2024-04-25T08:35:51.350 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T08:35:51.350 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub} --owner scheduled_neesingh@teuthology --archive /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996 --verbose --name neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi -- /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996/orig.config.yaml 2024-04-25T08:35:51.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T08:35:51.477 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996 branch: wip-neesingh-testing-240416 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7672996' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-neesingh-testing-240416 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62537 sha1: 5787d42d10024ba410e822a8aba474331cb9af02 owner: scheduled_neesingh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5869 sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-62537 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 5787d42d10024ba410e822a8aba474331cb9af02 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBND9fJUld9x5na72sfQkSEimJBJvAjDa7OsLSDbNFMUDQxIScptMIJ+nUm5g9Bl/jROSTagzLS9QUm+Bc6JSHgE= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBML4himyrBcCjd9Rjkz7VPdj8BI3YujYkfAGYTGQ5IBM4NhLN2rUfEdpieu+te3s3XjFTMtZ8usHDaYuxL+oBaM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_08:15:18 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T08:35:51.478 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa; will attempt to use it 2024-04-25T08:35:51.478 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks 2024-04-25T08:35:51.478 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T08:35:51.480 INFO:teuthology.task.internal:Checking packages... 2024-04-25T08:35:51.503 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec' 2024-04-25T08:35:51.503 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T08:35:51.504 INFO:teuthology.packaging:ref: None 2024-04-25T08:35:51.504 INFO:teuthology.packaging:tag: None 2024-04-25T08:35:51.504 INFO:teuthology.packaging:branch: wip-neesingh-testing-240416 2024-04-25T08:35:51.504 INFO:teuthology.packaging:sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:35:51.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-neesingh-testing-240416 2024-04-25T08:35:51.648 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1628.g97ae6cc9 2024-04-25T08:35:51.650 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T08:35:51.656 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T08:35:51.656 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T08:35:51.666 INFO:teuthology.task.internal:Saving configuration 2024-04-25T08:35:51.681 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T08:35:51.687 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T08:35:51.713 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:30:37.658034', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBND9fJUld9x5na72sfQkSEimJBJvAjDa7OsLSDbNFMUDQxIScptMIJ+nUm5g9Bl/jROSTagzLS9QUm+Bc6JSHgE='} 2024-04-25T08:35:51.735 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:30:37.659292', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBML4himyrBcCjd9Rjkz7VPdj8BI3YujYkfAGYTGQ5IBM4NhLN2rUfEdpieu+te3s3XjFTMtZ8usHDaYuxL+oBaM='} 2024-04-25T08:35:51.735 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T08:35:51.743 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T08:35:51.743 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T08:35:51.743 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T08:35:51.805 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f373ffe7160>, signals=[15]) 2024-04-25T08:35:51.806 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T08:35:51.812 INFO:teuthology.task.internal:Opening connections... 2024-04-25T08:35:51.812 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:35:51.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:35:51.900 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:35:51.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:35:51.987 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T08:35:51.994 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-25T08:35:52.012 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-25T08:35:52.012 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-25T08:35:52.069 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-25T08:35:52.069 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-04-25T08:35:52.069 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-25T08:35:52.069 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-25T08:35:52.069 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-04-25T08:35:52.069 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-04-25T08:35:52.070 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T08:35:52.070 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-25T08:35:52.070 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-04-25T08:35:52.070 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T08:35:52.070 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-25T08:35:52.070 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T08:35:52.070 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T08:35:52.070 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T08:35:52.071 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-25T08:35:52.093 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2024-04-25T08:35:52.111 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2024-04-25T08:35:52.111 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-04-25T08:35:52.168 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2024-04-25T08:35:52.168 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2024-04-25T08:35:52.168 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2024-04-25T08:35:52.168 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2024-04-25T08:35:52.169 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2024-04-25T08:35:52.169 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2024-04-25T08:35:52.169 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T08:35:52.169 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2024-04-25T08:35:52.169 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2024-04-25T08:35:52.169 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T08:35:52.169 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2024-04-25T08:35:52.169 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T08:35:52.169 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T08:35:52.169 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T08:35:52.169 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-04-25T08:35:52.194 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T08:35:52.203 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T08:35:52.208 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T08:35:52.208 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:35:52.211 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:35:52.227 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T08:35:52.233 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T08:35:52.233 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:35:52.267 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:35:52.360 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T08:35:52.414 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T08:35:52.430 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T08:35:52.430 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-25T08:35:52.430 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-25T08:35:52.430 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:35:52.431 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:35:52.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:35:52.448 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-04-25T08:35:52.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:35:52.449 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2024-04-25T08:35:52.504 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-437.el9.x86_64 2024-04-25T08:35:52.505 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.14.0-437.el9.x86_64 2024-04-25T08:35:52.505 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-04-25T08:35:52.506 INFO:teuthology.orchestra.run.smithi186.stdout:5.14.0-437.el9.x86_64 2024-04-25T08:35:52.506 INFO:teuthology.task.kernel:Running kernel on smithi186: 5.14.0-437.el9.x86_64 2024-04-25T08:35:52.506 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum install -y kernel 2024-04-25T08:35:55.073 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.0 MB 00:00 2024-04-25T08:35:56.034 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.0 MB 00:01 2024-04-25T08:35:58.074 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 19 MB 00:01 2024-04-25T08:36:01.284 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 19 MB 00:04 2024-04-25T08:36:02.924 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.2 MB 00:01 2024-04-25T08:36:04.709 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-04-25T08:36:05.717 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.2 MB 00:00 2024-04-25T08:36:06.121 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-25T08:36:07.160 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-04-25T08:36:08.362 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-25T08:36:11.193 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-04-25T08:36:13.032 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T08:36:13.033 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T08:36:13.125 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T08:36:13.126 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T08:36:13.127 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T08:36:13.246 DEBUG:teuthology.orchestra.run.smithi186:> echo no | sudo yum reinstall kernel || true 2024-04-25T08:36:13.411 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-04-25T08:36:13.745 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 08:36:11 AM UTC. 2024-04-25T08:36:13.886 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T08:36:13.893 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T08:36:13.893 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-25T08:36:13.893 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T08:36:13.893 INFO:teuthology.orchestra.run.smithi186.stdout:Reinstalling: 2024-04-25T08:36:13.893 INFO:teuthology.orchestra.run.smithi186.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:36:13.893 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:36:13.894 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T08:36:13.894 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T08:36:13.894 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:36:13.894 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 255 k 2024-04-25T08:36:13.894 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 0 2024-04-25T08:36:13.894 INFO:teuthology.orchestra.run.smithi186.stderr:Operation aborted. 2024-04-25T08:36:13.953 INFO:teuthology.orchestra.run.smithi186.stdout:Is this ok [y/N]: 2024-04-25T08:36:13.954 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum reinstall -y kernel || true 2024-04-25T08:36:14.447 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 08:36:11 AM UTC. 2024-04-25T08:36:14.564 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T08:36:14.564 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout:Reinstalling: 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 255 k 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 0 2024-04-25T08:36:14.565 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T08:36:15.267 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T08:36:15.268 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T08:36:15.270 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-5.14.0-437.el9.x86_64.rpm 593 kB/s | 255 kB 00:00 2024-04-25T08:36:15.270 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:36:15.270 INFO:teuthology.orchestra.run.smithi186.stdout:Total 361 kB/s | 255 kB 00:00 2024-04-25T08:36:15.290 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T08:36:15.361 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T08:36:15.363 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T08:36:15.363 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T08:36:15.479 DEBUG:teuthology.orchestra.run.smithi172:> echo no | sudo yum reinstall kernel || true 2024-04-25T08:36:15.487 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T08:36:15.487 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T08:36:15.491 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T08:36:15.491 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T08:36:15.621 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T08:36:15.721 INFO:teuthology.orchestra.run.smithi186.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:36:15.721 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:36:15.981 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 08:36:13 AM UTC. 2024-04-25T08:36:16.102 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T08:36:16.116 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T08:36:16.116 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-25T08:36:16.116 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T08:36:16.116 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalling: 2024-04-25T08:36:16.116 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:36:16.116 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:36:16.117 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T08:36:16.117 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T08:36:16.117 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:36:16.117 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 255 k 2024-04-25T08:36:16.117 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 0 2024-04-25T08:36:16.117 INFO:teuthology.orchestra.run.smithi172.stderr:Operation aborted. 2024-04-25T08:36:16.197 INFO:teuthology.orchestra.run.smithi172.stdout:Is this ok [y/N]: 2024-04-25T08:36:16.198 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum reinstall -y kernel || true 2024-04-25T08:36:16.456 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:36:16.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:36:16.693 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 08:36:13 AM UTC. 2024-04-25T08:36:16.810 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T08:36:16.810 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T08:36:16.810 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-25T08:36:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T08:36:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalling: 2024-04-25T08:36:16.811 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T08:36:16.811 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:36:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T08:36:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T08:36:16.811 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:36:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 255 k 2024-04-25T08:36:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 0 2024-04-25T08:36:16.811 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T08:36:17.122 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:36:17.122 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:36:17.122 INFO:teuthology.orchestra.run.smithi186.stdout:Reinstalled: 2024-04-25T08:36:17.122 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T08:36:17.122 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:36:17.122 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T08:36:17.308 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T08:36:17.355 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T08:36:17.355 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T08:36:17.356 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T08:36:17.356 DEBUG:teuthology.parallel:result is None 2024-04-25T08:36:17.539 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-437.el9.x86_64.rpm 559 kB/s | 255 kB 00:00 2024-04-25T08:36:17.539 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:36:17.539 INFO:teuthology.orchestra.run.smithi172.stdout:Total 350 kB/s | 255 kB 00:00 2024-04-25T08:36:17.558 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T08:36:17.759 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T08:36:17.759 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T08:36:17.764 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T08:36:17.764 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T08:36:17.910 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T08:36:17.990 INFO:teuthology.orchestra.run.smithi172.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:36:17.990 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:36:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:36:18.702 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T08:36:19.414 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T08:36:19.414 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:36:19.414 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalled: 2024-04-25T08:36:19.414 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T08:36:19.414 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:36:19.414 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T08:36:19.608 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T08:36:19.654 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T08:36:19.655 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T08:36:19.655 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T08:36:19.655 DEBUG:teuthology.parallel:result is None 2024-04-25T08:36:19.655 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T08:36:19.663 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T08:36:19.663 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:36:19.666 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:36:19.683 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T08:36:19.690 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T08:36:19.697 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T08:36:19.697 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:36:19.720 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:36:19.845 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T08:36:19.852 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T08:36:19.853 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:36:19.855 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:36:19.884 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:36:19.888 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:36:19.903 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:36:19.904 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:36:19.906 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T08:36:19.913 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T08:36:19.913 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:36:19.948 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:36:19.975 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T08:36:19.984 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T08:36:19.985 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:36:20.012 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:36:20.031 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:36:20.105 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:36:20.154 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:36:20.235 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:36:20.274 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:36:20.275 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:36:20.337 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:36:20.380 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:36:20.431 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:36:20.515 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:36:20.557 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:36:20.557 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:36:20.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-04-25T08:36:20.625 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2024-04-25T08:36:20.660 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T08:36:20.700 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T08:36:21.033 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T08:36:21.041 INFO:teuthology.task.internal:Starting timer... 2024-04-25T08:36:21.041 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T08:36:21.052 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T08:36:21.060 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-04-25T08:36:21.111 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-04-25T08:36:21.113 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2024-04-25T08:36:21.160 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2024-04-25T08:36:21.162 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T08:36:21.162 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-04-25T08:36:21.202 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-04-25T08:36:21.202 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2024-04-25T08:36:21.222 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2024-04-25T08:36:21.222 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi172.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive'} 2024-04-25T08:36:21.222 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T08:36:21.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:36:21.267 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T08:36:21.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:36:21.291 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T08:36:21.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-04-25T08:36:21.331 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2024-04-25T08:36:21.355 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T08:36:21.364 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T08:36:21.370 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T08:36:21.486 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T08:36:21.501 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T08:36:21.502 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi172.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T08:39:47.769 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi172.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2024-04-25T08:39:47.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T08:39:47.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:39:47.846 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-25T08:39:47.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T08:39:47.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T08:39:47.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:39:48.006 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-04-25T08:39:48.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T08:39:48.085 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T08:39:48.097 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T08:39:48.097 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T08:39:48.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:39:48.100 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T08:39:48.100 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:39:48.126 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T08:39:48.139 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T08:39:48.154 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T08:39:48.162 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-04-25T08:39:48.167 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T08:39:48.173 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-04-25T08:39:48.186 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T08:39:48.189 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2024-04-25T08:39:48.199 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T08:39:48.199 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2024-04-25T08:39:48.212 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T08:39:48.225 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T08:39:48.252 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-04-25T08:39:48.255 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T08:39:48.255 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-04-25T08:39:48.256 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:39:48.256 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:39:48.256 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:39:48.256 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:39:48.276 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-04-25T08:39:48.280 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T08:39:48.280 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-04-25T08:39:48.280 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:39:48.280 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:39:48.280 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:39:48.280 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:39:48.281 INFO:teuthology.run_tasks:Running task install... 2024-04-25T08:39:48.289 DEBUG:teuthology.task.install:project ceph 2024-04-25T08:39:48.289 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}} 2024-04-25T08:39:48.290 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'} 2024-04-25T08:39:48.290 INFO:teuthology.task.install:Using flavor: default 2024-04-25T08:39:48.295 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T08:39:48.295 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T08:39:48.296 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'tag': None, 'wait_for_package': False} 2024-04-25T08:39:48.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:39:48.298 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'tag': None, 'wait_for_package': False} 2024-04-25T08:39:48.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:39:48.438 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/ 2024-04-25T08:39:48.438 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1628.g97ae6cc9 2024-04-25T08:39:48.448 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/ 2024-04-25T08:39:48.448 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1628.g97ae6cc9 2024-04-25T08:39:48.550 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T08:39:48.551 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:39:48.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T08:39:48.577 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T08:39:48.577 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T08:39:48.579 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T08:39:48.579 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:39:48.579 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T08:39:48.604 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T08:39:48.605 DEBUG:teuthology.orchestra.run.smithi186:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T08:39:48.641 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T08:39:48.670 DEBUG:teuthology.orchestra.run.smithi186:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T08:39:48.715 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T08:39:48.744 DEBUG:teuthology.orchestra.run.smithi186:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T08:39:48.778 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-04-25T08:39:48.779 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-04-25T08:39:48.808 INFO:teuthology.orchestra.run.smithi186.stdout:check_obsoletes = 1 2024-04-25T08:39:48.809 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum clean all 2024-04-25T08:39:49.004 INFO:teuthology.orchestra.run.smithi172.stdout:48 files removed 2024-04-25T08:39:49.031 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T08:39:49.032 INFO:teuthology.orchestra.run.smithi186.stdout:48 files removed 2024-04-25T08:39:49.058 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T08:39:49.619 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 251 kB/s | 82 kB 00:00 2024-04-25T08:39:49.681 INFO:teuthology.orchestra.run.smithi186.stdout:ceph packages for x86_64 225 kB/s | 82 kB 00:00 2024-04-25T08:39:49.964 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 33 kB/s | 10 kB 00:00 2024-04-25T08:39:50.032 INFO:teuthology.orchestra.run.smithi186.stdout:ceph noarch packages 33 kB/s | 10 kB 00:00 2024-04-25T08:39:50.321 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-04-25T08:39:50.366 INFO:teuthology.orchestra.run.smithi186.stdout:ceph source packages 6.3 kB/s | 1.9 kB 00:00 2024-04-25T08:39:52.254 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.0 MB 00:01 2024-04-25T08:39:52.399 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.0 MB 00:01 2024-04-25T08:39:53.999 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-04-25T08:39:55.192 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-04-25T08:39:57.990 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-25T08:39:59.340 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 16 kB 00:00 2024-04-25T08:39:59.560 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.2 MB 00:00 2024-04-25T08:40:00.403 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-04-25T08:40:01.919 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-04-25T08:40:02.795 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 28 MB/s | 21 MB 00:00 2024-04-25T08:40:05.375 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-25T08:40:07.509 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:40:07.510 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:40:07.520 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T08:40:07.521 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T08:40:07.522 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T08:40:07.523 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T08:40:07.524 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T08:40:07.526 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T08:40:07.527 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T08:40:07.588 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 6.6 k 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.3 M 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 887 k 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 145 k 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 1.5 M 2024-04-25T08:40:07.597 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 138 k 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 1.8 M 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 7.4 M 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 49 k 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 9.8 M 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 47 M 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 264 k 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 748 k 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 220 k 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 27 k 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 18 k 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T08:40:07.598 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 31 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 744 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 127 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 162 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 321 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 298 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 99 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 85 k 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:40:07.599 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 170 k 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.4 M 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 20 M 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 31 k 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 2.1 M 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 248 k 2024-04-25T08:40:07.600 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 4.7 M 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 17 M 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 15 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 25 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 163 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T08:40:07.601 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 501 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.1 M 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T08:40:07.602 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 45 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 131 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T08:40:07.603 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T08:40:07.604 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T08:40:07.605 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T08:40:07.606 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-04-25T08:40:07.607 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T08:40:07.608 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:40:07.608 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T08:40:07.608 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-25T08:40:07.608 INFO:teuthology.orchestra.run.smithi172.stdout:Install 148 Packages 2024-04-25T08:40:07.608 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 4 Packages 2024-04-25T08:40:07.608 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:40:07.608 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 215 M 2024-04-25T08:40:07.608 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T08:40:07.996 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 9.4 kB/s | 1.7 kB 00:00 2024-04-25T08:40:08.268 INFO:teuthology.orchestra.run.smithi172.stdout:(1/152): ceph-19.0.0-1628.g97ae6cc9.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-04-25T08:40:08.518 INFO:teuthology.orchestra.run.smithi172.stdout:(2/152): ceph-fuse-19.0.0-1628.g97ae6cc9.el9.x8 3.5 MB/s | 887 kB 00:00 2024-04-25T08:40:08.594 INFO:teuthology.orchestra.run.smithi172.stdout:(3/152): ceph-immutable-object-cache-19.0.0-162 1.9 MB/s | 145 kB 00:00 2024-04-25T08:40:08.819 INFO:teuthology.orchestra.run.smithi172.stdout:(4/152): ceph-base-19.0.0-1628.g97ae6cc9.el9.x8 7.5 MB/s | 5.3 MB 00:00 2024-04-25T08:40:08.869 INFO:teuthology.orchestra.run.smithi172.stdout:(5/152): ceph-mds-19.0.0-1628.g97ae6cc9.el9.x86 7.7 MB/s | 2.1 MB 00:00 2024-04-25T08:40:08.961 INFO:teuthology.orchestra.run.smithi172.stdout:(6/152): ceph-mgr-19.0.0-1628.g97ae6cc9.el9.x86 11 MB/s | 1.5 MB 00:00 2024-04-25T08:40:09.519 INFO:teuthology.orchestra.run.smithi172.stdout:(7/152): ceph-mon-19.0.0-1628.g97ae6cc9.el9.x86 7.2 MB/s | 4.7 MB 00:00 2024-04-25T08:40:10.206 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:40:10.206 INFO:teuthology.orchestra.run.smithi186.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T08:40:10.217 INFO:teuthology.orchestra.run.smithi186.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T08:40:10.217 INFO:teuthology.orchestra.run.smithi186.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T08:40:10.218 INFO:teuthology.orchestra.run.smithi186.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T08:40:10.219 INFO:teuthology.orchestra.run.smithi186.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T08:40:10.221 INFO:teuthology.orchestra.run.smithi186.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T08:40:10.223 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T08:40:10.224 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T08:40:10.286 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T08:40:10.295 INFO:teuthology.orchestra.run.smithi186.stdout:======================================================================================= 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout:======================================================================================= 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: ceph x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 6.6 k 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.3 M 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 887 k 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 145 k 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 1.5 M 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 138 k 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 1.8 M 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 7.4 M 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 49 k 2024-04-25T08:40:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 9.8 M 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 47 M 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 264 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 748 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 220 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 27 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 18 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 31 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 744 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 127 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T08:40:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 162 k 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 321 k 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 298 k 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 99 k 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 85 k 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 170 k 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrading: 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.4 M 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 3.1 M 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T08:40:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 20 M 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 31 k 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 2.1 M 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 248 k 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 4.7 M 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 17 M 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1628.g97ae6cc9.el9 ceph-noarch 15 k 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 25 k 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T08:40:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 163 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 501 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2 x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 5.1 M 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T08:40:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 45 k 2024-04-25T08:40:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common x86_64 2:19.0.0-1628.g97ae6cc9.el9 ceph 131 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T08:40:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T08:40:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T08:40:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T08:40:10.305 INFO:teuthology.orchestra.run.smithi186.stdout:Installing weak dependencies: 2024-04-25T08:40:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T08:40:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:40:10.306 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T08:40:10.306 INFO:teuthology.orchestra.run.smithi186.stdout:======================================================================================= 2024-04-25T08:40:10.306 INFO:teuthology.orchestra.run.smithi186.stdout:Install 148 Packages 2024-04-25T08:40:10.306 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrade 4 Packages 2024-04-25T08:40:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:40:10.306 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 215 M 2024-04-25T08:40:10.306 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T08:40:10.320 INFO:teuthology.orchestra.run.smithi172.stdout:(8/152): ceph-common-19.0.0-1628.g97ae6cc9.el9. 9.0 MB/s | 20 MB 00:02 2024-04-25T08:40:10.403 INFO:teuthology.orchestra.run.smithi172.stdout:(9/152): ceph-selinux-19.0.0-1628.g97ae6cc9.el9 303 kB/s | 25 kB 00:00 2024-04-25T08:40:10.662 INFO:teuthology.orchestra.run.smithi172.stdout:(10/152): ceph-osd-19.0.0-1628.g97ae6cc9.el9.x8 9.9 MB/s | 17 MB 00:01 2024-04-25T08:40:10.770 INFO:teuthology.orchestra.run.smithi172.stdout:(11/152): ceph-radosgw-19.0.0-1628.g97ae6cc9.el 7.8 MB/s | 9.8 MB 00:01 2024-04-25T08:40:10.795 INFO:teuthology.orchestra.run.smithi172.stdout:(12/152): cephfs-mirror-19.0.0-1628.g97ae6cc9.e 1.6 MB/s | 220 kB 00:00 2024-04-25T08:40:10.829 INFO:teuthology.orchestra.run.smithi172.stdout:(13/152): cephfs-shell-19.0.0-1628.g97ae6cc9.el 462 kB/s | 27 kB 00:00 2024-04-25T08:40:10.854 INFO:teuthology.orchestra.run.smithi172.stdout:(14/152): libcephfs-devel-19.0.0-1628.g97ae6cc9 531 kB/s | 31 kB 00:00 2024-04-25T08:40:10.930 INFO:teuthology.orchestra.run.smithi172.stdout:(15/152): libcephsqlite-19.0.0-1628.g97ae6cc9.e 2.1 MB/s | 163 kB 00:00 2024-04-25T08:40:10.955 INFO:teuthology.orchestra.run.smithi172.stdout:(16/152): libcephfs2-19.0.0-1628.g97ae6cc9.el9. 5.8 MB/s | 744 kB 00:00 2024-04-25T08:40:10.988 INFO:teuthology.orchestra.run.smithi172.stdout:(17/152): librados-devel-19.0.0-1628.g97ae6cc9. 2.1 MB/s | 127 kB 00:00 2024-04-25T08:40:11.031 INFO:teuthology.orchestra.run.smithi172.stdout:(18/152): libradosstriper1-19.0.0-1628.g97ae6cc 6.5 MB/s | 501 kB 00:00 2024-04-25T08:40:11.106 INFO:teuthology.orchestra.run.smithi172.stdout:(19/152): python3-ceph-argparse-19.0.0-1628.g97 601 kB/s | 45 kB 00:00 2024-04-25T08:40:11.172 INFO:teuthology.orchestra.run.smithi186.stdout:(1/152): ceph-19.0.0-1628.g97ae6cc9.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-04-25T08:40:11.189 INFO:teuthology.orchestra.run.smithi172.stdout:(20/152): python3-ceph-common-19.0.0-1628.g97ae 1.5 MB/s | 131 kB 00:00 2024-04-25T08:40:11.265 INFO:teuthology.orchestra.run.smithi172.stdout:(21/152): python3-cephfs-19.0.0-1628.g97ae6cc9. 2.1 MB/s | 162 kB 00:00 2024-04-25T08:40:11.357 INFO:teuthology.orchestra.run.smithi172.stdout:(22/152): python3-rados-19.0.0-1628.g97ae6cc9.e 3.4 MB/s | 321 kB 00:00 2024-04-25T08:40:11.451 INFO:teuthology.orchestra.run.smithi172.stdout:(23/152): python3-rbd-19.0.0-1628.g97ae6cc9.el9 3.1 MB/s | 298 kB 00:00 2024-04-25T08:40:11.518 INFO:teuthology.orchestra.run.smithi172.stdout:(24/152): librgw2-19.0.0-1628.g97ae6cc9.el9.x86 9.7 MB/s | 5.1 MB 00:00 2024-04-25T08:40:11.544 INFO:teuthology.orchestra.run.smithi172.stdout:(25/152): python3-rgw-19.0.0-1628.g97ae6cc9.el9 1.0 MB/s | 99 kB 00:00 2024-04-25T08:40:11.577 INFO:teuthology.orchestra.run.smithi172.stdout:(26/152): rbd-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-25T08:40:11.661 INFO:teuthology.orchestra.run.smithi172.stdout:(27/152): rbd-nbd-19.0.0-1628.g97ae6cc9.el9.x86 2.0 MB/s | 170 kB 00:00 2024-04-25T08:40:11.752 INFO:teuthology.orchestra.run.smithi172.stdout:(28/152): ceph-grafana-dashboards-19.0.0-1628.g 343 kB/s | 31 kB 00:00 2024-04-25T08:40:11.830 INFO:teuthology.orchestra.run.smithi186.stdout:(2/152): ceph-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.3 MB/s | 887 kB 00:00 2024-04-25T08:40:11.844 INFO:teuthology.orchestra.run.smithi172.stdout:(29/152): ceph-mgr-cephadm-19.0.0-1628.g97ae6cc 1.5 MB/s | 138 kB 00:00 2024-04-25T08:40:11.945 INFO:teuthology.orchestra.run.smithi172.stdout:(30/152): rbd-mirror-19.0.0-1628.g97ae6cc9.el9. 7.7 MB/s | 3.1 MB 00:00 2024-04-25T08:40:11.980 INFO:teuthology.orchestra.run.smithi186.stdout:(3/152): ceph-immutable-object-cache-19.0.0-162 972 kB/s | 145 kB 00:00 2024-04-25T08:40:12.454 INFO:teuthology.orchestra.run.smithi172.stdout:(31/152): ceph-mgr-dashboard-19.0.0-1628.g97ae6 2.9 MB/s | 1.8 MB 00:00 2024-04-25T08:40:12.554 INFO:teuthology.orchestra.run.smithi172.stdout:(32/152): ceph-mgr-modules-core-19.0.0-1628.g97 2.4 MB/s | 248 kB 00:00 2024-04-25T08:40:12.646 INFO:teuthology.orchestra.run.smithi172.stdout:(33/152): ceph-mgr-rook-19.0.0-1628.g97ae6cc9.e 539 kB/s | 49 kB 00:00 2024-04-25T08:40:12.738 INFO:teuthology.orchestra.run.smithi172.stdout:(34/152): ceph-prometheus-alerts-19.0.0-1628.g9 167 kB/s | 15 kB 00:00 2024-04-25T08:40:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:(4/152): ceph-base-19.0.0-1628.g97ae6cc9.el9.x8 2.9 MB/s | 5.3 MB 00:01 2024-04-25T08:40:12.821 INFO:teuthology.orchestra.run.smithi172.stdout:(35/152): ceph-volume-19.0.0-1628.g97ae6cc9.el9 3.1 MB/s | 264 kB 00:00 2024-04-25T08:40:13.071 INFO:teuthology.orchestra.run.smithi172.stdout:(36/152): cephadm-19.0.0-1628.g97ae6cc9.el9.noa 2.9 MB/s | 748 kB 00:00 2024-04-25T08:40:13.122 INFO:teuthology.orchestra.run.smithi186.stdout:(5/152): ceph-mgr-19.0.0-1628.g97ae6cc9.el9.x86 4.2 MB/s | 1.5 MB 00:00 2024-04-25T08:40:13.164 INFO:teuthology.orchestra.run.smithi172.stdout:(37/152): ceph-mgr-diskprediction-local-19.0.0- 6.1 MB/s | 7.4 MB 00:01 2024-04-25T08:40:13.188 INFO:teuthology.orchestra.run.smithi172.stdout:(38/152): cephfs-top-19.0.0-1628.g97ae6cc9.el9. 156 kB/s | 18 kB 00:00 2024-04-25T08:40:13.372 INFO:teuthology.orchestra.run.smithi172.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 386 kB/s | 80 kB 00:00 2024-04-25T08:40:13.481 INFO:teuthology.orchestra.run.smithi186.stdout:(6/152): ceph-mds-19.0.0-1628.g97ae6cc9.el9.x86 1.4 MB/s | 2.1 MB 00:01 2024-04-25T08:40:13.631 INFO:teuthology.orchestra.run.smithi172.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 756 kB/s | 195 kB 00:00 2024-04-25T08:40:13.656 INFO:teuthology.orchestra.run.smithi172.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 803 kB 00:00 2024-04-25T08:40:13.890 INFO:teuthology.orchestra.run.smithi172.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 980 kB/s | 253 kB 00:00 2024-04-25T08:40:13.923 INFO:teuthology.orchestra.run.smithi186.stdout:(7/152): ceph-mon-19.0.0-1628.g97ae6cc9.el9.x86 5.9 MB/s | 4.7 MB 00:00 2024-04-25T08:40:14.290 INFO:teuthology.orchestra.run.smithi172.stdout:(43/152): ceph-test-19.0.0-1628.g97ae6cc9.el9.x 12 MB/s | 47 MB 00:03 2024-04-25T08:40:14.357 INFO:teuthology.orchestra.run.smithi172.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 1.7 MB/s | 1.2 MB 00:00 2024-04-25T08:40:14.466 INFO:teuthology.orchestra.run.smithi172.stdout:(45/152): python3-ply-3.11-14.el9.noarch.rpm 185 kB/s | 106 kB 00:00 2024-04-25T08:40:14.491 INFO:teuthology.orchestra.run.smithi172.stdout:(46/152): python3-pycparser-2.20-6.el9.noarch.r 675 kB/s | 135 kB 00:00 2024-04-25T08:40:14.600 INFO:teuthology.orchestra.run.smithi172.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 516 kB/s | 125 kB 00:00 2024-04-25T08:40:14.716 INFO:teuthology.orchestra.run.smithi172.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 857 kB/s | 215 kB 00:00 2024-04-25T08:40:14.809 INFO:teuthology.orchestra.run.smithi172.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-04-25T08:40:14.859 INFO:teuthology.orchestra.run.smithi172.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 430 kB/s | 21 kB 00:00 2024-04-25T08:40:14.901 INFO:teuthology.orchestra.run.smithi172.stdout:(51/152): boost-program-options-1.75.0-8.el9.x8 581 kB/s | 107 kB 00:00 2024-04-25T08:40:14.934 INFO:teuthology.orchestra.run.smithi172.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-04-25T08:40:14.960 INFO:teuthology.orchestra.run.smithi172.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-04-25T08:40:15.010 INFO:teuthology.orchestra.run.smithi172.stdout:(54/152): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-04-25T08:40:15.035 INFO:teuthology.orchestra.run.smithi172.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-04-25T08:40:15.077 INFO:teuthology.orchestra.run.smithi172.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-04-25T08:40:15.119 INFO:teuthology.orchestra.run.smithi172.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-04-25T08:40:15.144 INFO:teuthology.orchestra.run.smithi172.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-04-25T08:40:15.195 INFO:teuthology.orchestra.run.smithi172.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-04-25T08:40:15.253 INFO:teuthology.orchestra.run.smithi172.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 437 kB/s | 25 kB 00:00 2024-04-25T08:40:15.295 INFO:teuthology.orchestra.run.smithi172.stdout:(61/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-04-25T08:40:15.320 INFO:teuthology.orchestra.run.smithi172.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-04-25T08:40:15.346 INFO:teuthology.orchestra.run.smithi172.stdout:(63/152): libtool-2.4.6-45.el9.x86_64.rpm 2.8 MB/s | 582 kB 00:00 2024-04-25T08:40:15.371 INFO:teuthology.orchestra.run.smithi172.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-25T08:40:15.396 INFO:teuthology.orchestra.run.smithi172.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-25T08:40:15.421 INFO:teuthology.orchestra.run.smithi172.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 466 kB/s | 35 kB 00:00 2024-04-25T08:40:15.714 INFO:teuthology.orchestra.run.smithi172.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-25T08:40:15.756 INFO:teuthology.orchestra.run.smithi186.stdout:(8/152): ceph-radosgw-19.0.0-1628.g97ae6cc9.el9 5.3 MB/s | 9.8 MB 00:01 2024-04-25T08:40:15.772 INFO:teuthology.orchestra.run.smithi172.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-04-25T08:40:15.806 INFO:teuthology.orchestra.run.smithi172.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-04-25T08:40:15.823 INFO:teuthology.orchestra.run.smithi186.stdout:(9/152): ceph-selinux-19.0.0-1628.g97ae6cc9.el9 380 kB/s | 25 kB 00:00 2024-04-25T08:40:15.839 INFO:teuthology.orchestra.run.smithi172.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 7.1 MB/s | 911 kB 00:00 2024-04-25T08:40:15.864 INFO:teuthology.orchestra.run.smithi172.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-25T08:40:15.923 INFO:teuthology.orchestra.run.smithi172.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T08:40:15.956 INFO:teuthology.orchestra.run.smithi172.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-04-25T08:40:16.024 INFO:teuthology.orchestra.run.smithi172.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-04-25T08:40:16.091 INFO:teuthology.orchestra.run.smithi172.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-04-25T08:40:16.149 INFO:teuthology.orchestra.run.smithi172.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 442 kB/s | 26 kB 00:00 2024-04-25T08:40:16.208 INFO:teuthology.orchestra.run.smithi172.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-04-25T08:40:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-25T08:40:16.359 INFO:teuthology.orchestra.run.smithi172.stdout:(79/152): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-04-25T08:40:16.376 INFO:teuthology.orchestra.run.smithi172.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-04-25T08:40:16.442 INFO:teuthology.orchestra.run.smithi172.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-04-25T08:40:16.518 INFO:teuthology.orchestra.run.smithi172.stdout:(82/152): postgresql-server-13.14-1.el9.x86_64. 8.1 MB/s | 5.8 MB 00:00 2024-04-25T08:40:16.543 INFO:teuthology.orchestra.run.smithi172.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-04-25T08:40:16.576 INFO:teuthology.orchestra.run.smithi172.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-25T08:40:16.594 INFO:teuthology.orchestra.run.smithi172.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-04-25T08:40:16.660 INFO:teuthology.orchestra.run.smithi172.stdout:(86/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-04-25T08:40:16.686 INFO:teuthology.orchestra.run.smithi172.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-04-25T08:40:16.711 INFO:teuthology.orchestra.run.smithi172.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-04-25T08:40:16.736 INFO:teuthology.orchestra.run.smithi172.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-25T08:40:16.761 INFO:teuthology.orchestra.run.smithi172.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-04-25T08:40:16.787 INFO:teuthology.orchestra.run.smithi172.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-04-25T08:40:16.820 INFO:teuthology.orchestra.run.smithi172.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-04-25T08:40:16.862 INFO:teuthology.orchestra.run.smithi172.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-04-25T08:40:16.896 INFO:teuthology.orchestra.run.smithi172.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-04-25T08:40:16.921 INFO:teuthology.orchestra.run.smithi172.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-04-25T08:40:16.955 INFO:teuthology.orchestra.run.smithi172.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-04-25T08:40:16.981 INFO:teuthology.orchestra.run.smithi172.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T08:40:17.030 INFO:teuthology.orchestra.run.smithi172.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-04-25T08:40:17.056 INFO:teuthology.orchestra.run.smithi172.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-04-25T08:40:17.089 INFO:teuthology.orchestra.run.smithi172.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-25T08:40:17.114 INFO:teuthology.orchestra.run.smithi172.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-04-25T08:40:17.349 INFO:teuthology.orchestra.run.smithi172.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-04-25T08:40:17.373 INFO:teuthology.orchestra.run.smithi172.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-04-25T08:40:17.757 INFO:teuthology.orchestra.run.smithi172.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-04-25T08:40:18.041 INFO:teuthology.orchestra.run.smithi172.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 463 kB/s | 309 kB 00:00 2024-04-25T08:40:18.149 INFO:teuthology.orchestra.run.smithi172.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 50 kB/s | 19 kB 00:00 2024-04-25T08:40:18.174 INFO:teuthology.orchestra.run.smithi172.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 664 kB/s | 548 kB 00:00 2024-04-25T08:40:18.291 INFO:teuthology.orchestra.run.smithi172.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 417 kB/s | 49 kB 00:00 2024-04-25T08:40:18.325 INFO:teuthology.orchestra.run.smithi172.stdout:(109/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 148 kB/s | 26 kB 00:00 2024-04-25T08:40:18.401 INFO:teuthology.orchestra.run.smithi172.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2024-04-25T08:40:18.534 INFO:teuthology.orchestra.run.smithi172.stdout:(111/152): libarrow-9.0.0-10.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-04-25T08:40:18.610 INFO:teuthology.orchestra.run.smithi172.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2024-04-25T08:40:18.651 INFO:teuthology.orchestra.run.smithi172.stdout:(113/152): luarocks-3.9.2-1.el9.noarch.rpm 464 kB/s | 151 kB 00:00 2024-04-25T08:40:18.693 INFO:teuthology.orchestra.run.smithi172.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-04-25T08:40:18.727 INFO:teuthology.orchestra.run.smithi172.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 371 kB/s | 43 kB 00:00 2024-04-25T08:40:18.777 INFO:teuthology.orchestra.run.smithi172.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 257 kB/s | 32 kB 00:00 2024-04-25T08:40:18.879 INFO:teuthology.orchestra.run.smithi172.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 81 kB/s | 15 kB 00:00 2024-04-25T08:40:18.911 INFO:teuthology.orchestra.run.smithi172.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 934 kB/s | 172 kB 00:00 2024-04-25T08:40:18.995 INFO:teuthology.orchestra.run.smithi172.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.6 MB/s | 303 kB 00:00 2024-04-25T08:40:19.045 INFO:teuthology.orchestra.run.smithi172.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 264 kB/s | 35 kB 00:00 2024-04-25T08:40:19.070 INFO:teuthology.orchestra.run.smithi172.stdout:(121/152): python3-cherrypy-18.6.1-2.el9.noarch 1.2 MB/s | 358 kB 00:00 2024-04-25T08:40:19.120 INFO:teuthology.orchestra.run.smithi172.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.6 MB/s | 206 kB 00:00 2024-04-25T08:40:19.212 INFO:teuthology.orchestra.run.smithi172.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-04-25T08:40:19.238 INFO:teuthology.orchestra.run.smithi172.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 91 kB/s | 11 kB 00:00 2024-04-25T08:40:19.313 INFO:teuthology.orchestra.run.smithi172.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.6 MB/s | 2.0 MB 00:00 2024-04-25T08:40:19.338 INFO:teuthology.orchestra.run.smithi172.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2024-04-25T08:40:19.355 INFO:teuthology.orchestra.run.smithi172.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 197 kB/s | 23 kB 00:00 2024-04-25T08:40:19.414 INFO:teuthology.orchestra.run.smithi172.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-04-25T08:40:19.430 INFO:teuthology.orchestra.run.smithi172.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-04-25T08:40:19.523 INFO:teuthology.orchestra.run.smithi172.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 425 kB/s | 46 kB 00:00 2024-04-25T08:40:19.548 INFO:teuthology.orchestra.run.smithi172.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 674 kB/s | 79 kB 00:00 2024-04-25T08:40:19.623 INFO:teuthology.orchestra.run.smithi172.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 576 kB/s | 58 kB 00:00 2024-04-25T08:40:19.657 INFO:teuthology.orchestra.run.smithi172.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-04-25T08:40:19.682 INFO:teuthology.orchestra.run.smithi172.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-04-25T08:40:19.741 INFO:teuthology.orchestra.run.smithi172.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-04-25T08:40:19.783 INFO:teuthology.orchestra.run.smithi172.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 717 kB/s | 90 kB 00:00 2024-04-25T08:40:19.808 INFO:teuthology.orchestra.run.smithi172.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 225 kB/s | 28 kB 00:00 2024-04-25T08:40:19.850 INFO:teuthology.orchestra.run.smithi172.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 282 kB/s | 31 kB 00:00 2024-04-25T08:40:19.934 INFO:teuthology.orchestra.run.smithi172.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-04-25T08:40:19.959 INFO:teuthology.orchestra.run.smithi172.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 392 kB/s | 59 kB 00:00 2024-04-25T08:40:19.993 INFO:teuthology.orchestra.run.smithi172.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 251 kB/s | 36 kB 00:00 2024-04-25T08:40:20.076 INFO:teuthology.orchestra.run.smithi172.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 359 kB/s | 51 kB 00:00 2024-04-25T08:40:20.101 INFO:teuthology.orchestra.run.smithi172.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-04-25T08:40:20.135 INFO:teuthology.orchestra.run.smithi172.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 630 kB/s | 90 kB 00:00 2024-04-25T08:40:20.227 INFO:teuthology.orchestra.run.smithi172.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 160 kB/s | 20 kB 00:00 2024-04-25T08:40:20.261 INFO:teuthology.orchestra.run.smithi172.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-04-25T08:40:20.281 INFO:teuthology.orchestra.run.smithi186.stdout:(10/152): ceph-osd-19.0.0-1628.g97ae6cc9.el9.x8 2.5 MB/s | 17 MB 00:06 2024-04-25T08:40:20.286 INFO:teuthology.orchestra.run.smithi172.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-04-25T08:40:20.389 INFO:teuthology.orchestra.run.smithi186.stdout:(11/152): cephfs-mirror-19.0.0-1628.g97ae6cc9.e 2.0 MB/s | 220 kB 00:00 2024-04-25T08:40:20.456 INFO:teuthology.orchestra.run.smithi186.stdout:(12/152): cephfs-shell-19.0.0-1628.g97ae6cc9.el 406 kB/s | 27 kB 00:00 2024-04-25T08:40:20.524 INFO:teuthology.orchestra.run.smithi186.stdout:(13/152): libcephfs-devel-19.0.0-1628.g97ae6cc9 467 kB/s | 31 kB 00:00 2024-04-25T08:40:20.644 INFO:teuthology.orchestra.run.smithi172.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 3.8 MB/s | 1.6 MB 00:00 2024-04-25T08:40:20.761 INFO:teuthology.orchestra.run.smithi172.stdout:(149/152): librados2-19.0.0-1628.g97ae6cc9.el9. 6.7 MB/s | 3.4 MB 00:00 2024-04-25T08:40:20.807 INFO:teuthology.orchestra.run.smithi186.stdout:(14/152): ceph-common-19.0.0-1628.g97ae6cc9.el9 2.0 MB/s | 20 MB 00:09 2024-04-25T08:40:20.849 INFO:teuthology.orchestra.run.smithi186.stdout:(15/152): libcephfs2-19.0.0-1628.g97ae6cc9.el9. 2.2 MB/s | 744 kB 00:00 2024-04-25T08:40:20.908 INFO:teuthology.orchestra.run.smithi186.stdout:(16/152): librados-devel-19.0.0-1628.g97ae6cc9. 2.1 MB/s | 127 kB 00:00 2024-04-25T08:40:20.932 INFO:teuthology.orchestra.run.smithi186.stdout:(17/152): libcephsqlite-19.0.0-1628.g97ae6cc9.e 1.3 MB/s | 163 kB 00:00 2024-04-25T08:40:21.066 INFO:teuthology.orchestra.run.smithi186.stdout:(18/152): libradosstriper1-19.0.0-1628.g97ae6cc 3.1 MB/s | 501 kB 00:00 2024-04-25T08:40:21.125 INFO:teuthology.orchestra.run.smithi186.stdout:(19/152): python3-ceph-argparse-19.0.0-1628.g97 774 kB/s | 45 kB 00:00 2024-04-25T08:40:21.192 INFO:teuthology.orchestra.run.smithi186.stdout:(20/152): python3-ceph-common-19.0.0-1628.g97ae 1.9 MB/s | 131 kB 00:00 2024-04-25T08:40:21.259 INFO:teuthology.orchestra.run.smithi186.stdout:(21/152): python3-cephfs-19.0.0-1628.g97ae6cc9. 2.4 MB/s | 162 kB 00:00 2024-04-25T08:40:21.381 INFO:teuthology.orchestra.run.smithi172.stdout:(150/152): librbd1-19.0.0-1628.g97ae6cc9.el9.x8 2.9 MB/s | 3.1 MB 00:01 2024-04-25T08:40:21.384 INFO:teuthology.orchestra.run.smithi186.stdout:(22/152): python3-rados-19.0.0-1628.g97ae6cc9.e 2.5 MB/s | 321 kB 00:00 2024-04-25T08:40:21.484 INFO:teuthology.orchestra.run.smithi186.stdout:(23/152): python3-rbd-19.0.0-1628.g97ae6cc9.el9 2.9 MB/s | 298 kB 00:00 2024-04-25T08:40:21.543 INFO:teuthology.orchestra.run.smithi186.stdout:(24/152): python3-rgw-19.0.0-1628.g97ae6cc9.el9 1.7 MB/s | 99 kB 00:00 2024-04-25T08:40:21.602 INFO:teuthology.orchestra.run.smithi186.stdout:(25/152): rbd-fuse-19.0.0-1628.g97ae6cc9.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-25T08:40:21.612 INFO:teuthology.orchestra.run.smithi172.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 1.4 MB/s | 1.3 MB 00:00 2024-04-25T08:40:21.795 INFO:teuthology.orchestra.run.smithi172.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-04-25T08:40:21.802 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:40:21.802 INFO:teuthology.orchestra.run.smithi172.stdout:Total 15 MB/s | 215 MB 00:14 2024-04-25T08:40:22.269 INFO:teuthology.orchestra.run.smithi186.stdout:(26/152): rbd-mirror-19.0.0-1628.g97ae6cc9.el9. 4.6 MB/s | 3.1 MB 00:00 2024-04-25T08:40:22.336 INFO:teuthology.orchestra.run.smithi186.stdout:(27/152): rbd-nbd-19.0.0-1628.g97ae6cc9.el9.x86 2.5 MB/s | 170 kB 00:00 2024-04-25T08:40:22.394 INFO:teuthology.orchestra.run.smithi186.stdout:(28/152): ceph-grafana-dashboards-19.0.0-1628.g 540 kB/s | 31 kB 00:00 2024-04-25T08:40:22.453 INFO:teuthology.orchestra.run.smithi186.stdout:(29/152): ceph-mgr-cephadm-19.0.0-1628.g97ae6cc 2.3 MB/s | 138 kB 00:00 2024-04-25T08:40:22.870 INFO:teuthology.orchestra.run.smithi186.stdout:(30/152): ceph-mgr-dashboard-19.0.0-1628.g97ae6 4.3 MB/s | 1.8 MB 00:00 2024-04-25T08:40:22.902 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T08:40:23.046 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T08:40:23.046 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T08:40:23.553 INFO:teuthology.orchestra.run.smithi186.stdout:(31/152): librgw2-19.0.0-1628.g97ae6cc9.el9.x86 2.0 MB/s | 5.1 MB 00:02 2024-04-25T08:40:23.679 INFO:teuthology.orchestra.run.smithi186.stdout:(32/152): ceph-mgr-modules-core-19.0.0-1628.g97 1.9 MB/s | 248 kB 00:00 2024-04-25T08:40:23.729 INFO:teuthology.orchestra.run.smithi186.stdout:(33/152): ceph-mgr-rook-19.0.0-1628.g97ae6cc9.e 990 kB/s | 49 kB 00:00 2024-04-25T08:40:23.779 INFO:teuthology.orchestra.run.smithi186.stdout:(34/152): ceph-prometheus-alerts-19.0.0-1628.g9 307 kB/s | 15 kB 00:00 2024-04-25T08:40:23.921 INFO:teuthology.orchestra.run.smithi186.stdout:(35/152): ceph-volume-19.0.0-1628.g97ae6cc9.el9 1.8 MB/s | 264 kB 00:00 2024-04-25T08:40:24.272 INFO:teuthology.orchestra.run.smithi186.stdout:(36/152): cephadm-19.0.0-1628.g97ae6cc9.el9.noa 2.1 MB/s | 748 kB 00:00 2024-04-25T08:40:24.313 INFO:teuthology.orchestra.run.smithi186.stdout:(37/152): cephfs-top-19.0.0-1628.g97ae6cc9.el9. 441 kB/s | 18 kB 00:00 2024-04-25T08:40:24.464 INFO:teuthology.orchestra.run.smithi186.stdout:(38/152): ceph-mgr-diskprediction-local-19.0.0- 4.6 MB/s | 7.4 MB 00:01 2024-04-25T08:40:24.556 INFO:teuthology.orchestra.run.smithi186.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 332 kB/s | 80 kB 00:00 2024-04-25T08:40:24.779 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T08:40:24.780 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T08:40:24.780 INFO:teuthology.orchestra.run.smithi186.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 869 kB/s | 195 kB 00:00 2024-04-25T08:40:25.373 INFO:teuthology.orchestra.run.smithi186.stdout:(41/152): ceph-test-19.0.0-1628.g97ae6cc9.el9.x 5.0 MB/s | 47 MB 00:09 2024-04-25T08:40:25.398 INFO:teuthology.orchestra.run.smithi186.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 410 kB/s | 253 kB 00:00 2024-04-25T08:40:25.440 INFO:teuthology.orchestra.run.smithi186.stdout:(43/152): libgfortran-11.4.1-3.el9.x86_64.rpm 823 kB/s | 803 kB 00:00 2024-04-25T08:40:25.641 INFO:teuthology.orchestra.run.smithi186.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 441 kB/s | 106 kB 00:00 2024-04-25T08:40:25.674 INFO:teuthology.orchestra.run.smithi186.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 579 kB/s | 135 kB 00:00 2024-04-25T08:40:25.849 INFO:teuthology.orchestra.run.smithi186.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 599 kB/s | 125 kB 00:00 2024-04-25T08:40:25.966 INFO:teuthology.orchestra.run.smithi186.stdout:(47/152): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-04-25T08:40:25.991 INFO:teuthology.orchestra.run.smithi186.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 677 kB/s | 215 kB 00:00 2024-04-25T08:40:26.067 INFO:teuthology.orchestra.run.smithi186.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-04-25T08:40:26.117 INFO:teuthology.orchestra.run.smithi186.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 431 kB/s | 21 kB 00:00 2024-04-25T08:40:26.142 INFO:teuthology.orchestra.run.smithi186.stdout:(51/152): boost-program-options-1.75.0-8.el9.x8 712 kB/s | 107 kB 00:00 2024-04-25T08:40:26.169 INFO:teuthology.orchestra.run.smithi186.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 5.9 MB/s | 313 kB 00:00 2024-04-25T08:40:26.186 INFO:teuthology.orchestra.run.smithi186.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 742 kB/s | 33 kB 00:00 2024-04-25T08:40:26.229 INFO:teuthology.orchestra.run.smithi186.stdout:(54/152): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 943 kB 00:00 2024-04-25T08:40:26.246 INFO:teuthology.orchestra.run.smithi186.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-04-25T08:40:26.271 INFO:teuthology.orchestra.run.smithi186.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-04-25T08:40:26.321 INFO:teuthology.orchestra.run.smithi186.stdout:(57/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-04-25T08:40:26.338 INFO:teuthology.orchestra.run.smithi186.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 678 kB/s | 45 kB 00:00 2024-04-25T08:40:26.363 INFO:teuthology.orchestra.run.smithi186.stdout:(59/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-04-25T08:40:26.397 INFO:teuthology.orchestra.run.smithi186.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-04-25T08:40:26.413 INFO:teuthology.orchestra.run.smithi186.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 507 kB/s | 25 kB 00:00 2024-04-25T08:40:26.439 INFO:teuthology.orchestra.run.smithi186.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-04-25T08:40:26.456 INFO:teuthology.orchestra.run.smithi186.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 804 kB/s | 47 kB 00:00 2024-04-25T08:40:26.481 INFO:teuthology.orchestra.run.smithi186.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-25T08:40:26.498 INFO:teuthology.orchestra.run.smithi186.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 845 kB/s | 35 kB 00:00 2024-04-25T08:40:26.523 INFO:teuthology.orchestra.run.smithi186.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-25T08:40:26.648 INFO:teuthology.orchestra.run.smithi186.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-04-25T08:40:26.690 INFO:teuthology.orchestra.run.smithi186.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-04-25T08:40:26.724 INFO:teuthology.orchestra.run.smithi186.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-04-25T08:40:26.749 INFO:teuthology.orchestra.run.smithi186.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-25T08:40:26.816 INFO:teuthology.orchestra.run.smithi186.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-04-25T08:40:26.858 INFO:teuthology.orchestra.run.smithi186.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-25T08:40:26.875 INFO:teuthology.orchestra.run.smithi186.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T08:40:26.958 INFO:teuthology.orchestra.run.smithi186.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-04-25T08:40:26.984 INFO:teuthology.orchestra.run.smithi186.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-04-25T08:40:27.034 INFO:teuthology.orchestra.run.smithi186.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-04-25T08:40:27.059 INFO:teuthology.orchestra.run.smithi186.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 342 kB/s | 26 kB 00:00 2024-04-25T08:40:27.085 INFO:teuthology.orchestra.run.smithi186.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-04-25T08:40:27.110 INFO:teuthology.orchestra.run.smithi186.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-25T08:40:27.135 INFO:teuthology.orchestra.run.smithi186.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-04-25T08:40:27.210 INFO:teuthology.orchestra.run.smithi186.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-04-25T08:40:27.235 INFO:teuthology.orchestra.run.smithi186.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-04-25T08:40:27.261 INFO:teuthology.orchestra.run.smithi186.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-04-25T08:40:27.295 INFO:teuthology.orchestra.run.smithi186.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-25T08:40:27.320 INFO:teuthology.orchestra.run.smithi186.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 718 kB/s | 42 kB 00:00 2024-04-25T08:40:27.345 INFO:teuthology.orchestra.run.smithi186.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-25T08:40:27.370 INFO:teuthology.orchestra.run.smithi186.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T08:40:27.396 INFO:teuthology.orchestra.run.smithi186.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-25T08:40:27.421 INFO:teuthology.orchestra.run.smithi186.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T08:40:27.446 INFO:teuthology.orchestra.run.smithi186.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T08:40:27.521 INFO:teuthology.orchestra.run.smithi186.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-04-25T08:40:27.546 INFO:teuthology.orchestra.run.smithi186.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-04-25T08:40:27.580 INFO:teuthology.orchestra.run.smithi186.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-04-25T08:40:27.605 INFO:teuthology.orchestra.run.smithi186.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-25T08:40:27.639 INFO:teuthology.orchestra.run.smithi186.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-04-25T08:40:27.665 INFO:teuthology.orchestra.run.smithi186.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-04-25T08:40:27.690 INFO:teuthology.orchestra.run.smithi186.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-04-25T08:40:27.723 INFO:teuthology.orchestra.run.smithi186.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-04-25T08:40:27.749 INFO:teuthology.orchestra.run.smithi186.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-25T08:40:27.774 INFO:teuthology.orchestra.run.smithi186.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T08:40:27.799 INFO:teuthology.orchestra.run.smithi186.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-04-25T08:40:28.033 INFO:teuthology.orchestra.run.smithi186.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-04-25T08:40:28.058 INFO:teuthology.orchestra.run.smithi186.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 78 kB/s | 22 kB 00:00 2024-04-25T08:40:28.242 INFO:teuthology.orchestra.run.smithi186.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-04-25T08:40:28.367 INFO:teuthology.orchestra.run.smithi186.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.0 MB/s | 309 kB 00:00 2024-04-25T08:40:28.384 INFO:teuthology.orchestra.run.smithi186.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 137 kB/s | 19 kB 00:00 2024-04-25T08:40:28.450 INFO:teuthology.orchestra.run.smithi186.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.3 MB/s | 548 kB 00:00 2024-04-25T08:40:28.467 INFO:teuthology.orchestra.run.smithi186.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-04-25T08:40:28.501 INFO:teuthology.orchestra.run.smithi186.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-04-25T08:40:28.560 INFO:teuthology.orchestra.run.smithi186.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 733 kB/s | 67 kB 00:00 2024-04-25T08:40:28.593 INFO:teuthology.orchestra.run.smithi186.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-25T08:40:28.802 INFO:teuthology.orchestra.run.smithi186.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-04-25T08:40:28.886 INFO:teuthology.orchestra.run.smithi186.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 522 kB/s | 43 kB 00:00 2024-04-25T08:40:28.911 INFO:teuthology.orchestra.run.smithi186.stdout:(114/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.3 MB/s | 838 kB 00:00 2024-04-25T08:40:28.944 INFO:teuthology.orchestra.run.smithi186.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 547 kB/s | 32 kB 00:00 2024-04-25T08:40:28.978 INFO:teuthology.orchestra.run.smithi186.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 223 kB/s | 15 kB 00:00 2024-04-25T08:40:29.054 INFO:teuthology.orchestra.run.smithi186.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-04-25T08:40:29.212 INFO:teuthology.orchestra.run.smithi186.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 1.5 MB/s | 358 kB 00:00 2024-04-25T08:40:29.271 INFO:teuthology.orchestra.run.smithi186.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.4 MB/s | 303 kB 00:00 2024-04-25T08:40:29.296 INFO:teuthology.orchestra.run.smithi186.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 423 kB/s | 35 kB 00:00 2024-04-25T08:40:29.396 INFO:teuthology.orchestra.run.smithi186.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.6 MB/s | 206 kB 00:00 2024-04-25T08:40:29.471 INFO:teuthology.orchestra.run.smithi186.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-04-25T08:40:29.513 INFO:teuthology.orchestra.run.smithi186.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 9.4 MB/s | 2.0 MB 00:00 2024-04-25T08:40:29.539 INFO:teuthology.orchestra.run.smithi186.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 159 kB/s | 11 kB 00:00 2024-04-25T08:40:29.606 INFO:teuthology.orchestra.run.smithi186.stdout:(125/152): libarrow-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-04-25T08:40:29.631 INFO:teuthology.orchestra.run.smithi186.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 151 kB/s | 18 kB 00:00 2024-04-25T08:40:29.656 INFO:teuthology.orchestra.run.smithi186.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 197 kB/s | 23 kB 00:00 2024-04-25T08:40:29.690 INFO:teuthology.orchestra.run.smithi186.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-04-25T08:40:29.715 INFO:teuthology.orchestra.run.smithi186.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-04-25T08:40:29.749 INFO:teuthology.orchestra.run.smithi186.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 790 kB/s | 46 kB 00:00 2024-04-25T08:40:29.774 INFO:teuthology.orchestra.run.smithi186.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-25T08:40:29.807 INFO:teuthology.orchestra.run.smithi186.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-04-25T08:40:29.833 INFO:teuthology.orchestra.run.smithi186.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 690 kB/s | 58 kB 00:00 2024-04-25T08:40:29.866 INFO:teuthology.orchestra.run.smithi186.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-04-25T08:40:29.892 INFO:teuthology.orchestra.run.smithi186.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-25T08:40:29.917 INFO:teuthology.orchestra.run.smithi186.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-04-25T08:40:29.942 INFO:teuthology.orchestra.run.smithi186.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 372 kB/s | 28 kB 00:00 2024-04-25T08:40:29.967 INFO:teuthology.orchestra.run.smithi186.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-25T08:40:29.993 INFO:teuthology.orchestra.run.smithi186.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T08:40:30.034 INFO:teuthology.orchestra.run.smithi186.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 644 kB/s | 59 kB 00:00 2024-04-25T08:40:30.060 INFO:teuthology.orchestra.run.smithi186.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-04-25T08:40:30.093 INFO:teuthology.orchestra.run.smithi186.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 508 kB/s | 51 kB 00:00 2024-04-25T08:40:30.144 INFO:teuthology.orchestra.run.smithi186.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-25T08:40:30.169 INFO:teuthology.orchestra.run.smithi186.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 823 kB/s | 90 kB 00:00 2024-04-25T08:40:30.211 INFO:teuthology.orchestra.run.smithi186.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-04-25T08:40:30.236 INFO:teuthology.orchestra.run.smithi186.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-04-25T08:40:30.295 INFO:teuthology.orchestra.run.smithi186.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-04-25T08:40:30.404 INFO:teuthology.orchestra.run.smithi186.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2024-04-25T08:40:30.687 INFO:teuthology.orchestra.run.smithi186.stdout:(149/152): librbd1-19.0.0-1628.g97ae6cc9.el9.x8 8.0 MB/s | 3.1 MB 00:00 2024-04-25T08:40:30.737 INFO:teuthology.orchestra.run.smithi186.stdout:(150/152): librados2-19.0.0-1628.g97ae6cc9.el9. 6.7 MB/s | 3.4 MB 00:00 2024-04-25T08:40:30.991 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T08:40:31.074 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T08:40:31.112 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T08:40:31.174 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T08:40:31.207 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T08:40:31.244 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T08:40:31.293 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T08:40:31.471 INFO:teuthology.orchestra.run.smithi186.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:01 2024-04-25T08:40:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T08:40:31.721 INFO:teuthology.orchestra.run.smithi186.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-04-25T08:40:31.724 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T08:40:31.724 INFO:teuthology.orchestra.run.smithi186.stdout:Total 10 MB/s | 215 MB 00:21 2024-04-25T08:40:31.726 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:40:31.832 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:40:31.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:40:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:40:31.965 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:40:32.113 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T08:40:32.162 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T08:40:32.189 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:40:32.293 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:40:32.316 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:40:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:40:32.400 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:40:32.420 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:40:32.617 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:40:32.650 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:40:32.757 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T08:40:32.830 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T08:40:32.853 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T08:40:32.882 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T08:40:32.917 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T08:40:32.972 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T08:40:32.972 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T08:40:32.981 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T08:40:33.016 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T08:40:33.059 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T08:40:33.092 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T08:40:33.120 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T08:40:33.188 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T08:40:33.242 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T08:40:33.273 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T08:40:33.308 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T08:40:33.384 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T08:40:33.419 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 31/156 2024-04-25T08:40:33.462 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 32/156 2024-04-25T08:40:33.490 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 33/156 2024-04-25T08:40:33.561 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T08:40:33.605 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T08:40:33.680 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T08:40:33.812 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T08:40:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T08:40:34.399 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T08:40:34.488 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T08:40:34.516 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T08:40:34.558 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T08:40:34.588 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 43/156 2024-04-25T08:40:34.630 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T08:40:34.705 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T08:40:34.706 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T08:40:34.787 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T08:40:34.850 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T08:40:34.905 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T08:40:34.978 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T08:40:35.008 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T08:40:35.045 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T08:40:35.091 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T08:40:35.136 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T08:40:35.179 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T08:40:35.221 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T08:40:35.359 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T08:40:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T08:40:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T08:40:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T08:40:35.567 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T08:40:35.607 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T08:40:35.647 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T08:40:35.672 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T08:40:35.697 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T08:40:35.772 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T08:40:35.901 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T08:40:35.938 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T08:40:35.966 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T08:40:36.000 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T08:40:36.039 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T08:40:36.070 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T08:40:36.101 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T08:40:36.135 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T08:40:36.168 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T08:40:36.214 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T08:40:36.433 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T08:40:36.702 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T08:40:36.851 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T08:40:36.882 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T08:40:36.929 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T08:40:37.036 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T08:40:37.083 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T08:40:37.808 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T08:40:37.863 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T08:40:37.897 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T08:40:37.996 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T08:40:38.055 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T08:40:38.142 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T08:40:38.174 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T08:40:38.352 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T08:40:38.380 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T08:40:38.458 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T08:40:39.097 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T08:40:39.211 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T08:40:40.434 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T08:40:40.509 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T08:40:40.537 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T08:40:40.570 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T08:40:40.640 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T08:40:40.716 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T08:40:40.787 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T08:40:40.880 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T08:40:40.950 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:40:40.993 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T08:40:41.034 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T08:40:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:40:41.059 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T08:40:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 100/156 2024-04-25T08:40:41.102 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T08:40:41.124 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T08:40:41.427 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T08:40:41.535 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:40:41.577 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T08:40:41.603 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:40:41.639 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:40:41.673 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:40:41.677 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:40:41.696 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 104/156 2024-04-25T08:40:41.752 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:40:41.790 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:40:41.939 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T08:40:41.995 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T08:40:42.015 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:40:42.118 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:40:42.141 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:40:42.203 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 14/156 2024-04-25T08:40:42.225 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:40:42.247 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T08:40:42.458 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:40:42.491 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T08:40:42.590 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T08:40:42.687 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T08:40:42.715 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T08:40:42.750 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T08:40:42.824 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T08:40:42.858 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T08:40:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T08:40:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T08:40:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T08:40:43.031 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T08:40:43.085 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T08:40:43.115 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T08:40:43.159 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T08:40:43.236 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T08:40:43.269 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 31/156 2024-04-25T08:40:43.305 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 32/156 2024-04-25T08:40:43.333 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 33/156 2024-04-25T08:40:43.404 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T08:40:43.448 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T08:40:43.523 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T08:40:43.658 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T08:40:43.709 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T08:40:43.841 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:40:43.876 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:40:44.240 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T08:40:44.320 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T08:40:44.349 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T08:40:44.392 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T08:40:44.413 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:40:44.430 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 43/156 2024-04-25T08:40:44.454 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:40:44.471 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T08:40:44.528 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:40:44.528 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T08:40:44.528 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T08:40:44.528 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:40:44.556 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:40:44.625 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T08:40:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T08:40:44.738 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T08:40:44.810 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T08:40:44.841 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T08:40:44.878 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T08:40:44.925 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T08:40:44.969 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T08:40:45.012 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T08:40:45.054 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T08:40:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T08:40:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T08:40:45.273 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T08:40:45.314 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T08:40:45.409 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T08:40:45.448 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T08:40:45.479 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T08:40:45.505 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T08:40:45.530 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T08:40:45.605 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T08:40:45.733 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T08:40:45.770 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T08:40:45.798 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T08:40:45.832 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T08:40:45.871 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T08:40:45.903 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T08:40:45.933 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T08:40:45.967 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T08:40:46.000 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T08:40:46.042 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T08:40:46.077 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T08:40:46.164 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T08:40:46.206 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T08:40:46.238 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T08:40:46.285 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T08:40:46.384 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T08:40:46.431 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T08:40:47.148 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T08:40:47.195 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T08:40:47.229 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T08:40:47.326 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T08:40:47.377 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T08:40:47.467 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T08:40:47.541 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T08:40:47.717 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T08:40:47.745 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T08:40:47.830 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T08:40:48.475 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T08:40:48.593 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T08:40:49.836 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T08:40:49.915 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T08:40:49.943 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T08:40:49.976 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T08:40:50.286 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T08:40:50.322 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:40:50.413 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 99/156 2024-04-25T08:40:50.443 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 100/156 2024-04-25T08:40:50.480 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T08:40:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T08:40:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:40:51.020 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 103/156 2024-04-25T08:40:51.043 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 104/156 2024-04-25T08:40:53.232 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:40:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:40:53.815 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 105/156 2024-04-25T08:40:53.859 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:40:53.953 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 106/156 2024-04-25T08:40:53.954 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T08:40:53.954 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T08:40:53.954 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:40:53.985 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:40:56.027 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:40:56.028 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-04-25T08:40:56.028 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-04-25T08:40:56.028 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-04-25T08:40:56.028 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-04-25T08:40:56.028 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-04-25T08:40:56.028 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-04-25T08:40:56.028 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-04-25T08:40:56.028 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:40:56.202 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:40:56.220 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:40:56.220 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:40:56.220 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T08:40:56.220 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:40:57.706 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:40:57.731 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:40:57.731 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:40:57.731 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T08:40:57.731 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:40:57.732 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:40:57.732 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:40:57.947 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:40:57.970 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:40:57.970 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:40:57.971 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T08:40:57.971 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:40:57.971 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:40:57.971 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:40:58.415 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:40:58.438 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:40:58.438 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:40:58.438 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T08:40:58.438 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:40:58.438 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:40:58.438 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:40:58.553 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T08:40:58.602 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T08:40:58.658 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T08:40:58.844 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T08:40:58.890 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T08:40:58.969 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T08:40:59.057 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:40:59.197 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:40:59.241 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T08:40:59.281 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T08:40:59.309 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T08:40:59.768 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:40:59.807 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:40:59.838 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 124/156 2024-04-25T08:40:59.900 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 125/156 2024-04-25T08:40:59.922 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:41:00.149 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:41:00.181 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:41:01.144 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:41:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:41:01.277 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:41:01.465 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 129/156 2024-04-25T08:41:01.492 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:41:01.516 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:41:01.516 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:01.516 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T08:41:01.517 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:41:01.517 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:41:01.517 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:01.568 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:41:01.579 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:41:01.678 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 132/156 2024-04-25T08:41:01.733 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 133/156 2024-04-25T08:41:02.593 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T08:41:02.629 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:41:02.652 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:41:02.653 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:02.653 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T08:41:02.653 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:41:02.653 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:41:02.653 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:02.696 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:41:02.719 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:41:02.719 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:02.719 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T08:41:02.719 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:02.764 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:41:02.787 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:41:02.787 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:02.787 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T08:41:02.787 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:41:02.787 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:41:02.787 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:03.098 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:41:03.120 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:41:03.121 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:03.121 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T08:41:03.121 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:41:03.121 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:41:03.122 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:05.482 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 107/156 2024-04-25T08:41:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /sys 2024-04-25T08:41:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /proc 2024-04-25T08:41:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /mnt 2024-04-25T08:41:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /var/tmp 2024-04-25T08:41:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /home 2024-04-25T08:41:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /root 2024-04-25T08:41:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /tmp 2024-04-25T08:41:05.483 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:05.655 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:41:05.671 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 108/156 2024-04-25T08:41:05.671 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:05.671 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T08:41:05.671 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:07.141 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:41:07.167 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 109/156 2024-04-25T08:41:07.167 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:07.167 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T08:41:07.167 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:41:07.167 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T08:41:07.167 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:07.375 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:41:07.397 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 110/156 2024-04-25T08:41:07.398 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:07.398 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T08:41:07.398 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:41:07.398 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T08:41:07.398 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:07.560 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 139/156 2024-04-25T08:41:07.609 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 140/156 2024-04-25T08:41:07.650 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 141/156 2024-04-25T08:41:07.682 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T08:41:07.709 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T08:41:07.842 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:41:07.865 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 111/156 2024-04-25T08:41:07.865 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:07.865 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T08:41:07.865 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:41:07.865 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T08:41:07.865 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:07.885 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 144/156 2024-04-25T08:41:07.938 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T08:41:07.964 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T08:41:07.969 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 146/156 2024-04-25T08:41:08.055 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T08:41:08.110 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T08:41:08.298 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T08:41:08.343 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T08:41:08.421 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T08:41:08.526 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:41:08.620 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:41:08.658 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:41:08.665 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:41:08.678 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:41:08.701 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T08:41:08.733 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T08:41:08.760 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T08:41:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:41:09.226 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 123/156 2024-04-25T08:41:09.257 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 124/156 2024-04-25T08:41:09.319 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 125/156 2024-04-25T08:41:09.340 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:41:09.530 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 148/156 2024-04-25T08:41:09.569 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 126/156 2024-04-25T08:41:09.599 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:41:09.613 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T08:41:09.654 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T08:41:09.745 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T08:41:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T08:41:09.784 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:41:09.868 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:41:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:41:09.901 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:41:09.989 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:41:10.058 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:41:10.560 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 127/156 2024-04-25T08:41:10.591 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:41:10.693 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 128/156 2024-04-25T08:41:10.854 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 129/156 2024-04-25T08:41:10.876 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:41:10.900 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 130/156 2024-04-25T08:41:10.900 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:10.900 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T08:41:10.900 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:41:10.900 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T08:41:10.901 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:10.944 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:41:10.955 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 131/156 2024-04-25T08:41:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 132/156 2024-04-25T08:41:11.100 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 133/156 2024-04-25T08:41:11.944 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T08:41:11.972 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:41:11.994 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 135/156 2024-04-25T08:41:11.995 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:11.995 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T08:41:11.995 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:41:11.995 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:41:11.995 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:12.039 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:41:12.061 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 136/156 2024-04-25T08:41:12.061 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:12.061 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T08:41:12.061 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:12.106 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:41:12.129 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 137/156 2024-04-25T08:41:12.129 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:12.129 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T08:41:12.129 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:41:12.129 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:41:12.129 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:12.440 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:41:12.463 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 138/156 2024-04-25T08:41:12.463 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T08:41:12.463 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T08:41:12.463 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:41:12.463 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T08:41:12.463 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:41:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 1/156 2024-04-25T08:41:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 3/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 4/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 5/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 6/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 7/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 11/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 12/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 14/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 15/156 2024-04-25T08:41:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 16/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 17/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 18/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 19/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 20/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 21/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 22/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 23/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 24/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 25/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 26/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 27/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 28/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 29/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 30/156 2024-04-25T08:41:15.190 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 31/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 32/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 33/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 34/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 35/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 36/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 37/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 38/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 39/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T08:41:15.191 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T08:41:15.192 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T08:41:15.193 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T08:41:15.194 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T08:41:15.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T08:41:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T08:41:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T08:41:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T08:41:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T08:41:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T08:41:15.196 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T08:41:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T08:41:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T08:41:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T08:41:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T08:41:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T08:41:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T08:41:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T08:41:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T08:41:15.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T08:41:15.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T08:41:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T08:41:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T08:41:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T08:41:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 149/156 2024-04-25T08:41:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T08:41:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 151/156 2024-04-25T08:41:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T08:41:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T08:41:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:41:15.200 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T08:41:16.877 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 139/156 2024-04-25T08:41:16.918 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 140/156 2024-04-25T08:41:16.959 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 141/156 2024-04-25T08:41:16.991 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T08:41:17.018 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T08:41:17.205 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 144/156 2024-04-25T08:41:17.250 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T08:41:17.277 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 146/156 2024-04-25T08:41:17.295 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:41:17.295 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:17.295 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-04-25T08:41:17.295 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.295 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.295 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T08:41:17.295 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T08:41:17.295 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T08:41:17.295 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.296 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.297 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T08:41:17.298 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T08:41:17.299 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T08:41:17.300 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T08:41:17.301 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T08:41:17.302 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T08:41:17.303 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T08:41:17.304 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T08:41:17.305 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T08:41:17.306 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T08:41:17.306 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:17.306 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T08:41:17.710 DEBUG:teuthology.parallel:result is None 2024-04-25T08:41:17.862 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:41:17.891 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:41:17.911 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T08:41:18.759 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 148/156 2024-04-25T08:41:18.829 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T08:41:18.870 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T08:41:18.954 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T08:41:18.983 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T08:41:18.983 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:41:19.067 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T08:41:19.100 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:41:19.100 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:41:19.172 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T08:41:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:41:24.441 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:41:24.441 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 1/156 2024-04-25T08:41:24.441 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 3/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 4/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1628.g97ae6 5/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 6/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 7/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 8/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 9/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 10/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 11/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 12/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 13/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 14/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_ 15/156 2024-04-25T08:41:24.442 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 16/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 17/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_6 18/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86 19/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 20/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el 21/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9. 22/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_6 23/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 24/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 25/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 26/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 27/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 28/156 2024-04-25T08:41:24.443 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 29/156 2024-04-25T08:41:24.455 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9. 30/156 2024-04-25T08:41:24.455 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noa 31/156 2024-04-25T08:41:24.455 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.n 32/156 2024-04-25T08:41:24.455 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1628.g97a 33/156 2024-04-25T08:41:24.455 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el 34/156 2024-04-25T08:41:24.455 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 35/156 2024-04-25T08:41:24.455 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.e 36/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 37/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 38/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 39/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T08:41:24.456 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T08:41:24.457 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T08:41:24.458 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T08:41:24.459 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T08:41:24.460 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T08:41:24.461 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T08:41:24.462 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T08:41:24.463 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T08:41:24.463 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 149/156 2024-04-25T08:41:24.463 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T08:41:24.463 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 151/156 2024-04-25T08:41:24.463 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T08:41:24.463 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T08:41:24.463 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T08:41:24.463 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout:Upgraded: 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout: librados2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T08:41:26.549 INFO:teuthology.orchestra.run.smithi186.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.550 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top-2:19.0.0-1628.g97ae6cc9.el9.noarch 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T08:41:26.551 INFO:teuthology.orchestra.run.smithi186.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.552 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T08:41:26.553 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T08:41:26.554 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T08:41:26.555 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T08:41:26.556 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T08:41:26.557 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd-2:19.0.0-1628.g97ae6cc9.el9.x86_64 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T08:41:26.558 INFO:teuthology.orchestra.run.smithi186.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T08:41:26.559 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T08:41:26.559 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T08:41:26.559 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T08:41:26.559 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:26.559 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T08:41:26.917 DEBUG:teuthology.parallel:result is None 2024-04-25T08:41:26.917 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:41:27.054 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T08:41:27.079 INFO:teuthology.orchestra.run.smithi172.stdout:19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:41:27.080 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:41:27.080 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628.g97ae6cc9 is installed. 2024-04-25T08:41:27.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:41:27.230 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T08:41:27.251 INFO:teuthology.orchestra.run.smithi186.stdout:19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:41:27.251 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628.g97ae6cc9.el9 2024-04-25T08:41:27.251 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628.g97ae6cc9 is installed. 2024-04-25T08:41:27.252 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T08:41:27.253 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:27.253 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T08:41:27.284 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:41:27.284 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T08:41:27.316 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T08:41:27.316 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:27.316 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T08:41:27.352 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T08:41:27.418 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:41:27.418 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T08:41:27.442 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T08:41:27.506 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T08:41:27.506 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:27.506 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T08:41:27.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T08:41:27.598 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:41:27.598 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T08:41:27.621 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T08:41:27.688 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T08:41:27.688 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:27.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T08:41:27.713 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T08:41:27.777 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:41:27.777 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T08:41:27.802 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T08:41:27.866 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T08:41:27.940 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T08:41:27.940 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-04-25T08:41:27.943 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /var/log/ceph 2024-04-25T08:41:27.966 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T08:41:27.966 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T08:41:28.007 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T08:41:28.030 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T08:41:28.030 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T08:41:28.073 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T08:41:28.149 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T08:41:28.176 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T08:41:28.177 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T08:41:28.177 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:28.177 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T08:41:28.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T08:41:28.296 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T08:41:28.340 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:41:28.340 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T08:41:28.354 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T08:41:28.459 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T08:41:28.487 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T08:41:28.488 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T08:41:28.488 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996', 'branch': 'wip-neesingh-testing-240416', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7672996', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-240416'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62537', 'sha1': '5787d42d10024ba410e822a8aba474331cb9af02'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5869, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-62537', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '5787d42d10024ba410e822a8aba474331cb9af02', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBND9fJUld9x5na72sfQkSEimJBJvAjDa7OsLSDbNFMUDQxIScptMIJ+nUm5g9Bl/jROSTagzLS9QUm+Bc6JSHgE=', 'smithi186.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBML4himyrBcCjd9Rjkz7VPdj8BI3YujYkfAGYTGQ5IBM4NhLN2rUfEdpieu+te3s3XjFTMtZ8usHDaYuxL+oBaM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_08:15:18', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T08:41:28.488 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T08:41:28.490 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T08:41:28.537 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T08:41:28.545 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T08:41:28.601 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:28.601 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T08:41:28.621 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T08:41:28.622 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-04-25T08:41:28.676 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T08:41:28.676 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:41:28.676 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-04-25T08:41:28.676 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:41:28.676 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:41:28.676 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 08:41:10.448284277 +0000 2024-04-25T08:41:28.676 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 08:39:28.387330728 +0000 2024-04-25T08:41:28.676 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 08:39:28.387330728 +0000 2024-04-25T08:41:28.676 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-25 08:39:28.387330728 +0000 2024-04-25T08:41:28.676 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T08:41:28.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:41:28.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:41:28.738 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000238159 s, 2.1 MB/s 2024-04-25T08:41:28.739 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T08:41:28.795 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-04-25T08:41:28.850 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T08:41:28.850 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:41:28.850 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T08:41:28.850 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:41:28.850 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:41:28.850 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 08:41:10.448284277 +0000 2024-04-25T08:41:28.850 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 08:39:28.742321862 +0000 2024-04-25T08:41:28.850 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 08:39:28.742321862 +0000 2024-04-25T08:41:28.850 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-25 08:39:28.742321862 +0000 2024-04-25T08:41:28.850 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T08:41:28.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:41:28.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:41:28.912 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000189743 s, 2.7 MB/s 2024-04-25T08:41:28.913 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T08:41:28.968 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-04-25T08:41:29.023 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T08:41:29.023 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:41:29.023 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T08:41:29.023 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:41:29.023 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:41:29.023 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 08:41:10.448284277 +0000 2024-04-25T08:41:29.023 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 08:39:29.069313695 +0000 2024-04-25T08:41:29.023 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 08:39:29.069313695 +0000 2024-04-25T08:41:29.024 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-25 08:39:29.069313695 +0000 2024-04-25T08:41:29.024 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T08:41:29.085 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:41:29.085 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:41:29.086 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000211595 s, 2.4 MB/s 2024-04-25T08:41:29.087 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T08:41:29.141 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-04-25T08:41:29.196 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T08:41:29.196 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:41:29.196 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-04-25T08:41:29.196 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:41:29.196 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:41:29.196 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 08:41:10.449284252 +0000 2024-04-25T08:41:29.196 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 08:39:29.398305478 +0000 2024-04-25T08:41:29.196 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 08:39:29.398305478 +0000 2024-04-25T08:41:29.196 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-25 08:39:29.398305478 +0000 2024-04-25T08:41:29.197 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T08:41:29.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:41:29.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:41:29.258 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000189295 s, 2.7 MB/s 2024-04-25T08:41:29.259 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T08:41:29.314 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:41:29.314 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:41:29.315 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T08:41:29.331 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T08:41:29.331 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2024-04-25T08:41:29.387 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T08:41:29.387 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:41:29.387 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T08:41:29.387 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:41:29.387 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:41:29.387 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-25 08:41:19.643804708 +0000 2024-04-25T08:41:29.387 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-25 08:39:28.373770437 +0000 2024-04-25T08:41:29.387 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-25 08:39:28.373770437 +0000 2024-04-25T08:41:29.387 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-04-25 08:39:28.373770437 +0000 2024-04-25T08:41:29.387 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T08:41:29.450 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-25T08:41:29.450 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-25T08:41:29.450 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000271704 s, 1.9 MB/s 2024-04-25T08:41:29.452 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T08:41:29.508 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2024-04-25T08:41:29.563 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T08:41:29.563 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:41:29.563 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T08:41:29.563 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:41:29.563 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:41:29.563 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-25 08:41:19.643804708 +0000 2024-04-25T08:41:29.563 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-25 08:39:28.720763469 +0000 2024-04-25T08:41:29.563 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-25 08:39:28.720763469 +0000 2024-04-25T08:41:29.563 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-04-25 08:39:28.720763469 +0000 2024-04-25T08:41:29.563 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T08:41:29.626 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-25T08:41:29.626 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-25T08:41:29.626 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000219555 s, 2.3 MB/s 2024-04-25T08:41:29.628 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T08:41:29.683 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2024-04-25T08:41:29.738 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T08:41:29.738 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:41:29.738 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T08:41:29.738 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:41:29.738 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:41:29.738 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-25 08:41:19.643804708 +0000 2024-04-25T08:41:29.738 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-25 08:39:29.064756562 +0000 2024-04-25T08:41:29.739 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-25 08:39:29.064756562 +0000 2024-04-25T08:41:29.739 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-04-25 08:39:29.064756562 +0000 2024-04-25T08:41:29.739 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T08:41:29.800 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-25T08:41:29.800 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-25T08:41:29.800 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000187148 s, 2.7 MB/s 2024-04-25T08:41:29.802 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T08:41:29.858 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2024-04-25T08:41:29.912 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T08:41:29.912 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T08:41:29.912 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-25T08:41:29.912 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T08:41:29.913 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T08:41:29.913 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-25 08:41:19.644804689 +0000 2024-04-25T08:41:29.913 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-25 08:39:29.407749675 +0000 2024-04-25T08:41:29.913 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-25 08:39:29.407749675 +0000 2024-04-25T08:41:29.913 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-04-25 08:39:29.407749675 +0000 2024-04-25T08:41:29.913 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T08:41:29.974 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-25T08:41:29.974 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-25T08:41:29.974 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000208358 s, 2.5 MB/s 2024-04-25T08:41:29.975 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T08:41:30.030 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:41:30.030 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T08:41:30.030 INFO:tasks.ceph:Generating config... 2024-04-25T08:41:30.031 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T08:41:30.032 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T08:41:30.032 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T08:41:30.032 INFO:tasks.ceph:[client] pid file = 2024-04-25T08:41:30.032 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T08:41:30.032 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T08:41:30.032 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T08:41:30.032 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T08:41:30.032 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T08:41:30.032 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T08:41:30.032 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-04-25T08:41:30.032 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T08:41:30.032 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T08:41:30.032 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-04-25T08:41:30.032 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T08:41:30.032 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T08:41:30.033 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T08:41:30.033 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T08:41:30.033 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T08:41:30.033 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T08:41:30.033 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T08:41:30.033 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T08:41:30.033 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T08:41:30.033 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T08:41:30.033 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T08:41:30.033 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T08:41:30.033 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T08:41:30.033 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T08:41:30.033 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T08:41:30.033 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T08:41:30.033 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T08:41:30.033 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T08:41:30.033 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T08:41:30.034 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T08:41:30.034 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T08:41:30.034 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T08:41:30.034 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T08:41:30.034 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T08:41:30.034 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T08:41:30.034 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T08:41:30.085 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T08:41:30.088 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T08:41:30.129 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T08:41:30.193 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.172'), ('mon.b', '172.21.15.186'), ('mon.c', '[v2:172.21.15.186:3301,v1:172.21.15.186:6790]')] 2024-04-25T08:41:30.194 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.172,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T08:41:30.194 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:30.194 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T08:41:30.248 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.172 --add b 172.21.15.186 --addv c '[v2:172.21.15.186:3301,v1:172.21.15.186:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:30.334 INFO:teuthology.orchestra.run.smithi172.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:monmaptool: generated fsid fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:setting min_mon_release = quincy 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:epoch 0 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:fsid fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:last_changed 2024-04-25T08:41:30.343446+0000 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:created 2024-04-25T08:41:30.343446+0000 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:min_mon_release 17 (quincy) 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:election_strategy: 1 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:0: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.a 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:2: [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] mon.c 2024-04-25T08:41:30.335 INFO:teuthology.orchestra.run.smithi172.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T08:41:30.336 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T08:41:30.351 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2... 2024-04-25T08:41:30.351 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T08:41:30.393 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T08:41:30.431 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-25T08:41:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-25T08:41:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T08:41:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-25T08:41:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-25T08:41:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-25T08:41:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.172,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]" 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on skipped message = False 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-25T08:41:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-25T08:41:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 20 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 20 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 10 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-25T08:41:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-25T08:41:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = "" 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-25T08:41:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds balancer = 20 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: mds cache max size = 1000 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = True 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: mds log max segments = 1 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2024-04-25T08:41:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = True 2024-04-25T08:41:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-25T08:41:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-25T08:41:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-25T08:41:30.445 INFO:teuthology.orchestra.run.smithi186.stdout:[global] 2024-04-25T08:41:30.445 INFO:teuthology.orchestra.run.smithi186.stdout: chdir = "" 2024-04-25T08:41:30.445 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T08:41:30.445 INFO:teuthology.orchestra.run.smithi186.stdout: auth supported = cephx 2024-04-25T08:41:30.445 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.445 INFO:teuthology.orchestra.run.smithi186.stdout: filestore xattr use omap = true 2024-04-25T08:41:30.445 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.445 INFO:teuthology.orchestra.run.smithi186.stdout: mon clock drift allowed = 1.000 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: osd crush chooseleaf type = 0 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: auth debug = true 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on old message = true 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on bug = true 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: mon pg warn max object skew = 0 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default size = 2 2024-04-25T08:41:30.446 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow primary affinity = true 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow pg remap = true 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on legacy crush tunables = false 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on crush straw calc version zero = false 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on no sortbitwise = false 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on osd down out interval zero = false 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on too few osds = false 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon_allow_pool_size_one = true 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: osd default data pool replay window = 5 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.447 INFO:teuthology.orchestra.run.smithi186.stdout: mon allow pool delete = true 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: mon cluster log file level = debug 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: debug asserts on shutdown = true 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: mon health detail to clog = false 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: mon host = "172.21.15.172,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]" 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on skipped message = False 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: fsid = fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout:[osd] 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: osd journal size = 100 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub load threshold = 5.0 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub max interval = 600 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: osd mclock profile = high_recovery_ops 2024-04-25T08:41:30.448 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: osd recover clone overlap = true 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: osd recovery max chunk = 1048576 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug shutdown = true 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug op order = true 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug verify stray on activate = true 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug trim objects = true 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: osd open classes on start = true 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug pg log writeout = true 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: osd deep scrub update digest min age = 30 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: osd map max advance = 10 2024-04-25T08:41:30.449 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: journal zero on create = true 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: filestore ondisk finisher threads = 3 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: filestore apply finisher threads = 3 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: bdev debug aio = true 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug misdirected ops = true 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore block size = 96636764160 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore fsck on mount = True 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluefs = 20 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluestore = 20 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: debug osd = 20 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: debug rocksdb = 10 2024-04-25T08:41:30.450 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd full ratio = 0.9 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd nearfull ratio = 0.8 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: osd failsafe full ratio = 0.95 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: osd objectstore = bluestore 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr] 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: debug mgr = 20 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: mgr/telemetry/nag = false 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.451 INFO:teuthology.orchestra.run.smithi186.stdout:[mon] 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: debug paxos = 20 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: mon data avail warn = 5 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: mon mgr mkfs grace = 240 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd reporter subtree level = osd 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd prime pg temp = true 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T08:41:30.452 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: # 1m isn't quite enough 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: mon_down_mkfs_grace = 2m 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_filestore_osds = false 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: mon op complaint time = 120 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout:[client] 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: rgw cache enabled = true 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable ops log = true 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable usage log = true 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: client mount timeout = 600 2024-04-25T08:41:30.453 INFO:teuthology.orchestra.run.smithi186.stdout: debug client = 20 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = "" 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 900 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 900 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.a] 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.b] 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.c] 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.c] 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.d] 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout:[mds] 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds = 20 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds balancer = 20 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T08:41:30.454 INFO:teuthology.orchestra.run.smithi186.stdout: mds cache max size = 1000 2024-04-25T08:41:30.455 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug frag = True 2024-04-25T08:41:30.455 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug scatterstat = True 2024-04-25T08:41:30.455 INFO:teuthology.orchestra.run.smithi186.stdout: mds log max segments = 1 2024-04-25T08:41:30.455 INFO:teuthology.orchestra.run.smithi186.stdout: mds op complaint time = 180 2024-04-25T08:41:30.455 INFO:teuthology.orchestra.run.smithi186.stdout: mds verify scatter = True 2024-04-25T08:41:30.455 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2024-04-25T08:41:30.455 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 900 2024-04-25T08:41:30.455 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 900 2024-04-25T08:41:30.456 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T08:41:30.456 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T08:41:30.533 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T08:41:30.533 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:30.533 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T08:41:30.548 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:30.548 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T08:41:30.603 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:41:30.603 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:30.603 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T08:41:30.603 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T08:41:30.675 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:41:30.675 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:30.730 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:41:30.730 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:41:30.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T08:41:30.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T08:41:30.763 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:41:30.763 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:30.818 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T08:41:30.818 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T08:41:30.818 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T08:41:30.867 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T08:41:30.869 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T08:41:30.954 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T08:41:30.956 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T08:41:30.957 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T08:41:31.005 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T08:41:31.007 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T08:41:31.030 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T08:41:31.119 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T08:41:31.121 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T08:41:31.144 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T08:41:31.192 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T08:41:31.195 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T08:41:31.218 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T08:41:31.306 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T08:41:31.309 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T08:41:31.332 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T08:41:31.332 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T08:41:31.372 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T08:41:31.384 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T08:41:31.464 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T08:41:31.476 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T08:41:31.515 INFO:teuthology.orchestra.run.smithi186.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T08:41:31.527 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T08:41:31.606 INFO:teuthology.orchestra.run.smithi186.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T08:41:31.618 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T08:41:31.618 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T08:41:31.618 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T08:41:31.642 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:41:31.642 INFO:tasks.ceph:role: osd.0 2024-04-25T08:41:31.642 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:41:31.643 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T08:41:31.713 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:41:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:41:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:41:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:41:31.713 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:41:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:41:31.713 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:41:31.714 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:41:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:41:31.714 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:41:32.216 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-25T08:41:32.218 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-25T08:41:32.218 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T08:41:32.340 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T08:41:32.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T08:41:32.433 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:41:32.433 INFO:tasks.ceph:role: osd.1 2024-04-25T08:41:32.433 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:41:32.433 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T08:41:32.504 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:41:32.504 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:41:32.504 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:41:32.504 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:41:32.504 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:41:32.504 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:41:32.504 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:41:32.504 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:41:32.504 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:41:32.505 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:41:32.955 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-25T08:41:32.958 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-25T08:41:32.958 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T08:41:33.048 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T08:41:33.077 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T08:41:33.141 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:41:33.141 INFO:tasks.ceph:role: osd.2 2024-04-25T08:41:33.141 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:41:33.142 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T08:41:33.211 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:41:33.212 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:41:33.212 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:41:33.212 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:41:33.212 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:41:33.212 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:41:33.212 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:41:33.212 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:41:33.212 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:41:33.212 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:41:33.694 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-25T08:41:33.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-25T08:41:33.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T08:41:33.827 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T08:41:33.857 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T08:41:33.921 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T08:41:33.921 INFO:tasks.ceph:role: osd.3 2024-04-25T08:41:33.921 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:41:33.921 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T08:41:33.992 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:41:33.992 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:41:33.992 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:41:33.992 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:41:33.993 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:41:33.993 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:41:33.993 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:41:33.993 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:41:33.993 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:41:33.993 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:41:34.502 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-25T08:41:34.504 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-25T08:41:34.504 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T08:41:34.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T08:41:34.690 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:34.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:34.793+0000 7ff4cc822640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T08:41:34.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:34.793+0000 7ff4cc822640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T08:41:34.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:34.793+0000 7ff4cc822640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T08:41:34.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:34.793+0000 7ff4cc822640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T08:41:34.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:34.793+0000 7ff4cc822640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T08:41:34.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:34.794+0000 7ff4cc822640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T08:41:37.633 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T08:41:37.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:37.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:37.756+0000 7f5f61968640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T08:41:37.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:37.757+0000 7f5f61968640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T08:41:37.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:37.757+0000 7f5f61968640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T08:41:37.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:37.757+0000 7f5f61968640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T08:41:37.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:37.757+0000 7f5f61968640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T08:41:37.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:37.757+0000 7f5f61968640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T08:41:40.595 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T08:41:40.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:40.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:40.721+0000 7f970520d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T08:41:40.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:40.721+0000 7f970520d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T08:41:40.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:40.721+0000 7f970520d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T08:41:40.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:40.721+0000 7f970520d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T08:41:40.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:40.721+0000 7f970520d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T08:41:40.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:40.722+0000 7f970520d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T08:41:43.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T08:41:43.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:43.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:43.677+0000 7fa8c320d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T08:41:43.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:43.678+0000 7fa8c320d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T08:41:43.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:43.678+0000 7fa8c320d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T08:41:43.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:43.678+0000 7fa8c320d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T08:41:43.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:43.678+0000 7fa8c320d640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T08:41:43.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:41:43.678+0000 7fa8c320d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T08:41:46.524 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T08:41:46.552 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T08:41:46.581 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:41:46.581 INFO:tasks.ceph:role: osd.4 2024-04-25T08:41:46.581 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:41:46.581 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T08:41:46.656 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:41:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:41:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:41:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:41:46.657 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:41:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:41:46.657 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:41:46.657 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:41:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:41:46.657 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:41:47.147 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-04-25T08:41:47.149 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-04-25T08:41:47.149 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T08:41:47.295 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T08:41:47.324 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T08:41:47.388 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:41:47.388 INFO:tasks.ceph:role: osd.5 2024-04-25T08:41:47.389 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:41:47.389 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T08:41:47.460 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:41:47.460 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:41:47.460 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:41:47.461 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:41:47.461 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:41:47.461 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:41:47.461 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:41:47.461 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:41:47.461 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:41:47.461 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:41:47.909 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-04-25T08:41:47.911 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-04-25T08:41:47.911 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T08:41:48.003 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T08:41:48.030 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T08:41:48.093 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:41:48.093 INFO:tasks.ceph:role: osd.6 2024-04-25T08:41:48.093 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:41:48.094 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T08:41:48.163 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:41:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:41:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:41:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:41:48.163 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:41:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:41:48.163 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:41:48.164 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:41:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:41:48.164 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:41:48.670 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-04-25T08:41:48.672 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-04-25T08:41:48.672 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T08:41:48.792 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T08:41:48.821 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T08:41:48.885 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T08:41:48.885 INFO:tasks.ceph:role: osd.7 2024-04-25T08:41:48.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:41:48.885 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T08:41:48.956 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T08:41:48.956 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T08:41:48.956 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T08:41:48.956 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T08:41:48.956 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T08:41:48.956 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-04-25T08:41:48.956 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T08:41:48.956 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T08:41:48.957 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T08:41:48.957 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T08:41:49.475 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-04-25T08:41:49.476 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-04-25T08:41:49.477 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T08:41:49.615 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T08:41:49.647 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:49.740 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:49.748+0000 7fbd64232640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T08:41:49.741 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:49.749+0000 7fbd64232640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T08:41:49.741 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:49.749+0000 7fbd64232640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T08:41:49.741 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:49.749+0000 7fbd64232640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T08:41:49.741 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:49.749+0000 7fbd64232640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T08:41:49.742 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:49.749+0000 7fbd64232640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T08:41:52.591 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T08:41:52.620 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:52.708 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:52.715+0000 7f16484b3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T08:41:52.708 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:52.716+0000 7f16484b3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T08:41:52.708 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:52.716+0000 7f16484b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T08:41:52.708 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:52.716+0000 7f16484b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T08:41:52.708 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:52.716+0000 7f16484b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T08:41:52.709 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:52.716+0000 7f16484b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T08:41:55.556 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T08:41:55.583 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:55.670 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:55.677+0000 7f8eda01f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T08:41:55.670 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:55.677+0000 7f8eda01f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T08:41:55.670 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:55.677+0000 7f8eda01f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T08:41:55.670 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:55.677+0000 7f8eda01f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T08:41:55.670 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:55.677+0000 7f8eda01f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T08:41:55.670 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:55.678+0000 7f8eda01f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T08:41:58.489 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:41:58.492 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:41:58.524 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T08:41:58.595 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:41:58.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:58.685+0000 7f1dc44f0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T08:41:58.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:58.686+0000 7f1dc44f0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T08:41:58.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:58.686+0000 7f1dc44f0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T08:41:58.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:58.686+0000 7f1dc44f0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T08:41:58.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:58.686+0000 7f1dc44f0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T08:41:58.679 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:41:58.686+0000 7f1dc44f0640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T08:42:01.522 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T08:42:01.591 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T08:42:01.591 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:01.592 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T08:42:01.620 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:01.621 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T08:42:01.688 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:01.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T08:42:01.754 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:01.754 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T08:42:01.820 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:01.820 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T08:42:01.886 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:01.886 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T08:42:01.952 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:01.952 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T08:42:02.016 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:02.017 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T08:42:02.045 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:02.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T08:42:02.112 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:02.112 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T08:42:02.177 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:02.178 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T08:42:02.243 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:02.243 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T08:42:02.308 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:02.308 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T08:42:02.372 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:02.372 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T08:42:02.436 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:02.436 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T08:42:02.452 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:02.453 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T08:42:02.508 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:02.508 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T08:42:02.523 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:02.523 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T08:42:02.578 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T08:42:02.578 DEBUG:teuthology.orchestra.run.smithi172:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T08:42:02.580 DEBUG:teuthology.orchestra.run.smithi186:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T08:42:02.621 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.y] 2024-04-25T08:42:02.621 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg== 2024-04-25T08:42:02.621 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-25T08:42:02.621 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q== 2024-04-25T08:42:02.621 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2024-04-25T08:42:02.621 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA== 2024-04-25T08:42:02.621 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2024-04-25T08:42:02.621 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ== 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g== 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g== 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.3] 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg== 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.x] 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw== 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg== 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg== 2024-04-25T08:42:02.622 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.4] 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw== 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.5] 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow== 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.6] 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg== 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.7] 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q== 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout:[client.2] 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw== 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout:[client.1] 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g== 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout:[client.3] 2024-04-25T08:42:02.623 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w== 2024-04-25T08:42:02.640 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.y] 2024-04-25T08:42:02.640 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg== 2024-04-25T08:42:02.640 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2024-04-25T08:42:02.640 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q== 2024-04-25T08:42:02.640 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.c] 2024-04-25T08:42:02.640 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA== 2024-04-25T08:42:02.640 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.0] 2024-04-25T08:42:02.640 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ== 2024-04-25T08:42:02.640 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.1] 2024-04-25T08:42:02.640 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g== 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.2] 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g== 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.3] 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg== 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.x] 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw== 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg== 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.d] 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg== 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.4] 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw== 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.5] 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow== 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.6] 2024-04-25T08:42:02.641 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg== 2024-04-25T08:42:02.642 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.7] 2024-04-25T08:42:02.642 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q== 2024-04-25T08:42:02.642 INFO:teuthology.orchestra.run.smithi186.stdout:[client.0] 2024-04-25T08:42:02.642 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:42:02.642 INFO:teuthology.orchestra.run.smithi186.stdout:[client.2] 2024-04-25T08:42:02.642 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw== 2024-04-25T08:42:02.642 INFO:teuthology.orchestra.run.smithi186.stdout:[client.1] 2024-04-25T08:42:02.642 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g== 2024-04-25T08:42:02.642 INFO:teuthology.orchestra.run.smithi186.stdout:[client.3] 2024-04-25T08:42:02.642 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w== 2024-04-25T08:42:02.643 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:42:02.667 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:42:02.732 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:42:02.734 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:42:02.785 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:42:02.787 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:42:02.839 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:02.841 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:02.889 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:02.891 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:02.940 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:02.942 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:02.990 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:02.992 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:03.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:42:03.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T08:42:03.093 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:42:03.095 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:42:03.146 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:42:03.149 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T08:42:03.201 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:03.203 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:03.252 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:03.254 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:03.303 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:03.305 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:03.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:03.356 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T08:42:03.404 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:42:03.407 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:42:03.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:42:03.461 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:42:03.512 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:42:03.514 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:42:03.565 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:42:03.568 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T08:42:03.619 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T08:42:03.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T08:42:03.643 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T08:42:03.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T08:42:03.761 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T08:42:03.784 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T08:42:03.877 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T08:42:03.900 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T08:42:03.964 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T08:42:04.057 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T08:42:04.081 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:42:04.083 DEBUG:teuthology.orchestra.run.smithi186:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T08:42:04.135 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T08:42:04.136 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T08:42:04.136 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T08:42:04.138 INFO:tasks.ceph.mon.a:Started 2024-04-25T08:42:04.138 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T08:42:04.138 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T08:42:04.177 INFO:tasks.ceph.mon.b:Started 2024-04-25T08:42:04.177 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T08:42:04.177 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T08:42:04.179 INFO:tasks.ceph.mon.c:Started 2024-04-25T08:42:04.179 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T08:42:04.180 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T08:42:04.180 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T08:42:04.182 INFO:tasks.ceph.mgr.y:Started 2024-04-25T08:42:04.182 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T08:42:04.182 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T08:42:04.184 INFO:tasks.ceph.mgr.x:Started 2024-04-25T08:42:04.184 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T08:42:04.185 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T08:42:04.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.290+0000 7f631f99e640 1 Processor -- start 2024-04-25T08:42:04.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.291+0000 7f631f99e640 1 -- start start 2024-04-25T08:42:04.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.291+0000 7f631f99e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63180cbf00 0x7f631806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.291+0000 7f631f99e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63180cae60 con 0x7f63180cc390 2024-04-25T08:42:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.291+0000 7f631f99e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63180cb140 con 0x7f631815dbb0 2024-04-25T08:42:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.291+0000 7f631f99e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63180cb420 con 0x7f63180cbf00 2024-04-25T08:42:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.292+0000 7f631cf39640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63180cbf00 0x7f631806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.292+0000 7f631cf39640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63180cbf00 0x7f631806bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48050/0 (socket says 172.21.15.172:48050) 2024-04-25T08:42:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.292+0000 7f631cf39640 1 -- 172.21.15.172:0/839823288 learned_addr learned my addr 172.21.15.172:0/839823288 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.292+0000 7f631cf39640 1 -- 172.21.15.172:0/839823288 >> v2:172.21.15.172:3300/0 conn(0x7f63180cbf00 msgr2=0x7f631806bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T08:42:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.292+0000 7f631cf39640 1 -- 172.21.15.172:0/839823288 >> v2:172.21.15.172:3300/0 conn(0x7f63180cbf00 msgr2=0x7f631806bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T08:42:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.292+0000 7f631cf39640 1 --2- 172.21.15.172:0/839823288 >> v2:172.21.15.172:3300/0 conn(0x7f63180cbf00 0x7f631806bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T08:42:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.292+0000 7f631cf39640 1 --2- 172.21.15.172:0/839823288 >> v2:172.21.15.172:3300/0 conn(0x7f63180cbf00 0x7f631806bbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T08:42:04.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.448+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663537871 0 0) 0x7f63180cae60 con 0x7f63180cc390 2024-04-25T08:42:04.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.448+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6304003520 con 0x7f63180cc390 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.448+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638713999 0 0) 0x7f63180cb140 con 0x7f631815dbb0 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.448+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63180cae60 con 0x7f631815dbb0 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2895124055 0 0) 0x7f6304003520 con 0x7f63180cc390 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 >> v2:172.21.15.172:3300/0 conn(0x7f63180cbf00 msgr2=0x7f631806bbf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 --2- 172.21.15.172:0/839823288 >> v2:172.21.15.172:3300/0 conn(0x7f63180cbf00 0x7f631806bbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 >> v1:172.21.15.186:6789/0 conn(0x7f631815dbb0 legacy=0x7f631806fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63180cb700 con 0x7f63180cc390 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f6310001670 con 0x7f63180cc390 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 >> v1:172.21.15.172:6789/0 conn(0x7f63180cc390 legacy=0x7f631806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6304003b40 0x7f6304003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:04.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6304004800 0x7f6304004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63040051c0 0x7f630400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63180cb420 con 0x7f63040051c0 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630400c0f0 con 0x7f6304004800 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630400c2f0 con 0x7f6304003b40 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f631d73a640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6304003b40 0x7f6304003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f631df3b640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63040051c0 0x7f630400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.449+0000 7f631cf39640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6304004800 0x7f6304004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.450+0000 7f631df3b640 1 -- 172.21.15.172:0/839823288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6304003b40 msgr2=0x7f6304003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.450+0000 7f631df3b640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6304003b40 0x7f6304003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.450+0000 7f631df3b640 1 -- 172.21.15.172:0/839823288 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6304004800 msgr2=0x7f6304004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.450+0000 7f631df3b640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6304004800 0x7f6304004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.450+0000 7f631df3b640 1 -- 172.21.15.172:0/839823288 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63180cb700 con 0x7f63040051c0 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.450+0000 7f631cf39640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6304004800 0x7f6304004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:04.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.450+0000 7f631df3b640 1 -- 172.21.15.172:0/839823288 reap_dead start 2024-04-25T08:42:04.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.451+0000 7f631df3b640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63040051c0 0x7f630400b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f63100149f0 tx=0x7f6304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66f400889ef93de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:04.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.451+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310040070 con 0x7f63040051c0 2024-04-25T08:42:04.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.451+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310033980 con 0x7f63040051c0 2024-04-25T08:42:04.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.451+0000 7f630ffff640 1 -- 172.21.15.172:0/839823288 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800f040 con 0x7f63040051c0 2024-04-25T08:42:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.452+0000 7f631f99e640 1 -- 172.21.15.172:0/839823288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63040051c0 msgr2=0x7f630400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.452+0000 7f631f99e640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63040051c0 0x7f630400b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f63100149f0 tx=0x7f6304005830 comp rx=0 tx=0).stop 2024-04-25T08:42:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.452+0000 7f631f99e640 1 -- 172.21.15.172:0/839823288 shutdown_connections 2024-04-25T08:42:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.452+0000 7f631f99e640 1 --2- 172.21.15.172:0/839823288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63040051c0 0x7f630400b9c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.452+0000 7f631f99e640 1 -- 172.21.15.172:0/839823288 >> 172.21.15.172:0/839823288 conn(0x7f6318071af0 msgr2=0x7f6318071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.452+0000 7f631f99e640 1 -- 172.21.15.172:0/839823288 shutdown_connections 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.452+0000 7f631f99e640 1 -- 172.21.15.172:0/839823288 wait complete. 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.453+0000 7f631f99e640 1 Processor -- start 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.453+0000 7f631f99e640 1 -- start start 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631f99e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040051c0 0x7f63180c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631f99e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f631814f7c0 0x7f631806ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631f99e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63180c5950 0x7f63181537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631f99e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63180cab10 con 0x7f63180c5950 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631f99e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631815df90 con 0x7f631814f7c0 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631f99e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6318072ac0 con 0x7f63040051c0 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631df3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63180c5950 0x7f63181537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631df3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63180c5950 0x7f63181537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48068/0 (socket says 172.21.15.172:48068) 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631df3b640 1 -- 172.21.15.172:0/2873559834 learned_addr learned my addr 172.21.15.172:0/2873559834 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631cf39640 1 --2- 172.21.15.172:0/2873559834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f631814f7c0 0x7f631806ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631d73a640 1 --2- 172.21.15.172:0/2873559834 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040051c0 0x7f63180c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631df3b640 1 -- 172.21.15.172:0/2873559834 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040051c0 msgr2=0x7f63180c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631df3b640 1 --2- 172.21.15.172:0/2873559834 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040051c0 0x7f63180c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631df3b640 1 -- 172.21.15.172:0/2873559834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f631814f7c0 msgr2=0x7f631806ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631df3b640 1 --2- 172.21.15.172:0/2873559834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f631814f7c0 0x7f631806ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631df3b640 1 -- 172.21.15.172:0/2873559834 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63180b14c0 con 0x7f63180c5950 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f631df3b640 1 --2- 172.21.15.172:0/2873559834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63180c5950 0x7f63181537b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f631003e040 tx=0x7f6310001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.454+0000 7f630dffb640 1 -- 172.21.15.172:0/2873559834 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310049070 con 0x7f63180c5950 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.455+0000 7f630dffb640 1 -- 172.21.15.172:0/2873559834 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310005290 con 0x7f63180c5950 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.455+0000 7f631f99e640 1 -- 172.21.15.172:0/2873559834 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63180c4e90 con 0x7f63180c5950 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.455+0000 7f630dffb640 1 -- 172.21.15.172:0/2873559834 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310040040 con 0x7f63180c5950 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.455+0000 7f631f99e640 1 -- 172.21.15.172:0/2873559834 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63180c5450 con 0x7f63180c5950 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.455+0000 7f630dffb640 1 -- 172.21.15.172:0/2873559834 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f631004c070 con 0x7f63180c5950 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.455+0000 7f630dffb640 1 -- 172.21.15.172:0/2873559834 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f631004e780 con 0x7f63180c5950 2024-04-25T08:42:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.456+0000 7f631f99e640 1 -- 172.21.15.172:0/2873559834 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6318073a00 con 0x7f63180c5950 2024-04-25T08:42:04.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.458+0000 7f630dffb640 1 -- 172.21.15.172:0/2873559834 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6310065dd0 con 0x7f63180c5950 2024-04-25T08:42:04.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.524+0000 7f631f99e640 1 -- 172.21.15.172:0/2873559834 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6318061b50 con 0x7f63180c5950 2024-04-25T08:42:04.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.526+0000 7f630dffb640 1 -- 172.21.15.172:0/2873559834 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6310054090 con 0x7f63180c5950 2024-04-25T08:42:04.518 INFO:teuthology.orchestra.run.smithi172.stderr:adjusted tunables profile to default 2024-04-25T08:42:04.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.527+0000 7f631f99e640 1 -- 172.21.15.172:0/2873559834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63180c5950 msgr2=0x7f63181537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:04.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.527+0000 7f631f99e640 1 --2- 172.21.15.172:0/2873559834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63180c5950 0x7f63181537b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f631003e040 tx=0x7f6310001970 comp rx=0 tx=0).stop 2024-04-25T08:42:04.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.527+0000 7f631f99e640 1 -- 172.21.15.172:0/2873559834 shutdown_connections 2024-04-25T08:42:04.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.527+0000 7f631f99e640 1 --2- 172.21.15.172:0/2873559834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f631814f7c0 0x7f631806ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:04.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.527+0000 7f631f99e640 1 --2- 172.21.15.172:0/2873559834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63180c5950 0x7f63181537b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:04.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.527+0000 7f631f99e640 1 --2- 172.21.15.172:0/2873559834 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040051c0 0x7f63180c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:04.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.527+0000 7f631f99e640 1 -- 172.21.15.172:0/2873559834 >> 172.21.15.172:0/2873559834 conn(0x7f6318071af0 msgr2=0x7f6318157390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:04.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.527+0000 7f631f99e640 1 -- 172.21.15.172:0/2873559834 shutdown_connections 2024-04-25T08:42:04.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:04.527+0000 7f631f99e640 1 -- 172.21.15.172:0/2873559834 wait complete. 2024-04-25T08:42:04.530 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T08:42:04.531 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T08:42:04.531 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:04.531 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T08:42:04.556 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:04.556 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T08:42:04.557 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:04.564+0000 7fc8cde0e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T08:42:04.559 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:04.566+0000 7ff6d4f67040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T08:42:04.579 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:04.579 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T08:42:04.642 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:04.642 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T08:42:04.706 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:04.707 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T08:42:04.710 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:04.717+0000 7fc8cde0e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:42:04.713 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:04.719+0000 7ff6d4f67040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:42:04.730 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:04.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T08:42:04.764 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:04.772+0000 7fc8cde0e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T08:42:04.769 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:04.776+0000 7ff6d4f67040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T08:42:04.792 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:04.792 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T08:42:04.855 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:42:04.855 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T08:42:04.919 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 6d2b332e-9db6-4e47-9e73-f6401c952cbe 0 2024-04-25T08:42:05.001 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:05.009+0000 7fc8cde0e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T08:42:05.019 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:05.026+0000 7ff6d4f67040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T08:42:05.047 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:05.054+0000 7fc8cde0e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T08:42:05.057 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.063+0000 7f9f3efc8640 1 Processor -- start 2024-04-25T08:42:05.057 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.063+0000 7f9f3efc8640 1 -- start start 2024-04-25T08:42:05.058 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.064+0000 7f9f3efc8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9f380cd6f0 0x7f9f38165520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.058 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.064+0000 7f9f3efc8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f380c6940 con 0x7f9f380c6010 2024-04-25T08:42:05.058 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.064+0000 7f9f3efc8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3815add0 con 0x7f9f3815a9f0 2024-04-25T08:42:05.058 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.064+0000 7f9f3efc8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f380b0020 con 0x7f9f380cd6f0 2024-04-25T08:42:05.059 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.064+0000 7f9f3cd64640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f9f3815a9f0 0x7f9f380cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:55874/0 (socket says 172.21.15.186:55874) 2024-04-25T08:42:05.059 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.064+0000 7f9f3cd64640 1 -- 172.21.15.186:0/2069299585 learned_addr learned my addr 172.21.15.186:0/2069299585 (peer_addr_for_me v1:172.21.15.186:0/0) 2024-04-25T08:42:05.059 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.064+0000 7f9f3d565640 1 --2- 172.21.15.186:0/2069299585 >> v2:172.21.15.172:3300/0 conn(0x7f9f380cd6f0 0x7f9f38165520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.059 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.065+0000 7f9f377fe640 1 -- 172.21.15.186:0/2069299585 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142721450 0 0) 0x7f9f3815add0 con 0x7f9f3815a9f0 2024-04-25T08:42:05.059 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.065+0000 7f9f377fe640 1 -- 172.21.15.186:0/2069299585 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f28003520 con 0x7f9f3815a9f0 2024-04-25T08:42:05.059 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.065+0000 7f9f377fe640 1 -- 172.21.15.186:0/2069299585 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857994214 0 0) 0x7f9f24001110 con 0x7f9f380c6010 2024-04-25T08:42:05.059 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.065+0000 7f9f377fe640 1 -- 172.21.15.186:0/2069299585 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3815add0 con 0x7f9f380c6010 2024-04-25T08:42:05.059 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.065+0000 7f9f3d565640 1 -- 172.21.15.186:0/2069299585 >> v1:172.21.15.186:6789/0 conn(0x7f9f3815a9f0 legacy=0x7f9f380cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.059 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.065+0000 7f9f3d565640 1 -- 172.21.15.186:0/2069299585 >> v1:172.21.15.172:6789/0 conn(0x7f9f380c6010 legacy=0x7f9f380ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.059 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.065+0000 7f9f3d565640 1 -- 172.21.15.186:0/2069299585 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380c6660 con 0x7f9f380cd6f0 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.065+0000 7f9f3d565640 1 --2- 172.21.15.186:0/2069299585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f380cd6f0 0x7f9f38165520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009d90 tx=0x7f9f3002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7923876e329475f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.066+0000 7f9f377fe640 1 -- 172.21.15.186:0/2069299585 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30007740 con 0x7f9f380cd6f0 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.066+0000 7f9f377fe640 1 -- 172.21.15.186:0/2069299585 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f300078e0 con 0x7f9f380cd6f0 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.066+0000 7f9f377fe640 1 -- 172.21.15.186:0/2069299585 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30007cb0 con 0x7f9f380cd6f0 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.066+0000 7f9f3efc8640 1 -- 172.21.15.186:0/2069299585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f380cd6f0 msgr2=0x7f9f38165520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.066+0000 7f9f3efc8640 1 --2- 172.21.15.186:0/2069299585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f380cd6f0 0x7f9f38165520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009d90 tx=0x7f9f3002a6f0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.066+0000 7f9f3efc8640 1 -- 172.21.15.186:0/2069299585 shutdown_connections 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.066+0000 7f9f3efc8640 1 --2- 172.21.15.186:0/2069299585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f380cd6f0 0x7f9f38165520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.066+0000 7f9f3efc8640 1 -- 172.21.15.186:0/2069299585 >> 172.21.15.186:0/2069299585 conn(0x7f9f380b2390 msgr2=0x7f9f380b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.066+0000 7f9f3efc8640 1 -- 172.21.15.186:0/2069299585 shutdown_connections 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.066+0000 7f9f3efc8640 1 -- 172.21.15.186:0/2069299585 wait complete. 2024-04-25T08:42:05.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.068+0000 7f9f3efc8640 1 Processor -- start 2024-04-25T08:42:05.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.068+0000 7f9f3efc8640 1 -- start start 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.068+0000 7f9f3efc8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f380c6010 0x7f9f3814c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.068+0000 7f9f3efc8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f380cd6f0 0x7f9f381693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.068+0000 7f9f3efc8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f3815a9f0 0x7f9f380b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.068+0000 7f9f3efc8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380cb230 con 0x7f9f380c6010 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.068+0000 7f9f3efc8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380cb5a0 con 0x7f9f380cd6f0 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.068+0000 7f9f3efc8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380cca40 con 0x7f9f3815a9f0 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3d565640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f3815a9f0 0x7f9f380b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f37fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f380cd6f0 0x7f9f381693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3d565640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f3815a9f0 0x7f9f380b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:43120/0 (socket says 172.21.15.186:43120) 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3d565640 1 -- 172.21.15.186:0/661196716 learned_addr learned my addr 172.21.15.186:0/661196716 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T08:42:05.064 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3cd64640 1 --2- 172.21.15.186:0/661196716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f380c6010 0x7f9f3814c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3d565640 1 -- 172.21.15.186:0/661196716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f380cd6f0 msgr2=0x7f9f381693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3d565640 1 --2- 172.21.15.186:0/661196716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f380cd6f0 0x7f9f381693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3d565640 1 -- 172.21.15.186:0/661196716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f380c6010 msgr2=0x7f9f3814c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3d565640 1 --2- 172.21.15.186:0/661196716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f380c6010 0x7f9f3814c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3d565640 1 -- 172.21.15.186:0/661196716 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f38167b90 con 0x7f9f3815a9f0 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f37fff640 1 --2- 172.21.15.186:0/661196716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f380cd6f0 0x7f9f381693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3d565640 1 --2- 172.21.15.186:0/661196716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f3815a9f0 0x7f9f380b1200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9f3002ace0 tx=0x7f9f30004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f357fa640 1 -- 172.21.15.186:0/661196716 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30040070 con 0x7f9f3815a9f0 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f357fa640 1 -- 172.21.15.186:0/661196716 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f30031bc0 con 0x7f9f3815a9f0 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3efc8640 1 -- 172.21.15.186:0/661196716 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f38167e70 con 0x7f9f3815a9f0 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f357fa640 1 -- 172.21.15.186:0/661196716 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30009450 con 0x7f9f3815a9f0 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.069+0000 7f9f3efc8640 1 -- 172.21.15.186:0/661196716 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f38168430 con 0x7f9f3815a9f0 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.070+0000 7f9f357fa640 1 -- 172.21.15.186:0/661196716 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9f30039040 con 0x7f9f3815a9f0 2024-04-25T08:42:05.065 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.070+0000 7f9f357fa640 1 -- 172.21.15.186:0/661196716 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9f300042a0 con 0x7f9f3815a9f0 2024-04-25T08:42:05.066 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.070+0000 7f9f3efc8640 1 -- 172.21.15.186:0/661196716 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3806cc80 con 0x7f9f3815a9f0 2024-04-25T08:42:05.066 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.072+0000 7f9f357fa640 1 -- 172.21.15.186:0/661196716 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9f3004a060 con 0x7f9f3815a9f0 2024-04-25T08:42:05.067 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:05.074+0000 7ff6d4f67040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T08:42:05.138 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.145+0000 7f9f3efc8640 1 -- 172.21.15.186:0/661196716 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6d2b332e-9db6-4e47-9e73-f6401c952cbe", "id": 0} v 0) v1 -- 0x7f9f3806f630 con 0x7f9f3815a9f0 2024-04-25T08:42:05.144 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.151+0000 7f9f357fa640 1 -- 172.21.15.186:0/661196716 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d2b332e-9db6-4e47-9e73-f6401c952cbe", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9f3806f630 con 0x7f9f3815a9f0 2024-04-25T08:42:05.145 INFO:teuthology.orchestra.run.smithi186.stdout:0 2024-04-25T08:42:05.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.152+0000 7f9f3efc8640 1 -- 172.21.15.186:0/661196716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f3815a9f0 msgr2=0x7f9f380b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.152+0000 7f9f3efc8640 1 --2- 172.21.15.186:0/661196716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f3815a9f0 0x7f9f380b1200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9f3002ace0 tx=0x7f9f30004a40 comp rx=0 tx=0).stop 2024-04-25T08:42:05.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.152+0000 7f9f3efc8640 1 -- 172.21.15.186:0/661196716 shutdown_connections 2024-04-25T08:42:05.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.152+0000 7f9f3efc8640 1 --2- 172.21.15.186:0/661196716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f380cd6f0 0x7f9f381693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.152+0000 7f9f3efc8640 1 --2- 172.21.15.186:0/661196716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f3815a9f0 0x7f9f380b1200 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.152+0000 7f9f3efc8640 1 --2- 172.21.15.186:0/661196716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f380c6010 0x7f9f3814c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.152+0000 7f9f3efc8640 1 -- 172.21.15.186:0/661196716 >> 172.21.15.186:0/661196716 conn(0x7f9f380b2390 msgr2=0x7f9f3806ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:05.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.152+0000 7f9f3efc8640 1 -- 172.21.15.186:0/661196716 shutdown_connections 2024-04-25T08:42:05.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.152+0000 7f9f3efc8640 1 -- 172.21.15.186:0/661196716 wait complete. 2024-04-25T08:42:05.156 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 94541717-bc18-474e-b64c-bb86bf951952 1 2024-04-25T08:42:05.253 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.260+0000 7f6319641640 1 Processor -- start 2024-04-25T08:42:05.253 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.260+0000 7f6319641640 1 -- start start 2024-04-25T08:42:05.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6319641640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f631415dc20 0x7f63140ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6319641640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63140d32f0 0x7f63140cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6319641640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631415e000 con 0x7f6314161710 2024-04-25T08:42:05.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6319641640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63140d1de0 con 0x7f63140d32f0 2024-04-25T08:42:05.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6319641640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6314161c60 con 0x7f631415dc20 2024-04-25T08:42:05.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6312ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f631415dc20 0x7f63140ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f63127fc640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f6314161710 0x7f631406bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:55876/0 (socket says 172.21.15.186:55876) 2024-04-25T08:42:05.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f63127fc640 1 -- 172.21.15.186:0/1437179262 learned_addr learned my addr 172.21.15.186:0/1437179262 (peer_addr_for_me v1:172.21.15.186:0/0) 2024-04-25T08:42:05.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f63137fe640 1 --2- 172.21.15.186:0/1437179262 >> v2:172.21.15.172:3300/0 conn(0x7f63140d32f0 0x7f63140cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.256 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6311ffb640 1 -- 172.21.15.186:0/1437179262 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50655912 0 0) 0x7f631415e000 con 0x7f6314161710 2024-04-25T08:42:05.256 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6311ffb640 1 -- 172.21.15.186:0/1437179262 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6300003520 con 0x7f6314161710 2024-04-25T08:42:05.256 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6312ffd640 1 -- 172.21.15.186:0/1437179262 >> v2:172.21.15.172:3300/0 conn(0x7f63140d32f0 msgr2=0x7f63140cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:05.256 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6312ffd640 1 --2- 172.21.15.186:0/1437179262 >> v2:172.21.15.172:3300/0 conn(0x7f63140d32f0 0x7f63140cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.256 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6312ffd640 1 -- 172.21.15.186:0/1437179262 >> v1:172.21.15.186:6789/0 conn(0x7f6314161710 legacy=0x7f631406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.256 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.261+0000 7f6312ffd640 1 -- 172.21.15.186:0/1437179262 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6314161f40 con 0x7f631415dc20 2024-04-25T08:42:05.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.262+0000 7f6312ffd640 1 --2- 172.21.15.186:0/1437179262 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f631415dc20 0x7f63140ce670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0097a0 tx=0x7f62fc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1401c90e3266dfde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:05.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.262+0000 7f6311ffb640 1 -- 172.21.15.186:0/1437179262 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc037070 con 0x7f631415dc20 2024-04-25T08:42:05.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.262+0000 7f6311ffb640 1 -- 172.21.15.186:0/1437179262 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc032440 con 0x7f631415dc20 2024-04-25T08:42:05.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.262+0000 7f6311ffb640 1 -- 172.21.15.186:0/1437179262 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc032810 con 0x7f631415dc20 2024-04-25T08:42:05.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.263+0000 7f6319641640 1 -- 172.21.15.186:0/1437179262 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f631415dc20 msgr2=0x7f63140ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.258 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.263+0000 7f6319641640 1 --2- 172.21.15.186:0/1437179262 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f631415dc20 0x7f63140ce670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0097a0 tx=0x7f62fc02a180 comp rx=0 tx=0).stop 2024-04-25T08:42:05.258 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.263+0000 7f6319641640 1 -- 172.21.15.186:0/1437179262 shutdown_connections 2024-04-25T08:42:05.258 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.263+0000 7f6319641640 1 --2- 172.21.15.186:0/1437179262 >> v2:172.21.15.172:3300/0 conn(0x7f63140d32f0 0x7f63140cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.258 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.263+0000 7f6319641640 1 --2- 172.21.15.186:0/1437179262 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f631415dc20 0x7f63140ce670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.258 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.263+0000 7f6319641640 1 -- 172.21.15.186:0/1437179262 >> 172.21.15.186:0/1437179262 conn(0x7f63140d0420 msgr2=0x7f63140d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:05.258 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.263+0000 7f6319641640 1 -- 172.21.15.186:0/1437179262 shutdown_connections 2024-04-25T08:42:05.258 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.263+0000 7f6319641640 1 -- 172.21.15.186:0/1437179262 wait complete. 2024-04-25T08:42:05.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6319641640 1 Processor -- start 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6319641640 1 -- start start 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6319641640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63140d32f0 0x7f63140cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6319641640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f631415dc20 0x7f6314146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6319641640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6314161710 0x7f6314148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6319641640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b5e50 con 0x7f631415dc20 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6319641640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6314162500 con 0x7f6314161710 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6319641640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b5fd0 con 0x7f63140d32f0 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6312ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63140d32f0 0x7f63140cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f63137fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6314161710 0x7f6314148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6312ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63140d32f0 0x7f63140cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:43140/0 (socket says 172.21.15.186:43140) 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f6312ffd640 1 -- 172.21.15.186:0/1679113472 learned_addr learned my addr 172.21.15.186:0/1679113472 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.265+0000 7f63127fc640 1 --2- 172.21.15.186:0/1679113472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f631415dc20 0x7f6314146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f63137fe640 1 -- 172.21.15.186:0/1679113472 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63140d32f0 msgr2=0x7f63140cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f63137fe640 1 --2- 172.21.15.186:0/1679113472 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63140d32f0 0x7f63140cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f63137fe640 1 -- 172.21.15.186:0/1679113472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f631415dc20 msgr2=0x7f6314146c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f63137fe640 1 --2- 172.21.15.186:0/1679113472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f631415dc20 0x7f6314146c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f63137fe640 1 -- 172.21.15.186:0/1679113472 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63141595c0 con 0x7f6314161710 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f6312ffd640 1 --2- 172.21.15.186:0/1679113472 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63140d32f0 0x7f63140cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f63137fe640 1 --2- 172.21.15.186:0/1679113472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6314161710 0x7f6314148cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f630c00eb50 tx=0x7f630c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f630b7fe640 1 -- 172.21.15.186:0/1679113472 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c018020 con 0x7f6314161710 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f630b7fe640 1 -- 172.21.15.186:0/1679113472 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c00cd40 con 0x7f6314161710 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f6319641640 1 -- 172.21.15.186:0/1679113472 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6314149400 con 0x7f6314161710 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f630b7fe640 1 -- 172.21.15.186:0/1679113472 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c0146c0 con 0x7f6314161710 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f6319641640 1 -- 172.21.15.186:0/1679113472 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63141499c0 con 0x7f6314161710 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f630b7fe640 1 -- 172.21.15.186:0/1679113472 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f630c005d10 con 0x7f6314161710 2024-04-25T08:42:05.262 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.266+0000 7f630b7fe640 1 -- 172.21.15.186:0/1679113472 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f630c013790 con 0x7f6314161710 2024-04-25T08:42:05.263 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.267+0000 7f6319641640 1 -- 172.21.15.186:0/1679113472 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6314073a00 con 0x7f6314161710 2024-04-25T08:42:05.263 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.269+0000 7f630b7fe640 1 -- 172.21.15.186:0/1679113472 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f630c022030 con 0x7f6314161710 2024-04-25T08:42:05.335 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.342+0000 7f6319641640 1 -- 172.21.15.186:0/1679113472 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "94541717-bc18-474e-b64c-bb86bf951952", "id": 1} v 0) v1 -- 0x7f63140d16b0 con 0x7f6314161710 2024-04-25T08:42:05.338 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.345+0000 7f630b7fe640 1 -- 172.21.15.186:0/1679113472 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94541717-bc18-474e-b64c-bb86bf951952", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f630c010040 con 0x7f6314161710 2024-04-25T08:42:05.338 INFO:teuthology.orchestra.run.smithi186.stdout:1 2024-04-25T08:42:05.339 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.346+0000 7f6319641640 1 -- 172.21.15.186:0/1679113472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6314161710 msgr2=0x7f6314148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.340 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.346+0000 7f6319641640 1 --2- 172.21.15.186:0/1679113472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6314161710 0x7f6314148cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f630c00eb50 tx=0x7f630c00c490 comp rx=0 tx=0).stop 2024-04-25T08:42:05.340 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.346+0000 7f6319641640 1 -- 172.21.15.186:0/1679113472 shutdown_connections 2024-04-25T08:42:05.340 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.346+0000 7f6319641640 1 --2- 172.21.15.186:0/1679113472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6314161710 0x7f6314148cb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.340 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.346+0000 7f6319641640 1 --2- 172.21.15.186:0/1679113472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f631415dc20 0x7f6314146c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.340 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.346+0000 7f6319641640 1 --2- 172.21.15.186:0/1679113472 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63140d32f0 0x7f63140cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.340 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.346+0000 7f6319641640 1 -- 172.21.15.186:0/1679113472 >> 172.21.15.186:0/1679113472 conn(0x7f63140d0420 msgr2=0x7f63140b8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:05.340 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.346+0000 7f6319641640 1 -- 172.21.15.186:0/1679113472 shutdown_connections 2024-04-25T08:42:05.340 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.346+0000 7f6319641640 1 -- 172.21.15.186:0/1679113472 wait complete. 2024-04-25T08:42:05.350 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new d41b27c4-f2ab-4bed-bea7-25436f39e91a 2 2024-04-25T08:42:05.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.456+0000 7f4538a5d640 1 Processor -- start 2024-04-25T08:42:05.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.456+0000 7f4538a5d640 1 -- start start 2024-04-25T08:42:05.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f4538a5d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f453415dbb0 0x7f453406fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f4538a5d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f453406c300 0x7f453406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f4538a5d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340cae60 con 0x7f45340cbf00 2024-04-25T08:42:05.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f4538a5d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45340cb140 con 0x7f453406c300 2024-04-25T08:42:05.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f4538a5d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45340cb420 con 0x7f453415dbb0 2024-04-25T08:42:05.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f453259c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f453415dbb0 0x7f453406fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f4531d9b640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f45340cbf00 0x7f453406bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:55878/0 (socket says 172.21.15.186:55878) 2024-04-25T08:42:05.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f4531d9b640 1 -- 172.21.15.186:0/1707576707 learned_addr learned my addr 172.21.15.186:0/1707576707 (peer_addr_for_me v1:172.21.15.186:0/0) 2024-04-25T08:42:05.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f4532d9d640 1 --2- 172.21.15.186:0/1707576707 >> v2:172.21.15.172:3300/0 conn(0x7f453406c300 0x7f453406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.452 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f453259c640 1 -- 172.21.15.186:0/1707576707 >> v2:172.21.15.172:3300/0 conn(0x7f453406c300 msgr2=0x7f453406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:05.452 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f453259c640 1 --2- 172.21.15.186:0/1707576707 >> v2:172.21.15.172:3300/0 conn(0x7f453406c300 0x7f453406db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.452 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f453259c640 1 -- 172.21.15.186:0/1707576707 >> v1:172.21.15.186:6789/0 conn(0x7f45340cbf00 legacy=0x7f453406bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.452 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f453159a640 1 -- 172.21.15.186:0/1707576707 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704548441 0 0) 0x7f45340cae60 con 0x7f45340cbf00 2024-04-25T08:42:05.452 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.457+0000 7f453259c640 1 -- 172.21.15.186:0/1707576707 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45340cb700 con 0x7f453415dbb0 2024-04-25T08:42:05.453 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.458+0000 7f453259c640 1 --2- 172.21.15.186:0/1707576707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 0x7f453406fea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4534062330 tx=0x7f452802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6117d164410a5ebe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:05.453 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.458+0000 7f453159a640 1 -- 172.21.15.186:0/1707576707 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528037070 con 0x7f453415dbb0 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.458+0000 7f453159a640 1 -- 172.21.15.186:0/1707576707 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4528032440 con 0x7f453415dbb0 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.458+0000 7f453159a640 1 -- 172.21.15.186:0/1707576707 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528032810 con 0x7f453415dbb0 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.459+0000 7f4538a5d640 1 -- 172.21.15.186:0/1707576707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 msgr2=0x7f453406fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.459+0000 7f4538a5d640 1 --2- 172.21.15.186:0/1707576707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 0x7f453406fea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4534062330 tx=0x7f452802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.459+0000 7f4538a5d640 1 -- 172.21.15.186:0/1707576707 shutdown_connections 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.459+0000 7f4538a5d640 1 --2- 172.21.15.186:0/1707576707 >> v2:172.21.15.172:3300/0 conn(0x7f453406c300 0x7f453406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.459+0000 7f4538a5d640 1 --2- 172.21.15.186:0/1707576707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 0x7f453406fea0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.459+0000 7f4538a5d640 1 -- 172.21.15.186:0/1707576707 >> 172.21.15.186:0/1707576707 conn(0x7f4534071af0 msgr2=0x7f4534071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.459+0000 7f4538a5d640 1 -- 172.21.15.186:0/1707576707 shutdown_connections 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.459+0000 7f4538a5d640 1 -- 172.21.15.186:0/1707576707 wait complete. 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.460+0000 7f4538a5d640 1 Processor -- start 2024-04-25T08:42:05.454 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.460+0000 7f4538a5d640 1 -- start start 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4538a5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f453406c300 0x7f4534158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4538a5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45340cbf00 0x7f45340c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4538a5d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 0x7f45340b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4538a5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45340cab10 con 0x7f453406c300 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4538a5d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453415df90 con 0x7f453415dbb0 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4538a5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45340703e0 con 0x7f45340cbf00 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4531d9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45340cbf00 0x7f45340c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4532d9d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 0x7f45340b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4531d9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45340cbf00 0x7f45340c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:43144/0 (socket says 172.21.15.186:43144) 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4532d9d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 0x7f45340b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:48666/0 (socket says 172.21.15.186:48666) 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4531d9b640 1 -- 172.21.15.186:0/2811948662 learned_addr learned my addr 172.21.15.186:0/2811948662 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T08:42:05.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f453259c640 1 --2- 172.21.15.186:0/2811948662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f453406c300 0x7f4534158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4531d9b640 1 -- 172.21.15.186:0/2811948662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 msgr2=0x7f45340b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4531d9b640 1 --2- 172.21.15.186:0/2811948662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 0x7f45340b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4531d9b640 1 -- 172.21.15.186:0/2811948662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f453406c300 msgr2=0x7f4534158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4531d9b640 1 --2- 172.21.15.186:0/2811948662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f453406c300 0x7f4534158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4531d9b640 1 -- 172.21.15.186:0/2811948662 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453415e1b0 con 0x7f45340cbf00 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.461+0000 7f4532d9d640 1 --2- 172.21.15.186:0/2811948662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 0x7f45340b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.462+0000 7f4531d9b640 1 --2- 172.21.15.186:0/2811948662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45340cbf00 0x7f45340c8500 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f452400c500 tx=0x7f452400c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.462+0000 7f4522ffd640 1 -- 172.21.15.186:0/2811948662 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524018070 con 0x7f45340cbf00 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.462+0000 7f4522ffd640 1 -- 172.21.15.186:0/2811948662 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4524007580 con 0x7f45340cbf00 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.462+0000 7f4538a5d640 1 -- 172.21.15.186:0/2811948662 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453415e490 con 0x7f45340cbf00 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.462+0000 7f4522ffd640 1 -- 172.21.15.186:0/2811948662 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524004a20 con 0x7f45340cbf00 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.462+0000 7f4538a5d640 1 -- 172.21.15.186:0/2811948662 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453415ea50 con 0x7f45340cbf00 2024-04-25T08:42:05.458 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.462+0000 7f4522ffd640 1 -- 172.21.15.186:0/2811948662 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f452401b070 con 0x7f45340cbf00 2024-04-25T08:42:05.459 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.462+0000 7f4522ffd640 1 -- 172.21.15.186:0/2811948662 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4524012820 con 0x7f45340cbf00 2024-04-25T08:42:05.459 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.463+0000 7f4538a5d640 1 -- 172.21.15.186:0/2811948662 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4534073a00 con 0x7f45340cbf00 2024-04-25T08:42:05.459 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.465+0000 7f4522ffd640 1 -- 172.21.15.186:0/2811948662 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4524012400 con 0x7f45340cbf00 2024-04-25T08:42:05.531 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.538+0000 7f4538a5d640 1 -- 172.21.15.186:0/2811948662 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d41b27c4-f2ab-4bed-bea7-25436f39e91a", "id": 2} v 0) v1 -- 0x7f453415c0c0 con 0x7f45340cbf00 2024-04-25T08:42:05.536 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.543+0000 7f4522ffd640 1 -- 172.21.15.186:0/2811948662 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d41b27c4-f2ab-4bed-bea7-25436f39e91a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4524012ac0 con 0x7f45340cbf00 2024-04-25T08:42:05.537 INFO:teuthology.orchestra.run.smithi186.stdout:2 2024-04-25T08:42:05.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.544+0000 7f4538a5d640 1 -- 172.21.15.186:0/2811948662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45340cbf00 msgr2=0x7f45340c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.544+0000 7f4538a5d640 1 --2- 172.21.15.186:0/2811948662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45340cbf00 0x7f45340c8500 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f452400c500 tx=0x7f452400c9c0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.544+0000 7f4538a5d640 1 -- 172.21.15.186:0/2811948662 shutdown_connections 2024-04-25T08:42:05.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.544+0000 7f4538a5d640 1 --2- 172.21.15.186:0/2811948662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f453415dbb0 0x7f45340b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.544+0000 7f4538a5d640 1 --2- 172.21.15.186:0/2811948662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45340cbf00 0x7f45340c8500 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.544+0000 7f4538a5d640 1 --2- 172.21.15.186:0/2811948662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f453406c300 0x7f4534158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.544+0000 7f4538a5d640 1 -- 172.21.15.186:0/2811948662 >> 172.21.15.186:0/2811948662 conn(0x7f4534071af0 msgr2=0x7f4534161510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:05.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.544+0000 7f4538a5d640 1 -- 172.21.15.186:0/2811948662 shutdown_connections 2024-04-25T08:42:05.539 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.544+0000 7f4538a5d640 1 -- 172.21.15.186:0/2811948662 wait complete. 2024-04-25T08:42:05.548 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 7ec284fb-fe73-4631-9b85-603e83e63599 3 2024-04-25T08:42:05.646 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.652+0000 7fcf121c8640 1 Processor -- start 2024-04-25T08:42:05.646 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.652+0000 7fcf121c8640 1 -- start start 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf121c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c15dbb0 0x7fcf0c06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf121c8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcf0c06c300 0x7fcf0c06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf121c8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c0cae60 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf121c8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c0cb140 con 0x7fcf0c06c300 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf121c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0cb420 con 0x7fcf0c15dbb0 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf0bfff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcf0c06c300 0x7fcf0c06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf0b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c15dbb0 0x7fcf0c06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf0bfff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcf0c06c300 0x7fcf0c06db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:48672/0 (socket says 172.21.15.186:48672) 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf0b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c15dbb0 0x7fcf0c06fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:43154/0 (socket says 172.21.15.186:43154) 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf03fff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fcf0c0cbf00 0x7fcf0c06bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:55882/0 (socket says 172.21.15.186:55882) 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.653+0000 7fcf0bfff640 1 -- 172.21.15.186:0/2648603798 learned_addr learned my addr 172.21.15.186:0/2648603798 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.654+0000 7fcf0bfff640 1 -- 172.21.15.186:0/2648603798 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c15dbb0 msgr2=0x7fcf0c06fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:05.648 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.654+0000 7fcf0bfff640 1 --2- 172.21.15.186:0/2648603798 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c15dbb0 0x7fcf0c06fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.649 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.654+0000 7fcf0bfff640 1 -- 172.21.15.186:0/2648603798 >> v1:172.21.15.186:6789/0 conn(0x7fcf0c0cbf00 legacy=0x7fcf0c06bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.649 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.654+0000 7fcf0affd640 1 -- 172.21.15.186:0/2648603798 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557280780 0 0) 0x7fcf0c0cae60 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.649 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.654+0000 7fcf0bfff640 1 -- 172.21.15.186:0/2648603798 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0cb700 con 0x7fcf0c06c300 2024-04-25T08:42:05.649 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.654+0000 7fcf0b7fe640 1 --2- 172.21.15.186:0/2648603798 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c15dbb0 0x7fcf0c06fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:05.649 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.654+0000 7fcf0bfff640 1 --2- 172.21.15.186:0/2648603798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c06c300 0x7fcf0c06db50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009e50 tx=0x7fcf0402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b98ba58818381d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:05.649 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.654+0000 7fcf0affd640 1 -- 172.21.15.186:0/2648603798 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04036070 con 0x7fcf0c06c300 2024-04-25T08:42:05.649 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.654+0000 7fcf0affd640 1 -- 172.21.15.186:0/2648603798 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf04031600 con 0x7fcf0c06c300 2024-04-25T08:42:05.649 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.654+0000 7fcf0affd640 1 -- 172.21.15.186:0/2648603798 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf040319d0 con 0x7fcf0c06c300 2024-04-25T08:42:05.652 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.655+0000 7fcf121c8640 1 -- 172.21.15.186:0/2648603798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c06c300 msgr2=0x7fcf0c06db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.652 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.655+0000 7fcf121c8640 1 --2- 172.21.15.186:0/2648603798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c06c300 0x7fcf0c06db50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009e50 tx=0x7fcf0402a710 comp rx=0 tx=0).stop 2024-04-25T08:42:05.652 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.655+0000 7fcf121c8640 1 -- 172.21.15.186:0/2648603798 shutdown_connections 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.655+0000 7fcf121c8640 1 --2- 172.21.15.186:0/2648603798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c06c300 0x7fcf0c06db50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.655+0000 7fcf121c8640 1 --2- 172.21.15.186:0/2648603798 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c15dbb0 0x7fcf0c06fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.655+0000 7fcf121c8640 1 -- 172.21.15.186:0/2648603798 >> 172.21.15.186:0/2648603798 conn(0x7fcf0c071af0 msgr2=0x7fcf0c071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.655+0000 7fcf121c8640 1 -- 172.21.15.186:0/2648603798 shutdown_connections 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.655+0000 7fcf121c8640 1 -- 172.21.15.186:0/2648603798 wait complete. 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.656+0000 7fcf121c8640 1 Processor -- start 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.656+0000 7fcf121c8640 1 -- start start 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf121c8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c06c300 0x7fcf0c1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf121c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0cbf00 0x7fcf0c0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf121c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0c15dbb0 0x7fcf0c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf121c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0cab10 con 0x7fcf0c15dbb0 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf121c8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c15df90 con 0x7fcf0c06c300 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf121c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0703e0 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.653 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf0b7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c06c300 0x7fcf0c1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf03fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0cbf00 0x7fcf0c0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf03fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0cbf00 0x7fcf0c0b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:43162/0 (socket says 172.21.15.186:43162) 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf03fff640 1 -- 172.21.15.186:0/1285753180 learned_addr learned my addr 172.21.15.186:0/1285753180 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf0bfff640 1 --2- 172.21.15.186:0/1285753180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0c15dbb0 0x7fcf0c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf03fff640 1 -- 172.21.15.186:0/1285753180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c06c300 msgr2=0x7fcf0c1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf03fff640 1 --2- 172.21.15.186:0/1285753180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c06c300 0x7fcf0c1508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf03fff640 1 -- 172.21.15.186:0/1285753180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0c15dbb0 msgr2=0x7fcf0c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf03fff640 1 --2- 172.21.15.186:0/1285753180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0c15dbb0 0x7fcf0c0c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf03fff640 1 -- 172.21.15.186:0/1285753180 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0b2cc0 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.657+0000 7fcf0b7fe640 1 --2- 172.21.15.186:0/1285753180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c06c300 0x7fcf0c1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.658+0000 7fcf03fff640 1 --2- 172.21.15.186:0/1285753180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0cbf00 0x7fcf0c0b4da0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c4d0 tx=0x7fcef400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.658+0000 7fcf08ff9640 1 -- 172.21.15.186:0/1285753180 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4018070 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.654 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.658+0000 7fcf08ff9640 1 -- 172.21.15.186:0/1285753180 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef4007500 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.655 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.658+0000 7fcf121c8640 1 -- 172.21.15.186:0/1285753180 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c0b2fa0 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.655 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.658+0000 7fcf08ff9640 1 -- 172.21.15.186:0/1285753180 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4004a20 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.655 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.658+0000 7fcf121c8640 1 -- 172.21.15.186:0/1285753180 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c0b3560 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.655 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.658+0000 7fcf08ff9640 1 -- 172.21.15.186:0/1285753180 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcef401b070 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.655 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.658+0000 7fcf08ff9640 1 -- 172.21.15.186:0/1285753180 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fcef4012890 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.655 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.659+0000 7fcf121c8640 1 -- 172.21.15.186:0/1285753180 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c0cc6f0 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.655 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.661+0000 7fcf08ff9640 1 -- 172.21.15.186:0/1285753180 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fcf0c0cc6f0 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.726 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.733+0000 7fcf121c8640 1 -- 172.21.15.186:0/1285753180 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7ec284fb-fe73-4631-9b85-603e83e63599", "id": 3} v 0) v1 -- 0x7fcf0c061b50 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.732 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.739+0000 7fcf08ff9640 1 -- 172.21.15.186:0/1285753180 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ec284fb-fe73-4631-9b85-603e83e63599", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcef4004dd0 con 0x7fcf0c0cbf00 2024-04-25T08:42:05.732 INFO:teuthology.orchestra.run.smithi186.stdout:3 2024-04-25T08:42:05.733 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.740+0000 7fcf121c8640 1 -- 172.21.15.186:0/1285753180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0cbf00 msgr2=0x7fcf0c0b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.733 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.740+0000 7fcf121c8640 1 --2- 172.21.15.186:0/1285753180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0cbf00 0x7fcf0c0b4da0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcef400c4d0 tx=0x7fcef400c990 comp rx=0 tx=0).stop 2024-04-25T08:42:05.734 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.740+0000 7fcf121c8640 1 -- 172.21.15.186:0/1285753180 shutdown_connections 2024-04-25T08:42:05.734 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.740+0000 7fcf121c8640 1 --2- 172.21.15.186:0/1285753180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0c15dbb0 0x7fcf0c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.734 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.740+0000 7fcf121c8640 1 --2- 172.21.15.186:0/1285753180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0cbf00 0x7fcf0c0b4da0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.734 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.740+0000 7fcf121c8640 1 --2- 172.21.15.186:0/1285753180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c06c300 0x7fcf0c1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.734 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.740+0000 7fcf121c8640 1 -- 172.21.15.186:0/1285753180 >> 172.21.15.186:0/1285753180 conn(0x7fcf0c071af0 msgr2=0x7fcf0c06f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:05.734 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.740+0000 7fcf121c8640 1 -- 172.21.15.186:0/1285753180 shutdown_connections 2024-04-25T08:42:05.734 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.740+0000 7fcf121c8640 1 -- 172.21.15.186:0/1285753180 wait complete. 2024-04-25T08:42:05.744 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 7552fd6b-df45-46e9-bfd3-60dc645cc1f7 4 2024-04-25T08:42:05.757 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:05.765+0000 7fc8cde0e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T08:42:05.822 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:05.829+0000 7ff6d4f67040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T08:42:05.841 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.848+0000 7f2deb9fe640 1 Processor -- start 2024-04-25T08:42:05.841 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.848+0000 7f2deb9fe640 1 -- start start 2024-04-25T08:42:05.844 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2deb9fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2de40cbf00 0x7f2de406bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.844 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2deb9fe640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de40cae60 con 0x7f2de40cc390 2024-04-25T08:42:05.844 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2deb9fe640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de40cb140 con 0x7f2de415dbb0 2024-04-25T08:42:05.844 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2deb9fe640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de40cb420 con 0x7f2de40cbf00 2024-04-25T08:42:05.844 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2de979a640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f2de415dbb0 0x7f2de406fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:55896/0 (socket says 172.21.15.186:55896) 2024-04-25T08:42:05.844 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2de979a640 1 -- 172.21.15.186:0/3473861270 learned_addr learned my addr 172.21.15.186:0/3473861270 (peer_addr_for_me v1:172.21.15.186:0/0) 2024-04-25T08:42:05.844 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2de8f99640 1 --2- 172.21.15.186:0/3473861270 >> v2:172.21.15.172:3300/0 conn(0x7f2de40cbf00 0x7f2de406bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.844 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2ddbfff640 1 -- 172.21.15.186:0/3473861270 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978559844 0 0) 0x7f2de40cb140 con 0x7f2de415dbb0 2024-04-25T08:42:05.844 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2ddbfff640 1 -- 172.21.15.186:0/3473861270 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd0003520 con 0x7f2de415dbb0 2024-04-25T08:42:05.845 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2ddbfff640 1 -- 172.21.15.186:0/3473861270 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123651409 0 0) 0x7f2de40cae60 con 0x7f2de40cc390 2024-04-25T08:42:05.845 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2ddbfff640 1 -- 172.21.15.186:0/3473861270 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2de40cb140 con 0x7f2de40cc390 2024-04-25T08:42:05.845 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2de8f99640 1 -- 172.21.15.186:0/3473861270 >> v1:172.21.15.186:6789/0 conn(0x7f2de415dbb0 legacy=0x7f2de406fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.845 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2de8f99640 1 -- 172.21.15.186:0/3473861270 >> v1:172.21.15.172:6789/0 conn(0x7f2de40cc390 legacy=0x7f2de406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.845 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.849+0000 7f2de8f99640 1 -- 172.21.15.186:0/3473861270 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40cb700 con 0x7f2de40cbf00 2024-04-25T08:42:05.845 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.850+0000 7f2de8f99640 1 --2- 172.21.15.186:0/3473861270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2de40cbf00 0x7f2de406bbf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40097a0 tx=0x7f2dd402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733d3a8d24aad235 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:05.845 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.850+0000 7f2ddbfff640 1 -- 172.21.15.186:0/3473861270 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4037070 con 0x7f2de40cbf00 2024-04-25T08:42:05.845 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.850+0000 7f2ddbfff640 1 -- 172.21.15.186:0/3473861270 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd4032440 con 0x7f2de40cbf00 2024-04-25T08:42:05.845 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.850+0000 7f2ddbfff640 1 -- 172.21.15.186:0/3473861270 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4032810 con 0x7f2de40cbf00 2024-04-25T08:42:05.846 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:05.852+0000 7fc8cde0e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T08:42:05.848 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.851+0000 7f2deb9fe640 1 -- 172.21.15.186:0/3473861270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2de40cbf00 msgr2=0x7f2de406bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.848 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.851+0000 7f2deb9fe640 1 --2- 172.21.15.186:0/3473861270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2de40cbf00 0x7f2de406bbf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40097a0 tx=0x7f2dd402a230 comp rx=0 tx=0).stop 2024-04-25T08:42:05.848 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.851+0000 7f2deb9fe640 1 -- 172.21.15.186:0/3473861270 shutdown_connections 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.851+0000 7f2deb9fe640 1 --2- 172.21.15.186:0/3473861270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2de40cbf00 0x7f2de406bbf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.851+0000 7f2deb9fe640 1 -- 172.21.15.186:0/3473861270 >> 172.21.15.186:0/3473861270 conn(0x7f2de4071af0 msgr2=0x7f2de4071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.851+0000 7f2deb9fe640 1 -- 172.21.15.186:0/3473861270 shutdown_connections 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.851+0000 7f2deb9fe640 1 -- 172.21.15.186:0/3473861270 wait complete. 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.852+0000 7f2deb9fe640 1 Processor -- start 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.852+0000 7f2deb9fe640 1 -- start start 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2deb9fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2de40cbf00 0x7f2de40b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2deb9fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2de40cc390 0x7f2de414f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2deb9fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2de415dbb0 0x7f2de40acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2deb9fe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40cab10 con 0x7f2de415dbb0 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2deb9fe640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de415df90 con 0x7f2de40cc390 2024-04-25T08:42:05.849 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2deb9fe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4072ac0 con 0x7f2de40cbf00 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de8f99640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2de40cc390 0x7f2de414f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de979a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2de40cbf00 0x7f2de40b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de8f99640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2de40cc390 0x7f2de414f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:48684/0 (socket says 172.21.15.186:48684) 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de8f99640 1 -- 172.21.15.186:0/4058658332 learned_addr learned my addr 172.21.15.186:0/4058658332 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de9f9b640 1 --2- 172.21.15.186:0/4058658332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2de415dbb0 0x7f2de40acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de8f99640 1 -- 172.21.15.186:0/4058658332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2de40cbf00 msgr2=0x7f2de40b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de8f99640 1 --2- 172.21.15.186:0/4058658332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2de40cbf00 0x7f2de40b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de8f99640 1 -- 172.21.15.186:0/4058658332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2de415dbb0 msgr2=0x7f2de40acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de8f99640 1 --2- 172.21.15.186:0/4058658332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2de415dbb0 0x7f2de40acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de8f99640 1 -- 172.21.15.186:0/4058658332 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40b1290 con 0x7f2de40cc390 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.853+0000 7f2de979a640 1 --2- 172.21.15.186:0/4058658332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2de40cbf00 0x7f2de40b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.854+0000 7f2de8f99640 1 --2- 172.21.15.186:0/4058658332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2de40cc390 0x7f2de414f830 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4035040 tx=0x7f2dd40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:05.850 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.854+0000 7f2dd9ffb640 1 -- 172.21.15.186:0/4058658332 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4041030 con 0x7f2de40cc390 2024-04-25T08:42:05.851 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.854+0000 7f2dd9ffb640 1 -- 172.21.15.186:0/4058658332 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd403d4e0 con 0x7f2de40cc390 2024-04-25T08:42:05.851 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.854+0000 7f2dd9ffb640 1 -- 172.21.15.186:0/4058658332 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4037040 con 0x7f2de40cc390 2024-04-25T08:42:05.851 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.854+0000 7f2deb9fe640 1 -- 172.21.15.186:0/4058658332 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de40c7050 con 0x7f2de40cc390 2024-04-25T08:42:05.851 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.854+0000 7f2deb9fe640 1 -- 172.21.15.186:0/4058658332 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de415ffa0 con 0x7f2de40cc390 2024-04-25T08:42:05.851 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.854+0000 7f2dd9ffb640 1 -- 172.21.15.186:0/4058658332 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2dd4044070 con 0x7f2de40cc390 2024-04-25T08:42:05.851 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.854+0000 7f2dd9ffb640 1 -- 172.21.15.186:0/4058658332 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f2dd4046ba0 con 0x7f2de40cc390 2024-04-25T08:42:05.851 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.855+0000 7f2deb9fe640 1 -- 172.21.15.186:0/4058658332 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de4073a00 con 0x7f2de40cc390 2024-04-25T08:42:05.852 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.859+0000 7f2dd9ffb640 1 -- 172.21.15.186:0/4058658332 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2dd4046690 con 0x7f2de40cc390 2024-04-25T08:42:05.887 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:05.894+0000 7fc8cde0e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T08:42:05.915 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:05.922+0000 7ff6d4f67040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T08:42:05.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.932+0000 7f2deb9fe640 1 -- 172.21.15.186:0/4058658332 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7552fd6b-df45-46e9-bfd3-60dc645cc1f7", "id": 4} v 0) v1 -- 0x7f2de4061b50 con 0x7f2de40cc390 2024-04-25T08:42:05.928 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.935+0000 7f2dd9ffb640 1 -- 172.21.15.186:0/4058658332 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7552fd6b-df45-46e9-bfd3-60dc645cc1f7", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2dd4046870 con 0x7f2de40cc390 2024-04-25T08:42:05.929 INFO:teuthology.orchestra.run.smithi186.stdout:4 2024-04-25T08:42:05.930 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.936+0000 7f2deb9fe640 1 -- 172.21.15.186:0/4058658332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2de40cc390 msgr2=0x7f2de414f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:05.930 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.936+0000 7f2deb9fe640 1 --2- 172.21.15.186:0/4058658332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2de40cc390 0x7f2de414f830 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4035040 tx=0x7f2dd40046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.930 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.936+0000 7f2deb9fe640 1 -- 172.21.15.186:0/4058658332 shutdown_connections 2024-04-25T08:42:05.930 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.936+0000 7f2deb9fe640 1 --2- 172.21.15.186:0/4058658332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2de40cc390 0x7f2de414f830 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.930 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.936+0000 7f2deb9fe640 1 --2- 172.21.15.186:0/4058658332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2de415dbb0 0x7f2de40acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.930 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.936+0000 7f2deb9fe640 1 --2- 172.21.15.186:0/4058658332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2de40cbf00 0x7f2de40b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:05.930 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.936+0000 7f2deb9fe640 1 -- 172.21.15.186:0/4058658332 >> 172.21.15.186:0/4058658332 conn(0x7f2de4071af0 msgr2=0x7f2de40c4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:05.930 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.936+0000 7f2deb9fe640 1 -- 172.21.15.186:0/4058658332 shutdown_connections 2024-04-25T08:42:05.930 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:05.936+0000 7f2deb9fe640 1 -- 172.21.15.186:0/4058658332 wait complete. 2024-04-25T08:42:05.940 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new ddbad192-fed4-4c7e-9558-5365e737dc40 5 2024-04-25T08:42:05.962 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:05.969+0000 7ff6d4f67040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T08:42:06.037 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.043+0000 7fc4566ea640 1 Processor -- start 2024-04-25T08:42:06.037 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.043+0000 7fc4566ea640 1 -- start start 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.044+0000 7fc4566ea640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc4500c6010 0x7fc4500ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.044+0000 7fc4566ea640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc4500cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.044+0000 7fc4566ea640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4500c6940 con 0x7fc45015a9f0 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.044+0000 7fc4566ea640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4500b0020 con 0x7fc4500c6010 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.044+0000 7fc4566ea640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500cb5a0 con 0x7fc4500cd520 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.044+0000 7fc44ffff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fc45015a9f0 0x7fc4500cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:55908/0 (socket says 172.21.15.186:55908) 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.044+0000 7fc44ffff640 1 -- 172.21.15.186:0/2489492888 learned_addr learned my addr 172.21.15.186:0/2489492888 (peer_addr_for_me v1:172.21.15.186:0/0) 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.044+0000 7fc454c87640 1 --2- 172.21.15.186:0/2489492888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc4500cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.044+0000 7fc44f7fe640 1 --2- 172.21.15.186:0/2489492888 >> v2:172.21.15.172:3300/0 conn(0x7fc4500c6010 0x7fc4500ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.045+0000 7fc44effd640 1 -- 172.21.15.186:0/2489492888 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545331805 0 0) 0x7fc444001110 con 0x7fc45015a9f0 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.045+0000 7fc44effd640 1 -- 172.21.15.186:0/2489492888 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc438003520 con 0x7fc45015a9f0 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.045+0000 7fc454c87640 1 -- 172.21.15.186:0/2489492888 >> v2:172.21.15.172:3300/0 conn(0x7fc4500c6010 msgr2=0x7fc4500ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:06.039 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.045+0000 7fc454c87640 1 --2- 172.21.15.186:0/2489492888 >> v2:172.21.15.172:3300/0 conn(0x7fc4500c6010 0x7fc4500ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.040 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.045+0000 7fc454c87640 1 -- 172.21.15.186:0/2489492888 >> v1:172.21.15.186:6789/0 conn(0x7fc45015a9f0 legacy=0x7fc4500cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.040 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.045+0000 7fc454c87640 1 -- 172.21.15.186:0/2489492888 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45015add0 con 0x7fc4500cd520 2024-04-25T08:42:06.040 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.045+0000 7fc454c87640 1 --2- 172.21.15.186:0/2489492888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc4500cba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc448009d90 tx=0x7fc44802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16fc1e2fa853a31b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:06.040 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.045+0000 7fc44effd640 1 -- 172.21.15.186:0/2489492888 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448007740 con 0x7fc4500cd520 2024-04-25T08:42:06.040 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.045+0000 7fc44effd640 1 -- 172.21.15.186:0/2489492888 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4480078e0 con 0x7fc4500cd520 2024-04-25T08:42:06.040 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.046+0000 7fc44effd640 1 -- 172.21.15.186:0/2489492888 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448007cb0 con 0x7fc4500cd520 2024-04-25T08:42:06.041 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.046+0000 7fc4566ea640 1 -- 172.21.15.186:0/2489492888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 msgr2=0x7fc4500cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.041 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.046+0000 7fc4566ea640 1 --2- 172.21.15.186:0/2489492888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc4500cba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc448009d90 tx=0x7fc44802a660 comp rx=0 tx=0).stop 2024-04-25T08:42:06.041 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.046+0000 7fc4566ea640 1 -- 172.21.15.186:0/2489492888 shutdown_connections 2024-04-25T08:42:06.041 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.046+0000 7fc4566ea640 1 --2- 172.21.15.186:0/2489492888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc4500cba30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.041 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.046+0000 7fc4566ea640 1 --2- 172.21.15.186:0/2489492888 >> v2:172.21.15.172:3300/0 conn(0x7fc4500c6010 0x7fc4500ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.041 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.046+0000 7fc4566ea640 1 -- 172.21.15.186:0/2489492888 >> 172.21.15.186:0/2489492888 conn(0x7fc4500b2390 msgr2=0x7fc4500b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:06.041 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.046+0000 7fc4566ea640 1 -- 172.21.15.186:0/2489492888 shutdown_connections 2024-04-25T08:42:06.041 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.046+0000 7fc4566ea640 1 -- 172.21.15.186:0/2489492888 wait complete. 2024-04-25T08:42:06.042 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.048+0000 7fc4566ea640 1 Processor -- start 2024-04-25T08:42:06.042 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.048+0000 7fc4566ea640 1 -- start start 2024-04-25T08:42:06.044 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.049+0000 7fc4566ea640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4500c6010 0x7fc45014b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.049+0000 7fc4566ea640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc450159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.049+0000 7fc4566ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc45015a9f0 0x7fc450156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.049+0000 7fc4566ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500cb230 con 0x7fc45015a9f0 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc4566ea640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500caf50 con 0x7fc4500c6010 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc4566ea640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500cbf70 con 0x7fc4500cd520 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44f7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc450159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44ffff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4500c6010 0x7fc45014b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44f7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc450159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:43190/0 (socket says 172.21.15.186:43190) 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44f7fe640 1 -- 172.21.15.186:0/966897025 learned_addr learned my addr 172.21.15.186:0/966897025 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc454c87640 1 --2- 172.21.15.186:0/966897025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc45015a9f0 0x7fc450156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44f7fe640 1 -- 172.21.15.186:0/966897025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4500c6010 msgr2=0x7fc45014b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44f7fe640 1 --2- 172.21.15.186:0/966897025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4500c6010 0x7fc45014b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44f7fe640 1 -- 172.21.15.186:0/966897025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc45015a9f0 msgr2=0x7fc450156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.045 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44f7fe640 1 --2- 172.21.15.186:0/966897025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc45015a9f0 0x7fc450156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.046 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44f7fe640 1 -- 172.21.15.186:0/966897025 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500b3960 con 0x7fc4500cd520 2024-04-25T08:42:06.046 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44f7fe640 1 --2- 172.21.15.186:0/966897025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc450159630 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc44000e9e0 tx=0x7fc44000eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:06.046 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44cff9640 1 -- 172.21.15.186:0/966897025 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440017070 con 0x7fc4500cd520 2024-04-25T08:42:06.046 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44cff9640 1 -- 172.21.15.186:0/966897025 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44000c9d0 con 0x7fc4500cd520 2024-04-25T08:42:06.046 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44cff9640 1 -- 172.21.15.186:0/966897025 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44000cdc0 con 0x7fc4500cd520 2024-04-25T08:42:06.046 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc4566ea640 1 -- 172.21.15.186:0/966897025 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4500b3c40 con 0x7fc4500cd520 2024-04-25T08:42:06.046 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc4566ea640 1 -- 172.21.15.186:0/966897025 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4500b4200 con 0x7fc4500cd520 2024-04-25T08:42:06.046 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44cff9640 1 -- 172.21.15.186:0/966897025 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc44001a070 con 0x7fc4500cd520 2024-04-25T08:42:06.046 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.050+0000 7fc44cff9640 1 -- 172.21.15.186:0/966897025 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc44001cac0 con 0x7fc4500cd520 2024-04-25T08:42:06.046 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.051+0000 7fc4566ea640 1 -- 172.21.15.186:0/966897025 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45006cc80 con 0x7fc4500cd520 2024-04-25T08:42:06.047 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.053+0000 7fc44cff9640 1 -- 172.21.15.186:0/966897025 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc44001c600 con 0x7fc4500cd520 2024-04-25T08:42:06.051 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:06.059+0000 7fc8cde0e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T08:42:06.099 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:06.106+0000 7fc8cde0e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T08:42:06.117 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.124+0000 7fc4566ea640 1 -- 172.21.15.186:0/966897025 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ddbad192-fed4-4c7e-9558-5365e737dc40", "id": 5} v 0) v1 -- 0x7fc450073a00 con 0x7fc4500cd520 2024-04-25T08:42:06.123 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.129+0000 7fc44cff9640 1 -- 172.21.15.186:0/966897025 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ddbad192-fed4-4c7e-9558-5365e737dc40", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc440005990 con 0x7fc4500cd520 2024-04-25T08:42:06.123 INFO:teuthology.orchestra.run.smithi186.stdout:5 2024-04-25T08:42:06.124 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.130+0000 7fc4566ea640 1 -- 172.21.15.186:0/966897025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 msgr2=0x7fc450159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.124 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.130+0000 7fc4566ea640 1 --2- 172.21.15.186:0/966897025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc450159630 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc44000e9e0 tx=0x7fc44000eea0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.124 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.130+0000 7fc4566ea640 1 -- 172.21.15.186:0/966897025 shutdown_connections 2024-04-25T08:42:06.124 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.130+0000 7fc4566ea640 1 --2- 172.21.15.186:0/966897025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc45015a9f0 0x7fc450156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.124 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.130+0000 7fc4566ea640 1 --2- 172.21.15.186:0/966897025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4500cd520 0x7fc450159630 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.125 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.130+0000 7fc4566ea640 1 --2- 172.21.15.186:0/966897025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4500c6010 0x7fc45014b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.125 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.130+0000 7fc4566ea640 1 -- 172.21.15.186:0/966897025 >> 172.21.15.186:0/966897025 conn(0x7fc4500b2390 msgr2=0x7fc45006f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:06.125 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.131+0000 7fc4566ea640 1 -- 172.21.15.186:0/966897025 shutdown_connections 2024-04-25T08:42:06.125 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.131+0000 7fc4566ea640 1 -- 172.21.15.186:0/966897025 wait complete. 2024-04-25T08:42:06.134 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new b8431046-4c0e-4b35-a561-bf1b2552de8a 6 2024-04-25T08:42:06.135 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:06.142+0000 7ff6d4f67040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T08:42:06.151 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:06.159+0000 7fc8cde0e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T08:42:06.197 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:06.204+0000 7ff6d4f67040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T08:42:06.233 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.239+0000 7f05a2a38640 1 Processor -- start 2024-04-25T08:42:06.233 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.240+0000 7f05a2a38640 1 -- start start 2024-04-25T08:42:06.235 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.240+0000 7f05a2a38640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f059c0cadb0 0x7f059c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.235 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.240+0000 7f05a2a38640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f059c0ccfe0 0x7f059c0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.235 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.240+0000 7f05a2a38640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c0afc80 con 0x7f059c15de80 2024-04-25T08:42:06.235 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.240+0000 7f05a2a38640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0cb240 con 0x7f059c0ccfe0 2024-04-25T08:42:06.235 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.240+0000 7f05a2a38640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0ce4d0 con 0x7f059c0cadb0 2024-04-25T08:42:06.235 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.240+0000 7f059b7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f059c0cadb0 0x7f059c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.235 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.241+0000 7f059bfff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f059c15de80 0x7f059c0cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:55910/0 (socket says 172.21.15.186:55910) 2024-04-25T08:42:06.235 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.241+0000 7f059bfff640 1 -- 172.21.15.186:0/1349176473 learned_addr learned my addr 172.21.15.186:0/1349176473 (peer_addr_for_me v1:172.21.15.186:0/0) 2024-04-25T08:42:06.235 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.241+0000 7f05a0fd5640 1 --2- 172.21.15.186:0/1349176473 >> v2:172.21.15.172:3300/0 conn(0x7f059c0ccfe0 0x7f059c0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.236 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.241+0000 7f059b7fe640 1 -- 172.21.15.186:0/1349176473 >> v2:172.21.15.172:3300/0 conn(0x7f059c0ccfe0 msgr2=0x7f059c0cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:06.236 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.241+0000 7f059b7fe640 1 --2- 172.21.15.186:0/1349176473 >> v2:172.21.15.172:3300/0 conn(0x7f059c0ccfe0 0x7f059c0cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.236 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.241+0000 7f059b7fe640 1 -- 172.21.15.186:0/1349176473 >> v1:172.21.15.186:6789/0 conn(0x7f059c15de80 legacy=0x7f059c0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.236 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.241+0000 7f059affd640 1 -- 172.21.15.186:0/1349176473 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669366161 0 0) 0x7f059c0afc80 con 0x7f059c15de80 2024-04-25T08:42:06.236 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.241+0000 7f059b7fe640 1 -- 172.21.15.186:0/1349176473 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0ce7b0 con 0x7f059c0cadb0 2024-04-25T08:42:06.236 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.241+0000 7f05a0fd5640 1 --2- 172.21.15.186:0/1349176473 >> v2:172.21.15.172:3300/0 conn(0x7f059c0ccfe0 0x7f059c0cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:06.236 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.241+0000 7f059b7fe640 1 --2- 172.21.15.186:0/1349176473 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 0x7f059c0cf6c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f059c062500 tx=0x7f058c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e896f331fa18a32b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:06.236 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f059affd640 1 -- 172.21.15.186:0/1349176473 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c037070 con 0x7f059c0cadb0 2024-04-25T08:42:06.236 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f059affd640 1 -- 172.21.15.186:0/1349176473 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c032440 con 0x7f059c0cadb0 2024-04-25T08:42:06.236 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f059affd640 1 -- 172.21.15.186:0/1349176473 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c032810 con 0x7f059c0cadb0 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f05a2a38640 1 -- 172.21.15.186:0/1349176473 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 msgr2=0x7f059c0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f05a2a38640 1 --2- 172.21.15.186:0/1349176473 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 0x7f059c0cf6c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f059c062500 tx=0x7f058c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f05a2a38640 1 -- 172.21.15.186:0/1349176473 shutdown_connections 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f05a2a38640 1 --2- 172.21.15.186:0/1349176473 >> v2:172.21.15.172:3300/0 conn(0x7f059c0ccfe0 0x7f059c0cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f05a2a38640 1 --2- 172.21.15.186:0/1349176473 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 0x7f059c0cf6c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f05a2a38640 1 -- 172.21.15.186:0/1349176473 >> 172.21.15.186:0/1349176473 conn(0x7f059c0b2390 msgr2=0x7f059c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f05a2a38640 1 -- 172.21.15.186:0/1349176473 shutdown_connections 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.242+0000 7f05a2a38640 1 -- 172.21.15.186:0/1349176473 wait complete. 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.243+0000 7f05a2a38640 1 Processor -- start 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f05a2a38640 1 -- start start 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f05a2a38640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 0x7f059c0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f05a2a38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0ccfe0 0x7f059c156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f05a2a38640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15de80 0x7f059c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.240 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f05a2a38640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c15e260 con 0x7f059c0ccfe0 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f05a2a38640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0cfc00 con 0x7f059c0cadb0 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f05a2a38640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b2eb0 con 0x7f059c15de80 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f059bfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 0x7f059c0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f059bfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 0x7f059c0b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:48710/0 (socket says 172.21.15.186:48710) 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f059bfff640 1 -- 172.21.15.186:0/145841859 learned_addr learned my addr 172.21.15.186:0/145841859 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.244+0000 7f05a0fd5640 1 --2- 172.21.15.186:0/145841859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15de80 0x7f059c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f059b7fe640 1 --2- 172.21.15.186:0/145841859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0ccfe0 0x7f059c156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f059bfff640 1 -- 172.21.15.186:0/145841859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15de80 msgr2=0x7f059c14c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f059bfff640 1 --2- 172.21.15.186:0/145841859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15de80 0x7f059c14c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f059bfff640 1 -- 172.21.15.186:0/145841859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0ccfe0 msgr2=0x7f059c156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f059bfff640 1 --2- 172.21.15.186:0/145841859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0ccfe0 0x7f059c156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.241 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f059bfff640 1 -- 172.21.15.186:0/145841859 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c159130 con 0x7f059c0cadb0 2024-04-25T08:42:06.242 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f059bfff640 1 --2- 172.21.15.186:0/145841859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 0x7f059c0b1450 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f059000c430 tx=0x7f059000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:06.242 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f0598ff9640 1 -- 172.21.15.186:0/145841859 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05900074e0 con 0x7f059c0cadb0 2024-04-25T08:42:06.242 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f0598ff9640 1 -- 172.21.15.186:0/145841859 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05900047e0 con 0x7f059c0cadb0 2024-04-25T08:42:06.242 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f05a2a38640 1 -- 172.21.15.186:0/145841859 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c159410 con 0x7f059c0cadb0 2024-04-25T08:42:06.242 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f0598ff9640 1 -- 172.21.15.186:0/145841859 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590004bd0 con 0x7f059c0cadb0 2024-04-25T08:42:06.242 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f05a2a38640 1 -- 172.21.15.186:0/145841859 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c1599d0 con 0x7f059c0cadb0 2024-04-25T08:42:06.242 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f0598ff9640 1 -- 172.21.15.186:0/145841859 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0590011070 con 0x7f059c0cadb0 2024-04-25T08:42:06.242 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.245+0000 7f0598ff9640 1 -- 172.21.15.186:0/145841859 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f05900139b0 con 0x7f059c0cadb0 2024-04-25T08:42:06.242 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.246+0000 7f05a2a38640 1 -- 172.21.15.186:0/145841859 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c073a00 con 0x7f059c0cadb0 2024-04-25T08:42:06.243 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.248+0000 7f0598ff9640 1 -- 172.21.15.186:0/145841859 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0590004d70 con 0x7f059c0cadb0 2024-04-25T08:42:06.254 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:06.261+0000 7ff6d4f67040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T08:42:06.263 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:06.271+0000 7fc8cde0e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:42:06.314 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.320+0000 7f05a2a38640 1 -- 172.21.15.186:0/145841859 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b8431046-4c0e-4b35-a561-bf1b2552de8a", "id": 6} v 0) v1 -- 0x7f059c15bad0 con 0x7f059c0cadb0 2024-04-25T08:42:06.318 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.325+0000 7f0598ff9640 1 -- 172.21.15.186:0/145841859 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8431046-4c0e-4b35-a561-bf1b2552de8a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0590013c40 con 0x7f059c0cadb0 2024-04-25T08:42:06.319 INFO:teuthology.orchestra.run.smithi186.stdout:6 2024-04-25T08:42:06.320 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.326+0000 7f05a2a38640 1 -- 172.21.15.186:0/145841859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 msgr2=0x7f059c0b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.320 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.326+0000 7f05a2a38640 1 --2- 172.21.15.186:0/145841859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 0x7f059c0b1450 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f059000c430 tx=0x7f059000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.320 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.326+0000 7f05a2a38640 1 -- 172.21.15.186:0/145841859 shutdown_connections 2024-04-25T08:42:06.320 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.326+0000 7f05a2a38640 1 --2- 172.21.15.186:0/145841859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15de80 0x7f059c14c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.320 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.326+0000 7f05a2a38640 1 --2- 172.21.15.186:0/145841859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0ccfe0 0x7f059c156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.320 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.326+0000 7f05a2a38640 1 --2- 172.21.15.186:0/145841859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f059c0cadb0 0x7f059c0b1450 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.320 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.326+0000 7f05a2a38640 1 -- 172.21.15.186:0/145841859 >> 172.21.15.186:0/145841859 conn(0x7f059c0b2390 msgr2=0x7f059c0cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:06.320 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.326+0000 7f05a2a38640 1 -- 172.21.15.186:0/145841859 shutdown_connections 2024-04-25T08:42:06.320 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.327+0000 7f05a2a38640 1 -- 172.21.15.186:0/145841859 wait complete. 2024-04-25T08:42:06.330 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c 7 2024-04-25T08:42:06.372 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:06.379+0000 7ff6d4f67040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T08:42:06.427 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.434+0000 7fa771722640 1 Processor -- start 2024-04-25T08:42:06.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.434+0000 7fa771722640 1 -- start start 2024-04-25T08:42:06.430 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa771722640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c0cadb0 0x7fa76c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.430 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa771722640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa76c0ccfe0 0x7fa76c0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.430 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa771722640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0afc80 con 0x7fa76c15de80 2024-04-25T08:42:06.430 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa771722640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c0cb210 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.430 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa771722640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0ce4d0 con 0x7fa76c0cadb0 2024-04-25T08:42:06.430 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa76a7fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c0cadb0 0x7fa76c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.430 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa76affd640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fa76c15de80 0x7fa76c0cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:55924/0 (socket says 172.21.15.186:55924) 2024-04-25T08:42:06.430 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa76affd640 1 -- 172.21.15.186:0/4155249978 learned_addr learned my addr 172.21.15.186:0/4155249978 (peer_addr_for_me v1:172.21.15.186:0/0) 2024-04-25T08:42:06.430 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa76b7fe640 1 --2- 172.21.15.186:0/4155249978 >> v2:172.21.15.172:3300/0 conn(0x7fa76c0ccfe0 0x7fa76c0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.430 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa769ffb640 1 -- 172.21.15.186:0/4155249978 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209090148 0 0) 0x7fa76c0afc80 con 0x7fa76c15de80 2024-04-25T08:42:06.431 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa769ffb640 1 -- 172.21.15.186:0/4155249978 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa754003520 con 0x7fa76c15de80 2024-04-25T08:42:06.431 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa76a7fc640 1 -- 172.21.15.186:0/4155249978 >> v2:172.21.15.172:3300/0 conn(0x7fa76c0ccfe0 msgr2=0x7fa76c0cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:06.431 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa76a7fc640 1 --2- 172.21.15.186:0/4155249978 >> v2:172.21.15.172:3300/0 conn(0x7fa76c0ccfe0 0x7fa76c0cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.431 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa76a7fc640 1 -- 172.21.15.186:0/4155249978 >> v1:172.21.15.186:6789/0 conn(0x7fa76c15de80 legacy=0x7fa76c0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.431 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.435+0000 7fa76a7fc640 1 -- 172.21.15.186:0/4155249978 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0ce7b0 con 0x7fa76c0cadb0 2024-04-25T08:42:06.431 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.436+0000 7fa76a7fc640 1 --2- 172.21.15.186:0/4155249978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c0cadb0 0x7fa76c0cf6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa7600097a0 tx=0x7fa76002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=286d122bffd4717c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:06.431 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.436+0000 7fa769ffb640 1 -- 172.21.15.186:0/4155249978 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760037070 con 0x7fa76c0cadb0 2024-04-25T08:42:06.431 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.436+0000 7fa769ffb640 1 -- 172.21.15.186:0/4155249978 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa760032440 con 0x7fa76c0cadb0 2024-04-25T08:42:06.431 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.436+0000 7fa769ffb640 1 -- 172.21.15.186:0/4155249978 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760032810 con 0x7fa76c0cadb0 2024-04-25T08:42:06.434 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.437+0000 7fa771722640 1 -- 172.21.15.186:0/4155249978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c0cadb0 msgr2=0x7fa76c0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.434 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.437+0000 7fa771722640 1 --2- 172.21.15.186:0/4155249978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c0cadb0 0x7fa76c0cf6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa7600097a0 tx=0x7fa76002a180 comp rx=0 tx=0).stop 2024-04-25T08:42:06.434 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.437+0000 7fa771722640 1 -- 172.21.15.186:0/4155249978 shutdown_connections 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.437+0000 7fa771722640 1 --2- 172.21.15.186:0/4155249978 >> v2:172.21.15.172:3300/0 conn(0x7fa76c0ccfe0 0x7fa76c0cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.437+0000 7fa771722640 1 --2- 172.21.15.186:0/4155249978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c0cadb0 0x7fa76c0cf6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.437+0000 7fa771722640 1 -- 172.21.15.186:0/4155249978 >> 172.21.15.186:0/4155249978 conn(0x7fa76c0b2390 msgr2=0x7fa76c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.437+0000 7fa771722640 1 -- 172.21.15.186:0/4155249978 shutdown_connections 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.437+0000 7fa771722640 1 -- 172.21.15.186:0/4155249978 wait complete. 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.438+0000 7fa771722640 1 Processor -- start 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.438+0000 7fa771722640 1 -- start start 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa771722640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa76c0cadb0 0x7fa76c0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa771722640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa76c0ccfe0 0x7fa76c1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa771722640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c15de80 0x7fa76c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa771722640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c15e260 con 0x7fa76c0cadb0 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa771722640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0cfc00 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa771722640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0b2eb0 con 0x7fa76c15de80 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76a7fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa76c0ccfe0 0x7fa76c1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c15de80 0x7fa76c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.435 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76a7fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa76c0ccfe0 0x7fa76c1522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:60058/0 (socket says 172.21.15.186:60058) 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76a7fc640 1 -- 172.21.15.186:0/2348305368 learned_addr learned my addr 172.21.15.186:0/2348305368 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76affd640 1 --2- 172.21.15.186:0/2348305368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa76c0cadb0 0x7fa76c0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76a7fc640 1 -- 172.21.15.186:0/2348305368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c15de80 msgr2=0x7fa76c152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76a7fc640 1 --2- 172.21.15.186:0/2348305368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c15de80 0x7fa76c152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76a7fc640 1 -- 172.21.15.186:0/2348305368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa76c0cadb0 msgr2=0x7fa76c0aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76a7fc640 1 --2- 172.21.15.186:0/2348305368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa76c0cadb0 0x7fa76c0aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76a7fc640 1 -- 172.21.15.186:0/2348305368 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0c88d0 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.439+0000 7fa76b7fe640 1 --2- 172.21.15.186:0/2348305368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c15de80 0x7fa76c152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.440+0000 7fa76a7fc640 1 --2- 172.21.15.186:0/2348305368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa76c0ccfe0 0x7fa76c1522c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa760035040 tx=0x7fa7600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.440+0000 7fa7537fe640 1 -- 172.21.15.186:0/2348305368 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760041030 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.440+0000 7fa7537fe640 1 -- 172.21.15.186:0/2348305368 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76003d4e0 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.440+0000 7fa771722640 1 -- 172.21.15.186:0/2348305368 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c0c7830 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.440+0000 7fa7537fe640 1 -- 172.21.15.186:0/2348305368 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760037040 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.440+0000 7fa771722640 1 -- 172.21.15.186:0/2348305368 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c0c7df0 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.437 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.440+0000 7fa7537fe640 1 -- 172.21.15.186:0/2348305368 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa760044070 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.437 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.440+0000 7fa7537fe640 1 -- 172.21.15.186:0/2348305368 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa760046d40 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.437 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.441+0000 7fa771722640 1 -- 172.21.15.186:0/2348305368 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c073a00 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.437 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.443+0000 7fa7537fe640 1 -- 172.21.15.186:0/2348305368 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa7600466e0 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.525 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.532+0000 7fa771722640 1 -- 172.21.15.186:0/2348305368 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c", "id": 7} v 0) v1 -- 0x7fa76c15c9c0 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.536 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.543+0000 7fa7537fe640 1 -- 172.21.15.186:0/2348305368 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa7600468c0 con 0x7fa76c0ccfe0 2024-04-25T08:42:06.536 INFO:teuthology.orchestra.run.smithi186.stdout:7 2024-04-25T08:42:06.537 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.544+0000 7fa771722640 1 -- 172.21.15.186:0/2348305368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa76c0ccfe0 msgr2=0x7fa76c1522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.537 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.544+0000 7fa771722640 1 --2- 172.21.15.186:0/2348305368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa76c0ccfe0 0x7fa76c1522c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa760035040 tx=0x7fa7600046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.537 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.544+0000 7fa771722640 1 -- 172.21.15.186:0/2348305368 shutdown_connections 2024-04-25T08:42:06.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.544+0000 7fa771722640 1 --2- 172.21.15.186:0/2348305368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa76c0ccfe0 0x7fa76c1522c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.544+0000 7fa771722640 1 --2- 172.21.15.186:0/2348305368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa76c15de80 0x7fa76c152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.544+0000 7fa771722640 1 --2- 172.21.15.186:0/2348305368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa76c0cadb0 0x7fa76c0aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.544+0000 7fa771722640 1 -- 172.21.15.186:0/2348305368 >> 172.21.15.186:0/2348305368 conn(0x7fa76c0b2390 msgr2=0x7fa76c0cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:06.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.544+0000 7fa771722640 1 -- 172.21.15.186:0/2348305368 shutdown_connections 2024-04-25T08:42:06.538 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T08:42:06.544+0000 7fa771722640 1 -- 172.21.15.186:0/2348305368 wait complete. 2024-04-25T08:42:06.548 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T08:42:06.548 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T08:42:06.551 INFO:tasks.ceph.osd.0:Started 2024-04-25T08:42:06.551 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T08:42:06.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T08:42:06.553 INFO:tasks.ceph.osd.1:Started 2024-04-25T08:42:06.553 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T08:42:06.554 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T08:42:06.555 INFO:tasks.ceph.osd.2:Started 2024-04-25T08:42:06.556 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T08:42:06.556 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T08:42:06.558 INFO:tasks.ceph.osd.3:Started 2024-04-25T08:42:06.558 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T08:42:06.558 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T08:42:06.590 INFO:tasks.ceph.osd.4:Started 2024-04-25T08:42:06.590 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T08:42:06.591 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T08:42:06.592 INFO:tasks.ceph.osd.5:Started 2024-04-25T08:42:06.593 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T08:42:06.593 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T08:42:06.595 INFO:tasks.ceph.osd.6:Started 2024-04-25T08:42:06.595 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T08:42:06.595 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T08:42:06.597 INFO:tasks.ceph.osd.7:Started 2024-04-25T08:42:06.598 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:06.669 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:06.677+0000 7fc8cde0e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T08:42:06.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.720+0000 7f61caf5c640 1 Processor -- start 2024-04-25T08:42:06.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.720+0000 7f61caf5c640 1 -- start start 2024-04-25T08:42:06.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61caf5c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f61c40d0400 0x7f61c40d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61caf5c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61c406ff10 0x7f61c40729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61caf5c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c40b3780 con 0x7f61c415aa20 2024-04-25T08:42:06.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61caf5c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c40d0d20 con 0x7f61c406ff10 2024-04-25T08:42:06.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61c94f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61c406ff10 0x7f61c40729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61caf5c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c40cf480 con 0x7f61c40d0400 2024-04-25T08:42:06.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61c94f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61c406ff10 0x7f61c40729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48106/0 (socket says 172.21.15.172:48106) 2024-04-25T08:42:06.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61c94f9640 1 -- 172.21.15.172:0/1988450631 learned_addr learned my addr 172.21.15.172:0/1988450631 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:06.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61c8cf8640 1 --2- 172.21.15.172:0/1988450631 >> v2:172.21.15.186:3300/0 conn(0x7f61c40d0400 0x7f61c40d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61c94f9640 1 -- 172.21.15.172:0/1988450631 >> v2:172.21.15.186:3300/0 conn(0x7f61c40d0400 msgr2=0x7f61c40d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:06.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61c94f9640 1 --2- 172.21.15.172:0/1988450631 >> v2:172.21.15.186:3300/0 conn(0x7f61c40d0400 0x7f61c40d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61c94f9640 1 -- 172.21.15.172:0/1988450631 >> v1:172.21.15.186:6789/0 conn(0x7f61c415aa20 legacy=0x7f61c40722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.721+0000 7f61c94f9640 1 -- 172.21.15.172:0/1988450631 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c40cf760 con 0x7f61c406ff10 2024-04-25T08:42:06.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.722+0000 7f61c94f9640 1 --2- 172.21.15.172:0/1988450631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c406ff10 0x7f61c40729f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f61c40d1540 tx=0x7f61bc02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e959d8f472754 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:06.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.722+0000 7f61c37fe640 1 -- 172.21.15.172:0/1988450631 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc00b2d0 con 0x7f61c406ff10 2024-04-25T08:42:06.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.722+0000 7f61c37fe640 1 -- 172.21.15.172:0/1988450631 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc00b470 con 0x7f61c406ff10 2024-04-25T08:42:06.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.722+0000 7f61c37fe640 1 -- 172.21.15.172:0/1988450631 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc009820 con 0x7f61c406ff10 2024-04-25T08:42:06.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.723+0000 7f61caf5c640 1 -- 172.21.15.172:0/1988450631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c406ff10 msgr2=0x7f61c40729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.723+0000 7f61caf5c640 1 --2- 172.21.15.172:0/1988450631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c406ff10 0x7f61c40729f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f61c40d1540 tx=0x7f61bc02c8b0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.723+0000 7f61caf5c640 1 -- 172.21.15.172:0/1988450631 shutdown_connections 2024-04-25T08:42:06.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.723+0000 7f61caf5c640 1 --2- 172.21.15.172:0/1988450631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c406ff10 0x7f61c40729f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.723+0000 7f61caf5c640 1 --2- 172.21.15.172:0/1988450631 >> v2:172.21.15.186:3300/0 conn(0x7f61c40d0400 0x7f61c40d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.723+0000 7f61caf5c640 1 -- 172.21.15.172:0/1988450631 >> 172.21.15.172:0/1988450631 conn(0x7f61c40b23e0 msgr2=0x7f61c40b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:06.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.723+0000 7f61caf5c640 1 -- 172.21.15.172:0/1988450631 shutdown_connections 2024-04-25T08:42:06.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.723+0000 7f61caf5c640 1 -- 172.21.15.172:0/1988450631 wait complete. 2024-04-25T08:42:06.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.724+0000 7f61caf5c640 1 Processor -- start 2024-04-25T08:42:06.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.725+0000 7f61caf5c640 1 -- start start 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.725+0000 7f61caf5c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61c406ff10 0x7f61c40b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.725+0000 7f61caf5c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c40d0400 0x7f61c41f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61caf5c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61c415aa20 0x7f61c4148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61caf5c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40cf150 con 0x7f61c40d0400 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61caf5c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40cfa40 con 0x7f61c415aa20 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61caf5c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c4072f30 con 0x7f61c406ff10 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c8cf8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61c406ff10 0x7f61c40b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c40d0400 0x7f61c41f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c8cf8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61c406ff10 0x7f61c40b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:60892/0 (socket says 172.21.15.172:60892) 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c8cf8640 1 -- 172.21.15.172:0/417602856 learned_addr learned my addr 172.21.15.172:0/417602856 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c94f9640 1 --2- 172.21.15.172:0/417602856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61c415aa20 0x7f61c4148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c8cf8640 1 -- 172.21.15.172:0/417602856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61c415aa20 msgr2=0x7f61c4148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c8cf8640 1 --2- 172.21.15.172:0/417602856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61c415aa20 0x7f61c4148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c8cf8640 1 -- 172.21.15.172:0/417602856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c40d0400 msgr2=0x7f61c41f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c8cf8640 1 --2- 172.21.15.172:0/417602856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c40d0400 0x7f61c41f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c8cf8640 1 -- 172.21.15.172:0/417602856 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c415b010 con 0x7f61c406ff10 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c8cf8640 1 --2- 172.21.15.172:0/417602856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61c406ff10 0x7f61c40b1510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f61b800e9b0 tx=0x7f61b800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c17fa640 1 -- 172.21.15.172:0/417602856 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8017070 con 0x7f61c406ff10 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c17fa640 1 -- 172.21.15.172:0/417602856 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b800c9a0 con 0x7f61c406ff10 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61caf5c640 1 -- 172.21.15.172:0/417602856 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c415b2f0 con 0x7f61c406ff10 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c17fa640 1 -- 172.21.15.172:0/417602856 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800cd90 con 0x7f61c406ff10 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61caf5c640 1 -- 172.21.15.172:0/417602856 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c415b8b0 con 0x7f61c406ff10 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.726+0000 7f61c17fa640 1 -- 172.21.15.172:0/417602856 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f61b801a070 con 0x7f61c406ff10 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.727+0000 7f61c17fa640 1 -- 172.21.15.172:0/417602856 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f61b8006660 con 0x7f61c406ff10 2024-04-25T08:42:06.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.727+0000 7f61caf5c640 1 -- 172.21.15.172:0/417602856 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c4073990 con 0x7f61c406ff10 2024-04-25T08:42:06.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.729+0000 7f61c17fa640 1 -- 172.21.15.172:0/417602856 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f61b8005990 con 0x7f61c406ff10 2024-04-25T08:42:06.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.791+0000 7f61caf5c640 1 -- 172.21.15.172:0/417602856 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61c406d330 con 0x7f61c406ff10 2024-04-25T08:42:06.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.791+0000 7f61c17fa640 1 -- 172.21.15.172:0/417602856 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f61b8005b70 con 0x7f61c406ff10 2024-04-25T08:42:06.784 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:06.784 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":10,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:06.535155+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.792+0000 7f61caf5c640 1 -- 172.21.15.172:0/417602856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61c406ff10 msgr2=0x7f61c40b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.792+0000 7f61caf5c640 1 --2- 172.21.15.172:0/417602856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61c406ff10 0x7f61c40b1510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f61b800e9b0 tx=0x7f61b800ee70 comp rx=0 tx=0).stop 2024-04-25T08:42:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.792+0000 7f61caf5c640 1 -- 172.21.15.172:0/417602856 shutdown_connections 2024-04-25T08:42:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.792+0000 7f61caf5c640 1 --2- 172.21.15.172:0/417602856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61c415aa20 0x7f61c4148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.792+0000 7f61caf5c640 1 --2- 172.21.15.172:0/417602856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c40d0400 0x7f61c41f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.792+0000 7f61caf5c640 1 --2- 172.21.15.172:0/417602856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61c406ff10 0x7f61c40b1510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.792+0000 7f61caf5c640 1 -- 172.21.15.172:0/417602856 >> 172.21.15.172:0/417602856 conn(0x7f61c40b23e0 msgr2=0x7f61c40b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.792+0000 7f61caf5c640 1 -- 172.21.15.172:0/417602856 shutdown_connections 2024-04-25T08:42:06.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:06.792+0000 7f61caf5c640 1 -- 172.21.15.172:0/417602856 wait complete. 2024-04-25T08:42:06.795 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T08:42:06.796 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T08:42:06.801 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:06.808+0000 7ff6d4f67040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T08:42:06.934 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:06.942+0000 7fc8cde0e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T08:42:06.988 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:06.995+0000 7fc8cde0e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T08:42:07.057 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:07.064+0000 7ff6d4f67040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T08:42:07.102 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:07.110+0000 7fc8cde0e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T08:42:07.108 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:07.115+0000 7ff6d4f67040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T08:42:07.160 INFO:tasks.ceph.osd.0.smithi172.stderr:2024-04-25T08:42:07.167+0000 7fca09526640 -1 Falling back to public interface 2024-04-25T08:42:07.166 INFO:tasks.ceph.osd.3.smithi172.stderr:2024-04-25T08:42:07.174+0000 7f9e61da7640 -1 Falling back to public interface 2024-04-25T08:42:07.167 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T08:42:07.175+0000 7f73bb83c640 -1 Falling back to public interface 2024-04-25T08:42:07.171 INFO:tasks.ceph.osd.1.smithi172.stderr:2024-04-25T08:42:07.179+0000 7f9146e3a640 -1 Falling back to public interface 2024-04-25T08:42:07.188 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T08:42:07.195+0000 7f5d30a22640 -1 Falling back to public interface 2024-04-25T08:42:07.193 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T08:42:07.200+0000 7f9deb030640 -1 Falling back to public interface 2024-04-25T08:42:07.208 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T08:42:07.215+0000 7f5daa80f640 -1 Falling back to public interface 2024-04-25T08:42:07.212 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T08:42:07.219+0000 7f7ff861a640 -1 Falling back to public interface 2024-04-25T08:42:07.227 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:07.234+0000 7ff6d4f67040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T08:42:07.384 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:07.392+0000 7fc8cde0e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T08:42:07.432 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:07.439+0000 7fc8cde0e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T08:42:07.505 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:07.512+0000 7ff6d4f67040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T08:42:07.552 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:07.559+0000 7ff6d4f67040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T08:42:07.591 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:07.598+0000 7fc8cde0e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T08:42:07.601 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:07.692 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.699+0000 7f9885710640 1 Processor -- start 2024-04-25T08:42:07.692 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.699+0000 7f9885710640 1 -- start start 2024-04-25T08:42:07.694 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.700+0000 7f9885710640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f988015dc50 0x7f98800d2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:07.694 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.700+0000 7f9885710640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98800ce700 0x7f98800b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:07.694 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.700+0000 7f9885710640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98800d4420 con 0x7f98800ce2a0 2024-04-25T08:42:07.694 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.700+0000 7f9885710640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98800d3f90 con 0x7f988015dc50 2024-04-25T08:42:07.694 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.700+0000 7f9885710640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98800d30a0 con 0x7f98800ce700 2024-04-25T08:42:07.694 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.700+0000 7f987e7fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f98800ce2a0 0x7f98800b54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40476/0 (socket says 172.21.15.172:40476) 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.700+0000 7f987e7fc640 1 -- 172.21.15.172:0/2065119642 learned_addr learned my addr 172.21.15.172:0/2065119642 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.700+0000 7f987f7fe640 1 --2- 172.21.15.172:0/2065119642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98800ce700 0x7f98800b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.700+0000 7f987effd640 1 --2- 172.21.15.172:0/2065119642 >> v2:172.21.15.186:3300/0 conn(0x7f988015dc50 0x7f98800d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.701+0000 7f987dffb640 1 -- 172.21.15.172:0/2065119642 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045810264 0 0) 0x7f98800d4420 con 0x7f98800ce2a0 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.701+0000 7f987dffb640 1 -- 172.21.15.172:0/2065119642 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9868003520 con 0x7f98800ce2a0 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.701+0000 7f987effd640 1 -- 172.21.15.172:0/2065119642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98800ce700 msgr2=0x7f98800b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.701+0000 7f987effd640 1 --2- 172.21.15.172:0/2065119642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98800ce700 0x7f98800b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.701+0000 7f987effd640 1 -- 172.21.15.172:0/2065119642 >> v1:172.21.15.172:6789/0 conn(0x7f98800ce2a0 legacy=0x7f98800b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.701+0000 7f987effd640 1 -- 172.21.15.172:0/2065119642 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800d3380 con 0x7f988015dc50 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.701+0000 7f987f7fe640 1 --2- 172.21.15.172:0/2065119642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98800ce700 0x7f98800b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f987effd640 1 --2- 172.21.15.172:0/2065119642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f988015dc50 0x7f98800d2570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f98740097a0 tx=0x7f987402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f926c80a5d97043d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f987dffb640 1 -- 172.21.15.172:0/2065119642 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874037070 con 0x7f988015dc50 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f987dffb640 1 -- 172.21.15.172:0/2065119642 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874032440 con 0x7f988015dc50 2024-04-25T08:42:07.695 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f987dffb640 1 -- 172.21.15.172:0/2065119642 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874032810 con 0x7f988015dc50 2024-04-25T08:42:07.698 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f9885710640 1 -- 172.21.15.172:0/2065119642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f988015dc50 msgr2=0x7f98800d2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:07.698 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f9885710640 1 --2- 172.21.15.172:0/2065119642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f988015dc50 0x7f98800d2570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f98740097a0 tx=0x7f987402a210 comp rx=0 tx=0).stop 2024-04-25T08:42:07.698 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f9885710640 1 -- 172.21.15.172:0/2065119642 shutdown_connections 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f9885710640 1 --2- 172.21.15.172:0/2065119642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98800ce700 0x7f98800b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f9885710640 1 --2- 172.21.15.172:0/2065119642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f988015dc50 0x7f98800d2570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f9885710640 1 -- 172.21.15.172:0/2065119642 >> 172.21.15.172:0/2065119642 conn(0x7f98800726e0 msgr2=0x7f9880072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f9885710640 1 -- 172.21.15.172:0/2065119642 shutdown_connections 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.702+0000 7f9885710640 1 -- 172.21.15.172:0/2065119642 wait complete. 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f9885710640 1 Processor -- start 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f9885710640 1 -- start start 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f9885710640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98800ce2a0 0x7f9880152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f9885710640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98800ce700 0x7f98800c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f9885710640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f988015dc50 0x7f988015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f9885710640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98800d3c20 con 0x7f98800ce700 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f9885710640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98800d3940 con 0x7f98800ce2a0 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f9885710640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98800ceb90 con 0x7f988015dc50 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f987e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98800ce700 0x7f98800c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:07.699 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f987e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98800ce700 0x7f98800c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45328/0 (socket says 172.21.15.172:45328) 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.704+0000 7f987e7fc640 1 -- 172.21.15.172:0/2427991918 learned_addr learned my addr 172.21.15.172:0/2427991918 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f987f7fe640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f988015dc50 0x7f988015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f987effd640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98800ce2a0 0x7f9880152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f987f7fe640 1 -- 172.21.15.172:0/2427991918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98800ce2a0 msgr2=0x7f9880152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f987f7fe640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98800ce2a0 0x7f9880152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f987f7fe640 1 -- 172.21.15.172:0/2427991918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98800ce700 msgr2=0x7f98800c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f987f7fe640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98800ce700 0x7f98800c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f987f7fe640 1 -- 172.21.15.172:0/2427991918 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800c8de0 con 0x7f988015dc50 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f987effd640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98800ce2a0 0x7f9880152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f987e7fc640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98800ce700 0x7f98800c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f987f7fe640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f988015dc50 0x7f988015b910 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f987800efc0 tx=0x7f987800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f98677fe640 1 -- 172.21.15.172:0/2427991918 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878018030 con 0x7f988015dc50 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f98677fe640 1 -- 172.21.15.172:0/2427991918 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987800cd30 con 0x7f988015dc50 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f9885710640 1 -- 172.21.15.172:0/2427991918 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98800c90c0 con 0x7f988015dc50 2024-04-25T08:42:07.700 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f98677fe640 1 -- 172.21.15.172:0/2427991918 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9878003bb0 con 0x7f988015dc50 2024-04-25T08:42:07.701 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f9885710640 1 -- 172.21.15.172:0/2427991918 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98800c9680 con 0x7f988015dc50 2024-04-25T08:42:07.701 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f98677fe640 1 -- 172.21.15.172:0/2427991918 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f987801b070 con 0x7f988015dc50 2024-04-25T08:42:07.701 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.705+0000 7f98677fe640 1 -- 172.21.15.172:0/2427991918 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9878014b50 con 0x7f988015dc50 2024-04-25T08:42:07.701 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.706+0000 7f9885710640 1 -- 172.21.15.172:0/2427991918 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98801f3950 con 0x7f988015dc50 2024-04-25T08:42:07.701 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.708+0000 7f98677fe640 1 -- 172.21.15.172:0/2427991918 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9878010040 con 0x7f988015dc50 2024-04-25T08:42:07.707 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:07.714+0000 7ff6d4f67040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T08:42:07.734 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:07.742+0000 7fc8cde0e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T08:42:07.764 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.771+0000 7f9885710640 1 -- 172.21.15.172:0/2427991918 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f988004ef20 con 0x7f988015dc50 2024-04-25T08:42:07.764 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.772+0000 7f98677fe640 1 -- 172.21.15.172:0/2427991918 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f9878014480 con 0x7f988015dc50 2024-04-25T08:42:07.764 INFO:teuthology.misc.health.smithi172.stdout: 2024-04-25T08:42:07.765 INFO:teuthology.misc.health.smithi172.stdout:{"epoch":10,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:06.535155+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:07.766 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.773+0000 7f9885710640 1 -- 172.21.15.172:0/2427991918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f988015dc50 msgr2=0x7f988015b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:07.766 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.773+0000 7f9885710640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f988015dc50 0x7f988015b910 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f987800efc0 tx=0x7f987800c490 comp rx=0 tx=0).stop 2024-04-25T08:42:07.766 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.773+0000 7f9885710640 1 -- 172.21.15.172:0/2427991918 shutdown_connections 2024-04-25T08:42:07.766 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.773+0000 7f9885710640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f988015dc50 0x7f988015b910 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:07.766 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.773+0000 7f9885710640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98800ce700 0x7f98800c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:07.766 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.773+0000 7f9885710640 1 --2- 172.21.15.172:0/2427991918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98800ce2a0 0x7f9880152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:07.766 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.773+0000 7f9885710640 1 -- 172.21.15.172:0/2427991918 >> 172.21.15.172:0/2427991918 conn(0x7f98800726e0 msgr2=0x7f98800b8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:07.766 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.773+0000 7f9885710640 1 -- 172.21.15.172:0/2427991918 shutdown_connections 2024-04-25T08:42:07.766 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:07.773+0000 7f9885710640 1 -- 172.21.15.172:0/2427991918 wait complete. 2024-04-25T08:42:07.775 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T08:42:07.787 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:07.794+0000 7fc8cde0e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T08:42:07.844 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:07.851+0000 7ff6d4f67040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T08:42:07.858 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:07.865+0000 7fc8cde0e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T08:42:07.894 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:07.900+0000 7ff6d4f67040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T08:42:07.902 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:07.910+0000 7fc8cde0e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T08:42:07.963 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:07.970+0000 7ff6d4f67040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T08:42:08.009 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:08.015+0000 7ff6d4f67040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T08:42:08.378 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:08.386+0000 7fc8cde0e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T08:42:08.482 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:08.489+0000 7ff6d4f67040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T08:42:08.492 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:08.500+0000 7fc8cde0e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T08:42:08.606 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T08:42:08.613+0000 7ff6d4f67040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T08:42:09.509 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:09.516+0000 7fc86e53c640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T08:42:09.510 INFO:tasks.ceph.mgr.y.smithi172.stderr:2024-04-25T08:42:09.518+0000 7fc86e53c640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T08:42:10.642 INFO:tasks.ceph.osd.0.smithi172.stderr:2024-04-25T08:42:10.649+0000 7fca09526640 -1 osd.0 0 log_to_monitors true 2024-04-25T08:42:10.659 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T08:42:10.666+0000 7f9deb030640 -1 osd.4 0 log_to_monitors true 2024-04-25T08:42:10.692 INFO:tasks.ceph.osd.3.smithi172.stderr:2024-04-25T08:42:10.699+0000 7f9e61da7640 -1 osd.3 0 log_to_monitors true 2024-04-25T08:42:10.692 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T08:42:10.700+0000 7f73bb83c640 -1 osd.2 0 log_to_monitors true 2024-04-25T08:42:10.696 INFO:tasks.ceph.osd.1.smithi172.stderr:2024-04-25T08:42:10.704+0000 7f9146e3a640 -1 osd.1 0 log_to_monitors true 2024-04-25T08:42:10.701 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T08:42:10.708+0000 7f5daa80f640 -1 osd.6 0 log_to_monitors true 2024-04-25T08:42:10.701 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T08:42:10.708+0000 7f5d30a22640 -1 osd.5 0 log_to_monitors true 2024-04-25T08:42:10.724 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T08:42:10.731+0000 7f7ff861a640 -1 osd.7 0 log_to_monitors true 2024-04-25T08:42:14.504 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T08:42:14.511+0000 7f7ff3fe7640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T08:42:14.528 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T08:42:14.536+0000 7f7febe07640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:42:14.563 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T08:42:14.569+0000 7f73b77d2640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T08:42:14.570 INFO:tasks.ceph.osd.0.smithi172.stderr:2024-04-25T08:42:14.578+0000 7fca054bc640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T08:42:14.577 INFO:tasks.ceph.osd.2.smithi172.stderr:2024-04-25T08:42:14.585+0000 7f73af5f2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:42:14.582 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:14.585 INFO:tasks.ceph.osd.0.smithi172.stderr:2024-04-25T08:42:14.593+0000 7fc9fd2dc640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:42:14.601 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T08:42:14.609+0000 7f5da6124640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T08:42:14.622 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T08:42:14.630+0000 7f5d9df44640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:42:14.653 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T08:42:14.661+0000 7f5d2c31a640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T08:42:14.654 INFO:tasks.ceph.osd.1.smithi172.stderr:2024-04-25T08:42:14.662+0000 7f9142dd0640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T08:42:14.666 INFO:tasks.ceph.osd.1.smithi172.stderr:2024-04-25T08:42:14.674+0000 7f913abf0640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:42:14.672 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T08:42:14.679+0000 7f9de6578640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T08:42:14.675 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T08:42:14.683+0000 7f5d2413a640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:42:14.688 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T08:42:14.696+0000 7f9dde398640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:42:14.710 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.717+0000 7facd5d89640 1 Processor -- start 2024-04-25T08:42:14.710 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.718+0000 7facd5d89640 1 -- start start 2024-04-25T08:42:14.712 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.718+0000 7facd5d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd0072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:14.712 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.718+0000 7facd5d89640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd0072b70 con 0x7facd006c2b0 2024-04-25T08:42:14.712 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.718+0000 7facd5d89640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd00ca6b0 con 0x7facd006d9b0 2024-04-25T08:42:14.712 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.718+0000 7facd5d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd00ca990 con 0x7facd015d980 2024-04-25T08:42:14.712 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.718+0000 7faccffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7facd006c2b0 0x7facd00cb470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40484/0 (socket says 172.21.15.172:40484) 2024-04-25T08:42:14.712 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.718+0000 7faccffff640 1 -- 172.21.15.172:0/3193612770 learned_addr learned my addr 172.21.15.172:0/3193612770 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:14.712 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.719+0000 7faccf7fe640 1 --2- 172.21.15.172:0/3193612770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd0072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:14.712 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.719+0000 7facce7fc640 1 -- 172.21.15.172:0/3193612770 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635483249 0 0) 0x7facc8001490 con 0x7facd006c2b0 2024-04-25T08:42:14.712 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.719+0000 7facce7fc640 1 -- 172.21.15.172:0/3193612770 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb8003520 con 0x7facd006c2b0 2024-04-25T08:42:14.713 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.719+0000 7facce7fc640 1 -- 172.21.15.172:0/3193612770 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799463396 0 0) 0x7facd00ca6b0 con 0x7facd006d9b0 2024-04-25T08:42:14.713 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.719+0000 7facce7fc640 1 -- 172.21.15.172:0/3193612770 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc8001490 con 0x7facd006d9b0 2024-04-25T08:42:14.713 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.719+0000 7faccf7fe640 1 -- 172.21.15.172:0/3193612770 >> v1:172.21.15.186:6789/0 conn(0x7facd006d9b0 legacy=0x7facd006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:14.713 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.719+0000 7faccf7fe640 1 -- 172.21.15.172:0/3193612770 >> v1:172.21.15.172:6789/0 conn(0x7facd006c2b0 legacy=0x7facd00cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:14.713 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.719+0000 7faccf7fe640 1 -- 172.21.15.172:0/3193612770 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00cac70 con 0x7facd015d980 2024-04-25T08:42:14.713 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.720+0000 7faccf7fe640 1 --2- 172.21.15.172:0/3193612770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd0072630 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7facc00097d0 tx=0x7facc002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aefa5aaeb0c8429d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:14.713 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.720+0000 7facce7fc640 1 -- 172.21.15.172:0/3193612770 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0037070 con 0x7facd015d980 2024-04-25T08:42:14.713 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.720+0000 7facce7fc640 1 -- 172.21.15.172:0/3193612770 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc0032440 con 0x7facd015d980 2024-04-25T08:42:14.713 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.720+0000 7facce7fc640 1 -- 172.21.15.172:0/3193612770 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0032810 con 0x7facd015d980 2024-04-25T08:42:14.713 INFO:tasks.ceph.osd.3.smithi172.stderr:2024-04-25T08:42:14.720+0000 7f9e5dd3d640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T08:42:14.714 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.720+0000 7facd5d89640 1 -- 172.21.15.172:0/3193612770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 msgr2=0x7facd0072630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:14.714 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.720+0000 7facd5d89640 1 --2- 172.21.15.172:0/3193612770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd0072630 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7facc00097d0 tx=0x7facc002a210 comp rx=0 tx=0).stop 2024-04-25T08:42:14.714 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.721+0000 7facd5d89640 1 -- 172.21.15.172:0/3193612770 shutdown_connections 2024-04-25T08:42:14.714 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.721+0000 7facd5d89640 1 --2- 172.21.15.172:0/3193612770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd0072630 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:14.714 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.721+0000 7facd5d89640 1 -- 172.21.15.172:0/3193612770 >> 172.21.15.172:0/3193612770 conn(0x7facd0071b10 msgr2=0x7facd0071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:14.714 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.721+0000 7facd5d89640 1 -- 172.21.15.172:0/3193612770 shutdown_connections 2024-04-25T08:42:14.714 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.721+0000 7facd5d89640 1 -- 172.21.15.172:0/3193612770 wait complete. 2024-04-25T08:42:14.715 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.722+0000 7facd5d89640 1 Processor -- start 2024-04-25T08:42:14.715 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.723+0000 7facd5d89640 1 -- start start 2024-04-25T08:42:14.717 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facd5d89640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facd006c2b0 0x7facd00b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:14.717 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facd5d89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd006d9b0 0x7facd01515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:14.717 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facd5d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd00b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:14.717 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facd5d89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd015dee0 con 0x7facd006d9b0 2024-04-25T08:42:14.717 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facd5d89640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd015dd60 con 0x7facd006c2b0 2024-04-25T08:42:14.717 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facd5d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd00cda90 con 0x7facd015d980 2024-04-25T08:42:14.717 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facceffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd006d9b0 0x7facd01515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:14.717 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7faccffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd00b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7faccf7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facd006c2b0 0x7facd00b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facceffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd006d9b0 0x7facd01515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45442/0 (socket says 172.21.15.172:45442) 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7faccf7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facd006c2b0 0x7facd00b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:51546/0 (socket says 172.21.15.172:51546) 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7faccffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd00b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:46226/0 (socket says 172.21.15.172:46226) 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facceffd640 1 -- 172.21.15.172:0/3667779047 learned_addr learned my addr 172.21.15.172:0/3667779047 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7faccffff640 1 -- 172.21.15.172:0/3667779047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facd006c2b0 msgr2=0x7facd00b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7faccffff640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facd006c2b0 0x7facd00b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7faccffff640 1 -- 172.21.15.172:0/3667779047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd006d9b0 msgr2=0x7facd01515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7faccffff640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd006d9b0 0x7facd01515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7faccffff640 1 -- 172.21.15.172:0/3667779047 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00b5c00 con 0x7facd015d980 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facceffd640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd006d9b0 0x7facd01515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7faccffff640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd00b2e90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7facd00ad0e0 tx=0x7facc800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:14.718 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.724+0000 7facb7fff640 1 -- 172.21.15.172:0/3667779047 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8017070 con 0x7facd015d980 2024-04-25T08:42:14.719 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.725+0000 7facb7fff640 1 -- 172.21.15.172:0/3667779047 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc800ce20 con 0x7facd015d980 2024-04-25T08:42:14.719 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.725+0000 7facd5d89640 1 -- 172.21.15.172:0/3667779047 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd0159f00 con 0x7facd015d980 2024-04-25T08:42:14.719 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.725+0000 7facb7fff640 1 -- 172.21.15.172:0/3667779047 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8012620 con 0x7facd015d980 2024-04-25T08:42:14.719 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.725+0000 7facd5d89640 1 -- 172.21.15.172:0/3667779047 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd015a4c0 con 0x7facd015d980 2024-04-25T08:42:14.720 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.726+0000 7facd5d89640 1 -- 172.21.15.172:0/3667779047 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd004ef20 con 0x7facd015d980 2024-04-25T08:42:14.720 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.726+0000 7facb7fff640 1 -- 172.21.15.172:0/3667779047 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7facc801a070 con 0x7facd015d980 2024-04-25T08:42:14.720 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.726+0000 7facb7fff640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facbc06b440 0x7facbc06d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:14.720 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.727+0000 7faccf7fe640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facbc06b440 0x7facbc06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:14.720 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.727+0000 7facb7fff640 1 -- 172.21.15.172:0/3667779047 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7facc80891d0 con 0x7facd015d980 2024-04-25T08:42:14.720 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.727+0000 7faccf7fe640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facbc06b440 0x7facbc06d900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7facc0034000 tx=0x7facc002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:14.723 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.731+0000 7facb7fff640 1 -- 172.21.15.172:0/3667779047 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7facd0072b70 con 0x7facd015d980 2024-04-25T08:42:14.731 INFO:tasks.ceph.osd.3.smithi172.stderr:2024-04-25T08:42:14.739+0000 7f9e55b5d640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T08:42:14.895 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.902+0000 7facd5d89640 1 -- 172.21.15.172:0/3667779047 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facd0161ef0 con 0x7facd015d980 2024-04-25T08:42:14.896 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.903+0000 7facb7fff640 1 -- 172.21.15.172:0/3667779047 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7facc8058870 con 0x7facd015d980 2024-04-25T08:42:14.896 INFO:teuthology.misc.health.smithi172.stdout: 2024-04-25T08:42:14.896 INFO:teuthology.misc.health.smithi172.stdout:{"epoch":12,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:12.520042+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:14.898 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.905+0000 7facd5d89640 1 -- 172.21.15.172:0/3667779047 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facbc06b440 msgr2=0x7facbc06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.905+0000 7facd5d89640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facbc06b440 0x7facbc06d900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7facc0034000 tx=0x7facc002e000 comp rx=0 tx=0).stop 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.905+0000 7facd5d89640 1 -- 172.21.15.172:0/3667779047 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 msgr2=0x7facd00b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.905+0000 7facd5d89640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd00b2e90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7facd00ad0e0 tx=0x7facc800a430 comp rx=0 tx=0).stop 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.905+0000 7facd5d89640 1 -- 172.21.15.172:0/3667779047 shutdown_connections 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.906+0000 7facd5d89640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facbc06b440 0x7facbc06d900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.906+0000 7facd5d89640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facd015d980 0x7facd00b2e90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.906+0000 7facd5d89640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd006d9b0 0x7facd01515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.906+0000 7facd5d89640 1 --2- 172.21.15.172:0/3667779047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facd006c2b0 0x7facd00b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.906+0000 7facd5d89640 1 -- 172.21.15.172:0/3667779047 >> 172.21.15.172:0/3667779047 conn(0x7facd0071b10 msgr2=0x7facd00ce2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.906+0000 7facd5d89640 1 -- 172.21.15.172:0/3667779047 shutdown_connections 2024-04-25T08:42:14.899 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:14.906+0000 7facd5d89640 1 -- 172.21.15.172:0/3667779047 wait complete. 2024-04-25T08:42:14.908 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T08:42:21.713 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:21.814 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.821+0000 7fb4541c8640 1 Processor -- start 2024-04-25T08:42:21.814 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.822+0000 7fb4541c8640 1 -- start start 2024-04-25T08:42:21.817 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.822+0000 7fb4541c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0aede0 0x7fb44c15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:21.817 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.822+0000 7fb4541c8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c0cf4d0 con 0x7fb44c15a230 2024-04-25T08:42:21.817 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.822+0000 7fb4541c8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c06e6e0 con 0x7fb44c15dbb0 2024-04-25T08:42:21.817 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.822+0000 7fb4541c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c06e9c0 con 0x7fb44c0aede0 2024-04-25T08:42:21.817 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb451763640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb44c15a230 0x7fb44c0b2e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59704/0 (socket says 172.21.15.172:59704) 2024-04-25T08:42:21.817 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb451763640 1 -- 172.21.15.172:0/3503381236 learned_addr learned my addr 172.21.15.172:0/3503381236 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:21.817 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb452765640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0aede0 0x7fb44c15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:21.817 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698796658 0 0) 0x7fb44c0cf4d0 con 0x7fb44c15a230 2024-04-25T08:42:21.817 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb438004630 con 0x7fb44c15a230 2024-04-25T08:42:21.818 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969805813 0 0) 0x7fb44c06e6e0 con 0x7fb44c15dbb0 2024-04-25T08:42:21.818 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb44c0cf4d0 con 0x7fb44c15dbb0 2024-04-25T08:42:21.818 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1809284952 0 0) 0x7fb438004630 con 0x7fb44c15a230 2024-04-25T08:42:21.818 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0aede0 msgr2=0x7fb44c15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:21.818 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0aede0 0x7fb44c15e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:21.818 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 >> v1:172.21.15.186:6789/0 conn(0x7fb44c15dbb0 legacy=0x7fb44c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:21.818 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c06eca0 con 0x7fb44c15a230 2024-04-25T08:42:21.818 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fb448001670 con 0x7fb44c15a230 2024-04-25T08:42:21.818 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 >> v1:172.21.15.172:6789/0 conn(0x7fb44c15a230 legacy=0x7fb44c0b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb438004c80 0x7fb438005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0aede0 0x7fb438005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 0x7fb4380062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c06e9c0 con 0x7fb438005e50 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380034f0 con 0x7fb438004c80 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380036f0 con 0x7fb44c0aede0 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb452765640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 0x7fb4380062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb451f64640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb438004c80 0x7fb438005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.823+0000 7fb451763640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0aede0 0x7fb438005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.824+0000 7fb452765640 1 -- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0aede0 msgr2=0x7fb438005910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.824+0000 7fb452765640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0aede0 0x7fb438005910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.824+0000 7fb452765640 1 -- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb438004c80 msgr2=0x7fb438005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.824+0000 7fb452765640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb438004c80 0x7fb438005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.824+0000 7fb452765640 1 -- 172.21.15.172:0/3503381236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438004630 con 0x7fb438005e50 2024-04-25T08:42:21.819 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.824+0000 7fb452765640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 0x7fb4380062d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb444009f90 tx=0x7fb438006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863fae6164a82be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:21.820 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.824+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444009c10 con 0x7fb438005e50 2024-04-25T08:42:21.820 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.825+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb444036070 con 0x7fb438005e50 2024-04-25T08:42:21.820 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.825+0000 7fb450f62640 1 -- 172.21.15.172:0/3503381236 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444031810 con 0x7fb438005e50 2024-04-25T08:42:21.823 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.825+0000 7fb4541c8640 1 -- 172.21.15.172:0/3503381236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 msgr2=0x7fb4380062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:21.823 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.825+0000 7fb4541c8640 1 --2- 172.21.15.172:0/3503381236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 0x7fb4380062d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb444009f90 tx=0x7fb438006940 comp rx=0 tx=0).stop 2024-04-25T08:42:21.823 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.825+0000 7fb452765640 1 -- 172.21.15.172:0/3503381236 reap_dead start 2024-04-25T08:42:21.823 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.825+0000 7fb4541c8640 1 -- 172.21.15.172:0/3503381236 shutdown_connections 2024-04-25T08:42:21.823 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.825+0000 7fb4541c8640 1 -- 172.21.15.172:0/3503381236 >> 172.21.15.172:0/3503381236 conn(0x7fb44c0b1470 msgr2=0x7fb44c0b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.825+0000 7fb4541c8640 1 -- 172.21.15.172:0/3503381236 shutdown_connections 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.825+0000 7fb4541c8640 1 -- 172.21.15.172:0/3503381236 wait complete. 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.826+0000 7fb4541c8640 1 Processor -- start 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb4541c8640 1 -- start start 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb4541c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 0x7fb44c1f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb4541c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0afd80 0x7fb44c1f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb4541c8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb44c0b0200 0x7fb44c1f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb4541c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c15e820 con 0x7fb438005e50 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb4541c8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c15e6a0 con 0x7fb44c0b0200 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb4541c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c15e9a0 con 0x7fb44c0afd80 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb451f64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 0x7fb44c1f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb451f64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 0x7fb44c1f2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42542/0 (socket says 172.21.15.172:42542) 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb451f64640 1 -- 172.21.15.172:0/142124358 learned_addr learned my addr 172.21.15.172:0/142124358 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb452765640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb44c0b0200 0x7fb44c1f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:21.824 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.827+0000 7fb451763640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0afd80 0x7fb44c1f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb451f64640 1 -- 172.21.15.172:0/142124358 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0afd80 msgr2=0x7fb44c1f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb451f64640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0afd80 0x7fb44c1f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb451f64640 1 -- 172.21.15.172:0/142124358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb44c0b0200 msgr2=0x7fb44c1f0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb451f64640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb44c0b0200 0x7fb44c1f0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb451f64640 1 -- 172.21.15.172:0/142124358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c14b070 con 0x7fb438005e50 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb451f64640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 0x7fb44c1f2d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00f810 tx=0x7fb43c00fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb4427fc640 1 -- 172.21.15.172:0/142124358 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0052e0 con 0x7fb438005e50 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb4427fc640 1 -- 172.21.15.172:0/142124358 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c018070 con 0x7fb438005e50 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb4427fc640 1 -- 172.21.15.172:0/142124358 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00d970 con 0x7fb438005e50 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb4541c8640 1 -- 172.21.15.172:0/142124358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c1f35b0 con 0x7fb438005e50 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.828+0000 7fb4541c8640 1 -- 172.21.15.172:0/142124358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c14b2e0 con 0x7fb438005e50 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.829+0000 7fb4541c8640 1 -- 172.21.15.172:0/142124358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c0680b0 con 0x7fb438005e50 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.829+0000 7fb4427fc640 1 -- 172.21.15.172:0/142124358 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb43c00db10 con 0x7fb438005e50 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.830+0000 7fb4427fc640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb43006b4d0 0x7fb43006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:21.825 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.830+0000 7fb4427fc640 1 -- 172.21.15.172:0/142124358 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb43c089da0 con 0x7fb438005e50 2024-04-25T08:42:21.826 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.830+0000 7fb451763640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb43006b4d0 0x7fb43006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:21.826 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.830+0000 7fb451763640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb43006b4d0 0x7fb43006d990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0b07b0 tx=0x7fb448000f80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:21.826 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:21.834+0000 7fb4427fc640 1 -- 172.21.15.172:0/142124358 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb43c058920 con 0x7fb438005e50 2024-04-25T08:42:21.995 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.003+0000 7fb4541c8640 1 -- 172.21.15.172:0/142124358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb44c04ef20 con 0x7fb438005e50 2024-04-25T08:42:21.996 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.004+0000 7fb4427fc640 1 -- 172.21.15.172:0/142124358 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12944 (secure 0 0 0) 0x7fb43c05c9c0 con 0x7fb438005e50 2024-04-25T08:42:21.996 INFO:teuthology.misc.health.smithi172.stdout: 2024-04-25T08:42:21.997 INFO:teuthology.misc.health.smithi172.stdout:{"epoch":16,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:18.561383+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 -- 172.21.15.172:0/142124358 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb43006b4d0 msgr2=0x7fb43006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb43006b4d0 0x7fb43006d990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0b07b0 tx=0x7fb448000f80 comp rx=0 tx=0).stop 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 -- 172.21.15.172:0/142124358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 msgr2=0x7fb44c1f2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 0x7fb44c1f2d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00f810 tx=0x7fb43c00fcd0 comp rx=0 tx=0).stop 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 -- 172.21.15.172:0/142124358 shutdown_connections 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb43006b4d0 0x7fb43006d990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb44c0b0200 0x7fb44c1f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb44c0afd80 0x7fb44c1f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 --2- 172.21.15.172:0/142124358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb438005e50 0x7fb44c1f2d60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 -- 172.21.15.172:0/142124358 >> 172.21.15.172:0/142124358 conn(0x7fb44c0b1470 msgr2=0x7fb44c15df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 -- 172.21.15.172:0/142124358 shutdown_connections 2024-04-25T08:42:21.999 INFO:teuthology.misc.health.smithi172.stderr:2024-04-25T08:42:22.006+0000 7fb4541c8640 1 -- 172.21.15.172:0/142124358 wait complete. 2024-04-25T08:42:22.008 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T08:42:22.008 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T08:42:22.008 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:42:22.009 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:42:22.011 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:42:22.011 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:42:22.011 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:42:22.013 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:42:22.013 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:42:22.013 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:42:22.016 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:42:22.016 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:42:22.016 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:42:22.018 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:42:22.019 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T08:42:22.019 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:22.084 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:42:22.084 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:42:22.100 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:42:22.100 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:42:22.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.130+0000 7f0221a12640 1 Processor -- start 2024-04-25T08:42:22.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.130+0000 7f0221a12640 1 -- start start 2024-04-25T08:42:22.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f0221a12640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f021c06b2f0 0x7f021c16cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f0221a12640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0b37f0 con 0x7f021c162020 2024-04-25T08:42:22.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f0221a12640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0b3ad0 con 0x7f021c0b4890 2024-04-25T08:42:22.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f0221a12640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0b3db0 con 0x7f021c06b2f0 2024-04-25T08:42:22.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f021affd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f021c162020 0x7f021c070490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59718/0 (socket says 172.21.15.172:59718) 2024-04-25T08:42:22.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f021affd640 1 -- 172.21.15.172:0/297718136 learned_addr learned my addr 172.21.15.172:0/297718136 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:22.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f021b7fe640 1 --2- 172.21.15.172:0/297718136 >> v2:172.21.15.186:3300/0 conn(0x7f021c06b2f0 0x7f021c16cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f021a7fc640 1 -- 172.21.15.172:0/297718136 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080688742 0 0) 0x7f021c0b37f0 con 0x7f021c162020 2024-04-25T08:42:22.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f021a7fc640 1 -- 172.21.15.172:0/297718136 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0208003520 con 0x7f021c162020 2024-04-25T08:42:22.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f021b7fe640 1 -- 172.21.15.172:0/297718136 >> v1:172.21.15.186:6789/0 conn(0x7f021c0b4890 legacy=0x7f021c06abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.131+0000 7f021b7fe640 1 -- 172.21.15.172:0/297718136 >> v1:172.21.15.172:6789/0 conn(0x7f021c162020 legacy=0x7f021c070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.132+0000 7f021b7fe640 1 -- 172.21.15.172:0/297718136 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0b4090 con 0x7f021c06b2f0 2024-04-25T08:42:22.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.132+0000 7f021b7fe640 1 --2- 172.21.15.172:0/297718136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f021c06b2f0 0x7f021c16cc20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0214009d90 tx=0x7f021402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4683fe1ded59183 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:22.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.132+0000 7f021a7fc640 1 -- 172.21.15.172:0/297718136 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214007740 con 0x7f021c06b2f0 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.132+0000 7f021a7fc640 1 -- 172.21.15.172:0/297718136 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02140078e0 con 0x7f021c06b2f0 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.132+0000 7f021a7fc640 1 -- 172.21.15.172:0/297718136 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214007c90 con 0x7f021c06b2f0 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.133+0000 7f0221a12640 1 -- 172.21.15.172:0/297718136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f021c06b2f0 msgr2=0x7f021c16cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.133+0000 7f0221a12640 1 --2- 172.21.15.172:0/297718136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f021c06b2f0 0x7f021c16cc20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0214009d90 tx=0x7f021402a6f0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.133+0000 7f0221a12640 1 -- 172.21.15.172:0/297718136 shutdown_connections 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.133+0000 7f0221a12640 1 --2- 172.21.15.172:0/297718136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f021c06b2f0 0x7f021c16cc20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.133+0000 7f0221a12640 1 -- 172.21.15.172:0/297718136 >> 172.21.15.172:0/297718136 conn(0x7f021c0b2370 msgr2=0x7f021c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.133+0000 7f0221a12640 1 -- 172.21.15.172:0/297718136 shutdown_connections 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.133+0000 7f0221a12640 1 -- 172.21.15.172:0/297718136 wait complete. 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.134+0000 7f0221a12640 1 Processor -- start 2024-04-25T08:42:22.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.134+0000 7f0221a12640 1 -- start start 2024-04-25T08:42:22.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0221a12640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f021c06b2f0 0x7f021c14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0221a12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0b4890 0x7f021c15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0221a12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f021c162020 0x7f021c1ec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0221a12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c072a00 con 0x7f021c0b4890 2024-04-25T08:42:22.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0221a12640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c162400 con 0x7f021c06b2f0 2024-04-25T08:42:22.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0221a12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c070ba0 con 0x7f021c162020 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0213fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0b4890 0x7f021c15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0213fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0b4890 0x7f021c15bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42566/0 (socket says 172.21.15.172:42566) 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0213fff640 1 -- 172.21.15.172:0/3311318404 learned_addr learned my addr 172.21.15.172:0/3311318404 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f021affd640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f021c06b2f0 0x7f021c14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f021b7fe640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f021c162020 0x7f021c1ec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0213fff640 1 -- 172.21.15.172:0/3311318404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f021c162020 msgr2=0x7f021c1ec1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0213fff640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f021c162020 0x7f021c1ec1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0213fff640 1 -- 172.21.15.172:0/3311318404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f021c06b2f0 msgr2=0x7f021c14e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0213fff640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f021c06b2f0 0x7f021c14e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0213fff640 1 -- 172.21.15.172:0/3311318404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c164e50 con 0x7f021c0b4890 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f021affd640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f021c06b2f0 0x7f021c14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0213fff640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0b4890 0x7f021c15bd10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f020400c400 tx=0x7f020400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0218ff9640 1 -- 172.21.15.172:0/3311318404 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02040052d0 con 0x7f021c0b4890 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0218ff9640 1 -- 172.21.15.172:0/3311318404 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0204005490 con 0x7f021c0b4890 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0221a12640 1 -- 172.21.15.172:0/3311318404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c162f90 con 0x7f021c0b4890 2024-04-25T08:42:22.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.135+0000 7f0218ff9640 1 -- 172.21.15.172:0/3311318404 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204007260 con 0x7f021c0b4890 2024-04-25T08:42:22.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.136+0000 7f0221a12640 1 -- 172.21.15.172:0/3311318404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c163550 con 0x7f021c0b4890 2024-04-25T08:42:22.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.136+0000 7f0221a12640 1 -- 172.21.15.172:0/3311318404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c073990 con 0x7f021c0b4890 2024-04-25T08:42:22.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.137+0000 7f0218ff9640 1 -- 172.21.15.172:0/3311318404 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0204007400 con 0x7f021c0b4890 2024-04-25T08:42:22.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.137+0000 7f0218ff9640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01fc06b4d0 0x7f01fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.137+0000 7f021affd640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01fc06b4d0 0x7f01fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.137+0000 7f0218ff9640 1 -- 172.21.15.172:0/3311318404 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f02040892f0 con 0x7f021c0b4890 2024-04-25T08:42:22.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.138+0000 7f021affd640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01fc06b4d0 0x7f01fc06d990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f020c0011e0 tx=0x7f020c007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:22.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.142+0000 7f0218ff9640 1 -- 172.21.15.172:0/3311318404 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0204057f00 con 0x7f021c0b4890 2024-04-25T08:42:22.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.314+0000 7f0221a12640 1 -- 172.21.15.172:0/3311318404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f021c15f100 con 0x7f021c0b4890 2024-04-25T08:42:22.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.315+0000 7f0218ff9640 1 -- 172.21.15.172:0/3311318404 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12944 (secure 0 0 0) 0x7f020405bfa0 con 0x7f021c0b4890 2024-04-25T08:42:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:22.308 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":16,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:18.561383+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 -- 172.21.15.172:0/3311318404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01fc06b4d0 msgr2=0x7f01fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01fc06b4d0 0x7f01fc06d990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f020c0011e0 tx=0x7f020c007d30 comp rx=0 tx=0).stop 2024-04-25T08:42:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 -- 172.21.15.172:0/3311318404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0b4890 msgr2=0x7f021c15bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0b4890 0x7f021c15bd10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f020400c400 tx=0x7f020400c8c0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 -- 172.21.15.172:0/3311318404 shutdown_connections 2024-04-25T08:42:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01fc06b4d0 0x7f01fc06d990 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f021c162020 0x7f021c1ec1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c0b4890 0x7f021c15bd10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 --2- 172.21.15.172:0/3311318404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f021c06b2f0 0x7f021c14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 -- 172.21.15.172:0/3311318404 >> 172.21.15.172:0/3311318404 conn(0x7f021c0b2370 msgr2=0x7f021c0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:22.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 -- 172.21.15.172:0/3311318404 shutdown_connections 2024-04-25T08:42:22.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.317+0000 7f0221a12640 1 -- 172.21.15.172:0/3311318404 wait complete. 2024-04-25T08:42:22.321 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:42:22.321 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:42:22.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.427+0000 7efe3c5ce640 1 Processor -- start 2024-04-25T08:42:22.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.427+0000 7efe3c5ce640 1 -- start start 2024-04-25T08:42:22.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.428+0000 7efe3c5ce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe3406c9e0 0x7efe340b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.428+0000 7efe3c5ce640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3406cf50 con 0x7efe340b5620 2024-04-25T08:42:22.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.428+0000 7efe3c5ce640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe340ce530 con 0x7efe3415b7d0 2024-04-25T08:42:22.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.428+0000 7efe3c5ce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe340ce810 con 0x7efe3406c9e0 2024-04-25T08:42:22.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.428+0000 7efe39b69640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efe340b5620 0x7efe3406c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59724/0 (socket says 172.21.15.172:59724) 2024-04-25T08:42:22.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.428+0000 7efe39b69640 1 -- 172.21.15.172:0/2544845346 learned_addr learned my addr 172.21.15.172:0/2544845346 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:22.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.428+0000 7efe3ab6b640 1 --2- 172.21.15.172:0/2544845346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe3406c9e0 0x7efe340b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.428+0000 7efe39368640 1 -- 172.21.15.172:0/2544845346 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678457329 0 0) 0x7efe3406cf50 con 0x7efe340b5620 2024-04-25T08:42:22.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.428+0000 7efe39368640 1 -- 172.21.15.172:0/2544845346 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe20003520 con 0x7efe340b5620 2024-04-25T08:42:22.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.429+0000 7efe39368640 1 -- 172.21.15.172:0/2544845346 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172615848 0 0) 0x7efe340ce530 con 0x7efe3415b7d0 2024-04-25T08:42:22.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.429+0000 7efe39368640 1 -- 172.21.15.172:0/2544845346 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe3406cf50 con 0x7efe3415b7d0 2024-04-25T08:42:22.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.429+0000 7efe3ab6b640 1 -- 172.21.15.172:0/2544845346 >> v1:172.21.15.186:6789/0 conn(0x7efe3415b7d0 legacy=0x7efe340cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.429+0000 7efe39368640 1 -- 172.21.15.172:0/2544845346 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 61263317 0 0) 0x7efe20003520 con 0x7efe340b5620 2024-04-25T08:42:22.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.429+0000 7efe3ab6b640 1 -- 172.21.15.172:0/2544845346 >> v1:172.21.15.172:6789/0 conn(0x7efe340b5620 legacy=0x7efe3406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.429+0000 7efe3ab6b640 1 -- 172.21.15.172:0/2544845346 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe340ceaf0 con 0x7efe3406c9e0 2024-04-25T08:42:22.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.429+0000 7efe3ab6b640 1 --2- 172.21.15.172:0/2544845346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe3406c9e0 0x7efe340b5ab0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0097d0 tx=0x7efe2c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0b77473d5a175ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:22.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.430+0000 7efe39368640 1 -- 172.21.15.172:0/2544845346 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c037070 con 0x7efe3406c9e0 2024-04-25T08:42:22.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.430+0000 7efe39368640 1 -- 172.21.15.172:0/2544845346 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c02ac30 con 0x7efe3406c9e0 2024-04-25T08:42:22.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.430+0000 7efe39368640 1 -- 172.21.15.172:0/2544845346 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24001690 con 0x7efe3406c9e0 2024-04-25T08:42:22.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.430+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2544845346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe3406c9e0 msgr2=0x7efe340b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.430+0000 7efe3c5ce640 1 --2- 172.21.15.172:0/2544845346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe3406c9e0 0x7efe340b5ab0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0097d0 tx=0x7efe2c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.430+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2544845346 shutdown_connections 2024-04-25T08:42:22.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.430+0000 7efe3c5ce640 1 --2- 172.21.15.172:0/2544845346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe3406c9e0 0x7efe340b5ab0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.430+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2544845346 >> 172.21.15.172:0/2544845346 conn(0x7efe340d0800 msgr2=0x7efe340d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:22.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.430+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2544845346 shutdown_connections 2024-04-25T08:42:22.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.430+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2544845346 wait complete. 2024-04-25T08:42:22.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.431+0000 7efe3c5ce640 1 Processor -- start 2024-04-25T08:42:22.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.431+0000 7efe3c5ce640 1 -- start start 2024-04-25T08:42:22.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3c5ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe3406c9e0 0x7efe340ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3c5ce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe340b5620 0x7efe340c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3c5ce640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe3415b7d0 0x7efe3415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3c5ce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3415bd30 con 0x7efe3406c9e0 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3c5ce640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3415bbb0 con 0x7efe3415b7d0 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3c5ce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe340d1f40 con 0x7efe340b5620 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3a36a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe3406c9e0 0x7efe340ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3a36a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe3406c9e0 0x7efe340ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42570/0 (socket says 172.21.15.172:42570) 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3a36a640 1 -- 172.21.15.172:0/2243707226 learned_addr learned my addr 172.21.15.172:0/2243707226 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe39b69640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe340b5620 0x7efe340c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3ab6b640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe3415b7d0 0x7efe3415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3a36a640 1 -- 172.21.15.172:0/2243707226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe340b5620 msgr2=0x7efe340c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3a36a640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe340b5620 0x7efe340c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3a36a640 1 -- 172.21.15.172:0/2243707226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe3415b7d0 msgr2=0x7efe3415cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3a36a640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe3415b7d0 0x7efe3415cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3a36a640 1 -- 172.21.15.172:0/2243707226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe340c9440 con 0x7efe3406c9e0 2024-04-25T08:42:22.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.432+0000 7efe3ab6b640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe3415b7d0 0x7efe3415cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:22.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.433+0000 7efe3a36a640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe3406c9e0 0x7efe340ca1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c7a0 tx=0x7efe3000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:22.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.433+0000 7efe2affd640 1 -- 172.21.15.172:0/2243707226 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30003b70 con 0x7efe3406c9e0 2024-04-25T08:42:22.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.433+0000 7efe2affd640 1 -- 172.21.15.172:0/2243707226 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe30003d10 con 0x7efe3406c9e0 2024-04-25T08:42:22.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.433+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2243707226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe34148ad0 con 0x7efe3406c9e0 2024-04-25T08:42:22.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.433+0000 7efe2affd640 1 -- 172.21.15.172:0/2243707226 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000aa90 con 0x7efe3406c9e0 2024-04-25T08:42:22.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.433+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2243707226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe340c99a0 con 0x7efe3406c9e0 2024-04-25T08:42:22.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.434+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2243707226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe340739e0 con 0x7efe3406c9e0 2024-04-25T08:42:22.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.434+0000 7efe2affd640 1 -- 172.21.15.172:0/2243707226 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe3000ac30 con 0x7efe3406c9e0 2024-04-25T08:42:22.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.435+0000 7efe2affd640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe1806b4d0 0x7efe1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.435+0000 7efe39b69640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe1806b4d0 0x7efe1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.435+0000 7efe2affd640 1 -- 172.21.15.172:0/2243707226 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efe30089e20 con 0x7efe3406c9e0 2024-04-25T08:42:22.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.435+0000 7efe39b69640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe1806b4d0 0x7efe1806d990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe24001eb0 tx=0x7efe240016d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:22.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.439+0000 7efe2affd640 1 -- 172.21.15.172:0/2243707226 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe340c9440 con 0x7efe3406c9e0 2024-04-25T08:42:22.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.609+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2243707226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe340d0c80 con 0x7efe3406c9e0 2024-04-25T08:42:22.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.610+0000 7efe2affd640 1 -- 172.21.15.172:0/2243707226 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe30058f70 con 0x7efe3406c9e0 2024-04-25T08:42:22.603 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2243707226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe1806b4d0 msgr2=0x7efe1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe1806b4d0 0x7efe1806d990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe24001eb0 tx=0x7efe240016d0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2243707226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe3406c9e0 msgr2=0x7efe340ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe3406c9e0 0x7efe340ca1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c7a0 tx=0x7efe3000cc60 comp rx=0 tx=0).stop 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2243707226 shutdown_connections 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe1806b4d0 0x7efe1806d990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe3415b7d0 0x7efe3415cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe340b5620 0x7efe340c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 --2- 172.21.15.172:0/2243707226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe3406c9e0 0x7efe340ca1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2243707226 >> 172.21.15.172:0/2243707226 conn(0x7efe340d0800 msgr2=0x7efe3415afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2243707226 shutdown_connections 2024-04-25T08:42:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.612+0000 7efe3c5ce640 1 -- 172.21.15.172:0/2243707226 wait complete. 2024-04-25T08:42:22.615 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:42:22.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.720+0000 7f63ef3f4640 1 Processor -- start 2024-04-25T08:42:22.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.720+0000 7f63ef3f4640 1 -- start start 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ef3f4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f63e815dd30 0x7f63e80b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ef3f4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63e80b9770 0x7f63e80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ef3f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63e80d2e90 0x7f63e80d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ef3f4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e80d1df0 con 0x7f63e80b9770 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ef3f4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e80d20d0 con 0x7f63e815dd30 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ef3f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80d23b0 con 0x7f63e80d2e90 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ec98f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63e80b9770 0x7f63e80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ec98f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63e80b9770 0x7f63e80d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42582/0 (socket says 172.21.15.172:42582) 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ec98f640 1 -- 172.21.15.172:0/3113537744 learned_addr learned my addr 172.21.15.172:0/3113537744 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ed190640 1 --2- 172.21.15.172:0/3113537744 >> v2:172.21.15.186:3300/0 conn(0x7f63e815dd30 0x7f63e80b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ec98f640 1 -- 172.21.15.172:0/3113537744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63e80d2e90 msgr2=0x7f63e80d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ed991640 1 --2- 172.21.15.172:0/3113537744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63e80d2e90 0x7f63e80d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ec98f640 1 --2- 172.21.15.172:0/3113537744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63e80d2e90 0x7f63e80d0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ec98f640 1 -- 172.21.15.172:0/3113537744 >> v2:172.21.15.186:3300/0 conn(0x7f63e815dd30 msgr2=0x7f63e80b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:22.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ec98f640 1 --2- 172.21.15.172:0/3113537744 >> v2:172.21.15.186:3300/0 conn(0x7f63e815dd30 0x7f63e80b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ec98f640 1 -- 172.21.15.172:0/3113537744 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80d2690 con 0x7f63e80b9770 2024-04-25T08:42:22.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.721+0000 7f63ed190640 1 --2- 172.21.15.172:0/3113537744 >> v2:172.21.15.186:3300/0 conn(0x7f63e815dd30 0x7f63e80b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:22.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.722+0000 7f63ec98f640 1 --2- 172.21.15.172:0/3113537744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80b9770 0x7f63e80d03c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f63e806d000 tx=0x7f63d802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73452419b3b0aba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:22.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.722+0000 7f63dffff640 1 -- 172.21.15.172:0/3113537744 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8004030 con 0x7f63e80b9770 2024-04-25T08:42:22.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.722+0000 7f63dffff640 1 -- 172.21.15.172:0/3113537744 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d80041d0 con 0x7f63e80b9770 2024-04-25T08:42:22.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.722+0000 7f63dffff640 1 -- 172.21.15.172:0/3113537744 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8003610 con 0x7f63e80b9770 2024-04-25T08:42:22.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.723+0000 7f63ef3f4640 1 -- 172.21.15.172:0/3113537744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80b9770 msgr2=0x7f63e80d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.723+0000 7f63ef3f4640 1 --2- 172.21.15.172:0/3113537744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80b9770 0x7f63e80d03c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f63e806d000 tx=0x7f63d802a130 comp rx=0 tx=0).stop 2024-04-25T08:42:22.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.723+0000 7f63ef3f4640 1 -- 172.21.15.172:0/3113537744 shutdown_connections 2024-04-25T08:42:22.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.723+0000 7f63ef3f4640 1 --2- 172.21.15.172:0/3113537744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63e80d2e90 0x7f63e80d0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.723+0000 7f63ef3f4640 1 --2- 172.21.15.172:0/3113537744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80b9770 0x7f63e80d03c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.723+0000 7f63ef3f4640 1 --2- 172.21.15.172:0/3113537744 >> v2:172.21.15.186:3300/0 conn(0x7f63e815dd30 0x7f63e80b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.723+0000 7f63ef3f4640 1 -- 172.21.15.172:0/3113537744 >> 172.21.15.172:0/3113537744 conn(0x7f63e8061c30 msgr2=0x7f63e806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.723+0000 7f63ef3f4640 1 -- 172.21.15.172:0/3113537744 shutdown_connections 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.723+0000 7f63ef3f4640 1 -- 172.21.15.172:0/3113537744 wait complete. 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.724+0000 7f63ef3f4640 1 Processor -- start 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.724+0000 7f63ef3f4640 1 -- start start 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ef3f4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63e80b9770 0x7f63e815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ef3f4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80d2e90 0x7f63e815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ef3f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63e815dd30 0x7f63e80c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ef3f4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80d1b90 con 0x7f63e80d2e90 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ef3f4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80d1a10 con 0x7f63e80b9770 2024-04-25T08:42:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ef3f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80b5430 con 0x7f63e815dd30 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ec98f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80d2e90 0x7f63e815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ec98f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80d2e90 0x7f63e815eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42594/0 (socket says 172.21.15.172:42594) 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ec98f640 1 -- 172.21.15.172:0/4197688254 learned_addr learned my addr 172.21.15.172:0/4197688254 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ed190640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63e80b9770 0x7f63e815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ed991640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63e815dd30 0x7f63e80c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ec98f640 1 -- 172.21.15.172:0/4197688254 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63e815dd30 msgr2=0x7f63e80c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ec98f640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63e815dd30 0x7f63e80c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ec98f640 1 -- 172.21.15.172:0/4197688254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63e80b9770 msgr2=0x7f63e815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ec98f640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63e80b9770 0x7f63e815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ec98f640 1 -- 172.21.15.172:0/4197688254 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e815eff0 con 0x7f63e80d2e90 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ed190640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63e80b9770 0x7f63e815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.725+0000 7f63ec98f640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80d2e90 0x7f63e815eab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63d802a170 tx=0x7f63d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.726+0000 7f63ddffb640 1 -- 172.21.15.172:0/4197688254 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8041020 con 0x7f63e80d2e90 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.726+0000 7f63ddffb640 1 -- 172.21.15.172:0/4197688254 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8003c50 con 0x7f63e80d2e90 2024-04-25T08:42:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.726+0000 7f63ef3f4640 1 -- 172.21.15.172:0/4197688254 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e80c9f60 con 0x7f63e80d2e90 2024-04-25T08:42:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.726+0000 7f63ddffb640 1 -- 172.21.15.172:0/4197688254 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8004030 con 0x7f63e80d2e90 2024-04-25T08:42:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.726+0000 7f63ef3f4640 1 -- 172.21.15.172:0/4197688254 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e80c99a0 con 0x7f63e80d2e90 2024-04-25T08:42:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.727+0000 7f63ef3f4640 1 -- 172.21.15.172:0/4197688254 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e8073990 con 0x7f63e80d2e90 2024-04-25T08:42:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.727+0000 7f63ddffb640 1 -- 172.21.15.172:0/4197688254 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f63d8044020 con 0x7f63e80d2e90 2024-04-25T08:42:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.727+0000 7f63ddffb640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f63cc06b4d0 0x7f63cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.728+0000 7f63ddffb640 1 -- 172.21.15.172:0/4197688254 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f63d80aabc0 con 0x7f63e80d2e90 2024-04-25T08:42:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.728+0000 7f63ed190640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f63cc06b4d0 0x7f63cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.728+0000 7f63ed190640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f63cc06b4d0 0x7f63cc06d990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63e400a910 tx=0x7f63e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.732+0000 7f63ddffb640 1 -- 172.21.15.172:0/4197688254 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f63d804b030 con 0x7f63e80d2e90 2024-04-25T08:42:22.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.937+0000 7f63ef3f4640 1 -- 172.21.15.172:0/4197688254 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63e8067e90 con 0x7f63e80d2e90 2024-04-25T08:42:22.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.938+0000 7f63ddffb640 1 -- 172.21.15.172:0/4197688254 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f63d8079d90 con 0x7f63e80d2e90 2024-04-25T08:42:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:22.930 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-04-25T08:42:22.931 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 2 2024-04-25T08:42:22.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 -- 172.21.15.172:0/4197688254 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f63cc06b4d0 msgr2=0x7f63cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f63cc06b4d0 0x7f63cc06d990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f63e400a910 tx=0x7f63e4008040 comp rx=0 tx=0).stop 2024-04-25T08:42:22.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 -- 172.21.15.172:0/4197688254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80d2e90 msgr2=0x7f63e815eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:22.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80d2e90 0x7f63e815eab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63d802a170 tx=0x7f63d80046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 -- 172.21.15.172:0/4197688254 shutdown_connections 2024-04-25T08:42:22.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f63cc06b4d0 0x7f63cc06d990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63e815dd30 0x7f63e80c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63e80d2e90 0x7f63e815eab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 --2- 172.21.15.172:0/4197688254 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63e80b9770 0x7f63e815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:22.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 -- 172.21.15.172:0/4197688254 >> 172.21.15.172:0/4197688254 conn(0x7f63e8061c30 msgr2=0x7f63e80b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:22.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 -- 172.21.15.172:0/4197688254 shutdown_connections 2024-04-25T08:42:22.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:22.940+0000 7f63ef3f4640 1 -- 172.21.15.172:0/4197688254 wait complete. 2024-04-25T08:42:24.944 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:42:25.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.061+0000 7f7491a6f640 1 Processor -- start 2024-04-25T08:42:25.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.061+0000 7f7491a6f640 1 -- start start 2024-04-25T08:42:25.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f7491a6f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f748c0b3af0 0x7f748c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f7491a6f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f748c0cf340 0x7f748c0cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f7491a6f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0c7380 con 0x7f748c15b8f0 2024-04-25T08:42:25.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f7491a6f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c0d03c0 con 0x7f748c0b3af0 2024-04-25T08:42:25.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f7491a6f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c0c7150 con 0x7f748c0cf340 2024-04-25T08:42:25.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f748b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f748c15b8f0 0x7f748c0b33e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59730/0 (socket says 172.21.15.172:59730) 2024-04-25T08:42:25.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f748affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f748c0b3af0 0x7f748c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f748b7fe640 1 -- 172.21.15.172:0/2594030189 learned_addr learned my addr 172.21.15.172:0/2594030189 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:25.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f748bfff640 1 --2- 172.21.15.172:0/2594030189 >> v2:172.21.15.186:3300/0 conn(0x7f748c0cf340 0x7f748c0cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f748affd640 1 -- 172.21.15.172:0/2594030189 >> v2:172.21.15.186:3300/0 conn(0x7f748c0cf340 msgr2=0x7f748c0cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:25.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f748affd640 1 --2- 172.21.15.172:0/2594030189 >> v2:172.21.15.186:3300/0 conn(0x7f748c0cf340 0x7f748c0cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f748affd640 1 -- 172.21.15.172:0/2594030189 >> v1:172.21.15.172:6789/0 conn(0x7f748c15b8f0 legacy=0x7f748c0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f748a7fc640 1 -- 172.21.15.172:0/2594030189 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513050047 0 0) 0x7f748c0c7380 con 0x7f748c15b8f0 2024-04-25T08:42:25.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f748affd640 1 -- 172.21.15.172:0/2594030189 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0c7660 con 0x7f748c0b3af0 2024-04-25T08:42:25.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.062+0000 7f748bfff640 1 --2- 172.21.15.172:0/2594030189 >> v2:172.21.15.186:3300/0 conn(0x7f748c0cf340 0x7f748c0cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:25.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.063+0000 7f748affd640 1 --2- 172.21.15.172:0/2594030189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 0x7f748c0c6c10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f748c0d1110 tx=0x7f748002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295b395922b7cc72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.063+0000 7f748a7fc640 1 -- 172.21.15.172:0/2594030189 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480037070 con 0x7f748c0b3af0 2024-04-25T08:42:25.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.063+0000 7f748a7fc640 1 -- 172.21.15.172:0/2594030189 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7480032440 con 0x7f748c0b3af0 2024-04-25T08:42:25.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.063+0000 7f748a7fc640 1 -- 172.21.15.172:0/2594030189 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480032810 con 0x7f748c0b3af0 2024-04-25T08:42:25.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.064+0000 7f7491a6f640 1 -- 172.21.15.172:0/2594030189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 msgr2=0x7f748c0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.064+0000 7f7491a6f640 1 --2- 172.21.15.172:0/2594030189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 0x7f748c0c6c10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f748c0d1110 tx=0x7f748002a230 comp rx=0 tx=0).stop 2024-04-25T08:42:25.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.064+0000 7f7491a6f640 1 -- 172.21.15.172:0/2594030189 shutdown_connections 2024-04-25T08:42:25.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.064+0000 7f7491a6f640 1 --2- 172.21.15.172:0/2594030189 >> v2:172.21.15.186:3300/0 conn(0x7f748c0cf340 0x7f748c0cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.064+0000 7f7491a6f640 1 --2- 172.21.15.172:0/2594030189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 0x7f748c0c6c10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.064+0000 7f7491a6f640 1 -- 172.21.15.172:0/2594030189 >> 172.21.15.172:0/2594030189 conn(0x7f748c0d1800 msgr2=0x7f748c0d1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:25.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.064+0000 7f7491a6f640 1 -- 172.21.15.172:0/2594030189 shutdown_connections 2024-04-25T08:42:25.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.064+0000 7f7491a6f640 1 -- 172.21.15.172:0/2594030189 wait complete. 2024-04-25T08:42:25.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.065+0000 7f7491a6f640 1 Processor -- start 2024-04-25T08:42:25.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.065+0000 7f7491a6f640 1 -- start start 2024-04-25T08:42:25.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f7491a6f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 0x7f748c0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f7491a6f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f748c0cf340 0x7f748c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f7491a6f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c15b8f0 0x7f748c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f7491a6f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0c7c20 con 0x7f748c0b3af0 2024-04-25T08:42:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f7491a6f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0c7f90 con 0x7f748c15b8f0 2024-04-25T08:42:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f7491a6f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c15bcd0 con 0x7f748c0cf340 2024-04-25T08:42:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 0x7f748c0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 0x7f748c0ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42610/0 (socket says 172.21.15.172:42610) 2024-04-25T08:42:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748b7fe640 1 -- 172.21.15.172:0/3643973916 learned_addr learned my addr 172.21.15.172:0/3643973916 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748affd640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f748c0cf340 0x7f748c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748bfff640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c15b8f0 0x7f748c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748b7fe640 1 -- 172.21.15.172:0/3643973916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f748c0cf340 msgr2=0x7f748c15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748b7fe640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f748c0cf340 0x7f748c15dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748b7fe640 1 -- 172.21.15.172:0/3643973916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c15b8f0 msgr2=0x7f748c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748b7fe640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c15b8f0 0x7f748c15e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748b7fe640 1 -- 172.21.15.172:0/3643973916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0ccf40 con 0x7f748c0b3af0 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.066+0000 7f748bfff640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c15b8f0 0x7f748c15e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.067+0000 7f748b7fe640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 0x7f748c0ce6c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c460 tx=0x7f747c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.067+0000 7f7473fff640 1 -- 172.21.15.172:0/3643973916 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c018070 con 0x7f748c0b3af0 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.067+0000 7f7473fff640 1 -- 172.21.15.172:0/3643973916 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c007500 con 0x7f748c0b3af0 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.067+0000 7f7491a6f640 1 -- 172.21.15.172:0/3643973916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c0cc330 con 0x7f748c0b3af0 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.067+0000 7f7473fff640 1 -- 172.21.15.172:0/3643973916 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c004a20 con 0x7f748c0b3af0 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.067+0000 7f7491a6f640 1 -- 172.21.15.172:0/3643973916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c0cc8f0 con 0x7f748c0b3af0 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.068+0000 7f7491a6f640 1 -- 172.21.15.172:0/3643973916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c073990 con 0x7f748c0b3af0 2024-04-25T08:42:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.068+0000 7f7473fff640 1 -- 172.21.15.172:0/3643973916 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f747c01b070 con 0x7f748c0b3af0 2024-04-25T08:42:25.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.069+0000 7f7473fff640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f747806b500 0x7f747806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.069+0000 7f7473fff640 1 -- 172.21.15.172:0/3643973916 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f747c089100 con 0x7f748c0b3af0 2024-04-25T08:42:25.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.069+0000 7f748affd640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f747806b500 0x7f747806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.069+0000 7f748affd640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f747806b500 0x7f747806d9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7480034000 tx=0x7f748002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.073+0000 7f7473fff640 1 -- 172.21.15.172:0/3643973916 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f747c0582d0 con 0x7f748c0b3af0 2024-04-25T08:42:25.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.282+0000 7f7491a6f640 1 -- 172.21.15.172:0/3643973916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f748c0c9a00 con 0x7f748c0b3af0 2024-04-25T08:42:25.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.282+0000 7f7473fff640 1 -- 172.21.15.172:0/3643973916 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7f747c057bd0 con 0x7f748c0b3af0 2024-04-25T08:42:25.275 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:25.275 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-04-25T08:42:25.275 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 3 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 -- 172.21.15.172:0/3643973916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f747806b500 msgr2=0x7f747806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f747806b500 0x7f747806d9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7480034000 tx=0x7f748002e000 comp rx=0 tx=0).stop 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 -- 172.21.15.172:0/3643973916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 msgr2=0x7f748c0ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 0x7f748c0ce6c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c460 tx=0x7f747c00c920 comp rx=0 tx=0).stop 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 -- 172.21.15.172:0/3643973916 shutdown_connections 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f747806b500 0x7f747806d9c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f748c15b8f0 0x7f748c15e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f748c0cf340 0x7f748c15dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 --2- 172.21.15.172:0/3643973916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f748c0b3af0 0x7f748c0ce6c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 -- 172.21.15.172:0/3643973916 >> 172.21.15.172:0/3643973916 conn(0x7f748c0d1800 msgr2=0x7f748c0d1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 -- 172.21.15.172:0/3643973916 shutdown_connections 2024-04-25T08:42:25.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.284+0000 7f7491a6f640 1 -- 172.21.15.172:0/3643973916 wait complete. 2024-04-25T08:42:25.288 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:25.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.392+0000 7fbbaeeb3640 1 Processor -- start 2024-04-25T08:42:25.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.392+0000 7fbbaeeb3640 1 -- start start 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbbaeeb3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbba815db70 0x7fbba8162150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbbaeeb3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbba80b6cb0 0x7fbba80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbbaeeb3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba8162690 con 0x7fbba80b5a60 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbbaeeb3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba80d3800 con 0x7fbba80b6cb0 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbbaeeb3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba80ceee0 con 0x7fbba815db70 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbba7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbba80b6cb0 0x7fbba80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbbad450640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbba80b5a60 0x7fbba806c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59746/0 (socket says 172.21.15.172:59746) 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbbad450640 1 -- 172.21.15.172:0/1514629622 learned_addr learned my addr 172.21.15.172:0/1514629622 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbbacc4f640 1 --2- 172.21.15.172:0/1514629622 >> v2:172.21.15.186:3300/0 conn(0x7fbba815db70 0x7fbba8162150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbba7fff640 1 -- 172.21.15.172:0/1514629622 >> v2:172.21.15.186:3300/0 conn(0x7fbba815db70 msgr2=0x7fbba8162150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:25.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbba7fff640 1 --2- 172.21.15.172:0/1514629622 >> v2:172.21.15.186:3300/0 conn(0x7fbba815db70 0x7fbba8162150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbba7fff640 1 -- 172.21.15.172:0/1514629622 >> v1:172.21.15.172:6789/0 conn(0x7fbba80b5a60 legacy=0x7fbba806c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbba77fe640 1 -- 172.21.15.172:0/1514629622 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291334715 0 0) 0x7fbba8162690 con 0x7fbba80b5a60 2024-04-25T08:42:25.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbba7fff640 1 -- 172.21.15.172:0/1514629622 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba80d1d10 con 0x7fbba80b6cb0 2024-04-25T08:42:25.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.393+0000 7fbbacc4f640 1 --2- 172.21.15.172:0/1514629622 >> v2:172.21.15.186:3300/0 conn(0x7fbba815db70 0x7fbba8162150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.394+0000 7fbba7fff640 1 --2- 172.21.15.172:0/1514629622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 0x7fbba80b5520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbba80d3980 tx=0x7fbb9402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb27c757f4a89d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.394+0000 7fbba77fe640 1 -- 172.21.15.172:0/1514629622 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94037070 con 0x7fbba80b6cb0 2024-04-25T08:42:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.394+0000 7fbba77fe640 1 -- 172.21.15.172:0/1514629622 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb94032440 con 0x7fbba80b6cb0 2024-04-25T08:42:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.394+0000 7fbba77fe640 1 -- 172.21.15.172:0/1514629622 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9402ae60 con 0x7fbba80b6cb0 2024-04-25T08:42:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.394+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/1514629622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 msgr2=0x7fbba80b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.394+0000 7fbbaeeb3640 1 --2- 172.21.15.172:0/1514629622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 0x7fbba80b5520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbba80d3980 tx=0x7fbb9402a110 comp rx=0 tx=0).stop 2024-04-25T08:42:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.395+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/1514629622 shutdown_connections 2024-04-25T08:42:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.395+0000 7fbbaeeb3640 1 --2- 172.21.15.172:0/1514629622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 0x7fbba80b5520 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.395+0000 7fbbaeeb3640 1 --2- 172.21.15.172:0/1514629622 >> v2:172.21.15.186:3300/0 conn(0x7fbba815db70 0x7fbba8162150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.395+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/1514629622 >> 172.21.15.172:0/1514629622 conn(0x7fbba80d0520 msgr2=0x7fbba80d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:25.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.395+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/1514629622 shutdown_connections 2024-04-25T08:42:25.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.395+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/1514629622 wait complete. 2024-04-25T08:42:25.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.396+0000 7fbbaeeb3640 1 Processor -- start 2024-04-25T08:42:25.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.396+0000 7fbbaeeb3640 1 -- start start 2024-04-25T08:42:25.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbaeeb3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbba80b5a60 0x7fbba80c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbaeeb3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 0x7fbba8159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbaeeb3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbba815db70 0x7fbba815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbaeeb3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba815df50 con 0x7fbba80b6cb0 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbaeeb3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80d22d0 con 0x7fbba80b5a60 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbaeeb3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80ce530 con 0x7fbba815db70 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 0x7fbba8159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 0x7fbba8159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42634/0 (socket says 172.21.15.172:42634) 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba7fff640 1 -- 172.21.15.172:0/2728668801 learned_addr learned my addr 172.21.15.172:0/2728668801 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbacc4f640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbba80b5a60 0x7fbba80c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbad450640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbba815db70 0x7fbba815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba7fff640 1 -- 172.21.15.172:0/2728668801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbba815db70 msgr2=0x7fbba815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba7fff640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbba815db70 0x7fbba815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba7fff640 1 -- 172.21.15.172:0/2728668801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbba80b5a60 msgr2=0x7fbba80c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba7fff640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbba80b5a60 0x7fbba80c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba7fff640 1 -- 172.21.15.172:0/2728668801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba80c9b90 con 0x7fbba80b6cb0 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbacc4f640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbba80b5a60 0x7fbba80c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbad450640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbba815db70 0x7fbba815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba7fff640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 0x7fbba8159160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb94000c00 tx=0x7fbb940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba57fa640 1 -- 172.21.15.172:0/2728668801 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94037040 con 0x7fbba80b6cb0 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba57fa640 1 -- 172.21.15.172:0/2728668801 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb94042070 con 0x7fbba80b6cb0 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/2728668801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba81580c0 con 0x7fbba80b6cb0 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbba57fa640 1 -- 172.21.15.172:0/2728668801 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94030a50 con 0x7fbba80b6cb0 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.397+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/2728668801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba8158680 con 0x7fbba80b6cb0 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.398+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/2728668801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba80ce830 con 0x7fbba80b6cb0 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.399+0000 7fbba57fa640 1 -- 172.21.15.172:0/2728668801 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb94030bf0 con 0x7fbba80b6cb0 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.399+0000 7fbba57fa640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb8c06b4d0 0x7fbb8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.399+0000 7fbba57fa640 1 -- 172.21.15.172:0/2728668801 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb940aa8b0 con 0x7fbba80b6cb0 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.399+0000 7fbbacc4f640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb8c06b4d0 0x7fbb8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.399+0000 7fbbacc4f640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb8c06b4d0 0x7fbb8c06d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c006fd0 tx=0x7fbb9c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.403+0000 7fbba57fa640 1 -- 172.21.15.172:0/2728668801 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbba80ce830 con 0x7fbba80b6cb0 2024-04-25T08:42:25.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.576+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/2728668801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbba80ce180 con 0x7fbba80b6cb0 2024-04-25T08:42:25.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.576+0000 7fbba57fa640 1 -- 172.21.15.172:0/2728668801 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12944 (secure 0 0 0) 0x7fbb94079c30 con 0x7fbba80b6cb0 2024-04-25T08:42:25.569 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:25.569 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":16,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:18.561383+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:25.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/2728668801 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb8c06b4d0 msgr2=0x7fbb8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb8c06b4d0 0x7fbb8c06d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c006fd0 tx=0x7fbb9c008040 comp rx=0 tx=0).stop 2024-04-25T08:42:25.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/2728668801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 msgr2=0x7fbba8159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 0x7fbba8159160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb94000c00 tx=0x7fbb940046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/2728668801 shutdown_connections 2024-04-25T08:42:25.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb8c06b4d0 0x7fbb8c06d990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbba815db70 0x7fbba815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba80b6cb0 0x7fbba8159160 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 --2- 172.21.15.172:0/2728668801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbba80b5a60 0x7fbba80c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/2728668801 >> 172.21.15.172:0/2728668801 conn(0x7fbba80d0520 msgr2=0x7fbba815ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:25.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/2728668801 shutdown_connections 2024-04-25T08:42:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.579+0000 7fbbaeeb3640 1 -- 172.21.15.172:0/2728668801 wait complete. 2024-04-25T08:42:25.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:42:25.583 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:42:25.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.692+0000 7f0bfb942640 1 Processor -- start 2024-04-25T08:42:25.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.692+0000 7f0bfb942640 1 -- start start 2024-04-25T08:42:25.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.692+0000 7f0bfb942640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0bf415dc20 0x7f0bf40d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.692+0000 7f0bfb942640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0bf40d1ce0 0x7f0bf40b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.692+0000 7f0bfb942640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf40d2120 con 0x7f0bf40ce670 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.692+0000 7f0bfb942640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf40d23a0 con 0x7f0bf40d1ce0 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.692+0000 7f0bfb942640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf40d2680 con 0x7f0bf415dc20 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.693+0000 7f0bf8edd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0bf40d1ce0 0x7f0bf40b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.693+0000 7f0bf8edd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0bf40d1ce0 0x7f0bf40b9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42650/0 (socket says 172.21.15.172:42650) 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.693+0000 7f0bf8edd640 1 -- 172.21.15.172:0/1411820833 learned_addr learned my addr 172.21.15.172:0/1411820833 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.693+0000 7f0bf96de640 1 --2- 172.21.15.172:0/1411820833 >> v2:172.21.15.186:3300/0 conn(0x7f0bf415dc20 0x7f0bf40d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.693+0000 7f0bf8edd640 1 -- 172.21.15.172:0/1411820833 >> v2:172.21.15.186:3300/0 conn(0x7f0bf415dc20 msgr2=0x7f0bf40d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.693+0000 7f0bf8edd640 1 --2- 172.21.15.172:0/1411820833 >> v2:172.21.15.186:3300/0 conn(0x7f0bf415dc20 0x7f0bf40d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.693+0000 7f0bf8edd640 1 -- 172.21.15.172:0/1411820833 >> v1:172.21.15.186:6789/0 conn(0x7f0bf40ce670 legacy=0x7f0bf40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.693+0000 7f0bf8edd640 1 -- 172.21.15.172:0/1411820833 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf40d2960 con 0x7f0bf40d1ce0 2024-04-25T08:42:25.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.693+0000 7f0bf96de640 1 --2- 172.21.15.172:0/1411820833 >> v2:172.21.15.186:3300/0 conn(0x7f0bf415dc20 0x7f0bf40d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:25.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bf8edd640 1 --2- 172.21.15.172:0/1411820833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf40d1ce0 0x7f0bf40b9490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40d1500 tx=0x7f0be402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d048a3a3e0bf9f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bebfff640 1 -- 172.21.15.172:0/1411820833 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4037070 con 0x7f0bf40d1ce0 2024-04-25T08:42:25.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bebfff640 1 -- 172.21.15.172:0/1411820833 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be4032440 con 0x7f0bf40d1ce0 2024-04-25T08:42:25.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bebfff640 1 -- 172.21.15.172:0/1411820833 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4032810 con 0x7f0bf40d1ce0 2024-04-25T08:42:25.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bfb942640 1 -- 172.21.15.172:0/1411820833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf40d1ce0 msgr2=0x7f0bf40b9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bfb942640 1 --2- 172.21.15.172:0/1411820833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf40d1ce0 0x7f0bf40b9490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40d1500 tx=0x7f0be402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bfb942640 1 -- 172.21.15.172:0/1411820833 shutdown_connections 2024-04-25T08:42:25.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bfb942640 1 --2- 172.21.15.172:0/1411820833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf40d1ce0 0x7f0bf40b9490 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bfb942640 1 --2- 172.21.15.172:0/1411820833 >> v2:172.21.15.186:3300/0 conn(0x7f0bf415dc20 0x7f0bf40d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bfb942640 1 -- 172.21.15.172:0/1411820833 >> 172.21.15.172:0/1411820833 conn(0x7f0bf4061a20 msgr2=0x7f0bf4061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:25.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bfb942640 1 -- 172.21.15.172:0/1411820833 shutdown_connections 2024-04-25T08:42:25.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.694+0000 7f0bfb942640 1 -- 172.21.15.172:0/1411820833 wait complete. 2024-04-25T08:42:25.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.695+0000 7f0bfb942640 1 Processor -- start 2024-04-25T08:42:25.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.696+0000 7f0bfb942640 1 -- start start 2024-04-25T08:42:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.696+0000 7f0bfb942640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bf40ce670 0x7f0bf41e6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.696+0000 7f0bfb942640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf40d1ce0 0x7f0bf41f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.696+0000 7f0bfb942640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf415dc20 0x7f0bf414c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.696+0000 7f0bfb942640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40b6a30 con 0x7f0bf415dc20 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.696+0000 7f0bfb942640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40d2f20 con 0x7f0bf40d1ce0 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.696+0000 7f0bfb942640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40b6bb0 con 0x7f0bf40ce670 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.696+0000 7f0bf9edf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf415dc20 0x7f0bf414c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.696+0000 7f0bf9edf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf415dc20 0x7f0bf414c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42652/0 (socket says 172.21.15.172:42652) 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.696+0000 7f0bf9edf640 1 -- 172.21.15.172:0/2338538092 learned_addr learned my addr 172.21.15.172:0/2338538092 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0bf8edd640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf40d1ce0 0x7f0bf41f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0bf9edf640 1 -- 172.21.15.172:0/2338538092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bf40ce670 msgr2=0x7f0bf41e6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0bf9edf640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bf40ce670 0x7f0bf41e6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0bf9edf640 1 -- 172.21.15.172:0/2338538092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf40d1ce0 msgr2=0x7f0bf41f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0bf9edf640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf40d1ce0 0x7f0bf41f3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0bf9edf640 1 -- 172.21.15.172:0/2338538092 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf40cd9a0 con 0x7f0bf415dc20 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0bf9edf640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf415dc20 0x7f0bf414c600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c410 tx=0x7f0bec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0be9ffb640 1 -- 172.21.15.172:0/2338538092 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec011790 con 0x7f0bf415dc20 2024-04-25T08:42:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0be9ffb640 1 -- 172.21.15.172:0/2338538092 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec017070 con 0x7f0bf415dc20 2024-04-25T08:42:25.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0bfb942640 1 -- 172.21.15.172:0/2338538092 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf414a570 con 0x7f0bf415dc20 2024-04-25T08:42:25.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0be9ffb640 1 -- 172.21.15.172:0/2338538092 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec011bb0 con 0x7f0bf415dc20 2024-04-25T08:42:25.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.697+0000 7f0bfb942640 1 -- 172.21.15.172:0/2338538092 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf414ab30 con 0x7f0bf415dc20 2024-04-25T08:42:25.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.698+0000 7f0bfb942640 1 -- 172.21.15.172:0/2338538092 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf4073a00 con 0x7f0bf415dc20 2024-04-25T08:42:25.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.698+0000 7f0be9ffb640 1 -- 172.21.15.172:0/2338538092 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0bec01c460 con 0x7f0bf415dc20 2024-04-25T08:42:25.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.699+0000 7f0be9ffb640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bd806b4d0 0x7f0bd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.699+0000 7f0be9ffb640 1 -- 172.21.15.172:0/2338538092 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0bec089b20 con 0x7f0bf415dc20 2024-04-25T08:42:25.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.699+0000 7f0bf96de640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bd806b4d0 0x7f0bd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.699+0000 7f0bf96de640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bd806b4d0 0x7f0bd806d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0008e00 tx=0x7f0bf0008330 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.703+0000 7f0be9ffb640 1 -- 172.21.15.172:0/2338538092 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0bec021020 con 0x7f0bf415dc20 2024-04-25T08:42:25.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.871+0000 7f0bfb942640 1 -- 172.21.15.172:0/2338538092 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0bf4061fa0 con 0x7f0bf415dc20 2024-04-25T08:42:25.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.872+0000 7f0be9ffb640 1 -- 172.21.15.172:0/2338538092 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0bec058cf0 con 0x7f0bf415dc20 2024-04-25T08:42:25.864 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 -- 172.21.15.172:0/2338538092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bd806b4d0 msgr2=0x7f0bd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bd806b4d0 0x7f0bd806d990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0008e00 tx=0x7f0bf0008330 comp rx=0 tx=0).stop 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 -- 172.21.15.172:0/2338538092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf415dc20 msgr2=0x7f0bf414c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf415dc20 0x7f0bf414c600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c410 tx=0x7f0bec00c8d0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 -- 172.21.15.172:0/2338538092 shutdown_connections 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bd806b4d0 0x7f0bd806d990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bf40d1ce0 0x7f0bf41f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf415dc20 0x7f0bf414c600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 --2- 172.21.15.172:0/2338538092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bf40ce670 0x7f0bf41e6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 -- 172.21.15.172:0/2338538092 >> 172.21.15.172:0/2338538092 conn(0x7f0bf4061a20 msgr2=0x7f0bf40b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 -- 172.21.15.172:0/2338538092 shutdown_connections 2024-04-25T08:42:25.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.874+0000 7f0bfb942640 1 -- 172.21.15.172:0/2338538092 wait complete. 2024-04-25T08:42:25.877 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:42:25.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.982+0000 7efff8329640 1 Processor -- start 2024-04-25T08:42:25.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.982+0000 7efff8329640 1 -- start start 2024-04-25T08:42:25.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.983+0000 7efff8329640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015dce0 0x7efff00cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.983+0000 7efff8329640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7efff00af970 0x7efff00cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.983+0000 7efff8329640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff006abe0 con 0x7efff006e410 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.983+0000 7efff8329640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff006b4f0 con 0x7efff00af970 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.983+0000 7efff8329640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff00d0380 con 0x7efff015dce0 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.983+0000 7efff68c6640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efff006e410 0x7efff006e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59760/0 (socket says 172.21.15.172:59760) 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.983+0000 7efff68c6640 1 -- 172.21.15.172:0/2299377315 learned_addr learned my addr 172.21.15.172:0/2299377315 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812451929 0 0) 0x7efff006abe0 con 0x7efff006e410 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effdc003520 con 0x7efff006e410 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff58c4640 1 --2- 172.21.15.172:0/2299377315 >> v2:172.21.15.186:3300/0 conn(0x7efff00af970 0x7efff00cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff60c5640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015dce0 0x7efff00cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1506039698 0 0) 0x7effdc003520 con 0x7efff006e410 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015dce0 msgr2=0x7efff00cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015dce0 0x7efff00cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 >> v2:172.21.15.186:3300/0 conn(0x7efff00af970 msgr2=0x7efff00cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 --2- 172.21.15.172:0/2299377315 >> v2:172.21.15.186:3300/0 conn(0x7efff00af970 0x7efff00cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00cdf80 con 0x7efff006e410 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7effe8001670 con 0x7efff006e410 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff60c5640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015dce0 0x7efff00cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 >> v1:172.21.15.172:6789/0 conn(0x7efff006e410 legacy=0x7efff006e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 0x7effdc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effdc004800 0x7effdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015dce0 0x7effdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff006b4f0 con 0x7effdc0039b0 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00d0380 con 0x7effdc004800 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effdc00b9c0 con 0x7efff015dce0 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff60c5640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 0x7effdc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff58c4640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effdc004800 0x7effdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff68c6640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015dce0 0x7effdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff60c5640 1 -- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015dce0 msgr2=0x7effdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff60c5640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015dce0 0x7effdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff60c5640 1 -- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effdc004800 msgr2=0x7effdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff60c5640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effdc004800 0x7effdc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.984+0000 7efff60c5640 1 -- 172.21.15.172:0/2299377315 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc003520 con 0x7effdc0039b0 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.985+0000 7efff60c5640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 0x7effdc003dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effec007410 tx=0x7effdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c759021c2d7c81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.985+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec009c80 con 0x7effdc0039b0 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.985+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec02c650 con 0x7effdc0039b0 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.985+0000 7efff50c3640 1 -- 172.21.15.172:0/2299377315 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec02ca00 con 0x7effdc0039b0 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.986+0000 7efff8329640 1 -- 172.21.15.172:0/2299377315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 msgr2=0x7effdc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.986+0000 7efff8329640 1 --2- 172.21.15.172:0/2299377315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 0x7effdc003dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effec007410 tx=0x7effdc005830 comp rx=0 tx=0).stop 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.986+0000 7efff68c6640 1 -- 172.21.15.172:0/2299377315 reap_dead start 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.986+0000 7efff8329640 1 -- 172.21.15.172:0/2299377315 shutdown_connections 2024-04-25T08:42:25.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.986+0000 7efff8329640 1 -- 172.21.15.172:0/2299377315 >> 172.21.15.172:0/2299377315 conn(0x7efff00b2290 msgr2=0x7efff00b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:25.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.986+0000 7efff8329640 1 -- 172.21.15.172:0/2299377315 shutdown_connections 2024-04-25T08:42:25.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.986+0000 7efff8329640 1 -- 172.21.15.172:0/2299377315 wait complete. 2024-04-25T08:42:25.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.987+0000 7efff8329640 1 Processor -- start 2024-04-25T08:42:25.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.987+0000 7efff8329640 1 -- start start 2024-04-25T08:42:25.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff8329640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 0x7efff0152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff8329640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff00c6b00 0x7efff00c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff8329640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015ffb0 0x7efff0160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff8329640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff006b180 con 0x7effdc0039b0 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff8329640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff006aea0 con 0x7efff00c6b00 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff8329640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff006b980 con 0x7efff015ffb0 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff60c5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 0x7efff0152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff60c5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 0x7efff0152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42676/0 (socket says 172.21.15.172:42676) 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff60c5640 1 -- 172.21.15.172:0/3563294190 learned_addr learned my addr 172.21.15.172:0/3563294190 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff58c4640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff00c6b00 0x7efff00c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff68c6640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015ffb0 0x7efff0160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff60c5640 1 -- 172.21.15.172:0/3563294190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015ffb0 msgr2=0x7efff0160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff60c5640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015ffb0 0x7efff0160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff60c5640 1 -- 172.21.15.172:0/3563294190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff00c6b00 msgr2=0x7efff00c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff60c5640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff00c6b00 0x7efff00c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff60c5640 1 -- 172.21.15.172:0/3563294190 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff015e240 con 0x7effdc0039b0 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff60c5640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 0x7efff0152b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7effec02b130 tx=0x7effec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7effe6ffd640 1 -- 172.21.15.172:0/3563294190 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec009c80 con 0x7effdc0039b0 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7effe6ffd640 1 -- 172.21.15.172:0/3563294190 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec02d9f0 con 0x7effdc0039b0 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff8329640 1 -- 172.21.15.172:0/3563294190 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff015e520 con 0x7effdc0039b0 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7effe6ffd640 1 -- 172.21.15.172:0/3563294190 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec02dde0 con 0x7effdc0039b0 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.988+0000 7efff8329640 1 -- 172.21.15.172:0/3563294190 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff015eae0 con 0x7effdc0039b0 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.989+0000 7efff8329640 1 -- 172.21.15.172:0/3563294190 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff0073990 con 0x7effdc0039b0 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.990+0000 7effe6ffd640 1 -- 172.21.15.172:0/3563294190 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effec049400 con 0x7effdc0039b0 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.990+0000 7effe6ffd640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd406b500 0x7effd406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.990+0000 7effe6ffd640 1 -- 172.21.15.172:0/3563294190 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7effec0aac00 con 0x7effdc0039b0 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.990+0000 7efff58c4640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd406b500 0x7effd406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.991+0000 7efff58c4640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd406b500 0x7effd406d9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efff01f7b00 tx=0x7effe0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:25.994+0000 7effe6ffd640 1 -- 172.21.15.172:0/3563294190 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7effec0b0020 con 0x7effdc0039b0 2024-04-25T08:42:26.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.168+0000 7efff8329640 1 -- 172.21.15.172:0/3563294190 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efff006f5b0 con 0x7effdc0039b0 2024-04-25T08:42:26.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.169+0000 7effe6ffd640 1 -- 172.21.15.172:0/3563294190 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7effec04e020 con 0x7effdc0039b0 2024-04-25T08:42:26.161 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:26.162 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:42:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:42:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2024-04-25T08:42:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2024-04-25T08:42:26.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:42:26.162 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:42:26.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 -- 172.21.15.172:0/3563294190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd406b500 msgr2=0x7effd406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd406b500 0x7effd406d9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efff01f7b00 tx=0x7effe0008040 comp rx=0 tx=0).stop 2024-04-25T08:42:26.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 -- 172.21.15.172:0/3563294190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 msgr2=0x7efff0152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 0x7efff0152b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7effec02b130 tx=0x7effec004ab0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 -- 172.21.15.172:0/3563294190 shutdown_connections 2024-04-25T08:42:26.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd406b500 0x7effd406d9c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff00c6b00 0x7efff00c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff015ffb0 0x7efff0160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 --2- 172.21.15.172:0/3563294190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effdc0039b0 0x7efff0152b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 -- 172.21.15.172:0/3563294190 >> 172.21.15.172:0/3563294190 conn(0x7efff00b2290 msgr2=0x7efff00b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:26.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 -- 172.21.15.172:0/3563294190 shutdown_connections 2024-04-25T08:42:26.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.171+0000 7efff8329640 1 -- 172.21.15.172:0/3563294190 wait complete. 2024-04-25T08:42:26.174 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:42:26.174 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:42:26.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.282+0000 7ff45c134640 1 Processor -- start 2024-04-25T08:42:26.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.282+0000 7ff45c134640 1 -- start start 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.282+0000 7ff45c134640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff45406e360 0x7ff45406e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff45c134640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45406ec80 0x7ff4540b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff45c134640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45415e020 con 0x7ff4540b3e10 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff45c134640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45406b890 con 0x7ff45406e360 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff45c134640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45406ac80 con 0x7ff45406ec80 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff459ed0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff45406e360 0x7ff45406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff4596cf640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45406ec80 0x7ff4540b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff459ed0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff45406e360 0x7ff45406e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:38780/0 (socket says 172.21.15.172:38780) 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff459ed0640 1 -- 172.21.15.172:0/3540023459 learned_addr learned my addr 172.21.15.172:0/3540023459 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff459ed0640 1 -- 172.21.15.172:0/3540023459 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45406ec80 msgr2=0x7ff4540b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff459ed0640 1 --2- 172.21.15.172:0/3540023459 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45406ec80 0x7ff4540b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff459ed0640 1 -- 172.21.15.172:0/3540023459 >> v1:172.21.15.186:6789/0 conn(0x7ff4540b3e10 legacy=0x7ff45406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.283+0000 7ff459ed0640 1 -- 172.21.15.172:0/3540023459 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45406af60 con 0x7ff45406e360 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.284+0000 7ff459ed0640 1 --2- 172.21.15.172:0/3540023459 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff45406e360 0x7ff45406e740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff444009870 tx=0x7ff44402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb94cb8afd2e587e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.284+0000 7ff458ece640 1 -- 172.21.15.172:0/3540023459 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444037070 con 0x7ff45406e360 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.284+0000 7ff458ece640 1 -- 172.21.15.172:0/3540023459 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44402ae50 con 0x7ff45406e360 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.284+0000 7ff458ece640 1 -- 172.21.15.172:0/3540023459 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444032860 con 0x7ff45406e360 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.285+0000 7ff45c134640 1 -- 172.21.15.172:0/3540023459 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff45406e360 msgr2=0x7ff45406e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.285+0000 7ff45c134640 1 --2- 172.21.15.172:0/3540023459 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff45406e360 0x7ff45406e740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff444009870 tx=0x7ff44402a300 comp rx=0 tx=0).stop 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.285+0000 7ff45c134640 1 -- 172.21.15.172:0/3540023459 shutdown_connections 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.285+0000 7ff45c134640 1 --2- 172.21.15.172:0/3540023459 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45406ec80 0x7ff4540b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.285+0000 7ff45c134640 1 --2- 172.21.15.172:0/3540023459 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff45406e360 0x7ff45406e740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.285+0000 7ff45c134640 1 -- 172.21.15.172:0/3540023459 >> 172.21.15.172:0/3540023459 conn(0x7ff4540cfec0 msgr2=0x7ff4540d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.285+0000 7ff45c134640 1 -- 172.21.15.172:0/3540023459 shutdown_connections 2024-04-25T08:42:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.285+0000 7ff45c134640 1 -- 172.21.15.172:0/3540023459 wait complete. 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.286+0000 7ff45c134640 1 Processor -- start 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.286+0000 7ff45c134640 1 -- start start 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff45c134640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45406e360 0x7ff4541f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff45c134640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff45406ec80 0x7ff4540af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff45c134640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4540b3e10 0x7ff4540afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff45c134640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540b2fd0 con 0x7ff45406ec80 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff45c134640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45406b520 con 0x7ff4540b3e10 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff45c134640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540b3150 con 0x7ff45406e360 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff4596cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff45406ec80 0x7ff4540af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff4596cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff45406ec80 0x7ff4540af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42682/0 (socket says 172.21.15.172:42682) 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff4596cf640 1 -- 172.21.15.172:0/3790871029 learned_addr learned my addr 172.21.15.172:0/3790871029 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:26.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff45a6d1640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4540b3e10 0x7ff4540afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff459ed0640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45406e360 0x7ff4541f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff4596cf640 1 -- 172.21.15.172:0/3790871029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45406e360 msgr2=0x7ff4541f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff4596cf640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45406e360 0x7ff4541f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff4596cf640 1 -- 172.21.15.172:0/3790871029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4540b3e10 msgr2=0x7ff4540afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff4596cf640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4540b3e10 0x7ff4540afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff4596cf640 1 -- 172.21.15.172:0/3790871029 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540b0440 con 0x7ff45406ec80 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff4596cf640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff45406ec80 0x7ff4540af860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff45000e9e0 tx=0x7ff45000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff44a7fc640 1 -- 172.21.15.172:0/3790871029 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450017070 con 0x7ff45406ec80 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff44a7fc640 1 -- 172.21.15.172:0/3790871029 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45000c9d0 con 0x7ff45406ec80 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff44a7fc640 1 -- 172.21.15.172:0/3790871029 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000cdc0 con 0x7ff45406ec80 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff45c134640 1 -- 172.21.15.172:0/3790871029 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4540b0720 con 0x7ff45406ec80 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.287+0000 7ff45c134640 1 -- 172.21.15.172:0/3790871029 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4540c58b0 con 0x7ff45406ec80 2024-04-25T08:42:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.288+0000 7ff45c134640 1 -- 172.21.15.172:0/3790871029 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff454073a00 con 0x7ff45406ec80 2024-04-25T08:42:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.289+0000 7ff44a7fc640 1 -- 172.21.15.172:0/3790871029 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff45001a070 con 0x7ff45406ec80 2024-04-25T08:42:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.289+0000 7ff44a7fc640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff43806b4d0 0x7ff43806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.289+0000 7ff459ed0640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff43806b4d0 0x7ff43806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.289+0000 7ff44a7fc640 1 -- 172.21.15.172:0/3790871029 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff45008a1b0 con 0x7ff45406ec80 2024-04-25T08:42:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.290+0000 7ff459ed0640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff43806b4d0 0x7ff43806d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff444034000 tx=0x7ff44402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:26.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.294+0000 7ff44a7fc640 1 -- 172.21.15.172:0/3790871029 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff450058dc0 con 0x7ff45406ec80 2024-04-25T08:42:26.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.465+0000 7ff45c134640 1 -- 172.21.15.172:0/3790871029 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff45415b400 con 0x7ff45406ec80 2024-04-25T08:42:26.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.642+0000 7ff44a7fc640 1 -- 172.21.15.172:0/3790871029 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff45005ce60 con 0x7ff45406ec80 2024-04-25T08:42:26.635 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2024-04-25T08:42:26.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.644+0000 7ff45c134640 1 -- 172.21.15.172:0/3790871029 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff43806b4d0 msgr2=0x7ff43806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.644+0000 7ff45c134640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff43806b4d0 0x7ff43806d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff444034000 tx=0x7ff44402e000 comp rx=0 tx=0).stop 2024-04-25T08:42:26.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.644+0000 7ff45c134640 1 -- 172.21.15.172:0/3790871029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff45406ec80 msgr2=0x7ff4540af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.644+0000 7ff45c134640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff45406ec80 0x7ff4540af860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff45000e9e0 tx=0x7ff45000eea0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.644+0000 7ff45c134640 1 -- 172.21.15.172:0/3790871029 shutdown_connections 2024-04-25T08:42:26.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.644+0000 7ff45c134640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff43806b4d0 0x7ff43806d990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.644+0000 7ff45c134640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4540b3e10 0x7ff4540afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.644+0000 7ff45c134640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff45406ec80 0x7ff4540af860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.644+0000 7ff45c134640 1 --2- 172.21.15.172:0/3790871029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45406e360 0x7ff4541f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.644+0000 7ff45c134640 1 -- 172.21.15.172:0/3790871029 >> 172.21.15.172:0/3790871029 conn(0x7ff4540cfec0 msgr2=0x7ff45415aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:26.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.645+0000 7ff45c134640 1 -- 172.21.15.172:0/3790871029 shutdown_connections 2024-04-25T08:42:26.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.645+0000 7ff45c134640 1 -- 172.21.15.172:0/3790871029 wait complete. 2024-04-25T08:42:26.651 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T08:42:26.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.763+0000 7ff93784d640 1 Processor -- start 2024-04-25T08:42:26.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.763+0000 7ff93784d640 1 -- start start 2024-04-25T08:42:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.764+0000 7ff93784d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9300d34c0 0x7ff9300d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.764+0000 7ff93784d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9300d2420 con 0x7ff9300d08e0 2024-04-25T08:42:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.764+0000 7ff93784d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9300d2700 con 0x7ff93015dac0 2024-04-25T08:42:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.764+0000 7ff93784d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300d0d50 con 0x7ff9300d34c0 2024-04-25T08:42:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.764+0000 7ff934de8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9300d34c0 0x7ff9300d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.764+0000 7ff935dea640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff9300d08e0 0x7ff9300b6990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59766/0 (socket says 172.21.15.172:59766) 2024-04-25T08:42:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.764+0000 7ff935dea640 1 -- 172.21.15.172:0/1184815160 learned_addr learned my addr 172.21.15.172:0/1184815160 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.765+0000 7ff934de8640 1 -- 172.21.15.172:0/1184815160 >> v1:172.21.15.186:6789/0 conn(0x7ff93015dac0 legacy=0x7ff9300d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.765+0000 7ff934de8640 1 -- 172.21.15.172:0/1184815160 >> v1:172.21.15.172:6789/0 conn(0x7ff9300d08e0 legacy=0x7ff9300b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.765+0000 7ff927fff640 1 -- 172.21.15.172:0/1184815160 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976389040 0 0) 0x7ff9300d2420 con 0x7ff9300d08e0 2024-04-25T08:42:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.765+0000 7ff934de8640 1 -- 172.21.15.172:0/1184815160 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9300d29e0 con 0x7ff9300d34c0 2024-04-25T08:42:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.765+0000 7ff934de8640 1 --2- 172.21.15.172:0/1184815160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d34c0 0x7ff9300d03a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff920009790 tx=0x7ff92002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f59f80eba0dc74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.765+0000 7ff927fff640 1 -- 172.21.15.172:0/1184815160 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920037070 con 0x7ff9300d34c0 2024-04-25T08:42:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.765+0000 7ff927fff640 1 -- 172.21.15.172:0/1184815160 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920032440 con 0x7ff9300d34c0 2024-04-25T08:42:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.765+0000 7ff927fff640 1 -- 172.21.15.172:0/1184815160 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920032810 con 0x7ff9300d34c0 2024-04-25T08:42:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.766+0000 7ff93784d640 1 -- 172.21.15.172:0/1184815160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d34c0 msgr2=0x7ff9300d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.766+0000 7ff93784d640 1 --2- 172.21.15.172:0/1184815160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d34c0 0x7ff9300d03a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff920009790 tx=0x7ff92002a2a0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.766+0000 7ff93784d640 1 -- 172.21.15.172:0/1184815160 shutdown_connections 2024-04-25T08:42:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.766+0000 7ff93784d640 1 --2- 172.21.15.172:0/1184815160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d34c0 0x7ff9300d03a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.766+0000 7ff93784d640 1 -- 172.21.15.172:0/1184815160 >> 172.21.15.172:0/1184815160 conn(0x7ff930061c30 msgr2=0x7ff93006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.766+0000 7ff93784d640 1 -- 172.21.15.172:0/1184815160 shutdown_connections 2024-04-25T08:42:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.766+0000 7ff93784d640 1 -- 172.21.15.172:0/1184815160 wait complete. 2024-04-25T08:42:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.767+0000 7ff93784d640 1 Processor -- start 2024-04-25T08:42:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.767+0000 7ff93784d640 1 -- start start 2024-04-25T08:42:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff93784d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d08e0 0x7ff9301609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff93784d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9300d34c0 0x7ff9300c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff93784d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff93015dac0 0x7ff9300c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff93784d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300d2100 con 0x7ff9300d08e0 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff93784d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300d3030 con 0x7ff93015dac0 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff93784d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93015dea0 con 0x7ff9300d34c0 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff9355e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d08e0 0x7ff9301609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff9355e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d08e0 0x7ff9301609d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42698/0 (socket says 172.21.15.172:42698) 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff9355e9640 1 -- 172.21.15.172:0/4156096485 learned_addr learned my addr 172.21.15.172:0/4156096485 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff934de8640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9300d34c0 0x7ff9300c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff935dea640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff93015dac0 0x7ff9300c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff9355e9640 1 -- 172.21.15.172:0/4156096485 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9300d34c0 msgr2=0x7ff9300c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff9355e9640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9300d34c0 0x7ff9300c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff9355e9640 1 -- 172.21.15.172:0/4156096485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff93015dac0 msgr2=0x7ff9300c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff9355e9640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff93015dac0 0x7ff9300c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.768+0000 7ff9355e9640 1 -- 172.21.15.172:0/4156096485 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93015fc10 con 0x7ff9300d08e0 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.769+0000 7ff9355e9640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d08e0 0x7ff9301609d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00c400 tx=0x7ff92c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.769+0000 7ff925ffb640 1 -- 172.21.15.172:0/4156096485 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c017070 con 0x7ff9300d08e0 2024-04-25T08:42:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.769+0000 7ff925ffb640 1 -- 172.21.15.172:0/4156096485 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c0052d0 con 0x7ff9300d08e0 2024-04-25T08:42:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.769+0000 7ff93784d640 1 -- 172.21.15.172:0/4156096485 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93015fef0 con 0x7ff9300d08e0 2024-04-25T08:42:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.769+0000 7ff925ffb640 1 -- 172.21.15.172:0/4156096485 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c003830 con 0x7ff9300d08e0 2024-04-25T08:42:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.769+0000 7ff93784d640 1 -- 172.21.15.172:0/4156096485 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff930160f10 con 0x7ff9300d08e0 2024-04-25T08:42:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.770+0000 7ff93784d640 1 -- 172.21.15.172:0/4156096485 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff930073a00 con 0x7ff9300d08e0 2024-04-25T08:42:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.770+0000 7ff925ffb640 1 -- 172.21.15.172:0/4156096485 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff92c01a070 con 0x7ff9300d08e0 2024-04-25T08:42:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.770+0000 7ff925ffb640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff91406b4d0 0x7ff91406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.771+0000 7ff934de8640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff91406b4d0 0x7ff91406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:26.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.771+0000 7ff925ffb640 1 -- 172.21.15.172:0/4156096485 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff92c089410 con 0x7ff9300d08e0 2024-04-25T08:42:26.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.771+0000 7ff934de8640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff91406b4d0 0x7ff91406d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff920034000 tx=0x7ff92002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.775+0000 7ff925ffb640 1 -- 172.21.15.172:0/4156096485 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff92c0583e0 con 0x7ff9300d08e0 2024-04-25T08:42:26.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:26.946+0000 7ff93784d640 1 -- 172.21.15.172:0/4156096485 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7ff93015b1f0 con 0x7ff9300d08e0 2024-04-25T08:42:27.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.644+0000 7ff925ffb640 1 -- 172.21.15.172:0/4156096485 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7ff92c057ce0 con 0x7ff9300d08e0 2024-04-25T08:42:27.637 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2024-04-25T08:42:27.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.648+0000 7ff93784d640 1 -- 172.21.15.172:0/4156096485 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff91406b4d0 msgr2=0x7ff91406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:27.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.648+0000 7ff93784d640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff91406b4d0 0x7ff91406d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff920034000 tx=0x7ff92002e000 comp rx=0 tx=0).stop 2024-04-25T08:42:27.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.648+0000 7ff93784d640 1 -- 172.21.15.172:0/4156096485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d08e0 msgr2=0x7ff9301609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:27.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.648+0000 7ff93784d640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d08e0 0x7ff9301609d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00c400 tx=0x7ff92c00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:42:27.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.648+0000 7ff93784d640 1 -- 172.21.15.172:0/4156096485 shutdown_connections 2024-04-25T08:42:27.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.648+0000 7ff93784d640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff91406b4d0 0x7ff91406d990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:27.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.648+0000 7ff93784d640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff93015dac0 0x7ff9300c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:27.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.648+0000 7ff93784d640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9300d34c0 0x7ff9300c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:27.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.648+0000 7ff93784d640 1 --2- 172.21.15.172:0/4156096485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9300d08e0 0x7ff9301609d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:27.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.648+0000 7ff93784d640 1 -- 172.21.15.172:0/4156096485 >> 172.21.15.172:0/4156096485 conn(0x7ff930061c30 msgr2=0x7ff9300ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:27.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.649+0000 7ff93784d640 1 -- 172.21.15.172:0/4156096485 shutdown_connections 2024-04-25T08:42:27.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.650+0000 7ff93784d640 1 -- 172.21.15.172:0/4156096485 wait complete. 2024-04-25T08:42:27.670 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:42:27.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.781+0000 7fa55aca3640 1 Processor -- start 2024-04-25T08:42:27.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.782+0000 7fa55aca3640 1 -- start start 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.782+0000 7fa55aca3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5540cadb0 0x7fa5540cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.782+0000 7fa55aca3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa5540ccfe0 0x7fa5540cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.782+0000 7fa55aca3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5540afc80 con 0x7fa55415de80 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.782+0000 7fa55aca3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5540cb240 con 0x7fa5540cadb0 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.782+0000 7fa55aca3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5540ce4d0 con 0x7fa5540ccfe0 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.783+0000 7fa553fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5540cadb0 0x7fa5540cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.783+0000 7fa553fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5540cadb0 0x7fa5540cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41432/0 (socket says 172.21.15.172:41432) 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.783+0000 7fa553fff640 1 -- 172.21.15.172:0/1578447936 learned_addr learned my addr 172.21.15.172:0/1578447936 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.783+0000 7fa559240640 1 --2- 172.21.15.172:0/1578447936 >> v2:172.21.15.186:3300/0 conn(0x7fa5540ccfe0 0x7fa5540cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.783+0000 7fa553fff640 1 -- 172.21.15.172:0/1578447936 >> v2:172.21.15.186:3300/0 conn(0x7fa5540ccfe0 msgr2=0x7fa5540cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.783+0000 7fa553fff640 1 --2- 172.21.15.172:0/1578447936 >> v2:172.21.15.186:3300/0 conn(0x7fa5540ccfe0 0x7fa5540cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:27.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.783+0000 7fa553fff640 1 -- 172.21.15.172:0/1578447936 >> v1:172.21.15.186:6789/0 conn(0x7fa55415de80 legacy=0x7fa5540cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.783+0000 7fa553fff640 1 -- 172.21.15.172:0/1578447936 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5540ce7b0 con 0x7fa5540cadb0 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa553fff640 1 --2- 172.21.15.172:0/1578447936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 0x7fa5540cf6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa55406e2a0 tx=0x7fa54802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b77bafcf54c446e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa5537fe640 1 -- 172.21.15.172:0/1578447936 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548037070 con 0x7fa5540cadb0 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa5537fe640 1 -- 172.21.15.172:0/1578447936 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548032440 con 0x7fa5540cadb0 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa5537fe640 1 -- 172.21.15.172:0/1578447936 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548032810 con 0x7fa5540cadb0 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa55aca3640 1 -- 172.21.15.172:0/1578447936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 msgr2=0x7fa5540cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa55aca3640 1 --2- 172.21.15.172:0/1578447936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 0x7fa5540cf6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa55406e2a0 tx=0x7fa54802a230 comp rx=0 tx=0).stop 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa55aca3640 1 -- 172.21.15.172:0/1578447936 shutdown_connections 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa55aca3640 1 --2- 172.21.15.172:0/1578447936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 0x7fa5540cf6c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa55aca3640 1 --2- 172.21.15.172:0/1578447936 >> v2:172.21.15.186:3300/0 conn(0x7fa5540ccfe0 0x7fa5540cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:27.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa55aca3640 1 -- 172.21.15.172:0/1578447936 >> 172.21.15.172:0/1578447936 conn(0x7fa5540b2390 msgr2=0x7fa5540b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:27.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa55aca3640 1 -- 172.21.15.172:0/1578447936 shutdown_connections 2024-04-25T08:42:27.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.784+0000 7fa55aca3640 1 -- 172.21.15.172:0/1578447936 wait complete. 2024-04-25T08:42:27.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.785+0000 7fa55aca3640 1 Processor -- start 2024-04-25T08:42:27.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.785+0000 7fa55aca3640 1 -- start start 2024-04-25T08:42:27.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.786+0000 7fa55aca3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 0x7fa5540c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:27.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.786+0000 7fa55aca3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5540ccfe0 0x7fa55414f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:27.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.786+0000 7fa55aca3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa55415de80 0x7fa5540b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:27.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.786+0000 7fa55aca3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55415e260 con 0x7fa5540cadb0 2024-04-25T08:42:27.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.786+0000 7fa55aca3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540cfc00 con 0x7fa55415de80 2024-04-25T08:42:27.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.786+0000 7fa55aca3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540b2eb0 con 0x7fa5540ccfe0 2024-04-25T08:42:27.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.786+0000 7fa558a3f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 0x7fa5540c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:27.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.786+0000 7fa558a3f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 0x7fa5540c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41436/0 (socket says 172.21.15.172:41436) 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.786+0000 7fa558a3f640 1 -- 172.21.15.172:0/2005724203 learned_addr learned my addr 172.21.15.172:0/2005724203 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa559240640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa55415de80 0x7fa5540b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa558a3f640 1 -- 172.21.15.172:0/2005724203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5540ccfe0 msgr2=0x7fa55414f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa558a3f640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5540ccfe0 0x7fa55414f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa558a3f640 1 -- 172.21.15.172:0/2005724203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa55415de80 msgr2=0x7fa5540b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa558a3f640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa55415de80 0x7fa5540b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa558a3f640 1 -- 172.21.15.172:0/2005724203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5540b0730 con 0x7fa5540cadb0 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa559240640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa55415de80 0x7fa5540b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa558a3f640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 0x7fa5540c8560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa54400b3f0 tx=0x7fa54400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa5517fa640 1 -- 172.21.15.172:0/2005724203 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544015020 con 0x7fa5540cadb0 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa5517fa640 1 -- 172.21.15.172:0/2005724203 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa544011830 con 0x7fa5540cadb0 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa55aca3640 1 -- 172.21.15.172:0/2005724203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5540b0a10 con 0x7fa5540cadb0 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa5517fa640 1 -- 172.21.15.172:0/2005724203 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544011c20 con 0x7fa5540cadb0 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.787+0000 7fa55aca3640 1 -- 172.21.15.172:0/2005724203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5540b0fd0 con 0x7fa5540cadb0 2024-04-25T08:42:27.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.788+0000 7fa55aca3640 1 -- 172.21.15.172:0/2005724203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa554073a00 con 0x7fa5540cadb0 2024-04-25T08:42:27.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.788+0000 7fa5517fa640 1 -- 172.21.15.172:0/2005724203 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa544018020 con 0x7fa5540cadb0 2024-04-25T08:42:27.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.789+0000 7fa5517fa640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa54006b4d0 0x7fa54006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:27.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.789+0000 7fa5517fa640 1 -- 172.21.15.172:0/2005724203 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa544089e30 con 0x7fa5540cadb0 2024-04-25T08:42:27.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.789+0000 7fa553fff640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa54006b4d0 0x7fa54006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:27.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.789+0000 7fa553fff640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa54006b4d0 0x7fa54006d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa548034000 tx=0x7fa54802c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:27.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:27.793+0000 7fa5517fa640 1 -- 172.21.15.172:0/2005724203 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa54401f030 con 0x7fa5540cadb0 2024-04-25T08:42:27.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.001+0000 7fa55aca3640 1 -- 172.21.15.172:0/2005724203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa55415bf40 con 0x7fa5540cadb0 2024-04-25T08:42:28.546 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:42:28.549 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:42:28.661 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T08:42:28.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.668+0000 7fa5517fa640 1 -- 172.21.15.172:0/2005724203 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa5440172c0 con 0x7fa5540cadb0 2024-04-25T08:42:28.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.675+0000 7fa55aca3640 1 -- 172.21.15.172:0/2005724203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa54006b4d0 msgr2=0x7fa54006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:28.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.675+0000 7fa55aca3640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa54006b4d0 0x7fa54006d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa548034000 tx=0x7fa54802c000 comp rx=0 tx=0).stop 2024-04-25T08:42:28.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.675+0000 7fa55aca3640 1 -- 172.21.15.172:0/2005724203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 msgr2=0x7fa5540c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:28.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.675+0000 7fa55aca3640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 0x7fa5540c8560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa54400b3f0 tx=0x7fa54400b8b0 comp rx=0 tx=0).stop 2024-04-25T08:42:28.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.675+0000 7fa55aca3640 1 -- 172.21.15.172:0/2005724203 shutdown_connections 2024-04-25T08:42:28.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.675+0000 7fa55aca3640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa54006b4d0 0x7fa54006d990 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa548034000 tx=0x7fa54802c000 comp rx=0 tx=0).stop 2024-04-25T08:42:28.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.675+0000 7fa55aca3640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa55415de80 0x7fa5540b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:28.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.675+0000 7fa55aca3640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5540ccfe0 0x7fa55414f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:28.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.675+0000 7fa55aca3640 1 --2- 172.21.15.172:0/2005724203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5540cadb0 0x7fa5540c8560 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa54400b3f0 tx=0x7fa54400b8b0 comp rx=0 tx=0).stop 2024-04-25T08:42:28.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.675+0000 7fa55aca3640 1 -- 172.21.15.172:0/2005724203 >> 172.21.15.172:0/2005724203 conn(0x7fa5540b2390 msgr2=0x7fa55415c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:28.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.676+0000 7fa55aca3640 1 -- 172.21.15.172:0/2005724203 shutdown_connections 2024-04-25T08:42:28.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.677+0000 7fa55aca3640 1 -- 172.21.15.172:0/2005724203 wait complete. 2024-04-25T08:42:28.689 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T08:42:28.689 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T08:42:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.803+0000 7fc3cf170640 1 Processor -- start 2024-04-25T08:42:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.803+0000 7fc3cf170640 1 -- start start 2024-04-25T08:42:28.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.803+0000 7fc3cf170640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815ba80 0x7fc3c80cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:28.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.803+0000 7fc3cf170640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3c815c990 0x7fc3c80ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:28.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.803+0000 7fc3cf170640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c806fe50 con 0x7fc3c80cf080 2024-04-25T08:42:28.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.803+0000 7fc3cf170640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c8070130 con 0x7fc3c815c990 2024-04-25T08:42:28.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.803+0000 7fc3cf170640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80cc8b0 con 0x7fc3c815ba80 2024-04-25T08:42:28.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.804+0000 7fc3c7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3c815c990 0x7fc3c80ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:28.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.804+0000 7fc3c7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3c815c990 0x7fc3c80ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41444/0 (socket says 172.21.15.172:41444) 2024-04-25T08:42:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.804+0000 7fc3c7fff640 1 -- 172.21.15.172:0/1037593772 learned_addr learned my addr 172.21.15.172:0/1037593772 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.804+0000 7fc3ccf0c640 1 --2- 172.21.15.172:0/1037593772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815ba80 0x7fc3c80cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.804+0000 7fc3c7fff640 1 -- 172.21.15.172:0/1037593772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815ba80 msgr2=0x7fc3c80cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.804+0000 7fc3c7fff640 1 --2- 172.21.15.172:0/1037593772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815ba80 0x7fc3c80cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.804+0000 7fc3c7fff640 1 -- 172.21.15.172:0/1037593772 >> v1:172.21.15.186:6789/0 conn(0x7fc3c80cf080 legacy=0x7fc3c815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.804+0000 7fc3c7fff640 1 -- 172.21.15.172:0/1037593772 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80ccb90 con 0x7fc3c815c990 2024-04-25T08:42:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.804+0000 7fc3ccf0c640 1 --2- 172.21.15.172:0/1037593772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815ba80 0x7fc3c80cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3c7fff640 1 --2- 172.21.15.172:0/1037593772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c815c990 0x7fc3c80ceb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009870 tx=0x7fc3b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c85b9ecaccd6b03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3c77fe640 1 -- 172.21.15.172:0/1037593772 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4037070 con 0x7fc3c815c990 2024-04-25T08:42:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3c77fe640 1 -- 172.21.15.172:0/1037593772 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4032440 con 0x7fc3c815c990 2024-04-25T08:42:28.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3c77fe640 1 -- 172.21.15.172:0/1037593772 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4032810 con 0x7fc3c815c990 2024-04-25T08:42:28.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3cf170640 1 -- 172.21.15.172:0/1037593772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c815c990 msgr2=0x7fc3c80ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:28.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3cf170640 1 --2- 172.21.15.172:0/1037593772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c815c990 0x7fc3c80ceb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009870 tx=0x7fc3b402a270 comp rx=0 tx=0).stop 2024-04-25T08:42:28.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3cf170640 1 -- 172.21.15.172:0/1037593772 shutdown_connections 2024-04-25T08:42:28.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3cf170640 1 --2- 172.21.15.172:0/1037593772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c815c990 0x7fc3c80ceb40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:28.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3cf170640 1 --2- 172.21.15.172:0/1037593772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815ba80 0x7fc3c80cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:28.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3cf170640 1 -- 172.21.15.172:0/1037593772 >> 172.21.15.172:0/1037593772 conn(0x7fc3c806abe0 msgr2=0x7fc3c806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:28.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3cf170640 1 -- 172.21.15.172:0/1037593772 shutdown_connections 2024-04-25T08:42:28.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.805+0000 7fc3cf170640 1 -- 172.21.15.172:0/1037593772 wait complete. 2024-04-25T08:42:28.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.806+0000 7fc3cf170640 1 Processor -- start 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.806+0000 7fc3cf170640 1 -- start start 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.807+0000 7fc3cf170640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c80cf080 0x7fc3c80c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.807+0000 7fc3cf170640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3c815ba80 0x7fc3c80c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.807+0000 7fc3cf170640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815c990 0x7fc3c814d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.807+0000 7fc3cf170640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c815cdf0 con 0x7fc3c80cf080 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.807+0000 7fc3cf170640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80cf510 con 0x7fc3c815ba80 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.807+0000 7fc3cf170640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c806fb00 con 0x7fc3c815c990 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.807+0000 7fc3ccf0c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c80cf080 0x7fc3c80c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.807+0000 7fc3ccf0c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c80cf080 0x7fc3c80c4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41458/0 (socket says 172.21.15.172:41458) 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.807+0000 7fc3ccf0c640 1 -- 172.21.15.172:0/3606613818 learned_addr learned my addr 172.21.15.172:0/3606613818 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3c7fff640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3c815ba80 0x7fc3c80c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:28.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3cd70d640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815c990 0x7fc3c814d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3ccf0c640 1 -- 172.21.15.172:0/3606613818 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815c990 msgr2=0x7fc3c814d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3ccf0c640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815c990 0x7fc3c814d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3ccf0c640 1 -- 172.21.15.172:0/3606613818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3c815ba80 msgr2=0x7fc3c80c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3ccf0c640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3c815ba80 0x7fc3c80c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3ccf0c640 1 -- 172.21.15.172:0/3606613818 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c806dd40 con 0x7fc3c80cf080 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3ccf0c640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c80cf080 0x7fc3c80c4a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c820 tx=0x7fc3bc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3c57fa640 1 -- 172.21.15.172:0/3606613818 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc015070 con 0x7fc3c80cf080 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3c57fa640 1 -- 172.21.15.172:0/3606613818 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc007a30 con 0x7fc3c80cf080 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3c57fa640 1 -- 172.21.15.172:0/3606613818 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc007e00 con 0x7fc3c80cf080 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3cf170640 1 -- 172.21.15.172:0/3606613818 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c806e020 con 0x7fc3c80cf080 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.808+0000 7fc3cf170640 1 -- 172.21.15.172:0/3606613818 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c806e5e0 con 0x7fc3c80cf080 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.809+0000 7fc3cf170640 1 -- 172.21.15.172:0/3606613818 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c8073a00 con 0x7fc3c80cf080 2024-04-25T08:42:28.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.809+0000 7fc3c57fa640 1 -- 172.21.15.172:0/3606613818 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3bc018070 con 0x7fc3c80cf080 2024-04-25T08:42:28.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.810+0000 7fc3c57fa640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ac06b4d0 0x7fc3ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:28.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.810+0000 7fc3c57fa640 1 -- 172.21.15.172:0/3606613818 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3bc08a130 con 0x7fc3c80cf080 2024-04-25T08:42:28.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.810+0000 7fc3c7fff640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ac06b4d0 0x7fc3ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:28.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.810+0000 7fc3c7fff640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ac06b4d0 0x7fc3ac06d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4034000 tx=0x7fc3b402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:28.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.814+0000 7fc3c57fa640 1 -- 172.21.15.172:0/3606613818 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3bc058960 con 0x7fc3c80cf080 2024-04-25T08:42:28.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:28.992+0000 7fc3cf170640 1 -- 172.21.15.172:0/3606613818 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fc3c80ceca0 con 0x7fc3c80cf080 2024-04-25T08:42:29.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.670+0000 7fc3c57fa640 1 -- 172.21.15.172:0/3606613818 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fc3bc05ca00 con 0x7fc3c80cf080 2024-04-25T08:42:29.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 -- 172.21.15.172:0/3606613818 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ac06b4d0 msgr2=0x7fc3ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ac06b4d0 0x7fc3ac06d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4034000 tx=0x7fc3b402e000 comp rx=0 tx=0).stop 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 -- 172.21.15.172:0/3606613818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c80cf080 msgr2=0x7fc3c80c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c80cf080 0x7fc3c80c4a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00c820 tx=0x7fc3bc00cc20 comp rx=0 tx=0).stop 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 -- 172.21.15.172:0/3606613818 shutdown_connections 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ac06b4d0 0x7fc3ac06d990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3c815ba80 0x7fc3c80c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3c815c990 0x7fc3c814d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 --2- 172.21.15.172:0/3606613818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c80cf080 0x7fc3c80c4a00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 -- 172.21.15.172:0/3606613818 >> 172.21.15.172:0/3606613818 conn(0x7fc3c806abe0 msgr2=0x7fc3c80af700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 -- 172.21.15.172:0/3606613818 shutdown_connections 2024-04-25T08:42:29.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.673+0000 7fc3cf170640 1 -- 172.21.15.172:0/3606613818 wait complete. 2024-04-25T08:42:29.678 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:42:29.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.794+0000 7fc96a6b3640 1 Processor -- start 2024-04-25T08:42:29.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.794+0000 7fc96a6b3640 1 -- start start 2024-04-25T08:42:29.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc96a6b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96415b7d0 0x7fc9640cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:29.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc96a6b3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc96406c9e0 0x7fc9640b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:29.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc96a6b3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96406cf50 con 0x7fc9640b5620 2024-04-25T08:42:29.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc96a6b3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9640b5fc0 con 0x7fc96406c9e0 2024-04-25T08:42:29.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc96a6b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640ce530 con 0x7fc96415b7d0 2024-04-25T08:42:29.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc968c50640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc96406c9e0 0x7fc9640b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:29.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc9637fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc9640b5620 0x7fc96406c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57540/0 (socket says 172.21.15.172:57540) 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc9637fe640 1 -- 172.21.15.172:0/650975476 learned_addr learned my addr 172.21.15.172:0/650975476 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc963fff640 1 --2- 172.21.15.172:0/650975476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96415b7d0 0x7fc9640cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc968c50640 1 -- 172.21.15.172:0/650975476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96415b7d0 msgr2=0x7fc9640cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc968c50640 1 --2- 172.21.15.172:0/650975476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96415b7d0 0x7fc9640cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc968c50640 1 -- 172.21.15.172:0/650975476 >> v1:172.21.15.172:6789/0 conn(0x7fc9640b5620 legacy=0x7fc96406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc968c50640 1 -- 172.21.15.172:0/650975476 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640ce810 con 0x7fc96406c9e0 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.795+0000 7fc962ffd640 1 -- 172.21.15.172:0/650975476 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377352143 0 0) 0x7fc96406cf50 con 0x7fc9640b5620 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc968c50640 1 --2- 172.21.15.172:0/650975476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc96406c9e0 0x7fc9640b5a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009d90 tx=0x7fc95c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd1ac3cf5c1be11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc962ffd640 1 -- 172.21.15.172:0/650975476 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c007740 con 0x7fc96406c9e0 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc962ffd640 1 -- 172.21.15.172:0/650975476 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c0078e0 con 0x7fc96406c9e0 2024-04-25T08:42:29.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc962ffd640 1 -- 172.21.15.172:0/650975476 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c007cb0 con 0x7fc96406c9e0 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc96a6b3640 1 -- 172.21.15.172:0/650975476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc96406c9e0 msgr2=0x7fc9640b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc96a6b3640 1 --2- 172.21.15.172:0/650975476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc96406c9e0 0x7fc9640b5a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009d90 tx=0x7fc95c02a660 comp rx=0 tx=0).stop 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc96a6b3640 1 -- 172.21.15.172:0/650975476 shutdown_connections 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc96a6b3640 1 --2- 172.21.15.172:0/650975476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc96406c9e0 0x7fc9640b5a80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc96a6b3640 1 --2- 172.21.15.172:0/650975476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96415b7d0 0x7fc9640cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc96a6b3640 1 -- 172.21.15.172:0/650975476 >> 172.21.15.172:0/650975476 conn(0x7fc9640d0800 msgr2=0x7fc9640d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc96a6b3640 1 -- 172.21.15.172:0/650975476 shutdown_connections 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.796+0000 7fc96a6b3640 1 -- 172.21.15.172:0/650975476 wait complete. 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.798+0000 7fc96a6b3640 1 Processor -- start 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.798+0000 7fc96a6b3640 1 -- start start 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.798+0000 7fc96a6b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96406c9e0 0x7fc96415bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:29.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.798+0000 7fc96a6b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9640b5620 0x7fc964158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.798+0000 7fc96a6b3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc96415b7d0 0x7fc9641549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.798+0000 7fc96a6b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640cf550 con 0x7fc9640b5620 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.798+0000 7fc96a6b3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96406d230 con 0x7fc96415b7d0 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.798+0000 7fc96a6b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640cf6d0 con 0x7fc96406c9e0 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc9637fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9640b5620 0x7fc964158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc9637fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9640b5620 0x7fc964158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41470/0 (socket says 172.21.15.172:41470) 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc9637fe640 1 -- 172.21.15.172:0/3234150134 learned_addr learned my addr 172.21.15.172:0/3234150134 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc968c50640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc96415b7d0 0x7fc9641549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc963fff640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96406c9e0 0x7fc96415bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc9637fe640 1 -- 172.21.15.172:0/3234150134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96406c9e0 msgr2=0x7fc96415bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc9637fe640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96406c9e0 0x7fc96415bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc9637fe640 1 -- 172.21.15.172:0/3234150134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc96415b7d0 msgr2=0x7fc9641549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc9637fe640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc96415b7d0 0x7fc9641549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc9637fe640 1 -- 172.21.15.172:0/3234150134 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96415cbc0 con 0x7fc9640b5620 2024-04-25T08:42:29.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc963fff640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96406c9e0 0x7fc96415bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:29.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc968c50640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc96415b7d0 0x7fc9641549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:29.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc9637fe640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9640b5620 0x7fc964158740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc95800c4d0 tx=0x7fc95800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:29.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc960ff9640 1 -- 172.21.15.172:0/3234150134 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958018070 con 0x7fc9640b5620 2024-04-25T08:42:29.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc960ff9640 1 -- 172.21.15.172:0/3234150134 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958007500 con 0x7fc9640b5620 2024-04-25T08:42:29.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc960ff9640 1 -- 172.21.15.172:0/3234150134 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958004a20 con 0x7fc9640b5620 2024-04-25T08:42:29.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc96a6b3640 1 -- 172.21.15.172:0/3234150134 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9641f3570 con 0x7fc9640b5620 2024-04-25T08:42:29.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.799+0000 7fc96a6b3640 1 -- 172.21.15.172:0/3234150134 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96415c600 con 0x7fc9640b5620 2024-04-25T08:42:29.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.800+0000 7fc96a6b3640 1 -- 172.21.15.172:0/3234150134 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc964073a00 con 0x7fc9640b5620 2024-04-25T08:42:29.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.800+0000 7fc960ff9640 1 -- 172.21.15.172:0/3234150134 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc95801b070 con 0x7fc9640b5620 2024-04-25T08:42:29.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.801+0000 7fc960ff9640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc95006b4d0 0x7fc95006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:29.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.801+0000 7fc963fff640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc95006b4d0 0x7fc95006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:29.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.801+0000 7fc960ff9640 1 -- 172.21.15.172:0/3234150134 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6007+0+0 (secure 0 0 0) 0x7fc9580895b0 con 0x7fc9640b5620 2024-04-25T08:42:29.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.801+0000 7fc963fff640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc95006b4d0 0x7fc95006d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc96415b3f0 tx=0x7fc954008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:29.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.805+0000 7fc960ff9640 1 -- 172.21.15.172:0/3234150134 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc958058390 con 0x7fc9640b5620 2024-04-25T08:42:29.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:29.979+0000 7fc96a6b3640 1 -- 172.21.15.172:0/3234150134 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc964067df0 con 0x7fc9640b5620 2024-04-25T08:42:31.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.685+0000 7fc960ff9640 1 -- 172.21.15.172:0/3234150134 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fc958057c90 con 0x7fc9640b5620 2024-04-25T08:42:31.678 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data_ec' created 2024-04-25T08:42:31.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.688+0000 7fc96a6b3640 1 -- 172.21.15.172:0/3234150134 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc95006b4d0 msgr2=0x7fc95006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:31.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.688+0000 7fc96a6b3640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc95006b4d0 0x7fc95006d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc96415b3f0 tx=0x7fc954008040 comp rx=0 tx=0).stop 2024-04-25T08:42:31.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.688+0000 7fc96a6b3640 1 -- 172.21.15.172:0/3234150134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9640b5620 msgr2=0x7fc964158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:31.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.688+0000 7fc96a6b3640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9640b5620 0x7fc964158740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc95800c4d0 tx=0x7fc95800c990 comp rx=0 tx=0).stop 2024-04-25T08:42:31.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.688+0000 7fc96a6b3640 1 -- 172.21.15.172:0/3234150134 shutdown_connections 2024-04-25T08:42:31.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.688+0000 7fc96a6b3640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc95006b4d0 0x7fc95006d990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:31.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.688+0000 7fc96a6b3640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc96415b7d0 0x7fc9641549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:31.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.688+0000 7fc96a6b3640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9640b5620 0x7fc964158740 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:31.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.688+0000 7fc96a6b3640 1 --2- 172.21.15.172:0/3234150134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc96406c9e0 0x7fc96415bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:31.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.688+0000 7fc96a6b3640 1 -- 172.21.15.172:0/3234150134 >> 172.21.15.172:0/3234150134 conn(0x7fc9640d0800 msgr2=0x7fc96415f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:31.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.689+0000 7fc96a6b3640 1 -- 172.21.15.172:0/3234150134 shutdown_connections 2024-04-25T08:42:31.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.689+0000 7fc96a6b3640 1 -- 172.21.15.172:0/3234150134 wait complete. 2024-04-25T08:42:31.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T08:42:31.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.816+0000 7f1671d10640 1 Processor -- start 2024-04-25T08:42:31.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.816+0000 7f1671d10640 1 -- start start 2024-04-25T08:42:31.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f1671d10640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166c0d34c0 0x7f166c0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:31.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f1671d10640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f166c0d08e0 0x7f166c0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:31.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f1671d10640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c0d2420 con 0x7f166c15dac0 2024-04-25T08:42:31.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f1671d10640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166c0d3030 con 0x7f166c0d08e0 2024-04-25T08:42:31.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f1671d10640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0d2700 con 0x7f166c0d34c0 2024-04-25T08:42:31.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f166bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f166c0d08e0 0x7f166c0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:31.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f166bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f166c0d08e0 0x7f166c0b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41478/0 (socket says 172.21.15.172:41478) 2024-04-25T08:42:31.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f166bfff640 1 -- 172.21.15.172:0/140107217 learned_addr learned my addr 172.21.15.172:0/140107217 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:31.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f166affd640 1 --2- 172.21.15.172:0/140107217 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166c0d34c0 0x7f166c0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:31.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f166bfff640 1 -- 172.21.15.172:0/140107217 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166c0d34c0 msgr2=0x7f166c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:31.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f166bfff640 1 --2- 172.21.15.172:0/140107217 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166c0d34c0 0x7f166c0d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:31.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f166bfff640 1 -- 172.21.15.172:0/140107217 >> v1:172.21.15.186:6789/0 conn(0x7f166c15dac0 legacy=0x7f166c0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:31.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.817+0000 7f166bfff640 1 -- 172.21.15.172:0/140107217 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c0d29e0 con 0x7f166c0d08e0 2024-04-25T08:42:31.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.818+0000 7f166bfff640 1 --2- 172.21.15.172:0/140107217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 0x7f166c0b6990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1664009e50 tx=0x7f166402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed7c9d576ab58c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:31.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.818+0000 7f166a7fc640 1 -- 172.21.15.172:0/140107217 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664036070 con 0x7f166c0d08e0 2024-04-25T08:42:31.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.818+0000 7f166a7fc640 1 -- 172.21.15.172:0/140107217 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1664031600 con 0x7f166c0d08e0 2024-04-25T08:42:31.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.818+0000 7f166a7fc640 1 -- 172.21.15.172:0/140107217 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16640319d0 con 0x7f166c0d08e0 2024-04-25T08:42:31.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.819+0000 7f1671d10640 1 -- 172.21.15.172:0/140107217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 msgr2=0x7f166c0b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:31.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.819+0000 7f1671d10640 1 --2- 172.21.15.172:0/140107217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 0x7f166c0b6990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1664009e50 tx=0x7f166402a7a0 comp rx=0 tx=0).stop 2024-04-25T08:42:31.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.819+0000 7f1671d10640 1 -- 172.21.15.172:0/140107217 shutdown_connections 2024-04-25T08:42:31.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.819+0000 7f1671d10640 1 --2- 172.21.15.172:0/140107217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 0x7f166c0b6990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:31.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.819+0000 7f1671d10640 1 --2- 172.21.15.172:0/140107217 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166c0d34c0 0x7f166c0d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:31.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.819+0000 7f1671d10640 1 -- 172.21.15.172:0/140107217 >> 172.21.15.172:0/140107217 conn(0x7f166c061c30 msgr2=0x7f166c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:31.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.819+0000 7f1671d10640 1 -- 172.21.15.172:0/140107217 shutdown_connections 2024-04-25T08:42:31.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.819+0000 7f1671d10640 1 -- 172.21.15.172:0/140107217 wait complete. 2024-04-25T08:42:31.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.820+0000 7f1671d10640 1 Processor -- start 2024-04-25T08:42:31.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.820+0000 7f1671d10640 1 -- start start 2024-04-25T08:42:31.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1671d10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 0x7f166c0cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:31.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1671d10640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166c0d34c0 0x7f166c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:31.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1671d10640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f166c15dac0 0x7f166c0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1671d10640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c15dea0 con 0x7f166c0d08e0 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1671d10640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0d2100 con 0x7f166c15dac0 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1671d10640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166c0b97d0 con 0x7f166c0d34c0 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 0x7f166c0cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 0x7f166c0cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41484/0 (socket says 172.21.15.172:41484) 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166b7fe640 1 -- 172.21.15.172:0/2191002942 learned_addr learned my addr 172.21.15.172:0/2191002942 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166bfff640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f166c15dac0 0x7f166c0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166affd640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166c0d34c0 0x7f166c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166b7fe640 1 -- 172.21.15.172:0/2191002942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166c0d34c0 msgr2=0x7f166c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166b7fe640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166c0d34c0 0x7f166c151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166b7fe640 1 -- 172.21.15.172:0/2191002942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f166c15dac0 msgr2=0x7f166c0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166b7fe640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f166c15dac0 0x7f166c0b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:31.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166b7fe640 1 -- 172.21.15.172:0/2191002942 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c0cd8c0 con 0x7f166c0d08e0 2024-04-25T08:42:31.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f166b7fe640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 0x7f166c0cd380 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f165c00c3f0 tx=0x7f165c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:31.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1653fff640 1 -- 172.21.15.172:0/2191002942 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0052d0 con 0x7f166c0d08e0 2024-04-25T08:42:31.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1653fff640 1 -- 172.21.15.172:0/2191002942 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c005490 con 0x7f166c0d08e0 2024-04-25T08:42:31.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1671d10640 1 -- 172.21.15.172:0/2191002942 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166c152040 con 0x7f166c0d08e0 2024-04-25T08:42:31.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1653fff640 1 -- 172.21.15.172:0/2191002942 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c007260 con 0x7f166c0d08e0 2024-04-25T08:42:31.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.821+0000 7f1671d10640 1 -- 172.21.15.172:0/2191002942 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c15fc80 con 0x7f166c0d08e0 2024-04-25T08:42:31.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.822+0000 7f1671d10640 1 -- 172.21.15.172:0/2191002942 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c15fab0 con 0x7f166c0d08e0 2024-04-25T08:42:31.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.823+0000 7f1653fff640 1 -- 172.21.15.172:0/2191002942 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f165c007400 con 0x7f166c0d08e0 2024-04-25T08:42:31.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.823+0000 7f1653fff640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f165806b4d0 0x7f165806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:31.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.824+0000 7f166affd640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f165806b4d0 0x7f165806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:31.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.824+0000 7f1653fff640 1 -- 172.21.15.172:0/2191002942 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f165c0898c0 con 0x7f166c0d08e0 2024-04-25T08:42:31.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.824+0000 7f166affd640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f165806b4d0 0x7f165806d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f166c0d3920 tx=0x7f1660009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:31.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.828+0000 7f1653fff640 1 -- 172.21.15.172:0/2191002942 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f165c057e60 con 0x7f166c0d08e0 2024-04-25T08:42:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:31.998+0000 7f1671d10640 1 -- 172.21.15.172:0/2191002942 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f166c073a00 con 0x7f166c0d08e0 2024-04-25T08:42:32.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.687+0000 7f1653fff640 1 -- 172.21.15.172:0/2191002942 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f165c05ce20 con 0x7f166c0d08e0 2024-04-25T08:42:32.679 INFO:teuthology.orchestra.run.smithi172.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T08:42:32.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.690+0000 7f1671d10640 1 -- 172.21.15.172:0/2191002942 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f165806b4d0 msgr2=0x7f165806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:32.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.690+0000 7f1671d10640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f165806b4d0 0x7f165806d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f166c0d3920 tx=0x7f1660009110 comp rx=0 tx=0).stop 2024-04-25T08:42:32.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.690+0000 7f1671d10640 1 -- 172.21.15.172:0/2191002942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 msgr2=0x7f166c0cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:32.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.690+0000 7f1671d10640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 0x7f166c0cd380 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f165c00c3f0 tx=0x7f165c00c8b0 comp rx=0 tx=0).stop 2024-04-25T08:42:32.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.690+0000 7f1671d10640 1 -- 172.21.15.172:0/2191002942 shutdown_connections 2024-04-25T08:42:32.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.690+0000 7f1671d10640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f165806b4d0 0x7f165806d990 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f166c0d3920 tx=0x7f1660009110 comp rx=0 tx=0).stop 2024-04-25T08:42:32.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.690+0000 7f1671d10640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f166c15dac0 0x7f166c0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:32.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.690+0000 7f1671d10640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166c0d34c0 0x7f166c151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:32.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.690+0000 7f1671d10640 1 --2- 172.21.15.172:0/2191002942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f166c0d08e0 0x7f166c0cd380 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:32.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.690+0000 7f1671d10640 1 -- 172.21.15.172:0/2191002942 >> 172.21.15.172:0/2191002942 conn(0x7f166c061c30 msgr2=0x7f166c0b85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:32.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.692+0000 7f1671d10640 1 -- 172.21.15.172:0/2191002942 shutdown_connections 2024-04-25T08:42:32.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.692+0000 7f1671d10640 1 -- 172.21.15.172:0/2191002942 wait complete. 2024-04-25T08:42:32.712 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T08:42:32.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.824+0000 7ffb39dc4640 1 Processor -- start 2024-04-25T08:42:32.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.824+0000 7ffb39dc4640 1 -- start start 2024-04-25T08:42:32.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb39dc4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb340b5c40 0x7ffb340ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:32.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb39dc4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb3415b980 0x7ffb340ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:32.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb39dc4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340cf320 con 0x7ffb3415b5a0 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb39dc4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340ced90 con 0x7ffb340b5c40 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb39dc4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340cf040 con 0x7ffb3415b980 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb32ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb340b5c40 0x7ffb340ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb337fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ffb3415b5a0 0x7ffb340b5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57546/0 (socket says 172.21.15.172:57546) 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb337fe640 1 -- 172.21.15.172:0/1621842457 learned_addr learned my addr 172.21.15.172:0/1621842457 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb32ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb340b5c40 0x7ffb340ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41494/0 (socket says 172.21.15.172:41494) 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb33fff640 1 --2- 172.21.15.172:0/1621842457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb3415b980 0x7ffb340ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb32ffd640 1 -- 172.21.15.172:0/1621842457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb3415b980 msgr2=0x7ffb340ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb32ffd640 1 --2- 172.21.15.172:0/1621842457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb3415b980 0x7ffb340ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb32ffd640 1 -- 172.21.15.172:0/1621842457 >> v1:172.21.15.172:6789/0 conn(0x7ffb3415b5a0 legacy=0x7ffb340b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.825+0000 7ffb32ffd640 1 -- 172.21.15.172:0/1621842457 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb34161970 con 0x7ffb340b5c40 2024-04-25T08:42:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb32ffd640 1 --2- 172.21.15.172:0/1621842457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb340b5c40 0x7ffb340ce310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009790 tx=0x7ffb2802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6202d0be45a33db3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb327fc640 1 -- 172.21.15.172:0/1621842457 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28037070 con 0x7ffb340b5c40 2024-04-25T08:42:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb327fc640 1 -- 172.21.15.172:0/1621842457 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb28032440 con 0x7ffb340b5c40 2024-04-25T08:42:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb327fc640 1 -- 172.21.15.172:0/1621842457 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28032810 con 0x7ffb340b5c40 2024-04-25T08:42:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb39dc4640 1 -- 172.21.15.172:0/1621842457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb340b5c40 msgr2=0x7ffb340ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb39dc4640 1 --2- 172.21.15.172:0/1621842457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb340b5c40 0x7ffb340ce310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009790 tx=0x7ffb2802a180 comp rx=0 tx=0).stop 2024-04-25T08:42:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb39dc4640 1 -- 172.21.15.172:0/1621842457 shutdown_connections 2024-04-25T08:42:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb39dc4640 1 --2- 172.21.15.172:0/1621842457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb3415b980 0x7ffb340ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb39dc4640 1 --2- 172.21.15.172:0/1621842457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb340b5c40 0x7ffb340ce310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb39dc4640 1 -- 172.21.15.172:0/1621842457 >> 172.21.15.172:0/1621842457 conn(0x7ffb340d0530 msgr2=0x7ffb340d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb39dc4640 1 -- 172.21.15.172:0/1621842457 shutdown_connections 2024-04-25T08:42:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.826+0000 7ffb39dc4640 1 -- 172.21.15.172:0/1621842457 wait complete. 2024-04-25T08:42:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.827+0000 7ffb39dc4640 1 Processor -- start 2024-04-25T08:42:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.828+0000 7ffb39dc4640 1 -- start start 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.828+0000 7ffb39dc4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb340b5c40 0x7ffb340c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.828+0000 7ffb39dc4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb3415b5a0 0x7ffb3414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.828+0000 7ffb39dc4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb3415b980 0x7ffb340c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.828+0000 7ffb39dc4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34162450 con 0x7ffb3415b980 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.828+0000 7ffb39dc4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34161f30 con 0x7ffb340b5c40 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.828+0000 7ffb39dc4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341625d0 con 0x7ffb3415b5a0 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.828+0000 7ffb33fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb3415b980 0x7ffb340c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb33fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb3415b980 0x7ffb340c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41508/0 (socket says 172.21.15.172:41508) 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb33fff640 1 -- 172.21.15.172:0/2012169616 learned_addr learned my addr 172.21.15.172:0/2012169616 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb32ffd640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb3415b5a0 0x7ffb3414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb337fe640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb340b5c40 0x7ffb340c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb33fff640 1 -- 172.21.15.172:0/2012169616 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb3415b5a0 msgr2=0x7ffb3414c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb33fff640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb3415b5a0 0x7ffb3414c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb33fff640 1 -- 172.21.15.172:0/2012169616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb340b5c40 msgr2=0x7ffb340c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb33fff640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb340b5c40 0x7ffb340c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb33fff640 1 -- 172.21.15.172:0/2012169616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340c8f60 con 0x7ffb3415b980 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb33fff640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb3415b980 0x7ffb340c8680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c007d80 tx=0x7ffb2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb1bfff640 1 -- 172.21.15.172:0/2012169616 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c014420 con 0x7ffb3415b980 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb1bfff640 1 -- 172.21.15.172:0/2012169616 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c019070 con 0x7ffb3415b980 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb39dc4640 1 -- 172.21.15.172:0/2012169616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb340c9240 con 0x7ffb3415b980 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb1bfff640 1 -- 172.21.15.172:0/2012169616 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c014800 con 0x7ffb3415b980 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.829+0000 7ffb39dc4640 1 -- 172.21.15.172:0/2012169616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb340c78c0 con 0x7ffb3415b980 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.830+0000 7ffb39dc4640 1 -- 172.21.15.172:0/2012169616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb34073a00 con 0x7ffb3415b980 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.830+0000 7ffb1bfff640 1 -- 172.21.15.172:0/2012169616 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb2c0149a0 con 0x7ffb3415b980 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.831+0000 7ffb1bfff640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b4d0 0x7ffb2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.831+0000 7ffb1bfff640 1 -- 172.21.15.172:0/2012169616 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6500+0+0 (secure 0 0 0) 0x7ffb2c08ab70 con 0x7ffb3415b980 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.831+0000 7ffb337fe640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b4d0 0x7ffb2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.831+0000 7ffb337fe640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b4d0 0x7ffb2006d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffb24007fd0 tx=0x7ffb24007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:32.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:32.835+0000 7ffb1bfff640 1 -- 172.21.15.172:0/2012169616 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb2c059110 con 0x7ffb3415b980 2024-04-25T08:42:33.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.043+0000 7ffb39dc4640 1 -- 172.21.15.172:0/2012169616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7ffb340d17c0 con 0x7ffb3415b980 2024-04-25T08:42:33.099 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T08:42:33.107+0000 7f1942e15640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:42:33.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.711+0000 7ffb1bfff640 1 -- 172.21.15.172:0/2012169616 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7ffb2c05d1b0 con 0x7ffb3415b980 2024-04-25T08:42:33.704 INFO:teuthology.orchestra.run.smithi172.stderr:added data pool 4 to fsmap 2024-04-25T08:42:33.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 -- 172.21.15.172:0/2012169616 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b4d0 msgr2=0x7ffb2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:33.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b4d0 0x7ffb2006d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffb24007fd0 tx=0x7ffb24007e80 comp rx=0 tx=0).stop 2024-04-25T08:42:33.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 -- 172.21.15.172:0/2012169616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb3415b980 msgr2=0x7ffb340c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:33.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb3415b980 0x7ffb340c8680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c007d80 tx=0x7ffb2c00e4b0 comp rx=0 tx=0).stop 2024-04-25T08:42:33.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 -- 172.21.15.172:0/2012169616 shutdown_connections 2024-04-25T08:42:33.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b4d0 0x7ffb2006d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:33.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb3415b980 0x7ffb340c8680 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:33.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb3415b5a0 0x7ffb3414c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:33.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 --2- 172.21.15.172:0/2012169616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb340b5c40 0x7ffb340c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:33.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 -- 172.21.15.172:0/2012169616 >> 172.21.15.172:0/2012169616 conn(0x7ffb340d0530 msgr2=0x7ffb340d2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:33.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 -- 172.21.15.172:0/2012169616 shutdown_connections 2024-04-25T08:42:33.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.714+0000 7ffb39dc4640 1 -- 172.21.15.172:0/2012169616 wait complete. 2024-04-25T08:42:33.719 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:42:33.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.826+0000 7fc6c1db0640 1 Processor -- start 2024-04-25T08:42:33.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.826+0000 7fc6c1db0640 1 -- start start 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6c1db0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6bc0cc8e0 0x7fc6bc1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6c1db0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6bc0d1810 0x7fc6bc0d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6c1db0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6bc0cce50 con 0x7fc6bc15dc90 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6c1db0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6bc161af0 con 0x7fc6bc0d1810 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6c1db0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc161dd0 con 0x7fc6bc0cc8e0 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6bbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6bc0d1810 0x7fc6bc0d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6bbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6bc0d1810 0x7fc6bc0d1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41524/0 (socket says 172.21.15.172:41524) 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6bbfff640 1 -- 172.21.15.172:0/3081145512 learned_addr learned my addr 172.21.15.172:0/3081145512 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6bbfff640 1 -- 172.21.15.172:0/3081145512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6bc0cc8e0 msgr2=0x7fc6bc1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6bbfff640 1 --2- 172.21.15.172:0/3081145512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6bc0cc8e0 0x7fc6bc1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6bbfff640 1 -- 172.21.15.172:0/3081145512 >> v1:172.21.15.186:6789/0 conn(0x7fc6bc15dc90 legacy=0x7fc6bc15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:33.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.827+0000 7fc6bbfff640 1 -- 172.21.15.172:0/3081145512 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc1620b0 con 0x7fc6bc0d1810 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.828+0000 7fc6bbfff640 1 --2- 172.21.15.172:0/3081145512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 0x7fc6bc0d1ca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009e50 tx=0x7fc6b402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b793ea81c1dcb0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.828+0000 7fc6ba7fc640 1 -- 172.21.15.172:0/3081145512 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4036070 con 0x7fc6bc0d1810 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.828+0000 7fc6ba7fc640 1 -- 172.21.15.172:0/3081145512 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b4031600 con 0x7fc6bc0d1810 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.828+0000 7fc6ba7fc640 1 -- 172.21.15.172:0/3081145512 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40319d0 con 0x7fc6bc0d1810 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.829+0000 7fc6c1db0640 1 -- 172.21.15.172:0/3081145512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 msgr2=0x7fc6bc0d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.829+0000 7fc6c1db0640 1 --2- 172.21.15.172:0/3081145512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 0x7fc6bc0d1ca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009e50 tx=0x7fc6b402a630 comp rx=0 tx=0).stop 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.829+0000 7fc6c1db0640 1 -- 172.21.15.172:0/3081145512 shutdown_connections 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.829+0000 7fc6c1db0640 1 --2- 172.21.15.172:0/3081145512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 0x7fc6bc0d1ca0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.829+0000 7fc6c1db0640 1 --2- 172.21.15.172:0/3081145512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6bc0cc8e0 0x7fc6bc1625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.829+0000 7fc6c1db0640 1 -- 172.21.15.172:0/3081145512 >> 172.21.15.172:0/3081145512 conn(0x7fc6bc06f590 msgr2=0x7fc6bc06f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.829+0000 7fc6c1db0640 1 -- 172.21.15.172:0/3081145512 shutdown_connections 2024-04-25T08:42:33.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.829+0000 7fc6c1db0640 1 -- 172.21.15.172:0/3081145512 wait complete. 2024-04-25T08:42:33.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.830+0000 7fc6c1db0640 1 Processor -- start 2024-04-25T08:42:33.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.830+0000 7fc6c1db0640 1 -- start start 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6c1db0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6bc0cc8e0 0x7fc6bc155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6c1db0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 0x7fc6bc0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6c1db0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6bc15dc90 0x7fc6bc15fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6c1db0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc15e1f0 con 0x7fc6bc0d1810 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6c1db0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc15e070 con 0x7fc6bc0cc8e0 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6c1db0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc0cfde0 con 0x7fc6bc15dc90 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6baffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 0x7fc6bc0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6baffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 0x7fc6bc0b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41530/0 (socket says 172.21.15.172:41530) 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6baffd640 1 -- 172.21.15.172:0/600646974 learned_addr learned my addr 172.21.15.172:0/600646974 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6bb7fe640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6bc0cc8e0 0x7fc6bc155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6bbfff640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6bc15dc90 0x7fc6bc15fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6baffd640 1 -- 172.21.15.172:0/600646974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6bc15dc90 msgr2=0x7fc6bc15fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6baffd640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6bc15dc90 0x7fc6bc15fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6baffd640 1 -- 172.21.15.172:0/600646974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6bc0cc8e0 msgr2=0x7fc6bc155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:33.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6baffd640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6bc0cc8e0 0x7fc6bc155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:33.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6baffd640 1 -- 172.21.15.172:0/600646974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc0c94e0 con 0x7fc6bc0d1810 2024-04-25T08:42:33.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.831+0000 7fc6bb7fe640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6bc0cc8e0 0x7fc6bc155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:33.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.832+0000 7fc6baffd640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 0x7fc6bc0b02c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000b4d0 tx=0x7fc6b000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:33.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.832+0000 7fc6a3fff640 1 -- 172.21.15.172:0/600646974 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0014070 con 0x7fc6bc0d1810 2024-04-25T08:42:33.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.832+0000 7fc6a3fff640 1 -- 172.21.15.172:0/600646974 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0010610 con 0x7fc6bc0d1810 2024-04-25T08:42:33.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.832+0000 7fc6c1db0640 1 -- 172.21.15.172:0/600646974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc0c97c0 con 0x7fc6bc0d1810 2024-04-25T08:42:33.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.832+0000 7fc6a3fff640 1 -- 172.21.15.172:0/600646974 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0010a00 con 0x7fc6bc0d1810 2024-04-25T08:42:33.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.832+0000 7fc6c1db0640 1 -- 172.21.15.172:0/600646974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc156b00 con 0x7fc6bc0d1810 2024-04-25T08:42:33.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.833+0000 7fc6c1db0640 1 -- 172.21.15.172:0/600646974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc1f41e0 con 0x7fc6bc0d1810 2024-04-25T08:42:33.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.833+0000 7fc6a3fff640 1 -- 172.21.15.172:0/600646974 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc6b0017070 con 0x7fc6bc0d1810 2024-04-25T08:42:33.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.834+0000 7fc6a3fff640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6a806b4d0 0x7fc6a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:33.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.834+0000 7fc6a3fff640 1 -- 172.21.15.172:0/600646974 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc6b0089fd0 con 0x7fc6bc0d1810 2024-04-25T08:42:33.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.834+0000 7fc6bb7fe640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6a806b4d0 0x7fc6a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:33.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.834+0000 7fc6bb7fe640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6a806b4d0 0x7fc6a806d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00a830 tx=0x7fc6ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:33.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:33.838+0000 7fc6a3fff640 1 -- 172.21.15.172:0/600646974 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc6b0058a90 con 0x7fc6bc0d1810 2024-04-25T08:42:34.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.043+0000 7fc6c1db0640 1 -- 172.21.15.172:0/600646974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6bc1625d0 con 0x7fc6bc0d1810 2024-04-25T08:42:34.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.043+0000 7fc6a3fff640 1 -- 172.21.15.172:0/600646974 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4943 (secure 0 0 0) 0x7fc6bc1625d0 con 0x7fc6bc0d1810 2024-04-25T08:42:34.036 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:34.036 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:42:28.003161+0000","modified":"2024-04-25T08:42:33.044941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-25T08:42:34.036 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 6 2024-04-25T08:42:34.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 -- 172.21.15.172:0/600646974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6a806b4d0 msgr2=0x7fc6a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6a806b4d0 0x7fc6a806d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00a830 tx=0x7fc6ac008040 comp rx=0 tx=0).stop 2024-04-25T08:42:34.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 -- 172.21.15.172:0/600646974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 msgr2=0x7fc6bc0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 0x7fc6bc0b02c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000b4d0 tx=0x7fc6b000b990 comp rx=0 tx=0).stop 2024-04-25T08:42:34.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 -- 172.21.15.172:0/600646974 shutdown_connections 2024-04-25T08:42:34.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6a806b4d0 0x7fc6a806d990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6bc15dc90 0x7fc6bc15fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6bc0d1810 0x7fc6bc0b02c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 --2- 172.21.15.172:0/600646974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6bc0cc8e0 0x7fc6bc155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 -- 172.21.15.172:0/600646974 >> 172.21.15.172:0/600646974 conn(0x7fc6bc06f590 msgr2=0x7fc6bc0c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:34.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.045+0000 7fc6c1db0640 1 -- 172.21.15.172:0/600646974 shutdown_connections 2024-04-25T08:42:34.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.046+0000 7fc6c1db0640 1 -- 172.21.15.172:0/600646974 wait complete. 2024-04-25T08:42:34.049 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:34.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.154+0000 7fa5ae1e0640 1 Processor -- start 2024-04-25T08:42:34.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.154+0000 7fa5ae1e0640 1 -- start start 2024-04-25T08:42:34.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5ae1e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a815dd30 0x7fa5a80b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5ae1e0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a80d1df0 con 0x7fa5a80b9770 2024-04-25T08:42:34.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5ae1e0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a80d20d0 con 0x7fa5a80d0ad0 2024-04-25T08:42:34.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5ae1e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80d23b0 con 0x7fa5a815dd30 2024-04-25T08:42:34.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a6ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa5a80b9770 0x7fa5a80d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57562/0 (socket says 172.21.15.172:57562) 2024-04-25T08:42:34.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a6ffd640 1 -- 172.21.15.172:0/695280500 learned_addr learned my addr 172.21.15.172:0/695280500 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:34.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a77fe640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a815dd30 0x7fa5a80b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994374639 0 0) 0x7fa5a80d1df0 con 0x7fa5a80b9770 2024-04-25T08:42:34.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa590003520 con 0x7fa5a80b9770 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 819839650 0 0) 0x7fa590003520 con 0x7fa5a80b9770 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a815dd30 msgr2=0x7fa5a80b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a815dd30 0x7fa5a80b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 >> v1:172.21.15.186:6789/0 conn(0x7fa5a80d0ad0 legacy=0x7fa5a80b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80d2690 con 0x7fa5a80b9770 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fa59c0017f0 con 0x7fa5a80b9770 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 >> v1:172.21.15.172:6789/0 conn(0x7fa5a80b9770 legacy=0x7fa5a80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 0x7fa590003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a815dd30 0x7fa590004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa590004d40 0x7fa5900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80d23b0 con 0x7fa5900039e0 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59000ba70 con 0x7fa590004d40 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59000bc70 con 0x7fa5a815dd30 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.155+0000 7fa5a77fe640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 0x7fa590003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a6ffd640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a815dd30 0x7fa590004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a7fff640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa590004d40 0x7fa5900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a77fe640 1 -- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a815dd30 msgr2=0x7fa590004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a77fe640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a815dd30 0x7fa590004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a77fe640 1 -- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa590004d40 msgr2=0x7fa5900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a77fe640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa590004d40 0x7fa5900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a77fe640 1 -- 172.21.15.172:0/695280500 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590003520 con 0x7fa5900039e0 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a6ffd640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a815dd30 0x7fa590004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a77fe640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 0x7fa590003dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa598009ac0 tx=0x7fa590005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39e959bb2692a98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598036070 con 0x7fa5900039e0 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa598031400 con 0x7fa5900039e0 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.156+0000 7fa5a67fc640 1 -- 172.21.15.172:0/695280500 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598009690 con 0x7fa5900039e0 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.157+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/695280500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 msgr2=0x7fa590003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.157+0000 7fa5ae1e0640 1 --2- 172.21.15.172:0/695280500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 0x7fa590003dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa598009ac0 tx=0x7fa590005830 comp rx=0 tx=0).stop 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.157+0000 7fa5a7fff640 1 -- 172.21.15.172:0/695280500 reap_dead start 2024-04-25T08:42:34.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.157+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/695280500 shutdown_connections 2024-04-25T08:42:34.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.157+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/695280500 >> 172.21.15.172:0/695280500 conn(0x7fa5a8061c30 msgr2=0x7fa5a806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:34.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.157+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/695280500 shutdown_connections 2024-04-25T08:42:34.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.157+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/695280500 wait complete. 2024-04-25T08:42:34.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.158+0000 7fa5ae1e0640 1 Processor -- start 2024-04-25T08:42:34.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.158+0000 7fa5ae1e0640 1 -- start start 2024-04-25T08:42:34.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5ae1e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 0x7fa5a80acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5ae1e0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5a80ad110 0x7fa5a80b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5ae1e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a80b4db0 0x7fa5a814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5ae1e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80d1b90 con 0x7fa5900039e0 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5ae1e0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80d1a10 con 0x7fa5a80ad110 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5ae1e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a80d2e90 con 0x7fa5a80b4db0 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5a77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 0x7fa5a80acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5a77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 0x7fa5a80acbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41552/0 (socket says 172.21.15.172:41552) 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5a77fe640 1 -- 172.21.15.172:0/313569656 learned_addr learned my addr 172.21.15.172:0/313569656 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5a6ffd640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5a80ad110 0x7fa5a80b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5a77fe640 1 -- 172.21.15.172:0/313569656 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a80b4db0 msgr2=0x7fa5a814ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5a7fff640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a80b4db0 0x7fa5a814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5a77fe640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a80b4db0 0x7fa5a814ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5a77fe640 1 -- 172.21.15.172:0/313569656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5a80ad110 msgr2=0x7fa5a80b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5a77fe640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5a80ad110 0x7fa5a80b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.159+0000 7fa5a77fe640 1 -- 172.21.15.172:0/313569656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a80ad590 con 0x7fa5900039e0 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.160+0000 7fa5a77fe640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 0x7fa5a80acbd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa598034040 tx=0x7fa598004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:34.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.160+0000 7fa58ffff640 1 -- 172.21.15.172:0/313569656 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598040020 con 0x7fa5900039e0 2024-04-25T08:42:34.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.160+0000 7fa58ffff640 1 -- 172.21.15.172:0/313569656 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5980038c0 con 0x7fa5900039e0 2024-04-25T08:42:34.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.160+0000 7fa58ffff640 1 -- 172.21.15.172:0/313569656 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598036040 con 0x7fa5900039e0 2024-04-25T08:42:34.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.160+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/313569656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a80b55f0 con 0x7fa5900039e0 2024-04-25T08:42:34.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.160+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/313569656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a80b5bb0 con 0x7fa5900039e0 2024-04-25T08:42:34.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.161+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/313569656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a8073990 con 0x7fa5900039e0 2024-04-25T08:42:34.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.161+0000 7fa58ffff640 1 -- 172.21.15.172:0/313569656 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa598043020 con 0x7fa5900039e0 2024-04-25T08:42:34.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.161+0000 7fa58ffff640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59406b4d0 0x7fa59406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.162+0000 7fa58ffff640 1 -- 172.21.15.172:0/313569656 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa5980aa630 con 0x7fa5900039e0 2024-04-25T08:42:34.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.162+0000 7fa5a6ffd640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59406b4d0 0x7fa59406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.162+0000 7fa5a6ffd640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59406b4d0 0x7fa59406d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa59c001170 tx=0x7fa59c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:34.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.166+0000 7fa58ffff640 1 -- 172.21.15.172:0/313569656 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa59804a070 con 0x7fa5900039e0 2024-04-25T08:42:34.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.339+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/313569656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5a814ca50 con 0x7fa5900039e0 2024-04-25T08:42:34.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.340+0000 7fa58ffff640 1 -- 172.21.15.172:0/313569656 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7fa598079200 con 0x7fa5900039e0 2024-04-25T08:42:34.333 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:34.333 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:34.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/313569656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59406b4d0 msgr2=0x7fa59406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59406b4d0 0x7fa59406d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa59c001170 tx=0x7fa59c009040 comp rx=0 tx=0).stop 2024-04-25T08:42:34.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/313569656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 msgr2=0x7fa5a80acbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 0x7fa5a80acbd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa598034040 tx=0x7fa598004730 comp rx=0 tx=0).stop 2024-04-25T08:42:34.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/313569656 shutdown_connections 2024-04-25T08:42:34.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59406b4d0 0x7fa59406d990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5a80ad110 0x7fa5a80b4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5a80b4db0 0x7fa5a814ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 --2- 172.21.15.172:0/313569656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5900039e0 0x7fa5a80acbd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/313569656 >> 172.21.15.172:0/313569656 conn(0x7fa5a8061c30 msgr2=0x7fa5a8160780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:34.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/313569656 shutdown_connections 2024-04-25T08:42:34.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.342+0000 7fa5ae1e0640 1 -- 172.21.15.172:0/313569656 wait complete. 2024-04-25T08:42:34.346 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:34.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.451+0000 7fb33fa6b640 1 Processor -- start 2024-04-25T08:42:34.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.451+0000 7fb33fa6b640 1 -- start start 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33fa6b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb33815da70 0x7fb3380d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33fa6b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3380c8030 con 0x7fb3380c7730 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33fa6b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3380c8310 con 0x7fb3380ce8d0 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33fa6b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3380c85f0 con 0x7fb33815da70 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33d807640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb33815da70 0x7fb3380d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33d006640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb3380c7730 0x7fb3380ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57574/0 (socket says 172.21.15.172:57574) 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33d006640 1 -- 172.21.15.172:0/4171768285 learned_addr learned my addr 172.21.15.172:0/4171768285 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33d807640 1 -- 172.21.15.172:0/4171768285 >> v1:172.21.15.186:6789/0 conn(0x7fb3380ce8d0 legacy=0x7fb33806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33d807640 1 -- 172.21.15.172:0/4171768285 >> v1:172.21.15.172:6789/0 conn(0x7fb3380c7730 legacy=0x7fb3380ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33d807640 1 -- 172.21.15.172:0/4171768285 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33806bb30 con 0x7fb33815da70 2024-04-25T08:42:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.452+0000 7fb33c805640 1 -- 172.21.15.172:0/4171768285 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840129949 0 0) 0x7fb3380c8030 con 0x7fb3380c7730 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.453+0000 7fb33d807640 1 --2- 172.21.15.172:0/4171768285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 0x7fb3380d0170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb334009d90 tx=0x7fb33402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bc6448a5c7d671 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.453+0000 7fb33c805640 1 -- 172.21.15.172:0/4171768285 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334007740 con 0x7fb33815da70 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.453+0000 7fb33c805640 1 -- 172.21.15.172:0/4171768285 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3340078e0 con 0x7fb33815da70 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.453+0000 7fb33c805640 1 -- 172.21.15.172:0/4171768285 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334007cb0 con 0x7fb33815da70 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.454+0000 7fb33fa6b640 1 -- 172.21.15.172:0/4171768285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 msgr2=0x7fb3380d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.454+0000 7fb33fa6b640 1 --2- 172.21.15.172:0/4171768285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 0x7fb3380d0170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb334009d90 tx=0x7fb33402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.454+0000 7fb33fa6b640 1 -- 172.21.15.172:0/4171768285 shutdown_connections 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.454+0000 7fb33fa6b640 1 --2- 172.21.15.172:0/4171768285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 0x7fb3380d0170 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.454+0000 7fb33fa6b640 1 -- 172.21.15.172:0/4171768285 >> 172.21.15.172:0/4171768285 conn(0x7fb3380b33e0 msgr2=0x7fb3380b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.454+0000 7fb33fa6b640 1 -- 172.21.15.172:0/4171768285 shutdown_connections 2024-04-25T08:42:34.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.454+0000 7fb33fa6b640 1 -- 172.21.15.172:0/4171768285 wait complete. 2024-04-25T08:42:34.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.455+0000 7fb33fa6b640 1 Processor -- start 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.455+0000 7fb33fa6b640 1 -- start start 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33fa6b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3380c7730 0x7fb3380c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33fa6b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3380ce8d0 0x7fb33814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33fa6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 0x7fb33815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33fa6b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380c7bc0 con 0x7fb33815da70 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33fa6b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33815de50 con 0x7fb3380ce8d0 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33fa6b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380c7d40 con 0x7fb3380c7730 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33e008640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 0x7fb33815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33e008640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 0x7fb33815b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41568/0 (socket says 172.21.15.172:41568) 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33e008640 1 -- 172.21.15.172:0/3862867082 learned_addr learned my addr 172.21.15.172:0/3862867082 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33d006640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3380ce8d0 0x7fb33814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33d807640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3380c7730 0x7fb3380c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33e008640 1 -- 172.21.15.172:0/3862867082 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3380c7730 msgr2=0x7fb3380c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33e008640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3380c7730 0x7fb3380c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33e008640 1 -- 172.21.15.172:0/3862867082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3380ce8d0 msgr2=0x7fb33814c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33e008640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3380ce8d0 0x7fb33814c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33e008640 1 -- 172.21.15.172:0/3862867082 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3380c89b0 con 0x7fb33815da70 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33d006640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3380ce8d0 0x7fb33814c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33e008640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 0x7fb33815b500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c440 tx=0x7fb33000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb32e7fc640 1 -- 172.21.15.172:0/3862867082 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330011790 con 0x7fb33815da70 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb32e7fc640 1 -- 172.21.15.172:0/3862867082 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330017070 con 0x7fb33815da70 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb32e7fc640 1 -- 172.21.15.172:0/3862867082 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330011b70 con 0x7fb33815da70 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33fa6b640 1 -- 172.21.15.172:0/3862867082 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3380c8c90 con 0x7fb33815da70 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.456+0000 7fb33fa6b640 1 -- 172.21.15.172:0/3862867082 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3380c9250 con 0x7fb33815da70 2024-04-25T08:42:34.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.457+0000 7fb33fa6b640 1 -- 172.21.15.172:0/3862867082 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3380ce0f0 con 0x7fb33815da70 2024-04-25T08:42:34.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.458+0000 7fb32e7fc640 1 -- 172.21.15.172:0/3862867082 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb330011d10 con 0x7fb33815da70 2024-04-25T08:42:34.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.458+0000 7fb32e7fc640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb31c06b4d0 0x7fb31c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.458+0000 7fb32e7fc640 1 -- 172.21.15.172:0/3862867082 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb33008a2b0 con 0x7fb33815da70 2024-04-25T08:42:34.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.458+0000 7fb33d807640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb31c06b4d0 0x7fb31c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.459+0000 7fb33d807640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb31c06b4d0 0x7fb31c06d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb334034000 tx=0x7fb33402f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:34.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.462+0000 7fb32e7fc640 1 -- 172.21.15.172:0/3862867082 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3380ce0f0 con 0x7fb33815da70 2024-04-25T08:42:34.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.634+0000 7fb33fa6b640 1 -- 172.21.15.172:0/3862867082 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb338073990 con 0x7fb33815da70 2024-04-25T08:42:34.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.635+0000 7fb32e7fc640 1 -- 172.21.15.172:0/3862867082 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7fb330058e80 con 0x7fb33815da70 2024-04-25T08:42:34.628 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:34.628 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:34.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.637+0000 7fb33fa6b640 1 -- 172.21.15.172:0/3862867082 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb31c06b4d0 msgr2=0x7fb31c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.637+0000 7fb33fa6b640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb31c06b4d0 0x7fb31c06d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb334034000 tx=0x7fb33402f000 comp rx=0 tx=0).stop 2024-04-25T08:42:34.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.637+0000 7fb33fa6b640 1 -- 172.21.15.172:0/3862867082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 msgr2=0x7fb33815b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.637+0000 7fb33fa6b640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 0x7fb33815b500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c440 tx=0x7fb33000c900 comp rx=0 tx=0).stop 2024-04-25T08:42:34.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.637+0000 7fb33fa6b640 1 -- 172.21.15.172:0/3862867082 shutdown_connections 2024-04-25T08:42:34.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.637+0000 7fb33fa6b640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb31c06b4d0 0x7fb31c06d990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.637+0000 7fb33fa6b640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3380ce8d0 0x7fb33814c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.637+0000 7fb33fa6b640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33815da70 0x7fb33815b500 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.637+0000 7fb33fa6b640 1 --2- 172.21.15.172:0/3862867082 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3380c7730 0x7fb3380c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.637+0000 7fb33fa6b640 1 -- 172.21.15.172:0/3862867082 >> 172.21.15.172:0/3862867082 conn(0x7fb3380b33e0 msgr2=0x7fb3380b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:34.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.638+0000 7fb33fa6b640 1 -- 172.21.15.172:0/3862867082 shutdown_connections 2024-04-25T08:42:34.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.638+0000 7fb33fa6b640 1 -- 172.21.15.172:0/3862867082 wait complete. 2024-04-25T08:42:34.656 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:42:34.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.805+0000 7faea6189640 1 Processor -- start 2024-04-25T08:42:34.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.805+0000 7faea6189640 1 -- start start 2024-04-25T08:42:34.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.806+0000 7faea6189640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faea01648e0 0x7faea0166cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.806+0000 7faea6189640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea00b5a40 con 0x7faea015bd30 2024-04-25T08:42:34.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.806+0000 7faea6189640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea00d0350 con 0x7faea00d13f0 2024-04-25T08:42:34.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.806+0000 7faea6189640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea00d0630 con 0x7faea01648e0 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.806+0000 7fae9f7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7faea015bd30 0x7faea00cf900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57588/0 (socket says 172.21.15.172:57588) 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.806+0000 7fae9f7fe640 1 -- 172.21.15.172:0/603557780 learned_addr learned my addr 172.21.15.172:0/603557780 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.806+0000 7fae9ffff640 1 --2- 172.21.15.172:0/603557780 >> v2:172.21.15.186:3300/0 conn(0x7faea01648e0 0x7faea0166cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.806+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420757617 0 0) 0x7faea00b5a40 con 0x7faea015bd30 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae88003520 con 0x7faea015bd30 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64564317 0 0) 0x7faea00d0350 con 0x7faea00d13f0 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faea00b5a40 con 0x7faea00d13f0 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2836985620 0 0) 0x7fae88003520 con 0x7faea015bd30 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 >> v2:172.21.15.186:3300/0 conn(0x7faea01648e0 msgr2=0x7faea0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 --2- 172.21.15.172:0/603557780 >> v2:172.21.15.186:3300/0 conn(0x7faea01648e0 0x7faea0166cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 >> v1:172.21.15.186:6789/0 conn(0x7faea00d13f0 legacy=0x7faea00d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea00d0910 con 0x7faea015bd30 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fae90001670 con 0x7faea015bd30 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 >> v1:172.21.15.172:6789/0 conn(0x7faea015bd30 legacy=0x7faea00cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae88003b90 0x7fae88003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae88004800 0x7fae88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae880051c0 0x7fae8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea00d0630 con 0x7fae88003b90 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8800bfe0 con 0x7fae88004800 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8800c1e0 con 0x7fae880051c0 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9f7fe640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae88003b90 0x7fae88003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9effd640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae88004800 0x7fae88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9ffff640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae880051c0 0x7fae8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9f7fe640 1 -- 172.21.15.172:0/603557780 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae880051c0 msgr2=0x7fae8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9f7fe640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae880051c0 0x7fae8800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9f7fe640 1 -- 172.21.15.172:0/603557780 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae88004800 msgr2=0x7fae88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9f7fe640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae88004800 0x7fae88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9f7fe640 1 -- 172.21.15.172:0/603557780 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae88003520 con 0x7fae88003b90 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.807+0000 7fae9ffff640 1 -- 172.21.15.172:0/603557780 reap_dead start 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.808+0000 7fae9f7fe640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae88003b90 0x7fae88003f90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae90007fa0 tx=0x7fae88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2e0e0e4c83945a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.808+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90007bc0 con 0x7fae88003b90 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.808+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90005af0 con 0x7fae88003b90 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.808+0000 7fae9e7fc640 1 -- 172.21.15.172:0/603557780 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90007070 con 0x7fae88003b90 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.808+0000 7faea6189640 1 -- 172.21.15.172:0/603557780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae88003b90 msgr2=0x7fae88003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.809+0000 7faea6189640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae88003b90 0x7fae88003f90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae90007fa0 tx=0x7fae88005830 comp rx=0 tx=0).stop 2024-04-25T08:42:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.809+0000 7faea6189640 1 -- 172.21.15.172:0/603557780 shutdown_connections 2024-04-25T08:42:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.809+0000 7faea6189640 1 --2- 172.21.15.172:0/603557780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae88003b90 0x7fae88003f90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.809+0000 7faea6189640 1 -- 172.21.15.172:0/603557780 >> 172.21.15.172:0/603557780 conn(0x7faea006f590 msgr2=0x7faea006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.809+0000 7faea6189640 1 -- 172.21.15.172:0/603557780 shutdown_connections 2024-04-25T08:42:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.809+0000 7faea6189640 1 -- 172.21.15.172:0/603557780 wait complete. 2024-04-25T08:42:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.810+0000 7faea6189640 1 Processor -- start 2024-04-25T08:42:34.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.810+0000 7faea6189640 1 -- start start 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7faea6189640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae88003b90 0x7faea014af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7faea6189640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faea0157cb0 0x7faea01591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7faea6189640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faea0159720 0x7faea015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7faea6189640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea015c110 con 0x7faea0159720 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7faea6189640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea00d0ed0 con 0x7faea0157cb0 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7faea6189640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea00b73b0 con 0x7fae88003b90 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faea0159720 0x7faea015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faea0159720 0x7faea015a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41578/0 (socket says 172.21.15.172:41578) 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9ffff640 1 -- 172.21.15.172:0/7918472 learned_addr learned my addr 172.21.15.172:0/7918472 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9effd640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faea0157cb0 0x7faea01591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9f7fe640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae88003b90 0x7faea014af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9ffff640 1 -- 172.21.15.172:0/7918472 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae88003b90 msgr2=0x7faea014af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9ffff640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae88003b90 0x7faea014af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9ffff640 1 -- 172.21.15.172:0/7918472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faea0157cb0 msgr2=0x7faea01591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9ffff640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faea0157cb0 0x7faea01591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9ffff640 1 -- 172.21.15.172:0/7918472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea014b480 con 0x7faea0159720 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9f7fe640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae88003b90 0x7faea014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae9ffff640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faea0159720 0x7faea015a660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faea00b6fe0 tx=0x7fae980115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae87fff640 1 -- 172.21.15.172:0/7918472 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98011e10 con 0x7faea0159720 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae87fff640 1 -- 172.21.15.172:0/7918472 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9801b070 con 0x7faea0159720 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7faea6189640 1 -- 172.21.15.172:0/7918472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea0158140 con 0x7faea0159720 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7fae87fff640 1 -- 172.21.15.172:0/7918472 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98003990 con 0x7faea0159720 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.811+0000 7faea6189640 1 -- 172.21.15.172:0/7918472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea0158700 con 0x7faea0159720 2024-04-25T08:42:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.812+0000 7faea6189640 1 -- 172.21.15.172:0/7918472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea0073990 con 0x7faea0159720 2024-04-25T08:42:34.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.813+0000 7fae87fff640 1 -- 172.21.15.172:0/7918472 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae98005d10 con 0x7faea0159720 2024-04-25T08:42:34.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.813+0000 7fae87fff640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8c06b4d0 0x7fae8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:34.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.813+0000 7fae9f7fe640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8c06b4d0 0x7fae8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:34.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.813+0000 7fae87fff640 1 -- 172.21.15.172:0/7918472 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fae9808a880 con 0x7faea0159720 2024-04-25T08:42:34.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.814+0000 7fae9f7fe640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8c06b4d0 0x7fae8c06d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fae90032000 tx=0x7fae90009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:34.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:34.817+0000 7fae87fff640 1 -- 172.21.15.172:0/7918472 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae98059450 con 0x7faea0159720 2024-04-25T08:42:35.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.024+0000 7faea6189640 1 -- 172.21.15.172:0/7918472 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faea00b61d0 con 0x7faea0159720 2024-04-25T08:42:35.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.024+0000 7fae87fff640 1 -- 172.21.15.172:0/7918472 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4943 (secure 0 0 0) 0x7fae98058d50 con 0x7faea0159720 2024-04-25T08:42:35.017 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:35.017 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:42:28.003161+0000","modified":"2024-04-25T08:42:33.044941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-25T08:42:35.018 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 6 2024-04-25T08:42:35.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.026+0000 7faea6189640 1 -- 172.21.15.172:0/7918472 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8c06b4d0 msgr2=0x7fae8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.026+0000 7faea6189640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8c06b4d0 0x7fae8c06d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fae90032000 tx=0x7fae90009030 comp rx=0 tx=0).stop 2024-04-25T08:42:35.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.026+0000 7faea6189640 1 -- 172.21.15.172:0/7918472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faea0159720 msgr2=0x7faea015a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.026+0000 7faea6189640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faea0159720 0x7faea015a660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faea00b6fe0 tx=0x7fae980115a0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.026+0000 7faea6189640 1 -- 172.21.15.172:0/7918472 shutdown_connections 2024-04-25T08:42:35.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.026+0000 7faea6189640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8c06b4d0 0x7fae8c06d990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.026+0000 7faea6189640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faea0157cb0 0x7faea01591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.026+0000 7faea6189640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faea0159720 0x7faea015a660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.026+0000 7faea6189640 1 --2- 172.21.15.172:0/7918472 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae88003b90 0x7faea014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.026+0000 7faea6189640 1 -- 172.21.15.172:0/7918472 >> 172.21.15.172:0/7918472 conn(0x7faea006f590 msgr2=0x7faea0154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:35.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.027+0000 7faea6189640 1 -- 172.21.15.172:0/7918472 shutdown_connections 2024-04-25T08:42:35.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.027+0000 7faea6189640 1 -- 172.21.15.172:0/7918472 wait complete. 2024-04-25T08:42:35.030 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:35.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.134+0000 7fafb6a38640 1 Processor -- start 2024-04-25T08:42:35.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.134+0000 7fafb6a38640 1 -- start start 2024-04-25T08:42:35.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.134+0000 7fafb6a38640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fafb015dc00 0x7fafb00c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.134+0000 7fafb6a38640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fafb00ceb20 0x7fafb00d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.134+0000 7fafb6a38640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb015dfe0 con 0x7fafb00d1c00 2024-04-25T08:42:35.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.134+0000 7fafb6a38640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00d2090 con 0x7fafb015dc00 2024-04-25T08:42:35.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.134+0000 7fafb6a38640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00d00c0 con 0x7fafb00ceb20 2024-04-25T08:42:35.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.135+0000 7fafaffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fafb015dc00 0x7fafb00c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.135+0000 7fafb4fd5640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fafb00d1c00 0x7fafb00ccc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57600/0 (socket says 172.21.15.172:57600) 2024-04-25T08:42:35.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.135+0000 7fafb4fd5640 1 -- 172.21.15.172:0/2554713729 learned_addr learned my addr 172.21.15.172:0/2554713729 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.135+0000 7fafaf7fe640 1 --2- 172.21.15.172:0/2554713729 >> v2:172.21.15.186:3300/0 conn(0x7fafb00ceb20 0x7fafb00d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.135+0000 7fafaffff640 1 -- 172.21.15.172:0/2554713729 >> v2:172.21.15.186:3300/0 conn(0x7fafb00ceb20 msgr2=0x7fafb00d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.135+0000 7fafaffff640 1 --2- 172.21.15.172:0/2554713729 >> v2:172.21.15.186:3300/0 conn(0x7fafb00ceb20 0x7fafb00d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.135+0000 7fafaffff640 1 -- 172.21.15.172:0/2554713729 >> v1:172.21.15.172:6789/0 conn(0x7fafb00d1c00 legacy=0x7fafb00ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.135+0000 7fafaeffd640 1 -- 172.21.15.172:0/2554713729 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323186988 0 0) 0x7fafa8001490 con 0x7fafb00d1c00 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.135+0000 7fafaffff640 1 -- 172.21.15.172:0/2554713729 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00d03a0 con 0x7fafb015dc00 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.135+0000 7fafaf7fe640 1 --2- 172.21.15.172:0/2554713729 >> v2:172.21.15.186:3300/0 conn(0x7fafb00ceb20 0x7fafb00d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafaffff640 1 --2- 172.21.15.172:0/2554713729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb015dc00 0x7fafb00c6df0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fafb00c8820 tx=0x7faf9802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa57d2534e3812d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafaeffd640 1 -- 172.21.15.172:0/2554713729 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98037070 con 0x7fafb015dc00 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafaeffd640 1 -- 172.21.15.172:0/2554713729 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf98032440 con 0x7fafb015dc00 2024-04-25T08:42:35.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafaeffd640 1 -- 172.21.15.172:0/2554713729 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98032810 con 0x7fafb015dc00 2024-04-25T08:42:35.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafb6a38640 1 -- 172.21.15.172:0/2554713729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb015dc00 msgr2=0x7fafb00c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafb6a38640 1 --2- 172.21.15.172:0/2554713729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb015dc00 0x7fafb00c6df0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fafb00c8820 tx=0x7faf9802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafb6a38640 1 -- 172.21.15.172:0/2554713729 shutdown_connections 2024-04-25T08:42:35.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafb6a38640 1 --2- 172.21.15.172:0/2554713729 >> v2:172.21.15.186:3300/0 conn(0x7fafb00ceb20 0x7fafb00d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafb6a38640 1 --2- 172.21.15.172:0/2554713729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb015dc00 0x7fafb00c6df0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafb6a38640 1 -- 172.21.15.172:0/2554713729 >> 172.21.15.172:0/2554713729 conn(0x7fafb006f5d0 msgr2=0x7fafb006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:35.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafb6a38640 1 -- 172.21.15.172:0/2554713729 shutdown_connections 2024-04-25T08:42:35.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.136+0000 7fafb6a38640 1 -- 172.21.15.172:0/2554713729 wait complete. 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.137+0000 7fafb6a38640 1 Processor -- start 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.138+0000 7fafb6a38640 1 -- start start 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.138+0000 7fafb6a38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb00ceb20 0x7fafb014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.138+0000 7fafb6a38640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafb00d1c00 0x7fafb01e7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.138+0000 7fafb6a38640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafb015dc00 0x7fafb015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.138+0000 7fafb6a38640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00cc130 con 0x7fafb00ceb20 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.138+0000 7fafb6a38640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00cc720 con 0x7fafb00d1c00 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.138+0000 7fafb6a38640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00cfd90 con 0x7fafb015dc00 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.138+0000 7fafaffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb00ceb20 0x7fafb014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.138+0000 7fafaffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb00ceb20 0x7fafb014a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41602/0 (socket says 172.21.15.172:41602) 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.138+0000 7fafaffff640 1 -- 172.21.15.172:0/632860246 learned_addr learned my addr 172.21.15.172:0/632860246 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafaf7fe640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafb00d1c00 0x7fafb01e7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafb4fd5640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafb015dc00 0x7fafb015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafaffff640 1 -- 172.21.15.172:0/632860246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafb015dc00 msgr2=0x7fafb015bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafaffff640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafb015dc00 0x7fafb015bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafaffff640 1 -- 172.21.15.172:0/632860246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafb00d1c00 msgr2=0x7fafb01e7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafaffff640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafb00d1c00 0x7fafb01e7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafaffff640 1 -- 172.21.15.172:0/632860246 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb01e7f60 con 0x7fafb00ceb20 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafaf7fe640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafb00d1c00 0x7fafb01e7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafb4fd5640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafb015dc00 0x7fafb015bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafaffff640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb00ceb20 0x7fafb014a360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf98000c00 tx=0x7faf980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafacff9640 1 -- 172.21.15.172:0/632860246 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98037040 con 0x7fafb00ceb20 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafacff9640 1 -- 172.21.15.172:0/632860246 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf98042070 con 0x7fafb00ceb20 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafacff9640 1 -- 172.21.15.172:0/632860246 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf98030a50 con 0x7fafb00ceb20 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafb6a38640 1 -- 172.21.15.172:0/632860246 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb01e8240 con 0x7fafb00ceb20 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.139+0000 7fafb6a38640 1 -- 172.21.15.172:0/632860246 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb01e8800 con 0x7fafb00ceb20 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.140+0000 7fafb6a38640 1 -- 172.21.15.172:0/632860246 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb0073990 con 0x7fafb00ceb20 2024-04-25T08:42:35.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.140+0000 7fafacff9640 1 -- 172.21.15.172:0/632860246 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf98030bf0 con 0x7fafb00ceb20 2024-04-25T08:42:35.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.141+0000 7fafacff9640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf9006b4d0 0x7faf9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.141+0000 7fafaf7fe640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf9006b4d0 0x7faf9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.141+0000 7fafacff9640 1 -- 172.21.15.172:0/632860246 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faf980aaf40 con 0x7fafb00ceb20 2024-04-25T08:42:35.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.141+0000 7fafaf7fe640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf9006b4d0 0x7faf9006d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fafa0006fd0 tx=0x7fafa0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.145+0000 7fafacff9640 1 -- 172.21.15.172:0/632860246 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf98079c30 con 0x7fafb00ceb20 2024-04-25T08:42:35.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.316+0000 7fafb6a38640 1 -- 172.21.15.172:0/632860246 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafb006c1a0 con 0x7fafb00ceb20 2024-04-25T08:42:35.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.317+0000 7fafacff9640 1 -- 172.21.15.172:0/632860246 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7faf98079530 con 0x7fafb00ceb20 2024-04-25T08:42:35.310 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:35.310 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.319+0000 7fafb6a38640 1 -- 172.21.15.172:0/632860246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf9006b4d0 msgr2=0x7faf9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.319+0000 7fafb6a38640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf9006b4d0 0x7faf9006d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fafa0006fd0 tx=0x7fafa0008040 comp rx=0 tx=0).stop 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.319+0000 7fafb6a38640 1 -- 172.21.15.172:0/632860246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb00ceb20 msgr2=0x7fafb014a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.319+0000 7fafb6a38640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb00ceb20 0x7fafb014a360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf98000c00 tx=0x7faf980046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.319+0000 7fafb6a38640 1 -- 172.21.15.172:0/632860246 shutdown_connections 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.319+0000 7fafb6a38640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf9006b4d0 0x7faf9006d990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.319+0000 7fafb6a38640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafb00d1c00 0x7fafb01e7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.319+0000 7fafb6a38640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafb015dc00 0x7fafb015bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.319+0000 7fafb6a38640 1 --2- 172.21.15.172:0/632860246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafb00ceb20 0x7fafb014a360 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.319+0000 7fafb6a38640 1 -- 172.21.15.172:0/632860246 >> 172.21.15.172:0/632860246 conn(0x7fafb006f5d0 msgr2=0x7fafb006ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:35.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.320+0000 7fafb6a38640 1 -- 172.21.15.172:0/632860246 shutdown_connections 2024-04-25T08:42:35.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.320+0000 7fafb6a38640 1 -- 172.21.15.172:0/632860246 wait complete. 2024-04-25T08:42:35.726 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:42:28.003161+0000', 'modified': '2024-04-25T08:42:33.044941+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6835/3177493296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6833', 'nonce': 3177493296}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 3177493296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-04-25T08:42:35.726 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:42:35.727 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T08:42:35.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.833+0000 7fbcec05d640 1 Processor -- start 2024-04-25T08:42:35.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.833+0000 7fbcec05d640 1 -- start start 2024-04-25T08:42:35.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbcec05d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbce415ba80 0x7fbce40cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbcec05d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbce415c990 0x7fbce40ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbcec05d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbce40cf080 0x7fbce415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbcec05d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce4070130 con 0x7fbce415ba80 2024-04-25T08:42:35.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbcec05d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce415ce20 con 0x7fbce415c990 2024-04-25T08:42:35.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbcec05d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce406fe50 con 0x7fbce40cf080 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbce9df9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbce415ba80 0x7fbce40cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbce9df9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbce415ba80 0x7fbce40cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41618/0 (socket says 172.21.15.172:41618) 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbce9df9640 1 -- 172.21.15.172:0/4255915493 learned_addr learned my addr 172.21.15.172:0/4255915493 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbce95f8640 1 --2- 172.21.15.172:0/4255915493 >> v2:172.21.15.186:3300/0 conn(0x7fbce415c990 0x7fbce40ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbcea5fa640 1 --2- 172.21.15.172:0/4255915493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbce40cf080 0x7fbce415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbce9df9640 1 -- 172.21.15.172:0/4255915493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbce40cf080 msgr2=0x7fbce415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbce9df9640 1 --2- 172.21.15.172:0/4255915493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbce40cf080 0x7fbce415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbce9df9640 1 -- 172.21.15.172:0/4255915493 >> v2:172.21.15.186:3300/0 conn(0x7fbce415c990 msgr2=0x7fbce40ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbce9df9640 1 --2- 172.21.15.172:0/4255915493 >> v2:172.21.15.186:3300/0 conn(0x7fbce415c990 0x7fbce40ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.834+0000 7fbce9df9640 1 -- 172.21.15.172:0/4255915493 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce40cc8b0 con 0x7fbce415ba80 2024-04-25T08:42:35.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.835+0000 7fbce9df9640 1 --2- 172.21.15.172:0/4255915493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415ba80 0x7fbce40cd390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbce4072ee0 tx=0x7fbce002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78fe6d572bb67d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.835+0000 7fbce8df7640 1 -- 172.21.15.172:0/4255915493 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0036070 con 0x7fbce415ba80 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.835+0000 7fbce8df7640 1 -- 172.21.15.172:0/4255915493 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce0031600 con 0x7fbce415ba80 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.835+0000 7fbce8df7640 1 -- 172.21.15.172:0/4255915493 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00319d0 con 0x7fbce415ba80 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.836+0000 7fbcec05d640 1 -- 172.21.15.172:0/4255915493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415ba80 msgr2=0x7fbce40cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.836+0000 7fbcec05d640 1 --2- 172.21.15.172:0/4255915493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415ba80 0x7fbce40cd390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbce4072ee0 tx=0x7fbce002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.836+0000 7fbcec05d640 1 -- 172.21.15.172:0/4255915493 shutdown_connections 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.836+0000 7fbcec05d640 1 --2- 172.21.15.172:0/4255915493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbce40cf080 0x7fbce415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.836+0000 7fbcec05d640 1 --2- 172.21.15.172:0/4255915493 >> v2:172.21.15.186:3300/0 conn(0x7fbce415c990 0x7fbce40ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.836+0000 7fbcec05d640 1 --2- 172.21.15.172:0/4255915493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415ba80 0x7fbce40cd390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.836+0000 7fbcec05d640 1 -- 172.21.15.172:0/4255915493 >> 172.21.15.172:0/4255915493 conn(0x7fbce406abe0 msgr2=0x7fbce406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.836+0000 7fbcec05d640 1 -- 172.21.15.172:0/4255915493 shutdown_connections 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.836+0000 7fbcec05d640 1 -- 172.21.15.172:0/4255915493 wait complete. 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.837+0000 7fbcec05d640 1 Processor -- start 2024-04-25T08:42:35.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.837+0000 7fbcec05d640 1 -- start start 2024-04-25T08:42:35.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcec05d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbce40cf080 0x7fbce41444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcec05d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbce415ba80 0x7fbce41e5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcec05d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415c990 0x7fbce4144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcec05d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40cf510 con 0x7fbce415c990 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcec05d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40cce70 con 0x7fbce415ba80 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcec05d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce406fb00 con 0x7fbce40cf080 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcea5fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415c990 0x7fbce4144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcea5fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415c990 0x7fbce4144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41622/0 (socket says 172.21.15.172:41622) 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcea5fa640 1 -- 172.21.15.172:0/2157835819 learned_addr learned my addr 172.21.15.172:0/2157835819 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcea5fa640 1 -- 172.21.15.172:0/2157835819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbce40cf080 msgr2=0x7fbce41444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcea5fa640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbce40cf080 0x7fbce41444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbce95f8640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbce415ba80 0x7fbce41e5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcea5fa640 1 -- 172.21.15.172:0/2157835819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbce415ba80 msgr2=0x7fbce41e5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcea5fa640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbce415ba80 0x7fbce41e5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcea5fa640 1 -- 172.21.15.172:0/2157835819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce41e4f10 con 0x7fbce415c990 2024-04-25T08:42:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcea5fa640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415c990 0x7fbce4144fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00d600 tx=0x7fbcdc00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcda7fc640 1 -- 172.21.15.172:0/2157835819 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc018020 con 0x7fbce415c990 2024-04-25T08:42:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcda7fc640 1 -- 172.21.15.172:0/2157835819 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc014620 con 0x7fbce415c990 2024-04-25T08:42:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcec05d640 1 -- 172.21.15.172:0/2157835819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce41e51f0 con 0x7fbce415c990 2024-04-25T08:42:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcda7fc640 1 -- 172.21.15.172:0/2157835819 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc0149f0 con 0x7fbce415c990 2024-04-25T08:42:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.838+0000 7fbcec05d640 1 -- 172.21.15.172:0/2157835819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce41e57b0 con 0x7fbce415c990 2024-04-25T08:42:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.840+0000 7fbcda7fc640 1 -- 172.21.15.172:0/2157835819 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbcdc01b020 con 0x7fbce415c990 2024-04-25T08:42:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.840+0000 7fbcda7fc640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbcc806b4d0 0x7fbcc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.840+0000 7fbce9df9640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbcc806b4d0 0x7fbcc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.840+0000 7fbcda7fc640 1 -- 172.21.15.172:0/2157835819 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbcdc08a770 con 0x7fbce415c990 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.841+0000 7fbce9df9640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbcc806b4d0 0x7fbcc806d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbce0033000 tx=0x7fbce002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.841+0000 7fbceee39740 1 Processor -- start 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.841+0000 7fbceee39740 1 -- start start 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbceee39740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038eeb2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbceee39740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eecfad0 0x56038eed0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbceee39740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038ee87f10 0x56038eece190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbceee39740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56038edeaa10 con 0x56038eeb2230 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbceee39740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56038ed93b30 con 0x56038eecfad0 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbceee39740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56038ede6c50 con 0x56038ee87f10 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbce9df9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038eeb2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbce9df9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038eeb2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41638/0 (socket says 172.21.15.172:41638) 2024-04-25T08:42:35.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbce9df9640 1 -- 172.21.15.172:0/155013221 learned_addr learned my addr 172.21.15.172:0/155013221 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbce9df9640 1 -- 172.21.15.172:0/155013221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038ee87f10 msgr2=0x56038eece190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbce9df9640 1 --2- 172.21.15.172:0/155013221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038ee87f10 0x56038eece190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbce9df9640 1 -- 172.21.15.172:0/155013221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eecfad0 msgr2=0x56038eed0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbce9df9640 1 --2- 172.21.15.172:0/155013221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eecfad0 0x56038eed0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.842+0000 7fbce9df9640 1 -- 172.21.15.172:0/155013221 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56038eda8e10 con 0x56038eeb2230 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbce9df9640 1 --2- 172.21.15.172:0/155013221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038eeb2610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009f10 tx=0x7fbce002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31547163786f6729 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbcc77fe640 1 -- 172.21.15.172:0/155013221 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce003b600 con 0x56038eeb2230 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbcc77fe640 1 -- 172.21.15.172:0/155013221 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce004c070 con 0x56038eeb2230 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbcc77fe640 1 -- 172.21.15.172:0/155013221 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce003b9a0 con 0x56038eeb2230 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbceee39740 1 -- 172.21.15.172:0/155013221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 msgr2=0x56038eeb2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbceee39740 1 --2- 172.21.15.172:0/155013221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038eeb2610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009f10 tx=0x7fbce002f000 comp rx=0 tx=0).stop 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbceee39740 1 -- 172.21.15.172:0/155013221 shutdown_connections 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbceee39740 1 --2- 172.21.15.172:0/155013221 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eecfad0 0x56038eed0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbceee39740 1 --2- 172.21.15.172:0/155013221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038ee87f10 0x56038eece190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbceee39740 1 --2- 172.21.15.172:0/155013221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038eeb2610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbceee39740 1 -- 172.21.15.172:0/155013221 >> 172.21.15.172:0/155013221 conn(0x56038ee84840 msgr2=0x56038eecd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:35.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbceee39740 1 -- 172.21.15.172:0/155013221 shutdown_connections 2024-04-25T08:42:35.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.843+0000 7fbceee39740 1 -- 172.21.15.172:0/155013221 wait complete. 2024-04-25T08:42:35.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.844+0000 7fbceee39740 1 -- start start 2024-04-25T08:42:35.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.844+0000 7fbceee39740 1 Processor -- start 2024-04-25T08:42:35.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbceee39740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb2230 0x56038ee9cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbceee39740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038eeb5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbceee39740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eee0ac0 0x56038eee0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbceee39740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56038ee88cb0 con 0x56038eecfad0 2024-04-25T08:42:35.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbceee39740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56038eda70c0 con 0x56038eeb2230 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbceee39740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56038ee82770 con 0x56038eee0ac0 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbceee39740 10 client.0 _ll_register_callbacks cb 0x56038ed9aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbce95f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038eeb5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbce95f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038eeb5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41640/0 (socket says 172.21.15.172:41640) 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbce95f8640 1 -- 172.21.15.172:0/2619329577 learned_addr learned my addr 172.21.15.172:0/2619329577 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbce9df9640 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb2230 0x56038ee9cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbcea5fa640 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eee0ac0 0x56038eee0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbce95f8640 1 -- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eee0ac0 msgr2=0x56038eee0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbce95f8640 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eee0ac0 0x56038eee0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbce95f8640 1 -- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb2230 msgr2=0x56038ee9cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbce95f8640 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb2230 0x56038ee9cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbce95f8640 1 -- 172.21.15.172:0/2619329577 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56038eaff2d0 con 0x56038eecfad0 2024-04-25T08:42:35.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbce95f8640 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038eeb5200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009fd0 tx=0x7fbcd400e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4486984caed93d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.845+0000 7fbcc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/2619329577 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd400f040 con 0x56038eecfad0 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/2619329577 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbcd4004030 con 0x56038eecfad0 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbceee39740 1 -- 172.21.15.172:0/2619329577 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbce004c070 con 0x56038eecfad0 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/2619329577 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcd4020050 con 0x56038eecfad0 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbceee39740 10 client.4431 fetch_fsmap learned FSMap version 6 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbceee39740 1 -- 172.21.15.172:0/2619329577 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x56038ebc96b0 con 0x56038eecfad0 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/2619329577 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce004c070 con 0x56038eecfad0 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/2619329577 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fbcd4023020 con 0x56038eecfad0 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbceee39740 10 client.4431 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbceee39740 10 client.4431 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbceee39740 20 client.4431 populate_metadata read hostname 'smithi172' 2024-04-25T08:42:35.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbceee39740 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x56038eeb3cc0 0x56038eeddb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbceee39740 4 client.4431 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbceee39740 1 -- 172.21.15.172:0/2619329577 --> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56038ee49920 con 0x56038eeb3cc0 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.846+0000 7fbce9df9640 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x56038eeb3cc0 0x56038eeddb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.847+0000 7fbcc4ff9640 10 client.4431 ms_handle_connect on v2:172.21.15.186:6833/3177493296 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.847+0000 7fbce9df9640 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x56038eeb3cc0 0x56038eeddb50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3b04891061ae89a server_cookie=4e7e79c2e8df527b in_seq=0 out_seq=0 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.847+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/2619329577 <== mds.0 v2:172.21.15.186:6833/3177493296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56038ee49920 con 0x56038eeb3cc0 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.847+0000 7fbcc4ff9640 10 client.4431 handle_command_reply: tid=0 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.847+0000 7fbceee39740 1 client.4431 shutdown 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 1 -- 172.21.15.172:0/2619329577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 msgr2=0x56038eeb5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038eeb5200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009fd0 tx=0x7fbcd400e600 comp rx=0 tx=0).stop 2024-04-25T08:42:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 1 -- 172.21.15.172:0/2619329577 shutdown_connections 2024-04-25T08:42:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x56038eeb3cc0 0x56038eeddb50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eee0ac0 0x56038eee0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbcc4ff9640 0 client.4431 ms_handle_reset on v2:172.21.15.186:6833/3177493296 2024-04-25T08:42:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038eeb5200 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 1 --2- 172.21.15.172:0/2619329577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb2230 0x56038ee9cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 1 -- 172.21.15.172:0/2619329577 >> 172.21.15.172:0/2619329577 conn(0x56038ee87f10 msgr2=0x56038eed05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 1 -- 172.21.15.172:0/2619329577 shutdown_connections 2024-04-25T08:42:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 1 -- 172.21.15.172:0/2619329577 wait complete. 2024-04-25T08:42:35.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.848+0000 7fbceee39740 20 client.4431 trim_cache size 0 max 16384 2024-04-25T08:42:35.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.863+0000 7fbceee39740 1 Processor -- start 2024-04-25T08:42:35.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbceee39740 1 -- start start 2024-04-25T08:42:35.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbceee39740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb2230 0x56038eec5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbceee39740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eeb3cc0 0x56038ee88350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbceee39740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038ee88890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbceee39740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce41fe220 con 0x56038eecfad0 2024-04-25T08:42:35.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbceee39740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce41fd620 con 0x56038eeb2230 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbceee39740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce41fdc20 con 0x56038eeb3cc0 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbcea5fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038ee88890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbcea5fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038ee88890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41648/0 (socket says 172.21.15.172:41648) 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbcea5fa640 1 -- 172.21.15.172:0/3596665408 learned_addr learned my addr 172.21.15.172:0/3596665408 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.864+0000 7fbcea5fa640 1 -- 172.21.15.172:0/3596665408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eeb3cc0 msgr2=0x56038ee88350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbcea5fa640 1 --2- 172.21.15.172:0/3596665408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eeb3cc0 0x56038ee88350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbcea5fa640 1 -- 172.21.15.172:0/3596665408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb2230 msgr2=0x56038eec5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbcea5fa640 1 --2- 172.21.15.172:0/3596665408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb2230 0x56038eec5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbcea5fa640 1 -- 172.21.15.172:0/3596665408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56038eee1650 con 0x56038eecfad0 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbcea5fa640 1 --2- 172.21.15.172:0/3596665408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038ee88890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0888c0 tx=0x7fbcdc08a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8925ea500c13955 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbcc6ffd640 1 -- 172.21.15.172:0/3596665408 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc070020 con 0x56038eecfad0 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbcc6ffd640 1 -- 172.21.15.172:0/3596665408 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc0889d0 con 0x56038eecfad0 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbcc6ffd640 1 -- 172.21.15.172:0/3596665408 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc014b90 con 0x56038eecfad0 2024-04-25T08:42:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbceee39740 1 -- 172.21.15.172:0/3596665408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 msgr2=0x56038ee88890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbceee39740 1 --2- 172.21.15.172:0/3596665408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038ee88890 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0888c0 tx=0x7fbcdc08a040 comp rx=0 tx=0).stop 2024-04-25T08:42:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbceee39740 1 -- 172.21.15.172:0/3596665408 shutdown_connections 2024-04-25T08:42:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbceee39740 1 --2- 172.21.15.172:0/3596665408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eecfad0 0x56038ee88890 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbceee39740 1 --2- 172.21.15.172:0/3596665408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eeb3cc0 0x56038ee88350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbceee39740 1 --2- 172.21.15.172:0/3596665408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb2230 0x56038eec5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbceee39740 1 -- 172.21.15.172:0/3596665408 >> 172.21.15.172:0/3596665408 conn(0x56038ee87f10 msgr2=0x56038ee7dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbceee39740 1 -- 172.21.15.172:0/3596665408 shutdown_connections 2024-04-25T08:42:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.865+0000 7fbceee39740 1 -- 172.21.15.172:0/3596665408 wait complete. 2024-04-25T08:42:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.866+0000 7fbceee39740 1 -- start start 2024-04-25T08:42:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.866+0000 7fbceee39740 1 Processor -- start 2024-04-25T08:42:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbceee39740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038ef3c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbceee39740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb3cc0 0x56038eec2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbceee39740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eecfad0 0x56038eecaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbceee39740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56038eeb3b40 con 0x56038eeb2230 2024-04-25T08:42:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbceee39740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56038eeb3100 con 0x56038eeb3cc0 2024-04-25T08:42:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbceee39740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56038eeb4110 con 0x56038eecfad0 2024-04-25T08:42:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbceee39740 10 client.0 _ll_register_callbacks cb 0x56038ee82c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:42:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbce9df9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038ef3c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbce9df9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038ef3c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41658/0 (socket says 172.21.15.172:41658) 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbce9df9640 1 -- 172.21.15.172:0/1981838853 learned_addr learned my addr 172.21.15.172:0/1981838853 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbce95f8640 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb3cc0 0x56038eec2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbcea5fa640 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eecfad0 0x56038eecaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbce9df9640 1 -- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eecfad0 msgr2=0x56038eecaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbce9df9640 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eecfad0 0x56038eecaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbce9df9640 1 -- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb3cc0 msgr2=0x56038eec2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbce9df9640 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb3cc0 0x56038eec2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbce9df9640 1 -- 172.21.15.172:0/1981838853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56038ee817e0 con 0x56038eeb2230 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbce9df9640 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038ef3c2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbce002a6e0 tx=0x7fbce0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a7abbbbb5b9dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbcc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/1981838853 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce005f060 con 0x56038eeb2230 2024-04-25T08:42:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/1981838853 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbce005ad70 con 0x56038eeb2230 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.867+0000 7fbceee39740 1 -- 172.21.15.172:0/1981838853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbcdc0889d0 con 0x56038eeb2230 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/1981838853 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbce0065050 con 0x56038eeb2230 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbceee39740 10 client.4437 fetch_fsmap learned FSMap version 6 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbceee39740 1 -- 172.21.15.172:0/1981838853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x56038eeb1be0 con 0x56038eeb2230 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/1981838853 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc0889d0 con 0x56038eeb2230 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/1981838853 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fbce0068020 con 0x56038eeb2230 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbceee39740 10 client.4437 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbceee39740 10 client.4437 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbceee39740 20 client.4437 populate_metadata read hostname 'smithi172' 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbceee39740 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x56038eee0ac0 0x56038ee886f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbceee39740 4 client.4437 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbceee39740 1 -- 172.21.15.172:0/1981838853 --> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56038edf7f50 con 0x56038eee0ac0 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbce95f8640 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x56038eee0ac0 0x56038ee886f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbcc4ff9640 10 client.4437 ms_handle_connect on v2:172.21.15.186:6833/3177493296 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.868+0000 7fbce95f8640 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x56038eee0ac0 0x56038ee886f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ba2a005b4e5b1bc server_cookie=ea28121b30dccf20 in_seq=0 out_seq=0 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcc4ff9640 1 -- 172.21.15.172:0/1981838853 <== mds.0 v2:172.21.15.186:6833/3177493296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56038edf7f50 con 0x56038eee0ac0 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcc4ff9640 10 client.4437 handle_command_reply: tid=0 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 client.4437 shutdown 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 -- 172.21.15.172:0/1981838853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 msgr2=0x56038ef3c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038ef3c2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbce002a6e0 tx=0x7fbce0004a40 comp rx=0 tx=0).stop 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 -- 172.21.15.172:0/1981838853 shutdown_connections 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x56038eee0ac0 0x56038ee886f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56038eeb3cc0 0x56038eec2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56038eecfad0 0x56038eecaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcc4ff9640 0 client.4437 ms_handle_reset on v2:172.21.15.186:6833/3177493296 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 --2- 172.21.15.172:0/1981838853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56038eeb2230 0x56038ef3c2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 -- 172.21.15.172:0/1981838853 >> 172.21.15.172:0/1981838853 conn(0x56038ee87f10 msgr2=0x56038eecb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 -- 172.21.15.172:0/1981838853 shutdown_connections 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 1 -- 172.21.15.172:0/1981838853 wait complete. 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbceee39740 20 client.4437 trim_cache size 0 max 16384 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 4287, 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:42:35.868 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 7.2006993140000004, 2024-04-25T08:42:35.869 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 6, 2024-04-25T08:42:35.869 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 24, 2024-04-25T08:42:35.869 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 23, 2024-04-25T08:42:35.869 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 13.758971750000001 2024-04-25T08:42:35.869 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:42:35.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 -- 172.21.15.172:0/2157835819 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbcc806b4d0 msgr2=0x7fbcc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbcc806b4d0 0x7fbcc806d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbce0033000 tx=0x7fbce002e000 comp rx=0 tx=0).stop 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 -- 172.21.15.172:0/2157835819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415c990 msgr2=0x7fbce4144fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415c990 0x7fbce4144fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00d600 tx=0x7fbcdc00dac0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 -- 172.21.15.172:0/2157835819 shutdown_connections 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbcc806b4d0 0x7fbcc806d990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbce415ba80 0x7fbce41e5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce415c990 0x7fbce4144fd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 --2- 172.21.15.172:0/2157835819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbce40cf080 0x7fbce41444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 -- 172.21.15.172:0/2157835819 >> 172.21.15.172:0/2157835819 conn(0x7fbce406abe0 msgr2=0x7fbce40cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.869+0000 7fbcec05d640 1 -- 172.21.15.172:0/2157835819 shutdown_connections 2024-04-25T08:42:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.870+0000 7fbcec05d640 1 -- 172.21.15.172:0/2157835819 wait complete. 2024-04-25T08:42:35.873 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:42:35.873 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T08:42:35.873 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:42:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.977+0000 7fdcff7e0640 1 Processor -- start 2024-04-25T08:42:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.977+0000 7fdcff7e0640 1 -- start start 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.978+0000 7fdcff7e0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdcf815a790 0x7fdcf80d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.978+0000 7fdcff7e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf806fea0 0x7fdcf80d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.978+0000 7fdcff7e0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf80b3710 con 0x7fdcf80af9c0 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.978+0000 7fdcff7e0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf80cf0e0 con 0x7fdcf815a790 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.978+0000 7fdcff7e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80cf3c0 con 0x7fdcf806fea0 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.978+0000 7fdcfdd7d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fdcf80af9c0 0x7fdcf8072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57616/0 (socket says 172.21.15.172:57616) 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.978+0000 7fdcfdd7d640 1 -- 172.21.15.172:0/3729091838 learned_addr learned my addr 172.21.15.172:0/3729091838 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.978+0000 7fdcfd57c640 1 --2- 172.21.15.172:0/3729091838 >> v2:172.21.15.186:3300/0 conn(0x7fdcf815a790 0x7fdcf80d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdcfcd7b640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf806fea0 0x7fdcf80d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030800629 0 0) 0x7fdcf80b3710 con 0x7fdcf80af9c0 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce4003520 con 0x7fdcf80af9c0 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2108347941 0 0) 0x7fdce4003520 con 0x7fdcf80af9c0 2024-04-25T08:42:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf806fea0 msgr2=0x7fdcf80d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf806fea0 0x7fdcf80d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 >> v2:172.21.15.186:3300/0 conn(0x7fdcf815a790 msgr2=0x7fdcf80d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 --2- 172.21.15.172:0/3729091838 >> v2:172.21.15.186:3300/0 conn(0x7fdcf815a790 0x7fdcf80d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80cf6a0 con 0x7fdcf80af9c0 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fdcf0001670 con 0x7fdcf80af9c0 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdcfd57c640 1 --2- 172.21.15.172:0/3729091838 >> v2:172.21.15.186:3300/0 conn(0x7fdcf815a790 0x7fdcf80d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 >> v1:172.21.15.172:6789/0 conn(0x7fdcf80af9c0 legacy=0x7fdcf8072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce40039b0 0x7fdce4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf806fea0 0x7fdce4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdce4004d40 0x7fdce40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80cf0e0 con 0x7fdce4004d40 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80cf3c0 con 0x7fdce40039b0 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce400b9c0 con 0x7fdcf806fea0 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdcfdd7d640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdce4004d40 0x7fdce40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdcfd57c640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce40039b0 0x7fdce4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdcfcd7b640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf806fea0 0x7fdce4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdcfdd7d640 1 -- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf806fea0 msgr2=0x7fdce4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdcfdd7d640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf806fea0 0x7fdce4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdcfdd7d640 1 -- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce40039b0 msgr2=0x7fdce4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdcfdd7d640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce40039b0 0x7fdce4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.979+0000 7fdcfdd7d640 1 -- 172.21.15.172:0/3729091838 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce4003520 con 0x7fdce4004d40 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.980+0000 7fdcfdd7d640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdce4004d40 0x7fdce40051c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0007fd0 tx=0x7fdce4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b8c9e9d6be7a2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.980+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0007d50 con 0x7fdce4004d40 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.980+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf0005ad0 con 0x7fdce4004d40 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.980+0000 7fdceffff640 1 -- 172.21.15.172:0/3729091838 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0007070 con 0x7fdce4004d40 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.981+0000 7fdcff7e0640 1 -- 172.21.15.172:0/3729091838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdce4004d40 msgr2=0x7fdce40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.981+0000 7fdcff7e0640 1 --2- 172.21.15.172:0/3729091838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdce4004d40 0x7fdce40051c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0007fd0 tx=0x7fdce4005830 comp rx=0 tx=0).stop 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.981+0000 7fdcfdd7d640 1 -- 172.21.15.172:0/3729091838 reap_dead start 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.981+0000 7fdcff7e0640 1 -- 172.21.15.172:0/3729091838 shutdown_connections 2024-04-25T08:42:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.981+0000 7fdcff7e0640 1 -- 172.21.15.172:0/3729091838 >> 172.21.15.172:0/3729091838 conn(0x7fdcf80b2370 msgr2=0x7fdcf80b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:35.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.981+0000 7fdcff7e0640 1 -- 172.21.15.172:0/3729091838 shutdown_connections 2024-04-25T08:42:35.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.981+0000 7fdcff7e0640 1 -- 172.21.15.172:0/3729091838 wait complete. 2024-04-25T08:42:35.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.982+0000 7fdcff7e0640 1 Processor -- start 2024-04-25T08:42:35.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.982+0000 7fdcff7e0640 1 -- start start 2024-04-25T08:42:35.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcff7e0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce4004d40 0x7fdcf806ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcff7e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf80aeab0 0x7fdcf80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcff7e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf80ac7a0 0x7fdcf80acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcff7e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf815ab70 con 0x7fdcf80aeab0 2024-04-25T08:42:35.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcff7e0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80cf980 con 0x7fdce4004d40 2024-04-25T08:42:35.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcff7e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf815acf0 con 0x7fdcf80ac7a0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfcd7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf80aeab0 0x7fdcf80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfcd7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf80aeab0 0x7fdcf80aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41684/0 (socket says 172.21.15.172:41684) 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfcd7b640 1 -- 172.21.15.172:0/982734474 learned_addr learned my addr 172.21.15.172:0/982734474 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfd57c640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce4004d40 0x7fdcf806ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfdd7d640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf80ac7a0 0x7fdcf80acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfcd7b640 1 -- 172.21.15.172:0/982734474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf80ac7a0 msgr2=0x7fdcf80acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfcd7b640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf80ac7a0 0x7fdcf80acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfcd7b640 1 -- 172.21.15.172:0/982734474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce4004d40 msgr2=0x7fdcf806ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfcd7b640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce4004d40 0x7fdcf806ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfcd7b640 1 -- 172.21.15.172:0/982734474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80ad160 con 0x7fdcf80aeab0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcfcd7b640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf80aeab0 0x7fdcf80aef30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdce8011910 tx=0x7fdce8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcedffb640 1 -- 172.21.15.172:0/982734474 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8019070 con 0x7fdcf80aeab0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcedffb640 1 -- 172.21.15.172:0/982734474 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce8004240 con 0x7fdcf80aeab0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcff7e0640 1 -- 172.21.15.172:0/982734474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf80a9c30 con 0x7fdcf80aeab0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.983+0000 7fdcedffb640 1 -- 172.21.15.172:0/982734474 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce800f8e0 con 0x7fdcf80aeab0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.984+0000 7fdcff7e0640 1 -- 172.21.15.172:0/982734474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf80aa1b0 con 0x7fdcf80aeab0 2024-04-25T08:42:35.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.985+0000 7fdcff7e0640 1 -- 172.21.15.172:0/982734474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf8073990 con 0x7fdcf80aeab0 2024-04-25T08:42:35.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.985+0000 7fdcedffb640 1 -- 172.21.15.172:0/982734474 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdce801c070 con 0x7fdcf80aeab0 2024-04-25T08:42:35.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.985+0000 7fdcedffb640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdcdc06b4d0 0x7fdcdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:35.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.985+0000 7fdcedffb640 1 -- 172.21.15.172:0/982734474 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdce808a980 con 0x7fdcf80aeab0 2024-04-25T08:42:35.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.985+0000 7fdcfd57c640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdcdc06b4d0 0x7fdcdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:35.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.986+0000 7fdcfd57c640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdcdc06b4d0 0x7fdcdc06d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009a40 tx=0x7fdcf400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:35.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:35.989+0000 7fdcedffb640 1 -- 172.21.15.172:0/982734474 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdce8058e70 con 0x7fdcf80aeab0 2024-04-25T08:42:36.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.195+0000 7fdcff7e0640 1 -- 172.21.15.172:0/982734474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdcf80b15e0 con 0x7fdcf80aeab0 2024-04-25T08:42:36.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.196+0000 7fdcedffb640 1 -- 172.21.15.172:0/982734474 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdce805cf10 con 0x7fdcf80aeab0 2024-04-25T08:42:36.188 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T08:42:36.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 -- 172.21.15.172:0/982734474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdcdc06b4d0 msgr2=0x7fdcdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:36.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdcdc06b4d0 0x7fdcdc06d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009a40 tx=0x7fdcf400b040 comp rx=0 tx=0).stop 2024-04-25T08:42:36.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 -- 172.21.15.172:0/982734474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf80aeab0 msgr2=0x7fdcf80aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:36.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf80aeab0 0x7fdcf80aef30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdce8011910 tx=0x7fdce8011dd0 comp rx=0 tx=0).stop 2024-04-25T08:42:36.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 -- 172.21.15.172:0/982734474 shutdown_connections 2024-04-25T08:42:36.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdcdc06b4d0 0x7fdcdc06d990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:36.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcf80ac7a0 0x7fdcf80acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:36.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf80aeab0 0x7fdcf80aef30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:36.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 --2- 172.21.15.172:0/982734474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdce4004d40 0x7fdcf806ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:36.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 -- 172.21.15.172:0/982734474 >> 172.21.15.172:0/982734474 conn(0x7fdcf80b2370 msgr2=0x7fdcf80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:36.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 -- 172.21.15.172:0/982734474 shutdown_connections 2024-04-25T08:42:36.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:36.198+0000 7fdcff7e0640 1 -- 172.21.15.172:0/982734474 wait complete. 2024-04-25T08:42:36.201 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:42:36.201 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:42:36.201 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:42:36.201 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T08:42:36.201 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T08:42:36.201 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:42:36.201 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:42:36.201 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:42:36.201 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T08:42:36.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:36.202 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:42:36.217 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:42:36.218 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:42:36.218 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:42:36.218 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:42:36.218 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:42:36.218 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:42:36.218 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42763sec preferred_lft 42763sec 2024-04-25T08:42:36.218 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:42:36.218 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:42:36.219 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T08:42:36.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:36.219 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:42:36.219 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:42:36.219 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add name ceph-brx type bridge 2024-04-25T08:42:36.219 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr flush dev ceph-brx 2024-04-25T08:42:36.219 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set ceph-brx up 2024-04-25T08:42:36.219 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T08:42:36.219 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:42:36.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:36.359 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:42:36.382 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:42:36.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:36.384 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:42:36.456 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:42:36.456 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:42:36.457 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:42:36.457 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:42:36.457 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:42:36.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:36.457 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:42:36.457 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:42:36.457 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:42:36.457 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:42:36.457 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:42:36.457 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:42:36.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:36.663 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:42:36.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:36.678 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2024-04-25T08:42:36.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:36.733 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:42:36.733 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:42:36.733 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T08:42:36.733 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T08:42:36.734 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:42:36.811 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T08:42:36.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:36.811 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:42:36.811 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:42:36.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T08:42:36.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T08:42:36.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T08:42:36.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T08:42:36.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T08:42:36.812 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:42:36.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:36.947 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:42:36.947 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:42:36.947 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:42:36.947 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T08:42:36.947 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:42:36.982 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T08:42:36.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:42:36.983 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T08:42:37.038 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T08:42:37.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:42:37.038 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T08:42:37.092 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2024-04-25T08:42:37.159 DEBUG:teuthology.orchestra.run.smithi172:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T08:42:37.215 INFO:teuthology.orchestra.run.smithi172.stdout:/proc 2024-04-25T08:42:37.215 INFO:teuthology.orchestra.run.smithi172.stdout:/sys 2024-04-25T08:42:37.215 INFO:teuthology.orchestra.run.smithi172.stdout:/dev 2024-04-25T08:42:37.215 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/security 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/shm 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/pts 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/run 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/cgroup 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/pstore 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/bpf 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/ 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/selinux 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/hugepages 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/mqueue 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/debug 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/tracing 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T08:42:37.216 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/config 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/fuse/connections 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/1000 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T08:42:37.217 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T08:42:37.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:37.218 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2024-04-25T08:42:37.269 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T08:42:37.269 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T08:42:37.311 DEBUG:teuthology.orchestra.run.smithi172:> sudo modprobe fuse 2024-04-25T08:42:37.334 DEBUG:teuthology.orchestra.run.smithi172:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T08:42:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:/proc 2024-04-25T08:42:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:/sys 2024-04-25T08:42:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:/dev 2024-04-25T08:42:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/security 2024-04-25T08:42:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/shm 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/pts 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/run 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/cgroup 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/pstore 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/bpf 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/ 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/selinux 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/hugepages 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/dev/mqueue 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/debug 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/tracing 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T08:42:37.392 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/kernel/config 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/sys/fs/fuse/connections 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/run/user/1000 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T08:42:37.393 INFO:teuthology.orchestra.run.smithi172.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T08:42:37.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:37.394 DEBUG:teuthology.orchestra.run.smithi172:> ls /sys/fs/fuse/connections 2024-04-25T08:42:37.399 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi172.stderr:2024-04-25T08:42:37.407+0000 7f1e02f5e480 -1 init, newargv = 0x5594e23ee670 newargc=15 2024-04-25T08:42:37.399 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi172.stderr:ceph-fuse[42031]: starting ceph client 2024-04-25T08:42:37.406 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi172.stderr:ceph-fuse[42031]: starting fuse 2024-04-25T08:42:37.414 INFO:teuthology.orchestra.run.smithi172.stdout:43 2024-04-25T08:42:37.414 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-25T08:42:37.414 DEBUG:teuthology.orchestra.run.smithi172:> sudo stdin-killer -- python3 -c ' 2024-04-25T08:42:37.414 DEBUG:teuthology.orchestra.run.smithi172:> import glob 2024-04-25T08:42:37.414 DEBUG:teuthology.orchestra.run.smithi172:> import re 2024-04-25T08:42:37.414 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-04-25T08:42:37.414 DEBUG:teuthology.orchestra.run.smithi172:> import subprocess 2024-04-25T08:42:37.414 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:42:37.414 DEBUG:teuthology.orchestra.run.smithi172:> def _find_admin_socket(client_name): 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> files = glob.glob(asok_path) 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> # Given a non-glob path, it better be there 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> if "*" not in asok_path: 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> assert(len(files) == 1) 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> return files[0] 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> for f in files: 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> contents = proc_f.read() 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> if mountpoint in contents: 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> return f 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T08:42:37.415 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:42:37.416 DEBUG:teuthology.orchestra.run.smithi172:> print(_find_admin_socket("client.admin")) 2024-04-25T08:42:37.416 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-04-25T08:42:37.532 INFO:teuthology.orchestra.run.smithi172.stdout:/var/run/ceph/ceph-client.admin.42031.asok 2024-04-25T08:42:37.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:42:37.542 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42031.asok 2024-04-25T08:42:37.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:37.543 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42031.asok status 2024-04-25T08:42:37.676 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:42:37.676 INFO:teuthology.orchestra.run.smithi172.stdout: "metadata": { 2024-04-25T08:42:37.676 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_sha1": "97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec", 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.0.0-1628-g97ae6cc9 (97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec) squid (dev)", 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "entity_id": "admin", 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "hostname": "smithi172", 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "pid": "42031", 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "root": "/" 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_count": 0, 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "dentry_pinned_count": 0, 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 4446, 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "inst": { 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "name": { 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "client", 2024-04-25T08:42:37.677 INFO:teuthology.orchestra.run.smithi172.stdout: "num": 4446 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "192.168.0.1:0", 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 2704617525 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": { 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "type": "v1", 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "addr": "192.168.0.1:0", 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "nonce": 2704617525 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "inst_str": "client.4446 192.168.0.1:0/2704617525", 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "addr_str": "192.168.0.1:0/2704617525", 2024-04-25T08:42:37.678 INFO:teuthology.orchestra.run.smithi172.stdout: "inode_count": 1, 2024-04-25T08:42:37.679 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_epoch": 6, 2024-04-25T08:42:37.679 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch": 24, 2024-04-25T08:42:37.679 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_epoch_barrier": 0, 2024-04-25T08:42:37.679 INFO:teuthology.orchestra.run.smithi172.stdout: "blocklisted": false, 2024-04-25T08:42:37.679 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs" 2024-04-25T08:42:37.679 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:42:37.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:37.685 DEBUG:teuthology.orchestra.run.smithi172:> stat --file-system '--printf=%T 2024-04-25T08:42:37.686 DEBUG:teuthology.orchestra.run.smithi172:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T08:42:37.701 INFO:teuthology.orchestra.run.smithi172.stdout:fuseblk 2024-04-25T08:42:37.701 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T08:42:37.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:37.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T08:42:37.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:37.767 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T08:42:37.842 INFO:teuthology.orchestra.run.smithi172.stdout:# file: . 2024-04-25T08:42:37.842 INFO:teuthology.orchestra.run.smithi172.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T08:42:37.842 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:37.842 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:37.842 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:42:37.898 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:38.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.043+0000 7fefeb6f5640 1 Processor -- start 2024-04-25T08:42:38.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.043+0000 7fefeb6f5640 1 -- start start 2024-04-25T08:42:38.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefeb6f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fefe415dc00 0x7fefe40c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefeb6f5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fefe40d1dd0 0x7fefe40ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefeb6f5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe415dfe0 con 0x7fefe40ceb20 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefeb6f5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40d00c0 con 0x7fefe40d1dd0 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefeb6f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40d03a0 con 0x7fefe415dc00 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefe9c92640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fefe40d1dd0 0x7fefe40ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefe9c92640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fefe40d1dd0 0x7fefe40ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43838/0 (socket says 172.21.15.172:43838) 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefe9c92640 1 -- 172.21.15.172:0/3820158877 learned_addr learned my addr 172.21.15.172:0/3820158877 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefe9491640 1 --2- 172.21.15.172:0/3820158877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fefe415dc00 0x7fefe40c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefe9c92640 1 -- 172.21.15.172:0/3820158877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fefe415dc00 msgr2=0x7fefe40c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefe9c92640 1 --2- 172.21.15.172:0/3820158877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fefe415dc00 0x7fefe40c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefe9c92640 1 -- 172.21.15.172:0/3820158877 >> v1:172.21.15.186:6789/0 conn(0x7fefe40ceb20 legacy=0x7fefe40d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.044+0000 7fefe9c92640 1 -- 172.21.15.172:0/3820158877 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40cc440 con 0x7fefe40d1dd0 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.045+0000 7fefe9c92640 1 --2- 172.21.15.172:0/3820158877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe40d1dd0 0x7fefe40ccc40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009e50 tx=0x7fefdc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f456deef18a049 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.045+0000 7fefdbfff640 1 -- 172.21.15.172:0/3820158877 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc036070 con 0x7fefe40d1dd0 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.045+0000 7fefdbfff640 1 -- 172.21.15.172:0/3820158877 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc031600 con 0x7fefe40d1dd0 2024-04-25T08:42:38.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.045+0000 7fefdbfff640 1 -- 172.21.15.172:0/3820158877 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0319d0 con 0x7fefe40d1dd0 2024-04-25T08:42:38.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.046+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3820158877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe40d1dd0 msgr2=0x7fefe40ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.046+0000 7fefeb6f5640 1 --2- 172.21.15.172:0/3820158877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe40d1dd0 0x7fefe40ccc40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009e50 tx=0x7fefdc02a710 comp rx=0 tx=0).stop 2024-04-25T08:42:38.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.046+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3820158877 shutdown_connections 2024-04-25T08:42:38.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.046+0000 7fefeb6f5640 1 --2- 172.21.15.172:0/3820158877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe40d1dd0 0x7fefe40ccc40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.046+0000 7fefeb6f5640 1 --2- 172.21.15.172:0/3820158877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fefe415dc00 0x7fefe40c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.046+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3820158877 >> 172.21.15.172:0/3820158877 conn(0x7fefe406f5d0 msgr2=0x7fefe406f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.046+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3820158877 shutdown_connections 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.046+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3820158877 wait complete. 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.047+0000 7fefeb6f5640 1 Processor -- start 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.047+0000 7fefeb6f5640 1 -- start start 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefeb6f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fefe40ceb20 0x7fefe40b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefeb6f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefe40d1dd0 0x7fefe4152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefeb6f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe415dc00 0x7fefe41530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefeb6f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40cfd90 con 0x7fefe415dc00 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefeb6f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40cc130 con 0x7fefe40d1dd0 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefeb6f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40cdd70 con 0x7fefe40ceb20 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe9c92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe415dc00 0x7fefe41530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe9c92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe415dc00 0x7fefe41530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43852/0 (socket says 172.21.15.172:43852) 2024-04-25T08:42:38.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe9c92640 1 -- 172.21.15.172:0/3774678140 learned_addr learned my addr 172.21.15.172:0/3774678140 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe9491640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fefe40ceb20 0x7fefe40b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe8c90640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefe40d1dd0 0x7fefe4152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe9c92640 1 -- 172.21.15.172:0/3774678140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fefe40ceb20 msgr2=0x7fefe40b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe9c92640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fefe40ceb20 0x7fefe40b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe9c92640 1 -- 172.21.15.172:0/3774678140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefe40d1dd0 msgr2=0x7fefe4152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe9c92640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefe40d1dd0 0x7fefe4152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe9c92640 1 -- 172.21.15.172:0/3774678140 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe406c780 con 0x7fefe415dc00 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefe9c92640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe415dc00 0x7fefe41530c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009e50 tx=0x7fefdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefd9ffb640 1 -- 172.21.15.172:0/3774678140 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc036050 con 0x7fefe415dc00 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefd9ffb640 1 -- 172.21.15.172:0/3774678140 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc042070 con 0x7fefe415dc00 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3774678140 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe406ca60 con 0x7fefe415dc00 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.048+0000 7fefd9ffb640 1 -- 172.21.15.172:0/3774678140 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc009510 con 0x7fefe415dc00 2024-04-25T08:42:38.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.049+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3774678140 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe406d020 con 0x7fefe415dc00 2024-04-25T08:42:38.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.049+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3774678140 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe4073990 con 0x7fefe415dc00 2024-04-25T08:42:38.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.050+0000 7fefd9ffb640 1 -- 172.21.15.172:0/3774678140 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fefdc007bd0 con 0x7fefe415dc00 2024-04-25T08:42:38.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.050+0000 7fefd9ffb640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fefc806b500 0x7fefc806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.050+0000 7fefd9ffb640 1 -- 172.21.15.172:0/3774678140 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fefdc0ab410 con 0x7fefe415dc00 2024-04-25T08:42:38.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.050+0000 7fefe9491640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fefc806b500 0x7fefc806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.051+0000 7fefe9491640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fefc806b500 0x7fefc806d9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fefe0006fd0 tx=0x7fefe0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.054+0000 7fefd9ffb640 1 -- 172.21.15.172:0/3774678140 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fefdc079ec0 con 0x7fefe415dc00 2024-04-25T08:42:38.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.226+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3774678140 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefe40c66c0 con 0x7fefe415dc00 2024-04-25T08:42:38.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.227+0000 7fefd9ffb640 1 -- 172.21.15.172:0/3774678140 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7fefdc0797c0 con 0x7fefe415dc00 2024-04-25T08:42:38.219 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:38.219 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:38.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3774678140 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fefc806b500 msgr2=0x7fefc806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fefc806b500 0x7fefc806d9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fefe0006fd0 tx=0x7fefe0008040 comp rx=0 tx=0).stop 2024-04-25T08:42:38.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3774678140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe415dc00 msgr2=0x7fefe41530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe415dc00 0x7fefe41530c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009e50 tx=0x7fefdc004a40 comp rx=0 tx=0).stop 2024-04-25T08:42:38.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3774678140 shutdown_connections 2024-04-25T08:42:38.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fefc806b500 0x7fefc806d9c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefe40d1dd0 0x7fefe4152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe415dc00 0x7fefe41530c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 --2- 172.21.15.172:0/3774678140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fefe40ceb20 0x7fefe40b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3774678140 >> 172.21.15.172:0/3774678140 conn(0x7fefe406f5d0 msgr2=0x7fefe40c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:38.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3774678140 shutdown_connections 2024-04-25T08:42:38.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.229+0000 7fefeb6f5640 1 -- 172.21.15.172:0/3774678140 wait complete. 2024-04-25T08:42:38.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:42:38.232 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:42:38.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.340+0000 7f5d4679e640 1 Processor -- start 2024-04-25T08:42:38.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.340+0000 7f5d4679e640 1 -- start start 2024-04-25T08:42:38.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.340+0000 7f5d4679e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 0x7f5d400b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.340+0000 7f5d4679e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d400b54a0 0x7f5d400b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.340+0000 7f5d4679e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d400cf1d0 con 0x7f5d40161240 2024-04-25T08:42:38.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.340+0000 7f5d4679e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d400b7120 con 0x7f5d400b54a0 2024-04-25T08:42:38.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.340+0000 7f5d4679e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d40161620 con 0x7f5d40161890 2024-04-25T08:42:38.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d44d3b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d400b54a0 0x7f5d400b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d3ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5d40161240 0x7f5d400ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42922/0 (socket says 172.21.15.172:42922) 2024-04-25T08:42:38.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d3ffff640 1 -- 172.21.15.172:0/275896259 learned_addr learned my addr 172.21.15.172:0/275896259 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:38.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d44d3b640 1 -- 172.21.15.172:0/275896259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 msgr2=0x7f5d400b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:38.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d3f7fe640 1 --2- 172.21.15.172:0/275896259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 0x7f5d400b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d3effd640 1 -- 172.21.15.172:0/275896259 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338266283 0 0) 0x7f5d400cf1d0 con 0x7f5d40161240 2024-04-25T08:42:38.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d44d3b640 1 --2- 172.21.15.172:0/275896259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 0x7f5d400b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d44d3b640 1 -- 172.21.15.172:0/275896259 >> v1:172.21.15.172:6789/0 conn(0x7f5d40161240 legacy=0x7f5d400ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d44d3b640 1 -- 172.21.15.172:0/275896259 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40161e00 con 0x7f5d400b54a0 2024-04-25T08:42:38.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d3f7fe640 1 --2- 172.21.15.172:0/275896259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 0x7f5d400b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:38.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.341+0000 7f5d44d3b640 1 --2- 172.21.15.172:0/275896259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d400b54a0 0x7f5d400b5930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009d90 tx=0x7f5d3802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1495d57e9f904c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d3effd640 1 -- 172.21.15.172:0/275896259 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38007740 con 0x7f5d400b54a0 2024-04-25T08:42:38.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d3effd640 1 -- 172.21.15.172:0/275896259 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d380078e0 con 0x7f5d400b54a0 2024-04-25T08:42:38.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d3effd640 1 -- 172.21.15.172:0/275896259 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38007cb0 con 0x7f5d400b54a0 2024-04-25T08:42:38.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d4679e640 1 -- 172.21.15.172:0/275896259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d400b54a0 msgr2=0x7f5d400b5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d4679e640 1 --2- 172.21.15.172:0/275896259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d400b54a0 0x7f5d400b5930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009d90 tx=0x7f5d3802a660 comp rx=0 tx=0).stop 2024-04-25T08:42:38.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d4679e640 1 -- 172.21.15.172:0/275896259 shutdown_connections 2024-04-25T08:42:38.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d4679e640 1 --2- 172.21.15.172:0/275896259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 0x7f5d400b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d4679e640 1 --2- 172.21.15.172:0/275896259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d400b54a0 0x7f5d400b5930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d4679e640 1 -- 172.21.15.172:0/275896259 >> 172.21.15.172:0/275896259 conn(0x7f5d400d04a0 msgr2=0x7f5d400d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d4679e640 1 -- 172.21.15.172:0/275896259 shutdown_connections 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.342+0000 7f5d4679e640 1 -- 172.21.15.172:0/275896259 wait complete. 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.343+0000 7f5d4679e640 1 Processor -- start 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.344+0000 7f5d4679e640 1 -- start start 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.344+0000 7f5d4679e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d400b54a0 0x7f5d400c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.344+0000 7f5d4679e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40161240 0x7f5d400cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.344+0000 7f5d4679e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 0x7f5d400b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.344+0000 7f5d4679e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d401626a0 con 0x7f5d40161240 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.344+0000 7f5d4679e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d401623c0 con 0x7f5d400b54a0 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.344+0000 7f5d4679e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400d15f0 con 0x7f5d40161890 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.344+0000 7f5d3f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40161240 0x7f5d400cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.344+0000 7f5d3f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40161240 0x7f5d400cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43868/0 (socket says 172.21.15.172:43868) 2024-04-25T08:42:38.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.344+0000 7f5d3f7fe640 1 -- 172.21.15.172:0/2708064947 learned_addr learned my addr 172.21.15.172:0/2708064947 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d44d3b640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 0x7f5d400b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d3ffff640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d400b54a0 0x7f5d400c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d3f7fe640 1 -- 172.21.15.172:0/2708064947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 msgr2=0x7f5d400b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d3f7fe640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 0x7f5d400b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d3f7fe640 1 -- 172.21.15.172:0/2708064947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d400b54a0 msgr2=0x7f5d400c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d3f7fe640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d400b54a0 0x7f5d400c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d3f7fe640 1 -- 172.21.15.172:0/2708064947 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400cd910 con 0x7f5d40161240 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d3f7fe640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40161240 0x7f5d400cd3d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400c7f0 tx=0x7f5d3400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d3cff9640 1 -- 172.21.15.172:0/2708064947 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34015070 con 0x7f5d40161240 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d3cff9640 1 -- 172.21.15.172:0/2708064947 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d34007820 con 0x7f5d40161240 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d4679e640 1 -- 172.21.15.172:0/2708064947 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4015ecc0 con 0x7f5d40161240 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d3cff9640 1 -- 172.21.15.172:0/2708064947 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34007bd0 con 0x7f5d40161240 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.345+0000 7f5d4679e640 1 -- 172.21.15.172:0/2708064947 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4015f280 con 0x7f5d40161240 2024-04-25T08:42:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.346+0000 7f5d4679e640 1 -- 172.21.15.172:0/2708064947 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d40073a00 con 0x7f5d40161240 2024-04-25T08:42:38.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.346+0000 7f5d3cff9640 1 -- 172.21.15.172:0/2708064947 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d34018070 con 0x7f5d40161240 2024-04-25T08:42:38.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.347+0000 7f5d3cff9640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d2c06b4d0 0x7f5d2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.347+0000 7f5d3cff9640 1 -- 172.21.15.172:0/2708064947 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5d3408a5c0 con 0x7f5d40161240 2024-04-25T08:42:38.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.347+0000 7f5d3ffff640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d2c06b4d0 0x7f5d2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.347+0000 7f5d3ffff640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d2c06b4d0 0x7f5d2c06d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d30000f60 tx=0x7f5d30007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.351+0000 7f5d3cff9640 1 -- 172.21.15.172:0/2708064947 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d34058ab0 con 0x7f5d40161240 2024-04-25T08:42:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.521+0000 7f5d4679e640 1 -- 172.21.15.172:0/2708064947 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d4006d240 con 0x7f5d40161240 2024-04-25T08:42:38.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.521+0000 7f5d3cff9640 1 -- 172.21.15.172:0/2708064947 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d3405cb50 con 0x7f5d40161240 2024-04-25T08:42:38.514 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:42:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 -- 172.21.15.172:0/2708064947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d2c06b4d0 msgr2=0x7f5d2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d2c06b4d0 0x7f5d2c06d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d30000f60 tx=0x7f5d30007d50 comp rx=0 tx=0).stop 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 -- 172.21.15.172:0/2708064947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40161240 msgr2=0x7f5d400cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40161240 0x7f5d400cd3d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400c7f0 tx=0x7f5d3400ccb0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 -- 172.21.15.172:0/2708064947 shutdown_connections 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d2c06b4d0 0x7f5d2c06d990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d40161890 0x7f5d400b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40161240 0x7f5d400cd3d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 --2- 172.21.15.172:0/2708064947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d400b54a0 0x7f5d400c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 -- 172.21.15.172:0/2708064947 >> 172.21.15.172:0/2708064947 conn(0x7f5d400d04a0 msgr2=0x7f5d400b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 -- 172.21.15.172:0/2708064947 shutdown_connections 2024-04-25T08:42:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.523+0000 7f5d4679e640 1 -- 172.21.15.172:0/2708064947 wait complete. 2024-04-25T08:42:38.526 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:42:38.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.635+0000 7f0aaa314640 1 Processor -- start 2024-04-25T08:42:38.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.635+0000 7f0aaa314640 1 -- start start 2024-04-25T08:42:38.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.635+0000 7f0aaa314640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa41610f0 0x7f0aa406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.635+0000 7f0aaa314640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0aa40ce7b0 0x7f0aa4161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.635+0000 7f0aaa314640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa40c6960 con 0x7f0aa41616f0 2024-04-25T08:42:38.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.635+0000 7f0aaa314640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa41614d0 con 0x7f0aa40ce7b0 2024-04-25T08:42:38.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.635+0000 7f0aaa314640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa4162260 con 0x7f0aa41610f0 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.635+0000 7f0aa37fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0aa41616f0 0x7f0aa40ce0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42938/0 (socket says 172.21.15.172:42938) 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.635+0000 7f0aa37fe640 1 -- 172.21.15.172:0/1882938641 learned_addr learned my addr 172.21.15.172:0/1882938641 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa88b1640 1 --2- 172.21.15.172:0/1882938641 >> v2:172.21.15.186:3300/0 conn(0x7f0aa40ce7b0 0x7f0aa4161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa3fff640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa41610f0 0x7f0aa406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262293371 0 0) 0x7f0aa40c6960 con 0x7f0aa41616f0 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a8c003520 con 0x7f0aa41616f0 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616930538 0 0) 0x7f0a8c003520 con 0x7f0aa41616f0 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa41610f0 msgr2=0x7f0aa406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa41610f0 0x7f0aa406c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 >> v2:172.21.15.186:3300/0 conn(0x7f0aa40ce7b0 msgr2=0x7f0aa4161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 --2- 172.21.15.172:0/1882938641 >> v2:172.21.15.186:3300/0 conn(0x7f0aa40ce7b0 0x7f0aa4161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4162540 con 0x7f0aa41616f0 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f0a98001670 con 0x7f0aa41616f0 2024-04-25T08:42:38.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa88b1640 1 --2- 172.21.15.172:0/1882938641 >> v2:172.21.15.186:3300/0 conn(0x7f0aa40ce7b0 0x7f0aa4161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 >> v1:172.21.15.172:6789/0 conn(0x7f0aa41616f0 legacy=0x7f0aa40ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa41610f0 0x7f0a8c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c003f30 0x7f0a8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c004d40 0x7f0a8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa41614d0 con 0x7f0a8c004d40 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa4162260 con 0x7f0a8c003f30 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c00b9c0 con 0x7f0aa41610f0 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa88b1640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c004d40 0x7f0a8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa3fff640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa41610f0 0x7f0a8c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa37fe640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c003f30 0x7f0a8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa88b1640 1 -- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa41610f0 msgr2=0x7f0a8c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa88b1640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa41610f0 0x7f0a8c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa88b1640 1 -- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c003f30 msgr2=0x7f0a8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:38.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa88b1640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c003f30 0x7f0a8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.636+0000 7f0aa88b1640 1 -- 172.21.15.172:0/1882938641 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c003520 con 0x7f0a8c004d40 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.637+0000 7f0aa88b1640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c004d40 0x7f0a8c0051c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00e350 tx=0x7f0a8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f5a1f478e2fc5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.637+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c009de0 con 0x7f0a8c004d40 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.637+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c02e650 con 0x7f0a8c004d40 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.637+0000 7f0aa2ffd640 1 -- 172.21.15.172:0/1882938641 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c02ea00 con 0x7f0a8c004d40 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.638+0000 7f0aaa314640 1 -- 172.21.15.172:0/1882938641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c004d40 msgr2=0x7f0a8c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.638+0000 7f0aaa314640 1 --2- 172.21.15.172:0/1882938641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c004d40 0x7f0a8c0051c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00e350 tx=0x7f0a8c005830 comp rx=0 tx=0).stop 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.638+0000 7f0aa88b1640 1 -- 172.21.15.172:0/1882938641 reap_dead start 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.638+0000 7f0aaa314640 1 -- 172.21.15.172:0/1882938641 shutdown_connections 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.638+0000 7f0aaa314640 1 -- 172.21.15.172:0/1882938641 >> 172.21.15.172:0/1882938641 conn(0x7f0aa406f500 msgr2=0x7f0aa406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.638+0000 7f0aaa314640 1 -- 172.21.15.172:0/1882938641 shutdown_connections 2024-04-25T08:42:38.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.638+0000 7f0aaa314640 1 -- 172.21.15.172:0/1882938641 wait complete. 2024-04-25T08:42:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.639+0000 7f0aaa314640 1 Processor -- start 2024-04-25T08:42:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.639+0000 7f0aaa314640 1 -- start start 2024-04-25T08:42:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aaa314640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c004d40 0x7f0aa4158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aaa314640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa4144e30 0x7f0aa41562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aaa314640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa4145330 0x7f0aa41f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aaa314640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40cf690 con 0x7f0aa4145330 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aaa314640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40cfce0 con 0x7f0a8c004d40 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aaa314640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa406c1c0 con 0x7f0aa4144e30 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa88b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa4145330 0x7f0aa41f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa88b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa4145330 0x7f0aa41f7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43882/0 (socket says 172.21.15.172:43882) 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa88b1640 1 -- 172.21.15.172:0/3759551696 learned_addr learned my addr 172.21.15.172:0/3759551696 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa3fff640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c004d40 0x7f0aa4158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa37fe640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa4144e30 0x7f0aa41562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa88b1640 1 -- 172.21.15.172:0/3759551696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa4144e30 msgr2=0x7f0aa41562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa88b1640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa4144e30 0x7f0aa41562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa88b1640 1 -- 172.21.15.172:0/3759551696 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c004d40 msgr2=0x7f0aa4158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa88b1640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c004d40 0x7f0aa4158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa88b1640 1 -- 172.21.15.172:0/3759551696 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4156810 con 0x7f0aa4145330 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa3fff640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c004d40 0x7f0aa4158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.640+0000 7f0aa37fe640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa4144e30 0x7f0aa41562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.641+0000 7f0aa88b1640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa4145330 0x7f0aa41f7130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00e470 tx=0x7f0a9c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.641+0000 7f0aa0ff9640 1 -- 172.21.15.172:0/3759551696 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c009de0 con 0x7f0aa4145330 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.641+0000 7f0aa0ff9640 1 -- 172.21.15.172:0/3759551696 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c003990 con 0x7f0aa4145330 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.641+0000 7f0aaa314640 1 -- 172.21.15.172:0/3759551696 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa4158e90 con 0x7f0aa4145330 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.641+0000 7f0aa0ff9640 1 -- 172.21.15.172:0/3759551696 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c003d60 con 0x7f0aa4145330 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.641+0000 7f0aaa314640 1 -- 172.21.15.172:0/3759551696 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa40b5610 con 0x7f0aa4145330 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.642+0000 7f0aaa314640 1 -- 172.21.15.172:0/3759551696 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa4073a00 con 0x7f0aa4145330 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.642+0000 7f0aa0ff9640 1 -- 172.21.15.172:0/3759551696 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a9c02c040 con 0x7f0aa4145330 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.642+0000 7f0aa0ff9640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a9006b4d0 0x7f0a9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.643+0000 7f0aa0ff9640 1 -- 172.21.15.172:0/3759551696 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0a9c0ab360 con 0x7f0aa4145330 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.643+0000 7f0aa3fff640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a9006b4d0 0x7f0a9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.643+0000 7f0aa3fff640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a9006b4d0 0x7f0a9006d990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009ab0 tx=0x7f0a94008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.647+0000 7f0aa0ff9640 1 -- 172.21.15.172:0/3759551696 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a9c032030 con 0x7f0aa4145330 2024-04-25T08:42:38.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.817+0000 7f0aaa314640 1 -- 172.21.15.172:0/3759551696 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0aa415db10 con 0x7f0aa4145330 2024-04-25T08:42:38.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.818+0000 7f0aa0ff9640 1 -- 172.21.15.172:0/3759551696 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a9c079fc0 con 0x7f0aa4145330 2024-04-25T08:42:38.810 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 -- 172.21.15.172:0/3759551696 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a9006b4d0 msgr2=0x7f0a9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a9006b4d0 0x7f0a9006d990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009ab0 tx=0x7f0a94008040 comp rx=0 tx=0).stop 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 -- 172.21.15.172:0/3759551696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa4145330 msgr2=0x7f0aa41f7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa4145330 0x7f0aa41f7130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00e470 tx=0x7f0a9c004ab0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 -- 172.21.15.172:0/3759551696 shutdown_connections 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a9006b4d0 0x7f0a9006d990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa4145330 0x7f0aa41f7130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0aa4144e30 0x7f0aa41562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 --2- 172.21.15.172:0/3759551696 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c004d40 0x7f0aa4158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 -- 172.21.15.172:0/3759551696 >> 172.21.15.172:0/3759551696 conn(0x7f0aa406f500 msgr2=0x7f0aa40ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 -- 172.21.15.172:0/3759551696 shutdown_connections 2024-04-25T08:42:38.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.820+0000 7f0aaa314640 1 -- 172.21.15.172:0/3759551696 wait complete. 2024-04-25T08:42:38.823 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:42:38.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.931+0000 7ffa090db640 1 Processor -- start 2024-04-25T08:42:38.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.931+0000 7ffa090db640 1 -- start start 2024-04-25T08:42:38.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.932+0000 7ffa090db640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0415dac0 0x7ffa040d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.932+0000 7ffa090db640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffa040d0ab0 0x7ffa040b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.932+0000 7ffa090db640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa040d2420 con 0x7ffa040d1f30 2024-04-25T08:42:38.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.932+0000 7ffa090db640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa040d3030 con 0x7ffa040d0ab0 2024-04-25T08:42:38.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.932+0000 7ffa090db640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040d2700 con 0x7ffa0415dac0 2024-04-25T08:42:38.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.932+0000 7ffa0359e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffa040d0ab0 0x7ffa040b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.932+0000 7ffa02d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0415dac0 0x7ffa040d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.932+0000 7ffa0259c640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7ffa040d1f30 0x7ffa040d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:36058/0 (socket says 172.21.15.172:36058) 2024-04-25T08:42:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.932+0000 7ffa0259c640 1 -- 172.21.15.172:0/3918174267 learned_addr learned my addr 172.21.15.172:0/3918174267 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.932+0000 7ffa0359e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffa040d0ab0 0x7ffa040b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:34134/0 (socket says 172.21.15.172:34134) 2024-04-25T08:42:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.933+0000 7ffa02d9d640 1 -- 172.21.15.172:0/3918174267 >> v2:172.21.15.186:3300/0 conn(0x7ffa040d0ab0 msgr2=0x7ffa040b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.933+0000 7ffa02d9d640 1 --2- 172.21.15.172:0/3918174267 >> v2:172.21.15.186:3300/0 conn(0x7ffa040d0ab0 0x7ffa040b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.933+0000 7ffa02d9d640 1 -- 172.21.15.172:0/3918174267 >> v1:172.21.15.186:6789/0 conn(0x7ffa040d1f30 legacy=0x7ffa040d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.933+0000 7ffa02d9d640 1 -- 172.21.15.172:0/3918174267 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa040d29e0 con 0x7ffa0415dac0 2024-04-25T08:42:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.933+0000 7ffa0359e640 1 --2- 172.21.15.172:0/3918174267 >> v2:172.21.15.186:3300/0 conn(0x7ffa040d0ab0 0x7ffa040b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.933+0000 7ffa02d9d640 1 --2- 172.21.15.172:0/3918174267 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0415dac0 0x7ffa040d19f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40097a0 tx=0x7ff9f402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac6c548d4696d29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.933+0000 7ffa01d9b640 1 -- 172.21.15.172:0/3918174267 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4037070 con 0x7ffa0415dac0 2024-04-25T08:42:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.934+0000 7ffa01d9b640 1 -- 172.21.15.172:0/3918174267 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4032440 con 0x7ffa0415dac0 2024-04-25T08:42:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.934+0000 7ffa01d9b640 1 -- 172.21.15.172:0/3918174267 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f4032810 con 0x7ffa0415dac0 2024-04-25T08:42:38.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.934+0000 7ffa090db640 1 -- 172.21.15.172:0/3918174267 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0415dac0 msgr2=0x7ffa040d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.934+0000 7ffa090db640 1 --2- 172.21.15.172:0/3918174267 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0415dac0 0x7ffa040d19f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40097a0 tx=0x7ff9f402a210 comp rx=0 tx=0).stop 2024-04-25T08:42:38.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.934+0000 7ffa090db640 1 -- 172.21.15.172:0/3918174267 shutdown_connections 2024-04-25T08:42:38.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.934+0000 7ffa090db640 1 --2- 172.21.15.172:0/3918174267 >> v2:172.21.15.186:3300/0 conn(0x7ffa040d0ab0 0x7ffa040b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.934+0000 7ffa090db640 1 --2- 172.21.15.172:0/3918174267 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0415dac0 0x7ffa040d19f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.934+0000 7ffa090db640 1 -- 172.21.15.172:0/3918174267 >> 172.21.15.172:0/3918174267 conn(0x7ffa04061c30 msgr2=0x7ffa0406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:38.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.934+0000 7ffa090db640 1 -- 172.21.15.172:0/3918174267 shutdown_connections 2024-04-25T08:42:38.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.934+0000 7ffa090db640 1 -- 172.21.15.172:0/3918174267 wait complete. 2024-04-25T08:42:38.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.936+0000 7ffa090db640 1 Processor -- start 2024-04-25T08:42:38.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.936+0000 7ffa090db640 1 -- start start 2024-04-25T08:42:38.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.936+0000 7ffa090db640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa040d0ab0 0x7ffa041e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.936+0000 7ffa090db640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa040d1f30 0x7ffa0414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.936+0000 7ffa090db640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0415dac0 0x7ffa0415e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.936+0000 7ffa090db640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040b97d0 con 0x7ffa0415dac0 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.936+0000 7ffa090db640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0415dea0 con 0x7ffa040d1f30 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.936+0000 7ffa090db640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040b9950 con 0x7ffa040d0ab0 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.936+0000 7ffa0359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0415dac0 0x7ffa0415e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa0359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0415dac0 0x7ffa0415e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43886/0 (socket says 172.21.15.172:43886) 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa0359e640 1 -- 172.21.15.172:0/3028814927 learned_addr learned my addr 172.21.15.172:0/3028814927 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa0259c640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa040d1f30 0x7ffa0414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa02d9d640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa040d0ab0 0x7ffa041e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa0259c640 1 -- 172.21.15.172:0/3028814927 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa040d0ab0 msgr2=0x7ffa041e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa0259c640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa040d0ab0 0x7ffa041e7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa0259c640 1 -- 172.21.15.172:0/3028814927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0415dac0 msgr2=0x7ffa0415e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa0259c640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0415dac0 0x7ffa0415e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa0259c640 1 -- 172.21.15.172:0/3028814927 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa041e7610 con 0x7ffa040d1f30 2024-04-25T08:42:38.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa0359e640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0415dac0 0x7ffa0415e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:38.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa0259c640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa040d1f30 0x7ffa0414ac40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa040d2350 tx=0x7ff9f800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ff9eb7fe640 1 -- 172.21.15.172:0/3028814927 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8017070 con 0x7ffa040d1f30 2024-04-25T08:42:38.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ff9eb7fe640 1 -- 172.21.15.172:0/3028814927 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f8005d30 con 0x7ffa040d1f30 2024-04-25T08:42:38.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa090db640 1 -- 172.21.15.172:0/3028814927 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa041e78f0 con 0x7ffa040d1f30 2024-04-25T08:42:38.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ff9eb7fe640 1 -- 172.21.15.172:0/3028814927 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8007310 con 0x7ffa040d1f30 2024-04-25T08:42:38.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.937+0000 7ffa090db640 1 -- 172.21.15.172:0/3028814927 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa041e7eb0 con 0x7ffa040d1f30 2024-04-25T08:42:38.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.938+0000 7ffa090db640 1 -- 172.21.15.172:0/3028814927 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa04073a00 con 0x7ffa040d1f30 2024-04-25T08:42:38.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.939+0000 7ff9eb7fe640 1 -- 172.21.15.172:0/3028814927 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9f801a070 con 0x7ffa040d1f30 2024-04-25T08:42:38.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.939+0000 7ff9eb7fe640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f006b4d0 0x7ff9f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:38.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.939+0000 7ff9eb7fe640 1 -- 172.21.15.172:0/3028814927 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff9f80897c0 con 0x7ffa040d1f30 2024-04-25T08:42:38.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.939+0000 7ffa02d9d640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f006b4d0 0x7ff9f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:38.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.940+0000 7ffa02d9d640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f006b4d0 0x7ff9f006d990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4034000 tx=0x7ff9f402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:38.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:38.944+0000 7ff9eb7fe640 1 -- 172.21.15.172:0/3028814927 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9f8057ca0 con 0x7ffa040d1f30 2024-04-25T08:42:39.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.114+0000 7ffa090db640 1 -- 172.21.15.172:0/3028814927 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa040b8af0 con 0x7ffa040d1f30 2024-04-25T08:42:39.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.115+0000 7ff9eb7fe640 1 -- 172.21.15.172:0/3028814927 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9f805bd40 con 0x7ffa040d1f30 2024-04-25T08:42:39.107 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 -- 172.21.15.172:0/3028814927 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f006b4d0 msgr2=0x7ff9f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f006b4d0 0x7ff9f006d990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4034000 tx=0x7ff9f402e000 comp rx=0 tx=0).stop 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 -- 172.21.15.172:0/3028814927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa040d1f30 msgr2=0x7ffa0414ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa040d1f30 0x7ffa0414ac40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa040d2350 tx=0x7ff9f800c800 comp rx=0 tx=0).stop 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 -- 172.21.15.172:0/3028814927 shutdown_connections 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f006b4d0 0x7ff9f006d990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa040d1f30 0x7ffa0414ac40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0415dac0 0x7ffa0415e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 --2- 172.21.15.172:0/3028814927 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa040d0ab0 0x7ffa041e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 -- 172.21.15.172:0/3028814927 >> 172.21.15.172:0/3028814927 conn(0x7ffa04061c30 msgr2=0x7ffa040b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 -- 172.21.15.172:0/3028814927 shutdown_connections 2024-04-25T08:42:39.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.117+0000 7ffa090db640 1 -- 172.21.15.172:0/3028814927 wait complete. 2024-04-25T08:42:39.120 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:42:39.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.227+0000 7fd9c38f5640 1 Processor -- start 2024-04-25T08:42:39.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.228+0000 7fd9c38f5640 1 -- start start 2024-04-25T08:42:39.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.228+0000 7fd9c38f5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd9bc15a9f0 0x7fd9bc0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.228+0000 7fd9c38f5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd9bc0cdbf0 0x7fd9bc0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.228+0000 7fd9c38f5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9bc0c6940 con 0x7fd9bc0cd520 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.228+0000 7fd9c38f5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc0b0020 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.228+0000 7fd9c38f5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9bc0cb5a0 con 0x7fd9bc15a9f0 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.229+0000 7fd9c0e90640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd9bc0cdbf0 0x7fd9bc0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.229+0000 7fd9c0e90640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd9bc0cdbf0 0x7fd9bc0ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43892/0 (socket says 172.21.15.172:43892) 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.229+0000 7fd9c0e90640 1 -- 172.21.15.172:0/2335204488 learned_addr learned my addr 172.21.15.172:0/2335204488 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.229+0000 7fd9c1691640 1 --2- 172.21.15.172:0/2335204488 >> v2:172.21.15.186:3300/0 conn(0x7fd9bc15a9f0 0x7fd9bc0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.229+0000 7fd9c0e90640 1 -- 172.21.15.172:0/2335204488 >> v2:172.21.15.186:3300/0 conn(0x7fd9bc15a9f0 msgr2=0x7fd9bc0c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.229+0000 7fd9c0e90640 1 --2- 172.21.15.172:0/2335204488 >> v2:172.21.15.186:3300/0 conn(0x7fd9bc15a9f0 0x7fd9bc0c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.229+0000 7fd9c0e90640 1 -- 172.21.15.172:0/2335204488 >> v1:172.21.15.186:6789/0 conn(0x7fd9bc0cd520 legacy=0x7fd9bc0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.229+0000 7fd9c0e90640 1 -- 172.21.15.172:0/2335204488 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc15add0 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9c0e90640 1 --2- 172.21.15.172:0/2335204488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 0x7fd9bc0ccfe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0c77e0 tx=0x7fd9b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44949a22ddd5826a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9bbfff640 1 -- 172.21.15.172:0/2335204488 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0037070 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9bbfff640 1 -- 172.21.15.172:0/2335204488 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b0032440 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9bbfff640 1 -- 172.21.15.172:0/2335204488 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0032810 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2335204488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 msgr2=0x7fd9bc0ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9c38f5640 1 --2- 172.21.15.172:0/2335204488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 0x7fd9bc0ccfe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0c77e0 tx=0x7fd9b002a270 comp rx=0 tx=0).stop 2024-04-25T08:42:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2335204488 shutdown_connections 2024-04-25T08:42:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9c38f5640 1 --2- 172.21.15.172:0/2335204488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 0x7fd9bc0ccfe0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9c38f5640 1 --2- 172.21.15.172:0/2335204488 >> v2:172.21.15.186:3300/0 conn(0x7fd9bc15a9f0 0x7fd9bc0c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2335204488 >> 172.21.15.172:0/2335204488 conn(0x7fd9bc0b2390 msgr2=0x7fd9bc0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2335204488 shutdown_connections 2024-04-25T08:42:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.230+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2335204488 wait complete. 2024-04-25T08:42:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.231+0000 7fd9c38f5640 1 Processor -- start 2024-04-25T08:42:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c38f5640 1 -- start start 2024-04-25T08:42:39.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c38f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9bc0cd520 0x7fd9bc0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c38f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 0x7fd9bc06f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c38f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9bc15a9f0 0x7fd9bc149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c38f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0cb230 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c38f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0caf50 con 0x7fd9bc0cd520 2024-04-25T08:42:39.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c38f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc0ce070 con 0x7fd9bc15a9f0 2024-04-25T08:42:39.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c0e90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 0x7fd9bc06f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c0e90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 0x7fd9bc06f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43894/0 (socket says 172.21.15.172:43894) 2024-04-25T08:42:39.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c0e90640 1 -- 172.21.15.172:0/2748159815 learned_addr learned my addr 172.21.15.172:0/2748159815 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:39.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.232+0000 7fd9c1691640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9bc0cd520 0x7fd9bc0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9c1e92640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9bc15a9f0 0x7fd9bc149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9c0e90640 1 -- 172.21.15.172:0/2748159815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9bc15a9f0 msgr2=0x7fd9bc149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9c0e90640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9bc15a9f0 0x7fd9bc149fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9c0e90640 1 -- 172.21.15.172:0/2748159815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9bc0cd520 msgr2=0x7fd9bc0b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9c0e90640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9bc0cd520 0x7fd9bc0b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9c0e90640 1 -- 172.21.15.172:0/2748159815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc1f5130 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9c0e90640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 0x7fd9bc06f930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9b002a2b0 tx=0x7fd9b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9b9ffb640 1 -- 172.21.15.172:0/2748159815 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0037040 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9b9ffb640 1 -- 172.21.15.172:0/2748159815 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b0042070 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2748159815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc1f5410 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9b9ffb640 1 -- 172.21.15.172:0/2748159815 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0030880 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.233+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2748159815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc1f59d0 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.234+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2748159815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9bc06cc80 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.234+0000 7fd9b9ffb640 1 -- 172.21.15.172:0/2748159815 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd9b0030a20 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.235+0000 7fd9b9ffb640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd9a806b4d0 0x7fd9a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.235+0000 7fd9c1691640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd9a806b4d0 0x7fd9a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.235+0000 7fd9b9ffb640 1 -- 172.21.15.172:0/2748159815 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd9b00aada0 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.235+0000 7fd9c1691640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd9a806b4d0 0x7fd9a806d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009a30 tx=0x7fd9b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:39.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.239+0000 7fd9b9ffb640 1 -- 172.21.15.172:0/2748159815 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9b00798e0 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.412+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2748159815 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd9bc0cb920 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.413+0000 7fd9b9ffb640 1 -- 172.21.15.172:0/2748159815 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd9b00791e0 con 0x7fd9bc0cdbf0 2024-04-25T08:42:39.405 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:42:39.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2748159815 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd9a806b4d0 msgr2=0x7fd9a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd9a806b4d0 0x7fd9a806d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009a30 tx=0x7fd9b4008040 comp rx=0 tx=0).stop 2024-04-25T08:42:39.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2748159815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 msgr2=0x7fd9bc06f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 0x7fd9bc06f930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd9b002a2b0 tx=0x7fd9b00046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2748159815 shutdown_connections 2024-04-25T08:42:39.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd9a806b4d0 0x7fd9a806d990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd9bc15a9f0 0x7fd9bc149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9bc0cdbf0 0x7fd9bc06f930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 --2- 172.21.15.172:0/2748159815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd9bc0cd520 0x7fd9bc0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2748159815 >> 172.21.15.172:0/2748159815 conn(0x7fd9bc0b2390 msgr2=0x7fd9bc0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:39.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2748159815 shutdown_connections 2024-04-25T08:42:39.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.415+0000 7fd9c38f5640 1 -- 172.21.15.172:0/2748159815 wait complete. 2024-04-25T08:42:39.419 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:42:39.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.524+0000 7f05c14c6640 1 Processor -- start 2024-04-25T08:42:39.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.524+0000 7f05c14c6640 1 -- start start 2024-04-25T08:42:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.525+0000 7f05c14c6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f05bc0cadb0 0x7f05bc0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.525+0000 7f05c14c6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f05bc0ccfe0 0x7f05bc0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.525+0000 7f05c14c6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc0afc80 con 0x7f05bc15de80 2024-04-25T08:42:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.525+0000 7f05c14c6640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc0cb240 con 0x7f05bc0ccfe0 2024-04-25T08:42:39.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.525+0000 7f05c14c6640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc0ce4d0 con 0x7f05bc0cadb0 2024-04-25T08:42:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.525+0000 7f05bb7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f05bc0ccfe0 0x7f05bc0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.525+0000 7f05bb7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f05bc0ccfe0 0x7f05bc0cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43906/0 (socket says 172.21.15.172:43906) 2024-04-25T08:42:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.525+0000 7f05bb7fe640 1 -- 172.21.15.172:0/1972969214 learned_addr learned my addr 172.21.15.172:0/1972969214 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.526+0000 7f05ba7fc640 1 --2- 172.21.15.172:0/1972969214 >> v2:172.21.15.186:3300/0 conn(0x7f05bc0cadb0 0x7f05bc0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.526+0000 7f05bb7fe640 1 -- 172.21.15.172:0/1972969214 >> v2:172.21.15.186:3300/0 conn(0x7f05bc0cadb0 msgr2=0x7f05bc0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.526+0000 7f05bb7fe640 1 --2- 172.21.15.172:0/1972969214 >> v2:172.21.15.186:3300/0 conn(0x7f05bc0cadb0 0x7f05bc0cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.526+0000 7f05bb7fe640 1 -- 172.21.15.172:0/1972969214 >> v1:172.21.15.186:6789/0 conn(0x7f05bc15de80 legacy=0x7f05bc0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:39.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.526+0000 7f05bb7fe640 1 -- 172.21.15.172:0/1972969214 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc0ce7b0 con 0x7f05bc0ccfe0 2024-04-25T08:42:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.526+0000 7f05bb7fe640 1 --2- 172.21.15.172:0/1972969214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc0ccfe0 0x7f05bc0cd410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f05bc062500 tx=0x7f05b402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0884fb94873c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05b9ffb640 1 -- 172.21.15.172:0/1972969214 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4037070 con 0x7f05bc0ccfe0 2024-04-25T08:42:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05b9ffb640 1 -- 172.21.15.172:0/1972969214 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4032440 con 0x7f05bc0ccfe0 2024-04-25T08:42:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05b9ffb640 1 -- 172.21.15.172:0/1972969214 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4032810 con 0x7f05bc0ccfe0 2024-04-25T08:42:39.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05c14c6640 1 -- 172.21.15.172:0/1972969214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc0ccfe0 msgr2=0x7f05bc0cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05c14c6640 1 --2- 172.21.15.172:0/1972969214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc0ccfe0 0x7f05bc0cd410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f05bc062500 tx=0x7f05b402a230 comp rx=0 tx=0).stop 2024-04-25T08:42:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05c14c6640 1 -- 172.21.15.172:0/1972969214 shutdown_connections 2024-04-25T08:42:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05c14c6640 1 --2- 172.21.15.172:0/1972969214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc0ccfe0 0x7f05bc0cd410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05c14c6640 1 --2- 172.21.15.172:0/1972969214 >> v2:172.21.15.186:3300/0 conn(0x7f05bc0cadb0 0x7f05bc0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05c14c6640 1 -- 172.21.15.172:0/1972969214 >> 172.21.15.172:0/1972969214 conn(0x7f05bc0b2390 msgr2=0x7f05bc0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05c14c6640 1 -- 172.21.15.172:0/1972969214 shutdown_connections 2024-04-25T08:42:39.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.527+0000 7f05c14c6640 1 -- 172.21.15.172:0/1972969214 wait complete. 2024-04-25T08:42:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.528+0000 7f05c14c6640 1 Processor -- start 2024-04-25T08:42:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.528+0000 7f05c14c6640 1 -- start start 2024-04-25T08:42:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05c14c6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05bc0cadb0 0x7f05bc0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05c14c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05bc0ccfe0 0x7f05bc0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05c14c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc15de80 0x7f05bc1f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05c14c6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc15e260 con 0x7f05bc15de80 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05c14c6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0cfc00 con 0x7f05bc0cadb0 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05c14c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0b2eb0 con 0x7f05bc0ccfe0 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05bb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc15de80 0x7f05bc1f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05bb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc15de80 0x7f05bc1f6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43920/0 (socket says 172.21.15.172:43920) 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05bb7fe640 1 -- 172.21.15.172:0/2869283418 learned_addr learned my addr 172.21.15.172:0/2869283418 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05baffd640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05bc0cadb0 0x7f05bc0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.529+0000 7f05ba7fc640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05bc0ccfe0 0x7f05bc0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05bb7fe640 1 -- 172.21.15.172:0/2869283418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05bc0ccfe0 msgr2=0x7f05bc0b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05bb7fe640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05bc0ccfe0 0x7f05bc0b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05bb7fe640 1 -- 172.21.15.172:0/2869283418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05bc0cadb0 msgr2=0x7f05bc0c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05bb7fe640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05bc0cadb0 0x7f05bc0c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05bb7fe640 1 -- 172.21.15.172:0/2869283418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc1f7de0 con 0x7f05bc15de80 2024-04-25T08:42:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05bb7fe640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc15de80 0x7f05bc1f6fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f05b40090b0 tx=0x7f05b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05a37fe640 1 -- 172.21.15.172:0/2869283418 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4041020 con 0x7f05bc15de80 2024-04-25T08:42:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05a37fe640 1 -- 172.21.15.172:0/2869283418 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b40306c0 con 0x7f05bc15de80 2024-04-25T08:42:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05a37fe640 1 -- 172.21.15.172:0/2869283418 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4037040 con 0x7f05bc15de80 2024-04-25T08:42:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05c14c6640 1 -- 172.21.15.172:0/2869283418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc1f7b00 con 0x7f05bc15de80 2024-04-25T08:42:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.530+0000 7f05c14c6640 1 -- 172.21.15.172:0/2869283418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc0c7bb0 con 0x7f05bc15de80 2024-04-25T08:42:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.531+0000 7f05c14c6640 1 -- 172.21.15.172:0/2869283418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc073a00 con 0x7f05bc15de80 2024-04-25T08:42:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.531+0000 7f05a37fe640 1 -- 172.21.15.172:0/2869283418 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05b4044020 con 0x7f05bc15de80 2024-04-25T08:42:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.532+0000 7f05a37fe640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05a806b4d0 0x7f05a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.532+0000 7f05a37fe640 1 -- 172.21.15.172:0/2869283418 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f05b40aab70 con 0x7f05bc15de80 2024-04-25T08:42:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.532+0000 7f05baffd640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05a806b4d0 0x7f05a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.532+0000 7f05baffd640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05a806b4d0 0x7f05a806d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0ce010 tx=0x7f05ac00d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:39.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.536+0000 7f05a37fe640 1 -- 172.21.15.172:0/2869283418 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05b404b030 con 0x7f05bc15de80 2024-04-25T08:42:39.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.718+0000 7f05c14c6640 1 -- 172.21.15.172:0/2869283418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05bc158750 con 0x7f05bc15de80 2024-04-25T08:42:39.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.718+0000 7f05a37fe640 1 -- 172.21.15.172:0/2869283418 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f05b4079060 con 0x7f05bc15de80 2024-04-25T08:42:39.711 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:42:39.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.720+0000 7f05c14c6640 1 -- 172.21.15.172:0/2869283418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05a806b4d0 msgr2=0x7f05a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.720+0000 7f05c14c6640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05a806b4d0 0x7f05a806d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0ce010 tx=0x7f05ac00d040 comp rx=0 tx=0).stop 2024-04-25T08:42:39.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.720+0000 7f05c14c6640 1 -- 172.21.15.172:0/2869283418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc15de80 msgr2=0x7f05bc1f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.720+0000 7f05c14c6640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc15de80 0x7f05bc1f6fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f05b40090b0 tx=0x7f05b40046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.720+0000 7f05c14c6640 1 -- 172.21.15.172:0/2869283418 shutdown_connections 2024-04-25T08:42:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.720+0000 7f05c14c6640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05a806b4d0 0x7f05a806d990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.720+0000 7f05c14c6640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05bc15de80 0x7f05bc1f6fb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.720+0000 7f05c14c6640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05bc0ccfe0 0x7f05bc0b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.720+0000 7f05c14c6640 1 --2- 172.21.15.172:0/2869283418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05bc0cadb0 0x7f05bc0c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.720+0000 7f05c14c6640 1 -- 172.21.15.172:0/2869283418 >> 172.21.15.172:0/2869283418 conn(0x7f05bc0b2390 msgr2=0x7f05bc15ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.721+0000 7f05c14c6640 1 -- 172.21.15.172:0/2869283418 shutdown_connections 2024-04-25T08:42:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.721+0000 7f05c14c6640 1 -- 172.21.15.172:0/2869283418 wait complete. 2024-04-25T08:42:39.724 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:42:39.724 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:42:39.739 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:39.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.883+0000 7f4f98db6640 1 Processor -- start 2024-04-25T08:42:39.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.883+0000 7f4f98db6640 1 -- start start 2024-04-25T08:42:39.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f98db6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f9415bd30 0x7f4f940cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f98db6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4f940cfe40 0x7f4f940d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f98db6640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940b5a40 con 0x7f4f940d1930 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f98db6640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f940d0350 con 0x7f4f940cfe40 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f98db6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940d0630 con 0x7f4f9415bd30 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f91d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4f940cfe40 0x7f4f940d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f92d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4f940d1930 0x7f4f940ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42940/0 (socket says 172.21.15.172:42940) 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f92d9d640 1 -- 172.21.15.172:0/420132120 learned_addr learned my addr 172.21.15.172:0/420132120 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f9259c640 1 --2- 172.21.15.172:0/420132120 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f9415bd30 0x7f4f940cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f91d9b640 1 -- 172.21.15.172:0/420132120 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f9415bd30 msgr2=0x7f4f940cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f91d9b640 1 --2- 172.21.15.172:0/420132120 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f9415bd30 0x7f4f940cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f91d9b640 1 -- 172.21.15.172:0/420132120 >> v1:172.21.15.172:6789/0 conn(0x7f4f940d1930 legacy=0x7f4f940ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f9159a640 1 -- 172.21.15.172:0/420132120 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965166023 0 0) 0x7f4f940b5a40 con 0x7f4f940d1930 2024-04-25T08:42:39.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.884+0000 7f4f91d9b640 1 -- 172.21.15.172:0/420132120 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940d0910 con 0x7f4f940cfe40 2024-04-25T08:42:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.885+0000 7f4f91d9b640 1 --2- 172.21.15.172:0/420132120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 0x7f4f940d13f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4f880097a0 tx=0x7f4f8802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329d45911c100621 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.885+0000 7f4f9159a640 1 -- 172.21.15.172:0/420132120 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88037070 con 0x7f4f940cfe40 2024-04-25T08:42:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.885+0000 7f4f9159a640 1 -- 172.21.15.172:0/420132120 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f88032440 con 0x7f4f940cfe40 2024-04-25T08:42:39.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.885+0000 7f4f9159a640 1 -- 172.21.15.172:0/420132120 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88032810 con 0x7f4f940cfe40 2024-04-25T08:42:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.886+0000 7f4f98db6640 1 -- 172.21.15.172:0/420132120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 msgr2=0x7f4f940d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.886+0000 7f4f98db6640 1 --2- 172.21.15.172:0/420132120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 0x7f4f940d13f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4f880097a0 tx=0x7f4f8802a210 comp rx=0 tx=0).stop 2024-04-25T08:42:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.886+0000 7f4f98db6640 1 -- 172.21.15.172:0/420132120 shutdown_connections 2024-04-25T08:42:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.886+0000 7f4f98db6640 1 --2- 172.21.15.172:0/420132120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 0x7f4f940d13f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.886+0000 7f4f98db6640 1 --2- 172.21.15.172:0/420132120 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f9415bd30 0x7f4f940cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.886+0000 7f4f98db6640 1 -- 172.21.15.172:0/420132120 >> 172.21.15.172:0/420132120 conn(0x7f4f9406f590 msgr2=0x7f4f9406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.886+0000 7f4f98db6640 1 -- 172.21.15.172:0/420132120 shutdown_connections 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.886+0000 7f4f98db6640 1 -- 172.21.15.172:0/420132120 wait complete. 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.887+0000 7f4f98db6640 1 Processor -- start 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.887+0000 7f4f98db6640 1 -- start start 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f98db6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 0x7f4f94150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f98db6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f940d1930 0x7f4f9406bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f98db6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f9415bd30 0x7f4f940c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f98db6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9415c110 con 0x7f4f940cfe40 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f98db6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940d0ed0 con 0x7f4f9415bd30 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f98db6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940b73b0 con 0x7f4f940d1930 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f9259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 0x7f4f94150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f9259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 0x7f4f94150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43936/0 (socket says 172.21.15.172:43936) 2024-04-25T08:42:39.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f9259c640 1 -- 172.21.15.172:0/255670290 learned_addr learned my addr 172.21.15.172:0/255670290 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f91d9b640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f940d1930 0x7f4f9406bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f92d9d640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f9415bd30 0x7f4f940c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f9259c640 1 -- 172.21.15.172:0/255670290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f940d1930 msgr2=0x7f4f9406bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f9259c640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f940d1930 0x7f4f9406bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f9259c640 1 -- 172.21.15.172:0/255670290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f9415bd30 msgr2=0x7f4f940c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f9259c640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f9415bd30 0x7f4f940c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f9259c640 1 -- 172.21.15.172:0/255670290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940ca210 con 0x7f4f940cfe40 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f91d9b640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f940d1930 0x7f4f9406bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.888+0000 7f4f92d9d640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f9415bd30 0x7f4f940c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.889+0000 7f4f9259c640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 0x7f4f94150fc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400c7f0 tx=0x7f4f8400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.889+0000 7f4f82ffd640 1 -- 172.21.15.172:0/255670290 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84015070 con 0x7f4f940cfe40 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.889+0000 7f4f82ffd640 1 -- 172.21.15.172:0/255670290 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f84004220 con 0x7f4f940cfe40 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.889+0000 7f4f98db6640 1 -- 172.21.15.172:0/255670290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9415dbc0 con 0x7f4f940cfe40 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.889+0000 7f4f82ffd640 1 -- 172.21.15.172:0/255670290 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84007620 con 0x7f4f940cfe40 2024-04-25T08:42:39.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.889+0000 7f4f98db6640 1 -- 172.21.15.172:0/255670290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9415e180 con 0x7f4f940cfe40 2024-04-25T08:42:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.890+0000 7f4f98db6640 1 -- 172.21.15.172:0/255670290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f940d2620 con 0x7f4f940cfe40 2024-04-25T08:42:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.890+0000 7f4f82ffd640 1 -- 172.21.15.172:0/255670290 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4f840079d0 con 0x7f4f940cfe40 2024-04-25T08:42:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.890+0000 7f4f82ffd640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f7406b4d0 0x7f4f7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.891+0000 7f4f91d9b640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f7406b4d0 0x7f4f7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.891+0000 7f4f82ffd640 1 -- 172.21.15.172:0/255670290 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4f8408a900 con 0x7f4f940cfe40 2024-04-25T08:42:39.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.891+0000 7f4f91d9b640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f7406b4d0 0x7f4f7406d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f88034000 tx=0x7f4f8802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:39.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:39.895+0000 7f4f82ffd640 1 -- 172.21.15.172:0/255670290 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4f940d2620 con 0x7f4f940cfe40 2024-04-25T08:42:40.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.067+0000 7f4f98db6640 1 -- 172.21.15.172:0/255670290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f94073990 con 0x7f4f940cfe40 2024-04-25T08:42:40.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.068+0000 7f4f82ffd640 1 -- 172.21.15.172:0/255670290 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f4f84059440 con 0x7f4f940cfe40 2024-04-25T08:42:40.061 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:40.061 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:40.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.070+0000 7f4f98db6640 1 -- 172.21.15.172:0/255670290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f7406b4d0 msgr2=0x7f4f7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.070+0000 7f4f98db6640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f7406b4d0 0x7f4f7406d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f88034000 tx=0x7f4f8802e000 comp rx=0 tx=0).stop 2024-04-25T08:42:40.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.070+0000 7f4f98db6640 1 -- 172.21.15.172:0/255670290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 msgr2=0x7f4f94150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.070+0000 7f4f98db6640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 0x7f4f94150fc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400c7f0 tx=0x7f4f8400ccb0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.071+0000 7f4f98db6640 1 -- 172.21.15.172:0/255670290 shutdown_connections 2024-04-25T08:42:40.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.071+0000 7f4f98db6640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f7406b4d0 0x7f4f7406d990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.071+0000 7f4f98db6640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f9415bd30 0x7f4f940c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.071+0000 7f4f98db6640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f940d1930 0x7f4f9406bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.071+0000 7f4f98db6640 1 --2- 172.21.15.172:0/255670290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f940cfe40 0x7f4f94150fc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.071+0000 7f4f98db6640 1 -- 172.21.15.172:0/255670290 >> 172.21.15.172:0/255670290 conn(0x7f4f9406f590 msgr2=0x7f4f940b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:40.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.071+0000 7f4f98db6640 1 -- 172.21.15.172:0/255670290 shutdown_connections 2024-04-25T08:42:40.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.071+0000 7f4f98db6640 1 -- 172.21.15.172:0/255670290 wait complete. 2024-04-25T08:42:40.074 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:42:40.075 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:42:40.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.183+0000 7f4c81f96640 1 Processor -- start 2024-04-25T08:42:40.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.183+0000 7f4c81f96640 1 -- start start 2024-04-25T08:42:40.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c81f96640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4c7c15dac0 0x7f4c7c0d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c81f96640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4c7c0d1f30 0x7f4c7c0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c81f96640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7c0d2420 con 0x7f4c7c0d34c0 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c81f96640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7c0d3030 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c81f96640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7c0d2700 con 0x7f4c7c15dac0 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c7affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4c7c0d1f30 0x7f4c7c0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c7affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4c7c0d1f30 0x7f4c7c0d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43942/0 (socket says 172.21.15.172:43942) 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c7affd640 1 -- 172.21.15.172:0/3067876355 learned_addr learned my addr 172.21.15.172:0/3067876355 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c7b7fe640 1 --2- 172.21.15.172:0/3067876355 >> v2:172.21.15.186:3300/0 conn(0x7f4c7c15dac0 0x7f4c7c0d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c7affd640 1 -- 172.21.15.172:0/3067876355 >> v2:172.21.15.186:3300/0 conn(0x7f4c7c15dac0 msgr2=0x7f4c7c0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c7affd640 1 --2- 172.21.15.172:0/3067876355 >> v2:172.21.15.186:3300/0 conn(0x7f4c7c15dac0 0x7f4c7c0d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c7affd640 1 -- 172.21.15.172:0/3067876355 >> v1:172.21.15.186:6789/0 conn(0x7f4c7c0d34c0 legacy=0x7f4c7c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.184+0000 7f4c7affd640 1 -- 172.21.15.172:0/3067876355 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c0d29e0 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c7affd640 1 --2- 172.21.15.172:0/3067876355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 0x7f4c7c0d03a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0b6520 tx=0x7f4c6c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e0010d3f4b40fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c7a7fc640 1 -- 172.21.15.172:0/3067876355 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c004230 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c7a7fc640 1 -- 172.21.15.172:0/3067876355 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c02ae50 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c7a7fc640 1 -- 172.21.15.172:0/3067876355 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c003610 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c81f96640 1 -- 172.21.15.172:0/3067876355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 msgr2=0x7f4c7c0d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c81f96640 1 --2- 172.21.15.172:0/3067876355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 0x7f4c7c0d03a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0b6520 tx=0x7f4c6c02a300 comp rx=0 tx=0).stop 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c81f96640 1 -- 172.21.15.172:0/3067876355 shutdown_connections 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c81f96640 1 --2- 172.21.15.172:0/3067876355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 0x7f4c7c0d03a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c81f96640 1 --2- 172.21.15.172:0/3067876355 >> v2:172.21.15.186:3300/0 conn(0x7f4c7c15dac0 0x7f4c7c0d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c81f96640 1 -- 172.21.15.172:0/3067876355 >> 172.21.15.172:0/3067876355 conn(0x7f4c7c061c30 msgr2=0x7f4c7c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c81f96640 1 -- 172.21.15.172:0/3067876355 shutdown_connections 2024-04-25T08:42:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.185+0000 7f4c81f96640 1 -- 172.21.15.172:0/3067876355 wait complete. 2024-04-25T08:42:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.187+0000 7f4c81f96640 1 Processor -- start 2024-04-25T08:42:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.187+0000 7f4c81f96640 1 -- start start 2024-04-25T08:42:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.187+0000 7f4c81f96640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 0x7f4c7c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.187+0000 7f4c81f96640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c7c0d34c0 0x7f4c7c156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.187+0000 7f4c81f96640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7c15dac0 0x7f4c7c0c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.187+0000 7f4c81f96640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c0b97d0 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.187+0000 7f4c81f96640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c15dea0 con 0x7f4c7c15dac0 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.187+0000 7f4c81f96640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c0b9950 con 0x7f4c7c0d34c0 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 0x7f4c7c15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 0x7f4c7c15e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43954/0 (socket says 172.21.15.172:43954) 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7b7fe640 1 -- 172.21.15.172:0/778764746 learned_addr learned my addr 172.21.15.172:0/778764746 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7bfff640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7c15dac0 0x7f4c7c0c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7affd640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c7c0d34c0 0x7f4c7c156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7b7fe640 1 -- 172.21.15.172:0/778764746 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c7c0d34c0 msgr2=0x7f4c7c156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7b7fe640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c7c0d34c0 0x7f4c7c156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7b7fe640 1 -- 172.21.15.172:0/778764746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7c15dac0 msgr2=0x7f4c7c0c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7b7fe640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7c15dac0 0x7f4c7c0c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7b7fe640 1 -- 172.21.15.172:0/778764746 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c15e640 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c7b7fe640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 0x7f4c7c15e020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000e870 tx=0x7f4c7000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c63fff640 1 -- 172.21.15.172:0/778764746 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70017070 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c63fff640 1 -- 172.21.15.172:0/778764746 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7000c940 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c63fff640 1 -- 172.21.15.172:0/778764746 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000cd30 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c81f96640 1 -- 172.21.15.172:0/778764746 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c15e920 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.188+0000 7f4c81f96640 1 -- 172.21.15.172:0/778764746 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c15eee0 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.189+0000 7f4c81f96640 1 -- 172.21.15.172:0/778764746 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c073a00 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.190+0000 7f4c63fff640 1 -- 172.21.15.172:0/778764746 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c7001a070 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.190+0000 7f4c63fff640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b4d0 0x7f4c6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.190+0000 7f4c63fff640 1 -- 172.21.15.172:0/778764746 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4c7008a710 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.190+0000 7f4c7affd640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b4d0 0x7f4c6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.190+0000 7f4c7affd640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b4d0 0x7f4c6806d990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c033000 tx=0x7f4c6c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:40.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.194+0000 7f4c63fff640 1 -- 172.21.15.172:0/778764746 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c70058c00 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.364+0000 7f4c81f96640 1 -- 172.21.15.172:0/778764746 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c7c0b2440 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.364+0000 7f4c63fff640 1 -- 172.21.15.172:0/778764746 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c7005cca0 con 0x7f4c7c0d1f30 2024-04-25T08:42:40.357 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:42:40.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.366+0000 7f4c81f96640 1 -- 172.21.15.172:0/778764746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b4d0 msgr2=0x7f4c6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.366+0000 7f4c81f96640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b4d0 0x7f4c6806d990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c033000 tx=0x7f4c6c02e000 comp rx=0 tx=0).stop 2024-04-25T08:42:40.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.366+0000 7f4c81f96640 1 -- 172.21.15.172:0/778764746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 msgr2=0x7f4c7c15e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.366+0000 7f4c81f96640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 0x7f4c7c15e020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000e870 tx=0x7f4c7000ed30 comp rx=0 tx=0).stop 2024-04-25T08:42:40.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.366+0000 7f4c81f96640 1 -- 172.21.15.172:0/778764746 shutdown_connections 2024-04-25T08:42:40.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.366+0000 7f4c81f96640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b4d0 0x7f4c6806d990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.366+0000 7f4c81f96640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7c15dac0 0x7f4c7c0c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.366+0000 7f4c81f96640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c7c0d34c0 0x7f4c7c156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.366+0000 7f4c81f96640 1 --2- 172.21.15.172:0/778764746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c0d1f30 0x7f4c7c15e020 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.366+0000 7f4c81f96640 1 -- 172.21.15.172:0/778764746 >> 172.21.15.172:0/778764746 conn(0x7f4c7c061c30 msgr2=0x7f4c7c0d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:40.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.367+0000 7f4c81f96640 1 -- 172.21.15.172:0/778764746 shutdown_connections 2024-04-25T08:42:40.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.367+0000 7f4c81f96640 1 -- 172.21.15.172:0/778764746 wait complete. 2024-04-25T08:42:40.370 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:42:40.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.477+0000 7f56fa169640 1 Processor -- start 2024-04-25T08:42:40.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.477+0000 7f56fa169640 1 -- start start 2024-04-25T08:42:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.478+0000 7f56fa169640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 0x7f56f40cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.478+0000 7f56fa169640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f56f40cbf20 0x7f56f40cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.478+0000 7f56fa169640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f40c75e0 con 0x7f56f415bb50 2024-04-25T08:42:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.478+0000 7f56fa169640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f40c8680 con 0x7f56f40cbf20 2024-04-25T08:42:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.478+0000 7f56fa169640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40cff80 con 0x7f56f40cf600 2024-04-25T08:42:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.478+0000 7f56f3fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f56f40cbf20 0x7f56f40cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.478+0000 7f56eaffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 0x7f56f40cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.478+0000 7f56f37fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f56f415bb50 0x7f56f40c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:36102/0 (socket says 172.21.15.172:36102) 2024-04-25T08:42:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.478+0000 7f56f37fe640 1 -- 172.21.15.172:0/1880576932 learned_addr learned my addr 172.21.15.172:0/1880576932 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.479+0000 7f56f3fff640 1 -- 172.21.15.172:0/1880576932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 msgr2=0x7f56f40cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.479+0000 7f56f3fff640 1 --2- 172.21.15.172:0/1880576932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 0x7f56f40cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.479+0000 7f56f3fff640 1 -- 172.21.15.172:0/1880576932 >> v1:172.21.15.186:6789/0 conn(0x7f56f415bb50 legacy=0x7f56f40c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.479+0000 7f56f3fff640 1 -- 172.21.15.172:0/1880576932 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f40c78c0 con 0x7f56f40cbf20 2024-04-25T08:42:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.479+0000 7f56eaffd640 1 --2- 172.21.15.172:0/1880576932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 0x7f56f40cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:40.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56f3fff640 1 --2- 172.21.15.172:0/1880576932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f40cbf20 0x7f56f40cc3b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009d90 tx=0x7f56ec02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=575b04c253c047ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:40.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56f2ffd640 1 -- 172.21.15.172:0/1880576932 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec007740 con 0x7f56f40cbf20 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56f2ffd640 1 -- 172.21.15.172:0/1880576932 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec0078e0 con 0x7f56f40cbf20 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56f2ffd640 1 -- 172.21.15.172:0/1880576932 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec007cb0 con 0x7f56f40cbf20 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56fa169640 1 -- 172.21.15.172:0/1880576932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f40cbf20 msgr2=0x7f56f40cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56fa169640 1 --2- 172.21.15.172:0/1880576932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f40cbf20 0x7f56f40cc3b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009d90 tx=0x7f56ec02a6f0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56fa169640 1 -- 172.21.15.172:0/1880576932 shutdown_connections 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56fa169640 1 --2- 172.21.15.172:0/1880576932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 0x7f56f40cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56fa169640 1 --2- 172.21.15.172:0/1880576932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f40cbf20 0x7f56f40cc3b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56fa169640 1 -- 172.21.15.172:0/1880576932 >> 172.21.15.172:0/1880576932 conn(0x7f56f406f500 msgr2=0x7f56f406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56fa169640 1 -- 172.21.15.172:0/1880576932 shutdown_connections 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.480+0000 7f56fa169640 1 -- 172.21.15.172:0/1880576932 wait complete. 2024-04-25T08:42:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.481+0000 7f56fa169640 1 Processor -- start 2024-04-25T08:42:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.482+0000 7f56fa169640 1 -- start start 2024-04-25T08:42:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.482+0000 7f56fa169640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f40cbf20 0x7f56f414a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.482+0000 7f56fa169640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 0x7f56f4157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.482+0000 7f56fa169640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f415bb50 0x7f56f415e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.482+0000 7f56fa169640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40c8160 con 0x7f56f40cbf20 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.482+0000 7f56fa169640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40c7e80 con 0x7f56f415bb50 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.482+0000 7f56fa169640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40c72a0 con 0x7f56f40cf600 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.482+0000 7f56f37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f40cbf20 0x7f56f414a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f3fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f415bb50 0x7f56f415e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f40cbf20 0x7f56f414a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43962/0 (socket says 172.21.15.172:43962) 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f37fe640 1 -- 172.21.15.172:0/2445675995 learned_addr learned my addr 172.21.15.172:0/2445675995 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56eaffd640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 0x7f56f4157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f37fe640 1 -- 172.21.15.172:0/2445675995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 msgr2=0x7f56f4157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f37fe640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 0x7f56f4157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f37fe640 1 -- 172.21.15.172:0/2445675995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f415bb50 msgr2=0x7f56f415e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f37fe640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f415bb50 0x7f56f415e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f37fe640 1 -- 172.21.15.172:0/2445675995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f40c9be0 con 0x7f56f40cbf20 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f3fff640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f415bb50 0x7f56f415e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f37fe640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f40cbf20 0x7f56f414a360 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f56e400c3c0 tx=0x7f56e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:40.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f0ff9640 1 -- 172.21.15.172:0/2445675995 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4017070 con 0x7f56f40cbf20 2024-04-25T08:42:40.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f0ff9640 1 -- 172.21.15.172:0/2445675995 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e4005ce0 con 0x7f56f40cbf20 2024-04-25T08:42:40.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56f0ff9640 1 -- 172.21.15.172:0/2445675995 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e40072f0 con 0x7f56f40cbf20 2024-04-25T08:42:40.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56fa169640 1 -- 172.21.15.172:0/2445675995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f40c9ec0 con 0x7f56f40cbf20 2024-04-25T08:42:40.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.483+0000 7f56fa169640 1 -- 172.21.15.172:0/2445675995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f40ca480 con 0x7f56f40cbf20 2024-04-25T08:42:40.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.484+0000 7f56fa169640 1 -- 172.21.15.172:0/2445675995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f4073a00 con 0x7f56f40cbf20 2024-04-25T08:42:40.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.485+0000 7f56f0ff9640 1 -- 172.21.15.172:0/2445675995 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f56e401a070 con 0x7f56f40cbf20 2024-04-25T08:42:40.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.485+0000 7f56f0ff9640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d406b4d0 0x7f56d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.485+0000 7f56f0ff9640 1 -- 172.21.15.172:0/2445675995 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f56e4089870 con 0x7f56f40cbf20 2024-04-25T08:42:40.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.485+0000 7f56eaffd640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d406b4d0 0x7f56d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.485+0000 7f56eaffd640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d406b4d0 0x7f56d406d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009560 tx=0x7f56dc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:40.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.489+0000 7f56f0ff9640 1 -- 172.21.15.172:0/2445675995 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56e4057d60 con 0x7f56f40cbf20 2024-04-25T08:42:40.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.663+0000 7f56fa169640 1 -- 172.21.15.172:0/2445675995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56f4157fc0 con 0x7f56f40cbf20 2024-04-25T08:42:40.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.663+0000 7f56f0ff9640 1 -- 172.21.15.172:0/2445675995 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56e405be00 con 0x7f56f40cbf20 2024-04-25T08:42:40.656 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:42:40.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 -- 172.21.15.172:0/2445675995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d406b4d0 msgr2=0x7f56d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d406b4d0 0x7f56d406d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009560 tx=0x7f56dc009190 comp rx=0 tx=0).stop 2024-04-25T08:42:40.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 -- 172.21.15.172:0/2445675995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f40cbf20 msgr2=0x7f56f414a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f40cbf20 0x7f56f414a360 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f56e400c3c0 tx=0x7f56e400c880 comp rx=0 tx=0).stop 2024-04-25T08:42:40.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 -- 172.21.15.172:0/2445675995 shutdown_connections 2024-04-25T08:42:40.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d406b4d0 0x7f56d406d990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f415bb50 0x7f56f415e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f40cf600 0x7f56f4157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 --2- 172.21.15.172:0/2445675995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f40cbf20 0x7f56f414a360 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 -- 172.21.15.172:0/2445675995 >> 172.21.15.172:0/2445675995 conn(0x7f56f406f500 msgr2=0x7f56f40b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:40.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 -- 172.21.15.172:0/2445675995 shutdown_connections 2024-04-25T08:42:40.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.665+0000 7f56fa169640 1 -- 172.21.15.172:0/2445675995 wait complete. 2024-04-25T08:42:40.669 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:42:40.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.781+0000 7fccef5b0640 1 Processor -- start 2024-04-25T08:42:40.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.781+0000 7fccef5b0640 1 -- start start 2024-04-25T08:42:40.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.782+0000 7fccef5b0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce815a9f0 0x7fcce80c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.782+0000 7fccef5b0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcce80cd6f0 0x7fcce80cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.782+0000 7fccef5b0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce80c6940 con 0x7fcce80cdbf0 2024-04-25T08:42:40.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.782+0000 7fccef5b0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce80b0020 con 0x7fcce80cd6f0 2024-04-25T08:42:40.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.782+0000 7fccef5b0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80cb5a0 con 0x7fcce815a9f0 2024-04-25T08:42:40.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.782+0000 7fccecb4b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcce80cdbf0 0x7fcce80ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42948/0 (socket says 172.21.15.172:42948) 2024-04-25T08:42:40.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.782+0000 7fccecb4b640 1 -- 172.21.15.172:0/3622051318 learned_addr learned my addr 172.21.15.172:0/3622051318 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:40.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccedb4d640 1 --2- 172.21.15.172:0/3622051318 >> v2:172.21.15.186:3300/0 conn(0x7fcce80cd6f0 0x7fcce80cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fcced34c640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce815a9f0 0x7fcce80c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224510239 0 0) 0x7fccd8001110 con 0x7fcce80cdbf0 2024-04-25T08:42:40.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd4003520 con 0x7fcce80cdbf0 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2730431984 0 0) 0x7fccd4003520 con 0x7fcce80cdbf0 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce815a9f0 msgr2=0x7fcce80c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce815a9f0 0x7fcce80c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 >> v2:172.21.15.186:3300/0 conn(0x7fcce80cd6f0 msgr2=0x7fcce80cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 --2- 172.21.15.172:0/3622051318 >> v2:172.21.15.186:3300/0 conn(0x7fcce80cd6f0 0x7fcce80cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce815add0 con 0x7fcce80cdbf0 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fccd8001840 con 0x7fcce80cdbf0 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 >> v1:172.21.15.172:6789/0 conn(0x7fcce80cdbf0 legacy=0x7fcce80ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccd40039b0 0x7fccd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccd4004800 0x7fccd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce815a9f0 0x7fccd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80cb5a0 con 0x7fccd4004800 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd400b9c0 con 0x7fccd40039b0 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd400bb40 con 0x7fcce815a9f0 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccecb4b640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccd4004800 0x7fccd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fcced34c640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccd40039b0 0x7fccd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccedb4d640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce815a9f0 0x7fccd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccecb4b640 1 -- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce815a9f0 msgr2=0x7fccd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccecb4b640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcce815a9f0 0x7fccd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccecb4b640 1 -- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccd40039b0 msgr2=0x7fccd4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccecb4b640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fccd40039b0 0x7fccd4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.783+0000 7fccecb4b640 1 -- 172.21.15.172:0/3622051318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4003520 con 0x7fccd4004800 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.784+0000 7fccecb4b640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccd4004800 0x7fccd4004c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fccd800c4c0 tx=0x7fccd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847fe02fbcb16faf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.784+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800c0e0 con 0x7fccd4004800 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.784+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd8034070 con 0x7fccd4004800 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.784+0000 7fccdffff640 1 -- 172.21.15.172:0/3622051318 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8005d30 con 0x7fccd4004800 2024-04-25T08:42:40.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.785+0000 7fccef5b0640 1 -- 172.21.15.172:0/3622051318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccd4004800 msgr2=0x7fccd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.785+0000 7fccef5b0640 1 --2- 172.21.15.172:0/3622051318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccd4004800 0x7fccd4004c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fccd800c4c0 tx=0x7fccd4005830 comp rx=0 tx=0).stop 2024-04-25T08:42:40.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.785+0000 7fccedb4d640 1 -- 172.21.15.172:0/3622051318 reap_dead start 2024-04-25T08:42:40.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.785+0000 7fccef5b0640 1 -- 172.21.15.172:0/3622051318 shutdown_connections 2024-04-25T08:42:40.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.785+0000 7fccef5b0640 1 -- 172.21.15.172:0/3622051318 >> 172.21.15.172:0/3622051318 conn(0x7fcce80b2390 msgr2=0x7fcce80b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:40.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.785+0000 7fccef5b0640 1 -- 172.21.15.172:0/3622051318 shutdown_connections 2024-04-25T08:42:40.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.785+0000 7fccef5b0640 1 -- 172.21.15.172:0/3622051318 wait complete. 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.786+0000 7fccef5b0640 1 Processor -- start 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.786+0000 7fccef5b0640 1 -- start start 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccef5b0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fccd4004800 0x7fcce80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccef5b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce80b33c0 0x7fcce80b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccef5b0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcce80b5b80 0x7fcce80b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccef5b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80cb230 con 0x7fcce80b33c0 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccef5b0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80caf50 con 0x7fcce80b5b80 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccef5b0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80ce070 con 0x7fccd4004800 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccecb4b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce80b33c0 0x7fcce80b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccecb4b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce80b33c0 0x7fcce80b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43976/0 (socket says 172.21.15.172:43976) 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccecb4b640 1 -- 172.21.15.172:0/3983791544 learned_addr learned my addr 172.21.15.172:0/3983791544 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:40.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccedb4d640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcce80b5b80 0x7fcce80b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fcced34c640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fccd4004800 0x7fcce80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccecb4b640 1 -- 172.21.15.172:0/3983791544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fccd4004800 msgr2=0x7fcce80aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccecb4b640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fccd4004800 0x7fcce80aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccecb4b640 1 -- 172.21.15.172:0/3983791544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcce80b5b80 msgr2=0x7fcce80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccecb4b640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcce80b5b80 0x7fcce80b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccecb4b640 1 -- 172.21.15.172:0/3983791544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce80ada50 con 0x7fcce80b33c0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccecb4b640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce80b33c0 0x7fcce80b3840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fccd802b000 tx=0x7fcce80cb510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.787+0000 7fccddffb640 1 -- 172.21.15.172:0/3983791544 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8007270 con 0x7fcce80b33c0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.788+0000 7fccddffb640 1 -- 172.21.15.172:0/3983791544 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd8007410 con 0x7fcce80b33c0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.788+0000 7fccddffb640 1 -- 172.21.15.172:0/3983791544 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8007800 con 0x7fcce80b33c0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.788+0000 7fccef5b0640 1 -- 172.21.15.172:0/3983791544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce80add30 con 0x7fcce80b33c0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.788+0000 7fccef5b0640 1 -- 172.21.15.172:0/3983791544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce80ae2f0 con 0x7fcce80b33c0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.789+0000 7fccef5b0640 1 -- 172.21.15.172:0/3983791544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce806cc80 con 0x7fcce80b33c0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.789+0000 7fccddffb640 1 -- 172.21.15.172:0/3983791544 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fccd802f480 con 0x7fcce80b33c0 2024-04-25T08:42:40.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.789+0000 7fccddffb640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcccc06b410 0x7fcccc06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:40.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.790+0000 7fccddffb640 1 -- 172.21.15.172:0/3983791544 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fccd80aaad0 con 0x7fcce80b33c0 2024-04-25T08:42:40.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.790+0000 7fcced34c640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcccc06b410 0x7fcccc06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:40.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.790+0000 7fcced34c640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcccc06b410 0x7fcccc06d8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009a60 tx=0x7fcce4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:40.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.794+0000 7fccddffb640 1 -- 172.21.15.172:0/3983791544 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fccd8040070 con 0x7fcce80b33c0 2024-04-25T08:42:40.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.962+0000 7fccef5b0640 1 -- 172.21.15.172:0/3983791544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcce8073a00 con 0x7fcce80b33c0 2024-04-25T08:42:40.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.963+0000 7fccddffb640 1 -- 172.21.15.172:0/3983791544 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcce80c6940 con 0x7fcce80b33c0 2024-04-25T08:42:40.956 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 -- 172.21.15.172:0/3983791544 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcccc06b410 msgr2=0x7fcccc06d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcccc06b410 0x7fcccc06d8d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009a60 tx=0x7fcce4009190 comp rx=0 tx=0).stop 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 -- 172.21.15.172:0/3983791544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce80b33c0 msgr2=0x7fcce80b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce80b33c0 0x7fcce80b3840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fccd802b000 tx=0x7fcce80cb510 comp rx=0 tx=0).stop 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 -- 172.21.15.172:0/3983791544 shutdown_connections 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcccc06b410 0x7fcccc06d8d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcce80b5b80 0x7fcce80b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce80b33c0 0x7fcce80b3840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 --2- 172.21.15.172:0/3983791544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fccd4004800 0x7fcce80aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 -- 172.21.15.172:0/3983791544 >> 172.21.15.172:0/3983791544 conn(0x7fcce80b2390 msgr2=0x7fcce8159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 -- 172.21.15.172:0/3983791544 shutdown_connections 2024-04-25T08:42:40.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:40.965+0000 7fccef5b0640 1 -- 172.21.15.172:0/3983791544 wait complete. 2024-04-25T08:42:40.968 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:42:41.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.076+0000 7f9a35d89640 1 Processor -- start 2024-04-25T08:42:41.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.076+0000 7f9a35d89640 1 -- start start 2024-04-25T08:42:41.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a35d89640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9a30158230 0x7f9a300d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:41.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a35d89640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a300d2020 con 0x7f9a300b4e60 2024-04-25T08:42:41.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a35d89640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a300d2300 con 0x7f9a300d1b80 2024-04-25T08:42:41.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a35d89640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a30158610 con 0x7f9a30158230 2024-04-25T08:42:41.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a2f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9a30158230 0x7f9a300d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a2ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9a300b4e60 0x7f9a3006f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42954/0 (socket says 172.21.15.172:42954) 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a2f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9a30158230 0x7f9a300d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43992/0 (socket says 172.21.15.172:43992) 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a2ffff640 1 -- 172.21.15.172:0/1409283173 learned_addr learned my addr 172.21.15.172:0/1409283173 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a2f7fe640 1 -- 172.21.15.172:0/1409283173 >> v1:172.21.15.186:6789/0 conn(0x7f9a300d1b80 legacy=0x7f9a3006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a2f7fe640 1 -- 172.21.15.172:0/1409283173 >> v1:172.21.15.172:6789/0 conn(0x7f9a300b4e60 legacy=0x7f9a3006f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a2f7fe640 1 -- 172.21.15.172:0/1409283173 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3006bb30 con 0x7f9a30158230 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.077+0000 7f9a2e7fc640 1 -- 172.21.15.172:0/1409283173 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581569949 0 0) 0x7f9a300d2020 con 0x7f9a300b4e60 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.078+0000 7f9a2f7fe640 1 --2- 172.21.15.172:0/1409283173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a30158230 0x7f9a300d1640 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097a0 tx=0x7f9a2002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494463652ca2bbf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.078+0000 7f9a2e7fc640 1 -- 172.21.15.172:0/1409283173 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20037070 con 0x7f9a30158230 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.078+0000 7f9a2e7fc640 1 -- 172.21.15.172:0/1409283173 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a20032440 con 0x7f9a30158230 2024-04-25T08:42:41.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.078+0000 7f9a2e7fc640 1 -- 172.21.15.172:0/1409283173 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20032810 con 0x7f9a30158230 2024-04-25T08:42:41.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.078+0000 7f9a35d89640 1 -- 172.21.15.172:0/1409283173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a30158230 msgr2=0x7f9a300d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.078+0000 7f9a35d89640 1 --2- 172.21.15.172:0/1409283173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a30158230 0x7f9a300d1640 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097a0 tx=0x7f9a2002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.079+0000 7f9a35d89640 1 -- 172.21.15.172:0/1409283173 shutdown_connections 2024-04-25T08:42:41.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.079+0000 7f9a35d89640 1 --2- 172.21.15.172:0/1409283173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a30158230 0x7f9a300d1640 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.079+0000 7f9a35d89640 1 -- 172.21.15.172:0/1409283173 >> 172.21.15.172:0/1409283173 conn(0x7f9a30061600 msgr2=0x7f9a300619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:41.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.079+0000 7f9a35d89640 1 -- 172.21.15.172:0/1409283173 shutdown_connections 2024-04-25T08:42:41.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.079+0000 7f9a35d89640 1 -- 172.21.15.172:0/1409283173 wait complete. 2024-04-25T08:42:41.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.080+0000 7f9a35d89640 1 Processor -- start 2024-04-25T08:42:41.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.080+0000 7f9a35d89640 1 -- start start 2024-04-25T08:42:41.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a35d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a300b4e60 0x7f9a30154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:41.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a35d89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a300d1b80 0x7f9a301f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:41.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a35d89640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a300cd050 0x7f9a300cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:41.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a35d89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3006ca40 con 0x7f9a300d1b80 2024-04-25T08:42:41.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a35d89640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3006bea0 con 0x7f9a300cd050 2024-04-25T08:42:41.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a35d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3015e320 con 0x7f9a300b4e60 2024-04-25T08:42:41.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a300d1b80 0x7f9a301f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:41.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a300d1b80 0x7f9a301f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44006/0 (socket says 172.21.15.172:44006) 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2effd640 1 -- 172.21.15.172:0/3098068423 learned_addr learned my addr 172.21.15.172:0/3098068423 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2ffff640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a300cd050 0x7f9a300cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2f7fe640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a300b4e60 0x7f9a30154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2effd640 1 -- 172.21.15.172:0/3098068423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a300b4e60 msgr2=0x7f9a30154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2effd640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a300b4e60 0x7f9a30154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2effd640 1 -- 172.21.15.172:0/3098068423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a300cd050 msgr2=0x7f9a300cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2effd640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a300cd050 0x7f9a300cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2effd640 1 -- 172.21.15.172:0/3098068423 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a301e4ec0 con 0x7f9a300d1b80 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2ffff640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a300cd050 0x7f9a300cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a2effd640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a300d1b80 0x7f9a301f3c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400c420 tx=0x7f9a2400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a17fff640 1 -- 172.21.15.172:0/3098068423 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24006820 con 0x7f9a300d1b80 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a17fff640 1 -- 172.21.15.172:0/3098068423 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a240069c0 con 0x7f9a300d1b80 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a35d89640 1 -- 172.21.15.172:0/3098068423 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a301e51a0 con 0x7f9a300d1b80 2024-04-25T08:42:41.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a17fff640 1 -- 172.21.15.172:0/3098068423 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24006dd0 con 0x7f9a300d1b80 2024-04-25T08:42:41.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.081+0000 7f9a35d89640 1 -- 172.21.15.172:0/3098068423 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a301e5760 con 0x7f9a300d1b80 2024-04-25T08:42:41.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.082+0000 7f9a35d89640 1 -- 172.21.15.172:0/3098068423 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3006de50 con 0x7f9a300d1b80 2024-04-25T08:42:41.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.083+0000 7f9a17fff640 1 -- 172.21.15.172:0/3098068423 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9a24019030 con 0x7f9a300d1b80 2024-04-25T08:42:41.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.083+0000 7f9a17fff640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a1c06b4d0 0x7f9a1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:41.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.083+0000 7f9a17fff640 1 -- 172.21.15.172:0/3098068423 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9a24089c30 con 0x7f9a300d1b80 2024-04-25T08:42:41.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.083+0000 7f9a2f7fe640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a1c06b4d0 0x7f9a1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:41.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.084+0000 7f9a2f7fe640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a1c06b4d0 0x7f9a1c06d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a20034000 tx=0x7f9a2002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:41.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.087+0000 7f9a17fff640 1 -- 172.21.15.172:0/3098068423 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9a24020020 con 0x7f9a300d1b80 2024-04-25T08:42:41.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.257+0000 7f9a35d89640 1 -- 172.21.15.172:0/3098068423 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9a3006c4d0 con 0x7f9a300d1b80 2024-04-25T08:42:41.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.257+0000 7f9a17fff640 1 -- 172.21.15.172:0/3098068423 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9a24058800 con 0x7f9a300d1b80 2024-04-25T08:42:41.250 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:42:41.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 -- 172.21.15.172:0/3098068423 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a1c06b4d0 msgr2=0x7f9a1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a1c06b4d0 0x7f9a1c06d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a20034000 tx=0x7f9a2002e000 comp rx=0 tx=0).stop 2024-04-25T08:42:41.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 -- 172.21.15.172:0/3098068423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a300d1b80 msgr2=0x7f9a301f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a300d1b80 0x7f9a301f3c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400c420 tx=0x7f9a2400c8e0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 -- 172.21.15.172:0/3098068423 shutdown_connections 2024-04-25T08:42:41.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a1c06b4d0 0x7f9a1c06d990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a300cd050 0x7f9a300cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a300d1b80 0x7f9a301f3c50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 --2- 172.21.15.172:0/3098068423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a300b4e60 0x7f9a30154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 -- 172.21.15.172:0/3098068423 >> 172.21.15.172:0/3098068423 conn(0x7f9a30061600 msgr2=0x7f9a300b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:41.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 -- 172.21.15.172:0/3098068423 shutdown_connections 2024-04-25T08:42:41.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.259+0000 7f9a35d89640 1 -- 172.21.15.172:0/3098068423 wait complete. 2024-04-25T08:42:41.263 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:42:41.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.369+0000 7f3a8e49e640 1 Processor -- start 2024-04-25T08:42:41.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.369+0000 7f3a8e49e640 1 -- start start 2024-04-25T08:42:41.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a8e49e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3a880d0ab0 0x7f3a88168670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:41.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a8e49e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880d2420 con 0x7f3a8815dac0 2024-04-25T08:42:41.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a8e49e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880d2700 con 0x7f3a880d34c0 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a8e49e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a880d3030 con 0x7f3a880d0ab0 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a8ca3b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3a880d0ab0 0x7f3a88168670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a87fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3a8815dac0 0x7f3a880d19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42956/0 (socket says 172.21.15.172:42956) 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a8ca3b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3a880d0ab0 0x7f3a88168670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44008/0 (socket says 172.21.15.172:44008) 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a87fff640 1 -- 172.21.15.172:0/842534022 learned_addr learned my addr 172.21.15.172:0/842534022 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a8ca3b640 1 -- 172.21.15.172:0/842534022 >> v1:172.21.15.186:6789/0 conn(0x7f3a880d34c0 legacy=0x7f3a880d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a8ca3b640 1 -- 172.21.15.172:0/842534022 >> v1:172.21.15.172:6789/0 conn(0x7f3a8815dac0 legacy=0x7f3a880d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a8ca3b640 1 -- 172.21.15.172:0/842534022 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880d29e0 con 0x7f3a880d0ab0 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.370+0000 7f3a86ffd640 1 -- 172.21.15.172:0/842534022 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525128443 0 0) 0x7f3a880d2420 con 0x7f3a8815dac0 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.371+0000 7f3a8ca3b640 1 --2- 172.21.15.172:0/842534022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 0x7f3a88168670 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3a880d31b0 tx=0x7f3a8002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e89699184c1e04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.371+0000 7f3a86ffd640 1 -- 172.21.15.172:0/842534022 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80037070 con 0x7f3a880d0ab0 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.371+0000 7f3a86ffd640 1 -- 172.21.15.172:0/842534022 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a80007740 con 0x7f3a880d0ab0 2024-04-25T08:42:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.371+0000 7f3a86ffd640 1 -- 172.21.15.172:0/842534022 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80007b10 con 0x7f3a880d0ab0 2024-04-25T08:42:41.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.372+0000 7f3a8e49e640 1 -- 172.21.15.172:0/842534022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 msgr2=0x7f3a88168670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.372+0000 7f3a8e49e640 1 --2- 172.21.15.172:0/842534022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 0x7f3a88168670 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3a880d31b0 tx=0x7f3a8002a780 comp rx=0 tx=0).stop 2024-04-25T08:42:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.372+0000 7f3a8e49e640 1 -- 172.21.15.172:0/842534022 shutdown_connections 2024-04-25T08:42:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.372+0000 7f3a8e49e640 1 --2- 172.21.15.172:0/842534022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 0x7f3a88168670 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.372+0000 7f3a8e49e640 1 -- 172.21.15.172:0/842534022 >> 172.21.15.172:0/842534022 conn(0x7f3a88061c30 msgr2=0x7f3a8806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.372+0000 7f3a8e49e640 1 -- 172.21.15.172:0/842534022 shutdown_connections 2024-04-25T08:42:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.372+0000 7f3a8e49e640 1 -- 172.21.15.172:0/842534022 wait complete. 2024-04-25T08:42:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.373+0000 7f3a8e49e640 1 Processor -- start 2024-04-25T08:42:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.373+0000 7f3a8e49e640 1 -- start start 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a8e49e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 0x7f3a880cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a8e49e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a880d34c0 0x7f3a880cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a8e49e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a8815dac0 0x7f3a881531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a8e49e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8815dea0 con 0x7f3a880d0ab0 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a8e49e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880d2100 con 0x7f3a880d34c0 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a8e49e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880b97d0 con 0x7f3a8815dac0 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 0x7f3a880cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 0x7f3a880cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44014/0 (socket says 172.21.15.172:44014) 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a87fff640 1 -- 172.21.15.172:0/1283194490 learned_addr learned my addr 172.21.15.172:0/1283194490 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a877fe640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a880d34c0 0x7f3a880cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a8ca3b640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a8815dac0 0x7f3a881531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a87fff640 1 -- 172.21.15.172:0/1283194490 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a8815dac0 msgr2=0x7f3a881531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a87fff640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a8815dac0 0x7f3a881531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a87fff640 1 -- 172.21.15.172:0/1283194490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a880d34c0 msgr2=0x7f3a880cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a87fff640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a880d34c0 0x7f3a880cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a87fff640 1 -- 172.21.15.172:0/1283194490 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880b5730 con 0x7f3a880d0ab0 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a8ca3b640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a8815dac0 0x7f3a881531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a87fff640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 0x7f3a880cb370 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c3f0 tx=0x7f3a7800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a84ff9640 1 -- 172.21.15.172:0/1283194490 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780074e0 con 0x7f3a880d0ab0 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a84ff9640 1 -- 172.21.15.172:0/1283194490 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a780047e0 con 0x7f3a880d0ab0 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a8e49e640 1 -- 172.21.15.172:0/1283194490 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a880b5a10 con 0x7f3a880d0ab0 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a84ff9640 1 -- 172.21.15.172:0/1283194490 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78004c10 con 0x7f3a880d0ab0 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.374+0000 7f3a8e49e640 1 -- 172.21.15.172:0/1283194490 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a880b5fd0 con 0x7f3a880d0ab0 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.375+0000 7f3a8e49e640 1 -- 172.21.15.172:0/1283194490 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a88073a00 con 0x7f3a880d0ab0 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.376+0000 7f3a84ff9640 1 -- 172.21.15.172:0/1283194490 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3a78011070 con 0x7f3a880d0ab0 2024-04-25T08:42:41.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.376+0000 7f3a84ff9640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a7406b4d0 0x7f3a7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:41.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.377+0000 7f3a84ff9640 1 -- 172.21.15.172:0/1283194490 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3a7808a110 con 0x7f3a880d0ab0 2024-04-25T08:42:41.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.377+0000 7f3a877fe640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a7406b4d0 0x7f3a7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:41.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.377+0000 7f3a877fe640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a7406b4d0 0x7f3a7406d990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3a880b33a0 tx=0x7f3a7c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:41.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.381+0000 7f3a84ff9640 1 -- 172.21.15.172:0/1283194490 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a7801a2b0 con 0x7f3a880d0ab0 2024-04-25T08:42:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.563+0000 7f3a8e49e640 1 -- 172.21.15.172:0/1283194490 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3a8806c8e0 con 0x7f3a880d0ab0 2024-04-25T08:42:41.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.563+0000 7f3a84ff9640 1 -- 172.21.15.172:0/1283194490 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3a78058ce0 con 0x7f3a880d0ab0 2024-04-25T08:42:41.556 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:42:41.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 -- 172.21.15.172:0/1283194490 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a7406b4d0 msgr2=0x7f3a7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a7406b4d0 0x7f3a7406d990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3a880b33a0 tx=0x7f3a7c009040 comp rx=0 tx=0).stop 2024-04-25T08:42:41.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 -- 172.21.15.172:0/1283194490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 msgr2=0x7f3a880cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:41.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 0x7f3a880cb370 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c3f0 tx=0x7f3a7800c8b0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 -- 172.21.15.172:0/1283194490 shutdown_connections 2024-04-25T08:42:41.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a7406b4d0 0x7f3a7406d990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a880d34c0 0x7f3a880cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a8815dac0 0x7f3a881531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 --2- 172.21.15.172:0/1283194490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a880d0ab0 0x7f3a880cb370 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:41.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 -- 172.21.15.172:0/1283194490 >> 172.21.15.172:0/1283194490 conn(0x7f3a88061c30 msgr2=0x7f3a880c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:41.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 -- 172.21.15.172:0/1283194490 shutdown_connections 2024-04-25T08:42:41.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:41.565+0000 7f3a8e49e640 1 -- 172.21.15.172:0/1283194490 wait complete. 2024-04-25T08:42:41.569 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi172.front.sepia.ceph.com... 2024-04-25T08:42:41.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:41.569 DEBUG:teuthology.orchestra.run.smithi172:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T08:42:41.590 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi172.stderr:ceph-fuse[42031]: fuse finished with error 0 and tester_r 0 2024-04-25T08:42:41.592 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:42:47.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:42:47.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:47.695 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T08:42:47.728 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:47.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.877+0000 7f2f8c02a640 1 Processor -- start 2024-04-25T08:42:47.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.877+0000 7f2f8c02a640 1 -- start start 2024-04-25T08:42:47.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.878+0000 7f2f8c02a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2f8406ce10 0x7f2f840d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.878+0000 7f2f8c02a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8406c220 con 0x7f2f8409a450 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.878+0000 7f2f8c02a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f840d0080 con 0x7f2f8415dc70 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.878+0000 7f2f8c02a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f840d0c90 con 0x7f2f8406ce10 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.878+0000 7f2f8a5c7640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2f8409a450 0x7f2f840cbdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46134/0 (socket says 172.21.15.172:46134) 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.878+0000 7f2f8a5c7640 1 -- 172.21.15.172:0/298213016 learned_addr learned my addr 172.21.15.172:0/298213016 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f895c5640 1 --2- 172.21.15.172:0/298213016 >> v2:172.21.15.186:3300/0 conn(0x7f2f8406ce10 0x7f2f840d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355476907 0 0) 0x7f2f8406c220 con 0x7f2f8409a450 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f70003520 con 0x7f2f8409a450 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2343308410 0 0) 0x7f2f70003520 con 0x7f2f8409a450 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 >> v2:172.21.15.186:3300/0 conn(0x7f2f8406ce10 msgr2=0x7f2f840d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 --2- 172.21.15.172:0/298213016 >> v2:172.21.15.186:3300/0 conn(0x7f2f8406ce10 0x7f2f840d1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 >> v1:172.21.15.186:6789/0 conn(0x7f2f8415dc70 legacy=0x7f2f8406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:47.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f840d0360 con 0x7f2f8409a450 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f2f7c001670 con 0x7f2f8409a450 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 >> v1:172.21.15.172:6789/0 conn(0x7f2f8409a450 legacy=0x7f2f840cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f700039b0 0x7f2f70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f70004800 0x7f2f70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f700051c0 0x7f2f7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840d0c90 con 0x7f2f700051c0 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7000c060 con 0x7f2f70004800 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7000c260 con 0x7f2f700039b0 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f8a5c7640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f700051c0 0x7f2f7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f895c5640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f70004800 0x7f2f70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f89dc6640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f700039b0 0x7f2f70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f8a5c7640 1 -- 172.21.15.172:0/298213016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f700039b0 msgr2=0x7f2f70003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f8a5c7640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f700039b0 0x7f2f70003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f8a5c7640 1 -- 172.21.15.172:0/298213016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f70004800 msgr2=0x7f2f70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:47.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f8a5c7640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f70004800 0x7f2f70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f8a5c7640 1 -- 172.21.15.172:0/298213016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70003520 con 0x7f2f700051c0 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.879+0000 7f2f89dc6640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f700039b0 0x7f2f70003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.880+0000 7f2f8a5c7640 1 -- 172.21.15.172:0/298213016 reap_dead start 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.880+0000 7f2f8a5c7640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f700051c0 0x7f2f7000b9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c240 tx=0x7f2f70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640927b399f8033e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.880+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c007d10 con 0x7f2f700051c0 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.880+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c005ad0 con 0x7f2f700051c0 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.880+0000 7f2f88dc4640 1 -- 172.21.15.172:0/298213016 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c007070 con 0x7f2f700051c0 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.881+0000 7f2f8c02a640 1 -- 172.21.15.172:0/298213016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f700051c0 msgr2=0x7f2f7000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.881+0000 7f2f8c02a640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f700051c0 0x7f2f7000b9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c240 tx=0x7f2f70005830 comp rx=0 tx=0).stop 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.881+0000 7f2f8c02a640 1 -- 172.21.15.172:0/298213016 shutdown_connections 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.881+0000 7f2f8c02a640 1 --2- 172.21.15.172:0/298213016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f700051c0 0x7f2f7000b9c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.881+0000 7f2f8c02a640 1 -- 172.21.15.172:0/298213016 >> 172.21.15.172:0/298213016 conn(0x7f2f840b3270 msgr2=0x7f2f840b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.881+0000 7f2f8c02a640 1 -- 172.21.15.172:0/298213016 shutdown_connections 2024-04-25T08:42:47.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.881+0000 7f2f8c02a640 1 -- 172.21.15.172:0/298213016 wait complete. 2024-04-25T08:42:47.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.882+0000 7f2f8c02a640 1 Processor -- start 2024-04-25T08:42:47.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.882+0000 7f2f8c02a640 1 -- start start 2024-04-25T08:42:47.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f8c02a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f700051c0 0x7f2f8415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:47.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f8c02a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8415c650 0x7f2f840c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:47.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f8c02a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f840b60c0 0x7f2f840b6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f8c02a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415e050 con 0x7f2f8415c650 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f8c02a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840d0920 con 0x7f2f840b60c0 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f8c02a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840d1120 con 0x7f2f700051c0 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f895c5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8415c650 0x7f2f840c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f895c5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8415c650 0x7f2f840c71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50258/0 (socket says 172.21.15.172:50258) 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f895c5640 1 -- 172.21.15.172:0/3229387350 learned_addr learned my addr 172.21.15.172:0/3229387350 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f89dc6640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f700051c0 0x7f2f8415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f8a5c7640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f840b60c0 0x7f2f840b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f895c5640 1 -- 172.21.15.172:0/3229387350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f700051c0 msgr2=0x7f2f8415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f895c5640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f700051c0 0x7f2f8415ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f895c5640 1 -- 172.21.15.172:0/3229387350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f840b60c0 msgr2=0x7f2f840b6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f895c5640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f840b60c0 0x7f2f840b6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f895c5640 1 -- 172.21.15.172:0/3229387350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8415cad0 con 0x7f2f8415c650 2024-04-25T08:42:47.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f8a5c7640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f840b60c0 0x7f2f840b6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f895c5640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8415c650 0x7f2f840c71e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f740118e0 tx=0x7f2f74011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f7a7fc640 1 -- 172.21.15.172:0/3229387350 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400faf0 con 0x7f2f8415c650 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f7a7fc640 1 -- 172.21.15.172:0/3229387350 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7400fc90 con 0x7f2f8415c650 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f8c02a640 1 -- 172.21.15.172:0/3229387350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8415f2e0 con 0x7f2f8415c650 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f7a7fc640 1 -- 172.21.15.172:0/3229387350 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74014440 con 0x7f2f8415c650 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.883+0000 7f2f8c02a640 1 -- 172.21.15.172:0/3229387350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8415f8a0 con 0x7f2f8415c650 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.884+0000 7f2f8c02a640 1 -- 172.21.15.172:0/3229387350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f84073990 con 0x7f2f8415c650 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.885+0000 7f2f7a7fc640 1 -- 172.21.15.172:0/3229387350 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f74012040 con 0x7f2f8415c650 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.885+0000 7f2f7a7fc640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f6806b500 0x7f2f6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.885+0000 7f2f7a7fc640 1 -- 172.21.15.172:0/3229387350 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2f7408ab40 con 0x7f2f8415c650 2024-04-25T08:42:47.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.885+0000 7f2f89dc6640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f6806b500 0x7f2f6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:47.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.886+0000 7f2f89dc6640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f6806b500 0x7f2f6806d9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f80000f80 tx=0x7f2f80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:47.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:47.890+0000 7f2f7a7fc640 1 -- 172.21.15.172:0/3229387350 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f74019030 con 0x7f2f8415c650 2024-04-25T08:42:48.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.061+0000 7f2f8c02a640 1 -- 172.21.15.172:0/3229387350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f840b40a0 con 0x7f2f8415c650 2024-04-25T08:42:48.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.062+0000 7f2f7a7fc640 1 -- 172.21.15.172:0/3229387350 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f2f74059710 con 0x7f2f8415c650 2024-04-25T08:42:48.055 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:48.055 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.064+0000 7f2f8c02a640 1 -- 172.21.15.172:0/3229387350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f6806b500 msgr2=0x7f2f6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.064+0000 7f2f8c02a640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f6806b500 0x7f2f6806d9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f80000f80 tx=0x7f2f80009040 comp rx=0 tx=0).stop 2024-04-25T08:42:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.064+0000 7f2f8c02a640 1 -- 172.21.15.172:0/3229387350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8415c650 msgr2=0x7f2f840c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.064+0000 7f2f8c02a640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8415c650 0x7f2f840c71e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f740118e0 tx=0x7f2f74011da0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.064+0000 7f2f8c02a640 1 -- 172.21.15.172:0/3229387350 shutdown_connections 2024-04-25T08:42:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.064+0000 7f2f8c02a640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f6806b500 0x7f2f6806d9c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.064+0000 7f2f8c02a640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f840b60c0 0x7f2f840b6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.064+0000 7f2f8c02a640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8415c650 0x7f2f840c71e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.064+0000 7f2f8c02a640 1 --2- 172.21.15.172:0/3229387350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f700051c0 0x7f2f8415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.064+0000 7f2f8c02a640 1 -- 172.21.15.172:0/3229387350 >> 172.21.15.172:0/3229387350 conn(0x7f2f840b3270 msgr2=0x7f2f840cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:48.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.065+0000 7f2f8c02a640 1 -- 172.21.15.172:0/3229387350 shutdown_connections 2024-04-25T08:42:48.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.065+0000 7f2f8c02a640 1 -- 172.21.15.172:0/3229387350 wait complete. 2024-04-25T08:42:48.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:48.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.172+0000 7fce90c4d640 1 Processor -- start 2024-04-25T08:42:48.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.172+0000 7fce90c4d640 1 -- start start 2024-04-25T08:42:48.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.173+0000 7fce90c4d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce8c15dbe0 0x7fce8c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.173+0000 7fce90c4d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fce8c0b92a0 0x7fce8c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.173+0000 7fce90c4d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8c0b97a0 con 0x7fce8c0b2cb0 2024-04-25T08:42:48.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.173+0000 7fce90c4d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8c15dfc0 con 0x7fce8c15dbe0 2024-04-25T08:42:48.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.173+0000 7fce90c4d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8c0d1a00 con 0x7fce8c0b92a0 2024-04-25T08:42:48.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.173+0000 7fce8a59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce8c15dbe0 0x7fce8c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.173+0000 7fce8a59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce8c15dbe0 0x7fce8c0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50266/0 (socket says 172.21.15.172:50266) 2024-04-25T08:42:48.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.173+0000 7fce8a59c640 1 -- 172.21.15.172:0/169490264 learned_addr learned my addr 172.21.15.172:0/169490264 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:48.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.174+0000 7fce8ad9d640 1 --2- 172.21.15.172:0/169490264 >> v2:172.21.15.186:3300/0 conn(0x7fce8c0b92a0 0x7fce8c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.174+0000 7fce8a59c640 1 -- 172.21.15.172:0/169490264 >> v2:172.21.15.186:3300/0 conn(0x7fce8c0b92a0 msgr2=0x7fce8c0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:48.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.174+0000 7fce8a59c640 1 --2- 172.21.15.172:0/169490264 >> v2:172.21.15.186:3300/0 conn(0x7fce8c0b92a0 0x7fce8c0d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.174+0000 7fce8a59c640 1 -- 172.21.15.172:0/169490264 >> v1:172.21.15.186:6789/0 conn(0x7fce8c0b2cb0 legacy=0x7fce8c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.174+0000 7fce8a59c640 1 -- 172.21.15.172:0/169490264 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c0d1c50 con 0x7fce8c15dbe0 2024-04-25T08:42:48.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.174+0000 7fce8a59c640 1 --2- 172.21.15.172:0/169490264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c15dbe0 0x7fce8c0d0910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0cfb90 tx=0x7fce7c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801c14db66cd2c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:48.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce8959a640 1 -- 172.21.15.172:0/169490264 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c036070 con 0x7fce8c15dbe0 2024-04-25T08:42:48.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce8959a640 1 -- 172.21.15.172:0/169490264 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c031600 con 0x7fce8c15dbe0 2024-04-25T08:42:48.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce8959a640 1 -- 172.21.15.172:0/169490264 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0319d0 con 0x7fce8c15dbe0 2024-04-25T08:42:48.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce90c4d640 1 -- 172.21.15.172:0/169490264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c15dbe0 msgr2=0x7fce8c0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce90c4d640 1 --2- 172.21.15.172:0/169490264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c15dbe0 0x7fce8c0d0910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0cfb90 tx=0x7fce7c02a6a0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce90c4d640 1 -- 172.21.15.172:0/169490264 shutdown_connections 2024-04-25T08:42:48.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce90c4d640 1 --2- 172.21.15.172:0/169490264 >> v2:172.21.15.186:3300/0 conn(0x7fce8c0b92a0 0x7fce8c0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce90c4d640 1 --2- 172.21.15.172:0/169490264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c15dbe0 0x7fce8c0d0910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce90c4d640 1 -- 172.21.15.172:0/169490264 >> 172.21.15.172:0/169490264 conn(0x7fce8c061a20 msgr2=0x7fce8c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:48.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce90c4d640 1 -- 172.21.15.172:0/169490264 shutdown_connections 2024-04-25T08:42:48.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.175+0000 7fce90c4d640 1 -- 172.21.15.172:0/169490264 wait complete. 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce90c4d640 1 Processor -- start 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce90c4d640 1 -- start start 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce90c4d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce8c0b2cb0 0x7fce8c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce90c4d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c0b92a0 0x7fce8c0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce90c4d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce8c15dbe0 0x7fce8c15f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce90c4d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0b6ab0 con 0x7fce8c0b92a0 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce90c4d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0d2210 con 0x7fce8c0b2cb0 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce90c4d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0b6c30 con 0x7fce8c15dbe0 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce89d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c0b92a0 0x7fce8c0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce89d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c0b92a0 0x7fce8c0c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50280/0 (socket says 172.21.15.172:50280) 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.177+0000 7fce89d9b640 1 -- 172.21.15.172:0/2110091710 learned_addr learned my addr 172.21.15.172:0/2110091710 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce8a59c640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce8c0b2cb0 0x7fce8c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce8ad9d640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce8c15dbe0 0x7fce8c15f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce89d9b640 1 -- 172.21.15.172:0/2110091710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce8c15dbe0 msgr2=0x7fce8c15f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce89d9b640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce8c15dbe0 0x7fce8c15f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce89d9b640 1 -- 172.21.15.172:0/2110091710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce8c0b2cb0 msgr2=0x7fce8c0cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce89d9b640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce8c0b2cb0 0x7fce8c0cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce89d9b640 1 -- 172.21.15.172:0/2110091710 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c0b57c0 con 0x7fce8c0b92a0 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce8ad9d640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce8c15dbe0 0x7fce8c15f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce89d9b640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c0b92a0 0x7fce8c0c95d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fce8000c440 tx=0x7fce80001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce7affd640 1 -- 172.21.15.172:0/2110091710 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce800052d0 con 0x7fce8c0b92a0 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce7affd640 1 -- 172.21.15.172:0/2110091710 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80005470 con 0x7fce8c0b92a0 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce90c4d640 1 -- 172.21.15.172:0/2110091710 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c0cac60 con 0x7fce8c0b92a0 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce7affd640 1 -- 172.21.15.172:0/2110091710 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80007260 con 0x7fce8c0b92a0 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.178+0000 7fce90c4d640 1 -- 172.21.15.172:0/2110091710 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c15fba0 con 0x7fce8c0b92a0 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.179+0000 7fce90c4d640 1 -- 172.21.15.172:0/2110091710 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8c073990 con 0x7fce8c0b92a0 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.179+0000 7fce7affd640 1 -- 172.21.15.172:0/2110091710 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce80007400 con 0x7fce8c0b92a0 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.180+0000 7fce7affd640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6c06b4d0 0x7fce6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.180+0000 7fce8a59c640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6c06b4d0 0x7fce6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.180+0000 7fce7affd640 1 -- 172.21.15.172:0/2110091710 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fce800899f0 con 0x7fce8c0b92a0 2024-04-25T08:42:48.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.180+0000 7fce8a59c640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6c06b4d0 0x7fce6c06d990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fce7c033000 tx=0x7fce7c009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:48.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.184+0000 7fce7affd640 1 -- 172.21.15.172:0/2110091710 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce800585c0 con 0x7fce8c0b92a0 2024-04-25T08:42:48.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.357+0000 7fce90c4d640 1 -- 172.21.15.172:0/2110091710 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce8c0b65a0 con 0x7fce8c0b92a0 2024-04-25T08:42:48.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.358+0000 7fce7affd640 1 -- 172.21.15.172:0/2110091710 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7fce80057ec0 con 0x7fce8c0b92a0 2024-04-25T08:42:48.351 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:48.351 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 -- 172.21.15.172:0/2110091710 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6c06b4d0 msgr2=0x7fce6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6c06b4d0 0x7fce6c06d990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fce7c033000 tx=0x7fce7c009000 comp rx=0 tx=0).stop 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 -- 172.21.15.172:0/2110091710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c0b92a0 msgr2=0x7fce8c0c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c0b92a0 0x7fce8c0c95d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fce8000c440 tx=0x7fce80001e70 comp rx=0 tx=0).stop 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 -- 172.21.15.172:0/2110091710 shutdown_connections 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6c06b4d0 0x7fce6c06d990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce8c15dbe0 0x7fce8c15f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c0b92a0 0x7fce8c0c95d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 --2- 172.21.15.172:0/2110091710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce8c0b2cb0 0x7fce8c0cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 -- 172.21.15.172:0/2110091710 >> 172.21.15.172:0/2110091710 conn(0x7fce8c061a20 msgr2=0x7fce8c15b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:48.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 -- 172.21.15.172:0/2110091710 shutdown_connections 2024-04-25T08:42:48.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.360+0000 7fce90c4d640 1 -- 172.21.15.172:0/2110091710 wait complete. 2024-04-25T08:42:48.364 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:42:48.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.471+0000 7f9811e5d640 1 Processor -- start 2024-04-25T08:42:48.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.471+0000 7f9811e5d640 1 -- start start 2024-04-25T08:42:48.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f9811e5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f980c15dac0 0x7f980c0d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f9811e5d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f980c0d1f30 0x7f980c0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f9811e5d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c0d2420 con 0x7f980c0d34c0 2024-04-25T08:42:48.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f9811e5d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0d3030 con 0x7f980c0d1f30 2024-04-25T08:42:48.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f9811e5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0d2700 con 0x7f980c15dac0 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f980affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f980c0d1f30 0x7f980c0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f980bfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f980c0d34c0 0x7f980c0b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46148/0 (socket says 172.21.15.172:46148) 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f980bfff640 1 -- 172.21.15.172:0/1941029274 learned_addr learned my addr 172.21.15.172:0/1941029274 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f980b7fe640 1 --2- 172.21.15.172:0/1941029274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f980c15dac0 0x7f980c0d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f980affd640 1 -- 172.21.15.172:0/1941029274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f980c15dac0 msgr2=0x7f980c0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f980affd640 1 --2- 172.21.15.172:0/1941029274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f980c15dac0 0x7f980c0d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f980affd640 1 -- 172.21.15.172:0/1941029274 >> v1:172.21.15.172:6789/0 conn(0x7f980c0d34c0 legacy=0x7f980c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.472+0000 7f980affd640 1 -- 172.21.15.172:0/1941029274 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0d29e0 con 0x7f980c0d1f30 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.473+0000 7f980affd640 1 --2- 172.21.15.172:0/1941029274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d1f30 0x7f980c0d03a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009790 tx=0x7f97fc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fde6767c534e0e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.473+0000 7f980a7fc640 1 -- 172.21.15.172:0/1941029274 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc037070 con 0x7f980c0d1f30 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.473+0000 7f980a7fc640 1 -- 172.21.15.172:0/1941029274 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc032440 con 0x7f980c0d1f30 2024-04-25T08:42:48.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.473+0000 7f980a7fc640 1 -- 172.21.15.172:0/1941029274 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc032810 con 0x7f980c0d1f30 2024-04-25T08:42:48.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.474+0000 7f9811e5d640 1 -- 172.21.15.172:0/1941029274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d1f30 msgr2=0x7f980c0d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.474+0000 7f9811e5d640 1 --2- 172.21.15.172:0/1941029274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d1f30 0x7f980c0d03a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009790 tx=0x7f97fc02a210 comp rx=0 tx=0).stop 2024-04-25T08:42:48.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.474+0000 7f9811e5d640 1 -- 172.21.15.172:0/1941029274 shutdown_connections 2024-04-25T08:42:48.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.474+0000 7f9811e5d640 1 --2- 172.21.15.172:0/1941029274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d1f30 0x7f980c0d03a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.474+0000 7f9811e5d640 1 --2- 172.21.15.172:0/1941029274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f980c15dac0 0x7f980c0d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.474+0000 7f9811e5d640 1 -- 172.21.15.172:0/1941029274 >> 172.21.15.172:0/1941029274 conn(0x7f980c061c30 msgr2=0x7f980c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:48.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.474+0000 7f9811e5d640 1 -- 172.21.15.172:0/1941029274 shutdown_connections 2024-04-25T08:42:48.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.474+0000 7f9811e5d640 1 -- 172.21.15.172:0/1941029274 wait complete. 2024-04-25T08:42:48.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.475+0000 7f9811e5d640 1 Processor -- start 2024-04-25T08:42:48.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.475+0000 7f9811e5d640 1 -- start start 2024-04-25T08:42:48.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f9811e5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f980c0d1f30 0x7f980c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f9811e5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d34c0 0x7f980c15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f9811e5d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f980c15dac0 0x7f980c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f9811e5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0b97d0 con 0x7f980c0d34c0 2024-04-25T08:42:48.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f9811e5d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c15dea0 con 0x7f980c15dac0 2024-04-25T08:42:48.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f9811e5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0b9950 con 0x7f980c0d1f30 2024-04-25T08:42:48.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d34c0 0x7f980c15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d34c0 0x7f980c15eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50302/0 (socket says 172.21.15.172:50302) 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980affd640 1 -- 172.21.15.172:0/4251145725 learned_addr learned my addr 172.21.15.172:0/4251145725 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980bfff640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f980c15dac0 0x7f980c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980b7fe640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f980c0d1f30 0x7f980c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980affd640 1 -- 172.21.15.172:0/4251145725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f980c0d1f30 msgr2=0x7f980c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980affd640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f980c0d1f30 0x7f980c151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980affd640 1 -- 172.21.15.172:0/4251145725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f980c15dac0 msgr2=0x7f980c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980affd640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f980c15dac0 0x7f980c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980affd640 1 -- 172.21.15.172:0/4251145725 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c1e8ee0 con 0x7f980c0d34c0 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.476+0000 7f980affd640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d34c0 0x7f980c15eb60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f97fc035040 tx=0x7f97fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.477+0000 7f9803fff640 1 -- 172.21.15.172:0/4251145725 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc037040 con 0x7f980c0d34c0 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.477+0000 7f9803fff640 1 -- 172.21.15.172:0/4251145725 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc005bd0 con 0x7f980c0d34c0 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.477+0000 7f9811e5d640 1 -- 172.21.15.172:0/4251145725 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c1e91c0 con 0x7f980c0d34c0 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.477+0000 7f9803fff640 1 -- 172.21.15.172:0/4251145725 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc030770 con 0x7f980c0d34c0 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.477+0000 7f9811e5d640 1 -- 172.21.15.172:0/4251145725 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c1e9780 con 0x7f980c0d34c0 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.478+0000 7f9811e5d640 1 -- 172.21.15.172:0/4251145725 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c1e9980 con 0x7f980c0d34c0 2024-04-25T08:42:48.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.478+0000 7f9803fff640 1 -- 172.21.15.172:0/4251145725 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f97fc030910 con 0x7f980c0d34c0 2024-04-25T08:42:48.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.478+0000 7f9803fff640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f97ec06b4d0 0x7f97ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.478+0000 7f9803fff640 1 -- 172.21.15.172:0/4251145725 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f97fc0aaf90 con 0x7f980c0d34c0 2024-04-25T08:42:48.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.479+0000 7f980b7fe640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f97ec06b4d0 0x7f97ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.479+0000 7f980b7fe640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f97ec06b4d0 0x7f97ec06d990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f97f4006fd0 tx=0x7f97f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:48.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.483+0000 7f9803fff640 1 -- 172.21.15.172:0/4251145725 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f980c1e9980 con 0x7f980c0d34c0 2024-04-25T08:42:48.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.692+0000 7f9811e5d640 1 -- 172.21.15.172:0/4251145725 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f980c073a00 con 0x7f980c0d34c0 2024-04-25T08:42:48.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.752+0000 7f9803fff640 1 -- 172.21.15.172:0/4251145725 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f97fc032e20 con 0x7f980c0d34c0 2024-04-25T08:42:48.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 -- 172.21.15.172:0/4251145725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f97ec06b4d0 msgr2=0x7f97ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f97ec06b4d0 0x7f97ec06d990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f97f4006fd0 tx=0x7f97f4008040 comp rx=0 tx=0).stop 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 -- 172.21.15.172:0/4251145725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d34c0 msgr2=0x7f980c15eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d34c0 0x7f980c15eb60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f97fc035040 tx=0x7f97fc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 -- 172.21.15.172:0/4251145725 shutdown_connections 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f97ec06b4d0 0x7f97ec06d990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f980c15dac0 0x7f980c15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f980c0d34c0 0x7f980c15eb60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 --2- 172.21.15.172:0/4251145725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f980c0d1f30 0x7f980c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 -- 172.21.15.172:0/4251145725 >> 172.21.15.172:0/4251145725 conn(0x7f980c061c30 msgr2=0x7f980c0d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 -- 172.21.15.172:0/4251145725 shutdown_connections 2024-04-25T08:42:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.754+0000 7f9811e5d640 1 -- 172.21.15.172:0/4251145725 wait complete. 2024-04-25T08:42:48.758 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-25T08:42:48.758 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:42:48.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.866+0000 7fb54c5f5640 1 Processor -- start 2024-04-25T08:42:48.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.866+0000 7fb54c5f5640 1 -- start start 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.867+0000 7fb54c5f5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb544166a10 0x7fb544168e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.867+0000 7fb54c5f5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5440afc80 con 0x7fb54415de80 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.867+0000 7fb54c5f5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5440ce4d0 con 0x7fb5440cadb0 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.867+0000 7fb54c5f5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5440cb240 con 0x7fb544166a10 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54a391640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb54415de80 0x7fb5440cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46152/0 (socket says 172.21.15.172:46152) 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54a391640 1 -- 172.21.15.172:0/141167163 learned_addr learned my addr 172.21.15.172:0/141167163 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630885477 0 0) 0x7fb5440afc80 con 0x7fb54415de80 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54ab92640 1 --2- 172.21.15.172:0/141167163 >> v2:172.21.15.186:3300/0 conn(0x7fb544166a10 0x7fb544168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb530003520 con 0x7fb54415de80 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 441243234 0 0) 0x7fb530003520 con 0x7fb54415de80 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 >> v2:172.21.15.186:3300/0 conn(0x7fb544166a10 msgr2=0x7fb544168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 --2- 172.21.15.172:0/141167163 >> v2:172.21.15.186:3300/0 conn(0x7fb544166a10 0x7fb544168e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 >> v1:172.21.15.186:6789/0 conn(0x7fb5440cadb0 legacy=0x7fb5440cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440ce7b0 con 0x7fb54415de80 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fb534001670 con 0x7fb54415de80 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 >> v1:172.21.15.172:6789/0 conn(0x7fb54415de80 legacy=0x7fb5440cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb530003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb530004800 0x7fb530004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5300051c0 0x7fb53000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53000c130 con 0x7fb5300039b0 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53000c2e0 con 0x7fb5300051c0 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53000c4e0 con 0x7fb530004800 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54a391640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb530003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb549b90640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb530004800 0x7fb530004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.868+0000 7fb54ab92640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5300051c0 0x7fb53000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54a391640 1 -- 172.21.15.172:0/141167163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb530004800 msgr2=0x7fb530004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54a391640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb530004800 0x7fb530004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54a391640 1 -- 172.21.15.172:0/141167163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5300051c0 msgr2=0x7fb53000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54a391640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5300051c0 0x7fb53000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54a391640 1 -- 172.21.15.172:0/141167163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb530003520 con 0x7fb5300039b0 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54ab92640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5300051c0 0x7fb53000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54ab92640 1 -- 172.21.15.172:0/141167163 reap_dead start 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54a391640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb530003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb53400c240 tx=0x7fb530005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d201e551b07704 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534007cf0 con 0x7fb5300039b0 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534005af0 con 0x7fb5300039b0 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.869+0000 7fb54938f640 1 -- 172.21.15.172:0/141167163 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534007070 con 0x7fb5300039b0 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.870+0000 7fb54c5f5640 1 -- 172.21.15.172:0/141167163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 msgr2=0x7fb530003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.870+0000 7fb54c5f5640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb530003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb53400c240 tx=0x7fb530005830 comp rx=0 tx=0).stop 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.870+0000 7fb54c5f5640 1 -- 172.21.15.172:0/141167163 shutdown_connections 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.870+0000 7fb54c5f5640 1 --2- 172.21.15.172:0/141167163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb530003dd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.870+0000 7fb54c5f5640 1 -- 172.21.15.172:0/141167163 >> 172.21.15.172:0/141167163 conn(0x7fb5440b2390 msgr2=0x7fb5440b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.870+0000 7fb54c5f5640 1 -- 172.21.15.172:0/141167163 shutdown_connections 2024-04-25T08:42:48.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.870+0000 7fb54c5f5640 1 -- 172.21.15.172:0/141167163 wait complete. 2024-04-25T08:42:48.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.871+0000 7fb54c5f5640 1 Processor -- start 2024-04-25T08:42:48.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.871+0000 7fb54c5f5640 1 -- start start 2024-04-25T08:42:48.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54c5f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb54414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54c5f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5440c9c70 0x7fb544155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54c5f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb544155570 0x7fb5441560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54c5f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5440b2eb0 con 0x7fb5300039b0 2024-04-25T08:42:48.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54c5f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54415e260 con 0x7fb544155570 2024-04-25T08:42:48.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54c5f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5440b3030 con 0x7fb5440c9c70 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54a391640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb54414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54a391640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb54414ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50322/0 (socket says 172.21.15.172:50322) 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54a391640 1 -- 172.21.15.172:0/4088695411 learned_addr learned my addr 172.21.15.172:0/4088695411 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54a391640 1 -- 172.21.15.172:0/4088695411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5440c9c70 msgr2=0x7fb544155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54a391640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5440c9c70 0x7fb544155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54a391640 1 -- 172.21.15.172:0/4088695411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb544155570 msgr2=0x7fb5441560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54a391640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb544155570 0x7fb5441560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54a391640 1 -- 172.21.15.172:0/4088695411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544156e10 con 0x7fb5300039b0 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.872+0000 7fb54a391640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb54414ac30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb53400c360 tx=0x7fb5440ce6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.873+0000 7fb53affd640 1 -- 172.21.15.172:0/4088695411 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534037040 con 0x7fb5300039b0 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.873+0000 7fb53affd640 1 -- 172.21.15.172:0/4088695411 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534041070 con 0x7fb5300039b0 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.873+0000 7fb54c5f5640 1 -- 172.21.15.172:0/4088695411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5440c8eb0 con 0x7fb5300039b0 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.873+0000 7fb53affd640 1 -- 172.21.15.172:0/4088695411 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534001670 con 0x7fb5300039b0 2024-04-25T08:42:48.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.873+0000 7fb54c5f5640 1 -- 172.21.15.172:0/4088695411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5440c9470 con 0x7fb5300039b0 2024-04-25T08:42:48.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.873+0000 7fb54c5f5640 1 -- 172.21.15.172:0/4088695411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb544155990 con 0x7fb5300039b0 2024-04-25T08:42:48.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.874+0000 7fb53affd640 1 -- 172.21.15.172:0/4088695411 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb5340049e0 con 0x7fb5300039b0 2024-04-25T08:42:48.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.874+0000 7fb53affd640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb52806b500 0x7fb52806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:48.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.874+0000 7fb53affd640 1 -- 172.21.15.172:0/4088695411 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb5340aa250 con 0x7fb5300039b0 2024-04-25T08:42:48.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.874+0000 7fb549b90640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb52806b500 0x7fb52806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:48.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.875+0000 7fb549b90640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb52806b500 0x7fb52806d9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb540000c00 tx=0x7fb540009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:48.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:48.878+0000 7fb53affd640 1 -- 172.21.15.172:0/4088695411 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb534078d90 con 0x7fb5300039b0 2024-04-25T08:42:49.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.089+0000 7fb54c5f5640 1 -- 172.21.15.172:0/4088695411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb544073a00 con 0x7fb5300039b0 2024-04-25T08:42:49.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.755+0000 7fb53affd640 1 -- 172.21.15.172:0/4088695411 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb534078690 con 0x7fb5300039b0 2024-04-25T08:42:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 -- 172.21.15.172:0/4088695411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb52806b500 msgr2=0x7fb52806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb52806b500 0x7fb52806d9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb540000c00 tx=0x7fb540009040 comp rx=0 tx=0).stop 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 -- 172.21.15.172:0/4088695411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 msgr2=0x7fb54414ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb54414ac30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb53400c360 tx=0x7fb5440ce6a0 comp rx=0 tx=0).stop 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 -- 172.21.15.172:0/4088695411 shutdown_connections 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb52806b500 0x7fb52806d9c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb544155570 0x7fb5441560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5440c9c70 0x7fb544155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 --2- 172.21.15.172:0/4088695411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5300039b0 0x7fb54414ac30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 -- 172.21.15.172:0/4088695411 >> 172.21.15.172:0/4088695411 conn(0x7fb5440b2390 msgr2=0x7fb5440b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 -- 172.21.15.172:0/4088695411 shutdown_connections 2024-04-25T08:42:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.758+0000 7fb54c5f5640 1 -- 172.21.15.172:0/4088695411 wait complete. 2024-04-25T08:42:49.762 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:42:49.762 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:42:49.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.868+0000 7fd30a09a640 1 Processor -- start 2024-04-25T08:42:49.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.868+0000 7fd30a09a640 1 -- start start 2024-04-25T08:42:49.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd30a09a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd30415db70 0x7fd304162150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:49.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd30a09a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3040b5c30 0x7fd3040d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:49.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd30a09a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd304162690 con 0x7fd3040b6cb0 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd30a09a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3040ceee0 con 0x7fd3040b5c30 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd30a09a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040d1d10 con 0x7fd30415db70 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd303fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3040b5c30 0x7fd3040d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd303fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3040b5c30 0x7fd3040d27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50336/0 (socket says 172.21.15.172:50336) 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd303fff640 1 -- 172.21.15.172:0/2879821423 learned_addr learned my addr 172.21.15.172:0/2879821423 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd3037fe640 1 --2- 172.21.15.172:0/2879821423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd30415db70 0x7fd304162150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd303fff640 1 -- 172.21.15.172:0/2879821423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd30415db70 msgr2=0x7fd304162150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd303fff640 1 --2- 172.21.15.172:0/2879821423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd30415db70 0x7fd304162150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd303fff640 1 -- 172.21.15.172:0/2879821423 >> v1:172.21.15.186:6789/0 conn(0x7fd3040b6cb0 legacy=0x7fd3040b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.869+0000 7fd303fff640 1 -- 172.21.15.172:0/2879821423 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3040d1ff0 con 0x7fd3040b5c30 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.870+0000 7fd303fff640 1 --2- 172.21.15.172:0/2879821423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 0x7fd3040d27f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009e50 tx=0x7fd2fc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c928f0301c02cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.870+0000 7fd3027fc640 1 -- 172.21.15.172:0/2879821423 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc036070 con 0x7fd3040b5c30 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.870+0000 7fd3027fc640 1 -- 172.21.15.172:0/2879821423 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc031600 con 0x7fd3040b5c30 2024-04-25T08:42:49.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.870+0000 7fd3027fc640 1 -- 172.21.15.172:0/2879821423 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0319d0 con 0x7fd3040b5c30 2024-04-25T08:42:49.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.871+0000 7fd30a09a640 1 -- 172.21.15.172:0/2879821423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 msgr2=0x7fd3040d27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:49.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.871+0000 7fd30a09a640 1 --2- 172.21.15.172:0/2879821423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 0x7fd3040d27f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009e50 tx=0x7fd2fc02a680 comp rx=0 tx=0).stop 2024-04-25T08:42:49.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.871+0000 7fd30a09a640 1 -- 172.21.15.172:0/2879821423 shutdown_connections 2024-04-25T08:42:49.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.871+0000 7fd30a09a640 1 --2- 172.21.15.172:0/2879821423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 0x7fd3040d27f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:49.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.871+0000 7fd30a09a640 1 --2- 172.21.15.172:0/2879821423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd30415db70 0x7fd304162150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:49.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.871+0000 7fd30a09a640 1 -- 172.21.15.172:0/2879821423 >> 172.21.15.172:0/2879821423 conn(0x7fd3040d0520 msgr2=0x7fd3040d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:49.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.871+0000 7fd30a09a640 1 -- 172.21.15.172:0/2879821423 shutdown_connections 2024-04-25T08:42:49.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.871+0000 7fd30a09a640 1 -- 172.21.15.172:0/2879821423 wait complete. 2024-04-25T08:42:49.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.872+0000 7fd30a09a640 1 Processor -- start 2024-04-25T08:42:49.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.872+0000 7fd30a09a640 1 -- start start 2024-04-25T08:42:49.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd30a09a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 0x7fd304154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:49.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd30a09a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3040b6cb0 0x7fd3040c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:49.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd30a09a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd30415db70 0x7fd3040c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:49.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd30a09a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040ce530 con 0x7fd3040b5c30 2024-04-25T08:42:49.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd30a09a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30415df50 con 0x7fd3040b6cb0 2024-04-25T08:42:49.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd30a09a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3040cf1c0 con 0x7fd30415db70 2024-04-25T08:42:49.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd3037fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 0x7fd304154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:49.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd3037fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 0x7fd304154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50340/0 (socket says 172.21.15.172:50340) 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd3037fe640 1 -- 172.21.15.172:0/4082015995 learned_addr learned my addr 172.21.15.172:0/4082015995 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd302ffd640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3040b6cb0 0x7fd3040c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd303fff640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd30415db70 0x7fd3040c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd3037fe640 1 -- 172.21.15.172:0/4082015995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd30415db70 msgr2=0x7fd3040c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd3037fe640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd30415db70 0x7fd3040c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd3037fe640 1 -- 172.21.15.172:0/4082015995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3040b6cb0 msgr2=0x7fd3040c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd3037fe640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3040b6cb0 0x7fd3040c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd3037fe640 1 -- 172.21.15.172:0/4082015995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3041552d0 con 0x7fd3040b5c30 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd302ffd640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3040b6cb0 0x7fd3040c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd3037fe640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 0x7fd304154c40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400d5f0 tx=0x7fd2f400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd2ebfff640 1 -- 172.21.15.172:0/4082015995 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40125f0 con 0x7fd3040b5c30 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd2ebfff640 1 -- 172.21.15.172:0/4082015995 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4019070 con 0x7fd3040b5c30 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd30a09a640 1 -- 172.21.15.172:0/4082015995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3041555b0 con 0x7fd3040b5c30 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.873+0000 7fd2ebfff640 1 -- 172.21.15.172:0/4082015995 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40129d0 con 0x7fd3040b5c30 2024-04-25T08:42:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.874+0000 7fd30a09a640 1 -- 172.21.15.172:0/4082015995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd304155b70 con 0x7fd3040b5c30 2024-04-25T08:42:49.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.874+0000 7fd30a09a640 1 -- 172.21.15.172:0/4082015995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd304073990 con 0x7fd3040b5c30 2024-04-25T08:42:49.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.875+0000 7fd2ebfff640 1 -- 172.21.15.172:0/4082015995 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2f4012b70 con 0x7fd3040b5c30 2024-04-25T08:42:49.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.875+0000 7fd2ebfff640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2f006b4d0 0x7fd2f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:49.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.875+0000 7fd2ebfff640 1 -- 172.21.15.172:0/4082015995 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd2f408a960 con 0x7fd3040b5c30 2024-04-25T08:42:49.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.875+0000 7fd302ffd640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2f006b4d0 0x7fd2f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:49.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.876+0000 7fd302ffd640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2f006b4d0 0x7fd2f006d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd304159570 tx=0x7fd2f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:49.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:49.879+0000 7fd2ebfff640 1 -- 172.21.15.172:0/4082015995 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2f40594a0 con 0x7fd3040b5c30 2024-04-25T08:42:50.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.086+0000 7fd30a09a640 1 -- 172.21.15.172:0/4082015995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3040d1820 con 0x7fd3040b5c30 2024-04-25T08:42:50.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.086+0000 7fd2ebfff640 1 -- 172.21.15.172:0/4082015995 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4943 (secure 0 0 0) 0x7fd2f4058da0 con 0x7fd3040b5c30 2024-04-25T08:42:50.079 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:50.079 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:42:28.003161+0000","modified":"2024-04-25T08:42:49.090813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:42:50.079 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2024-04-25T08:42:50.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 -- 172.21.15.172:0/4082015995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2f006b4d0 msgr2=0x7fd2f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2f006b4d0 0x7fd2f006d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd304159570 tx=0x7fd2f8009040 comp rx=0 tx=0).stop 2024-04-25T08:42:50.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 -- 172.21.15.172:0/4082015995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 msgr2=0x7fd304154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 0x7fd304154c40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400d5f0 tx=0x7fd2f400dab0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 -- 172.21.15.172:0/4082015995 shutdown_connections 2024-04-25T08:42:50.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2f006b4d0 0x7fd2f006d990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3040b6cb0 0x7fd3040c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd30415db70 0x7fd3040c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 --2- 172.21.15.172:0/4082015995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040b5c30 0x7fd304154c40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 -- 172.21.15.172:0/4082015995 >> 172.21.15.172:0/4082015995 conn(0x7fd3040d0520 msgr2=0x7fd30415c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:50.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 -- 172.21.15.172:0/4082015995 shutdown_connections 2024-04-25T08:42:50.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.088+0000 7fd30a09a640 1 -- 172.21.15.172:0/4082015995 wait complete. 2024-04-25T08:42:50.092 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:50.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.197+0000 7ff3bfbb6640 1 Processor -- start 2024-04-25T08:42:50.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.197+0000 7ff3bfbb6640 1 -- start start 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3bfbb6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff3b806c1d0 0x7ff3b8168930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3bfbb6640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b80adcf0 con 0x7ff3b8071ac0 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3bfbb6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b815ec60 con 0x7ff3b8154ed0 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3bfbb6640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b815ef40 con 0x7ff3b806c1d0 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3be153640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff3b806c1d0 0x7ff3b8168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3bd151640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff3b8071ac0 0x7ff3b80ad5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46160/0 (socket says 172.21.15.172:46160) 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3bd151640 1 -- 172.21.15.172:0/2624902522 learned_addr learned my addr 172.21.15.172:0/2624902522 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3be153640 1 -- 172.21.15.172:0/2624902522 >> v1:172.21.15.186:6789/0 conn(0x7ff3b8154ed0 legacy=0x7ff3b80aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3be153640 1 -- 172.21.15.172:0/2624902522 >> v1:172.21.15.172:6789/0 conn(0x7ff3b8071ac0 legacy=0x7ff3b80ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3bc950640 1 -- 172.21.15.172:0/2624902522 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802230206 0 0) 0x7ff3b80adcf0 con 0x7ff3b8071ac0 2024-04-25T08:42:50.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.198+0000 7ff3be153640 1 -- 172.21.15.172:0/2624902522 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b806db90 con 0x7ff3b806c1d0 2024-04-25T08:42:50.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.199+0000 7ff3be153640 1 --2- 172.21.15.172:0/2624902522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b806c1d0 0x7ff3b8168930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009d90 tx=0x7ff3b002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1752f44030f7f5b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:50.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.199+0000 7ff3bc950640 1 -- 172.21.15.172:0/2624902522 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0007740 con 0x7ff3b806c1d0 2024-04-25T08:42:50.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.199+0000 7ff3bc950640 1 -- 172.21.15.172:0/2624902522 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b00078e0 con 0x7ff3b806c1d0 2024-04-25T08:42:50.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.199+0000 7ff3bc950640 1 -- 172.21.15.172:0/2624902522 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0007cb0 con 0x7ff3b806c1d0 2024-04-25T08:42:50.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.199+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/2624902522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b806c1d0 msgr2=0x7ff3b8168930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.199+0000 7ff3bfbb6640 1 --2- 172.21.15.172:0/2624902522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b806c1d0 0x7ff3b8168930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009d90 tx=0x7ff3b002a660 comp rx=0 tx=0).stop 2024-04-25T08:42:50.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.200+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/2624902522 shutdown_connections 2024-04-25T08:42:50.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.200+0000 7ff3bfbb6640 1 --2- 172.21.15.172:0/2624902522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b806c1d0 0x7ff3b8168930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.200+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/2624902522 >> 172.21.15.172:0/2624902522 conn(0x7ff3b80af670 msgr2=0x7ff3b80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:50.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.200+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/2624902522 shutdown_connections 2024-04-25T08:42:50.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.200+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/2624902522 wait complete. 2024-04-25T08:42:50.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.201+0000 7ff3bfbb6640 1 Processor -- start 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.201+0000 7ff3bfbb6640 1 -- start start 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.201+0000 7ff3bfbb6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3b8071ac0 0x7ff3b8144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.201+0000 7ff3bfbb6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3b8154ed0 0x7ff3b80ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.201+0000 7ff3bfbb6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b80cd510 0x7ff3b814c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.201+0000 7ff3bfbb6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8168ff0 con 0x7ff3b80cd510 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.201+0000 7ff3bfbb6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8168e70 con 0x7ff3b8154ed0 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.201+0000 7ff3bfbb6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8169170 con 0x7ff3b8071ac0 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3be153640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b80cd510 0x7ff3b814c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3be153640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b80cd510 0x7ff3b814c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50358/0 (socket says 172.21.15.172:50358) 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3be153640 1 -- 172.21.15.172:0/1287522378 learned_addr learned my addr 172.21.15.172:0/1287522378 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3bd151640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3b8154ed0 0x7ff3b80ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3bd952640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3b8071ac0 0x7ff3b8144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3be153640 1 -- 172.21.15.172:0/1287522378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3b8071ac0 msgr2=0x7ff3b8144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3be153640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3b8071ac0 0x7ff3b8144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3be153640 1 -- 172.21.15.172:0/1287522378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3b8154ed0 msgr2=0x7ff3b80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3be153640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3b8154ed0 0x7ff3b80ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3be153640 1 -- 172.21.15.172:0/1287522378 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8155fc0 con 0x7ff3b80cd510 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3be153640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b80cd510 0x7ff3b814c150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009e80 tx=0x7ff3b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3ae7fc640 1 -- 172.21.15.172:0/1287522378 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0040070 con 0x7ff3b80cd510 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3ae7fc640 1 -- 172.21.15.172:0/1287522378 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0031b70 con 0x7ff3b80cd510 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/1287522378 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b81562a0 con 0x7ff3b80cd510 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3ae7fc640 1 -- 172.21.15.172:0/1287522378 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0045460 con 0x7ff3b80cd510 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.202+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/1287522378 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b8156ac0 con 0x7ff3b80cd510 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.203+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/1287522378 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b8073990 con 0x7ff3b80cd510 2024-04-25T08:42:50.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.204+0000 7ff3ae7fc640 1 -- 172.21.15.172:0/1287522378 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff3b0039040 con 0x7ff3b80cd510 2024-04-25T08:42:50.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.204+0000 7ff3ae7fc640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39c06b4d0 0x7ff39c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.204+0000 7ff3ae7fc640 1 -- 172.21.15.172:0/1287522378 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff3b00abd40 con 0x7ff3b80cd510 2024-04-25T08:42:50.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.204+0000 7ff3bd952640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39c06b4d0 0x7ff39c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.204+0000 7ff3bd952640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39c06b4d0 0x7ff39c06d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff3b815d9c0 tx=0x7ff3b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:50.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.208+0000 7ff3ae7fc640 1 -- 172.21.15.172:0/1287522378 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff3b007a230 con 0x7ff3b80cd510 2024-04-25T08:42:50.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.378+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/1287522378 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3b8160f30 con 0x7ff3b80cd510 2024-04-25T08:42:50.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.379+0000 7ff3ae7fc640 1 -- 172.21.15.172:0/1287522378 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7ff3b007e2d0 con 0x7ff3b80cd510 2024-04-25T08:42:50.372 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:50.372 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/1287522378 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39c06b4d0 msgr2=0x7ff39c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39c06b4d0 0x7ff39c06d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff3b815d9c0 tx=0x7ff3b4009040 comp rx=0 tx=0).stop 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/1287522378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b80cd510 msgr2=0x7ff3b814c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b80cd510 0x7ff3b814c150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009e80 tx=0x7ff3b0004a40 comp rx=0 tx=0).stop 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/1287522378 shutdown_connections 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39c06b4d0 0x7ff39c06d990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3b8154ed0 0x7ff3b80ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3b80cd510 0x7ff3b814c150 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 --2- 172.21.15.172:0/1287522378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3b8071ac0 0x7ff3b8144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/1287522378 >> 172.21.15.172:0/1287522378 conn(0x7ff3b806c1d0 msgr2=0x7ff3b815f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:50.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/1287522378 shutdown_connections 2024-04-25T08:42:50.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.381+0000 7ff3bfbb6640 1 -- 172.21.15.172:0/1287522378 wait complete. 2024-04-25T08:42:50.385 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:42:50.385 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:42:50.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.490+0000 7fbddb3e0640 1 Processor -- start 2024-04-25T08:42:50.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.490+0000 7fbddb3e0640 1 -- start start 2024-04-25T08:42:50.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbddb3e0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbdd415dc00 0x7fbdd40c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbddb3e0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbdd40ceb20 0x7fbdd40d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbddb3e0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd415dfe0 con 0x7fbdd40d1c00 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbddb3e0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd40d2090 con 0x7fbdd415dc00 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbddb3e0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd40d00c0 con 0x7fbdd40ceb20 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbdd917c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbdd415dc00 0x7fbdd40c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbdd917c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbdd415dc00 0x7fbdd40c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50364/0 (socket says 172.21.15.172:50364) 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbdd917c640 1 -- 172.21.15.172:0/1716570107 learned_addr learned my addr 172.21.15.172:0/1716570107 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbdd897b640 1 --2- 172.21.15.172:0/1716570107 >> v2:172.21.15.186:3300/0 conn(0x7fbdd40ceb20 0x7fbdd40d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbdd917c640 1 -- 172.21.15.172:0/1716570107 >> v2:172.21.15.186:3300/0 conn(0x7fbdd40ceb20 msgr2=0x7fbdd40d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbdd917c640 1 --2- 172.21.15.172:0/1716570107 >> v2:172.21.15.186:3300/0 conn(0x7fbdd40ceb20 0x7fbdd40d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbdd917c640 1 -- 172.21.15.172:0/1716570107 >> v1:172.21.15.186:6789/0 conn(0x7fbdd40d1c00 legacy=0x7fbdd40ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.491+0000 7fbdd917c640 1 -- 172.21.15.172:0/1716570107 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd40d03a0 con 0x7fbdd415dc00 2024-04-25T08:42:50.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.492+0000 7fbdd917c640 1 --2- 172.21.15.172:0/1716570107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd415dc00 0x7fbdd40c6df0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40c8820 tx=0x7fbdd002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3f44a5886b3c1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:50.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.492+0000 7fbdcbfff640 1 -- 172.21.15.172:0/1716570107 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0036070 con 0x7fbdd415dc00 2024-04-25T08:42:50.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.492+0000 7fbdcbfff640 1 -- 172.21.15.172:0/1716570107 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd0031600 con 0x7fbdd415dc00 2024-04-25T08:42:50.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.492+0000 7fbdcbfff640 1 -- 172.21.15.172:0/1716570107 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00319d0 con 0x7fbdd415dc00 2024-04-25T08:42:50.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.492+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1716570107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd415dc00 msgr2=0x7fbdd40c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.492+0000 7fbddb3e0640 1 --2- 172.21.15.172:0/1716570107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd415dc00 0x7fbdd40c6df0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40c8820 tx=0x7fbdd002a730 comp rx=0 tx=0).stop 2024-04-25T08:42:50.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.492+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1716570107 shutdown_connections 2024-04-25T08:42:50.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.492+0000 7fbddb3e0640 1 --2- 172.21.15.172:0/1716570107 >> v2:172.21.15.186:3300/0 conn(0x7fbdd40ceb20 0x7fbdd40d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.492+0000 7fbddb3e0640 1 --2- 172.21.15.172:0/1716570107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd415dc00 0x7fbdd40c6df0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.492+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1716570107 >> 172.21.15.172:0/1716570107 conn(0x7fbdd406f5d0 msgr2=0x7fbdd406f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:50.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.493+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1716570107 shutdown_connections 2024-04-25T08:42:50.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.493+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1716570107 wait complete. 2024-04-25T08:42:50.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbddb3e0640 1 Processor -- start 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbddb3e0640 1 -- start start 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbddb3e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd40ceb20 0x7fbdd4160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbddb3e0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd40d1c00 0x7fbdd4158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbddb3e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd415dc00 0x7fbdd4161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbddb3e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40cc130 con 0x7fbdd40ceb20 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbddb3e0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40cc720 con 0x7fbdd40d1c00 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbddb3e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd40cfd90 con 0x7fbdd415dc00 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbdd917c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd40ceb20 0x7fbdd4160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbdd917c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd40ceb20 0x7fbdd4160450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50378/0 (socket says 172.21.15.172:50378) 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.494+0000 7fbdd917c640 1 -- 172.21.15.172:0/1080789215 learned_addr learned my addr 172.21.15.172:0/1080789215 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdd897b640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd40d1c00 0x7fbdd4158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdd997d640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd415dc00 0x7fbdd4161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdd917c640 1 -- 172.21.15.172:0/1080789215 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd415dc00 msgr2=0x7fbdd4161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdd917c640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd415dc00 0x7fbdd4161fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdd917c640 1 -- 172.21.15.172:0/1080789215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd40d1c00 msgr2=0x7fbdd4158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdd917c640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd40d1c00 0x7fbdd4158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdd917c640 1 -- 172.21.15.172:0/1080789215 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd41f40c0 con 0x7fbdd40ceb20 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdd897b640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd40d1c00 0x7fbdd4158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdd917c640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd40ceb20 0x7fbdd4160450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0034040 tx=0x7fbdd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdc9ffb640 1 -- 172.21.15.172:0/1080789215 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd003f020 con 0x7fbdd40ceb20 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdc9ffb640 1 -- 172.21.15.172:0/1080789215 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd0037040 con 0x7fbdd40ceb20 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1080789215 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd41f43a0 con 0x7fbdd40ceb20 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbdc9ffb640 1 -- 172.21.15.172:0/1080789215 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0036070 con 0x7fbdd40ceb20 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.495+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1080789215 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd41f4960 con 0x7fbdd40ceb20 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.496+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1080789215 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd4073990 con 0x7fbdd40ceb20 2024-04-25T08:42:50.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.497+0000 7fbdc9ffb640 1 -- 172.21.15.172:0/1080789215 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbdd0042020 con 0x7fbdd40ceb20 2024-04-25T08:42:50.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.497+0000 7fbdc9ffb640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdb806b4d0 0x7fbdb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.497+0000 7fbdc9ffb640 1 -- 172.21.15.172:0/1080789215 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbdd00aa830 con 0x7fbdd40ceb20 2024-04-25T08:42:50.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.497+0000 7fbdd897b640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdb806b4d0 0x7fbdb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.497+0000 7fbdd897b640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdb806b4d0 0x7fbdb806d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40b7c20 tx=0x7fbdc4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:50.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.501+0000 7fbdc9ffb640 1 -- 172.21.15.172:0/1080789215 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbdd0049030 con 0x7fbdd40ceb20 2024-04-25T08:42:50.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.672+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1080789215 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdd40c66c0 con 0x7fbdb806b4d0 2024-04-25T08:42:50.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.680+0000 7fbdc9ffb640 1 -- 172.21.15.172:0/1080789215 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7fbdd40c66c0 con 0x7fbdb806b4d0 2024-04-25T08:42:50.677 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:42:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1080789215 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdb806b4d0 msgr2=0x7fbdb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdb806b4d0 0x7fbdb806d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40b7c20 tx=0x7fbdc4008040 comp rx=0 tx=0).stop 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1080789215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd40ceb20 msgr2=0x7fbdd4160450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd40ceb20 0x7fbdd4160450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0034040 tx=0x7fbdd0004a40 comp rx=0 tx=0).stop 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1080789215 shutdown_connections 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdb806b4d0 0x7fbdb806d990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd40d1c00 0x7fbdd4158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd415dc00 0x7fbdd4161fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 --2- 172.21.15.172:0/1080789215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd40ceb20 0x7fbdd4160450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1080789215 >> 172.21.15.172:0/1080789215 conn(0x7fbdd406f5d0 msgr2=0x7fbdd406d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1080789215 shutdown_connections 2024-04-25T08:42:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.684+0000 7fbddb3e0640 1 -- 172.21.15.172:0/1080789215 wait complete. 2024-04-25T08:42:50.687 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T08:42:50.517185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002963"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718621+0000","last_change":"2024-04-25T08:42:27.663913+0000","last_active":"2024-04-25T08:42:34.718621+0000","last_peered":"2024-04-25T08:42:34.718621+0000","last_clean":"2024-04-25T08:42:34.718621+0000","last_became_active":"2024-04-25T08:42:27.663206+0000","last_became_peered":"2024-04-25T08:42:27.663206+0000","last_unstale":"2024-04-25T08:42:34.718621+0000","last_undegraded":"2024-04-25T08:42:34.718621+0000","last_fullsized":"2024-04-25T08:42:34.718621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:08.095908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720030+0000","last_change":"2024-04-25T08:42:28.679929+0000","last_active":"2024-04-25T08:42:34.720030+0000","last_peered":"2024-04-25T08:42:34.720030+0000","last_clean":"2024-04-25T08:42:34.720030+0000","last_became_active":"2024-04-25T08:42:28.679533+0000","last_became_peered":"2024-04-25T08:42:28.679533+0000","last_unstale":"2024-04-25T08:42:34.720030+0000","last_undegraded":"2024-04-25T08:42:34.720030+0000","last_fullsized":"2024-04-25T08:42:34.720030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719823+0000","last_change":"2024-04-25T08:42:32.775785+0000","last_active":"2024-04-25T08:42:34.719823+0000","last_peered":"2024-04-25T08:42:34.719823+0000","last_clean":"2024-04-25T08:42:34.719823+0000","last_became_active":"2024-04-25T08:42:32.775418+0000","last_became_peered":"2024-04-25T08:42:32.775418+0000","last_unstale":"2024-04-25T08:42:34.719823+0000","last_undegraded":"2024-04-25T08:42:34.719823+0000","last_fullsized":"2024-04-25T08:42:34.719823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:16.973550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720238+0000","last_change":"2024-04-25T08:42:27.669510+0000","last_active":"2024-04-25T08:42:34.720238+0000","last_peered":"2024-04-25T08:42:34.720238+0000","last_clean":"2024-04-25T08:42:34.720238+0000","last_became_active":"2024-04-25T08:42:27.669194+0000","last_became_peered":"2024-04-25T08:42:27.669194+0000","last_unstale":"2024-04-25T08:42:34.720238+0000","last_undegraded":"2024-04-25T08:42:34.720238+0000","last_fullsized":"2024-04-25T08:42:34.720238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:43.313642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718181+0000","last_change":"2024-04-25T08:42:28.678584+0000","last_active":"2024-04-25T08:42:34.718181+0000","last_peered":"2024-04-25T08:42:34.718181+0000","last_clean":"2024-04-25T08:42:34.718181+0000","last_became_active":"2024-04-25T08:42:28.677636+0000","last_became_peered":"2024-04-25T08:42:28.677636+0000","last_unstale":"2024-04-25T08:42:34.718181+0000","last_undegraded":"2024-04-25T08:42:34.718181+0000","last_fullsized":"2024-04-25T08:42:34.718181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716151+0000","last_change":"2024-04-25T08:42:32.710347+0000","last_active":"2024-04-25T08:42:33.716151+0000","last_peered":"2024-04-25T08:42:33.716151+0000","last_clean":"2024-04-25T08:42:33.716151+0000","last_became_active":"2024-04-25T08:42:32.709855+0000","last_became_peered":"2024-04-25T08:42:32.709855+0000","last_unstale":"2024-04-25T08:42:33.716151+0000","last_undegraded":"2024-04-25T08:42:33.716151+0000","last_fullsized":"2024-04-25T08:42:33.716151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:17.497098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341696+0000","last_change":"2024-04-25T08:42:27.667761+0000","last_active":"2024-04-25T08:42:34.341696+0000","last_peered":"2024-04-25T08:42:34.341696+0000","last_clean":"2024-04-25T08:42:34.341696+0000","last_became_active":"2024-04-25T08:42:27.667504+0000","last_became_peered":"2024-04-25T08:42:27.667504+0000","last_unstale":"2024-04-25T08:42:34.341696+0000","last_undegraded":"2024-04-25T08:42:34.341696+0000","last_fullsized":"2024-04-25T08:42:34.341696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:11.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717960+0000","last_change":"2024-04-25T08:42:28.679617+0000","last_active":"2024-04-25T08:42:33.717960+0000","last_peered":"2024-04-25T08:42:33.717960+0000","last_clean":"2024-04-25T08:42:33.717960+0000","last_became_active":"2024-04-25T08:42:28.677547+0000","last_became_peered":"2024-04-25T08:42:28.677547+0000","last_unstale":"2024-04-25T08:42:33.717960+0000","last_undegraded":"2024-04-25T08:42:33.717960+0000","last_fullsized":"2024-04-25T08:42:33.717960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716871+0000","last_change":"2024-04-25T08:42:32.715254+0000","last_active":"2024-04-25T08:42:33.716871+0000","last_peered":"2024-04-25T08:42:33.716871+0000","last_clean":"2024-04-25T08:42:33.716871+0000","last_became_active":"2024-04-25T08:42:32.714553+0000","last_became_peered":"2024-04-25T08:42:32.714553+0000","last_unstale":"2024-04-25T08:42:33.716871+0000","last_undegraded":"2024-04-25T08:42:33.716871+0000","last_fullsized":"2024-04-25T08:42:33.716871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:02.361047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341492+0000","last_change":"2024-04-25T08:42:27.669362+0000","last_active":"2024-04-25T08:42:34.341492+0000","last_peered":"2024-04-25T08:42:34.341492+0000","last_clean":"2024-04-25T08:42:34.341492+0000","last_became_active":"2024-04-25T08:42:27.669047+0000","last_became_peered":"2024-04-25T08:42:27.669047+0000","last_unstale":"2024-04-25T08:42:34.341492+0000","last_undegraded":"2024-04-25T08:42:34.341492+0000","last_fullsized":"2024-04-25T08:42:34.341492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:24.034481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718067+0000","last_change":"2024-04-25T08:42:28.676280+0000","last_active":"2024-04-25T08:42:33.718067+0000","last_peered":"2024-04-25T08:42:33.718067+0000","last_clean":"2024-04-25T08:42:33.718067+0000","last_became_active":"2024-04-25T08:42:28.676008+0000","last_became_peered":"2024-04-25T08:42:28.676008+0000","last_unstale":"2024-04-25T08:42:33.718067+0000","last_undegraded":"2024-04-25T08:42:33.718067+0000","last_fullsized":"2024-04-25T08:42:33.718067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716251+0000","last_change":"2024-04-25T08:42:32.702185+0000","last_active":"2024-04-25T08:42:33.716251+0000","last_peered":"2024-04-25T08:42:33.716251+0000","last_clean":"2024-04-25T08:42:33.716251+0000","last_became_active":"2024-04-25T08:42:32.701758+0000","last_became_peered":"2024-04-25T08:42:32.701758+0000","last_unstale":"2024-04-25T08:42:33.716251+0000","last_undegraded":"2024-04-25T08:42:33.716251+0000","last_fullsized":"2024-04-25T08:42:33.716251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:49.319348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718505+0000","last_change":"2024-04-25T08:42:28.687237+0000","last_active":"2024-04-25T08:42:34.718505+0000","last_peered":"2024-04-25T08:42:34.718505+0000","last_clean":"2024-04-25T08:42:34.718505+0000","last_became_active":"2024-04-25T08:42:28.686009+0000","last_became_peered":"2024-04-25T08:42:28.686009+0000","last_unstale":"2024-04-25T08:42:34.718505+0000","last_undegraded":"2024-04-25T08:42:34.718505+0000","last_fullsized":"2024-04-25T08:42:34.718505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341503+0000","last_change":"2024-04-25T08:42:27.666906+0000","last_active":"2024-04-25T08:42:34.341503+0000","last_peered":"2024-04-25T08:42:34.341503+0000","last_clean":"2024-04-25T08:42:34.341503+0000","last_became_active":"2024-04-25T08:42:27.666643+0000","last_became_peered":"2024-04-25T08:42:27.666643+0000","last_unstale":"2024-04-25T08:42:34.341503+0000","last_undegraded":"2024-04-25T08:42:34.341503+0000","last_fullsized":"2024-04-25T08:42:34.341503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716980+0000","last_change":"2024-04-25T08:42:32.711169+0000","last_active":"2024-04-25T08:42:33.716980+0000","last_peered":"2024-04-25T08:42:33.716980+0000","last_clean":"2024-04-25T08:42:33.716980+0000","last_became_active":"2024-04-25T08:42:32.710192+0000","last_became_peered":"2024-04-25T08:42:32.710192+0000","last_unstale":"2024-04-25T08:42:33.716980+0000","last_undegraded":"2024-04-25T08:42:33.716980+0000","last_fullsized":"2024-04-25T08:42:33.716980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:41.910425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720554+0000","last_change":"2024-04-25T08:42:28.672389+0000","last_active":"2024-04-25T08:42:34.720554+0000","last_peered":"2024-04-25T08:42:34.720554+0000","last_clean":"2024-04-25T08:42:34.720554+0000","last_became_active":"2024-04-25T08:42:28.672116+0000","last_became_peered":"2024-04-25T08:42:28.672116+0000","last_unstale":"2024-04-25T08:42:34.720554+0000","last_undegraded":"2024-04-25T08:42:34.720554+0000","last_fullsized":"2024-04-25T08:42:34.720554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719572+0000","last_change":"2024-04-25T08:42:27.669517+0000","last_active":"2024-04-25T08:42:34.719572+0000","last_peered":"2024-04-25T08:42:34.719572+0000","last_clean":"2024-04-25T08:42:34.719572+0000","last_became_active":"2024-04-25T08:42:27.669240+0000","last_became_peered":"2024-04-25T08:42:27.669240+0000","last_unstale":"2024-04-25T08:42:34.719572+0000","last_undegraded":"2024-04-25T08:42:34.719572+0000","last_fullsized":"2024-04-25T08:42:34.719572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717062+0000","last_change":"2024-04-25T08:42:32.710857+0000","last_active":"2024-04-25T08:42:33.717062+0000","last_peered":"2024-04-25T08:42:33.717062+0000","last_clean":"2024-04-25T08:42:33.717062+0000","last_became_active":"2024-04-25T08:42:32.709737+0000","last_became_peered":"2024-04-25T08:42:32.709737+0000","last_unstale":"2024-04-25T08:42:33.717062+0000","last_undegraded":"2024-04-25T08:42:33.717062+0000","last_fullsized":"2024-04-25T08:42:33.717062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:48.222965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720874+0000","last_change":"2024-04-25T08:42:28.672212+0000","last_active":"2024-04-25T08:42:34.720874+0000","last_peered":"2024-04-25T08:42:34.720874+0000","last_clean":"2024-04-25T08:42:34.720874+0000","last_became_active":"2024-04-25T08:42:28.671893+0000","last_became_peered":"2024-04-25T08:42:28.671893+0000","last_unstale":"2024-04-25T08:42:34.720874+0000","last_undegraded":"2024-04-25T08:42:34.720874+0000","last_fullsized":"2024-04-25T08:42:34.720874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718326+0000","last_change":"2024-04-25T08:42:27.662789+0000","last_active":"2024-04-25T08:42:34.718326+0000","last_peered":"2024-04-25T08:42:34.718326+0000","last_clean":"2024-04-25T08:42:34.718326+0000","last_became_active":"2024-04-25T08:42:27.662490+0000","last_became_peered":"2024-04-25T08:42:27.662490+0000","last_unstale":"2024-04-25T08:42:34.718326+0000","last_undegraded":"2024-04-25T08:42:34.718326+0000","last_fullsized":"2024-04-25T08:42:34.718326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719021+0000","last_change":"2024-04-25T08:42:32.773797+0000","last_active":"2024-04-25T08:42:34.719021+0000","last_peered":"2024-04-25T08:42:34.719021+0000","last_clean":"2024-04-25T08:42:34.719021+0000","last_became_active":"2024-04-25T08:42:32.772850+0000","last_became_peered":"2024-04-25T08:42:32.772850+0000","last_unstale":"2024-04-25T08:42:34.719021+0000","last_undegraded":"2024-04-25T08:42:34.719021+0000","last_fullsized":"2024-04-25T08:42:34.719021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716595+0000","last_change":"2024-04-25T08:42:28.670256+0000","last_active":"2024-04-25T08:42:33.716595+0000","last_peered":"2024-04-25T08:42:33.716595+0000","last_clean":"2024-04-25T08:42:33.716595+0000","last_became_active":"2024-04-25T08:42:28.669544+0000","last_became_peered":"2024-04-25T08:42:28.669544+0000","last_unstale":"2024-04-25T08:42:33.716595+0000","last_undegraded":"2024-04-25T08:42:33.716595+0000","last_fullsized":"2024-04-25T08:42:33.716595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:56.767579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341156+0000","last_change":"2024-04-25T08:42:27.666339+0000","last_active":"2024-04-25T08:42:34.341156+0000","last_peered":"2024-04-25T08:42:34.341156+0000","last_clean":"2024-04-25T08:42:34.341156+0000","last_became_active":"2024-04-25T08:42:27.665968+0000","last_became_peered":"2024-04-25T08:42:27.665968+0000","last_unstale":"2024-04-25T08:42:34.341156+0000","last_undegraded":"2024-04-25T08:42:34.341156+0000","last_fullsized":"2024-04-25T08:42:34.341156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716958+0000","last_change":"2024-04-25T08:42:32.716309+0000","last_active":"2024-04-25T08:42:33.716958+0000","last_peered":"2024-04-25T08:42:33.716958+0000","last_clean":"2024-04-25T08:42:33.716958+0000","last_became_active":"2024-04-25T08:42:32.715869+0000","last_became_peered":"2024-04-25T08:42:32.715869+0000","last_unstale":"2024-04-25T08:42:33.716958+0000","last_undegraded":"2024-04-25T08:42:33.716958+0000","last_fullsized":"2024-04-25T08:42:33.716958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:42.194257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718628+0000","last_change":"2024-04-25T08:42:28.671623+0000","last_active":"2024-04-25T08:42:34.718628+0000","last_peered":"2024-04-25T08:42:34.718628+0000","last_clean":"2024-04-25T08:42:34.718628+0000","last_became_active":"2024-04-25T08:42:28.671330+0000","last_became_peered":"2024-04-25T08:42:28.671330+0000","last_unstale":"2024-04-25T08:42:34.718628+0000","last_undegraded":"2024-04-25T08:42:34.718628+0000","last_fullsized":"2024-04-25T08:42:34.718628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719273+0000","last_change":"2024-04-25T08:42:27.662946+0000","last_active":"2024-04-25T08:42:34.719273+0000","last_peered":"2024-04-25T08:42:34.719273+0000","last_clean":"2024-04-25T08:42:34.719273+0000","last_became_active":"2024-04-25T08:42:27.662661+0000","last_became_peered":"2024-04-25T08:42:27.662661+0000","last_unstale":"2024-04-25T08:42:34.719273+0000","last_undegraded":"2024-04-25T08:42:34.719273+0000","last_fullsized":"2024-04-25T08:42:34.719273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716252+0000","last_change":"2024-04-25T08:42:32.773209+0000","last_active":"2024-04-25T08:42:33.716252+0000","last_peered":"2024-04-25T08:42:33.716252+0000","last_clean":"2024-04-25T08:42:33.716252+0000","last_became_active":"2024-04-25T08:42:32.772788+0000","last_became_peered":"2024-04-25T08:42:32.772788+0000","last_unstale":"2024-04-25T08:42:33.716252+0000","last_undegraded":"2024-04-25T08:42:33.716252+0000","last_fullsized":"2024-04-25T08:42:33.716252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:59.766748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720324+0000","last_change":"2024-04-25T08:42:28.681466+0000","last_active":"2024-04-25T08:42:34.720324+0000","last_peered":"2024-04-25T08:42:34.720324+0000","last_clean":"2024-04-25T08:42:34.720324+0000","last_became_active":"2024-04-25T08:42:28.681184+0000","last_became_peered":"2024-04-25T08:42:28.681184+0000","last_unstale":"2024-04-25T08:42:34.720324+0000","last_undegraded":"2024-04-25T08:42:34.720324+0000","last_fullsized":"2024-04-25T08:42:34.720324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719545+0000","last_change":"2024-04-25T08:42:27.663837+0000","last_active":"2024-04-25T08:42:34.719545+0000","last_peered":"2024-04-25T08:42:34.719545+0000","last_clean":"2024-04-25T08:42:34.719545+0000","last_became_active":"2024-04-25T08:42:27.663542+0000","last_became_peered":"2024-04-25T08:42:27.663542+0000","last_unstale":"2024-04-25T08:42:34.719545+0000","last_undegraded":"2024-04-25T08:42:34.719545+0000","last_fullsized":"2024-04-25T08:42:34.719545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720453+0000","last_change":"2024-04-25T08:42:32.773738+0000","last_active":"2024-04-25T08:42:34.720453+0000","last_peered":"2024-04-25T08:42:34.720453+0000","last_clean":"2024-04-25T08:42:34.720453+0000","last_became_active":"2024-04-25T08:42:32.773337+0000","last_became_peered":"2024-04-25T08:42:32.773337+0000","last_unstale":"2024-04-25T08:42:34.720453+0000","last_undegraded":"2024-04-25T08:42:34.720453+0000","last_fullsized":"2024-04-25T08:42:34.720453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:24.829343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719414+0000","last_change":"2024-04-25T08:42:28.672285+0000","last_active":"2024-04-25T08:42:34.719414+0000","last_peered":"2024-04-25T08:42:34.719414+0000","last_clean":"2024-04-25T08:42:34.719414+0000","last_became_active":"2024-04-25T08:42:28.672041+0000","last_became_peered":"2024-04-25T08:42:28.672041+0000","last_unstale":"2024-04-25T08:42:34.719414+0000","last_undegraded":"2024-04-25T08:42:34.719414+0000","last_fullsized":"2024-04-25T08:42:34.719414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341853+0000","last_change":"2024-04-25T08:42:27.665607+0000","last_active":"2024-04-25T08:42:34.341853+0000","last_peered":"2024-04-25T08:42:34.341853+0000","last_clean":"2024-04-25T08:42:34.341853+0000","last_became_active":"2024-04-25T08:42:27.664407+0000","last_became_peered":"2024-04-25T08:42:27.664407+0000","last_unstale":"2024-04-25T08:42:34.341853+0000","last_undegraded":"2024-04-25T08:42:34.341853+0000","last_fullsized":"2024-04-25T08:42:34.341853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.628103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718135+0000","last_change":"2024-04-25T08:42:32.773268+0000","last_active":"2024-04-25T08:42:34.718135+0000","last_peered":"2024-04-25T08:42:34.718135+0000","last_clean":"2024-04-25T08:42:34.718135+0000","last_became_active":"2024-04-25T08:42:32.772863+0000","last_became_peered":"2024-04-25T08:42:32.772863+0000","last_unstale":"2024-04-25T08:42:34.718135+0000","last_undegraded":"2024-04-25T08:42:34.718135+0000","last_fullsized":"2024-04-25T08:42:34.718135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718190+0000","last_change":"2024-04-25T08:42:28.680636+0000","last_active":"2024-04-25T08:42:33.718190+0000","last_peered":"2024-04-25T08:42:33.718190+0000","last_clean":"2024-04-25T08:42:33.718190+0000","last_became_active":"2024-04-25T08:42:28.680378+0000","last_became_peered":"2024-04-25T08:42:28.680378+0000","last_unstale":"2024-04-25T08:42:33.718190+0000","last_undegraded":"2024-04-25T08:42:33.718190+0000","last_fullsized":"2024-04-25T08:42:33.718190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719445+0000","last_change":"2024-04-25T08:42:27.659419+0000","last_active":"2024-04-25T08:42:34.719445+0000","last_peered":"2024-04-25T08:42:34.719445+0000","last_clean":"2024-04-25T08:42:34.719445+0000","last_became_active":"2024-04-25T08:42:27.657839+0000","last_became_peered":"2024-04-25T08:42:27.657839+0000","last_unstale":"2024-04-25T08:42:34.719445+0000","last_undegraded":"2024-04-25T08:42:34.719445+0000","last_fullsized":"2024-04-25T08:42:34.719445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719161+0000","last_change":"2024-04-25T08:42:32.711534+0000","last_active":"2024-04-25T08:42:34.719161+0000","last_peered":"2024-04-25T08:42:34.719161+0000","last_clean":"2024-04-25T08:42:34.719161+0000","last_became_active":"2024-04-25T08:42:32.709615+0000","last_became_peered":"2024-04-25T08:42:32.709615+0000","last_unstale":"2024-04-25T08:42:34.719161+0000","last_undegraded":"2024-04-25T08:42:34.719161+0000","last_fullsized":"2024-04-25T08:42:34.719161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:50.447473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717233+0000","last_change":"2024-04-25T08:42:28.675371+0000","last_active":"2024-04-25T08:42:33.717233+0000","last_peered":"2024-04-25T08:42:33.717233+0000","last_clean":"2024-04-25T08:42:33.717233+0000","last_became_active":"2024-04-25T08:42:28.675078+0000","last_became_peered":"2024-04-25T08:42:28.675078+0000","last_unstale":"2024-04-25T08:42:33.717233+0000","last_undegraded":"2024-04-25T08:42:33.717233+0000","last_fullsized":"2024-04-25T08:42:33.717233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:45.680776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717778+0000","last_change":"2024-04-25T08:42:27.663976+0000","last_active":"2024-04-25T08:42:33.717778+0000","last_peered":"2024-04-25T08:42:33.717778+0000","last_clean":"2024-04-25T08:42:33.717778+0000","last_became_active":"2024-04-25T08:42:27.663254+0000","last_became_peered":"2024-04-25T08:42:27.663254+0000","last_unstale":"2024-04-25T08:42:33.717778+0000","last_undegraded":"2024-04-25T08:42:33.717778+0000","last_fullsized":"2024-04-25T08:42:33.717778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719384+0000","last_change":"2024-04-25T08:42:32.712637+0000","last_active":"2024-04-25T08:42:34.719384+0000","last_peered":"2024-04-25T08:42:34.719384+0000","last_clean":"2024-04-25T08:42:34.719384+0000","last_became_active":"2024-04-25T08:42:32.712245+0000","last_became_peered":"2024-04-25T08:42:32.712245+0000","last_unstale":"2024-04-25T08:42:34.719384+0000","last_undegraded":"2024-04-25T08:42:34.719384+0000","last_fullsized":"2024-04-25T08:42:34.719384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:59.518802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719010+0000","last_change":"2024-04-25T08:42:28.673163+0000","last_active":"2024-04-25T08:42:34.719010+0000","last_peered":"2024-04-25T08:42:34.719010+0000","last_clean":"2024-04-25T08:42:34.719010+0000","last_became_active":"2024-04-25T08:42:28.672866+0000","last_became_peered":"2024-04-25T08:42:28.672866+0000","last_unstale":"2024-04-25T08:42:34.719010+0000","last_undegraded":"2024-04-25T08:42:34.719010+0000","last_fullsized":"2024-04-25T08:42:34.719010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714151+0000","last_change":"2024-04-25T08:42:27.665216+0000","last_active":"2024-04-25T08:42:33.714151+0000","last_peered":"2024-04-25T08:42:33.714151+0000","last_clean":"2024-04-25T08:42:33.714151+0000","last_became_active":"2024-04-25T08:42:27.664871+0000","last_became_peered":"2024-04-25T08:42:27.664871+0000","last_unstale":"2024-04-25T08:42:33.714151+0000","last_undegraded":"2024-04-25T08:42:33.714151+0000","last_fullsized":"2024-04-25T08:42:33.714151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:43.313642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719177+0000","last_change":"2024-04-25T08:42:32.708236+0000","last_active":"2024-04-25T08:42:34.719177+0000","last_peered":"2024-04-25T08:42:34.719177+0000","last_clean":"2024-04-25T08:42:34.719177+0000","last_became_active":"2024-04-25T08:42:32.707821+0000","last_became_peered":"2024-04-25T08:42:32.707821+0000","last_unstale":"2024-04-25T08:42:34.719177+0000","last_undegraded":"2024-04-25T08:42:34.719177+0000","last_fullsized":"2024-04-25T08:42:34.719177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:58.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.717992+0000","last_change":"2024-04-25T08:42:28.674649+0000","last_active":"2024-04-25T08:42:34.717992+0000","last_peered":"2024-04-25T08:42:34.717992+0000","last_clean":"2024-04-25T08:42:34.717992+0000","last_became_active":"2024-04-25T08:42:28.671414+0000","last_became_peered":"2024-04-25T08:42:28.671414+0000","last_unstale":"2024-04-25T08:42:34.717992+0000","last_undegraded":"2024-04-25T08:42:34.717992+0000","last_fullsized":"2024-04-25T08:42:34.717992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:16.974552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341186+0000","last_change":"2024-04-25T08:42:27.665689+0000","last_active":"2024-04-25T08:42:34.341186+0000","last_peered":"2024-04-25T08:42:34.341186+0000","last_clean":"2024-04-25T08:42:34.341186+0000","last_became_active":"2024-04-25T08:42:27.664957+0000","last_became_peered":"2024-04-25T08:42:27.664957+0000","last_unstale":"2024-04-25T08:42:34.341186+0000","last_undegraded":"2024-04-25T08:42:34.341186+0000","last_fullsized":"2024-04-25T08:42:34.341186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718502+0000","last_change":"2024-04-25T08:42:32.775658+0000","last_active":"2024-04-25T08:42:34.718502+0000","last_peered":"2024-04-25T08:42:34.718502+0000","last_clean":"2024-04-25T08:42:34.718502+0000","last_became_active":"2024-04-25T08:42:32.775292+0000","last_became_peered":"2024-04-25T08:42:32.775292+0000","last_unstale":"2024-04-25T08:42:34.718502+0000","last_undegraded":"2024-04-25T08:42:34.718502+0000","last_fullsized":"2024-04-25T08:42:34.718502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:59.518802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719571+0000","last_change":"2024-04-25T08:42:28.677751+0000","last_active":"2024-04-25T08:42:34.719571+0000","last_peered":"2024-04-25T08:42:34.719571+0000","last_clean":"2024-04-25T08:42:34.719571+0000","last_became_active":"2024-04-25T08:42:28.677457+0000","last_became_peered":"2024-04-25T08:42:28.677457+0000","last_unstale":"2024-04-25T08:42:34.719571+0000","last_undegraded":"2024-04-25T08:42:34.719571+0000","last_fullsized":"2024-04-25T08:42:34.719571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717550+0000","last_change":"2024-04-25T08:42:27.657212+0000","last_active":"2024-04-25T08:42:33.717550+0000","last_peered":"2024-04-25T08:42:33.717550+0000","last_clean":"2024-04-25T08:42:33.717550+0000","last_became_active":"2024-04-25T08:42:27.656883+0000","last_became_peered":"2024-04-25T08:42:27.656883+0000","last_unstale":"2024-04-25T08:42:33.717550+0000","last_undegraded":"2024-04-25T08:42:33.717550+0000","last_fullsized":"2024-04-25T08:42:33.717550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341308+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:42:34.341308+0000","last_peered":"2024-04-25T08:42:34.341308+0000","last_clean":"2024-04-25T08:42:34.341308+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:42:34.341308+0000","last_undegraded":"2024-04-25T08:42:34.341308+0000","last_fullsized":"2024-04-25T08:42:34.341308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718667+0000","last_change":"2024-04-25T08:42:32.776301+0000","last_active":"2024-04-25T08:42:34.718667+0000","last_peered":"2024-04-25T08:42:34.718667+0000","last_clean":"2024-04-25T08:42:34.718667+0000","last_became_active":"2024-04-25T08:42:32.775904+0000","last_became_peered":"2024-04-25T08:42:32.775904+0000","last_unstale":"2024-04-25T08:42:34.718667+0000","last_undegraded":"2024-04-25T08:42:34.718667+0000","last_fullsized":"2024-04-25T08:42:34.718667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341570+0000","last_change":"2024-04-25T08:42:28.692829+0000","last_active":"2024-04-25T08:42:34.341570+0000","last_peered":"2024-04-25T08:42:34.341570+0000","last_clean":"2024-04-25T08:42:34.341570+0000","last_became_active":"2024-04-25T08:42:28.690838+0000","last_became_peered":"2024-04-25T08:42:28.690838+0000","last_unstale":"2024-04-25T08:42:34.341570+0000","last_undegraded":"2024-04-25T08:42:34.341570+0000","last_fullsized":"2024-04-25T08:42:34.341570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:31.845872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714659+0000","last_change":"2024-04-25T08:42:27.664137+0000","last_active":"2024-04-25T08:42:33.714659+0000","last_peered":"2024-04-25T08:42:33.714659+0000","last_clean":"2024-04-25T08:42:33.714659+0000","last_became_active":"2024-04-25T08:42:27.663755+0000","last_became_peered":"2024-04-25T08:42:27.663755+0000","last_unstale":"2024-04-25T08:42:33.714659+0000","last_undegraded":"2024-04-25T08:42:33.714659+0000","last_fullsized":"2024-04-25T08:42:33.714659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718434+0000","last_change":"2024-04-25T08:42:32.773504+0000","last_active":"2024-04-25T08:42:34.718434+0000","last_peered":"2024-04-25T08:42:34.718434+0000","last_clean":"2024-04-25T08:42:34.718434+0000","last_became_active":"2024-04-25T08:42:32.773110+0000","last_became_peered":"2024-04-25T08:42:32.773110+0000","last_unstale":"2024-04-25T08:42:34.718434+0000","last_undegraded":"2024-04-25T08:42:34.718434+0000","last_fullsized":"2024-04-25T08:42:34.718434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:48.222965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717970+0000","last_change":"2024-04-25T08:42:28.679402+0000","last_active":"2024-04-25T08:42:33.717970+0000","last_peered":"2024-04-25T08:42:33.717970+0000","last_clean":"2024-04-25T08:42:33.717970+0000","last_became_active":"2024-04-25T08:42:28.677035+0000","last_became_peered":"2024-04-25T08:42:28.677035+0000","last_unstale":"2024-04-25T08:42:33.717970+0000","last_undegraded":"2024-04-25T08:42:33.717970+0000","last_fullsized":"2024-04-25T08:42:33.717970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:46.406390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719572+0000","last_change":"2024-04-25T08:42:27.667160+0000","last_active":"2024-04-25T08:42:34.719572+0000","last_peered":"2024-04-25T08:42:34.719572+0000","last_clean":"2024-04-25T08:42:34.719572+0000","last_became_active":"2024-04-25T08:42:27.666859+0000","last_became_peered":"2024-04-25T08:42:27.666859+0000","last_unstale":"2024-04-25T08:42:34.719572+0000","last_undegraded":"2024-04-25T08:42:34.719572+0000","last_fullsized":"2024-04-25T08:42:34.719572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.628103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718382+0000","last_change":"2024-04-25T08:42:32.712665+0000","last_active":"2024-04-25T08:42:34.718382+0000","last_peered":"2024-04-25T08:42:34.718382+0000","last_clean":"2024-04-25T08:42:34.718382+0000","last_became_active":"2024-04-25T08:42:32.712042+0000","last_became_peered":"2024-04-25T08:42:32.712042+0000","last_unstale":"2024-04-25T08:42:34.718382+0000","last_undegraded":"2024-04-25T08:42:34.718382+0000","last_fullsized":"2024-04-25T08:42:34.718382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:58.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341968+0000","last_change":"2024-04-25T08:42:28.693096+0000","last_active":"2024-04-25T08:42:34.341968+0000","last_peered":"2024-04-25T08:42:34.341968+0000","last_clean":"2024-04-25T08:42:34.341968+0000","last_became_active":"2024-04-25T08:42:28.692818+0000","last_became_peered":"2024-04-25T08:42:28.692818+0000","last_unstale":"2024-04-25T08:42:34.341968+0000","last_undegraded":"2024-04-25T08:42:34.341968+0000","last_fullsized":"2024-04-25T08:42:34.341968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:18.213161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714486+0000","last_change":"2024-04-25T08:42:27.669796+0000","last_active":"2024-04-25T08:42:33.714486+0000","last_peered":"2024-04-25T08:42:33.714486+0000","last_clean":"2024-04-25T08:42:33.714486+0000","last_became_active":"2024-04-25T08:42:27.669436+0000","last_became_peered":"2024-04-25T08:42:27.669436+0000","last_unstale":"2024-04-25T08:42:33.714486+0000","last_undegraded":"2024-04-25T08:42:33.714486+0000","last_fullsized":"2024-04-25T08:42:33.714486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.411487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716067+0000","last_change":"2024-04-25T08:42:32.776302+0000","last_active":"2024-04-25T08:42:33.716067+0000","last_peered":"2024-04-25T08:42:33.716067+0000","last_clean":"2024-04-25T08:42:33.716067+0000","last_became_active":"2024-04-25T08:42:32.775933+0000","last_became_peered":"2024-04-25T08:42:32.775933+0000","last_unstale":"2024-04-25T08:42:33.716067+0000","last_undegraded":"2024-04-25T08:42:33.716067+0000","last_fullsized":"2024-04-25T08:42:33.716067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341857+0000","last_change":"2024-04-25T08:42:28.690533+0000","last_active":"2024-04-25T08:42:34.341857+0000","last_peered":"2024-04-25T08:42:34.341857+0000","last_clean":"2024-04-25T08:42:34.341857+0000","last_became_active":"2024-04-25T08:42:28.690239+0000","last_became_peered":"2024-04-25T08:42:28.690239+0000","last_unstale":"2024-04-25T08:42:34.341857+0000","last_undegraded":"2024-04-25T08:42:34.341857+0000","last_fullsized":"2024-04-25T08:42:34.341857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:46.406390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717279+0000","last_change":"2024-04-25T08:42:27.656949+0000","last_active":"2024-04-25T08:42:33.717279+0000","last_peered":"2024-04-25T08:42:33.717279+0000","last_clean":"2024-04-25T08:42:33.717279+0000","last_became_active":"2024-04-25T08:42:27.656636+0000","last_became_peered":"2024-04-25T08:42:27.656636+0000","last_unstale":"2024-04-25T08:42:33.717279+0000","last_undegraded":"2024-04-25T08:42:33.717279+0000","last_fullsized":"2024-04-25T08:42:33.717279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:20.615472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716458+0000","last_change":"2024-04-25T08:42:32.710504+0000","last_active":"2024-04-25T08:42:33.716458+0000","last_peered":"2024-04-25T08:42:33.716458+0000","last_clean":"2024-04-25T08:42:33.716458+0000","last_became_active":"2024-04-25T08:42:32.709907+0000","last_became_peered":"2024-04-25T08:42:32.709907+0000","last_unstale":"2024-04-25T08:42:33.716458+0000","last_undegraded":"2024-04-25T08:42:33.716458+0000","last_fullsized":"2024-04-25T08:42:33.716458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:01.014826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341325+0000","last_change":"2024-04-25T08:42:28.691813+0000","last_active":"2024-04-25T08:42:34.341325+0000","last_peered":"2024-04-25T08:42:34.341325+0000","last_clean":"2024-04-25T08:42:34.341325+0000","last_became_active":"2024-04-25T08:42:28.691149+0000","last_became_peered":"2024-04-25T08:42:28.691149+0000","last_unstale":"2024-04-25T08:42:34.341325+0000","last_undegraded":"2024-04-25T08:42:34.341325+0000","last_fullsized":"2024-04-25T08:42:34.341325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714031+0000","last_change":"2024-04-25T08:42:27.662731+0000","last_active":"2024-04-25T08:42:33.714031+0000","last_peered":"2024-04-25T08:42:33.714031+0000","last_clean":"2024-04-25T08:42:33.714031+0000","last_became_active":"2024-04-25T08:42:27.662403+0000","last_became_peered":"2024-04-25T08:42:27.662403+0000","last_unstale":"2024-04-25T08:42:33.714031+0000","last_undegraded":"2024-04-25T08:42:33.714031+0000","last_fullsized":"2024-04-25T08:42:33.714031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:50.270810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718353+0000","last_change":"2024-04-25T08:42:32.710724+0000","last_active":"2024-04-25T08:42:34.718353+0000","last_peered":"2024-04-25T08:42:34.718353+0000","last_clean":"2024-04-25T08:42:34.718353+0000","last_became_active":"2024-04-25T08:42:32.710334+0000","last_became_peered":"2024-04-25T08:42:32.710334+0000","last_unstale":"2024-04-25T08:42:34.718353+0000","last_undegraded":"2024-04-25T08:42:34.718353+0000","last_fullsized":"2024-04-25T08:42:34.718353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:50.447473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718379+0000","last_change":"2024-04-25T08:42:28.687700+0000","last_active":"2024-04-25T08:42:34.718379+0000","last_peered":"2024-04-25T08:42:34.718379+0000","last_clean":"2024-04-25T08:42:34.718379+0000","last_became_active":"2024-04-25T08:42:28.687069+0000","last_became_peered":"2024-04-25T08:42:28.687069+0000","last_unstale":"2024-04-25T08:42:34.718379+0000","last_undegraded":"2024-04-25T08:42:34.718379+0000","last_fullsized":"2024-04-25T08:42:34.718379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718433+0000","last_change":"2024-04-25T08:42:27.666832+0000","last_active":"2024-04-25T08:42:34.718433+0000","last_peered":"2024-04-25T08:42:34.718433+0000","last_clean":"2024-04-25T08:42:34.718433+0000","last_became_active":"2024-04-25T08:42:27.666534+0000","last_became_peered":"2024-04-25T08:42:27.666534+0000","last_unstale":"2024-04-25T08:42:34.718433+0000","last_undegraded":"2024-04-25T08:42:34.718433+0000","last_fullsized":"2024-04-25T08:42:34.718433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720268+0000","last_change":"2024-04-25T08:42:32.774301+0000","last_active":"2024-04-25T08:42:34.720268+0000","last_peered":"2024-04-25T08:42:34.720268+0000","last_clean":"2024-04-25T08:42:34.720268+0000","last_became_active":"2024-04-25T08:42:32.773417+0000","last_became_peered":"2024-04-25T08:42:32.773417+0000","last_unstale":"2024-04-25T08:42:34.720268+0000","last_undegraded":"2024-04-25T08:42:34.720268+0000","last_fullsized":"2024-04-25T08:42:34.720268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:35.240827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341533+0000","last_change":"2024-04-25T08:42:28.691458+0000","last_active":"2024-04-25T08:42:34.341533+0000","last_peered":"2024-04-25T08:42:34.341533+0000","last_clean":"2024-04-25T08:42:34.341533+0000","last_became_active":"2024-04-25T08:42:28.691196+0000","last_became_peered":"2024-04-25T08:42:28.691196+0000","last_unstale":"2024-04-25T08:42:34.341533+0000","last_undegraded":"2024-04-25T08:42:34.341533+0000","last_fullsized":"2024-04-25T08:42:34.341533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717730+0000","last_change":"2024-04-25T08:42:27.667521+0000","last_active":"2024-04-25T08:42:33.717730+0000","last_peered":"2024-04-25T08:42:33.717730+0000","last_clean":"2024-04-25T08:42:33.717730+0000","last_became_active":"2024-04-25T08:42:27.666568+0000","last_became_peered":"2024-04-25T08:42:27.666568+0000","last_unstale":"2024-04-25T08:42:33.717730+0000","last_undegraded":"2024-04-25T08:42:33.717730+0000","last_fullsized":"2024-04-25T08:42:33.717730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719926+0000","last_change":"2024-04-25T08:42:32.773283+0000","last_active":"2024-04-25T08:42:34.719926+0000","last_peered":"2024-04-25T08:42:34.719926+0000","last_clean":"2024-04-25T08:42:34.719926+0000","last_became_active":"2024-04-25T08:42:32.772847+0000","last_became_peered":"2024-04-25T08:42:32.772847+0000","last_unstale":"2024-04-25T08:42:34.719926+0000","last_undegraded":"2024-04-25T08:42:34.719926+0000","last_fullsized":"2024-04-25T08:42:34.719926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718713+0000","last_change":"2024-04-25T08:42:28.682019+0000","last_active":"2024-04-25T08:42:34.718713+0000","last_peered":"2024-04-25T08:42:34.718713+0000","last_clean":"2024-04-25T08:42:34.718713+0000","last_became_active":"2024-04-25T08:42:28.681710+0000","last_became_peered":"2024-04-25T08:42:28.681710+0000","last_unstale":"2024-04-25T08:42:34.718713+0000","last_undegraded":"2024-04-25T08:42:34.718713+0000","last_fullsized":"2024-04-25T08:42:34.718713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:25.495879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718612+0000","last_change":"2024-04-25T08:42:27.662671+0000","last_active":"2024-04-25T08:42:34.718612+0000","last_peered":"2024-04-25T08:42:34.718612+0000","last_clean":"2024-04-25T08:42:34.718612+0000","last_became_active":"2024-04-25T08:42:27.662360+0000","last_became_peered":"2024-04-25T08:42:27.662360+0000","last_unstale":"2024-04-25T08:42:34.718612+0000","last_undegraded":"2024-04-25T08:42:34.718612+0000","last_fullsized":"2024-04-25T08:42:34.718612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:50.270810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718134+0000","last_change":"2024-04-25T08:42:32.775284+0000","last_active":"2024-04-25T08:42:33.718134+0000","last_peered":"2024-04-25T08:42:33.718134+0000","last_clean":"2024-04-25T08:42:33.718134+0000","last_became_active":"2024-04-25T08:42:32.774805+0000","last_became_peered":"2024-04-25T08:42:32.774805+0000","last_unstale":"2024-04-25T08:42:33.718134+0000","last_undegraded":"2024-04-25T08:42:33.718134+0000","last_fullsized":"2024-04-25T08:42:33.718134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:40.291706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341553+0000","last_change":"2024-04-25T08:42:28.687467+0000","last_active":"2024-04-25T08:42:34.341553+0000","last_peered":"2024-04-25T08:42:34.341553+0000","last_clean":"2024-04-25T08:42:34.341553+0000","last_became_active":"2024-04-25T08:42:28.687151+0000","last_became_peered":"2024-04-25T08:42:28.687151+0000","last_unstale":"2024-04-25T08:42:34.341553+0000","last_undegraded":"2024-04-25T08:42:34.341553+0000","last_fullsized":"2024-04-25T08:42:34.341553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:12.983651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:37.848489+0000","last_change":"2024-04-25T08:42:27.667309+0000","last_active":"2024-04-25T08:42:37.848489+0000","last_peered":"2024-04-25T08:42:37.848489+0000","last_clean":"2024-04-25T08:42:37.848489+0000","last_became_active":"2024-04-25T08:42:27.666995+0000","last_became_peered":"2024-04-25T08:42:27.666995+0000","last_unstale":"2024-04-25T08:42:37.848489+0000","last_undegraded":"2024-04-25T08:42:37.848489+0000","last_fullsized":"2024-04-25T08:42:37.848489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719544+0000","last_change":"2024-04-25T08:42:32.709153+0000","last_active":"2024-04-25T08:42:34.719544+0000","last_peered":"2024-04-25T08:42:34.719544+0000","last_clean":"2024-04-25T08:42:34.719544+0000","last_became_active":"2024-04-25T08:42:32.708767+0000","last_became_peered":"2024-04-25T08:42:32.708767+0000","last_unstale":"2024-04-25T08:42:34.719544+0000","last_undegraded":"2024-04-25T08:42:34.719544+0000","last_fullsized":"2024-04-25T08:42:34.719544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:07.122172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716905+0000","last_change":"2024-04-25T08:42:28.682383+0000","last_active":"2024-04-25T08:42:33.716905+0000","last_peered":"2024-04-25T08:42:33.716905+0000","last_clean":"2024-04-25T08:42:33.716905+0000","last_became_active":"2024-04-25T08:42:28.682089+0000","last_became_peered":"2024-04-25T08:42:28.682089+0000","last_unstale":"2024-04-25T08:42:33.716905+0000","last_undegraded":"2024-04-25T08:42:33.716905+0000","last_fullsized":"2024-04-25T08:42:33.716905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.349485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719476+0000","last_change":"2024-04-25T08:42:27.667264+0000","last_active":"2024-04-25T08:42:34.719476+0000","last_peered":"2024-04-25T08:42:34.719476+0000","last_clean":"2024-04-25T08:42:34.719476+0000","last_became_active":"2024-04-25T08:42:27.666961+0000","last_became_peered":"2024-04-25T08:42:27.666961+0000","last_unstale":"2024-04-25T08:42:34.719476+0000","last_undegraded":"2024-04-25T08:42:34.719476+0000","last_fullsized":"2024-04-25T08:42:34.719476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:11.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717197+0000","last_change":"2024-04-25T08:42:32.714944+0000","last_active":"2024-04-25T08:42:33.717197+0000","last_peered":"2024-04-25T08:42:33.717197+0000","last_clean":"2024-04-25T08:42:33.717197+0000","last_became_active":"2024-04-25T08:42:32.714532+0000","last_became_peered":"2024-04-25T08:42:32.714532+0000","last_unstale":"2024-04-25T08:42:33.717197+0000","last_undegraded":"2024-04-25T08:42:33.717197+0000","last_fullsized":"2024-04-25T08:42:33.717197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718384+0000","last_change":"2024-04-25T08:42:28.678248+0000","last_active":"2024-04-25T08:42:34.718384+0000","last_peered":"2024-04-25T08:42:34.718384+0000","last_clean":"2024-04-25T08:42:34.718384+0000","last_became_active":"2024-04-25T08:42:28.677444+0000","last_became_peered":"2024-04-25T08:42:28.677444+0000","last_unstale":"2024-04-25T08:42:34.718384+0000","last_undegraded":"2024-04-25T08:42:34.718384+0000","last_fullsized":"2024-04-25T08:42:34.718384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718054+0000","last_change":"2024-04-25T08:42:27.662208+0000","last_active":"2024-04-25T08:42:33.718054+0000","last_peered":"2024-04-25T08:42:33.718054+0000","last_clean":"2024-04-25T08:42:33.718054+0000","last_became_active":"2024-04-25T08:42:27.661833+0000","last_became_peered":"2024-04-25T08:42:27.661833+0000","last_unstale":"2024-04-25T08:42:33.718054+0000","last_undegraded":"2024-04-25T08:42:33.718054+0000","last_fullsized":"2024-04-25T08:42:33.718054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720748+0000","last_change":"2024-04-25T08:42:32.704429+0000","last_active":"2024-04-25T08:42:34.720748+0000","last_peered":"2024-04-25T08:42:34.720748+0000","last_clean":"2024-04-25T08:42:34.720748+0000","last_became_active":"2024-04-25T08:42:32.703936+0000","last_became_peered":"2024-04-25T08:42:32.703936+0000","last_unstale":"2024-04-25T08:42:34.720748+0000","last_undegraded":"2024-04-25T08:42:34.720748+0000","last_fullsized":"2024-04-25T08:42:34.720748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:27.086996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717935+0000","last_change":"2024-04-25T08:42:28.685516+0000","last_active":"2024-04-25T08:42:33.717935+0000","last_peered":"2024-04-25T08:42:33.717935+0000","last_clean":"2024-04-25T08:42:33.717935+0000","last_became_active":"2024-04-25T08:42:28.685250+0000","last_became_peered":"2024-04-25T08:42:28.685250+0000","last_unstale":"2024-04-25T08:42:33.717935+0000","last_undegraded":"2024-04-25T08:42:33.717935+0000","last_fullsized":"2024-04-25T08:42:33.717935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719154+0000","last_change":"2024-04-25T08:42:27.665950+0000","last_active":"2024-04-25T08:42:34.719154+0000","last_peered":"2024-04-25T08:42:34.719154+0000","last_clean":"2024-04-25T08:42:34.719154+0000","last_became_active":"2024-04-25T08:42:27.665624+0000","last_became_peered":"2024-04-25T08:42:27.665624+0000","last_unstale":"2024-04-25T08:42:34.719154+0000","last_undegraded":"2024-04-25T08:42:34.719154+0000","last_fullsized":"2024-04-25T08:42:34.719154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720002+0000","last_change":"2024-04-25T08:42:32.776610+0000","last_active":"2024-04-25T08:42:34.720002+0000","last_peered":"2024-04-25T08:42:34.720002+0000","last_clean":"2024-04-25T08:42:34.720002+0000","last_became_active":"2024-04-25T08:42:32.776245+0000","last_became_peered":"2024-04-25T08:42:32.776245+0000","last_unstale":"2024-04-25T08:42:34.720002+0000","last_undegraded":"2024-04-25T08:42:34.720002+0000","last_fullsized":"2024-04-25T08:42:34.720002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:40.291706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718182+0000","last_change":"2024-04-25T08:42:32.776744+0000","last_active":"2024-04-25T08:42:34.718182+0000","last_peered":"2024-04-25T08:42:34.718182+0000","last_clean":"2024-04-25T08:42:34.718182+0000","last_became_active":"2024-04-25T08:42:32.776378+0000","last_became_peered":"2024-04-25T08:42:32.776378+0000","last_unstale":"2024-04-25T08:42:34.718182+0000","last_undegraded":"2024-04-25T08:42:34.718182+0000","last_fullsized":"2024-04-25T08:42:34.718182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718145+0000","last_change":"2024-04-25T08:42:28.675393+0000","last_active":"2024-04-25T08:42:34.718145+0000","last_peered":"2024-04-25T08:42:34.718145+0000","last_clean":"2024-04-25T08:42:34.718145+0000","last_became_active":"2024-04-25T08:42:28.675124+0000","last_became_peered":"2024-04-25T08:42:28.675124+0000","last_unstale":"2024-04-25T08:42:34.718145+0000","last_undegraded":"2024-04-25T08:42:34.718145+0000","last_fullsized":"2024-04-25T08:42:34.718145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716296+0000","last_change":"2024-04-25T08:42:27.661033+0000","last_active":"2024-04-25T08:42:33.716296+0000","last_peered":"2024-04-25T08:42:33.716296+0000","last_clean":"2024-04-25T08:42:33.716296+0000","last_became_active":"2024-04-25T08:42:27.660770+0000","last_became_peered":"2024-04-25T08:42:27.660770+0000","last_unstale":"2024-04-25T08:42:33.716296+0000","last_undegraded":"2024-04-25T08:42:33.716296+0000","last_fullsized":"2024-04-25T08:42:33.716296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719178+0000","last_change":"2024-04-25T08:42:32.714933+0000","last_active":"2024-04-25T08:42:34.719178+0000","last_peered":"2024-04-25T08:42:34.719178+0000","last_clean":"2024-04-25T08:42:34.719178+0000","last_became_active":"2024-04-25T08:42:32.714432+0000","last_became_peered":"2024-04-25T08:42:32.714432+0000","last_unstale":"2024-04-25T08:42:34.719178+0000","last_undegraded":"2024-04-25T08:42:34.719178+0000","last_fullsized":"2024-04-25T08:42:34.719178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720792+0000","last_change":"2024-04-25T08:42:28.679501+0000","last_active":"2024-04-25T08:42:34.720792+0000","last_peered":"2024-04-25T08:42:34.720792+0000","last_clean":"2024-04-25T08:42:34.720792+0000","last_became_active":"2024-04-25T08:42:28.679169+0000","last_became_peered":"2024-04-25T08:42:28.679169+0000","last_unstale":"2024-04-25T08:42:34.720792+0000","last_undegraded":"2024-04-25T08:42:34.720792+0000","last_fullsized":"2024-04-25T08:42:34.720792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720301+0000","last_change":"2024-04-25T08:42:27.669642+0000","last_active":"2024-04-25T08:42:34.720301+0000","last_peered":"2024-04-25T08:42:34.720301+0000","last_clean":"2024-04-25T08:42:34.720301+0000","last_became_active":"2024-04-25T08:42:27.669219+0000","last_became_peered":"2024-04-25T08:42:27.669219+0000","last_unstale":"2024-04-25T08:42:34.720301+0000","last_undegraded":"2024-04-25T08:42:34.720301+0000","last_fullsized":"2024-04-25T08:42:34.720301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718695+0000","last_change":"2024-04-25T08:42:27.664507+0000","last_active":"2024-04-25T08:42:34.718695+0000","last_peered":"2024-04-25T08:42:34.718695+0000","last_clean":"2024-04-25T08:42:34.718695+0000","last_became_active":"2024-04-25T08:42:27.663781+0000","last_became_peered":"2024-04-25T08:42:27.663781+0000","last_unstale":"2024-04-25T08:42:34.718695+0000","last_undegraded":"2024-04-25T08:42:34.718695+0000","last_fullsized":"2024-04-25T08:42:34.718695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718519+0000","last_change":"2024-04-25T08:42:28.670559+0000","last_active":"2024-04-25T08:42:34.718519+0000","last_peered":"2024-04-25T08:42:34.718519+0000","last_clean":"2024-04-25T08:42:34.718519+0000","last_became_active":"2024-04-25T08:42:28.670258+0000","last_became_peered":"2024-04-25T08:42:28.670258+0000","last_unstale":"2024-04-25T08:42:34.718519+0000","last_undegraded":"2024-04-25T08:42:34.718519+0000","last_fullsized":"2024-04-25T08:42:34.718519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714478+0000","last_change":"2024-04-25T08:42:32.714660+0000","last_active":"2024-04-25T08:42:33.714478+0000","last_peered":"2024-04-25T08:42:33.714478+0000","last_clean":"2024-04-25T08:42:33.714478+0000","last_became_active":"2024-04-25T08:42:32.714182+0000","last_became_peered":"2024-04-25T08:42:32.714182+0000","last_unstale":"2024-04-25T08:42:33.714478+0000","last_undegraded":"2024-04-25T08:42:33.714478+0000","last_fullsized":"2024-04-25T08:42:33.714478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:21.015635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720625+0000","last_change":"2024-04-25T08:42:27.671542+0000","last_active":"2024-04-25T08:42:34.720625+0000","last_peered":"2024-04-25T08:42:34.720625+0000","last_clean":"2024-04-25T08:42:34.720625+0000","last_became_active":"2024-04-25T08:42:27.670640+0000","last_became_peered":"2024-04-25T08:42:27.670640+0000","last_unstale":"2024-04-25T08:42:34.720625+0000","last_undegraded":"2024-04-25T08:42:34.720625+0000","last_fullsized":"2024-04-25T08:42:34.720625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.411487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716383+0000","last_change":"2024-04-25T08:42:28.675535+0000","last_active":"2024-04-25T08:42:33.716383+0000","last_peered":"2024-04-25T08:42:33.716383+0000","last_clean":"2024-04-25T08:42:33.716383+0000","last_became_active":"2024-04-25T08:42:28.674786+0000","last_became_peered":"2024-04-25T08:42:28.674786+0000","last_unstale":"2024-04-25T08:42:33.716383+0000","last_undegraded":"2024-04-25T08:42:33.716383+0000","last_fullsized":"2024-04-25T08:42:33.716383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:19.055819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720001+0000","last_change":"2024-04-25T08:42:32.703253+0000","last_active":"2024-04-25T08:42:34.720001+0000","last_peered":"2024-04-25T08:42:34.720001+0000","last_clean":"2024-04-25T08:42:34.720001+0000","last_became_active":"2024-04-25T08:42:32.702862+0000","last_became_peered":"2024-04-25T08:42:32.702862+0000","last_unstale":"2024-04-25T08:42:34.720001+0000","last_undegraded":"2024-04-25T08:42:34.720001+0000","last_fullsized":"2024-04-25T08:42:34.720001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:46.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718238+0000","last_change":"2024-04-25T08:42:28.688424+0000","last_active":"2024-04-25T08:42:34.718238+0000","last_peered":"2024-04-25T08:42:34.718238+0000","last_clean":"2024-04-25T08:42:34.718238+0000","last_became_active":"2024-04-25T08:42:28.687428+0000","last_became_peered":"2024-04-25T08:42:28.687428+0000","last_unstale":"2024-04-25T08:42:34.718238+0000","last_undegraded":"2024-04-25T08:42:34.718238+0000","last_fullsized":"2024-04-25T08:42:34.718238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714119+0000","last_change":"2024-04-25T08:42:28.676656+0000","last_active":"2024-04-25T08:42:33.714119+0000","last_peered":"2024-04-25T08:42:33.714119+0000","last_clean":"2024-04-25T08:42:33.714119+0000","last_became_active":"2024-04-25T08:42:28.676373+0000","last_became_peered":"2024-04-25T08:42:28.676373+0000","last_unstale":"2024-04-25T08:42:33.714119+0000","last_undegraded":"2024-04-25T08:42:33.714119+0000","last_fullsized":"2024-04-25T08:42:33.714119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:12.180971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717556+0000","last_change":"2024-04-25T08:42:28.681762+0000","last_active":"2024-04-25T08:42:33.717556+0000","last_peered":"2024-04-25T08:42:33.717556+0000","last_clean":"2024-04-25T08:42:33.717556+0000","last_became_active":"2024-04-25T08:42:28.681291+0000","last_became_peered":"2024-04-25T08:42:28.681291+0000","last_unstale":"2024-04-25T08:42:33.717556+0000","last_undegraded":"2024-04-25T08:42:33.717556+0000","last_fullsized":"2024-04-25T08:42:33.717556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:54.440616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718428+0000","last_change":"2024-04-25T08:42:28.676467+0000","last_active":"2024-04-25T08:42:34.718428+0000","last_peered":"2024-04-25T08:42:34.718428+0000","last_clean":"2024-04-25T08:42:34.718428+0000","last_became_active":"2024-04-25T08:42:28.675914+0000","last_became_peered":"2024-04-25T08:42:28.675914+0000","last_unstale":"2024-04-25T08:42:34.718428+0000","last_undegraded":"2024-04-25T08:42:34.718428+0000","last_fullsized":"2024-04-25T08:42:34.718428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720100+0000","last_change":"2024-04-25T08:42:28.675440+0000","last_active":"2024-04-25T08:42:34.720100+0000","last_peered":"2024-04-25T08:42:34.720100+0000","last_clean":"2024-04-25T08:42:34.720100+0000","last_became_active":"2024-04-25T08:42:28.675157+0000","last_became_peered":"2024-04-25T08:42:28.675157+0000","last_unstale":"2024-04-25T08:42:34.720100+0000","last_undegraded":"2024-04-25T08:42:34.720100+0000","last_fullsized":"2024-04-25T08:42:34.720100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719294+0000","last_change":"2024-04-25T08:42:28.681482+0000","last_active":"2024-04-25T08:42:34.719294+0000","last_peered":"2024-04-25T08:42:34.719294+0000","last_clean":"2024-04-25T08:42:34.719294+0000","last_became_active":"2024-04-25T08:42:28.681211+0000","last_became_peered":"2024-04-25T08:42:28.681211+0000","last_unstale":"2024-04-25T08:42:34.719294+0000","last_undegraded":"2024-04-25T08:42:34.719294+0000","last_fullsized":"2024-04-25T08:42:34.719294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719200+0000","last_change":"2024-04-25T08:42:28.684774+0000","last_active":"2024-04-25T08:42:34.719200+0000","last_peered":"2024-04-25T08:42:34.719200+0000","last_clean":"2024-04-25T08:42:34.719200+0000","last_became_active":"2024-04-25T08:42:28.684502+0000","last_became_peered":"2024-04-25T08:42:28.684502+0000","last_unstale":"2024-04-25T08:42:34.719200+0000","last_undegraded":"2024-04-25T08:42:34.719200+0000","last_fullsized":"2024-04-25T08:42:34.719200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720334+0000","last_change":"2024-04-25T08:42:28.675478+0000","last_active":"2024-04-25T08:42:34.720334+0000","last_peered":"2024-04-25T08:42:34.720334+0000","last_clean":"2024-04-25T08:42:34.720334+0000","last_became_active":"2024-04-25T08:42:28.675191+0000","last_became_peered":"2024-04-25T08:42:28.675191+0000","last_unstale":"2024-04-25T08:42:34.720334+0000","last_undegraded":"2024-04-25T08:42:34.720334+0000","last_fullsized":"2024-04-25T08:42:34.720334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716297+0000","last_change":"2024-04-25T08:42:28.679789+0000","last_active":"2024-04-25T08:42:33.716297+0000","last_peered":"2024-04-25T08:42:33.716297+0000","last_clean":"2024-04-25T08:42:33.716297+0000","last_became_active":"2024-04-25T08:42:28.677404+0000","last_became_peered":"2024-04-25T08:42:28.677404+0000","last_unstale":"2024-04-25T08:42:33.716297+0000","last_undegraded":"2024-04-25T08:42:33.716297+0000","last_fullsized":"2024-04-25T08:42:33.716297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720113+0000","last_change":"2024-04-25T08:42:28.683643+0000","last_active":"2024-04-25T08:42:34.720113+0000","last_peered":"2024-04-25T08:42:34.720113+0000","last_clean":"2024-04-25T08:42:34.720113+0000","last_became_active":"2024-04-25T08:42:28.683205+0000","last_became_peered":"2024-04-25T08:42:28.683205+0000","last_unstale":"2024-04-25T08:42:34.720113+0000","last_undegraded":"2024-04-25T08:42:34.720113+0000","last_fullsized":"2024-04-25T08:42:34.720113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717551+0000","last_change":"2024-04-25T08:42:28.682157+0000","last_active":"2024-04-25T08:42:33.717551+0000","last_peered":"2024-04-25T08:42:33.717551+0000","last_clean":"2024-04-25T08:42:33.717551+0000","last_became_active":"2024-04-25T08:42:28.681910+0000","last_became_peered":"2024-04-25T08:42:28.681910+0000","last_unstale":"2024-04-25T08:42:33.717551+0000","last_undegraded":"2024-04-25T08:42:33.717551+0000","last_fullsized":"2024-04-25T08:42:33.717551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718189+0000","last_change":"2024-04-25T08:42:28.681636+0000","last_active":"2024-04-25T08:42:34.718189+0000","last_peered":"2024-04-25T08:42:34.718189+0000","last_clean":"2024-04-25T08:42:34.718189+0000","last_became_active":"2024-04-25T08:42:28.681243+0000","last_became_peered":"2024-04-25T08:42:28.681243+0000","last_unstale":"2024-04-25T08:42:34.718189+0000","last_undegraded":"2024-04-25T08:42:34.718189+0000","last_fullsized":"2024-04-25T08:42:34.718189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:22.224011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718681+0000","last_change":"2024-04-25T08:42:28.690347+0000","last_active":"2024-04-25T08:42:34.718681+0000","last_peered":"2024-04-25T08:42:34.718681+0000","last_clean":"2024-04-25T08:42:34.718681+0000","last_became_active":"2024-04-25T08:42:28.690062+0000","last_became_peered":"2024-04-25T08:42:28.690062+0000","last_unstale":"2024-04-25T08:42:34.718681+0000","last_undegraded":"2024-04-25T08:42:34.718681+0000","last_fullsized":"2024-04-25T08:42:34.718681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341807+0000","last_change":"2024-04-25T08:42:28.687419+0000","last_active":"2024-04-25T08:42:34.341807+0000","last_peered":"2024-04-25T08:42:34.341807+0000","last_clean":"2024-04-25T08:42:34.341807+0000","last_became_active":"2024-04-25T08:42:28.686800+0000","last_became_peered":"2024-04-25T08:42:28.686800+0000","last_unstale":"2024-04-25T08:42:34.341807+0000","last_undegraded":"2024-04-25T08:42:34.341807+0000","last_fullsized":"2024-04-25T08:42:34.341807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:54.440616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714411+0000","last_change":"2024-04-25T08:42:28.679139+0000","last_active":"2024-04-25T08:42:33.714411+0000","last_peered":"2024-04-25T08:42:33.714411+0000","last_clean":"2024-04-25T08:42:33.714411+0000","last_became_active":"2024-04-25T08:42:28.678803+0000","last_became_peered":"2024-04-25T08:42:28.678803+0000","last_unstale":"2024-04-25T08:42:33.714411+0000","last_undegraded":"2024-04-25T08:42:33.714411+0000","last_fullsized":"2024-04-25T08:42:33.714411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:08.632475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718400+0000","last_change":"2024-04-25T08:42:28.682788+0000","last_active":"2024-04-25T08:42:33.718400+0000","last_peered":"2024-04-25T08:42:33.718400+0000","last_clean":"2024-04-25T08:42:33.718400+0000","last_became_active":"2024-04-25T08:42:28.682532+0000","last_became_peered":"2024-04-25T08:42:28.682532+0000","last_unstale":"2024-04-25T08:42:33.718400+0000","last_undegraded":"2024-04-25T08:42:33.718400+0000","last_fullsized":"2024-04-25T08:42:33.718400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:12.983651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716185+0000","last_change":"2024-04-25T08:42:28.676138+0000","last_active":"2024-04-25T08:42:33.716185+0000","last_peered":"2024-04-25T08:42:33.716185+0000","last_clean":"2024-04-25T08:42:33.716185+0000","last_became_active":"2024-04-25T08:42:28.675765+0000","last_became_peered":"2024-04-25T08:42:28.675765+0000","last_unstale":"2024-04-25T08:42:33.716185+0000","last_undegraded":"2024-04-25T08:42:33.716185+0000","last_fullsized":"2024-04-25T08:42:33.716185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:31.845872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718240+0000","last_change":"2024-04-25T08:42:28.676274+0000","last_active":"2024-04-25T08:42:34.718240+0000","last_peered":"2024-04-25T08:42:34.718240+0000","last_clean":"2024-04-25T08:42:34.718240+0000","last_became_active":"2024-04-25T08:42:28.675935+0000","last_became_peered":"2024-04-25T08:42:28.675935+0000","last_unstale":"2024-04-25T08:42:34.718240+0000","last_undegraded":"2024-04-25T08:42:34.718240+0000","last_fullsized":"2024-04-25T08:42:34.718240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718466+0000","last_change":"2024-04-25T08:42:28.675277+0000","last_active":"2024-04-25T08:42:34.718466+0000","last_peered":"2024-04-25T08:42:34.718466+0000","last_clean":"2024-04-25T08:42:34.718466+0000","last_became_active":"2024-04-25T08:42:28.674998+0000","last_became_peered":"2024-04-25T08:42:28.674998+0000","last_unstale":"2024-04-25T08:42:34.718466+0000","last_undegraded":"2024-04-25T08:42:34.718466+0000","last_fullsized":"2024-04-25T08:42:34.718466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:25.796192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720546+0000","last_change":"2024-04-25T08:42:28.679479+0000","last_active":"2024-04-25T08:42:34.720546+0000","last_peered":"2024-04-25T08:42:34.720546+0000","last_clean":"2024-04-25T08:42:34.720546+0000","last_became_active":"2024-04-25T08:42:28.679202+0000","last_became_peered":"2024-04-25T08:42:28.679202+0000","last_unstale":"2024-04-25T08:42:34.720546+0000","last_undegraded":"2024-04-25T08:42:34.720546+0000","last_fullsized":"2024-04-25T08:42:34.720546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716781+0000","last_change":"2024-04-25T08:42:28.680700+0000","last_active":"2024-04-25T08:42:33.716781+0000","last_peered":"2024-04-25T08:42:33.716781+0000","last_clean":"2024-04-25T08:42:33.716781+0000","last_became_active":"2024-04-25T08:42:28.680363+0000","last_became_peered":"2024-04-25T08:42:28.680363+0000","last_unstale":"2024-04-25T08:42:33.716781+0000","last_undegraded":"2024-04-25T08:42:33.716781+0000","last_fullsized":"2024-04-25T08:42:33.716781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:12.180971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718922+0000","last_change":"2024-04-25T08:42:28.688063+0000","last_active":"2024-04-25T08:42:34.718922+0000","last_peered":"2024-04-25T08:42:34.718922+0000","last_clean":"2024-04-25T08:42:34.718922+0000","last_became_active":"2024-04-25T08:42:28.687786+0000","last_became_peered":"2024-04-25T08:42:28.687786+0000","last_unstale":"2024-04-25T08:42:34.718922+0000","last_undegraded":"2024-04-25T08:42:34.718922+0000","last_fullsized":"2024-04-25T08:42:34.718922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719162+0000","last_change":"2024-04-25T08:42:28.688118+0000","last_active":"2024-04-25T08:42:34.719162+0000","last_peered":"2024-04-25T08:42:34.719162+0000","last_clean":"2024-04-25T08:42:34.719162+0000","last_became_active":"2024-04-25T08:42:28.687841+0000","last_became_peered":"2024-04-25T08:42:28.687841+0000","last_unstale":"2024-04-25T08:42:34.719162+0000","last_undegraded":"2024-04-25T08:42:34.719162+0000","last_fullsized":"2024-04-25T08:42:34.719162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341962+0000","last_change":"2024-04-25T08:42:28.692587+0000","last_active":"2024-04-25T08:42:34.341962+0000","last_peered":"2024-04-25T08:42:34.341962+0000","last_clean":"2024-04-25T08:42:34.341962+0000","last_became_active":"2024-04-25T08:42:28.688599+0000","last_became_peered":"2024-04-25T08:42:28.688599+0000","last_unstale":"2024-04-25T08:42:34.341962+0000","last_undegraded":"2024-04-25T08:42:34.341962+0000","last_fullsized":"2024-04-25T08:42:34.341962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:03.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720561+0000","last_change":"2024-04-25T08:42:28.683857+0000","last_active":"2024-04-25T08:42:34.720561+0000","last_peered":"2024-04-25T08:42:34.720561+0000","last_clean":"2024-04-25T08:42:34.720561+0000","last_became_active":"2024-04-25T08:42:28.683465+0000","last_became_peered":"2024-04-25T08:42:28.683465+0000","last_unstale":"2024-04-25T08:42:34.720561+0000","last_undegraded":"2024-04-25T08:42:34.720561+0000","last_fullsized":"2024-04-25T08:42:34.720561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341299+0000","last_change":"2024-04-25T08:42:28.691863+0000","last_active":"2024-04-25T08:42:34.341299+0000","last_peered":"2024-04-25T08:42:34.341299+0000","last_clean":"2024-04-25T08:42:34.341299+0000","last_became_active":"2024-04-25T08:42:28.690583+0000","last_became_peered":"2024-04-25T08:42:28.690583+0000","last_unstale":"2024-04-25T08:42:34.341299+0000","last_undegraded":"2024-04-25T08:42:34.341299+0000","last_fullsized":"2024-04-25T08:42:34.341299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717427+0000","last_change":"2024-04-25T08:42:28.675349+0000","last_active":"2024-04-25T08:42:33.717427+0000","last_peered":"2024-04-25T08:42:33.717427+0000","last_clean":"2024-04-25T08:42:33.717427+0000","last_became_active":"2024-04-25T08:42:28.675000+0000","last_became_peered":"2024-04-25T08:42:28.675000+0000","last_unstale":"2024-04-25T08:42:33.717427+0000","last_undegraded":"2024-04-25T08:42:33.717427+0000","last_fullsized":"2024-04-25T08:42:33.717427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:55.477719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341365+0000","last_change":"2024-04-25T08:42:28.684750+0000","last_active":"2024-04-25T08:42:34.341365+0000","last_peered":"2024-04-25T08:42:34.341365+0000","last_clean":"2024-04-25T08:42:34.341365+0000","last_became_active":"2024-04-25T08:42:28.684463+0000","last_became_peered":"2024-04-25T08:42:28.684463+0000","last_unstale":"2024-04-25T08:42:34.341365+0000","last_undegraded":"2024-04-25T08:42:34.341365+0000","last_fullsized":"2024-04-25T08:42:34.341365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717827+0000","last_change":"2024-04-25T08:42:28.680160+0000","last_active":"2024-04-25T08:42:33.717827+0000","last_peered":"2024-04-25T08:42:33.717827+0000","last_clean":"2024-04-25T08:42:33.717827+0000","last_became_active":"2024-04-25T08:42:28.679868+0000","last_became_peered":"2024-04-25T08:42:28.679868+0000","last_unstale":"2024-04-25T08:42:33.717827+0000","last_undegraded":"2024-04-25T08:42:33.717827+0000","last_fullsized":"2024-04-25T08:42:33.717827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718100+0000","last_change":"2024-04-25T08:42:28.674768+0000","last_active":"2024-04-25T08:42:34.718100+0000","last_peered":"2024-04-25T08:42:34.718100+0000","last_clean":"2024-04-25T08:42:34.718100+0000","last_became_active":"2024-04-25T08:42:28.669240+0000","last_became_peered":"2024-04-25T08:42:28.669240+0000","last_unstale":"2024-04-25T08:42:34.718100+0000","last_undegraded":"2024-04-25T08:42:34.718100+0000","last_fullsized":"2024-04-25T08:42:34.718100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719515+0000","last_change":"2024-04-25T08:42:28.676190+0000","last_active":"2024-04-25T08:42:34.719515+0000","last_peered":"2024-04-25T08:42:34.719515+0000","last_clean":"2024-04-25T08:42:34.719515+0000","last_became_active":"2024-04-25T08:42:28.675895+0000","last_became_peered":"2024-04-25T08:42:28.675895+0000","last_unstale":"2024-04-25T08:42:34.719515+0000","last_undegraded":"2024-04-25T08:42:34.719515+0000","last_fullsized":"2024-04-25T08:42:34.719515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341862+0000","last_change":"2024-04-25T08:42:28.686275+0000","last_active":"2024-04-25T08:42:34.341862+0000","last_peered":"2024-04-25T08:42:34.341862+0000","last_clean":"2024-04-25T08:42:34.341862+0000","last_became_active":"2024-04-25T08:42:28.686029+0000","last_became_peered":"2024-04-25T08:42:28.686029+0000","last_unstale":"2024-04-25T08:42:34.341862+0000","last_undegraded":"2024-04-25T08:42:34.341862+0000","last_fullsized":"2024-04-25T08:42:34.341862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:55.477719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:42:50.692 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:42:50.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.833+0000 7fd543eb6640 1 Processor -- start 2024-04-25T08:42:50.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.833+0000 7fd543eb6640 1 -- start start 2024-04-25T08:42:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd543eb6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd53c15dc00 0x7fd53c0c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd543eb6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd53c0ceb20 0x7fd53c0d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd543eb6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd53c0d1c00 0x7fd53c0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd543eb6640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0d2060 con 0x7fd53c15dc00 2024-04-25T08:42:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd543eb6640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c15dfe0 con 0x7fd53c0d1c00 2024-04-25T08:42:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd543eb6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0d00c0 con 0x7fd53c0ceb20 2024-04-25T08:42:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd541c52640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd53c15dc00 0x7fd53c0c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd541c52640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd53c15dc00 0x7fd53c0c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50380/0 (socket says 172.21.15.172:50380) 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd541c52640 1 -- 172.21.15.172:0/3497929574 learned_addr learned my addr 172.21.15.172:0/3497929574 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd542453640 1 --2- 172.21.15.172:0/3497929574 >> v2:172.21.15.186:3300/0 conn(0x7fd53c0d1c00 0x7fd53c0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd541451640 1 --2- 172.21.15.172:0/3497929574 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd53c0ceb20 0x7fd53c0d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd541c52640 1 -- 172.21.15.172:0/3497929574 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd53c0ceb20 msgr2=0x7fd53c0d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd541c52640 1 --2- 172.21.15.172:0/3497929574 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd53c0ceb20 0x7fd53c0d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd541c52640 1 -- 172.21.15.172:0/3497929574 >> v2:172.21.15.186:3300/0 conn(0x7fd53c0d1c00 msgr2=0x7fd53c0ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd541c52640 1 --2- 172.21.15.172:0/3497929574 >> v2:172.21.15.186:3300/0 conn(0x7fd53c0d1c00 0x7fd53c0ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.834+0000 7fd541c52640 1 -- 172.21.15.172:0/3497929574 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0d03a0 con 0x7fd53c15dc00 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.835+0000 7fd541c52640 1 --2- 172.21.15.172:0/3497929574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c15dc00 0x7fd53c0c6df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd53c06b890 tx=0x7fd53802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70baa0ae162d382c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.835+0000 7fd540c50640 1 -- 172.21.15.172:0/3497929574 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538037070 con 0x7fd53c15dc00 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.835+0000 7fd540c50640 1 -- 172.21.15.172:0/3497929574 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd538032440 con 0x7fd53c15dc00 2024-04-25T08:42:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.835+0000 7fd540c50640 1 -- 172.21.15.172:0/3497929574 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538032810 con 0x7fd53c15dc00 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.835+0000 7fd543eb6640 1 -- 172.21.15.172:0/3497929574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c15dc00 msgr2=0x7fd53c0c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.835+0000 7fd543eb6640 1 --2- 172.21.15.172:0/3497929574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c15dc00 0x7fd53c0c6df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd53c06b890 tx=0x7fd53802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.835+0000 7fd543eb6640 1 -- 172.21.15.172:0/3497929574 shutdown_connections 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.835+0000 7fd543eb6640 1 --2- 172.21.15.172:0/3497929574 >> v2:172.21.15.186:3300/0 conn(0x7fd53c0d1c00 0x7fd53c0ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.836+0000 7fd543eb6640 1 --2- 172.21.15.172:0/3497929574 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd53c0ceb20 0x7fd53c0d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.836+0000 7fd543eb6640 1 --2- 172.21.15.172:0/3497929574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c15dc00 0x7fd53c0c6df0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.836+0000 7fd543eb6640 1 -- 172.21.15.172:0/3497929574 >> 172.21.15.172:0/3497929574 conn(0x7fd53c06f5d0 msgr2=0x7fd53c06f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.836+0000 7fd543eb6640 1 -- 172.21.15.172:0/3497929574 shutdown_connections 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.836+0000 7fd543eb6640 1 -- 172.21.15.172:0/3497929574 wait complete. 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.837+0000 7fd543eb6640 1 Processor -- start 2024-04-25T08:42:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.837+0000 7fd543eb6640 1 -- start start 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.837+0000 7fd543eb6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd53c0ceb20 0x7fd53c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.837+0000 7fd543eb6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c0d1c00 0x7fd53c1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.837+0000 7fd543eb6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd53c15dc00 0x7fd53c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.837+0000 7fd543eb6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0cc130 con 0x7fd53c0d1c00 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.837+0000 7fd543eb6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0cc720 con 0x7fd53c15dc00 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.837+0000 7fd543eb6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0cfd90 con 0x7fd53c0ceb20 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.837+0000 7fd541451640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c0d1c00 0x7fd53c1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd541451640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c0d1c00 0x7fd53c1589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50388/0 (socket says 172.21.15.172:50388) 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd541451640 1 -- 172.21.15.172:0/524358367 learned_addr learned my addr 172.21.15.172:0/524358367 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd541c52640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd53c0ceb20 0x7fd53c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd542453640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd53c15dc00 0x7fd53c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd541451640 1 -- 172.21.15.172:0/524358367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd53c0ceb20 msgr2=0x7fd53c158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd541451640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd53c0ceb20 0x7fd53c158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd541451640 1 -- 172.21.15.172:0/524358367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd53c15dc00 msgr2=0x7fd53c0b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd541451640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd53c15dc00 0x7fd53c0b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd541451640 1 -- 172.21.15.172:0/524358367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c15a490 con 0x7fd53c0d1c00 2024-04-25T08:42:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd541451640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c0d1c00 0x7fd53c1589a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00d800 tx=0x7fd52c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd5327fc640 1 -- 172.21.15.172:0/524358367 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c018020 con 0x7fd53c0d1c00 2024-04-25T08:42:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd5327fc640 1 -- 172.21.15.172:0/524358367 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c0096a0 con 0x7fd53c0d1c00 2024-04-25T08:42:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd543eb6640 1 -- 172.21.15.172:0/524358367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c15a770 con 0x7fd53c0d1c00 2024-04-25T08:42:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd5327fc640 1 -- 172.21.15.172:0/524358367 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c009a70 con 0x7fd53c0d1c00 2024-04-25T08:42:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.838+0000 7fd543eb6640 1 -- 172.21.15.172:0/524358367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c15e410 con 0x7fd53c0d1c00 2024-04-25T08:42:50.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.839+0000 7fd543eb6640 1 -- 172.21.15.172:0/524358367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c0b7a40 con 0x7fd53c0d1c00 2024-04-25T08:42:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.839+0000 7fd5327fc640 1 -- 172.21.15.172:0/524358367 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd52c01b020 con 0x7fd53c0d1c00 2024-04-25T08:42:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.840+0000 7fd5327fc640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd52006b500 0x7fd52006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.840+0000 7fd5327fc640 1 -- 172.21.15.172:0/524358367 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd52c08a560 con 0x7fd53c0d1c00 2024-04-25T08:42:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.840+0000 7fd541c52640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd52006b500 0x7fd52006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.840+0000 7fd541c52640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd52006b500 0x7fd52006d9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd538034000 tx=0x7fd53802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:50.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:50.844+0000 7fd5327fc640 1 -- 172.21.15.172:0/524358367 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd53c0b7a40 con 0x7fd53c0d1c00 2024-04-25T08:42:51.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.012+0000 7fd543eb6640 1 -- 172.21.15.172:0/524358367 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd53c073990 con 0x7fd52006b500 2024-04-25T08:42:51.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.020+0000 7fd5327fc640 1 -- 172.21.15.172:0/524358367 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7fd53c073990 con 0x7fd52006b500 2024-04-25T08:42:51.015 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:51.017 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:42:51.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 -- 172.21.15.172:0/524358367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd52006b500 msgr2=0x7fd52006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd52006b500 0x7fd52006d9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd538034000 tx=0x7fd53802e000 comp rx=0 tx=0).stop 2024-04-25T08:42:51.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 -- 172.21.15.172:0/524358367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c0d1c00 msgr2=0x7fd53c1589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c0d1c00 0x7fd53c1589a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00d800 tx=0x7fd52c00dcc0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 -- 172.21.15.172:0/524358367 shutdown_connections 2024-04-25T08:42:51.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd52006b500 0x7fd52006d9c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd53c15dc00 0x7fd53c0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd53c0d1c00 0x7fd53c1589a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 --2- 172.21.15.172:0/524358367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd53c0ceb20 0x7fd53c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 -- 172.21.15.172:0/524358367 >> 172.21.15.172:0/524358367 conn(0x7fd53c06f5d0 msgr2=0x7fd53c0b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:51.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 -- 172.21.15.172:0/524358367 shutdown_connections 2024-04-25T08:42:51.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.023+0000 7fd543eb6640 1 -- 172.21.15.172:0/524358367 wait complete. 2024-04-25T08:42:51.026 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T08:42:50.517185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002963"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718621+0000","last_change":"2024-04-25T08:42:27.663913+0000","last_active":"2024-04-25T08:42:34.718621+0000","last_peered":"2024-04-25T08:42:34.718621+0000","last_clean":"2024-04-25T08:42:34.718621+0000","last_became_active":"2024-04-25T08:42:27.663206+0000","last_became_peered":"2024-04-25T08:42:27.663206+0000","last_unstale":"2024-04-25T08:42:34.718621+0000","last_undegraded":"2024-04-25T08:42:34.718621+0000","last_fullsized":"2024-04-25T08:42:34.718621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:08.095908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720030+0000","last_change":"2024-04-25T08:42:28.679929+0000","last_active":"2024-04-25T08:42:34.720030+0000","last_peered":"2024-04-25T08:42:34.720030+0000","last_clean":"2024-04-25T08:42:34.720030+0000","last_became_active":"2024-04-25T08:42:28.679533+0000","last_became_peered":"2024-04-25T08:42:28.679533+0000","last_unstale":"2024-04-25T08:42:34.720030+0000","last_undegraded":"2024-04-25T08:42:34.720030+0000","last_fullsized":"2024-04-25T08:42:34.720030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719823+0000","last_change":"2024-04-25T08:42:32.775785+0000","last_active":"2024-04-25T08:42:34.719823+0000","last_peered":"2024-04-25T08:42:34.719823+0000","last_clean":"2024-04-25T08:42:34.719823+0000","last_became_active":"2024-04-25T08:42:32.775418+0000","last_became_peered":"2024-04-25T08:42:32.775418+0000","last_unstale":"2024-04-25T08:42:34.719823+0000","last_undegraded":"2024-04-25T08:42:34.719823+0000","last_fullsized":"2024-04-25T08:42:34.719823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:16.973550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720238+0000","last_change":"2024-04-25T08:42:27.669510+0000","last_active":"2024-04-25T08:42:34.720238+0000","last_peered":"2024-04-25T08:42:34.720238+0000","last_clean":"2024-04-25T08:42:34.720238+0000","last_became_active":"2024-04-25T08:42:27.669194+0000","last_became_peered":"2024-04-25T08:42:27.669194+0000","last_unstale":"2024-04-25T08:42:34.720238+0000","last_undegraded":"2024-04-25T08:42:34.720238+0000","last_fullsized":"2024-04-25T08:42:34.720238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:43.313642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718181+0000","last_change":"2024-04-25T08:42:28.678584+0000","last_active":"2024-04-25T08:42:34.718181+0000","last_peered":"2024-04-25T08:42:34.718181+0000","last_clean":"2024-04-25T08:42:34.718181+0000","last_became_active":"2024-04-25T08:42:28.677636+0000","last_became_peered":"2024-04-25T08:42:28.677636+0000","last_unstale":"2024-04-25T08:42:34.718181+0000","last_undegraded":"2024-04-25T08:42:34.718181+0000","last_fullsized":"2024-04-25T08:42:34.718181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716151+0000","last_change":"2024-04-25T08:42:32.710347+0000","last_active":"2024-04-25T08:42:33.716151+0000","last_peered":"2024-04-25T08:42:33.716151+0000","last_clean":"2024-04-25T08:42:33.716151+0000","last_became_active":"2024-04-25T08:42:32.709855+0000","last_became_peered":"2024-04-25T08:42:32.709855+0000","last_unstale":"2024-04-25T08:42:33.716151+0000","last_undegraded":"2024-04-25T08:42:33.716151+0000","last_fullsized":"2024-04-25T08:42:33.716151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:17.497098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341696+0000","last_change":"2024-04-25T08:42:27.667761+0000","last_active":"2024-04-25T08:42:34.341696+0000","last_peered":"2024-04-25T08:42:34.341696+0000","last_clean":"2024-04-25T08:42:34.341696+0000","last_became_active":"2024-04-25T08:42:27.667504+0000","last_became_peered":"2024-04-25T08:42:27.667504+0000","last_unstale":"2024-04-25T08:42:34.341696+0000","last_undegraded":"2024-04-25T08:42:34.341696+0000","last_fullsized":"2024-04-25T08:42:34.341696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:11.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717960+0000","last_change":"2024-04-25T08:42:28.679617+0000","last_active":"2024-04-25T08:42:33.717960+0000","last_peered":"2024-04-25T08:42:33.717960+0000","last_clean":"2024-04-25T08:42:33.717960+0000","last_became_active":"2024-04-25T08:42:28.677547+0000","last_became_peered":"2024-04-25T08:42:28.677547+0000","last_unstale":"2024-04-25T08:42:33.717960+0000","last_undegraded":"2024-04-25T08:42:33.717960+0000","last_fullsized":"2024-04-25T08:42:33.717960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716871+0000","last_change":"2024-04-25T08:42:32.715254+0000","last_active":"2024-04-25T08:42:33.716871+0000","last_peered":"2024-04-25T08:42:33.716871+0000","last_clean":"2024-04-25T08:42:33.716871+0000","last_became_active":"2024-04-25T08:42:32.714553+0000","last_became_peered":"2024-04-25T08:42:32.714553+0000","last_unstale":"2024-04-25T08:42:33.716871+0000","last_undegraded":"2024-04-25T08:42:33.716871+0000","last_fullsized":"2024-04-25T08:42:33.716871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:02.361047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341492+0000","last_change":"2024-04-25T08:42:27.669362+0000","last_active":"2024-04-25T08:42:34.341492+0000","last_peered":"2024-04-25T08:42:34.341492+0000","last_clean":"2024-04-25T08:42:34.341492+0000","last_became_active":"2024-04-25T08:42:27.669047+0000","last_became_peered":"2024-04-25T08:42:27.669047+0000","last_unstale":"2024-04-25T08:42:34.341492+0000","last_undegraded":"2024-04-25T08:42:34.341492+0000","last_fullsized":"2024-04-25T08:42:34.341492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:24.034481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718067+0000","last_change":"2024-04-25T08:42:28.676280+0000","last_active":"2024-04-25T08:42:33.718067+0000","last_peered":"2024-04-25T08:42:33.718067+0000","last_clean":"2024-04-25T08:42:33.718067+0000","last_became_active":"2024-04-25T08:42:28.676008+0000","last_became_peered":"2024-04-25T08:42:28.676008+0000","last_unstale":"2024-04-25T08:42:33.718067+0000","last_undegraded":"2024-04-25T08:42:33.718067+0000","last_fullsized":"2024-04-25T08:42:33.718067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716251+0000","last_change":"2024-04-25T08:42:32.702185+0000","last_active":"2024-04-25T08:42:33.716251+0000","last_peered":"2024-04-25T08:42:33.716251+0000","last_clean":"2024-04-25T08:42:33.716251+0000","last_became_active":"2024-04-25T08:42:32.701758+0000","last_became_peered":"2024-04-25T08:42:32.701758+0000","last_unstale":"2024-04-25T08:42:33.716251+0000","last_undegraded":"2024-04-25T08:42:33.716251+0000","last_fullsized":"2024-04-25T08:42:33.716251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:49.319348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718505+0000","last_change":"2024-04-25T08:42:28.687237+0000","last_active":"2024-04-25T08:42:34.718505+0000","last_peered":"2024-04-25T08:42:34.718505+0000","last_clean":"2024-04-25T08:42:34.718505+0000","last_became_active":"2024-04-25T08:42:28.686009+0000","last_became_peered":"2024-04-25T08:42:28.686009+0000","last_unstale":"2024-04-25T08:42:34.718505+0000","last_undegraded":"2024-04-25T08:42:34.718505+0000","last_fullsized":"2024-04-25T08:42:34.718505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341503+0000","last_change":"2024-04-25T08:42:27.666906+0000","last_active":"2024-04-25T08:42:34.341503+0000","last_peered":"2024-04-25T08:42:34.341503+0000","last_clean":"2024-04-25T08:42:34.341503+0000","last_became_active":"2024-04-25T08:42:27.666643+0000","last_became_peered":"2024-04-25T08:42:27.666643+0000","last_unstale":"2024-04-25T08:42:34.341503+0000","last_undegraded":"2024-04-25T08:42:34.341503+0000","last_fullsized":"2024-04-25T08:42:34.341503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716980+0000","last_change":"2024-04-25T08:42:32.711169+0000","last_active":"2024-04-25T08:42:33.716980+0000","last_peered":"2024-04-25T08:42:33.716980+0000","last_clean":"2024-04-25T08:42:33.716980+0000","last_became_active":"2024-04-25T08:42:32.710192+0000","last_became_peered":"2024-04-25T08:42:32.710192+0000","last_unstale":"2024-04-25T08:42:33.716980+0000","last_undegraded":"2024-04-25T08:42:33.716980+0000","last_fullsized":"2024-04-25T08:42:33.716980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:41.910425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720554+0000","last_change":"2024-04-25T08:42:28.672389+0000","last_active":"2024-04-25T08:42:34.720554+0000","last_peered":"2024-04-25T08:42:34.720554+0000","last_clean":"2024-04-25T08:42:34.720554+0000","last_became_active":"2024-04-25T08:42:28.672116+0000","last_became_peered":"2024-04-25T08:42:28.672116+0000","last_unstale":"2024-04-25T08:42:34.720554+0000","last_undegraded":"2024-04-25T08:42:34.720554+0000","last_fullsized":"2024-04-25T08:42:34.720554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719572+0000","last_change":"2024-04-25T08:42:27.669517+0000","last_active":"2024-04-25T08:42:34.719572+0000","last_peered":"2024-04-25T08:42:34.719572+0000","last_clean":"2024-04-25T08:42:34.719572+0000","last_became_active":"2024-04-25T08:42:27.669240+0000","last_became_peered":"2024-04-25T08:42:27.669240+0000","last_unstale":"2024-04-25T08:42:34.719572+0000","last_undegraded":"2024-04-25T08:42:34.719572+0000","last_fullsized":"2024-04-25T08:42:34.719572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717062+0000","last_change":"2024-04-25T08:42:32.710857+0000","last_active":"2024-04-25T08:42:33.717062+0000","last_peered":"2024-04-25T08:42:33.717062+0000","last_clean":"2024-04-25T08:42:33.717062+0000","last_became_active":"2024-04-25T08:42:32.709737+0000","last_became_peered":"2024-04-25T08:42:32.709737+0000","last_unstale":"2024-04-25T08:42:33.717062+0000","last_undegraded":"2024-04-25T08:42:33.717062+0000","last_fullsized":"2024-04-25T08:42:33.717062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:48.222965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720874+0000","last_change":"2024-04-25T08:42:28.672212+0000","last_active":"2024-04-25T08:42:34.720874+0000","last_peered":"2024-04-25T08:42:34.720874+0000","last_clean":"2024-04-25T08:42:34.720874+0000","last_became_active":"2024-04-25T08:42:28.671893+0000","last_became_peered":"2024-04-25T08:42:28.671893+0000","last_unstale":"2024-04-25T08:42:34.720874+0000","last_undegraded":"2024-04-25T08:42:34.720874+0000","last_fullsized":"2024-04-25T08:42:34.720874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718326+0000","last_change":"2024-04-25T08:42:27.662789+0000","last_active":"2024-04-25T08:42:34.718326+0000","last_peered":"2024-04-25T08:42:34.718326+0000","last_clean":"2024-04-25T08:42:34.718326+0000","last_became_active":"2024-04-25T08:42:27.662490+0000","last_became_peered":"2024-04-25T08:42:27.662490+0000","last_unstale":"2024-04-25T08:42:34.718326+0000","last_undegraded":"2024-04-25T08:42:34.718326+0000","last_fullsized":"2024-04-25T08:42:34.718326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719021+0000","last_change":"2024-04-25T08:42:32.773797+0000","last_active":"2024-04-25T08:42:34.719021+0000","last_peered":"2024-04-25T08:42:34.719021+0000","last_clean":"2024-04-25T08:42:34.719021+0000","last_became_active":"2024-04-25T08:42:32.772850+0000","last_became_peered":"2024-04-25T08:42:32.772850+0000","last_unstale":"2024-04-25T08:42:34.719021+0000","last_undegraded":"2024-04-25T08:42:34.719021+0000","last_fullsized":"2024-04-25T08:42:34.719021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716595+0000","last_change":"2024-04-25T08:42:28.670256+0000","last_active":"2024-04-25T08:42:33.716595+0000","last_peered":"2024-04-25T08:42:33.716595+0000","last_clean":"2024-04-25T08:42:33.716595+0000","last_became_active":"2024-04-25T08:42:28.669544+0000","last_became_peered":"2024-04-25T08:42:28.669544+0000","last_unstale":"2024-04-25T08:42:33.716595+0000","last_undegraded":"2024-04-25T08:42:33.716595+0000","last_fullsized":"2024-04-25T08:42:33.716595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:56.767579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341156+0000","last_change":"2024-04-25T08:42:27.666339+0000","last_active":"2024-04-25T08:42:34.341156+0000","last_peered":"2024-04-25T08:42:34.341156+0000","last_clean":"2024-04-25T08:42:34.341156+0000","last_became_active":"2024-04-25T08:42:27.665968+0000","last_became_peered":"2024-04-25T08:42:27.665968+0000","last_unstale":"2024-04-25T08:42:34.341156+0000","last_undegraded":"2024-04-25T08:42:34.341156+0000","last_fullsized":"2024-04-25T08:42:34.341156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716958+0000","last_change":"2024-04-25T08:42:32.716309+0000","last_active":"2024-04-25T08:42:33.716958+0000","last_peered":"2024-04-25T08:42:33.716958+0000","last_clean":"2024-04-25T08:42:33.716958+0000","last_became_active":"2024-04-25T08:42:32.715869+0000","last_became_peered":"2024-04-25T08:42:32.715869+0000","last_unstale":"2024-04-25T08:42:33.716958+0000","last_undegraded":"2024-04-25T08:42:33.716958+0000","last_fullsized":"2024-04-25T08:42:33.716958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:42.194257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718628+0000","last_change":"2024-04-25T08:42:28.671623+0000","last_active":"2024-04-25T08:42:34.718628+0000","last_peered":"2024-04-25T08:42:34.718628+0000","last_clean":"2024-04-25T08:42:34.718628+0000","last_became_active":"2024-04-25T08:42:28.671330+0000","last_became_peered":"2024-04-25T08:42:28.671330+0000","last_unstale":"2024-04-25T08:42:34.718628+0000","last_undegraded":"2024-04-25T08:42:34.718628+0000","last_fullsized":"2024-04-25T08:42:34.718628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719273+0000","last_change":"2024-04-25T08:42:27.662946+0000","last_active":"2024-04-25T08:42:34.719273+0000","last_peered":"2024-04-25T08:42:34.719273+0000","last_clean":"2024-04-25T08:42:34.719273+0000","last_became_active":"2024-04-25T08:42:27.662661+0000","last_became_peered":"2024-04-25T08:42:27.662661+0000","last_unstale":"2024-04-25T08:42:34.719273+0000","last_undegraded":"2024-04-25T08:42:34.719273+0000","last_fullsized":"2024-04-25T08:42:34.719273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716252+0000","last_change":"2024-04-25T08:42:32.773209+0000","last_active":"2024-04-25T08:42:33.716252+0000","last_peered":"2024-04-25T08:42:33.716252+0000","last_clean":"2024-04-25T08:42:33.716252+0000","last_became_active":"2024-04-25T08:42:32.772788+0000","last_became_peered":"2024-04-25T08:42:32.772788+0000","last_unstale":"2024-04-25T08:42:33.716252+0000","last_undegraded":"2024-04-25T08:42:33.716252+0000","last_fullsized":"2024-04-25T08:42:33.716252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:59.766748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720324+0000","last_change":"2024-04-25T08:42:28.681466+0000","last_active":"2024-04-25T08:42:34.720324+0000","last_peered":"2024-04-25T08:42:34.720324+0000","last_clean":"2024-04-25T08:42:34.720324+0000","last_became_active":"2024-04-25T08:42:28.681184+0000","last_became_peered":"2024-04-25T08:42:28.681184+0000","last_unstale":"2024-04-25T08:42:34.720324+0000","last_undegraded":"2024-04-25T08:42:34.720324+0000","last_fullsized":"2024-04-25T08:42:34.720324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719545+0000","last_change":"2024-04-25T08:42:27.663837+0000","last_active":"2024-04-25T08:42:34.719545+0000","last_peered":"2024-04-25T08:42:34.719545+0000","last_clean":"2024-04-25T08:42:34.719545+0000","last_became_active":"2024-04-25T08:42:27.663542+0000","last_became_peered":"2024-04-25T08:42:27.663542+0000","last_unstale":"2024-04-25T08:42:34.719545+0000","last_undegraded":"2024-04-25T08:42:34.719545+0000","last_fullsized":"2024-04-25T08:42:34.719545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720453+0000","last_change":"2024-04-25T08:42:32.773738+0000","last_active":"2024-04-25T08:42:34.720453+0000","last_peered":"2024-04-25T08:42:34.720453+0000","last_clean":"2024-04-25T08:42:34.720453+0000","last_became_active":"2024-04-25T08:42:32.773337+0000","last_became_peered":"2024-04-25T08:42:32.773337+0000","last_unstale":"2024-04-25T08:42:34.720453+0000","last_undegraded":"2024-04-25T08:42:34.720453+0000","last_fullsized":"2024-04-25T08:42:34.720453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:24.829343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719414+0000","last_change":"2024-04-25T08:42:28.672285+0000","last_active":"2024-04-25T08:42:34.719414+0000","last_peered":"2024-04-25T08:42:34.719414+0000","last_clean":"2024-04-25T08:42:34.719414+0000","last_became_active":"2024-04-25T08:42:28.672041+0000","last_became_peered":"2024-04-25T08:42:28.672041+0000","last_unstale":"2024-04-25T08:42:34.719414+0000","last_undegraded":"2024-04-25T08:42:34.719414+0000","last_fullsized":"2024-04-25T08:42:34.719414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341853+0000","last_change":"2024-04-25T08:42:27.665607+0000","last_active":"2024-04-25T08:42:34.341853+0000","last_peered":"2024-04-25T08:42:34.341853+0000","last_clean":"2024-04-25T08:42:34.341853+0000","last_became_active":"2024-04-25T08:42:27.664407+0000","last_became_peered":"2024-04-25T08:42:27.664407+0000","last_unstale":"2024-04-25T08:42:34.341853+0000","last_undegraded":"2024-04-25T08:42:34.341853+0000","last_fullsized":"2024-04-25T08:42:34.341853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.628103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718135+0000","last_change":"2024-04-25T08:42:32.773268+0000","last_active":"2024-04-25T08:42:34.718135+0000","last_peered":"2024-04-25T08:42:34.718135+0000","last_clean":"2024-04-25T08:42:34.718135+0000","last_became_active":"2024-04-25T08:42:32.772863+0000","last_became_peered":"2024-04-25T08:42:32.772863+0000","last_unstale":"2024-04-25T08:42:34.718135+0000","last_undegraded":"2024-04-25T08:42:34.718135+0000","last_fullsized":"2024-04-25T08:42:34.718135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718190+0000","last_change":"2024-04-25T08:42:28.680636+0000","last_active":"2024-04-25T08:42:33.718190+0000","last_peered":"2024-04-25T08:42:33.718190+0000","last_clean":"2024-04-25T08:42:33.718190+0000","last_became_active":"2024-04-25T08:42:28.680378+0000","last_became_peered":"2024-04-25T08:42:28.680378+0000","last_unstale":"2024-04-25T08:42:33.718190+0000","last_undegraded":"2024-04-25T08:42:33.718190+0000","last_fullsized":"2024-04-25T08:42:33.718190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719445+0000","last_change":"2024-04-25T08:42:27.659419+0000","last_active":"2024-04-25T08:42:34.719445+0000","last_peered":"2024-04-25T08:42:34.719445+0000","last_clean":"2024-04-25T08:42:34.719445+0000","last_became_active":"2024-04-25T08:42:27.657839+0000","last_became_peered":"2024-04-25T08:42:27.657839+0000","last_unstale":"2024-04-25T08:42:34.719445+0000","last_undegraded":"2024-04-25T08:42:34.719445+0000","last_fullsized":"2024-04-25T08:42:34.719445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719161+0000","last_change":"2024-04-25T08:42:32.711534+0000","last_active":"2024-04-25T08:42:34.719161+0000","last_peered":"2024-04-25T08:42:34.719161+0000","last_clean":"2024-04-25T08:42:34.719161+0000","last_became_active":"2024-04-25T08:42:32.709615+0000","last_became_peered":"2024-04-25T08:42:32.709615+0000","last_unstale":"2024-04-25T08:42:34.719161+0000","last_undegraded":"2024-04-25T08:42:34.719161+0000","last_fullsized":"2024-04-25T08:42:34.719161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:50.447473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717233+0000","last_change":"2024-04-25T08:42:28.675371+0000","last_active":"2024-04-25T08:42:33.717233+0000","last_peered":"2024-04-25T08:42:33.717233+0000","last_clean":"2024-04-25T08:42:33.717233+0000","last_became_active":"2024-04-25T08:42:28.675078+0000","last_became_peered":"2024-04-25T08:42:28.675078+0000","last_unstale":"2024-04-25T08:42:33.717233+0000","last_undegraded":"2024-04-25T08:42:33.717233+0000","last_fullsized":"2024-04-25T08:42:33.717233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:45.680776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717778+0000","last_change":"2024-04-25T08:42:27.663976+0000","last_active":"2024-04-25T08:42:33.717778+0000","last_peered":"2024-04-25T08:42:33.717778+0000","last_clean":"2024-04-25T08:42:33.717778+0000","last_became_active":"2024-04-25T08:42:27.663254+0000","last_became_peered":"2024-04-25T08:42:27.663254+0000","last_unstale":"2024-04-25T08:42:33.717778+0000","last_undegraded":"2024-04-25T08:42:33.717778+0000","last_fullsized":"2024-04-25T08:42:33.717778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719384+0000","last_change":"2024-04-25T08:42:32.712637+0000","last_active":"2024-04-25T08:42:34.719384+0000","last_peered":"2024-04-25T08:42:34.719384+0000","last_clean":"2024-04-25T08:42:34.719384+0000","last_became_active":"2024-04-25T08:42:32.712245+0000","last_became_peered":"2024-04-25T08:42:32.712245+0000","last_unstale":"2024-04-25T08:42:34.719384+0000","last_undegraded":"2024-04-25T08:42:34.719384+0000","last_fullsized":"2024-04-25T08:42:34.719384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:59.518802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719010+0000","last_change":"2024-04-25T08:42:28.673163+0000","last_active":"2024-04-25T08:42:34.719010+0000","last_peered":"2024-04-25T08:42:34.719010+0000","last_clean":"2024-04-25T08:42:34.719010+0000","last_became_active":"2024-04-25T08:42:28.672866+0000","last_became_peered":"2024-04-25T08:42:28.672866+0000","last_unstale":"2024-04-25T08:42:34.719010+0000","last_undegraded":"2024-04-25T08:42:34.719010+0000","last_fullsized":"2024-04-25T08:42:34.719010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714151+0000","last_change":"2024-04-25T08:42:27.665216+0000","last_active":"2024-04-25T08:42:33.714151+0000","last_peered":"2024-04-25T08:42:33.714151+0000","last_clean":"2024-04-25T08:42:33.714151+0000","last_became_active":"2024-04-25T08:42:27.664871+0000","last_became_peered":"2024-04-25T08:42:27.664871+0000","last_unstale":"2024-04-25T08:42:33.714151+0000","last_undegraded":"2024-04-25T08:42:33.714151+0000","last_fullsized":"2024-04-25T08:42:33.714151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:43.313642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719177+0000","last_change":"2024-04-25T08:42:32.708236+0000","last_active":"2024-04-25T08:42:34.719177+0000","last_peered":"2024-04-25T08:42:34.719177+0000","last_clean":"2024-04-25T08:42:34.719177+0000","last_became_active":"2024-04-25T08:42:32.707821+0000","last_became_peered":"2024-04-25T08:42:32.707821+0000","last_unstale":"2024-04-25T08:42:34.719177+0000","last_undegraded":"2024-04-25T08:42:34.719177+0000","last_fullsized":"2024-04-25T08:42:34.719177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:58.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.717992+0000","last_change":"2024-04-25T08:42:28.674649+0000","last_active":"2024-04-25T08:42:34.717992+0000","last_peered":"2024-04-25T08:42:34.717992+0000","last_clean":"2024-04-25T08:42:34.717992+0000","last_became_active":"2024-04-25T08:42:28.671414+0000","last_became_peered":"2024-04-25T08:42:28.671414+0000","last_unstale":"2024-04-25T08:42:34.717992+0000","last_undegraded":"2024-04-25T08:42:34.717992+0000","last_fullsized":"2024-04-25T08:42:34.717992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:16.974552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341186+0000","last_change":"2024-04-25T08:42:27.665689+0000","last_active":"2024-04-25T08:42:34.341186+0000","last_peered":"2024-04-25T08:42:34.341186+0000","last_clean":"2024-04-25T08:42:34.341186+0000","last_became_active":"2024-04-25T08:42:27.664957+0000","last_became_peered":"2024-04-25T08:42:27.664957+0000","last_unstale":"2024-04-25T08:42:34.341186+0000","last_undegraded":"2024-04-25T08:42:34.341186+0000","last_fullsized":"2024-04-25T08:42:34.341186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718502+0000","last_change":"2024-04-25T08:42:32.775658+0000","last_active":"2024-04-25T08:42:34.718502+0000","last_peered":"2024-04-25T08:42:34.718502+0000","last_clean":"2024-04-25T08:42:34.718502+0000","last_became_active":"2024-04-25T08:42:32.775292+0000","last_became_peered":"2024-04-25T08:42:32.775292+0000","last_unstale":"2024-04-25T08:42:34.718502+0000","last_undegraded":"2024-04-25T08:42:34.718502+0000","last_fullsized":"2024-04-25T08:42:34.718502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:59.518802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719571+0000","last_change":"2024-04-25T08:42:28.677751+0000","last_active":"2024-04-25T08:42:34.719571+0000","last_peered":"2024-04-25T08:42:34.719571+0000","last_clean":"2024-04-25T08:42:34.719571+0000","last_became_active":"2024-04-25T08:42:28.677457+0000","last_became_peered":"2024-04-25T08:42:28.677457+0000","last_unstale":"2024-04-25T08:42:34.719571+0000","last_undegraded":"2024-04-25T08:42:34.719571+0000","last_fullsized":"2024-04-25T08:42:34.719571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717550+0000","last_change":"2024-04-25T08:42:27.657212+0000","last_active":"2024-04-25T08:42:33.717550+0000","last_peered":"2024-04-25T08:42:33.717550+0000","last_clean":"2024-04-25T08:42:33.717550+0000","last_became_active":"2024-04-25T08:42:27.656883+0000","last_became_peered":"2024-04-25T08:42:27.656883+0000","last_unstale":"2024-04-25T08:42:33.717550+0000","last_undegraded":"2024-04-25T08:42:33.717550+0000","last_fullsized":"2024-04-25T08:42:33.717550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341308+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:42:34.341308+0000","last_peered":"2024-04-25T08:42:34.341308+0000","last_clean":"2024-04-25T08:42:34.341308+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:42:34.341308+0000","last_undegraded":"2024-04-25T08:42:34.341308+0000","last_fullsized":"2024-04-25T08:42:34.341308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718667+0000","last_change":"2024-04-25T08:42:32.776301+0000","last_active":"2024-04-25T08:42:34.718667+0000","last_peered":"2024-04-25T08:42:34.718667+0000","last_clean":"2024-04-25T08:42:34.718667+0000","last_became_active":"2024-04-25T08:42:32.775904+0000","last_became_peered":"2024-04-25T08:42:32.775904+0000","last_unstale":"2024-04-25T08:42:34.718667+0000","last_undegraded":"2024-04-25T08:42:34.718667+0000","last_fullsized":"2024-04-25T08:42:34.718667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341570+0000","last_change":"2024-04-25T08:42:28.692829+0000","last_active":"2024-04-25T08:42:34.341570+0000","last_peered":"2024-04-25T08:42:34.341570+0000","last_clean":"2024-04-25T08:42:34.341570+0000","last_became_active":"2024-04-25T08:42:28.690838+0000","last_became_peered":"2024-04-25T08:42:28.690838+0000","last_unstale":"2024-04-25T08:42:34.341570+0000","last_undegraded":"2024-04-25T08:42:34.341570+0000","last_fullsized":"2024-04-25T08:42:34.341570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:31.845872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714659+0000","last_change":"2024-04-25T08:42:27.664137+0000","last_active":"2024-04-25T08:42:33.714659+0000","last_peered":"2024-04-25T08:42:33.714659+0000","last_clean":"2024-04-25T08:42:33.714659+0000","last_became_active":"2024-04-25T08:42:27.663755+0000","last_became_peered":"2024-04-25T08:42:27.663755+0000","last_unstale":"2024-04-25T08:42:33.714659+0000","last_undegraded":"2024-04-25T08:42:33.714659+0000","last_fullsized":"2024-04-25T08:42:33.714659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718434+0000","last_change":"2024-04-25T08:42:32.773504+0000","last_active":"2024-04-25T08:42:34.718434+0000","last_peered":"2024-04-25T08:42:34.718434+0000","last_clean":"2024-04-25T08:42:34.718434+0000","last_became_active":"2024-04-25T08:42:32.773110+0000","last_became_peered":"2024-04-25T08:42:32.773110+0000","last_unstale":"2024-04-25T08:42:34.718434+0000","last_undegraded":"2024-04-25T08:42:34.718434+0000","last_fullsized":"2024-04-25T08:42:34.718434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:48.222965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717970+0000","last_change":"2024-04-25T08:42:28.679402+0000","last_active":"2024-04-25T08:42:33.717970+0000","last_peered":"2024-04-25T08:42:33.717970+0000","last_clean":"2024-04-25T08:42:33.717970+0000","last_became_active":"2024-04-25T08:42:28.677035+0000","last_became_peered":"2024-04-25T08:42:28.677035+0000","last_unstale":"2024-04-25T08:42:33.717970+0000","last_undegraded":"2024-04-25T08:42:33.717970+0000","last_fullsized":"2024-04-25T08:42:33.717970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:46.406390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719572+0000","last_change":"2024-04-25T08:42:27.667160+0000","last_active":"2024-04-25T08:42:34.719572+0000","last_peered":"2024-04-25T08:42:34.719572+0000","last_clean":"2024-04-25T08:42:34.719572+0000","last_became_active":"2024-04-25T08:42:27.666859+0000","last_became_peered":"2024-04-25T08:42:27.666859+0000","last_unstale":"2024-04-25T08:42:34.719572+0000","last_undegraded":"2024-04-25T08:42:34.719572+0000","last_fullsized":"2024-04-25T08:42:34.719572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.628103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718382+0000","last_change":"2024-04-25T08:42:32.712665+0000","last_active":"2024-04-25T08:42:34.718382+0000","last_peered":"2024-04-25T08:42:34.718382+0000","last_clean":"2024-04-25T08:42:34.718382+0000","last_became_active":"2024-04-25T08:42:32.712042+0000","last_became_peered":"2024-04-25T08:42:32.712042+0000","last_unstale":"2024-04-25T08:42:34.718382+0000","last_undegraded":"2024-04-25T08:42:34.718382+0000","last_fullsized":"2024-04-25T08:42:34.718382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:58.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341968+0000","last_change":"2024-04-25T08:42:28.693096+0000","last_active":"2024-04-25T08:42:34.341968+0000","last_peered":"2024-04-25T08:42:34.341968+0000","last_clean":"2024-04-25T08:42:34.341968+0000","last_became_active":"2024-04-25T08:42:28.692818+0000","last_became_peered":"2024-04-25T08:42:28.692818+0000","last_unstale":"2024-04-25T08:42:34.341968+0000","last_undegraded":"2024-04-25T08:42:34.341968+0000","last_fullsized":"2024-04-25T08:42:34.341968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:18.213161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714486+0000","last_change":"2024-04-25T08:42:27.669796+0000","last_active":"2024-04-25T08:42:33.714486+0000","last_peered":"2024-04-25T08:42:33.714486+0000","last_clean":"2024-04-25T08:42:33.714486+0000","last_became_active":"2024-04-25T08:42:27.669436+0000","last_became_peered":"2024-04-25T08:42:27.669436+0000","last_unstale":"2024-04-25T08:42:33.714486+0000","last_undegraded":"2024-04-25T08:42:33.714486+0000","last_fullsized":"2024-04-25T08:42:33.714486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.411487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716067+0000","last_change":"2024-04-25T08:42:32.776302+0000","last_active":"2024-04-25T08:42:33.716067+0000","last_peered":"2024-04-25T08:42:33.716067+0000","last_clean":"2024-04-25T08:42:33.716067+0000","last_became_active":"2024-04-25T08:42:32.775933+0000","last_became_peered":"2024-04-25T08:42:32.775933+0000","last_unstale":"2024-04-25T08:42:33.716067+0000","last_undegraded":"2024-04-25T08:42:33.716067+0000","last_fullsized":"2024-04-25T08:42:33.716067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341857+0000","last_change":"2024-04-25T08:42:28.690533+0000","last_active":"2024-04-25T08:42:34.341857+0000","last_peered":"2024-04-25T08:42:34.341857+0000","last_clean":"2024-04-25T08:42:34.341857+0000","last_became_active":"2024-04-25T08:42:28.690239+0000","last_became_peered":"2024-04-25T08:42:28.690239+0000","last_unstale":"2024-04-25T08:42:34.341857+0000","last_undegraded":"2024-04-25T08:42:34.341857+0000","last_fullsized":"2024-04-25T08:42:34.341857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:46.406390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717279+0000","last_change":"2024-04-25T08:42:27.656949+0000","last_active":"2024-04-25T08:42:33.717279+0000","last_peered":"2024-04-25T08:42:33.717279+0000","last_clean":"2024-04-25T08:42:33.717279+0000","last_became_active":"2024-04-25T08:42:27.656636+0000","last_became_peered":"2024-04-25T08:42:27.656636+0000","last_unstale":"2024-04-25T08:42:33.717279+0000","last_undegraded":"2024-04-25T08:42:33.717279+0000","last_fullsized":"2024-04-25T08:42:33.717279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:20.615472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716458+0000","last_change":"2024-04-25T08:42:32.710504+0000","last_active":"2024-04-25T08:42:33.716458+0000","last_peered":"2024-04-25T08:42:33.716458+0000","last_clean":"2024-04-25T08:42:33.716458+0000","last_became_active":"2024-04-25T08:42:32.709907+0000","last_became_peered":"2024-04-25T08:42:32.709907+0000","last_unstale":"2024-04-25T08:42:33.716458+0000","last_undegraded":"2024-04-25T08:42:33.716458+0000","last_fullsized":"2024-04-25T08:42:33.716458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:01.014826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341325+0000","last_change":"2024-04-25T08:42:28.691813+0000","last_active":"2024-04-25T08:42:34.341325+0000","last_peered":"2024-04-25T08:42:34.341325+0000","last_clean":"2024-04-25T08:42:34.341325+0000","last_became_active":"2024-04-25T08:42:28.691149+0000","last_became_peered":"2024-04-25T08:42:28.691149+0000","last_unstale":"2024-04-25T08:42:34.341325+0000","last_undegraded":"2024-04-25T08:42:34.341325+0000","last_fullsized":"2024-04-25T08:42:34.341325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714031+0000","last_change":"2024-04-25T08:42:27.662731+0000","last_active":"2024-04-25T08:42:33.714031+0000","last_peered":"2024-04-25T08:42:33.714031+0000","last_clean":"2024-04-25T08:42:33.714031+0000","last_became_active":"2024-04-25T08:42:27.662403+0000","last_became_peered":"2024-04-25T08:42:27.662403+0000","last_unstale":"2024-04-25T08:42:33.714031+0000","last_undegraded":"2024-04-25T08:42:33.714031+0000","last_fullsized":"2024-04-25T08:42:33.714031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:50.270810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718353+0000","last_change":"2024-04-25T08:42:32.710724+0000","last_active":"2024-04-25T08:42:34.718353+0000","last_peered":"2024-04-25T08:42:34.718353+0000","last_clean":"2024-04-25T08:42:34.718353+0000","last_became_active":"2024-04-25T08:42:32.710334+0000","last_became_peered":"2024-04-25T08:42:32.710334+0000","last_unstale":"2024-04-25T08:42:34.718353+0000","last_undegraded":"2024-04-25T08:42:34.718353+0000","last_fullsized":"2024-04-25T08:42:34.718353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:50.447473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718379+0000","last_change":"2024-04-25T08:42:28.687700+0000","last_active":"2024-04-25T08:42:34.718379+0000","last_peered":"2024-04-25T08:42:34.718379+0000","last_clean":"2024-04-25T08:42:34.718379+0000","last_became_active":"2024-04-25T08:42:28.687069+0000","last_became_peered":"2024-04-25T08:42:28.687069+0000","last_unstale":"2024-04-25T08:42:34.718379+0000","last_undegraded":"2024-04-25T08:42:34.718379+0000","last_fullsized":"2024-04-25T08:42:34.718379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718433+0000","last_change":"2024-04-25T08:42:27.666832+0000","last_active":"2024-04-25T08:42:34.718433+0000","last_peered":"2024-04-25T08:42:34.718433+0000","last_clean":"2024-04-25T08:42:34.718433+0000","last_became_active":"2024-04-25T08:42:27.666534+0000","last_became_peered":"2024-04-25T08:42:27.666534+0000","last_unstale":"2024-04-25T08:42:34.718433+0000","last_undegraded":"2024-04-25T08:42:34.718433+0000","last_fullsized":"2024-04-25T08:42:34.718433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720268+0000","last_change":"2024-04-25T08:42:32.774301+0000","last_active":"2024-04-25T08:42:34.720268+0000","last_peered":"2024-04-25T08:42:34.720268+0000","last_clean":"2024-04-25T08:42:34.720268+0000","last_became_active":"2024-04-25T08:42:32.773417+0000","last_became_peered":"2024-04-25T08:42:32.773417+0000","last_unstale":"2024-04-25T08:42:34.720268+0000","last_undegraded":"2024-04-25T08:42:34.720268+0000","last_fullsized":"2024-04-25T08:42:34.720268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:35.240827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341533+0000","last_change":"2024-04-25T08:42:28.691458+0000","last_active":"2024-04-25T08:42:34.341533+0000","last_peered":"2024-04-25T08:42:34.341533+0000","last_clean":"2024-04-25T08:42:34.341533+0000","last_became_active":"2024-04-25T08:42:28.691196+0000","last_became_peered":"2024-04-25T08:42:28.691196+0000","last_unstale":"2024-04-25T08:42:34.341533+0000","last_undegraded":"2024-04-25T08:42:34.341533+0000","last_fullsized":"2024-04-25T08:42:34.341533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717730+0000","last_change":"2024-04-25T08:42:27.667521+0000","last_active":"2024-04-25T08:42:33.717730+0000","last_peered":"2024-04-25T08:42:33.717730+0000","last_clean":"2024-04-25T08:42:33.717730+0000","last_became_active":"2024-04-25T08:42:27.666568+0000","last_became_peered":"2024-04-25T08:42:27.666568+0000","last_unstale":"2024-04-25T08:42:33.717730+0000","last_undegraded":"2024-04-25T08:42:33.717730+0000","last_fullsized":"2024-04-25T08:42:33.717730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719926+0000","last_change":"2024-04-25T08:42:32.773283+0000","last_active":"2024-04-25T08:42:34.719926+0000","last_peered":"2024-04-25T08:42:34.719926+0000","last_clean":"2024-04-25T08:42:34.719926+0000","last_became_active":"2024-04-25T08:42:32.772847+0000","last_became_peered":"2024-04-25T08:42:32.772847+0000","last_unstale":"2024-04-25T08:42:34.719926+0000","last_undegraded":"2024-04-25T08:42:34.719926+0000","last_fullsized":"2024-04-25T08:42:34.719926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718713+0000","last_change":"2024-04-25T08:42:28.682019+0000","last_active":"2024-04-25T08:42:34.718713+0000","last_peered":"2024-04-25T08:42:34.718713+0000","last_clean":"2024-04-25T08:42:34.718713+0000","last_became_active":"2024-04-25T08:42:28.681710+0000","last_became_peered":"2024-04-25T08:42:28.681710+0000","last_unstale":"2024-04-25T08:42:34.718713+0000","last_undegraded":"2024-04-25T08:42:34.718713+0000","last_fullsized":"2024-04-25T08:42:34.718713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:25.495879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718612+0000","last_change":"2024-04-25T08:42:27.662671+0000","last_active":"2024-04-25T08:42:34.718612+0000","last_peered":"2024-04-25T08:42:34.718612+0000","last_clean":"2024-04-25T08:42:34.718612+0000","last_became_active":"2024-04-25T08:42:27.662360+0000","last_became_peered":"2024-04-25T08:42:27.662360+0000","last_unstale":"2024-04-25T08:42:34.718612+0000","last_undegraded":"2024-04-25T08:42:34.718612+0000","last_fullsized":"2024-04-25T08:42:34.718612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:50.270810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718134+0000","last_change":"2024-04-25T08:42:32.775284+0000","last_active":"2024-04-25T08:42:33.718134+0000","last_peered":"2024-04-25T08:42:33.718134+0000","last_clean":"2024-04-25T08:42:33.718134+0000","last_became_active":"2024-04-25T08:42:32.774805+0000","last_became_peered":"2024-04-25T08:42:32.774805+0000","last_unstale":"2024-04-25T08:42:33.718134+0000","last_undegraded":"2024-04-25T08:42:33.718134+0000","last_fullsized":"2024-04-25T08:42:33.718134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:40.291706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341553+0000","last_change":"2024-04-25T08:42:28.687467+0000","last_active":"2024-04-25T08:42:34.341553+0000","last_peered":"2024-04-25T08:42:34.341553+0000","last_clean":"2024-04-25T08:42:34.341553+0000","last_became_active":"2024-04-25T08:42:28.687151+0000","last_became_peered":"2024-04-25T08:42:28.687151+0000","last_unstale":"2024-04-25T08:42:34.341553+0000","last_undegraded":"2024-04-25T08:42:34.341553+0000","last_fullsized":"2024-04-25T08:42:34.341553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:12.983651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:37.848489+0000","last_change":"2024-04-25T08:42:27.667309+0000","last_active":"2024-04-25T08:42:37.848489+0000","last_peered":"2024-04-25T08:42:37.848489+0000","last_clean":"2024-04-25T08:42:37.848489+0000","last_became_active":"2024-04-25T08:42:27.666995+0000","last_became_peered":"2024-04-25T08:42:27.666995+0000","last_unstale":"2024-04-25T08:42:37.848489+0000","last_undegraded":"2024-04-25T08:42:37.848489+0000","last_fullsized":"2024-04-25T08:42:37.848489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719544+0000","last_change":"2024-04-25T08:42:32.709153+0000","last_active":"2024-04-25T08:42:34.719544+0000","last_peered":"2024-04-25T08:42:34.719544+0000","last_clean":"2024-04-25T08:42:34.719544+0000","last_became_active":"2024-04-25T08:42:32.708767+0000","last_became_peered":"2024-04-25T08:42:32.708767+0000","last_unstale":"2024-04-25T08:42:34.719544+0000","last_undegraded":"2024-04-25T08:42:34.719544+0000","last_fullsized":"2024-04-25T08:42:34.719544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:07.122172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716905+0000","last_change":"2024-04-25T08:42:28.682383+0000","last_active":"2024-04-25T08:42:33.716905+0000","last_peered":"2024-04-25T08:42:33.716905+0000","last_clean":"2024-04-25T08:42:33.716905+0000","last_became_active":"2024-04-25T08:42:28.682089+0000","last_became_peered":"2024-04-25T08:42:28.682089+0000","last_unstale":"2024-04-25T08:42:33.716905+0000","last_undegraded":"2024-04-25T08:42:33.716905+0000","last_fullsized":"2024-04-25T08:42:33.716905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.349485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719476+0000","last_change":"2024-04-25T08:42:27.667264+0000","last_active":"2024-04-25T08:42:34.719476+0000","last_peered":"2024-04-25T08:42:34.719476+0000","last_clean":"2024-04-25T08:42:34.719476+0000","last_became_active":"2024-04-25T08:42:27.666961+0000","last_became_peered":"2024-04-25T08:42:27.666961+0000","last_unstale":"2024-04-25T08:42:34.719476+0000","last_undegraded":"2024-04-25T08:42:34.719476+0000","last_fullsized":"2024-04-25T08:42:34.719476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:11.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717197+0000","last_change":"2024-04-25T08:42:32.714944+0000","last_active":"2024-04-25T08:42:33.717197+0000","last_peered":"2024-04-25T08:42:33.717197+0000","last_clean":"2024-04-25T08:42:33.717197+0000","last_became_active":"2024-04-25T08:42:32.714532+0000","last_became_peered":"2024-04-25T08:42:32.714532+0000","last_unstale":"2024-04-25T08:42:33.717197+0000","last_undegraded":"2024-04-25T08:42:33.717197+0000","last_fullsized":"2024-04-25T08:42:33.717197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718384+0000","last_change":"2024-04-25T08:42:28.678248+0000","last_active":"2024-04-25T08:42:34.718384+0000","last_peered":"2024-04-25T08:42:34.718384+0000","last_clean":"2024-04-25T08:42:34.718384+0000","last_became_active":"2024-04-25T08:42:28.677444+0000","last_became_peered":"2024-04-25T08:42:28.677444+0000","last_unstale":"2024-04-25T08:42:34.718384+0000","last_undegraded":"2024-04-25T08:42:34.718384+0000","last_fullsized":"2024-04-25T08:42:34.718384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718054+0000","last_change":"2024-04-25T08:42:27.662208+0000","last_active":"2024-04-25T08:42:33.718054+0000","last_peered":"2024-04-25T08:42:33.718054+0000","last_clean":"2024-04-25T08:42:33.718054+0000","last_became_active":"2024-04-25T08:42:27.661833+0000","last_became_peered":"2024-04-25T08:42:27.661833+0000","last_unstale":"2024-04-25T08:42:33.718054+0000","last_undegraded":"2024-04-25T08:42:33.718054+0000","last_fullsized":"2024-04-25T08:42:33.718054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720748+0000","last_change":"2024-04-25T08:42:32.704429+0000","last_active":"2024-04-25T08:42:34.720748+0000","last_peered":"2024-04-25T08:42:34.720748+0000","last_clean":"2024-04-25T08:42:34.720748+0000","last_became_active":"2024-04-25T08:42:32.703936+0000","last_became_peered":"2024-04-25T08:42:32.703936+0000","last_unstale":"2024-04-25T08:42:34.720748+0000","last_undegraded":"2024-04-25T08:42:34.720748+0000","last_fullsized":"2024-04-25T08:42:34.720748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:27.086996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717935+0000","last_change":"2024-04-25T08:42:28.685516+0000","last_active":"2024-04-25T08:42:33.717935+0000","last_peered":"2024-04-25T08:42:33.717935+0000","last_clean":"2024-04-25T08:42:33.717935+0000","last_became_active":"2024-04-25T08:42:28.685250+0000","last_became_peered":"2024-04-25T08:42:28.685250+0000","last_unstale":"2024-04-25T08:42:33.717935+0000","last_undegraded":"2024-04-25T08:42:33.717935+0000","last_fullsized":"2024-04-25T08:42:33.717935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719154+0000","last_change":"2024-04-25T08:42:27.665950+0000","last_active":"2024-04-25T08:42:34.719154+0000","last_peered":"2024-04-25T08:42:34.719154+0000","last_clean":"2024-04-25T08:42:34.719154+0000","last_became_active":"2024-04-25T08:42:27.665624+0000","last_became_peered":"2024-04-25T08:42:27.665624+0000","last_unstale":"2024-04-25T08:42:34.719154+0000","last_undegraded":"2024-04-25T08:42:34.719154+0000","last_fullsized":"2024-04-25T08:42:34.719154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720002+0000","last_change":"2024-04-25T08:42:32.776610+0000","last_active":"2024-04-25T08:42:34.720002+0000","last_peered":"2024-04-25T08:42:34.720002+0000","last_clean":"2024-04-25T08:42:34.720002+0000","last_became_active":"2024-04-25T08:42:32.776245+0000","last_became_peered":"2024-04-25T08:42:32.776245+0000","last_unstale":"2024-04-25T08:42:34.720002+0000","last_undegraded":"2024-04-25T08:42:34.720002+0000","last_fullsized":"2024-04-25T08:42:34.720002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:40.291706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718182+0000","last_change":"2024-04-25T08:42:32.776744+0000","last_active":"2024-04-25T08:42:34.718182+0000","last_peered":"2024-04-25T08:42:34.718182+0000","last_clean":"2024-04-25T08:42:34.718182+0000","last_became_active":"2024-04-25T08:42:32.776378+0000","last_became_peered":"2024-04-25T08:42:32.776378+0000","last_unstale":"2024-04-25T08:42:34.718182+0000","last_undegraded":"2024-04-25T08:42:34.718182+0000","last_fullsized":"2024-04-25T08:42:34.718182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718145+0000","last_change":"2024-04-25T08:42:28.675393+0000","last_active":"2024-04-25T08:42:34.718145+0000","last_peered":"2024-04-25T08:42:34.718145+0000","last_clean":"2024-04-25T08:42:34.718145+0000","last_became_active":"2024-04-25T08:42:28.675124+0000","last_became_peered":"2024-04-25T08:42:28.675124+0000","last_unstale":"2024-04-25T08:42:34.718145+0000","last_undegraded":"2024-04-25T08:42:34.718145+0000","last_fullsized":"2024-04-25T08:42:34.718145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716296+0000","last_change":"2024-04-25T08:42:27.661033+0000","last_active":"2024-04-25T08:42:33.716296+0000","last_peered":"2024-04-25T08:42:33.716296+0000","last_clean":"2024-04-25T08:42:33.716296+0000","last_became_active":"2024-04-25T08:42:27.660770+0000","last_became_peered":"2024-04-25T08:42:27.660770+0000","last_unstale":"2024-04-25T08:42:33.716296+0000","last_undegraded":"2024-04-25T08:42:33.716296+0000","last_fullsized":"2024-04-25T08:42:33.716296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719178+0000","last_change":"2024-04-25T08:42:32.714933+0000","last_active":"2024-04-25T08:42:34.719178+0000","last_peered":"2024-04-25T08:42:34.719178+0000","last_clean":"2024-04-25T08:42:34.719178+0000","last_became_active":"2024-04-25T08:42:32.714432+0000","last_became_peered":"2024-04-25T08:42:32.714432+0000","last_unstale":"2024-04-25T08:42:34.719178+0000","last_undegraded":"2024-04-25T08:42:34.719178+0000","last_fullsized":"2024-04-25T08:42:34.719178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720792+0000","last_change":"2024-04-25T08:42:28.679501+0000","last_active":"2024-04-25T08:42:34.720792+0000","last_peered":"2024-04-25T08:42:34.720792+0000","last_clean":"2024-04-25T08:42:34.720792+0000","last_became_active":"2024-04-25T08:42:28.679169+0000","last_became_peered":"2024-04-25T08:42:28.679169+0000","last_unstale":"2024-04-25T08:42:34.720792+0000","last_undegraded":"2024-04-25T08:42:34.720792+0000","last_fullsized":"2024-04-25T08:42:34.720792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720301+0000","last_change":"2024-04-25T08:42:27.669642+0000","last_active":"2024-04-25T08:42:34.720301+0000","last_peered":"2024-04-25T08:42:34.720301+0000","last_clean":"2024-04-25T08:42:34.720301+0000","last_became_active":"2024-04-25T08:42:27.669219+0000","last_became_peered":"2024-04-25T08:42:27.669219+0000","last_unstale":"2024-04-25T08:42:34.720301+0000","last_undegraded":"2024-04-25T08:42:34.720301+0000","last_fullsized":"2024-04-25T08:42:34.720301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718695+0000","last_change":"2024-04-25T08:42:27.664507+0000","last_active":"2024-04-25T08:42:34.718695+0000","last_peered":"2024-04-25T08:42:34.718695+0000","last_clean":"2024-04-25T08:42:34.718695+0000","last_became_active":"2024-04-25T08:42:27.663781+0000","last_became_peered":"2024-04-25T08:42:27.663781+0000","last_unstale":"2024-04-25T08:42:34.718695+0000","last_undegraded":"2024-04-25T08:42:34.718695+0000","last_fullsized":"2024-04-25T08:42:34.718695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718519+0000","last_change":"2024-04-25T08:42:28.670559+0000","last_active":"2024-04-25T08:42:34.718519+0000","last_peered":"2024-04-25T08:42:34.718519+0000","last_clean":"2024-04-25T08:42:34.718519+0000","last_became_active":"2024-04-25T08:42:28.670258+0000","last_became_peered":"2024-04-25T08:42:28.670258+0000","last_unstale":"2024-04-25T08:42:34.718519+0000","last_undegraded":"2024-04-25T08:42:34.718519+0000","last_fullsized":"2024-04-25T08:42:34.718519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714478+0000","last_change":"2024-04-25T08:42:32.714660+0000","last_active":"2024-04-25T08:42:33.714478+0000","last_peered":"2024-04-25T08:42:33.714478+0000","last_clean":"2024-04-25T08:42:33.714478+0000","last_became_active":"2024-04-25T08:42:32.714182+0000","last_became_peered":"2024-04-25T08:42:32.714182+0000","last_unstale":"2024-04-25T08:42:33.714478+0000","last_undegraded":"2024-04-25T08:42:33.714478+0000","last_fullsized":"2024-04-25T08:42:33.714478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:21.015635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720625+0000","last_change":"2024-04-25T08:42:27.671542+0000","last_active":"2024-04-25T08:42:34.720625+0000","last_peered":"2024-04-25T08:42:34.720625+0000","last_clean":"2024-04-25T08:42:34.720625+0000","last_became_active":"2024-04-25T08:42:27.670640+0000","last_became_peered":"2024-04-25T08:42:27.670640+0000","last_unstale":"2024-04-25T08:42:34.720625+0000","last_undegraded":"2024-04-25T08:42:34.720625+0000","last_fullsized":"2024-04-25T08:42:34.720625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.411487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716383+0000","last_change":"2024-04-25T08:42:28.675535+0000","last_active":"2024-04-25T08:42:33.716383+0000","last_peered":"2024-04-25T08:42:33.716383+0000","last_clean":"2024-04-25T08:42:33.716383+0000","last_became_active":"2024-04-25T08:42:28.674786+0000","last_became_peered":"2024-04-25T08:42:28.674786+0000","last_unstale":"2024-04-25T08:42:33.716383+0000","last_undegraded":"2024-04-25T08:42:33.716383+0000","last_fullsized":"2024-04-25T08:42:33.716383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:19.055819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720001+0000","last_change":"2024-04-25T08:42:32.703253+0000","last_active":"2024-04-25T08:42:34.720001+0000","last_peered":"2024-04-25T08:42:34.720001+0000","last_clean":"2024-04-25T08:42:34.720001+0000","last_became_active":"2024-04-25T08:42:32.702862+0000","last_became_peered":"2024-04-25T08:42:32.702862+0000","last_unstale":"2024-04-25T08:42:34.720001+0000","last_undegraded":"2024-04-25T08:42:34.720001+0000","last_fullsized":"2024-04-25T08:42:34.720001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:46.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718238+0000","last_change":"2024-04-25T08:42:28.688424+0000","last_active":"2024-04-25T08:42:34.718238+0000","last_peered":"2024-04-25T08:42:34.718238+0000","last_clean":"2024-04-25T08:42:34.718238+0000","last_became_active":"2024-04-25T08:42:28.687428+0000","last_became_peered":"2024-04-25T08:42:28.687428+0000","last_unstale":"2024-04-25T08:42:34.718238+0000","last_undegraded":"2024-04-25T08:42:34.718238+0000","last_fullsized":"2024-04-25T08:42:34.718238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714119+0000","last_change":"2024-04-25T08:42:28.676656+0000","last_active":"2024-04-25T08:42:33.714119+0000","last_peered":"2024-04-25T08:42:33.714119+0000","last_clean":"2024-04-25T08:42:33.714119+0000","last_became_active":"2024-04-25T08:42:28.676373+0000","last_became_peered":"2024-04-25T08:42:28.676373+0000","last_unstale":"2024-04-25T08:42:33.714119+0000","last_undegraded":"2024-04-25T08:42:33.714119+0000","last_fullsized":"2024-04-25T08:42:33.714119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:12.180971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717556+0000","last_change":"2024-04-25T08:42:28.681762+0000","last_active":"2024-04-25T08:42:33.717556+0000","last_peered":"2024-04-25T08:42:33.717556+0000","last_clean":"2024-04-25T08:42:33.717556+0000","last_became_active":"2024-04-25T08:42:28.681291+0000","last_became_peered":"2024-04-25T08:42:28.681291+0000","last_unstale":"2024-04-25T08:42:33.717556+0000","last_undegraded":"2024-04-25T08:42:33.717556+0000","last_fullsized":"2024-04-25T08:42:33.717556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:54.440616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718428+0000","last_change":"2024-04-25T08:42:28.676467+0000","last_active":"2024-04-25T08:42:34.718428+0000","last_peered":"2024-04-25T08:42:34.718428+0000","last_clean":"2024-04-25T08:42:34.718428+0000","last_became_active":"2024-04-25T08:42:28.675914+0000","last_became_peered":"2024-04-25T08:42:28.675914+0000","last_unstale":"2024-04-25T08:42:34.718428+0000","last_undegraded":"2024-04-25T08:42:34.718428+0000","last_fullsized":"2024-04-25T08:42:34.718428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720100+0000","last_change":"2024-04-25T08:42:28.675440+0000","last_active":"2024-04-25T08:42:34.720100+0000","last_peered":"2024-04-25T08:42:34.720100+0000","last_clean":"2024-04-25T08:42:34.720100+0000","last_became_active":"2024-04-25T08:42:28.675157+0000","last_became_peered":"2024-04-25T08:42:28.675157+0000","last_unstale":"2024-04-25T08:42:34.720100+0000","last_undegraded":"2024-04-25T08:42:34.720100+0000","last_fullsized":"2024-04-25T08:42:34.720100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719294+0000","last_change":"2024-04-25T08:42:28.681482+0000","last_active":"2024-04-25T08:42:34.719294+0000","last_peered":"2024-04-25T08:42:34.719294+0000","last_clean":"2024-04-25T08:42:34.719294+0000","last_became_active":"2024-04-25T08:42:28.681211+0000","last_became_peered":"2024-04-25T08:42:28.681211+0000","last_unstale":"2024-04-25T08:42:34.719294+0000","last_undegraded":"2024-04-25T08:42:34.719294+0000","last_fullsized":"2024-04-25T08:42:34.719294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719200+0000","last_change":"2024-04-25T08:42:28.684774+0000","last_active":"2024-04-25T08:42:34.719200+0000","last_peered":"2024-04-25T08:42:34.719200+0000","last_clean":"2024-04-25T08:42:34.719200+0000","last_became_active":"2024-04-25T08:42:28.684502+0000","last_became_peered":"2024-04-25T08:42:28.684502+0000","last_unstale":"2024-04-25T08:42:34.719200+0000","last_undegraded":"2024-04-25T08:42:34.719200+0000","last_fullsized":"2024-04-25T08:42:34.719200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720334+0000","last_change":"2024-04-25T08:42:28.675478+0000","last_active":"2024-04-25T08:42:34.720334+0000","last_peered":"2024-04-25T08:42:34.720334+0000","last_clean":"2024-04-25T08:42:34.720334+0000","last_became_active":"2024-04-25T08:42:28.675191+0000","last_became_peered":"2024-04-25T08:42:28.675191+0000","last_unstale":"2024-04-25T08:42:34.720334+0000","last_undegraded":"2024-04-25T08:42:34.720334+0000","last_fullsized":"2024-04-25T08:42:34.720334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716297+0000","last_change":"2024-04-25T08:42:28.679789+0000","last_active":"2024-04-25T08:42:33.716297+0000","last_peered":"2024-04-25T08:42:33.716297+0000","last_clean":"2024-04-25T08:42:33.716297+0000","last_became_active":"2024-04-25T08:42:28.677404+0000","last_became_peered":"2024-04-25T08:42:28.677404+0000","last_unstale":"2024-04-25T08:42:33.716297+0000","last_undegraded":"2024-04-25T08:42:33.716297+0000","last_fullsized":"2024-04-25T08:42:33.716297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720113+0000","last_change":"2024-04-25T08:42:28.683643+0000","last_active":"2024-04-25T08:42:34.720113+0000","last_peered":"2024-04-25T08:42:34.720113+0000","last_clean":"2024-04-25T08:42:34.720113+0000","last_became_active":"2024-04-25T08:42:28.683205+0000","last_became_peered":"2024-04-25T08:42:28.683205+0000","last_unstale":"2024-04-25T08:42:34.720113+0000","last_undegraded":"2024-04-25T08:42:34.720113+0000","last_fullsized":"2024-04-25T08:42:34.720113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717551+0000","last_change":"2024-04-25T08:42:28.682157+0000","last_active":"2024-04-25T08:42:33.717551+0000","last_peered":"2024-04-25T08:42:33.717551+0000","last_clean":"2024-04-25T08:42:33.717551+0000","last_became_active":"2024-04-25T08:42:28.681910+0000","last_became_peered":"2024-04-25T08:42:28.681910+0000","last_unstale":"2024-04-25T08:42:33.717551+0000","last_undegraded":"2024-04-25T08:42:33.717551+0000","last_fullsized":"2024-04-25T08:42:33.717551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718189+0000","last_change":"2024-04-25T08:42:28.681636+0000","last_active":"2024-04-25T08:42:34.718189+0000","last_peered":"2024-04-25T08:42:34.718189+0000","last_clean":"2024-04-25T08:42:34.718189+0000","last_became_active":"2024-04-25T08:42:28.681243+0000","last_became_peered":"2024-04-25T08:42:28.681243+0000","last_unstale":"2024-04-25T08:42:34.718189+0000","last_undegraded":"2024-04-25T08:42:34.718189+0000","last_fullsized":"2024-04-25T08:42:34.718189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:22.224011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718681+0000","last_change":"2024-04-25T08:42:28.690347+0000","last_active":"2024-04-25T08:42:34.718681+0000","last_peered":"2024-04-25T08:42:34.718681+0000","last_clean":"2024-04-25T08:42:34.718681+0000","last_became_active":"2024-04-25T08:42:28.690062+0000","last_became_peered":"2024-04-25T08:42:28.690062+0000","last_unstale":"2024-04-25T08:42:34.718681+0000","last_undegraded":"2024-04-25T08:42:34.718681+0000","last_fullsized":"2024-04-25T08:42:34.718681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341807+0000","last_change":"2024-04-25T08:42:28.687419+0000","last_active":"2024-04-25T08:42:34.341807+0000","last_peered":"2024-04-25T08:42:34.341807+0000","last_clean":"2024-04-25T08:42:34.341807+0000","last_became_active":"2024-04-25T08:42:28.686800+0000","last_became_peered":"2024-04-25T08:42:28.686800+0000","last_unstale":"2024-04-25T08:42:34.341807+0000","last_undegraded":"2024-04-25T08:42:34.341807+0000","last_fullsized":"2024-04-25T08:42:34.341807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:54.440616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714411+0000","last_change":"2024-04-25T08:42:28.679139+0000","last_active":"2024-04-25T08:42:33.714411+0000","last_peered":"2024-04-25T08:42:33.714411+0000","last_clean":"2024-04-25T08:42:33.714411+0000","last_became_active":"2024-04-25T08:42:28.678803+0000","last_became_peered":"2024-04-25T08:42:28.678803+0000","last_unstale":"2024-04-25T08:42:33.714411+0000","last_undegraded":"2024-04-25T08:42:33.714411+0000","last_fullsized":"2024-04-25T08:42:33.714411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:08.632475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718400+0000","last_change":"2024-04-25T08:42:28.682788+0000","last_active":"2024-04-25T08:42:33.718400+0000","last_peered":"2024-04-25T08:42:33.718400+0000","last_clean":"2024-04-25T08:42:33.718400+0000","last_became_active":"2024-04-25T08:42:28.682532+0000","last_became_peered":"2024-04-25T08:42:28.682532+0000","last_unstale":"2024-04-25T08:42:33.718400+0000","last_undegraded":"2024-04-25T08:42:33.718400+0000","last_fullsized":"2024-04-25T08:42:33.718400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:12.983651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716185+0000","last_change":"2024-04-25T08:42:28.676138+0000","last_active":"2024-04-25T08:42:33.716185+0000","last_peered":"2024-04-25T08:42:33.716185+0000","last_clean":"2024-04-25T08:42:33.716185+0000","last_became_active":"2024-04-25T08:42:28.675765+0000","last_became_peered":"2024-04-25T08:42:28.675765+0000","last_unstale":"2024-04-25T08:42:33.716185+0000","last_undegraded":"2024-04-25T08:42:33.716185+0000","last_fullsized":"2024-04-25T08:42:33.716185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:31.845872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718240+0000","last_change":"2024-04-25T08:42:28.676274+0000","last_active":"2024-04-25T08:42:34.718240+0000","last_peered":"2024-04-25T08:42:34.718240+0000","last_clean":"2024-04-25T08:42:34.718240+0000","last_became_active":"2024-04-25T08:42:28.675935+0000","last_became_peered":"2024-04-25T08:42:28.675935+0000","last_unstale":"2024-04-25T08:42:34.718240+0000","last_undegraded":"2024-04-25T08:42:34.718240+0000","last_fullsized":"2024-04-25T08:42:34.718240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718466+0000","last_change":"2024-04-25T08:42:28.675277+0000","last_active":"2024-04-25T08:42:34.718466+0000","last_peered":"2024-04-25T08:42:34.718466+0000","last_clean":"2024-04-25T08:42:34.718466+0000","last_became_active":"2024-04-25T08:42:28.674998+0000","last_became_peered":"2024-04-25T08:42:28.674998+0000","last_unstale":"2024-04-25T08:42:34.718466+0000","last_undegraded":"2024-04-25T08:42:34.718466+0000","last_fullsized":"2024-04-25T08:42:34.718466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:25.796192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720546+0000","last_change":"2024-04-25T08:42:28.679479+0000","last_active":"2024-04-25T08:42:34.720546+0000","last_peered":"2024-04-25T08:42:34.720546+0000","last_clean":"2024-04-25T08:42:34.720546+0000","last_became_active":"2024-04-25T08:42:28.679202+0000","last_became_peered":"2024-04-25T08:42:28.679202+0000","last_unstale":"2024-04-25T08:42:34.720546+0000","last_undegraded":"2024-04-25T08:42:34.720546+0000","last_fullsized":"2024-04-25T08:42:34.720546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716781+0000","last_change":"2024-04-25T08:42:28.680700+0000","last_active":"2024-04-25T08:42:33.716781+0000","last_peered":"2024-04-25T08:42:33.716781+0000","last_clean":"2024-04-25T08:42:33.716781+0000","last_became_active":"2024-04-25T08:42:28.680363+0000","last_became_peered":"2024-04-25T08:42:28.680363+0000","last_unstale":"2024-04-25T08:42:33.716781+0000","last_undegraded":"2024-04-25T08:42:33.716781+0000","last_fullsized":"2024-04-25T08:42:33.716781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:12.180971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718922+0000","last_change":"2024-04-25T08:42:28.688063+0000","last_active":"2024-04-25T08:42:34.718922+0000","last_peered":"2024-04-25T08:42:34.718922+0000","last_clean":"2024-04-25T08:42:34.718922+0000","last_became_active":"2024-04-25T08:42:28.687786+0000","last_became_peered":"2024-04-25T08:42:28.687786+0000","last_unstale":"2024-04-25T08:42:34.718922+0000","last_undegraded":"2024-04-25T08:42:34.718922+0000","last_fullsized":"2024-04-25T08:42:34.718922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719162+0000","last_change":"2024-04-25T08:42:28.688118+0000","last_active":"2024-04-25T08:42:34.719162+0000","last_peered":"2024-04-25T08:42:34.719162+0000","last_clean":"2024-04-25T08:42:34.719162+0000","last_became_active":"2024-04-25T08:42:28.687841+0000","last_became_peered":"2024-04-25T08:42:28.687841+0000","last_unstale":"2024-04-25T08:42:34.719162+0000","last_undegraded":"2024-04-25T08:42:34.719162+0000","last_fullsized":"2024-04-25T08:42:34.719162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341962+0000","last_change":"2024-04-25T08:42:28.692587+0000","last_active":"2024-04-25T08:42:34.341962+0000","last_peered":"2024-04-25T08:42:34.341962+0000","last_clean":"2024-04-25T08:42:34.341962+0000","last_became_active":"2024-04-25T08:42:28.688599+0000","last_became_peered":"2024-04-25T08:42:28.688599+0000","last_unstale":"2024-04-25T08:42:34.341962+0000","last_undegraded":"2024-04-25T08:42:34.341962+0000","last_fullsized":"2024-04-25T08:42:34.341962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:03.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720561+0000","last_change":"2024-04-25T08:42:28.683857+0000","last_active":"2024-04-25T08:42:34.720561+0000","last_peered":"2024-04-25T08:42:34.720561+0000","last_clean":"2024-04-25T08:42:34.720561+0000","last_became_active":"2024-04-25T08:42:28.683465+0000","last_became_peered":"2024-04-25T08:42:28.683465+0000","last_unstale":"2024-04-25T08:42:34.720561+0000","last_undegraded":"2024-04-25T08:42:34.720561+0000","last_fullsized":"2024-04-25T08:42:34.720561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341299+0000","last_change":"2024-04-25T08:42:28.691863+0000","last_active":"2024-04-25T08:42:34.341299+0000","last_peered":"2024-04-25T08:42:34.341299+0000","last_clean":"2024-04-25T08:42:34.341299+0000","last_became_active":"2024-04-25T08:42:28.690583+0000","last_became_peered":"2024-04-25T08:42:28.690583+0000","last_unstale":"2024-04-25T08:42:34.341299+0000","last_undegraded":"2024-04-25T08:42:34.341299+0000","last_fullsized":"2024-04-25T08:42:34.341299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717427+0000","last_change":"2024-04-25T08:42:28.675349+0000","last_active":"2024-04-25T08:42:33.717427+0000","last_peered":"2024-04-25T08:42:33.717427+0000","last_clean":"2024-04-25T08:42:33.717427+0000","last_became_active":"2024-04-25T08:42:28.675000+0000","last_became_peered":"2024-04-25T08:42:28.675000+0000","last_unstale":"2024-04-25T08:42:33.717427+0000","last_undegraded":"2024-04-25T08:42:33.717427+0000","last_fullsized":"2024-04-25T08:42:33.717427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:55.477719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341365+0000","last_change":"2024-04-25T08:42:28.684750+0000","last_active":"2024-04-25T08:42:34.341365+0000","last_peered":"2024-04-25T08:42:34.341365+0000","last_clean":"2024-04-25T08:42:34.341365+0000","last_became_active":"2024-04-25T08:42:28.684463+0000","last_became_peered":"2024-04-25T08:42:28.684463+0000","last_unstale":"2024-04-25T08:42:34.341365+0000","last_undegraded":"2024-04-25T08:42:34.341365+0000","last_fullsized":"2024-04-25T08:42:34.341365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717827+0000","last_change":"2024-04-25T08:42:28.680160+0000","last_active":"2024-04-25T08:42:33.717827+0000","last_peered":"2024-04-25T08:42:33.717827+0000","last_clean":"2024-04-25T08:42:33.717827+0000","last_became_active":"2024-04-25T08:42:28.679868+0000","last_became_peered":"2024-04-25T08:42:28.679868+0000","last_unstale":"2024-04-25T08:42:33.717827+0000","last_undegraded":"2024-04-25T08:42:33.717827+0000","last_fullsized":"2024-04-25T08:42:33.717827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718100+0000","last_change":"2024-04-25T08:42:28.674768+0000","last_active":"2024-04-25T08:42:34.718100+0000","last_peered":"2024-04-25T08:42:34.718100+0000","last_clean":"2024-04-25T08:42:34.718100+0000","last_became_active":"2024-04-25T08:42:28.669240+0000","last_became_peered":"2024-04-25T08:42:28.669240+0000","last_unstale":"2024-04-25T08:42:34.718100+0000","last_undegraded":"2024-04-25T08:42:34.718100+0000","last_fullsized":"2024-04-25T08:42:34.718100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719515+0000","last_change":"2024-04-25T08:42:28.676190+0000","last_active":"2024-04-25T08:42:34.719515+0000","last_peered":"2024-04-25T08:42:34.719515+0000","last_clean":"2024-04-25T08:42:34.719515+0000","last_became_active":"2024-04-25T08:42:28.675895+0000","last_became_peered":"2024-04-25T08:42:28.675895+0000","last_unstale":"2024-04-25T08:42:34.719515+0000","last_undegraded":"2024-04-25T08:42:34.719515+0000","last_fullsized":"2024-04-25T08:42:34.719515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341862+0000","last_change":"2024-04-25T08:42:28.686275+0000","last_active":"2024-04-25T08:42:34.341862+0000","last_peered":"2024-04-25T08:42:34.341862+0000","last_clean":"2024-04-25T08:42:34.341862+0000","last_became_active":"2024-04-25T08:42:28.686029+0000","last_became_peered":"2024-04-25T08:42:28.686029+0000","last_unstale":"2024-04-25T08:42:34.341862+0000","last_undegraded":"2024-04-25T08:42:34.341862+0000","last_fullsized":"2024-04-25T08:42:34.341862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:55.477719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:42:51.031 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:42:51.031 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T08:42:51.031 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T08:42:51.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T08:42:51.032 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T08:42:51.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.172+0000 7fef87c8f640 1 Processor -- start 2024-04-25T08:42:51.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.172+0000 7fef87c8f640 1 -- start start 2024-04-25T08:42:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef87c8f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fef800cc8e0 0x7fef801625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef87c8f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800cce50 con 0x7fef800d1810 2024-04-25T08:42:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef87c8f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef80161af0 con 0x7fef8015dc90 2024-04-25T08:42:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef87c8f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef80161dd0 con 0x7fef800cc8e0 2024-04-25T08:42:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef8522a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fef800cc8e0 0x7fef801625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef8622c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fef800d1810 0x7fef800cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46174/0 (socket says 172.21.15.172:46174) 2024-04-25T08:42:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef8622c640 1 -- 172.21.15.172:0/2205194577 learned_addr learned my addr 172.21.15.172:0/2205194577 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef8522a640 1 -- 172.21.15.172:0/2205194577 >> v1:172.21.15.186:6789/0 conn(0x7fef8015dc90 legacy=0x7fef8015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef8522a640 1 -- 172.21.15.172:0/2205194577 >> v1:172.21.15.172:6789/0 conn(0x7fef800d1810 legacy=0x7fef800cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef8522a640 1 -- 172.21.15.172:0/2205194577 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef801620b0 con 0x7fef800cc8e0 2024-04-25T08:42:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.173+0000 7fef84a29640 1 -- 172.21.15.172:0/2205194577 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408184826 0 0) 0x7fef800cce50 con 0x7fef800d1810 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.174+0000 7fef8522a640 1 --2- 172.21.15.172:0/2205194577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800cc8e0 0x7fef801625d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef700097a0 tx=0x7fef7002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6354ac530d2c59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.174+0000 7fef84a29640 1 -- 172.21.15.172:0/2205194577 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70037070 con 0x7fef800cc8e0 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.174+0000 7fef84a29640 1 -- 172.21.15.172:0/2205194577 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70032440 con 0x7fef800cc8e0 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.174+0000 7fef84a29640 1 -- 172.21.15.172:0/2205194577 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70032810 con 0x7fef800cc8e0 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.174+0000 7fef87c8f640 1 -- 172.21.15.172:0/2205194577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800cc8e0 msgr2=0x7fef801625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.174+0000 7fef87c8f640 1 --2- 172.21.15.172:0/2205194577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800cc8e0 0x7fef801625d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef700097a0 tx=0x7fef7002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.174+0000 7fef87c8f640 1 -- 172.21.15.172:0/2205194577 shutdown_connections 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.175+0000 7fef87c8f640 1 --2- 172.21.15.172:0/2205194577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800cc8e0 0x7fef801625d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.175+0000 7fef87c8f640 1 -- 172.21.15.172:0/2205194577 >> 172.21.15.172:0/2205194577 conn(0x7fef8006f590 msgr2=0x7fef8006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.175+0000 7fef87c8f640 1 -- 172.21.15.172:0/2205194577 shutdown_connections 2024-04-25T08:42:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.175+0000 7fef87c8f640 1 -- 172.21.15.172:0/2205194577 wait complete. 2024-04-25T08:42:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.176+0000 7fef87c8f640 1 Processor -- start 2024-04-25T08:42:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.176+0000 7fef87c8f640 1 -- start start 2024-04-25T08:42:51.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.176+0000 7fef87c8f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fef800cc8e0 0x7fef800c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.176+0000 7fef87c8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800d1810 0x7fef800c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.176+0000 7fef87c8f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef8015dc90 0x7fef800b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.176+0000 7fef87c8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8015e1f0 con 0x7fef800d1810 2024-04-25T08:42:51.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.176+0000 7fef87c8f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8015e070 con 0x7fef8015dc90 2024-04-25T08:42:51.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.176+0000 7fef87c8f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef800d1c80 con 0x7fef800cc8e0 2024-04-25T08:42:51.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef8522a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800d1810 0x7fef800c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef8522a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800d1810 0x7fef800c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50410/0 (socket says 172.21.15.172:50410) 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef8522a640 1 -- 172.21.15.172:0/645902505 learned_addr learned my addr 172.21.15.172:0/645902505 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef8622c640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef8015dc90 0x7fef800b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef85a2b640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fef800cc8e0 0x7fef800c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef8522a640 1 -- 172.21.15.172:0/645902505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fef800cc8e0 msgr2=0x7fef800c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef8522a640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fef800cc8e0 0x7fef800c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef8522a640 1 -- 172.21.15.172:0/645902505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef8015dc90 msgr2=0x7fef800b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef8522a640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef8015dc90 0x7fef800b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef8522a640 1 -- 172.21.15.172:0/645902505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800b5530 con 0x7fef800d1810 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef85a2b640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fef800cc8e0 0x7fef800c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef8522a640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800d1810 0x7fef800c8bc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef700098c0 tx=0x7fef700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef767fc640 1 -- 172.21.15.172:0/645902505 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70037040 con 0x7fef800d1810 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef767fc640 1 -- 172.21.15.172:0/645902505 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70042070 con 0x7fef800d1810 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef767fc640 1 -- 172.21.15.172:0/645902505 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70030a70 con 0x7fef800d1810 2024-04-25T08:42:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef87c8f640 1 -- 172.21.15.172:0/645902505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef800cb9d0 con 0x7fef800d1810 2024-04-25T08:42:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.177+0000 7fef87c8f640 1 -- 172.21.15.172:0/645902505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef800cbf90 con 0x7fef800d1810 2024-04-25T08:42:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.178+0000 7fef87c8f640 1 -- 172.21.15.172:0/645902505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef80073990 con 0x7fef800d1810 2024-04-25T08:42:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.178+0000 7fef767fc640 1 -- 172.21.15.172:0/645902505 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fef70030c10 con 0x7fef800d1810 2024-04-25T08:42:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.179+0000 7fef767fc640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fef6406b4d0 0x7fef6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.179+0000 7fef767fc640 1 -- 172.21.15.172:0/645902505 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fef700aaf10 con 0x7fef800d1810 2024-04-25T08:42:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.179+0000 7fef85a2b640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fef6406b4d0 0x7fef6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.179+0000 7fef85a2b640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fef6406b4d0 0x7fef6406d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fef7c007fd0 tx=0x7fef7c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:51.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.183+0000 7fef767fc640 1 -- 172.21.15.172:0/645902505 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fef70079a50 con 0x7fef800d1810 2024-04-25T08:42:51.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.396+0000 7fef87c8f640 1 -- 172.21.15.172:0/645902505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fef800cf6b0 con 0x7fef800d1810 2024-04-25T08:42:51.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.399+0000 7fef767fc640 1 -- 172.21.15.172:0/645902505 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171791 (secure 0 0 0) 0x7fef70079350 con 0x7fef800d1810 2024-04-25T08:42:51.393 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.401+0000 7fef87c8f640 1 -- 172.21.15.172:0/645902505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fef6406b4d0 msgr2=0x7fef6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.401+0000 7fef87c8f640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fef6406b4d0 0x7fef6406d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fef7c007fd0 tx=0x7fef7c009040 comp rx=0 tx=0).stop 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.401+0000 7fef87c8f640 1 -- 172.21.15.172:0/645902505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800d1810 msgr2=0x7fef800c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.401+0000 7fef87c8f640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800d1810 0x7fef800c8bc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef700098c0 tx=0x7fef700046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.402+0000 7fef87c8f640 1 -- 172.21.15.172:0/645902505 shutdown_connections 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.402+0000 7fef87c8f640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fef6406b4d0 0x7fef6406d990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.402+0000 7fef87c8f640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fef8015dc90 0x7fef800b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.402+0000 7fef87c8f640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef800d1810 0x7fef800c8bc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.402+0000 7fef87c8f640 1 --2- 172.21.15.172:0/645902505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fef800cc8e0 0x7fef800c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.402+0000 7fef87c8f640 1 -- 172.21.15.172:0/645902505 >> 172.21.15.172:0/645902505 conn(0x7fef8006f590 msgr2=0x7fef800cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.402+0000 7fef87c8f640 1 -- 172.21.15.172:0/645902505 shutdown_connections 2024-04-25T08:42:51.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.402+0000 7fef87c8f640 1 -- 172.21.15.172:0/645902505 wait complete. 2024-04-25T08:42:51.405 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2190189121},{"type":"v1","addr":"172.21.15.172:6833","nonce":2190189121}]},"active_addr":"172.21.15.172:6833/2190189121","active_change":"2024-04-25T08:42:08.502618+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1379217403}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":657304196}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":3729336759}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":4227439839}]}]} 2024-04-25T08:42:51.408 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T08:42:51.408 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T08:42:51.408 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:51.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.514+0000 7fa5b62bd640 1 Processor -- start 2024-04-25T08:42:51.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.514+0000 7fa5b62bd640 1 -- start start 2024-04-25T08:42:51.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.514+0000 7fa5b62bd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5b00d2e90 0x7fa5b00d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.514+0000 7fa5b62bd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b00b9940 con 0x7fa5b015dd30 2024-04-25T08:42:51.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.514+0000 7fa5b62bd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b00d1df0 con 0x7fa5b00d0900 2024-04-25T08:42:51.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.514+0000 7fa5b62bd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b00d0d40 con 0x7fa5b00d2e90 2024-04-25T08:42:51.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.515+0000 7fa5af7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5b00d2e90 0x7fa5b00d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.515+0000 7fa5affff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa5b015dd30 0x7fa5b00b9230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46190/0 (socket says 172.21.15.172:46190) 2024-04-25T08:42:51.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.515+0000 7fa5affff640 1 -- 172.21.15.172:0/195352693 learned_addr learned my addr 172.21.15.172:0/195352693 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:51.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.515+0000 7fa5af7fe640 1 -- 172.21.15.172:0/195352693 >> v1:172.21.15.186:6789/0 conn(0x7fa5b00d0900 legacy=0x7fa5b00b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.515+0000 7fa5af7fe640 1 -- 172.21.15.172:0/195352693 >> v1:172.21.15.172:6789/0 conn(0x7fa5b015dd30 legacy=0x7fa5b00b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.515+0000 7fa5af7fe640 1 -- 172.21.15.172:0/195352693 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b00d20d0 con 0x7fa5b00d2e90 2024-04-25T08:42:51.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5af7fe640 1 --2- 172.21.15.172:0/195352693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d2e90 0x7fa5b00d03c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009790 tx=0x7fa5a002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73221b323bc87271 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:51.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5aeffd640 1 -- 172.21.15.172:0/195352693 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0037070 con 0x7fa5b00d2e90 2024-04-25T08:42:51.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5aeffd640 1 -- 172.21.15.172:0/195352693 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a002ae50 con 0x7fa5b00d2e90 2024-04-25T08:42:51.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5aeffd640 1 -- 172.21.15.172:0/195352693 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0032660 con 0x7fa5b00d2e90 2024-04-25T08:42:51.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5b62bd640 1 -- 172.21.15.172:0/195352693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d2e90 msgr2=0x7fa5b00d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5b62bd640 1 --2- 172.21.15.172:0/195352693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d2e90 0x7fa5b00d03c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0009790 tx=0x7fa5a002a100 comp rx=0 tx=0).stop 2024-04-25T08:42:51.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5b62bd640 1 -- 172.21.15.172:0/195352693 shutdown_connections 2024-04-25T08:42:51.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5b62bd640 1 --2- 172.21.15.172:0/195352693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d2e90 0x7fa5b00d03c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5b62bd640 1 -- 172.21.15.172:0/195352693 >> 172.21.15.172:0/195352693 conn(0x7fa5b0061c30 msgr2=0x7fa5b006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:51.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5b62bd640 1 -- 172.21.15.172:0/195352693 shutdown_connections 2024-04-25T08:42:51.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.516+0000 7fa5b62bd640 1 -- 172.21.15.172:0/195352693 wait complete. 2024-04-25T08:42:51.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.518+0000 7fa5b62bd640 1 Processor -- start 2024-04-25T08:42:51.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.518+0000 7fa5b62bd640 1 -- start start 2024-04-25T08:42:51.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.518+0000 7fa5b62bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d0900 0x7fa5b01f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.518+0000 7fa5b62bd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5b00d2e90 0x7fa5b00b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.518+0000 7fa5b62bd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5b015dd30 0x7fa5b01e8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.518+0000 7fa5b62bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b00d2970 con 0x7fa5b00d0900 2024-04-25T08:42:51.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.518+0000 7fa5b62bd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b00d2690 con 0x7fa5b015dd30 2024-04-25T08:42:51.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.518+0000 7fa5b62bd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b00d1a10 con 0x7fa5b00d2e90 2024-04-25T08:42:51.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5affff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d0900 0x7fa5b01f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5affff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d0900 0x7fa5b01f7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50418/0 (socket says 172.21.15.172:50418) 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5affff640 1 -- 172.21.15.172:0/803232306 learned_addr learned my addr 172.21.15.172:0/803232306 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5b485a640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5b015dd30 0x7fa5b01e8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5af7fe640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5b00d2e90 0x7fa5b00b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5affff640 1 -- 172.21.15.172:0/803232306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5b00d2e90 msgr2=0x7fa5b00b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5affff640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5b00d2e90 0x7fa5b00b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5affff640 1 -- 172.21.15.172:0/803232306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5b015dd30 msgr2=0x7fa5b01e8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5affff640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5b015dd30 0x7fa5b01e8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5affff640 1 -- 172.21.15.172:0/803232306 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b00b3850 con 0x7fa5b00d0900 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5b485a640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5b015dd30 0x7fa5b01e8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5affff640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d0900 0x7fa5b01f7d70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400c4a0 tx=0x7fa5a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5acff9640 1 -- 172.21.15.172:0/803232306 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4017070 con 0x7fa5b00d0900 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5acff9640 1 -- 172.21.15.172:0/803232306 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a4005ce0 con 0x7fa5b00d0900 2024-04-25T08:42:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5b62bd640 1 -- 172.21.15.172:0/803232306 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b00b3b30 con 0x7fa5b00d0900 2024-04-25T08:42:51.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5acff9640 1 -- 172.21.15.172:0/803232306 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4007270 con 0x7fa5b00d0900 2024-04-25T08:42:51.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.519+0000 7fa5b62bd640 1 -- 172.21.15.172:0/803232306 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b00b40f0 con 0x7fa5b00d0900 2024-04-25T08:42:51.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.520+0000 7fa5b62bd640 1 -- 172.21.15.172:0/803232306 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b00d03c0 con 0x7fa5b00d0900 2024-04-25T08:42:51.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.521+0000 7fa5acff9640 1 -- 172.21.15.172:0/803232306 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa5a401a070 con 0x7fa5b00d0900 2024-04-25T08:42:51.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.521+0000 7fa5acff9640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59c06b4d0 0x7fa59c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.521+0000 7fa5acff9640 1 -- 172.21.15.172:0/803232306 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa5a4089770 con 0x7fa5b00d0900 2024-04-25T08:42:51.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.521+0000 7fa5af7fe640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59c06b4d0 0x7fa59c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.521+0000 7fa5af7fe640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59c06b4d0 0x7fa59c06d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0034000 tx=0x7fa5a002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:51.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.525+0000 7fa5acff9640 1 -- 172.21.15.172:0/803232306 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5b00d03c0 con 0x7fa5b00d0900 2024-04-25T08:42:51.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.698+0000 7fa5b62bd640 1 -- 172.21.15.172:0/803232306 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5b00b66b0 con 0x7fa5b00d0900 2024-04-25T08:42:51.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.699+0000 7fa5acff9640 1 -- 172.21.15.172:0/803232306 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7fa5a4057c60 con 0x7fa5b00d0900 2024-04-25T08:42:51.692 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:51.692 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:51.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.701+0000 7fa5b62bd640 1 -- 172.21.15.172:0/803232306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59c06b4d0 msgr2=0x7fa59c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.701+0000 7fa5b62bd640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59c06b4d0 0x7fa59c06d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0034000 tx=0x7fa5a002e000 comp rx=0 tx=0).stop 2024-04-25T08:42:51.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.701+0000 7fa5b62bd640 1 -- 172.21.15.172:0/803232306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d0900 msgr2=0x7fa5b01f7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.701+0000 7fa5b62bd640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d0900 0x7fa5b01f7d70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400c4a0 tx=0x7fa5a400c960 comp rx=0 tx=0).stop 2024-04-25T08:42:51.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.701+0000 7fa5b62bd640 1 -- 172.21.15.172:0/803232306 shutdown_connections 2024-04-25T08:42:51.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.701+0000 7fa5b62bd640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa59c06b4d0 0x7fa59c06d990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.701+0000 7fa5b62bd640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5b015dd30 0x7fa5b01e8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.701+0000 7fa5b62bd640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5b00d2e90 0x7fa5b00b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.701+0000 7fa5b62bd640 1 --2- 172.21.15.172:0/803232306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5b00d0900 0x7fa5b01f7d70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.701+0000 7fa5b62bd640 1 -- 172.21.15.172:0/803232306 >> 172.21.15.172:0/803232306 conn(0x7fa5b0061c30 msgr2=0x7fa5b0160120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:51.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.702+0000 7fa5b62bd640 1 -- 172.21.15.172:0/803232306 shutdown_connections 2024-04-25T08:42:51.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.702+0000 7fa5b62bd640 1 -- 172.21.15.172:0/803232306 wait complete. 2024-04-25T08:42:51.705 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T08:42:51.705 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:51.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.812+0000 7f735d2bc640 1 Processor -- start 2024-04-25T08:42:51.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.812+0000 7f735d2bc640 1 -- start start 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.812+0000 7f735d2bc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f735815dbe0 0x7f73580d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.812+0000 7f735d2bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73580b92a0 0x7f73580d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f735d2bc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73580b97a0 con 0x7f73580b2cb0 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f735d2bc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735815dfc0 con 0x7f735815dbe0 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f735d2bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73580d1a00 con 0x7f73580b92a0 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f73567fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f73580b2cb0 0x7f73580b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46200/0 (socket says 172.21.15.172:46200) 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f73567fc640 1 -- 172.21.15.172:0/362103009 learned_addr learned my addr 172.21.15.172:0/362103009 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7356ffd640 1 --2- 172.21.15.172:0/362103009 >> v2:172.21.15.186:3300/0 conn(0x7f735815dbe0 0x7f73580d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f73577fe640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73580b92a0 0x7f73580d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193814589 0 0) 0x7f73580b97a0 con 0x7f73580b2cb0 2024-04-25T08:42:51.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7340003520 con 0x7f73580b2cb0 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3110959210 0 0) 0x7f7340003520 con 0x7f73580b2cb0 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73580b92a0 msgr2=0x7f73580d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73580b92a0 0x7f73580d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 >> v2:172.21.15.186:3300/0 conn(0x7f735815dbe0 msgr2=0x7f73580d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 --2- 172.21.15.172:0/362103009 >> v2:172.21.15.186:3300/0 conn(0x7f735815dbe0 0x7f73580d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73580d1c50 con 0x7f73580b2cb0 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7356ffd640 1 --2- 172.21.15.172:0/362103009 >> v2:172.21.15.186:3300/0 conn(0x7f735815dbe0 0x7f73580d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f734c001670 con 0x7f73580b2cb0 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 >> v1:172.21.15.172:6789/0 conn(0x7f73580b2cb0 legacy=0x7f73580b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73400039b0 0x7f7340003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7340004800 0x7f7340004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73580b92a0 0x7f73400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73580d1a00 con 0x7f73400039b0 2024-04-25T08:42:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734000b9c0 con 0x7f7340004800 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734000bb40 con 0x7f73580b92a0 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f7356ffd640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73400039b0 0x7f7340003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.813+0000 7f73567fc640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7340004800 0x7f7340004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.814+0000 7f73577fe640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73580b92a0 0x7f73400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.814+0000 7f7356ffd640 1 -- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73580b92a0 msgr2=0x7f73400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.814+0000 7f7356ffd640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73580b92a0 0x7f73400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.814+0000 7f7356ffd640 1 -- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7340004800 msgr2=0x7f7340004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.814+0000 7f7356ffd640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7340004800 0x7f7340004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.814+0000 7f7356ffd640 1 -- 172.21.15.172:0/362103009 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340003520 con 0x7f73400039b0 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.814+0000 7f7356ffd640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73400039b0 0x7f7340003dd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7348009c90 tx=0x7f7340005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d08470d00dd7a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.814+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348036070 con 0x7f73400039b0 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.814+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7348031400 con 0x7f73400039b0 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.815+0000 7f7355ffb640 1 -- 172.21.15.172:0/362103009 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348009860 con 0x7f73400039b0 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.815+0000 7f735d2bc640 1 -- 172.21.15.172:0/362103009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73400039b0 msgr2=0x7f7340003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.815+0000 7f735d2bc640 1 --2- 172.21.15.172:0/362103009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73400039b0 0x7f7340003dd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7348009c90 tx=0x7f7340005830 comp rx=0 tx=0).stop 2024-04-25T08:42:51.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.815+0000 7f73577fe640 1 -- 172.21.15.172:0/362103009 reap_dead start 2024-04-25T08:42:51.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.815+0000 7f735d2bc640 1 -- 172.21.15.172:0/362103009 shutdown_connections 2024-04-25T08:42:51.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.815+0000 7f735d2bc640 1 -- 172.21.15.172:0/362103009 >> 172.21.15.172:0/362103009 conn(0x7f7358061a20 msgr2=0x7f7358061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:51.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.815+0000 7f735d2bc640 1 -- 172.21.15.172:0/362103009 shutdown_connections 2024-04-25T08:42:51.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.815+0000 7f735d2bc640 1 -- 172.21.15.172:0/362103009 wait complete. 2024-04-25T08:42:51.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.816+0000 7f735d2bc640 1 Processor -- start 2024-04-25T08:42:51.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.816+0000 7f735d2bc640 1 -- start start 2024-04-25T08:42:51.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.817+0000 7f735d2bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73400039b0 0x7f73581f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.817+0000 7f735d2bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735814e1e0 0x7f7358153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.817+0000 7f735d2bc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358154160 0x7f73581f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.817+0000 7f735d2bc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73580b6ab0 con 0x7f735814e1e0 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.817+0000 7f735d2bc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73580d2210 con 0x7f7358154160 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.817+0000 7f735d2bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73580b6c30 con 0x7f73400039b0 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.817+0000 7f73567fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735814e1e0 0x7f7358153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.817+0000 7f73567fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735814e1e0 0x7f7358153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50440/0 (socket says 172.21.15.172:50440) 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.817+0000 7f73567fc640 1 -- 172.21.15.172:0/1060854267 learned_addr learned my addr 172.21.15.172:0/1060854267 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f73577fe640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358154160 0x7f73581f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f73567fc640 1 -- 172.21.15.172:0/1060854267 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73400039b0 msgr2=0x7f73581f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f73567fc640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73400039b0 0x7f73581f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f73567fc640 1 -- 172.21.15.172:0/1060854267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358154160 msgr2=0x7f73581f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f73567fc640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358154160 0x7f73581f6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f73567fc640 1 -- 172.21.15.172:0/1060854267 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73581527c0 con 0x7f735814e1e0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f73567fc640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735814e1e0 0x7f7358153c20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f734c007340 tx=0x7f734c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f733f7fe640 1 -- 172.21.15.172:0/1060854267 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00f9c0 con 0x7f735814e1e0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f733f7fe640 1 -- 172.21.15.172:0/1060854267 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734c018070 con 0x7f735814e1e0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f735d2bc640 1 -- 172.21.15.172:0/1060854267 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73581f4410 con 0x7f735814e1e0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f733f7fe640 1 -- 172.21.15.172:0/1060854267 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c00fde0 con 0x7f735814e1e0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.818+0000 7f735d2bc640 1 -- 172.21.15.172:0/1060854267 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7358152200 con 0x7f735814e1e0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.819+0000 7f735d2bc640 1 -- 172.21.15.172:0/1060854267 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7358073990 con 0x7f735814e1e0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.819+0000 7f733f7fe640 1 -- 172.21.15.172:0/1060854267 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f734c01d460 con 0x7f735814e1e0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.820+0000 7f733f7fe640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f734406b500 0x7f734406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.820+0000 7f733f7fe640 1 -- 172.21.15.172:0/1060854267 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f734c08a5f0 con 0x7f735814e1e0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.820+0000 7f7356ffd640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f734406b500 0x7f734406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:51.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.820+0000 7f7356ffd640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f734406b500 0x7f734406d9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7348033000 tx=0x7f734802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:51.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.824+0000 7f733f7fe640 1 -- 172.21.15.172:0/1060854267 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f73581f4410 con 0x7f735814e1e0 2024-04-25T08:42:51.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.994+0000 7f735d2bc640 1 -- 172.21.15.172:0/1060854267 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f735806b080 con 0x7f735814e1e0 2024-04-25T08:42:51.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.995+0000 7f733f7fe640 1 -- 172.21.15.172:0/1060854267 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f73581527c0 con 0x7f735814e1e0 2024-04-25T08:42:51.988 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:51.988 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:51.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 -- 172.21.15.172:0/1060854267 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f734406b500 msgr2=0x7f734406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f734406b500 0x7f734406d9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7348033000 tx=0x7f734802e000 comp rx=0 tx=0).stop 2024-04-25T08:42:51.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 -- 172.21.15.172:0/1060854267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735814e1e0 msgr2=0x7f7358153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:51.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735814e1e0 0x7f7358153c20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f734c007340 tx=0x7f734c007800 comp rx=0 tx=0).stop 2024-04-25T08:42:51.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 -- 172.21.15.172:0/1060854267 shutdown_connections 2024-04-25T08:42:51.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f734406b500 0x7f734406d9c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7358154160 0x7f73581f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735814e1e0 0x7f7358153c20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 --2- 172.21.15.172:0/1060854267 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73400039b0 0x7f73581f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:51.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 -- 172.21.15.172:0/1060854267 >> 172.21.15.172:0/1060854267 conn(0x7f7358061a20 msgr2=0x7f735815b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:51.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 -- 172.21.15.172:0/1060854267 shutdown_connections 2024-04-25T08:42:51.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:51.997+0000 7f735d2bc640 1 -- 172.21.15.172:0/1060854267 wait complete. 2024-04-25T08:42:52.001 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T08:42:52.001 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T08:42:52.002 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T08:42:52.002 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T08:42:52.003 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T08:42:52.003 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T08:42:52.003 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T08:42:52.004 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T08:42:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.174+0000 7f3fa489e640 1 Processor -- start 2024-04-25T08:42:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.174+0000 7f3fa489e640 1 -- start start 2024-04-25T08:42:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.175+0000 7fdd2785d640 1 Processor -- start 2024-04-25T08:42:52.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.176+0000 7f3fa489e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3fa0072a10 0x7f3fa015e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.175+0000 7fdd2785d640 1 -- start start 2024-04-25T08:42:52.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.176+0000 7f3f9dd9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3fa0143a80 0x7f3fa0072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46202/0 (socket says 172.21.15.172:46202) 2024-04-25T08:42:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.176+0000 7f3f9ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3fa0072a10 0x7f3fa015e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.177+0000 7f3f9ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3fa0072a10 0x7f3fa015e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50444/0 (socket says 172.21.15.172:50444) 2024-04-25T08:42:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.177+0000 7f3f9dd9b640 1 -- 172.21.15.172:0/197606461 learned_addr learned my addr 172.21.15.172:0/197606461 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.177+0000 7f3fa489e640 1 -- 172.21.15.172:0/197606461 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa01437e0 con 0x7f3fa0143a80 2024-04-25T08:42:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.177+0000 7f3fa489e640 1 -- 172.21.15.172:0/197606461 --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa00cd6b0 con 0x7f3fa0143400 2024-04-25T08:42:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.177+0000 7f3fa489e640 1 -- 172.21.15.172:0/197606461 --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa00b43b0 con 0x7f3fa0072a10 2024-04-25T08:42:52.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7faf3ab27640 1 Processor -- start 2024-04-25T08:42:52.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7f3f9ed9d640 1 -- 172.21.15.172:0/197606461 >> v1:172.21.15.186:6789/0 conn(0x7f3fa0143400 legacy=0x7f3fa00b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7f3f9ed9d640 1 -- 172.21.15.172:0/197606461 >> v1:172.21.15.172:6789/0 conn(0x7f3fa0143a80 legacy=0x7f3fa0072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7f3f9ed9d640 1 -- 172.21.15.172:0/197606461 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00cd990 con 0x7f3fa0072a10 2024-04-25T08:42:52.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7fde924b2640 1 Processor -- start 2024-04-25T08:42:52.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7fde924b2640 1 -- start start 2024-04-25T08:42:52.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fde924b2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fde8c06fdc0 0x7fde8c0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fde924b2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8c070230 con 0x7fde8c06f930 2024-04-25T08:42:52.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fde924b2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8c06b6a0 con 0x7fde8c15dbc0 2024-04-25T08:42:52.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fde924b2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c06b980 con 0x7fde8c06fdc0 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.177+0000 7fdd2785d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180e3150 0x7fdd180e7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.177+0000 7fdd2785d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdd18053ca0 0x7fdd18054110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.177+0000 7fdd2785d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd18054650 con 0x7fdd1803c090 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.177+0000 7fdd2785d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd18007b60 con 0x7fdd18053ca0 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.177+0000 7fdd2785d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18058800 con 0x7fdd180e3150 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7fdd255f9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180e3150 0x7fdd180e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7fdd255f9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180e3150 0x7fdd180e7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43590/0 (socket says 172.21.15.172:43590) 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7fdd255f9640 1 -- 172.21.15.172:0/1953523093 learned_addr learned my addr 172.21.15.172:0/1953523093 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7fdd13fff640 1 -- 172.21.15.172:0/1953523093 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96200509 0 0) 0x7fdd18054650 con 0x7fdd1803c090 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7fdd13fff640 1 -- 172.21.15.172:0/1953523093 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd0c003520 con 0x7fdd1803c090 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.179+0000 7fdd255f9640 1 -- 172.21.15.172:0/1953523093 >> v2:172.21.15.186:3300/0 conn(0x7fdd18053ca0 msgr2=0x7fdd18054110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T08:42:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.179+0000 7fdd255f9640 1 --2- 172.21.15.172:0/1953523093 >> v2:172.21.15.186:3300/0 conn(0x7fdd18053ca0 0x7fdd18054110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.179+0000 7fdd255f9640 1 -- 172.21.15.172:0/1953523093 >> v1:172.21.15.172:6789/0 conn(0x7fdd1803c090 legacy=0x7fdd18058040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.179+0000 7fdd255f9640 1 -- 172.21.15.172:0/1953523093 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18058ae0 con 0x7fdd180e3150 2024-04-25T08:42:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.178+0000 7faf3ab27640 1 -- start start 2024-04-25T08:42:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.179+0000 7fa538116640 1 Processor -- start 2024-04-25T08:42:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.179+0000 7fa538116640 1 -- start start 2024-04-25T08:42:52.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.179+0000 7f3f9ed9d640 1 --2- 172.21.15.172:0/197606461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa0072a10 0x7f3fa015e6a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009d90 tx=0x7f3f9802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b29d71f634387b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.179+0000 7f3f9d59a640 1 -- 172.21.15.172:0/197606461 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98036020 con 0x7f3fa0072a10 2024-04-25T08:42:52.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.179+0000 7f3f9d59a640 1 -- 172.21.15.172:0/197606461 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f98032820 con 0x7f3fa0072a10 2024-04-25T08:42:52.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.179+0000 7f3f9d59a640 1 -- 172.21.15.172:0/197606461 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98032c30 con 0x7f3fa0072a10 2024-04-25T08:42:52.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fde90caf640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fde8c06f930 0x7fde8c0ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46210/0 (socket says 172.21.15.172:46210) 2024-04-25T08:42:52.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fde90caf640 1 -- 172.21.15.172:0/3295005093 learned_addr learned my addr 172.21.15.172:0/3295005093 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:52.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7faf3ab27640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 0x7faf34165060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7faf3ab27640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340b3be0 con 0x7faf340b3e30 2024-04-25T08:42:52.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7faf3ab27640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3415a4a0 con 0x7faf3406bbf0 2024-04-25T08:42:52.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7faf3ab27640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf34157d80 con 0x7faf34162c70 2024-04-25T08:42:52.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fdd255f9640 1 --2- 172.21.15.172:0/1953523093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180e3150 0x7fdd180e7770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009870 tx=0x7fdd1c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4c897fc07c53d2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fde91cb1640 1 --2- 172.21.15.172:0/3295005093 >> v2:172.21.15.186:3300/0 conn(0x7fde8c06fdc0 0x7fde8c0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fde83fff640 1 -- 172.21.15.172:0/3295005093 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798371365 0 0) 0x7fde8c070230 con 0x7fde8c06f930 2024-04-25T08:42:52.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fde83fff640 1 -- 172.21.15.172:0/3295005093 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde78003520 con 0x7fde8c06f930 2024-04-25T08:42:52.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7faf3a326640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 0x7faf34165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7faf3a326640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 0x7faf34165060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43598/0 (socket says 172.21.15.172:43598) 2024-04-25T08:42:52.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7f3fa489e640 1 -- 172.21.15.172:0/197606461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa0072a10 msgr2=0x7f3fa015e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7f3fa489e640 1 --2- 172.21.15.172:0/197606461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa0072a10 0x7f3fa015e6a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009d90 tx=0x7f3f9802c920 comp rx=0 tx=0).stop 2024-04-25T08:42:52.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7faf3a326640 1 -- 172.21.15.172:0/1251718159 learned_addr learned my addr 172.21.15.172:0/1251718159 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fde83fff640 1 -- 172.21.15.172:0/3295005093 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423938891 0 0) 0x7fde8c06b6a0 con 0x7fde8c15dbc0 2024-04-25T08:42:52.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fde83fff640 1 -- 172.21.15.172:0/3295005093 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde780048e0 con 0x7fde8c15dbc0 2024-04-25T08:42:52.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fdd13fff640 1 -- 172.21.15.172:0/1953523093 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c037070 con 0x7fdd180e3150 2024-04-25T08:42:52.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fde91cb1640 1 -- 172.21.15.172:0/3295005093 >> v1:172.21.15.186:6789/0 conn(0x7fde8c15dbc0 legacy=0x7fde8c06abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fdd13fff640 1 -- 172.21.15.172:0/1953523093 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c032440 con 0x7fdd180e3150 2024-04-25T08:42:52.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fa538116640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa53006b6d0 0x7fa53015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fde91cb1640 1 -- 172.21.15.172:0/3295005093 >> v1:172.21.15.172:6789/0 conn(0x7fde8c06f930 legacy=0x7fde8c0ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fde91cb1640 1 -- 172.21.15.172:0/3295005093 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c06bc60 con 0x7fde8c06fdc0 2024-04-25T08:42:52.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7f3fa489e640 1 -- 172.21.15.172:0/197606461 shutdown_connections 2024-04-25T08:42:52.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7f3fa489e640 1 --2- 172.21.15.172:0/197606461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa0072a10 0x7f3fa015e6a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7faf38b23640 1 -- 172.21.15.172:0/1251718159 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953432483 0 0) 0x7faf3415a4a0 con 0x7faf3406bbf0 2024-04-25T08:42:52.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fa538116640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa530157490 0x7fa530157910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fa538116640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5300cd2e0 0x7fa5300cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fa538116640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53015e7d0 con 0x7fa5300cd2e0 2024-04-25T08:42:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fa538116640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53015d840 con 0x7fa530157490 2024-04-25T08:42:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.180+0000 7fa538116640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa530071f30 con 0x7fa53006b6d0 2024-04-25T08:42:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fa535eb2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa53006b6d0 0x7fa53015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fa535eb2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa53006b6d0 0x7fa53015e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43604/0 (socket says 172.21.15.172:43604) 2024-04-25T08:42:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fa535eb2640 1 -- 172.21.15.172:0/4032350280 learned_addr learned my addr 172.21.15.172:0/4032350280 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fa5356b1640 1 --2- 172.21.15.172:0/4032350280 >> v2:172.21.15.186:3300/0 conn(0x7fa530157490 0x7fa530157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fa5356b1640 1 -- 172.21.15.172:0/4032350280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa53006b6d0 msgr2=0x7fa53015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fa5356b1640 1 --2- 172.21.15.172:0/4032350280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa53006b6d0 0x7fa53015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fa5356b1640 1 -- 172.21.15.172:0/4032350280 >> v2:172.21.15.172:3300/0 conn(0x7fa5300cd2e0 msgr2=0x7fa5300cd790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T08:42:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7faf38b23640 1 -- 172.21.15.172:0/1251718159 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf20003520 con 0x7faf3406bbf0 2024-04-25T08:42:52.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fa5366b3640 1 --2- 172.21.15.172:0/4032350280 >> v2:172.21.15.172:3300/0 conn(0x7fa5300cd2e0 0x7fa5300cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7f3fa489e640 1 -- 172.21.15.172:0/197606461 >> 172.21.15.172:0/197606461 conn(0x7f3fa006e390 msgr2=0x7f3fa006e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7faf3a326640 1 -- 172.21.15.172:0/1251718159 >> v1:172.21.15.186:6789/0 conn(0x7faf3406bbf0 legacy=0x7faf3406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7efc086a3640 1 Processor -- start 2024-04-25T08:42:52.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7efc086a3640 1 -- start start 2024-04-25T08:42:52.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7faf3a326640 1 -- 172.21.15.172:0/1251718159 >> v1:172.21.15.172:6789/0 conn(0x7faf340b3e30 legacy=0x7faf340b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fde91cb1640 1 --2- 172.21.15.172:0/3295005093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde8c06fdc0 0x7fde8c0cea30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde88009d90 tx=0x7fde8802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e542753f4738de82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fde83fff640 1 -- 172.21.15.172:0/3295005093 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88007740 con 0x7fde8c06fdc0 2024-04-25T08:42:52.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fdd13fff640 1 -- 172.21.15.172:0/1953523093 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c032810 con 0x7fdd180e3150 2024-04-25T08:42:52.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fdd2785d640 1 -- 172.21.15.172:0/1953523093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180e3150 msgr2=0x7fdd180e7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fdd2785d640 1 --2- 172.21.15.172:0/1953523093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180e3150 0x7fdd180e7770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009870 tx=0x7fdd1c02a250 comp rx=0 tx=0).stop 2024-04-25T08:42:52.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fdd2785d640 1 -- 172.21.15.172:0/1953523093 shutdown_connections 2024-04-25T08:42:52.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fdd2785d640 1 --2- 172.21.15.172:0/1953523093 >> v2:172.21.15.186:3300/0 conn(0x7fdd18053ca0 0x7fdd18054110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fdd2785d640 1 --2- 172.21.15.172:0/1953523093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd180e3150 0x7fdd180e7770 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fdd2785d640 1 -- 172.21.15.172:0/1953523093 >> 172.21.15.172:0/1953523093 conn(0x7fdd18058ed0 msgr2=0x7fdd180592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fdd2785d640 1 -- 172.21.15.172:0/1953523093 shutdown_connections 2024-04-25T08:42:52.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7faf3a326640 1 -- 172.21.15.172:0/1251718159 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3415a780 con 0x7faf34162c70 2024-04-25T08:42:52.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7f3fa489e640 1 -- 172.21.15.172:0/197606461 shutdown_connections 2024-04-25T08:42:52.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fa5356b1640 1 --2- 172.21.15.172:0/4032350280 >> v2:172.21.15.172:3300/0 conn(0x7fa5300cd2e0 0x7fa5300cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.181+0000 7fa5356b1640 1 -- 172.21.15.172:0/4032350280 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53015da90 con 0x7fa530157490 2024-04-25T08:42:52.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fa5366b3640 1 --2- 172.21.15.172:0/4032350280 >> v2:172.21.15.172:3300/0 conn(0x7fa5300cd2e0 0x7fa5300cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:52.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7f3fa489e640 1 -- 172.21.15.172:0/197606461 wait complete. 2024-04-25T08:42:52.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fa5356b1640 1 --2- 172.21.15.172:0/4032350280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa530157490 0x7fa530157910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa53006c060 tx=0x7fa52802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=643b853fee65b1e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7faf3a326640 1 --2- 172.21.15.172:0/1251718159 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 0x7faf34165060 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faf240098a0 tx=0x7faf2402a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=363fbed54d152529 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fde83fff640 1 -- 172.21.15.172:0/3295005093 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880078e0 con 0x7fde8c06fdc0 2024-04-25T08:42:52.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.182+0000 7fde83fff640 1 -- 172.21.15.172:0/3295005093 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88007740 con 0x7fde8c06fdc0 2024-04-25T08:42:52.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7fb5b8370640 1 Processor -- start 2024-04-25T08:42:52.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7efc086a3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efbf80546c0 0x7efbf8038170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7efc086a3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efbf804f0b0 0x7efbf804fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7efc086a3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf8005f60 con 0x7efbf800c0d0 2024-04-25T08:42:52.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7efc086a3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80df4d0 con 0x7efbf80546c0 2024-04-25T08:42:52.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7efc086a3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80e38e0 con 0x7efbf804f0b0 2024-04-25T08:42:52.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7faf38b23640 1 -- 172.21.15.172:0/1251718159 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24037070 con 0x7faf34162c70 2024-04-25T08:42:52.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7faf38b23640 1 -- 172.21.15.172:0/1251718159 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf24032640 con 0x7faf34162c70 2024-04-25T08:42:52.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7faf38b23640 1 -- 172.21.15.172:0/1251718159 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24032a10 con 0x7faf34162c70 2024-04-25T08:42:52.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7fa534eb0640 1 -- 172.21.15.172:0/4032350280 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528007740 con 0x7fa530157490 2024-04-25T08:42:52.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7efc05c3e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efbf800c0d0 0x7efbf80dedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46234/0 (socket says 172.21.15.172:46234) 2024-04-25T08:42:52.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7efc05c3e640 1 -- 172.21.15.172:0/2645888661 learned_addr learned my addr 172.21.15.172:0/2645888661 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:52.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7efc0643f640 1 --2- 172.21.15.172:0/2645888661 >> v2:172.21.15.172:3300/0 conn(0x7efbf80546c0 0x7efbf8038170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7fb5b8370640 1 -- start start 2024-04-25T08:42:52.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7fde924b2640 1 -- 172.21.15.172:0/3295005093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde8c06fdc0 msgr2=0x7fde8c0cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7fa534eb0640 1 -- 172.21.15.172:0/4032350280 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5280078e0 con 0x7fa530157490 2024-04-25T08:42:52.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7fa534eb0640 1 -- 172.21.15.172:0/4032350280 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528007cf0 con 0x7fa530157490 2024-04-25T08:42:52.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7fde924b2640 1 --2- 172.21.15.172:0/3295005093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde8c06fdc0 0x7fde8c0cea30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fde88009d90 tx=0x7fde8802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7fde924b2640 1 -- 172.21.15.172:0/3295005093 shutdown_connections 2024-04-25T08:42:52.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7fde924b2640 1 --2- 172.21.15.172:0/3295005093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde8c06fdc0 0x7fde8c0cea30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.183+0000 7fde924b2640 1 -- 172.21.15.172:0/3295005093 >> 172.21.15.172:0/3295005093 conn(0x7fde8c0d04e0 msgr2=0x7fde8c0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7fa538116640 1 -- 172.21.15.172:0/4032350280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa530157490 msgr2=0x7fa530157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7efc06c40640 1 --2- 172.21.15.172:0/2645888661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efbf804f0b0 0x7efbf804fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7efc0643f640 1 -- 172.21.15.172:0/2645888661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efbf804f0b0 msgr2=0x7efbf804fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7efc0643f640 1 --2- 172.21.15.172:0/2645888661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efbf804f0b0 0x7efbf804fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7efc0643f640 1 -- 172.21.15.172:0/2645888661 >> v1:172.21.15.172:6789/0 conn(0x7efbf800c0d0 legacy=0x7efbf80dedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7efc0643f640 1 -- 172.21.15.172:0/2645888661 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8006200 con 0x7efbf80546c0 2024-04-25T08:42:52.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7fa538116640 1 --2- 172.21.15.172:0/4032350280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa530157490 0x7fa530157910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa53006c060 tx=0x7fa52802a680 comp rx=0 tx=0).stop 2024-04-25T08:42:52.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7fdd2785d640 1 -- 172.21.15.172:0/1953523093 wait complete. 2024-04-25T08:42:52.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7f2644c53640 1 Processor -- start 2024-04-25T08:42:52.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7faf3ab27640 1 -- 172.21.15.172:0/1251718159 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 msgr2=0x7faf34165060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7faf3ab27640 1 --2- 172.21.15.172:0/1251718159 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 0x7faf34165060 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faf240098a0 tx=0x7faf2402a2e0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7fde924b2640 1 -- 172.21.15.172:0/3295005093 shutdown_connections 2024-04-25T08:42:52.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7faf3ab27640 1 -- 172.21.15.172:0/1251718159 shutdown_connections 2024-04-25T08:42:52.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7faf3ab27640 1 --2- 172.21.15.172:0/1251718159 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 0x7faf34165060 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7faf3ab27640 1 -- 172.21.15.172:0/1251718159 >> 172.21.15.172:0/1251718159 conn(0x7faf34071ad0 msgr2=0x7faf34071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7fa538116640 1 -- 172.21.15.172:0/4032350280 shutdown_connections 2024-04-25T08:42:52.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7fa538116640 1 --2- 172.21.15.172:0/4032350280 >> v2:172.21.15.172:3300/0 conn(0x7fa5300cd2e0 0x7fa5300cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7fa538116640 1 --2- 172.21.15.172:0/4032350280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa530157490 0x7fa530157910 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7faf3ab27640 1 -- 172.21.15.172:0/1251718159 shutdown_connections 2024-04-25T08:42:52.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7faf3ab27640 1 -- 172.21.15.172:0/1251718159 wait complete. 2024-04-25T08:42:52.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7f3fa489e640 1 Processor -- start 2024-04-25T08:42:52.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7f3fa489e640 1 -- start start 2024-04-25T08:42:52.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7fb5b8370640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 0x7fb5b00cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7fb5b8370640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb5b00cef10 0x7fb5b00cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7fa538116640 1 --2- 172.21.15.172:0/4032350280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa53006b6d0 0x7fa53015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7fa538116640 1 -- 172.21.15.172:0/4032350280 >> 172.21.15.172:0/4032350280 conn(0x7fa53006abe0 msgr2=0x7fa53006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7fa538116640 1 -- 172.21.15.172:0/4032350280 shutdown_connections 2024-04-25T08:42:52.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7fb5b610c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 0x7fb5b00cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7fb5b610c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 0x7fb5b00cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43628/0 (socket says 172.21.15.172:43628) 2024-04-25T08:42:52.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7fb5b610c640 1 -- 172.21.15.172:0/3945550010 learned_addr learned my addr 172.21.15.172:0/3945550010 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7fb5b590b640 1 --2- 172.21.15.172:0/3945550010 >> v2:172.21.15.186:3300/0 conn(0x7fb5b00cef10 0x7fb5b00cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7efc0643f640 1 --2- 172.21.15.172:0/2645888661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf80546c0 0x7efbf8038170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097a0 tx=0x7efbfc02a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f6fb3147f1648a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fb5b8370640 1 -- 172.21.15.172:0/3945550010 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b015b1c0 con 0x7fb5b006f360 2024-04-25T08:42:52.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7f2644c53640 1 -- start start 2024-04-25T08:42:52.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7f2644c53640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f26401658b0 0x7f2640165c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7f2644c53640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f264006dc80 0x7f264006e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f2644c53640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 0x7f2640162770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f2644c53640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2640166710 con 0x7f264006dc80 2024-04-25T08:42:52.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f2644c53640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26400cd410 con 0x7f26401658b0 2024-04-25T08:42:52.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f2644c53640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264006ebe0 con 0x7f2640162300 2024-04-25T08:42:52.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7efc0543d640 1 -- 172.21.15.172:0/2645888661 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc037070 con 0x7efbf80546c0 2024-04-25T08:42:52.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fb5b8370640 1 -- 172.21.15.172:0/3945550010 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b006f0d0 con 0x7fb5b00cef10 2024-04-25T08:42:52.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fb5b8370640 1 -- 172.21.15.172:0/3945550010 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015a2a0 con 0x7fb5b0154150 2024-04-25T08:42:52.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.184+0000 7fde924b2640 1 -- 172.21.15.172:0/3295005093 wait complete. 2024-04-25T08:42:52.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7fdd2785d640 1 Processor -- start 2024-04-25T08:42:52.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.185+0000 7fdd2785d640 1 -- start start 2024-04-25T08:42:52.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f263effd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f264006dc80 0x7f264006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f263effd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f264006dc80 0x7f264006e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50480/0 (socket says 172.21.15.172:50480) 2024-04-25T08:42:52.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f263effd640 1 -- 172.21.15.172:0/3017312642 learned_addr learned my addr 172.21.15.172:0/3017312642 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f263f7fe640 1 --2- 172.21.15.172:0/3017312642 >> v2:172.21.15.186:3300/0 conn(0x7f26401658b0 0x7f2640165c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fb5b510a640 1 -- 172.21.15.172:0/3945550010 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332147540 0 0) 0x7fb5b015b1c0 con 0x7fb5b006f360 2024-04-25T08:42:52.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f263ffff640 1 --2- 172.21.15.172:0/3017312642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 0x7f2640162770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fb5b510a640 1 -- 172.21.15.172:0/3945550010 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb59c003520 con 0x7fb5b006f360 2024-04-25T08:42:52.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7efc0543d640 1 -- 172.21.15.172:0/2645888661 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc02ad50 con 0x7efbf80546c0 2024-04-25T08:42:52.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7efc0543d640 1 -- 172.21.15.172:0/2645888661 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc032660 con 0x7efbf80546c0 2024-04-25T08:42:52.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fde924b2640 1 Processor -- start 2024-04-25T08:42:52.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7faf3ab27640 1 Processor -- start 2024-04-25T08:42:52.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7faf3ab27640 1 -- start start 2024-04-25T08:42:52.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fb5b610c640 1 -- 172.21.15.172:0/3945550010 >> v2:172.21.15.186:3300/0 conn(0x7fb5b00cef10 msgr2=0x7fb5b00cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fb5b610c640 1 --2- 172.21.15.172:0/3945550010 >> v2:172.21.15.186:3300/0 conn(0x7fb5b00cef10 0x7fb5b00cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fb5b610c640 1 -- 172.21.15.172:0/3945550010 >> v1:172.21.15.172:6789/0 conn(0x7fb5b006f360 legacy=0x7fb5b015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fb5b610c640 1 -- 172.21.15.172:0/3945550010 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b015a540 con 0x7fb5b0154150 2024-04-25T08:42:52.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f3fa489e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa0072a10 0x7f3fa0139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f3fa489e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fa0143400 0x7f3fa015ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f3f9e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa0072a10 0x7f3fa0139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f3fa489e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fa0143a80 0x7f3fa015c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f3fa489e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00cdf50 con 0x7f3fa0072a10 2024-04-25T08:42:52.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f3f9e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa0072a10 0x7f3fa0139db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50496/0 (socket says 172.21.15.172:50496) 2024-04-25T08:42:52.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f3f9e59c640 1 -- 172.21.15.172:0/3884488866 learned_addr learned my addr 172.21.15.172:0/3884488866 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7f3f9dd9b640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fa0143400 0x7f3fa015ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7f263effd640 1 -- 172.21.15.172:0/3017312642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 msgr2=0x7f2640162770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7f263effd640 1 --2- 172.21.15.172:0/3017312642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 0x7f2640162770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7f263effd640 1 -- 172.21.15.172:0/3017312642 >> v2:172.21.15.186:3300/0 conn(0x7f26401658b0 msgr2=0x7f2640165c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7f263effd640 1 --2- 172.21.15.172:0/3017312642 >> v2:172.21.15.186:3300/0 conn(0x7f26401658b0 0x7f2640165c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fa538116640 1 -- 172.21.15.172:0/4032350280 wait complete. 2024-04-25T08:42:52.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7f263effd640 1 -- 172.21.15.172:0/3017312642 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264006e670 con 0x7f264006dc80 2024-04-25T08:42:52.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.186+0000 7fde924b2640 1 -- start start 2024-04-25T08:42:52.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7faf3ab27640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406bbf0 0x7faf340afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd2785d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd1803c090 0x7fdd18182960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7faf3ab27640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf340b3e30 0x7faf340b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fb5b610c640 1 --2- 172.21.15.172:0/3945550010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 0x7fb5b00cd2e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac007360 tx=0x7fb5ac02b1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214638190d01a7a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde924b2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde8c06f930 0x7fde8c159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde924b2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde8c06fdc0 0x7fde8c16dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde924b2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde8c15dbc0 0x7fde8c146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde924b2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c0b4ae0 con 0x7fde8c06fdc0 2024-04-25T08:42:52.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde924b2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c06c220 con 0x7fde8c15dbc0 2024-04-25T08:42:52.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde924b2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c15dfa0 con 0x7fde8c06f930 2024-04-25T08:42:52.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7faf3ab27640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 0x7faf34163cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7faf3ab27640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3415b020 con 0x7faf340b3e30 2024-04-25T08:42:52.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7efc086a3640 1 -- 172.21.15.172:0/2645888661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf80546c0 msgr2=0x7efbf8038170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7efc086a3640 1 --2- 172.21.15.172:0/2645888661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf80546c0 0x7efbf8038170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0097a0 tx=0x7efbfc02a0c0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7faf3ab27640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3415ad40 con 0x7faf3406bbf0 2024-04-25T08:42:52.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7faf3ab27640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340ae9c0 con 0x7faf34162c70 2024-04-25T08:42:52.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa015e210 con 0x7f3fa0143a80 2024-04-25T08:42:52.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa00cd360 con 0x7f3fa0143400 2024-04-25T08:42:52.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fa538116640 1 Processor -- start 2024-04-25T08:42:52.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7f3f9ed9d640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fa0143a80 0x7f3fa015c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fb5b510a640 1 -- 172.21.15.172:0/3945550010 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0089e0 con 0x7fb5b0154150 2024-04-25T08:42:52.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fb5b510a640 1 -- 172.21.15.172:0/3945550010 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac008b80 con 0x7fb5b0154150 2024-04-25T08:42:52.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fb5b510a640 1 -- 172.21.15.172:0/3945550010 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00a0d0 con 0x7fb5b0154150 2024-04-25T08:42:52.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7faf39b25640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406bbf0 0x7faf340afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7faf3a326640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 0x7faf34163cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7faf39b25640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406bbf0 0x7faf340afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:40410/0 (socket says 172.21.15.172:40410) 2024-04-25T08:42:52.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7faf39b25640 1 -- 172.21.15.172:0/633372172 learned_addr learned my addr 172.21.15.172:0/633372172 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd2785d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd18053ca0 0x7fdd180e6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fa538116640 1 -- start start 2024-04-25T08:42:52.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7f3f9dd9b640 1 -- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fa0143a80 msgr2=0x7f3fa015c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7f3f9dd9b640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fa0143a80 0x7f3fa015c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7f3f9dd9b640 1 -- 172.21.15.172:0/3884488866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa0072a10 msgr2=0x7f3fa0139db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7f3f9dd9b640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fa0072a10 0x7f3fa0139db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7f3f9dd9b640 1 -- 172.21.15.172:0/3884488866 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa015b810 con 0x7f3fa0143400 2024-04-25T08:42:52.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd2785d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd180e3150 0x7fdd180e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7f263effd640 1 --2- 172.21.15.172:0/3017312642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f264006dc80 0x7f264006e130 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f264006b7a0 tx=0x7f263802a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a83edd80cdaa210 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde914b0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde8c06f930 0x7fde8c159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7efc086a3640 1 -- 172.21.15.172:0/2645888661 shutdown_connections 2024-04-25T08:42:52.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7efc086a3640 1 --2- 172.21.15.172:0/2645888661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efbf804f0b0 0x7efbf804fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde91cb1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde8c15dbc0 0x7fde8c146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde90caf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde8c06fdc0 0x7fde8c16dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde914b0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde8c06f930 0x7fde8c159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43658/0 (socket says 172.21.15.172:43658) 2024-04-25T08:42:52.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fde914b0640 1 -- 172.21.15.172:0/1425337426 learned_addr learned my addr 172.21.15.172:0/1425337426 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7efc086a3640 1 --2- 172.21.15.172:0/2645888661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf80546c0 0x7efbf8038170 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7efc086a3640 1 -- 172.21.15.172:0/2645888661 >> 172.21.15.172:0/2645888661 conn(0x7efbf8009fe0 msgr2=0x7efbf800a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde90caf640 1 -- 172.21.15.172:0/1425337426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde8c06f930 msgr2=0x7fde8c159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde90caf640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde8c06f930 0x7fde8c159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde90caf640 1 -- 172.21.15.172:0/1425337426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde8c15dbc0 msgr2=0x7fde8c146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde90caf640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fde8c15dbc0 0x7fde8c146390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde90caf640 1 -- 172.21.15.172:0/1425337426 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c15a270 con 0x7fde8c06fdc0 2024-04-25T08:42:52.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde914b0640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fde8c06f930 0x7fde8c159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:52.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7f3f9dd9b640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fa0143400 0x7f3fa015ae10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400c440 tx=0x7f3f94001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd2785d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180e3530 con 0x7fdd180e3150 2024-04-25T08:42:52.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde90caf640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde8c06fdc0 0x7fde8c16dc50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c410 tx=0x7fde7c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd2785d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18006630 con 0x7fdd1803c090 2024-04-25T08:42:52.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7faf39324640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf340b3e30 0x7faf340b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7faf39b25640 1 -- 172.21.15.172:0/633372172 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 msgr2=0x7faf34163cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7faf39b25640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf34162c70 0x7faf34163cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7faf39b25640 1 -- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf340b3e30 msgr2=0x7faf340b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7faf39b25640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf340b3e30 0x7faf340b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7faf39b25640 1 -- 172.21.15.172:0/633372172 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf341f8060 con 0x7faf3406bbf0 2024-04-25T08:42:52.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7f263e7fc640 1 -- 172.21.15.172:0/3017312642 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638036070 con 0x7f264006dc80 2024-04-25T08:42:52.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7f263e7fc640 1 -- 172.21.15.172:0/3017312642 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2638031600 con 0x7f264006dc80 2024-04-25T08:42:52.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7f263e7fc640 1 -- 172.21.15.172:0/3017312642 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26380319d0 con 0x7f264006dc80 2024-04-25T08:42:52.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7faf39324640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf340b3e30 0x7faf340b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:52.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd2785d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18006b50 con 0x7fdd18053ca0 2024-04-25T08:42:52.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd255f9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd1803c090 0x7fdd18182960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd255f9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd1803c090 0x7fdd18182960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:40392/0 (socket says 172.21.15.172:40392) 2024-04-25T08:42:52.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd255f9640 1 -- 172.21.15.172:0/3319257331 learned_addr learned my addr 172.21.15.172:0/3319257331 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd24df8640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd18053ca0 0x7fdd180e6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd255f9640 1 -- 172.21.15.172:0/3319257331 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd18053ca0 msgr2=0x7fdd180e6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd255f9640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd18053ca0 0x7fdd180e6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd255f9640 1 -- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd180e3150 msgr2=0x7fdd180e70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.187+0000 7fdd25dfa640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd180e3150 0x7fdd180e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fdd255f9640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd180e3150 0x7fdd180e70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fdd255f9640 1 -- 172.21.15.172:0/3319257331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd181855e0 con 0x7fdd1803c090 2024-04-25T08:42:52.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.188+0000 7fdd25dfa640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd180e3150 0x7fdd180e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:52.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fdd255f9640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd1803c090 0x7fdd18182960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009990 tx=0x7fdd1c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fdd11ffb640 1 -- 172.21.15.172:0/3319257331 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c042020 con 0x7fdd1803c090 2024-04-25T08:42:52.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fdd11ffb640 1 -- 172.21.15.172:0/3319257331 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c03d730 con 0x7fdd1803c090 2024-04-25T08:42:52.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fdd11ffb640 1 -- 172.21.15.172:0/3319257331 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c037040 con 0x7fdd1803c090 2024-04-25T08:42:52.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fdd2785d640 1 -- 172.21.15.172:0/3319257331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd181858c0 con 0x7fdd1803c090 2024-04-25T08:42:52.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fb5b8370640 1 -- 172.21.15.172:0/3945550010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 msgr2=0x7fb5b00cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fb5b8370640 1 --2- 172.21.15.172:0/3945550010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 0x7fb5b00cd2e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac007360 tx=0x7fb5ac02b1d0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fb5b8370640 1 -- 172.21.15.172:0/3945550010 shutdown_connections 2024-04-25T08:42:52.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fb5b8370640 1 --2- 172.21.15.172:0/3945550010 >> v2:172.21.15.186:3300/0 conn(0x7fb5b00cef10 0x7fb5b00cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fb5b8370640 1 --2- 172.21.15.172:0/3945550010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 0x7fb5b00cd2e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fb5b8370640 1 -- 172.21.15.172:0/3945550010 >> 172.21.15.172:0/3945550010 conn(0x7fb5b006abe0 msgr2=0x7fb5b006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde81ffb640 1 -- 172.21.15.172:0/1425337426 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0074e0 con 0x7fde8c06fdc0 2024-04-25T08:42:52.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde81ffb640 1 -- 172.21.15.172:0/1425337426 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c0047e0 con 0x7fde8c06fdc0 2024-04-25T08:42:52.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde924b2640 1 -- 172.21.15.172:0/1425337426 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c1452f0 con 0x7fde8c06fdc0 2024-04-25T08:42:52.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fb5b8370640 1 -- 172.21.15.172:0/3945550010 shutdown_connections 2024-04-25T08:42:52.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fde81ffb640 1 -- 172.21.15.172:0/1425337426 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c004bd0 con 0x7fde8c06fdc0 2024-04-25T08:42:52.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fdd2785d640 1 -- 172.21.15.172:0/3319257331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd18185e80 con 0x7fdd1803c090 2024-04-25T08:42:52.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fb5b8370640 1 -- 172.21.15.172:0/3945550010 wait complete. 2024-04-25T08:42:52.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fa538116640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa53006b6d0 0x7fa53014b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7fa538116640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5300cd2e0 0x7fa53014fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7fde924b2640 1 -- 172.21.15.172:0/1425337426 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c1458b0 con 0x7fde8c06fdc0 2024-04-25T08:42:52.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7efc086a3640 1 -- 172.21.15.172:0/2645888661 shutdown_connections 2024-04-25T08:42:52.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7fa538116640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530157490 0x7fa5301551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7fa538116640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300ae830 con 0x7fa530157490 2024-04-25T08:42:52.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7fa538116640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300718e0 con 0x7fa53006b6d0 2024-04-25T08:42:52.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7fa538116640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300ae9b0 con 0x7fa5300cd2e0 2024-04-25T08:42:52.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7f2644c53640 1 -- 172.21.15.172:0/3017312642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f264006dc80 msgr2=0x7f264006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7f2644c53640 1 --2- 172.21.15.172:0/3017312642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f264006dc80 0x7f264006e130 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f264006b7a0 tx=0x7f263802a690 comp rx=0 tx=0).stop 2024-04-25T08:42:52.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7f2644c53640 1 -- 172.21.15.172:0/3017312642 shutdown_connections 2024-04-25T08:42:52.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7faf39b25640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406bbf0 0x7faf340afac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c7a0 tx=0x7faf2c00cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7f2644c53640 1 --2- 172.21.15.172:0/3017312642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 0x7f2640162770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7f2644c53640 1 --2- 172.21.15.172:0/3017312642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f264006dc80 0x7f264006e130 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7f2644c53640 1 --2- 172.21.15.172:0/3017312642 >> v2:172.21.15.186:3300/0 conn(0x7f26401658b0 0x7f2640165c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7f2644c53640 1 -- 172.21.15.172:0/3017312642 >> 172.21.15.172:0/3017312642 conn(0x7f264006b210 msgr2=0x7f26400b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7f2644c53640 1 -- 172.21.15.172:0/3017312642 shutdown_connections 2024-04-25T08:42:52.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7f2644c53640 1 -- 172.21.15.172:0/3017312642 wait complete. 2024-04-25T08:42:52.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7f3f8effd640 1 -- 172.21.15.172:0/3884488866 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94017070 con 0x7f3fa0143400 2024-04-25T08:42:52.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.189+0000 7f3f8effd640 1 -- 172.21.15.172:0/3884488866 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f94005ce0 con 0x7f3fa0143400 2024-04-25T08:42:52.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7f3f8effd640 1 -- 172.21.15.172:0/3884488866 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f940072d0 con 0x7f3fa0143400 2024-04-25T08:42:52.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa015baf0 con 0x7f3fa0143400 2024-04-25T08:42:52.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa015c0b0 con 0x7f3fa0143400 2024-04-25T08:42:52.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7fa5366b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530157490 0x7fa5301551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7fa5366b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530157490 0x7fa5301551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50526/0 (socket says 172.21.15.172:50526) 2024-04-25T08:42:52.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7fa5366b3640 1 -- 172.21.15.172:0/404913668 learned_addr learned my addr 172.21.15.172:0/404913668 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7fb5b8370640 1 Processor -- start 2024-04-25T08:42:52.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.190+0000 7efc086a3640 1 -- 172.21.15.172:0/2645888661 wait complete. 2024-04-25T08:42:52.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7fa535eb2640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa53006b6d0 0x7fa53014b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7fde777fe640 1 -- 172.21.15.172:0/1425337426 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde8c073990 con 0x7fde8c06fdc0 2024-04-25T08:42:52.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7fa5356b1640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5300cd2e0 0x7fa53014fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7fb5b8370640 1 -- start start 2024-04-25T08:42:52.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7fdd2785d640 1 -- 172.21.15.172:0/3319257331 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd18182ea0 con 0x7fdd1803c090 2024-04-25T08:42:52.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7faf2a7fc640 1 -- 172.21.15.172:0/633372172 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c003b70 con 0x7faf3406bbf0 2024-04-25T08:42:52.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7faf2a7fc640 1 -- 172.21.15.172:0/633372172 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c003d10 con 0x7faf3406bbf0 2024-04-25T08:42:52.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.191+0000 7faf2a7fc640 1 -- 172.21.15.172:0/633372172 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00aa90 con 0x7faf3406bbf0 2024-04-25T08:42:52.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7efc086a3640 1 Processor -- start 2024-04-25T08:42:52.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf341f8340 con 0x7faf3406bbf0 2024-04-25T08:42:52.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf341f8900 con 0x7faf3406bbf0 2024-04-25T08:42:52.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7fa5356b1640 1 -- 172.21.15.172:0/404913668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa53006b6d0 msgr2=0x7fa53014b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7fa5356b1640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa53006b6d0 0x7fa53014b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7fa5356b1640 1 -- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530157490 msgr2=0x7fa5301551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7f2644c53640 1 Processor -- start 2024-04-25T08:42:52.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7f2644c53640 1 -- start start 2024-04-25T08:42:52.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7fb5b8370640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5b006f360 0x7fb5b01f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7fb5b8370640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5b00cef10 0x7fb5b01586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7fb5b8370640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 0x7fb5b01fa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7fb5b8370640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015ade0 con 0x7fb5b00cef10 2024-04-25T08:42:52.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7fa5356b1640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530157490 0x7fa5301551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7fa5356b1640 1 -- 172.21.15.172:0/404913668 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53014b850 con 0x7fa5300cd2e0 2024-04-25T08:42:52.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7fa5366b3640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530157490 0x7fa5301551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:52.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.192+0000 7efc086a3640 1 -- start start 2024-04-25T08:42:52.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7fb5b8370640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b015ab00 con 0x7fb5b006f360 2024-04-25T08:42:52.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7fb5b8370640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b0154530 con 0x7fb5b0154150 2024-04-25T08:42:52.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7fa5356b1640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5300cd2e0 0x7fa53014fef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa528031000 tx=0x7fa528004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fa0073990 con 0x7f3fa0143400 2024-04-25T08:42:52.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc086a3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efbf800c0d0 0x7efbf80445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc086a3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efbf804f0b0 0x7efbf80e1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc086a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf80546c0 0x7efbf804d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc086a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf8050640 con 0x7efbf80546c0 2024-04-25T08:42:52.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc086a3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80e3bc0 con 0x7efbf804f0b0 2024-04-25T08:42:52.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc086a3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf80507c0 con 0x7efbf800c0d0 2024-04-25T08:42:52.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf34073990 con 0x7faf3406bbf0 2024-04-25T08:42:52.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc06c40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf80546c0 0x7efbf804d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7fb5b690d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 0x7fb5b01fa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7fb5b690d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 0x7fb5b01fa9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43670/0 (socket says 172.21.15.172:43670) 2024-04-25T08:42:52.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7fb5b610c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5b006f360 0x7fb5b01f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7fb5b610c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5b006f360 0x7fb5b01f7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:40442/0 (socket says 172.21.15.172:40442) 2024-04-25T08:42:52.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7fb5b610c640 1 -- 172.21.15.172:0/2739868325 learned_addr learned my addr 172.21.15.172:0/2739868325 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7fb5b590b640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5b00cef10 0x7fb5b01586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc06c40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf80546c0 0x7efbf804d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50542/0 (socket says 172.21.15.172:50542) 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc06c40640 1 -- 172.21.15.172:0/2207498677 learned_addr learned my addr 172.21.15.172:0/2207498677 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc05c3e640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efbf804f0b0 0x7efbf80e1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7efc0643f640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efbf800c0d0 0x7efbf80445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7efc05c3e640 1 -- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efbf800c0d0 msgr2=0x7efbf80445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7efc05c3e640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efbf800c0d0 0x7efbf80445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7efc05c3e640 1 -- 172.21.15.172:0/2207498677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf80546c0 msgr2=0x7efbf804d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7efc05c3e640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf80546c0 0x7efbf804d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7efc05c3e640 1 -- 172.21.15.172:0/2207498677 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80e06d0 con 0x7efbf804f0b0 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fa5267fc640 1 -- 172.21.15.172:0/404913668 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528040070 con 0x7fa5300cd2e0 2024-04-25T08:42:52.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fa5267fc640 1 -- 172.21.15.172:0/404913668 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528031be0 con 0x7fa5300cd2e0 2024-04-25T08:42:52.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fdd11ffb640 1 -- 172.21.15.172:0/3319257331 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd1c045020 con 0x7fdd1803c090 2024-04-25T08:42:52.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f2644c53640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f264006dc80 0x7f26400b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7efc05c3e640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efbf804f0b0 0x7efbf80e1780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc0004fcd0 tx=0x7efc000686c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f2644c53640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 0x7f2640146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.193+0000 7f3f8effd640 1 -- 172.21.15.172:0/3884488866 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3f9401a070 con 0x7f3fa0143400 2024-04-25T08:42:52.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f3f8effd640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006f9b0 0x7f3f80071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fb5b590b640 1 -- 172.21.15.172:0/2739868325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 msgr2=0x7fb5b01fa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fb5b590b640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5b0154150 0x7fb5b01fa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fb5b590b640 1 -- 172.21.15.172:0/2739868325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5b006f360 msgr2=0x7fb5b01f7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fb5b590b640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5b006f360 0x7fb5b01f7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f2644c53640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26401658b0 0x7f2640147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7efbf6ffd640 1 -- 172.21.15.172:0/2207498677 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00074610 con 0x7efbf804f0b0 2024-04-25T08:42:52.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fb5b590b640 1 -- 172.21.15.172:0/2739868325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b0158ef0 con 0x7fb5b00cef10 2024-04-25T08:42:52.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f263effd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 0x7f2640146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf804ce70 con 0x7efbf804f0b0 2024-04-25T08:42:52.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf80e1cc0 con 0x7efbf804f0b0 2024-04-25T08:42:52.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f263effd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 0x7f2640146b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43684/0 (socket says 172.21.15.172:43684) 2024-04-25T08:42:52.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f263f7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f264006dc80 0x7f26400b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f263f7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f264006dc80 0x7f26400b0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:40448/0 (socket says 172.21.15.172:40448) 2024-04-25T08:42:52.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fdd11ffb640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd0406b4d0 0x7fdd0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fa5267fc640 1 -- 172.21.15.172:0/404913668 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528045460 con 0x7fa5300cd2e0 2024-04-25T08:42:52.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f3f8effd640 1 -- 172.21.15.172:0/3884488866 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3f94089810 con 0x7f3fa0143400 2024-04-25T08:42:52.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f3f8effd640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x7f3f800790a0 0x7f3f8007b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f3f8effd640 1 -- 172.21.15.172:0/3884488866 --> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f8007bbb0 con 0x7f3f800790a0 2024-04-25T08:42:52.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7fb5b590b640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5b00cef10 0x7fb5b01586a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000e870 tx=0x7fb5a000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fde81ffb640 1 -- 172.21.15.172:0/1425337426 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fde7c011070 con 0x7fde8c06fdc0 2024-04-25T08:42:52.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fde81ffb640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fde7006b5a0 0x7fde7006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fde81ffb640 1 -- 172.21.15.172:0/1425337426 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fde7c089f60 con 0x7fde8c06fdc0 2024-04-25T08:42:52.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fde81ffb640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] conn(0x7fde70074ca0 0x7fde700770e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7fde81ffb640 1 -- 172.21.15.172:0/1425337426 --> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde7c01ce80 con 0x7fde70074ca0 2024-04-25T08:42:52.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7fde81ffb640 1 -- 172.21.15.172:0/1425337426 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde7c054760 con 0x7fde8c06fdc0 2024-04-25T08:42:52.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7fde914b0640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fde7006b5a0 0x7fde7006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.194+0000 7f263effd640 1 -- 172.21.15.172:0/1095960338 learned_addr learned my addr 172.21.15.172:0/1095960338 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7f263ffff640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26401658b0 0x7f2640147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7f2644c53640 1 -- 172.21.15.172:0/1095960338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400cd640 con 0x7f26401658b0 2024-04-25T08:42:52.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7f3f9ed9d640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x7f3f800790a0 0x7f3f8007b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7f3f8effd640 1 -- 172.21.15.172:0/3884488866 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f94053f80 con 0x7f3fa0143400 2024-04-25T08:42:52.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7efbf6ffd640 1 -- 172.21.15.172:0/2207498677 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0008f020 con 0x7efbf804f0b0 2024-04-25T08:42:52.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7efbf6ffd640 1 -- 172.21.15.172:0/2207498677 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0006ae20 con 0x7efbf804f0b0 2024-04-25T08:42:52.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7f2644c53640 1 -- 172.21.15.172:0/1095960338 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264006e900 con 0x7f264006dc80 2024-04-25T08:42:52.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7fde91cb1640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] conn(0x7fde70074ca0 0x7fde700770e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7f2644c53640 1 -- 172.21.15.172:0/1095960338 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26400cd920 con 0x7f2640162300 2024-04-25T08:42:52.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7fde91cb1640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] conn(0x7fde70074ca0 0x7fde700770e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7fb5a6ffd640 1 -- 172.21.15.172:0/2739868325 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0017070 con 0x7fb5b00cef10 2024-04-25T08:42:52.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7fb5a6ffd640 1 -- 172.21.15.172:0/2739868325 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a000ee60 con 0x7fb5b00cef10 2024-04-25T08:42:52.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7f263effd640 1 -- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f264006dc80 msgr2=0x7f26400b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7f263effd640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f264006dc80 0x7f26400b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7f263effd640 1 -- 172.21.15.172:0/1095960338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26401658b0 msgr2=0x7f2640147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7f263effd640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26401658b0 0x7f2640147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7f263effd640 1 -- 172.21.15.172:0/1095960338 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26401453d0 con 0x7f2640162300 2024-04-25T08:42:52.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5301ef780 con 0x7fa5300cd2e0 2024-04-25T08:42:52.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5301efd40 con 0x7fa5300cd2e0 2024-04-25T08:42:52.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7f263f7fe640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f264006dc80 0x7f26400b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:52.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7fb5a6ffd640 1 -- 172.21.15.172:0/2739868325 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a000cb60 con 0x7fb5b00cef10 2024-04-25T08:42:52.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7fb5b8370640 1 -- 172.21.15.172:0/2739868325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b01591d0 con 0x7fb5b00cef10 2024-04-25T08:42:52.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa530073a00 con 0x7fa5300cd2e0 2024-04-25T08:42:52.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7fb5b8370640 1 -- 172.21.15.172:0/2739868325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b0156140 con 0x7fb5b00cef10 2024-04-25T08:42:52.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7f263ffff640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26401658b0 0x7f2640147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:52.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7f263effd640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 0x7f2640146b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2638009f40 tx=0x7f2638004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efbe8001030 con 0x7efbf804f0b0 2024-04-25T08:42:52.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.195+0000 7f3f9e59c640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006f9b0 0x7f3f80071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7fdd24df8640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd0406b4d0 0x7fdd0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7f2627fff640 1 -- 172.21.15.172:0/1095960338 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638041020 con 0x7f2640162300 2024-04-25T08:42:52.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7f2644c53640 1 -- 172.21.15.172:0/1095960338 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26400b0de0 con 0x7f2640162300 2024-04-25T08:42:52.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7faf2a7fc640 1 -- 172.21.15.172:0/633372172 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf2c00ac30 con 0x7faf3406bbf0 2024-04-25T08:42:52.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7faf2a7fc640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf1806b5a0 0x7faf1806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.196+0000 7faf2a7fc640 1 -- 172.21.15.172:0/633372172 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faf2c08adc0 con 0x7faf3406bbf0 2024-04-25T08:42:52.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7faf2a7fc640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] conn(0x7faf18074d20 0x7faf18077160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7faf2a7fc640 1 -- 172.21.15.172:0/633372172 --> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf18077830 con 0x7faf18074d20 2024-04-25T08:42:52.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7faf2a7fc640 1 -- 172.21.15.172:0/633372172 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf2c08b1b0 con 0x7faf3406bbf0 2024-04-25T08:42:52.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7fdd11ffb640 1 -- 172.21.15.172:0/3319257331 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fdd1c0aafb0 con 0x7fdd1803c090 2024-04-25T08:42:52.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7fde81ffb640 1 -- 172.21.15.172:0/1425337426 <== osd.0 v2:172.21.15.172:6800/1800402261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fde7c01ce80 con 0x7fde70074ca0 2024-04-25T08:42:52.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7fdd11ffb640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] conn(0x7fdd04074c50 0x7fdd04077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7fdd11ffb640 1 -- 172.21.15.172:0/3319257331 --> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd1c006810 con 0x7fdd04074c50 2024-04-25T08:42:52.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7fdd11ffb640 1 -- 172.21.15.172:0/3319257331 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd1c0ad610 con 0x7fdd1803c090 2024-04-25T08:42:52.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7f2627fff640 1 -- 172.21.15.172:0/1095960338 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26380087b0 con 0x7f2640162300 2024-04-25T08:42:52.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7fdd24df8640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd0406b4d0 0x7fdd0406d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd180e3b10 tx=0x7fdd14009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7f2644c53640 1 -- 172.21.15.172:0/1095960338 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2640145920 con 0x7f2640162300 2024-04-25T08:42:52.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7fdd25dfa640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] conn(0x7fdd04074c50 0x7fdd04077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7faf3a326640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] conn(0x7faf18074d20 0x7faf18077160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7faf39324640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf1806b5a0 0x7faf1806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7fb5a4ff9640 1 -- 172.21.15.172:0/2739868325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5b0156520 con 0x7fb5b00cef10 2024-04-25T08:42:52.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.197+0000 7f2627fff640 1 -- 172.21.15.172:0/1095960338 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638041020 con 0x7f2640162300 2024-04-25T08:42:52.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.198+0000 7fdd25dfa640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] conn(0x7fdd04074c50 0x7fdd04077090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.198+0000 7f3f9ed9d640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x7f3f800790a0 0x7f3f8007b4e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.198+0000 7faf3a326640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] conn(0x7faf18074d20 0x7faf18077160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.198+0000 7f3f9e59c640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006f9b0 0x7f3f80071e70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f90001840 tx=0x7f3f90009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.198+0000 7fa5267fc640 1 -- 172.21.15.172:0/404913668 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa528039040 con 0x7fa5300cd2e0 2024-04-25T08:42:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.198+0000 7efbf6ffd640 1 -- 172.21.15.172:0/2207498677 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc0006c110 con 0x7efbf804f0b0 2024-04-25T08:42:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.198+0000 7fde914b0640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fde7006b5a0 0x7fde7006da60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fde84007fd0 tx=0x7fde84009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.198+0000 7faf39324640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf1806b5a0 0x7faf1806da60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf340b1060 tx=0x7faf30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.198+0000 7fa5267fc640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa51406b5a0 0x7fa51406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7efbf6ffd640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efbe406b5d0 0x7efbe406da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7fb5a6ffd640 1 -- 172.21.15.172:0/2739868325 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb5a001a070 con 0x7fb5b00cef10 2024-04-25T08:42:52.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7fa5267fc640 1 -- 172.21.15.172:0/404913668 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa5280abc60 con 0x7fa5300cd2e0 2024-04-25T08:42:52.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7fa5267fc640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] conn(0x7fa514074d20 0x7fa514077160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7fa5267fc640 1 -- 172.21.15.172:0/404913668 --> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa52802ee50 con 0x7fa514074d20 2024-04-25T08:42:52.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7fa5267fc640 1 -- 172.21.15.172:0/404913668 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5280ae2c0 con 0x7fa5300cd2e0 2024-04-25T08:42:52.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7fdd11ffb640 1 -- 172.21.15.172:0/3319257331 <== osd.1 v2:172.21.15.172:6824/2427392636 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdd1c006810 con 0x7fdd04074c50 2024-04-25T08:42:52.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7efbf6ffd640 1 -- 172.21.15.172:0/2207498677 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7efc00105530 con 0x7efbf804f0b0 2024-04-25T08:42:52.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7f2627fff640 1 -- 172.21.15.172:0/1095960338 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2638044020 con 0x7f2640162300 2024-04-25T08:42:52.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7efbf6ffd640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x7efbe4074d40 0x7efbe4077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7efbf6ffd640 1 -- 172.21.15.172:0/2207498677 --> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc00096e50 con 0x7efbe4074d40 2024-04-25T08:42:52.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7f3f8effd640 1 -- 172.21.15.172:0/3884488866 <== osd.4 v2:172.21.15.186:6808/1547498830 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3f8007bbb0 con 0x7f3f800790a0 2024-04-25T08:42:52.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7efbf6ffd640 1 -- 172.21.15.172:0/2207498677 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc00105920 con 0x7efbf804f0b0 2024-04-25T08:42:52.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7fb5a6ffd640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb59406b5a0 0x7fb59406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7fa535eb2640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa51406b5a0 0x7fa51406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7efc0643f640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efbe406b5d0 0x7efbe406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.199+0000 7fa5366b3640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] conn(0x7fa514074d20 0x7fa514077160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7fb5a6ffd640 1 -- 172.21.15.172:0/2739868325 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb5a008a5a0 con 0x7fb5b00cef10 2024-04-25T08:42:52.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7f2627fff640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262c06b6d0 0x7f262c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7fb5a6ffd640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x7fb594074ca0 0x7fb5940770e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7fb5a6ffd640 1 -- 172.21.15.172:0/2739868325 --> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5940777b0 con 0x7fb594074ca0 2024-04-25T08:42:52.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7fb5a6ffd640 1 -- 172.21.15.172:0/2739868325 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5a0091050 con 0x7fb5b00cef10 2024-04-25T08:42:52.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7fb5b610c640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb59406b5a0 0x7fb59406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7f2627fff640 1 -- 172.21.15.172:0/1095960338 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2638077150 con 0x7f2640162300 2024-04-25T08:42:52.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7f263f7fe640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262c06b6d0 0x7f262c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7f2644c53640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] conn(0x7f264015f1e0 0x7f2640143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7f2644c53640 1 -- 172.21.15.172:0/1095960338 --> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f26400b2110 con 0x7f264015f1e0 2024-04-25T08:42:52.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7faf2a7fc640 1 -- 172.21.15.172:0/633372172 <== osd.2 v2:172.21.15.172:6813/2429635913 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faf18077830 con 0x7faf18074d20 2024-04-25T08:42:52.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7fa5366b3640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] conn(0x7fa514074d20 0x7fa514077160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7efc0643f640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efbe406b5d0 0x7efbe406da90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efbfc034000 tx=0x7efbfc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.200+0000 7f263ffff640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] conn(0x7f264015f1e0 0x7f2640143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.201+0000 7f263f7fe640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262c06b6d0 0x7f262c06db90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2630009a20 tx=0x7f2630008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.201+0000 7fa535eb2640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa51406b5a0 0x7fa51406da60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009a10 tx=0x7fa52c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.201+0000 7f263ffff640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] conn(0x7f264015f1e0 0x7f2640143050 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.201+0000 7fb5b690d640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x7fb594074ca0 0x7fb5940770e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.201+0000 7fb5b610c640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb59406b5a0 0x7fb59406da60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00ac20 tx=0x7fb5ac02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.201+0000 7efc06c40640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x7efbe4074d40 0x7efbe4077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.201+0000 7fa5267fc640 1 -- 172.21.15.172:0/404913668 <== osd.3 v2:172.21.15.172:6808/3046026724 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa52802ee50 con 0x7fa514074d20 2024-04-25T08:42:52.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.202+0000 7fb5b690d640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x7fb594074ca0 0x7fb5940770e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.202+0000 7f2627fff640 1 -- 172.21.15.172:0/1095960338 <== osd.7 v2:172.21.15.186:6824/1002001557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f26400b2110 con 0x7f264015f1e0 2024-04-25T08:42:52.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.202+0000 7fb5a6ffd640 1 -- 172.21.15.172:0/2739868325 <== osd.6 v2:172.21.15.186:6816/2238458508 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb5940777b0 con 0x7fb594074ca0 2024-04-25T08:42:52.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.206+0000 7efc06c40640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x7efbe4074d40 0x7efbe4077180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.207+0000 7efbf6ffd640 1 -- 172.21.15.172:0/2207498677 <== osd.5 v2:172.21.15.186:6800/2784790337 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efc00096e50 con 0x7efbe4074d40 2024-04-25T08:42:52.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.227+0000 7fdd2785d640 1 -- 172.21.15.172:0/3319257331 --> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd18005380 con 0x7fdd04074c50 2024-04-25T08:42:52.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.228+0000 7fdd11ffb640 1 -- 172.21.15.172:0/3319257331 <== osd.1 v2:172.21.15.172:6824/2427392636 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd18005380 con 0x7fdd04074c50 2024-04-25T08:42:52.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.229+0000 7fdd037fe640 1 -- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] conn(0x7fdd04074c50 msgr2=0x7fdd04077090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.229+0000 7fdd037fe640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] conn(0x7fdd04074c50 0x7fdd04077090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.229+0000 7fde777fe640 1 -- 172.21.15.172:0/1425337426 --> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde8c067ef0 con 0x7fde70074ca0 2024-04-25T08:42:52.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.230+0000 7fde81ffb640 1 -- 172.21.15.172:0/1425337426 <== osd.0 v2:172.21.15.172:6800/1800402261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fde8c067ef0 con 0x7fde70074ca0 2024-04-25T08:42:52.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.230+0000 7fdd037fe640 1 -- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd0406b4d0 msgr2=0x7fdd0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.230+0000 7fdd037fe640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd0406b4d0 0x7fdd0406d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd180e3b10 tx=0x7fdd14009040 comp rx=0 tx=0).stop 2024-04-25T08:42:52.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.230+0000 7fdd037fe640 1 -- 172.21.15.172:0/3319257331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd1803c090 msgr2=0x7fdd18182960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.230+0000 7fdd037fe640 1 --2- 172.21.15.172:0/3319257331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd1803c090 0x7fdd18182960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009990 tx=0x7fdd1c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fdd25dfa640 1 -- 172.21.15.172:0/3319257331 reap_dead start 2024-04-25T08:42:52.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fde924b2640 1 -- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] conn(0x7fde70074ca0 msgr2=0x7fde700770e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fde924b2640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] conn(0x7fde70074ca0 0x7fde700770e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fdd037fe640 1 -- 172.21.15.172:0/3319257331 shutdown_connections 2024-04-25T08:42:52.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fde924b2640 1 -- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fde7006b5a0 msgr2=0x7fde7006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fde924b2640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fde7006b5a0 0x7fde7006da60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fde84007fd0 tx=0x7fde84009040 comp rx=0 tx=0).stop 2024-04-25T08:42:52.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fde924b2640 1 -- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde8c06fdc0 msgr2=0x7fde8c16dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fde924b2640 1 --2- 172.21.15.172:0/1425337426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde8c06fdc0 0x7fde8c16dc50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c410 tx=0x7fde7c00c8d0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fde91cb1640 1 -- 172.21.15.172:0/1425337426 reap_dead start 2024-04-25T08:42:52.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fdd037fe640 1 -- 172.21.15.172:0/3319257331 >> 172.21.15.172:0/3319257331 conn(0x7fdd18058ed0 msgr2=0x7fdd18039820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fde924b2640 1 -- 172.21.15.172:0/1425337426 shutdown_connections 2024-04-25T08:42:52.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fde924b2640 1 -- 172.21.15.172:0/1425337426 >> 172.21.15.172:0/1425337426 conn(0x7fde8c0d04e0 msgr2=0x7fde8c14ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.231+0000 7fdd037fe640 1 -- 172.21.15.172:0/3319257331 shutdown_connections 2024-04-25T08:42:52.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.232+0000 7fde924b2640 1 -- 172.21.15.172:0/1425337426 shutdown_connections 2024-04-25T08:42:52.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.232+0000 7fdd037fe640 1 -- 172.21.15.172:0/3319257331 wait complete. 2024-04-25T08:42:52.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.232+0000 7fde924b2640 1 -- 172.21.15.172:0/1425337426 wait complete. 2024-04-25T08:42:52.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.232+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 --> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3fa00b3a80 con 0x7f3f800790a0 2024-04-25T08:42:52.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.232+0000 7f3f8effd640 1 -- 172.21.15.172:0/3884488866 <== osd.4 v2:172.21.15.186:6808/1547498830 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3fa00b3a80 con 0x7f3f800790a0 2024-04-25T08:42:52.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 --> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf34164e50 con 0x7faf18074d20 2024-04-25T08:42:52.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x7f3f800790a0 msgr2=0x7f3f8007b4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7f3fa489e640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x7f3f800790a0 0x7f3f8007b4e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006f9b0 msgr2=0x7f3f80071e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7f3fa489e640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006f9b0 0x7f3f80071e70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f90001840 tx=0x7f3f90009040 comp rx=0 tx=0).stop 2024-04-25T08:42:52.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fa0143400 msgr2=0x7f3fa015ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7f3fa489e640 1 --2- 172.21.15.172:0/3884488866 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fa0143400 0x7f3fa015ae10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400c440 tx=0x7f3f94001e70 comp rx=0 tx=0).stop 2024-04-25T08:42:52.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7f3f9ed9d640 1 -- 172.21.15.172:0/3884488866 reap_dead start 2024-04-25T08:42:52.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7faf2a7fc640 1 -- 172.21.15.172:0/633372172 <== osd.2 v2:172.21.15.172:6813/2429635913 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faf34164e50 con 0x7faf18074d20 2024-04-25T08:42:52.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 shutdown_connections 2024-04-25T08:42:52.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.233+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 >> 172.21.15.172:0/3884488866 conn(0x7f3fa006e390 msgr2=0x7f3fa0070080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.234+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] conn(0x7faf18074d20 msgr2=0x7faf18077160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.234+0000 7faf3ab27640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] conn(0x7faf18074d20 0x7faf18077160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.234+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 shutdown_connections 2024-04-25T08:42:52.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.234+0000 7f3fa489e640 1 -- 172.21.15.172:0/3884488866 wait complete. 2024-04-25T08:42:52.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.234+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 --> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5300cf480 con 0x7fa514074d20 2024-04-25T08:42:52.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.234+0000 7fa5267fc640 1 -- 172.21.15.172:0/404913668 <== osd.3 v2:172.21.15.172:6808/3046026724 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa5300cf480 con 0x7fa514074d20 2024-04-25T08:42:52.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.235+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] conn(0x7fa514074d20 msgr2=0x7fa514077160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.235+0000 7fa538116640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] conn(0x7fa514074d20 0x7fa514077160 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.235+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa51406b5a0 msgr2=0x7fa51406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.235+0000 7fa538116640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa51406b5a0 0x7fa51406da60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009a10 tx=0x7fa52c008040 comp rx=0 tx=0).stop 2024-04-25T08:42:52.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.235+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5300cd2e0 msgr2=0x7fa53014fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.235+0000 7fa538116640 1 --2- 172.21.15.172:0/404913668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5300cd2e0 0x7fa53014fef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa528031000 tx=0x7fa528004a40 comp rx=0 tx=0).stop 2024-04-25T08:42:52.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.235+0000 7fa5366b3640 1 -- 172.21.15.172:0/404913668 reap_dead start 2024-04-25T08:42:52.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.235+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 shutdown_connections 2024-04-25T08:42:52.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.235+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 >> 172.21.15.172:0/404913668 conn(0x7fa53006abe0 msgr2=0x7fa5301565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.235+0000 7f2644c53640 1 -- 172.21.15.172:0/1095960338 --> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f264006d750 con 0x7f264015f1e0 2024-04-25T08:42:52.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 --> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efbe8002dd0 con 0x7efbe4074d40 2024-04-25T08:42:52.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf1806b5a0 msgr2=0x7faf1806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7faf3ab27640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf1806b5a0 0x7faf1806da60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf340b1060 tx=0x7faf30009040 comp rx=0 tx=0).stop 2024-04-25T08:42:52.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 shutdown_connections 2024-04-25T08:42:52.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406bbf0 msgr2=0x7faf340afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7faf3ab27640 1 --2- 172.21.15.172:0/633372172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf3406bbf0 0x7faf340afac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c7a0 tx=0x7faf2c00cc60 comp rx=0 tx=0).stop 2024-04-25T08:42:52.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7faf3a326640 1 -- 172.21.15.172:0/633372172 reap_dead start 2024-04-25T08:42:52.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7fa538116640 1 -- 172.21.15.172:0/404913668 wait complete. 2024-04-25T08:42:52.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7f2627fff640 1 -- 172.21.15.172:0/1095960338 <== osd.7 v2:172.21.15.186:6824/1002001557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f264006d750 con 0x7f264015f1e0 2024-04-25T08:42:52.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7efbf6ffd640 1 -- 172.21.15.172:0/2207498677 <== osd.5 v2:172.21.15.186:6800/2784790337 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efbe8002dd0 con 0x7efbe4074d40 2024-04-25T08:42:52.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 shutdown_connections 2024-04-25T08:42:52.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.236+0000 7fb5a4ff9640 1 -- 172.21.15.172:0/2739868325 --> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5b0073a00 con 0x7fb594074ca0 2024-04-25T08:42:52.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x7efbe4074d40 msgr2=0x7efbe4077180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7f2625ffb640 1 -- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] conn(0x7f264015f1e0 msgr2=0x7f2640143050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7efc086a3640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x7efbe4074d40 0x7efbe4077180 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7f2625ffb640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] conn(0x7f264015f1e0 0x7f2640143050 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 >> 172.21.15.172:0/633372172 conn(0x7faf34071ad0 msgr2=0x7faf340aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efbe406b5d0 msgr2=0x7efbe406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7f2625ffb640 1 -- 172.21.15.172:0/1095960338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262c06b6d0 msgr2=0x7f262c06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7f2625ffb640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262c06b6d0 0x7f262c06db90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2630009a20 tx=0x7f2630008040 comp rx=0 tx=0).stop 2024-04-25T08:42:52.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7f2625ffb640 1 -- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 msgr2=0x7f2640146b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7f2625ffb640 1 --2- 172.21.15.172:0/1095960338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2640162300 0x7f2640146b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2638009f40 tx=0x7f2638004a40 comp rx=0 tx=0).stop 2024-04-25T08:42:52.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7f263ffff640 1 -- 172.21.15.172:0/1095960338 reap_dead start 2024-04-25T08:42:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7efc086a3640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efbe406b5d0 0x7efbe406da90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efbfc034000 tx=0x7efbfc02e000 comp rx=0 tx=0).stop 2024-04-25T08:42:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7fb5a6ffd640 1 -- 172.21.15.172:0/2739868325 <== osd.6 v2:172.21.15.186:6816/2238458508 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb5b0073a00 con 0x7fb594074ca0 2024-04-25T08:42:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efbf804f0b0 msgr2=0x7efbf80e1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 shutdown_connections 2024-04-25T08:42:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7efc086a3640 1 --2- 172.21.15.172:0/2207498677 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efbf804f0b0 0x7efbf80e1780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc0004fcd0 tx=0x7efc000686c0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7f2625ffb640 1 -- 172.21.15.172:0/1095960338 shutdown_connections 2024-04-25T08:42:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7f2625ffb640 1 -- 172.21.15.172:0/1095960338 >> 172.21.15.172:0/1095960338 conn(0x7f264006b210 msgr2=0x7f26400af310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7faf3ab27640 1 -- 172.21.15.172:0/633372172 wait complete. 2024-04-25T08:42:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7efc06c40640 1 -- 172.21.15.172:0/2207498677 reap_dead start 2024-04-25T08:42:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 shutdown_connections 2024-04-25T08:42:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 >> 172.21.15.172:0/2207498677 conn(0x7efbf8009fe0 msgr2=0x7efbf8034cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.237+0000 7f2625ffb640 1 -- 172.21.15.172:0/1095960338 shutdown_connections 2024-04-25T08:42:52.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7fb5a4ff9640 1 -- 172.21.15.172:0/2739868325 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x7fb594074ca0 msgr2=0x7fb5940770e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7fb5a4ff9640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x7fb594074ca0 0x7fb5940770e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 shutdown_connections 2024-04-25T08:42:52.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7f2625ffb640 1 -- 172.21.15.172:0/1095960338 wait complete. 2024-04-25T08:42:52.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7efc086a3640 1 -- 172.21.15.172:0/2207498677 wait complete. 2024-04-25T08:42:52.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7fb5a4ff9640 1 -- 172.21.15.172:0/2739868325 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb59406b5a0 msgr2=0x7fb59406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7fb5a4ff9640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb59406b5a0 0x7fb59406da60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00ac20 tx=0x7fb5ac02f000 comp rx=0 tx=0).stop 2024-04-25T08:42:52.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7fb5a4ff9640 1 -- 172.21.15.172:0/2739868325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5b00cef10 msgr2=0x7fb5b01586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7fb5a4ff9640 1 --2- 172.21.15.172:0/2739868325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5b00cef10 0x7fb5b01586a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000e870 tx=0x7fb5a000ed30 comp rx=0 tx=0).stop 2024-04-25T08:42:52.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7fb5b690d640 1 -- 172.21.15.172:0/2739868325 reap_dead start 2024-04-25T08:42:52.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7fb5a4ff9640 1 -- 172.21.15.172:0/2739868325 shutdown_connections 2024-04-25T08:42:52.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.238+0000 7fb5a4ff9640 1 -- 172.21.15.172:0/2739868325 >> 172.21.15.172:0/2739868325 conn(0x7fb5b006abe0 msgr2=0x7fb5b00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.239+0000 7fb5a4ff9640 1 -- 172.21.15.172:0/2739868325 shutdown_connections 2024-04-25T08:42:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.239+0000 7fb5a4ff9640 1 -- 172.21.15.172:0/2739868325 wait complete. 2024-04-25T08:42:52.291 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.291 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T08:42:52.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T08:42:52.293 INFO:teuthology.orchestra.run.smithi172.stdout:55834574859 2024-04-25T08:42:52.294 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T08:42:52.294 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.295 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T08:42:52.295 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.295 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.296 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T08:42:52.296 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T08:42:52.297 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.297 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T08:42:52.298 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T08:42:52.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.507+0000 7ffb75cf5640 1 Processor -- start 2024-04-25T08:42:52.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.507+0000 7ffb75cf5640 1 -- start start 2024-04-25T08:42:52.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.506+0000 7f705e05d640 1 Processor -- start 2024-04-25T08:42:52.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.506+0000 7f705e05d640 1 -- start start 2024-04-25T08:42:52.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.507+0000 7f14cdc1f640 1 Processor -- start 2024-04-25T08:42:52.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7f14cdc1f640 1 -- start start 2024-04-25T08:42:52.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7ffb75cf5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffb700b38f0 0x7ffb700cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7ffb75cf5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb700cf840 0x7ffb700cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7ffb75cf5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb70159f00 con 0x7ffb70159b20 2024-04-25T08:42:52.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7ffb75cf5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700cfc90 con 0x7ffb700cf840 2024-04-25T08:42:52.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7ffb75cf5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb700b3460 con 0x7ffb700b38f0 2024-04-25T08:42:52.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7f705e05d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7f705e05d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70580cd5a0 con 0x7f7058161d90 2024-04-25T08:42:52.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7f705e05d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7058165e60 con 0x7f705806ec00 2024-04-25T08:42:52.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7f705e05d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7058165c10 con 0x7f70580cc8b0 2024-04-25T08:42:52.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7f70577fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7058161d90 0x7f705806e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46258/0 (socket says 172.21.15.172:46258) 2024-04-25T08:42:52.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7f70577fe640 1 -- 172.21.15.172:0/990812970 learned_addr learned my addr 172.21.15.172:0/990812970 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:52.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7f7057fff640 1 --2- 172.21.15.172:0/990812970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.508+0000 7ffb6effd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffb700b38f0 0x7ffb700cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7ffb6effd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffb700b38f0 0x7ffb700cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:40452/0 (socket says 172.21.15.172:40452) 2024-04-25T08:42:52.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7ffb6effd640 1 -- 172.21.15.172:0/2354976410 learned_addr learned my addr 172.21.15.172:0/2354976410 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7ffb6ffff640 1 --2- 172.21.15.172:0/2354976410 >> v2:172.21.15.172:3300/0 conn(0x7ffb700cf840 0x7ffb700cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7ffb6effd640 1 -- 172.21.15.172:0/2354976410 >> v2:172.21.15.172:3300/0 conn(0x7ffb700cf840 msgr2=0x7ffb700cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7f7057fff640 1 -- 172.21.15.172:0/990812970 >> v1:172.21.15.186:6789/0 conn(0x7f705806ec00 legacy=0x7f70580ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7f7057fff640 1 -- 172.21.15.172:0/990812970 >> v1:172.21.15.172:6789/0 conn(0x7f7058161d90 legacy=0x7f705806e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7f70567fc640 1 -- 172.21.15.172:0/990812970 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734599294 0 0) 0x7f70580cd5a0 con 0x7f7058161d90 2024-04-25T08:42:52.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7f7057fff640 1 -- 172.21.15.172:0/990812970 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7058166140 con 0x7f70580cc8b0 2024-04-25T08:42:52.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7ffb6effd640 1 --2- 172.21.15.172:0/2354976410 >> v2:172.21.15.172:3300/0 conn(0x7ffb700cf840 0x7ffb700cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7ffb6effd640 1 -- 172.21.15.172:0/2354976410 >> v1:172.21.15.172:6789/0 conn(0x7ffb70159b20 legacy=0x7ffb7006dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7ffb6effd640 1 -- 172.21.15.172:0/2354976410 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700b2850 con 0x7ffb700b38f0 2024-04-25T08:42:52.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7f14cdc1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14c80d15f0 0x7f14c80cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7f14c77fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f14c806c180 0x7f14c806c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:54926/0 (socket says 172.21.15.172:54926) 2024-04-25T08:42:52.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7f14c77fe640 1 -- 172.21.15.172:0/2477857151 learned_addr learned my addr 172.21.15.172:0/2477857151 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:52.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/2477857151 >> v2:172.21.15.186:3300/0 conn(0x7f14c80b2bb0 0x7f14c8165b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7f14c6ffd640 1 --2- 172.21.15.172:0/2477857151 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14c80d15f0 0x7f14c80cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7f14cdc1f640 1 -- 172.21.15.172:0/2477857151 --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80d2a00 con 0x7f14c806c180 2024-04-25T08:42:52.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7f14cdc1f640 1 -- 172.21.15.172:0/2477857151 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80d2ce0 con 0x7f14c80b2bb0 2024-04-25T08:42:52.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7f14cdc1f640 1 -- 172.21.15.172:0/2477857151 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80d2fc0 con 0x7f14c80d15f0 2024-04-25T08:42:52.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7f14c7fff640 1 --2- 172.21.15.172:0/2477857151 >> v2:172.21.15.186:3300/0 conn(0x7f14c80b2bb0 0x7f14c8165b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.509+0000 7fa13936a640 1 Processor -- start 2024-04-25T08:42:52.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7fa13936a640 1 -- start start 2024-04-25T08:42:52.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7ffb6effd640 1 --2- 172.21.15.172:0/2354976410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 0x7ffb700cf300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffb700b4350 tx=0x7ffb6402e970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=381dec7b88aa4b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7f14c67fc640 1 -- 172.21.15.172:0/2477857151 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494813966 0 0) 0x7f14c80d2a00 con 0x7f14c806c180 2024-04-25T08:42:52.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.510+0000 7f7057fff640 1 --2- 172.21.15.172:0/990812970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580cf480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f704c0097d0 tx=0x7f704c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2bfca43cff50ecb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7f14c67fc640 1 -- 172.21.15.172:0/2477857151 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b0003520 con 0x7f14c806c180 2024-04-25T08:42:52.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7f14c7fff640 1 -- 172.21.15.172:0/2477857151 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14c80d15f0 msgr2=0x7f14c80cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7f14c7fff640 1 --2- 172.21.15.172:0/2477857151 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14c80d15f0 0x7f14c80cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7f14c7fff640 1 -- 172.21.15.172:0/2477857151 >> v1:172.21.15.186:6789/0 conn(0x7f14c806c180 legacy=0x7f14c806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7f14c7fff640 1 -- 172.21.15.172:0/2477857151 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80d32a0 con 0x7f14c80b2bb0 2024-04-25T08:42:52.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7f70567fc640 1 -- 172.21.15.172:0/990812970 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c037070 con 0x7f70580cc8b0 2024-04-25T08:42:52.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7ffb6e7fc640 1 -- 172.21.15.172:0/2354976410 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb640357e0 con 0x7ffb700b38f0 2024-04-25T08:42:52.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7fa13936a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa1340716b0 0x7fa1341616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7ffb6e7fc640 1 -- 172.21.15.172:0/2354976410 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6403b070 con 0x7ffb700b38f0 2024-04-25T08:42:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7fa13936a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340cc6e0 0x7fa134163c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7fa13936a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13406ee70 con 0x7fa134159b20 2024-04-25T08:42:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7fa13936a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13406d9d0 con 0x7fa1340716b0 2024-04-25T08:42:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7fa13936a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa134159f00 con 0x7fa1340cc6e0 2024-04-25T08:42:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7fa1337fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340cc6e0 0x7fa134163c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7fa1337fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340cc6e0 0x7fa134163c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43708/0 (socket says 172.21.15.172:43708) 2024-04-25T08:42:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7fa1337fe640 1 -- 172.21.15.172:0/3329786553 learned_addr learned my addr 172.21.15.172:0/3329786553 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7f3f58922640 1 Processor -- start 2024-04-25T08:42:52.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7f3f58922640 1 -- start start 2024-04-25T08:42:52.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7ff29ca1f640 1 Processor -- start 2024-04-25T08:42:52.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.511+0000 7f70567fc640 1 -- 172.21.15.172:0/990812970 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c032440 con 0x7f70580cc8b0 2024-04-25T08:42:52.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f705e05d640 1 -- 172.21.15.172:0/990812970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 msgr2=0x7f70580cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f705e05d640 1 --2- 172.21.15.172:0/990812970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580cf480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f704c0097d0 tx=0x7f704c02a180 comp rx=0 tx=0).stop 2024-04-25T08:42:52.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7fa1327fc640 1 --2- 172.21.15.172:0/3329786553 >> v2:172.21.15.172:3300/0 conn(0x7fa1340716b0 0x7fa1341616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f705e05d640 1 -- 172.21.15.172:0/990812970 shutdown_connections 2024-04-25T08:42:52.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f705e05d640 1 --2- 172.21.15.172:0/990812970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580cf480 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f705e05d640 1 -- 172.21.15.172:0/990812970 >> 172.21.15.172:0/990812970 conn(0x7f705806abe0 msgr2=0x7f705806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7fa1337fe640 1 -- 172.21.15.172:0/3329786553 >> v2:172.21.15.172:3300/0 conn(0x7fa1340716b0 msgr2=0x7fa1341616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f705e05d640 1 -- 172.21.15.172:0/990812970 shutdown_connections 2024-04-25T08:42:52.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7fa1337fe640 1 --2- 172.21.15.172:0/3329786553 >> v2:172.21.15.172:3300/0 conn(0x7fa1340716b0 0x7fa1341616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7fa1337fe640 1 -- 172.21.15.172:0/3329786553 >> v1:172.21.15.172:6789/0 conn(0x7fa134159b20 legacy=0x7fa134070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7fa1337fe640 1 -- 172.21.15.172:0/3329786553 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340b3b80 con 0x7fa1340cc6e0 2024-04-25T08:42:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f14c7fff640 1 --2- 172.21.15.172:0/2477857151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c80b2bb0 0x7f14c8165b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009d90 tx=0x7f14c002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58f87309dab0c0c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f14c67fc640 1 -- 172.21.15.172:0/2477857151 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0031600 con 0x7f14c80b2bb0 2024-04-25T08:42:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f14c67fc640 1 -- 172.21.15.172:0/2477857151 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c00317a0 con 0x7f14c80b2bb0 2024-04-25T08:42:52.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f14c67fc640 1 -- 172.21.15.172:0/2477857151 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0031b70 con 0x7f14c80b2bb0 2024-04-25T08:42:52.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7f705e05d640 1 -- 172.21.15.172:0/990812970 wait complete. 2024-04-25T08:42:52.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7ff29ca1f640 1 -- start start 2024-04-25T08:42:52.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7ff29ca1f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff298161fc0 0x7ff2981623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f58922640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f540c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f58922640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3f540d03f0 0x7f3f540b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f58922640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540b6170 con 0x7f3f540b5330 2024-04-25T08:42:52.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f58922640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f540b5cd0 con 0x7f3f540d03f0 2024-04-25T08:42:52.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f58922640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540d1990 con 0x7f3f54161e30 2024-04-25T08:42:52.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f5259c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f540c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7ff29ca1f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff29806ea90 0x7ff298071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7ff29ca1f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2981628e0 con 0x7ff29806d2d0 2024-04-25T08:42:52.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7ff29ca1f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff298165be0 con 0x7ff298161fc0 2024-04-25T08:42:52.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7ff29ca1f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff298162ba0 con 0x7ff29806ea90 2024-04-25T08:42:52.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f5259c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f540c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43722/0 (socket says 172.21.15.172:43722) 2024-04-25T08:42:52.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f5259c640 1 -- 172.21.15.172:0/1430648023 learned_addr learned my addr 172.21.15.172:0/1430648023 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f52d9d640 1 --2- 172.21.15.172:0/1430648023 >> v2:172.21.15.186:3300/0 conn(0x7f3f540d03f0 0x7f3f540b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f5259c640 1 -- 172.21.15.172:0/1430648023 >> v2:172.21.15.186:3300/0 conn(0x7f3f540d03f0 msgr2=0x7f3f540b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7fa1337fe640 1 --2- 172.21.15.172:0/3329786553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340cc6e0 0x7fa134163c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c2e0 tx=0x7fa12c02bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2af3f427c0757946 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7ff296d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff29806d2d0 0x7ff29806d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46274/0 (socket says 172.21.15.172:46274) 2024-04-25T08:42:52.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7ff296d9d640 1 -- 172.21.15.172:0/211946417 learned_addr learned my addr 172.21.15.172:0/211946417 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:52.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.512+0000 7ffb6e7fc640 1 -- 172.21.15.172:0/2354976410 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64035ba0 con 0x7ffb700b38f0 2024-04-25T08:42:52.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7ff29659c640 1 --2- 172.21.15.172:0/211946417 >> v2:172.21.15.172:3300/0 conn(0x7ff298161fc0 0x7ff2981623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7fa131ffb640 1 -- 172.21.15.172:0/3329786553 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c033070 con 0x7fa1340cc6e0 2024-04-25T08:42:52.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7fa131ffb640 1 -- 172.21.15.172:0/3329786553 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c02d840 con 0x7fa1340cc6e0 2024-04-25T08:42:52.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7fa131ffb640 1 -- 172.21.15.172:0/3329786553 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c02dc50 con 0x7fa1340cc6e0 2024-04-25T08:42:52.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f639359e640 1 Processor -- start 2024-04-25T08:42:52.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f639359e640 1 -- start start 2024-04-25T08:42:52.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f14cdc1f640 1 -- 172.21.15.172:0/2477857151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c80b2bb0 msgr2=0x7f14c8165b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7ffb75cf5640 1 -- 172.21.15.172:0/2354976410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 msgr2=0x7ffb700cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7ffb75cf5640 1 --2- 172.21.15.172:0/2354976410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 0x7ffb700cf300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffb700b4350 tx=0x7ffb6402e970 comp rx=0 tx=0).stop 2024-04-25T08:42:52.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/2477857151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c80b2bb0 0x7f14c8165b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009d90 tx=0x7f14c002a5d0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f14cdc1f640 1 -- 172.21.15.172:0/2477857151 shutdown_connections 2024-04-25T08:42:52.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7f705e05d640 1 Processor -- start 2024-04-25T08:42:52.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/2477857151 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14c80d15f0 0x7f14c80cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/2477857151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c80b2bb0 0x7f14c8165b10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f14cdc1f640 1 -- 172.21.15.172:0/2477857151 >> 172.21.15.172:0/2477857151 conn(0x7f14c80d3a20 msgr2=0x7f14c80d3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f14cdc1f640 1 -- 172.21.15.172:0/2477857151 shutdown_connections 2024-04-25T08:42:52.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f14cdc1f640 1 -- 172.21.15.172:0/2477857151 wait complete. 2024-04-25T08:42:52.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f5259c640 1 --2- 172.21.15.172:0/1430648023 >> v2:172.21.15.186:3300/0 conn(0x7f3f540d03f0 0x7f3f540b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.513+0000 7f3f5259c640 1 -- 172.21.15.172:0/1430648023 >> v1:172.21.15.186:6789/0 conn(0x7f3f540b5330 legacy=0x7f3f540cfce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T08:42:52.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7f3f5259c640 1 -- 172.21.15.172:0/1430648023 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f540d09c0 con 0x7f3f54161e30 2024-04-25T08:42:52.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7ff28dd9b640 1 --2- 172.21.15.172:0/211946417 >> v2:172.21.15.186:3300/0 conn(0x7ff29806ea90 0x7ff298071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7ff29659c640 1 -- 172.21.15.172:0/211946417 >> v2:172.21.15.186:3300/0 conn(0x7ff29806ea90 msgr2=0x7ff298071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7ff29659c640 1 --2- 172.21.15.172:0/211946417 >> v2:172.21.15.186:3300/0 conn(0x7ff29806ea90 0x7ff298071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7ff29659c640 1 -- 172.21.15.172:0/211946417 >> v1:172.21.15.172:6789/0 conn(0x7ff29806d2d0 legacy=0x7ff29806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7ff29659c640 1 -- 172.21.15.172:0/211946417 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff298162e80 con 0x7ff298161fc0 2024-04-25T08:42:52.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7f705e05d640 1 -- start start 2024-04-25T08:42:52.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7f211ffff640 1 Processor -- start 2024-04-25T08:42:52.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.514+0000 7f211ffff640 1 -- start start 2024-04-25T08:42:52.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f3f5259c640 1 --2- 172.21.15.172:0/1430648023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f540c7400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009870 tx=0x7f3f4402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33cd3abc7e62286c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7fa13936a640 1 -- 172.21.15.172:0/3329786553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340cc6e0 msgr2=0x7fa134163c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7fa13936a640 1 --2- 172.21.15.172:0/3329786553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340cc6e0 0x7fa134163c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c2e0 tx=0x7fa12c02bb20 comp rx=0 tx=0).stop 2024-04-25T08:42:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7ffb75cf5640 1 -- 172.21.15.172:0/2354976410 shutdown_connections 2024-04-25T08:42:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7ffb75cf5640 1 --2- 172.21.15.172:0/2354976410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 0x7ffb700cf300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7ffb75cf5640 1 --2- 172.21.15.172:0/2354976410 >> v2:172.21.15.172:3300/0 conn(0x7ffb700cf840 0x7ffb700cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7ffb75cf5640 1 -- 172.21.15.172:0/2354976410 >> 172.21.15.172:0/2354976410 conn(0x7ffb7006abe0 msgr2=0x7ffb7006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7ffb75cf5640 1 -- 172.21.15.172:0/2354976410 shutdown_connections 2024-04-25T08:42:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7ffb75cf5640 1 -- 172.21.15.172:0/2354976410 wait complete. 2024-04-25T08:42:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f639359e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f63940b3690 0x7f639415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f639359e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63940b2710 0x7f639406da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f639359e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639415d4f0 con 0x7f639406f100 2024-04-25T08:42:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f639359e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639415d300 con 0x7f63940b2710 2024-04-25T08:42:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f639359e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639415d790 con 0x7f63940b3690 2024-04-25T08:42:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7fa13936a640 1 -- 172.21.15.172:0/3329786553 shutdown_connections 2024-04-25T08:42:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7fa13936a640 1 --2- 172.21.15.172:0/3329786553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340cc6e0 0x7fa134163c00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7fa13936a640 1 --2- 172.21.15.172:0/3329786553 >> v2:172.21.15.172:3300/0 conn(0x7fa1340716b0 0x7fa1341616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f3f5159a640 1 -- 172.21.15.172:0/1430648023 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44037070 con 0x7f3f54161e30 2024-04-25T08:42:52.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f3f5159a640 1 -- 172.21.15.172:0/1430648023 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f44032440 con 0x7f3f54161e30 2024-04-25T08:42:52.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7ff29659c640 1 --2- 172.21.15.172:0/211946417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff298161fc0 0x7ff2981623a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff2980713b0 tx=0x7ff28002a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b7a31c6d8e258b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7fa13936a640 1 -- 172.21.15.172:0/3329786553 >> 172.21.15.172:0/3329786553 conn(0x7fa1340b1170 msgr2=0x7fa1340b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f14cdc1f640 1 Processor -- start 2024-04-25T08:42:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f3f5159a640 1 -- 172.21.15.172:0/1430648023 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44032810 con 0x7f3f54161e30 2024-04-25T08:42:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f705e05d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f705806ec00 0x7f70580c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f705e05d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f705e05d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7058161d90 0x7f70580c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f705e05d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7058071ec0 con 0x7f705806ec00 2024-04-25T08:42:52.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f705e05d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7058166700 con 0x7f7058161d90 2024-04-25T08:42:52.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f705e05d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7058072040 con 0x7f70580cc8b0 2024-04-25T08:42:52.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f14cdc1f640 1 -- start start 2024-04-25T08:42:52.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f211ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2120161c00 0x7f2120071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f7056ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f7056ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43738/0 (socket says 172.21.15.172:43738) 2024-04-25T08:42:52.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f7056ffd640 1 -- 172.21.15.172:0/2453780401 learned_addr learned my addr 172.21.15.172:0/2453780401 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f211ffff640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21200b38e0 con 0x7f2120161fe0 2024-04-25T08:42:52.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f211ffff640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21200b3b80 con 0x7f21200b4660 2024-04-25T08:42:52.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f7057fff640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7058161d90 0x7f70580c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7ff295d9b640 1 -- 172.21.15.172:0/211946417 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280037070 con 0x7ff298161fc0 2024-04-25T08:42:52.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f70577fe640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f705806ec00 0x7f70580c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f3f58922640 1 -- 172.21.15.172:0/1430648023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 msgr2=0x7f3f540c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f3f58922640 1 --2- 172.21.15.172:0/1430648023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f540c7400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009870 tx=0x7f3f4402a250 comp rx=0 tx=0).stop 2024-04-25T08:42:52.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7ff295d9b640 1 -- 172.21.15.172:0/211946417 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28002aca0 con 0x7ff298161fc0 2024-04-25T08:42:52.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7ff295d9b640 1 -- 172.21.15.172:0/211946417 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280032660 con 0x7ff298161fc0 2024-04-25T08:42:52.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f639259c640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f639406f100 0x7f63940b2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:54944/0 (socket says 172.21.15.172:54944) 2024-04-25T08:42:52.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f639259c640 1 -- 172.21.15.172:0/1842004774 learned_addr learned my addr 172.21.15.172:0/1842004774 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:52.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.515+0000 7f6392d9d640 1 --2- 172.21.15.172:0/1842004774 >> v2:172.21.15.172:3300/0 conn(0x7f63940b2710 0x7f639406da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f6391d9b640 1 --2- 172.21.15.172:0/1842004774 >> v2:172.21.15.186:3300/0 conn(0x7f63940b3690 0x7f639415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7ffb75cf5640 1 Processor -- start 2024-04-25T08:42:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f7056ffd640 1 -- 172.21.15.172:0/2453780401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7058161d90 msgr2=0x7f70580c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f7056ffd640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7058161d90 0x7f70580c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f7056ffd640 1 -- 172.21.15.172:0/2453780401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f705806ec00 msgr2=0x7f70580c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f7056ffd640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f705806ec00 0x7f70580c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f7056ffd640 1 -- 172.21.15.172:0/2453780401 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70580c68d0 con 0x7f70580cc8b0 2024-04-25T08:42:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f639159a640 1 -- 172.21.15.172:0/1842004774 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053171653 0 0) 0x7f639415d4f0 con 0x7f639406f100 2024-04-25T08:42:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f639159a640 1 -- 172.21.15.172:0/1842004774 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f637c003520 con 0x7f639406f100 2024-04-25T08:42:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f7056ffd640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580c7e60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f705000c760 tx=0x7f705000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7ffb75cf5640 1 -- start start 2024-04-25T08:42:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f6392d9d640 1 -- 172.21.15.172:0/1842004774 >> v2:172.21.15.186:3300/0 conn(0x7f63940b3690 msgr2=0x7f639415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f6392d9d640 1 --2- 172.21.15.172:0/1842004774 >> v2:172.21.15.186:3300/0 conn(0x7f63940b3690 0x7f639415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f6392d9d640 1 -- 172.21.15.172:0/1842004774 >> v1:172.21.15.186:6789/0 conn(0x7f639406f100 legacy=0x7f63940b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f6392d9d640 1 -- 172.21.15.172:0/1842004774 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639415da70 con 0x7f63940b2710 2024-04-25T08:42:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f3f58922640 1 -- 172.21.15.172:0/1430648023 shutdown_connections 2024-04-25T08:42:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f3f58922640 1 --2- 172.21.15.172:0/1430648023 >> v2:172.21.15.186:3300/0 conn(0x7f3f540d03f0 0x7f3f540b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f14cdc1f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c806c180 0x7f14c80c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f3f58922640 1 --2- 172.21.15.172:0/1430648023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f540c7400 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f3f58922640 1 -- 172.21.15.172:0/1430648023 >> 172.21.15.172:0/1430648023 conn(0x7f3f5406bf40 msgr2=0x7f3f5406c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f14cdc1f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14c80b2bb0 0x7f14c80c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f211ffff640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21200b3e60 con 0x7f2120161c00 2024-04-25T08:42:52.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f211f7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2120161fe0 0x7f21200cc070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46280/0 (socket says 172.21.15.172:46280) 2024-04-25T08:42:52.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f211f7fe640 1 -- 172.21.15.172:0/2580827209 learned_addr learned my addr 172.21.15.172:0/2580827209 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:52.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.516+0000 7f211effd640 1 --2- 172.21.15.172:0/2580827209 >> v2:172.21.15.172:3300/0 conn(0x7f2120161c00 0x7f2120071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f211effd640 1 -- 172.21.15.172:0/2580827209 >> v1:172.21.15.186:6789/0 conn(0x7f21200b4660 legacy=0x7f21200b26a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T08:42:52.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f211dffb640 1 -- 172.21.15.172:0/2580827209 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369544935 0 0) 0x7f21200b38e0 con 0x7f2120161fe0 2024-04-25T08:42:52.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f211effd640 1 -- 172.21.15.172:0/2580827209 >> v1:172.21.15.172:6789/0 conn(0x7f2120161fe0 legacy=0x7f21200cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f211effd640 1 -- 172.21.15.172:0/2580827209 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200b4140 con 0x7f2120161c00 2024-04-25T08:42:52.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f703ffff640 1 -- 172.21.15.172:0/2453780401 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050003b70 con 0x7f70580cc8b0 2024-04-25T08:42:52.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f703ffff640 1 -- 172.21.15.172:0/2453780401 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7050003d10 con 0x7f70580cc8b0 2024-04-25T08:42:52.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f703ffff640 1 -- 172.21.15.172:0/2453780401 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705000aa90 con 0x7f70580cc8b0 2024-04-25T08:42:52.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7fa13936a640 1 -- 172.21.15.172:0/3329786553 shutdown_connections 2024-04-25T08:42:52.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14c77fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c806c180 0x7f14c80c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14c77fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c806c180 0x7f14c80c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:40504/0 (socket says 172.21.15.172:40504) 2024-04-25T08:42:52.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.517+0000 7f705e05d640 1 -- 172.21.15.172:0/2453780401 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70580c6bb0 con 0x7f70580cc8b0 2024-04-25T08:42:52.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f705e05d640 1 -- 172.21.15.172:0/2453780401 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70580c7170 con 0x7f70580cc8b0 2024-04-25T08:42:52.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ff29ca1f640 1 -- 172.21.15.172:0/211946417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff298161fc0 msgr2=0x7ff2981623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ff29ca1f640 1 --2- 172.21.15.172:0/211946417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff298161fc0 0x7ff2981623a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff2980713b0 tx=0x7ff28002a010 comp rx=0 tx=0).stop 2024-04-25T08:42:52.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14c77fe640 1 -- 172.21.15.172:0/386157561 learned_addr learned my addr 172.21.15.172:0/386157561 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14c80d15f0 0x7f14c80c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ff29ca1f640 1 -- 172.21.15.172:0/211946417 shutdown_connections 2024-04-25T08:42:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ff29ca1f640 1 --2- 172.21.15.172:0/211946417 >> v2:172.21.15.186:3300/0 conn(0x7ff29806ea90 0x7ff298071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ff29ca1f640 1 --2- 172.21.15.172:0/211946417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff298161fc0 0x7ff2981623a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ff29ca1f640 1 -- 172.21.15.172:0/211946417 >> 172.21.15.172:0/211946417 conn(0x7ff29806abe0 msgr2=0x7ff29806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80b3030 con 0x7f14c80b2bb0 2024-04-25T08:42:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7fa13936a640 1 -- 172.21.15.172:0/3329786553 wait complete. 2024-04-25T08:42:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80d25c0 con 0x7f14c806c180 2024-04-25T08:42:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80b31b0 con 0x7f14c80d15f0 2024-04-25T08:42:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f3f58922640 1 -- 172.21.15.172:0/1430648023 shutdown_connections 2024-04-25T08:42:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ff29ca1f640 1 -- 172.21.15.172:0/211946417 shutdown_connections 2024-04-25T08:42:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ff29ca1f640 1 -- 172.21.15.172:0/211946417 wait complete. 2024-04-25T08:42:52.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ffb75cf5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 0x7ffb701430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14c7fff640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14c80d15f0 0x7f14c80c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ffb75cf5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb700cf840 0x7ffb70145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ffb75cf5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70159b20 0x7ffb70153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ffb75cf5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700b30f0 con 0x7ffb70159b20 2024-04-25T08:42:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ffb75cf5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700b2e10 con 0x7ffb700b38f0 2024-04-25T08:42:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7ffb75cf5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7006e2d0 con 0x7ffb700cf840 2024-04-25T08:42:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f3f58922640 1 -- 172.21.15.172:0/1430648023 wait complete. 2024-04-25T08:42:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14c77fe640 1 -- 172.21.15.172:0/386157561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14c80d15f0 msgr2=0x7f14c80c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14c77fe640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14c80d15f0 0x7f14c80c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14c77fe640 1 -- 172.21.15.172:0/386157561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14c80b2bb0 msgr2=0x7f14c80c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14c77fe640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14c80b2bb0 0x7f14c80c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f14c77fe640 1 -- 172.21.15.172:0/386157561 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8163810 con 0x7f14c806c180 2024-04-25T08:42:52.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.518+0000 7f211effd640 1 --2- 172.21.15.172:0/2580827209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 0x7f2120071010 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f21140097a0 tx=0x7f211402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b0689ed88956cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.519+0000 7f211dffb640 1 -- 172.21.15.172:0/2580827209 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114037070 con 0x7f2120161c00 2024-04-25T08:42:52.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.519+0000 7f14c77fe640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c806c180 0x7f14c80c9850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c410 tx=0x7f14b800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.519+0000 7f211dffb640 1 -- 172.21.15.172:0/2580827209 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211402ae50 con 0x7f2120161c00 2024-04-25T08:42:52.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.519+0000 7f211dffb640 1 -- 172.21.15.172:0/2580827209 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114032660 con 0x7f2120161c00 2024-04-25T08:42:52.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.519+0000 7ffb6f7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 0x7ffb701430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.519+0000 7ffb6ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70159b20 0x7ffb70153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.519+0000 7ffb6f7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 0x7ffb701430f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:40520/0 (socket says 172.21.15.172:40520) 2024-04-25T08:42:52.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.519+0000 7ffb6f7fe640 1 -- 172.21.15.172:0/1515420890 learned_addr learned my addr 172.21.15.172:0/1515420890 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.519+0000 7ffb6effd640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb700cf840 0x7ffb70145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f14affff640 1 -- 172.21.15.172:0/386157561 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8017070 con 0x7f14c806c180 2024-04-25T08:42:52.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7ffb6f7fe640 1 -- 172.21.15.172:0/1515420890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb700cf840 msgr2=0x7ffb70145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7ffb6f7fe640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb700cf840 0x7ffb70145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7ffb6f7fe640 1 -- 172.21.15.172:0/1515420890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70159b20 msgr2=0x7ffb70153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f703ffff640 1 -- 172.21.15.172:0/2453780401 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f705000ac30 con 0x7f70580cc8b0 2024-04-25T08:42:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7ffb6f7fe640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70159b20 0x7ffb70153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f211ffff640 1 -- 172.21.15.172:0/2580827209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 msgr2=0x7f2120071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f211ffff640 1 --2- 172.21.15.172:0/2580827209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 0x7f2120071010 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f21140097a0 tx=0x7f211402a140 comp rx=0 tx=0).stop 2024-04-25T08:42:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7ffb6f7fe640 1 -- 172.21.15.172:0/1515420890 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb701437b0 con 0x7ffb700b38f0 2024-04-25T08:42:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f705e05d640 1 -- 172.21.15.172:0/2453780401 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7038005290 con 0x7f70580cc8b0 2024-04-25T08:42:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7ffb6f7fe640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 0x7ffb701430f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000c430 tx=0x7ffb6000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f211ffff640 1 -- 172.21.15.172:0/2580827209 shutdown_connections 2024-04-25T08:42:52.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f211ffff640 1 --2- 172.21.15.172:0/2580827209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 0x7f2120071010 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f211ffff640 1 -- 172.21.15.172:0/2580827209 >> 172.21.15.172:0/2580827209 conn(0x7f212006adc0 msgr2=0x7f212006b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f14affff640 1 -- 172.21.15.172:0/386157561 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b8005ce0 con 0x7f14c806c180 2024-04-25T08:42:52.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f6392d9d640 1 --2- 172.21.15.172:0/1842004774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b2710 0x7f639406da00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f63940cbf90 tx=0x7f638c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd23dd20a6b132a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7ffb57fff640 1 -- 172.21.15.172:0/1515420890 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60017070 con 0x7ffb700b38f0 2024-04-25T08:42:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7ffb57fff640 1 -- 172.21.15.172:0/1515420890 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600052d0 con 0x7ffb700b38f0 2024-04-25T08:42:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7ffb57fff640 1 -- 172.21.15.172:0/1515420890 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60003830 con 0x7ffb700b38f0 2024-04-25T08:42:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f211ffff640 1 -- 172.21.15.172:0/2580827209 shutdown_connections 2024-04-25T08:42:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f3f58922640 1 Processor -- start 2024-04-25T08:42:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f211ffff640 1 -- 172.21.15.172:0/2580827209 wait complete. 2024-04-25T08:42:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7f703ffff640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f704406b5a0 0x7f704406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f3f58922640 1 -- start start 2024-04-25T08:42:52.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f703ffff640 1 -- 172.21.15.172:0/2453780401 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f705008a3f0 con 0x7f70580cc8b0 2024-04-25T08:42:52.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7fa13936a640 1 Processor -- start 2024-04-25T08:42:52.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.520+0000 7fa13936a640 1 -- start start 2024-04-25T08:42:52.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7ff29ca1f640 1 Processor -- start 2024-04-25T08:42:52.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7ff29ca1f640 1 -- start start 2024-04-25T08:42:52.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f14affff640 1 -- 172.21.15.172:0/386157561 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b80072f0 con 0x7f14c806c180 2024-04-25T08:42:52.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f3f58922640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f540b5330 0x7f3f5414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f3f58922640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f540d03f0 0x7f3f540cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f3f58922640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f5415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f3f58922640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54162210 con 0x7f3f540d03f0 2024-04-25T08:42:52.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f3f58922640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540d1620 con 0x7f3f540b5330 2024-04-25T08:42:52.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f3f58922640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540d1e20 con 0x7f3f54161e30 2024-04-25T08:42:52.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7ffb75cf5640 1 -- 172.21.15.172:0/1515420890 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb70143a90 con 0x7ffb700b38f0 2024-04-25T08:42:52.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c8163af0 con 0x7f14c806c180 2024-04-25T08:42:52.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7ffb75cf5640 1 -- 172.21.15.172:0/1515420890 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb70144050 con 0x7ffb700b38f0 2024-04-25T08:42:52.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.521+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c81640b0 con 0x7f14c806c180 2024-04-25T08:42:52.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f5259c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f540b5330 0x7f3f5414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f52d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f5415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f52d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f5415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43754/0 (socket says 172.21.15.172:43754) 2024-04-25T08:42:52.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f52d9d640 1 -- 172.21.15.172:0/1788790257 learned_addr learned my addr 172.21.15.172:0/1788790257 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f51d9b640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f540d03f0 0x7f3f540cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f70577fe640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f704406b5a0 0x7f704406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7fa13936a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340716b0 0x7fa1340a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7fa13936a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1340cc6e0 0x7fa134151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7fa13936a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa134159b20 0x7fa1340af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7fa13936a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13406d660 con 0x7fa1340cc6e0 2024-04-25T08:42:52.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7fa13936a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13406d380 con 0x7fa134159b20 2024-04-25T08:42:52.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7fa13936a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1340b37a0 con 0x7fa1340716b0 2024-04-25T08:42:52.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7fa1337fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa134159b20 0x7fa1340af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7fa1337fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa134159b20 0x7fa1340af820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:40532/0 (socket says 172.21.15.172:40532) 2024-04-25T08:42:52.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7fa1337fe640 1 -- 172.21.15.172:0/1378211151 learned_addr learned my addr 172.21.15.172:0/1378211151 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f639159a640 1 -- 172.21.15.172:0/1842004774 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c007740 con 0x7f63940b2710 2024-04-25T08:42:52.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f211ffff640 1 Processor -- start 2024-04-25T08:42:52.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7ff29ca1f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff29806d2d0 0x7ff29815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c8073a00 con 0x7f14c806c180 2024-04-25T08:42:52.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7ff29ca1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff29806ea90 0x7ff2980add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f639159a640 1 -- 172.21.15.172:0/1842004774 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c0078e0 con 0x7f63940b2710 2024-04-25T08:42:52.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f639159a640 1 -- 172.21.15.172:0/1842004774 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c007cb0 con 0x7f63940b2710 2024-04-25T08:42:52.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7ff29ca1f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff298161fc0 0x7ff298164740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7ff29ca1f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980719c0 con 0x7ff298161fc0 2024-04-25T08:42:52.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7ff29ca1f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff298163440 con 0x7ff29806d2d0 2024-04-25T08:42:52.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7ff29ca1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff298071b40 con 0x7ff29806ea90 2024-04-25T08:42:52.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f52d9d640 1 -- 172.21.15.172:0/1788790257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f540b5330 msgr2=0x7f3f5414fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f52d9d640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f540b5330 0x7f3f5414fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f52d9d640 1 -- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f540d03f0 msgr2=0x7f3f540cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f52d9d640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f540d03f0 0x7f3f540cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f52d9d640 1 -- 172.21.15.172:0/1788790257 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f540ce680 con 0x7f3f54161e30 2024-04-25T08:42:52.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f3f51d9b640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f540d03f0 0x7f3f540cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:52.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7fa1327fc640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1340cc6e0 0x7fa134151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7f3f52d9d640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f5415d340 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00efc0 tx=0x7f3f4c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7ff296d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff298161fc0 0x7ff298164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7ff296d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff298161fc0 0x7ff298164740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50678/0 (socket says 172.21.15.172:50678) 2024-04-25T08:42:52.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7ff296d9d640 1 -- 172.21.15.172:0/4187083185 learned_addr learned my addr 172.21.15.172:0/4187083185 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7ff28dd9b640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff29806ea90 0x7ff2980add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7ffb75cf5640 1 -- 172.21.15.172:0/1515420890 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb70073990 con 0x7ffb700b38f0 2024-04-25T08:42:52.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7fa1337fe640 1 -- 172.21.15.172:0/1378211151 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340716b0 msgr2=0x7fa1340a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7fa1337fe640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340716b0 0x7fa1340a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7fa1337fe640 1 -- 172.21.15.172:0/1378211151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1340cc6e0 msgr2=0x7fa134151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7fa1337fe640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1340cc6e0 0x7fa134151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7fa1337fe640 1 -- 172.21.15.172:0/1378211151 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1340a8cf0 con 0x7fa134159b20 2024-04-25T08:42:52.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.522+0000 7f211ffff640 1 -- start start 2024-04-25T08:42:52.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7f70577fe640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f704406b5a0 0x7f704406da60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7048000f60 tx=0x7f7048007b90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7ff28dd9b640 1 -- 172.21.15.172:0/4187083185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff29806d2d0 msgr2=0x7ff29815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7ff28dd9b640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff29806d2d0 0x7ff29815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7ff28dd9b640 1 -- 172.21.15.172:0/4187083185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff298161fc0 msgr2=0x7ff298164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7ff28dd9b640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff298161fc0 0x7ff298164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7ff28dd9b640 1 -- 172.21.15.172:0/4187083185 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29815e930 con 0x7ff29806ea90 2024-04-25T08:42:52.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7f639359e640 1 -- 172.21.15.172:0/1842004774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b2710 msgr2=0x7f639406da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.523+0000 7f639359e640 1 --2- 172.21.15.172:0/1842004774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b2710 0x7f639406da00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f63940cbf90 tx=0x7f638c02a680 comp rx=0 tx=0).stop 2024-04-25T08:42:52.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7fa1337fe640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa134159b20 0x7fa1340af820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c2e0 tx=0x7fa12c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f639359e640 1 -- 172.21.15.172:0/1842004774 shutdown_connections 2024-04-25T08:42:52.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f639359e640 1 --2- 172.21.15.172:0/1842004774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b2710 0x7f639406da00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f639359e640 1 --2- 172.21.15.172:0/1842004774 >> v2:172.21.15.186:3300/0 conn(0x7f63940b3690 0x7f639415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f639359e640 1 -- 172.21.15.172:0/1842004774 >> 172.21.15.172:0/1842004774 conn(0x7f6394061c60 msgr2=0x7f639406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7ff28dd9b640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff29806ea90 0x7ff2980add80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c5e0 tx=0x7ff28800caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f639359e640 1 -- 172.21.15.172:0/1842004774 shutdown_connections 2024-04-25T08:42:52.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7ffb57fff640 1 -- 172.21.15.172:0/1515420890 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb6001a070 con 0x7ffb700b38f0 2024-04-25T08:42:52.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f639359e640 1 -- 172.21.15.172:0/1842004774 wait complete. 2024-04-25T08:42:52.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211ffff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21200b4660 0x7f212014d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f14affff640 1 -- 172.21.15.172:0/386157561 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f14b801a070 con 0x7f14c806c180 2024-04-25T08:42:52.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 0x7f21200cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211ffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2120161fe0 0x7f2120164080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211ffff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21200b2f30 con 0x7f2120161c00 2024-04-25T08:42:52.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211ffff640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21200b2db0 con 0x7f21200b4660 2024-04-25T08:42:52.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211ffff640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21200b30b0 con 0x7f2120161fe0 2024-04-25T08:42:52.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7ffb57fff640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb5c06b520 0x7ffb5c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 0x7f21200cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 0x7f21200cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50680/0 (socket says 172.21.15.172:50680) 2024-04-25T08:42:52.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211effd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21200b4660 0x7f212014d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211e7fc640 1 -- 172.21.15.172:0/2689769280 learned_addr learned my addr 172.21.15.172:0/2689769280 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7ffb57fff640 1 -- 172.21.15.172:0/1515420890 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffb600897d0 con 0x7ffb700b38f0 2024-04-25T08:42:52.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7f211f7fe640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2120161fe0 0x7f2120164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.524+0000 7ffb6effd640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb5c06b520 0x7ffb5c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f14affff640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f14b406b520 0x7f14b406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f14affff640 1 -- 172.21.15.172:0/386157561 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f14b8089f00 con 0x7f14c806c180 2024-04-25T08:42:52.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f14c6ffd640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f14b406b520 0x7f14b406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f211effd640 1 -- 172.21.15.172:0/2689769280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2120161fe0 msgr2=0x7f2120164080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f211effd640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2120161fe0 0x7f2120164080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f211effd640 1 -- 172.21.15.172:0/2689769280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 msgr2=0x7f21200cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f211effd640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 0x7f21200cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f211effd640 1 -- 172.21.15.172:0/2689769280 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200ce280 con 0x7f21200b4660 2024-04-25T08:42:52.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f211e7fc640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 0x7f21200cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:52.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f211effd640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21200b4660 0x7f212014d830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f212006ee20 tx=0x7f21140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7ffb6effd640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb5c06b520 0x7ffb5c06d9e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb6403a000 tx=0x7ffb6400d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.525+0000 7f14c6ffd640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f14b406b520 0x7f14b406d9e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006a90 tx=0x7f14bc006a20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7f639359e640 1 Processor -- start 2024-04-25T08:42:52.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7f639359e640 1 -- start start 2024-04-25T08:42:52.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7f3f42ffd640 1 -- 172.21.15.172:0/1788790257 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c018020 con 0x7f3f54161e30 2024-04-25T08:42:52.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7ff28f7fe640 1 -- 172.21.15.172:0/4187083185 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288015070 con 0x7ff29806ea90 2024-04-25T08:42:52.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7ff28f7fe640 1 -- 172.21.15.172:0/4187083185 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff288004220 con 0x7ff29806ea90 2024-04-25T08:42:52.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7ff28f7fe640 1 -- 172.21.15.172:0/4187083185 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288003610 con 0x7ff29806ea90 2024-04-25T08:42:52.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7ff29ca1f640 1 -- 172.21.15.172:0/4187083185 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29814a9c0 con 0x7ff29806ea90 2024-04-25T08:42:52.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7ff29ca1f640 1 -- 172.21.15.172:0/4187083185 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29814ac60 con 0x7ff29806ea90 2024-04-25T08:42:52.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7f3f42ffd640 1 -- 172.21.15.172:0/1788790257 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c014480 con 0x7f3f54161e30 2024-04-25T08:42:52.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7f3f42ffd640 1 -- 172.21.15.172:0/1788790257 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c014870 con 0x7f3f54161e30 2024-04-25T08:42:52.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7f3f58922640 1 -- 172.21.15.172:0/1788790257 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f540cda70 con 0x7f3f54161e30 2024-04-25T08:42:52.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7f3f58922640 1 -- 172.21.15.172:0/1788790257 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f540ce030 con 0x7f3f54161e30 2024-04-25T08:42:52.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.526+0000 7f703ffff640 1 -- 172.21.15.172:0/2453780401 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7050058fa0 con 0x7f70580cc8b0 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f639359e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f639406f100 0x7f6394167070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f639359e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63940b2710 0x7f6394153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f639359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b3690 0x7f639413e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f639359e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639415e310 con 0x7f63940b3690 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f639359e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639415e030 con 0x7f639406f100 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f639359e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63940cfbe0 con 0x7f63940b2710 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f6392d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b3690 0x7f639413e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f6392d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b3690 0x7f639413e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50682/0 (socket says 172.21.15.172:50682) 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f6392d9d640 1 -- 172.21.15.172:0/894072046 learned_addr learned my addr 172.21.15.172:0/894072046 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f639259c640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f639406f100 0x7f6394167070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f6392d9d640 1 -- 172.21.15.172:0/894072046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63940b2710 msgr2=0x7f6394153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f6391d9b640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63940b2710 0x7f6394153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f6392d9d640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63940b2710 0x7f6394153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f6392d9d640 1 -- 172.21.15.172:0/894072046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f639406f100 msgr2=0x7f6394167070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f6392d9d640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f639406f100 0x7f6394167070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.527+0000 7f6392d9d640 1 -- 172.21.15.172:0/894072046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639413f640 con 0x7f63940b3690 2024-04-25T08:42:52.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7f3f58922640 1 -- 172.21.15.172:0/1788790257 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5415d0a0 con 0x7f3f54161e30 2024-04-25T08:42:52.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7f6391d9b640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63940b2710 0x7f6394153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:52.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7f6392d9d640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b3690 0x7f639413e370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f638c02ac70 tx=0x7f638c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7f6382ffd640 1 -- 172.21.15.172:0/894072046 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c040070 con 0x7f63940b3690 2024-04-25T08:42:52.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7f639359e640 1 -- 172.21.15.172:0/894072046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639413f8e0 con 0x7f63940b3690 2024-04-25T08:42:52.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7ff28f7fe640 1 -- 172.21.15.172:0/4187083185 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff2880037d0 con 0x7ff29806ea90 2024-04-25T08:42:52.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7ff29ca1f640 1 -- 172.21.15.172:0/4187083185 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff298073a00 con 0x7ff29806ea90 2024-04-25T08:42:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7f639359e640 1 -- 172.21.15.172:0/894072046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6394153f80 con 0x7f63940b3690 2024-04-25T08:42:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7f6382ffd640 1 -- 172.21.15.172:0/894072046 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c031bc0 con 0x7f63940b3690 2024-04-25T08:42:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7f3f42ffd640 1 -- 172.21.15.172:0/1788790257 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3f4c01b020 con 0x7f3f54161e30 2024-04-25T08:42:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.528+0000 7ff28f7fe640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff27806b500 0x7ff27806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7ff28f7fe640 1 -- 172.21.15.172:0/4187083185 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff28808a230 con 0x7ff29806ea90 2024-04-25T08:42:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7f3f42ffd640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3406b4d0 0x7f3f3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7ff29659c640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff27806b500 0x7ff27806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7f6382ffd640 1 -- 172.21.15.172:0/894072046 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c009450 con 0x7f63940b3690 2024-04-25T08:42:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7f14affff640 1 -- 172.21.15.172:0/386157561 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f14b8021020 con 0x7f14c806c180 2024-04-25T08:42:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7f2107fff640 1 -- 172.21.15.172:0/2689769280 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114042070 con 0x7f21200b4660 2024-04-25T08:42:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7f3f42ffd640 1 -- 172.21.15.172:0/1788790257 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3f4c08af40 con 0x7f3f54161e30 2024-04-25T08:42:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7f3f5259c640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3406b4d0 0x7f3f3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7f211ffff640 1 -- 172.21.15.172:0/2689769280 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21200ce560 con 0x7f21200b4660 2024-04-25T08:42:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7fa11b7fe640 1 -- 172.21.15.172:0/1378211151 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c047070 con 0x7fa134159b20 2024-04-25T08:42:52.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7f211ffff640 1 -- 172.21.15.172:0/2689769280 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21200ceb20 con 0x7f21200b4660 2024-04-25T08:42:52.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.529+0000 7fa13936a640 1 -- 172.21.15.172:0/1378211151 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1340a8fd0 con 0x7fa134159b20 2024-04-25T08:42:52.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.530+0000 7fa13936a640 1 -- 172.21.15.172:0/1378211151 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1340a9590 con 0x7fa134159b20 2024-04-25T08:42:52.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.530+0000 7f639359e640 1 -- 172.21.15.172:0/894072046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63940b2530 con 0x7f63940b3690 2024-04-25T08:42:52.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.530+0000 7ff29659c640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff27806b500 0x7ff27806d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff280034000 tx=0x7ff28002c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.530+0000 7f6382ffd640 1 -- 172.21.15.172:0/894072046 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f638c039040 con 0x7f63940b3690 2024-04-25T08:42:52.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.530+0000 7f3f5259c640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3406b4d0 0x7f3f3406d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3f44034000 tx=0x7f3f4402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.531+0000 7f6382ffd640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f637406b500 0x7f637406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.531+0000 7f6382ffd640 1 -- 172.21.15.172:0/894072046 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f638c0abce0 con 0x7f63940b3690 2024-04-25T08:42:52.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.531+0000 7fa13936a640 1 -- 172.21.15.172:0/1378211151 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa134073990 con 0x7fa134159b20 2024-04-25T08:42:52.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.531+0000 7f211ffff640 1 -- 172.21.15.172:0/2689769280 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2120073990 con 0x7f21200b4660 2024-04-25T08:42:52.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.531+0000 7f639259c640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f637406b500 0x7f637406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.532+0000 7f639259c640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f637406b500 0x7f637406d9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63840011e0 tx=0x7f6384007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.533+0000 7fa11b7fe640 1 -- 172.21.15.172:0/1378211151 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c02d700 con 0x7fa134159b20 2024-04-25T08:42:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.533+0000 7fa11b7fe640 1 -- 172.21.15.172:0/1378211151 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c051060 con 0x7fa134159b20 2024-04-25T08:42:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.533+0000 7f2107fff640 1 -- 172.21.15.172:0/2689769280 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211402ae50 con 0x7f21200b4660 2024-04-25T08:42:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.533+0000 7f2107fff640 1 -- 172.21.15.172:0/2689769280 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211404c060 con 0x7f21200b4660 2024-04-25T08:42:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.533+0000 7ff28f7fe640 1 -- 172.21.15.172:0/4187083185 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff288058720 con 0x7ff29806ea90 2024-04-25T08:42:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.534+0000 7ffb57fff640 1 -- 172.21.15.172:0/1515420890 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb60057d20 con 0x7ffb700b38f0 2024-04-25T08:42:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.535+0000 7fa11b7fe640 1 -- 172.21.15.172:0/1378211151 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa12c04a070 con 0x7fa134159b20 2024-04-25T08:42:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.535+0000 7f2107fff640 1 -- 172.21.15.172:0/2689769280 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2114045070 con 0x7f21200b4660 2024-04-25T08:42:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.536+0000 7f2107fff640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210c06b4d0 0x7f210c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.536+0000 7fa11b7fe640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa12006b4d0 0x7fa12006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.536+0000 7fa11b7fe640 1 -- 172.21.15.172:0/1378211151 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa12c0abb10 con 0x7fa134159b20 2024-04-25T08:42:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.536+0000 7f2107fff640 1 -- 172.21.15.172:0/2689769280 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f21140ab100 con 0x7f21200b4660 2024-04-25T08:42:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.536+0000 7f211e7fc640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210c06b4d0 0x7f210c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.536+0000 7fa132ffd640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa12006b4d0 0x7fa12006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.536+0000 7f6382ffd640 1 -- 172.21.15.172:0/894072046 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f63940b2530 con 0x7f63940b3690 2024-04-25T08:42:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.537+0000 7f211e7fc640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210c06b4d0 0x7f210c06d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21201eb070 tx=0x7f211000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.537+0000 7fa132ffd640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa12006b4d0 0x7fa12006d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa128009650 tx=0x7fa128006ba0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.538+0000 7f3f42ffd640 1 -- 172.21.15.172:0/1788790257 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3f4c022070 con 0x7f3f54161e30 2024-04-25T08:42:52.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.538+0000 7fa11b7fe640 1 -- 172.21.15.172:0/1378211151 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa12c07a190 con 0x7fa134159b20 2024-04-25T08:42:52.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.544+0000 7f2107fff640 1 -- 172.21.15.172:0/2689769280 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2114079550 con 0x7f21200b4660 2024-04-25T08:42:52.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.937+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f14c80d2740 con 0x7f14c806c180 2024-04-25T08:42:52.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.938+0000 7f14affff640 1 -- 172.21.15.172:0/386157561 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14b8058a20 con 0x7f14c806c180 2024-04-25T08:42:52.930 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.940+0000 7ffb75cf5640 1 -- 172.21.15.172:0/1515420890 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ffb70156500 con 0x7ffb700b38f0 2024-04-25T08:42:52.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.941+0000 7ffb57fff640 1 -- 172.21.15.172:0/1515420890 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb6005bdc0 con 0x7ffb700b38f0 2024-04-25T08:42:52.933 INFO:teuthology.orchestra.run.smithi172.stdout:55834574859 2024-04-25T08:42:52.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.941+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f14b406b520 msgr2=0x7f14b406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.941+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f14b406b520 0x7f14b406d9e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006a90 tx=0x7f14bc006a20 comp rx=0 tx=0).stop 2024-04-25T08:42:52.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.941+0000 7f705e05d640 1 -- 172.21.15.172:0/2453780401 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7038005580 con 0x7f70580cc8b0 2024-04-25T08:42:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.941+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c806c180 msgr2=0x7f14c80c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.941+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c806c180 0x7f14c80c9850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14b800c410 tx=0x7f14b800c8d0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.942+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 shutdown_connections 2024-04-25T08:42:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.942+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f14b406b520 0x7f14b406d9e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.942+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14c80d15f0 0x7f14c80c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.942+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14c80b2bb0 0x7f14c80c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.942+0000 7f14cdc1f640 1 --2- 172.21.15.172:0/386157561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14c806c180 0x7f14c80c9850 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.942+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 >> 172.21.15.172:0/386157561 conn(0x7f14c80d3a20 msgr2=0x7f14c80ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.942+0000 7f703ffff640 1 -- 172.21.15.172:0/2453780401 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70500588a0 con 0x7f70580cc8b0 2024-04-25T08:42:52.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.942+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 shutdown_connections 2024-04-25T08:42:52.936 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.942+0000 7f14cdc1f640 1 -- 172.21.15.172:0/386157561 wait complete. 2024-04-25T08:42:52.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.944+0000 7fa13936a640 1 -- 172.21.15.172:0/1378211151 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa1340ce950 con 0x7fa134159b20 2024-04-25T08:42:52.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7ffb75cf5640 1 -- 172.21.15.172:0/1515420890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb5c06b520 msgr2=0x7ffb5c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.938 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7fa11b7fe640 1 -- 172.21.15.172:0/1378211151 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa12c07e230 con 0x7fa134159b20 2024-04-25T08:42:52.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7ffb75cf5640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb5c06b520 0x7ffb5c06d9e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffb6403a000 tx=0x7ffb6400d040 comp rx=0 tx=0).stop 2024-04-25T08:42:52.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7ffb75cf5640 1 -- 172.21.15.172:0/1515420890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 msgr2=0x7ffb701430f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7ffb75cf5640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 0x7ffb701430f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000c430 tx=0x7ffb6000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7ffb75cf5640 1 -- 172.21.15.172:0/1515420890 shutdown_connections 2024-04-25T08:42:52.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7f705e05d640 1 -- 172.21.15.172:0/2453780401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f704406b5a0 msgr2=0x7f704406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7f705e05d640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f704406b5a0 0x7f704406da60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7048000f60 tx=0x7f7048007b90 comp rx=0 tx=0).stop 2024-04-25T08:42:52.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7f705e05d640 1 -- 172.21.15.172:0/2453780401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 msgr2=0x7f70580c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7f705e05d640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580c7e60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f705000c760 tx=0x7f705000cc20 comp rx=0 tx=0).stop 2024-04-25T08:42:52.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7f705e05d640 1 -- 172.21.15.172:0/2453780401 shutdown_connections 2024-04-25T08:42:52.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7f705e05d640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f704406b5a0 0x7f704406da60 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7048000f60 tx=0x7f7048007b90 comp rx=0 tx=0).stop 2024-04-25T08:42:52.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7ffb75cf5640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb5c06b520 0x7ffb5c06d9e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7f705e05d640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7058161d90 0x7f70580c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7f705e05d640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f70580cc8b0 0x7f70580c7e60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7f705e05d640 1 --2- 172.21.15.172:0/2453780401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f705806ec00 0x7f70580c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7f705e05d640 1 -- 172.21.15.172:0/2453780401 >> 172.21.15.172:0/2453780401 conn(0x7f705806abe0 msgr2=0x7f705806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7ffb75cf5640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb70159b20 0x7ffb70153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7ffb75cf5640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb700cf840 0x7ffb70145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7ffb75cf5640 1 --2- 172.21.15.172:0/1515420890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb700b38f0 0x7ffb701430f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.945+0000 7ffb75cf5640 1 -- 172.21.15.172:0/1515420890 >> 172.21.15.172:0/1515420890 conn(0x7ffb7006abe0 msgr2=0x7ffb70155100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.946+0000 7ffb75cf5640 1 -- 172.21.15.172:0/1515420890 shutdown_connections 2024-04-25T08:42:52.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.946+0000 7ffb75cf5640 1 -- 172.21.15.172:0/1515420890 wait complete. 2024-04-25T08:42:52.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.946+0000 7f705e05d640 1 -- 172.21.15.172:0/2453780401 shutdown_connections 2024-04-25T08:42:52.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.946+0000 7f705e05d640 1 -- 172.21.15.172:0/2453780401 wait complete. 2024-04-25T08:42:52.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.948+0000 7fa13936a640 1 -- 172.21.15.172:0/1378211151 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa12006b4d0 msgr2=0x7fa12006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.948+0000 7fa13936a640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa12006b4d0 0x7fa12006d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa128009650 tx=0x7fa128006ba0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.948+0000 7fa13936a640 1 -- 172.21.15.172:0/1378211151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa134159b20 msgr2=0x7fa1340af820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.948+0000 7fa13936a640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa134159b20 0x7fa1340af820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c2e0 tx=0x7fa12c004a40 comp rx=0 tx=0).stop 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.949+0000 7fa13936a640 1 -- 172.21.15.172:0/1378211151 shutdown_connections 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.949+0000 7fa13936a640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa12006b4d0 0x7fa12006d990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.949+0000 7fa13936a640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa134159b20 0x7fa1340af820 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.949+0000 7fa13936a640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1340cc6e0 0x7fa134151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.949+0000 7fa13936a640 1 --2- 172.21.15.172:0/1378211151 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1340716b0 0x7fa1340a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.949+0000 7fa13936a640 1 -- 172.21.15.172:0/1378211151 >> 172.21.15.172:0/1378211151 conn(0x7fa1340b1170 msgr2=0x7fa134070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.949+0000 7fa13936a640 1 -- 172.21.15.172:0/1378211151 shutdown_connections 2024-04-25T08:42:52.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.949+0000 7fa13936a640 1 -- 172.21.15.172:0/1378211151 wait complete. 2024-04-25T08:42:52.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.957+0000 7f3f58922640 1 -- 172.21.15.172:0/1788790257 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3f540b3c80 con 0x7f3f54161e30 2024-04-25T08:42:52.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.957+0000 7f211ffff640 1 -- 172.21.15.172:0/2689769280 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f21200afb50 con 0x7f21200b4660 2024-04-25T08:42:52.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.958+0000 7f3f42ffd640 1 -- 172.21.15.172:0/1788790257 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f4c010040 con 0x7f3f54161e30 2024-04-25T08:42:52.950 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.958+0000 7f2107fff640 1 -- 172.21.15.172:0/2689769280 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f211407d5f0 con 0x7f21200b4660 2024-04-25T08:42:52.951 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.961+0000 7f639359e640 1 -- 172.21.15.172:0/894072046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f639406d500 con 0x7f63940b3690 2024-04-25T08:42:52.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 -- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3406b4d0 msgr2=0x7f3f3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3406b4d0 0x7f3f3406d990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3f44034000 tx=0x7f3f4402e000 comp rx=0 tx=0).stop 2024-04-25T08:42:52.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 -- 172.21.15.172:0/1788790257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 msgr2=0x7f3f5415d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f5415d340 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00efc0 tx=0x7f3f4c00c490 comp rx=0 tx=0).stop 2024-04-25T08:42:52.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 -- 172.21.15.172:0/1788790257 shutdown_connections 2024-04-25T08:42:52.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3406b4d0 0x7f3f3406d990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f54161e30 0x7f3f5415d340 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f540d03f0 0x7f3f540cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 --2- 172.21.15.172:0/1788790257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f540b5330 0x7f3f5414fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 -- 172.21.15.172:0/1788790257 >> 172.21.15.172:0/1788790257 conn(0x7f3f5406bf40 msgr2=0x7f3f540b4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 -- 172.21.15.172:0/1788790257 shutdown_connections 2024-04-25T08:42:52.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f3f58922640 1 -- 172.21.15.172:0/1788790257 wait complete. 2024-04-25T08:42:52.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7ff29ca1f640 1 -- 172.21.15.172:0/4187083185 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff29806b060 con 0x7ff29806ea90 2024-04-25T08:42:52.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-04-25T08:42:52.957 DEBUG:teuthology.parallel:result is None 2024-04-25T08:42:52.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f211ffff640 1 -- 172.21.15.172:0/2689769280 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210c06b4d0 msgr2=0x7f210c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f211ffff640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210c06b4d0 0x7f210c06d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21201eb070 tx=0x7f211000b040 comp rx=0 tx=0).stop 2024-04-25T08:42:52.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f211ffff640 1 -- 172.21.15.172:0/2689769280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21200b4660 msgr2=0x7f212014d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.962+0000 7f211ffff640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21200b4660 0x7f212014d830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f212006ee20 tx=0x7f21140046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.963+0000 7f211ffff640 1 -- 172.21.15.172:0/2689769280 shutdown_connections 2024-04-25T08:42:52.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.963+0000 7f211ffff640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210c06b4d0 0x7f210c06d990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.963+0000 7f211ffff640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2120161fe0 0x7f2120164080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.963+0000 7f211ffff640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2120161c00 0x7f21200cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.963+0000 7f211ffff640 1 --2- 172.21.15.172:0/2689769280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21200b4660 0x7f212014d830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.963+0000 7f211ffff640 1 -- 172.21.15.172:0/2689769280 >> 172.21.15.172:0/2689769280 conn(0x7f212006adc0 msgr2=0x7f212006e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.963+0000 7f211ffff640 1 -- 172.21.15.172:0/2689769280 shutdown_connections 2024-04-25T08:42:52.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.963+0000 7f211ffff640 1 -- 172.21.15.172:0/2689769280 wait complete. 2024-04-25T08:42:52.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.963+0000 7f6382ffd640 1 -- 172.21.15.172:0/894072046 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f638c07a810 con 0x7f63940b3690 2024-04-25T08:42:52.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.963+0000 7ff28f7fe640 1 -- 172.21.15.172:0/4187083185 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff28805c7c0 con 0x7ff29806ea90 2024-04-25T08:42:52.960 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.960 INFO:teuthology.orchestra.run.smithi172.stdout:55834574858 2024-04-25T08:42:52.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-04-25T08:42:52.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 -- 172.21.15.172:0/4187083185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff27806b500 msgr2=0x7ff27806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff27806b500 0x7ff27806d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff280034000 tx=0x7ff28002c000 comp rx=0 tx=0).stop 2024-04-25T08:42:52.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 -- 172.21.15.172:0/4187083185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff29806ea90 msgr2=0x7ff2980add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff29806ea90 0x7ff2980add80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c5e0 tx=0x7ff28800caa0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.962 DEBUG:teuthology.parallel:result is None 2024-04-25T08:42:52.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7f639359e640 1 -- 172.21.15.172:0/894072046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f637406b500 msgr2=0x7f637406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7f639359e640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f637406b500 0x7f637406d9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63840011e0 tx=0x7f6384007d30 comp rx=0 tx=0).stop 2024-04-25T08:42:52.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7f639359e640 1 -- 172.21.15.172:0/894072046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b3690 msgr2=0x7f639413e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:52.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7f639359e640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b3690 0x7f639413e370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f638c02ac70 tx=0x7f638c004a40 comp rx=0 tx=0).stop 2024-04-25T08:42:52.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7f639359e640 1 -- 172.21.15.172:0/894072046 shutdown_connections 2024-04-25T08:42:52.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7f639359e640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f637406b500 0x7f637406d9c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7f639359e640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63940b3690 0x7f639413e370 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7f639359e640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63940b2710 0x7f6394153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7f639359e640 1 --2- 172.21.15.172:0/894072046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f639406f100 0x7f6394167070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7f639359e640 1 -- 172.21.15.172:0/894072046 >> 172.21.15.172:0/894072046 conn(0x7f6394061c60 msgr2=0x7f639406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 -- 172.21.15.172:0/4187083185 shutdown_connections 2024-04-25T08:42:52.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff27806b500 0x7ff27806d9c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff298161fc0 0x7ff298164740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff29806ea90 0x7ff2980add80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 --2- 172.21.15.172:0/4187083185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff29806d2d0 0x7ff29815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:52.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 -- 172.21.15.172:0/4187083185 >> 172.21.15.172:0/4187083185 conn(0x7ff29806abe0 msgr2=0x7ff29815dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:52.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 -- 172.21.15.172:0/4187083185 shutdown_connections 2024-04-25T08:42:52.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.967+0000 7ff29ca1f640 1 -- 172.21.15.172:0/4187083185 wait complete. 2024-04-25T08:42:52.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.968+0000 7f639359e640 1 -- 172.21.15.172:0/894072046 shutdown_connections 2024-04-25T08:42:52.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:52.968+0000 7f639359e640 1 -- 172.21.15.172:0/894072046 wait complete. 2024-04-25T08:42:52.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-04-25T08:42:52.965 DEBUG:teuthology.parallel:result is None 2024-04-25T08:42:52.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-04-25T08:42:52.965 DEBUG:teuthology.parallel:result is None 2024-04-25T08:42:52.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-04-25T08:42:52.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-04-25T08:42:52.973 DEBUG:teuthology.parallel:result is None 2024-04-25T08:42:52.973 DEBUG:teuthology.parallel:result is None 2024-04-25T08:42:52.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-04-25T08:42:52.980 DEBUG:teuthology.parallel:result is None 2024-04-25T08:42:52.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-25T08:42:52.980 DEBUG:teuthology.parallel:result is None 2024-04-25T08:42:52.980 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T08:42:52.980 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:42:53.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.124+0000 7fbb3e5b7640 1 Processor -- start 2024-04-25T08:42:53.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.125+0000 7fbb3e5b7640 1 -- start start 2024-04-25T08:42:53.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.125+0000 7fbb3e5b7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbb3815da70 0x7fbb380d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.125+0000 7fbb3e5b7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbb380c7730 0x7fbb380ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.125+0000 7fbb3e5b7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb380c8030 con 0x7fbb380ce700 2024-04-25T08:42:53.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.125+0000 7fbb3e5b7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb380ceb30 con 0x7fbb380c7730 2024-04-25T08:42:53.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.125+0000 7fbb3e5b7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb380c8310 con 0x7fbb3815da70 2024-04-25T08:42:53.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.126+0000 7fbb377fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbb380c7730 0x7fbb380ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.126+0000 7fbb377fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbb380c7730 0x7fbb380ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50694/0 (socket says 172.21.15.172:50694) 2024-04-25T08:42:53.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.126+0000 7fbb377fe640 1 -- 172.21.15.172:0/1509046309 learned_addr learned my addr 172.21.15.172:0/1509046309 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:53.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.126+0000 7fbb37fff640 1 --2- 172.21.15.172:0/1509046309 >> v2:172.21.15.186:3300/0 conn(0x7fbb3815da70 0x7fbb380d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.126+0000 7fbb377fe640 1 -- 172.21.15.172:0/1509046309 >> v2:172.21.15.186:3300/0 conn(0x7fbb3815da70 msgr2=0x7fbb380d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:53.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.126+0000 7fbb377fe640 1 --2- 172.21.15.172:0/1509046309 >> v2:172.21.15.186:3300/0 conn(0x7fbb3815da70 0x7fbb380d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.126+0000 7fbb377fe640 1 -- 172.21.15.172:0/1509046309 >> v1:172.21.15.186:6789/0 conn(0x7fbb380ce700 legacy=0x7fbb38070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.126+0000 7fbb377fe640 1 -- 172.21.15.172:0/1509046309 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb380c85f0 con 0x7fbb380c7730 2024-04-25T08:42:53.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.126+0000 7fbb377fe640 1 --2- 172.21.15.172:0/1509046309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 0x7fbb380ce1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb3806b900 tx=0x7fbb2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e600a3aed17e38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:53.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb36ffd640 1 -- 172.21.15.172:0/1509046309 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28037070 con 0x7fbb380c7730 2024-04-25T08:42:53.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb36ffd640 1 -- 172.21.15.172:0/1509046309 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28032440 con 0x7fbb380c7730 2024-04-25T08:42:53.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb36ffd640 1 -- 172.21.15.172:0/1509046309 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28032810 con 0x7fbb380c7730 2024-04-25T08:42:53.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/1509046309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 msgr2=0x7fbb380ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb3e5b7640 1 --2- 172.21.15.172:0/1509046309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 0x7fbb380ce1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb3806b900 tx=0x7fbb2802a270 comp rx=0 tx=0).stop 2024-04-25T08:42:53.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/1509046309 shutdown_connections 2024-04-25T08:42:53.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb3e5b7640 1 --2- 172.21.15.172:0/1509046309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 0x7fbb380ce1c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb3e5b7640 1 --2- 172.21.15.172:0/1509046309 >> v2:172.21.15.186:3300/0 conn(0x7fbb3815da70 0x7fbb380d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/1509046309 >> 172.21.15.172:0/1509046309 conn(0x7fbb380b33e0 msgr2=0x7fbb380b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:53.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/1509046309 shutdown_connections 2024-04-25T08:42:53.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.127+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/1509046309 wait complete. 2024-04-25T08:42:53.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.128+0000 7fbb3e5b7640 1 Processor -- start 2024-04-25T08:42:53.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.129+0000 7fbb3e5b7640 1 -- start start 2024-04-25T08:42:53.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.129+0000 7fbb3e5b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 0x7fbb380ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.129+0000 7fbb3e5b7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb380ce700 0x7fbb38152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.129+0000 7fbb3e5b7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb3815da70 0x7fbb380cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.129+0000 7fbb3e5b7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3815de50 con 0x7fbb380c7730 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.129+0000 7fbb3e5b7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3806be10 con 0x7fbb3815da70 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.129+0000 7fbb3e5b7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380c7bc0 con 0x7fbb380ce700 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.129+0000 7fbb37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 0x7fbb380ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.129+0000 7fbb37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 0x7fbb380ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50708/0 (socket says 172.21.15.172:50708) 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.129+0000 7fbb37fff640 1 -- 172.21.15.172:0/2593112558 learned_addr learned my addr 172.21.15.172:0/2593112558 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb3cb54640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb3815da70 0x7fbb380cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb377fe640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb380ce700 0x7fbb38152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb37fff640 1 -- 172.21.15.172:0/2593112558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb380ce700 msgr2=0x7fbb38152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb37fff640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb380ce700 0x7fbb38152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb37fff640 1 -- 172.21.15.172:0/2593112558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb3815da70 msgr2=0x7fbb380cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb37fff640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb3815da70 0x7fbb380cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb37fff640 1 -- 172.21.15.172:0/2593112558 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb380b6330 con 0x7fbb380c7730 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb37fff640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 0x7fbb380ca2d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00d5f0 tx=0x7fbb2c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb34ff9640 1 -- 172.21.15.172:0/2593112558 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0125f0 con 0x7fbb380c7730 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb34ff9640 1 -- 172.21.15.172:0/2593112558 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c019070 con 0x7fbb380c7730 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/2593112558 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb380b6610 con 0x7fbb380c7730 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb34ff9640 1 -- 172.21.15.172:0/2593112558 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0129d0 con 0x7fbb380c7730 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.130+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/2593112558 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb380ca810 con 0x7fbb380c7730 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.131+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/2593112558 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3806de80 con 0x7fbb380c7730 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.131+0000 7fbb34ff9640 1 -- 172.21.15.172:0/2593112558 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb2c012b70 con 0x7fbb380c7730 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.132+0000 7fbb34ff9640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb2406b4d0 0x7fbb2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.132+0000 7fbb34ff9640 1 -- 172.21.15.172:0/2593112558 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbb2c08a890 con 0x7fbb380c7730 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.132+0000 7fbb377fe640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb2406b4d0 0x7fbb2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.132+0000 7fbb377fe640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb2406b4d0 0x7fbb2406d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbb28034000 tx=0x7fbb2802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:53.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.136+0000 7fbb34ff9640 1 -- 172.21.15.172:0/2593112558 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb2c058cf0 con 0x7fbb380c7730 2024-04-25T08:42:53.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.301+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/2593112558 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb380b3860 con 0x7fbb2406b4d0 2024-04-25T08:42:53.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.309+0000 7fbb34ff9640 1 -- 172.21.15.172:0/2593112558 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7fbb380b3860 con 0x7fbb2406b4d0 2024-04-25T08:42:53.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:53.306 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/2593112558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb2406b4d0 msgr2=0x7fbb2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb2406b4d0 0x7fbb2406d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbb28034000 tx=0x7fbb2802e000 comp rx=0 tx=0).stop 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/2593112558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 msgr2=0x7fbb380ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 0x7fbb380ca2d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00d5f0 tx=0x7fbb2c00dab0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/2593112558 shutdown_connections 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb2406b4d0 0x7fbb2406d990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb3815da70 0x7fbb380cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb380ce700 0x7fbb38152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 --2- 172.21.15.172:0/2593112558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb380c7730 0x7fbb380ca2d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/2593112558 >> 172.21.15.172:0/2593112558 conn(0x7fbb380b33e0 msgr2=0x7fbb3815c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/2593112558 shutdown_connections 2024-04-25T08:42:53.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.312+0000 7fbb3e5b7640 1 -- 172.21.15.172:0/2593112558 wait complete. 2024-04-25T08:42:53.315 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-25T08:42:52.517475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002874"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718621+0000","last_change":"2024-04-25T08:42:27.663913+0000","last_active":"2024-04-25T08:42:34.718621+0000","last_peered":"2024-04-25T08:42:34.718621+0000","last_clean":"2024-04-25T08:42:34.718621+0000","last_became_active":"2024-04-25T08:42:27.663206+0000","last_became_peered":"2024-04-25T08:42:27.663206+0000","last_unstale":"2024-04-25T08:42:34.718621+0000","last_undegraded":"2024-04-25T08:42:34.718621+0000","last_fullsized":"2024-04-25T08:42:34.718621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:08.095908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720030+0000","last_change":"2024-04-25T08:42:28.679929+0000","last_active":"2024-04-25T08:42:34.720030+0000","last_peered":"2024-04-25T08:42:34.720030+0000","last_clean":"2024-04-25T08:42:34.720030+0000","last_became_active":"2024-04-25T08:42:28.679533+0000","last_became_peered":"2024-04-25T08:42:28.679533+0000","last_unstale":"2024-04-25T08:42:34.720030+0000","last_undegraded":"2024-04-25T08:42:34.720030+0000","last_fullsized":"2024-04-25T08:42:34.720030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719823+0000","last_change":"2024-04-25T08:42:32.775785+0000","last_active":"2024-04-25T08:42:34.719823+0000","last_peered":"2024-04-25T08:42:34.719823+0000","last_clean":"2024-04-25T08:42:34.719823+0000","last_became_active":"2024-04-25T08:42:32.775418+0000","last_became_peered":"2024-04-25T08:42:32.775418+0000","last_unstale":"2024-04-25T08:42:34.719823+0000","last_undegraded":"2024-04-25T08:42:34.719823+0000","last_fullsized":"2024-04-25T08:42:34.719823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:16.973550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720238+0000","last_change":"2024-04-25T08:42:27.669510+0000","last_active":"2024-04-25T08:42:34.720238+0000","last_peered":"2024-04-25T08:42:34.720238+0000","last_clean":"2024-04-25T08:42:34.720238+0000","last_became_active":"2024-04-25T08:42:27.669194+0000","last_became_peered":"2024-04-25T08:42:27.669194+0000","last_unstale":"2024-04-25T08:42:34.720238+0000","last_undegraded":"2024-04-25T08:42:34.720238+0000","last_fullsized":"2024-04-25T08:42:34.720238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:43.313642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718181+0000","last_change":"2024-04-25T08:42:28.678584+0000","last_active":"2024-04-25T08:42:34.718181+0000","last_peered":"2024-04-25T08:42:34.718181+0000","last_clean":"2024-04-25T08:42:34.718181+0000","last_became_active":"2024-04-25T08:42:28.677636+0000","last_became_peered":"2024-04-25T08:42:28.677636+0000","last_unstale":"2024-04-25T08:42:34.718181+0000","last_undegraded":"2024-04-25T08:42:34.718181+0000","last_fullsized":"2024-04-25T08:42:34.718181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716151+0000","last_change":"2024-04-25T08:42:32.710347+0000","last_active":"2024-04-25T08:42:33.716151+0000","last_peered":"2024-04-25T08:42:33.716151+0000","last_clean":"2024-04-25T08:42:33.716151+0000","last_became_active":"2024-04-25T08:42:32.709855+0000","last_became_peered":"2024-04-25T08:42:32.709855+0000","last_unstale":"2024-04-25T08:42:33.716151+0000","last_undegraded":"2024-04-25T08:42:33.716151+0000","last_fullsized":"2024-04-25T08:42:33.716151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:17.497098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341696+0000","last_change":"2024-04-25T08:42:27.667761+0000","last_active":"2024-04-25T08:42:34.341696+0000","last_peered":"2024-04-25T08:42:34.341696+0000","last_clean":"2024-04-25T08:42:34.341696+0000","last_became_active":"2024-04-25T08:42:27.667504+0000","last_became_peered":"2024-04-25T08:42:27.667504+0000","last_unstale":"2024-04-25T08:42:34.341696+0000","last_undegraded":"2024-04-25T08:42:34.341696+0000","last_fullsized":"2024-04-25T08:42:34.341696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:11.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717960+0000","last_change":"2024-04-25T08:42:28.679617+0000","last_active":"2024-04-25T08:42:33.717960+0000","last_peered":"2024-04-25T08:42:33.717960+0000","last_clean":"2024-04-25T08:42:33.717960+0000","last_became_active":"2024-04-25T08:42:28.677547+0000","last_became_peered":"2024-04-25T08:42:28.677547+0000","last_unstale":"2024-04-25T08:42:33.717960+0000","last_undegraded":"2024-04-25T08:42:33.717960+0000","last_fullsized":"2024-04-25T08:42:33.717960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716871+0000","last_change":"2024-04-25T08:42:32.715254+0000","last_active":"2024-04-25T08:42:33.716871+0000","last_peered":"2024-04-25T08:42:33.716871+0000","last_clean":"2024-04-25T08:42:33.716871+0000","last_became_active":"2024-04-25T08:42:32.714553+0000","last_became_peered":"2024-04-25T08:42:32.714553+0000","last_unstale":"2024-04-25T08:42:33.716871+0000","last_undegraded":"2024-04-25T08:42:33.716871+0000","last_fullsized":"2024-04-25T08:42:33.716871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:02.361047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341492+0000","last_change":"2024-04-25T08:42:27.669362+0000","last_active":"2024-04-25T08:42:34.341492+0000","last_peered":"2024-04-25T08:42:34.341492+0000","last_clean":"2024-04-25T08:42:34.341492+0000","last_became_active":"2024-04-25T08:42:27.669047+0000","last_became_peered":"2024-04-25T08:42:27.669047+0000","last_unstale":"2024-04-25T08:42:34.341492+0000","last_undegraded":"2024-04-25T08:42:34.341492+0000","last_fullsized":"2024-04-25T08:42:34.341492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:24.034481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718067+0000","last_change":"2024-04-25T08:42:28.676280+0000","last_active":"2024-04-25T08:42:33.718067+0000","last_peered":"2024-04-25T08:42:33.718067+0000","last_clean":"2024-04-25T08:42:33.718067+0000","last_became_active":"2024-04-25T08:42:28.676008+0000","last_became_peered":"2024-04-25T08:42:28.676008+0000","last_unstale":"2024-04-25T08:42:33.718067+0000","last_undegraded":"2024-04-25T08:42:33.718067+0000","last_fullsized":"2024-04-25T08:42:33.718067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716251+0000","last_change":"2024-04-25T08:42:32.702185+0000","last_active":"2024-04-25T08:42:33.716251+0000","last_peered":"2024-04-25T08:42:33.716251+0000","last_clean":"2024-04-25T08:42:33.716251+0000","last_became_active":"2024-04-25T08:42:32.701758+0000","last_became_peered":"2024-04-25T08:42:32.701758+0000","last_unstale":"2024-04-25T08:42:33.716251+0000","last_undegraded":"2024-04-25T08:42:33.716251+0000","last_fullsized":"2024-04-25T08:42:33.716251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:49.319348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718505+0000","last_change":"2024-04-25T08:42:28.687237+0000","last_active":"2024-04-25T08:42:34.718505+0000","last_peered":"2024-04-25T08:42:34.718505+0000","last_clean":"2024-04-25T08:42:34.718505+0000","last_became_active":"2024-04-25T08:42:28.686009+0000","last_became_peered":"2024-04-25T08:42:28.686009+0000","last_unstale":"2024-04-25T08:42:34.718505+0000","last_undegraded":"2024-04-25T08:42:34.718505+0000","last_fullsized":"2024-04-25T08:42:34.718505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341503+0000","last_change":"2024-04-25T08:42:27.666906+0000","last_active":"2024-04-25T08:42:34.341503+0000","last_peered":"2024-04-25T08:42:34.341503+0000","last_clean":"2024-04-25T08:42:34.341503+0000","last_became_active":"2024-04-25T08:42:27.666643+0000","last_became_peered":"2024-04-25T08:42:27.666643+0000","last_unstale":"2024-04-25T08:42:34.341503+0000","last_undegraded":"2024-04-25T08:42:34.341503+0000","last_fullsized":"2024-04-25T08:42:34.341503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716980+0000","last_change":"2024-04-25T08:42:32.711169+0000","last_active":"2024-04-25T08:42:33.716980+0000","last_peered":"2024-04-25T08:42:33.716980+0000","last_clean":"2024-04-25T08:42:33.716980+0000","last_became_active":"2024-04-25T08:42:32.710192+0000","last_became_peered":"2024-04-25T08:42:32.710192+0000","last_unstale":"2024-04-25T08:42:33.716980+0000","last_undegraded":"2024-04-25T08:42:33.716980+0000","last_fullsized":"2024-04-25T08:42:33.716980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:41.910425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720554+0000","last_change":"2024-04-25T08:42:28.672389+0000","last_active":"2024-04-25T08:42:34.720554+0000","last_peered":"2024-04-25T08:42:34.720554+0000","last_clean":"2024-04-25T08:42:34.720554+0000","last_became_active":"2024-04-25T08:42:28.672116+0000","last_became_peered":"2024-04-25T08:42:28.672116+0000","last_unstale":"2024-04-25T08:42:34.720554+0000","last_undegraded":"2024-04-25T08:42:34.720554+0000","last_fullsized":"2024-04-25T08:42:34.720554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719572+0000","last_change":"2024-04-25T08:42:27.669517+0000","last_active":"2024-04-25T08:42:34.719572+0000","last_peered":"2024-04-25T08:42:34.719572+0000","last_clean":"2024-04-25T08:42:34.719572+0000","last_became_active":"2024-04-25T08:42:27.669240+0000","last_became_peered":"2024-04-25T08:42:27.669240+0000","last_unstale":"2024-04-25T08:42:34.719572+0000","last_undegraded":"2024-04-25T08:42:34.719572+0000","last_fullsized":"2024-04-25T08:42:34.719572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717062+0000","last_change":"2024-04-25T08:42:32.710857+0000","last_active":"2024-04-25T08:42:33.717062+0000","last_peered":"2024-04-25T08:42:33.717062+0000","last_clean":"2024-04-25T08:42:33.717062+0000","last_became_active":"2024-04-25T08:42:32.709737+0000","last_became_peered":"2024-04-25T08:42:32.709737+0000","last_unstale":"2024-04-25T08:42:33.717062+0000","last_undegraded":"2024-04-25T08:42:33.717062+0000","last_fullsized":"2024-04-25T08:42:33.717062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:48.222965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720874+0000","last_change":"2024-04-25T08:42:28.672212+0000","last_active":"2024-04-25T08:42:34.720874+0000","last_peered":"2024-04-25T08:42:34.720874+0000","last_clean":"2024-04-25T08:42:34.720874+0000","last_became_active":"2024-04-25T08:42:28.671893+0000","last_became_peered":"2024-04-25T08:42:28.671893+0000","last_unstale":"2024-04-25T08:42:34.720874+0000","last_undegraded":"2024-04-25T08:42:34.720874+0000","last_fullsized":"2024-04-25T08:42:34.720874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718326+0000","last_change":"2024-04-25T08:42:27.662789+0000","last_active":"2024-04-25T08:42:34.718326+0000","last_peered":"2024-04-25T08:42:34.718326+0000","last_clean":"2024-04-25T08:42:34.718326+0000","last_became_active":"2024-04-25T08:42:27.662490+0000","last_became_peered":"2024-04-25T08:42:27.662490+0000","last_unstale":"2024-04-25T08:42:34.718326+0000","last_undegraded":"2024-04-25T08:42:34.718326+0000","last_fullsized":"2024-04-25T08:42:34.718326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719021+0000","last_change":"2024-04-25T08:42:32.773797+0000","last_active":"2024-04-25T08:42:34.719021+0000","last_peered":"2024-04-25T08:42:34.719021+0000","last_clean":"2024-04-25T08:42:34.719021+0000","last_became_active":"2024-04-25T08:42:32.772850+0000","last_became_peered":"2024-04-25T08:42:32.772850+0000","last_unstale":"2024-04-25T08:42:34.719021+0000","last_undegraded":"2024-04-25T08:42:34.719021+0000","last_fullsized":"2024-04-25T08:42:34.719021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716595+0000","last_change":"2024-04-25T08:42:28.670256+0000","last_active":"2024-04-25T08:42:33.716595+0000","last_peered":"2024-04-25T08:42:33.716595+0000","last_clean":"2024-04-25T08:42:33.716595+0000","last_became_active":"2024-04-25T08:42:28.669544+0000","last_became_peered":"2024-04-25T08:42:28.669544+0000","last_unstale":"2024-04-25T08:42:33.716595+0000","last_undegraded":"2024-04-25T08:42:33.716595+0000","last_fullsized":"2024-04-25T08:42:33.716595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:56.767579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341156+0000","last_change":"2024-04-25T08:42:27.666339+0000","last_active":"2024-04-25T08:42:34.341156+0000","last_peered":"2024-04-25T08:42:34.341156+0000","last_clean":"2024-04-25T08:42:34.341156+0000","last_became_active":"2024-04-25T08:42:27.665968+0000","last_became_peered":"2024-04-25T08:42:27.665968+0000","last_unstale":"2024-04-25T08:42:34.341156+0000","last_undegraded":"2024-04-25T08:42:34.341156+0000","last_fullsized":"2024-04-25T08:42:34.341156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716958+0000","last_change":"2024-04-25T08:42:32.716309+0000","last_active":"2024-04-25T08:42:33.716958+0000","last_peered":"2024-04-25T08:42:33.716958+0000","last_clean":"2024-04-25T08:42:33.716958+0000","last_became_active":"2024-04-25T08:42:32.715869+0000","last_became_peered":"2024-04-25T08:42:32.715869+0000","last_unstale":"2024-04-25T08:42:33.716958+0000","last_undegraded":"2024-04-25T08:42:33.716958+0000","last_fullsized":"2024-04-25T08:42:33.716958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:42.194257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718628+0000","last_change":"2024-04-25T08:42:28.671623+0000","last_active":"2024-04-25T08:42:34.718628+0000","last_peered":"2024-04-25T08:42:34.718628+0000","last_clean":"2024-04-25T08:42:34.718628+0000","last_became_active":"2024-04-25T08:42:28.671330+0000","last_became_peered":"2024-04-25T08:42:28.671330+0000","last_unstale":"2024-04-25T08:42:34.718628+0000","last_undegraded":"2024-04-25T08:42:34.718628+0000","last_fullsized":"2024-04-25T08:42:34.718628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719273+0000","last_change":"2024-04-25T08:42:27.662946+0000","last_active":"2024-04-25T08:42:34.719273+0000","last_peered":"2024-04-25T08:42:34.719273+0000","last_clean":"2024-04-25T08:42:34.719273+0000","last_became_active":"2024-04-25T08:42:27.662661+0000","last_became_peered":"2024-04-25T08:42:27.662661+0000","last_unstale":"2024-04-25T08:42:34.719273+0000","last_undegraded":"2024-04-25T08:42:34.719273+0000","last_fullsized":"2024-04-25T08:42:34.719273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716252+0000","last_change":"2024-04-25T08:42:32.773209+0000","last_active":"2024-04-25T08:42:33.716252+0000","last_peered":"2024-04-25T08:42:33.716252+0000","last_clean":"2024-04-25T08:42:33.716252+0000","last_became_active":"2024-04-25T08:42:32.772788+0000","last_became_peered":"2024-04-25T08:42:32.772788+0000","last_unstale":"2024-04-25T08:42:33.716252+0000","last_undegraded":"2024-04-25T08:42:33.716252+0000","last_fullsized":"2024-04-25T08:42:33.716252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:59.766748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720324+0000","last_change":"2024-04-25T08:42:28.681466+0000","last_active":"2024-04-25T08:42:34.720324+0000","last_peered":"2024-04-25T08:42:34.720324+0000","last_clean":"2024-04-25T08:42:34.720324+0000","last_became_active":"2024-04-25T08:42:28.681184+0000","last_became_peered":"2024-04-25T08:42:28.681184+0000","last_unstale":"2024-04-25T08:42:34.720324+0000","last_undegraded":"2024-04-25T08:42:34.720324+0000","last_fullsized":"2024-04-25T08:42:34.720324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719545+0000","last_change":"2024-04-25T08:42:27.663837+0000","last_active":"2024-04-25T08:42:34.719545+0000","last_peered":"2024-04-25T08:42:34.719545+0000","last_clean":"2024-04-25T08:42:34.719545+0000","last_became_active":"2024-04-25T08:42:27.663542+0000","last_became_peered":"2024-04-25T08:42:27.663542+0000","last_unstale":"2024-04-25T08:42:34.719545+0000","last_undegraded":"2024-04-25T08:42:34.719545+0000","last_fullsized":"2024-04-25T08:42:34.719545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720453+0000","last_change":"2024-04-25T08:42:32.773738+0000","last_active":"2024-04-25T08:42:34.720453+0000","last_peered":"2024-04-25T08:42:34.720453+0000","last_clean":"2024-04-25T08:42:34.720453+0000","last_became_active":"2024-04-25T08:42:32.773337+0000","last_became_peered":"2024-04-25T08:42:32.773337+0000","last_unstale":"2024-04-25T08:42:34.720453+0000","last_undegraded":"2024-04-25T08:42:34.720453+0000","last_fullsized":"2024-04-25T08:42:34.720453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:24.829343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719414+0000","last_change":"2024-04-25T08:42:28.672285+0000","last_active":"2024-04-25T08:42:34.719414+0000","last_peered":"2024-04-25T08:42:34.719414+0000","last_clean":"2024-04-25T08:42:34.719414+0000","last_became_active":"2024-04-25T08:42:28.672041+0000","last_became_peered":"2024-04-25T08:42:28.672041+0000","last_unstale":"2024-04-25T08:42:34.719414+0000","last_undegraded":"2024-04-25T08:42:34.719414+0000","last_fullsized":"2024-04-25T08:42:34.719414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341853+0000","last_change":"2024-04-25T08:42:27.665607+0000","last_active":"2024-04-25T08:42:34.341853+0000","last_peered":"2024-04-25T08:42:34.341853+0000","last_clean":"2024-04-25T08:42:34.341853+0000","last_became_active":"2024-04-25T08:42:27.664407+0000","last_became_peered":"2024-04-25T08:42:27.664407+0000","last_unstale":"2024-04-25T08:42:34.341853+0000","last_undegraded":"2024-04-25T08:42:34.341853+0000","last_fullsized":"2024-04-25T08:42:34.341853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.628103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718135+0000","last_change":"2024-04-25T08:42:32.773268+0000","last_active":"2024-04-25T08:42:34.718135+0000","last_peered":"2024-04-25T08:42:34.718135+0000","last_clean":"2024-04-25T08:42:34.718135+0000","last_became_active":"2024-04-25T08:42:32.772863+0000","last_became_peered":"2024-04-25T08:42:32.772863+0000","last_unstale":"2024-04-25T08:42:34.718135+0000","last_undegraded":"2024-04-25T08:42:34.718135+0000","last_fullsized":"2024-04-25T08:42:34.718135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718190+0000","last_change":"2024-04-25T08:42:28.680636+0000","last_active":"2024-04-25T08:42:33.718190+0000","last_peered":"2024-04-25T08:42:33.718190+0000","last_clean":"2024-04-25T08:42:33.718190+0000","last_became_active":"2024-04-25T08:42:28.680378+0000","last_became_peered":"2024-04-25T08:42:28.680378+0000","last_unstale":"2024-04-25T08:42:33.718190+0000","last_undegraded":"2024-04-25T08:42:33.718190+0000","last_fullsized":"2024-04-25T08:42:33.718190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719445+0000","last_change":"2024-04-25T08:42:27.659419+0000","last_active":"2024-04-25T08:42:34.719445+0000","last_peered":"2024-04-25T08:42:34.719445+0000","last_clean":"2024-04-25T08:42:34.719445+0000","last_became_active":"2024-04-25T08:42:27.657839+0000","last_became_peered":"2024-04-25T08:42:27.657839+0000","last_unstale":"2024-04-25T08:42:34.719445+0000","last_undegraded":"2024-04-25T08:42:34.719445+0000","last_fullsized":"2024-04-25T08:42:34.719445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719161+0000","last_change":"2024-04-25T08:42:32.711534+0000","last_active":"2024-04-25T08:42:34.719161+0000","last_peered":"2024-04-25T08:42:34.719161+0000","last_clean":"2024-04-25T08:42:34.719161+0000","last_became_active":"2024-04-25T08:42:32.709615+0000","last_became_peered":"2024-04-25T08:42:32.709615+0000","last_unstale":"2024-04-25T08:42:34.719161+0000","last_undegraded":"2024-04-25T08:42:34.719161+0000","last_fullsized":"2024-04-25T08:42:34.719161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:50.447473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717233+0000","last_change":"2024-04-25T08:42:28.675371+0000","last_active":"2024-04-25T08:42:33.717233+0000","last_peered":"2024-04-25T08:42:33.717233+0000","last_clean":"2024-04-25T08:42:33.717233+0000","last_became_active":"2024-04-25T08:42:28.675078+0000","last_became_peered":"2024-04-25T08:42:28.675078+0000","last_unstale":"2024-04-25T08:42:33.717233+0000","last_undegraded":"2024-04-25T08:42:33.717233+0000","last_fullsized":"2024-04-25T08:42:33.717233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:45.680776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717778+0000","last_change":"2024-04-25T08:42:27.663976+0000","last_active":"2024-04-25T08:42:33.717778+0000","last_peered":"2024-04-25T08:42:33.717778+0000","last_clean":"2024-04-25T08:42:33.717778+0000","last_became_active":"2024-04-25T08:42:27.663254+0000","last_became_peered":"2024-04-25T08:42:27.663254+0000","last_unstale":"2024-04-25T08:42:33.717778+0000","last_undegraded":"2024-04-25T08:42:33.717778+0000","last_fullsized":"2024-04-25T08:42:33.717778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719384+0000","last_change":"2024-04-25T08:42:32.712637+0000","last_active":"2024-04-25T08:42:34.719384+0000","last_peered":"2024-04-25T08:42:34.719384+0000","last_clean":"2024-04-25T08:42:34.719384+0000","last_became_active":"2024-04-25T08:42:32.712245+0000","last_became_peered":"2024-04-25T08:42:32.712245+0000","last_unstale":"2024-04-25T08:42:34.719384+0000","last_undegraded":"2024-04-25T08:42:34.719384+0000","last_fullsized":"2024-04-25T08:42:34.719384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:59.518802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719010+0000","last_change":"2024-04-25T08:42:28.673163+0000","last_active":"2024-04-25T08:42:34.719010+0000","last_peered":"2024-04-25T08:42:34.719010+0000","last_clean":"2024-04-25T08:42:34.719010+0000","last_became_active":"2024-04-25T08:42:28.672866+0000","last_became_peered":"2024-04-25T08:42:28.672866+0000","last_unstale":"2024-04-25T08:42:34.719010+0000","last_undegraded":"2024-04-25T08:42:34.719010+0000","last_fullsized":"2024-04-25T08:42:34.719010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714151+0000","last_change":"2024-04-25T08:42:27.665216+0000","last_active":"2024-04-25T08:42:33.714151+0000","last_peered":"2024-04-25T08:42:33.714151+0000","last_clean":"2024-04-25T08:42:33.714151+0000","last_became_active":"2024-04-25T08:42:27.664871+0000","last_became_peered":"2024-04-25T08:42:27.664871+0000","last_unstale":"2024-04-25T08:42:33.714151+0000","last_undegraded":"2024-04-25T08:42:33.714151+0000","last_fullsized":"2024-04-25T08:42:33.714151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:43.313642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719177+0000","last_change":"2024-04-25T08:42:32.708236+0000","last_active":"2024-04-25T08:42:34.719177+0000","last_peered":"2024-04-25T08:42:34.719177+0000","last_clean":"2024-04-25T08:42:34.719177+0000","last_became_active":"2024-04-25T08:42:32.707821+0000","last_became_peered":"2024-04-25T08:42:32.707821+0000","last_unstale":"2024-04-25T08:42:34.719177+0000","last_undegraded":"2024-04-25T08:42:34.719177+0000","last_fullsized":"2024-04-25T08:42:34.719177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:58.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.717992+0000","last_change":"2024-04-25T08:42:28.674649+0000","last_active":"2024-04-25T08:42:34.717992+0000","last_peered":"2024-04-25T08:42:34.717992+0000","last_clean":"2024-04-25T08:42:34.717992+0000","last_became_active":"2024-04-25T08:42:28.671414+0000","last_became_peered":"2024-04-25T08:42:28.671414+0000","last_unstale":"2024-04-25T08:42:34.717992+0000","last_undegraded":"2024-04-25T08:42:34.717992+0000","last_fullsized":"2024-04-25T08:42:34.717992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:16.974552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341186+0000","last_change":"2024-04-25T08:42:27.665689+0000","last_active":"2024-04-25T08:42:34.341186+0000","last_peered":"2024-04-25T08:42:34.341186+0000","last_clean":"2024-04-25T08:42:34.341186+0000","last_became_active":"2024-04-25T08:42:27.664957+0000","last_became_peered":"2024-04-25T08:42:27.664957+0000","last_unstale":"2024-04-25T08:42:34.341186+0000","last_undegraded":"2024-04-25T08:42:34.341186+0000","last_fullsized":"2024-04-25T08:42:34.341186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718502+0000","last_change":"2024-04-25T08:42:32.775658+0000","last_active":"2024-04-25T08:42:34.718502+0000","last_peered":"2024-04-25T08:42:34.718502+0000","last_clean":"2024-04-25T08:42:34.718502+0000","last_became_active":"2024-04-25T08:42:32.775292+0000","last_became_peered":"2024-04-25T08:42:32.775292+0000","last_unstale":"2024-04-25T08:42:34.718502+0000","last_undegraded":"2024-04-25T08:42:34.718502+0000","last_fullsized":"2024-04-25T08:42:34.718502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:59.518802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719571+0000","last_change":"2024-04-25T08:42:28.677751+0000","last_active":"2024-04-25T08:42:34.719571+0000","last_peered":"2024-04-25T08:42:34.719571+0000","last_clean":"2024-04-25T08:42:34.719571+0000","last_became_active":"2024-04-25T08:42:28.677457+0000","last_became_peered":"2024-04-25T08:42:28.677457+0000","last_unstale":"2024-04-25T08:42:34.719571+0000","last_undegraded":"2024-04-25T08:42:34.719571+0000","last_fullsized":"2024-04-25T08:42:34.719571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717550+0000","last_change":"2024-04-25T08:42:27.657212+0000","last_active":"2024-04-25T08:42:33.717550+0000","last_peered":"2024-04-25T08:42:33.717550+0000","last_clean":"2024-04-25T08:42:33.717550+0000","last_became_active":"2024-04-25T08:42:27.656883+0000","last_became_peered":"2024-04-25T08:42:27.656883+0000","last_unstale":"2024-04-25T08:42:33.717550+0000","last_undegraded":"2024-04-25T08:42:33.717550+0000","last_fullsized":"2024-04-25T08:42:33.717550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341308+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:42:34.341308+0000","last_peered":"2024-04-25T08:42:34.341308+0000","last_clean":"2024-04-25T08:42:34.341308+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:42:34.341308+0000","last_undegraded":"2024-04-25T08:42:34.341308+0000","last_fullsized":"2024-04-25T08:42:34.341308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718667+0000","last_change":"2024-04-25T08:42:32.776301+0000","last_active":"2024-04-25T08:42:34.718667+0000","last_peered":"2024-04-25T08:42:34.718667+0000","last_clean":"2024-04-25T08:42:34.718667+0000","last_became_active":"2024-04-25T08:42:32.775904+0000","last_became_peered":"2024-04-25T08:42:32.775904+0000","last_unstale":"2024-04-25T08:42:34.718667+0000","last_undegraded":"2024-04-25T08:42:34.718667+0000","last_fullsized":"2024-04-25T08:42:34.718667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341570+0000","last_change":"2024-04-25T08:42:28.692829+0000","last_active":"2024-04-25T08:42:34.341570+0000","last_peered":"2024-04-25T08:42:34.341570+0000","last_clean":"2024-04-25T08:42:34.341570+0000","last_became_active":"2024-04-25T08:42:28.690838+0000","last_became_peered":"2024-04-25T08:42:28.690838+0000","last_unstale":"2024-04-25T08:42:34.341570+0000","last_undegraded":"2024-04-25T08:42:34.341570+0000","last_fullsized":"2024-04-25T08:42:34.341570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:31.845872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714659+0000","last_change":"2024-04-25T08:42:27.664137+0000","last_active":"2024-04-25T08:42:33.714659+0000","last_peered":"2024-04-25T08:42:33.714659+0000","last_clean":"2024-04-25T08:42:33.714659+0000","last_became_active":"2024-04-25T08:42:27.663755+0000","last_became_peered":"2024-04-25T08:42:27.663755+0000","last_unstale":"2024-04-25T08:42:33.714659+0000","last_undegraded":"2024-04-25T08:42:33.714659+0000","last_fullsized":"2024-04-25T08:42:33.714659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718434+0000","last_change":"2024-04-25T08:42:32.773504+0000","last_active":"2024-04-25T08:42:34.718434+0000","last_peered":"2024-04-25T08:42:34.718434+0000","last_clean":"2024-04-25T08:42:34.718434+0000","last_became_active":"2024-04-25T08:42:32.773110+0000","last_became_peered":"2024-04-25T08:42:32.773110+0000","last_unstale":"2024-04-25T08:42:34.718434+0000","last_undegraded":"2024-04-25T08:42:34.718434+0000","last_fullsized":"2024-04-25T08:42:34.718434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:48.222965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717970+0000","last_change":"2024-04-25T08:42:28.679402+0000","last_active":"2024-04-25T08:42:33.717970+0000","last_peered":"2024-04-25T08:42:33.717970+0000","last_clean":"2024-04-25T08:42:33.717970+0000","last_became_active":"2024-04-25T08:42:28.677035+0000","last_became_peered":"2024-04-25T08:42:28.677035+0000","last_unstale":"2024-04-25T08:42:33.717970+0000","last_undegraded":"2024-04-25T08:42:33.717970+0000","last_fullsized":"2024-04-25T08:42:33.717970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:46.406390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719572+0000","last_change":"2024-04-25T08:42:27.667160+0000","last_active":"2024-04-25T08:42:34.719572+0000","last_peered":"2024-04-25T08:42:34.719572+0000","last_clean":"2024-04-25T08:42:34.719572+0000","last_became_active":"2024-04-25T08:42:27.666859+0000","last_became_peered":"2024-04-25T08:42:27.666859+0000","last_unstale":"2024-04-25T08:42:34.719572+0000","last_undegraded":"2024-04-25T08:42:34.719572+0000","last_fullsized":"2024-04-25T08:42:34.719572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.628103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718382+0000","last_change":"2024-04-25T08:42:32.712665+0000","last_active":"2024-04-25T08:42:34.718382+0000","last_peered":"2024-04-25T08:42:34.718382+0000","last_clean":"2024-04-25T08:42:34.718382+0000","last_became_active":"2024-04-25T08:42:32.712042+0000","last_became_peered":"2024-04-25T08:42:32.712042+0000","last_unstale":"2024-04-25T08:42:34.718382+0000","last_undegraded":"2024-04-25T08:42:34.718382+0000","last_fullsized":"2024-04-25T08:42:34.718382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:58.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341968+0000","last_change":"2024-04-25T08:42:28.693096+0000","last_active":"2024-04-25T08:42:34.341968+0000","last_peered":"2024-04-25T08:42:34.341968+0000","last_clean":"2024-04-25T08:42:34.341968+0000","last_became_active":"2024-04-25T08:42:28.692818+0000","last_became_peered":"2024-04-25T08:42:28.692818+0000","last_unstale":"2024-04-25T08:42:34.341968+0000","last_undegraded":"2024-04-25T08:42:34.341968+0000","last_fullsized":"2024-04-25T08:42:34.341968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:18.213161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714486+0000","last_change":"2024-04-25T08:42:27.669796+0000","last_active":"2024-04-25T08:42:33.714486+0000","last_peered":"2024-04-25T08:42:33.714486+0000","last_clean":"2024-04-25T08:42:33.714486+0000","last_became_active":"2024-04-25T08:42:27.669436+0000","last_became_peered":"2024-04-25T08:42:27.669436+0000","last_unstale":"2024-04-25T08:42:33.714486+0000","last_undegraded":"2024-04-25T08:42:33.714486+0000","last_fullsized":"2024-04-25T08:42:33.714486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.411487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716067+0000","last_change":"2024-04-25T08:42:32.776302+0000","last_active":"2024-04-25T08:42:33.716067+0000","last_peered":"2024-04-25T08:42:33.716067+0000","last_clean":"2024-04-25T08:42:33.716067+0000","last_became_active":"2024-04-25T08:42:32.775933+0000","last_became_peered":"2024-04-25T08:42:32.775933+0000","last_unstale":"2024-04-25T08:42:33.716067+0000","last_undegraded":"2024-04-25T08:42:33.716067+0000","last_fullsized":"2024-04-25T08:42:33.716067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341857+0000","last_change":"2024-04-25T08:42:28.690533+0000","last_active":"2024-04-25T08:42:34.341857+0000","last_peered":"2024-04-25T08:42:34.341857+0000","last_clean":"2024-04-25T08:42:34.341857+0000","last_became_active":"2024-04-25T08:42:28.690239+0000","last_became_peered":"2024-04-25T08:42:28.690239+0000","last_unstale":"2024-04-25T08:42:34.341857+0000","last_undegraded":"2024-04-25T08:42:34.341857+0000","last_fullsized":"2024-04-25T08:42:34.341857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:46.406390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717279+0000","last_change":"2024-04-25T08:42:27.656949+0000","last_active":"2024-04-25T08:42:33.717279+0000","last_peered":"2024-04-25T08:42:33.717279+0000","last_clean":"2024-04-25T08:42:33.717279+0000","last_became_active":"2024-04-25T08:42:27.656636+0000","last_became_peered":"2024-04-25T08:42:27.656636+0000","last_unstale":"2024-04-25T08:42:33.717279+0000","last_undegraded":"2024-04-25T08:42:33.717279+0000","last_fullsized":"2024-04-25T08:42:33.717279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:20.615472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716458+0000","last_change":"2024-04-25T08:42:32.710504+0000","last_active":"2024-04-25T08:42:33.716458+0000","last_peered":"2024-04-25T08:42:33.716458+0000","last_clean":"2024-04-25T08:42:33.716458+0000","last_became_active":"2024-04-25T08:42:32.709907+0000","last_became_peered":"2024-04-25T08:42:32.709907+0000","last_unstale":"2024-04-25T08:42:33.716458+0000","last_undegraded":"2024-04-25T08:42:33.716458+0000","last_fullsized":"2024-04-25T08:42:33.716458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:01.014826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341325+0000","last_change":"2024-04-25T08:42:28.691813+0000","last_active":"2024-04-25T08:42:34.341325+0000","last_peered":"2024-04-25T08:42:34.341325+0000","last_clean":"2024-04-25T08:42:34.341325+0000","last_became_active":"2024-04-25T08:42:28.691149+0000","last_became_peered":"2024-04-25T08:42:28.691149+0000","last_unstale":"2024-04-25T08:42:34.341325+0000","last_undegraded":"2024-04-25T08:42:34.341325+0000","last_fullsized":"2024-04-25T08:42:34.341325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714031+0000","last_change":"2024-04-25T08:42:27.662731+0000","last_active":"2024-04-25T08:42:33.714031+0000","last_peered":"2024-04-25T08:42:33.714031+0000","last_clean":"2024-04-25T08:42:33.714031+0000","last_became_active":"2024-04-25T08:42:27.662403+0000","last_became_peered":"2024-04-25T08:42:27.662403+0000","last_unstale":"2024-04-25T08:42:33.714031+0000","last_undegraded":"2024-04-25T08:42:33.714031+0000","last_fullsized":"2024-04-25T08:42:33.714031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:50.270810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718353+0000","last_change":"2024-04-25T08:42:32.710724+0000","last_active":"2024-04-25T08:42:34.718353+0000","last_peered":"2024-04-25T08:42:34.718353+0000","last_clean":"2024-04-25T08:42:34.718353+0000","last_became_active":"2024-04-25T08:42:32.710334+0000","last_became_peered":"2024-04-25T08:42:32.710334+0000","last_unstale":"2024-04-25T08:42:34.718353+0000","last_undegraded":"2024-04-25T08:42:34.718353+0000","last_fullsized":"2024-04-25T08:42:34.718353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:50.447473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718379+0000","last_change":"2024-04-25T08:42:28.687700+0000","last_active":"2024-04-25T08:42:34.718379+0000","last_peered":"2024-04-25T08:42:34.718379+0000","last_clean":"2024-04-25T08:42:34.718379+0000","last_became_active":"2024-04-25T08:42:28.687069+0000","last_became_peered":"2024-04-25T08:42:28.687069+0000","last_unstale":"2024-04-25T08:42:34.718379+0000","last_undegraded":"2024-04-25T08:42:34.718379+0000","last_fullsized":"2024-04-25T08:42:34.718379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718433+0000","last_change":"2024-04-25T08:42:27.666832+0000","last_active":"2024-04-25T08:42:34.718433+0000","last_peered":"2024-04-25T08:42:34.718433+0000","last_clean":"2024-04-25T08:42:34.718433+0000","last_became_active":"2024-04-25T08:42:27.666534+0000","last_became_peered":"2024-04-25T08:42:27.666534+0000","last_unstale":"2024-04-25T08:42:34.718433+0000","last_undegraded":"2024-04-25T08:42:34.718433+0000","last_fullsized":"2024-04-25T08:42:34.718433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720268+0000","last_change":"2024-04-25T08:42:32.774301+0000","last_active":"2024-04-25T08:42:34.720268+0000","last_peered":"2024-04-25T08:42:34.720268+0000","last_clean":"2024-04-25T08:42:34.720268+0000","last_became_active":"2024-04-25T08:42:32.773417+0000","last_became_peered":"2024-04-25T08:42:32.773417+0000","last_unstale":"2024-04-25T08:42:34.720268+0000","last_undegraded":"2024-04-25T08:42:34.720268+0000","last_fullsized":"2024-04-25T08:42:34.720268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:35.240827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341533+0000","last_change":"2024-04-25T08:42:28.691458+0000","last_active":"2024-04-25T08:42:34.341533+0000","last_peered":"2024-04-25T08:42:34.341533+0000","last_clean":"2024-04-25T08:42:34.341533+0000","last_became_active":"2024-04-25T08:42:28.691196+0000","last_became_peered":"2024-04-25T08:42:28.691196+0000","last_unstale":"2024-04-25T08:42:34.341533+0000","last_undegraded":"2024-04-25T08:42:34.341533+0000","last_fullsized":"2024-04-25T08:42:34.341533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717730+0000","last_change":"2024-04-25T08:42:27.667521+0000","last_active":"2024-04-25T08:42:33.717730+0000","last_peered":"2024-04-25T08:42:33.717730+0000","last_clean":"2024-04-25T08:42:33.717730+0000","last_became_active":"2024-04-25T08:42:27.666568+0000","last_became_peered":"2024-04-25T08:42:27.666568+0000","last_unstale":"2024-04-25T08:42:33.717730+0000","last_undegraded":"2024-04-25T08:42:33.717730+0000","last_fullsized":"2024-04-25T08:42:33.717730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719926+0000","last_change":"2024-04-25T08:42:32.773283+0000","last_active":"2024-04-25T08:42:34.719926+0000","last_peered":"2024-04-25T08:42:34.719926+0000","last_clean":"2024-04-25T08:42:34.719926+0000","last_became_active":"2024-04-25T08:42:32.772847+0000","last_became_peered":"2024-04-25T08:42:32.772847+0000","last_unstale":"2024-04-25T08:42:34.719926+0000","last_undegraded":"2024-04-25T08:42:34.719926+0000","last_fullsized":"2024-04-25T08:42:34.719926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718713+0000","last_change":"2024-04-25T08:42:28.682019+0000","last_active":"2024-04-25T08:42:34.718713+0000","last_peered":"2024-04-25T08:42:34.718713+0000","last_clean":"2024-04-25T08:42:34.718713+0000","last_became_active":"2024-04-25T08:42:28.681710+0000","last_became_peered":"2024-04-25T08:42:28.681710+0000","last_unstale":"2024-04-25T08:42:34.718713+0000","last_undegraded":"2024-04-25T08:42:34.718713+0000","last_fullsized":"2024-04-25T08:42:34.718713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:25.495879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718612+0000","last_change":"2024-04-25T08:42:27.662671+0000","last_active":"2024-04-25T08:42:34.718612+0000","last_peered":"2024-04-25T08:42:34.718612+0000","last_clean":"2024-04-25T08:42:34.718612+0000","last_became_active":"2024-04-25T08:42:27.662360+0000","last_became_peered":"2024-04-25T08:42:27.662360+0000","last_unstale":"2024-04-25T08:42:34.718612+0000","last_undegraded":"2024-04-25T08:42:34.718612+0000","last_fullsized":"2024-04-25T08:42:34.718612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:50.270810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718134+0000","last_change":"2024-04-25T08:42:32.775284+0000","last_active":"2024-04-25T08:42:33.718134+0000","last_peered":"2024-04-25T08:42:33.718134+0000","last_clean":"2024-04-25T08:42:33.718134+0000","last_became_active":"2024-04-25T08:42:32.774805+0000","last_became_peered":"2024-04-25T08:42:32.774805+0000","last_unstale":"2024-04-25T08:42:33.718134+0000","last_undegraded":"2024-04-25T08:42:33.718134+0000","last_fullsized":"2024-04-25T08:42:33.718134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:40.291706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341553+0000","last_change":"2024-04-25T08:42:28.687467+0000","last_active":"2024-04-25T08:42:34.341553+0000","last_peered":"2024-04-25T08:42:34.341553+0000","last_clean":"2024-04-25T08:42:34.341553+0000","last_became_active":"2024-04-25T08:42:28.687151+0000","last_became_peered":"2024-04-25T08:42:28.687151+0000","last_unstale":"2024-04-25T08:42:34.341553+0000","last_undegraded":"2024-04-25T08:42:34.341553+0000","last_fullsized":"2024-04-25T08:42:34.341553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:12.983651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:37.848489+0000","last_change":"2024-04-25T08:42:27.667309+0000","last_active":"2024-04-25T08:42:37.848489+0000","last_peered":"2024-04-25T08:42:37.848489+0000","last_clean":"2024-04-25T08:42:37.848489+0000","last_became_active":"2024-04-25T08:42:27.666995+0000","last_became_peered":"2024-04-25T08:42:27.666995+0000","last_unstale":"2024-04-25T08:42:37.848489+0000","last_undegraded":"2024-04-25T08:42:37.848489+0000","last_fullsized":"2024-04-25T08:42:37.848489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719544+0000","last_change":"2024-04-25T08:42:32.709153+0000","last_active":"2024-04-25T08:42:34.719544+0000","last_peered":"2024-04-25T08:42:34.719544+0000","last_clean":"2024-04-25T08:42:34.719544+0000","last_became_active":"2024-04-25T08:42:32.708767+0000","last_became_peered":"2024-04-25T08:42:32.708767+0000","last_unstale":"2024-04-25T08:42:34.719544+0000","last_undegraded":"2024-04-25T08:42:34.719544+0000","last_fullsized":"2024-04-25T08:42:34.719544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:07.122172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716905+0000","last_change":"2024-04-25T08:42:28.682383+0000","last_active":"2024-04-25T08:42:33.716905+0000","last_peered":"2024-04-25T08:42:33.716905+0000","last_clean":"2024-04-25T08:42:33.716905+0000","last_became_active":"2024-04-25T08:42:28.682089+0000","last_became_peered":"2024-04-25T08:42:28.682089+0000","last_unstale":"2024-04-25T08:42:33.716905+0000","last_undegraded":"2024-04-25T08:42:33.716905+0000","last_fullsized":"2024-04-25T08:42:33.716905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.349485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719476+0000","last_change":"2024-04-25T08:42:27.667264+0000","last_active":"2024-04-25T08:42:34.719476+0000","last_peered":"2024-04-25T08:42:34.719476+0000","last_clean":"2024-04-25T08:42:34.719476+0000","last_became_active":"2024-04-25T08:42:27.666961+0000","last_became_peered":"2024-04-25T08:42:27.666961+0000","last_unstale":"2024-04-25T08:42:34.719476+0000","last_undegraded":"2024-04-25T08:42:34.719476+0000","last_fullsized":"2024-04-25T08:42:34.719476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:11.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717197+0000","last_change":"2024-04-25T08:42:32.714944+0000","last_active":"2024-04-25T08:42:33.717197+0000","last_peered":"2024-04-25T08:42:33.717197+0000","last_clean":"2024-04-25T08:42:33.717197+0000","last_became_active":"2024-04-25T08:42:32.714532+0000","last_became_peered":"2024-04-25T08:42:32.714532+0000","last_unstale":"2024-04-25T08:42:33.717197+0000","last_undegraded":"2024-04-25T08:42:33.717197+0000","last_fullsized":"2024-04-25T08:42:33.717197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718384+0000","last_change":"2024-04-25T08:42:28.678248+0000","last_active":"2024-04-25T08:42:34.718384+0000","last_peered":"2024-04-25T08:42:34.718384+0000","last_clean":"2024-04-25T08:42:34.718384+0000","last_became_active":"2024-04-25T08:42:28.677444+0000","last_became_peered":"2024-04-25T08:42:28.677444+0000","last_unstale":"2024-04-25T08:42:34.718384+0000","last_undegraded":"2024-04-25T08:42:34.718384+0000","last_fullsized":"2024-04-25T08:42:34.718384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718054+0000","last_change":"2024-04-25T08:42:27.662208+0000","last_active":"2024-04-25T08:42:33.718054+0000","last_peered":"2024-04-25T08:42:33.718054+0000","last_clean":"2024-04-25T08:42:33.718054+0000","last_became_active":"2024-04-25T08:42:27.661833+0000","last_became_peered":"2024-04-25T08:42:27.661833+0000","last_unstale":"2024-04-25T08:42:33.718054+0000","last_undegraded":"2024-04-25T08:42:33.718054+0000","last_fullsized":"2024-04-25T08:42:33.718054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720748+0000","last_change":"2024-04-25T08:42:32.704429+0000","last_active":"2024-04-25T08:42:34.720748+0000","last_peered":"2024-04-25T08:42:34.720748+0000","last_clean":"2024-04-25T08:42:34.720748+0000","last_became_active":"2024-04-25T08:42:32.703936+0000","last_became_peered":"2024-04-25T08:42:32.703936+0000","last_unstale":"2024-04-25T08:42:34.720748+0000","last_undegraded":"2024-04-25T08:42:34.720748+0000","last_fullsized":"2024-04-25T08:42:34.720748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:27.086996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717935+0000","last_change":"2024-04-25T08:42:28.685516+0000","last_active":"2024-04-25T08:42:33.717935+0000","last_peered":"2024-04-25T08:42:33.717935+0000","last_clean":"2024-04-25T08:42:33.717935+0000","last_became_active":"2024-04-25T08:42:28.685250+0000","last_became_peered":"2024-04-25T08:42:28.685250+0000","last_unstale":"2024-04-25T08:42:33.717935+0000","last_undegraded":"2024-04-25T08:42:33.717935+0000","last_fullsized":"2024-04-25T08:42:33.717935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719154+0000","last_change":"2024-04-25T08:42:27.665950+0000","last_active":"2024-04-25T08:42:34.719154+0000","last_peered":"2024-04-25T08:42:34.719154+0000","last_clean":"2024-04-25T08:42:34.719154+0000","last_became_active":"2024-04-25T08:42:27.665624+0000","last_became_peered":"2024-04-25T08:42:27.665624+0000","last_unstale":"2024-04-25T08:42:34.719154+0000","last_undegraded":"2024-04-25T08:42:34.719154+0000","last_fullsized":"2024-04-25T08:42:34.719154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720002+0000","last_change":"2024-04-25T08:42:32.776610+0000","last_active":"2024-04-25T08:42:34.720002+0000","last_peered":"2024-04-25T08:42:34.720002+0000","last_clean":"2024-04-25T08:42:34.720002+0000","last_became_active":"2024-04-25T08:42:32.776245+0000","last_became_peered":"2024-04-25T08:42:32.776245+0000","last_unstale":"2024-04-25T08:42:34.720002+0000","last_undegraded":"2024-04-25T08:42:34.720002+0000","last_fullsized":"2024-04-25T08:42:34.720002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:40.291706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718182+0000","last_change":"2024-04-25T08:42:32.776744+0000","last_active":"2024-04-25T08:42:34.718182+0000","last_peered":"2024-04-25T08:42:34.718182+0000","last_clean":"2024-04-25T08:42:34.718182+0000","last_became_active":"2024-04-25T08:42:32.776378+0000","last_became_peered":"2024-04-25T08:42:32.776378+0000","last_unstale":"2024-04-25T08:42:34.718182+0000","last_undegraded":"2024-04-25T08:42:34.718182+0000","last_fullsized":"2024-04-25T08:42:34.718182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718145+0000","last_change":"2024-04-25T08:42:28.675393+0000","last_active":"2024-04-25T08:42:34.718145+0000","last_peered":"2024-04-25T08:42:34.718145+0000","last_clean":"2024-04-25T08:42:34.718145+0000","last_became_active":"2024-04-25T08:42:28.675124+0000","last_became_peered":"2024-04-25T08:42:28.675124+0000","last_unstale":"2024-04-25T08:42:34.718145+0000","last_undegraded":"2024-04-25T08:42:34.718145+0000","last_fullsized":"2024-04-25T08:42:34.718145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716296+0000","last_change":"2024-04-25T08:42:27.661033+0000","last_active":"2024-04-25T08:42:33.716296+0000","last_peered":"2024-04-25T08:42:33.716296+0000","last_clean":"2024-04-25T08:42:33.716296+0000","last_became_active":"2024-04-25T08:42:27.660770+0000","last_became_peered":"2024-04-25T08:42:27.660770+0000","last_unstale":"2024-04-25T08:42:33.716296+0000","last_undegraded":"2024-04-25T08:42:33.716296+0000","last_fullsized":"2024-04-25T08:42:33.716296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719178+0000","last_change":"2024-04-25T08:42:32.714933+0000","last_active":"2024-04-25T08:42:34.719178+0000","last_peered":"2024-04-25T08:42:34.719178+0000","last_clean":"2024-04-25T08:42:34.719178+0000","last_became_active":"2024-04-25T08:42:32.714432+0000","last_became_peered":"2024-04-25T08:42:32.714432+0000","last_unstale":"2024-04-25T08:42:34.719178+0000","last_undegraded":"2024-04-25T08:42:34.719178+0000","last_fullsized":"2024-04-25T08:42:34.719178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720792+0000","last_change":"2024-04-25T08:42:28.679501+0000","last_active":"2024-04-25T08:42:34.720792+0000","last_peered":"2024-04-25T08:42:34.720792+0000","last_clean":"2024-04-25T08:42:34.720792+0000","last_became_active":"2024-04-25T08:42:28.679169+0000","last_became_peered":"2024-04-25T08:42:28.679169+0000","last_unstale":"2024-04-25T08:42:34.720792+0000","last_undegraded":"2024-04-25T08:42:34.720792+0000","last_fullsized":"2024-04-25T08:42:34.720792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720301+0000","last_change":"2024-04-25T08:42:27.669642+0000","last_active":"2024-04-25T08:42:34.720301+0000","last_peered":"2024-04-25T08:42:34.720301+0000","last_clean":"2024-04-25T08:42:34.720301+0000","last_became_active":"2024-04-25T08:42:27.669219+0000","last_became_peered":"2024-04-25T08:42:27.669219+0000","last_unstale":"2024-04-25T08:42:34.720301+0000","last_undegraded":"2024-04-25T08:42:34.720301+0000","last_fullsized":"2024-04-25T08:42:34.720301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718695+0000","last_change":"2024-04-25T08:42:27.664507+0000","last_active":"2024-04-25T08:42:34.718695+0000","last_peered":"2024-04-25T08:42:34.718695+0000","last_clean":"2024-04-25T08:42:34.718695+0000","last_became_active":"2024-04-25T08:42:27.663781+0000","last_became_peered":"2024-04-25T08:42:27.663781+0000","last_unstale":"2024-04-25T08:42:34.718695+0000","last_undegraded":"2024-04-25T08:42:34.718695+0000","last_fullsized":"2024-04-25T08:42:34.718695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718519+0000","last_change":"2024-04-25T08:42:28.670559+0000","last_active":"2024-04-25T08:42:34.718519+0000","last_peered":"2024-04-25T08:42:34.718519+0000","last_clean":"2024-04-25T08:42:34.718519+0000","last_became_active":"2024-04-25T08:42:28.670258+0000","last_became_peered":"2024-04-25T08:42:28.670258+0000","last_unstale":"2024-04-25T08:42:34.718519+0000","last_undegraded":"2024-04-25T08:42:34.718519+0000","last_fullsized":"2024-04-25T08:42:34.718519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714478+0000","last_change":"2024-04-25T08:42:32.714660+0000","last_active":"2024-04-25T08:42:33.714478+0000","last_peered":"2024-04-25T08:42:33.714478+0000","last_clean":"2024-04-25T08:42:33.714478+0000","last_became_active":"2024-04-25T08:42:32.714182+0000","last_became_peered":"2024-04-25T08:42:32.714182+0000","last_unstale":"2024-04-25T08:42:33.714478+0000","last_undegraded":"2024-04-25T08:42:33.714478+0000","last_fullsized":"2024-04-25T08:42:33.714478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:21.015635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720625+0000","last_change":"2024-04-25T08:42:27.671542+0000","last_active":"2024-04-25T08:42:34.720625+0000","last_peered":"2024-04-25T08:42:34.720625+0000","last_clean":"2024-04-25T08:42:34.720625+0000","last_became_active":"2024-04-25T08:42:27.670640+0000","last_became_peered":"2024-04-25T08:42:27.670640+0000","last_unstale":"2024-04-25T08:42:34.720625+0000","last_undegraded":"2024-04-25T08:42:34.720625+0000","last_fullsized":"2024-04-25T08:42:34.720625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.411487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716383+0000","last_change":"2024-04-25T08:42:28.675535+0000","last_active":"2024-04-25T08:42:33.716383+0000","last_peered":"2024-04-25T08:42:33.716383+0000","last_clean":"2024-04-25T08:42:33.716383+0000","last_became_active":"2024-04-25T08:42:28.674786+0000","last_became_peered":"2024-04-25T08:42:28.674786+0000","last_unstale":"2024-04-25T08:42:33.716383+0000","last_undegraded":"2024-04-25T08:42:33.716383+0000","last_fullsized":"2024-04-25T08:42:33.716383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:19.055819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720001+0000","last_change":"2024-04-25T08:42:32.703253+0000","last_active":"2024-04-25T08:42:34.720001+0000","last_peered":"2024-04-25T08:42:34.720001+0000","last_clean":"2024-04-25T08:42:34.720001+0000","last_became_active":"2024-04-25T08:42:32.702862+0000","last_became_peered":"2024-04-25T08:42:32.702862+0000","last_unstale":"2024-04-25T08:42:34.720001+0000","last_undegraded":"2024-04-25T08:42:34.720001+0000","last_fullsized":"2024-04-25T08:42:34.720001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:46.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718238+0000","last_change":"2024-04-25T08:42:28.688424+0000","last_active":"2024-04-25T08:42:34.718238+0000","last_peered":"2024-04-25T08:42:34.718238+0000","last_clean":"2024-04-25T08:42:34.718238+0000","last_became_active":"2024-04-25T08:42:28.687428+0000","last_became_peered":"2024-04-25T08:42:28.687428+0000","last_unstale":"2024-04-25T08:42:34.718238+0000","last_undegraded":"2024-04-25T08:42:34.718238+0000","last_fullsized":"2024-04-25T08:42:34.718238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714119+0000","last_change":"2024-04-25T08:42:28.676656+0000","last_active":"2024-04-25T08:42:33.714119+0000","last_peered":"2024-04-25T08:42:33.714119+0000","last_clean":"2024-04-25T08:42:33.714119+0000","last_became_active":"2024-04-25T08:42:28.676373+0000","last_became_peered":"2024-04-25T08:42:28.676373+0000","last_unstale":"2024-04-25T08:42:33.714119+0000","last_undegraded":"2024-04-25T08:42:33.714119+0000","last_fullsized":"2024-04-25T08:42:33.714119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:12.180971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717556+0000","last_change":"2024-04-25T08:42:28.681762+0000","last_active":"2024-04-25T08:42:33.717556+0000","last_peered":"2024-04-25T08:42:33.717556+0000","last_clean":"2024-04-25T08:42:33.717556+0000","last_became_active":"2024-04-25T08:42:28.681291+0000","last_became_peered":"2024-04-25T08:42:28.681291+0000","last_unstale":"2024-04-25T08:42:33.717556+0000","last_undegraded":"2024-04-25T08:42:33.717556+0000","last_fullsized":"2024-04-25T08:42:33.717556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:54.440616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718428+0000","last_change":"2024-04-25T08:42:28.676467+0000","last_active":"2024-04-25T08:42:34.718428+0000","last_peered":"2024-04-25T08:42:34.718428+0000","last_clean":"2024-04-25T08:42:34.718428+0000","last_became_active":"2024-04-25T08:42:28.675914+0000","last_became_peered":"2024-04-25T08:42:28.675914+0000","last_unstale":"2024-04-25T08:42:34.718428+0000","last_undegraded":"2024-04-25T08:42:34.718428+0000","last_fullsized":"2024-04-25T08:42:34.718428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720100+0000","last_change":"2024-04-25T08:42:28.675440+0000","last_active":"2024-04-25T08:42:34.720100+0000","last_peered":"2024-04-25T08:42:34.720100+0000","last_clean":"2024-04-25T08:42:34.720100+0000","last_became_active":"2024-04-25T08:42:28.675157+0000","last_became_peered":"2024-04-25T08:42:28.675157+0000","last_unstale":"2024-04-25T08:42:34.720100+0000","last_undegraded":"2024-04-25T08:42:34.720100+0000","last_fullsized":"2024-04-25T08:42:34.720100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719294+0000","last_change":"2024-04-25T08:42:28.681482+0000","last_active":"2024-04-25T08:42:34.719294+0000","last_peered":"2024-04-25T08:42:34.719294+0000","last_clean":"2024-04-25T08:42:34.719294+0000","last_became_active":"2024-04-25T08:42:28.681211+0000","last_became_peered":"2024-04-25T08:42:28.681211+0000","last_unstale":"2024-04-25T08:42:34.719294+0000","last_undegraded":"2024-04-25T08:42:34.719294+0000","last_fullsized":"2024-04-25T08:42:34.719294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719200+0000","last_change":"2024-04-25T08:42:28.684774+0000","last_active":"2024-04-25T08:42:34.719200+0000","last_peered":"2024-04-25T08:42:34.719200+0000","last_clean":"2024-04-25T08:42:34.719200+0000","last_became_active":"2024-04-25T08:42:28.684502+0000","last_became_peered":"2024-04-25T08:42:28.684502+0000","last_unstale":"2024-04-25T08:42:34.719200+0000","last_undegraded":"2024-04-25T08:42:34.719200+0000","last_fullsized":"2024-04-25T08:42:34.719200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720334+0000","last_change":"2024-04-25T08:42:28.675478+0000","last_active":"2024-04-25T08:42:34.720334+0000","last_peered":"2024-04-25T08:42:34.720334+0000","last_clean":"2024-04-25T08:42:34.720334+0000","last_became_active":"2024-04-25T08:42:28.675191+0000","last_became_peered":"2024-04-25T08:42:28.675191+0000","last_unstale":"2024-04-25T08:42:34.720334+0000","last_undegraded":"2024-04-25T08:42:34.720334+0000","last_fullsized":"2024-04-25T08:42:34.720334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716297+0000","last_change":"2024-04-25T08:42:28.679789+0000","last_active":"2024-04-25T08:42:33.716297+0000","last_peered":"2024-04-25T08:42:33.716297+0000","last_clean":"2024-04-25T08:42:33.716297+0000","last_became_active":"2024-04-25T08:42:28.677404+0000","last_became_peered":"2024-04-25T08:42:28.677404+0000","last_unstale":"2024-04-25T08:42:33.716297+0000","last_undegraded":"2024-04-25T08:42:33.716297+0000","last_fullsized":"2024-04-25T08:42:33.716297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720113+0000","last_change":"2024-04-25T08:42:28.683643+0000","last_active":"2024-04-25T08:42:34.720113+0000","last_peered":"2024-04-25T08:42:34.720113+0000","last_clean":"2024-04-25T08:42:34.720113+0000","last_became_active":"2024-04-25T08:42:28.683205+0000","last_became_peered":"2024-04-25T08:42:28.683205+0000","last_unstale":"2024-04-25T08:42:34.720113+0000","last_undegraded":"2024-04-25T08:42:34.720113+0000","last_fullsized":"2024-04-25T08:42:34.720113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717551+0000","last_change":"2024-04-25T08:42:28.682157+0000","last_active":"2024-04-25T08:42:33.717551+0000","last_peered":"2024-04-25T08:42:33.717551+0000","last_clean":"2024-04-25T08:42:33.717551+0000","last_became_active":"2024-04-25T08:42:28.681910+0000","last_became_peered":"2024-04-25T08:42:28.681910+0000","last_unstale":"2024-04-25T08:42:33.717551+0000","last_undegraded":"2024-04-25T08:42:33.717551+0000","last_fullsized":"2024-04-25T08:42:33.717551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718189+0000","last_change":"2024-04-25T08:42:28.681636+0000","last_active":"2024-04-25T08:42:34.718189+0000","last_peered":"2024-04-25T08:42:34.718189+0000","last_clean":"2024-04-25T08:42:34.718189+0000","last_became_active":"2024-04-25T08:42:28.681243+0000","last_became_peered":"2024-04-25T08:42:28.681243+0000","last_unstale":"2024-04-25T08:42:34.718189+0000","last_undegraded":"2024-04-25T08:42:34.718189+0000","last_fullsized":"2024-04-25T08:42:34.718189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:22.224011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718681+0000","last_change":"2024-04-25T08:42:28.690347+0000","last_active":"2024-04-25T08:42:34.718681+0000","last_peered":"2024-04-25T08:42:34.718681+0000","last_clean":"2024-04-25T08:42:34.718681+0000","last_became_active":"2024-04-25T08:42:28.690062+0000","last_became_peered":"2024-04-25T08:42:28.690062+0000","last_unstale":"2024-04-25T08:42:34.718681+0000","last_undegraded":"2024-04-25T08:42:34.718681+0000","last_fullsized":"2024-04-25T08:42:34.718681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341807+0000","last_change":"2024-04-25T08:42:28.687419+0000","last_active":"2024-04-25T08:42:34.341807+0000","last_peered":"2024-04-25T08:42:34.341807+0000","last_clean":"2024-04-25T08:42:34.341807+0000","last_became_active":"2024-04-25T08:42:28.686800+0000","last_became_peered":"2024-04-25T08:42:28.686800+0000","last_unstale":"2024-04-25T08:42:34.341807+0000","last_undegraded":"2024-04-25T08:42:34.341807+0000","last_fullsized":"2024-04-25T08:42:34.341807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:54.440616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714411+0000","last_change":"2024-04-25T08:42:28.679139+0000","last_active":"2024-04-25T08:42:33.714411+0000","last_peered":"2024-04-25T08:42:33.714411+0000","last_clean":"2024-04-25T08:42:33.714411+0000","last_became_active":"2024-04-25T08:42:28.678803+0000","last_became_peered":"2024-04-25T08:42:28.678803+0000","last_unstale":"2024-04-25T08:42:33.714411+0000","last_undegraded":"2024-04-25T08:42:33.714411+0000","last_fullsized":"2024-04-25T08:42:33.714411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:08.632475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718400+0000","last_change":"2024-04-25T08:42:28.682788+0000","last_active":"2024-04-25T08:42:33.718400+0000","last_peered":"2024-04-25T08:42:33.718400+0000","last_clean":"2024-04-25T08:42:33.718400+0000","last_became_active":"2024-04-25T08:42:28.682532+0000","last_became_peered":"2024-04-25T08:42:28.682532+0000","last_unstale":"2024-04-25T08:42:33.718400+0000","last_undegraded":"2024-04-25T08:42:33.718400+0000","last_fullsized":"2024-04-25T08:42:33.718400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:12.983651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716185+0000","last_change":"2024-04-25T08:42:28.676138+0000","last_active":"2024-04-25T08:42:33.716185+0000","last_peered":"2024-04-25T08:42:33.716185+0000","last_clean":"2024-04-25T08:42:33.716185+0000","last_became_active":"2024-04-25T08:42:28.675765+0000","last_became_peered":"2024-04-25T08:42:28.675765+0000","last_unstale":"2024-04-25T08:42:33.716185+0000","last_undegraded":"2024-04-25T08:42:33.716185+0000","last_fullsized":"2024-04-25T08:42:33.716185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:31.845872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718240+0000","last_change":"2024-04-25T08:42:28.676274+0000","last_active":"2024-04-25T08:42:34.718240+0000","last_peered":"2024-04-25T08:42:34.718240+0000","last_clean":"2024-04-25T08:42:34.718240+0000","last_became_active":"2024-04-25T08:42:28.675935+0000","last_became_peered":"2024-04-25T08:42:28.675935+0000","last_unstale":"2024-04-25T08:42:34.718240+0000","last_undegraded":"2024-04-25T08:42:34.718240+0000","last_fullsized":"2024-04-25T08:42:34.718240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718466+0000","last_change":"2024-04-25T08:42:28.675277+0000","last_active":"2024-04-25T08:42:34.718466+0000","last_peered":"2024-04-25T08:42:34.718466+0000","last_clean":"2024-04-25T08:42:34.718466+0000","last_became_active":"2024-04-25T08:42:28.674998+0000","last_became_peered":"2024-04-25T08:42:28.674998+0000","last_unstale":"2024-04-25T08:42:34.718466+0000","last_undegraded":"2024-04-25T08:42:34.718466+0000","last_fullsized":"2024-04-25T08:42:34.718466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:25.796192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720546+0000","last_change":"2024-04-25T08:42:28.679479+0000","last_active":"2024-04-25T08:42:34.720546+0000","last_peered":"2024-04-25T08:42:34.720546+0000","last_clean":"2024-04-25T08:42:34.720546+0000","last_became_active":"2024-04-25T08:42:28.679202+0000","last_became_peered":"2024-04-25T08:42:28.679202+0000","last_unstale":"2024-04-25T08:42:34.720546+0000","last_undegraded":"2024-04-25T08:42:34.720546+0000","last_fullsized":"2024-04-25T08:42:34.720546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716781+0000","last_change":"2024-04-25T08:42:28.680700+0000","last_active":"2024-04-25T08:42:33.716781+0000","last_peered":"2024-04-25T08:42:33.716781+0000","last_clean":"2024-04-25T08:42:33.716781+0000","last_became_active":"2024-04-25T08:42:28.680363+0000","last_became_peered":"2024-04-25T08:42:28.680363+0000","last_unstale":"2024-04-25T08:42:33.716781+0000","last_undegraded":"2024-04-25T08:42:33.716781+0000","last_fullsized":"2024-04-25T08:42:33.716781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:12.180971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718922+0000","last_change":"2024-04-25T08:42:28.688063+0000","last_active":"2024-04-25T08:42:34.718922+0000","last_peered":"2024-04-25T08:42:34.718922+0000","last_clean":"2024-04-25T08:42:34.718922+0000","last_became_active":"2024-04-25T08:42:28.687786+0000","last_became_peered":"2024-04-25T08:42:28.687786+0000","last_unstale":"2024-04-25T08:42:34.718922+0000","last_undegraded":"2024-04-25T08:42:34.718922+0000","last_fullsized":"2024-04-25T08:42:34.718922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719162+0000","last_change":"2024-04-25T08:42:28.688118+0000","last_active":"2024-04-25T08:42:34.719162+0000","last_peered":"2024-04-25T08:42:34.719162+0000","last_clean":"2024-04-25T08:42:34.719162+0000","last_became_active":"2024-04-25T08:42:28.687841+0000","last_became_peered":"2024-04-25T08:42:28.687841+0000","last_unstale":"2024-04-25T08:42:34.719162+0000","last_undegraded":"2024-04-25T08:42:34.719162+0000","last_fullsized":"2024-04-25T08:42:34.719162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341962+0000","last_change":"2024-04-25T08:42:28.692587+0000","last_active":"2024-04-25T08:42:34.341962+0000","last_peered":"2024-04-25T08:42:34.341962+0000","last_clean":"2024-04-25T08:42:34.341962+0000","last_became_active":"2024-04-25T08:42:28.688599+0000","last_became_peered":"2024-04-25T08:42:28.688599+0000","last_unstale":"2024-04-25T08:42:34.341962+0000","last_undegraded":"2024-04-25T08:42:34.341962+0000","last_fullsized":"2024-04-25T08:42:34.341962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:03.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720561+0000","last_change":"2024-04-25T08:42:28.683857+0000","last_active":"2024-04-25T08:42:34.720561+0000","last_peered":"2024-04-25T08:42:34.720561+0000","last_clean":"2024-04-25T08:42:34.720561+0000","last_became_active":"2024-04-25T08:42:28.683465+0000","last_became_peered":"2024-04-25T08:42:28.683465+0000","last_unstale":"2024-04-25T08:42:34.720561+0000","last_undegraded":"2024-04-25T08:42:34.720561+0000","last_fullsized":"2024-04-25T08:42:34.720561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341299+0000","last_change":"2024-04-25T08:42:28.691863+0000","last_active":"2024-04-25T08:42:34.341299+0000","last_peered":"2024-04-25T08:42:34.341299+0000","last_clean":"2024-04-25T08:42:34.341299+0000","last_became_active":"2024-04-25T08:42:28.690583+0000","last_became_peered":"2024-04-25T08:42:28.690583+0000","last_unstale":"2024-04-25T08:42:34.341299+0000","last_undegraded":"2024-04-25T08:42:34.341299+0000","last_fullsized":"2024-04-25T08:42:34.341299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717427+0000","last_change":"2024-04-25T08:42:28.675349+0000","last_active":"2024-04-25T08:42:33.717427+0000","last_peered":"2024-04-25T08:42:33.717427+0000","last_clean":"2024-04-25T08:42:33.717427+0000","last_became_active":"2024-04-25T08:42:28.675000+0000","last_became_peered":"2024-04-25T08:42:28.675000+0000","last_unstale":"2024-04-25T08:42:33.717427+0000","last_undegraded":"2024-04-25T08:42:33.717427+0000","last_fullsized":"2024-04-25T08:42:33.717427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:55.477719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341365+0000","last_change":"2024-04-25T08:42:28.684750+0000","last_active":"2024-04-25T08:42:34.341365+0000","last_peered":"2024-04-25T08:42:34.341365+0000","last_clean":"2024-04-25T08:42:34.341365+0000","last_became_active":"2024-04-25T08:42:28.684463+0000","last_became_peered":"2024-04-25T08:42:28.684463+0000","last_unstale":"2024-04-25T08:42:34.341365+0000","last_undegraded":"2024-04-25T08:42:34.341365+0000","last_fullsized":"2024-04-25T08:42:34.341365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717827+0000","last_change":"2024-04-25T08:42:28.680160+0000","last_active":"2024-04-25T08:42:33.717827+0000","last_peered":"2024-04-25T08:42:33.717827+0000","last_clean":"2024-04-25T08:42:33.717827+0000","last_became_active":"2024-04-25T08:42:28.679868+0000","last_became_peered":"2024-04-25T08:42:28.679868+0000","last_unstale":"2024-04-25T08:42:33.717827+0000","last_undegraded":"2024-04-25T08:42:33.717827+0000","last_fullsized":"2024-04-25T08:42:33.717827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718100+0000","last_change":"2024-04-25T08:42:28.674768+0000","last_active":"2024-04-25T08:42:34.718100+0000","last_peered":"2024-04-25T08:42:34.718100+0000","last_clean":"2024-04-25T08:42:34.718100+0000","last_became_active":"2024-04-25T08:42:28.669240+0000","last_became_peered":"2024-04-25T08:42:28.669240+0000","last_unstale":"2024-04-25T08:42:34.718100+0000","last_undegraded":"2024-04-25T08:42:34.718100+0000","last_fullsized":"2024-04-25T08:42:34.718100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719515+0000","last_change":"2024-04-25T08:42:28.676190+0000","last_active":"2024-04-25T08:42:34.719515+0000","last_peered":"2024-04-25T08:42:34.719515+0000","last_clean":"2024-04-25T08:42:34.719515+0000","last_became_active":"2024-04-25T08:42:28.675895+0000","last_became_peered":"2024-04-25T08:42:28.675895+0000","last_unstale":"2024-04-25T08:42:34.719515+0000","last_undegraded":"2024-04-25T08:42:34.719515+0000","last_fullsized":"2024-04-25T08:42:34.719515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341862+0000","last_change":"2024-04-25T08:42:28.686275+0000","last_active":"2024-04-25T08:42:34.341862+0000","last_peered":"2024-04-25T08:42:34.341862+0000","last_clean":"2024-04-25T08:42:34.341862+0000","last_became_active":"2024-04-25T08:42:28.686029+0000","last_became_peered":"2024-04-25T08:42:28.686029+0000","last_unstale":"2024-04-25T08:42:34.341862+0000","last_undegraded":"2024-04-25T08:42:34.341862+0000","last_fullsized":"2024-04-25T08:42:34.341862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:55.477719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:42:53.320 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:42:53.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.460+0000 7f3f49dab640 1 Processor -- start 2024-04-25T08:42:53.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.460+0000 7f3f49dab640 1 -- start start 2024-04-25T08:42:53.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f49dab640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3f4415dc90 0x7f3f441625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f49dab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f440d1810 0x7f3f440d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f49dab640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f440cce50 con 0x7f3f440cc8e0 2024-04-25T08:42:53.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f49dab640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f440d21c0 con 0x7f3f4415dc90 2024-04-25T08:42:53.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f49dab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44161af0 con 0x7f3f440d1810 2024-04-25T08:42:53.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f43fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f440d1810 0x7f3f440d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f437fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3f4415dc90 0x7f3f441625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f437fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3f4415dc90 0x7f3f441625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:40580/0 (socket says 172.21.15.172:40580) 2024-04-25T08:42:53.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f437fe640 1 -- 172.21.15.172:0/1516416608 learned_addr learned my addr 172.21.15.172:0/1516416608 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:53.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f42ffd640 1 --1- 172.21.15.172:0/1516416608 >> v1:172.21.15.186:6789/0 conn(0x7f3f440cc8e0 0x7f3f4415ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:54970/0 (socket says 172.21.15.172:54970) 2024-04-25T08:42:53.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f437fe640 1 -- 172.21.15.172:0/1516416608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f440d1810 msgr2=0x7f3f440d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:53.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f437fe640 1 --2- 172.21.15.172:0/1516416608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f440d1810 0x7f3f440d1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f437fe640 1 -- 172.21.15.172:0/1516416608 >> v1:172.21.15.186:6789/0 conn(0x7f3f440cc8e0 legacy=0x7f3f4415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.461+0000 7f3f437fe640 1 -- 172.21.15.172:0/1516416608 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44161dd0 con 0x7f3f4415dc90 2024-04-25T08:42:53.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.462+0000 7f3f437fe640 1 --2- 172.21.15.172:0/1516416608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f4415dc90 0x7f3f441625d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009870 tx=0x7f3f3402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=851800e9c16a140f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:53.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.462+0000 7f3f427fc640 1 -- 172.21.15.172:0/1516416608 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34037070 con 0x7f3f4415dc90 2024-04-25T08:42:53.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.462+0000 7f3f427fc640 1 -- 172.21.15.172:0/1516416608 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34032440 con 0x7f3f4415dc90 2024-04-25T08:42:53.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.462+0000 7f3f427fc640 1 -- 172.21.15.172:0/1516416608 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34032810 con 0x7f3f4415dc90 2024-04-25T08:42:53.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.463+0000 7f3f49dab640 1 -- 172.21.15.172:0/1516416608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f4415dc90 msgr2=0x7f3f441625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.463+0000 7f3f49dab640 1 --2- 172.21.15.172:0/1516416608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f4415dc90 0x7f3f441625d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009870 tx=0x7f3f3402a1c0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.463+0000 7f3f49dab640 1 -- 172.21.15.172:0/1516416608 shutdown_connections 2024-04-25T08:42:53.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.463+0000 7f3f49dab640 1 --2- 172.21.15.172:0/1516416608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f440d1810 0x7f3f440d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.463+0000 7f3f49dab640 1 --2- 172.21.15.172:0/1516416608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f4415dc90 0x7f3f441625d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.463+0000 7f3f49dab640 1 -- 172.21.15.172:0/1516416608 >> 172.21.15.172:0/1516416608 conn(0x7f3f4406f590 msgr2=0x7f3f4406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:53.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.463+0000 7f3f49dab640 1 -- 172.21.15.172:0/1516416608 shutdown_connections 2024-04-25T08:42:53.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.463+0000 7f3f49dab640 1 -- 172.21.15.172:0/1516416608 wait complete. 2024-04-25T08:42:53.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.464+0000 7f3f49dab640 1 Processor -- start 2024-04-25T08:42:53.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.464+0000 7f3f49dab640 1 -- start start 2024-04-25T08:42:53.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f49dab640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f440cc8e0 0x7f3f440c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f49dab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f440d1810 0x7f3f441556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f49dab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f4415dc90 0x7f3f440d0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f49dab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4415e070 con 0x7f3f4415dc90 2024-04-25T08:42:53.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f49dab640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440cd130 con 0x7f3f440cc8e0 2024-04-25T08:42:53.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f49dab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4415e1f0 con 0x7f3f440d1810 2024-04-25T08:42:53.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f43fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f4415dc90 0x7f3f440d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f43fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f4415dc90 0x7f3f440d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50714/0 (socket says 172.21.15.172:50714) 2024-04-25T08:42:53.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f43fff640 1 -- 172.21.15.172:0/39908379 learned_addr learned my addr 172.21.15.172:0/39908379 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:53.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f437fe640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f440cc8e0 0x7f3f440c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f42ffd640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f440d1810 0x7f3f441556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f43fff640 1 -- 172.21.15.172:0/39908379 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f440d1810 msgr2=0x7f3f441556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f43fff640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f440d1810 0x7f3f441556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f43fff640 1 -- 172.21.15.172:0/39908379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f440cc8e0 msgr2=0x7f3f440c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f43fff640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f440cc8e0 0x7f3f440c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.465+0000 7f3f43fff640 1 -- 172.21.15.172:0/39908379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440c7210 con 0x7f3f4415dc90 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.466+0000 7f3f43fff640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f4415dc90 0x7f3f440d0480 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00efc0 tx=0x7f3f3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.466+0000 7f3f2bfff640 1 -- 172.21.15.172:0/39908379 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c018020 con 0x7f3f4415dc90 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.466+0000 7f3f2bfff640 1 -- 172.21.15.172:0/39908379 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c009b10 con 0x7f3f4415dc90 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.466+0000 7f3f49dab640 1 -- 172.21.15.172:0/39908379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f440c74f0 con 0x7f3f4415dc90 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.466+0000 7f3f2bfff640 1 -- 172.21.15.172:0/39908379 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0146c0 con 0x7f3f4415dc90 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.466+0000 7f3f49dab640 1 -- 172.21.15.172:0/39908379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f440c7ab0 con 0x7f3f4415dc90 2024-04-25T08:42:53.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.467+0000 7f3f49dab640 1 -- 172.21.15.172:0/39908379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f44073990 con 0x7f3f4415dc90 2024-04-25T08:42:53.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.467+0000 7f3f2bfff640 1 -- 172.21.15.172:0/39908379 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3f3c005d10 con 0x7f3f4415dc90 2024-04-25T08:42:53.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.468+0000 7f3f2bfff640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3006b4d0 0x7f3f3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.468+0000 7f3f2bfff640 1 -- 172.21.15.172:0/39908379 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3f3c08b260 con 0x7f3f4415dc90 2024-04-25T08:42:53.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.468+0000 7f3f437fe640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3006b4d0 0x7f3f3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.468+0000 7f3f437fe640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3006b4d0 0x7f3f3006d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f34034000 tx=0x7f3f3402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:53.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.472+0000 7f3f2bfff640 1 -- 172.21.15.172:0/39908379 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3f3c022030 con 0x7f3f4415dc90 2024-04-25T08:42:53.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.638+0000 7f3f49dab640 1 -- 172.21.15.172:0/39908379 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f440cf6b0 con 0x7f3f3006b4d0 2024-04-25T08:42:53.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.645+0000 7f3f2bfff640 1 -- 172.21.15.172:0/39908379 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332534 (secure 0 0 0) 0x7f3f440cf6b0 con 0x7f3f3006b4d0 2024-04-25T08:42:53.641 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:53.643 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:42:53.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.648+0000 7f3f49dab640 1 -- 172.21.15.172:0/39908379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3006b4d0 msgr2=0x7f3f3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.648+0000 7f3f49dab640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3006b4d0 0x7f3f3006d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f34034000 tx=0x7f3f3402e000 comp rx=0 tx=0).stop 2024-04-25T08:42:53.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.648+0000 7f3f49dab640 1 -- 172.21.15.172:0/39908379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f4415dc90 msgr2=0x7f3f440d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.648+0000 7f3f49dab640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f4415dc90 0x7f3f440d0480 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00efc0 tx=0x7f3f3c00c490 comp rx=0 tx=0).stop 2024-04-25T08:42:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.648+0000 7f3f49dab640 1 -- 172.21.15.172:0/39908379 shutdown_connections 2024-04-25T08:42:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.648+0000 7f3f49dab640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f3006b4d0 0x7f3f3006d990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.648+0000 7f3f49dab640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f4415dc90 0x7f3f440d0480 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.648+0000 7f3f49dab640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f440d1810 0x7f3f441556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.648+0000 7f3f49dab640 1 --2- 172.21.15.172:0/39908379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f440cc8e0 0x7f3f440c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.648+0000 7f3f49dab640 1 -- 172.21.15.172:0/39908379 >> 172.21.15.172:0/39908379 conn(0x7f3f4406f590 msgr2=0x7f3f4415b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.649+0000 7f3f49dab640 1 -- 172.21.15.172:0/39908379 shutdown_connections 2024-04-25T08:42:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.649+0000 7f3f49dab640 1 -- 172.21.15.172:0/39908379 wait complete. 2024-04-25T08:42:53.652 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-25T08:42:52.517475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002874"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718621+0000","last_change":"2024-04-25T08:42:27.663913+0000","last_active":"2024-04-25T08:42:34.718621+0000","last_peered":"2024-04-25T08:42:34.718621+0000","last_clean":"2024-04-25T08:42:34.718621+0000","last_became_active":"2024-04-25T08:42:27.663206+0000","last_became_peered":"2024-04-25T08:42:27.663206+0000","last_unstale":"2024-04-25T08:42:34.718621+0000","last_undegraded":"2024-04-25T08:42:34.718621+0000","last_fullsized":"2024-04-25T08:42:34.718621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:08.095908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720030+0000","last_change":"2024-04-25T08:42:28.679929+0000","last_active":"2024-04-25T08:42:34.720030+0000","last_peered":"2024-04-25T08:42:34.720030+0000","last_clean":"2024-04-25T08:42:34.720030+0000","last_became_active":"2024-04-25T08:42:28.679533+0000","last_became_peered":"2024-04-25T08:42:28.679533+0000","last_unstale":"2024-04-25T08:42:34.720030+0000","last_undegraded":"2024-04-25T08:42:34.720030+0000","last_fullsized":"2024-04-25T08:42:34.720030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719823+0000","last_change":"2024-04-25T08:42:32.775785+0000","last_active":"2024-04-25T08:42:34.719823+0000","last_peered":"2024-04-25T08:42:34.719823+0000","last_clean":"2024-04-25T08:42:34.719823+0000","last_became_active":"2024-04-25T08:42:32.775418+0000","last_became_peered":"2024-04-25T08:42:32.775418+0000","last_unstale":"2024-04-25T08:42:34.719823+0000","last_undegraded":"2024-04-25T08:42:34.719823+0000","last_fullsized":"2024-04-25T08:42:34.719823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:16.973550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720238+0000","last_change":"2024-04-25T08:42:27.669510+0000","last_active":"2024-04-25T08:42:34.720238+0000","last_peered":"2024-04-25T08:42:34.720238+0000","last_clean":"2024-04-25T08:42:34.720238+0000","last_became_active":"2024-04-25T08:42:27.669194+0000","last_became_peered":"2024-04-25T08:42:27.669194+0000","last_unstale":"2024-04-25T08:42:34.720238+0000","last_undegraded":"2024-04-25T08:42:34.720238+0000","last_fullsized":"2024-04-25T08:42:34.720238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:43.313642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718181+0000","last_change":"2024-04-25T08:42:28.678584+0000","last_active":"2024-04-25T08:42:34.718181+0000","last_peered":"2024-04-25T08:42:34.718181+0000","last_clean":"2024-04-25T08:42:34.718181+0000","last_became_active":"2024-04-25T08:42:28.677636+0000","last_became_peered":"2024-04-25T08:42:28.677636+0000","last_unstale":"2024-04-25T08:42:34.718181+0000","last_undegraded":"2024-04-25T08:42:34.718181+0000","last_fullsized":"2024-04-25T08:42:34.718181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716151+0000","last_change":"2024-04-25T08:42:32.710347+0000","last_active":"2024-04-25T08:42:33.716151+0000","last_peered":"2024-04-25T08:42:33.716151+0000","last_clean":"2024-04-25T08:42:33.716151+0000","last_became_active":"2024-04-25T08:42:32.709855+0000","last_became_peered":"2024-04-25T08:42:32.709855+0000","last_unstale":"2024-04-25T08:42:33.716151+0000","last_undegraded":"2024-04-25T08:42:33.716151+0000","last_fullsized":"2024-04-25T08:42:33.716151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:17.497098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341696+0000","last_change":"2024-04-25T08:42:27.667761+0000","last_active":"2024-04-25T08:42:34.341696+0000","last_peered":"2024-04-25T08:42:34.341696+0000","last_clean":"2024-04-25T08:42:34.341696+0000","last_became_active":"2024-04-25T08:42:27.667504+0000","last_became_peered":"2024-04-25T08:42:27.667504+0000","last_unstale":"2024-04-25T08:42:34.341696+0000","last_undegraded":"2024-04-25T08:42:34.341696+0000","last_fullsized":"2024-04-25T08:42:34.341696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:11.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717960+0000","last_change":"2024-04-25T08:42:28.679617+0000","last_active":"2024-04-25T08:42:33.717960+0000","last_peered":"2024-04-25T08:42:33.717960+0000","last_clean":"2024-04-25T08:42:33.717960+0000","last_became_active":"2024-04-25T08:42:28.677547+0000","last_became_peered":"2024-04-25T08:42:28.677547+0000","last_unstale":"2024-04-25T08:42:33.717960+0000","last_undegraded":"2024-04-25T08:42:33.717960+0000","last_fullsized":"2024-04-25T08:42:33.717960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716871+0000","last_change":"2024-04-25T08:42:32.715254+0000","last_active":"2024-04-25T08:42:33.716871+0000","last_peered":"2024-04-25T08:42:33.716871+0000","last_clean":"2024-04-25T08:42:33.716871+0000","last_became_active":"2024-04-25T08:42:32.714553+0000","last_became_peered":"2024-04-25T08:42:32.714553+0000","last_unstale":"2024-04-25T08:42:33.716871+0000","last_undegraded":"2024-04-25T08:42:33.716871+0000","last_fullsized":"2024-04-25T08:42:33.716871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:02.361047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341492+0000","last_change":"2024-04-25T08:42:27.669362+0000","last_active":"2024-04-25T08:42:34.341492+0000","last_peered":"2024-04-25T08:42:34.341492+0000","last_clean":"2024-04-25T08:42:34.341492+0000","last_became_active":"2024-04-25T08:42:27.669047+0000","last_became_peered":"2024-04-25T08:42:27.669047+0000","last_unstale":"2024-04-25T08:42:34.341492+0000","last_undegraded":"2024-04-25T08:42:34.341492+0000","last_fullsized":"2024-04-25T08:42:34.341492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:24.034481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718067+0000","last_change":"2024-04-25T08:42:28.676280+0000","last_active":"2024-04-25T08:42:33.718067+0000","last_peered":"2024-04-25T08:42:33.718067+0000","last_clean":"2024-04-25T08:42:33.718067+0000","last_became_active":"2024-04-25T08:42:28.676008+0000","last_became_peered":"2024-04-25T08:42:28.676008+0000","last_unstale":"2024-04-25T08:42:33.718067+0000","last_undegraded":"2024-04-25T08:42:33.718067+0000","last_fullsized":"2024-04-25T08:42:33.718067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716251+0000","last_change":"2024-04-25T08:42:32.702185+0000","last_active":"2024-04-25T08:42:33.716251+0000","last_peered":"2024-04-25T08:42:33.716251+0000","last_clean":"2024-04-25T08:42:33.716251+0000","last_became_active":"2024-04-25T08:42:32.701758+0000","last_became_peered":"2024-04-25T08:42:32.701758+0000","last_unstale":"2024-04-25T08:42:33.716251+0000","last_undegraded":"2024-04-25T08:42:33.716251+0000","last_fullsized":"2024-04-25T08:42:33.716251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:49.319348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718505+0000","last_change":"2024-04-25T08:42:28.687237+0000","last_active":"2024-04-25T08:42:34.718505+0000","last_peered":"2024-04-25T08:42:34.718505+0000","last_clean":"2024-04-25T08:42:34.718505+0000","last_became_active":"2024-04-25T08:42:28.686009+0000","last_became_peered":"2024-04-25T08:42:28.686009+0000","last_unstale":"2024-04-25T08:42:34.718505+0000","last_undegraded":"2024-04-25T08:42:34.718505+0000","last_fullsized":"2024-04-25T08:42:34.718505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341503+0000","last_change":"2024-04-25T08:42:27.666906+0000","last_active":"2024-04-25T08:42:34.341503+0000","last_peered":"2024-04-25T08:42:34.341503+0000","last_clean":"2024-04-25T08:42:34.341503+0000","last_became_active":"2024-04-25T08:42:27.666643+0000","last_became_peered":"2024-04-25T08:42:27.666643+0000","last_unstale":"2024-04-25T08:42:34.341503+0000","last_undegraded":"2024-04-25T08:42:34.341503+0000","last_fullsized":"2024-04-25T08:42:34.341503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716980+0000","last_change":"2024-04-25T08:42:32.711169+0000","last_active":"2024-04-25T08:42:33.716980+0000","last_peered":"2024-04-25T08:42:33.716980+0000","last_clean":"2024-04-25T08:42:33.716980+0000","last_became_active":"2024-04-25T08:42:32.710192+0000","last_became_peered":"2024-04-25T08:42:32.710192+0000","last_unstale":"2024-04-25T08:42:33.716980+0000","last_undegraded":"2024-04-25T08:42:33.716980+0000","last_fullsized":"2024-04-25T08:42:33.716980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:41.910425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720554+0000","last_change":"2024-04-25T08:42:28.672389+0000","last_active":"2024-04-25T08:42:34.720554+0000","last_peered":"2024-04-25T08:42:34.720554+0000","last_clean":"2024-04-25T08:42:34.720554+0000","last_became_active":"2024-04-25T08:42:28.672116+0000","last_became_peered":"2024-04-25T08:42:28.672116+0000","last_unstale":"2024-04-25T08:42:34.720554+0000","last_undegraded":"2024-04-25T08:42:34.720554+0000","last_fullsized":"2024-04-25T08:42:34.720554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719572+0000","last_change":"2024-04-25T08:42:27.669517+0000","last_active":"2024-04-25T08:42:34.719572+0000","last_peered":"2024-04-25T08:42:34.719572+0000","last_clean":"2024-04-25T08:42:34.719572+0000","last_became_active":"2024-04-25T08:42:27.669240+0000","last_became_peered":"2024-04-25T08:42:27.669240+0000","last_unstale":"2024-04-25T08:42:34.719572+0000","last_undegraded":"2024-04-25T08:42:34.719572+0000","last_fullsized":"2024-04-25T08:42:34.719572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717062+0000","last_change":"2024-04-25T08:42:32.710857+0000","last_active":"2024-04-25T08:42:33.717062+0000","last_peered":"2024-04-25T08:42:33.717062+0000","last_clean":"2024-04-25T08:42:33.717062+0000","last_became_active":"2024-04-25T08:42:32.709737+0000","last_became_peered":"2024-04-25T08:42:32.709737+0000","last_unstale":"2024-04-25T08:42:33.717062+0000","last_undegraded":"2024-04-25T08:42:33.717062+0000","last_fullsized":"2024-04-25T08:42:33.717062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:48.222965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720874+0000","last_change":"2024-04-25T08:42:28.672212+0000","last_active":"2024-04-25T08:42:34.720874+0000","last_peered":"2024-04-25T08:42:34.720874+0000","last_clean":"2024-04-25T08:42:34.720874+0000","last_became_active":"2024-04-25T08:42:28.671893+0000","last_became_peered":"2024-04-25T08:42:28.671893+0000","last_unstale":"2024-04-25T08:42:34.720874+0000","last_undegraded":"2024-04-25T08:42:34.720874+0000","last_fullsized":"2024-04-25T08:42:34.720874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718326+0000","last_change":"2024-04-25T08:42:27.662789+0000","last_active":"2024-04-25T08:42:34.718326+0000","last_peered":"2024-04-25T08:42:34.718326+0000","last_clean":"2024-04-25T08:42:34.718326+0000","last_became_active":"2024-04-25T08:42:27.662490+0000","last_became_peered":"2024-04-25T08:42:27.662490+0000","last_unstale":"2024-04-25T08:42:34.718326+0000","last_undegraded":"2024-04-25T08:42:34.718326+0000","last_fullsized":"2024-04-25T08:42:34.718326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719021+0000","last_change":"2024-04-25T08:42:32.773797+0000","last_active":"2024-04-25T08:42:34.719021+0000","last_peered":"2024-04-25T08:42:34.719021+0000","last_clean":"2024-04-25T08:42:34.719021+0000","last_became_active":"2024-04-25T08:42:32.772850+0000","last_became_peered":"2024-04-25T08:42:32.772850+0000","last_unstale":"2024-04-25T08:42:34.719021+0000","last_undegraded":"2024-04-25T08:42:34.719021+0000","last_fullsized":"2024-04-25T08:42:34.719021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716595+0000","last_change":"2024-04-25T08:42:28.670256+0000","last_active":"2024-04-25T08:42:33.716595+0000","last_peered":"2024-04-25T08:42:33.716595+0000","last_clean":"2024-04-25T08:42:33.716595+0000","last_became_active":"2024-04-25T08:42:28.669544+0000","last_became_peered":"2024-04-25T08:42:28.669544+0000","last_unstale":"2024-04-25T08:42:33.716595+0000","last_undegraded":"2024-04-25T08:42:33.716595+0000","last_fullsized":"2024-04-25T08:42:33.716595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:56.767579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341156+0000","last_change":"2024-04-25T08:42:27.666339+0000","last_active":"2024-04-25T08:42:34.341156+0000","last_peered":"2024-04-25T08:42:34.341156+0000","last_clean":"2024-04-25T08:42:34.341156+0000","last_became_active":"2024-04-25T08:42:27.665968+0000","last_became_peered":"2024-04-25T08:42:27.665968+0000","last_unstale":"2024-04-25T08:42:34.341156+0000","last_undegraded":"2024-04-25T08:42:34.341156+0000","last_fullsized":"2024-04-25T08:42:34.341156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716958+0000","last_change":"2024-04-25T08:42:32.716309+0000","last_active":"2024-04-25T08:42:33.716958+0000","last_peered":"2024-04-25T08:42:33.716958+0000","last_clean":"2024-04-25T08:42:33.716958+0000","last_became_active":"2024-04-25T08:42:32.715869+0000","last_became_peered":"2024-04-25T08:42:32.715869+0000","last_unstale":"2024-04-25T08:42:33.716958+0000","last_undegraded":"2024-04-25T08:42:33.716958+0000","last_fullsized":"2024-04-25T08:42:33.716958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:42.194257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718628+0000","last_change":"2024-04-25T08:42:28.671623+0000","last_active":"2024-04-25T08:42:34.718628+0000","last_peered":"2024-04-25T08:42:34.718628+0000","last_clean":"2024-04-25T08:42:34.718628+0000","last_became_active":"2024-04-25T08:42:28.671330+0000","last_became_peered":"2024-04-25T08:42:28.671330+0000","last_unstale":"2024-04-25T08:42:34.718628+0000","last_undegraded":"2024-04-25T08:42:34.718628+0000","last_fullsized":"2024-04-25T08:42:34.718628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719273+0000","last_change":"2024-04-25T08:42:27.662946+0000","last_active":"2024-04-25T08:42:34.719273+0000","last_peered":"2024-04-25T08:42:34.719273+0000","last_clean":"2024-04-25T08:42:34.719273+0000","last_became_active":"2024-04-25T08:42:27.662661+0000","last_became_peered":"2024-04-25T08:42:27.662661+0000","last_unstale":"2024-04-25T08:42:34.719273+0000","last_undegraded":"2024-04-25T08:42:34.719273+0000","last_fullsized":"2024-04-25T08:42:34.719273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716252+0000","last_change":"2024-04-25T08:42:32.773209+0000","last_active":"2024-04-25T08:42:33.716252+0000","last_peered":"2024-04-25T08:42:33.716252+0000","last_clean":"2024-04-25T08:42:33.716252+0000","last_became_active":"2024-04-25T08:42:32.772788+0000","last_became_peered":"2024-04-25T08:42:32.772788+0000","last_unstale":"2024-04-25T08:42:33.716252+0000","last_undegraded":"2024-04-25T08:42:33.716252+0000","last_fullsized":"2024-04-25T08:42:33.716252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:59.766748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720324+0000","last_change":"2024-04-25T08:42:28.681466+0000","last_active":"2024-04-25T08:42:34.720324+0000","last_peered":"2024-04-25T08:42:34.720324+0000","last_clean":"2024-04-25T08:42:34.720324+0000","last_became_active":"2024-04-25T08:42:28.681184+0000","last_became_peered":"2024-04-25T08:42:28.681184+0000","last_unstale":"2024-04-25T08:42:34.720324+0000","last_undegraded":"2024-04-25T08:42:34.720324+0000","last_fullsized":"2024-04-25T08:42:34.720324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719545+0000","last_change":"2024-04-25T08:42:27.663837+0000","last_active":"2024-04-25T08:42:34.719545+0000","last_peered":"2024-04-25T08:42:34.719545+0000","last_clean":"2024-04-25T08:42:34.719545+0000","last_became_active":"2024-04-25T08:42:27.663542+0000","last_became_peered":"2024-04-25T08:42:27.663542+0000","last_unstale":"2024-04-25T08:42:34.719545+0000","last_undegraded":"2024-04-25T08:42:34.719545+0000","last_fullsized":"2024-04-25T08:42:34.719545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720453+0000","last_change":"2024-04-25T08:42:32.773738+0000","last_active":"2024-04-25T08:42:34.720453+0000","last_peered":"2024-04-25T08:42:34.720453+0000","last_clean":"2024-04-25T08:42:34.720453+0000","last_became_active":"2024-04-25T08:42:32.773337+0000","last_became_peered":"2024-04-25T08:42:32.773337+0000","last_unstale":"2024-04-25T08:42:34.720453+0000","last_undegraded":"2024-04-25T08:42:34.720453+0000","last_fullsized":"2024-04-25T08:42:34.720453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:24.829343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719414+0000","last_change":"2024-04-25T08:42:28.672285+0000","last_active":"2024-04-25T08:42:34.719414+0000","last_peered":"2024-04-25T08:42:34.719414+0000","last_clean":"2024-04-25T08:42:34.719414+0000","last_became_active":"2024-04-25T08:42:28.672041+0000","last_became_peered":"2024-04-25T08:42:28.672041+0000","last_unstale":"2024-04-25T08:42:34.719414+0000","last_undegraded":"2024-04-25T08:42:34.719414+0000","last_fullsized":"2024-04-25T08:42:34.719414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341853+0000","last_change":"2024-04-25T08:42:27.665607+0000","last_active":"2024-04-25T08:42:34.341853+0000","last_peered":"2024-04-25T08:42:34.341853+0000","last_clean":"2024-04-25T08:42:34.341853+0000","last_became_active":"2024-04-25T08:42:27.664407+0000","last_became_peered":"2024-04-25T08:42:27.664407+0000","last_unstale":"2024-04-25T08:42:34.341853+0000","last_undegraded":"2024-04-25T08:42:34.341853+0000","last_fullsized":"2024-04-25T08:42:34.341853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.628103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718135+0000","last_change":"2024-04-25T08:42:32.773268+0000","last_active":"2024-04-25T08:42:34.718135+0000","last_peered":"2024-04-25T08:42:34.718135+0000","last_clean":"2024-04-25T08:42:34.718135+0000","last_became_active":"2024-04-25T08:42:32.772863+0000","last_became_peered":"2024-04-25T08:42:32.772863+0000","last_unstale":"2024-04-25T08:42:34.718135+0000","last_undegraded":"2024-04-25T08:42:34.718135+0000","last_fullsized":"2024-04-25T08:42:34.718135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718190+0000","last_change":"2024-04-25T08:42:28.680636+0000","last_active":"2024-04-25T08:42:33.718190+0000","last_peered":"2024-04-25T08:42:33.718190+0000","last_clean":"2024-04-25T08:42:33.718190+0000","last_became_active":"2024-04-25T08:42:28.680378+0000","last_became_peered":"2024-04-25T08:42:28.680378+0000","last_unstale":"2024-04-25T08:42:33.718190+0000","last_undegraded":"2024-04-25T08:42:33.718190+0000","last_fullsized":"2024-04-25T08:42:33.718190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719445+0000","last_change":"2024-04-25T08:42:27.659419+0000","last_active":"2024-04-25T08:42:34.719445+0000","last_peered":"2024-04-25T08:42:34.719445+0000","last_clean":"2024-04-25T08:42:34.719445+0000","last_became_active":"2024-04-25T08:42:27.657839+0000","last_became_peered":"2024-04-25T08:42:27.657839+0000","last_unstale":"2024-04-25T08:42:34.719445+0000","last_undegraded":"2024-04-25T08:42:34.719445+0000","last_fullsized":"2024-04-25T08:42:34.719445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719161+0000","last_change":"2024-04-25T08:42:32.711534+0000","last_active":"2024-04-25T08:42:34.719161+0000","last_peered":"2024-04-25T08:42:34.719161+0000","last_clean":"2024-04-25T08:42:34.719161+0000","last_became_active":"2024-04-25T08:42:32.709615+0000","last_became_peered":"2024-04-25T08:42:32.709615+0000","last_unstale":"2024-04-25T08:42:34.719161+0000","last_undegraded":"2024-04-25T08:42:34.719161+0000","last_fullsized":"2024-04-25T08:42:34.719161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:50.447473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717233+0000","last_change":"2024-04-25T08:42:28.675371+0000","last_active":"2024-04-25T08:42:33.717233+0000","last_peered":"2024-04-25T08:42:33.717233+0000","last_clean":"2024-04-25T08:42:33.717233+0000","last_became_active":"2024-04-25T08:42:28.675078+0000","last_became_peered":"2024-04-25T08:42:28.675078+0000","last_unstale":"2024-04-25T08:42:33.717233+0000","last_undegraded":"2024-04-25T08:42:33.717233+0000","last_fullsized":"2024-04-25T08:42:33.717233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:45.680776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717778+0000","last_change":"2024-04-25T08:42:27.663976+0000","last_active":"2024-04-25T08:42:33.717778+0000","last_peered":"2024-04-25T08:42:33.717778+0000","last_clean":"2024-04-25T08:42:33.717778+0000","last_became_active":"2024-04-25T08:42:27.663254+0000","last_became_peered":"2024-04-25T08:42:27.663254+0000","last_unstale":"2024-04-25T08:42:33.717778+0000","last_undegraded":"2024-04-25T08:42:33.717778+0000","last_fullsized":"2024-04-25T08:42:33.717778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719384+0000","last_change":"2024-04-25T08:42:32.712637+0000","last_active":"2024-04-25T08:42:34.719384+0000","last_peered":"2024-04-25T08:42:34.719384+0000","last_clean":"2024-04-25T08:42:34.719384+0000","last_became_active":"2024-04-25T08:42:32.712245+0000","last_became_peered":"2024-04-25T08:42:32.712245+0000","last_unstale":"2024-04-25T08:42:34.719384+0000","last_undegraded":"2024-04-25T08:42:34.719384+0000","last_fullsized":"2024-04-25T08:42:34.719384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:59.518802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719010+0000","last_change":"2024-04-25T08:42:28.673163+0000","last_active":"2024-04-25T08:42:34.719010+0000","last_peered":"2024-04-25T08:42:34.719010+0000","last_clean":"2024-04-25T08:42:34.719010+0000","last_became_active":"2024-04-25T08:42:28.672866+0000","last_became_peered":"2024-04-25T08:42:28.672866+0000","last_unstale":"2024-04-25T08:42:34.719010+0000","last_undegraded":"2024-04-25T08:42:34.719010+0000","last_fullsized":"2024-04-25T08:42:34.719010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714151+0000","last_change":"2024-04-25T08:42:27.665216+0000","last_active":"2024-04-25T08:42:33.714151+0000","last_peered":"2024-04-25T08:42:33.714151+0000","last_clean":"2024-04-25T08:42:33.714151+0000","last_became_active":"2024-04-25T08:42:27.664871+0000","last_became_peered":"2024-04-25T08:42:27.664871+0000","last_unstale":"2024-04-25T08:42:33.714151+0000","last_undegraded":"2024-04-25T08:42:33.714151+0000","last_fullsized":"2024-04-25T08:42:33.714151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:43.313642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719177+0000","last_change":"2024-04-25T08:42:32.708236+0000","last_active":"2024-04-25T08:42:34.719177+0000","last_peered":"2024-04-25T08:42:34.719177+0000","last_clean":"2024-04-25T08:42:34.719177+0000","last_became_active":"2024-04-25T08:42:32.707821+0000","last_became_peered":"2024-04-25T08:42:32.707821+0000","last_unstale":"2024-04-25T08:42:34.719177+0000","last_undegraded":"2024-04-25T08:42:34.719177+0000","last_fullsized":"2024-04-25T08:42:34.719177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:58.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.717992+0000","last_change":"2024-04-25T08:42:28.674649+0000","last_active":"2024-04-25T08:42:34.717992+0000","last_peered":"2024-04-25T08:42:34.717992+0000","last_clean":"2024-04-25T08:42:34.717992+0000","last_became_active":"2024-04-25T08:42:28.671414+0000","last_became_peered":"2024-04-25T08:42:28.671414+0000","last_unstale":"2024-04-25T08:42:34.717992+0000","last_undegraded":"2024-04-25T08:42:34.717992+0000","last_fullsized":"2024-04-25T08:42:34.717992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:16.974552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341186+0000","last_change":"2024-04-25T08:42:27.665689+0000","last_active":"2024-04-25T08:42:34.341186+0000","last_peered":"2024-04-25T08:42:34.341186+0000","last_clean":"2024-04-25T08:42:34.341186+0000","last_became_active":"2024-04-25T08:42:27.664957+0000","last_became_peered":"2024-04-25T08:42:27.664957+0000","last_unstale":"2024-04-25T08:42:34.341186+0000","last_undegraded":"2024-04-25T08:42:34.341186+0000","last_fullsized":"2024-04-25T08:42:34.341186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718502+0000","last_change":"2024-04-25T08:42:32.775658+0000","last_active":"2024-04-25T08:42:34.718502+0000","last_peered":"2024-04-25T08:42:34.718502+0000","last_clean":"2024-04-25T08:42:34.718502+0000","last_became_active":"2024-04-25T08:42:32.775292+0000","last_became_peered":"2024-04-25T08:42:32.775292+0000","last_unstale":"2024-04-25T08:42:34.718502+0000","last_undegraded":"2024-04-25T08:42:34.718502+0000","last_fullsized":"2024-04-25T08:42:34.718502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:59.518802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719571+0000","last_change":"2024-04-25T08:42:28.677751+0000","last_active":"2024-04-25T08:42:34.719571+0000","last_peered":"2024-04-25T08:42:34.719571+0000","last_clean":"2024-04-25T08:42:34.719571+0000","last_became_active":"2024-04-25T08:42:28.677457+0000","last_became_peered":"2024-04-25T08:42:28.677457+0000","last_unstale":"2024-04-25T08:42:34.719571+0000","last_undegraded":"2024-04-25T08:42:34.719571+0000","last_fullsized":"2024-04-25T08:42:34.719571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717550+0000","last_change":"2024-04-25T08:42:27.657212+0000","last_active":"2024-04-25T08:42:33.717550+0000","last_peered":"2024-04-25T08:42:33.717550+0000","last_clean":"2024-04-25T08:42:33.717550+0000","last_became_active":"2024-04-25T08:42:27.656883+0000","last_became_peered":"2024-04-25T08:42:27.656883+0000","last_unstale":"2024-04-25T08:42:33.717550+0000","last_undegraded":"2024-04-25T08:42:33.717550+0000","last_fullsized":"2024-04-25T08:42:33.717550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341308+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:42:34.341308+0000","last_peered":"2024-04-25T08:42:34.341308+0000","last_clean":"2024-04-25T08:42:34.341308+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:42:34.341308+0000","last_undegraded":"2024-04-25T08:42:34.341308+0000","last_fullsized":"2024-04-25T08:42:34.341308+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718667+0000","last_change":"2024-04-25T08:42:32.776301+0000","last_active":"2024-04-25T08:42:34.718667+0000","last_peered":"2024-04-25T08:42:34.718667+0000","last_clean":"2024-04-25T08:42:34.718667+0000","last_became_active":"2024-04-25T08:42:32.775904+0000","last_became_peered":"2024-04-25T08:42:32.775904+0000","last_unstale":"2024-04-25T08:42:34.718667+0000","last_undegraded":"2024-04-25T08:42:34.718667+0000","last_fullsized":"2024-04-25T08:42:34.718667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341570+0000","last_change":"2024-04-25T08:42:28.692829+0000","last_active":"2024-04-25T08:42:34.341570+0000","last_peered":"2024-04-25T08:42:34.341570+0000","last_clean":"2024-04-25T08:42:34.341570+0000","last_became_active":"2024-04-25T08:42:28.690838+0000","last_became_peered":"2024-04-25T08:42:28.690838+0000","last_unstale":"2024-04-25T08:42:34.341570+0000","last_undegraded":"2024-04-25T08:42:34.341570+0000","last_fullsized":"2024-04-25T08:42:34.341570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:31.845872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714659+0000","last_change":"2024-04-25T08:42:27.664137+0000","last_active":"2024-04-25T08:42:33.714659+0000","last_peered":"2024-04-25T08:42:33.714659+0000","last_clean":"2024-04-25T08:42:33.714659+0000","last_became_active":"2024-04-25T08:42:27.663755+0000","last_became_peered":"2024-04-25T08:42:27.663755+0000","last_unstale":"2024-04-25T08:42:33.714659+0000","last_undegraded":"2024-04-25T08:42:33.714659+0000","last_fullsized":"2024-04-25T08:42:33.714659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718434+0000","last_change":"2024-04-25T08:42:32.773504+0000","last_active":"2024-04-25T08:42:34.718434+0000","last_peered":"2024-04-25T08:42:34.718434+0000","last_clean":"2024-04-25T08:42:34.718434+0000","last_became_active":"2024-04-25T08:42:32.773110+0000","last_became_peered":"2024-04-25T08:42:32.773110+0000","last_unstale":"2024-04-25T08:42:34.718434+0000","last_undegraded":"2024-04-25T08:42:34.718434+0000","last_fullsized":"2024-04-25T08:42:34.718434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:48.222965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717970+0000","last_change":"2024-04-25T08:42:28.679402+0000","last_active":"2024-04-25T08:42:33.717970+0000","last_peered":"2024-04-25T08:42:33.717970+0000","last_clean":"2024-04-25T08:42:33.717970+0000","last_became_active":"2024-04-25T08:42:28.677035+0000","last_became_peered":"2024-04-25T08:42:28.677035+0000","last_unstale":"2024-04-25T08:42:33.717970+0000","last_undegraded":"2024-04-25T08:42:33.717970+0000","last_fullsized":"2024-04-25T08:42:33.717970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:46.406390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719572+0000","last_change":"2024-04-25T08:42:27.667160+0000","last_active":"2024-04-25T08:42:34.719572+0000","last_peered":"2024-04-25T08:42:34.719572+0000","last_clean":"2024-04-25T08:42:34.719572+0000","last_became_active":"2024-04-25T08:42:27.666859+0000","last_became_peered":"2024-04-25T08:42:27.666859+0000","last_unstale":"2024-04-25T08:42:34.719572+0000","last_undegraded":"2024-04-25T08:42:34.719572+0000","last_fullsized":"2024-04-25T08:42:34.719572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:07.628103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718382+0000","last_change":"2024-04-25T08:42:32.712665+0000","last_active":"2024-04-25T08:42:34.718382+0000","last_peered":"2024-04-25T08:42:34.718382+0000","last_clean":"2024-04-25T08:42:34.718382+0000","last_became_active":"2024-04-25T08:42:32.712042+0000","last_became_peered":"2024-04-25T08:42:32.712042+0000","last_unstale":"2024-04-25T08:42:34.718382+0000","last_undegraded":"2024-04-25T08:42:34.718382+0000","last_fullsized":"2024-04-25T08:42:34.718382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:58.481699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341968+0000","last_change":"2024-04-25T08:42:28.693096+0000","last_active":"2024-04-25T08:42:34.341968+0000","last_peered":"2024-04-25T08:42:34.341968+0000","last_clean":"2024-04-25T08:42:34.341968+0000","last_became_active":"2024-04-25T08:42:28.692818+0000","last_became_peered":"2024-04-25T08:42:28.692818+0000","last_unstale":"2024-04-25T08:42:34.341968+0000","last_undegraded":"2024-04-25T08:42:34.341968+0000","last_fullsized":"2024-04-25T08:42:34.341968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:18.213161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714486+0000","last_change":"2024-04-25T08:42:27.669796+0000","last_active":"2024-04-25T08:42:33.714486+0000","last_peered":"2024-04-25T08:42:33.714486+0000","last_clean":"2024-04-25T08:42:33.714486+0000","last_became_active":"2024-04-25T08:42:27.669436+0000","last_became_peered":"2024-04-25T08:42:27.669436+0000","last_unstale":"2024-04-25T08:42:33.714486+0000","last_undegraded":"2024-04-25T08:42:33.714486+0000","last_fullsized":"2024-04-25T08:42:33.714486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.411487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716067+0000","last_change":"2024-04-25T08:42:32.776302+0000","last_active":"2024-04-25T08:42:33.716067+0000","last_peered":"2024-04-25T08:42:33.716067+0000","last_clean":"2024-04-25T08:42:33.716067+0000","last_became_active":"2024-04-25T08:42:32.775933+0000","last_became_peered":"2024-04-25T08:42:32.775933+0000","last_unstale":"2024-04-25T08:42:33.716067+0000","last_undegraded":"2024-04-25T08:42:33.716067+0000","last_fullsized":"2024-04-25T08:42:33.716067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341857+0000","last_change":"2024-04-25T08:42:28.690533+0000","last_active":"2024-04-25T08:42:34.341857+0000","last_peered":"2024-04-25T08:42:34.341857+0000","last_clean":"2024-04-25T08:42:34.341857+0000","last_became_active":"2024-04-25T08:42:28.690239+0000","last_became_peered":"2024-04-25T08:42:28.690239+0000","last_unstale":"2024-04-25T08:42:34.341857+0000","last_undegraded":"2024-04-25T08:42:34.341857+0000","last_fullsized":"2024-04-25T08:42:34.341857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:46.406390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717279+0000","last_change":"2024-04-25T08:42:27.656949+0000","last_active":"2024-04-25T08:42:33.717279+0000","last_peered":"2024-04-25T08:42:33.717279+0000","last_clean":"2024-04-25T08:42:33.717279+0000","last_became_active":"2024-04-25T08:42:27.656636+0000","last_became_peered":"2024-04-25T08:42:27.656636+0000","last_unstale":"2024-04-25T08:42:33.717279+0000","last_undegraded":"2024-04-25T08:42:33.717279+0000","last_fullsized":"2024-04-25T08:42:33.717279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:20.615472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716458+0000","last_change":"2024-04-25T08:42:32.710504+0000","last_active":"2024-04-25T08:42:33.716458+0000","last_peered":"2024-04-25T08:42:33.716458+0000","last_clean":"2024-04-25T08:42:33.716458+0000","last_became_active":"2024-04-25T08:42:32.709907+0000","last_became_peered":"2024-04-25T08:42:32.709907+0000","last_unstale":"2024-04-25T08:42:33.716458+0000","last_undegraded":"2024-04-25T08:42:33.716458+0000","last_fullsized":"2024-04-25T08:42:33.716458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:01.014826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341325+0000","last_change":"2024-04-25T08:42:28.691813+0000","last_active":"2024-04-25T08:42:34.341325+0000","last_peered":"2024-04-25T08:42:34.341325+0000","last_clean":"2024-04-25T08:42:34.341325+0000","last_became_active":"2024-04-25T08:42:28.691149+0000","last_became_peered":"2024-04-25T08:42:28.691149+0000","last_unstale":"2024-04-25T08:42:34.341325+0000","last_undegraded":"2024-04-25T08:42:34.341325+0000","last_fullsized":"2024-04-25T08:42:34.341325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714031+0000","last_change":"2024-04-25T08:42:27.662731+0000","last_active":"2024-04-25T08:42:33.714031+0000","last_peered":"2024-04-25T08:42:33.714031+0000","last_clean":"2024-04-25T08:42:33.714031+0000","last_became_active":"2024-04-25T08:42:27.662403+0000","last_became_peered":"2024-04-25T08:42:27.662403+0000","last_unstale":"2024-04-25T08:42:33.714031+0000","last_undegraded":"2024-04-25T08:42:33.714031+0000","last_fullsized":"2024-04-25T08:42:33.714031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:50.270810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718353+0000","last_change":"2024-04-25T08:42:32.710724+0000","last_active":"2024-04-25T08:42:34.718353+0000","last_peered":"2024-04-25T08:42:34.718353+0000","last_clean":"2024-04-25T08:42:34.718353+0000","last_became_active":"2024-04-25T08:42:32.710334+0000","last_became_peered":"2024-04-25T08:42:32.710334+0000","last_unstale":"2024-04-25T08:42:34.718353+0000","last_undegraded":"2024-04-25T08:42:34.718353+0000","last_fullsized":"2024-04-25T08:42:34.718353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:50.447473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718379+0000","last_change":"2024-04-25T08:42:28.687700+0000","last_active":"2024-04-25T08:42:34.718379+0000","last_peered":"2024-04-25T08:42:34.718379+0000","last_clean":"2024-04-25T08:42:34.718379+0000","last_became_active":"2024-04-25T08:42:28.687069+0000","last_became_peered":"2024-04-25T08:42:28.687069+0000","last_unstale":"2024-04-25T08:42:34.718379+0000","last_undegraded":"2024-04-25T08:42:34.718379+0000","last_fullsized":"2024-04-25T08:42:34.718379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718433+0000","last_change":"2024-04-25T08:42:27.666832+0000","last_active":"2024-04-25T08:42:34.718433+0000","last_peered":"2024-04-25T08:42:34.718433+0000","last_clean":"2024-04-25T08:42:34.718433+0000","last_became_active":"2024-04-25T08:42:27.666534+0000","last_became_peered":"2024-04-25T08:42:27.666534+0000","last_unstale":"2024-04-25T08:42:34.718433+0000","last_undegraded":"2024-04-25T08:42:34.718433+0000","last_fullsized":"2024-04-25T08:42:34.718433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:55.763207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720268+0000","last_change":"2024-04-25T08:42:32.774301+0000","last_active":"2024-04-25T08:42:34.720268+0000","last_peered":"2024-04-25T08:42:34.720268+0000","last_clean":"2024-04-25T08:42:34.720268+0000","last_became_active":"2024-04-25T08:42:32.773417+0000","last_became_peered":"2024-04-25T08:42:32.773417+0000","last_unstale":"2024-04-25T08:42:34.720268+0000","last_undegraded":"2024-04-25T08:42:34.720268+0000","last_fullsized":"2024-04-25T08:42:34.720268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:35.240827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341533+0000","last_change":"2024-04-25T08:42:28.691458+0000","last_active":"2024-04-25T08:42:34.341533+0000","last_peered":"2024-04-25T08:42:34.341533+0000","last_clean":"2024-04-25T08:42:34.341533+0000","last_became_active":"2024-04-25T08:42:28.691196+0000","last_became_peered":"2024-04-25T08:42:28.691196+0000","last_unstale":"2024-04-25T08:42:34.341533+0000","last_undegraded":"2024-04-25T08:42:34.341533+0000","last_fullsized":"2024-04-25T08:42:34.341533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717730+0000","last_change":"2024-04-25T08:42:27.667521+0000","last_active":"2024-04-25T08:42:33.717730+0000","last_peered":"2024-04-25T08:42:33.717730+0000","last_clean":"2024-04-25T08:42:33.717730+0000","last_became_active":"2024-04-25T08:42:27.666568+0000","last_became_peered":"2024-04-25T08:42:27.666568+0000","last_unstale":"2024-04-25T08:42:33.717730+0000","last_undegraded":"2024-04-25T08:42:33.717730+0000","last_fullsized":"2024-04-25T08:42:33.717730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719926+0000","last_change":"2024-04-25T08:42:32.773283+0000","last_active":"2024-04-25T08:42:34.719926+0000","last_peered":"2024-04-25T08:42:34.719926+0000","last_clean":"2024-04-25T08:42:34.719926+0000","last_became_active":"2024-04-25T08:42:32.772847+0000","last_became_peered":"2024-04-25T08:42:32.772847+0000","last_unstale":"2024-04-25T08:42:34.719926+0000","last_undegraded":"2024-04-25T08:42:34.719926+0000","last_fullsized":"2024-04-25T08:42:34.719926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:58.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718713+0000","last_change":"2024-04-25T08:42:28.682019+0000","last_active":"2024-04-25T08:42:34.718713+0000","last_peered":"2024-04-25T08:42:34.718713+0000","last_clean":"2024-04-25T08:42:34.718713+0000","last_became_active":"2024-04-25T08:42:28.681710+0000","last_became_peered":"2024-04-25T08:42:28.681710+0000","last_unstale":"2024-04-25T08:42:34.718713+0000","last_undegraded":"2024-04-25T08:42:34.718713+0000","last_fullsized":"2024-04-25T08:42:34.718713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:25.495879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718612+0000","last_change":"2024-04-25T08:42:27.662671+0000","last_active":"2024-04-25T08:42:34.718612+0000","last_peered":"2024-04-25T08:42:34.718612+0000","last_clean":"2024-04-25T08:42:34.718612+0000","last_became_active":"2024-04-25T08:42:27.662360+0000","last_became_peered":"2024-04-25T08:42:27.662360+0000","last_unstale":"2024-04-25T08:42:34.718612+0000","last_undegraded":"2024-04-25T08:42:34.718612+0000","last_fullsized":"2024-04-25T08:42:34.718612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:50.270810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718134+0000","last_change":"2024-04-25T08:42:32.775284+0000","last_active":"2024-04-25T08:42:33.718134+0000","last_peered":"2024-04-25T08:42:33.718134+0000","last_clean":"2024-04-25T08:42:33.718134+0000","last_became_active":"2024-04-25T08:42:32.774805+0000","last_became_peered":"2024-04-25T08:42:32.774805+0000","last_unstale":"2024-04-25T08:42:33.718134+0000","last_undegraded":"2024-04-25T08:42:33.718134+0000","last_fullsized":"2024-04-25T08:42:33.718134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:40.291706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341553+0000","last_change":"2024-04-25T08:42:28.687467+0000","last_active":"2024-04-25T08:42:34.341553+0000","last_peered":"2024-04-25T08:42:34.341553+0000","last_clean":"2024-04-25T08:42:34.341553+0000","last_became_active":"2024-04-25T08:42:28.687151+0000","last_became_peered":"2024-04-25T08:42:28.687151+0000","last_unstale":"2024-04-25T08:42:34.341553+0000","last_undegraded":"2024-04-25T08:42:34.341553+0000","last_fullsized":"2024-04-25T08:42:34.341553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:12.983651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:37.848489+0000","last_change":"2024-04-25T08:42:27.667309+0000","last_active":"2024-04-25T08:42:37.848489+0000","last_peered":"2024-04-25T08:42:37.848489+0000","last_clean":"2024-04-25T08:42:37.848489+0000","last_became_active":"2024-04-25T08:42:27.666995+0000","last_became_peered":"2024-04-25T08:42:27.666995+0000","last_unstale":"2024-04-25T08:42:37.848489+0000","last_undegraded":"2024-04-25T08:42:37.848489+0000","last_fullsized":"2024-04-25T08:42:37.848489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:03.345113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719544+0000","last_change":"2024-04-25T08:42:32.709153+0000","last_active":"2024-04-25T08:42:34.719544+0000","last_peered":"2024-04-25T08:42:34.719544+0000","last_clean":"2024-04-25T08:42:34.719544+0000","last_became_active":"2024-04-25T08:42:32.708767+0000","last_became_peered":"2024-04-25T08:42:32.708767+0000","last_unstale":"2024-04-25T08:42:34.719544+0000","last_undegraded":"2024-04-25T08:42:34.719544+0000","last_fullsized":"2024-04-25T08:42:34.719544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:07.122172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716905+0000","last_change":"2024-04-25T08:42:28.682383+0000","last_active":"2024-04-25T08:42:33.716905+0000","last_peered":"2024-04-25T08:42:33.716905+0000","last_clean":"2024-04-25T08:42:33.716905+0000","last_became_active":"2024-04-25T08:42:28.682089+0000","last_became_peered":"2024-04-25T08:42:28.682089+0000","last_unstale":"2024-04-25T08:42:33.716905+0000","last_undegraded":"2024-04-25T08:42:33.716905+0000","last_fullsized":"2024-04-25T08:42:33.716905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.349485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719476+0000","last_change":"2024-04-25T08:42:27.667264+0000","last_active":"2024-04-25T08:42:34.719476+0000","last_peered":"2024-04-25T08:42:34.719476+0000","last_clean":"2024-04-25T08:42:34.719476+0000","last_became_active":"2024-04-25T08:42:27.666961+0000","last_became_peered":"2024-04-25T08:42:27.666961+0000","last_unstale":"2024-04-25T08:42:34.719476+0000","last_undegraded":"2024-04-25T08:42:34.719476+0000","last_fullsized":"2024-04-25T08:42:34.719476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:11.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717197+0000","last_change":"2024-04-25T08:42:32.714944+0000","last_active":"2024-04-25T08:42:33.717197+0000","last_peered":"2024-04-25T08:42:33.717197+0000","last_clean":"2024-04-25T08:42:33.717197+0000","last_became_active":"2024-04-25T08:42:32.714532+0000","last_became_peered":"2024-04-25T08:42:32.714532+0000","last_unstale":"2024-04-25T08:42:33.717197+0000","last_undegraded":"2024-04-25T08:42:33.717197+0000","last_fullsized":"2024-04-25T08:42:33.717197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:17.024734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718384+0000","last_change":"2024-04-25T08:42:28.678248+0000","last_active":"2024-04-25T08:42:34.718384+0000","last_peered":"2024-04-25T08:42:34.718384+0000","last_clean":"2024-04-25T08:42:34.718384+0000","last_became_active":"2024-04-25T08:42:28.677444+0000","last_became_peered":"2024-04-25T08:42:28.677444+0000","last_unstale":"2024-04-25T08:42:34.718384+0000","last_undegraded":"2024-04-25T08:42:34.718384+0000","last_fullsized":"2024-04-25T08:42:34.718384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718054+0000","last_change":"2024-04-25T08:42:27.662208+0000","last_active":"2024-04-25T08:42:33.718054+0000","last_peered":"2024-04-25T08:42:33.718054+0000","last_clean":"2024-04-25T08:42:33.718054+0000","last_became_active":"2024-04-25T08:42:27.661833+0000","last_became_peered":"2024-04-25T08:42:27.661833+0000","last_unstale":"2024-04-25T08:42:33.718054+0000","last_undegraded":"2024-04-25T08:42:33.718054+0000","last_fullsized":"2024-04-25T08:42:33.718054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.051447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720748+0000","last_change":"2024-04-25T08:42:32.704429+0000","last_active":"2024-04-25T08:42:34.720748+0000","last_peered":"2024-04-25T08:42:34.720748+0000","last_clean":"2024-04-25T08:42:34.720748+0000","last_became_active":"2024-04-25T08:42:32.703936+0000","last_became_peered":"2024-04-25T08:42:32.703936+0000","last_unstale":"2024-04-25T08:42:34.720748+0000","last_undegraded":"2024-04-25T08:42:34.720748+0000","last_fullsized":"2024-04-25T08:42:34.720748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:27.086996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717935+0000","last_change":"2024-04-25T08:42:28.685516+0000","last_active":"2024-04-25T08:42:33.717935+0000","last_peered":"2024-04-25T08:42:33.717935+0000","last_clean":"2024-04-25T08:42:33.717935+0000","last_became_active":"2024-04-25T08:42:28.685250+0000","last_became_peered":"2024-04-25T08:42:28.685250+0000","last_unstale":"2024-04-25T08:42:33.717935+0000","last_undegraded":"2024-04-25T08:42:33.717935+0000","last_fullsized":"2024-04-25T08:42:33.717935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719154+0000","last_change":"2024-04-25T08:42:27.665950+0000","last_active":"2024-04-25T08:42:34.719154+0000","last_peered":"2024-04-25T08:42:34.719154+0000","last_clean":"2024-04-25T08:42:34.719154+0000","last_became_active":"2024-04-25T08:42:27.665624+0000","last_became_peered":"2024-04-25T08:42:27.665624+0000","last_unstale":"2024-04-25T08:42:34.719154+0000","last_undegraded":"2024-04-25T08:42:34.719154+0000","last_fullsized":"2024-04-25T08:42:34.719154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720002+0000","last_change":"2024-04-25T08:42:32.776610+0000","last_active":"2024-04-25T08:42:34.720002+0000","last_peered":"2024-04-25T08:42:34.720002+0000","last_clean":"2024-04-25T08:42:34.720002+0000","last_became_active":"2024-04-25T08:42:32.776245+0000","last_became_peered":"2024-04-25T08:42:32.776245+0000","last_unstale":"2024-04-25T08:42:34.720002+0000","last_undegraded":"2024-04-25T08:42:34.720002+0000","last_fullsized":"2024-04-25T08:42:34.720002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:40.291706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718182+0000","last_change":"2024-04-25T08:42:32.776744+0000","last_active":"2024-04-25T08:42:34.718182+0000","last_peered":"2024-04-25T08:42:34.718182+0000","last_clean":"2024-04-25T08:42:34.718182+0000","last_became_active":"2024-04-25T08:42:32.776378+0000","last_became_peered":"2024-04-25T08:42:32.776378+0000","last_unstale":"2024-04-25T08:42:34.718182+0000","last_undegraded":"2024-04-25T08:42:34.718182+0000","last_fullsized":"2024-04-25T08:42:34.718182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718145+0000","last_change":"2024-04-25T08:42:28.675393+0000","last_active":"2024-04-25T08:42:34.718145+0000","last_peered":"2024-04-25T08:42:34.718145+0000","last_clean":"2024-04-25T08:42:34.718145+0000","last_became_active":"2024-04-25T08:42:28.675124+0000","last_became_peered":"2024-04-25T08:42:28.675124+0000","last_unstale":"2024-04-25T08:42:34.718145+0000","last_undegraded":"2024-04-25T08:42:34.718145+0000","last_fullsized":"2024-04-25T08:42:34.718145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716296+0000","last_change":"2024-04-25T08:42:27.661033+0000","last_active":"2024-04-25T08:42:33.716296+0000","last_peered":"2024-04-25T08:42:33.716296+0000","last_clean":"2024-04-25T08:42:33.716296+0000","last_became_active":"2024-04-25T08:42:27.660770+0000","last_became_peered":"2024-04-25T08:42:27.660770+0000","last_unstale":"2024-04-25T08:42:33.716296+0000","last_undegraded":"2024-04-25T08:42:33.716296+0000","last_fullsized":"2024-04-25T08:42:33.716296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:44.676405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719178+0000","last_change":"2024-04-25T08:42:32.714933+0000","last_active":"2024-04-25T08:42:34.719178+0000","last_peered":"2024-04-25T08:42:34.719178+0000","last_clean":"2024-04-25T08:42:34.719178+0000","last_became_active":"2024-04-25T08:42:32.714432+0000","last_became_peered":"2024-04-25T08:42:32.714432+0000","last_unstale":"2024-04-25T08:42:34.719178+0000","last_undegraded":"2024-04-25T08:42:34.719178+0000","last_fullsized":"2024-04-25T08:42:34.719178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:35.886955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720792+0000","last_change":"2024-04-25T08:42:28.679501+0000","last_active":"2024-04-25T08:42:34.720792+0000","last_peered":"2024-04-25T08:42:34.720792+0000","last_clean":"2024-04-25T08:42:34.720792+0000","last_became_active":"2024-04-25T08:42:28.679169+0000","last_became_peered":"2024-04-25T08:42:28.679169+0000","last_unstale":"2024-04-25T08:42:34.720792+0000","last_undegraded":"2024-04-25T08:42:34.720792+0000","last_fullsized":"2024-04-25T08:42:34.720792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720301+0000","last_change":"2024-04-25T08:42:27.669642+0000","last_active":"2024-04-25T08:42:34.720301+0000","last_peered":"2024-04-25T08:42:34.720301+0000","last_clean":"2024-04-25T08:42:34.720301+0000","last_became_active":"2024-04-25T08:42:27.669219+0000","last_became_peered":"2024-04-25T08:42:27.669219+0000","last_unstale":"2024-04-25T08:42:34.720301+0000","last_undegraded":"2024-04-25T08:42:34.720301+0000","last_fullsized":"2024-04-25T08:42:34.720301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718695+0000","last_change":"2024-04-25T08:42:27.664507+0000","last_active":"2024-04-25T08:42:34.718695+0000","last_peered":"2024-04-25T08:42:34.718695+0000","last_clean":"2024-04-25T08:42:34.718695+0000","last_became_active":"2024-04-25T08:42:27.663781+0000","last_became_peered":"2024-04-25T08:42:27.663781+0000","last_unstale":"2024-04-25T08:42:34.718695+0000","last_undegraded":"2024-04-25T08:42:34.718695+0000","last_fullsized":"2024-04-25T08:42:34.718695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:44.093710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718519+0000","last_change":"2024-04-25T08:42:28.670559+0000","last_active":"2024-04-25T08:42:34.718519+0000","last_peered":"2024-04-25T08:42:34.718519+0000","last_clean":"2024-04-25T08:42:34.718519+0000","last_became_active":"2024-04-25T08:42:28.670258+0000","last_became_peered":"2024-04-25T08:42:28.670258+0000","last_unstale":"2024-04-25T08:42:34.718519+0000","last_undegraded":"2024-04-25T08:42:34.718519+0000","last_fullsized":"2024-04-25T08:42:34.718519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714478+0000","last_change":"2024-04-25T08:42:32.714660+0000","last_active":"2024-04-25T08:42:33.714478+0000","last_peered":"2024-04-25T08:42:33.714478+0000","last_clean":"2024-04-25T08:42:33.714478+0000","last_became_active":"2024-04-25T08:42:32.714182+0000","last_became_peered":"2024-04-25T08:42:32.714182+0000","last_unstale":"2024-04-25T08:42:33.714478+0000","last_undegraded":"2024-04-25T08:42:33.714478+0000","last_fullsized":"2024-04-25T08:42:33.714478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:21.015635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720625+0000","last_change":"2024-04-25T08:42:27.671542+0000","last_active":"2024-04-25T08:42:34.720625+0000","last_peered":"2024-04-25T08:42:34.720625+0000","last_clean":"2024-04-25T08:42:34.720625+0000","last_became_active":"2024-04-25T08:42:27.670640+0000","last_became_peered":"2024-04-25T08:42:27.670640+0000","last_unstale":"2024-04-25T08:42:34.720625+0000","last_undegraded":"2024-04-25T08:42:34.720625+0000","last_fullsized":"2024-04-25T08:42:34.720625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:26.638942+0000","last_clean_scrub_stamp":"2024-04-25T08:42:26.638942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:50.411487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716383+0000","last_change":"2024-04-25T08:42:28.675535+0000","last_active":"2024-04-25T08:42:33.716383+0000","last_peered":"2024-04-25T08:42:33.716383+0000","last_clean":"2024-04-25T08:42:33.716383+0000","last_became_active":"2024-04-25T08:42:28.674786+0000","last_became_peered":"2024-04-25T08:42:28.674786+0000","last_unstale":"2024-04-25T08:42:33.716383+0000","last_undegraded":"2024-04-25T08:42:33.716383+0000","last_fullsized":"2024-04-25T08:42:33.716383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:19.055819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720001+0000","last_change":"2024-04-25T08:42:32.703253+0000","last_active":"2024-04-25T08:42:34.720001+0000","last_peered":"2024-04-25T08:42:34.720001+0000","last_clean":"2024-04-25T08:42:34.720001+0000","last_became_active":"2024-04-25T08:42:32.702862+0000","last_became_peered":"2024-04-25T08:42:32.702862+0000","last_unstale":"2024-04-25T08:42:34.720001+0000","last_undegraded":"2024-04-25T08:42:34.720001+0000","last_fullsized":"2024-04-25T08:42:34.720001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:31.684397+0000","last_clean_scrub_stamp":"2024-04-25T08:42:31.684397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:46.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718238+0000","last_change":"2024-04-25T08:42:28.688424+0000","last_active":"2024-04-25T08:42:34.718238+0000","last_peered":"2024-04-25T08:42:34.718238+0000","last_clean":"2024-04-25T08:42:34.718238+0000","last_became_active":"2024-04-25T08:42:28.687428+0000","last_became_peered":"2024-04-25T08:42:28.687428+0000","last_unstale":"2024-04-25T08:42:34.718238+0000","last_undegraded":"2024-04-25T08:42:34.718238+0000","last_fullsized":"2024-04-25T08:42:34.718238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714119+0000","last_change":"2024-04-25T08:42:28.676656+0000","last_active":"2024-04-25T08:42:33.714119+0000","last_peered":"2024-04-25T08:42:33.714119+0000","last_clean":"2024-04-25T08:42:33.714119+0000","last_became_active":"2024-04-25T08:42:28.676373+0000","last_became_peered":"2024-04-25T08:42:28.676373+0000","last_unstale":"2024-04-25T08:42:33.714119+0000","last_undegraded":"2024-04-25T08:42:33.714119+0000","last_fullsized":"2024-04-25T08:42:33.714119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:12.180971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717556+0000","last_change":"2024-04-25T08:42:28.681762+0000","last_active":"2024-04-25T08:42:33.717556+0000","last_peered":"2024-04-25T08:42:33.717556+0000","last_clean":"2024-04-25T08:42:33.717556+0000","last_became_active":"2024-04-25T08:42:28.681291+0000","last_became_peered":"2024-04-25T08:42:28.681291+0000","last_unstale":"2024-04-25T08:42:33.717556+0000","last_undegraded":"2024-04-25T08:42:33.717556+0000","last_fullsized":"2024-04-25T08:42:33.717556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:54.440616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718428+0000","last_change":"2024-04-25T08:42:28.676467+0000","last_active":"2024-04-25T08:42:34.718428+0000","last_peered":"2024-04-25T08:42:34.718428+0000","last_clean":"2024-04-25T08:42:34.718428+0000","last_became_active":"2024-04-25T08:42:28.675914+0000","last_became_peered":"2024-04-25T08:42:28.675914+0000","last_unstale":"2024-04-25T08:42:34.718428+0000","last_undegraded":"2024-04-25T08:42:34.718428+0000","last_fullsized":"2024-04-25T08:42:34.718428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720100+0000","last_change":"2024-04-25T08:42:28.675440+0000","last_active":"2024-04-25T08:42:34.720100+0000","last_peered":"2024-04-25T08:42:34.720100+0000","last_clean":"2024-04-25T08:42:34.720100+0000","last_became_active":"2024-04-25T08:42:28.675157+0000","last_became_peered":"2024-04-25T08:42:28.675157+0000","last_unstale":"2024-04-25T08:42:34.720100+0000","last_undegraded":"2024-04-25T08:42:34.720100+0000","last_fullsized":"2024-04-25T08:42:34.720100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719294+0000","last_change":"2024-04-25T08:42:28.681482+0000","last_active":"2024-04-25T08:42:34.719294+0000","last_peered":"2024-04-25T08:42:34.719294+0000","last_clean":"2024-04-25T08:42:34.719294+0000","last_became_active":"2024-04-25T08:42:28.681211+0000","last_became_peered":"2024-04-25T08:42:28.681211+0000","last_unstale":"2024-04-25T08:42:34.719294+0000","last_undegraded":"2024-04-25T08:42:34.719294+0000","last_fullsized":"2024-04-25T08:42:34.719294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719200+0000","last_change":"2024-04-25T08:42:28.684774+0000","last_active":"2024-04-25T08:42:34.719200+0000","last_peered":"2024-04-25T08:42:34.719200+0000","last_clean":"2024-04-25T08:42:34.719200+0000","last_became_active":"2024-04-25T08:42:28.684502+0000","last_became_peered":"2024-04-25T08:42:28.684502+0000","last_unstale":"2024-04-25T08:42:34.719200+0000","last_undegraded":"2024-04-25T08:42:34.719200+0000","last_fullsized":"2024-04-25T08:42:34.719200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:56.973743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720334+0000","last_change":"2024-04-25T08:42:28.675478+0000","last_active":"2024-04-25T08:42:34.720334+0000","last_peered":"2024-04-25T08:42:34.720334+0000","last_clean":"2024-04-25T08:42:34.720334+0000","last_became_active":"2024-04-25T08:42:28.675191+0000","last_became_peered":"2024-04-25T08:42:28.675191+0000","last_unstale":"2024-04-25T08:42:34.720334+0000","last_undegraded":"2024-04-25T08:42:34.720334+0000","last_fullsized":"2024-04-25T08:42:34.720334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716297+0000","last_change":"2024-04-25T08:42:28.679789+0000","last_active":"2024-04-25T08:42:33.716297+0000","last_peered":"2024-04-25T08:42:33.716297+0000","last_clean":"2024-04-25T08:42:33.716297+0000","last_became_active":"2024-04-25T08:42:28.677404+0000","last_became_peered":"2024-04-25T08:42:28.677404+0000","last_unstale":"2024-04-25T08:42:33.716297+0000","last_undegraded":"2024-04-25T08:42:33.716297+0000","last_fullsized":"2024-04-25T08:42:33.716297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720113+0000","last_change":"2024-04-25T08:42:28.683643+0000","last_active":"2024-04-25T08:42:34.720113+0000","last_peered":"2024-04-25T08:42:34.720113+0000","last_clean":"2024-04-25T08:42:34.720113+0000","last_became_active":"2024-04-25T08:42:28.683205+0000","last_became_peered":"2024-04-25T08:42:28.683205+0000","last_unstale":"2024-04-25T08:42:34.720113+0000","last_undegraded":"2024-04-25T08:42:34.720113+0000","last_fullsized":"2024-04-25T08:42:34.720113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717551+0000","last_change":"2024-04-25T08:42:28.682157+0000","last_active":"2024-04-25T08:42:33.717551+0000","last_peered":"2024-04-25T08:42:33.717551+0000","last_clean":"2024-04-25T08:42:33.717551+0000","last_became_active":"2024-04-25T08:42:28.681910+0000","last_became_peered":"2024-04-25T08:42:28.681910+0000","last_unstale":"2024-04-25T08:42:33.717551+0000","last_undegraded":"2024-04-25T08:42:33.717551+0000","last_fullsized":"2024-04-25T08:42:33.717551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:44.181882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718189+0000","last_change":"2024-04-25T08:42:28.681636+0000","last_active":"2024-04-25T08:42:34.718189+0000","last_peered":"2024-04-25T08:42:34.718189+0000","last_clean":"2024-04-25T08:42:34.718189+0000","last_became_active":"2024-04-25T08:42:28.681243+0000","last_became_peered":"2024-04-25T08:42:28.681243+0000","last_unstale":"2024-04-25T08:42:34.718189+0000","last_undegraded":"2024-04-25T08:42:34.718189+0000","last_fullsized":"2024-04-25T08:42:34.718189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:22.224011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718681+0000","last_change":"2024-04-25T08:42:28.690347+0000","last_active":"2024-04-25T08:42:34.718681+0000","last_peered":"2024-04-25T08:42:34.718681+0000","last_clean":"2024-04-25T08:42:34.718681+0000","last_became_active":"2024-04-25T08:42:28.690062+0000","last_became_peered":"2024-04-25T08:42:28.690062+0000","last_unstale":"2024-04-25T08:42:34.718681+0000","last_undegraded":"2024-04-25T08:42:34.718681+0000","last_fullsized":"2024-04-25T08:42:34.718681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:47.793162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341807+0000","last_change":"2024-04-25T08:42:28.687419+0000","last_active":"2024-04-25T08:42:34.341807+0000","last_peered":"2024-04-25T08:42:34.341807+0000","last_clean":"2024-04-25T08:42:34.341807+0000","last_became_active":"2024-04-25T08:42:28.686800+0000","last_became_peered":"2024-04-25T08:42:28.686800+0000","last_unstale":"2024-04-25T08:42:34.341807+0000","last_undegraded":"2024-04-25T08:42:34.341807+0000","last_fullsized":"2024-04-25T08:42:34.341807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:54.440616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.714411+0000","last_change":"2024-04-25T08:42:28.679139+0000","last_active":"2024-04-25T08:42:33.714411+0000","last_peered":"2024-04-25T08:42:33.714411+0000","last_clean":"2024-04-25T08:42:33.714411+0000","last_became_active":"2024-04-25T08:42:28.678803+0000","last_became_peered":"2024-04-25T08:42:28.678803+0000","last_unstale":"2024-04-25T08:42:33.714411+0000","last_undegraded":"2024-04-25T08:42:33.714411+0000","last_fullsized":"2024-04-25T08:42:33.714411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:08.632475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.718400+0000","last_change":"2024-04-25T08:42:28.682788+0000","last_active":"2024-04-25T08:42:33.718400+0000","last_peered":"2024-04-25T08:42:33.718400+0000","last_clean":"2024-04-25T08:42:33.718400+0000","last_became_active":"2024-04-25T08:42:28.682532+0000","last_became_peered":"2024-04-25T08:42:28.682532+0000","last_unstale":"2024-04-25T08:42:33.718400+0000","last_undegraded":"2024-04-25T08:42:33.718400+0000","last_fullsized":"2024-04-25T08:42:33.718400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:12.983651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716185+0000","last_change":"2024-04-25T08:42:28.676138+0000","last_active":"2024-04-25T08:42:33.716185+0000","last_peered":"2024-04-25T08:42:33.716185+0000","last_clean":"2024-04-25T08:42:33.716185+0000","last_became_active":"2024-04-25T08:42:28.675765+0000","last_became_peered":"2024-04-25T08:42:28.675765+0000","last_unstale":"2024-04-25T08:42:33.716185+0000","last_undegraded":"2024-04-25T08:42:33.716185+0000","last_fullsized":"2024-04-25T08:42:33.716185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:31.845872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718240+0000","last_change":"2024-04-25T08:42:28.676274+0000","last_active":"2024-04-25T08:42:34.718240+0000","last_peered":"2024-04-25T08:42:34.718240+0000","last_clean":"2024-04-25T08:42:34.718240+0000","last_became_active":"2024-04-25T08:42:28.675935+0000","last_became_peered":"2024-04-25T08:42:28.675935+0000","last_unstale":"2024-04-25T08:42:34.718240+0000","last_undegraded":"2024-04-25T08:42:34.718240+0000","last_fullsized":"2024-04-25T08:42:34.718240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:22.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718466+0000","last_change":"2024-04-25T08:42:28.675277+0000","last_active":"2024-04-25T08:42:34.718466+0000","last_peered":"2024-04-25T08:42:34.718466+0000","last_clean":"2024-04-25T08:42:34.718466+0000","last_became_active":"2024-04-25T08:42:28.674998+0000","last_became_peered":"2024-04-25T08:42:28.674998+0000","last_unstale":"2024-04-25T08:42:34.718466+0000","last_undegraded":"2024-04-25T08:42:34.718466+0000","last_fullsized":"2024-04-25T08:42:34.718466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:25.796192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720546+0000","last_change":"2024-04-25T08:42:28.679479+0000","last_active":"2024-04-25T08:42:34.720546+0000","last_peered":"2024-04-25T08:42:34.720546+0000","last_clean":"2024-04-25T08:42:34.720546+0000","last_became_active":"2024-04-25T08:42:28.679202+0000","last_became_peered":"2024-04-25T08:42:28.679202+0000","last_unstale":"2024-04-25T08:42:34.720546+0000","last_undegraded":"2024-04-25T08:42:34.720546+0000","last_fullsized":"2024-04-25T08:42:34.720546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:13.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.716781+0000","last_change":"2024-04-25T08:42:28.680700+0000","last_active":"2024-04-25T08:42:33.716781+0000","last_peered":"2024-04-25T08:42:33.716781+0000","last_clean":"2024-04-25T08:42:33.716781+0000","last_became_active":"2024-04-25T08:42:28.680363+0000","last_became_peered":"2024-04-25T08:42:28.680363+0000","last_unstale":"2024-04-25T08:42:33.716781+0000","last_undegraded":"2024-04-25T08:42:33.716781+0000","last_fullsized":"2024-04-25T08:42:33.716781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:12.180971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718922+0000","last_change":"2024-04-25T08:42:28.688063+0000","last_active":"2024-04-25T08:42:34.718922+0000","last_peered":"2024-04-25T08:42:34.718922+0000","last_clean":"2024-04-25T08:42:34.718922+0000","last_became_active":"2024-04-25T08:42:28.687786+0000","last_became_peered":"2024-04-25T08:42:28.687786+0000","last_unstale":"2024-04-25T08:42:34.718922+0000","last_undegraded":"2024-04-25T08:42:34.718922+0000","last_fullsized":"2024-04-25T08:42:34.718922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:55.725665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719162+0000","last_change":"2024-04-25T08:42:28.688118+0000","last_active":"2024-04-25T08:42:34.719162+0000","last_peered":"2024-04-25T08:42:34.719162+0000","last_clean":"2024-04-25T08:42:34.719162+0000","last_became_active":"2024-04-25T08:42:28.687841+0000","last_became_peered":"2024-04-25T08:42:28.687841+0000","last_unstale":"2024-04-25T08:42:34.719162+0000","last_undegraded":"2024-04-25T08:42:34.719162+0000","last_fullsized":"2024-04-25T08:42:34.719162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341962+0000","last_change":"2024-04-25T08:42:28.692587+0000","last_active":"2024-04-25T08:42:34.341962+0000","last_peered":"2024-04-25T08:42:34.341962+0000","last_clean":"2024-04-25T08:42:34.341962+0000","last_became_active":"2024-04-25T08:42:28.688599+0000","last_became_peered":"2024-04-25T08:42:28.688599+0000","last_unstale":"2024-04-25T08:42:34.341962+0000","last_undegraded":"2024-04-25T08:42:34.341962+0000","last_fullsized":"2024-04-25T08:42:34.341962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:03.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.720561+0000","last_change":"2024-04-25T08:42:28.683857+0000","last_active":"2024-04-25T08:42:34.720561+0000","last_peered":"2024-04-25T08:42:34.720561+0000","last_clean":"2024-04-25T08:42:34.720561+0000","last_became_active":"2024-04-25T08:42:28.683465+0000","last_became_peered":"2024-04-25T08:42:28.683465+0000","last_unstale":"2024-04-25T08:42:34.720561+0000","last_undegraded":"2024-04-25T08:42:34.720561+0000","last_fullsized":"2024-04-25T08:42:34.720561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341299+0000","last_change":"2024-04-25T08:42:28.691863+0000","last_active":"2024-04-25T08:42:34.341299+0000","last_peered":"2024-04-25T08:42:34.341299+0000","last_clean":"2024-04-25T08:42:34.341299+0000","last_became_active":"2024-04-25T08:42:28.690583+0000","last_became_peered":"2024-04-25T08:42:28.690583+0000","last_unstale":"2024-04-25T08:42:34.341299+0000","last_undegraded":"2024-04-25T08:42:34.341299+0000","last_fullsized":"2024-04-25T08:42:34.341299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:58.319964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717427+0000","last_change":"2024-04-25T08:42:28.675349+0000","last_active":"2024-04-25T08:42:33.717427+0000","last_peered":"2024-04-25T08:42:33.717427+0000","last_clean":"2024-04-25T08:42:33.717427+0000","last_became_active":"2024-04-25T08:42:28.675000+0000","last_became_peered":"2024-04-25T08:42:28.675000+0000","last_unstale":"2024-04-25T08:42:33.717427+0000","last_undegraded":"2024-04-25T08:42:33.717427+0000","last_fullsized":"2024-04-25T08:42:33.717427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:55.477719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341365+0000","last_change":"2024-04-25T08:42:28.684750+0000","last_active":"2024-04-25T08:42:34.341365+0000","last_peered":"2024-04-25T08:42:34.341365+0000","last_clean":"2024-04-25T08:42:34.341365+0000","last_became_active":"2024-04-25T08:42:28.684463+0000","last_became_peered":"2024-04-25T08:42:28.684463+0000","last_unstale":"2024-04-25T08:42:34.341365+0000","last_undegraded":"2024-04-25T08:42:34.341365+0000","last_fullsized":"2024-04-25T08:42:34.341365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:37.869342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:33.717827+0000","last_change":"2024-04-25T08:42:28.680160+0000","last_active":"2024-04-25T08:42:33.717827+0000","last_peered":"2024-04-25T08:42:33.717827+0000","last_clean":"2024-04-25T08:42:33.717827+0000","last_became_active":"2024-04-25T08:42:28.679868+0000","last_became_peered":"2024-04-25T08:42:28.679868+0000","last_unstale":"2024-04-25T08:42:33.717827+0000","last_undegraded":"2024-04-25T08:42:33.717827+0000","last_fullsized":"2024-04-25T08:42:33.717827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:38.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.718100+0000","last_change":"2024-04-25T08:42:28.674768+0000","last_active":"2024-04-25T08:42:34.718100+0000","last_peered":"2024-04-25T08:42:34.718100+0000","last_clean":"2024-04-25T08:42:34.718100+0000","last_became_active":"2024-04-25T08:42:28.669240+0000","last_became_peered":"2024-04-25T08:42:28.669240+0000","last_unstale":"2024-04-25T08:42:34.718100+0000","last_undegraded":"2024-04-25T08:42:34.718100+0000","last_fullsized":"2024-04-25T08:42:34.718100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:04.520057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.719515+0000","last_change":"2024-04-25T08:42:28.676190+0000","last_active":"2024-04-25T08:42:34.719515+0000","last_peered":"2024-04-25T08:42:34.719515+0000","last_clean":"2024-04-25T08:42:34.719515+0000","last_became_active":"2024-04-25T08:42:28.675895+0000","last_became_peered":"2024-04-25T08:42:28.675895+0000","last_unstale":"2024-04-25T08:42:34.719515+0000","last_undegraded":"2024-04-25T08:42:34.719515+0000","last_fullsized":"2024-04-25T08:42:34.719515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:45.278266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T08:42:34.341862+0000","last_change":"2024-04-25T08:42:28.686275+0000","last_active":"2024-04-25T08:42:34.341862+0000","last_peered":"2024-04-25T08:42:34.341862+0000","last_clean":"2024-04-25T08:42:34.341862+0000","last_became_active":"2024-04-25T08:42:28.686029+0000","last_became_peered":"2024-04-25T08:42:28.686029+0000","last_unstale":"2024-04-25T08:42:34.341862+0000","last_undegraded":"2024-04-25T08:42:34.341862+0000","last_fullsized":"2024-04-25T08:42:34.341862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:27.643314+0000","last_clean_scrub_stamp":"2024-04-25T08:42:27.643314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:55.477719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:42:53.657 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T08:42:53.657 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T08:42:53.657 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T08:42:53.657 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T08:42:53.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.798+0000 7fa522e15640 1 Processor -- start 2024-04-25T08:42:53.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.798+0000 7fa522e15640 1 -- start start 2024-04-25T08:42:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.798+0000 7fa522e15640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa51c15dd30 0x7fa51c0b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.798+0000 7fa522e15640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa51c0b9770 0x7fa51c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.798+0000 7fa522e15640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c0d1df0 con 0x7fa51c0d2e90 2024-04-25T08:42:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.798+0000 7fa522e15640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c0b7a50 con 0x7fa51c15dd30 2024-04-25T08:42:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.798+0000 7fa522e15640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c0d20d0 con 0x7fa51c0b9770 2024-04-25T08:42:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.799+0000 7fa520bb1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa51c15dd30 0x7fa51c0b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.799+0000 7fa5213b2640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa51c0d2e90 0x7fa51c0b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46282/0 (socket says 172.21.15.172:46282) 2024-04-25T08:42:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.799+0000 7fa520bb1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa51c15dd30 0x7fa51c0b9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50722/0 (socket says 172.21.15.172:50722) 2024-04-25T08:42:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.799+0000 7fa5213b2640 1 -- 172.21.15.172:0/1319157335 learned_addr learned my addr 172.21.15.172:0/1319157335 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.799+0000 7fa51bfff640 1 --2- 172.21.15.172:0/1319157335 >> v2:172.21.15.186:3300/0 conn(0x7fa51c0b9770 0x7fa51c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.799+0000 7fa520bb1640 1 -- 172.21.15.172:0/1319157335 >> v2:172.21.15.186:3300/0 conn(0x7fa51c0b9770 msgr2=0x7fa51c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.799+0000 7fa520bb1640 1 --2- 172.21.15.172:0/1319157335 >> v2:172.21.15.186:3300/0 conn(0x7fa51c0b9770 0x7fa51c0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.799+0000 7fa520bb1640 1 -- 172.21.15.172:0/1319157335 >> v1:172.21.15.172:6789/0 conn(0x7fa51c0d2e90 legacy=0x7fa51c0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.799+0000 7fa51b7fe640 1 -- 172.21.15.172:0/1319157335 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231740428 0 0) 0x7fa51c0d1df0 con 0x7fa51c0d2e90 2024-04-25T08:42:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.799+0000 7fa520bb1640 1 -- 172.21.15.172:0/1319157335 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0d23b0 con 0x7fa51c15dd30 2024-04-25T08:42:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa520bb1640 1 --2- 172.21.15.172:0/1319157335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c15dd30 0x7fa51c0b9230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0b6540 tx=0x7fa51402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258521f578dd1b40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa51b7fe640 1 -- 172.21.15.172:0/1319157335 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514007740 con 0x7fa51c15dd30 2024-04-25T08:42:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa51b7fe640 1 -- 172.21.15.172:0/1319157335 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5140078e0 con 0x7fa51c15dd30 2024-04-25T08:42:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa51b7fe640 1 -- 172.21.15.172:0/1319157335 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514007cb0 con 0x7fa51c15dd30 2024-04-25T08:42:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa522e15640 1 -- 172.21.15.172:0/1319157335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c15dd30 msgr2=0x7fa51c0b9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa522e15640 1 --2- 172.21.15.172:0/1319157335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c15dd30 0x7fa51c0b9230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0b6540 tx=0x7fa51402a560 comp rx=0 tx=0).stop 2024-04-25T08:42:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa522e15640 1 -- 172.21.15.172:0/1319157335 shutdown_connections 2024-04-25T08:42:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa522e15640 1 --2- 172.21.15.172:0/1319157335 >> v2:172.21.15.186:3300/0 conn(0x7fa51c0b9770 0x7fa51c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa522e15640 1 --2- 172.21.15.172:0/1319157335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c15dd30 0x7fa51c0b9230 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa522e15640 1 -- 172.21.15.172:0/1319157335 >> 172.21.15.172:0/1319157335 conn(0x7fa51c061c30 msgr2=0x7fa51c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa522e15640 1 -- 172.21.15.172:0/1319157335 shutdown_connections 2024-04-25T08:42:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.800+0000 7fa522e15640 1 -- 172.21.15.172:0/1319157335 wait complete. 2024-04-25T08:42:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.802+0000 7fa522e15640 1 Processor -- start 2024-04-25T08:42:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.802+0000 7fa522e15640 1 -- start start 2024-04-25T08:42:53.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.802+0000 7fa522e15640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa51c0b9770 0x7fa51c0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.802+0000 7fa522e15640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c0d2e90 0x7fa51c0b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.802+0000 7fa522e15640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa51c15dd30 0x7fa51c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.802+0000 7fa522e15640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0d1a10 con 0x7fa51c0d2e90 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.802+0000 7fa522e15640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0d2970 con 0x7fa51c0b9770 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.802+0000 7fa522e15640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0d1b90 con 0x7fa51c15dd30 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c0d2e90 0x7fa51c0b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c0d2e90 0x7fa51c0b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50726/0 (socket says 172.21.15.172:50726) 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa51bfff640 1 -- 172.21.15.172:0/1299194226 learned_addr learned my addr 172.21.15.172:0/1299194226 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa520bb1640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa51c0b9770 0x7fa51c0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa5213b2640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa51c15dd30 0x7fa51c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa51bfff640 1 -- 172.21.15.172:0/1299194226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa51c15dd30 msgr2=0x7fa51c15a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa51bfff640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa51c15dd30 0x7fa51c15a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa51bfff640 1 -- 172.21.15.172:0/1299194226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa51c0b9770 msgr2=0x7fa51c0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa51bfff640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa51c0b9770 0x7fa51c0cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa51bfff640 1 -- 172.21.15.172:0/1299194226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0cc7f0 con 0x7fa51c0d2e90 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa520bb1640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa51c0b9770 0x7fa51c0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa5213b2640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa51c15dd30 0x7fa51c15a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa51bfff640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c0d2e90 0x7fa51c0b5240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d800 tx=0x7fa50400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa5197fa640 1 -- 172.21.15.172:0/1299194226 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400b660 con 0x7fa51c0d2e90 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa5197fa640 1 -- 172.21.15.172:0/1299194226 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa504019070 con 0x7fa51c0d2e90 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa5197fa640 1 -- 172.21.15.172:0/1299194226 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400ba40 con 0x7fa51c0d2e90 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa522e15640 1 -- 172.21.15.172:0/1299194226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c0ccad0 con 0x7fa51c0d2e90 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.803+0000 7fa522e15640 1 -- 172.21.15.172:0/1299194226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c0cd090 con 0x7fa51c0d2e90 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.804+0000 7fa522e15640 1 -- 172.21.15.172:0/1299194226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c073990 con 0x7fa51c0d2e90 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.805+0000 7fa5197fa640 1 -- 172.21.15.172:0/1299194226 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa50400bbe0 con 0x7fa51c0d2e90 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.805+0000 7fa5197fa640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4fc06b500 0x7fa4fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.805+0000 7fa5197fa640 1 -- 172.21.15.172:0/1299194226 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa50408a8d0 con 0x7fa51c0d2e90 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.805+0000 7fa520bb1640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4fc06b500 0x7fa4fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.805+0000 7fa520bb1640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4fc06b500 0x7fa4fc06d9c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa514034000 tx=0x7fa514033040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:53.809+0000 7fa5197fa640 1 -- 172.21.15.172:0/1299194226 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5040594a0 con 0x7fa51c0d2e90 2024-04-25T08:42:54.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.017+0000 7fa522e15640 1 -- 172.21.15.172:0/1299194226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa51c0b82a0 con 0x7fa51c0d2e90 2024-04-25T08:42:54.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.017+0000 7fa5197fa640 1 -- 172.21.15.172:0/1299194226 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa504058da0 con 0x7fa51c0d2e90 2024-04-25T08:42:54.009 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:54.009 INFO:teuthology.orchestra.run.smithi172.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 -- 172.21.15.172:0/1299194226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4fc06b500 msgr2=0x7fa4fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4fc06b500 0x7fa4fc06d9c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa514034000 tx=0x7fa514033040 comp rx=0 tx=0).stop 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 -- 172.21.15.172:0/1299194226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c0d2e90 msgr2=0x7fa51c0b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c0d2e90 0x7fa51c0b5240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d800 tx=0x7fa50400dcc0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 -- 172.21.15.172:0/1299194226 shutdown_connections 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4fc06b500 0x7fa4fc06d9c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa51c15dd30 0x7fa51c15a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa51c0d2e90 0x7fa51c0b5240 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 --2- 172.21.15.172:0/1299194226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa51c0b9770 0x7fa51c0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 -- 172.21.15.172:0/1299194226 >> 172.21.15.172:0/1299194226 conn(0x7fa51c061c30 msgr2=0x7fa51c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 -- 172.21.15.172:0/1299194226 shutdown_connections 2024-04-25T08:42:54.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.019+0000 7fa522e15640 1 -- 172.21.15.172:0/1299194226 wait complete. 2024-04-25T08:42:54.022 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T08:42:54.023 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:54.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.129+0000 7f46756bd640 1 Processor -- start 2024-04-25T08:42:54.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.129+0000 7f46756bd640 1 -- start start 2024-04-25T08:42:54.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f46756bd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f467015dbe0 0x7f46700d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f46756bd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46700b6220 con 0x7f46700b92a0 2024-04-25T08:42:54.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f46756bd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46700b97a0 con 0x7f46700b2cb0 2024-04-25T08:42:54.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f46756bd640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467015dfc0 con 0x7f467015dbe0 2024-04-25T08:42:54.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466f7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f46700b92a0 0x7f46700b5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46290/0 (socket says 172.21.15.172:46290) 2024-04-25T08:42:54.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466f7fe640 1 -- 172.21.15.172:0/1695685998 learned_addr learned my addr 172.21.15.172:0/1695685998 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:54.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466effd640 1 --2- 172.21.15.172:0/1695685998 >> v2:172.21.15.186:3300/0 conn(0x7f467015dbe0 0x7f46700d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883785182 0 0) 0x7f46700b6220 con 0x7f46700b92a0 2024-04-25T08:42:54.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f465c003520 con 0x7f46700b92a0 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 89713290 0 0) 0x7f465c003520 con 0x7f46700b92a0 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 >> v2:172.21.15.186:3300/0 conn(0x7f467015dbe0 msgr2=0x7f46700d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 --2- 172.21.15.172:0/1695685998 >> v2:172.21.15.186:3300/0 conn(0x7f467015dbe0 0x7f46700d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 >> v1:172.21.15.186:6789/0 conn(0x7f46700b2cb0 legacy=0x7f46700b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46700d1c50 con 0x7f46700b92a0 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f46680019f0 con 0x7f46700b92a0 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 >> v1:172.21.15.172:6789/0 conn(0x7f46700b92a0 legacy=0x7f46700b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f465c0039b0 0x7f465c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f465c004800 0x7f465c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f465c0051c0 0x7f465c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c00c130 con 0x7f465c0039b0 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c00c2e0 con 0x7f465c004800 2024-04-25T08:42:54.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.130+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c00c4e0 con 0x7f465c0051c0 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.131+0000 7f466effd640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f465c0039b0 0x7f465c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.131+0000 7f4667fff640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f465c004800 0x7f465c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.131+0000 7f466f7fe640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f465c0051c0 0x7f465c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.131+0000 7f466effd640 1 -- 172.21.15.172:0/1695685998 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f465c0051c0 msgr2=0x7f465c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.131+0000 7f466effd640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f465c0051c0 0x7f465c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.131+0000 7f466effd640 1 -- 172.21.15.172:0/1695685998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f465c004800 msgr2=0x7f465c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.131+0000 7f466effd640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f465c004800 0x7f465c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.131+0000 7f466effd640 1 -- 172.21.15.172:0/1695685998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c003520 con 0x7f465c0039b0 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.131+0000 7f466f7fe640 1 -- 172.21.15.172:0/1695685998 reap_dead start 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.131+0000 7f466effd640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f465c0039b0 0x7f465c003dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4660009ac0 tx=0x7f465c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4b51646c6ca756 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.132+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660036070 con 0x7f465c0039b0 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.132+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4660031400 con 0x7f465c0039b0 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.132+0000 7f466e7fc640 1 -- 172.21.15.172:0/1695685998 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660009690 con 0x7f465c0039b0 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.132+0000 7f46756bd640 1 -- 172.21.15.172:0/1695685998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f465c0039b0 msgr2=0x7f465c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.132+0000 7f46756bd640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f465c0039b0 0x7f465c003dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4660009ac0 tx=0x7f465c005830 comp rx=0 tx=0).stop 2024-04-25T08:42:54.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.132+0000 7f46756bd640 1 -- 172.21.15.172:0/1695685998 shutdown_connections 2024-04-25T08:42:54.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.132+0000 7f46756bd640 1 --2- 172.21.15.172:0/1695685998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f465c0039b0 0x7f465c003dd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.132+0000 7f46756bd640 1 -- 172.21.15.172:0/1695685998 >> 172.21.15.172:0/1695685998 conn(0x7f4670061a20 msgr2=0x7f4670061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:54.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.132+0000 7f46756bd640 1 -- 172.21.15.172:0/1695685998 shutdown_connections 2024-04-25T08:42:54.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.132+0000 7f46756bd640 1 -- 172.21.15.172:0/1695685998 wait complete. 2024-04-25T08:42:54.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.133+0000 7f46756bd640 1 Processor -- start 2024-04-25T08:42:54.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.133+0000 7f46756bd640 1 -- start start 2024-04-25T08:42:54.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f46756bd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f465c0039b0 0x7f467015dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f46756bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f467014f530 0x7f4670140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f46756bd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46700b43e0 0x7f46700b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f46756bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46700d2210 con 0x7f467014f530 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f46756bd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46700d1a00 con 0x7f46700b43e0 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f46756bd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46700b6ab0 con 0x7f465c0039b0 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f4667fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f467014f530 0x7f4670140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f4667fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f467014f530 0x7f4670140cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50742/0 (socket says 172.21.15.172:50742) 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f4667fff640 1 -- 172.21.15.172:0/460024887 learned_addr learned my addr 172.21.15.172:0/460024887 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f466f7fe640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46700b43e0 0x7f46700b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f466effd640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f465c0039b0 0x7f467015dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f4667fff640 1 -- 172.21.15.172:0/460024887 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f465c0039b0 msgr2=0x7f467015dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f4667fff640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f465c0039b0 0x7f467015dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f4667fff640 1 -- 172.21.15.172:0/460024887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46700b43e0 msgr2=0x7f46700b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f4667fff640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46700b43e0 0x7f46700b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.134+0000 7f4667fff640 1 -- 172.21.15.172:0/460024887 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670160da0 con 0x7f467014f530 2024-04-25T08:42:54.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.135+0000 7f4667fff640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f467014f530 0x7f4670140cf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f465800f5c0 tx=0x7f465800fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.135+0000 7f46677fe640 1 -- 172.21.15.172:0/460024887 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580052e0 con 0x7f467014f530 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.135+0000 7f46677fe640 1 -- 172.21.15.172:0/460024887 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4658018070 con 0x7f467014f530 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.135+0000 7f46677fe640 1 -- 172.21.15.172:0/460024887 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658003830 con 0x7f467014f530 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.135+0000 7f46756bd640 1 -- 172.21.15.172:0/460024887 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46700b3900 con 0x7f467014f530 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.135+0000 7f46756bd640 1 -- 172.21.15.172:0/460024887 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46700b3ec0 con 0x7f467014f530 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.136+0000 7f46756bd640 1 -- 172.21.15.172:0/460024887 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46701588d0 con 0x7f467014f530 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.136+0000 7f46677fe640 1 -- 172.21.15.172:0/460024887 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f46580039d0 con 0x7f467014f530 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.137+0000 7f46677fe640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f465006b4d0 0x7f465006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.137+0000 7f46677fe640 1 -- 172.21.15.172:0/460024887 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f465808a340 con 0x7f467014f530 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.137+0000 7f466effd640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f465006b4d0 0x7f465006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.137+0000 7f466effd640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f465006b4d0 0x7f465006d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4660033000 tx=0x7f4660008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:54.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.141+0000 7f46677fe640 1 -- 172.21.15.172:0/460024887 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f46701588d0 con 0x7f467014f530 2024-04-25T08:42:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.317+0000 7f46756bd640 1 -- 172.21.15.172:0/460024887 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4670073990 con 0x7f467014f530 2024-04-25T08:42:54.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.319+0000 7f46677fe640 1 -- 172.21.15.172:0/460024887 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f4658058e80 con 0x7f467014f530 2024-04-25T08:42:54.311 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:54.311 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:54.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 -- 172.21.15.172:0/460024887 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f465006b4d0 msgr2=0x7f465006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f465006b4d0 0x7f465006d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4660033000 tx=0x7f4660008030 comp rx=0 tx=0).stop 2024-04-25T08:42:54.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 -- 172.21.15.172:0/460024887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f467014f530 msgr2=0x7f4670140cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f467014f530 0x7f4670140cf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f465800f5c0 tx=0x7f465800fa80 comp rx=0 tx=0).stop 2024-04-25T08:42:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 -- 172.21.15.172:0/460024887 shutdown_connections 2024-04-25T08:42:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f465006b4d0 0x7f465006d990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46700b43e0 0x7f46700b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f467014f530 0x7f4670140cf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 --2- 172.21.15.172:0/460024887 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f465c0039b0 0x7f467015dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 -- 172.21.15.172:0/460024887 >> 172.21.15.172:0/460024887 conn(0x7f4670061a20 msgr2=0x7f4670157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 -- 172.21.15.172:0/460024887 shutdown_connections 2024-04-25T08:42:54.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.321+0000 7f46756bd640 1 -- 172.21.15.172:0/460024887 wait complete. 2024-04-25T08:42:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:42:54.325 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:42:54.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.434+0000 7f7964ac4640 1 Processor -- start 2024-04-25T08:42:54.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.434+0000 7f7964ac4640 1 -- start start 2024-04-25T08:42:54.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f7964ac4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7960144d20 0x7f79600ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f7964ac4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601454b0 0x7f7960070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f7964ac4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79600ceba0 con 0x7f7960071300 2024-04-25T08:42:54.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f7964ac4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7960071750 con 0x7f7960144d20 2024-04-25T08:42:54.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f7964ac4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79600b4830 con 0x7f79601454b0 2024-04-25T08:42:54.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795ed9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7960071300 0x7f796015f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46294/0 (socket says 172.21.15.172:46294) 2024-04-25T08:42:54.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795ed9d640 1 -- 172.21.15.172:0/2220527756 learned_addr learned my addr 172.21.15.172:0/2220527756 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:54.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944889240 0 0) 0x7f79600ceba0 con 0x7f7960071300 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795e59c640 1 --2- 172.21.15.172:0/2220527756 >> v2:172.21.15.186:3300/0 conn(0x7f7960144d20 0x7f79600ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f7957fff640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601454b0 0x7f7960070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f794c003520 con 0x7f7960071300 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3846544532 0 0) 0x7f794c003520 con 0x7f7960071300 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601454b0 msgr2=0x7f7960070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601454b0 0x7f7960070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 >> v2:172.21.15.186:3300/0 conn(0x7f7960144d20 msgr2=0x7f79600ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 --2- 172.21.15.172:0/2220527756 >> v2:172.21.15.186:3300/0 conn(0x7f7960144d20 0x7f79600ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600cee80 con 0x7f7960071300 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f79580019f0 con 0x7f7960071300 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 >> v1:172.21.15.172:6789/0 conn(0x7f7960071300 legacy=0x7f796015f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c0039b0 0x7f794c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794c004800 0x7f794c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601454b0 0x7f794c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7960071750 con 0x7f794c004800 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79600b4830 con 0x7f794c0039b0 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.435+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c00b9c0 con 0x7f79601454b0 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.436+0000 7f7957fff640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794c004800 0x7f794c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.436+0000 7f795e59c640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c0039b0 0x7f794c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.436+0000 7f795ed9d640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601454b0 0x7f794c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.436+0000 7f7957fff640 1 -- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601454b0 msgr2=0x7f794c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.436+0000 7f7957fff640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601454b0 0x7f794c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.436+0000 7f7957fff640 1 -- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c0039b0 msgr2=0x7f794c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.436+0000 7f7957fff640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c0039b0 0x7f794c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.436+0000 7f7957fff640 1 -- 172.21.15.172:0/2220527756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c003520 con 0x7f794c004800 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.436+0000 7f795e59c640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c0039b0 0x7f794c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:42:54.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.436+0000 7f7957fff640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794c004800 0x7f794c004c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7948009ac0 tx=0x7f794c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bad23b0d95ae6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:54.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.437+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948036070 con 0x7f794c004800 2024-04-25T08:42:54.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.437+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7948031400 con 0x7f794c004800 2024-04-25T08:42:54.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.437+0000 7f795dd9b640 1 -- 172.21.15.172:0/2220527756 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948009690 con 0x7f794c004800 2024-04-25T08:42:54.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.437+0000 7f7964ac4640 1 -- 172.21.15.172:0/2220527756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794c004800 msgr2=0x7f794c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.437+0000 7f7964ac4640 1 --2- 172.21.15.172:0/2220527756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794c004800 0x7f794c004c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7948009ac0 tx=0x7f794c005830 comp rx=0 tx=0).stop 2024-04-25T08:42:54.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.437+0000 7f795ed9d640 1 -- 172.21.15.172:0/2220527756 reap_dead start 2024-04-25T08:42:54.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.437+0000 7f7964ac4640 1 -- 172.21.15.172:0/2220527756 shutdown_connections 2024-04-25T08:42:54.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.437+0000 7f7964ac4640 1 -- 172.21.15.172:0/2220527756 >> 172.21.15.172:0/2220527756 conn(0x7f79600b3530 msgr2=0x7f79600b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:54.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.437+0000 7f7964ac4640 1 -- 172.21.15.172:0/2220527756 shutdown_connections 2024-04-25T08:42:54.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.437+0000 7f7964ac4640 1 -- 172.21.15.172:0/2220527756 wait complete. 2024-04-25T08:42:54.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f7964ac4640 1 Processor -- start 2024-04-25T08:42:54.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f7964ac4640 1 -- start start 2024-04-25T08:42:54.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f7964ac4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c004800 0x7f79601e0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f7964ac4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601e2670 0x7f7960141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f7964ac4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796013e8c0 0x7f796013ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f7964ac4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79600ce890 con 0x7f796013e8c0 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f7964ac4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79600cf440 con 0x7f794c004800 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f7964ac4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7960145100 con 0x7f79601e2670 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f795ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796013e8c0 0x7f796013ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f795ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796013e8c0 0x7f796013ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50772/0 (socket says 172.21.15.172:50772) 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.439+0000 7f795ed9d640 1 -- 172.21.15.172:0/4255801905 learned_addr learned my addr 172.21.15.172:0/4255801905 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f7957fff640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601e2670 0x7f7960141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f795e59c640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c004800 0x7f79601e0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f795ed9d640 1 -- 172.21.15.172:0/4255801905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601e2670 msgr2=0x7f7960141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f795ed9d640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601e2670 0x7f7960141ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f795ed9d640 1 -- 172.21.15.172:0/4255801905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c004800 msgr2=0x7f79601e0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f795ed9d640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c004800 0x7f79601e0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f795ed9d640 1 -- 172.21.15.172:0/4255801905 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796013f260 con 0x7f796013e8c0 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f795e59c640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c004800 0x7f79601e0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f795ed9d640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796013e8c0 0x7f796013ed20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7960070ab0 tx=0x7f7958007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:54.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f7956ffd640 1 -- 172.21.15.172:0/4255801905 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950009690 con 0x7f796013e8c0 2024-04-25T08:42:54.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f7956ffd640 1 -- 172.21.15.172:0/4255801905 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7958019070 con 0x7f796013e8c0 2024-04-25T08:42:54.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f7956ffd640 1 -- 172.21.15.172:0/4255801905 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580133f0 con 0x7f796013e8c0 2024-04-25T08:42:54.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f7964ac4640 1 -- 172.21.15.172:0/4255801905 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79601e1360 con 0x7f796013e8c0 2024-04-25T08:42:54.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.440+0000 7f7964ac4640 1 -- 172.21.15.172:0/4255801905 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79601e1920 con 0x7f796013e8c0 2024-04-25T08:42:54.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.441+0000 7f7964ac4640 1 -- 172.21.15.172:0/4255801905 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7960073a00 con 0x7f796013e8c0 2024-04-25T08:42:54.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.442+0000 7f7956ffd640 1 -- 172.21.15.172:0/4255801905 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7958013590 con 0x7f796013e8c0 2024-04-25T08:42:54.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.442+0000 7f7956ffd640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794006b4d0 0x7f794006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.442+0000 7f7956ffd640 1 -- 172.21.15.172:0/4255801905 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f795808a930 con 0x7f796013e8c0 2024-04-25T08:42:54.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.442+0000 7f795e59c640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794006b4d0 0x7f794006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.442+0000 7f795e59c640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794006b4d0 0x7f794006d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7950009c60 tx=0x7f7950008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:54.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.446+0000 7f7956ffd640 1 -- 172.21.15.172:0/4255801905 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f796013f260 con 0x7f796013e8c0 2024-04-25T08:42:54.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.622+0000 7f7964ac4640 1 -- 172.21.15.172:0/4255801905 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79600b4200 con 0x7f796013e8c0 2024-04-25T08:42:54.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.623+0000 7f7956ffd640 1 -- 172.21.15.172:0/4255801905 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7958059470 con 0x7f796013e8c0 2024-04-25T08:42:54.615 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:42:54.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 -- 172.21.15.172:0/4255801905 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794006b4d0 msgr2=0x7f794006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794006b4d0 0x7f794006d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7950009c60 tx=0x7f7950008040 comp rx=0 tx=0).stop 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 -- 172.21.15.172:0/4255801905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796013e8c0 msgr2=0x7f796013ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796013e8c0 0x7f796013ed20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7960070ab0 tx=0x7f7958007b00 comp rx=0 tx=0).stop 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 -- 172.21.15.172:0/4255801905 shutdown_connections 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794006b4d0 0x7f794006d990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796013e8c0 0x7f796013ed20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79601e2670 0x7f7960141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 --2- 172.21.15.172:0/4255801905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f794c004800 0x7f79601e0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 -- 172.21.15.172:0/4255801905 >> 172.21.15.172:0/4255801905 conn(0x7f79600b3530 msgr2=0x7f79600b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 -- 172.21.15.172:0/4255801905 shutdown_connections 2024-04-25T08:42:54.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.625+0000 7f7964ac4640 1 -- 172.21.15.172:0/4255801905 wait complete. 2024-04-25T08:42:54.628 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:42:54.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.736+0000 7feedab3b640 1 Processor -- start 2024-04-25T08:42:54.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.736+0000 7feedab3b640 1 -- start start 2024-04-25T08:42:54.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feedab3b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feed406ccd0 0x7feed40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feedab3b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7feed415deb0 0x7feed415e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feedab3b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed40d1770 con 0x7feed4070dc0 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feedab3b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed41622b0 con 0x7feed406ccd0 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feedab3b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed40b10f0 con 0x7feed415deb0 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feed3fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feed406ccd0 0x7feed40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feed3fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feed406ccd0 0x7feed40b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50774/0 (socket says 172.21.15.172:50774) 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feed3fff640 1 -- 172.21.15.172:0/996744870 learned_addr learned my addr 172.21.15.172:0/996744870 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feed90d8640 1 --2- 172.21.15.172:0/996744870 >> v2:172.21.15.186:3300/0 conn(0x7feed415deb0 0x7feed415e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feed3fff640 1 -- 172.21.15.172:0/996744870 >> v2:172.21.15.186:3300/0 conn(0x7feed415deb0 msgr2=0x7feed415e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feed3fff640 1 --2- 172.21.15.172:0/996744870 >> v2:172.21.15.186:3300/0 conn(0x7feed415deb0 0x7feed415e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feed3fff640 1 -- 172.21.15.172:0/996744870 >> v1:172.21.15.186:6789/0 conn(0x7feed4070dc0 legacy=0x7feed40711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.737+0000 7feed3fff640 1 -- 172.21.15.172:0/996744870 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed4162740 con 0x7feed406ccd0 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.738+0000 7feed3fff640 1 --2- 172.21.15.172:0/996744870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed406ccd0 0x7feed40b07a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feed406de30 tx=0x7feec802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63799c6ffc706ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.738+0000 7feed37fe640 1 -- 172.21.15.172:0/996744870 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8037070 con 0x7feed406ccd0 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.738+0000 7feed37fe640 1 -- 172.21.15.172:0/996744870 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec802ae20 con 0x7feed406ccd0 2024-04-25T08:42:54.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.738+0000 7feed37fe640 1 -- 172.21.15.172:0/996744870 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8032660 con 0x7feed406ccd0 2024-04-25T08:42:54.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.739+0000 7feedab3b640 1 -- 172.21.15.172:0/996744870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed406ccd0 msgr2=0x7feed40b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.739+0000 7feedab3b640 1 --2- 172.21.15.172:0/996744870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed406ccd0 0x7feed40b07a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feed406de30 tx=0x7feec802a110 comp rx=0 tx=0).stop 2024-04-25T08:42:54.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.739+0000 7feedab3b640 1 -- 172.21.15.172:0/996744870 shutdown_connections 2024-04-25T08:42:54.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.739+0000 7feedab3b640 1 --2- 172.21.15.172:0/996744870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed406ccd0 0x7feed40b07a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.739+0000 7feedab3b640 1 --2- 172.21.15.172:0/996744870 >> v2:172.21.15.186:3300/0 conn(0x7feed415deb0 0x7feed415e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.739+0000 7feedab3b640 1 -- 172.21.15.172:0/996744870 >> 172.21.15.172:0/996744870 conn(0x7feed40b3530 msgr2=0x7feed40b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:54.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.739+0000 7feedab3b640 1 -- 172.21.15.172:0/996744870 shutdown_connections 2024-04-25T08:42:54.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.739+0000 7feedab3b640 1 -- 172.21.15.172:0/996744870 wait complete. 2024-04-25T08:42:54.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.740+0000 7feedab3b640 1 Processor -- start 2024-04-25T08:42:54.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.740+0000 7feedab3b640 1 -- start start 2024-04-25T08:42:54.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feedab3b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feed406ccd0 0x7feed414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feedab3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed4070dc0 0x7feed415f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feedab3b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feed415deb0 0x7feed406ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feedab3b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed4161f40 con 0x7feed4070dc0 2024-04-25T08:42:54.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feedab3b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed4161c60 con 0x7feed415deb0 2024-04-25T08:42:54.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feedab3b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed40b5840 con 0x7feed406ccd0 2024-04-25T08:42:54.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed4070dc0 0x7feed415f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed4070dc0 0x7feed415f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50782/0 (socket says 172.21.15.172:50782) 2024-04-25T08:42:54.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed3fff640 1 -- 172.21.15.172:0/710683878 learned_addr learned my addr 172.21.15.172:0/710683878 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:54.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed90d8640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feed415deb0 0x7feed406ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed88d7640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feed406ccd0 0x7feed414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed3fff640 1 -- 172.21.15.172:0/710683878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feed406ccd0 msgr2=0x7feed414e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed3fff640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feed406ccd0 0x7feed414e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed3fff640 1 -- 172.21.15.172:0/710683878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feed415deb0 msgr2=0x7feed406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed3fff640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feed415deb0 0x7feed406ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed3fff640 1 -- 172.21.15.172:0/710683878 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed415fe10 con 0x7feed4070dc0 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.741+0000 7feed90d8640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feed415deb0 0x7feed406ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.742+0000 7feed3fff640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed4070dc0 0x7feed415f350 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feec802a150 tx=0x7feec80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.742+0000 7feed17fa640 1 -- 172.21.15.172:0/710683878 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8041070 con 0x7feed4070dc0 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.742+0000 7feed17fa640 1 -- 172.21.15.172:0/710683878 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec803c680 con 0x7feed4070dc0 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.742+0000 7feedab3b640 1 -- 172.21.15.172:0/710683878 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed41600f0 con 0x7feed4070dc0 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.742+0000 7feed17fa640 1 -- 172.21.15.172:0/710683878 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8037040 con 0x7feed4070dc0 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.742+0000 7feedab3b640 1 -- 172.21.15.172:0/710683878 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed40cb030 con 0x7feed4070dc0 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.743+0000 7feedab3b640 1 -- 172.21.15.172:0/710683878 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed4073a00 con 0x7feed4070dc0 2024-04-25T08:42:54.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.743+0000 7feed17fa640 1 -- 172.21.15.172:0/710683878 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feec8044070 con 0x7feed4070dc0 2024-04-25T08:42:54.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.744+0000 7feed17fa640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feec006b4d0 0x7feec006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:54.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.744+0000 7feed88d7640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feec006b4d0 0x7feec006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:54.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.744+0000 7feed17fa640 1 -- 172.21.15.172:0/710683878 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7feec80aad50 con 0x7feed4070dc0 2024-04-25T08:42:54.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.744+0000 7feed88d7640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feec006b4d0 0x7feec006d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feec40015d0 tx=0x7feec4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:54.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.748+0000 7feed17fa640 1 -- 172.21.15.172:0/710683878 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feec80ae030 con 0x7feed4070dc0 2024-04-25T08:42:54.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.920+0000 7feedab3b640 1 -- 172.21.15.172:0/710683878 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feed4074550 con 0x7feed4070dc0 2024-04-25T08:42:54.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.921+0000 7feed17fa640 1 -- 172.21.15.172:0/710683878 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7feec802ae20 con 0x7feed4070dc0 2024-04-25T08:42:54.913 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:42:54.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.922+0000 7feedab3b640 1 -- 172.21.15.172:0/710683878 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feec006b4d0 msgr2=0x7feec006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.922+0000 7feedab3b640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feec006b4d0 0x7feec006d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feec40015d0 tx=0x7feec4009040 comp rx=0 tx=0).stop 2024-04-25T08:42:54.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.922+0000 7feedab3b640 1 -- 172.21.15.172:0/710683878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed4070dc0 msgr2=0x7feed415f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:54.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.922+0000 7feedab3b640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed4070dc0 0x7feed415f350 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feec802a150 tx=0x7feec80046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.923+0000 7feedab3b640 1 -- 172.21.15.172:0/710683878 shutdown_connections 2024-04-25T08:42:54.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.923+0000 7feedab3b640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feec006b4d0 0x7feec006d990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.923+0000 7feedab3b640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feed415deb0 0x7feed406ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.923+0000 7feedab3b640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feed4070dc0 0x7feed415f350 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.923+0000 7feedab3b640 1 --2- 172.21.15.172:0/710683878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feed406ccd0 0x7feed414e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:54.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.923+0000 7feedab3b640 1 -- 172.21.15.172:0/710683878 >> 172.21.15.172:0/710683878 conn(0x7feed40b3530 msgr2=0x7feed415d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:54.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.923+0000 7feedab3b640 1 -- 172.21.15.172:0/710683878 shutdown_connections 2024-04-25T08:42:54.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:54.923+0000 7feedab3b640 1 -- 172.21.15.172:0/710683878 wait complete. 2024-04-25T08:42:54.926 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:42:55.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.033+0000 7f6a0a7ce640 1 Processor -- start 2024-04-25T08:42:55.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.034+0000 7f6a0a7ce640 1 -- start start 2024-04-25T08:42:55.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.034+0000 7f6a0a7ce640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6a0415b980 0x7f6a040cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.034+0000 7f6a0a7ce640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a040cf320 con 0x7f6a0415b5a0 2024-04-25T08:42:55.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.034+0000 7f6a0a7ce640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a040cf040 con 0x7f6a040b5c40 2024-04-25T08:42:55.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.034+0000 7f6a0a7ce640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a04161970 con 0x7f6a0415b980 2024-04-25T08:42:55.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.034+0000 7f6a08d6b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6a0415b980 0x7f6a040cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.034+0000 7f6a03fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6a0415b5a0 0x7f6a040b5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46296/0 (socket says 172.21.15.172:46296) 2024-04-25T08:42:55.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.034+0000 7f6a03fff640 1 -- 172.21.15.172:0/3883681456 learned_addr learned my addr 172.21.15.172:0/3883681456 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:55.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.035+0000 7f6a08d6b640 1 -- 172.21.15.172:0/3883681456 >> v1:172.21.15.186:6789/0 conn(0x7f6a040b5c40 legacy=0x7f6a040ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:55.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.035+0000 7f6a08d6b640 1 -- 172.21.15.172:0/3883681456 >> v1:172.21.15.172:6789/0 conn(0x7f6a0415b5a0 legacy=0x7f6a040b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.035+0000 7f6a08d6b640 1 -- 172.21.15.172:0/3883681456 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04161c50 con 0x7f6a0415b980 2024-04-25T08:42:55.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.035+0000 7f6a08d6b640 1 --2- 172.21.15.172:0/3883681456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 0x7f6a040cea20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009d90 tx=0x7f69fc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6967f8f8acaba95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.035+0000 7f6a02ffd640 1 -- 172.21.15.172:0/3883681456 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc007740 con 0x7f6a0415b980 2024-04-25T08:42:55.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.036+0000 7f6a02ffd640 1 -- 172.21.15.172:0/3883681456 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc0078e0 con 0x7f6a0415b980 2024-04-25T08:42:55.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.036+0000 7f6a02ffd640 1 -- 172.21.15.172:0/3883681456 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc007cb0 con 0x7f6a0415b980 2024-04-25T08:42:55.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.036+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/3883681456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 msgr2=0x7f6a040cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.036+0000 7f6a0a7ce640 1 --2- 172.21.15.172:0/3883681456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 0x7f6a040cea20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009d90 tx=0x7f69fc02a6a0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.036+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/3883681456 shutdown_connections 2024-04-25T08:42:55.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.036+0000 7f6a0a7ce640 1 --2- 172.21.15.172:0/3883681456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 0x7f6a040cea20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.036+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/3883681456 >> 172.21.15.172:0/3883681456 conn(0x7f6a040d0530 msgr2=0x7f6a040d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:55.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.036+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/3883681456 shutdown_connections 2024-04-25T08:42:55.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.036+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/3883681456 wait complete. 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.037+0000 7f6a0a7ce640 1 Processor -- start 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.037+0000 7f6a0a7ce640 1 -- start start 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.038+0000 7f6a0a7ce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a040b5c40 0x7f6a040b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.038+0000 7f6a0a7ce640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0415b5a0 0x7f6a040b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.038+0000 7f6a0a7ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 0x7f6a04154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.038+0000 7f6a0a7ce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a041625d0 con 0x7f6a0415b980 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.038+0000 7f6a0a7ce640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a04162450 con 0x7f6a0415b5a0 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.038+0000 7f6a0a7ce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a04162750 con 0x7f6a040b5c40 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.038+0000 7f6a08d6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 0x7f6a04154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.038+0000 7f6a08d6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 0x7f6a04154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50800/0 (socket says 172.21.15.172:50800) 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.038+0000 7f6a08d6b640 1 -- 172.21.15.172:0/1710453327 learned_addr learned my addr 172.21.15.172:0/1710453327 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:55.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.038+0000 7f6a037fe640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0415b5a0 0x7f6a040b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a03fff640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a040b5c40 0x7f6a040b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a08d6b640 1 -- 172.21.15.172:0/1710453327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a040b5c40 msgr2=0x7f6a040b84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a08d6b640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a040b5c40 0x7f6a040b84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a08d6b640 1 -- 172.21.15.172:0/1710453327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0415b5a0 msgr2=0x7f6a040b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a08d6b640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0415b5a0 0x7f6a040b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a08d6b640 1 -- 172.21.15.172:0/1710453327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a040c7680 con 0x7f6a0415b980 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a037fe640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0415b5a0 0x7f6a040b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a08d6b640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 0x7f6a04154a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009d90 tx=0x7f69fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a00ff9640 1 -- 172.21.15.172:0/1710453327 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc040070 con 0x7f6a0415b980 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a00ff9640 1 -- 172.21.15.172:0/1710453327 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc031c90 con 0x7f6a0415b980 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/1710453327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a040c7960 con 0x7f6a0415b980 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a00ff9640 1 -- 172.21.15.172:0/1710453327 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc03c640 con 0x7f6a0415b980 2024-04-25T08:42:55.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.039+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/1710453327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a040c7f20 con 0x7f6a0415b980 2024-04-25T08:42:55.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.040+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/1710453327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a04073a00 con 0x7f6a0415b980 2024-04-25T08:42:55.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.040+0000 7f6a00ff9640 1 -- 172.21.15.172:0/1710453327 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f69fc039040 con 0x7f6a0415b980 2024-04-25T08:42:55.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.041+0000 7f6a00ff9640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69f006b500 0x7f69f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.041+0000 7f6a00ff9640 1 -- 172.21.15.172:0/1710453327 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f69fc0abb20 con 0x7f6a0415b980 2024-04-25T08:42:55.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.041+0000 7f6a03fff640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69f006b500 0x7f69f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.041+0000 7f6a03fff640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69f006b500 0x7f69f006d9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f69f4000f60 tx=0x7f69f4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.045+0000 7f6a00ff9640 1 -- 172.21.15.172:0/1710453327 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69fc04b340 con 0x7f6a0415b980 2024-04-25T08:42:55.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.214+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/1710453327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a040b9260 con 0x7f6a0415b980 2024-04-25T08:42:55.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.214+0000 7f6a00ff9640 1 -- 172.21.15.172:0/1710453327 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69fc07a720 con 0x7f6a0415b980 2024-04-25T08:42:55.207 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/1710453327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69f006b500 msgr2=0x7f69f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69f006b500 0x7f69f006d9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f69f4000f60 tx=0x7f69f4009040 comp rx=0 tx=0).stop 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/1710453327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 msgr2=0x7f6a04154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 0x7f6a04154a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009d90 tx=0x7f69fc004a40 comp rx=0 tx=0).stop 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/1710453327 shutdown_connections 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69f006b500 0x7f69f006d9c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0415b5a0 0x7f6a040b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0415b980 0x7f6a04154a30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 --2- 172.21.15.172:0/1710453327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a040b5c40 0x7f6a040b84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/1710453327 >> 172.21.15.172:0/1710453327 conn(0x7f6a040d0530 msgr2=0x7f6a0415be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:55.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.216+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/1710453327 shutdown_connections 2024-04-25T08:42:55.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.217+0000 7f6a0a7ce640 1 -- 172.21.15.172:0/1710453327 wait complete. 2024-04-25T08:42:55.220 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:42:55.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.327+0000 7f75a30b3640 1 Processor -- start 2024-04-25T08:42:55.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.327+0000 7f75a30b3640 1 -- start start 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.328+0000 7f75a30b3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f759c15b7d0 0x7f759c0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.328+0000 7f75a30b3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c06cf50 con 0x7f759c06c9e0 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.328+0000 7f75a30b3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c0ce530 con 0x7f759c0b5620 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.328+0000 7f75a30b3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c0ce810 con 0x7f759c15b7d0 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.328+0000 7f75a0e4f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f759c15b7d0 0x7f759c0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.328+0000 7f75a1650640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f759c06c9e0 0x7f759c0d1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46306/0 (socket says 172.21.15.172:46306) 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.328+0000 7f75a1650640 1 -- 172.21.15.172:0/2520995281 learned_addr learned my addr 172.21.15.172:0/2520995281 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.329+0000 7f75a0e4f640 1 -- 172.21.15.172:0/2520995281 >> v1:172.21.15.186:6789/0 conn(0x7f759c0b5620 legacy=0x7f759c06c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.329+0000 7f75a0e4f640 1 -- 172.21.15.172:0/2520995281 >> v1:172.21.15.172:6789/0 conn(0x7f759c06c9e0 legacy=0x7f759c0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.329+0000 7f759b7fe640 1 -- 172.21.15.172:0/2520995281 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9688193 0 0) 0x7f759c06cf50 con 0x7f759c06c9e0 2024-04-25T08:42:55.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.329+0000 7f75a0e4f640 1 -- 172.21.15.172:0/2520995281 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c0ceaf0 con 0x7f759c15b7d0 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.329+0000 7f75a0e4f640 1 --2- 172.21.15.172:0/2520995281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 0x7f759c0cf010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f758c0097a0 tx=0x7f758c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756cc1681869e0c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.329+0000 7f759b7fe640 1 -- 172.21.15.172:0/2520995281 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c037070 con 0x7f759c15b7d0 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.329+0000 7f759b7fe640 1 -- 172.21.15.172:0/2520995281 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c032440 con 0x7f759c15b7d0 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.329+0000 7f759b7fe640 1 -- 172.21.15.172:0/2520995281 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c032810 con 0x7f759c15b7d0 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.330+0000 7f75a30b3640 1 -- 172.21.15.172:0/2520995281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 msgr2=0x7f759c0cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.330+0000 7f75a30b3640 1 --2- 172.21.15.172:0/2520995281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 0x7f759c0cf010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f758c0097a0 tx=0x7f758c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.330+0000 7f75a30b3640 1 -- 172.21.15.172:0/2520995281 shutdown_connections 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.330+0000 7f75a30b3640 1 --2- 172.21.15.172:0/2520995281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 0x7f759c0cf010 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.330+0000 7f75a30b3640 1 -- 172.21.15.172:0/2520995281 >> 172.21.15.172:0/2520995281 conn(0x7f759c0d0800 msgr2=0x7f759c0d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.330+0000 7f75a30b3640 1 -- 172.21.15.172:0/2520995281 shutdown_connections 2024-04-25T08:42:55.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.330+0000 7f75a30b3640 1 -- 172.21.15.172:0/2520995281 wait complete. 2024-04-25T08:42:55.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.331+0000 7f75a30b3640 1 Processor -- start 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.331+0000 7f75a30b3640 1 -- start start 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a30b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f759c06c9e0 0x7f759c1486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a30b3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f759c0b5620 0x7f759c0ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a30b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 0x7f759c0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a30b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0cf6d0 con 0x7f759c15b7d0 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a30b3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0cf550 con 0x7f759c0b5620 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a30b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c15bbb0 con 0x7f759c06c9e0 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a1650640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 0x7f759c0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a1650640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 0x7f759c0cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50822/0 (socket says 172.21.15.172:50822) 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a1650640 1 -- 172.21.15.172:0/2663963738 learned_addr learned my addr 172.21.15.172:0/2663963738 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a0e4f640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f759c06c9e0 0x7f759c1486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f759bfff640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f759c0b5620 0x7f759c0ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a1650640 1 -- 172.21.15.172:0/2663963738 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f759c06c9e0 msgr2=0x7f759c1486d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a1650640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f759c06c9e0 0x7f759c1486d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a1650640 1 -- 172.21.15.172:0/2663963738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f759c0b5620 msgr2=0x7f759c0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a1650640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f759c0b5620 0x7f759c0ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.332+0000 7f75a1650640 1 -- 172.21.15.172:0/2663963738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c0cd720 con 0x7f759c15b7d0 2024-04-25T08:42:55.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.333+0000 7f75a1650640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 0x7f759c0cd130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f759400c830 tx=0x7f759400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.333+0000 7f75997fa640 1 -- 172.21.15.172:0/2663963738 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594018070 con 0x7f759c15b7d0 2024-04-25T08:42:55.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.333+0000 7f75997fa640 1 -- 172.21.15.172:0/2663963738 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759400ce20 con 0x7f759c15b7d0 2024-04-25T08:42:55.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.333+0000 7f75a30b3640 1 -- 172.21.15.172:0/2663963738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c0cda00 con 0x7f759c15b7d0 2024-04-25T08:42:55.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.333+0000 7f75997fa640 1 -- 172.21.15.172:0/2663963738 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759400a880 con 0x7f759c15b7d0 2024-04-25T08:42:55.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.333+0000 7f75a30b3640 1 -- 172.21.15.172:0/2663963738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c1582c0 con 0x7f759c15b7d0 2024-04-25T08:42:55.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.334+0000 7f75a30b3640 1 -- 172.21.15.172:0/2663963738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c073a00 con 0x7f759c15b7d0 2024-04-25T08:42:55.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.334+0000 7f75997fa640 1 -- 172.21.15.172:0/2663963738 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f759401b070 con 0x7f759c15b7d0 2024-04-25T08:42:55.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.334+0000 7f75997fa640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f758806b4d0 0x7f758806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.335+0000 7f75997fa640 1 -- 172.21.15.172:0/2663963738 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7594089a60 con 0x7f759c15b7d0 2024-04-25T08:42:55.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.335+0000 7f75a0e4f640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f758806b4d0 0x7f758806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.335+0000 7f75a0e4f640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f758806b4d0 0x7f758806d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f758c034000 tx=0x7f758c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.339+0000 7f75997fa640 1 -- 172.21.15.172:0/2663963738 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7594058660 con 0x7f759c15b7d0 2024-04-25T08:42:55.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.507+0000 7f75a30b3640 1 -- 172.21.15.172:0/2663963738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f759c0b6560 con 0x7f759c15b7d0 2024-04-25T08:42:55.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.508+0000 7f75997fa640 1 -- 172.21.15.172:0/2663963738 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7594057f60 con 0x7f759c15b7d0 2024-04-25T08:42:55.500 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:42:55.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 -- 172.21.15.172:0/2663963738 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f758806b4d0 msgr2=0x7f758806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f758806b4d0 0x7f758806d990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f758c034000 tx=0x7f758c02e000 comp rx=0 tx=0).stop 2024-04-25T08:42:55.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 -- 172.21.15.172:0/2663963738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 msgr2=0x7f759c0cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 0x7f759c0cd130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f759400c830 tx=0x7f759400ccf0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 -- 172.21.15.172:0/2663963738 shutdown_connections 2024-04-25T08:42:55.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f758806b4d0 0x7f758806d990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f759c0b5620 0x7f759c0ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f759c15b7d0 0x7f759c0cd130 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 --2- 172.21.15.172:0/2663963738 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f759c06c9e0 0x7f759c1486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 -- 172.21.15.172:0/2663963738 >> 172.21.15.172:0/2663963738 conn(0x7f759c0d0800 msgr2=0x7f759c0b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:55.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 -- 172.21.15.172:0/2663963738 shutdown_connections 2024-04-25T08:42:55.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.510+0000 7f75a30b3640 1 -- 172.21.15.172:0/2663963738 wait complete. 2024-04-25T08:42:55.513 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:42:55.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.618+0000 7fc6e3110640 1 Processor -- start 2024-04-25T08:42:55.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.618+0000 7fc6e3110640 1 -- start start 2024-04-25T08:42:55.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6e3110640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6dc154ed0 0x7fc6dc0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6e3110640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc15ec60 con 0x7fc6dc071ac0 2024-04-25T08:42:55.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6e3110640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc15ef40 con 0x7fc6dc06c1d0 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6e3110640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc06db90 con 0x7fc6dc154ed0 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6e0eac640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6dc154ed0 0x7fc6dc0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6dbfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc6dc071ac0 0x7fc6dc0ad410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46310/0 (socket says 172.21.15.172:46310) 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6dbfff640 1 -- 172.21.15.172:0/1536812311 learned_addr learned my addr 172.21.15.172:0/1536812311 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6e0eac640 1 -- 172.21.15.172:0/1536812311 >> v1:172.21.15.186:6789/0 conn(0x7fc6dc06c1d0 legacy=0x7fc6dc06afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6e0eac640 1 -- 172.21.15.172:0/1536812311 >> v1:172.21.15.172:6789/0 conn(0x7fc6dc071ac0 legacy=0x7fc6dc0ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6db7fe640 1 -- 172.21.15.172:0/1536812311 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356569529 0 0) 0x7fc6dc15ec60 con 0x7fc6dc071ac0 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.619+0000 7fc6e0eac640 1 -- 172.21.15.172:0/1536812311 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc06de70 con 0x7fc6dc154ed0 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.620+0000 7fc6e0eac640 1 --2- 172.21.15.172:0/1536812311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc154ed0 0x7fc6dc0aced0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00097a0 tx=0x7fc6d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394d6d17af358f04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.620+0000 7fc6db7fe640 1 -- 172.21.15.172:0/1536812311 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0037070 con 0x7fc6dc154ed0 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.620+0000 7fc6db7fe640 1 -- 172.21.15.172:0/1536812311 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d002ae50 con 0x7fc6dc154ed0 2024-04-25T08:42:55.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.620+0000 7fc6db7fe640 1 -- 172.21.15.172:0/1536812311 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0032660 con 0x7fc6dc154ed0 2024-04-25T08:42:55.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.621+0000 7fc6e3110640 1 -- 172.21.15.172:0/1536812311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc154ed0 msgr2=0x7fc6dc0aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.621+0000 7fc6e3110640 1 --2- 172.21.15.172:0/1536812311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc154ed0 0x7fc6dc0aced0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00097a0 tx=0x7fc6d002a140 comp rx=0 tx=0).stop 2024-04-25T08:42:55.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.621+0000 7fc6e3110640 1 -- 172.21.15.172:0/1536812311 shutdown_connections 2024-04-25T08:42:55.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.621+0000 7fc6e3110640 1 --2- 172.21.15.172:0/1536812311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc154ed0 0x7fc6dc0aced0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.621+0000 7fc6e3110640 1 -- 172.21.15.172:0/1536812311 >> 172.21.15.172:0/1536812311 conn(0x7fc6dc0af670 msgr2=0x7fc6dc0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:55.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.621+0000 7fc6e3110640 1 -- 172.21.15.172:0/1536812311 shutdown_connections 2024-04-25T08:42:55.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.621+0000 7fc6e3110640 1 -- 172.21.15.172:0/1536812311 wait complete. 2024-04-25T08:42:55.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.622+0000 7fc6e3110640 1 Processor -- start 2024-04-25T08:42:55.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.622+0000 7fc6e3110640 1 -- start start 2024-04-25T08:42:55.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e3110640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc071ac0 0x7fc6dc0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e3110640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6dc154ed0 0x7fc6dc1f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e3110640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6dc1f77c0 0x7fc6dc1f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e3110640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc06b830 con 0x7fc6dc071ac0 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e3110640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc06b6b0 con 0x7fc6dc1f77c0 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e3110640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc06b9b0 con 0x7fc6dc154ed0 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e0eac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc071ac0 0x7fc6dc0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e0eac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc071ac0 0x7fc6dc0ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50852/0 (socket says 172.21.15.172:50852) 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e0eac640 1 -- 172.21.15.172:0/3767072290 learned_addr learned my addr 172.21.15.172:0/3767072290 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e0eac640 1 -- 172.21.15.172:0/3767072290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6dc154ed0 msgr2=0x7fc6dc1f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e0eac640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6dc154ed0 0x7fc6dc1f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e0eac640 1 -- 172.21.15.172:0/3767072290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6dc1f77c0 msgr2=0x7fc6dc1f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e0eac640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6dc1f77c0 0x7fc6dc1f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e0eac640 1 -- 172.21.15.172:0/3767072290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc0b06c0 con 0x7fc6dc071ac0 2024-04-25T08:42:55.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e0eac640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc071ac0 0x7fc6dc0ceae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00097a0 tx=0x7fc6d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6d97fa640 1 -- 172.21.15.172:0/3767072290 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0042070 con 0x7fc6dc071ac0 2024-04-25T08:42:55.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6d97fa640 1 -- 172.21.15.172:0/3767072290 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d003e670 con 0x7fc6dc071ac0 2024-04-25T08:42:55.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6e3110640 1 -- 172.21.15.172:0/3767072290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6dc0b09a0 con 0x7fc6dc071ac0 2024-04-25T08:42:55.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.623+0000 7fc6d97fa640 1 -- 172.21.15.172:0/3767072290 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0037040 con 0x7fc6dc071ac0 2024-04-25T08:42:55.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.624+0000 7fc6e3110640 1 -- 172.21.15.172:0/3767072290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6dc0b0f60 con 0x7fc6dc071ac0 2024-04-25T08:42:55.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.625+0000 7fc6e3110640 1 -- 172.21.15.172:0/3767072290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6dc0b3c90 con 0x7fc6dc071ac0 2024-04-25T08:42:55.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.625+0000 7fc6d97fa640 1 -- 172.21.15.172:0/3767072290 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc6d0045070 con 0x7fc6dc071ac0 2024-04-25T08:42:55.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.625+0000 7fc6d97fa640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6c006b4d0 0x7fc6c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.625+0000 7fc6d97fa640 1 -- 172.21.15.172:0/3767072290 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc6d00aade0 con 0x7fc6dc071ac0 2024-04-25T08:42:55.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.625+0000 7fc6dbfff640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6c006b4d0 0x7fc6c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.626+0000 7fc6dbfff640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6c006b4d0 0x7fc6c006d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8007fd0 tx=0x7fc6c8007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.629+0000 7fc6d97fa640 1 -- 172.21.15.172:0/3767072290 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc6d0079a40 con 0x7fc6dc071ac0 2024-04-25T08:42:55.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.835+0000 7fc6e3110640 1 -- 172.21.15.172:0/3767072290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6dc14feb0 con 0x7fc6dc071ac0 2024-04-25T08:42:55.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.835+0000 7fc6d97fa640 1 -- 172.21.15.172:0/3767072290 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4943 (secure 0 0 0) 0x7fc6d0079340 con 0x7fc6dc071ac0 2024-04-25T08:42:55.828 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:55.828 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:42:28.003161+0000","modified":"2024-04-25T08:42:49.090813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:42:55.828 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2024-04-25T08:42:55.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.837+0000 7fc6e3110640 1 -- 172.21.15.172:0/3767072290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6c006b4d0 msgr2=0x7fc6c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.837+0000 7fc6e3110640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6c006b4d0 0x7fc6c006d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8007fd0 tx=0x7fc6c8007920 comp rx=0 tx=0).stop 2024-04-25T08:42:55.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.837+0000 7fc6e3110640 1 -- 172.21.15.172:0/3767072290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc071ac0 msgr2=0x7fc6dc0ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.837+0000 7fc6e3110640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc071ac0 0x7fc6dc0ceae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00097a0 tx=0x7fc6d00046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.838+0000 7fc6e3110640 1 -- 172.21.15.172:0/3767072290 shutdown_connections 2024-04-25T08:42:55.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.838+0000 7fc6e3110640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6c006b4d0 0x7fc6c006d990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.838+0000 7fc6e3110640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6dc1f77c0 0x7fc6dc1f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.838+0000 7fc6e3110640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6dc154ed0 0x7fc6dc1f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.838+0000 7fc6e3110640 1 --2- 172.21.15.172:0/3767072290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6dc071ac0 0x7fc6dc0ceae0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.838+0000 7fc6e3110640 1 -- 172.21.15.172:0/3767072290 >> 172.21.15.172:0/3767072290 conn(0x7fc6dc06c1d0 msgr2=0x7fc6dc0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:55.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.838+0000 7fc6e3110640 1 -- 172.21.15.172:0/3767072290 shutdown_connections 2024-04-25T08:42:55.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.838+0000 7fc6e3110640 1 -- 172.21.15.172:0/3767072290 wait complete. 2024-04-25T08:42:55.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:55.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.946+0000 7f6d4ee9e640 1 Processor -- start 2024-04-25T08:42:55.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.947+0000 7f6d4ee9e640 1 -- start start 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.947+0000 7f6d4ee9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4815da70 0x7f6d480d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.947+0000 7f6d4ee9e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6d480c7730 0x7f6d480ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.947+0000 7f6d4ee9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6d480c7b90 0x7f6d480ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.947+0000 7f6d4ee9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d480c8030 con 0x7f6d480c7b90 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.947+0000 7f6d4ee9e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d480c8310 con 0x7f6d480c7730 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.947+0000 7f6d4ee9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480c85f0 con 0x7f6d4815da70 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4d43b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6d480c7b90 0x7f6d480ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4d43b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6d480c7b90 0x7f6d480ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50860/0 (socket says 172.21.15.172:50860) 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4d43b640 1 -- 172.21.15.172:0/3263089206 learned_addr learned my addr 172.21.15.172:0/3263089206 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d3ffff640 1 --2- 172.21.15.172:0/3263089206 >> v2:172.21.15.186:3300/0 conn(0x7f6d480c7730 0x7f6d480ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4cc3a640 1 --2- 172.21.15.172:0/3263089206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4815da70 0x7f6d480d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4d43b640 1 -- 172.21.15.172:0/3263089206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4815da70 msgr2=0x7f6d480d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:55.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4d43b640 1 --2- 172.21.15.172:0/3263089206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4815da70 0x7f6d480d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4d43b640 1 -- 172.21.15.172:0/3263089206 >> v2:172.21.15.186:3300/0 conn(0x7f6d480c7730 msgr2=0x7f6d480ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:55.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4d43b640 1 --2- 172.21.15.172:0/3263089206 >> v2:172.21.15.186:3300/0 conn(0x7f6d480c7730 0x7f6d480ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4d43b640 1 -- 172.21.15.172:0/3263089206 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4806bb30 con 0x7f6d480c7b90 2024-04-25T08:42:55.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4cc3a640 1 --2- 172.21.15.172:0/3263089206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4815da70 0x7f6d480d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:55.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.948+0000 7f6d4d43b640 1 --2- 172.21.15.172:0/3263089206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 0x7f6d480ce700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6d4806b9b0 tx=0x7f6d4002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6ed5930354565c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d3f7fe640 1 -- 172.21.15.172:0/3263089206 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40036070 con 0x7f6d480c7b90 2024-04-25T08:42:55.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d3f7fe640 1 -- 172.21.15.172:0/3263089206 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d40031600 con 0x7f6d480c7b90 2024-04-25T08:42:55.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d3f7fe640 1 -- 172.21.15.172:0/3263089206 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d400319d0 con 0x7f6d480c7b90 2024-04-25T08:42:55.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/3263089206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 msgr2=0x7f6d480ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d4ee9e640 1 --2- 172.21.15.172:0/3263089206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 0x7f6d480ce700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6d4806b9b0 tx=0x7f6d4002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/3263089206 shutdown_connections 2024-04-25T08:42:55.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d4ee9e640 1 --2- 172.21.15.172:0/3263089206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 0x7f6d480ce700 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d4ee9e640 1 --2- 172.21.15.172:0/3263089206 >> v2:172.21.15.186:3300/0 conn(0x7f6d480c7730 0x7f6d480ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d4ee9e640 1 --2- 172.21.15.172:0/3263089206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d4815da70 0x7f6d480d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/3263089206 >> 172.21.15.172:0/3263089206 conn(0x7f6d480b33e0 msgr2=0x7f6d480b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:55.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/3263089206 shutdown_connections 2024-04-25T08:42:55.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.949+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/3263089206 wait complete. 2024-04-25T08:42:55.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.950+0000 7f6d4ee9e640 1 Processor -- start 2024-04-25T08:42:55.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.950+0000 7f6d4ee9e640 1 -- start start 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.951+0000 7f6d4ee9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480c7730 0x7f6d480ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.951+0000 7f6d4ee9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 0x7f6d4814b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.951+0000 7f6d4ee9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d4815da70 0x7f6d480b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.951+0000 7f6d4ee9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48070c60 con 0x7f6d480c7b90 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.951+0000 7f6d4ee9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4815de50 con 0x7f6d4815da70 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.951+0000 7f6d4ee9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48070de0 con 0x7f6d480c7730 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.951+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 0x7f6d4814b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.951+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 0x7f6d4814b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50876/0 (socket says 172.21.15.172:50876) 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.951+0000 7f6d3ffff640 1 -- 172.21.15.172:0/681038411 learned_addr learned my addr 172.21.15.172:0/681038411 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d4d43b640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d4815da70 0x7f6d480b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d4cc3a640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480c7730 0x7f6d480ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d3ffff640 1 -- 172.21.15.172:0/681038411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480c7730 msgr2=0x7f6d480ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d3ffff640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480c7730 0x7f6d480ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d3ffff640 1 -- 172.21.15.172:0/681038411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d4815da70 msgr2=0x7f6d480b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d3ffff640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d4815da70 0x7f6d480b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d3ffff640 1 -- 172.21.15.172:0/681038411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480cdc70 con 0x7f6d480c7b90 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d4cc3a640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480c7730 0x7f6d480ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d3ffff640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 0x7f6d4814b200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800e9b0 tx=0x7f6d3800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d3d7fa640 1 -- 172.21.15.172:0/681038411 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38017070 con 0x7f6d480c7b90 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d3d7fa640 1 -- 172.21.15.172:0/681038411 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3800c9a0 con 0x7f6d480c7b90 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d3d7fa640 1 -- 172.21.15.172:0/681038411 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800cd90 con 0x7f6d480c7b90 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/681038411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d480cdf50 con 0x7f6d480c7b90 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.952+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/681038411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d480ce510 con 0x7f6d480c7b90 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.953+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/681038411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d48073990 con 0x7f6d480c7b90 2024-04-25T08:42:55.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.954+0000 7f6d3d7fa640 1 -- 172.21.15.172:0/681038411 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6d3801a070 con 0x7f6d480c7b90 2024-04-25T08:42:55.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.954+0000 7f6d3d7fa640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6d3406b4d0 0x7f6d3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:55.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.954+0000 7f6d4cc3a640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6d3406b4d0 0x7f6d3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:55.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.954+0000 7f6d3d7fa640 1 -- 172.21.15.172:0/681038411 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6d3808a580 con 0x7f6d480c7b90 2024-04-25T08:42:55.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.955+0000 7f6d4cc3a640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6d3406b4d0 0x7f6d3406d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d44006fd0 tx=0x7f6d44008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:55.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:55.958+0000 7f6d3d7fa640 1 -- 172.21.15.172:0/681038411 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6d380590c0 con 0x7f6d480c7b90 2024-04-25T08:42:56.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.129+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/681038411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d4815cfb0 con 0x7f6d480c7b90 2024-04-25T08:42:56.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.130+0000 7f6d3d7fa640 1 -- 172.21.15.172:0/681038411 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f6d380589c0 con 0x7f6d480c7b90 2024-04-25T08:42:56.123 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:56.123 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:56.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.132+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/681038411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6d3406b4d0 msgr2=0x7f6d3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.132+0000 7f6d4ee9e640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6d3406b4d0 0x7f6d3406d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6d44006fd0 tx=0x7f6d44008040 comp rx=0 tx=0).stop 2024-04-25T08:42:56.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.132+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/681038411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 msgr2=0x7f6d4814b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.132+0000 7f6d4ee9e640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 0x7f6d4814b200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800e9b0 tx=0x7f6d3800ee70 comp rx=0 tx=0).stop 2024-04-25T08:42:56.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.133+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/681038411 shutdown_connections 2024-04-25T08:42:56.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.133+0000 7f6d4ee9e640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6d3406b4d0 0x7f6d3406d990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.133+0000 7f6d4ee9e640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d4815da70 0x7f6d480b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.133+0000 7f6d4ee9e640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d480c7b90 0x7f6d4814b200 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.133+0000 7f6d4ee9e640 1 --2- 172.21.15.172:0/681038411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d480c7730 0x7f6d480ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.133+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/681038411 >> 172.21.15.172:0/681038411 conn(0x7f6d480b33e0 msgr2=0x7f6d480b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:56.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.133+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/681038411 shutdown_connections 2024-04-25T08:42:56.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.133+0000 7f6d4ee9e640 1 -- 172.21.15.172:0/681038411 wait complete. 2024-04-25T08:42:56.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:42:56.136 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:42:56.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.244+0000 7f56e9288640 1 Processor -- start 2024-04-25T08:42:56.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.244+0000 7f56e9288640 1 -- start start 2024-04-25T08:42:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e9288640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56e415dc20 0x7f56e40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e9288640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f56e4161710 0x7f56e40cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e9288640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f56e40b9330 0x7f56e406bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e9288640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e415e000 con 0x7f56e4161710 2024-04-25T08:42:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e9288640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e40d1de0 con 0x7f56e40b9330 2024-04-25T08:42:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e9288640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4161c60 con 0x7f56e415dc20 2024-04-25T08:42:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e27fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f56e4161710 0x7f56e40cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e27fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f56e4161710 0x7f56e40cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50880/0 (socket says 172.21.15.172:50880) 2024-04-25T08:42:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e27fc640 1 -- 172.21.15.172:0/2741448493 learned_addr learned my addr 172.21.15.172:0/2741448493 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:56.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e37fe640 1 --2- 172.21.15.172:0/2741448493 >> v2:172.21.15.186:3300/0 conn(0x7f56e40b9330 0x7f56e406bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e27fc640 1 -- 172.21.15.172:0/2741448493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56e415dc20 msgr2=0x7f56e40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e27fc640 1 --2- 172.21.15.172:0/2741448493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56e415dc20 0x7f56e40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e27fc640 1 -- 172.21.15.172:0/2741448493 >> v2:172.21.15.186:3300/0 conn(0x7f56e40b9330 msgr2=0x7f56e406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e27fc640 1 --2- 172.21.15.172:0/2741448493 >> v2:172.21.15.186:3300/0 conn(0x7f56e40b9330 0x7f56e406bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.245+0000 7f56e27fc640 1 -- 172.21.15.172:0/2741448493 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4161f40 con 0x7f56e4161710 2024-04-25T08:42:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.246+0000 7f56e27fc640 1 --2- 172.21.15.172:0/2741448493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 0x7f56e40cebb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56e40b6570 tx=0x7f56d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503af63d5d0dff2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.246+0000 7f56e1ffb640 1 -- 172.21.15.172:0/2741448493 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8037070 con 0x7f56e4161710 2024-04-25T08:42:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.246+0000 7f56e1ffb640 1 -- 172.21.15.172:0/2741448493 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d8032440 con 0x7f56e4161710 2024-04-25T08:42:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.246+0000 7f56e1ffb640 1 -- 172.21.15.172:0/2741448493 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8032810 con 0x7f56e4161710 2024-04-25T08:42:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.247+0000 7f56e9288640 1 -- 172.21.15.172:0/2741448493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 msgr2=0x7f56e40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.247+0000 7f56e9288640 1 --2- 172.21.15.172:0/2741448493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 0x7f56e40cebb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f56e40b6570 tx=0x7f56d802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.247+0000 7f56e9288640 1 -- 172.21.15.172:0/2741448493 shutdown_connections 2024-04-25T08:42:56.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.247+0000 7f56e9288640 1 --2- 172.21.15.172:0/2741448493 >> v2:172.21.15.186:3300/0 conn(0x7f56e40b9330 0x7f56e406bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.247+0000 7f56e9288640 1 --2- 172.21.15.172:0/2741448493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 0x7f56e40cebb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.247+0000 7f56e9288640 1 --2- 172.21.15.172:0/2741448493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56e415dc20 0x7f56e40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.247+0000 7f56e9288640 1 -- 172.21.15.172:0/2741448493 >> 172.21.15.172:0/2741448493 conn(0x7f56e40d0420 msgr2=0x7f56e40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:56.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.247+0000 7f56e9288640 1 -- 172.21.15.172:0/2741448493 shutdown_connections 2024-04-25T08:42:56.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.247+0000 7f56e9288640 1 -- 172.21.15.172:0/2741448493 wait complete. 2024-04-25T08:42:56.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.248+0000 7f56e9288640 1 Processor -- start 2024-04-25T08:42:56.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.248+0000 7f56e9288640 1 -- start start 2024-04-25T08:42:56.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e9288640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56e40b9330 0x7f56e415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e9288640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56e415dc20 0x7f56e41f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e9288640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 0x7f56e40ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e9288640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40b5e50 con 0x7f56e4161710 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e9288640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4162500 con 0x7f56e40b9330 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e9288640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e40b5fd0 con 0x7f56e415dc20 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 0x7f56e40ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 0x7f56e40ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50890/0 (socket says 172.21.15.172:50890) 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e37fe640 1 -- 172.21.15.172:0/693943559 learned_addr learned my addr 172.21.15.172:0/693943559 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e2ffd640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56e40b9330 0x7f56e415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e27fc640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56e415dc20 0x7f56e41f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e37fe640 1 -- 172.21.15.172:0/693943559 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56e415dc20 msgr2=0x7f56e41f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e37fe640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56e415dc20 0x7f56e41f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e37fe640 1 -- 172.21.15.172:0/693943559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56e40b9330 msgr2=0x7f56e415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e37fe640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56e40b9330 0x7f56e415b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e37fe640 1 -- 172.21.15.172:0/693943559 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e41f78b0 con 0x7f56e4161710 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e37fe640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 0x7f56e40ccd60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00cc80 tx=0x7f56dc00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:56.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56cb7fe640 1 -- 172.21.15.172:0/693943559 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc00ce30 con 0x7f56e4161710 2024-04-25T08:42:56.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56cb7fe640 1 -- 172.21.15.172:0/693943559 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc003990 con 0x7f56e4161710 2024-04-25T08:42:56.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.249+0000 7f56e9288640 1 -- 172.21.15.172:0/693943559 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e41f7b90 con 0x7f56e4161710 2024-04-25T08:42:56.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.250+0000 7f56cb7fe640 1 -- 172.21.15.172:0/693943559 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc003d60 con 0x7f56e4161710 2024-04-25T08:42:56.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.250+0000 7f56e9288640 1 -- 172.21.15.172:0/693943559 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e40cc840 con 0x7f56e4161710 2024-04-25T08:42:56.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.251+0000 7f56e9288640 1 -- 172.21.15.172:0/693943559 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e4073a00 con 0x7f56e4161710 2024-04-25T08:42:56.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.251+0000 7f56cb7fe640 1 -- 172.21.15.172:0/693943559 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f56dc004000 con 0x7f56e4161710 2024-04-25T08:42:56.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.251+0000 7f56cb7fe640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d006b4d0 0x7f56d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.251+0000 7f56cb7fe640 1 -- 172.21.15.172:0/693943559 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f56dc08a8f0 con 0x7f56e4161710 2024-04-25T08:42:56.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.251+0000 7f56e2ffd640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d006b4d0 0x7f56d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.252+0000 7f56e2ffd640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d006b4d0 0x7f56d006d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f56d400a770 tx=0x7f56d4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:56.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.255+0000 7f56cb7fe640 1 -- 172.21.15.172:0/693943559 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56dc014030 con 0x7f56e4161710 2024-04-25T08:42:56.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.424+0000 7f56e9288640 1 -- 172.21.15.172:0/693943559 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56e41f7d60 con 0x7f56e4161710 2024-04-25T08:42:56.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.424+0000 7f56cb7fe640 1 -- 172.21.15.172:0/693943559 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56dc0594c0 con 0x7f56e4161710 2024-04-25T08:42:56.416 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:42:56.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 -- 172.21.15.172:0/693943559 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d006b4d0 msgr2=0x7f56d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d006b4d0 0x7f56d006d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f56d400a770 tx=0x7f56d4008040 comp rx=0 tx=0).stop 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 -- 172.21.15.172:0/693943559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 msgr2=0x7f56e40ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 0x7f56e40ccd60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00cc80 tx=0x7f56dc00a5c0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 -- 172.21.15.172:0/693943559 shutdown_connections 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56d006b4d0 0x7f56d006d990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e4161710 0x7f56e40ccd60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56e415dc20 0x7f56e41f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 --2- 172.21.15.172:0/693943559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56e40b9330 0x7f56e415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 -- 172.21.15.172:0/693943559 >> 172.21.15.172:0/693943559 conn(0x7f56e40d0420 msgr2=0x7f56e40b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 -- 172.21.15.172:0/693943559 shutdown_connections 2024-04-25T08:42:56.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.426+0000 7f56e9288640 1 -- 172.21.15.172:0/693943559 wait complete. 2024-04-25T08:42:56.429 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:42:56.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.537+0000 7f612cef5640 1 Processor -- start 2024-04-25T08:42:56.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.537+0000 7f612cef5640 1 -- start start 2024-04-25T08:42:56.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.538+0000 7f612cef5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f61280ce230 0x7f61280cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.538+0000 7f612cef5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f612815b270 0x7f612815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.538+0000 7f612cef5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6128072280 con 0x7f61280cc4f0 2024-04-25T08:42:56.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.538+0000 7f612cef5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6128071270 con 0x7f61280ce230 2024-04-25T08:42:56.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.538+0000 7f612cef5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280714c0 con 0x7f612815b270 2024-04-25T08:42:56.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.538+0000 7f612659c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f61280cc4f0 0x7f61280cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46326/0 (socket says 172.21.15.172:46326) 2024-04-25T08:42:56.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.538+0000 7f612659c640 1 -- 172.21.15.172:0/2046664795 learned_addr learned my addr 172.21.15.172:0/2046664795 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:56.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.538+0000 7f6125d9b640 1 --2- 172.21.15.172:0/2046664795 >> v2:172.21.15.186:3300/0 conn(0x7f61280ce230 0x7f61280cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.538+0000 7f6126d9d640 1 --2- 172.21.15.172:0/2046664795 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f612815b270 0x7f612815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.539+0000 7f612559a640 1 -- 172.21.15.172:0/2046664795 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431678427 0 0) 0x7f6128072280 con 0x7f61280cc4f0 2024-04-25T08:42:56.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.539+0000 7f612559a640 1 -- 172.21.15.172:0/2046664795 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6110003520 con 0x7f61280cc4f0 2024-04-25T08:42:56.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.539+0000 7f6125d9b640 1 -- 172.21.15.172:0/2046664795 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f612815b270 msgr2=0x7f612815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:56.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.539+0000 7f6125d9b640 1 --2- 172.21.15.172:0/2046664795 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f612815b270 0x7f612815b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.539+0000 7f6125d9b640 1 -- 172.21.15.172:0/2046664795 >> v1:172.21.15.172:6789/0 conn(0x7f61280cc4f0 legacy=0x7f61280cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.539+0000 7f6125d9b640 1 -- 172.21.15.172:0/2046664795 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280717a0 con 0x7f61280ce230 2024-04-25T08:42:56.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.539+0000 7f6125d9b640 1 --2- 172.21.15.172:0/2046664795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61280ce230 0x7f61280cc8d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f611c009d90 tx=0x7f611c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54d27975b8ffdbb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612559a640 1 -- 172.21.15.172:0/2046664795 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c007740 con 0x7f61280ce230 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612559a640 1 -- 172.21.15.172:0/2046664795 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c0078e0 con 0x7f61280ce230 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612559a640 1 -- 172.21.15.172:0/2046664795 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c007c90 con 0x7f61280ce230 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612cef5640 1 -- 172.21.15.172:0/2046664795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61280ce230 msgr2=0x7f61280cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612cef5640 1 --2- 172.21.15.172:0/2046664795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61280ce230 0x7f61280cc8d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f611c009d90 tx=0x7f611c02a660 comp rx=0 tx=0).stop 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612cef5640 1 -- 172.21.15.172:0/2046664795 shutdown_connections 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612cef5640 1 --2- 172.21.15.172:0/2046664795 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f612815b270 0x7f612815b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612cef5640 1 --2- 172.21.15.172:0/2046664795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61280ce230 0x7f61280cc8d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612cef5640 1 -- 172.21.15.172:0/2046664795 >> 172.21.15.172:0/2046664795 conn(0x7f612806abe0 msgr2=0x7f612806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612cef5640 1 -- 172.21.15.172:0/2046664795 shutdown_connections 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.540+0000 7f612cef5640 1 -- 172.21.15.172:0/2046664795 wait complete. 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f612cef5640 1 Processor -- start 2024-04-25T08:42:56.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f612cef5640 1 -- start start 2024-04-25T08:42:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f612cef5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61280cc4f0 0x7f612815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f612cef5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61280ce230 0x7f61281493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f612cef5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612815b270 0x7f6128156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f612cef5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612815bbf0 con 0x7f612815b270 2024-04-25T08:42:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f612cef5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128071d60 con 0x7f61280cc4f0 2024-04-25T08:42:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f612cef5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612815bd70 con 0x7f61280ce230 2024-04-25T08:42:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f6126d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612815b270 0x7f6128156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f6126d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612815b270 0x7f6128156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50906/0 (socket says 172.21.15.172:50906) 2024-04-25T08:42:56.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f6126d9d640 1 -- 172.21.15.172:0/1206820056 learned_addr learned my addr 172.21.15.172:0/1206820056 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f612659c640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61280cc4f0 0x7f612815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.542+0000 7f6125d9b640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61280ce230 0x7f61281493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f6126d9d640 1 -- 172.21.15.172:0/1206820056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61280ce230 msgr2=0x7f61281493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f6126d9d640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61280ce230 0x7f61281493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f6126d9d640 1 -- 172.21.15.172:0/1206820056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61280cc4f0 msgr2=0x7f612815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f6126d9d640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61280cc4f0 0x7f612815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f6126d9d640 1 -- 172.21.15.172:0/1206820056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6128149930 con 0x7f612815b270 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f6126d9d640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612815b270 0x7f6128156fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f611800e930 tx=0x7f611800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f6116ffd640 1 -- 172.21.15.172:0/1206820056 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118017070 con 0x7f612815b270 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f6116ffd640 1 -- 172.21.15.172:0/1206820056 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611800c980 con 0x7f612815b270 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f612cef5640 1 -- 172.21.15.172:0/1206820056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612815df70 con 0x7f612815b270 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f6116ffd640 1 -- 172.21.15.172:0/1206820056 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800cd70 con 0x7f612815b270 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.543+0000 7f612cef5640 1 -- 172.21.15.172:0/1206820056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612815dc90 con 0x7f612815b270 2024-04-25T08:42:56.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.544+0000 7f612cef5640 1 -- 172.21.15.172:0/1206820056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6128073a00 con 0x7f612815b270 2024-04-25T08:42:56.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.544+0000 7f6116ffd640 1 -- 172.21.15.172:0/1206820056 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f611801a070 con 0x7f612815b270 2024-04-25T08:42:56.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.545+0000 7f6116ffd640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f610806b500 0x7f610806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.545+0000 7f6116ffd640 1 -- 172.21.15.172:0/1206820056 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f611808a440 con 0x7f612815b270 2024-04-25T08:42:56.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.545+0000 7f612659c640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f610806b500 0x7f610806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.545+0000 7f612659c640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f610806b500 0x7f610806d9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6120005880 tx=0x7f6120009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:56.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.549+0000 7f6116ffd640 1 -- 172.21.15.172:0/1206820056 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6128149930 con 0x7f612815b270 2024-04-25T08:42:56.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.722+0000 7f612cef5640 1 -- 172.21.15.172:0/1206820056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f612806d3a0 con 0x7f612815b270 2024-04-25T08:42:56.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.723+0000 7f6116ffd640 1 -- 172.21.15.172:0/1206820056 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61180589f0 con 0x7f612815b270 2024-04-25T08:42:56.715 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:42:56.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 -- 172.21.15.172:0/1206820056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f610806b500 msgr2=0x7f610806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f610806b500 0x7f610806d9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6120005880 tx=0x7f6120009040 comp rx=0 tx=0).stop 2024-04-25T08:42:56.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 -- 172.21.15.172:0/1206820056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612815b270 msgr2=0x7f6128156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612815b270 0x7f6128156fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f611800e930 tx=0x7f611800edf0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 -- 172.21.15.172:0/1206820056 shutdown_connections 2024-04-25T08:42:56.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f610806b500 0x7f610806d9c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612815b270 0x7f6128156fa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61280ce230 0x7f61281493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 --2- 172.21.15.172:0/1206820056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61280cc4f0 0x7f612815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 -- 172.21.15.172:0/1206820056 >> 172.21.15.172:0/1206820056 conn(0x7f612806abe0 msgr2=0x7f612806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:56.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 -- 172.21.15.172:0/1206820056 shutdown_connections 2024-04-25T08:42:56.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.725+0000 7f612cef5640 1 -- 172.21.15.172:0/1206820056 wait complete. 2024-04-25T08:42:56.728 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:42:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.838+0000 7f6de8922640 1 Processor -- start 2024-04-25T08:42:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.838+0000 7f6de8922640 1 -- start start 2024-04-25T08:42:56.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de8922640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6de406ccd0 0x7f6de40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de8922640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6de415deb0 0x7f6de415e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de8922640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de40d1770 con 0x7f6de4070dc0 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de8922640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de41622b0 con 0x7f6de415deb0 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de8922640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40b10f0 con 0x7f6de406ccd0 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de2d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6de415deb0 0x7f6de415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de259c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6de4070dc0 0x7f6de40711a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46338/0 (socket says 172.21.15.172:46338) 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de259c640 1 -- 172.21.15.172:0/1971513164 learned_addr learned my addr 172.21.15.172:0/1971513164 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de2d9d640 1 -- 172.21.15.172:0/1971513164 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6de406ccd0 msgr2=0x7f6de40b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de1d9b640 1 --2- 172.21.15.172:0/1971513164 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6de406ccd0 0x7f6de40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de159a640 1 -- 172.21.15.172:0/1971513164 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341265067 0 0) 0x7f6de40d1770 con 0x7f6de4070dc0 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de2d9d640 1 --2- 172.21.15.172:0/1971513164 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6de406ccd0 0x7f6de40b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de2d9d640 1 -- 172.21.15.172:0/1971513164 >> v1:172.21.15.172:6789/0 conn(0x7f6de4070dc0 legacy=0x7f6de40711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.839+0000 7f6de2d9d640 1 -- 172.21.15.172:0/1971513164 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de4162740 con 0x7f6de415deb0 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.840+0000 7f6de2d9d640 1 --2- 172.21.15.172:0/1971513164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de415deb0 0x7f6de415e340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0097a0 tx=0x7f6ddc02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b81936041f3dd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.840+0000 7f6de159a640 1 -- 172.21.15.172:0/1971513164 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc037070 con 0x7f6de415deb0 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.840+0000 7f6de159a640 1 -- 172.21.15.172:0/1971513164 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc02adb0 con 0x7f6de415deb0 2024-04-25T08:42:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.840+0000 7f6de159a640 1 -- 172.21.15.172:0/1971513164 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc032660 con 0x7f6de415deb0 2024-04-25T08:42:56.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.841+0000 7f6de8922640 1 -- 172.21.15.172:0/1971513164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de415deb0 msgr2=0x7f6de415e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.841+0000 7f6de8922640 1 --2- 172.21.15.172:0/1971513164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de415deb0 0x7f6de415e340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0097a0 tx=0x7f6ddc02a060 comp rx=0 tx=0).stop 2024-04-25T08:42:56.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.841+0000 7f6de8922640 1 -- 172.21.15.172:0/1971513164 shutdown_connections 2024-04-25T08:42:56.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.841+0000 7f6de8922640 1 --2- 172.21.15.172:0/1971513164 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6de406ccd0 0x7f6de40b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.841+0000 7f6de8922640 1 --2- 172.21.15.172:0/1971513164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de415deb0 0x7f6de415e340 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.841+0000 7f6de8922640 1 -- 172.21.15.172:0/1971513164 >> 172.21.15.172:0/1971513164 conn(0x7f6de40b3530 msgr2=0x7f6de40b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:56.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.841+0000 7f6de8922640 1 -- 172.21.15.172:0/1971513164 shutdown_connections 2024-04-25T08:42:56.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.841+0000 7f6de8922640 1 -- 172.21.15.172:0/1971513164 wait complete. 2024-04-25T08:42:56.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.842+0000 7f6de8922640 1 Processor -- start 2024-04-25T08:42:56.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.842+0000 7f6de8922640 1 -- start start 2024-04-25T08:42:56.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de8922640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6de406ccd0 0x7f6de41f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de8922640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de4070dc0 0x7f6de40cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de8922640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6de415deb0 0x7f6de415f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de8922640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de4161f40 con 0x7f6de4070dc0 2024-04-25T08:42:56.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de8922640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de4161c60 con 0x7f6de415deb0 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de8922640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de40b5840 con 0x7f6de406ccd0 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de1d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de4070dc0 0x7f6de40cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de1d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de4070dc0 0x7f6de40cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50922/0 (socket says 172.21.15.172:50922) 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de1d9b640 1 -- 172.21.15.172:0/960491257 learned_addr learned my addr 172.21.15.172:0/960491257 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de259c640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6de406ccd0 0x7f6de41f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de2d9d640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6de415deb0 0x7f6de415f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de1d9b640 1 -- 172.21.15.172:0/960491257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6de406ccd0 msgr2=0x7f6de41f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de1d9b640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6de406ccd0 0x7f6de41f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de1d9b640 1 -- 172.21.15.172:0/960491257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6de415deb0 msgr2=0x7f6de415f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de1d9b640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6de415deb0 0x7f6de415f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.843+0000 7f6de1d9b640 1 -- 172.21.15.172:0/960491257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de415e360 con 0x7f6de4070dc0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.844+0000 7f6de1d9b640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de4070dc0 0x7f6de40cb070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800c7f0 tx=0x7f6dd800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.844+0000 7f6dd2ffd640 1 -- 172.21.15.172:0/960491257 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8015070 con 0x7f6de4070dc0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.844+0000 7f6dd2ffd640 1 -- 172.21.15.172:0/960491257 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd8004240 con 0x7f6de4070dc0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.844+0000 7f6de8922640 1 -- 172.21.15.172:0/960491257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de415e640 con 0x7f6de4070dc0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.844+0000 7f6dd2ffd640 1 -- 172.21.15.172:0/960491257 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8007620 con 0x7f6de4070dc0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.844+0000 7f6de8922640 1 -- 172.21.15.172:0/960491257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de415eee0 con 0x7f6de4070dc0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.845+0000 7f6de8922640 1 -- 172.21.15.172:0/960491257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de415e810 con 0x7f6de4070dc0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.845+0000 7f6dd2ffd640 1 -- 172.21.15.172:0/960491257 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6dd80079d0 con 0x7f6de4070dc0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.845+0000 7f6dd2ffd640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6dc406b4d0 0x7f6dc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.846+0000 7f6dd2ffd640 1 -- 172.21.15.172:0/960491257 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6dd808aa50 con 0x7f6de4070dc0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.846+0000 7f6de259c640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6dc406b4d0 0x7f6dc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:56.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.846+0000 7f6de259c640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6dc406b4d0 0x7f6dc406d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40012e0 tx=0x7f6dd4007ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:56.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:56.850+0000 7f6dd2ffd640 1 -- 172.21.15.172:0/960491257 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6dd8059510 con 0x7f6de4070dc0 2024-04-25T08:42:57.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.021+0000 7f6de8922640 1 -- 172.21.15.172:0/960491257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6de4073a00 con 0x7f6de4070dc0 2024-04-25T08:42:57.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.022+0000 7f6dd2ffd640 1 -- 172.21.15.172:0/960491257 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6dd8058e10 con 0x7f6de4070dc0 2024-04-25T08:42:57.014 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:42:57.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 -- 172.21.15.172:0/960491257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6dc406b4d0 msgr2=0x7f6dc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6dc406b4d0 0x7f6dc406d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40012e0 tx=0x7f6dd4007ed0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 -- 172.21.15.172:0/960491257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de4070dc0 msgr2=0x7f6de40cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de4070dc0 0x7f6de40cb070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800c7f0 tx=0x7f6dd800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 -- 172.21.15.172:0/960491257 shutdown_connections 2024-04-25T08:42:57.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6dc406b4d0 0x7f6dc406d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6de415deb0 0x7f6de415f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6de4070dc0 0x7f6de40cb070 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 --2- 172.21.15.172:0/960491257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6de406ccd0 0x7f6de41f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 -- 172.21.15.172:0/960491257 >> 172.21.15.172:0/960491257 conn(0x7f6de40b3530 msgr2=0x7f6de40b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:57.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 -- 172.21.15.172:0/960491257 shutdown_connections 2024-04-25T08:42:57.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.024+0000 7f6de8922640 1 -- 172.21.15.172:0/960491257 wait complete. 2024-04-25T08:42:57.027 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:42:57.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.134+0000 7f9c6402a640 1 Processor -- start 2024-04-25T08:42:57.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.135+0000 7f9c6402a640 1 -- start start 2024-04-25T08:42:57.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.135+0000 7f9c6402a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c5c15de80 0x7f9c5c0cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.135+0000 7f9c6402a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5c0afc80 con 0x7f9c5c0cefb0 2024-04-25T08:42:57.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.135+0000 7f9c6402a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5c0ce4d0 con 0x7f9c5c0ccfe0 2024-04-25T08:42:57.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.135+0000 7f9c6402a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0ce7b0 con 0x7f9c5c15de80 2024-04-25T08:42:57.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.136+0000 7f9c61dc6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c5c15de80 0x7f9c5c0cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.136+0000 7f9c615c5640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9c5c0cefb0 0x7f9c5c0cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46354/0 (socket says 172.21.15.172:46354) 2024-04-25T08:42:57.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.136+0000 7f9c615c5640 1 -- 172.21.15.172:0/2893768115 learned_addr learned my addr 172.21.15.172:0/2893768115 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:57.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.136+0000 7f9c60dc4640 1 -- 172.21.15.172:0/2893768115 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856905492 0 0) 0x7f9c5c0afc80 con 0x7f9c5c0cefb0 2024-04-25T08:42:57.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.136+0000 7f9c60dc4640 1 -- 172.21.15.172:0/2893768115 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c48003520 con 0x7f9c5c0cefb0 2024-04-25T08:42:57.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.136+0000 7f9c61dc6640 1 -- 172.21.15.172:0/2893768115 >> v1:172.21.15.186:6789/0 conn(0x7f9c5c0ccfe0 legacy=0x7f9c5c0cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.136+0000 7f9c61dc6640 1 -- 172.21.15.172:0/2893768115 >> v1:172.21.15.172:6789/0 conn(0x7f9c5c0cefb0 legacy=0x7f9c5c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.136+0000 7f9c61dc6640 1 -- 172.21.15.172:0/2893768115 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c0cea90 con 0x7f9c5c15de80 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c61dc6640 1 --2- 172.21.15.172:0/2893768115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 0x7f9c5c0cadb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c580097a0 tx=0x7f9c5802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e4ba13d7566a33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c60dc4640 1 -- 172.21.15.172:0/2893768115 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58037070 con 0x7f9c5c15de80 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c60dc4640 1 -- 172.21.15.172:0/2893768115 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c58032440 con 0x7f9c5c15de80 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c60dc4640 1 -- 172.21.15.172:0/2893768115 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58032810 con 0x7f9c5c15de80 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c6402a640 1 -- 172.21.15.172:0/2893768115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 msgr2=0x7f9c5c0cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c6402a640 1 --2- 172.21.15.172:0/2893768115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 0x7f9c5c0cadb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c580097a0 tx=0x7f9c5802a230 comp rx=0 tx=0).stop 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c6402a640 1 -- 172.21.15.172:0/2893768115 shutdown_connections 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c6402a640 1 --2- 172.21.15.172:0/2893768115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 0x7f9c5c0cadb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c6402a640 1 -- 172.21.15.172:0/2893768115 >> 172.21.15.172:0/2893768115 conn(0x7f9c5c0b2390 msgr2=0x7f9c5c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c6402a640 1 -- 172.21.15.172:0/2893768115 shutdown_connections 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.137+0000 7f9c6402a640 1 -- 172.21.15.172:0/2893768115 wait complete. 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.138+0000 7f9c6402a640 1 Processor -- start 2024-04-25T08:42:57.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.139+0000 7f9c6402a640 1 -- start start 2024-04-25T08:42:57.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.139+0000 7f9c6402a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c5c0ccfe0 0x7f9c5c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.139+0000 7f9c6402a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5c0cefb0 0x7f9c5c0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.139+0000 7f9c6402a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 0x7f9c5c0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.139+0000 7f9c6402a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0cfb50 con 0x7f9c5c15de80 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.139+0000 7f9c6402a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0b2eb0 con 0x7f9c5c0cefb0 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.139+0000 7f9c6402a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0c79d0 con 0x7f9c5c0ccfe0 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.139+0000 7f9c625c7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 0x7f9c5c0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.139+0000 7f9c625c7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 0x7f9c5c0b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50942/0 (socket says 172.21.15.172:50942) 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.139+0000 7f9c625c7640 1 -- 172.21.15.172:0/3967360907 learned_addr learned my addr 172.21.15.172:0/3967360907 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c615c5640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5c0cefb0 0x7f9c5c0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c61dc6640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c5c0ccfe0 0x7f9c5c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c625c7640 1 -- 172.21.15.172:0/3967360907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c5c0ccfe0 msgr2=0x7f9c5c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c625c7640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c5c0ccfe0 0x7f9c5c0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c625c7640 1 -- 172.21.15.172:0/3967360907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5c0cefb0 msgr2=0x7f9c5c0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c625c7640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5c0cefb0 0x7f9c5c0b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c625c7640 1 -- 172.21.15.172:0/3967360907 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c15aff0 con 0x7f9c5c15de80 2024-04-25T08:42:57.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c615c5640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5c0cefb0 0x7f9c5c0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:57.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c61dc6640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c5c0ccfe0 0x7f9c5c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:57.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c625c7640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 0x7f9c5c0b1810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c7a0 tx=0x7f9c5400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:57.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c527fc640 1 -- 172.21.15.172:0/3967360907 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54003b70 con 0x7f9c5c15de80 2024-04-25T08:42:57.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c527fc640 1 -- 172.21.15.172:0/3967360907 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c54003d30 con 0x7f9c5c15de80 2024-04-25T08:42:57.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c6402a640 1 -- 172.21.15.172:0/3967360907 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c0c7c70 con 0x7f9c5c15de80 2024-04-25T08:42:57.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c527fc640 1 -- 172.21.15.172:0/3967360907 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400aa90 con 0x7f9c5c15de80 2024-04-25T08:42:57.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.140+0000 7f9c6402a640 1 -- 172.21.15.172:0/3967360907 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c0c7f50 con 0x7f9c5c15de80 2024-04-25T08:42:57.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.141+0000 7f9c6402a640 1 -- 172.21.15.172:0/3967360907 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c073a00 con 0x7f9c5c15de80 2024-04-25T08:42:57.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.141+0000 7f9c527fc640 1 -- 172.21.15.172:0/3967360907 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c5400ac30 con 0x7f9c5c15de80 2024-04-25T08:42:57.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.142+0000 7f9c527fc640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c4006b500 0x7f9c4006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.142+0000 7f9c61dc6640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c4006b500 0x7f9c4006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.142+0000 7f9c527fc640 1 -- 172.21.15.172:0/3967360907 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9c5408a470 con 0x7f9c5c15de80 2024-04-25T08:42:57.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.142+0000 7f9c61dc6640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c4006b500 0x7f9c4006d9c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9c58034000 tx=0x7f9c5802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:57.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.146+0000 7f9c527fc640 1 -- 172.21.15.172:0/3967360907 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c54058fb0 con 0x7f9c5c15de80 2024-04-25T08:42:57.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.322+0000 7f9c6402a640 1 -- 172.21.15.172:0/3967360907 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9c5c070130 con 0x7f9c5c15de80 2024-04-25T08:42:57.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.323+0000 7f9c527fc640 1 -- 172.21.15.172:0/3967360907 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9c540588b0 con 0x7f9c5c15de80 2024-04-25T08:42:57.315 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:42:57.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 -- 172.21.15.172:0/3967360907 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c4006b500 msgr2=0x7f9c4006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c4006b500 0x7f9c4006d9c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9c58034000 tx=0x7f9c5802e000 comp rx=0 tx=0).stop 2024-04-25T08:42:57.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 -- 172.21.15.172:0/3967360907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 msgr2=0x7f9c5c0b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 0x7f9c5c0b1810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400c7a0 tx=0x7f9c5400cc60 comp rx=0 tx=0).stop 2024-04-25T08:42:57.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 -- 172.21.15.172:0/3967360907 shutdown_connections 2024-04-25T08:42:57.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c4006b500 0x7f9c4006d9c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5c0cefb0 0x7f9c5c0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c5c15de80 0x7f9c5c0b1810 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 --2- 172.21.15.172:0/3967360907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c5c0ccfe0 0x7f9c5c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 -- 172.21.15.172:0/3967360907 >> 172.21.15.172:0/3967360907 conn(0x7f9c5c0b2390 msgr2=0x7f9c5c0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:57.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 -- 172.21.15.172:0/3967360907 shutdown_connections 2024-04-25T08:42:57.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.325+0000 7f9c6402a640 1 -- 172.21.15.172:0/3967360907 wait complete. 2024-04-25T08:42:57.328 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:42:57.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.433+0000 7fc19302a640 1 Processor -- start 2024-04-25T08:42:57.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.433+0000 7fc19302a640 1 -- start start 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc19302a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18c0d0ad0 0x7fc18c168760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc19302a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c0b9940 con 0x7fc18c15dd30 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc19302a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c0d1df0 con 0x7fc18c0d2e90 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc19302a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0b7a50 con 0x7fc18c0d0ad0 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc190dc6640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc18c15dd30 0x7fc18c0b9230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46368/0 (socket says 172.21.15.172:46368) 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc190dc6640 1 -- 172.21.15.172:0/2783241033 learned_addr learned my addr 172.21.15.172:0/2783241033 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc1915c7640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18c0d0ad0 0x7fc18c168760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276089897 0 0) 0x7fc18c0b9940 con 0x7fc18c15dd30 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc17c003520 con 0x7fc18c15dd30 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3958996924 0 0) 0x7fc17c003520 con 0x7fc18c15dd30 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18c0d0ad0 msgr2=0x7fc18c168760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18c0d0ad0 0x7fc18c168760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 >> v1:172.21.15.186:6789/0 conn(0x7fc18c0d2e90 legacy=0x7fc18c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0d20d0 con 0x7fc18c15dd30 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fc180001670 con 0x7fc18c15dd30 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 >> v1:172.21.15.172:6789/0 conn(0x7fc18c15dd30 legacy=0x7fc18c0b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18c0d0ad0 0x7fc17c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc17c003f60 0x7fc17c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc17c004d40 0x7fc17c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0b7a50 con 0x7fc17c003f60 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c00bb50 con 0x7fc17c004d40 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c00bd50 con 0x7fc18c0d0ad0 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc18bfff640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc17c003f60 0x7fc17c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc190dc6640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18c0d0ad0 0x7fc17c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.434+0000 7fc1915c7640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc17c004d40 0x7fc17c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.435+0000 7fc18bfff640 1 -- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18c0d0ad0 msgr2=0x7fc17c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:57.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.435+0000 7fc18bfff640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18c0d0ad0 0x7fc17c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.435+0000 7fc18bfff640 1 -- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc17c004d40 msgr2=0x7fc17c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:57.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.435+0000 7fc18bfff640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc17c004d40 0x7fc17c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.435+0000 7fc18bfff640 1 -- 172.21.15.172:0/2783241033 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c003520 con 0x7fc17c003f60 2024-04-25T08:42:57.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.435+0000 7fc18bfff640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc17c003f60 0x7fc17c004800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc178001770 tx=0x7fc17c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee614022abf7192 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:57.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.435+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1780013c0 con 0x7fc17c003f60 2024-04-25T08:42:57.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.435+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1780052d0 con 0x7fc17c003f60 2024-04-25T08:42:57.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.436+0000 7fc18b7fe640 1 -- 172.21.15.172:0/2783241033 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17802a8c0 con 0x7fc17c003f60 2024-04-25T08:42:57.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.436+0000 7fc19302a640 1 -- 172.21.15.172:0/2783241033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc17c003f60 msgr2=0x7fc17c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.436+0000 7fc19302a640 1 --2- 172.21.15.172:0/2783241033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc17c003f60 0x7fc17c004800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc178001770 tx=0x7fc17c005830 comp rx=0 tx=0).stop 2024-04-25T08:42:57.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.436+0000 7fc1915c7640 1 -- 172.21.15.172:0/2783241033 reap_dead start 2024-04-25T08:42:57.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.436+0000 7fc19302a640 1 -- 172.21.15.172:0/2783241033 shutdown_connections 2024-04-25T08:42:57.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.436+0000 7fc19302a640 1 -- 172.21.15.172:0/2783241033 >> 172.21.15.172:0/2783241033 conn(0x7fc18c061c30 msgr2=0x7fc18c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:57.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.436+0000 7fc19302a640 1 -- 172.21.15.172:0/2783241033 shutdown_connections 2024-04-25T08:42:57.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.436+0000 7fc19302a640 1 -- 172.21.15.172:0/2783241033 wait complete. 2024-04-25T08:42:57.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.437+0000 7fc19302a640 1 Processor -- start 2024-04-25T08:42:57.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.437+0000 7fc19302a640 1 -- start start 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc19302a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc17c003f60 0x7fc18c153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc19302a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc18c0cce90 0x7fc18c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc19302a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc18c153f90 0x7fc18c158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc19302a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0d2970 con 0x7fc18c0cce90 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc19302a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0d2690 con 0x7fc18c153f90 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc19302a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0d1a10 con 0x7fc17c003f60 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc18bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc18c0cce90 0x7fc18c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc18bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc18c0cce90 0x7fc18c157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50956/0 (socket says 172.21.15.172:50956) 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc18bfff640 1 -- 172.21.15.172:0/2619041306 learned_addr learned my addr 172.21.15.172:0/2619041306 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc18bfff640 1 -- 172.21.15.172:0/2619041306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc17c003f60 msgr2=0x7fc18c153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc18bfff640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc17c003f60 0x7fc18c153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc18bfff640 1 -- 172.21.15.172:0/2619041306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc18c153f90 msgr2=0x7fc18c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc18bfff640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc18c153f90 0x7fc18c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.438+0000 7fc18bfff640 1 -- 172.21.15.172:0/2619041306 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0cd400 con 0x7fc18c0cce90 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.439+0000 7fc18bfff640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc18c0cce90 0x7fc18c157fd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc17802a570 tx=0x7fc178001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.439+0000 7fc1897fa640 1 -- 172.21.15.172:0/2619041306 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178037040 con 0x7fc18c0cce90 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.439+0000 7fc1897fa640 1 -- 172.21.15.172:0/2619041306 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc178041070 con 0x7fc18c0cce90 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.439+0000 7fc19302a640 1 -- 172.21.15.172:0/2619041306 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c15a190 con 0x7fc18c0cce90 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.439+0000 7fc1897fa640 1 -- 172.21.15.172:0/2619041306 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178006a80 con 0x7fc18c0cce90 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.439+0000 7fc19302a640 1 -- 172.21.15.172:0/2619041306 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c15a750 con 0x7fc18c0cce90 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.440+0000 7fc19302a640 1 -- 172.21.15.172:0/2619041306 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16c005290 con 0x7fc18c0cce90 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.440+0000 7fc1897fa640 1 -- 172.21.15.172:0/2619041306 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc178006c20 con 0x7fc18c0cce90 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.440+0000 7fc1897fa640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 0x7fc17006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.441+0000 7fc1897fa640 1 -- 172.21.15.172:0/2619041306 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc1780aa330 con 0x7fc18c0cce90 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.441+0000 7fc190dc6640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 0x7fc17006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.441+0000 7fc190dc6640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 0x7fc17006d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc180001b80 tx=0x7fc180001c10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:57.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.445+0000 7fc1897fa640 1 -- 172.21.15.172:0/2619041306 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1780790e0 con 0x7fc18c0cce90 2024-04-25T08:42:57.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.652+0000 7fc19302a640 1 -- 172.21.15.172:0/2619041306 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc16c005850 con 0x7fc18c0cce90 2024-04-25T08:42:57.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.653+0000 7fc1897fa640 1 -- 172.21.15.172:0/2619041306 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4943 (secure 0 0 0) 0x7fc1780789e0 con 0x7fc18c0cce90 2024-04-25T08:42:57.645 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:57.645 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:42:28.003161+0000","modified":"2024-04-25T08:42:49.090813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:42:57.645 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2024-04-25T08:42:57.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.654+0000 7fc19302a640 1 -- 172.21.15.172:0/2619041306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 msgr2=0x7fc17006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.654+0000 7fc19302a640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 0x7fc17006d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc180001b80 tx=0x7fc180001c10 comp rx=0 tx=0).stop 2024-04-25T08:42:57.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.655+0000 7fc19302a640 1 -- 172.21.15.172:0/2619041306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc18c0cce90 msgr2=0x7fc18c157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.655+0000 7fc19302a640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc18c0cce90 0x7fc18c157fd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc17802a570 tx=0x7fc178001170 comp rx=0 tx=0).stop 2024-04-25T08:42:57.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.655+0000 7fc19302a640 1 -- 172.21.15.172:0/2619041306 shutdown_connections 2024-04-25T08:42:57.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.655+0000 7fc19302a640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 0x7fc17006d990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.655+0000 7fc19302a640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc18c153f90 0x7fc18c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.655+0000 7fc19302a640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc18c0cce90 0x7fc18c157fd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.655+0000 7fc19302a640 1 --2- 172.21.15.172:0/2619041306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc17c003f60 0x7fc18c153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.655+0000 7fc19302a640 1 -- 172.21.15.172:0/2619041306 >> 172.21.15.172:0/2619041306 conn(0x7fc18c061c30 msgr2=0x7fc18c0b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:57.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.655+0000 7fc19302a640 1 -- 172.21.15.172:0/2619041306 shutdown_connections 2024-04-25T08:42:57.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.655+0000 7fc19302a640 1 -- 172.21.15.172:0/2619041306 wait complete. 2024-04-25T08:42:57.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:42:57.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.764+0000 7f5d914b6640 1 Processor -- start 2024-04-25T08:42:57.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.764+0000 7f5d914b6640 1 -- start start 2024-04-25T08:42:57.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.765+0000 7f5d914b6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d8c06ea20 0x7f5d8c1658a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.765+0000 7f5d914b6640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c0b4470 con 0x7f5d8c15a990 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.765+0000 7f5d914b6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c0b4750 con 0x7f5d8c0b3f00 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.765+0000 7f5d914b6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0b4a30 con 0x7f5d8c06ea20 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.765+0000 7f5d8affd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5d8c15a990 0x7f5d8c06b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59652/0 (socket says 172.21.15.172:59652) 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.765+0000 7f5d8affd640 1 -- 172.21.15.172:0/1711536758 learned_addr learned my addr 172.21.15.172:0/1711536758 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.765+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976056290 0 0) 0x7f5d8c0b4470 con 0x7f5d8c15a990 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.765+0000 7f5d8b7fe640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d8c06ea20 0x7f5d8c1658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.765+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d74003520 con 0x7f5d8c15a990 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718731385 0 0) 0x7f5d8c0b4750 con 0x7f5d8c0b3f00 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d8c0b4470 con 0x7f5d8c0b3f00 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3354802926 0 0) 0x7f5d74003520 con 0x7f5d8c15a990 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d8c06ea20 msgr2=0x7f5d8c1658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d8c06ea20 0x7f5d8c1658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 >> v1:172.21.15.186:6789/0 conn(0x7f5d8c0b3f00 legacy=0x7f5d8c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c0b4d10 con 0x7f5d8c15a990 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f5d7c001a10 con 0x7f5d8c15a990 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 >> v1:172.21.15.172:6789/0 conn(0x7f5d8c15a990 legacy=0x7f5d8c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d74003b70 0x7f5d74003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d8c06ea20 0x7f5d74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d74004d40 0x7f5d740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0b4a30 con 0x7f5d74003b70 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7400dcd0 con 0x7f5d74004d40 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7400ded0 con 0x7f5d8c06ea20 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d8affd640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d74003b70 0x7f5d74003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d8a7fc640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d8c06ea20 0x7f5d74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d8b7fe640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d74004d40 0x7f5d740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d8affd640 1 -- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d8c06ea20 msgr2=0x7f5d74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:57.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d8affd640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d8c06ea20 0x7f5d74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d8affd640 1 -- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d74004d40 msgr2=0x7f5d740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d8affd640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d74004d40 0x7f5d740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.766+0000 7f5d8affd640 1 -- 172.21.15.172:0/1711536758 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74003520 con 0x7f5d74003b70 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.767+0000 7f5d8affd640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d74003b70 0x7f5d74003f70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00a7d0 tx=0x7f5d74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc01122784cfdfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.767+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00a430 con 0x7f5d74003b70 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.767+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c02f070 con 0x7f5d74003b70 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.767+0000 7f5d89ffb640 1 -- 172.21.15.172:0/1711536758 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c02bc00 con 0x7f5d74003b70 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.767+0000 7f5d914b6640 1 -- 172.21.15.172:0/1711536758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d74003b70 msgr2=0x7f5d74003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.767+0000 7f5d914b6640 1 --2- 172.21.15.172:0/1711536758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d74003b70 0x7f5d74003f70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00a7d0 tx=0x7f5d74005830 comp rx=0 tx=0).stop 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.767+0000 7f5d8b7fe640 1 -- 172.21.15.172:0/1711536758 reap_dead start 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.768+0000 7f5d914b6640 1 -- 172.21.15.172:0/1711536758 shutdown_connections 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.768+0000 7f5d914b6640 1 -- 172.21.15.172:0/1711536758 >> 172.21.15.172:0/1711536758 conn(0x7f5d8c0b1bf0 msgr2=0x7f5d8c0b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.768+0000 7f5d914b6640 1 -- 172.21.15.172:0/1711536758 shutdown_connections 2024-04-25T08:42:57.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.768+0000 7f5d914b6640 1 -- 172.21.15.172:0/1711536758 wait complete. 2024-04-25T08:42:57.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.769+0000 7f5d914b6640 1 Processor -- start 2024-04-25T08:42:57.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.769+0000 7f5d914b6640 1 -- start start 2024-04-25T08:42:57.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d914b6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d74003b70 0x7f5d8c1411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d914b6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d8c0cfc10 0x7f5d8c0d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d914b6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d8c156330 0x7f5d8c1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d914b6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0ad760 con 0x7f5d8c156330 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d914b6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0ad5e0 con 0x7f5d8c0cfc10 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d914b6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c071ae0 con 0x7f5d74003b70 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d8c156330 0x7f5d8c1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d8c156330 0x7f5d8c1567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56654/0 (socket says 172.21.15.172:56654) 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8b7fe640 1 -- 172.21.15.172:0/403716967 learned_addr learned my addr 172.21.15.172:0/403716967 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8affd640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d74003b70 0x7f5d8c1411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8a7fc640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d8c0cfc10 0x7f5d8c0d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8b7fe640 1 -- 172.21.15.172:0/403716967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d74003b70 msgr2=0x7f5d8c1411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8b7fe640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d74003b70 0x7f5d8c1411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8b7fe640 1 -- 172.21.15.172:0/403716967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d8c0cfc10 msgr2=0x7f5d8c0d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8b7fe640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d8c0cfc10 0x7f5d8c0d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8b7fe640 1 -- 172.21.15.172:0/403716967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c1479f0 con 0x7f5d8c156330 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d8b7fe640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d8c156330 0x7f5d8c1567b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0afb30 tx=0x7f5d84011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d737fe640 1 -- 172.21.15.172:0/403716967 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84004030 con 0x7f5d8c156330 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d737fe640 1 -- 172.21.15.172:0/403716967 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8401b070 con 0x7f5d8c156330 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d737fe640 1 -- 172.21.15.172:0/403716967 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840043f0 con 0x7f5d8c156330 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d914b6640 1 -- 172.21.15.172:0/403716967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c157060 con 0x7f5d8c156330 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.770+0000 7f5d914b6640 1 -- 172.21.15.172:0/403716967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c144190 con 0x7f5d8c156330 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.771+0000 7f5d914b6640 1 -- 172.21.15.172:0/403716967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c06ffa0 con 0x7f5d8c156330 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.772+0000 7f5d737fe640 1 -- 172.21.15.172:0/403716967 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d84012040 con 0x7f5d8c156330 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.772+0000 7f5d737fe640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d7806b4d0 0x7f5d7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.772+0000 7f5d8affd640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d7806b4d0 0x7f5d7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.772+0000 7f5d737fe640 1 -- 172.21.15.172:0/403716967 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5d8408a490 con 0x7f5d8c156330 2024-04-25T08:42:57.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.773+0000 7f5d8affd640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d7806b4d0 0x7f5d7806d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c033000 tx=0x7f5d7c007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:57.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.777+0000 7f5d737fe640 1 -- 172.21.15.172:0/403716967 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d8c06ffa0 con 0x7f5d8c156330 2024-04-25T08:42:57.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.949+0000 7f5d914b6640 1 -- 172.21.15.172:0/403716967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d8c0adb10 con 0x7f5d8c156330 2024-04-25T08:42:57.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.950+0000 7f5d737fe640 1 -- 172.21.15.172:0/403716967 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f5d8c0adb10 con 0x7f5d8c156330 2024-04-25T08:42:57.943 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:57.943 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:42:57.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.952+0000 7f5d914b6640 1 -- 172.21.15.172:0/403716967 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d7806b4d0 msgr2=0x7f5d7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.952+0000 7f5d914b6640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d7806b4d0 0x7f5d7806d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c033000 tx=0x7f5d7c007000 comp rx=0 tx=0).stop 2024-04-25T08:42:57.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.952+0000 7f5d914b6640 1 -- 172.21.15.172:0/403716967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d8c156330 msgr2=0x7f5d8c1567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:57.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.952+0000 7f5d914b6640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d8c156330 0x7f5d8c1567b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0afb30 tx=0x7f5d84011c30 comp rx=0 tx=0).stop 2024-04-25T08:42:57.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.952+0000 7f5d914b6640 1 -- 172.21.15.172:0/403716967 shutdown_connections 2024-04-25T08:42:57.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.952+0000 7f5d914b6640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d7806b4d0 0x7f5d7806d990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.952+0000 7f5d914b6640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d8c0cfc10 0x7f5d8c0d0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.952+0000 7f5d914b6640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d8c156330 0x7f5d8c1567b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.952+0000 7f5d914b6640 1 --2- 172.21.15.172:0/403716967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d74003b70 0x7f5d8c1411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:57.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.952+0000 7f5d914b6640 1 -- 172.21.15.172:0/403716967 >> 172.21.15.172:0/403716967 conn(0x7f5d8c0b1bf0 msgr2=0x7f5d8c06b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:57.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.953+0000 7f5d914b6640 1 -- 172.21.15.172:0/403716967 shutdown_connections 2024-04-25T08:42:57.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:57.953+0000 7f5d914b6640 1 -- 172.21.15.172:0/403716967 wait complete. 2024-04-25T08:42:57.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:42:58.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.061+0000 7fb8b1f29640 1 Processor -- start 2024-04-25T08:42:58.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.061+0000 7fb8b1f29640 1 -- start start 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8b1f29640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8ac15ba70 0x7fb8ac0725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8b1f29640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8ac06f360 0x7fb8ac0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8b1f29640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac15be50 con 0x7fb8ac0aefa0 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8b1f29640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac0717f0 con 0x7fb8ac15ba70 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8b1f29640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac071ad0 con 0x7fb8ac06f360 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8ab7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8ac15ba70 0x7fb8ac0725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8ab7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8ac15ba70 0x7fb8ac0725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56660/0 (socket says 172.21.15.172:56660) 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8ab7fe640 1 -- 172.21.15.172:0/962318446 learned_addr learned my addr 172.21.15.172:0/962318446 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8ab7fe640 1 -- 172.21.15.172:0/962318446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8ac06f360 msgr2=0x7fb8ac0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8ab7fe640 1 --2- 172.21.15.172:0/962318446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8ac06f360 0x7fb8ac0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8ab7fe640 1 -- 172.21.15.172:0/962318446 >> v1:172.21.15.186:6789/0 conn(0x7fb8ac0aefa0 legacy=0x7fb8ac06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.062+0000 7fb8ab7fe640 1 -- 172.21.15.172:0/962318446 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac071db0 con 0x7fb8ac15ba70 2024-04-25T08:42:58.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.063+0000 7fb8ab7fe640 1 --2- 172.21.15.172:0/962318446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac15ba70 0x7fb8ac0725b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009870 tx=0x7fb89c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46149396c9b63ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:58.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.063+0000 7fb8aa7fc640 1 -- 172.21.15.172:0/962318446 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c037070 con 0x7fb8ac15ba70 2024-04-25T08:42:58.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.063+0000 7fb8aa7fc640 1 -- 172.21.15.172:0/962318446 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c032440 con 0x7fb8ac15ba70 2024-04-25T08:42:58.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.063+0000 7fb8aa7fc640 1 -- 172.21.15.172:0/962318446 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c032810 con 0x7fb8ac15ba70 2024-04-25T08:42:58.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.063+0000 7fb8b1f29640 1 -- 172.21.15.172:0/962318446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac15ba70 msgr2=0x7fb8ac0725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.063+0000 7fb8b1f29640 1 --2- 172.21.15.172:0/962318446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac15ba70 0x7fb8ac0725b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009870 tx=0x7fb89c02a210 comp rx=0 tx=0).stop 2024-04-25T08:42:58.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.063+0000 7fb8b1f29640 1 -- 172.21.15.172:0/962318446 shutdown_connections 2024-04-25T08:42:58.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.064+0000 7fb8b1f29640 1 --2- 172.21.15.172:0/962318446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8ac06f360 0x7fb8ac0cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.064+0000 7fb8b1f29640 1 --2- 172.21.15.172:0/962318446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac15ba70 0x7fb8ac0725b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.064+0000 7fb8b1f29640 1 -- 172.21.15.172:0/962318446 >> 172.21.15.172:0/962318446 conn(0x7fb8ac0cfae0 msgr2=0x7fb8ac0cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:58.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.064+0000 7fb8b1f29640 1 -- 172.21.15.172:0/962318446 shutdown_connections 2024-04-25T08:42:58.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.064+0000 7fb8b1f29640 1 -- 172.21.15.172:0/962318446 wait complete. 2024-04-25T08:42:58.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.065+0000 7fb8b1f29640 1 Processor -- start 2024-04-25T08:42:58.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.065+0000 7fb8b1f29640 1 -- start start 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.065+0000 7fb8b1f29640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac06f360 0x7fb8ac15fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8b1f29640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8ac0aefa0 0x7fb8ac15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8b1f29640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8ac15ba70 0x7fb8ac156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8b1f29640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0cd420 con 0x7fb8ac06f360 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8b1f29640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0cd7e0 con 0x7fb8ac0aefa0 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8b1f29640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0cd5a0 con 0x7fb8ac15ba70 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8ab7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac06f360 0x7fb8ac15fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8ab7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac06f360 0x7fb8ac15fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56672/0 (socket says 172.21.15.172:56672) 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8ab7fe640 1 -- 172.21.15.172:0/380615102 learned_addr learned my addr 172.21.15.172:0/380615102 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8aaffd640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8ac0aefa0 0x7fb8ac15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8abfff640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8ac15ba70 0x7fb8ac156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8ab7fe640 1 -- 172.21.15.172:0/380615102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8ac15ba70 msgr2=0x7fb8ac156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8ab7fe640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8ac15ba70 0x7fb8ac156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8ab7fe640 1 -- 172.21.15.172:0/380615102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8ac0aefa0 msgr2=0x7fb8ac15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8ab7fe640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8ac0aefa0 0x7fb8ac15d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8ab7fe640 1 -- 172.21.15.172:0/380615102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac15e040 con 0x7fb8ac06f360 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8abfff640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8ac15ba70 0x7fb8ac156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8ab7fe640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac06f360 0x7fb8ac15fa70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb89c000c00 tx=0x7fb89c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb893fff640 1 -- 172.21.15.172:0/380615102 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c041070 con 0x7fb8ac06f360 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb893fff640 1 -- 172.21.15.172:0/380615102 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c03c870 con 0x7fb8ac06f360 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8b1f29640 1 -- 172.21.15.172:0/380615102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac15e320 con 0x7fb8ac06f360 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb893fff640 1 -- 172.21.15.172:0/380615102 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c037040 con 0x7fb8ac06f360 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.066+0000 7fb8b1f29640 1 -- 172.21.15.172:0/380615102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac15e8e0 con 0x7fb8ac06f360 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.067+0000 7fb8b1f29640 1 -- 172.21.15.172:0/380615102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac073990 con 0x7fb8ac06f360 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.068+0000 7fb893fff640 1 -- 172.21.15.172:0/380615102 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb89c044070 con 0x7fb8ac06f360 2024-04-25T08:42:58.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.068+0000 7fb893fff640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb89806b4d0 0x7fb89806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.068+0000 7fb893fff640 1 -- 172.21.15.172:0/380615102 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb89c0ab1f0 con 0x7fb8ac06f360 2024-04-25T08:42:58.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.068+0000 7fb8aaffd640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb89806b4d0 0x7fb89806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.069+0000 7fb8aaffd640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb89806b4d0 0x7fb89806d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00098e0 tx=0x7fb8a0009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:58.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.072+0000 7fb893fff640 1 -- 172.21.15.172:0/380615102 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8ac15be50 con 0x7fb8ac06f360 2024-04-25T08:42:58.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.279+0000 7fb8b1f29640 1 -- 172.21.15.172:0/380615102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8ac06df50 con 0x7fb8ac06f360 2024-04-25T08:42:58.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.279+0000 7fb893fff640 1 -- 172.21.15.172:0/380615102 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4943 (secure 0 0 0) 0x7fb89c079810 con 0x7fb8ac06f360 2024-04-25T08:42:58.272 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:42:58.272 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:42:28.003161+0000","modified":"2024-04-25T08:42:49.090813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:42:58.272 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 -- 172.21.15.172:0/380615102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb89806b4d0 msgr2=0x7fb89806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb89806b4d0 0x7fb89806d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00098e0 tx=0x7fb8a0009060 comp rx=0 tx=0).stop 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 -- 172.21.15.172:0/380615102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac06f360 msgr2=0x7fb8ac15fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac06f360 0x7fb8ac15fa70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb89c000c00 tx=0x7fb89c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 -- 172.21.15.172:0/380615102 shutdown_connections 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb89806b4d0 0x7fb89806d990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8ac0aefa0 0x7fb8ac15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8ac15ba70 0x7fb8ac156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 --2- 172.21.15.172:0/380615102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8ac06f360 0x7fb8ac15fa70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 -- 172.21.15.172:0/380615102 >> 172.21.15.172:0/380615102 conn(0x7fb8ac0cfae0 msgr2=0x7fb8ac15aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:58.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 -- 172.21.15.172:0/380615102 shutdown_connections 2024-04-25T08:42:58.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.281+0000 7fb8b1f29640 1 -- 172.21.15.172:0/380615102 wait complete. 2024-04-25T08:42:58.687 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:42:28.003161+0000', 'modified': '2024-04-25T08:42:49.090813+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6835/3177493296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6833', 'nonce': 3177493296}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 3177493296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:42:58.688 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:42:58.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T08:42:58.719 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:42:58.733 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:42:58.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.798+0000 7f7256a58640 1 Processor -- start 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.798+0000 7f7256a58640 1 -- start start 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f7256a58640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7250161240 0x7f72500b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f7256a58640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161890 0x7f72500ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f7256a58640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7250161620 con 0x7f72500b54a0 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f7256a58640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72500b7120 con 0x7f7250161240 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f7256a58640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7250161e00 con 0x7f7250161890 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f724f7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161890 0x7f72500ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f724f7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161890 0x7f72500ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:60770/0 (socket says 172.21.15.172:60770) 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f724f7fe640 1 -- 172.21.15.172:0/2156805974 learned_addr learned my addr 172.21.15.172:0/2156805974 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f724ffff640 1 --2- 172.21.15.172:0/2156805974 >> v2:172.21.15.186:3300/0 conn(0x7f7250161240 0x7f72500b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f724f7fe640 1 -- 172.21.15.172:0/2156805974 >> v2:172.21.15.186:3300/0 conn(0x7f7250161240 msgr2=0x7f72500b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f724f7fe640 1 --2- 172.21.15.172:0/2156805974 >> v2:172.21.15.186:3300/0 conn(0x7f7250161240 0x7f72500b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f724f7fe640 1 -- 172.21.15.172:0/2156805974 >> v1:172.21.15.186:6789/0 conn(0x7f72500b54a0 legacy=0x7f72500d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.799+0000 7f724f7fe640 1 -- 172.21.15.172:0/2156805974 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72501620e0 con 0x7f7250161890 2024-04-25T08:42:58.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.800+0000 7f724f7fe640 1 --2- 172.21.15.172:0/2156805974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161890 0x7f72500ceac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7244009870 tx=0x7f724402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5bc9fbd2e473ef3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:58.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.800+0000 7f724effd640 1 -- 172.21.15.172:0/2156805974 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244037070 con 0x7f7250161890 2024-04-25T08:42:58.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.800+0000 7f724effd640 1 -- 172.21.15.172:0/2156805974 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7244032440 con 0x7f7250161890 2024-04-25T08:42:58.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.800+0000 7f724effd640 1 -- 172.21.15.172:0/2156805974 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244032810 con 0x7f7250161890 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.801+0000 7f7256a58640 1 -- 172.21.15.172:0/2156805974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161890 msgr2=0x7f72500ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.801+0000 7f7256a58640 1 --2- 172.21.15.172:0/2156805974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161890 0x7f72500ceac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7244009870 tx=0x7f724402a270 comp rx=0 tx=0).stop 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.801+0000 7f7256a58640 1 -- 172.21.15.172:0/2156805974 shutdown_connections 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.801+0000 7f7256a58640 1 --2- 172.21.15.172:0/2156805974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161890 0x7f72500ceac0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.801+0000 7f7256a58640 1 --2- 172.21.15.172:0/2156805974 >> v2:172.21.15.186:3300/0 conn(0x7f7250161240 0x7f72500b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.801+0000 7f7256a58640 1 -- 172.21.15.172:0/2156805974 >> 172.21.15.172:0/2156805974 conn(0x7f72500d04a0 msgr2=0x7f72500d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.801+0000 7f7256a58640 1 -- 172.21.15.172:0/2156805974 shutdown_connections 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.801+0000 7f7256a58640 1 -- 172.21.15.172:0/2156805974 wait complete. 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.802+0000 7f7256a58640 1 Processor -- start 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.802+0000 7f7256a58640 1 -- start start 2024-04-25T08:42:58.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7256a58640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72500b54a0 0x7f72500c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7256a58640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161240 0x7f72501f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7256a58640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7250161890 0x7f7250150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7256a58640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500d15f0 con 0x7f7250161890 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7256a58640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501626a0 con 0x7f72500b54a0 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7256a58640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72500cf000 con 0x7f7250161240 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7254ff5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7250161890 0x7f7250150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7254ff5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7250161890 0x7f7250150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56682/0 (socket says 172.21.15.172:56682) 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7254ff5640 1 -- 172.21.15.172:0/1303963252 learned_addr learned my addr 172.21.15.172:0/1303963252 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f724f7fe640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161240 0x7f72501f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f724ffff640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72500b54a0 0x7f72500c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7254ff5640 1 -- 172.21.15.172:0/1303963252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161240 msgr2=0x7f72501f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7254ff5640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161240 0x7f72501f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7254ff5640 1 -- 172.21.15.172:0/1303963252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72500b54a0 msgr2=0x7f72500c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7254ff5640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72500b54a0 0x7f72500c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7254ff5640 1 -- 172.21.15.172:0/1303963252 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250151340 con 0x7f7250161890 2024-04-25T08:42:58.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.803+0000 7f7254ff5640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7250161890 0x7f7250150e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f724800c7a0 tx=0x7f724800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:58.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.804+0000 7f724cff9640 1 -- 172.21.15.172:0/1303963252 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248003b70 con 0x7f7250161890 2024-04-25T08:42:58.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.804+0000 7f724cff9640 1 -- 172.21.15.172:0/1303963252 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7248003d30 con 0x7f7250161890 2024-04-25T08:42:58.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.804+0000 7f724cff9640 1 -- 172.21.15.172:0/1303963252 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800aa90 con 0x7f7250161890 2024-04-25T08:42:58.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.804+0000 7f7256a58640 1 -- 172.21.15.172:0/1303963252 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72501608d0 con 0x7f7250161890 2024-04-25T08:42:58.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.804+0000 7f7256a58640 1 -- 172.21.15.172:0/1303963252 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72500c9df0 con 0x7f7250161890 2024-04-25T08:42:58.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.805+0000 7f724cff9640 1 -- 172.21.15.172:0/1303963252 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f724800ac30 con 0x7f7250161890 2024-04-25T08:42:58.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.805+0000 7f724cff9640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f723c06b4d0 0x7f723c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.806+0000 7f724cff9640 1 -- 172.21.15.172:0/1303963252 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f724808a400 con 0x7f7250161890 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.806+0000 7f724ffff640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f723c06b4d0 0x7f723c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.806+0000 7f724ffff640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f723c06b4d0 0x7f723c06d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7240009ad0 tx=0x7f7240008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.806+0000 7f7259837740 1 Processor -- start 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f7259837740 1 -- start start 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f7259837740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aac4a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f7259837740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac68020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f7259837740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac1ff10 0x5611aac66190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f7259837740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611aab82a10 con 0x5611aac67ad0 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f7259837740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611aab2bb30 con 0x5611aac1ff10 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f7259837740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611aab7ec50 con 0x5611aac4a230 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f724f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac68020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f724f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac68020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56698/0 (socket says 172.21.15.172:56698) 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f724f7fe640 1 -- 172.21.15.172:0/3393405265 learned_addr learned my addr 172.21.15.172:0/3393405265 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.807+0000 7f724ffff640 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aac4a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f7254ff5640 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac1ff10 0x5611aac66190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f724f7fe640 1 -- 172.21.15.172:0/3393405265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 msgr2=0x5611aac4a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f724f7fe640 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aac4a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f724f7fe640 1 -- 172.21.15.172:0/3393405265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac1ff10 msgr2=0x5611aac66190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f724f7fe640 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac1ff10 0x5611aac66190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f724f7fe640 1 -- 172.21.15.172:0/3393405265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611aab40e10 con 0x5611aac67ad0 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f724ffff640 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aac4a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f7254ff5640 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac1ff10 0x5611aac66190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f724f7fe640 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac68020 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7244009870 tx=0x7f724402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3fdd52e2b8351e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f7235ffb640 1 -- 172.21.15.172:0/3393405265 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244037040 con 0x5611aac67ad0 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f7235ffb640 1 -- 172.21.15.172:0/3393405265 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7244032780 con 0x5611aac67ad0 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f7235ffb640 1 -- 172.21.15.172:0/3393405265 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244032b30 con 0x5611aac67ad0 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.808+0000 7f7259837740 1 -- 172.21.15.172:0/3393405265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 msgr2=0x5611aac68020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.809+0000 7f7259837740 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac68020 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7244009870 tx=0x7f724402c000 comp rx=0 tx=0).stop 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.809+0000 7f7259837740 1 -- 172.21.15.172:0/3393405265 shutdown_connections 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.809+0000 7f7259837740 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac1ff10 0x5611aac66190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.809+0000 7f7259837740 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac68020 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.809+0000 7f7259837740 1 --2- 172.21.15.172:0/3393405265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aac4a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.809+0000 7f7259837740 1 -- 172.21.15.172:0/3393405265 >> 172.21.15.172:0/3393405265 conn(0x5611aac1c840 msgr2=0x5611aac65040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.809+0000 7f7259837740 1 -- 172.21.15.172:0/3393405265 shutdown_connections 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.809+0000 7f7259837740 1 -- 172.21.15.172:0/3393405265 wait complete. 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.809+0000 7f7259837740 1 -- start start 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.809+0000 7f7259837740 1 Processor -- start 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f7259837740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac4a230 0x5611aac5bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f7259837740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac36200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f7259837740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac48040 0x5611aac4d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f7259837740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611aac20cb0 con 0x5611aac67ad0 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f7259837740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611aab3f0c0 con 0x5611aac4a230 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f7259837740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611aac1a770 con 0x5611aac48040 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f7259837740 10 client.0 _ll_register_callbacks cb 0x5611aab32ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f724f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac36200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f724f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac36200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56714/0 (socket says 172.21.15.172:56714) 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f724f7fe640 1 -- 172.21.15.172:0/2860085616 learned_addr learned my addr 172.21.15.172:0/2860085616 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f724ffff640 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac4a230 0x5611aac5bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.810+0000 7f7254ff5640 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac48040 0x5611aac4d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f724f7fe640 1 -- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac48040 msgr2=0x5611aac4d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f724f7fe640 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac48040 0x5611aac4d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f724f7fe640 1 -- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac4a230 msgr2=0x5611aac5bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f724f7fe640 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac4a230 0x5611aac5bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f724f7fe640 1 -- 172.21.15.172:0/2860085616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611aa8972d0 con 0x5611aac67ad0 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f724f7fe640 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac36200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f724402a860 tx=0x7f7244004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bfb1b6295b3553 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f722effd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f722effd640 1 -- 172.21.15.172:0/2860085616 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724404c060 con 0x5611aac67ad0 2024-04-25T08:42:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f722effd640 1 -- 172.21.15.172:0/2860085616 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7244032d40 con 0x5611aac67ad0 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f7259837740 1 -- 172.21.15.172:0/2860085616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7244032780 con 0x5611aac67ad0 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f722effd640 1 -- 172.21.15.172:0/2860085616 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7244052050 con 0x5611aac67ad0 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f7259837740 10 client.4815 fetch_fsmap learned FSMap version 8 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f7259837740 1 -- 172.21.15.172:0/2860085616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5611aa9616b0 con 0x5611aac67ad0 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f722effd640 1 -- 172.21.15.172:0/2860085616 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7244032780 con 0x5611aac67ad0 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f722effd640 1 -- 172.21.15.172:0/2860085616 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f7244055020 con 0x5611aac67ad0 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f7259837740 10 client.4815 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f7259837740 10 client.4815 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f7259837740 20 client.4815 populate_metadata read hostname 'smithi172' 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f7259837740 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x5611aac78b40 0x5611aac78f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f7259837740 4 client.4815 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.811+0000 7f7259837740 1 -- 172.21.15.172:0/2860085616 --> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611aabe1920 con 0x5611aac78b40 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.812+0000 7f724ffff640 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x5611aac78b40 0x5611aac78f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.812+0000 7f724ffff640 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x5611aac78b40 0x5611aac78f20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2190096c6875a2f1 server_cookie=bcc62470f5ef2a7d in_seq=0 out_seq=0 2024-04-25T08:42:58.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.812+0000 7f722effd640 10 client.4815 ms_handle_connect on v2:172.21.15.186:6833/3177493296 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f722effd640 1 -- 172.21.15.172:0/2860085616 <== mds.0 v2:172.21.15.186:6833/3177493296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5611aabe1920 con 0x5611aac78b40 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f722effd640 10 client.4815 handle_command_reply: tid=0 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 client.4815 shutdown 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 -- 172.21.15.172:0/2860085616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 msgr2=0x5611aac36200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac36200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f724402a860 tx=0x7f7244004730 comp rx=0 tx=0).stop 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 -- 172.21.15.172:0/2860085616 shutdown_connections 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x5611aac78b40 0x5611aac78f20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac48040 0x5611aac4d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac36200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f722effd640 0 client.4815 ms_handle_reset on v2:172.21.15.186:6833/3177493296 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 --2- 172.21.15.172:0/2860085616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac4a230 0x5611aac5bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 -- 172.21.15.172:0/2860085616 >> 172.21.15.172:0/2860085616 conn(0x5611aac1ff10 msgr2=0x5611aac685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 -- 172.21.15.172:0/2860085616 shutdown_connections 2024-04-25T08:42:58.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 1 -- 172.21.15.172:0/2860085616 wait complete. 2024-04-25T08:42:58.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.813+0000 7f7259837740 20 client.4815 trim_cache size 0 max 16384 2024-04-25T08:42:58.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.829+0000 7f7259837740 1 Processor -- start 2024-04-25T08:42:58.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.829+0000 7f7259837740 1 -- start start 2024-04-25T08:42:58.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.829+0000 7f7259837740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac48040 0x5611aac31e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.829+0000 7f7259837740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aac74ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.829+0000 7f7259837740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac20540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.829+0000 7f7259837740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7250200650 con 0x5611aac67ad0 2024-04-25T08:42:58.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.829+0000 7f7259837740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501ffc80 con 0x5611aac48040 2024-04-25T08:42:58.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.829+0000 7f7259837740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7250200080 con 0x5611aac4a230 2024-04-25T08:42:58.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f7254ff5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac20540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f7254ff5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac20540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56722/0 (socket says 172.21.15.172:56722) 2024-04-25T08:42:58.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f7254ff5640 1 -- 172.21.15.172:0/2252667937 learned_addr learned my addr 172.21.15.172:0/2252667937 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f724f7fe640 1 --2- 172.21.15.172:0/2252667937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aac74ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f724ffff640 1 --2- 172.21.15.172:0/2252667937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac48040 0x5611aac31e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f7254ff5640 1 -- 172.21.15.172:0/2252667937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 msgr2=0x5611aac74ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f7254ff5640 1 --2- 172.21.15.172:0/2252667937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aac74ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f7254ff5640 1 -- 172.21.15.172:0/2252667937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac48040 msgr2=0x5611aac31e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f7254ff5640 1 --2- 172.21.15.172:0/2252667937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac48040 0x5611aac31e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f7254ff5640 1 -- 172.21.15.172:0/2252667937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611aac49e60 con 0x5611aac67ad0 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f724f7fe640 1 --2- 172.21.15.172:0/2252667937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aac74ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f7254ff5640 1 --2- 172.21.15.172:0/2252667937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac20540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7248058860 tx=0x7f72480014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6958fb10fc688c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f72357fa640 1 -- 172.21.15.172:0/2252667937 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248086070 con 0x5611aac67ad0 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f72357fa640 1 -- 172.21.15.172:0/2252667937 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724805ca20 con 0x5611aac67ad0 2024-04-25T08:42:58.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.830+0000 7f72357fa640 1 -- 172.21.15.172:0/2252667937 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248070070 con 0x5611aac67ad0 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 -- 172.21.15.172:0/2252667937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 msgr2=0x5611aac20540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 --2- 172.21.15.172:0/2252667937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac20540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7248058860 tx=0x7f72480014a0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 -- 172.21.15.172:0/2252667937 shutdown_connections 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 --2- 172.21.15.172:0/2252667937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aac20540 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 --2- 172.21.15.172:0/2252667937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aac74ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 --2- 172.21.15.172:0/2252667937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac48040 0x5611aac31e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 -- 172.21.15.172:0/2252667937 >> 172.21.15.172:0/2252667937 conn(0x5611aac1ff10 msgr2=0x5611aac36010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 -- 172.21.15.172:0/2252667937 shutdown_connections 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 -- 172.21.15.172:0/2252667937 wait complete. 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 -- start start 2024-04-25T08:42:58.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.831+0000 7f7259837740 1 Processor -- start 2024-04-25T08:42:58.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f7259837740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac48040 0x5611aac77750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f7259837740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aacc68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f7259837740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aacc6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f7259837740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611aac49060 con 0x5611aac67ad0 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f7259837740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611aac48aa0 con 0x5611aac48040 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f7259837740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611aac333f0 con 0x5611aac4a230 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f7259837740 10 client.0 _ll_register_callbacks cb 0x5611aac1ac50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f7254ff5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aacc6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f7254ff5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aacc6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56734/0 (socket says 172.21.15.172:56734) 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f7254ff5640 1 -- 172.21.15.172:0/50782125 learned_addr learned my addr 172.21.15.172:0/50782125 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f724ffff640 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac48040 0x5611aac77750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.832+0000 7f724f7fe640 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aacc68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7254ff5640 1 -- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 msgr2=0x5611aacc68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7254ff5640 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aacc68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7254ff5640 1 -- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac48040 msgr2=0x5611aac77750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:42:58.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7254ff5640 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac48040 0x5611aac77750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7254ff5640 1 -- 172.21.15.172:0/50782125 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611aac77c90 con 0x5611aac67ad0 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f724f7fe640 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aacc68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7254ff5640 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aacc6df0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f72480886d0 tx=0x7f7248088550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6797761673735a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f722effd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f722effd640 1 -- 172.21.15.172:0/50782125 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248086070 con 0x5611aac67ad0 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f722effd640 1 -- 172.21.15.172:0/50782125 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7248054f40 con 0x5611aac67ad0 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7259837740 1 -- 172.21.15.172:0/50782125 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f724805ca20 con 0x5611aac67ad0 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f722effd640 1 -- 172.21.15.172:0/50782125 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7248070040 con 0x5611aac67ad0 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7259837740 10 client.4821 fetch_fsmap learned FSMap version 8 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7259837740 1 -- 172.21.15.172:0/50782125 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5611aacca7c0 con 0x5611aac67ad0 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f722effd640 1 -- 172.21.15.172:0/50782125 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724805ca20 con 0x5611aac67ad0 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f722effd640 1 -- 172.21.15.172:0/50782125 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f724808a0b0 con 0x5611aac67ad0 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7259837740 10 client.4821 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7259837740 10 client.4821 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:42:58.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7259837740 20 client.4821 populate_metadata read hostname 'smithi172' 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7259837740 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x5611aac5b040 0x5611aac5b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7259837740 4 client.4821 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f7259837740 1 -- 172.21.15.172:0/50782125 --> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5611aab8ff50 con 0x5611aac5b040 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.833+0000 7f724ffff640 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x5611aac5b040 0x5611aac5b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f724ffff640 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x5611aac5b040 0x5611aac5b420 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21b104b1d292d5aa server_cookie=b3a5bc403d40319c in_seq=0 out_seq=0 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f722effd640 10 client.4821 ms_handle_connect on v2:172.21.15.186:6833/3177493296 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f722effd640 1 -- 172.21.15.172:0/50782125 <== mds.0 v2:172.21.15.186:6833/3177493296 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5611aab8ff50 con 0x5611aac5b040 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f722effd640 10 client.4821 handle_command_reply: tid=0 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 client.4821 shutdown 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 -- 172.21.15.172:0/50782125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 msgr2=0x5611aacc6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aacc6df0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f72480886d0 tx=0x7f7248088550 comp rx=0 tx=0).stop 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 -- 172.21.15.172:0/50782125 shutdown_connections 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:6833/3177493296,v1:172.21.15.186:6835/3177493296] conn(0x5611aac5b040 0x5611aac5b420 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611aac67ad0 0x5611aacc6df0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5611aac4a230 0x5611aacc68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f722effd640 0 client.4821 ms_handle_reset on v2:172.21.15.186:6833/3177493296 2024-04-25T08:42:58.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 --2- 172.21.15.172:0/50782125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5611aac48040 0x5611aac77750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 -- 172.21.15.172:0/50782125 >> 172.21.15.172:0/50782125 conn(0x5611aac1ff10 msgr2=0x5611aac31e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:58.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 -- 172.21.15.172:0/50782125 shutdown_connections 2024-04-25T08:42:58.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 1 -- 172.21.15.172:0/50782125 wait complete. 2024-04-25T08:42:58.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.834+0000 7f7259837740 20 client.4821 trim_cache size 0 max 16384 2024-04-25T08:42:58.834 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:42:58.834 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:42:58.834 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:42:58.834 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 4287, 2024-04-25T08:42:58.834 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:42:58.835 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:42:58.835 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:42:58.835 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 30.166089739, 2024-04-25T08:42:58.835 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 8, 2024-04-25T08:42:58.835 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 24, 2024-04-25T08:42:58.835 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 24, 2024-04-25T08:42:58.835 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 36.724362894000002 2024-04-25T08:42:58.835 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 -- 172.21.15.172:0/1303963252 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f723c06b4d0 msgr2=0x7f723c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f723c06b4d0 0x7f723c06d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7240009ad0 tx=0x7f7240008040 comp rx=0 tx=0).stop 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 -- 172.21.15.172:0/1303963252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7250161890 msgr2=0x7f7250150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7250161890 0x7f7250150e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f724800c7a0 tx=0x7f724800cc60 comp rx=0 tx=0).stop 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 -- 172.21.15.172:0/1303963252 shutdown_connections 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f723c06b4d0 0x7f723c06d990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7250161890 0x7f7250150e00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7250161240 0x7f72501f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 --2- 172.21.15.172:0/1303963252 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72500b54a0 0x7f72500c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 -- 172.21.15.172:0/1303963252 >> 172.21.15.172:0/1303963252 conn(0x7f72500d04a0 msgr2=0x7f72500b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 -- 172.21.15.172:0/1303963252 shutdown_connections 2024-04-25T08:42:58.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:58.835+0000 7f7256a58640 1 -- 172.21.15.172:0/1303963252 wait complete. 2024-04-25T08:42:58.838 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T08:42:58.851 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T08:42:58.852 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T08:42:58.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:58.852 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:42:58.866 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T08:42:58.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:58.867 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T08:42:58.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:58.930 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-04-25T08:42:59.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.021 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:42:59.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.036 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-04-25T08:42:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2024-04-25T08:42:59.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:42:59.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.109 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T08:42:59.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.128 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-04-25T08:42:59.197 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-04-25T08:42:59.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:42:59.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.199 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T08:42:59.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.257 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-04-25T08:42:59.326 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-04-25T08:42:59.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:42:59.328 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T08:42:59.328 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:42:59.328 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:42:59.328 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:42:59.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.433+0000 7fa90806b640 1 Processor -- start 2024-04-25T08:42:59.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.433+0000 7fa90806b640 1 -- start start 2024-04-25T08:42:59.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa90806b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa9000ce590 0x7fa900165900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:59.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa90806b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa900071480 con 0x7fa900154ee0 2024-04-25T08:42:59.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa90806b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa900071760 con 0x7fa9000cfec0 2024-04-25T08:42:59.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa90806b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa900072090 con 0x7fa9000ce590 2024-04-25T08:42:59.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa906608640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa9000ce590 0x7fa900165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:59.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa905e07640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa900154ee0 0x7fa9000cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59668/0 (socket says 172.21.15.172:59668) 2024-04-25T08:42:59.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa905e07640 1 -- 172.21.15.172:0/2827870183 learned_addr learned my addr 172.21.15.172:0/2827870183 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:42:59.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa906608640 1 -- 172.21.15.172:0/2827870183 >> v1:172.21.15.186:6789/0 conn(0x7fa9000cfec0 legacy=0x7fa9000cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:59.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa906608640 1 -- 172.21.15.172:0/2827870183 >> v1:172.21.15.172:6789/0 conn(0x7fa900154ee0 legacy=0x7fa9000cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa906608640 1 -- 172.21.15.172:0/2827870183 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900071a40 con 0x7fa9000ce590 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.434+0000 7fa904e05640 1 -- 172.21.15.172:0/2827870183 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708915068 0 0) 0x7fa900071480 con 0x7fa900154ee0 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.435+0000 7fa906608640 1 --2- 172.21.15.172:0/2827870183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000ce590 0x7fa900165900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009d90 tx=0x7fa8f802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b27b3b98a743a67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.435+0000 7fa904e05640 1 -- 172.21.15.172:0/2827870183 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8007740 con 0x7fa9000ce590 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.435+0000 7fa904e05640 1 -- 172.21.15.172:0/2827870183 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f80078e0 con 0x7fa9000ce590 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.435+0000 7fa904e05640 1 -- 172.21.15.172:0/2827870183 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8007cb0 con 0x7fa9000ce590 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.435+0000 7fa90806b640 1 -- 172.21.15.172:0/2827870183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000ce590 msgr2=0x7fa900165900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.435+0000 7fa90806b640 1 --2- 172.21.15.172:0/2827870183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000ce590 0x7fa900165900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009d90 tx=0x7fa8f802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.435+0000 7fa90806b640 1 -- 172.21.15.172:0/2827870183 shutdown_connections 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.435+0000 7fa90806b640 1 --2- 172.21.15.172:0/2827870183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000ce590 0x7fa900165900 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.435+0000 7fa90806b640 1 -- 172.21.15.172:0/2827870183 >> 172.21.15.172:0/2827870183 conn(0x7fa90006abe0 msgr2=0x7fa90006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.436+0000 7fa90806b640 1 -- 172.21.15.172:0/2827870183 shutdown_connections 2024-04-25T08:42:59.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.436+0000 7fa90806b640 1 -- 172.21.15.172:0/2827870183 wait complete. 2024-04-25T08:42:59.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.437+0000 7fa90806b640 1 Processor -- start 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.437+0000 7fa90806b640 1 -- start start 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.437+0000 7fa90806b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9000ce590 0x7fa900158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.437+0000 7fa90806b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000cfec0 0x7fa900159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.437+0000 7fa90806b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900154ee0 0x7fa9001f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.437+0000 7fa90806b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001552c0 con 0x7fa9000cfec0 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.437+0000 7fa90806b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa900071230 con 0x7fa9000ce590 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.437+0000 7fa90806b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa900155440 con 0x7fa900154ee0 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.437+0000 7fa905606640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000cfec0 0x7fa900159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa905606640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000cfec0 0x7fa900159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56740/0 (socket says 172.21.15.172:56740) 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa905606640 1 -- 172.21.15.172:0/1421113244 learned_addr learned my addr 172.21.15.172:0/1421113244 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa905e07640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9000ce590 0x7fa900158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:59.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa906608640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900154ee0 0x7fa9001f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa905606640 1 -- 172.21.15.172:0/1421113244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900154ee0 msgr2=0x7fa9001f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa905606640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900154ee0 0x7fa9001f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa905606640 1 -- 172.21.15.172:0/1421113244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9000ce590 msgr2=0x7fa900158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa905606640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9000ce590 0x7fa900158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa905606640 1 -- 172.21.15.172:0/1421113244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900158d90 con 0x7fa9000cfec0 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa905606640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000cfec0 0x7fa900159e30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c480 tx=0x7fa8f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa8f67fc640 1 -- 172.21.15.172:0/1421113244 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00052d0 con 0x7fa9000cfec0 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa8f67fc640 1 -- 172.21.15.172:0/1421113244 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f0005470 con 0x7fa9000cfec0 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa8f67fc640 1 -- 172.21.15.172:0/1421113244 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0012870 con 0x7fa9000cfec0 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa90806b640 1 -- 172.21.15.172:0/1421113244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa900159070 con 0x7fa9000cfec0 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.438+0000 7fa90806b640 1 -- 172.21.15.172:0/1421113244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa900159630 con 0x7fa9000cfec0 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.439+0000 7fa90806b640 1 -- 172.21.15.172:0/1421113244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa900073990 con 0x7fa9000cfec0 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.440+0000 7fa8f67fc640 1 -- 172.21.15.172:0/1421113244 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa8f0012a10 con 0x7fa9000cfec0 2024-04-25T08:42:59.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.440+0000 7fa8f67fc640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa8e406b4d0 0x7fa8e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:42:59.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.440+0000 7fa905e07640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa8e406b4d0 0x7fa8e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:42:59.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.440+0000 7fa8f67fc640 1 -- 172.21.15.172:0/1421113244 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa8f008a0a0 con 0x7fa9000cfec0 2024-04-25T08:42:59.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.440+0000 7fa905e07640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa8e406b4d0 0x7fa8e406d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000f60 tx=0x7fa8fc007e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:42:59.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.445+0000 7fa8f67fc640 1 -- 172.21.15.172:0/1421113244 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8f0058c70 con 0x7fa9000cfec0 2024-04-25T08:42:59.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.659+0000 7fa90806b640 1 -- 172.21.15.172:0/1421113244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa90006b3d0 con 0x7fa9000cfec0 2024-04-25T08:42:59.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.659+0000 7fa8f67fc640 1 -- 172.21.15.172:0/1421113244 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa8f0058570 con 0x7fa9000cfec0 2024-04-25T08:42:59.651 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 -- 172.21.15.172:0/1421113244 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa8e406b4d0 msgr2=0x7fa8e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa8e406b4d0 0x7fa8e406d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000f60 tx=0x7fa8fc007e40 comp rx=0 tx=0).stop 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 -- 172.21.15.172:0/1421113244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000cfec0 msgr2=0x7fa900159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000cfec0 0x7fa900159e30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c480 tx=0x7fa8f000c940 comp rx=0 tx=0).stop 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 -- 172.21.15.172:0/1421113244 shutdown_connections 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa8e406b4d0 0x7fa8e406d990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa900154ee0 0x7fa9001f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9000cfec0 0x7fa900159e30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 --2- 172.21.15.172:0/1421113244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9000ce590 0x7fa900158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 -- 172.21.15.172:0/1421113244 >> 172.21.15.172:0/1421113244 conn(0x7fa90006abe0 msgr2=0x7fa90015ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:42:59.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 -- 172.21.15.172:0/1421113244 shutdown_connections 2024-04-25T08:42:59.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:42:59.661+0000 7fa90806b640 1 -- 172.21.15.172:0/1421113244 wait complete. 2024-04-25T08:42:59.665 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:42:59.665 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:42:59.665 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:42:59.665 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:42:59.665 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:42:59.665 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:42:59.665 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:42:59.665 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:42:59.665 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:42:59.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.666 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:42:59.681 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:42:59.681 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:42:59.681 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:42:59.681 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:42:59.681 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:42:59.681 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:42:59.681 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:42:59.681 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:42:59.681 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:42:59.681 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:42:59.682 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T08:42:59.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.683 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:42:59.683 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:42:59.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add name ceph-brx type bridge 2024-04-25T08:42:59.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr flush dev ceph-brx 2024-04-25T08:42:59.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set ceph-brx up 2024-04-25T08:42:59.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T08:42:59.683 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:42:59.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.776 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:42:59.798 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:42:59.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.800 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:42:59.855 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:42:59.855 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:42:59.855 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:42:59.856 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:42:59.856 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:42:59.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.856 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:42:59.856 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:42:59.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:42:59.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:42:59.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:42:59.856 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:42:59.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.940 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:42:59.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:42:59.955 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2024-04-25T08:43:00.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:00.009 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:43:00.009 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:43:00.010 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:43:00.010 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T08:43:00.010 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:43:00.085 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T08:43:00.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:00.085 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:43:00.085 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:43:00.085 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T08:43:00.085 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T08:43:00.085 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T08:43:00.085 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T08:43:00.085 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T08:43:00.085 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:43:00.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:00.193 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:43:00.193 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:43:00.194 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:43:00.194 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T08:43:00.194 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:43:00.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:43:00.228 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:43:00.282 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:43:00.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:43:00.283 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:43:00.337 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:43:00.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:00.338 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:43:00.419 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:43:00.419 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:43:00.419 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:43:00.534 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:43:00.534 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:43:00.534 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:43:00.535 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:43:00.535 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:43:00.544 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:43:00.544 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:43:00.544 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:43:00.544 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:43:00.544 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:43:00.545 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:43:00.545 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:43:00.545 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:43:00.545 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:43:00.545 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:43:00.545 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:43:00.546 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:43:00.546 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:43:00.547 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:43:00.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:00.547 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:43:00.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:00.611 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:00.668 INFO:teuthology.orchestra.run.smithi172.stdout:client4517 2024-04-25T08:43:00.668 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:43:00.668 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:00.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:00.724 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:00.780 INFO:teuthology.orchestra.run.smithi172.stdout:client4517 2024-04-25T08:43:00.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:00.781 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:00.837 INFO:teuthology.orchestra.run.smithi172.stdout:client4517 2024-04-25T08:43:00.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:00.838 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2.client4517/status') 2024-04-25T08:43:00.900 INFO:teuthology.orchestra.run.smithi172.stdout:instance: client.4517 (3)172.21.15.172:0/2245504705 2024-04-25T08:43:00.900 INFO:teuthology.orchestra.run.smithi172.stdout:blocklisted: false 2024-04-25T08:43:00.900 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records in 2024-04-25T08:43:00.901 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records out 2024-04-25T08:43:00.901 INFO:teuthology.orchestra.run.smithi172.stderr:71 bytes copied, 3.9522e-05 s, 1.8 MB/s 2024-04-25T08:43:00.902 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-25T08:43:00.902 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:43:00.902 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T08:43:00.902 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:43:01.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.047+0000 7eff672ac640 1 Processor -- start 2024-04-25T08:43:01.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.047+0000 7eff672ac640 1 -- start start 2024-04-25T08:43:01.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff672ac640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7eff60154ed0 0x7eff600aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff672ac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff60071ac0 0x7eff600ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff672ac640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6015ec60 con 0x7eff6006c1d0 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff672ac640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6015ef40 con 0x7eff60154ed0 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff672ac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6006db90 con 0x7eff60071ac0 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff65048640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7eff60154ed0 0x7eff600aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff65048640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7eff60154ed0 0x7eff600aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56754/0 (socket says 172.21.15.172:56754) 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff65048640 1 -- 172.21.15.172:0/3514068896 learned_addr learned my addr 172.21.15.172:0/3514068896 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff64847640 1 --2- 172.21.15.172:0/3514068896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff60071ac0 0x7eff600ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff65048640 1 -- 172.21.15.172:0/3514068896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff60071ac0 msgr2=0x7eff600ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff65048640 1 --2- 172.21.15.172:0/3514068896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff60071ac0 0x7eff600ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff65048640 1 -- 172.21.15.172:0/3514068896 >> v1:172.21.15.186:6789/0 conn(0x7eff6006c1d0 legacy=0x7eff601617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:01.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.048+0000 7eff65048640 1 -- 172.21.15.172:0/3514068896 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6006de70 con 0x7eff60154ed0 2024-04-25T08:43:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.049+0000 7eff65048640 1 --2- 172.21.15.172:0/3514068896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 0x7eff600aced0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009870 tx=0x7eff5c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4fbbda722ddccc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.049+0000 7eff57fff640 1 -- 172.21.15.172:0/3514068896 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c037070 con 0x7eff60154ed0 2024-04-25T08:43:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.049+0000 7eff57fff640 1 -- 172.21.15.172:0/3514068896 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c032440 con 0x7eff60154ed0 2024-04-25T08:43:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.049+0000 7eff57fff640 1 -- 172.21.15.172:0/3514068896 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c032810 con 0x7eff60154ed0 2024-04-25T08:43:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.049+0000 7eff672ac640 1 -- 172.21.15.172:0/3514068896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 msgr2=0x7eff600aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.050+0000 7eff672ac640 1 --2- 172.21.15.172:0/3514068896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 0x7eff600aced0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009870 tx=0x7eff5c02a210 comp rx=0 tx=0).stop 2024-04-25T08:43:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.050+0000 7eff672ac640 1 -- 172.21.15.172:0/3514068896 shutdown_connections 2024-04-25T08:43:01.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.050+0000 7eff672ac640 1 --2- 172.21.15.172:0/3514068896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff60071ac0 0x7eff600ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:01.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.050+0000 7eff672ac640 1 --2- 172.21.15.172:0/3514068896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 0x7eff600aced0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:01.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.050+0000 7eff672ac640 1 -- 172.21.15.172:0/3514068896 >> 172.21.15.172:0/3514068896 conn(0x7eff600af670 msgr2=0x7eff600b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:01.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.050+0000 7eff672ac640 1 -- 172.21.15.172:0/3514068896 shutdown_connections 2024-04-25T08:43:01.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.050+0000 7eff672ac640 1 -- 172.21.15.172:0/3514068896 wait complete. 2024-04-25T08:43:01.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.051+0000 7eff672ac640 1 Processor -- start 2024-04-25T08:43:01.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.051+0000 7eff672ac640 1 -- start start 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff672ac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff60071ac0 0x7eff60153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff672ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 0x7eff600c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff672ac640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff601f7560 0x7eff601f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff672ac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600add20 con 0x7eff60154ed0 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff672ac640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff600adba0 con 0x7eff601f7560 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff672ac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff60161ee0 con 0x7eff60071ac0 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff64847640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 0x7eff600c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff64847640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 0x7eff600c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56770/0 (socket says 172.21.15.172:56770) 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff64847640 1 -- 172.21.15.172:0/1716161989 learned_addr learned my addr 172.21.15.172:0/1716161989 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff65849640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff601f7560 0x7eff601f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff65048640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff60071ac0 0x7eff60153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:01.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff64847640 1 -- 172.21.15.172:0/1716161989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff60071ac0 msgr2=0x7eff60153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff64847640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff60071ac0 0x7eff60153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff64847640 1 -- 172.21.15.172:0/1716161989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff601f7560 msgr2=0x7eff601f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff64847640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff601f7560 0x7eff601f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff64847640 1 -- 172.21.15.172:0/1716161989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff601f83c0 con 0x7eff60154ed0 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff64847640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 0x7eff600c5680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c7f0 tx=0x7eff5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff55ffb640 1 -- 172.21.15.172:0/1716161989 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50015070 con 0x7eff60154ed0 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff55ffb640 1 -- 172.21.15.172:0/1716161989 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff50004220 con 0x7eff60154ed0 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff55ffb640 1 -- 172.21.15.172:0/1716161989 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50007620 con 0x7eff60154ed0 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.052+0000 7eff672ac640 1 -- 172.21.15.172:0/1716161989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff600cd510 con 0x7eff60154ed0 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.053+0000 7eff672ac640 1 -- 172.21.15.172:0/1716161989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff600cda90 con 0x7eff60154ed0 2024-04-25T08:43:01.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.054+0000 7eff672ac640 1 -- 172.21.15.172:0/1716161989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff600b2b10 con 0x7eff60154ed0 2024-04-25T08:43:01.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.054+0000 7eff55ffb640 1 -- 172.21.15.172:0/1716161989 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff500079d0 con 0x7eff60154ed0 2024-04-25T08:43:01.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.054+0000 7eff55ffb640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff4406b4d0 0x7eff4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:01.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.054+0000 7eff55ffb640 1 -- 172.21.15.172:0/1716161989 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7eff5008a7c0 con 0x7eff60154ed0 2024-04-25T08:43:01.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.054+0000 7eff65048640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff4406b4d0 0x7eff4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:01.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.055+0000 7eff65048640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff4406b4d0 0x7eff4406d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff5c034000 tx=0x7eff5c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:01.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.059+0000 7eff55ffb640 1 -- 172.21.15.172:0/1716161989 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff601f83c0 con 0x7eff60154ed0 2024-04-25T08:43:01.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.267+0000 7eff672ac640 1 -- 172.21.15.172:0/1716161989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff600d0ba0 con 0x7eff60154ed0 2024-04-25T08:43:01.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.267+0000 7eff55ffb640 1 -- 172.21.15.172:0/1716161989 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7eff600d0ba0 con 0x7eff60154ed0 2024-04-25T08:43:01.260 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T08:43:01.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 -- 172.21.15.172:0/1716161989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff4406b4d0 msgr2=0x7eff4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:01.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff4406b4d0 0x7eff4406d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff5c034000 tx=0x7eff5c02e000 comp rx=0 tx=0).stop 2024-04-25T08:43:01.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 -- 172.21.15.172:0/1716161989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 msgr2=0x7eff600c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:01.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 0x7eff600c5680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c7f0 tx=0x7eff5000ccb0 comp rx=0 tx=0).stop 2024-04-25T08:43:01.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 -- 172.21.15.172:0/1716161989 shutdown_connections 2024-04-25T08:43:01.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff4406b4d0 0x7eff4406d990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:01.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff601f7560 0x7eff601f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:01.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff60154ed0 0x7eff600c5680 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:01.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 --2- 172.21.15.172:0/1716161989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff60071ac0 0x7eff60153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:01.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 -- 172.21.15.172:0/1716161989 >> 172.21.15.172:0/1716161989 conn(0x7eff6006c1d0 msgr2=0x7eff600b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:01.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 -- 172.21.15.172:0/1716161989 shutdown_connections 2024-04-25T08:43:01.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:01.270+0000 7eff672ac640 1 -- 172.21.15.172:0/1716161989 wait complete. 2024-04-25T08:43:01.274 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:43:01.274 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:43:01.274 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:43:01.274 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T08:43:01.274 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T08:43:01.274 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:43:01.274 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:43:01.274 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:43:01.274 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T08:43:01.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.275 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:43:01.290 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:43:01.290 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:43:01.290 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:43:01.290 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.290 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:43:01.290 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42738sec preferred_lft 42738sec 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:43:01.291 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:01.292 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:43:01.292 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.292 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link tentative 2024-04-25T08:43:01.292 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.292 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:43:01.292 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:43:01.292 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link tentative 2024-04-25T08:43:01.292 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.292 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:43:01.355 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:43:01.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.356 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:43:01.412 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:43:01.412 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:43:01.413 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:43:01.413 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:43:01.413 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:43:01.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.413 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:43:01.413 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:43:01.413 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:43:01.413 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:43:01.413 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:43:01.413 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:43:01.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.499 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:43:01.513 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:43:01.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.514 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2024-04-25T08:43:01.569 INFO:teuthology.orchestra.run.smithi172.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T08:43:01.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.569 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:43:01.569 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:43:01.569 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:43:01.569 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T08:43:01.569 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:43:01.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.657 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T08:43:01.680 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:43:01.680 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:43:01.681 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:43:01.681 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.681 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:43:01.681 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.681 INFO:teuthology.orchestra.run.smithi172.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:43:01.681 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 02:b8:a4:5d:a0:a2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:43:01.681 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:43:01.681 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.681 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::b8:a4ff:fe5d:a0a2/64 scope link 2024-04-25T08:43:01.681 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.682 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T08:43:01.746 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:43:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:43:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:43:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.746 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:43:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.747 INFO:teuthology.orchestra.run.smithi172.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:43:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 02:b8:a4:5d:a0:a2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:43:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:43:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::b8:a4ff:fe5d:a0a2/64 scope link 2024-04-25T08:43:01.747 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:01.748 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T08:43:01.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.748 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:43:01.748 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:43:01.748 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T08:43:01.748 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T08:43:01.749 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T08:43:01.749 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T08:43:01.749 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T08:43:01.749 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:43:01.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:01.859 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:43:01.859 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:43:01.859 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.1 up 2024-04-25T08:43:01.859 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T08:43:01.859 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:43:01.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:43:01.894 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T08:43:01.949 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T08:43:01.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:43:01.950 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T08:43:02.004 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:43:02.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:02.004 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T08:43:02.085 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T08:43:02.085 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T08:43:02.085 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:43:02.094 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T08:43:02.094 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T08:43:02.094 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:43:02.094 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:43:02.094 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:43:02.099 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T08:43:02.099 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T08:43:02.099 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:43:02.100 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:43:02.100 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:43:02.100 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:43:02.100 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:43:02.100 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:43:02.100 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-25T08:43:02.100 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:43:02.101 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:43:02.101 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:43:02.101 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:43:02.102 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:43:02.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:02.103 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T08:43:02.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:02.167 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:02.223 INFO:teuthology.orchestra.run.smithi172.stdout:client4711 2024-04-25T08:43:02.223 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:43:02.223 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:02.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:02.278 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:02.333 INFO:teuthology.orchestra.run.smithi172.stdout:client4711 2024-04-25T08:43:02.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:02.334 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:02.389 INFO:teuthology.orchestra.run.smithi172.stdout:client4711 2024-04-25T08:43:02.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:02.390 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2.client4711/status') 2024-04-25T08:43:02.454 INFO:teuthology.orchestra.run.smithi172.stdout:instance: client.4711 (3)172.21.15.172:0/2740298941 2024-04-25T08:43:02.454 INFO:teuthology.orchestra.run.smithi172.stdout:blocklisted: false 2024-04-25T08:43:02.454 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records in 2024-04-25T08:43:02.454 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records out 2024-04-25T08:43:02.454 INFO:teuthology.orchestra.run.smithi172.stderr:71 bytes copied, 2.226e-05 s, 3.2 MB/s 2024-04-25T08:43:02.455 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T08:43:02.455 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:43:02.455 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T08:43:02.455 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:43:02.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.600+0000 7f9fbf710640 1 Processor -- start 2024-04-25T08:43:02.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.600+0000 7f9fbf710640 1 -- start start 2024-04-25T08:43:02.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.601+0000 7f9fbf710640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 0x7f9fb806f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:02.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.601+0000 7f9fbf710640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9fb806d9f0 0x7f9fb815bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:02.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.601+0000 7f9fbf710640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb806c730 con 0x7f9fb815bb60 2024-04-25T08:43:02.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.601+0000 7f9fbf710640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb806b690 con 0x7f9fb806d9f0 2024-04-25T08:43:02.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.601+0000 7f9fbf710640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb806b970 con 0x7f9fb80721d0 2024-04-25T08:43:02.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.601+0000 7f9fbdcad640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9fb806d9f0 0x7f9fb815bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:02.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.601+0000 7f9fbccab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 0x7f9fb806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:02.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.601+0000 7f9fbccab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 0x7f9fb806f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:60838/0 (socket says 172.21.15.172:60838) 2024-04-25T08:43:02.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.601+0000 7f9fbccab640 1 -- 172.21.15.172:0/1115760928 learned_addr learned my addr 172.21.15.172:0/1115760928 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:02.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.601+0000 7f9fbdcad640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9fb806d9f0 0x7f9fb815bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:33948/0 (socket says 172.21.15.172:33948) 2024-04-25T08:43:02.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.602+0000 7f9fbccab640 1 -- 172.21.15.172:0/1115760928 >> v2:172.21.15.186:3300/0 conn(0x7f9fb806d9f0 msgr2=0x7f9fb815bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:02.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.602+0000 7f9fbccab640 1 --2- 172.21.15.172:0/1115760928 >> v2:172.21.15.186:3300/0 conn(0x7f9fb806d9f0 0x7f9fb815bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:02.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.602+0000 7f9fbccab640 1 -- 172.21.15.172:0/1115760928 >> v1:172.21.15.186:6789/0 conn(0x7f9fb815bb60 legacy=0x7f9fb8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:02.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.602+0000 7f9fbccab640 1 -- 172.21.15.172:0/1115760928 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb806bc50 con 0x7f9fb80721d0 2024-04-25T08:43:02.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.602+0000 7f9fbccab640 1 --2- 172.21.15.172:0/1115760928 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 0x7f9fb806f550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009870 tx=0x7f9fa802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31a3077145eff186 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:02.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.602+0000 7f9faffff640 1 -- 172.21.15.172:0/1115760928 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8037070 con 0x7f9fb80721d0 2024-04-25T08:43:02.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.603+0000 7f9faffff640 1 -- 172.21.15.172:0/1115760928 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa8032440 con 0x7f9fb80721d0 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.603+0000 7f9faffff640 1 -- 172.21.15.172:0/1115760928 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8032810 con 0x7f9fb80721d0 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.603+0000 7f9fbf710640 1 -- 172.21.15.172:0/1115760928 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 msgr2=0x7f9fb806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.603+0000 7f9fbf710640 1 --2- 172.21.15.172:0/1115760928 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 0x7f9fb806f550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009870 tx=0x7f9fa802a270 comp rx=0 tx=0).stop 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.603+0000 7f9fbf710640 1 -- 172.21.15.172:0/1115760928 shutdown_connections 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.603+0000 7f9fbf710640 1 --2- 172.21.15.172:0/1115760928 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 0x7f9fb806f550 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.603+0000 7f9fbf710640 1 --2- 172.21.15.172:0/1115760928 >> v2:172.21.15.186:3300/0 conn(0x7f9fb806d9f0 0x7f9fb815bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.603+0000 7f9fbf710640 1 -- 172.21.15.172:0/1115760928 >> 172.21.15.172:0/1115760928 conn(0x7f9fb80af670 msgr2=0x7f9fb80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.603+0000 7f9fbf710640 1 -- 172.21.15.172:0/1115760928 shutdown_connections 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.603+0000 7f9fbf710640 1 -- 172.21.15.172:0/1115760928 wait complete. 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.604+0000 7f9fbf710640 1 Processor -- start 2024-04-25T08:43:02.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.604+0000 7f9fbf710640 1 -- start start 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbf710640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 0x7f9fb81492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbf710640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fb815bb60 0x7f9fb813c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbf710640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8151a40 0x7f9fb8151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbf710640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80727f0 con 0x7f9fb8151a40 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbf710640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb806c210 con 0x7f9fb815bb60 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbf710640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8072970 con 0x7f9fb80721d0 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbdcad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8151a40 0x7f9fb8151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbdcad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8151a40 0x7f9fb8151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56784/0 (socket says 172.21.15.172:56784) 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbdcad640 1 -- 172.21.15.172:0/1537689916 learned_addr learned my addr 172.21.15.172:0/1537689916 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbccab640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fb815bb60 0x7f9fb813c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:02.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbd4ac640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 0x7f9fb81492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbdcad640 1 -- 172.21.15.172:0/1537689916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 msgr2=0x7f9fb81492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbdcad640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 0x7f9fb81492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbdcad640 1 -- 172.21.15.172:0/1537689916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fb815bb60 msgr2=0x7f9fb813c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.605+0000 7f9fbdcad640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fb815bb60 0x7f9fb813c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.606+0000 7f9fbdcad640 1 -- 172.21.15.172:0/1537689916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb8148220 con 0x7f9fb8151a40 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.606+0000 7f9fbccab640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fb815bb60 0x7f9fb813c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.606+0000 7f9fbdcad640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8151a40 0x7f9fb8151ef0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000efc0 tx=0x7f9fb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.606+0000 7f9fadffb640 1 -- 172.21.15.172:0/1537689916 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0018020 con 0x7f9fb8151a40 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.606+0000 7f9fadffb640 1 -- 172.21.15.172:0/1537689916 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb0009b10 con 0x7f9fb8151a40 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.606+0000 7f9fbf710640 1 -- 172.21.15.172:0/1537689916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb8148500 con 0x7f9fb8151a40 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.606+0000 7f9fadffb640 1 -- 172.21.15.172:0/1537689916 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00146c0 con 0x7f9fb8151a40 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.606+0000 7f9fbf710640 1 -- 172.21.15.172:0/1537689916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb8148ac0 con 0x7f9fb8151a40 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.607+0000 7f9fbf710640 1 -- 172.21.15.172:0/1537689916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb8073990 con 0x7f9fb8151a40 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.607+0000 7f9fadffb640 1 -- 172.21.15.172:0/1537689916 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9fb0005d10 con 0x7f9fb8151a40 2024-04-25T08:43:02.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.608+0000 7f9fadffb640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f9c06b4d0 0x7f9f9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:02.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.608+0000 7f9fadffb640 1 -- 172.21.15.172:0/1537689916 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9fb008b380 con 0x7f9fb8151a40 2024-04-25T08:43:02.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.608+0000 7f9fbd4ac640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f9c06b4d0 0x7f9f9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:02.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.608+0000 7f9fbd4ac640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f9c06b4d0 0x7f9f9c06d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4001500 tx=0x7f9fb4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:02.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.612+0000 7f9fadffb640 1 -- 172.21.15.172:0/1537689916 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9fb0022030 con 0x7f9fb8151a40 2024-04-25T08:43:02.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.820+0000 7f9fbf710640 1 -- 172.21.15.172:0/1537689916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9fb8071fb0 con 0x7f9fb8151a40 2024-04-25T08:43:02.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.821+0000 7f9fadffb640 1 -- 172.21.15.172:0/1537689916 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9fb0010040 con 0x7f9fb8151a40 2024-04-25T08:43:02.813 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T08:43:02.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 -- 172.21.15.172:0/1537689916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f9c06b4d0 msgr2=0x7f9f9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:02.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f9c06b4d0 0x7f9f9c06d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4001500 tx=0x7f9fb4009040 comp rx=0 tx=0).stop 2024-04-25T08:43:02.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 -- 172.21.15.172:0/1537689916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8151a40 msgr2=0x7f9fb8151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8151a40 0x7f9fb8151ef0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000efc0 tx=0x7f9fb000c490 comp rx=0 tx=0).stop 2024-04-25T08:43:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 -- 172.21.15.172:0/1537689916 shutdown_connections 2024-04-25T08:43:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f9c06b4d0 0x7f9f9c06d990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fb815bb60 0x7f9fb813c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8151a40 0x7f9fb8151ef0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 --2- 172.21.15.172:0/1537689916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fb80721d0 0x7f9fb81492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 -- 172.21.15.172:0/1537689916 >> 172.21.15.172:0/1537689916 conn(0x7f9fb806d9f0 msgr2=0x7f9fb81505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 -- 172.21.15.172:0/1537689916 shutdown_connections 2024-04-25T08:43:02.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:02.823+0000 7f9fbf710640 1 -- 172.21.15.172:0/1537689916 wait complete. 2024-04-25T08:43:02.826 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:43:02.826 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:43:02.826 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi186.front.sepia.ceph.com 2024-04-25T08:43:02.826 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T08:43:02.826 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T08:43:02.826 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:43:02.826 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:43:02.826 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:43:02.826 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T08:43:02.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:02.827 DEBUG:teuthology.orchestra.run.smithi186:> ip addr 2024-04-25T08:43:02.845 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f0 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f1 2024-04-25T08:43:02.847 INFO:teuthology.orchestra.run.smithi186.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f4 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:02.847 INFO:teuthology.orchestra.run.smithi186.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:43:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: inet 172.21.15.186/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:43:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft 42736sec preferred_lft 42736sec 2024-04-25T08:43:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::8a7d:21c8:a225:c880/64 scope link noprefixroute 2024-04-25T08:43:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:02.847 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T08:43:02.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:02.848 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2024-04-25T08:43:02.848 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T08:43:02.848 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add name ceph-brx type bridge 2024-04-25T08:43:02.848 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip addr flush dev ceph-brx 2024-04-25T08:43:02.848 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set ceph-brx up 2024-04-25T08:43:02.848 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T08:43:02.848 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T08:43:03.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:03.056 DEBUG:teuthology.orchestra.run.smithi186:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:43:03.080 INFO:teuthology.orchestra.run.smithi186.stdout:1 2024-04-25T08:43:03.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:03.082 DEBUG:teuthology.orchestra.run.smithi186:> route 2024-04-25T08:43:03.159 INFO:teuthology.orchestra.run.smithi186.stdout:Kernel IP routing table 2024-04-25T08:43:03.159 INFO:teuthology.orchestra.run.smithi186.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:43:03.159 INFO:teuthology.orchestra.run.smithi186.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:43:03.159 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:43:03.159 INFO:teuthology.orchestra.run.smithi186.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:43:03.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:03.160 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2024-04-25T08:43:03.160 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T08:43:03.160 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:43:03.160 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:43:03.160 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:43:03.160 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T08:43:03.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:03.396 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T08:43:03.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:03.410 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list-id 2024-04-25T08:43:03.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:03.464 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2024-04-25T08:43:03.464 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T08:43:03.464 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T08:43:03.464 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T08:43:03.465 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T08:43:03.551 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T08:43:03.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:03.552 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2024-04-25T08:43:03.552 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T08:43:03.552 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T08:43:03.552 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T08:43:03.552 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T08:43:03.552 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T08:43:03.552 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T08:43:03.552 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T08:43:03.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:03.635 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2024-04-25T08:43:03.635 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T08:43:03.635 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set brx.0 up 2024-04-25T08:43:03.635 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T08:43:03.635 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T08:43:03.670 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:43:03.670 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T08:43:03.724 INFO:teuthology.orchestra.run.smithi186.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T08:43:03.725 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:43:03.725 DEBUG:teuthology.orchestra.run.smithi186:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T08:43:03.779 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:43:03.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:03.780 DEBUG:teuthology.orchestra.run.smithi186:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T08:43:03.873 INFO:teuthology.orchestra.run.smithi186.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T08:43:03.873 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T08:43:03.873 INFO:teuthology.orchestra.run.smithi186.stdout:invalid new device string format 2024-04-25T08:43:03.975 INFO:teuthology.orchestra.run.smithi186.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T08:43:03.975 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T08:43:03.976 INFO:teuthology.orchestra.run.smithi186.stdout:invalid new device string format 2024-04-25T08:43:03.976 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:43:03.976 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:43:03.980 INFO:teuthology.orchestra.run.smithi186.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T08:43:03.980 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T08:43:03.980 INFO:teuthology.orchestra.run.smithi186.stdout:invalid new device string format 2024-04-25T08:43:03.980 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:43:03.981 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:43:03.981 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:43:03.981 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:43:03.981 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:43:03.981 INFO:teuthology.orchestra.run.smithi186.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-25T08:43:03.982 INFO:teuthology.orchestra.run.smithi186.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:43:03.982 INFO:teuthology.orchestra.run.smithi186.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:43:03.982 INFO:teuthology.orchestra.run.smithi186.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:43:03.982 INFO:teuthology.orchestra.run.smithi186.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:43:03.984 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:43:03.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:03.984 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T08:43:04.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.013 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:04.069 INFO:teuthology.orchestra.run.smithi186.stdout:client4720 2024-04-25T08:43:04.069 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:43:04.069 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:04.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.126 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:04.181 INFO:teuthology.orchestra.run.smithi186.stdout:client4720 2024-04-25T08:43:04.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.181 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:04.237 INFO:teuthology.orchestra.run.smithi186.stdout:client4720 2024-04-25T08:43:04.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.237 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2.client4720/status') 2024-04-25T08:43:04.300 INFO:teuthology.orchestra.run.smithi186.stdout:instance: client.4720 (3)192.168.0.1:0/3987510561 2024-04-25T08:43:04.301 INFO:teuthology.orchestra.run.smithi186.stdout:blocklisted: false 2024-04-25T08:43:04.301 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2024-04-25T08:43:04.301 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2024-04-25T08:43:04.301 INFO:teuthology.orchestra.run.smithi186.stderr:69 bytes copied, 2.384e-05 s, 2.9 MB/s 2024-04-25T08:43:04.302 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-25T08:43:04.302 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T08:43:04.302 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T08:43:04.302 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:43:04.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.418+0000 7f6ff61f9640 1 Processor -- start 2024-04-25T08:43:04.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.418+0000 7f6ff61f9640 1 -- start start 2024-04-25T08:43:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.419+0000 7f6ff61f9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff013d190 0x7f6ff00cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.419+0000 7f6ff61f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6ff00cc4f0 0x7f6ff0071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.419+0000 7f6ff61f9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff00cc940 con 0x7f6ff015b320 2024-04-25T08:43:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.419+0000 7f6ff61f9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff00cfd30 con 0x7f6ff00cc4f0 2024-04-25T08:43:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.419+0000 7f6ff61f9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0071ed0 con 0x7f6ff013d190 2024-04-25T08:43:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.419+0000 7f6feffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6ff00cc4f0 0x7f6ff0071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.419+0000 7f6feeffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff013d190 0x7f6ff00cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.419+0000 7f6fef7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6ff015b320 0x7f6ff00cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59672/0 (socket says 172.21.15.172:59672) 2024-04-25T08:43:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.419+0000 7f6fef7fe640 1 -- 172.21.15.172:0/1927021209 learned_addr learned my addr 172.21.15.172:0/1927021209 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.420+0000 7f6feffff640 1 -- 172.21.15.172:0/1927021209 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff013d190 msgr2=0x7f6ff00cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.420+0000 7f6feffff640 1 --2- 172.21.15.172:0/1927021209 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff013d190 0x7f6ff00cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.420+0000 7f6feffff640 1 -- 172.21.15.172:0/1927021209 >> v1:172.21.15.172:6789/0 conn(0x7f6ff015b320 legacy=0x7f6ff00cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.420+0000 7f6fee7fc640 1 -- 172.21.15.172:0/1927021209 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704231678 0 0) 0x7f6ff00cc940 con 0x7f6ff015b320 2024-04-25T08:43:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.420+0000 7f6feffff640 1 -- 172.21.15.172:0/1927021209 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff015a840 con 0x7f6ff00cc4f0 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.420+0000 7f6feffff640 1 --2- 172.21.15.172:0/1927021209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff00cc4f0 0x7f6ff0071230 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009d90 tx=0x7f6fe802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eab0b0de419bd28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6fee7fc640 1 -- 172.21.15.172:0/1927021209 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8031600 con 0x7f6ff00cc4f0 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6fee7fc640 1 -- 172.21.15.172:0/1927021209 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe80317a0 con 0x7f6ff00cc4f0 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6fee7fc640 1 -- 172.21.15.172:0/1927021209 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8031b70 con 0x7f6ff00cc4f0 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6ff61f9640 1 -- 172.21.15.172:0/1927021209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff00cc4f0 msgr2=0x7f6ff0071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6ff61f9640 1 --2- 172.21.15.172:0/1927021209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff00cc4f0 0x7f6ff0071230 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009d90 tx=0x7f6fe802a5d0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6ff61f9640 1 -- 172.21.15.172:0/1927021209 shutdown_connections 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6ff61f9640 1 --2- 172.21.15.172:0/1927021209 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff013d190 0x7f6ff00cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6ff61f9640 1 --2- 172.21.15.172:0/1927021209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff00cc4f0 0x7f6ff0071230 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6ff61f9640 1 -- 172.21.15.172:0/1927021209 >> 172.21.15.172:0/1927021209 conn(0x7f6ff006abe0 msgr2=0x7f6ff006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6ff61f9640 1 -- 172.21.15.172:0/1927021209 shutdown_connections 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.421+0000 7f6ff61f9640 1 -- 172.21.15.172:0/1927021209 wait complete. 2024-04-25T08:43:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.422+0000 7f6ff61f9640 1 Processor -- start 2024-04-25T08:43:04.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.423+0000 7f6ff61f9640 1 -- start start 2024-04-25T08:43:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.423+0000 7f6ff61f9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff00cc4f0 0x7f6ff01f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.423+0000 7f6ff61f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff013d190 0x7f6ff014fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.423+0000 7f6ff61f9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff015b320 0x7f6ff00b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.423+0000 7f6ff61f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0071770 con 0x7f6ff013d190 2024-04-25T08:43:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.423+0000 7f6ff61f9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff015ae00 con 0x7f6ff00cc4f0 2024-04-25T08:43:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.423+0000 7f6ff61f9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00718f0 con 0x7f6ff015b320 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feeffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff013d190 0x7f6ff014fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feeffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff013d190 0x7f6ff014fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56800/0 (socket says 172.21.15.172:56800) 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feeffd640 1 -- 172.21.15.172:0/2130082213 learned_addr learned my addr 172.21.15.172:0/2130082213 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feffff640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff015b320 0x7f6ff00b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6fef7fe640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff00cc4f0 0x7f6ff01f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feeffd640 1 -- 172.21.15.172:0/2130082213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff015b320 msgr2=0x7f6ff00b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feeffd640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff015b320 0x7f6ff00b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feeffd640 1 -- 172.21.15.172:0/2130082213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff00cc4f0 msgr2=0x7f6ff01f13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feeffd640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff00cc4f0 0x7f6ff01f13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feeffd640 1 -- 172.21.15.172:0/2130082213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff00b06c0 con 0x7f6ff013d190 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feffff640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff015b320 0x7f6ff00b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6feeffd640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff013d190 0x7f6ff014fd80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400e9b0 tx=0x7f6fe400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6fd7fff640 1 -- 172.21.15.172:0/2130082213 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4017070 con 0x7f6ff013d190 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6fd7fff640 1 -- 172.21.15.172:0/2130082213 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe400c9a0 con 0x7f6ff013d190 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6fd7fff640 1 -- 172.21.15.172:0/2130082213 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe400cd90 con 0x7f6ff013d190 2024-04-25T08:43:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6ff61f9640 1 -- 172.21.15.172:0/2130082213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff00b09a0 con 0x7f6ff013d190 2024-04-25T08:43:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.424+0000 7f6ff61f9640 1 -- 172.21.15.172:0/2130082213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff01f1930 con 0x7f6ff013d190 2024-04-25T08:43:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.425+0000 7f6ff61f9640 1 -- 172.21.15.172:0/2130082213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff0073990 con 0x7f6ff013d190 2024-04-25T08:43:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.426+0000 7f6fd7fff640 1 -- 172.21.15.172:0/2130082213 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fe401a070 con 0x7f6ff013d190 2024-04-25T08:43:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.426+0000 7f6fd7fff640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fdc06b4d0 0x7f6fdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.426+0000 7f6fd7fff640 1 -- 172.21.15.172:0/2130082213 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6fe408a520 con 0x7f6ff013d190 2024-04-25T08:43:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.426+0000 7f6fef7fe640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fdc06b4d0 0x7f6fdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.427+0000 7f6fef7fe640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fdc06b4d0 0x7f6fdc06d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0007fd0 tx=0x7f6fe0007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:04.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.430+0000 7f6fd7fff640 1 -- 172.21.15.172:0/2130082213 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6fe4058a10 con 0x7f6ff013d190 2024-04-25T08:43:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.638+0000 7f6ff61f9640 1 -- 172.21.15.172:0/2130082213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6ff01502c0 con 0x7f6ff013d190 2024-04-25T08:43:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.639+0000 7f6fd7fff640 1 -- 172.21.15.172:0/2130082213 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6fe405cab0 con 0x7f6ff013d190 2024-04-25T08:43:04.631 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T08:43:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.640+0000 7f6ff61f9640 1 -- 172.21.15.172:0/2130082213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fdc06b4d0 msgr2=0x7f6fdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.640+0000 7f6ff61f9640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fdc06b4d0 0x7f6fdc06d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0007fd0 tx=0x7f6fe0007de0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.640+0000 7f6ff61f9640 1 -- 172.21.15.172:0/2130082213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff013d190 msgr2=0x7f6ff014fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.640+0000 7f6ff61f9640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff013d190 0x7f6ff014fd80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400e9b0 tx=0x7f6fe400ee70 comp rx=0 tx=0).stop 2024-04-25T08:43:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.641+0000 7f6ff61f9640 1 -- 172.21.15.172:0/2130082213 shutdown_connections 2024-04-25T08:43:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.641+0000 7f6ff61f9640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fdc06b4d0 0x7f6fdc06d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.641+0000 7f6ff61f9640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff015b320 0x7f6ff00b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.641+0000 7f6ff61f9640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff013d190 0x7f6ff014fd80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.641+0000 7f6ff61f9640 1 --2- 172.21.15.172:0/2130082213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff00cc4f0 0x7f6ff01f13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:04.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.641+0000 7f6ff61f9640 1 -- 172.21.15.172:0/2130082213 >> 172.21.15.172:0/2130082213 conn(0x7f6ff006abe0 msgr2=0x7f6ff006e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:04.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.641+0000 7f6ff61f9640 1 -- 172.21.15.172:0/2130082213 shutdown_connections 2024-04-25T08:43:04.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:04.641+0000 7f6ff61f9640 1 -- 172.21.15.172:0/2130082213 wait complete. 2024-04-25T08:43:04.644 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T08:43:04.644 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:43:04.644 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi186.front.sepia.ceph.com 2024-04-25T08:43:04.644 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T08:43:04.644 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T08:43:04.644 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T08:43:04.644 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T08:43:04.644 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:43:04.644 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T08:43:04.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.644 DEBUG:teuthology.orchestra.run.smithi186:> ip addr 2024-04-25T08:43:04.660 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f0 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f1 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f4 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f5 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: inet 172.21.15.186/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft 42734sec preferred_lft 42734sec 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::8a7d:21c8:a225:c880/64 scope link noprefixroute 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether ba:d6:2a:fc:1a:79 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::9821:1eff:fe6c:56aa/64 scope link 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:04.662 INFO:teuthology.orchestra.run.smithi186.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:43:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether ba:d6:2a:fc:1a:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T08:43:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::b8d6:2aff:fefc:1a79/64 scope link tentative 2024-04-25T08:43:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:04.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.663 DEBUG:teuthology.orchestra.run.smithi186:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:43:04.724 INFO:teuthology.orchestra.run.smithi186.stdout:1 2024-04-25T08:43:04.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.725 DEBUG:teuthology.orchestra.run.smithi186:> route 2024-04-25T08:43:04.780 INFO:teuthology.orchestra.run.smithi186.stdout:Kernel IP routing table 2024-04-25T08:43:04.780 INFO:teuthology.orchestra.run.smithi186.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:43:04.780 INFO:teuthology.orchestra.run.smithi186.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:43:04.780 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:43:04.781 INFO:teuthology.orchestra.run.smithi186.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:43:04.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.781 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2024-04-25T08:43:04.781 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T08:43:04.781 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:43:04.781 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:43:04.781 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:43:04.781 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T08:43:04.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.866 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T08:43:04.880 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T08:43:04.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.881 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list-id 2024-04-25T08:43:04.935 INFO:teuthology.orchestra.run.smithi186.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T08:43:04.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:04.935 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2024-04-25T08:43:04.935 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T08:43:04.935 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T08:43:04.935 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T08:43:04.936 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T08:43:05.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:05.011 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T08:43:05.073 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 92:19:ec:49:a8:da brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::9019:ecff:fe49:a8da/64 scope link tentative 2024-04-25T08:43:05.074 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:05.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:05.076 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 92:19:ec:49:a8:da brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::9019:ecff:fe49:a8da/64 scope link tentative 2024-04-25T08:43:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:05.140 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T08:43:05.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:05.141 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2024-04-25T08:43:05.141 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T08:43:05.141 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T08:43:05.141 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T08:43:05.141 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T08:43:05.141 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T08:43:05.141 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T08:43:05.141 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T08:43:05.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:05.248 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec bash -c ' 2024-04-25T08:43:05.248 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T08:43:05.248 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set brx.1 up 2024-04-25T08:43:05.248 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T08:43:05.248 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T08:43:05.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:43:05.283 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T08:43:05.337 INFO:teuthology.orchestra.run.smithi186.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T08:43:05.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:43:05.338 DEBUG:teuthology.orchestra.run.smithi186:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T08:43:05.392 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:43:05.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:05.434 DEBUG:teuthology.orchestra.run.smithi186:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T08:43:05.474 INFO:teuthology.orchestra.run.smithi186.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T08:43:05.475 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T08:43:05.475 INFO:teuthology.orchestra.run.smithi186.stdout:invalid new device string format 2024-04-25T08:43:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T08:43:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T08:43:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:invalid new device string format 2024-04-25T08:43:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:43:05.483 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:43:05.488 INFO:teuthology.orchestra.run.smithi186.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T08:43:05.488 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T08:43:05.488 INFO:teuthology.orchestra.run.smithi186.stdout:invalid new device string format 2024-04-25T08:43:05.488 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:43:05.488 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:43:05.488 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:43:05.488 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:43:05.489 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:43:05.489 INFO:teuthology.orchestra.run.smithi186.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-25T08:43:05.489 INFO:teuthology.orchestra.run.smithi186.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:43:05.489 INFO:teuthology.orchestra.run.smithi186.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:43:05.489 INFO:teuthology.orchestra.run.smithi186.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:43:05.489 INFO:teuthology.orchestra.run.smithi186.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:43:05.491 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:43:05.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:05.491 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T08:43:05.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:05.554 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:05.611 INFO:teuthology.orchestra.run.smithi186.stdout:client4532 2024-04-25T08:43:05.611 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:43:05.611 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:05.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:05.666 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:05.723 INFO:teuthology.orchestra.run.smithi186.stdout:client4532 2024-04-25T08:43:05.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:05.723 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:05.778 INFO:teuthology.orchestra.run.smithi186.stdout:client4532 2024-04-25T08:43:05.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:05.779 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2.client4532/status') 2024-04-25T08:43:05.842 INFO:teuthology.orchestra.run.smithi186.stdout:instance: client.4532 (3)192.168.0.2:0/3643313200 2024-04-25T08:43:05.842 INFO:teuthology.orchestra.run.smithi186.stdout:blocklisted: false 2024-04-25T08:43:05.843 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2024-04-25T08:43:05.843 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2024-04-25T08:43:05.843 INFO:teuthology.orchestra.run.smithi186.stderr:69 bytes copied, 2.1563e-05 s, 3.2 MB/s 2024-04-25T08:43:05.844 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T08:43:05.860 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:05.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.978+0000 7f83559e7640 1 Processor -- start 2024-04-25T08:43:05.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.979+0000 7f83559e7640 1 -- start start 2024-04-25T08:43:05.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.979+0000 7f83559e7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f83500b5f00 0x7f83500ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:05.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.979+0000 7f83559e7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500cec00 con 0x7f83500d0b10 2024-04-25T08:43:05.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.979+0000 7f83559e7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500ceee0 con 0x7f835015db60 2024-04-25T08:43:05.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.979+0000 7f83559e7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83500ce930 con 0x7f83500b5f00 2024-04-25T08:43:05.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.980+0000 7f834e7fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f83500d0b10 0x7f83500d2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59676/0 (socket says 172.21.15.172:59676) 2024-04-25T08:43:05.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.980+0000 7f834e7fc640 1 -- 172.21.15.172:0/3950001170 learned_addr learned my addr 172.21.15.172:0/3950001170 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:05.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.980+0000 7f834f7fe640 1 --2- 172.21.15.172:0/3950001170 >> v2:172.21.15.186:3300/0 conn(0x7f83500b5f00 0x7f83500ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:05.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.980+0000 7f834dffb640 1 -- 172.21.15.172:0/3950001170 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675062722 0 0) 0x7f83500cec00 con 0x7f83500d0b10 2024-04-25T08:43:05.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.980+0000 7f834dffb640 1 -- 172.21.15.172:0/3950001170 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8338003520 con 0x7f83500d0b10 2024-04-25T08:43:05.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.980+0000 7f834f7fe640 1 -- 172.21.15.172:0/3950001170 >> v1:172.21.15.186:6789/0 conn(0x7f835015db60 legacy=0x7f83500d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:05.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.980+0000 7f834f7fe640 1 -- 172.21.15.172:0/3950001170 >> v1:172.21.15.172:6789/0 conn(0x7f83500d0b10 legacy=0x7f83500d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:05.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.980+0000 7f834f7fe640 1 -- 172.21.15.172:0/3950001170 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500cf1c0 con 0x7f83500b5f00 2024-04-25T08:43:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.981+0000 7f834f7fe640 1 --2- 172.21.15.172:0/3950001170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83500b5f00 0x7f83500ce3f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f83480097d0 tx=0x7f834802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcff3d9bbe5278be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.981+0000 7f834dffb640 1 -- 172.21.15.172:0/3950001170 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348037070 con 0x7f83500b5f00 2024-04-25T08:43:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.981+0000 7f834dffb640 1 -- 172.21.15.172:0/3950001170 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8348032440 con 0x7f83500b5f00 2024-04-25T08:43:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.981+0000 7f834dffb640 1 -- 172.21.15.172:0/3950001170 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348032810 con 0x7f83500b5f00 2024-04-25T08:43:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.981+0000 7f83559e7640 1 -- 172.21.15.172:0/3950001170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83500b5f00 msgr2=0x7f83500ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.981+0000 7f83559e7640 1 --2- 172.21.15.172:0/3950001170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83500b5f00 0x7f83500ce3f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f83480097d0 tx=0x7f834802a1c0 comp rx=0 tx=0).stop 2024-04-25T08:43:05.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.981+0000 7f83559e7640 1 -- 172.21.15.172:0/3950001170 shutdown_connections 2024-04-25T08:43:05.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.982+0000 7f83559e7640 1 --2- 172.21.15.172:0/3950001170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83500b5f00 0x7f83500ce3f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:05.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.982+0000 7f83559e7640 1 -- 172.21.15.172:0/3950001170 >> 172.21.15.172:0/3950001170 conn(0x7f8350061600 msgr2=0x7f8350061a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:05.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.982+0000 7f83559e7640 1 -- 172.21.15.172:0/3950001170 shutdown_connections 2024-04-25T08:43:05.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.982+0000 7f83559e7640 1 -- 172.21.15.172:0/3950001170 wait complete. 2024-04-25T08:43:05.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.983+0000 7f83559e7640 1 Processor -- start 2024-04-25T08:43:05.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.983+0000 7f83559e7640 1 -- start start 2024-04-25T08:43:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f83559e7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83500b5f00 0x7f83500c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f83559e7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83500d0b10 0x7f8350147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f83559e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835015db60 0x7f8350155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f83559e7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835015df40 con 0x7f835015db60 2024-04-25T08:43:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f83559e7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500b6450 con 0x7f83500b5f00 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f83559e7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835015e0c0 con 0x7f83500d0b10 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835015db60 0x7f8350155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835015db60 0x7f8350155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56816/0 (socket says 172.21.15.172:56816) 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834f7fe640 1 -- 172.21.15.172:0/1692354172 learned_addr learned my addr 172.21.15.172:0/1692354172 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834e7fc640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83500d0b10 0x7f8350147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834effd640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83500b5f00 0x7f83500c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834f7fe640 1 -- 172.21.15.172:0/1692354172 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83500d0b10 msgr2=0x7f8350147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834f7fe640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83500d0b10 0x7f8350147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834f7fe640 1 -- 172.21.15.172:0/1692354172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83500b5f00 msgr2=0x7f83500c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834f7fe640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83500b5f00 0x7f83500c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:05.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834f7fe640 1 -- 172.21.15.172:0/1692354172 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500cb970 con 0x7f835015db60 2024-04-25T08:43:05.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834e7fc640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83500d0b10 0x7f8350147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:05.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834effd640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83500b5f00 0x7f83500c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:05.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f834f7fe640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835015db60 0x7f8350155070 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f83480098f0 tx=0x7f83480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:05.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f8337fff640 1 -- 172.21.15.172:0/1692354172 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348037040 con 0x7f835015db60 2024-04-25T08:43:05.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f8337fff640 1 -- 172.21.15.172:0/1692354172 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8348042070 con 0x7f835015db60 2024-04-25T08:43:05.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f83559e7640 1 -- 172.21.15.172:0/1692354172 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83500cbc50 con 0x7f835015db60 2024-04-25T08:43:05.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f8337fff640 1 -- 172.21.15.172:0/1692354172 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348030860 con 0x7f835015db60 2024-04-25T08:43:05.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.984+0000 7f83559e7640 1 -- 172.21.15.172:0/1692354172 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83501555b0 con 0x7f835015db60 2024-04-25T08:43:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.986+0000 7f83559e7640 1 -- 172.21.15.172:0/1692354172 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8350073270 con 0x7f835015db60 2024-04-25T08:43:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.986+0000 7f8337fff640 1 -- 172.21.15.172:0/1692354172 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8348030a00 con 0x7f835015db60 2024-04-25T08:43:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.986+0000 7f8337fff640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f833c06b4d0 0x7f833c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.987+0000 7f8337fff640 1 -- 172.21.15.172:0/1692354172 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f83480aae50 con 0x7f835015db60 2024-04-25T08:43:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.987+0000 7f834effd640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f833c06b4d0 0x7f833c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:05.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.987+0000 7f834effd640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f833c06b4d0 0x7f833c06d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8340001cd0 tx=0x7f8340009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:05.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:05.991+0000 7f8337fff640 1 -- 172.21.15.172:0/1692354172 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8348079ab0 con 0x7f835015db60 2024-04-25T08:43:06.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.162+0000 7f83559e7640 1 -- 172.21.15.172:0/1692354172 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8350073990 con 0x7f835015db60 2024-04-25T08:43:06.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.163+0000 7f8337fff640 1 -- 172.21.15.172:0/1692354172 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f83480793b0 con 0x7f835015db60 2024-04-25T08:43:06.155 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:06.155 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:06.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 -- 172.21.15.172:0/1692354172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f833c06b4d0 msgr2=0x7f833c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f833c06b4d0 0x7f833c06d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8340001cd0 tx=0x7f8340009040 comp rx=0 tx=0).stop 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 -- 172.21.15.172:0/1692354172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835015db60 msgr2=0x7f8350155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835015db60 0x7f8350155070 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f83480098f0 tx=0x7f83480046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 -- 172.21.15.172:0/1692354172 shutdown_connections 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f833c06b4d0 0x7f833c06d990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835015db60 0x7f8350155070 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83500d0b10 0x7f8350147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 --2- 172.21.15.172:0/1692354172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83500b5f00 0x7f83500c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 -- 172.21.15.172:0/1692354172 >> 172.21.15.172:0/1692354172 conn(0x7f8350061600 msgr2=0x7f83500cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 -- 172.21.15.172:0/1692354172 shutdown_connections 2024-04-25T08:43:06.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.165+0000 7f83559e7640 1 -- 172.21.15.172:0/1692354172 wait complete. 2024-04-25T08:43:06.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:43:06.169 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:06.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.277+0000 7f8fadb90640 1 Processor -- start 2024-04-25T08:43:06.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.277+0000 7f8fadb90640 1 -- start start 2024-04-25T08:43:06.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.277+0000 7f8fadb90640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fa80ce900 0x7f8fa8166870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.277+0000 7f8fadb90640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa80ced00 con 0x7f8fa8155f80 2024-04-25T08:43:06.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.277+0000 7f8fadb90640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa80b4d80 con 0x7f8fa806fbd0 2024-04-25T08:43:06.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.277+0000 7f8fadb90640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa80b5390 con 0x7f8fa80ce900 2024-04-25T08:43:06.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.278+0000 7f8fa7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fa80ce900 0x7f8fa8166870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.278+0000 7f8fa77fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8fa8155f80 0x7f8fa806f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59680/0 (socket says 172.21.15.172:59680) 2024-04-25T08:43:06.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.278+0000 7f8fa77fe640 1 -- 172.21.15.172:0/2396129217 learned_addr learned my addr 172.21.15.172:0/2396129217 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:06.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.278+0000 7f8fa7fff640 1 -- 172.21.15.172:0/2396129217 >> v1:172.21.15.186:6789/0 conn(0x7f8fa806fbd0 legacy=0x7f8fa80ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:06.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.278+0000 7f8fa7fff640 1 -- 172.21.15.172:0/2396129217 >> v1:172.21.15.172:6789/0 conn(0x7f8fa8155f80 legacy=0x7f8fa806f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.278+0000 7f8fa7fff640 1 -- 172.21.15.172:0/2396129217 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80cef70 con 0x7f8fa80ce900 2024-04-25T08:43:06.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.278+0000 7f8fa67fc640 1 -- 172.21.15.172:0/2396129217 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181034117 0 0) 0x7f8fa80ced00 con 0x7f8fa8155f80 2024-04-25T08:43:06.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fa7fff640 1 --2- 172.21.15.172:0/2396129217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 0x7f8fa8166870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80b5510 tx=0x7f8fa002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc821e0392fb87b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:06.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fa67fc640 1 -- 172.21.15.172:0/2396129217 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0007740 con 0x7f8fa80ce900 2024-04-25T08:43:06.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fa67fc640 1 -- 172.21.15.172:0/2396129217 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa00078e0 con 0x7f8fa80ce900 2024-04-25T08:43:06.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fa67fc640 1 -- 172.21.15.172:0/2396129217 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0007cb0 con 0x7f8fa80ce900 2024-04-25T08:43:06.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fadb90640 1 -- 172.21.15.172:0/2396129217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 msgr2=0x7f8fa8166870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fadb90640 1 --2- 172.21.15.172:0/2396129217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 0x7f8fa8166870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80b5510 tx=0x7f8fa002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fadb90640 1 -- 172.21.15.172:0/2396129217 shutdown_connections 2024-04-25T08:43:06.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fadb90640 1 --2- 172.21.15.172:0/2396129217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 0x7f8fa8166870 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fadb90640 1 -- 172.21.15.172:0/2396129217 >> 172.21.15.172:0/2396129217 conn(0x7f8fa8061600 msgr2=0x7f8fa80619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:06.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fadb90640 1 -- 172.21.15.172:0/2396129217 shutdown_connections 2024-04-25T08:43:06.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.279+0000 7f8fadb90640 1 -- 172.21.15.172:0/2396129217 wait complete. 2024-04-25T08:43:06.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.280+0000 7f8fadb90640 1 Processor -- start 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.281+0000 7f8fadb90640 1 -- start start 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.281+0000 7f8fadb90640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa806fbd0 0x7f8fa81529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.281+0000 7f8fadb90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 0x7f8fa81f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.281+0000 7f8fadb90640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa8155f80 0x7f8fa815a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.281+0000 7f8fadb90640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8156360 con 0x7f8fa80ce900 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.281+0000 7f8fadb90640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80d07f0 con 0x7f8fa8155f80 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.281+0000 7f8fadb90640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80cf250 con 0x7f8fa806fbd0 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.281+0000 7f8fa6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 0x7f8fa81f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.281+0000 7f8fa6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 0x7f8fa81f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56832/0 (socket says 172.21.15.172:56832) 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fa6ffd640 1 -- 172.21.15.172:0/1643687691 learned_addr learned my addr 172.21.15.172:0/1643687691 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fa77fe640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa806fbd0 0x7f8fa81529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fa7fff640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa8155f80 0x7f8fa815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fa6ffd640 1 -- 172.21.15.172:0/1643687691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa806fbd0 msgr2=0x7f8fa81529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fa6ffd640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa806fbd0 0x7f8fa81529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fa6ffd640 1 -- 172.21.15.172:0/1643687691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa8155f80 msgr2=0x7f8fa815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fa6ffd640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa8155f80 0x7f8fa815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fa6ffd640 1 -- 172.21.15.172:0/1643687691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa81f45d0 con 0x7f8fa80ce900 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fa6ffd640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 0x7f8fa81f3ae0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c004640 tx=0x7f8f9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8f8ffff640 1 -- 172.21.15.172:0/1643687691 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011790 con 0x7f8fa80ce900 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8f8ffff640 1 -- 172.21.15.172:0/1643687691 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c017070 con 0x7f8fa80ce900 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8f8ffff640 1 -- 172.21.15.172:0/1643687691 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011bb0 con 0x7f8fa80ce900 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fadb90640 1 -- 172.21.15.172:0/1643687691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa81f48b0 con 0x7f8fa80ce900 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.282+0000 7f8fadb90640 1 -- 172.21.15.172:0/1643687691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa80c6af0 con 0x7f8fa80ce900 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.283+0000 7f8fadb90640 1 -- 172.21.15.172:0/1643687691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa80c6cf0 con 0x7f8fa80ce900 2024-04-25T08:43:06.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.284+0000 7f8f8ffff640 1 -- 172.21.15.172:0/1643687691 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8f9c011d50 con 0x7f8fa80ce900 2024-04-25T08:43:06.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.284+0000 7f8f8ffff640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8f9406b4d0 0x7f8f9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.284+0000 7f8f8ffff640 1 -- 172.21.15.172:0/1643687691 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8f9c089f50 con 0x7f8fa80ce900 2024-04-25T08:43:06.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.284+0000 7f8fa77fe640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8f9406b4d0 0x7f8f9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.284+0000 7f8fa77fe640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8f9406b4d0 0x7f8f9406d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8f98007fd0 tx=0x7f8f98007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:06.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.288+0000 7f8f8ffff640 1 -- 172.21.15.172:0/1643687691 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8fa80c6cf0 con 0x7f8fa80ce900 2024-04-25T08:43:06.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.457+0000 7f8fadb90640 1 -- 172.21.15.172:0/1643687691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fa8073a00 con 0x7f8fa80ce900 2024-04-25T08:43:06.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.458+0000 7f8f8ffff640 1 -- 172.21.15.172:0/1643687691 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f9c058440 con 0x7f8fa80ce900 2024-04-25T08:43:06.450 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:06.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.459+0000 7f8fadb90640 1 -- 172.21.15.172:0/1643687691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8f9406b4d0 msgr2=0x7f8f9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.459+0000 7f8fadb90640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8f9406b4d0 0x7f8f9406d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8f98007fd0 tx=0x7f8f98007de0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.459+0000 7f8fadb90640 1 -- 172.21.15.172:0/1643687691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 msgr2=0x7f8fa81f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.459+0000 7f8fadb90640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 0x7f8fa81f3ae0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c004640 tx=0x7f8f9c00c8e0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.459+0000 7f8fadb90640 1 -- 172.21.15.172:0/1643687691 shutdown_connections 2024-04-25T08:43:06.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.459+0000 7f8fadb90640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8f9406b4d0 0x7f8f9406d990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.459+0000 7f8fadb90640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa8155f80 0x7f8fa815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.459+0000 7f8fadb90640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa80ce900 0x7f8fa81f3ae0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.459+0000 7f8fadb90640 1 --2- 172.21.15.172:0/1643687691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa806fbd0 0x7f8fa81529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.459+0000 7f8fadb90640 1 -- 172.21.15.172:0/1643687691 >> 172.21.15.172:0/1643687691 conn(0x7f8fa8061600 msgr2=0x7f8fa815bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:06.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.460+0000 7f8fadb90640 1 -- 172.21.15.172:0/1643687691 shutdown_connections 2024-04-25T08:43:06.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.460+0000 7f8fadb90640 1 -- 172.21.15.172:0/1643687691 wait complete. 2024-04-25T08:43:06.463 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:43:06.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.572+0000 7f524c8ac640 1 Processor -- start 2024-04-25T08:43:06.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.572+0000 7f524c8ac640 1 -- start start 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.573+0000 7f524c8ac640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f52481610f0 0x7f524806c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.573+0000 7f524c8ac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 0x7f5248161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.573+0000 7f524c8ac640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52480c6960 con 0x7f52481616f0 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.573+0000 7f524c8ac640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52481614d0 con 0x7f52481610f0 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.573+0000 7f524c8ac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5248162260 con 0x7f52480ce7b0 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.574+0000 7f524659c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f52481610f0 0x7f524806c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.574+0000 7f5246d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 0x7f5248161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.574+0000 7f524659c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f52481610f0 0x7f524806c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:33998/0 (socket says 172.21.15.172:33998) 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.574+0000 7f5245d9b640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f52481616f0 0x7f52480ce0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:58364/0 (socket says 172.21.15.172:58364) 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.574+0000 7f5246d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 0x7f5248161b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:60882/0 (socket says 172.21.15.172:60882) 2024-04-25T08:43:06.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.574+0000 7f5245d9b640 1 -- 172.21.15.172:0/3943436249 learned_addr learned my addr 172.21.15.172:0/3943436249 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:06.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.574+0000 7f524659c640 1 -- 172.21.15.172:0/3943436249 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 msgr2=0x7f5248161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:06.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.574+0000 7f524659c640 1 --2- 172.21.15.172:0/3943436249 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 0x7f5248161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.574+0000 7f524659c640 1 -- 172.21.15.172:0/3943436249 >> v1:172.21.15.186:6789/0 conn(0x7f52481616f0 legacy=0x7f52480ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.574+0000 7f524659c640 1 -- 172.21.15.172:0/3943436249 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5248162540 con 0x7f52481610f0 2024-04-25T08:43:06.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.575+0000 7f524659c640 1 --2- 172.21.15.172:0/3943436249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52481610f0 0x7f524806c1c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5238009d90 tx=0x7f523802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9138ea6f9a6d333c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:06.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.575+0000 7f524559a640 1 -- 172.21.15.172:0/3943436249 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238007740 con 0x7f52481610f0 2024-04-25T08:43:06.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.575+0000 7f524559a640 1 -- 172.21.15.172:0/3943436249 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52380078e0 con 0x7f52481610f0 2024-04-25T08:43:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.575+0000 7f524559a640 1 -- 172.21.15.172:0/3943436249 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238007cb0 con 0x7f52481610f0 2024-04-25T08:43:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.575+0000 7f524c8ac640 1 -- 172.21.15.172:0/3943436249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52481610f0 msgr2=0x7f524806c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.575+0000 7f524c8ac640 1 --2- 172.21.15.172:0/3943436249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52481610f0 0x7f524806c1c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5238009d90 tx=0x7f523802a660 comp rx=0 tx=0).stop 2024-04-25T08:43:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.576+0000 7f524c8ac640 1 -- 172.21.15.172:0/3943436249 shutdown_connections 2024-04-25T08:43:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.576+0000 7f524c8ac640 1 --2- 172.21.15.172:0/3943436249 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 0x7f5248161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.576+0000 7f524c8ac640 1 --2- 172.21.15.172:0/3943436249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52481610f0 0x7f524806c1c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.576+0000 7f524c8ac640 1 -- 172.21.15.172:0/3943436249 >> 172.21.15.172:0/3943436249 conn(0x7f524806f500 msgr2=0x7f524806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.576+0000 7f524c8ac640 1 -- 172.21.15.172:0/3943436249 shutdown_connections 2024-04-25T08:43:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.576+0000 7f524c8ac640 1 -- 172.21.15.172:0/3943436249 wait complete. 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.577+0000 7f524c8ac640 1 Processor -- start 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.577+0000 7f524c8ac640 1 -- start start 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f524c8ac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 0x7f524814b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f524c8ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52481610f0 0x7f52480b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f524c8ac640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52481616f0 0x7f52481f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f524c8ac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52480cf690 con 0x7f52481610f0 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f524c8ac640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52480cfce0 con 0x7f52481616f0 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f524c8ac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524806c700 con 0x7f52480ce7b0 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5245d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52481610f0 0x7f52480b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5245d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52481610f0 0x7f52480b0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56844/0 (socket says 172.21.15.172:56844) 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5245d9b640 1 -- 172.21.15.172:0/3353008817 learned_addr learned my addr 172.21.15.172:0/3353008817 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:06.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5246d9d640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52481616f0 0x7f52481f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f524659c640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 0x7f524814b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5246d9d640 1 -- 172.21.15.172:0/3353008817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 msgr2=0x7f524814b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5246d9d640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 0x7f524814b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5246d9d640 1 -- 172.21.15.172:0/3353008817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52481610f0 msgr2=0x7f52480b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5246d9d640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52481610f0 0x7f52480b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5246d9d640 1 -- 172.21.15.172:0/3353008817 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480ae720 con 0x7f52481616f0 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5245d9b640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52481610f0 0x7f52480b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5246d9d640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52481616f0 0x7f52481f3c30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f524000e7c0 tx=0x7f524000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5236ffd640 1 -- 172.21.15.172:0/3353008817 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240017070 con 0x7f52481616f0 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5236ffd640 1 -- 172.21.15.172:0/3353008817 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524000c730 con 0x7f52481616f0 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f524c8ac640 1 -- 172.21.15.172:0/3353008817 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52480aea00 con 0x7f52481616f0 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.578+0000 7f5236ffd640 1 -- 172.21.15.172:0/3353008817 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000cb60 con 0x7f52481616f0 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.579+0000 7f524c8ac640 1 -- 172.21.15.172:0/3353008817 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52480aca30 con 0x7f52481616f0 2024-04-25T08:43:06.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.579+0000 7f524c8ac640 1 -- 172.21.15.172:0/3353008817 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5248073a00 con 0x7f52481616f0 2024-04-25T08:43:06.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.580+0000 7f5236ffd640 1 -- 172.21.15.172:0/3353008817 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f524001a070 con 0x7f52481616f0 2024-04-25T08:43:06.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.580+0000 7f5236ffd640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f522806b500 0x7f522806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.581+0000 7f5236ffd640 1 -- 172.21.15.172:0/3353008817 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f524008a5f0 con 0x7f52481616f0 2024-04-25T08:43:06.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.581+0000 7f524659c640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f522806b500 0x7f522806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.581+0000 7f524659c640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f522806b500 0x7f522806d9c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5238034000 tx=0x7f523802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:06.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.585+0000 7f5236ffd640 1 -- 172.21.15.172:0/3353008817 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5240058a40 con 0x7f52481616f0 2024-04-25T08:43:06.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.755+0000 7f524c8ac640 1 -- 172.21.15.172:0/3353008817 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52480cf150 con 0x7f52481616f0 2024-04-25T08:43:06.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.756+0000 7f5236ffd640 1 -- 172.21.15.172:0/3353008817 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f524005cae0 con 0x7f52481616f0 2024-04-25T08:43:06.748 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:06.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 -- 172.21.15.172:0/3353008817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f522806b500 msgr2=0x7f522806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f522806b500 0x7f522806d9c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5238034000 tx=0x7f523802f000 comp rx=0 tx=0).stop 2024-04-25T08:43:06.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 -- 172.21.15.172:0/3353008817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52481616f0 msgr2=0x7f52481f3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52481616f0 0x7f52481f3c30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f524000e7c0 tx=0x7f524000ec80 comp rx=0 tx=0).stop 2024-04-25T08:43:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 -- 172.21.15.172:0/3353008817 shutdown_connections 2024-04-25T08:43:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f522806b500 0x7f522806d9c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52481616f0 0x7f52481f3c30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52481610f0 0x7f52480b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 --2- 172.21.15.172:0/3353008817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52480ce7b0 0x7f524814b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 -- 172.21.15.172:0/3353008817 >> 172.21.15.172:0/3353008817 conn(0x7f524806f500 msgr2=0x7f52480c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 -- 172.21.15.172:0/3353008817 shutdown_connections 2024-04-25T08:43:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.758+0000 7f524c8ac640 1 -- 172.21.15.172:0/3353008817 wait complete. 2024-04-25T08:43:06.761 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:43:06.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.870+0000 7f7aa889a640 1 Processor -- start 2024-04-25T08:43:06.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.870+0000 7f7aa889a640 1 -- start start 2024-04-25T08:43:06.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.870+0000 7f7aa889a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7aa415dac0 0x7f7aa40d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.870+0000 7f7aa889a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa40d0ab0 0x7f7aa40b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.870+0000 7f7aa889a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa40d2420 con 0x7f7aa40d1f30 2024-04-25T08:43:06.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.870+0000 7f7aa889a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa40d3030 con 0x7f7aa415dac0 2024-04-25T08:43:06.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.870+0000 7f7aa889a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40d2700 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7aa2d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa40d0ab0 0x7f7aa40b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7aa259c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7aa415dac0 0x7f7aa40d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7aa2d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa40d0ab0 0x7f7aa40b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:60908/0 (socket says 172.21.15.172:60908) 2024-04-25T08:43:06.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7aa259c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7aa415dac0 0x7f7aa40d19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:34012/0 (socket says 172.21.15.172:34012) 2024-04-25T08:43:06.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7a9bfff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f7aa40d1f30 0x7f7aa40d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:58368/0 (socket says 172.21.15.172:58368) 2024-04-25T08:43:06.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7aa2d9d640 1 -- 172.21.15.172:0/2144032184 learned_addr learned my addr 172.21.15.172:0/2144032184 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:06.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7aa2d9d640 1 -- 172.21.15.172:0/2144032184 >> v2:172.21.15.186:3300/0 conn(0x7f7aa415dac0 msgr2=0x7f7aa40d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:06.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7aa2d9d640 1 --2- 172.21.15.172:0/2144032184 >> v2:172.21.15.186:3300/0 conn(0x7f7aa415dac0 0x7f7aa40d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7aa2d9d640 1 -- 172.21.15.172:0/2144032184 >> v1:172.21.15.186:6789/0 conn(0x7f7aa40d1f30 legacy=0x7f7aa40d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7aa2d9d640 1 -- 172.21.15.172:0/2144032184 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa40d29e0 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.871+0000 7f7aa259c640 1 --2- 172.21.15.172:0/2144032184 >> v2:172.21.15.186:3300/0 conn(0x7f7aa415dac0 0x7f7aa40d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:06.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.872+0000 7f7aa2d9d640 1 --2- 172.21.15.172:0/2144032184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa40d0ab0 0x7f7aa40b6990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009e50 tx=0x7f7a9c02a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8940070a701ec0dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:06.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.872+0000 7f7aa1d9b640 1 -- 172.21.15.172:0/2144032184 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c036070 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.872+0000 7f7aa1d9b640 1 -- 172.21.15.172:0/2144032184 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c031600 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.872+0000 7f7aa1d9b640 1 -- 172.21.15.172:0/2144032184 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c0319d0 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.873+0000 7f7aa889a640 1 -- 172.21.15.172:0/2144032184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa40d0ab0 msgr2=0x7f7aa40b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.873+0000 7f7aa889a640 1 --2- 172.21.15.172:0/2144032184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa40d0ab0 0x7f7aa40b6990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009e50 tx=0x7f7a9c02a7a0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.873+0000 7f7aa889a640 1 -- 172.21.15.172:0/2144032184 shutdown_connections 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.873+0000 7f7aa889a640 1 --2- 172.21.15.172:0/2144032184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa40d0ab0 0x7f7aa40b6990 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.873+0000 7f7aa889a640 1 --2- 172.21.15.172:0/2144032184 >> v2:172.21.15.186:3300/0 conn(0x7f7aa415dac0 0x7f7aa40d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.873+0000 7f7aa889a640 1 -- 172.21.15.172:0/2144032184 >> 172.21.15.172:0/2144032184 conn(0x7f7aa4061c30 msgr2=0x7f7aa406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.873+0000 7f7aa889a640 1 -- 172.21.15.172:0/2144032184 shutdown_connections 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.873+0000 7f7aa889a640 1 -- 172.21.15.172:0/2144032184 wait complete. 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.874+0000 7f7aa889a640 1 Processor -- start 2024-04-25T08:43:06.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.874+0000 7f7aa889a640 1 -- start start 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa889a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7aa40d0ab0 0x7f7aa41530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa889a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa40d1f30 0x7f7aa40cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa889a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa415dac0 0x7f7aa40cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa889a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40b97d0 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa889a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa415dea0 con 0x7f7aa40d1f30 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa889a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40b9950 con 0x7f7aa415dac0 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7aa40d0ab0 0x7f7aa41530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7aa40d0ab0 0x7f7aa41530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56850/0 (socket says 172.21.15.172:56850) 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa259c640 1 -- 172.21.15.172:0/3600535774 learned_addr learned my addr 172.21.15.172:0/3600535774 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7a9bfff640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa40d1f30 0x7f7aa40cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa2d9d640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa415dac0 0x7f7aa40cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa259c640 1 -- 172.21.15.172:0/3600535774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa415dac0 msgr2=0x7f7aa40cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa259c640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa415dac0 0x7f7aa40cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa259c640 1 -- 172.21.15.172:0/3600535774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa40d1f30 msgr2=0x7f7aa40cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa259c640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa40d1f30 0x7f7aa40cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa259c640 1 -- 172.21.15.172:0/3600535774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4153630 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa259c640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7aa40d0ab0 0x7f7aa41530f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400e960 tx=0x7f7a9400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7a9affd640 1 -- 172.21.15.172:0/3600535774 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94017070 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7a9affd640 1 -- 172.21.15.172:0/3600535774 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9400ca00 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7a9affd640 1 -- 172.21.15.172:0/3600535774 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9400cdd0 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa889a640 1 -- 172.21.15.172:0/3600535774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa415fe80 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.875+0000 7f7aa889a640 1 -- 172.21.15.172:0/3600535774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa4160440 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.876+0000 7f7aa889a640 1 -- 172.21.15.172:0/3600535774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa40ca760 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.877+0000 7f7a9affd640 1 -- 172.21.15.172:0/3600535774 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a9401a070 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.877+0000 7f7a9affd640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a8406b4d0 0x7f7a8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.877+0000 7f7a9affd640 1 -- 172.21.15.172:0/3600535774 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7a9408a310 con 0x7f7aa40d0ab0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.877+0000 7f7a9bfff640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a8406b4d0 0x7f7a8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:06.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.878+0000 7f7a9bfff640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a8406b4d0 0x7f7a8406d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7aa406cd10 tx=0x7f7a8c007e70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:06.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:06.882+0000 7f7a9affd640 1 -- 172.21.15.172:0/3600535774 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7aa40ca760 con 0x7f7aa40d0ab0 2024-04-25T08:43:07.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.052+0000 7f7aa889a640 1 -- 172.21.15.172:0/3600535774 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7aa40d3550 con 0x7f7aa40d0ab0 2024-04-25T08:43:07.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.053+0000 7f7a9affd640 1 -- 172.21.15.172:0/3600535774 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7aa40d3550 con 0x7f7aa40d0ab0 2024-04-25T08:43:07.045 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:43:07.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 -- 172.21.15.172:0/3600535774 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a8406b4d0 msgr2=0x7f7a8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a8406b4d0 0x7f7a8406d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7aa406cd10 tx=0x7f7a8c007e70 comp rx=0 tx=0).stop 2024-04-25T08:43:07.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 -- 172.21.15.172:0/3600535774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7aa40d0ab0 msgr2=0x7f7aa41530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7aa40d0ab0 0x7f7aa41530f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400e960 tx=0x7f7a9400ee20 comp rx=0 tx=0).stop 2024-04-25T08:43:07.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 -- 172.21.15.172:0/3600535774 shutdown_connections 2024-04-25T08:43:07.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a8406b4d0 0x7f7a8406d990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa40d1f30 0x7f7aa40cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa415dac0 0x7f7aa40cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 --2- 172.21.15.172:0/3600535774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7aa40d0ab0 0x7f7aa41530f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 -- 172.21.15.172:0/3600535774 >> 172.21.15.172:0/3600535774 conn(0x7f7aa4061c30 msgr2=0x7f7aa40ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:07.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 -- 172.21.15.172:0/3600535774 shutdown_connections 2024-04-25T08:43:07.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.055+0000 7f7aa889a640 1 -- 172.21.15.172:0/3600535774 wait complete. 2024-04-25T08:43:07.058 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:43:07.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.166+0000 7fe54ab2b640 1 Processor -- start 2024-04-25T08:43:07.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.166+0000 7fe54ab2b640 1 -- start start 2024-04-25T08:43:07.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.167+0000 7fe54ab2b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5440c6010 0x7fe5440ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.167+0000 7fe54ab2b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe5440cd520 0x7fe5440cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.167+0000 7fe54ab2b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5440c6940 con 0x7fe54415a9f0 2024-04-25T08:43:07.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.167+0000 7fe54ab2b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5440b0020 con 0x7fe5440cd520 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.167+0000 7fe54ab2b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440cb5a0 con 0x7fe5440c6010 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.167+0000 7fe5488c7640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe54415a9f0 0x7fe5440cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59684/0 (socket says 172.21.15.172:59684) 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.167+0000 7fe5488c7640 1 -- 172.21.15.172:0/1100921652 learned_addr learned my addr 172.21.15.172:0/1100921652 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.168+0000 7fe5490c8640 1 --2- 172.21.15.172:0/1100921652 >> v2:172.21.15.186:3300/0 conn(0x7fe5440cd520 0x7fe5440cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.168+0000 7fe543fff640 1 --2- 172.21.15.172:0/1100921652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5440c6010 0x7fe5440ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.168+0000 7fe5437fe640 1 -- 172.21.15.172:0/1100921652 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140228484 0 0) 0x7fe534001110 con 0x7fe54415a9f0 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.168+0000 7fe5437fe640 1 -- 172.21.15.172:0/1100921652 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe52c003520 con 0x7fe54415a9f0 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.168+0000 7fe5490c8640 1 -- 172.21.15.172:0/1100921652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5440c6010 msgr2=0x7fe5440ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.168+0000 7fe5490c8640 1 --2- 172.21.15.172:0/1100921652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5440c6010 0x7fe5440ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.168+0000 7fe5490c8640 1 -- 172.21.15.172:0/1100921652 >> v1:172.21.15.172:6789/0 conn(0x7fe54415a9f0 legacy=0x7fe5440cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.168+0000 7fe5490c8640 1 -- 172.21.15.172:0/1100921652 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54415add0 con 0x7fe5440cd520 2024-04-25T08:43:07.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe5490c8640 1 --2- 172.21.15.172:0/1100921652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5440cd520 0x7fe5440cba30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009d90 tx=0x7fe53c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bde605d0997a7165 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:07.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe5437fe640 1 -- 172.21.15.172:0/1100921652 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c007740 con 0x7fe5440cd520 2024-04-25T08:43:07.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe5437fe640 1 -- 172.21.15.172:0/1100921652 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c0078e0 con 0x7fe5440cd520 2024-04-25T08:43:07.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe5437fe640 1 -- 172.21.15.172:0/1100921652 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c007cb0 con 0x7fe5440cd520 2024-04-25T08:43:07.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe54ab2b640 1 -- 172.21.15.172:0/1100921652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5440cd520 msgr2=0x7fe5440cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe54ab2b640 1 --2- 172.21.15.172:0/1100921652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5440cd520 0x7fe5440cba30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009d90 tx=0x7fe53c02a660 comp rx=0 tx=0).stop 2024-04-25T08:43:07.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe54ab2b640 1 -- 172.21.15.172:0/1100921652 shutdown_connections 2024-04-25T08:43:07.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe54ab2b640 1 --2- 172.21.15.172:0/1100921652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5440cd520 0x7fe5440cba30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe54ab2b640 1 --2- 172.21.15.172:0/1100921652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5440c6010 0x7fe5440ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe54ab2b640 1 -- 172.21.15.172:0/1100921652 >> 172.21.15.172:0/1100921652 conn(0x7fe5440b2390 msgr2=0x7fe5440b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:07.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe54ab2b640 1 -- 172.21.15.172:0/1100921652 shutdown_connections 2024-04-25T08:43:07.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.169+0000 7fe54ab2b640 1 -- 172.21.15.172:0/1100921652 wait complete. 2024-04-25T08:43:07.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.170+0000 7fe54ab2b640 1 Processor -- start 2024-04-25T08:43:07.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.170+0000 7fe54ab2b640 1 -- start start 2024-04-25T08:43:07.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.171+0000 7fe54ab2b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5440c6010 0x7fe54414d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.171+0000 7fe54ab2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5440cd520 0x7fe5440ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.171+0000 7fe54ab2b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe54415a9f0 0x7fe5440cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.171+0000 7fe54ab2b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440cb230 con 0x7fe5440cd520 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.171+0000 7fe54ab2b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440caf50 con 0x7fe5440c6010 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.171+0000 7fe54ab2b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440cbf70 con 0x7fe54415a9f0 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.171+0000 7fe543fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5440cd520 0x7fe5440ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.171+0000 7fe543fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5440cd520 0x7fe5440ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56858/0 (socket says 172.21.15.172:56858) 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.171+0000 7fe543fff640 1 -- 172.21.15.172:0/2656154707 learned_addr learned my addr 172.21.15.172:0/2656154707 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.171+0000 7fe5488c7640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5440c6010 0x7fe54414d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe5490c8640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe54415a9f0 0x7fe5440cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe543fff640 1 -- 172.21.15.172:0/2656154707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe54415a9f0 msgr2=0x7fe5440cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe543fff640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe54415a9f0 0x7fe5440cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe543fff640 1 -- 172.21.15.172:0/2656154707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5440c6010 msgr2=0x7fe54414d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe543fff640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5440c6010 0x7fe54414d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe543fff640 1 -- 172.21.15.172:0/2656154707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440b4c20 con 0x7fe5440cd520 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe5490c8640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe54415a9f0 0x7fe5440cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe543fff640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5440cd520 0x7fe5440ceba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe53800e9e0 tx=0x7fe53800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe5417fa640 1 -- 172.21.15.172:0/2656154707 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538017070 con 0x7fe5440cd520 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe5417fa640 1 -- 172.21.15.172:0/2656154707 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53800c9d0 con 0x7fe5440cd520 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe54ab2b640 1 -- 172.21.15.172:0/2656154707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54414d780 con 0x7fe5440cd520 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe5417fa640 1 -- 172.21.15.172:0/2656154707 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53800cdc0 con 0x7fe5440cd520 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.172+0000 7fe54ab2b640 1 -- 172.21.15.172:0/2656154707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5440b4140 con 0x7fe5440cd520 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.173+0000 7fe54ab2b640 1 -- 172.21.15.172:0/2656154707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe544073a00 con 0x7fe5440cd520 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.173+0000 7fe5417fa640 1 -- 172.21.15.172:0/2656154707 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe53801a070 con 0x7fe5440cd520 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.174+0000 7fe5417fa640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe53006b4d0 0x7fe53006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.174+0000 7fe5417fa640 1 -- 172.21.15.172:0/2656154707 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe53808a520 con 0x7fe5440cd520 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.174+0000 7fe5488c7640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe53006b4d0 0x7fe53006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.174+0000 7fe5488c7640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe53006b4d0 0x7fe53006d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe534005880 tx=0x7fe534009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:07.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.178+0000 7fe5417fa640 1 -- 172.21.15.172:0/2656154707 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe54414d780 con 0x7fe5440cd520 2024-04-25T08:43:07.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.348+0000 7fe54ab2b640 1 -- 172.21.15.172:0/2656154707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe5440cc3d0 con 0x7fe5440cd520 2024-04-25T08:43:07.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.348+0000 7fe5417fa640 1 -- 172.21.15.172:0/2656154707 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe5440b4c20 con 0x7fe5440cd520 2024-04-25T08:43:07.341 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:07.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.350+0000 7fe54ab2b640 1 -- 172.21.15.172:0/2656154707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe53006b4d0 msgr2=0x7fe53006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.350+0000 7fe54ab2b640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe53006b4d0 0x7fe53006d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe534005880 tx=0x7fe534009040 comp rx=0 tx=0).stop 2024-04-25T08:43:07.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.350+0000 7fe54ab2b640 1 -- 172.21.15.172:0/2656154707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5440cd520 msgr2=0x7fe5440ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.350+0000 7fe54ab2b640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5440cd520 0x7fe5440ceba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe53800e9e0 tx=0x7fe53800eea0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.351+0000 7fe54ab2b640 1 -- 172.21.15.172:0/2656154707 shutdown_connections 2024-04-25T08:43:07.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.351+0000 7fe54ab2b640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe53006b4d0 0x7fe53006d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.351+0000 7fe54ab2b640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe54415a9f0 0x7fe5440cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.351+0000 7fe54ab2b640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5440cd520 0x7fe5440ceba0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.351+0000 7fe54ab2b640 1 --2- 172.21.15.172:0/2656154707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5440c6010 0x7fe54414d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.351+0000 7fe54ab2b640 1 -- 172.21.15.172:0/2656154707 >> 172.21.15.172:0/2656154707 conn(0x7fe5440b2390 msgr2=0x7fe5440af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:07.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.351+0000 7fe54ab2b640 1 -- 172.21.15.172:0/2656154707 shutdown_connections 2024-04-25T08:43:07.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.351+0000 7fe54ab2b640 1 -- 172.21.15.172:0/2656154707 wait complete. 2024-04-25T08:43:07.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:07.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.459+0000 7f972ec38640 1 Processor -- start 2024-04-25T08:43:07.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.459+0000 7f972ec38640 1 -- start start 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.460+0000 7f972ec38640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97280af720 0x7f97280afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.460+0000 7f972ec38640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f97280d02f0 0x7f97280d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.460+0000 7f972ec38640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972806fe00 con 0x7f9728158220 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.460+0000 7f972ec38640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97280b3670 con 0x7f97280d02f0 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.460+0000 7f972ec38640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9728070a10 con 0x7f97280af720 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.460+0000 7f972d1d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f97280d02f0 0x7f97280d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.460+0000 7f972d1d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f97280d02f0 0x7f97280d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47598/0 (socket says 172.21.15.172:47598) 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.460+0000 7f972d1d5640 1 -- 172.21.15.172:0/4158180397 learned_addr learned my addr 172.21.15.172:0/4158180397 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.460+0000 7f9727fff640 1 --2- 172.21.15.172:0/4158180397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97280af720 0x7f97280afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.461+0000 7f972d1d5640 1 -- 172.21.15.172:0/4158180397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97280af720 msgr2=0x7f97280afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.461+0000 7f972d1d5640 1 --2- 172.21.15.172:0/4158180397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97280af720 0x7f97280afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.461+0000 7f972d1d5640 1 -- 172.21.15.172:0/4158180397 >> v1:172.21.15.186:6789/0 conn(0x7f9728158220 legacy=0x7f972815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.461+0000 7f972d1d5640 1 -- 172.21.15.172:0/4158180397 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97280700e0 con 0x7f97280d02f0 2024-04-25T08:43:07.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.461+0000 7f972d1d5640 1 --2- 172.21.15.172:0/4158180397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97280d02f0 0x7f97280d0780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9720009e50 tx=0x7f972002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae79e070cd40fee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:07.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.461+0000 7f97277fe640 1 -- 172.21.15.172:0/4158180397 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720036070 con 0x7f97280d02f0 2024-04-25T08:43:07.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.461+0000 7f97277fe640 1 -- 172.21.15.172:0/4158180397 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9720031600 con 0x7f97280d02f0 2024-04-25T08:43:07.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.461+0000 7f97277fe640 1 -- 172.21.15.172:0/4158180397 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97200319d0 con 0x7f97280d02f0 2024-04-25T08:43:07.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.462+0000 7f972ec38640 1 -- 172.21.15.172:0/4158180397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97280d02f0 msgr2=0x7f97280d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.462+0000 7f972ec38640 1 --2- 172.21.15.172:0/4158180397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97280d02f0 0x7f97280d0780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9720009e50 tx=0x7f972002a710 comp rx=0 tx=0).stop 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.462+0000 7f972ec38640 1 -- 172.21.15.172:0/4158180397 shutdown_connections 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.462+0000 7f972ec38640 1 --2- 172.21.15.172:0/4158180397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97280d02f0 0x7f97280d0780 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.462+0000 7f972ec38640 1 --2- 172.21.15.172:0/4158180397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97280af720 0x7f97280afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.462+0000 7f972ec38640 1 -- 172.21.15.172:0/4158180397 >> 172.21.15.172:0/4158180397 conn(0x7f97280b2370 msgr2=0x7f97280b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.462+0000 7f972ec38640 1 -- 172.21.15.172:0/4158180397 shutdown_connections 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.462+0000 7f972ec38640 1 -- 172.21.15.172:0/4158180397 wait complete. 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.463+0000 7f972ec38640 1 Processor -- start 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.463+0000 7f972ec38640 1 -- start start 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972ec38640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97280af720 0x7f97281445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972ec38640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97280d02f0 0x7f9728146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972ec38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9728158220 0x7f972815f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972ec38640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9728158600 con 0x7f9728158220 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972ec38640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97280706a0 con 0x7f97280af720 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972ec38640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9728072960 con 0x7f97280d02f0 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972d1d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9728158220 0x7f972815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972d1d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9728158220 0x7f972815f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47610/0 (socket says 172.21.15.172:47610) 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972d1d5640 1 -- 172.21.15.172:0/1235691302 learned_addr learned my addr 172.21.15.172:0/1235691302 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f9727fff640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97280d02f0 0x7f9728146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972c9d4640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97280af720 0x7f97281445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972d1d5640 1 -- 172.21.15.172:0/1235691302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97280d02f0 msgr2=0x7f9728146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972d1d5640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97280d02f0 0x7f9728146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972d1d5640 1 -- 172.21.15.172:0/1235691302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97280af720 msgr2=0x7f97281445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972d1d5640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97280af720 0x7f97281445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.464+0000 7f972d1d5640 1 -- 172.21.15.172:0/1235691302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97281551e0 con 0x7f9728158220 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.465+0000 7f972d1d5640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9728158220 0x7f972815f780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9720034040 tx=0x7f9720004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:07.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.465+0000 7f97257fa640 1 -- 172.21.15.172:0/1235691302 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972003f020 con 0x7f9728158220 2024-04-25T08:43:07.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.465+0000 7f97257fa640 1 -- 172.21.15.172:0/1235691302 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9720037040 con 0x7f9728158220 2024-04-25T08:43:07.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.465+0000 7f97257fa640 1 -- 172.21.15.172:0/1235691302 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720036070 con 0x7f9728158220 2024-04-25T08:43:07.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.465+0000 7f972ec38640 1 -- 172.21.15.172:0/1235691302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97281453e0 con 0x7f9728158220 2024-04-25T08:43:07.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.465+0000 7f972ec38640 1 -- 172.21.15.172:0/1235691302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97281459a0 con 0x7f9728158220 2024-04-25T08:43:07.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.466+0000 7f972ec38640 1 -- 172.21.15.172:0/1235691302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9728072720 con 0x7f9728158220 2024-04-25T08:43:07.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.466+0000 7f97257fa640 1 -- 172.21.15.172:0/1235691302 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9720042020 con 0x7f9728158220 2024-04-25T08:43:07.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.467+0000 7f97257fa640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f971406b4d0 0x7f971406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.467+0000 7f97257fa640 1 -- 172.21.15.172:0/1235691302 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f97200aaaa0 con 0x7f9728158220 2024-04-25T08:43:07.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.467+0000 7f972c9d4640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f971406b4d0 0x7f971406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.467+0000 7f972c9d4640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f971406b4d0 0x7f971406d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9718007fd0 tx=0x7f9718009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:07.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.471+0000 7f97257fa640 1 -- 172.21.15.172:0/1235691302 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9728072720 con 0x7f9728158220 2024-04-25T08:43:07.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.641+0000 7f972ec38640 1 -- 172.21.15.172:0/1235691302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f972815c3e0 con 0x7f9728158220 2024-04-25T08:43:07.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.643+0000 7f97257fa640 1 -- 172.21.15.172:0/1235691302 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18574 (secure 0 0 0) 0x7f9720049030 con 0x7f9728158220 2024-04-25T08:43:07.635 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:07.635 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:42:33.044742+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:07.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.644+0000 7f972ec38640 1 -- 172.21.15.172:0/1235691302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f971406b4d0 msgr2=0x7f971406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.644+0000 7f972ec38640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f971406b4d0 0x7f971406d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9718007fd0 tx=0x7f9718009040 comp rx=0 tx=0).stop 2024-04-25T08:43:07.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.644+0000 7f972ec38640 1 -- 172.21.15.172:0/1235691302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9728158220 msgr2=0x7f972815f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.644+0000 7f972ec38640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9728158220 0x7f972815f780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9720034040 tx=0x7f9720004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:07.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.645+0000 7f972ec38640 1 -- 172.21.15.172:0/1235691302 shutdown_connections 2024-04-25T08:43:07.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.645+0000 7f972ec38640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f971406b4d0 0x7f971406d990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.645+0000 7f972ec38640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9728158220 0x7f972815f780 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.645+0000 7f972ec38640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97280d02f0 0x7f9728146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.645+0000 7f972ec38640 1 --2- 172.21.15.172:0/1235691302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97280af720 0x7f97281445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.645+0000 7f972ec38640 1 -- 172.21.15.172:0/1235691302 >> 172.21.15.172:0/1235691302 conn(0x7f97280b2370 msgr2=0x7f972815d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:07.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.645+0000 7f972ec38640 1 -- 172.21.15.172:0/1235691302 shutdown_connections 2024-04-25T08:43:07.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.645+0000 7f972ec38640 1 -- 172.21.15.172:0/1235691302 wait complete. 2024-04-25T08:43:07.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:43:07.648 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:07.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.756+0000 7f92c2acd640 1 Processor -- start 2024-04-25T08:43:07.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.756+0000 7f92c2acd640 1 -- start start 2024-04-25T08:43:07.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c2acd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f92bc06ccd0 0x7f92bc0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c2acd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f92bc15deb0 0x7f92bc15e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c2acd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc0d1770 con 0x7f92bc070dc0 2024-04-25T08:43:07.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c2acd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc1622b0 con 0x7f92bc15deb0 2024-04-25T08:43:07.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c2acd640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0b10f0 con 0x7f92bc06ccd0 2024-04-25T08:43:07.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c106a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f92bc15deb0 0x7f92bc15e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c106a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f92bc15deb0 0x7f92bc15e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47622/0 (socket says 172.21.15.172:47622) 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c106a640 1 -- 172.21.15.172:0/2602951678 learned_addr learned my addr 172.21.15.172:0/2602951678 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92bbfff640 1 --2- 172.21.15.172:0/2602951678 >> v2:172.21.15.186:3300/0 conn(0x7f92bc06ccd0 0x7f92bc0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c106a640 1 -- 172.21.15.172:0/2602951678 >> v2:172.21.15.186:3300/0 conn(0x7f92bc06ccd0 msgr2=0x7f92bc0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c106a640 1 --2- 172.21.15.172:0/2602951678 >> v2:172.21.15.186:3300/0 conn(0x7f92bc06ccd0 0x7f92bc0b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c106a640 1 -- 172.21.15.172:0/2602951678 >> v1:172.21.15.186:6789/0 conn(0x7f92bc070dc0 legacy=0x7f92bc0711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.757+0000 7f92c106a640 1 -- 172.21.15.172:0/2602951678 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc162740 con 0x7f92bc15deb0 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.758+0000 7f92c106a640 1 --2- 172.21.15.172:0/2602951678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc15deb0 0x7f92bc15e320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f92bc04efc0 tx=0x7f92b402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eca70721e1090d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.758+0000 7f92bb7fe640 1 -- 172.21.15.172:0/2602951678 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4036070 con 0x7f92bc15deb0 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.758+0000 7f92bb7fe640 1 -- 172.21.15.172:0/2602951678 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4031600 con 0x7f92bc15deb0 2024-04-25T08:43:07.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.758+0000 7f92bb7fe640 1 -- 172.21.15.172:0/2602951678 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40319d0 con 0x7f92bc15deb0 2024-04-25T08:43:07.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.759+0000 7f92c2acd640 1 -- 172.21.15.172:0/2602951678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc15deb0 msgr2=0x7f92bc15e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.759+0000 7f92c2acd640 1 --2- 172.21.15.172:0/2602951678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc15deb0 0x7f92bc15e320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f92bc04efc0 tx=0x7f92b402a5d0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.759+0000 7f92c2acd640 1 -- 172.21.15.172:0/2602951678 shutdown_connections 2024-04-25T08:43:07.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.759+0000 7f92c2acd640 1 --2- 172.21.15.172:0/2602951678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc15deb0 0x7f92bc15e320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.759+0000 7f92c2acd640 1 --2- 172.21.15.172:0/2602951678 >> v2:172.21.15.186:3300/0 conn(0x7f92bc06ccd0 0x7f92bc0b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.759+0000 7f92c2acd640 1 -- 172.21.15.172:0/2602951678 >> 172.21.15.172:0/2602951678 conn(0x7f92bc0b3530 msgr2=0x7f92bc0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:07.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.759+0000 7f92c2acd640 1 -- 172.21.15.172:0/2602951678 shutdown_connections 2024-04-25T08:43:07.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.759+0000 7f92c2acd640 1 -- 172.21.15.172:0/2602951678 wait complete. 2024-04-25T08:43:07.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.760+0000 7f92c2acd640 1 Processor -- start 2024-04-25T08:43:07.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.760+0000 7f92c2acd640 1 -- start start 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c2acd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc06ccd0 0x7f92bc160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c2acd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92bc070dc0 0x7f92bc15f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c2acd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92bc15deb0 0x7f92bc1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c2acd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc161f40 con 0x7f92bc06ccd0 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c2acd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc161c60 con 0x7f92bc15deb0 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c2acd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0b5840 con 0x7f92bc070dc0 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c0869640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc06ccd0 0x7f92bc160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c0869640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc06ccd0 0x7f92bc160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47638/0 (socket says 172.21.15.172:47638) 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c0869640 1 -- 172.21.15.172:0/2102842946 learned_addr learned my addr 172.21.15.172:0/2102842946 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c106a640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92bc15deb0 0x7f92bc1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92bbfff640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92bc070dc0 0x7f92bc15f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c0869640 1 -- 172.21.15.172:0/2102842946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92bc070dc0 msgr2=0x7f92bc15f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c0869640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92bc070dc0 0x7f92bc15f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c0869640 1 -- 172.21.15.172:0/2102842946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92bc15deb0 msgr2=0x7f92bc1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c0869640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92bc15deb0 0x7f92bc1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c0869640 1 -- 172.21.15.172:0/2102842946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc15f850 con 0x7f92bc06ccd0 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c106a640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92bc15deb0 0x7f92bc1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92bbfff640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92bc070dc0 0x7f92bc15f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c0869640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc06ccd0 0x7f92bc160e30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c410 tx=0x7f92b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92b97fa640 1 -- 172.21.15.172:0/2102842946 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0017070 con 0x7f92bc06ccd0 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92b97fa640 1 -- 172.21.15.172:0/2102842946 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b00035f0 con 0x7f92bc06ccd0 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c2acd640 1 -- 172.21.15.172:0/2102842946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc0cad30 con 0x7f92bc06ccd0 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92b97fa640 1 -- 172.21.15.172:0/2102842946 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0003a20 con 0x7f92bc06ccd0 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.761+0000 7f92c2acd640 1 -- 172.21.15.172:0/2102842946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc15fdd0 con 0x7f92bc06ccd0 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.762+0000 7f92c2acd640 1 -- 172.21.15.172:0/2102842946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc073a00 con 0x7f92bc06ccd0 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.763+0000 7f92b97fa640 1 -- 172.21.15.172:0/2102842946 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f92b001a070 con 0x7f92bc06ccd0 2024-04-25T08:43:07.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.763+0000 7f92b97fa640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f92a006b4d0 0x7f92a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:07.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.763+0000 7f92bbfff640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f92a006b4d0 0x7f92a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:07.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.763+0000 7f92b97fa640 1 -- 172.21.15.172:0/2102842946 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f92b0089a20 con 0x7f92bc06ccd0 2024-04-25T08:43:07.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.764+0000 7f92bbfff640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f92a006b4d0 0x7f92a006d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92bc067f00 tx=0x7f92a8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:07.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.768+0000 7f92b97fa640 1 -- 172.21.15.172:0/2102842946 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f92b0058560 con 0x7f92bc06ccd0 2024-04-25T08:43:07.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.938+0000 7f92c2acd640 1 -- 172.21.15.172:0/2102842946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92bc158c30 con 0x7f92bc06ccd0 2024-04-25T08:43:07.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.939+0000 7f92b97fa640 1 -- 172.21.15.172:0/2102842946 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92b00010c0 con 0x7f92bc06ccd0 2024-04-25T08:43:07.932 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:07.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 -- 172.21.15.172:0/2102842946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f92a006b4d0 msgr2=0x7f92a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f92a006b4d0 0x7f92a006d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f92bc067f00 tx=0x7f92a8008040 comp rx=0 tx=0).stop 2024-04-25T08:43:07.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 -- 172.21.15.172:0/2102842946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc06ccd0 msgr2=0x7f92bc160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:07.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc06ccd0 0x7f92bc160e30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c410 tx=0x7f92b000c8d0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 -- 172.21.15.172:0/2102842946 shutdown_connections 2024-04-25T08:43:07.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f92a006b4d0 0x7f92a006d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92bc15deb0 0x7f92bc1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92bc070dc0 0x7f92bc15f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 --2- 172.21.15.172:0/2102842946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92bc06ccd0 0x7f92bc160e30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:07.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 -- 172.21.15.172:0/2102842946 >> 172.21.15.172:0/2102842946 conn(0x7f92bc0b3530 msgr2=0x7f92bc0ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:07.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 -- 172.21.15.172:0/2102842946 shutdown_connections 2024-04-25T08:43:07.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:07.941+0000 7f92c2acd640 1 -- 172.21.15.172:0/2102842946 wait complete. 2024-04-25T08:43:07.944 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:43:08.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.052+0000 7faf916fc640 1 Processor -- start 2024-04-25T08:43:08.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.053+0000 7faf916fc640 1 -- start start 2024-04-25T08:43:08.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.053+0000 7faf916fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf8c15dc20 0x7faf8c0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.053+0000 7faf916fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faf8c161710 0x7faf8c0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.053+0000 7faf916fc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8c15e000 con 0x7faf8c0b9330 2024-04-25T08:43:08.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.053+0000 7faf916fc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8c0d1de0 con 0x7faf8c161710 2024-04-25T08:43:08.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.053+0000 7faf916fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c161c60 con 0x7faf8c15dc20 2024-04-25T08:43:08.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.053+0000 7faf8a7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faf8c161710 0x7faf8c0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.053+0000 7faf8b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7faf8c0b9330 0x7faf8c06bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49580/0 (socket says 172.21.15.172:49580) 2024-04-25T08:43:08.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.053+0000 7faf8b7fe640 1 -- 172.21.15.172:0/2516604501 learned_addr learned my addr 172.21.15.172:0/2516604501 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:08.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.054+0000 7faf8affd640 1 --2- 172.21.15.172:0/2516604501 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf8c15dc20 0x7faf8c0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.054+0000 7faf8a7fc640 1 -- 172.21.15.172:0/2516604501 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf8c15dc20 msgr2=0x7faf8c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:08.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.054+0000 7faf8a7fc640 1 --2- 172.21.15.172:0/2516604501 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf8c15dc20 0x7faf8c0ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.054+0000 7faf8a7fc640 1 -- 172.21.15.172:0/2516604501 >> v1:172.21.15.172:6789/0 conn(0x7faf8c0b9330 legacy=0x7faf8c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.054+0000 7faf8a7fc640 1 -- 172.21.15.172:0/2516604501 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c161f40 con 0x7faf8c161710 2024-04-25T08:43:08.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.054+0000 7faf89ffb640 1 -- 172.21.15.172:0/2516604501 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912027496 0 0) 0x7faf8c15e000 con 0x7faf8c0b9330 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.054+0000 7faf8a7fc640 1 --2- 172.21.15.172:0/2516604501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 0x7faf8c0cebb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf800097a0 tx=0x7faf8002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcf85aa0f64ac15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf89ffb640 1 -- 172.21.15.172:0/2516604501 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80037070 con 0x7faf8c161710 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf89ffb640 1 -- 172.21.15.172:0/2516604501 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf80032440 con 0x7faf8c161710 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf89ffb640 1 -- 172.21.15.172:0/2516604501 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80032810 con 0x7faf8c161710 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf916fc640 1 -- 172.21.15.172:0/2516604501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 msgr2=0x7faf8c0cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf916fc640 1 --2- 172.21.15.172:0/2516604501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 0x7faf8c0cebb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf800097a0 tx=0x7faf8002a180 comp rx=0 tx=0).stop 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf916fc640 1 -- 172.21.15.172:0/2516604501 shutdown_connections 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf916fc640 1 --2- 172.21.15.172:0/2516604501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 0x7faf8c0cebb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf916fc640 1 --2- 172.21.15.172:0/2516604501 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf8c15dc20 0x7faf8c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf916fc640 1 -- 172.21.15.172:0/2516604501 >> 172.21.15.172:0/2516604501 conn(0x7faf8c0d0420 msgr2=0x7faf8c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf916fc640 1 -- 172.21.15.172:0/2516604501 shutdown_connections 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.055+0000 7faf916fc640 1 -- 172.21.15.172:0/2516604501 wait complete. 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.056+0000 7faf916fc640 1 Processor -- start 2024-04-25T08:43:08.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.057+0000 7faf916fc640 1 -- start start 2024-04-25T08:43:08.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.057+0000 7faf916fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf8c0b9330 0x7faf8c15fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.057+0000 7faf916fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf8c15dc20 0x7faf8c15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.057+0000 7faf916fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 0x7faf8c15e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.057+0000 7faf916fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0b5e50 con 0x7faf8c161710 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.057+0000 7faf916fc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c162500 con 0x7faf8c15dc20 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.057+0000 7faf916fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0b5fd0 con 0x7faf8c0b9330 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.057+0000 7faf8b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 0x7faf8c15e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.057+0000 7faf8b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 0x7faf8c15e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47658/0 (socket says 172.21.15.172:47658) 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.057+0000 7faf8b7fe640 1 -- 172.21.15.172:0/3181488419 learned_addr learned my addr 172.21.15.172:0/3181488419 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf8affd640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf8c0b9330 0x7faf8c15fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf8b7fe640 1 -- 172.21.15.172:0/3181488419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf8c0b9330 msgr2=0x7faf8c15fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf8b7fe640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf8c0b9330 0x7faf8c15fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf8b7fe640 1 -- 172.21.15.172:0/3181488419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf8c15dc20 msgr2=0x7faf8c15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf8b7fe640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf8c15dc20 0x7faf8c15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf8b7fe640 1 -- 172.21.15.172:0/3181488419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c1e7810 con 0x7faf8c161710 2024-04-25T08:43:08.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf8b7fe640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 0x7faf8c15e180 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faf8400c410 tx=0x7faf8400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf737fe640 1 -- 172.21.15.172:0/3181488419 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf840074e0 con 0x7faf8c161710 2024-04-25T08:43:08.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf737fe640 1 -- 172.21.15.172:0/3181488419 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf84007680 con 0x7faf8c161710 2024-04-25T08:43:08.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf737fe640 1 -- 172.21.15.172:0/3181488419 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84004a20 con 0x7faf8c161710 2024-04-25T08:43:08.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf916fc640 1 -- 172.21.15.172:0/3181488419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8c15ed50 con 0x7faf8c161710 2024-04-25T08:43:08.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.058+0000 7faf916fc640 1 -- 172.21.15.172:0/3181488419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8c15f590 con 0x7faf8c161710 2024-04-25T08:43:08.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.059+0000 7faf916fc640 1 -- 172.21.15.172:0/3181488419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8c073a00 con 0x7faf8c161710 2024-04-25T08:43:08.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.059+0000 7faf737fe640 1 -- 172.21.15.172:0/3181488419 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf84011070 con 0x7faf8c161710 2024-04-25T08:43:08.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.060+0000 7faf737fe640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf7806b4d0 0x7faf7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.060+0000 7faf737fe640 1 -- 172.21.15.172:0/3181488419 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faf8408a080 con 0x7faf8c161710 2024-04-25T08:43:08.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.060+0000 7faf8affd640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf7806b4d0 0x7faf7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.060+0000 7faf8affd640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf7806b4d0 0x7faf7806d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009e90 tx=0x7faf7c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.064+0000 7faf737fe640 1 -- 172.21.15.172:0/3181488419 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf8c15ed50 con 0x7faf8c161710 2024-04-25T08:43:08.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.235+0000 7faf916fc640 1 -- 172.21.15.172:0/3181488419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf8c0d16b0 con 0x7faf8c161710 2024-04-25T08:43:08.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.235+0000 7faf737fe640 1 -- 172.21.15.172:0/3181488419 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf84058bc0 con 0x7faf8c161710 2024-04-25T08:43:08.228 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 -- 172.21.15.172:0/3181488419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf7806b4d0 msgr2=0x7faf7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf7806b4d0 0x7faf7806d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009e90 tx=0x7faf7c00b040 comp rx=0 tx=0).stop 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 -- 172.21.15.172:0/3181488419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 msgr2=0x7faf8c15e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 0x7faf8c15e180 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faf8400c410 tx=0x7faf8400c8d0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 -- 172.21.15.172:0/3181488419 shutdown_connections 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf7806b4d0 0x7faf7806d990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf8c15dc20 0x7faf8c15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c161710 0x7faf8c15e180 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 --2- 172.21.15.172:0/3181488419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf8c0b9330 0x7faf8c15fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 -- 172.21.15.172:0/3181488419 >> 172.21.15.172:0/3181488419 conn(0x7faf8c0d0420 msgr2=0x7faf8c15cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 -- 172.21.15.172:0/3181488419 shutdown_connections 2024-04-25T08:43:08.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.237+0000 7faf916fc640 1 -- 172.21.15.172:0/3181488419 wait complete. 2024-04-25T08:43:08.240 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:43:08.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.348+0000 7f4bf38a3640 1 Processor -- start 2024-04-25T08:43:08.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.349+0000 7f4bf38a3640 1 -- start start 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.349+0000 7f4bf38a3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4bec0c6010 0x7f4bec0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.349+0000 7f4bf38a3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4bec0cd520 0x7f4bec0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.349+0000 7f4bf38a3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bec0c6940 con 0x7f4bec15a9f0 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.349+0000 7f4bf38a3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bec0b0020 con 0x7f4bec0c6010 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.349+0000 7f4bf38a3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0cb5a0 con 0x7f4bec0cd520 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.349+0000 7f4bf0e3e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4bec0c6010 0x7f4bec0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.350+0000 7f4bf163f640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4bec15a9f0 0x7f4bec0cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49592/0 (socket says 172.21.15.172:49592) 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.350+0000 7f4bf163f640 1 -- 172.21.15.172:0/1224800292 learned_addr learned my addr 172.21.15.172:0/1224800292 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.350+0000 7f4bf1e40640 1 --2- 172.21.15.172:0/1224800292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4bec0cd520 0x7f4bec0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.350+0000 7f4bf0e3e640 1 -- 172.21.15.172:0/1224800292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4bec0cd520 msgr2=0x7f4bec0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.350+0000 7f4bf0e3e640 1 --2- 172.21.15.172:0/1224800292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4bec0cd520 0x7f4bec0cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.350+0000 7f4bf0e3e640 1 -- 172.21.15.172:0/1224800292 >> v1:172.21.15.172:6789/0 conn(0x7f4bec15a9f0 legacy=0x7f4bec0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.350+0000 7f4bf0e3e640 1 -- 172.21.15.172:0/1224800292 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec15add0 con 0x7f4bec0c6010 2024-04-25T08:43:08.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.350+0000 7f4bf0e3e640 1 --2- 172.21.15.172:0/1224800292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 0x7f4bec0ccfe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0097a0 tx=0x7f4bdc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb31943a1b31e7ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4be3fff640 1 -- 172.21.15.172:0/1224800292 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc037070 con 0x7f4bec0c6010 2024-04-25T08:43:08.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4be3fff640 1 -- 172.21.15.172:0/1224800292 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc032440 con 0x7f4bec0c6010 2024-04-25T08:43:08.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4be3fff640 1 -- 172.21.15.172:0/1224800292 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc032810 con 0x7f4bec0c6010 2024-04-25T08:43:08.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4bf38a3640 1 -- 172.21.15.172:0/1224800292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 msgr2=0x7f4bec0ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4bf38a3640 1 --2- 172.21.15.172:0/1224800292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 0x7f4bec0ccfe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0097a0 tx=0x7f4bdc02a180 comp rx=0 tx=0).stop 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4bf38a3640 1 -- 172.21.15.172:0/1224800292 shutdown_connections 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4bf38a3640 1 --2- 172.21.15.172:0/1224800292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4bec0cd520 0x7f4bec0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4bf38a3640 1 --2- 172.21.15.172:0/1224800292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 0x7f4bec0ccfe0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4bf38a3640 1 -- 172.21.15.172:0/1224800292 >> 172.21.15.172:0/1224800292 conn(0x7f4bec0b2390 msgr2=0x7f4bec0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4bf38a3640 1 -- 172.21.15.172:0/1224800292 shutdown_connections 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.351+0000 7f4bf38a3640 1 -- 172.21.15.172:0/1224800292 wait complete. 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.352+0000 7f4bf38a3640 1 Processor -- start 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.352+0000 7f4bf38a3640 1 -- start start 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf38a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 0x7f4bec149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf38a3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4bec0cd520 0x7f4bec0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf38a3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bec15a9f0 0x7f4bec145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf38a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0cb230 con 0x7f4bec0c6010 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf38a3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0caf50 con 0x7f4bec15a9f0 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf38a3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec0cbf70 con 0x7f4bec0cd520 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf163f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 0x7f4bec149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf163f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 0x7f4bec149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47684/0 (socket says 172.21.15.172:47684) 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf163f640 1 -- 172.21.15.172:0/4282973200 learned_addr learned my addr 172.21.15.172:0/4282973200 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf163f640 1 -- 172.21.15.172:0/4282973200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4bec0cd520 msgr2=0x7f4bec0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf163f640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4bec0cd520 0x7f4bec0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf163f640 1 -- 172.21.15.172:0/4282973200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bec15a9f0 msgr2=0x7f4bec145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf1e40640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bec15a9f0 0x7f4bec145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf163f640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bec15a9f0 0x7f4bec145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.353+0000 7f4bf163f640 1 -- 172.21.15.172:0/4282973200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec1497b0 con 0x7f4bec0c6010 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.354+0000 7f4bf163f640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 0x7f4bec149270 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c3c0 tx=0x7f4be800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.354+0000 7f4be1ffb640 1 -- 172.21.15.172:0/4282973200 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8017070 con 0x7f4bec0c6010 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.354+0000 7f4be1ffb640 1 -- 172.21.15.172:0/4282973200 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be8005ce0 con 0x7f4bec0c6010 2024-04-25T08:43:08.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.354+0000 7f4be1ffb640 1 -- 172.21.15.172:0/4282973200 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80072f0 con 0x7f4bec0c6010 2024-04-25T08:43:08.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.354+0000 7f4bf38a3640 1 -- 172.21.15.172:0/4282973200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec0c7b00 con 0x7f4bec0c6010 2024-04-25T08:43:08.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.354+0000 7f4bf38a3640 1 -- 172.21.15.172:0/4282973200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec0ca140 con 0x7f4bec0c6010 2024-04-25T08:43:08.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.355+0000 7f4bf38a3640 1 -- 172.21.15.172:0/4282973200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bec073a00 con 0x7f4bec0c6010 2024-04-25T08:43:08.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.355+0000 7f4be1ffb640 1 -- 172.21.15.172:0/4282973200 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4be801a070 con 0x7f4bec0c6010 2024-04-25T08:43:08.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.356+0000 7f4be1ffb640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4bd006b4d0 0x7f4bd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.356+0000 7f4be1ffb640 1 -- 172.21.15.172:0/4282973200 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4be8089890 con 0x7f4bec0c6010 2024-04-25T08:43:08.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.356+0000 7f4bf0e3e640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4bd006b4d0 0x7f4bd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.356+0000 7f4bf0e3e640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4bd006b4d0 0x7f4bd006d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc034000 tx=0x7f4bdc02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.360+0000 7f4be1ffb640 1 -- 172.21.15.172:0/4282973200 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4bec1497b0 con 0x7f4bec0c6010 2024-04-25T08:43:08.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.530+0000 7f4bf38a3640 1 -- 172.21.15.172:0/4282973200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4bec0cecc0 con 0x7f4bec0c6010 2024-04-25T08:43:08.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.531+0000 7f4be1ffb640 1 -- 172.21.15.172:0/4282973200 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4bec0c6940 con 0x7f4bec0c6010 2024-04-25T08:43:08.523 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:43:08.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 -- 172.21.15.172:0/4282973200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4bd006b4d0 msgr2=0x7f4bd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4bd006b4d0 0x7f4bd006d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc034000 tx=0x7f4bdc02c000 comp rx=0 tx=0).stop 2024-04-25T08:43:08.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 -- 172.21.15.172:0/4282973200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 msgr2=0x7f4bec149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 0x7f4bec149270 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c3c0 tx=0x7f4be800c880 comp rx=0 tx=0).stop 2024-04-25T08:43:08.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 -- 172.21.15.172:0/4282973200 shutdown_connections 2024-04-25T08:43:08.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4bd006b4d0 0x7f4bd006d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bec15a9f0 0x7f4bec145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4bec0cd520 0x7f4bec0cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 --2- 172.21.15.172:0/4282973200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bec0c6010 0x7f4bec149270 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 -- 172.21.15.172:0/4282973200 >> 172.21.15.172:0/4282973200 conn(0x7f4bec0b2390 msgr2=0x7f4bec159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:08.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 -- 172.21.15.172:0/4282973200 shutdown_connections 2024-04-25T08:43:08.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.533+0000 7f4bf38a3640 1 -- 172.21.15.172:0/4282973200 wait complete. 2024-04-25T08:43:08.536 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:43:08.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.644+0000 7f513f142640 1 Processor -- start 2024-04-25T08:43:08.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.644+0000 7f513f142640 1 -- start start 2024-04-25T08:43:08.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513f142640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5138070dc0 0x7f513806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513f142640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f51380711a0 0x7f51380b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513f142640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51380b4830 0x7f51380b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513f142640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51381622b0 con 0x7f5138070dc0 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513f142640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51380b10f0 con 0x7f51380711a0 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513f142640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51380d1770 con 0x7f51380b4830 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513cede640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5138070dc0 0x7f513806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513cede640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5138070dc0 0x7f513806ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47696/0 (socket says 172.21.15.172:47696) 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513cede640 1 -- 172.21.15.172:0/3553135449 learned_addr learned my addr 172.21.15.172:0/3553135449 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513cede640 1 -- 172.21.15.172:0/3553135449 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51380b4830 msgr2=0x7f51380b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f513d6df640 1 --2- 172.21.15.172:0/3553135449 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51380b4830 0x7f51380b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.645+0000 7f5137fff640 1 --2- 172.21.15.172:0/3553135449 >> v2:172.21.15.186:3300/0 conn(0x7f51380711a0 0x7f51380b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.646+0000 7f513cede640 1 --2- 172.21.15.172:0/3553135449 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51380b4830 0x7f51380b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.646+0000 7f513cede640 1 -- 172.21.15.172:0/3553135449 >> v2:172.21.15.186:3300/0 conn(0x7f51380711a0 msgr2=0x7f51380b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.646+0000 7f513cede640 1 --2- 172.21.15.172:0/3553135449 >> v2:172.21.15.186:3300/0 conn(0x7f51380711a0 0x7f51380b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.646+0000 7f513cede640 1 -- 172.21.15.172:0/3553135449 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5138162740 con 0x7f5138070dc0 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.646+0000 7f513d6df640 1 --2- 172.21.15.172:0/3553135449 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51380b4830 0x7f51380b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.646+0000 7f5137fff640 1 --2- 172.21.15.172:0/3553135449 >> v2:172.21.15.186:3300/0 conn(0x7f51380711a0 0x7f51380b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.646+0000 7f513cede640 1 --2- 172.21.15.172:0/3553135449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5138070dc0 0x7f513806ccd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f513804efc0 tx=0x7f512802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8284d26fb24a013 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.646+0000 7f51377fe640 1 -- 172.21.15.172:0/3553135449 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128036070 con 0x7f5138070dc0 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.646+0000 7f51377fe640 1 -- 172.21.15.172:0/3553135449 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5128031600 con 0x7f5138070dc0 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.646+0000 7f51377fe640 1 -- 172.21.15.172:0/3553135449 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51280319d0 con 0x7f5138070dc0 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.647+0000 7f513f142640 1 -- 172.21.15.172:0/3553135449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5138070dc0 msgr2=0x7f513806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.647+0000 7f513f142640 1 --2- 172.21.15.172:0/3553135449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5138070dc0 0x7f513806ccd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f513804efc0 tx=0x7f512802a5b0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.647+0000 7f513f142640 1 -- 172.21.15.172:0/3553135449 shutdown_connections 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.647+0000 7f513f142640 1 --2- 172.21.15.172:0/3553135449 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51380b4830 0x7f51380b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.647+0000 7f513f142640 1 --2- 172.21.15.172:0/3553135449 >> v2:172.21.15.186:3300/0 conn(0x7f51380711a0 0x7f51380b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.647+0000 7f513f142640 1 --2- 172.21.15.172:0/3553135449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5138070dc0 0x7f513806ccd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.647+0000 7f513f142640 1 -- 172.21.15.172:0/3553135449 >> 172.21.15.172:0/3553135449 conn(0x7f51380b3530 msgr2=0x7f51380b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:08.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.647+0000 7f513f142640 1 -- 172.21.15.172:0/3553135449 shutdown_connections 2024-04-25T08:43:08.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.647+0000 7f513f142640 1 -- 172.21.15.172:0/3553135449 wait complete. 2024-04-25T08:43:08.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.648+0000 7f513f142640 1 Processor -- start 2024-04-25T08:43:08.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.648+0000 7f513f142640 1 -- start start 2024-04-25T08:43:08.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f513f142640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5138070dc0 0x7f5138158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f513f142640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51380711a0 0x7f5138147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f513f142640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51380b4830 0x7f51381484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f513f142640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138161f40 con 0x7f51380711a0 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f513f142640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138161c60 con 0x7f5138070dc0 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f513f142640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5138071630 con 0x7f51380b4830 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f5137fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51380711a0 0x7f5138147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f5137fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51380711a0 0x7f5138147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47708/0 (socket says 172.21.15.172:47708) 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f5137fff640 1 -- 172.21.15.172:0/3123596293 learned_addr learned my addr 172.21.15.172:0/3123596293 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f5137fff640 1 -- 172.21.15.172:0/3123596293 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51380b4830 msgr2=0x7f51381484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f5137fff640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51380b4830 0x7f51381484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f5137fff640 1 -- 172.21.15.172:0/3123596293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5138070dc0 msgr2=0x7f5138158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f5137fff640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5138070dc0 0x7f5138158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f5137fff640 1 -- 172.21.15.172:0/3123596293 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5138155e70 con 0x7f51380711a0 2024-04-25T08:43:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.649+0000 7f5137fff640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51380711a0 0x7f5138147fa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c7c0 tx=0x7f512c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.650+0000 7f51357fa640 1 -- 172.21.15.172:0/3123596293 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c015070 con 0x7f51380711a0 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.650+0000 7f51357fa640 1 -- 172.21.15.172:0/3123596293 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c007a30 con 0x7f51380711a0 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.650+0000 7f51357fa640 1 -- 172.21.15.172:0/3123596293 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c007e00 con 0x7f51380711a0 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.650+0000 7f513f142640 1 -- 172.21.15.172:0/3123596293 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51381538d0 con 0x7f51380711a0 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.650+0000 7f513f142640 1 -- 172.21.15.172:0/3123596293 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5138153e90 con 0x7f51380711a0 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.651+0000 7f513f142640 1 -- 172.21.15.172:0/3123596293 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5138154090 con 0x7f51380711a0 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.651+0000 7f51357fa640 1 -- 172.21.15.172:0/3123596293 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f512c018070 con 0x7f51380711a0 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.652+0000 7f51357fa640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f512406b4d0 0x7f512406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.652+0000 7f51357fa640 1 -- 172.21.15.172:0/3123596293 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f512c08a420 con 0x7f51380711a0 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.652+0000 7f513cede640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f512406b4d0 0x7f512406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.652+0000 7f513cede640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f512406b4d0 0x7f512406d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5128033000 tx=0x7f512802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.656+0000 7f51357fa640 1 -- 172.21.15.172:0/3123596293 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5138154090 con 0x7f51380711a0 2024-04-25T08:43:08.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.837+0000 7f513f142640 1 -- 172.21.15.172:0/3123596293 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5138073a00 con 0x7f51380711a0 2024-04-25T08:43:08.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.837+0000 7f51357fa640 1 -- 172.21.15.172:0/3123596293 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f512c058ff0 con 0x7f51380711a0 2024-04-25T08:43:08.829 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:08.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 -- 172.21.15.172:0/3123596293 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f512406b4d0 msgr2=0x7f512406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f512406b4d0 0x7f512406d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5128033000 tx=0x7f512802e000 comp rx=0 tx=0).stop 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 -- 172.21.15.172:0/3123596293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51380711a0 msgr2=0x7f5138147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51380711a0 0x7f5138147fa0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c7c0 tx=0x7f512c00cc80 comp rx=0 tx=0).stop 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 -- 172.21.15.172:0/3123596293 shutdown_connections 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f512406b4d0 0x7f512406d990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51380b4830 0x7f51381484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51380711a0 0x7f5138147fa0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 --2- 172.21.15.172:0/3123596293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5138070dc0 0x7f5138158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 -- 172.21.15.172:0/3123596293 >> 172.21.15.172:0/3123596293 conn(0x7f51380b3530 msgr2=0x7f51380b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 -- 172.21.15.172:0/3123596293 shutdown_connections 2024-04-25T08:43:08.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.839+0000 7f513f142640 1 -- 172.21.15.172:0/3123596293 wait complete. 2024-04-25T08:43:08.843 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:08.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.948+0000 7fbe02e22640 1 Processor -- start 2024-04-25T08:43:08.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.948+0000 7fbe02e22640 1 -- start start 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.948+0000 7fbe02e22640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbdfc1602e0 0x7fbdfc0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.948+0000 7fbe02e22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdfc15f5f0 0x7fbdfc15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.948+0000 7fbe02e22640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc0cd710 con 0x7fbdfc15ba00 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.948+0000 7fbe02e22640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc099b70 con 0x7fbdfc1602e0 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.948+0000 7fbe02e22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc099e50 con 0x7fbdfc15f5f0 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.949+0000 7fbdfbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbdfc1602e0 0x7fbdfc0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.949+0000 7fbe00bbe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbdfc15ba00 0x7fbdfc09a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49602/0 (socket says 172.21.15.172:49602) 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.949+0000 7fbe00bbe640 1 -- 172.21.15.172:0/2053441975 learned_addr learned my addr 172.21.15.172:0/2053441975 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.949+0000 7fbe013bf640 1 --2- 172.21.15.172:0/2053441975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdfc15f5f0 0x7fbdfc15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.949+0000 7fbdfbfff640 1 -- 172.21.15.172:0/2053441975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdfc15f5f0 msgr2=0x7fbdfc15fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.949+0000 7fbdfbfff640 1 --2- 172.21.15.172:0/2053441975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdfc15f5f0 0x7fbdfc15fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.949+0000 7fbdfbfff640 1 -- 172.21.15.172:0/2053441975 >> v1:172.21.15.172:6789/0 conn(0x7fbdfc15ba00 legacy=0x7fbdfc09a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.949+0000 7fbdfbfff640 1 -- 172.21.15.172:0/2053441975 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc09a130 con 0x7fbdfc1602e0 2024-04-25T08:43:08.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.949+0000 7fbdfb7fe640 1 -- 172.21.15.172:0/2053441975 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138925299 0 0) 0x7fbdf0001110 con 0x7fbdfc15ba00 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbdfbfff640 1 --2- 172.21.15.172:0/2053441975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 0x7fbdfc0ccda0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbde80097a0 tx=0x7fbde802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbdd266078c64f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbdfb7fe640 1 -- 172.21.15.172:0/2053441975 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8037070 con 0x7fbdfc1602e0 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbdfb7fe640 1 -- 172.21.15.172:0/2053441975 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde802adb0 con 0x7fbdfc1602e0 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbdfb7fe640 1 -- 172.21.15.172:0/2053441975 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8032660 con 0x7fbdfc1602e0 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbe02e22640 1 -- 172.21.15.172:0/2053441975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 msgr2=0x7fbdfc0ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbe02e22640 1 --2- 172.21.15.172:0/2053441975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 0x7fbdfc0ccda0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbde80097a0 tx=0x7fbde802a060 comp rx=0 tx=0).stop 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbe02e22640 1 -- 172.21.15.172:0/2053441975 shutdown_connections 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbe02e22640 1 --2- 172.21.15.172:0/2053441975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdfc15f5f0 0x7fbdfc15fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbe02e22640 1 --2- 172.21.15.172:0/2053441975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 0x7fbdfc0ccda0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbe02e22640 1 -- 172.21.15.172:0/2053441975 >> 172.21.15.172:0/2053441975 conn(0x7fbdfc0b3270 msgr2=0x7fbdfc0b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbe02e22640 1 -- 172.21.15.172:0/2053441975 shutdown_connections 2024-04-25T08:43:08.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.950+0000 7fbe02e22640 1 -- 172.21.15.172:0/2053441975 wait complete. 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.951+0000 7fbe02e22640 1 Processor -- start 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.951+0000 7fbe02e22640 1 -- start start 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.952+0000 7fbe02e22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdfc15ba00 0x7fbdfc157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.952+0000 7fbe02e22640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdfc15f5f0 0x7fbdfc070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.952+0000 7fbe02e22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 0x7fbdfc070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.952+0000 7fbe02e22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc0cd460 con 0x7fbdfc1602e0 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.952+0000 7fbe02e22640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc0cd2e0 con 0x7fbdfc15f5f0 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.952+0000 7fbe02e22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc0c52d0 con 0x7fbdfc15ba00 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.952+0000 7fbe013bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 0x7fbdfc070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.952+0000 7fbe013bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 0x7fbdfc070e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47724/0 (socket says 172.21.15.172:47724) 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.952+0000 7fbe013bf640 1 -- 172.21.15.172:0/1850839716 learned_addr learned my addr 172.21.15.172:0/1850839716 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbe00bbe640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdfc15ba00 0x7fbdfc157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbdfbfff640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdfc15f5f0 0x7fbdfc070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbe013bf640 1 -- 172.21.15.172:0/1850839716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdfc15ba00 msgr2=0x7fbdfc157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbe013bf640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdfc15ba00 0x7fbdfc157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbe013bf640 1 -- 172.21.15.172:0/1850839716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdfc15f5f0 msgr2=0x7fbdfc070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbe013bf640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdfc15f5f0 0x7fbdfc070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbe013bf640 1 -- 172.21.15.172:0/1850839716 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0c8850 con 0x7fbdfc1602e0 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbe013bf640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 0x7fbdfc070e80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4007e40 tx=0x7fbdf400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbdf97fa640 1 -- 172.21.15.172:0/1850839716 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4014620 con 0x7fbdfc1602e0 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbdf97fa640 1 -- 172.21.15.172:0/1850839716 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf4019070 con 0x7fbdfc1602e0 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbe02e22640 1 -- 172.21.15.172:0/1850839716 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc15eee0 con 0x7fbdfc1602e0 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbdf97fa640 1 -- 172.21.15.172:0/1850839716 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4014a20 con 0x7fbdfc1602e0 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.953+0000 7fbe02e22640 1 -- 172.21.15.172:0/1850839716 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc09f120 con 0x7fbdfc1602e0 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.954+0000 7fbe02e22640 1 -- 172.21.15.172:0/1850839716 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc073990 con 0x7fbdfc1602e0 2024-04-25T08:43:08.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.955+0000 7fbdf97fa640 1 -- 172.21.15.172:0/1850839716 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbdf4014bc0 con 0x7fbdfc1602e0 2024-04-25T08:43:08.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.955+0000 7fbdf97fa640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbde006b4d0 0x7fbde006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:08.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.955+0000 7fbe00bbe640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbde006b4d0 0x7fbde006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:08.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.955+0000 7fbdf97fa640 1 -- 172.21.15.172:0/1850839716 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbdf408aeb0 con 0x7fbdfc1602e0 2024-04-25T08:43:08.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.955+0000 7fbe00bbe640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbde006b4d0 0x7fbde006d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0000f60 tx=0x7fbdf0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:08.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:08.959+0000 7fbdf97fa640 1 -- 172.21.15.172:0/1850839716 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbdf40599c0 con 0x7fbdfc1602e0 2024-04-25T08:43:09.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.131+0000 7fbe02e22640 1 -- 172.21.15.172:0/1850839716 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdfc0b40a0 con 0x7fbdfc1602e0 2024-04-25T08:43:09.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.132+0000 7fbdf97fa640 1 -- 172.21.15.172:0/1850839716 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18905 (secure 0 0 0) 0x7fbdf40592c0 con 0x7fbdfc1602e0 2024-04-25T08:43:09.125 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:09.125 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":25,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:08.816233+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:09.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 -- 172.21.15.172:0/1850839716 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbde006b4d0 msgr2=0x7fbde006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbde006b4d0 0x7fbde006d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0000f60 tx=0x7fbdf0009040 comp rx=0 tx=0).stop 2024-04-25T08:43:09.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 -- 172.21.15.172:0/1850839716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 msgr2=0x7fbdfc070e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 0x7fbdfc070e80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4007e40 tx=0x7fbdf400e4b0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 -- 172.21.15.172:0/1850839716 shutdown_connections 2024-04-25T08:43:09.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbde006b4d0 0x7fbde006d990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdfc15f5f0 0x7fbdfc070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdfc1602e0 0x7fbdfc070e80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 --2- 172.21.15.172:0/1850839716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdfc15ba00 0x7fbdfc157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 -- 172.21.15.172:0/1850839716 >> 172.21.15.172:0/1850839716 conn(0x7fbdfc0b3270 msgr2=0x7fbdfc0c7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:09.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.134+0000 7fbe02e22640 1 -- 172.21.15.172:0/1850839716 shutdown_connections 2024-04-25T08:43:09.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.135+0000 7fbe02e22640 1 -- 172.21.15.172:0/1850839716 wait complete. 2024-04-25T08:43:09.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:43:09.139 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:09.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.246+0000 7f2509e46640 1 Processor -- start 2024-04-25T08:43:09.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.246+0000 7f2509e46640 1 -- start start 2024-04-25T08:43:09.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f2509e46640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f25041454b0 0x7f2504070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f2509e46640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2504071300 0x7f25040b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f2509e46640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25040ceba0 con 0x7f2504144d20 2024-04-25T08:43:09.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f2509e46640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25040b4830 con 0x7f25041454b0 2024-04-25T08:43:09.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f2509e46640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2504071730 con 0x7f2504071300 2024-04-25T08:43:09.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f25037fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2504144d20 0x7f25040ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49612/0 (socket says 172.21.15.172:49612) 2024-04-25T08:43:09.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f25037fe640 1 -- 172.21.15.172:0/3898253196 learned_addr learned my addr 172.21.15.172:0/3898253196 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472807487 0 0) 0x7f25040ceba0 con 0x7f2504144d20 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24ec003520 con 0x7f2504144d20 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f2503fff640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2504071300 0x7f25040b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.247+0000 7f2502ffd640 1 --2- 172.21.15.172:0/3898253196 >> v2:172.21.15.186:3300/0 conn(0x7f25041454b0 0x7f2504070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3348305078 0 0) 0x7f24ec003520 con 0x7f2504144d20 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2504071300 msgr2=0x7f25040b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2504071300 0x7f25040b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 >> v2:172.21.15.186:3300/0 conn(0x7f25041454b0 msgr2=0x7f2504070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 --2- 172.21.15.172:0/3898253196 >> v2:172.21.15.186:3300/0 conn(0x7f25041454b0 0x7f2504070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25040cee80 con 0x7f2504144d20 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f24f4001690 con 0x7f2504144d20 2024-04-25T08:43:09.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 >> v1:172.21.15.172:6789/0 conn(0x7f2504144d20 legacy=0x7f25040ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec0039b0 0x7f24ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24ec004800 0x7f24ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2504071300 0x7f24ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25040b4830 con 0x7f24ec0039b0 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2504071730 con 0x7f24ec004800 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ec00b9c0 con 0x7f2504071300 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25037fe640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec0039b0 0x7f24ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f2502ffd640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24ec004800 0x7f24ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f2503fff640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2504071300 0x7f24ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25037fe640 1 -- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2504071300 msgr2=0x7f24ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25037fe640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2504071300 0x7f24ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25037fe640 1 -- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24ec004800 msgr2=0x7f24ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:09.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25037fe640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24ec004800 0x7f24ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.248+0000 7f25037fe640 1 -- 172.21.15.172:0/3898253196 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec003520 con 0x7f24ec0039b0 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.249+0000 7f25037fe640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec0039b0 0x7f24ec003dd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f24f4007fd0 tx=0x7f24ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9678cfa2d12ed402 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.249+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f4007d50 con 0x7f24ec0039b0 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.249+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f4005af0 con 0x7f24ec0039b0 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.249+0000 7f25027fc640 1 -- 172.21.15.172:0/3898253196 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f4007070 con 0x7f24ec0039b0 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.250+0000 7f2509e46640 1 -- 172.21.15.172:0/3898253196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec0039b0 msgr2=0x7f24ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.250+0000 7f2509e46640 1 --2- 172.21.15.172:0/3898253196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec0039b0 0x7f24ec003dd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f24f4007fd0 tx=0x7f24ec005830 comp rx=0 tx=0).stop 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.250+0000 7f2503fff640 1 -- 172.21.15.172:0/3898253196 reap_dead start 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.250+0000 7f2509e46640 1 -- 172.21.15.172:0/3898253196 shutdown_connections 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.250+0000 7f2509e46640 1 -- 172.21.15.172:0/3898253196 >> 172.21.15.172:0/3898253196 conn(0x7f25040b3530 msgr2=0x7f25040b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.250+0000 7f2509e46640 1 -- 172.21.15.172:0/3898253196 shutdown_connections 2024-04-25T08:43:09.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.250+0000 7f2509e46640 1 -- 172.21.15.172:0/3898253196 wait complete. 2024-04-25T08:43:09.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.251+0000 7f2509e46640 1 Processor -- start 2024-04-25T08:43:09.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.251+0000 7f2509e46640 1 -- start start 2024-04-25T08:43:09.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2509e46640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24ec0039b0 0x7f25040ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2509e46640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25040a95f0 0x7f250415af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2509e46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25040a9b50 0x7f25040abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2509e46640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2504145100 con 0x7f25040a9b50 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2509e46640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25040cf440 con 0x7f24ec0039b0 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2509e46640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2504145280 con 0x7f25040a95f0 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2503fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25040a9b50 0x7f25040abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2503fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25040a9b50 0x7f25040abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47744/0 (socket says 172.21.15.172:47744) 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2503fff640 1 -- 172.21.15.172:0/508328230 learned_addr learned my addr 172.21.15.172:0/508328230 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2503fff640 1 -- 172.21.15.172:0/508328230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25040a95f0 msgr2=0x7f250415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2503fff640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25040a95f0 0x7f250415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2503fff640 1 -- 172.21.15.172:0/508328230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24ec0039b0 msgr2=0x7f25040ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2503fff640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24ec0039b0 0x7f25040ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2503fff640 1 -- 172.21.15.172:0/508328230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25040aa4a0 con 0x7f25040a9b50 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2503fff640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25040a9b50 0x7f25040abbb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f250406f360 tx=0x7f24fc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f24ebfff640 1 -- 172.21.15.172:0/508328230 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00fe10 con 0x7f25040a9b50 2024-04-25T08:43:09.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f24ebfff640 1 -- 172.21.15.172:0/508328230 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc01d070 con 0x7f25040a9b50 2024-04-25T08:43:09.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2509e46640 1 -- 172.21.15.172:0/508328230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25040aa780 con 0x7f25040a9b50 2024-04-25T08:43:09.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f24ebfff640 1 -- 172.21.15.172:0/508328230 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc015670 con 0x7f25040a9b50 2024-04-25T08:43:09.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.252+0000 7f2509e46640 1 -- 172.21.15.172:0/508328230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25040aad40 con 0x7f25040a9b50 2024-04-25T08:43:09.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.254+0000 7f2509e46640 1 -- 172.21.15.172:0/508328230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250406cc70 con 0x7f25040a9b50 2024-04-25T08:43:09.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.254+0000 7f24ebfff640 1 -- 172.21.15.172:0/508328230 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f24fc015810 con 0x7f25040a9b50 2024-04-25T08:43:09.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.254+0000 7f24ebfff640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f24f006b500 0x7f24f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.254+0000 7f24ebfff640 1 -- 172.21.15.172:0/508328230 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f24fc08af00 con 0x7f25040a9b50 2024-04-25T08:43:09.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.254+0000 7f25037fe640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f24f006b500 0x7f24f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.255+0000 7f25037fe640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f24f006b500 0x7f24f006d9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24f4033000 tx=0x7f24f4007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:09.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.258+0000 7f24ebfff640 1 -- 172.21.15.172:0/508328230 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f250406cc70 con 0x7f25040a9b50 2024-04-25T08:43:09.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.429+0000 7f2509e46640 1 -- 172.21.15.172:0/508328230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2504073a00 con 0x7f25040a9b50 2024-04-25T08:43:09.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.430+0000 7f24ebfff640 1 -- 172.21.15.172:0/508328230 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24fc010040 con 0x7f25040a9b50 2024-04-25T08:43:09.422 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:09.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 -- 172.21.15.172:0/508328230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f24f006b500 msgr2=0x7f24f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f24f006b500 0x7f24f006d9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24f4033000 tx=0x7f24f4007000 comp rx=0 tx=0).stop 2024-04-25T08:43:09.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 -- 172.21.15.172:0/508328230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25040a9b50 msgr2=0x7f25040abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25040a9b50 0x7f25040abbb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f250406f360 tx=0x7f24fc00f580 comp rx=0 tx=0).stop 2024-04-25T08:43:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 -- 172.21.15.172:0/508328230 shutdown_connections 2024-04-25T08:43:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f24f006b500 0x7f24f006d9c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25040a9b50 0x7f25040abbb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25040a95f0 0x7f250415af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 --2- 172.21.15.172:0/508328230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24ec0039b0 0x7f25040ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 -- 172.21.15.172:0/508328230 >> 172.21.15.172:0/508328230 conn(0x7f25040b3530 msgr2=0x7f25040b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 -- 172.21.15.172:0/508328230 shutdown_connections 2024-04-25T08:43:09.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.432+0000 7f2509e46640 1 -- 172.21.15.172:0/508328230 wait complete. 2024-04-25T08:43:09.435 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:43:09.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.543+0000 7f44f10fc640 1 Processor -- start 2024-04-25T08:43:09.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.543+0000 7f44f10fc640 1 -- start start 2024-04-25T08:43:09.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.543+0000 7f44f10fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f44ec0cd4c0 0x7f44ec0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.543+0000 7f44f10fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44ec15b1c0 0x7f44ec15dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.543+0000 7f44f10fc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f44ec15e1a0 0x7f44ec150b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.543+0000 7f44f10fc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec15b620 con 0x7f44ec0cd4c0 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.543+0000 7f44f10fc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec15e6e0 con 0x7f44ec15e1a0 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.543+0000 7f44f10fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec15e9c0 con 0x7f44ec15b1c0 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.544+0000 7f44ead9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f44ec0cd4c0 0x7f44ec0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.544+0000 7f44ead9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f44ec0cd4c0 0x7f44ec0cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47746/0 (socket says 172.21.15.172:47746) 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.544+0000 7f44ead9d640 1 -- 172.21.15.172:0/3670809849 learned_addr learned my addr 172.21.15.172:0/3670809849 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.544+0000 7f44eb59e640 1 --2- 172.21.15.172:0/3670809849 >> v2:172.21.15.186:3300/0 conn(0x7f44ec15e1a0 0x7f44ec150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.544+0000 7f44ead9d640 1 -- 172.21.15.172:0/3670809849 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44ec15b1c0 msgr2=0x7f44ec15dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.544+0000 7f44ead9d640 1 --2- 172.21.15.172:0/3670809849 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44ec15b1c0 0x7f44ec15dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.544+0000 7f44ead9d640 1 -- 172.21.15.172:0/3670809849 >> v2:172.21.15.186:3300/0 conn(0x7f44ec15e1a0 msgr2=0x7f44ec150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.544+0000 7f44ead9d640 1 --2- 172.21.15.172:0/3670809849 >> v2:172.21.15.186:3300/0 conn(0x7f44ec15e1a0 0x7f44ec150b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.544+0000 7f44ead9d640 1 -- 172.21.15.172:0/3670809849 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec15a9c0 con 0x7f44ec0cd4c0 2024-04-25T08:43:09.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44ead9d640 1 --2- 172.21.15.172:0/3670809849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec0cd4c0 0x7f44ec0cd8a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0af3a0 tx=0x7f44dc02b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34476ed52a5dc17e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:09.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44ea59c640 1 -- 172.21.15.172:0/3670809849 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00b040 con 0x7f44ec0cd4c0 2024-04-25T08:43:09.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44ea59c640 1 -- 172.21.15.172:0/3670809849 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc030710 con 0x7f44ec0cd4c0 2024-04-25T08:43:09.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44ea59c640 1 -- 172.21.15.172:0/3670809849 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc030ae0 con 0x7f44ec0cd4c0 2024-04-25T08:43:09.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44f10fc640 1 -- 172.21.15.172:0/3670809849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec0cd4c0 msgr2=0x7f44ec0cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44f10fc640 1 --2- 172.21.15.172:0/3670809849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec0cd4c0 0x7f44ec0cd8a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0af3a0 tx=0x7f44dc02b5a0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44f10fc640 1 -- 172.21.15.172:0/3670809849 shutdown_connections 2024-04-25T08:43:09.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44f10fc640 1 --2- 172.21.15.172:0/3670809849 >> v2:172.21.15.186:3300/0 conn(0x7f44ec15e1a0 0x7f44ec150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44f10fc640 1 --2- 172.21.15.172:0/3670809849 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44ec15b1c0 0x7f44ec15dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44f10fc640 1 --2- 172.21.15.172:0/3670809849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec0cd4c0 0x7f44ec0cd8a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44f10fc640 1 -- 172.21.15.172:0/3670809849 >> 172.21.15.172:0/3670809849 conn(0x7f44ec06abe0 msgr2=0x7f44ec06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:09.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44f10fc640 1 -- 172.21.15.172:0/3670809849 shutdown_connections 2024-04-25T08:43:09.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.545+0000 7f44f10fc640 1 -- 172.21.15.172:0/3670809849 wait complete. 2024-04-25T08:43:09.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.547+0000 7f44f10fc640 1 Processor -- start 2024-04-25T08:43:09.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.547+0000 7f44f10fc640 1 -- start start 2024-04-25T08:43:09.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.547+0000 7f44f10fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44ec0cd4c0 0x7f44ec0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.547+0000 7f44f10fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec15b1c0 0x7f44ec1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.547+0000 7f44f10fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44ec15e1a0 0x7f44ec1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.547+0000 7f44f10fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec06eca0 con 0x7f44ec15b1c0 2024-04-25T08:43:09.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.547+0000 7f44f10fc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec15a670 con 0x7f44ec15e1a0 2024-04-25T08:43:09.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.547+0000 7f44f10fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec06ee20 con 0x7f44ec0cd4c0 2024-04-25T08:43:09.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec15b1c0 0x7f44ec1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec15b1c0 0x7f44ec1511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47754/0 (socket says 172.21.15.172:47754) 2024-04-25T08:43:09.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e3fff640 1 -- 172.21.15.172:0/2846711824 learned_addr learned my addr 172.21.15.172:0/2846711824 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44ead9d640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44ec0cd4c0 0x7f44ec0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44eb59e640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44ec15e1a0 0x7f44ec1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e3fff640 1 -- 172.21.15.172:0/2846711824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44ec0cd4c0 msgr2=0x7f44ec0af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e3fff640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44ec0cd4c0 0x7f44ec0af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e3fff640 1 -- 172.21.15.172:0/2846711824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44ec15e1a0 msgr2=0x7f44ec1590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e3fff640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44ec15e1a0 0x7f44ec1590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e3fff640 1 -- 172.21.15.172:0/2846711824 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec0afca0 con 0x7f44ec15b1c0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e3fff640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec15b1c0 0x7f44ec1511f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f44d400b450 tx=0x7f44d400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e37fe640 1 -- 172.21.15.172:0/2846711824 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4015020 con 0x7f44ec15b1c0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e37fe640 1 -- 172.21.15.172:0/2846711824 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d4011890 con 0x7f44ec15b1c0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44e37fe640 1 -- 172.21.15.172:0/2846711824 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4011c80 con 0x7f44ec15b1c0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44f10fc640 1 -- 172.21.15.172:0/2846711824 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ec0aff80 con 0x7f44ec15b1c0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.548+0000 7f44f10fc640 1 -- 172.21.15.172:0/2846711824 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ec0af8e0 con 0x7f44ec15b1c0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.549+0000 7f44f10fc640 1 -- 172.21.15.172:0/2846711824 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ec073a00 con 0x7f44ec15b1c0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.550+0000 7f44e37fe640 1 -- 172.21.15.172:0/2846711824 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f44d4018020 con 0x7f44ec15b1c0 2024-04-25T08:43:09.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.550+0000 7f44e37fe640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f44cc06b4d0 0x7f44cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.550+0000 7f44e37fe640 1 -- 172.21.15.172:0/2846711824 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f44d408a6f0 con 0x7f44ec15b1c0 2024-04-25T08:43:09.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.550+0000 7f44ead9d640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f44cc06b4d0 0x7f44cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.550+0000 7f44ead9d640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f44cc06b4d0 0x7f44cc06d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f44dc035000 tx=0x7f44dc00c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:09.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.554+0000 7f44e37fe640 1 -- 172.21.15.172:0/2846711824 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44d401f020 con 0x7f44ec15b1c0 2024-04-25T08:43:09.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.727+0000 7f44f10fc640 1 -- 172.21.15.172:0/2846711824 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44ec0ccb10 con 0x7f44ec15b1c0 2024-04-25T08:43:09.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.727+0000 7f44e37fe640 1 -- 172.21.15.172:0/2846711824 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44d400d040 con 0x7f44ec15b1c0 2024-04-25T08:43:09.720 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:09.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 -- 172.21.15.172:0/2846711824 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f44cc06b4d0 msgr2=0x7f44cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f44cc06b4d0 0x7f44cc06d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f44dc035000 tx=0x7f44dc00c040 comp rx=0 tx=0).stop 2024-04-25T08:43:09.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 -- 172.21.15.172:0/2846711824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec15b1c0 msgr2=0x7f44ec1511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec15b1c0 0x7f44ec1511f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f44d400b450 tx=0x7f44d400b910 comp rx=0 tx=0).stop 2024-04-25T08:43:09.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 -- 172.21.15.172:0/2846711824 shutdown_connections 2024-04-25T08:43:09.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f44cc06b4d0 0x7f44cc06d990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f44ec15e1a0 0x7f44ec1590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44ec15b1c0 0x7f44ec1511f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 --2- 172.21.15.172:0/2846711824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44ec0cd4c0 0x7f44ec0af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 -- 172.21.15.172:0/2846711824 >> 172.21.15.172:0/2846711824 conn(0x7f44ec06abe0 msgr2=0x7f44ec15c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:09.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 -- 172.21.15.172:0/2846711824 shutdown_connections 2024-04-25T08:43:09.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.729+0000 7f44f10fc640 1 -- 172.21.15.172:0/2846711824 wait complete. 2024-04-25T08:43:09.732 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:43:09.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.848+0000 7f56ff0bd640 1 Processor -- start 2024-04-25T08:43:09.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.848+0000 7f56ff0bd640 1 -- start start 2024-04-25T08:43:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56ff0bd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f56f80cfa40 0x7f56f80cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56ff0bd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f80c75e0 con 0x7f56f80cf600 2024-04-25T08:43:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56ff0bd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f80c78c0 con 0x7f56f815bb50 2024-04-25T08:43:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56ff0bd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f80c8680 con 0x7f56f80cfa40 2024-04-25T08:43:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56fd65a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f56f80cfa40 0x7f56f80cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56f7fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f56f80cf600 0x7f56f80cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49616/0 (socket says 172.21.15.172:49616) 2024-04-25T08:43:09.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56f7fff640 1 -- 172.21.15.172:0/278121806 learned_addr learned my addr 172.21.15.172:0/278121806 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:09.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56fd65a640 1 -- 172.21.15.172:0/278121806 >> v1:172.21.15.186:6789/0 conn(0x7f56f815bb50 legacy=0x7f56f80c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56fd65a640 1 -- 172.21.15.172:0/278121806 >> v1:172.21.15.172:6789/0 conn(0x7f56f80cf600 legacy=0x7f56f80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56fd65a640 1 -- 172.21.15.172:0/278121806 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80c7ba0 con 0x7f56f80cfa40 2024-04-25T08:43:09.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.849+0000 7f56f77fe640 1 -- 172.21.15.172:0/278121806 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284555038 0 0) 0x7f56f80c75e0 con 0x7f56f80cf600 2024-04-25T08:43:09.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.850+0000 7f56fd65a640 1 --2- 172.21.15.172:0/278121806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cfa40 0x7f56f80cc630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009d90 tx=0x7f56f002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01d4998e5235311 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:09.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.850+0000 7f56f77fe640 1 -- 172.21.15.172:0/278121806 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0037070 con 0x7f56f80cfa40 2024-04-25T08:43:09.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.850+0000 7f56f77fe640 1 -- 172.21.15.172:0/278121806 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f0007740 con 0x7f56f80cfa40 2024-04-25T08:43:09.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.850+0000 7f56f77fe640 1 -- 172.21.15.172:0/278121806 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0007b10 con 0x7f56f80cfa40 2024-04-25T08:43:09.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.851+0000 7f56ff0bd640 1 -- 172.21.15.172:0/278121806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cfa40 msgr2=0x7f56f80cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.851+0000 7f56ff0bd640 1 --2- 172.21.15.172:0/278121806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cfa40 0x7f56f80cc630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009d90 tx=0x7f56f002a780 comp rx=0 tx=0).stop 2024-04-25T08:43:09.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.851+0000 7f56ff0bd640 1 -- 172.21.15.172:0/278121806 shutdown_connections 2024-04-25T08:43:09.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.851+0000 7f56ff0bd640 1 --2- 172.21.15.172:0/278121806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cfa40 0x7f56f80cc630 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.851+0000 7f56ff0bd640 1 -- 172.21.15.172:0/278121806 >> 172.21.15.172:0/278121806 conn(0x7f56f806f500 msgr2=0x7f56f806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:09.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.851+0000 7f56ff0bd640 1 -- 172.21.15.172:0/278121806 shutdown_connections 2024-04-25T08:43:09.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.851+0000 7f56ff0bd640 1 -- 172.21.15.172:0/278121806 wait complete. 2024-04-25T08:43:09.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.852+0000 7f56ff0bd640 1 Processor -- start 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.852+0000 7f56ff0bd640 1 -- start start 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56ff0bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cf600 0x7f56f8145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56ff0bd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f80cfa40 0x7f56f815d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56ff0bd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f815bb50 0x7f56f81541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56ff0bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80c72a0 con 0x7f56f80cf600 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56ff0bd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80c8160 con 0x7f56f815bb50 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56ff0bd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80cfe90 con 0x7f56f80cfa40 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fce59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cf600 0x7f56f8145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fce59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cf600 0x7f56f8145280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47770/0 (socket says 172.21.15.172:47770) 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fce59640 1 -- 172.21.15.172:0/2167294918 learned_addr learned my addr 172.21.15.172:0/2167294918 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:09.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fd65a640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f815bb50 0x7f56f81541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56f7fff640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f80cfa40 0x7f56f815d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fce59640 1 -- 172.21.15.172:0/2167294918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f80cfa40 msgr2=0x7f56f815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fce59640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f80cfa40 0x7f56f815d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fce59640 1 -- 172.21.15.172:0/2167294918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f815bb50 msgr2=0x7f56f81541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fce59640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f815bb50 0x7f56f81541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fce59640 1 -- 172.21.15.172:0/2167294918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f81457c0 con 0x7f56f80cf600 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fd65a640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f815bb50 0x7f56f81541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56f7fff640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f80cfa40 0x7f56f815d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56fce59640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cf600 0x7f56f8145280 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00c400 tx=0x7f56ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56f57fa640 1 -- 172.21.15.172:0/2167294918 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec017070 con 0x7f56f80cf600 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56f57fa640 1 -- 172.21.15.172:0/2167294918 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec0052d0 con 0x7f56f80cf600 2024-04-25T08:43:09.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56ff0bd640 1 -- 172.21.15.172:0/2167294918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f815dde0 con 0x7f56f80cf600 2024-04-25T08:43:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56f57fa640 1 -- 172.21.15.172:0/2167294918 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec003830 con 0x7f56f80cf600 2024-04-25T08:43:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.853+0000 7f56ff0bd640 1 -- 172.21.15.172:0/2167294918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f815e3a0 con 0x7f56f80cf600 2024-04-25T08:43:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.854+0000 7f56ff0bd640 1 -- 172.21.15.172:0/2167294918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f8073a00 con 0x7f56f80cf600 2024-04-25T08:43:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.855+0000 7f56f57fa640 1 -- 172.21.15.172:0/2167294918 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f56ec01a070 con 0x7f56f80cf600 2024-04-25T08:43:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.855+0000 7f56f57fa640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56dc06b4d0 0x7f56dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.855+0000 7f56f57fa640 1 -- 172.21.15.172:0/2167294918 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f56ec089990 con 0x7f56f80cf600 2024-04-25T08:43:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.855+0000 7f56f7fff640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56dc06b4d0 0x7f56dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.856+0000 7f56f7fff640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56dc06b4d0 0x7f56dc06d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f56f80c7060 tx=0x7f56e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:09.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:09.859+0000 7f56f57fa640 1 -- 172.21.15.172:0/2167294918 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56f81457c0 con 0x7f56f80cf600 2024-04-25T08:43:10.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.030+0000 7f56ff0bd640 1 -- 172.21.15.172:0/2167294918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56f80d2230 con 0x7f56f80cf600 2024-04-25T08:43:10.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.031+0000 7f56f57fa640 1 -- 172.21.15.172:0/2167294918 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56ec058410 con 0x7f56f80cf600 2024-04-25T08:43:10.023 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:43:10.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 -- 172.21.15.172:0/2167294918 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56dc06b4d0 msgr2=0x7f56dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56dc06b4d0 0x7f56dc06d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f56f80c7060 tx=0x7f56e4009040 comp rx=0 tx=0).stop 2024-04-25T08:43:10.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 -- 172.21.15.172:0/2167294918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cf600 msgr2=0x7f56f8145280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cf600 0x7f56f8145280 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00c400 tx=0x7f56ec00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 -- 172.21.15.172:0/2167294918 shutdown_connections 2024-04-25T08:43:10.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f56dc06b4d0 0x7f56dc06d990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56f815bb50 0x7f56f81541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56f80cfa40 0x7f56f815d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 --2- 172.21.15.172:0/2167294918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56f80cf600 0x7f56f8145280 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 -- 172.21.15.172:0/2167294918 >> 172.21.15.172:0/2167294918 conn(0x7f56f806f500 msgr2=0x7f56f80b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:10.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 -- 172.21.15.172:0/2167294918 shutdown_connections 2024-04-25T08:43:10.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.033+0000 7f56ff0bd640 1 -- 172.21.15.172:0/2167294918 wait complete. 2024-04-25T08:43:10.036 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:43:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.145+0000 7fc8e550a640 1 Processor -- start 2024-04-25T08:43:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.146+0000 7fc8e550a640 1 -- start start 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.146+0000 7fc8e550a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e00caa60 0x7fc8e00cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.146+0000 7fc8e550a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc8e006bbf0 0x7fc8e006c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.146+0000 7fc8e550a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e00cae60 con 0x7fc8e015dbd0 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.146+0000 7fc8e550a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e00cc6c0 con 0x7fc8e006bbf0 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.146+0000 7fc8e550a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00cb0e0 con 0x7fc8e00caa60 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.146+0000 7fc8df7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc8e006bbf0 0x7fc8e006c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.146+0000 7fc8df7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc8e006bbf0 0x7fc8e006c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47778/0 (socket says 172.21.15.172:47778) 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.146+0000 7fc8df7fe640 1 -- 172.21.15.172:0/1346473334 learned_addr learned my addr 172.21.15.172:0/1346473334 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.147+0000 7fc8de7fc640 1 --2- 172.21.15.172:0/1346473334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e00caa60 0x7fc8e00cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.147+0000 7fc8df7fe640 1 -- 172.21.15.172:0/1346473334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e00caa60 msgr2=0x7fc8e00cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.147+0000 7fc8df7fe640 1 --2- 172.21.15.172:0/1346473334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e00caa60 0x7fc8e00cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.147+0000 7fc8df7fe640 1 -- 172.21.15.172:0/1346473334 >> v1:172.21.15.186:6789/0 conn(0x7fc8e015dbd0 legacy=0x7fc8e006ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.147+0000 7fc8df7fe640 1 -- 172.21.15.172:0/1346473334 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00cb3c0 con 0x7fc8e006bbf0 2024-04-25T08:43:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.147+0000 7fc8de7fc640 1 --2- 172.21.15.172:0/1346473334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e00caa60 0x7fc8e00cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.147+0000 7fc8df7fe640 1 --2- 172.21.15.172:0/1346473334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e006bbf0 0x7fc8e006c080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80098a0 tx=0x7fc8d802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca332b5ca233d6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8ddffb640 1 -- 172.21.15.172:0/1346473334 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8037070 con 0x7fc8e006bbf0 2024-04-25T08:43:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8ddffb640 1 -- 172.21.15.172:0/1346473334 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d8032440 con 0x7fc8e006bbf0 2024-04-25T08:43:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8ddffb640 1 -- 172.21.15.172:0/1346473334 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8032810 con 0x7fc8e006bbf0 2024-04-25T08:43:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8e550a640 1 -- 172.21.15.172:0/1346473334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e006bbf0 msgr2=0x7fc8e006c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8e550a640 1 --2- 172.21.15.172:0/1346473334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e006bbf0 0x7fc8e006c080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80098a0 tx=0x7fc8d802a250 comp rx=0 tx=0).stop 2024-04-25T08:43:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8e550a640 1 -- 172.21.15.172:0/1346473334 shutdown_connections 2024-04-25T08:43:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8e550a640 1 --2- 172.21.15.172:0/1346473334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e006bbf0 0x7fc8e006c080 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8e550a640 1 --2- 172.21.15.172:0/1346473334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e00caa60 0x7fc8e00cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8e550a640 1 -- 172.21.15.172:0/1346473334 >> 172.21.15.172:0/1346473334 conn(0x7fc8e0071af0 msgr2=0x7fc8e0071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8e550a640 1 -- 172.21.15.172:0/1346473334 shutdown_connections 2024-04-25T08:43:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.148+0000 7fc8e550a640 1 -- 172.21.15.172:0/1346473334 wait complete. 2024-04-25T08:43:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.149+0000 7fc8e550a640 1 Processor -- start 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8e550a640 1 -- start start 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8e550a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8e006bbf0 0x7fc8e00b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8e550a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e00caa60 0x7fc8e00c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8e550a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e015dbd0 0x7fc8e006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8e550a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00cbc60 con 0x7fc8e00caa60 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8e550a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00cb980 con 0x7fc8e006bbf0 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8e550a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e015dfb0 con 0x7fc8e015dbd0 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8de7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e00caa60 0x7fc8e00c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8de7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e00caa60 0x7fc8e00c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47792/0 (socket says 172.21.15.172:47792) 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8de7fc640 1 -- 172.21.15.172:0/3979029393 learned_addr learned my addr 172.21.15.172:0/3979029393 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8df7fe640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e015dbd0 0x7fc8e006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.150+0000 7fc8deffd640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8e006bbf0 0x7fc8e00b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8de7fc640 1 -- 172.21.15.172:0/3979029393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e015dbd0 msgr2=0x7fc8e006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8de7fc640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e015dbd0 0x7fc8e006ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8de7fc640 1 -- 172.21.15.172:0/3979029393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8e006bbf0 msgr2=0x7fc8e00b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8de7fc640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8e006bbf0 0x7fc8e00b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8de7fc640 1 -- 172.21.15.172:0/3979029393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e01f7310 con 0x7fc8e00caa60 2024-04-25T08:43:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8deffd640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8e006bbf0 0x7fc8e00b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8de7fc640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e00caa60 0x7fc8e00c6f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400c7f0 tx=0x7fc8d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8c77fe640 1 -- 172.21.15.172:0/3979029393 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4015070 con 0x7fc8e00caa60 2024-04-25T08:43:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8c77fe640 1 -- 172.21.15.172:0/3979029393 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d4007a30 con 0x7fc8e00caa60 2024-04-25T08:43:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8c77fe640 1 -- 172.21.15.172:0/3979029393 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4007e00 con 0x7fc8e00caa60 2024-04-25T08:43:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8e550a640 1 -- 172.21.15.172:0/3979029393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e01f75f0 con 0x7fc8e00caa60 2024-04-25T08:43:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.151+0000 7fc8e550a640 1 -- 172.21.15.172:0/3979029393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e01f7bb0 con 0x7fc8e00caa60 2024-04-25T08:43:10.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.152+0000 7fc8e550a640 1 -- 172.21.15.172:0/3979029393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e0073a00 con 0x7fc8e00caa60 2024-04-25T08:43:10.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.152+0000 7fc8c77fe640 1 -- 172.21.15.172:0/3979029393 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc8d4018070 con 0x7fc8e00caa60 2024-04-25T08:43:10.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.153+0000 7fc8c77fe640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc8cc06b4d0 0x7fc8cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.153+0000 7fc8c77fe640 1 -- 172.21.15.172:0/3979029393 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc8d408a4f0 con 0x7fc8e00caa60 2024-04-25T08:43:10.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.153+0000 7fc8deffd640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc8cc06b4d0 0x7fc8cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.153+0000 7fc8deffd640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc8cc06b4d0 0x7fc8cc06d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00045b0 tx=0x7fc8d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:10.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.157+0000 7fc8c77fe640 1 -- 172.21.15.172:0/3979029393 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc8d4058930 con 0x7fc8e00caa60 2024-04-25T08:43:10.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.329+0000 7fc8e550a640 1 -- 172.21.15.172:0/3979029393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc8e0061b30 con 0x7fc8e00caa60 2024-04-25T08:43:10.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.329+0000 7fc8c77fe640 1 -- 172.21.15.172:0/3979029393 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc8d405c9d0 con 0x7fc8e00caa60 2024-04-25T08:43:10.322 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 -- 172.21.15.172:0/3979029393 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc8cc06b4d0 msgr2=0x7fc8cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc8cc06b4d0 0x7fc8cc06d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00045b0 tx=0x7fc8d0009040 comp rx=0 tx=0).stop 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 -- 172.21.15.172:0/3979029393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e00caa60 msgr2=0x7fc8e00c6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e00caa60 0x7fc8e00c6f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400c7f0 tx=0x7fc8d400cbf0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 -- 172.21.15.172:0/3979029393 shutdown_connections 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc8cc06b4d0 0x7fc8cc06d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8e015dbd0 0x7fc8e006ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e00caa60 0x7fc8e00c6f20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 --2- 172.21.15.172:0/3979029393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8e006bbf0 0x7fc8e00b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 -- 172.21.15.172:0/3979029393 >> 172.21.15.172:0/3979029393 conn(0x7fc8e0071af0 msgr2=0x7fc8e00aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 -- 172.21.15.172:0/3979029393 shutdown_connections 2024-04-25T08:43:10.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.331+0000 7fc8e550a640 1 -- 172.21.15.172:0/3979029393 wait complete. 2024-04-25T08:43:10.334 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:10.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.440+0000 7f979a177640 1 Processor -- start 2024-04-25T08:43:10.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.440+0000 7f979a177640 1 -- start start 2024-04-25T08:43:10.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f979a177640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f979413d190 0x7f97940cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f979a177640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9794071940 0x7f97940cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f979a177640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9794071ed0 con 0x7f979415b320 2024-04-25T08:43:10.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f979a177640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979413d570 con 0x7f979413d190 2024-04-25T08:43:10.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f979a177640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979415a840 con 0x7f9794071940 2024-04-25T08:43:10.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f97937fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f979413d190 0x7f97940cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f9792ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f979415b320 0x7f9794071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49624/0 (socket says 172.21.15.172:49624) 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f9792ffd640 1 -- 172.21.15.172:0/1470482459 learned_addr learned my addr 172.21.15.172:0/1470482459 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f9793fff640 1 --2- 172.21.15.172:0/1470482459 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9794071940 0x7f97940cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f97927fc640 1 -- 172.21.15.172:0/1470482459 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895390069 0 0) 0x7f9794071ed0 con 0x7f979415b320 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f97927fc640 1 -- 172.21.15.172:0/1470482459 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f977c003440 con 0x7f979415b320 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f97937fe640 1 -- 172.21.15.172:0/1470482459 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9794071940 msgr2=0x7f97940cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f97937fe640 1 --2- 172.21.15.172:0/1470482459 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9794071940 0x7f97940cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f97937fe640 1 -- 172.21.15.172:0/1470482459 >> v1:172.21.15.172:6789/0 conn(0x7f979415b320 legacy=0x7f9794071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f97937fe640 1 -- 172.21.15.172:0/1470482459 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979415ab20 con 0x7f979413d190 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.441+0000 7f9793fff640 1 --2- 172.21.15.172:0/1470482459 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9794071940 0x7f97940cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.442+0000 7f97937fe640 1 --2- 172.21.15.172:0/1470482459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979413d190 0x7f97940cbfb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f97840097a0 tx=0x7f978402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77f58a91530d4da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.442+0000 7f97927fc640 1 -- 172.21.15.172:0/1470482459 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784037070 con 0x7f979413d190 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.442+0000 7f97927fc640 1 -- 172.21.15.172:0/1470482459 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978402ae50 con 0x7f979413d190 2024-04-25T08:43:10.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.442+0000 7f97927fc640 1 -- 172.21.15.172:0/1470482459 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784032640 con 0x7f979413d190 2024-04-25T08:43:10.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.443+0000 7f979a177640 1 -- 172.21.15.172:0/1470482459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979413d190 msgr2=0x7f97940cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.443+0000 7f979a177640 1 --2- 172.21.15.172:0/1470482459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979413d190 0x7f97940cbfb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f97840097a0 tx=0x7f978402a100 comp rx=0 tx=0).stop 2024-04-25T08:43:10.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.443+0000 7f979a177640 1 -- 172.21.15.172:0/1470482459 shutdown_connections 2024-04-25T08:43:10.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.443+0000 7f979a177640 1 --2- 172.21.15.172:0/1470482459 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9794071940 0x7f97940cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.443+0000 7f979a177640 1 --2- 172.21.15.172:0/1470482459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979413d190 0x7f97940cbfb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.443+0000 7f979a177640 1 -- 172.21.15.172:0/1470482459 >> 172.21.15.172:0/1470482459 conn(0x7f979406abe0 msgr2=0x7f979406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:10.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.443+0000 7f979a177640 1 -- 172.21.15.172:0/1470482459 shutdown_connections 2024-04-25T08:43:10.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.443+0000 7f979a177640 1 -- 172.21.15.172:0/1470482459 wait complete. 2024-04-25T08:43:10.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.444+0000 7f979a177640 1 Processor -- start 2024-04-25T08:43:10.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.444+0000 7f979a177640 1 -- start start 2024-04-25T08:43:10.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f979a177640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9794071940 0x7f97940adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f979a177640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f979413d190 0x7f9794138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f979a177640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979415b320 0x7f979415c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f979a177640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940cf7a0 con 0x7f979415b320 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f979a177640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940cf620 con 0x7f9794071940 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f979a177640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97940cf920 con 0x7f979413d190 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f9793fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979415b320 0x7f979415c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f9793fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979415b320 0x7f979415c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47808/0 (socket says 172.21.15.172:47808) 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f9793fff640 1 -- 172.21.15.172:0/2989233999 learned_addr learned my addr 172.21.15.172:0/2989233999 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f9792ffd640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f979413d190 0x7f9794138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f97937fe640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9794071940 0x7f97940adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f9793fff640 1 -- 172.21.15.172:0/2989233999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f979413d190 msgr2=0x7f9794138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f9793fff640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f979413d190 0x7f9794138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f9793fff640 1 -- 172.21.15.172:0/2989233999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9794071940 msgr2=0x7f97940adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f9793fff640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9794071940 0x7f97940adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f9793fff640 1 -- 172.21.15.172:0/2989233999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97940ac8b0 con 0x7f979415b320 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f97937fe640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9794071940 0x7f97940adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f9793fff640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979415b320 0x7f979415c730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f978c009fa0 tx=0x7f978c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:10.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f977bfff640 1 -- 172.21.15.172:0/2989233999 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c01a070 con 0x7f979415b320 2024-04-25T08:43:10.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f977bfff640 1 -- 172.21.15.172:0/2989233999 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c003bb0 con 0x7f979415b320 2024-04-25T08:43:10.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f977bfff640 1 -- 172.21.15.172:0/2989233999 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c004030 con 0x7f979415b320 2024-04-25T08:43:10.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f979a177640 1 -- 172.21.15.172:0/2989233999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97940acb90 con 0x7f979415b320 2024-04-25T08:43:10.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.445+0000 7f979a177640 1 -- 172.21.15.172:0/2989233999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97940ad150 con 0x7f979415b320 2024-04-25T08:43:10.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.446+0000 7f979a177640 1 -- 172.21.15.172:0/2989233999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9794073990 con 0x7f979415b320 2024-04-25T08:43:10.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.447+0000 7f977bfff640 1 -- 172.21.15.172:0/2989233999 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f978c01d070 con 0x7f979415b320 2024-04-25T08:43:10.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.447+0000 7f977bfff640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f978006b4d0 0x7f978006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.447+0000 7f97937fe640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f978006b4d0 0x7f978006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.447+0000 7f977bfff640 1 -- 172.21.15.172:0/2989233999 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f978c08a940 con 0x7f979415b320 2024-04-25T08:43:10.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.448+0000 7f97937fe640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f978006b4d0 0x7f978006d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9784034000 tx=0x7f978402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:10.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.452+0000 7f977bfff640 1 -- 172.21.15.172:0/2989233999 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f978c010070 con 0x7f979415b320 2024-04-25T08:43:10.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.627+0000 7f979a177640 1 -- 172.21.15.172:0/2989233999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97940ae170 con 0x7f979415b320 2024-04-25T08:43:10.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.628+0000 7f977bfff640 1 -- 172.21.15.172:0/2989233999 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18905 (secure 0 0 0) 0x7f978c0593c0 con 0x7f979415b320 2024-04-25T08:43:10.621 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:10.621 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:09.821048+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:10.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 -- 172.21.15.172:0/2989233999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f978006b4d0 msgr2=0x7f978006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f978006b4d0 0x7f978006d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9784034000 tx=0x7f978402e000 comp rx=0 tx=0).stop 2024-04-25T08:43:10.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 -- 172.21.15.172:0/2989233999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979415b320 msgr2=0x7f979415c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979415b320 0x7f979415c730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f978c009fa0 tx=0x7f978c00d560 comp rx=0 tx=0).stop 2024-04-25T08:43:10.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 -- 172.21.15.172:0/2989233999 shutdown_connections 2024-04-25T08:43:10.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f978006b4d0 0x7f978006d990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f979415b320 0x7f979415c730 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f979413d190 0x7f9794138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 --2- 172.21.15.172:0/2989233999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9794071940 0x7f97940adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 -- 172.21.15.172:0/2989233999 >> 172.21.15.172:0/2989233999 conn(0x7f979406abe0 msgr2=0x7f979413c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:10.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 -- 172.21.15.172:0/2989233999 shutdown_connections 2024-04-25T08:43:10.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.631+0000 7f979a177640 1 -- 172.21.15.172:0/2989233999 wait complete. 2024-04-25T08:43:10.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:43:10.635 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:10.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.743+0000 7f38d7e3f640 1 Processor -- start 2024-04-25T08:43:10.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.743+0000 7f38d7e3f640 1 -- start start 2024-04-25T08:43:10.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.744+0000 7f38d7e3f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38d00cf600 0x7f38d00cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.744+0000 7f38d7e3f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00c75e0 con 0x7f38d00cbf20 2024-04-25T08:43:10.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.744+0000 7f38d7e3f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00c78c0 con 0x7f38d015bb50 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.744+0000 7f38d7e3f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00c8680 con 0x7f38d00cf600 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.744+0000 7f38d63dc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f38d00cbf20 0x7f38d00cc3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49636/0 (socket says 172.21.15.172:49636) 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.744+0000 7f38d63dc640 1 -- 172.21.15.172:0/2664622170 learned_addr learned my addr 172.21.15.172:0/2664622170 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653051725 0 0) 0x7f38d00c75e0 con 0x7f38d00cbf20 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d53da640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38d00cf600 0x7f38d00cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38bc003520 con 0x7f38d00cbf20 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3961830199 0 0) 0x7f38bc003520 con 0x7f38d00cbf20 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38d00cf600 msgr2=0x7f38d00cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38d00cf600 0x7f38d00cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 >> v1:172.21.15.186:6789/0 conn(0x7f38d015bb50 legacy=0x7f38d00c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00c7ba0 con 0x7f38d00cbf20 2024-04-25T08:43:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f38c8001670 con 0x7f38d00cbf20 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 >> v1:172.21.15.172:6789/0 conn(0x7f38d00cbf20 legacy=0x7f38d00cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38bc0039e0 0x7f38bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38bc004800 0x7f38bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38d00cf600 0x7f38bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00c8680 con 0x7f38bc004800 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc00bb00 con 0x7f38bc0039e0 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc00bd00 con 0x7f38d00cf600 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d53da640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38bc004800 0x7f38bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d5bdb640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38bc0039e0 0x7f38bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d63dc640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38d00cf600 0x7f38bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d53da640 1 -- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38d00cf600 msgr2=0x7f38bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d53da640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38d00cf600 0x7f38bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d53da640 1 -- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38bc0039e0 msgr2=0x7f38bc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:10.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d53da640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38bc0039e0 0x7f38bc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d53da640 1 -- 172.21.15.172:0/2664622170 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc003520 con 0x7f38bc004800 2024-04-25T08:43:10.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.745+0000 7f38d5bdb640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38bc0039e0 0x7f38bc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:10.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.746+0000 7f38d53da640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38bc004800 0x7f38bc004c80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009a90 tx=0x7f38bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9d76ceed52b314 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:10.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.746+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0036070 con 0x7f38bc004800 2024-04-25T08:43:10.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.746+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0031400 con 0x7f38bc004800 2024-04-25T08:43:10.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.746+0000 7f38d4bd9640 1 -- 172.21.15.172:0/2664622170 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0009690 con 0x7f38bc004800 2024-04-25T08:43:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.747+0000 7f38d7e3f640 1 -- 172.21.15.172:0/2664622170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38bc004800 msgr2=0x7f38bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.747+0000 7f38d7e3f640 1 --2- 172.21.15.172:0/2664622170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38bc004800 0x7f38bc004c80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009a90 tx=0x7f38bc005830 comp rx=0 tx=0).stop 2024-04-25T08:43:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.747+0000 7f38d63dc640 1 -- 172.21.15.172:0/2664622170 reap_dead start 2024-04-25T08:43:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.747+0000 7f38d7e3f640 1 -- 172.21.15.172:0/2664622170 shutdown_connections 2024-04-25T08:43:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.747+0000 7f38d7e3f640 1 -- 172.21.15.172:0/2664622170 >> 172.21.15.172:0/2664622170 conn(0x7f38d006f500 msgr2=0x7f38d006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.747+0000 7f38d7e3f640 1 -- 172.21.15.172:0/2664622170 shutdown_connections 2024-04-25T08:43:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.747+0000 7f38d7e3f640 1 -- 172.21.15.172:0/2664622170 wait complete. 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.748+0000 7f38d7e3f640 1 Processor -- start 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.748+0000 7f38d7e3f640 1 -- start start 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d7e3f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38bc004800 0x7f38d00caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d7e3f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38d015bf30 0x7f38d01452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d7e3f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38d0142be0 0x7f38d01457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d7e3f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00c72a0 con 0x7f38d015bf30 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d7e3f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00c8160 con 0x7f38d0142be0 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d7e3f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d015f6d0 con 0x7f38bc004800 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d53da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38d015bf30 0x7f38d01452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d53da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38d015bf30 0x7f38d01452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47838/0 (socket says 172.21.15.172:47838) 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d53da640 1 -- 172.21.15.172:0/4250342714 learned_addr learned my addr 172.21.15.172:0/4250342714 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d5bdb640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38bc004800 0x7f38d00caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d53da640 1 -- 172.21.15.172:0/4250342714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38bc004800 msgr2=0x7f38d00caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d53da640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38bc004800 0x7f38d00caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d53da640 1 -- 172.21.15.172:0/4250342714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38d0142be0 msgr2=0x7f38d01457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d63dc640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38d0142be0 0x7f38d01457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d53da640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38d0142be0 0x7f38d01457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d53da640 1 -- 172.21.15.172:0/4250342714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d015c6a0 con 0x7f38d015bf30 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d5bdb640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38bc004800 0x7f38d00caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d63dc640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38d0142be0 0x7f38d01457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d53da640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38d015bf30 0x7f38d01452a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f38c0034040 tx=0x7f38c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38c67fc640 1 -- 172.21.15.172:0/4250342714 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0040020 con 0x7f38d015bf30 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38c67fc640 1 -- 172.21.15.172:0/4250342714 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0003b40 con 0x7f38d015bf30 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38c67fc640 1 -- 172.21.15.172:0/4250342714 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0036040 con 0x7f38d015bf30 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d7e3f640 1 -- 172.21.15.172:0/4250342714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d015c3c0 con 0x7f38d015bf30 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.749+0000 7f38d7e3f640 1 -- 172.21.15.172:0/4250342714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d00ca6d0 con 0x7f38d015bf30 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.750+0000 7f38d7e3f640 1 -- 172.21.15.172:0/4250342714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d0073a00 con 0x7f38d015bf30 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.751+0000 7f38c67fc640 1 -- 172.21.15.172:0/4250342714 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f38c0043020 con 0x7f38d015bf30 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.751+0000 7f38c67fc640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f38b406b4d0 0x7f38b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.751+0000 7f38c67fc640 1 -- 172.21.15.172:0/4250342714 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f38c00aa830 con 0x7f38d015bf30 2024-04-25T08:43:10.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.751+0000 7f38d5bdb640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f38b406b4d0 0x7f38b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:10.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.752+0000 7f38d5bdb640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f38b406b4d0 0x7f38b406d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f38cc001e40 tx=0x7f38cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:10.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.755+0000 7f38c67fc640 1 -- 172.21.15.172:0/4250342714 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f38c004a070 con 0x7f38d015bf30 2024-04-25T08:43:10.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.927+0000 7f38d7e3f640 1 -- 172.21.15.172:0/4250342714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38d00cf150 con 0x7f38d015bf30 2024-04-25T08:43:10.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.928+0000 7f38c67fc640 1 -- 172.21.15.172:0/4250342714 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38c00044e0 con 0x7f38d015bf30 2024-04-25T08:43:10.920 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:10.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 -- 172.21.15.172:0/4250342714 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f38b406b4d0 msgr2=0x7f38b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f38b406b4d0 0x7f38b406d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f38cc001e40 tx=0x7f38cc009040 comp rx=0 tx=0).stop 2024-04-25T08:43:10.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 -- 172.21.15.172:0/4250342714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38d015bf30 msgr2=0x7f38d01452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:10.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38d015bf30 0x7f38d01452a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f38c0034040 tx=0x7f38c0004730 comp rx=0 tx=0).stop 2024-04-25T08:43:10.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 -- 172.21.15.172:0/4250342714 shutdown_connections 2024-04-25T08:43:10.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f38b406b4d0 0x7f38b406d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38d0142be0 0x7f38d01457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38d015bf30 0x7f38d01452a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 --2- 172.21.15.172:0/4250342714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38bc004800 0x7f38d00caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:10.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 -- 172.21.15.172:0/4250342714 >> 172.21.15.172:0/4250342714 conn(0x7f38d006f500 msgr2=0x7f38d00b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:10.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 -- 172.21.15.172:0/4250342714 shutdown_connections 2024-04-25T08:43:10.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:10.930+0000 7f38d7e3f640 1 -- 172.21.15.172:0/4250342714 wait complete. 2024-04-25T08:43:10.933 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:43:11.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.040+0000 7ff18722a640 1 Processor -- start 2024-04-25T08:43:11.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.040+0000 7ff18722a640 1 -- start start 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.041+0000 7ff18722a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff1801610f0 0x7ff18006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.041+0000 7ff18722a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff1801616f0 0x7ff180161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.041+0000 7ff18722a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1800c6960 con 0x7ff1800ce0a0 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.041+0000 7ff18722a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1801614d0 con 0x7ff1801610f0 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.041+0000 7ff18722a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff180162260 con 0x7ff1801616f0 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.041+0000 7ff184fc6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff1801610f0 0x7ff18006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.041+0000 7ff184fc6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff1801610f0 0x7ff18006c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47846/0 (socket says 172.21.15.172:47846) 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.041+0000 7ff184fc6640 1 -- 172.21.15.172:0/2564227370 learned_addr learned my addr 172.21.15.172:0/2564227370 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.042+0000 7ff184fc6640 1 -- 172.21.15.172:0/2564227370 >> v2:172.21.15.186:3300/0 conn(0x7ff1801616f0 msgr2=0x7ff180161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.042+0000 7ff184fc6640 1 --2- 172.21.15.172:0/2564227370 >> v2:172.21.15.186:3300/0 conn(0x7ff1801616f0 0x7ff180161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.042+0000 7ff184fc6640 1 -- 172.21.15.172:0/2564227370 >> v1:172.21.15.186:6789/0 conn(0x7ff1800ce0a0 legacy=0x7ff1800d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:11.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.042+0000 7ff184fc6640 1 -- 172.21.15.172:0/2564227370 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff180162540 con 0x7ff1801610f0 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.042+0000 7ff184fc6640 1 --2- 172.21.15.172:0/2564227370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801610f0 0x7ff18006c1c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff18006f220 tx=0x7ff17002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d60f7025c91926 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.042+0000 7ff17f7fe640 1 -- 172.21.15.172:0/2564227370 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170037070 con 0x7ff1801610f0 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.043+0000 7ff17f7fe640 1 -- 172.21.15.172:0/2564227370 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff170032440 con 0x7ff1801610f0 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.043+0000 7ff17f7fe640 1 -- 172.21.15.172:0/2564227370 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170032810 con 0x7ff1801610f0 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.043+0000 7ff18722a640 1 -- 172.21.15.172:0/2564227370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801610f0 msgr2=0x7ff18006c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.043+0000 7ff18722a640 1 --2- 172.21.15.172:0/2564227370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801610f0 0x7ff18006c1c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff18006f220 tx=0x7ff17002a230 comp rx=0 tx=0).stop 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.043+0000 7ff18722a640 1 -- 172.21.15.172:0/2564227370 shutdown_connections 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.043+0000 7ff18722a640 1 --2- 172.21.15.172:0/2564227370 >> v2:172.21.15.186:3300/0 conn(0x7ff1801616f0 0x7ff180161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.043+0000 7ff18722a640 1 --2- 172.21.15.172:0/2564227370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801610f0 0x7ff18006c1c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.043+0000 7ff18722a640 1 -- 172.21.15.172:0/2564227370 >> 172.21.15.172:0/2564227370 conn(0x7ff18006f500 msgr2=0x7ff18006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.043+0000 7ff18722a640 1 -- 172.21.15.172:0/2564227370 shutdown_connections 2024-04-25T08:43:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.043+0000 7ff18722a640 1 -- 172.21.15.172:0/2564227370 wait complete. 2024-04-25T08:43:11.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.044+0000 7ff18722a640 1 Processor -- start 2024-04-25T08:43:11.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.044+0000 7ff18722a640 1 -- start start 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.045+0000 7ff18722a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1800ce0a0 0x7ff180148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.045+0000 7ff18722a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1801610f0 0x7ff1801451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.045+0000 7ff18722a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801616f0 0x7ff1801456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.045+0000 7ff18722a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1800cf690 con 0x7ff1801616f0 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.045+0000 7ff18722a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1800cfce0 con 0x7ff1800ce0a0 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.045+0000 7ff18722a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18006c700 con 0x7ff1801610f0 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.045+0000 7ff1857c7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801616f0 0x7ff1801456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.045+0000 7ff1857c7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801616f0 0x7ff1801456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47860/0 (socket says 172.21.15.172:47860) 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.045+0000 7ff1857c7640 1 -- 172.21.15.172:0/1768145086 learned_addr learned my addr 172.21.15.172:0/1768145086 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff184fc6640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1800ce0a0 0x7ff180148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff17ffff640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1801610f0 0x7ff1801451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff1857c7640 1 -- 172.21.15.172:0/1768145086 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1801610f0 msgr2=0x7ff1801451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff1857c7640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1801610f0 0x7ff1801451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff1857c7640 1 -- 172.21.15.172:0/1768145086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1800ce0a0 msgr2=0x7ff180148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff1857c7640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1800ce0a0 0x7ff180148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff1857c7640 1 -- 172.21.15.172:0/1768145086 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1801440e0 con 0x7ff1801616f0 2024-04-25T08:43:11.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff17ffff640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1801610f0 0x7ff1801451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:11.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff184fc6640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1800ce0a0 0x7ff180148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:11.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff1857c7640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801616f0 0x7ff1801456e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff17800b990 tx=0x7ff17800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff17d7fa640 1 -- 172.21.15.172:0/1768145086 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178019070 con 0x7ff1801616f0 2024-04-25T08:43:11.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff17d7fa640 1 -- 172.21.15.172:0/1768145086 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17800cba0 con 0x7ff1801616f0 2024-04-25T08:43:11.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff18722a640 1 -- 172.21.15.172:0/1768145086 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1801443c0 con 0x7ff1801616f0 2024-04-25T08:43:11.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff17d7fa640 1 -- 172.21.15.172:0/1768145086 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178014440 con 0x7ff1801616f0 2024-04-25T08:43:11.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.046+0000 7ff18722a640 1 -- 172.21.15.172:0/1768145086 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff180144980 con 0x7ff1801616f0 2024-04-25T08:43:11.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.047+0000 7ff18722a640 1 -- 172.21.15.172:0/1768145086 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff180073a00 con 0x7ff1801616f0 2024-04-25T08:43:11.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.047+0000 7ff17d7fa640 1 -- 172.21.15.172:0/1768145086 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff178007370 con 0x7ff1801616f0 2024-04-25T08:43:11.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.048+0000 7ff17d7fa640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff16c06b500 0x7ff16c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.048+0000 7ff17d7fa640 1 -- 172.21.15.172:0/1768145086 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff17808a2d0 con 0x7ff1801616f0 2024-04-25T08:43:11.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.048+0000 7ff184fc6640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff16c06b500 0x7ff16c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.048+0000 7ff184fc6640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff16c06b500 0x7ff16c06d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff170034000 tx=0x7ff17002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.052+0000 7ff17d7fa640 1 -- 172.21.15.172:0/1768145086 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff178058cc0 con 0x7ff1801616f0 2024-04-25T08:43:11.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.219+0000 7ff18722a640 1 -- 172.21.15.172:0/1768145086 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1800cf150 con 0x7ff1801616f0 2024-04-25T08:43:11.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.219+0000 7ff17d7fa640 1 -- 172.21.15.172:0/1768145086 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff17808a0f0 con 0x7ff1801616f0 2024-04-25T08:43:11.212 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 -- 172.21.15.172:0/1768145086 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff16c06b500 msgr2=0x7ff16c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff16c06b500 0x7ff16c06d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff170034000 tx=0x7ff17002e000 comp rx=0 tx=0).stop 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 -- 172.21.15.172:0/1768145086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801616f0 msgr2=0x7ff1801456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801616f0 0x7ff1801456e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff17800b990 tx=0x7ff17800be50 comp rx=0 tx=0).stop 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 -- 172.21.15.172:0/1768145086 shutdown_connections 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff16c06b500 0x7ff16c06d9c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1801616f0 0x7ff1801456e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1801610f0 0x7ff1801451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 --2- 172.21.15.172:0/1768145086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1800ce0a0 0x7ff180148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 -- 172.21.15.172:0/1768145086 >> 172.21.15.172:0/1768145086 conn(0x7ff18006f500 msgr2=0x7ff1801566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 -- 172.21.15.172:0/1768145086 shutdown_connections 2024-04-25T08:43:11.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.221+0000 7ff18722a640 1 -- 172.21.15.172:0/1768145086 wait complete. 2024-04-25T08:43:11.224 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:43:11.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.332+0000 7fac8a709640 1 Processor -- start 2024-04-25T08:43:11.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.332+0000 7fac8a709640 1 -- start start 2024-04-25T08:43:11.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.332+0000 7fac8a709640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fac84070dc0 0x7fac8406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.332+0000 7fac8a709640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac8415deb0 0x7fac8415e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.332+0000 7fac8a709640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac840d1770 con 0x7fac840711a0 2024-04-25T08:43:11.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.332+0000 7fac8a709640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac840b0eb0 con 0x7fac8415deb0 2024-04-25T08:43:11.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.332+0000 7fac8a709640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac841622b0 con 0x7fac84070dc0 2024-04-25T08:43:11.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.333+0000 7fac88ca6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac8415deb0 0x7fac8415e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.333+0000 7fac837fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fac840711a0 0x7fac840b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49638/0 (socket says 172.21.15.172:49638) 2024-04-25T08:43:11.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.333+0000 7fac837fe640 1 -- 172.21.15.172:0/1574749056 learned_addr learned my addr 172.21.15.172:0/1574749056 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:11.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.333+0000 7fac83fff640 1 --2- 172.21.15.172:0/1574749056 >> v2:172.21.15.186:3300/0 conn(0x7fac84070dc0 0x7fac8406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.333+0000 7fac88ca6640 1 -- 172.21.15.172:0/1574749056 >> v2:172.21.15.186:3300/0 conn(0x7fac84070dc0 msgr2=0x7fac8406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:11.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.333+0000 7fac88ca6640 1 --2- 172.21.15.172:0/1574749056 >> v2:172.21.15.186:3300/0 conn(0x7fac84070dc0 0x7fac8406ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.333+0000 7fac88ca6640 1 -- 172.21.15.172:0/1574749056 >> v1:172.21.15.172:6789/0 conn(0x7fac840711a0 legacy=0x7fac840b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.333+0000 7fac82ffd640 1 -- 172.21.15.172:0/1574749056 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294342336 0 0) 0x7fac840d1770 con 0x7fac840711a0 2024-04-25T08:43:11.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.333+0000 7fac88ca6640 1 -- 172.21.15.172:0/1574749056 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84162740 con 0x7fac8415deb0 2024-04-25T08:43:11.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac88ca6640 1 --2- 172.21.15.172:0/1574749056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac8415deb0 0x7fac8415e300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fac84070a00 tx=0x7fac7c02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3fc1b0ea8d4772 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac82ffd640 1 -- 172.21.15.172:0/1574749056 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c007740 con 0x7fac8415deb0 2024-04-25T08:43:11.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac82ffd640 1 -- 172.21.15.172:0/1574749056 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c0078e0 con 0x7fac8415deb0 2024-04-25T08:43:11.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac82ffd640 1 -- 172.21.15.172:0/1574749056 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c007cb0 con 0x7fac8415deb0 2024-04-25T08:43:11.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac8a709640 1 -- 172.21.15.172:0/1574749056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac8415deb0 msgr2=0x7fac8415e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac8a709640 1 --2- 172.21.15.172:0/1574749056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac8415deb0 0x7fac8415e300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fac84070a00 tx=0x7fac7c02a560 comp rx=0 tx=0).stop 2024-04-25T08:43:11.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac8a709640 1 -- 172.21.15.172:0/1574749056 shutdown_connections 2024-04-25T08:43:11.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac8a709640 1 --2- 172.21.15.172:0/1574749056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac8415deb0 0x7fac8415e300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac8a709640 1 --2- 172.21.15.172:0/1574749056 >> v2:172.21.15.186:3300/0 conn(0x7fac84070dc0 0x7fac8406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac8a709640 1 -- 172.21.15.172:0/1574749056 >> 172.21.15.172:0/1574749056 conn(0x7fac840b3530 msgr2=0x7fac840b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:11.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac8a709640 1 -- 172.21.15.172:0/1574749056 shutdown_connections 2024-04-25T08:43:11.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.334+0000 7fac8a709640 1 -- 172.21.15.172:0/1574749056 wait complete. 2024-04-25T08:43:11.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.335+0000 7fac8a709640 1 Processor -- start 2024-04-25T08:43:11.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.336+0000 7fac8a709640 1 -- start start 2024-04-25T08:43:11.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.336+0000 7fac8a709640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac84070dc0 0x7fac84152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.336+0000 7fac8a709640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac840711a0 0x7fac841606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.336+0000 7fac8a709640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac8415deb0 0x7fac84156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.336+0000 7fac8a709640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac84161c60 con 0x7fac840711a0 2024-04-25T08:43:11.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.336+0000 7fac8a709640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac840b10f0 con 0x7fac84070dc0 2024-04-25T08:43:11.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.336+0000 7fac8a709640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac84161f40 con 0x7fac8415deb0 2024-04-25T08:43:11.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.336+0000 7fac837fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac840711a0 0x7fac841606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac837fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac840711a0 0x7fac841606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47880/0 (socket says 172.21.15.172:47880) 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac837fe640 1 -- 172.21.15.172:0/3368088576 learned_addr learned my addr 172.21.15.172:0/3368088576 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac837fe640 1 -- 172.21.15.172:0/3368088576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac8415deb0 msgr2=0x7fac84156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac837fe640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac8415deb0 0x7fac84156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac837fe640 1 -- 172.21.15.172:0/3368088576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac84070dc0 msgr2=0x7fac84152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac83fff640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac84070dc0 0x7fac84152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac837fe640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac84070dc0 0x7fac84152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac837fe640 1 -- 172.21.15.172:0/3368088576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8415e2c0 con 0x7fac840711a0 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac837fe640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac840711a0 0x7fac841606d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac7800c500 tx=0x7fac7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac80ff9640 1 -- 172.21.15.172:0/3368088576 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac78018070 con 0x7fac840711a0 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac80ff9640 1 -- 172.21.15.172:0/3368088576 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac78007580 con 0x7fac840711a0 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac8a709640 1 -- 172.21.15.172:0/3368088576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8415e5a0 con 0x7fac840711a0 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac80ff9640 1 -- 172.21.15.172:0/3368088576 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac78004a20 con 0x7fac840711a0 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.337+0000 7fac8a709640 1 -- 172.21.15.172:0/3368088576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8415eb60 con 0x7fac840711a0 2024-04-25T08:43:11.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.338+0000 7fac8a709640 1 -- 172.21.15.172:0/3368088576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac84073a00 con 0x7fac840711a0 2024-04-25T08:43:11.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.339+0000 7fac80ff9640 1 -- 172.21.15.172:0/3368088576 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac7801b070 con 0x7fac840711a0 2024-04-25T08:43:11.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.339+0000 7fac80ff9640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac7006b500 0x7fac7006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.339+0000 7fac80ff9640 1 -- 172.21.15.172:0/3368088576 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fac78089850 con 0x7fac840711a0 2024-04-25T08:43:11.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.339+0000 7fac83fff640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac7006b500 0x7fac7006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.339+0000 7fac83fff640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac7006b500 0x7fac7006d9c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac74006fd0 tx=0x7fac74008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.343+0000 7fac80ff9640 1 -- 172.21.15.172:0/3368088576 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac78058360 con 0x7fac840711a0 2024-04-25T08:43:11.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.513+0000 7fac8a709640 1 -- 172.21.15.172:0/3368088576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac840b5470 con 0x7fac840711a0 2024-04-25T08:43:11.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.513+0000 7fac80ff9640 1 -- 172.21.15.172:0/3368088576 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac78057c60 con 0x7fac840711a0 2024-04-25T08:43:11.505 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 -- 172.21.15.172:0/3368088576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac7006b500 msgr2=0x7fac7006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac7006b500 0x7fac7006d9c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac74006fd0 tx=0x7fac74008040 comp rx=0 tx=0).stop 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 -- 172.21.15.172:0/3368088576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac840711a0 msgr2=0x7fac841606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac840711a0 0x7fac841606d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac7800c500 tx=0x7fac7800c9c0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 -- 172.21.15.172:0/3368088576 shutdown_connections 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac7006b500 0x7fac7006d9c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac8415deb0 0x7fac84156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac840711a0 0x7fac841606d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 --2- 172.21.15.172:0/3368088576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac84070dc0 0x7fac84152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 -- 172.21.15.172:0/3368088576 >> 172.21.15.172:0/3368088576 conn(0x7fac840b3530 msgr2=0x7fac840b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 -- 172.21.15.172:0/3368088576 shutdown_connections 2024-04-25T08:43:11.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.515+0000 7fac8a709640 1 -- 172.21.15.172:0/3368088576 wait complete. 2024-04-25T08:43:11.518 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:43:11.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.626+0000 7f59d14fc640 1 Processor -- start 2024-04-25T08:43:11.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.626+0000 7f59d14fc640 1 -- start start 2024-04-25T08:43:11.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.627+0000 7f59d14fc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f59cc15dc20 0x7f59cc0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.627+0000 7f59d14fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc161710 0x7f59cc0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.627+0000 7f59d14fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f59cc0b9330 0x7f59cc06bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.627+0000 7f59d14fc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc15e000 con 0x7f59cc0b9330 2024-04-25T08:43:11.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.627+0000 7f59d14fc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59cc0d1de0 con 0x7f59cc15dc20 2024-04-25T08:43:11.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.627+0000 7f59d14fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc161c60 con 0x7f59cc161710 2024-04-25T08:43:11.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.627+0000 7f59cb7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f59cc0b9330 0x7f59cc06bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.627+0000 7f59cb7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f59cc0b9330 0x7f59cc06bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47896/0 (socket says 172.21.15.172:47896) 2024-04-25T08:43:11.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.627+0000 7f59cb7fe640 1 -- 172.21.15.172:0/2878555354 learned_addr learned my addr 172.21.15.172:0/2878555354 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:11.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.628+0000 7f59ca7fc640 1 --2- 172.21.15.172:0/2878555354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc161710 0x7f59cc0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.628+0000 7f59caffd640 1 --2- 172.21.15.172:0/2878555354 >> v2:172.21.15.186:3300/0 conn(0x7f59cc15dc20 0x7f59cc0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.628+0000 7f59cb7fe640 1 -- 172.21.15.172:0/2878555354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc161710 msgr2=0x7f59cc0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:11.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.628+0000 7f59cb7fe640 1 --2- 172.21.15.172:0/2878555354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc161710 0x7f59cc0cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.628+0000 7f59cb7fe640 1 -- 172.21.15.172:0/2878555354 >> v2:172.21.15.186:3300/0 conn(0x7f59cc15dc20 msgr2=0x7f59cc0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:11.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.628+0000 7f59cb7fe640 1 --2- 172.21.15.172:0/2878555354 >> v2:172.21.15.186:3300/0 conn(0x7f59cc15dc20 0x7f59cc0ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.628+0000 7f59cb7fe640 1 -- 172.21.15.172:0/2878555354 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc161f40 con 0x7f59cc0b9330 2024-04-25T08:43:11.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.628+0000 7f59ca7fc640 1 --2- 172.21.15.172:0/2878555354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc161710 0x7f59cc0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:11.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.628+0000 7f59caffd640 1 --2- 172.21.15.172:0/2878555354 >> v2:172.21.15.186:3300/0 conn(0x7f59cc15dc20 0x7f59cc0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.628+0000 7f59cb7fe640 1 --2- 172.21.15.172:0/2878555354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc0b9330 0x7f59cc06bf80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0d1520 tx=0x7f59c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e930a8dbce7ce347 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59c9ffb640 1 -- 172.21.15.172:0/2878555354 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4037070 con 0x7f59cc0b9330 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59c9ffb640 1 -- 172.21.15.172:0/2878555354 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4032440 con 0x7f59cc0b9330 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59c9ffb640 1 -- 172.21.15.172:0/2878555354 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4032810 con 0x7f59cc0b9330 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59d14fc640 1 -- 172.21.15.172:0/2878555354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc0b9330 msgr2=0x7f59cc06bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59d14fc640 1 --2- 172.21.15.172:0/2878555354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc0b9330 0x7f59cc06bf80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0d1520 tx=0x7f59c402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59d14fc640 1 -- 172.21.15.172:0/2878555354 shutdown_connections 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59d14fc640 1 --2- 172.21.15.172:0/2878555354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc0b9330 0x7f59cc06bf80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59d14fc640 1 --2- 172.21.15.172:0/2878555354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc161710 0x7f59cc0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59d14fc640 1 --2- 172.21.15.172:0/2878555354 >> v2:172.21.15.186:3300/0 conn(0x7f59cc15dc20 0x7f59cc0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59d14fc640 1 -- 172.21.15.172:0/2878555354 >> 172.21.15.172:0/2878555354 conn(0x7f59cc0d0420 msgr2=0x7f59cc0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:11.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59d14fc640 1 -- 172.21.15.172:0/2878555354 shutdown_connections 2024-04-25T08:43:11.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.629+0000 7f59d14fc640 1 -- 172.21.15.172:0/2878555354 wait complete. 2024-04-25T08:43:11.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.630+0000 7f59d14fc640 1 Processor -- start 2024-04-25T08:43:11.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.631+0000 7f59d14fc640 1 -- start start 2024-04-25T08:43:11.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.631+0000 7f59d14fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59cc0b9330 0x7f59cc1f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.631+0000 7f59d14fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc15dc20 0x7f59cc0aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.631+0000 7f59d14fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc161710 0x7f59cc0ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.631+0000 7f59d14fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc0b5e50 con 0x7f59cc161710 2024-04-25T08:43:11.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.631+0000 7f59d14fc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc162500 con 0x7f59cc0b9330 2024-04-25T08:43:11.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.631+0000 7f59d14fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc0b5fd0 con 0x7f59cc15dc20 2024-04-25T08:43:11.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.631+0000 7f59cb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc161710 0x7f59cc0ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.631+0000 7f59cb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc161710 0x7f59cc0ab2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47912/0 (socket says 172.21.15.172:47912) 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.631+0000 7f59cb7fe640 1 -- 172.21.15.172:0/2441545937 learned_addr learned my addr 172.21.15.172:0/2441545937 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59caffd640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59cc0b9330 0x7f59cc1f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59ca7fc640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc15dc20 0x7f59cc0aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59cb7fe640 1 -- 172.21.15.172:0/2441545937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc15dc20 msgr2=0x7f59cc0aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59cb7fe640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc15dc20 0x7f59cc0aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59cb7fe640 1 -- 172.21.15.172:0/2441545937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59cc0b9330 msgr2=0x7f59cc1f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59cb7fe640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59cc0b9330 0x7f59cc1f2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59cb7fe640 1 -- 172.21.15.172:0/2441545937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc0ab950 con 0x7f59cc161710 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59ca7fc640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc15dc20 0x7f59cc0aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59cb7fe640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc161710 0x7f59cc0ab2d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f59c402a220 tx=0x7f59c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59b37fe640 1 -- 172.21.15.172:0/2441545937 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4041070 con 0x7f59cc161710 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59b37fe640 1 -- 172.21.15.172:0/2441545937 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c403c890 con 0x7f59cc161710 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59d14fc640 1 -- 172.21.15.172:0/2441545937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc0abc30 con 0x7f59cc161710 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59b37fe640 1 -- 172.21.15.172:0/2441545937 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4037040 con 0x7f59cc161710 2024-04-25T08:43:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.632+0000 7f59d14fc640 1 -- 172.21.15.172:0/2441545937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc0cbbf0 con 0x7f59cc161710 2024-04-25T08:43:11.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.633+0000 7f59d14fc640 1 -- 172.21.15.172:0/2441545937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59cc073a00 con 0x7f59cc161710 2024-04-25T08:43:11.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.633+0000 7f59b37fe640 1 -- 172.21.15.172:0/2441545937 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f59c4044070 con 0x7f59cc161710 2024-04-25T08:43:11.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.634+0000 7f59b37fe640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f59b806b4d0 0x7f59b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.634+0000 7f59b37fe640 1 -- 172.21.15.172:0/2441545937 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f59c40ab120 con 0x7f59cc161710 2024-04-25T08:43:11.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.634+0000 7f59caffd640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f59b806b4d0 0x7f59b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.634+0000 7f59caffd640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f59b806b4d0 0x7f59b806d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f59bc007fc0 tx=0x7f59bc007550 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.638+0000 7f59b37fe640 1 -- 172.21.15.172:0/2441545937 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f59c4079d50 con 0x7f59cc161710 2024-04-25T08:43:11.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.806+0000 7f59d14fc640 1 -- 172.21.15.172:0/2441545937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f59cc0d16b0 con 0x7f59cc161710 2024-04-25T08:43:11.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.806+0000 7f59b37fe640 1 -- 172.21.15.172:0/2441545937 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f59c4079650 con 0x7f59cc161710 2024-04-25T08:43:11.798 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:11.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 -- 172.21.15.172:0/2441545937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f59b806b4d0 msgr2=0x7f59b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f59b806b4d0 0x7f59b806d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f59bc007fc0 tx=0x7f59bc007550 comp rx=0 tx=0).stop 2024-04-25T08:43:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 -- 172.21.15.172:0/2441545937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc161710 msgr2=0x7f59cc0ab2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc161710 0x7f59cc0ab2d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f59c402a220 tx=0x7f59c40046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 -- 172.21.15.172:0/2441545937 shutdown_connections 2024-04-25T08:43:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f59b806b4d0 0x7f59b806d990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59cc161710 0x7f59cc0ab2d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59cc15dc20 0x7f59cc0aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 --2- 172.21.15.172:0/2441545937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59cc0b9330 0x7f59cc1f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 -- 172.21.15.172:0/2441545937 >> 172.21.15.172:0/2441545937 conn(0x7f59cc0d0420 msgr2=0x7f59cc0d3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 -- 172.21.15.172:0/2441545937 shutdown_connections 2024-04-25T08:43:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.808+0000 7f59d14fc640 1 -- 172.21.15.172:0/2441545937 wait complete. 2024-04-25T08:43:11.820 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-04-25T08:43:11.821 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T08:43:11.821 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.928+0000 7f6e17d61640 1 Processor -- start 2024-04-25T08:43:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.928+0000 7f6e17d61640 1 -- start start 2024-04-25T08:43:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e17d61640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 0x7f6e1015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e17d61640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6e100af720 0x7f6e100afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e17d61640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6e101617b0 0x7f6e10161c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e17d61640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e100b3670 con 0x7f6e100af720 2024-04-25T08:43:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e17d61640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e10070a10 con 0x7f6e101617b0 2024-04-25T08:43:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e17d61640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1015f180 con 0x7f6e10158220 2024-04-25T08:43:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e152fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6e100af720 0x7f6e100afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e152fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6e100af720 0x7f6e100afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47916/0 (socket says 172.21.15.172:47916) 2024-04-25T08:43:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e152fc640 1 -- 172.21.15.172:0/1957894011 learned_addr learned my addr 172.21.15.172:0/1957894011 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:11.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e162fe640 1 --2- 172.21.15.172:0/1957894011 >> v2:172.21.15.186:3300/0 conn(0x7f6e101617b0 0x7f6e10161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.929+0000 7f6e15afd640 1 --2- 172.21.15.172:0/1957894011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 0x7f6e1015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.930+0000 7f6e152fc640 1 -- 172.21.15.172:0/1957894011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 msgr2=0x7f6e1015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:11.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.930+0000 7f6e152fc640 1 --2- 172.21.15.172:0/1957894011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 0x7f6e1015ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.930+0000 7f6e152fc640 1 -- 172.21.15.172:0/1957894011 >> v2:172.21.15.186:3300/0 conn(0x7f6e101617b0 msgr2=0x7f6e10161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:11.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.930+0000 7f6e152fc640 1 --2- 172.21.15.172:0/1957894011 >> v2:172.21.15.186:3300/0 conn(0x7f6e101617b0 0x7f6e10161c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.930+0000 7f6e152fc640 1 -- 172.21.15.172:0/1957894011 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1006fe00 con 0x7f6e100af720 2024-04-25T08:43:11.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.930+0000 7f6e152fc640 1 --2- 172.21.15.172:0/1957894011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e100af720 0x7f6e100afba0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e101616e0 tx=0x7f6e0002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e2ea217d6880e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.930+0000 7f6e14afb640 1 -- 172.21.15.172:0/1957894011 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00037070 con 0x7f6e100af720 2024-04-25T08:43:11.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.930+0000 7f6e14afb640 1 -- 172.21.15.172:0/1957894011 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00032440 con 0x7f6e100af720 2024-04-25T08:43:11.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.930+0000 7f6e14afb640 1 -- 172.21.15.172:0/1957894011 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00032810 con 0x7f6e100af720 2024-04-25T08:43:11.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.931+0000 7f6e17d61640 1 -- 172.21.15.172:0/1957894011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e100af720 msgr2=0x7f6e100afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.931+0000 7f6e17d61640 1 --2- 172.21.15.172:0/1957894011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e100af720 0x7f6e100afba0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e101616e0 tx=0x7f6e0002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.931+0000 7f6e17d61640 1 -- 172.21.15.172:0/1957894011 shutdown_connections 2024-04-25T08:43:11.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.931+0000 7f6e17d61640 1 --2- 172.21.15.172:0/1957894011 >> v2:172.21.15.186:3300/0 conn(0x7f6e101617b0 0x7f6e10161c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.931+0000 7f6e17d61640 1 --2- 172.21.15.172:0/1957894011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e100af720 0x7f6e100afba0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.931+0000 7f6e17d61640 1 --2- 172.21.15.172:0/1957894011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 0x7f6e1015ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.931+0000 7f6e17d61640 1 -- 172.21.15.172:0/1957894011 >> 172.21.15.172:0/1957894011 conn(0x7f6e100b2370 msgr2=0x7f6e100b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:11.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.931+0000 7f6e17d61640 1 -- 172.21.15.172:0/1957894011 shutdown_connections 2024-04-25T08:43:11.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.931+0000 7f6e17d61640 1 -- 172.21.15.172:0/1957894011 wait complete. 2024-04-25T08:43:11.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.933+0000 7f6e17d61640 1 Processor -- start 2024-04-25T08:43:11.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.933+0000 7f6e17d61640 1 -- start start 2024-04-25T08:43:11.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.933+0000 7f6e17d61640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100af720 0x7f6e1013b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.933+0000 7f6e17d61640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 0x7f6e1015f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.933+0000 7f6e17d61640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e101617b0 0x7f6e1015fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.933+0000 7f6e17d61640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100706a0 con 0x7f6e101617b0 2024-04-25T08:43:11.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.933+0000 7f6e17d61640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e100703c0 con 0x7f6e100af720 2024-04-25T08:43:11.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.933+0000 7f6e17d61640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e10158600 con 0x7f6e10158220 2024-04-25T08:43:11.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.933+0000 7f6e162fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e101617b0 0x7f6e1015fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e162fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e101617b0 0x7f6e1015fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47924/0 (socket says 172.21.15.172:47924) 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e162fe640 1 -- 172.21.15.172:0/2566247326 learned_addr learned my addr 172.21.15.172:0/2566247326 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e15afd640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100af720 0x7f6e1013b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e152fc640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 0x7f6e1015f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e162fe640 1 -- 172.21.15.172:0/2566247326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 msgr2=0x7f6e1015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e162fe640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 0x7f6e1015f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e162fe640 1 -- 172.21.15.172:0/2566247326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100af720 msgr2=0x7f6e1013b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e162fe640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100af720 0x7f6e1013b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e162fe640 1 -- 172.21.15.172:0/2566247326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1013c0b0 con 0x7f6e101617b0 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e152fc640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 0x7f6e1015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e15afd640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100af720 0x7f6e1013b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e162fe640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e101617b0 0x7f6e1015fe40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800efc0 tx=0x7f6e0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e067fc640 1 -- 172.21.15.172:0/2566247326 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08018020 con 0x7f6e101617b0 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e067fc640 1 -- 172.21.15.172:0/2566247326 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e08014480 con 0x7f6e101617b0 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e17d61640 1 -- 172.21.15.172:0/2566247326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e100cc780 con 0x7f6e101617b0 2024-04-25T08:43:11.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e067fc640 1 -- 172.21.15.172:0/2566247326 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08014870 con 0x7f6e101617b0 2024-04-25T08:43:11.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.934+0000 7f6e17d61640 1 -- 172.21.15.172:0/2566247326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e100cb970 con 0x7f6e101617b0 2024-04-25T08:43:11.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.935+0000 7f6e17d61640 1 -- 172.21.15.172:0/2566247326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e10073990 con 0x7f6e101617b0 2024-04-25T08:43:11.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.936+0000 7f6e067fc640 1 -- 172.21.15.172:0/2566247326 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6e08005d10 con 0x7f6e101617b0 2024-04-25T08:43:11.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.936+0000 7f6e067fc640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 0x7f6df406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:11.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.936+0000 7f6e067fc640 1 -- 172.21.15.172:0/2566247326 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6e0808af50 con 0x7f6e101617b0 2024-04-25T08:43:11.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.936+0000 7f6e15afd640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 0x7f6df406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:11.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.937+0000 7f6e15afd640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 0x7f6df406d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009e10 tx=0x7f6e0c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:11.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:11.941+0000 7f6e067fc640 1 -- 172.21.15.172:0/2566247326 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e08022070 con 0x7f6e101617b0 2024-04-25T08:43:12.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.115+0000 7f6e17d61640 1 -- 172.21.15.172:0/2566247326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e100ccca0 con 0x7f6e101617b0 2024-04-25T08:43:12.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.116+0000 7f6e067fc640 1 -- 172.21.15.172:0/2566247326 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18905 (secure 0 0 0) 0x7f6e08010040 con 0x7f6e101617b0 2024-04-25T08:43:12.108 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:12.109 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:09.821048+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:12.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 -- 172.21.15.172:0/2566247326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 msgr2=0x7f6df406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 0x7f6df406d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009e10 tx=0x7f6e0c009190 comp rx=0 tx=0).stop 2024-04-25T08:43:12.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 -- 172.21.15.172:0/2566247326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e101617b0 msgr2=0x7f6e1015fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e101617b0 0x7f6e1015fe40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800efc0 tx=0x7f6e0800c490 comp rx=0 tx=0).stop 2024-04-25T08:43:12.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 -- 172.21.15.172:0/2566247326 shutdown_connections 2024-04-25T08:43:12.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 0x7f6df406d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e101617b0 0x7f6e1015fe40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e10158220 0x7f6e1015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 --2- 172.21.15.172:0/2566247326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e100af720 0x7f6e1013b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 -- 172.21.15.172:0/2566247326 >> 172.21.15.172:0/2566247326 conn(0x7f6e100b2370 msgr2=0x7f6e10160e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:12.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 -- 172.21.15.172:0/2566247326 shutdown_connections 2024-04-25T08:43:12.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.118+0000 7f6e17d61640 1 -- 172.21.15.172:0/2566247326 wait complete. 2024-04-25T08:43:12.122 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:43:12.122 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:12.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.230+0000 7f92ab422640 1 Processor -- start 2024-04-25T08:43:12.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.230+0000 7f92ab422640 1 -- start start 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f92ab422640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f92a406abe0 0x7f92a406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f92ab422640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a406b500 con 0x7f92a415dd80 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f92ab422640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a40b3930 con 0x7f92a40ad570 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f92ab422640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a406e410 con 0x7f92a406abe0 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f92a89bd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f92a415dd80 0x7f92a40b5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49644/0 (socket says 172.21.15.172:49644) 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f92a89bd640 1 -- 172.21.15.172:0/2222185991 learned_addr learned my addr 172.21.15.172:0/2222185991 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086314271 0 0) 0x7f92a406b500 con 0x7f92a415dd80 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9290003520 con 0x7f92a415dd80 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f92a91be640 1 --2- 172.21.15.172:0/2222185991 >> v2:172.21.15.186:3300/0 conn(0x7f92a406abe0 0x7f92a406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4067961680 0 0) 0x7f9290003520 con 0x7f92a415dd80 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 >> v2:172.21.15.186:3300/0 conn(0x7f92a406abe0 msgr2=0x7f92a406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 --2- 172.21.15.172:0/2222185991 >> v2:172.21.15.186:3300/0 conn(0x7f92a406abe0 0x7f92a406afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 >> v1:172.21.15.186:6789/0 conn(0x7f92a40ad570 legacy=0x7f92a406ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a40b3c10 con 0x7f92a415dd80 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f9294001670 con 0x7f92a415dd80 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 >> v1:172.21.15.172:6789/0 conn(0x7f92a415dd80 legacy=0x7f92a40b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f9290003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290004800 0x7f9290004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92900051c0 0x7f929000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a406e410 con 0x7f92900039b0 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929000c060 con 0x7f92900051c0 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.231+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929000c260 con 0x7f9290004800 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.232+0000 7f92a91be640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f9290003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.232+0000 7f92a99bf640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92900051c0 0x7f929000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.232+0000 7f92a89bd640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290004800 0x7f9290004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.232+0000 7f92a91be640 1 -- 172.21.15.172:0/2222185991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290004800 msgr2=0x7f9290004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.232+0000 7f92a91be640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9290004800 0x7f9290004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.232+0000 7f92a91be640 1 -- 172.21.15.172:0/2222185991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92900051c0 msgr2=0x7f929000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:12.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.232+0000 7f92a91be640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92900051c0 0x7f929000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.232+0000 7f92a91be640 1 -- 172.21.15.172:0/2222185991 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290003520 con 0x7f92900039b0 2024-04-25T08:43:12.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.232+0000 7f92a99bf640 1 -- 172.21.15.172:0/2222185991 reap_dead start 2024-04-25T08:43:12.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.232+0000 7f92a91be640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f9290003dd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009ac0 tx=0x7f9290005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d552346e3a9b1ebf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:12.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.233+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0036070 con 0x7f92900039b0 2024-04-25T08:43:12.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.233+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a0031400 con 0x7f92900039b0 2024-04-25T08:43:12.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.233+0000 7f929bfff640 1 -- 172.21.15.172:0/2222185991 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0009690 con 0x7f92900039b0 2024-04-25T08:43:12.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.233+0000 7f92ab422640 1 -- 172.21.15.172:0/2222185991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 msgr2=0x7f9290003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.233+0000 7f92ab422640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f9290003dd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009ac0 tx=0x7f9290005830 comp rx=0 tx=0).stop 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.233+0000 7f92ab422640 1 -- 172.21.15.172:0/2222185991 shutdown_connections 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.233+0000 7f92ab422640 1 --2- 172.21.15.172:0/2222185991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f9290003dd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.233+0000 7f92ab422640 1 -- 172.21.15.172:0/2222185991 >> 172.21.15.172:0/2222185991 conn(0x7f92a40b5af0 msgr2=0x7f92a40b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.233+0000 7f92ab422640 1 -- 172.21.15.172:0/2222185991 shutdown_connections 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.233+0000 7f92ab422640 1 -- 172.21.15.172:0/2222185991 wait complete. 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.234+0000 7f92ab422640 1 Processor -- start 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.234+0000 7f92ab422640 1 -- start start 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92ab422640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f92a4147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92ab422640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92a4159fd0 0x7f92a415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92ab422640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92a409b4e0 0x7f92a409b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92ab422640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4070280 con 0x7f92900039b0 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92ab422640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a406e940 con 0x7f92a4159fd0 2024-04-25T08:43:12.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92ab422640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4070400 con 0x7f92a409b4e0 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92a91be640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f92a4147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92a91be640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f92a4147110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47944/0 (socket says 172.21.15.172:47944) 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92a91be640 1 -- 172.21.15.172:0/323821188 learned_addr learned my addr 172.21.15.172:0/323821188 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92a91be640 1 -- 172.21.15.172:0/323821188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92a409b4e0 msgr2=0x7f92a409b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.235+0000 7f92a91be640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92a409b4e0 0x7f92a409b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.236+0000 7f92a89bd640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92a4159fd0 0x7f92a415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.236+0000 7f92a91be640 1 -- 172.21.15.172:0/323821188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92a4159fd0 msgr2=0x7f92a415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.236+0000 7f92a91be640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92a4159fd0 0x7f92a415a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.236+0000 7f92a91be640 1 -- 172.21.15.172:0/323821188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a415ad00 con 0x7f92900039b0 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.236+0000 7f92a91be640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f92a4147110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009be0 tx=0x7f92a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.236+0000 7f9299ffb640 1 -- 172.21.15.172:0/323821188 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a003f020 con 0x7f92900039b0 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.236+0000 7f9299ffb640 1 -- 172.21.15.172:0/323821188 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a0037040 con 0x7f92900039b0 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.236+0000 7f92ab422640 1 -- 172.21.15.172:0/323821188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a415afe0 con 0x7f92900039b0 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.236+0000 7f9299ffb640 1 -- 172.21.15.172:0/323821188 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0036070 con 0x7f92900039b0 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.236+0000 7f92ab422640 1 -- 172.21.15.172:0/323821188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a415b5a0 con 0x7f92900039b0 2024-04-25T08:43:12.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.237+0000 7f92ab422640 1 -- 172.21.15.172:0/323821188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a4073a00 con 0x7f92900039b0 2024-04-25T08:43:12.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.237+0000 7f9299ffb640 1 -- 172.21.15.172:0/323821188 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f92a0042020 con 0x7f92900039b0 2024-04-25T08:43:12.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.238+0000 7f9299ffb640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f928806b4d0 0x7f928806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.238+0000 7f9299ffb640 1 -- 172.21.15.172:0/323821188 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f92a00aa280 con 0x7f92900039b0 2024-04-25T08:43:12.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.238+0000 7f92a89bd640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f928806b4d0 0x7f928806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.238+0000 7f92a89bd640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f928806b4d0 0x7f928806d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f92a4153d10 tx=0x7f9294009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:12.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.242+0000 7f9299ffb640 1 -- 172.21.15.172:0/323821188 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f92a0049070 con 0x7f92900039b0 2024-04-25T08:43:12.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.411+0000 7f92ab422640 1 -- 172.21.15.172:0/323821188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92a41574f0 con 0x7f92900039b0 2024-04-25T08:43:12.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.412+0000 7f9299ffb640 1 -- 172.21.15.172:0/323821188 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92a0078d00 con 0x7f92900039b0 2024-04-25T08:43:12.404 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 -- 172.21.15.172:0/323821188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f928806b4d0 msgr2=0x7f928806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f928806b4d0 0x7f928806d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f92a4153d10 tx=0x7f9294009040 comp rx=0 tx=0).stop 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 -- 172.21.15.172:0/323821188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 msgr2=0x7f92a4147110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f92a4147110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009be0 tx=0x7f92a0004730 comp rx=0 tx=0).stop 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 -- 172.21.15.172:0/323821188 shutdown_connections 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f928806b4d0 0x7f928806d990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f92a4159fd0 0x7f92a415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f92a409b4e0 0x7f92a409b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 --2- 172.21.15.172:0/323821188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92900039b0 0x7f92a4147110 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 -- 172.21.15.172:0/323821188 >> 172.21.15.172:0/323821188 conn(0x7f92a40b5af0 msgr2=0x7f92a40addf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 -- 172.21.15.172:0/323821188 shutdown_connections 2024-04-25T08:43:12.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.414+0000 7f92ab422640 1 -- 172.21.15.172:0/323821188 wait complete. 2024-04-25T08:43:12.417 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:43:12.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.546+0000 7f29a415c640 1 Processor -- start 2024-04-25T08:43:12.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.546+0000 7f29a415c640 1 -- start start 2024-04-25T08:43:12.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a415c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f299c15bb20 0x7f299c0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a415c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 0x7f299c0cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a415c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f299c0cdcd0 0x7f299c0cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a415c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c0d0450 con 0x7f299c0cdcd0 2024-04-25T08:43:12.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a415c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c0cb190 con 0x7f299c15bb20 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a415c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0cb470 con 0x7f299c0ccdd0 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a26f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f299c0cdcd0 0x7f299c0cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a26f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f299c0cdcd0 0x7f299c0cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47952/0 (socket says 172.21.15.172:47952) 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a26f9640 1 -- 172.21.15.172:0/1080991717 learned_addr learned my addr 172.21.15.172:0/1080991717 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a16f7640 1 --2- 172.21.15.172:0/1080991717 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 0x7f299c0cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a1ef8640 1 --2- 172.21.15.172:0/1080991717 >> v2:172.21.15.186:3300/0 conn(0x7f299c15bb20 0x7f299c0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a26f9640 1 -- 172.21.15.172:0/1080991717 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 msgr2=0x7f299c0cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a26f9640 1 --2- 172.21.15.172:0/1080991717 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 0x7f299c0cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a26f9640 1 -- 172.21.15.172:0/1080991717 >> v2:172.21.15.186:3300/0 conn(0x7f299c15bb20 msgr2=0x7f299c0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a26f9640 1 --2- 172.21.15.172:0/1080991717 >> v2:172.21.15.186:3300/0 conn(0x7f299c15bb20 0x7f299c0cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a26f9640 1 -- 172.21.15.172:0/1080991717 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0cb750 con 0x7f299c0cdcd0 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a16f7640 1 --2- 172.21.15.172:0/1080991717 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 0x7f299c0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.547+0000 7f29a1ef8640 1 --2- 172.21.15.172:0/1080991717 >> v2:172.21.15.186:3300/0 conn(0x7f299c15bb20 0x7f299c0cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.548+0000 7f29a26f9640 1 --2- 172.21.15.172:0/1080991717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c0cdcd0 0x7f299c0cff10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f299c0d1800 tx=0x7f299402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d7e9f1db21cf7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:12.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.548+0000 7f29a0ef6640 1 -- 172.21.15.172:0/1080991717 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994036070 con 0x7f299c0cdcd0 2024-04-25T08:43:12.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.548+0000 7f29a0ef6640 1 -- 172.21.15.172:0/1080991717 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2994031600 con 0x7f299c0cdcd0 2024-04-25T08:43:12.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.548+0000 7f29a0ef6640 1 -- 172.21.15.172:0/1080991717 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29940319d0 con 0x7f299c0cdcd0 2024-04-25T08:43:12.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.549+0000 7f29a415c640 1 -- 172.21.15.172:0/1080991717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c0cdcd0 msgr2=0x7f299c0cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.549+0000 7f29a415c640 1 --2- 172.21.15.172:0/1080991717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c0cdcd0 0x7f299c0cff10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f299c0d1800 tx=0x7f299402a610 comp rx=0 tx=0).stop 2024-04-25T08:43:12.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.549+0000 7f29a415c640 1 -- 172.21.15.172:0/1080991717 shutdown_connections 2024-04-25T08:43:12.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.549+0000 7f29a415c640 1 --2- 172.21.15.172:0/1080991717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c0cdcd0 0x7f299c0cff10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.549+0000 7f29a415c640 1 --2- 172.21.15.172:0/1080991717 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 0x7f299c0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.549+0000 7f29a415c640 1 --2- 172.21.15.172:0/1080991717 >> v2:172.21.15.186:3300/0 conn(0x7f299c15bb20 0x7f299c0cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.549+0000 7f29a415c640 1 -- 172.21.15.172:0/1080991717 >> 172.21.15.172:0/1080991717 conn(0x7f299c0b2390 msgr2=0x7f299c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.549+0000 7f29a415c640 1 -- 172.21.15.172:0/1080991717 shutdown_connections 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.549+0000 7f29a415c640 1 -- 172.21.15.172:0/1080991717 wait complete. 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.550+0000 7f29a415c640 1 Processor -- start 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.550+0000 7f29a415c640 1 -- start start 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a415c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 0x7f299c0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a415c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f299c0cdcd0 0x7f299c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a415c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c15bb20 0x7f299c0b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a415c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0cc770 con 0x7f299c15bb20 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a415c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0cbd10 con 0x7f299c0cdcd0 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a415c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c15bf00 con 0x7f299c0ccdd0 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a26f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c15bb20 0x7f299c0b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a26f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c15bb20 0x7f299c0b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47964/0 (socket says 172.21.15.172:47964) 2024-04-25T08:43:12.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a26f9640 1 -- 172.21.15.172:0/601010555 learned_addr learned my addr 172.21.15.172:0/601010555 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a1ef8640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 0x7f299c0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a16f7640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f299c0cdcd0 0x7f299c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a26f9640 1 -- 172.21.15.172:0/601010555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 msgr2=0x7f299c0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a26f9640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 0x7f299c0ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a26f9640 1 -- 172.21.15.172:0/601010555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f299c0cdcd0 msgr2=0x7f299c0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a26f9640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f299c0cdcd0 0x7f299c0b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a26f9640 1 -- 172.21.15.172:0/601010555 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0b6540 con 0x7f299c15bb20 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29a26f9640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c15bb20 0x7f299c0b0ce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2994009f40 tx=0x7f2994004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29927fc640 1 -- 172.21.15.172:0/601010555 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994036050 con 0x7f299c15bb20 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.551+0000 7f29927fc640 1 -- 172.21.15.172:0/601010555 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2994042070 con 0x7f299c15bb20 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.552+0000 7f29a415c640 1 -- 172.21.15.172:0/601010555 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c0c7960 con 0x7f299c15bb20 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.552+0000 7f29927fc640 1 -- 172.21.15.172:0/601010555 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994009510 con 0x7f299c15bb20 2024-04-25T08:43:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.552+0000 7f29a415c640 1 -- 172.21.15.172:0/601010555 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c0b5f80 con 0x7f299c15bb20 2024-04-25T08:43:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.553+0000 7f29a415c640 1 -- 172.21.15.172:0/601010555 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c0c7b30 con 0x7f299c15bb20 2024-04-25T08:43:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.553+0000 7f29927fc640 1 -- 172.21.15.172:0/601010555 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2994007bd0 con 0x7f299c15bb20 2024-04-25T08:43:12.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.553+0000 7f29927fc640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298006b500 0x7f298006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.554+0000 7f29927fc640 1 -- 172.21.15.172:0/601010555 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f29940ab3f0 con 0x7f299c15bb20 2024-04-25T08:43:12.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.554+0000 7f29a1ef8640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298006b500 0x7f298006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.554+0000 7f29a1ef8640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298006b500 0x7f298006d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f299c070400 tx=0x7f2998008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:12.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.558+0000 7f29927fc640 1 -- 172.21.15.172:0/601010555 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2994079f00 con 0x7f299c15bb20 2024-04-25T08:43:12.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.732+0000 7f29a415c640 1 -- 172.21.15.172:0/601010555 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f299c073a00 con 0x7f299c15bb20 2024-04-25T08:43:12.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.732+0000 7f29927fc640 1 -- 172.21.15.172:0/601010555 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2994079800 con 0x7f299c15bb20 2024-04-25T08:43:12.725 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:12.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 -- 172.21.15.172:0/601010555 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298006b500 msgr2=0x7f298006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298006b500 0x7f298006d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f299c070400 tx=0x7f2998008040 comp rx=0 tx=0).stop 2024-04-25T08:43:12.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 -- 172.21.15.172:0/601010555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c15bb20 msgr2=0x7f299c0b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c15bb20 0x7f299c0b0ce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2994009f40 tx=0x7f2994004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:12.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 -- 172.21.15.172:0/601010555 shutdown_connections 2024-04-25T08:43:12.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298006b500 0x7f298006d9c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f299c0cdcd0 0x7f299c0b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f299c15bb20 0x7f299c0b0ce0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 --2- 172.21.15.172:0/601010555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f299c0ccdd0 0x7f299c0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 -- 172.21.15.172:0/601010555 >> 172.21.15.172:0/601010555 conn(0x7f299c0b2390 msgr2=0x7f299c0cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:12.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 -- 172.21.15.172:0/601010555 shutdown_connections 2024-04-25T08:43:12.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.735+0000 7f29a415c640 1 -- 172.21.15.172:0/601010555 wait complete. 2024-04-25T08:43:12.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:43:12.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.847+0000 7ff0f80bc640 1 Processor -- start 2024-04-25T08:43:12.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.847+0000 7ff0f80bc640 1 -- start start 2024-04-25T08:43:12.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f80bc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff0f015b7d0 0x7ff0f00cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f80bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0f00b5620 0x7ff0f00b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f80bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0f006c2d0 0x7ff0f006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f80bc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f006cc80 con 0x7ff0f00b5620 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f80bc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f006cf50 con 0x7ff0f015b7d0 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f80bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f00ce530 con 0x7ff0f006c2d0 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f5657640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0f00b5620 0x7ff0f00b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f5657640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0f00b5620 0x7ff0f00b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47970/0 (socket says 172.21.15.172:47970) 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f5657640 1 -- 172.21.15.172:0/687374809 learned_addr learned my addr 172.21.15.172:0/687374809 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f5e58640 1 --2- 172.21.15.172:0/687374809 >> v2:172.21.15.186:3300/0 conn(0x7ff0f015b7d0 0x7ff0f00cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f6659640 1 --2- 172.21.15.172:0/687374809 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0f006c2d0 0x7ff0f006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f5657640 1 -- 172.21.15.172:0/687374809 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0f006c2d0 msgr2=0x7ff0f006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f5657640 1 --2- 172.21.15.172:0/687374809 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0f006c2d0 0x7ff0f006c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f5657640 1 -- 172.21.15.172:0/687374809 >> v2:172.21.15.186:3300/0 conn(0x7ff0f015b7d0 msgr2=0x7ff0f00cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f5657640 1 --2- 172.21.15.172:0/687374809 >> v2:172.21.15.186:3300/0 conn(0x7ff0f015b7d0 0x7ff0f00cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f5657640 1 -- 172.21.15.172:0/687374809 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f00ce810 con 0x7ff0f00b5620 2024-04-25T08:43:12.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.848+0000 7ff0f5e58640 1 --2- 172.21.15.172:0/687374809 >> v2:172.21.15.186:3300/0 conn(0x7ff0f015b7d0 0x7ff0f00cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:12.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.849+0000 7ff0f5657640 1 --2- 172.21.15.172:0/687374809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f00b5620 0x7ff0f00b5ab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0f008c0d0 tx=0x7ff0e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e1506d9f4b2a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:12.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.849+0000 7ff0f4e56640 1 -- 172.21.15.172:0/687374809 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0037070 con 0x7ff0f00b5620 2024-04-25T08:43:12.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.849+0000 7ff0f4e56640 1 -- 172.21.15.172:0/687374809 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e0032440 con 0x7ff0f00b5620 2024-04-25T08:43:12.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.849+0000 7ff0f4e56640 1 -- 172.21.15.172:0/687374809 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0032810 con 0x7ff0f00b5620 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.850+0000 7ff0f80bc640 1 -- 172.21.15.172:0/687374809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f00b5620 msgr2=0x7ff0f00b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.850+0000 7ff0f80bc640 1 --2- 172.21.15.172:0/687374809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f00b5620 0x7ff0f00b5ab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0f008c0d0 tx=0x7ff0e002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.850+0000 7ff0f80bc640 1 -- 172.21.15.172:0/687374809 shutdown_connections 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.850+0000 7ff0f80bc640 1 --2- 172.21.15.172:0/687374809 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0f006c2d0 0x7ff0f006c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.850+0000 7ff0f80bc640 1 --2- 172.21.15.172:0/687374809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f00b5620 0x7ff0f00b5ab0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.850+0000 7ff0f80bc640 1 --2- 172.21.15.172:0/687374809 >> v2:172.21.15.186:3300/0 conn(0x7ff0f015b7d0 0x7ff0f00cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.850+0000 7ff0f80bc640 1 -- 172.21.15.172:0/687374809 >> 172.21.15.172:0/687374809 conn(0x7ff0f00d0800 msgr2=0x7ff0f00d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.850+0000 7ff0f80bc640 1 -- 172.21.15.172:0/687374809 shutdown_connections 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.850+0000 7ff0f80bc640 1 -- 172.21.15.172:0/687374809 wait complete. 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.851+0000 7ff0f80bc640 1 Processor -- start 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.851+0000 7ff0f80bc640 1 -- start start 2024-04-25T08:43:12.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f80bc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0f006c2d0 0x7ff0f01522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f80bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0f00b5620 0x7ff0f00cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f80bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f015b7d0 0x7ff0f01f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f80bc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f00cf550 con 0x7ff0f015b7d0 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f80bc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f006d230 con 0x7ff0f006c2d0 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f80bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f00cf6d0 con 0x7ff0f00b5620 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f6659640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f015b7d0 0x7ff0f01f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f6659640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f015b7d0 0x7ff0f01f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47984/0 (socket says 172.21.15.172:47984) 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f6659640 1 -- 172.21.15.172:0/2130546453 learned_addr learned my addr 172.21.15.172:0/2130546453 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f5e58640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0f006c2d0 0x7ff0f01522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f5657640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0f00b5620 0x7ff0f00cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f6659640 1 -- 172.21.15.172:0/2130546453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0f00b5620 msgr2=0x7ff0f00cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f6659640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0f00b5620 0x7ff0f00cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f6659640 1 -- 172.21.15.172:0/2130546453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0f006c2d0 msgr2=0x7ff0f01522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f6659640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0f006c2d0 0x7ff0f01522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:12.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.852+0000 7ff0f6659640 1 -- 172.21.15.172:0/2130546453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f00c8350 con 0x7ff0f015b7d0 2024-04-25T08:43:12.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.853+0000 7ff0f6659640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f015b7d0 0x7ff0f01f33c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8007d10 tx=0x7ff0e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:12.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.853+0000 7ff0e67fc640 1 -- 172.21.15.172:0/2130546453 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8014420 con 0x7ff0f015b7d0 2024-04-25T08:43:12.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.853+0000 7ff0e67fc640 1 -- 172.21.15.172:0/2130546453 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e8019070 con 0x7ff0f015b7d0 2024-04-25T08:43:12.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.853+0000 7ff0f80bc640 1 -- 172.21.15.172:0/2130546453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f00c8630 con 0x7ff0f015b7d0 2024-04-25T08:43:12.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.853+0000 7ff0e67fc640 1 -- 172.21.15.172:0/2130546453 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8014820 con 0x7ff0f015b7d0 2024-04-25T08:43:12.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.853+0000 7ff0f80bc640 1 -- 172.21.15.172:0/2130546453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f00c8bf0 con 0x7ff0f015b7d0 2024-04-25T08:43:12.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.854+0000 7ff0f80bc640 1 -- 172.21.15.172:0/2130546453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f0068410 con 0x7ff0f015b7d0 2024-04-25T08:43:12.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.854+0000 7ff0e67fc640 1 -- 172.21.15.172:0/2130546453 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff0e80149c0 con 0x7ff0f015b7d0 2024-04-25T08:43:12.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.854+0000 7ff0e67fc640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff0d406b4d0 0x7ff0d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:12.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.855+0000 7ff0e67fc640 1 -- 172.21.15.172:0/2130546453 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff0e808ac50 con 0x7ff0f015b7d0 2024-04-25T08:43:12.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.855+0000 7ff0f5e58640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff0d406b4d0 0x7ff0d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:12.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.855+0000 7ff0f5e58640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff0d406b4d0 0x7ff0d406d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0155eb0 tx=0x7ff0ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:12.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:12.859+0000 7ff0e67fc640 1 -- 172.21.15.172:0/2130546453 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0f0068410 con 0x7ff0f015b7d0 2024-04-25T08:43:13.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.029+0000 7ff0f80bc640 1 -- 172.21.15.172:0/2130546453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0f0073a00 con 0x7ff0f015b7d0 2024-04-25T08:43:13.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.029+0000 7ff0e67fc640 1 -- 172.21.15.172:0/2130546453 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff0e8090020 con 0x7ff0f015b7d0 2024-04-25T08:43:13.021 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:43:13.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 -- 172.21.15.172:0/2130546453 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff0d406b4d0 msgr2=0x7ff0d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff0d406b4d0 0x7ff0d406d990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0155eb0 tx=0x7ff0ec008040 comp rx=0 tx=0).stop 2024-04-25T08:43:13.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 -- 172.21.15.172:0/2130546453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f015b7d0 msgr2=0x7ff0f01f33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f015b7d0 0x7ff0f01f33c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8007d10 tx=0x7ff0e800e4b0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 -- 172.21.15.172:0/2130546453 shutdown_connections 2024-04-25T08:43:13.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff0d406b4d0 0x7ff0d406d990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f015b7d0 0x7ff0f01f33c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0f00b5620 0x7ff0f00cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 --2- 172.21.15.172:0/2130546453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0f006c2d0 0x7ff0f01522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 -- 172.21.15.172:0/2130546453 >> 172.21.15.172:0/2130546453 conn(0x7ff0f00d0800 msgr2=0x7ff0f00b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:13.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 -- 172.21.15.172:0/2130546453 shutdown_connections 2024-04-25T08:43:13.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.031+0000 7ff0f80bc640 1 -- 172.21.15.172:0/2130546453 wait complete. 2024-04-25T08:43:13.034 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:43:13.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.142+0000 7fe259f9e640 1 Processor -- start 2024-04-25T08:43:13.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.142+0000 7fe259f9e640 1 -- start start 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe259f9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2541446d0 0x7fe2540b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe259f9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe254144d50 0x7fe2540b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe259f9e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540cccc0 con 0x7fe2541452a0 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe259f9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2540b2b20 con 0x7fe254144d50 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe259f9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25406d400 con 0x7fe2541446d0 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe252ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe254144d50 0x7fe2540b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe253fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe2541452a0 0x7fe2540cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49654/0 (socket says 172.21.15.172:49654) 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe253fff640 1 -- 172.21.15.172:0/4188135499 learned_addr learned my addr 172.21.15.172:0/4188135499 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe252ffd640 1 -- 172.21.15.172:0/4188135499 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2541446d0 msgr2=0x7fe2540b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe2537fe640 1 --2- 172.21.15.172:0/4188135499 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2541446d0 0x7fe2540b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe2527fc640 1 -- 172.21.15.172:0/4188135499 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413786959 0 0) 0x7fe2540cccc0 con 0x7fe2541452a0 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.143+0000 7fe252ffd640 1 --2- 172.21.15.172:0/4188135499 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2541446d0 0x7fe2540b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.144+0000 7fe252ffd640 1 -- 172.21.15.172:0/4188135499 >> v1:172.21.15.172:6789/0 conn(0x7fe2541452a0 legacy=0x7fe2540cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.144+0000 7fe252ffd640 1 -- 172.21.15.172:0/4188135499 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540cc140 con 0x7fe254144d50 2024-04-25T08:43:13.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.144+0000 7fe2537fe640 1 --2- 172.21.15.172:0/4188135499 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2541446d0 0x7fe2540b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:13.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.144+0000 7fe252ffd640 1 --2- 172.21.15.172:0/4188135499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 0x7fe2540b4460 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe2480097a0 tx=0x7fe24802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567af5556b170a85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:13.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.144+0000 7fe2527fc640 1 -- 172.21.15.172:0/4188135499 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248037070 con 0x7fe254144d50 2024-04-25T08:43:13.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.144+0000 7fe2527fc640 1 -- 172.21.15.172:0/4188135499 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe248032440 con 0x7fe254144d50 2024-04-25T08:43:13.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.144+0000 7fe2527fc640 1 -- 172.21.15.172:0/4188135499 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248032810 con 0x7fe254144d50 2024-04-25T08:43:13.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.145+0000 7fe259f9e640 1 -- 172.21.15.172:0/4188135499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 msgr2=0x7fe2540b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.145+0000 7fe259f9e640 1 --2- 172.21.15.172:0/4188135499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 0x7fe2540b4460 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe2480097a0 tx=0x7fe24802a180 comp rx=0 tx=0).stop 2024-04-25T08:43:13.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.145+0000 7fe259f9e640 1 -- 172.21.15.172:0/4188135499 shutdown_connections 2024-04-25T08:43:13.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.145+0000 7fe259f9e640 1 --2- 172.21.15.172:0/4188135499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 0x7fe2540b4460 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.145+0000 7fe259f9e640 1 --2- 172.21.15.172:0/4188135499 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2541446d0 0x7fe2540b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.145+0000 7fe259f9e640 1 -- 172.21.15.172:0/4188135499 >> 172.21.15.172:0/4188135499 conn(0x7fe25406abe0 msgr2=0x7fe25406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.145+0000 7fe259f9e640 1 -- 172.21.15.172:0/4188135499 shutdown_connections 2024-04-25T08:43:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.145+0000 7fe259f9e640 1 -- 172.21.15.172:0/4188135499 wait complete. 2024-04-25T08:43:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.146+0000 7fe259f9e640 1 Processor -- start 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.146+0000 7fe259f9e640 1 -- start start 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe259f9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2541446d0 0x7fe25413ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe259f9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 0x7fe2540ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe259f9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2541452a0 0x7fe2540ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe259f9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540cc700 con 0x7fe254144d50 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe259f9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540b49a0 con 0x7fe2541446d0 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe259f9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540cc9e0 con 0x7fe2541452a0 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe252ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 0x7fe2540ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe252ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 0x7fe2540ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48012/0 (socket says 172.21.15.172:48012) 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe252ffd640 1 -- 172.21.15.172:0/2305342343 learned_addr learned my addr 172.21.15.172:0/2305342343 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe252ffd640 1 -- 172.21.15.172:0/2305342343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2541452a0 msgr2=0x7fe2540ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe252ffd640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2541452a0 0x7fe2540ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe252ffd640 1 -- 172.21.15.172:0/2305342343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2541446d0 msgr2=0x7fe25413ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe252ffd640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2541446d0 0x7fe25413ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.147+0000 7fe252ffd640 1 -- 172.21.15.172:0/2305342343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25413f680 con 0x7fe254144d50 2024-04-25T08:43:13.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.148+0000 7fe252ffd640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 0x7fe2540ade00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe2480097a0 tx=0x7fe2480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:13.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.148+0000 7fe23bfff640 1 -- 172.21.15.172:0/2305342343 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248037050 con 0x7fe254144d50 2024-04-25T08:43:13.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.148+0000 7fe23bfff640 1 -- 172.21.15.172:0/2305342343 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe248038040 con 0x7fe254144d50 2024-04-25T08:43:13.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.148+0000 7fe259f9e640 1 -- 172.21.15.172:0/2305342343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25413f960 con 0x7fe254144d50 2024-04-25T08:43:13.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.148+0000 7fe23bfff640 1 -- 172.21.15.172:0/2305342343 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248004490 con 0x7fe254144d50 2024-04-25T08:43:13.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.148+0000 7fe259f9e640 1 -- 172.21.15.172:0/2305342343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25413ff20 con 0x7fe254144d50 2024-04-25T08:43:13.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.149+0000 7fe259f9e640 1 -- 172.21.15.172:0/2305342343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe254073a00 con 0x7fe254144d50 2024-04-25T08:43:13.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.149+0000 7fe23bfff640 1 -- 172.21.15.172:0/2305342343 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe248030980 con 0x7fe254144d50 2024-04-25T08:43:13.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.149+0000 7fe23bfff640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe24006b4d0 0x7fe24006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.150+0000 7fe23bfff640 1 -- 172.21.15.172:0/2305342343 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe2480ab160 con 0x7fe254144d50 2024-04-25T08:43:13.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.150+0000 7fe2537fe640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe24006b4d0 0x7fe24006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.150+0000 7fe2537fe640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe24006b4d0 0x7fe24006d990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe244006fd0 tx=0x7fe244008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:13.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.154+0000 7fe23bfff640 1 -- 172.21.15.172:0/2305342343 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe248079d00 con 0x7fe254144d50 2024-04-25T08:43:13.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.324+0000 7fe259f9e640 1 -- 172.21.15.172:0/2305342343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe2540b2520 con 0x7fe254144d50 2024-04-25T08:43:13.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.325+0000 7fe23bfff640 1 -- 172.21.15.172:0/2305342343 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe248079600 con 0x7fe254144d50 2024-04-25T08:43:13.317 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:13.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 -- 172.21.15.172:0/2305342343 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe24006b4d0 msgr2=0x7fe24006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe24006b4d0 0x7fe24006d990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe244006fd0 tx=0x7fe244008040 comp rx=0 tx=0).stop 2024-04-25T08:43:13.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 -- 172.21.15.172:0/2305342343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 msgr2=0x7fe2540ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 0x7fe2540ade00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe2480097a0 tx=0x7fe2480046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 -- 172.21.15.172:0/2305342343 shutdown_connections 2024-04-25T08:43:13.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe24006b4d0 0x7fe24006d990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2541452a0 0x7fe2540ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe254144d50 0x7fe2540ade00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 --2- 172.21.15.172:0/2305342343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2541446d0 0x7fe25413ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 -- 172.21.15.172:0/2305342343 >> 172.21.15.172:0/2305342343 conn(0x7fe25406abe0 msgr2=0x7fe254143890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:13.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 -- 172.21.15.172:0/2305342343 shutdown_connections 2024-04-25T08:43:13.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.327+0000 7fe259f9e640 1 -- 172.21.15.172:0/2305342343 wait complete. 2024-04-25T08:43:13.330 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-04-25T08:43:13.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.436+0000 7f65f02e1640 1 Processor -- start 2024-04-25T08:43:13.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.436+0000 7f65f02e1640 1 -- start start 2024-04-25T08:43:13.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65f02e1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f65e80721d0 0x7f65e806c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65f02e1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f65e806f550 0x7f65e80b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65f02e1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e806f960 con 0x7f65e815dd80 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65f02e1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e8072d70 con 0x7f65e806f550 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65f02e1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e806db20 con 0x7f65e80721d0 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65ee87e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f65e806f550 0x7f65e80b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65ee07d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f65e815dd80 0x7f65e8071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49670/0 (socket says 172.21.15.172:49670) 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65ee07d640 1 -- 172.21.15.172:0/3011225524 learned_addr learned my addr 172.21.15.172:0/3011225524 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65ed87c640 1 --2- 172.21.15.172:0/3011225524 >> v2:172.21.15.186:3300/0 conn(0x7f65e80721d0 0x7f65e806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65ee87e640 1 -- 172.21.15.172:0/3011225524 >> v2:172.21.15.186:3300/0 conn(0x7f65e80721d0 msgr2=0x7f65e806c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65ee87e640 1 --2- 172.21.15.172:0/3011225524 >> v2:172.21.15.186:3300/0 conn(0x7f65e80721d0 0x7f65e806c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65ee87e640 1 -- 172.21.15.172:0/3011225524 >> v1:172.21.15.172:6789/0 conn(0x7f65e815dd80 legacy=0x7f65e8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65ee87e640 1 -- 172.21.15.172:0/3011225524 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e806de00 con 0x7f65e806f550 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65ed07b640 1 -- 172.21.15.172:0/3011225524 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659787035 0 0) 0x7f65e806f960 con 0x7f65e815dd80 2024-04-25T08:43:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.437+0000 7f65ed87c640 1 --2- 172.21.15.172:0/3011225524 >> v2:172.21.15.186:3300/0 conn(0x7f65e80721d0 0x7f65e806c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.438+0000 7f65ee87e640 1 --2- 172.21.15.172:0/3011225524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e806f550 0x7f65e80b2ef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f65e806c0c0 tx=0x7f65e002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842727edbcc26640 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.438+0000 7f65ed07b640 1 -- 172.21.15.172:0/3011225524 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0007740 con 0x7f65e806f550 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.438+0000 7f65ed07b640 1 -- 172.21.15.172:0/3011225524 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e00078e0 con 0x7f65e806f550 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.438+0000 7f65ed07b640 1 -- 172.21.15.172:0/3011225524 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0007cb0 con 0x7f65e806f550 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.438+0000 7f65f02e1640 1 -- 172.21.15.172:0/3011225524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e806f550 msgr2=0x7f65e80b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.438+0000 7f65f02e1640 1 --2- 172.21.15.172:0/3011225524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e806f550 0x7f65e80b2ef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f65e806c0c0 tx=0x7f65e002a560 comp rx=0 tx=0).stop 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.438+0000 7f65f02e1640 1 -- 172.21.15.172:0/3011225524 shutdown_connections 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.438+0000 7f65f02e1640 1 --2- 172.21.15.172:0/3011225524 >> v2:172.21.15.186:3300/0 conn(0x7f65e80721d0 0x7f65e806c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.438+0000 7f65f02e1640 1 --2- 172.21.15.172:0/3011225524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e806f550 0x7f65e80b2ef0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.438+0000 7f65f02e1640 1 -- 172.21.15.172:0/3011225524 >> 172.21.15.172:0/3011225524 conn(0x7f65e80af670 msgr2=0x7f65e80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.439+0000 7f65f02e1640 1 -- 172.21.15.172:0/3011225524 shutdown_connections 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.439+0000 7f65f02e1640 1 -- 172.21.15.172:0/3011225524 wait complete. 2024-04-25T08:43:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.440+0000 7f65f02e1640 1 Processor -- start 2024-04-25T08:43:13.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.440+0000 7f65f02e1640 1 -- start start 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.440+0000 7f65f02e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65e80721d0 0x7f65e8145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.440+0000 7f65f02e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e815dd80 0x7f65e81f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.440+0000 7f65f02e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e80b38e0 0x7f65e80b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.440+0000 7f65f02e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e80b3430 con 0x7f65e80b38e0 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.440+0000 7f65f02e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e806ba70 con 0x7f65e815dd80 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.440+0000 7f65f02e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e80b35b0 con 0x7f65e80721d0 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.440+0000 7f65ee87e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e80b38e0 0x7f65e80b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.440+0000 7f65ee87e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e80b38e0 0x7f65e80b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48030/0 (socket says 172.21.15.172:48030) 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65ee87e640 1 -- 172.21.15.172:0/3763931350 learned_addr learned my addr 172.21.15.172:0/3763931350 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65ed87c640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e815dd80 0x7f65e81f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65ee07d640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65e80721d0 0x7f65e8145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65ee87e640 1 -- 172.21.15.172:0/3763931350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65e80721d0 msgr2=0x7f65e8145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65ee87e640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65e80721d0 0x7f65e8145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65ee87e640 1 -- 172.21.15.172:0/3763931350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e815dd80 msgr2=0x7f65e81f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65ee87e640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e815dd80 0x7f65e81f3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65ee87e640 1 -- 172.21.15.172:0/3763931350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e81f4290 con 0x7f65e80b38e0 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65ee87e640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e80b38e0 0x7f65e80b3d60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009e50 tx=0x7f65e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65deffd640 1 -- 172.21.15.172:0/3763931350 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0040070 con 0x7f65e80b38e0 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65deffd640 1 -- 172.21.15.172:0/3763931350 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0031bf0 con 0x7f65e80b38e0 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65f02e1640 1 -- 172.21.15.172:0/3763931350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e8155cd0 con 0x7f65e80b38e0 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65deffd640 1 -- 172.21.15.172:0/3763931350 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0009450 con 0x7f65e80b38e0 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.441+0000 7f65f02e1640 1 -- 172.21.15.172:0/3763931350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e8156290 con 0x7f65e80b38e0 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.442+0000 7f65f02e1640 1 -- 172.21.15.172:0/3763931350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e8073990 con 0x7f65e80b38e0 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.442+0000 7f65deffd640 1 -- 172.21.15.172:0/3763931350 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f65e0039040 con 0x7f65e80b38e0 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.443+0000 7f65deffd640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f65cc06b500 0x7f65cc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.443+0000 7f65deffd640 1 -- 172.21.15.172:0/3763931350 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f65e00abdc0 con 0x7f65e80b38e0 2024-04-25T08:43:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.443+0000 7f65ee07d640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f65cc06b500 0x7f65cc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.443+0000 7f65ee07d640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f65cc06b500 0x7f65cc06d9c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000f60 tx=0x7f65d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:13.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.447+0000 7f65deffd640 1 -- 172.21.15.172:0/3763931350 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f65e81f4290 con 0x7f65e80b38e0 2024-04-25T08:43:13.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.686+0000 7f65f02e1640 1 -- 172.21.15.172:0/3763931350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7f65e80b4e20 con 0x7f65e80b38e0 2024-04-25T08:43:13.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.844+0000 7f65deffd640 1 -- 172.21.15.172:0/3763931350 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v63) v1 ==== 151+0+0 (secure 0 0 0) 0x7f65e0080070 con 0x7f65e80b38e0 2024-04-25T08:43:13.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.847+0000 7f65f02e1640 1 -- 172.21.15.172:0/3763931350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f65cc06b500 msgr2=0x7f65cc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.847+0000 7f65f02e1640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f65cc06b500 0x7f65cc06d9c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65d8000f60 tx=0x7f65d8009040 comp rx=0 tx=0).stop 2024-04-25T08:43:13.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.847+0000 7f65f02e1640 1 -- 172.21.15.172:0/3763931350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e80b38e0 msgr2=0x7f65e80b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.847+0000 7f65f02e1640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e80b38e0 0x7f65e80b3d60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009e50 tx=0x7f65e0004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:13.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.847+0000 7f65f02e1640 1 -- 172.21.15.172:0/3763931350 shutdown_connections 2024-04-25T08:43:13.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.847+0000 7f65f02e1640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f65cc06b500 0x7f65cc06d9c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.847+0000 7f65f02e1640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e815dd80 0x7f65e81f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.847+0000 7f65f02e1640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65e80b38e0 0x7f65e80b3d60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.847+0000 7f65f02e1640 1 --2- 172.21.15.172:0/3763931350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65e80721d0 0x7f65e8145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.848+0000 7f65f02e1640 1 -- 172.21.15.172:0/3763931350 >> 172.21.15.172:0/3763931350 conn(0x7f65e806f550 msgr2=0x7f65e80ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:13.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.848+0000 7f65f02e1640 1 -- 172.21.15.172:0/3763931350 shutdown_connections 2024-04-25T08:43:13.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.848+0000 7f65f02e1640 1 -- 172.21.15.172:0/3763931350 wait complete. 2024-04-25T08:43:13.851 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:43:13.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.960+0000 7f6e0d838640 1 Processor -- start 2024-04-25T08:43:13.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.960+0000 7f6e0d838640 1 -- start start 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e0d838640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6e0806c9e0 0x7f6e080b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e0d838640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0806cf50 con 0x7f6e080b5620 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e0d838640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e080ce530 con 0x7f6e0815b7d0 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e0d838640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e080ce810 con 0x7f6e0806c9e0 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e077fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6e0806c9e0 0x7f6e080b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e067fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6e080b5620 0x7f6e0806c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49672/0 (socket says 172.21.15.172:49672) 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e067fc640 1 -- 172.21.15.172:0/2102288029 learned_addr learned my addr 172.21.15.172:0/2102288029 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e077fe640 1 -- 172.21.15.172:0/2102288029 >> v1:172.21.15.186:6789/0 conn(0x7f6e0815b7d0 legacy=0x7f6e080cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e077fe640 1 -- 172.21.15.172:0/2102288029 >> v1:172.21.15.172:6789/0 conn(0x7f6e080b5620 legacy=0x7f6e0806c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e05ffb640 1 -- 172.21.15.172:0/2102288029 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631593299 0 0) 0x7f6e0806cf50 con 0x7f6e080b5620 2024-04-25T08:43:13.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.961+0000 7f6e077fe640 1 -- 172.21.15.172:0/2102288029 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e080ceaf0 con 0x7f6e0806c9e0 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.962+0000 7f6e077fe640 1 --2- 172.21.15.172:0/2102288029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0806c9e0 0x7f6e080b5ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6e000097a0 tx=0x7f6e0002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d763555e9769763d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.962+0000 7f6e05ffb640 1 -- 172.21.15.172:0/2102288029 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00037070 con 0x7f6e0806c9e0 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.962+0000 7f6e05ffb640 1 -- 172.21.15.172:0/2102288029 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00032440 con 0x7f6e0806c9e0 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.962+0000 7f6e05ffb640 1 -- 172.21.15.172:0/2102288029 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00032810 con 0x7f6e0806c9e0 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.963+0000 7f6e0d838640 1 -- 172.21.15.172:0/2102288029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0806c9e0 msgr2=0x7f6e080b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.963+0000 7f6e0d838640 1 --2- 172.21.15.172:0/2102288029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0806c9e0 0x7f6e080b5ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6e000097a0 tx=0x7f6e0002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.963+0000 7f6e0d838640 1 -- 172.21.15.172:0/2102288029 shutdown_connections 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.963+0000 7f6e0d838640 1 --2- 172.21.15.172:0/2102288029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0806c9e0 0x7f6e080b5ab0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.963+0000 7f6e0d838640 1 -- 172.21.15.172:0/2102288029 >> 172.21.15.172:0/2102288029 conn(0x7f6e080d0800 msgr2=0x7f6e080d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.963+0000 7f6e0d838640 1 -- 172.21.15.172:0/2102288029 shutdown_connections 2024-04-25T08:43:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.963+0000 7f6e0d838640 1 -- 172.21.15.172:0/2102288029 wait complete. 2024-04-25T08:43:13.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.964+0000 7f6e0d838640 1 Processor -- start 2024-04-25T08:43:13.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.964+0000 7f6e0d838640 1 -- start start 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e0d838640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e0806c9e0 0x7f6e08157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e0d838640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e080b5620 0x7f6e08158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e0d838640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0815b7d0 0x7f6e08159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e0d838640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0815bd30 con 0x7f6e0815b7d0 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e0d838640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0815bbb0 con 0x7f6e0806c9e0 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e0d838640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080d1f40 con 0x7f6e080b5620 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e077fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0815b7d0 0x7f6e08159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e077fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0815b7d0 0x7f6e08159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48050/0 (socket says 172.21.15.172:48050) 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e077fe640 1 -- 172.21.15.172:0/4269403039 learned_addr learned my addr 172.21.15.172:0/4269403039 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e06ffd640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e0806c9e0 0x7f6e08157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e067fc640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e080b5620 0x7f6e08158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e077fe640 1 -- 172.21.15.172:0/4269403039 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e080b5620 msgr2=0x7f6e08158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e077fe640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e080b5620 0x7f6e08158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e077fe640 1 -- 172.21.15.172:0/4269403039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e0806c9e0 msgr2=0x7f6e08157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e077fe640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e0806c9e0 0x7f6e08157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e077fe640 1 -- 172.21.15.172:0/4269403039 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e080cd020 con 0x7f6e0815b7d0 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.965+0000 7f6e067fc640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e080b5620 0x7f6e08158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.966+0000 7f6e077fe640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0815b7d0 0x7f6e08159510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6e000097a0 tx=0x7f6e000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.966+0000 7f6deffff640 1 -- 172.21.15.172:0/4269403039 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00037040 con 0x7f6e0815b7d0 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.966+0000 7f6deffff640 1 -- 172.21.15.172:0/4269403039 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e00004230 con 0x7f6e0815b7d0 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.966+0000 7f6e0d838640 1 -- 172.21.15.172:0/4269403039 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e080cd300 con 0x7f6e0815b7d0 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.966+0000 7f6deffff640 1 -- 172.21.15.172:0/4269403039 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00003610 con 0x7f6e0815b7d0 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.966+0000 7f6e0d838640 1 -- 172.21.15.172:0/4269403039 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e080cd8c0 con 0x7f6e0815b7d0 2024-04-25T08:43:13.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.967+0000 7f6e0d838640 1 -- 172.21.15.172:0/4269403039 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e08073a00 con 0x7f6e0815b7d0 2024-04-25T08:43:13.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.967+0000 7f6deffff640 1 -- 172.21.15.172:0/4269403039 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6e000037b0 con 0x7f6e0815b7d0 2024-04-25T08:43:13.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.968+0000 7f6deffff640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 0x7f6df406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:13.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.968+0000 7f6deffff640 1 -- 172.21.15.172:0/4269403039 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6e000ab780 con 0x7f6e0815b7d0 2024-04-25T08:43:13.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.968+0000 7f6e06ffd640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 0x7f6df406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:13.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.968+0000 7f6e06ffd640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 0x7f6df406d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009f20 tx=0x7f6df80094d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:13.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:13.972+0000 7f6deffff640 1 -- 172.21.15.172:0/4269403039 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e0007a3b0 con 0x7f6e0815b7d0 2024-04-25T08:43:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.141+0000 7f6e0d838640 1 -- 172.21.15.172:0/4269403039 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6e0815e650 con 0x7f6e0815b7d0 2024-04-25T08:43:14.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.146+0000 7f6deffff640 1 -- 172.21.15.172:0/4269403039 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6e00079cb0 con 0x7f6e0815b7d0 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 -- 172.21.15.172:0/4269403039 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 msgr2=0x7f6df406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 0x7f6df406d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009f20 tx=0x7f6df80094d0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 -- 172.21.15.172:0/4269403039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0815b7d0 msgr2=0x7f6e08159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0815b7d0 0x7f6e08159510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6e000097a0 tx=0x7f6e000046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 -- 172.21.15.172:0/4269403039 shutdown_connections 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6df406b4d0 0x7f6df406d990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e0815b7d0 0x7f6e08159510 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e080b5620 0x7f6e08158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 --2- 172.21.15.172:0/4269403039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e0806c9e0 0x7f6e08157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 -- 172.21.15.172:0/4269403039 >> 172.21.15.172:0/4269403039 conn(0x7f6e080d0800 msgr2=0x7f6e080cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 -- 172.21.15.172:0/4269403039 shutdown_connections 2024-04-25T08:43:14.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.148+0000 7f6e0d838640 1 -- 172.21.15.172:0/4269403039 wait complete. 2024-04-25T08:43:14.152 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:43:14.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:43:14.187 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:43:14.232 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:43:14.232 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:43:14.233 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:14.248 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:43:14.248 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:14.303 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:43:14.303 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:14.358 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:14.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.503+0000 7f089545d640 1 Processor -- start 2024-04-25T08:43:14.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.503+0000 7f089545d640 1 -- start start 2024-04-25T08:43:14.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.504+0000 7f089545d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f089016aa50 0x7f08900cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.504+0000 7f089545d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089016ae30 con 0x7f0890071d50 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.504+0000 7f089545d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08900cce00 con 0x7f089006ebc0 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.504+0000 7f089545d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08900cd850 con 0x7f089016aa50 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.504+0000 7f088effd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f089016aa50 0x7f08900cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.504+0000 7f0887fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0890071d50 0x7f089006e4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49676/0 (socket says 172.21.15.172:49676) 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.504+0000 7f0887fff640 1 -- 172.21.15.172:0/1331768355 learned_addr learned my addr 172.21.15.172:0/1331768355 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.505+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680100816 0 0) 0x7f089016ae30 con 0x7f0890071d50 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f087c003500 con 0x7f0890071d50 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289451724 0 0) 0x7f08900cce00 con 0x7f089006ebc0 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f089016ae30 con 0x7f089006ebc0 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3817630821 0 0) 0x7f087c003500 con 0x7f0890071d50 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 >> v2:172.21.15.172:3300/0 conn(0x7f089016aa50 msgr2=0x7f08900cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 --2- 172.21.15.172:0/1331768355 >> v2:172.21.15.172:3300/0 conn(0x7f089016aa50 0x7f08900cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 >> v1:172.21.15.186:6789/0 conn(0x7f089006ebc0 legacy=0x7f08900b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08900cf050 con 0x7f0890071d50 2024-04-25T08:43:14.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f0878001690 con 0x7f0890071d50 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088effd640 1 --2- 172.21.15.172:0/1331768355 >> v2:172.21.15.172:3300/0 conn(0x7f089016aa50 0x7f08900cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 >> v1:172.21.15.172:6789/0 conn(0x7f0890071d50 legacy=0x7f089006e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f087c004d40 0x7f087c003890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c003f00 0x7f087c009160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f087c0044b0 0x7f087c009770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900cd850 con 0x7f087c003f00 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c00a050 con 0x7f087c0044b0 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c00a250 con 0x7f087c004d40 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f0887fff640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c003f00 0x7f087c009160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088effd640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f087c004d40 0x7f087c003890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088f7fe640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f087c0044b0 0x7f087c009770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f0887fff640 1 -- 172.21.15.172:0/1331768355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f087c004d40 msgr2=0x7f087c003890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f0887fff640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f087c004d40 0x7f087c003890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f0887fff640 1 -- 172.21.15.172:0/1331768355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f087c0044b0 msgr2=0x7f087c009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f0887fff640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f087c0044b0 0x7f087c009770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f0887fff640 1 -- 172.21.15.172:0/1331768355 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c003500 con 0x7f087c003f00 2024-04-25T08:43:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088effd640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f087c004d40 0x7f087c003890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088f7fe640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f087c0044b0 0x7f087c009770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.545+0000 7f088f7fe640 1 -- 172.21.15.172:0/1331768355 reap_dead start 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.546+0000 7f0887fff640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c003f00 0x7f087c009160 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f089016b000 tx=0x7f087c00afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee66c12f7eab07e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.546+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878007cf0 con 0x7f087c003f00 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.546+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0878005ad0 con 0x7f087c003f00 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.546+0000 7f088e7fc640 1 -- 172.21.15.172:0/1331768355 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878007070 con 0x7f087c003f00 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.547+0000 7f089545d640 1 -- 172.21.15.172:0/1331768355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c003f00 msgr2=0x7f087c009160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.547+0000 7f089545d640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c003f00 0x7f087c009160 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f089016b000 tx=0x7f087c00afc0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.547+0000 7f089545d640 1 -- 172.21.15.172:0/1331768355 shutdown_connections 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.547+0000 7f089545d640 1 --2- 172.21.15.172:0/1331768355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c003f00 0x7f087c009160 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.547+0000 7f089545d640 1 -- 172.21.15.172:0/1331768355 >> 172.21.15.172:0/1331768355 conn(0x7f0890061a20 msgr2=0x7f089006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.547+0000 7f089545d640 1 -- 172.21.15.172:0/1331768355 shutdown_connections 2024-04-25T08:43:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.547+0000 7f089545d640 1 -- 172.21.15.172:0/1331768355 wait complete. 2024-04-25T08:43:14.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.548+0000 7f089545d640 1 Processor -- start 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.548+0000 7f089545d640 1 -- start start 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f089545d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f087c003f00 0x7f08900cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f089545d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0890154a40 0x7f08900cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f089545d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0890203820 0x7f0890203ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f089545d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900cf8f0 con 0x7f0890154a40 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f089545d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900cf610 con 0x7f087c003f00 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f089545d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08900cfe10 con 0x7f0890203820 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f0887fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0890154a40 0x7f08900cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f0887fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0890154a40 0x7f08900cbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48064/0 (socket says 172.21.15.172:48064) 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f0887fff640 1 -- 172.21.15.172:0/1411467658 learned_addr learned my addr 172.21.15.172:0/1411467658 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f088effd640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f087c003f00 0x7f08900cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f088f7fe640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0890203820 0x7f0890203ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f0887fff640 1 -- 172.21.15.172:0/1411467658 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0890203820 msgr2=0x7f0890203ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f0887fff640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0890203820 0x7f0890203ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f0887fff640 1 -- 172.21.15.172:0/1411467658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f087c003f00 msgr2=0x7f08900cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f0887fff640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f087c003f00 0x7f08900cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f0887fff640 1 -- 172.21.15.172:0/1411467658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08900cc5e0 con 0x7f0890154a40 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.549+0000 7f0887fff640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0890154a40 0x7f08900cbd50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f087802ad50 tx=0x7f08780019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.550+0000 7f08877fe640 1 -- 172.21.15.172:0/1411467658 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878041020 con 0x7f0890154a40 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.550+0000 7f08877fe640 1 -- 172.21.15.172:0/1411467658 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0878038040 con 0x7f0890154a40 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.550+0000 7f08877fe640 1 -- 172.21.15.172:0/1411467658 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878007070 con 0x7f0890154a40 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.550+0000 7f089545d640 1 -- 172.21.15.172:0/1411467658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08900c4660 con 0x7f0890154a40 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.550+0000 7f089545d640 1 -- 172.21.15.172:0/1411467658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08900c4c20 con 0x7f0890154a40 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.551+0000 7f089545d640 1 -- 172.21.15.172:0/1411467658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089006bbc0 con 0x7f0890154a40 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.551+0000 7f08877fe640 1 -- 172.21.15.172:0/1411467658 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0878044020 con 0x7f0890154a40 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.551+0000 7f08877fe640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f087006b500 0x7f087006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.552+0000 7f08877fe640 1 -- 172.21.15.172:0/1411467658 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f08780aa840 con 0x7f0890154a40 2024-04-25T08:43:14.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.552+0000 7f088effd640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f087006b500 0x7f087006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.552+0000 7f088effd640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f087006b500 0x7f087006d9c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0880009fd0 tx=0x7f0880008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:14.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.556+0000 7f08877fe640 1 -- 172.21.15.172:0/1411467658 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f08780793f0 con 0x7f0890154a40 2024-04-25T08:43:14.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.727+0000 7f089545d640 1 -- 172.21.15.172:0/1411467658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08900b3ba0 con 0x7f0890154a40 2024-04-25T08:43:14.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.728+0000 7f08877fe640 1 -- 172.21.15.172:0/1411467658 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18905 (secure 0 0 0) 0x7f0878078cf0 con 0x7f0890154a40 2024-04-25T08:43:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:14.721 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:09.821048+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:14.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.730+0000 7f089545d640 1 -- 172.21.15.172:0/1411467658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f087006b500 msgr2=0x7f087006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.730+0000 7f089545d640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f087006b500 0x7f087006d9c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0880009fd0 tx=0x7f0880008040 comp rx=0 tx=0).stop 2024-04-25T08:43:14.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.730+0000 7f089545d640 1 -- 172.21.15.172:0/1411467658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0890154a40 msgr2=0x7f08900cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.730+0000 7f089545d640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0890154a40 0x7f08900cbd50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f087802ad50 tx=0x7f08780019e0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.730+0000 7f089545d640 1 -- 172.21.15.172:0/1411467658 shutdown_connections 2024-04-25T08:43:14.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.730+0000 7f089545d640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f087006b500 0x7f087006d9c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.730+0000 7f089545d640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0890203820 0x7f0890203ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.730+0000 7f089545d640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0890154a40 0x7f08900cbd50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.730+0000 7f089545d640 1 --2- 172.21.15.172:0/1411467658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f087c003f00 0x7f08900cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.730+0000 7f089545d640 1 -- 172.21.15.172:0/1411467658 >> 172.21.15.172:0/1411467658 conn(0x7f0890061a20 msgr2=0x7f089016a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:14.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.731+0000 7f089545d640 1 -- 172.21.15.172:0/1411467658 shutdown_connections 2024-04-25T08:43:14.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.731+0000 7f089545d640 1 -- 172.21.15.172:0/1411467658 wait complete. 2024-04-25T08:43:14.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:43:14.734 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:14.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.842+0000 7f37b9a46640 1 Processor -- start 2024-04-25T08:43:14.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.842+0000 7f37b9a46640 1 -- start start 2024-04-25T08:43:14.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.843+0000 7f37b9a46640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 0x7f37b40b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.843+0000 7f37b9a46640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b40b52f0 con 0x7f37b415fd40 2024-04-25T08:43:14.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.843+0000 7f37b9a46640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b40adaa0 con 0x7f37b40b4f10 2024-04-25T08:43:14.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.843+0000 7f37b9a46640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b406bc40 con 0x7f37b40af5e0 2024-04-25T08:43:14.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.843+0000 7f37b27fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f37b415fd40 0x7f37b40b3910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49682/0 (socket says 172.21.15.172:49682) 2024-04-25T08:43:14.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.843+0000 7f37b27fc640 1 -- 172.21.15.172:0/1711947156 learned_addr learned my addr 172.21.15.172:0/1711947156 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:14.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.844+0000 7f37b37fe640 1 --2- 172.21.15.172:0/1711947156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 0x7f37b40b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.844+0000 7f37b1ffb640 1 -- 172.21.15.172:0/1711947156 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158775280 0 0) 0x7f37b40b52f0 con 0x7f37b415fd40 2024-04-25T08:43:14.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.844+0000 7f37b1ffb640 1 -- 172.21.15.172:0/1711947156 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f379c003520 con 0x7f37b415fd40 2024-04-25T08:43:14.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.844+0000 7f37b1ffb640 1 -- 172.21.15.172:0/1711947156 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186275411 0 0) 0x7f37b40adaa0 con 0x7f37b40b4f10 2024-04-25T08:43:14.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.844+0000 7f37b1ffb640 1 -- 172.21.15.172:0/1711947156 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b40b52f0 con 0x7f37b40b4f10 2024-04-25T08:43:14.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.844+0000 7f37b1ffb640 1 -- 172.21.15.172:0/1711947156 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518247475 0 0) 0x7f379c003520 con 0x7f37b415fd40 2024-04-25T08:43:14.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.844+0000 7f37b37fe640 1 -- 172.21.15.172:0/1711947156 >> v1:172.21.15.186:6789/0 conn(0x7f37b40b4f10 legacy=0x7f37b415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.844+0000 7f37b37fe640 1 -- 172.21.15.172:0/1711947156 >> v1:172.21.15.172:6789/0 conn(0x7f37b415fd40 legacy=0x7f37b40b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.844+0000 7f37b37fe640 1 -- 172.21.15.172:0/1711947156 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40add80 con 0x7f37b40af5e0 2024-04-25T08:43:14.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.845+0000 7f37b37fe640 1 --2- 172.21.15.172:0/1711947156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 0x7f37b40b2e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0097d0 tx=0x7f37ac02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5e5b4ea5ffdb72e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:14.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.845+0000 7f37b1ffb640 1 -- 172.21.15.172:0/1711947156 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac037070 con 0x7f37b40af5e0 2024-04-25T08:43:14.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.845+0000 7f37b1ffb640 1 -- 172.21.15.172:0/1711947156 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac02ac30 con 0x7f37b40af5e0 2024-04-25T08:43:14.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.845+0000 7f37b1ffb640 1 -- 172.21.15.172:0/1711947156 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8001670 con 0x7f37b40af5e0 2024-04-25T08:43:14.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.846+0000 7f37b9a46640 1 -- 172.21.15.172:0/1711947156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 msgr2=0x7f37b40b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.846+0000 7f37b9a46640 1 --2- 172.21.15.172:0/1711947156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 0x7f37b40b2e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0097d0 tx=0x7f37ac02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.846+0000 7f37b9a46640 1 -- 172.21.15.172:0/1711947156 shutdown_connections 2024-04-25T08:43:14.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.846+0000 7f37b9a46640 1 --2- 172.21.15.172:0/1711947156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 0x7f37b40b2e10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.846+0000 7f37b9a46640 1 -- 172.21.15.172:0/1711947156 >> 172.21.15.172:0/1711947156 conn(0x7f37b40cfec0 msgr2=0x7f37b40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:14.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.846+0000 7f37b9a46640 1 -- 172.21.15.172:0/1711947156 shutdown_connections 2024-04-25T08:43:14.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.846+0000 7f37b9a46640 1 -- 172.21.15.172:0/1711947156 wait complete. 2024-04-25T08:43:14.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.847+0000 7f37b9a46640 1 Processor -- start 2024-04-25T08:43:14.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.847+0000 7f37b9a46640 1 -- start start 2024-04-25T08:43:14.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b9a46640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 0x7f37b41592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b9a46640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37b40b4f10 0x7f37b41577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b9a46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415fd40 0x7f37b409caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b9a46640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40ad730 con 0x7f37b415fd40 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b9a46640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b406b8d0 con 0x7f37b40b4f10 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b9a46640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b406c0d0 con 0x7f37b40af5e0 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415fd40 0x7f37b409caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415fd40 0x7f37b409caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48078/0 (socket says 172.21.15.172:48078) 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b37fe640 1 -- 172.21.15.172:0/3365926408 learned_addr learned my addr 172.21.15.172:0/3365926408 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b2ffd640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 0x7f37b41592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b27fc640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37b40b4f10 0x7f37b41577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b37fe640 1 -- 172.21.15.172:0/3365926408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 msgr2=0x7f37b41592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b37fe640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 0x7f37b41592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b37fe640 1 -- 172.21.15.172:0/3365926408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37b40b4f10 msgr2=0x7f37b41577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b37fe640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37b40b4f10 0x7f37b41577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b37fe640 1 -- 172.21.15.172:0/3365926408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4158240 con 0x7f37b415fd40 2024-04-25T08:43:14.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.848+0000 7f37b37fe640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415fd40 0x7f37b409caa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f37ac035040 tx=0x7f37ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:14.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.849+0000 7f379bfff640 1 -- 172.21.15.172:0/3365926408 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac037050 con 0x7f37b415fd40 2024-04-25T08:43:14.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.849+0000 7f379bfff640 1 -- 172.21.15.172:0/3365926408 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac038040 con 0x7f37b415fd40 2024-04-25T08:43:14.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.850+0000 7f37b9a46640 1 -- 172.21.15.172:0/3365926408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b4158520 con 0x7f37b415fd40 2024-04-25T08:43:14.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.850+0000 7f379bfff640 1 -- 172.21.15.172:0/3365926408 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac006e10 con 0x7f37b415fd40 2024-04-25T08:43:14.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.850+0000 7f37b9a46640 1 -- 172.21.15.172:0/3365926408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b4158ae0 con 0x7f37b415fd40 2024-04-25T08:43:14.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.851+0000 7f37b9a46640 1 -- 172.21.15.172:0/3365926408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b4073a00 con 0x7f37b415fd40 2024-04-25T08:43:14.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.851+0000 7f379bfff640 1 -- 172.21.15.172:0/3365926408 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f37ac003610 con 0x7f37b415fd40 2024-04-25T08:43:14.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.851+0000 7f379bfff640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f37a006b4d0 0x7f37a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:14.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.851+0000 7f379bfff640 1 -- 172.21.15.172:0/3365926408 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f37ac0aac40 con 0x7f37b415fd40 2024-04-25T08:43:14.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.851+0000 7f37b2ffd640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f37a006b4d0 0x7f37a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:14.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.852+0000 7f37b2ffd640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f37a006b4d0 0x7f37a006d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37a4001560 tx=0x7f37a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:14.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:14.856+0000 7f379bfff640 1 -- 172.21.15.172:0/3365926408 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f37ac079870 con 0x7f37b415fd40 2024-04-25T08:43:15.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.025+0000 7f37b9a46640 1 -- 172.21.15.172:0/3365926408 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37b40cf580 con 0x7f37b415fd40 2024-04-25T08:43:15.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.025+0000 7f379bfff640 1 -- 172.21.15.172:0/3365926408 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37ac079170 con 0x7f37b415fd40 2024-04-25T08:43:15.017 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 -- 172.21.15.172:0/3365926408 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f37a006b4d0 msgr2=0x7f37a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f37a006b4d0 0x7f37a006d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37a4001560 tx=0x7f37a4009040 comp rx=0 tx=0).stop 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 -- 172.21.15.172:0/3365926408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415fd40 msgr2=0x7f37b409caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415fd40 0x7f37b409caa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f37ac035040 tx=0x7f37ac0046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 -- 172.21.15.172:0/3365926408 shutdown_connections 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f37a006b4d0 0x7f37a006d990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37b40b4f10 0x7f37b41577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415fd40 0x7f37b409caa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 --2- 172.21.15.172:0/3365926408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37b40af5e0 0x7f37b41592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 -- 172.21.15.172:0/3365926408 >> 172.21.15.172:0/3365926408 conn(0x7f37b40cfec0 msgr2=0x7f37b415d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 -- 172.21.15.172:0/3365926408 shutdown_connections 2024-04-25T08:43:15.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.027+0000 7f37b9a46640 1 -- 172.21.15.172:0/3365926408 wait complete. 2024-04-25T08:43:15.030 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:43:15.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.140+0000 7f6e5741c640 1 Processor -- start 2024-04-25T08:43:15.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.140+0000 7f6e5741c640 1 -- start start 2024-04-25T08:43:15.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.140+0000 7f6e5741c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6e500cadb0 0x7f6e500cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e5741c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6e500ccfe0 0x7f6e500cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e5741c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e500afc80 con 0x7f6e5015de80 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e5741c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e500cb240 con 0x7f6e500ccfe0 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e5741c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e500ce4d0 con 0x7f6e500cadb0 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e559b9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6e500ccfe0 0x7f6e500cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e559b9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6e500ccfe0 0x7f6e500cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48084/0 (socket says 172.21.15.172:48084) 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e559b9640 1 -- 172.21.15.172:0/2849052458 learned_addr learned my addr 172.21.15.172:0/2849052458 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e549b7640 1 --2- 172.21.15.172:0/2849052458 >> v2:172.21.15.186:3300/0 conn(0x7f6e500cadb0 0x7f6e500cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e559b9640 1 -- 172.21.15.172:0/2849052458 >> v2:172.21.15.186:3300/0 conn(0x7f6e500cadb0 msgr2=0x7f6e500cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e559b9640 1 --2- 172.21.15.172:0/2849052458 >> v2:172.21.15.186:3300/0 conn(0x7f6e500cadb0 0x7f6e500cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e559b9640 1 -- 172.21.15.172:0/2849052458 >> v1:172.21.15.186:6789/0 conn(0x7f6e5015de80 legacy=0x7f6e500cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e559b9640 1 -- 172.21.15.172:0/2849052458 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500ce7b0 con 0x7f6e500ccfe0 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.141+0000 7f6e549b7640 1 --2- 172.21.15.172:0/2849052458 >> v2:172.21.15.186:3300/0 conn(0x7f6e500cadb0 0x7f6e500cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e559b9640 1 --2- 172.21.15.172:0/2849052458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e500ccfe0 0x7f6e500cd410 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6e50062500 tx=0x7f6e4802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e72de1814ffc94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:15.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e47fff640 1 -- 172.21.15.172:0/2849052458 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48036070 con 0x7f6e500ccfe0 2024-04-25T08:43:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e47fff640 1 -- 172.21.15.172:0/2849052458 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48031600 con 0x7f6e500ccfe0 2024-04-25T08:43:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e47fff640 1 -- 172.21.15.172:0/2849052458 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e480319d0 con 0x7f6e500ccfe0 2024-04-25T08:43:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e5741c640 1 -- 172.21.15.172:0/2849052458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e500ccfe0 msgr2=0x7f6e500cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e5741c640 1 --2- 172.21.15.172:0/2849052458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e500ccfe0 0x7f6e500cd410 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6e50062500 tx=0x7f6e4802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e5741c640 1 -- 172.21.15.172:0/2849052458 shutdown_connections 2024-04-25T08:43:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e5741c640 1 --2- 172.21.15.172:0/2849052458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e500ccfe0 0x7f6e500cd410 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e5741c640 1 --2- 172.21.15.172:0/2849052458 >> v2:172.21.15.186:3300/0 conn(0x7f6e500cadb0 0x7f6e500cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e5741c640 1 -- 172.21.15.172:0/2849052458 >> 172.21.15.172:0/2849052458 conn(0x7f6e500b2390 msgr2=0x7f6e500b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.142+0000 7f6e5741c640 1 -- 172.21.15.172:0/2849052458 shutdown_connections 2024-04-25T08:43:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.143+0000 7f6e5741c640 1 -- 172.21.15.172:0/2849052458 wait complete. 2024-04-25T08:43:15.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.144+0000 7f6e5741c640 1 Processor -- start 2024-04-25T08:43:15.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.144+0000 7f6e5741c640 1 -- start start 2024-04-25T08:43:15.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.144+0000 7f6e5741c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e500cadb0 0x7f6e500c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.144+0000 7f6e5741c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e500ccfe0 0x7f6e5014c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.144+0000 7f6e5741c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5015de80 0x7f6e501f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.144+0000 7f6e5741c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5015e260 con 0x7f6e5015de80 2024-04-25T08:43:15.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.144+0000 7f6e5741c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e500cfc00 con 0x7f6e500cadb0 2024-04-25T08:43:15.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.144+0000 7f6e5741c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e500b2eb0 con 0x7f6e500ccfe0 2024-04-25T08:43:15.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.144+0000 7f6e559b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5015de80 0x7f6e501f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e559b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5015de80 0x7f6e501f7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48096/0 (socket says 172.21.15.172:48096) 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e559b9640 1 -- 172.21.15.172:0/881278982 learned_addr learned my addr 172.21.15.172:0/881278982 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e551b8640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e500cadb0 0x7f6e500c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e549b7640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e500ccfe0 0x7f6e5014c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e559b9640 1 -- 172.21.15.172:0/881278982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e500ccfe0 msgr2=0x7f6e5014c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e559b9640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e500ccfe0 0x7f6e5014c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e559b9640 1 -- 172.21.15.172:0/881278982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e500cadb0 msgr2=0x7f6e500c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e559b9640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e500cadb0 0x7f6e500c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e559b9640 1 -- 172.21.15.172:0/881278982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500c7830 con 0x7f6e5015de80 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e559b9640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5015de80 0x7f6e501f7040 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009f40 tx=0x7f6e48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e45ffb640 1 -- 172.21.15.172:0/881278982 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48036050 con 0x7f6e5015de80 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e45ffb640 1 -- 172.21.15.172:0/881278982 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48042070 con 0x7f6e5015de80 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e5741c640 1 -- 172.21.15.172:0/881278982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e501f7b00 con 0x7f6e5015de80 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e45ffb640 1 -- 172.21.15.172:0/881278982 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48009510 con 0x7f6e5015de80 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.145+0000 7f6e5741c640 1 -- 172.21.15.172:0/881278982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e500c7af0 con 0x7f6e5015de80 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.146+0000 7f6e5741c640 1 -- 172.21.15.172:0/881278982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e50073a00 con 0x7f6e5015de80 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.147+0000 7f6e45ffb640 1 -- 172.21.15.172:0/881278982 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6e48007bd0 con 0x7f6e5015de80 2024-04-25T08:43:15.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.147+0000 7f6e45ffb640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e3406b4d0 0x7f6e3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.147+0000 7f6e45ffb640 1 -- 172.21.15.172:0/881278982 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6e480ab390 con 0x7f6e5015de80 2024-04-25T08:43:15.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.147+0000 7f6e551b8640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e3406b4d0 0x7f6e3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.148+0000 7f6e551b8640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e3406b4d0 0x7f6e3406d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c006fd0 tx=0x7f6e4c009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:15.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.151+0000 7f6e45ffb640 1 -- 172.21.15.172:0/881278982 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e48079850 con 0x7f6e5015de80 2024-04-25T08:43:15.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.319+0000 7f6e5741c640 1 -- 172.21.15.172:0/881278982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e50158cc0 con 0x7f6e5015de80 2024-04-25T08:43:15.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.320+0000 7f6e45ffb640 1 -- 172.21.15.172:0/881278982 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e4807d8f0 con 0x7f6e5015de80 2024-04-25T08:43:15.312 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:15.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 -- 172.21.15.172:0/881278982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e3406b4d0 msgr2=0x7f6e3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e3406b4d0 0x7f6e3406d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c006fd0 tx=0x7f6e4c009060 comp rx=0 tx=0).stop 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 -- 172.21.15.172:0/881278982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5015de80 msgr2=0x7f6e501f7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5015de80 0x7f6e501f7040 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009f40 tx=0x7f6e48004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 -- 172.21.15.172:0/881278982 shutdown_connections 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e3406b4d0 0x7f6e3406d990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e5015de80 0x7f6e501f7040 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e500ccfe0 0x7f6e5014c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 --2- 172.21.15.172:0/881278982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e500cadb0 0x7f6e500c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 -- 172.21.15.172:0/881278982 >> 172.21.15.172:0/881278982 conn(0x7f6e500b2390 msgr2=0x7f6e5015cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 -- 172.21.15.172:0/881278982 shutdown_connections 2024-04-25T08:43:15.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.322+0000 7f6e5741c640 1 -- 172.21.15.172:0/881278982 wait complete. 2024-04-25T08:43:15.325 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:43:15.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.433+0000 7f72f8968640 1 Processor -- start 2024-04-25T08:43:15.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.433+0000 7f72f8968640 1 -- start start 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f8968640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f72f40cc4f0 0x7f72f40cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f8968640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 0x7f72f40cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f8968640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f72f415b270 0x7f72f415b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f8968640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f40ce4c0 con 0x7f72f40cc4f0 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f8968640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f4071270 con 0x7f72f415b270 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f8968640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4072280 con 0x7f72f40cdb20 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f72f40cc4f0 0x7f72f40cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f72f40cc4f0 0x7f72f40cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48106/0 (socket says 172.21.15.172:48106) 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f259c640 1 -- 172.21.15.172:0/4088658791 learned_addr learned my addr 172.21.15.172:0/4088658791 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f1d9b640 1 --2- 172.21.15.172:0/4088658791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 0x7f72f40cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f2d9d640 1 --2- 172.21.15.172:0/4088658791 >> v2:172.21.15.186:3300/0 conn(0x7f72f415b270 0x7f72f415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f259c640 1 -- 172.21.15.172:0/4088658791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 msgr2=0x7f72f40cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f259c640 1 --2- 172.21.15.172:0/4088658791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 0x7f72f40cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f259c640 1 -- 172.21.15.172:0/4088658791 >> v2:172.21.15.186:3300/0 conn(0x7f72f415b270 msgr2=0x7f72f415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f259c640 1 --2- 172.21.15.172:0/4088658791 >> v2:172.21.15.186:3300/0 conn(0x7f72f415b270 0x7f72f415b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f259c640 1 -- 172.21.15.172:0/4088658791 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f40714c0 con 0x7f72f40cc4f0 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f1d9b640 1 --2- 172.21.15.172:0/4088658791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 0x7f72f40cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.434+0000 7f72f2d9d640 1 --2- 172.21.15.172:0/4088658791 >> v2:172.21.15.186:3300/0 conn(0x7f72f415b270 0x7f72f415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.435+0000 7f72f259c640 1 --2- 172.21.15.172:0/4088658791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f40cc4f0 0x7f72f40cc8d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f72f4158aa0 tx=0x7f72e402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58358553e2b3e75c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.435+0000 7f72f159a640 1 -- 172.21.15.172:0/4088658791 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4032790 con 0x7f72f40cc4f0 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.435+0000 7f72f159a640 1 -- 172.21.15.172:0/4088658791 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e4038070 con 0x7f72f40cc4f0 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.435+0000 7f72f159a640 1 -- 172.21.15.172:0/4088658791 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4032b50 con 0x7f72f40cc4f0 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.435+0000 7f72f8968640 1 -- 172.21.15.172:0/4088658791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f40cc4f0 msgr2=0x7f72f40cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.435+0000 7f72f8968640 1 --2- 172.21.15.172:0/4088658791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f40cc4f0 0x7f72f40cc8d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f72f4158aa0 tx=0x7f72e402c890 comp rx=0 tx=0).stop 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.436+0000 7f72f8968640 1 -- 172.21.15.172:0/4088658791 shutdown_connections 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.436+0000 7f72f8968640 1 --2- 172.21.15.172:0/4088658791 >> v2:172.21.15.186:3300/0 conn(0x7f72f415b270 0x7f72f415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.436+0000 7f72f8968640 1 --2- 172.21.15.172:0/4088658791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 0x7f72f40cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.436+0000 7f72f8968640 1 --2- 172.21.15.172:0/4088658791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f40cc4f0 0x7f72f40cc8d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.436+0000 7f72f8968640 1 -- 172.21.15.172:0/4088658791 >> 172.21.15.172:0/4088658791 conn(0x7f72f406abe0 msgr2=0x7f72f406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:15.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.436+0000 7f72f8968640 1 -- 172.21.15.172:0/4088658791 shutdown_connections 2024-04-25T08:43:15.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.436+0000 7f72f8968640 1 -- 172.21.15.172:0/4088658791 wait complete. 2024-04-25T08:43:15.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.437+0000 7f72f8968640 1 Processor -- start 2024-04-25T08:43:15.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.437+0000 7f72f8968640 1 -- start start 2024-04-25T08:43:15.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f8968640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72f40cc4f0 0x7f72f41e57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f8968640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 0x7f72f4144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f8968640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f415b270 0x7f72f41f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f8968640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4071d60 con 0x7f72f415b270 2024-04-25T08:43:15.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f8968640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4071a80 con 0x7f72f40cc4f0 2024-04-25T08:43:15.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f8968640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f415bbc0 con 0x7f72f40cdb20 2024-04-25T08:43:15.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f415b270 0x7f72f41f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f415b270 0x7f72f41f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48108/0 (socket says 172.21.15.172:48108) 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f2d9d640 1 -- 172.21.15.172:0/3452937624 learned_addr learned my addr 172.21.15.172:0/3452937624 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f259c640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72f40cc4f0 0x7f72f41e57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f1d9b640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 0x7f72f4144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f2d9d640 1 -- 172.21.15.172:0/3452937624 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 msgr2=0x7f72f4144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f2d9d640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 0x7f72f4144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f2d9d640 1 -- 172.21.15.172:0/3452937624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72f40cc4f0 msgr2=0x7f72f41e57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f2d9d640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72f40cc4f0 0x7f72f41e57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f2d9d640 1 -- 172.21.15.172:0/3452937624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4144650 con 0x7f72f415b270 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f259c640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72f40cc4f0 0x7f72f41e57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f2d9d640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f415b270 0x7f72f41f4190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f72ec007ef0 tx=0x7f72ec00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72e2ffd640 1 -- 172.21.15.172:0/3452937624 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec01a070 con 0x7f72f415b270 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72e2ffd640 1 -- 172.21.15.172:0/3452937624 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec003b90 con 0x7f72f415b270 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72f8968640 1 -- 172.21.15.172:0/3452937624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f41f46d0 con 0x7f72f415b270 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.438+0000 7f72e2ffd640 1 -- 172.21.15.172:0/3452937624 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec004030 con 0x7f72f415b270 2024-04-25T08:43:15.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.439+0000 7f72f8968640 1 -- 172.21.15.172:0/3452937624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f41e4a10 con 0x7f72f415b270 2024-04-25T08:43:15.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.440+0000 7f72f8968640 1 -- 172.21.15.172:0/3452937624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f4073a00 con 0x7f72f415b270 2024-04-25T08:43:15.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.440+0000 7f72e2ffd640 1 -- 172.21.15.172:0/3452937624 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f72ec01d070 con 0x7f72f415b270 2024-04-25T08:43:15.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.440+0000 7f72e2ffd640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72d406b4d0 0x7f72d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.440+0000 7f72f259c640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72d406b4d0 0x7f72d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.440+0000 7f72e2ffd640 1 -- 172.21.15.172:0/3452937624 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f72ec08a760 con 0x7f72f415b270 2024-04-25T08:43:15.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.441+0000 7f72f259c640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72d406b4d0 0x7f72d406d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f72e4037000 tx=0x7f72e4032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:15.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.445+0000 7f72e2ffd640 1 -- 172.21.15.172:0/3452937624 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f72ec010070 con 0x7f72f415b270 2024-04-25T08:43:15.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.615+0000 7f72f8968640 1 -- 172.21.15.172:0/3452937624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72f40cd3e0 con 0x7f72f415b270 2024-04-25T08:43:15.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.615+0000 7f72e2ffd640 1 -- 172.21.15.172:0/3452937624 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f72ec058c20 con 0x7f72f415b270 2024-04-25T08:43:15.607 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:43:15.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 -- 172.21.15.172:0/3452937624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72d406b4d0 msgr2=0x7f72d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72d406b4d0 0x7f72d406d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f72e4037000 tx=0x7f72e4032000 comp rx=0 tx=0).stop 2024-04-25T08:43:15.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 -- 172.21.15.172:0/3452937624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f415b270 msgr2=0x7f72f41f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f415b270 0x7f72f41f4190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f72ec007ef0 tx=0x7f72ec00d4a0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 -- 172.21.15.172:0/3452937624 shutdown_connections 2024-04-25T08:43:15.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72d406b4d0 0x7f72d406d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f415b270 0x7f72f41f4190 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72f40cdb20 0x7f72f4144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 --2- 172.21.15.172:0/3452937624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72f40cc4f0 0x7f72f41e57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 -- 172.21.15.172:0/3452937624 >> 172.21.15.172:0/3452937624 conn(0x7f72f406abe0 msgr2=0x7f72f40b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:15.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 -- 172.21.15.172:0/3452937624 shutdown_connections 2024-04-25T08:43:15.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.617+0000 7f72f8968640 1 -- 172.21.15.172:0/3452937624 wait complete. 2024-04-25T08:43:15.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:43:15.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.728+0000 7f9c3005d640 1 Processor -- start 2024-04-25T08:43:15.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.729+0000 7f9c3005d640 1 -- start start 2024-04-25T08:43:15.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.729+0000 7f9c3005d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c28161240 0x7f9c280b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.729+0000 7f9c3005d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9c28161890 0x7f9c280ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.729+0000 7f9c3005d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c28161620 con 0x7f9c280b54a0 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.729+0000 7f9c3005d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c280b7120 con 0x7f9c28161240 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.729+0000 7f9c3005d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c28161e00 con 0x7f9c28161890 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.730+0000 7f9c2ddf9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c28161240 0x7f9c280b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.730+0000 7f9c2e5fa640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9c280b54a0 0x7f9c280d1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49686/0 (socket says 172.21.15.172:49686) 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.730+0000 7f9c2e5fa640 1 -- 172.21.15.172:0/3094250435 learned_addr learned my addr 172.21.15.172:0/3094250435 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.730+0000 7f9c2d5f8640 1 --2- 172.21.15.172:0/3094250435 >> v2:172.21.15.186:3300/0 conn(0x7f9c28161890 0x7f9c280ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.730+0000 7f9c2ddf9640 1 -- 172.21.15.172:0/3094250435 >> v2:172.21.15.186:3300/0 conn(0x7f9c28161890 msgr2=0x7f9c280ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.730+0000 7f9c2ddf9640 1 --2- 172.21.15.172:0/3094250435 >> v2:172.21.15.186:3300/0 conn(0x7f9c28161890 0x7f9c280ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.730+0000 7f9c2ddf9640 1 -- 172.21.15.172:0/3094250435 >> v1:172.21.15.172:6789/0 conn(0x7f9c280b54a0 legacy=0x7f9c280d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.730+0000 7f9c2ddf9640 1 -- 172.21.15.172:0/3094250435 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c281620e0 con 0x7f9c28161240 2024-04-25T08:43:15.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.730+0000 7f9c2cdf7640 1 -- 172.21.15.172:0/3094250435 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636555637 0 0) 0x7f9c28161620 con 0x7f9c280b54a0 2024-04-25T08:43:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c2ddf9640 1 --2- 172.21.15.172:0/3094250435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 0x7f9c280b6be0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9c2808c330 tx=0x7f9c2402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8733f351aa896049 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c2cdf7640 1 -- 172.21.15.172:0/3094250435 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24037070 con 0x7f9c28161240 2024-04-25T08:43:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c2cdf7640 1 -- 172.21.15.172:0/3094250435 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c24032440 con 0x7f9c28161240 2024-04-25T08:43:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c2cdf7640 1 -- 172.21.15.172:0/3094250435 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24032810 con 0x7f9c28161240 2024-04-25T08:43:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c3005d640 1 -- 172.21.15.172:0/3094250435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 msgr2=0x7f9c280b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c3005d640 1 --2- 172.21.15.172:0/3094250435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 0x7f9c280b6be0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9c2808c330 tx=0x7f9c2402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c3005d640 1 -- 172.21.15.172:0/3094250435 shutdown_connections 2024-04-25T08:43:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c3005d640 1 --2- 172.21.15.172:0/3094250435 >> v2:172.21.15.186:3300/0 conn(0x7f9c28161890 0x7f9c280ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c3005d640 1 --2- 172.21.15.172:0/3094250435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 0x7f9c280b6be0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c3005d640 1 -- 172.21.15.172:0/3094250435 >> 172.21.15.172:0/3094250435 conn(0x7f9c280d04a0 msgr2=0x7f9c280d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:15.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c3005d640 1 -- 172.21.15.172:0/3094250435 shutdown_connections 2024-04-25T08:43:15.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.731+0000 7f9c3005d640 1 -- 172.21.15.172:0/3094250435 wait complete. 2024-04-25T08:43:15.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c3005d640 1 Processor -- start 2024-04-25T08:43:15.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c3005d640 1 -- start start 2024-04-25T08:43:15.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c3005d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c280b54a0 0x7f9c281f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c3005d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 0x7f9c280c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c3005d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c28161890 0x7f9c2814ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c3005d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280d15f0 con 0x7f9c28161240 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c3005d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c281626a0 con 0x7f9c280b54a0 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c3005d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280cf000 con 0x7f9c28161890 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c2d5f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 0x7f9c280c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c2d5f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 0x7f9c280c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48138/0 (socket says 172.21.15.172:48138) 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c2d5f8640 1 -- 172.21.15.172:0/1338914724 learned_addr learned my addr 172.21.15.172:0/1338914724 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.733+0000 7f9c2ddf9640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c280b54a0 0x7f9c281f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c2e5fa640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c28161890 0x7f9c2814ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c2d5f8640 1 -- 172.21.15.172:0/1338914724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c28161890 msgr2=0x7f9c2814ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c2d5f8640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c28161890 0x7f9c2814ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c2d5f8640 1 -- 172.21.15.172:0/1338914724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c280b54a0 msgr2=0x7f9c281f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c2d5f8640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c280b54a0 0x7f9c281f37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c2d5f8640 1 -- 172.21.15.172:0/1338914724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c280c7a50 con 0x7f9c28161240 2024-04-25T08:43:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c2d5f8640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 0x7f9c280c8b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800d620 tx=0x7f9c1800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c1e7fc640 1 -- 172.21.15.172:0/1338914724 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800b620 con 0x7f9c28161240 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c1e7fc640 1 -- 172.21.15.172:0/1338914724 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c18019070 con 0x7f9c28161240 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c3005d640 1 -- 172.21.15.172:0/1338914724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c280c7d30 con 0x7f9c28161240 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c1e7fc640 1 -- 172.21.15.172:0/1338914724 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800ba00 con 0x7f9c28161240 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.734+0000 7f9c3005d640 1 -- 172.21.15.172:0/1338914724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c280c82f0 con 0x7f9c28161240 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.735+0000 7f9c3005d640 1 -- 172.21.15.172:0/1338914724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c28073a00 con 0x7f9c28161240 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.735+0000 7f9c1e7fc640 1 -- 172.21.15.172:0/1338914724 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c1800bba0 con 0x7f9c28161240 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.736+0000 7f9c1e7fc640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0c06b4d0 0x7f9c0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.736+0000 7f9c1e7fc640 1 -- 172.21.15.172:0/1338914724 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9c1808a8e0 con 0x7f9c28161240 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.736+0000 7f9c2ddf9640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0c06b4d0 0x7f9c0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.736+0000 7f9c2ddf9640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0c06b4d0 0x7f9c0c06d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c24034000 tx=0x7f9c2402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:15.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.740+0000 7f9c1e7fc640 1 -- 172.21.15.172:0/1338914724 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c180593f0 con 0x7f9c28161240 2024-04-25T08:43:15.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.911+0000 7f9c3005d640 1 -- 172.21.15.172:0/1338914724 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9c2806d240 con 0x7f9c28161240 2024-04-25T08:43:15.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.911+0000 7f9c1e7fc640 1 -- 172.21.15.172:0/1338914724 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9c18058cf0 con 0x7f9c28161240 2024-04-25T08:43:15.904 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:15.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.913+0000 7f9c3005d640 1 -- 172.21.15.172:0/1338914724 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0c06b4d0 msgr2=0x7f9c0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.913+0000 7f9c3005d640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0c06b4d0 0x7f9c0c06d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9c24034000 tx=0x7f9c2402e000 comp rx=0 tx=0).stop 2024-04-25T08:43:15.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.913+0000 7f9c3005d640 1 -- 172.21.15.172:0/1338914724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 msgr2=0x7f9c280c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:15.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.913+0000 7f9c3005d640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 0x7f9c280c8b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800d620 tx=0x7f9c1800dae0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.913+0000 7f9c3005d640 1 -- 172.21.15.172:0/1338914724 shutdown_connections 2024-04-25T08:43:15.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.913+0000 7f9c3005d640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0c06b4d0 0x7f9c0c06d990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.913+0000 7f9c3005d640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c28161890 0x7f9c2814ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.913+0000 7f9c3005d640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c28161240 0x7f9c280c8b10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.913+0000 7f9c3005d640 1 --2- 172.21.15.172:0/1338914724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c280b54a0 0x7f9c281f37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:15.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.913+0000 7f9c3005d640 1 -- 172.21.15.172:0/1338914724 >> 172.21.15.172:0/1338914724 conn(0x7f9c280d04a0 msgr2=0x7f9c280d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:15.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.914+0000 7f9c3005d640 1 -- 172.21.15.172:0/1338914724 shutdown_connections 2024-04-25T08:43:15.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:15.914+0000 7f9c3005d640 1 -- 172.21.15.172:0/1338914724 wait complete. 2024-04-25T08:43:15.917 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:43:16.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.022+0000 7ff7c824a640 1 Processor -- start 2024-04-25T08:43:16.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.023+0000 7ff7c824a640 1 -- start start 2024-04-25T08:43:16.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.023+0000 7ff7c824a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff7c00cc4f0 0x7ff7c00cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.023+0000 7ff7c824a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7c00cdb20 0x7ff7c00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c824a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c0072280 con 0x7ff7c015b270 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c824a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c00ce4c0 con 0x7ff7c00cc4f0 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c824a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c0071270 con 0x7ff7c00cdb20 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c5fe6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff7c00cc4f0 0x7ff7c00cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c5fe6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff7c00cc4f0 0x7ff7c00cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48140/0 (socket says 172.21.15.172:48140) 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c5fe6640 1 -- 172.21.15.172:0/2552699883 learned_addr learned my addr 172.21.15.172:0/2552699883 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c57e5640 1 --2- 172.21.15.172:0/2552699883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7c00cdb20 0x7ff7c00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c5fe6640 1 -- 172.21.15.172:0/2552699883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7c00cdb20 msgr2=0x7ff7c00cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c5fe6640 1 --2- 172.21.15.172:0/2552699883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7c00cdb20 0x7ff7c00cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c5fe6640 1 -- 172.21.15.172:0/2552699883 >> v1:172.21.15.172:6789/0 conn(0x7ff7c015b270 legacy=0x7ff7c015b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.024+0000 7ff7c5fe6640 1 -- 172.21.15.172:0/2552699883 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c00714c0 con 0x7ff7c00cc4f0 2024-04-25T08:43:16.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.025+0000 7ff7c5fe6640 1 --2- 172.21.15.172:0/2552699883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cc4f0 0x7ff7c00cc8d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000bb10 tx=0x7ff7b002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2187d685340ab723 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:16.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.025+0000 7ff7c4fe4640 1 -- 172.21.15.172:0/2552699883 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0036020 con 0x7ff7c00cc4f0 2024-04-25T08:43:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.025+0000 7ff7c4fe4640 1 -- 172.21.15.172:0/2552699883 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b0032820 con 0x7ff7c00cc4f0 2024-04-25T08:43:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.025+0000 7ff7c4fe4640 1 -- 172.21.15.172:0/2552699883 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0032bf0 con 0x7ff7c00cc4f0 2024-04-25T08:43:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.025+0000 7ff7c824a640 1 -- 172.21.15.172:0/2552699883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cc4f0 msgr2=0x7ff7c00cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.025+0000 7ff7c824a640 1 --2- 172.21.15.172:0/2552699883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cc4f0 0x7ff7c00cc8d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000bb10 tx=0x7ff7b002c920 comp rx=0 tx=0).stop 2024-04-25T08:43:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.025+0000 7ff7c824a640 1 -- 172.21.15.172:0/2552699883 shutdown_connections 2024-04-25T08:43:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.025+0000 7ff7c824a640 1 --2- 172.21.15.172:0/2552699883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7c00cdb20 0x7ff7c00cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.025+0000 7ff7c824a640 1 --2- 172.21.15.172:0/2552699883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cc4f0 0x7ff7c00cc8d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.025+0000 7ff7c824a640 1 -- 172.21.15.172:0/2552699883 >> 172.21.15.172:0/2552699883 conn(0x7ff7c006abe0 msgr2=0x7ff7c006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.026+0000 7ff7c824a640 1 -- 172.21.15.172:0/2552699883 shutdown_connections 2024-04-25T08:43:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.026+0000 7ff7c824a640 1 -- 172.21.15.172:0/2552699883 wait complete. 2024-04-25T08:43:16.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.027+0000 7ff7c824a640 1 Processor -- start 2024-04-25T08:43:16.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.027+0000 7ff7c824a640 1 -- start start 2024-04-25T08:43:16.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.027+0000 7ff7c824a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7c00cc4f0 0x7ff7c0140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.027+0000 7ff7c824a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cdb20 0x7ff7c014dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.027+0000 7ff7c824a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c015b270 0x7ff7c014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.027+0000 7ff7c824a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c0071a80 con 0x7ff7c00cdb20 2024-04-25T08:43:16.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.027+0000 7ff7c824a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c015bd90 con 0x7ff7c015b270 2024-04-25T08:43:16.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.027+0000 7ff7c824a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c0071d60 con 0x7ff7c00cc4f0 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.027+0000 7ff7c57e5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cdb20 0x7ff7c014dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c57e5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cdb20 0x7ff7c014dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48154/0 (socket says 172.21.15.172:48154) 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c57e5640 1 -- 172.21.15.172:0/321126701 learned_addr learned my addr 172.21.15.172:0/321126701 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c5fe6640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7c00cc4f0 0x7ff7c0140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c57e5640 1 -- 172.21.15.172:0/321126701 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7c00cc4f0 msgr2=0x7ff7c0140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c57e5640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7c00cc4f0 0x7ff7c0140ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c57e5640 1 -- 172.21.15.172:0/321126701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c015b270 msgr2=0x7ff7c014e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c67e7640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c015b270 0x7ff7c014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c57e5640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c015b270 0x7ff7c014e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c57e5640 1 -- 172.21.15.172:0/321126701 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0152ed0 con 0x7ff7c00cdb20 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c57e5640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cdb20 0x7ff7c014dcf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00d800 tx=0x7ff7bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7b67fc640 1 -- 172.21.15.172:0/321126701 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00b6c0 con 0x7ff7c00cdb20 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7b67fc640 1 -- 172.21.15.172:0/321126701 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc019070 con 0x7ff7c00cdb20 2024-04-25T08:43:16.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c824a640 1 -- 172.21.15.172:0/321126701 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c01531b0 con 0x7ff7c00cdb20 2024-04-25T08:43:16.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7b67fc640 1 -- 172.21.15.172:0/321126701 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00ba80 con 0x7ff7c00cdb20 2024-04-25T08:43:16.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.028+0000 7ff7c824a640 1 -- 172.21.15.172:0/321126701 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c0153a50 con 0x7ff7c00cdb20 2024-04-25T08:43:16.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.029+0000 7ff7c824a640 1 -- 172.21.15.172:0/321126701 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c0073a00 con 0x7ff7c00cdb20 2024-04-25T08:43:16.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.029+0000 7ff7b67fc640 1 -- 172.21.15.172:0/321126701 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff7bc00bc20 con 0x7ff7c00cdb20 2024-04-25T08:43:16.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.030+0000 7ff7b67fc640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff7a406b4d0 0x7ff7a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.030+0000 7ff7b67fc640 1 -- 172.21.15.172:0/321126701 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff7bc08ab40 con 0x7ff7c00cdb20 2024-04-25T08:43:16.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.030+0000 7ff7c5fe6640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff7a406b4d0 0x7ff7a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.030+0000 7ff7c5fe6640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff7a406b4d0 0x7ff7a406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0037000 tx=0x7ff7b003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:16.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.034+0000 7ff7b67fc640 1 -- 172.21.15.172:0/321126701 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7bc059530 con 0x7ff7c00cdb20 2024-04-25T08:43:16.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.214+0000 7ff7c824a640 1 -- 172.21.15.172:0/321126701 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff7c006d3a0 con 0x7ff7c00cdb20 2024-04-25T08:43:16.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.215+0000 7ff7b67fc640 1 -- 172.21.15.172:0/321126701 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff7bc058e30 con 0x7ff7c00cdb20 2024-04-25T08:43:16.207 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:43:16.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 -- 172.21.15.172:0/321126701 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff7a406b4d0 msgr2=0x7ff7a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff7a406b4d0 0x7ff7a406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0037000 tx=0x7ff7b003d040 comp rx=0 tx=0).stop 2024-04-25T08:43:16.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 -- 172.21.15.172:0/321126701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cdb20 msgr2=0x7ff7c014dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cdb20 0x7ff7c014dcf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc00d800 tx=0x7ff7bc00dcc0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 -- 172.21.15.172:0/321126701 shutdown_connections 2024-04-25T08:43:16.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff7a406b4d0 0x7ff7a406d990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7c015b270 0x7ff7c014e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7c00cdb20 0x7ff7c014dcf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 --2- 172.21.15.172:0/321126701 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff7c00cc4f0 0x7ff7c0140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 -- 172.21.15.172:0/321126701 >> 172.21.15.172:0/321126701 conn(0x7ff7c006abe0 msgr2=0x7ff7c00b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:16.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 -- 172.21.15.172:0/321126701 shutdown_connections 2024-04-25T08:43:16.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.217+0000 7ff7c824a640 1 -- 172.21.15.172:0/321126701 wait complete. 2024-04-25T08:43:16.220 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:43:16.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:16.220 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T08:43:16.244 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:43:16.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:16.244 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:43:16.300 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:43:16.300 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:16.319 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:43:16.319 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:16.378 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:43:16.378 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:16.436 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:16.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.542+0000 7f8870b4c640 1 Processor -- start 2024-04-25T08:43:16.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.542+0000 7f8870b4c640 1 -- start start 2024-04-25T08:43:16.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.543+0000 7f8870b4c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c154ed0 0x7f886c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.543+0000 7f8870b4c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f886c06c1d0 0x7f886c06afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.543+0000 7f8870b4c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c15ec60 con 0x7f886c071ac0 2024-04-25T08:43:16.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.543+0000 7f8870b4c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c15ef40 con 0x7f886c06c1d0 2024-04-25T08:43:16.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.543+0000 7f8870b4c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c06db90 con 0x7f886c154ed0 2024-04-25T08:43:16.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.543+0000 7f8869d9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f886c071ac0 0x7f886c0ad410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49706/0 (socket says 172.21.15.172:49706) 2024-04-25T08:43:16.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.543+0000 7f8869d9b640 1 -- 172.21.15.172:0/3616847812 learned_addr learned my addr 172.21.15.172:0/3616847812 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:16.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.543+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438629612 0 0) 0x7f886c15ec60 con 0x7f886c071ac0 2024-04-25T08:43:16.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.543+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8854003520 con 0x7f886c071ac0 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886ad9d640 1 --2- 172.21.15.172:0/3616847812 >> v2:172.21.15.186:3300/0 conn(0x7f886c06c1d0 0x7f886c06afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886a59c640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c154ed0 0x7f886c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3660538010 0 0) 0x7f8854003520 con 0x7f886c071ac0 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c154ed0 msgr2=0x7f886c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c154ed0 0x7f886c0aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 >> v2:172.21.15.186:3300/0 conn(0x7f886c06c1d0 msgr2=0x7f886c06afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 --2- 172.21.15.172:0/3616847812 >> v2:172.21.15.186:3300/0 conn(0x7f886c06c1d0 0x7f886c06afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c06de70 con 0x7f886c071ac0 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f8860001670 con 0x7f886c071ac0 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 >> v1:172.21.15.172:6789/0 conn(0x7f886c071ac0 legacy=0x7f886c0ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88540039b0 0x7f8854003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8854004800 0x7f8854004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c154ed0 0x7f88540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c15ef40 con 0x7f88540039b0 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c06db90 con 0x7f8854004800 2024-04-25T08:43:16.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885400b9c0 con 0x7f886c154ed0 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886a59c640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88540039b0 0x7f8854003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f8869d9b640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8854004800 0x7f8854004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886ad9d640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c154ed0 0x7f88540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886a59c640 1 -- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c154ed0 msgr2=0x7f88540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886a59c640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c154ed0 0x7f88540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886a59c640 1 -- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8854004800 msgr2=0x7f8854004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886a59c640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8854004800 0x7f8854004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f886a59c640 1 -- 172.21.15.172:0/3616847812 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854003520 con 0x7f88540039b0 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.544+0000 7f8869d9b640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8854004800 0x7f8854004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.545+0000 7f886a59c640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88540039b0 0x7f8854003dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f885c009fc0 tx=0x7f8854005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7add80cddcf26bd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.545+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c009c10 con 0x7f88540039b0 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.545+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c036070 con 0x7f88540039b0 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.545+0000 7f886959a640 1 -- 172.21.15.172:0/3616847812 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c031880 con 0x7f88540039b0 2024-04-25T08:43:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.546+0000 7f8870b4c640 1 -- 172.21.15.172:0/3616847812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88540039b0 msgr2=0x7f8854003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.546+0000 7f8870b4c640 1 --2- 172.21.15.172:0/3616847812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88540039b0 0x7f8854003dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f885c009fc0 tx=0x7f8854005830 comp rx=0 tx=0).stop 2024-04-25T08:43:16.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.546+0000 7f886ad9d640 1 -- 172.21.15.172:0/3616847812 reap_dead start 2024-04-25T08:43:16.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.546+0000 7f8870b4c640 1 -- 172.21.15.172:0/3616847812 shutdown_connections 2024-04-25T08:43:16.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.546+0000 7f8870b4c640 1 -- 172.21.15.172:0/3616847812 >> 172.21.15.172:0/3616847812 conn(0x7f886c0af670 msgr2=0x7f886c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:16.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.546+0000 7f8870b4c640 1 -- 172.21.15.172:0/3616847812 shutdown_connections 2024-04-25T08:43:16.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.546+0000 7f8870b4c640 1 -- 172.21.15.172:0/3616847812 wait complete. 2024-04-25T08:43:16.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.547+0000 7f8870b4c640 1 Processor -- start 2024-04-25T08:43:16.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.547+0000 7f8870b4c640 1 -- start start 2024-04-25T08:43:16.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8870b4c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c156be0 0x7f886c1f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8870b4c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f886c145230 0x7f886c1f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8870b4c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f886c145780 0x7f886c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8870b4c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0ad050 con 0x7f886c145230 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8870b4c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0aced0 con 0x7f886c145780 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8870b4c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0ad1d0 con 0x7f886c156be0 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8869d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f886c145230 0x7f886c1f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8869d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f886c145230 0x7f886c1f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48184/0 (socket says 172.21.15.172:48184) 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8869d9b640 1 -- 172.21.15.172:0/10742622 learned_addr learned my addr 172.21.15.172:0/10742622 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f886ad9d640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f886c145780 0x7f886c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f886a59c640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c156be0 0x7f886c1f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8869d9b640 1 -- 172.21.15.172:0/10742622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c156be0 msgr2=0x7f886c1f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8869d9b640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c156be0 0x7f886c1f7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8869d9b640 1 -- 172.21.15.172:0/10742622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f886c145780 msgr2=0x7f886c1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8869d9b640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f886c145780 0x7f886c1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8869d9b640 1 -- 172.21.15.172:0/10742622 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c1f7fb0 con 0x7f886c145230 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8869d9b640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f886c145230 0x7f886c1f7650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f886000e820 tx=0x7f886000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f885affd640 1 -- 172.21.15.172:0/10742622 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000c870 con 0x7f886c145230 2024-04-25T08:43:16.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f885affd640 1 -- 172.21.15.172:0/10742622 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8860018070 con 0x7f886c145230 2024-04-25T08:43:16.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f8870b4c640 1 -- 172.21.15.172:0/10742622 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c151960 con 0x7f886c145230 2024-04-25T08:43:16.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.548+0000 7f885affd640 1 -- 172.21.15.172:0/10742622 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000cc30 con 0x7f886c145230 2024-04-25T08:43:16.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.549+0000 7f8870b4c640 1 -- 172.21.15.172:0/10742622 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c151f20 con 0x7f886c145230 2024-04-25T08:43:16.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.549+0000 7f8870b4c640 1 -- 172.21.15.172:0/10742622 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c0b3c90 con 0x7f886c145230 2024-04-25T08:43:16.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.550+0000 7f885affd640 1 -- 172.21.15.172:0/10742622 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f886001d460 con 0x7f886c145230 2024-04-25T08:43:16.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.550+0000 7f885affd640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884c06b4d0 0x7f884c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.550+0000 7f886a59c640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884c06b4d0 0x7f884c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.550+0000 7f885affd640 1 -- 172.21.15.172:0/10742622 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f886008a4f0 con 0x7f886c145230 2024-04-25T08:43:16.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.551+0000 7f886a59c640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884c06b4d0 0x7f884c06d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f885c035000 tx=0x7f885c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:16.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.554+0000 7f885affd640 1 -- 172.21.15.172:0/10742622 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8860058ef0 con 0x7f886c145230 2024-04-25T08:43:16.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.729+0000 7f8870b4c640 1 -- 172.21.15.172:0/10742622 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f886c073990 con 0x7f886c145230 2024-04-25T08:43:16.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.731+0000 7f885affd640 1 -- 172.21.15.172:0/10742622 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18905 (secure 0 0 0) 0x7f88600587f0 con 0x7f886c145230 2024-04-25T08:43:16.723 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:16.723 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:09.821048+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:16.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 -- 172.21.15.172:0/10742622 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884c06b4d0 msgr2=0x7f884c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884c06b4d0 0x7f884c06d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f885c035000 tx=0x7f885c02f000 comp rx=0 tx=0).stop 2024-04-25T08:43:16.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 -- 172.21.15.172:0/10742622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f886c145230 msgr2=0x7f886c1f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f886c145230 0x7f886c1f7650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f886000e820 tx=0x7f886000ece0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 -- 172.21.15.172:0/10742622 shutdown_connections 2024-04-25T08:43:16.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884c06b4d0 0x7f884c06d990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f886c145780 0x7f886c1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f886c145230 0x7f886c1f7650 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 --2- 172.21.15.172:0/10742622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886c156be0 0x7f886c1f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 -- 172.21.15.172:0/10742622 >> 172.21.15.172:0/10742622 conn(0x7f88540039b0 msgr2=0x7f886c15f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:16.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 -- 172.21.15.172:0/10742622 shutdown_connections 2024-04-25T08:43:16.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.733+0000 7f8870b4c640 1 -- 172.21.15.172:0/10742622 wait complete. 2024-04-25T08:43:16.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:43:16.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:16.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.844+0000 7fed8b66b640 1 Processor -- start 2024-04-25T08:43:16.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.845+0000 7fed8b66b640 1 -- start start 2024-04-25T08:43:16.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.845+0000 7fed8b66b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fed840cd8a0 0x7fed8415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.845+0000 7fed8b66b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 0x7fed84151020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.845+0000 7fed8b66b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8415e6e0 con 0x7fed840cd4c0 2024-04-25T08:43:16.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.845+0000 7fed8b66b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed84151560 con 0x7fed840cd8a0 2024-04-25T08:43:16.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.845+0000 7fed8b66b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8415e9c0 con 0x7fed84150b90 2024-04-25T08:43:16.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.846+0000 7fed88c06640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fed840cd8a0 0x7fed8415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.846+0000 7fed89407640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fed840cd4c0 0x7fed8415dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:43206/0 (socket says 172.21.15.172:43206) 2024-04-25T08:43:16.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.846+0000 7fed89407640 1 -- 172.21.15.172:0/2822124672 learned_addr learned my addr 172.21.15.172:0/2822124672 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:16.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.846+0000 7fed89c08640 1 --2- 172.21.15.172:0/2822124672 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 0x7fed84151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.846+0000 7fed89c08640 1 -- 172.21.15.172:0/2822124672 >> v2:172.21.15.186:3300/0 conn(0x7fed840cd8a0 msgr2=0x7fed8415b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:16.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.846+0000 7fed89c08640 1 --2- 172.21.15.172:0/2822124672 >> v2:172.21.15.186:3300/0 conn(0x7fed840cd8a0 0x7fed8415b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.846+0000 7fed89c08640 1 -- 172.21.15.172:0/2822124672 >> v1:172.21.15.186:6789/0 conn(0x7fed840cd4c0 legacy=0x7fed8415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.846+0000 7fed89c08640 1 -- 172.21.15.172:0/2822124672 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8415a9c0 con 0x7fed84150b90 2024-04-25T08:43:16.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.846+0000 7fed88c06640 1 --2- 172.21.15.172:0/2822124672 >> v2:172.21.15.186:3300/0 conn(0x7fed840cd8a0 0x7fed8415b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.847+0000 7fed89c08640 1 --2- 172.21.15.172:0/2822124672 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 0x7fed84151020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fed80009d90 tx=0x7fed8002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a91ad2e31badd944 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.847+0000 7fed7bfff640 1 -- 172.21.15.172:0/2822124672 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80007740 con 0x7fed84150b90 2024-04-25T08:43:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.847+0000 7fed7bfff640 1 -- 172.21.15.172:0/2822124672 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed800078e0 con 0x7fed84150b90 2024-04-25T08:43:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.847+0000 7fed7bfff640 1 -- 172.21.15.172:0/2822124672 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80007cb0 con 0x7fed84150b90 2024-04-25T08:43:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.848+0000 7fed8b66b640 1 -- 172.21.15.172:0/2822124672 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 msgr2=0x7fed84151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.848+0000 7fed8b66b640 1 --2- 172.21.15.172:0/2822124672 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 0x7fed84151020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fed80009d90 tx=0x7fed8002a660 comp rx=0 tx=0).stop 2024-04-25T08:43:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.848+0000 7fed8b66b640 1 -- 172.21.15.172:0/2822124672 shutdown_connections 2024-04-25T08:43:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.848+0000 7fed8b66b640 1 --2- 172.21.15.172:0/2822124672 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 0x7fed84151020 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.848+0000 7fed8b66b640 1 --2- 172.21.15.172:0/2822124672 >> v2:172.21.15.186:3300/0 conn(0x7fed840cd8a0 0x7fed8415b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.848+0000 7fed8b66b640 1 -- 172.21.15.172:0/2822124672 >> 172.21.15.172:0/2822124672 conn(0x7fed8406abe0 msgr2=0x7fed8406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.848+0000 7fed8b66b640 1 -- 172.21.15.172:0/2822124672 shutdown_connections 2024-04-25T08:43:16.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.848+0000 7fed8b66b640 1 -- 172.21.15.172:0/2822124672 wait complete. 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.849+0000 7fed8b66b640 1 Processor -- start 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.849+0000 7fed8b66b640 1 -- start start 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed8b66b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed840cd4c0 0x7fed84156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed8b66b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed840cd8a0 0x7fed840b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed8b66b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 0x7fed84146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed8b66b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8415e370 con 0x7fed840cd4c0 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed8b66b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8415a670 con 0x7fed840cd8a0 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed8b66b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8406eca0 con 0x7fed84150b90 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed89407640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed840cd4c0 0x7fed84156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed89407640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed840cd4c0 0x7fed84156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48198/0 (socket says 172.21.15.172:48198) 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed89407640 1 -- 172.21.15.172:0/83088676 learned_addr learned my addr 172.21.15.172:0/83088676 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:16.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed89c08640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 0x7fed84146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed88c06640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed840cd8a0 0x7fed840b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed89407640 1 -- 172.21.15.172:0/83088676 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 msgr2=0x7fed84146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed89407640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 0x7fed84146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed89407640 1 -- 172.21.15.172:0/83088676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed840cd8a0 msgr2=0x7fed840b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed89407640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed840cd8a0 0x7fed840b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed89407640 1 -- 172.21.15.172:0/83088676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8414aaf0 con 0x7fed840cd4c0 2024-04-25T08:43:16.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.850+0000 7fed89407640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed840cd4c0 0x7fed84156170 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c430 tx=0x7fed7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:16.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.852+0000 7fed79ffb640 1 -- 172.21.15.172:0/83088676 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c017070 con 0x7fed840cd4c0 2024-04-25T08:43:16.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.852+0000 7fed79ffb640 1 -- 172.21.15.172:0/83088676 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c005ce0 con 0x7fed840cd4c0 2024-04-25T08:43:16.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.852+0000 7fed8b66b640 1 -- 172.21.15.172:0/83088676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed841566b0 con 0x7fed840cd4c0 2024-04-25T08:43:16.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.852+0000 7fed79ffb640 1 -- 172.21.15.172:0/83088676 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c0072f0 con 0x7fed840cd4c0 2024-04-25T08:43:16.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.853+0000 7fed8b66b640 1 -- 172.21.15.172:0/83088676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed84156c10 con 0x7fed840cd4c0 2024-04-25T08:43:16.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.854+0000 7fed79ffb640 1 -- 172.21.15.172:0/83088676 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed7c01a070 con 0x7fed840cd4c0 2024-04-25T08:43:16.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.854+0000 7fed8b66b640 1 -- 172.21.15.172:0/83088676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed84073a00 con 0x7fed840cd4c0 2024-04-25T08:43:16.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.854+0000 7fed79ffb640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed6806b4d0 0x7fed6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:16.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.854+0000 7fed79ffb640 1 -- 172.21.15.172:0/83088676 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fed7c0899a0 con 0x7fed840cd4c0 2024-04-25T08:43:16.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.854+0000 7fed88c06640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed6806b4d0 0x7fed6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:16.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.855+0000 7fed88c06640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed6806b4d0 0x7fed6806d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed74009560 tx=0x7fed74009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:16.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:16.858+0000 7fed79ffb640 1 -- 172.21.15.172:0/83088676 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed841566b0 con 0x7fed840cd4c0 2024-04-25T08:43:17.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.026+0000 7fed8b66b640 1 -- 172.21.15.172:0/83088676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fed840b4a60 con 0x7fed840cd4c0 2024-04-25T08:43:17.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.027+0000 7fed79ffb640 1 -- 172.21.15.172:0/83088676 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fed8414aaf0 con 0x7fed840cd4c0 2024-04-25T08:43:17.019 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:17.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 -- 172.21.15.172:0/83088676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed6806b4d0 msgr2=0x7fed6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed6806b4d0 0x7fed6806d990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed74009560 tx=0x7fed74009190 comp rx=0 tx=0).stop 2024-04-25T08:43:17.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 -- 172.21.15.172:0/83088676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed840cd4c0 msgr2=0x7fed84156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed840cd4c0 0x7fed84156170 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c430 tx=0x7fed7c00c8f0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 -- 172.21.15.172:0/83088676 shutdown_connections 2024-04-25T08:43:17.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed6806b4d0 0x7fed6806d990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed840cd8a0 0x7fed840b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed84150b90 0x7fed84146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 --2- 172.21.15.172:0/83088676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed840cd4c0 0x7fed84156170 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 -- 172.21.15.172:0/83088676 >> 172.21.15.172:0/83088676 conn(0x7fed8406abe0 msgr2=0x7fed8406d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:17.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 -- 172.21.15.172:0/83088676 shutdown_connections 2024-04-25T08:43:17.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.029+0000 7fed8b66b640 1 -- 172.21.15.172:0/83088676 wait complete. 2024-04-25T08:43:17.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:43:17.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.140+0000 7fb5e346b640 1 Processor -- start 2024-04-25T08:43:17.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.140+0000 7fb5e346b640 1 -- start start 2024-04-25T08:43:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5e346b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb5dc15b8a0 0x7fb5dc06abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5e346b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0adf30 con 0x7fb5dc0af520 2024-04-25T08:43:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5e346b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0ad970 con 0x7fb5dc0b4040 2024-04-25T08:43:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5e346b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc0adc50 con 0x7fb5dc15b8a0 2024-04-25T08:43:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5e0a06640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb5dc0af520 0x7fb5dc06b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49714/0 (socket says 172.21.15.172:49714) 2024-04-25T08:43:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5e0a06640 1 -- 172.21.15.172:0/2329826703 learned_addr learned my addr 172.21.15.172:0/2329826703 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762185000 0 0) 0x7fb5cc001110 con 0x7fb5dc0af520 2024-04-25T08:43:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5e1207640 1 --2- 172.21.15.172:0/2329826703 >> v2:172.21.15.186:3300/0 conn(0x7fb5dc15b8a0 0x7fb5dc06abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c8003520 con 0x7fb5dc0af520 2024-04-25T08:43:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3347962262 0 0) 0x7fb5c8003520 con 0x7fb5dc0af520 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 >> v2:172.21.15.186:3300/0 conn(0x7fb5dc15b8a0 msgr2=0x7fb5dc06abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5d3fff640 1 --2- 172.21.15.172:0/2329826703 >> v2:172.21.15.186:3300/0 conn(0x7fb5dc15b8a0 0x7fb5dc06abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 >> v1:172.21.15.186:6789/0 conn(0x7fb5dc0b4040 legacy=0x7fb5dc0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0b3840 con 0x7fb5dc0af520 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.141+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fb5cc001840 con 0x7fb5dc0af520 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 >> v1:172.21.15.172:6789/0 conn(0x7fb5dc0af520 legacy=0x7fb5dc06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5d3fff640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5c80039b0 0x7fb5c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5d3fff640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5c8004800 0x7fb5c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5d3fff640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5c80051c0 0x7fb5c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0adc50 con 0x7fb5c8004800 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c800c060 con 0x7fb5c80039b0 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c800c260 con 0x7fb5c80051c0 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5e0a06640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5c8004800 0x7fb5c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5e1207640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5c80039b0 0x7fb5c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5e1a08640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5c80051c0 0x7fb5c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5e0a06640 1 -- 172.21.15.172:0/2329826703 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5c80051c0 msgr2=0x7fb5c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5e0a06640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5c80051c0 0x7fb5c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5e0a06640 1 -- 172.21.15.172:0/2329826703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5c80039b0 msgr2=0x7fb5c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5e0a06640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5c80039b0 0x7fb5c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5e1a08640 1 -- 172.21.15.172:0/2329826703 reap_dead start 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.142+0000 7fb5e0a06640 1 -- 172.21.15.172:0/2329826703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8003520 con 0x7fb5c8004800 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5e0a06640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5c8004800 0x7fb5c8004c80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00c4c0 tx=0x7fb5c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63295ea8d591d5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00c0e0 con 0x7fb5c8004800 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc034070 con 0x7fb5c8004800 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5d3fff640 1 -- 172.21.15.172:0/2329826703 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc005d30 con 0x7fb5c8004800 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5e346b640 1 -- 172.21.15.172:0/2329826703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5c8004800 msgr2=0x7fb5c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5e346b640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5c8004800 0x7fb5c8004c80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00c4c0 tx=0x7fb5c8005830 comp rx=0 tx=0).stop 2024-04-25T08:43:17.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5e346b640 1 -- 172.21.15.172:0/2329826703 shutdown_connections 2024-04-25T08:43:17.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5e346b640 1 --2- 172.21.15.172:0/2329826703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5c8004800 0x7fb5c8004c80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5e346b640 1 -- 172.21.15.172:0/2329826703 >> 172.21.15.172:0/2329826703 conn(0x7fb5dc0cfec0 msgr2=0x7fb5dc0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:17.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5e346b640 1 -- 172.21.15.172:0/2329826703 shutdown_connections 2024-04-25T08:43:17.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.143+0000 7fb5e346b640 1 -- 172.21.15.172:0/2329826703 wait complete. 2024-04-25T08:43:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e346b640 1 Processor -- start 2024-04-25T08:43:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e346b640 1 -- start start 2024-04-25T08:43:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e346b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5c8004800 0x7fb5dc06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e346b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5dc0cd220 0x7fb5dc0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e346b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc15ca50 0x7fb5dc1f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e346b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc15be00 con 0x7fb5dc15ca50 2024-04-25T08:43:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e346b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc15bc80 con 0x7fb5dc0cd220 2024-04-25T08:43:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e346b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc06abe0 con 0x7fb5c8004800 2024-04-25T08:43:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e1a08640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc15ca50 0x7fb5dc1f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e1a08640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc15ca50 0x7fb5dc1f3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48230/0 (socket says 172.21.15.172:48230) 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.145+0000 7fb5e1a08640 1 -- 172.21.15.172:0/3171923139 learned_addr learned my addr 172.21.15.172:0/3171923139 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e0a06640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5dc0cd220 0x7fb5dc0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e1207640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5c8004800 0x7fb5dc06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e1a08640 1 -- 172.21.15.172:0/3171923139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5c8004800 msgr2=0x7fb5dc06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e1a08640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5c8004800 0x7fb5dc06d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e1a08640 1 -- 172.21.15.172:0/3171923139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5dc0cd220 msgr2=0x7fb5dc0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e1a08640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5dc0cd220 0x7fb5dc0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e1a08640 1 -- 172.21.15.172:0/3171923139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0cd7a0 con 0x7fb5dc15ca50 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e0a06640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5dc0cd220 0x7fb5dc0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e1a08640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc15ca50 0x7fb5dc1f3670 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0ae660 tx=0x7fb5d400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5d1ffb640 1 -- 172.21.15.172:0/3171923139 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400fe50 con 0x7fb5dc15ca50 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5d1ffb640 1 -- 172.21.15.172:0/3171923139 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4018070 con 0x7fb5dc15ca50 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5d1ffb640 1 -- 172.21.15.172:0/3171923139 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4003dc0 con 0x7fb5dc15ca50 2024-04-25T08:43:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e346b640 1 -- 172.21.15.172:0/3171923139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc0cda80 con 0x7fb5dc15ca50 2024-04-25T08:43:17.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.146+0000 7fb5e346b640 1 -- 172.21.15.172:0/3171923139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc0ce040 con 0x7fb5dc15ca50 2024-04-25T08:43:17.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.147+0000 7fb5e346b640 1 -- 172.21.15.172:0/3171923139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc06b680 con 0x7fb5dc15ca50 2024-04-25T08:43:17.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.147+0000 7fb5d1ffb640 1 -- 172.21.15.172:0/3171923139 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb5d40050d0 con 0x7fb5dc15ca50 2024-04-25T08:43:17.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.148+0000 7fb5d1ffb640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5c006b4d0 0x7fb5c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.148+0000 7fb5d1ffb640 1 -- 172.21.15.172:0/3171923139 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb5d408a390 con 0x7fb5dc15ca50 2024-04-25T08:43:17.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.148+0000 7fb5e1207640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5c006b4d0 0x7fb5c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.148+0000 7fb5e1207640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5c006b4d0 0x7fb5c006d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009ae0 tx=0x7fb5d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:17.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.152+0000 7fb5d1ffb640 1 -- 172.21.15.172:0/3171923139 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb5dc06b680 con 0x7fb5dc15ca50 2024-04-25T08:43:17.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.320+0000 7fb5e346b640 1 -- 172.21.15.172:0/3171923139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5dc073a00 con 0x7fb5dc15ca50 2024-04-25T08:43:17.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.320+0000 7fb5d1ffb640 1 -- 172.21.15.172:0/3171923139 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5d4058e10 con 0x7fb5dc15ca50 2024-04-25T08:43:17.313 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.322+0000 7fb5e346b640 1 -- 172.21.15.172:0/3171923139 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5c006b4d0 msgr2=0x7fb5c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.322+0000 7fb5e346b640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5c006b4d0 0x7fb5c006d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009ae0 tx=0x7fb5d8008040 comp rx=0 tx=0).stop 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.322+0000 7fb5e346b640 1 -- 172.21.15.172:0/3171923139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc15ca50 msgr2=0x7fb5dc1f3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.322+0000 7fb5e346b640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc15ca50 0x7fb5dc1f3670 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0ae660 tx=0x7fb5d400fc00 comp rx=0 tx=0).stop 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.322+0000 7fb5e346b640 1 -- 172.21.15.172:0/3171923139 shutdown_connections 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.322+0000 7fb5e346b640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5c006b4d0 0x7fb5c006d990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.322+0000 7fb5e346b640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5dc0cd220 0x7fb5dc0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.322+0000 7fb5e346b640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5dc15ca50 0x7fb5dc1f3670 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.322+0000 7fb5e346b640 1 --2- 172.21.15.172:0/3171923139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5c8004800 0x7fb5dc06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.322+0000 7fb5e346b640 1 -- 172.21.15.172:0/3171923139 >> 172.21.15.172:0/3171923139 conn(0x7fb5dc0cfec0 msgr2=0x7fb5dc06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:17.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.323+0000 7fb5e346b640 1 -- 172.21.15.172:0/3171923139 shutdown_connections 2024-04-25T08:43:17.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.323+0000 7fb5e346b640 1 -- 172.21.15.172:0/3171923139 wait complete. 2024-04-25T08:43:17.326 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:43:17.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.434+0000 7f8899e88640 1 Processor -- start 2024-04-25T08:43:17.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.434+0000 7f8899e88640 1 -- start start 2024-04-25T08:43:17.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.434+0000 7f8899e88640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 0x7f88940ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.434+0000 7f8899e88640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f88940d32f0 0x7f88940cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.434+0000 7f8899e88640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889415e000 con 0x7f8894161710 2024-04-25T08:43:17.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.434+0000 7f8899e88640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88940d1de0 con 0x7f88940d32f0 2024-04-25T08:43:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.434+0000 7f8899e88640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8894161c60 con 0x7f889415dc20 2024-04-25T08:43:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.435+0000 7f8893fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f88940d32f0 0x7f88940cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.435+0000 7f8893fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f88940d32f0 0x7f88940cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48238/0 (socket says 172.21.15.172:48238) 2024-04-25T08:43:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.435+0000 7f8893fff640 1 -- 172.21.15.172:0/375359551 learned_addr learned my addr 172.21.15.172:0/375359551 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.435+0000 7f88937fe640 1 --2- 172.21.15.172:0/375359551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 0x7f88940ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.435+0000 7f8893fff640 1 -- 172.21.15.172:0/375359551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 msgr2=0x7f88940ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.435+0000 7f8893fff640 1 --2- 172.21.15.172:0/375359551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 0x7f88940ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.435+0000 7f8893fff640 1 -- 172.21.15.172:0/375359551 >> v1:172.21.15.186:6789/0 conn(0x7f8894161710 legacy=0x7f889406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.435+0000 7f8893fff640 1 -- 172.21.15.172:0/375359551 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8894161f40 con 0x7f88940d32f0 2024-04-25T08:43:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f8893fff640 1 --2- 172.21.15.172:0/375359551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 0x7f88940cebb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f888c009e50 tx=0x7f888c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea4e5db5d4c8448 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f88927fc640 1 -- 172.21.15.172:0/375359551 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c036070 con 0x7f88940d32f0 2024-04-25T08:43:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f88927fc640 1 -- 172.21.15.172:0/375359551 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c031600 con 0x7f88940d32f0 2024-04-25T08:43:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f88927fc640 1 -- 172.21.15.172:0/375359551 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0319d0 con 0x7f88940d32f0 2024-04-25T08:43:17.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f8899e88640 1 -- 172.21.15.172:0/375359551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 msgr2=0x7f88940cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f8899e88640 1 --2- 172.21.15.172:0/375359551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 0x7f88940cebb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f888c009e50 tx=0x7f888c02a710 comp rx=0 tx=0).stop 2024-04-25T08:43:17.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f8899e88640 1 -- 172.21.15.172:0/375359551 shutdown_connections 2024-04-25T08:43:17.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f8899e88640 1 --2- 172.21.15.172:0/375359551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 0x7f88940cebb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f8899e88640 1 --2- 172.21.15.172:0/375359551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 0x7f88940ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f8899e88640 1 -- 172.21.15.172:0/375359551 >> 172.21.15.172:0/375359551 conn(0x7f88940d0420 msgr2=0x7f88940d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:17.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f8899e88640 1 -- 172.21.15.172:0/375359551 shutdown_connections 2024-04-25T08:43:17.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.436+0000 7f8899e88640 1 -- 172.21.15.172:0/375359551 wait complete. 2024-04-25T08:43:17.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.437+0000 7f8899e88640 1 Processor -- start 2024-04-25T08:43:17.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.438+0000 7f8899e88640 1 -- start start 2024-04-25T08:43:17.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.438+0000 7f8899e88640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 0x7f889414fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.438+0000 7f8899e88640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 0x7f88940b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.438+0000 7f8899e88640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894161710 0x7f88940b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.438+0000 7f8899e88640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88940b5e50 con 0x7f88940d32f0 2024-04-25T08:43:17.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.438+0000 7f8899e88640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8894162500 con 0x7f8894161710 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.438+0000 7f8899e88640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88940b5fd0 con 0x7f889415dc20 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.438+0000 7f88937fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 0x7f889414fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.438+0000 7f88937fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 0x7f889414fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48248/0 (socket says 172.21.15.172:48248) 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.438+0000 7f88937fe640 1 -- 172.21.15.172:0/4067040898 learned_addr learned my addr 172.21.15.172:0/4067040898 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f8893fff640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894161710 0x7f88940b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f8892ffd640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 0x7f88940b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f88937fe640 1 -- 172.21.15.172:0/4067040898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 msgr2=0x7f88940b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f88937fe640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 0x7f88940b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f88937fe640 1 -- 172.21.15.172:0/4067040898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894161710 msgr2=0x7f88940b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f88937fe640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894161710 0x7f88940b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f88937fe640 1 -- 172.21.15.172:0/4067040898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8894150210 con 0x7f88940d32f0 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f8892ffd640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 0x7f88940b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f88937fe640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 0x7f889414fcd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f888400d5d0 tx=0x7f888400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f887bfff640 1 -- 172.21.15.172:0/4067040898 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840125f0 con 0x7f88940d32f0 2024-04-25T08:43:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f887bfff640 1 -- 172.21.15.172:0/4067040898 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8884019070 con 0x7f88940d32f0 2024-04-25T08:43:17.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f8899e88640 1 -- 172.21.15.172:0/4067040898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88941e9390 con 0x7f88940d32f0 2024-04-25T08:43:17.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f887bfff640 1 -- 172.21.15.172:0/4067040898 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840129f0 con 0x7f88940d32f0 2024-04-25T08:43:17.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.439+0000 7f8899e88640 1 -- 172.21.15.172:0/4067040898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88941f45d0 con 0x7f88940d32f0 2024-04-25T08:43:17.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.440+0000 7f8899e88640 1 -- 172.21.15.172:0/4067040898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8894073a00 con 0x7f88940d32f0 2024-04-25T08:43:17.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.441+0000 7f887bfff640 1 -- 172.21.15.172:0/4067040898 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8884012b90 con 0x7f88940d32f0 2024-04-25T08:43:17.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.441+0000 7f887bfff640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f888006b4d0 0x7f888006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.441+0000 7f8892ffd640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f888006b4d0 0x7f888006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.441+0000 7f887bfff640 1 -- 172.21.15.172:0/4067040898 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f888408a9f0 con 0x7f88940d32f0 2024-04-25T08:43:17.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.442+0000 7f8892ffd640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f888006b4d0 0x7f888006d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f88940ccc70 tx=0x7f8888009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:17.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.445+0000 7f887bfff640 1 -- 172.21.15.172:0/4067040898 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8884059470 con 0x7f88940d32f0 2024-04-25T08:43:17.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.617+0000 7f8899e88640 1 -- 172.21.15.172:0/4067040898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88940b5c10 con 0x7f88940d32f0 2024-04-25T08:43:17.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.618+0000 7f887bfff640 1 -- 172.21.15.172:0/4067040898 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8884058d70 con 0x7f88940d32f0 2024-04-25T08:43:17.610 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:43:17.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.619+0000 7f8899e88640 1 -- 172.21.15.172:0/4067040898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f888006b4d0 msgr2=0x7f888006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.619+0000 7f8899e88640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f888006b4d0 0x7f888006d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f88940ccc70 tx=0x7f8888009040 comp rx=0 tx=0).stop 2024-04-25T08:43:17.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.619+0000 7f8899e88640 1 -- 172.21.15.172:0/4067040898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 msgr2=0x7f889414fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.619+0000 7f8899e88640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 0x7f889414fcd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f888400d5d0 tx=0x7f888400da90 comp rx=0 tx=0).stop 2024-04-25T08:43:17.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.620+0000 7f8899e88640 1 -- 172.21.15.172:0/4067040898 shutdown_connections 2024-04-25T08:43:17.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.620+0000 7f8899e88640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f888006b4d0 0x7f888006d990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.620+0000 7f8899e88640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894161710 0x7f88940b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.620+0000 7f8899e88640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f889415dc20 0x7f88940b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.620+0000 7f8899e88640 1 --2- 172.21.15.172:0/4067040898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88940d32f0 0x7f889414fcd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.620+0000 7f8899e88640 1 -- 172.21.15.172:0/4067040898 >> 172.21.15.172:0/4067040898 conn(0x7f88940d0420 msgr2=0x7f88940b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:17.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.620+0000 7f8899e88640 1 -- 172.21.15.172:0/4067040898 shutdown_connections 2024-04-25T08:43:17.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.620+0000 7f8899e88640 1 -- 172.21.15.172:0/4067040898 wait complete. 2024-04-25T08:43:17.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:43:17.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.730+0000 7fa07b389640 1 Processor -- start 2024-04-25T08:43:17.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.730+0000 7fa07b389640 1 -- start start 2024-04-25T08:43:17.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.731+0000 7fa07b389640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa0740ced80 0x7fa0740d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.731+0000 7fa07b389640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07415e000 con 0x7fa074161710 2024-04-25T08:43:17.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.731+0000 7fa07b389640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0740d1de0 con 0x7fa07415dc20 2024-04-25T08:43:17.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.731+0000 7fa07b389640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa074161c60 con 0x7fa0740ced80 2024-04-25T08:43:17.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.731+0000 7fa078924640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa0740ced80 0x7fa0740d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.731+0000 7fa079926640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa074161710 0x7fa0740d2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52590/0 (socket says 172.21.15.172:52590) 2024-04-25T08:43:17.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.731+0000 7fa079926640 1 -- 172.21.15.172:0/1897093824 learned_addr learned my addr 172.21.15.172:0/1897093824 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:17.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.732+0000 7fa06bfff640 1 -- 172.21.15.172:0/1897093824 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352310972 0 0) 0x7fa07415e000 con 0x7fa074161710 2024-04-25T08:43:17.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.732+0000 7fa06bfff640 1 -- 172.21.15.172:0/1897093824 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa060003520 con 0x7fa074161710 2024-04-25T08:43:17.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.732+0000 7fa078924640 1 -- 172.21.15.172:0/1897093824 >> v1:172.21.15.186:6789/0 conn(0x7fa07415dc20 legacy=0x7fa0740ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:17.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.732+0000 7fa078924640 1 -- 172.21.15.172:0/1897093824 >> v1:172.21.15.172:6789/0 conn(0x7fa074161710 legacy=0x7fa0740d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.732+0000 7fa078924640 1 -- 172.21.15.172:0/1897093824 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074161f40 con 0x7fa0740ced80 2024-04-25T08:43:17.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.732+0000 7fa078924640 1 --2- 172.21.15.172:0/1897093824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0740ced80 0x7fa0740d22e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa0640097a0 tx=0x7fa06402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b253cd0eee2ab772 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:17.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.733+0000 7fa06bfff640 1 -- 172.21.15.172:0/1897093824 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064037070 con 0x7fa0740ced80 2024-04-25T08:43:17.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.733+0000 7fa06bfff640 1 -- 172.21.15.172:0/1897093824 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa064032440 con 0x7fa0740ced80 2024-04-25T08:43:17.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.733+0000 7fa06bfff640 1 -- 172.21.15.172:0/1897093824 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064032810 con 0x7fa0740ced80 2024-04-25T08:43:17.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.733+0000 7fa07b389640 1 -- 172.21.15.172:0/1897093824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0740ced80 msgr2=0x7fa0740d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.733+0000 7fa07b389640 1 --2- 172.21.15.172:0/1897093824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0740ced80 0x7fa0740d22e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa0640097a0 tx=0x7fa06402a230 comp rx=0 tx=0).stop 2024-04-25T08:43:17.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.733+0000 7fa07b389640 1 -- 172.21.15.172:0/1897093824 shutdown_connections 2024-04-25T08:43:17.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.733+0000 7fa07b389640 1 --2- 172.21.15.172:0/1897093824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0740ced80 0x7fa0740d22e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.733+0000 7fa07b389640 1 -- 172.21.15.172:0/1897093824 >> 172.21.15.172:0/1897093824 conn(0x7fa0740d0420 msgr2=0x7fa0740d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:17.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.733+0000 7fa07b389640 1 -- 172.21.15.172:0/1897093824 shutdown_connections 2024-04-25T08:43:17.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.733+0000 7fa07b389640 1 -- 172.21.15.172:0/1897093824 wait complete. 2024-04-25T08:43:17.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.734+0000 7fa07b389640 1 Processor -- start 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.734+0000 7fa07b389640 1 -- start start 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa07b389640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0740ced80 0x7fa074157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa07b389640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07415dc20 0x7fa074157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa07b389640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa074161710 0x7fa0741582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa07b389640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0740b5e50 con 0x7fa07415dc20 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa07b389640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa074162500 con 0x7fa074161710 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa07b389640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0740b5fd0 con 0x7fa0740ced80 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa078924640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07415dc20 0x7fa074157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa078924640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07415dc20 0x7fa074157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58876/0 (socket says 172.21.15.172:58876) 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa078924640 1 -- 172.21.15.172:0/270295746 learned_addr learned my addr 172.21.15.172:0/270295746 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa079125640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0740ced80 0x7fa074157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa079926640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa074161710 0x7fa0741582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa078924640 1 -- 172.21.15.172:0/270295746 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0740ced80 msgr2=0x7fa074157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa078924640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0740ced80 0x7fa074157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa078924640 1 -- 172.21.15.172:0/270295746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa074161710 msgr2=0x7fa0741582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.735+0000 7fa078924640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa074161710 0x7fa0741582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.736+0000 7fa078924640 1 -- 172.21.15.172:0/270295746 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074160e00 con 0x7fa07415dc20 2024-04-25T08:43:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.736+0000 7fa078924640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07415dc20 0x7fa074157db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa064035040 tx=0x7fa0640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.736+0000 7fa069ffb640 1 -- 172.21.15.172:0/270295746 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064037040 con 0x7fa07415dc20 2024-04-25T08:43:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.736+0000 7fa069ffb640 1 -- 172.21.15.172:0/270295746 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa064030500 con 0x7fa07415dc20 2024-04-25T08:43:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.736+0000 7fa069ffb640 1 -- 172.21.15.172:0/270295746 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064030910 con 0x7fa07415dc20 2024-04-25T08:43:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.736+0000 7fa07b389640 1 -- 172.21.15.172:0/270295746 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa074156d90 con 0x7fa07415dc20 2024-04-25T08:43:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.736+0000 7fa07b389640 1 -- 172.21.15.172:0/270295746 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa074157350 con 0x7fa07415dc20 2024-04-25T08:43:17.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.737+0000 7fa07b389640 1 -- 172.21.15.172:0/270295746 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa074073a00 con 0x7fa07415dc20 2024-04-25T08:43:17.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.737+0000 7fa069ffb640 1 -- 172.21.15.172:0/270295746 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa064044020 con 0x7fa07415dc20 2024-04-25T08:43:17.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.738+0000 7fa069ffb640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa05806b4d0 0x7fa05806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:17.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.738+0000 7fa069ffb640 1 -- 172.21.15.172:0/270295746 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa0640aa7e0 con 0x7fa07415dc20 2024-04-25T08:43:17.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.738+0000 7fa079125640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa05806b4d0 0x7fa05806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:17.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.738+0000 7fa079125640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa05806b4d0 0x7fa05806d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa070001f10 tx=0x7fa070009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:17.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.742+0000 7fa069ffb640 1 -- 172.21.15.172:0/270295746 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa064078b80 con 0x7fa07415dc20 2024-04-25T08:43:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.913+0000 7fa07b389640 1 -- 172.21.15.172:0/270295746 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa0740d16b0 con 0x7fa07415dc20 2024-04-25T08:43:17.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.913+0000 7fa069ffb640 1 -- 172.21.15.172:0/270295746 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa06407cc20 con 0x7fa07415dc20 2024-04-25T08:43:17.906 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:17.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 -- 172.21.15.172:0/270295746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa05806b4d0 msgr2=0x7fa05806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa05806b4d0 0x7fa05806d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa070001f10 tx=0x7fa070009040 comp rx=0 tx=0).stop 2024-04-25T08:43:17.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 -- 172.21.15.172:0/270295746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07415dc20 msgr2=0x7fa074157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:17.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07415dc20 0x7fa074157db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa064035040 tx=0x7fa0640046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 -- 172.21.15.172:0/270295746 shutdown_connections 2024-04-25T08:43:17.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa05806b4d0 0x7fa05806d990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa074161710 0x7fa0741582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07415dc20 0x7fa074157db0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 --2- 172.21.15.172:0/270295746 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0740ced80 0x7fa074157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 -- 172.21.15.172:0/270295746 >> 172.21.15.172:0/270295746 conn(0x7fa0740d0420 msgr2=0x7fa0740b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 -- 172.21.15.172:0/270295746 shutdown_connections 2024-04-25T08:43:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:17.916+0000 7fa07b389640 1 -- 172.21.15.172:0/270295746 wait complete. 2024-04-25T08:43:17.919 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:43:18.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.024+0000 7f637c2b3640 1 Processor -- start 2024-04-25T08:43:18.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.024+0000 7f637c2b3640 1 -- start start 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.025+0000 7f637c2b3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f637415a9f0 0x7f63740c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.025+0000 7f637c2b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63740cdbf0 0x7f63740ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.025+0000 7f637c2b3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f63740cd520 0x7f63740ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.025+0000 7f637c2b3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63740b0020 con 0x7f637415a9f0 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.025+0000 7f637c2b3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63740cb5a0 con 0x7f63740cd520 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.025+0000 7f637c2b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63740c6940 con 0x7f63740cdbf0 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.025+0000 7f637a04f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f637415a9f0 0x7f63740c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.026+0000 7f637a04f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f637415a9f0 0x7f63740c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58884/0 (socket says 172.21.15.172:58884) 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.026+0000 7f637a04f640 1 -- 172.21.15.172:0/1554692396 learned_addr learned my addr 172.21.15.172:0/1554692396 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.026+0000 7f637984e640 1 --2- 172.21.15.172:0/1554692396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63740cdbf0 0x7f63740ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.026+0000 7f637a850640 1 --2- 172.21.15.172:0/1554692396 >> v2:172.21.15.186:3300/0 conn(0x7f63740cd520 0x7f63740ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.026+0000 7f637a04f640 1 -- 172.21.15.172:0/1554692396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63740cdbf0 msgr2=0x7f63740ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:18.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.026+0000 7f637a04f640 1 --2- 172.21.15.172:0/1554692396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63740cdbf0 0x7f63740ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.026+0000 7f637a04f640 1 -- 172.21.15.172:0/1554692396 >> v2:172.21.15.186:3300/0 conn(0x7f63740cd520 msgr2=0x7f63740ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:18.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.026+0000 7f637a04f640 1 --2- 172.21.15.172:0/1554692396 >> v2:172.21.15.186:3300/0 conn(0x7f63740cd520 0x7f63740ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.026+0000 7f637a04f640 1 -- 172.21.15.172:0/1554692396 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637415add0 con 0x7f637415a9f0 2024-04-25T08:43:18.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.026+0000 7f637a04f640 1 --2- 172.21.15.172:0/1554692396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 0x7f63740c6010 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f63740b6950 tx=0x7f637002c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe9fd105624f76f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:18.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637904d640 1 -- 172.21.15.172:0/1554692396 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637000b2e0 con 0x7f637415a9f0 2024-04-25T08:43:18.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637904d640 1 -- 172.21.15.172:0/1554692396 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6370009600 con 0x7f637415a9f0 2024-04-25T08:43:18.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637904d640 1 -- 172.21.15.172:0/1554692396 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637000b480 con 0x7f637415a9f0 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637c2b3640 1 -- 172.21.15.172:0/1554692396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 msgr2=0x7f63740c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637c2b3640 1 --2- 172.21.15.172:0/1554692396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 0x7f63740c6010 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f63740b6950 tx=0x7f637002c8a0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637c2b3640 1 -- 172.21.15.172:0/1554692396 shutdown_connections 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637c2b3640 1 --2- 172.21.15.172:0/1554692396 >> v2:172.21.15.186:3300/0 conn(0x7f63740cd520 0x7f63740ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637c2b3640 1 --2- 172.21.15.172:0/1554692396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63740cdbf0 0x7f63740ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637c2b3640 1 --2- 172.21.15.172:0/1554692396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 0x7f63740c6010 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637c2b3640 1 -- 172.21.15.172:0/1554692396 >> 172.21.15.172:0/1554692396 conn(0x7f63740b2390 msgr2=0x7f63740b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637c2b3640 1 -- 172.21.15.172:0/1554692396 shutdown_connections 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.027+0000 7f637c2b3640 1 -- 172.21.15.172:0/1554692396 wait complete. 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.028+0000 7f637c2b3640 1 Processor -- start 2024-04-25T08:43:18.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.028+0000 7f637c2b3640 1 -- start start 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637c2b3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63740cd520 0x7f6374149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637c2b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63740cdbf0 0x7f63741f0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637c2b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 0x7f63740b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637c2b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63740cb230 con 0x7f637415a9f0 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637c2b3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63740caf50 con 0x7f63740cd520 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637c2b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63740ce070 con 0x7f63740cdbf0 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637a850640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 0x7f63740b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637a850640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 0x7f63740b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58898/0 (socket says 172.21.15.172:58898) 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637a850640 1 -- 172.21.15.172:0/2754228404 learned_addr learned my addr 172.21.15.172:0/2754228404 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637a04f640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63740cd520 0x7f6374149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.029+0000 7f637984e640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63740cdbf0 0x7f63741f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f637a850640 1 -- 172.21.15.172:0/2754228404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63740cdbf0 msgr2=0x7f63741f0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f637a850640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63740cdbf0 0x7f63741f0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f637a850640 1 -- 172.21.15.172:0/2754228404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63740cd520 msgr2=0x7f6374149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f637a850640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63740cd520 0x7f6374149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f637a850640 1 -- 172.21.15.172:0/2754228404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63740b66d0 con 0x7f637415a9f0 2024-04-25T08:43:18.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f637a850640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 0x7f63740b3480 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f636c00d800 tx=0x7f636c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:18.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f636affd640 1 -- 172.21.15.172:0/2754228404 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c018020 con 0x7f637415a9f0 2024-04-25T08:43:18.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f636affd640 1 -- 172.21.15.172:0/2754228404 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636c0096c0 con 0x7f637415a9f0 2024-04-25T08:43:18.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f636affd640 1 -- 172.21.15.172:0/2754228404 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c009a90 con 0x7f637415a9f0 2024-04-25T08:43:18.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f637c2b3640 1 -- 172.21.15.172:0/2754228404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6374157b10 con 0x7f637415a9f0 2024-04-25T08:43:18.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.030+0000 7f637c2b3640 1 -- 172.21.15.172:0/2754228404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63741580d0 con 0x7f637415a9f0 2024-04-25T08:43:18.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.031+0000 7f637c2b3640 1 -- 172.21.15.172:0/2754228404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637406cc80 con 0x7f637415a9f0 2024-04-25T08:43:18.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.031+0000 7f636affd640 1 -- 172.21.15.172:0/2754228404 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f636c01b020 con 0x7f637415a9f0 2024-04-25T08:43:18.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.032+0000 7f636affd640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635806b4d0 0x7f635806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.032+0000 7f637a04f640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635806b4d0 0x7f635806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.032+0000 7f636affd640 1 -- 172.21.15.172:0/2754228404 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f636c08a7c0 con 0x7f637415a9f0 2024-04-25T08:43:18.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.032+0000 7f637a04f640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635806b4d0 0x7f635806d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6370036000 tx=0x7f637000b000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:18.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.036+0000 7f636affd640 1 -- 172.21.15.172:0/2754228404 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f636c022030 con 0x7f637415a9f0 2024-04-25T08:43:18.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.218+0000 7f637c2b3640 1 -- 172.21.15.172:0/2754228404 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6374073a00 con 0x7f637415a9f0 2024-04-25T08:43:18.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.218+0000 7f636affd640 1 -- 172.21.15.172:0/2754228404 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f636c0102e0 con 0x7f637415a9f0 2024-04-25T08:43:18.210 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:43:18.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 -- 172.21.15.172:0/2754228404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635806b4d0 msgr2=0x7f635806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635806b4d0 0x7f635806d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6370036000 tx=0x7f637000b000 comp rx=0 tx=0).stop 2024-04-25T08:43:18.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 -- 172.21.15.172:0/2754228404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 msgr2=0x7f63740b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 0x7f63740b3480 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f636c00d800 tx=0x7f636c00dcc0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 -- 172.21.15.172:0/2754228404 shutdown_connections 2024-04-25T08:43:18.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635806b4d0 0x7f635806d990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f637415a9f0 0x7f63740b3480 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63740cdbf0 0x7f63741f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 --2- 172.21.15.172:0/2754228404 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63740cd520 0x7f6374149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 -- 172.21.15.172:0/2754228404 >> 172.21.15.172:0/2754228404 conn(0x7f63740b2390 msgr2=0x7f637406e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:18.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 -- 172.21.15.172:0/2754228404 shutdown_connections 2024-04-25T08:43:18.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.220+0000 7f637c2b3640 1 -- 172.21.15.172:0/2754228404 wait complete. 2024-04-25T08:43:18.223 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T08:43:18.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:18.223 DEBUG:teuthology.orchestra.run.smithi186:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T08:43:18.253 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:43:18.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:18.254 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T08:43:18.403 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:43:18.403 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:18.418 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:43:18.418 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:18.474 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:43:18.474 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:18.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:18.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.674+0000 7fa1fa2f5640 1 Processor -- start 2024-04-25T08:43:18.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.674+0000 7fa1fa2f5640 1 -- start start 2024-04-25T08:43:18.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1fa2f5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa1f4144750 0x7fa1f406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1fa2f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1f406eb10 0x7fa1f40ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1fa2f5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa1f40cee60 0x7fa1f415f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1fa2f5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f4144b30 con 0x7fa1f4144750 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1fa2f5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f40712d0 con 0x7fa1f40cee60 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1fa2f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f40715b0 con 0x7fa1f406eb10 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1f3fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa1f4144750 0x7fa1f406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1f3fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa1f4144750 0x7fa1f406e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58908/0 (socket says 172.21.15.172:58908) 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1f3fff640 1 -- 172.21.15.172:0/1836766873 learned_addr learned my addr 172.21.15.172:0/1836766873 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1f3fff640 1 -- 172.21.15.172:0/1836766873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1f406eb10 msgr2=0x7fa1f40ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1f3fff640 1 --2- 172.21.15.172:0/1836766873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1f406eb10 0x7fa1f40ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1f3fff640 1 -- 172.21.15.172:0/1836766873 >> v2:172.21.15.186:3300/0 conn(0x7fa1f40cee60 msgr2=0x7fa1f415f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1f3fff640 1 --2- 172.21.15.172:0/1836766873 >> v2:172.21.15.186:3300/0 conn(0x7fa1f40cee60 0x7fa1f415f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.675+0000 7fa1f3fff640 1 -- 172.21.15.172:0/1836766873 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4071890 con 0x7fa1f4144750 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.676+0000 7fa1f3fff640 1 --2- 172.21.15.172:0/1836766873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f4144750 0x7fa1f406e5d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40b4aa0 tx=0x7fa1e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a782dda666f897 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.676+0000 7fa1f2ffd640 1 -- 172.21.15.172:0/1836766873 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4037070 con 0x7fa1f4144750 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.676+0000 7fa1f2ffd640 1 -- 172.21.15.172:0/1836766873 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e4032440 con 0x7fa1f4144750 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.676+0000 7fa1f2ffd640 1 -- 172.21.15.172:0/1836766873 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4032810 con 0x7fa1f4144750 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.677+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1836766873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f4144750 msgr2=0x7fa1f406e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.677+0000 7fa1fa2f5640 1 --2- 172.21.15.172:0/1836766873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f4144750 0x7fa1f406e5d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40b4aa0 tx=0x7fa1e402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.677+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1836766873 shutdown_connections 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.677+0000 7fa1fa2f5640 1 --2- 172.21.15.172:0/1836766873 >> v2:172.21.15.186:3300/0 conn(0x7fa1f40cee60 0x7fa1f415f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.677+0000 7fa1fa2f5640 1 --2- 172.21.15.172:0/1836766873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1f406eb10 0x7fa1f40ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.677+0000 7fa1fa2f5640 1 --2- 172.21.15.172:0/1836766873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f4144750 0x7fa1f406e5d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.677+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1836766873 >> 172.21.15.172:0/1836766873 conn(0x7fa1f406abe0 msgr2=0x7fa1f406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.677+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1836766873 shutdown_connections 2024-04-25T08:43:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.677+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1836766873 wait complete. 2024-04-25T08:43:18.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.678+0000 7fa1fa2f5640 1 Processor -- start 2024-04-25T08:43:18.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.678+0000 7fa1fa2f5640 1 -- start start 2024-04-25T08:43:18.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1fa2f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f406eb10 0x7fa1f413e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1fa2f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f40cee60 0x7fa1f41f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1fa2f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1f4144750 0x7fa1f41f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1fa2f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4145450 con 0x7fa1f406eb10 2024-04-25T08:43:18.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1fa2f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f406f020 con 0x7fa1f40cee60 2024-04-25T08:43:18.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1fa2f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f41455d0 con 0x7fa1f4144750 2024-04-25T08:43:18.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f406eb10 0x7fa1f413e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f406eb10 0x7fa1f413e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58914/0 (socket says 172.21.15.172:58914) 2024-04-25T08:43:18.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f3fff640 1 -- 172.21.15.172:0/1199734976 learned_addr learned my addr 172.21.15.172:0/1199734976 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f8892640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1f4144750 0x7fa1f41f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f3fff640 1 -- 172.21.15.172:0/1199734976 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1f4144750 msgr2=0x7fa1f41f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f37fe640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f40cee60 0x7fa1f41f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f3fff640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1f4144750 0x7fa1f41f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f3fff640 1 -- 172.21.15.172:0/1199734976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f40cee60 msgr2=0x7fa1f41f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f3fff640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f40cee60 0x7fa1f41f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f3fff640 1 -- 172.21.15.172:0/1199734976 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f413eee0 con 0x7fa1f406eb10 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f37fe640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f40cee60 0x7fa1f41f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f8892640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1f4144750 0x7fa1f41f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.679+0000 7fa1f3fff640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f406eb10 0x7fa1f413e9a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4000c00 tx=0x7fa1e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.680+0000 7fa1f0ff9640 1 -- 172.21.15.172:0/1199734976 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4041070 con 0x7fa1f406eb10 2024-04-25T08:43:18.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.680+0000 7fa1f0ff9640 1 -- 172.21.15.172:0/1199734976 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e403c870 con 0x7fa1f406eb10 2024-04-25T08:43:18.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.680+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1199734976 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f40a9c30 con 0x7fa1f406eb10 2024-04-25T08:43:18.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.680+0000 7fa1f0ff9640 1 -- 172.21.15.172:0/1199734976 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4037040 con 0x7fa1f406eb10 2024-04-25T08:43:18.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.680+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1199734976 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f415ccf0 con 0x7fa1f406eb10 2024-04-25T08:43:18.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.681+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1199734976 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f4073990 con 0x7fa1f406eb10 2024-04-25T08:43:18.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.681+0000 7fa1f0ff9640 1 -- 172.21.15.172:0/1199734976 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa1e4044070 con 0x7fa1f406eb10 2024-04-25T08:43:18.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.681+0000 7fa1f0ff9640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa1e006b4d0 0x7fa1e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.681+0000 7fa1f0ff9640 1 -- 172.21.15.172:0/1199734976 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa1e40ab110 con 0x7fa1f406eb10 2024-04-25T08:43:18.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.681+0000 7fa1f37fe640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa1e006b4d0 0x7fa1e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.682+0000 7fa1f37fe640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa1e006b4d0 0x7fa1e006d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa1f415e3f0 tx=0x7fa1e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:18.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.686+0000 7fa1f0ff9640 1 -- 172.21.15.172:0/1199734976 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa1e4079d40 con 0x7fa1f406eb10 2024-04-25T08:43:18.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.858+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1199734976 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1f41409b0 con 0x7fa1f406eb10 2024-04-25T08:43:18.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.860+0000 7fa1f0ff9640 1 -- 172.21.15.172:0/1199734976 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18905 (secure 0 0 0) 0x7fa1e4079640 con 0x7fa1f406eb10 2024-04-25T08:43:18.852 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:18.852 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:09.821048+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:18.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1199734976 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa1e006b4d0 msgr2=0x7fa1e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa1e006b4d0 0x7fa1e006d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa1f415e3f0 tx=0x7fa1e8008040 comp rx=0 tx=0).stop 2024-04-25T08:43:18.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1199734976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f406eb10 msgr2=0x7fa1f413e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f406eb10 0x7fa1f413e9a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4000c00 tx=0x7fa1e40046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1199734976 shutdown_connections 2024-04-25T08:43:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa1e006b4d0 0x7fa1e006d990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1f40cee60 0x7fa1f41f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1f4144750 0x7fa1f41f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 --2- 172.21.15.172:0/1199734976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1f406eb10 0x7fa1f413e9a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1199734976 >> 172.21.15.172:0/1199734976 conn(0x7fa1f406abe0 msgr2=0x7fa1f4140c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1199734976 shutdown_connections 2024-04-25T08:43:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.862+0000 7fa1fa2f5640 1 -- 172.21.15.172:0/1199734976 wait complete. 2024-04-25T08:43:18.865 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:43:18.866 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:18.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.974+0000 7f603fe31640 1 Processor -- start 2024-04-25T08:43:18.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.974+0000 7f603fe31640 1 -- start start 2024-04-25T08:43:18.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.975+0000 7f603fe31640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 0x7f603806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.975+0000 7f603fe31640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f603815deb0 0x7f603815e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.975+0000 7f603fe31640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380d1770 con 0x7f60380711a0 2024-04-25T08:43:18.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.975+0000 7f603fe31640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60380b0eb0 con 0x7f603815deb0 2024-04-25T08:43:18.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.975+0000 7f603fe31640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60381622b0 con 0x7f6038070dc0 2024-04-25T08:43:18.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.975+0000 7f603e3ce640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f603815deb0 0x7f603815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.975+0000 7f603dbcd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 0x7f603806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.975+0000 7f603d3cc640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f60380711a0 0x7f60380b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:43764/0 (socket says 172.21.15.172:43764) 2024-04-25T08:43:18.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.975+0000 7f603e3ce640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f603815deb0 0x7f603815e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:48170/0 (socket says 172.21.15.172:48170) 2024-04-25T08:43:18.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.975+0000 7f603d3cc640 1 -- 172.21.15.172:0/1996214221 learned_addr learned my addr 172.21.15.172:0/1996214221 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:18.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.976+0000 7f603dbcd640 1 -- 172.21.15.172:0/1996214221 >> v2:172.21.15.186:3300/0 conn(0x7f603815deb0 msgr2=0x7f603815e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:18.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.976+0000 7f603dbcd640 1 --2- 172.21.15.172:0/1996214221 >> v2:172.21.15.186:3300/0 conn(0x7f603815deb0 0x7f603815e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.976+0000 7f603dbcd640 1 -- 172.21.15.172:0/1996214221 >> v1:172.21.15.186:6789/0 conn(0x7f60380711a0 legacy=0x7f60380b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.976+0000 7f603dbcd640 1 -- 172.21.15.172:0/1996214221 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038162740 con 0x7f6038070dc0 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.976+0000 7f603e3ce640 1 --2- 172.21.15.172:0/1996214221 >> v2:172.21.15.186:3300/0 conn(0x7f603815deb0 0x7f603815e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603dbcd640 1 --2- 172.21.15.172:0/1996214221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 0x7f603806ccd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6034009d90 tx=0x7f603402a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cebdd4cf66c91709 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603cbcb640 1 -- 172.21.15.172:0/1996214221 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034007740 con 0x7f6038070dc0 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603cbcb640 1 -- 172.21.15.172:0/1996214221 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60340078e0 con 0x7f6038070dc0 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603cbcb640 1 -- 172.21.15.172:0/1996214221 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034007cb0 con 0x7f6038070dc0 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603fe31640 1 -- 172.21.15.172:0/1996214221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 msgr2=0x7f603806ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603fe31640 1 --2- 172.21.15.172:0/1996214221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 0x7f603806ccd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6034009d90 tx=0x7f603402a530 comp rx=0 tx=0).stop 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603fe31640 1 -- 172.21.15.172:0/1996214221 shutdown_connections 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603fe31640 1 --2- 172.21.15.172:0/1996214221 >> v2:172.21.15.186:3300/0 conn(0x7f603815deb0 0x7f603815e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603fe31640 1 --2- 172.21.15.172:0/1996214221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 0x7f603806ccd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603fe31640 1 -- 172.21.15.172:0/1996214221 >> 172.21.15.172:0/1996214221 conn(0x7f60380b3530 msgr2=0x7f60380b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:18.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603fe31640 1 -- 172.21.15.172:0/1996214221 shutdown_connections 2024-04-25T08:43:18.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.977+0000 7f603fe31640 1 -- 172.21.15.172:0/1996214221 wait complete. 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.978+0000 7f603fe31640 1 Processor -- start 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.979+0000 7f603fe31640 1 -- start start 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.979+0000 7f603fe31640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 0x7f60380cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.979+0000 7f603fe31640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60380711a0 0x7f60380d0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.979+0000 7f603fe31640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603815deb0 0x7f60380d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.979+0000 7f603fe31640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6038161c60 con 0x7f603815deb0 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.979+0000 7f603fe31640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60380b10f0 con 0x7f60380711a0 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.979+0000 7f603fe31640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6038161f40 con 0x7f6038070dc0 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.979+0000 7f603e3ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603815deb0 0x7f60380d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.979+0000 7f603e3ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603815deb0 0x7f60380d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58916/0 (socket says 172.21.15.172:58916) 2024-04-25T08:43:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.979+0000 7f603e3ce640 1 -- 172.21.15.172:0/156678350 learned_addr learned my addr 172.21.15.172:0/156678350 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f603dbcd640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 0x7f60380cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f603d3cc640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60380711a0 0x7f60380d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f603e3ce640 1 -- 172.21.15.172:0/156678350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 msgr2=0x7f60380cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f603e3ce640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 0x7f60380cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f603e3ce640 1 -- 172.21.15.172:0/156678350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60380711a0 msgr2=0x7f60380d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f603e3ce640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60380711a0 0x7f60380d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f603e3ce640 1 -- 172.21.15.172:0/156678350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038160620 con 0x7f603815deb0 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f603e3ce640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603815deb0 0x7f60380d0ad0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f603000e880 tx=0x7f603000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f602e7fc640 1 -- 172.21.15.172:0/156678350 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030017070 con 0x7f603815deb0 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f602e7fc640 1 -- 172.21.15.172:0/156678350 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6030004020 con 0x7f603815deb0 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f603fe31640 1 -- 172.21.15.172:0/156678350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6038160900 con 0x7f603815deb0 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f602e7fc640 1 -- 172.21.15.172:0/156678350 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300043f0 con 0x7f603815deb0 2024-04-25T08:43:18.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.980+0000 7f603fe31640 1 -- 172.21.15.172:0/156678350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603815f8b0 con 0x7f603815deb0 2024-04-25T08:43:18.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.981+0000 7f603fe31640 1 -- 172.21.15.172:0/156678350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6038073a00 con 0x7f603815deb0 2024-04-25T08:43:18.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.981+0000 7f602e7fc640 1 -- 172.21.15.172:0/156678350 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f603000c940 con 0x7f603815deb0 2024-04-25T08:43:18.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.982+0000 7f602e7fc640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f601c06b4d0 0x7f601c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:18.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.982+0000 7f602e7fc640 1 -- 172.21.15.172:0/156678350 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f603008a6c0 con 0x7f603815deb0 2024-04-25T08:43:18.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.982+0000 7f603dbcd640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f601c06b4d0 0x7f601c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:18.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.982+0000 7f603dbcd640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f601c06b4d0 0x7f601c06d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6034034000 tx=0x7f603402f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:18.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:18.986+0000 7f602e7fc640 1 -- 172.21.15.172:0/156678350 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f60300591d0 con 0x7f603815deb0 2024-04-25T08:43:19.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.157+0000 7f603fe31640 1 -- 172.21.15.172:0/156678350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60380b1760 con 0x7f603815deb0 2024-04-25T08:43:19.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.157+0000 7f602e7fc640 1 -- 172.21.15.172:0/156678350 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6030058ad0 con 0x7f603815deb0 2024-04-25T08:43:19.149 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:19.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 -- 172.21.15.172:0/156678350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f601c06b4d0 msgr2=0x7f601c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f601c06b4d0 0x7f601c06d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6034034000 tx=0x7f603402f000 comp rx=0 tx=0).stop 2024-04-25T08:43:19.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 -- 172.21.15.172:0/156678350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603815deb0 msgr2=0x7f60380d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603815deb0 0x7f60380d0ad0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f603000e880 tx=0x7f603000ed40 comp rx=0 tx=0).stop 2024-04-25T08:43:19.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 -- 172.21.15.172:0/156678350 shutdown_connections 2024-04-25T08:43:19.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f601c06b4d0 0x7f601c06d990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60380711a0 0x7f60380d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603815deb0 0x7f60380d0ad0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 --2- 172.21.15.172:0/156678350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6038070dc0 0x7f60380cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 -- 172.21.15.172:0/156678350 >> 172.21.15.172:0/156678350 conn(0x7f60380b3530 msgr2=0x7f60380ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:19.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 -- 172.21.15.172:0/156678350 shutdown_connections 2024-04-25T08:43:19.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.159+0000 7f603fe31640 1 -- 172.21.15.172:0/156678350 wait complete. 2024-04-25T08:43:19.162 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:43:19.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.271+0000 7f062f64c640 1 Processor -- start 2024-04-25T08:43:19.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.271+0000 7f062f64c640 1 -- start start 2024-04-25T08:43:19.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062f64c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0628158230 0x7f06280d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062f64c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f06280d1b80 0x7f062806c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062f64c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062806c870 0x7f06280b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062f64c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0628158610 con 0x7f06280d1b80 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062f64c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062806bea0 con 0x7f0628158230 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062f64c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06280d2020 con 0x7f062806c870 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062cbe7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f06280d1b80 0x7f062806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062cbe7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f06280d1b80 0x7f062806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58920/0 (socket says 172.21.15.172:58920) 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062cbe7640 1 -- 172.21.15.172:0/3890623292 learned_addr learned my addr 172.21.15.172:0/3890623292 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062d3e8640 1 --2- 172.21.15.172:0/3890623292 >> v2:172.21.15.186:3300/0 conn(0x7f0628158230 0x7f06280d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062dbe9640 1 --2- 172.21.15.172:0/3890623292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062806c870 0x7f06280b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062cbe7640 1 -- 172.21.15.172:0/3890623292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062806c870 msgr2=0x7f06280b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062cbe7640 1 --2- 172.21.15.172:0/3890623292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062806c870 0x7f06280b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062cbe7640 1 -- 172.21.15.172:0/3890623292 >> v2:172.21.15.186:3300/0 conn(0x7f0628158230 msgr2=0x7f06280d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062cbe7640 1 --2- 172.21.15.172:0/3890623292 >> v2:172.21.15.186:3300/0 conn(0x7f0628158230 0x7f06280d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.272+0000 7f062cbe7640 1 -- 172.21.15.172:0/3890623292 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06280d2300 con 0x7f06280d1b80 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.273+0000 7f062cbe7640 1 --2- 172.21.15.172:0/3890623292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06280d1b80 0x7f062806c330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0628070460 tx=0x7f061802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16980d8856e11bc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.273+0000 7f061ffff640 1 -- 172.21.15.172:0/3890623292 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618004030 con 0x7f06280d1b80 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.273+0000 7f061ffff640 1 -- 172.21.15.172:0/3890623292 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06180041d0 con 0x7f06280d1b80 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.273+0000 7f061ffff640 1 -- 172.21.15.172:0/3890623292 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618003610 con 0x7f06280d1b80 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.273+0000 7f062f64c640 1 -- 172.21.15.172:0/3890623292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06280d1b80 msgr2=0x7f062806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.273+0000 7f062f64c640 1 --2- 172.21.15.172:0/3890623292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06280d1b80 0x7f062806c330 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0628070460 tx=0x7f061802a1c0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.274+0000 7f062f64c640 1 -- 172.21.15.172:0/3890623292 shutdown_connections 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.274+0000 7f062f64c640 1 --2- 172.21.15.172:0/3890623292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062806c870 0x7f06280b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.274+0000 7f062f64c640 1 --2- 172.21.15.172:0/3890623292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06280d1b80 0x7f062806c330 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.274+0000 7f062f64c640 1 --2- 172.21.15.172:0/3890623292 >> v2:172.21.15.186:3300/0 conn(0x7f0628158230 0x7f06280d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.274+0000 7f062f64c640 1 -- 172.21.15.172:0/3890623292 >> 172.21.15.172:0/3890623292 conn(0x7f0628061600 msgr2=0x7f06280619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.274+0000 7f062f64c640 1 -- 172.21.15.172:0/3890623292 shutdown_connections 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.274+0000 7f062f64c640 1 -- 172.21.15.172:0/3890623292 wait complete. 2024-04-25T08:43:19.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.275+0000 7f062f64c640 1 Processor -- start 2024-04-25T08:43:19.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.275+0000 7f062f64c640 1 -- start start 2024-04-25T08:43:19.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.275+0000 7f062f64c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062806c870 0x7f06281f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.275+0000 7f062f64c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06280d1b80 0x7f0628151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.275+0000 7f062f64c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0628158230 0x7f06281f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.275+0000 7f062f64c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062815e320 con 0x7f0628158230 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.275+0000 7f062f64c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06280d25e0 con 0x7f06280d1b80 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.275+0000 7f062f64c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062815e4a0 con 0x7f062806c870 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062dbe9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0628158230 0x7f06281f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062dbe9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0628158230 0x7f06281f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58934/0 (socket says 172.21.15.172:58934) 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062dbe9640 1 -- 172.21.15.172:0/3169012 learned_addr learned my addr 172.21.15.172:0/3169012 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062cbe7640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06280d1b80 0x7f0628151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062d3e8640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062806c870 0x7f06281f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062dbe9640 1 -- 172.21.15.172:0/3169012 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062806c870 msgr2=0x7f06281f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062dbe9640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062806c870 0x7f06281f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062dbe9640 1 -- 172.21.15.172:0/3169012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06280d1b80 msgr2=0x7f0628151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062dbe9640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06280d1b80 0x7f0628151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062dbe9640 1 -- 172.21.15.172:0/3169012 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06281f3c00 con 0x7f0628158230 2024-04-25T08:43:19.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062dbe9640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0628158230 0x7f06281f36c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f062000e930 tx=0x7f062000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:19.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f061dffb640 1 -- 172.21.15.172:0/3169012 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620017070 con 0x7f0628158230 2024-04-25T08:43:19.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f061dffb640 1 -- 172.21.15.172:0/3169012 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062000c980 con 0x7f0628158230 2024-04-25T08:43:19.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f061dffb640 1 -- 172.21.15.172:0/3169012 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000cd70 con 0x7f0628158230 2024-04-25T08:43:19.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062f64c640 1 -- 172.21.15.172:0/3169012 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0628145350 con 0x7f0628158230 2024-04-25T08:43:19.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.276+0000 7f062f64c640 1 -- 172.21.15.172:0/3169012 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0628145910 con 0x7f0628158230 2024-04-25T08:43:19.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.277+0000 7f062f64c640 1 -- 172.21.15.172:0/3169012 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062806de50 con 0x7f0628158230 2024-04-25T08:43:19.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.278+0000 7f061dffb640 1 -- 172.21.15.172:0/3169012 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f062001a070 con 0x7f0628158230 2024-04-25T08:43:19.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.278+0000 7f061dffb640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f060c06b4d0 0x7f060c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.278+0000 7f061dffb640 1 -- 172.21.15.172:0/3169012 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f062008a530 con 0x7f0628158230 2024-04-25T08:43:19.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.278+0000 7f062d3e8640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f060c06b4d0 0x7f060c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.279+0000 7f062d3e8640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f060c06b4d0 0x7f060c06d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0624011340 tx=0x7f062400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:19.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.282+0000 7f061dffb640 1 -- 172.21.15.172:0/3169012 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0620058a20 con 0x7f0628158230 2024-04-25T08:43:19.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.451+0000 7f062f64c640 1 -- 172.21.15.172:0/3169012 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0628073a00 con 0x7f0628158230 2024-04-25T08:43:19.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.452+0000 7f061dffb640 1 -- 172.21.15.172:0/3169012 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f062005cac0 con 0x7f0628158230 2024-04-25T08:43:19.444 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 -- 172.21.15.172:0/3169012 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f060c06b4d0 msgr2=0x7f060c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f060c06b4d0 0x7f060c06d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0624011340 tx=0x7f062400b040 comp rx=0 tx=0).stop 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 -- 172.21.15.172:0/3169012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0628158230 msgr2=0x7f06281f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0628158230 0x7f06281f36c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f062000e930 tx=0x7f062000edf0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 -- 172.21.15.172:0/3169012 shutdown_connections 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f060c06b4d0 0x7f060c06d990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06280d1b80 0x7f0628151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0628158230 0x7f06281f36c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 --2- 172.21.15.172:0/3169012 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062806c870 0x7f06281f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 -- 172.21.15.172:0/3169012 >> 172.21.15.172:0/3169012 conn(0x7f0628061600 msgr2=0x7f06280cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 -- 172.21.15.172:0/3169012 shutdown_connections 2024-04-25T08:43:19.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.454+0000 7f062f64c640 1 -- 172.21.15.172:0/3169012 wait complete. 2024-04-25T08:43:19.457 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:43:19.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.565+0000 7fc67f534640 1 Processor -- start 2024-04-25T08:43:19.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.566+0000 7fc67f534640 1 -- start start 2024-04-25T08:43:19.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.566+0000 7fc67f534640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6780ccdd0 0x7fc6780cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.566+0000 7fc67f534640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6780cdcd0 0x7fc6780cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.566+0000 7fc67f534640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6780cb190 con 0x7fc67815bb20 2024-04-25T08:43:19.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.566+0000 7fc67f534640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6780d0450 con 0x7fc6780cdcd0 2024-04-25T08:43:19.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.566+0000 7fc67f534640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780cb470 con 0x7fc6780ccdd0 2024-04-25T08:43:19.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.566+0000 7fc67dad1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6780cdcd0 0x7fc6780cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.566+0000 7fc67d2d0640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc67815bb20 0x7fc6780cc230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52594/0 (socket says 172.21.15.172:52594) 2024-04-25T08:43:19.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.567+0000 7fc67d2d0640 1 -- 172.21.15.172:0/622908915 learned_addr learned my addr 172.21.15.172:0/622908915 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:19.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.567+0000 7fc67cacf640 1 --2- 172.21.15.172:0/622908915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6780ccdd0 0x7fc6780cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.567+0000 7fc67dad1640 1 -- 172.21.15.172:0/622908915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6780ccdd0 msgr2=0x7fc6780cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:19.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.567+0000 7fc67dad1640 1 --2- 172.21.15.172:0/622908915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6780ccdd0 0x7fc6780cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.567+0000 7fc67dad1640 1 -- 172.21.15.172:0/622908915 >> v1:172.21.15.172:6789/0 conn(0x7fc67815bb20 legacy=0x7fc6780cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.567+0000 7fc67dad1640 1 -- 172.21.15.172:0/622908915 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780cb750 con 0x7fc6780cdcd0 2024-04-25T08:43:19.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.567+0000 7fc66ffff640 1 -- 172.21.15.172:0/622908915 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964061128 0 0) 0x7fc6780cb190 con 0x7fc67815bb20 2024-04-25T08:43:19.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.567+0000 7fc67cacf640 1 --2- 172.21.15.172:0/622908915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6780ccdd0 0x7fc6780cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:19.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.567+0000 7fc67dad1640 1 --2- 172.21.15.172:0/622908915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 0x7fc6780cff10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc6700097a0 tx=0x7fc67002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afc3f3181424ecb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:19.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc66ffff640 1 -- 172.21.15.172:0/622908915 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc670037070 con 0x7fc6780cdcd0 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc66ffff640 1 -- 172.21.15.172:0/622908915 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67002ae50 con 0x7fc6780cdcd0 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc66ffff640 1 -- 172.21.15.172:0/622908915 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc670032660 con 0x7fc6780cdcd0 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc67f534640 1 -- 172.21.15.172:0/622908915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 msgr2=0x7fc6780cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc67f534640 1 --2- 172.21.15.172:0/622908915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 0x7fc6780cff10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc6700097a0 tx=0x7fc67002a100 comp rx=0 tx=0).stop 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc67f534640 1 -- 172.21.15.172:0/622908915 shutdown_connections 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc67f534640 1 --2- 172.21.15.172:0/622908915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6780ccdd0 0x7fc6780cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc67f534640 1 --2- 172.21.15.172:0/622908915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 0x7fc6780cff10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc67f534640 1 -- 172.21.15.172:0/622908915 >> 172.21.15.172:0/622908915 conn(0x7fc6780b2390 msgr2=0x7fc6780b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc67f534640 1 -- 172.21.15.172:0/622908915 shutdown_connections 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.568+0000 7fc67f534640 1 -- 172.21.15.172:0/622908915 wait complete. 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.569+0000 7fc67f534640 1 Processor -- start 2024-04-25T08:43:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.569+0000 7fc67f534640 1 -- start start 2024-04-25T08:43:19.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67f534640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6780ccdd0 0x7fc6780c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67f534640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 0x7fc678151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67f534640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc67815bb20 0x7fc6780c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67f534640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67815bf00 con 0x7fc6780cdcd0 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67f534640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780cbd10 con 0x7fc6780ccdd0 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67f534640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67815c080 con 0x7fc67815bb20 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67cacf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 0x7fc678151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67cacf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 0x7fc678151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58950/0 (socket says 172.21.15.172:58950) 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67cacf640 1 -- 172.21.15.172:0/1896446329 learned_addr learned my addr 172.21.15.172:0/1896446329 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67dad1640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc67815bb20 0x7fc6780c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.570+0000 7fc67d2d0640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6780ccdd0 0x7fc6780c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc67cacf640 1 -- 172.21.15.172:0/1896446329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc67815bb20 msgr2=0x7fc6780c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc67cacf640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc67815bb20 0x7fc6780c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc67cacf640 1 -- 172.21.15.172:0/1896446329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6780ccdd0 msgr2=0x7fc6780c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc67cacf640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6780ccdd0 0x7fc6780c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc67cacf640 1 -- 172.21.15.172:0/1896446329 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780b5d90 con 0x7fc6780cdcd0 2024-04-25T08:43:19.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc67cacf640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 0x7fc678151c10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc66800e7e0 tx=0x7fc66800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:19.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc66dffb640 1 -- 172.21.15.172:0/1896446329 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66800f040 con 0x7fc6780cdcd0 2024-04-25T08:43:19.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc66dffb640 1 -- 172.21.15.172:0/1896446329 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc668004030 con 0x7fc6780cdcd0 2024-04-25T08:43:19.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc67f534640 1 -- 172.21.15.172:0/1896446329 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67815f0d0 con 0x7fc6780cdcd0 2024-04-25T08:43:19.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc66dffb640 1 -- 172.21.15.172:0/1896446329 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc668004400 con 0x7fc6780cdcd0 2024-04-25T08:43:19.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.571+0000 7fc67f534640 1 -- 172.21.15.172:0/1896446329 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6780c7830 con 0x7fc6780cdcd0 2024-04-25T08:43:19.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.572+0000 7fc67f534640 1 -- 172.21.15.172:0/1896446329 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc678073a00 con 0x7fc6780cdcd0 2024-04-25T08:43:19.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.572+0000 7fc66dffb640 1 -- 172.21.15.172:0/1896446329 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc66800c6d0 con 0x7fc6780cdcd0 2024-04-25T08:43:19.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.573+0000 7fc66dffb640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc65c06b4d0 0x7fc65c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.573+0000 7fc67d2d0640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc65c06b4d0 0x7fc65c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.573+0000 7fc66dffb640 1 -- 172.21.15.172:0/1896446329 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc66808a390 con 0x7fc6780cdcd0 2024-04-25T08:43:19.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.573+0000 7fc67d2d0640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc65c06b4d0 0x7fc65c06d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc674007ed0 tx=0x7fc674007e60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:19.569 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.577+0000 7fc66dffb640 1 -- 172.21.15.172:0/1896446329 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc668017020 con 0x7fc6780cdcd0 2024-04-25T08:43:19.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.747+0000 7fc67f534640 1 -- 172.21.15.172:0/1896446329 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc678157ec0 con 0x7fc6780cdcd0 2024-04-25T08:43:19.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.748+0000 7fc66dffb640 1 -- 172.21.15.172:0/1896446329 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc668058e10 con 0x7fc6780cdcd0 2024-04-25T08:43:19.740 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:43:19.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 -- 172.21.15.172:0/1896446329 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc65c06b4d0 msgr2=0x7fc65c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc65c06b4d0 0x7fc65c06d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc674007ed0 tx=0x7fc674007e60 comp rx=0 tx=0).stop 2024-04-25T08:43:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 -- 172.21.15.172:0/1896446329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 msgr2=0x7fc678151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 0x7fc678151c10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc66800e7e0 tx=0x7fc66800eca0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 -- 172.21.15.172:0/1896446329 shutdown_connections 2024-04-25T08:43:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc65c06b4d0 0x7fc65c06d990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc67815bb20 0x7fc6780c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6780cdcd0 0x7fc678151c10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 --2- 172.21.15.172:0/1896446329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6780ccdd0 0x7fc6780c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 -- 172.21.15.172:0/1896446329 >> 172.21.15.172:0/1896446329 conn(0x7fc6780b2390 msgr2=0x7fc6780ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 -- 172.21.15.172:0/1896446329 shutdown_connections 2024-04-25T08:43:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.750+0000 7fc67f534640 1 -- 172.21.15.172:0/1896446329 wait complete. 2024-04-25T08:43:19.753 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:43:19.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.861+0000 7f2f92ff5640 1 Processor -- start 2024-04-25T08:43:19.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.861+0000 7f2f92ff5640 1 -- start start 2024-04-25T08:43:19.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f92ff5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2f8c06abe0 0x7f2f8c06afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f92ff5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f8c0ad570 0x7f2f8c06ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f92ff5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c06b500 con 0x7f2f8c15dd80 2024-04-25T08:43:19.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f92ff5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c06e410 con 0x7f2f8c0ad570 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f92ff5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b3930 con 0x7f2f8c06abe0 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f91592640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f8c0ad570 0x7f2f8c06ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f91592640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f8c0ad570 0x7f2f8c06ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58962/0 (socket says 172.21.15.172:58962) 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f91592640 1 -- 172.21.15.172:0/557416516 learned_addr learned my addr 172.21.15.172:0/557416516 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f90d91640 1 --2- 172.21.15.172:0/557416516 >> v2:172.21.15.186:3300/0 conn(0x7f2f8c06abe0 0x7f2f8c06afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f91592640 1 -- 172.21.15.172:0/557416516 >> v2:172.21.15.186:3300/0 conn(0x7f2f8c06abe0 msgr2=0x7f2f8c06afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f91592640 1 --2- 172.21.15.172:0/557416516 >> v2:172.21.15.186:3300/0 conn(0x7f2f8c06abe0 0x7f2f8c06afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f91592640 1 -- 172.21.15.172:0/557416516 >> v1:172.21.15.186:6789/0 conn(0x7f2f8c15dd80 legacy=0x7f2f8c0b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.862+0000 7f2f91592640 1 -- 172.21.15.172:0/557416516 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0b3c10 con 0x7f2f8c0ad570 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.863+0000 7f2f91592640 1 --2- 172.21.15.172:0/557416516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ad570 0x7f2f8c06ee60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c06e590 tx=0x7f2f8402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cad0c7b57a2e03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.863+0000 7f2f8b7fe640 1 -- 172.21.15.172:0/557416516 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84036070 con 0x7f2f8c0ad570 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.863+0000 7f2f8b7fe640 1 -- 172.21.15.172:0/557416516 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f84031600 con 0x7f2f8c0ad570 2024-04-25T08:43:19.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.863+0000 7f2f8b7fe640 1 -- 172.21.15.172:0/557416516 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f840319d0 con 0x7f2f8c0ad570 2024-04-25T08:43:19.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.864+0000 7f2f92ff5640 1 -- 172.21.15.172:0/557416516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ad570 msgr2=0x7f2f8c06ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.864+0000 7f2f92ff5640 1 --2- 172.21.15.172:0/557416516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ad570 0x7f2f8c06ee60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c06e590 tx=0x7f2f8402a730 comp rx=0 tx=0).stop 2024-04-25T08:43:19.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.864+0000 7f2f92ff5640 1 -- 172.21.15.172:0/557416516 shutdown_connections 2024-04-25T08:43:19.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.864+0000 7f2f92ff5640 1 --2- 172.21.15.172:0/557416516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ad570 0x7f2f8c06ee60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.864+0000 7f2f92ff5640 1 --2- 172.21.15.172:0/557416516 >> v2:172.21.15.186:3300/0 conn(0x7f2f8c06abe0 0x7f2f8c06afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.864+0000 7f2f92ff5640 1 -- 172.21.15.172:0/557416516 >> 172.21.15.172:0/557416516 conn(0x7f2f8c0b5af0 msgr2=0x7f2f8c0b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:19.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.864+0000 7f2f92ff5640 1 -- 172.21.15.172:0/557416516 shutdown_connections 2024-04-25T08:43:19.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.864+0000 7f2f92ff5640 1 -- 172.21.15.172:0/557416516 wait complete. 2024-04-25T08:43:19.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.865+0000 7f2f92ff5640 1 Processor -- start 2024-04-25T08:43:19.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.865+0000 7f2f92ff5640 1 -- start start 2024-04-25T08:43:19.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f92ff5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c06abe0 0x7f2f8c152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f92ff5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c0ad570 0x7f2f8c1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f92ff5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dd80 0x7f2f8c14ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f92ff5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c070280 con 0x7f2f8c15dd80 2024-04-25T08:43:19.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f92ff5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c06e940 con 0x7f2f8c06abe0 2024-04-25T08:43:19.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f92ff5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c070400 con 0x7f2f8c0ad570 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f91592640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dd80 0x7f2f8c14ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f91592640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dd80 0x7f2f8c14ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58970/0 (socket says 172.21.15.172:58970) 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f91592640 1 -- 172.21.15.172:0/540525401 learned_addr learned my addr 172.21.15.172:0/540525401 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f90d91640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c06abe0 0x7f2f8c152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f8bfff640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c0ad570 0x7f2f8c1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f91592640 1 -- 172.21.15.172:0/540525401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c0ad570 msgr2=0x7f2f8c1536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f91592640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c0ad570 0x7f2f8c1536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f91592640 1 -- 172.21.15.172:0/540525401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c06abe0 msgr2=0x7f2f8c152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f91592640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c06abe0 0x7f2f8c152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.866+0000 7f2f91592640 1 -- 172.21.15.172:0/540525401 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c153e20 con 0x7f2f8c15dd80 2024-04-25T08:43:19.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.867+0000 7f2f91592640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dd80 0x7f2f8c14ce40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009f10 tx=0x7f2f84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:19.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.868+0000 7f2f897fa640 1 -- 172.21.15.172:0/540525401 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84036050 con 0x7f2f8c15dd80 2024-04-25T08:43:19.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.868+0000 7f2f897fa640 1 -- 172.21.15.172:0/540525401 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f84042070 con 0x7f2f8c15dd80 2024-04-25T08:43:19.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.868+0000 7f2f92ff5640 1 -- 172.21.15.172:0/540525401 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c15ecb0 con 0x7f2f8c15dd80 2024-04-25T08:43:19.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.868+0000 7f2f897fa640 1 -- 172.21.15.172:0/540525401 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84009510 con 0x7f2f8c15dd80 2024-04-25T08:43:19.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.868+0000 7f2f92ff5640 1 -- 172.21.15.172:0/540525401 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c15f270 con 0x7f2f8c15dd80 2024-04-25T08:43:19.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.869+0000 7f2f92ff5640 1 -- 172.21.15.172:0/540525401 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c073a00 con 0x7f2f8c15dd80 2024-04-25T08:43:19.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.870+0000 7f2f897fa640 1 -- 172.21.15.172:0/540525401 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f84007bf0 con 0x7f2f8c15dd80 2024-04-25T08:43:19.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.870+0000 7f2f897fa640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 0x7f2f7006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:19.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.870+0000 7f2f897fa640 1 -- 172.21.15.172:0/540525401 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2f840ab100 con 0x7f2f8c15dd80 2024-04-25T08:43:19.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.870+0000 7f2f90d91640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 0x7f2f7006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:19.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.871+0000 7f2f90d91640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 0x7f2f7006d9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009b40 tx=0x7f2f80009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:19.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:19.874+0000 7f2f897fa640 1 -- 172.21.15.172:0/540525401 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f840795c0 con 0x7f2f8c15dd80 2024-04-25T08:43:20.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.044+0000 7f2f92ff5640 1 -- 172.21.15.172:0/540525401 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2f8c0b1700 con 0x7f2f8c15dd80 2024-04-25T08:43:20.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.044+0000 7f2f897fa640 1 -- 172.21.15.172:0/540525401 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2f8407d660 con 0x7f2f8c15dd80 2024-04-25T08:43:20.036 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:20.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 -- 172.21.15.172:0/540525401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 msgr2=0x7f2f7006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 0x7f2f7006d9c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009b40 tx=0x7f2f80009190 comp rx=0 tx=0).stop 2024-04-25T08:43:20.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 -- 172.21.15.172:0/540525401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dd80 msgr2=0x7f2f8c14ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dd80 0x7f2f8c14ce40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009f10 tx=0x7f2f84004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:20.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 -- 172.21.15.172:0/540525401 shutdown_connections 2024-04-25T08:43:20.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 0x7f2f7006d9c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dd80 0x7f2f8c14ce40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c0ad570 0x7f2f8c1536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 --2- 172.21.15.172:0/540525401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c06abe0 0x7f2f8c152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 -- 172.21.15.172:0/540525401 >> 172.21.15.172:0/540525401 conn(0x7f2f8c0b5af0 msgr2=0x7f2f8c0ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:20.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 -- 172.21.15.172:0/540525401 shutdown_connections 2024-04-25T08:43:20.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.046+0000 7f2f92ff5640 1 -- 172.21.15.172:0/540525401 wait complete. 2024-04-25T08:43:20.049 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:43:20.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.155+0000 7f7bcf2b3640 1 Processor -- start 2024-04-25T08:43:20.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.156+0000 7f7bcf2b3640 1 -- start start 2024-04-25T08:43:20.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.156+0000 7f7bcf2b3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7bc80b5bb0 0x7f7bc80b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.156+0000 7f7bcf2b3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc80cf1d0 con 0x7f7bc8161890 2024-04-25T08:43:20.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.156+0000 7f7bcf2b3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc8161620 con 0x7f7bc8161240 2024-04-25T08:43:20.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.156+0000 7f7bcf2b3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc80b7120 con 0x7f7bc80b5bb0 2024-04-25T08:43:20.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.157+0000 7f7bcd850640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7bc80b5bb0 0x7f7bc80b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.157+0000 7f7bcc84e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7bc8161890 0x7f7bc80b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52610/0 (socket says 172.21.15.172:52610) 2024-04-25T08:43:20.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.157+0000 7f7bcc84e640 1 -- 172.21.15.172:0/2303640612 learned_addr learned my addr 172.21.15.172:0/2303640612 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:20.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.157+0000 7f7bcd850640 1 -- 172.21.15.172:0/2303640612 >> v1:172.21.15.186:6789/0 conn(0x7f7bc8161240 legacy=0x7f7bc80ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:20.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.157+0000 7f7bcd850640 1 -- 172.21.15.172:0/2303640612 >> v1:172.21.15.172:6789/0 conn(0x7f7bc8161890 legacy=0x7f7bc80b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.157+0000 7f7bcd850640 1 -- 172.21.15.172:0/2303640612 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8161e00 con 0x7f7bc80b5bb0 2024-04-25T08:43:20.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.157+0000 7f7bbffff640 1 -- 172.21.15.172:0/2303640612 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878035640 0 0) 0x7f7bc80cf1d0 con 0x7f7bc8161890 2024-04-25T08:43:20.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bcd850640 1 --2- 172.21.15.172:0/2303640612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc80b5bb0 0x7f7bc80b6be0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009d90 tx=0x7f7bc002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811367a13da5a77b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:20.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bbffff640 1 -- 172.21.15.172:0/2303640612 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0007740 con 0x7f7bc80b5bb0 2024-04-25T08:43:20.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bbffff640 1 -- 172.21.15.172:0/2303640612 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc00078e0 con 0x7f7bc80b5bb0 2024-04-25T08:43:20.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bbffff640 1 -- 172.21.15.172:0/2303640612 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0007cb0 con 0x7f7bc80b5bb0 2024-04-25T08:43:20.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/2303640612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc80b5bb0 msgr2=0x7f7bc80b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bcf2b3640 1 --2- 172.21.15.172:0/2303640612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc80b5bb0 0x7f7bc80b6be0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009d90 tx=0x7f7bc002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/2303640612 shutdown_connections 2024-04-25T08:43:20.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bcf2b3640 1 --2- 172.21.15.172:0/2303640612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc80b5bb0 0x7f7bc80b6be0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/2303640612 >> 172.21.15.172:0/2303640612 conn(0x7f7bc80d04a0 msgr2=0x7f7bc80d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:20.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/2303640612 shutdown_connections 2024-04-25T08:43:20.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.158+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/2303640612 wait complete. 2024-04-25T08:43:20.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.159+0000 7f7bcf2b3640 1 Processor -- start 2024-04-25T08:43:20.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcf2b3640 1 -- start start 2024-04-25T08:43:20.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcf2b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7bc80b5bb0 0x7f7bc815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcf2b3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bc8161240 0x7f7bc80c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcf2b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8161890 0x7f7bc814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcf2b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc81626a0 con 0x7f7bc8161890 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcf2b3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc81623c0 con 0x7f7bc8161240 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcf2b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80d15f0 con 0x7f7bc80b5bb0 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcd850640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8161890 0x7f7bc814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcd850640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8161890 0x7f7bc814fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58988/0 (socket says 172.21.15.172:58988) 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcd850640 1 -- 172.21.15.172:0/1208144832 learned_addr learned my addr 172.21.15.172:0/1208144832 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcc84e640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bc8161240 0x7f7bc80c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.160+0000 7f7bcd04f640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7bc80b5bb0 0x7f7bc815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bcd850640 1 -- 172.21.15.172:0/1208144832 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7bc80b5bb0 msgr2=0x7f7bc815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bcd850640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7bc80b5bb0 0x7f7bc815b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bcd850640 1 -- 172.21.15.172:0/1208144832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bc8161240 msgr2=0x7f7bc80c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bcd850640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bc8161240 0x7f7bc80c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bcd850640 1 -- 172.21.15.172:0/1208144832 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc81503e0 con 0x7f7bc8161890 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bcd04f640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7bc80b5bb0 0x7f7bc815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bcd850640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8161890 0x7f7bc814fa30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009eb0 tx=0x7f7bc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:20.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bbdffb640 1 -- 172.21.15.172:0/1208144832 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0040070 con 0x7f7bc8161890 2024-04-25T08:43:20.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bbdffb640 1 -- 172.21.15.172:0/1208144832 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc0031c90 con 0x7f7bc8161890 2024-04-25T08:43:20.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/1208144832 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc80ca2b0 con 0x7f7bc8161890 2024-04-25T08:43:20.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bbdffb640 1 -- 172.21.15.172:0/1208144832 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0045680 con 0x7f7bc8161890 2024-04-25T08:43:20.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.161+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/1208144832 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc80c81d0 con 0x7f7bc8161890 2024-04-25T08:43:20.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.162+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/1208144832 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc80cb5b0 con 0x7f7bc8161890 2024-04-25T08:43:20.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.163+0000 7f7bbdffb640 1 -- 172.21.15.172:0/1208144832 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7bc0039040 con 0x7f7bc8161890 2024-04-25T08:43:20.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.163+0000 7f7bbdffb640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7bac06b500 0x7f7bac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.163+0000 7f7bbdffb640 1 -- 172.21.15.172:0/1208144832 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7bc00ac020 con 0x7f7bc8161890 2024-04-25T08:43:20.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.163+0000 7f7bcd04f640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7bac06b500 0x7f7bac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.163+0000 7f7bcd04f640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7bac06b500 0x7f7bac06d9c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8003eb0 tx=0x7f7bb8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:20.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.167+0000 7f7bbdffb640 1 -- 172.21.15.172:0/1208144832 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7bc81503e0 con 0x7f7bc8161890 2024-04-25T08:43:20.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.347+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/1208144832 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7bc8073a00 con 0x7f7bc8161890 2024-04-25T08:43:20.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.347+0000 7f7bbdffb640 1 -- 172.21.15.172:0/1208144832 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7bc007abf0 con 0x7f7bc8161890 2024-04-25T08:43:20.340 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:43:20.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.349+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/1208144832 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7bac06b500 msgr2=0x7f7bac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.349+0000 7f7bcf2b3640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7bac06b500 0x7f7bac06d9c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8003eb0 tx=0x7f7bb8009040 comp rx=0 tx=0).stop 2024-04-25T08:43:20.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.349+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/1208144832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8161890 msgr2=0x7f7bc814fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.349+0000 7f7bcf2b3640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8161890 0x7f7bc814fa30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009eb0 tx=0x7f7bc0004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:20.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.349+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/1208144832 shutdown_connections 2024-04-25T08:43:20.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.349+0000 7f7bcf2b3640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7bac06b500 0x7f7bac06d9c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.349+0000 7f7bcf2b3640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bc8161240 0x7f7bc80c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.349+0000 7f7bcf2b3640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bc8161890 0x7f7bc814fa30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.349+0000 7f7bcf2b3640 1 --2- 172.21.15.172:0/1208144832 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7bc80b5bb0 0x7f7bc815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.349+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/1208144832 >> 172.21.15.172:0/1208144832 conn(0x7f7bc80d04a0 msgr2=0x7f7bc80d2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:20.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.350+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/1208144832 shutdown_connections 2024-04-25T08:43:20.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.350+0000 7f7bcf2b3640 1 -- 172.21.15.172:0/1208144832 wait complete. 2024-04-25T08:43:20.353 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T08:43:20.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:20.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T08:43:20.377 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:43:20.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:20.377 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T08:43:20.433 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:43:20.433 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:20.451 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:43:20.451 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:20.509 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:43:20.510 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:20.567 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:20.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.673+0000 7f7478f13640 1 Processor -- start 2024-04-25T08:43:20.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.673+0000 7f7478f13640 1 -- start start 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7478f13640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f747415f020 0x7f74740cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7478f13640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74740cc3c0 con 0x7f7474099a40 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7478f13640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747415f400 con 0x7f74740b0b90 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7478f13640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74740cccb0 con 0x7f747415f020 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7472d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7474099a40 0x7f74740cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52614/0 (socket says 172.21.15.172:52614) 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7472d9d640 1 -- 172.21.15.172:0/283052678 learned_addr learned my addr 172.21.15.172:0/283052678 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658620891 0 0) 0x7f74740cc3c0 con 0x7f7474099a40 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7460003520 con 0x7f7474099a40 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f747259c640 1 --2- 172.21.15.172:0/283052678 >> v2:172.21.15.186:3300/0 conn(0x7f747415f020 0x7f74740cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1382540567 0 0) 0x7f7460003520 con 0x7f7474099a40 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 >> v2:172.21.15.186:3300/0 conn(0x7f747415f020 msgr2=0x7f74740cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:20.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 --2- 172.21.15.172:0/283052678 >> v2:172.21.15.186:3300/0 conn(0x7f747415f020 0x7f74740cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 >> v1:172.21.15.186:6789/0 conn(0x7f74740b0b90 legacy=0x7f74740b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74740d0550 con 0x7f7474099a40 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f746c0019f0 con 0x7f7474099a40 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 >> v1:172.21.15.172:6789/0 conn(0x7f7474099a40 legacy=0x7f74740cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74600039b0 0x7f7460003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7460004800 0x7f7460004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74600051c0 0x7f746000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740cccb0 con 0x7f74600039b0 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746000c060 con 0x7f74600051c0 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746000c260 con 0x7f7460004800 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.674+0000 7f747259c640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74600039b0 0x7f7460003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f746bfff640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7460004800 0x7f7460004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f7472d9d640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74600051c0 0x7f746000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f747259c640 1 -- 172.21.15.172:0/283052678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7460004800 msgr2=0x7f7460004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f747259c640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7460004800 0x7f7460004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f747259c640 1 -- 172.21.15.172:0/283052678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74600051c0 msgr2=0x7f746000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f747259c640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74600051c0 0x7f746000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f747259c640 1 -- 172.21.15.172:0/283052678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460003520 con 0x7f74600039b0 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f7472d9d640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74600051c0 0x7f746000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f7472d9d640 1 -- 172.21.15.172:0/283052678 reap_dead start 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f747259c640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74600039b0 0x7f7460003dd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7464009ac0 tx=0x7f7460005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5e5b464ffc3927 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464036070 con 0x7f74600039b0 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464031400 con 0x7f74600039b0 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.675+0000 7f7471d9b640 1 -- 172.21.15.172:0/283052678 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464009690 con 0x7f74600039b0 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.676+0000 7f7478f13640 1 -- 172.21.15.172:0/283052678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74600039b0 msgr2=0x7f7460003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.676+0000 7f7478f13640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74600039b0 0x7f7460003dd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7464009ac0 tx=0x7f7460005830 comp rx=0 tx=0).stop 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.676+0000 7f7478f13640 1 -- 172.21.15.172:0/283052678 shutdown_connections 2024-04-25T08:43:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.676+0000 7f7478f13640 1 --2- 172.21.15.172:0/283052678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74600039b0 0x7f7460003dd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.676+0000 7f7478f13640 1 -- 172.21.15.172:0/283052678 >> 172.21.15.172:0/283052678 conn(0x7f74740b3310 msgr2=0x7f74740b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:20.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.676+0000 7f7478f13640 1 -- 172.21.15.172:0/283052678 shutdown_connections 2024-04-25T08:43:20.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.676+0000 7f7478f13640 1 -- 172.21.15.172:0/283052678 wait complete. 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.677+0000 7f7478f13640 1 Processor -- start 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.677+0000 7f7478f13640 1 -- start start 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f7478f13640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74600039b0 0x7f74740b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f7478f13640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74740cb490 0x7f74740c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f7478f13640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74740caa30 0x7f74740ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f7478f13640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740cc940 con 0x7f74740cb490 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f7478f13640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740cc660 con 0x7f74740caa30 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f7478f13640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74740cfe00 con 0x7f74600039b0 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f746bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74740cb490 0x7f74740c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f746bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74740cb490 0x7f74740c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59012/0 (socket says 172.21.15.172:59012) 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f746bfff640 1 -- 172.21.15.172:0/863940779 learned_addr learned my addr 172.21.15.172:0/863940779 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f7472d9d640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74740caa30 0x7f74740ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f747259c640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74600039b0 0x7f74740b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f746bfff640 1 -- 172.21.15.172:0/863940779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74600039b0 msgr2=0x7f74740b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f746bfff640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74600039b0 0x7f74740b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f746bfff640 1 -- 172.21.15.172:0/863940779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74740caa30 msgr2=0x7f74740ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f746bfff640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74740caa30 0x7f74740ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f746bfff640 1 -- 172.21.15.172:0/863940779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74741f5c40 con 0x7f74740cb490 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.678+0000 7f7472d9d640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74740caa30 0x7f74740ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.679+0000 7f746bfff640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74740cb490 0x7f74740c94a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f745c00f620 tx=0x7f745c00fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.679+0000 7f746affd640 1 -- 172.21.15.172:0/863940779 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0052e0 con 0x7f74740cb490 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.679+0000 7f746affd640 1 -- 172.21.15.172:0/863940779 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c018070 con 0x7f74740cb490 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.679+0000 7f7478f13640 1 -- 172.21.15.172:0/863940779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74740c7a60 con 0x7f74740cb490 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.679+0000 7f746affd640 1 -- 172.21.15.172:0/863940779 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c003830 con 0x7f74740cb490 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.679+0000 7f7478f13640 1 -- 172.21.15.172:0/863940779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74740ca510 con 0x7f74740cb490 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.680+0000 7f7478f13640 1 -- 172.21.15.172:0/863940779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7474073990 con 0x7f74740cb490 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.680+0000 7f746affd640 1 -- 172.21.15.172:0/863940779 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f745c0039d0 con 0x7f74740cb490 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.681+0000 7f746affd640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f745406b500 0x7f745406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.681+0000 7f746affd640 1 -- 172.21.15.172:0/863940779 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f745c089f10 con 0x7f74740cb490 2024-04-25T08:43:20.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.681+0000 7f747259c640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f745406b500 0x7f745406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.681+0000 7f747259c640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f745406b500 0x7f745406d9c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7464033000 tx=0x7f7464008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:20.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.685+0000 7f746affd640 1 -- 172.21.15.172:0/863940779 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f745c058a20 con 0x7f74740cb490 2024-04-25T08:43:20.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.863+0000 7f7478f13640 1 -- 172.21.15.172:0/863940779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74740cdeb0 con 0x7f74740cb490 2024-04-25T08:43:20.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.864+0000 7f746affd640 1 -- 172.21.15.172:0/863940779 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18905 (secure 0 0 0) 0x7f745c058320 con 0x7f74740cb490 2024-04-25T08:43:20.856 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:20.857 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:09.821048+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 -- 172.21.15.172:0/863940779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f745406b500 msgr2=0x7f745406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f745406b500 0x7f745406d9c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7464033000 tx=0x7f7464008030 comp rx=0 tx=0).stop 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 -- 172.21.15.172:0/863940779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74740cb490 msgr2=0x7f74740c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74740cb490 0x7f74740c94a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f745c00f620 tx=0x7f745c00fae0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 -- 172.21.15.172:0/863940779 shutdown_connections 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f745406b500 0x7f745406d9c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74740caa30 0x7f74740ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74740cb490 0x7f74740c94a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 --2- 172.21.15.172:0/863940779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74600039b0 0x7f74740b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 -- 172.21.15.172:0/863940779 >> 172.21.15.172:0/863940779 conn(0x7f74740b3310 msgr2=0x7f74740cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 -- 172.21.15.172:0/863940779 shutdown_connections 2024-04-25T08:43:20.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.866+0000 7f7478f13640 1 -- 172.21.15.172:0/863940779 wait complete. 2024-04-25T08:43:20.870 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:43:20.870 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:20.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.979+0000 7f67b8c8f640 1 Processor -- start 2024-04-25T08:43:20.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.979+0000 7f67b8c8f640 1 -- start start 2024-04-25T08:43:20.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67b8c8f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67b4158230 0x7f67b40d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67b8c8f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67b40d1b80 0x7f67b406c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67b8c8f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f67b406c870 0x7f67b40b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67b8c8f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b4158610 con 0x7f67b40d1b80 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67b8c8f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b406bea0 con 0x7f67b406c870 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67b8c8f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b40d2020 con 0x7f67b4158230 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67a9d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67b40d1b80 0x7f67b406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67a9d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67b40d1b80 0x7f67b406c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59020/0 (socket says 172.21.15.172:59020) 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67a9d9b640 1 -- 172.21.15.172:0/2441088823 learned_addr learned my addr 172.21.15.172:0/2441088823 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67b259c640 1 --2- 172.21.15.172:0/2441088823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67b4158230 0x7f67b40d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67b2d9d640 1 --2- 172.21.15.172:0/2441088823 >> v2:172.21.15.186:3300/0 conn(0x7f67b406c870 0x7f67b40b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67a9d9b640 1 -- 172.21.15.172:0/2441088823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67b4158230 msgr2=0x7f67b40d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67a9d9b640 1 --2- 172.21.15.172:0/2441088823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67b4158230 0x7f67b40d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67a9d9b640 1 -- 172.21.15.172:0/2441088823 >> v2:172.21.15.186:3300/0 conn(0x7f67b406c870 msgr2=0x7f67b40b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67a9d9b640 1 --2- 172.21.15.172:0/2441088823 >> v2:172.21.15.186:3300/0 conn(0x7f67b406c870 0x7f67b40b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.980+0000 7f67a9d9b640 1 -- 172.21.15.172:0/2441088823 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b40d2300 con 0x7f67b40d1b80 2024-04-25T08:43:20.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67a9d9b640 1 --2- 172.21.15.172:0/2441088823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b40d1b80 0x7f67b406c330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f67b40d13e0 tx=0x7f679c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a904f67666f031 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:20.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67b1d9b640 1 -- 172.21.15.172:0/2441088823 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c004030 con 0x7f67b40d1b80 2024-04-25T08:43:20.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67b1d9b640 1 -- 172.21.15.172:0/2441088823 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c0041d0 con 0x7f67b40d1b80 2024-04-25T08:43:20.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67b1d9b640 1 -- 172.21.15.172:0/2441088823 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c003610 con 0x7f67b40d1b80 2024-04-25T08:43:20.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67b8c8f640 1 -- 172.21.15.172:0/2441088823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b40d1b80 msgr2=0x7f67b406c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67b8c8f640 1 --2- 172.21.15.172:0/2441088823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b40d1b80 0x7f67b406c330 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f67b40d13e0 tx=0x7f679c02a1c0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67b8c8f640 1 -- 172.21.15.172:0/2441088823 shutdown_connections 2024-04-25T08:43:20.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67b8c8f640 1 --2- 172.21.15.172:0/2441088823 >> v2:172.21.15.186:3300/0 conn(0x7f67b406c870 0x7f67b40b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67b8c8f640 1 --2- 172.21.15.172:0/2441088823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b40d1b80 0x7f67b406c330 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67b8c8f640 1 --2- 172.21.15.172:0/2441088823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67b4158230 0x7f67b40d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.981+0000 7f67b8c8f640 1 -- 172.21.15.172:0/2441088823 >> 172.21.15.172:0/2441088823 conn(0x7f67b4061600 msgr2=0x7f67b40619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:20.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.982+0000 7f67b8c8f640 1 -- 172.21.15.172:0/2441088823 shutdown_connections 2024-04-25T08:43:20.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.982+0000 7f67b8c8f640 1 -- 172.21.15.172:0/2441088823 wait complete. 2024-04-25T08:43:20.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.983+0000 7f67b8c8f640 1 Processor -- start 2024-04-25T08:43:20.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.983+0000 7f67b8c8f640 1 -- start start 2024-04-25T08:43:20.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b8c8f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67b406c870 0x7f67b4153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b8c8f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67b40d1b80 0x7f67b41e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b8c8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b4158230 0x7f67b41e5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b8c8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b415e320 con 0x7f67b4158230 2024-04-25T08:43:20.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b8c8f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b40d25e0 con 0x7f67b40d1b80 2024-04-25T08:43:20.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b8c8f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b415e4a0 con 0x7f67b406c870 2024-04-25T08:43:20.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b4158230 0x7f67b41e5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b4158230 0x7f67b41e5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59036/0 (socket says 172.21.15.172:59036) 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b2d9d640 1 -- 172.21.15.172:0/3818361375 learned_addr learned my addr 172.21.15.172:0/3818361375 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67a9d9b640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67b40d1b80 0x7f67b41e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b259c640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67b406c870 0x7f67b4153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b2d9d640 1 -- 172.21.15.172:0/3818361375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67b406c870 msgr2=0x7f67b4153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b2d9d640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67b406c870 0x7f67b4153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b2d9d640 1 -- 172.21.15.172:0/3818361375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67b40d1b80 msgr2=0x7f67b41e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b2d9d640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67b40d1b80 0x7f67b41e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b2d9d640 1 -- 172.21.15.172:0/3818361375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b41e7da0 con 0x7f67b4158230 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67b2d9d640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b4158230 0x7f67b41e5440 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f67ac007e60 tx=0x7f67ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67ab7fe640 1 -- 172.21.15.172:0/3818361375 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac014420 con 0x7f67b4158230 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.984+0000 7f67ab7fe640 1 -- 172.21.15.172:0/3818361375 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac019070 con 0x7f67b4158230 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.985+0000 7f67ab7fe640 1 -- 172.21.15.172:0/3818361375 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac014820 con 0x7f67b4158230 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.985+0000 7f67b8c8f640 1 -- 172.21.15.172:0/3818361375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b40cba30 con 0x7f67b4158230 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.985+0000 7f67b8c8f640 1 -- 172.21.15.172:0/3818361375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b41538c0 con 0x7f67b4158230 2024-04-25T08:43:20.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.986+0000 7f67b8c8f640 1 -- 172.21.15.172:0/3818361375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b406de50 con 0x7f67b4158230 2024-04-25T08:43:20.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.986+0000 7f67ab7fe640 1 -- 172.21.15.172:0/3818361375 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f67ac0149c0 con 0x7f67b4158230 2024-04-25T08:43:20.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.986+0000 7f67ab7fe640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f679406b4d0 0x7f679406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:20.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.987+0000 7f67ab7fe640 1 -- 172.21.15.172:0/3818361375 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f67ac08ad20 con 0x7f67b4158230 2024-04-25T08:43:20.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.987+0000 7f67b259c640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f679406b4d0 0x7f679406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:20.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.987+0000 7f67b259c640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f679406b4d0 0x7f679406d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f67a4006fd0 tx=0x7f67a4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:20.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:20.991+0000 7f67ab7fe640 1 -- 172.21.15.172:0/3818361375 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67ac059150 con 0x7f67b4158230 2024-04-25T08:43:21.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.160+0000 7f67b8c8f640 1 -- 172.21.15.172:0/3818361375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67b415c370 con 0x7f67b4158230 2024-04-25T08:43:21.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.160+0000 7f67ab7fe640 1 -- 172.21.15.172:0/3818361375 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67ac05d1f0 con 0x7f67b4158230 2024-04-25T08:43:21.152 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:21.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 -- 172.21.15.172:0/3818361375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f679406b4d0 msgr2=0x7f679406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f679406b4d0 0x7f679406d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f67a4006fd0 tx=0x7f67a4008040 comp rx=0 tx=0).stop 2024-04-25T08:43:21.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 -- 172.21.15.172:0/3818361375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b4158230 msgr2=0x7f67b41e5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b4158230 0x7f67b41e5440 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f67ac007e60 tx=0x7f67ac00e4b0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 -- 172.21.15.172:0/3818361375 shutdown_connections 2024-04-25T08:43:21.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f679406b4d0 0x7f679406d990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67b40d1b80 0x7f67b41e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b4158230 0x7f67b41e5440 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 --2- 172.21.15.172:0/3818361375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67b406c870 0x7f67b4153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 -- 172.21.15.172:0/3818361375 >> 172.21.15.172:0/3818361375 conn(0x7f67b4061600 msgr2=0x7f67b40b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:21.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 -- 172.21.15.172:0/3818361375 shutdown_connections 2024-04-25T08:43:21.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.162+0000 7f67b8c8f640 1 -- 172.21.15.172:0/3818361375 wait complete. 2024-04-25T08:43:21.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:43:21.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.273+0000 7f1be73f5640 1 Processor -- start 2024-04-25T08:43:21.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.273+0000 7f1be73f5640 1 -- start start 2024-04-25T08:43:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1be73f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be015dac0 0x7f1be00d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1be73f5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be00d2420 con 0x7f1be00d1f30 2024-04-25T08:43:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1be73f5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be00d2700 con 0x7f1be00d0ab0 2024-04-25T08:43:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1be73f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00d3030 con 0x7f1be015dac0 2024-04-25T08:43:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1be4990640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1be00d1f30 0x7f1be00d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52618/0 (socket says 172.21.15.172:52618) 2024-04-25T08:43:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1be4990640 1 -- 172.21.15.172:0/584467561 learned_addr learned my addr 172.21.15.172:0/584467561 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1be5191640 1 --2- 172.21.15.172:0/584467561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be015dac0 0x7f1be00d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1bd7fff640 1 -- 172.21.15.172:0/584467561 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286138001 0 0) 0x7f1be00d2420 con 0x7f1be00d1f30 2024-04-25T08:43:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1bd7fff640 1 -- 172.21.15.172:0/584467561 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bcc003520 con 0x7f1be00d1f30 2024-04-25T08:43:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1bd7fff640 1 -- 172.21.15.172:0/584467561 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967788964 0 0) 0x7f1be00d2700 con 0x7f1be00d0ab0 2024-04-25T08:43:21.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1bd7fff640 1 -- 172.21.15.172:0/584467561 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be00d2420 con 0x7f1be00d0ab0 2024-04-25T08:43:21.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1bd7fff640 1 -- 172.21.15.172:0/584467561 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1687216177 0 0) 0x7f1bcc003520 con 0x7f1be00d1f30 2024-04-25T08:43:21.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1be5191640 1 -- 172.21.15.172:0/584467561 >> v1:172.21.15.186:6789/0 conn(0x7f1be00d0ab0 legacy=0x7f1be00b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1be5191640 1 -- 172.21.15.172:0/584467561 >> v1:172.21.15.172:6789/0 conn(0x7f1be00d1f30 legacy=0x7f1be00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.274+0000 7f1be5191640 1 -- 172.21.15.172:0/584467561 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be00d29e0 con 0x7f1be015dac0 2024-04-25T08:43:21.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.275+0000 7f1be5191640 1 --2- 172.21.15.172:0/584467561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be015dac0 0x7f1be00d19f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1be00d31b0 tx=0x7f1bdc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f14678fcce5f757 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:21.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.275+0000 7f1bd7fff640 1 -- 172.21.15.172:0/584467561 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc037070 con 0x7f1be015dac0 2024-04-25T08:43:21.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.275+0000 7f1bd7fff640 1 -- 172.21.15.172:0/584467561 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc02aca0 con 0x7f1be015dac0 2024-04-25T08:43:21.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.275+0000 7f1bd7fff640 1 -- 172.21.15.172:0/584467561 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00017f0 con 0x7f1be015dac0 2024-04-25T08:43:21.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.276+0000 7f1be73f5640 1 -- 172.21.15.172:0/584467561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be015dac0 msgr2=0x7f1be00d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.276+0000 7f1be73f5640 1 --2- 172.21.15.172:0/584467561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be015dac0 0x7f1be00d19f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1be00d31b0 tx=0x7f1bdc02a210 comp rx=0 tx=0).stop 2024-04-25T08:43:21.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.276+0000 7f1be73f5640 1 -- 172.21.15.172:0/584467561 shutdown_connections 2024-04-25T08:43:21.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.276+0000 7f1be73f5640 1 --2- 172.21.15.172:0/584467561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be015dac0 0x7f1be00d19f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.276+0000 7f1be73f5640 1 -- 172.21.15.172:0/584467561 >> 172.21.15.172:0/584467561 conn(0x7f1be0061c30 msgr2=0x7f1be006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:21.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.276+0000 7f1be73f5640 1 -- 172.21.15.172:0/584467561 shutdown_connections 2024-04-25T08:43:21.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.276+0000 7f1be73f5640 1 -- 172.21.15.172:0/584467561 wait complete. 2024-04-25T08:43:21.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.277+0000 7f1be73f5640 1 Processor -- start 2024-04-25T08:43:21.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.277+0000 7f1be73f5640 1 -- start start 2024-04-25T08:43:21.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be73f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1be00d0ab0 0x7f1be01f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be73f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be00d1f30 0x7f1be00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be73f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be015dac0 0x7f1be00cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be73f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00b97d0 con 0x7f1be015dac0 2024-04-25T08:43:21.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be73f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be015dea0 con 0x7f1be00d0ab0 2024-04-25T08:43:21.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be73f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00b9950 con 0x7f1be00d1f30 2024-04-25T08:43:21.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be5992640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be015dac0 0x7f1be00cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be5992640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be015dac0 0x7f1be00cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59046/0 (socket says 172.21.15.172:59046) 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be5992640 1 -- 172.21.15.172:0/2546694448 learned_addr learned my addr 172.21.15.172:0/2546694448 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be5191640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1be00d0ab0 0x7f1be01f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be4990640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be00d1f30 0x7f1be00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be5992640 1 -- 172.21.15.172:0/2546694448 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be00d1f30 msgr2=0x7f1be00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be5992640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be00d1f30 0x7f1be00cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be5992640 1 -- 172.21.15.172:0/2546694448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1be00d0ab0 msgr2=0x7f1be01f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be5992640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1be00d0ab0 0x7f1be01f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be5992640 1 -- 172.21.15.172:0/2546694448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be015fb40 con 0x7f1be015dac0 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be4990640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be00d1f30 0x7f1be00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.278+0000 7f1be5992640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be015dac0 0x7f1be00cd860 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800c7a0 tx=0x7f1bd800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.279+0000 7f1bd5ffb640 1 -- 172.21.15.172:0/2546694448 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8003b70 con 0x7f1be015dac0 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.279+0000 7f1bd5ffb640 1 -- 172.21.15.172:0/2546694448 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd8003d10 con 0x7f1be015dac0 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.279+0000 7f1bd5ffb640 1 -- 172.21.15.172:0/2546694448 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800aa90 con 0x7f1be015dac0 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.279+0000 7f1be73f5640 1 -- 172.21.15.172:0/2546694448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be00cac80 con 0x7f1be015dac0 2024-04-25T08:43:21.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.279+0000 7f1be73f5640 1 -- 172.21.15.172:0/2546694448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be00cb240 con 0x7f1be015dac0 2024-04-25T08:43:21.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.280+0000 7f1be73f5640 1 -- 172.21.15.172:0/2546694448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be00cb440 con 0x7f1be015dac0 2024-04-25T08:43:21.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.280+0000 7f1bd5ffb640 1 -- 172.21.15.172:0/2546694448 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1bd800ac30 con 0x7f1be015dac0 2024-04-25T08:43:21.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.280+0000 7f1bd5ffb640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1bc406b4d0 0x7f1bc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.280+0000 7f1bd5ffb640 1 -- 172.21.15.172:0/2546694448 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1bd808a540 con 0x7f1be015dac0 2024-04-25T08:43:21.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.280+0000 7f1be5191640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1bc406b4d0 0x7f1bc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.281+0000 7f1be5191640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1bc406b4d0 0x7f1bc406d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc034000 tx=0x7f1bdc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:21.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.284+0000 7f1bd5ffb640 1 -- 172.21.15.172:0/2546694448 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1be00cb440 con 0x7f1be015dac0 2024-04-25T08:43:21.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.455+0000 7f1be73f5640 1 -- 172.21.15.172:0/2546694448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1be0073a00 con 0x7f1be015dac0 2024-04-25T08:43:21.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.456+0000 7f1bd5ffb640 1 -- 172.21.15.172:0/2546694448 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1bd8059030 con 0x7f1be015dac0 2024-04-25T08:43:21.448 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:21.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 -- 172.21.15.172:0/2546694448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1bc406b4d0 msgr2=0x7f1bc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1bc406b4d0 0x7f1bc406d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc034000 tx=0x7f1bdc02e000 comp rx=0 tx=0).stop 2024-04-25T08:43:21.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 -- 172.21.15.172:0/2546694448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be015dac0 msgr2=0x7f1be00cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be015dac0 0x7f1be00cd860 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800c7a0 tx=0x7f1bd800cc60 comp rx=0 tx=0).stop 2024-04-25T08:43:21.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 -- 172.21.15.172:0/2546694448 shutdown_connections 2024-04-25T08:43:21.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1bc406b4d0 0x7f1bc406d990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be015dac0 0x7f1be00cd860 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1be00d1f30 0x7f1be00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 --2- 172.21.15.172:0/2546694448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1be00d0ab0 0x7f1be01f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 -- 172.21.15.172:0/2546694448 >> 172.21.15.172:0/2546694448 conn(0x7f1be0061c30 msgr2=0x7f1be00c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:21.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 -- 172.21.15.172:0/2546694448 shutdown_connections 2024-04-25T08:43:21.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.458+0000 7f1be73f5640 1 -- 172.21.15.172:0/2546694448 wait complete. 2024-04-25T08:43:21.461 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:43:21.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.569+0000 7f6e5ed1d640 1 Processor -- start 2024-04-25T08:43:21.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.569+0000 7f6e5ed1d640 1 -- start start 2024-04-25T08:43:21.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.570+0000 7f6e5ed1d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e580ad570 0x7f6e5806ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.570+0000 7f6e5ed1d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e580b3930 con 0x7f6e5806abe0 2024-04-25T08:43:21.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.570+0000 7f6e5ed1d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e580b3c10 con 0x7f6e5815dd80 2024-04-25T08:43:21.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.570+0000 7f6e5ed1d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5806e410 con 0x7f6e580ad570 2024-04-25T08:43:21.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.570+0000 7f6e5cab9640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6e5806abe0 0x7f6e5806afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52624/0 (socket says 172.21.15.172:52624) 2024-04-25T08:43:21.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.570+0000 7f6e5cab9640 1 -- 172.21.15.172:0/3534651702 learned_addr learned my addr 172.21.15.172:0/3534651702 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.570+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941251524 0 0) 0x7f6e580b3930 con 0x7f6e5806abe0 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e40003520 con 0x7f6e5806abe0 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e5d2ba640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e580ad570 0x7f6e5806ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3311817890 0 0) 0x7f6e40003520 con 0x7f6e5806abe0 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e580ad570 msgr2=0x7f6e5806ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e580ad570 0x7f6e5806ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 >> v1:172.21.15.186:6789/0 conn(0x7f6e5815dd80 legacy=0x7f6e580b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5806e660 con 0x7f6e5806abe0 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f6e48001670 con 0x7f6e5806abe0 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 >> v1:172.21.15.172:6789/0 conn(0x7f6e5806abe0 legacy=0x7f6e5806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e400039e0 0x7f6e40003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e580ad570 0x7f6e40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e40004d40 0x7f6e400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5806e410 con 0x7f6e400039e0 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4000baa0 con 0x7f6e40004d40 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4000bca0 con 0x7f6e580ad570 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e5cab9640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e400039e0 0x7f6e40003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e57fff640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e580ad570 0x7f6e40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e5d2ba640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e40004d40 0x7f6e400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e5cab9640 1 -- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e580ad570 msgr2=0x7f6e40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e5cab9640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e580ad570 0x7f6e40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e5cab9640 1 -- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e40004d40 msgr2=0x7f6e400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e5cab9640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e40004d40 0x7f6e400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e5cab9640 1 -- 172.21.15.172:0/3534651702 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40003520 con 0x7f6e400039e0 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e57fff640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e580ad570 0x7f6e40004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.571+0000 7f6e5d2ba640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e40004d40 0x7f6e400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:21.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.572+0000 7f6e5cab9640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e400039e0 0x7f6e40003e00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6e48001eb0 tx=0x7f6e40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fc21ffa049539f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.572+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48007d30 con 0x7f6e400039e0 2024-04-25T08:43:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.572+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e480058d0 con 0x7f6e400039e0 2024-04-25T08:43:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.572+0000 7f6e577fe640 1 -- 172.21.15.172:0/3534651702 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48005ce0 con 0x7f6e400039e0 2024-04-25T08:43:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.573+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/3534651702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e400039e0 msgr2=0x7f6e40003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.573+0000 7f6e5ed1d640 1 --2- 172.21.15.172:0/3534651702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e400039e0 0x7f6e40003e00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6e48001eb0 tx=0x7f6e40005830 comp rx=0 tx=0).stop 2024-04-25T08:43:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.573+0000 7f6e5d2ba640 1 -- 172.21.15.172:0/3534651702 reap_dead start 2024-04-25T08:43:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.573+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/3534651702 shutdown_connections 2024-04-25T08:43:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.573+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/3534651702 >> 172.21.15.172:0/3534651702 conn(0x7f6e580b5af0 msgr2=0x7f6e580b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.573+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/3534651702 shutdown_connections 2024-04-25T08:43:21.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.573+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/3534651702 wait complete. 2024-04-25T08:43:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.574+0000 7f6e5ed1d640 1 Processor -- start 2024-04-25T08:43:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.574+0000 7f6e5ed1d640 1 -- start start 2024-04-25T08:43:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e5ed1d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e400039e0 0x7f6e581421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e5ed1d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e581f7b90 0x7f6e581f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e5ed1d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e581f7480 0x7f6e58155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e5ed1d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58070400 con 0x7f6e581f7b90 2024-04-25T08:43:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e5ed1d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58070280 con 0x7f6e400039e0 2024-04-25T08:43:21.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e5ed1d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580b3590 con 0x7f6e581f7480 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e57fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e581f7b90 0x7f6e581f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e57fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e581f7b90 0x7f6e581f6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59062/0 (socket says 172.21.15.172:59062) 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e57fff640 1 -- 172.21.15.172:0/245911118 learned_addr learned my addr 172.21.15.172:0/245911118 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e5cab9640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e400039e0 0x7f6e581421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e5d2ba640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e581f7480 0x7f6e58155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e57fff640 1 -- 172.21.15.172:0/245911118 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e581f7480 msgr2=0x7f6e58155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e57fff640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e581f7480 0x7f6e58155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e57fff640 1 -- 172.21.15.172:0/245911118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e400039e0 msgr2=0x7f6e581421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e57fff640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e400039e0 0x7f6e581421e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e57fff640 1 -- 172.21.15.172:0/245911118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5815c6c0 con 0x7f6e581f7b90 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e57fff640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e581f7b90 0x7f6e581f6f40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00e5d0 tx=0x7f6e4c00ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e557fa640 1 -- 172.21.15.172:0/245911118 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c0052e0 con 0x7f6e581f7b90 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e557fa640 1 -- 172.21.15.172:0/245911118 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c018070 con 0x7f6e581f7b90 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/245911118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e58154f10 con 0x7f6e581f7b90 2024-04-25T08:43:21.572 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e557fa640 1 -- 172.21.15.172:0/245911118 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c003830 con 0x7f6e581f7b90 2024-04-25T08:43:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.575+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/245911118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e581554d0 con 0x7f6e581f7b90 2024-04-25T08:43:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.576+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/245911118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e58073a00 con 0x7f6e581f7b90 2024-04-25T08:43:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.577+0000 7f6e557fa640 1 -- 172.21.15.172:0/245911118 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6e4c0039d0 con 0x7f6e581f7b90 2024-04-25T08:43:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.577+0000 7f6e557fa640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e4406b500 0x7f6e4406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.577+0000 7f6e557fa640 1 -- 172.21.15.172:0/245911118 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6e4c08a020 con 0x7f6e581f7b90 2024-04-25T08:43:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.577+0000 7f6e5cab9640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e4406b500 0x7f6e4406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.578+0000 7f6e5cab9640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e4406b500 0x7f6e4406d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6e48033000 tx=0x7f6e4802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:21.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.582+0000 7f6e557fa640 1 -- 172.21.15.172:0/245911118 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e4c0584e0 con 0x7f6e581f7b90 2024-04-25T08:43:21.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.751+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/245911118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6e581f7860 con 0x7f6e581f7b90 2024-04-25T08:43:21.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.752+0000 7f6e557fa640 1 -- 172.21.15.172:0/245911118 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6e4c05c580 con 0x7f6e581f7b90 2024-04-25T08:43:21.744 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:43:21.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.753+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/245911118 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e4406b500 msgr2=0x7f6e4406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e4406b500 0x7f6e4406d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6e48033000 tx=0x7f6e4802e000 comp rx=0 tx=0).stop 2024-04-25T08:43:21.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/245911118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e581f7b90 msgr2=0x7f6e581f6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e581f7b90 0x7f6e581f6f40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00e5d0 tx=0x7f6e4c00ea90 comp rx=0 tx=0).stop 2024-04-25T08:43:21.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/245911118 shutdown_connections 2024-04-25T08:43:21.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6e4406b500 0x7f6e4406d9c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e581f7480 0x7f6e58155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e581f7b90 0x7f6e581f6f40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 --2- 172.21.15.172:0/245911118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e400039e0 0x7f6e581421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/245911118 >> 172.21.15.172:0/245911118 conn(0x7f6e580b5af0 msgr2=0x7f6e5815ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:21.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/245911118 shutdown_connections 2024-04-25T08:43:21.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.754+0000 7f6e5ed1d640 1 -- 172.21.15.172:0/245911118 wait complete. 2024-04-25T08:43:21.757 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:43:21.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.864+0000 7f35f7a6f640 1 Processor -- start 2024-04-25T08:43:21.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.864+0000 7f35f7a6f640 1 -- start start 2024-04-25T08:43:21.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f7a6f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35f00d0a00 0x7f35f0162140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f7a6f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0de0 0x7f35f00cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f7a6f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f015e3a0 con 0x7f35f00cd540 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f7a6f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f00cd9d0 con 0x7f35f00d0a00 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f7a6f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00cdc70 con 0x7f35f00d0de0 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f580b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35f00d0a00 0x7f35f0162140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f600c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f35f00cd540 0x7f35f00caad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52626/0 (socket says 172.21.15.172:52626) 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f600c640 1 -- 172.21.15.172:0/468564893 learned_addr learned my addr 172.21.15.172:0/468564893 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f500a640 1 --2- 172.21.15.172:0/468564893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0de0 0x7f35f00cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f580b640 1 -- 172.21.15.172:0/468564893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0de0 msgr2=0x7f35f00cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f580b640 1 --2- 172.21.15.172:0/468564893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0de0 0x7f35f00cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f580b640 1 -- 172.21.15.172:0/468564893 >> v1:172.21.15.172:6789/0 conn(0x7f35f00cd540 legacy=0x7f35f00caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.865+0000 7f35f580b640 1 -- 172.21.15.172:0/468564893 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f00cdf50 con 0x7f35f00d0a00 2024-04-25T08:43:21.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.866+0000 7f35f580b640 1 --2- 172.21.15.172:0/468564893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00d0a00 0x7f35f0162140 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009d90 tx=0x7f35ec02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191bc54677fa7549 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.866+0000 7f35f4809640 1 -- 172.21.15.172:0/468564893 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec031600 con 0x7f35f00d0a00 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.866+0000 7f35f4809640 1 -- 172.21.15.172:0/468564893 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec0317a0 con 0x7f35f00d0a00 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.866+0000 7f35f4809640 1 -- 172.21.15.172:0/468564893 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec031b70 con 0x7f35f00d0a00 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.867+0000 7f35f7a6f640 1 -- 172.21.15.172:0/468564893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00d0a00 msgr2=0x7f35f0162140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.867+0000 7f35f7a6f640 1 --2- 172.21.15.172:0/468564893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00d0a00 0x7f35f0162140 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009d90 tx=0x7f35ec02a5d0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.867+0000 7f35f7a6f640 1 -- 172.21.15.172:0/468564893 shutdown_connections 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.867+0000 7f35f7a6f640 1 --2- 172.21.15.172:0/468564893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0de0 0x7f35f00cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.867+0000 7f35f7a6f640 1 --2- 172.21.15.172:0/468564893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00d0a00 0x7f35f0162140 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.867+0000 7f35f7a6f640 1 -- 172.21.15.172:0/468564893 >> 172.21.15.172:0/468564893 conn(0x7f35f00d17c0 msgr2=0x7f35f00d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.867+0000 7f35f7a6f640 1 -- 172.21.15.172:0/468564893 shutdown_connections 2024-04-25T08:43:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.867+0000 7f35f7a6f640 1 -- 172.21.15.172:0/468564893 wait complete. 2024-04-25T08:43:21.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.868+0000 7f35f7a6f640 1 Processor -- start 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.868+0000 7f35f7a6f640 1 -- start start 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f7a6f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00cd540 0x7f35f01402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f7a6f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0a00 0x7f35f00b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f7a6f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35f00d0de0 0x7f35f00b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f7a6f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0161c20 con 0x7f35f00cd540 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f7a6f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0161940 con 0x7f35f00d0de0 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f7a6f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00d1260 con 0x7f35f00d0a00 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f580b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00cd540 0x7f35f01402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f580b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00cd540 0x7f35f01402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59080/0 (socket says 172.21.15.172:59080) 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f580b640 1 -- 172.21.15.172:0/882431827 learned_addr learned my addr 172.21.15.172:0/882431827 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f600c640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35f00d0de0 0x7f35f00b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f500a640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0a00 0x7f35f00b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f580b640 1 -- 172.21.15.172:0/882431827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0a00 msgr2=0x7f35f00b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f580b640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0a00 0x7f35f00b6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f580b640 1 -- 172.21.15.172:0/882431827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35f00d0de0 msgr2=0x7f35f00b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f580b640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35f00d0de0 0x7f35f00b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f580b640 1 -- 172.21.15.172:0/882431827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0144540 con 0x7f35f00cd540 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f500a640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0a00 0x7f35f00b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f580b640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00cd540 0x7f35f01402e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009d90 tx=0x7f35ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35e67fc640 1 -- 172.21.15.172:0/882431827 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec040070 con 0x7f35f00cd540 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35e67fc640 1 -- 172.21.15.172:0/882431827 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec030be0 con 0x7f35f00cd540 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.869+0000 7f35f7a6f640 1 -- 172.21.15.172:0/882431827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f00a87d0 con 0x7f35f00cd540 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.870+0000 7f35e67fc640 1 -- 172.21.15.172:0/882431827 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec009450 con 0x7f35f00cd540 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.870+0000 7f35f7a6f640 1 -- 172.21.15.172:0/882431827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f00b5b10 con 0x7f35f00cd540 2024-04-25T08:43:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.870+0000 7f35f7a6f640 1 -- 172.21.15.172:0/882431827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f0073a00 con 0x7f35f00cd540 2024-04-25T08:43:21.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.871+0000 7f35e67fc640 1 -- 172.21.15.172:0/882431827 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f35ec039040 con 0x7f35f00cd540 2024-04-25T08:43:21.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.872+0000 7f35e67fc640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f35d406b4d0 0x7f35d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:21.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.872+0000 7f35e67fc640 1 -- 172.21.15.172:0/882431827 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f35ec0abd50 con 0x7f35f00cd540 2024-04-25T08:43:21.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.872+0000 7f35f500a640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f35d406b4d0 0x7f35d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:21.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.872+0000 7f35f500a640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f35d406b4d0 0x7f35d406d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35e0006fd0 tx=0x7f35e0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:21.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:21.877+0000 7f35e67fc640 1 -- 172.21.15.172:0/882431827 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f35ec0af030 con 0x7f35f00cd540 2024-04-25T08:43:22.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.050+0000 7f35f7a6f640 1 -- 172.21.15.172:0/882431827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f35f0071d60 con 0x7f35f00cd540 2024-04-25T08:43:22.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.050+0000 7f35e67fc640 1 -- 172.21.15.172:0/882431827 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f35ec07a180 con 0x7f35f00cd540 2024-04-25T08:43:22.042 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:22.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 -- 172.21.15.172:0/882431827 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f35d406b4d0 msgr2=0x7f35d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f35d406b4d0 0x7f35d406d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35e0006fd0 tx=0x7f35e0008040 comp rx=0 tx=0).stop 2024-04-25T08:43:22.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 -- 172.21.15.172:0/882431827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00cd540 msgr2=0x7f35f01402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00cd540 0x7f35f01402e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009d90 tx=0x7f35ec004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:22.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 -- 172.21.15.172:0/882431827 shutdown_connections 2024-04-25T08:43:22.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f35d406b4d0 0x7f35d406d990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35f00d0de0 0x7f35f00b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35f00d0a00 0x7f35f00b6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 --2- 172.21.15.172:0/882431827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35f00cd540 0x7f35f01402e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 -- 172.21.15.172:0/882431827 >> 172.21.15.172:0/882431827 conn(0x7f35f00d17c0 msgr2=0x7f35f0143240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:22.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 -- 172.21.15.172:0/882431827 shutdown_connections 2024-04-25T08:43:22.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.052+0000 7f35f7a6f640 1 -- 172.21.15.172:0/882431827 wait complete. 2024-04-25T08:43:22.056 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:43:22.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.162+0000 7f59973d5640 1 Processor -- start 2024-04-25T08:43:22.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.162+0000 7f59973d5640 1 -- start start 2024-04-25T08:43:22.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f59973d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5990162140 0x7f59900cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f59973d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f59900cd540 0x7f59900caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f59973d5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599015e3a0 con 0x7f59900d0a00 2024-04-25T08:43:22.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f59973d5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59901625c0 con 0x7f59900cd540 2024-04-25T08:43:22.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f59973d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59900cd9d0 con 0x7f5990162140 2024-04-25T08:43:22.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f5995972640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f59900cd540 0x7f59900caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f5995171640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f59900d0a00 0x7f59900d0de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52634/0 (socket says 172.21.15.172:52634) 2024-04-25T08:43:22.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f5995171640 1 -- 172.21.15.172:0/2529001549 learned_addr learned my addr 172.21.15.172:0/2529001549 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:22.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f5995972640 1 -- 172.21.15.172:0/2529001549 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5990162140 msgr2=0x7f59900cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:22.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f5995972640 1 --2- 172.21.15.172:0/2529001549 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5990162140 0x7f59900cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f5995972640 1 -- 172.21.15.172:0/2529001549 >> v1:172.21.15.172:6789/0 conn(0x7f59900d0a00 legacy=0x7f59900d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f5995972640 1 -- 172.21.15.172:0/2529001549 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900cdc70 con 0x7f59900cd540 2024-04-25T08:43:22.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.163+0000 7f5987fff640 1 -- 172.21.15.172:0/2529001549 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633273293 0 0) 0x7f599015e3a0 con 0x7f59900d0a00 2024-04-25T08:43:22.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.164+0000 7f5995972640 1 --2- 172.21.15.172:0/2529001549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900cd540 0x7f59900caad0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5988009dc0 tx=0x7f598802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d742f891fe91fd7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:22.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.164+0000 7f5987fff640 1 -- 172.21.15.172:0/2529001549 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988007740 con 0x7f59900cd540 2024-04-25T08:43:22.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.164+0000 7f5987fff640 1 -- 172.21.15.172:0/2529001549 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59880078e0 con 0x7f59900cd540 2024-04-25T08:43:22.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.164+0000 7f5987fff640 1 -- 172.21.15.172:0/2529001549 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988007cb0 con 0x7f59900cd540 2024-04-25T08:43:22.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.164+0000 7f59973d5640 1 -- 172.21.15.172:0/2529001549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900cd540 msgr2=0x7f59900caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.164+0000 7f59973d5640 1 --2- 172.21.15.172:0/2529001549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900cd540 0x7f59900caad0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5988009dc0 tx=0x7f598802a5f0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.165+0000 7f59973d5640 1 -- 172.21.15.172:0/2529001549 shutdown_connections 2024-04-25T08:43:22.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.165+0000 7f59973d5640 1 --2- 172.21.15.172:0/2529001549 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5990162140 0x7f59900cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.165+0000 7f59973d5640 1 --2- 172.21.15.172:0/2529001549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900cd540 0x7f59900caad0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.165+0000 7f59973d5640 1 -- 172.21.15.172:0/2529001549 >> 172.21.15.172:0/2529001549 conn(0x7f59900d17c0 msgr2=0x7f59900d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:22.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.165+0000 7f59973d5640 1 -- 172.21.15.172:0/2529001549 shutdown_connections 2024-04-25T08:43:22.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.165+0000 7f59973d5640 1 -- 172.21.15.172:0/2529001549 wait complete. 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.166+0000 7f59973d5640 1 Processor -- start 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.166+0000 7f59973d5640 1 -- start start 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.166+0000 7f59973d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59900cd540 0x7f5990142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.166+0000 7f59973d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900d0a00 0x7f59901e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.166+0000 7f59973d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5990162140 0x7f5990145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.166+0000 7f59973d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990161940 con 0x7f59900d0a00 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.166+0000 7f59973d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5990161660 con 0x7f59900cd540 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.166+0000 7f59973d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5990161c20 con 0x7f5990162140 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5994970640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900d0a00 0x7f59901e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5994970640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900d0a00 0x7f59901e8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59094/0 (socket says 172.21.15.172:59094) 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5994970640 1 -- 172.21.15.172:0/1471903772 learned_addr learned my addr 172.21.15.172:0/1471903772 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:22.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5995972640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5990162140 0x7f5990145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5995171640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59900cd540 0x7f5990142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5994970640 1 -- 172.21.15.172:0/1471903772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5990162140 msgr2=0x7f5990145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5994970640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5990162140 0x7f5990145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5994970640 1 -- 172.21.15.172:0/1471903772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59900cd540 msgr2=0x7f5990142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5994970640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59900cd540 0x7f5990142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5994970640 1 -- 172.21.15.172:0/1471903772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900b49b0 con 0x7f59900d0a00 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5994970640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900d0a00 0x7f59901e8b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f598000b440 tx=0x7f598000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5985ffb640 1 -- 172.21.15.172:0/1471903772 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5980015020 con 0x7f59900d0a00 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5985ffb640 1 -- 172.21.15.172:0/1471903772 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5980011890 con 0x7f59900d0a00 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f59973d5640 1 -- 172.21.15.172:0/1471903772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59901e80b0 con 0x7f59900d0a00 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f5985ffb640 1 -- 172.21.15.172:0/1471903772 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5980011c80 con 0x7f59900d0a00 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.167+0000 7f59973d5640 1 -- 172.21.15.172:0/1471903772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59901e90d0 con 0x7f59900d0a00 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.168+0000 7f59973d5640 1 -- 172.21.15.172:0/1471903772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5990073a00 con 0x7f59900d0a00 2024-04-25T08:43:22.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.169+0000 7f5985ffb640 1 -- 172.21.15.172:0/1471903772 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5980018020 con 0x7f59900d0a00 2024-04-25T08:43:22.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.169+0000 7f5985ffb640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f597406b4d0 0x7f597406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.169+0000 7f5985ffb640 1 -- 172.21.15.172:0/1471903772 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f598008a6b0 con 0x7f59900d0a00 2024-04-25T08:43:22.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.169+0000 7f5995171640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f597406b4d0 0x7f597406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.170+0000 7f5995171640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f597406b4d0 0x7f597406d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f598c000f60 tx=0x7f598c007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:22.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.173+0000 7f5985ffb640 1 -- 172.21.15.172:0/1471903772 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f598001f020 con 0x7f59900d0a00 2024-04-25T08:43:22.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.354+0000 7f59973d5640 1 -- 172.21.15.172:0/1471903772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f59901604e0 con 0x7f59900d0a00 2024-04-25T08:43:22.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.354+0000 7f5985ffb640 1 -- 172.21.15.172:0/1471903772 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f598000d040 con 0x7f59900d0a00 2024-04-25T08:43:22.347 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:43:22.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 -- 172.21.15.172:0/1471903772 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f597406b4d0 msgr2=0x7f597406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f597406b4d0 0x7f597406d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f598c000f60 tx=0x7f598c007b50 comp rx=0 tx=0).stop 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 -- 172.21.15.172:0/1471903772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900d0a00 msgr2=0x7f59901e8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900d0a00 0x7f59901e8b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f598000b440 tx=0x7f598000b900 comp rx=0 tx=0).stop 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 -- 172.21.15.172:0/1471903772 shutdown_connections 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f597406b4d0 0x7f597406d990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5990162140 0x7f5990145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59900d0a00 0x7f59901e8b90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 --2- 172.21.15.172:0/1471903772 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59900cd540 0x7f5990142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 -- 172.21.15.172:0/1471903772 >> 172.21.15.172:0/1471903772 conn(0x7f59900d17c0 msgr2=0x7f59900cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 -- 172.21.15.172:0/1471903772 shutdown_connections 2024-04-25T08:43:22.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.356+0000 7f59973d5640 1 -- 172.21.15.172:0/1471903772 wait complete. 2024-04-25T08:43:22.359 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T08:43:22.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:22.360 DEBUG:teuthology.orchestra.run.smithi186:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T08:43:22.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:43:22.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:22.390 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T08:43:22.449 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:43:22.449 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:43:22.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.555+0000 7ff9d4d70640 1 Processor -- start 2024-04-25T08:43:22.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.555+0000 7ff9d4d70640 1 -- start start 2024-04-25T08:43:22.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9d4d70640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff9d00c6df0 0x7ff9d00d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9d4d70640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9d00d1c00 0x7ff9d00ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9d4d70640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d015dfe0 con 0x7ff9d015dc00 2024-04-25T08:43:22.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9d4d70640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d00d2070 con 0x7ff9d00d1c00 2024-04-25T08:43:22.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9d4d70640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d00d00c0 con 0x7ff9d00c6df0 2024-04-25T08:43:22.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9ce59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff9d015dc00 0x7ff9d00ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52638/0 (socket says 172.21.15.172:52638) 2024-04-25T08:43:22.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9ce59c640 1 -- 172.21.15.172:0/3451729607 learned_addr learned my addr 172.21.15.172:0/3451729607 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:22.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9ced9d640 1 --2- 172.21.15.172:0/3451729607 >> v2:172.21.15.172:3300/0 conn(0x7ff9d00d1c00 0x7ff9d00ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9cdd9b640 1 --2- 172.21.15.172:0/3451729607 >> v2:172.21.15.186:3300/0 conn(0x7ff9d00c6df0 0x7ff9d00d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9cd59a640 1 -- 172.21.15.172:0/3451729607 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892200992 0 0) 0x7ff9c0001490 con 0x7ff9d015dc00 2024-04-25T08:43:22.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9cd59a640 1 -- 172.21.15.172:0/3451729607 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9bc003520 con 0x7ff9d015dc00 2024-04-25T08:43:22.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9ced9d640 1 -- 172.21.15.172:0/3451729607 >> v2:172.21.15.186:3300/0 conn(0x7ff9d00c6df0 msgr2=0x7ff9d00d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:22.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9ced9d640 1 --2- 172.21.15.172:0/3451729607 >> v2:172.21.15.186:3300/0 conn(0x7ff9d00c6df0 0x7ff9d00d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9ced9d640 1 -- 172.21.15.172:0/3451729607 >> v1:172.21.15.172:6789/0 conn(0x7ff9d015dc00 legacy=0x7ff9d00ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9ced9d640 1 -- 172.21.15.172:0/3451729607 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00d03a0 con 0x7ff9d00d1c00 2024-04-25T08:43:22.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.556+0000 7ff9cdd9b640 1 --2- 172.21.15.172:0/3451729607 >> v2:172.21.15.186:3300/0 conn(0x7ff9d00c6df0 0x7ff9d00d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:22.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.557+0000 7ff9ced9d640 1 --2- 172.21.15.172:0/3451729607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 0x7ff9d00ccc40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00c8820 tx=0x7ff9c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644f9d84bca004f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:22.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.557+0000 7ff9cd59a640 1 -- 172.21.15.172:0/3451729607 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8037070 con 0x7ff9d00d1c00 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.557+0000 7ff9cd59a640 1 -- 172.21.15.172:0/3451729607 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c8032440 con 0x7ff9d00d1c00 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.557+0000 7ff9cd59a640 1 -- 172.21.15.172:0/3451729607 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8032810 con 0x7ff9d00d1c00 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.558+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3451729607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 msgr2=0x7ff9d00ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.558+0000 7ff9d4d70640 1 --2- 172.21.15.172:0/3451729607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 0x7ff9d00ccc40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00c8820 tx=0x7ff9c802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.558+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3451729607 shutdown_connections 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.558+0000 7ff9d4d70640 1 --2- 172.21.15.172:0/3451729607 >> v2:172.21.15.186:3300/0 conn(0x7ff9d00c6df0 0x7ff9d00d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.558+0000 7ff9d4d70640 1 --2- 172.21.15.172:0/3451729607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 0x7ff9d00ccc40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.558+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3451729607 >> 172.21.15.172:0/3451729607 conn(0x7ff9d006f5d0 msgr2=0x7ff9d006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.558+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3451729607 shutdown_connections 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.558+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3451729607 wait complete. 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.559+0000 7ff9d4d70640 1 Processor -- start 2024-04-25T08:43:22.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.559+0000 7ff9d4d70640 1 -- start start 2024-04-25T08:43:22.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9d4d70640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9d00c6df0 0x7ff9d0153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9d4d70640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 0x7ff9d01f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9d4d70640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d015dc00 0x7ff9d006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9d4d70640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00cc130 con 0x7ff9d00d1c00 2024-04-25T08:43:22.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9d4d70640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00cc720 con 0x7ff9d015dc00 2024-04-25T08:43:22.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9d4d70640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00cfd90 con 0x7ff9d00c6df0 2024-04-25T08:43:22.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9cdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 0x7ff9d01f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9cdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 0x7ff9d01f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59118/0 (socket says 172.21.15.172:59118) 2024-04-25T08:43:22.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9cdd9b640 1 -- 172.21.15.172:0/3876098748 learned_addr learned my addr 172.21.15.172:0/3876098748 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9ce59c640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9d00c6df0 0x7ff9d0153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9ced9d640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d015dc00 0x7ff9d006cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9cdd9b640 1 -- 172.21.15.172:0/3876098748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9d00c6df0 msgr2=0x7ff9d0153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9cdd9b640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9d00c6df0 0x7ff9d0153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9cdd9b640 1 -- 172.21.15.172:0/3876098748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d015dc00 msgr2=0x7ff9d006cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9cdd9b640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d015dc00 0x7ff9d006cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.560+0000 7ff9cdd9b640 1 -- 172.21.15.172:0/3876098748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d01f7850 con 0x7ff9d00d1c00 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.561+0000 7ff9cdd9b640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 0x7ff9d01f6ee0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800e810 tx=0x7ff9b800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.561+0000 7ff9c6ffd640 1 -- 172.21.15.172:0/3876098748 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800f040 con 0x7ff9d00d1c00 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.561+0000 7ff9c6ffd640 1 -- 172.21.15.172:0/3876098748 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b8004030 con 0x7ff9d00d1c00 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.561+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3876098748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d01f7b30 con 0x7ff9d00d1c00 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.561+0000 7ff9c6ffd640 1 -- 172.21.15.172:0/3876098748 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8004400 con 0x7ff9d00d1c00 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.561+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3876098748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d00c8d70 con 0x7ff9d00d1c00 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.562+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3876098748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d0073990 con 0x7ff9d00d1c00 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.562+0000 7ff9c6ffd640 1 -- 172.21.15.172:0/3876098748 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9b800c6d0 con 0x7ff9d00d1c00 2024-04-25T08:43:22.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.563+0000 7ff9c6ffd640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 0x7ff9b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.563+0000 7ff9c6ffd640 1 -- 172.21.15.172:0/3876098748 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff9b808a400 con 0x7ff9d00d1c00 2024-04-25T08:43:22.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.563+0000 7ff9ce59c640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 0x7ff9b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.563+0000 7ff9ce59c640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 0x7ff9b006d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0005c00 tx=0x7ff9c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:22.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.567+0000 7ff9c6ffd640 1 -- 172.21.15.172:0/3876098748 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9b8017020 con 0x7ff9d00d1c00 2024-04-25T08:43:22.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.774+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3876098748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9d0157ff0 con 0x7ff9d00d1c00 2024-04-25T08:43:22.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.775+0000 7ff9c6ffd640 1 -- 172.21.15.172:0/3876098748 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4943 (secure 0 0 0) 0x7ff9b8058e60 con 0x7ff9d00d1c00 2024-04-25T08:43:22.767 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:22.767 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:42:28.003161+0000","modified":"2024-04-25T08:42:49.090813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:43:22.768 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2024-04-25T08:43:22.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3876098748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 msgr2=0x7ff9b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 0x7ff9b006d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0005c00 tx=0x7ff9c0009040 comp rx=0 tx=0).stop 2024-04-25T08:43:22.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3876098748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 msgr2=0x7ff9d01f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 0x7ff9d01f6ee0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800e810 tx=0x7ff9b800ecd0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3876098748 shutdown_connections 2024-04-25T08:43:22.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 0x7ff9b006d990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9d015dc00 0x7ff9d006cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d00d1c00 0x7ff9d01f6ee0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 --2- 172.21.15.172:0/3876098748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9d00c6df0 0x7ff9d0153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3876098748 >> 172.21.15.172:0/3876098748 conn(0x7ff9d006f5d0 msgr2=0x7ff9d0158360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:22.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3876098748 shutdown_connections 2024-04-25T08:43:22.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.777+0000 7ff9d4d70640 1 -- 172.21.15.172:0/3876098748 wait complete. 2024-04-25T08:43:22.780 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.886+0000 7f3087a38640 1 Processor -- start 2024-04-25T08:43:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.886+0000 7f3087a38640 1 -- start start 2024-04-25T08:43:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f3087a38640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f308015dd20 0x7f30800b96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f3087a38640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308015eac0 con 0x7f30800d11b0 2024-04-25T08:43:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f3087a38640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308015eda0 con 0x7f308015e100 2024-04-25T08:43:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f3087a38640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30800d1c00 con 0x7f308015dd20 2024-04-25T08:43:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f30857d4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f308015dd20 0x7f30800b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f3085fd5640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f30800d11b0 0x7f30800d2370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52640/0 (socket says 172.21.15.172:52640) 2024-04-25T08:43:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f3085fd5640 1 -- 172.21.15.172:0/1036002961 learned_addr learned my addr 172.21.15.172:0/1036002961 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f30857d4640 1 -- 172.21.15.172:0/1036002961 >> v1:172.21.15.186:6789/0 conn(0x7f308015e100 legacy=0x7f30800d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f30857d4640 1 -- 172.21.15.172:0/1036002961 >> v1:172.21.15.172:6789/0 conn(0x7f30800d11b0 legacy=0x7f30800d2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f3077fff640 1 -- 172.21.15.172:0/1036002961 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171501012 0 0) 0x7f308015eac0 con 0x7f30800d11b0 2024-04-25T08:43:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.887+0000 7f30857d4640 1 -- 172.21.15.172:0/1036002961 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308015f080 con 0x7f308015dd20 2024-04-25T08:43:22.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.888+0000 7f30857d4640 1 --2- 172.21.15.172:0/1036002961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 0x7f30800b96d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f307c0097a0 tx=0x7f307c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a785cb11e39aa8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:22.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.888+0000 7f3077fff640 1 -- 172.21.15.172:0/1036002961 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c037070 con 0x7f308015dd20 2024-04-25T08:43:22.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.888+0000 7f3077fff640 1 -- 172.21.15.172:0/1036002961 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307c032440 con 0x7f308015dd20 2024-04-25T08:43:22.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.888+0000 7f3077fff640 1 -- 172.21.15.172:0/1036002961 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c032810 con 0x7f308015dd20 2024-04-25T08:43:22.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.888+0000 7f3087a38640 1 -- 172.21.15.172:0/1036002961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 msgr2=0x7f30800b96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.888+0000 7f3087a38640 1 --2- 172.21.15.172:0/1036002961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 0x7f30800b96d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f307c0097a0 tx=0x7f307c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.889+0000 7f3087a38640 1 -- 172.21.15.172:0/1036002961 shutdown_connections 2024-04-25T08:43:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.889+0000 7f3087a38640 1 --2- 172.21.15.172:0/1036002961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 0x7f30800b96d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.889+0000 7f3087a38640 1 -- 172.21.15.172:0/1036002961 >> 172.21.15.172:0/1036002961 conn(0x7f3080061a20 msgr2=0x7f3080061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.889+0000 7f3087a38640 1 -- 172.21.15.172:0/1036002961 shutdown_connections 2024-04-25T08:43:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.889+0000 7f3087a38640 1 -- 172.21.15.172:0/1036002961 wait complete. 2024-04-25T08:43:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.890+0000 7f3087a38640 1 Processor -- start 2024-04-25T08:43:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.890+0000 7f3087a38640 1 -- start start 2024-04-25T08:43:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.890+0000 7f3087a38640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30800d11b0 0x7f308015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.890+0000 7f3087a38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 0x7f30800ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.890+0000 7f3087a38640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f308015e100 0x7f30800cec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.890+0000 7f3087a38640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308015e710 con 0x7f308015dd20 2024-04-25T08:43:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.890+0000 7f3087a38640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308015e590 con 0x7f30800d11b0 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.890+0000 7f3087a38640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30801f6cb0 con 0x7f308015e100 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3084fd3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 0x7f30800ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3084fd3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 0x7f30800ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59138/0 (socket says 172.21.15.172:59138) 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3084fd3640 1 -- 172.21.15.172:0/1353350218 learned_addr learned my addr 172.21.15.172:0/1353350218 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f30857d4640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30800d11b0 0x7f308015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3085fd5640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f308015e100 0x7f30800cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3084fd3640 1 -- 172.21.15.172:0/1353350218 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f308015e100 msgr2=0x7f30800cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3084fd3640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f308015e100 0x7f30800cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3084fd3640 1 -- 172.21.15.172:0/1353350218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30800d11b0 msgr2=0x7f308015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3084fd3640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30800d11b0 0x7f308015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3084fd3640 1 -- 172.21.15.172:0/1353350218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30801f6f90 con 0x7f308015dd20 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3084fd3640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 0x7f30800ce710 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f307000c430 tx=0x7f307000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3075ffb640 1 -- 172.21.15.172:0/1353350218 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3070017070 con 0x7f308015dd20 2024-04-25T08:43:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3075ffb640 1 -- 172.21.15.172:0/1353350218 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30700052d0 con 0x7f308015dd20 2024-04-25T08:43:22.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3087a38640 1 -- 172.21.15.172:0/1353350218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30801f7270 con 0x7f308015dd20 2024-04-25T08:43:22.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3075ffb640 1 -- 172.21.15.172:0/1353350218 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3070003830 con 0x7f308015dd20 2024-04-25T08:43:22.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.891+0000 7f3087a38640 1 -- 172.21.15.172:0/1353350218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30801f7830 con 0x7f308015dd20 2024-04-25T08:43:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.892+0000 7f3087a38640 1 -- 172.21.15.172:0/1353350218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30801f7a30 con 0x7f308015dd20 2024-04-25T08:43:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.893+0000 7f3075ffb640 1 -- 172.21.15.172:0/1353350218 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f307001a070 con 0x7f308015dd20 2024-04-25T08:43:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.893+0000 7f3075ffb640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f306406b4d0 0x7f306406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.893+0000 7f3075ffb640 1 -- 172.21.15.172:0/1353350218 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3070089840 con 0x7f308015dd20 2024-04-25T08:43:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.893+0000 7f30857d4640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f306406b4d0 0x7f306406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.894+0000 7f30857d4640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f306406b4d0 0x7f306406d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f307c034000 tx=0x7f307c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:22.897+0000 7f3075ffb640 1 -- 172.21.15.172:0/1353350218 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30801f7a30 con 0x7f308015dd20 2024-04-25T08:43:23.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.069+0000 7f3087a38640 1 -- 172.21.15.172:0/1353350218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3080073990 con 0x7f308015dd20 2024-04-25T08:43:23.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.070+0000 7f3075ffb640 1 -- 172.21.15.172:0/1353350218 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18905 (secure 0 0 0) 0x7f3070057d00 con 0x7f308015dd20 2024-04-25T08:43:23.063 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:23.063 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:09.821048+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 -- 172.21.15.172:0/1353350218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f306406b4d0 msgr2=0x7f306406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f306406b4d0 0x7f306406d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f307c034000 tx=0x7f307c02e000 comp rx=0 tx=0).stop 2024-04-25T08:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 -- 172.21.15.172:0/1353350218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 msgr2=0x7f30800ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 0x7f30800ce710 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f307000c430 tx=0x7f307000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 -- 172.21.15.172:0/1353350218 shutdown_connections 2024-04-25T08:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f306406b4d0 0x7f306406d990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f308015e100 0x7f30800cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f308015dd20 0x7f30800ce710 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 --2- 172.21.15.172:0/1353350218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30800d11b0 0x7f308015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 -- 172.21.15.172:0/1353350218 >> 172.21.15.172:0/1353350218 conn(0x7f3080061a20 msgr2=0x7f30800b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:23.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 -- 172.21.15.172:0/1353350218 shutdown_connections 2024-04-25T08:43:23.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.072+0000 7f3087a38640 1 -- 172.21.15.172:0/1353350218 wait complete. 2024-04-25T08:43:23.075 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:42:26.484132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:42:26.964595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T08:42:30.704572+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T08:43:23.076 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:23.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.184+0000 7fb10342a640 1 Processor -- start 2024-04-25T08:43:23.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.184+0000 7fb10342a640 1 -- start start 2024-04-25T08:43:23.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb10342a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb0fc1446d0 0x7fb0fc0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb10342a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0fc144d50 0x7fb0fc0b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb10342a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc0cccc0 con 0x7fb0fc1452a0 2024-04-25T08:43:23.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb10342a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc0b2b20 con 0x7fb0fc1446d0 2024-04-25T08:43:23.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb10342a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc06d400 con 0x7fb0fc144d50 2024-04-25T08:43:23.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb1019c7640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb0fc1452a0 0x7fb0fc0cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52644/0 (socket says 172.21.15.172:52644) 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb1019c7640 1 -- 172.21.15.172:0/2002370242 learned_addr learned my addr 172.21.15.172:0/2002370242 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb1011c6640 1 --2- 172.21.15.172:0/2002370242 >> v2:172.21.15.186:3300/0 conn(0x7fb0fc1446d0 0x7fb0fc0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb1009c5640 1 --2- 172.21.15.172:0/2002370242 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0fc144d50 0x7fb0fc0b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb0f3fff640 1 -- 172.21.15.172:0/2002370242 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962386316 0 0) 0x7fb0fc0cccc0 con 0x7fb0fc1452a0 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.185+0000 7fb0f3fff640 1 -- 172.21.15.172:0/2002370242 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e8003520 con 0x7fb0fc1452a0 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.186+0000 7fb0f3fff640 1 -- 172.21.15.172:0/2002370242 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2105039199 0 0) 0x7fb0e8003520 con 0x7fb0fc1452a0 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.186+0000 7fb1011c6640 1 -- 172.21.15.172:0/2002370242 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0fc144d50 msgr2=0x7fb0fc0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.186+0000 7fb1011c6640 1 --2- 172.21.15.172:0/2002370242 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0fc144d50 0x7fb0fc0b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.186+0000 7fb1011c6640 1 -- 172.21.15.172:0/2002370242 >> v1:172.21.15.172:6789/0 conn(0x7fb0fc1452a0 legacy=0x7fb0fc0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.186+0000 7fb1011c6640 1 -- 172.21.15.172:0/2002370242 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0cc140 con 0x7fb0fc1446d0 2024-04-25T08:43:23.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.186+0000 7fb1009c5640 1 --2- 172.21.15.172:0/2002370242 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0fc144d50 0x7fb0fc0b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.186+0000 7fb1011c6640 1 --2- 172.21.15.172:0/2002370242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0fc1446d0 0x7fb0fc0b3f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009d90 tx=0x7fb0f802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1fc3b1765288cfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb0f3fff640 1 -- 172.21.15.172:0/2002370242 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4001670 con 0x7fb0fc1446d0 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb0f3fff640 1 -- 172.21.15.172:0/2002370242 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f8007540 con 0x7fb0fc1446d0 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb0f3fff640 1 -- 172.21.15.172:0/2002370242 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8007910 con 0x7fb0fc1446d0 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb10342a640 1 -- 172.21.15.172:0/2002370242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0fc1446d0 msgr2=0x7fb0fc0b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb10342a640 1 --2- 172.21.15.172:0/2002370242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0fc1446d0 0x7fb0fc0b3f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009d90 tx=0x7fb0f802a5f0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb10342a640 1 -- 172.21.15.172:0/2002370242 shutdown_connections 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb10342a640 1 --2- 172.21.15.172:0/2002370242 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0fc144d50 0x7fb0fc0b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb10342a640 1 --2- 172.21.15.172:0/2002370242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0fc1446d0 0x7fb0fc0b3f20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb10342a640 1 -- 172.21.15.172:0/2002370242 >> 172.21.15.172:0/2002370242 conn(0x7fb0fc06abe0 msgr2=0x7fb0fc06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:23.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb10342a640 1 -- 172.21.15.172:0/2002370242 shutdown_connections 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.187+0000 7fb10342a640 1 -- 172.21.15.172:0/2002370242 wait complete. 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.188+0000 7fb10342a640 1 Processor -- start 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.188+0000 7fb10342a640 1 -- start start 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb10342a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0fc1446d0 0x7fb0fc15b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb10342a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0fc144d50 0x7fb0fc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb10342a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0fc1452a0 0x7fb0fc0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb10342a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0cc700 con 0x7fb0fc1446d0 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb10342a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0b49a0 con 0x7fb0fc1452a0 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb10342a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0cc9e0 con 0x7fb0fc144d50 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb1011c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0fc1446d0 0x7fb0fc15b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb1011c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0fc1446d0 0x7fb0fc15b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59152/0 (socket says 172.21.15.172:59152) 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb1011c6640 1 -- 172.21.15.172:0/128223576 learned_addr learned my addr 172.21.15.172:0/128223576 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb1011c6640 1 -- 172.21.15.172:0/128223576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0fc144d50 msgr2=0x7fb0fc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.189+0000 7fb1011c6640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0fc144d50 0x7fb0fc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.190+0000 7fb1011c6640 1 -- 172.21.15.172:0/128223576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0fc1452a0 msgr2=0x7fb0fc0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.190+0000 7fb1011c6640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0fc1452a0 0x7fb0fc0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.190+0000 7fb1011c6640 1 -- 172.21.15.172:0/128223576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc1f3640 con 0x7fb0fc1446d0 2024-04-25T08:43:23.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.190+0000 7fb1011c6640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0fc1446d0 0x7fb0fc15b460 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009d90 tx=0x7fb0f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:23.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.190+0000 7fb0f1ffb640 1 -- 172.21.15.172:0/128223576 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8040070 con 0x7fb0fc1446d0 2024-04-25T08:43:23.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.190+0000 7fb0f1ffb640 1 -- 172.21.15.172:0/128223576 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f8031c40 con 0x7fb0fc1446d0 2024-04-25T08:43:23.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.190+0000 7fb10342a640 1 -- 172.21.15.172:0/128223576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc0adea0 con 0x7fb0fc1446d0 2024-04-25T08:43:23.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.190+0000 7fb0f1ffb640 1 -- 172.21.15.172:0/128223576 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8009450 con 0x7fb0fc1446d0 2024-04-25T08:43:23.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.190+0000 7fb10342a640 1 -- 172.21.15.172:0/128223576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc0c4770 con 0x7fb0fc1446d0 2024-04-25T08:43:23.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.191+0000 7fb10342a640 1 -- 172.21.15.172:0/128223576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc073a00 con 0x7fb0fc1446d0 2024-04-25T08:43:23.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.192+0000 7fb0f1ffb640 1 -- 172.21.15.172:0/128223576 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb0f8039040 con 0x7fb0fc1446d0 2024-04-25T08:43:23.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.192+0000 7fb0f1ffb640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb0e006b4d0 0x7fb0e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.192+0000 7fb0f1ffb640 1 -- 172.21.15.172:0/128223576 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb0f80aba40 con 0x7fb0fc1446d0 2024-04-25T08:43:23.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.192+0000 7fb1009c5640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb0e006b4d0 0x7fb0e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.192+0000 7fb1009c5640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb0e006b4d0 0x7fb0e006d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec006e80 tx=0x7fb0ec006dd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:23.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.196+0000 7fb0f1ffb640 1 -- 172.21.15.172:0/128223576 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb0fc1f3640 con 0x7fb0fc1446d0 2024-04-25T08:43:23.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.366+0000 7fb10342a640 1 -- 172.21.15.172:0/128223576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0fc141fd0 con 0x7fb0fc1446d0 2024-04-25T08:43:23.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.366+0000 7fb0f1ffb640 1 -- 172.21.15.172:0/128223576 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0f807a4c0 con 0x7fb0fc1446d0 2024-04-25T08:43:23.359 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:23.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 -- 172.21.15.172:0/128223576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb0e006b4d0 msgr2=0x7fb0e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb0e006b4d0 0x7fb0e006d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec006e80 tx=0x7fb0ec006dd0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 -- 172.21.15.172:0/128223576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0fc1446d0 msgr2=0x7fb0fc15b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0fc1446d0 0x7fb0fc15b460 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009d90 tx=0x7fb0f8004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:23.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 -- 172.21.15.172:0/128223576 shutdown_connections 2024-04-25T08:43:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb0e006b4d0 0x7fb0e006d990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0fc1452a0 0x7fb0fc0ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0fc144d50 0x7fb0fc0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 --2- 172.21.15.172:0/128223576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0fc1446d0 0x7fb0fc15b460 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 -- 172.21.15.172:0/128223576 >> 172.21.15.172:0/128223576 conn(0x7fb0fc06abe0 msgr2=0x7fb0fc071170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 -- 172.21.15.172:0/128223576 shutdown_connections 2024-04-25T08:43:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.369+0000 7fb10342a640 1 -- 172.21.15.172:0/128223576 wait complete. 2024-04-25T08:43:23.372 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:43:23.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.480+0000 7f64e83ed640 1 Processor -- start 2024-04-25T08:43:23.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.480+0000 7f64e83ed640 1 -- start start 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.481+0000 7f64e83ed640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f64e0099cb0 0x7f64e00b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.481+0000 7f64e83ed640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64e00cfd30 0x7f64e015ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.481+0000 7f64e83ed640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e00cc5e0 con 0x7f64e009a090 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.481+0000 7f64e83ed640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e00cc3b0 con 0x7f64e00cfd30 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.481+0000 7f64e83ed640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e00d0210 con 0x7f64e0099cb0 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.481+0000 7f64e698a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f64e009a090 0x7f64e015f890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52652/0 (socket says 172.21.15.172:52652) 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.481+0000 7f64e5988640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64e00cfd30 0x7f64e015ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.481+0000 7f64e698a640 1 -- 172.21.15.172:0/3055661966 learned_addr learned my addr 172.21.15.172:0/3055661966 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.482+0000 7f64e6189640 1 --2- 172.21.15.172:0/3055661966 >> v2:172.21.15.186:3300/0 conn(0x7f64e0099cb0 0x7f64e00b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.482+0000 7f64e5988640 1 -- 172.21.15.172:0/3055661966 >> v2:172.21.15.186:3300/0 conn(0x7f64e0099cb0 msgr2=0x7f64e00b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.482+0000 7f64e5988640 1 --2- 172.21.15.172:0/3055661966 >> v2:172.21.15.186:3300/0 conn(0x7f64e0099cb0 0x7f64e00b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.482+0000 7f64e5988640 1 -- 172.21.15.172:0/3055661966 >> v1:172.21.15.172:6789/0 conn(0x7f64e009a090 legacy=0x7f64e015f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.482+0000 7f64e5988640 1 -- 172.21.15.172:0/3055661966 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e00d04f0 con 0x7f64e00cfd30 2024-04-25T08:43:23.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.482+0000 7f64e5187640 1 -- 172.21.15.172:0/3055661966 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009157082 0 0) 0x7f64e00cc5e0 con 0x7f64e009a090 2024-04-25T08:43:23.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.482+0000 7f64e5988640 1 --2- 172.21.15.172:0/3055661966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 0x7f64e015ecc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f64e00728e0 tx=0x7f64d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cab4456ed7babcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:23.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e5187640 1 -- 172.21.15.172:0/3055661966 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0037070 con 0x7f64e00cfd30 2024-04-25T08:43:23.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e5187640 1 -- 172.21.15.172:0/3055661966 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d0032440 con 0x7f64e00cfd30 2024-04-25T08:43:23.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e5187640 1 -- 172.21.15.172:0/3055661966 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0032810 con 0x7f64e00cfd30 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e83ed640 1 -- 172.21.15.172:0/3055661966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 msgr2=0x7f64e015ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e83ed640 1 --2- 172.21.15.172:0/3055661966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 0x7f64e015ecc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f64e00728e0 tx=0x7f64d002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e83ed640 1 -- 172.21.15.172:0/3055661966 shutdown_connections 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e83ed640 1 --2- 172.21.15.172:0/3055661966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 0x7f64e015ecc0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e83ed640 1 --2- 172.21.15.172:0/3055661966 >> v2:172.21.15.186:3300/0 conn(0x7f64e0099cb0 0x7f64e00b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e83ed640 1 -- 172.21.15.172:0/3055661966 >> 172.21.15.172:0/3055661966 conn(0x7f64e00b3290 msgr2=0x7f64e00b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e83ed640 1 -- 172.21.15.172:0/3055661966 shutdown_connections 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.483+0000 7f64e83ed640 1 -- 172.21.15.172:0/3055661966 wait complete. 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.484+0000 7f64e83ed640 1 Processor -- start 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e83ed640 1 -- start start 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e83ed640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64e0099cb0 0x7f64e00b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e83ed640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64e009a090 0x7f64e00cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e83ed640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 0x7f64e014dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e83ed640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00c52f0 con 0x7f64e00cfd30 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e83ed640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00d07d0 con 0x7f64e0099cb0 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e83ed640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00c5470 con 0x7f64e009a090 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e698a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 0x7f64e014dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e698a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 0x7f64e014dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59158/0 (socket says 172.21.15.172:59158) 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e698a640 1 -- 172.21.15.172:0/2253357636 learned_addr learned my addr 172.21.15.172:0/2253357636 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e6189640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64e0099cb0 0x7f64e00b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.485+0000 7f64e5988640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64e009a090 0x7f64e00cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64e698a640 1 -- 172.21.15.172:0/2253357636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64e009a090 msgr2=0x7f64e00cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64e698a640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64e009a090 0x7f64e00cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64e698a640 1 -- 172.21.15.172:0/2253357636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64e0099cb0 msgr2=0x7f64e00b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64e698a640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64e0099cb0 0x7f64e00b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64e698a640 1 -- 172.21.15.172:0/2253357636 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e00b5a60 con 0x7f64e00cfd30 2024-04-25T08:43:23.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64e698a640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 0x7f64e014dd90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f64d800c480 tx=0x7f64d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:23.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64d6ffd640 1 -- 172.21.15.172:0/2253357636 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8005ce0 con 0x7f64e00cfd30 2024-04-25T08:43:23.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64d6ffd640 1 -- 172.21.15.172:0/2253357636 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d8007070 con 0x7f64e00cfd30 2024-04-25T08:43:23.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64e83ed640 1 -- 172.21.15.172:0/2253357636 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e00b5d00 con 0x7f64e00cfd30 2024-04-25T08:43:23.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64d6ffd640 1 -- 172.21.15.172:0/2253357636 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d80074a0 con 0x7f64e00cfd30 2024-04-25T08:43:23.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.486+0000 7f64e83ed640 1 -- 172.21.15.172:0/2253357636 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e00b62c0 con 0x7f64e00cfd30 2024-04-25T08:43:23.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.487+0000 7f64e83ed640 1 -- 172.21.15.172:0/2253357636 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e0068370 con 0x7f64e00cfd30 2024-04-25T08:43:23.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.487+0000 7f64d6ffd640 1 -- 172.21.15.172:0/2253357636 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64d801b400 con 0x7f64e00cfd30 2024-04-25T08:43:23.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.488+0000 7f64d6ffd640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64c406b4d0 0x7f64c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.488+0000 7f64d6ffd640 1 -- 172.21.15.172:0/2253357636 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f64d808a060 con 0x7f64e00cfd30 2024-04-25T08:43:23.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.488+0000 7f64e6189640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64c406b4d0 0x7f64c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.488+0000 7f64e6189640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64c406b4d0 0x7f64c406d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64dc011340 tx=0x7f64dc00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:23.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.492+0000 7f64d6ffd640 1 -- 172.21.15.172:0/2253357636 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64e0068370 con 0x7f64e00cfd30 2024-04-25T08:43:23.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.664+0000 7f64e83ed640 1 -- 172.21.15.172:0/2253357636 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64e00c80a0 con 0x7f64e00cfd30 2024-04-25T08:43:23.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.664+0000 7f64d6ffd640 1 -- 172.21.15.172:0/2253357636 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64d8058520 con 0x7f64e00cfd30 2024-04-25T08:43:23.657 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.666+0000 7f64e83ed640 1 -- 172.21.15.172:0/2253357636 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64c406b4d0 msgr2=0x7f64c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.666+0000 7f64e83ed640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64c406b4d0 0x7f64c406d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64dc011340 tx=0x7f64dc00b040 comp rx=0 tx=0).stop 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.666+0000 7f64e83ed640 1 -- 172.21.15.172:0/2253357636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 msgr2=0x7f64e014dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.666+0000 7f64e83ed640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 0x7f64e014dd90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f64d800c480 tx=0x7f64d800c940 comp rx=0 tx=0).stop 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.666+0000 7f64e83ed640 1 -- 172.21.15.172:0/2253357636 shutdown_connections 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.666+0000 7f64e83ed640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64c406b4d0 0x7f64c406d990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.667+0000 7f64e83ed640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64e00cfd30 0x7f64e014dd90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.667+0000 7f64e83ed640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64e009a090 0x7f64e00cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.667+0000 7f64e83ed640 1 --2- 172.21.15.172:0/2253357636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64e0099cb0 0x7f64e00b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.667+0000 7f64e83ed640 1 -- 172.21.15.172:0/2253357636 >> 172.21.15.172:0/2253357636 conn(0x7f64e00b3290 msgr2=0x7f64e0070380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.667+0000 7f64e83ed640 1 -- 172.21.15.172:0/2253357636 shutdown_connections 2024-04-25T08:43:23.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.667+0000 7f64e83ed640 1 -- 172.21.15.172:0/2253357636 wait complete. 2024-04-25T08:43:23.670 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:43:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.778+0000 7faf73153640 1 Processor -- start 2024-04-25T08:43:23.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.778+0000 7faf73153640 1 -- start start 2024-04-25T08:43:23.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.779+0000 7faf73153640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faf6c15bb50 0x7faf6c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.779+0000 7faf73153640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faf6c0cfd10 0x7faf6c0cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.779+0000 7faf73153640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6c0c75e0 con 0x7faf6c0c70d0 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.779+0000 7faf73153640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6c0c8680 con 0x7faf6c0cfd10 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.779+0000 7faf73153640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6c0c78c0 con 0x7faf6c15bb50 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.779+0000 7faf716f0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faf6c0cfd10 0x7faf6c0cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.779+0000 7faf6bfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7faf6c0c70d0 0x7faf6c0cf600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52666/0 (socket says 172.21.15.172:52666) 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.779+0000 7faf6bfff640 1 -- 172.21.15.172:0/989759198 learned_addr learned my addr 172.21.15.172:0/989759198 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.780+0000 7faf70eef640 1 --2- 172.21.15.172:0/989759198 >> v2:172.21.15.186:3300/0 conn(0x7faf6c15bb50 0x7faf6c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.780+0000 7faf716f0640 1 -- 172.21.15.172:0/989759198 >> v2:172.21.15.186:3300/0 conn(0x7faf6c15bb50 msgr2=0x7faf6c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.780+0000 7faf716f0640 1 --2- 172.21.15.172:0/989759198 >> v2:172.21.15.186:3300/0 conn(0x7faf6c15bb50 0x7faf6c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.780+0000 7faf716f0640 1 -- 172.21.15.172:0/989759198 >> v1:172.21.15.172:6789/0 conn(0x7faf6c0c70d0 legacy=0x7faf6c0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.780+0000 7faf6b7fe640 1 -- 172.21.15.172:0/989759198 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228397732 0 0) 0x7faf6c0c75e0 con 0x7faf6c0c70d0 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.780+0000 7faf716f0640 1 -- 172.21.15.172:0/989759198 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c0c7ba0 con 0x7faf6c0cfd10 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.780+0000 7faf70eef640 1 --2- 172.21.15.172:0/989759198 >> v2:172.21.15.186:3300/0 conn(0x7faf6c15bb50 0x7faf6c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:23.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.780+0000 7faf716f0640 1 --2- 172.21.15.172:0/989759198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0cfd10 0x7faf6c0cbf20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf6c070ab0 tx=0x7faf6402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fbe73816264eb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf6b7fe640 1 -- 172.21.15.172:0/989759198 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64007740 con 0x7faf6c0cfd10 2024-04-25T08:43:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf6b7fe640 1 -- 172.21.15.172:0/989759198 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf640078e0 con 0x7faf6c0cfd10 2024-04-25T08:43:23.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf6b7fe640 1 -- 172.21.15.172:0/989759198 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64007cb0 con 0x7faf6c0cfd10 2024-04-25T08:43:23.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf73153640 1 -- 172.21.15.172:0/989759198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0cfd10 msgr2=0x7faf6c0cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf73153640 1 --2- 172.21.15.172:0/989759198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0cfd10 0x7faf6c0cbf20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faf6c070ab0 tx=0x7faf6402a710 comp rx=0 tx=0).stop 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf73153640 1 -- 172.21.15.172:0/989759198 shutdown_connections 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf73153640 1 --2- 172.21.15.172:0/989759198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0cfd10 0x7faf6c0cbf20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf73153640 1 --2- 172.21.15.172:0/989759198 >> v2:172.21.15.186:3300/0 conn(0x7faf6c15bb50 0x7faf6c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf73153640 1 -- 172.21.15.172:0/989759198 >> 172.21.15.172:0/989759198 conn(0x7faf6c06f500 msgr2=0x7faf6c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf73153640 1 -- 172.21.15.172:0/989759198 shutdown_connections 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.781+0000 7faf73153640 1 -- 172.21.15.172:0/989759198 wait complete. 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.782+0000 7faf73153640 1 Processor -- start 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.782+0000 7faf73153640 1 -- start start 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf73153640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0c70d0 0x7faf6c15cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf73153640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf6c0cfd10 0x7faf6c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf73153640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf6c15bb50 0x7faf6c147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf73153640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c15f6d0 con 0x7faf6c0c70d0 2024-04-25T08:43:23.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf73153640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0c8160 con 0x7faf6c0cfd10 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf73153640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c15f850 con 0x7faf6c15bb50 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf70eef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0c70d0 0x7faf6c15cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf70eef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0c70d0 0x7faf6c15cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59182/0 (socket says 172.21.15.172:59182) 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf70eef640 1 -- 172.21.15.172:0/4176173580 learned_addr learned my addr 172.21.15.172:0/4176173580 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf6bfff640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf6c0cfd10 0x7faf6c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.783+0000 7faf716f0640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf6c15bb50 0x7faf6c147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf70eef640 1 -- 172.21.15.172:0/4176173580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf6c15bb50 msgr2=0x7faf6c147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf70eef640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf6c15bb50 0x7faf6c147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf70eef640 1 -- 172.21.15.172:0/4176173580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf6c0cfd10 msgr2=0x7faf6c0c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf70eef640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf6c0cfd10 0x7faf6c0c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf70eef640 1 -- 172.21.15.172:0/4176173580 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c146b00 con 0x7faf6c0c70d0 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf70eef640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0c70d0 0x7faf6c15cc50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00d800 tx=0x7faf5c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf697fa640 1 -- 172.21.15.172:0/4176173580 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c004030 con 0x7faf6c0c70d0 2024-04-25T08:43:23.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf697fa640 1 -- 172.21.15.172:0/4176173580 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c0041d0 con 0x7faf6c0c70d0 2024-04-25T08:43:23.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf73153640 1 -- 172.21.15.172:0/4176173580 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c15d2e0 con 0x7faf6c0c70d0 2024-04-25T08:43:23.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf697fa640 1 -- 172.21.15.172:0/4176173580 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0096a0 con 0x7faf6c0c70d0 2024-04-25T08:43:23.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.784+0000 7faf73153640 1 -- 172.21.15.172:0/4176173580 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c15d8a0 con 0x7faf6c0c70d0 2024-04-25T08:43:23.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.785+0000 7faf73153640 1 -- 172.21.15.172:0/4176173580 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6c073a00 con 0x7faf6c0c70d0 2024-04-25T08:43:23.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.785+0000 7faf697fa640 1 -- 172.21.15.172:0/4176173580 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf5c009840 con 0x7faf6c0c70d0 2024-04-25T08:43:23.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.786+0000 7faf697fa640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf5806b500 0x7faf5806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:23.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.786+0000 7faf697fa640 1 -- 172.21.15.172:0/4176173580 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7faf5c08a900 con 0x7faf6c0c70d0 2024-04-25T08:43:23.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.786+0000 7faf6bfff640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf5806b500 0x7faf5806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:23.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.786+0000 7faf6bfff640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf5806b500 0x7faf5806d9c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faf6c157c90 tx=0x7faf60007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:23.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.790+0000 7faf697fa640 1 -- 172.21.15.172:0/4176173580 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf5c0592f0 con 0x7faf6c0c70d0 2024-04-25T08:43:23.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.961+0000 7faf73153640 1 -- 172.21.15.172:0/4176173580 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf6c0cf150 con 0x7faf6c0c70d0 2024-04-25T08:43:23.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.961+0000 7faf697fa640 1 -- 172.21.15.172:0/4176173580 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf5c058bf0 con 0x7faf6c0c70d0 2024-04-25T08:43:23.953 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:43:23.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 -- 172.21.15.172:0/4176173580 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf5806b500 msgr2=0x7faf5806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf5806b500 0x7faf5806d9c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faf6c157c90 tx=0x7faf60007b50 comp rx=0 tx=0).stop 2024-04-25T08:43:23.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 -- 172.21.15.172:0/4176173580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0c70d0 msgr2=0x7faf6c15cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:23.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0c70d0 0x7faf6c15cc50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00d800 tx=0x7faf5c00dcc0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 -- 172.21.15.172:0/4176173580 shutdown_connections 2024-04-25T08:43:23.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf5806b500 0x7faf5806d9c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf6c0cfd10 0x7faf6c0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf6c15bb50 0x7faf6c147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 --2- 172.21.15.172:0/4176173580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf6c0c70d0 0x7faf6c15cc50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:23.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 -- 172.21.15.172:0/4176173580 >> 172.21.15.172:0/4176173580 conn(0x7faf6c06f500 msgr2=0x7faf6c06f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:23.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 -- 172.21.15.172:0/4176173580 shutdown_connections 2024-04-25T08:43:23.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:23.963+0000 7faf73153640 1 -- 172.21.15.172:0/4176173580 wait complete. 2024-04-25T08:43:23.966 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T08:43:24.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.074+0000 7f45cb093640 1 Processor -- start 2024-04-25T08:43:24.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.074+0000 7f45cb093640 1 -- start start 2024-04-25T08:43:24.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.075+0000 7f45cb093640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f45c4161710 0x7f45c40d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.075+0000 7f45cb093640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c415e000 con 0x7f45c40ced80 2024-04-25T08:43:24.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.075+0000 7f45cb093640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c40d1de0 con 0x7f45c415dc20 2024-04-25T08:43:24.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.075+0000 7f45cb093640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c4161c60 con 0x7f45c4161710 2024-04-25T08:43:24.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.075+0000 7f45c3fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f45c40ced80 0x7f45c40d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52674/0 (socket says 172.21.15.172:52674) 2024-04-25T08:43:24.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.075+0000 7f45c3fff640 1 -- 172.21.15.172:0/3491376419 learned_addr learned my addr 172.21.15.172:0/3491376419 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c9630640 1 --2- 172.21.15.172:0/3491376419 >> v2:172.21.15.186:3300/0 conn(0x7f45c4161710 0x7f45c40d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75930152 0 0) 0x7f45c415e000 con 0x7f45c40ced80 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45ac003520 con 0x7f45c40ced80 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004510852 0 0) 0x7f45c40d1de0 con 0x7f45c415dc20 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45c415e000 con 0x7f45c415dc20 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 130516298 0 0) 0x7f45ac003520 con 0x7f45c40ced80 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 >> v2:172.21.15.186:3300/0 conn(0x7f45c4161710 msgr2=0x7f45c40d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 --2- 172.21.15.172:0/3491376419 >> v2:172.21.15.186:3300/0 conn(0x7f45c4161710 0x7f45c40d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 >> v1:172.21.15.186:6789/0 conn(0x7f45c415dc20 legacy=0x7f45c40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4161f40 con 0x7f45c40ced80 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f45b8001670 con 0x7f45c40ced80 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 >> v1:172.21.15.172:6789/0 conn(0x7f45c40ced80 legacy=0x7f45c40d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45ac003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45ac004800 0x7f45ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45ac0051c0 0x7f45ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4161c60 con 0x7f45ac003b40 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac00c040 con 0x7f45ac0051c0 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac00c240 con 0x7f45ac004800 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c8e2f640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45ac003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c9630640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45ac0051c0 0x7f45ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c3fff640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45ac004800 0x7f45ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c8e2f640 1 -- 172.21.15.172:0/3491376419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45ac004800 msgr2=0x7f45ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c8e2f640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45ac004800 0x7f45ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c8e2f640 1 -- 172.21.15.172:0/3491376419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45ac0051c0 msgr2=0x7f45ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c8e2f640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45ac0051c0 0x7f45ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c8e2f640 1 -- 172.21.15.172:0/3491376419 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac003520 con 0x7f45ac003b40 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c9630640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45ac0051c0 0x7f45ac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:24.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.076+0000 7f45c9630640 1 -- 172.21.15.172:0/3491376419 reap_dead start 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.077+0000 7f45c8e2f640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45ac003f40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f45b40018d0 tx=0x7f45ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e897e2c4f4ff166 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.077+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40014f0 con 0x7f45ac003b40 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.077+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b40052d0 con 0x7f45ac003b40 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.077+0000 7f45c37fe640 1 -- 172.21.15.172:0/3491376419 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b402ac40 con 0x7f45ac003b40 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.078+0000 7f45cb093640 1 -- 172.21.15.172:0/3491376419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 msgr2=0x7f45ac003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.078+0000 7f45cb093640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45ac003f40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f45b40018d0 tx=0x7f45ac005830 comp rx=0 tx=0).stop 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.078+0000 7f45cb093640 1 -- 172.21.15.172:0/3491376419 shutdown_connections 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.078+0000 7f45cb093640 1 --2- 172.21.15.172:0/3491376419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45ac003f40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.078+0000 7f45cb093640 1 -- 172.21.15.172:0/3491376419 >> 172.21.15.172:0/3491376419 conn(0x7f45c40d0420 msgr2=0x7f45c40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.078+0000 7f45cb093640 1 -- 172.21.15.172:0/3491376419 shutdown_connections 2024-04-25T08:43:24.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.078+0000 7f45cb093640 1 -- 172.21.15.172:0/3491376419 wait complete. 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.079+0000 7f45cb093640 1 Processor -- start 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.079+0000 7f45cb093640 1 -- start start 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45cb093640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45c40cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45cb093640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45c4152a20 0x7f45c4152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45cb093640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45c40cb030 0x7f45c40cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45cb093640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40b5e50 con 0x7f45ac003b40 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45cb093640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4162500 con 0x7f45c40cb030 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45cb093640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40b5fd0 con 0x7f45c4152a20 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c8e2f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45c40cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c8e2f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45c40cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59190/0 (socket says 172.21.15.172:59190) 2024-04-25T08:43:24.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c8e2f640 1 -- 172.21.15.172:0/3684696184 learned_addr learned my addr 172.21.15.172:0/3684696184 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c8e2f640 1 -- 172.21.15.172:0/3684696184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45c4152a20 msgr2=0x7f45c4152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c8e2f640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45c4152a20 0x7f45c4152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c8e2f640 1 -- 172.21.15.172:0/3684696184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45c40cb030 msgr2=0x7f45c40cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c8e2f640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45c40cb030 0x7f45c40cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c8e2f640 1 -- 172.21.15.172:0/3684696184 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c41533e0 con 0x7f45ac003b40 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c8e2f640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45c40cd920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f45b4000c00 tx=0x7f45b40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c17fa640 1 -- 172.21.15.172:0/3684696184 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b4040030 con 0x7f45ac003b40 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c17fa640 1 -- 172.21.15.172:0/3684696184 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4005480 con 0x7f45ac003b40 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45c17fa640 1 -- 172.21.15.172:0/3684696184 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40014f0 con 0x7f45ac003b40 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.080+0000 7f45cb093640 1 -- 172.21.15.172:0/3684696184 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c40cbda0 con 0x7f45ac003b40 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.081+0000 7f45cb093640 1 -- 172.21.15.172:0/3684696184 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c40cc360 con 0x7f45ac003b40 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.081+0000 7f45cb093640 1 -- 172.21.15.172:0/3684696184 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4073a00 con 0x7f45ac003b40 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.082+0000 7f45c17fa640 1 -- 172.21.15.172:0/3684696184 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f45b4043070 con 0x7f45ac003b40 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.082+0000 7f45c17fa640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45b006b4d0 0x7f45b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.082+0000 7f45c3fff640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45b006b4d0 0x7f45b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.082+0000 7f45c17fa640 1 -- 172.21.15.172:0/3684696184 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f45b40aa340 con 0x7f45ac003b40 2024-04-25T08:43:24.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.083+0000 7f45c3fff640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45b006b4d0 0x7f45b006d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f45b8001050 tx=0x7f45b8001170 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.087+0000 7f45c17fa640 1 -- 172.21.15.172:0/3684696184 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f45b4078e50 con 0x7f45ac003b40 2024-04-25T08:43:24.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.258+0000 7f45cb093640 1 -- 172.21.15.172:0/3684696184 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f45c40c70c0 con 0x7f45ac003b40 2024-04-25T08:43:24.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.258+0000 7f45c17fa640 1 -- 172.21.15.172:0/3684696184 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f45b4078750 con 0x7f45ac003b40 2024-04-25T08:43:24.251 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:43:24.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 -- 172.21.15.172:0/3684696184 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45b006b4d0 msgr2=0x7f45b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45b006b4d0 0x7f45b006d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f45b8001050 tx=0x7f45b8001170 comp rx=0 tx=0).stop 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 -- 172.21.15.172:0/3684696184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 msgr2=0x7f45c40cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45c40cd920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f45b4000c00 tx=0x7f45b40012d0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 -- 172.21.15.172:0/3684696184 shutdown_connections 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45b006b4d0 0x7f45b006d990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45c40cb030 0x7f45c40cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45c4152a20 0x7f45c4152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 --2- 172.21.15.172:0/3684696184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45ac003b40 0x7f45c40cd920 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 -- 172.21.15.172:0/3684696184 >> 172.21.15.172:0/3684696184 conn(0x7f45c40d0420 msgr2=0x7f45c40b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 -- 172.21.15.172:0/3684696184 shutdown_connections 2024-04-25T08:43:24.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.260+0000 7f45cb093640 1 -- 172.21.15.172:0/3684696184 wait complete. 2024-04-25T08:43:24.264 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:43:24.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.368+0000 7fc2328f5640 1 Processor -- start 2024-04-25T08:43:24.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.368+0000 7fc2328f5640 1 -- start start 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.369+0000 7fc2328f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc22c0d0aa0 0x7fc22c0b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.369+0000 7fc2328f5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc22c06fea0 0x7fc22c0b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.369+0000 7fc2328f5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22c0b3710 con 0x7fc22c15a790 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.369+0000 7fc2328f5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22c0cf0e0 con 0x7fc22c06fea0 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.369+0000 7fc2328f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0cf3c0 con 0x7fc22c0d0aa0 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.369+0000 7fc22bfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc22c15a790 0x7fc22c0d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52680/0 (socket says 172.21.15.172:52680) 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.369+0000 7fc22bfff640 1 -- 172.21.15.172:0/2997614595 learned_addr learned my addr 172.21.15.172:0/2997614595 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.370+0000 7fc230e92640 1 --2- 172.21.15.172:0/2997614595 >> v2:172.21.15.186:3300/0 conn(0x7fc22c06fea0 0x7fc22c0b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.370+0000 7fc22b7fe640 1 --2- 172.21.15.172:0/2997614595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc22c0d0aa0 0x7fc22c0b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.370+0000 7fc22affd640 1 -- 172.21.15.172:0/2997614595 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780354385 0 0) 0x7fc22c0b3710 con 0x7fc22c15a790 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.370+0000 7fc22affd640 1 -- 172.21.15.172:0/2997614595 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc214003520 con 0x7fc22c15a790 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.370+0000 7fc230e92640 1 -- 172.21.15.172:0/2997614595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc22c0d0aa0 msgr2=0x7fc22c0b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:24.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.370+0000 7fc230e92640 1 --2- 172.21.15.172:0/2997614595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc22c0d0aa0 0x7fc22c0b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.370+0000 7fc230e92640 1 -- 172.21.15.172:0/2997614595 >> v1:172.21.15.172:6789/0 conn(0x7fc22c15a790 legacy=0x7fc22c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.370+0000 7fc230e92640 1 -- 172.21.15.172:0/2997614595 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c0cf6a0 con 0x7fc22c06fea0 2024-04-25T08:43:24.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc230e92640 1 --2- 172.21.15.172:0/2997614595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc22c06fea0 0x7fc22c0b43e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc224009d90 tx=0x7fc22402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32078b35d26b963a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc22affd640 1 -- 172.21.15.172:0/2997614595 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224007740 con 0x7fc22c06fea0 2024-04-25T08:43:24.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc22affd640 1 -- 172.21.15.172:0/2997614595 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2240078e0 con 0x7fc22c06fea0 2024-04-25T08:43:24.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc22affd640 1 -- 172.21.15.172:0/2997614595 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224007c90 con 0x7fc22c06fea0 2024-04-25T08:43:24.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc2328f5640 1 -- 172.21.15.172:0/2997614595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc22c06fea0 msgr2=0x7fc22c0b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc2328f5640 1 --2- 172.21.15.172:0/2997614595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc22c06fea0 0x7fc22c0b43e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc224009d90 tx=0x7fc22402a660 comp rx=0 tx=0).stop 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc2328f5640 1 -- 172.21.15.172:0/2997614595 shutdown_connections 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc2328f5640 1 --2- 172.21.15.172:0/2997614595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc22c06fea0 0x7fc22c0b43e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc2328f5640 1 --2- 172.21.15.172:0/2997614595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc22c0d0aa0 0x7fc22c0b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc2328f5640 1 -- 172.21.15.172:0/2997614595 >> 172.21.15.172:0/2997614595 conn(0x7fc22c0b2370 msgr2=0x7fc22c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc2328f5640 1 -- 172.21.15.172:0/2997614595 shutdown_connections 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.371+0000 7fc2328f5640 1 -- 172.21.15.172:0/2997614595 wait complete. 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.372+0000 7fc2328f5640 1 Processor -- start 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.373+0000 7fc2328f5640 1 -- start start 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.373+0000 7fc2328f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc22c06fea0 0x7fc22c1e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.373+0000 7fc2328f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc22c0d0aa0 0x7fc22c1e4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.373+0000 7fc2328f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc22c15a790 0x7fc22c072570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.373+0000 7fc2328f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c15ab70 con 0x7fc22c15a790 2024-04-25T08:43:24.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.373+0000 7fc2328f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c0cf980 con 0x7fc22c06fea0 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.373+0000 7fc2328f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c15acf0 con 0x7fc22c0d0aa0 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.373+0000 7fc230e92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc22c15a790 0x7fc22c072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc230e92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc22c15a790 0x7fc22c072570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59198/0 (socket says 172.21.15.172:59198) 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc230e92640 1 -- 172.21.15.172:0/1316493225 learned_addr learned my addr 172.21.15.172:0/1316493225 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc22bfff640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc22c06fea0 0x7fc22c1e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc22b7fe640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc22c0d0aa0 0x7fc22c1e4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc230e92640 1 -- 172.21.15.172:0/1316493225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc22c0d0aa0 msgr2=0x7fc22c1e4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc230e92640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc22c0d0aa0 0x7fc22c1e4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc230e92640 1 -- 172.21.15.172:0/1316493225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc22c06fea0 msgr2=0x7fc22c1e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc230e92640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc22c06fea0 0x7fc22c1e66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc230e92640 1 -- 172.21.15.172:0/1316493225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c1e5600 con 0x7fc22c15a790 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc230e92640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc22c15a790 0x7fc22c072570 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc224009eb0 tx=0x7fc224004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc228ff9640 1 -- 172.21.15.172:0/1316493225 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224040070 con 0x7fc22c15a790 2024-04-25T08:43:24.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc228ff9640 1 -- 172.21.15.172:0/1316493225 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc224031c60 con 0x7fc22c15a790 2024-04-25T08:43:24.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc228ff9640 1 -- 172.21.15.172:0/1316493225 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224009450 con 0x7fc22c15a790 2024-04-25T08:43:24.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc2328f5640 1 -- 172.21.15.172:0/1316493225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22c1e58e0 con 0x7fc22c15a790 2024-04-25T08:43:24.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.374+0000 7fc2328f5640 1 -- 172.21.15.172:0/1316493225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22c1e5ea0 con 0x7fc22c15a790 2024-04-25T08:43:24.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.375+0000 7fc2328f5640 1 -- 172.21.15.172:0/1316493225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22c073990 con 0x7fc22c15a790 2024-04-25T08:43:24.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.375+0000 7fc228ff9640 1 -- 172.21.15.172:0/1316493225 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc224039040 con 0x7fc22c15a790 2024-04-25T08:43:24.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.376+0000 7fc228ff9640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc21806b4d0 0x7fc21806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.376+0000 7fc228ff9640 1 -- 172.21.15.172:0/1316493225 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc2240ab520 con 0x7fc22c15a790 2024-04-25T08:43:24.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.376+0000 7fc22bfff640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc21806b4d0 0x7fc21806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.376+0000 7fc22bfff640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc21806b4d0 0x7fc21806d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc21c005880 tx=0x7fc21c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.380+0000 7fc228ff9640 1 -- 172.21.15.172:0/1316493225 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc224079950 con 0x7fc22c15a790 2024-04-25T08:43:24.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.587+0000 7fc2328f5640 1 -- 172.21.15.172:0/1316493225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc22c0d0760 con 0x7fc22c15a790 2024-04-25T08:43:24.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.588+0000 7fc228ff9640 1 -- 172.21.15.172:0/1316493225 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4943 (secure 0 0 0) 0x7fc22407d9f0 con 0x7fc22c15a790 2024-04-25T08:43:24.580 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:24.580 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:42:28.003161+0000","modified":"2024-04-25T08:42:49.090813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:43:24.581 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 -- 172.21.15.172:0/1316493225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc21806b4d0 msgr2=0x7fc21806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc21806b4d0 0x7fc21806d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc21c005880 tx=0x7fc21c009040 comp rx=0 tx=0).stop 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 -- 172.21.15.172:0/1316493225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc22c15a790 msgr2=0x7fc22c072570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc22c15a790 0x7fc22c072570 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc224009eb0 tx=0x7fc224004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 -- 172.21.15.172:0/1316493225 shutdown_connections 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc21806b4d0 0x7fc21806d990 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc22c15a790 0x7fc22c072570 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc22c0d0aa0 0x7fc22c1e4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 --2- 172.21.15.172:0/1316493225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc22c06fea0 0x7fc22c1e66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 -- 172.21.15.172:0/1316493225 >> 172.21.15.172:0/1316493225 conn(0x7fc22c0b2370 msgr2=0x7fc22c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 -- 172.21.15.172:0/1316493225 shutdown_connections 2024-04-25T08:43:24.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.590+0000 7fc2328f5640 1 -- 172.21.15.172:0/1316493225 wait complete. 2024-04-25T08:43:24.593 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:24.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.700+0000 7fd7628e1640 1 Processor -- start 2024-04-25T08:43:24.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.700+0000 7fd7628e1640 1 -- start start 2024-04-25T08:43:24.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.701+0000 7fd7628e1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd75c0af720 0x7fd75c0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.701+0000 7fd7628e1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd75c0d02f0 0x7fd75c0d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.701+0000 7fd7628e1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c06fe00 con 0x7fd75c158220 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.701+0000 7fd7628e1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c0b3670 con 0x7fd75c0d02f0 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.701+0000 7fd7628e1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c070a10 con 0x7fd75c0af720 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.701+0000 7fd75bfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd75c158220 0x7fd75c15ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52684/0 (socket says 172.21.15.172:52684) 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.701+0000 7fd75bfff640 1 -- 172.21.15.172:0/3311060620 learned_addr learned my addr 172.21.15.172:0/3311060620 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.701+0000 7fd760e7e640 1 --2- 172.21.15.172:0/3311060620 >> v2:172.21.15.172:3300/0 conn(0x7fd75c0d02f0 0x7fd75c0d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.701+0000 7fd75b7fe640 1 --2- 172.21.15.172:0/3311060620 >> v2:172.21.15.186:3300/0 conn(0x7fd75c0af720 0x7fd75c0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.702+0000 7fd75affd640 1 -- 172.21.15.172:0/3311060620 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323247518 0 0) 0x7fd75c06fe00 con 0x7fd75c158220 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.702+0000 7fd75affd640 1 -- 172.21.15.172:0/3311060620 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd744003520 con 0x7fd75c158220 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.702+0000 7fd760e7e640 1 -- 172.21.15.172:0/3311060620 >> v2:172.21.15.186:3300/0 conn(0x7fd75c0af720 msgr2=0x7fd75c0afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.702+0000 7fd760e7e640 1 --2- 172.21.15.172:0/3311060620 >> v2:172.21.15.186:3300/0 conn(0x7fd75c0af720 0x7fd75c0afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.702+0000 7fd760e7e640 1 -- 172.21.15.172:0/3311060620 >> v1:172.21.15.172:6789/0 conn(0x7fd75c158220 legacy=0x7fd75c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.702+0000 7fd760e7e640 1 -- 172.21.15.172:0/3311060620 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c0700e0 con 0x7fd75c0d02f0 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.702+0000 7fd760e7e640 1 --2- 172.21.15.172:0/3311060620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c0d02f0 0x7fd75c0d0720 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0cfc70 tx=0x7fd75402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8fe4570d72e2e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.702+0000 7fd75affd640 1 -- 172.21.15.172:0/3311060620 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754007740 con 0x7fd75c0d02f0 2024-04-25T08:43:24.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.702+0000 7fd75affd640 1 -- 172.21.15.172:0/3311060620 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7540078e0 con 0x7fd75c0d02f0 2024-04-25T08:43:24.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.703+0000 7fd75affd640 1 -- 172.21.15.172:0/3311060620 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754007cb0 con 0x7fd75c0d02f0 2024-04-25T08:43:24.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.703+0000 7fd7628e1640 1 -- 172.21.15.172:0/3311060620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c0d02f0 msgr2=0x7fd75c0d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.703+0000 7fd7628e1640 1 --2- 172.21.15.172:0/3311060620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c0d02f0 0x7fd75c0d0720 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0cfc70 tx=0x7fd75402a680 comp rx=0 tx=0).stop 2024-04-25T08:43:24.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.703+0000 7fd7628e1640 1 -- 172.21.15.172:0/3311060620 shutdown_connections 2024-04-25T08:43:24.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.703+0000 7fd7628e1640 1 --2- 172.21.15.172:0/3311060620 >> v2:172.21.15.186:3300/0 conn(0x7fd75c0af720 0x7fd75c0afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.703+0000 7fd7628e1640 1 --2- 172.21.15.172:0/3311060620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c0d02f0 0x7fd75c0d0720 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.703+0000 7fd7628e1640 1 -- 172.21.15.172:0/3311060620 >> 172.21.15.172:0/3311060620 conn(0x7fd75c0b2370 msgr2=0x7fd75c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:24.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.703+0000 7fd7628e1640 1 -- 172.21.15.172:0/3311060620 shutdown_connections 2024-04-25T08:43:24.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.703+0000 7fd7628e1640 1 -- 172.21.15.172:0/3311060620 wait complete. 2024-04-25T08:43:24.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.704+0000 7fd7628e1640 1 Processor -- start 2024-04-25T08:43:24.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.704+0000 7fd7628e1640 1 -- start start 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd7628e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd75c0af720 0x7fd75c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd7628e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd75c0d02f0 0x7fd75c14c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd7628e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c158220 0x7fd75c159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd7628e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c158600 con 0x7fd75c158220 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd7628e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c0706a0 con 0x7fd75c0d02f0 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd7628e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c072960 con 0x7fd75c0af720 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd760e7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c158220 0x7fd75c159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd760e7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c158220 0x7fd75c159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59218/0 (socket says 172.21.15.172:59218) 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd760e7e640 1 -- 172.21.15.172:0/1106217396 learned_addr learned my addr 172.21.15.172:0/1106217396 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd75b7fe640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd75c0d02f0 0x7fd75c14c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.705+0000 7fd75bfff640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd75c0af720 0x7fd75c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd760e7e640 1 -- 172.21.15.172:0/1106217396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd75c0af720 msgr2=0x7fd75c0cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd760e7e640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd75c0af720 0x7fd75c0cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd760e7e640 1 -- 172.21.15.172:0/1106217396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd75c0d02f0 msgr2=0x7fd75c14c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd760e7e640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd75c0d02f0 0x7fd75c14c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd760e7e640 1 -- 172.21.15.172:0/1106217396 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c15f4d0 con 0x7fd75c158220 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd75b7fe640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd75c0d02f0 0x7fd75c14c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd760e7e640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c158220 0x7fd75c159ba0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd75402ac70 tx=0x7fd754004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd758ff9640 1 -- 172.21.15.172:0/1106217396 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75403f070 con 0x7fd75c158220 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd758ff9640 1 -- 172.21.15.172:0/1106217396 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd754031bc0 con 0x7fd75c158220 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd7628e1640 1 -- 172.21.15.172:0/1106217396 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c1603e0 con 0x7fd75c158220 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd758ff9640 1 -- 172.21.15.172:0/1106217396 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754009450 con 0x7fd75c158220 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.706+0000 7fd7628e1640 1 -- 172.21.15.172:0/1106217396 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c1609a0 con 0x7fd75c158220 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.707+0000 7fd7628e1640 1 -- 172.21.15.172:0/1106217396 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c073990 con 0x7fd75c158220 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.707+0000 7fd758ff9640 1 -- 172.21.15.172:0/1106217396 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd75403b410 con 0x7fd75c158220 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.708+0000 7fd758ff9640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd74806b4d0 0x7fd74806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.708+0000 7fd75bfff640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd74806b4d0 0x7fd74806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.708+0000 7fd758ff9640 1 -- 172.21.15.172:0/1106217396 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd7540abd20 con 0x7fd75c158220 2024-04-25T08:43:24.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.708+0000 7fd75bfff640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd74806b4d0 0x7fd74806d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd74c005880 tx=0x7fd74c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.712+0000 7fd758ff9640 1 -- 172.21.15.172:0/1106217396 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd75407a150 con 0x7fd75c158220 2024-04-25T08:43:24.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.883+0000 7fd7628e1640 1 -- 172.21.15.172:0/1106217396 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd75c156770 con 0x7fd75c158220 2024-04-25T08:43:24.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.884+0000 7fd758ff9640 1 -- 172.21.15.172:0/1106217396 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18905 (secure 0 0 0) 0x7fd75407e1f0 con 0x7fd75c158220 2024-04-25T08:43:24.877 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:24.877 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:09.821048+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.886+0000 7fd7628e1640 1 -- 172.21.15.172:0/1106217396 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd74806b4d0 msgr2=0x7fd74806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.886+0000 7fd7628e1640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd74806b4d0 0x7fd74806d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd74c005880 tx=0x7fd74c009040 comp rx=0 tx=0).stop 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.886+0000 7fd7628e1640 1 -- 172.21.15.172:0/1106217396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c158220 msgr2=0x7fd75c159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.886+0000 7fd7628e1640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c158220 0x7fd75c159ba0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd75402ac70 tx=0x7fd754004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.886+0000 7fd7628e1640 1 -- 172.21.15.172:0/1106217396 shutdown_connections 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.886+0000 7fd7628e1640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd74806b4d0 0x7fd74806d990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.886+0000 7fd7628e1640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd75c0d02f0 0x7fd75c14c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.886+0000 7fd7628e1640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75c158220 0x7fd75c159ba0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.886+0000 7fd7628e1640 1 --2- 172.21.15.172:0/1106217396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd75c0af720 0x7fd75c0cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.886+0000 7fd7628e1640 1 -- 172.21.15.172:0/1106217396 >> 172.21.15.172:0/1106217396 conn(0x7fd75c0b2370 msgr2=0x7fd75c1571e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.887+0000 7fd7628e1640 1 -- 172.21.15.172:0/1106217396 shutdown_connections 2024-04-25T08:43:24.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.887+0000 7fd7628e1640 1 -- 172.21.15.172:0/1106217396 wait complete. 2024-04-25T08:43:24.890 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:43:24.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:43:24.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.995+0000 7fb91f46b640 1 Processor -- start 2024-04-25T08:43:24.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.995+0000 7fb91f46b640 1 -- start start 2024-04-25T08:43:24.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.996+0000 7fb91f46b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb918071ac0 0x7fb9180ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.996+0000 7fb91f46b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91806c1d0 0x7fb91806afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.996+0000 7fb91f46b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91815ec60 con 0x7fb918154ed0 2024-04-25T08:43:24.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.996+0000 7fb91f46b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91815ef40 con 0x7fb918071ac0 2024-04-25T08:43:24.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.996+0000 7fb91f46b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91806db90 con 0x7fb91806c1d0 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.996+0000 7fb91d207640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb918154ed0 0x7fb9180aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52696/0 (socket says 172.21.15.172:52696) 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.996+0000 7fb91d207640 1 -- 172.21.15.172:0/1496161635 learned_addr learned my addr 172.21.15.172:0/1496161635 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.996+0000 7fb91ca06640 1 --2- 172.21.15.172:0/1496161635 >> v2:172.21.15.186:3300/0 conn(0x7fb918071ac0 0x7fb9180ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.996+0000 7fb91da08640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91806c1d0 0x7fb91806afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.996+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199651096 0 0) 0x7fb91815ec60 con 0x7fb918154ed0 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb904003520 con 0x7fb918154ed0 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1304883476 0 0) 0x7fb904003520 con 0x7fb918154ed0 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91806c1d0 msgr2=0x7fb91806afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91806c1d0 0x7fb91806afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 >> v2:172.21.15.186:3300/0 conn(0x7fb918071ac0 msgr2=0x7fb9180ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 --2- 172.21.15.172:0/1496161635 >> v2:172.21.15.186:3300/0 conn(0x7fb918071ac0 0x7fb9180ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91806de70 con 0x7fb918154ed0 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fb9140019f0 con 0x7fb918154ed0 2024-04-25T08:43:24.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 >> v1:172.21.15.172:6789/0 conn(0x7fb918154ed0 legacy=0x7fb9180aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9040039b0 0x7fb904003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91806c1d0 0x7fb904004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb904004d40 0x7fb9040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91815ef40 con 0x7fb9040039b0 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91806db90 con 0x7fb904004d40 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90400b9c0 con 0x7fb91806c1d0 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb91ca06640 1 --2- 172.21.15.172:0/1496161635 >> v2:172.21.15.186:3300/0 conn(0x7fb918071ac0 0x7fb9180ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb91d207640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9040039b0 0x7fb904003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb91da08640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb904004d40 0x7fb9040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb91ca06640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91806c1d0 0x7fb904004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb91d207640 1 -- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91806c1d0 msgr2=0x7fb904004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb91d207640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91806c1d0 0x7fb904004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb91d207640 1 -- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb904004d40 msgr2=0x7fb9040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb91d207640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb904004d40 0x7fb9040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb91d207640 1 -- 172.21.15.172:0/1496161635 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb904003520 con 0x7fb9040039b0 2024-04-25T08:43:24.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.997+0000 7fb91ca06640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91806c1d0 0x7fb904004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.998+0000 7fb91d207640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9040039b0 0x7fb904003dd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb91400a8b0 tx=0x7fb904005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85cab893694c324 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.998+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91400a4d0 con 0x7fb9040039b0 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.998+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91402f070 con 0x7fb9040039b0 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.998+0000 7fb90ffff640 1 -- 172.21.15.172:0/1496161635 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91402bd10 con 0x7fb9040039b0 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.999+0000 7fb91f46b640 1 -- 172.21.15.172:0/1496161635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9040039b0 msgr2=0x7fb904003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.999+0000 7fb91f46b640 1 --2- 172.21.15.172:0/1496161635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9040039b0 0x7fb904003dd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb91400a8b0 tx=0x7fb904005830 comp rx=0 tx=0).stop 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.999+0000 7fb91da08640 1 -- 172.21.15.172:0/1496161635 reap_dead start 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.999+0000 7fb91f46b640 1 -- 172.21.15.172:0/1496161635 shutdown_connections 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.999+0000 7fb91f46b640 1 -- 172.21.15.172:0/1496161635 >> 172.21.15.172:0/1496161635 conn(0x7fb9180af670 msgr2=0x7fb9180b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.999+0000 7fb91f46b640 1 -- 172.21.15.172:0/1496161635 shutdown_connections 2024-04-25T08:43:24.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:24.999+0000 7fb91f46b640 1 -- 172.21.15.172:0/1496161635 wait complete. 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.000+0000 7fb91f46b640 1 Processor -- start 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.000+0000 7fb91f46b640 1 -- start start 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91f46b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb918141700 0x7fb9181f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91f46b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9181f74f0 0x7fb9180b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91f46b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918141ae0 0x7fb9180b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91f46b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91806b120 con 0x7fb9181f74f0 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91f46b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91806afa0 con 0x7fb918141ae0 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91f46b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91806b2a0 con 0x7fb918141700 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91ca06640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9181f74f0 0x7fb9180b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91ca06640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9181f74f0 0x7fb9180b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59244/0 (socket says 172.21.15.172:59244) 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91ca06640 1 -- 172.21.15.172:0/4156432695 learned_addr learned my addr 172.21.15.172:0/4156432695 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:24.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91da08640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918141ae0 0x7fb9180b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91d207640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb918141700 0x7fb9181f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91ca06640 1 -- 172.21.15.172:0/4156432695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb918141700 msgr2=0x7fb9181f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91ca06640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb918141700 0x7fb9181f49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91ca06640 1 -- 172.21.15.172:0/4156432695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918141ae0 msgr2=0x7fb9180b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91ca06640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918141ae0 0x7fb9180b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91ca06640 1 -- 172.21.15.172:0/4156432695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9181f79f0 con 0x7fb9181f74f0 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91da08640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918141ae0 0x7fb9180b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91ca06640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9181f74f0 0x7fb9180b0ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb908011900 tx=0x7fb908011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb90dffb640 1 -- 172.21.15.172:0/4156432695 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90800fbd0 con 0x7fb9181f74f0 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb90dffb640 1 -- 172.21.15.172:0/4156432695 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90800fd70 con 0x7fb9181f74f0 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb90dffb640 1 -- 172.21.15.172:0/4156432695 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908015660 con 0x7fb9181f74f0 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.001+0000 7fb91f46b640 1 -- 172.21.15.172:0/4156432695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9181f7cd0 con 0x7fb9181f74f0 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.002+0000 7fb91f46b640 1 -- 172.21.15.172:0/4156432695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9181f8290 con 0x7fb9181f74f0 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.002+0000 7fb91f46b640 1 -- 172.21.15.172:0/4156432695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9180b2b10 con 0x7fb9181f74f0 2024-04-25T08:43:24.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.003+0000 7fb90dffb640 1 -- 172.21.15.172:0/4156432695 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb908015800 con 0x7fb9181f74f0 2024-04-25T08:43:24.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.003+0000 7fb90dffb640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8fc06b500 0x7fb8fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:24.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.003+0000 7fb90dffb640 1 -- 172.21.15.172:0/4156432695 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb90808b0f0 con 0x7fb9181f74f0 2024-04-25T08:43:24.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.003+0000 7fb91d207640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8fc06b500 0x7fb8fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:24.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.004+0000 7fb91d207640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8fc06b500 0x7fb8fc06d9c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb914033000 tx=0x7fb91402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:24.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.008+0000 7fb90dffb640 1 -- 172.21.15.172:0/4156432695 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb908019030 con 0x7fb9181f74f0 2024-04-25T08:43:25.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.211+0000 7fb91f46b640 1 -- 172.21.15.172:0/4156432695 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb918073990 con 0x7fb9181f74f0 2024-04-25T08:43:25.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.212+0000 7fb90dffb640 1 -- 172.21.15.172:0/4156432695 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4943 (secure 0 0 0) 0x7fb908059b70 con 0x7fb9181f74f0 2024-04-25T08:43:25.204 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:25.204 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:42:28.003161+0000","modified":"2024-04-25T08:42:49.090813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:43:25.204 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2024-04-25T08:43:25.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 -- 172.21.15.172:0/4156432695 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8fc06b500 msgr2=0x7fb8fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8fc06b500 0x7fb8fc06d9c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb914033000 tx=0x7fb91402e000 comp rx=0 tx=0).stop 2024-04-25T08:43:25.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 -- 172.21.15.172:0/4156432695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9181f74f0 msgr2=0x7fb9180b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9181f74f0 0x7fb9180b0ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb908011900 tx=0x7fb908011dc0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 -- 172.21.15.172:0/4156432695 shutdown_connections 2024-04-25T08:43:25.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8fc06b500 0x7fb8fc06d9c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb918141ae0 0x7fb9180b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9181f74f0 0x7fb9180b0ab0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 --2- 172.21.15.172:0/4156432695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb918141700 0x7fb9181f49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 -- 172.21.15.172:0/4156432695 >> 172.21.15.172:0/4156432695 conn(0x7fb9040039b0 msgr2=0x7fb9180b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:25.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 -- 172.21.15.172:0/4156432695 shutdown_connections 2024-04-25T08:43:25.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.214+0000 7fb91f46b640 1 -- 172.21.15.172:0/4156432695 wait complete. 2024-04-25T08:43:25.217 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:43:25.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.322+0000 7f5f788cb640 1 Processor -- start 2024-04-25T08:43:25.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.322+0000 7f5f788cb640 1 -- start start 2024-04-25T08:43:25.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f788cb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5f740cedf0 0x7f5f741616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f788cb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5f740b93a0 0x7f5f740d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f788cb640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7415e000 con 0x7f5f7415dc20 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f788cb640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f740b6bb0 con 0x7f5f740cedf0 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f788cb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f740b6030 con 0x7f5f740b93a0 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f71d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5f740cedf0 0x7f5f741616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f71d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5f740cedf0 0x7f5f741616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59256/0 (socket says 172.21.15.172:59256) 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f71d9b640 1 -- 172.21.15.172:0/3161795707 learned_addr learned my addr 172.21.15.172:0/3161795707 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f72d9d640 1 --2- 172.21.15.172:0/3161795707 >> v2:172.21.15.186:3300/0 conn(0x7f5f740b93a0 0x7f5f740d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f71d9b640 1 -- 172.21.15.172:0/3161795707 >> v2:172.21.15.186:3300/0 conn(0x7f5f740b93a0 msgr2=0x7f5f740d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f71d9b640 1 --2- 172.21.15.172:0/3161795707 >> v2:172.21.15.186:3300/0 conn(0x7f5f740b93a0 0x7f5f740d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f71d9b640 1 -- 172.21.15.172:0/3161795707 >> v1:172.21.15.186:6789/0 conn(0x7f5f7415dc20 legacy=0x7f5f740ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f71d9b640 1 -- 172.21.15.172:0/3161795707 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74161de0 con 0x7f5f740cedf0 2024-04-25T08:43:25.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.323+0000 7f5f72d9d640 1 --2- 172.21.15.172:0/3161795707 >> v2:172.21.15.186:3300/0 conn(0x7f5f740b93a0 0x7f5f740d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:25.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.324+0000 7f5f71d9b640 1 --2- 172.21.15.172:0/3161795707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740cedf0 0x7f5f741616b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5f740cdff0 tx=0x7f5f6802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460a58b10a61849b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.324+0000 7f5f7159a640 1 -- 172.21.15.172:0/3161795707 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68037070 con 0x7f5f740cedf0 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.324+0000 7f5f7159a640 1 -- 172.21.15.172:0/3161795707 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f68032440 con 0x7f5f740cedf0 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.324+0000 7f5f7159a640 1 -- 172.21.15.172:0/3161795707 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68032810 con 0x7f5f740cedf0 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.325+0000 7f5f788cb640 1 -- 172.21.15.172:0/3161795707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740cedf0 msgr2=0x7f5f741616b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.325+0000 7f5f788cb640 1 --2- 172.21.15.172:0/3161795707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740cedf0 0x7f5f741616b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5f740cdff0 tx=0x7f5f6802a230 comp rx=0 tx=0).stop 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.325+0000 7f5f788cb640 1 -- 172.21.15.172:0/3161795707 shutdown_connections 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.325+0000 7f5f788cb640 1 --2- 172.21.15.172:0/3161795707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740cedf0 0x7f5f741616b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.325+0000 7f5f788cb640 1 --2- 172.21.15.172:0/3161795707 >> v2:172.21.15.186:3300/0 conn(0x7f5f740b93a0 0x7f5f740d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.325+0000 7f5f788cb640 1 -- 172.21.15.172:0/3161795707 >> 172.21.15.172:0/3161795707 conn(0x7f5f740d0490 msgr2=0x7f5f740d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.325+0000 7f5f788cb640 1 -- 172.21.15.172:0/3161795707 shutdown_connections 2024-04-25T08:43:25.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.325+0000 7f5f788cb640 1 -- 172.21.15.172:0/3161795707 wait complete. 2024-04-25T08:43:25.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.326+0000 7f5f788cb640 1 Processor -- start 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.326+0000 7f5f788cb640 1 -- start start 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f788cb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740b93a0 0x7f5f74159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f788cb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f740cedf0 0x7f5f74157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f788cb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f7415dc20 0x7f5f741f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f788cb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740d2a50 con 0x7f5f740b93a0 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f788cb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f741623a0 con 0x7f5f7415dc20 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f788cb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740d2bd0 con 0x7f5f740cedf0 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f7259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740b93a0 0x7f5f74159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f7259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740b93a0 0x7f5f74159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59264/0 (socket says 172.21.15.172:59264) 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f7259c640 1 -- 172.21.15.172:0/1317203385 learned_addr learned my addr 172.21.15.172:0/1317203385 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f72d9d640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f7415dc20 0x7f5f741f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f71d9b640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f740cedf0 0x7f5f74157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f7259c640 1 -- 172.21.15.172:0/1317203385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f740cedf0 msgr2=0x7f5f74157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f7259c640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f740cedf0 0x7f5f74157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f7259c640 1 -- 172.21.15.172:0/1317203385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f7415dc20 msgr2=0x7f5f741f70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f7259c640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f7415dc20 0x7f5f741f70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f7259c640 1 -- 172.21.15.172:0/1317203385 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7415a390 con 0x7f5f740b93a0 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f72d9d640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f7415dc20 0x7f5f741f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f7259c640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740b93a0 0x7f5f74159a60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400b3f0 tx=0x7f5f6400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.327+0000 7f5f62ffd640 1 -- 172.21.15.172:0/1317203385 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64015020 con 0x7f5f740b93a0 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.328+0000 7f5f62ffd640 1 -- 172.21.15.172:0/1317203385 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f64011830 con 0x7f5f740b93a0 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.328+0000 7f5f62ffd640 1 -- 172.21.15.172:0/1317203385 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64011c20 con 0x7f5f740b93a0 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.328+0000 7f5f788cb640 1 -- 172.21.15.172:0/1317203385 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7415a670 con 0x7f5f740b93a0 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.328+0000 7f5f788cb640 1 -- 172.21.15.172:0/1317203385 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f74159fa0 con 0x7f5f740b93a0 2024-04-25T08:43:25.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.329+0000 7f5f788cb640 1 -- 172.21.15.172:0/1317203385 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f74073990 con 0x7f5f740b93a0 2024-04-25T08:43:25.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.329+0000 7f5f62ffd640 1 -- 172.21.15.172:0/1317203385 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5f64018020 con 0x7f5f740b93a0 2024-04-25T08:43:25.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.329+0000 7f5f62ffd640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f5406b4d0 0x7f5f5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.330+0000 7f5f62ffd640 1 -- 172.21.15.172:0/1317203385 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5f6408a190 con 0x7f5f740b93a0 2024-04-25T08:43:25.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.330+0000 7f5f71d9b640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f5406b4d0 0x7f5f5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.330+0000 7f5f71d9b640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f5406b4d0 0x7f5f5406d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5f68034000 tx=0x7f5f6802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:25.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.334+0000 7f5f62ffd640 1 -- 172.21.15.172:0/1317203385 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f6401f030 con 0x7f5f740b93a0 2024-04-25T08:43:25.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.542+0000 7f5f788cb640 1 -- 172.21.15.172:0/1317203385 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f740d1720 con 0x7f5f740b93a0 2024-04-25T08:43:25.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.543+0000 7f5f62ffd640 1 -- 172.21.15.172:0/1317203385 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4943 (secure 0 0 0) 0x7f5f640172c0 con 0x7f5f740b93a0 2024-04-25T08:43:25.536 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:25.536 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1499114774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1499114774},{"type":"v1","addr":"172.21.15.172:6836","nonce":1499114774}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/839716219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":839716219},{"type":"v1","addr":"172.21.15.172:6837","nonce":839716219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3196690942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3196690942},{"type":"v1","addr":"172.21.15.186:6834","nonce":3196690942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:42:28.003161+0000","modified":"2024-04-25T08:42:49.090813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3177493296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3177493296},{"type":"v1","addr":"172.21.15.186:6835","nonce":3177493296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T08:43:25.536 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 8 2024-04-25T08:43:25.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 -- 172.21.15.172:0/1317203385 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f5406b4d0 msgr2=0x7f5f5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f5406b4d0 0x7f5f5406d990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5f68034000 tx=0x7f5f6802e000 comp rx=0 tx=0).stop 2024-04-25T08:43:25.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 -- 172.21.15.172:0/1317203385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740b93a0 msgr2=0x7f5f74159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740b93a0 0x7f5f74159a60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400b3f0 tx=0x7f5f6400b8b0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 -- 172.21.15.172:0/1317203385 shutdown_connections 2024-04-25T08:43:25.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f5406b4d0 0x7f5f5406d990 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f7415dc20 0x7f5f741f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f740cedf0 0x7f5f74157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 --2- 172.21.15.172:0/1317203385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f740b93a0 0x7f5f74159a60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 -- 172.21.15.172:0/1317203385 >> 172.21.15.172:0/1317203385 conn(0x7f5f740d0490 msgr2=0x7f5f740ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:25.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 -- 172.21.15.172:0/1317203385 shutdown_connections 2024-04-25T08:43:25.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.545+0000 7f5f788cb640 1 -- 172.21.15.172:0/1317203385 wait complete. 2024-04-25T08:43:25.549 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:25.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.652+0000 7fbbfa9ce640 1 Processor -- start 2024-04-25T08:43:25.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.652+0000 7fbbfa9ce640 1 -- start start 2024-04-25T08:43:25.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbfa9ce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf415c9e0 0x7fbbf4071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbfa9ce640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbbf4072000 0x7fbbf406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbfa9ce640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf415ce40 con 0x7fbbf4155fe0 2024-04-25T08:43:25.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbfa9ce640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf4072470 con 0x7fbbf4072000 2024-04-25T08:43:25.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbfa9ce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf406de40 con 0x7fbbf415c9e0 2024-04-25T08:43:25.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbf8f6b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbbf4072000 0x7fbbf406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbf3fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbbf4155fe0 0x7fbbf40adbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52702/0 (socket says 172.21.15.172:52702) 2024-04-25T08:43:25.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbf3fff640 1 -- 172.21.15.172:0/4178324343 learned_addr learned my addr 172.21.15.172:0/4178324343 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbf37fe640 1 --2- 172.21.15.172:0/4178324343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf415c9e0 0x7fbbf4071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbf8f6b640 1 -- 172.21.15.172:0/4178324343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf415c9e0 msgr2=0x7fbbf4071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbf8f6b640 1 --2- 172.21.15.172:0/4178324343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf415c9e0 0x7fbbf4071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbf8f6b640 1 -- 172.21.15.172:0/4178324343 >> v1:172.21.15.172:6789/0 conn(0x7fbbf4155fe0 legacy=0x7fbbf40adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.653+0000 7fbbf2ffd640 1 -- 172.21.15.172:0/4178324343 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906051183 0 0) 0x7fbbf415ce40 con 0x7fbbf4155fe0 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.654+0000 7fbbf8f6b640 1 -- 172.21.15.172:0/4178324343 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40ad0e0 con 0x7fbbf4072000 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.654+0000 7fbbf37fe640 1 --2- 172.21.15.172:0/4178324343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf415c9e0 0x7fbbf4071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.654+0000 7fbbf8f6b640 1 --2- 172.21.15.172:0/4178324343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4072000 0x7fbbf406abe0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009d90 tx=0x7fbbec02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e96c6627f1b2798 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.654+0000 7fbbf2ffd640 1 -- 172.21.15.172:0/4178324343 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec031600 con 0x7fbbf4072000 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.654+0000 7fbbf2ffd640 1 -- 172.21.15.172:0/4178324343 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec0317a0 con 0x7fbbf4072000 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.654+0000 7fbbf2ffd640 1 -- 172.21.15.172:0/4178324343 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec031b70 con 0x7fbbf4072000 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.655+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/4178324343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4072000 msgr2=0x7fbbf406abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.655+0000 7fbbfa9ce640 1 --2- 172.21.15.172:0/4178324343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4072000 0x7fbbf406abe0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009d90 tx=0x7fbbec02a5d0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.655+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/4178324343 shutdown_connections 2024-04-25T08:43:25.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.655+0000 7fbbfa9ce640 1 --2- 172.21.15.172:0/4178324343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf415c9e0 0x7fbbf4071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.655+0000 7fbbfa9ce640 1 --2- 172.21.15.172:0/4178324343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4072000 0x7fbbf406abe0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.655+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/4178324343 >> 172.21.15.172:0/4178324343 conn(0x7fbbf40af670 msgr2=0x7fbbf40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:25.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.655+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/4178324343 shutdown_connections 2024-04-25T08:43:25.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.655+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/4178324343 wait complete. 2024-04-25T08:43:25.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.656+0000 7fbbfa9ce640 1 Processor -- start 2024-04-25T08:43:25.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.656+0000 7fbbfa9ce640 1 -- start start 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbfa9ce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf4155fe0 0x7fbbf4145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbfa9ce640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf415c9e0 0x7fbbf40b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbfa9ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4142710 0x7fbbf41f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbfa9ce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf41563c0 con 0x7fbbf4142710 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbfa9ce640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40ad6a0 con 0x7fbbf415c9e0 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbfa9ce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf406f880 con 0x7fbbf4155fe0 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf8f6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4142710 0x7fbbf41f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf8f6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4142710 0x7fbbf41f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59276/0 (socket says 172.21.15.172:59276) 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf8f6b640 1 -- 172.21.15.172:0/201403253 learned_addr learned my addr 172.21.15.172:0/201403253 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf37fe640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf415c9e0 0x7fbbf40b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf3fff640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf4155fe0 0x7fbbf4145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf8f6b640 1 -- 172.21.15.172:0/201403253 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf4155fe0 msgr2=0x7fbbf4145cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf8f6b640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf4155fe0 0x7fbbf4145cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf8f6b640 1 -- 172.21.15.172:0/201403253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf415c9e0 msgr2=0x7fbbf40b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf8f6b640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf415c9e0 0x7fbbf40b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf8f6b640 1 -- 172.21.15.172:0/201403253 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40b45f0 con 0x7fbbf4142710 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf37fe640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf415c9e0 0x7fbbf40b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.657+0000 7fbbf8f6b640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4142710 0x7fbbf41f3ed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbbec02abc0 tx=0x7fbbec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.658+0000 7fbbf0ff9640 1 -- 172.21.15.172:0/201403253 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec03f070 con 0x7fbbf4142710 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.658+0000 7fbbf0ff9640 1 -- 172.21.15.172:0/201403253 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec030b60 con 0x7fbbf4142710 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.658+0000 7fbbf0ff9640 1 -- 172.21.15.172:0/201403253 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec044460 con 0x7fbbf4142710 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.658+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/201403253 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf41f36f0 con 0x7fbbf4142710 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.658+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/201403253 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf40b4b80 con 0x7fbbf4142710 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.659+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/201403253 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf4073990 con 0x7fbbf4142710 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.659+0000 7fbbf0ff9640 1 -- 172.21.15.172:0/201403253 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbbec03b410 con 0x7fbbf4142710 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.659+0000 7fbbf0ff9640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbe006b4d0 0x7fbbe006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.660+0000 7fbbf0ff9640 1 -- 172.21.15.172:0/201403253 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbbec0abbb0 con 0x7fbbf4142710 2024-04-25T08:43:25.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.660+0000 7fbbf3fff640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbe006b4d0 0x7fbbe006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.660+0000 7fbbf3fff640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbe006b4d0 0x7fbbe006d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4000f60 tx=0x7fbbe4007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:25.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.665+0000 7fbbf0ff9640 1 -- 172.21.15.172:0/201403253 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbbec07a0a0 con 0x7fbbf4142710 2024-04-25T08:43:25.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.837+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/201403253 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbf40b4f20 con 0x7fbbf4142710 2024-04-25T08:43:25.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.838+0000 7fbbf0ff9640 1 -- 172.21.15.172:0/201403253 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18905 (secure 0 0 0) 0x7fbbec07e140 con 0x7fbbf4142710 2024-04-25T08:43:25.831 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:25.831 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:09.821048+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:42:26.484132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T08:42:26.964595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T08:42:30.704572+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/201403253 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbe006b4d0 msgr2=0x7fbbe006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbe006b4d0 0x7fbbe006d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4000f60 tx=0x7fbbe4007c00 comp rx=0 tx=0).stop 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/201403253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4142710 msgr2=0x7fbbf41f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4142710 0x7fbbf41f3ed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbbec02abc0 tx=0x7fbbec004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/201403253 shutdown_connections 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbe006b4d0 0x7fbbe006d990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf415c9e0 0x7fbbf40b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbf4142710 0x7fbbf41f3ed0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 --2- 172.21.15.172:0/201403253 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf4155fe0 0x7fbbf4145cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/201403253 >> 172.21.15.172:0/201403253 conn(0x7fbbf4072000 msgr2=0x7fbbf40afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/201403253 shutdown_connections 2024-04-25T08:43:25.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.840+0000 7fbbfa9ce640 1 -- 172.21.15.172:0/201403253 wait complete. 2024-04-25T08:43:25.845 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:43:25.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.951+0000 7f1b0754f640 1 Processor -- start 2024-04-25T08:43:25.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.951+0000 7f1b0754f640 1 -- start start 2024-04-25T08:43:25.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b0754f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1b00070dc0 0x7f1b0006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b0754f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b000711a0 0x7f1b000b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b0754f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1b000b4830 0x7f1b000b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b0754f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b001622b0 con 0x7f1b000b4830 2024-04-25T08:43:25.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b0754f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b000b10f0 con 0x7f1b00070dc0 2024-04-25T08:43:25.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b0754f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000d1770 con 0x7f1b000711a0 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b05aec640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1b000b4830 0x7f1b000b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b05aec640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1b000b4830 0x7f1b000b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59288/0 (socket says 172.21.15.172:59288) 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b05aec640 1 -- 172.21.15.172:0/2932144923 learned_addr learned my addr 172.21.15.172:0/2932144923 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b04aea640 1 --2- 172.21.15.172:0/2932144923 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b000711a0 0x7f1b000b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b052eb640 1 --2- 172.21.15.172:0/2932144923 >> v2:172.21.15.186:3300/0 conn(0x7f1b00070dc0 0x7f1b0006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b05aec640 1 -- 172.21.15.172:0/2932144923 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b000711a0 msgr2=0x7f1b000b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b05aec640 1 --2- 172.21.15.172:0/2932144923 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b000711a0 0x7f1b000b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b05aec640 1 -- 172.21.15.172:0/2932144923 >> v2:172.21.15.186:3300/0 conn(0x7f1b00070dc0 msgr2=0x7f1b0006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b05aec640 1 --2- 172.21.15.172:0/2932144923 >> v2:172.21.15.186:3300/0 conn(0x7f1b00070dc0 0x7f1b0006ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b05aec640 1 -- 172.21.15.172:0/2932144923 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00162740 con 0x7f1b000b4830 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.952+0000 7f1b052eb640 1 --2- 172.21.15.172:0/2932144923 >> v2:172.21.15.186:3300/0 conn(0x7f1b00070dc0 0x7f1b0006ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:25.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.953+0000 7f1b05aec640 1 --2- 172.21.15.172:0/2932144923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 0x7f1b000b4cc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1b00070a00 tx=0x7f1afc02a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1ee91de83d9065 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:25.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.953+0000 7f1af7fff640 1 -- 172.21.15.172:0/2932144923 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc036070 con 0x7f1b000b4830 2024-04-25T08:43:25.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.953+0000 7f1af7fff640 1 -- 172.21.15.172:0/2932144923 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc031600 con 0x7f1b000b4830 2024-04-25T08:43:25.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.953+0000 7f1af7fff640 1 -- 172.21.15.172:0/2932144923 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0319d0 con 0x7f1b000b4830 2024-04-25T08:43:25.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.954+0000 7f1b0754f640 1 -- 172.21.15.172:0/2932144923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 msgr2=0x7f1b000b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.954+0000 7f1b0754f640 1 --2- 172.21.15.172:0/2932144923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 0x7f1b000b4cc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1b00070a00 tx=0x7f1afc02a5b0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.954+0000 7f1b0754f640 1 -- 172.21.15.172:0/2932144923 shutdown_connections 2024-04-25T08:43:25.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.954+0000 7f1b0754f640 1 --2- 172.21.15.172:0/2932144923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 0x7f1b000b4cc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.954+0000 7f1b0754f640 1 --2- 172.21.15.172:0/2932144923 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b000711a0 0x7f1b000b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.954+0000 7f1b0754f640 1 --2- 172.21.15.172:0/2932144923 >> v2:172.21.15.186:3300/0 conn(0x7f1b00070dc0 0x7f1b0006ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.954+0000 7f1b0754f640 1 -- 172.21.15.172:0/2932144923 >> 172.21.15.172:0/2932144923 conn(0x7f1b000b3530 msgr2=0x7f1b000b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.954+0000 7f1b0754f640 1 -- 172.21.15.172:0/2932144923 shutdown_connections 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.954+0000 7f1b0754f640 1 -- 172.21.15.172:0/2932144923 wait complete. 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.955+0000 7f1b0754f640 1 Processor -- start 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.955+0000 7f1b0754f640 1 -- start start 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b0754f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b00070dc0 0x7f1b001f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b0754f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b000711a0 0x7f1b000b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b0754f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 0x7f1b000b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b0754f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00161f40 con 0x7f1b000b4830 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b0754f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00161c60 con 0x7f1b000711a0 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b0754f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00071600 con 0x7f1b00070dc0 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b05aec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 0x7f1b000b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b05aec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 0x7f1b000b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59300/0 (socket says 172.21.15.172:59300) 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b05aec640 1 -- 172.21.15.172:0/2145615188 learned_addr learned my addr 172.21.15.172:0/2145615188 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:25.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b052eb640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b00070dc0 0x7f1b001f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b04aea640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b000711a0 0x7f1b000b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b05aec640 1 -- 172.21.15.172:0/2145615188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b00070dc0 msgr2=0x7f1b001f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b05aec640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b00070dc0 0x7f1b001f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b05aec640 1 -- 172.21.15.172:0/2145615188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b000711a0 msgr2=0x7f1b000b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b05aec640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b000711a0 0x7f1b000b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b05aec640 1 -- 172.21.15.172:0/2145615188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000a9360 con 0x7f1b000b4830 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b04aea640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b000711a0 0x7f1b000b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b05aec640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 0x7f1b000b61d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009e50 tx=0x7f1afc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1af5ffb640 1 -- 172.21.15.172:0/2145615188 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc041020 con 0x7f1b000b4830 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1af5ffb640 1 -- 172.21.15.172:0/2145615188 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc007780 con 0x7f1b000b4830 2024-04-25T08:43:25.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1af5ffb640 1 -- 172.21.15.172:0/2145615188 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc036040 con 0x7f1b000b4830 2024-04-25T08:43:25.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.956+0000 7f1b0754f640 1 -- 172.21.15.172:0/2145615188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b000a9640 con 0x7f1b000b4830 2024-04-25T08:43:25.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.957+0000 7f1b0754f640 1 -- 172.21.15.172:0/2145615188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b000a9c00 con 0x7f1b000b4830 2024-04-25T08:43:25.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.958+0000 7f1b0754f640 1 -- 172.21.15.172:0/2145615188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b00073a00 con 0x7f1b000b4830 2024-04-25T08:43:25.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.958+0000 7f1af5ffb640 1 -- 172.21.15.172:0/2145615188 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1afc044020 con 0x7f1b000b4830 2024-04-25T08:43:25.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.959+0000 7f1af5ffb640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ae406b4d0 0x7f1ae406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:25.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.959+0000 7f1b052eb640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ae406b4d0 0x7f1ae406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:25.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.959+0000 7f1af5ffb640 1 -- 172.21.15.172:0/2145615188 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1afc0ab1b0 con 0x7f1b000b4830 2024-04-25T08:43:25.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.959+0000 7f1b052eb640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ae406b4d0 0x7f1ae406d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1af8006b10 tx=0x7f1af8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:25.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:25.963+0000 7f1af5ffb640 1 -- 172.21.15.172:0/2145615188 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1afc04b030 con 0x7f1b000b4830 2024-04-25T08:43:26.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.171+0000 7f1b0754f640 1 -- 172.21.15.172:0/2145615188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1b0006bd50 con 0x7f1b000b4830 2024-04-25T08:43:26.163 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:43:26.171+0000 7f9412b2f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:43:26.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.173+0000 7f1af5ffb640 1 -- 172.21.15.172:0/2145615188 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1afc079cc0 con 0x7f1b000b4830 2024-04-25T08:43:26.165 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:43:26.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 -- 172.21.15.172:0/2145615188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ae406b4d0 msgr2=0x7f1ae406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:26.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ae406b4d0 0x7f1ae406d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1af8006b10 tx=0x7f1af8008040 comp rx=0 tx=0).stop 2024-04-25T08:43:26.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 -- 172.21.15.172:0/2145615188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 msgr2=0x7f1b000b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:26.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 0x7f1b000b61d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1afc009e50 tx=0x7f1afc004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:26.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 -- 172.21.15.172:0/2145615188 shutdown_connections 2024-04-25T08:43:26.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ae406b4d0 0x7f1ae406d990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:26.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b000711a0 0x7f1b000b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:26.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000b4830 0x7f1b000b61d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:26.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 --2- 172.21.15.172:0/2145615188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b00070dc0 0x7f1b001f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:26.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 -- 172.21.15.172:0/2145615188 >> 172.21.15.172:0/2145615188 conn(0x7f1b000b3530 msgr2=0x7f1b0015d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:26.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 -- 172.21.15.172:0/2145615188 shutdown_connections 2024-04-25T08:43:26.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.176+0000 7f1b0754f640 1 -- 172.21.15.172:0/2145615188 wait complete. 2024-04-25T08:43:26.171 INFO:tasks.ceph.mds.d.smithi186.stderr: -4827> 2024-04-25T08:42:33.107+0000 7f1942e15640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:43:26.179 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:43:26.203 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:43:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.286+0000 7f8fde1e0640 1 Processor -- start 2024-04-25T08:43:26.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.286+0000 7f8fde1e0640 1 -- start start 2024-04-25T08:43:26.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fde1e0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fd80ce230 0x7f8fd80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:26.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fde1e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fd815b270 0x7f8fd815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:26.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fde1e0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd8072280 con 0x7f8fd80cc4f0 2024-04-25T08:43:26.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fde1e0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd8071270 con 0x7f8fd80ce230 2024-04-25T08:43:26.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fde1e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80714c0 con 0x7f8fd815b270 2024-04-25T08:43:26.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fd6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fd80ce230 0x7f8fd80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:26.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fd6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fd80ce230 0x7f8fd80cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59302/0 (socket says 172.21.15.172:59302) 2024-04-25T08:43:26.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fd6ffd640 1 -- 172.21.15.172:0/1537132336 learned_addr learned my addr 172.21.15.172:0/1537132336 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:26.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fd7fff640 1 --2- 172.21.15.172:0/1537132336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fd815b270 0x7f8fd815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:26.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fd6ffd640 1 -- 172.21.15.172:0/1537132336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fd815b270 msgr2=0x7f8fd815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:26.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fd6ffd640 1 --2- 172.21.15.172:0/1537132336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fd815b270 0x7f8fd815b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:26.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fd6ffd640 1 -- 172.21.15.172:0/1537132336 >> v1:172.21.15.186:6789/0 conn(0x7f8fd80cc4f0 legacy=0x7f8fd80cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:26.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.287+0000 7f8fd6ffd640 1 -- 172.21.15.172:0/1537132336 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80717a0 con 0x7f8fd80ce230 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fd6ffd640 1 --2- 172.21.15.172:0/1537132336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 0x7f8fd80cc8d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009870 tx=0x7f8fcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b86a8ba5d4599e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fd67fc640 1 -- 172.21.15.172:0/1537132336 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc037070 con 0x7f8fd80ce230 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fd67fc640 1 -- 172.21.15.172:0/1537132336 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc032440 con 0x7f8fd80ce230 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fd67fc640 1 -- 172.21.15.172:0/1537132336 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc032810 con 0x7f8fd80ce230 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1537132336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 msgr2=0x7f8fd80cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fde1e0640 1 --2- 172.21.15.172:0/1537132336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 0x7f8fd80cc8d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009870 tx=0x7f8fcc02a270 comp rx=0 tx=0).stop 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1537132336 shutdown_connections 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fde1e0640 1 --2- 172.21.15.172:0/1537132336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fd815b270 0x7f8fd815b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fde1e0640 1 --2- 172.21.15.172:0/1537132336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 0x7f8fd80cc8d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1537132336 >> 172.21.15.172:0/1537132336 conn(0x7f8fd806abe0 msgr2=0x7f8fd806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1537132336 shutdown_connections 2024-04-25T08:43:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.288+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1537132336 wait complete. 2024-04-25T08:43:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.290+0000 7f8fde1e0640 1 Processor -- start 2024-04-25T08:43:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.290+0000 7f8fde1e0640 1 -- start start 2024-04-25T08:43:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.290+0000 7f8fde1e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fd80cc4f0 0x7f8fd814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.290+0000 7f8fde1e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 0x7f8fd814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.290+0000 7f8fde1e0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fd815b270 0x7f8fd8136c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.290+0000 7f8fde1e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd815bbf0 con 0x7f8fd80ce230 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.290+0000 7f8fde1e0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8071d60 con 0x7f8fd815b270 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.290+0000 7f8fde1e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd815bd70 con 0x7f8fd80cc4f0 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 0x7f8fd814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 0x7f8fd814bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59310/0 (socket says 172.21.15.172:59310) 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd6ffd640 1 -- 172.21.15.172:0/1525672931 learned_addr learned my addr 172.21.15.172:0/1525672931 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd77fe640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fd80cc4f0 0x7f8fd814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd7fff640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fd815b270 0x7f8fd8136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd6ffd640 1 -- 172.21.15.172:0/1525672931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fd80cc4f0 msgr2=0x7f8fd814fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd6ffd640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fd80cc4f0 0x7f8fd814fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd6ffd640 1 -- 172.21.15.172:0/1525672931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fd815b270 msgr2=0x7f8fd8136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd6ffd640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fd815b270 0x7f8fd8136c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:26.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd6ffd640 1 -- 172.21.15.172:0/1525672931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd814e740 con 0x7f8fd80ce230 2024-04-25T08:43:26.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fd6ffd640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 0x7f8fd814bb40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc000c00 tx=0x7f8fcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:26.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fbffff640 1 -- 172.21.15.172:0/1525672931 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc037040 con 0x7f8fd80ce230 2024-04-25T08:43:26.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fbffff640 1 -- 172.21.15.172:0/1525672931 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc042070 con 0x7f8fd80ce230 2024-04-25T08:43:26.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fbffff640 1 -- 172.21.15.172:0/1525672931 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc030860 con 0x7f8fd80ce230 2024-04-25T08:43:26.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1525672931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd814e9e0 con 0x7f8fd80ce230 2024-04-25T08:43:26.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.291+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1525672931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd814f280 con 0x7f8fd80ce230 2024-04-25T08:43:26.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.292+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1525672931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd8073a00 con 0x7f8fd80ce230 2024-04-25T08:43:26.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.293+0000 7f8fbffff640 1 -- 172.21.15.172:0/1525672931 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8fcc030a00 con 0x7f8fd80ce230 2024-04-25T08:43:26.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.293+0000 7f8fbffff640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8fc406b4d0 0x7f8fc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:26.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.293+0000 7f8fbffff640 1 -- 172.21.15.172:0/1525672931 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f8fcc0aae10 con 0x7f8fd80ce230 2024-04-25T08:43:26.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.293+0000 7f8fd77fe640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8fc406b4d0 0x7f8fc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:26.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.294+0000 7f8fd77fe640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8fc406b4d0 0x7f8fc406d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80016e0 tx=0x7f8fc8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:26.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.297+0000 7f8fbffff640 1 -- 172.21.15.172:0/1525672931 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8fcc0791e0 con 0x7f8fd80ce230 2024-04-25T08:43:26.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:26.509+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1525672931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8fd814ed70 con 0x7f8fd80ce230 2024-04-25T08:43:27.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.178+0000 7f8fbffff640 1 -- 172.21.15.172:0/1525672931 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8fcc07d280 con 0x7f8fd80ce230 2024-04-25T08:43:27.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1525672931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8fc406b4d0 msgr2=0x7f8fc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:27.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8fc406b4d0 0x7f8fc406d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fc80016e0 tx=0x7f8fc8009040 comp rx=0 tx=0).stop 2024-04-25T08:43:27.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1525672931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 msgr2=0x7f8fd814bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:27.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 0x7f8fd814bb40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc000c00 tx=0x7f8fcc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:27.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1525672931 shutdown_connections 2024-04-25T08:43:27.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8fc406b4d0 0x7f8fc406d990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:27.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fd815b270 0x7f8fd8136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:27.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd80ce230 0x7f8fd814bb40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:27.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 --2- 172.21.15.172:0/1525672931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fd80cc4f0 0x7f8fd814fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:27.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1525672931 >> 172.21.15.172:0/1525672931 conn(0x7f8fd806abe0 msgr2=0x7f8fd8154ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:27.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1525672931 shutdown_connections 2024-04-25T08:43:27.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.181+0000 7f8fde1e0640 1 -- 172.21.15.172:0/1525672931 wait complete. 2024-04-25T08:43:27.186 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:43:27.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.300+0000 7fc40706b640 1 Processor -- start 2024-04-25T08:43:27.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.300+0000 7fc40706b640 1 -- start start 2024-04-25T08:43:27.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc40706b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc40015b980 0x7fc4000cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:27.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc40706b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc400072280 con 0x7fc4000cc4f0 2024-04-25T08:43:27.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc40706b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4000714c0 con 0x7fc4000ce230 2024-04-25T08:43:27.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc40706b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc400071270 con 0x7fc40015b980 2024-04-25T08:43:27.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc405608640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc40015b980 0x7fc4000cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:27.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc404e07640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc4000cc4f0 0x7fc4000cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:52708/0 (socket says 172.21.15.172:52708) 2024-04-25T08:43:27.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc404e07640 1 -- 172.21.15.172:0/3850343623 learned_addr learned my addr 172.21.15.172:0/3850343623 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:27.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc405608640 1 -- 172.21.15.172:0/3850343623 >> v1:172.21.15.186:6789/0 conn(0x7fc4000ce230 legacy=0x7fc40015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:27.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc3ff7fe640 1 -- 172.21.15.172:0/3850343623 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631833059 0 0) 0x7fc400072280 con 0x7fc4000cc4f0 2024-04-25T08:43:27.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc405608640 1 -- 172.21.15.172:0/3850343623 >> v1:172.21.15.172:6789/0 conn(0x7fc4000cc4f0 legacy=0x7fc4000cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:27.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.301+0000 7fc405608640 1 -- 172.21.15.172:0/3850343623 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4000717a0 con 0x7fc40015b980 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.302+0000 7fc405608640 1 --2- 172.21.15.172:0/3850343623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40015b980 0x7fc4000cc8d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009d90 tx=0x7fc3f802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1502f3d095d45d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.302+0000 7fc3ff7fe640 1 -- 172.21.15.172:0/3850343623 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8007740 con 0x7fc40015b980 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.302+0000 7fc3ff7fe640 1 -- 172.21.15.172:0/3850343623 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f80078e0 con 0x7fc40015b980 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.302+0000 7fc3ff7fe640 1 -- 172.21.15.172:0/3850343623 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8007cb0 con 0x7fc40015b980 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.303+0000 7fc40706b640 1 -- 172.21.15.172:0/3850343623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40015b980 msgr2=0x7fc4000cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.303+0000 7fc40706b640 1 --2- 172.21.15.172:0/3850343623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40015b980 0x7fc4000cc8d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009d90 tx=0x7fc3f802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.303+0000 7fc40706b640 1 -- 172.21.15.172:0/3850343623 shutdown_connections 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.303+0000 7fc40706b640 1 --2- 172.21.15.172:0/3850343623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40015b980 0x7fc4000cc8d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.303+0000 7fc40706b640 1 -- 172.21.15.172:0/3850343623 >> 172.21.15.172:0/3850343623 conn(0x7fc40006abe0 msgr2=0x7fc40006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.303+0000 7fc40706b640 1 -- 172.21.15.172:0/3850343623 shutdown_connections 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.303+0000 7fc40706b640 1 -- 172.21.15.172:0/3850343623 wait complete. 2024-04-25T08:43:27.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.304+0000 7fc40706b640 1 Processor -- start 2024-04-25T08:43:27.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.304+0000 7fc40706b640 1 -- start start 2024-04-25T08:43:27.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc40706b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4000cc4f0 0x7fc400145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc40706b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4000ce230 0x7fc40014e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc40706b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40015b980 0x7fc4001599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc40706b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40006e8a0 con 0x7fc4000cc4f0 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc40706b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc400071d60 con 0x7fc40015b980 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc40706b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000ae500 con 0x7fc4000ce230 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc404e07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4000cc4f0 0x7fc400145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc404e07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4000cc4f0 0x7fc400145190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59336/0 (socket says 172.21.15.172:59336) 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc404e07640 1 -- 172.21.15.172:0/1040298456 learned_addr learned my addr 172.21.15.172:0/1040298456 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc405608640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40015b980 0x7fc4001599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc3fffff640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4000ce230 0x7fc40014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc404e07640 1 -- 172.21.15.172:0/1040298456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4000ce230 msgr2=0x7fc40014e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc404e07640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4000ce230 0x7fc40014e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:27.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc404e07640 1 -- 172.21.15.172:0/1040298456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40015b980 msgr2=0x7fc4001599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:27.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc404e07640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40015b980 0x7fc4001599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:27.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc404e07640 1 -- 172.21.15.172:0/1040298456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4001456d0 con 0x7fc4000cc4f0 2024-04-25T08:43:27.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc404e07640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4000cc4f0 0x7fc400145190 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c3f0 tx=0x7fc3f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:27.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc3fd7fa640 1 -- 172.21.15.172:0/1040298456 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f40074e0 con 0x7fc4000cc4f0 2024-04-25T08:43:27.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc3fd7fa640 1 -- 172.21.15.172:0/1040298456 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f40047e0 con 0x7fc4000cc4f0 2024-04-25T08:43:27.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc40706b640 1 -- 172.21.15.172:0/1040298456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4000b1080 con 0x7fc4000cc4f0 2024-04-25T08:43:27.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.305+0000 7fc3fd7fa640 1 -- 172.21.15.172:0/1040298456 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4004c10 con 0x7fc4000cc4f0 2024-04-25T08:43:27.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.306+0000 7fc40706b640 1 -- 172.21.15.172:0/1040298456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4000b1640 con 0x7fc4000cc4f0 2024-04-25T08:43:27.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.307+0000 7fc40706b640 1 -- 172.21.15.172:0/1040298456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc400073a00 con 0x7fc4000cc4f0 2024-04-25T08:43:27.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.307+0000 7fc3fd7fa640 1 -- 172.21.15.172:0/1040298456 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3f4011070 con 0x7fc4000cc4f0 2024-04-25T08:43:27.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.307+0000 7fc3fd7fa640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3e406b4d0 0x7fc3e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:27.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.307+0000 7fc3fd7fa640 1 -- 172.21.15.172:0/1040298456 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fc3f408a260 con 0x7fc4000cc4f0 2024-04-25T08:43:27.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.307+0000 7fc3fffff640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3e406b4d0 0x7fc3e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:27.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.308+0000 7fc3fffff640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3e406b4d0 0x7fc3e406d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4000b2250 tx=0x7fc3ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:27.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.312+0000 7fc3fd7fa640 1 -- 172.21.15.172:0/1040298456 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc4001456d0 con 0x7fc4000cc4f0 2024-04-25T08:43:27.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:27.482+0000 7fc40706b640 1 -- 172.21.15.172:0/1040298456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc400155120 con 0x7fc4000cc4f0 2024-04-25T08:43:28.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.179+0000 7fc3fd7fa640 1 -- 172.21.15.172:0/1040298456 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc3f401a2b0 con 0x7fc4000cc4f0 2024-04-25T08:43:28.172 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:43:28.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 -- 172.21.15.172:0/1040298456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3e406b4d0 msgr2=0x7fc3e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:28.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3e406b4d0 0x7fc3e406d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4000b2250 tx=0x7fc3ec009040 comp rx=0 tx=0).stop 2024-04-25T08:43:28.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 -- 172.21.15.172:0/1040298456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4000cc4f0 msgr2=0x7fc400145190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:28.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4000cc4f0 0x7fc400145190 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c3f0 tx=0x7fc3f400c8b0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 -- 172.21.15.172:0/1040298456 shutdown_connections 2024-04-25T08:43:28.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3e406b4d0 0x7fc3e406d990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40015b980 0x7fc4001599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc4000ce230 0x7fc40014e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 --2- 172.21.15.172:0/1040298456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4000cc4f0 0x7fc400145190 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 -- 172.21.15.172:0/1040298456 >> 172.21.15.172:0/1040298456 conn(0x7fc40006abe0 msgr2=0x7fc40015d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:28.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 -- 172.21.15.172:0/1040298456 shutdown_connections 2024-04-25T08:43:28.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.183+0000 7fc40706b640 1 -- 172.21.15.172:0/1040298456 wait complete. 2024-04-25T08:43:28.189 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:43:28.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.305+0000 7f8996bb0640 1 Processor -- start 2024-04-25T08:43:28.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.305+0000 7f8996bb0640 1 -- start start 2024-04-25T08:43:28.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f8996bb0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89901446d0 0x7f89900b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f8996bb0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8990144d50 0x7f89900b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f8996bb0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f89901452a0 0x7f89900cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f8996bb0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89900b2b20 con 0x7f8990144d50 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f8996bb0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899006d400 con 0x7f89901452a0 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f8996bb0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89900b49a0 con 0x7f89901446d0 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f898ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8990144d50 0x7f89900b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f898ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8990144d50 0x7f89900b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45154/0 (socket says 172.21.15.172:45154) 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f898ffff640 1 -- 172.21.15.172:0/1068413555 learned_addr learned my addr 172.21.15.172:0/1068413555 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f898ffff640 1 -- 172.21.15.172:0/1068413555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89901446d0 msgr2=0x7f89900b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f898ffff640 1 --2- 172.21.15.172:0/1068413555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89901446d0 0x7f89900b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f898ffff640 1 -- 172.21.15.172:0/1068413555 >> v2:172.21.15.186:3300/0 conn(0x7f89901452a0 msgr2=0x7f89900cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f898ffff640 1 --2- 172.21.15.172:0/1068413555 >> v2:172.21.15.186:3300/0 conn(0x7f89901452a0 0x7f89900cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.306+0000 7f898ffff640 1 -- 172.21.15.172:0/1068413555 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89900cccc0 con 0x7f8990144d50 2024-04-25T08:43:28.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.307+0000 7f898ffff640 1 --2- 172.21.15.172:0/1068413555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8990144d50 0x7f89900b4460 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8990145880 tx=0x7f897c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9374bee85d728b81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:28.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.307+0000 7f898f7fe640 1 -- 172.21.15.172:0/1068413555 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c037070 con 0x7f8990144d50 2024-04-25T08:43:28.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.307+0000 7f898f7fe640 1 -- 172.21.15.172:0/1068413555 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c032440 con 0x7f8990144d50 2024-04-25T08:43:28.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.307+0000 7f898f7fe640 1 -- 172.21.15.172:0/1068413555 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c032810 con 0x7f8990144d50 2024-04-25T08:43:28.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.308+0000 7f8996bb0640 1 -- 172.21.15.172:0/1068413555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8990144d50 msgr2=0x7f89900b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:28.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.308+0000 7f8996bb0640 1 --2- 172.21.15.172:0/1068413555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8990144d50 0x7f89900b4460 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8990145880 tx=0x7f897c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.308+0000 7f8996bb0640 1 -- 172.21.15.172:0/1068413555 shutdown_connections 2024-04-25T08:43:28.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.308+0000 7f8996bb0640 1 --2- 172.21.15.172:0/1068413555 >> v2:172.21.15.186:3300/0 conn(0x7f89901452a0 0x7f89900cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.308+0000 7f8996bb0640 1 --2- 172.21.15.172:0/1068413555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8990144d50 0x7f89900b4460 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.308+0000 7f8996bb0640 1 --2- 172.21.15.172:0/1068413555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89901446d0 0x7f89900b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.308+0000 7f8996bb0640 1 -- 172.21.15.172:0/1068413555 >> 172.21.15.172:0/1068413555 conn(0x7f899006abe0 msgr2=0x7f899006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:28.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.308+0000 7f8996bb0640 1 -- 172.21.15.172:0/1068413555 shutdown_connections 2024-04-25T08:43:28.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.308+0000 7f8996bb0640 1 -- 172.21.15.172:0/1068413555 wait complete. 2024-04-25T08:43:28.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.309+0000 7f8996bb0640 1 Processor -- start 2024-04-25T08:43:28.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.309+0000 7f8996bb0640 1 -- start start 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f8996bb0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89901446d0 0x7f89900c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f8996bb0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8990144d50 0x7f89901ea450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f8996bb0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89901452a0 0x7f89900adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f8996bb0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89900cc700 con 0x7f89901452a0 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f8996bb0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89900cc420 con 0x7f89901446d0 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f8996bb0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89900cc9e0 con 0x7f8990144d50 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899514d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89901452a0 0x7f89900adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899514d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89901452a0 0x7f89900adc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45158/0 (socket says 172.21.15.172:45158) 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899514d640 1 -- 172.21.15.172:0/2404228547 learned_addr learned my addr 172.21.15.172:0/2404228547 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f898ffff640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8990144d50 0x7f89901ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:28.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899514d640 1 -- 172.21.15.172:0/2404228547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8990144d50 msgr2=0x7f89901ea450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899494c640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89901446d0 0x7f89900c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899514d640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8990144d50 0x7f89901ea450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899514d640 1 -- 172.21.15.172:0/2404228547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89901446d0 msgr2=0x7f89900c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899514d640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89901446d0 0x7f89900c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899514d640 1 -- 172.21.15.172:0/2404228547 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89901f49c0 con 0x7f89901452a0 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f898ffff640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8990144d50 0x7f89901ea450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899494c640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89901446d0 0x7f89900c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.310+0000 7f899514d640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89901452a0 0x7f89900adc30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f898800b9a0 tx=0x7f898800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.311+0000 7f898d7fa640 1 -- 172.21.15.172:0/2404228547 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988019070 con 0x7f89901452a0 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.311+0000 7f898d7fa640 1 -- 172.21.15.172:0/2404228547 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898800cbc0 con 0x7f89901452a0 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.311+0000 7f8996bb0640 1 -- 172.21.15.172:0/2404228547 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89900c4c10 con 0x7f89901452a0 2024-04-25T08:43:28.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.311+0000 7f898d7fa640 1 -- 172.21.15.172:0/2404228547 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988014440 con 0x7f89901452a0 2024-04-25T08:43:28.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.311+0000 7f8996bb0640 1 -- 172.21.15.172:0/2404228547 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89901f3e40 con 0x7f89901452a0 2024-04-25T08:43:28.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.312+0000 7f8996bb0640 1 -- 172.21.15.172:0/2404228547 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8990073a00 con 0x7f89901452a0 2024-04-25T08:43:28.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.312+0000 7f898d7fa640 1 -- 172.21.15.172:0/2404228547 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f898801c070 con 0x7f89901452a0 2024-04-25T08:43:28.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.312+0000 7f898d7fa640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f897406b4d0 0x7f897406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:28.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.313+0000 7f898d7fa640 1 -- 172.21.15.172:0/2404228547 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6383+0+0 (secure 0 0 0) 0x7f898808a190 con 0x7f89901452a0 2024-04-25T08:43:28.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.313+0000 7f899494c640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f897406b4d0 0x7f897406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:28.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.313+0000 7f899494c640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f897406b4d0 0x7f897406d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8984006fd0 tx=0x7f8984008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:28.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.317+0000 7f898d7fa640 1 -- 172.21.15.172:0/2404228547 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8988058e00 con 0x7f89901452a0 2024-04-25T08:43:28.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:28.487+0000 7f8996bb0640 1 -- 172.21.15.172:0/2404228547 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8990143530 con 0x7f89901452a0 2024-04-25T08:43:29.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:43:29.046 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:43:29.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.186+0000 7f898d7fa640 1 -- 172.21.15.172:0/2404228547 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8988058700 con 0x7f89901452a0 2024-04-25T08:43:29.178 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.189+0000 7f8996bb0640 1 -- 172.21.15.172:0/2404228547 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f897406b4d0 msgr2=0x7f897406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.189+0000 7f8996bb0640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f897406b4d0 0x7f897406d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8984006fd0 tx=0x7f8984008040 comp rx=0 tx=0).stop 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.189+0000 7f8996bb0640 1 -- 172.21.15.172:0/2404228547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89901452a0 msgr2=0x7f89900adc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.189+0000 7f8996bb0640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89901452a0 0x7f89900adc30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f898800b9a0 tx=0x7f898800be60 comp rx=0 tx=0).stop 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.189+0000 7f8996bb0640 1 -- 172.21.15.172:0/2404228547 shutdown_connections 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.189+0000 7f8996bb0640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f897406b4d0 0x7f897406d990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.189+0000 7f8996bb0640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89901452a0 0x7f89900adc30 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.189+0000 7f8996bb0640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8990144d50 0x7f89901ea450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.189+0000 7f8996bb0640 1 --2- 172.21.15.172:0/2404228547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89901446d0 0x7f89900c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.189+0000 7f8996bb0640 1 -- 172.21.15.172:0/2404228547 >> 172.21.15.172:0/2404228547 conn(0x7f899006abe0 msgr2=0x7f899006d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.190+0000 7f8996bb0640 1 -- 172.21.15.172:0/2404228547 shutdown_connections 2024-04-25T08:43:29.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.190+0000 7f8996bb0640 1 -- 172.21.15.172:0/2404228547 wait complete. 2024-04-25T08:43:29.194 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T08:43:29.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.303+0000 7f0453bd5640 1 Processor -- start 2024-04-25T08:43:29.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.304+0000 7f0453bd5640 1 -- start start 2024-04-25T08:43:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.304+0000 7f0453bd5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f044c15dd80 0x7f044c0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.304+0000 7f0453bd5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044c0b3930 con 0x7f044c06abe0 2024-04-25T08:43:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.304+0000 7f0453bd5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044c0b3c10 con 0x7f044c0ad570 2024-04-25T08:43:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.304+0000 7f0453bd5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044c06e410 con 0x7f044c15dd80 2024-04-25T08:43:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.305+0000 7f0451170640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f044c15dd80 0x7f044c0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.305+0000 7f0451971640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f044c06abe0 0x7f044c06afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54074/0 (socket says 172.21.15.172:54074) 2024-04-25T08:43:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.305+0000 7f0451971640 1 -- 172.21.15.172:0/753808192 learned_addr learned my addr 172.21.15.172:0/753808192 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.305+0000 7f0451170640 1 -- 172.21.15.172:0/753808192 >> v1:172.21.15.186:6789/0 conn(0x7f044c0ad570 legacy=0x7f044c06ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:29.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.305+0000 7f0451170640 1 -- 172.21.15.172:0/753808192 >> v1:172.21.15.172:6789/0 conn(0x7f044c06abe0 legacy=0x7f044c06afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:29.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.305+0000 7f0451170640 1 -- 172.21.15.172:0/753808192 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c06e660 con 0x7f044c15dd80 2024-04-25T08:43:29.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.305+0000 7f045096f640 1 -- 172.21.15.172:0/753808192 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837455836 0 0) 0x7f044c0b3930 con 0x7f044c06abe0 2024-04-25T08:43:29.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f0451170640 1 --2- 172.21.15.172:0/753808192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 0x7f044c0b5290 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f043c0097a0 tx=0x7f043c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adebe300fb5be0e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:29.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f045096f640 1 -- 172.21.15.172:0/753808192 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c037070 con 0x7f044c15dd80 2024-04-25T08:43:29.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f045096f640 1 -- 172.21.15.172:0/753808192 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c032440 con 0x7f044c15dd80 2024-04-25T08:43:29.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f045096f640 1 -- 172.21.15.172:0/753808192 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c032810 con 0x7f044c15dd80 2024-04-25T08:43:29.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f0453bd5640 1 -- 172.21.15.172:0/753808192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 msgr2=0x7f044c0b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:29.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f0453bd5640 1 --2- 172.21.15.172:0/753808192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 0x7f044c0b5290 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f043c0097a0 tx=0x7f043c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:43:29.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f0453bd5640 1 -- 172.21.15.172:0/753808192 shutdown_connections 2024-04-25T08:43:29.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f0453bd5640 1 --2- 172.21.15.172:0/753808192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 0x7f044c0b5290 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:29.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f0453bd5640 1 -- 172.21.15.172:0/753808192 >> 172.21.15.172:0/753808192 conn(0x7f044c0b5af0 msgr2=0x7f044c0b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:29.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f0453bd5640 1 -- 172.21.15.172:0/753808192 shutdown_connections 2024-04-25T08:43:29.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.306+0000 7f0453bd5640 1 -- 172.21.15.172:0/753808192 wait complete. 2024-04-25T08:43:29.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.307+0000 7f0453bd5640 1 Processor -- start 2024-04-25T08:43:29.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.307+0000 7f0453bd5640 1 -- start start 2024-04-25T08:43:29.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0453bd5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f044c06abe0 0x7f044c15fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0453bd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f044c0ad570 0x7f044c09afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0453bd5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 0x7f044c09d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0453bd5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c070280 con 0x7f044c15dd80 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0453bd5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c0b57d0 con 0x7f044c06abe0 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0453bd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c070400 con 0x7f044c0ad570 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0452172640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 0x7f044c09d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0452172640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 0x7f044c09d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45166/0 (socket says 172.21.15.172:45166) 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0452172640 1 -- 172.21.15.172:0/549290973 learned_addr learned my addr 172.21.15.172:0/549290973 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0451170640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f044c0ad570 0x7f044c09afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.308+0000 7f0451971640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f044c06abe0 0x7f044c15fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f0452172640 1 -- 172.21.15.172:0/549290973 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f044c0ad570 msgr2=0x7f044c09afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:29.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f0452172640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f044c0ad570 0x7f044c09afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f0452172640 1 -- 172.21.15.172:0/549290973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f044c06abe0 msgr2=0x7f044c15fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f0452172640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f044c06abe0 0x7f044c15fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f0452172640 1 -- 172.21.15.172:0/549290973 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c149430 con 0x7f044c15dd80 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f0451170640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f044c0ad570 0x7f044c09afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f0451971640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f044c06abe0 0x7f044c15fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f0452172640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 0x7f044c09d9d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f044400c780 tx=0x7f044400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f04427fc640 1 -- 172.21.15.172:0/549290973 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444017070 con 0x7f044c15dd80 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f04427fc640 1 -- 172.21.15.172:0/549290973 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0444003da0 con 0x7f044c15dd80 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f0453bd5640 1 -- 172.21.15.172:0/549290973 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044c09b520 con 0x7f044c15dd80 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f04427fc640 1 -- 172.21.15.172:0/549290973 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440052b0 con 0x7f044c15dd80 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.309+0000 7f0453bd5640 1 -- 172.21.15.172:0/549290973 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044c1604a0 con 0x7f044c15dd80 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.310+0000 7f0453bd5640 1 -- 172.21.15.172:0/549290973 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044c073a00 con 0x7f044c15dd80 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.310+0000 7f04427fc640 1 -- 172.21.15.172:0/549290973 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f044401a070 con 0x7f044c15dd80 2024-04-25T08:43:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.311+0000 7f04427fc640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f043006b4d0 0x7f043006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:29.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.311+0000 7f04427fc640 1 -- 172.21.15.172:0/549290973 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f04440898d0 con 0x7f044c15dd80 2024-04-25T08:43:29.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.311+0000 7f0451971640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f043006b4d0 0x7f043006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:29.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.311+0000 7f0451971640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f043006b4d0 0x7f043006d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0448000f60 tx=0x7f0448007c30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:29.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.315+0000 7f04427fc640 1 -- 172.21.15.172:0/549290973 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f04440586c0 con 0x7f044c15dd80 2024-04-25T08:43:29.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:29.495+0000 7f0453bd5640 1 -- 172.21.15.172:0/549290973 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f044c06b340 con 0x7f044c15dd80 2024-04-25T08:43:30.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.187+0000 7f04427fc640 1 -- 172.21.15.172:0/549290973 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f0444057fc0 con 0x7f044c15dd80 2024-04-25T08:43:30.180 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data_ec' removed 2024-04-25T08:43:30.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 -- 172.21.15.172:0/549290973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f043006b4d0 msgr2=0x7f043006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:30.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f043006b4d0 0x7f043006d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0448000f60 tx=0x7f0448007c30 comp rx=0 tx=0).stop 2024-04-25T08:43:30.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 -- 172.21.15.172:0/549290973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 msgr2=0x7f044c09d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:30.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 0x7f044c09d9d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f044400c780 tx=0x7f044400cc40 comp rx=0 tx=0).stop 2024-04-25T08:43:30.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 -- 172.21.15.172:0/549290973 shutdown_connections 2024-04-25T08:43:30.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f043006b4d0 0x7f043006d990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:30.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f044c15dd80 0x7f044c09d9d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:30.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f044c0ad570 0x7f044c09afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:30.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 --2- 172.21.15.172:0/549290973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f044c06abe0 0x7f044c15fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:30.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 -- 172.21.15.172:0/549290973 >> 172.21.15.172:0/549290973 conn(0x7f044c0b5af0 msgr2=0x7f044c0ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:30.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 -- 172.21.15.172:0/549290973 shutdown_connections 2024-04-25T08:43:30.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.191+0000 7f0453bd5640 1 -- 172.21.15.172:0/549290973 wait complete. 2024-04-25T08:43:30.196 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:43:30.197 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:43:30.197 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:43:30.197 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:43:30.197 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:43:30.197 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:43:30.197 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:43:30.197 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:43:30.198 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:43:30.198 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:43:30.198 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:43:30.198 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:43:30.198 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:43:30.198 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:43:30.198 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:43:30.199 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:43:30.207 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:43:30.207 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:43:30.208 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:43:30.208 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:43:30.210 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:43:30.210 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:43:30.211 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:43:30.211 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:43:30.250 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:43:30.250 DEBUG:teuthology.parallel:result is None 2024-04-25T08:43:30.251 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:43:30.251 DEBUG:teuthology.parallel:result is None 2024-04-25T08:43:30.253 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:43:30.253 DEBUG:teuthology.parallel:result is None 2024-04-25T08:43:30.253 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:43:30.254 DEBUG:teuthology.parallel:result is None 2024-04-25T08:43:30.254 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:43:30.325 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:43:30.325 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:43:30.326 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:43:30.327 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:43:30.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.366+0000 7f0d4c4c6640 1 Processor -- start 2024-04-25T08:43:30.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.366+0000 7f0d4c4c6640 1 -- start start 2024-04-25T08:43:30.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d4c4c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d44161710 0x7f0d440d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:30.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d4c4c6640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4415e000 con 0x7f0d4415dc20 2024-04-25T08:43:30.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d4c4c6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d440d1de0 con 0x7f0d440ced80 2024-04-25T08:43:30.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d4a262640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0d4415dc20 0x7f0d440ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54094/0 (socket says 172.21.15.172:54094) 2024-04-25T08:43:30.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d4a262640 1 -- 172.21.15.172:0/2731083019 learned_addr learned my addr 172.21.15.172:0/2731083019 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:30.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/2731083019 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44161c60 con 0x7f0d44161710 2024-04-25T08:43:30.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d4aa63640 1 --2- 172.21.15.172:0/2731083019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d44161710 0x7f0d440d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:30.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d49260640 1 -- 172.21.15.172:0/2731083019 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922317528 0 0) 0x7f0d4415e000 con 0x7f0d4415dc20 2024-04-25T08:43:30.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d49260640 1 -- 172.21.15.172:0/2731083019 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d30003520 con 0x7f0d4415dc20 2024-04-25T08:43:30.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d4aa63640 1 -- 172.21.15.172:0/2731083019 >> v1:172.21.15.186:6789/0 conn(0x7f0d440ced80 legacy=0x7f0d440d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:30.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d4aa63640 1 -- 172.21.15.172:0/2731083019 >> v1:172.21.15.172:6789/0 conn(0x7f0d4415dc20 legacy=0x7f0d440ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:30.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.367+0000 7f0d4aa63640 1 -- 172.21.15.172:0/2731083019 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44161f40 con 0x7f0d44161710 2024-04-25T08:43:30.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.368+0000 7f0d4aa63640 1 --2- 172.21.15.172:0/2731083019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d44161710 0x7f0d440d29f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009dc0 tx=0x7f0d3c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f77e2353175d78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:30.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.368+0000 7f0d49260640 1 -- 172.21.15.172:0/2731083019 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c007740 con 0x7f0d44161710 2024-04-25T08:43:30.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.368+0000 7f0d49260640 1 -- 172.21.15.172:0/2731083019 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0078e0 con 0x7f0d44161710 2024-04-25T08:43:30.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.368+0000 7f0d49260640 1 -- 172.21.15.172:0/2731083019 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c007c90 con 0x7f0d44161710 2024-04-25T08:43:30.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.368+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/2731083019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d44161710 msgr2=0x7f0d440d29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:30.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.368+0000 7f0d4c4c6640 1 --2- 172.21.15.172:0/2731083019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d44161710 0x7f0d440d29f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009dc0 tx=0x7f0d3c02a6d0 comp rx=0 tx=0).stop 2024-04-25T08:43:30.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.369+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/2731083019 shutdown_connections 2024-04-25T08:43:30.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.369+0000 7f0d4c4c6640 1 --2- 172.21.15.172:0/2731083019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d44161710 0x7f0d440d29f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:30.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.369+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/2731083019 >> 172.21.15.172:0/2731083019 conn(0x7f0d440d0420 msgr2=0x7f0d440d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:30.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.369+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/2731083019 shutdown_connections 2024-04-25T08:43:30.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.369+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/2731083019 wait complete. 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.370+0000 7f0d4c4c6640 1 Processor -- start 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.370+0000 7f0d4c4c6640 1 -- start start 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.370+0000 7f0d4c4c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d440ced80 0x7f0d4415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.370+0000 7f0d4c4c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4415dc20 0x7f0d440cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.370+0000 7f0d4c4c6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d44161710 0x7f0d4415f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.370+0000 7f0d4c4c6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440b5e50 con 0x7f0d4415dc20 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.370+0000 7f0d4c4c6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44162500 con 0x7f0d44161710 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.370+0000 7f0d4c4c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440b5fd0 con 0x7f0d440ced80 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d49a61640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4415dc20 0x7f0d440cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d49a61640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4415dc20 0x7f0d440cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45196/0 (socket says 172.21.15.172:45196) 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d49a61640 1 -- 172.21.15.172:0/3152584340 learned_addr learned my addr 172.21.15.172:0/3152584340 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d4a262640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d440ced80 0x7f0d4415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d4aa63640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d44161710 0x7f0d4415f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:30.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d49a61640 1 -- 172.21.15.172:0/3152584340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d440ced80 msgr2=0x7f0d4415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:30.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d49a61640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d440ced80 0x7f0d4415ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:30.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d49a61640 1 -- 172.21.15.172:0/3152584340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d44161710 msgr2=0x7f0d4415f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:30.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d49a61640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d44161710 0x7f0d4415f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:30.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d49a61640 1 -- 172.21.15.172:0/3152584340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d441f7260 con 0x7f0d4415dc20 2024-04-25T08:43:30.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d49a61640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4415dc20 0x7f0d440cb840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800c400 tx=0x7f0d3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:30.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d36ffd640 1 -- 172.21.15.172:0/3152584340 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38017070 con 0x7f0d4415dc20 2024-04-25T08:43:30.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d36ffd640 1 -- 172.21.15.172:0/3152584340 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d380052d0 con 0x7f0d4415dc20 2024-04-25T08:43:30.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d36ffd640 1 -- 172.21.15.172:0/3152584340 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38003830 con 0x7f0d4415dc20 2024-04-25T08:43:30.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/3152584340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d441f7540 con 0x7f0d4415dc20 2024-04-25T08:43:30.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.371+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/3152584340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d441f7b00 con 0x7f0d4415dc20 2024-04-25T08:43:30.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.372+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/3152584340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d44073a00 con 0x7f0d4415dc20 2024-04-25T08:43:30.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.373+0000 7f0d36ffd640 1 -- 172.21.15.172:0/3152584340 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d3801a070 con 0x7f0d4415dc20 2024-04-25T08:43:30.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.373+0000 7f0d36ffd640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d2806b4d0 0x7f0d2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:30.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.373+0000 7f0d36ffd640 1 -- 172.21.15.172:0/3152584340 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0d38089370 con 0x7f0d4415dc20 2024-04-25T08:43:30.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.373+0000 7f0d4a262640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d2806b4d0 0x7f0d2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:30.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.373+0000 7f0d4a262640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d2806b4d0 0x7f0d2806d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d400011e0 tx=0x7f0d40007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:30.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.377+0000 7f0d36ffd640 1 -- 172.21.15.172:0/3152584340 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d38057d20 con 0x7f0d4415dc20 2024-04-25T08:43:30.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:30.568+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/3152584340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0d440d16b0 con 0x7f0d4415dc20 2024-04-25T08:43:31.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.206+0000 7f0d36ffd640 1 -- 172.21.15.172:0/3152584340 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0d3805bdc0 con 0x7f0d4415dc20 2024-04-25T08:43:31.199 INFO:teuthology.orchestra.run.smithi172.stderr: removed all blocklist entries 2024-04-25T08:43:31.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/3152584340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d2806b4d0 msgr2=0x7f0d2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d2806b4d0 0x7f0d2806d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d400011e0 tx=0x7f0d40007d30 comp rx=0 tx=0).stop 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/3152584340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4415dc20 msgr2=0x7f0d440cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4415dc20 0x7f0d440cb840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0d3800c400 tx=0x7f0d3800c8c0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/3152584340 shutdown_connections 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d2806b4d0 0x7f0d2806d990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d44161710 0x7f0d4415f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4415dc20 0x7f0d440cb840 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 --2- 172.21.15.172:0/3152584340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d440ced80 0x7f0d4415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/3152584340 >> 172.21.15.172:0/3152584340 conn(0x7f0d440d0420 msgr2=0x7f0d440d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/3152584340 shutdown_connections 2024-04-25T08:43:31.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.209+0000 7f0d4c4c6640 1 -- 172.21.15.172:0/3152584340 wait complete. 2024-04-25T08:43:31.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:43:31.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.321+0000 7fd77b9b0640 1 Processor -- start 2024-04-25T08:43:31.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.321+0000 7fd77b9b0640 1 -- start start 2024-04-25T08:43:31.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd77b9b0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7740cfec0 0x7fd7740cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd77b9b0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd774071480 con 0x7fd774154ee0 2024-04-25T08:43:31.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd77b9b0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd774071760 con 0x7fd7740ce3c0 2024-04-25T08:43:31.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd77b9b0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd774072090 con 0x7fd7740cfec0 2024-04-25T08:43:31.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd77974c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd774154ee0 0x7fd7740cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54104/0 (socket says 172.21.15.172:54104) 2024-04-25T08:43:31.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd77974c640 1 -- 172.21.15.172:0/3016015579 learned_addr learned my addr 172.21.15.172:0/3016015579 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:31.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256808609 0 0) 0x7fd774071480 con 0x7fd774154ee0 2024-04-25T08:43:31.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd760005730 con 0x7fd774154ee0 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd778f4b640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7740cfec0 0x7fd7740cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092111500 0 0) 0x7fd774071760 con 0x7fd7740ce3c0 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd774071480 con 0x7fd7740ce3c0 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009142050 0 0) 0x7fd760005730 con 0x7fd774154ee0 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7740cfec0 msgr2=0x7fd7740cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd76bfff640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7740cfec0 0x7fd7740cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 >> v1:172.21.15.186:6789/0 conn(0x7fd7740ce3c0 legacy=0x7fd77406d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774071a40 con 0x7fd774154ee0 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.322+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fd770001670 con 0x7fd774154ee0 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 >> v1:172.21.15.172:6789/0 conn(0x7fd774154ee0 legacy=0x7fd7740cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd76bfff640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 0x7fd760006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd76bfff640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd760006a10 0x7fd760006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd76bfff640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7740cfec0 0x7fd7600073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76000dc80 con 0x7fd760005d80 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76000de00 con 0x7fd760006a10 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76000e000 con 0x7fd7740cfec0 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd77974c640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 0x7fd760006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd778f4b640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd760006a10 0x7fd760006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd779f4d640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7740cfec0 0x7fd7600073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd77974c640 1 -- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7740cfec0 msgr2=0x7fd7600073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd77974c640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7740cfec0 0x7fd7600073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd77974c640 1 -- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd760006a10 msgr2=0x7fd760006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd77974c640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd760006a10 0x7fd760006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.323+0000 7fd77974c640 1 -- 172.21.15.172:0/3016015579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760005730 con 0x7fd760005d80 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd77974c640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 0x7fd760006180 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c0e0 tx=0x7fd760007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7236064528d4dc57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770007c00 con 0x7fd760005d80 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd770005ad0 con 0x7fd760005d80 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd76bfff640 1 -- 172.21.15.172:0/3016015579 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770007070 con 0x7fd760005d80 2024-04-25T08:43:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3016015579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 msgr2=0x7fd760006180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd77b9b0640 1 --2- 172.21.15.172:0/3016015579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 0x7fd760006180 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c0e0 tx=0x7fd760007a40 comp rx=0 tx=0).stop 2024-04-25T08:43:31.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd779f4d640 1 -- 172.21.15.172:0/3016015579 reap_dead start 2024-04-25T08:43:31.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3016015579 shutdown_connections 2024-04-25T08:43:31.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3016015579 >> 172.21.15.172:0/3016015579 conn(0x7fd77406abe0 msgr2=0x7fd77406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:31.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3016015579 shutdown_connections 2024-04-25T08:43:31.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.324+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3016015579 wait complete. 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77b9b0640 1 Processor -- start 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77b9b0640 1 -- start start 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77b9b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 0x7fd7740addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77b9b0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd774141fe0 0x7fd774142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77b9b0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7740a8740 0x7fd7740a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77b9b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740ce800 con 0x7fd760005d80 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77b9b0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd774071230 con 0x7fd7740a8740 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77b9b0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7741552c0 con 0x7fd774141fe0 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77974c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 0x7fd7740addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77974c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 0x7fd7740addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45216/0 (socket says 172.21.15.172:45216) 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.326+0000 7fd77974c640 1 -- 172.21.15.172:0/3778457691 learned_addr learned my addr 172.21.15.172:0/3778457691 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd778f4b640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd774141fe0 0x7fd774142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd779f4d640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7740a8740 0x7fd7740a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd77974c640 1 -- 172.21.15.172:0/3778457691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd774141fe0 msgr2=0x7fd774142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd77974c640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd774141fe0 0x7fd774142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd77974c640 1 -- 172.21.15.172:0/3778457691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7740a8740 msgr2=0x7fd7740a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd77974c640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7740a8740 0x7fd7740a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd77974c640 1 -- 172.21.15.172:0/3778457691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774143d50 con 0x7fd760005d80 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd77974c640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 0x7fd7740addd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c0e0 tx=0x7fd774071650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd769ffb640 1 -- 172.21.15.172:0/3778457691 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77003f020 con 0x7fd760005d80 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd769ffb640 1 -- 172.21.15.172:0/3778457691 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd770001470 con 0x7fd760005d80 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3778457691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd774143790 con 0x7fd760005d80 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd769ffb640 1 -- 172.21.15.172:0/3778457691 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7700049e0 con 0x7fd760005d80 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.327+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3778457691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd774145500 con 0x7fd760005d80 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.328+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3778457691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd774073990 con 0x7fd760005d80 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.329+0000 7fd769ffb640 1 -- 172.21.15.172:0/3778457691 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd770042020 con 0x7fd760005d80 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.329+0000 7fd769ffb640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd75806b4d0 0x7fd75806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.329+0000 7fd769ffb640 1 -- 172.21.15.172:0/3778457691 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd7700a9ab0 con 0x7fd760005d80 2024-04-25T08:43:31.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.329+0000 7fd778f4b640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd75806b4d0 0x7fd75806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.329+0000 7fd778f4b640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd75806b4d0 0x7fd75806d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd774145050 tx=0x7fd764008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:31.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.333+0000 7fd769ffb640 1 -- 172.21.15.172:0/3778457691 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd770078af0 con 0x7fd760005d80 2024-04-25T08:43:31.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.575+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3778457691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd77406d360 con 0x7fd760005d80 2024-04-25T08:43:31.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.576+0000 7fd769ffb640 1 -- 172.21.15.172:0/3778457691 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fd7700783f0 con 0x7fd760005d80 2024-04-25T08:43:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:31.569 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:43:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: "auth_dump": [ 2024-04-25T08:43:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.a", 2024-04-25T08:43:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q==", 2024-04-25T08:43:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.b", 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg==", 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:43:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:43:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.c", 2024-04-25T08:43:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA==", 2024-04-25T08:43:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:43:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:43:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.d", 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg==", 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.0", 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ==", 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.1", 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g==", 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:43:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.2", 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g==", 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.3", 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg==", 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.4", 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw==", 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.5", 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow==", 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.6", 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg==", 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:43:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.7", 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q==", 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.0", 2024-04-25T08:43:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q==", 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.1", 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g==", 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.2", 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw==", 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.3", 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w==", 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.admin", 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmFmQsIBAAkuAmqIptAT1ivH6T7/1T8A==", 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:43:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-mds", 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBcFypmBDgqGhAA2CTxTKVZ6m3a14zNiMgRWg==", 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBcFypmAEAqGhAArvijYJcpe19dxpxxKSQ3dQ==", 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-osd", 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBcFypmwUYqGhAAHp2d6hVlD6LX9opAGBvv5w==", 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBcFypmHE0qGhAA/cXS2NtK+aKHdId5PmebFQ==", 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBcFypmm1QqGhAAk47rlbkAoRQWWqeMvJjhvQ==", 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBcFypmWVsqGhAAWApQZ2zGC3iCG9q9jjRAtA==", 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.x", 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw==", 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.y", 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg==", 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:43:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:43:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:43:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:43:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-25T08:43:31.585 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3778457691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd75806b4d0 msgr2=0x7fd75806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd75806b4d0 0x7fd75806d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd774145050 tx=0x7fd764008040 comp rx=0 tx=0).stop 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3778457691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 msgr2=0x7fd7740addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 0x7fd7740addd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c0e0 tx=0x7fd774071650 comp rx=0 tx=0).stop 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3778457691 shutdown_connections 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd75806b4d0 0x7fd75806d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7740a8740 0x7fd7740a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd774141fe0 0x7fd774142df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 --2- 172.21.15.172:0/3778457691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd760005d80 0x7fd7740addd0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3778457691 >> 172.21.15.172:0/3778457691 conn(0x7fd77406abe0 msgr2=0x7fd7740ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3778457691 shutdown_connections 2024-04-25T08:43:31.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.579+0000 7fd77b9b0640 1 -- 172.21.15.172:0/3778457691 wait complete. 2024-04-25T08:43:31.588 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T08:43:31.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.697+0000 7f7a06eee640 1 Processor -- start 2024-04-25T08:43:31.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.697+0000 7f7a06eee640 1 -- start start 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.698+0000 7f7a06eee640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7a000cf600 0x7f7a000cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.698+0000 7f7a06eee640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7a000cbf20 0x7f7a000cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.698+0000 7f7a06eee640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a000c75e0 con 0x7f7a0015bb50 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.698+0000 7f7a06eee640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a000c8680 con 0x7f7a000cbf20 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.698+0000 7f7a06eee640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a000cff80 con 0x7f7a000cf600 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.698+0000 7f7a0548b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7a000cbf20 0x7f7a000cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.698+0000 7f7a04c8a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7a0015bb50 0x7f7a000c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54120/0 (socket says 172.21.15.172:54120) 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.698+0000 7f7a04c8a640 1 -- 172.21.15.172:0/3287378444 learned_addr learned my addr 172.21.15.172:0/3287378444 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.699+0000 7f79fffff640 1 --2- 172.21.15.172:0/3287378444 >> v2:172.21.15.186:3300/0 conn(0x7f7a000cf600 0x7f7a000cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.699+0000 7f7a0548b640 1 -- 172.21.15.172:0/3287378444 >> v2:172.21.15.186:3300/0 conn(0x7f7a000cf600 msgr2=0x7f7a000cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.699+0000 7f7a0548b640 1 --2- 172.21.15.172:0/3287378444 >> v2:172.21.15.186:3300/0 conn(0x7f7a000cf600 0x7f7a000cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.699+0000 7f79ff7fe640 1 -- 172.21.15.172:0/3287378444 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245300218 0 0) 0x7f7a000c75e0 con 0x7f7a0015bb50 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.699+0000 7f7a0548b640 1 -- 172.21.15.172:0/3287378444 >> v1:172.21.15.172:6789/0 conn(0x7f7a0015bb50 legacy=0x7f7a000c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.699+0000 7f7a0548b640 1 -- 172.21.15.172:0/3287378444 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a000c78c0 con 0x7f7a000cbf20 2024-04-25T08:43:31.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.699+0000 7f7a0548b640 1 --2- 172.21.15.172:0/3287378444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 0x7f7a000cc370 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7a0006f220 tx=0x7f79f802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cffa22551dfc764 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:31.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f79ff7fe640 1 -- 172.21.15.172:0/3287378444 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8007740 con 0x7f7a000cbf20 2024-04-25T08:43:31.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f79ff7fe640 1 -- 172.21.15.172:0/3287378444 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f80078e0 con 0x7f7a000cbf20 2024-04-25T08:43:31.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f79ff7fe640 1 -- 172.21.15.172:0/3287378444 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8007cb0 con 0x7f7a000cbf20 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f7a06eee640 1 -- 172.21.15.172:0/3287378444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 msgr2=0x7f7a000cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f7a06eee640 1 --2- 172.21.15.172:0/3287378444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 0x7f7a000cc370 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7a0006f220 tx=0x7f79f802a710 comp rx=0 tx=0).stop 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f7a06eee640 1 -- 172.21.15.172:0/3287378444 shutdown_connections 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f7a06eee640 1 --2- 172.21.15.172:0/3287378444 >> v2:172.21.15.186:3300/0 conn(0x7f7a000cf600 0x7f7a000cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f7a06eee640 1 --2- 172.21.15.172:0/3287378444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 0x7f7a000cc370 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f7a06eee640 1 -- 172.21.15.172:0/3287378444 >> 172.21.15.172:0/3287378444 conn(0x7f7a0006f500 msgr2=0x7f7a0006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f7a06eee640 1 -- 172.21.15.172:0/3287378444 shutdown_connections 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.700+0000 7f7a06eee640 1 -- 172.21.15.172:0/3287378444 wait complete. 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.701+0000 7f7a06eee640 1 Processor -- start 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.701+0000 7f7a06eee640 1 -- start start 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.702+0000 7f7a06eee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 0x7f7a001565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.702+0000 7f7a06eee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a000cf600 0x7f7a001522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.702+0000 7f7a06eee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a0015bb50 0x7f7a001540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.702+0000 7f7a06eee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000c8160 con 0x7f7a000cbf20 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.702+0000 7f7a06eee640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000c7e80 con 0x7f7a000cf600 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.702+0000 7f7a06eee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000c72a0 con 0x7f7a0015bb50 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.702+0000 7f7a04c8a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 0x7f7a001565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.702+0000 7f7a04c8a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 0x7f7a001565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45246/0 (socket says 172.21.15.172:45246) 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.702+0000 7f7a04c8a640 1 -- 172.21.15.172:0/1765220955 learned_addr learned my addr 172.21.15.172:0/1765220955 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f79fffff640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a000cf600 0x7f7a001522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f7a0548b640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a0015bb50 0x7f7a001540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f7a04c8a640 1 -- 172.21.15.172:0/1765220955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a0015bb50 msgr2=0x7f7a001540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f7a04c8a640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a0015bb50 0x7f7a001540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f7a04c8a640 1 -- 172.21.15.172:0/1765220955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a000cf600 msgr2=0x7f7a001522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f7a04c8a640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a000cf600 0x7f7a001522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f7a04c8a640 1 -- 172.21.15.172:0/1765220955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a00156ae0 con 0x7f7a000cbf20 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f7a04c8a640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 0x7f7a001565a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f79f400c460 tx=0x7f79f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f79fd7fa640 1 -- 172.21.15.172:0/1765220955 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4018070 con 0x7f7a000cbf20 2024-04-25T08:43:31.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f79fd7fa640 1 -- 172.21.15.172:0/1765220955 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f4007500 con 0x7f7a000cbf20 2024-04-25T08:43:31.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f7a06eee640 1 -- 172.21.15.172:0/1765220955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a000ca1e0 con 0x7f7a000cbf20 2024-04-25T08:43:31.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f79fd7fa640 1 -- 172.21.15.172:0/1765220955 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4004a20 con 0x7f7a000cbf20 2024-04-25T08:43:31.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.703+0000 7f7a06eee640 1 -- 172.21.15.172:0/1765220955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a000ca7a0 con 0x7f7a000cbf20 2024-04-25T08:43:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.704+0000 7f7a06eee640 1 -- 172.21.15.172:0/1765220955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a000c7680 con 0x7f7a000cbf20 2024-04-25T08:43:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.705+0000 7f79fd7fa640 1 -- 172.21.15.172:0/1765220955 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f79f401b070 con 0x7f7a000cbf20 2024-04-25T08:43:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.705+0000 7f79fd7fa640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79e406b4d0 0x7f79e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.705+0000 7f79fffff640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79e406b4d0 0x7f79e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.705+0000 7f79fd7fa640 1 -- 172.21.15.172:0/1765220955 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f79f4089160 con 0x7f7a000cbf20 2024-04-25T08:43:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.706+0000 7f79fffff640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79e406b4d0 0x7f79e406d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7a0015ec80 tx=0x7f79ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:31.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.710+0000 7f79fd7fa640 1 -- 172.21.15.172:0/1765220955 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a000c7680 con 0x7f7a000cbf20 2024-04-25T08:43:31.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.960+0000 7f7a06eee640 1 -- 172.21.15.172:0/1765220955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7a00073a00 con 0x7f7a000cbf20 2024-04-25T08:43:31.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.962+0000 7f79fd7fa640 1 -- 172.21.15.172:0/1765220955 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f79f4057be0 con 0x7f7a000cbf20 2024-04-25T08:43:31.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 -- 172.21.15.172:0/1765220955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79e406b4d0 msgr2=0x7f79e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79e406b4d0 0x7f79e406d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7a0015ec80 tx=0x7f79ec008040 comp rx=0 tx=0).stop 2024-04-25T08:43:31.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 -- 172.21.15.172:0/1765220955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 msgr2=0x7f7a001565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:31.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 0x7f7a001565a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f79f400c460 tx=0x7f79f400c920 comp rx=0 tx=0).stop 2024-04-25T08:43:31.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 -- 172.21.15.172:0/1765220955 shutdown_connections 2024-04-25T08:43:31.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79e406b4d0 0x7f79e406d990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a000cf600 0x7f7a001522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a0015bb50 0x7f7a001540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 --2- 172.21.15.172:0/1765220955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a000cbf20 0x7f7a001565a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:31.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 -- 172.21.15.172:0/1765220955 >> 172.21.15.172:0/1765220955 conn(0x7f7a0006f500 msgr2=0x7f7a000b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:31.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 -- 172.21.15.172:0/1765220955 shutdown_connections 2024-04-25T08:43:31.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:31.965+0000 7f7a06eee640 1 -- 172.21.15.172:0/1765220955 wait complete. 2024-04-25T08:43:31.972 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T08:43:32.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.081+0000 7f0cfeba9640 1 Processor -- start 2024-04-25T08:43:32.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.081+0000 7f0cfeba9640 1 -- start start 2024-04-25T08:43:32.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfeba9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0cf815bb20 0x7f0cf80cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfeba9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf80ccdd0 0x7f0cf80cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfeba9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0cf80cdcd0 0x7f0cf80cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfeba9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf80d0450 con 0x7f0cf815bb20 2024-04-25T08:43:32.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfeba9640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf80cb190 con 0x7f0cf80cdcd0 2024-04-25T08:43:32.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfeba9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80cb470 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfc945640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0cf815bb20 0x7f0cf80cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfc945640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0cf815bb20 0x7f0cf80cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45252/0 (socket says 172.21.15.172:45252) 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfc945640 1 -- 172.21.15.172:0/1074927469 learned_addr learned my addr 172.21.15.172:0/1074927469 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfc945640 1 -- 172.21.15.172:0/1074927469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf80ccdd0 msgr2=0x7f0cf80cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfd146640 1 --2- 172.21.15.172:0/1074927469 >> v2:172.21.15.186:3300/0 conn(0x7f0cf80cdcd0 0x7f0cf80cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cf7fff640 1 --2- 172.21.15.172:0/1074927469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf80ccdd0 0x7f0cf80cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfc945640 1 --2- 172.21.15.172:0/1074927469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf80ccdd0 0x7f0cf80cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfc945640 1 -- 172.21.15.172:0/1074927469 >> v2:172.21.15.186:3300/0 conn(0x7f0cf80cdcd0 msgr2=0x7f0cf80cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfc945640 1 --2- 172.21.15.172:0/1074927469 >> v2:172.21.15.186:3300/0 conn(0x7f0cf80cdcd0 0x7f0cf80cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.082+0000 7f0cfc945640 1 -- 172.21.15.172:0/1074927469 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80cb750 con 0x7f0cf815bb20 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.083+0000 7f0cfd146640 1 --2- 172.21.15.172:0/1074927469 >> v2:172.21.15.186:3300/0 conn(0x7f0cf80cdcd0 0x7f0cf80cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.083+0000 7f0cf7fff640 1 --2- 172.21.15.172:0/1074927469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf80ccdd0 0x7f0cf80cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.083+0000 7f0cfc945640 1 --2- 172.21.15.172:0/1074927469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf815bb20 0x7f0cf80cc230 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8071d80 tx=0x7f0cf002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aacb2829544be3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.083+0000 7f0cf77fe640 1 -- 172.21.15.172:0/1074927469 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0036070 con 0x7f0cf815bb20 2024-04-25T08:43:32.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.083+0000 7f0cf77fe640 1 -- 172.21.15.172:0/1074927469 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf0031600 con 0x7f0cf815bb20 2024-04-25T08:43:32.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.083+0000 7f0cf77fe640 1 -- 172.21.15.172:0/1074927469 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00319d0 con 0x7f0cf815bb20 2024-04-25T08:43:32.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.084+0000 7f0cfeba9640 1 -- 172.21.15.172:0/1074927469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf815bb20 msgr2=0x7f0cf80cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.084+0000 7f0cfeba9640 1 --2- 172.21.15.172:0/1074927469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf815bb20 0x7f0cf80cc230 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8071d80 tx=0x7f0cf002a610 comp rx=0 tx=0).stop 2024-04-25T08:43:32.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.084+0000 7f0cfeba9640 1 -- 172.21.15.172:0/1074927469 shutdown_connections 2024-04-25T08:43:32.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.084+0000 7f0cfeba9640 1 --2- 172.21.15.172:0/1074927469 >> v2:172.21.15.186:3300/0 conn(0x7f0cf80cdcd0 0x7f0cf80cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.084+0000 7f0cfeba9640 1 --2- 172.21.15.172:0/1074927469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf80ccdd0 0x7f0cf80cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.084+0000 7f0cfeba9640 1 --2- 172.21.15.172:0/1074927469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf815bb20 0x7f0cf80cc230 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.084+0000 7f0cfeba9640 1 -- 172.21.15.172:0/1074927469 >> 172.21.15.172:0/1074927469 conn(0x7f0cf80b2390 msgr2=0x7f0cf80b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:32.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.084+0000 7f0cfeba9640 1 -- 172.21.15.172:0/1074927469 shutdown_connections 2024-04-25T08:43:32.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.084+0000 7f0cfeba9640 1 -- 172.21.15.172:0/1074927469 wait complete. 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.085+0000 7f0cfeba9640 1 Processor -- start 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.085+0000 7f0cfeba9640 1 -- start start 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfeba9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf80ccdd0 0x7f0cf81e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfeba9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0cf80cdcd0 0x7f0cf814a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfeba9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf815bb20 0x7f0cf80c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfeba9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80cc770 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfeba9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80cbd10 con 0x7f0cf80cdcd0 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfeba9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf815bf00 con 0x7f0cf815bb20 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfc945640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf80ccdd0 0x7f0cf81e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfc945640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf80ccdd0 0x7f0cf81e5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45268/0 (socket says 172.21.15.172:45268) 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfc945640 1 -- 172.21.15.172:0/83378088 learned_addr learned my addr 172.21.15.172:0/83378088 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:32.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfd146640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf815bb20 0x7f0cf80c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cf7fff640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0cf80cdcd0 0x7f0cf814a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfc945640 1 -- 172.21.15.172:0/83378088 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf815bb20 msgr2=0x7f0cf80c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfc945640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf815bb20 0x7f0cf80c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfc945640 1 -- 172.21.15.172:0/83378088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0cf80cdcd0 msgr2=0x7f0cf814a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfc945640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0cf80cdcd0 0x7f0cf814a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfc945640 1 -- 172.21.15.172:0/83378088 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8159120 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cf7fff640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0cf80cdcd0 0x7f0cf814a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.086+0000 7f0cfd146640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf815bb20 0x7f0cf80c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.087+0000 7f0cfc945640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf80ccdd0 0x7f0cf81e5c90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0034040 tx=0x7f0cf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.087+0000 7f0cf57fa640 1 -- 172.21.15.172:0/83378088 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0036050 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.087+0000 7f0cf57fa640 1 -- 172.21.15.172:0/83378088 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf0042070 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.087+0000 7f0cfeba9640 1 -- 172.21.15.172:0/83378088 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf81e63c0 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.087+0000 7f0cf57fa640 1 -- 172.21.15.172:0/83378088 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0009510 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.087+0000 7f0cfeba9640 1 -- 172.21.15.172:0/83378088 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf81596a0 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.088+0000 7f0cfeba9640 1 -- 172.21.15.172:0/83378088 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf8073a00 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.088+0000 7f0cf57fa640 1 -- 172.21.15.172:0/83378088 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0cf0007c30 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.089+0000 7f0cf57fa640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ce406b4d0 0x7f0ce406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.089+0000 7f0cf7fff640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ce406b4d0 0x7f0ce406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.089+0000 7f0cf57fa640 1 -- 172.21.15.172:0/83378088 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0cf00ab050 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.089+0000 7f0cf7fff640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ce406b4d0 0x7f0ce406d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0cf806fda0 tx=0x7f0cec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:32.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.093+0000 7f0cf57fa640 1 -- 172.21.15.172:0/83378088 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0cf0045360 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.338+0000 7f0cfeba9640 1 -- 172.21.15.172:0/83378088 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0cf80d0080 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.340+0000 7f0cf57fa640 1 -- 172.21.15.172:0/83378088 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0cf007a090 con 0x7f0cf80ccdd0 2024-04-25T08:43:32.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.342+0000 7f0cfeba9640 1 -- 172.21.15.172:0/83378088 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ce406b4d0 msgr2=0x7f0ce406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.342+0000 7f0cfeba9640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ce406b4d0 0x7f0ce406d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0cf806fda0 tx=0x7f0cec008040 comp rx=0 tx=0).stop 2024-04-25T08:43:32.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.342+0000 7f0cfeba9640 1 -- 172.21.15.172:0/83378088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf80ccdd0 msgr2=0x7f0cf81e5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.342+0000 7f0cfeba9640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf80ccdd0 0x7f0cf81e5c90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0034040 tx=0x7f0cf0004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:32.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.342+0000 7f0cfeba9640 1 -- 172.21.15.172:0/83378088 shutdown_connections 2024-04-25T08:43:32.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.342+0000 7f0cfeba9640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ce406b4d0 0x7f0ce406d990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.342+0000 7f0cfeba9640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0cf80cdcd0 0x7f0cf814a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.342+0000 7f0cfeba9640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0cf815bb20 0x7f0cf80c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.342+0000 7f0cfeba9640 1 --2- 172.21.15.172:0/83378088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0cf80ccdd0 0x7f0cf81e5c90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.342+0000 7f0cfeba9640 1 -- 172.21.15.172:0/83378088 >> 172.21.15.172:0/83378088 conn(0x7f0cf80b2390 msgr2=0x7f0cf80ad600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:32.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.343+0000 7f0cfeba9640 1 -- 172.21.15.172:0/83378088 shutdown_connections 2024-04-25T08:43:32.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.343+0000 7f0cfeba9640 1 -- 172.21.15.172:0/83378088 wait complete. 2024-04-25T08:43:32.345 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T08:43:32.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.452+0000 7fd3e2407640 1 Processor -- start 2024-04-25T08:43:32.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.453+0000 7fd3e2407640 1 -- start start 2024-04-25T08:43:32.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.453+0000 7fd3e2407640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3dc161710 0x7fd3dc0d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.453+0000 7fd3e2407640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3dc15e000 con 0x7fd3dc0ced80 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.453+0000 7fd3e2407640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3dc0d1de0 con 0x7fd3dc15dc20 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.453+0000 7fd3e2407640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3dc161c60 con 0x7fd3dc161710 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.453+0000 7fd3e09a4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3dc161710 0x7fd3dc0d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.454+0000 7fd3e09a4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3dc161710 0x7fd3dc0d29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45272/0 (socket says 172.21.15.172:45272) 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.454+0000 7fd3e09a4640 1 -- 172.21.15.172:0/2554887289 learned_addr learned my addr 172.21.15.172:0/2554887289 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.454+0000 7fd3e09a4640 1 -- 172.21.15.172:0/2554887289 >> v1:172.21.15.186:6789/0 conn(0x7fd3dc15dc20 legacy=0x7fd3dc0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.454+0000 7fd3e09a4640 1 -- 172.21.15.172:0/2554887289 >> v1:172.21.15.172:6789/0 conn(0x7fd3dc0ced80 legacy=0x7fd3dc0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.454+0000 7fd3e09a4640 1 -- 172.21.15.172:0/2554887289 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc161f40 con 0x7fd3dc161710 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.454+0000 7fd3daffd640 1 -- 172.21.15.172:0/2554887289 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068704941 0 0) 0x7fd3dc15e000 con 0x7fd3dc0ced80 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.454+0000 7fd3e09a4640 1 --2- 172.21.15.172:0/2554887289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc161710 0x7fd3dc0d29f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009e50 tx=0x7fd3d402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cf0c436d21d50c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.455+0000 7fd3daffd640 1 -- 172.21.15.172:0/2554887289 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4036070 con 0x7fd3dc161710 2024-04-25T08:43:32.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.455+0000 7fd3daffd640 1 -- 172.21.15.172:0/2554887289 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d4031600 con 0x7fd3dc161710 2024-04-25T08:43:32.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.455+0000 7fd3daffd640 1 -- 172.21.15.172:0/2554887289 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40319d0 con 0x7fd3dc161710 2024-04-25T08:43:32.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.455+0000 7fd3e2407640 1 -- 172.21.15.172:0/2554887289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc161710 msgr2=0x7fd3dc0d29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.455+0000 7fd3e2407640 1 --2- 172.21.15.172:0/2554887289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc161710 0x7fd3dc0d29f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009e50 tx=0x7fd3d402a760 comp rx=0 tx=0).stop 2024-04-25T08:43:32.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.455+0000 7fd3e2407640 1 -- 172.21.15.172:0/2554887289 shutdown_connections 2024-04-25T08:43:32.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.455+0000 7fd3e2407640 1 --2- 172.21.15.172:0/2554887289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc161710 0x7fd3dc0d29f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.455+0000 7fd3e2407640 1 -- 172.21.15.172:0/2554887289 >> 172.21.15.172:0/2554887289 conn(0x7fd3dc0d0420 msgr2=0x7fd3dc0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:32.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.455+0000 7fd3e2407640 1 -- 172.21.15.172:0/2554887289 shutdown_connections 2024-04-25T08:43:32.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.455+0000 7fd3e2407640 1 -- 172.21.15.172:0/2554887289 wait complete. 2024-04-25T08:43:32.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.456+0000 7fd3e2407640 1 Processor -- start 2024-04-25T08:43:32.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.457+0000 7fd3e2407640 1 -- start start 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.457+0000 7fd3e2407640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3dc0ced80 0x7fd3dc0b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.457+0000 7fd3e2407640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc15dc20 0x7fd3dc0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.457+0000 7fd3e2407640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3dc161710 0x7fd3dc0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.457+0000 7fd3e2407640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc0b5e50 con 0x7fd3dc15dc20 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.457+0000 7fd3e2407640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc162500 con 0x7fd3dc161710 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.457+0000 7fd3e2407640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc0b5fd0 con 0x7fd3dc0ced80 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.457+0000 7fd3db7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc15dc20 0x7fd3dc0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.457+0000 7fd3db7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc15dc20 0x7fd3dc0caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45276/0 (socket says 172.21.15.172:45276) 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.457+0000 7fd3db7fe640 1 -- 172.21.15.172:0/1809813629 learned_addr learned my addr 172.21.15.172:0/1809813629 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3e09a4640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3dc161710 0x7fd3dc0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3dbfff640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3dc0ced80 0x7fd3dc0b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3db7fe640 1 -- 172.21.15.172:0/1809813629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3dc0ced80 msgr2=0x7fd3dc0b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3db7fe640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3dc0ced80 0x7fd3dc0b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3db7fe640 1 -- 172.21.15.172:0/1809813629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3dc161710 msgr2=0x7fd3dc0cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3db7fe640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3dc161710 0x7fd3dc0cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3db7fe640 1 -- 172.21.15.172:0/1809813629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc0cb560 con 0x7fd3dc15dc20 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3e09a4640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3dc161710 0x7fd3dc0cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3dbfff640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3dc0ced80 0x7fd3dc0b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3db7fe640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc15dc20 0x7fd3dc0caae0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000c410 tx=0x7fd3d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3d8ff9640 1 -- 172.21.15.172:0/1809813629 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0017070 con 0x7fd3dc15dc20 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3d8ff9640 1 -- 172.21.15.172:0/1809813629 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d00035f0 con 0x7fd3dc15dc20 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3e2407640 1 -- 172.21.15.172:0/1809813629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc0cb810 con 0x7fd3dc15dc20 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3d8ff9640 1 -- 172.21.15.172:0/1809813629 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00039e0 con 0x7fd3dc15dc20 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.458+0000 7fd3e2407640 1 -- 172.21.15.172:0/1809813629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc0cbdd0 con 0x7fd3dc15dc20 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.459+0000 7fd3e2407640 1 -- 172.21.15.172:0/1809813629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3dc0cf380 con 0x7fd3dc15dc20 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.460+0000 7fd3d8ff9640 1 -- 172.21.15.172:0/1809813629 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd3d001a070 con 0x7fd3dc15dc20 2024-04-25T08:43:32.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.460+0000 7fd3d8ff9640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3c806b4d0 0x7fd3c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.460+0000 7fd3d8ff9640 1 -- 172.21.15.172:0/1809813629 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd3d00893e0 con 0x7fd3dc15dc20 2024-04-25T08:43:32.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.460+0000 7fd3dbfff640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3c806b4d0 0x7fd3c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.460+0000 7fd3dbfff640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3c806b4d0 0x7fd3c806d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc007fd0 tx=0x7fd3cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:32.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.464+0000 7fd3d8ff9640 1 -- 172.21.15.172:0/1809813629 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd3dc0cf380 con 0x7fd3dc15dc20 2024-04-25T08:43:32.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.710+0000 7fd3e2407640 1 -- 172.21.15.172:0/1809813629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd3dc073a00 con 0x7fd3dc15dc20 2024-04-25T08:43:32.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.712+0000 7fd3d8ff9640 1 -- 172.21.15.172:0/1809813629 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd3d005ce20 con 0x7fd3dc15dc20 2024-04-25T08:43:32.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 -- 172.21.15.172:0/1809813629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3c806b4d0 msgr2=0x7fd3c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3c806b4d0 0x7fd3c806d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc007fd0 tx=0x7fd3cc009040 comp rx=0 tx=0).stop 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 -- 172.21.15.172:0/1809813629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc15dc20 msgr2=0x7fd3dc0caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc15dc20 0x7fd3dc0caae0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000c410 tx=0x7fd3d000c8d0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 -- 172.21.15.172:0/1809813629 shutdown_connections 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3c806b4d0 0x7fd3c806d990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3dc161710 0x7fd3dc0cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3dc15dc20 0x7fd3dc0caae0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 --2- 172.21.15.172:0/1809813629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3dc0ced80 0x7fd3dc0b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 -- 172.21.15.172:0/1809813629 >> 172.21.15.172:0/1809813629 conn(0x7fd3dc0d0420 msgr2=0x7fd3dc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 -- 172.21.15.172:0/1809813629 shutdown_connections 2024-04-25T08:43:32.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.715+0000 7fd3e2407640 1 -- 172.21.15.172:0/1809813629 wait complete. 2024-04-25T08:43:32.718 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T08:43:32.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.824+0000 7f84e9207640 1 Processor -- start 2024-04-25T08:43:32.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.824+0000 7f84e9207640 1 -- start start 2024-04-25T08:43:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e9207640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f84e415dd80 0x7f84e40b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e9207640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f84e40ad570 0x7f84e406ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e9207640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e40b3930 con 0x7f84e406abe0 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e9207640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e406e410 con 0x7f84e415dd80 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e9207640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e40b3c10 con 0x7f84e40ad570 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f84e415dd80 0x7f84e40b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e2d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f84e406abe0 0x7f84e406afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54140/0 (socket says 172.21.15.172:54140) 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e2d9d640 1 -- 172.21.15.172:0/2203630718 learned_addr learned my addr 172.21.15.172:0/2203630718 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e259c640 1 -- 172.21.15.172:0/2203630718 >> v2:172.21.15.186:3300/0 conn(0x7f84e40ad570 msgr2=0x7f84e406ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e259c640 1 --2- 172.21.15.172:0/2203630718 >> v2:172.21.15.186:3300/0 conn(0x7f84e40ad570 0x7f84e406ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e259c640 1 -- 172.21.15.172:0/2203630718 >> v1:172.21.15.172:6789/0 conn(0x7f84e406abe0 legacy=0x7f84e406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e1d9b640 1 -- 172.21.15.172:0/2203630718 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289782616 0 0) 0x7f84e40b3930 con 0x7f84e406abe0 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.825+0000 7f84e259c640 1 -- 172.21.15.172:0/2203630718 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e406e660 con 0x7f84e415dd80 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.826+0000 7f84e259c640 1 --2- 172.21.15.172:0/2203630718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e415dd80 0x7f84e40b5290 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f84e4072fe0 tx=0x7f84d802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45b099c583ef4fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.826+0000 7f84e1d9b640 1 -- 172.21.15.172:0/2203630718 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8037070 con 0x7f84e415dd80 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.826+0000 7f84e1d9b640 1 -- 172.21.15.172:0/2203630718 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d8032440 con 0x7f84e415dd80 2024-04-25T08:43:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.826+0000 7f84e1d9b640 1 -- 172.21.15.172:0/2203630718 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8032810 con 0x7f84e415dd80 2024-04-25T08:43:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.827+0000 7f84e9207640 1 -- 172.21.15.172:0/2203630718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e415dd80 msgr2=0x7f84e40b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.827+0000 7f84e9207640 1 --2- 172.21.15.172:0/2203630718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e415dd80 0x7f84e40b5290 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f84e4072fe0 tx=0x7f84d802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.827+0000 7f84e9207640 1 -- 172.21.15.172:0/2203630718 shutdown_connections 2024-04-25T08:43:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.827+0000 7f84e9207640 1 --2- 172.21.15.172:0/2203630718 >> v2:172.21.15.186:3300/0 conn(0x7f84e40ad570 0x7f84e406ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.827+0000 7f84e9207640 1 --2- 172.21.15.172:0/2203630718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e415dd80 0x7f84e40b5290 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.827+0000 7f84e9207640 1 -- 172.21.15.172:0/2203630718 >> 172.21.15.172:0/2203630718 conn(0x7f84e40b5af0 msgr2=0x7f84e40b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.827+0000 7f84e9207640 1 -- 172.21.15.172:0/2203630718 shutdown_connections 2024-04-25T08:43:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.827+0000 7f84e9207640 1 -- 172.21.15.172:0/2203630718 wait complete. 2024-04-25T08:43:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.828+0000 7f84e9207640 1 Processor -- start 2024-04-25T08:43:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.828+0000 7f84e9207640 1 -- start start 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e9207640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84e406abe0 0x7f84e415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e9207640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40ad570 0x7f84e409a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e9207640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e415dd80 0x7f84e409abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e9207640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e4070280 con 0x7f84e40ad570 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e9207640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40b57d0 con 0x7f84e415dd80 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e9207640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e4070400 con 0x7f84e406abe0 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40ad570 0x7f84e409a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40ad570 0x7f84e409a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45308/0 (socket says 172.21.15.172:45308) 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e259c640 1 -- 172.21.15.172:0/3669730652 learned_addr learned my addr 172.21.15.172:0/3669730652 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e359e640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e415dd80 0x7f84e409abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e259c640 1 -- 172.21.15.172:0/3669730652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84e406abe0 msgr2=0x7f84e415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e2d9d640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84e406abe0 0x7f84e415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e259c640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84e406abe0 0x7f84e415ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e259c640 1 -- 172.21.15.172:0/3669730652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e415dd80 msgr2=0x7f84e409abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e259c640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e415dd80 0x7f84e409abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e259c640 1 -- 172.21.15.172:0/3669730652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e409d590 con 0x7f84e40ad570 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.829+0000 7f84e359e640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e415dd80 0x7f84e409abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.830+0000 7f84e259c640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40ad570 0x7f84e409a680 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f84d8000c00 tx=0x7f84d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.830+0000 7f84cb7fe640 1 -- 172.21.15.172:0/3669730652 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8041070 con 0x7f84e40ad570 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.830+0000 7f84cb7fe640 1 -- 172.21.15.172:0/3669730652 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d803c890 con 0x7f84e40ad570 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.830+0000 7f84e9207640 1 -- 172.21.15.172:0/3669730652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e409d870 con 0x7f84e40ad570 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.830+0000 7f84cb7fe640 1 -- 172.21.15.172:0/3669730652 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8037040 con 0x7f84e40ad570 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.830+0000 7f84e9207640 1 -- 172.21.15.172:0/3669730652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e409de30 con 0x7f84e40ad570 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.831+0000 7f84e9207640 1 -- 172.21.15.172:0/3669730652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e4073a00 con 0x7f84e40ad570 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.831+0000 7f84cb7fe640 1 -- 172.21.15.172:0/3669730652 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f84d8044070 con 0x7f84e40ad570 2024-04-25T08:43:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.832+0000 7f84cb7fe640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f84d006b4d0 0x7f84d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:32.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.832+0000 7f84e2d9d640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f84d006b4d0 0x7f84d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:32.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.832+0000 7f84cb7fe640 1 -- 172.21.15.172:0/3669730652 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f84d80aac80 con 0x7f84e40ad570 2024-04-25T08:43:32.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.832+0000 7f84e2d9d640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f84d006b4d0 0x7f84d006d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f84d40012e0 tx=0x7f84d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:32.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:32.836+0000 7f84cb7fe640 1 -- 172.21.15.172:0/3669730652 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84d8079e70 con 0x7f84e40ad570 2024-04-25T08:43:33.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.071+0000 7f84e9207640 1 -- 172.21.15.172:0/3669730652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f84e40b3590 con 0x7f84e40ad570 2024-04-25T08:43:33.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.073+0000 7f84cb7fe640 1 -- 172.21.15.172:0/3669730652 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f84d8079770 con 0x7f84e40ad570 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 -- 172.21.15.172:0/3669730652 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f84d006b4d0 msgr2=0x7f84d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f84d006b4d0 0x7f84d006d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f84d40012e0 tx=0x7f84d4009040 comp rx=0 tx=0).stop 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 -- 172.21.15.172:0/3669730652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40ad570 msgr2=0x7f84e409a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40ad570 0x7f84e409a680 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f84d8000c00 tx=0x7f84d80046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 -- 172.21.15.172:0/3669730652 shutdown_connections 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f84d006b4d0 0x7f84d006d990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84e415dd80 0x7f84e409abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40ad570 0x7f84e409a680 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 --2- 172.21.15.172:0/3669730652 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84e406abe0 0x7f84e415ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 -- 172.21.15.172:0/3669730652 >> 172.21.15.172:0/3669730652 conn(0x7f84e40b5af0 msgr2=0x7f84e406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:33.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 -- 172.21.15.172:0/3669730652 shutdown_connections 2024-04-25T08:43:33.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.075+0000 7f84e9207640 1 -- 172.21.15.172:0/3669730652 wait complete. 2024-04-25T08:43:33.078 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T08:43:33.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.184+0000 7ff06de3f640 1 Processor -- start 2024-04-25T08:43:33.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.184+0000 7ff06de3f640 1 -- start start 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.185+0000 7ff06de3f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0680ce230 0x7ff0680cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.185+0000 7ff06de3f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff06815b270 0x7ff06815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.185+0000 7ff06de3f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff068072280 con 0x7ff0680cc4f0 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.185+0000 7ff06de3f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff068071270 con 0x7ff0680ce230 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.185+0000 7ff06de3f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680714c0 con 0x7ff06815b270 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.185+0000 7ff066ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0680ce230 0x7ff0680cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.185+0000 7ff066ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0680ce230 0x7ff0680cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45316/0 (socket says 172.21.15.172:45316) 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.185+0000 7ff066ffd640 1 -- 172.21.15.172:0/892099630 learned_addr learned my addr 172.21.15.172:0/892099630 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.186+0000 7ff066ffd640 1 -- 172.21.15.172:0/892099630 >> v2:172.21.15.186:3300/0 conn(0x7ff06815b270 msgr2=0x7ff06815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.186+0000 7ff066ffd640 1 --2- 172.21.15.172:0/892099630 >> v2:172.21.15.186:3300/0 conn(0x7ff06815b270 0x7ff06815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.186+0000 7ff066ffd640 1 -- 172.21.15.172:0/892099630 >> v1:172.21.15.186:6789/0 conn(0x7ff0680cc4f0 legacy=0x7ff0680cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.186+0000 7ff066ffd640 1 -- 172.21.15.172:0/892099630 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680717a0 con 0x7ff0680ce230 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.186+0000 7ff066ffd640 1 --2- 172.21.15.172:0/892099630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0680ce230 0x7ff0680cc8d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff06815af60 tx=0x7ff05c02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339af451b5d14df0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.186+0000 7ff0667fc640 1 -- 172.21.15.172:0/892099630 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0325a0 con 0x7ff0680ce230 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.186+0000 7ff0667fc640 1 -- 172.21.15.172:0/892099630 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05c038070 con 0x7ff0680ce230 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.186+0000 7ff0667fc640 1 -- 172.21.15.172:0/892099630 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05c032960 con 0x7ff0680ce230 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.187+0000 7ff06de3f640 1 -- 172.21.15.172:0/892099630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0680ce230 msgr2=0x7ff0680cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.187+0000 7ff06de3f640 1 --2- 172.21.15.172:0/892099630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0680ce230 0x7ff0680cc8d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff06815af60 tx=0x7ff05c02c8e0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.187+0000 7ff06de3f640 1 -- 172.21.15.172:0/892099630 shutdown_connections 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.187+0000 7ff06de3f640 1 --2- 172.21.15.172:0/892099630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0680ce230 0x7ff0680cc8d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.187+0000 7ff06de3f640 1 --2- 172.21.15.172:0/892099630 >> v2:172.21.15.186:3300/0 conn(0x7ff06815b270 0x7ff06815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.187+0000 7ff06de3f640 1 -- 172.21.15.172:0/892099630 >> 172.21.15.172:0/892099630 conn(0x7ff06806abe0 msgr2=0x7ff06806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.187+0000 7ff06de3f640 1 -- 172.21.15.172:0/892099630 shutdown_connections 2024-04-25T08:43:33.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.187+0000 7ff06de3f640 1 -- 172.21.15.172:0/892099630 wait complete. 2024-04-25T08:43:33.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.188+0000 7ff06de3f640 1 Processor -- start 2024-04-25T08:43:33.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.188+0000 7ff06de3f640 1 -- start start 2024-04-25T08:43:33.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff06de3f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0680cc4f0 0x7ff068143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff06de3f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0680ce230 0x7ff068146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff06de3f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff06815b270 0x7ff06815c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff06de3f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06815bc20 con 0x7ff06815b270 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff06de3f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068071d60 con 0x7ff0680cc4f0 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff06de3f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06815bda0 con 0x7ff0680ce230 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff067fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff06815b270 0x7ff06815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff067fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff06815b270 0x7ff06815c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45326/0 (socket says 172.21.15.172:45326) 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff067fff640 1 -- 172.21.15.172:0/3962127277 learned_addr learned my addr 172.21.15.172:0/3962127277 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff0677fe640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0680cc4f0 0x7ff068143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff066ffd640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0680ce230 0x7ff068146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff067fff640 1 -- 172.21.15.172:0/3962127277 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0680ce230 msgr2=0x7ff068146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff067fff640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0680ce230 0x7ff068146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff067fff640 1 -- 172.21.15.172:0/3962127277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0680cc4f0 msgr2=0x7ff068143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff067fff640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0680cc4f0 0x7ff068143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff067fff640 1 -- 172.21.15.172:0/3962127277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680cb6d0 con 0x7ff06815b270 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.189+0000 7ff066ffd640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0680ce230 0x7ff068146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.190+0000 7ff067fff640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff06815b270 0x7ff06815c480 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff06000b970 tx=0x7ff06000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:33.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.190+0000 7ff04ffff640 1 -- 172.21.15.172:0/3962127277 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060019070 con 0x7ff06815b270 2024-04-25T08:43:33.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.190+0000 7ff04ffff640 1 -- 172.21.15.172:0/3962127277 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06000cb60 con 0x7ff06815b270 2024-04-25T08:43:33.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.190+0000 7ff06de3f640 1 -- 172.21.15.172:0/3962127277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff068146970 con 0x7ff06815b270 2024-04-25T08:43:33.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.190+0000 7ff04ffff640 1 -- 172.21.15.172:0/3962127277 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060014440 con 0x7ff06815b270 2024-04-25T08:43:33.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.190+0000 7ff06de3f640 1 -- 172.21.15.172:0/3962127277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0680ca910 con 0x7ff06815b270 2024-04-25T08:43:33.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.191+0000 7ff06de3f640 1 -- 172.21.15.172:0/3962127277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff068073a00 con 0x7ff06815b270 2024-04-25T08:43:33.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.191+0000 7ff04ffff640 1 -- 172.21.15.172:0/3962127277 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff06001c070 con 0x7ff06815b270 2024-04-25T08:43:33.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.192+0000 7ff04ffff640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff05406b500 0x7ff05406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.192+0000 7ff0677fe640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff05406b500 0x7ff05406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.192+0000 7ff04ffff640 1 -- 172.21.15.172:0/3962127277 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ff060089c70 con 0x7ff06815b270 2024-04-25T08:43:33.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.192+0000 7ff0677fe640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff05406b500 0x7ff05406d9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff058006fd0 tx=0x7ff058008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:33.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.196+0000 7ff04ffff640 1 -- 172.21.15.172:0/3962127277 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff068146970 con 0x7ff06815b270 2024-04-25T08:43:33.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.435+0000 7ff06de3f640 1 -- 172.21.15.172:0/3962127277 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff06806d3a0 con 0x7ff06815b270 2024-04-25T08:43:33.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.436+0000 7ff04ffff640 1 -- 172.21.15.172:0/3962127277 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff0680cb6d0 con 0x7ff06815b270 2024-04-25T08:43:33.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 -- 172.21.15.172:0/3962127277 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff05406b500 msgr2=0x7ff05406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff05406b500 0x7ff05406d9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff058006fd0 tx=0x7ff058008040 comp rx=0 tx=0).stop 2024-04-25T08:43:33.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 -- 172.21.15.172:0/3962127277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff06815b270 msgr2=0x7ff06815c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff06815b270 0x7ff06815c480 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff06000b970 tx=0x7ff06000be30 comp rx=0 tx=0).stop 2024-04-25T08:43:33.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 -- 172.21.15.172:0/3962127277 shutdown_connections 2024-04-25T08:43:33.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff05406b500 0x7ff05406d9c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff06815b270 0x7ff06815c480 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0680ce230 0x7ff068146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 --2- 172.21.15.172:0/3962127277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0680cc4f0 0x7ff068143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 -- 172.21.15.172:0/3962127277 >> 172.21.15.172:0/3962127277 conn(0x7ff06806abe0 msgr2=0x7ff06806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:33.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 -- 172.21.15.172:0/3962127277 shutdown_connections 2024-04-25T08:43:33.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.439+0000 7ff06de3f640 1 -- 172.21.15.172:0/3962127277 wait complete. 2024-04-25T08:43:33.442 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T08:43:33.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.548+0000 7f932e6e1640 1 Processor -- start 2024-04-25T08:43:33.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.548+0000 7f932e6e1640 1 -- start start 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f932e6e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280d0ab0 0x7f9328168670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f932e6e1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93280d2420 con 0x7f93280d34c0 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f932e6e1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93280d2700 con 0x7f932815dac0 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f932e6e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280d3030 con 0x7f93280d0ab0 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f93277fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f93280d34c0 0x7f93280d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54144/0 (socket says 172.21.15.172:54144) 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f93277fe640 1 -- 172.21.15.172:0/641651074 learned_addr learned my addr 172.21.15.172:0/641651074 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f932cc7e640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280d0ab0 0x7f9328168670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967456947 0 0) 0x7f93280d2420 con 0x7f93280d34c0 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9310003520 con 0x7f93280d34c0 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1316692952 0 0) 0x7f9310003520 con 0x7f93280d34c0 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280d0ab0 msgr2=0x7f9328168670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280d0ab0 0x7f9328168670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 >> v1:172.21.15.186:6789/0 conn(0x7f932815dac0 legacy=0x7f93280d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93280d29e0 con 0x7f93280d34c0 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f931c0017f0 con 0x7f93280d34c0 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 >> v1:172.21.15.172:6789/0 conn(0x7f93280d34c0 legacy=0x7f93280d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280d0ab0 0x7f9310003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 0x7f9310004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9310004d40 0x7f93100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280d3030 con 0x7f9310003fd0 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931000bbb0 con 0x7f9310004d40 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931000bdb0 con 0x7f93280d0ab0 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.549+0000 7f93277fe640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 0x7f9310004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.550+0000 7f9327fff640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280d0ab0 0x7f9310003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.550+0000 7f932cc7e640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9310004d40 0x7f93100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.550+0000 7f93277fe640 1 -- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280d0ab0 msgr2=0x7f9310003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.550+0000 7f93277fe640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280d0ab0 0x7f9310003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.550+0000 7f93277fe640 1 -- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9310004d40 msgr2=0x7f93100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.550+0000 7f93277fe640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9310004d40 0x7f93100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.550+0000 7f93277fe640 1 -- 172.21.15.172:0/641651074 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9310003520 con 0x7f9310003fd0 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.550+0000 7f93277fe640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 0x7f9310004800 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c160 tx=0x7f9310005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d5afecdecd85b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.551+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c007c20 con 0x7f9310003fd0 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.551+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c007290 con 0x7f9310003fd0 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.551+0000 7f9326ffd640 1 -- 172.21.15.172:0/641651074 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c0057a0 con 0x7f9310003fd0 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.551+0000 7f932e6e1640 1 -- 172.21.15.172:0/641651074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 msgr2=0x7f9310004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.551+0000 7f932e6e1640 1 --2- 172.21.15.172:0/641651074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 0x7f9310004800 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c160 tx=0x7f9310005830 comp rx=0 tx=0).stop 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.551+0000 7f932cc7e640 1 -- 172.21.15.172:0/641651074 reap_dead start 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.551+0000 7f932e6e1640 1 -- 172.21.15.172:0/641651074 shutdown_connections 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.551+0000 7f932e6e1640 1 -- 172.21.15.172:0/641651074 >> 172.21.15.172:0/641651074 conn(0x7f9328061c30 msgr2=0x7f932806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.551+0000 7f932e6e1640 1 -- 172.21.15.172:0/641651074 shutdown_connections 2024-04-25T08:43:33.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.551+0000 7f932e6e1640 1 -- 172.21.15.172:0/641651074 wait complete. 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.552+0000 7f932e6e1640 1 Processor -- start 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.553+0000 7f932e6e1640 1 -- start start 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.553+0000 7f932e6e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 0x7f93281501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.553+0000 7f932e6e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f932814d850 0x7f9328160550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.553+0000 7f932e6e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9328160a90 0x7f93280cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.553+0000 7f932e6e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932815dea0 con 0x7f9310003fd0 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.553+0000 7f932e6e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280d2100 con 0x7f932814d850 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.553+0000 7f932e6e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280b97d0 con 0x7f9328160a90 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.553+0000 7f9327fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 0x7f93281501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.553+0000 7f9327fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 0x7f93281501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45344/0 (socket says 172.21.15.172:45344) 2024-04-25T08:43:33.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.553+0000 7f9327fff640 1 -- 172.21.15.172:0/1993046502 learned_addr learned my addr 172.21.15.172:0/1993046502 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f9327fff640 1 -- 172.21.15.172:0/1993046502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9328160a90 msgr2=0x7f93280cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f9327fff640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9328160a90 0x7f93280cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f9327fff640 1 -- 172.21.15.172:0/1993046502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f932814d850 msgr2=0x7f9328160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f9327fff640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f932814d850 0x7f9328160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f9327fff640 1 -- 172.21.15.172:0/1993046502 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93281f3440 con 0x7f9310003fd0 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f9327fff640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 0x7f93281501f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f931800f820 tx=0x7f931800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f9324ff9640 1 -- 172.21.15.172:0/1993046502 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180050d0 con 0x7f9310003fd0 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f9324ff9640 1 -- 172.21.15.172:0/1993046502 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318018070 con 0x7f9310003fd0 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f932e6e1640 1 -- 172.21.15.172:0/1993046502 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93280cc2c0 con 0x7f9310003fd0 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f9324ff9640 1 -- 172.21.15.172:0/1993046502 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318005490 con 0x7f9310003fd0 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.554+0000 7f932e6e1640 1 -- 172.21.15.172:0/1993046502 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932815eb90 con 0x7f9310003fd0 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.555+0000 7f932e6e1640 1 -- 172.21.15.172:0/1993046502 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9328160eb0 con 0x7f9310003fd0 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.555+0000 7f9324ff9640 1 -- 172.21.15.172:0/1993046502 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f931800d6b0 con 0x7f9310003fd0 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.556+0000 7f9324ff9640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 0x7f931406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.556+0000 7f9324ff9640 1 -- 172.21.15.172:0/1993046502 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f9318089e60 con 0x7f9310003fd0 2024-04-25T08:43:33.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.556+0000 7f93277fe640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 0x7f931406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.556+0000 7f93277fe640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 0x7f931406d990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f931c032000 tx=0x7f931c007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:33.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.560+0000 7f9324ff9640 1 -- 172.21.15.172:0/1993046502 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f93281f3440 con 0x7f9310003fd0 2024-04-25T08:43:33.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.796+0000 7f932e6e1640 1 -- 172.21.15.172:0/1993046502 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f9328073a00 con 0x7f9310003fd0 2024-04-25T08:43:33.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.797+0000 7f9324ff9640 1 -- 172.21.15.172:0/1993046502 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9318058ea0 con 0x7f9310003fd0 2024-04-25T08:43:33.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 -- 172.21.15.172:0/1993046502 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 msgr2=0x7f931406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 0x7f931406d990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f931c032000 tx=0x7f931c007000 comp rx=0 tx=0).stop 2024-04-25T08:43:33.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 -- 172.21.15.172:0/1993046502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 msgr2=0x7f93281501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 0x7f93281501f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f931800f820 tx=0x7f931800fce0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 -- 172.21.15.172:0/1993046502 shutdown_connections 2024-04-25T08:43:33.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 0x7f931406d990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f932814d850 0x7f9328160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9328160a90 0x7f93280cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 --2- 172.21.15.172:0/1993046502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9310003fd0 0x7f93281501f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 -- 172.21.15.172:0/1993046502 >> 172.21.15.172:0/1993046502 conn(0x7f9328061c30 msgr2=0x7f93280c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:33.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 -- 172.21.15.172:0/1993046502 shutdown_connections 2024-04-25T08:43:33.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.800+0000 7f932e6e1640 1 -- 172.21.15.172:0/1993046502 wait complete. 2024-04-25T08:43:33.803 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:33.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.907+0000 7f8b10f3b640 1 Processor -- start 2024-04-25T08:43:33.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.907+0000 7f8b10f3b640 1 -- start start 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.908+0000 7f8b10f3b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8b0c0b2cb0 0x7f8b0c0d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.908+0000 7f8b10f3b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0c0b97a0 con 0x7f8b0c0d1020 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.908+0000 7f8b10f3b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0c0d1c50 con 0x7f8b0c15dbe0 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.908+0000 7f8b10f3b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c15dfc0 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.908+0000 7f8b09d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8b0c0b2cb0 0x7f8b0c0d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.909+0000 7f8b0ad9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8b0c0d1020 0x7f8b0c0d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54154/0 (socket says 172.21.15.172:54154) 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.909+0000 7f8b09d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8b0c0b2cb0 0x7f8b0c0d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45348/0 (socket says 172.21.15.172:45348) 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.909+0000 7f8b0ad9d640 1 -- 172.21.15.172:0/2601054615 learned_addr learned my addr 172.21.15.172:0/2601054615 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.909+0000 7f8b09d9b640 1 -- 172.21.15.172:0/2601054615 >> v1:172.21.15.186:6789/0 conn(0x7f8b0c15dbe0 legacy=0x7f8b0c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.909+0000 7f8b09d9b640 1 -- 172.21.15.172:0/2601054615 >> v1:172.21.15.172:6789/0 conn(0x7f8b0c0d1020 legacy=0x7f8b0c0d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.909+0000 7f8b0959a640 1 -- 172.21.15.172:0/2601054615 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158920900 0 0) 0x7f8b0c0b97a0 con 0x7f8b0c0d1020 2024-04-25T08:43:33.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.909+0000 7f8b09d9b640 1 -- 172.21.15.172:0/2601054615 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c0d1f30 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.909+0000 7f8b09d9b640 1 --2- 172.21.15.172:0/2601054615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 0x7f8b0c0d2730 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0097a0 tx=0x7f8afc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c92359e93b6491c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:33.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.910+0000 7f8b0959a640 1 -- 172.21.15.172:0/2601054615 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc037070 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.910+0000 7f8b0959a640 1 -- 172.21.15.172:0/2601054615 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc032440 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.910+0000 7f8b0959a640 1 -- 172.21.15.172:0/2601054615 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc032810 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.910+0000 7f8b10f3b640 1 -- 172.21.15.172:0/2601054615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 msgr2=0x7f8b0c0d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.910+0000 7f8b10f3b640 1 --2- 172.21.15.172:0/2601054615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 0x7f8b0c0d2730 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0097a0 tx=0x7f8afc02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.910+0000 7f8b10f3b640 1 -- 172.21.15.172:0/2601054615 shutdown_connections 2024-04-25T08:43:33.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.910+0000 7f8b10f3b640 1 --2- 172.21.15.172:0/2601054615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 0x7f8b0c0d2730 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.910+0000 7f8b10f3b640 1 -- 172.21.15.172:0/2601054615 >> 172.21.15.172:0/2601054615 conn(0x7f8b0c061a20 msgr2=0x7f8b0c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:33.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.910+0000 7f8b10f3b640 1 -- 172.21.15.172:0/2601054615 shutdown_connections 2024-04-25T08:43:33.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.910+0000 7f8b10f3b640 1 -- 172.21.15.172:0/2601054615 wait complete. 2024-04-25T08:43:33.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b10f3b640 1 Processor -- start 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b10f3b640 1 -- start start 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b10f3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 0x7f8b0c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b10f3b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b0c0d1020 0x7f8b0c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b10f3b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b0c15dbe0 0x7f8b0c0ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b10f3b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0b92a0 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b10f3b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0d1a00 con 0x7f8b0c15dbe0 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b10f3b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0b9420 con 0x7f8b0c0d1020 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b0a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 0x7f8b0c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b0a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 0x7f8b0c0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45364/0 (socket says 172.21.15.172:45364) 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.912+0000 7f8b0a59c640 1 -- 172.21.15.172:0/1842325986 learned_addr learned my addr 172.21.15.172:0/1842325986 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8b0ad9d640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b0c15dbe0 0x7f8b0c0ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8b09d9b640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b0c0d1020 0x7f8b0c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8b0a59c640 1 -- 172.21.15.172:0/1842325986 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b0c0d1020 msgr2=0x7f8b0c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8b0a59c640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b0c0d1020 0x7f8b0c152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8b0a59c640 1 -- 172.21.15.172:0/1842325986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b0c15dbe0 msgr2=0x7f8b0c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8b0a59c640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b0c15dbe0 0x7f8b0c0ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8b0a59c640 1 -- 172.21.15.172:0/1842325986 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c0cbb40 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8b0a59c640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 0x7f8b0c0caa50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000b3e0 tx=0x7f8b0000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8afaffd640 1 -- 172.21.15.172:0/1842325986 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b00015020 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8afaffd640 1 -- 172.21.15.172:0/1842325986 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b00011850 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8b10f3b640 1 -- 172.21.15.172:0/1842325986 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c0b61d0 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8afaffd640 1 -- 172.21.15.172:0/1842325986 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b00011c40 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.913+0000 7f8b10f3b640 1 -- 172.21.15.172:0/1842325986 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c0cb860 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.914+0000 7f8b10f3b640 1 -- 172.21.15.172:0/1842325986 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c073990 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.915+0000 7f8afaffd640 1 -- 172.21.15.172:0/1842325986 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8b00018020 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.915+0000 7f8afaffd640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8aec06b500 0x7f8aec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.915+0000 7f8afaffd640 1 -- 172.21.15.172:0/1842325986 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8b00089ef0 con 0x7f8b0c0b2cb0 2024-04-25T08:43:33.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.915+0000 7f8b09d9b640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8aec06b500 0x7f8aec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:33.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.915+0000 7f8b09d9b640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8aec06b500 0x7f8aec06d9c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8afc034000 tx=0x7f8afc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:33.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:33.919+0000 7f8afaffd640 1 -- 172.21.15.172:0/1842325986 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8b0001f020 con 0x7f8b0c0b2cb0 2024-04-25T08:43:34.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.091+0000 7f8b10f3b640 1 -- 172.21.15.172:0/1842325986 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b0c0d3060 con 0x7f8b0c0b2cb0 2024-04-25T08:43:34.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.091+0000 7f8afaffd640 1 -- 172.21.15.172:0/1842325986 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13224 (secure 0 0 0) 0x7f8b000172c0 con 0x7f8b0c0b2cb0 2024-04-25T08:43:34.084 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:34.084 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":34,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:31.218306+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.093+0000 7f8b10f3b640 1 -- 172.21.15.172:0/1842325986 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8aec06b500 msgr2=0x7f8aec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.093+0000 7f8b10f3b640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8aec06b500 0x7f8aec06d9c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8afc034000 tx=0x7f8afc02e000 comp rx=0 tx=0).stop 2024-04-25T08:43:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.093+0000 7f8b10f3b640 1 -- 172.21.15.172:0/1842325986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 msgr2=0x7f8b0c0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.093+0000 7f8b10f3b640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 0x7f8b0c0caa50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000b3e0 tx=0x7f8b0000b8a0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.094+0000 7f8b10f3b640 1 -- 172.21.15.172:0/1842325986 shutdown_connections 2024-04-25T08:43:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.094+0000 7f8b10f3b640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8aec06b500 0x7f8aec06d9c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.094+0000 7f8b10f3b640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b0c15dbe0 0x7f8b0c0ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.094+0000 7f8b10f3b640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b0c0d1020 0x7f8b0c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.094+0000 7f8b10f3b640 1 --2- 172.21.15.172:0/1842325986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0c0b2cb0 0x7f8b0c0caa50 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.094+0000 7f8b10f3b640 1 -- 172.21.15.172:0/1842325986 >> 172.21.15.172:0/1842325986 conn(0x7f8b0c061a20 msgr2=0x7f8b0c158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:34.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.094+0000 7f8b10f3b640 1 -- 172.21.15.172:0/1842325986 shutdown_connections 2024-04-25T08:43:34.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.094+0000 7f8b10f3b640 1 -- 172.21.15.172:0/1842325986 wait complete. 2024-04-25T08:43:34.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:43:34.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:43:34.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.205+0000 7feee9363640 1 Processor -- start 2024-04-25T08:43:34.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.205+0000 7feee9363640 1 -- start start 2024-04-25T08:43:34.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.205+0000 7feee9363640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feee40ced80 0x7feee40d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.205+0000 7feee9363640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feee4161710 0x7feee40d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.205+0000 7feee9363640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee415e000 con 0x7feee415dc20 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.205+0000 7feee9363640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee40d1de0 con 0x7feee40ced80 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.205+0000 7feee9363640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee4161c60 con 0x7feee4161710 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.206+0000 7feee27fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feee40ced80 0x7feee40d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.206+0000 7feee2ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7feee415dc20 0x7feee40ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54168/0 (socket says 172.21.15.172:54168) 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.206+0000 7feee2ffd640 1 -- 172.21.15.172:0/926675686 learned_addr learned my addr 172.21.15.172:0/926675686 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.206+0000 7feee37fe640 1 --2- 172.21.15.172:0/926675686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feee4161710 0x7feee40d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.206+0000 7feee27fc640 1 -- 172.21.15.172:0/926675686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feee4161710 msgr2=0x7feee40d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.206+0000 7feee27fc640 1 --2- 172.21.15.172:0/926675686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feee4161710 0x7feee40d2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.206+0000 7feee27fc640 1 -- 172.21.15.172:0/926675686 >> v1:172.21.15.172:6789/0 conn(0x7feee415dc20 legacy=0x7feee40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.206+0000 7feee1ffb640 1 -- 172.21.15.172:0/926675686 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460699103 0 0) 0x7feee415e000 con 0x7feee415dc20 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.206+0000 7feee27fc640 1 -- 172.21.15.172:0/926675686 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee4161f40 con 0x7feee40ced80 2024-04-25T08:43:34.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee27fc640 1 --2- 172.21.15.172:0/926675686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee40ced80 0x7feee40d22e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7feed80097a0 tx=0x7feed802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe8826073eedcd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee1ffb640 1 -- 172.21.15.172:0/926675686 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8037070 con 0x7feee40ced80 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee1ffb640 1 -- 172.21.15.172:0/926675686 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8032440 con 0x7feee40ced80 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee1ffb640 1 -- 172.21.15.172:0/926675686 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8032810 con 0x7feee40ced80 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee9363640 1 -- 172.21.15.172:0/926675686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee40ced80 msgr2=0x7feee40d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee9363640 1 --2- 172.21.15.172:0/926675686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee40ced80 0x7feee40d22e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7feed80097a0 tx=0x7feed802a180 comp rx=0 tx=0).stop 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee9363640 1 -- 172.21.15.172:0/926675686 shutdown_connections 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee9363640 1 --2- 172.21.15.172:0/926675686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feee4161710 0x7feee40d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee9363640 1 --2- 172.21.15.172:0/926675686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee40ced80 0x7feee40d22e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee9363640 1 -- 172.21.15.172:0/926675686 >> 172.21.15.172:0/926675686 conn(0x7feee40d0420 msgr2=0x7feee40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee9363640 1 -- 172.21.15.172:0/926675686 shutdown_connections 2024-04-25T08:43:34.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.207+0000 7feee9363640 1 -- 172.21.15.172:0/926675686 wait complete. 2024-04-25T08:43:34.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.209+0000 7feee9363640 1 Processor -- start 2024-04-25T08:43:34.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.209+0000 7feee9363640 1 -- start start 2024-04-25T08:43:34.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.209+0000 7feee9363640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feee40ced80 0x7feee40cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.209+0000 7feee9363640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feee415dc20 0x7feee40d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.209+0000 7feee9363640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee4161710 0x7feee4151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.209+0000 7feee9363640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40b5e50 con 0x7feee4161710 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.209+0000 7feee9363640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee4162500 con 0x7feee415dc20 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.209+0000 7feee9363640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40b5fd0 con 0x7feee40ced80 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.209+0000 7feee37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee4161710 0x7feee4151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee4161710 0x7feee4151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45382/0 (socket says 172.21.15.172:45382) 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee37fe640 1 -- 172.21.15.172:0/3676189075 learned_addr learned my addr 172.21.15.172:0/3676189075 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee27fc640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feee415dc20 0x7feee40d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee2ffd640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feee40ced80 0x7feee40cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee37fe640 1 -- 172.21.15.172:0/3676189075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feee40ced80 msgr2=0x7feee40cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee37fe640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feee40ced80 0x7feee40cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee37fe640 1 -- 172.21.15.172:0/3676189075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feee415dc20 msgr2=0x7feee40d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee37fe640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feee415dc20 0x7feee40d2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee37fe640 1 -- 172.21.15.172:0/3676189075 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee40cb620 con 0x7feee4161710 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee27fc640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feee415dc20 0x7feee40d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee37fe640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee4161710 0x7feee4151880 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feedc00cd20 tx=0x7feedc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feecb7fe640 1 -- 172.21.15.172:0/3676189075 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc003b90 con 0x7feee4161710 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feecb7fe640 1 -- 172.21.15.172:0/3676189075 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc003d30 con 0x7feee4161710 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee9363640 1 -- 172.21.15.172:0/3676189075 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee40cb900 con 0x7feee4161710 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feecb7fe640 1 -- 172.21.15.172:0/3676189075 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc004240 con 0x7feee4161710 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.210+0000 7feee9363640 1 -- 172.21.15.172:0/3676189075 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee40cbec0 con 0x7feee4161710 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.211+0000 7feee9363640 1 -- 172.21.15.172:0/3676189075 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee40cc100 con 0x7feee4161710 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.212+0000 7feecb7fe640 1 -- 172.21.15.172:0/3676189075 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feedc0043e0 con 0x7feee4161710 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.212+0000 7feecb7fe640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feed006b4d0 0x7feed006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.212+0000 7feecb7fe640 1 -- 172.21.15.172:0/3676189075 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7feedc08aac0 con 0x7feee4161710 2024-04-25T08:43:34.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.212+0000 7feee2ffd640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feed006b4d0 0x7feed006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.213+0000 7feee2ffd640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feed006b4d0 0x7feed006d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feed4000f60 tx=0x7feed4007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:34.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.216+0000 7feecb7fe640 1 -- 172.21.15.172:0/3676189075 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feee40cc100 con 0x7feee4161710 2024-04-25T08:43:34.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.390+0000 7feee9363640 1 -- 172.21.15.172:0/3676189075 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feee4073a00 con 0x7feee4161710 2024-04-25T08:43:34.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.390+0000 7feecb7fe640 1 -- 172.21.15.172:0/3676189075 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7feedc059b00 con 0x7feee4161710 2024-04-25T08:43:34.382 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:43:34.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 -- 172.21.15.172:0/3676189075 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feed006b4d0 msgr2=0x7feed006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feed006b4d0 0x7feed006d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feed4000f60 tx=0x7feed4007c00 comp rx=0 tx=0).stop 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 -- 172.21.15.172:0/3676189075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee4161710 msgr2=0x7feee4151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee4161710 0x7feee4151880 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feedc00cd20 tx=0x7feedc00a660 comp rx=0 tx=0).stop 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 -- 172.21.15.172:0/3676189075 shutdown_connections 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feed006b4d0 0x7feed006d990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feee415dc20 0x7feee40d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee4161710 0x7feee4151880 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 --2- 172.21.15.172:0/3676189075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feee40ced80 0x7feee40cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 -- 172.21.15.172:0/3676189075 >> 172.21.15.172:0/3676189075 conn(0x7feee40d0420 msgr2=0x7feee40b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 -- 172.21.15.172:0/3676189075 shutdown_connections 2024-04-25T08:43:34.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.392+0000 7feee9363640 1 -- 172.21.15.172:0/3676189075 wait complete. 2024-04-25T08:43:34.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:43:34.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.501+0000 7f6fd129e640 1 Processor -- start 2024-04-25T08:43:34.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.501+0000 7f6fd129e640 1 -- start start 2024-04-25T08:43:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.502+0000 7f6fd129e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6fcc15b870 0x7f6fcc0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.502+0000 7f6fd129e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc0cc5e0 con 0x7f6fcc09a150 2024-04-25T08:43:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.502+0000 7f6fd129e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc0cc8c0 con 0x7f6fcc15bc50 2024-04-25T08:43:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.502+0000 7f6fd129e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc0ccba0 con 0x7f6fcc15b870 2024-04-25T08:43:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.502+0000 7f6fcb7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6fcc09a150 0x7f6fcc0cfdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54176/0 (socket says 172.21.15.172:54176) 2024-04-25T08:43:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.502+0000 7f6fcb7fe640 1 -- 172.21.15.172:0/735752895 learned_addr learned my addr 172.21.15.172:0/735752895 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.502+0000 7f6fcaffd640 1 --2- 172.21.15.172:0/735752895 >> v2:172.21.15.186:3300/0 conn(0x7f6fcc15b870 0x7f6fcc0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.502+0000 7f6fc9ffb640 1 -- 172.21.15.172:0/735752895 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892128925 0 0) 0x7f6fcc0cc5e0 con 0x7f6fcc09a150 2024-04-25T08:43:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.502+0000 7f6fc9ffb640 1 -- 172.21.15.172:0/735752895 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb4003520 con 0x7f6fcc09a150 2024-04-25T08:43:34.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.503+0000 7f6fc9ffb640 1 -- 172.21.15.172:0/735752895 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2083628028 0 0) 0x7f6fb4003520 con 0x7f6fcc09a150 2024-04-25T08:43:34.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.503+0000 7f6fcaffd640 1 -- 172.21.15.172:0/735752895 >> v1:172.21.15.186:6789/0 conn(0x7f6fcc15bc50 legacy=0x7f6fcc099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.503+0000 7f6fcaffd640 1 -- 172.21.15.172:0/735752895 >> v1:172.21.15.172:6789/0 conn(0x7f6fcc09a150 legacy=0x7f6fcc0cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.503+0000 7f6fcaffd640 1 -- 172.21.15.172:0/735752895 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0cce80 con 0x7f6fcc15b870 2024-04-25T08:43:34.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.503+0000 7f6fcaffd640 1 --2- 172.21.15.172:0/735752895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc15b870 0x7f6fcc0cd680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0097a0 tx=0x7f6fbc02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc49078fcbfeb48b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:34.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.504+0000 7f6fc9ffb640 1 -- 172.21.15.172:0/735752895 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc037070 con 0x7f6fcc15b870 2024-04-25T08:43:34.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.504+0000 7f6fc9ffb640 1 -- 172.21.15.172:0/735752895 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc02abc0 con 0x7f6fcc15b870 2024-04-25T08:43:34.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.504+0000 7f6fc9ffb640 1 -- 172.21.15.172:0/735752895 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40019f0 con 0x7f6fcc15b870 2024-04-25T08:43:34.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.504+0000 7f6fd129e640 1 -- 172.21.15.172:0/735752895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc15b870 msgr2=0x7f6fcc0cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.504+0000 7f6fd129e640 1 --2- 172.21.15.172:0/735752895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc15b870 0x7f6fcc0cd680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0097a0 tx=0x7f6fbc02a130 comp rx=0 tx=0).stop 2024-04-25T08:43:34.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.504+0000 7f6fd129e640 1 -- 172.21.15.172:0/735752895 shutdown_connections 2024-04-25T08:43:34.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.504+0000 7f6fd129e640 1 --2- 172.21.15.172:0/735752895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc15b870 0x7f6fcc0cd680 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.504+0000 7f6fd129e640 1 -- 172.21.15.172:0/735752895 >> 172.21.15.172:0/735752895 conn(0x7f6fcc0b3270 msgr2=0x7f6fcc0b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:34.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.504+0000 7f6fd129e640 1 -- 172.21.15.172:0/735752895 shutdown_connections 2024-04-25T08:43:34.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.504+0000 7f6fd129e640 1 -- 172.21.15.172:0/735752895 wait complete. 2024-04-25T08:43:34.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.505+0000 7f6fd129e640 1 Processor -- start 2024-04-25T08:43:34.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.505+0000 7f6fd129e640 1 -- start start 2024-04-25T08:43:34.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fd129e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc09a150 0x7f6fcc154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fd129e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fcc15b870 0x7f6fcc158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fd129e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6fcc15bc50 0x7f6fcc15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fd129e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0cdbc0 con 0x7f6fcc15b870 2024-04-25T08:43:34.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fd129e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0cc290 con 0x7f6fcc09a150 2024-04-25T08:43:34.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fd129e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0cdd40 con 0x7f6fcc15bc50 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fca7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fcc15b870 0x7f6fcc158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fca7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fcc15b870 0x7f6fcc158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45390/0 (socket says 172.21.15.172:45390) 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fca7fc640 1 -- 172.21.15.172:0/3182475320 learned_addr learned my addr 172.21.15.172:0/3182475320 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fca7fc640 1 -- 172.21.15.172:0/3182475320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6fcc15bc50 msgr2=0x7f6fcc15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.506+0000 7f6fca7fc640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6fcc15bc50 0x7f6fcc15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.507+0000 7f6fca7fc640 1 -- 172.21.15.172:0/3182475320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc09a150 msgr2=0x7f6fcc154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.507+0000 7f6fca7fc640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc09a150 0x7f6fcc154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.507+0000 7f6fca7fc640 1 -- 172.21.15.172:0/3182475320 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc155dd0 con 0x7f6fcc15b870 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.507+0000 7f6fca7fc640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fcc15b870 0x7f6fcc158110 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000c400 tx=0x7f6fc000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.507+0000 7f6fb37fe640 1 -- 172.21.15.172:0/3182475320 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0017070 con 0x7f6fcc15b870 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.507+0000 7f6fb37fe640 1 -- 172.21.15.172:0/3182475320 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc00052d0 con 0x7f6fcc15b870 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.507+0000 7f6fd129e640 1 -- 172.21.15.172:0/3182475320 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc0c8aa0 con 0x7f6fcc15b870 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.507+0000 7f6fb37fe640 1 -- 172.21.15.172:0/3182475320 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0003830 con 0x7f6fcc15b870 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.507+0000 7f6fd129e640 1 -- 172.21.15.172:0/3182475320 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc0c9060 con 0x7f6fcc15b870 2024-04-25T08:43:34.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.508+0000 7f6fd129e640 1 -- 172.21.15.172:0/3182475320 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc0c8830 con 0x7f6fcc15b870 2024-04-25T08:43:34.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.508+0000 7f6fb37fe640 1 -- 172.21.15.172:0/3182475320 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fc001a070 con 0x7f6fcc15b870 2024-04-25T08:43:34.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.509+0000 7f6fb37fe640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fb806b500 0x7f6fb806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.509+0000 7f6fcaffd640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fb806b500 0x7f6fb806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.509+0000 7f6fb37fe640 1 -- 172.21.15.172:0/3182475320 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f6fc0089480 con 0x7f6fcc15b870 2024-04-25T08:43:34.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.509+0000 7f6fcaffd640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fb806b500 0x7f6fb806d9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc034000 tx=0x7f6fbc02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:34.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.513+0000 7f6fb37fe640 1 -- 172.21.15.172:0/3182475320 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6fc0058440 con 0x7f6fcc15b870 2024-04-25T08:43:34.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.685+0000 7f6fd129e640 1 -- 172.21.15.172:0/3182475320 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6fcc0c5050 con 0x7f6fcc15b870 2024-04-25T08:43:34.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.685+0000 7f6fb37fe640 1 -- 172.21.15.172:0/3182475320 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6fc0057d40 con 0x7f6fcc15b870 2024-04-25T08:43:34.677 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:34.677 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:43:34.678 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:43:34.678 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2024-04-25T08:43:34.678 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2024-04-25T08:43:34.678 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:43:34.678 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:43:34.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 -- 172.21.15.172:0/3182475320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fb806b500 msgr2=0x7f6fb806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fb806b500 0x7f6fb806d9c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc034000 tx=0x7f6fbc02c000 comp rx=0 tx=0).stop 2024-04-25T08:43:34.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 -- 172.21.15.172:0/3182475320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fcc15b870 msgr2=0x7f6fcc158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fcc15b870 0x7f6fcc158110 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000c400 tx=0x7f6fc000c8c0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 -- 172.21.15.172:0/3182475320 shutdown_connections 2024-04-25T08:43:34.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fb806b500 0x7f6fb806d9c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6fcc15bc50 0x7f6fcc15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fcc15b870 0x7f6fcc158110 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 --2- 172.21.15.172:0/3182475320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6fcc09a150 0x7f6fcc154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 -- 172.21.15.172:0/3182475320 >> 172.21.15.172:0/3182475320 conn(0x7f6fcc0b3270 msgr2=0x7f6fcc06f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:34.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 -- 172.21.15.172:0/3182475320 shutdown_connections 2024-04-25T08:43:34.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.687+0000 7f6fd129e640 1 -- 172.21.15.172:0/3182475320 wait complete. 2024-04-25T08:43:34.690 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:43:34.690 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:43:34.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.798+0000 7f1e840b6640 1 Processor -- start 2024-04-25T08:43:34.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.799+0000 7f1e840b6640 1 -- start start 2024-04-25T08:43:34.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.799+0000 7f1e840b6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c0c6010 0x7f1e7c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.799+0000 7f1e840b6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1e7c0cd520 0x7f1e7c0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.799+0000 7f1e840b6640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c0c6940 con 0x7f1e7c15a9f0 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.799+0000 7f1e840b6640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c0b0020 con 0x7f1e7c0cd520 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.799+0000 7f1e840b6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cb5a0 con 0x7f1e7c0c6010 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e81e52640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1e7c15a9f0 0x7f1e7c0cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54188/0 (socket says 172.21.15.172:54188) 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e81e52640 1 -- 172.21.15.172:0/767125899 learned_addr learned my addr 172.21.15.172:0/767125899 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e82653640 1 --2- 172.21.15.172:0/767125899 >> v2:172.21.15.186:3300/0 conn(0x7f1e7c0cd520 0x7f1e7c0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679993105 0 0) 0x7f1e74001490 con 0x7f1e7c15a9f0 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e81651640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c0c6010 0x7f1e7c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e64003520 con 0x7f1e7c15a9f0 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3948581181 0 0) 0x7f1e64003520 con 0x7f1e7c15a9f0 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c0c6010 msgr2=0x7f1e7c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:34.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c0c6010 0x7f1e7c0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 >> v2:172.21.15.186:3300/0 conn(0x7f1e7c0cd520 msgr2=0x7f1e7c0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 --2- 172.21.15.172:0/767125899 >> v2:172.21.15.186:3300/0 conn(0x7f1e7c0cd520 0x7f1e7c0cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c15add0 con 0x7f1e7c15a9f0 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f1e74001bc0 con 0x7f1e7c15a9f0 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 >> v1:172.21.15.172:6789/0 conn(0x7f1e7c15a9f0 legacy=0x7f1e7c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c0c6010 0x7f1e640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e64003f30 0x7f1e64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64004d40 0x7f1e640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cb5a0 con 0x7f1e64004d40 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6400b9c0 con 0x7f1e64003f30 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6400bb40 con 0x7f1e7c0c6010 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e82653640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64004d40 0x7f1e640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e81e52640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c0c6010 0x7f1e640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.800+0000 7f1e81651640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e64003f30 0x7f1e64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.801+0000 7f1e82653640 1 -- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c0c6010 msgr2=0x7f1e640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:34.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.801+0000 7f1e82653640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c0c6010 0x7f1e640039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.801+0000 7f1e82653640 1 -- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e64003f30 msgr2=0x7f1e64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:34.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.801+0000 7f1e82653640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e64003f30 0x7f1e64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.801+0000 7f1e82653640 1 -- 172.21.15.172:0/767125899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64003520 con 0x7f1e64004d40 2024-04-25T08:43:34.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.801+0000 7f1e82653640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64004d40 0x7f1e640051c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009ac0 tx=0x7f1e64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432424ce67495903 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:34.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.801+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c036070 con 0x7f1e64004d40 2024-04-25T08:43:34.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.801+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c031400 con 0x7f1e64004d40 2024-04-25T08:43:34.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.801+0000 7f1e80e50640 1 -- 172.21.15.172:0/767125899 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c009690 con 0x7f1e64004d40 2024-04-25T08:43:34.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.802+0000 7f1e840b6640 1 -- 172.21.15.172:0/767125899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64004d40 msgr2=0x7f1e640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.802+0000 7f1e840b6640 1 --2- 172.21.15.172:0/767125899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e64004d40 0x7f1e640051c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009ac0 tx=0x7f1e64005830 comp rx=0 tx=0).stop 2024-04-25T08:43:34.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.802+0000 7f1e82653640 1 -- 172.21.15.172:0/767125899 reap_dead start 2024-04-25T08:43:34.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.802+0000 7f1e840b6640 1 -- 172.21.15.172:0/767125899 shutdown_connections 2024-04-25T08:43:34.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.802+0000 7f1e840b6640 1 -- 172.21.15.172:0/767125899 >> 172.21.15.172:0/767125899 conn(0x7f1e7c0b2390 msgr2=0x7f1e7c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:34.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.802+0000 7f1e840b6640 1 -- 172.21.15.172:0/767125899 shutdown_connections 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.802+0000 7f1e840b6640 1 -- 172.21.15.172:0/767125899 wait complete. 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.803+0000 7f1e840b6640 1 Processor -- start 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.803+0000 7f1e840b6640 1 -- start start 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e840b6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c14be70 0x7f1e7c15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e840b6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e7c15bee0 0x7f1e7c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e840b6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c15daa0 0x7f1e7c0b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e840b6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cb230 con 0x7f1e7c14be70 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e840b6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0caf50 con 0x7f1e7c15bee0 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e840b6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0ccfe0 con 0x7f1e7c15daa0 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e81e52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c14be70 0x7f1e7c15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e81e52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c14be70 0x7f1e7c15b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45412/0 (socket says 172.21.15.172:45412) 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e81e52640 1 -- 172.21.15.172:0/1217277226 learned_addr learned my addr 172.21.15.172:0/1217277226 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e82653640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c15daa0 0x7f1e7c0b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e81651640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e7c15bee0 0x7f1e7c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e81e52640 1 -- 172.21.15.172:0/1217277226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c15daa0 msgr2=0x7f1e7c0b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e81e52640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c15daa0 0x7f1e7c0b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e81e52640 1 -- 172.21.15.172:0/1217277226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e7c15bee0 msgr2=0x7f1e7c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e81e52640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e7c15bee0 0x7f1e7c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.804+0000 7f1e81e52640 1 -- 172.21.15.172:0/1217277226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c14c5c0 con 0x7f1e7c14be70 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.805+0000 7f1e81e52640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c14be70 0x7f1e7c15b9a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1e74007140 tx=0x7f1e74007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.805+0000 7f1e7a7fc640 1 -- 172.21.15.172:0/1217277226 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400f5e0 con 0x7f1e7c14be70 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.805+0000 7f1e7a7fc640 1 -- 172.21.15.172:0/1217277226 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74018070 con 0x7f1e7c14be70 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.805+0000 7f1e840b6640 1 -- 172.21.15.172:0/1217277226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c15c560 con 0x7f1e7c14be70 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.805+0000 7f1e7a7fc640 1 -- 172.21.15.172:0/1217277226 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400f9c0 con 0x7f1e7c14be70 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.805+0000 7f1e840b6640 1 -- 172.21.15.172:0/1217277226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c14ccc0 con 0x7f1e7c14be70 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.806+0000 7f1e840b6640 1 -- 172.21.15.172:0/1217277226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c06cc80 con 0x7f1e7c14be70 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.806+0000 7f1e7a7fc640 1 -- 172.21.15.172:0/1217277226 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1e7400fb60 con 0x7f1e7c14be70 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.806+0000 7f1e7a7fc640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1e6806b4d0 0x7f1e6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.807+0000 7f1e7a7fc640 1 -- 172.21.15.172:0/1217277226 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1e7408ac90 con 0x7f1e7c14be70 2024-04-25T08:43:34.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.807+0000 7f1e81651640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1e6806b4d0 0x7f1e6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:34.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.807+0000 7f1e81651640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1e6806b4d0 0x7f1e6806d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0cecd0 tx=0x7f1e70008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:34.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.811+0000 7f1e7a7fc640 1 -- 172.21.15.172:0/1217277226 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e7c0c6940 con 0x7f1e7c14be70 2024-04-25T08:43:34.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:34.982+0000 7f1e840b6640 1 -- 172.21.15.172:0/1217277226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1e7c073a00 con 0x7f1e7c14be70 2024-04-25T08:43:35.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.347+0000 7f1e7a7fc640 1 -- 172.21.15.172:0/1217277226 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1e74059d60 con 0x7f1e7c14be70 2024-04-25T08:43:35.340 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2024-04-25T08:43:35.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 -- 172.21.15.172:0/1217277226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1e6806b4d0 msgr2=0x7f1e6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:35.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1e6806b4d0 0x7f1e6806d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0cecd0 tx=0x7f1e70008040 comp rx=0 tx=0).stop 2024-04-25T08:43:35.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 -- 172.21.15.172:0/1217277226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c14be70 msgr2=0x7f1e7c15b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:35.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c14be70 0x7f1e7c15b9a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1e74007140 tx=0x7f1e74007600 comp rx=0 tx=0).stop 2024-04-25T08:43:35.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 -- 172.21.15.172:0/1217277226 shutdown_connections 2024-04-25T08:43:35.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1e6806b4d0 0x7f1e6806d990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:35.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e7c15bee0 0x7f1e7c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:35.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1e7c15daa0 0x7f1e7c0b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:35.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 --2- 172.21.15.172:0/1217277226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e7c14be70 0x7f1e7c15b9a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:35.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 -- 172.21.15.172:0/1217277226 >> 172.21.15.172:0/1217277226 conn(0x7f1e7c0b2390 msgr2=0x7f1e7c0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:35.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 -- 172.21.15.172:0/1217277226 shutdown_connections 2024-04-25T08:43:35.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.350+0000 7f1e840b6640 1 -- 172.21.15.172:0/1217277226 wait complete. 2024-04-25T08:43:35.356 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:43:35.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.468+0000 7f28780e1640 1 Processor -- start 2024-04-25T08:43:35.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.468+0000 7f28780e1640 1 -- start start 2024-04-25T08:43:35.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.469+0000 7f28780e1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f28700cc4f0 0x7f28700cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:35.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.469+0000 7f28780e1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2870072280 con 0x7f28700cdb20 2024-04-25T08:43:35.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.469+0000 7f28780e1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28700714c0 con 0x7f287015b980 2024-04-25T08:43:35.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.469+0000 7f28780e1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2870071270 con 0x7f28700cc4f0 2024-04-25T08:43:35.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.469+0000 7f287567c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f28700cdb20 0x7f287015b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54194/0 (socket says 172.21.15.172:54194) 2024-04-25T08:43:35.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.469+0000 7f287567c640 1 -- 172.21.15.172:0/703725707 learned_addr learned my addr 172.21.15.172:0/703725707 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:35.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714258048 0 0) 0x7f2870072280 con 0x7f28700cdb20 2024-04-25T08:43:35.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f285c003520 con 0x7f28700cdb20 2024-04-25T08:43:35.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2875e7d640 1 --2- 172.21.15.172:0/703725707 >> v2:172.21.15.186:3300/0 conn(0x7f28700cc4f0 0x7f28700cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3806488884 0 0) 0x7f285c003520 con 0x7f28700cdb20 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 >> v2:172.21.15.186:3300/0 conn(0x7f28700cc4f0 msgr2=0x7f28700cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 --2- 172.21.15.172:0/703725707 >> v2:172.21.15.186:3300/0 conn(0x7f28700cc4f0 0x7f28700cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 >> v1:172.21.15.186:6789/0 conn(0x7f287015b980 legacy=0x7f28700ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700717a0 con 0x7f28700cdb20 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f2860001670 con 0x7f28700cdb20 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 >> v1:172.21.15.172:6789/0 conn(0x7f28700cdb20 legacy=0x7f287015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285c003a00 0x7f285c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f285c004800 0x7f285c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f285c0051c0 0x7f285c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870071270 con 0x7f285c003a00 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c00e2d0 con 0x7f285c004800 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c00c110 con 0x7f285c0051c0 2024-04-25T08:43:35.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2875e7d640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285c003a00 0x7f285c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f287567c640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f285c004800 0x7f285c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f287667e640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f285c0051c0 0x7f285c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2875e7d640 1 -- 172.21.15.172:0/703725707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f285c0051c0 msgr2=0x7f285c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2875e7d640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f285c0051c0 0x7f285c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2875e7d640 1 -- 172.21.15.172:0/703725707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f285c004800 msgr2=0x7f285c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2875e7d640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f285c004800 0x7f285c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f2875e7d640 1 -- 172.21.15.172:0/703725707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c003520 con 0x7f285c003a00 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.470+0000 7f287667e640 1 -- 172.21.15.172:0/703725707 reap_dead start 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.471+0000 7f2875e7d640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285c003a00 0x7f285c003e20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f286c009fc0 tx=0x7f285c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb609a1498de244 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.471+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c009c10 con 0x7f285c003a00 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.471+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c036070 con 0x7f285c003a00 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.471+0000 7f2874e7b640 1 -- 172.21.15.172:0/703725707 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c031880 con 0x7f285c003a00 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.472+0000 7f28780e1640 1 -- 172.21.15.172:0/703725707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285c003a00 msgr2=0x7f285c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.472+0000 7f28780e1640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285c003a00 0x7f285c003e20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f286c009fc0 tx=0x7f285c005830 comp rx=0 tx=0).stop 2024-04-25T08:43:35.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.472+0000 7f28780e1640 1 -- 172.21.15.172:0/703725707 shutdown_connections 2024-04-25T08:43:35.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.472+0000 7f28780e1640 1 --2- 172.21.15.172:0/703725707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285c003a00 0x7f285c003e20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:35.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.472+0000 7f28780e1640 1 -- 172.21.15.172:0/703725707 >> 172.21.15.172:0/703725707 conn(0x7f287006abe0 msgr2=0x7f287006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:35.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.472+0000 7f28780e1640 1 -- 172.21.15.172:0/703725707 shutdown_connections 2024-04-25T08:43:35.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.472+0000 7f28780e1640 1 -- 172.21.15.172:0/703725707 wait complete. 2024-04-25T08:43:35.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.473+0000 7f28780e1640 1 Processor -- start 2024-04-25T08:43:35.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.473+0000 7f28780e1640 1 -- start start 2024-04-25T08:43:35.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f28780e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f285c003a00 0x7f287013daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:35.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f28780e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f287013e310 0x7f287013e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:35.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f28780e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2870153ef0 0x7f2870154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:35.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f28780e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870071d60 con 0x7f2870153ef0 2024-04-25T08:43:35.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f28780e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287015bd80 con 0x7f287013e310 2024-04-25T08:43:35.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f28780e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28700cc8d0 con 0x7f285c003a00 2024-04-25T08:43:35.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287667e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2870153ef0 0x7f2870154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:35.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287667e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2870153ef0 0x7f2870154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45440/0 (socket says 172.21.15.172:45440) 2024-04-25T08:43:35.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287667e640 1 -- 172.21.15.172:0/4286781181 learned_addr learned my addr 172.21.15.172:0/4286781181 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:35.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287567c640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f287013e310 0x7f287013e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:35.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f2875e7d640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f285c003a00 0x7f287013daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287667e640 1 -- 172.21.15.172:0/4286781181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f285c003a00 msgr2=0x7f287013daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287667e640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f285c003a00 0x7f287013daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287667e640 1 -- 172.21.15.172:0/4286781181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f287013e310 msgr2=0x7f287013e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287667e640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f287013e310 0x7f287013e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287667e640 1 -- 172.21.15.172:0/4286781181 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287013dfe0 con 0x7f2870153ef0 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f2875e7d640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f285c003a00 0x7f287013daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287567c640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f287013e310 0x7f287013e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.474+0000 7f287667e640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2870153ef0 0x7f2870154370 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f287006b930 tx=0x7f286800f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.475+0000 7f28667fc640 1 -- 172.21.15.172:0/4286781181 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680052e0 con 0x7f2870153ef0 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.475+0000 7f28667fc640 1 -- 172.21.15.172:0/4286781181 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2868018070 con 0x7f2870153ef0 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.475+0000 7f28780e1640 1 -- 172.21.15.172:0/4286781181 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287014e680 con 0x7f2870153ef0 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.475+0000 7f28667fc640 1 -- 172.21.15.172:0/4286781181 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868003830 con 0x7f2870153ef0 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.475+0000 7f28780e1640 1 -- 172.21.15.172:0/4286781181 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287013f160 con 0x7f2870153ef0 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.476+0000 7f28780e1640 1 -- 172.21.15.172:0/4286781181 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2870073a00 con 0x7f2870153ef0 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.476+0000 7f28667fc640 1 -- 172.21.15.172:0/4286781181 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f28680039d0 con 0x7f2870153ef0 2024-04-25T08:43:35.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.476+0000 7f28667fc640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f285406b4d0 0x7f285406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:35.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.477+0000 7f28667fc640 1 -- 172.21.15.172:0/4286781181 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f2868089c40 con 0x7f2870153ef0 2024-04-25T08:43:35.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.477+0000 7f2875e7d640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f285406b4d0 0x7f285406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:35.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.477+0000 7f2875e7d640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f285406b4d0 0x7f285406d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f286c035000 tx=0x7f286c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:35.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.481+0000 7f28667fc640 1 -- 172.21.15.172:0/4286781181 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2868058b10 con 0x7f2870153ef0 2024-04-25T08:43:35.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:35.653+0000 7f28780e1640 1 -- 172.21.15.172:0/4286781181 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f287006d3a0 con 0x7f2870153ef0 2024-04-25T08:43:36.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.350+0000 7f28667fc640 1 -- 172.21.15.172:0/4286781181 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2868058410 con 0x7f2870153ef0 2024-04-25T08:43:36.342 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2024-04-25T08:43:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 -- 172.21.15.172:0/4286781181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f285406b4d0 msgr2=0x7f285406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f285406b4d0 0x7f285406d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f286c035000 tx=0x7f286c02f000 comp rx=0 tx=0).stop 2024-04-25T08:43:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 -- 172.21.15.172:0/4286781181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2870153ef0 msgr2=0x7f2870154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2870153ef0 0x7f2870154370 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f287006b930 tx=0x7f286800f900 comp rx=0 tx=0).stop 2024-04-25T08:43:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 -- 172.21.15.172:0/4286781181 shutdown_connections 2024-04-25T08:43:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f285406b4d0 0x7f285406d990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f287013e310 0x7f287013e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2870153ef0 0x7f2870154370 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 --2- 172.21.15.172:0/4286781181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f285c003a00 0x7f287013daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 -- 172.21.15.172:0/4286781181 >> 172.21.15.172:0/4286781181 conn(0x7f287006abe0 msgr2=0x7f287006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:36.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 -- 172.21.15.172:0/4286781181 shutdown_connections 2024-04-25T08:43:36.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.353+0000 7f28780e1640 1 -- 172.21.15.172:0/4286781181 wait complete. 2024-04-25T08:43:36.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:43:36.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.477+0000 7fa7d6e58640 1 Processor -- start 2024-04-25T08:43:36.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.477+0000 7fa7d6e58640 1 -- start start 2024-04-25T08:43:36.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d6e58640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa7d006abe0 0x7fa7d006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:36.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d6e58640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa7d00ad570 0x7fa7d006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:36.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d6e58640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d006b500 con 0x7fa7d015dd80 2024-04-25T08:43:36.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d6e58640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d006e410 con 0x7fa7d006abe0 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d6e58640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00b3930 con 0x7fa7d00ad570 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d4bf4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa7d006abe0 0x7fa7d006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d4bf4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa7d006abe0 0x7fa7d006afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45452/0 (socket says 172.21.15.172:45452) 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d4bf4640 1 -- 172.21.15.172:0/553027533 learned_addr learned my addr 172.21.15.172:0/553027533 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d53f5640 1 --2- 172.21.15.172:0/553027533 >> v2:172.21.15.186:3300/0 conn(0x7fa7d00ad570 0x7fa7d006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d4bf4640 1 -- 172.21.15.172:0/553027533 >> v2:172.21.15.186:3300/0 conn(0x7fa7d00ad570 msgr2=0x7fa7d006ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.478+0000 7fa7d4bf4640 1 --2- 172.21.15.172:0/553027533 >> v2:172.21.15.186:3300/0 conn(0x7fa7d00ad570 0x7fa7d006ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.479+0000 7fa7d4bf4640 1 -- 172.21.15.172:0/553027533 >> v1:172.21.15.186:6789/0 conn(0x7fa7d015dd80 legacy=0x7fa7d00b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.479+0000 7fa7d4bf4640 1 -- 172.21.15.172:0/553027533 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00b3c10 con 0x7fa7d006abe0 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.479+0000 7fa7d4bf4640 1 --2- 172.21.15.172:0/553027533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d006abe0 0x7fa7d006afc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa7d006e590 tx=0x7fa7c002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254f99df04c04108 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.479+0000 7fa7cf7fe640 1 -- 172.21.15.172:0/553027533 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0037070 con 0x7fa7d006abe0 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.479+0000 7fa7cf7fe640 1 -- 172.21.15.172:0/553027533 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c0032440 con 0x7fa7d006abe0 2024-04-25T08:43:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.479+0000 7fa7cf7fe640 1 -- 172.21.15.172:0/553027533 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0032810 con 0x7fa7d006abe0 2024-04-25T08:43:36.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.480+0000 7fa7d6e58640 1 -- 172.21.15.172:0/553027533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d006abe0 msgr2=0x7fa7d006afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:36.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.480+0000 7fa7d6e58640 1 --2- 172.21.15.172:0/553027533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d006abe0 0x7fa7d006afc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa7d006e590 tx=0x7fa7c002a210 comp rx=0 tx=0).stop 2024-04-25T08:43:36.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.480+0000 7fa7d6e58640 1 -- 172.21.15.172:0/553027533 shutdown_connections 2024-04-25T08:43:36.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.480+0000 7fa7d6e58640 1 --2- 172.21.15.172:0/553027533 >> v2:172.21.15.186:3300/0 conn(0x7fa7d00ad570 0x7fa7d006ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:36.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.480+0000 7fa7d6e58640 1 --2- 172.21.15.172:0/553027533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d006abe0 0x7fa7d006afc0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:36.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.480+0000 7fa7d6e58640 1 -- 172.21.15.172:0/553027533 >> 172.21.15.172:0/553027533 conn(0x7fa7d00b5af0 msgr2=0x7fa7d00b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:36.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.480+0000 7fa7d6e58640 1 -- 172.21.15.172:0/553027533 shutdown_connections 2024-04-25T08:43:36.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.480+0000 7fa7d6e58640 1 -- 172.21.15.172:0/553027533 wait complete. 2024-04-25T08:43:36.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.481+0000 7fa7d6e58640 1 Processor -- start 2024-04-25T08:43:36.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.481+0000 7fa7d6e58640 1 -- start start 2024-04-25T08:43:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7d6e58640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d006abe0 0x7fa7d0156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7d6e58640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d00ad570 0x7fa7d0155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7d6e58640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7d015dd80 0x7fa7d01f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7d6e58640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0070280 con 0x7fa7d00ad570 2024-04-25T08:43:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7d6e58640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d006e940 con 0x7fa7d006abe0 2024-04-25T08:43:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7d6e58640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0070400 con 0x7fa7d015dd80 2024-04-25T08:43:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7cffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d00ad570 0x7fa7d0155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7cffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d00ad570 0x7fa7d0155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45466/0 (socket says 172.21.15.172:45466) 2024-04-25T08:43:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7cffff640 1 -- 172.21.15.172:0/4125551327 learned_addr learned my addr 172.21.15.172:0/4125551327 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7d53f5640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7d015dd80 0x7fa7d01f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7d4bf4640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d006abe0 0x7fa7d0156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7cffff640 1 -- 172.21.15.172:0/4125551327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7d015dd80 msgr2=0x7fa7d01f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7cffff640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7d015dd80 0x7fa7d01f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7cffff640 1 -- 172.21.15.172:0/4125551327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d006abe0 msgr2=0x7fa7d0156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7cffff640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d006abe0 0x7fa7d0156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.482+0000 7fa7cffff640 1 -- 172.21.15.172:0/4125551327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d01f4be0 con 0x7fa7d00ad570 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.483+0000 7fa7cffff640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d00ad570 0x7fa7d0155140 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400b3c0 tx=0x7fa7c400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.483+0000 7fa7cd7fa640 1 -- 172.21.15.172:0/4125551327 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4011830 con 0x7fa7d00ad570 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.483+0000 7fa7cd7fa640 1 -- 172.21.15.172:0/4125551327 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4016070 con 0x7fa7d00ad570 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.483+0000 7fa7d6e58640 1 -- 172.21.15.172:0/4125551327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d015a4f0 con 0x7fa7d00ad570 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.483+0000 7fa7cd7fa640 1 -- 172.21.15.172:0/4125551327 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4011c50 con 0x7fa7d00ad570 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.483+0000 7fa7d6e58640 1 -- 172.21.15.172:0/4125551327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d015aab0 con 0x7fa7d00ad570 2024-04-25T08:43:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.484+0000 7fa7d6e58640 1 -- 172.21.15.172:0/4125551327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d0073a00 con 0x7fa7d00ad570 2024-04-25T08:43:36.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.484+0000 7fa7cd7fa640 1 -- 172.21.15.172:0/4125551327 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa7c401b460 con 0x7fa7d00ad570 2024-04-25T08:43:36.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.485+0000 7fa7cd7fa640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa7bc06b4d0 0x7fa7bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:36.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.485+0000 7fa7cd7fa640 1 -- 172.21.15.172:0/4125551327 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fa7c4089bb0 con 0x7fa7d00ad570 2024-04-25T08:43:36.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.485+0000 7fa7d4bf4640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa7bc06b4d0 0x7fa7bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:36.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.485+0000 7fa7d4bf4640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa7bc06b4d0 0x7fa7bc06d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0034000 tx=0x7fa7c002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:36.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.489+0000 7fa7cd7fa640 1 -- 172.21.15.172:0/4125551327 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa7c4020020 con 0x7fa7d00ad570 2024-04-25T08:43:36.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:36.705+0000 7fa7d6e58640 1 -- 172.21.15.172:0/4125551327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa7d015a1a0 con 0x7fa7d00ad570 2024-04-25T08:43:37.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.372+0000 7fa7cd7fa640 1 -- 172.21.15.172:0/4125551327 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa7d01f4be0 con 0x7fa7d00ad570 2024-04-25T08:43:37.364 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 5 and data pool 6 2024-04-25T08:43:37.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.383+0000 7fa7d6e58640 1 -- 172.21.15.172:0/4125551327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa7bc06b4d0 msgr2=0x7fa7bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.384+0000 7fa7d6e58640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa7bc06b4d0 0x7fa7bc06d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0034000 tx=0x7fa7c002e000 comp rx=0 tx=0).stop 2024-04-25T08:43:37.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.384+0000 7fa7d6e58640 1 -- 172.21.15.172:0/4125551327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d00ad570 msgr2=0x7fa7d0155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.384+0000 7fa7d6e58640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d00ad570 0x7fa7d0155140 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400b3c0 tx=0x7fa7c400b880 comp rx=0 tx=0).stop 2024-04-25T08:43:37.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.386+0000 7fa7d6e58640 1 -- 172.21.15.172:0/4125551327 shutdown_connections 2024-04-25T08:43:37.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.386+0000 7fa7d6e58640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa7bc06b4d0 0x7fa7bc06d990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.387+0000 7fa7d6e58640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7d015dd80 0x7fa7d01f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.387+0000 7fa7d6e58640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d00ad570 0x7fa7d0155140 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.387+0000 7fa7d6e58640 1 --2- 172.21.15.172:0/4125551327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7d006abe0 0x7fa7d0156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.387+0000 7fa7d6e58640 1 -- 172.21.15.172:0/4125551327 >> 172.21.15.172:0/4125551327 conn(0x7fa7d00b5af0 msgr2=0x7fa7d006ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:37.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.390+0000 7fa7d6e58640 1 -- 172.21.15.172:0/4125551327 shutdown_connections 2024-04-25T08:43:37.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.390+0000 7fa7d6e58640 1 -- 172.21.15.172:0/4125551327 wait complete. 2024-04-25T08:43:37.399 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.507+0000 7f918781c640 1 Processor -- start 2024-04-25T08:43:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.507+0000 7f918781c640 1 -- start start 2024-04-25T08:43:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.508+0000 7f918781c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f918013d190 0x7f91800cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.508+0000 7f918781c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9180071ed0 con 0x7f918015b320 2024-04-25T08:43:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.508+0000 7f918781c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918015a840 con 0x7f9180071940 2024-04-25T08:43:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.508+0000 7f918781c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f918013d570 con 0x7f918013d190 2024-04-25T08:43:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.508+0000 7f9184db7640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f918015b320 0x7f9180071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42654/0 (socket says 172.21.15.172:42654) 2024-04-25T08:43:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.508+0000 7f9184db7640 1 -- 172.21.15.172:0/3583952713 learned_addr learned my addr 172.21.15.172:0/3583952713 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.508+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288808680 0 0) 0x7f9180071ed0 con 0x7f918015b320 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.508+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f916c003520 con 0x7f918015b320 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.508+0000 7f91855b8640 1 --2- 172.21.15.172:0/3583952713 >> v2:172.21.15.186:3300/0 conn(0x7f918013d190 0x7f91800cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3993819392 0 0) 0x7f916c003520 con 0x7f918015b320 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 >> v2:172.21.15.186:3300/0 conn(0x7f918013d190 msgr2=0x7f91800cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 --2- 172.21.15.172:0/3583952713 >> v2:172.21.15.186:3300/0 conn(0x7f918013d190 0x7f91800cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 >> v1:172.21.15.186:6789/0 conn(0x7f9180071940 legacy=0x7f918015dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918015ab20 con 0x7f918015b320 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f9170001670 con 0x7f918015b320 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 >> v1:172.21.15.172:6789/0 conn(0x7f918015b320 legacy=0x7f9180071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f916c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f916c004800 0x7f916c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f916c0051c0 0x7f916c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918013d570 con 0x7f916c0039b0 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c00c160 con 0x7f916c0051c0 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c00c360 con 0x7f916c004800 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f91855b8640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f916c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9185db9640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f916c0051c0 0x7f916c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9184db7640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f916c004800 0x7f916c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f91855b8640 1 -- 172.21.15.172:0/3583952713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f916c004800 msgr2=0x7f916c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f91855b8640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f916c004800 0x7f916c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f91855b8640 1 -- 172.21.15.172:0/3583952713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f916c0051c0 msgr2=0x7f916c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f91855b8640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f916c0051c0 0x7f916c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9185db9640 1 -- 172.21.15.172:0/3583952713 reap_dead start 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f91855b8640 1 -- 172.21.15.172:0/3583952713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c003520 con 0x7f916c0039b0 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.509+0000 7f9184db7640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f916c004800 0x7f916c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.510+0000 7f91855b8640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f916c003dd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f917c00f270 tx=0x7f916c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92dd9ef95c6c02d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.510+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c034020 con 0x7f916c0039b0 2024-04-25T08:43:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.510+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c00a0d0 con 0x7f916c0039b0 2024-04-25T08:43:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.510+0000 7f9177fff640 1 -- 172.21.15.172:0/3583952713 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c00ad20 con 0x7f916c0039b0 2024-04-25T08:43:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.511+0000 7f918781c640 1 -- 172.21.15.172:0/3583952713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 msgr2=0x7f916c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.511+0000 7f918781c640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f916c003dd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f917c00f270 tx=0x7f916c005830 comp rx=0 tx=0).stop 2024-04-25T08:43:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.511+0000 7f918781c640 1 -- 172.21.15.172:0/3583952713 shutdown_connections 2024-04-25T08:43:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.511+0000 7f918781c640 1 --2- 172.21.15.172:0/3583952713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f916c003dd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.511+0000 7f918781c640 1 -- 172.21.15.172:0/3583952713 >> 172.21.15.172:0/3583952713 conn(0x7f918006abe0 msgr2=0x7f918006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.511+0000 7f918781c640 1 -- 172.21.15.172:0/3583952713 shutdown_connections 2024-04-25T08:43:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.511+0000 7f918781c640 1 -- 172.21.15.172:0/3583952713 wait complete. 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.512+0000 7f918781c640 1 Processor -- start 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.512+0000 7f918781c640 1 -- start start 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.512+0000 7f918781c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f91800b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f918781c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91800af2c0 0x7f9180139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f918781c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91800cbae0 0x7f91800cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f918781c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91800713b0 con 0x7f916c0039b0 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f918781c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9180071230 con 0x7f91800cbae0 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f918781c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9180071530 con 0x7f91800af2c0 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f91855b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f91800b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f91855b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f91800b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35422/0 (socket says 172.21.15.172:35422) 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f91855b8640 1 -- 172.21.15.172:0/796425637 learned_addr learned my addr 172.21.15.172:0/796425637 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f9184db7640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91800af2c0 0x7f9180139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f9185db9640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91800cbae0 0x7f91800cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f91855b8640 1 -- 172.21.15.172:0/796425637 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91800af2c0 msgr2=0x7f9180139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f91855b8640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91800af2c0 0x7f9180139ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f91855b8640 1 -- 172.21.15.172:0/796425637 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91800cbae0 msgr2=0x7f91800cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f91855b8640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91800cbae0 0x7f91800cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f91855b8640 1 -- 172.21.15.172:0/796425637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91800af980 con 0x7f916c0039b0 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f91855b8640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f91800b2190 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f917c02bfe0 tx=0x7f917c00a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f9175ffb640 1 -- 172.21.15.172:0/796425637 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c03f070 con 0x7f916c0039b0 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f9175ffb640 1 -- 172.21.15.172:0/796425637 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c039860 con 0x7f916c0039b0 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f918781c640 1 -- 172.21.15.172:0/796425637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91801f30e0 con 0x7f916c0039b0 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f9175ffb640 1 -- 172.21.15.172:0/796425637 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c034040 con 0x7f916c0039b0 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.513+0000 7f918781c640 1 -- 172.21.15.172:0/796425637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91801f36a0 con 0x7f916c0039b0 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.515+0000 7f918781c640 1 -- 172.21.15.172:0/796425637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9180073990 con 0x7f916c0039b0 2024-04-25T08:43:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.515+0000 7f9175ffb640 1 -- 172.21.15.172:0/796425637 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f917c042070 con 0x7f916c0039b0 2024-04-25T08:43:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.515+0000 7f9175ffb640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f916406b4d0 0x7f916406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.515+0000 7f9175ffb640 1 -- 172.21.15.172:0/796425637 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f917c0aa8e0 con 0x7f916c0039b0 2024-04-25T08:43:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.515+0000 7f9184db7640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f916406b4d0 0x7f916406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.516+0000 7f9184db7640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f916406b4d0 0x7f916406d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9170001cc0 tx=0x7f9170001150 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.519+0000 7f9175ffb640 1 -- 172.21.15.172:0/796425637 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f917c079660 con 0x7f916c0039b0 2024-04-25T08:43:37.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.692+0000 7f918781c640 1 -- 172.21.15.172:0/796425637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91800aeb60 con 0x7f916c0039b0 2024-04-25T08:43:37.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.694+0000 7f9175ffb640 1 -- 172.21.15.172:0/796425637 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17015 (secure 0 0 0) 0x7f917c078f60 con 0x7f916c0039b0 2024-04-25T08:43:37.686 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:37.687 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":37,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:36.706737+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:43:35.001610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T08:43:35.672731+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 -- 172.21.15.172:0/796425637 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f916406b4d0 msgr2=0x7f916406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f916406b4d0 0x7f916406d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9170001cc0 tx=0x7f9170001150 comp rx=0 tx=0).stop 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 -- 172.21.15.172:0/796425637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 msgr2=0x7f91800b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f91800b2190 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f917c02bfe0 tx=0x7f917c00a860 comp rx=0 tx=0).stop 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 -- 172.21.15.172:0/796425637 shutdown_connections 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f916406b4d0 0x7f916406d990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91800cbae0 0x7f91800cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91800af2c0 0x7f9180139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 --2- 172.21.15.172:0/796425637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f916c0039b0 0x7f91800b2190 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 -- 172.21.15.172:0/796425637 >> 172.21.15.172:0/796425637 conn(0x7f918006abe0 msgr2=0x7f918006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 -- 172.21.15.172:0/796425637 shutdown_connections 2024-04-25T08:43:37.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.696+0000 7f918781c640 1 -- 172.21.15.172:0/796425637 wait complete. 2024-04-25T08:43:37.700 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:37.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.805+0000 7f39e7cdd640 1 Processor -- start 2024-04-25T08:43:37.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.805+0000 7f39e7cdd640 1 -- start start 2024-04-25T08:43:37.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e7cdd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f39e00ce330 0x7f39e006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e7cdd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39e00700a0 0x7f39e015d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e7cdd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e01626e0 con 0x7f39e006abe0 2024-04-25T08:43:37.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e7cdd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e00cd270 con 0x7f39e00700a0 2024-04-25T08:43:37.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e7cdd640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e00cd550 con 0x7f39e00ce330 2024-04-25T08:43:37.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e627a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39e00700a0 0x7f39e015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e627a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39e00700a0 0x7f39e015d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35436/0 (socket says 172.21.15.172:35436) 2024-04-25T08:43:37.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e627a640 1 -- 172.21.15.172:0/3914526961 learned_addr learned my addr 172.21.15.172:0/3914526961 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:37.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e5278640 1 --2- 172.21.15.172:0/3914526961 >> v2:172.21.15.186:3300/0 conn(0x7f39e00ce330 0x7f39e006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e627a640 1 -- 172.21.15.172:0/3914526961 >> v2:172.21.15.186:3300/0 conn(0x7f39e00ce330 msgr2=0x7f39e006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:37.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e627a640 1 --2- 172.21.15.172:0/3914526961 >> v2:172.21.15.186:3300/0 conn(0x7f39e00ce330 0x7f39e006fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e627a640 1 -- 172.21.15.172:0/3914526961 >> v1:172.21.15.186:6789/0 conn(0x7f39e006abe0 legacy=0x7f39e006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.806+0000 7f39e627a640 1 -- 172.21.15.172:0/3914526961 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e00cd830 con 0x7f39e00700a0 2024-04-25T08:43:37.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.807+0000 7f39e627a640 1 --2- 172.21.15.172:0/3914526961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 0x7f39e015d370 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f39e0068860 tx=0x7f39d802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1704b93012578d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:37.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.807+0000 7f39e4a77640 1 -- 172.21.15.172:0/3914526961 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8036070 con 0x7f39e00700a0 2024-04-25T08:43:37.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.807+0000 7f39e4a77640 1 -- 172.21.15.172:0/3914526961 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d8031600 con 0x7f39e00700a0 2024-04-25T08:43:37.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.807+0000 7f39e4a77640 1 -- 172.21.15.172:0/3914526961 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80319d0 con 0x7f39e00700a0 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.807+0000 7f39e7cdd640 1 -- 172.21.15.172:0/3914526961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 msgr2=0x7f39e015d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.807+0000 7f39e7cdd640 1 --2- 172.21.15.172:0/3914526961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 0x7f39e015d370 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f39e0068860 tx=0x7f39d802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.808+0000 7f39e7cdd640 1 -- 172.21.15.172:0/3914526961 shutdown_connections 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.808+0000 7f39e7cdd640 1 --2- 172.21.15.172:0/3914526961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 0x7f39e015d370 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.808+0000 7f39e7cdd640 1 --2- 172.21.15.172:0/3914526961 >> v2:172.21.15.186:3300/0 conn(0x7f39e00ce330 0x7f39e006fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.808+0000 7f39e7cdd640 1 -- 172.21.15.172:0/3914526961 >> 172.21.15.172:0/3914526961 conn(0x7f39e00b2220 msgr2=0x7f39e00b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.808+0000 7f39e7cdd640 1 -- 172.21.15.172:0/3914526961 shutdown_connections 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.808+0000 7f39e7cdd640 1 -- 172.21.15.172:0/3914526961 wait complete. 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.809+0000 7f39e7cdd640 1 Processor -- start 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.809+0000 7f39e7cdd640 1 -- start start 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.809+0000 7f39e7cdd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39e006abe0 0x7f39e00b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.809+0000 7f39e7cdd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 0x7f39e00b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.809+0000 7f39e7cdd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39e00ce330 0x7f39e014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.809+0000 7f39e7cdd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e015d8b0 con 0x7f39e00700a0 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.809+0000 7f39e7cdd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e0161780 con 0x7f39e006abe0 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.809+0000 7f39e7cdd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e015da30 con 0x7f39e00ce330 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e5278640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 0x7f39e00b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e5278640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 0x7f39e00b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35438/0 (socket says 172.21.15.172:35438) 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e5278640 1 -- 172.21.15.172:0/2782904149 learned_addr learned my addr 172.21.15.172:0/2782904149 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e5a79640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39e006abe0 0x7f39e00b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e627a640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39e00ce330 0x7f39e014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e5278640 1 -- 172.21.15.172:0/2782904149 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39e00ce330 msgr2=0x7f39e014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e5278640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39e00ce330 0x7f39e014ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e5278640 1 -- 172.21.15.172:0/2782904149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39e006abe0 msgr2=0x7f39e00b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e5278640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39e006abe0 0x7f39e00b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e5278640 1 -- 172.21.15.172:0/2782904149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e009aa80 con 0x7f39e00700a0 2024-04-25T08:43:37.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e5278640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 0x7f39e00b5ee0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f39d000e870 tx=0x7f39d000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39d67fc640 1 -- 172.21.15.172:0/2782904149 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0017070 con 0x7f39e00700a0 2024-04-25T08:43:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39d67fc640 1 -- 172.21.15.172:0/2782904149 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d000c940 con 0x7f39e00700a0 2024-04-25T08:43:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e7cdd640 1 -- 172.21.15.172:0/2782904149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e00b4920 con 0x7f39e00700a0 2024-04-25T08:43:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39d67fc640 1 -- 172.21.15.172:0/2782904149 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d000cd10 con 0x7f39e00700a0 2024-04-25T08:43:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.810+0000 7f39e7cdd640 1 -- 172.21.15.172:0/2782904149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e00b4ee0 con 0x7f39e00700a0 2024-04-25T08:43:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.811+0000 7f39e7cdd640 1 -- 172.21.15.172:0/2782904149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e0073990 con 0x7f39e00700a0 2024-04-25T08:43:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.811+0000 7f39d67fc640 1 -- 172.21.15.172:0/2782904149 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f39d001a070 con 0x7f39e00700a0 2024-04-25T08:43:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.812+0000 7f39d67fc640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39c406b4d0 0x7f39c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.812+0000 7f39d67fc640 1 -- 172.21.15.172:0/2782904149 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f39d008a1f0 con 0x7f39e00700a0 2024-04-25T08:43:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.812+0000 7f39e5a79640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39c406b4d0 0x7f39c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.812+0000 7f39e5a79640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39c406b4d0 0x7f39c406d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001640 tx=0x7f39dc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:37.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.816+0000 7f39d67fc640 1 -- 172.21.15.172:0/2782904149 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39d0058ee0 con 0x7f39e00700a0 2024-04-25T08:43:37.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.988+0000 7f39e7cdd640 1 -- 172.21.15.172:0/2782904149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39e00b2ff0 con 0x7f39e00700a0 2024-04-25T08:43:37.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.989+0000 7f39d67fc640 1 -- 172.21.15.172:0/2782904149 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+17015 (secure 0 0 0) 0x7f39d00587e0 con 0x7f39e00700a0 2024-04-25T08:43:37.981 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:37.981 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":37,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:36.706737+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:43:35.001610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T08:43:35.672731+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 -- 172.21.15.172:0/2782904149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39c406b4d0 msgr2=0x7f39c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39c406b4d0 0x7f39c406d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001640 tx=0x7f39dc009040 comp rx=0 tx=0).stop 2024-04-25T08:43:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 -- 172.21.15.172:0/2782904149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 msgr2=0x7f39e00b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 0x7f39e00b5ee0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f39d000e870 tx=0x7f39d000ed30 comp rx=0 tx=0).stop 2024-04-25T08:43:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 -- 172.21.15.172:0/2782904149 shutdown_connections 2024-04-25T08:43:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39c406b4d0 0x7f39c406d990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39e00ce330 0x7f39e014ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39e00700a0 0x7f39e00b5ee0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 --2- 172.21.15.172:0/2782904149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39e006abe0 0x7f39e00b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:37.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 -- 172.21.15.172:0/2782904149 >> 172.21.15.172:0/2782904149 conn(0x7f39e00b2220 msgr2=0x7f39e015ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:37.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 -- 172.21.15.172:0/2782904149 shutdown_connections 2024-04-25T08:43:37.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:37.991+0000 7f39e7cdd640 1 -- 172.21.15.172:0/2782904149 wait complete. 2024-04-25T08:43:37.995 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:43:38.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.102+0000 7f49cc09a640 1 Processor -- start 2024-04-25T08:43:38.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.102+0000 7f49cc09a640 1 -- start start 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49cc09a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f49c406ccd0 0x7f49c40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49cc09a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c415deb0 0x7f49c415e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49cc09a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c40d1770 con 0x7f49c4070dc0 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49cc09a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c41622b0 con 0x7f49c406ccd0 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49cc09a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40b10f0 con 0x7f49c415deb0 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c9e36640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f49c4070dc0 0x7f49c40711a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42664/0 (socket says 172.21.15.172:42664) 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c9e36640 1 -- 172.21.15.172:0/3872691414 learned_addr learned my addr 172.21.15.172:0/3872691414 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399147644 0 0) 0x7f49c40d1770 con 0x7f49c4070dc0 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c9635640 1 --2- 172.21.15.172:0/3872691414 >> v2:172.21.15.186:3300/0 conn(0x7f49c406ccd0 0x7f49c40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49ca637640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c415deb0 0x7f49c415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b0003520 con 0x7f49c4070dc0 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3736634238 0 0) 0x7f49b0003520 con 0x7f49c4070dc0 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c415deb0 msgr2=0x7f49c415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c8e34640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c415deb0 0x7f49c415e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 >> v2:172.21.15.186:3300/0 conn(0x7f49c406ccd0 msgr2=0x7f49c40b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c8e34640 1 --2- 172.21.15.172:0/3872691414 >> v2:172.21.15.186:3300/0 conn(0x7f49c406ccd0 0x7f49c40b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.103+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c4162740 con 0x7f49c4070dc0 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f49c0001670 con 0x7f49c4070dc0 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 >> v1:172.21.15.172:6789/0 conn(0x7f49c4070dc0 legacy=0x7f49c40711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c8e34640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c415deb0 0x7f49b00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c8e34640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b0003f30 0x7f49b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c8e34640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b0004d40 0x7f49b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c41622b0 con 0x7f49b0003f30 2024-04-25T08:43:38.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40b10f0 con 0x7f49b0004d40 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b000baa0 con 0x7f49c415deb0 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c9635640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b0003f30 0x7f49b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c9e36640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c415deb0 0x7f49b00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49ca637640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b0004d40 0x7f49b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c9635640 1 -- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c415deb0 msgr2=0x7f49b00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c9635640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c415deb0 0x7f49b00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c9635640 1 -- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b0004d40 msgr2=0x7f49b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c9635640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b0004d40 0x7f49b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49c9635640 1 -- 172.21.15.172:0/3872691414 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b0003520 con 0x7f49b0003f30 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.104+0000 7f49ca637640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b0004d40 0x7f49b00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49c9635640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b0003f30 0x7f49b0004800 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009ac0 tx=0x7f49b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dca2f51f2a9fa18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4036070 con 0x7f49b0003f30 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4031400 con 0x7f49b0003f30 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49c8e34640 1 -- 172.21.15.172:0/3872691414 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4009690 con 0x7f49b0003f30 2024-04-25T08:43:38.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49cc09a640 1 -- 172.21.15.172:0/3872691414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b0003f30 msgr2=0x7f49b0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49cc09a640 1 --2- 172.21.15.172:0/3872691414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49b0003f30 0x7f49b0004800 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009ac0 tx=0x7f49b0005830 comp rx=0 tx=0).stop 2024-04-25T08:43:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49ca637640 1 -- 172.21.15.172:0/3872691414 reap_dead start 2024-04-25T08:43:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49cc09a640 1 -- 172.21.15.172:0/3872691414 shutdown_connections 2024-04-25T08:43:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49cc09a640 1 -- 172.21.15.172:0/3872691414 >> 172.21.15.172:0/3872691414 conn(0x7f49c40b3530 msgr2=0x7f49c40b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49cc09a640 1 -- 172.21.15.172:0/3872691414 shutdown_connections 2024-04-25T08:43:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.105+0000 7f49cc09a640 1 -- 172.21.15.172:0/3872691414 wait complete. 2024-04-25T08:43:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49cc09a640 1 Processor -- start 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49cc09a640 1 -- start start 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49cc09a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b0003f30 0x7f49c4152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49cc09a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c41f4670 0x7f49c40b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49cc09a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c40b5ff0 0x7f49c40cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49cc09a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4161f40 con 0x7f49c40b5ff0 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49cc09a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4161c60 con 0x7f49b0003f30 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49cc09a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40b5840 con 0x7f49c41f4670 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49ca637640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c40b5ff0 0x7f49c40cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49ca637640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c40b5ff0 0x7f49c40cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35452/0 (socket says 172.21.15.172:35452) 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49ca637640 1 -- 172.21.15.172:0/699543376 learned_addr learned my addr 172.21.15.172:0/699543376 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49c9635640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c41f4670 0x7f49c40b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.107+0000 7f49c9e36640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b0003f30 0x7f49c4152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49ca637640 1 -- 172.21.15.172:0/699543376 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c41f4670 msgr2=0x7f49c40b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:38.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49ca637640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c41f4670 0x7f49c40b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49ca637640 1 -- 172.21.15.172:0/699543376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b0003f30 msgr2=0x7f49c4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49ca637640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b0003f30 0x7f49c4152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49ca637640 1 -- 172.21.15.172:0/699543376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40cc2f0 con 0x7f49c40b5ff0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49ca637640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c40b5ff0 0x7f49c40cb580 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f49c4070ab0 tx=0x7f49bc010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49ba7fc640 1 -- 172.21.15.172:0/699543376 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc01a030 con 0x7f49c40b5ff0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49ba7fc640 1 -- 172.21.15.172:0/699543376 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc010db0 con 0x7f49c40b5ff0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49cc09a640 1 -- 172.21.15.172:0/699543376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c41578d0 con 0x7f49c40b5ff0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49ba7fc640 1 -- 172.21.15.172:0/699543376 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc003bd0 con 0x7f49c40b5ff0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.108+0000 7f49cc09a640 1 -- 172.21.15.172:0/699543376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c4157e90 con 0x7f49c40b5ff0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.109+0000 7f49cc09a640 1 -- 172.21.15.172:0/699543376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4158090 con 0x7f49c40b5ff0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.109+0000 7f49ba7fc640 1 -- 172.21.15.172:0/699543376 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f49bc005d10 con 0x7f49c40b5ff0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.110+0000 7f49ba7fc640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f49a806b500 0x7f49a806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.110+0000 7f49ba7fc640 1 -- 172.21.15.172:0/699543376 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f49bc08a710 con 0x7f49c40b5ff0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.110+0000 7f49c9e36640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f49a806b500 0x7f49a806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.110+0000 7f49c9e36640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f49a806b500 0x7f49a806d9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f49c00011e0 tx=0x7f49c00078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:38.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.114+0000 7f49ba7fc640 1 -- 172.21.15.172:0/699543376 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f49c4158090 con 0x7f49c40b5ff0 2024-04-25T08:43:38.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.324+0000 7f49cc09a640 1 -- 172.21.15.172:0/699543376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f49c40739e0 con 0x7f49c40b5ff0 2024-04-25T08:43:38.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.372+0000 7f49ba7fc640 1 -- 172.21.15.172:0/699543376 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f49bc025020 con 0x7f49c40b5ff0 2024-04-25T08:43:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 -- 172.21.15.172:0/699543376 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f49a806b500 msgr2=0x7f49a806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f49a806b500 0x7f49a806d9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f49c00011e0 tx=0x7f49c00078f0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 -- 172.21.15.172:0/699543376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c40b5ff0 msgr2=0x7f49c40cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c40b5ff0 0x7f49c40cb580 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f49c4070ab0 tx=0x7f49bc010590 comp rx=0 tx=0).stop 2024-04-25T08:43:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 -- 172.21.15.172:0/699543376 shutdown_connections 2024-04-25T08:43:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f49a806b500 0x7f49a806d9c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49c40b5ff0 0x7f49c40cb580 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49c41f4670 0x7f49c40b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 --2- 172.21.15.172:0/699543376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f49b0003f30 0x7f49c4152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 -- 172.21.15.172:0/699543376 >> 172.21.15.172:0/699543376 conn(0x7f49c40b3530 msgr2=0x7f49c40cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 -- 172.21.15.172:0/699543376 shutdown_connections 2024-04-25T08:43:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.375+0000 7f49cc09a640 1 -- 172.21.15.172:0/699543376 wait complete. 2024-04-25T08:43:38.378 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:43:38.378 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:43:38.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.486+0000 7f0638f61640 1 Processor -- start 2024-04-25T08:43:38.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.486+0000 7f0638f61640 1 -- start start 2024-04-25T08:43:38.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f0638f61640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0634070dc0 0x7f063406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f0638f61640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f063415deb0 0x7f063415e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f0638f61640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340d1770 con 0x7f06340711a0 2024-04-25T08:43:38.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f0638f61640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06340b0eb0 con 0x7f0634070dc0 2024-04-25T08:43:38.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f0638f61640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06341622b0 con 0x7f063415deb0 2024-04-25T08:43:38.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f063259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0634070dc0 0x7f063406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f0631d9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f06340711a0 0x7f06340b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42678/0 (socket says 172.21.15.172:42678) 2024-04-25T08:43:38.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f0631d9b640 1 -- 172.21.15.172:0/2834649141 learned_addr learned my addr 172.21.15.172:0/2834649141 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:38.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f0632d9d640 1 --2- 172.21.15.172:0/2834649141 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f063415deb0 0x7f063415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f063259c640 1 -- 172.21.15.172:0/2834649141 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f063415deb0 msgr2=0x7f063415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:38.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f063259c640 1 --2- 172.21.15.172:0/2834649141 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f063415deb0 0x7f063415e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f063159a640 1 -- 172.21.15.172:0/2834649141 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733581944 0 0) 0x7f06340d1770 con 0x7f06340711a0 2024-04-25T08:43:38.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f063259c640 1 -- 172.21.15.172:0/2834649141 >> v1:172.21.15.172:6789/0 conn(0x7f06340711a0 legacy=0x7f06340b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:38.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f063259c640 1 -- 172.21.15.172:0/2834649141 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634162740 con 0x7f0634070dc0 2024-04-25T08:43:38.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.487+0000 7f0632d9d640 1 --2- 172.21.15.172:0/2834649141 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f063415deb0 0x7f063415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:38.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.488+0000 7f063259c640 1 --2- 172.21.15.172:0/2834649141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 0x7f063406ccd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f062c0097a0 tx=0x7f062c02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a058278d787969 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:38.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.488+0000 7f063159a640 1 -- 172.21.15.172:0/2834649141 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c037070 con 0x7f0634070dc0 2024-04-25T08:43:38.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.488+0000 7f063159a640 1 -- 172.21.15.172:0/2834649141 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c02adb0 con 0x7f0634070dc0 2024-04-25T08:43:38.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.488+0000 7f063159a640 1 -- 172.21.15.172:0/2834649141 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c032660 con 0x7f0634070dc0 2024-04-25T08:43:38.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.488+0000 7f0638f61640 1 -- 172.21.15.172:0/2834649141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 msgr2=0x7f063406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:38.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.488+0000 7f0638f61640 1 --2- 172.21.15.172:0/2834649141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 0x7f063406ccd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f062c0097a0 tx=0x7f062c02a060 comp rx=0 tx=0).stop 2024-04-25T08:43:38.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.489+0000 7f0638f61640 1 -- 172.21.15.172:0/2834649141 shutdown_connections 2024-04-25T08:43:38.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.489+0000 7f0638f61640 1 --2- 172.21.15.172:0/2834649141 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f063415deb0 0x7f063415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.489+0000 7f0638f61640 1 --2- 172.21.15.172:0/2834649141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 0x7f063406ccd0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.489+0000 7f0638f61640 1 -- 172.21.15.172:0/2834649141 >> 172.21.15.172:0/2834649141 conn(0x7f06340b3530 msgr2=0x7f06340b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:38.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.489+0000 7f0638f61640 1 -- 172.21.15.172:0/2834649141 shutdown_connections 2024-04-25T08:43:38.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.489+0000 7f0638f61640 1 -- 172.21.15.172:0/2834649141 wait complete. 2024-04-25T08:43:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.490+0000 7f0638f61640 1 Processor -- start 2024-04-25T08:43:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.490+0000 7f0638f61640 1 -- start start 2024-04-25T08:43:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0638f61640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 0x7f0634152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0638f61640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06340711a0 0x7f0634155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0638f61640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f063415deb0 0x7f0634155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0638f61640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634161c60 con 0x7f0634070dc0 2024-04-25T08:43:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0638f61640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340b10f0 con 0x7f06340711a0 2024-04-25T08:43:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0638f61640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0634161f40 con 0x7f063415deb0 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f063259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 0x7f0634152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f063259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 0x7f0634152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35474/0 (socket says 172.21.15.172:35474) 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f063259c640 1 -- 172.21.15.172:0/490406255 learned_addr learned my addr 172.21.15.172:0/490406255 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f063259c640 1 -- 172.21.15.172:0/490406255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f063415deb0 msgr2=0x7f0634155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f063259c640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f063415deb0 0x7f0634155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f063259c640 1 -- 172.21.15.172:0/490406255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06340711a0 msgr2=0x7f0634155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f063259c640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06340711a0 0x7f0634155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f063259c640 1 -- 172.21.15.172:0/490406255 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634160ba0 con 0x7f0634070dc0 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f063259c640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 0x7f0634152400 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f062c0098c0 tx=0x7f062c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0622ffd640 1 -- 172.21.15.172:0/490406255 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c041070 con 0x7f0634070dc0 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0622ffd640 1 -- 172.21.15.172:0/490406255 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c03c670 con 0x7f0634070dc0 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0622ffd640 1 -- 172.21.15.172:0/490406255 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c037040 con 0x7f0634070dc0 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0638f61640 1 -- 172.21.15.172:0/490406255 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063415fde0 con 0x7f0634070dc0 2024-04-25T08:43:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.491+0000 7f0638f61640 1 -- 172.21.15.172:0/490406255 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06341603a0 con 0x7f0634070dc0 2024-04-25T08:43:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.493+0000 7f0638f61640 1 -- 172.21.15.172:0/490406255 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0634073a00 con 0x7f0634070dc0 2024-04-25T08:43:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.493+0000 7f0622ffd640 1 -- 172.21.15.172:0/490406255 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f062c044070 con 0x7f0634070dc0 2024-04-25T08:43:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.493+0000 7f0622ffd640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061406b4d0 0x7f061406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.493+0000 7f0622ffd640 1 -- 172.21.15.172:0/490406255 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f062c0aae00 con 0x7f0634070dc0 2024-04-25T08:43:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.493+0000 7f0631d9b640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061406b4d0 0x7f061406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.494+0000 7f0631d9b640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061406b4d0 0x7f061406d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0628007fd0 tx=0x7f0628007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.497+0000 7f0622ffd640 1 -- 172.21.15.172:0/490406255 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f062c079c10 con 0x7f0634070dc0 2024-04-25T08:43:38.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:38.704+0000 7f0638f61640 1 -- 172.21.15.172:0/490406255 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f06340b2310 con 0x7f0634070dc0 2024-04-25T08:43:39.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.385+0000 7f0622ffd640 1 -- 172.21.15.172:0/490406255 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f062c079510 con 0x7f0634070dc0 2024-04-25T08:43:39.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.387+0000 7f0638f61640 1 -- 172.21.15.172:0/490406255 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061406b4d0 msgr2=0x7f061406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.387+0000 7f0638f61640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061406b4d0 0x7f061406d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0628007fd0 tx=0x7f0628007920 comp rx=0 tx=0).stop 2024-04-25T08:43:39.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.387+0000 7f0638f61640 1 -- 172.21.15.172:0/490406255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 msgr2=0x7f0634152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.387+0000 7f0638f61640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 0x7f0634152400 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f062c0098c0 tx=0x7f062c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.387+0000 7f0638f61640 1 -- 172.21.15.172:0/490406255 shutdown_connections 2024-04-25T08:43:39.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.387+0000 7f0638f61640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061406b4d0 0x7f061406d990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.387+0000 7f0638f61640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06340711a0 0x7f0634155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.387+0000 7f0638f61640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f063415deb0 0x7f0634155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.387+0000 7f0638f61640 1 --2- 172.21.15.172:0/490406255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0634070dc0 0x7f0634152400 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.388+0000 7f0638f61640 1 -- 172.21.15.172:0/490406255 >> 172.21.15.172:0/490406255 conn(0x7f06340b3530 msgr2=0x7f063406cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:39.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.388+0000 7f0638f61640 1 -- 172.21.15.172:0/490406255 shutdown_connections 2024-04-25T08:43:39.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.388+0000 7f0638f61640 1 -- 172.21.15.172:0/490406255 wait complete. 2024-04-25T08:43:39.393 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:43:39.393 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:43:39.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.503+0000 7fc1fc15c640 1 Processor -- start 2024-04-25T08:43:39.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.503+0000 7fc1fc15c640 1 -- start start 2024-04-25T08:43:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.504+0000 7fc1fc15c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc1f4158220 0x7fc1f415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.504+0000 7fc1fc15c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 0x7fc1f40afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.504+0000 7fc1fc15c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f415f180 con 0x7fc1f41617b0 2024-04-25T08:43:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.504+0000 7fc1fc15c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40b3670 con 0x7fc1f4158220 2024-04-25T08:43:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.504+0000 7fc1fc15c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4070a10 con 0x7fc1f40af720 2024-04-25T08:43:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.504+0000 7fc1f9ef8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc1f4158220 0x7fc1f415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.504+0000 7fc1f9ef8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc1f4158220 0x7fc1f415ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35488/0 (socket says 172.21.15.172:35488) 2024-04-25T08:43:39.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.504+0000 7fc1f9ef8640 1 -- 172.21.15.172:0/1689135762 learned_addr learned my addr 172.21.15.172:0/1689135762 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.505+0000 7fc1f96f7640 1 --2- 172.21.15.172:0/1689135762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 0x7fc1f40afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.505+0000 7fc1f9ef8640 1 -- 172.21.15.172:0/1689135762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 msgr2=0x7fc1f40afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.505+0000 7fc1f9ef8640 1 --2- 172.21.15.172:0/1689135762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 0x7fc1f40afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.505+0000 7fc1f9ef8640 1 -- 172.21.15.172:0/1689135762 >> v1:172.21.15.186:6789/0 conn(0x7fc1f41617b0 legacy=0x7fc1f4161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.505+0000 7fc1f9ef8640 1 -- 172.21.15.172:0/1689135762 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f406fe00 con 0x7fc1f4158220 2024-04-25T08:43:39.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.505+0000 7fc1f9ef8640 1 --2- 172.21.15.172:0/1689135762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 0x7fc1f415ec40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009e50 tx=0x7fc1f002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5156c18ee825118 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:39.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1f8ef6640 1 -- 172.21.15.172:0/1689135762 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0036070 con 0x7fc1f4158220 2024-04-25T08:43:39.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1f8ef6640 1 -- 172.21.15.172:0/1689135762 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f0031600 con 0x7fc1f4158220 2024-04-25T08:43:39.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1f8ef6640 1 -- 172.21.15.172:0/1689135762 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00319d0 con 0x7fc1f4158220 2024-04-25T08:43:39.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1fc15c640 1 -- 172.21.15.172:0/1689135762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 msgr2=0x7fc1f415ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1fc15c640 1 --2- 172.21.15.172:0/1689135762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 0x7fc1f415ec40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009e50 tx=0x7fc1f002a710 comp rx=0 tx=0).stop 2024-04-25T08:43:39.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1fc15c640 1 -- 172.21.15.172:0/1689135762 shutdown_connections 2024-04-25T08:43:39.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1fc15c640 1 --2- 172.21.15.172:0/1689135762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 0x7fc1f40afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1fc15c640 1 --2- 172.21.15.172:0/1689135762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 0x7fc1f415ec40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1fc15c640 1 -- 172.21.15.172:0/1689135762 >> 172.21.15.172:0/1689135762 conn(0x7fc1f40b2370 msgr2=0x7fc1f40b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:39.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1fc15c640 1 -- 172.21.15.172:0/1689135762 shutdown_connections 2024-04-25T08:43:39.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.506+0000 7fc1fc15c640 1 -- 172.21.15.172:0/1689135762 wait complete. 2024-04-25T08:43:39.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.507+0000 7fc1fc15c640 1 Processor -- start 2024-04-25T08:43:39.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.507+0000 7fc1fc15c640 1 -- start start 2024-04-25T08:43:39.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1fc15c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 0x7fc1f415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1fc15c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 0x7fc1f414b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1fc15c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f41617b0 0x7fc1f4158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1fc15c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40706a0 con 0x7fc1f4158220 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1fc15c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40703c0 con 0x7fc1f41617b0 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1fc15c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4158600 con 0x7fc1f40af720 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1f96f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 0x7fc1f414b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1f96f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 0x7fc1f414b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35490/0 (socket says 172.21.15.172:35490) 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1f96f7640 1 -- 172.21.15.172:0/2980547762 learned_addr learned my addr 172.21.15.172:0/2980547762 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1fa6f9640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f41617b0 0x7fc1f4158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1f9ef8640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 0x7fc1f415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1f96f7640 1 -- 172.21.15.172:0/2980547762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 msgr2=0x7fc1f415a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1f96f7640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 0x7fc1f415a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1f96f7640 1 -- 172.21.15.172:0/2980547762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f41617b0 msgr2=0x7fc1f4158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1f96f7640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f41617b0 0x7fc1f4158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1f96f7640 1 -- 172.21.15.172:0/2980547762 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f41592b0 con 0x7fc1f4158220 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1f9ef8640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 0x7fc1f415a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.508+0000 7fc1fa6f9640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f41617b0 0x7fc1f4158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.509+0000 7fc1f96f7640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 0x7fc1f414b020 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400d800 tx=0x7fc1e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.509+0000 7fc1ea7fc640 1 -- 172.21.15.172:0/2980547762 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e400b6c0 con 0x7fc1f4158220 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.509+0000 7fc1ea7fc640 1 -- 172.21.15.172:0/2980547762 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4019070 con 0x7fc1f4158220 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.509+0000 7fc1fc15c640 1 -- 172.21.15.172:0/2980547762 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f4159590 con 0x7fc1f4158220 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.509+0000 7fc1ea7fc640 1 -- 172.21.15.172:0/2980547762 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e400ba80 con 0x7fc1f4158220 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.509+0000 7fc1fc15c640 1 -- 172.21.15.172:0/2980547762 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f4159b50 con 0x7fc1f4158220 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.510+0000 7fc1fc15c640 1 -- 172.21.15.172:0/2980547762 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f4073990 con 0x7fc1f4158220 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.510+0000 7fc1ea7fc640 1 -- 172.21.15.172:0/2980547762 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc1e400bc20 con 0x7fc1f4158220 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.510+0000 7fc1ea7fc640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1d806b4d0 0x7fc1d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.511+0000 7fc1ea7fc640 1 -- 172.21.15.172:0/2980547762 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc1e408a790 con 0x7fc1f4158220 2024-04-25T08:43:39.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.511+0000 7fc1f9ef8640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1d806b4d0 0x7fc1d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.511+0000 7fc1f9ef8640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1d806b4d0 0x7fc1d806d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0033000 tx=0x7fc1f0009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:39.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.516+0000 7fc1ea7fc640 1 -- 172.21.15.172:0/2980547762 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1e4059510 con 0x7fc1f4158220 2024-04-25T08:43:39.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.724+0000 7fc1fc15c640 1 -- 172.21.15.172:0/2980547762 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1f4156680 con 0x7fc1f4158220 2024-04-25T08:43:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.725+0000 7fc1ea7fc640 1 -- 172.21.15.172:0/2980547762 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fc1e4058e10 con 0x7fc1f4158220 2024-04-25T08:43:39.717 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:39.717 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/1959121045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1959121045},{"type":"v1","addr":"172.21.15.186:6834","nonce":1959121045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/898320853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":898320853},{"type":"v1","addr":"172.21.15.186:6835","nonce":898320853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1482887107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1482887107},{"type":"v1","addr":"172.21.15.172:6836","nonce":1482887107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:43:36.707052+0000","modified":"2024-04-25T08:43:38.705443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3537703238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3537703238},{"type":"v1","addr":"172.21.15.172:6837","nonce":3537703238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:43:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 15 2024-04-25T08:43:39.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 -- 172.21.15.172:0/2980547762 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1d806b4d0 msgr2=0x7fc1d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1d806b4d0 0x7fc1d806d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0033000 tx=0x7fc1f0009000 comp rx=0 tx=0).stop 2024-04-25T08:43:39.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 -- 172.21.15.172:0/2980547762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 msgr2=0x7fc1f414b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 0x7fc1f414b020 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400d800 tx=0x7fc1e400dcc0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 -- 172.21.15.172:0/2980547762 shutdown_connections 2024-04-25T08:43:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1d806b4d0 0x7fc1d806d990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f41617b0 0x7fc1f4158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f4158220 0x7fc1f414b020 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 --2- 172.21.15.172:0/2980547762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1f40af720 0x7fc1f415a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 -- 172.21.15.172:0/2980547762 >> 172.21.15.172:0/2980547762 conn(0x7fc1f40b2370 msgr2=0x7fc1f4160a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 -- 172.21.15.172:0/2980547762 shutdown_connections 2024-04-25T08:43:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.727+0000 7fc1fc15c640 1 -- 172.21.15.172:0/2980547762 wait complete. 2024-04-25T08:43:39.730 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:43:39.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.836+0000 7f46217c1640 1 Processor -- start 2024-04-25T08:43:39.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.836+0000 7f46217c1640 1 -- start start 2024-04-25T08:43:39.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f46217c1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f461c15dbe0 0x7f461c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f46217c1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f461c0b92a0 0x7f461c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f46217c1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0b97a0 con 0x7f461c0b2cb0 2024-04-25T08:43:39.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f46217c1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c15dfc0 con 0x7f461c15dbe0 2024-04-25T08:43:39.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f46217c1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c0d1a00 con 0x7f461c0b92a0 2024-04-25T08:43:39.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f461affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f461c15dbe0 0x7f461c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f4613fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f461c0b2cb0 0x7f461c0b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42682/0 (socket says 172.21.15.172:42682) 2024-04-25T08:43:39.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f4613fff640 1 -- 172.21.15.172:0/3116582678 learned_addr learned my addr 172.21.15.172:0/3116582678 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:39.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f461affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f461c15dbe0 0x7f461c0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35492/0 (socket says 172.21.15.172:35492) 2024-04-25T08:43:39.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f461b7fe640 1 --2- 172.21.15.172:0/3116582678 >> v2:172.21.15.186:3300/0 conn(0x7f461c0b92a0 0x7f461c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f461affd640 1 -- 172.21.15.172:0/3116582678 >> v2:172.21.15.186:3300/0 conn(0x7f461c0b92a0 msgr2=0x7f461c0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:39.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f461affd640 1 --2- 172.21.15.172:0/3116582678 >> v2:172.21.15.186:3300/0 conn(0x7f461c0b92a0 0x7f461c0d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f461affd640 1 -- 172.21.15.172:0/3116582678 >> v1:172.21.15.172:6789/0 conn(0x7f461c0b2cb0 legacy=0x7f461c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.837+0000 7f461affd640 1 -- 172.21.15.172:0/3116582678 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0d1c50 con 0x7f461c15dbe0 2024-04-25T08:43:39.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.838+0000 7f461affd640 1 --2- 172.21.15.172:0/3116582678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c15dbe0 0x7f461c0d0910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f461c0cfb90 tx=0x7f460c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4399a9f0ac627cf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:39.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.838+0000 7f461a7fc640 1 -- 172.21.15.172:0/3116582678 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c037070 con 0x7f461c15dbe0 2024-04-25T08:43:39.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.838+0000 7f461a7fc640 1 -- 172.21.15.172:0/3116582678 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c032440 con 0x7f461c15dbe0 2024-04-25T08:43:39.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.838+0000 7f461a7fc640 1 -- 172.21.15.172:0/3116582678 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c02ae60 con 0x7f461c15dbe0 2024-04-25T08:43:39.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.839+0000 7f46217c1640 1 -- 172.21.15.172:0/3116582678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c15dbe0 msgr2=0x7f461c0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.839+0000 7f46217c1640 1 --2- 172.21.15.172:0/3116582678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c15dbe0 0x7f461c0d0910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f461c0cfb90 tx=0x7f460c02a110 comp rx=0 tx=0).stop 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.839+0000 7f46217c1640 1 -- 172.21.15.172:0/3116582678 shutdown_connections 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.839+0000 7f46217c1640 1 --2- 172.21.15.172:0/3116582678 >> v2:172.21.15.186:3300/0 conn(0x7f461c0b92a0 0x7f461c0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.839+0000 7f46217c1640 1 --2- 172.21.15.172:0/3116582678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c15dbe0 0x7f461c0d0910 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.839+0000 7f46217c1640 1 -- 172.21.15.172:0/3116582678 >> 172.21.15.172:0/3116582678 conn(0x7f461c061a20 msgr2=0x7f461c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.839+0000 7f46217c1640 1 -- 172.21.15.172:0/3116582678 shutdown_connections 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.839+0000 7f46217c1640 1 -- 172.21.15.172:0/3116582678 wait complete. 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.840+0000 7f46217c1640 1 Processor -- start 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.840+0000 7f46217c1640 1 -- start start 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46217c1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c0b2cb0 0x7f461c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46217c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c0b92a0 0x7f461c0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46217c1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f461c15dbe0 0x7f461c15f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46217c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0b6ab0 con 0x7f461c0b92a0 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46217c1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0d2210 con 0x7f461c0b2cb0 2024-04-25T08:43:39.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46217c1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0b6c30 con 0x7f461c15dbe0 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f4613fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c0b92a0 0x7f461c0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f4613fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c0b92a0 0x7f461c0c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35508/0 (socket says 172.21.15.172:35508) 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f4613fff640 1 -- 172.21.15.172:0/2723894551 learned_addr learned my addr 172.21.15.172:0/2723894551 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f461affd640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c0b2cb0 0x7f461c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f4613fff640 1 -- 172.21.15.172:0/2723894551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f461c15dbe0 msgr2=0x7f461c15f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f461b7fe640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f461c15dbe0 0x7f461c15f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f4613fff640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f461c15dbe0 0x7f461c15f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f4613fff640 1 -- 172.21.15.172:0/2723894551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c0b2cb0 msgr2=0x7f461c0cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f4613fff640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c0b2cb0 0x7f461c0cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f4613fff640 1 -- 172.21.15.172:0/2723894551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0b57c0 con 0x7f461c0b92a0 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f461affd640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c0b2cb0 0x7f461c0cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:39.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f4613fff640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c0b92a0 0x7f461c0c95d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f460400c440 tx=0x7f4604001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:39.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46137fe640 1 -- 172.21.15.172:0/2723894551 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604017070 con 0x7f461c0b92a0 2024-04-25T08:43:39.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46137fe640 1 -- 172.21.15.172:0/2723894551 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4604005ce0 con 0x7f461c0b92a0 2024-04-25T08:43:39.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46137fe640 1 -- 172.21.15.172:0/2723894551 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46040072f0 con 0x7f461c0b92a0 2024-04-25T08:43:39.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46217c1640 1 -- 172.21.15.172:0/2723894551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c0cac60 con 0x7f461c0b92a0 2024-04-25T08:43:39.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.841+0000 7f46217c1640 1 -- 172.21.15.172:0/2723894551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c15fba0 con 0x7f461c0b92a0 2024-04-25T08:43:39.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.842+0000 7f46217c1640 1 -- 172.21.15.172:0/2723894551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c073990 con 0x7f461c0b92a0 2024-04-25T08:43:39.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.843+0000 7f46137fe640 1 -- 172.21.15.172:0/2723894551 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f460401a070 con 0x7f461c0b92a0 2024-04-25T08:43:39.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.843+0000 7f46137fe640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45fc06b4d0 0x7f45fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:39.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.843+0000 7f46137fe640 1 -- 172.21.15.172:0/2723894551 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f46040896f0 con 0x7f461c0b92a0 2024-04-25T08:43:39.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.843+0000 7f461affd640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45fc06b4d0 0x7f45fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:39.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.844+0000 7f461affd640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45fc06b4d0 0x7f45fc06d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f460c034000 tx=0x7f460c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:39.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:39.847+0000 7f46137fe640 1 -- 172.21.15.172:0/2723894551 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4604058470 con 0x7f461c0b92a0 2024-04-25T08:43:40.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.016+0000 7f46217c1640 1 -- 172.21.15.172:0/2723894551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f461c0b65a0 con 0x7f461c0b92a0 2024-04-25T08:43:40.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.018+0000 7f46137fe640 1 -- 172.21.15.172:0/2723894551 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17002 (secure 0 0 0) 0x7f4604057d70 con 0x7f461c0b92a0 2024-04-25T08:43:40.010 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:40.010 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":38,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:43:38.362823+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:43:35.001610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T08:43:35.672731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:43:40.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 -- 172.21.15.172:0/2723894551 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45fc06b4d0 msgr2=0x7f45fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45fc06b4d0 0x7f45fc06d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f460c034000 tx=0x7f460c02e000 comp rx=0 tx=0).stop 2024-04-25T08:43:40.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 -- 172.21.15.172:0/2723894551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c0b92a0 msgr2=0x7f461c0c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c0b92a0 0x7f461c0c95d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f460400c440 tx=0x7f4604001e70 comp rx=0 tx=0).stop 2024-04-25T08:43:40.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 -- 172.21.15.172:0/2723894551 shutdown_connections 2024-04-25T08:43:40.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45fc06b4d0 0x7f45fc06d990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f461c15dbe0 0x7f461c15f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f461c0b92a0 0x7f461c0c95d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 --2- 172.21.15.172:0/2723894551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f461c0b2cb0 0x7f461c0cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 -- 172.21.15.172:0/2723894551 >> 172.21.15.172:0/2723894551 conn(0x7f461c061a20 msgr2=0x7f461c15b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:40.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 -- 172.21.15.172:0/2723894551 shutdown_connections 2024-04-25T08:43:40.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.020+0000 7f46217c1640 1 -- 172.21.15.172:0/2723894551 wait complete. 2024-04-25T08:43:40.024 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:43:40.025 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:43:40.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.131+0000 7f809c7b7640 1 Processor -- start 2024-04-25T08:43:40.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.131+0000 7f809c7b7640 1 -- start start 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809c7b7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8094144750 0x7f809406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809c7b7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f809406eb10 0x7f80940ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809c7b7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80940cee60 0x7f809415f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809c7b7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8094144b30 con 0x7f80940cee60 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809c7b7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80940712d0 con 0x7f809406eb10 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809c7b7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80940715b0 con 0x7f8094144750 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809ad54640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80940cee60 0x7f809415f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809ad54640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80940cee60 0x7f809415f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35522/0 (socket says 172.21.15.172:35522) 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809ad54640 1 -- 172.21.15.172:0/1289065886 learned_addr learned my addr 172.21.15.172:0/1289065886 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809a553640 1 --2- 172.21.15.172:0/1289065886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8094144750 0x7f809406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f8099d52640 1 --2- 172.21.15.172:0/1289065886 >> v2:172.21.15.186:3300/0 conn(0x7f809406eb10 0x7f80940ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809ad54640 1 -- 172.21.15.172:0/1289065886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8094144750 msgr2=0x7f809406e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:40.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809ad54640 1 --2- 172.21.15.172:0/1289065886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8094144750 0x7f809406e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809ad54640 1 -- 172.21.15.172:0/1289065886 >> v2:172.21.15.186:3300/0 conn(0x7f809406eb10 msgr2=0x7f80940ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:40.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809ad54640 1 --2- 172.21.15.172:0/1289065886 >> v2:172.21.15.186:3300/0 conn(0x7f809406eb10 0x7f80940ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.132+0000 7f809ad54640 1 -- 172.21.15.172:0/1289065886 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8094071890 con 0x7f80940cee60 2024-04-25T08:43:40.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.133+0000 7f8099d52640 1 --2- 172.21.15.172:0/1289065886 >> v2:172.21.15.186:3300/0 conn(0x7f809406eb10 0x7f80940ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:40.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.133+0000 7f809ad54640 1 --2- 172.21.15.172:0/1289065886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80940cee60 0x7f809415f610 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f80940cd3d0 tx=0x7f808c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7daf3b10ffe28f14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:40.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.133+0000 7f8099551640 1 -- 172.21.15.172:0/1289065886 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c037070 con 0x7f80940cee60 2024-04-25T08:43:40.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.133+0000 7f8099551640 1 -- 172.21.15.172:0/1289065886 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c032440 con 0x7f80940cee60 2024-04-25T08:43:40.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.133+0000 7f8099551640 1 -- 172.21.15.172:0/1289065886 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c032810 con 0x7f80940cee60 2024-04-25T08:43:40.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.134+0000 7f809c7b7640 1 -- 172.21.15.172:0/1289065886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80940cee60 msgr2=0x7f809415f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.134+0000 7f809c7b7640 1 --2- 172.21.15.172:0/1289065886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80940cee60 0x7f809415f610 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f80940cd3d0 tx=0x7f808c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.134+0000 7f809c7b7640 1 -- 172.21.15.172:0/1289065886 shutdown_connections 2024-04-25T08:43:40.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.134+0000 7f809c7b7640 1 --2- 172.21.15.172:0/1289065886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80940cee60 0x7f809415f610 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.134+0000 7f809c7b7640 1 --2- 172.21.15.172:0/1289065886 >> v2:172.21.15.186:3300/0 conn(0x7f809406eb10 0x7f80940ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.134+0000 7f809c7b7640 1 --2- 172.21.15.172:0/1289065886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8094144750 0x7f809406e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.134+0000 7f809c7b7640 1 -- 172.21.15.172:0/1289065886 >> 172.21.15.172:0/1289065886 conn(0x7f809406abe0 msgr2=0x7f809406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:40.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.134+0000 7f809c7b7640 1 -- 172.21.15.172:0/1289065886 shutdown_connections 2024-04-25T08:43:40.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.134+0000 7f809c7b7640 1 -- 172.21.15.172:0/1289065886 wait complete. 2024-04-25T08:43:40.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.135+0000 7f809c7b7640 1 Processor -- start 2024-04-25T08:43:40.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.135+0000 7f809c7b7640 1 -- start start 2024-04-25T08:43:40.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809c7b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f809406eb10 0x7f80941f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809c7b7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80940cee60 0x7f80940a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809c7b7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8094144750 0x7f80940a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809c7b7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8094145450 con 0x7f809406eb10 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809c7b7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809406f020 con 0x7f8094144750 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809c7b7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80941455d0 con 0x7f80940cee60 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809a553640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f809406eb10 0x7f80941f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809a553640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f809406eb10 0x7f80941f2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35532/0 (socket says 172.21.15.172:35532) 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809a553640 1 -- 172.21.15.172:0/378788803 learned_addr learned my addr 172.21.15.172:0/378788803 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f8099d52640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80940cee60 0x7f80940a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809ad54640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8094144750 0x7f80940a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809a553640 1 -- 172.21.15.172:0/378788803 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80940cee60 msgr2=0x7f80940a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809a553640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80940cee60 0x7f80940a8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809a553640 1 -- 172.21.15.172:0/378788803 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8094144750 msgr2=0x7f80940a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809a553640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8094144750 0x7f80940a9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.136+0000 7f809a553640 1 -- 172.21.15.172:0/378788803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809415ccc0 con 0x7f809406eb10 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.137+0000 7f809a553640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f809406eb10 0x7f80941f2210 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8090009db0 tx=0x7f809000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.137+0000 7f808affd640 1 -- 172.21.15.172:0/378788803 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090018020 con 0x7f809406eb10 2024-04-25T08:43:40.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.137+0000 7f808affd640 1 -- 172.21.15.172:0/378788803 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090014480 con 0x7f809406eb10 2024-04-25T08:43:40.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.137+0000 7f809c7b7640 1 -- 172.21.15.172:0/378788803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809415cfa0 con 0x7f809406eb10 2024-04-25T08:43:40.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.137+0000 7f808affd640 1 -- 172.21.15.172:0/378788803 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090014850 con 0x7f809406eb10 2024-04-25T08:43:40.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.137+0000 7f809c7b7640 1 -- 172.21.15.172:0/378788803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809415d560 con 0x7f809406eb10 2024-04-25T08:43:40.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.138+0000 7f809c7b7640 1 -- 172.21.15.172:0/378788803 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8094073990 con 0x7f809406eb10 2024-04-25T08:43:40.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.138+0000 7f808affd640 1 -- 172.21.15.172:0/378788803 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8090005d10 con 0x7f809406eb10 2024-04-25T08:43:40.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.138+0000 7f808affd640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f807806b4d0 0x7f807806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.138+0000 7f808affd640 1 -- 172.21.15.172:0/378788803 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f809008ae70 con 0x7f809406eb10 2024-04-25T08:43:40.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.138+0000 7f8099d52640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f807806b4d0 0x7f807806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.139+0000 7f8099d52640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f807806b4d0 0x7f807806d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8084006fd0 tx=0x7f8084008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:40.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.142+0000 7f808affd640 1 -- 172.21.15.172:0/378788803 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8090022070 con 0x7f809406eb10 2024-04-25T08:43:40.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.310+0000 7f809c7b7640 1 -- 172.21.15.172:0/378788803 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80940d0510 con 0x7f807806b4d0 2024-04-25T08:43:40.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.316+0000 7f808affd640 1 -- 172.21.15.172:0/378788803 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241611 (secure 0 0 0) 0x7f80940d0510 con 0x7f807806b4d0 2024-04-25T08:43:40.310 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:40.311 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:43:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 -- 172.21.15.172:0/378788803 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f807806b4d0 msgr2=0x7f807806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f807806b4d0 0x7f807806d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8084006fd0 tx=0x7f8084008040 comp rx=0 tx=0).stop 2024-04-25T08:43:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 -- 172.21.15.172:0/378788803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f809406eb10 msgr2=0x7f80941f2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f809406eb10 0x7f80941f2210 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8090009db0 tx=0x7f809000c490 comp rx=0 tx=0).stop 2024-04-25T08:43:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 -- 172.21.15.172:0/378788803 shutdown_connections 2024-04-25T08:43:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f807806b4d0 0x7f807806d990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8094144750 0x7f80940a9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80940cee60 0x7f80940a8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 --2- 172.21.15.172:0/378788803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f809406eb10 0x7f80941f2210 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 -- 172.21.15.172:0/378788803 >> 172.21.15.172:0/378788803 conn(0x7f809406abe0 msgr2=0x7f809413f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 -- 172.21.15.172:0/378788803 shutdown_connections 2024-04-25T08:43:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.319+0000 7f809c7b7640 1 -- 172.21.15.172:0/378788803 wait complete. 2024-04-25T08:43:40.322 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-04-25T08:43:38.526505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220484,"kb_used_data":4224,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754236,"statfs":{"total":773094113280,"available":772868337664,"internally_reserved":0,"allocated":4325376,"data_stored":2499498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000473"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365513+0000","last_change":"2024-04-25T08:43:36.365513+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365513+0000","last_undegraded":"2024-04-25T08:43:36.365513+0000","last_fullsized":"2024-04-25T08:43:36.365513+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364651+0000","last_change":"2024-04-25T08:43:36.364651+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364651+0000","last_undegraded":"2024-04-25T08:43:36.364651+0000","last_fullsized":"2024-04-25T08:43:36.364651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354982+0000","last_change":"2024-04-25T08:43:36.354982+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354982+0000","last_undegraded":"2024-04-25T08:43:36.354982+0000","last_fullsized":"2024-04-25T08:43:36.354982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354415+0000","last_change":"2024-04-25T08:43:36.354415+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354415+0000","last_undegraded":"2024-04-25T08:43:36.354415+0000","last_fullsized":"2024-04-25T08:43:36.354415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365066+0000","last_change":"2024-04-25T08:43:36.365066+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365066+0000","last_undegraded":"2024-04-25T08:43:36.365066+0000","last_fullsized":"2024-04-25T08:43:36.365066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.355373+0000","last_change":"2024-04-25T08:43:36.355373+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.355373+0000","last_undegraded":"2024-04-25T08:43:36.355373+0000","last_fullsized":"2024-04-25T08:43:36.355373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354396+0000","last_change":"2024-04-25T08:43:36.354396+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354396+0000","last_undegraded":"2024-04-25T08:43:36.354396+0000","last_fullsized":"2024-04-25T08:43:36.354396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354683+0000","last_change":"2024-04-25T08:43:36.354683+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354683+0000","last_undegraded":"2024-04-25T08:43:36.354683+0000","last_fullsized":"2024-04-25T08:43:36.354683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.355426+0000","last_change":"2024-04-25T08:43:36.355426+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.355426+0000","last_undegraded":"2024-04-25T08:43:36.355426+0000","last_fullsized":"2024-04-25T08:43:36.355426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364173+0000","last_change":"2024-04-25T08:43:36.364173+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364173+0000","last_undegraded":"2024-04-25T08:43:36.364173+0000","last_fullsized":"2024-04-25T08:43:36.364173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.363035+0000","last_change":"2024-04-25T08:43:36.363035+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.363035+0000","last_undegraded":"2024-04-25T08:43:36.363035+0000","last_fullsized":"2024-04-25T08:43:36.363035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.367125+0000","last_change":"2024-04-25T08:43:36.362931+0000","last_active":"2024-04-25T08:43:36.367125+0000","last_peered":"2024-04-25T08:43:36.367125+0000","last_clean":"2024-04-25T08:43:36.367125+0000","last_became_active":"2024-04-25T08:43:36.362595+0000","last_became_peered":"2024-04-25T08:43:36.362595+0000","last_unstale":"2024-04-25T08:43:36.367125+0000","last_undegraded":"2024-04-25T08:43:36.367125+0000","last_fullsized":"2024-04-25T08:43:36.367125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:57.138643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353638+0000","last_change":"2024-04-25T08:43:35.353638+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353638+0000","last_undegraded":"2024-04-25T08:43:35.353638+0000","last_fullsized":"2024-04-25T08:43:35.353638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352129+0000","last_change":"2024-04-25T08:43:35.352129+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352129+0000","last_undegraded":"2024-04-25T08:43:35.352129+0000","last_fullsized":"2024-04-25T08:43:35.352129+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355351+0000","last_change":"2024-04-25T08:43:35.355351+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355351+0000","last_undegraded":"2024-04-25T08:43:35.355351+0000","last_fullsized":"2024-04-25T08:43:35.355351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351127+0000","last_change":"2024-04-25T08:43:35.351127+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351127+0000","last_undegraded":"2024-04-25T08:43:35.351127+0000","last_fullsized":"2024-04-25T08:43:35.351127+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.372902+0000","last_change":"2024-04-25T08:43:36.370505+0000","last_active":"2024-04-25T08:43:36.372902+0000","last_peered":"2024-04-25T08:43:36.372902+0000","last_clean":"2024-04-25T08:43:36.372902+0000","last_became_active":"2024-04-25T08:43:36.370213+0000","last_became_peered":"2024-04-25T08:43:36.370213+0000","last_unstale":"2024-04-25T08:43:36.372902+0000","last_undegraded":"2024-04-25T08:43:36.372902+0000","last_fullsized":"2024-04-25T08:43:36.372902+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:13.283542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352097+0000","last_change":"2024-04-25T08:43:35.352097+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352097+0000","last_undegraded":"2024-04-25T08:43:35.352097+0000","last_fullsized":"2024-04-25T08:43:35.352097+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355249+0000","last_change":"2024-04-25T08:43:35.355249+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355249+0000","last_undegraded":"2024-04-25T08:43:35.355249+0000","last_fullsized":"2024-04-25T08:43:35.355249+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354716+0000","last_change":"2024-04-25T08:43:35.354716+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354716+0000","last_undegraded":"2024-04-25T08:43:35.354716+0000","last_fullsized":"2024-04-25T08:43:35.354716+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365506+0000","last_change":"2024-04-25T08:43:36.365506+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365506+0000","last_undegraded":"2024-04-25T08:43:36.365506+0000","last_fullsized":"2024-04-25T08:43:36.365506+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351439+0000","last_change":"2024-04-25T08:43:35.351439+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351439+0000","last_undegraded":"2024-04-25T08:43:35.351439+0000","last_fullsized":"2024-04-25T08:43:35.351439+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351726+0000","last_change":"2024-04-25T08:43:35.351726+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351726+0000","last_undegraded":"2024-04-25T08:43:35.351726+0000","last_fullsized":"2024-04-25T08:43:35.351726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354675+0000","last_change":"2024-04-25T08:43:35.354675+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354675+0000","last_undegraded":"2024-04-25T08:43:35.354675+0000","last_fullsized":"2024-04-25T08:43:35.354675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354683+0000","last_change":"2024-04-25T08:43:35.354683+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354683+0000","last_undegraded":"2024-04-25T08:43:35.354683+0000","last_fullsized":"2024-04-25T08:43:35.354683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351989+0000","last_change":"2024-04-25T08:43:35.351989+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351989+0000","last_undegraded":"2024-04-25T08:43:35.351989+0000","last_fullsized":"2024-04-25T08:43:35.351989+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.363803+0000","last_change":"2024-04-25T08:43:36.363803+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.363803+0000","last_undegraded":"2024-04-25T08:43:36.363803+0000","last_fullsized":"2024-04-25T08:43:36.363803+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.369455+0000","last_change":"2024-04-25T08:43:36.367865+0000","last_active":"2024-04-25T08:43:36.369455+0000","last_peered":"2024-04-25T08:43:36.369455+0000","last_clean":"2024-04-25T08:43:36.369455+0000","last_became_active":"2024-04-25T08:43:36.367571+0000","last_became_peered":"2024-04-25T08:43:36.367571+0000","last_unstale":"2024-04-25T08:43:36.369455+0000","last_undegraded":"2024-04-25T08:43:36.369455+0000","last_fullsized":"2024-04-25T08:43:36.369455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:42.606872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.374079+0000","last_change":"2024-04-25T08:43:36.372180+0000","last_active":"2024-04-25T08:43:36.374079+0000","last_peered":"2024-04-25T08:43:36.374079+0000","last_clean":"2024-04-25T08:43:36.374079+0000","last_became_active":"2024-04-25T08:43:36.371910+0000","last_became_peered":"2024-04-25T08:43:36.371910+0000","last_unstale":"2024-04-25T08:43:36.374079+0000","last_undegraded":"2024-04-25T08:43:36.374079+0000","last_fullsized":"2024-04-25T08:43:36.374079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:36.695080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352276+0000","last_change":"2024-04-25T08:43:35.352276+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352276+0000","last_undegraded":"2024-04-25T08:43:35.352276+0000","last_fullsized":"2024-04-25T08:43:35.352276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355412+0000","last_change":"2024-04-25T08:43:35.355412+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355412+0000","last_undegraded":"2024-04-25T08:43:35.355412+0000","last_fullsized":"2024-04-25T08:43:35.355412+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358163+0000","last_change":"2024-04-25T08:43:35.358163+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358163+0000","last_undegraded":"2024-04-25T08:43:35.358163+0000","last_fullsized":"2024-04-25T08:43:35.358163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351995+0000","last_change":"2024-04-25T08:43:35.351995+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351995+0000","last_undegraded":"2024-04-25T08:43:35.351995+0000","last_fullsized":"2024-04-25T08:43:35.351995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364167+0000","last_change":"2024-04-25T08:43:36.364167+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364167+0000","last_undegraded":"2024-04-25T08:43:36.364167+0000","last_fullsized":"2024-04-25T08:43:36.364167+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358163+0000","last_change":"2024-04-25T08:43:35.358163+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358163+0000","last_undegraded":"2024-04-25T08:43:35.358163+0000","last_fullsized":"2024-04-25T08:43:35.358163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358079+0000","last_change":"2024-04-25T08:43:35.358079+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358079+0000","last_undegraded":"2024-04-25T08:43:35.358079+0000","last_fullsized":"2024-04-25T08:43:35.358079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.375069+0000","last_change":"2024-04-25T08:43:36.373963+0000","last_active":"2024-04-25T08:43:36.375069+0000","last_peered":"2024-04-25T08:43:36.375069+0000","last_clean":"2024-04-25T08:43:36.375069+0000","last_became_active":"2024-04-25T08:43:36.373670+0000","last_became_peered":"2024-04-25T08:43:36.373670+0000","last_unstale":"2024-04-25T08:43:36.375069+0000","last_undegraded":"2024-04-25T08:43:36.375069+0000","last_fullsized":"2024-04-25T08:43:36.375069+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:29.822090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358286+0000","last_change":"2024-04-25T08:43:35.358286+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358286+0000","last_undegraded":"2024-04-25T08:43:35.358286+0000","last_fullsized":"2024-04-25T08:43:35.358286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351734+0000","last_change":"2024-04-25T08:43:35.351734+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351734+0000","last_undegraded":"2024-04-25T08:43:35.351734+0000","last_fullsized":"2024-04-25T08:43:35.351734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365096+0000","last_change":"2024-04-25T08:43:36.365096+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365096+0000","last_undegraded":"2024-04-25T08:43:36.365096+0000","last_fullsized":"2024-04-25T08:43:36.365096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358105+0000","last_change":"2024-04-25T08:43:35.358105+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358105+0000","last_undegraded":"2024-04-25T08:43:35.358105+0000","last_fullsized":"2024-04-25T08:43:35.358105+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353649+0000","last_change":"2024-04-25T08:43:35.353649+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353649+0000","last_undegraded":"2024-04-25T08:43:35.353649+0000","last_fullsized":"2024-04-25T08:43:35.353649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353638+0000","last_change":"2024-04-25T08:43:35.353638+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353638+0000","last_undegraded":"2024-04-25T08:43:35.353638+0000","last_fullsized":"2024-04-25T08:43:35.353638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.370700+0000","last_change":"2024-04-25T08:43:36.368863+0000","last_active":"2024-04-25T08:43:36.370700+0000","last_peered":"2024-04-25T08:43:36.370700+0000","last_clean":"2024-04-25T08:43:36.370700+0000","last_became_active":"2024-04-25T08:43:36.368563+0000","last_became_peered":"2024-04-25T08:43:36.368563+0000","last_unstale":"2024-04-25T08:43:36.370700+0000","last_undegraded":"2024-04-25T08:43:36.370700+0000","last_fullsized":"2024-04-25T08:43:36.370700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:52.443687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355207+0000","last_change":"2024-04-25T08:43:35.355207+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355207+0000","last_undegraded":"2024-04-25T08:43:35.355207+0000","last_fullsized":"2024-04-25T08:43:35.355207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.361889+0000","last_change":"2024-04-25T08:43:36.361889+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.361889+0000","last_undegraded":"2024-04-25T08:43:36.361889+0000","last_fullsized":"2024-04-25T08:43:36.361889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354686+0000","last_change":"2024-04-25T08:43:35.354686+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354686+0000","last_undegraded":"2024-04-25T08:43:35.354686+0000","last_fullsized":"2024-04-25T08:43:35.354686+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.372926+0000","last_change":"2024-04-25T08:43:36.370869+0000","last_active":"2024-04-25T08:43:36.372926+0000","last_peered":"2024-04-25T08:43:36.372926+0000","last_clean":"2024-04-25T08:43:36.372926+0000","last_became_active":"2024-04-25T08:43:36.370179+0000","last_became_peered":"2024-04-25T08:43:36.370179+0000","last_unstale":"2024-04-25T08:43:36.372926+0000","last_undegraded":"2024-04-25T08:43:36.372926+0000","last_fullsized":"2024-04-25T08:43:36.372926+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:02.953547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.366036+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:43:36.366036+0000","last_peered":"2024-04-25T08:43:36.366036+0000","last_clean":"2024-04-25T08:43:36.366036+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:43:36.366036+0000","last_undegraded":"2024-04-25T08:43:36.366036+0000","last_fullsized":"2024-04-25T08:43:36.366036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":759870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:43:40.325 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:43:40.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.467+0000 7f5e809d5640 1 Processor -- start 2024-04-25T08:43:40.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.467+0000 7f5e809d5640 1 -- start start 2024-04-25T08:43:40.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e809d5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5e7c15dc90 0x7f5e7c1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e809d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 0x7f5e7c15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e809d5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c15f390 con 0x7f5e7c0d1810 2024-04-25T08:43:40.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e809d5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7c0cce50 con 0x7f5e7c15dc90 2024-04-25T08:43:40.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e809d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c161af0 con 0x7f5e7c0cc8e0 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e7ad9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5e7c0d1810 0x7f5e7c0cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42690/0 (socket says 172.21.15.172:42690) 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e7ad9d640 1 -- 172.21.15.172:0/443737474 learned_addr learned my addr 172.21.15.172:0/443737474 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e7a59c640 1 --2- 172.21.15.172:0/443737474 >> v2:172.21.15.186:3300/0 conn(0x7f5e7c15dc90 0x7f5e7c1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e73fff640 1 --2- 172.21.15.172:0/443737474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 0x7f5e7c15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e79d9b640 1 -- 172.21.15.172:0/443737474 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344514677 0 0) 0x7f5e74001490 con 0x7f5e7c0d1810 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e79d9b640 1 -- 172.21.15.172:0/443737474 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e68003520 con 0x7f5e7c0d1810 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e79d9b640 1 -- 172.21.15.172:0/443737474 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2948116869 0 0) 0x7f5e68003520 con 0x7f5e7c0d1810 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e7a59c640 1 -- 172.21.15.172:0/443737474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 msgr2=0x7f5e7c15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e7a59c640 1 --2- 172.21.15.172:0/443737474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 0x7f5e7c15ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e7a59c640 1 -- 172.21.15.172:0/443737474 >> v1:172.21.15.172:6789/0 conn(0x7f5e7c0d1810 legacy=0x7f5e7c0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e7a59c640 1 -- 172.21.15.172:0/443737474 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c161dd0 con 0x7f5e7c15dc90 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.468+0000 7f5e73fff640 1 --2- 172.21.15.172:0/443737474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 0x7f5e7c15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.469+0000 7f5e7a59c640 1 --2- 172.21.15.172:0/443737474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e7c15dc90 0x7f5e7c1625d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0097a0 tx=0x7f5e6c02a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=154a95b4522afb2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.469+0000 7f5e79d9b640 1 -- 172.21.15.172:0/443737474 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c037070 con 0x7f5e7c15dc90 2024-04-25T08:43:40.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.469+0000 7f5e79d9b640 1 -- 172.21.15.172:0/443737474 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c02ab10 con 0x7f5e7c15dc90 2024-04-25T08:43:40.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.469+0000 7f5e79d9b640 1 -- 172.21.15.172:0/443737474 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74001bc0 con 0x7f5e7c15dc90 2024-04-25T08:43:40.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.470+0000 7f5e809d5640 1 -- 172.21.15.172:0/443737474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e7c15dc90 msgr2=0x7f5e7c1625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.470+0000 7f5e809d5640 1 --2- 172.21.15.172:0/443737474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e7c15dc90 0x7f5e7c1625d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0097a0 tx=0x7f5e6c02a080 comp rx=0 tx=0).stop 2024-04-25T08:43:40.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.470+0000 7f5e809d5640 1 -- 172.21.15.172:0/443737474 shutdown_connections 2024-04-25T08:43:40.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.470+0000 7f5e809d5640 1 --2- 172.21.15.172:0/443737474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 0x7f5e7c15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.470+0000 7f5e809d5640 1 --2- 172.21.15.172:0/443737474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e7c15dc90 0x7f5e7c1625d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.470+0000 7f5e809d5640 1 -- 172.21.15.172:0/443737474 >> 172.21.15.172:0/443737474 conn(0x7f5e7c06f590 msgr2=0x7f5e7c06f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:40.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.470+0000 7f5e809d5640 1 -- 172.21.15.172:0/443737474 shutdown_connections 2024-04-25T08:43:40.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.470+0000 7f5e809d5640 1 -- 172.21.15.172:0/443737474 wait complete. 2024-04-25T08:43:40.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.471+0000 7f5e809d5640 1 Processor -- start 2024-04-25T08:43:40.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.471+0000 7f5e809d5640 1 -- start start 2024-04-25T08:43:40.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e809d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 0x7f5e7c1605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e809d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e7c0d1810 0x7f5e7c153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e809d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e7c15dc90 0x7f5e7c0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e809d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c15e070 con 0x7f5e7c15dc90 2024-04-25T08:43:40.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e809d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c0cd130 con 0x7f5e7c0d1810 2024-04-25T08:43:40.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e809d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c15e1f0 con 0x7f5e7c0cc8e0 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e7ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e7c15dc90 0x7f5e7c0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e7ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e7c15dc90 0x7f5e7c0b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35548/0 (socket says 172.21.15.172:35548) 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e7ad9d640 1 -- 172.21.15.172:0/3070608715 learned_addr learned my addr 172.21.15.172:0/3070608715 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e73fff640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e7c0d1810 0x7f5e7c153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e7a59c640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 0x7f5e7c1605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e7ad9d640 1 -- 172.21.15.172:0/3070608715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 msgr2=0x7f5e7c1605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e7ad9d640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 0x7f5e7c1605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e7ad9d640 1 -- 172.21.15.172:0/3070608715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e7c0d1810 msgr2=0x7f5e7c153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e7ad9d640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e7c0d1810 0x7f5e7c153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e7ad9d640 1 -- 172.21.15.172:0/3070608715 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0b5640 con 0x7f5e7c15dc90 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.472+0000 7f5e73fff640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e7c0d1810 0x7f5e7c153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.473+0000 7f5e7ad9d640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e7c15dc90 0x7f5e7c0b4ef0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5e74002230 tx=0x7f5e7400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.473+0000 7f5e72ffd640 1 -- 172.21.15.172:0/3070608715 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74017070 con 0x7f5e7c15dc90 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.473+0000 7f5e72ffd640 1 -- 172.21.15.172:0/3070608715 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7400ad00 con 0x7f5e7c15dc90 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.473+0000 7f5e809d5640 1 -- 172.21.15.172:0/3070608715 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7c0b5920 con 0x7f5e7c15dc90 2024-04-25T08:43:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.473+0000 7f5e72ffd640 1 -- 172.21.15.172:0/3070608715 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e74012640 con 0x7f5e7c15dc90 2024-04-25T08:43:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.473+0000 7f5e809d5640 1 -- 172.21.15.172:0/3070608715 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c0b5ee0 con 0x7f5e7c15dc90 2024-04-25T08:43:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.474+0000 7f5e809d5640 1 -- 172.21.15.172:0/3070608715 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c0b6210 con 0x7f5e7c15dc90 2024-04-25T08:43:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.474+0000 7f5e72ffd640 1 -- 172.21.15.172:0/3070608715 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e7401a070 con 0x7f5e7c15dc90 2024-04-25T08:43:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.475+0000 7f5e72ffd640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e5c06b4d0 0x7f5e5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.475+0000 7f5e7a59c640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e5c06b4d0 0x7f5e5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.475+0000 7f5e72ffd640 1 -- 172.21.15.172:0/3070608715 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5e7408a1e0 con 0x7f5e7c15dc90 2024-04-25T08:43:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.475+0000 7f5e7a59c640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e5c06b4d0 0x7f5e5c06d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c034000 tx=0x7f5e6c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.479+0000 7f5e72ffd640 1 -- 172.21.15.172:0/3070608715 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e7c15f390 con 0x7f5e7c15dc90 2024-04-25T08:43:40.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.649+0000 7f5e809d5640 1 -- 172.21.15.172:0/3070608715 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e7c073990 con 0x7f5e5c06b4d0 2024-04-25T08:43:40.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.655+0000 7f5e72ffd640 1 -- 172.21.15.172:0/3070608715 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241611 (secure 0 0 0) 0x7f5e7c073990 con 0x7f5e5c06b4d0 2024-04-25T08:43:40.649 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:40.650 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.657+0000 7f5e809d5640 1 -- 172.21.15.172:0/3070608715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e5c06b4d0 msgr2=0x7f5e5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.657+0000 7f5e809d5640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e5c06b4d0 0x7f5e5c06d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c034000 tx=0x7f5e6c02e000 comp rx=0 tx=0).stop 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.657+0000 7f5e809d5640 1 -- 172.21.15.172:0/3070608715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e7c15dc90 msgr2=0x7f5e7c0b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.657+0000 7f5e809d5640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e7c15dc90 0x7f5e7c0b4ef0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5e74002230 tx=0x7f5e7400a430 comp rx=0 tx=0).stop 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.658+0000 7f5e809d5640 1 -- 172.21.15.172:0/3070608715 shutdown_connections 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.658+0000 7f5e809d5640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e5c06b4d0 0x7f5e5c06d990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.658+0000 7f5e809d5640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e7c0d1810 0x7f5e7c153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.658+0000 7f5e809d5640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e7c15dc90 0x7f5e7c0b4ef0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.658+0000 7f5e809d5640 1 --2- 172.21.15.172:0/3070608715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e7c0cc8e0 0x7f5e7c1605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.658+0000 7f5e809d5640 1 -- 172.21.15.172:0/3070608715 >> 172.21.15.172:0/3070608715 conn(0x7f5e7c06f590 msgr2=0x7f5e7c06d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.658+0000 7f5e809d5640 1 -- 172.21.15.172:0/3070608715 shutdown_connections 2024-04-25T08:43:40.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.658+0000 7f5e809d5640 1 -- 172.21.15.172:0/3070608715 wait complete. 2024-04-25T08:43:40.660 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-25T08:43:40.526776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220484,"kb_used_data":4224,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754236,"statfs":{"total":773094113280,"available":772868337664,"internally_reserved":0,"allocated":4325376,"data_stored":2499498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.177798"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365513+0000","last_change":"2024-04-25T08:43:36.365513+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365513+0000","last_undegraded":"2024-04-25T08:43:36.365513+0000","last_fullsized":"2024-04-25T08:43:36.365513+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364651+0000","last_change":"2024-04-25T08:43:36.364651+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364651+0000","last_undegraded":"2024-04-25T08:43:36.364651+0000","last_fullsized":"2024-04-25T08:43:36.364651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354982+0000","last_change":"2024-04-25T08:43:36.354982+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354982+0000","last_undegraded":"2024-04-25T08:43:36.354982+0000","last_fullsized":"2024-04-25T08:43:36.354982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354415+0000","last_change":"2024-04-25T08:43:36.354415+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354415+0000","last_undegraded":"2024-04-25T08:43:36.354415+0000","last_fullsized":"2024-04-25T08:43:36.354415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365066+0000","last_change":"2024-04-25T08:43:36.365066+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365066+0000","last_undegraded":"2024-04-25T08:43:36.365066+0000","last_fullsized":"2024-04-25T08:43:36.365066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.355373+0000","last_change":"2024-04-25T08:43:36.355373+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.355373+0000","last_undegraded":"2024-04-25T08:43:36.355373+0000","last_fullsized":"2024-04-25T08:43:36.355373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354396+0000","last_change":"2024-04-25T08:43:36.354396+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354396+0000","last_undegraded":"2024-04-25T08:43:36.354396+0000","last_fullsized":"2024-04-25T08:43:36.354396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354683+0000","last_change":"2024-04-25T08:43:36.354683+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354683+0000","last_undegraded":"2024-04-25T08:43:36.354683+0000","last_fullsized":"2024-04-25T08:43:36.354683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.355426+0000","last_change":"2024-04-25T08:43:36.355426+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.355426+0000","last_undegraded":"2024-04-25T08:43:36.355426+0000","last_fullsized":"2024-04-25T08:43:36.355426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364173+0000","last_change":"2024-04-25T08:43:36.364173+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364173+0000","last_undegraded":"2024-04-25T08:43:36.364173+0000","last_fullsized":"2024-04-25T08:43:36.364173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.363035+0000","last_change":"2024-04-25T08:43:36.363035+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.363035+0000","last_undegraded":"2024-04-25T08:43:36.363035+0000","last_fullsized":"2024-04-25T08:43:36.363035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.367125+0000","last_change":"2024-04-25T08:43:36.362931+0000","last_active":"2024-04-25T08:43:36.367125+0000","last_peered":"2024-04-25T08:43:36.367125+0000","last_clean":"2024-04-25T08:43:36.367125+0000","last_became_active":"2024-04-25T08:43:36.362595+0000","last_became_peered":"2024-04-25T08:43:36.362595+0000","last_unstale":"2024-04-25T08:43:36.367125+0000","last_undegraded":"2024-04-25T08:43:36.367125+0000","last_fullsized":"2024-04-25T08:43:36.367125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:57.138643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353638+0000","last_change":"2024-04-25T08:43:35.353638+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353638+0000","last_undegraded":"2024-04-25T08:43:35.353638+0000","last_fullsized":"2024-04-25T08:43:35.353638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352129+0000","last_change":"2024-04-25T08:43:35.352129+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352129+0000","last_undegraded":"2024-04-25T08:43:35.352129+0000","last_fullsized":"2024-04-25T08:43:35.352129+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355351+0000","last_change":"2024-04-25T08:43:35.355351+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355351+0000","last_undegraded":"2024-04-25T08:43:35.355351+0000","last_fullsized":"2024-04-25T08:43:35.355351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351127+0000","last_change":"2024-04-25T08:43:35.351127+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351127+0000","last_undegraded":"2024-04-25T08:43:35.351127+0000","last_fullsized":"2024-04-25T08:43:35.351127+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.372902+0000","last_change":"2024-04-25T08:43:36.370505+0000","last_active":"2024-04-25T08:43:36.372902+0000","last_peered":"2024-04-25T08:43:36.372902+0000","last_clean":"2024-04-25T08:43:36.372902+0000","last_became_active":"2024-04-25T08:43:36.370213+0000","last_became_peered":"2024-04-25T08:43:36.370213+0000","last_unstale":"2024-04-25T08:43:36.372902+0000","last_undegraded":"2024-04-25T08:43:36.372902+0000","last_fullsized":"2024-04-25T08:43:36.372902+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:13.283542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352097+0000","last_change":"2024-04-25T08:43:35.352097+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352097+0000","last_undegraded":"2024-04-25T08:43:35.352097+0000","last_fullsized":"2024-04-25T08:43:35.352097+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355249+0000","last_change":"2024-04-25T08:43:35.355249+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355249+0000","last_undegraded":"2024-04-25T08:43:35.355249+0000","last_fullsized":"2024-04-25T08:43:35.355249+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354716+0000","last_change":"2024-04-25T08:43:35.354716+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354716+0000","last_undegraded":"2024-04-25T08:43:35.354716+0000","last_fullsized":"2024-04-25T08:43:35.354716+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365506+0000","last_change":"2024-04-25T08:43:36.365506+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365506+0000","last_undegraded":"2024-04-25T08:43:36.365506+0000","last_fullsized":"2024-04-25T08:43:36.365506+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351439+0000","last_change":"2024-04-25T08:43:35.351439+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351439+0000","last_undegraded":"2024-04-25T08:43:35.351439+0000","last_fullsized":"2024-04-25T08:43:35.351439+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351726+0000","last_change":"2024-04-25T08:43:35.351726+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351726+0000","last_undegraded":"2024-04-25T08:43:35.351726+0000","last_fullsized":"2024-04-25T08:43:35.351726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354675+0000","last_change":"2024-04-25T08:43:35.354675+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354675+0000","last_undegraded":"2024-04-25T08:43:35.354675+0000","last_fullsized":"2024-04-25T08:43:35.354675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354683+0000","last_change":"2024-04-25T08:43:35.354683+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354683+0000","last_undegraded":"2024-04-25T08:43:35.354683+0000","last_fullsized":"2024-04-25T08:43:35.354683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351989+0000","last_change":"2024-04-25T08:43:35.351989+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351989+0000","last_undegraded":"2024-04-25T08:43:35.351989+0000","last_fullsized":"2024-04-25T08:43:35.351989+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.363803+0000","last_change":"2024-04-25T08:43:36.363803+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.363803+0000","last_undegraded":"2024-04-25T08:43:36.363803+0000","last_fullsized":"2024-04-25T08:43:36.363803+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.369455+0000","last_change":"2024-04-25T08:43:36.367865+0000","last_active":"2024-04-25T08:43:36.369455+0000","last_peered":"2024-04-25T08:43:36.369455+0000","last_clean":"2024-04-25T08:43:36.369455+0000","last_became_active":"2024-04-25T08:43:36.367571+0000","last_became_peered":"2024-04-25T08:43:36.367571+0000","last_unstale":"2024-04-25T08:43:36.369455+0000","last_undegraded":"2024-04-25T08:43:36.369455+0000","last_fullsized":"2024-04-25T08:43:36.369455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:42.606872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.374079+0000","last_change":"2024-04-25T08:43:36.372180+0000","last_active":"2024-04-25T08:43:36.374079+0000","last_peered":"2024-04-25T08:43:36.374079+0000","last_clean":"2024-04-25T08:43:36.374079+0000","last_became_active":"2024-04-25T08:43:36.371910+0000","last_became_peered":"2024-04-25T08:43:36.371910+0000","last_unstale":"2024-04-25T08:43:36.374079+0000","last_undegraded":"2024-04-25T08:43:36.374079+0000","last_fullsized":"2024-04-25T08:43:36.374079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:36.695080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352276+0000","last_change":"2024-04-25T08:43:35.352276+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352276+0000","last_undegraded":"2024-04-25T08:43:35.352276+0000","last_fullsized":"2024-04-25T08:43:35.352276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355412+0000","last_change":"2024-04-25T08:43:35.355412+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355412+0000","last_undegraded":"2024-04-25T08:43:35.355412+0000","last_fullsized":"2024-04-25T08:43:35.355412+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358163+0000","last_change":"2024-04-25T08:43:35.358163+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358163+0000","last_undegraded":"2024-04-25T08:43:35.358163+0000","last_fullsized":"2024-04-25T08:43:35.358163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351995+0000","last_change":"2024-04-25T08:43:35.351995+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351995+0000","last_undegraded":"2024-04-25T08:43:35.351995+0000","last_fullsized":"2024-04-25T08:43:35.351995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364167+0000","last_change":"2024-04-25T08:43:36.364167+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364167+0000","last_undegraded":"2024-04-25T08:43:36.364167+0000","last_fullsized":"2024-04-25T08:43:36.364167+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358163+0000","last_change":"2024-04-25T08:43:35.358163+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358163+0000","last_undegraded":"2024-04-25T08:43:35.358163+0000","last_fullsized":"2024-04-25T08:43:35.358163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358079+0000","last_change":"2024-04-25T08:43:35.358079+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358079+0000","last_undegraded":"2024-04-25T08:43:35.358079+0000","last_fullsized":"2024-04-25T08:43:35.358079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.375069+0000","last_change":"2024-04-25T08:43:36.373963+0000","last_active":"2024-04-25T08:43:36.375069+0000","last_peered":"2024-04-25T08:43:36.375069+0000","last_clean":"2024-04-25T08:43:36.375069+0000","last_became_active":"2024-04-25T08:43:36.373670+0000","last_became_peered":"2024-04-25T08:43:36.373670+0000","last_unstale":"2024-04-25T08:43:36.375069+0000","last_undegraded":"2024-04-25T08:43:36.375069+0000","last_fullsized":"2024-04-25T08:43:36.375069+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:29.822090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358286+0000","last_change":"2024-04-25T08:43:35.358286+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358286+0000","last_undegraded":"2024-04-25T08:43:35.358286+0000","last_fullsized":"2024-04-25T08:43:35.358286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351734+0000","last_change":"2024-04-25T08:43:35.351734+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351734+0000","last_undegraded":"2024-04-25T08:43:35.351734+0000","last_fullsized":"2024-04-25T08:43:35.351734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365096+0000","last_change":"2024-04-25T08:43:36.365096+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365096+0000","last_undegraded":"2024-04-25T08:43:36.365096+0000","last_fullsized":"2024-04-25T08:43:36.365096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358105+0000","last_change":"2024-04-25T08:43:35.358105+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358105+0000","last_undegraded":"2024-04-25T08:43:35.358105+0000","last_fullsized":"2024-04-25T08:43:35.358105+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353649+0000","last_change":"2024-04-25T08:43:35.353649+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353649+0000","last_undegraded":"2024-04-25T08:43:35.353649+0000","last_fullsized":"2024-04-25T08:43:35.353649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353638+0000","last_change":"2024-04-25T08:43:35.353638+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353638+0000","last_undegraded":"2024-04-25T08:43:35.353638+0000","last_fullsized":"2024-04-25T08:43:35.353638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.370700+0000","last_change":"2024-04-25T08:43:36.368863+0000","last_active":"2024-04-25T08:43:36.370700+0000","last_peered":"2024-04-25T08:43:36.370700+0000","last_clean":"2024-04-25T08:43:36.370700+0000","last_became_active":"2024-04-25T08:43:36.368563+0000","last_became_peered":"2024-04-25T08:43:36.368563+0000","last_unstale":"2024-04-25T08:43:36.370700+0000","last_undegraded":"2024-04-25T08:43:36.370700+0000","last_fullsized":"2024-04-25T08:43:36.370700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:52.443687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355207+0000","last_change":"2024-04-25T08:43:35.355207+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355207+0000","last_undegraded":"2024-04-25T08:43:35.355207+0000","last_fullsized":"2024-04-25T08:43:35.355207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.361889+0000","last_change":"2024-04-25T08:43:36.361889+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.361889+0000","last_undegraded":"2024-04-25T08:43:36.361889+0000","last_fullsized":"2024-04-25T08:43:36.361889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354686+0000","last_change":"2024-04-25T08:43:35.354686+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354686+0000","last_undegraded":"2024-04-25T08:43:35.354686+0000","last_fullsized":"2024-04-25T08:43:35.354686+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.372926+0000","last_change":"2024-04-25T08:43:36.370869+0000","last_active":"2024-04-25T08:43:36.372926+0000","last_peered":"2024-04-25T08:43:36.372926+0000","last_clean":"2024-04-25T08:43:36.372926+0000","last_became_active":"2024-04-25T08:43:36.370179+0000","last_became_peered":"2024-04-25T08:43:36.370179+0000","last_unstale":"2024-04-25T08:43:36.372926+0000","last_undegraded":"2024-04-25T08:43:36.372926+0000","last_fullsized":"2024-04-25T08:43:36.372926+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:02.953547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.366036+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:43:36.366036+0000","last_peered":"2024-04-25T08:43:36.366036+0000","last_clean":"2024-04-25T08:43:36.366036+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:43:36.366036+0000","last_undegraded":"2024-04-25T08:43:36.366036+0000","last_fullsized":"2024-04-25T08:43:36.366036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":759870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:43:40.666 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:43:40.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.807+0000 7fc1a6d63640 1 Processor -- start 2024-04-25T08:43:40.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.807+0000 7fc1a6d63640 1 -- start start 2024-04-25T08:43:40.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.808+0000 7fc1a6d63640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 0x7fc1a01625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.808+0000 7fc1a6d63640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc1a00cc8e0 0x7fc1a015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.808+0000 7fc1a6d63640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a015f390 con 0x7fc1a00d1810 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.808+0000 7fc1a6d63640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a00cce50 con 0x7fc1a00cc8e0 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.808+0000 7fc1a6d63640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0161af0 con 0x7fc1a015dc90 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.808+0000 7fc19ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc1a00cc8e0 0x7fc1a015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.808+0000 7fc19ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc1a00cc8e0 0x7fc1a015ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35564/0 (socket says 172.21.15.172:35564) 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.808+0000 7fc19ffff640 1 -- 172.21.15.172:0/2480486015 learned_addr learned my addr 172.21.15.172:0/2480486015 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.808+0000 7fc1a5300640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc1a00d1810 0x7fc1a00cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42694/0 (socket says 172.21.15.172:42694) 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc19ffff640 1 -- 172.21.15.172:0/2480486015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 msgr2=0x7fc1a01625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc1a4aff640 1 --2- 172.21.15.172:0/2480486015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 0x7fc1a01625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc19f7fe640 1 -- 172.21.15.172:0/2480486015 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223290635 0 0) 0x7fc198001490 con 0x7fc1a00d1810 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc19ffff640 1 --2- 172.21.15.172:0/2480486015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 0x7fc1a01625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc19ffff640 1 -- 172.21.15.172:0/2480486015 >> v1:172.21.15.172:6789/0 conn(0x7fc1a00d1810 legacy=0x7fc1a00cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc19ffff640 1 -- 172.21.15.172:0/2480486015 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0161dd0 con 0x7fc1a00cc8e0 2024-04-25T08:43:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc1a4aff640 1 --2- 172.21.15.172:0/2480486015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 0x7fc1a01625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc19ffff640 1 --2- 172.21.15.172:0/2480486015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00cc8e0 0x7fc1a015ee50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc194009870 tx=0x7fc19402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838563a1c68cc3a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc19f7fe640 1 -- 172.21.15.172:0/2480486015 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194037070 con 0x7fc1a00cc8e0 2024-04-25T08:43:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc19f7fe640 1 -- 172.21.15.172:0/2480486015 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc194032440 con 0x7fc1a00cc8e0 2024-04-25T08:43:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.809+0000 7fc19f7fe640 1 -- 172.21.15.172:0/2480486015 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194032810 con 0x7fc1a00cc8e0 2024-04-25T08:43:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.810+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2480486015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00cc8e0 msgr2=0x7fc1a015ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.810+0000 7fc1a6d63640 1 --2- 172.21.15.172:0/2480486015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00cc8e0 0x7fc1a015ee50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc194009870 tx=0x7fc19402a1c0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.810+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2480486015 shutdown_connections 2024-04-25T08:43:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.810+0000 7fc1a6d63640 1 --2- 172.21.15.172:0/2480486015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00cc8e0 0x7fc1a015ee50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.810+0000 7fc1a6d63640 1 --2- 172.21.15.172:0/2480486015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 0x7fc1a01625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.810+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2480486015 >> 172.21.15.172:0/2480486015 conn(0x7fc1a006f590 msgr2=0x7fc1a006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.810+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2480486015 shutdown_connections 2024-04-25T08:43:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.810+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2480486015 wait complete. 2024-04-25T08:43:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.811+0000 7fc1a6d63640 1 Processor -- start 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.811+0000 7fc1a6d63640 1 -- start start 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc1a6d63640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1a00cc8e0 0x7fc1a00cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc1a6d63640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00d1810 0x7fc1a014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc1a6d63640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 0x7fc1a014d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc1a6d63640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a015e070 con 0x7fc1a00d1810 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc1a6d63640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00cd130 con 0x7fc1a00cc8e0 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc1a6d63640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a015e1f0 con 0x7fc1a015dc90 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc19ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00d1810 0x7fc1a014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc19ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00d1810 0x7fc1a014e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35576/0 (socket says 172.21.15.172:35576) 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc19ffff640 1 -- 172.21.15.172:0/2641982981 learned_addr learned my addr 172.21.15.172:0/2641982981 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc1a5300640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 0x7fc1a014d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc1a4aff640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1a00cc8e0 0x7fc1a00cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc19ffff640 1 -- 172.21.15.172:0/2641982981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 msgr2=0x7fc1a014d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc19ffff640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 0x7fc1a014d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc19ffff640 1 -- 172.21.15.172:0/2641982981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1a00cc8e0 msgr2=0x7fc1a00cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc19ffff640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1a00cc8e0 0x7fc1a00cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc19ffff640 1 -- 172.21.15.172:0/2641982981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a00c9640 con 0x7fc1a00d1810 2024-04-25T08:43:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc1a5300640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 0x7fc1a014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.812+0000 7fc1a4aff640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1a00cc8e0 0x7fc1a00cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.813+0000 7fc19ffff640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00d1810 0x7fc1a014e730 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc194000c00 tx=0x7fc1940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.813+0000 7fc19d7fa640 1 -- 172.21.15.172:0/2641982981 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194037040 con 0x7fc1a00d1810 2024-04-25T08:43:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.813+0000 7fc19d7fa640 1 -- 172.21.15.172:0/2641982981 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc194042070 con 0x7fc1a00d1810 2024-04-25T08:43:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.813+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2641982981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a00c9920 con 0x7fc1a00d1810 2024-04-25T08:43:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.813+0000 7fc19d7fa640 1 -- 172.21.15.172:0/2641982981 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194030bd0 con 0x7fc1a00d1810 2024-04-25T08:43:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.813+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2641982981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a00c9ee0 con 0x7fc1a00d1810 2024-04-25T08:43:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.814+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2641982981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a0073990 con 0x7fc1a00d1810 2024-04-25T08:43:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.814+0000 7fc19d7fa640 1 -- 172.21.15.172:0/2641982981 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc19402ad10 con 0x7fc1a00d1810 2024-04-25T08:43:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.815+0000 7fc19d7fa640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc18c06b4d0 0x7fc18c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.815+0000 7fc1a4aff640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc18c06b4d0 0x7fc18c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.815+0000 7fc19d7fa640 1 -- 172.21.15.172:0/2641982981 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc1940aad40 con 0x7fc1a00d1810 2024-04-25T08:43:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.815+0000 7fc1a4aff640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc18c06b4d0 0x7fc18c06d990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc190006fd0 tx=0x7fc190008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:40.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.819+0000 7fc19d7fa640 1 -- 172.21.15.172:0/2641982981 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc194079a30 con 0x7fc1a00d1810 2024-04-25T08:43:40.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.988+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2641982981 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1a006c2e0 con 0x7fc18c06b4d0 2024-04-25T08:43:40.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.994+0000 7fc19d7fa640 1 -- 172.21.15.172:0/2641982981 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241611 (secure 0 0 0) 0x7fc1a006c2e0 con 0x7fc18c06b4d0 2024-04-25T08:43:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:40.989 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2641982981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc18c06b4d0 msgr2=0x7fc18c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc18c06b4d0 0x7fc18c06d990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc190006fd0 tx=0x7fc190008040 comp rx=0 tx=0).stop 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2641982981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00d1810 msgr2=0x7fc1a014e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00d1810 0x7fc1a014e730 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc194000c00 tx=0x7fc1940046c0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2641982981 shutdown_connections 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc18c06b4d0 0x7fc18c06d990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1a015dc90 0x7fc1a014d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1a00d1810 0x7fc1a014e730 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 --2- 172.21.15.172:0/2641982981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1a00cc8e0 0x7fc1a00cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2641982981 >> 172.21.15.172:0/2641982981 conn(0x7fc1a006f590 msgr2=0x7fc1a00b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2641982981 shutdown_connections 2024-04-25T08:43:40.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:40.997+0000 7fc1a6d63640 1 -- 172.21.15.172:0/2641982981 wait complete. 2024-04-25T08:43:41.000 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-25T08:43:40.526776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220484,"kb_used_data":4224,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754236,"statfs":{"total":773094113280,"available":772868337664,"internally_reserved":0,"allocated":4325376,"data_stored":2499498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.177798"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365513+0000","last_change":"2024-04-25T08:43:36.365513+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365513+0000","last_undegraded":"2024-04-25T08:43:36.365513+0000","last_fullsized":"2024-04-25T08:43:36.365513+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364651+0000","last_change":"2024-04-25T08:43:36.364651+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364651+0000","last_undegraded":"2024-04-25T08:43:36.364651+0000","last_fullsized":"2024-04-25T08:43:36.364651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354982+0000","last_change":"2024-04-25T08:43:36.354982+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354982+0000","last_undegraded":"2024-04-25T08:43:36.354982+0000","last_fullsized":"2024-04-25T08:43:36.354982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354415+0000","last_change":"2024-04-25T08:43:36.354415+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354415+0000","last_undegraded":"2024-04-25T08:43:36.354415+0000","last_fullsized":"2024-04-25T08:43:36.354415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365066+0000","last_change":"2024-04-25T08:43:36.365066+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365066+0000","last_undegraded":"2024-04-25T08:43:36.365066+0000","last_fullsized":"2024-04-25T08:43:36.365066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.355373+0000","last_change":"2024-04-25T08:43:36.355373+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.355373+0000","last_undegraded":"2024-04-25T08:43:36.355373+0000","last_fullsized":"2024-04-25T08:43:36.355373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354396+0000","last_change":"2024-04-25T08:43:36.354396+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354396+0000","last_undegraded":"2024-04-25T08:43:36.354396+0000","last_fullsized":"2024-04-25T08:43:36.354396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354683+0000","last_change":"2024-04-25T08:43:36.354683+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354683+0000","last_undegraded":"2024-04-25T08:43:36.354683+0000","last_fullsized":"2024-04-25T08:43:36.354683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.355426+0000","last_change":"2024-04-25T08:43:36.355426+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.355426+0000","last_undegraded":"2024-04-25T08:43:36.355426+0000","last_fullsized":"2024-04-25T08:43:36.355426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364173+0000","last_change":"2024-04-25T08:43:36.364173+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364173+0000","last_undegraded":"2024-04-25T08:43:36.364173+0000","last_fullsized":"2024-04-25T08:43:36.364173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.363035+0000","last_change":"2024-04-25T08:43:36.363035+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.363035+0000","last_undegraded":"2024-04-25T08:43:36.363035+0000","last_fullsized":"2024-04-25T08:43:36.363035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.367125+0000","last_change":"2024-04-25T08:43:36.362931+0000","last_active":"2024-04-25T08:43:36.367125+0000","last_peered":"2024-04-25T08:43:36.367125+0000","last_clean":"2024-04-25T08:43:36.367125+0000","last_became_active":"2024-04-25T08:43:36.362595+0000","last_became_peered":"2024-04-25T08:43:36.362595+0000","last_unstale":"2024-04-25T08:43:36.367125+0000","last_undegraded":"2024-04-25T08:43:36.367125+0000","last_fullsized":"2024-04-25T08:43:36.367125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:57.138643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353638+0000","last_change":"2024-04-25T08:43:35.353638+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353638+0000","last_undegraded":"2024-04-25T08:43:35.353638+0000","last_fullsized":"2024-04-25T08:43:35.353638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352129+0000","last_change":"2024-04-25T08:43:35.352129+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352129+0000","last_undegraded":"2024-04-25T08:43:35.352129+0000","last_fullsized":"2024-04-25T08:43:35.352129+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355351+0000","last_change":"2024-04-25T08:43:35.355351+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355351+0000","last_undegraded":"2024-04-25T08:43:35.355351+0000","last_fullsized":"2024-04-25T08:43:35.355351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351127+0000","last_change":"2024-04-25T08:43:35.351127+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351127+0000","last_undegraded":"2024-04-25T08:43:35.351127+0000","last_fullsized":"2024-04-25T08:43:35.351127+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.372902+0000","last_change":"2024-04-25T08:43:36.370505+0000","last_active":"2024-04-25T08:43:36.372902+0000","last_peered":"2024-04-25T08:43:36.372902+0000","last_clean":"2024-04-25T08:43:36.372902+0000","last_became_active":"2024-04-25T08:43:36.370213+0000","last_became_peered":"2024-04-25T08:43:36.370213+0000","last_unstale":"2024-04-25T08:43:36.372902+0000","last_undegraded":"2024-04-25T08:43:36.372902+0000","last_fullsized":"2024-04-25T08:43:36.372902+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:13.283542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352097+0000","last_change":"2024-04-25T08:43:35.352097+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352097+0000","last_undegraded":"2024-04-25T08:43:35.352097+0000","last_fullsized":"2024-04-25T08:43:35.352097+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355249+0000","last_change":"2024-04-25T08:43:35.355249+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355249+0000","last_undegraded":"2024-04-25T08:43:35.355249+0000","last_fullsized":"2024-04-25T08:43:35.355249+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354716+0000","last_change":"2024-04-25T08:43:35.354716+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354716+0000","last_undegraded":"2024-04-25T08:43:35.354716+0000","last_fullsized":"2024-04-25T08:43:35.354716+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365506+0000","last_change":"2024-04-25T08:43:36.365506+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365506+0000","last_undegraded":"2024-04-25T08:43:36.365506+0000","last_fullsized":"2024-04-25T08:43:36.365506+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351439+0000","last_change":"2024-04-25T08:43:35.351439+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351439+0000","last_undegraded":"2024-04-25T08:43:35.351439+0000","last_fullsized":"2024-04-25T08:43:35.351439+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351726+0000","last_change":"2024-04-25T08:43:35.351726+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351726+0000","last_undegraded":"2024-04-25T08:43:35.351726+0000","last_fullsized":"2024-04-25T08:43:35.351726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354675+0000","last_change":"2024-04-25T08:43:35.354675+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354675+0000","last_undegraded":"2024-04-25T08:43:35.354675+0000","last_fullsized":"2024-04-25T08:43:35.354675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354683+0000","last_change":"2024-04-25T08:43:35.354683+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354683+0000","last_undegraded":"2024-04-25T08:43:35.354683+0000","last_fullsized":"2024-04-25T08:43:35.354683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351989+0000","last_change":"2024-04-25T08:43:35.351989+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351989+0000","last_undegraded":"2024-04-25T08:43:35.351989+0000","last_fullsized":"2024-04-25T08:43:35.351989+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.363803+0000","last_change":"2024-04-25T08:43:36.363803+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.363803+0000","last_undegraded":"2024-04-25T08:43:36.363803+0000","last_fullsized":"2024-04-25T08:43:36.363803+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.369455+0000","last_change":"2024-04-25T08:43:36.367865+0000","last_active":"2024-04-25T08:43:36.369455+0000","last_peered":"2024-04-25T08:43:36.369455+0000","last_clean":"2024-04-25T08:43:36.369455+0000","last_became_active":"2024-04-25T08:43:36.367571+0000","last_became_peered":"2024-04-25T08:43:36.367571+0000","last_unstale":"2024-04-25T08:43:36.369455+0000","last_undegraded":"2024-04-25T08:43:36.369455+0000","last_fullsized":"2024-04-25T08:43:36.369455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:42.606872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.374079+0000","last_change":"2024-04-25T08:43:36.372180+0000","last_active":"2024-04-25T08:43:36.374079+0000","last_peered":"2024-04-25T08:43:36.374079+0000","last_clean":"2024-04-25T08:43:36.374079+0000","last_became_active":"2024-04-25T08:43:36.371910+0000","last_became_peered":"2024-04-25T08:43:36.371910+0000","last_unstale":"2024-04-25T08:43:36.374079+0000","last_undegraded":"2024-04-25T08:43:36.374079+0000","last_fullsized":"2024-04-25T08:43:36.374079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:36.695080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352276+0000","last_change":"2024-04-25T08:43:35.352276+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352276+0000","last_undegraded":"2024-04-25T08:43:35.352276+0000","last_fullsized":"2024-04-25T08:43:35.352276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355412+0000","last_change":"2024-04-25T08:43:35.355412+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355412+0000","last_undegraded":"2024-04-25T08:43:35.355412+0000","last_fullsized":"2024-04-25T08:43:35.355412+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358163+0000","last_change":"2024-04-25T08:43:35.358163+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358163+0000","last_undegraded":"2024-04-25T08:43:35.358163+0000","last_fullsized":"2024-04-25T08:43:35.358163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351995+0000","last_change":"2024-04-25T08:43:35.351995+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351995+0000","last_undegraded":"2024-04-25T08:43:35.351995+0000","last_fullsized":"2024-04-25T08:43:35.351995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364167+0000","last_change":"2024-04-25T08:43:36.364167+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364167+0000","last_undegraded":"2024-04-25T08:43:36.364167+0000","last_fullsized":"2024-04-25T08:43:36.364167+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358163+0000","last_change":"2024-04-25T08:43:35.358163+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358163+0000","last_undegraded":"2024-04-25T08:43:35.358163+0000","last_fullsized":"2024-04-25T08:43:35.358163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358079+0000","last_change":"2024-04-25T08:43:35.358079+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358079+0000","last_undegraded":"2024-04-25T08:43:35.358079+0000","last_fullsized":"2024-04-25T08:43:35.358079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.375069+0000","last_change":"2024-04-25T08:43:36.373963+0000","last_active":"2024-04-25T08:43:36.375069+0000","last_peered":"2024-04-25T08:43:36.375069+0000","last_clean":"2024-04-25T08:43:36.375069+0000","last_became_active":"2024-04-25T08:43:36.373670+0000","last_became_peered":"2024-04-25T08:43:36.373670+0000","last_unstale":"2024-04-25T08:43:36.375069+0000","last_undegraded":"2024-04-25T08:43:36.375069+0000","last_fullsized":"2024-04-25T08:43:36.375069+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:29.822090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358286+0000","last_change":"2024-04-25T08:43:35.358286+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358286+0000","last_undegraded":"2024-04-25T08:43:35.358286+0000","last_fullsized":"2024-04-25T08:43:35.358286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351734+0000","last_change":"2024-04-25T08:43:35.351734+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351734+0000","last_undegraded":"2024-04-25T08:43:35.351734+0000","last_fullsized":"2024-04-25T08:43:35.351734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365096+0000","last_change":"2024-04-25T08:43:36.365096+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365096+0000","last_undegraded":"2024-04-25T08:43:36.365096+0000","last_fullsized":"2024-04-25T08:43:36.365096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358105+0000","last_change":"2024-04-25T08:43:35.358105+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358105+0000","last_undegraded":"2024-04-25T08:43:35.358105+0000","last_fullsized":"2024-04-25T08:43:35.358105+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353649+0000","last_change":"2024-04-25T08:43:35.353649+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353649+0000","last_undegraded":"2024-04-25T08:43:35.353649+0000","last_fullsized":"2024-04-25T08:43:35.353649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353638+0000","last_change":"2024-04-25T08:43:35.353638+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353638+0000","last_undegraded":"2024-04-25T08:43:35.353638+0000","last_fullsized":"2024-04-25T08:43:35.353638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.370700+0000","last_change":"2024-04-25T08:43:36.368863+0000","last_active":"2024-04-25T08:43:36.370700+0000","last_peered":"2024-04-25T08:43:36.370700+0000","last_clean":"2024-04-25T08:43:36.370700+0000","last_became_active":"2024-04-25T08:43:36.368563+0000","last_became_peered":"2024-04-25T08:43:36.368563+0000","last_unstale":"2024-04-25T08:43:36.370700+0000","last_undegraded":"2024-04-25T08:43:36.370700+0000","last_fullsized":"2024-04-25T08:43:36.370700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:52.443687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355207+0000","last_change":"2024-04-25T08:43:35.355207+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355207+0000","last_undegraded":"2024-04-25T08:43:35.355207+0000","last_fullsized":"2024-04-25T08:43:35.355207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.361889+0000","last_change":"2024-04-25T08:43:36.361889+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.361889+0000","last_undegraded":"2024-04-25T08:43:36.361889+0000","last_fullsized":"2024-04-25T08:43:36.361889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354686+0000","last_change":"2024-04-25T08:43:35.354686+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354686+0000","last_undegraded":"2024-04-25T08:43:35.354686+0000","last_fullsized":"2024-04-25T08:43:35.354686+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.372926+0000","last_change":"2024-04-25T08:43:36.370869+0000","last_active":"2024-04-25T08:43:36.372926+0000","last_peered":"2024-04-25T08:43:36.372926+0000","last_clean":"2024-04-25T08:43:36.372926+0000","last_became_active":"2024-04-25T08:43:36.370179+0000","last_became_peered":"2024-04-25T08:43:36.370179+0000","last_unstale":"2024-04-25T08:43:36.372926+0000","last_undegraded":"2024-04-25T08:43:36.372926+0000","last_fullsized":"2024-04-25T08:43:36.372926+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:02.953547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.366036+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:43:36.366036+0000","last_peered":"2024-04-25T08:43:36.366036+0000","last_clean":"2024-04-25T08:43:36.366036+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:43:36.366036+0000","last_undegraded":"2024-04-25T08:43:36.366036+0000","last_fullsized":"2024-04-25T08:43:36.366036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":759870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:43:41.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-04-25T08:43:41.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-04-25T08:43:41.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.365513+0000', 'last_change': '2024-04-25T08:43:36.365513+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.365513+0000', 'last_undegraded': '2024-04-25T08:43:36.365513+0000', 'last_fullsized': '2024-04-25T08:43:36.365513+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.364651+0000', 'last_change': '2024-04-25T08:43:36.364651+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.364651+0000', 'last_undegraded': '2024-04-25T08:43:36.364651+0000', 'last_fullsized': '2024-04-25T08:43:36.364651+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.354982+0000', 'last_change': '2024-04-25T08:43:36.354982+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.354982+0000', 'last_undegraded': '2024-04-25T08:43:36.354982+0000', 'last_fullsized': '2024-04-25T08:43:36.354982+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-04-25T08:43:41.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.354415+0000', 'last_change': '2024-04-25T08:43:36.354415+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.354415+0000', 'last_undegraded': '2024-04-25T08:43:36.354415+0000', 'last_fullsized': '2024-04-25T08:43:36.354415+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.365066+0000', 'last_change': '2024-04-25T08:43:36.365066+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.365066+0000', 'last_undegraded': '2024-04-25T08:43:36.365066+0000', 'last_fullsized': '2024-04-25T08:43:36.365066+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-04-25T08:43:41.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.355373+0000', 'last_change': '2024-04-25T08:43:36.355373+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.355373+0000', 'last_undegraded': '2024-04-25T08:43:36.355373+0000', 'last_fullsized': '2024-04-25T08:43:36.355373+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.354396+0000', 'last_change': '2024-04-25T08:43:36.354396+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.354396+0000', 'last_undegraded': '2024-04-25T08:43:36.354396+0000', 'last_fullsized': '2024-04-25T08:43:36.354396+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.354683+0000', 'last_change': '2024-04-25T08:43:36.354683+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.354683+0000', 'last_undegraded': '2024-04-25T08:43:36.354683+0000', 'last_fullsized': '2024-04-25T08:43:36.354683+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.355426+0000', 'last_change': '2024-04-25T08:43:36.355426+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.355426+0000', 'last_undegraded': '2024-04-25T08:43:36.355426+0000', 'last_fullsized': '2024-04-25T08:43:36.355426+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-04-25T08:43:41.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.364173+0000', 'last_change': '2024-04-25T08:43:36.364173+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.364173+0000', 'last_undegraded': '2024-04-25T08:43:36.364173+0000', 'last_fullsized': '2024-04-25T08:43:36.364173+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.363035+0000', 'last_change': '2024-04-25T08:43:36.363035+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.363035+0000', 'last_undegraded': '2024-04-25T08:43:36.363035+0000', 'last_fullsized': '2024-04-25T08:43:36.363035+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.353638+0000', 'last_change': '2024-04-25T08:43:35.353638+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.353638+0000', 'last_undegraded': '2024-04-25T08:43:35.353638+0000', 'last_fullsized': '2024-04-25T08:43:35.353638+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-25T08:43:41.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.352129+0000', 'last_change': '2024-04-25T08:43:35.352129+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.352129+0000', 'last_undegraded': '2024-04-25T08:43:35.352129+0000', 'last_fullsized': '2024-04-25T08:43:35.352129+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.355351+0000', 'last_change': '2024-04-25T08:43:35.355351+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.355351+0000', 'last_undegraded': '2024-04-25T08:43:35.355351+0000', 'last_fullsized': '2024-04-25T08:43:35.355351+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.351127+0000', 'last_change': '2024-04-25T08:43:35.351127+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.351127+0000', 'last_undegraded': '2024-04-25T08:43:35.351127+0000', 'last_fullsized': '2024-04-25T08:43:35.351127+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.352097+0000', 'last_change': '2024-04-25T08:43:35.352097+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.352097+0000', 'last_undegraded': '2024-04-25T08:43:35.352097+0000', 'last_fullsized': '2024-04-25T08:43:35.352097+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.355249+0000', 'last_change': '2024-04-25T08:43:35.355249+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.355249+0000', 'last_undegraded': '2024-04-25T08:43:35.355249+0000', 'last_fullsized': '2024-04-25T08:43:35.355249+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-25T08:43:41.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.354716+0000', 'last_change': '2024-04-25T08:43:35.354716+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.354716+0000', 'last_undegraded': '2024-04-25T08:43:35.354716+0000', 'last_fullsized': '2024-04-25T08:43:35.354716+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.365506+0000', 'last_change': '2024-04-25T08:43:36.365506+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.365506+0000', 'last_undegraded': '2024-04-25T08:43:36.365506+0000', 'last_fullsized': '2024-04-25T08:43:36.365506+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.351439+0000', 'last_change': '2024-04-25T08:43:35.351439+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.351439+0000', 'last_undegraded': '2024-04-25T08:43:35.351439+0000', 'last_fullsized': '2024-04-25T08:43:35.351439+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.351726+0000', 'last_change': '2024-04-25T08:43:35.351726+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.351726+0000', 'last_undegraded': '2024-04-25T08:43:35.351726+0000', 'last_fullsized': '2024-04-25T08:43:35.351726+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-25T08:43:41.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.354675+0000', 'last_change': '2024-04-25T08:43:35.354675+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.354675+0000', 'last_undegraded': '2024-04-25T08:43:35.354675+0000', 'last_fullsized': '2024-04-25T08:43:35.354675+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:43:41.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-25T08:43:41.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-25T08:43:41.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.354683+0000', 'last_change': '2024-04-25T08:43:35.354683+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.354683+0000', 'last_undegraded': '2024-04-25T08:43:35.354683+0000', 'last_fullsized': '2024-04-25T08:43:35.354683+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:43:41.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-25T08:43:41.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-25T08:43:41.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.351989+0000', 'last_change': '2024-04-25T08:43:35.351989+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.351989+0000', 'last_undegraded': '2024-04-25T08:43:35.351989+0000', 'last_fullsized': '2024-04-25T08:43:35.351989+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:43:41.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-04-25T08:43:41.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.363803+0000', 'last_change': '2024-04-25T08:43:36.363803+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.363803+0000', 'last_undegraded': '2024-04-25T08:43:36.363803+0000', 'last_fullsized': '2024-04-25T08:43:36.363803+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:43:41.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-25T08:43:41.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-25T08:43:41.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-25T08:43:41.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.352276+0000', 'last_change': '2024-04-25T08:43:35.352276+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.352276+0000', 'last_undegraded': '2024-04-25T08:43:35.352276+0000', 'last_fullsized': '2024-04-25T08:43:35.352276+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:43:41.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.355412+0000', 'last_change': '2024-04-25T08:43:35.355412+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.355412+0000', 'last_undegraded': '2024-04-25T08:43:35.355412+0000', 'last_fullsized': '2024-04-25T08:43:35.355412+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.358163+0000', 'last_change': '2024-04-25T08:43:35.358163+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.358163+0000', 'last_undegraded': '2024-04-25T08:43:35.358163+0000', 'last_fullsized': '2024-04-25T08:43:35.358163+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-25T08:43:41.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.351995+0000', 'last_change': '2024-04-25T08:43:35.351995+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.351995+0000', 'last_undegraded': '2024-04-25T08:43:35.351995+0000', 'last_fullsized': '2024-04-25T08:43:35.351995+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.364167+0000', 'last_change': '2024-04-25T08:43:36.364167+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.364167+0000', 'last_undegraded': '2024-04-25T08:43:36.364167+0000', 'last_fullsized': '2024-04-25T08:43:36.364167+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.358163+0000', 'last_change': '2024-04-25T08:43:35.358163+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.358163+0000', 'last_undegraded': '2024-04-25T08:43:35.358163+0000', 'last_fullsized': '2024-04-25T08:43:35.358163+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.358079+0000', 'last_change': '2024-04-25T08:43:35.358079+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.358079+0000', 'last_undegraded': '2024-04-25T08:43:35.358079+0000', 'last_fullsized': '2024-04-25T08:43:35.358079+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-25T08:43:41.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-25T08:43:41.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.358286+0000', 'last_change': '2024-04-25T08:43:35.358286+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.358286+0000', 'last_undegraded': '2024-04-25T08:43:35.358286+0000', 'last_fullsized': '2024-04-25T08:43:35.358286+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:43:41.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-25T08:43:41.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-25T08:43:41.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.351734+0000', 'last_change': '2024-04-25T08:43:35.351734+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.351734+0000', 'last_undegraded': '2024-04-25T08:43:35.351734+0000', 'last_fullsized': '2024-04-25T08:43:35.351734+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T08:43:41.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-04-25T08:43:41.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.365096+0000', 'last_change': '2024-04-25T08:43:36.365096+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.365096+0000', 'last_undegraded': '2024-04-25T08:43:36.365096+0000', 'last_fullsized': '2024-04-25T08:43:36.365096+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:43:41.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.358105+0000', 'last_change': '2024-04-25T08:43:35.358105+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.358105+0000', 'last_undegraded': '2024-04-25T08:43:35.358105+0000', 'last_fullsized': '2024-04-25T08:43:35.358105+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.353649+0000', 'last_change': '2024-04-25T08:43:35.353649+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.353649+0000', 'last_undegraded': '2024-04-25T08:43:35.353649+0000', 'last_fullsized': '2024-04-25T08:43:35.353649+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.353638+0000', 'last_change': '2024-04-25T08:43:35.353638+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.353638+0000', 'last_undegraded': '2024-04-25T08:43:35.353638+0000', 'last_fullsized': '2024-04-25T08:43:35.353638+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-25T08:43:41.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-04-25T08:43:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-25T08:43:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.355207+0000', 'last_change': '2024-04-25T08:43:35.355207+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.355207+0000', 'last_undegraded': '2024-04-25T08:43:35.355207+0000', 'last_fullsized': '2024-04-25T08:43:35.355207+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T08:43:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-04-25T08:43:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:36.361889+0000', 'last_change': '2024-04-25T08:43:36.361889+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.361889+0000', 'last_undegraded': '2024-04-25T08:43:36.361889+0000', 'last_fullsized': '2024-04-25T08:43:36.361889+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:43:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-25T08:43:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:43:35.354686+0000', 'last_change': '2024-04-25T08:43:35.354686+0000', 'last_active': '2024-04-25T08:43:35.344373+0000', 'last_peered': '2024-04-25T08:43:35.344373+0000', 'last_clean': '2024-04-25T08:43:35.344373+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:35.354686+0000', 'last_undegraded': '2024-04-25T08:43:35.354686+0000', 'last_fullsized': '2024-04-25T08:43:35.354686+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:35.344373+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T08:43:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-04-25T08:43:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:43:36.348590+0000', 'last_change': '2024-04-25T08:43:36.348590+0000', 'last_active': '2024-04-25T08:43:36.348590+0000', 'last_peered': '2024-04-25T08:43:36.348590+0000', 'last_clean': '2024-04-25T08:43:36.348590+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:43:36.348590+0000', 'last_undegraded': '2024-04-25T08:43:36.348590+0000', 'last_fullsized': '2024-04-25T08:43:36.348590+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'last_clean_scrub_stamp': '2024-04-25T08:43:36.348590+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:43:41.021 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:43:41.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.145+0000 7f1a617a5640 1 Processor -- start 2024-04-25T08:43:41.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.145+0000 7f1a617a5640 1 -- start start 2024-04-25T08:43:41.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.146+0000 7f1a617a5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1a5c0d1020 0x7f1a5c0d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.146+0000 7f1a617a5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c0b97a0 con 0x7f1a5c0b2cb0 2024-04-25T08:43:41.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.146+0000 7f1a617a5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c0d1c50 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.146+0000 7f1a617a5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c15dfc0 con 0x7f1a5c0d1020 2024-04-25T08:43:41.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.146+0000 7f1a53fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1a5c0b2cb0 0x7f1a5c0d2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42696/0 (socket says 172.21.15.172:42696) 2024-04-25T08:43:41.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.146+0000 7f1a53fff640 1 -- 172.21.15.172:0/517166322 learned_addr learned my addr 172.21.15.172:0/517166322 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:41.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.146+0000 7f1a5b7fe640 1 --2- 172.21.15.172:0/517166322 >> v2:172.21.15.186:3300/0 conn(0x7f1a5c0d1020 0x7f1a5c0d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.146+0000 7f1a5a7fc640 1 -- 172.21.15.172:0/517166322 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965787538 0 0) 0x7f1a5c0b97a0 con 0x7f1a5c0b2cb0 2024-04-25T08:43:41.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.146+0000 7f1a5a7fc640 1 -- 172.21.15.172:0/517166322 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a48003520 con 0x7f1a5c0b2cb0 2024-04-25T08:43:41.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.147+0000 7f1a5a7fc640 1 -- 172.21.15.172:0/517166322 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3337045756 0 0) 0x7f1a48003520 con 0x7f1a5c0b2cb0 2024-04-25T08:43:41.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.147+0000 7f1a5b7fe640 1 -- 172.21.15.172:0/517166322 >> v1:172.21.15.186:6789/0 conn(0x7f1a5c15dbe0 legacy=0x7f1a5c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.147+0000 7f1a5b7fe640 1 -- 172.21.15.172:0/517166322 >> v1:172.21.15.172:6789/0 conn(0x7f1a5c0b2cb0 legacy=0x7f1a5c0d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.147+0000 7f1a5b7fe640 1 -- 172.21.15.172:0/517166322 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0d1f30 con 0x7f1a5c0d1020 2024-04-25T08:43:41.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.147+0000 7f1a5b7fe640 1 --2- 172.21.15.172:0/517166322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a5c0d1020 0x7f1a5c0d2e40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009d90 tx=0x7f1a5402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23bee33303716db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:41.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.148+0000 7f1a5a7fc640 1 -- 172.21.15.172:0/517166322 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44001670 con 0x7f1a5c0d1020 2024-04-25T08:43:41.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.148+0000 7f1a5a7fc640 1 -- 172.21.15.172:0/517166322 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54007540 con 0x7f1a5c0d1020 2024-04-25T08:43:41.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.148+0000 7f1a5a7fc640 1 -- 172.21.15.172:0/517166322 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540078f0 con 0x7f1a5c0d1020 2024-04-25T08:43:41.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.148+0000 7f1a617a5640 1 -- 172.21.15.172:0/517166322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a5c0d1020 msgr2=0x7f1a5c0d2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.148+0000 7f1a617a5640 1 --2- 172.21.15.172:0/517166322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a5c0d1020 0x7f1a5c0d2e40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009d90 tx=0x7f1a5402a680 comp rx=0 tx=0).stop 2024-04-25T08:43:41.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.148+0000 7f1a617a5640 1 -- 172.21.15.172:0/517166322 shutdown_connections 2024-04-25T08:43:41.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.148+0000 7f1a617a5640 1 --2- 172.21.15.172:0/517166322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a5c0d1020 0x7f1a5c0d2e40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.148+0000 7f1a617a5640 1 -- 172.21.15.172:0/517166322 >> 172.21.15.172:0/517166322 conn(0x7f1a5c061a20 msgr2=0x7f1a5c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:41.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.148+0000 7f1a617a5640 1 -- 172.21.15.172:0/517166322 shutdown_connections 2024-04-25T08:43:41.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.148+0000 7f1a617a5640 1 -- 172.21.15.172:0/517166322 wait complete. 2024-04-25T08:43:41.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.149+0000 7f1a617a5640 1 Processor -- start 2024-04-25T08:43:41.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.149+0000 7f1a617a5640 1 -- start start 2024-04-25T08:43:41.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a617a5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a5c0b2cb0 0x7f1a5c143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a617a5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a5c0d1020 0x7f1a5c1467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a617a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a5c15dbe0 0x7f1a5c1f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a617a5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0b92a0 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a617a5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0d1a00 con 0x7f1a5c0b2cb0 2024-04-25T08:43:41.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a617a5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0b9420 con 0x7f1a5c0d1020 2024-04-25T08:43:41.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a5b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a5c15dbe0 0x7f1a5c1f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a5b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a5c15dbe0 0x7f1a5c1f2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35584/0 (socket says 172.21.15.172:35584) 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a5b7fe640 1 -- 172.21.15.172:0/2127546773 learned_addr learned my addr 172.21.15.172:0/2127546773 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a5affd640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a5c0b2cb0 0x7f1a5c143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.150+0000 7f1a53fff640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a5c0d1020 0x7f1a5c1467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a5b7fe640 1 -- 172.21.15.172:0/2127546773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a5c0d1020 msgr2=0x7f1a5c1467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a5b7fe640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a5c0d1020 0x7f1a5c1467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a5b7fe640 1 -- 172.21.15.172:0/2127546773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a5c0b2cb0 msgr2=0x7f1a5c143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a5b7fe640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a5c0b2cb0 0x7f1a5c143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a5b7fe640 1 -- 172.21.15.172:0/2127546773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c146d20 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a5b7fe640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a5c15dbe0 0x7f1a5c1f2990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009eb0 tx=0x7f1a54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a537fe640 1 -- 172.21.15.172:0/2127546773 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54040070 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a537fe640 1 -- 172.21.15.172:0/2127546773 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54031c40 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a617a5640 1 -- 172.21.15.172:0/2127546773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c1f40b0 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a537fe640 1 -- 172.21.15.172:0/2127546773 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54009450 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.151+0000 7f1a617a5640 1 -- 172.21.15.172:0/2127546773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c1f3810 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.152+0000 7f1a617a5640 1 -- 172.21.15.172:0/2127546773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c073990 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.152+0000 7f1a537fe640 1 -- 172.21.15.172:0/2127546773 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1a54039040 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.153+0000 7f1a537fe640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a3c06b4d0 0x7f1a3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.153+0000 7f1a5affd640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a3c06b4d0 0x7f1a3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.153+0000 7f1a537fe640 1 -- 172.21.15.172:0/2127546773 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1a540ab660 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.153+0000 7f1a5affd640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a3c06b4d0 0x7f1a3c06d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c143c10 tx=0x7f1a4c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:41.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.157+0000 7f1a537fe640 1 -- 172.21.15.172:0/2127546773 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1a5c146d20 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.201 INFO:tasks.ceph.mds.a.smithi172.stderr:2024-04-25T08:43:41.209+0000 7f280ce3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:43:41.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.403+0000 7f1a617a5640 1 -- 172.21.15.172:0/2127546773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1a5c06b080 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.403+0000 7f1a537fe640 1 -- 172.21.15.172:0/2127546773 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1108 (secure 0 0 0) 0x7f1a540a9e20 con 0x7f1a5c15dbe0 2024-04-25T08:43:41.396 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:41.396 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":96,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":48},{"state_name":"creating+peering","count":41},{"state_name":"active+clean","count":8}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225775616,"bytes_avail":772868337664,"bytes_total":773094113280,"unknown_pgs_ratio":0.49484536051750183,"inactive_pgs_ratio":0.42268040776252747},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5340}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-04-25T08:43:26.524765+0000","services":{}},"progress_events":{}} 2024-04-25T08:43:41.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 -- 172.21.15.172:0/2127546773 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a3c06b4d0 msgr2=0x7f1a3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a3c06b4d0 0x7f1a3c06d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c143c10 tx=0x7f1a4c009040 comp rx=0 tx=0).stop 2024-04-25T08:43:41.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 -- 172.21.15.172:0/2127546773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a5c15dbe0 msgr2=0x7f1a5c1f2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a5c15dbe0 0x7f1a5c1f2990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009eb0 tx=0x7f1a54004a40 comp rx=0 tx=0).stop 2024-04-25T08:43:41.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 -- 172.21.15.172:0/2127546773 shutdown_connections 2024-04-25T08:43:41.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a3c06b4d0 0x7f1a3c06d990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a5c15dbe0 0x7f1a5c1f2990 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a5c0d1020 0x7f1a5c1467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 --2- 172.21.15.172:0/2127546773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a5c0b2cb0 0x7f1a5c143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 -- 172.21.15.172:0/2127546773 >> 172.21.15.172:0/2127546773 conn(0x7f1a5c061a20 msgr2=0x7f1a5c15cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:41.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 -- 172.21.15.172:0/2127546773 shutdown_connections 2024-04-25T08:43:41.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.406+0000 7f1a617a5640 1 -- 172.21.15.172:0/2127546773 wait complete. 2024-04-25T08:43:41.409 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:43:41.409 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:43:41.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.515+0000 7f0255b89640 1 Processor -- start 2024-04-25T08:43:41.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.515+0000 7f0255b89640 1 -- start start 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.515+0000 7f0255b89640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f02500701e0 0x7f02500cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.515+0000 7f0255b89640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f02500cbbf0 0x7f02500cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.515+0000 7f0255b89640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025006f6c0 con 0x7f025015df00 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.515+0000 7f0255b89640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025006f950 con 0x7f02500cbbf0 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.515+0000 7f0255b89640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02500cdf00 con 0x7f02500701e0 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.516+0000 7f024ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f02500cbbf0 0x7f02500cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.516+0000 7f024ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f02500cbbf0 0x7f02500cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35588/0 (socket says 172.21.15.172:35588) 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.516+0000 7f024ffff640 1 -- 172.21.15.172:0/1787991036 learned_addr learned my addr 172.21.15.172:0/1787991036 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.516+0000 7f0247fff640 1 --2- 172.21.15.172:0/1787991036 >> v2:172.21.15.186:3300/0 conn(0x7f02500701e0 0x7f02500cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.516+0000 7f024ffff640 1 -- 172.21.15.172:0/1787991036 >> v2:172.21.15.186:3300/0 conn(0x7f02500701e0 msgr2=0x7f02500cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.516+0000 7f024ffff640 1 --2- 172.21.15.172:0/1787991036 >> v2:172.21.15.186:3300/0 conn(0x7f02500701e0 0x7f02500cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.516+0000 7f024ffff640 1 -- 172.21.15.172:0/1787991036 >> v1:172.21.15.186:6789/0 conn(0x7f025015df00 legacy=0x7f02500cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:41.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.516+0000 7f024ffff640 1 -- 172.21.15.172:0/1787991036 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02500cece0 con 0x7f02500cbbf0 2024-04-25T08:43:41.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.516+0000 7f0247fff640 1 --2- 172.21.15.172:0/1787991036 >> v2:172.21.15.186:3300/0 conn(0x7f02500701e0 0x7f02500cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:41.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f024ffff640 1 --2- 172.21.15.172:0/1787991036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500cbbf0 0x7f02500cc010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f02500c7760 tx=0x7f024802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fb295d94c6806e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:41.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f024effd640 1 -- 172.21.15.172:0/1787991036 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248036070 con 0x7f02500cbbf0 2024-04-25T08:43:41.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f024effd640 1 -- 172.21.15.172:0/1787991036 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0248031600 con 0x7f02500cbbf0 2024-04-25T08:43:41.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f024effd640 1 -- 172.21.15.172:0/1787991036 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02480319d0 con 0x7f02500cbbf0 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f0255b89640 1 -- 172.21.15.172:0/1787991036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500cbbf0 msgr2=0x7f02500cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f0255b89640 1 --2- 172.21.15.172:0/1787991036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500cbbf0 0x7f02500cc010 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f02500c7760 tx=0x7f024802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f0255b89640 1 -- 172.21.15.172:0/1787991036 shutdown_connections 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f0255b89640 1 --2- 172.21.15.172:0/1787991036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500cbbf0 0x7f02500cc010 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f0255b89640 1 --2- 172.21.15.172:0/1787991036 >> v2:172.21.15.186:3300/0 conn(0x7f02500701e0 0x7f02500cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f0255b89640 1 -- 172.21.15.172:0/1787991036 >> 172.21.15.172:0/1787991036 conn(0x7f02500b2290 msgr2=0x7f02500b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f0255b89640 1 -- 172.21.15.172:0/1787991036 shutdown_connections 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.517+0000 7f0255b89640 1 -- 172.21.15.172:0/1787991036 wait complete. 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f0255b89640 1 Processor -- start 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f0255b89640 1 -- start start 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f0255b89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500701e0 0x7f02500b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f0255b89640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02500cbbf0 0x7f02501581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f0255b89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f025015df00 0x7f02501f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f0255b89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025006fd00 con 0x7f02500701e0 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f0255b89640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02500cf4e0 con 0x7f02500cbbf0 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f0255b89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025006fe80 con 0x7f025015df00 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500701e0 0x7f02500b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500701e0 0x7f02500b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35604/0 (socket says 172.21.15.172:35604) 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.519+0000 7f024f7fe640 1 -- 172.21.15.172:0/826762810 learned_addr learned my addr 172.21.15.172:0/826762810 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f0247fff640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02500cbbf0 0x7f02501581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f024ffff640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f025015df00 0x7f02501f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f024f7fe640 1 -- 172.21.15.172:0/826762810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f025015df00 msgr2=0x7f02501f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f024f7fe640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f025015df00 0x7f02501f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f024f7fe640 1 -- 172.21.15.172:0/826762810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02500cbbf0 msgr2=0x7f02501581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f024f7fe640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02500cbbf0 0x7f02501581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f024f7fe640 1 -- 172.21.15.172:0/826762810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02501f23b0 con 0x7f02500701e0 2024-04-25T08:43:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f0247fff640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02500cbbf0 0x7f02501581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f024f7fe640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500701e0 0x7f02500b43b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f024000b420 tx=0x7f024000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f024cff9640 1 -- 172.21.15.172:0/826762810 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240011830 con 0x7f02500701e0 2024-04-25T08:43:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f024cff9640 1 -- 172.21.15.172:0/826762810 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240016070 con 0x7f02500701e0 2024-04-25T08:43:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f0255b89640 1 -- 172.21.15.172:0/826762810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02501f2690 con 0x7f02500701e0 2024-04-25T08:43:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f024cff9640 1 -- 172.21.15.172:0/826762810 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240011c10 con 0x7f02500701e0 2024-04-25T08:43:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.520+0000 7f0255b89640 1 -- 172.21.15.172:0/826762810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02500b5480 con 0x7f02500701e0 2024-04-25T08:43:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.521+0000 7f0255b89640 1 -- 172.21.15.172:0/826762810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02500b5270 con 0x7f02500701e0 2024-04-25T08:43:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.521+0000 7f024cff9640 1 -- 172.21.15.172:0/826762810 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f024001b460 con 0x7f02500701e0 2024-04-25T08:43:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.522+0000 7f024cff9640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f023006b4d0 0x7f023006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.522+0000 7f024cff9640 1 -- 172.21.15.172:0/826762810 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0240089e20 con 0x7f02500701e0 2024-04-25T08:43:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.522+0000 7f0247fff640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f023006b4d0 0x7f023006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.522+0000 7f0247fff640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f023006b4d0 0x7f023006d990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0238006fd0 tx=0x7f0238008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.526+0000 7f024cff9640 1 -- 172.21.15.172:0/826762810 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0240020020 con 0x7f02500701e0 2024-04-25T08:43:41.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.693+0000 7f0255b89640 1 -- 172.21.15.172:0/826762810 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0250073990 con 0x7f023006b4d0 2024-04-25T08:43:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.698+0000 7f024cff9640 1 -- 172.21.15.172:0/826762810 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241611 (secure 0 0 0) 0x7f0250073990 con 0x7f023006b4d0 2024-04-25T08:43:41.693 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:41.694 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 -- 172.21.15.172:0/826762810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f023006b4d0 msgr2=0x7f023006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f023006b4d0 0x7f023006d990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0238006fd0 tx=0x7f0238008040 comp rx=0 tx=0).stop 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 -- 172.21.15.172:0/826762810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500701e0 msgr2=0x7f02500b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500701e0 0x7f02500b43b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f024000b420 tx=0x7f024000b8e0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 -- 172.21.15.172:0/826762810 shutdown_connections 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f023006b4d0 0x7f023006d990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02500cbbf0 0x7f02501581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f025015df00 0x7f02501f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 --2- 172.21.15.172:0/826762810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02500701e0 0x7f02500b43b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 -- 172.21.15.172:0/826762810 >> 172.21.15.172:0/826762810 conn(0x7f02500b2290 msgr2=0x7f02500cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 -- 172.21.15.172:0/826762810 shutdown_connections 2024-04-25T08:43:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:41.701+0000 7f0255b89640 1 -- 172.21.15.172:0/826762810 wait complete. 2024-04-25T08:43:41.704 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-25T08:43:40.526776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220484,"kb_used_data":4224,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754236,"statfs":{"total":773094113280,"available":772868337664,"internally_reserved":0,"allocated":4325376,"data_stored":2499498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.177798"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365513+0000","last_change":"2024-04-25T08:43:36.365513+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365513+0000","last_undegraded":"2024-04-25T08:43:36.365513+0000","last_fullsized":"2024-04-25T08:43:36.365513+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364651+0000","last_change":"2024-04-25T08:43:36.364651+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364651+0000","last_undegraded":"2024-04-25T08:43:36.364651+0000","last_fullsized":"2024-04-25T08:43:36.364651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354982+0000","last_change":"2024-04-25T08:43:36.354982+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354982+0000","last_undegraded":"2024-04-25T08:43:36.354982+0000","last_fullsized":"2024-04-25T08:43:36.354982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354415+0000","last_change":"2024-04-25T08:43:36.354415+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354415+0000","last_undegraded":"2024-04-25T08:43:36.354415+0000","last_fullsized":"2024-04-25T08:43:36.354415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365066+0000","last_change":"2024-04-25T08:43:36.365066+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365066+0000","last_undegraded":"2024-04-25T08:43:36.365066+0000","last_fullsized":"2024-04-25T08:43:36.365066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.355373+0000","last_change":"2024-04-25T08:43:36.355373+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.355373+0000","last_undegraded":"2024-04-25T08:43:36.355373+0000","last_fullsized":"2024-04-25T08:43:36.355373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354396+0000","last_change":"2024-04-25T08:43:36.354396+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354396+0000","last_undegraded":"2024-04-25T08:43:36.354396+0000","last_fullsized":"2024-04-25T08:43:36.354396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.354683+0000","last_change":"2024-04-25T08:43:36.354683+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.354683+0000","last_undegraded":"2024-04-25T08:43:36.354683+0000","last_fullsized":"2024-04-25T08:43:36.354683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.355426+0000","last_change":"2024-04-25T08:43:36.355426+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.355426+0000","last_undegraded":"2024-04-25T08:43:36.355426+0000","last_fullsized":"2024-04-25T08:43:36.355426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364173+0000","last_change":"2024-04-25T08:43:36.364173+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364173+0000","last_undegraded":"2024-04-25T08:43:36.364173+0000","last_fullsized":"2024-04-25T08:43:36.364173+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.363035+0000","last_change":"2024-04-25T08:43:36.363035+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.363035+0000","last_undegraded":"2024-04-25T08:43:36.363035+0000","last_fullsized":"2024-04-25T08:43:36.363035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.367125+0000","last_change":"2024-04-25T08:43:36.362931+0000","last_active":"2024-04-25T08:43:36.367125+0000","last_peered":"2024-04-25T08:43:36.367125+0000","last_clean":"2024-04-25T08:43:36.367125+0000","last_became_active":"2024-04-25T08:43:36.362595+0000","last_became_peered":"2024-04-25T08:43:36.362595+0000","last_unstale":"2024-04-25T08:43:36.367125+0000","last_undegraded":"2024-04-25T08:43:36.367125+0000","last_fullsized":"2024-04-25T08:43:36.367125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:57.138643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353638+0000","last_change":"2024-04-25T08:43:35.353638+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353638+0000","last_undegraded":"2024-04-25T08:43:35.353638+0000","last_fullsized":"2024-04-25T08:43:35.353638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352129+0000","last_change":"2024-04-25T08:43:35.352129+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352129+0000","last_undegraded":"2024-04-25T08:43:35.352129+0000","last_fullsized":"2024-04-25T08:43:35.352129+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355351+0000","last_change":"2024-04-25T08:43:35.355351+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355351+0000","last_undegraded":"2024-04-25T08:43:35.355351+0000","last_fullsized":"2024-04-25T08:43:35.355351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351127+0000","last_change":"2024-04-25T08:43:35.351127+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351127+0000","last_undegraded":"2024-04-25T08:43:35.351127+0000","last_fullsized":"2024-04-25T08:43:35.351127+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.372902+0000","last_change":"2024-04-25T08:43:36.370505+0000","last_active":"2024-04-25T08:43:36.372902+0000","last_peered":"2024-04-25T08:43:36.372902+0000","last_clean":"2024-04-25T08:43:36.372902+0000","last_became_active":"2024-04-25T08:43:36.370213+0000","last_became_peered":"2024-04-25T08:43:36.370213+0000","last_unstale":"2024-04-25T08:43:36.372902+0000","last_undegraded":"2024-04-25T08:43:36.372902+0000","last_fullsized":"2024-04-25T08:43:36.372902+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:13.283542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352097+0000","last_change":"2024-04-25T08:43:35.352097+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352097+0000","last_undegraded":"2024-04-25T08:43:35.352097+0000","last_fullsized":"2024-04-25T08:43:35.352097+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355249+0000","last_change":"2024-04-25T08:43:35.355249+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355249+0000","last_undegraded":"2024-04-25T08:43:35.355249+0000","last_fullsized":"2024-04-25T08:43:35.355249+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354716+0000","last_change":"2024-04-25T08:43:35.354716+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354716+0000","last_undegraded":"2024-04-25T08:43:35.354716+0000","last_fullsized":"2024-04-25T08:43:35.354716+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365506+0000","last_change":"2024-04-25T08:43:36.365506+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365506+0000","last_undegraded":"2024-04-25T08:43:36.365506+0000","last_fullsized":"2024-04-25T08:43:36.365506+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351439+0000","last_change":"2024-04-25T08:43:35.351439+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351439+0000","last_undegraded":"2024-04-25T08:43:35.351439+0000","last_fullsized":"2024-04-25T08:43:35.351439+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351726+0000","last_change":"2024-04-25T08:43:35.351726+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351726+0000","last_undegraded":"2024-04-25T08:43:35.351726+0000","last_fullsized":"2024-04-25T08:43:35.351726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354675+0000","last_change":"2024-04-25T08:43:35.354675+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354675+0000","last_undegraded":"2024-04-25T08:43:35.354675+0000","last_fullsized":"2024-04-25T08:43:35.354675+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354683+0000","last_change":"2024-04-25T08:43:35.354683+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354683+0000","last_undegraded":"2024-04-25T08:43:35.354683+0000","last_fullsized":"2024-04-25T08:43:35.354683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351989+0000","last_change":"2024-04-25T08:43:35.351989+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351989+0000","last_undegraded":"2024-04-25T08:43:35.351989+0000","last_fullsized":"2024-04-25T08:43:35.351989+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.363803+0000","last_change":"2024-04-25T08:43:36.363803+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.363803+0000","last_undegraded":"2024-04-25T08:43:36.363803+0000","last_fullsized":"2024-04-25T08:43:36.363803+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.369455+0000","last_change":"2024-04-25T08:43:36.367865+0000","last_active":"2024-04-25T08:43:36.369455+0000","last_peered":"2024-04-25T08:43:36.369455+0000","last_clean":"2024-04-25T08:43:36.369455+0000","last_became_active":"2024-04-25T08:43:36.367571+0000","last_became_peered":"2024-04-25T08:43:36.367571+0000","last_unstale":"2024-04-25T08:43:36.369455+0000","last_undegraded":"2024-04-25T08:43:36.369455+0000","last_fullsized":"2024-04-25T08:43:36.369455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:42.606872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.374079+0000","last_change":"2024-04-25T08:43:36.372180+0000","last_active":"2024-04-25T08:43:36.374079+0000","last_peered":"2024-04-25T08:43:36.374079+0000","last_clean":"2024-04-25T08:43:36.374079+0000","last_became_active":"2024-04-25T08:43:36.371910+0000","last_became_peered":"2024-04-25T08:43:36.371910+0000","last_unstale":"2024-04-25T08:43:36.374079+0000","last_undegraded":"2024-04-25T08:43:36.374079+0000","last_fullsized":"2024-04-25T08:43:36.374079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:36.695080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.352276+0000","last_change":"2024-04-25T08:43:35.352276+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.352276+0000","last_undegraded":"2024-04-25T08:43:35.352276+0000","last_fullsized":"2024-04-25T08:43:35.352276+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355412+0000","last_change":"2024-04-25T08:43:35.355412+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355412+0000","last_undegraded":"2024-04-25T08:43:35.355412+0000","last_fullsized":"2024-04-25T08:43:35.355412+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358163+0000","last_change":"2024-04-25T08:43:35.358163+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358163+0000","last_undegraded":"2024-04-25T08:43:35.358163+0000","last_fullsized":"2024-04-25T08:43:35.358163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351995+0000","last_change":"2024-04-25T08:43:35.351995+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351995+0000","last_undegraded":"2024-04-25T08:43:35.351995+0000","last_fullsized":"2024-04-25T08:43:35.351995+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.364167+0000","last_change":"2024-04-25T08:43:36.364167+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.364167+0000","last_undegraded":"2024-04-25T08:43:36.364167+0000","last_fullsized":"2024-04-25T08:43:36.364167+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358163+0000","last_change":"2024-04-25T08:43:35.358163+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358163+0000","last_undegraded":"2024-04-25T08:43:35.358163+0000","last_fullsized":"2024-04-25T08:43:35.358163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358079+0000","last_change":"2024-04-25T08:43:35.358079+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358079+0000","last_undegraded":"2024-04-25T08:43:35.358079+0000","last_fullsized":"2024-04-25T08:43:35.358079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.375069+0000","last_change":"2024-04-25T08:43:36.373963+0000","last_active":"2024-04-25T08:43:36.375069+0000","last_peered":"2024-04-25T08:43:36.375069+0000","last_clean":"2024-04-25T08:43:36.375069+0000","last_became_active":"2024-04-25T08:43:36.373670+0000","last_became_peered":"2024-04-25T08:43:36.373670+0000","last_unstale":"2024-04-25T08:43:36.375069+0000","last_undegraded":"2024-04-25T08:43:36.375069+0000","last_fullsized":"2024-04-25T08:43:36.375069+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:29.822090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358286+0000","last_change":"2024-04-25T08:43:35.358286+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358286+0000","last_undegraded":"2024-04-25T08:43:35.358286+0000","last_fullsized":"2024-04-25T08:43:35.358286+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.351734+0000","last_change":"2024-04-25T08:43:35.351734+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.351734+0000","last_undegraded":"2024-04-25T08:43:35.351734+0000","last_fullsized":"2024-04-25T08:43:35.351734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.365096+0000","last_change":"2024-04-25T08:43:36.365096+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.365096+0000","last_undegraded":"2024-04-25T08:43:36.365096+0000","last_fullsized":"2024-04-25T08:43:36.365096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.358105+0000","last_change":"2024-04-25T08:43:35.358105+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.358105+0000","last_undegraded":"2024-04-25T08:43:35.358105+0000","last_fullsized":"2024-04-25T08:43:35.358105+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353649+0000","last_change":"2024-04-25T08:43:35.353649+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353649+0000","last_undegraded":"2024-04-25T08:43:35.353649+0000","last_fullsized":"2024-04-25T08:43:35.353649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.353638+0000","last_change":"2024-04-25T08:43:35.353638+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.353638+0000","last_undegraded":"2024-04-25T08:43:35.353638+0000","last_fullsized":"2024-04-25T08:43:35.353638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.370700+0000","last_change":"2024-04-25T08:43:36.368863+0000","last_active":"2024-04-25T08:43:36.370700+0000","last_peered":"2024-04-25T08:43:36.370700+0000","last_clean":"2024-04-25T08:43:36.370700+0000","last_became_active":"2024-04-25T08:43:36.368563+0000","last_became_peered":"2024-04-25T08:43:36.368563+0000","last_unstale":"2024-04-25T08:43:36.370700+0000","last_undegraded":"2024-04-25T08:43:36.370700+0000","last_fullsized":"2024-04-25T08:43:36.370700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:52.443687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.355207+0000","last_change":"2024-04-25T08:43:35.355207+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.355207+0000","last_undegraded":"2024-04-25T08:43:35.355207+0000","last_fullsized":"2024-04-25T08:43:35.355207+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-04-25T08:43:36.361889+0000","last_change":"2024-04-25T08:43:36.361889+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.361889+0000","last_undegraded":"2024-04-25T08:43:36.361889+0000","last_fullsized":"2024-04-25T08:43:36.361889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-04-25T08:43:35.354686+0000","last_change":"2024-04-25T08:43:35.354686+0000","last_active":"2024-04-25T08:43:35.344373+0000","last_peered":"2024-04-25T08:43:35.344373+0000","last_clean":"2024-04-25T08:43:35.344373+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:35.354686+0000","last_undegraded":"2024-04-25T08:43:35.354686+0000","last_fullsized":"2024-04-25T08:43:35.354686+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:43:36.348590+0000","last_change":"2024-04-25T08:43:36.348590+0000","last_active":"2024-04-25T08:43:36.348590+0000","last_peered":"2024-04-25T08:43:36.348590+0000","last_clean":"2024-04-25T08:43:36.348590+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:43:36.348590+0000","last_undegraded":"2024-04-25T08:43:36.348590+0000","last_fullsized":"2024-04-25T08:43:36.348590+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.372926+0000","last_change":"2024-04-25T08:43:36.370869+0000","last_active":"2024-04-25T08:43:36.372926+0000","last_peered":"2024-04-25T08:43:36.372926+0000","last_clean":"2024-04-25T08:43:36.372926+0000","last_became_active":"2024-04-25T08:43:36.370179+0000","last_became_peered":"2024-04-25T08:43:36.370179+0000","last_unstale":"2024-04-25T08:43:36.372926+0000","last_undegraded":"2024-04-25T08:43:36.372926+0000","last_fullsized":"2024-04-25T08:43:36.372926+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:02.953547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T08:43:36.366036+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:43:36.366036+0000","last_peered":"2024-04-25T08:43:36.366036+0000","last_clean":"2024-04-25T08:43:36.366036+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:43:36.366036+0000","last_undegraded":"2024-04-25T08:43:36.366036+0000","last_fullsized":"2024-04-25T08:43:36.366036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":759870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":163293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":753661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:43:44.709 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:43:44.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.826+0000 7f895944a640 1 Processor -- start 2024-04-25T08:43:44.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.826+0000 7f895944a640 1 -- start start 2024-04-25T08:43:44.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.827+0000 7f895944a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f89540b2cb0 0x7f89540d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.827+0000 7f895944a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89540b97a0 con 0x7f895415dbe0 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.827+0000 7f895944a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89540d1c50 con 0x7f89540d1020 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.827+0000 7f8952ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f895415dbe0 0x7f89540d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42712/0 (socket says 172.21.15.172:42712) 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.827+0000 7f8952ffd640 1 -- 172.21.15.172:0/744556504 learned_addr learned my addr 172.21.15.172:0/744556504 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.827+0000 7f89527fc640 1 --2- 172.21.15.172:0/744556504 >> v2:172.21.15.172:3300/0 conn(0x7f89540b2cb0 0x7f89540d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.827+0000 7f895944a640 1 -- 172.21.15.172:0/744556504 --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895415dfc0 con 0x7f89540b2cb0 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.827+0000 7f8951ffb640 1 -- 172.21.15.172:0/744556504 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155337377 0 0) 0x7f89540b97a0 con 0x7f895415dbe0 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.828+0000 7f8951ffb640 1 -- 172.21.15.172:0/744556504 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f893c003520 con 0x7f895415dbe0 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.828+0000 7f89527fc640 1 -- 172.21.15.172:0/744556504 >> v1:172.21.15.186:6789/0 conn(0x7f89540d1020 legacy=0x7f89540d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.828+0000 7f89527fc640 1 -- 172.21.15.172:0/744556504 >> v1:172.21.15.172:6789/0 conn(0x7f895415dbe0 legacy=0x7f89540d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:44.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.828+0000 7f89527fc640 1 -- 172.21.15.172:0/744556504 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540d1f30 con 0x7f89540b2cb0 2024-04-25T08:43:44.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.828+0000 7f89527fc640 1 --2- 172.21.15.172:0/744556504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89540b2cb0 0x7f89540d2730 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f89480097a0 tx=0x7f894802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354041f3465364cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:44.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.828+0000 7f8951ffb640 1 -- 172.21.15.172:0/744556504 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948037070 con 0x7f89540b2cb0 2024-04-25T08:43:44.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.829+0000 7f8951ffb640 1 -- 172.21.15.172:0/744556504 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8948032440 con 0x7f89540b2cb0 2024-04-25T08:43:44.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.829+0000 7f8951ffb640 1 -- 172.21.15.172:0/744556504 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948032810 con 0x7f89540b2cb0 2024-04-25T08:43:44.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.829+0000 7f895944a640 1 -- 172.21.15.172:0/744556504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89540b2cb0 msgr2=0x7f89540d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:44.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.829+0000 7f895944a640 1 --2- 172.21.15.172:0/744556504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89540b2cb0 0x7f89540d2730 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f89480097a0 tx=0x7f894802a230 comp rx=0 tx=0).stop 2024-04-25T08:43:44.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.829+0000 7f895944a640 1 -- 172.21.15.172:0/744556504 shutdown_connections 2024-04-25T08:43:44.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.829+0000 7f895944a640 1 --2- 172.21.15.172:0/744556504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89540b2cb0 0x7f89540d2730 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:44.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.829+0000 7f895944a640 1 -- 172.21.15.172:0/744556504 >> 172.21.15.172:0/744556504 conn(0x7f8954061a20 msgr2=0x7f8954061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:44.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.829+0000 7f895944a640 1 -- 172.21.15.172:0/744556504 shutdown_connections 2024-04-25T08:43:44.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.829+0000 7f895944a640 1 -- 172.21.15.172:0/744556504 wait complete. 2024-04-25T08:43:44.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.831+0000 7f895944a640 1 Processor -- start 2024-04-25T08:43:44.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.831+0000 7f895944a640 1 -- start start 2024-04-25T08:43:44.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.831+0000 7f895944a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89540b2cb0 0x7f89540b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.831+0000 7f895944a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89540d1020 0x7f895414c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.831+0000 7f895944a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895415dbe0 0x7f89540b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.831+0000 7f895944a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89540b92a0 con 0x7f895415dbe0 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.831+0000 7f895944a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89540d1a00 con 0x7f89540b2cb0 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.831+0000 7f895944a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89540b9420 con 0x7f89540d1020 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.831+0000 7f89537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895415dbe0 0x7f89540b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f89537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895415dbe0 0x7f89540b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35626/0 (socket says 172.21.15.172:35626) 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f89537fe640 1 -- 172.21.15.172:0/149264149 learned_addr learned my addr 172.21.15.172:0/149264149 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f89527fc640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89540d1020 0x7f895414c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f8952ffd640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89540b2cb0 0x7f89540b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f89537fe640 1 -- 172.21.15.172:0/149264149 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89540d1020 msgr2=0x7f895414c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f89537fe640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89540d1020 0x7f895414c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f89537fe640 1 -- 172.21.15.172:0/149264149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89540b2cb0 msgr2=0x7f89540b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:44.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f89537fe640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89540b2cb0 0x7f89540b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:44.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f89537fe640 1 -- 172.21.15.172:0/149264149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895415f470 con 0x7f895415dbe0 2024-04-25T08:43:44.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f89527fc640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89540d1020 0x7f895414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:44.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f89537fe640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895415dbe0 0x7f89540b3fe0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f894c00c710 tx=0x7f894c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:44.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f893b7fe640 1 -- 172.21.15.172:0/149264149 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c016020 con 0x7f895415dbe0 2024-04-25T08:43:44.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f893b7fe640 1 -- 172.21.15.172:0/149264149 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c006d50 con 0x7f895415dbe0 2024-04-25T08:43:44.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f893b7fe640 1 -- 172.21.15.172:0/149264149 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c003bb0 con 0x7f895415dbe0 2024-04-25T08:43:44.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f895944a640 1 -- 172.21.15.172:0/149264149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895415f730 con 0x7f895415dbe0 2024-04-25T08:43:44.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.832+0000 7f895944a640 1 -- 172.21.15.172:0/149264149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895415fcf0 con 0x7f895415dbe0 2024-04-25T08:43:44.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.833+0000 7f895944a640 1 -- 172.21.15.172:0/149264149 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8954073990 con 0x7f895415dbe0 2024-04-25T08:43:44.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.833+0000 7f893b7fe640 1 -- 172.21.15.172:0/149264149 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f894c00a850 con 0x7f895415dbe0 2024-04-25T08:43:44.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.834+0000 7f893b7fe640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894006b500 0x7f894006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:44.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.834+0000 7f8952ffd640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894006b500 0x7f894006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:44.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.834+0000 7f893b7fe640 1 -- 172.21.15.172:0/149264149 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f894c089ea0 con 0x7f895415dbe0 2024-04-25T08:43:44.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.834+0000 7f8952ffd640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894006b500 0x7f894006d9c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f89440011e0 tx=0x7f8944007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:44.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:44.838+0000 7f893b7fe640 1 -- 172.21.15.172:0/149264149 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f894c020020 con 0x7f895415dbe0 2024-04-25T08:43:44.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.005+0000 7f895944a640 1 -- 172.21.15.172:0/149264149 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89540b4990 con 0x7f894006b500 2024-04-25T08:43:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.011+0000 7f893b7fe640 1 -- 172.21.15.172:0/149264149 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251943 (secure 0 0 0) 0x7f8944005850 con 0x7f894006b500 2024-04-25T08:43:45.005 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:45.007 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:43:45.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 -- 172.21.15.172:0/149264149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894006b500 msgr2=0x7f894006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894006b500 0x7f894006d9c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f89440011e0 tx=0x7f8944007d30 comp rx=0 tx=0).stop 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 -- 172.21.15.172:0/149264149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895415dbe0 msgr2=0x7f89540b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895415dbe0 0x7f89540b3fe0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f894c00c710 tx=0x7f894c00cbd0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 -- 172.21.15.172:0/149264149 shutdown_connections 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894006b500 0x7f894006d9c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f895415dbe0 0x7f89540b3fe0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89540d1020 0x7f895414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 --2- 172.21.15.172:0/149264149 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89540b2cb0 0x7f89540b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 -- 172.21.15.172:0/149264149 >> 172.21.15.172:0/149264149 conn(0x7f8954061a20 msgr2=0x7f89540b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 -- 172.21.15.172:0/149264149 shutdown_connections 2024-04-25T08:43:45.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.014+0000 7f895944a640 1 -- 172.21.15.172:0/149264149 wait complete. 2024-04-25T08:43:45.017 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-04-25T08:43:44.527493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220796,"kb_used_data":4612,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753924,"statfs":{"total":773094113280,"available":772868018176,"internally_reserved":0,"allocated":4722688,"data_stored":2685704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001250"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515441+0000","last_change":"2024-04-25T08:43:37.385305+0000","last_active":"2024-04-25T08:43:39.515441+0000","last_peered":"2024-04-25T08:43:39.515441+0000","last_clean":"2024-04-25T08:43:39.515441+0000","last_became_active":"2024-04-25T08:43:37.384418+0000","last_became_peered":"2024-04-25T08:43:37.384418+0000","last_unstale":"2024-04-25T08:43:39.515441+0000","last_undegraded":"2024-04-25T08:43:39.515441+0000","last_fullsized":"2024-04-25T08:43:39.515441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:57.884061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515343+0000","last_change":"2024-04-25T08:43:37.383115+0000","last_active":"2024-04-25T08:43:39.515343+0000","last_peered":"2024-04-25T08:43:39.515343+0000","last_clean":"2024-04-25T08:43:39.515343+0000","last_became_active":"2024-04-25T08:43:37.382841+0000","last_became_peered":"2024-04-25T08:43:37.382841+0000","last_unstale":"2024-04-25T08:43:39.515343+0000","last_undegraded":"2024-04-25T08:43:39.515343+0000","last_fullsized":"2024-04-25T08:43:39.515343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:45.741787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.384938+0000","last_change":"2024-04-25T08:43:37.382998+0000","last_active":"2024-04-25T08:43:37.384938+0000","last_peered":"2024-04-25T08:43:37.384938+0000","last_clean":"2024-04-25T08:43:37.384938+0000","last_became_active":"2024-04-25T08:43:37.382699+0000","last_became_peered":"2024-04-25T08:43:37.382699+0000","last_unstale":"2024-04-25T08:43:37.384938+0000","last_undegraded":"2024-04-25T08:43:37.384938+0000","last_fullsized":"2024-04-25T08:43:37.384938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:09.736260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368762+0000","last_change":"2024-04-25T08:43:37.381416+0000","last_active":"2024-04-25T08:43:38.368762+0000","last_peered":"2024-04-25T08:43:38.368762+0000","last_clean":"2024-04-25T08:43:38.368762+0000","last_became_active":"2024-04-25T08:43:37.381155+0000","last_became_peered":"2024-04-25T08:43:37.381155+0000","last_unstale":"2024-04-25T08:43:38.368762+0000","last_undegraded":"2024-04-25T08:43:38.368762+0000","last_fullsized":"2024-04-25T08:43:38.368762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:37.699297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368563+0000","last_change":"2024-04-25T08:43:37.379869+0000","last_active":"2024-04-25T08:43:38.368563+0000","last_peered":"2024-04-25T08:43:38.368563+0000","last_clean":"2024-04-25T08:43:38.368563+0000","last_became_active":"2024-04-25T08:43:37.379580+0000","last_became_peered":"2024-04-25T08:43:37.379580+0000","last_unstale":"2024-04-25T08:43:38.368563+0000","last_undegraded":"2024-04-25T08:43:38.368563+0000","last_fullsized":"2024-04-25T08:43:38.368563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:27.473289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.519632+0000","last_change":"2024-04-25T08:43:37.387494+0000","last_active":"2024-04-25T08:43:40.519632+0000","last_peered":"2024-04-25T08:43:40.519632+0000","last_clean":"2024-04-25T08:43:40.519632+0000","last_became_active":"2024-04-25T08:43:37.387212+0000","last_became_peered":"2024-04-25T08:43:37.387212+0000","last_unstale":"2024-04-25T08:43:40.519632+0000","last_undegraded":"2024-04-25T08:43:40.519632+0000","last_fullsized":"2024-04-25T08:43:40.519632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:08.417486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367599+0000","last_change":"2024-04-25T08:43:37.380568+0000","last_active":"2024-04-25T08:43:38.367599+0000","last_peered":"2024-04-25T08:43:38.367599+0000","last_clean":"2024-04-25T08:43:38.367599+0000","last_became_active":"2024-04-25T08:43:37.380243+0000","last_became_peered":"2024-04-25T08:43:37.380243+0000","last_unstale":"2024-04-25T08:43:38.367599+0000","last_undegraded":"2024-04-25T08:43:38.367599+0000","last_fullsized":"2024-04-25T08:43:38.367599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:28.354105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515010+0000","last_change":"2024-04-25T08:43:37.376805+0000","last_active":"2024-04-25T08:43:39.515010+0000","last_peered":"2024-04-25T08:43:39.515010+0000","last_clean":"2024-04-25T08:43:39.515010+0000","last_became_active":"2024-04-25T08:43:37.376363+0000","last_became_peered":"2024-04-25T08:43:37.376363+0000","last_unstale":"2024-04-25T08:43:39.515010+0000","last_undegraded":"2024-04-25T08:43:39.515010+0000","last_fullsized":"2024-04-25T08:43:39.515010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:28.354105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.384969+0000","last_change":"2024-04-25T08:43:37.382951+0000","last_active":"2024-04-25T08:43:37.384969+0000","last_peered":"2024-04-25T08:43:37.384969+0000","last_clean":"2024-04-25T08:43:37.384969+0000","last_became_active":"2024-04-25T08:43:37.382666+0000","last_became_peered":"2024-04-25T08:43:37.382666+0000","last_unstale":"2024-04-25T08:43:37.384969+0000","last_undegraded":"2024-04-25T08:43:37.384969+0000","last_fullsized":"2024-04-25T08:43:37.384969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:16.095403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368517+0000","last_change":"2024-04-25T08:43:37.389616+0000","last_active":"2024-04-25T08:43:38.368517+0000","last_peered":"2024-04-25T08:43:38.368517+0000","last_clean":"2024-04-25T08:43:38.368517+0000","last_became_active":"2024-04-25T08:43:37.387231+0000","last_became_peered":"2024-04-25T08:43:37.387231+0000","last_unstale":"2024-04-25T08:43:38.368517+0000","last_undegraded":"2024-04-25T08:43:38.368517+0000","last_fullsized":"2024-04-25T08:43:38.368517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:45.741787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367583+0000","last_change":"2024-04-25T08:43:37.371448+0000","last_active":"2024-04-25T08:43:38.367583+0000","last_peered":"2024-04-25T08:43:38.367583+0000","last_clean":"2024-04-25T08:43:38.367583+0000","last_became_active":"2024-04-25T08:43:37.370915+0000","last_became_peered":"2024-04-25T08:43:37.370915+0000","last_unstale":"2024-04-25T08:43:38.367583+0000","last_undegraded":"2024-04-25T08:43:38.367583+0000","last_fullsized":"2024-04-25T08:43:38.367583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:18.204695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.394058+0000","last_change":"2024-04-25T08:43:37.388933+0000","last_active":"2024-04-25T08:43:37.394058+0000","last_peered":"2024-04-25T08:43:37.394058+0000","last_clean":"2024-04-25T08:43:37.394058+0000","last_became_active":"2024-04-25T08:43:37.388655+0000","last_became_peered":"2024-04-25T08:43:37.388655+0000","last_unstale":"2024-04-25T08:43:37.394058+0000","last_undegraded":"2024-04-25T08:43:37.394058+0000","last_fullsized":"2024-04-25T08:43:37.394058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:51.877397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367701+0000","last_change":"2024-04-25T08:43:37.382795+0000","last_active":"2024-04-25T08:43:38.367701+0000","last_peered":"2024-04-25T08:43:38.367701+0000","last_clean":"2024-04-25T08:43:38.367701+0000","last_became_active":"2024-04-25T08:43:37.382247+0000","last_became_peered":"2024-04-25T08:43:37.382247+0000","last_unstale":"2024-04-25T08:43:38.367701+0000","last_undegraded":"2024-04-25T08:43:38.367701+0000","last_fullsized":"2024-04-25T08:43:38.367701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:53.266401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.381554+0000","last_change":"2024-04-25T08:43:37.377043+0000","last_active":"2024-04-25T08:43:37.381554+0000","last_peered":"2024-04-25T08:43:37.381554+0000","last_clean":"2024-04-25T08:43:37.381554+0000","last_became_active":"2024-04-25T08:43:37.376729+0000","last_became_peered":"2024-04-25T08:43:37.376729+0000","last_unstale":"2024-04-25T08:43:37.381554+0000","last_undegraded":"2024-04-25T08:43:37.381554+0000","last_fullsized":"2024-04-25T08:43:37.381554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:09.736260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367750+0000","last_change":"2024-04-25T08:43:37.372360+0000","last_active":"2024-04-25T08:43:38.367750+0000","last_peered":"2024-04-25T08:43:38.367750+0000","last_clean":"2024-04-25T08:43:38.367750+0000","last_became_active":"2024-04-25T08:43:37.372073+0000","last_became_peered":"2024-04-25T08:43:37.372073+0000","last_unstale":"2024-04-25T08:43:38.367750+0000","last_undegraded":"2024-04-25T08:43:38.367750+0000","last_fullsized":"2024-04-25T08:43:38.367750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:25.467194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149467+0000","last_change":"2024-04-25T08:43:37.383854+0000","last_active":"2024-04-25T08:43:40.149467+0000","last_peered":"2024-04-25T08:43:40.149467+0000","last_clean":"2024-04-25T08:43:40.149467+0000","last_became_active":"2024-04-25T08:43:37.383489+0000","last_became_peered":"2024-04-25T08:43:37.383489+0000","last_unstale":"2024-04-25T08:43:40.149467+0000","last_undegraded":"2024-04-25T08:43:40.149467+0000","last_fullsized":"2024-04-25T08:43:40.149467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:54.794734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.150005+0000","last_change":"2024-04-25T08:43:37.384174+0000","last_active":"2024-04-25T08:43:40.150005+0000","last_peered":"2024-04-25T08:43:40.150005+0000","last_clean":"2024-04-25T08:43:40.150005+0000","last_became_active":"2024-04-25T08:43:37.383903+0000","last_became_peered":"2024-04-25T08:43:37.383903+0000","last_unstale":"2024-04-25T08:43:40.150005+0000","last_undegraded":"2024-04-25T08:43:40.150005+0000","last_fullsized":"2024-04-25T08:43:40.150005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:25.467194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367700+0000","last_change":"2024-04-25T08:43:37.377550+0000","last_active":"2024-04-25T08:43:38.367700+0000","last_peered":"2024-04-25T08:43:38.367700+0000","last_clean":"2024-04-25T08:43:38.367700+0000","last_became_active":"2024-04-25T08:43:37.377279+0000","last_became_peered":"2024-04-25T08:43:37.377279+0000","last_unstale":"2024-04-25T08:43:38.367700+0000","last_undegraded":"2024-04-25T08:43:38.367700+0000","last_fullsized":"2024-04-25T08:43:38.367700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:55.025413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368718+0000","last_change":"2024-04-25T08:43:37.394499+0000","last_active":"2024-04-25T08:43:38.368718+0000","last_peered":"2024-04-25T08:43:38.368718+0000","last_clean":"2024-04-25T08:43:38.368718+0000","last_became_active":"2024-04-25T08:43:37.394210+0000","last_became_peered":"2024-04-25T08:43:37.394210+0000","last_unstale":"2024-04-25T08:43:38.368718+0000","last_undegraded":"2024-04-25T08:43:38.368718+0000","last_fullsized":"2024-04-25T08:43:38.368718+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:03.957764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367208+0000","last_change":"2024-04-25T08:43:37.385708+0000","last_active":"2024-04-25T08:43:38.367208+0000","last_peered":"2024-04-25T08:43:38.367208+0000","last_clean":"2024-04-25T08:43:38.367208+0000","last_became_active":"2024-04-25T08:43:37.385382+0000","last_became_peered":"2024-04-25T08:43:37.385382+0000","last_unstale":"2024-04-25T08:43:38.367208+0000","last_undegraded":"2024-04-25T08:43:38.367208+0000","last_fullsized":"2024-04-25T08:43:38.367208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:09.736260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367531+0000","last_change":"2024-04-25T08:43:37.390031+0000","last_active":"2024-04-25T08:43:38.367531+0000","last_peered":"2024-04-25T08:43:38.367531+0000","last_clean":"2024-04-25T08:43:38.367531+0000","last_became_active":"2024-04-25T08:43:37.389764+0000","last_became_peered":"2024-04-25T08:43:37.389764+0000","last_unstale":"2024-04-25T08:43:38.367531+0000","last_undegraded":"2024-04-25T08:43:38.367531+0000","last_fullsized":"2024-04-25T08:43:38.367531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:31.472131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.381534+0000","last_change":"2024-04-25T08:43:37.376101+0000","last_active":"2024-04-25T08:43:37.381534+0000","last_peered":"2024-04-25T08:43:37.381534+0000","last_clean":"2024-04-25T08:43:37.381534+0000","last_became_active":"2024-04-25T08:43:37.375320+0000","last_became_peered":"2024-04-25T08:43:37.375320+0000","last_unstale":"2024-04-25T08:43:37.381534+0000","last_undegraded":"2024-04-25T08:43:37.381534+0000","last_fullsized":"2024-04-25T08:43:37.381534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:49.589383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149598+0000","last_change":"2024-04-25T08:43:37.397087+0000","last_active":"2024-04-25T08:43:40.149598+0000","last_peered":"2024-04-25T08:43:40.149598+0000","last_clean":"2024-04-25T08:43:40.149598+0000","last_became_active":"2024-04-25T08:43:37.396766+0000","last_became_peered":"2024-04-25T08:43:37.396766+0000","last_unstale":"2024-04-25T08:43:40.149598+0000","last_undegraded":"2024-04-25T08:43:40.149598+0000","last_fullsized":"2024-04-25T08:43:40.149598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:55.490582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368482+0000","last_change":"2024-04-25T08:43:37.389887+0000","last_active":"2024-04-25T08:43:38.368482+0000","last_peered":"2024-04-25T08:43:38.368482+0000","last_clean":"2024-04-25T08:43:38.368482+0000","last_became_active":"2024-04-25T08:43:37.389632+0000","last_became_peered":"2024-04-25T08:43:37.389632+0000","last_unstale":"2024-04-25T08:43:38.368482+0000","last_undegraded":"2024-04-25T08:43:38.368482+0000","last_fullsized":"2024-04-25T08:43:38.368482+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:53.447904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368191+0000","last_change":"2024-04-25T08:43:37.385533+0000","last_active":"2024-04-25T08:43:38.368191+0000","last_peered":"2024-04-25T08:43:38.368191+0000","last_clean":"2024-04-25T08:43:38.368191+0000","last_became_active":"2024-04-25T08:43:37.385190+0000","last_became_peered":"2024-04-25T08:43:37.385190+0000","last_unstale":"2024-04-25T08:43:38.368191+0000","last_undegraded":"2024-04-25T08:43:38.368191+0000","last_fullsized":"2024-04-25T08:43:38.368191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:15.272540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.519780+0000","last_change":"2024-04-25T08:43:37.382299+0000","last_active":"2024-04-25T08:43:40.519780+0000","last_peered":"2024-04-25T08:43:40.519780+0000","last_clean":"2024-04-25T08:43:40.519780+0000","last_became_active":"2024-04-25T08:43:37.382026+0000","last_became_peered":"2024-04-25T08:43:37.382026+0000","last_unstale":"2024-04-25T08:43:40.519780+0000","last_undegraded":"2024-04-25T08:43:40.519780+0000","last_fullsized":"2024-04-25T08:43:40.519780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:54.794734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367428+0000","last_change":"2024-04-25T08:43:37.382695+0000","last_active":"2024-04-25T08:43:38.367428+0000","last_peered":"2024-04-25T08:43:38.367428+0000","last_clean":"2024-04-25T08:43:38.367428+0000","last_became_active":"2024-04-25T08:43:37.382332+0000","last_became_peered":"2024-04-25T08:43:37.382332+0000","last_unstale":"2024-04-25T08:43:38.367428+0000","last_undegraded":"2024-04-25T08:43:38.367428+0000","last_fullsized":"2024-04-25T08:43:38.367428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:25.027138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367997+0000","last_change":"2024-04-25T08:43:37.388709+0000","last_active":"2024-04-25T08:43:38.367997+0000","last_peered":"2024-04-25T08:43:38.367997+0000","last_clean":"2024-04-25T08:43:38.367997+0000","last_became_active":"2024-04-25T08:43:37.388429+0000","last_became_peered":"2024-04-25T08:43:37.388429+0000","last_unstale":"2024-04-25T08:43:38.367997+0000","last_undegraded":"2024-04-25T08:43:38.367997+0000","last_fullsized":"2024-04-25T08:43:38.367997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.391080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367548+0000","last_change":"2024-04-25T08:43:37.389527+0000","last_active":"2024-04-25T08:43:38.367548+0000","last_peered":"2024-04-25T08:43:38.367548+0000","last_clean":"2024-04-25T08:43:38.367548+0000","last_became_active":"2024-04-25T08:43:37.389255+0000","last_became_peered":"2024-04-25T08:43:37.389255+0000","last_unstale":"2024-04-25T08:43:38.367548+0000","last_undegraded":"2024-04-25T08:43:38.367548+0000","last_fullsized":"2024-04-25T08:43:38.367548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:06.665230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367823+0000","last_change":"2024-04-25T08:43:37.381139+0000","last_active":"2024-04-25T08:43:38.367823+0000","last_peered":"2024-04-25T08:43:38.367823+0000","last_clean":"2024-04-25T08:43:38.367823+0000","last_became_active":"2024-04-25T08:43:37.380839+0000","last_became_peered":"2024-04-25T08:43:37.380839+0000","last_unstale":"2024-04-25T08:43:38.367823+0000","last_undegraded":"2024-04-25T08:43:38.367823+0000","last_fullsized":"2024-04-25T08:43:38.367823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:51.877397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149636+0000","last_change":"2024-04-25T08:43:37.397091+0000","last_active":"2024-04-25T08:43:40.149636+0000","last_peered":"2024-04-25T08:43:40.149636+0000","last_clean":"2024-04-25T08:43:40.149636+0000","last_became_active":"2024-04-25T08:43:37.396824+0000","last_became_peered":"2024-04-25T08:43:37.396824+0000","last_unstale":"2024-04-25T08:43:40.149636+0000","last_undegraded":"2024-04-25T08:43:40.149636+0000","last_fullsized":"2024-04-25T08:43:40.149636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:49.575268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.519700+0000","last_change":"2024-04-25T08:43:37.388756+0000","last_active":"2024-04-25T08:43:40.519700+0000","last_peered":"2024-04-25T08:43:40.519700+0000","last_clean":"2024-04-25T08:43:40.519700+0000","last_became_active":"2024-04-25T08:43:37.388463+0000","last_became_peered":"2024-04-25T08:43:37.388463+0000","last_unstale":"2024-04-25T08:43:40.519700+0000","last_undegraded":"2024-04-25T08:43:40.519700+0000","last_fullsized":"2024-04-25T08:43:40.519700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:56.385776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149703+0000","last_change":"2024-04-25T08:43:37.388480+0000","last_active":"2024-04-25T08:43:40.149703+0000","last_peered":"2024-04-25T08:43:40.149703+0000","last_clean":"2024-04-25T08:43:40.149703+0000","last_became_active":"2024-04-25T08:43:37.388134+0000","last_became_peered":"2024-04-25T08:43:37.388134+0000","last_unstale":"2024-04-25T08:43:40.149703+0000","last_undegraded":"2024-04-25T08:43:40.149703+0000","last_fullsized":"2024-04-25T08:43:40.149703+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:39.024547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368161+0000","last_change":"2024-04-25T08:43:36.362931+0000","last_active":"2024-04-25T08:43:38.368161+0000","last_peered":"2024-04-25T08:43:38.368161+0000","last_clean":"2024-04-25T08:43:38.368161+0000","last_became_active":"2024-04-25T08:43:36.362595+0000","last_became_peered":"2024-04-25T08:43:36.362595+0000","last_unstale":"2024-04-25T08:43:38.368161+0000","last_undegraded":"2024-04-25T08:43:38.368161+0000","last_fullsized":"2024-04-25T08:43:38.368161+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:13.283542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.519816+0000","last_change":"2024-04-25T08:43:37.391798+0000","last_active":"2024-04-25T08:43:40.519816+0000","last_peered":"2024-04-25T08:43:40.519816+0000","last_clean":"2024-04-25T08:43:40.519816+0000","last_became_active":"2024-04-25T08:43:37.391457+0000","last_became_peered":"2024-04-25T08:43:37.391457+0000","last_unstale":"2024-04-25T08:43:40.519816+0000","last_undegraded":"2024-04-25T08:43:40.519816+0000","last_fullsized":"2024-04-25T08:43:40.519816+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:49.575268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.373586+0000","last_change":"2024-04-25T08:43:36.372636+0000","last_active":"2024-04-25T08:43:37.373586+0000","last_peered":"2024-04-25T08:43:37.373586+0000","last_clean":"2024-04-25T08:43:37.373586+0000","last_became_active":"2024-04-25T08:43:36.372398+0000","last_became_peered":"2024-04-25T08:43:36.372398+0000","last_unstale":"2024-04-25T08:43:37.373586+0000","last_undegraded":"2024-04-25T08:43:37.373586+0000","last_fullsized":"2024-04-25T08:43:37.373586+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:48.293884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.381020+0000","last_change":"2024-04-25T08:43:37.376789+0000","last_active":"2024-04-25T08:43:37.381020+0000","last_peered":"2024-04-25T08:43:37.381020+0000","last_clean":"2024-04-25T08:43:37.381020+0000","last_became_active":"2024-04-25T08:43:37.376082+0000","last_became_peered":"2024-04-25T08:43:37.376082+0000","last_unstale":"2024-04-25T08:43:37.381020+0000","last_undegraded":"2024-04-25T08:43:37.381020+0000","last_fullsized":"2024-04-25T08:43:37.381020+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:16.095403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.519845+0000","last_change":"2024-04-25T08:43:36.362303+0000","last_active":"2024-04-25T08:43:40.519845+0000","last_peered":"2024-04-25T08:43:40.519845+0000","last_clean":"2024-04-25T08:43:40.519845+0000","last_became_active":"2024-04-25T08:43:36.362042+0000","last_became_peered":"2024-04-25T08:43:36.362042+0000","last_unstale":"2024-04-25T08:43:40.519845+0000","last_undegraded":"2024-04-25T08:43:40.519845+0000","last_fullsized":"2024-04-25T08:43:40.519845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:15.091186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515293+0000","last_change":"2024-04-25T08:43:37.382073+0000","last_active":"2024-04-25T08:43:39.515293+0000","last_peered":"2024-04-25T08:43:39.515293+0000","last_clean":"2024-04-25T08:43:39.515293+0000","last_became_active":"2024-04-25T08:43:37.380663+0000","last_became_peered":"2024-04-25T08:43:37.380663+0000","last_unstale":"2024-04-25T08:43:39.515293+0000","last_undegraded":"2024-04-25T08:43:39.515293+0000","last_fullsized":"2024-04-25T08:43:39.515293+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:03.406364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.399793+0000","last_change":"2024-04-25T08:43:36.369540+0000","last_active":"2024-04-25T08:43:37.399793+0000","last_peered":"2024-04-25T08:43:37.399793+0000","last_clean":"2024-04-25T08:43:37.399793+0000","last_became_active":"2024-04-25T08:43:36.369267+0000","last_became_peered":"2024-04-25T08:43:36.369267+0000","last_unstale":"2024-04-25T08:43:37.399793+0000","last_undegraded":"2024-04-25T08:43:37.399793+0000","last_fullsized":"2024-04-25T08:43:37.399793+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:02.953547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.394140+0000","last_change":"2024-04-25T08:43:37.389919+0000","last_active":"2024-04-25T08:43:37.394140+0000","last_peered":"2024-04-25T08:43:37.394140+0000","last_clean":"2024-04-25T08:43:37.394140+0000","last_became_active":"2024-04-25T08:43:37.389644+0000","last_became_peered":"2024-04-25T08:43:37.389644+0000","last_unstale":"2024-04-25T08:43:37.394140+0000","last_undegraded":"2024-04-25T08:43:37.394140+0000","last_fullsized":"2024-04-25T08:43:37.394140+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:15.272540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367592+0000","last_change":"2024-04-25T08:43:36.370068+0000","last_active":"2024-04-25T08:43:38.367592+0000","last_peered":"2024-04-25T08:43:38.367592+0000","last_clean":"2024-04-25T08:43:38.367592+0000","last_became_active":"2024-04-25T08:43:36.369507+0000","last_became_peered":"2024-04-25T08:43:36.369507+0000","last_unstale":"2024-04-25T08:43:38.367592+0000","last_undegraded":"2024-04-25T08:43:38.367592+0000","last_fullsized":"2024-04-25T08:43:38.367592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:05.661013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367908+0000","last_change":"2024-04-25T08:43:37.383770+0000","last_active":"2024-04-25T08:43:38.367908+0000","last_peered":"2024-04-25T08:43:38.367908+0000","last_clean":"2024-04-25T08:43:38.367908+0000","last_became_active":"2024-04-25T08:43:37.383504+0000","last_became_peered":"2024-04-25T08:43:37.383504+0000","last_unstale":"2024-04-25T08:43:38.367908+0000","last_undegraded":"2024-04-25T08:43:38.367908+0000","last_fullsized":"2024-04-25T08:43:38.367908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:45.453439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149542+0000","last_change":"2024-04-25T08:43:36.370505+0000","last_active":"2024-04-25T08:43:40.149542+0000","last_peered":"2024-04-25T08:43:40.149542+0000","last_clean":"2024-04-25T08:43:40.149542+0000","last_became_active":"2024-04-25T08:43:36.370213+0000","last_became_peered":"2024-04-25T08:43:36.370213+0000","last_unstale":"2024-04-25T08:43:40.149542+0000","last_undegraded":"2024-04-25T08:43:40.149542+0000","last_fullsized":"2024-04-25T08:43:40.149542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:48.293884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.385041+0000","last_change":"2024-04-25T08:43:37.382168+0000","last_active":"2024-04-25T08:43:37.385041+0000","last_peered":"2024-04-25T08:43:37.385041+0000","last_clean":"2024-04-25T08:43:37.385041+0000","last_became_active":"2024-04-25T08:43:37.381890+0000","last_became_peered":"2024-04-25T08:43:37.381890+0000","last_unstale":"2024-04-25T08:43:37.385041+0000","last_undegraded":"2024-04-25T08:43:37.385041+0000","last_fullsized":"2024-04-25T08:43:37.385041+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:25.027138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.519545+0000","last_change":"2024-04-25T08:43:36.368921+0000","last_active":"2024-04-25T08:43:40.519545+0000","last_peered":"2024-04-25T08:43:40.519545+0000","last_clean":"2024-04-25T08:43:40.519545+0000","last_became_active":"2024-04-25T08:43:36.368640+0000","last_became_peered":"2024-04-25T08:43:36.368640+0000","last_unstale":"2024-04-25T08:43:40.519545+0000","last_undegraded":"2024-04-25T08:43:40.519545+0000","last_fullsized":"2024-04-25T08:43:40.519545+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:40.897638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515038+0000","last_change":"2024-04-25T08:43:37.384382+0000","last_active":"2024-04-25T08:43:39.515038+0000","last_peered":"2024-04-25T08:43:39.515038+0000","last_clean":"2024-04-25T08:43:39.515038+0000","last_became_active":"2024-04-25T08:43:37.383778+0000","last_became_peered":"2024-04-25T08:43:37.383778+0000","last_unstale":"2024-04-25T08:43:39.515038+0000","last_undegraded":"2024-04-25T08:43:39.515038+0000","last_fullsized":"2024-04-25T08:43:39.515038+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:53.266401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.368651+0000","last_change":"2024-04-25T08:43:36.360686+0000","last_active":"2024-04-25T08:43:37.368651+0000","last_peered":"2024-04-25T08:43:37.368651+0000","last_clean":"2024-04-25T08:43:37.368651+0000","last_became_active":"2024-04-25T08:43:36.360389+0000","last_became_peered":"2024-04-25T08:43:36.360389+0000","last_unstale":"2024-04-25T08:43:37.368651+0000","last_undegraded":"2024-04-25T08:43:37.368651+0000","last_fullsized":"2024-04-25T08:43:37.368651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:29.822090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368706+0000","last_change":"2024-04-25T08:43:37.371693+0000","last_active":"2024-04-25T08:43:38.368706+0000","last_peered":"2024-04-25T08:43:38.368706+0000","last_clean":"2024-04-25T08:43:38.368706+0000","last_became_active":"2024-04-25T08:43:37.371380+0000","last_became_peered":"2024-04-25T08:43:37.371380+0000","last_unstale":"2024-04-25T08:43:38.368706+0000","last_undegraded":"2024-04-25T08:43:38.368706+0000","last_fullsized":"2024-04-25T08:43:38.368706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:14.287760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515354+0000","last_change":"2024-04-25T08:43:36.365396+0000","last_active":"2024-04-25T08:43:39.515354+0000","last_peered":"2024-04-25T08:43:39.515354+0000","last_clean":"2024-04-25T08:43:39.515354+0000","last_became_active":"2024-04-25T08:43:36.365128+0000","last_became_peered":"2024-04-25T08:43:36.365128+0000","last_unstale":"2024-04-25T08:43:39.515354+0000","last_undegraded":"2024-04-25T08:43:39.515354+0000","last_fullsized":"2024-04-25T08:43:39.515354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:14.268323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149763+0000","last_change":"2024-04-25T08:43:37.385570+0000","last_active":"2024-04-25T08:43:40.149763+0000","last_peered":"2024-04-25T08:43:40.149763+0000","last_clean":"2024-04-25T08:43:40.149763+0000","last_became_active":"2024-04-25T08:43:37.385293+0000","last_became_peered":"2024-04-25T08:43:37.385293+0000","last_unstale":"2024-04-25T08:43:40.149763+0000","last_undegraded":"2024-04-25T08:43:40.149763+0000","last_fullsized":"2024-04-25T08:43:40.149763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:31.472131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368578+0000","last_change":"2024-04-25T08:43:36.367788+0000","last_active":"2024-04-25T08:43:38.368578+0000","last_peered":"2024-04-25T08:43:38.368578+0000","last_clean":"2024-04-25T08:43:38.368578+0000","last_became_active":"2024-04-25T08:43:36.367522+0000","last_became_peered":"2024-04-25T08:43:36.367522+0000","last_unstale":"2024-04-25T08:43:38.368578+0000","last_undegraded":"2024-04-25T08:43:38.368578+0000","last_fullsized":"2024-04-25T08:43:38.368578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:54.021196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.394097+0000","last_change":"2024-04-25T08:43:37.388243+0000","last_active":"2024-04-25T08:43:37.394097+0000","last_peered":"2024-04-25T08:43:37.394097+0000","last_clean":"2024-04-25T08:43:37.394097+0000","last_became_active":"2024-04-25T08:43:37.387998+0000","last_became_peered":"2024-04-25T08:43:37.387998+0000","last_unstale":"2024-04-25T08:43:37.394097+0000","last_undegraded":"2024-04-25T08:43:37.394097+0000","last_fullsized":"2024-04-25T08:43:37.394097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:55.025413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368339+0000","last_change":"2024-04-25T08:43:36.372348+0000","last_active":"2024-04-25T08:43:38.368339+0000","last_peered":"2024-04-25T08:43:38.368339+0000","last_clean":"2024-04-25T08:43:38.368339+0000","last_became_active":"2024-04-25T08:43:36.372085+0000","last_became_peered":"2024-04-25T08:43:36.372085+0000","last_unstale":"2024-04-25T08:43:38.368339+0000","last_undegraded":"2024-04-25T08:43:38.368339+0000","last_fullsized":"2024-04-25T08:43:38.368339+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:50.873180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.380737+0000","last_change":"2024-04-25T08:43:37.375737+0000","last_active":"2024-04-25T08:43:37.380737+0000","last_peered":"2024-04-25T08:43:37.380737+0000","last_clean":"2024-04-25T08:43:37.380737+0000","last_became_active":"2024-04-25T08:43:37.375427+0000","last_became_peered":"2024-04-25T08:43:37.375427+0000","last_unstale":"2024-04-25T08:43:37.380737+0000","last_undegraded":"2024-04-25T08:43:37.380737+0000","last_fullsized":"2024-04-25T08:43:37.380737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:41.901855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515158+0000","last_change":"2024-04-25T08:43:36.370818+0000","last_active":"2024-04-25T08:43:39.515158+0000","last_peered":"2024-04-25T08:43:39.515158+0000","last_clean":"2024-04-25T08:43:39.515158+0000","last_became_active":"2024-04-25T08:43:36.370582+0000","last_became_peered":"2024-04-25T08:43:36.370582+0000","last_unstale":"2024-04-25T08:43:39.515158+0000","last_undegraded":"2024-04-25T08:43:39.515158+0000","last_fullsized":"2024-04-25T08:43:39.515158+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:48:50.873180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.384617+0000","last_change":"2024-04-25T08:43:37.382453+0000","last_active":"2024-04-25T08:43:37.384617+0000","last_peered":"2024-04-25T08:43:37.384617+0000","last_clean":"2024-04-25T08:43:37.384617+0000","last_became_active":"2024-04-25T08:43:37.382159+0000","last_became_peered":"2024-04-25T08:43:37.382159+0000","last_unstale":"2024-04-25T08:43:37.384617+0000","last_undegraded":"2024-04-25T08:43:37.384617+0000","last_fullsized":"2024-04-25T08:43:37.384617+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:49.589383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515133+0000","last_change":"2024-04-25T08:43:36.374163+0000","last_active":"2024-04-25T08:43:39.515133+0000","last_peered":"2024-04-25T08:43:39.515133+0000","last_clean":"2024-04-25T08:43:39.515133+0000","last_became_active":"2024-04-25T08:43:36.373880+0000","last_became_peered":"2024-04-25T08:43:36.373880+0000","last_unstale":"2024-04-25T08:43:39.515133+0000","last_undegraded":"2024-04-25T08:43:39.515133+0000","last_fullsized":"2024-04-25T08:43:39.515133+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:08.434634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.514979+0000","last_change":"2024-04-25T08:43:37.386611+0000","last_active":"2024-04-25T08:43:39.514979+0000","last_peered":"2024-04-25T08:43:39.514979+0000","last_clean":"2024-04-25T08:43:39.514979+0000","last_became_active":"2024-04-25T08:43:37.386316+0000","last_became_peered":"2024-04-25T08:43:37.386316+0000","last_unstale":"2024-04-25T08:43:39.514979+0000","last_undegraded":"2024-04-25T08:43:39.514979+0000","last_fullsized":"2024-04-25T08:43:39.514979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:18.204695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.519538+0000","last_change":"2024-04-25T08:43:36.369867+0000","last_active":"2024-04-25T08:43:40.519538+0000","last_peered":"2024-04-25T08:43:40.519538+0000","last_clean":"2024-04-25T08:43:40.519538+0000","last_became_active":"2024-04-25T08:43:36.369575+0000","last_became_peered":"2024-04-25T08:43:36.369575+0000","last_unstale":"2024-04-25T08:43:40.519538+0000","last_undegraded":"2024-04-25T08:43:40.519538+0000","last_fullsized":"2024-04-25T08:43:40.519538+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:48.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149659+0000","last_change":"2024-04-25T08:43:37.397101+0000","last_active":"2024-04-25T08:43:40.149659+0000","last_peered":"2024-04-25T08:43:40.149659+0000","last_clean":"2024-04-25T08:43:40.149659+0000","last_became_active":"2024-04-25T08:43:37.396795+0000","last_became_peered":"2024-04-25T08:43:37.396795+0000","last_unstale":"2024-04-25T08:43:40.149659+0000","last_undegraded":"2024-04-25T08:43:40.149659+0000","last_fullsized":"2024-04-25T08:43:40.149659+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:28.889763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367068+0000","last_change":"2024-04-25T08:43:36.367865+0000","last_active":"2024-04-25T08:43:38.367068+0000","last_peered":"2024-04-25T08:43:38.367068+0000","last_clean":"2024-04-25T08:43:38.367068+0000","last_became_active":"2024-04-25T08:43:36.367571+0000","last_became_peered":"2024-04-25T08:43:36.367571+0000","last_unstale":"2024-04-25T08:43:38.367068+0000","last_undegraded":"2024-04-25T08:43:38.367068+0000","last_fullsized":"2024-04-25T08:43:38.367068+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:02.953547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515047+0000","last_change":"2024-04-25T08:43:37.379942+0000","last_active":"2024-04-25T08:43:39.515047+0000","last_peered":"2024-04-25T08:43:39.515047+0000","last_clean":"2024-04-25T08:43:39.515047+0000","last_became_active":"2024-04-25T08:43:37.379671+0000","last_became_peered":"2024-04-25T08:43:37.379671+0000","last_unstale":"2024-04-25T08:43:39.515047+0000","last_undegraded":"2024-04-25T08:43:39.515047+0000","last_fullsized":"2024-04-25T08:43:39.515047+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:25.467194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149456+0000","last_change":"2024-04-25T08:43:36.372180+0000","last_active":"2024-04-25T08:43:40.149456+0000","last_peered":"2024-04-25T08:43:40.149456+0000","last_clean":"2024-04-25T08:43:40.149456+0000","last_became_active":"2024-04-25T08:43:36.371910+0000","last_became_peered":"2024-04-25T08:43:36.371910+0000","last_unstale":"2024-04-25T08:43:40.149456+0000","last_undegraded":"2024-04-25T08:43:40.149456+0000","last_fullsized":"2024-04-25T08:43:40.149456+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:40.897638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515229+0000","last_change":"2024-04-25T08:43:37.380901+0000","last_active":"2024-04-25T08:43:39.515229+0000","last_peered":"2024-04-25T08:43:39.515229+0000","last_clean":"2024-04-25T08:43:39.515229+0000","last_became_active":"2024-04-25T08:43:37.380540+0000","last_became_peered":"2024-04-25T08:43:37.380540+0000","last_unstale":"2024-04-25T08:43:39.515229+0000","last_undegraded":"2024-04-25T08:43:39.515229+0000","last_fullsized":"2024-04-25T08:43:39.515229+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:44.391080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368568+0000","last_change":"2024-04-25T08:43:36.363757+0000","last_active":"2024-04-25T08:43:38.368568+0000","last_peered":"2024-04-25T08:43:38.368568+0000","last_clean":"2024-04-25T08:43:38.368568+0000","last_became_active":"2024-04-25T08:43:36.363462+0000","last_became_peered":"2024-04-25T08:43:36.363462+0000","last_unstale":"2024-04-25T08:43:38.368568+0000","last_undegraded":"2024-04-25T08:43:38.368568+0000","last_fullsized":"2024-04-25T08:43:38.368568+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:08.732043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368444+0000","last_change":"2024-04-25T08:43:37.390677+0000","last_active":"2024-04-25T08:43:38.368444+0000","last_peered":"2024-04-25T08:43:38.368444+0000","last_clean":"2024-04-25T08:43:38.368444+0000","last_became_active":"2024-04-25T08:43:37.390384+0000","last_became_peered":"2024-04-25T08:43:37.390384+0000","last_unstale":"2024-04-25T08:43:38.368444+0000","last_undegraded":"2024-04-25T08:43:38.368444+0000","last_fullsized":"2024-04-25T08:43:38.368444+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:13.062613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.395720+0000","last_change":"2024-04-25T08:43:36.367885+0000","last_active":"2024-04-25T08:43:37.395720+0000","last_peered":"2024-04-25T08:43:37.395720+0000","last_clean":"2024-04-25T08:43:37.395720+0000","last_became_active":"2024-04-25T08:43:36.367592+0000","last_became_peered":"2024-04-25T08:43:36.367592+0000","last_unstale":"2024-04-25T08:43:37.395720+0000","last_undegraded":"2024-04-25T08:43:37.395720+0000","last_fullsized":"2024-04-25T08:43:37.395720+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:36.695080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.386496+0000","last_change":"2024-04-25T08:43:37.384021+0000","last_active":"2024-04-25T08:43:37.386496+0000","last_peered":"2024-04-25T08:43:37.386496+0000","last_clean":"2024-04-25T08:43:37.386496+0000","last_became_active":"2024-04-25T08:43:37.383726+0000","last_became_peered":"2024-04-25T08:43:37.383726+0000","last_unstale":"2024-04-25T08:43:37.386496+0000","last_undegraded":"2024-04-25T08:43:37.386496+0000","last_fullsized":"2024-04-25T08:43:37.386496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:06.665230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368645+0000","last_change":"2024-04-25T08:43:36.371424+0000","last_active":"2024-04-25T08:43:38.368645+0000","last_peered":"2024-04-25T08:43:38.368645+0000","last_clean":"2024-04-25T08:43:38.368645+0000","last_became_active":"2024-04-25T08:43:36.371136+0000","last_became_peered":"2024-04-25T08:43:36.371136+0000","last_unstale":"2024-04-25T08:43:38.368645+0000","last_undegraded":"2024-04-25T08:43:38.368645+0000","last_fullsized":"2024-04-25T08:43:38.368645+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:20.078191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368851+0000","last_change":"2024-04-25T08:43:37.390552+0000","last_active":"2024-04-25T08:43:38.368851+0000","last_peered":"2024-04-25T08:43:38.368851+0000","last_clean":"2024-04-25T08:43:38.368851+0000","last_became_active":"2024-04-25T08:43:37.390307+0000","last_became_peered":"2024-04-25T08:43:37.390307+0000","last_unstale":"2024-04-25T08:43:38.368851+0000","last_undegraded":"2024-04-25T08:43:38.368851+0000","last_fullsized":"2024-04-25T08:43:38.368851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:30.826307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.519598+0000","last_change":"2024-04-25T08:43:36.362104+0000","last_active":"2024-04-25T08:43:40.519598+0000","last_peered":"2024-04-25T08:43:40.519598+0000","last_clean":"2024-04-25T08:43:40.519598+0000","last_became_active":"2024-04-25T08:43:36.361806+0000","last_became_peered":"2024-04-25T08:43:36.361806+0000","last_unstale":"2024-04-25T08:43:40.519598+0000","last_undegraded":"2024-04-25T08:43:40.519598+0000","last_fullsized":"2024-04-25T08:43:40.519598+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:48.293884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149904+0000","last_change":"2024-04-25T08:43:37.397110+0000","last_active":"2024-04-25T08:43:40.149904+0000","last_peered":"2024-04-25T08:43:40.149904+0000","last_clean":"2024-04-25T08:43:40.149904+0000","last_became_active":"2024-04-25T08:43:37.396814+0000","last_became_peered":"2024-04-25T08:43:37.396814+0000","last_unstale":"2024-04-25T08:43:40.149904+0000","last_undegraded":"2024-04-25T08:43:40.149904+0000","last_fullsized":"2024-04-25T08:43:40.149904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:00:28.354105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368510+0000","last_change":"2024-04-25T08:43:36.373769+0000","last_active":"2024-04-25T08:43:38.368510+0000","last_peered":"2024-04-25T08:43:38.368510+0000","last_clean":"2024-04-25T08:43:38.368510+0000","last_became_active":"2024-04-25T08:43:36.373499+0000","last_became_peered":"2024-04-25T08:43:36.373499+0000","last_unstale":"2024-04-25T08:43:38.368510+0000","last_undegraded":"2024-04-25T08:43:38.368510+0000","last_fullsized":"2024-04-25T08:43:38.368510+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:19.574206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.394024+0000","last_change":"2024-04-25T08:43:37.387600+0000","last_active":"2024-04-25T08:43:37.394024+0000","last_peered":"2024-04-25T08:43:37.394024+0000","last_clean":"2024-04-25T08:43:37.394024+0000","last_became_active":"2024-04-25T08:43:37.387298+0000","last_became_peered":"2024-04-25T08:43:37.387298+0000","last_unstale":"2024-04-25T08:43:37.394024+0000","last_undegraded":"2024-04-25T08:43:37.394024+0000","last_fullsized":"2024-04-25T08:43:37.394024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:06.665230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368451+0000","last_change":"2024-04-25T08:43:36.362667+0000","last_active":"2024-04-25T08:43:38.368451+0000","last_peered":"2024-04-25T08:43:38.368451+0000","last_clean":"2024-04-25T08:43:38.368451+0000","last_became_active":"2024-04-25T08:43:36.362400+0000","last_became_peered":"2024-04-25T08:43:36.362400+0000","last_unstale":"2024-04-25T08:43:38.368451+0000","last_undegraded":"2024-04-25T08:43:38.368451+0000","last_fullsized":"2024-04-25T08:43:38.368451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:21.721641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368185+0000","last_change":"2024-04-25T08:43:37.380388+0000","last_active":"2024-04-25T08:43:38.368185+0000","last_peered":"2024-04-25T08:43:38.368185+0000","last_clean":"2024-04-25T08:43:38.368185+0000","last_became_active":"2024-04-25T08:43:37.379994+0000","last_became_peered":"2024-04-25T08:43:37.379994+0000","last_unstale":"2024-04-25T08:43:38.368185+0000","last_undegraded":"2024-04-25T08:43:38.368185+0000","last_fullsized":"2024-04-25T08:43:38.368185+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:03.406364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149804+0000","last_change":"2024-04-25T08:43:36.373963+0000","last_active":"2024-04-25T08:43:40.149804+0000","last_peered":"2024-04-25T08:43:40.149804+0000","last_clean":"2024-04-25T08:43:40.149804+0000","last_became_active":"2024-04-25T08:43:36.373670+0000","last_became_peered":"2024-04-25T08:43:36.373670+0000","last_unstale":"2024-04-25T08:43:40.149804+0000","last_undegraded":"2024-04-25T08:43:40.149804+0000","last_fullsized":"2024-04-25T08:43:40.149804+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:15.091186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515226+0000","last_change":"2024-04-25T08:43:37.384092+0000","last_active":"2024-04-25T08:43:39.515226+0000","last_peered":"2024-04-25T08:43:39.515226+0000","last_clean":"2024-04-25T08:43:39.515226+0000","last_became_active":"2024-04-25T08:43:37.383309+0000","last_became_peered":"2024-04-25T08:43:37.383309+0000","last_unstale":"2024-04-25T08:43:39.515226+0000","last_undegraded":"2024-04-25T08:43:39.515226+0000","last_fullsized":"2024-04-25T08:43:39.515226+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:45.453439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368379+0000","last_change":"2024-04-25T08:43:36.368844+0000","last_active":"2024-04-25T08:43:38.368379+0000","last_peered":"2024-04-25T08:43:38.368379+0000","last_clean":"2024-04-25T08:43:38.368379+0000","last_became_active":"2024-04-25T08:43:36.368561+0000","last_became_peered":"2024-04-25T08:43:36.368561+0000","last_unstale":"2024-04-25T08:43:38.368379+0000","last_undegraded":"2024-04-25T08:43:38.368379+0000","last_fullsized":"2024-04-25T08:43:38.368379+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:36.296321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.519650+0000","last_change":"2024-04-25T08:43:37.389820+0000","last_active":"2024-04-25T08:43:40.519650+0000","last_peered":"2024-04-25T08:43:40.519650+0000","last_clean":"2024-04-25T08:43:40.519650+0000","last_became_active":"2024-04-25T08:43:37.389527+0000","last_became_peered":"2024-04-25T08:43:37.389527+0000","last_unstale":"2024-04-25T08:43:40.519650+0000","last_undegraded":"2024-04-25T08:43:40.519650+0000","last_fullsized":"2024-04-25T08:43:40.519650+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:04.841431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368668+0000","last_change":"2024-04-25T08:43:36.366405+0000","last_active":"2024-04-25T08:43:38.368668+0000","last_peered":"2024-04-25T08:43:38.368668+0000","last_clean":"2024-04-25T08:43:38.368668+0000","last_became_active":"2024-04-25T08:43:36.366138+0000","last_became_peered":"2024-04-25T08:43:36.366138+0000","last_unstale":"2024-04-25T08:43:38.368668+0000","last_undegraded":"2024-04-25T08:43:38.368668+0000","last_fullsized":"2024-04-25T08:43:38.368668+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:24.022921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149994+0000","last_change":"2024-04-25T08:43:37.386026+0000","last_active":"2024-04-25T08:43:40.149994+0000","last_peered":"2024-04-25T08:43:40.149994+0000","last_clean":"2024-04-25T08:43:40.149994+0000","last_became_active":"2024-04-25T08:43:37.385610+0000","last_became_peered":"2024-04-25T08:43:37.385610+0000","last_unstale":"2024-04-25T08:43:40.149994+0000","last_undegraded":"2024-04-25T08:43:40.149994+0000","last_fullsized":"2024-04-25T08:43:40.149994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:53.266401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368724+0000","last_change":"2024-04-25T08:43:36.364266+0000","last_active":"2024-04-25T08:43:38.368724+0000","last_peered":"2024-04-25T08:43:38.368724+0000","last_clean":"2024-04-25T08:43:38.368724+0000","last_became_active":"2024-04-25T08:43:36.364007+0000","last_became_peered":"2024-04-25T08:43:36.364007+0000","last_unstale":"2024-04-25T08:43:38.368724+0000","last_undegraded":"2024-04-25T08:43:38.368724+0000","last_fullsized":"2024-04-25T08:43:38.368724+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:34.449179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.515286+0000","last_change":"2024-04-25T08:43:37.386073+0000","last_active":"2024-04-25T08:43:39.515286+0000","last_peered":"2024-04-25T08:43:39.515286+0000","last_clean":"2024-04-25T08:43:39.515286+0000","last_became_active":"2024-04-25T08:43:37.385767+0000","last_became_peered":"2024-04-25T08:43:37.385767+0000","last_unstale":"2024-04-25T08:43:39.515286+0000","last_undegraded":"2024-04-25T08:43:39.515286+0000","last_fullsized":"2024-04-25T08:43:39.515286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:13.062613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.372905+0000","last_change":"2024-04-25T08:43:36.371891+0000","last_active":"2024-04-25T08:43:37.372905+0000","last_peered":"2024-04-25T08:43:37.372905+0000","last_clean":"2024-04-25T08:43:37.372905+0000","last_became_active":"2024-04-25T08:43:36.371634+0000","last_became_peered":"2024-04-25T08:43:36.371634+0000","last_unstale":"2024-04-25T08:43:37.372905+0000","last_undegraded":"2024-04-25T08:43:37.372905+0000","last_fullsized":"2024-04-25T08:43:37.372905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:29.822090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.390590+0000","last_change":"2024-04-25T08:43:37.387187+0000","last_active":"2024-04-25T08:43:37.390590+0000","last_peered":"2024-04-25T08:43:37.390590+0000","last_clean":"2024-04-25T08:43:37.390590+0000","last_became_active":"2024-04-25T08:43:37.386923+0000","last_became_peered":"2024-04-25T08:43:37.386923+0000","last_unstale":"2024-04-25T08:43:37.390590+0000","last_undegraded":"2024-04-25T08:43:37.390590+0000","last_fullsized":"2024-04-25T08:43:37.390590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:25.027138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.374398+0000","last_change":"2024-04-25T08:43:36.370874+0000","last_active":"2024-04-25T08:43:37.374398+0000","last_peered":"2024-04-25T08:43:37.374398+0000","last_clean":"2024-04-25T08:43:37.374398+0000","last_became_active":"2024-04-25T08:43:36.369780+0000","last_became_peered":"2024-04-25T08:43:36.369780+0000","last_unstale":"2024-04-25T08:43:37.374398+0000","last_undegraded":"2024-04-25T08:43:37.374398+0000","last_fullsized":"2024-04-25T08:43:37.374398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:40.897638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.519577+0000","last_change":"2024-04-25T08:43:37.386831+0000","last_active":"2024-04-25T08:43:40.519577+0000","last_peered":"2024-04-25T08:43:40.519577+0000","last_clean":"2024-04-25T08:43:40.519577+0000","last_became_active":"2024-04-25T08:43:37.386571+0000","last_became_peered":"2024-04-25T08:43:37.386571+0000","last_unstale":"2024-04-25T08:43:40.519577+0000","last_undegraded":"2024-04-25T08:43:40.519577+0000","last_fullsized":"2024-04-25T08:43:40.519577+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:55.433807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.367948+0000","last_change":"2024-04-25T08:43:36.368863+0000","last_active":"2024-04-25T08:43:38.367948+0000","last_peered":"2024-04-25T08:43:38.367948+0000","last_clean":"2024-04-25T08:43:38.367948+0000","last_became_active":"2024-04-25T08:43:36.368563+0000","last_became_peered":"2024-04-25T08:43:36.368563+0000","last_unstale":"2024-04-25T08:43:38.367948+0000","last_undegraded":"2024-04-25T08:43:38.367948+0000","last_fullsized":"2024-04-25T08:43:38.367948+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:26.469072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.386679+0000","last_change":"2024-04-25T08:43:37.384889+0000","last_active":"2024-04-25T08:43:37.386679+0000","last_peered":"2024-04-25T08:43:37.386679+0000","last_clean":"2024-04-25T08:43:37.386679+0000","last_became_active":"2024-04-25T08:43:37.384556+0000","last_became_peered":"2024-04-25T08:43:37.384556+0000","last_unstale":"2024-04-25T08:43:37.386679+0000","last_undegraded":"2024-04-25T08:43:37.386679+0000","last_fullsized":"2024-04-25T08:43:37.386679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:55.025413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T08:43:37.368984+0000","last_change":"2024-04-25T08:43:36.370334+0000","last_active":"2024-04-25T08:43:37.368984+0000","last_peered":"2024-04-25T08:43:37.368984+0000","last_clean":"2024-04-25T08:43:37.368984+0000","last_became_active":"2024-04-25T08:43:36.370013+0000","last_became_peered":"2024-04-25T08:43:36.370013+0000","last_unstale":"2024-04-25T08:43:37.368984+0000","last_undegraded":"2024-04-25T08:43:37.368984+0000","last_fullsized":"2024-04-25T08:43:37.368984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:48.293884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149894+0000","last_change":"2024-04-25T08:43:37.386581+0000","last_active":"2024-04-25T08:43:40.149894+0000","last_peered":"2024-04-25T08:43:40.149894+0000","last_clean":"2024-04-25T08:43:40.149894+0000","last_became_active":"2024-04-25T08:43:37.386273+0000","last_became_peered":"2024-04-25T08:43:37.386273+0000","last_unstale":"2024-04-25T08:43:40.149894+0000","last_undegraded":"2024-04-25T08:43:40.149894+0000","last_fullsized":"2024-04-25T08:43:40.149894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:18.204695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:39.514879+0000","last_change":"2024-04-25T08:43:36.365370+0000","last_active":"2024-04-25T08:43:39.514879+0000","last_peered":"2024-04-25T08:43:39.514879+0000","last_clean":"2024-04-25T08:43:39.514879+0000","last_became_active":"2024-04-25T08:43:36.365097+0000","last_became_peered":"2024-04-25T08:43:36.365097+0000","last_unstale":"2024-04-25T08:43:39.514879+0000","last_undegraded":"2024-04-25T08:43:39.514879+0000","last_fullsized":"2024-04-25T08:43:39.514879+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:05.661013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:38.368588+0000","last_change":"2024-04-25T08:43:37.389245+0000","last_active":"2024-04-25T08:43:38.368588+0000","last_peered":"2024-04-25T08:43:38.368588+0000","last_clean":"2024-04-25T08:43:38.368588+0000","last_became_active":"2024-04-25T08:43:37.388938+0000","last_became_peered":"2024-04-25T08:43:37.388938+0000","last_unstale":"2024-04-25T08:43:38.368588+0000","last_undegraded":"2024-04-25T08:43:38.368588+0000","last_fullsized":"2024-04-25T08:43:38.368588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:36.348590+0000","last_clean_scrub_stamp":"2024-04-25T08:43:36.348590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:57.884061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149637+0000","last_change":"2024-04-25T08:43:36.370869+0000","last_active":"2024-04-25T08:43:40.149637+0000","last_peered":"2024-04-25T08:43:40.149637+0000","last_clean":"2024-04-25T08:43:40.149637+0000","last_became_active":"2024-04-25T08:43:36.370179+0000","last_became_peered":"2024-04-25T08:43:36.370179+0000","last_unstale":"2024-04-25T08:43:40.149637+0000","last_undegraded":"2024-04-25T08:43:40.149637+0000","last_fullsized":"2024-04-25T08:43:40.149637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:43:35.344373+0000","last_clean_scrub_stamp":"2024-04-25T08:43:35.344373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:48.585166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-25T08:43:40.149657+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:43:40.149657+0000","last_peered":"2024-04-25T08:43:40.149657+0000","last_clean":"2024-04-25T08:43:40.149657+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:43:40.149657+0000","last_undegraded":"2024-04-25T08:43:40.149657+0000","last_fullsized":"2024-04-25T08:43:40.149657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":782078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":183940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":191674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":183426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":773738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:43:45.020 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:43:45.021 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:43:45.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.169+0000 7fa6e8be0640 1 Processor -- start 2024-04-25T08:43:45.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.169+0000 7fa6e8be0640 1 -- start start 2024-04-25T08:43:45.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.170+0000 7fa6e8be0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6e415dc20 0x7fa6e40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.170+0000 7fa6e8be0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa6e4161710 0x7fa6e40cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.170+0000 7fa6e8be0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e415e000 con 0x7fa6e40b9330 2024-04-25T08:43:45.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.170+0000 7fa6e8be0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e40d1de0 con 0x7fa6e4161710 2024-04-25T08:43:45.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.170+0000 7fa6e8be0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4161c60 con 0x7fa6e415dc20 2024-04-25T08:43:45.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.170+0000 7fa6e1d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa6e4161710 0x7fa6e40cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.171+0000 7fa6e1d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa6e4161710 0x7fa6e40cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35632/0 (socket says 172.21.15.172:35632) 2024-04-25T08:43:45.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.171+0000 7fa6e1d9b640 1 -- 172.21.15.172:0/2504189087 learned_addr learned my addr 172.21.15.172:0/2504189087 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:45.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.171+0000 7fa6e259c640 1 --2- 172.21.15.172:0/2504189087 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6e415dc20 0x7fa6e40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.171+0000 7fa6e1d9b640 1 -- 172.21.15.172:0/2504189087 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6e415dc20 msgr2=0x7fa6e40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:45.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.171+0000 7fa6e1d9b640 1 --2- 172.21.15.172:0/2504189087 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6e415dc20 0x7fa6e40ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.171+0000 7fa6e1d9b640 1 -- 172.21.15.172:0/2504189087 >> v1:172.21.15.186:6789/0 conn(0x7fa6e40b9330 legacy=0x7fa6e406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.171+0000 7fa6e1d9b640 1 -- 172.21.15.172:0/2504189087 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4161f40 con 0x7fa6e4161710 2024-04-25T08:43:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e1d9b640 1 --2- 172.21.15.172:0/2504189087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 0x7fa6e40cebb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009870 tx=0x7fa6d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afe42a3c99a4148 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e159a640 1 -- 172.21.15.172:0/2504189087 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8037070 con 0x7fa6e4161710 2024-04-25T08:43:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e159a640 1 -- 172.21.15.172:0/2504189087 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d8032440 con 0x7fa6e4161710 2024-04-25T08:43:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e159a640 1 -- 172.21.15.172:0/2504189087 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8032810 con 0x7fa6e4161710 2024-04-25T08:43:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e8be0640 1 -- 172.21.15.172:0/2504189087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 msgr2=0x7fa6e40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e8be0640 1 --2- 172.21.15.172:0/2504189087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 0x7fa6e40cebb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009870 tx=0x7fa6d802a270 comp rx=0 tx=0).stop 2024-04-25T08:43:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e8be0640 1 -- 172.21.15.172:0/2504189087 shutdown_connections 2024-04-25T08:43:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e8be0640 1 --2- 172.21.15.172:0/2504189087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 0x7fa6e40cebb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e8be0640 1 --2- 172.21.15.172:0/2504189087 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6e415dc20 0x7fa6e40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e8be0640 1 -- 172.21.15.172:0/2504189087 >> 172.21.15.172:0/2504189087 conn(0x7fa6e40d0420 msgr2=0x7fa6e40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e8be0640 1 -- 172.21.15.172:0/2504189087 shutdown_connections 2024-04-25T08:43:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.172+0000 7fa6e8be0640 1 -- 172.21.15.172:0/2504189087 wait complete. 2024-04-25T08:43:45.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.174+0000 7fa6e8be0640 1 Processor -- start 2024-04-25T08:43:45.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.174+0000 7fa6e8be0640 1 -- start start 2024-04-25T08:43:45.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.174+0000 7fa6e8be0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6e40b9330 0x7fa6e40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.174+0000 7fa6e8be0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6e415dc20 0x7fa6e4152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.174+0000 7fa6e8be0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 0x7fa6e40ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.174+0000 7fa6e8be0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e40b5e50 con 0x7fa6e4161710 2024-04-25T08:43:45.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.174+0000 7fa6e8be0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4162500 con 0x7fa6e40b9330 2024-04-25T08:43:45.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.174+0000 7fa6e8be0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e40b5fd0 con 0x7fa6e415dc20 2024-04-25T08:43:45.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 0x7fa6e40ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 0x7fa6e40ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35638/0 (socket says 172.21.15.172:35638) 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e2d9d640 1 -- 172.21.15.172:0/1306233886 learned_addr learned my addr 172.21.15.172:0/1306233886 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e259c640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6e40b9330 0x7fa6e40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e1d9b640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6e415dc20 0x7fa6e4152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e2d9d640 1 -- 172.21.15.172:0/1306233886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6e415dc20 msgr2=0x7fa6e4152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e2d9d640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6e415dc20 0x7fa6e4152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e2d9d640 1 -- 172.21.15.172:0/1306233886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6e40b9330 msgr2=0x7fa6e40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e2d9d640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6e40b9330 0x7fa6e40cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e2d9d640 1 -- 172.21.15.172:0/1306233886 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e40ac3f0 con 0x7fa6e4161710 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e2d9d640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 0x7fa6e40ccc40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c3c0 tx=0x7fa6dc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6d2ffd640 1 -- 172.21.15.172:0/1306233886 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc017070 con 0x7fa6e4161710 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6d2ffd640 1 -- 172.21.15.172:0/1306233886 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc0052d0 con 0x7fa6e4161710 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e8be0640 1 -- 172.21.15.172:0/1306233886 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e40cdaa0 con 0x7fa6e4161710 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6d2ffd640 1 -- 172.21.15.172:0/1306233886 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc003830 con 0x7fa6e4161710 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.175+0000 7fa6e8be0640 1 -- 172.21.15.172:0/1306233886 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e40ab630 con 0x7fa6e4161710 2024-04-25T08:43:45.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.176+0000 7fa6e8be0640 1 -- 172.21.15.172:0/1306233886 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e4073a00 con 0x7fa6e4161710 2024-04-25T08:43:45.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.177+0000 7fa6d2ffd640 1 -- 172.21.15.172:0/1306233886 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa6dc01a070 con 0x7fa6e4161710 2024-04-25T08:43:45.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.177+0000 7fa6d2ffd640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6c406b4d0 0x7fa6c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.177+0000 7fa6d2ffd640 1 -- 172.21.15.172:0/1306233886 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa6dc089520 con 0x7fa6e4161710 2024-04-25T08:43:45.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.177+0000 7fa6e259c640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6c406b4d0 0x7fa6c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.177+0000 7fa6e259c640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6c406b4d0 0x7fa6c406d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40b2580 tx=0x7fa6d400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:45.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.181+0000 7fa6d2ffd640 1 -- 172.21.15.172:0/1306233886 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa6e40cdaa0 con 0x7fa6e4161710 2024-04-25T08:43:45.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.423+0000 7fa6e8be0640 1 -- 172.21.15.172:0/1306233886 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa6e40d16b0 con 0x7fa6e4161710 2024-04-25T08:43:45.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.425+0000 7fa6d2ffd640 1 -- 172.21.15.172:0/1306233886 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa6e40ac3f0 con 0x7fa6e4161710 2024-04-25T08:43:45.417 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T08:43:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:43:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: caps mds = "allow" 2024-04-25T08:43:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: caps mon = "allow r" 2024-04-25T08:43:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:43:45.418 INFO:teuthology.orchestra.run.smithi172.stderr:updated caps for client.0 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 -- 172.21.15.172:0/1306233886 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6c406b4d0 msgr2=0x7fa6c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6c406b4d0 0x7fa6c406d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40b2580 tx=0x7fa6d400b040 comp rx=0 tx=0).stop 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 -- 172.21.15.172:0/1306233886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 msgr2=0x7fa6e40ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 0x7fa6e40ccc40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00c3c0 tx=0x7fa6dc00c880 comp rx=0 tx=0).stop 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 -- 172.21.15.172:0/1306233886 shutdown_connections 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6c406b4d0 0x7fa6c406d990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6e4161710 0x7fa6e40ccc40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6e415dc20 0x7fa6e4152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 --2- 172.21.15.172:0/1306233886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6e40b9330 0x7fa6e40cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 -- 172.21.15.172:0/1306233886 >> 172.21.15.172:0/1306233886 conn(0x7fa6e40d0420 msgr2=0x7fa6e40b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 -- 172.21.15.172:0/1306233886 shutdown_connections 2024-04-25T08:43:45.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.427+0000 7fa6e8be0640 1 -- 172.21.15.172:0/1306233886 wait complete. 2024-04-25T08:43:45.431 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:43:45.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.535+0000 7fb15109a640 1 Processor -- start 2024-04-25T08:43:45.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.535+0000 7fb15109a640 1 -- start start 2024-04-25T08:43:45.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.536+0000 7fb15109a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb14c15dbe0 0x7fb14c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.536+0000 7fb15109a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb14c0b92a0 0x7fb14c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.536+0000 7fb15109a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c0b97a0 con 0x7fb14c0b2cb0 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.536+0000 7fb15109a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c15dfc0 con 0x7fb14c15dbe0 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.536+0000 7fb15109a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c0d1a00 con 0x7fb14c0b92a0 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.536+0000 7fb14ad9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb14c15dbe0 0x7fb14c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.536+0000 7fb14ad9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb14c15dbe0 0x7fb14c0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35640/0 (socket says 172.21.15.172:35640) 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.536+0000 7fb14a59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb14c0b2cb0 0x7fb14c0b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42726/0 (socket says 172.21.15.172:42726) 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.536+0000 7fb14ad9d640 1 -- 172.21.15.172:0/629675745 learned_addr learned my addr 172.21.15.172:0/629675745 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.537+0000 7fb14ad9d640 1 -- 172.21.15.172:0/629675745 >> v2:172.21.15.186:3300/0 conn(0x7fb14c0b92a0 msgr2=0x7fb14c0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.537+0000 7fb14ad9d640 1 --2- 172.21.15.172:0/629675745 >> v2:172.21.15.186:3300/0 conn(0x7fb14c0b92a0 0x7fb14c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.537+0000 7fb14ad9d640 1 -- 172.21.15.172:0/629675745 >> v1:172.21.15.172:6789/0 conn(0x7fb14c0b2cb0 legacy=0x7fb14c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.537+0000 7fb149d9b640 1 -- 172.21.15.172:0/629675745 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625639006 0 0) 0x7fb14c0b97a0 con 0x7fb14c0b2cb0 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.537+0000 7fb14ad9d640 1 -- 172.21.15.172:0/629675745 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0d1c50 con 0x7fb14c15dbe0 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.537+0000 7fb14ad9d640 1 --2- 172.21.15.172:0/629675745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c15dbe0 0x7fb14c0d0910 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0cfb90 tx=0x7fb14402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572ebcba1e171bca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.537+0000 7fb149d9b640 1 -- 172.21.15.172:0/629675745 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144036070 con 0x7fb14c15dbe0 2024-04-25T08:43:45.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.538+0000 7fb149d9b640 1 -- 172.21.15.172:0/629675745 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb144031600 con 0x7fb14c15dbe0 2024-04-25T08:43:45.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.538+0000 7fb149d9b640 1 -- 172.21.15.172:0/629675745 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1440319d0 con 0x7fb14c15dbe0 2024-04-25T08:43:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.538+0000 7fb15109a640 1 -- 172.21.15.172:0/629675745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c15dbe0 msgr2=0x7fb14c0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.538+0000 7fb15109a640 1 --2- 172.21.15.172:0/629675745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c15dbe0 0x7fb14c0d0910 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0cfb90 tx=0x7fb14402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.538+0000 7fb15109a640 1 -- 172.21.15.172:0/629675745 shutdown_connections 2024-04-25T08:43:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.538+0000 7fb15109a640 1 --2- 172.21.15.172:0/629675745 >> v2:172.21.15.186:3300/0 conn(0x7fb14c0b92a0 0x7fb14c0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.538+0000 7fb15109a640 1 --2- 172.21.15.172:0/629675745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c15dbe0 0x7fb14c0d0910 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.538+0000 7fb15109a640 1 -- 172.21.15.172:0/629675745 >> 172.21.15.172:0/629675745 conn(0x7fb14c061a20 msgr2=0x7fb14c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.538+0000 7fb15109a640 1 -- 172.21.15.172:0/629675745 shutdown_connections 2024-04-25T08:43:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.538+0000 7fb15109a640 1 -- 172.21.15.172:0/629675745 wait complete. 2024-04-25T08:43:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.540+0000 7fb15109a640 1 Processor -- start 2024-04-25T08:43:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.540+0000 7fb15109a640 1 -- start start 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb15109a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb14c0b2cb0 0x7fb14c0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb15109a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c0b92a0 0x7fb14c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb15109a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb14c15dbe0 0x7fb14c0b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb15109a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0b6ab0 con 0x7fb14c0b92a0 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb15109a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0d2210 con 0x7fb14c0b2cb0 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb15109a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0b6c30 con 0x7fb14c15dbe0 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c0b92a0 0x7fb14c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c0b92a0 0x7fb14c0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35646/0 (socket says 172.21.15.172:35646) 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14a59c640 1 -- 172.21.15.172:0/1386180628 learned_addr learned my addr 172.21.15.172:0/1386180628 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14ad9d640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb14c0b2cb0 0x7fb14c0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14b59e640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb14c15dbe0 0x7fb14c0b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14a59c640 1 -- 172.21.15.172:0/1386180628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb14c15dbe0 msgr2=0x7fb14c0b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14a59c640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb14c15dbe0 0x7fb14c0b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14a59c640 1 -- 172.21.15.172:0/1386180628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb14c0b2cb0 msgr2=0x7fb14c0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14a59c640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb14c0b2cb0 0x7fb14c0c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14a59c640 1 -- 172.21.15.172:0/1386180628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0b4af0 con 0x7fb14c0b92a0 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb14a59c640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c0b92a0 0x7fb14c0caa50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c4b0 tx=0x7fb13400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb1437fe640 1 -- 172.21.15.172:0/1386180628 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134018070 con 0x7fb14c0b92a0 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb1437fe640 1 -- 172.21.15.172:0/1386180628 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134007500 con 0x7fb14c0b92a0 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb1437fe640 1 -- 172.21.15.172:0/1386180628 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134004a20 con 0x7fb14c0b92a0 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.541+0000 7fb15109a640 1 -- 172.21.15.172:0/1386180628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c0b4dd0 con 0x7fb14c0b92a0 2024-04-25T08:43:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.542+0000 7fb15109a640 1 -- 172.21.15.172:0/1386180628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c0b5390 con 0x7fb14c0b92a0 2024-04-25T08:43:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.542+0000 7fb15109a640 1 -- 172.21.15.172:0/1386180628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c073990 con 0x7fb14c0b92a0 2024-04-25T08:43:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.543+0000 7fb1437fe640 1 -- 172.21.15.172:0/1386180628 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb13401b070 con 0x7fb14c0b92a0 2024-04-25T08:43:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.543+0000 7fb1437fe640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb12c06b4d0 0x7fb12c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.543+0000 7fb1437fe640 1 -- 172.21.15.172:0/1386180628 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb134089550 con 0x7fb14c0b92a0 2024-04-25T08:43:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.543+0000 7fb14ad9d640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb12c06b4d0 0x7fb12c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.544+0000 7fb14ad9d640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb12c06b4d0 0x7fb12c06d990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb144033000 tx=0x7fb144009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:45.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.548+0000 7fb1437fe640 1 -- 172.21.15.172:0/1386180628 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb134057d40 con 0x7fb14c0b92a0 2024-04-25T08:43:45.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.755+0000 7fb15109a640 1 -- 172.21.15.172:0/1386180628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb14c15b000 con 0x7fb14c0b92a0 2024-04-25T08:43:45.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.756+0000 7fb1437fe640 1 -- 172.21.15.172:0/1386180628 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fb13405bde0 con 0x7fb14c0b92a0 2024-04-25T08:43:45.748 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:43:45.748 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/1959121045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1959121045},{"type":"v1","addr":"172.21.15.186:6834","nonce":1959121045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/898320853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":898320853},{"type":"v1","addr":"172.21.15.186:6835","nonce":898320853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1482887107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1482887107},{"type":"v1","addr":"172.21.15.172:6836","nonce":1482887107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:43:36.707052+0000","modified":"2024-04-25T08:43:38.705443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3537703238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3537703238},{"type":"v1","addr":"172.21.15.172:6837","nonce":3537703238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:43:45.748 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 15 2024-04-25T08:43:45.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.757+0000 7fb15109a640 1 -- 172.21.15.172:0/1386180628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb12c06b4d0 msgr2=0x7fb12c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.757+0000 7fb15109a640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb12c06b4d0 0x7fb12c06d990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb144033000 tx=0x7fb144009000 comp rx=0 tx=0).stop 2024-04-25T08:43:45.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.757+0000 7fb15109a640 1 -- 172.21.15.172:0/1386180628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c0b92a0 msgr2=0x7fb14c0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:45.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.757+0000 7fb15109a640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c0b92a0 0x7fb14c0caa50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb13400c4b0 tx=0x7fb13400c970 comp rx=0 tx=0).stop 2024-04-25T08:43:45.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.758+0000 7fb15109a640 1 -- 172.21.15.172:0/1386180628 shutdown_connections 2024-04-25T08:43:45.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.758+0000 7fb15109a640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb12c06b4d0 0x7fb12c06d990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.758+0000 7fb15109a640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb14c15dbe0 0x7fb14c0b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.758+0000 7fb15109a640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c0b92a0 0x7fb14c0caa50 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.758+0000 7fb15109a640 1 --2- 172.21.15.172:0/1386180628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb14c0b2cb0 0x7fb14c0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:45.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.758+0000 7fb15109a640 1 -- 172.21.15.172:0/1386180628 >> 172.21.15.172:0/1386180628 conn(0x7fb14c061a20 msgr2=0x7fb14c15b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:45.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.758+0000 7fb15109a640 1 -- 172.21.15.172:0/1386180628 shutdown_connections 2024-04-25T08:43:45.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:45.758+0000 7fb15109a640 1 -- 172.21.15.172:0/1386180628 wait complete. 2024-04-25T08:43:46.164 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:43:36.707052+0000', 'modified': '2024-04-25T08:43:38.705443+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5340}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5340': {'gid': 5340, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6837/3537703238', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6835', 'nonce': 3537703238}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3537703238}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:43:46.164 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:43:46.164 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T08:43:46.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.273+0000 7f8a4865d640 1 Processor -- start 2024-04-25T08:43:46.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.274+0000 7f8a4865d640 1 -- start start 2024-04-25T08:43:46.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.274+0000 7f8a4865d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8a4015eec0 0x7f8a401689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.274+0000 7f8a4865d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a400d1770 con 0x7f8a4006ccd0 2024-04-25T08:43:46.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.275+0000 7f8a4865d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a40162740 con 0x7f8a40070dc0 2024-04-25T08:43:46.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.275+0000 7f8a4865d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a400b0eb0 con 0x7f8a4015eec0 2024-04-25T08:43:46.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.275+0000 7f8a46bfa640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8a4015eec0 0x7f8a401689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.275+0000 7f8a45bf8640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8a4006ccd0 0x7f8a400b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42728/0 (socket says 172.21.15.172:42728) 2024-04-25T08:43:46.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.275+0000 7f8a45bf8640 1 -- 172.21.15.172:0/3717819389 learned_addr learned my addr 172.21.15.172:0/3717819389 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:46.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.275+0000 7f8a46bfa640 1 -- 172.21.15.172:0/3717819389 >> v1:172.21.15.186:6789/0 conn(0x7f8a40070dc0 legacy=0x7f8a400711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.275+0000 7f8a46bfa640 1 -- 172.21.15.172:0/3717819389 >> v1:172.21.15.172:6789/0 conn(0x7f8a4006ccd0 legacy=0x7f8a400b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.275+0000 7f8a46bfa640 1 -- 172.21.15.172:0/3717819389 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40161980 con 0x7f8a4015eec0 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/3717819389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4015eec0 0x7f8a401689d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009d90 tx=0x7f8a3802a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d3c2cfd5e9daea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a453f7640 1 -- 172.21.15.172:0/3717819389 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38007740 con 0x7f8a4015eec0 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a453f7640 1 -- 172.21.15.172:0/3717819389 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a380078e0 con 0x7f8a4015eec0 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a453f7640 1 -- 172.21.15.172:0/3717819389 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38007cb0 con 0x7f8a4015eec0 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a4865d640 1 -- 172.21.15.172:0/3717819389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4015eec0 msgr2=0x7f8a401689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a4865d640 1 --2- 172.21.15.172:0/3717819389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4015eec0 0x7f8a401689d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009d90 tx=0x7f8a3802a580 comp rx=0 tx=0).stop 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a4865d640 1 -- 172.21.15.172:0/3717819389 shutdown_connections 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a4865d640 1 --2- 172.21.15.172:0/3717819389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4015eec0 0x7f8a401689d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a4865d640 1 -- 172.21.15.172:0/3717819389 >> 172.21.15.172:0/3717819389 conn(0x7f8a400b3530 msgr2=0x7f8a400b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a4865d640 1 -- 172.21.15.172:0/3717819389 shutdown_connections 2024-04-25T08:43:46.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.276+0000 7f8a4865d640 1 -- 172.21.15.172:0/3717819389 wait complete. 2024-04-25T08:43:46.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a4865d640 1 Processor -- start 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a4865d640 1 -- start start 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a4865d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4006ccd0 0x7f8a401f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a4865d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a40070dc0 0x7f8a400b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a4865d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8a4015eec0 0x7f8a4014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a4865d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a400b10f0 con 0x7f8a4006ccd0 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a4865d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a401622b0 con 0x7f8a40070dc0 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a4865d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40161f40 con 0x7f8a4015eec0 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a463f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4006ccd0 0x7f8a401f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a463f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4006ccd0 0x7f8a401f4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35666/0 (socket says 172.21.15.172:35666) 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.278+0000 7f8a463f9640 1 -- 172.21.15.172:0/2097292721 learned_addr learned my addr 172.21.15.172:0/2097292721 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a40070dc0 0x7f8a400b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8a4015eec0 0x7f8a4014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a463f9640 1 -- 172.21.15.172:0/2097292721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8a4015eec0 msgr2=0x7f8a4014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a463f9640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8a4015eec0 0x7f8a4014a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a463f9640 1 -- 172.21.15.172:0/2097292721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a40070dc0 msgr2=0x7f8a400b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a463f9640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a40070dc0 0x7f8a400b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a463f9640 1 -- 172.21.15.172:0/2097292721 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a401f46c0 con 0x7f8a4006ccd0 2024-04-25T08:43:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a40070dc0 0x7f8a400b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a463f9640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4006ccd0 0x7f8a401f4180 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00c410 tx=0x7f8a3c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a36ffd640 1 -- 172.21.15.172:0/2097292721 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c017070 con 0x7f8a4006ccd0 2024-04-25T08:43:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a36ffd640 1 -- 172.21.15.172:0/2097292721 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c0035f0 con 0x7f8a4006ccd0 2024-04-25T08:43:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a36ffd640 1 -- 172.21.15.172:0/2097292721 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c003a20 con 0x7f8a4006ccd0 2024-04-25T08:43:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a4865d640 1 -- 172.21.15.172:0/2097292721 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a400b0a30 con 0x7f8a4006ccd0 2024-04-25T08:43:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.279+0000 7f8a4865d640 1 -- 172.21.15.172:0/2097292721 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a40149b80 con 0x7f8a4006ccd0 2024-04-25T08:43:46.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.280+0000 7f8a36ffd640 1 -- 172.21.15.172:0/2097292721 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a3c01a070 con 0x7f8a4006ccd0 2024-04-25T08:43:46.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.281+0000 7f8a36ffd640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a2406b4d0 0x7f8a2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.281+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a2406b4d0 0x7f8a2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.281+0000 7f8a36ffd640 1 -- 172.21.15.172:0/2097292721 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8a3c089910 con 0x7f8a4006ccd0 2024-04-25T08:43:46.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.281+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a2406b4d0 0x7f8a2406d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8a400b3440 tx=0x7f8a30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:46.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.282+0000 7f8a4b365740 1 Processor -- start 2024-04-25T08:43:46.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.282+0000 7f8a4b365740 1 -- start start 2024-04-25T08:43:46.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f41109f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f411074f10 0x55f4110bb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a4b365740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f410fd7a10 con 0x55f4110bcad0 2024-04-25T08:43:46.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a4b365740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f410f80b30 con 0x55f41109f230 2024-04-25T08:43:46.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a4b365740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f410fd3c50 con 0x55f411074f10 2024-04-25T08:43:46.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a45bf8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a45bf8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110bd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35676/0 (socket says 172.21.15.172:35676) 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a45bf8640 1 -- 172.21.15.172:0/2112115662 learned_addr learned my addr 172.21.15.172:0/2112115662 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/2112115662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f411074f10 0x55f4110bb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a45bf8640 1 -- 172.21.15.172:0/2112115662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f411074f10 msgr2=0x55f4110bb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/2112115662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f411074f10 0x55f4110bb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a45bf8640 1 -- 172.21.15.172:0/2112115662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 msgr2=0x55f41109f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.283+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/2112115662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f41109f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.284+0000 7f8a45bf8640 1 -- 172.21.15.172:0/2112115662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f410f95e10 con 0x55f4110bcad0 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.284+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/2112115662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110bd020 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8a30005b10 tx=0x7f8a30010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b5b335d5402c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.284+0000 7f8a23fff640 1 -- 172.21.15.172:0/2112115662 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3000d9a0 con 0x55f4110bcad0 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.284+0000 7f8a23fff640 1 -- 172.21.15.172:0/2112115662 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000db40 con 0x55f4110bcad0 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.284+0000 7f8a23fff640 1 -- 172.21.15.172:0/2112115662 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30020450 con 0x55f4110bcad0 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.284+0000 7f8a4b365740 1 -- 172.21.15.172:0/2112115662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 msgr2=0x55f4110bd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.284+0000 7f8a4b365740 1 --2- 172.21.15.172:0/2112115662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110bd020 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8a30005b10 tx=0x7f8a30010000 comp rx=0 tx=0).stop 2024-04-25T08:43:46.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.285+0000 7f8a4b365740 1 -- 172.21.15.172:0/2112115662 shutdown_connections 2024-04-25T08:43:46.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.285+0000 7f8a4b365740 1 --2- 172.21.15.172:0/2112115662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f411074f10 0x55f4110bb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.285+0000 7f8a4b365740 1 --2- 172.21.15.172:0/2112115662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110bd020 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.285+0000 7f8a4b365740 1 --2- 172.21.15.172:0/2112115662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f41109f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.285+0000 7f8a4b365740 1 -- 172.21.15.172:0/2112115662 >> 172.21.15.172:0/2112115662 conn(0x55f411071840 msgr2=0x55f4110ba040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:46.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.285+0000 7f8a4b365740 1 -- 172.21.15.172:0/2112115662 shutdown_connections 2024-04-25T08:43:46.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.285+0000 7f8a4b365740 1 -- 172.21.15.172:0/2112115662 wait complete. 2024-04-25T08:43:46.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.285+0000 7f8a4b365740 1 -- start start 2024-04-25T08:43:46.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.285+0000 7f8a4b365740 1 Processor -- start 2024-04-25T08:43:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.286+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f4110b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.286+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.286+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 0x55f4110caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.286+0000 7f8a4b365740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f411075cb0 con 0x55f4110bcad0 2024-04-25T08:43:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.286+0000 7f8a4b365740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f410f940c0 con 0x55f41109f230 2024-04-25T08:43:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.286+0000 7f8a4b365740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f41106f770 con 0x55f41109b580 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.286+0000 7f8a4b365740 10 client.0 _ll_register_callbacks cb 0x55f410f87ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.286+0000 7f8a45bf8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.286+0000 7f8a45bf8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35692/0 (socket says 172.21.15.172:35692) 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.286+0000 7f8a45bf8640 1 -- 172.21.15.172:0/3790424537 learned_addr learned my addr 172.21.15.172:0/3790424537 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 0x55f4110caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a463f9640 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f4110b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a45bf8640 1 -- 172.21.15.172:0/3790424537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 msgr2=0x55f4110caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 0x55f4110caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a45bf8640 1 -- 172.21.15.172:0/3790424537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 msgr2=0x55f4110b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f4110b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a45bf8640 1 -- 172.21.15.172:0/3790424537 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f410cec2d0 con 0x55f4110bcad0 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 0x55f4110caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a463f9640 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f4110b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:46.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110b1cd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8a30001eb0 tx=0x7f8a30012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955069034efe0d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a217fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a217fa640 1 -- 172.21.15.172:0/3790424537 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300224f0 con 0x55f4110bcad0 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a217fa640 1 -- 172.21.15.172:0/3790424537 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8a30022690 con 0x55f4110bcad0 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a4b365740 1 -- 172.21.15.172:0/3790424537 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a3000db40 con 0x55f4110bcad0 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a217fa640 1 -- 172.21.15.172:0/3790424537 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a30034050 con 0x55f4110bcad0 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a4b365740 10 client.5562 fetch_fsmap learned FSMap version 15 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a4b365740 1 -- 172.21.15.172:0/3790424537 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55f410db66b0 con 0x55f4110bcad0 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a217fa640 1 -- 172.21.15.172:0/3790424537 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000db40 con 0x55f4110bcad0 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a217fa640 1 -- 172.21.15.172:0/3790424537 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8a30037020 con 0x55f4110bcad0 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a4b365740 10 client.5562 fetch_fsmap finished waiting for FSMap version 15 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a4b365740 10 client.5562 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a4b365740 20 client.5562 populate_metadata read hostname 'smithi172' 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a4b365740 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55f4110a00e0 0x55f4110a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a4b365740 4 client.5562 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.287+0000 7f8a4b365740 1 -- 172.21.15.172:0/3790424537 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f411036920 con 0x55f4110a00e0 2024-04-25T08:43:46.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.288+0000 7f8a463f9640 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55f4110a00e0 0x55f4110a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.288+0000 7f8a217fa640 10 client.5562 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.288+0000 7f8a463f9640 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55f4110a00e0 0x55f4110a04c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=749a11218b4ed808 server_cookie=e55ac7a14068d4ef in_seq=0 out_seq=0 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.288+0000 7f8a217fa640 1 -- 172.21.15.172:0/3790424537 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f411036920 con 0x55f4110a00e0 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.288+0000 7f8a217fa640 10 client.5562 handle_command_reply: tid=0 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.288+0000 7f8a4b365740 1 client.5562 shutdown 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.288+0000 7f8a4b365740 1 -- 172.21.15.172:0/3790424537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 msgr2=0x55f4110b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.288+0000 7f8a4b365740 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110b1cd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8a30001eb0 tx=0x7f8a30012000 comp rx=0 tx=0).stop 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.289+0000 7f8a4b365740 1 -- 172.21.15.172:0/3790424537 shutdown_connections 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.289+0000 7f8a4b365740 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55f4110a00e0 0x55f4110a04c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.289+0000 7f8a4b365740 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 0x55f4110caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.289+0000 7f8a4b365740 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110b1cd0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.289+0000 7f8a217fa640 0 client.5562 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.289+0000 7f8a4b365740 1 --2- 172.21.15.172:0/3790424537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f4110b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.289+0000 7f8a4b365740 1 -- 172.21.15.172:0/3790424537 >> 172.21.15.172:0/3790424537 conn(0x55f411074f10 msgr2=0x55f4110bd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:46.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.289+0000 7f8a4b365740 1 -- 172.21.15.172:0/3790424537 shutdown_connections 2024-04-25T08:43:46.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.289+0000 7f8a4b365740 1 -- 172.21.15.172:0/3790424537 wait complete. 2024-04-25T08:43:46.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.289+0000 7f8a4b365740 20 client.5562 trim_cache size 0 max 16384 2024-04-25T08:43:46.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.304+0000 7f8a4b365740 1 Processor -- start 2024-04-25T08:43:46.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.304+0000 7f8a4b365740 1 -- start start 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109b580 0x55f4110d4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109f230 0x55f4110af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110dd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a4b365740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a401ff530 con 0x55f4110bcad0 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a4b365740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4014bdc0 con 0x55f41109b580 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a4b365740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a401fef90 con 0x55f41109f230 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a46bfa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110dd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a46bfa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110dd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35704/0 (socket says 172.21.15.172:35704) 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a46bfa640 1 -- 172.21.15.172:0/1006269571 learned_addr learned my addr 172.21.15.172:0/1006269571 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a46bfa640 1 -- 172.21.15.172:0/1006269571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109f230 msgr2=0x55f4110af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/1006269571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109f230 0x55f4110af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a46bfa640 1 -- 172.21.15.172:0/1006269571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109b580 msgr2=0x55f4110d4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/1006269571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109b580 0x55f4110d4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.305+0000 7f8a46bfa640 1 -- 172.21.15.172:0/1006269571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f41100c460 con 0x55f4110bcad0 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/1006269571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110dd330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8a3802a5c0 tx=0x7f8a3802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a05549d5fd7bc6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a237fe640 1 -- 172.21.15.172:0/1006269571 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38007810 con 0x55f4110bcad0 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a237fe640 1 -- 172.21.15.172:0/1006269571 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a380079b0 con 0x55f4110bcad0 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a237fe640 1 -- 172.21.15.172:0/1006269571 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38007da0 con 0x55f4110bcad0 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a4b365740 1 -- 172.21.15.172:0/1006269571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 msgr2=0x55f4110dd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a4b365740 1 --2- 172.21.15.172:0/1006269571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110dd330 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8a3802a5c0 tx=0x7f8a3802e000 comp rx=0 tx=0).stop 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a4b365740 1 -- 172.21.15.172:0/1006269571 shutdown_connections 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a4b365740 1 --2- 172.21.15.172:0/1006269571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110dd330 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a4b365740 1 --2- 172.21.15.172:0/1006269571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109f230 0x55f4110af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a4b365740 1 --2- 172.21.15.172:0/1006269571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109b580 0x55f4110d4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a4b365740 1 -- 172.21.15.172:0/1006269571 >> 172.21.15.172:0/1006269571 conn(0x55f411074f10 msgr2=0x55f41109e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:46.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a4b365740 1 -- 172.21.15.172:0/1006269571 shutdown_connections 2024-04-25T08:43:46.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.306+0000 7f8a4b365740 1 -- 172.21.15.172:0/1006269571 wait complete. 2024-04-25T08:43:46.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.307+0000 7f8a4b365740 1 -- start start 2024-04-25T08:43:46.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.307+0000 7f8a4b365740 1 Processor -- start 2024-04-25T08:43:46.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 0x55f41110e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f4110af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a4b365740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a4b365740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4110a2150 con 0x55f4110bcad0 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a4b365740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f411075cb0 con 0x55f41109f230 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a4b365740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4110cb090 con 0x55f41109b580 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a4b365740 10 client.0 _ll_register_callbacks cb 0x55f41106fc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a46bfa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a46bfa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35710/0 (socket says 172.21.15.172:35710) 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a46bfa640 1 -- 172.21.15.172:0/1786788771 learned_addr learned my addr 172.21.15.172:0/1786788771 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f4110af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a463f9640 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 0x55f41110e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a46bfa640 1 -- 172.21.15.172:0/1786788771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 msgr2=0x55f41110e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 0x55f41110e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a46bfa640 1 -- 172.21.15.172:0/1786788771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 msgr2=0x55f4110af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f4110af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a46bfa640 1 -- 172.21.15.172:0/1786788771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4111253d0 con 0x55f4110bcad0 2024-04-25T08:43:46.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a45bf8640 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f4110af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a46bfa640 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110aff10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009eb0 tx=0x7f8a38004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39237f67ae75c9f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a217fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a217fa640 1 -- 172.21.15.172:0/1786788771 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38055060 con 0x55f4110bcad0 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a217fa640 1 -- 172.21.15.172:0/1786788771 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8a38004040 con 0x55f4110bcad0 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.308+0000 7f8a4b365740 1 -- 172.21.15.172:0/1786788771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a380079b0 con 0x55f4110bcad0 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a217fa640 1 -- 172.21.15.172:0/1786788771 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a38007810 con 0x55f4110bcad0 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 10 client.5568 fetch_fsmap learned FSMap version 15 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 1 -- 172.21.15.172:0/1786788771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55f411095770 con 0x55f4110bcad0 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a217fa640 1 -- 172.21.15.172:0/1786788771 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a380079b0 con 0x55f4110bcad0 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a217fa640 1 -- 172.21.15.172:0/1786788771 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8a38004280 con 0x55f4110bcad0 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 10 client.5568 fetch_fsmap finished waiting for FSMap version 15 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 10 client.5568 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 20 client.5568 populate_metadata read hostname 'smithi172' 2024-04-25T08:43:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55f4111293e0 0x55f411098480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 4 client.5568 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 1 -- 172.21.15.172:0/1786788771 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f4110cad90 con 0x55f4111293e0 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a463f9640 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55f4111293e0 0x55f411098480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a217fa640 10 client.5568 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a463f9640 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55f4111293e0 0x55f411098480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72f39615603820df server_cookie=fd69cd5964adfe72 in_seq=0 out_seq=0 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a217fa640 1 -- 172.21.15.172:0/1786788771 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f4110cad90 con 0x55f4111293e0 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a217fa640 10 client.5568 handle_command_reply: tid=0 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 1 client.5568 shutdown 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 1 -- 172.21.15.172:0/1786788771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 msgr2=0x55f4110aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.309+0000 7f8a4b365740 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110aff10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009eb0 tx=0x7f8a38004ab0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4b365740 1 -- 172.21.15.172:0/1786788771 shutdown_connections 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4b365740 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55f4111293e0 0x55f411098480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4b365740 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f41109f230 0x55f4110af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4b365740 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4110bcad0 0x55f4110aff10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a217fa640 0 client.5568 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4b365740 1 --2- 172.21.15.172:0/1786788771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f41109b580 0x55f41110e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4b365740 1 -- 172.21.15.172:0/1786788771 >> 172.21.15.172:0/1786788771 conn(0x55f411074f10 msgr2=0x55f4110b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4b365740 1 -- 172.21.15.172:0/1786788771 shutdown_connections 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4b365740 1 -- 172.21.15.172:0/1786788771 wait complete. 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4b365740 20 client.5568 trim_cache size 0 max 16384 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 5340, 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:43:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:43:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:43:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 8.9371482629999992, 2024-04-25T08:43:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 15, 2024-04-25T08:43:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 38, 2024-04-25T08:43:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 38, 2024-04-25T08:43:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 15.975043319999999 2024-04-25T08:43:46.309 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:43:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 -- 172.21.15.172:0/2097292721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a2406b4d0 msgr2=0x7f8a2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a2406b4d0 0x7f8a2406d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8a400b3440 tx=0x7f8a30009040 comp rx=0 tx=0).stop 2024-04-25T08:43:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 -- 172.21.15.172:0/2097292721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4006ccd0 msgr2=0x7f8a401f4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4006ccd0 0x7f8a401f4180 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00c410 tx=0x7f8a3c00c8d0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 -- 172.21.15.172:0/2097292721 shutdown_connections 2024-04-25T08:43:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a2406b4d0 0x7f8a2406d990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a40070dc0 0x7f8a400b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8a4015eec0 0x7f8a4014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 --2- 172.21.15.172:0/2097292721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a4006ccd0 0x7f8a401f4180 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 -- 172.21.15.172:0/2097292721 >> 172.21.15.172:0/2097292721 conn(0x7f8a400b3530 msgr2=0x7f8a400b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:46.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 -- 172.21.15.172:0/2097292721 shutdown_connections 2024-04-25T08:43:46.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.310+0000 7f8a4865d640 1 -- 172.21.15.172:0/2097292721 wait complete. 2024-04-25T08:43:46.313 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:43:46.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.420+0000 7f64badc8640 1 Processor -- start 2024-04-25T08:43:46.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.420+0000 7f64badc8640 1 -- start start 2024-04-25T08:43:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64badc8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f64b40701e0 0x7f64b40cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64badc8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64b40cbbf0 0x7f64b40cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64badc8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b406f6c0 con 0x7f64b415df00 2024-04-25T08:43:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64badc8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b406f950 con 0x7f64b40cbbf0 2024-04-25T08:43:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64badc8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b40cdf00 con 0x7f64b40701e0 2024-04-25T08:43:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64b9365640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64b40cbbf0 0x7f64b40cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64b9365640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64b40cbbf0 0x7f64b40cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35718/0 (socket says 172.21.15.172:35718) 2024-04-25T08:43:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64b9365640 1 -- 172.21.15.172:0/4232699660 learned_addr learned my addr 172.21.15.172:0/4232699660 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64b3fff640 1 --2- 172.21.15.172:0/4232699660 >> v2:172.21.15.186:3300/0 conn(0x7f64b40701e0 0x7f64b40cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64b9365640 1 -- 172.21.15.172:0/4232699660 >> v2:172.21.15.186:3300/0 conn(0x7f64b40701e0 msgr2=0x7f64b40cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64b9365640 1 --2- 172.21.15.172:0/4232699660 >> v2:172.21.15.186:3300/0 conn(0x7f64b40701e0 0x7f64b40cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64b9365640 1 -- 172.21.15.172:0/4232699660 >> v1:172.21.15.186:6789/0 conn(0x7f64b415df00 legacy=0x7f64b40cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.421+0000 7f64b9365640 1 -- 172.21.15.172:0/4232699660 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40cece0 con 0x7f64b40cbbf0 2024-04-25T08:43:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.422+0000 7f64b9365640 1 --2- 172.21.15.172:0/4232699660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40cbbf0 0x7f64b40cc010 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f64b40c7760 tx=0x7f64ac02c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea05f0d12ff65199 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.422+0000 7f64b37fe640 1 -- 172.21.15.172:0/4232699660 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac009600 con 0x7f64b40cbbf0 2024-04-25T08:43:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.422+0000 7f64b37fe640 1 -- 172.21.15.172:0/4232699660 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac0097a0 con 0x7f64b40cbbf0 2024-04-25T08:43:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.422+0000 7f64b37fe640 1 -- 172.21.15.172:0/4232699660 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac009b70 con 0x7f64b40cbbf0 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.423+0000 7f64badc8640 1 -- 172.21.15.172:0/4232699660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40cbbf0 msgr2=0x7f64b40cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.423+0000 7f64badc8640 1 --2- 172.21.15.172:0/4232699660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40cbbf0 0x7f64b40cc010 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f64b40c7760 tx=0x7f64ac02c900 comp rx=0 tx=0).stop 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.423+0000 7f64badc8640 1 -- 172.21.15.172:0/4232699660 shutdown_connections 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.423+0000 7f64badc8640 1 --2- 172.21.15.172:0/4232699660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40cbbf0 0x7f64b40cc010 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.423+0000 7f64badc8640 1 --2- 172.21.15.172:0/4232699660 >> v2:172.21.15.186:3300/0 conn(0x7f64b40701e0 0x7f64b40cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.423+0000 7f64badc8640 1 -- 172.21.15.172:0/4232699660 >> 172.21.15.172:0/4232699660 conn(0x7f64b40b2290 msgr2=0x7f64b40b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.423+0000 7f64badc8640 1 -- 172.21.15.172:0/4232699660 shutdown_connections 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.423+0000 7f64badc8640 1 -- 172.21.15.172:0/4232699660 wait complete. 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.424+0000 7f64badc8640 1 Processor -- start 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.424+0000 7f64badc8640 1 -- start start 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64badc8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40701e0 0x7f64b40b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64badc8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64b40cbbf0 0x7f64b41577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64badc8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64b415df00 0x7f64b40c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64badc8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b406fd00 con 0x7f64b40701e0 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64badc8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40cf4e0 con 0x7f64b40cbbf0 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64badc8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b406fe80 con 0x7f64b415df00 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b8b64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40701e0 0x7f64b40b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b8b64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40701e0 0x7f64b40b61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35724/0 (socket says 172.21.15.172:35724) 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b8b64640 1 -- 172.21.15.172:0/2324203575 learned_addr learned my addr 172.21.15.172:0/2324203575 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b3fff640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64b40cbbf0 0x7f64b41577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b9365640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64b415df00 0x7f64b40c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b8b64640 1 -- 172.21.15.172:0/2324203575 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64b415df00 msgr2=0x7f64b40c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b8b64640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64b415df00 0x7f64b40c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b8b64640 1 -- 172.21.15.172:0/2324203575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64b40cbbf0 msgr2=0x7f64b41577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b8b64640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64b40cbbf0 0x7f64b41577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b8b64640 1 -- 172.21.15.172:0/2324203575 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40c7bb0 con 0x7f64b40701e0 2024-04-25T08:43:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b3fff640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64b40cbbf0 0x7f64b41577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b8b64640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40701e0 0x7f64b40b61f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f64a800b420 tx=0x7f64a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b17fa640 1 -- 172.21.15.172:0/2324203575 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8011830 con 0x7f64b40701e0 2024-04-25T08:43:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b17fa640 1 -- 172.21.15.172:0/2324203575 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a8016070 con 0x7f64b40701e0 2024-04-25T08:43:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64badc8640 1 -- 172.21.15.172:0/2324203575 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b40c82f0 con 0x7f64b40701e0 2024-04-25T08:43:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64b17fa640 1 -- 172.21.15.172:0/2324203575 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8011c10 con 0x7f64b40701e0 2024-04-25T08:43:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.425+0000 7f64badc8640 1 -- 172.21.15.172:0/2324203575 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b40c77d0 con 0x7f64b40701e0 2024-04-25T08:43:46.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.426+0000 7f64badc8640 1 -- 172.21.15.172:0/2324203575 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b415e2e0 con 0x7f64b40701e0 2024-04-25T08:43:46.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.427+0000 7f64b17fa640 1 -- 172.21.15.172:0/2324203575 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64a801b460 con 0x7f64b40701e0 2024-04-25T08:43:46.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.427+0000 7f64b17fa640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f649806b4d0 0x7f649806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:46.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.427+0000 7f64b17fa640 1 -- 172.21.15.172:0/2324203575 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f64a808a090 con 0x7f64b40701e0 2024-04-25T08:43:46.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.427+0000 7f64b3fff640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f649806b4d0 0x7f649806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:46.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.428+0000 7f64b3fff640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f649806b4d0 0x7f649806d990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f64b41f2cd0 tx=0x7f64a0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:46.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.431+0000 7f64b17fa640 1 -- 172.21.15.172:0/2324203575 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64b415e2e0 con 0x7f64b40701e0 2024-04-25T08:43:46.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.639+0000 7f64badc8640 1 -- 172.21.15.172:0/2324203575 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64b4073990 con 0x7f64b40701e0 2024-04-25T08:43:46.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.640+0000 7f64b17fa640 1 -- 172.21.15.172:0/2324203575 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f64a8058d80 con 0x7f64b40701e0 2024-04-25T08:43:46.632 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:43:46.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.641+0000 7f64badc8640 1 -- 172.21.15.172:0/2324203575 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f649806b4d0 msgr2=0x7f649806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.641+0000 7f64badc8640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f649806b4d0 0x7f649806d990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f64b41f2cd0 tx=0x7f64a0008040 comp rx=0 tx=0).stop 2024-04-25T08:43:46.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.641+0000 7f64badc8640 1 -- 172.21.15.172:0/2324203575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40701e0 msgr2=0x7f64b40b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:46.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.641+0000 7f64badc8640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40701e0 0x7f64b40b61f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f64a800b420 tx=0x7f64a800b8e0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.642+0000 7f64badc8640 1 -- 172.21.15.172:0/2324203575 shutdown_connections 2024-04-25T08:43:46.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.642+0000 7f64badc8640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f649806b4d0 0x7f649806d990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.642+0000 7f64badc8640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64b40cbbf0 0x7f64b41577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.642+0000 7f64badc8640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64b415df00 0x7f64b40c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.642+0000 7f64badc8640 1 --2- 172.21.15.172:0/2324203575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b40701e0 0x7f64b40b61f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:46.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.642+0000 7f64badc8640 1 -- 172.21.15.172:0/2324203575 >> 172.21.15.172:0/2324203575 conn(0x7f64b40b2290 msgr2=0x7f64b40b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:46.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.642+0000 7f64badc8640 1 -- 172.21.15.172:0/2324203575 shutdown_connections 2024-04-25T08:43:46.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:46.642+0000 7f64badc8640 1 -- 172.21.15.172:0/2324203575 wait complete. 2024-04-25T08:43:46.644 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:43:46.645 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:43:46.645 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:43:46.645 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:43:46.645 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:43:46.645 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:43:46.645 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:43:46.645 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:43:46.645 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:43:46.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:46.645 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:43:46.660 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:46.661 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42692sec preferred_lft 42692sec 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:43:46.662 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link 2024-04-25T08:43:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:46.663 INFO:teuthology.orchestra.run.smithi172.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:43:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether de:e6:d5:6e:7d:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:43:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::dce6:d5ff:fe6e:7d91/64 scope link 2024-04-25T08:43:46.663 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:43:46.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:46.663 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:43:46.723 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:43:46.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:46.725 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:43:46.780 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:43:46.780 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:43:46.780 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:43:46.780 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:43:46.781 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:43:46.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:46.781 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:43:46.781 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:43:46.781 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:43:46.781 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:43:46.781 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:43:46.781 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:43:46.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:46.865 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:43:46.879 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:43:46.880 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:43:46.880 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:43:46.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:46.880 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:43:46.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:43:46.944 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:43:46.999 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:43:46.999 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:43:46.999 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:43:47.054 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:43:47.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:47.054 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:43:47.136 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:43:47.136 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:43:47.136 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:43:47.144 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:43:47.144 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:43:47.144 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:43:47.144 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:43:47.144 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:43:47.150 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:43:47.150 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:43:47.150 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:43:47.150 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:43:47.150 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:43:47.150 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:43:47.150 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:43:47.150 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:43:47.151 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:43:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:43:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:43:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:43:47.151 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:43:47.152 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:43:47.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:47.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:43:47.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:47.218 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:43:47.278 INFO:teuthology.orchestra.run.smithi172.stdout:client4850 2024-04-25T08:43:47.279 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:43:47.279 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:47.334 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-04-25T08:43:47.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.483+0000 7f98d45d5640 1 Processor -- start 2024-04-25T08:43:47.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.483+0000 7f98d45d5640 1 -- start start 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.484+0000 7f98d45d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 0x7f98cc0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.484+0000 7f98d45d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f98cc15b980 0x7f98cc0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.484+0000 7f98d45d5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc072280 con 0x7f98cc0cdb20 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.484+0000 7f98d45d5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc0ce4c0 con 0x7f98cc15b980 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.484+0000 7f98d45d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc071270 con 0x7f98cc0cc4f0 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.484+0000 7f98d2b72640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f98cc15b980 0x7f98cc0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.484+0000 7f98d1b70640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f98cc0cdb20 0x7f98cc15b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57930/0 (socket says 172.21.15.172:57930) 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.484+0000 7f98d2b72640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f98cc15b980 0x7f98cc0cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39514/0 (socket says 172.21.15.172:39514) 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.484+0000 7f98d1b70640 1 -- 172.21.15.172:0/4117743396 learned_addr learned my addr 172.21.15.172:0/4117743396 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.485+0000 7f98d2371640 1 --2- 172.21.15.172:0/4117743396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 0x7f98cc0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.485+0000 7f98d2b72640 1 -- 172.21.15.172:0/4117743396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 msgr2=0x7f98cc0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:43:47.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.485+0000 7f98d2b72640 1 --2- 172.21.15.172:0/4117743396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 0x7f98cc0cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:47.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.485+0000 7f98d2b72640 1 -- 172.21.15.172:0/4117743396 >> v1:172.21.15.172:6789/0 conn(0x7f98cc0cdb20 legacy=0x7f98cc15b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:47.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.485+0000 7f98d2b72640 1 -- 172.21.15.172:0/4117743396 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc0714c0 con 0x7f98cc15b980 2024-04-25T08:43:47.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.485+0000 7f98d136f640 1 -- 172.21.15.172:0/4117743396 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879354843 0 0) 0x7f98cc072280 con 0x7f98cc0cdb20 2024-04-25T08:43:47.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.485+0000 7f98d2b72640 1 --2- 172.21.15.172:0/4117743396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc15b980 0x7f98cc0cdf80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f98c40097a0 tx=0x7f98c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a6c1daeb69e3e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:47.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d136f640 1 -- 172.21.15.172:0/4117743396 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4037070 con 0x7f98cc15b980 2024-04-25T08:43:47.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d136f640 1 -- 172.21.15.172:0/4117743396 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c4032440 con 0x7f98cc15b980 2024-04-25T08:43:47.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d136f640 1 -- 172.21.15.172:0/4117743396 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4032810 con 0x7f98cc15b980 2024-04-25T08:43:47.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d45d5640 1 -- 172.21.15.172:0/4117743396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc15b980 msgr2=0x7f98cc0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d45d5640 1 --2- 172.21.15.172:0/4117743396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc15b980 0x7f98cc0cdf80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f98c40097a0 tx=0x7f98c402a180 comp rx=0 tx=0).stop 2024-04-25T08:43:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d45d5640 1 -- 172.21.15.172:0/4117743396 shutdown_connections 2024-04-25T08:43:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d45d5640 1 --2- 172.21.15.172:0/4117743396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc15b980 0x7f98cc0cdf80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d45d5640 1 --2- 172.21.15.172:0/4117743396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 0x7f98cc0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d45d5640 1 -- 172.21.15.172:0/4117743396 >> 172.21.15.172:0/4117743396 conn(0x7f98cc06abe0 msgr2=0x7f98cc06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d45d5640 1 -- 172.21.15.172:0/4117743396 shutdown_connections 2024-04-25T08:43:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.486+0000 7f98d45d5640 1 -- 172.21.15.172:0/4117743396 wait complete. 2024-04-25T08:43:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.487+0000 7f98d45d5640 1 Processor -- start 2024-04-25T08:43:47.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.487+0000 7f98d45d5640 1 -- start start 2024-04-25T08:43:47.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d45d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 0x7f98cc158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:47.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d45d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc0cdb20 0x7f98cc159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:47.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d45d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98cc15b980 0x7f98cc155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:47.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d45d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc071a80 con 0x7f98cc0cdb20 2024-04-25T08:43:47.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d45d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc15bd90 con 0x7f98cc15b980 2024-04-25T08:43:47.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d45d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc071d60 con 0x7f98cc0cc4f0 2024-04-25T08:43:47.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d1b70640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc0cdb20 0x7f98cc159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d1b70640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc0cdb20 0x7f98cc159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39520/0 (socket says 172.21.15.172:39520) 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d1b70640 1 -- 172.21.15.172:0/2398675805 learned_addr learned my addr 172.21.15.172:0/2398675805 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d2371640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 0x7f98cc158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.488+0000 7f98d1b70640 1 -- 172.21.15.172:0/2398675805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 msgr2=0x7f98cc158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98d2b72640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98cc15b980 0x7f98cc155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98d1b70640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 0x7f98cc158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98d1b70640 1 -- 172.21.15.172:0/2398675805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98cc15b980 msgr2=0x7f98cc155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98d1b70640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98cc15b980 0x7f98cc155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98d1b70640 1 -- 172.21.15.172:0/2398675805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc159b50 con 0x7f98cc0cdb20 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98d2371640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 0x7f98cc158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98d1b70640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc0cdb20 0x7f98cc159310 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00c4a0 tx=0x7f98bc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98c2ffd640 1 -- 172.21.15.172:0/2398675805 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc018070 con 0x7f98cc0cdb20 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98c2ffd640 1 -- 172.21.15.172:0/2398675805 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc0074e0 con 0x7f98cc0cdb20 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98d45d5640 1 -- 172.21.15.172:0/2398675805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc159e30 con 0x7f98cc0cdb20 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98c2ffd640 1 -- 172.21.15.172:0/2398675805 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc004a20 con 0x7f98cc0cdb20 2024-04-25T08:43:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.489+0000 7f98d45d5640 1 -- 172.21.15.172:0/2398675805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc1f1590 con 0x7f98cc0cdb20 2024-04-25T08:43:47.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.490+0000 7f98d45d5640 1 -- 172.21.15.172:0/2398675805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc073a00 con 0x7f98cc0cdb20 2024-04-25T08:43:47.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.490+0000 7f98c2ffd640 1 -- 172.21.15.172:0/2398675805 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98bc01b070 con 0x7f98cc0cdb20 2024-04-25T08:43:47.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.491+0000 7f98c2ffd640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f98b006b4d0 0x7f98b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:43:47.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.491+0000 7f98c2ffd640 1 -- 172.21.15.172:0/2398675805 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f98bc089680 con 0x7f98cc0cdb20 2024-04-25T08:43:47.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.491+0000 7f98d2371640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f98b006b4d0 0x7f98b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:43:47.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.491+0000 7f98d2371640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f98b006b4d0 0x7f98b006d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f98c8007eb0 tx=0x7f98c8007400 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:43:47.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.495+0000 7f98c2ffd640 1 -- 172.21.15.172:0/2398675805 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98bc058370 con 0x7f98cc0cdb20 2024-04-25T08:43:47.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:47.699+0000 7f98d45d5640 1 -- 172.21.15.172:0/2398675805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f98cc06d3a0 con 0x7f98cc0cdb20 2024-04-25T08:43:48.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.410+0000 7f98c2ffd640 1 -- 172.21.15.172:0/2398675805 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v16) v1 ==== 167+0+0 (secure 0 0 0) 0x7f98bc057c70 con 0x7f98cc0cdb20 2024-04-25T08:43:48.402 INFO:teuthology.orchestra.run.smithi172.stderr:enabled new snapshots 2024-04-25T08:43:48.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 -- 172.21.15.172:0/2398675805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f98b006b4d0 msgr2=0x7f98b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:48.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f98b006b4d0 0x7f98b006d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f98c8007eb0 tx=0x7f98c8007400 comp rx=0 tx=0).stop 2024-04-25T08:43:48.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 -- 172.21.15.172:0/2398675805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc0cdb20 msgr2=0x7f98cc159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:43:48.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc0cdb20 0x7f98cc159310 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00c4a0 tx=0x7f98bc00c960 comp rx=0 tx=0).stop 2024-04-25T08:43:48.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 -- 172.21.15.172:0/2398675805 shutdown_connections 2024-04-25T08:43:48.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f98b006b4d0 0x7f98b006d990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:48.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98cc15b980 0x7f98cc155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:48.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98cc0cdb20 0x7f98cc159310 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:48.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 --2- 172.21.15.172:0/2398675805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98cc0cc4f0 0x7f98cc158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:43:48.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 -- 172.21.15.172:0/2398675805 >> 172.21.15.172:0/2398675805 conn(0x7f98cc06abe0 msgr2=0x7f98cc0b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:43:48.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 -- 172.21.15.172:0/2398675805 shutdown_connections 2024-04-25T08:43:48.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:43:48.413+0000 7f98d45d5640 1 -- 172.21.15.172:0/2398675805 wait complete. 2024-04-25T08:43:48.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:43:48.418 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-04-25T08:43:48.440 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:43:48.440 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:43:48.498 DEBUG:teuthology.orchestra.run.smithi172:> stdin-killer -- python3 -c ' 2024-04-25T08:43:48.498 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-04-25T08:43:48.498 DEBUG:teuthology.orchestra.run.smithi172:> import uuid 2024-04-25T08:43:48.498 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:43:48.498 DEBUG:teuthology.orchestra.run.smithi172:> n = 2000 2024-04-25T08:43:48.498 DEBUG:teuthology.orchestra.run.smithi172:> create_hard_links = False 2024-04-25T08:43:48.498 DEBUG:teuthology.orchestra.run.smithi172:> if 3 > 0: 2024-04-25T08:43:48.498 DEBUG:teuthology.orchestra.run.smithi172:> create_hard_links = True 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> dpath = os.path.dirname(path) 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> fnameprefix = os.path.basename(path) 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> os.makedirs(dpath, exist_ok=True) 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> try: 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> for i in range(n): 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> with open(fpath, '"'"'w'"'"') as f: 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> f.write(f"{i}") 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> if False: 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> f.flush() 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> os.fsync(f.fileno()) 2024-04-25T08:43:48.499 DEBUG:teuthology.orchestra.run.smithi172:> if False: 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> os.unlink(fpath) 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> if False: 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> os.fsync(dirfd) 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> if create_hard_links: 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> for j in range(3): 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> if False: 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> os.fsync(dirfd) 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> finally: 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> os.close(dirfd) 2024-04-25T08:43:48.500 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-04-25T08:43:59.167 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:43:59.170 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:44:04.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:44:04.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:44:04.816 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T08:44:05.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:44:05.049 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-04-25T08:44:29.291 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:44:29.294 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:44:31.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:44:31.453 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T08:44:31.506 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:44:31.507 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-04-25T08:44:31.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.639+0000 7f73e015c640 1 Processor -- start 2024-04-25T08:44:31.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.639+0000 7f73e015c640 1 -- start start 2024-04-25T08:44:31.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.640+0000 7f73e015c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f73d8099cb0 0x7f73d80b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.640+0000 7f73e015c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f73d80cfd30 0x7f73d815ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.640+0000 7f73e015c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d80cc5e0 con 0x7f73d809a090 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.640+0000 7f73e015c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d80cc3b0 con 0x7f73d80cfd30 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.640+0000 7f73e015c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d80d0210 con 0x7f73d8099cb0 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.640+0000 7f73dd6f7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f73d80cfd30 0x7f73d815ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.640+0000 7f73dd6f7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f73d80cfd30 0x7f73d815ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38226/0 (socket says 172.21.15.172:38226) 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.640+0000 7f73dd6f7640 1 -- 172.21.15.172:0/4005832595 learned_addr learned my addr 172.21.15.172:0/4005832595 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.640+0000 7f73ddef8640 1 --2- 172.21.15.172:0/4005832595 >> v2:172.21.15.186:3300/0 conn(0x7f73d8099cb0 0x7f73d80b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.641+0000 7f73dd6f7640 1 -- 172.21.15.172:0/4005832595 >> v2:172.21.15.186:3300/0 conn(0x7f73d8099cb0 msgr2=0x7f73d80b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.641+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/4005832595 >> v2:172.21.15.186:3300/0 conn(0x7f73d8099cb0 0x7f73d80b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.641+0000 7f73dd6f7640 1 -- 172.21.15.172:0/4005832595 >> v1:172.21.15.186:6789/0 conn(0x7f73d809a090 legacy=0x7f73d815f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.641+0000 7f73dd6f7640 1 -- 172.21.15.172:0/4005832595 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80d04f0 con 0x7f73d80cfd30 2024-04-25T08:44:31.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.641+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/4005832595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d80cfd30 0x7f73d815ecc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f73d80728e0 tx=0x7f73d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86354dcb9239f488 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.641+0000 7f73dcef6640 1 -- 172.21.15.172:0/4005832595 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4037070 con 0x7f73d80cfd30 2024-04-25T08:44:31.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.641+0000 7f73dcef6640 1 -- 172.21.15.172:0/4005832595 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d4032440 con 0x7f73d80cfd30 2024-04-25T08:44:31.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.641+0000 7f73dcef6640 1 -- 172.21.15.172:0/4005832595 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4032810 con 0x7f73d80cfd30 2024-04-25T08:44:31.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.642+0000 7f73e015c640 1 -- 172.21.15.172:0/4005832595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d80cfd30 msgr2=0x7f73d815ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.642+0000 7f73e015c640 1 --2- 172.21.15.172:0/4005832595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d80cfd30 0x7f73d815ecc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f73d80728e0 tx=0x7f73d402a270 comp rx=0 tx=0).stop 2024-04-25T08:44:31.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.642+0000 7f73e015c640 1 -- 172.21.15.172:0/4005832595 shutdown_connections 2024-04-25T08:44:31.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.642+0000 7f73e015c640 1 --2- 172.21.15.172:0/4005832595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d80cfd30 0x7f73d815ecc0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.642+0000 7f73e015c640 1 --2- 172.21.15.172:0/4005832595 >> v2:172.21.15.186:3300/0 conn(0x7f73d8099cb0 0x7f73d80b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.642+0000 7f73e015c640 1 -- 172.21.15.172:0/4005832595 >> 172.21.15.172:0/4005832595 conn(0x7f73d80b3290 msgr2=0x7f73d80b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.642+0000 7f73e015c640 1 -- 172.21.15.172:0/4005832595 shutdown_connections 2024-04-25T08:44:31.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.642+0000 7f73e015c640 1 -- 172.21.15.172:0/4005832595 wait complete. 2024-04-25T08:44:31.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.643+0000 7f73e015c640 1 Processor -- start 2024-04-25T08:44:31.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.643+0000 7f73e015c640 1 -- start start 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73e015c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d8099cb0 0x7f73d80c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73e015c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73d809a090 0x7f73d80c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73e015c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d80cfd30 0x7f73d80b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73e015c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80c52f0 con 0x7f73d8099cb0 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73e015c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80d07d0 con 0x7f73d80cfd30 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73e015c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80c5470 con 0x7f73d809a090 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73ddef8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d8099cb0 0x7f73d80c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73ddef8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d8099cb0 0x7f73d80c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38228/0 (socket says 172.21.15.172:38228) 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73ddef8640 1 -- 172.21.15.172:0/2872313248 learned_addr learned my addr 172.21.15.172:0/2872313248 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73d809a090 0x7f73d80c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73de6f9640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d80cfd30 0x7f73d80b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73ddef8640 1 -- 172.21.15.172:0/2872313248 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73d809a090 msgr2=0x7f73d80c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73ddef8640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73d809a090 0x7f73d80c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73ddef8640 1 -- 172.21.15.172:0/2872313248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d80cfd30 msgr2=0x7f73d80b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73ddef8640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d80cfd30 0x7f73d80b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73ddef8640 1 -- 172.21.15.172:0/2872313248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80c9a60 con 0x7f73d8099cb0 2024-04-25T08:44:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.644+0000 7f73ddef8640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d8099cb0 0x7f73d80c67a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f73c800e870 tx=0x7f73c800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.645+0000 7f73ce7fc640 1 -- 172.21.15.172:0/2872313248 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8017070 con 0x7f73d8099cb0 2024-04-25T08:44:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.645+0000 7f73ce7fc640 1 -- 172.21.15.172:0/2872313248 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c800c940 con 0x7f73d8099cb0 2024-04-25T08:44:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.645+0000 7f73e015c640 1 -- 172.21.15.172:0/2872313248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d80c9d40 con 0x7f73d8099cb0 2024-04-25T08:44:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.645+0000 7f73ce7fc640 1 -- 172.21.15.172:0/2872313248 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c800cd30 con 0x7f73d8099cb0 2024-04-25T08:44:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.645+0000 7f73e015c640 1 -- 172.21.15.172:0/2872313248 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d80ca300 con 0x7f73d8099cb0 2024-04-25T08:44:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.646+0000 7f73ce7fc640 1 -- 172.21.15.172:0/2872313248 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f73c801a070 con 0x7f73d8099cb0 2024-04-25T08:44:31.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.646+0000 7f73ce7fc640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f73bc06b4d0 0x7f73bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.646+0000 7f73ce7fc640 1 -- 172.21.15.172:0/2872313248 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f73c808a620 con 0x7f73d8099cb0 2024-04-25T08:44:31.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.647+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f73bc06b4d0 0x7f73bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.647+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f73bc06b4d0 0x7f73bc06d990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73d4034000 tx=0x7f73d402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.648+0000 7f73e2e68740 1 Processor -- start 2024-04-25T08:44:31.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.648+0000 7f73e2e68740 1 -- start start 2024-04-25T08:44:31.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde67dca0 0x562cde67fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6ba370 0x562cde67e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde6a8760 0x562cde6a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73e2e68740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cde5e0b90 con 0x562cde67dca0 2024-04-25T08:44:31.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73e2e68740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cde589e40 con 0x562cde6a8760 2024-04-25T08:44:31.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73e2e68740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x562cde5dcc30 con 0x562cde6ba370 2024-04-25T08:44:31.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73ddef8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde67dca0 0x562cde67fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73ddef8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde67dca0 0x562cde67fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38230/0 (socket says 172.21.15.172:38230) 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73ddef8640 1 -- 172.21.15.172:0/3308581137 learned_addr learned my addr 172.21.15.172:0/3308581137 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/3308581137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6ba370 0x562cde67e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73ddef8640 1 -- 172.21.15.172:0/3308581137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6ba370 msgr2=0x562cde67e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73ddef8640 1 --2- 172.21.15.172:0/3308581137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6ba370 0x562cde67e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73de6f9640 1 --2- 172.21.15.172:0/3308581137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde6a8760 0x562cde6a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73ddef8640 1 -- 172.21.15.172:0/3308581137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde6a8760 msgr2=0x562cde6a8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73ddef8640 1 --2- 172.21.15.172:0/3308581137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde6a8760 0x562cde6a8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73ddef8640 1 -- 172.21.15.172:0/3308581137 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cde3bf7d0 con 0x562cde67dca0 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73ddef8640 1 --2- 172.21.15.172:0/3308581137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde67dca0 0x562cde67fe00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f73c8088840 tx=0x7f73c80095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f277b4c1582dfc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.649+0000 7f73bb7fe640 1 -- 172.21.15.172:0/3308581137 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8021070 con 0x562cde67dca0 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73bb7fe640 1 -- 172.21.15.172:0/3308581137 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c805cca0 con 0x562cde67dca0 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73bb7fe640 1 -- 172.21.15.172:0/3308581137 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8061260 con 0x562cde67dca0 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73e2e68740 1 -- 172.21.15.172:0/3308581137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde67dca0 msgr2=0x562cde67fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3308581137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde67dca0 0x562cde67fe00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f73c8088840 tx=0x7f73c80095e0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73e2e68740 1 -- 172.21.15.172:0/3308581137 shutdown_connections 2024-04-25T08:44:31.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3308581137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde6a8760 0x562cde6a8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3308581137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6ba370 0x562cde67e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3308581137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde67dca0 0x562cde67fe00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73e2e68740 1 -- 172.21.15.172:0/3308581137 >> 172.21.15.172:0/3308581137 conn(0x562cde645870 msgr2=0x562cde6c3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73e2e68740 1 -- 172.21.15.172:0/3308581137 shutdown_connections 2024-04-25T08:44:31.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.650+0000 7f73e2e68740 1 -- 172.21.15.172:0/3308581137 wait complete. 2024-04-25T08:44:31.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.651+0000 7f73e2e68740 1 -- start start 2024-04-25T08:44:31.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.651+0000 7f73e2e68740 1 Processor -- start 2024-04-25T08:44:31.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 0x562cde6aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 0x562cde6c0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde6c3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73e2e68740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cde5e0b90 con 0x562cde6ba370 2024-04-25T08:44:31.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73e2e68740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cde59d3e0 con 0x562cde67dca0 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73e2e68740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x562cde6beb40 con 0x562cde6a8760 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73e2e68740 10 client.0 _ll_register_callbacks cb 0x562cde59cdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73de6f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde6c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73dd6f7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 0x562cde6c0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73ddef8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 0x562cde6aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73de6f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde6c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38240/0 (socket says 172.21.15.172:38240) 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73de6f9640 1 -- 172.21.15.172:0/3789188529 learned_addr learned my addr 172.21.15.172:0/3789188529 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73dd6f7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 0x562cde6c0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:56314/0 (socket says 172.21.15.172:56314) 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73ddef8640 1 -- 172.21.15.172:0/3789188529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 msgr2=0x562cde6c0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73ddef8640 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 0x562cde6c0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73ddef8640 1 -- 172.21.15.172:0/3789188529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 msgr2=0x562cde6c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73ddef8640 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde6c3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73ddef8640 1 -- 172.21.15.172:0/3789188529 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562cde2b50f0 con 0x562cde67dca0 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73de6f9640 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde6c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:44:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73ddef8640 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 0x562cde6aaa00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f73c800c520 tx=0x7f73c808a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3043f064b7e04bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.652+0000 7f73b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3789188529 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c805ddc0 con 0x562cde67dca0 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3789188529 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f73c8058050 con 0x562cde67dca0 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73e2e68740 1 -- 172.21.15.172:0/3789188529 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73c805cca0 con 0x562cde67dca0 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3789188529 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73c8058250 con 0x562cde67dca0 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73e2e68740 10 client.5155 fetch_fsmap learned FSMap version 16 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73e2e68740 1 -- 172.21.15.172:0/3789188529 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x562cde41ff60 con 0x562cde67dca0 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3789188529 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c805cca0 con 0x562cde67dca0 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3789188529 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f73c806cb10 con 0x562cde67dca0 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73e2e68740 10 client.5155 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73e2e68740 10 client.5155 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73e2e68740 20 client.5155 populate_metadata read hostname 'smithi172' 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x562cde6be330 0x562cde699b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73e2e68740 4 client.5155 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73e2e68740 1 -- 172.21.15.172:0/3789188529 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562cde5ee0d0 con 0x562cde6be330 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.653+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x562cde6be330 0x562cde699b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73b8ff9640 10 client.5155 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x562cde6be330 0x562cde699b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e57d5cc97cdd02a server_cookie=fe5af39590f40267 in_seq=0 out_seq=0 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3789188529 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562cde5ee0d0 con 0x562cde6be330 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73b8ff9640 10 client.5155 handle_command_reply: tid=0 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73e2e68740 1 client.5155 shutdown 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73e2e68740 1 -- 172.21.15.172:0/3789188529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 msgr2=0x562cde6aaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 0x562cde6aaa00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f73c800c520 tx=0x7f73c808a040 comp rx=0 tx=0).stop 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73e2e68740 1 -- 172.21.15.172:0/3789188529 shutdown_connections 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x562cde6be330 0x562cde699b80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde6c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73b8ff9640 0 client.5155 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:31.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 0x562cde6c0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3789188529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 0x562cde6aaa00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.654+0000 7f73e2e68740 1 -- 172.21.15.172:0/3789188529 >> 172.21.15.172:0/3789188529 conn(0x562cde645870 msgr2=0x562cde6c4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.655+0000 7f73e2e68740 1 -- 172.21.15.172:0/3789188529 shutdown_connections 2024-04-25T08:44:31.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.655+0000 7f73e2e68740 1 -- 172.21.15.172:0/3789188529 wait complete. 2024-04-25T08:44:31.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.655+0000 7f73e2e68740 20 client.5155 trim_cache size 0 max 16384 2024-04-25T08:44:31.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.669+0000 7f73e2e68740 1 Processor -- start 2024-04-25T08:44:31.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.669+0000 7f73e2e68740 1 -- start start 2024-04-25T08:44:31.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde67dca0 0x562cde6ab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6a8760 0x562cde6d5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde6ba370 0x562cde6d6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73e2e68740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d81fc110 con 0x562cde6a8760 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73e2e68740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d81fb2f0 con 0x562cde6ba370 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73e2e68740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d806d860 con 0x562cde67dca0 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73dd6f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6a8760 0x562cde6d5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73dd6f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6a8760 0x562cde6d5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38242/0 (socket says 172.21.15.172:38242) 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73dd6f7640 1 -- 172.21.15.172:0/2384702 learned_addr learned my addr 172.21.15.172:0/2384702 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73dd6f7640 1 -- 172.21.15.172:0/2384702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde67dca0 msgr2=0x562cde6ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73ddef8640 1 --2- 172.21.15.172:0/2384702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde67dca0 0x562cde6ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/2384702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde67dca0 0x562cde6ab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73dd6f7640 1 -- 172.21.15.172:0/2384702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde6ba370 msgr2=0x562cde6d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/2384702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde6ba370 0x562cde6d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73dd6f7640 1 -- 172.21.15.172:0/2384702 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cde28e1b0 con 0x562cde6a8760 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/2384702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6a8760 0x562cde6d5f00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009960 tx=0x7f73d402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55c2c42d74e7fb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73baffd640 1 -- 172.21.15.172:0/2384702 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4037040 con 0x562cde6a8760 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73baffd640 1 -- 172.21.15.172:0/2384702 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d4032dd0 con 0x562cde6a8760 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.670+0000 7f73baffd640 1 -- 172.21.15.172:0/2384702 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4054680 con 0x562cde6a8760 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.671+0000 7f73e2e68740 1 -- 172.21.15.172:0/2384702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6a8760 msgr2=0x562cde6d5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.671+0000 7f73e2e68740 1 --2- 172.21.15.172:0/2384702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6a8760 0x562cde6d5f00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009960 tx=0x7f73d402c000 comp rx=0 tx=0).stop 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.671+0000 7f73e2e68740 1 -- 172.21.15.172:0/2384702 shutdown_connections 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.671+0000 7f73e2e68740 1 --2- 172.21.15.172:0/2384702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde6ba370 0x562cde6d6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.671+0000 7f73e2e68740 1 --2- 172.21.15.172:0/2384702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6a8760 0x562cde6d5f00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.671+0000 7f73e2e68740 1 --2- 172.21.15.172:0/2384702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde67dca0 0x562cde6ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.671+0000 7f73e2e68740 1 -- 172.21.15.172:0/2384702 >> 172.21.15.172:0/2384702 conn(0x562cde645870 msgr2=0x562cde677ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.671+0000 7f73e2e68740 1 -- 172.21.15.172:0/2384702 shutdown_connections 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.671+0000 7f73e2e68740 1 -- 172.21.15.172:0/2384702 wait complete. 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.672+0000 7f73e2e68740 1 -- start start 2024-04-25T08:44:31.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.672+0000 7f73e2e68740 1 Processor -- start 2024-04-25T08:44:31.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.672+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 0x562cde6bd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 0x562cde6c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73e2e68740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde67c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73e2e68740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d81fadc0 con 0x562cde6ba370 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73e2e68740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cde6c0480 con 0x562cde67dca0 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73e2e68740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x562cde6c4a00 con 0x562cde6a8760 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73e2e68740 10 client.0 _ll_register_callbacks cb 0x7f73c806f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73de6f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde67c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73de6f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde67c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38258/0 (socket says 172.21.15.172:38258) 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73de6f9640 1 -- 172.21.15.172:0/3747407352 learned_addr learned my addr 172.21.15.172:0/3747407352 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73ddef8640 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 0x562cde6bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73dd6f7640 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 0x562cde6c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73de6f9640 1 -- 172.21.15.172:0/3747407352 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 msgr2=0x562cde6c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73de6f9640 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 0x562cde6c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73de6f9640 1 -- 172.21.15.172:0/3747407352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 msgr2=0x562cde6bd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73de6f9640 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 0x562cde6bd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73de6f9640 1 -- 172.21.15.172:0/3747407352 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562cde6b9f10 con 0x562cde6ba370 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73ddef8640 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 0x562cde6bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73de6f9640 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde67c2d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f73d00014e0 tx=0x7f73d0005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4970a647dfe3b93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3747407352 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0021060 con 0x562cde6ba370 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3747407352 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f73d0012ca0 con 0x562cde6ba370 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73e2e68740 1 -- 172.21.15.172:0/3747407352 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73d4032dd0 con 0x562cde6ba370 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3747407352 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73d0027050 con 0x562cde6ba370 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73e2e68740 10 client.5601 fetch_fsmap learned FSMap version 16 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.673+0000 7f73e2e68740 1 -- 172.21.15.172:0/3747407352 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x562cde6c47a0 con 0x562cde6ba370 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3747407352 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d4032dd0 con 0x562cde6ba370 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3747407352 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f73d002a020 con 0x562cde6ba370 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73e2e68740 10 client.5601 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T08:44:31.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73e2e68740 10 client.5601 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73e2e68740 20 client.5601 populate_metadata read hostname 'smithi172' 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x562cde7124b0 0x562cde67c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73e2e68740 4 client.5601 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73e2e68740 1 -- 172.21.15.172:0/3747407352 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x562cde5e8420 con 0x562cde7124b0 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73ddef8640 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x562cde7124b0 0x562cde67c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73b8ff9640 10 client.5601 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.674+0000 7f73ddef8640 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x562cde7124b0 0x562cde67c810 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=295f2aeba879984f server_cookie=2b1ead062968c543 in_seq=0 out_seq=0 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73b8ff9640 1 -- 172.21.15.172:0/3747407352 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17922 (crc 0 0 0) 0x562cde5e8420 con 0x562cde7124b0 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73b8ff9640 10 client.5601 handle_command_reply: tid=0 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 client.5601 shutdown 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 -- 172.21.15.172:0/3747407352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 msgr2=0x562cde67c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde67c2d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f73d00014e0 tx=0x7f73d0005710 comp rx=0 tx=0).stop 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 -- 172.21.15.172:0/3747407352 shutdown_connections 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x562cde7124b0 0x562cde67c810 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cde6ba370 0x562cde67c2d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562cde6a8760 0x562cde6c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73b8ff9640 0 client.5601 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:31.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 --2- 172.21.15.172:0/3747407352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562cde67dca0 0x562cde6bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 -- 172.21.15.172:0/3747407352 >> 172.21.15.172:0/3747407352 conn(0x562cde645870 msgr2=0x562cde6e64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 -- 172.21.15.172:0/3747407352 shutdown_connections 2024-04-25T08:44:31.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 1 -- 172.21.15.172:0/3747407352 wait complete. 2024-04-25T08:44:31.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e2e68740 20 client.5601 trim_cache size 0 max 16384 2024-04-25T08:44:31.673 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:44:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1048, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1041, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 364519, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 16784862, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.138880461, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.069400011, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.032291917, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.032675034, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1041, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.168386414, 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000161754 2024-04-25T08:44:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000194, 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000097 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 117728, 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 18656 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 977, 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 992, 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 246500, 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 19968120, 2024-04-25T08:44:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.169736732, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.107191309, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.020108785, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.036090638, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 991, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.270928191, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000273388 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 106768 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 29592, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 52005, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 9460651, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 74398244, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 2.970324563, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 2.271807146, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.904791112, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.081729899, 2024-04-25T08:44:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 52004, 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.260528981, 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000024239 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 48872, 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.007662533, 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000156 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-04-25T08:44:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1202, 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 16.950335100, 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.014101776 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2035, 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.952077682, 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000467851 2024-04-25T08:44:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 25384, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 25384, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 25384, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 427.163744767, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.016828070 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 12, 2024-04-25T08:44:31.680 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 19853, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 19853, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 19853, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 149, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 149, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 45888, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 45491, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-04-25T08:44:31.681 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 102, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-04-25T08:44:31.682 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 894, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 4030, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 3670, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 3257, 2024-04-25T08:44:31.683 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 60, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 13898 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 1670, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 4099, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 1853, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 2195, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-04-25T08:44:31.684 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 24274, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-04-25T08:44:31.685 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 24274, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 32, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 32, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 3, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 95137827, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-04-25T08:44:31.686 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2470, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 107.647702087, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.043582065 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 2014, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 2014, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 0, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 13, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 13, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 0, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 19853, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 19854, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 1, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 149, 2024-04-25T08:44:31.687 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 8386, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 8237, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 112976, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215396 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 28163, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 25384, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 3, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2000, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.322260785, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000661130 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.688 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 29, 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.005365763, 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000185026 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6000, 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 6.999803756, 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001166633 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-04-25T08:44:31.689 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7147, 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 6.042087969, 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000845401 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.690 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000040571, 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000040571 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-04-25T08:44:31.691 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.003103212, 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003103212 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-04-25T08:44:31.692 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.210398506, 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.210398506 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8, 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.660981837, 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.207622729 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2195, 2024-04-25T08:44:31.693 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 394.351144870, 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.179658835 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.694 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.037188689, 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.037188689 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:44:31.695 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000246412, 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000246412 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-04-25T08:44:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8000, 2024-04-25T08:44:31.697 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 16.531122397, 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002066390 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 1, 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2024-04-25T08:44:31.698 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 18652, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 18652, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 43, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T08:44:31.699 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T08:44:31.700 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 16608854, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 6218, 2024-04-25T08:44:31.701 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 440, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 5, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 5520, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 78, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 21359959, 2024-04-25T08:44:31.702 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 884992, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 4564, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 91225473, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 37, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 4564, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4564, 2024-04-25T08:44:31.703 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 21.383481376, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004685250 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4564, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4654 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 4564, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 53, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 4511, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 11, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 53, 2024-04-25T08:44:31.704 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 2523, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 34, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 1523, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 363, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 22, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-04-25T08:44:31.705 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-04-25T08:44:31.706 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 40, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 3, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 8, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 8, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 98, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 27 2024-04-25T08:44:31.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 32, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 1853, 2024-04-25T08:44:31.708 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 1853, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 31612, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 7653226, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 31612, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 31612, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 7653226, 2024-04-25T08:44:31.709 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 4564, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 91424810, 2024-04-25T08:44:31.710 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4564, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 91424810, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:44:31.711 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 4564, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 4564, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4564, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 4564, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:44:31.712 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1853, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 199337, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1853, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 53, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 199337, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x564ae611a6e0": { 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 197754, 2024-04-25T08:44:31.713 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 24274, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 90943523, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 24274, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2470, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 90745769, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:31.714 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:31.715 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e015c640 1 -- 172.21.15.172:0/2872313248 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f73bc06b4d0 msgr2=0x7f73bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e015c640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f73bc06b4d0 0x7f73bc06d990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73d4034000 tx=0x7f73d402e000 comp rx=0 tx=0).stop 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e015c640 1 -- 172.21.15.172:0/2872313248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d8099cb0 msgr2=0x7f73d80c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e015c640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d8099cb0 0x7f73d80c67a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f73c800e870 tx=0x7f73c800ed30 comp rx=0 tx=0).stop 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e015c640 1 -- 172.21.15.172:0/2872313248 shutdown_connections 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e015c640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f73bc06b4d0 0x7f73bc06d990 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e015c640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73d80cfd30 0x7f73d80b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e015c640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73d809a090 0x7f73d80c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e015c640 1 --2- 172.21.15.172:0/2872313248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73d8099cb0 0x7f73d80c67a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.675+0000 7f73e015c640 1 -- 172.21.15.172:0/2872313248 >> 172.21.15.172:0/2872313248 conn(0x7f73d80b3290 msgr2=0x7f73d815da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.676+0000 7f73e015c640 1 -- 172.21.15.172:0/2872313248 shutdown_connections 2024-04-25T08:44:31.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.676+0000 7f73e015c640 1 -- 172.21.15.172:0/2872313248 wait complete. 2024-04-25T08:44:31.717 INFO:tasks.cephfs.test_scrub_checks:num of strays: 1670 2024-04-25T08:44:31.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:44:31.717 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-04-25T08:44:31.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.827+0000 7fce7a488640 1 Processor -- start 2024-04-25T08:44:31.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.827+0000 7fce7a488640 1 -- start start 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce7a488640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce7415b7d0 0x7fce740cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce7a488640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fce740b5620 0x7fce740b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce7a488640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce7406c2d0 0x7fce7406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce7a488640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7406cc80 con 0x7fce7415b7d0 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce7a488640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7406cf50 con 0x7fce740b5620 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce7a488640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce740ce530 con 0x7fce7406c2d0 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce73fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce7415b7d0 0x7fce740cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce73fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce7415b7d0 0x7fce740cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38268/0 (socket says 172.21.15.172:38268) 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce73fff640 1 -- 172.21.15.172:0/4232389 learned_addr learned my addr 172.21.15.172:0/4232389 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce737fe640 1 --2- 172.21.15.172:0/4232389 >> v2:172.21.15.186:3300/0 conn(0x7fce740b5620 0x7fce740b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce78a25640 1 --2- 172.21.15.172:0/4232389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce7406c2d0 0x7fce7406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce73fff640 1 -- 172.21.15.172:0/4232389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce7406c2d0 msgr2=0x7fce7406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce73fff640 1 --2- 172.21.15.172:0/4232389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce7406c2d0 0x7fce7406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce73fff640 1 -- 172.21.15.172:0/4232389 >> v2:172.21.15.186:3300/0 conn(0x7fce740b5620 msgr2=0x7fce740b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce73fff640 1 --2- 172.21.15.172:0/4232389 >> v2:172.21.15.186:3300/0 conn(0x7fce740b5620 0x7fce740b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce73fff640 1 -- 172.21.15.172:0/4232389 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740ce810 con 0x7fce7415b7d0 2024-04-25T08:44:31.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.828+0000 7fce737fe640 1 --2- 172.21.15.172:0/4232389 >> v2:172.21.15.186:3300/0 conn(0x7fce740b5620 0x7fce740b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:44:31.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.829+0000 7fce73fff640 1 --2- 172.21.15.172:0/4232389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 0x7fce740cf010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fce740ce180 tx=0x7fce6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d256fb6b4fd5fdc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.829+0000 7fce72ffd640 1 -- 172.21.15.172:0/4232389 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64037070 con 0x7fce7415b7d0 2024-04-25T08:44:31.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.829+0000 7fce72ffd640 1 -- 172.21.15.172:0/4232389 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce64032440 con 0x7fce7415b7d0 2024-04-25T08:44:31.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.829+0000 7fce72ffd640 1 -- 172.21.15.172:0/4232389 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64032810 con 0x7fce7415b7d0 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.830+0000 7fce7a488640 1 -- 172.21.15.172:0/4232389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 msgr2=0x7fce740cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.830+0000 7fce7a488640 1 --2- 172.21.15.172:0/4232389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 0x7fce740cf010 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fce740ce180 tx=0x7fce6402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.830+0000 7fce7a488640 1 -- 172.21.15.172:0/4232389 shutdown_connections 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.830+0000 7fce7a488640 1 --2- 172.21.15.172:0/4232389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce7406c2d0 0x7fce7406c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.830+0000 7fce7a488640 1 --2- 172.21.15.172:0/4232389 >> v2:172.21.15.186:3300/0 conn(0x7fce740b5620 0x7fce740b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.830+0000 7fce7a488640 1 --2- 172.21.15.172:0/4232389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 0x7fce740cf010 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.830+0000 7fce7a488640 1 -- 172.21.15.172:0/4232389 >> 172.21.15.172:0/4232389 conn(0x7fce740d0800 msgr2=0x7fce740d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.830+0000 7fce7a488640 1 -- 172.21.15.172:0/4232389 shutdown_connections 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.830+0000 7fce7a488640 1 -- 172.21.15.172:0/4232389 wait complete. 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.831+0000 7fce7a488640 1 Processor -- start 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.831+0000 7fce7a488640 1 -- start start 2024-04-25T08:44:31.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce7a488640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce7406c2d0 0x7fce741f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce7a488640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce740b5620 0x7fce740c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce7a488640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 0x7fce74159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce7a488640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740cf550 con 0x7fce7415b7d0 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce7a488640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7406d230 con 0x7fce7406c2d0 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce7a488640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce740cf6d0 con 0x7fce740b5620 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce78a25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 0x7fce74159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce78a25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 0x7fce74159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38272/0 (socket says 172.21.15.172:38272) 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce78a25640 1 -- 172.21.15.172:0/306637196 learned_addr learned my addr 172.21.15.172:0/306637196 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce73fff640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce7406c2d0 0x7fce741f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce737fe640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce740b5620 0x7fce740c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce78a25640 1 -- 172.21.15.172:0/306637196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce740b5620 msgr2=0x7fce740c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce78a25640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce740b5620 0x7fce740c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce78a25640 1 -- 172.21.15.172:0/306637196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce7406c2d0 msgr2=0x7fce741f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce78a25640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce7406c2d0 0x7fce741f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce78a25640 1 -- 172.21.15.172:0/306637196 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740c99d0 con 0x7fce7415b7d0 2024-04-25T08:44:31.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce78a25640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 0x7fce74159880 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fce6c007d10 tx=0x7fce6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce70ff9640 1 -- 172.21.15.172:0/306637196 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c014420 con 0x7fce7415b7d0 2024-04-25T08:44:31.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce70ff9640 1 -- 172.21.15.172:0/306637196 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c019070 con 0x7fce7415b7d0 2024-04-25T08:44:31.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce70ff9640 1 -- 172.21.15.172:0/306637196 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c014820 con 0x7fce7415b7d0 2024-04-25T08:44:31.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce7a488640 1 -- 172.21.15.172:0/306637196 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce741f6960 con 0x7fce7415b7d0 2024-04-25T08:44:31.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.832+0000 7fce7a488640 1 -- 172.21.15.172:0/306637196 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce741f2f80 con 0x7fce7415b7d0 2024-04-25T08:44:31.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.834+0000 7fce70ff9640 1 -- 172.21.15.172:0/306637196 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce6c0149c0 con 0x7fce7415b7d0 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.834+0000 7fce70ff9640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6006b500 0x7fce6006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.834+0000 7fce70ff9640 1 -- 172.21.15.172:0/306637196 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fce6c08aa60 con 0x7fce7415b7d0 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.834+0000 7fce73fff640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6006b500 0x7fce6006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.835+0000 7fce73fff640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6006b500 0x7fce6006d9c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fce64034000 tx=0x7fce6402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.835+0000 7fce7d185740 1 Processor -- start 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.835+0000 7fce7d185740 1 -- start start 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce7d185740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fe1710 0x5592c2fe3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce7d185740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fe4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce7d185740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fb4370 0x5592c2fb7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce7d185740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c2f1cbc0 con 0x5592c2fb4370 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce7d185740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c2ec5e70 con 0x5592c2fe1af0 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce7d185740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592c2f18c60 con 0x5592c2fe1710 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce78a25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fb4370 0x5592c2fb7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce78a25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fb4370 0x5592c2fb7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38274/0 (socket says 172.21.15.172:38274) 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce78a25640 1 -- 172.21.15.172:0/1406137599 learned_addr learned my addr 172.21.15.172:0/1406137599 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce73fff640 1 --2- 172.21.15.172:0/1406137599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fe1710 0x5592c2fe3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce78a25640 1 -- 172.21.15.172:0/1406137599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fe1710 msgr2=0x5592c2fe3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce78a25640 1 --2- 172.21.15.172:0/1406137599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fe1710 0x5592c2fe3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce78a25640 1 -- 172.21.15.172:0/1406137599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 msgr2=0x5592c2fe4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce78a25640 1 --2- 172.21.15.172:0/1406137599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fe4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce78a25640 1 -- 172.21.15.172:0/1406137599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592c2ee6ad0 con 0x5592c2fb4370 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.836+0000 7fce78a25640 1 --2- 172.21.15.172:0/1406137599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fb4370 0x5592c2fb7b80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fce6c061200 tx=0x7fce6c058d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c5515ce3ae9177 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce59ffb640 1 -- 172.21.15.172:0/1406137599 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c061730 con 0x5592c2fb4370 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce59ffb640 1 -- 172.21.15.172:0/1406137599 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c0573d0 con 0x5592c2fb4370 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce59ffb640 1 -- 172.21.15.172:0/1406137599 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c0612a0 con 0x5592c2fb4370 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce7d185740 1 -- 172.21.15.172:0/1406137599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fb4370 msgr2=0x5592c2fb7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce7d185740 1 --2- 172.21.15.172:0/1406137599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fb4370 0x5592c2fb7b80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fce6c061200 tx=0x7fce6c058d40 comp rx=0 tx=0).stop 2024-04-25T08:44:31.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce7d185740 1 -- 172.21.15.172:0/1406137599 shutdown_connections 2024-04-25T08:44:31.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce7d185740 1 --2- 172.21.15.172:0/1406137599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fe4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce7d185740 1 --2- 172.21.15.172:0/1406137599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fb4370 0x5592c2fb7b80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce7d185740 1 --2- 172.21.15.172:0/1406137599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fe1710 0x5592c2fe3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce7d185740 1 -- 172.21.15.172:0/1406137599 >> 172.21.15.172:0/1406137599 conn(0x5592c2fb65e0 msgr2=0x5592c2ffef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce7d185740 1 -- 172.21.15.172:0/1406137599 shutdown_connections 2024-04-25T08:44:31.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.837+0000 7fce7d185740 1 -- 172.21.15.172:0/1406137599 wait complete. 2024-04-25T08:44:31.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.838+0000 7fce7d185740 1 -- start start 2024-04-25T08:44:31.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.838+0000 7fce7d185740 1 Processor -- start 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce7d185740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fe1710 0x5592c2fdaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce7d185740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c3012ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce7d185740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fdbed0 0x5592c2fde760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce7d185740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c2fb9790 con 0x5592c2fdbed0 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce7d185740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c2ebb4e0 con 0x5592c2fe1af0 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce7d185740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592c2fb9a70 con 0x5592c2fe1710 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce7d185740 10 client.0 _ll_register_callbacks cb 0x5592c2ed8de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce78a25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fdbed0 0x5592c2fde760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce78a25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fdbed0 0x5592c2fde760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38286/0 (socket says 172.21.15.172:38286) 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce78a25640 1 -- 172.21.15.172:0/2596019111 learned_addr learned my addr 172.21.15.172:0/2596019111 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce73fff640 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fe1710 0x5592c2fdaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce737fe640 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c3012ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce78a25640 1 -- 172.21.15.172:0/2596019111 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fe1710 msgr2=0x5592c2fdaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce78a25640 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fe1710 0x5592c2fdaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce78a25640 1 -- 172.21.15.172:0/2596019111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 msgr2=0x5592c3012ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce78a25640 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c3012ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce78a25640 1 -- 172.21.15.172:0/2596019111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592c2cfd940 con 0x5592c2fdbed0 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce78a25640 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fdbed0 0x5592c2fde760 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fce6c059060 tx=0x7fce6c007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2402cac756931ac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce52ffd640 1 -- 172.21.15.172:0/2596019111 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c075060 con 0x5592c2fdbed0 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce52ffd640 1 -- 172.21.15.172:0/2596019111 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fce6c0614a0 con 0x5592c2fdbed0 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.839+0000 7fce7d185740 1 -- 172.21.15.172:0/2596019111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce6c0573d0 con 0x5592c2fdbed0 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce52ffd640 1 -- 172.21.15.172:0/2596019111 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce6c088070 con 0x5592c2fdbed0 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce7d185740 10 client.5613 fetch_fsmap learned FSMap version 16 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce7d185740 1 -- 172.21.15.172:0/2596019111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5592c2d5e0d0 con 0x5592c2fdbed0 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce52ffd640 1 -- 172.21.15.172:0/2596019111 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c0573d0 con 0x5592c2fdbed0 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce52ffd640 1 -- 172.21.15.172:0/2596019111 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fce6c058520 con 0x5592c2fdbed0 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce7d185740 10 client.5613 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T08:44:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce7d185740 10 client.5613 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce7d185740 20 client.5613 populate_metadata read hostname 'smithi172' 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce7d185740 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x5592c3000050 0x5592c3000460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce7d185740 4 client.5613 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce7d185740 1 -- 172.21.15.172:0/2596019111 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592c2f2a100 con 0x5592c3000050 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce73fff640 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x5592c3000050 0x5592c3000460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce52ffd640 10 client.5613 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.840+0000 7fce73fff640 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x5592c3000050 0x5592c3000460 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f285a4fe7e2d5cd server_cookie=99d740c51e6032f0 in_seq=0 out_seq=0 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce52ffd640 1 -- 172.21.15.172:0/2596019111 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5592c2f2a100 con 0x5592c3000050 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce52ffd640 10 client.5613 handle_command_reply: tid=0 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 client.5613 shutdown 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 -- 172.21.15.172:0/2596019111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fdbed0 msgr2=0x5592c2fde760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fdbed0 0x5592c2fde760 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fce6c059060 tx=0x7fce6c007f20 comp rx=0 tx=0).stop 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 -- 172.21.15.172:0/2596019111 shutdown_connections 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x5592c3000050 0x5592c3000460 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c3012ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fdbed0 0x5592c2fde760 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce52ffd640 0 client.5613 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 --2- 172.21.15.172:0/2596019111 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fe1710 0x5592c2fdaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 -- 172.21.15.172:0/2596019111 >> 172.21.15.172:0/2596019111 conn(0x5592c2fb4370 msgr2=0x5592c2fb5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 -- 172.21.15.172:0/2596019111 shutdown_connections 2024-04-25T08:44:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 1 -- 172.21.15.172:0/2596019111 wait complete. 2024-04-25T08:44:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.841+0000 7fce7d185740 20 client.5613 trim_cache size 0 max 16384 2024-04-25T08:44:31.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.856+0000 7fce7d185740 1 Processor -- start 2024-04-25T08:44:31.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.856+0000 7fce7d185740 1 -- start start 2024-04-25T08:44:31.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce7d185740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fdbed0 0x5592c2fe0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce7d185740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce7d185740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fb4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce7d185740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce742004d0 con 0x5592c2fe1710 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce7d185740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce741ff6d0 con 0x5592c2fe1af0 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce7d185740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce741feb70 con 0x5592c2fdbed0 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce737fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce737fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38292/0 (socket says 172.21.15.172:38292) 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce737fe640 1 -- 172.21.15.172:0/554022427 learned_addr learned my addr 172.21.15.172:0/554022427 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce73fff640 1 --2- 172.21.15.172:0/554022427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fdbed0 0x5592c2fe0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce78a25640 1 --2- 172.21.15.172:0/554022427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fb4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce737fe640 1 -- 172.21.15.172:0/554022427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fdbed0 msgr2=0x5592c2fe0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce737fe640 1 --2- 172.21.15.172:0/554022427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fdbed0 0x5592c2fe0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce737fe640 1 -- 172.21.15.172:0/554022427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 msgr2=0x5592c2fb4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce737fe640 1 --2- 172.21.15.172:0/554022427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fb4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce737fe640 1 -- 172.21.15.172:0/554022427 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592c2bf1230 con 0x5592c2fe1710 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce737fe640 1 --2- 172.21.15.172:0/554022427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4850 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fce7415abe0 tx=0x7fce68009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d731934492d41aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce597fa640 1 -- 172.21.15.172:0/554022427 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6800f040 con 0x5592c2fe1710 2024-04-25T08:44:31.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce597fa640 1 -- 172.21.15.172:0/554022427 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce68014a80 con 0x5592c2fe1710 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.857+0000 7fce597fa640 1 -- 172.21.15.172:0/554022427 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68014e50 con 0x5592c2fe1710 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.858+0000 7fce7d185740 1 -- 172.21.15.172:0/554022427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 msgr2=0x5592c2fb4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.858+0000 7fce7d185740 1 --2- 172.21.15.172:0/554022427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4850 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fce7415abe0 tx=0x7fce68009d60 comp rx=0 tx=0).stop 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.858+0000 7fce7d185740 1 -- 172.21.15.172:0/554022427 shutdown_connections 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.858+0000 7fce7d185740 1 --2- 172.21.15.172:0/554022427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fb4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.858+0000 7fce7d185740 1 --2- 172.21.15.172:0/554022427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4850 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.858+0000 7fce7d185740 1 --2- 172.21.15.172:0/554022427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fdbed0 0x5592c2fe0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.858+0000 7fce7d185740 1 -- 172.21.15.172:0/554022427 >> 172.21.15.172:0/554022427 conn(0x5592c2fb4370 msgr2=0x5592c2fafb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.858+0000 7fce7d185740 1 -- 172.21.15.172:0/554022427 shutdown_connections 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.858+0000 7fce7d185740 1 -- 172.21.15.172:0/554022427 wait complete. 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.859+0000 7fce7d185740 1 -- start start 2024-04-25T08:44:31.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.859+0000 7fce7d185740 1 Processor -- start 2024-04-25T08:44:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.859+0000 7fce7d185740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fdbed0 0x5592c2fb4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.859+0000 7fce7d185740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce7d185740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fb52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce7d185740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c3022190 con 0x5592c2fe1710 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce7d185740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce741ff0d0 con 0x5592c2fe1af0 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce7d185740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592c30131d0 con 0x5592c2fdbed0 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce7d185740 10 client.0 _ll_register_callbacks cb 0x7fce6c058a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce737fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce737fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38302/0 (socket says 172.21.15.172:38302) 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce737fe640 1 -- 172.21.15.172:0/1982078757 learned_addr learned my addr 172.21.15.172:0/1982078757 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce73fff640 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fdbed0 0x5592c2fb4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce78a25640 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fb52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce737fe640 1 -- 172.21.15.172:0/1982078757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fdbed0 msgr2=0x5592c2fb4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce737fe640 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fdbed0 0x5592c2fb4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce737fe640 1 -- 172.21.15.172:0/1982078757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 msgr2=0x5592c2fb52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce737fe640 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fb52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce737fe640 1 -- 172.21.15.172:0/1982078757 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592c2fba0a0 con 0x5592c2fe1710 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce737fe640 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fce6801b000 tx=0x7fce68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c1e87758031589 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce52ffd640 1 -- 172.21.15.172:0/1982078757 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6802d060 con 0x5592c2fe1710 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce52ffd640 1 -- 172.21.15.172:0/1982078757 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fce68003610 con 0x5592c2fe1710 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce7d185740 1 -- 172.21.15.172:0/1982078757 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce68014a80 con 0x5592c2fe1710 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce52ffd640 1 -- 172.21.15.172:0/1982078757 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce6800f040 con 0x5592c2fe1710 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce7d185740 10 client.5619 fetch_fsmap learned FSMap version 16 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce7d185740 1 -- 172.21.15.172:0/1982078757 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5592c30024e0 con 0x5592c2fe1710 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.860+0000 7fce52ffd640 1 -- 172.21.15.172:0/1982078757 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce68014a80 con 0x5592c2fe1710 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.861+0000 7fce52ffd640 1 -- 172.21.15.172:0/1982078757 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fce68027070 con 0x5592c2fe1710 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.861+0000 7fce7d185740 10 client.5619 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.861+0000 7fce7d185740 10 client.5619 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.861+0000 7fce7d185740 20 client.5619 populate_metadata read hostname 'smithi172' 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.861+0000 7fce7d185740 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x5592c3069340 0x5592c2fb7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.861+0000 7fce7d185740 4 client.5619 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.861+0000 7fce7d185740 1 -- 172.21.15.172:0/1982078757 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) v1 -- 0x5592c2f24450 con 0x5592c3069340 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.861+0000 7fce73fff640 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x5592c3069340 0x5592c2fb7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.861+0000 7fce52ffd640 10 client.5619 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.861+0000 7fce73fff640 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x5592c3069340 0x5592c2fb7b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9d4fb4eb42de43d server_cookie=aaea28703a63bce1 in_seq=0 out_seq=0 2024-04-25T08:44:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce52ffd640 1 -- 172.21.15.172:0/1982078757 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5592c2f24450 con 0x5592c3069340 2024-04-25T08:44:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce52ffd640 10 client.5619 handle_command_reply: tid=0 2024-04-25T08:44:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 client.5619 shutdown 2024-04-25T08:44:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 -- 172.21.15.172:0/1982078757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 msgr2=0x5592c2fb4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fce6801b000 tx=0x7fce68004730 comp rx=0 tx=0).stop 2024-04-25T08:44:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 -- 172.21.15.172:0/1982078757 shutdown_connections 2024-04-25T08:44:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x5592c3069340 0x5592c2fb7b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592c2fe1af0 0x5592c2fb52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592c2fe1710 0x5592c2fb4d90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 --2- 172.21.15.172:0/1982078757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592c2fdbed0 0x5592c2fb4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce52ffd640 0 client.5619 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 -- 172.21.15.172:0/1982078757 >> 172.21.15.172:0/1982078757 conn(0x5592c2fb4370 msgr2=0x5592c2fe0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 -- 172.21.15.172:0/1982078757 shutdown_connections 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 1 -- 172.21.15.172:0/1982078757 wait complete. 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.866+0000 7fce7d185740 20 client.5619 trim_cache size 0 max 16384 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "aab87314-b9fc-4a77-b040-a759e6336e9e", 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:44:31.860 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:44:31.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 -- 172.21.15.172:0/306637196 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6006b500 msgr2=0x7fce6006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6006b500 0x7fce6006d9c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fce64034000 tx=0x7fce6402e000 comp rx=0 tx=0).stop 2024-04-25T08:44:31.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 -- 172.21.15.172:0/306637196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 msgr2=0x7fce74159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 0x7fce74159880 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fce6c007d10 tx=0x7fce6c00e4b0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 -- 172.21.15.172:0/306637196 shutdown_connections 2024-04-25T08:44:31.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce6006b500 0x7fce6006d9c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce7415b7d0 0x7fce74159880 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce740b5620 0x7fce740c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 --2- 172.21.15.172:0/306637196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce7406c2d0 0x7fce741f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 -- 172.21.15.172:0/306637196 >> 172.21.15.172:0/306637196 conn(0x7fce740d0800 msgr2=0x7fce740b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 -- 172.21.15.172:0/306637196 shutdown_connections 2024-04-25T08:44:31.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.867+0000 7fce7a488640 1 -- 172.21.15.172:0/306637196 wait complete. 2024-04-25T08:44:31.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:44:31.873 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-04-25T08:44:31.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.995+0000 7f5d58812640 1 Processor -- start 2024-04-25T08:44:31.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.996+0000 7f5d58812640 1 -- start start 2024-04-25T08:44:31.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d58812640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5d5415a9f0 0x7f5d540c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d58812640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d540cdbf0 0x7f5d540ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d58812640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d540c6940 con 0x7f5d540cd520 2024-04-25T08:44:31.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d58812640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d540b0020 con 0x7f5d540cdbf0 2024-04-25T08:44:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d58812640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d540cb5a0 con 0x7f5d5415a9f0 2024-04-25T08:44:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d51d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d540cdbf0 0x7f5d540ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d5259c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5d5415a9f0 0x7f5d540c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d51d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d540cdbf0 0x7f5d540ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38310/0 (socket says 172.21.15.172:38310) 2024-04-25T08:44:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d51d9b640 1 -- 172.21.15.172:0/78146171 learned_addr learned my addr 172.21.15.172:0/78146171 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d51d9b640 1 -- 172.21.15.172:0/78146171 >> v2:172.21.15.186:3300/0 conn(0x7f5d5415a9f0 msgr2=0x7f5d540c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/78146171 >> v2:172.21.15.186:3300/0 conn(0x7f5d5415a9f0 0x7f5d540c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d51d9b640 1 -- 172.21.15.172:0/78146171 >> v1:172.21.15.172:6789/0 conn(0x7f5d540cd520 legacy=0x7f5d540ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.997+0000 7f5d51d9b640 1 -- 172.21.15.172:0/78146171 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5415add0 con 0x7f5d540cdbf0 2024-04-25T08:44:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.999+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/78146171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d540cdbf0 0x7f5d540ccfe0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5d540c77e0 tx=0x7f5d4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da0cf1c5a79e0f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.999+0000 7f5d5159a640 1 -- 172.21.15.172:0/78146171 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48037070 con 0x7f5d540cdbf0 2024-04-25T08:44:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.999+0000 7f5d5159a640 1 -- 172.21.15.172:0/78146171 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d48032440 con 0x7f5d540cdbf0 2024-04-25T08:44:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:31.999+0000 7f5d5159a640 1 -- 172.21.15.172:0/78146171 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48032810 con 0x7f5d540cdbf0 2024-04-25T08:44:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.000+0000 7f5d58812640 1 -- 172.21.15.172:0/78146171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d540cdbf0 msgr2=0x7f5d540ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.000+0000 7f5d58812640 1 --2- 172.21.15.172:0/78146171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d540cdbf0 0x7f5d540ccfe0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5d540c77e0 tx=0x7f5d4802a270 comp rx=0 tx=0).stop 2024-04-25T08:44:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.000+0000 7f5d58812640 1 -- 172.21.15.172:0/78146171 shutdown_connections 2024-04-25T08:44:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.000+0000 7f5d58812640 1 --2- 172.21.15.172:0/78146171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d540cdbf0 0x7f5d540ccfe0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.000+0000 7f5d58812640 1 --2- 172.21.15.172:0/78146171 >> v2:172.21.15.186:3300/0 conn(0x7f5d5415a9f0 0x7f5d540c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.000+0000 7f5d58812640 1 -- 172.21.15.172:0/78146171 >> 172.21.15.172:0/78146171 conn(0x7f5d540b2390 msgr2=0x7f5d540b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.000+0000 7f5d58812640 1 -- 172.21.15.172:0/78146171 shutdown_connections 2024-04-25T08:44:31.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.000+0000 7f5d58812640 1 -- 172.21.15.172:0/78146171 wait complete. 2024-04-25T08:44:31.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.002+0000 7f5d58812640 1 Processor -- start 2024-04-25T08:44:31.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.002+0000 7f5d58812640 1 -- start start 2024-04-25T08:44:31.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.003+0000 7f5d58812640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d540cd520 0x7f5d541590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.003+0000 7f5d58812640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d540cdbf0 0x7f5d540c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.003+0000 7f5d58812640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5415a9f0 0x7f5d540b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:31.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.003+0000 7f5d58812640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540cb230 con 0x7f5d540cdbf0 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.003+0000 7f5d58812640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540caf50 con 0x7f5d540cd520 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.003+0000 7f5d58812640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540ce070 con 0x7f5d5415a9f0 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.003+0000 7f5d5259c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d540cd520 0x7f5d541590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d51d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d540cdbf0 0x7f5d540c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d5259c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d540cd520 0x7f5d541590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:48272/0 (socket says 172.21.15.172:48272) 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d5259c640 1 -- 172.21.15.172:0/345121977 learned_addr learned my addr 172.21.15.172:0/345121977 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d52d9d640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5415a9f0 0x7f5d540b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d51d9b640 1 -- 172.21.15.172:0/345121977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5415a9f0 msgr2=0x7f5d540b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5415a9f0 0x7f5d540b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d51d9b640 1 -- 172.21.15.172:0/345121977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d540cd520 msgr2=0x7f5d541590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d540cd520 0x7f5d541590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d51d9b640 1 -- 172.21.15.172:0/345121977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d540c7d70 con 0x7f5d540cdbf0 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d5259c640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d540cd520 0x7f5d541590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:44:31.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d540cdbf0 0x7f5d540c7830 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5d48031000 tx=0x7f5d480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:31.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d42ffd640 1 -- 172.21.15.172:0/345121977 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48041030 con 0x7f5d540cdbf0 2024-04-25T08:44:31.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d42ffd640 1 -- 172.21.15.172:0/345121977 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d48030440 con 0x7f5d540cdbf0 2024-04-25T08:44:31.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.004+0000 7f5d42ffd640 1 -- 172.21.15.172:0/345121977 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48037040 con 0x7f5d540cdbf0 2024-04-25T08:44:31.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.005+0000 7f5d58812640 1 -- 172.21.15.172:0/345121977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d541e7f80 con 0x7f5d540cdbf0 2024-04-25T08:44:31.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.005+0000 7f5d58812640 1 -- 172.21.15.172:0/345121977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d540b4ae0 con 0x7f5d540cdbf0 2024-04-25T08:44:31.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.007+0000 7f5d42ffd640 1 -- 172.21.15.172:0/345121977 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d48044070 con 0x7f5d540cdbf0 2024-04-25T08:44:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.007+0000 7f5d42ffd640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 0x7f5d3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.008+0000 7f5d42ffd640 1 -- 172.21.15.172:0/345121977 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f5d480aa8d0 con 0x7f5d540cdbf0 2024-04-25T08:44:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.008+0000 7f5d5259c640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 0x7f5d3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.008+0000 7f5d5259c640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 0x7f5d3406d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009f50 tx=0x7f5d44009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.009+0000 7f5d5b5ec740 1 Processor -- start 2024-04-25T08:44:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.009+0000 7f5d5b5ec740 1 -- start start 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f40320 0x560334f5bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f5e320 0x560334f40700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560334e79da0 con 0x560334f5e320 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560334e22b80 con 0x560334f514a0 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560334e75e40 con 0x560334f40320 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5259c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f40320 0x560334f5bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5259c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f40320 0x560334f5bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:56398/0 (socket says 172.21.15.172:56398) 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5259c640 1 -- 172.21.15.172:0/4241294629 learned_addr learned my addr 172.21.15.172:0/4241294629 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/4241294629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f5e320 0x560334f40700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d52d9d640 1 --2- 172.21.15.172:0/4241294629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5259c640 1 -- 172.21.15.172:0/4241294629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 msgr2=0x560334f518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5259c640 1 --2- 172.21.15.172:0/4241294629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5259c640 1 -- 172.21.15.172:0/4241294629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f5e320 msgr2=0x560334f40700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5259c640 1 --2- 172.21.15.172:0/4241294629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f5e320 0x560334f40700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d5259c640 1 -- 172.21.15.172:0/4241294629 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560334e2cf10 con 0x560334f40320 2024-04-25T08:44:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.010+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/4241294629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f5e320 0x560334f40700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:44:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.011+0000 7f5d5259c640 1 --2- 172.21.15.172:0/4241294629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f40320 0x560334f5bef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d440147f0 tx=0x7f5d44014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6079edc447ebb1dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.011+0000 7f5d33fff640 1 -- 172.21.15.172:0/4241294629 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44025070 con 0x560334f40320 2024-04-25T08:44:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.011+0000 7f5d33fff640 1 -- 172.21.15.172:0/4241294629 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4401b070 con 0x560334f40320 2024-04-25T08:44:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.011+0000 7f5d33fff640 1 -- 172.21.15.172:0/4241294629 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44021820 con 0x560334f40320 2024-04-25T08:44:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.012+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/4241294629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f40320 msgr2=0x560334f5bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.012+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/4241294629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f40320 0x560334f5bef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d440147f0 tx=0x7f5d44014000 comp rx=0 tx=0).stop 2024-04-25T08:44:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.012+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/4241294629 shutdown_connections 2024-04-25T08:44:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.012+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/4241294629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.012+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/4241294629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f5e320 0x560334f40700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.012+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/4241294629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f40320 0x560334f5bef0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.012+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/4241294629 >> 172.21.15.172:0/4241294629 conn(0x560334f129e0 msgr2=0x560334f5b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:32.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.012+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/4241294629 shutdown_connections 2024-04-25T08:44:32.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.012+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/4241294629 wait complete. 2024-04-25T08:44:32.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.013+0000 7f5d5b5ec740 1 -- start start 2024-04-25T08:44:32.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.013+0000 7f5d5b5ec740 1 Processor -- start 2024-04-25T08:44:32.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f514a0 0x560334f3aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f5e320 0x560334f42110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334f41940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560334f10770 con 0x560334f414c0 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560334e184b0 con 0x560334f5e320 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560334f40c40 con 0x560334f514a0 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d52d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334f41940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5259c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f514a0 0x560334f3aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5259c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f514a0 0x560334f3aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:56400/0 (socket says 172.21.15.172:56400) 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d52d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334f41940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38344/0 (socket says 172.21.15.172:38344) 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5259c640 1 -- 172.21.15.172:0/1389824862 learned_addr learned my addr 172.21.15.172:0/1389824862 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5b5ec740 10 client.0 _ll_register_callbacks cb 0x560334e58180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f5e320 0x560334f42110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5259c640 1 -- 172.21.15.172:0/1389824862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f5e320 msgr2=0x560334f42110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:32.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5259c640 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f5e320 0x560334f42110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5259c640 1 -- 172.21.15.172:0/1389824862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 msgr2=0x560334f41940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5259c640 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334f41940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.014+0000 7f5d5259c640 1 -- 172.21.15.172:0/1389824862 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560334c587d0 con 0x560334f514a0 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.015+0000 7f5d5259c640 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f514a0 0x560334f3aab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x560334f11700 tx=0x7f5d44004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5183a2b26c4fb94f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.015+0000 7f5d317fa640 10 client.0 ms_handle_connect on v2:172.21.15.186:3301/0 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.015+0000 7f5d317fa640 1 -- 172.21.15.172:0/1389824862 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44025040 con 0x560334f514a0 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.015+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1389824862 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d4401b070 con 0x560334f514a0 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.015+0000 7f5d317fa640 1 -- 172.21.15.172:0/1389824862 <== mon.2 v2:172.21.15.186:3301/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f5d4402a860 con 0x560334f514a0 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.015+0000 7f5d317fa640 1 -- 172.21.15.172:0/1389824862 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d4402aa60 con 0x560334f514a0 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.015+0000 7f5d5b5ec740 10 client.4883 fetch_fsmap learned FSMap version 16 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.015+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1389824862 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x560334b8e3f0 con 0x560334f514a0 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.016+0000 7f5d317fa640 1 -- 172.21.15.172:0/1389824862 <== mon.2 v2:172.21.15.186:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4402ac00 con 0x560334f514a0 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.016+0000 7f5d317fa640 1 -- 172.21.15.172:0/1389824862 <== mon.2 v2:172.21.15.186:3301/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5d4403d080 con 0x560334f514a0 2024-04-25T08:44:32.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.016+0000 7f5d5b5ec740 10 client.4883 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T08:44:32.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.016+0000 7f5d5b5ec740 10 client.4883 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:44:32.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.016+0000 7f5d5b5ec740 20 client.4883 populate_metadata read hostname 'smithi172' 2024-04-25T08:44:32.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.016+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x560334f774c0 0x560334f778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.016+0000 7f5d5b5ec740 4 client.4883 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:44:32.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.016+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1389824862 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d4401b070 con 0x560334f774c0 2024-04-25T08:44:32.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.016+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x560334f774c0 0x560334f778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.016+0000 7f5d317fa640 10 client.4883 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:32.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.017+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x560334f774c0 0x560334f778d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=201a4f2e3e201186 server_cookie=9fbb1a396a837082 in_seq=0 out_seq=0 2024-04-25T08:44:32.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d317fa640 1 -- 172.21.15.172:0/1389824862 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7f5d4401b070 con 0x560334f774c0 2024-04-25T08:44:32.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d317fa640 10 client.4883 handle_command_reply: tid=0 2024-04-25T08:44:32.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 client.4883 shutdown 2024-04-25T08:44:32.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1389824862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f514a0 msgr2=0x560334f3aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:32.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f514a0 0x560334f3aab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x560334f11700 tx=0x7f5d44004730 comp rx=0 tx=0).stop 2024-04-25T08:44:32.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1389824862 shutdown_connections 2024-04-25T08:44:32.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x560334f774c0 0x560334f778d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f5e320 0x560334f42110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334f41940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1389824862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f514a0 0x560334f3aab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1389824862 >> 172.21.15.172:0/1389824862 conn(0x560334f40320 msgr2=0x560334f3d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:32.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d317fa640 0 client.4883 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:32.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1389824862 shutdown_connections 2024-04-25T08:44:32.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1389824862 wait complete. 2024-04-25T08:44:32.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.018+0000 7f5d5b5ec740 20 client.4883 trim_cache size 0 max 16384 2024-04-25T08:44:32.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.040+0000 7f5d5b5ec740 1 Processor -- start 2024-04-25T08:44:32.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.040+0000 7f5d5b5ec740 1 -- start start 2024-04-25T08:44:32.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334f421e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f5a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 0x560334f5a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5412b800 con 0x560334f414c0 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5412aa00 con 0x560334f514a0 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541e7370 con 0x560334f5e320 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d52d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 0x560334f5a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d51d9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f5a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d51d9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f5a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:48302/0 (socket says 172.21.15.172:48302) 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d5259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334f421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.041+0000 7f5d51d9b640 1 -- 172.21.15.172:0/145391262 learned_addr learned my addr 172.21.15.172:0/145391262 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.042+0000 7f5d51d9b640 1 -- 172.21.15.172:0/145391262 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 msgr2=0x560334f5a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.042+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/145391262 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 0x560334f5a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.042+0000 7f5d51d9b640 1 -- 172.21.15.172:0/145391262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 msgr2=0x560334f421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:32.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.042+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/145391262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334f421e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.042+0000 7f5d51d9b640 1 -- 172.21.15.172:0/145391262 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560334f41cb0 con 0x560334f514a0 2024-04-25T08:44:32.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.042+0000 7f5d5259c640 1 --2- 172.21.15.172:0/145391262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334f421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:44:32.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.042+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/145391262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f5a490 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5d48075430 tx=0x7f5d480a8a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=421d5c22a2a393e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:32.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.042+0000 7f5d337fe640 1 -- 172.21.15.172:0/145391262 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d480a6070 con 0x560334f514a0 2024-04-25T08:44:32.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.042+0000 7f5d337fe640 1 -- 172.21.15.172:0/145391262 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d480a8cc0 con 0x560334f514a0 2024-04-25T08:44:32.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.042+0000 7f5d337fe640 1 -- 172.21.15.172:0/145391262 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48075640 con 0x560334f514a0 2024-04-25T08:44:32.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.043+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/145391262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 msgr2=0x560334f5a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.043+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/145391262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f5a490 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5d48075430 tx=0x7f5d480a8a80 comp rx=0 tx=0).stop 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.043+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/145391262 shutdown_connections 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.043+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/145391262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f5a490 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.043+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/145391262 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 0x560334f5a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.043+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/145391262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334f421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.043+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/145391262 >> 172.21.15.172:0/145391262 conn(0x560334f40320 msgr2=0x560334f5bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.043+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/145391262 shutdown_connections 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.043+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/145391262 wait complete. 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.044+0000 7f5d5b5ec740 1 -- start start 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.044+0000 7f5d5b5ec740 1 Processor -- start 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.045+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334fd6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.045+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f3ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.045+0000 7f5d5b5ec740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 0x560334f3cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.045+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560334f7dc90 con 0x560334f414c0 2024-04-25T08:44:32.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.045+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d541e7970 con 0x560334f514a0 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.045+0000 7f5d5b5ec740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560334f59990 con 0x560334f5e320 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.045+0000 7f5d5b5ec740 10 client.0 _ll_register_callbacks cb 0x7f5d44009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d52d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 0x560334f3cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d52d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 0x560334f3cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:56420/0 (socket says 172.21.15.172:56420) 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d52d9d640 1 -- 172.21.15.172:0/1839624368 learned_addr learned my addr 172.21.15.172:0/1839624368 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d51d9b640 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f3ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d5259c640 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334fd6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d52d9d640 1 -- 172.21.15.172:0/1839624368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 msgr2=0x560334f3ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d52d9d640 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f3ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d52d9d640 1 -- 172.21.15.172:0/1839624368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 msgr2=0x560334fd6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d52d9d640 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334fd6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d52d9d640 1 -- 172.21.15.172:0/1839624368 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560334b4e0f0 con 0x560334f5e320 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d5259c640 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334fd6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d52d9d640 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 0x560334f3cfa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0169f0 tx=0x7f5d4c016eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30937e81045f496a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d317fa640 10 client.0 ms_handle_connect on v2:172.21.15.186:3301/0 2024-04-25T08:44:32.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d317fa640 1 -- 172.21.15.172:0/1839624368 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c003b80 con 0x560334f5e320 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.046+0000 7f5d317fa640 1 -- 172.21.15.172:0/1839624368 <== mon.2 v2:172.21.15.186:3301/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f5d4c010040 con 0x560334f5e320 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1839624368 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d480a8cc0 con 0x560334f5e320 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d317fa640 1 -- 172.21.15.172:0/1839624368 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d4c003d20 con 0x560334f5e320 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d5b5ec740 10 client.4889 fetch_fsmap learned FSMap version 16 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1839624368 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x560334f17240 con 0x560334f5e320 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d317fa640 1 -- 172.21.15.172:0/1839624368 <== mon.2 v2:172.21.15.186:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c015950 con 0x560334f5e320 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d317fa640 1 -- 172.21.15.172:0/1839624368 <== mon.2 v2:172.21.15.186:3301/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5d4c015b00 con 0x560334f5e320 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d5b5ec740 10 client.4889 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d5b5ec740 10 client.4889 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d5b5ec740 20 client.4889 populate_metadata read hostname 'smithi172' 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x560334f578b0 0x560334f57cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d5b5ec740 4 client.4889 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1839624368 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f5d480a8cc0 con 0x560334f578b0 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.047+0000 7f5d5259c640 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x560334f578b0 0x560334f57cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:44:32.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.048+0000 7f5d317fa640 10 client.4889 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:32.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.048+0000 7f5d5259c640 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x560334f578b0 0x560334f57cc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2778fb19d1774da8 server_cookie=7586c291ee86b500 in_seq=0 out_seq=0 2024-04-25T08:44:32.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d317fa640 1 -- 172.21.15.172:0/1839624368 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+274 (crc 0 0 0) 0x7f5d480a8cc0 con 0x560334f578b0 2024-04-25T08:44:32.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d317fa640 10 client.4889 handle_command_reply: tid=0 2024-04-25T08:44:32.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d5b5ec740 1 client.4889 shutdown 2024-04-25T08:44:32.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1839624368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 msgr2=0x560334f3cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:32.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 0x560334f3cfa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0169f0 tx=0x7f5d4c016eb0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1839624368 shutdown_connections 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x560334f578b0 0x560334f57cc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560334f514a0 0x560334f3ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560334f5e320 0x560334f3cfa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d5b5ec740 1 --2- 172.21.15.172:0/1839624368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560334f414c0 0x560334fd6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1839624368 >> 172.21.15.172:0/1839624368 conn(0x560334f40320 msgr2=0x560334f41f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.049+0000 7f5d317fa640 0 client.4889 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1839624368 shutdown_connections 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d5b5ec740 1 -- 172.21.15.172:0/1839624368 wait complete. 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d5b5ec740 20 client.4889 trim_cache size 0 max 16384 2024-04-25T08:44:32.045 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:44:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "scrub active (727 inodes in the stack)", 2024-04-25T08:44:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": { 2024-04-25T08:44:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: "aab87314-b9fc-4a77-b040-a759e6336e9e": { 2024-04-25T08:44:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "/", 2024-04-25T08:44:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: "tag": "aab87314-b9fc-4a77-b040-a759e6336e9e", 2024-04-25T08:44:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: "options": "recursive,scrub_mdsdir" 2024-04-25T08:44:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:32.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:44:32.046 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 -- 172.21.15.172:0/345121977 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 msgr2=0x7f5d3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 0x7f5d3406d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009f50 tx=0x7f5d44009190 comp rx=0 tx=0).stop 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 -- 172.21.15.172:0/345121977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d540cdbf0 msgr2=0x7f5d540c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d540cdbf0 0x7f5d540c7830 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5d48031000 tx=0x7f5d480046c0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 -- 172.21.15.172:0/345121977 shutdown_connections 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 0x7f5d3406d990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5415a9f0 0x7f5d540b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d540cdbf0 0x7f5d540c7830 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 --2- 172.21.15.172:0/345121977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d540cd520 0x7f5d541590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 -- 172.21.15.172:0/345121977 >> 172.21.15.172:0/345121977 conn(0x7f5d540b2390 msgr2=0x7f5d540cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.050+0000 7f5d58812640 1 -- 172.21.15.172:0/345121977 shutdown_connections 2024-04-25T08:44:32.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:44:32.051+0000 7f5d58812640 1 -- 172.21.15.172:0/345121977 wait complete. 2024-04-25T08:44:32.056 INFO:tasks.cephfs.filesystem:scrub status for tag:aab87314-b9fc-4a77-b040-a759e6336e9e - {'path': '/', 'tag': 'aab87314-b9fc-4a77-b040-a759e6336e9e', 'options': 'recursive,scrub_mdsdir'} 2024-04-25T08:44:59.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:44:59.398 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:45:02.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:02.057 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-04-25T08:45:02.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.175+0000 7f7e79c7c640 1 Processor -- start 2024-04-25T08:45:02.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.175+0000 7f7e79c7c640 1 -- start start 2024-04-25T08:45:02.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.176+0000 7f7e79c7c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7e741446d0 0x7f7e740b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.176+0000 7f7e79c7c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7e7406e8a0 0x7f7e740b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.176+0000 7f7e79c7c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e740cccc0 con 0x7f7e74144d50 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.176+0000 7f7e79c7c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e740b2b20 con 0x7f7e741446d0 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.176+0000 7f7e79c7c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7406d400 con 0x7f7e7406e8a0 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.176+0000 7f7e737fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7e741446d0 0x7f7e740b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.176+0000 7f7e72ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7e74144d50 0x7f7e740cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41692/0 (socket says 172.21.15.172:41692) 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.176+0000 7f7e737fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7e741446d0 0x7f7e740b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54152/0 (socket says 172.21.15.172:54152) 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.176+0000 7f7e72ffd640 1 -- 172.21.15.172:0/969675436 learned_addr learned my addr 172.21.15.172:0/969675436 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.177+0000 7f7e73fff640 1 --2- 172.21.15.172:0/969675436 >> v2:172.21.15.186:3300/0 conn(0x7f7e7406e8a0 0x7f7e740b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.177+0000 7f7e737fe640 1 -- 172.21.15.172:0/969675436 >> v2:172.21.15.186:3300/0 conn(0x7f7e7406e8a0 msgr2=0x7f7e740b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.177+0000 7f7e737fe640 1 --2- 172.21.15.172:0/969675436 >> v2:172.21.15.186:3300/0 conn(0x7f7e7406e8a0 0x7f7e740b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.177+0000 7f7e737fe640 1 -- 172.21.15.172:0/969675436 >> v1:172.21.15.172:6789/0 conn(0x7f7e74144d50 legacy=0x7f7e740cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.177+0000 7f7e737fe640 1 -- 172.21.15.172:0/969675436 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740cc140 con 0x7f7e741446d0 2024-04-25T08:45:02.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.177+0000 7f7e727fc640 1 -- 172.21.15.172:0/969675436 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887188136 0 0) 0x7f7e740cccc0 con 0x7f7e74144d50 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.177+0000 7f7e737fe640 1 --2- 172.21.15.172:0/969675436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e741446d0 0x7f7e740b3f20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7e74071200 tx=0x7f7e6402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd37ca88dec80998 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e727fc640 1 -- 172.21.15.172:0/969675436 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64037070 con 0x7f7e741446d0 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e727fc640 1 -- 172.21.15.172:0/969675436 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64032440 con 0x7f7e741446d0 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e727fc640 1 -- 172.21.15.172:0/969675436 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64032810 con 0x7f7e741446d0 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e79c7c640 1 -- 172.21.15.172:0/969675436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e741446d0 msgr2=0x7f7e740b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e79c7c640 1 --2- 172.21.15.172:0/969675436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e741446d0 0x7f7e740b3f20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7e74071200 tx=0x7f7e6402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e79c7c640 1 -- 172.21.15.172:0/969675436 shutdown_connections 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e79c7c640 1 --2- 172.21.15.172:0/969675436 >> v2:172.21.15.186:3300/0 conn(0x7f7e7406e8a0 0x7f7e740b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e79c7c640 1 --2- 172.21.15.172:0/969675436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e741446d0 0x7f7e740b3f20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e79c7c640 1 -- 172.21.15.172:0/969675436 >> 172.21.15.172:0/969675436 conn(0x7f7e7406abe0 msgr2=0x7f7e7406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e79c7c640 1 -- 172.21.15.172:0/969675436 shutdown_connections 2024-04-25T08:45:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.178+0000 7f7e79c7c640 1 -- 172.21.15.172:0/969675436 wait complete. 2024-04-25T08:45:02.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.179+0000 7f7e79c7c640 1 Processor -- start 2024-04-25T08:45:02.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.180+0000 7f7e79c7c640 1 -- start start 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.180+0000 7f7e79c7c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e7406e8a0 0x7f7e741f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.180+0000 7f7e79c7c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e741446d0 0x7f7e74138d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.180+0000 7f7e79c7c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e74144d50 0x7f7e74139270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.180+0000 7f7e79c7c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740cc700 con 0x7f7e74144d50 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.180+0000 7f7e79c7c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740b49a0 con 0x7f7e7406e8a0 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.180+0000 7f7e79c7c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740cc9e0 con 0x7f7e741446d0 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.180+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e74144d50 0x7f7e74139270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e74144d50 0x7f7e74139270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54154/0 (socket says 172.21.15.172:54154) 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e73fff640 1 -- 172.21.15.172:0/951209466 learned_addr learned my addr 172.21.15.172:0/951209466 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e737fe640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e7406e8a0 0x7f7e741f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e72ffd640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e741446d0 0x7f7e74138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e73fff640 1 -- 172.21.15.172:0/951209466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e741446d0 msgr2=0x7f7e74138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e73fff640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e741446d0 0x7f7e74138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e73fff640 1 -- 172.21.15.172:0/951209466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e7406e8a0 msgr2=0x7f7e741f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e73fff640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e7406e8a0 0x7f7e741f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e73fff640 1 -- 172.21.15.172:0/951209466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74139b60 con 0x7f7e74144d50 2024-04-25T08:45:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e73fff640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e74144d50 0x7f7e74139270 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c007e40 tx=0x7f7e6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e5bfff640 1 -- 172.21.15.172:0/951209466 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c014620 con 0x7f7e74144d50 2024-04-25T08:45:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e5bfff640 1 -- 172.21.15.172:0/951209466 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c019070 con 0x7f7e74144d50 2024-04-25T08:45:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e79c7c640 1 -- 172.21.15.172:0/951209466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e740ab1d0 con 0x7f7e74144d50 2024-04-25T08:45:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e5bfff640 1 -- 172.21.15.172:0/951209466 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c014a20 con 0x7f7e74144d50 2024-04-25T08:45:02.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.181+0000 7f7e79c7c640 1 -- 172.21.15.172:0/951209466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e740ab790 con 0x7f7e74144d50 2024-04-25T08:45:02.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.183+0000 7f7e5bfff640 1 -- 172.21.15.172:0/951209466 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7e6c014bc0 con 0x7f7e74144d50 2024-04-25T08:45:02.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.183+0000 7f7e5bfff640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7e6006b4d0 0x7f7e6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.183+0000 7f7e5bfff640 1 -- 172.21.15.172:0/951209466 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f7e6c08aba0 con 0x7f7e74144d50 2024-04-25T08:45:02.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.183+0000 7f7e737fe640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7e6006b4d0 0x7f7e6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.184+0000 7f7e737fe640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7e6006b4d0 0x7f7e6006d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e64034000 tx=0x7f7e6402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.184+0000 7f7e7c977740 1 Processor -- start 2024-04-25T08:45:02.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.184+0000 7f7e7c977740 1 -- start start 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 0x55a6c5026320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c5026860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c4ff6770 0x55a6c4ff9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e7c977740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c4f5fda0 con 0x55a6c5023ef0 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e7c977740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c4f08b80 con 0x55a6c5023b10 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e7c977740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a6c4f5be40 con 0x55a6c4ff6770 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c5026860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e72ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c5026860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54158/0 (socket says 172.21.15.172:54158) 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e72ffd640 1 -- 172.21.15.172:0/634015354 learned_addr learned my addr 172.21.15.172:0/634015354 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e73fff640 1 --2- 172.21.15.172:0/634015354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c4ff6770 0x55a6c4ff9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e737fe640 1 --2- 172.21.15.172:0/634015354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 0x55a6c5026320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e72ffd640 1 -- 172.21.15.172:0/634015354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c4ff6770 msgr2=0x55a6c4ff9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e72ffd640 1 --2- 172.21.15.172:0/634015354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c4ff6770 0x55a6c4ff9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e72ffd640 1 -- 172.21.15.172:0/634015354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 msgr2=0x55a6c5026320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e72ffd640 1 --2- 172.21.15.172:0/634015354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 0x55a6c5026320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e72ffd640 1 -- 172.21.15.172:0/634015354 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6c4f12f10 con 0x55a6c5023ef0 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.185+0000 7f7e737fe640 1 --2- 172.21.15.172:0/634015354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 0x55a6c5026320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e72ffd640 1 --2- 172.21.15.172:0/634015354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c5026860 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7e68000f60 tx=0x7f7e68004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b1b1295f07316a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e597fa640 1 -- 172.21.15.172:0/634015354 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68001790 con 0x55a6c5023ef0 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e597fa640 1 -- 172.21.15.172:0/634015354 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68001930 con 0x55a6c5023ef0 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e597fa640 1 -- 172.21.15.172:0/634015354 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68001b20 con 0x55a6c5023ef0 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e7c977740 1 -- 172.21.15.172:0/634015354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 msgr2=0x55a6c5026860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e7c977740 1 --2- 172.21.15.172:0/634015354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c5026860 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7e68000f60 tx=0x7f7e68004bb0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e7c977740 1 -- 172.21.15.172:0/634015354 shutdown_connections 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e7c977740 1 --2- 172.21.15.172:0/634015354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c4ff6770 0x55a6c4ff9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e7c977740 1 --2- 172.21.15.172:0/634015354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c5026860 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e7c977740 1 --2- 172.21.15.172:0/634015354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 0x55a6c5026320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.186+0000 7f7e7c977740 1 -- 172.21.15.172:0/634015354 >> 172.21.15.172:0/634015354 conn(0x55a6c4ff89e0 msgr2=0x55a6c5041320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.187+0000 7f7e7c977740 1 -- 172.21.15.172:0/634015354 shutdown_connections 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.187+0000 7f7e7c977740 1 -- 172.21.15.172:0/634015354 wait complete. 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.187+0000 7f7e7c977740 1 -- start start 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.187+0000 7f7e7c977740 1 Processor -- start 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c5023b10 0x55a6c501a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023ef0 0x55a6c503b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c4ffb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e7c977740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c4ffbb90 con 0x55a6c4ffaf90 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e7c977740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c4efe4b0 con 0x55a6c5023ef0 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e7c977740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a6c4ffbe70 con 0x55a6c5023b10 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e7c977740 10 client.0 _ll_register_callbacks cb 0x55a6c4f3e180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c4ffb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c4ffb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54174/0 (socket says 172.21.15.172:54174) 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e73fff640 1 -- 172.21.15.172:0/1077367241 learned_addr learned my addr 172.21.15.172:0/1077367241 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e737fe640 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c5023b10 0x55a6c501a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e72ffd640 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023ef0 0x55a6c503b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e73fff640 1 -- 172.21.15.172:0/1077367241 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c5023b10 msgr2=0x55a6c501a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e73fff640 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c5023b10 0x55a6c501a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e73fff640 1 -- 172.21.15.172:0/1077367241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023ef0 msgr2=0x55a6c503b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e73fff640 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023ef0 0x55a6c503b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e73fff640 1 -- 172.21.15.172:0/1077367241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6c4d3e7d0 con 0x55a6c4ffaf90 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e73fff640 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c4ffb410 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0591a0 tx=0x7f7e6c059350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a637a56e85c01521 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.188+0000 7f7e527fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e527fc640 1 -- 172.21.15.172:0/1077367241 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c055880 con 0x55a6c4ffaf90 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e527fc640 1 -- 172.21.15.172:0/1077367241 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f7e6c0613e0 con 0x55a6c4ffaf90 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e7c977740 1 -- 172.21.15.172:0/1077367241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e68001930 con 0x55a6c4ffaf90 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e527fc640 1 -- 172.21.15.172:0/1077367241 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e6c055a20 con 0x55a6c4ffaf90 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e7c977740 10 client.5652 fetch_fsmap learned FSMap version 16 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e7c977740 1 -- 172.21.15.172:0/1077367241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a6c4c743f0 con 0x55a6c4ffaf90 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e527fc640 1 -- 172.21.15.172:0/1077367241 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68001930 con 0x55a6c4ffaf90 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e527fc640 1 -- 172.21.15.172:0/1077367241 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7e6c058660 con 0x55a6c4ffaf90 2024-04-25T08:45:02.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e7c977740 10 client.5652 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e7c977740 10 client.5652 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e7c977740 20 client.5652 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e7c977740 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55a6c5042920 0x55a6c5042d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e7c977740 4 client.5652 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e7c977740 1 -- 172.21.15.172:0/1077367241 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a6c4f6d2e0 con 0x55a6c5042920 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e737fe640 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55a6c5042920 0x55a6c5042d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e527fc640 10 client.5652 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.189+0000 7f7e737fe640 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55a6c5042920 0x55a6c5042d00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37fb74f15b881f08 server_cookie=caebed286291a7d8 in_seq=0 out_seq=0 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e527fc640 1 -- 172.21.15.172:0/1077367241 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a6c4f6d2e0 con 0x55a6c5042920 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e527fc640 10 client.5652 handle_command_reply: tid=0 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 client.5652 shutdown 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 -- 172.21.15.172:0/1077367241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 msgr2=0x55a6c4ffb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c4ffb410 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0591a0 tx=0x7f7e6c059350 comp rx=0 tx=0).stop 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 -- 172.21.15.172:0/1077367241 shutdown_connections 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55a6c5042920 0x55a6c5042d00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023ef0 0x55a6c503b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c4ffb410 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e527fc640 0 client.5652 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:45:02.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 --2- 172.21.15.172:0/1077367241 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c5023b10 0x55a6c501a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 -- 172.21.15.172:0/1077367241 >> 172.21.15.172:0/1077367241 conn(0x55a6c4ff6770 msgr2=0x55a6c5022d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 -- 172.21.15.172:0/1077367241 shutdown_connections 2024-04-25T08:45:02.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 1 -- 172.21.15.172:0/1077367241 wait complete. 2024-04-25T08:45:02.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.190+0000 7f7e7c977740 20 client.5652 trim_cache size 0 max 16384 2024-04-25T08:45:02.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.205+0000 7f7e7c977740 1 Processor -- start 2024-04-25T08:45:02.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.206+0000 7f7e7c977740 1 -- start start 2024-04-25T08:45:02.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.206+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c5041320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.206+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c5023b10 0x55a6c5041860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.206+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023ef0 0x55a6c4ff5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.206+0000 7f7e7c977740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6c505b360 con 0x55a6c4ffaf90 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.206+0000 7f7e7c977740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741fe0f0 con 0x55a6c5023ef0 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.206+0000 7f7e7c977740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741fd300 con 0x55a6c5023b10 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.206+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c5041320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.206+0000 7f7e737fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c5041320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54190/0 (socket says 172.21.15.172:54190) 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.206+0000 7f7e737fe640 1 -- 172.21.15.172:0/1604102355 learned_addr learned my addr 172.21.15.172:0/1604102355 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.207+0000 7f7e737fe640 1 -- 172.21.15.172:0/1604102355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c5023b10 msgr2=0x55a6c5041860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.207+0000 7f7e737fe640 1 --2- 172.21.15.172:0/1604102355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c5023b10 0x55a6c5041860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.207+0000 7f7e737fe640 1 -- 172.21.15.172:0/1604102355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023ef0 msgr2=0x55a6c4ff5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.207+0000 7f7e737fe640 1 --2- 172.21.15.172:0/1604102355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023ef0 0x55a6c4ff5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.207+0000 7f7e737fe640 1 -- 172.21.15.172:0/1604102355 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6c4c340f0 con 0x55a6c4ffaf90 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.207+0000 7f7e737fe640 1 --2- 172.21.15.172:0/1604102355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c5041320 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7e64035040 tx=0x7f7e6402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfadf7f2ae450c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.207+0000 7f7e58ff9640 1 -- 172.21.15.172:0/1604102355 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64037040 con 0x55a6c4ffaf90 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.207+0000 7f7e58ff9640 1 -- 172.21.15.172:0/1604102355 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64032cb0 con 0x55a6c4ffaf90 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.207+0000 7f7e58ff9640 1 -- 172.21.15.172:0/1604102355 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64032e60 con 0x55a6c4ffaf90 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 -- 172.21.15.172:0/1604102355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 msgr2=0x55a6c5041320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 --2- 172.21.15.172:0/1604102355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c5041320 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7e64035040 tx=0x7f7e6402c000 comp rx=0 tx=0).stop 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 -- 172.21.15.172:0/1604102355 shutdown_connections 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 --2- 172.21.15.172:0/1604102355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023ef0 0x55a6c4ff5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 --2- 172.21.15.172:0/1604102355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c5023b10 0x55a6c5041860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 --2- 172.21.15.172:0/1604102355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c4ffaf90 0x55a6c5041320 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 -- 172.21.15.172:0/1604102355 >> 172.21.15.172:0/1604102355 conn(0x55a6c4ff6770 msgr2=0x55a6c501a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 -- 172.21.15.172:0/1604102355 shutdown_connections 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 -- 172.21.15.172:0/1604102355 wait complete. 2024-04-25T08:45:02.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 -- start start 2024-04-25T08:45:02.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.208+0000 7f7e7c977740 1 Processor -- start 2024-04-25T08:45:02.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c4ffaf90 0x55a6c5041720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 0x55a6c5036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e7c977740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c50371f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e7c977740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740ae110 con 0x55a6c5023ef0 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e7c977740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740adb10 con 0x55a6c5023b10 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e7c977740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a6c4ffd870 con 0x55a6c4ffaf90 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e7c977740 10 client.0 _ll_register_callbacks cb 0x7f7e680070a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c50371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e73fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c50371f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54204/0 (socket says 172.21.15.172:54204) 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e73fff640 1 -- 172.21.15.172:0/60089283 learned_addr learned my addr 172.21.15.172:0/60089283 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e72ffd640 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 0x55a6c5036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.209+0000 7f7e737fe640 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c4ffaf90 0x55a6c5041720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e73fff640 1 -- 172.21.15.172:0/60089283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c4ffaf90 msgr2=0x55a6c5041720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e73fff640 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c4ffaf90 0x55a6c5041720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e73fff640 1 -- 172.21.15.172:0/60089283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 msgr2=0x55a6c5036cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e73fff640 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 0x55a6c5036cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e73fff640 1 -- 172.21.15.172:0/60089283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6c50499f0 con 0x55a6c5023ef0 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e72ffd640 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 0x55a6c5036cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e73fff640 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c50371f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c040 tx=0x7f7e6c088de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8970d556f7cb88ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e527fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e527fc640 1 -- 172.21.15.172:0/60089283 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c07b030 con 0x55a6c5023ef0 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e527fc640 1 -- 172.21.15.172:0/60089283 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f7e6c054f60 con 0x55a6c5023ef0 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e7c977740 1 -- 172.21.15.172:0/60089283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e64032cb0 con 0x55a6c5023ef0 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e527fc640 1 -- 172.21.15.172:0/60089283 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e6c055880 con 0x55a6c5023ef0 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e7c977740 10 client.5658 fetch_fsmap learned FSMap version 16 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e7c977740 1 -- 172.21.15.172:0/60089283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a6c502a030 con 0x55a6c5023ef0 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e527fc640 1 -- 172.21.15.172:0/60089283 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64032cb0 con 0x55a6c5023ef0 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e527fc640 1 -- 172.21.15.172:0/60089283 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7e6c077070 con 0x55a6c5023ef0 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e7c977740 10 client.5658 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T08:45:02.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e7c977740 10 client.5658 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e7c977740 20 client.5658 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e7c977740 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55a6c4ffdbc0 0x55a6c5037730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e7c977740 4 client.5658 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e7c977740 1 -- 172.21.15.172:0/60089283 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a6c4f67630 con 0x55a6c4ffdbc0 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.210+0000 7f7e737fe640 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55a6c4ffdbc0 0x55a6c5037730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e527fc640 10 client.5658 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e737fe640 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55a6c4ffdbc0 0x55a6c5037730 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b07eef90f94b3525 server_cookie=fa313ebf855bf4a0 in_seq=0 out_seq=0 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e527fc640 1 -- 172.21.15.172:0/60089283 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a6c4f67630 con 0x55a6c4ffdbc0 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e527fc640 10 client.5658 handle_command_reply: tid=0 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 client.5658 shutdown 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 -- 172.21.15.172:0/60089283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 msgr2=0x55a6c50371f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c50371f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c040 tx=0x7f7e6c088de0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 -- 172.21.15.172:0/60089283 shutdown_connections 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55a6c4ffdbc0 0x55a6c5037730 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a6c5023b10 0x55a6c5036cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6c5023ef0 0x55a6c50371f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e527fc640 0 client.5658 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:45:02.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 --2- 172.21.15.172:0/60089283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a6c4ffaf90 0x55a6c5041720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 -- 172.21.15.172:0/60089283 >> 172.21.15.172:0/60089283 conn(0x55a6c4ff6770 msgr2=0x55a6c5026350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 -- 172.21.15.172:0/60089283 shutdown_connections 2024-04-25T08:45:02.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 1 -- 172.21.15.172:0/60089283 wait complete. 2024-04-25T08:45:02.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.211+0000 7f7e7c977740 20 client.5658 trim_cache size 0 max 16384 2024-04-25T08:45:02.209 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:02.209 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "no active scrubs running", 2024-04-25T08:45:02.209 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": {} 2024-04-25T08:45:02.209 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:02.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 -- 172.21.15.172:0/951209466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7e6006b4d0 msgr2=0x7f7e6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7e6006b4d0 0x7f7e6006d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e64034000 tx=0x7f7e6402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:02.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 -- 172.21.15.172:0/951209466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e74144d50 msgr2=0x7f7e74139270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e74144d50 0x7f7e74139270 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c007e40 tx=0x7f7e6c00e4b0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 -- 172.21.15.172:0/951209466 shutdown_connections 2024-04-25T08:45:02.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7e6006b4d0 0x7f7e6006d990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e74144d50 0x7f7e74139270 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e741446d0 0x7f7e74138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 --2- 172.21.15.172:0/951209466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e7406e8a0 0x7f7e741f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 -- 172.21.15.172:0/951209466 >> 172.21.15.172:0/951209466 conn(0x7f7e7406abe0 msgr2=0x7f7e7406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 -- 172.21.15.172:0/951209466 shutdown_connections 2024-04-25T08:45:02.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.212+0000 7f7e79c7c640 1 -- 172.21.15.172:0/951209466 wait complete. 2024-04-25T08:45:02.214 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:45:02.214 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:02.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-04-25T08:45:02.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.322+0000 7fd4349d5640 1 Processor -- start 2024-04-25T08:45:02.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.322+0000 7fd4349d5640 1 -- start start 2024-04-25T08:45:02.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd4349d5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd4300cc4f0 0x7fd4300cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd4349d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd4300cdb20 0x7fd4300cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd4349d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd43015b270 0x7fd43015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd4349d5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd430071270 con 0x7fd4300cdb20 2024-04-25T08:45:02.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd4349d5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd430072280 con 0x7fd4300cc4f0 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd4349d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300714c0 con 0x7fd43015b270 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd427fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd4300cdb20 0x7fd4300cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd427fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd4300cdb20 0x7fd4300cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54214/0 (socket says 172.21.15.172:54214) 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd427fff640 1 -- 172.21.15.172:0/1219226013 learned_addr learned my addr 172.21.15.172:0/1219226013 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1219226013 >> v2:172.21.15.186:3300/0 conn(0x7fd4300cc4f0 0x7fd4300cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd42ed9d640 1 --2- 172.21.15.172:0/1219226013 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd43015b270 0x7fd43015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd427fff640 1 -- 172.21.15.172:0/1219226013 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd43015b270 msgr2=0x7fd43015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd427fff640 1 --2- 172.21.15.172:0/1219226013 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd43015b270 0x7fd43015b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd427fff640 1 -- 172.21.15.172:0/1219226013 >> v2:172.21.15.186:3300/0 conn(0x7fd4300cc4f0 msgr2=0x7fd4300cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd427fff640 1 --2- 172.21.15.172:0/1219226013 >> v2:172.21.15.186:3300/0 conn(0x7fd4300cc4f0 0x7fd4300cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.323+0000 7fd427fff640 1 -- 172.21.15.172:0/1219226013 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4300717a0 con 0x7fd4300cdb20 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.324+0000 7fd427fff640 1 --2- 172.21.15.172:0/1219226013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4300cdb20 0x7fd4300cdfb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd4300cd290 tx=0x7fd41802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1f35770d62b021 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.324+0000 7fd42dd9b640 1 -- 172.21.15.172:0/1219226013 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418037070 con 0x7fd4300cdb20 2024-04-25T08:45:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.324+0000 7fd42dd9b640 1 -- 172.21.15.172:0/1219226013 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd418032440 con 0x7fd4300cdb20 2024-04-25T08:45:02.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.324+0000 7fd42dd9b640 1 -- 172.21.15.172:0/1219226013 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418032810 con 0x7fd4300cdb20 2024-04-25T08:45:02.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.324+0000 7fd4349d5640 1 -- 172.21.15.172:0/1219226013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4300cdb20 msgr2=0x7fd4300cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.324+0000 7fd4349d5640 1 --2- 172.21.15.172:0/1219226013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4300cdb20 0x7fd4300cdfb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd4300cd290 tx=0x7fd41802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.325+0000 7fd4349d5640 1 -- 172.21.15.172:0/1219226013 shutdown_connections 2024-04-25T08:45:02.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.325+0000 7fd4349d5640 1 --2- 172.21.15.172:0/1219226013 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd43015b270 0x7fd43015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.325+0000 7fd4349d5640 1 --2- 172.21.15.172:0/1219226013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4300cdb20 0x7fd4300cdfb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.325+0000 7fd4349d5640 1 --2- 172.21.15.172:0/1219226013 >> v2:172.21.15.186:3300/0 conn(0x7fd4300cc4f0 0x7fd4300cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.325+0000 7fd4349d5640 1 -- 172.21.15.172:0/1219226013 >> 172.21.15.172:0/1219226013 conn(0x7fd43006abe0 msgr2=0x7fd43006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.325+0000 7fd4349d5640 1 -- 172.21.15.172:0/1219226013 shutdown_connections 2024-04-25T08:45:02.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.325+0000 7fd4349d5640 1 -- 172.21.15.172:0/1219226013 wait complete. 2024-04-25T08:45:02.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.326+0000 7fd4349d5640 1 Processor -- start 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.326+0000 7fd4349d5640 1 -- start start 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd4349d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300cc4f0 0x7fd430146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd4349d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4300cdb20 0x7fd4300cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd4349d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43015b270 0x7fd4300cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd4349d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43015bc00 con 0x7fd43015b270 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd4349d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd430071d60 con 0x7fd4300cdb20 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd4349d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43015bd80 con 0x7fd4300cc4f0 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43015b270 0x7fd4300cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43015b270 0x7fd4300cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54230/0 (socket says 172.21.15.172:54230) 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42ed9d640 1 -- 172.21.15.172:0/1820634152 learned_addr learned my addr 172.21.15.172:0/1820634152 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300cc4f0 0x7fd430146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd427fff640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4300cdb20 0x7fd4300cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42ed9d640 1 -- 172.21.15.172:0/1820634152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300cc4f0 msgr2=0x7fd430146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42ed9d640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300cc4f0 0x7fd430146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42ed9d640 1 -- 172.21.15.172:0/1820634152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4300cdb20 msgr2=0x7fd4300cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42ed9d640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4300cdb20 0x7fd4300cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42ed9d640 1 -- 172.21.15.172:0/1820634152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430154e90 con 0x7fd43015b270 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300cc4f0 0x7fd430146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd427fff640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4300cdb20 0x7fd4300cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd42ed9d640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43015b270 0x7fd4300cfc50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd428007e40 tx=0x7fd42800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd426ffd640 1 -- 172.21.15.172:0/1820634152 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428014620 con 0x7fd43015b270 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd426ffd640 1 -- 172.21.15.172:0/1820634152 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd428019070 con 0x7fd43015b270 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd4349d5640 1 -- 172.21.15.172:0/1820634152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd430153df0 con 0x7fd43015b270 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd426ffd640 1 -- 172.21.15.172:0/1820634152 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428014a20 con 0x7fd43015b270 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.327+0000 7fd4349d5640 1 -- 172.21.15.172:0/1820634152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4301543b0 con 0x7fd43015b270 2024-04-25T08:45:02.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.329+0000 7fd426ffd640 1 -- 172.21.15.172:0/1820634152 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd428014bc0 con 0x7fd43015b270 2024-04-25T08:45:02.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.329+0000 7fd426ffd640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b4d0 0x7fd41006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.329+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b4d0 0x7fd41006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.330+0000 7fd426ffd640 1 -- 172.21.15.172:0/1820634152 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7fd42808ac00 con 0x7fd43015b270 2024-04-25T08:45:02.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.330+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b4d0 0x7fd41006d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd42000ba50 tx=0x7fd420008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.330+0000 7fd4377b1740 1 Processor -- start 2024-04-25T08:45:02.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.331+0000 7fd4377b1740 1 -- start start 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.331+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee09e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.331+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 0x55c16ee08080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.331+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee32760 0x55c16ee32be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.331+0000 7fd4377b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16ed6ab90 con 0x55c16ee07ca0 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.331+0000 7fd4377b1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16ed13e40 con 0x55c16ee44370 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.331+0000 7fd4377b1740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c16ed66c30 con 0x55c16ee32760 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.331+0000 7fd42e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee09e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.331+0000 7fd42e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee09e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54238/0 (socket says 172.21.15.172:54238) 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.331+0000 7fd42e59c640 1 -- 172.21.15.172:0/3613767168 learned_addr learned my addr 172.21.15.172:0/3613767168 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.332+0000 7fd42e59c640 1 -- 172.21.15.172:0/3613767168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee32760 msgr2=0x55c16ee32be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.332+0000 7fd42e59c640 1 --2- 172.21.15.172:0/3613767168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee32760 0x55c16ee32be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.332+0000 7fd42e59c640 1 -- 172.21.15.172:0/3613767168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 msgr2=0x55c16ee08080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.332+0000 7fd42e59c640 1 --2- 172.21.15.172:0/3613767168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 0x55c16ee08080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.332+0000 7fd42e59c640 1 -- 172.21.15.172:0/3613767168 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c16eb497d0 con 0x55c16ee07ca0 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.332+0000 7fd42e59c640 1 --2- 172.21.15.172:0/3613767168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee09e00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd42000fb40 tx=0x7fd420012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2e7d57239472e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.332+0000 7fd40ffff640 1 -- 172.21.15.172:0/3613767168 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42001b050 con 0x55c16ee07ca0 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.332+0000 7fd40ffff640 1 -- 172.21.15.172:0/3613767168 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420025070 con 0x55c16ee07ca0 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.332+0000 7fd40ffff640 1 -- 172.21.15.172:0/3613767168 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420020440 con 0x55c16ee07ca0 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 -- 172.21.15.172:0/3613767168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 msgr2=0x55c16ee09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 --2- 172.21.15.172:0/3613767168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee09e00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd42000fb40 tx=0x7fd420012000 comp rx=0 tx=0).stop 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 -- 172.21.15.172:0/3613767168 shutdown_connections 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 --2- 172.21.15.172:0/3613767168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 0x55c16ee08080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 --2- 172.21.15.172:0/3613767168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee32760 0x55c16ee32be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 --2- 172.21.15.172:0/3613767168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee09e00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 -- 172.21.15.172:0/3613767168 >> 172.21.15.172:0/3613767168 conn(0x55c16edcf870 msgr2=0x55c16ee4d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 -- 172.21.15.172:0/3613767168 shutdown_connections 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 -- 172.21.15.172:0/3613767168 wait complete. 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 -- start start 2024-04-25T08:45:02.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.333+0000 7fd4377b1740 1 Processor -- start 2024-04-25T08:45:02.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee07ca0 0x55c16ee2e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16ee4e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee44370 0x55c16ee34720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd4377b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16ed273e0 con 0x55c16ee32760 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd4377b1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16ee302b0 con 0x55c16ee07ca0 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd4377b1740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c16ee5e8a0 con 0x55c16ee44370 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd4377b1740 10 client.0 _ll_register_callbacks cb 0x55c16ed26db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd427fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16ee4e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd427fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16ee4e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54244/0 (socket says 172.21.15.172:54244) 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd427fff640 1 -- 172.21.15.172:0/2201676515 learned_addr learned my addr 172.21.15.172:0/2201676515 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd42e59c640 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee07ca0 0x55c16ee2e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.334+0000 7fd42ed9d640 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee44370 0x55c16ee34720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd427fff640 1 -- 172.21.15.172:0/2201676515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee44370 msgr2=0x55c16ee34720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd427fff640 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee44370 0x55c16ee34720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd427fff640 1 -- 172.21.15.172:0/2201676515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee07ca0 msgr2=0x55c16ee2e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd427fff640 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee07ca0 0x55c16ee2e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd427fff640 1 -- 172.21.15.172:0/2201676515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c16ea3f0f0 con 0x55c16ee32760 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd42ed9d640 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee44370 0x55c16ee34720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd427fff640 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16ee4e890 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd41802a7d0 tx=0x7fd4180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dbd33716a0e122 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd40d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd40d7fa640 1 -- 172.21.15.172:0/2201676515 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418041070 con 0x55c16ee32760 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd40d7fa640 1 -- 172.21.15.172:0/2201676515 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7fd41803c660 con 0x55c16ee32760 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd4377b1740 1 -- 172.21.15.172:0/2201676515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd420025070 con 0x55c16ee32760 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd40d7fa640 1 -- 172.21.15.172:0/2201676515 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd418049050 con 0x55c16ee32760 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd4377b1740 10 client.5670 fetch_fsmap learned FSMap version 16 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd4377b1740 1 -- 172.21.15.172:0/2201676515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c16eba9f60 con 0x55c16ee32760 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd40d7fa640 1 -- 172.21.15.172:0/2201676515 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420025070 con 0x55c16ee32760 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd40d7fa640 1 -- 172.21.15.172:0/2201676515 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd41804c020 con 0x55c16ee32760 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd4377b1740 10 client.5670 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd4377b1740 10 client.5670 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:45:02.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd4377b1740 20 client.5670 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd4377b1740 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55c16ee32be0 0x55c16ee32fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd4377b1740 4 client.5670 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.335+0000 7fd4377b1740 1 -- 172.21.15.172:0/2201676515 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c16ed780d0 con 0x55c16ee32be0 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.336+0000 7fd42e59c640 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55c16ee32be0 0x55c16ee32fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.336+0000 7fd42e59c640 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55c16ee32be0 0x55c16ee32fc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=453b8141765b7df server_cookie=a5c9844f0af76315 in_seq=0 out_seq=0 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.336+0000 7fd40d7fa640 10 client.5670 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.336+0000 7fd40d7fa640 1 -- 172.21.15.172:0/2201676515 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c16ed780d0 con 0x55c16ee32be0 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.336+0000 7fd40d7fa640 10 client.5670 handle_command_reply: tid=0 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.336+0000 7fd4377b1740 1 client.5670 shutdown 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.336+0000 7fd4377b1740 1 -- 172.21.15.172:0/2201676515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 msgr2=0x55c16ee4e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.336+0000 7fd4377b1740 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16ee4e890 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd41802a7d0 tx=0x7fd4180046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.337+0000 7fd4377b1740 1 -- 172.21.15.172:0/2201676515 shutdown_connections 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.337+0000 7fd4377b1740 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55c16ee32be0 0x55c16ee32fc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.337+0000 7fd4377b1740 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee44370 0x55c16ee34720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.337+0000 7fd4377b1740 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16ee4e890 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.337+0000 7fd4377b1740 1 --2- 172.21.15.172:0/2201676515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee07ca0 0x55c16ee2e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.337+0000 7fd40d7fa640 0 client.5670 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:45:02.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.337+0000 7fd4377b1740 1 -- 172.21.15.172:0/2201676515 >> 172.21.15.172:0/2201676515 conn(0x55c16edcf870 msgr2=0x55c16ee30490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.337+0000 7fd4377b1740 1 -- 172.21.15.172:0/2201676515 shutdown_connections 2024-04-25T08:45:02.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.337+0000 7fd4377b1740 1 -- 172.21.15.172:0/2201676515 wait complete. 2024-04-25T08:45:02.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.337+0000 7fd4377b1740 20 client.5670 trim_cache size 0 max 16384 2024-04-25T08:45:02.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.351+0000 7fd4377b1740 1 Processor -- start 2024-04-25T08:45:02.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.351+0000 7fd4377b1740 1 -- start start 2024-04-25T08:45:02.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee32fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee32760 0x55c16ee33500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 0x55c16ee46780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd4377b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16ee369e0 con 0x55c16ee07ca0 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd4377b1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301fe2a0 con 0x55c16ee44370 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd4377b1740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301fd400 con 0x55c16ee32760 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd42e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee32fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd42e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee32fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54260/0 (socket says 172.21.15.172:54260) 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd42e59c640 1 -- 172.21.15.172:0/2473327947 learned_addr learned my addr 172.21.15.172:0/2473327947 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd42e59c640 1 -- 172.21.15.172:0/2473327947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee32760 msgr2=0x55c16ee33500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd42e59c640 1 --2- 172.21.15.172:0/2473327947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee32760 0x55c16ee33500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd42e59c640 1 -- 172.21.15.172:0/2473327947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 msgr2=0x55c16ee46780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd42e59c640 1 --2- 172.21.15.172:0/2473327947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 0x55c16ee46780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd42e59c640 1 -- 172.21.15.172:0/2473327947 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c16ea181b0 con 0x55c16ee07ca0 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd42e59c640 1 --2- 172.21.15.172:0/2473327947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee32fc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd420021000 tx=0x7fd42001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccfda9c10f667ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd40f7fe640 1 -- 172.21.15.172:0/2473327947 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42001b040 con 0x55c16ee07ca0 2024-04-25T08:45:02.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd40f7fe640 1 -- 172.21.15.172:0/2473327947 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42003c070 con 0x55c16ee07ca0 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.352+0000 7fd40f7fe640 1 -- 172.21.15.172:0/2473327947 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200378a0 con 0x55c16ee07ca0 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.353+0000 7fd4377b1740 1 -- 172.21.15.172:0/2473327947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 msgr2=0x55c16ee32fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.353+0000 7fd4377b1740 1 --2- 172.21.15.172:0/2473327947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee32fc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd420021000 tx=0x7fd42001e000 comp rx=0 tx=0).stop 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.353+0000 7fd4377b1740 1 -- 172.21.15.172:0/2473327947 shutdown_connections 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.353+0000 7fd4377b1740 1 --2- 172.21.15.172:0/2473327947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 0x55c16ee46780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.353+0000 7fd4377b1740 1 --2- 172.21.15.172:0/2473327947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee32760 0x55c16ee33500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.353+0000 7fd4377b1740 1 --2- 172.21.15.172:0/2473327947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee07ca0 0x55c16ee32fc0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.353+0000 7fd4377b1740 1 -- 172.21.15.172:0/2473327947 >> 172.21.15.172:0/2473327947 conn(0x55c16edcf870 msgr2=0x55c16ee6fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.353+0000 7fd4377b1740 1 -- 172.21.15.172:0/2473327947 shutdown_connections 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.353+0000 7fd4377b1740 1 -- 172.21.15.172:0/2473327947 wait complete. 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.354+0000 7fd4377b1740 1 -- start start 2024-04-25T08:45:02.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.354+0000 7fd4377b1740 1 Processor -- start 2024-04-25T08:45:02.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.354+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee07ca0 0x55c16eebb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.354+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16eeb5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.354+0000 7fd4377b1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 0x55c16ee66ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.354+0000 7fd4377b1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301fce00 con 0x55c16ee32760 2024-04-25T08:45:02.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.354+0000 7fd4377b1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4301538b0 con 0x55c16ee44370 2024-04-25T08:45:02.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd4377b1740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c16eebc0f0 con 0x55c16ee07ca0 2024-04-25T08:45:02.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd4377b1740 10 client.0 _ll_register_callbacks cb 0x7fd418035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:02.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd427fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16eeb5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd427fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16eeb5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54276/0 (socket says 172.21.15.172:54276) 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd427fff640 1 -- 172.21.15.172:0/1735449038 learned_addr learned my addr 172.21.15.172:0/1735449038 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee07ca0 0x55c16eebb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd42ed9d640 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 0x55c16ee66ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd427fff640 1 -- 172.21.15.172:0/1735449038 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee07ca0 msgr2=0x55c16eebb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd427fff640 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee07ca0 0x55c16eebb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd427fff640 1 -- 172.21.15.172:0/1735449038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 msgr2=0x55c16ee66ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd427fff640 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 0x55c16ee66ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd427fff640 1 -- 172.21.15.172:0/1735449038 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c16eeb5c50 con 0x55c16ee32760 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd427fff640 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16eeb5710 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd41802a220 tx=0x7fd418009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21507cddd12adb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd40d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd40d7fa640 1 -- 172.21.15.172:0/1735449038 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418052060 con 0x55c16ee32760 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd40d7fa640 1 -- 172.21.15.172:0/1735449038 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7fd41803cd70 con 0x55c16ee32760 2024-04-25T08:45:02.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd4377b1740 1 -- 172.21.15.172:0/1735449038 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd42003c070 con 0x55c16ee32760 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd40d7fa640 1 -- 172.21.15.172:0/1735449038 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd418058050 con 0x55c16ee32760 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd4377b1740 10 client.5676 fetch_fsmap learned FSMap version 16 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.355+0000 7fd4377b1740 1 -- 172.21.15.172:0/1735449038 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c16ee32250 con 0x55c16ee32760 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd40d7fa640 1 -- 172.21.15.172:0/1735449038 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42003c070 con 0x55c16ee32760 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd40d7fa640 1 -- 172.21.15.172:0/1735449038 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd41805b020 con 0x55c16ee32760 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd4377b1740 10 client.5676 fetch_fsmap finished waiting for FSMap version 16 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd4377b1740 10 client.5676 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd4377b1740 20 client.5676 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd4377b1740 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55c16ee67010 0x55c16ee32fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd4377b1740 4 client.5676 mds_command: new command op to 5340 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd4377b1740 1 -- 172.21.15.172:0/1735449038 --> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x55c16ed72420 con 0x55c16ee67010 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55c16ee67010 0x55c16ee32fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd40d7fa640 10 client.5676 ms_handle_connect on v2:172.21.15.172:6835/3537703238 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.356+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55c16ee67010 0x55c16ee32fc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab2e5766b22173e8 server_cookie=a152f79016acf24b in_seq=0 out_seq=0 2024-04-25T08:45:02.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd40d7fa640 1 -- 172.21.15.172:0/1735449038 <== mds.0 v2:172.21.15.172:6835/3537703238 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17931 (crc 0 0 0) 0x55c16ed72420 con 0x55c16ee67010 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd40d7fa640 10 client.5676 handle_command_reply: tid=0 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 client.5676 shutdown 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 -- 172.21.15.172:0/1735449038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 msgr2=0x55c16eeb5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16eeb5710 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd41802a220 tx=0x7fd418009240 comp rx=0 tx=0).stop 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 -- 172.21.15.172:0/1735449038 shutdown_connections 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.172:6835/3537703238,v1:172.21.15.172:6837/3537703238] conn(0x55c16ee67010 0x55c16ee32fc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c16ee44370 0x55c16ee66ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd40d7fa640 0 client.5676 ms_handle_reset on v2:172.21.15.172:6835/3537703238 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c16ee32760 0x55c16eeb5710 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 --2- 172.21.15.172:0/1735449038 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c16ee07ca0 0x55c16eebb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 -- 172.21.15.172:0/1735449038 >> 172.21.15.172:0/1735449038 conn(0x55c16edcf870 msgr2=0x55c16ee2e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 -- 172.21.15.172:0/1735449038 shutdown_connections 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 1 -- 172.21.15.172:0/1735449038 wait complete. 2024-04-25T08:45:02.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.357+0000 7fd4377b1740 20 client.5676 trim_cache size 0 max 16384 2024-04-25T08:45:02.355 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:02.355 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T08:45:02.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1869, 2024-04-25T08:45:02.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1862, 2024-04-25T08:45:02.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 573079, 2024-04-25T08:45:02.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 17150142, 2024-04-25T08:45:02.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 16, 2024-04-25T08:45:02.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.192963868, 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.089545916, 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.046471853, 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.048906682, 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1862, 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.207862626, 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000111634 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 10, 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000001328, 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000132 2024-04-25T08:45:02.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 121872, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 25504 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 2303, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2324, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 583410, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 21629444, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.259670945, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.147304086, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.037890075, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.062433306, 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:45:02.357 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2323, 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.353963674, 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000152373 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 117520 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 30879, 2024-04-25T08:45:02.358 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 53261, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 9964969, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 74979580, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 3.047120284, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 2.299989595, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.922883114, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.107865338, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 53260, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.324344284, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000024865 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:45:02.359 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 48876, 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.007665546, 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000156 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-04-25T08:45:02.360 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2357, 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 17.291710681, 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.007336321 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3819, 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.111458712, 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000291033 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 25384, 2024-04-25T08:45:02.361 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 25384, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 25384, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 427.163744767, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.016828070 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 12, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 17853, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-04-25T08:45:02.362 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 17853, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 17853, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 2, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 2, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 45889, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 45492, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 102, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-04-25T08:45:02.363 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 1683, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 1683, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 13, 2024-04-25T08:45:02.364 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 2, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 11, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 1670, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 894, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 4030, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 3670, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 3257, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 61, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 13898 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.365 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-04-25T08:45:02.366 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-04-25T08:45:02.366 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-04-25T08:45:02.366 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-04-25T08:45:02.366 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-04-25T08:45:02.366 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-04-25T08:45:02.366 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-04-25T08:45:02.366 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-04-25T08:45:02.366 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-04-25T08:45:02.366 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 4099, 2024-04-25T08:45:02.366 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 3523, 2024-04-25T08:45:02.394 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 2195, 2024-04-25T08:45:02.394 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-04-25T08:45:02.394 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-04-25T08:45:02.394 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-04-25T08:45:02.394 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-04-25T08:45:02.394 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 1, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 25952, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-04-25T08:45:02.395 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 25952, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 35, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 35, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 4, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 96154213, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2474, 2024-04-25T08:45:02.396 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 107.684835349, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.043526610 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 14, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 2016, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 2002, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 13, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 13, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 0, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 17853, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 19854, 2024-04-25T08:45:02.397 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 2001, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 2, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 8386, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 8384, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 102756, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215396 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 28163, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 25384, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 5, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-04-25T08:45:02.398 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2000, 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.322260785, 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000661130 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 29, 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.005365763, 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000185026 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6000, 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 6.999803756, 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001166633 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7147, 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 6.042087969, 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000845401 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000040571, 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000040571 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-04-25T08:45:02.402 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.003103212, 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003103212 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.210398506, 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.210398506 2024-04-25T08:45:02.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8, 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.660981837, 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.207622729 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2195, 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 394.351144870, 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.179658835 2024-04-25T08:45:02.404 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.405 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-04-25T08:45:02.405 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.405 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.405 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.405 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-04-25T08:45:02.405 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.405 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.405 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.405 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.406 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-04-25T08:45:02.406 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.406 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.406 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.407 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-04-25T08:45:02.407 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:45:02.407 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.037188689, 2024-04-25T08:45:02.407 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.037188689 2024-04-25T08:45:02.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.407 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-04-25T08:45:02.407 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.407 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.407 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000246412, 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000246412 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.408 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.409 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8000, 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 16.531122397, 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002066390 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:02.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 1, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 18652, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 18652, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 73, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-04-25T08:45:02.411 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-04-25T08:45:02.412 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T08:45:02.413 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-04-25T08:45:02.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-04-25T08:45:02.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-04-25T08:45:02.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-04-25T08:45:02.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T08:45:02.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-04-25T08:45:02.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T08:45:02.414 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 250233, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 92, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 440, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 5, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 5624, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 80, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T08:45:02.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 13443045, 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 661016, 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-04-25T08:45:02.416 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 7943, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 92618860, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 37, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 7943, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7943, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 30.590258155, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003851222 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7943, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 8034 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 7943, 2024-04-25T08:45:02.417 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 1746, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 6197, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 11, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 61, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 2533, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 38, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 1523, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 2033, 2024-04-25T08:45:02.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1685, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 22, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-04-25T08:45:02.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-04-25T08:45:02.420 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 42, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 5, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 8, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 8, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 100, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 28 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.421 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-04-25T08:45:02.422 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 32, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 3523, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 3523, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 35046, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 8393809, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 35046, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 35046, 2024-04-25T08:45:02.423 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 8393809, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-04-25T08:45:02.424 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 7943, 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 92986867, 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 7943, 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 92986867, 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:45:02.425 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 7943, 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 7943, 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 7943, 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 7943, 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:02.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 3523, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 368007, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 3523, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 59, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 368007, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.427 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x564ae611a6e0": { 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 25952, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 91959909, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 25952, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2474, 2024-04-25T08:45:02.428 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 91959909, 2024-04-25T08:45:02.429 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:45:02.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:45:02.429 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:45:02.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:45:02.429 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:02.429 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:02.429 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:02.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 -- 172.21.15.172:0/1820634152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b4d0 msgr2=0x7fd41006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b4d0 0x7fd41006d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd42000ba50 tx=0x7fd420008040 comp rx=0 tx=0).stop 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 -- 172.21.15.172:0/1820634152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43015b270 msgr2=0x7fd4300cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43015b270 0x7fd4300cfc50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd428007e40 tx=0x7fd42800e4b0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 -- 172.21.15.172:0/1820634152 shutdown_connections 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b4d0 0x7fd41006d990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4300cdb20 0x7fd4300cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43015b270 0x7fd4300cfc50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 --2- 172.21.15.172:0/1820634152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300cc4f0 0x7fd430146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 -- 172.21.15.172:0/1820634152 >> 172.21.15.172:0/1820634152 conn(0x7fd43006abe0 msgr2=0x7fd43015d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 -- 172.21.15.172:0/1820634152 shutdown_connections 2024-04-25T08:45:02.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.358+0000 7fd4349d5640 1 -- 172.21.15.172:0/1820634152 wait complete. 2024-04-25T08:45:02.432 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:45:02.432 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:45:02.478 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:45:02.526 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:45:02.526 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:02.526 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:02.541 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:02.541 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:02.597 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:02.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.741+0000 7f916762a640 1 Processor -- start 2024-04-25T08:45:02.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.741+0000 7f916762a640 1 -- start start 2024-04-25T08:45:02.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f916762a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f916015dbe0 0x7f91600d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f916762a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91600b6220 con 0x7f91600b92a0 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f916762a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91600b97a0 con 0x7f91600b2cb0 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f916762a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916015dfc0 con 0x7f916015dbe0 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9165bc7640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f91600b92a0 0x7f91600b5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41696/0 (socket says 172.21.15.172:41696) 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9165bc7640 1 -- 172.21.15.172:0/2834029847 learned_addr learned my addr 172.21.15.172:0/2834029847 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f91653c6640 1 --2- 172.21.15.172:0/2834029847 >> v2:172.21.15.186:3300/0 conn(0x7f916015dbe0 0x7f91600d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520842899 0 0) 0x7f91600b6220 con 0x7f91600b92a0 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f914c003520 con 0x7f91600b92a0 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1727287652 0 0) 0x7f914c003520 con 0x7f91600b92a0 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 >> v2:172.21.15.186:3300/0 conn(0x7f916015dbe0 msgr2=0x7f91600d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9157fff640 1 --2- 172.21.15.172:0/2834029847 >> v2:172.21.15.186:3300/0 conn(0x7f916015dbe0 0x7f91600d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 >> v1:172.21.15.186:6789/0 conn(0x7f91600b2cb0 legacy=0x7f91600b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600d1c50 con 0x7f91600b92a0 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f91580019f0 con 0x7f91600b92a0 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.742+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 >> v1:172.21.15.172:6789/0 conn(0x7f91600b92a0 legacy=0x7f91600b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9157fff640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f914c0039b0 0x7f914c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9157fff640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f914c004800 0x7f914c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9157fff640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f914c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c00c130 con 0x7f914c0051c0 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c00c2e0 con 0x7f914c0039b0 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c00c4e0 con 0x7f914c004800 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9165bc7640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f914c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f91653c6640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f914c0039b0 0x7f914c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9164bc5640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f914c004800 0x7f914c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9165bc7640 1 -- 172.21.15.172:0/2834029847 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f914c004800 msgr2=0x7f914c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9165bc7640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f914c004800 0x7f914c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9165bc7640 1 -- 172.21.15.172:0/2834029847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f914c0039b0 msgr2=0x7f914c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9165bc7640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f914c0039b0 0x7f914c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.743+0000 7f9165bc7640 1 -- 172.21.15.172:0/2834029847 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c003520 con 0x7f914c0051c0 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f9165bc7640 1 -- 172.21.15.172:0/2834029847 reap_dead start 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f9165bc7640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f914c00b9c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f915800a830 tx=0x7f914c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844bab52f68d523d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915800a480 con 0x7f914c0051c0 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915802f070 con 0x7f914c0051c0 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f9157fff640 1 -- 172.21.15.172:0/2834029847 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915802bc90 con 0x7f914c0051c0 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f916762a640 1 -- 172.21.15.172:0/2834029847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 msgr2=0x7f914c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f916762a640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f914c00b9c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f915800a830 tx=0x7f914c005830 comp rx=0 tx=0).stop 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f916762a640 1 -- 172.21.15.172:0/2834029847 shutdown_connections 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f916762a640 1 --2- 172.21.15.172:0/2834029847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f914c00b9c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f916762a640 1 -- 172.21.15.172:0/2834029847 >> 172.21.15.172:0/2834029847 conn(0x7f9160061a20 msgr2=0x7f9160061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f916762a640 1 -- 172.21.15.172:0/2834029847 shutdown_connections 2024-04-25T08:45:02.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.744+0000 7f916762a640 1 -- 172.21.15.172:0/2834029847 wait complete. 2024-04-25T08:45:02.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.745+0000 7f916762a640 1 Processor -- start 2024-04-25T08:45:02.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f916762a640 1 -- start start 2024-04-25T08:45:02.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f916762a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f9160160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f916762a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f916015ea80 0x7f916014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f916762a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f916015c860 0x7f916015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f916762a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91600d2210 con 0x7f914c0051c0 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f916762a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91600d1a00 con 0x7f916015c860 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f916762a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91600b6ab0 con 0x7f916015ea80 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f91653c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f9160160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f91653c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f9160160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54290/0 (socket says 172.21.15.172:54290) 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f91653c6640 1 -- 172.21.15.172:0/3155475980 learned_addr learned my addr 172.21.15.172:0/3155475980 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f9164bc5640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f916015ea80 0x7f916014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.746+0000 7f9165bc7640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f916015c860 0x7f916015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f91653c6640 1 -- 172.21.15.172:0/3155475980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f916015ea80 msgr2=0x7f916014fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f91653c6640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f916015ea80 0x7f916014fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f91653c6640 1 -- 172.21.15.172:0/3155475980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f916015c860 msgr2=0x7f916015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f91653c6640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f916015c860 0x7f916015cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f91653c6640 1 -- 172.21.15.172:0/3155475980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160160290 con 0x7f914c0051c0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f91653c6640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f9160160b10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f915c0118e0 tx=0x7f915c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f9155ffb640 1 -- 172.21.15.172:0/3155475980 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c00fa90 con 0x7f914c0051c0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f9155ffb640 1 -- 172.21.15.172:0/3155475980 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c00fc30 con 0x7f914c0051c0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f916762a640 1 -- 172.21.15.172:0/3155475980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916015f1f0 con 0x7f914c0051c0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f9155ffb640 1 -- 172.21.15.172:0/3155475980 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c014440 con 0x7f914c0051c0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.747+0000 7f916762a640 1 -- 172.21.15.172:0/3155475980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916015f7b0 con 0x7f914c0051c0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.748+0000 7f916762a640 1 -- 172.21.15.172:0/3155475980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9160073990 con 0x7f914c0051c0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.748+0000 7f9155ffb640 1 -- 172.21.15.172:0/3155475980 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f915c012040 con 0x7f914c0051c0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.749+0000 7f9155ffb640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f914406b4d0 0x7f914406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.749+0000 7f9155ffb640 1 -- 172.21.15.172:0/3155475980 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f915c08a960 con 0x7f914c0051c0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.749+0000 7f9164bc5640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f914406b4d0 0x7f914406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:02.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.749+0000 7f9164bc5640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f914406b4d0 0x7f914406d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f916015c710 tx=0x7f9150009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:02.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.753+0000 7f9155ffb640 1 -- 172.21.15.172:0/3155475980 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f915c019030 con 0x7f914c0051c0 2024-04-25T08:45:02.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.925+0000 7f916762a640 1 -- 172.21.15.172:0/3155475980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91600b8060 con 0x7f914c0051c0 2024-04-25T08:45:02.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.926+0000 7f9155ffb640 1 -- 172.21.15.172:0/3155475980 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17060 (secure 0 0 0) 0x7f915c0596b0 con 0x7f914c0051c0 2024-04-25T08:45:02.919 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:02.919 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":42,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:44:44.243816+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:43:35.001610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T08:43:35.672731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:02.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 -- 172.21.15.172:0/3155475980 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f914406b4d0 msgr2=0x7f914406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f914406b4d0 0x7f914406d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f916015c710 tx=0x7f9150009040 comp rx=0 tx=0).stop 2024-04-25T08:45:02.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 -- 172.21.15.172:0/3155475980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 msgr2=0x7f9160160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:02.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f9160160b10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f915c0118e0 tx=0x7f915c011da0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 -- 172.21.15.172:0/3155475980 shutdown_connections 2024-04-25T08:45:02.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f914406b4d0 0x7f914406d990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f916015c860 0x7f916015cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f916015ea80 0x7f916014fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 --2- 172.21.15.172:0/3155475980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c0051c0 0x7f9160160b10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:02.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 -- 172.21.15.172:0/3155475980 >> 172.21.15.172:0/3155475980 conn(0x7f9160061a20 msgr2=0x7f916015b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:02.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 -- 172.21.15.172:0/3155475980 shutdown_connections 2024-04-25T08:45:02.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:02.929+0000 7f916762a640 1 -- 172.21.15.172:0/3155475980 wait complete. 2024-04-25T08:45:02.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:43:35.001610+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:43:35.672731+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:45:02.932 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:45:03.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.040+0000 7f9c3af7e640 1 Processor -- start 2024-04-25T08:45:03.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.040+0000 7f9c3af7e640 1 -- start start 2024-04-25T08:45:03.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.041+0000 7f9c3af7e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9c3415bb50 0x7f9c340c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.041+0000 7f9c3af7e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c340c70d0 0x7f9c340cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.041+0000 7f9c3af7e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c340cfb40 0x7f9c34070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.041+0000 7f9c3af7e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c340c8680 con 0x7f9c340c70d0 2024-04-25T08:45:03.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.041+0000 7f9c3af7e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c340c75e0 con 0x7f9c3415bb50 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.041+0000 7f9c3af7e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340c78c0 con 0x7f9c340cfb40 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.041+0000 7f9c33fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c340c70d0 0x7f9c340cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.041+0000 7f9c33fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c340c70d0 0x7f9c340cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54298/0 (socket says 172.21.15.172:54298) 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.041+0000 7f9c33fff640 1 -- 172.21.15.172:0/1105278566 learned_addr learned my addr 172.21.15.172:0/1105278566 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c38d1a640 1 --2- 172.21.15.172:0/1105278566 >> v2:172.21.15.186:3300/0 conn(0x7f9c3415bb50 0x7f9c340c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c3951b640 1 --2- 172.21.15.172:0/1105278566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c340cfb40 0x7f9c34070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c33fff640 1 -- 172.21.15.172:0/1105278566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c340cfb40 msgr2=0x7f9c34070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c33fff640 1 --2- 172.21.15.172:0/1105278566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c340cfb40 0x7f9c34070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c33fff640 1 -- 172.21.15.172:0/1105278566 >> v2:172.21.15.186:3300/0 conn(0x7f9c3415bb50 msgr2=0x7f9c340c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c33fff640 1 --2- 172.21.15.172:0/1105278566 >> v2:172.21.15.186:3300/0 conn(0x7f9c3415bb50 0x7f9c340c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c33fff640 1 -- 172.21.15.172:0/1105278566 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340c7ba0 con 0x7f9c340c70d0 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c33fff640 1 --2- 172.21.15.172:0/1105278566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c340c70d0 0x7f9c340cf600 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9c34070ab0 tx=0x7f9c2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7428006e8bca6ad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c337fe640 1 -- 172.21.15.172:0/1105278566 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24037070 con 0x7f9c340c70d0 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c337fe640 1 -- 172.21.15.172:0/1105278566 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c24032440 con 0x7f9c340c70d0 2024-04-25T08:45:03.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.042+0000 7f9c337fe640 1 -- 172.21.15.172:0/1105278566 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c24032810 con 0x7f9c340c70d0 2024-04-25T08:45:03.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.043+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1105278566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c340c70d0 msgr2=0x7f9c340cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.043+0000 7f9c3af7e640 1 --2- 172.21.15.172:0/1105278566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c340c70d0 0x7f9c340cf600 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9c34070ab0 tx=0x7f9c2402a270 comp rx=0 tx=0).stop 2024-04-25T08:45:03.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.043+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1105278566 shutdown_connections 2024-04-25T08:45:03.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.043+0000 7f9c3af7e640 1 --2- 172.21.15.172:0/1105278566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c340cfb40 0x7f9c34070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.043+0000 7f9c3af7e640 1 --2- 172.21.15.172:0/1105278566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c340c70d0 0x7f9c340cf600 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.043+0000 7f9c3af7e640 1 --2- 172.21.15.172:0/1105278566 >> v2:172.21.15.186:3300/0 conn(0x7f9c3415bb50 0x7f9c340c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.043+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1105278566 >> 172.21.15.172:0/1105278566 conn(0x7f9c3406f500 msgr2=0x7f9c3406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:03.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.043+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1105278566 shutdown_connections 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.043+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1105278566 wait complete. 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.044+0000 7f9c3af7e640 1 Processor -- start 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.044+0000 7f9c3af7e640 1 -- start start 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.045+0000 7f9c3af7e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c340c70d0 0x7f9c340c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.045+0000 7f9c3af7e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c340cfb40 0x7f9c340b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.045+0000 7f9c3af7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3415bb50 0x7f9c3406bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.045+0000 7f9c3af7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3415f6d0 con 0x7f9c3415bb50 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.045+0000 7f9c3af7e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340c8160 con 0x7f9c340c70d0 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.045+0000 7f9c3af7e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3415f850 con 0x7f9c340cfb40 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.045+0000 7f9c3951b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3415bb50 0x7f9c3406bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.045+0000 7f9c3951b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3415bb50 0x7f9c3406bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54312/0 (socket says 172.21.15.172:54312) 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.045+0000 7f9c3951b640 1 -- 172.21.15.172:0/1382151549 learned_addr learned my addr 172.21.15.172:0/1382151549 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.045+0000 7f9c3951b640 1 -- 172.21.15.172:0/1382151549 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c340cfb40 msgr2=0x7f9c340b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.046+0000 7f9c3951b640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c340cfb40 0x7f9c340b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.046+0000 7f9c3951b640 1 -- 172.21.15.172:0/1382151549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c340c70d0 msgr2=0x7f9c340c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.046+0000 7f9c3951b640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c340c70d0 0x7f9c340c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.046+0000 7f9c3951b640 1 -- 172.21.15.172:0/1382151549 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3406c440 con 0x7f9c3415bb50 2024-04-25T08:45:03.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.046+0000 7f9c3951b640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3415bb50 0x7f9c3406bcf0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c007e60 tx=0x7f9c2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.046+0000 7f9c317fa640 1 -- 172.21.15.172:0/1382151549 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c014620 con 0x7f9c3415bb50 2024-04-25T08:45:03.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.046+0000 7f9c317fa640 1 -- 172.21.15.172:0/1382151549 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c019070 con 0x7f9c3415bb50 2024-04-25T08:45:03.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.046+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1382151549 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3406c720 con 0x7f9c3415bb50 2024-04-25T08:45:03.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.046+0000 7f9c317fa640 1 -- 172.21.15.172:0/1382151549 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c014a20 con 0x7f9c3415bb50 2024-04-25T08:45:03.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.046+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1382151549 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c34157120 con 0x7f9c3415bb50 2024-04-25T08:45:03.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.047+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1382151549 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c34073a00 con 0x7f9c3415bb50 2024-04-25T08:45:03.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.047+0000 7f9c317fa640 1 -- 172.21.15.172:0/1382151549 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c2c014bc0 con 0x7f9c3415bb50 2024-04-25T08:45:03.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.048+0000 7f9c317fa640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c1406b4d0 0x7f9c1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.048+0000 7f9c38d1a640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c1406b4d0 0x7f9c1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.048+0000 7f9c317fa640 1 -- 172.21.15.172:0/1382151549 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f9c2c08ac00 con 0x7f9c3415bb50 2024-04-25T08:45:03.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.048+0000 7f9c38d1a640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c1406b4d0 0x7f9c1406d990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0098f0 tx=0x7f9c1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.052+0000 7f9c317fa640 1 -- 172.21.15.172:0/1382151549 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c2c091080 con 0x7f9c3415bb50 2024-04-25T08:45:03.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.221+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1382151549 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c340b7a30 con 0x7f9c3415bb50 2024-04-25T08:45:03.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.221+0000 7f9c317fa640 1 -- 172.21.15.172:0/1382151549 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c2c059950 con 0x7f9c3415bb50 2024-04-25T08:45:03.213 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:45:03.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1382151549 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c1406b4d0 msgr2=0x7f9c1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c1406b4d0 0x7f9c1406d990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0098f0 tx=0x7f9c1c008040 comp rx=0 tx=0).stop 2024-04-25T08:45:03.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1382151549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3415bb50 msgr2=0x7f9c3406bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3415bb50 0x7f9c3406bcf0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c007e60 tx=0x7f9c2c00e4b0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1382151549 shutdown_connections 2024-04-25T08:45:03.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c1406b4d0 0x7f9c1406d990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3415bb50 0x7f9c3406bcf0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c340cfb40 0x7f9c340b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 --2- 172.21.15.172:0/1382151549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c340c70d0 0x7f9c340c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1382151549 >> 172.21.15.172:0/1382151549 conn(0x7f9c3406f500 msgr2=0x7f9c340b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:03.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1382151549 shutdown_connections 2024-04-25T08:45:03.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.223+0000 7f9c3af7e640 1 -- 172.21.15.172:0/1382151549 wait complete. 2024-04-25T08:45:03.226 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:45:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.334+0000 7f8befe5d640 1 Processor -- start 2024-04-25T08:45:03.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.335+0000 7f8befe5d640 1 -- start start 2024-04-25T08:45:03.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.335+0000 7f8befe5d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8be815dc20 0x7f8be80ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.335+0000 7f8befe5d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8be80d32f0 0x7f8be80cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.335+0000 7f8befe5d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be815e000 con 0x7f8be8161710 2024-04-25T08:45:03.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.335+0000 7f8befe5d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be80d1de0 con 0x7f8be815dc20 2024-04-25T08:45:03.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.335+0000 7f8befe5d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be8161c60 con 0x7f8be80d32f0 2024-04-25T08:45:03.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.336+0000 7f8bedbf9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8be815dc20 0x7f8be80ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.336+0000 7f8bedbf9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8be815dc20 0x7f8be80ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54320/0 (socket says 172.21.15.172:54320) 2024-04-25T08:45:03.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.336+0000 7f8bedbf9640 1 -- 172.21.15.172:0/1646015038 learned_addr learned my addr 172.21.15.172:0/1646015038 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:03.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.336+0000 7f8bedbf9640 1 -- 172.21.15.172:0/1646015038 >> v2:172.21.15.186:3300/0 conn(0x7f8be80d32f0 msgr2=0x7f8be80cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:03.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.336+0000 7f8bee3fa640 1 --2- 172.21.15.172:0/1646015038 >> v2:172.21.15.186:3300/0 conn(0x7f8be80d32f0 0x7f8be80cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.336+0000 7f8bedbf9640 1 --2- 172.21.15.172:0/1646015038 >> v2:172.21.15.186:3300/0 conn(0x7f8be80d32f0 0x7f8be80cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.336+0000 7f8bedbf9640 1 -- 172.21.15.172:0/1646015038 >> v1:172.21.15.186:6789/0 conn(0x7f8be8161710 legacy=0x7f8be806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:03.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.336+0000 7f8bedbf9640 1 -- 172.21.15.172:0/1646015038 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8161f40 con 0x7f8be815dc20 2024-04-25T08:45:03.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.336+0000 7f8bee3fa640 1 --2- 172.21.15.172:0/1646015038 >> v2:172.21.15.186:3300/0 conn(0x7f8be80d32f0 0x7f8be80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.337+0000 7f8bedbf9640 1 --2- 172.21.15.172:0/1646015038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be815dc20 0x7f8be80ce670 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8be80b6910 tx=0x7f8be402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d595836bbf7baccb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.337+0000 7f8becbf7640 1 -- 172.21.15.172:0/1646015038 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4036070 con 0x7f8be815dc20 2024-04-25T08:45:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.337+0000 7f8becbf7640 1 -- 172.21.15.172:0/1646015038 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be4031600 con 0x7f8be815dc20 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.337+0000 7f8becbf7640 1 -- 172.21.15.172:0/1646015038 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40319d0 con 0x7f8be815dc20 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.337+0000 7f8befe5d640 1 -- 172.21.15.172:0/1646015038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be815dc20 msgr2=0x7f8be80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.337+0000 7f8befe5d640 1 --2- 172.21.15.172:0/1646015038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be815dc20 0x7f8be80ce670 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8be80b6910 tx=0x7f8be402a6f0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.338+0000 7f8befe5d640 1 -- 172.21.15.172:0/1646015038 shutdown_connections 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.338+0000 7f8befe5d640 1 --2- 172.21.15.172:0/1646015038 >> v2:172.21.15.186:3300/0 conn(0x7f8be80d32f0 0x7f8be80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.338+0000 7f8befe5d640 1 --2- 172.21.15.172:0/1646015038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be815dc20 0x7f8be80ce670 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.338+0000 7f8befe5d640 1 -- 172.21.15.172:0/1646015038 >> 172.21.15.172:0/1646015038 conn(0x7f8be80d0420 msgr2=0x7f8be80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.338+0000 7f8befe5d640 1 -- 172.21.15.172:0/1646015038 shutdown_connections 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.338+0000 7f8befe5d640 1 -- 172.21.15.172:0/1646015038 wait complete. 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.339+0000 7f8befe5d640 1 Processor -- start 2024-04-25T08:45:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.339+0000 7f8befe5d640 1 -- start start 2024-04-25T08:45:03.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.339+0000 7f8befe5d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8be80d32f0 0x7f8be815e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8befe5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8be815dc20 0x7f8be815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8befe5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8161710 0x7f8be815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8befe5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80b5e50 con 0x7f8be8161710 2024-04-25T08:45:03.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8befe5d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8162500 con 0x7f8be80d32f0 2024-04-25T08:45:03.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8befe5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80b5fd0 con 0x7f8be815dc20 2024-04-25T08:45:03.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bee3fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8161710 0x7f8be815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bee3fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8161710 0x7f8be815c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54334/0 (socket says 172.21.15.172:54334) 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bee3fa640 1 -- 172.21.15.172:0/4016461338 learned_addr learned my addr 172.21.15.172:0/4016461338 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bedbf9640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8be80d32f0 0x7f8be815e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bed3f8640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8be815dc20 0x7f8be815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bee3fa640 1 -- 172.21.15.172:0/4016461338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8be815dc20 msgr2=0x7f8be815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bee3fa640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8be815dc20 0x7f8be815bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bee3fa640 1 -- 172.21.15.172:0/4016461338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8be80d32f0 msgr2=0x7f8be815e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bee3fa640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8be80d32f0 0x7f8be815e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bee3fa640 1 -- 172.21.15.172:0/4016461338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be815f080 con 0x7f8be8161710 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bee3fa640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8161710 0x7f8be815c1f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c5c0 tx=0x7f8be000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bde7fc640 1 -- 172.21.15.172:0/4016461338 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0015070 con 0x7f8be8161710 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bde7fc640 1 -- 172.21.15.172:0/4016461338 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0004220 con 0x7f8be8161710 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8befe5d640 1 -- 172.21.15.172:0/4016461338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be815f360 con 0x7f8be8161710 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8bde7fc640 1 -- 172.21.15.172:0/4016461338 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0003610 con 0x7f8be8161710 2024-04-25T08:45:03.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.340+0000 7f8befe5d640 1 -- 172.21.15.172:0/4016461338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be81f3760 con 0x7f8be8161710 2024-04-25T08:45:03.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.341+0000 7f8befe5d640 1 -- 172.21.15.172:0/4016461338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be8073a00 con 0x7f8be8161710 2024-04-25T08:45:03.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.342+0000 7f8bde7fc640 1 -- 172.21.15.172:0/4016461338 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8be00037b0 con 0x7f8be8161710 2024-04-25T08:45:03.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.342+0000 7f8bde7fc640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8bcc06b4d0 0x7f8bcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.342+0000 7f8bde7fc640 1 -- 172.21.15.172:0/4016461338 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f8be008a000 con 0x7f8be8161710 2024-04-25T08:45:03.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.342+0000 7f8bedbf9640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8bcc06b4d0 0x7f8bcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.343+0000 7f8bedbf9640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8bcc06b4d0 0x7f8bcc06d990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8be4033000 tx=0x7f8be4009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.346+0000 7f8bde7fc640 1 -- 172.21.15.172:0/4016461338 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8be0058670 con 0x7f8be8161710 2024-04-25T08:45:03.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.516+0000 7f8befe5d640 1 -- 172.21.15.172:0/4016461338 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8be80d16b0 con 0x7f8be8161710 2024-04-25T08:45:03.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.517+0000 7f8bde7fc640 1 -- 172.21.15.172:0/4016461338 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8be005c710 con 0x7f8be8161710 2024-04-25T08:45:03.509 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 -- 172.21.15.172:0/4016461338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8bcc06b4d0 msgr2=0x7f8bcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8bcc06b4d0 0x7f8bcc06d990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8be4033000 tx=0x7f8be4009000 comp rx=0 tx=0).stop 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 -- 172.21.15.172:0/4016461338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8161710 msgr2=0x7f8be815c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8161710 0x7f8be815c1f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c5c0 tx=0x7f8be000ca80 comp rx=0 tx=0).stop 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 -- 172.21.15.172:0/4016461338 shutdown_connections 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8bcc06b4d0 0x7f8bcc06d990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8161710 0x7f8be815c1f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8be815dc20 0x7f8be815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 --2- 172.21.15.172:0/4016461338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8be80d32f0 0x7f8be815e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 -- 172.21.15.172:0/4016461338 >> 172.21.15.172:0/4016461338 conn(0x7f8be80d0420 msgr2=0x7f8be80b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:03.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 -- 172.21.15.172:0/4016461338 shutdown_connections 2024-04-25T08:45:03.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.519+0000 7f8befe5d640 1 -- 172.21.15.172:0/4016461338 wait complete. 2024-04-25T08:45:03.521 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:45:03.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.630+0000 7f04e1f10640 1 Processor -- start 2024-04-25T08:45:03.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.630+0000 7f04e1f10640 1 -- start start 2024-04-25T08:45:03.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.631+0000 7f04e1f10640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f04dc15bb50 0x7f04dc0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.631+0000 7f04e1f10640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f04dc0c70d0 0x7f04dc0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.631+0000 7f04e1f10640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc0c75e0 con 0x7f04dc0cfb40 2024-04-25T08:45:03.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.631+0000 7f04e1f10640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0c8680 con 0x7f04dc15bb50 2024-04-25T08:45:03.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.631+0000 7f04e1f10640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0c78c0 con 0x7f04dc0c70d0 2024-04-25T08:45:03.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.631+0000 7f04db7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f04dc15bb50 0x7f04dc0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.631+0000 7f04db7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f04dc15bb50 0x7f04dc0c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54350/0 (socket says 172.21.15.172:54350) 2024-04-25T08:45:03.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.631+0000 7f04db7fe640 1 -- 172.21.15.172:0/1932706665 learned_addr learned my addr 172.21.15.172:0/1932706665 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.632+0000 7f04daffd640 1 --2- 172.21.15.172:0/1932706665 >> v2:172.21.15.186:3300/0 conn(0x7f04dc0c70d0 0x7f04dc0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.632+0000 7f04db7fe640 1 -- 172.21.15.172:0/1932706665 >> v2:172.21.15.186:3300/0 conn(0x7f04dc0c70d0 msgr2=0x7f04dc0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.632+0000 7f04db7fe640 1 --2- 172.21.15.172:0/1932706665 >> v2:172.21.15.186:3300/0 conn(0x7f04dc0c70d0 0x7f04dc0cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.632+0000 7f04db7fe640 1 -- 172.21.15.172:0/1932706665 >> v1:172.21.15.186:6789/0 conn(0x7f04dc0cfb40 legacy=0x7f04dc070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.632+0000 7f04db7fe640 1 -- 172.21.15.172:0/1932706665 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc0c7ba0 con 0x7f04dc15bb50 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.632+0000 7f04daffd640 1 --2- 172.21.15.172:0/1932706665 >> v2:172.21.15.186:3300/0 conn(0x7f04dc0c70d0 0x7f04dc0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.632+0000 7f04db7fe640 1 --2- 172.21.15.172:0/1932706665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc15bb50 0x7f04dc0c6b90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f04dc06f220 tx=0x7f04cc02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe5da57f72ee70e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.632+0000 7f04da7fc640 1 -- 172.21.15.172:0/1932706665 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc037070 con 0x7f04dc15bb50 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.633+0000 7f04da7fc640 1 -- 172.21.15.172:0/1932706665 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc032440 con 0x7f04dc15bb50 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.633+0000 7f04da7fc640 1 -- 172.21.15.172:0/1932706665 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc032810 con 0x7f04dc15bb50 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.633+0000 7f04e1f10640 1 -- 172.21.15.172:0/1932706665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc15bb50 msgr2=0x7f04dc0c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.633+0000 7f04e1f10640 1 --2- 172.21.15.172:0/1932706665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc15bb50 0x7f04dc0c6b90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f04dc06f220 tx=0x7f04cc02a2c0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.633+0000 7f04e1f10640 1 -- 172.21.15.172:0/1932706665 shutdown_connections 2024-04-25T08:45:03.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.633+0000 7f04e1f10640 1 --2- 172.21.15.172:0/1932706665 >> v2:172.21.15.186:3300/0 conn(0x7f04dc0c70d0 0x7f04dc0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.633+0000 7f04e1f10640 1 --2- 172.21.15.172:0/1932706665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc15bb50 0x7f04dc0c6b90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.633+0000 7f04e1f10640 1 -- 172.21.15.172:0/1932706665 >> 172.21.15.172:0/1932706665 conn(0x7f04dc06f500 msgr2=0x7f04dc06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:03.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.633+0000 7f04e1f10640 1 -- 172.21.15.172:0/1932706665 shutdown_connections 2024-04-25T08:45:03.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.633+0000 7f04e1f10640 1 -- 172.21.15.172:0/1932706665 wait complete. 2024-04-25T08:45:03.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.634+0000 7f04e1f10640 1 Processor -- start 2024-04-25T08:45:03.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.634+0000 7f04e1f10640 1 -- start start 2024-04-25T08:45:03.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04e1f10640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f04dc0c70d0 0x7f04dc06c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04e1f10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc0cfb40 0x7f04dc1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04e1f10640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04dc15bb50 0x7f04dc0cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04e1f10640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc15f6d0 con 0x7f04dc0cfb40 2024-04-25T08:45:03.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04e1f10640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0c8160 con 0x7f04dc15bb50 2024-04-25T08:45:03.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04e1f10640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc15f850 con 0x7f04dc0c70d0 2024-04-25T08:45:03.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04daffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc0cfb40 0x7f04dc1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04daffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc0cfb40 0x7f04dc1514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54364/0 (socket says 172.21.15.172:54364) 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04daffd640 1 -- 172.21.15.172:0/1727870734 learned_addr learned my addr 172.21.15.172:0/1727870734 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04db7fe640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f04dc0c70d0 0x7f04dc06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.635+0000 7f04dbfff640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04dc15bb50 0x7f04dc0cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04daffd640 1 -- 172.21.15.172:0/1727870734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f04dc0c70d0 msgr2=0x7f04dc06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04daffd640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f04dc0c70d0 0x7f04dc06c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04daffd640 1 -- 172.21.15.172:0/1727870734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04dc15bb50 msgr2=0x7f04dc0cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04daffd640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04dc15bb50 0x7f04dc0cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04daffd640 1 -- 172.21.15.172:0/1727870734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc06cd90 con 0x7f04dc0cfb40 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04dbfff640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04dc15bb50 0x7f04dc0cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04db7fe640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f04dc0c70d0 0x7f04dc06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04daffd640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc0cfb40 0x7f04dc1514d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f04d000e7e0 tx=0x7f04d000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04c3fff640 1 -- 172.21.15.172:0/1727870734 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0017070 con 0x7f04dc0cfb40 2024-04-25T08:45:03.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04c3fff640 1 -- 172.21.15.172:0/1727870734 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d000c6d0 con 0x7f04dc0cfb40 2024-04-25T08:45:03.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04e1f10640 1 -- 172.21.15.172:0/1727870734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc06d070 con 0x7f04dc0cfb40 2024-04-25T08:45:03.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04c3fff640 1 -- 172.21.15.172:0/1727870734 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000f040 con 0x7f04dc0cfb40 2024-04-25T08:45:03.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.636+0000 7f04e1f10640 1 -- 172.21.15.172:0/1727870734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc1e54f0 con 0x7f04dc0cfb40 2024-04-25T08:45:03.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.637+0000 7f04e1f10640 1 -- 172.21.15.172:0/1727870734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc073a00 con 0x7f04dc0cfb40 2024-04-25T08:45:03.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.638+0000 7f04c3fff640 1 -- 172.21.15.172:0/1727870734 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f04d001a070 con 0x7f04dc0cfb40 2024-04-25T08:45:03.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.638+0000 7f04c3fff640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04c806b4d0 0x7f04c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.638+0000 7f04c3fff640 1 -- 172.21.15.172:0/1727870734 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f04d008a300 con 0x7f04dc0cfb40 2024-04-25T08:45:03.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.638+0000 7f04db7fe640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04c806b4d0 0x7f04c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.638+0000 7f04db7fe640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04c806b4d0 0x7f04c806d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f04cc034000 tx=0x7f04cc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.642+0000 7f04c3fff640 1 -- 172.21.15.172:0/1727870734 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f04d0059050 con 0x7f04dc0cfb40 2024-04-25T08:45:03.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.816+0000 7f04e1f10640 1 -- 172.21.15.172:0/1727870734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04dc0cf150 con 0x7f04dc0cfb40 2024-04-25T08:45:03.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.816+0000 7f04c3fff640 1 -- 172.21.15.172:0/1727870734 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04d0058950 con 0x7f04dc0cfb40 2024-04-25T08:45:03.808 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:45:03.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 -- 172.21.15.172:0/1727870734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04c806b4d0 msgr2=0x7f04c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04c806b4d0 0x7f04c806d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f04cc034000 tx=0x7f04cc02e000 comp rx=0 tx=0).stop 2024-04-25T08:45:03.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 -- 172.21.15.172:0/1727870734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc0cfb40 msgr2=0x7f04dc1514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc0cfb40 0x7f04dc1514d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f04d000e7e0 tx=0x7f04d000eca0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 -- 172.21.15.172:0/1727870734 shutdown_connections 2024-04-25T08:45:03.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04c806b4d0 0x7f04c806d990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04dc15bb50 0x7f04dc0cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04dc0cfb40 0x7f04dc1514d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 --2- 172.21.15.172:0/1727870734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f04dc0c70d0 0x7f04dc06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 -- 172.21.15.172:0/1727870734 >> 172.21.15.172:0/1727870734 conn(0x7f04dc06f500 msgr2=0x7f04dc0b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:03.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 -- 172.21.15.172:0/1727870734 shutdown_connections 2024-04-25T08:45:03.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.819+0000 7f04e1f10640 1 -- 172.21.15.172:0/1727870734 wait complete. 2024-04-25T08:45:03.821 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:45:03.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.928+0000 7fe42866b640 1 Processor -- start 2024-04-25T08:45:03.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.929+0000 7fe42866b640 1 -- start start 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.929+0000 7fe42866b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe42006abe0 0x7fe4200acec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.929+0000 7fe42866b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe4200b3920 0x7fe42006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.929+0000 7fe42866b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42006db40 con 0x7fe4200b3d80 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.929+0000 7fe42866b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42006de20 con 0x7fe4200b3920 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.929+0000 7fe42866b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42006e100 con 0x7fe42006abe0 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.930+0000 7fe425c06640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe4200b3920 0x7fe42006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.930+0000 7fe425c06640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe4200b3920 0x7fe42006afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54366/0 (socket says 172.21.15.172:54366) 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.930+0000 7fe425c06640 1 -- 172.21.15.172:0/1662910872 learned_addr learned my addr 172.21.15.172:0/1662910872 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.930+0000 7fe426407640 1 --2- 172.21.15.172:0/1662910872 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe42006abe0 0x7fe4200acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.930+0000 7fe425c06640 1 -- 172.21.15.172:0/1662910872 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe42006abe0 msgr2=0x7fe4200acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:03.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.930+0000 7fe425c06640 1 --2- 172.21.15.172:0/1662910872 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe42006abe0 0x7fe4200acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.930+0000 7fe425c06640 1 -- 172.21.15.172:0/1662910872 >> v1:172.21.15.186:6789/0 conn(0x7fe4200b3d80 legacy=0x7fe42006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:03.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.930+0000 7fe425c06640 1 -- 172.21.15.172:0/1662910872 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42006e3e0 con 0x7fe4200b3920 2024-04-25T08:45:03.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.930+0000 7fe426407640 1 --2- 172.21.15.172:0/1662910872 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe42006abe0 0x7fe4200acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:03.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe425c06640 1 --2- 172.21.15.172:0/1662910872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4200b3920 0x7fe42006afc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe414009870 tx=0x7fe41402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14964372d82d61f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe425405640 1 -- 172.21.15.172:0/1662910872 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414037070 con 0x7fe4200b3920 2024-04-25T08:45:03.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe425405640 1 -- 172.21.15.172:0/1662910872 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe414032440 con 0x7fe4200b3920 2024-04-25T08:45:03.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe425405640 1 -- 172.21.15.172:0/1662910872 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414032810 con 0x7fe4200b3920 2024-04-25T08:45:03.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe42866b640 1 -- 172.21.15.172:0/1662910872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4200b3920 msgr2=0x7fe42006afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe42866b640 1 --2- 172.21.15.172:0/1662910872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4200b3920 0x7fe42006afc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe414009870 tx=0x7fe41402a180 comp rx=0 tx=0).stop 2024-04-25T08:45:03.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe42866b640 1 -- 172.21.15.172:0/1662910872 shutdown_connections 2024-04-25T08:45:03.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe42866b640 1 --2- 172.21.15.172:0/1662910872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4200b3920 0x7fe42006afc0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe42866b640 1 --2- 172.21.15.172:0/1662910872 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe42006abe0 0x7fe4200acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe42866b640 1 -- 172.21.15.172:0/1662910872 >> 172.21.15.172:0/1662910872 conn(0x7fe4200cfec0 msgr2=0x7fe4200d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:03.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe42866b640 1 -- 172.21.15.172:0/1662910872 shutdown_connections 2024-04-25T08:45:03.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.931+0000 7fe42866b640 1 -- 172.21.15.172:0/1662910872 wait complete. 2024-04-25T08:45:03.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.932+0000 7fe42866b640 1 Processor -- start 2024-04-25T08:45:03.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe42866b640 1 -- start start 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe42866b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe42006abe0 0x7fe4201f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe42866b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4200b3920 0x7fe420158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe42866b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4200b3d80 0x7fe420153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe42866b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42006b680 con 0x7fe42006abe0 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe42866b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42006b500 con 0x7fe4200b3d80 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe42866b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42006b800 con 0x7fe4200b3920 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe426407640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe42006abe0 0x7fe4201f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe426407640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe42006abe0 0x7fe4201f3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54376/0 (socket says 172.21.15.172:54376) 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe426407640 1 -- 172.21.15.172:0/3523396071 learned_addr learned my addr 172.21.15.172:0/3523396071 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.933+0000 7fe425c06640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4200b3920 0x7fe420158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe426c08640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4200b3d80 0x7fe420153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe426407640 1 -- 172.21.15.172:0/3523396071 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4200b3920 msgr2=0x7fe420158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe426407640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4200b3920 0x7fe420158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe426407640 1 -- 172.21.15.172:0/3523396071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4200b3d80 msgr2=0x7fe420153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:03.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe426407640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4200b3d80 0x7fe420153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe426407640 1 -- 172.21.15.172:0/3523396071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4201461f0 con 0x7fe42006abe0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe426c08640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4200b3d80 0x7fe420153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe426407640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe42006abe0 0x7fe4201f3110 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe41800ce00 tx=0x7fe41800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe41effd640 1 -- 172.21.15.172:0/3523396071 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800f890 con 0x7fe42006abe0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe41effd640 1 -- 172.21.15.172:0/3523396071 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41800fa30 con 0x7fe42006abe0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe41effd640 1 -- 172.21.15.172:0/3523396071 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800fe00 con 0x7fe42006abe0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe42866b640 1 -- 172.21.15.172:0/3523396071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4201f3650 con 0x7fe42006abe0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.934+0000 7fe42866b640 1 -- 172.21.15.172:0/3523396071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe420151f20 con 0x7fe42006abe0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.935+0000 7fe42866b640 1 -- 172.21.15.172:0/3523396071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe420073a00 con 0x7fe42006abe0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.935+0000 7fe41effd640 1 -- 172.21.15.172:0/3523396071 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe418018400 con 0x7fe42006abe0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.936+0000 7fe41effd640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe40c06b4d0 0x7fe40c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.936+0000 7fe41effd640 1 -- 172.21.15.172:0/3523396071 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7fe41808b330 con 0x7fe42006abe0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.936+0000 7fe425c06640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe40c06b4d0 0x7fe40c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:03.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.936+0000 7fe425c06640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe40c06b4d0 0x7fe40c06d990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe414034000 tx=0x7fe41402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:03.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:03.940+0000 7fe41effd640 1 -- 172.21.15.172:0/3523396071 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe418014030 con 0x7fe42006abe0 2024-04-25T08:45:04.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.121+0000 7fe42866b640 1 -- 172.21.15.172:0/3523396071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe4200b1640 con 0x7fe42006abe0 2024-04-25T08:45:04.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.121+0000 7fe41effd640 1 -- 172.21.15.172:0/3523396071 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe41800ae20 con 0x7fe42006abe0 2024-04-25T08:45:04.113 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:45:04.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 -- 172.21.15.172:0/3523396071 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe40c06b4d0 msgr2=0x7fe40c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe40c06b4d0 0x7fe40c06d990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe414034000 tx=0x7fe41402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 -- 172.21.15.172:0/3523396071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe42006abe0 msgr2=0x7fe4201f3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe42006abe0 0x7fe4201f3110 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe41800ce00 tx=0x7fe41800a650 comp rx=0 tx=0).stop 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 -- 172.21.15.172:0/3523396071 shutdown_connections 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe40c06b4d0 0x7fe40c06d990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4200b3d80 0x7fe420153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4200b3920 0x7fe420158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 --2- 172.21.15.172:0/3523396071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe42006abe0 0x7fe4201f3110 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 -- 172.21.15.172:0/3523396071 >> 172.21.15.172:0/3523396071 conn(0x7fe4200cfec0 msgr2=0x7fe4200ace80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.123+0000 7fe42866b640 1 -- 172.21.15.172:0/3523396071 shutdown_connections 2024-04-25T08:45:04.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.124+0000 7fe42866b640 1 -- 172.21.15.172:0/3523396071 wait complete. 2024-04-25T08:45:04.126 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:45:04.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:04.126 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:45:04.161 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:45:04.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:04.161 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:45:04.217 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:45:04.217 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:04.234 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:45:04.235 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:04.235 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:04.271 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:45:04.271 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:45:04.271 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:04.292 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:45:04.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:04.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.419+0000 7f3e7697d640 1 Processor -- start 2024-04-25T08:45:04.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.419+0000 7f3e7697d640 1 -- start start 2024-04-25T08:45:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.419+0000 7f3e7697d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3e7015dbe0 0x7f3e700d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.419+0000 7f3e7697d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3e700b2cb0 0x7f3e700d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.419+0000 7f3e7697d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e700b97a0 con 0x7f3e700b92a0 2024-04-25T08:45:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.419+0000 7f3e7697d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7015dfc0 con 0x7f3e7015dbe0 2024-04-25T08:45:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.419+0000 7f3e7697d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e700d1a00 con 0x7f3e700b2cb0 2024-04-25T08:45:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.420+0000 7f3e6ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3e7015dbe0 0x7f3e700d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.420+0000 7f3e74f1a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3e700b92a0 0x7f3e700b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41700/0 (socket says 172.21.15.172:41700) 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.420+0000 7f3e74f1a640 1 -- 172.21.15.172:0/3009364785 learned_addr learned my addr 172.21.15.172:0/3009364785 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.420+0000 7f3e6f7fe640 1 --2- 172.21.15.172:0/3009364785 >> v2:172.21.15.186:3300/0 conn(0x7f3e700b2cb0 0x7f3e700d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.420+0000 7f3e6ffff640 1 -- 172.21.15.172:0/3009364785 >> v2:172.21.15.186:3300/0 conn(0x7f3e700b2cb0 msgr2=0x7f3e700d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.420+0000 7f3e6ffff640 1 --2- 172.21.15.172:0/3009364785 >> v2:172.21.15.186:3300/0 conn(0x7f3e700b2cb0 0x7f3e700d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.420+0000 7f3e6ffff640 1 -- 172.21.15.172:0/3009364785 >> v1:172.21.15.172:6789/0 conn(0x7f3e700b92a0 legacy=0x7f3e700b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.420+0000 7f3e6ffff640 1 -- 172.21.15.172:0/3009364785 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700d1c50 con 0x7f3e7015dbe0 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.420+0000 7f3e6effd640 1 -- 172.21.15.172:0/3009364785 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856852284 0 0) 0x7f3e700b97a0 con 0x7f3e700b92a0 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.420+0000 7f3e6f7fe640 1 --2- 172.21.15.172:0/3009364785 >> v2:172.21.15.186:3300/0 conn(0x7f3e700b2cb0 0x7f3e700d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e6ffff640 1 --2- 172.21.15.172:0/3009364785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 0x7f3e700d0910 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3e7006cff0 tx=0x7f3e6402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d496ecdaaed7f2dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:04.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e6effd640 1 -- 172.21.15.172:0/3009364785 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64037070 con 0x7f3e7015dbe0 2024-04-25T08:45:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e6effd640 1 -- 172.21.15.172:0/3009364785 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64032440 con 0x7f3e7015dbe0 2024-04-25T08:45:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e6effd640 1 -- 172.21.15.172:0/3009364785 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6402ae60 con 0x7f3e7015dbe0 2024-04-25T08:45:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e7697d640 1 -- 172.21.15.172:0/3009364785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 msgr2=0x7f3e700d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e7697d640 1 --2- 172.21.15.172:0/3009364785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 0x7f3e700d0910 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3e7006cff0 tx=0x7f3e6402a110 comp rx=0 tx=0).stop 2024-04-25T08:45:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e7697d640 1 -- 172.21.15.172:0/3009364785 shutdown_connections 2024-04-25T08:45:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e7697d640 1 --2- 172.21.15.172:0/3009364785 >> v2:172.21.15.186:3300/0 conn(0x7f3e700b2cb0 0x7f3e700d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e7697d640 1 --2- 172.21.15.172:0/3009364785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 0x7f3e700d0910 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e7697d640 1 -- 172.21.15.172:0/3009364785 >> 172.21.15.172:0/3009364785 conn(0x7f3e70061a20 msgr2=0x7f3e70061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e7697d640 1 -- 172.21.15.172:0/3009364785 shutdown_connections 2024-04-25T08:45:04.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.421+0000 7f3e7697d640 1 -- 172.21.15.172:0/3009364785 wait complete. 2024-04-25T08:45:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.422+0000 7f3e7697d640 1 Processor -- start 2024-04-25T08:45:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.423+0000 7f3e7697d640 1 -- start start 2024-04-25T08:45:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.423+0000 7f3e7697d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e700b2cb0 0x7f3e700b8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.423+0000 7f3e7697d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e700b92a0 0x7f3e700cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.423+0000 7f3e7697d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 0x7f3e700cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.423+0000 7f3e7697d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700b6ab0 con 0x7f3e7015dbe0 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.423+0000 7f3e7697d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700d2210 con 0x7f3e700b92a0 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.423+0000 7f3e7697d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700b6c30 con 0x7f3e700b2cb0 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.423+0000 7f3e74f1a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 0x7f3e700cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.423+0000 7f3e74f1a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 0x7f3e700cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54398/0 (socket says 172.21.15.172:54398) 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.423+0000 7f3e74f1a640 1 -- 172.21.15.172:0/1418742275 learned_addr learned my addr 172.21.15.172:0/1418742275 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e6f7fe640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e700b92a0 0x7f3e700cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e6ffff640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e700b2cb0 0x7f3e700b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e74f1a640 1 -- 172.21.15.172:0/1418742275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e700b2cb0 msgr2=0x7f3e700b8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e74f1a640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e700b2cb0 0x7f3e700b8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e74f1a640 1 -- 172.21.15.172:0/1418742275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e700b92a0 msgr2=0x7f3e700cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e74f1a640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e700b92a0 0x7f3e700cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e74f1a640 1 -- 172.21.15.172:0/1418742275 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700cb600 con 0x7f3e7015dbe0 2024-04-25T08:45:04.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e74f1a640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 0x7f3e700cd750 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c780 tx=0x7f3e6800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e6cff9640 1 -- 172.21.15.172:0/1418742275 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68018070 con 0x7f3e7015dbe0 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e6cff9640 1 -- 172.21.15.172:0/1418742275 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6800a640 con 0x7f3e7015dbe0 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e6cff9640 1 -- 172.21.15.172:0/1418742275 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800aab0 con 0x7f3e7015dbe0 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e7697d640 1 -- 172.21.15.172:0/1418742275 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e700cb8e0 con 0x7f3e7015dbe0 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.424+0000 7f3e7697d640 1 -- 172.21.15.172:0/1418742275 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e700cbea0 con 0x7f3e7015dbe0 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.425+0000 7f3e7697d640 1 -- 172.21.15.172:0/1418742275 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e70073990 con 0x7f3e7015dbe0 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.425+0000 7f3e6cff9640 1 -- 172.21.15.172:0/1418742275 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e6801b070 con 0x7f3e7015dbe0 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.426+0000 7f3e6cff9640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e5c06b4d0 0x7f3e5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.426+0000 7f3e6cff9640 1 -- 172.21.15.172:0/1418742275 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f3e680899a0 con 0x7f3e7015dbe0 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.426+0000 7f3e6ffff640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e5c06b4d0 0x7f3e5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.426+0000 7f3e6ffff640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e5c06b4d0 0x7f3e5c06d990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3e64034000 tx=0x7f3e6402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:04.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.430+0000 7f3e6cff9640 1 -- 172.21.15.172:0/1418742275 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e68058660 con 0x7f3e7015dbe0 2024-04-25T08:45:04.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.636+0000 7f3e7697d640 1 -- 172.21.15.172:0/1418742275 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e70160a80 con 0x7f3e7015dbe0 2024-04-25T08:45:04.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.636+0000 7f3e6cff9640 1 -- 172.21.15.172:0/1418742275 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f3e68057f60 con 0x7f3e7015dbe0 2024-04-25T08:45:04.628 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:04.628 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/1959121045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1959121045},{"type":"v1","addr":"172.21.15.186:6834","nonce":1959121045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/898320853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":898320853},{"type":"v1","addr":"172.21.15.186:6835","nonce":898320853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1482887107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1482887107},{"type":"v1","addr":"172.21.15.172:6836","nonce":1482887107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:43:36.707052+0000","modified":"2024-04-25T08:43:47.700780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3537703238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3537703238},{"type":"v1","addr":"172.21.15.172:6837","nonce":3537703238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:45:04.629 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 16 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.638+0000 7f3e7697d640 1 -- 172.21.15.172:0/1418742275 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e5c06b4d0 msgr2=0x7f3e5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.638+0000 7f3e7697d640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e5c06b4d0 0x7f3e5c06d990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3e64034000 tx=0x7f3e6402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.638+0000 7f3e7697d640 1 -- 172.21.15.172:0/1418742275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 msgr2=0x7f3e700cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.638+0000 7f3e7697d640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 0x7f3e700cd750 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c780 tx=0x7f3e6800cc40 comp rx=0 tx=0).stop 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.639+0000 7f3e7697d640 1 -- 172.21.15.172:0/1418742275 shutdown_connections 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.639+0000 7f3e7697d640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e5c06b4d0 0x7f3e5c06d990 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.639+0000 7f3e7697d640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e700b92a0 0x7f3e700cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.639+0000 7f3e7697d640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7015dbe0 0x7f3e700cd750 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.639+0000 7f3e7697d640 1 --2- 172.21.15.172:0/1418742275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e700b2cb0 0x7f3e700b8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.639+0000 7f3e7697d640 1 -- 172.21.15.172:0/1418742275 >> 172.21.15.172:0/1418742275 conn(0x7f3e70061a20 msgr2=0x7f3e700d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.639+0000 7f3e7697d640 1 -- 172.21.15.172:0/1418742275 shutdown_connections 2024-04-25T08:45:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.639+0000 7f3e7697d640 1 -- 172.21.15.172:0/1418742275 wait complete. 2024-04-25T08:45:04.641 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:04.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.746+0000 7fae2741f640 1 Processor -- start 2024-04-25T08:45:04.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.747+0000 7fae2741f640 1 -- start start 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.747+0000 7fae2741f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fae2015dbe0 0x7fae200d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.747+0000 7fae2741f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae200b92a0 0x7fae200d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.747+0000 7fae2741f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae200b97a0 con 0x7fae200b2cb0 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.747+0000 7fae2741f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2015dfc0 con 0x7fae200b92a0 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.747+0000 7fae2741f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae200d1a00 con 0x7fae2015dbe0 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.748+0000 7fae259bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae200b92a0 0x7fae200d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.748+0000 7fae259bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae200b92a0 0x7fae200d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54406/0 (socket says 172.21.15.172:54406) 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.748+0000 7fae259bc640 1 -- 172.21.15.172:0/1484529963 learned_addr learned my addr 172.21.15.172:0/1484529963 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.748+0000 7fae251bb640 1 --2- 172.21.15.172:0/1484529963 >> v2:172.21.15.186:3300/0 conn(0x7fae2015dbe0 0x7fae200d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.748+0000 7fae259bc640 1 -- 172.21.15.172:0/1484529963 >> v2:172.21.15.186:3300/0 conn(0x7fae2015dbe0 msgr2=0x7fae200d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.748+0000 7fae259bc640 1 --2- 172.21.15.172:0/1484529963 >> v2:172.21.15.186:3300/0 conn(0x7fae2015dbe0 0x7fae200d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.748+0000 7fae259bc640 1 -- 172.21.15.172:0/1484529963 >> v1:172.21.15.186:6789/0 conn(0x7fae200b2cb0 legacy=0x7fae200b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:04.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.748+0000 7fae259bc640 1 -- 172.21.15.172:0/1484529963 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200d1c50 con 0x7fae200b92a0 2024-04-25T08:45:04.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.748+0000 7fae251bb640 1 --2- 172.21.15.172:0/1484529963 >> v2:172.21.15.186:3300/0 conn(0x7fae2015dbe0 0x7fae200d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae259bc640 1 --2- 172.21.15.172:0/1484529963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 0x7fae200d0e50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fae2006c140 tx=0x7fae1802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2dea05da081bdc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae17fff640 1 -- 172.21.15.172:0/1484529963 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18036070 con 0x7fae200b92a0 2024-04-25T08:45:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae17fff640 1 -- 172.21.15.172:0/1484529963 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae18031600 con 0x7fae200b92a0 2024-04-25T08:45:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae17fff640 1 -- 172.21.15.172:0/1484529963 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae180319d0 con 0x7fae200b92a0 2024-04-25T08:45:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae2741f640 1 -- 172.21.15.172:0/1484529963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 msgr2=0x7fae200d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae2741f640 1 --2- 172.21.15.172:0/1484529963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 0x7fae200d0e50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fae2006c140 tx=0x7fae1802a660 comp rx=0 tx=0).stop 2024-04-25T08:45:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae2741f640 1 -- 172.21.15.172:0/1484529963 shutdown_connections 2024-04-25T08:45:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae2741f640 1 --2- 172.21.15.172:0/1484529963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 0x7fae200d0e50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae2741f640 1 --2- 172.21.15.172:0/1484529963 >> v2:172.21.15.186:3300/0 conn(0x7fae2015dbe0 0x7fae200d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae2741f640 1 -- 172.21.15.172:0/1484529963 >> 172.21.15.172:0/1484529963 conn(0x7fae20061a20 msgr2=0x7fae20061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae2741f640 1 -- 172.21.15.172:0/1484529963 shutdown_connections 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.749+0000 7fae2741f640 1 -- 172.21.15.172:0/1484529963 wait complete. 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.750+0000 7fae2741f640 1 Processor -- start 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.751+0000 7fae2741f640 1 -- start start 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.751+0000 7fae2741f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae200b2cb0 0x7fae20155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.751+0000 7fae2741f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 0x7fae200b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.751+0000 7fae2741f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae2015dbe0 0x7fae2015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.751+0000 7fae2741f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200b6ab0 con 0x7fae200b92a0 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.751+0000 7fae2741f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200d2210 con 0x7fae2015dbe0 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.751+0000 7fae2741f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae200b6c30 con 0x7fae200b2cb0 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.751+0000 7fae249ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 0x7fae200b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.751+0000 7fae249ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 0x7fae200b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54420/0 (socket says 172.21.15.172:54420) 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.751+0000 7fae249ba640 1 -- 172.21.15.172:0/3579245203 learned_addr learned my addr 172.21.15.172:0/3579245203 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae259bc640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae2015dbe0 0x7fae2015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae251bb640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae200b2cb0 0x7fae20155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae249ba640 1 -- 172.21.15.172:0/3579245203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae200b2cb0 msgr2=0x7fae20155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae249ba640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae200b2cb0 0x7fae20155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae249ba640 1 -- 172.21.15.172:0/3579245203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae2015dbe0 msgr2=0x7fae2015b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae249ba640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae2015dbe0 0x7fae2015b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae249ba640 1 -- 172.21.15.172:0/3579245203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2015a6a0 con 0x7fae200b92a0 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae259bc640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae2015dbe0 0x7fae2015b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae251bb640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae200b2cb0 0x7fae20155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae249ba640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 0x7fae200b5c30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c400 tx=0x7fae1c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:04.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae15ffb640 1 -- 172.21.15.172:0/3579245203 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c011790 con 0x7fae200b92a0 2024-04-25T08:45:04.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae15ffb640 1 -- 172.21.15.172:0/3579245203 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c017070 con 0x7fae200b92a0 2024-04-25T08:45:04.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae15ffb640 1 -- 172.21.15.172:0/3579245203 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c011bb0 con 0x7fae200b92a0 2024-04-25T08:45:04.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae2741f640 1 -- 172.21.15.172:0/3579245203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2015a980 con 0x7fae200b92a0 2024-04-25T08:45:04.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.752+0000 7fae2741f640 1 -- 172.21.15.172:0/3579245203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2015af40 con 0x7fae200b92a0 2024-04-25T08:45:04.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.753+0000 7fae2741f640 1 -- 172.21.15.172:0/3579245203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae20073990 con 0x7fae200b92a0 2024-04-25T08:45:04.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.753+0000 7fae15ffb640 1 -- 172.21.15.172:0/3579245203 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae1c01c460 con 0x7fae200b92a0 2024-04-25T08:45:04.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.754+0000 7fae15ffb640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae0406b4d0 0x7fae0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:04.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.754+0000 7fae15ffb640 1 -- 172.21.15.172:0/3579245203 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7fae1c08a1e0 con 0x7fae200b92a0 2024-04-25T08:45:04.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.754+0000 7fae251bb640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae0406b4d0 0x7fae0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:04.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.754+0000 7fae251bb640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae0406b4d0 0x7fae0406d990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fae10006fd0 tx=0x7fae10008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:04.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.758+0000 7fae15ffb640 1 -- 172.21.15.172:0/3579245203 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae1c058f30 con 0x7fae200b92a0 2024-04-25T08:45:04.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.928+0000 7fae2741f640 1 -- 172.21.15.172:0/3579245203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae2015cd20 con 0x7fae200b92a0 2024-04-25T08:45:04.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.929+0000 7fae15ffb640 1 -- 172.21.15.172:0/3579245203 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17060 (secure 0 0 0) 0x7fae1c058830 con 0x7fae200b92a0 2024-04-25T08:45:04.921 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:04.921 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":42,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:44:44.243816+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:43:35.001610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T08:43:35.672731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:04.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 -- 172.21.15.172:0/3579245203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae0406b4d0 msgr2=0x7fae0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae0406b4d0 0x7fae0406d990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fae10006fd0 tx=0x7fae10008040 comp rx=0 tx=0).stop 2024-04-25T08:45:04.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 -- 172.21.15.172:0/3579245203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 msgr2=0x7fae200b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:04.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 0x7fae200b5c30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c400 tx=0x7fae1c00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 -- 172.21.15.172:0/3579245203 shutdown_connections 2024-04-25T08:45:04.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae0406b4d0 0x7fae0406d990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae2015dbe0 0x7fae2015b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae200b92a0 0x7fae200b5c30 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 --2- 172.21.15.172:0/3579245203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae200b2cb0 0x7fae20155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:04.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 -- 172.21.15.172:0/3579245203 >> 172.21.15.172:0/3579245203 conn(0x7fae20061a20 msgr2=0x7fae20160160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:04.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 -- 172.21.15.172:0/3579245203 shutdown_connections 2024-04-25T08:45:04.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:04.931+0000 7fae2741f640 1 -- 172.21.15.172:0/3579245203 wait complete. 2024-04-25T08:45:04.934 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:43:35.001610+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:43:35.672731+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:45:04.935 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:45:05.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.043+0000 7f41dd42a640 1 Processor -- start 2024-04-25T08:45:05.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.043+0000 7f41dd42a640 1 -- start start 2024-04-25T08:45:05.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41dd42a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f41d80ced80 0x7f41d80d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41dd42a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d815e000 con 0x7f41d8161710 2024-04-25T08:45:05.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41dd42a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d80d1de0 con 0x7f41d815dc20 2024-04-25T08:45:05.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41dd42a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d8161c60 con 0x7f41d80ced80 2024-04-25T08:45:05.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41ce7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f41d80ced80 0x7f41d80d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41d77fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f41d8161710 0x7f41d80d2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41708/0 (socket says 172.21.15.172:41708) 2024-04-25T08:45:05.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41d77fe640 1 -- 172.21.15.172:0/2820765662 learned_addr learned my addr 172.21.15.172:0/2820765662 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:05.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41ce7fc640 1 -- 172.21.15.172:0/2820765662 >> v1:172.21.15.186:6789/0 conn(0x7f41d815dc20 legacy=0x7f41d80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:05.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41d67fc640 1 -- 172.21.15.172:0/2820765662 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446935205 0 0) 0x7f41d815e000 con 0x7f41d8161710 2024-04-25T08:45:05.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41ce7fc640 1 -- 172.21.15.172:0/2820765662 >> v1:172.21.15.172:6789/0 conn(0x7f41d8161710 legacy=0x7f41d80d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.044+0000 7f41ce7fc640 1 -- 172.21.15.172:0/2820765662 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8161f40 con 0x7f41d80ced80 2024-04-25T08:45:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.045+0000 7f41ce7fc640 1 --2- 172.21.15.172:0/2820765662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d80ced80 0x7f41d80d22e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f41c00097a0 tx=0x7f41c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade4b0fd4aafa157 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.045+0000 7f41d67fc640 1 -- 172.21.15.172:0/2820765662 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0037070 con 0x7f41d80ced80 2024-04-25T08:45:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.045+0000 7f41d67fc640 1 -- 172.21.15.172:0/2820765662 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c0032440 con 0x7f41d80ced80 2024-04-25T08:45:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.045+0000 7f41d67fc640 1 -- 172.21.15.172:0/2820765662 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0032810 con 0x7f41d80ced80 2024-04-25T08:45:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.046+0000 7f41dd42a640 1 -- 172.21.15.172:0/2820765662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d80ced80 msgr2=0x7f41d80d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.046+0000 7f41dd42a640 1 --2- 172.21.15.172:0/2820765662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d80ced80 0x7f41d80d22e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f41c00097a0 tx=0x7f41c002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.046+0000 7f41dd42a640 1 -- 172.21.15.172:0/2820765662 shutdown_connections 2024-04-25T08:45:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.046+0000 7f41dd42a640 1 --2- 172.21.15.172:0/2820765662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d80ced80 0x7f41d80d22e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.046+0000 7f41dd42a640 1 -- 172.21.15.172:0/2820765662 >> 172.21.15.172:0/2820765662 conn(0x7f41d80d0420 msgr2=0x7f41d80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:05.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.046+0000 7f41dd42a640 1 -- 172.21.15.172:0/2820765662 shutdown_connections 2024-04-25T08:45:05.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.046+0000 7f41dd42a640 1 -- 172.21.15.172:0/2820765662 wait complete. 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.047+0000 7f41dd42a640 1 Processor -- start 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.047+0000 7f41dd42a640 1 -- start start 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41dd42a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d80ced80 0x7f41d8151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41dd42a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d815dc20 0x7f41d80c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41dd42a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41d8161710 0x7f41d80cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41dd42a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d80b5e50 con 0x7f41d815dc20 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41dd42a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d8162500 con 0x7f41d8161710 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41dd42a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d80b5fd0 con 0x7f41d80ced80 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d815dc20 0x7f41d80c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d815dc20 0x7f41d80c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54434/0 (socket says 172.21.15.172:54434) 2024-04-25T08:45:05.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41ce7fc640 1 -- 172.21.15.172:0/775210571 learned_addr learned my addr 172.21.15.172:0/775210571 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41ce7fc640 1 -- 172.21.15.172:0/775210571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d80ced80 msgr2=0x7f41d8151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41d77fe640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41d8161710 0x7f41d80cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41d6ffd640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d80ced80 0x7f41d8151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41ce7fc640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d80ced80 0x7f41d8151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41ce7fc640 1 -- 172.21.15.172:0/775210571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41d8161710 msgr2=0x7f41d80cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41ce7fc640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41d8161710 0x7f41d80cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.048+0000 7f41ce7fc640 1 -- 172.21.15.172:0/775210571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d80c7dc0 con 0x7f41d815dc20 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.049+0000 7f41ce7fc640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d815dc20 0x7f41d80c7300 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f41c00097a0 tx=0x7f41c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.049+0000 7f41cffff640 1 -- 172.21.15.172:0/775210571 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0037040 con 0x7f41d815dc20 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.049+0000 7f41cffff640 1 -- 172.21.15.172:0/775210571 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c0004250 con 0x7f41d815dc20 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.049+0000 7f41dd42a640 1 -- 172.21.15.172:0/775210571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d80c80a0 con 0x7f41d815dc20 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.049+0000 7f41cffff640 1 -- 172.21.15.172:0/775210571 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0032e20 con 0x7f41d815dc20 2024-04-25T08:45:05.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.049+0000 7f41dd42a640 1 -- 172.21.15.172:0/775210571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d80c8660 con 0x7f41d815dc20 2024-04-25T08:45:05.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.050+0000 7f41dd42a640 1 -- 172.21.15.172:0/775210571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d8073a00 con 0x7f41d815dc20 2024-04-25T08:45:05.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.050+0000 7f41cffff640 1 -- 172.21.15.172:0/775210571 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f41c0030770 con 0x7f41d815dc20 2024-04-25T08:45:05.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.050+0000 7f41cffff640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41b806b4d0 0x7f41b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.050+0000 7f41cffff640 1 -- 172.21.15.172:0/775210571 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f41c00ab670 con 0x7f41d815dc20 2024-04-25T08:45:05.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.051+0000 7f41d6ffd640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41b806b4d0 0x7f41b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.051+0000 7f41d6ffd640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41b806b4d0 0x7f41b806d990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f41d815c6b0 tx=0x7f41c8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.055+0000 7f41cffff640 1 -- 172.21.15.172:0/775210571 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f41c007a330 con 0x7f41d815dc20 2024-04-25T08:45:05.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.227+0000 7f41dd42a640 1 -- 172.21.15.172:0/775210571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41d80cf900 con 0x7f41d815dc20 2024-04-25T08:45:05.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.227+0000 7f41cffff640 1 -- 172.21.15.172:0/775210571 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41c0079c30 con 0x7f41d815dc20 2024-04-25T08:45:05.219 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:45:05.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.229+0000 7f41dd42a640 1 -- 172.21.15.172:0/775210571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41b806b4d0 msgr2=0x7f41b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.229+0000 7f41dd42a640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41b806b4d0 0x7f41b806d990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f41d815c6b0 tx=0x7f41c8009040 comp rx=0 tx=0).stop 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.229+0000 7f41dd42a640 1 -- 172.21.15.172:0/775210571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d815dc20 msgr2=0x7f41d80c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.229+0000 7f41dd42a640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d815dc20 0x7f41d80c7300 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f41c00097a0 tx=0x7f41c00046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.230+0000 7f41dd42a640 1 -- 172.21.15.172:0/775210571 shutdown_connections 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.230+0000 7f41dd42a640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41b806b4d0 0x7f41b806d990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.230+0000 7f41dd42a640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41d8161710 0x7f41d80cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.230+0000 7f41dd42a640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41d815dc20 0x7f41d80c7300 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.230+0000 7f41dd42a640 1 --2- 172.21.15.172:0/775210571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41d80ced80 0x7f41d8151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.230+0000 7f41dd42a640 1 -- 172.21.15.172:0/775210571 >> 172.21.15.172:0/775210571 conn(0x7f41d80d0420 msgr2=0x7f41d80b7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.230+0000 7f41dd42a640 1 -- 172.21.15.172:0/775210571 shutdown_connections 2024-04-25T08:45:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.230+0000 7f41dd42a640 1 -- 172.21.15.172:0/775210571 wait complete. 2024-04-25T08:45:05.232 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:45:05.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.341+0000 7f3844fab640 1 Processor -- start 2024-04-25T08:45:05.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.341+0000 7f3844fab640 1 -- start start 2024-04-25T08:45:05.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.342+0000 7f3844fab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38400cd6f0 0x7f3840165520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.342+0000 7f3844fab640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38400c6940 con 0x7f384015a9f0 2024-04-25T08:45:05.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.342+0000 7f3844fab640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384015add0 con 0x7f38400c6010 2024-04-25T08:45:05.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.342+0000 7f3844fab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38400b0020 con 0x7f38400cd6f0 2024-04-25T08:45:05.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.342+0000 7f383e59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f384015a9f0 0x7f38400cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41724/0 (socket says 172.21.15.172:41724) 2024-04-25T08:45:05.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.342+0000 7f383e59c640 1 -- 172.21.15.172:0/3175324126 learned_addr learned my addr 172.21.15.172:0/3175324126 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383ed9d640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38400cd6f0 0x7f3840165520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694282380 0 0) 0x7f3830001490 con 0x7f384015a9f0 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3828003520 con 0x7f384015a9f0 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3315045852 0 0) 0x7f3828003520 con 0x7f384015a9f0 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38400cd6f0 msgr2=0x7f3840165520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38400cd6f0 0x7f3840165520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 >> v1:172.21.15.186:6789/0 conn(0x7f38400c6010 legacy=0x7f38400ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38400c6660 con 0x7f384015a9f0 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383ed9d640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38400cd6f0 0x7f3840165520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f3830001bc0 con 0x7f384015a9f0 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 >> v1:172.21.15.172:6789/0 conn(0x7f384015a9f0 legacy=0x7f38400cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38400cd6f0 0x7f38280039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3828003f20 0x7f3828004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3828004d40 0x7f38280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382800b9f0 con 0x7f3828004d40 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382800bba0 con 0x7f3828003f20 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382800bda0 con 0x7f38400cd6f0 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383ed9d640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3828004d40 0x7f38280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383e59c640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38400cd6f0 0x7f38280039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383dd9b640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3828003f20 0x7f3828004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383ed9d640 1 -- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38400cd6f0 msgr2=0x7f38280039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383ed9d640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38400cd6f0 0x7f38280039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383ed9d640 1 -- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3828003f20 msgr2=0x7f3828004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383ed9d640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3828003f20 0x7f3828004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.343+0000 7f383ed9d640 1 -- 172.21.15.172:0/3175324126 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3828003520 con 0x7f3828004d40 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.344+0000 7f383ed9d640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3828004d40 0x7f38280051c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3838009c50 tx=0x7f3828005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31e57708d874110 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.344+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838036070 con 0x7f3828004d40 2024-04-25T08:45:05.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.344+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3838031400 con 0x7f3828004d40 2024-04-25T08:45:05.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.344+0000 7f383d59a640 1 -- 172.21.15.172:0/3175324126 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838009820 con 0x7f3828004d40 2024-04-25T08:45:05.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.345+0000 7f3844fab640 1 -- 172.21.15.172:0/3175324126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3828004d40 msgr2=0x7f38280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.345+0000 7f3844fab640 1 --2- 172.21.15.172:0/3175324126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3828004d40 0x7f38280051c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3838009c50 tx=0x7f3828005830 comp rx=0 tx=0).stop 2024-04-25T08:45:05.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.345+0000 7f383ed9d640 1 -- 172.21.15.172:0/3175324126 reap_dead start 2024-04-25T08:45:05.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.345+0000 7f3844fab640 1 -- 172.21.15.172:0/3175324126 shutdown_connections 2024-04-25T08:45:05.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.345+0000 7f3844fab640 1 -- 172.21.15.172:0/3175324126 >> 172.21.15.172:0/3175324126 conn(0x7f38400b2390 msgr2=0x7f38400b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:05.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.345+0000 7f3844fab640 1 -- 172.21.15.172:0/3175324126 shutdown_connections 2024-04-25T08:45:05.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.345+0000 7f3844fab640 1 -- 172.21.15.172:0/3175324126 wait complete. 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.346+0000 7f3844fab640 1 Processor -- start 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.346+0000 7f3844fab640 1 -- start start 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f3844fab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3828004d40 0x7f38400af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f3844fab640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38400af690 0x7f38400b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f3844fab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38400b4440 0x7f384014cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f3844fab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400cb230 con 0x7f38400b4440 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f3844fab640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400cb5a0 con 0x7f38400af690 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f3844fab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38400cca40 con 0x7f3828004d40 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38400b4440 0x7f384014cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38400b4440 0x7f384014cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54464/0 (socket says 172.21.15.172:54464) 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383ed9d640 1 -- 172.21.15.172:0/3841164585 learned_addr learned my addr 172.21.15.172:0/3841164585 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:05.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383e59c640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3828004d40 0x7f38400af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383dd9b640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38400af690 0x7f38400b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383ed9d640 1 -- 172.21.15.172:0/3841164585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3828004d40 msgr2=0x7f38400af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383ed9d640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3828004d40 0x7f38400af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383ed9d640 1 -- 172.21.15.172:0/3841164585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38400af690 msgr2=0x7f38400b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383ed9d640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38400af690 0x7f38400b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383ed9d640 1 -- 172.21.15.172:0/3841164585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38400c8d80 con 0x7f38400b4440 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383e59c640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3828004d40 0x7f38400af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.347+0000 7f383dd9b640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38400af690 0x7f38400b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.348+0000 7f383ed9d640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38400b4440 0x7f384014cb90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3838034040 tx=0x7f3838004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.348+0000 7f382effd640 1 -- 172.21.15.172:0/3841164585 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838036040 con 0x7f38400b4440 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.348+0000 7f382effd640 1 -- 172.21.15.172:0/3841164585 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3838031cc0 con 0x7f38400b4440 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.348+0000 7f3844fab640 1 -- 172.21.15.172:0/3841164585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38400c9060 con 0x7f38400b4440 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.348+0000 7f382effd640 1 -- 172.21.15.172:0/3841164585 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838009820 con 0x7f38400b4440 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.348+0000 7f3844fab640 1 -- 172.21.15.172:0/3841164585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38400c9620 con 0x7f38400b4440 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.349+0000 7f3844fab640 1 -- 172.21.15.172:0/3841164585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384006cc80 con 0x7f38400b4440 2024-04-25T08:45:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.349+0000 7f382effd640 1 -- 172.21.15.172:0/3841164585 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3838045030 con 0x7f38400b4440 2024-04-25T08:45:05.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.350+0000 7f382effd640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f382006b500 0x7f382006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.350+0000 7f382effd640 1 -- 172.21.15.172:0/3841164585 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f38380a9bd0 con 0x7f38400b4440 2024-04-25T08:45:05.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.350+0000 7f383e59c640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f382006b500 0x7f382006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.350+0000 7f383e59c640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f382006b500 0x7f382006d9c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38300013d0 tx=0x7f3830006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.354+0000 7f382effd640 1 -- 172.21.15.172:0/3841164585 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f383804c060 con 0x7f38400b4440 2024-04-25T08:45:05.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.528+0000 7f3844fab640 1 -- 172.21.15.172:0/3841164585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3840071b70 con 0x7f38400b4440 2024-04-25T08:45:05.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.529+0000 7f382effd640 1 -- 172.21.15.172:0/3841164585 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3840071b70 con 0x7f38400b4440 2024-04-25T08:45:05.520 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.530+0000 7f3844fab640 1 -- 172.21.15.172:0/3841164585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f382006b500 msgr2=0x7f382006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.530+0000 7f3844fab640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f382006b500 0x7f382006d9c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f38300013d0 tx=0x7f3830006040 comp rx=0 tx=0).stop 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.531+0000 7f3844fab640 1 -- 172.21.15.172:0/3841164585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38400b4440 msgr2=0x7f384014cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.531+0000 7f3844fab640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38400b4440 0x7f384014cb90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3838034040 tx=0x7f3838004730 comp rx=0 tx=0).stop 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.531+0000 7f3844fab640 1 -- 172.21.15.172:0/3841164585 shutdown_connections 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.531+0000 7f3844fab640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f382006b500 0x7f382006d9c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.531+0000 7f3844fab640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38400af690 0x7f38400b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.531+0000 7f3844fab640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38400b4440 0x7f384014cb90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.531+0000 7f3844fab640 1 --2- 172.21.15.172:0/3841164585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3828004d40 0x7f38400af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.531+0000 7f3844fab640 1 -- 172.21.15.172:0/3841164585 >> 172.21.15.172:0/3841164585 conn(0x7f38400b2390 msgr2=0x7f384006e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.531+0000 7f3844fab640 1 -- 172.21.15.172:0/3841164585 shutdown_connections 2024-04-25T08:45:05.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.531+0000 7f3844fab640 1 -- 172.21.15.172:0/3841164585 wait complete. 2024-04-25T08:45:05.533 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:45:05.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.642+0000 7fd7d8d1d640 1 Processor -- start 2024-04-25T08:45:05.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.642+0000 7fd7d8d1d640 1 -- start start 2024-04-25T08:45:05.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d8d1d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd7d4144d20 0x7fd7d40ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d8d1d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7d41454b0 0x7fd7d4070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d8d1d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d40ceba0 con 0x7fd7d4071300 2024-04-25T08:45:05.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d8d1d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d4071750 con 0x7fd7d4144d20 2024-04-25T08:45:05.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d8d1d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d40b4830 con 0x7fd7d41454b0 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd7d4144d20 0x7fd7d40ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d2d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd7d4071300 0x7fd7d415f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41734/0 (socket says 172.21.15.172:41734) 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d2d9d640 1 -- 172.21.15.172:0/1875128318 learned_addr learned my addr 172.21.15.172:0/1875128318 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd7d4144d20 0x7fd7d40ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54468/0 (socket says 172.21.15.172:54468) 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d259c640 1 -- 172.21.15.172:0/1875128318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7d41454b0 msgr2=0x7fd7d4070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7cbfff640 1 --2- 172.21.15.172:0/1875128318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7d41454b0 0x7fd7d4070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d259c640 1 --2- 172.21.15.172:0/1875128318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7d41454b0 0x7fd7d4070dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d259c640 1 -- 172.21.15.172:0/1875128318 >> v1:172.21.15.172:6789/0 conn(0x7fd7d4071300 legacy=0x7fd7d415f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d259c640 1 -- 172.21.15.172:0/1875128318 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40cee80 con 0x7fd7d4144d20 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.643+0000 7fd7d1d9b640 1 -- 172.21.15.172:0/1875128318 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641428568 0 0) 0x7fd7d40ceba0 con 0x7fd7d4071300 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.644+0000 7fd7d259c640 1 --2- 172.21.15.172:0/1875128318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d4144d20 0x7fd7d40ce350 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40097a0 tx=0x7fd7c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f9917fb19aafa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.644+0000 7fd7d1d9b640 1 -- 172.21.15.172:0/1875128318 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4037070 con 0x7fd7d4144d20 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.644+0000 7fd7d1d9b640 1 -- 172.21.15.172:0/1875128318 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c4032440 con 0x7fd7d4144d20 2024-04-25T08:45:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.644+0000 7fd7d1d9b640 1 -- 172.21.15.172:0/1875128318 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4032810 con 0x7fd7d4144d20 2024-04-25T08:45:05.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.644+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1875128318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d4144d20 msgr2=0x7fd7d40ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.644+0000 7fd7d8d1d640 1 --2- 172.21.15.172:0/1875128318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d4144d20 0x7fd7d40ce350 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40097a0 tx=0x7fd7c402a180 comp rx=0 tx=0).stop 2024-04-25T08:45:05.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.644+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1875128318 shutdown_connections 2024-04-25T08:45:05.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.644+0000 7fd7d8d1d640 1 --2- 172.21.15.172:0/1875128318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7d41454b0 0x7fd7d4070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.644+0000 7fd7d8d1d640 1 --2- 172.21.15.172:0/1875128318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d4144d20 0x7fd7d40ce350 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.644+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1875128318 >> 172.21.15.172:0/1875128318 conn(0x7fd7d40b3530 msgr2=0x7fd7d40b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:05.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.645+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1875128318 shutdown_connections 2024-04-25T08:45:05.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.645+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1875128318 wait complete. 2024-04-25T08:45:05.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.646+0000 7fd7d8d1d640 1 Processor -- start 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.646+0000 7fd7d8d1d640 1 -- start start 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d8d1d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7d4071300 0x7fd7d40cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d8d1d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7d4144d20 0x7fd7d41f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d8d1d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d41454b0 0x7fd7d41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d8d1d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d40ce890 con 0x7fd7d41454b0 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d8d1d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d40cf440 con 0x7fd7d4071300 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d8d1d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d4145100 con 0x7fd7d4144d20 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d41454b0 0x7fd7d41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d41454b0 0x7fd7d41551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54484/0 (socket says 172.21.15.172:54484) 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d2d9d640 1 -- 172.21.15.172:0/1240352456 learned_addr learned my addr 172.21.15.172:0/1240352456 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7cbfff640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7d4144d20 0x7fd7d41f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d259c640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7d4071300 0x7fd7d40cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d2d9d640 1 -- 172.21.15.172:0/1240352456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7d4144d20 msgr2=0x7fd7d41f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d2d9d640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7d4144d20 0x7fd7d41f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d2d9d640 1 -- 172.21.15.172:0/1240352456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7d4071300 msgr2=0x7fd7d40cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d2d9d640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7d4071300 0x7fd7d40cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d2d9d640 1 -- 172.21.15.172:0/1240352456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40ca250 con 0x7fd7d41454b0 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d259c640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7d4071300 0x7fd7d40cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d2d9d640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d41454b0 0x7fd7d41551e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00c700 tx=0x7fd7cc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7caffd640 1 -- 172.21.15.172:0/1240352456 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc018070 con 0x7fd7d41454b0 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7caffd640 1 -- 172.21.15.172:0/1240352456 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc00ce10 con 0x7fd7d41454b0 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1240352456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d40ca530 con 0x7fd7d41454b0 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7caffd640 1 -- 172.21.15.172:0/1240352456 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00a800 con 0x7fd7d41454b0 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.647+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1240352456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d40caaf0 con 0x7fd7d41454b0 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.648+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1240352456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d4073a00 con 0x7fd7d41454b0 2024-04-25T08:45:05.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.649+0000 7fd7caffd640 1 -- 172.21.15.172:0/1240352456 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd7cc01b070 con 0x7fd7d41454b0 2024-04-25T08:45:05.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.649+0000 7fd7caffd640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd7b406b4d0 0x7fd7b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.649+0000 7fd7caffd640 1 -- 172.21.15.172:0/1240352456 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7fd7cc089790 con 0x7fd7d41454b0 2024-04-25T08:45:05.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.649+0000 7fd7d259c640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd7b406b4d0 0x7fd7b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.649+0000 7fd7d259c640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd7b406b4d0 0x7fd7b406d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4034000 tx=0x7fd7c402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.653+0000 7fd7caffd640 1 -- 172.21.15.172:0/1240352456 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd7cc057e90 con 0x7fd7d41454b0 2024-04-25T08:45:05.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.822+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1240352456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7d40b4200 con 0x7fd7d41454b0 2024-04-25T08:45:05.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.822+0000 7fd7caffd640 1 -- 172.21.15.172:0/1240352456 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7cc05bf30 con 0x7fd7d41454b0 2024-04-25T08:45:05.814 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:45:05.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1240352456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd7b406b4d0 msgr2=0x7fd7b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd7b406b4d0 0x7fd7b406d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4034000 tx=0x7fd7c402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1240352456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d41454b0 msgr2=0x7fd7d41551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d41454b0 0x7fd7d41551e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00c700 tx=0x7fd7cc00cbc0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1240352456 shutdown_connections 2024-04-25T08:45:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd7b406b4d0 0x7fd7b406d990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d41454b0 0x7fd7d41551e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7d4144d20 0x7fd7d41f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 --2- 172.21.15.172:0/1240352456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7d4071300 0x7fd7d40cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1240352456 >> 172.21.15.172:0/1240352456 conn(0x7fd7d40b3530 msgr2=0x7fd7d40b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1240352456 shutdown_connections 2024-04-25T08:45:05.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.824+0000 7fd7d8d1d640 1 -- 172.21.15.172:0/1240352456 wait complete. 2024-04-25T08:45:05.827 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:05.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.933+0000 7f4ffebb6640 1 Processor -- start 2024-04-25T08:45:05.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.933+0000 7f4ffebb6640 1 -- start start 2024-04-25T08:45:05.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ffebb6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4ff80d1dd0 0x7f4ff80ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ffebb6640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff815dfe0 con 0x7f4ff80c6df0 2024-04-25T08:45:05.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ffebb6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff80d00c0 con 0x7f4ff815dc00 2024-04-25T08:45:05.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ffebb6640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff80d03a0 con 0x7f4ff80d1dd0 2024-04-25T08:45:05.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff7fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4ff80c6df0 0x7f4ff80d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41744/0 (socket says 172.21.15.172:41744) 2024-04-25T08:45:05.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff7fff640 1 -- 172.21.15.172:0/2334380108 learned_addr learned my addr 172.21.15.172:0/2334380108 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:05.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ffd153640 1 --2- 172.21.15.172:0/2334380108 >> v2:172.21.15.186:3300/0 conn(0x7f4ff80d1dd0 0x7f4ff80ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783527906 0 0) 0x7f4fe4001110 con 0x7f4ff80c6df0 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe8003520 con 0x7f4ff80c6df0 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3385891900 0 0) 0x7f4fe8003520 con 0x7f4ff80c6df0 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 >> v2:172.21.15.186:3300/0 conn(0x7f4ff80d1dd0 msgr2=0x7f4ff80ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 --2- 172.21.15.172:0/2334380108 >> v2:172.21.15.186:3300/0 conn(0x7f4ff80d1dd0 0x7f4ff80ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 >> v1:172.21.15.186:6789/0 conn(0x7f4ff815dc00 legacy=0x7f4ff80ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff80cc440 con 0x7f4ff80c6df0 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f4fe4001840 con 0x7f4ff80c6df0 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 >> v1:172.21.15.172:6789/0 conn(0x7f4ff80c6df0 legacy=0x7f4ff80d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fe80039b0 0x7f4fe8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fe8004800 0x7f4fe8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe80051c0 0x7f4fe800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80d03a0 con 0x7f4fe80039b0 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe800c060 con 0x7f4fe8004800 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe800c260 con 0x7f4fe80051c0 2024-04-25T08:45:05.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.934+0000 7f4ffc952640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fe80039b0 0x7f4fe8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ff7fff640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fe8004800 0x7f4fe8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ffd153640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe80051c0 0x7f4fe800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ffc952640 1 -- 172.21.15.172:0/2334380108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe80051c0 msgr2=0x7f4fe800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ffc952640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe80051c0 0x7f4fe800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ffc952640 1 -- 172.21.15.172:0/2334380108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fe8004800 msgr2=0x7f4fe8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ffc952640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fe8004800 0x7f4fe8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ffc952640 1 -- 172.21.15.172:0/2334380108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe8003520 con 0x7f4fe80039b0 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ff7fff640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fe8004800 0x7f4fe8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ffd153640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe80051c0 0x7f4fe800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ffd153640 1 -- 172.21.15.172:0/2334380108 reap_dead start 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.935+0000 7f4ffc952640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fe80039b0 0x7f4fe8003dd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4fec001750 tx=0x7f4fe8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b963d31bae9a8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.936+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec001370 con 0x7f4fe80039b0 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.936+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec0052d0 con 0x7f4fe80039b0 2024-04-25T08:45:05.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.936+0000 7f4ff77fe640 1 -- 172.21.15.172:0/2334380108 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec02abc0 con 0x7f4fe80039b0 2024-04-25T08:45:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.936+0000 7f4ffebb6640 1 -- 172.21.15.172:0/2334380108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fe80039b0 msgr2=0x7f4fe8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.936+0000 7f4ffebb6640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fe80039b0 0x7f4fe8003dd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4fec001750 tx=0x7f4fe8005830 comp rx=0 tx=0).stop 2024-04-25T08:45:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.936+0000 7f4ffebb6640 1 -- 172.21.15.172:0/2334380108 shutdown_connections 2024-04-25T08:45:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.936+0000 7f4ffebb6640 1 --2- 172.21.15.172:0/2334380108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fe80039b0 0x7f4fe8003dd0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.936+0000 7f4ffebb6640 1 -- 172.21.15.172:0/2334380108 >> 172.21.15.172:0/2334380108 conn(0x7f4ff806f5d0 msgr2=0x7f4ff806f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.936+0000 7f4ffebb6640 1 -- 172.21.15.172:0/2334380108 shutdown_connections 2024-04-25T08:45:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.936+0000 7f4ffebb6640 1 -- 172.21.15.172:0/2334380108 wait complete. 2024-04-25T08:45:05.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.937+0000 7f4ffebb6640 1 Processor -- start 2024-04-25T08:45:05.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.937+0000 7f4ffebb6640 1 -- start start 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ffebb6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe80039b0 0x7f4ff80b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ffebb6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ff8151760 0x7f4ff81f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ffebb6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff81f7590 0x7f4ff81f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ffebb6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80cfd90 con 0x7f4ff81f7590 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ffebb6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80cc130 con 0x7f4ff8151760 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ffebb6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80cdd70 con 0x7f4fe80039b0 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ffd153640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff81f7590 0x7f4ff81f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ffd153640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff81f7590 0x7f4ff81f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54498/0 (socket says 172.21.15.172:54498) 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ffd153640 1 -- 172.21.15.172:0/637666569 learned_addr learned my addr 172.21.15.172:0/637666569 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ffc952640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe80039b0 0x7f4ff80b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.938+0000 7f4ff7fff640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ff8151760 0x7f4ff81f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ffd153640 1 -- 172.21.15.172:0/637666569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe80039b0 msgr2=0x7f4ff80b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ffd153640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe80039b0 0x7f4ff80b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ffd153640 1 -- 172.21.15.172:0/637666569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ff8151760 msgr2=0x7f4ff81f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ffd153640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ff8151760 0x7f4ff81f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ffd153640 1 -- 172.21.15.172:0/637666569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff81f7f50 con 0x7f4ff81f7590 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ff7fff640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ff8151760 0x7f4ff81f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ffd153640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff81f7590 0x7f4ff81f7a10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80c6d40 tx=0x7f4ff0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ff57fa640 1 -- 172.21.15.172:0/637666569 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0010e00 con 0x7f4ff81f7590 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ff57fa640 1 -- 172.21.15.172:0/637666569 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0003990 con 0x7f4ff81f7590 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ffebb6640 1 -- 172.21.15.172:0/637666569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff80b7310 con 0x7f4ff81f7590 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ff57fa640 1 -- 172.21.15.172:0/637666569 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0003d80 con 0x7f4ff81f7590 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.939+0000 7f4ffebb6640 1 -- 172.21.15.172:0/637666569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff81e7850 con 0x7f4ff81f7590 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.940+0000 7f4ffebb6640 1 -- 172.21.15.172:0/637666569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff81e7f50 con 0x7f4ff81f7590 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.940+0000 7f4ff57fa640 1 -- 172.21.15.172:0/637666569 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ff001e030 con 0x7f4ff81f7590 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.941+0000 7f4ff57fa640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4fdc06b4d0 0x7f4fdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.941+0000 7f4ff57fa640 1 -- 172.21.15.172:0/637666569 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f4ff008aa10 con 0x7f4ff81f7590 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.941+0000 7f4ffc952640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4fdc06b4d0 0x7f4fdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:05.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.941+0000 7f4ffc952640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4fdc06b4d0 0x7f4fdc06d990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4fec032000 tx=0x7f4fec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:05.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:05.945+0000 7f4ff57fa640 1 -- 172.21.15.172:0/637666569 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ff0025020 con 0x7f4ff81f7590 2024-04-25T08:45:06.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.151+0000 7f4ffebb6640 1 -- 172.21.15.172:0/637666569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ff8073990 con 0x7f4ff81f7590 2024-04-25T08:45:06.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.151+0000 7f4ff57fa640 1 -- 172.21.15.172:0/637666569 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f4ff0059760 con 0x7f4ff81f7590 2024-04-25T08:45:06.143 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:06.144 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/1959121045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1959121045},{"type":"v1","addr":"172.21.15.186:6834","nonce":1959121045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/898320853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":898320853},{"type":"v1","addr":"172.21.15.186:6835","nonce":898320853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1482887107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1482887107},{"type":"v1","addr":"172.21.15.172:6836","nonce":1482887107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:43:36.707052+0000","modified":"2024-04-25T08:43:47.700780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3537703238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3537703238},{"type":"v1","addr":"172.21.15.172:6837","nonce":3537703238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:45:06.144 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 16 2024-04-25T08:45:06.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 -- 172.21.15.172:0/637666569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4fdc06b4d0 msgr2=0x7f4fdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4fdc06b4d0 0x7f4fdc06d990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4fec032000 tx=0x7f4fec02e000 comp rx=0 tx=0).stop 2024-04-25T08:45:06.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 -- 172.21.15.172:0/637666569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff81f7590 msgr2=0x7f4ff81f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff81f7590 0x7f4ff81f7a10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80c6d40 tx=0x7f4ff0010590 comp rx=0 tx=0).stop 2024-04-25T08:45:06.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 -- 172.21.15.172:0/637666569 shutdown_connections 2024-04-25T08:45:06.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4fdc06b4d0 0x7f4fdc06d990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ff8151760 0x7f4ff81f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff81f7590 0x7f4ff81f7a10 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 --2- 172.21.15.172:0/637666569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe80039b0 0x7f4ff80b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 -- 172.21.15.172:0/637666569 >> 172.21.15.172:0/637666569 conn(0x7f4ff806f5d0 msgr2=0x7f4ff80d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:06.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 -- 172.21.15.172:0/637666569 shutdown_connections 2024-04-25T08:45:06.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.153+0000 7f4ffebb6640 1 -- 172.21.15.172:0/637666569 wait complete. 2024-04-25T08:45:06.156 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:06.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.261+0000 7f114da7c640 1 Processor -- start 2024-04-25T08:45:06.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.261+0000 7f114da7c640 1 -- start start 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f114da7c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1148071ac0 0x7f11480ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f114da7c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f114806c1d0 0x7f114806afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f114da7c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114815ec60 con 0x7f1148154ed0 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f114da7c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114815ef40 con 0x7f1148071ac0 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f114da7c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114806db90 con 0x7f114806c1d0 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f1146ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1148071ac0 0x7f11480ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f1146ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1148071ac0 0x7f11480ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54504/0 (socket says 172.21.15.172:54504) 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f1146ffd640 1 -- 172.21.15.172:0/4235724429 learned_addr learned my addr 172.21.15.172:0/4235724429 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f1146ffd640 1 -- 172.21.15.172:0/4235724429 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f114806c1d0 msgr2=0x7f114806afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f1147fff640 1 --2- 172.21.15.172:0/4235724429 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f114806c1d0 0x7f114806afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f1146ffd640 1 --2- 172.21.15.172:0/4235724429 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f114806c1d0 0x7f114806afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f1146ffd640 1 -- 172.21.15.172:0/4235724429 >> v1:172.21.15.186:6789/0 conn(0x7f1148154ed0 legacy=0x7f11480aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f1146ffd640 1 -- 172.21.15.172:0/4235724429 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114806de70 con 0x7f1148071ac0 2024-04-25T08:45:06.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.262+0000 7f1147fff640 1 --2- 172.21.15.172:0/4235724429 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f114806c1d0 0x7f114806afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:06.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.263+0000 7f1146ffd640 1 --2- 172.21.15.172:0/4235724429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148071ac0 0x7f11480ad5e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f113c009870 tx=0x7f113c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a471a729b4034b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:06.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.263+0000 7f11467fc640 1 -- 172.21.15.172:0/4235724429 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c037070 con 0x7f1148071ac0 2024-04-25T08:45:06.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.263+0000 7f11467fc640 1 -- 172.21.15.172:0/4235724429 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c032440 con 0x7f1148071ac0 2024-04-25T08:45:06.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.263+0000 7f11467fc640 1 -- 172.21.15.172:0/4235724429 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c032810 con 0x7f1148071ac0 2024-04-25T08:45:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.264+0000 7f114da7c640 1 -- 172.21.15.172:0/4235724429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148071ac0 msgr2=0x7f11480ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.264+0000 7f114da7c640 1 --2- 172.21.15.172:0/4235724429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148071ac0 0x7f11480ad5e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f113c009870 tx=0x7f113c02a250 comp rx=0 tx=0).stop 2024-04-25T08:45:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.264+0000 7f114da7c640 1 -- 172.21.15.172:0/4235724429 shutdown_connections 2024-04-25T08:45:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.264+0000 7f114da7c640 1 --2- 172.21.15.172:0/4235724429 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f114806c1d0 0x7f114806afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.264+0000 7f114da7c640 1 --2- 172.21.15.172:0/4235724429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148071ac0 0x7f11480ad5e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.264+0000 7f114da7c640 1 -- 172.21.15.172:0/4235724429 >> 172.21.15.172:0/4235724429 conn(0x7f11480af670 msgr2=0x7f11480b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.264+0000 7f114da7c640 1 -- 172.21.15.172:0/4235724429 shutdown_connections 2024-04-25T08:45:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.264+0000 7f114da7c640 1 -- 172.21.15.172:0/4235724429 wait complete. 2024-04-25T08:45:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.265+0000 7f114da7c640 1 Processor -- start 2024-04-25T08:45:06.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.265+0000 7f114da7c640 1 -- start start 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f114da7c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1148071ac0 0x7f114814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f114da7c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148154ed0 0x7f11480ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f114da7c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f11480ceee0 0x7f11480b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f114da7c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114806b660 con 0x7f1148154ed0 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f114da7c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114806b4e0 con 0x7f11480ceee0 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f114da7c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114806b7e0 con 0x7f1148071ac0 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f1146ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148154ed0 0x7f11480ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f1146ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148154ed0 0x7f11480ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54508/0 (socket says 172.21.15.172:54508) 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f1146ffd640 1 -- 172.21.15.172:0/3191288152 learned_addr learned my addr 172.21.15.172:0/3191288152 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f1147fff640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f11480ceee0 0x7f11480b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f11477fe640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1148071ac0 0x7f114814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f1146ffd640 1 -- 172.21.15.172:0/3191288152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1148071ac0 msgr2=0x7f114814bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f1146ffd640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1148071ac0 0x7f114814bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f1146ffd640 1 -- 172.21.15.172:0/3191288152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f11480ceee0 msgr2=0x7f11480b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f1146ffd640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f11480ceee0 0x7f11480b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f1146ffd640 1 -- 172.21.15.172:0/3191288152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1148156f50 con 0x7f1148154ed0 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f1146ffd640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148154ed0 0x7f11480ce9a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f113c000c00 tx=0x7f113c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f112ffff640 1 -- 172.21.15.172:0/3191288152 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c037040 con 0x7f1148154ed0 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f112ffff640 1 -- 172.21.15.172:0/3191288152 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c042070 con 0x7f1148154ed0 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f114da7c640 1 -- 172.21.15.172:0/3191288152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1148157230 con 0x7f1148154ed0 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f112ffff640 1 -- 172.21.15.172:0/3191288152 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c030bd0 con 0x7f1148154ed0 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.266+0000 7f114da7c640 1 -- 172.21.15.172:0/3191288152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11481577f0 con 0x7f1148154ed0 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.267+0000 7f114da7c640 1 -- 172.21.15.172:0/3191288152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11480cf2f0 con 0x7f1148154ed0 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.268+0000 7f112ffff640 1 -- 172.21.15.172:0/3191288152 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f113c047460 con 0x7f1148154ed0 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.268+0000 7f112ffff640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f113406b4d0 0x7f113406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.268+0000 7f112ffff640 1 -- 172.21.15.172:0/3191288152 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f113c0aaf30 con 0x7f1148154ed0 2024-04-25T08:45:06.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.268+0000 7f11477fe640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f113406b4d0 0x7f113406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.269+0000 7f11477fe640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f113406b4d0 0x7f113406d990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1138007fd0 tx=0x7f1138009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:06.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.272+0000 7f112ffff640 1 -- 172.21.15.172:0/3191288152 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11480cf2f0 con 0x7f1148154ed0 2024-04-25T08:45:06.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.447+0000 7f114da7c640 1 -- 172.21.15.172:0/3191288152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1148073990 con 0x7f1148154ed0 2024-04-25T08:45:06.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.448+0000 7f112ffff640 1 -- 172.21.15.172:0/3191288152 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17060 (secure 0 0 0) 0x7f113c045360 con 0x7f1148154ed0 2024-04-25T08:45:06.440 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:06.441 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":42,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:44:44.243816+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:43:35.001610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T08:43:35.672731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:06.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.450+0000 7f114da7c640 1 -- 172.21.15.172:0/3191288152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f113406b4d0 msgr2=0x7f113406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.450+0000 7f114da7c640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f113406b4d0 0x7f113406d990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1138007fd0 tx=0x7f1138009040 comp rx=0 tx=0).stop 2024-04-25T08:45:06.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.450+0000 7f114da7c640 1 -- 172.21.15.172:0/3191288152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148154ed0 msgr2=0x7f11480ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.450+0000 7f114da7c640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148154ed0 0x7f11480ce9a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f113c000c00 tx=0x7f113c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.450+0000 7f114da7c640 1 -- 172.21.15.172:0/3191288152 shutdown_connections 2024-04-25T08:45:06.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.450+0000 7f114da7c640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f113406b4d0 0x7f113406d990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.450+0000 7f114da7c640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f11480ceee0 0x7f11480b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.450+0000 7f114da7c640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1148154ed0 0x7f11480ce9a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.450+0000 7f114da7c640 1 --2- 172.21.15.172:0/3191288152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1148071ac0 0x7f114814bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.450+0000 7f114da7c640 1 -- 172.21.15.172:0/3191288152 >> 172.21.15.172:0/3191288152 conn(0x7f114806c1d0 msgr2=0x7f11480aced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:06.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.451+0000 7f114da7c640 1 -- 172.21.15.172:0/3191288152 shutdown_connections 2024-04-25T08:45:06.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.451+0000 7f114da7c640 1 -- 172.21.15.172:0/3191288152 wait complete. 2024-04-25T08:45:06.453 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:45:06.454 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:06.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.560+0000 7f062a36a640 1 Processor -- start 2024-04-25T08:45:06.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.561+0000 7f062a36a640 1 -- start start 2024-04-25T08:45:06.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.561+0000 7f062a36a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062415dbe0 0x7f06240d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.561+0000 7f062a36a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240b6220 con 0x7f06240b92a0 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.561+0000 7f062a36a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240b97a0 con 0x7f06240b2cb0 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.561+0000 7f062a36a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062415dfc0 con 0x7f062415dbe0 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.561+0000 7f0628907640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f06240b92a0 0x7f06240b5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41754/0 (socket says 172.21.15.172:41754) 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.561+0000 7f0628907640 1 -- 172.21.15.172:0/2911997988 learned_addr learned my addr 172.21.15.172:0/2911997988 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0623fff640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062415dbe0 0x7f06240d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72228722 0 0) 0x7f06240b6220 con 0x7f06240b92a0 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f060c003520 con 0x7f06240b92a0 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1488558981 0 0) 0x7f060c003520 con 0x7f06240b92a0 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062415dbe0 msgr2=0x7f06240d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062415dbe0 0x7f06240d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 >> v1:172.21.15.186:6789/0 conn(0x7f06240b2cb0 legacy=0x7f06240b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240d1c50 con 0x7f06240b92a0 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f061c0019f0 con 0x7f06240b92a0 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 >> v1:172.21.15.172:6789/0 conn(0x7f06240b92a0 legacy=0x7f06240b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f060c0039e0 0x7f060c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f060c004390 0x7f060c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062415dbe0 0x7f060c0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c00b9c0 con 0x7f060c0039e0 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c00bb40 con 0x7f060c004390 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c00bd40 con 0x7f062415dbe0 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0623fff640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f060c0039e0 0x7f060c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0628907640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062415dbe0 0x7f060c0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f06237fe640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f060c004390 0x7f060c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0623fff640 1 -- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062415dbe0 msgr2=0x7f060c0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0623fff640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062415dbe0 0x7f060c0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0623fff640 1 -- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f060c004390 msgr2=0x7f060c004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:06.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0623fff640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f060c004390 0x7f060c004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0623fff640 1 -- 172.21.15.172:0/2911997988 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c003520 con 0x7f060c0039e0 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f0628907640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f062415dbe0 0x7f060c0050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.562+0000 7f06237fe640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f060c004390 0x7f060c004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.563+0000 7f0623fff640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f060c0039e0 0x7f060c003dc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0614009ac0 tx=0x7f060c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f5729fb49c6e5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.563+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614036070 con 0x7f060c0039e0 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.563+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0614031400 con 0x7f060c0039e0 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.563+0000 7f0622ffd640 1 -- 172.21.15.172:0/2911997988 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614009690 con 0x7f060c0039e0 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.564+0000 7f062a36a640 1 -- 172.21.15.172:0/2911997988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f060c0039e0 msgr2=0x7f060c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.564+0000 7f062a36a640 1 --2- 172.21.15.172:0/2911997988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f060c0039e0 0x7f060c003dc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0614009ac0 tx=0x7f060c005830 comp rx=0 tx=0).stop 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.564+0000 7f0628907640 1 -- 172.21.15.172:0/2911997988 reap_dead start 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.564+0000 7f062a36a640 1 -- 172.21.15.172:0/2911997988 shutdown_connections 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.564+0000 7f062a36a640 1 -- 172.21.15.172:0/2911997988 >> 172.21.15.172:0/2911997988 conn(0x7f0624061a20 msgr2=0x7f0624061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.564+0000 7f062a36a640 1 -- 172.21.15.172:0/2911997988 shutdown_connections 2024-04-25T08:45:06.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.564+0000 7f062a36a640 1 -- 172.21.15.172:0/2911997988 wait complete. 2024-04-25T08:45:06.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.565+0000 7f062a36a640 1 Processor -- start 2024-04-25T08:45:06.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.565+0000 7f062a36a640 1 -- start start 2024-04-25T08:45:06.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f062a36a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f060c0039e0 0x7f06240caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f062a36a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0624153f90 0x7f0624153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f062a36a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0624156a80 0x7f0624158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f062a36a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06240d2210 con 0x7f0624153f90 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f062a36a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06240d1a00 con 0x7f0624156a80 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f062a36a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06240b6ab0 con 0x7f060c0039e0 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f06237fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0624153f90 0x7f0624153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f06237fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0624153f90 0x7f0624153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54514/0 (socket says 172.21.15.172:54514) 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f06237fe640 1 -- 172.21.15.172:0/2953979704 learned_addr learned my addr 172.21.15.172:0/2953979704 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f0628907640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0624156a80 0x7f0624158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f0623fff640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f060c0039e0 0x7f06240caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f06237fe640 1 -- 172.21.15.172:0/2953979704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f060c0039e0 msgr2=0x7f06240caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f06237fe640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f060c0039e0 0x7f06240caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f06237fe640 1 -- 172.21.15.172:0/2953979704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0624156a80 msgr2=0x7f0624158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f06237fe640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0624156a80 0x7f0624158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f06237fe640 1 -- 172.21.15.172:0/2953979704 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0624157460 con 0x7f0624153f90 2024-04-25T08:45:06.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.566+0000 7f0623fff640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f060c0039e0 0x7f06240caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.567+0000 7f06237fe640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0624153f90 0x7f0624153230 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f061800e880 tx=0x7f061800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.567+0000 7f0620ff9640 1 -- 172.21.15.172:0/2953979704 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180050d0 con 0x7f0624153f90 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.567+0000 7f0620ff9640 1 -- 172.21.15.172:0/2953979704 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0618018070 con 0x7f0624153f90 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.567+0000 7f062a36a640 1 -- 172.21.15.172:0/2953979704 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0624157740 con 0x7f0624153f90 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.567+0000 7f0620ff9640 1 -- 172.21.15.172:0/2953979704 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618005470 con 0x7f0624153f90 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.567+0000 7f062a36a640 1 -- 172.21.15.172:0/2953979704 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062415e4b0 con 0x7f0624153f90 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.568+0000 7f062a36a640 1 -- 172.21.15.172:0/2953979704 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0624073990 con 0x7f0624153f90 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.568+0000 7f0620ff9640 1 -- 172.21.15.172:0/2953979704 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f061800c6c0 con 0x7f0624153f90 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.569+0000 7f0620ff9640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061006b500 0x7f061006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.569+0000 7f0623fff640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061006b500 0x7f061006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.569+0000 7f0620ff9640 1 -- 172.21.15.172:0/2953979704 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f061808a130 con 0x7f0624153f90 2024-04-25T08:45:06.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.569+0000 7f0623fff640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061006b500 0x7f061006d9c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0614009ac0 tx=0x7f0614008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:06.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.573+0000 7f0620ff9640 1 -- 172.21.15.172:0/2953979704 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0618058df0 con 0x7f0624153f90 2024-04-25T08:45:06.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.778+0000 7f062a36a640 1 -- 172.21.15.172:0/2953979704 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06240d3170 con 0x7f0624153f90 2024-04-25T08:45:06.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.779+0000 7f0620ff9640 1 -- 172.21.15.172:0/2953979704 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f06180586f0 con 0x7f0624153f90 2024-04-25T08:45:06.771 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:06.771 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/1959121045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1959121045},{"type":"v1","addr":"172.21.15.186:6834","nonce":1959121045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/898320853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":898320853},{"type":"v1","addr":"172.21.15.186:6835","nonce":898320853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1482887107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1482887107},{"type":"v1","addr":"172.21.15.172:6836","nonce":1482887107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:43:36.707052+0000","modified":"2024-04-25T08:43:47.700780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3537703238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3537703238},{"type":"v1","addr":"172.21.15.172:6837","nonce":3537703238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:45:06.771 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 16 2024-04-25T08:45:06.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 -- 172.21.15.172:0/2953979704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061006b500 msgr2=0x7f061006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061006b500 0x7f061006d9c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0614009ac0 tx=0x7f0614008030 comp rx=0 tx=0).stop 2024-04-25T08:45:06.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 -- 172.21.15.172:0/2953979704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0624153f90 msgr2=0x7f0624153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0624153f90 0x7f0624153230 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f061800e880 tx=0x7f061800ec80 comp rx=0 tx=0).stop 2024-04-25T08:45:06.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 -- 172.21.15.172:0/2953979704 shutdown_connections 2024-04-25T08:45:06.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f061006b500 0x7f061006d9c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0624156a80 0x7f0624158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0624153f90 0x7f0624153230 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 --2- 172.21.15.172:0/2953979704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f060c0039e0 0x7f06240caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 -- 172.21.15.172:0/2953979704 >> 172.21.15.172:0/2953979704 conn(0x7f0624061a20 msgr2=0x7f0624061e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:06.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 -- 172.21.15.172:0/2953979704 shutdown_connections 2024-04-25T08:45:06.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.781+0000 7f062a36a640 1 -- 172.21.15.172:0/2953979704 wait complete. 2024-04-25T08:45:06.783 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:06.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.889+0000 7f982741f640 1 Processor -- start 2024-04-25T08:45:06.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.889+0000 7f982741f640 1 -- start start 2024-04-25T08:45:06.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f982741f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f98200cfec0 0x7f98200cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f982741f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98200ce3c0 0x7f982006d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f982741f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9820071480 con 0x7f9820154ee0 2024-04-25T08:45:06.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f982741f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98200ce830 con 0x7f98200cfec0 2024-04-25T08:45:06.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f982741f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9820072090 con 0x7f98200ce3c0 2024-04-25T08:45:06.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f98249ba640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f98200cfec0 0x7f98200cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f98259bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98200ce3c0 0x7f982006d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f98251bb640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f9820154ee0 0x7f98200cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:39470/0 (socket says 172.21.15.172:39470) 2024-04-25T08:45:06.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f98251bb640 1 -- 172.21.15.172:0/662851058 learned_addr learned my addr 172.21.15.172:0/662851058 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f98249ba640 1 -- 172.21.15.172:0/662851058 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98200ce3c0 msgr2=0x7f982006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f98249ba640 1 --2- 172.21.15.172:0/662851058 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98200ce3c0 0x7f982006d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f98249ba640 1 -- 172.21.15.172:0/662851058 >> v1:172.21.15.186:6789/0 conn(0x7f9820154ee0 legacy=0x7f98200cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.890+0000 7f98249ba640 1 -- 172.21.15.172:0/662851058 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9820071760 con 0x7f98200cfec0 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.891+0000 7f98249ba640 1 --2- 172.21.15.172:0/662851058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98200cfec0 0x7f98200cde80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f98100097a0 tx=0x7f981002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0b7bc951aa08b1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.891+0000 7f9817fff640 1 -- 172.21.15.172:0/662851058 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810037070 con 0x7f98200cfec0 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.891+0000 7f9817fff640 1 -- 172.21.15.172:0/662851058 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981002ad10 con 0x7f98200cfec0 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.891+0000 7f9817fff640 1 -- 172.21.15.172:0/662851058 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810032660 con 0x7f98200cfec0 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.892+0000 7f982741f640 1 -- 172.21.15.172:0/662851058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98200cfec0 msgr2=0x7f98200cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.892+0000 7f982741f640 1 --2- 172.21.15.172:0/662851058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98200cfec0 0x7f98200cde80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f98100097a0 tx=0x7f981002a080 comp rx=0 tx=0).stop 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.892+0000 7f982741f640 1 -- 172.21.15.172:0/662851058 shutdown_connections 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.892+0000 7f982741f640 1 --2- 172.21.15.172:0/662851058 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98200ce3c0 0x7f982006d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.892+0000 7f982741f640 1 --2- 172.21.15.172:0/662851058 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98200cfec0 0x7f98200cde80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.892+0000 7f982741f640 1 -- 172.21.15.172:0/662851058 >> 172.21.15.172:0/662851058 conn(0x7f982006abe0 msgr2=0x7f982006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:06.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.892+0000 7f982741f640 1 -- 172.21.15.172:0/662851058 shutdown_connections 2024-04-25T08:45:06.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.892+0000 7f982741f640 1 -- 172.21.15.172:0/662851058 wait complete. 2024-04-25T08:45:06.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.893+0000 7f982741f640 1 Processor -- start 2024-04-25T08:45:06.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.893+0000 7f982741f640 1 -- start start 2024-04-25T08:45:06.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f982741f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98200ce3c0 0x7f9820158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f982741f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98200cfec0 0x7f9820157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f982741f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9820154ee0 0x7f98201555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f982741f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820071d20 con 0x7f98200cfec0 2024-04-25T08:45:06.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f982741f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820071230 con 0x7f98200ce3c0 2024-04-25T08:45:06.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f982741f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98201552c0 con 0x7f9820154ee0 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98249ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98200cfec0 0x7f9820157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98249ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98200cfec0 0x7f9820157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54520/0 (socket says 172.21.15.172:54520) 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98249ba640 1 -- 172.21.15.172:0/2009508068 learned_addr learned my addr 172.21.15.172:0/2009508068 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98251bb640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98200ce3c0 0x7f9820158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98259bc640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9820154ee0 0x7f98201555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98249ba640 1 -- 172.21.15.172:0/2009508068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9820154ee0 msgr2=0x7f98201555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98249ba640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9820154ee0 0x7f98201555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98249ba640 1 -- 172.21.15.172:0/2009508068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98200ce3c0 msgr2=0x7f9820158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98249ba640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98200ce3c0 0x7f9820158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98249ba640 1 -- 172.21.15.172:0/2009508068 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9820159470 con 0x7f98200cfec0 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98259bc640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9820154ee0 0x7f98201555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.894+0000 7f98251bb640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98200ce3c0 0x7f9820158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.895+0000 7f98249ba640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98200cfec0 0x7f9820157240 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9810035040 tx=0x7f98100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.895+0000 7f9815ffb640 1 -- 172.21.15.172:0/2009508068 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810041030 con 0x7f98200cfec0 2024-04-25T08:45:06.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.895+0000 7f9815ffb640 1 -- 172.21.15.172:0/2009508068 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981002ab10 con 0x7f98200cfec0 2024-04-25T08:45:06.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.895+0000 7f982741f640 1 -- 172.21.15.172:0/2009508068 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9820159750 con 0x7f98200cfec0 2024-04-25T08:45:06.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.895+0000 7f9815ffb640 1 -- 172.21.15.172:0/2009508068 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810037040 con 0x7f98200cfec0 2024-04-25T08:45:06.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.895+0000 7f982741f640 1 -- 172.21.15.172:0/2009508068 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9820159d10 con 0x7f98200cfec0 2024-04-25T08:45:06.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.896+0000 7f982741f640 1 -- 172.21.15.172:0/2009508068 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982015a200 con 0x7f98200cfec0 2024-04-25T08:45:06.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.896+0000 7f9815ffb640 1 -- 172.21.15.172:0/2009508068 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9810044070 con 0x7f98200cfec0 2024-04-25T08:45:06.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.897+0000 7f9815ffb640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f980406b4d0 0x7f980406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:06.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.897+0000 7f98251bb640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f980406b4d0 0x7f980406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:06.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.897+0000 7f9815ffb640 1 -- 172.21.15.172:0/2009508068 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f98100aa680 con 0x7f98200cfec0 2024-04-25T08:45:06.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.897+0000 7f98251bb640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f980406b4d0 0x7f980406d990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f981c000f60 tx=0x7f981c007d20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:06.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:06.901+0000 7f9815ffb640 1 -- 172.21.15.172:0/2009508068 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98100793d0 con 0x7f98200cfec0 2024-04-25T08:45:07.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.110+0000 7f982741f640 1 -- 172.21.15.172:0/2009508068 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9820073990 con 0x7f98200cfec0 2024-04-25T08:45:07.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.111+0000 7f9815ffb640 1 -- 172.21.15.172:0/2009508068 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f9810078cd0 con 0x7f98200cfec0 2024-04-25T08:45:07.102 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:07.103 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/1959121045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1959121045},{"type":"v1","addr":"172.21.15.186:6834","nonce":1959121045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/898320853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":898320853},{"type":"v1","addr":"172.21.15.186:6835","nonce":898320853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1482887107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1482887107},{"type":"v1","addr":"172.21.15.172:6836","nonce":1482887107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:43:36.707052+0000","modified":"2024-04-25T08:43:47.700780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5340":{"gid":5340,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3537703238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":3537703238},{"type":"v1","addr":"172.21.15.172:6837","nonce":3537703238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T08:45:07.103 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 16 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 -- 172.21.15.172:0/2009508068 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f980406b4d0 msgr2=0x7f980406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f980406b4d0 0x7f980406d990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f981c000f60 tx=0x7f981c007d20 comp rx=0 tx=0).stop 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 -- 172.21.15.172:0/2009508068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98200cfec0 msgr2=0x7f9820157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98200cfec0 0x7f9820157240 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9810035040 tx=0x7f98100046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 -- 172.21.15.172:0/2009508068 shutdown_connections 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f980406b4d0 0x7f980406d990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9820154ee0 0x7f98201555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98200cfec0 0x7f9820157240 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 --2- 172.21.15.172:0/2009508068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98200ce3c0 0x7f9820158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 -- 172.21.15.172:0/2009508068 >> 172.21.15.172:0/2009508068 conn(0x7f982006abe0 msgr2=0x7f982006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 -- 172.21.15.172:0/2009508068 shutdown_connections 2024-04-25T08:45:07.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.113+0000 7f982741f640 1 -- 172.21.15.172:0/2009508068 wait complete. 2024-04-25T08:45:07.115 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.221+0000 7f46dad7e640 1 Processor -- start 2024-04-25T08:45:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.221+0000 7f46dad7e640 1 -- start start 2024-04-25T08:45:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.221+0000 7f46dad7e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f46d4158220 0x7f46d415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.221+0000 7f46dad7e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46d40af720 0x7f46d40afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.221+0000 7f46dad7e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d415f180 con 0x7f46d41617b0 2024-04-25T08:45:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.221+0000 7f46dad7e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d40b3670 con 0x7f46d4158220 2024-04-25T08:45:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.221+0000 7f46dad7e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d4070a10 con 0x7f46d40af720 2024-04-25T08:45:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.221+0000 7f46d8b1a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f46d4158220 0x7f46d415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.222+0000 7f46d931b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f46d41617b0 0x7f46d4161c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41756/0 (socket says 172.21.15.172:41756) 2024-04-25T08:45:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.222+0000 7f46d8b1a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f46d4158220 0x7f46d415ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54524/0 (socket says 172.21.15.172:54524) 2024-04-25T08:45:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.222+0000 7f46d931b640 1 -- 172.21.15.172:0/1722177281 learned_addr learned my addr 172.21.15.172:0/1722177281 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.222+0000 7f46d3fff640 1 --2- 172.21.15.172:0/1722177281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46d40af720 0x7f46d40afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.222+0000 7f46d8b1a640 1 -- 172.21.15.172:0/1722177281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46d40af720 msgr2=0x7f46d40afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.222+0000 7f46d8b1a640 1 --2- 172.21.15.172:0/1722177281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46d40af720 0x7f46d40afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.222+0000 7f46d8b1a640 1 -- 172.21.15.172:0/1722177281 >> v1:172.21.15.172:6789/0 conn(0x7f46d41617b0 legacy=0x7f46d4161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.222+0000 7f46d8b1a640 1 -- 172.21.15.172:0/1722177281 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d406fe00 con 0x7f46d4158220 2024-04-25T08:45:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.222+0000 7f46d37fe640 1 -- 172.21.15.172:0/1722177281 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525797725 0 0) 0x7f46cc001490 con 0x7f46d41617b0 2024-04-25T08:45:07.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46d8b1a640 1 --2- 172.21.15.172:0/1722177281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d4158220 0x7f46d415ec40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f46c80097a0 tx=0x7f46c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb7c35bd616ebb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46d37fe640 1 -- 172.21.15.172:0/1722177281 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8037070 con 0x7f46d4158220 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46d37fe640 1 -- 172.21.15.172:0/1722177281 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c8032440 con 0x7f46d4158220 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46d37fe640 1 -- 172.21.15.172:0/1722177281 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8032810 con 0x7f46d4158220 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46dad7e640 1 -- 172.21.15.172:0/1722177281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d4158220 msgr2=0x7f46d415ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46dad7e640 1 --2- 172.21.15.172:0/1722177281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d4158220 0x7f46d415ec40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f46c80097a0 tx=0x7f46c802a180 comp rx=0 tx=0).stop 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46dad7e640 1 -- 172.21.15.172:0/1722177281 shutdown_connections 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46dad7e640 1 --2- 172.21.15.172:0/1722177281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46d40af720 0x7f46d40afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46dad7e640 1 --2- 172.21.15.172:0/1722177281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d4158220 0x7f46d415ec40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46dad7e640 1 -- 172.21.15.172:0/1722177281 >> 172.21.15.172:0/1722177281 conn(0x7f46d40b2370 msgr2=0x7f46d40b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46dad7e640 1 -- 172.21.15.172:0/1722177281 shutdown_connections 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.223+0000 7f46dad7e640 1 -- 172.21.15.172:0/1722177281 wait complete. 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.224+0000 7f46dad7e640 1 Processor -- start 2024-04-25T08:45:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.224+0000 7f46dad7e640 1 -- start start 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.225+0000 7f46dad7e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46d40af720 0x7f46d414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.225+0000 7f46dad7e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46d4158220 0x7f46d40b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.225+0000 7f46dad7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d41617b0 0x7f46d40cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.225+0000 7f46dad7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d40706a0 con 0x7f46d41617b0 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.225+0000 7f46dad7e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d40703c0 con 0x7f46d4158220 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.225+0000 7f46dad7e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d4158600 con 0x7f46d40af720 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.225+0000 7f46d931b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d41617b0 0x7f46d40cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.225+0000 7f46d931b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d41617b0 0x7f46d40cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54532/0 (socket says 172.21.15.172:54532) 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.225+0000 7f46d931b640 1 -- 172.21.15.172:0/1521485225 learned_addr learned my addr 172.21.15.172:0/1521485225 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d8b1a640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46d40af720 0x7f46d414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d3fff640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46d4158220 0x7f46d40b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d931b640 1 -- 172.21.15.172:0/1521485225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46d40af720 msgr2=0x7f46d414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d931b640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46d40af720 0x7f46d414fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d931b640 1 -- 172.21.15.172:0/1521485225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46d4158220 msgr2=0x7f46d40b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d931b640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46d4158220 0x7f46d40b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d931b640 1 -- 172.21.15.172:0/1521485225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d40c9e80 con 0x7f46d41617b0 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d3fff640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46d4158220 0x7f46d40b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d931b640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d41617b0 0x7f46d40cbc80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00c780 tx=0x7f46cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d17fa640 1 -- 172.21.15.172:0/1521485225 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc018070 con 0x7f46d41617b0 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d17fa640 1 -- 172.21.15.172:0/1521485225 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc00a640 con 0x7f46d41617b0 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46dad7e640 1 -- 172.21.15.172:0/1521485225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d40ca160 con 0x7f46d41617b0 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46d17fa640 1 -- 172.21.15.172:0/1521485225 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc00aa30 con 0x7f46d41617b0 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.226+0000 7f46dad7e640 1 -- 172.21.15.172:0/1521485225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d41591d0 con 0x7f46d41617b0 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.227+0000 7f46dad7e640 1 -- 172.21.15.172:0/1521485225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d4073990 con 0x7f46d41617b0 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.227+0000 7f46d17fa640 1 -- 172.21.15.172:0/1521485225 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f46cc01b070 con 0x7f46d41617b0 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.228+0000 7f46d17fa640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f46b806b4d0 0x7f46b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.228+0000 7f46d17fa640 1 -- 172.21.15.172:0/1521485225 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f46cc089970 con 0x7f46d41617b0 2024-04-25T08:45:07.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.228+0000 7f46d8b1a640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f46b806b4d0 0x7f46b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.228+0000 7f46d8b1a640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f46b806b4d0 0x7f46b806d990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f46c8034000 tx=0x7f46c802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:07.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.232+0000 7f46d17fa640 1 -- 172.21.15.172:0/1521485225 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f46d415f180 con 0x7f46d41617b0 2024-04-25T08:45:07.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.403+0000 7f46dad7e640 1 -- 172.21.15.172:0/1521485225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46d41593a0 con 0x7f46d41617b0 2024-04-25T08:45:07.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.404+0000 7f46d17fa640 1 -- 172.21.15.172:0/1521485225 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17060 (secure 0 0 0) 0x7f46cc058630 con 0x7f46d41617b0 2024-04-25T08:45:07.396 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:07.397 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":42,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:44:44.243816+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:43:35.001610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T08:43:35.672731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.406+0000 7f46dad7e640 1 -- 172.21.15.172:0/1521485225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f46b806b4d0 msgr2=0x7f46b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.406+0000 7f46dad7e640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f46b806b4d0 0x7f46b806d990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f46c8034000 tx=0x7f46c802e000 comp rx=0 tx=0).stop 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.406+0000 7f46dad7e640 1 -- 172.21.15.172:0/1521485225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d41617b0 msgr2=0x7f46d40cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.406+0000 7f46dad7e640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d41617b0 0x7f46d40cbc80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00c780 tx=0x7f46cc00cc40 comp rx=0 tx=0).stop 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.407+0000 7f46dad7e640 1 -- 172.21.15.172:0/1521485225 shutdown_connections 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.407+0000 7f46dad7e640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f46b806b4d0 0x7f46b806d990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.407+0000 7f46dad7e640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46d4158220 0x7f46d40b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.407+0000 7f46dad7e640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46d41617b0 0x7f46d40cbc80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.407+0000 7f46dad7e640 1 --2- 172.21.15.172:0/1521485225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46d40af720 0x7f46d414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.407+0000 7f46dad7e640 1 -- 172.21.15.172:0/1521485225 >> 172.21.15.172:0/1521485225 conn(0x7f46d40b2370 msgr2=0x7f46d4160a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.407+0000 7f46dad7e640 1 -- 172.21.15.172:0/1521485225 shutdown_connections 2024-04-25T08:45:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.407+0000 7f46dad7e640 1 -- 172.21.15.172:0/1521485225 wait complete. 2024-04-25T08:45:07.410 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:45:07.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.516+0000 7f6b8df22640 1 Processor -- start 2024-04-25T08:45:07.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.516+0000 7f6b8df22640 1 -- start start 2024-04-25T08:45:07.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b8df22640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6b8806e360 0x7f6b8806e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b8df22640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6b8806ec80 0x7f6b880b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b8df22640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8815e020 con 0x7f6b880b3e10 2024-04-25T08:45:07.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b8df22640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8806b890 con 0x7f6b8806ec80 2024-04-25T08:45:07.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b8df22640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8806ac80 con 0x7f6b8806e360 2024-04-25T08:45:07.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b86ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6b8806ec80 0x7f6b880b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b86ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6b8806ec80 0x7f6b880b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44900/0 (socket says 172.21.15.172:44900) 2024-04-25T08:45:07.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b86ffd640 1 -- 172.21.15.172:0/740024146 learned_addr learned my addr 172.21.15.172:0/740024146 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:07.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b86ffd640 1 -- 172.21.15.172:0/740024146 >> v2:172.21.15.186:3300/0 conn(0x7f6b8806e360 msgr2=0x7f6b8806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:07.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b86ffd640 1 --2- 172.21.15.172:0/740024146 >> v2:172.21.15.186:3300/0 conn(0x7f6b8806e360 0x7f6b8806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b86ffd640 1 -- 172.21.15.172:0/740024146 >> v1:172.21.15.186:6789/0 conn(0x7f6b880b3e10 legacy=0x7f6b8806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:07.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.517+0000 7f6b86ffd640 1 -- 172.21.15.172:0/740024146 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8806af60 con 0x7f6b8806ec80 2024-04-25T08:45:07.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.518+0000 7f6b86ffd640 1 --2- 172.21.15.172:0/740024146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 0x7f6b880b38d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6b88072e90 tx=0x7f6b7c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ac381c72823446 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:07.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.518+0000 7f6b867fc640 1 -- 172.21.15.172:0/740024146 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c037070 con 0x7f6b8806ec80 2024-04-25T08:45:07.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.518+0000 7f6b867fc640 1 -- 172.21.15.172:0/740024146 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c032440 con 0x7f6b8806ec80 2024-04-25T08:45:07.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.518+0000 7f6b867fc640 1 -- 172.21.15.172:0/740024146 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c032810 con 0x7f6b8806ec80 2024-04-25T08:45:07.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.519+0000 7f6b8df22640 1 -- 172.21.15.172:0/740024146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 msgr2=0x7f6b880b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.519+0000 7f6b8df22640 1 --2- 172.21.15.172:0/740024146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 0x7f6b880b38d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6b88072e90 tx=0x7f6b7c02a2c0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.519+0000 7f6b8df22640 1 -- 172.21.15.172:0/740024146 shutdown_connections 2024-04-25T08:45:07.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.519+0000 7f6b8df22640 1 --2- 172.21.15.172:0/740024146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 0x7f6b880b38d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.519+0000 7f6b8df22640 1 --2- 172.21.15.172:0/740024146 >> v2:172.21.15.186:3300/0 conn(0x7f6b8806e360 0x7f6b8806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.519+0000 7f6b8df22640 1 -- 172.21.15.172:0/740024146 >> 172.21.15.172:0/740024146 conn(0x7f6b880cfec0 msgr2=0x7f6b880d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:07.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.519+0000 7f6b8df22640 1 -- 172.21.15.172:0/740024146 shutdown_connections 2024-04-25T08:45:07.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.519+0000 7f6b8df22640 1 -- 172.21.15.172:0/740024146 wait complete. 2024-04-25T08:45:07.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.520+0000 7f6b8df22640 1 Processor -- start 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.520+0000 7f6b8df22640 1 -- start start 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b8df22640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b8806e360 0x7f6b88143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b8df22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 0x7f6b881e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b8df22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b880b3e10 0x7f6b88145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b8df22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880b2fd0 con 0x7f6b8806ec80 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b8df22640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8806b520 con 0x7f6b8806e360 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b8df22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880b3150 con 0x7f6b880b3e10 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b86ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 0x7f6b881e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b86ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 0x7f6b881e7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44902/0 (socket says 172.21.15.172:44902) 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b86ffd640 1 -- 172.21.15.172:0/2058955284 learned_addr learned my addr 172.21.15.172:0/2058955284 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b86ffd640 1 -- 172.21.15.172:0/2058955284 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b880b3e10 msgr2=0x7f6b88145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b86ffd640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b880b3e10 0x7f6b88145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b877fe640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b8806e360 0x7f6b88143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b86ffd640 1 -- 172.21.15.172:0/2058955284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b8806e360 msgr2=0x7f6b88143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b86ffd640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b8806e360 0x7f6b88143b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b86ffd640 1 -- 172.21.15.172:0/2058955284 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b88144960 con 0x7f6b8806ec80 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b86ffd640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 0x7f6b881e7ab0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c000c00 tx=0x7f6b7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b6ffff640 1 -- 172.21.15.172:0/2058955284 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c041070 con 0x7f6b8806ec80 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b6ffff640 1 -- 172.21.15.172:0/2058955284 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c03c870 con 0x7f6b8806ec80 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b6ffff640 1 -- 172.21.15.172:0/2058955284 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c037040 con 0x7f6b8806ec80 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.521+0000 7f6b8df22640 1 -- 172.21.15.172:0/2058955284 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b88144c40 con 0x7f6b8806ec80 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.522+0000 7f6b8df22640 1 -- 172.21.15.172:0/2058955284 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b88145200 con 0x7f6b8806ec80 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.522+0000 7f6b8df22640 1 -- 172.21.15.172:0/2058955284 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b88073a00 con 0x7f6b8806ec80 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.523+0000 7f6b6ffff640 1 -- 172.21.15.172:0/2058955284 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6b7c044070 con 0x7f6b8806ec80 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.523+0000 7f6b6ffff640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b7406b4d0 0x7f6b7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.523+0000 7f6b6ffff640 1 -- 172.21.15.172:0/2058955284 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6158+0+0 (secure 0 0 0) 0x7f6b7c0ab010 con 0x7f6b8806ec80 2024-04-25T08:45:07.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.523+0000 7f6b877fe640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b7406b4d0 0x7f6b7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.524+0000 7f6b877fe640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b7406b4d0 0x7f6b7406d990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800a810 tx=0x7f6b78008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:07.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.527+0000 7f6b6ffff640 1 -- 172.21.15.172:0/2058955284 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b7c079cd0 con 0x7f6b8806ec80 2024-04-25T08:45:07.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.735+0000 7f6b8df22640 1 -- 172.21.15.172:0/2058955284 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6b88159750 con 0x7f6b8806ec80 2024-04-25T08:45:07.727 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:45:07.735+0000 7f9412b2f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:45:07.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.739+0000 7f6b6ffff640 1 -- 172.21.15.172:0/2058955284 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6b7c0795d0 con 0x7f6b8806ec80 2024-04-25T08:45:07.731 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:45:07.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 -- 172.21.15.172:0/2058955284 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b7406b4d0 msgr2=0x7f6b7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b7406b4d0 0x7f6b7406d990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800a810 tx=0x7f6b78008040 comp rx=0 tx=0).stop 2024-04-25T08:45:07.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 -- 172.21.15.172:0/2058955284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 msgr2=0x7f6b881e7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 0x7f6b881e7ab0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c000c00 tx=0x7f6b7c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 -- 172.21.15.172:0/2058955284 shutdown_connections 2024-04-25T08:45:07.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b7406b4d0 0x7f6b7406d990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b880b3e10 0x7f6b88145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b8806ec80 0x7f6b881e7ab0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 --2- 172.21.15.172:0/2058955284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b8806e360 0x7f6b88143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 -- 172.21.15.172:0/2058955284 >> 172.21.15.172:0/2058955284 conn(0x7f6b880cfec0 msgr2=0x7f6b8815d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:07.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 -- 172.21.15.172:0/2058955284 shutdown_connections 2024-04-25T08:45:07.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.741+0000 7f6b8df22640 1 -- 172.21.15.172:0/2058955284 wait complete. 2024-04-25T08:45:07.745 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:45:07.771 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:45:07.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.853+0000 7facf2f3b640 1 Processor -- start 2024-04-25T08:45:07.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.853+0000 7facf2f3b640 1 -- start start 2024-04-25T08:45:07.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.854+0000 7facf2f3b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec0ced80 0x7facec0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.854+0000 7facf2f3b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7facec161710 0x7facec0d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.854+0000 7facf2f3b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facec15e000 con 0x7facec15dc20 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.854+0000 7facf2f3b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facec0d1de0 con 0x7facec161710 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.854+0000 7facf2f3b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec161c60 con 0x7facec0ced80 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facebfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec0ced80 0x7facec0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facf14d8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7facec161710 0x7facec0d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facf0cd7640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7facec15dc20 0x7facec0ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:52800/0 (socket says 172.21.15.172:52800) 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facf14d8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7facec161710 0x7facec0d2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:60166/0 (socket says 172.21.15.172:60166) 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facebfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec0ced80 0x7facec0d22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:57196/0 (socket says 172.21.15.172:57196) 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facf0cd7640 1 -- 172.21.15.172:0/2318914027 learned_addr learned my addr 172.21.15.172:0/2318914027 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facf14d8640 1 -- 172.21.15.172:0/2318914027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec0ced80 msgr2=0x7facec0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facf14d8640 1 --2- 172.21.15.172:0/2318914027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec0ced80 0x7facec0d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facf14d8640 1 -- 172.21.15.172:0/2318914027 >> v1:172.21.15.186:6789/0 conn(0x7facec15dc20 legacy=0x7facec0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facf14d8640 1 -- 172.21.15.172:0/2318914027 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec161f40 con 0x7facec161710 2024-04-25T08:45:07.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.855+0000 7facebfff640 1 --2- 172.21.15.172:0/2318914027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec0ced80 0x7facec0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:07.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7facf14d8640 1 --2- 172.21.15.172:0/2318914027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facec161710 0x7facec0d2820 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7face4009d90 tx=0x7face402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c63ed893771198e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7faceb7fe640 1 -- 172.21.15.172:0/2318914027 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4007740 con 0x7facec161710 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7faceb7fe640 1 -- 172.21.15.172:0/2318914027 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face40078e0 con 0x7facec161710 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7faceb7fe640 1 -- 172.21.15.172:0/2318914027 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face4007cb0 con 0x7facec161710 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7facf2f3b640 1 -- 172.21.15.172:0/2318914027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facec161710 msgr2=0x7facec0d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7facf2f3b640 1 --2- 172.21.15.172:0/2318914027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facec161710 0x7facec0d2820 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7face4009d90 tx=0x7face402a660 comp rx=0 tx=0).stop 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7facf2f3b640 1 -- 172.21.15.172:0/2318914027 shutdown_connections 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7facf2f3b640 1 --2- 172.21.15.172:0/2318914027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec0ced80 0x7facec0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7facf2f3b640 1 --2- 172.21.15.172:0/2318914027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facec161710 0x7facec0d2820 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7facf2f3b640 1 -- 172.21.15.172:0/2318914027 >> 172.21.15.172:0/2318914027 conn(0x7facec0d0420 msgr2=0x7facec0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7facf2f3b640 1 -- 172.21.15.172:0/2318914027 shutdown_connections 2024-04-25T08:45:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.856+0000 7facf2f3b640 1 -- 172.21.15.172:0/2318914027 wait complete. 2024-04-25T08:45:07.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.858+0000 7facf2f3b640 1 Processor -- start 2024-04-25T08:45:07.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.858+0000 7facf2f3b640 1 -- start start 2024-04-25T08:45:07.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.858+0000 7facf2f3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facec0ced80 0x7facec1e8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.858+0000 7facf2f3b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec15dc20 0x7facec0aa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.858+0000 7facf2f3b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facec161710 0x7facec0abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.858+0000 7facf2f3b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec0b5e50 con 0x7facec0ced80 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.858+0000 7facf2f3b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec162500 con 0x7facec161710 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.858+0000 7facf2f3b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec0b5fd0 con 0x7facec15dc20 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf0cd7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facec0ced80 0x7facec1e8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf0cd7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facec0ced80 0x7facec1e8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44936/0 (socket says 172.21.15.172:44936) 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf0cd7640 1 -- 172.21.15.172:0/5811817 learned_addr learned my addr 172.21.15.172:0/5811817 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facebfff640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec15dc20 0x7facec0aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf14d8640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facec161710 0x7facec0abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf0cd7640 1 -- 172.21.15.172:0/5811817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec15dc20 msgr2=0x7facec0aa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf0cd7640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec15dc20 0x7facec0aa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf0cd7640 1 -- 172.21.15.172:0/5811817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facec161710 msgr2=0x7facec0abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf0cd7640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facec161710 0x7facec0abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:07.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf0cd7640 1 -- 172.21.15.172:0/5811817 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec15f3c0 con 0x7facec0ced80 2024-04-25T08:45:07.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf0cd7640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facec0ced80 0x7facec1e8a20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c3f0 tx=0x7facdc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:07.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7face97fa640 1 -- 172.21.15.172:0/5811817 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc017070 con 0x7facec0ced80 2024-04-25T08:45:07.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7face97fa640 1 -- 172.21.15.172:0/5811817 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc005ce0 con 0x7facec0ced80 2024-04-25T08:45:07.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf2f3b640 1 -- 172.21.15.172:0/5811817 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facec15f6a0 con 0x7facec0ced80 2024-04-25T08:45:07.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7face97fa640 1 -- 172.21.15.172:0/5811817 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc0072f0 con 0x7facec0ced80 2024-04-25T08:45:07.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.859+0000 7facf2f3b640 1 -- 172.21.15.172:0/5811817 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec15fc60 con 0x7facec0ced80 2024-04-25T08:45:07.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.860+0000 7facf2f3b640 1 -- 172.21.15.172:0/5811817 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec073a00 con 0x7facec0ced80 2024-04-25T08:45:07.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.861+0000 7face97fa640 1 -- 172.21.15.172:0/5811817 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7facdc01a070 con 0x7facec0ced80 2024-04-25T08:45:07.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.861+0000 7face97fa640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facd806b4d0 0x7facd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:07.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.861+0000 7face97fa640 1 -- 172.21.15.172:0/5811817 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6216+0+0 (secure 0 0 0) 0x7facdc089660 con 0x7facec0ced80 2024-04-25T08:45:07.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.861+0000 7facebfff640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facd806b4d0 0x7facd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:07.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.861+0000 7facebfff640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facd806b4d0 0x7facd806d990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7face0009560 tx=0x7face0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:07.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:07.865+0000 7face97fa640 1 -- 172.21.15.172:0/5811817 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7facdc057d20 con 0x7facec0ced80 2024-04-25T08:45:08.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.073+0000 7facf2f3b640 1 -- 172.21.15.172:0/5811817 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7facec1e7df0 con 0x7facec0ced80 2024-04-25T08:45:08.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.742+0000 7face97fa640 1 -- 172.21.15.172:0/5811817 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7facdc05bdc0 con 0x7facec0ced80 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.744+0000 7facf2f3b640 1 -- 172.21.15.172:0/5811817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facd806b4d0 msgr2=0x7facd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.744+0000 7facf2f3b640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facd806b4d0 0x7facd806d990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7face0009560 tx=0x7face0009190 comp rx=0 tx=0).stop 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.744+0000 7facf2f3b640 1 -- 172.21.15.172:0/5811817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facec0ced80 msgr2=0x7facec1e8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.744+0000 7facf2f3b640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facec0ced80 0x7facec1e8a20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c3f0 tx=0x7facdc00c8b0 comp rx=0 tx=0).stop 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.745+0000 7facf2f3b640 1 -- 172.21.15.172:0/5811817 shutdown_connections 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.745+0000 7facf2f3b640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7facd806b4d0 0x7facd806d990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.745+0000 7facf2f3b640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facec161710 0x7facec0abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.745+0000 7facf2f3b640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facec15dc20 0x7facec0aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.745+0000 7facf2f3b640 1 --2- 172.21.15.172:0/5811817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facec0ced80 0x7facec1e8a20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.745+0000 7facf2f3b640 1 -- 172.21.15.172:0/5811817 >> 172.21.15.172:0/5811817 conn(0x7facec0d0420 msgr2=0x7facec0d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.745+0000 7facf2f3b640 1 -- 172.21.15.172:0/5811817 shutdown_connections 2024-04-25T08:45:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.745+0000 7facf2f3b640 1 -- 172.21.15.172:0/5811817 wait complete. 2024-04-25T08:45:08.749 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:45:08.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.900+0000 7fbed681f640 1 Processor -- start 2024-04-25T08:45:08.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.900+0000 7fbed681f640 1 -- start start 2024-04-25T08:45:08.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.901+0000 7fbed681f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbed00cf600 0x7fbed00cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:08.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.901+0000 7fbed681f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed00c75e0 con 0x7fbed00cbf20 2024-04-25T08:45:08.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.901+0000 7fbed681f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed00c78c0 con 0x7fbed015bb50 2024-04-25T08:45:08.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.901+0000 7fbed681f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed00c8680 con 0x7fbed00cf600 2024-04-25T08:45:08.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.901+0000 7fbecf7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbed00cf600 0x7fbed00cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:08.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.901+0000 7fbed4dbc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbed00cbf20 0x7fbed00cc370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48066/0 (socket says 172.21.15.172:48066) 2024-04-25T08:45:08.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.902+0000 7fbed4dbc640 1 -- 172.21.15.172:0/2902043906 learned_addr learned my addr 172.21.15.172:0/2902043906 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:08.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.902+0000 7fbecf7fe640 1 -- 172.21.15.172:0/2902043906 >> v1:172.21.15.186:6789/0 conn(0x7fbed015bb50 legacy=0x7fbed00c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:08.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.902+0000 7fbecf7fe640 1 -- 172.21.15.172:0/2902043906 >> v1:172.21.15.172:6789/0 conn(0x7fbed00cbf20 legacy=0x7fbed00cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:08.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.902+0000 7fbeceffd640 1 -- 172.21.15.172:0/2902043906 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188012709 0 0) 0x7fbed00c75e0 con 0x7fbed00cbf20 2024-04-25T08:45:08.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.902+0000 7fbecf7fe640 1 -- 172.21.15.172:0/2902043906 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00c7ba0 con 0x7fbed00cf600 2024-04-25T08:45:08.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.902+0000 7fbecf7fe640 1 --2- 172.21.15.172:0/2902043906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed00cf600 0x7fbed00cfa40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbec40097a0 tx=0x7fbec402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a994002dc0fcfde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:08.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.903+0000 7fbeceffd640 1 -- 172.21.15.172:0/2902043906 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4037070 con 0x7fbed00cf600 2024-04-25T08:45:08.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.903+0000 7fbeceffd640 1 -- 172.21.15.172:0/2902043906 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4032440 con 0x7fbed00cf600 2024-04-25T08:45:08.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.903+0000 7fbeceffd640 1 -- 172.21.15.172:0/2902043906 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4032810 con 0x7fbed00cf600 2024-04-25T08:45:08.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.903+0000 7fbed681f640 1 -- 172.21.15.172:0/2902043906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed00cf600 msgr2=0x7fbed00cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:08.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.903+0000 7fbed681f640 1 --2- 172.21.15.172:0/2902043906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed00cf600 0x7fbed00cfa40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbec40097a0 tx=0x7fbec402a270 comp rx=0 tx=0).stop 2024-04-25T08:45:08.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.903+0000 7fbed681f640 1 -- 172.21.15.172:0/2902043906 shutdown_connections 2024-04-25T08:45:08.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.903+0000 7fbed681f640 1 --2- 172.21.15.172:0/2902043906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed00cf600 0x7fbed00cfa40 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:08.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.903+0000 7fbed681f640 1 -- 172.21.15.172:0/2902043906 >> 172.21.15.172:0/2902043906 conn(0x7fbed006f500 msgr2=0x7fbed006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:08.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.903+0000 7fbed681f640 1 -- 172.21.15.172:0/2902043906 shutdown_connections 2024-04-25T08:45:08.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.903+0000 7fbed681f640 1 -- 172.21.15.172:0/2902043906 wait complete. 2024-04-25T08:45:08.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.904+0000 7fbed681f640 1 Processor -- start 2024-04-25T08:45:08.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.905+0000 7fbed681f640 1 -- start start 2024-04-25T08:45:08.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.905+0000 7fbed681f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbed00cbf20 0x7fbed015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:08.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.905+0000 7fbed681f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed00cf600 0x7fbed0144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:08.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.905+0000 7fbed681f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed015bb50 0x7fbed00cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:08.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.905+0000 7fbed681f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00c8160 con 0x7fbed015bb50 2024-04-25T08:45:08.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.905+0000 7fbed681f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00cff80 con 0x7fbed00cf600 2024-04-25T08:45:08.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.905+0000 7fbed681f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00c72a0 con 0x7fbed00cbf20 2024-04-25T08:45:08.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.905+0000 7fbed4dbc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed015bb50 0x7fbed00cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.905+0000 7fbed4dbc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed015bb50 0x7fbed00cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44944/0 (socket says 172.21.15.172:44944) 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.905+0000 7fbed4dbc640 1 -- 172.21.15.172:0/608130630 learned_addr learned my addr 172.21.15.172:0/608130630 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbecffff640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbed00cbf20 0x7fbed015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbecf7fe640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed00cf600 0x7fbed0144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbed4dbc640 1 -- 172.21.15.172:0/608130630 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbed00cbf20 msgr2=0x7fbed015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbed4dbc640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbed00cbf20 0x7fbed015bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbed4dbc640 1 -- 172.21.15.172:0/608130630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed00cf600 msgr2=0x7fbed0144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbed4dbc640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed00cf600 0x7fbed0144120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbed4dbc640 1 -- 172.21.15.172:0/608130630 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed015c810 con 0x7fbed015bb50 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbed4dbc640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed015bb50 0x7fbed00cd3c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c7d0 tx=0x7fbec800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbeccff9640 1 -- 172.21.15.172:0/608130630 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8018070 con 0x7fbed015bb50 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbeccff9640 1 -- 172.21.15.172:0/608130630 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec800a640 con 0x7fbed015bb50 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbeccff9640 1 -- 172.21.15.172:0/608130630 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800aa70 con 0x7fbed015bb50 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbed681f640 1 -- 172.21.15.172:0/608130630 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed015caf0 con 0x7fbed015bb50 2024-04-25T08:45:08.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.906+0000 7fbed681f640 1 -- 172.21.15.172:0/608130630 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed00b4770 con 0x7fbed015bb50 2024-04-25T08:45:08.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.907+0000 7fbed681f640 1 -- 172.21.15.172:0/608130630 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed00b4580 con 0x7fbed015bb50 2024-04-25T08:45:08.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.907+0000 7fbeccff9640 1 -- 172.21.15.172:0/608130630 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbec801b070 con 0x7fbed015bb50 2024-04-25T08:45:08.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.908+0000 7fbeccff9640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbebc06b4d0 0x7fbebc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:08.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.908+0000 7fbecffff640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbebc06b4d0 0x7fbebc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:08.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.908+0000 7fbeccff9640 1 -- 172.21.15.172:0/608130630 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6216+0+0 (secure 0 0 0) 0x7fbec8089990 con 0x7fbed015bb50 2024-04-25T08:45:08.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.908+0000 7fbecffff640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbebc06b4d0 0x7fbebc06d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbec0006fd0 tx=0x7fbec0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:08.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:08.912+0000 7fbeccff9640 1 -- 172.21.15.172:0/608130630 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbec80586a0 con 0x7fbed015bb50 2024-04-25T08:45:09.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.083+0000 7fbed681f640 1 -- 172.21.15.172:0/608130630 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbed00cf150 con 0x7fbed015bb50 2024-04-25T08:45:09.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.746+0000 7fbeccff9640 1 -- 172.21.15.172:0/608130630 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbec8057fa0 con 0x7fbed015bb50 2024-04-25T08:45:09.737 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:45:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 -- 172.21.15.172:0/608130630 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbebc06b4d0 msgr2=0x7fbebc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbebc06b4d0 0x7fbebc06d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbec0006fd0 tx=0x7fbec0008040 comp rx=0 tx=0).stop 2024-04-25T08:45:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 -- 172.21.15.172:0/608130630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed015bb50 msgr2=0x7fbed00cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed015bb50 0x7fbed00cd3c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c7d0 tx=0x7fbec800cc90 comp rx=0 tx=0).stop 2024-04-25T08:45:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 -- 172.21.15.172:0/608130630 shutdown_connections 2024-04-25T08:45:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbebc06b4d0 0x7fbebc06d990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbed00cf600 0x7fbed0144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed015bb50 0x7fbed00cd3c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 --2- 172.21.15.172:0/608130630 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbed00cbf20 0x7fbed015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:09.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 -- 172.21.15.172:0/608130630 >> 172.21.15.172:0/608130630 conn(0x7fbed006f500 msgr2=0x7fbed00b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:09.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 -- 172.21.15.172:0/608130630 shutdown_connections 2024-04-25T08:45:09.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.749+0000 7fbed681f640 1 -- 172.21.15.172:0/608130630 wait complete. 2024-04-25T08:45:09.753 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:45:09.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.864+0000 7f863d91b640 1 Processor -- start 2024-04-25T08:45:09.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.864+0000 7f863d91b640 1 -- start start 2024-04-25T08:45:09.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.865+0000 7f863d91b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8638166a10 0x7f8638168e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:09.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.865+0000 7f863d91b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86380afc80 con 0x7f863815de80 2024-04-25T08:45:09.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.865+0000 7f863d91b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86380ce4d0 con 0x7f86380cadb0 2024-04-25T08:45:09.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.865+0000 7f863d91b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86380cb240 con 0x7f8638166a10 2024-04-25T08:45:09.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.865+0000 7f8636ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f863815de80 0x7f86380cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48072/0 (socket says 172.21.15.172:48072) 2024-04-25T08:45:09.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.865+0000 7f8636ffd640 1 -- 172.21.15.172:0/2297521845 learned_addr learned my addr 172.21.15.172:0/2297521845 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:09.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.865+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977196950 0 0) 0x7f86380afc80 con 0x7f863815de80 2024-04-25T08:45:09.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8620003520 con 0x7f863815de80 2024-04-25T08:45:09.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f86377fe640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8638166a10 0x7f8638168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:09.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2138331322 0 0) 0x7f8620003520 con 0x7f863815de80 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8638166a10 msgr2=0x7f8638168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8638166a10 0x7f8638168e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 >> v1:172.21.15.186:6789/0 conn(0x7f86380cadb0 legacy=0x7f86380cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380ce7b0 con 0x7f863815de80 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f86280019f0 con 0x7f863815de80 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 >> v1:172.21.15.172:6789/0 conn(0x7f863815de80 legacy=0x7f86380cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8638166a10 0x7f86200039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8620004010 0x7f8620004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 0x7f86200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862000bbd0 con 0x7f8620004d40 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862000bd80 con 0x7f8620004010 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862000bf80 con 0x7f8638166a10 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f86377fe640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 0x7f86200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:09.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f8636ffd640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8638166a10 0x7f86200039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f86367fc640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8620004010 0x7f8620004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f86377fe640 1 -- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8638166a10 msgr2=0x7f86200039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f86377fe640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8638166a10 0x7f86200039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f86377fe640 1 -- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8620004010 msgr2=0x7f8620004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f86377fe640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8620004010 0x7f8620004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f86377fe640 1 -- 172.21.15.172:0/2297521845 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8620003520 con 0x7f8620004d40 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.866+0000 7f86367fc640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8620004010 0x7f8620004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.867+0000 7f86377fe640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 0x7f86200051c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f863000ba00 tx=0x7f8620005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688d92ab2afb99eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.867+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630030070 con 0x7f8620004d40 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.867+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863002adb0 con 0x7f8620004d40 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.867+0000 7f8635ffb640 1 -- 172.21.15.172:0/2297521845 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863000b600 con 0x7f8620004d40 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.868+0000 7f863d91b640 1 -- 172.21.15.172:0/2297521845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 msgr2=0x7f86200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.868+0000 7f863d91b640 1 --2- 172.21.15.172:0/2297521845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 0x7f86200051c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f863000ba00 tx=0x7f8620005830 comp rx=0 tx=0).stop 2024-04-25T08:45:09.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.868+0000 7f86377fe640 1 -- 172.21.15.172:0/2297521845 reap_dead start 2024-04-25T08:45:09.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.868+0000 7f863d91b640 1 -- 172.21.15.172:0/2297521845 shutdown_connections 2024-04-25T08:45:09.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.868+0000 7f863d91b640 1 -- 172.21.15.172:0/2297521845 >> 172.21.15.172:0/2297521845 conn(0x7f86380b2390 msgr2=0x7f86380b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:09.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.868+0000 7f863d91b640 1 -- 172.21.15.172:0/2297521845 shutdown_connections 2024-04-25T08:45:09.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.868+0000 7f863d91b640 1 -- 172.21.15.172:0/2297521845 wait complete. 2024-04-25T08:45:09.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.869+0000 7f863d91b640 1 Processor -- start 2024-04-25T08:45:09.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.869+0000 7f863d91b640 1 -- start start 2024-04-25T08:45:09.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f863d91b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 0x7f86380ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:09.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f863d91b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86380af350 0x7f863814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:09.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f863d91b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86381412b0 0x7f86380b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:09.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f863d91b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86380b2eb0 con 0x7f8620004d40 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f863d91b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863815e260 con 0x7f86380af350 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f863d91b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86380b3030 con 0x7f86381412b0 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f8636ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 0x7f86380ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f8636ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 0x7f86380ae420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44962/0 (socket says 172.21.15.172:44962) 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f8636ffd640 1 -- 172.21.15.172:0/875572587 learned_addr learned my addr 172.21.15.172:0/875572587 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f8636ffd640 1 -- 172.21.15.172:0/875572587 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86381412b0 msgr2=0x7f86380b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f8636ffd640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86381412b0 0x7f86380b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f8636ffd640 1 -- 172.21.15.172:0/875572587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86380af350 msgr2=0x7f863814f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f8636ffd640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86380af350 0x7f863814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f8636ffd640 1 -- 172.21.15.172:0/875572587 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380ad6a0 con 0x7f8620004d40 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f8636ffd640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 0x7f86380ae420 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f86280079a0 tx=0x7f862800a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f861ffff640 1 -- 172.21.15.172:0/875572587 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8628017020 con 0x7f8620004d40 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f861ffff640 1 -- 172.21.15.172:0/875572587 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86280133f0 con 0x7f8620004d40 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f863d91b640 1 -- 172.21.15.172:0/875572587 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86380ad940 con 0x7f8620004d40 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f861ffff640 1 -- 172.21.15.172:0/875572587 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86280137e0 con 0x7f8620004d40 2024-04-25T08:45:09.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.870+0000 7f863d91b640 1 -- 172.21.15.172:0/875572587 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86380adf00 con 0x7f8620004d40 2024-04-25T08:45:09.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.872+0000 7f863d91b640 1 -- 172.21.15.172:0/875572587 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8638073a00 con 0x7f8620004d40 2024-04-25T08:45:09.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.872+0000 7f861ffff640 1 -- 172.21.15.172:0/875572587 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f862801a020 con 0x7f8620004d40 2024-04-25T08:45:09.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.872+0000 7f861ffff640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f862406b4d0 0x7f862406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:09.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.872+0000 7f861ffff640 1 -- 172.21.15.172:0/875572587 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f862808ad70 con 0x7f8620004d40 2024-04-25T08:45:09.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.872+0000 7f86367fc640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f862406b4d0 0x7f862406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:09.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.873+0000 7f86367fc640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f862406b4d0 0x7f862406d990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f862c007fd0 tx=0x7f862c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:09.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:09.876+0000 7f861ffff640 1 -- 172.21.15.172:0/875572587 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8628021020 con 0x7f8620004d40 2024-04-25T08:45:10.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.048+0000 7f863d91b640 1 -- 172.21.15.172:0/875572587 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f86380b2c70 con 0x7f8620004d40 2024-04-25T08:45:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.747+0000 7f861ffff640 1 -- 172.21.15.172:0/875572587 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8628059ba0 con 0x7f8620004d40 2024-04-25T08:45:10.739 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2024-04-25T08:45:10.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 -- 172.21.15.172:0/875572587 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f862406b4d0 msgr2=0x7f862406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:10.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f862406b4d0 0x7f862406d990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f862c007fd0 tx=0x7f862c009040 comp rx=0 tx=0).stop 2024-04-25T08:45:10.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 -- 172.21.15.172:0/875572587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 msgr2=0x7f86380ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:10.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 0x7f86380ae420 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f86280079a0 tx=0x7f862800a730 comp rx=0 tx=0).stop 2024-04-25T08:45:10.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 -- 172.21.15.172:0/875572587 shutdown_connections 2024-04-25T08:45:10.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f862406b4d0 0x7f862406d990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86380af350 0x7f863814f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86381412b0 0x7f86380b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 --2- 172.21.15.172:0/875572587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8620004d40 0x7f86380ae420 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 -- 172.21.15.172:0/875572587 >> 172.21.15.172:0/875572587 conn(0x7f86380b2390 msgr2=0x7f863806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 -- 172.21.15.172:0/875572587 shutdown_connections 2024-04-25T08:45:10.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.751+0000 7f863d91b640 1 -- 172.21.15.172:0/875572587 wait complete. 2024-04-25T08:45:10.758 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:45:10.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.867+0000 7f09bbccb640 1 Processor -- start 2024-04-25T08:45:10.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.867+0000 7f09bbccb640 1 -- start start 2024-04-25T08:45:10.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09bbccb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f09b4158230 0x7f09b40d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:10.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09bbccb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f09b40d1b80 0x7f09b406c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:10.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09bbccb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09b406c870 0x7f09b40b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:10.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09bbccb640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b4158610 con 0x7f09b4158230 2024-04-25T08:45:10.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09bbccb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b406bea0 con 0x7f09b40d1b80 2024-04-25T08:45:10.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09bbccb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40d2020 con 0x7f09b406c870 2024-04-25T08:45:10.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09b9a67640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f09b4158230 0x7f09b40d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:10.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09b9a67640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f09b4158230 0x7f09b40d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44968/0 (socket says 172.21.15.172:44968) 2024-04-25T08:45:10.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09b9a67640 1 -- 172.21.15.172:0/2690736879 learned_addr learned my addr 172.21.15.172:0/2690736879 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:10.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09b9a67640 1 -- 172.21.15.172:0/2690736879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09b406c870 msgr2=0x7f09b40b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:10.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09b9a67640 1 --2- 172.21.15.172:0/2690736879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09b406c870 0x7f09b40b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09b9a67640 1 -- 172.21.15.172:0/2690736879 >> v2:172.21.15.186:3300/0 conn(0x7f09b40d1b80 msgr2=0x7f09b406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:10.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09b9a67640 1 --2- 172.21.15.172:0/2690736879 >> v2:172.21.15.186:3300/0 conn(0x7f09b40d1b80 0x7f09b406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.868+0000 7f09b9a67640 1 -- 172.21.15.172:0/2690736879 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40d2300 con 0x7f09b4158230 2024-04-25T08:45:10.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.869+0000 7f09b9a67640 1 --2- 172.21.15.172:0/2690736879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b4158230 0x7f09b40d1640 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f09b415bcc0 tx=0x7f09b002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f4864cad6ab115 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.869+0000 7f09b8a65640 1 -- 172.21.15.172:0/2690736879 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0037070 con 0x7f09b4158230 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.869+0000 7f09b8a65640 1 -- 172.21.15.172:0/2690736879 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b0032440 con 0x7f09b4158230 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.869+0000 7f09b8a65640 1 -- 172.21.15.172:0/2690736879 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0032810 con 0x7f09b4158230 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.870+0000 7f09bbccb640 1 -- 172.21.15.172:0/2690736879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b4158230 msgr2=0x7f09b40d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.870+0000 7f09bbccb640 1 --2- 172.21.15.172:0/2690736879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b4158230 0x7f09b40d1640 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f09b415bcc0 tx=0x7f09b002a200 comp rx=0 tx=0).stop 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.870+0000 7f09bbccb640 1 -- 172.21.15.172:0/2690736879 shutdown_connections 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.870+0000 7f09bbccb640 1 --2- 172.21.15.172:0/2690736879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09b406c870 0x7f09b40b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.870+0000 7f09bbccb640 1 --2- 172.21.15.172:0/2690736879 >> v2:172.21.15.186:3300/0 conn(0x7f09b40d1b80 0x7f09b406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.870+0000 7f09bbccb640 1 --2- 172.21.15.172:0/2690736879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b4158230 0x7f09b40d1640 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.870+0000 7f09bbccb640 1 -- 172.21.15.172:0/2690736879 >> 172.21.15.172:0/2690736879 conn(0x7f09b4061600 msgr2=0x7f09b40619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.870+0000 7f09bbccb640 1 -- 172.21.15.172:0/2690736879 shutdown_connections 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.870+0000 7f09bbccb640 1 -- 172.21.15.172:0/2690736879 wait complete. 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.871+0000 7f09bbccb640 1 Processor -- start 2024-04-25T08:45:10.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.871+0000 7f09bbccb640 1 -- start start 2024-04-25T08:45:10.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09bbccb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b406c870 0x7f09b4145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:10.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09bbccb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b40d1b80 0x7f09b4155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:10.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09bbccb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09b4158230 0x7f09b41561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09bbccb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b415e320 con 0x7f09b40d1b80 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09bbccb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40d25e0 con 0x7f09b406c870 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09bbccb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b415e4a0 con 0x7f09b4158230 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09b9266640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b40d1b80 0x7f09b4155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09b9266640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b40d1b80 0x7f09b4155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44970/0 (socket says 172.21.15.172:44970) 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09b9266640 1 -- 172.21.15.172:0/1858048388 learned_addr learned my addr 172.21.15.172:0/1858048388 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09b9a67640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b406c870 0x7f09b4145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09ba268640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09b4158230 0x7f09b41561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09b9266640 1 -- 172.21.15.172:0/1858048388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09b4158230 msgr2=0x7f09b41561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09b9266640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09b4158230 0x7f09b41561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09b9266640 1 -- 172.21.15.172:0/1858048388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b406c870 msgr2=0x7f09b4145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09b9266640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b406c870 0x7f09b4145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:10.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09b9266640 1 -- 172.21.15.172:0/1858048388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b4146330 con 0x7f09b40d1b80 2024-04-25T08:45:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09ba268640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09b4158230 0x7f09b41561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09b9266640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b40d1b80 0x7f09b4155c80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f09a400b460 tx=0x7f09a400b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09aa7fc640 1 -- 172.21.15.172:0/1858048388 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a4015030 con 0x7f09b40d1b80 2024-04-25T08:45:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09aa7fc640 1 -- 172.21.15.172:0/1858048388 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a4005a10 con 0x7f09b40d1b80 2024-04-25T08:45:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09aa7fc640 1 -- 172.21.15.172:0/1858048388 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a4005e00 con 0x7f09b40d1b80 2024-04-25T08:45:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09bbccb640 1 -- 172.21.15.172:0/1858048388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b4156820 con 0x7f09b40d1b80 2024-04-25T08:45:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.872+0000 7f09bbccb640 1 -- 172.21.15.172:0/1858048388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b4156de0 con 0x7f09b40d1b80 2024-04-25T08:45:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.873+0000 7f09bbccb640 1 -- 172.21.15.172:0/1858048388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b406de50 con 0x7f09b40d1b80 2024-04-25T08:45:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.874+0000 7f09aa7fc640 1 -- 172.21.15.172:0/1858048388 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f09a4018070 con 0x7f09b40d1b80 2024-04-25T08:45:10.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.874+0000 7f09aa7fc640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f099806b4d0 0x7f099806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:10.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.874+0000 7f09b9a67640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f099806b4d0 0x7f099806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:10.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.874+0000 7f09aa7fc640 1 -- 172.21.15.172:0/1858048388 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f09a4089c50 con 0x7f09b40d1b80 2024-04-25T08:45:10.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.875+0000 7f09b9a67640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f099806b4d0 0x7f099806d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09b0034000 tx=0x7f09b002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:10.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:10.879+0000 7f09aa7fc640 1 -- 172.21.15.172:0/1858048388 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09a408f020 con 0x7f09b40d1b80 2024-04-25T08:45:11.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.049+0000 7f09bbccb640 1 -- 172.21.15.172:0/1858048388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f09b40b11f0 con 0x7f09b40d1b80 2024-04-25T08:45:11.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.052+0000 7f09aa7fc640 1 -- 172.21.15.172:0/1858048388 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09b4146330 con 0x7f09b40d1b80 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 -- 172.21.15.172:0/1858048388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f099806b4d0 msgr2=0x7f099806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f099806b4d0 0x7f099806d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09b0034000 tx=0x7f09b002e000 comp rx=0 tx=0).stop 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 -- 172.21.15.172:0/1858048388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b40d1b80 msgr2=0x7f09b4155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b40d1b80 0x7f09b4155c80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f09a400b460 tx=0x7f09a400b920 comp rx=0 tx=0).stop 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 -- 172.21.15.172:0/1858048388 shutdown_connections 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f099806b4d0 0x7f099806d990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09b4158230 0x7f09b41561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09b40d1b80 0x7f09b4155c80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 --2- 172.21.15.172:0/1858048388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b406c870 0x7f09b4145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 -- 172.21.15.172:0/1858048388 >> 172.21.15.172:0/1858048388 conn(0x7f09b4061600 msgr2=0x7f09b40b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 -- 172.21.15.172:0/1858048388 shutdown_connections 2024-04-25T08:45:11.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.054+0000 7f09bbccb640 1 -- 172.21.15.172:0/1858048388 wait complete. 2024-04-25T08:45:11.057 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-04-25T08:45:11.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.163+0000 7f5397fe2640 1 Processor -- start 2024-04-25T08:45:11.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.163+0000 7f5397fe2640 1 -- start start 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.164+0000 7f5397fe2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5390158220 0x7f539015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.164+0000 7f5397fe2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539015f180 con 0x7f53900afba0 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.164+0000 7f5397fe2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53901625d0 con 0x7f53900af720 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.164+0000 7f5397fe2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53900b3670 con 0x7f5390158220 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.164+0000 7f539657f640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f53900afba0 0x7f5390161ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48088/0 (socket says 172.21.15.172:48088) 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.164+0000 7f539657f640 1 -- 172.21.15.172:0/1527743281 learned_addr learned my addr 172.21.15.172:0/1527743281 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5395d7e640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5390158220 0x7f539015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844851828 0 0) 0x7f5388001110 con 0x7f53900afba0 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f537c003520 con 0x7f53900afba0 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2563384709 0 0) 0x7f537c003520 con 0x7f53900afba0 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5390158220 msgr2=0x7f539015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5390158220 0x7f539015ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 >> v1:172.21.15.186:6789/0 conn(0x7f53900af720 legacy=0x7f53901617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900b0030 con 0x7f53900afba0 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f5388001840 con 0x7f53900afba0 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 >> v1:172.21.15.172:6789/0 conn(0x7f53900afba0 legacy=0x7f5390161ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5390158220 0x7f537c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f537c003f20 0x7f537c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f537c004d40 0x7f537c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c00b9f0 con 0x7f537c004d40 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c00bba0 con 0x7f537c003f20 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c00bda0 con 0x7f5390158220 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f539657f640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f537c004d40 0x7f537c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f5395d7e640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5390158220 0x7f537c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f539557d640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f537c003f20 0x7f537c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f539657f640 1 -- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5390158220 msgr2=0x7f537c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f539657f640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5390158220 0x7f537c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f539657f640 1 -- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f537c003f20 msgr2=0x7f537c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f539657f640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f537c003f20 0x7f537c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.165+0000 7f539657f640 1 -- 172.21.15.172:0/1527743281 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c003520 con 0x7f537c004d40 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.166+0000 7f539657f640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f537c004d40 0x7f537c0051c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f538800c3e0 tx=0x7f537c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d7f34dc9eda2ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.166+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800c0e0 con 0x7f537c004d40 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.166+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5388034070 con 0x7f537c004d40 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.166+0000 7f5394d7c640 1 -- 172.21.15.172:0/1527743281 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388005d50 con 0x7f537c004d40 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.167+0000 7f5397fe2640 1 -- 172.21.15.172:0/1527743281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f537c004d40 msgr2=0x7f537c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.167+0000 7f5397fe2640 1 --2- 172.21.15.172:0/1527743281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f537c004d40 0x7f537c0051c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f538800c3e0 tx=0x7f537c005830 comp rx=0 tx=0).stop 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.167+0000 7f539657f640 1 -- 172.21.15.172:0/1527743281 reap_dead start 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.167+0000 7f5397fe2640 1 -- 172.21.15.172:0/1527743281 shutdown_connections 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.167+0000 7f5397fe2640 1 -- 172.21.15.172:0/1527743281 >> 172.21.15.172:0/1527743281 conn(0x7f53900b2370 msgr2=0x7f53900b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.167+0000 7f5397fe2640 1 -- 172.21.15.172:0/1527743281 shutdown_connections 2024-04-25T08:45:11.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.167+0000 7f5397fe2640 1 -- 172.21.15.172:0/1527743281 wait complete. 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.168+0000 7f5397fe2640 1 Processor -- start 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.168+0000 7f5397fe2640 1 -- start start 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f5397fe2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c004d40 0x7f53901f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f5397fe2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539015a110 0x7f5390160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f5397fe2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5390160c50 0x7f5390154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f5397fe2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900700e0 con 0x7f539015a110 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f5397fe2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5390070a10 con 0x7f5390160c50 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f5397fe2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53900703c0 con 0x7f537c004d40 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f539557d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539015a110 0x7f5390160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f539557d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539015a110 0x7f5390160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44978/0 (socket says 172.21.15.172:44978) 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f539557d640 1 -- 172.21.15.172:0/2073827077 learned_addr learned my addr 172.21.15.172:0/2073827077 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f5395d7e640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c004d40 0x7f53901f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f539557d640 1 -- 172.21.15.172:0/2073827077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c004d40 msgr2=0x7f53901f6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f539657f640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5390160c50 0x7f5390154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f539557d640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c004d40 0x7f53901f6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f539557d640 1 -- 172.21.15.172:0/2073827077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5390160c50 msgr2=0x7f5390154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f539557d640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5390160c50 0x7f5390154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f539557d640 1 -- 172.21.15.172:0/2073827077 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53901f70d0 con 0x7f539015a110 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f5395d7e640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c004d40 0x7f53901f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f539557d640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539015a110 0x7f5390160710 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f538000f820 tx=0x7f538000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f53867fc640 1 -- 172.21.15.172:0/2073827077 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53800052e0 con 0x7f539015a110 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f53867fc640 1 -- 172.21.15.172:0/2073827077 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5380018070 con 0x7f539015a110 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.169+0000 7f5397fe2640 1 -- 172.21.15.172:0/2073827077 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53901f73b0 con 0x7f539015a110 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.170+0000 7f53867fc640 1 -- 172.21.15.172:0/2073827077 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000d970 con 0x7f539015a110 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.170+0000 7f5397fe2640 1 -- 172.21.15.172:0/2073827077 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53901f7970 con 0x7f539015a110 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.170+0000 7f5397fe2640 1 -- 172.21.15.172:0/2073827077 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5390073990 con 0x7f539015a110 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.171+0000 7f53867fc640 1 -- 172.21.15.172:0/2073827077 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f538000db10 con 0x7f539015a110 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.171+0000 7f53867fc640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f537406b500 0x7f537406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.171+0000 7f5395d7e640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f537406b500 0x7f537406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.171+0000 7f53867fc640 1 -- 172.21.15.172:0/2073827077 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f5380089fa0 con 0x7f539015a110 2024-04-25T08:45:11.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.172+0000 7f5395d7e640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f537406b500 0x7f537406d9c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f53901612d0 tx=0x7f538c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:11.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.175+0000 7f53867fc640 1 -- 172.21.15.172:0/2073827077 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f538001a310 con 0x7f539015a110 2024-04-25T08:45:11.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.411+0000 7f5397fe2640 1 -- 172.21.15.172:0/2073827077 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7f539015f6a0 con 0x7f539015a110 2024-04-25T08:45:11.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.749+0000 7f53867fc640 1 -- 172.21.15.172:0/2073827077 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v147) v1 ==== 148+0+0 (secure 0 0 0) 0x7f5380058f90 con 0x7f539015a110 2024-04-25T08:45:11.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 -- 172.21.15.172:0/2073827077 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f537406b500 msgr2=0x7f537406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f537406b500 0x7f537406d9c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f53901612d0 tx=0x7f538c00b040 comp rx=0 tx=0).stop 2024-04-25T08:45:11.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 -- 172.21.15.172:0/2073827077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539015a110 msgr2=0x7f5390160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539015a110 0x7f5390160710 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f538000f820 tx=0x7f538000fce0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 -- 172.21.15.172:0/2073827077 shutdown_connections 2024-04-25T08:45:11.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f537406b500 0x7f537406d9c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5390160c50 0x7f5390154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539015a110 0x7f5390160710 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 --2- 172.21.15.172:0/2073827077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c004d40 0x7f53901f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 -- 172.21.15.172:0/2073827077 >> 172.21.15.172:0/2073827077 conn(0x7f53900b2370 msgr2=0x7f53900d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:11.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 -- 172.21.15.172:0/2073827077 shutdown_connections 2024-04-25T08:45:11.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.751+0000 7f5397fe2640 1 -- 172.21.15.172:0/2073827077 wait complete. 2024-04-25T08:45:11.754 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-04-25T08:45:11.754 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T08:45:11.754 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:11.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.869+0000 7f51752b3640 1 Processor -- start 2024-04-25T08:45:11.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.869+0000 7f51752b3640 1 -- start start 2024-04-25T08:45:11.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f51752b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700b2cb0 0x7f51700d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f51752b3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51700d1020 0x7f51700d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f51752b3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51700b97a0 con 0x7f517015dbe0 2024-04-25T08:45:11.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f51752b3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517015dfc0 con 0x7f51700d1020 2024-04-25T08:45:11.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f51752b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51700d1a00 con 0x7f51700b2cb0 2024-04-25T08:45:11.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f516f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51700d1020 0x7f51700d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f516effd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f517015dbe0 0x7f51700d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48090/0 (socket says 172.21.15.172:48090) 2024-04-25T08:45:11.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f516effd640 1 -- 172.21.15.172:0/2708122915 learned_addr learned my addr 172.21.15.172:0/2708122915 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:11.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f5167fff640 1 --2- 172.21.15.172:0/2708122915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700b2cb0 0x7f51700d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f516f7fe640 1 -- 172.21.15.172:0/2708122915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700b2cb0 msgr2=0x7f51700d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:11.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f516f7fe640 1 --2- 172.21.15.172:0/2708122915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700b2cb0 0x7f51700d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f516f7fe640 1 -- 172.21.15.172:0/2708122915 >> v1:172.21.15.172:6789/0 conn(0x7f517015dbe0 legacy=0x7f51700d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f516f7fe640 1 -- 172.21.15.172:0/2708122915 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700d1c50 con 0x7f51700d1020 2024-04-25T08:45:11.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f516e7fc640 1 -- 172.21.15.172:0/2708122915 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262577998 0 0) 0x7f51700b97a0 con 0x7f517015dbe0 2024-04-25T08:45:11.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.870+0000 7f5167fff640 1 --2- 172.21.15.172:0/2708122915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700b2cb0 0x7f51700d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:11.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.871+0000 7f516f7fe640 1 --2- 172.21.15.172:0/2708122915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700d1020 0x7f51700d2c70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5168009d90 tx=0x7f516802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfab2d789fc333d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:11.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.871+0000 7f516e7fc640 1 -- 172.21.15.172:0/2708122915 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168007740 con 0x7f51700d1020 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.871+0000 7f516e7fc640 1 -- 172.21.15.172:0/2708122915 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51680078e0 con 0x7f51700d1020 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.871+0000 7f516e7fc640 1 -- 172.21.15.172:0/2708122915 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168007cb0 con 0x7f51700d1020 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.872+0000 7f51752b3640 1 -- 172.21.15.172:0/2708122915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700d1020 msgr2=0x7f51700d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.872+0000 7f51752b3640 1 --2- 172.21.15.172:0/2708122915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700d1020 0x7f51700d2c70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5168009d90 tx=0x7f516802a660 comp rx=0 tx=0).stop 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.872+0000 7f51752b3640 1 -- 172.21.15.172:0/2708122915 shutdown_connections 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.872+0000 7f51752b3640 1 --2- 172.21.15.172:0/2708122915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700b2cb0 0x7f51700d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.872+0000 7f51752b3640 1 --2- 172.21.15.172:0/2708122915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700d1020 0x7f51700d2c70 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.872+0000 7f51752b3640 1 -- 172.21.15.172:0/2708122915 >> 172.21.15.172:0/2708122915 conn(0x7f5170061a20 msgr2=0x7f5170061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.872+0000 7f51752b3640 1 -- 172.21.15.172:0/2708122915 shutdown_connections 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.872+0000 7f51752b3640 1 -- 172.21.15.172:0/2708122915 wait complete. 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.873+0000 7f51752b3640 1 Processor -- start 2024-04-25T08:45:11.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.873+0000 7f51752b3640 1 -- start start 2024-04-25T08:45:11.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.873+0000 7f51752b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700b2cb0 0x7f51700cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.873+0000 7f51752b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700d1020 0x7f517014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.873+0000 7f51752b3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f517015dbe0 0x7f51701576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.873+0000 7f51752b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51700b92a0 con 0x7f51700b2cb0 2024-04-25T08:45:11.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.873+0000 7f51752b3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51700d2210 con 0x7f517015dbe0 2024-04-25T08:45:11.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.873+0000 7f51752b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51700b9420 con 0x7f51700d1020 2024-04-25T08:45:11.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f516effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700b2cb0 0x7f51700cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f516effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700b2cb0 0x7f51700cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:44996/0 (socket says 172.21.15.172:44996) 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f516effd640 1 -- 172.21.15.172:0/951529237 learned_addr learned my addr 172.21.15.172:0/951529237 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f516effd640 1 -- 172.21.15.172:0/951529237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700d1020 msgr2=0x7f517014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f5167fff640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700d1020 0x7f517014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f516effd640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700d1020 0x7f517014bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f516f7fe640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f517015dbe0 0x7f51701576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f516effd640 1 -- 172.21.15.172:0/951529237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f517015dbe0 msgr2=0x7f51701576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f516effd640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f517015dbe0 0x7f51701576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f516effd640 1 -- 172.21.15.172:0/951529237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700cd9a0 con 0x7f51700b2cb0 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f516effd640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700b2cb0 0x7f51700cd460 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f516000c430 tx=0x7f516000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f51677fe640 1 -- 172.21.15.172:0/951529237 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51600074e0 con 0x7f51700b2cb0 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f51677fe640 1 -- 172.21.15.172:0/951529237 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51600047e0 con 0x7f51700b2cb0 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f51677fe640 1 -- 172.21.15.172:0/951529237 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160004bd0 con 0x7f51700b2cb0 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f51752b3640 1 -- 172.21.15.172:0/951529237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517014c1b0 con 0x7f51700b2cb0 2024-04-25T08:45:11.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.874+0000 7f51752b3640 1 -- 172.21.15.172:0/951529237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51700cb6b0 con 0x7f51700b2cb0 2024-04-25T08:45:11.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.875+0000 7f51752b3640 1 -- 172.21.15.172:0/951529237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5170073990 con 0x7f51700b2cb0 2024-04-25T08:45:11.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.876+0000 7f51677fe640 1 -- 172.21.15.172:0/951529237 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5160011070 con 0x7f51700b2cb0 2024-04-25T08:45:11.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.876+0000 7f51677fe640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f515006b4d0 0x7f515006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:11.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.876+0000 7f51677fe640 1 -- 172.21.15.172:0/951529237 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f5160089c20 con 0x7f51700b2cb0 2024-04-25T08:45:11.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.876+0000 7f5167fff640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f515006b4d0 0x7f515006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:11.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.877+0000 7f5167fff640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f515006b4d0 0x7f515006d990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5170155520 tx=0x7f5158008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:11.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:11.880+0000 7f51677fe640 1 -- 172.21.15.172:0/951529237 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51700cd9a0 con 0x7f51700b2cb0 2024-04-25T08:45:12.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.052+0000 7f51752b3640 1 -- 172.21.15.172:0/951529237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51700d2a40 con 0x7f51700b2cb0 2024-04-25T08:45:12.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.053+0000 7f51677fe640 1 -- 172.21.15.172:0/951529237 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+13355 (secure 0 0 0) 0x7f5160058ca0 con 0x7f51700b2cb0 2024-04-25T08:45:12.044 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:12.045 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":45,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:45:10.746729+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6837/3537703238":"2024-04-26T08:45:07.736394+0000","172.21.15.172:6835/3537703238":"2024-04-26T08:45:07.736394+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:12.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 -- 172.21.15.172:0/951529237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f515006b4d0 msgr2=0x7f515006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f515006b4d0 0x7f515006d990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5170155520 tx=0x7f5158008040 comp rx=0 tx=0).stop 2024-04-25T08:45:12.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 -- 172.21.15.172:0/951529237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700b2cb0 msgr2=0x7f51700cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700b2cb0 0x7f51700cd460 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f516000c430 tx=0x7f516000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 -- 172.21.15.172:0/951529237 shutdown_connections 2024-04-25T08:45:12.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f515006b4d0 0x7f515006d990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f517015dbe0 0x7f51701576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51700d1020 0x7f517014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 --2- 172.21.15.172:0/951529237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51700b2cb0 0x7f51700cd460 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 -- 172.21.15.172:0/951529237 >> 172.21.15.172:0/951529237 conn(0x7f5170061a20 msgr2=0x7f51700b8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:12.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 -- 172.21.15.172:0/951529237 shutdown_connections 2024-04-25T08:45:12.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.055+0000 7f51752b3640 1 -- 172.21.15.172:0/951529237 wait complete. 2024-04-25T08:45:12.058 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:45:12.058 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:45:12.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.168+0000 7fc5de36a640 1 Processor -- start 2024-04-25T08:45:12.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.168+0000 7fc5de36a640 1 -- start start 2024-04-25T08:45:12.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.168+0000 7fc5de36a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc5d80cfa40 0x7fc5d80cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.168+0000 7fc5de36a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d80c75e0 con 0x7fc5d80cf600 2024-04-25T08:45:12.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.168+0000 7fc5de36a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d80c78c0 con 0x7fc5d815bb50 2024-04-25T08:45:12.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.168+0000 7fc5de36a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d80c8680 con 0x7fc5d80cfa40 2024-04-25T08:45:12.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d77fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc5d80cf600 0x7fc5d80cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48098/0 (socket says 172.21.15.172:48098) 2024-04-25T08:45:12.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d77fe640 1 -- 172.21.15.172:0/3577873125 learned_addr learned my addr 172.21.15.172:0/3577873125 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:12.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287411768 0 0) 0x7fc5d80c75e0 con 0x7fc5d80cf600 2024-04-25T08:45:12.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c0003520 con 0x7fc5d80cf600 2024-04-25T08:45:12.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5dc907640 1 --2- 172.21.15.172:0/3577873125 >> v2:172.21.15.186:3300/0 conn(0x7fc5d80cfa40 0x7fc5d80cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641077911 0 0) 0x7fc5c0003520 con 0x7fc5d80cf600 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 >> v2:172.21.15.186:3300/0 conn(0x7fc5d80cfa40 msgr2=0x7fc5d80cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 --2- 172.21.15.172:0/3577873125 >> v2:172.21.15.186:3300/0 conn(0x7fc5d80cfa40 0x7fc5d80cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 >> v1:172.21.15.186:6789/0 conn(0x7fc5d815bb50 legacy=0x7fc5d80c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d80c7ba0 con 0x7fc5d80cf600 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fc5cc001670 con 0x7fc5d80cf600 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5dc907640 1 --2- 172.21.15.172:0/3577873125 >> v2:172.21.15.186:3300/0 conn(0x7fc5d80cfa40 0x7fc5d80cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 >> v1:172.21.15.172:6789/0 conn(0x7fc5d80cf600 legacy=0x7fc5d80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c00039b0 0x7fc5c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5c0004800 0x7fc5c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5c00051c0 0x7fc5c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80c8680 con 0x7fc5c00039b0 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c000c0f0 con 0x7fc5c0004800 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c000c2f0 con 0x7fc5c00051c0 2024-04-25T08:45:12.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d7fff640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c00039b0 0x7fc5c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5d77fe640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5c0004800 0x7fc5c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.169+0000 7fc5dc907640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5c00051c0 0x7fc5c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.170+0000 7fc5d7fff640 1 -- 172.21.15.172:0/3577873125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5c00051c0 msgr2=0x7fc5c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.170+0000 7fc5d7fff640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5c00051c0 0x7fc5c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.170+0000 7fc5d7fff640 1 -- 172.21.15.172:0/3577873125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5c0004800 msgr2=0x7fc5c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.170+0000 7fc5d7fff640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5c0004800 0x7fc5c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.170+0000 7fc5d7fff640 1 -- 172.21.15.172:0/3577873125 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c0003520 con 0x7fc5c00039b0 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.170+0000 7fc5dc907640 1 -- 172.21.15.172:0/3577873125 reap_dead start 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.170+0000 7fc5d7fff640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c00039b0 0x7fc5c0003dd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8001750 tx=0x7fc5c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecb12787127b3a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.170+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8001370 con 0x7fc5c00039b0 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.170+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c80052d0 con 0x7fc5c00039b0 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.170+0000 7fc5d6ffd640 1 -- 172.21.15.172:0/3577873125 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c802abe0 con 0x7fc5c00039b0 2024-04-25T08:45:12.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.171+0000 7fc5de36a640 1 -- 172.21.15.172:0/3577873125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c00039b0 msgr2=0x7fc5c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.171+0000 7fc5de36a640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c00039b0 0x7fc5c0003dd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8001750 tx=0x7fc5c0005830 comp rx=0 tx=0).stop 2024-04-25T08:45:12.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.171+0000 7fc5de36a640 1 -- 172.21.15.172:0/3577873125 shutdown_connections 2024-04-25T08:45:12.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.171+0000 7fc5de36a640 1 --2- 172.21.15.172:0/3577873125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c00039b0 0x7fc5c0003dd0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.171+0000 7fc5de36a640 1 -- 172.21.15.172:0/3577873125 >> 172.21.15.172:0/3577873125 conn(0x7fc5d806f500 msgr2=0x7fc5d806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:12.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.171+0000 7fc5de36a640 1 -- 172.21.15.172:0/3577873125 shutdown_connections 2024-04-25T08:45:12.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.171+0000 7fc5de36a640 1 -- 172.21.15.172:0/3577873125 wait complete. 2024-04-25T08:45:12.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.172+0000 7fc5de36a640 1 Processor -- start 2024-04-25T08:45:12.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.172+0000 7fc5de36a640 1 -- start start 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5de36a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5c00039b0 0x7fc5d814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5de36a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d814ff50 0x7fc5d815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5de36a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5d814fa00 0x7fc5d815e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5de36a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80cfe90 con 0x7fc5d814ff50 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5de36a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d80c8160 con 0x7fc5d814fa00 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5de36a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d815f6d0 con 0x7fc5c00039b0 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d814ff50 0x7fc5d815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5d77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d814ff50 0x7fc5d815d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45014/0 (socket says 172.21.15.172:45014) 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5d77fe640 1 -- 172.21.15.172:0/2360810673 learned_addr learned my addr 172.21.15.172:0/2360810673 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5d7fff640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5c00039b0 0x7fc5d814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5d77fe640 1 -- 172.21.15.172:0/2360810673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5c00039b0 msgr2=0x7fc5d814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5d77fe640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5c00039b0 0x7fc5d814f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5dc907640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5d814fa00 0x7fc5d815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5d77fe640 1 -- 172.21.15.172:0/2360810673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5d814fa00 msgr2=0x7fc5d815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5d77fe640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5d814fa00 0x7fc5d815e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5d77fe640 1 -- 172.21.15.172:0/2360810673 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d815d820 con 0x7fc5d814ff50 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.173+0000 7fc5dc907640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5d814fa00 0x7fc5d815e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.174+0000 7fc5d77fe640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d814ff50 0x7fc5d815d2e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00e730 tx=0x7fc5cc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.174+0000 7fc5d4ff9640 1 -- 172.21.15.172:0/2360810673 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc00c6c0 con 0x7fc5d814ff50 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.174+0000 7fc5d4ff9640 1 -- 172.21.15.172:0/2360810673 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5cc018070 con 0x7fc5d814ff50 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.174+0000 7fc5d4ff9640 1 -- 172.21.15.172:0/2360810673 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc00caa0 con 0x7fc5d814ff50 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.174+0000 7fc5de36a640 1 -- 172.21.15.172:0/2360810673 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d815a3d0 con 0x7fc5d814ff50 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.174+0000 7fc5de36a640 1 -- 172.21.15.172:0/2360810673 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d815cae0 con 0x7fc5d814ff50 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.175+0000 7fc5de36a640 1 -- 172.21.15.172:0/2360810673 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d815c8f0 con 0x7fc5d814ff50 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.175+0000 7fc5d4ff9640 1 -- 172.21.15.172:0/2360810673 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc5cc01d460 con 0x7fc5d814ff50 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.176+0000 7fc5d4ff9640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5c406b500 0x7fc5c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.176+0000 7fc5d4ff9640 1 -- 172.21.15.172:0/2360810673 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc5cc08a140 con 0x7fc5d814ff50 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.176+0000 7fc5d7fff640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5c406b500 0x7fc5c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.176+0000 7fc5d7fff640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5c406b500 0x7fc5c406d9c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8032000 tx=0x7fc5c802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:12.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.180+0000 7fc5d4ff9640 1 -- 172.21.15.172:0/2360810673 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5cc0590a0 con 0x7fc5d814ff50 2024-04-25T08:45:12.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.350+0000 7fc5de36a640 1 -- 172.21.15.172:0/2360810673 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5d8073a00 con 0x7fc5d814ff50 2024-04-25T08:45:12.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.351+0000 7fc5d4ff9640 1 -- 172.21.15.172:0/2360810673 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5cc0589a0 con 0x7fc5d814ff50 2024-04-25T08:45:12.342 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.352+0000 7fc5de36a640 1 -- 172.21.15.172:0/2360810673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5c406b500 msgr2=0x7fc5c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.352+0000 7fc5de36a640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5c406b500 0x7fc5c406d9c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8032000 tx=0x7fc5c802e000 comp rx=0 tx=0).stop 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.352+0000 7fc5de36a640 1 -- 172.21.15.172:0/2360810673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d814ff50 msgr2=0x7fc5d815d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.352+0000 7fc5de36a640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d814ff50 0x7fc5d815d2e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00e730 tx=0x7fc5cc00ebf0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.352+0000 7fc5de36a640 1 -- 172.21.15.172:0/2360810673 shutdown_connections 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.352+0000 7fc5de36a640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5c406b500 0x7fc5c406d9c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.352+0000 7fc5de36a640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5d814fa00 0x7fc5d815e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.352+0000 7fc5de36a640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5d814ff50 0x7fc5d815d2e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.352+0000 7fc5de36a640 1 --2- 172.21.15.172:0/2360810673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5c00039b0 0x7fc5d814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.353+0000 7fc5de36a640 1 -- 172.21.15.172:0/2360810673 >> 172.21.15.172:0/2360810673 conn(0x7fc5d806f500 msgr2=0x7fc5d80cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.353+0000 7fc5de36a640 1 -- 172.21.15.172:0/2360810673 shutdown_connections 2024-04-25T08:45:12.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.353+0000 7fc5de36a640 1 -- 172.21.15.172:0/2360810673 wait complete. 2024-04-25T08:45:12.356 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-04-25T08:45:12.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.461+0000 7f179aa76640 1 Processor -- start 2024-04-25T08:45:12.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.461+0000 7f179aa76640 1 -- start start 2024-04-25T08:45:12.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f179aa76640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179406abe0 0x7f179406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f179aa76640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f179415d370 0x7f179415d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f179aa76640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17941626e0 con 0x7f17940ce330 2024-04-25T08:45:12.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f179aa76640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179406b500 con 0x7f179415d370 2024-04-25T08:45:12.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f179aa76640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1794070270 con 0x7f179406abe0 2024-04-25T08:45:12.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f1793fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f17940ce330 0x7f179406fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48114/0 (socket says 172.21.15.172:48114) 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f1793fff640 1 -- 172.21.15.172:0/3764714434 learned_addr learned my addr 172.21.15.172:0/3764714434 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f1798812640 1 --2- 172.21.15.172:0/3764714434 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179406abe0 0x7f179406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f1799013640 1 --2- 172.21.15.172:0/3764714434 >> v2:172.21.15.186:3300/0 conn(0x7f179415d370 0x7f179415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f17937fe640 1 -- 172.21.15.172:0/3764714434 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825790085 0 0) 0x7f17941626e0 con 0x7f17940ce330 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.462+0000 7f17937fe640 1 -- 172.21.15.172:0/3764714434 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f177c003520 con 0x7f17940ce330 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.463+0000 7f1798812640 1 -- 172.21.15.172:0/3764714434 >> v2:172.21.15.186:3300/0 conn(0x7f179415d370 msgr2=0x7f179415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.463+0000 7f1798812640 1 --2- 172.21.15.172:0/3764714434 >> v2:172.21.15.186:3300/0 conn(0x7f179415d370 0x7f179415d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.463+0000 7f17937fe640 1 -- 172.21.15.172:0/3764714434 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2552029333 0 0) 0x7f177c003520 con 0x7f17940ce330 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.463+0000 7f1798812640 1 -- 172.21.15.172:0/3764714434 >> v1:172.21.15.172:6789/0 conn(0x7f17940ce330 legacy=0x7f179406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.463+0000 7f1798812640 1 -- 172.21.15.172:0/3764714434 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940cd270 con 0x7f179406abe0 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.463+0000 7f1798812640 1 --2- 172.21.15.172:0/3764714434 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179406abe0 0x7f179406afc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17840097a0 tx=0x7f178402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a6e3aed8c05f482 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f17937fe640 1 -- 172.21.15.172:0/3764714434 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784037070 con 0x7f179406abe0 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f17937fe640 1 -- 172.21.15.172:0/3764714434 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178402ab10 con 0x7f179406abe0 2024-04-25T08:45:12.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f17937fe640 1 -- 172.21.15.172:0/3764714434 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788001670 con 0x7f179406abe0 2024-04-25T08:45:12.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f179aa76640 1 -- 172.21.15.172:0/3764714434 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179406abe0 msgr2=0x7f179406afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f179aa76640 1 --2- 172.21.15.172:0/3764714434 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179406abe0 0x7f179406afc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17840097a0 tx=0x7f178402a080 comp rx=0 tx=0).stop 2024-04-25T08:45:12.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f179aa76640 1 -- 172.21.15.172:0/3764714434 shutdown_connections 2024-04-25T08:45:12.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f179aa76640 1 --2- 172.21.15.172:0/3764714434 >> v2:172.21.15.186:3300/0 conn(0x7f179415d370 0x7f179415d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f179aa76640 1 --2- 172.21.15.172:0/3764714434 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179406abe0 0x7f179406afc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f179aa76640 1 -- 172.21.15.172:0/3764714434 >> 172.21.15.172:0/3764714434 conn(0x7f17940b2220 msgr2=0x7f17940b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:12.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f179aa76640 1 -- 172.21.15.172:0/3764714434 shutdown_connections 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.464+0000 7f179aa76640 1 -- 172.21.15.172:0/3764714434 wait complete. 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.465+0000 7f179aa76640 1 Processor -- start 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.465+0000 7f179aa76640 1 -- start start 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f179aa76640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f179406abe0 0x7f179414de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f179aa76640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17940ce330 0x7f17940ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f179aa76640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179415d370 0x7f17940ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f179aa76640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17940cdb10 con 0x7f179406abe0 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f179aa76640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17940cd830 con 0x7f17940ce330 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f179aa76640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1794161780 con 0x7f179415d370 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f1798812640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f179406abe0 0x7f179414de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f1798812640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f179406abe0 0x7f179414de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45026/0 (socket says 172.21.15.172:45026) 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f1798812640 1 -- 172.21.15.172:0/1972523036 learned_addr learned my addr 172.21.15.172:0/1972523036 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f1799013640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179415d370 0x7f17940ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.466+0000 7f1793fff640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17940ce330 0x7f17940ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f1798812640 1 -- 172.21.15.172:0/1972523036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179415d370 msgr2=0x7f17940ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f1798812640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179415d370 0x7f17940ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f1798812640 1 -- 172.21.15.172:0/1972523036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17940ce330 msgr2=0x7f17940ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f1798812640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17940ce330 0x7f17940ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f1798812640 1 -- 172.21.15.172:0/1972523036 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17941f7a60 con 0x7f179406abe0 2024-04-25T08:45:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f1798812640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f179406abe0 0x7f179414de10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f17840097a0 tx=0x7f17840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f17917fa640 1 -- 172.21.15.172:0/1972523036 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784037040 con 0x7f179406abe0 2024-04-25T08:45:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f17917fa640 1 -- 172.21.15.172:0/1972523036 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1784004230 con 0x7f179406abe0 2024-04-25T08:45:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f179aa76640 1 -- 172.21.15.172:0/1972523036 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17941f7cd0 con 0x7f179406abe0 2024-04-25T08:45:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f17917fa640 1 -- 172.21.15.172:0/1972523036 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784006e10 con 0x7f179406abe0 2024-04-25T08:45:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.467+0000 7f179aa76640 1 -- 172.21.15.172:0/1972523036 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17941f8290 con 0x7f179406abe0 2024-04-25T08:45:12.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.468+0000 7f179aa76640 1 -- 172.21.15.172:0/1972523036 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1794073990 con 0x7f179406abe0 2024-04-25T08:45:12.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.468+0000 7f17917fa640 1 -- 172.21.15.172:0/1972523036 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1784003610 con 0x7f179406abe0 2024-04-25T08:45:12.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.469+0000 7f17917fa640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f178006b500 0x7f178006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.469+0000 7f17917fa640 1 -- 172.21.15.172:0/1972523036 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f17840aae60 con 0x7f179406abe0 2024-04-25T08:45:12.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.469+0000 7f1793fff640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f178006b500 0x7f178006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.469+0000 7f1793fff640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f178006b500 0x7f178006d9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f17940b6210 tx=0x7f1788009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:12.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.473+0000 7f17917fa640 1 -- 172.21.15.172:0/1972523036 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1784079ee0 con 0x7f179406abe0 2024-04-25T08:45:12.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.709+0000 7f179aa76640 1 -- 172.21.15.172:0/1972523036 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7f17940afe50 con 0x7f179406abe0 2024-04-25T08:45:12.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.753+0000 7f17917fa640 1 -- 172.21.15.172:0/1972523036 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v148) v1 ==== 146+0+0 (secure 0 0 0) 0x7f17840797e0 con 0x7f179406abe0 2024-04-25T08:45:12.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 -- 172.21.15.172:0/1972523036 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f178006b500 msgr2=0x7f178006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f178006b500 0x7f178006d9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f17940b6210 tx=0x7f1788009040 comp rx=0 tx=0).stop 2024-04-25T08:45:12.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 -- 172.21.15.172:0/1972523036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f179406abe0 msgr2=0x7f179414de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f179406abe0 0x7f179414de10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f17840097a0 tx=0x7f17840046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 -- 172.21.15.172:0/1972523036 shutdown_connections 2024-04-25T08:45:12.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f178006b500 0x7f178006d9c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17940ce330 0x7f17940ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f179415d370 0x7f17940ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 --2- 172.21.15.172:0/1972523036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f179406abe0 0x7f179414de10 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 -- 172.21.15.172:0/1972523036 >> 172.21.15.172:0/1972523036 conn(0x7f17940b2220 msgr2=0x7f17940b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:12.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 -- 172.21.15.172:0/1972523036 shutdown_connections 2024-04-25T08:45:12.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.755+0000 7f179aa76640 1 -- 172.21.15.172:0/1972523036 wait complete. 2024-04-25T08:45:12.758 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:45:12.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.866+0000 7ff9a5212640 1 Processor -- start 2024-04-25T08:45:12.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.867+0000 7ff9a5212640 1 -- start start 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.867+0000 7ff9a5212640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9a015dc20 0x7ff9a00ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.867+0000 7ff9a5212640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff9a0161710 0x7ff9a00cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.867+0000 7ff9a5212640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a015e000 con 0x7ff9a00b9330 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.867+0000 7ff9a5212640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a00d1de0 con 0x7ff9a015dc20 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.867+0000 7ff9a5212640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a0161c60 con 0x7ff9a0161710 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.867+0000 7ff99ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9a015dc20 0x7ff9a00ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.867+0000 7ff99f59e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff9a00b9330 0x7ff9a006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48124/0 (socket says 172.21.15.172:48124) 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.868+0000 7ff99f59e640 1 -- 172.21.15.172:0/2657729268 learned_addr learned my addr 172.21.15.172:0/2657729268 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.868+0000 7ff997fff640 1 --2- 172.21.15.172:0/2657729268 >> v2:172.21.15.186:3300/0 conn(0x7ff9a0161710 0x7ff9a00cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.868+0000 7ff99ed9d640 1 -- 172.21.15.172:0/2657729268 >> v2:172.21.15.186:3300/0 conn(0x7ff9a0161710 msgr2=0x7ff9a00cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.868+0000 7ff99ed9d640 1 --2- 172.21.15.172:0/2657729268 >> v2:172.21.15.186:3300/0 conn(0x7ff9a0161710 0x7ff9a00cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.868+0000 7ff99ed9d640 1 -- 172.21.15.172:0/2657729268 >> v1:172.21.15.172:6789/0 conn(0x7ff9a00b9330 legacy=0x7ff9a006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.868+0000 7ff99ed9d640 1 -- 172.21.15.172:0/2657729268 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0161f40 con 0x7ff9a015dc20 2024-04-25T08:45:12.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.868+0000 7ff99e59c640 1 -- 172.21.15.172:0/2657729268 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257283689 0 0) 0x7ff9a015e000 con 0x7ff9a00b9330 2024-04-25T08:45:12.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.868+0000 7ff99ed9d640 1 --2- 172.21.15.172:0/2657729268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 0x7ff9a00ce670 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff9a006da90 tx=0x7ff99002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773de7c425804edc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:12.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff99e59c640 1 -- 172.21.15.172:0/2657729268 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990037070 con 0x7ff9a015dc20 2024-04-25T08:45:12.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff99e59c640 1 -- 172.21.15.172:0/2657729268 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff990032440 con 0x7ff9a015dc20 2024-04-25T08:45:12.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff99e59c640 1 -- 172.21.15.172:0/2657729268 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990032810 con 0x7ff9a015dc20 2024-04-25T08:45:12.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff9a5212640 1 -- 172.21.15.172:0/2657729268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 msgr2=0x7ff9a00ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff9a5212640 1 --2- 172.21.15.172:0/2657729268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 0x7ff9a00ce670 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff9a006da90 tx=0x7ff99002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff9a5212640 1 -- 172.21.15.172:0/2657729268 shutdown_connections 2024-04-25T08:45:12.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff9a5212640 1 --2- 172.21.15.172:0/2657729268 >> v2:172.21.15.186:3300/0 conn(0x7ff9a0161710 0x7ff9a00cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff9a5212640 1 --2- 172.21.15.172:0/2657729268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 0x7ff9a00ce670 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff9a5212640 1 -- 172.21.15.172:0/2657729268 >> 172.21.15.172:0/2657729268 conn(0x7ff9a00d0420 msgr2=0x7ff9a00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:12.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff9a5212640 1 -- 172.21.15.172:0/2657729268 shutdown_connections 2024-04-25T08:45:12.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.869+0000 7ff9a5212640 1 -- 172.21.15.172:0/2657729268 wait complete. 2024-04-25T08:45:12.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.870+0000 7ff9a5212640 1 Processor -- start 2024-04-25T08:45:12.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff9a5212640 1 -- start start 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff9a5212640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a00b9330 0x7ff9a01f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff9a5212640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 0x7ff9a015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff9a5212640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a0161710 0x7ff9a00aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff9a5212640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00b5e50 con 0x7ff9a015dc20 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff9a5212640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0162500 con 0x7ff9a00b9330 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff9a5212640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00b5fd0 con 0x7ff9a0161710 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff997fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 0x7ff9a015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff997fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 0x7ff9a015a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45046/0 (socket says 172.21.15.172:45046) 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff997fff640 1 -- 172.21.15.172:0/592351802 learned_addr learned my addr 172.21.15.172:0/592351802 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.871+0000 7ff99ed9d640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a00b9330 0x7ff9a01f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff99f59e640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a0161710 0x7ff9a00aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff997fff640 1 -- 172.21.15.172:0/592351802 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a0161710 msgr2=0x7ff9a00aad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff997fff640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a0161710 0x7ff9a00aad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff997fff640 1 -- 172.21.15.172:0/592351802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a00b9330 msgr2=0x7ff9a01f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff997fff640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a00b9330 0x7ff9a01f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff997fff640 1 -- 172.21.15.172:0/592351802 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a01f7360 con 0x7ff9a015dc20 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff99ed9d640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a00b9330 0x7ff9a01f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff997fff640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 0x7ff9a015a460 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff98800d5f0 tx=0x7ff98800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff9977fe640 1 -- 172.21.15.172:0/592351802 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880125f0 con 0x7ff9a015dc20 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff9977fe640 1 -- 172.21.15.172:0/592351802 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff988019070 con 0x7ff9a015dc20 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff9a5212640 1 -- 172.21.15.172:0/592351802 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a01f7640 con 0x7ff9a015dc20 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff9977fe640 1 -- 172.21.15.172:0/592351802 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880129d0 con 0x7ff9a015dc20 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.872+0000 7ff9a5212640 1 -- 172.21.15.172:0/592351802 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a01f7c00 con 0x7ff9a015dc20 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.873+0000 7ff9a5212640 1 -- 172.21.15.172:0/592351802 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0073a00 con 0x7ff9a015dc20 2024-04-25T08:45:12.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.873+0000 7ff9977fe640 1 -- 172.21.15.172:0/592351802 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff988012b70 con 0x7ff9a015dc20 2024-04-25T08:45:12.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.874+0000 7ff9977fe640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98006b4d0 0x7ff98006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:12.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.874+0000 7ff99ed9d640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98006b4d0 0x7ff98006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:12.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.874+0000 7ff9977fe640 1 -- 172.21.15.172:0/592351802 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff98808a480 con 0x7ff9a015dc20 2024-04-25T08:45:12.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.874+0000 7ff99ed9d640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98006b4d0 0x7ff98006d990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff990034000 tx=0x7ff99002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:12.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:12.878+0000 7ff9977fe640 1 -- 172.21.15.172:0/592351802 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff988059470 con 0x7ff9a015dc20 2024-04-25T08:45:13.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.047+0000 7ff9a5212640 1 -- 172.21.15.172:0/592351802 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff9a00d16b0 con 0x7ff9a015dc20 2024-04-25T08:45:13.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.051+0000 7ff9977fe640 1 -- 172.21.15.172:0/592351802 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff988058d70 con 0x7ff9a015dc20 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 -- 172.21.15.172:0/592351802 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98006b4d0 msgr2=0x7ff98006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98006b4d0 0x7ff98006d990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff990034000 tx=0x7ff99002e000 comp rx=0 tx=0).stop 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 -- 172.21.15.172:0/592351802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 msgr2=0x7ff9a015a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 0x7ff9a015a460 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff98800d5f0 tx=0x7ff98800dab0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 -- 172.21.15.172:0/592351802 shutdown_connections 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98006b4d0 0x7ff98006d990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a0161710 0x7ff9a00aad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a015dc20 0x7ff9a015a460 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 --2- 172.21.15.172:0/592351802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a00b9330 0x7ff9a01f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 -- 172.21.15.172:0/592351802 >> 172.21.15.172:0/592351802 conn(0x7ff9a00d0420 msgr2=0x7ff9a00b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:13.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 -- 172.21.15.172:0/592351802 shutdown_connections 2024-04-25T08:45:13.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.053+0000 7ff9a5212640 1 -- 172.21.15.172:0/592351802 wait complete. 2024-04-25T08:45:13.056 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:45:13.056 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:45:13.095 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:45:13.135 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:45:13.135 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:13.135 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:13.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:45:13.151 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:45:13.151 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:13.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:45:13.192 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:13.192 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:13.207 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:45:13.207 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:45:13.207 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:13.249 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:45:13.249 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:45:13.249 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:13.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.355+0000 7fc7071a5640 1 Processor -- start 2024-04-25T08:45:13.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.355+0000 7fc7071a5640 1 -- start start 2024-04-25T08:45:13.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.355+0000 7fc7071a5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc70015dc00 0x7fc7000c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.355+0000 7fc7071a5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc7000ceb20 0x7fc7000d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.355+0000 7fc7071a5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70015dfe0 con 0x7fc7000d1c00 2024-04-25T08:45:13.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.355+0000 7fc7071a5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7000d2060 con 0x7fc7000ceb20 2024-04-25T08:45:13.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.355+0000 7fc7071a5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000d00c0 con 0x7fc70015dc00 2024-04-25T08:45:13.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.356+0000 7fc704f41640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc70015dc00 0x7fc7000c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.356+0000 7fc6fffff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc7000ceb20 0x7fc7000d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.356+0000 7fc705742640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fc7000d1c00 0x7fc7000ccc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:52840/0 (socket says 172.21.15.172:52840) 2024-04-25T08:45:13.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.356+0000 7fc705742640 1 -- 172.21.15.172:0/2837346612 learned_addr learned my addr 172.21.15.172:0/2837346612 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:13.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.356+0000 7fc704f41640 1 -- 172.21.15.172:0/2837346612 >> v2:172.21.15.186:3300/0 conn(0x7fc7000ceb20 msgr2=0x7fc7000d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:13.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.356+0000 7fc704f41640 1 --2- 172.21.15.172:0/2837346612 >> v2:172.21.15.186:3300/0 conn(0x7fc7000ceb20 0x7fc7000d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.356+0000 7fc704f41640 1 -- 172.21.15.172:0/2837346612 >> v1:172.21.15.186:6789/0 conn(0x7fc7000d1c00 legacy=0x7fc7000ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.356+0000 7fc704f41640 1 -- 172.21.15.172:0/2837346612 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000d03a0 con 0x7fc70015dc00 2024-04-25T08:45:13.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.356+0000 7fc6fffff640 1 --2- 172.21.15.172:0/2837346612 >> v2:172.21.15.186:3300/0 conn(0x7fc7000ceb20 0x7fc7000d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:13.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.357+0000 7fc704f41640 1 --2- 172.21.15.172:0/2837346612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc70015dc00 0x7fc7000c6df0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40097a0 tx=0x7fc6f402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8864bf87fb244cc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:13.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.357+0000 7fc6ff7fe640 1 -- 172.21.15.172:0/2837346612 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4037070 con 0x7fc70015dc00 2024-04-25T08:45:13.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.357+0000 7fc6ff7fe640 1 -- 172.21.15.172:0/2837346612 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4032440 con 0x7fc70015dc00 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.357+0000 7fc6ff7fe640 1 -- 172.21.15.172:0/2837346612 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4032810 con 0x7fc70015dc00 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.358+0000 7fc7071a5640 1 -- 172.21.15.172:0/2837346612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc70015dc00 msgr2=0x7fc7000c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.358+0000 7fc7071a5640 1 --2- 172.21.15.172:0/2837346612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc70015dc00 0x7fc7000c6df0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc6f40097a0 tx=0x7fc6f402a180 comp rx=0 tx=0).stop 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.358+0000 7fc7071a5640 1 -- 172.21.15.172:0/2837346612 shutdown_connections 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.358+0000 7fc7071a5640 1 --2- 172.21.15.172:0/2837346612 >> v2:172.21.15.186:3300/0 conn(0x7fc7000ceb20 0x7fc7000d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.358+0000 7fc7071a5640 1 --2- 172.21.15.172:0/2837346612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc70015dc00 0x7fc7000c6df0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.358+0000 7fc7071a5640 1 -- 172.21.15.172:0/2837346612 >> 172.21.15.172:0/2837346612 conn(0x7fc70006f5d0 msgr2=0x7fc70006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.358+0000 7fc7071a5640 1 -- 172.21.15.172:0/2837346612 shutdown_connections 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.358+0000 7fc7071a5640 1 -- 172.21.15.172:0/2837346612 wait complete. 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.359+0000 7fc7071a5640 1 Processor -- start 2024-04-25T08:45:13.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.359+0000 7fc7071a5640 1 -- start start 2024-04-25T08:45:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc7071a5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc7000ceb20 0x7fc700149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc7071a5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7000d1c00 0x7fc7000b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc7071a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc70015dc00 0x7fc7000b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc7071a5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000cc130 con 0x7fc70015dc00 2024-04-25T08:45:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc7071a5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000cc720 con 0x7fc7000d1c00 2024-04-25T08:45:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc7071a5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000cfd90 con 0x7fc7000ceb20 2024-04-25T08:45:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc705742640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc70015dc00 0x7fc7000b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc705742640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc70015dc00 0x7fc7000b6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45048/0 (socket says 172.21.15.172:45048) 2024-04-25T08:45:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc6fffff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7000d1c00 0x7fc7000b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc705742640 1 -- 172.21.15.172:0/871049431 learned_addr learned my addr 172.21.15.172:0/871049431 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc704f41640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc7000ceb20 0x7fc700149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc705742640 1 -- 172.21.15.172:0/871049431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc7000ceb20 msgr2=0x7fc700149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc705742640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc7000ceb20 0x7fc700149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc705742640 1 -- 172.21.15.172:0/871049431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7000d1c00 msgr2=0x7fc7000b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc705742640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7000d1c00 0x7fc7000b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc705742640 1 -- 172.21.15.172:0/871049431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000c8cd0 con 0x7fc70015dc00 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc6fffff640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7000d1c00 0x7fc7000b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc705742640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc70015dc00 0x7fc7000b6bb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800cbf0 tx=0x7fc6f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.360+0000 7fc6fd7fa640 1 -- 172.21.15.172:0/871049431 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8017070 con 0x7fc70015dc00 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.361+0000 7fc6fd7fa640 1 -- 172.21.15.172:0/871049431 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f800ad40 con 0x7fc70015dc00 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.361+0000 7fc7071a5640 1 -- 172.21.15.172:0/871049431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7000c8fb0 con 0x7fc70015dc00 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.361+0000 7fc6fd7fa640 1 -- 172.21.15.172:0/871049431 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8012600 con 0x7fc70015dc00 2024-04-25T08:45:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.361+0000 7fc7071a5640 1 -- 172.21.15.172:0/871049431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7000c9570 con 0x7fc70015dc00 2024-04-25T08:45:13.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.361+0000 7fc7071a5640 1 -- 172.21.15.172:0/871049431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc700073990 con 0x7fc70015dc00 2024-04-25T08:45:13.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.362+0000 7fc6fd7fa640 1 -- 172.21.15.172:0/871049431 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc6f801a070 con 0x7fc70015dc00 2024-04-25T08:45:13.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.362+0000 7fc6fd7fa640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6e406b500 0x7fc6e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.362+0000 7fc6fd7fa640 1 -- 172.21.15.172:0/871049431 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc6f8089d70 con 0x7fc70015dc00 2024-04-25T08:45:13.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.362+0000 7fc704f41640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6e406b500 0x7fc6e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.363+0000 7fc704f41640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6e406b500 0x7fc6e406d9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4034000 tx=0x7fc6f402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:13.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.366+0000 7fc6fd7fa640 1 -- 172.21.15.172:0/871049431 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc70015dfe0 con 0x7fc70015dc00 2024-04-25T08:45:13.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.575+0000 7fc7071a5640 1 -- 172.21.15.172:0/871049431 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7000cbd30 con 0x7fc70015dc00 2024-04-25T08:45:13.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.576+0000 7fc6fd7fa640 1 -- 172.21.15.172:0/871049431 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fc6f8058680 con 0x7fc70015dc00 2024-04-25T08:45:13.568 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:13.568 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4766,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/1959121045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1959121045},{"type":"v1","addr":"172.21.15.186:6834","nonce":1959121045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/898320853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":898320853},{"type":"v1","addr":"172.21.15.186:6835","nonce":898320853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5020,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1482887107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1482887107},{"type":"v1","addr":"172.21.15.172:6836","nonce":1482887107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/340610567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":340610567},{"type":"v1","addr":"172.21.15.172:6837","nonce":340610567}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2024-04-25T08:45:13.568 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 18 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 -- 172.21.15.172:0/871049431 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6e406b500 msgr2=0x7fc6e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6e406b500 0x7fc6e406d9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4034000 tx=0x7fc6f402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 -- 172.21.15.172:0/871049431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc70015dc00 msgr2=0x7fc7000b6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc70015dc00 0x7fc7000b6bb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800cbf0 tx=0x7fc6f800a430 comp rx=0 tx=0).stop 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 -- 172.21.15.172:0/871049431 shutdown_connections 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6e406b500 0x7fc6e406d9c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7000d1c00 0x7fc7000b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc70015dc00 0x7fc7000b6bb0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 --2- 172.21.15.172:0/871049431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc7000ceb20 0x7fc700149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 -- 172.21.15.172:0/871049431 >> 172.21.15.172:0/871049431 conn(0x7fc70006f5d0 msgr2=0x7fc7000b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 -- 172.21.15.172:0/871049431 shutdown_connections 2024-04-25T08:45:13.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.578+0000 7fc7071a5640 1 -- 172.21.15.172:0/871049431 wait complete. 2024-04-25T08:45:13.581 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:45:13.581 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:45:13.581 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:45:13.581 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:45:13.581 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:45:13.581 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:45:13.582 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:45:13.582 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:45:13.582 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:45:13.582 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:45:13.582 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:45:13.582 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:45:13.582 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:45:13.583 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:45:13.583 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:45:13.583 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:45:13.591 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:45:13.591 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:45:13.592 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:45:13.592 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:45:13.594 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:45:13.594 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:45:13.595 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:45:13.595 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:45:13.634 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:45:13.634 DEBUG:teuthology.parallel:result is None 2024-04-25T08:45:13.635 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:45:13.635 DEBUG:teuthology.parallel:result is None 2024-04-25T08:45:13.637 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:45:13.637 DEBUG:teuthology.parallel:result is None 2024-04-25T08:45:13.637 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:45:13.638 DEBUG:teuthology.parallel:result is None 2024-04-25T08:45:13.638 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:45:13.707 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:45:13.708 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:45:13.716 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:45:13.717 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:45:13.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.749+0000 7f9c291c1640 1 Processor -- start 2024-04-25T08:45:13.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.749+0000 7f9c291c1640 1 -- start start 2024-04-25T08:45:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c291c1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c240cc4f0 0x7f9c240cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c291c1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c24072280 con 0x7f9c240cdb20 2024-04-25T08:45:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c291c1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240714c0 con 0x7f9c2415b980 2024-04-25T08:45:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c291c1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c24071270 con 0x7f9c240cc4f0 2024-04-25T08:45:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c22d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c240cc4f0 0x7f9c240cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c1bfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9c240cdb20 0x7f9c2415b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48142/0 (socket says 172.21.15.172:48142) 2024-04-25T08:45:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c1bfff640 1 -- 172.21.15.172:0/2417564835 learned_addr learned my addr 172.21.15.172:0/2417564835 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:13.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c22d9d640 1 -- 172.21.15.172:0/2417564835 >> v1:172.21.15.186:6789/0 conn(0x7f9c2415b980 legacy=0x7f9c240ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:13.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c22d9d640 1 -- 172.21.15.172:0/2417564835 >> v1:172.21.15.172:6789/0 conn(0x7f9c240cdb20 legacy=0x7f9c2415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c22d9d640 1 -- 172.21.15.172:0/2417564835 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240717a0 con 0x7f9c240cc4f0 2024-04-25T08:45:13.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.750+0000 7f9c2259c640 1 -- 172.21.15.172:0/2417564835 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310652529 0 0) 0x7f9c24072280 con 0x7f9c240cdb20 2024-04-25T08:45:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.751+0000 7f9c22d9d640 1 --2- 172.21.15.172:0/2417564835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cc4f0 0x7f9c240cc8d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9c140097a0 tx=0x7f9c1402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437c4d5a9d84f77b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.751+0000 7f9c2259c640 1 -- 172.21.15.172:0/2417564835 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14037070 con 0x7f9c240cc4f0 2024-04-25T08:45:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.751+0000 7f9c2259c640 1 -- 172.21.15.172:0/2417564835 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c14032440 con 0x7f9c240cc4f0 2024-04-25T08:45:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.751+0000 7f9c2259c640 1 -- 172.21.15.172:0/2417564835 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14032810 con 0x7f9c240cc4f0 2024-04-25T08:45:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.751+0000 7f9c291c1640 1 -- 172.21.15.172:0/2417564835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cc4f0 msgr2=0x7f9c240cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.751+0000 7f9c291c1640 1 --2- 172.21.15.172:0/2417564835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cc4f0 0x7f9c240cc8d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9c140097a0 tx=0x7f9c1402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.752+0000 7f9c291c1640 1 -- 172.21.15.172:0/2417564835 shutdown_connections 2024-04-25T08:45:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.752+0000 7f9c291c1640 1 --2- 172.21.15.172:0/2417564835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cc4f0 0x7f9c240cc8d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.752+0000 7f9c291c1640 1 -- 172.21.15.172:0/2417564835 >> 172.21.15.172:0/2417564835 conn(0x7f9c2406abe0 msgr2=0x7f9c2406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:13.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.752+0000 7f9c291c1640 1 -- 172.21.15.172:0/2417564835 shutdown_connections 2024-04-25T08:45:13.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.752+0000 7f9c291c1640 1 -- 172.21.15.172:0/2417564835 wait complete. 2024-04-25T08:45:13.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.753+0000 7f9c291c1640 1 Processor -- start 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.753+0000 7f9c291c1640 1 -- start start 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c291c1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c240cc4f0 0x7f9c24143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c291c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cdb20 0x7f9c24155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c291c1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2415b980 0x7f9c24155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c291c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24071d60 con 0x7f9c240cdb20 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c291c1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2415bd80 con 0x7f9c2415b980 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c291c1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2406e8a0 con 0x7f9c240cc4f0 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c1bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cdb20 0x7f9c24155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c22d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c240cc4f0 0x7f9c24143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c1bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cdb20 0x7f9c24155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45080/0 (socket says 172.21.15.172:45080) 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c1bfff640 1 -- 172.21.15.172:0/1391642443 learned_addr learned my addr 172.21.15.172:0/1391642443 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c2359e640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2415b980 0x7f9c24155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c22d9d640 1 -- 172.21.15.172:0/1391642443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2415b980 msgr2=0x7f9c24155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c22d9d640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2415b980 0x7f9c24155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c22d9d640 1 -- 172.21.15.172:0/1391642443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cdb20 msgr2=0x7f9c24155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c22d9d640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cdb20 0x7f9c24155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c22d9d640 1 -- 172.21.15.172:0/1391642443 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c24157390 con 0x7f9c240cc4f0 2024-04-25T08:45:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c1bfff640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cdb20 0x7f9c24155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.754+0000 7f9c22d9d640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c240cc4f0 0x7f9c24143040 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c14031000 tx=0x7f9c140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.757+0000 7f9c1b7fe640 1 -- 172.21.15.172:0/1391642443 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14041070 con 0x7f9c240cc4f0 2024-04-25T08:45:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.757+0000 7f9c1b7fe640 1 -- 172.21.15.172:0/1391642443 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1403c970 con 0x7f9c240cc4f0 2024-04-25T08:45:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.757+0000 7f9c1b7fe640 1 -- 172.21.15.172:0/1391642443 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14037040 con 0x7f9c240cc4f0 2024-04-25T08:45:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.757+0000 7f9c291c1640 1 -- 172.21.15.172:0/1391642443 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c241586d0 con 0x7f9c240cc4f0 2024-04-25T08:45:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.757+0000 7f9c291c1640 1 -- 172.21.15.172:0/1391642443 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c24157910 con 0x7f9c240cc4f0 2024-04-25T08:45:13.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.758+0000 7f9c291c1640 1 -- 172.21.15.172:0/1391642443 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2406d630 con 0x7f9c240cc4f0 2024-04-25T08:45:13.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.758+0000 7f9c1b7fe640 1 -- 172.21.15.172:0/1391642443 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c14044070 con 0x7f9c240cc4f0 2024-04-25T08:45:13.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.759+0000 7f9c1b7fe640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0406b4d0 0x7f9c0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:13.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.759+0000 7f9c1bfff640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0406b4d0 0x7f9c0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:13.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.759+0000 7f9c1b7fe640 1 -- 172.21.15.172:0/1391642443 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f9c140aab80 con 0x7f9c240cc4f0 2024-04-25T08:45:13.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.760+0000 7f9c1bfff640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0406b4d0 0x7f9c0406d990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c2414a030 tx=0x7f9c0c007e10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:13.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.764+0000 7f9c1b7fe640 1 -- 172.21.15.172:0/1391642443 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c2406d630 con 0x7f9c240cc4f0 2024-04-25T08:45:13.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:13.947+0000 7f9c291c1640 1 -- 172.21.15.172:0/1391642443 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9c24073a00 con 0x7f9c240cc4f0 2024-04-25T08:45:14.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.780+0000 7f9c1b7fe640 1 -- 172.21.15.172:0/1391642443 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9c14079640 con 0x7f9c240cc4f0 2024-04-25T08:45:14.772 INFO:teuthology.orchestra.run.smithi172.stderr: removed all blocklist entries 2024-04-25T08:45:14.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 -- 172.21.15.172:0/1391642443 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0406b4d0 msgr2=0x7f9c0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:14.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0406b4d0 0x7f9c0406d990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c2414a030 tx=0x7f9c0c007e10 comp rx=0 tx=0).stop 2024-04-25T08:45:14.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 -- 172.21.15.172:0/1391642443 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c240cc4f0 msgr2=0x7f9c24143040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:14.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c240cc4f0 0x7f9c24143040 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c14031000 tx=0x7f9c140046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:14.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 -- 172.21.15.172:0/1391642443 shutdown_connections 2024-04-25T08:45:14.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c0406b4d0 0x7f9c0406d990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:14.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2415b980 0x7f9c24155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:14.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c240cdb20 0x7f9c24155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:14.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 --2- 172.21.15.172:0/1391642443 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c240cc4f0 0x7f9c24143040 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:14.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 -- 172.21.15.172:0/1391642443 >> 172.21.15.172:0/1391642443 conn(0x7f9c2406abe0 msgr2=0x7f9c2406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:14.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 -- 172.21.15.172:0/1391642443 shutdown_connections 2024-04-25T08:45:14.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.783+0000 7f9c291c1640 1 -- 172.21.15.172:0/1391642443 wait complete. 2024-04-25T08:45:14.788 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:45:14.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.899+0000 7f6438c4d640 1 Processor -- start 2024-04-25T08:45:14.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.899+0000 7f6438c4d640 1 -- start start 2024-04-25T08:45:14.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.900+0000 7f6438c4d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f643415dbe0 0x7f64340d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:14.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.900+0000 7f6438c4d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64340b6220 con 0x7f64340b92a0 2024-04-25T08:45:14.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.900+0000 7f6438c4d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64340b97a0 con 0x7f64340b2cb0 2024-04-25T08:45:14.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.900+0000 7f6438c4d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643415dfc0 con 0x7f643415dbe0 2024-04-25T08:45:14.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.901+0000 7f643259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f643415dbe0 0x7f64340d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:14.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.901+0000 7f6432d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f64340b92a0 0x7f64340b5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48148/0 (socket says 172.21.15.172:48148) 2024-04-25T08:45:14.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.901+0000 7f6432d9d640 1 -- 172.21.15.172:0/81959549 learned_addr learned my addr 172.21.15.172:0/81959549 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:14.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.901+0000 7f643259c640 1 -- 172.21.15.172:0/81959549 >> v1:172.21.15.186:6789/0 conn(0x7f64340b2cb0 legacy=0x7f64340b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:14.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.901+0000 7f643259c640 1 -- 172.21.15.172:0/81959549 >> v1:172.21.15.172:6789/0 conn(0x7f64340b92a0 legacy=0x7f64340b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:14.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.901+0000 7f643259c640 1 -- 172.21.15.172:0/81959549 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340d1c50 con 0x7f643415dbe0 2024-04-25T08:45:14.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.901+0000 7f643159a640 1 -- 172.21.15.172:0/81959549 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579437471 0 0) 0x7f64340b6220 con 0x7f64340b92a0 2024-04-25T08:45:14.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f643259c640 1 --2- 172.21.15.172:0/81959549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f643415dbe0 0x7f64340d0910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f64280097a0 tx=0x7f642802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3432b9790bcdb8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:14.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f643159a640 1 -- 172.21.15.172:0/81959549 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428037070 con 0x7f643415dbe0 2024-04-25T08:45:14.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f643159a640 1 -- 172.21.15.172:0/81959549 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6428032440 con 0x7f643415dbe0 2024-04-25T08:45:14.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f643159a640 1 -- 172.21.15.172:0/81959549 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428032810 con 0x7f643415dbe0 2024-04-25T08:45:14.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f6438c4d640 1 -- 172.21.15.172:0/81959549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f643415dbe0 msgr2=0x7f64340d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:14.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f6438c4d640 1 --2- 172.21.15.172:0/81959549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f643415dbe0 0x7f64340d0910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f64280097a0 tx=0x7f642802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:14.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f6438c4d640 1 -- 172.21.15.172:0/81959549 shutdown_connections 2024-04-25T08:45:14.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f6438c4d640 1 --2- 172.21.15.172:0/81959549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f643415dbe0 0x7f64340d0910 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:14.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f6438c4d640 1 -- 172.21.15.172:0/81959549 >> 172.21.15.172:0/81959549 conn(0x7f6434061a20 msgr2=0x7f6434061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:14.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f6438c4d640 1 -- 172.21.15.172:0/81959549 shutdown_connections 2024-04-25T08:45:14.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.902+0000 7f6438c4d640 1 -- 172.21.15.172:0/81959549 wait complete. 2024-04-25T08:45:14.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.904+0000 7f6438c4d640 1 Processor -- start 2024-04-25T08:45:14.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.904+0000 7f6438c4d640 1 -- start start 2024-04-25T08:45:14.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.904+0000 7f6438c4d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64340b2cb0 0x7f64341f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:14.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.904+0000 7f6438c4d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64340b92a0 0x7f64340c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:14.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.904+0000 7f6438c4d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f643415dbe0 0x7f64341519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.904+0000 7f6438c4d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340d2210 con 0x7f64340b92a0 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.904+0000 7f6438c4d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340d1a00 con 0x7f643415dbe0 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.904+0000 7f6438c4d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64340b6ab0 con 0x7f64340b2cb0 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6431d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64340b92a0 0x7f64340c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6431d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64340b92a0 0x7f64340c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45102/0 (socket says 172.21.15.172:45102) 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6431d9b640 1 -- 172.21.15.172:0/1874863596 learned_addr learned my addr 172.21.15.172:0/1874863596 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6432d9d640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f643415dbe0 0x7f64341519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f643259c640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64340b2cb0 0x7f64341f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6431d9b640 1 -- 172.21.15.172:0/1874863596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64340b2cb0 msgr2=0x7f64341f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6431d9b640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64340b2cb0 0x7f64341f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6431d9b640 1 -- 172.21.15.172:0/1874863596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f643415dbe0 msgr2=0x7f64341519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6431d9b640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f643415dbe0 0x7f64341519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6431d9b640 1 -- 172.21.15.172:0/1874863596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643415feb0 con 0x7f64340b92a0 2024-04-25T08:45:14.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6431d9b640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64340b92a0 0x7f64340c9c80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f642400c400 tx=0x7f642400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:14.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6422ffd640 1 -- 172.21.15.172:0/1874863596 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424017070 con 0x7f64340b92a0 2024-04-25T08:45:14.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6422ffd640 1 -- 172.21.15.172:0/1874863596 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64240052d0 con 0x7f64340b92a0 2024-04-25T08:45:14.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6422ffd640 1 -- 172.21.15.172:0/1874863596 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424003830 con 0x7f64340b92a0 2024-04-25T08:45:14.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6438c4d640 1 -- 172.21.15.172:0/1874863596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6434160190 con 0x7f64340b92a0 2024-04-25T08:45:14.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.905+0000 7f6438c4d640 1 -- 172.21.15.172:0/1874863596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64340caca0 con 0x7f64340b92a0 2024-04-25T08:45:14.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.906+0000 7f6438c4d640 1 -- 172.21.15.172:0/1874863596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64340caea0 con 0x7f64340b92a0 2024-04-25T08:45:14.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.907+0000 7f6422ffd640 1 -- 172.21.15.172:0/1874863596 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f642401a070 con 0x7f64340b92a0 2024-04-25T08:45:14.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.907+0000 7f6422ffd640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f641406b4d0 0x7f641406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:14.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.907+0000 7f643259c640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f641406b4d0 0x7f641406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:14.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.907+0000 7f6422ffd640 1 -- 172.21.15.172:0/1874863596 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f64240892d0 con 0x7f64340b92a0 2024-04-25T08:45:14.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.908+0000 7f643259c640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f641406b4d0 0x7f641406d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6428034000 tx=0x7f642802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:14.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:14.912+0000 7f6422ffd640 1 -- 172.21.15.172:0/1874863596 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64340caea0 con 0x7f64340b92a0 2024-04-25T08:45:15.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.146+0000 7f6438c4d640 1 -- 172.21.15.172:0/1874863596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f64340caab0 con 0x7f64340b92a0 2024-04-25T08:45:15.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.147+0000 7f6422ffd640 1 -- 172.21.15.172:0/1874863596 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6424057d50 con 0x7f64340b92a0 2024-04-25T08:45:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:15.139 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "auth_dump": [ 2024-04-25T08:45:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.a", 2024-04-25T08:45:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q==", 2024-04-25T08:45:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:45:15.139 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.b", 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg==", 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:45:15.140 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.c", 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA==", 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.141 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.d", 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg==", 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.0", 2024-04-25T08:45:15.142 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ==", 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.1", 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g==", 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:45:15.143 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.2", 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g==", 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.144 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.3", 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg==", 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.4", 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw==", 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:45:15.145 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.5", 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow==", 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.6", 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg==", 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.7", 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q==", 2024-04-25T08:45:15.147 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.0", 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q==", 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow r", 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:45:15.148 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.1", 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g==", 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.149 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.2", 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw==", 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.3", 2024-04-25T08:45:15.150 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w==", 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.admin", 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmFmQsIBAAkuAmqIptAT1ivH6T7/1T8A==", 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:45:15.151 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.x", 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw==", 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.y", 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg==", 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-25T08:45:15.153 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:15.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 -- 172.21.15.172:0/1874863596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f641406b4d0 msgr2=0x7f641406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f641406b4d0 0x7f641406d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6428034000 tx=0x7f642802e000 comp rx=0 tx=0).stop 2024-04-25T08:45:15.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 -- 172.21.15.172:0/1874863596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64340b92a0 msgr2=0x7f64340c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64340b92a0 0x7f64340c9c80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f642400c400 tx=0x7f642400c8c0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 -- 172.21.15.172:0/1874863596 shutdown_connections 2024-04-25T08:45:15.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f641406b4d0 0x7f641406d990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f643415dbe0 0x7f64341519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64340b92a0 0x7f64340c9c80 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 --2- 172.21.15.172:0/1874863596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64340b2cb0 0x7f64341f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 -- 172.21.15.172:0/1874863596 >> 172.21.15.172:0/1874863596 conn(0x7f6434061a20 msgr2=0x7f643415b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:15.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 -- 172.21.15.172:0/1874863596 shutdown_connections 2024-04-25T08:45:15.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.149+0000 7f6438c4d640 1 -- 172.21.15.172:0/1874863596 wait complete. 2024-04-25T08:45:15.156 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:15.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.262+0000 7f2a81734640 1 Processor -- start 2024-04-25T08:45:15.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.262+0000 7f2a81734640 1 -- start start 2024-04-25T08:45:15.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a81734640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a7c15dbe0 0x7f2a7c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a81734640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a7c0b2cb0 0x7f2a7c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a81734640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2a7c0b92a0 0x7f2a7c0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a81734640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c15dfc0 con 0x7f2a7c0b2cb0 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a81734640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c0d1a00 con 0x7f2a7c0b92a0 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a81734640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0b97a0 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a727fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a7c0b2cb0 0x7f2a7c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a727fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a7c0b2cb0 0x7f2a7c0d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45118/0 (socket says 172.21.15.172:45118) 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a727fc640 1 -- 172.21.15.172:0/3107449229 learned_addr learned my addr 172.21.15.172:0/3107449229 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a7b7fe640 1 --2- 172.21.15.172:0/3107449229 >> v2:172.21.15.186:3300/0 conn(0x7f2a7c0b92a0 0x7f2a7c0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a7affd640 1 --2- 172.21.15.172:0/3107449229 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a7c15dbe0 0x7f2a7c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a727fc640 1 -- 172.21.15.172:0/3107449229 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a7c15dbe0 msgr2=0x7f2a7c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a727fc640 1 --2- 172.21.15.172:0/3107449229 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a7c15dbe0 0x7f2a7c0d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a727fc640 1 -- 172.21.15.172:0/3107449229 >> v2:172.21.15.186:3300/0 conn(0x7f2a7c0b92a0 msgr2=0x7f2a7c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a727fc640 1 --2- 172.21.15.172:0/3107449229 >> v2:172.21.15.186:3300/0 conn(0x7f2a7c0b92a0 0x7f2a7c0b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a727fc640 1 -- 172.21.15.172:0/3107449229 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c0d1c50 con 0x7f2a7c0b2cb0 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.263+0000 7f2a7b7fe640 1 --2- 172.21.15.172:0/3107449229 >> v2:172.21.15.186:3300/0 conn(0x7f2a7c0b92a0 0x7f2a7c0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.264+0000 7f2a727fc640 1 --2- 172.21.15.172:0/3107449229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c0b2cb0 0x7f2a7c0d0e50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c06c640 tx=0x7f2a6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849572364ca6f926 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.264+0000 7f2a7a7fc640 1 -- 172.21.15.172:0/3107449229 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64037070 con 0x7f2a7c0b2cb0 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.264+0000 7f2a7a7fc640 1 -- 172.21.15.172:0/3107449229 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a64032440 con 0x7f2a7c0b2cb0 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.264+0000 7f2a7a7fc640 1 -- 172.21.15.172:0/3107449229 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64032810 con 0x7f2a7c0b2cb0 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.265+0000 7f2a81734640 1 -- 172.21.15.172:0/3107449229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c0b2cb0 msgr2=0x7f2a7c0d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.265+0000 7f2a81734640 1 --2- 172.21.15.172:0/3107449229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c0b2cb0 0x7f2a7c0d0e50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c06c640 tx=0x7f2a6402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.265+0000 7f2a81734640 1 -- 172.21.15.172:0/3107449229 shutdown_connections 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.265+0000 7f2a81734640 1 --2- 172.21.15.172:0/3107449229 >> v2:172.21.15.186:3300/0 conn(0x7f2a7c0b92a0 0x7f2a7c0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.265+0000 7f2a81734640 1 --2- 172.21.15.172:0/3107449229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c0b2cb0 0x7f2a7c0d0e50 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.265+0000 7f2a81734640 1 --2- 172.21.15.172:0/3107449229 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a7c15dbe0 0x7f2a7c0d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.265+0000 7f2a81734640 1 -- 172.21.15.172:0/3107449229 >> 172.21.15.172:0/3107449229 conn(0x7f2a7c061a20 msgr2=0x7f2a7c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.265+0000 7f2a81734640 1 -- 172.21.15.172:0/3107449229 shutdown_connections 2024-04-25T08:45:15.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.265+0000 7f2a81734640 1 -- 172.21.15.172:0/3107449229 wait complete. 2024-04-25T08:45:15.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.266+0000 7f2a81734640 1 Processor -- start 2024-04-25T08:45:15.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.266+0000 7f2a81734640 1 -- start start 2024-04-25T08:45:15.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a81734640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a7c0b2cb0 0x7f2a7c151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a81734640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a7c0b92a0 0x7f2a7c1f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a81734640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c15dbe0 0x7f2a7c1f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a81734640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0b6ab0 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a81734640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0d2210 con 0x7f2a7c0b92a0 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a81734640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c0b6c30 con 0x7f2a7c0b2cb0 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a7b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c15dbe0 0x7f2a7c1f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a7b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c15dbe0 0x7f2a7c1f7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45130/0 (socket says 172.21.15.172:45130) 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a7b7fe640 1 -- 172.21.15.172:0/1752322449 learned_addr learned my addr 172.21.15.172:0/1752322449 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a7affd640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a7c0b2cb0 0x7f2a7c151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a7b7fe640 1 -- 172.21.15.172:0/1752322449 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a7c0b2cb0 msgr2=0x7f2a7c151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a7b7fe640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a7c0b2cb0 0x7f2a7c151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a7b7fe640 1 -- 172.21.15.172:0/1752322449 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a7c0b92a0 msgr2=0x7f2a7c1f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a727fc640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a7c0b92a0 0x7f2a7c1f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a7b7fe640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a7c0b92a0 0x7f2a7c1f6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a7b7fe640 1 -- 172.21.15.172:0/1752322449 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c151a50 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.267+0000 7f2a7b7fe640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c15dbe0 0x7f2a7c1f7370 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2a74007e70 tx=0x7f2a7400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:15.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.268+0000 7f2a73fff640 1 -- 172.21.15.172:0/1752322449 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7401a070 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.268+0000 7f2a73fff640 1 -- 172.21.15.172:0/1752322449 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a74015600 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.268+0000 7f2a81734640 1 -- 172.21.15.172:0/1752322449 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c1f7c90 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.268+0000 7f2a73fff640 1 -- 172.21.15.172:0/1752322449 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740159f0 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.268+0000 7f2a81734640 1 -- 172.21.15.172:0/1752322449 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c0b4070 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.269+0000 7f2a81734640 1 -- 172.21.15.172:0/1752322449 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c073990 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.269+0000 7f2a73fff640 1 -- 172.21.15.172:0/1752322449 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a7401d070 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.269+0000 7f2a73fff640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a5c06b4d0 0x7f2a5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.270+0000 7f2a73fff640 1 -- 172.21.15.172:0/1752322449 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f2a7408a280 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.270+0000 7f2a7affd640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a5c06b4d0 0x7f2a5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.270+0000 7f2a7affd640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a5c06b4d0 0x7f2a5c06d990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c006fd0 tx=0x7f2a6c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:15.265 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.274+0000 7f2a73fff640 1 -- 172.21.15.172:0/1752322449 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2a74010070 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.445+0000 7f2a81734640 1 -- 172.21.15.172:0/1752322449 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a7c15aea0 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.446+0000 7f2a73fff640 1 -- 172.21.15.172:0/1752322449 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13224 (secure 0 0 0) 0x7f2a74059350 con 0x7f2a7c15dbe0 2024-04-25T08:45:15.438 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:15.438 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":50,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:45:14.772352+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 -- 172.21.15.172:0/1752322449 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a5c06b4d0 msgr2=0x7f2a5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a5c06b4d0 0x7f2a5c06d990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c006fd0 tx=0x7f2a6c008040 comp rx=0 tx=0).stop 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 -- 172.21.15.172:0/1752322449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c15dbe0 msgr2=0x7f2a7c1f7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c15dbe0 0x7f2a7c1f7370 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2a74007e70 tx=0x7f2a7400d4a0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 -- 172.21.15.172:0/1752322449 shutdown_connections 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a5c06b4d0 0x7f2a5c06d990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a7c0b92a0 0x7f2a7c1f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a7c15dbe0 0x7f2a7c1f7370 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 --2- 172.21.15.172:0/1752322449 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a7c0b2cb0 0x7f2a7c151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 -- 172.21.15.172:0/1752322449 >> 172.21.15.172:0/1752322449 conn(0x7f2a7c061a20 msgr2=0x7f2a7c0b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 -- 172.21.15.172:0/1752322449 shutdown_connections 2024-04-25T08:45:15.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.448+0000 7f2a81734640 1 -- 172.21.15.172:0/1752322449 wait complete. 2024-04-25T08:45:15.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:45:15.451 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:45:15.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.560+0000 7f7fc10bd640 1 Processor -- start 2024-04-25T08:45:15.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.560+0000 7f7fc10bd640 1 -- start start 2024-04-25T08:45:15.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.560+0000 7f7fc10bd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7fbc15b7d0 0x7f7fbc0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.560+0000 7f7fc10bd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7fbc0b5620 0x7f7fbc0b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.560+0000 7f7fc10bd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc06cf50 con 0x7f7fbc06c2d0 2024-04-25T08:45:15.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.560+0000 7f7fc10bd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fbc0ce530 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.560+0000 7f7fc10bd640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fbc0ce810 con 0x7f7fbc0b5620 2024-04-25T08:45:15.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.560+0000 7f7fbad9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7fbc15b7d0 0x7f7fbc0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.560+0000 7f7fbb59e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7fbc06c2d0 0x7f7fbc06c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48158/0 (socket says 172.21.15.172:48158) 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.560+0000 7f7fbb59e640 1 -- 172.21.15.172:0/3745415153 learned_addr learned my addr 172.21.15.172:0/3745415153 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.561+0000 7f7fba59c640 1 --2- 172.21.15.172:0/3745415153 >> v2:172.21.15.186:3300/0 conn(0x7f7fbc0b5620 0x7f7fbc0b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.561+0000 7f7fbad9d640 1 -- 172.21.15.172:0/3745415153 >> v2:172.21.15.186:3300/0 conn(0x7f7fbc0b5620 msgr2=0x7f7fbc0b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.561+0000 7f7fbad9d640 1 --2- 172.21.15.172:0/3745415153 >> v2:172.21.15.186:3300/0 conn(0x7f7fbc0b5620 0x7f7fbc0b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.561+0000 7f7fbad9d640 1 -- 172.21.15.172:0/3745415153 >> v1:172.21.15.172:6789/0 conn(0x7f7fbc06c2d0 legacy=0x7f7fbc06c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.561+0000 7f7fbad9d640 1 -- 172.21.15.172:0/3745415153 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0ceaf0 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.561+0000 7f7fb9d9b640 1 -- 172.21.15.172:0/3745415153 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583432091 0 0) 0x7f7fbc06cf50 con 0x7f7fbc06c2d0 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.561+0000 7f7fbad9d640 1 --2- 172.21.15.172:0/3745415153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 0x7f7fbc0cf010 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0ce180 tx=0x7f7fb402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f38501ab7460f04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fb9d9b640 1 -- 172.21.15.172:0/3745415153 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4037070 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fb9d9b640 1 -- 172.21.15.172:0/3745415153 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4032440 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fb9d9b640 1 -- 172.21.15.172:0/3745415153 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4032810 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fc10bd640 1 -- 172.21.15.172:0/3745415153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 msgr2=0x7f7fbc0cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fc10bd640 1 --2- 172.21.15.172:0/3745415153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 0x7f7fbc0cf010 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0ce180 tx=0x7f7fb402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fc10bd640 1 -- 172.21.15.172:0/3745415153 shutdown_connections 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fc10bd640 1 --2- 172.21.15.172:0/3745415153 >> v2:172.21.15.186:3300/0 conn(0x7f7fbc0b5620 0x7f7fbc0b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fc10bd640 1 --2- 172.21.15.172:0/3745415153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 0x7f7fbc0cf010 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fc10bd640 1 -- 172.21.15.172:0/3745415153 >> 172.21.15.172:0/3745415153 conn(0x7f7fbc0d0800 msgr2=0x7f7fbc0d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fc10bd640 1 -- 172.21.15.172:0/3745415153 shutdown_connections 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.562+0000 7f7fc10bd640 1 -- 172.21.15.172:0/3745415153 wait complete. 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fc10bd640 1 Processor -- start 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fc10bd640 1 -- start start 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fc10bd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fbc06c2d0 0x7f7fbc159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fc10bd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fbc0b5620 0x7f7fbc0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fc10bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 0x7f7fbc0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fc10bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0cf6d0 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fc10bd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0cf550 con 0x7f7fbc06c2d0 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fc10bd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc15bbb0 con 0x7f7fbc0b5620 2024-04-25T08:45:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fbb59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 0x7f7fbc0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fbb59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 0x7f7fbc0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45152/0 (socket says 172.21.15.172:45152) 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fbb59e640 1 -- 172.21.15.172:0/4086860548 learned_addr learned my addr 172.21.15.172:0/4086860548 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fbad9d640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fbc06c2d0 0x7f7fbc159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.564+0000 7f7fba59c640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fbc0b5620 0x7f7fbc0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fbb59e640 1 -- 172.21.15.172:0/4086860548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fbc0b5620 msgr2=0x7f7fbc0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fbb59e640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fbc0b5620 0x7f7fbc0c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fbb59e640 1 -- 172.21.15.172:0/4086860548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fbc06c2d0 msgr2=0x7f7fbc159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fbb59e640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fbc06c2d0 0x7f7fbc159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fbb59e640 1 -- 172.21.15.172:0/4086860548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc159860 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fbb59e640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 0x7f7fbc0c7cf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00c3f0 tx=0x7f7fac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fa37fe640 1 -- 172.21.15.172:0/4086860548 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac0074e0 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fa37fe640 1 -- 172.21.15.172:0/4086860548 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac0047e0 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fa37fe640 1 -- 172.21.15.172:0/4086860548 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac004bd0 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fc10bd640 1 -- 172.21.15.172:0/4086860548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc0ccc60 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.565+0000 7f7fc10bd640 1 -- 172.21.15.172:0/4086860548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc0cd220 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.566+0000 7f7fc10bd640 1 -- 172.21.15.172:0/4086860548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fbc073a00 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.566+0000 7f7fa37fe640 1 -- 172.21.15.172:0/4086860548 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7fac011070 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.567+0000 7f7fa37fe640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa806b4d0 0x7f7fa806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.567+0000 7f7fa37fe640 1 -- 172.21.15.172:0/4086860548 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7fac089990 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.567+0000 7f7fbad9d640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa806b4d0 0x7f7fa806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.567+0000 7f7fbad9d640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa806b4d0 0x7f7fa806d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4034000 tx=0x7f7fb402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:15.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.571+0000 7f7fa37fe640 1 -- 172.21.15.172:0/4086860548 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7fac058410 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.740+0000 7f7fc10bd640 1 -- 172.21.15.172:0/4086860548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fbc1e85e0 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.741+0000 7f7fa37fe640 1 -- 172.21.15.172:0/4086860548 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fac05c4b0 con 0x7f7fbc15b7d0 2024-04-25T08:45:15.733 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:45:15.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 -- 172.21.15.172:0/4086860548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa806b4d0 msgr2=0x7f7fa806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa806b4d0 0x7f7fa806d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4034000 tx=0x7f7fb402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 -- 172.21.15.172:0/4086860548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 msgr2=0x7f7fbc0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 0x7f7fbc0c7cf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00c3f0 tx=0x7f7fac00c8b0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 -- 172.21.15.172:0/4086860548 shutdown_connections 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa806b4d0 0x7f7fa806d990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fbc15b7d0 0x7f7fbc0c7cf0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fbc0b5620 0x7f7fbc0c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 --2- 172.21.15.172:0/4086860548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fbc06c2d0 0x7f7fbc159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 -- 172.21.15.172:0/4086860548 >> 172.21.15.172:0/4086860548 conn(0x7f7fbc0d0800 msgr2=0x7f7fbc160df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 -- 172.21.15.172:0/4086860548 shutdown_connections 2024-04-25T08:45:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.743+0000 7f7fc10bd640 1 -- 172.21.15.172:0/4086860548 wait complete. 2024-04-25T08:45:15.746 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:45:15.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.851+0000 7f5dc8fe7640 1 Processor -- start 2024-04-25T08:45:15.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.852+0000 7f5dc8fe7640 1 -- start start 2024-04-25T08:45:15.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.852+0000 7f5dc8fe7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5dc415dbe0 0x7f5dc40d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.852+0000 7f5dc8fe7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc40b6220 con 0x7f5dc40b2cb0 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.852+0000 7f5dc8fe7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc40b97a0 con 0x7f5dc40b92a0 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.852+0000 7f5dc8fe7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc415dfc0 con 0x7f5dc415dbe0 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.852+0000 7f5dbbfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5dc40b2cb0 0x7f5dc40b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48160/0 (socket says 172.21.15.172:48160) 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.852+0000 7f5dbbfff640 1 -- 172.21.15.172:0/2891888594 learned_addr learned my addr 172.21.15.172:0/2891888594 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc259c640 1 --2- 172.21.15.172:0/2891888594 >> v2:172.21.15.186:3300/0 conn(0x7f5dc415dbe0 0x7f5dc40d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146781193 0 0) 0x7f5dc40b6220 con 0x7f5dc40b2cb0 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5db0003520 con 0x7f5dc40b2cb0 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127353513 0 0) 0x7f5db0003520 con 0x7f5dc40b2cb0 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 >> v2:172.21.15.186:3300/0 conn(0x7f5dc415dbe0 msgr2=0x7f5dc40d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 --2- 172.21.15.172:0/2891888594 >> v2:172.21.15.186:3300/0 conn(0x7f5dc415dbe0 0x7f5dc40d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 >> v1:172.21.15.186:6789/0 conn(0x7f5dc40b92a0 legacy=0x7f5dc40b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40d1c50 con 0x7f5dc40b2cb0 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f5dac001670 con 0x7f5dc40b2cb0 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 >> v1:172.21.15.172:6789/0 conn(0x7f5dc40b2cb0 legacy=0x7f5dc40b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db00039b0 0x7f5db0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5db0004800 0x7f5db0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5db00051c0 0x7f5db000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db000c130 con 0x7f5db00039b0 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db000c2e0 con 0x7f5db0004800 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db000c4e0 con 0x7f5db00051c0 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc259c640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db00039b0 0x7f5db0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dbbfff640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5db0004800 0x7f5db0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc2d9d640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5db00051c0 0x7f5db000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc259c640 1 -- 172.21.15.172:0/2891888594 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5db00051c0 msgr2=0x7f5db000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc259c640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5db00051c0 0x7f5db000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc259c640 1 -- 172.21.15.172:0/2891888594 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5db0004800 msgr2=0x7f5db0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc259c640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5db0004800 0x7f5db0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc259c640 1 -- 172.21.15.172:0/2891888594 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db0003520 con 0x7f5db00039b0 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.853+0000 7f5dc2d9d640 1 -- 172.21.15.172:0/2891888594 reap_dead start 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.854+0000 7f5dc259c640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db00039b0 0x7f5db0003dd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009ac0 tx=0x7f5db0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded0b0d532d6a57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.854+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4036070 con 0x7f5db00039b0 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.854+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db4031400 con 0x7f5db00039b0 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.854+0000 7f5dc1d9b640 1 -- 172.21.15.172:0/2891888594 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4009690 con 0x7f5db00039b0 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.855+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2891888594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db00039b0 msgr2=0x7f5db0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.855+0000 7f5dc8fe7640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db00039b0 0x7f5db0003dd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009ac0 tx=0x7f5db0005830 comp rx=0 tx=0).stop 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.855+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2891888594 shutdown_connections 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.855+0000 7f5dc8fe7640 1 --2- 172.21.15.172:0/2891888594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db00039b0 0x7f5db0003dd0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.855+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2891888594 >> 172.21.15.172:0/2891888594 conn(0x7f5dc4061a20 msgr2=0x7f5dc4061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.855+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2891888594 shutdown_connections 2024-04-25T08:45:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.855+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2891888594 wait complete. 2024-04-25T08:45:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.856+0000 7f5dc8fe7640 1 Processor -- start 2024-04-25T08:45:15.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.856+0000 7f5dc8fe7640 1 -- start start 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc8fe7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5db00039b0 0x7f5dc40cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc8fe7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc4153c10 0x7f5dc41534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc8fe7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc415c710 0x7f5dc415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc8fe7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40d2210 con 0x7f5dc415c710 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc8fe7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40d1a00 con 0x7f5dc4153c10 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc8fe7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b6ab0 con 0x7f5db00039b0 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc415c710 0x7f5dc415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc415c710 0x7f5dc415cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45158/0 (socket says 172.21.15.172:45158) 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc2d9d640 1 -- 172.21.15.172:0/2395198656 learned_addr learned my addr 172.21.15.172:0/2395198656 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dbbfff640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc4153c10 0x7f5dc41534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc2d9d640 1 -- 172.21.15.172:0/2395198656 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5db00039b0 msgr2=0x7f5dc40cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc2d9d640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5db00039b0 0x7f5dc40cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc2d9d640 1 -- 172.21.15.172:0/2395198656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc4153c10 msgr2=0x7f5dc41534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc2d9d640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc4153c10 0x7f5dc41534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc2d9d640 1 -- 172.21.15.172:0/2395198656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40cdcf0 con 0x7f5dc415c710 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dbbfff640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc4153c10 0x7f5dc41534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dc2d9d640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc415c710 0x7f5dc415cb90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40cfb60 tx=0x7f5dbc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.857+0000 7f5dbaffd640 1 -- 172.21.15.172:0/2395198656 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc003970 con 0x7f5dc415c710 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.858+0000 7f5dbaffd640 1 -- 172.21.15.172:0/2395198656 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc018070 con 0x7f5dc415c710 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.858+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2395198656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc415dfc0 con 0x7f5dc415c710 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.858+0000 7f5dbaffd640 1 -- 172.21.15.172:0/2395198656 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc003d70 con 0x7f5dc415c710 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.858+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2395198656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc415e580 con 0x7f5dc415c710 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.859+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2395198656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc4073990 con 0x7f5dc415c710 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.859+0000 7f5dbaffd640 1 -- 172.21.15.172:0/2395198656 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5dbc0050d0 con 0x7f5dc415c710 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.859+0000 7f5dbaffd640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5da406b4d0 0x7f5da406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.859+0000 7f5dbaffd640 1 -- 172.21.15.172:0/2395198656 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f5dbc089bb0 con 0x7f5dc415c710 2024-04-25T08:45:15.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.859+0000 7f5dc259c640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5da406b4d0 0x7f5da406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:15.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.860+0000 7f5dc259c640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5da406b4d0 0x7f5da406d990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5db4033000 tx=0x7f5db402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:15.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:15.864+0000 7f5dbaffd640 1 -- 172.21.15.172:0/2395198656 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5dbc0585a0 con 0x7f5dc415c710 2024-04-25T08:45:16.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.037+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2395198656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5dc415bfb0 con 0x7f5dc415c710 2024-04-25T08:45:16.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.038+0000 7f5dbaffd640 1 -- 172.21.15.172:0/2395198656 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5dbc08d020 con 0x7f5dc415c710 2024-04-25T08:45:16.030 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:16.030 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:45:16.030 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:16.030 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2024-04-25T08:45:16.030 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2024-04-25T08:45:16.030 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:16.030 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.039+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2395198656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5da406b4d0 msgr2=0x7f5da406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.039+0000 7f5dc8fe7640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5da406b4d0 0x7f5da406d990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5db4033000 tx=0x7f5db402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.040+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2395198656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc415c710 msgr2=0x7f5dc415cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.040+0000 7f5dc8fe7640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc415c710 0x7f5dc415cb90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40cfb60 tx=0x7f5dbc00eb90 comp rx=0 tx=0).stop 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.040+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2395198656 shutdown_connections 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.040+0000 7f5dc8fe7640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5da406b4d0 0x7f5da406d990 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.040+0000 7f5dc8fe7640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc4153c10 0x7f5dc41534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.040+0000 7f5dc8fe7640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dc415c710 0x7f5dc415cb90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.040+0000 7f5dc8fe7640 1 --2- 172.21.15.172:0/2395198656 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5db00039b0 0x7f5dc40cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.040+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2395198656 >> 172.21.15.172:0/2395198656 conn(0x7f5dc4061a20 msgr2=0x7f5dc40d3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.040+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2395198656 shutdown_connections 2024-04-25T08:45:16.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.040+0000 7f5dc8fe7640 1 -- 172.21.15.172:0/2395198656 wait complete. 2024-04-25T08:45:16.042 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:45:16.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:45:16.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.153+0000 7f515cc07640 1 Processor -- start 2024-04-25T08:45:16.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.153+0000 7f515cc07640 1 -- start start 2024-04-25T08:45:16.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f515cc07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f515815dc20 0x7f51580ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f515cc07640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51580d32f0 0x7f51580cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f515cc07640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515815e000 con 0x7f5158161710 2024-04-25T08:45:16.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f515cc07640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51580d1de0 con 0x7f51580d32f0 2024-04-25T08:45:16.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f515cc07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5158161c60 con 0x7f515815dc20 2024-04-25T08:45:16.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f5156d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51580d32f0 0x7f51580cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f5156d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51580d32f0 0x7f51580cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45166/0 (socket says 172.21.15.172:45166) 2024-04-25T08:45:16.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f5156d9d640 1 -- 172.21.15.172:0/4196638819 learned_addr learned my addr 172.21.15.172:0/4196638819 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:16.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f515659c640 1 --2- 172.21.15.172:0/4196638819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f515815dc20 0x7f51580ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f5156d9d640 1 -- 172.21.15.172:0/4196638819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f515815dc20 msgr2=0x7f51580ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:16.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f5156d9d640 1 --2- 172.21.15.172:0/4196638819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f515815dc20 0x7f51580ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f5156d9d640 1 -- 172.21.15.172:0/4196638819 >> v1:172.21.15.186:6789/0 conn(0x7f5158161710 legacy=0x7f515806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.154+0000 7f5156d9d640 1 -- 172.21.15.172:0/4196638819 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5158161f40 con 0x7f51580d32f0 2024-04-25T08:45:16.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.155+0000 7f5156d9d640 1 --2- 172.21.15.172:0/4196638819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51580d32f0 0x7f51580cebb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5150009e50 tx=0x7f515002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d003a4aa7e543ea5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:16.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.155+0000 7f5155d9b640 1 -- 172.21.15.172:0/4196638819 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150036070 con 0x7f51580d32f0 2024-04-25T08:45:16.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.155+0000 7f5155d9b640 1 -- 172.21.15.172:0/4196638819 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5150031600 con 0x7f51580d32f0 2024-04-25T08:45:16.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.155+0000 7f5155d9b640 1 -- 172.21.15.172:0/4196638819 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500319d0 con 0x7f51580d32f0 2024-04-25T08:45:16.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.155+0000 7f515cc07640 1 -- 172.21.15.172:0/4196638819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51580d32f0 msgr2=0x7f51580cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.155+0000 7f515cc07640 1 --2- 172.21.15.172:0/4196638819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51580d32f0 0x7f51580cebb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5150009e50 tx=0x7f515002a710 comp rx=0 tx=0).stop 2024-04-25T08:45:16.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.156+0000 7f515cc07640 1 -- 172.21.15.172:0/4196638819 shutdown_connections 2024-04-25T08:45:16.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.156+0000 7f515cc07640 1 --2- 172.21.15.172:0/4196638819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51580d32f0 0x7f51580cebb0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.156+0000 7f515cc07640 1 --2- 172.21.15.172:0/4196638819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f515815dc20 0x7f51580ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.156+0000 7f515cc07640 1 -- 172.21.15.172:0/4196638819 >> 172.21.15.172:0/4196638819 conn(0x7f51580d0420 msgr2=0x7f51580d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:16.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.156+0000 7f515cc07640 1 -- 172.21.15.172:0/4196638819 shutdown_connections 2024-04-25T08:45:16.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.156+0000 7f515cc07640 1 -- 172.21.15.172:0/4196638819 wait complete. 2024-04-25T08:45:16.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.157+0000 7f515cc07640 1 Processor -- start 2024-04-25T08:45:16.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.157+0000 7f515cc07640 1 -- start start 2024-04-25T08:45:16.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f515cc07640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51580d32f0 0x7f515814c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f515cc07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f515815dc20 0x7f51580acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f515cc07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5158161710 0x7f51580ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f515cc07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580b5e50 con 0x7f5158161710 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f515cc07640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5158162500 con 0x7f51580d32f0 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f515cc07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51580b5fd0 con 0x7f515815dc20 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f5156d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5158161710 0x7f51580ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f5156d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5158161710 0x7f51580ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45172/0 (socket says 172.21.15.172:45172) 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f5156d9d640 1 -- 172.21.15.172:0/3554128796 learned_addr learned my addr 172.21.15.172:0/3554128796 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f515659c640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51580d32f0 0x7f515814c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f514ffff640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f515815dc20 0x7f51580acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f5156d9d640 1 -- 172.21.15.172:0/3554128796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f515815dc20 msgr2=0x7f51580acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f5156d9d640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f515815dc20 0x7f51580acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f5156d9d640 1 -- 172.21.15.172:0/3554128796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51580d32f0 msgr2=0x7f515814c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f5156d9d640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51580d32f0 0x7f515814c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f5156d9d640 1 -- 172.21.15.172:0/3554128796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580cd350 con 0x7f5158161710 2024-04-25T08:45:16.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f5156d9d640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5158161710 0x7f51580ad460 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5150009e50 tx=0x7f5150004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f514effd640 1 -- 172.21.15.172:0/3554128796 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150041020 con 0x7f5158161710 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f514effd640 1 -- 172.21.15.172:0/3554128796 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51500077a0 con 0x7f5158161710 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f515cc07640 1 -- 172.21.15.172:0/3554128796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515814cc30 con 0x7f5158161710 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f514effd640 1 -- 172.21.15.172:0/3554128796 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150036040 con 0x7f5158161710 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.158+0000 7f515cc07640 1 -- 172.21.15.172:0/3554128796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51580cc5d0 con 0x7f5158161710 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.160+0000 7f515cc07640 1 -- 172.21.15.172:0/3554128796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515814ca50 con 0x7f5158161710 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.160+0000 7f514effd640 1 -- 172.21.15.172:0/3554128796 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5150044020 con 0x7f5158161710 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.160+0000 7f514effd640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f513806b500 0x7f513806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.160+0000 7f514effd640 1 -- 172.21.15.172:0/3554128796 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f51500aaa80 con 0x7f5158161710 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.160+0000 7f515659c640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f513806b500 0x7f513806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.161+0000 7f515659c640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f513806b500 0x7f513806d9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f51580aa590 tx=0x7f5148008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:16.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.164+0000 7f514effd640 1 -- 172.21.15.172:0/3554128796 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f515814ca50 con 0x7f5158161710 2024-04-25T08:45:16.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.338+0000 7f515cc07640 1 -- 172.21.15.172:0/3554128796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5158073a00 con 0x7f5158161710 2024-04-25T08:45:16.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.783+0000 7f514effd640 1 -- 172.21.15.172:0/3554128796 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7f515004b030 con 0x7f5158161710 2024-04-25T08:45:16.775 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2024-04-25T08:45:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 -- 172.21.15.172:0/3554128796 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f513806b500 msgr2=0x7f513806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f513806b500 0x7f513806d9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f51580aa590 tx=0x7f5148008040 comp rx=0 tx=0).stop 2024-04-25T08:45:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 -- 172.21.15.172:0/3554128796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5158161710 msgr2=0x7f51580ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5158161710 0x7f51580ad460 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5150009e50 tx=0x7f5150004a40 comp rx=0 tx=0).stop 2024-04-25T08:45:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 -- 172.21.15.172:0/3554128796 shutdown_connections 2024-04-25T08:45:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f513806b500 0x7f513806d9c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5158161710 0x7f51580ad460 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f515815dc20 0x7f51580acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 --2- 172.21.15.172:0/3554128796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51580d32f0 0x7f515814c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 -- 172.21.15.172:0/3554128796 >> 172.21.15.172:0/3554128796 conn(0x7f51580d0420 msgr2=0x7f51580b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:16.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 -- 172.21.15.172:0/3554128796 shutdown_connections 2024-04-25T08:45:16.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.785+0000 7f515cc07640 1 -- 172.21.15.172:0/3554128796 wait complete. 2024-04-25T08:45:16.791 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:45:16.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.903+0000 7f3d9c63a640 1 Processor -- start 2024-04-25T08:45:16.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.903+0000 7f3d9c63a640 1 -- start start 2024-04-25T08:45:16.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.904+0000 7f3d9c63a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3d940cd8a0 0x7f3d9415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.904+0000 7f3d9c63a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9415e6e0 con 0x7f3d940cd4c0 2024-04-25T08:45:16.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.904+0000 7f3d9c63a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9415e9c0 con 0x7f3d94150b90 2024-04-25T08:45:16.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.904+0000 7f3d9c63a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9415a9c0 con 0x7f3d940cd8a0 2024-04-25T08:45:16.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d9a3d6640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3d940cd4c0 0x7f3d9415dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48176/0 (socket says 172.21.15.172:48176) 2024-04-25T08:45:16.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d9a3d6640 1 -- 172.21.15.172:0/1523189348 learned_addr learned my addr 172.21.15.172:0/1523189348 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:16.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247142582 0 0) 0x7f3d9415e6e0 con 0x7f3d940cd4c0 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d80004630 con 0x7f3d940cd4c0 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d99bd5640 1 --2- 172.21.15.172:0/1523189348 >> v2:172.21.15.186:3300/0 conn(0x7f3d940cd8a0 0x7f3d9415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 180260960 0 0) 0x7f3d80004630 con 0x7f3d940cd4c0 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 >> v2:172.21.15.186:3300/0 conn(0x7f3d940cd8a0 msgr2=0x7f3d9415b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 --2- 172.21.15.172:0/1523189348 >> v2:172.21.15.186:3300/0 conn(0x7f3d940cd8a0 0x7f3d9415b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 >> v1:172.21.15.186:6789/0 conn(0x7f3d94150b90 legacy=0x7f3d94071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9415aca0 con 0x7f3d940cd4c0 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f3d90001670 con 0x7f3d940cd4c0 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 >> v1:172.21.15.172:6789/0 conn(0x7f3d940cd4c0 legacy=0x7f3d9415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d80004ac0 0x7f3d80004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d80005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d800062d0 0x7f3d8000cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9415a9c0 con 0x7f3d80005910 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8000d170 con 0x7f3d80004ac0 2024-04-25T08:45:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8000d370 con 0x7f3d800062d0 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d99bd5640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d80005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d9a3d6640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d80004ac0 0x7f3d80004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.905+0000 7f3d9abd7640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d800062d0 0x7f3d8000cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d99bd5640 1 -- 172.21.15.172:0/1523189348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d800062d0 msgr2=0x7f3d8000cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d99bd5640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d800062d0 0x7f3d8000cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d99bd5640 1 -- 172.21.15.172:0/1523189348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d80004ac0 msgr2=0x7f3d80004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d99bd5640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d80004ac0 0x7f3d80004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d9abd7640 1 -- 172.21.15.172:0/1523189348 reap_dead start 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d99bd5640 1 -- 172.21.15.172:0/1523189348 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80004630 con 0x7f3d80005910 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d9a3d6640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d80004ac0 0x7f3d80004ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d99bd5640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d80005d90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009650 tx=0x7f3d80006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0e5bece93336c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84038070 con 0x7f3d80005910 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d84033400 con 0x7f3d80005910 2024-04-25T08:45:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.906+0000 7f3d993d4640 1 -- 172.21.15.172:0/1523189348 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84009690 con 0x7f3d80005910 2024-04-25T08:45:16.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.907+0000 7f3d9c63a640 1 -- 172.21.15.172:0/1523189348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 msgr2=0x7f3d80005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.907+0000 7f3d9c63a640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d80005d90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009650 tx=0x7f3d80006940 comp rx=0 tx=0).stop 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.907+0000 7f3d9c63a640 1 -- 172.21.15.172:0/1523189348 shutdown_connections 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.907+0000 7f3d9c63a640 1 --2- 172.21.15.172:0/1523189348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d80005d90 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.907+0000 7f3d9c63a640 1 -- 172.21.15.172:0/1523189348 >> 172.21.15.172:0/1523189348 conn(0x7f3d9406abe0 msgr2=0x7f3d9406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.907+0000 7f3d9c63a640 1 -- 172.21.15.172:0/1523189348 shutdown_connections 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.907+0000 7f3d9c63a640 1 -- 172.21.15.172:0/1523189348 wait complete. 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.908+0000 7f3d9c63a640 1 Processor -- start 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.908+0000 7f3d9c63a640 1 -- start start 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9c63a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d94141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9c63a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d9415d330 0x7f3d9415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9c63a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d940acb70 0x7f3d940acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9c63a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9406ee20 con 0x7f3d80005910 2024-04-25T08:45:16.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9c63a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9406eca0 con 0x7f3d9415d330 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9c63a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9415b1c0 con 0x7f3d940acb70 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9a3d6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d94141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9a3d6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d94141020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45178/0 (socket says 172.21.15.172:45178) 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9a3d6640 1 -- 172.21.15.172:0/3849937011 learned_addr learned my addr 172.21.15.172:0/3849937011 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9a3d6640 1 -- 172.21.15.172:0/3849937011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d940acb70 msgr2=0x7f3d940acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9a3d6640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d940acb70 0x7f3d940acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9a3d6640 1 -- 172.21.15.172:0/3849937011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d9415d330 msgr2=0x7f3d9415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9a3d6640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d9415d330 0x7f3d9415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.909+0000 7f3d9a3d6640 1 -- 172.21.15.172:0/3849937011 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940af620 con 0x7f3d80005910 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.910+0000 7f3d9a3d6640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d94141020 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000e790 tx=0x7f3d9000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.910+0000 7f3d8affd640 1 -- 172.21.15.172:0/3849937011 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000eea0 con 0x7f3d80005910 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.910+0000 7f3d8affd640 1 -- 172.21.15.172:0/3849937011 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d90018070 con 0x7f3d80005910 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.910+0000 7f3d9c63a640 1 -- 172.21.15.172:0/3849937011 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d940af900 con 0x7f3d80005910 2024-04-25T08:45:16.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.910+0000 7f3d8affd640 1 -- 172.21.15.172:0/3849937011 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000ca70 con 0x7f3d80005910 2024-04-25T08:45:16.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.910+0000 7f3d9c63a640 1 -- 172.21.15.172:0/3849937011 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d94141560 con 0x7f3d80005910 2024-04-25T08:45:16.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.911+0000 7f3d9c63a640 1 -- 172.21.15.172:0/3849937011 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9415dcf0 con 0x7f3d80005910 2024-04-25T08:45:16.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.911+0000 7f3d8affd640 1 -- 172.21.15.172:0/3849937011 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3d9000cc10 con 0x7f3d80005910 2024-04-25T08:45:16.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.911+0000 7f3d8affd640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3d7806b4d0 0x7f3d7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:16.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.912+0000 7f3d8affd640 1 -- 172.21.15.172:0/3849937011 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f3d9008a050 con 0x7f3d80005910 2024-04-25T08:45:16.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.912+0000 7f3d99bd5640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3d7806b4d0 0x7f3d7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:16.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.912+0000 7f3d99bd5640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3d7806b4d0 0x7f3d7806d990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3d84035000 tx=0x7f3d84030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:16.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:16.916+0000 7f3d8affd640 1 -- 172.21.15.172:0/3849937011 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3d90058f20 con 0x7f3d80005910 2024-04-25T08:45:17.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.085+0000 7f3d9c63a640 1 -- 172.21.15.172:0/3849937011 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3d94073a00 con 0x7f3d80005910 2024-04-25T08:45:17.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.785+0000 7f3d8affd640 1 -- 172.21.15.172:0/3849937011 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3d90058820 con 0x7f3d80005910 2024-04-25T08:45:17.777 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2024-04-25T08:45:17.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 -- 172.21.15.172:0/3849937011 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3d7806b4d0 msgr2=0x7f3d7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3d7806b4d0 0x7f3d7806d990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3d84035000 tx=0x7f3d84030000 comp rx=0 tx=0).stop 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 -- 172.21.15.172:0/3849937011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 msgr2=0x7f3d94141020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d94141020 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000e790 tx=0x7f3d9000ec50 comp rx=0 tx=0).stop 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 -- 172.21.15.172:0/3849937011 shutdown_connections 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3d7806b4d0 0x7f3d7806d990 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d9415d330 0x7f3d9415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d940acb70 0x7f3d940acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 --2- 172.21.15.172:0/3849937011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d80005910 0x7f3d94141020 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 -- 172.21.15.172:0/3849937011 >> 172.21.15.172:0/3849937011 conn(0x7f3d9406abe0 msgr2=0x7f3d9406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 -- 172.21.15.172:0/3849937011 shutdown_connections 2024-04-25T08:45:17.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.787+0000 7f3d9c63a640 1 -- 172.21.15.172:0/3849937011 wait complete. 2024-04-25T08:45:17.801 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:45:17.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.912+0000 7f51e3568640 1 Processor -- start 2024-04-25T08:45:17.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.912+0000 7f51e3568640 1 -- start start 2024-04-25T08:45:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e3568640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc070dc0 0x7f51dc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e3568640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51dc15deb0 0x7f51dc15e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e3568640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc0d1770 con 0x7f51dc0711a0 2024-04-25T08:45:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e3568640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc0b0eb0 con 0x7f51dc15deb0 2024-04-25T08:45:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e3568640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc1622b0 con 0x7f51dc070dc0 2024-04-25T08:45:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e1b05640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51dc15deb0 0x7f51dc15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e1b05640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51dc15deb0 0x7f51dc15e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47568/0 (socket says 172.21.15.172:47568) 2024-04-25T08:45:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e1b05640 1 -- 172.21.15.172:0/2625753491 learned_addr learned my addr 172.21.15.172:0/2625753491 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e1304640 1 --2- 172.21.15.172:0/2625753491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc070dc0 0x7f51dc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:17.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e1b05640 1 -- 172.21.15.172:0/2625753491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc070dc0 msgr2=0x7f51dc06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:17.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e1b05640 1 --2- 172.21.15.172:0/2625753491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc070dc0 0x7f51dc06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:17.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e1b05640 1 -- 172.21.15.172:0/2625753491 >> v1:172.21.15.186:6789/0 conn(0x7f51dc0711a0 legacy=0x7f51dc0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:17.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e1b05640 1 -- 172.21.15.172:0/2625753491 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc162740 con 0x7f51dc15deb0 2024-04-25T08:45:17.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.913+0000 7f51e1304640 1 --2- 172.21.15.172:0/2625753491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc070dc0 0x7f51dc06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.914+0000 7f51e1b05640 1 --2- 172.21.15.172:0/2625753491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc15deb0 0x7f51dc15e340 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009870 tx=0x7f51d402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b257480a3721e33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.914+0000 7f51d3fff640 1 -- 172.21.15.172:0/2625753491 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4037070 con 0x7f51dc15deb0 2024-04-25T08:45:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.914+0000 7f51d3fff640 1 -- 172.21.15.172:0/2625753491 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4032440 con 0x7f51dc15deb0 2024-04-25T08:45:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.914+0000 7f51d3fff640 1 -- 172.21.15.172:0/2625753491 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4032810 con 0x7f51dc15deb0 2024-04-25T08:45:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.914+0000 7f51e3568640 1 -- 172.21.15.172:0/2625753491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc15deb0 msgr2=0x7f51dc15e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.914+0000 7f51e3568640 1 --2- 172.21.15.172:0/2625753491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc15deb0 0x7f51dc15e340 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009870 tx=0x7f51d402a130 comp rx=0 tx=0).stop 2024-04-25T08:45:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.914+0000 7f51e3568640 1 -- 172.21.15.172:0/2625753491 shutdown_connections 2024-04-25T08:45:17.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.914+0000 7f51e3568640 1 --2- 172.21.15.172:0/2625753491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc15deb0 0x7f51dc15e340 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.914+0000 7f51e3568640 1 --2- 172.21.15.172:0/2625753491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc070dc0 0x7f51dc06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.914+0000 7f51e3568640 1 -- 172.21.15.172:0/2625753491 >> 172.21.15.172:0/2625753491 conn(0x7f51dc0b3530 msgr2=0x7f51dc0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.915+0000 7f51e3568640 1 -- 172.21.15.172:0/2625753491 shutdown_connections 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.915+0000 7f51e3568640 1 -- 172.21.15.172:0/2625753491 wait complete. 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.916+0000 7f51e3568640 1 Processor -- start 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.916+0000 7f51e3568640 1 -- start start 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.916+0000 7f51e3568640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc070dc0 0x7f51dc0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.916+0000 7f51e3568640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc0711a0 0x7f51dc14e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.916+0000 7f51e3568640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51dc15deb0 0x7f51dc160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.916+0000 7f51e3568640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc161c60 con 0x7f51dc070dc0 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.916+0000 7f51e3568640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0b10f0 con 0x7f51dc15deb0 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.916+0000 7f51e3568640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc161f40 con 0x7f51dc0711a0 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.916+0000 7f51e1304640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc070dc0 0x7f51dc0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:17.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e1304640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc070dc0 0x7f51dc0cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47578/0 (socket says 172.21.15.172:47578) 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e1304640 1 -- 172.21.15.172:0/3434508231 learned_addr learned my addr 172.21.15.172:0/3434508231 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e0b03640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc0711a0 0x7f51dc14e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e1b05640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51dc15deb0 0x7f51dc160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e1304640 1 -- 172.21.15.172:0/3434508231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc0711a0 msgr2=0x7f51dc14e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e1304640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc0711a0 0x7f51dc14e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e1304640 1 -- 172.21.15.172:0/3434508231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51dc15deb0 msgr2=0x7f51dc160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e1304640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51dc15deb0 0x7f51dc160a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e1304640 1 -- 172.21.15.172:0/3434508231 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc0cae00 con 0x7f51dc070dc0 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e1304640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc070dc0 0x7f51dc0cbbc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f51d800cf90 tx=0x7f51d800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51d1ffb640 1 -- 172.21.15.172:0/3434508231 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d801a070 con 0x7f51dc070dc0 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51d1ffb640 1 -- 172.21.15.172:0/3434508231 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d800d840 con 0x7f51dc070dc0 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e3568640 1 -- 172.21.15.172:0/3434508231 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc0cb0e0 con 0x7f51dc070dc0 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51d1ffb640 1 -- 172.21.15.172:0/3434508231 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800dc10 con 0x7f51dc070dc0 2024-04-25T08:45:17.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.917+0000 7f51e3568640 1 -- 172.21.15.172:0/3434508231 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc0cb6a0 con 0x7f51dc070dc0 2024-04-25T08:45:17.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.918+0000 7f51e3568640 1 -- 172.21.15.172:0/3434508231 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc072fc0 con 0x7f51dc070dc0 2024-04-25T08:45:17.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.919+0000 7f51d1ffb640 1 -- 172.21.15.172:0/3434508231 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f51d801d070 con 0x7f51dc070dc0 2024-04-25T08:45:17.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.919+0000 7f51d1ffb640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f51c006b4d0 0x7f51c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:17.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.919+0000 7f51e0b03640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f51c006b4d0 0x7f51c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:17.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.919+0000 7f51d1ffb640 1 -- 172.21.15.172:0/3434508231 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f51d808aab0 con 0x7f51dc070dc0 2024-04-25T08:45:17.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.920+0000 7f51e0b03640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f51c006b4d0 0x7f51c006d990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0cc580 tx=0x7f51cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:17.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:17.924+0000 7f51d1ffb640 1 -- 172.21.15.172:0/3434508231 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51dc072fc0 con 0x7f51dc070dc0 2024-04-25T08:45:18.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.130+0000 7f51e3568640 1 -- 172.21.15.172:0/3434508231 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f51dc0cb8a0 con 0x7f51dc070dc0 2024-04-25T08:45:18.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.809+0000 7f51d1ffb640 1 -- 172.21.15.172:0/3434508231 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f51dc0cb8a0 con 0x7f51dc070dc0 2024-04-25T08:45:18.801 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 7 and data pool 8 2024-04-25T08:45:18.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.817+0000 7f51e3568640 1 -- 172.21.15.172:0/3434508231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f51c006b4d0 msgr2=0x7f51c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:18.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.817+0000 7f51e3568640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f51c006b4d0 0x7f51c006d990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0cc580 tx=0x7f51cc009040 comp rx=0 tx=0).stop 2024-04-25T08:45:18.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.817+0000 7f51e3568640 1 -- 172.21.15.172:0/3434508231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc070dc0 msgr2=0x7f51dc0cbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:18.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.817+0000 7f51e3568640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc070dc0 0x7f51dc0cbbc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f51d800cf90 tx=0x7f51d800a7d0 comp rx=0 tx=0).stop 2024-04-25T08:45:18.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.818+0000 7f51e3568640 1 -- 172.21.15.172:0/3434508231 shutdown_connections 2024-04-25T08:45:18.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.818+0000 7f51e3568640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f51c006b4d0 0x7f51c006d990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:18.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.819+0000 7f51e3568640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51dc15deb0 0x7f51dc160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:18.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.819+0000 7f51e3568640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51dc0711a0 0x7f51dc14e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:18.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.819+0000 7f51e3568640 1 --2- 172.21.15.172:0/3434508231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51dc070dc0 0x7f51dc0cbbc0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:18.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.819+0000 7f51e3568640 1 -- 172.21.15.172:0/3434508231 >> 172.21.15.172:0/3434508231 conn(0x7f51dc0b3530 msgr2=0x7f51dc06cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:18.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.821+0000 7f51e3568640 1 -- 172.21.15.172:0/3434508231 shutdown_connections 2024-04-25T08:45:18.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.821+0000 7f51e3568640 1 -- 172.21.15.172:0/3434508231 wait complete. 2024-04-25T08:45:18.827 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:18.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.933+0000 7fcdd2de7640 1 Processor -- start 2024-04-25T08:45:18.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.933+0000 7fcdd2de7640 1 -- start start 2024-04-25T08:45:18.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.934+0000 7fcdd2de7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcdcc15dd30 0x7fcdcc0b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:18.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.934+0000 7fcdd2de7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcdcc0b9770 0x7fcdcc0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:18.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.934+0000 7fcdd2de7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc0d1df0 con 0x7fcdcc0d2e90 2024-04-25T08:45:18.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.934+0000 7fcdd2de7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0b7a50 con 0x7fcdcc15dd30 2024-04-25T08:45:18.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.934+0000 7fcdd2de7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0d20d0 con 0x7fcdcc0b9770 2024-04-25T08:45:18.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.934+0000 7fcdd0b83640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcdcc15dd30 0x7fcdcc0b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:18.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.934+0000 7fcdd1384640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcdcc0d2e90 0x7fcdcc0b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39324/0 (socket says 172.21.15.172:39324) 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.934+0000 7fcdd0b83640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcdcc15dd30 0x7fcdcc0b9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47582/0 (socket says 172.21.15.172:47582) 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.934+0000 7fcdd1384640 1 -- 172.21.15.172:0/2419365425 learned_addr learned my addr 172.21.15.172:0/2419365425 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.934+0000 7fcdcbfff640 1 --2- 172.21.15.172:0/2419365425 >> v2:172.21.15.186:3300/0 conn(0x7fcdcc0b9770 0x7fcdcc0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.935+0000 7fcdd0b83640 1 -- 172.21.15.172:0/2419365425 >> v2:172.21.15.186:3300/0 conn(0x7fcdcc0b9770 msgr2=0x7fcdcc0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.935+0000 7fcdd0b83640 1 --2- 172.21.15.172:0/2419365425 >> v2:172.21.15.186:3300/0 conn(0x7fcdcc0b9770 0x7fcdcc0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.935+0000 7fcdd0b83640 1 -- 172.21.15.172:0/2419365425 >> v1:172.21.15.172:6789/0 conn(0x7fcdcc0d2e90 legacy=0x7fcdcc0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.935+0000 7fcdd0b83640 1 -- 172.21.15.172:0/2419365425 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0d23b0 con 0x7fcdcc15dd30 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.935+0000 7fcdcb7fe640 1 -- 172.21.15.172:0/2419365425 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554285510 0 0) 0x7fcdcc0d1df0 con 0x7fcdcc0d2e90 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.935+0000 7fcdd0b83640 1 --2- 172.21.15.172:0/2419365425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 0x7fcdcc0b9230 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0b6540 tx=0x7fcdbc02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc541c881aed3964 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.935+0000 7fcdcb7fe640 1 -- 172.21.15.172:0/2419365425 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc037070 con 0x7fcdcc15dd30 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.935+0000 7fcdcb7fe640 1 -- 172.21.15.172:0/2419365425 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc02add0 con 0x7fcdcc15dd30 2024-04-25T08:45:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.935+0000 7fcdcb7fe640 1 -- 172.21.15.172:0/2419365425 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc032660 con 0x7fcdcc15dd30 2024-04-25T08:45:18.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.936+0000 7fcdd2de7640 1 -- 172.21.15.172:0/2419365425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 msgr2=0x7fcdcc0b9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:18.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.936+0000 7fcdd2de7640 1 --2- 172.21.15.172:0/2419365425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 0x7fcdcc0b9230 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0b6540 tx=0x7fcdbc02a080 comp rx=0 tx=0).stop 2024-04-25T08:45:18.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.936+0000 7fcdd2de7640 1 -- 172.21.15.172:0/2419365425 shutdown_connections 2024-04-25T08:45:18.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.936+0000 7fcdd2de7640 1 --2- 172.21.15.172:0/2419365425 >> v2:172.21.15.186:3300/0 conn(0x7fcdcc0b9770 0x7fcdcc0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:18.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.936+0000 7fcdd2de7640 1 --2- 172.21.15.172:0/2419365425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 0x7fcdcc0b9230 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:18.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.936+0000 7fcdd2de7640 1 -- 172.21.15.172:0/2419365425 >> 172.21.15.172:0/2419365425 conn(0x7fcdcc061c30 msgr2=0x7fcdcc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:18.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.936+0000 7fcdd2de7640 1 -- 172.21.15.172:0/2419365425 shutdown_connections 2024-04-25T08:45:18.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.936+0000 7fcdd2de7640 1 -- 172.21.15.172:0/2419365425 wait complete. 2024-04-25T08:45:18.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.937+0000 7fcdd2de7640 1 Processor -- start 2024-04-25T08:45:18.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.937+0000 7fcdd2de7640 1 -- start start 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd2de7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdcc0b9770 0x7fcdcc0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd2de7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdcc0d2e90 0x7fcdcc0b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd2de7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 0x7fcdcc15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd2de7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0d1a10 con 0x7fcdcc15dd30 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd2de7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0d2970 con 0x7fcdcc0b9770 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd2de7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0d1b90 con 0x7fcdcc0d2e90 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd1384640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 0x7fcdcc15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd1384640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 0x7fcdcc15a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47584/0 (socket says 172.21.15.172:47584) 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd1384640 1 -- 172.21.15.172:0/4146826495 learned_addr learned my addr 172.21.15.172:0/4146826495 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd0b83640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdcc0b9770 0x7fcdcc0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:18.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd1384640 1 -- 172.21.15.172:0/4146826495 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdcc0d2e90 msgr2=0x7fcdcc0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.938+0000 7fcdd1384640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdcc0d2e90 0x7fcdcc0b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.939+0000 7fcdd1384640 1 -- 172.21.15.172:0/4146826495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdcc0b9770 msgr2=0x7fcdcc0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.939+0000 7fcdd1384640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdcc0b9770 0x7fcdcc0cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.939+0000 7fcdd1384640 1 -- 172.21.15.172:0/4146826495 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0cc7f0 con 0x7fcdcc15dd30 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.939+0000 7fcdd1384640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 0x7fcdcc15a2c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400c7a0 tx=0x7fcdc400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.939+0000 7fcdc97fa640 1 -- 172.21.15.172:0/4146826495 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4018070 con 0x7fcdcc15dd30 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.939+0000 7fcdc97fa640 1 -- 172.21.15.172:0/4146826495 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400a5e0 con 0x7fcdcc15dd30 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.939+0000 7fcdc97fa640 1 -- 172.21.15.172:0/4146826495 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400aa50 con 0x7fcdcc15dd30 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.939+0000 7fcdd2de7640 1 -- 172.21.15.172:0/4146826495 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc0ccad0 con 0x7fcdcc15dd30 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.939+0000 7fcdd2de7640 1 -- 172.21.15.172:0/4146826495 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc0cd090 con 0x7fcdcc15dd30 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.940+0000 7fcdd2de7640 1 -- 172.21.15.172:0/4146826495 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc0cd290 con 0x7fcdcc15dd30 2024-04-25T08:45:18.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.940+0000 7fcdc97fa640 1 -- 172.21.15.172:0/4146826495 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcdc401b070 con 0x7fcdcc15dd30 2024-04-25T08:45:18.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.941+0000 7fcdc97fa640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcdb806b500 0x7fcdb806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:18.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.941+0000 7fcdc97fa640 1 -- 172.21.15.172:0/4146826495 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcdc4089980 con 0x7fcdcc15dd30 2024-04-25T08:45:18.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.941+0000 7fcdd0b83640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcdb806b500 0x7fcdb806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:18.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.941+0000 7fcdd0b83640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcdb806b500 0x7fcdb806d9c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc034000 tx=0x7fcdbc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:18.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:18.945+0000 7fcdc97fa640 1 -- 172.21.15.172:0/4146826495 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcdcc0cd290 con 0x7fcdcc15dd30 2024-04-25T08:45:19.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.119+0000 7fcdd2de7640 1 -- 172.21.15.172:0/4146826495 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdcc0b82a0 con 0x7fcdcc15dd30 2024-04-25T08:45:19.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.121+0000 7fcdc97fa640 1 -- 172.21.15.172:0/4146826495 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+17015 (secure 0 0 0) 0x7fcdc4058660 con 0x7fcdcc15dd30 2024-04-25T08:45:19.113 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:19.113 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":53,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:45:18.132341+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:45:16.357665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T08:45:17.104697+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 -- 172.21.15.172:0/4146826495 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcdb806b500 msgr2=0x7fcdb806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcdb806b500 0x7fcdb806d9c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc034000 tx=0x7fcdbc02e000 comp rx=0 tx=0).stop 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 -- 172.21.15.172:0/4146826495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 msgr2=0x7fcdcc15a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 0x7fcdcc15a2c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400c7a0 tx=0x7fcdc400cc60 comp rx=0 tx=0).stop 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 -- 172.21.15.172:0/4146826495 shutdown_connections 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcdb806b500 0x7fcdb806d9c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdcc15dd30 0x7fcdcc15a2c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdcc0d2e90 0x7fcdcc0b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 --2- 172.21.15.172:0/4146826495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdcc0b9770 0x7fcdcc0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 -- 172.21.15.172:0/4146826495 >> 172.21.15.172:0/4146826495 conn(0x7fcdcc061c30 msgr2=0x7fcdcc06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:19.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 -- 172.21.15.172:0/4146826495 shutdown_connections 2024-04-25T08:45:19.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.123+0000 7fcdd2de7640 1 -- 172.21.15.172:0/4146826495 wait complete. 2024-04-25T08:45:19.126 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:19.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.231+0000 7f120af4c640 1 Processor -- start 2024-04-25T08:45:19.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.231+0000 7f120af4c640 1 -- start start 2024-04-25T08:45:19.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.232+0000 7f120af4c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f120415f190 0x7f12040b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.232+0000 7f120af4c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f12040b4b60 0x7f12040b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.232+0000 7f120af4c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120415af60 con 0x7f1204154fe0 2024-04-25T08:45:19.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.232+0000 7f120af4c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12040b4fc0 con 0x7f12040b4b60 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.232+0000 7f120af4c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120415b870 con 0x7f120415f190 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.232+0000 7f1203fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f120415f190 0x7f12040b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.232+0000 7f12094e9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f12040b4b60 0x7f12040b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.232+0000 7f12094e9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f12040b4b60 0x7f12040b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:38584/0 (socket says 172.21.15.172:38584) 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.232+0000 7f1203fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f120415f190 0x7f12040b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:57798/0 (socket says 172.21.15.172:57798) 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.232+0000 7f12094e9640 1 -- 172.21.15.172:0/3465296572 learned_addr learned my addr 172.21.15.172:0/3465296572 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.233+0000 7f12094e9640 1 -- 172.21.15.172:0/3465296572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f120415f190 msgr2=0x7f12040b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.233+0000 7f12094e9640 1 --2- 172.21.15.172:0/3465296572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f120415f190 0x7f12040b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.233+0000 7f12094e9640 1 -- 172.21.15.172:0/3465296572 >> v1:172.21.15.186:6789/0 conn(0x7f1204154fe0 legacy=0x7f120406e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.233+0000 7f12094e9640 1 -- 172.21.15.172:0/3465296572 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120406f1c0 con 0x7f12040b4b60 2024-04-25T08:45:19.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.233+0000 7f12037fe640 1 -- 172.21.15.172:0/3465296572 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435150704 0 0) 0x7f120415af60 con 0x7f1204154fe0 2024-04-25T08:45:19.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.233+0000 7f12094e9640 1 --2- 172.21.15.172:0/3465296572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12040b4b60 0x7f12040b2b90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f120415b9f0 tx=0x7f11fc02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4744f95ee5c2dc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:19.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f12037fe640 1 -- 172.21.15.172:0/3465296572 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc036070 con 0x7f12040b4b60 2024-04-25T08:45:19.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f12037fe640 1 -- 172.21.15.172:0/3465296572 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc031600 con 0x7f12040b4b60 2024-04-25T08:45:19.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f12037fe640 1 -- 172.21.15.172:0/3465296572 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0319d0 con 0x7f12040b4b60 2024-04-25T08:45:19.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f120af4c640 1 -- 172.21.15.172:0/3465296572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12040b4b60 msgr2=0x7f12040b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f120af4c640 1 --2- 172.21.15.172:0/3465296572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12040b4b60 0x7f12040b2b90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f120415b9f0 tx=0x7f11fc02a710 comp rx=0 tx=0).stop 2024-04-25T08:45:19.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f120af4c640 1 -- 172.21.15.172:0/3465296572 shutdown_connections 2024-04-25T08:45:19.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f120af4c640 1 --2- 172.21.15.172:0/3465296572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f120415f190 0x7f12040b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f120af4c640 1 --2- 172.21.15.172:0/3465296572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12040b4b60 0x7f12040b2b90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f120af4c640 1 -- 172.21.15.172:0/3465296572 >> 172.21.15.172:0/3465296572 conn(0x7f12040cfae0 msgr2=0x7f12040cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:19.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f120af4c640 1 -- 172.21.15.172:0/3465296572 shutdown_connections 2024-04-25T08:45:19.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.234+0000 7f120af4c640 1 -- 172.21.15.172:0/3465296572 wait complete. 2024-04-25T08:45:19.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.235+0000 7f120af4c640 1 Processor -- start 2024-04-25T08:45:19.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.235+0000 7f120af4c640 1 -- start start 2024-04-25T08:45:19.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f120af4c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12040b4b60 0x7f12041f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f120af4c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1204154fe0 0x7f12041f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f120af4c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120415f190 0x7f12041f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f120af4c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120406ef60 con 0x7f120415f190 2024-04-25T08:45:19.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f120af4c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12040cdba0 con 0x7f1204154fe0 2024-04-25T08:45:19.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f120af4c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120415b500 con 0x7f12040b4b60 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f12094e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120415f190 0x7f12041f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f12094e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120415f190 0x7f12041f1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47586/0 (socket says 172.21.15.172:47586) 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f12094e9640 1 -- 172.21.15.172:0/973506588 learned_addr learned my addr 172.21.15.172:0/973506588 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f1208ce8640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12040b4b60 0x7f12041f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.236+0000 7f1203fff640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1204154fe0 0x7f12041f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f12094e9640 1 -- 172.21.15.172:0/973506588 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12040b4b60 msgr2=0x7f12041f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f12094e9640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12040b4b60 0x7f12041f24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f12094e9640 1 -- 172.21.15.172:0/973506588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1204154fe0 msgr2=0x7f12041f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f12094e9640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1204154fe0 0x7f12041f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f12094e9640 1 -- 172.21.15.172:0/973506588 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12041f22a0 con 0x7f120415f190 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f12094e9640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120415f190 0x7f12041f1d60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009f40 tx=0x7f11fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f12017fa640 1 -- 172.21.15.172:0/973506588 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc041020 con 0x7f120415f190 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f12017fa640 1 -- 172.21.15.172:0/973506588 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc037040 con 0x7f120415f190 2024-04-25T08:45:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f12017fa640 1 -- 172.21.15.172:0/973506588 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc036050 con 0x7f120415f190 2024-04-25T08:45:19.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f120af4c640 1 -- 172.21.15.172:0/973506588 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12041f2a80 con 0x7f120415f190 2024-04-25T08:45:19.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.237+0000 7f120af4c640 1 -- 172.21.15.172:0/973506588 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12041f3040 con 0x7f120415f190 2024-04-25T08:45:19.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.238+0000 7f120af4c640 1 -- 172.21.15.172:0/973506588 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12040cd780 con 0x7f120415f190 2024-04-25T08:45:19.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.238+0000 7f12017fa640 1 -- 172.21.15.172:0/973506588 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f11fc007c50 con 0x7f120415f190 2024-04-25T08:45:19.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.239+0000 7f12017fa640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f11e806b4d0 0x7f11e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.239+0000 7f12017fa640 1 -- 172.21.15.172:0/973506588 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f11fc0aa920 con 0x7f120415f190 2024-04-25T08:45:19.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.239+0000 7f1208ce8640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f11e806b4d0 0x7f11e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.239+0000 7f1208ce8640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f11e806b4d0 0x7f11e806d990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f11f8000f60 tx=0x7f11f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:19.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.243+0000 7f12017fa640 1 -- 172.21.15.172:0/973506588 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f12040cd780 con 0x7f120415f190 2024-04-25T08:45:19.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.418+0000 7f120af4c640 1 -- 172.21.15.172:0/973506588 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f120406eb60 con 0x7f120415f190 2024-04-25T08:45:19.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.419+0000 7f12017fa640 1 -- 172.21.15.172:0/973506588 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+17015 (secure 0 0 0) 0x7f11fc04b060 con 0x7f120415f190 2024-04-25T08:45:19.411 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:19.411 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":53,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:45:18.132341+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:45:16.357665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T08:45:17.104697+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:19.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 -- 172.21.15.172:0/973506588 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f11e806b4d0 msgr2=0x7f11e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f11e806b4d0 0x7f11e806d990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f11f8000f60 tx=0x7f11f8009040 comp rx=0 tx=0).stop 2024-04-25T08:45:19.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 -- 172.21.15.172:0/973506588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120415f190 msgr2=0x7f12041f1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120415f190 0x7f12041f1d60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009f40 tx=0x7f11fc004a40 comp rx=0 tx=0).stop 2024-04-25T08:45:19.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 -- 172.21.15.172:0/973506588 shutdown_connections 2024-04-25T08:45:19.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f11e806b4d0 0x7f11e806d990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1204154fe0 0x7f12041f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f120415f190 0x7f12041f1d60 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 --2- 172.21.15.172:0/973506588 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12040b4b60 0x7f12041f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 -- 172.21.15.172:0/973506588 >> 172.21.15.172:0/973506588 conn(0x7f12040cfae0 msgr2=0x7f120415dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:19.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 -- 172.21.15.172:0/973506588 shutdown_connections 2024-04-25T08:45:19.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.421+0000 7f120af4c640 1 -- 172.21.15.172:0/973506588 wait complete. 2024-04-25T08:45:19.424 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:45:19.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.533+0000 7fbb54de7640 1 Processor -- start 2024-04-25T08:45:19.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.533+0000 7fbb54de7640 1 -- start start 2024-04-25T08:45:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.534+0000 7fbb54de7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb500ced80 0x7fbb500d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.534+0000 7fbb54de7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5015e000 con 0x7fbb5015dc20 2024-04-25T08:45:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.534+0000 7fbb54de7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb500d1de0 con 0x7fbb50161710 2024-04-25T08:45:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.534+0000 7fbb54de7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb50161c60 con 0x7fbb500ced80 2024-04-25T08:45:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.534+0000 7fbb4e59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbb5015dc20 0x7fbb500ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39332/0 (socket says 172.21.15.172:39332) 2024-04-25T08:45:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.534+0000 7fbb4e59c640 1 -- 172.21.15.172:0/2549616108 learned_addr learned my addr 172.21.15.172:0/2549616108 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:19.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.534+0000 7fbb4dd9b640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb500ced80 0x7fbb500d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.534+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692152592 0 0) 0x7fbb5015e000 con 0x7fbb5015dc20 2024-04-25T08:45:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.534+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb38003520 con 0x7fbb5015dc20 2024-04-25T08:45:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.534+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1909990105 0 0) 0x7fbb38003520 con 0x7fbb5015dc20 2024-04-25T08:45:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb500ced80 msgr2=0x7fbb500d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb500ced80 0x7fbb500d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 >> v1:172.21.15.186:6789/0 conn(0x7fbb50161710 legacy=0x7fbb500d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50161f40 con 0x7fbb5015dc20 2024-04-25T08:45:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fbb40001670 con 0x7fbb5015dc20 2024-04-25T08:45:19.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 >> v1:172.21.15.172:6789/0 conn(0x7fbb5015dc20 legacy=0x7fbb500ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb500ced80 0x7fbb380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb38003f60 0x7fbb38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb38004d40 0x7fbb380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb50161c60 con 0x7fbb38004d40 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3800baa0 con 0x7fbb38003f60 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3800bca0 con 0x7fbb500ced80 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4ed9d640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb38004d40 0x7fbb380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4dd9b640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb38003f60 0x7fbb38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4e59c640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb500ced80 0x7fbb380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4ed9d640 1 -- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb500ced80 msgr2=0x7fbb380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4ed9d640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb500ced80 0x7fbb380039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4ed9d640 1 -- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb38003f60 msgr2=0x7fbb38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:19.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4ed9d640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb38003f60 0x7fbb38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.535+0000 7fbb4ed9d640 1 -- 172.21.15.172:0/2549616108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38003520 con 0x7fbb38004d40 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.536+0000 7fbb4ed9d640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb38004d40 0x7fbb380051c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbb48001e50 tx=0x7fbb38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8873836f0da82298 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.536+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48001a70 con 0x7fbb38004d40 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.536+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb48003970 con 0x7fbb38004d40 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.536+0000 7fbb4d59a640 1 -- 172.21.15.172:0/2549616108 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48003d60 con 0x7fbb38004d40 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.536+0000 7fbb54de7640 1 -- 172.21.15.172:0/2549616108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb38004d40 msgr2=0x7fbb380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.536+0000 7fbb54de7640 1 --2- 172.21.15.172:0/2549616108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb38004d40 0x7fbb380051c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbb48001e50 tx=0x7fbb38005830 comp rx=0 tx=0).stop 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.536+0000 7fbb4ed9d640 1 -- 172.21.15.172:0/2549616108 reap_dead start 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.537+0000 7fbb54de7640 1 -- 172.21.15.172:0/2549616108 shutdown_connections 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.537+0000 7fbb54de7640 1 -- 172.21.15.172:0/2549616108 >> 172.21.15.172:0/2549616108 conn(0x7fbb500d0420 msgr2=0x7fbb500d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.537+0000 7fbb54de7640 1 -- 172.21.15.172:0/2549616108 shutdown_connections 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.537+0000 7fbb54de7640 1 -- 172.21.15.172:0/2549616108 wait complete. 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.538+0000 7fbb54de7640 1 Processor -- start 2024-04-25T08:45:19.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.538+0000 7fbb54de7640 1 -- start start 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb54de7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb38004d40 0x7fbb5015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb54de7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb500ce330 0x7fbb501604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb54de7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb50160a00 0x7fbb500cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb54de7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500b5e50 con 0x7fbb50160a00 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb54de7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb50162500 con 0x7fbb500ce330 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb54de7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500b5fd0 con 0x7fbb38004d40 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb50160a00 0x7fbb500cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb50160a00 0x7fbb500cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47592/0 (socket says 172.21.15.172:47592) 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4ed9d640 1 -- 172.21.15.172:0/3204412114 learned_addr learned my addr 172.21.15.172:0/3204412114 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4e59c640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb38004d40 0x7fbb5015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4dd9b640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb500ce330 0x7fbb501604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4ed9d640 1 -- 172.21.15.172:0/3204412114 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb38004d40 msgr2=0x7fbb5015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4ed9d640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb38004d40 0x7fbb5015afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4ed9d640 1 -- 172.21.15.172:0/3204412114 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb500ce330 msgr2=0x7fbb501604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4ed9d640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb500ce330 0x7fbb501604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4ed9d640 1 -- 172.21.15.172:0/3204412114 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb500ce7b0 con 0x7fbb50160a00 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb4ed9d640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb50160a00 0x7fbb500cbac0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbb4802a920 tx=0x7fbb480014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb3effd640 1 -- 172.21.15.172:0/3204412114 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48007db0 con 0x7fbb50160a00 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb3effd640 1 -- 172.21.15.172:0/3204412114 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb48040070 con 0x7fbb50160a00 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb54de7640 1 -- 172.21.15.172:0/3204412114 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb501f7f10 con 0x7fbb50160a00 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb3effd640 1 -- 172.21.15.172:0/3204412114 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48001a70 con 0x7fbb50160a00 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.539+0000 7fbb54de7640 1 -- 172.21.15.172:0/3204412114 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb500cded0 con 0x7fbb50160a00 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.540+0000 7fbb54de7640 1 -- 172.21.15.172:0/3204412114 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb50073a00 con 0x7fbb50160a00 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.541+0000 7fbb3effd640 1 -- 172.21.15.172:0/3204412114 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbb4803a070 con 0x7fbb50160a00 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.541+0000 7fbb3effd640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb3006b4d0 0x7fbb3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.541+0000 7fbb4e59c640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb3006b4d0 0x7fbb3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.541+0000 7fbb3effd640 1 -- 172.21.15.172:0/3204412114 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbb480a9ac0 con 0x7fbb50160a00 2024-04-25T08:45:19.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.542+0000 7fbb4e59c640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb3006b4d0 0x7fbb3006d990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbb40001050 tx=0x7fbb40000f80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:19.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.546+0000 7fbb3effd640 1 -- 172.21.15.172:0/3204412114 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb480781f0 con 0x7fbb50160a00 2024-04-25T08:45:19.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:19.751+0000 7fbb54de7640 1 -- 172.21.15.172:0/3204412114 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbb500b66b0 con 0x7fbb50160a00 2024-04-25T08:45:20.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.253+0000 7fbb3effd640 1 -- 172.21.15.172:0/3204412114 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbb4807e020 con 0x7fbb50160a00 2024-04-25T08:45:20.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 -- 172.21.15.172:0/3204412114 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb3006b4d0 msgr2=0x7fbb3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:20.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb3006b4d0 0x7fbb3006d990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbb40001050 tx=0x7fbb40000f80 comp rx=0 tx=0).stop 2024-04-25T08:45:20.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 -- 172.21.15.172:0/3204412114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb50160a00 msgr2=0x7fbb500cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:20.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb50160a00 0x7fbb500cbac0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbb4802a920 tx=0x7fbb480014a0 comp rx=0 tx=0).stop 2024-04-25T08:45:20.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 -- 172.21.15.172:0/3204412114 shutdown_connections 2024-04-25T08:45:20.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb3006b4d0 0x7fbb3006d990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:20.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbb500ce330 0x7fbb501604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:20.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb50160a00 0x7fbb500cbac0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:20.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 --2- 172.21.15.172:0/3204412114 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbb38004d40 0x7fbb5015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:20.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 -- 172.21.15.172:0/3204412114 >> 172.21.15.172:0/3204412114 conn(0x7fbb500d0420 msgr2=0x7fbb500b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:20.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 -- 172.21.15.172:0/3204412114 shutdown_connections 2024-04-25T08:45:20.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.255+0000 7fbb54de7640 1 -- 172.21.15.172:0/3204412114 wait complete. 2024-04-25T08:45:20.259 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:45:20.259 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:45:20.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.369+0000 7f22c21e0640 1 Processor -- start 2024-04-25T08:45:20.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.369+0000 7f22c21e0640 1 -- start start 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22c21e0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f22bc06b2f0 0x7f22bc0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22c21e0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f22bc15c970 0x7f22bc15d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22c21e0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc15cde0 con 0x7f22bc1454a0 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22c21e0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc0af540 con 0x7f22bc15c970 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22c21e0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc0af820 con 0x7f22bc06b2f0 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22bbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f22bc15c970 0x7f22bc15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22bb7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f22bc1454a0 0x7f22bc06abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39342/0 (socket says 172.21.15.172:39342) 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22bb7fe640 1 -- 172.21.15.172:0/3767600299 learned_addr learned my addr 172.21.15.172:0/3767600299 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22baffd640 1 --2- 172.21.15.172:0/3767600299 >> v2:172.21.15.186:3300/0 conn(0x7f22bc06b2f0 0x7f22bc0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22bbfff640 1 -- 172.21.15.172:0/3767600299 >> v2:172.21.15.186:3300/0 conn(0x7f22bc06b2f0 msgr2=0x7f22bc0aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22bbfff640 1 --2- 172.21.15.172:0/3767600299 >> v2:172.21.15.186:3300/0 conn(0x7f22bc06b2f0 0x7f22bc0aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22ba7fc640 1 -- 172.21.15.172:0/3767600299 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404385225 0 0) 0x7f22bc15cde0 con 0x7f22bc1454a0 2024-04-25T08:45:20.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22bbfff640 1 -- 172.21.15.172:0/3767600299 >> v1:172.21.15.172:6789/0 conn(0x7f22bc1454a0 legacy=0x7f22bc06abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:20.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22bbfff640 1 -- 172.21.15.172:0/3767600299 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0afb00 con 0x7f22bc15c970 2024-04-25T08:45:20.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.370+0000 7f22baffd640 1 --2- 172.21.15.172:0/3767600299 >> v2:172.21.15.186:3300/0 conn(0x7f22bc06b2f0 0x7f22bc0aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:20.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.371+0000 7f22bbfff640 1 --2- 172.21.15.172:0/3767600299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc15c970 0x7f22bc15d490 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f22bc06d800 tx=0x7f22b402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1aba7aab29474d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:20.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.371+0000 7f22ba7fc640 1 -- 172.21.15.172:0/3767600299 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4007740 con 0x7f22bc15c970 2024-04-25T08:45:20.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.371+0000 7f22ba7fc640 1 -- 172.21.15.172:0/3767600299 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b40078e0 con 0x7f22bc15c970 2024-04-25T08:45:20.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.371+0000 7f22ba7fc640 1 -- 172.21.15.172:0/3767600299 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4007cb0 con 0x7f22bc15c970 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.371+0000 7f22c21e0640 1 -- 172.21.15.172:0/3767600299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc15c970 msgr2=0x7f22bc15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.372+0000 7f22c21e0640 1 --2- 172.21.15.172:0/3767600299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc15c970 0x7f22bc15d490 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f22bc06d800 tx=0x7f22b402a680 comp rx=0 tx=0).stop 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.372+0000 7f22c21e0640 1 -- 172.21.15.172:0/3767600299 shutdown_connections 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.372+0000 7f22c21e0640 1 --2- 172.21.15.172:0/3767600299 >> v2:172.21.15.186:3300/0 conn(0x7f22bc06b2f0 0x7f22bc0aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.372+0000 7f22c21e0640 1 --2- 172.21.15.172:0/3767600299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc15c970 0x7f22bc15d490 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.372+0000 7f22c21e0640 1 -- 172.21.15.172:0/3767600299 >> 172.21.15.172:0/3767600299 conn(0x7f22bc0b5af0 msgr2=0x7f22bc0b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.372+0000 7f22c21e0640 1 -- 172.21.15.172:0/3767600299 shutdown_connections 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.372+0000 7f22c21e0640 1 -- 172.21.15.172:0/3767600299 wait complete. 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.373+0000 7f22c21e0640 1 Processor -- start 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.373+0000 7f22c21e0640 1 -- start start 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22c21e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22bc06b2f0 0x7f22bc09e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:20.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22c21e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc1454a0 0x7f22bc09c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22c21e0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc15c970 0x7f22bc1f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22c21e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc15db50 con 0x7f22bc1454a0 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22c21e0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc15d9d0 con 0x7f22bc15c970 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22c21e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc15dcd0 con 0x7f22bc06b2f0 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22baffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc1454a0 0x7f22bc09c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22baffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc1454a0 0x7f22bc09c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47612/0 (socket says 172.21.15.172:47612) 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22baffd640 1 -- 172.21.15.172:0/3781148898 learned_addr learned my addr 172.21.15.172:0/3781148898 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22bbfff640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc15c970 0x7f22bc1f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22baffd640 1 -- 172.21.15.172:0/3781148898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22bc06b2f0 msgr2=0x7f22bc09e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22baffd640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22bc06b2f0 0x7f22bc09e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22baffd640 1 -- 172.21.15.172:0/3781148898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc15c970 msgr2=0x7f22bc1f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22baffd640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc15c970 0x7f22bc1f4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22baffd640 1 -- 172.21.15.172:0/3781148898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc09c880 con 0x7f22bc1454a0 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22baffd640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc1454a0 0x7f22bc09c050 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f22b000c7f0 tx=0x7f22b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:20.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22a3fff640 1 -- 172.21.15.172:0/3781148898 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0015070 con 0x7f22bc1454a0 2024-04-25T08:45:20.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22a3fff640 1 -- 172.21.15.172:0/3781148898 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b0007a30 con 0x7f22bc1454a0 2024-04-25T08:45:20.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22c21e0640 1 -- 172.21.15.172:0/3781148898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc09cb60 con 0x7f22bc1454a0 2024-04-25T08:45:20.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22a3fff640 1 -- 172.21.15.172:0/3781148898 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0007e00 con 0x7f22bc1454a0 2024-04-25T08:45:20.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.374+0000 7f22c21e0640 1 -- 172.21.15.172:0/3781148898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc09d120 con 0x7f22bc1454a0 2024-04-25T08:45:20.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.375+0000 7f22c21e0640 1 -- 172.21.15.172:0/3781148898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc073a00 con 0x7f22bc1454a0 2024-04-25T08:45:20.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.376+0000 7f22a3fff640 1 -- 172.21.15.172:0/3781148898 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f22b0018070 con 0x7f22bc1454a0 2024-04-25T08:45:20.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.376+0000 7f22a3fff640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f22a806b4d0 0x7f22a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:20.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.376+0000 7f22a3fff640 1 -- 172.21.15.172:0/3781148898 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f22b008a2b0 con 0x7f22bc1454a0 2024-04-25T08:45:20.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.376+0000 7f22bb7fe640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f22a806b4d0 0x7f22a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:20.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.376+0000 7f22bb7fe640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f22a806b4d0 0x7f22a806d990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f22ac007fd0 tx=0x7f22ac007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:20.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.380+0000 7f22a3fff640 1 -- 172.21.15.172:0/3781148898 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f22b0059030 con 0x7f22bc1454a0 2024-04-25T08:45:20.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:20.587+0000 7f22c21e0640 1 -- 172.21.15.172:0/3781148898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f22bc0b5490 con 0x7f22bc1454a0 2024-04-25T08:45:21.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.258+0000 7f22a3fff640 1 -- 172.21.15.172:0/3781148898 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f22b0058930 con 0x7f22bc1454a0 2024-04-25T08:45:21.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.260+0000 7f22c21e0640 1 -- 172.21.15.172:0/3781148898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f22a806b4d0 msgr2=0x7f22a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.260+0000 7f22c21e0640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f22a806b4d0 0x7f22a806d990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f22ac007fd0 tx=0x7f22ac007920 comp rx=0 tx=0).stop 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.260+0000 7f22c21e0640 1 -- 172.21.15.172:0/3781148898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc1454a0 msgr2=0x7f22bc09c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.260+0000 7f22c21e0640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc1454a0 0x7f22bc09c050 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f22b000c7f0 tx=0x7f22b000cbf0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.260+0000 7f22c21e0640 1 -- 172.21.15.172:0/3781148898 shutdown_connections 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.261+0000 7f22c21e0640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f22a806b4d0 0x7f22a806d990 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.261+0000 7f22c21e0640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22bc15c970 0x7f22bc1f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.261+0000 7f22c21e0640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22bc1454a0 0x7f22bc09c050 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.261+0000 7f22c21e0640 1 --2- 172.21.15.172:0/3781148898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22bc06b2f0 0x7f22bc09e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.261+0000 7f22c21e0640 1 -- 172.21.15.172:0/3781148898 >> 172.21.15.172:0/3781148898 conn(0x7f22bc0b5af0 msgr2=0x7f22bc15f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.261+0000 7f22c21e0640 1 -- 172.21.15.172:0/3781148898 shutdown_connections 2024-04-25T08:45:21.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.261+0000 7f22c21e0640 1 -- 172.21.15.172:0/3781148898 wait complete. 2024-04-25T08:45:21.266 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:45:21.266 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:21.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.375+0000 7f27567f4640 1 Processor -- start 2024-04-25T08:45:21.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.375+0000 7f27567f4640 1 -- start start 2024-04-25T08:45:21.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.376+0000 7f27567f4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f275013d190 0x7f27500cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.376+0000 7f27567f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 0x7f27500cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.376+0000 7f27567f4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2750071ed0 con 0x7f2750071230 2024-04-25T08:45:21.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.376+0000 7f27567f4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275013d570 con 0x7f275013d190 2024-04-25T08:45:21.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.376+0000 7f27567f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275015a840 con 0x7f275015b320 2024-04-25T08:45:21.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.376+0000 7f274ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f275013d190 0x7f27500cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.376+0000 7f2754d91640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2750071230 0x7f27500716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39344/0 (socket says 172.21.15.172:39344) 2024-04-25T08:45:21.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.376+0000 7f274ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f275013d190 0x7f27500cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47618/0 (socket says 172.21.15.172:47618) 2024-04-25T08:45:21.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.376+0000 7f2754d91640 1 -- 172.21.15.172:0/2194457431 learned_addr learned my addr 172.21.15.172:0/2194457431 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.376+0000 7f274f7fe640 1 --2- 172.21.15.172:0/2194457431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 0x7f27500cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.377+0000 7f274ffff640 1 -- 172.21.15.172:0/2194457431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 msgr2=0x7f27500cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.377+0000 7f274ffff640 1 --2- 172.21.15.172:0/2194457431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 0x7f27500cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.377+0000 7f274ffff640 1 -- 172.21.15.172:0/2194457431 >> v1:172.21.15.172:6789/0 conn(0x7f2750071230 legacy=0x7f27500716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.377+0000 7f274ffff640 1 -- 172.21.15.172:0/2194457431 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275015ab20 con 0x7f275013d190 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.377+0000 7f274effd640 1 -- 172.21.15.172:0/2194457431 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431683366 0 0) 0x7f2750071ed0 con 0x7f2750071230 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.377+0000 7f274f7fe640 1 --2- 172.21.15.172:0/2194457431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 0x7f27500cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.377+0000 7f274ffff640 1 --2- 172.21.15.172:0/2194457431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 0x7f27500cbfb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f27400097a0 tx=0x7f274002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569219b3c963e96e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.377+0000 7f274effd640 1 -- 172.21.15.172:0/2194457431 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740037070 con 0x7f275013d190 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.377+0000 7f274effd640 1 -- 172.21.15.172:0/2194457431 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274002ae50 con 0x7f275013d190 2024-04-25T08:45:21.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.377+0000 7f274effd640 1 -- 172.21.15.172:0/2194457431 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740032660 con 0x7f275013d190 2024-04-25T08:45:21.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.378+0000 7f27567f4640 1 -- 172.21.15.172:0/2194457431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 msgr2=0x7f27500cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.378+0000 7f27567f4640 1 --2- 172.21.15.172:0/2194457431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 0x7f27500cbfb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f27400097a0 tx=0x7f274002a100 comp rx=0 tx=0).stop 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.378+0000 7f27567f4640 1 -- 172.21.15.172:0/2194457431 shutdown_connections 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.378+0000 7f27567f4640 1 --2- 172.21.15.172:0/2194457431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 0x7f27500cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.378+0000 7f27567f4640 1 --2- 172.21.15.172:0/2194457431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 0x7f27500cbfb0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.378+0000 7f27567f4640 1 -- 172.21.15.172:0/2194457431 >> 172.21.15.172:0/2194457431 conn(0x7f275006abe0 msgr2=0x7f275006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.378+0000 7f27567f4640 1 -- 172.21.15.172:0/2194457431 shutdown_connections 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.378+0000 7f27567f4640 1 -- 172.21.15.172:0/2194457431 wait complete. 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.379+0000 7f27567f4640 1 Processor -- start 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.379+0000 7f27567f4640 1 -- start start 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f27567f4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2750071230 0x7f2750157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f27567f4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 0x7f275006d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f27567f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 0x7f275006db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f27567f4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500cf7a0 con 0x7f275013d190 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f27567f4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500cf620 con 0x7f2750071230 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f27567f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27500cf920 con 0x7f275015b320 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f274f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 0x7f275006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f274f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 0x7f275006d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47622/0 (socket says 172.21.15.172:47622) 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f274f7fe640 1 -- 172.21.15.172:0/1370065953 learned_addr learned my addr 172.21.15.172:0/1370065953 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f2754d91640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 0x7f275006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f274f7fe640 1 -- 172.21.15.172:0/1370065953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 msgr2=0x7f275006db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f274ffff640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2750071230 0x7f2750157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f274f7fe640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 0x7f275006db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f274f7fe640 1 -- 172.21.15.172:0/1370065953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2750071230 msgr2=0x7f2750157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f274f7fe640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2750071230 0x7f2750157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.380+0000 7f274f7fe640 1 -- 172.21.15.172:0/1370065953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750135670 con 0x7f275013d190 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.381+0000 7f274ffff640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2750071230 0x7f2750157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.381+0000 7f2754d91640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 0x7f275006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.381+0000 7f274f7fe640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 0x7f275006d650 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f274400c7f0 tx=0x7f274400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.381+0000 7f274cff9640 1 -- 172.21.15.172:0/1370065953 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744015070 con 0x7f275013d190 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.381+0000 7f274cff9640 1 -- 172.21.15.172:0/1370065953 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2744007820 con 0x7f275013d190 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.381+0000 7f27567f4640 1 -- 172.21.15.172:0/1370065953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2750131ac0 con 0x7f275013d190 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.381+0000 7f274cff9640 1 -- 172.21.15.172:0/1370065953 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744007c10 con 0x7f275013d190 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.381+0000 7f27567f4640 1 -- 172.21.15.172:0/1370065953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2750132080 con 0x7f275013d190 2024-04-25T08:45:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.382+0000 7f27567f4640 1 -- 172.21.15.172:0/1370065953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2750073990 con 0x7f275013d190 2024-04-25T08:45:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.382+0000 7f274cff9640 1 -- 172.21.15.172:0/1370065953 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2744018070 con 0x7f275013d190 2024-04-25T08:45:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.383+0000 7f274cff9640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f273c06b4d0 0x7f273c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.383+0000 7f274cff9640 1 -- 172.21.15.172:0/1370065953 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f274408a320 con 0x7f275013d190 2024-04-25T08:45:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.383+0000 7f274ffff640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f273c06b4d0 0x7f273c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.383+0000 7f274ffff640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f273c06b4d0 0x7f273c06d990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2740034000 tx=0x7f274002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:21.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.387+0000 7f274cff9640 1 -- 172.21.15.172:0/1370065953 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2744058f80 con 0x7f275013d190 2024-04-25T08:45:21.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.594+0000 7f27567f4640 1 -- 172.21.15.172:0/1370065953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27500cfeb0 con 0x7f275013d190 2024-04-25T08:45:21.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.594+0000 7f274cff9640 1 -- 172.21.15.172:0/1370065953 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f2744058880 con 0x7f275013d190 2024-04-25T08:45:21.586 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:21.586 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:20.588374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:21.587 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 23 2024-04-25T08:45:21.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 -- 172.21.15.172:0/1370065953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f273c06b4d0 msgr2=0x7f273c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f273c06b4d0 0x7f273c06d990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2740034000 tx=0x7f274002e000 comp rx=0 tx=0).stop 2024-04-25T08:45:21.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 -- 172.21.15.172:0/1370065953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 msgr2=0x7f275006d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 0x7f275006d650 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f274400c7f0 tx=0x7f274400ccb0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 -- 172.21.15.172:0/1370065953 shutdown_connections 2024-04-25T08:45:21.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f273c06b4d0 0x7f273c06d990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f275015b320 0x7f275006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f275013d190 0x7f275006d650 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 --2- 172.21.15.172:0/1370065953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2750071230 0x7f2750157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 -- 172.21.15.172:0/1370065953 >> 172.21.15.172:0/1370065953 conn(0x7f275006abe0 msgr2=0x7f2750159a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:21.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 -- 172.21.15.172:0/1370065953 shutdown_connections 2024-04-25T08:45:21.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.596+0000 7f27567f4640 1 -- 172.21.15.172:0/1370065953 wait complete. 2024-04-25T08:45:21.599 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:21.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.705+0000 7f867cb70640 1 Processor -- start 2024-04-25T08:45:21.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.705+0000 7f867cb70640 1 -- start start 2024-04-25T08:45:21.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f867cb70640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780d1f20 0x7f86781625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f867cb70640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780cce50 con 0x7f867815dc90 2024-04-25T08:45:21.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f867cb70640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8678161af0 con 0x7f86780cc8e0 2024-04-25T08:45:21.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f867cb70640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8678161dd0 con 0x7f86780d1f20 2024-04-25T08:45:21.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f867659c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f867815dc90 0x7f867815ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39360/0 (socket says 172.21.15.172:39360) 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f867659c640 1 -- 172.21.15.172:0/2781810225 learned_addr learned my addr 172.21.15.172:0/2781810225 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8676d9d640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780d1f20 0x7f86781625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393179219 0 0) 0x7f86780cce50 con 0x7f867815dc90 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8664003520 con 0x7f867815dc90 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4240209784 0 0) 0x7f8664003520 con 0x7f867815dc90 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780d1f20 msgr2=0x7f86781625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780d1f20 0x7f86781625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 >> v1:172.21.15.186:6789/0 conn(0x7f86780cc8e0 legacy=0x7f86780d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86781620b0 con 0x7f867815dc90 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f8668001670 con 0x7f867815dc90 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 >> v1:172.21.15.172:6789/0 conn(0x7f867815dc90 legacy=0x7f867815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86640039e0 0x7f8664003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780d1f20 0x7f8664004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 0x7f86640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8678161dd0 con 0x7f8664004d40 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866400baa0 con 0x7f86640039e0 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.706+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866400bca0 con 0x7f86780d1f20 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.707+0000 7f8676d9d640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 0x7f86640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.707+0000 7f867659c640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86640039e0 0x7f8664003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.707+0000 7f866ffff640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780d1f20 0x7f8664004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.707+0000 7f8676d9d640 1 -- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780d1f20 msgr2=0x7f8664004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.707+0000 7f8676d9d640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780d1f20 0x7f8664004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.707+0000 7f8676d9d640 1 -- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86640039e0 msgr2=0x7f8664003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.707+0000 7f8676d9d640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86640039e0 0x7f8664003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.707+0000 7f8676d9d640 1 -- 172.21.15.172:0/2781810225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664003520 con 0x7f8664004d40 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f8676d9d640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 0x7f86640051c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8670009f90 tx=0x7f8664005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410f7f61bcab0004 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670009c10 con 0x7f8664004d40 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670036070 con 0x7f8664004d40 2024-04-25T08:45:21.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f8675d9b640 1 -- 172.21.15.172:0/2781810225 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670031850 con 0x7f8664004d40 2024-04-25T08:45:21.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f867cb70640 1 -- 172.21.15.172:0/2781810225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 msgr2=0x7f86640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f867cb70640 1 --2- 172.21.15.172:0/2781810225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 0x7f86640051c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8670009f90 tx=0x7f8664005830 comp rx=0 tx=0).stop 2024-04-25T08:45:21.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f8676d9d640 1 -- 172.21.15.172:0/2781810225 reap_dead start 2024-04-25T08:45:21.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f867cb70640 1 -- 172.21.15.172:0/2781810225 shutdown_connections 2024-04-25T08:45:21.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f867cb70640 1 -- 172.21.15.172:0/2781810225 >> 172.21.15.172:0/2781810225 conn(0x7f867806f590 msgr2=0x7f867806f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:21.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f867cb70640 1 -- 172.21.15.172:0/2781810225 shutdown_connections 2024-04-25T08:45:21.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.708+0000 7f867cb70640 1 -- 172.21.15.172:0/2781810225 wait complete. 2024-04-25T08:45:21.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867cb70640 1 Processor -- start 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867cb70640 1 -- start start 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867cb70640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 0x7f86780c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867cb70640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780b5a20 0x7f86780b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867cb70640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86780b75c0 0x7f8678148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867cb70640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867815e1f0 con 0x7f8664004d40 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867cb70640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867815e070 con 0x7f86780b75c0 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867cb70640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86781625d0 con 0x7f86780b5a20 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 0x7f86780c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 0x7f86780c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47632/0 (socket says 172.21.15.172:47632) 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.710+0000 7f867659c640 1 -- 172.21.15.172:0/2270589486 learned_addr learned my addr 172.21.15.172:0/2270589486 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f866ffff640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780b5a20 0x7f86780b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f8676d9d640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86780b75c0 0x7f8678148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f867659c640 1 -- 172.21.15.172:0/2270589486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780b5a20 msgr2=0x7f86780b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f867659c640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780b5a20 0x7f86780b7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f867659c640 1 -- 172.21.15.172:0/2270589486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86780b75c0 msgr2=0x7f8678148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f867659c640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86780b75c0 0x7f8678148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f867659c640 1 -- 172.21.15.172:0/2270589486 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780b5fe0 con 0x7f8664004d40 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f867659c640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 0x7f86780c7520 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8668004f40 tx=0x7f86680074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f866effd640 1 -- 172.21.15.172:0/2270589486 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866800f7b0 con 0x7f8664004d40 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f866effd640 1 -- 172.21.15.172:0/2270589486 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8668018070 con 0x7f8664004d40 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f867cb70640 1 -- 172.21.15.172:0/2270589486 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86780b62c0 con 0x7f8664004d40 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f866effd640 1 -- 172.21.15.172:0/2270589486 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866800fbb0 con 0x7f8664004d40 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.711+0000 7f867cb70640 1 -- 172.21.15.172:0/2270589486 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86780b6880 con 0x7f8664004d40 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.712+0000 7f867cb70640 1 -- 172.21.15.172:0/2270589486 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8678073990 con 0x7f8664004d40 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.712+0000 7f866effd640 1 -- 172.21.15.172:0/2270589486 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f866800fd50 con 0x7f8664004d40 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.713+0000 7f866effd640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f865806b4d0 0x7f865806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.713+0000 7f866ffff640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f865806b4d0 0x7f865806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.713+0000 7f866effd640 1 -- 172.21.15.172:0/2270589486 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f866808a370 con 0x7f8664004d40 2024-04-25T08:45:21.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.713+0000 7f866ffff640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f865806b4d0 0x7f865806d990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f86780d0710 tx=0x7f8660009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:21.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.717+0000 7f866effd640 1 -- 172.21.15.172:0/2270589486 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8668059060 con 0x7f8664004d40 2024-04-25T08:45:21.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.888+0000 7f867cb70640 1 -- 172.21.15.172:0/2270589486 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f867806fe70 con 0x7f8664004d40 2024-04-25T08:45:21.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.889+0000 7f866effd640 1 -- 172.21.15.172:0/2270589486 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17002 (secure 0 0 0) 0x7f8668058960 con 0x7f8664004d40 2024-04-25T08:45:21.881 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:21.881 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":54,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:45:19.797206+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:45:16.357665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T08:45:17.104697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:21.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 -- 172.21.15.172:0/2270589486 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f865806b4d0 msgr2=0x7f865806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f865806b4d0 0x7f865806d990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f86780d0710 tx=0x7f8660009040 comp rx=0 tx=0).stop 2024-04-25T08:45:21.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 -- 172.21.15.172:0/2270589486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 msgr2=0x7f86780c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 0x7f86780c7520 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8668004f40 tx=0x7f86680074f0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 -- 172.21.15.172:0/2270589486 shutdown_connections 2024-04-25T08:45:21.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f865806b4d0 0x7f865806d990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86780b75c0 0x7f8678148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86780b5a20 0x7f86780b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 --2- 172.21.15.172:0/2270589486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8664004d40 0x7f86780c7520 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 -- 172.21.15.172:0/2270589486 >> 172.21.15.172:0/2270589486 conn(0x7f867806f590 msgr2=0x7f86780b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:21.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 -- 172.21.15.172:0/2270589486 shutdown_connections 2024-04-25T08:45:21.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:21.891+0000 7f867cb70640 1 -- 172.21.15.172:0/2270589486 wait complete. 2024-04-25T08:45:21.895 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:45:21.895 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:45:21.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.002+0000 7f0e518bc640 1 Processor -- start 2024-04-25T08:45:21.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.002+0000 7f0e518bc640 1 -- start start 2024-04-25T08:45:21.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e518bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e4c15dbe0 0x7f0e4c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e518bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0e4c0b92a0 0x7f0e4c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:21.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e518bc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c0b97a0 con 0x7f0e4c0b2cb0 2024-04-25T08:45:21.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e518bc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c15dfc0 con 0x7f0e4c0b92a0 2024-04-25T08:45:21.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e518bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0d1a00 con 0x7f0e4c15dbe0 2024-04-25T08:45:21.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e4b7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0e4c0b92a0 0x7f0e4c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:21.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e43fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0e4c0b2cb0 0x7f0e4c0b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39362/0 (socket says 172.21.15.172:39362) 2024-04-25T08:45:21.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e43fff640 1 -- 172.21.15.172:0/911540083 learned_addr learned my addr 172.21.15.172:0/911540083 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:21.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e4b7fe640 1 -- 172.21.15.172:0/911540083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e4c15dbe0 msgr2=0x7f0e4c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:21.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e4b7fe640 1 --2- 172.21.15.172:0/911540083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e4c15dbe0 0x7f0e4c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e4b7fe640 1 -- 172.21.15.172:0/911540083 >> v1:172.21.15.172:6789/0 conn(0x7f0e4c0b2cb0 legacy=0x7f0e4c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e4b7fe640 1 -- 172.21.15.172:0/911540083 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c0d1c50 con 0x7f0e4c0b92a0 2024-04-25T08:45:21.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.003+0000 7f0e4a7fc640 1 -- 172.21.15.172:0/911540083 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997168737 0 0) 0x7f0e4c0b97a0 con 0x7f0e4c0b2cb0 2024-04-25T08:45:21.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.004+0000 7f0e4b7fe640 1 --2- 172.21.15.172:0/911540083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b92a0 0x7f0e4c0d0e50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009d90 tx=0x7f0e4402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e84a621d396551 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:21.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.004+0000 7f0e4a7fc640 1 -- 172.21.15.172:0/911540083 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44007740 con 0x7f0e4c0b92a0 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.004+0000 7f0e4a7fc640 1 -- 172.21.15.172:0/911540083 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e440078e0 con 0x7f0e4c0b92a0 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.004+0000 7f0e4a7fc640 1 -- 172.21.15.172:0/911540083 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44007cb0 con 0x7f0e4c0b92a0 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.004+0000 7f0e518bc640 1 -- 172.21.15.172:0/911540083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b92a0 msgr2=0x7f0e4c0d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.004+0000 7f0e518bc640 1 --2- 172.21.15.172:0/911540083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b92a0 0x7f0e4c0d0e50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009d90 tx=0x7f0e4402a660 comp rx=0 tx=0).stop 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.004+0000 7f0e518bc640 1 -- 172.21.15.172:0/911540083 shutdown_connections 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.004+0000 7f0e518bc640 1 --2- 172.21.15.172:0/911540083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b92a0 0x7f0e4c0d0e50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.005+0000 7f0e518bc640 1 --2- 172.21.15.172:0/911540083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e4c15dbe0 0x7f0e4c0d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.005+0000 7f0e518bc640 1 -- 172.21.15.172:0/911540083 >> 172.21.15.172:0/911540083 conn(0x7f0e4c061a20 msgr2=0x7f0e4c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.005+0000 7f0e518bc640 1 -- 172.21.15.172:0/911540083 shutdown_connections 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.005+0000 7f0e518bc640 1 -- 172.21.15.172:0/911540083 wait complete. 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.006+0000 7f0e518bc640 1 Processor -- start 2024-04-25T08:45:21.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.006+0000 7f0e518bc640 1 -- start start 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.006+0000 7f0e518bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b2cb0 0x7f0e4c151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.006+0000 7f0e518bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e4c0b92a0 0x7f0e4c1f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.006+0000 7f0e518bc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e4c15dbe0 0x7f0e4c1f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.006+0000 7f0e518bc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0b6ab0 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.006+0000 7f0e518bc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0d2210 con 0x7f0e4c15dbe0 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.006+0000 7f0e518bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0b6c30 con 0x7f0e4c0b92a0 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.006+0000 7f0e4affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b2cb0 0x7f0e4c151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e4affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b2cb0 0x7f0e4c151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47656/0 (socket says 172.21.15.172:47656) 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e4affd640 1 -- 172.21.15.172:0/1187234432 learned_addr learned my addr 172.21.15.172:0/1187234432 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e43fff640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e4c0b92a0 0x7f0e4c1f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e4b7fe640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e4c15dbe0 0x7f0e4c1f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e4affd640 1 -- 172.21.15.172:0/1187234432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e4c0b92a0 msgr2=0x7f0e4c1f32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e4affd640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e4c0b92a0 0x7f0e4c1f32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e4affd640 1 -- 172.21.15.172:0/1187234432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e4c15dbe0 msgr2=0x7f0e4c1f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e4affd640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e4c15dbe0 0x7f0e4c1f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e4affd640 1 -- 172.21.15.172:0/1187234432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c1f4500 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e4b7fe640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e4c15dbe0 0x7f0e4c1f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e4affd640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b2cb0 0x7f0e4c151e90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00b410 tx=0x7f0e3c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e48ff9640 1 -- 172.21.15.172:0/1187234432 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c015020 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e48ff9640 1 -- 172.21.15.172:0/1187234432 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c011850 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e48ff9640 1 -- 172.21.15.172:0/1187234432 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c011c40 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e518bc640 1 -- 172.21.15.172:0/1187234432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c0cc2e0 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.007+0000 7f0e518bc640 1 -- 172.21.15.172:0/1187234432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c1f47a0 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.008+0000 7f0e518bc640 1 -- 172.21.15.172:0/1187234432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c073990 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.009+0000 7f0e48ff9640 1 -- 172.21.15.172:0/1187234432 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0e3c018020 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.009+0000 7f0e48ff9640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0e2c06b4d0 0x7f0e2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.009+0000 7f0e48ff9640 1 -- 172.21.15.172:0/1187234432 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0e3c08a250 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.009+0000 7f0e43fff640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0e2c06b4d0 0x7f0e2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.010+0000 7f0e43fff640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0e2c06b4d0 0x7f0e2c06d990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c158a00 tx=0x7f0e34007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:22.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.013+0000 7f0e48ff9640 1 -- 172.21.15.172:0/1187234432 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0e3c01f020 con 0x7f0e4c0b2cb0 2024-04-25T08:45:22.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.180+0000 7f0e518bc640 1 -- 172.21.15.172:0/1187234432 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e4c1523d0 con 0x7f0e2c06b4d0 2024-04-25T08:45:22.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.185+0000 7f0e48ff9640 1 -- 172.21.15.172:0/1187234432 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237205 (secure 0 0 0) 0x7f0e34004c70 con 0x7f0e2c06b4d0 2024-04-25T08:45:22.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:22.181 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 -- 172.21.15.172:0/1187234432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0e2c06b4d0 msgr2=0x7f0e2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0e2c06b4d0 0x7f0e2c06d990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c158a00 tx=0x7f0e34007d50 comp rx=0 tx=0).stop 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 -- 172.21.15.172:0/1187234432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b2cb0 msgr2=0x7f0e4c151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b2cb0 0x7f0e4c151e90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00b410 tx=0x7f0e3c00b8d0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 -- 172.21.15.172:0/1187234432 shutdown_connections 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0e2c06b4d0 0x7f0e2c06d990 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e4c15dbe0 0x7f0e4c1f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e4c0b92a0 0x7f0e4c1f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 --2- 172.21.15.172:0/1187234432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e4c0b2cb0 0x7f0e4c151e90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 -- 172.21.15.172:0/1187234432 >> 172.21.15.172:0/1187234432 conn(0x7f0e4c061a20 msgr2=0x7f0e4c0b72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 -- 172.21.15.172:0/1187234432 shutdown_connections 2024-04-25T08:45:22.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.188+0000 7f0e518bc640 1 -- 172.21.15.172:0/1187234432 wait complete. 2024-04-25T08:45:22.191 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-04-25T08:45:20.547226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":280184,"kb_used_data":5752,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754694536,"statfs":{"total":773094113280,"available":772807204864,"internally_reserved":0,"allocated":5890048,"data_stored":3258460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000774"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T08:45:16.143027+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:45:16.143027+0000","last_peered":"2024-04-25T08:45:16.143027+0000","last_clean":"2024-04-25T08:45:16.143027+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:45:16.143027+0000","last_undegraded":"2024-04-25T08:45:16.143027+0000","last_fullsized":"2024-04-25T08:45:16.143027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1175552,"data_stored":847324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":593920,"data_stored":262475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":262475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35920,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335920,"statfs":{"total":96636764160,"available":96599982080,"internally_reserved":0,"allocated":593920,"data_stored":262475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":593920,"data_stored":262475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35912,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335928,"statfs":{"total":96636764160,"available":96599990272,"internally_reserved":0,"allocated":581632,"data_stored":256956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35916,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":581632,"data_stored":256956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36488,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335352,"statfs":{"total":96636764160,"available":96599400448,"internally_reserved":0,"allocated":1175552,"data_stored":847324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:45:22.195 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:45:22.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.338+0000 7ff43ad29640 1 Processor -- start 2024-04-25T08:45:22.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.338+0000 7ff43ad29640 1 -- start start 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.338+0000 7ff43ad29640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff43415dd30 0x7ff4340b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.338+0000 7ff43ad29640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff4340b9770 0x7ff4340d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.338+0000 7ff43ad29640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4340d1df0 con 0x7ff4340d2e90 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.338+0000 7ff43ad29640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4340b7a50 con 0x7ff43415dd30 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.338+0000 7ff43ad29640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4340d20d0 con 0x7ff4340b9770 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.339+0000 7ff438ac5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff43415dd30 0x7ff4340b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.339+0000 7ff4392c6640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff4340d2e90 0x7ff4340b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39372/0 (socket says 172.21.15.172:39372) 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.339+0000 7ff4392c6640 1 -- 172.21.15.172:0/60193838 learned_addr learned my addr 172.21.15.172:0/60193838 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.339+0000 7ff433fff640 1 --2- 172.21.15.172:0/60193838 >> v2:172.21.15.186:3300/0 conn(0x7ff4340b9770 0x7ff4340d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.339+0000 7ff438ac5640 1 -- 172.21.15.172:0/60193838 >> v2:172.21.15.186:3300/0 conn(0x7ff4340b9770 msgr2=0x7ff4340d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.339+0000 7ff438ac5640 1 --2- 172.21.15.172:0/60193838 >> v2:172.21.15.186:3300/0 conn(0x7ff4340b9770 0x7ff4340d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.339+0000 7ff438ac5640 1 -- 172.21.15.172:0/60193838 >> v1:172.21.15.172:6789/0 conn(0x7ff4340d2e90 legacy=0x7ff4340b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.339+0000 7ff4337fe640 1 -- 172.21.15.172:0/60193838 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380790334 0 0) 0x7ff4340d1df0 con 0x7ff4340d2e90 2024-04-25T08:45:22.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.339+0000 7ff438ac5640 1 -- 172.21.15.172:0/60193838 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4340d23b0 con 0x7ff43415dd30 2024-04-25T08:45:22.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.339+0000 7ff433fff640 1 --2- 172.21.15.172:0/60193838 >> v2:172.21.15.186:3300/0 conn(0x7ff4340b9770 0x7ff4340d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff438ac5640 1 --2- 172.21.15.172:0/60193838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43415dd30 0x7ff4340b9230 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff4340b6540 tx=0x7ff42c02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4971a42a61de515 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff4337fe640 1 -- 172.21.15.172:0/60193838 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c007740 con 0x7ff43415dd30 2024-04-25T08:45:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff4337fe640 1 -- 172.21.15.172:0/60193838 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c0078e0 con 0x7ff43415dd30 2024-04-25T08:45:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff4337fe640 1 -- 172.21.15.172:0/60193838 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c007cb0 con 0x7ff43415dd30 2024-04-25T08:45:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff43ad29640 1 -- 172.21.15.172:0/60193838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43415dd30 msgr2=0x7ff4340b9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff43ad29640 1 --2- 172.21.15.172:0/60193838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43415dd30 0x7ff4340b9230 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff4340b6540 tx=0x7ff42c02a560 comp rx=0 tx=0).stop 2024-04-25T08:45:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff43ad29640 1 -- 172.21.15.172:0/60193838 shutdown_connections 2024-04-25T08:45:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff43ad29640 1 --2- 172.21.15.172:0/60193838 >> v2:172.21.15.186:3300/0 conn(0x7ff4340b9770 0x7ff4340d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff43ad29640 1 --2- 172.21.15.172:0/60193838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43415dd30 0x7ff4340b9230 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff43ad29640 1 -- 172.21.15.172:0/60193838 >> 172.21.15.172:0/60193838 conn(0x7ff434061c30 msgr2=0x7ff43406c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff43ad29640 1 -- 172.21.15.172:0/60193838 shutdown_connections 2024-04-25T08:45:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.340+0000 7ff43ad29640 1 -- 172.21.15.172:0/60193838 wait complete. 2024-04-25T08:45:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.341+0000 7ff43ad29640 1 Processor -- start 2024-04-25T08:45:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.342+0000 7ff43ad29640 1 -- start start 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.342+0000 7ff43ad29640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4340b9770 0x7ff4340b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.342+0000 7ff43ad29640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4340d2e90 0x7ff4341f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.342+0000 7ff43ad29640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff43415dd30 0x7ff4340aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.342+0000 7ff43ad29640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340d1a10 con 0x7ff4340b9770 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.342+0000 7ff43ad29640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340d2970 con 0x7ff43415dd30 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.342+0000 7ff43ad29640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340d1b90 con 0x7ff4340d2e90 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.342+0000 7ff438ac5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4340b9770 0x7ff4340b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.342+0000 7ff438ac5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4340b9770 0x7ff4340b5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47668/0 (socket says 172.21.15.172:47668) 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff438ac5640 1 -- 172.21.15.172:0/1253899027 learned_addr learned my addr 172.21.15.172:0/1253899027 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff4392c6640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff43415dd30 0x7ff4340aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff433fff640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4340d2e90 0x7ff4341f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff438ac5640 1 -- 172.21.15.172:0/1253899027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4340d2e90 msgr2=0x7ff4341f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff438ac5640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4340d2e90 0x7ff4341f45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff438ac5640 1 -- 172.21.15.172:0/1253899027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff43415dd30 msgr2=0x7ff4340aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff438ac5640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff43415dd30 0x7ff4340aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff438ac5640 1 -- 172.21.15.172:0/1253899027 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4340ab2f0 con 0x7ff4340b9770 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff4392c6640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff43415dd30 0x7ff4340aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff438ac5640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4340b9770 0x7ff4340b5ca0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009e80 tx=0x7ff42c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff4317fa640 1 -- 172.21.15.172:0/1253899027 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c03f070 con 0x7ff4340b9770 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff4317fa640 1 -- 172.21.15.172:0/1253899027 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c031c40 con 0x7ff4340b9770 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff43ad29640 1 -- 172.21.15.172:0/1253899027 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4340b3160 con 0x7ff4340b9770 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff4317fa640 1 -- 172.21.15.172:0/1253899027 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c043410 con 0x7ff4340b9770 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.343+0000 7ff43ad29640 1 -- 172.21.15.172:0/1253899027 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4340b3720 con 0x7ff4340b9770 2024-04-25T08:45:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.344+0000 7ff43ad29640 1 -- 172.21.15.172:0/1253899027 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff434073990 con 0x7ff4340b9770 2024-04-25T08:45:22.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.345+0000 7ff4317fa640 1 -- 172.21.15.172:0/1253899027 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff42c0435b0 con 0x7ff4340b9770 2024-04-25T08:45:22.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.345+0000 7ff4317fa640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff41406b4d0 0x7ff41406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.345+0000 7ff4317fa640 1 -- 172.21.15.172:0/1253899027 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff42c0ab920 con 0x7ff4340b9770 2024-04-25T08:45:22.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.345+0000 7ff433fff640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff41406b4d0 0x7ff41406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.345+0000 7ff433fff640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff41406b4d0 0x7ff41406d990 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff41c006fd0 tx=0x7ff41c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:22.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.349+0000 7ff4317fa640 1 -- 172.21.15.172:0/1253899027 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff42c07a610 con 0x7ff4340b9770 2024-04-25T08:45:22.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.517+0000 7ff43ad29640 1 -- 172.21.15.172:0/1253899027 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4340b61f0 con 0x7ff41406b4d0 2024-04-25T08:45:22.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.522+0000 7ff4317fa640 1 -- 172.21.15.172:0/1253899027 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237205 (secure 0 0 0) 0x7ff4340b61f0 con 0x7ff41406b4d0 2024-04-25T08:45:22.516 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:22.517 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:45:22.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 -- 172.21.15.172:0/1253899027 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff41406b4d0 msgr2=0x7ff41406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff41406b4d0 0x7ff41406d990 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff41c006fd0 tx=0x7ff41c008040 comp rx=0 tx=0).stop 2024-04-25T08:45:22.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 -- 172.21.15.172:0/1253899027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4340b9770 msgr2=0x7ff4340b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4340b9770 0x7ff4340b5ca0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009e80 tx=0x7ff42c004a40 comp rx=0 tx=0).stop 2024-04-25T08:45:22.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 -- 172.21.15.172:0/1253899027 shutdown_connections 2024-04-25T08:45:22.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff41406b4d0 0x7ff41406d990 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff43415dd30 0x7ff4340aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4340d2e90 0x7ff4341f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 --2- 172.21.15.172:0/1253899027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4340b9770 0x7ff4340b5ca0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 -- 172.21.15.172:0/1253899027 >> 172.21.15.172:0/1253899027 conn(0x7ff434061c30 msgr2=0x7ff4340d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:22.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 -- 172.21.15.172:0/1253899027 shutdown_connections 2024-04-25T08:45:22.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.525+0000 7ff43ad29640 1 -- 172.21.15.172:0/1253899027 wait complete. 2024-04-25T08:45:22.528 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-04-25T08:45:20.547226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":280184,"kb_used_data":5752,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754694536,"statfs":{"total":773094113280,"available":772807204864,"internally_reserved":0,"allocated":5890048,"data_stored":3258460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000774"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:17.784010+0000","last_change":"2024-04-25T08:45:17.784010+0000","last_active":"2024-04-25T08:45:17.784010+0000","last_peered":"2024-04-25T08:45:17.784010+0000","last_clean":"2024-04-25T08:45:17.784010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:17.784010+0000","last_undegraded":"2024-04-25T08:45:17.784010+0000","last_fullsized":"2024-04-25T08:45:17.784010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:45:16.777414+0000","last_change":"2024-04-25T08:45:16.777414+0000","last_active":"2024-04-25T08:45:16.777414+0000","last_peered":"2024-04-25T08:45:16.777414+0000","last_clean":"2024-04-25T08:45:16.777414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:45:16.777414+0000","last_undegraded":"2024-04-25T08:45:16.777414+0000","last_fullsized":"2024-04-25T08:45:16.777414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-25T08:45:16.143027+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:45:16.143027+0000","last_peered":"2024-04-25T08:45:16.143027+0000","last_clean":"2024-04-25T08:45:16.143027+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:45:16.143027+0000","last_undegraded":"2024-04-25T08:45:16.143027+0000","last_fullsized":"2024-04-25T08:45:16.143027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1175552,"data_stored":847324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":593920,"data_stored":262475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":262475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35920,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335920,"statfs":{"total":96636764160,"available":96599982080,"internally_reserved":0,"allocated":593920,"data_stored":262475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35928,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335912,"statfs":{"total":96636764160,"available":96599973888,"internally_reserved":0,"allocated":593920,"data_stored":262475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35912,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335928,"statfs":{"total":96636764160,"available":96599990272,"internally_reserved":0,"allocated":581632,"data_stored":256956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35916,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":581632,"data_stored":256956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36488,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335352,"statfs":{"total":96636764160,"available":96599400448,"internally_reserved":0,"allocated":1175552,"data_stored":847324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:45:22.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:45:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.675+0000 7f6ae518b640 1 Processor -- start 2024-04-25T08:45:22.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.675+0000 7f6ae518b640 1 -- start start 2024-04-25T08:45:22.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6ae518b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6ae015dbe0 0x7f6ae00d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6ae518b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 0x7f6ae00d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6ae518b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae00b97a0 con 0x7f6ae00b92a0 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6ae518b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae015dfc0 con 0x7f6ae015dbe0 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6ae518b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00d1a00 con 0x7f6ae00b2cb0 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6ade59c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 0x7f6ae00d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6aded9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6ae015dbe0 0x7f6ae00d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6aded9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6ae015dbe0 0x7f6ae00d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:38660/0 (socket says 172.21.15.172:38660) 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6adf59e640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f6ae00b92a0 0x7f6ae00b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:46888/0 (socket says 172.21.15.172:46888) 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6ade59c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 0x7f6ae00d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:57920/0 (socket says 172.21.15.172:57920) 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.676+0000 7f6aded9d640 1 -- 172.21.15.172:0/3976814105 learned_addr learned my addr 172.21.15.172:0/3976814105 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.677+0000 7f6aded9d640 1 -- 172.21.15.172:0/3976814105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 msgr2=0x7f6ae00d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:22.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.677+0000 7f6aded9d640 1 --2- 172.21.15.172:0/3976814105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 0x7f6ae00d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.677+0000 7f6aded9d640 1 -- 172.21.15.172:0/3976814105 >> v1:172.21.15.186:6789/0 conn(0x7f6ae00b92a0 legacy=0x7f6ae00b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.677+0000 7f6aded9d640 1 -- 172.21.15.172:0/3976814105 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00d1c50 con 0x7f6ae015dbe0 2024-04-25T08:45:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.677+0000 7f6addd9b640 1 -- 172.21.15.172:0/3976814105 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431833402 0 0) 0x7f6ae00b97a0 con 0x7f6ae00b92a0 2024-04-25T08:45:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.677+0000 7f6ade59c640 1 --2- 172.21.15.172:0/3976814105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 0x7f6ae00d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:22.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.677+0000 7f6aded9d640 1 --2- 172.21.15.172:0/3976814105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ae015dbe0 0x7f6ae00d0910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009e50 tx=0x7f6ad002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed016e17bdc39e89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:22.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6addd9b640 1 -- 172.21.15.172:0/3976814105 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0036070 con 0x7f6ae015dbe0 2024-04-25T08:45:22.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6addd9b640 1 -- 172.21.15.172:0/3976814105 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0031600 con 0x7f6ae015dbe0 2024-04-25T08:45:22.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6addd9b640 1 -- 172.21.15.172:0/3976814105 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00319d0 con 0x7f6ae015dbe0 2024-04-25T08:45:22.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6ae518b640 1 -- 172.21.15.172:0/3976814105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ae015dbe0 msgr2=0x7f6ae00d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6ae518b640 1 --2- 172.21.15.172:0/3976814105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ae015dbe0 0x7f6ae00d0910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009e50 tx=0x7f6ad002a710 comp rx=0 tx=0).stop 2024-04-25T08:45:22.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6ae518b640 1 -- 172.21.15.172:0/3976814105 shutdown_connections 2024-04-25T08:45:22.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6ae518b640 1 --2- 172.21.15.172:0/3976814105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 0x7f6ae00d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6ae518b640 1 --2- 172.21.15.172:0/3976814105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ae015dbe0 0x7f6ae00d0910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6ae518b640 1 -- 172.21.15.172:0/3976814105 >> 172.21.15.172:0/3976814105 conn(0x7f6ae0061a20 msgr2=0x7f6ae0061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:22.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6ae518b640 1 -- 172.21.15.172:0/3976814105 shutdown_connections 2024-04-25T08:45:22.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.678+0000 7f6ae518b640 1 -- 172.21.15.172:0/3976814105 wait complete. 2024-04-25T08:45:22.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.680+0000 7f6ae518b640 1 Processor -- start 2024-04-25T08:45:22.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.680+0000 7f6ae518b640 1 -- start start 2024-04-25T08:45:22.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.680+0000 7f6ae518b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 0x7f6ae0154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.680+0000 7f6ae518b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae00b92a0 0x7f6ae00caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.680+0000 7f6ae518b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ae015dbe0 0x7f6ae00c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ae518b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00b6ab0 con 0x7f6ae00b92a0 2024-04-25T08:45:22.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ae518b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00d2210 con 0x7f6ae015dbe0 2024-04-25T08:45:22.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ae518b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00b6c30 con 0x7f6ae00b2cb0 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ade59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae00b92a0 0x7f6ae00caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ade59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae00b92a0 0x7f6ae00caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47678/0 (socket says 172.21.15.172:47678) 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ade59c640 1 -- 172.21.15.172:0/1828500157 learned_addr learned my addr 172.21.15.172:0/1828500157 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6adf59e640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ae015dbe0 0x7f6ae00c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6aded9d640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 0x7f6ae0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ade59c640 1 -- 172.21.15.172:0/1828500157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 msgr2=0x7f6ae0154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ade59c640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 0x7f6ae0154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ade59c640 1 -- 172.21.15.172:0/1828500157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ae015dbe0 msgr2=0x7f6ae00c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ade59c640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ae015dbe0 0x7f6ae00c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ade59c640 1 -- 172.21.15.172:0/1828500157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00c9250 con 0x7f6ae00b92a0 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ade59c640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae00b92a0 0x7f6ae00caa50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400e960 tx=0x7f6ad400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ac77fe640 1 -- 172.21.15.172:0/1828500157 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4017070 con 0x7f6ae00b92a0 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ac77fe640 1 -- 172.21.15.172:0/1828500157 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400ca00 con 0x7f6ae00b92a0 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ac77fe640 1 -- 172.21.15.172:0/1828500157 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400cdd0 con 0x7f6ae00b92a0 2024-04-25T08:45:22.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ae518b640 1 -- 172.21.15.172:0/1828500157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae00ccf60 con 0x7f6ae00b92a0 2024-04-25T08:45:22.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.681+0000 7f6ae518b640 1 -- 172.21.15.172:0/1828500157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae00cd520 con 0x7f6ae00b92a0 2024-04-25T08:45:22.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.682+0000 7f6ae518b640 1 -- 172.21.15.172:0/1828500157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae0073990 con 0x7f6ae00b92a0 2024-04-25T08:45:22.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.683+0000 7f6ac77fe640 1 -- 172.21.15.172:0/1828500157 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6ad401a070 con 0x7f6ae00b92a0 2024-04-25T08:45:22.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.683+0000 7f6ac77fe640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6acc06b4d0 0x7f6acc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:22.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.683+0000 7f6ac77fe640 1 -- 172.21.15.172:0/1828500157 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6ad408a220 con 0x7f6ae00b92a0 2024-04-25T08:45:22.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.683+0000 7f6aded9d640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6acc06b4d0 0x7f6acc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:22.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.684+0000 7f6aded9d640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6acc06b4d0 0x7f6acc06d990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0033000 tx=0x7f6ad0009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:22.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.687+0000 7f6ac77fe640 1 -- 172.21.15.172:0/1828500157 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6ad4058840 con 0x7f6ae00b92a0 2024-04-25T08:45:22.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.854+0000 7f6ae518b640 1 -- 172.21.15.172:0/1828500157 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ae006b080 con 0x7f6acc06b4d0 2024-04-25T08:45:22.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.860+0000 7f6ac77fe640 1 -- 172.21.15.172:0/1828500157 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251937 (secure 0 0 0) 0x7f6ae006b080 con 0x7f6acc06b4d0 2024-04-25T08:45:22.854 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:22.855 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:45:22.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 -- 172.21.15.172:0/1828500157 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6acc06b4d0 msgr2=0x7f6acc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6acc06b4d0 0x7f6acc06d990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0033000 tx=0x7f6ad0009000 comp rx=0 tx=0).stop 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 -- 172.21.15.172:0/1828500157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae00b92a0 msgr2=0x7f6ae00caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae00b92a0 0x7f6ae00caa50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400e960 tx=0x7f6ad400ee20 comp rx=0 tx=0).stop 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 -- 172.21.15.172:0/1828500157 shutdown_connections 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6acc06b4d0 0x7f6acc06d990 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ae015dbe0 0x7f6ae00c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae00b92a0 0x7f6ae00caa50 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 --2- 172.21.15.172:0/1828500157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ae00b2cb0 0x7f6ae0154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 -- 172.21.15.172:0/1828500157 >> 172.21.15.172:0/1828500157 conn(0x7f6ae0061a20 msgr2=0x7f6ae015bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 -- 172.21.15.172:0/1828500157 shutdown_connections 2024-04-25T08:45:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:22.863+0000 7f6ae518b640 1 -- 172.21.15.172:0/1828500157 wait complete. 2024-04-25T08:45:22.866 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-04-25T08:45:22.547590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":280660,"kb_used_data":6212,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754694060,"statfs":{"total":773094113280,"available":772806717440,"internally_reserved":0,"allocated":6361088,"data_stored":3479160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.763143"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804833+0000","last_change":"2024-04-25T08:45:18.808381+0000","last_active":"2024-04-25T08:45:19.804833+0000","last_peered":"2024-04-25T08:45:19.804833+0000","last_clean":"2024-04-25T08:45:19.804833+0000","last_became_active":"2024-04-25T08:45:18.808133+0000","last_became_peered":"2024-04-25T08:45:18.808133+0000","last_unstale":"2024-04-25T08:45:19.804833+0000","last_undegraded":"2024-04-25T08:45:19.804833+0000","last_fullsized":"2024-04-25T08:45:19.804833+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:45.316373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.821007+0000","last_change":"2024-04-25T08:45:18.816452+0000","last_active":"2024-04-25T08:45:19.821007+0000","last_peered":"2024-04-25T08:45:19.821007+0000","last_clean":"2024-04-25T08:45:19.821007+0000","last_became_active":"2024-04-25T08:45:18.816182+0000","last_became_peered":"2024-04-25T08:45:18.816182+0000","last_unstale":"2024-04-25T08:45:19.821007+0000","last_undegraded":"2024-04-25T08:45:19.821007+0000","last_fullsized":"2024-04-25T08:45:19.821007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:06.045642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818416+0000","last_change":"2024-04-25T08:45:18.812932+0000","last_active":"2024-04-25T08:45:19.818416+0000","last_peered":"2024-04-25T08:45:19.818416+0000","last_clean":"2024-04-25T08:45:19.818416+0000","last_became_active":"2024-04-25T08:45:18.812661+0000","last_became_peered":"2024-04-25T08:45:18.812661+0000","last_unstale":"2024-04-25T08:45:19.818416+0000","last_undegraded":"2024-04-25T08:45:19.818416+0000","last_fullsized":"2024-04-25T08:45:19.818416+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:27.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820758+0000","last_change":"2024-04-25T08:45:18.813517+0000","last_active":"2024-04-25T08:45:19.820758+0000","last_peered":"2024-04-25T08:45:19.820758+0000","last_clean":"2024-04-25T08:45:19.820758+0000","last_became_active":"2024-04-25T08:45:18.812328+0000","last_became_peered":"2024-04-25T08:45:18.812328+0000","last_unstale":"2024-04-25T08:45:19.820758+0000","last_undegraded":"2024-04-25T08:45:19.820758+0000","last_fullsized":"2024-04-25T08:45:19.820758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:59.678260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.824949+0000","last_change":"2024-04-25T08:45:18.820153+0000","last_active":"2024-04-25T08:45:18.824949+0000","last_peered":"2024-04-25T08:45:18.824949+0000","last_clean":"2024-04-25T08:45:18.824949+0000","last_became_active":"2024-04-25T08:45:18.818010+0000","last_became_peered":"2024-04-25T08:45:18.818010+0000","last_unstale":"2024-04-25T08:45:18.824949+0000","last_undegraded":"2024-04-25T08:45:18.824949+0000","last_fullsized":"2024-04-25T08:45:18.824949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:43.970122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804462+0000","last_change":"2024-04-25T08:45:18.814509+0000","last_active":"2024-04-25T08:45:19.804462+0000","last_peered":"2024-04-25T08:45:19.804462+0000","last_clean":"2024-04-25T08:45:19.804462+0000","last_became_active":"2024-04-25T08:45:18.814250+0000","last_became_peered":"2024-04-25T08:45:18.814250+0000","last_unstale":"2024-04-25T08:45:19.804462+0000","last_undegraded":"2024-04-25T08:45:19.804462+0000","last_fullsized":"2024-04-25T08:45:19.804462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:44.477349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818101+0000","last_change":"2024-04-25T08:45:18.813257+0000","last_active":"2024-04-25T08:45:19.818101+0000","last_peered":"2024-04-25T08:45:19.818101+0000","last_clean":"2024-04-25T08:45:19.818101+0000","last_became_active":"2024-04-25T08:45:18.812942+0000","last_became_peered":"2024-04-25T08:45:18.812942+0000","last_unstale":"2024-04-25T08:45:19.818101+0000","last_undegraded":"2024-04-25T08:45:19.818101+0000","last_fullsized":"2024-04-25T08:45:19.818101+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:58.824000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.814761+0000","last_change":"2024-04-25T08:45:18.811425+0000","last_active":"2024-04-25T08:45:18.814761+0000","last_peered":"2024-04-25T08:45:18.814761+0000","last_clean":"2024-04-25T08:45:18.814761+0000","last_became_active":"2024-04-25T08:45:18.811053+0000","last_became_peered":"2024-04-25T08:45:18.811053+0000","last_unstale":"2024-04-25T08:45:18.814761+0000","last_undegraded":"2024-04-25T08:45:18.814761+0000","last_fullsized":"2024-04-25T08:45:18.814761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:05.538676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.822045+0000","last_change":"2024-04-25T08:45:18.821468+0000","last_active":"2024-04-25T08:45:18.822045+0000","last_peered":"2024-04-25T08:45:18.822045+0000","last_clean":"2024-04-25T08:45:18.822045+0000","last_became_active":"2024-04-25T08:45:18.820592+0000","last_became_peered":"2024-04-25T08:45:18.820592+0000","last_unstale":"2024-04-25T08:45:18.822045+0000","last_undegraded":"2024-04-25T08:45:18.822045+0000","last_fullsized":"2024-04-25T08:45:18.822045+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:37.225948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804810+0000","last_change":"2024-04-25T08:45:18.816572+0000","last_active":"2024-04-25T08:45:19.804810+0000","last_peered":"2024-04-25T08:45:19.804810+0000","last_clean":"2024-04-25T08:45:19.804810+0000","last_became_active":"2024-04-25T08:45:18.816307+0000","last_became_peered":"2024-04-25T08:45:18.816307+0000","last_unstale":"2024-04-25T08:45:19.804810+0000","last_undegraded":"2024-04-25T08:45:19.804810+0000","last_fullsized":"2024-04-25T08:45:19.804810+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:47.307740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.817107+0000","last_change":"2024-04-25T08:45:18.814478+0000","last_active":"2024-04-25T08:45:18.817107+0000","last_peered":"2024-04-25T08:45:18.817107+0000","last_clean":"2024-04-25T08:45:18.817107+0000","last_became_active":"2024-04-25T08:45:18.814241+0000","last_became_peered":"2024-04-25T08:45:18.814241+0000","last_unstale":"2024-04-25T08:45:18.817107+0000","last_undegraded":"2024-04-25T08:45:18.817107+0000","last_fullsized":"2024-04-25T08:45:18.817107+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:24.794944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.810769+0000","last_change":"2024-04-25T08:45:18.807537+0000","last_active":"2024-04-25T08:45:18.810769+0000","last_peered":"2024-04-25T08:45:18.810769+0000","last_clean":"2024-04-25T08:45:18.810769+0000","last_became_active":"2024-04-25T08:45:18.806588+0000","last_became_peered":"2024-04-25T08:45:18.806588+0000","last_unstale":"2024-04-25T08:45:18.810769+0000","last_undegraded":"2024-04-25T08:45:18.810769+0000","last_fullsized":"2024-04-25T08:45:18.810769+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:21.517873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804507+0000","last_change":"2024-04-25T08:45:18.813226+0000","last_active":"2024-04-25T08:45:19.804507+0000","last_peered":"2024-04-25T08:45:19.804507+0000","last_clean":"2024-04-25T08:45:19.804507+0000","last_became_active":"2024-04-25T08:45:18.812923+0000","last_became_peered":"2024-04-25T08:45:18.812923+0000","last_unstale":"2024-04-25T08:45:19.804507+0000","last_undegraded":"2024-04-25T08:45:19.804507+0000","last_fullsized":"2024-04-25T08:45:19.804507+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:18.141783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818311+0000","last_change":"2024-04-25T08:45:18.817433+0000","last_active":"2024-04-25T08:45:19.818311+0000","last_peered":"2024-04-25T08:45:19.818311+0000","last_clean":"2024-04-25T08:45:19.818311+0000","last_became_active":"2024-04-25T08:45:18.817185+0000","last_became_peered":"2024-04-25T08:45:18.817185+0000","last_unstale":"2024-04-25T08:45:19.818311+0000","last_undegraded":"2024-04-25T08:45:19.818311+0000","last_fullsized":"2024-04-25T08:45:19.818311+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:13.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820608+0000","last_change":"2024-04-25T08:45:18.818766+0000","last_active":"2024-04-25T08:45:19.820608+0000","last_peered":"2024-04-25T08:45:19.820608+0000","last_clean":"2024-04-25T08:45:19.820608+0000","last_became_active":"2024-04-25T08:45:18.818486+0000","last_became_peered":"2024-04-25T08:45:18.818486+0000","last_unstale":"2024-04-25T08:45:19.820608+0000","last_undegraded":"2024-04-25T08:45:19.820608+0000","last_fullsized":"2024-04-25T08:45:19.820608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:39.831346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804271+0000","last_change":"2024-04-25T08:45:18.812328+0000","last_active":"2024-04-25T08:45:19.804271+0000","last_peered":"2024-04-25T08:45:19.804271+0000","last_clean":"2024-04-25T08:45:19.804271+0000","last_became_active":"2024-04-25T08:45:18.812060+0000","last_became_peered":"2024-04-25T08:45:18.812060+0000","last_unstale":"2024-04-25T08:45:19.804271+0000","last_undegraded":"2024-04-25T08:45:19.804271+0000","last_fullsized":"2024-04-25T08:45:19.804271+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:07.421990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818584+0000","last_change":"2024-04-25T08:45:18.811962+0000","last_active":"2024-04-25T08:45:19.818584+0000","last_peered":"2024-04-25T08:45:19.818584+0000","last_clean":"2024-04-25T08:45:19.818584+0000","last_became_active":"2024-04-25T08:45:18.811504+0000","last_became_peered":"2024-04-25T08:45:18.811504+0000","last_unstale":"2024-04-25T08:45:19.818584+0000","last_undegraded":"2024-04-25T08:45:19.818584+0000","last_fullsized":"2024-04-25T08:45:19.818584+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:17.800955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.821074+0000","last_change":"2024-04-25T08:45:18.815126+0000","last_active":"2024-04-25T08:45:19.821074+0000","last_peered":"2024-04-25T08:45:19.821074+0000","last_clean":"2024-04-25T08:45:19.821074+0000","last_became_active":"2024-04-25T08:45:18.814855+0000","last_became_peered":"2024-04-25T08:45:18.814855+0000","last_unstale":"2024-04-25T08:45:19.821074+0000","last_undegraded":"2024-04-25T08:45:19.821074+0000","last_fullsized":"2024-04-25T08:45:19.821074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:01.492205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818492+0000","last_change":"2024-04-25T08:45:18.817199+0000","last_active":"2024-04-25T08:45:19.818492+0000","last_peered":"2024-04-25T08:45:19.818492+0000","last_clean":"2024-04-25T08:45:19.818492+0000","last_became_active":"2024-04-25T08:45:18.816814+0000","last_became_peered":"2024-04-25T08:45:18.816814+0000","last_unstale":"2024-04-25T08:45:19.818492+0000","last_undegraded":"2024-04-25T08:45:19.818492+0000","last_fullsized":"2024-04-25T08:45:19.818492+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:06.813911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803737+0000","last_change":"2024-04-25T08:45:18.817338+0000","last_active":"2024-04-25T08:45:19.803737+0000","last_peered":"2024-04-25T08:45:19.803737+0000","last_clean":"2024-04-25T08:45:19.803737+0000","last_became_active":"2024-04-25T08:45:18.817056+0000","last_became_peered":"2024-04-25T08:45:18.817056+0000","last_unstale":"2024-04-25T08:45:19.803737+0000","last_undegraded":"2024-04-25T08:45:19.803737+0000","last_fullsized":"2024-04-25T08:45:19.803737+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:27.789534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803947+0000","last_change":"2024-04-25T08:45:18.819401+0000","last_active":"2024-04-25T08:45:19.803947+0000","last_peered":"2024-04-25T08:45:19.803947+0000","last_clean":"2024-04-25T08:45:19.803947+0000","last_became_active":"2024-04-25T08:45:18.819138+0000","last_became_peered":"2024-04-25T08:45:18.819138+0000","last_unstale":"2024-04-25T08:45:19.803947+0000","last_undegraded":"2024-04-25T08:45:19.803947+0000","last_fullsized":"2024-04-25T08:45:19.803947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:28.771073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.820962+0000","last_change":"2024-04-25T08:45:18.817815+0000","last_active":"2024-04-25T08:45:18.820962+0000","last_peered":"2024-04-25T08:45:18.820962+0000","last_clean":"2024-04-25T08:45:18.820962+0000","last_became_active":"2024-04-25T08:45:18.816694+0000","last_became_peered":"2024-04-25T08:45:18.816694+0000","last_unstale":"2024-04-25T08:45:18.820962+0000","last_undegraded":"2024-04-25T08:45:18.820962+0000","last_fullsized":"2024-04-25T08:45:18.820962+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:06.813911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.821277+0000","last_change":"2024-04-25T08:45:18.817738+0000","last_active":"2024-04-25T08:45:18.821277+0000","last_peered":"2024-04-25T08:45:18.821277+0000","last_clean":"2024-04-25T08:45:18.821277+0000","last_became_active":"2024-04-25T08:45:18.817465+0000","last_became_peered":"2024-04-25T08:45:18.817465+0000","last_unstale":"2024-04-25T08:45:18.821277+0000","last_undegraded":"2024-04-25T08:45:18.821277+0000","last_fullsized":"2024-04-25T08:45:18.821277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:56.767629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818062+0000","last_change":"2024-04-25T08:45:18.816702+0000","last_active":"2024-04-25T08:45:19.818062+0000","last_peered":"2024-04-25T08:45:19.818062+0000","last_clean":"2024-04-25T08:45:19.818062+0000","last_became_active":"2024-04-25T08:45:18.816452+0000","last_became_peered":"2024-04-25T08:45:18.816452+0000","last_unstale":"2024-04-25T08:45:19.818062+0000","last_undegraded":"2024-04-25T08:45:19.818062+0000","last_fullsized":"2024-04-25T08:45:19.818062+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:21.517873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818670+0000","last_change":"2024-04-25T08:45:18.813768+0000","last_active":"2024-04-25T08:45:19.818670+0000","last_peered":"2024-04-25T08:45:19.818670+0000","last_clean":"2024-04-25T08:45:19.818670+0000","last_became_active":"2024-04-25T08:45:18.812372+0000","last_became_peered":"2024-04-25T08:45:18.812372+0000","last_unstale":"2024-04-25T08:45:19.818670+0000","last_undegraded":"2024-04-25T08:45:19.818670+0000","last_fullsized":"2024-04-25T08:45:19.818670+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:41.400003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.820219+0000","last_change":"2024-04-25T08:45:18.814137+0000","last_active":"2024-04-25T08:45:18.820219+0000","last_peered":"2024-04-25T08:45:18.820219+0000","last_clean":"2024-04-25T08:45:18.820219+0000","last_became_active":"2024-04-25T08:45:18.813607+0000","last_became_peered":"2024-04-25T08:45:18.813607+0000","last_unstale":"2024-04-25T08:45:18.820219+0000","last_undegraded":"2024-04-25T08:45:18.820219+0000","last_fullsized":"2024-04-25T08:45:18.820219+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:55.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804880+0000","last_change":"2024-04-25T08:45:18.811043+0000","last_active":"2024-04-25T08:45:19.804880+0000","last_peered":"2024-04-25T08:45:19.804880+0000","last_clean":"2024-04-25T08:45:19.804880+0000","last_became_active":"2024-04-25T08:45:18.809769+0000","last_became_peered":"2024-04-25T08:45:18.809769+0000","last_unstale":"2024-04-25T08:45:19.804880+0000","last_undegraded":"2024-04-25T08:45:19.804880+0000","last_fullsized":"2024-04-25T08:45:19.804880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:39.831346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803907+0000","last_change":"2024-04-25T08:45:18.809403+0000","last_active":"2024-04-25T08:45:19.803907+0000","last_peered":"2024-04-25T08:45:19.803907+0000","last_clean":"2024-04-25T08:45:19.803907+0000","last_became_active":"2024-04-25T08:45:18.809134+0000","last_became_peered":"2024-04-25T08:45:18.809134+0000","last_unstale":"2024-04-25T08:45:19.803907+0000","last_undegraded":"2024-04-25T08:45:19.803907+0000","last_fullsized":"2024-04-25T08:45:19.803907+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:07.424894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818328+0000","last_change":"2024-04-25T08:45:18.812719+0000","last_active":"2024-04-25T08:45:19.818328+0000","last_peered":"2024-04-25T08:45:19.818328+0000","last_clean":"2024-04-25T08:45:19.818328+0000","last_became_active":"2024-04-25T08:45:18.812448+0000","last_became_peered":"2024-04-25T08:45:18.812448+0000","last_unstale":"2024-04-25T08:45:19.818328+0000","last_undegraded":"2024-04-25T08:45:19.818328+0000","last_fullsized":"2024-04-25T08:45:19.818328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:56.948524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820676+0000","last_change":"2024-04-25T08:45:18.819965+0000","last_active":"2024-04-25T08:45:19.820676+0000","last_peered":"2024-04-25T08:45:19.820676+0000","last_clean":"2024-04-25T08:45:19.820676+0000","last_became_active":"2024-04-25T08:45:18.819478+0000","last_became_peered":"2024-04-25T08:45:18.819478+0000","last_unstale":"2024-04-25T08:45:19.820676+0000","last_undegraded":"2024-04-25T08:45:19.820676+0000","last_fullsized":"2024-04-25T08:45:19.820676+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:19.149675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818198+0000","last_change":"2024-04-25T08:45:18.812158+0000","last_active":"2024-04-25T08:45:19.818198+0000","last_peered":"2024-04-25T08:45:19.818198+0000","last_clean":"2024-04-25T08:45:19.818198+0000","last_became_active":"2024-04-25T08:45:18.811885+0000","last_became_peered":"2024-04-25T08:45:18.811885+0000","last_unstale":"2024-04-25T08:45:19.818198+0000","last_undegraded":"2024-04-25T08:45:19.818198+0000","last_fullsized":"2024-04-25T08:45:19.818198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:05.538676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803094+0000","last_change":"2024-04-25T08:45:18.806217+0000","last_active":"2024-04-25T08:45:19.803094+0000","last_peered":"2024-04-25T08:45:19.803094+0000","last_clean":"2024-04-25T08:45:19.803094+0000","last_became_active":"2024-04-25T08:45:18.805547+0000","last_became_peered":"2024-04-25T08:45:18.805547+0000","last_unstale":"2024-04-25T08:45:19.803094+0000","last_undegraded":"2024-04-25T08:45:19.803094+0000","last_fullsized":"2024-04-25T08:45:19.803094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:13.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820393+0000","last_change":"2024-04-25T08:45:18.823127+0000","last_active":"2024-04-25T08:45:19.820393+0000","last_peered":"2024-04-25T08:45:19.820393+0000","last_clean":"2024-04-25T08:45:19.820393+0000","last_became_active":"2024-04-25T08:45:18.822827+0000","last_became_peered":"2024-04-25T08:45:18.822827+0000","last_unstale":"2024-04-25T08:45:19.820393+0000","last_undegraded":"2024-04-25T08:45:19.820393+0000","last_fullsized":"2024-04-25T08:45:19.820393+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:45.316373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804028+0000","last_change":"2024-04-25T08:45:17.798176+0000","last_active":"2024-04-25T08:45:19.804028+0000","last_peered":"2024-04-25T08:45:19.804028+0000","last_clean":"2024-04-25T08:45:19.804028+0000","last_became_active":"2024-04-25T08:45:17.797819+0000","last_became_peered":"2024-04-25T08:45:17.797819+0000","last_unstale":"2024-04-25T08:45:19.804028+0000","last_undegraded":"2024-04-25T08:45:19.804028+0000","last_fullsized":"2024-04-25T08:45:19.804028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:23.144816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803606+0000","last_change":"2024-04-25T08:45:18.818475+0000","last_active":"2024-04-25T08:45:19.803606+0000","last_peered":"2024-04-25T08:45:19.803606+0000","last_clean":"2024-04-25T08:45:19.803606+0000","last_became_active":"2024-04-25T08:45:18.818139+0000","last_became_peered":"2024-04-25T08:45:18.818139+0000","last_unstale":"2024-04-25T08:45:19.803606+0000","last_undegraded":"2024-04-25T08:45:19.803606+0000","last_fullsized":"2024-04-25T08:45:19.803606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:27.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804775+0000","last_change":"2024-04-25T08:45:17.809481+0000","last_active":"2024-04-25T08:45:19.804775+0000","last_peered":"2024-04-25T08:45:19.804775+0000","last_clean":"2024-04-25T08:45:19.804775+0000","last_became_active":"2024-04-25T08:45:17.809229+0000","last_became_peered":"2024-04-25T08:45:17.809229+0000","last_unstale":"2024-04-25T08:45:19.804775+0000","last_undegraded":"2024-04-25T08:45:19.804775+0000","last_fullsized":"2024-04-25T08:45:19.804775+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:14.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804496+0000","last_change":"2024-04-25T08:45:18.812140+0000","last_active":"2024-04-25T08:45:19.804496+0000","last_peered":"2024-04-25T08:45:19.804496+0000","last_clean":"2024-04-25T08:45:19.804496+0000","last_became_active":"2024-04-25T08:45:18.811876+0000","last_became_peered":"2024-04-25T08:45:18.811876+0000","last_unstale":"2024-04-25T08:45:19.804496+0000","last_undegraded":"2024-04-25T08:45:19.804496+0000","last_fullsized":"2024-04-25T08:45:19.804496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:07.421990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804848+0000","last_change":"2024-04-25T08:45:17.801691+0000","last_active":"2024-04-25T08:45:19.804848+0000","last_peered":"2024-04-25T08:45:19.804848+0000","last_clean":"2024-04-25T08:45:19.804848+0000","last_became_active":"2024-04-25T08:45:17.800726+0000","last_became_peered":"2024-04-25T08:45:17.800726+0000","last_unstale":"2024-04-25T08:45:19.804848+0000","last_undegraded":"2024-04-25T08:45:19.804848+0000","last_fullsized":"2024-04-25T08:45:19.804848+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:08.963648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.814788+0000","last_change":"2024-04-25T08:45:18.812760+0000","last_active":"2024-04-25T08:45:18.814788+0000","last_peered":"2024-04-25T08:45:18.814788+0000","last_clean":"2024-04-25T08:45:18.814788+0000","last_became_active":"2024-04-25T08:45:18.812525+0000","last_became_peered":"2024-04-25T08:45:18.812525+0000","last_unstale":"2024-04-25T08:45:18.814788+0000","last_undegraded":"2024-04-25T08:45:18.814788+0000","last_fullsized":"2024-04-25T08:45:18.814788+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:13.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803786+0000","last_change":"2024-04-25T08:45:17.802514+0000","last_active":"2024-04-25T08:45:19.803786+0000","last_peered":"2024-04-25T08:45:19.803786+0000","last_clean":"2024-04-25T08:45:19.803786+0000","last_became_active":"2024-04-25T08:45:17.802246+0000","last_became_peered":"2024-04-25T08:45:17.802246+0000","last_unstale":"2024-04-25T08:45:19.803786+0000","last_undegraded":"2024-04-25T08:45:19.803786+0000","last_fullsized":"2024-04-25T08:45:19.803786+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:38.824749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.825087+0000","last_change":"2024-04-25T08:45:18.817582+0000","last_active":"2024-04-25T08:45:18.825087+0000","last_peered":"2024-04-25T08:45:18.825087+0000","last_clean":"2024-04-25T08:45:18.825087+0000","last_became_active":"2024-04-25T08:45:18.817310+0000","last_became_peered":"2024-04-25T08:45:18.817310+0000","last_unstale":"2024-04-25T08:45:18.825087+0000","last_undegraded":"2024-04-25T08:45:18.825087+0000","last_fullsized":"2024-04-25T08:45:18.825087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:39.455423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818296+0000","last_change":"2024-04-25T08:45:17.810355+0000","last_active":"2024-04-25T08:45:19.818296+0000","last_peered":"2024-04-25T08:45:19.818296+0000","last_clean":"2024-04-25T08:45:19.818296+0000","last_became_active":"2024-04-25T08:45:17.809979+0000","last_became_peered":"2024-04-25T08:45:17.809979+0000","last_unstale":"2024-04-25T08:45:19.818296+0000","last_undegraded":"2024-04-25T08:45:19.818296+0000","last_fullsized":"2024-04-25T08:45:19.818296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:28.037489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820804+0000","last_change":"2024-04-25T08:45:18.818362+0000","last_active":"2024-04-25T08:45:19.820804+0000","last_peered":"2024-04-25T08:45:19.820804+0000","last_clean":"2024-04-25T08:45:19.820804+0000","last_became_active":"2024-04-25T08:45:18.818063+0000","last_became_peered":"2024-04-25T08:45:18.818063+0000","last_unstale":"2024-04-25T08:45:19.820804+0000","last_undegraded":"2024-04-25T08:45:19.820804+0000","last_fullsized":"2024-04-25T08:45:19.820804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:32.847694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.829770+0000","last_change":"2024-04-25T08:45:17.800390+0000","last_active":"2024-04-25T08:45:18.829770+0000","last_peered":"2024-04-25T08:45:18.829770+0000","last_clean":"2024-04-25T08:45:18.829770+0000","last_became_active":"2024-04-25T08:45:17.800099+0000","last_became_peered":"2024-04-25T08:45:17.800099+0000","last_unstale":"2024-04-25T08:45:18.829770+0000","last_undegraded":"2024-04-25T08:45:18.829770+0000","last_fullsized":"2024-04-25T08:45:18.829770+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:46.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.820196+0000","last_change":"2024-04-25T08:45:18.813926+0000","last_active":"2024-04-25T08:45:18.820196+0000","last_peered":"2024-04-25T08:45:18.820196+0000","last_clean":"2024-04-25T08:45:18.820196+0000","last_became_active":"2024-04-25T08:45:18.813576+0000","last_became_peered":"2024-04-25T08:45:18.813576+0000","last_unstale":"2024-04-25T08:45:18.820196+0000","last_undegraded":"2024-04-25T08:45:18.820196+0000","last_fullsized":"2024-04-25T08:45:18.820196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:56.948524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804342+0000","last_change":"2024-04-25T08:45:17.802334+0000","last_active":"2024-04-25T08:45:19.804342+0000","last_peered":"2024-04-25T08:45:19.804342+0000","last_clean":"2024-04-25T08:45:19.804342+0000","last_became_active":"2024-04-25T08:45:17.802078+0000","last_became_peered":"2024-04-25T08:45:17.802078+0000","last_unstale":"2024-04-25T08:45:19.804342+0000","last_undegraded":"2024-04-25T08:45:19.804342+0000","last_fullsized":"2024-04-25T08:45:19.804342+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:19.594037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820804+0000","last_change":"2024-04-25T08:45:18.819710+0000","last_active":"2024-04-25T08:45:19.820804+0000","last_peered":"2024-04-25T08:45:19.820804+0000","last_clean":"2024-04-25T08:45:19.820804+0000","last_became_active":"2024-04-25T08:45:18.819347+0000","last_became_peered":"2024-04-25T08:45:18.819347+0000","last_unstale":"2024-04-25T08:45:19.820804+0000","last_undegraded":"2024-04-25T08:45:19.820804+0000","last_fullsized":"2024-04-25T08:45:19.820804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:12.202880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818079+0000","last_change":"2024-04-25T08:45:17.805228+0000","last_active":"2024-04-25T08:45:19.818079+0000","last_peered":"2024-04-25T08:45:19.818079+0000","last_clean":"2024-04-25T08:45:19.818079+0000","last_became_active":"2024-04-25T08:45:17.804964+0000","last_became_peered":"2024-04-25T08:45:17.804964+0000","last_unstale":"2024-04-25T08:45:19.818079+0000","last_undegraded":"2024-04-25T08:45:19.818079+0000","last_fullsized":"2024-04-25T08:45:19.818079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:27.764477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.816634+0000","last_change":"2024-04-25T08:45:18.814488+0000","last_active":"2024-04-25T08:45:18.816634+0000","last_peered":"2024-04-25T08:45:18.816634+0000","last_clean":"2024-04-25T08:45:18.816634+0000","last_became_active":"2024-04-25T08:45:18.814172+0000","last_became_peered":"2024-04-25T08:45:18.814172+0000","last_unstale":"2024-04-25T08:45:18.816634+0000","last_undegraded":"2024-04-25T08:45:18.816634+0000","last_fullsized":"2024-04-25T08:45:18.816634+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:59.633758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820924+0000","last_change":"2024-04-25T08:45:17.803671+0000","last_active":"2024-04-25T08:45:19.820924+0000","last_peered":"2024-04-25T08:45:19.820924+0000","last_clean":"2024-04-25T08:45:19.820924+0000","last_became_active":"2024-04-25T08:45:17.803356+0000","last_became_peered":"2024-04-25T08:45:17.803356+0000","last_unstale":"2024-04-25T08:45:19.820924+0000","last_undegraded":"2024-04-25T08:45:19.820924+0000","last_fullsized":"2024-04-25T08:45:19.820924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:33.793872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803057+0000","last_change":"2024-04-25T08:45:18.815729+0000","last_active":"2024-04-25T08:45:19.803057+0000","last_peered":"2024-04-25T08:45:19.803057+0000","last_clean":"2024-04-25T08:45:19.803057+0000","last_became_active":"2024-04-25T08:45:18.815460+0000","last_became_peered":"2024-04-25T08:45:18.815460+0000","last_unstale":"2024-04-25T08:45:19.803057+0000","last_undegraded":"2024-04-25T08:45:19.803057+0000","last_fullsized":"2024-04-25T08:45:19.803057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:05.538676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.807571+0000","last_change":"2024-04-25T08:45:17.810448+0000","last_active":"2024-04-25T08:45:18.807571+0000","last_peered":"2024-04-25T08:45:18.807571+0000","last_clean":"2024-04-25T08:45:18.807571+0000","last_became_active":"2024-04-25T08:45:17.810154+0000","last_became_peered":"2024-04-25T08:45:17.810154+0000","last_unstale":"2024-04-25T08:45:18.807571+0000","last_undegraded":"2024-04-25T08:45:18.807571+0000","last_fullsized":"2024-04-25T08:45:18.807571+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:23.502405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818334+0000","last_change":"2024-04-25T08:45:18.816083+0000","last_active":"2024-04-25T08:45:19.818334+0000","last_peered":"2024-04-25T08:45:19.818334+0000","last_clean":"2024-04-25T08:45:19.818334+0000","last_became_active":"2024-04-25T08:45:18.815636+0000","last_became_peered":"2024-04-25T08:45:18.815636+0000","last_unstale":"2024-04-25T08:45:19.818334+0000","last_undegraded":"2024-04-25T08:45:19.818334+0000","last_fullsized":"2024-04-25T08:45:19.818334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:55.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820891+0000","last_change":"2024-04-25T08:45:17.804283+0000","last_active":"2024-04-25T08:45:19.820891+0000","last_peered":"2024-04-25T08:45:19.820891+0000","last_clean":"2024-04-25T08:45:19.820891+0000","last_became_active":"2024-04-25T08:45:17.804027+0000","last_became_peered":"2024-04-25T08:45:17.804027+0000","last_unstale":"2024-04-25T08:45:19.820891+0000","last_undegraded":"2024-04-25T08:45:19.820891+0000","last_fullsized":"2024-04-25T08:45:19.820891+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:27.764477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.816668+0000","last_change":"2024-04-25T08:45:18.813202+0000","last_active":"2024-04-25T08:45:18.816668+0000","last_peered":"2024-04-25T08:45:18.816668+0000","last_clean":"2024-04-25T08:45:18.816668+0000","last_became_active":"2024-04-25T08:45:18.812920+0000","last_became_peered":"2024-04-25T08:45:18.812920+0000","last_unstale":"2024-04-25T08:45:18.816668+0000","last_undegraded":"2024-04-25T08:45:18.816668+0000","last_fullsized":"2024-04-25T08:45:18.816668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:09.193858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"53'6","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.834512+0000","last_change":"2024-04-25T08:45:17.799519+0000","last_active":"2024-04-25T08:45:18.834512+0000","last_peered":"2024-04-25T08:45:18.834512+0000","last_clean":"2024-04-25T08:45:18.834512+0000","last_became_active":"2024-04-25T08:45:17.799208+0000","last_became_peered":"2024-04-25T08:45:17.799208+0000","last_unstale":"2024-04-25T08:45:18.834512+0000","last_undegraded":"2024-04-25T08:45:18.834512+0000","last_fullsized":"2024-04-25T08:45:18.834512+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:11.196284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803414+0000","last_change":"2024-04-25T08:45:18.812390+0000","last_active":"2024-04-25T08:45:19.803414+0000","last_peered":"2024-04-25T08:45:19.803414+0000","last_clean":"2024-04-25T08:45:19.803414+0000","last_became_active":"2024-04-25T08:45:18.812083+0000","last_became_peered":"2024-04-25T08:45:18.812083+0000","last_unstale":"2024-04-25T08:45:19.803414+0000","last_undegraded":"2024-04-25T08:45:19.803414+0000","last_fullsized":"2024-04-25T08:45:19.803414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:55.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818459+0000","last_change":"2024-04-25T08:45:17.806064+0000","last_active":"2024-04-25T08:45:19.818459+0000","last_peered":"2024-04-25T08:45:19.818459+0000","last_clean":"2024-04-25T08:45:19.818459+0000","last_became_active":"2024-04-25T08:45:17.805804+0000","last_became_peered":"2024-04-25T08:45:17.805804+0000","last_unstale":"2024-04-25T08:45:19.818459+0000","last_undegraded":"2024-04-25T08:45:19.818459+0000","last_fullsized":"2024-04-25T08:45:19.818459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:26.782938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818549+0000","last_change":"2024-04-25T08:45:18.819138+0000","last_active":"2024-04-25T08:45:19.818549+0000","last_peered":"2024-04-25T08:45:19.818549+0000","last_clean":"2024-04-25T08:45:19.818549+0000","last_became_active":"2024-04-25T08:45:18.818869+0000","last_became_peered":"2024-04-25T08:45:18.818869+0000","last_unstale":"2024-04-25T08:45:19.818549+0000","last_undegraded":"2024-04-25T08:45:19.818549+0000","last_fullsized":"2024-04-25T08:45:19.818549+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:37.225948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804485+0000","last_change":"2024-04-25T08:45:17.809326+0000","last_active":"2024-04-25T08:45:19.804485+0000","last_peered":"2024-04-25T08:45:19.804485+0000","last_clean":"2024-04-25T08:45:19.804485+0000","last_became_active":"2024-04-25T08:45:17.809042+0000","last_became_peered":"2024-04-25T08:45:17.809042+0000","last_unstale":"2024-04-25T08:45:19.804485+0000","last_undegraded":"2024-04-25T08:45:19.804485+0000","last_fullsized":"2024-04-25T08:45:19.804485+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:14.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.820238+0000","last_change":"2024-04-25T08:45:18.814543+0000","last_active":"2024-04-25T08:45:18.820238+0000","last_peered":"2024-04-25T08:45:18.820238+0000","last_clean":"2024-04-25T08:45:18.820238+0000","last_became_active":"2024-04-25T08:45:18.814271+0000","last_became_peered":"2024-04-25T08:45:18.814271+0000","last_unstale":"2024-04-25T08:45:18.820238+0000","last_undegraded":"2024-04-25T08:45:18.820238+0000","last_fullsized":"2024-04-25T08:45:18.820238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:27.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820697+0000","last_change":"2024-04-25T08:45:17.803988+0000","last_active":"2024-04-25T08:45:19.820697+0000","last_peered":"2024-04-25T08:45:19.820697+0000","last_clean":"2024-04-25T08:45:19.820697+0000","last_became_active":"2024-04-25T08:45:17.803681+0000","last_became_peered":"2024-04-25T08:45:17.803681+0000","last_unstale":"2024-04-25T08:45:19.820697+0000","last_undegraded":"2024-04-25T08:45:19.820697+0000","last_fullsized":"2024-04-25T08:45:19.820697+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:26.782938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818633+0000","last_change":"2024-04-25T08:45:18.817297+0000","last_active":"2024-04-25T08:45:19.818633+0000","last_peered":"2024-04-25T08:45:19.818633+0000","last_clean":"2024-04-25T08:45:19.818633+0000","last_became_active":"2024-04-25T08:45:18.813964+0000","last_became_peered":"2024-04-25T08:45:18.813964+0000","last_unstale":"2024-04-25T08:45:19.818633+0000","last_undegraded":"2024-04-25T08:45:19.818633+0000","last_fullsized":"2024-04-25T08:45:19.818633+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:54.242386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"53'8","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.832490+0000","last_change":"2024-04-25T08:45:17.800781+0000","last_active":"2024-04-25T08:45:18.832490+0000","last_peered":"2024-04-25T08:45:18.832490+0000","last_clean":"2024-04-25T08:45:18.832490+0000","last_became_active":"2024-04-25T08:45:17.800534+0000","last_became_peered":"2024-04-25T08:45:17.800534+0000","last_unstale":"2024-04-25T08:45:18.832490+0000","last_undegraded":"2024-04-25T08:45:18.832490+0000","last_fullsized":"2024-04-25T08:45:18.832490+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:00.485609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.814273+0000","last_change":"2024-04-25T08:45:18.810293+0000","last_active":"2024-04-25T08:45:18.814273+0000","last_peered":"2024-04-25T08:45:18.814273+0000","last_clean":"2024-04-25T08:45:18.814273+0000","last_became_active":"2024-04-25T08:45:18.810028+0000","last_became_peered":"2024-04-25T08:45:18.810028+0000","last_unstale":"2024-04-25T08:45:18.814273+0000","last_undegraded":"2024-04-25T08:45:18.814273+0000","last_fullsized":"2024-04-25T08:45:18.814273+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:58.824000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818735+0000","last_change":"2024-04-25T08:45:17.812248+0000","last_active":"2024-04-25T08:45:19.818735+0000","last_peered":"2024-04-25T08:45:19.818735+0000","last_clean":"2024-04-25T08:45:19.818735+0000","last_became_active":"2024-04-25T08:45:17.811983+0000","last_became_peered":"2024-04-25T08:45:17.811983+0000","last_unstale":"2024-04-25T08:45:19.818735+0000","last_undegraded":"2024-04-25T08:45:19.818735+0000","last_fullsized":"2024-04-25T08:45:19.818735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:33.793872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804293+0000","last_change":"2024-04-25T08:45:18.809234+0000","last_active":"2024-04-25T08:45:19.804293+0000","last_peered":"2024-04-25T08:45:19.804293+0000","last_clean":"2024-04-25T08:45:19.804293+0000","last_became_active":"2024-04-25T08:45:18.808966+0000","last_became_peered":"2024-04-25T08:45:18.808966+0000","last_unstale":"2024-04-25T08:45:19.804293+0000","last_undegraded":"2024-04-25T08:45:19.804293+0000","last_fullsized":"2024-04-25T08:45:19.804293+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:52:14.901643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.824861+0000","last_change":"2024-04-25T08:45:17.798805+0000","last_active":"2024-04-25T08:45:18.824861+0000","last_peered":"2024-04-25T08:45:18.824861+0000","last_clean":"2024-04-25T08:45:18.824861+0000","last_became_active":"2024-04-25T08:45:17.798548+0000","last_became_peered":"2024-04-25T08:45:17.798548+0000","last_unstale":"2024-04-25T08:45:18.824861+0000","last_undegraded":"2024-04-25T08:45:18.824861+0000","last_fullsized":"2024-04-25T08:45:18.824861+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:16.504381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.825020+0000","last_change":"2024-04-25T08:45:18.821542+0000","last_active":"2024-04-25T08:45:18.825020+0000","last_peered":"2024-04-25T08:45:18.825020+0000","last_clean":"2024-04-25T08:45:18.825020+0000","last_became_active":"2024-04-25T08:45:18.821265+0000","last_became_peered":"2024-04-25T08:45:18.821265+0000","last_unstale":"2024-04-25T08:45:18.825020+0000","last_undegraded":"2024-04-25T08:45:18.825020+0000","last_fullsized":"2024-04-25T08:45:18.825020+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.044086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804389+0000","last_change":"2024-04-25T08:45:17.803274+0000","last_active":"2024-04-25T08:45:19.804389+0000","last_peered":"2024-04-25T08:45:19.804389+0000","last_clean":"2024-04-25T08:45:19.804389+0000","last_became_active":"2024-04-25T08:45:17.802955+0000","last_became_peered":"2024-04-25T08:45:17.802955+0000","last_unstale":"2024-04-25T08:45:19.804389+0000","last_undegraded":"2024-04-25T08:45:19.804389+0000","last_fullsized":"2024-04-25T08:45:19.804389+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:32.249645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804519+0000","last_change":"2024-04-25T08:45:18.804429+0000","last_active":"2024-04-25T08:45:19.804519+0000","last_peered":"2024-04-25T08:45:19.804519+0000","last_clean":"2024-04-25T08:45:19.804519+0000","last_became_active":"2024-04-25T08:45:18.804174+0000","last_became_peered":"2024-04-25T08:45:18.804174+0000","last_unstale":"2024-04-25T08:45:19.804519+0000","last_undegraded":"2024-04-25T08:45:19.804519+0000","last_fullsized":"2024-04-25T08:45:19.804519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:23.495679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804054+0000","last_change":"2024-04-25T08:45:17.808334+0000","last_active":"2024-04-25T08:45:19.804054+0000","last_peered":"2024-04-25T08:45:19.804054+0000","last_clean":"2024-04-25T08:45:19.804054+0000","last_became_active":"2024-04-25T08:45:17.808083+0000","last_became_peered":"2024-04-25T08:45:17.808083+0000","last_unstale":"2024-04-25T08:45:19.804054+0000","last_undegraded":"2024-04-25T08:45:19.804054+0000","last_fullsized":"2024-04-25T08:45:19.804054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:46.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803679+0000","last_change":"2024-04-25T08:45:18.813938+0000","last_active":"2024-04-25T08:45:19.803679+0000","last_peered":"2024-04-25T08:45:19.803679+0000","last_clean":"2024-04-25T08:45:19.803679+0000","last_became_active":"2024-04-25T08:45:18.813684+0000","last_became_peered":"2024-04-25T08:45:18.813684+0000","last_unstale":"2024-04-25T08:45:19.803679+0000","last_undegraded":"2024-04-25T08:45:19.803679+0000","last_fullsized":"2024-04-25T08:45:19.803679+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:23.134616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804603+0000","last_change":"2024-04-25T08:45:17.794790+0000","last_active":"2024-04-25T08:45:19.804603+0000","last_peered":"2024-04-25T08:45:19.804603+0000","last_clean":"2024-04-25T08:45:19.804603+0000","last_became_active":"2024-04-25T08:45:17.794372+0000","last_became_peered":"2024-04-25T08:45:17.794372+0000","last_unstale":"2024-04-25T08:45:19.804603+0000","last_undegraded":"2024-04-25T08:45:19.804603+0000","last_fullsized":"2024-04-25T08:45:19.804603+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:46.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804061+0000","last_change":"2024-04-25T08:45:18.816086+0000","last_active":"2024-04-25T08:45:19.804061+0000","last_peered":"2024-04-25T08:45:19.804061+0000","last_clean":"2024-04-25T08:45:19.804061+0000","last_became_active":"2024-04-25T08:45:18.815805+0000","last_became_peered":"2024-04-25T08:45:18.815805+0000","last_unstale":"2024-04-25T08:45:19.804061+0000","last_undegraded":"2024-04-25T08:45:19.804061+0000","last_fullsized":"2024-04-25T08:45:19.804061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:34.800468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.801989+0000","last_change":"2024-04-25T08:45:17.805427+0000","last_active":"2024-04-25T08:45:18.801989+0000","last_peered":"2024-04-25T08:45:18.801989+0000","last_clean":"2024-04-25T08:45:18.801989+0000","last_became_active":"2024-04-25T08:45:17.805189+0000","last_became_peered":"2024-04-25T08:45:17.805189+0000","last_unstale":"2024-04-25T08:45:18.801989+0000","last_undegraded":"2024-04-25T08:45:18.801989+0000","last_fullsized":"2024-04-25T08:45:18.801989+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:31.841098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818560+0000","last_change":"2024-04-25T08:45:18.813716+0000","last_active":"2024-04-25T08:45:19.818560+0000","last_peered":"2024-04-25T08:45:19.818560+0000","last_clean":"2024-04-25T08:45:19.818560+0000","last_became_active":"2024-04-25T08:45:18.813402+0000","last_became_peered":"2024-04-25T08:45:18.813402+0000","last_unstale":"2024-04-25T08:45:19.818560+0000","last_undegraded":"2024-04-25T08:45:19.818560+0000","last_fullsized":"2024-04-25T08:45:19.818560+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:12.775500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818228+0000","last_change":"2024-04-25T08:45:17.810788+0000","last_active":"2024-04-25T08:45:19.818228+0000","last_peered":"2024-04-25T08:45:19.818228+0000","last_clean":"2024-04-25T08:45:19.818228+0000","last_became_active":"2024-04-25T08:45:17.810512+0000","last_became_peered":"2024-04-25T08:45:17.810512+0000","last_unstale":"2024-04-25T08:45:19.818228+0000","last_undegraded":"2024-04-25T08:45:19.818228+0000","last_fullsized":"2024-04-25T08:45:19.818228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:06.418297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804900+0000","last_change":"2024-04-25T08:45:18.809939+0000","last_active":"2024-04-25T08:45:19.804900+0000","last_peered":"2024-04-25T08:45:19.804900+0000","last_clean":"2024-04-25T08:45:19.804900+0000","last_became_active":"2024-04-25T08:45:18.809661+0000","last_became_peered":"2024-04-25T08:45:18.809661+0000","last_unstale":"2024-04-25T08:45:19.804900+0000","last_undegraded":"2024-04-25T08:45:19.804900+0000","last_fullsized":"2024-04-25T08:45:19.804900+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:19.149675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.805314+0000","last_change":"2024-04-25T08:45:17.798455+0000","last_active":"2024-04-25T08:45:18.805314+0000","last_peered":"2024-04-25T08:45:18.805314+0000","last_clean":"2024-04-25T08:45:18.805314+0000","last_became_active":"2024-04-25T08:45:17.798181+0000","last_became_peered":"2024-04-25T08:45:17.798181+0000","last_unstale":"2024-04-25T08:45:18.805314+0000","last_undegraded":"2024-04-25T08:45:18.805314+0000","last_fullsized":"2024-04-25T08:45:18.805314+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:40.232205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803128+0000","last_change":"2024-04-25T08:45:18.806436+0000","last_active":"2024-04-25T08:45:19.803128+0000","last_peered":"2024-04-25T08:45:19.803128+0000","last_clean":"2024-04-25T08:45:19.803128+0000","last_became_active":"2024-04-25T08:45:18.805932+0000","last_became_peered":"2024-04-25T08:45:18.805932+0000","last_unstale":"2024-04-25T08:45:19.803128+0000","last_undegraded":"2024-04-25T08:45:19.803128+0000","last_fullsized":"2024-04-25T08:45:19.803128+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:05.548991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804154+0000","last_change":"2024-04-25T08:45:17.810476+0000","last_active":"2024-04-25T08:45:19.804154+0000","last_peered":"2024-04-25T08:45:19.804154+0000","last_clean":"2024-04-25T08:45:19.804154+0000","last_became_active":"2024-04-25T08:45:17.810125+0000","last_became_peered":"2024-04-25T08:45:17.810125+0000","last_unstale":"2024-04-25T08:45:19.804154+0000","last_undegraded":"2024-04-25T08:45:19.804154+0000","last_fullsized":"2024-04-25T08:45:19.804154+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:06.066759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804519+0000","last_change":"2024-04-25T08:45:18.806583+0000","last_active":"2024-04-25T08:45:19.804519+0000","last_peered":"2024-04-25T08:45:19.804519+0000","last_clean":"2024-04-25T08:45:19.804519+0000","last_became_active":"2024-04-25T08:45:18.806332+0000","last_became_peered":"2024-04-25T08:45:18.806332+0000","last_unstale":"2024-04-25T08:45:19.804519+0000","last_undegraded":"2024-04-25T08:45:19.804519+0000","last_fullsized":"2024-04-25T08:45:19.804519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:02.583352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820933+0000","last_change":"2024-04-25T08:45:17.804780+0000","last_active":"2024-04-25T08:45:19.820933+0000","last_peered":"2024-04-25T08:45:19.820933+0000","last_clean":"2024-04-25T08:45:19.820933+0000","last_became_active":"2024-04-25T08:45:17.804467+0000","last_became_peered":"2024-04-25T08:45:17.804467+0000","last_unstale":"2024-04-25T08:45:19.820933+0000","last_undegraded":"2024-04-25T08:45:19.820933+0000","last_fullsized":"2024-04-25T08:45:19.820933+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:06.418297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.820910+0000","last_change":"2024-04-25T08:45:18.813775+0000","last_active":"2024-04-25T08:45:18.820910+0000","last_peered":"2024-04-25T08:45:18.820910+0000","last_clean":"2024-04-25T08:45:18.820910+0000","last_became_active":"2024-04-25T08:45:18.813301+0000","last_became_peered":"2024-04-25T08:45:18.813301+0000","last_unstale":"2024-04-25T08:45:18.820910+0000","last_undegraded":"2024-04-25T08:45:18.820910+0000","last_fullsized":"2024-04-25T08:45:18.820910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:05.548991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818252+0000","last_change":"2024-04-25T08:45:17.806261+0000","last_active":"2024-04-25T08:45:19.818252+0000","last_peered":"2024-04-25T08:45:19.818252+0000","last_clean":"2024-04-25T08:45:19.818252+0000","last_became_active":"2024-04-25T08:45:17.805976+0000","last_became_peered":"2024-04-25T08:45:17.805976+0000","last_unstale":"2024-04-25T08:45:19.818252+0000","last_undegraded":"2024-04-25T08:45:19.818252+0000","last_fullsized":"2024-04-25T08:45:19.818252+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:45.401917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818319+0000","last_change":"2024-04-25T08:45:18.816647+0000","last_active":"2024-04-25T08:45:19.818319+0000","last_peered":"2024-04-25T08:45:19.818319+0000","last_clean":"2024-04-25T08:45:19.818319+0000","last_became_active":"2024-04-25T08:45:18.816385+0000","last_became_peered":"2024-04-25T08:45:18.816385+0000","last_unstale":"2024-04-25T08:45:19.818319+0000","last_undegraded":"2024-04-25T08:45:19.818319+0000","last_fullsized":"2024-04-25T08:45:19.818319+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:05.548991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.802893+0000","last_change":"2024-04-25T08:45:17.806083+0000","last_active":"2024-04-25T08:45:18.802893+0000","last_peered":"2024-04-25T08:45:18.802893+0000","last_clean":"2024-04-25T08:45:18.802893+0000","last_became_active":"2024-04-25T08:45:17.805839+0000","last_became_peered":"2024-04-25T08:45:17.805839+0000","last_unstale":"2024-04-25T08:45:18.802893+0000","last_undegraded":"2024-04-25T08:45:18.802893+0000","last_fullsized":"2024-04-25T08:45:18.802893+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:34.657722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803315+0000","last_change":"2024-04-25T08:45:18.813360+0000","last_active":"2024-04-25T08:45:19.803315+0000","last_peered":"2024-04-25T08:45:19.803315+0000","last_clean":"2024-04-25T08:45:19.803315+0000","last_became_active":"2024-04-25T08:45:18.812955+0000","last_became_peered":"2024-04-25T08:45:18.812955+0000","last_unstale":"2024-04-25T08:45:19.803315+0000","last_undegraded":"2024-04-25T08:45:19.803315+0000","last_fullsized":"2024-04-25T08:45:19.803315+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:56.948524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.802129+0000","last_change":"2024-04-25T08:45:17.803961+0000","last_active":"2024-04-25T08:45:18.802129+0000","last_peered":"2024-04-25T08:45:18.802129+0000","last_clean":"2024-04-25T08:45:18.802129+0000","last_became_active":"2024-04-25T08:45:17.803705+0000","last_became_peered":"2024-04-25T08:45:17.803705+0000","last_unstale":"2024-04-25T08:45:18.802129+0000","last_undegraded":"2024-04-25T08:45:18.802129+0000","last_fullsized":"2024-04-25T08:45:18.802129+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:05.039045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818478+0000","last_change":"2024-04-25T08:45:18.818777+0000","last_active":"2024-04-25T08:45:19.818478+0000","last_peered":"2024-04-25T08:45:19.818478+0000","last_clean":"2024-04-25T08:45:19.818478+0000","last_became_active":"2024-04-25T08:45:18.818176+0000","last_became_peered":"2024-04-25T08:45:18.818176+0000","last_unstale":"2024-04-25T08:45:19.818478+0000","last_undegraded":"2024-04-25T08:45:19.818478+0000","last_fullsized":"2024-04-25T08:45:19.818478+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:23.134616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.807562+0000","last_change":"2024-04-25T08:45:17.807674+0000","last_active":"2024-04-25T08:45:18.807562+0000","last_peered":"2024-04-25T08:45:18.807562+0000","last_clean":"2024-04-25T08:45:18.807562+0000","last_became_active":"2024-04-25T08:45:17.807455+0000","last_became_peered":"2024-04-25T08:45:17.807455+0000","last_unstale":"2024-04-25T08:45:18.807562+0000","last_undegraded":"2024-04-25T08:45:18.807562+0000","last_fullsized":"2024-04-25T08:45:18.807562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:08.963648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.821020+0000","last_change":"2024-04-25T08:45:18.815010+0000","last_active":"2024-04-25T08:45:18.821020+0000","last_peered":"2024-04-25T08:45:18.821020+0000","last_clean":"2024-04-25T08:45:18.821020+0000","last_became_active":"2024-04-25T08:45:18.814468+0000","last_became_peered":"2024-04-25T08:45:18.814468+0000","last_unstale":"2024-04-25T08:45:18.821020+0000","last_undegraded":"2024-04-25T08:45:18.821020+0000","last_fullsized":"2024-04-25T08:45:18.821020+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:23.134616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803214+0000","last_change":"2024-04-25T08:45:17.801098+0000","last_active":"2024-04-25T08:45:19.803214+0000","last_peered":"2024-04-25T08:45:19.803214+0000","last_clean":"2024-04-25T08:45:19.803214+0000","last_became_active":"2024-04-25T08:45:17.798374+0000","last_became_peered":"2024-04-25T08:45:17.798374+0000","last_unstale":"2024-04-25T08:45:19.803214+0000","last_undegraded":"2024-04-25T08:45:19.803214+0000","last_fullsized":"2024-04-25T08:45:19.803214+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:18.143078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804248+0000","last_change":"2024-04-25T08:45:18.806073+0000","last_active":"2024-04-25T08:45:19.804248+0000","last_peered":"2024-04-25T08:45:19.804248+0000","last_clean":"2024-04-25T08:45:19.804248+0000","last_became_active":"2024-04-25T08:45:18.805646+0000","last_became_peered":"2024-04-25T08:45:18.805646+0000","last_unstale":"2024-04-25T08:45:19.804248+0000","last_undegraded":"2024-04-25T08:45:19.804248+0000","last_fullsized":"2024-04-25T08:45:19.804248+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:46.408513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"54'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.819898+0000","last_change":"2024-04-25T08:45:17.808409+0000","last_active":"2024-04-25T08:45:19.819898+0000","last_peered":"2024-04-25T08:45:19.819898+0000","last_clean":"2024-04-25T08:45:19.819898+0000","last_became_active":"2024-04-25T08:45:17.808054+0000","last_became_peered":"2024-04-25T08:45:17.808054+0000","last_unstale":"2024-04-25T08:45:19.819898+0000","last_undegraded":"2024-04-25T08:45:19.819898+0000","last_fullsized":"2024-04-25T08:45:19.819898+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:06.415394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820392+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:45:19.820392+0000","last_peered":"2024-04-25T08:45:19.820392+0000","last_clean":"2024-04-25T08:45:19.820392+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:45:19.820392+0000","last_undegraded":"2024-04-25T08:45:19.820392+0000","last_fullsized":"2024-04-25T08:45:19.820392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":879702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":289862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":289210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35964,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335876,"statfs":{"total":96636764160,"available":96599937024,"internally_reserved":0,"allocated":634880,"data_stored":283100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":647168,"data_stored":284152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":643072,"data_stored":284130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":651264,"data_stored":289370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36560,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335280,"statfs":{"total":96636764160,"available":96599326720,"internally_reserved":0,"allocated":1245184,"data_stored":879634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:45:22.873 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:45:23.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.012+0000 7f9649b9e640 1 Processor -- start 2024-04-25T08:45:23.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.012+0000 7f9649b9e640 1 -- start start 2024-04-25T08:45:23.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f9649b9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f964415dc90 0x7f96441625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f9649b9e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f96440cc8e0 0x7f964415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f9649b9e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964415f390 con 0x7f96440d1810 2024-04-25T08:45:23.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f9649b9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96440cce50 con 0x7f964415dc90 2024-04-25T08:45:23.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f9649b9e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9644161af0 con 0x7f96440cc8e0 2024-04-25T08:45:23.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f96437fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f964415dc90 0x7f96441625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f96437fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f964415dc90 0x7f96441625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47694/0 (socket says 172.21.15.172:47694) 2024-04-25T08:45:23.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f96437fe640 1 -- 172.21.15.172:0/1915913905 learned_addr learned my addr 172.21.15.172:0/1915913905 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:23.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f9642ffd640 1 --2- 172.21.15.172:0/1915913905 >> v2:172.21.15.186:3300/0 conn(0x7f96440cc8e0 0x7f964415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f96437fe640 1 -- 172.21.15.172:0/1915913905 >> v2:172.21.15.186:3300/0 conn(0x7f96440cc8e0 msgr2=0x7f964415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:23.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f96437fe640 1 --2- 172.21.15.172:0/1915913905 >> v2:172.21.15.186:3300/0 conn(0x7f96440cc8e0 0x7f964415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f96437fe640 1 -- 172.21.15.172:0/1915913905 >> v1:172.21.15.186:6789/0 conn(0x7f96440d1810 legacy=0x7f96440cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.013+0000 7f96437fe640 1 -- 172.21.15.172:0/1915913905 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644161dd0 con 0x7f964415dc90 2024-04-25T08:45:23.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.014+0000 7f96437fe640 1 --2- 172.21.15.172:0/1915913905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 0x7f96441625d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f96440c88a0 tx=0x7f963402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea218898d6b8008 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:23.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.014+0000 7f96427fc640 1 -- 172.21.15.172:0/1915913905 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634037070 con 0x7f964415dc90 2024-04-25T08:45:23.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.014+0000 7f96427fc640 1 -- 172.21.15.172:0/1915913905 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9634032440 con 0x7f964415dc90 2024-04-25T08:45:23.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.014+0000 7f96427fc640 1 -- 172.21.15.172:0/1915913905 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634032810 con 0x7f964415dc90 2024-04-25T08:45:23.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.014+0000 7f9649b9e640 1 -- 172.21.15.172:0/1915913905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 msgr2=0x7f96441625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.014+0000 7f9649b9e640 1 --2- 172.21.15.172:0/1915913905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 0x7f96441625d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f96440c88a0 tx=0x7f963402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.014+0000 7f9649b9e640 1 -- 172.21.15.172:0/1915913905 shutdown_connections 2024-04-25T08:45:23.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.014+0000 7f9649b9e640 1 --2- 172.21.15.172:0/1915913905 >> v2:172.21.15.186:3300/0 conn(0x7f96440cc8e0 0x7f964415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.014+0000 7f9649b9e640 1 --2- 172.21.15.172:0/1915913905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 0x7f96441625d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.014+0000 7f9649b9e640 1 -- 172.21.15.172:0/1915913905 >> 172.21.15.172:0/1915913905 conn(0x7f964406f590 msgr2=0x7f964406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:23.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.015+0000 7f9649b9e640 1 -- 172.21.15.172:0/1915913905 shutdown_connections 2024-04-25T08:45:23.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.015+0000 7f9649b9e640 1 -- 172.21.15.172:0/1915913905 wait complete. 2024-04-25T08:45:23.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.016+0000 7f9649b9e640 1 Processor -- start 2024-04-25T08:45:23.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.016+0000 7f9649b9e640 1 -- start start 2024-04-25T08:45:23.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.016+0000 7f9649b9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96440cc8e0 0x7f9644155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.016+0000 7f9649b9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96440d1810 0x7f96440b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9649b9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 0x7f964415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9649b9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964415e070 con 0x7f964415dc90 2024-04-25T08:45:23.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9649b9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96440cd130 con 0x7f96440cc8e0 2024-04-25T08:45:23.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9649b9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964415e1f0 con 0x7f96440d1810 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9643fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 0x7f964415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9643fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 0x7f964415ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47706/0 (socket says 172.21.15.172:47706) 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9643fff640 1 -- 172.21.15.172:0/1196235508 learned_addr learned my addr 172.21.15.172:0/1196235508 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f96437fe640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96440cc8e0 0x7f9644155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9642ffd640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96440d1810 0x7f96440b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9643fff640 1 -- 172.21.15.172:0/1196235508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96440d1810 msgr2=0x7f96440b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9643fff640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96440d1810 0x7f96440b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9643fff640 1 -- 172.21.15.172:0/1196235508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96440cc8e0 msgr2=0x7f9644155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9643fff640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96440cc8e0 0x7f9644155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9643fff640 1 -- 172.21.15.172:0/1196235508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96441f3e20 con 0x7f964415dc90 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f96437fe640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96440cc8e0 0x7f9644155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9643fff640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 0x7f964415ace0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f963c00c730 tx=0x7f963c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f962bfff640 1 -- 172.21.15.172:0/1196235508 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c003b70 con 0x7f964415dc90 2024-04-25T08:45:23.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f962bfff640 1 -- 172.21.15.172:0/1196235508 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c003d30 con 0x7f964415dc90 2024-04-25T08:45:23.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f962bfff640 1 -- 172.21.15.172:0/1196235508 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c005310 con 0x7f964415dc90 2024-04-25T08:45:23.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9649b9e640 1 -- 172.21.15.172:0/1196235508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96441562a0 con 0x7f964415dc90 2024-04-25T08:45:23.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.017+0000 7f9649b9e640 1 -- 172.21.15.172:0/1196235508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96440b5970 con 0x7f964415dc90 2024-04-25T08:45:23.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.018+0000 7f9649b9e640 1 -- 172.21.15.172:0/1196235508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96440d1270 con 0x7f964415dc90 2024-04-25T08:45:23.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.019+0000 7f962bfff640 1 -- 172.21.15.172:0/1196235508 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f963c0056c0 con 0x7f964415dc90 2024-04-25T08:45:23.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.019+0000 7f962bfff640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f963006b4d0 0x7f963006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.019+0000 7f96437fe640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f963006b4d0 0x7f963006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.020+0000 7f962bfff640 1 -- 172.21.15.172:0/1196235508 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f963c08a400 con 0x7f964415dc90 2024-04-25T08:45:23.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.020+0000 7f96437fe640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f963006b4d0 0x7f963006d990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9634034000 tx=0x7f963402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:23.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.024+0000 7f962bfff640 1 -- 172.21.15.172:0/1196235508 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f96440d1270 con 0x7f964415dc90 2024-04-25T08:45:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.260+0000 7f9649b9e640 1 -- 172.21.15.172:0/1196235508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9644073990 con 0x7f964415dc90 2024-04-25T08:45:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.260+0000 7f962bfff640 1 -- 172.21.15.172:0/1196235508 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1023 (secure 0 0 0) 0x7f964415f390 con 0x7f964415dc90 2024-04-25T08:45:23.252 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:23.252 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":198,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":286908416,"bytes_avail":772807204864,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":23,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5877}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-04-25T08:45:08.545309+0000","services":{}},"progress_events":{}} 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.262+0000 7f9649b9e640 1 -- 172.21.15.172:0/1196235508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f963006b4d0 msgr2=0x7f963006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.262+0000 7f9649b9e640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f963006b4d0 0x7f963006d990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9634034000 tx=0x7f963402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.262+0000 7f9649b9e640 1 -- 172.21.15.172:0/1196235508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 msgr2=0x7f964415ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.262+0000 7f9649b9e640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 0x7f964415ace0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f963c00c730 tx=0x7f963c00cbf0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.262+0000 7f9649b9e640 1 -- 172.21.15.172:0/1196235508 shutdown_connections 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.262+0000 7f9649b9e640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f963006b4d0 0x7f963006d990 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.262+0000 7f9649b9e640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f964415dc90 0x7f964415ace0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.262+0000 7f9649b9e640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96440d1810 0x7f96440b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.262+0000 7f9649b9e640 1 --2- 172.21.15.172:0/1196235508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96440cc8e0 0x7f9644155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.262+0000 7f9649b9e640 1 -- 172.21.15.172:0/1196235508 >> 172.21.15.172:0/1196235508 conn(0x7f964406f590 msgr2=0x7f96440d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.263+0000 7f9649b9e640 1 -- 172.21.15.172:0/1196235508 shutdown_connections 2024-04-25T08:45:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.263+0000 7f9649b9e640 1 -- 172.21.15.172:0/1196235508 wait complete. 2024-04-25T08:45:23.265 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:45:23.266 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:45:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.370+0000 7ff4f48a3640 1 Processor -- start 2024-04-25T08:45:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.370+0000 7ff4f48a3640 1 -- start start 2024-04-25T08:45:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4f48a3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff4f006b5f0 0x7ff4f00cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4f48a3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f00cffb0 0x7ff4f015c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4f48a3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f015f710 con 0x7ff4f015b980 2024-04-25T08:45:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4f48a3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f015f9b0 con 0x7ff4f006b5f0 2024-04-25T08:45:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4f48a3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f015fc90 con 0x7ff4f00cffb0 2024-04-25T08:45:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4e7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff4f006b5f0 0x7ff4f00cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4ee59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff4f015b980 0x7ff4f00cf8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39386/0 (socket says 172.21.15.172:39386) 2024-04-25T08:45:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4ee59c640 1 -- 172.21.15.172:0/2271276985 learned_addr learned my addr 172.21.15.172:0/2271276985 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:23.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4eed9d640 1 --2- 172.21.15.172:0/2271276985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f00cffb0 0x7ff4f015c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4e7fff640 1 -- 172.21.15.172:0/2271276985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f00cffb0 msgr2=0x7ff4f015c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:23.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4e7fff640 1 --2- 172.21.15.172:0/2271276985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f00cffb0 0x7ff4f015c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4e7fff640 1 -- 172.21.15.172:0/2271276985 >> v1:172.21.15.172:6789/0 conn(0x7ff4f015b980 legacy=0x7ff4f00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4e7fff640 1 -- 172.21.15.172:0/2271276985 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f015ff70 con 0x7ff4f006b5f0 2024-04-25T08:45:23.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.371+0000 7ff4edd9b640 1 -- 172.21.15.172:0/2271276985 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431101178 0 0) 0x7ff4f015f710 con 0x7ff4f015b980 2024-04-25T08:45:23.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.372+0000 7ff4e7fff640 1 --2- 172.21.15.172:0/2271276985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f006b5f0 0x7ff4f00cc300 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80097a0 tx=0x7ff4d802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd5af16785f8d72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:23.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.372+0000 7ff4edd9b640 1 -- 172.21.15.172:0/2271276985 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8037070 con 0x7ff4f006b5f0 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.372+0000 7ff4edd9b640 1 -- 172.21.15.172:0/2271276985 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d8032440 con 0x7ff4f006b5f0 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.372+0000 7ff4edd9b640 1 -- 172.21.15.172:0/2271276985 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8032810 con 0x7ff4f006b5f0 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.373+0000 7ff4f48a3640 1 -- 172.21.15.172:0/2271276985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f006b5f0 msgr2=0x7ff4f00cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.373+0000 7ff4f48a3640 1 --2- 172.21.15.172:0/2271276985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f006b5f0 0x7ff4f00cc300 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80097a0 tx=0x7ff4d802a180 comp rx=0 tx=0).stop 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.373+0000 7ff4f48a3640 1 -- 172.21.15.172:0/2271276985 shutdown_connections 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.373+0000 7ff4f48a3640 1 --2- 172.21.15.172:0/2271276985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f00cffb0 0x7ff4f015c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.373+0000 7ff4f48a3640 1 --2- 172.21.15.172:0/2271276985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f006b5f0 0x7ff4f00cc300 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.373+0000 7ff4f48a3640 1 -- 172.21.15.172:0/2271276985 >> 172.21.15.172:0/2271276985 conn(0x7ff4f00b2220 msgr2=0x7ff4f00b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.373+0000 7ff4f48a3640 1 -- 172.21.15.172:0/2271276985 shutdown_connections 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.373+0000 7ff4f48a3640 1 -- 172.21.15.172:0/2271276985 wait complete. 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.374+0000 7ff4f48a3640 1 Processor -- start 2024-04-25T08:45:23.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.374+0000 7ff4f48a3640 1 -- start start 2024-04-25T08:45:23.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4f48a3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f006b5f0 0x7ff4f00b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4f48a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f00cffb0 0x7ff4f01f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4f48a3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4f015b980 0x7ff4f00b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4f48a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00cf550 con 0x7ff4f00cffb0 2024-04-25T08:45:23.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4f48a3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f015bd60 con 0x7ff4f015b980 2024-04-25T08:45:23.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4f48a3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00b2d40 con 0x7ff4f006b5f0 2024-04-25T08:45:23.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4e7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f00cffb0 0x7ff4f01f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4e7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f00cffb0 0x7ff4f01f0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47718/0 (socket says 172.21.15.172:47718) 2024-04-25T08:45:23.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4e7fff640 1 -- 172.21.15.172:0/1002046236 learned_addr learned my addr 172.21.15.172:0/1002046236 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4eed9d640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4f015b980 0x7ff4f00b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4ee59c640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f006b5f0 0x7ff4f00b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4e7fff640 1 -- 172.21.15.172:0/1002046236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f006b5f0 msgr2=0x7ff4f00b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4e7fff640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f006b5f0 0x7ff4f00b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4e7fff640 1 -- 172.21.15.172:0/1002046236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4f015b980 msgr2=0x7ff4f00b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4e7fff640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4f015b980 0x7ff4f00b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4e7fff640 1 -- 172.21.15.172:0/1002046236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00b47c0 con 0x7ff4f00cffb0 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4ee59c640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f006b5f0 0x7ff4f00b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4e7fff640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f00cffb0 0x7ff4f01f0c50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80098c0 tx=0x7ff4d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.375+0000 7ff4e6ffd640 1 -- 172.21.15.172:0/1002046236 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8037040 con 0x7ff4f00cffb0 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.376+0000 7ff4e6ffd640 1 -- 172.21.15.172:0/1002046236 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d8030770 con 0x7ff4f00cffb0 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.376+0000 7ff4e6ffd640 1 -- 172.21.15.172:0/1002046236 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8030b40 con 0x7ff4f00cffb0 2024-04-25T08:45:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.376+0000 7ff4f48a3640 1 -- 172.21.15.172:0/1002046236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f00b4aa0 con 0x7ff4f00cffb0 2024-04-25T08:45:23.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.376+0000 7ff4f48a3640 1 -- 172.21.15.172:0/1002046236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f01550e0 con 0x7ff4f00cffb0 2024-04-25T08:45:23.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.376+0000 7ff4f48a3640 1 -- 172.21.15.172:0/1002046236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f00b4c70 con 0x7ff4f00cffb0 2024-04-25T08:45:23.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.377+0000 7ff4e6ffd640 1 -- 172.21.15.172:0/1002046236 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff4d8044020 con 0x7ff4f00cffb0 2024-04-25T08:45:23.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.377+0000 7ff4e6ffd640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff4d006b4d0 0x7ff4d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:23.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.377+0000 7ff4e6ffd640 1 -- 172.21.15.172:0/1002046236 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff4d80aa840 con 0x7ff4f00cffb0 2024-04-25T08:45:23.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.377+0000 7ff4ee59c640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff4d006b4d0 0x7ff4d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:23.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.378+0000 7ff4ee59c640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff4d006b4d0 0x7ff4d006d990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0000f60 tx=0x7ff4e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:23.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.382+0000 7ff4e6ffd640 1 -- 172.21.15.172:0/1002046236 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff4d8032e20 con 0x7ff4f00cffb0 2024-04-25T08:45:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.548+0000 7ff4f48a3640 1 -- 172.21.15.172:0/1002046236 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4f0073990 con 0x7ff4d006b4d0 2024-04-25T08:45:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.554+0000 7ff4e6ffd640 1 -- 172.21.15.172:0/1002046236 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251937 (secure 0 0 0) 0x7ff4f0073990 con 0x7ff4d006b4d0 2024-04-25T08:45:23.548 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:23.550 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:45:23.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.557+0000 7ff4f48a3640 1 -- 172.21.15.172:0/1002046236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff4d006b4d0 msgr2=0x7ff4d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.557+0000 7ff4f48a3640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff4d006b4d0 0x7ff4d006d990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0000f60 tx=0x7ff4e0009040 comp rx=0 tx=0).stop 2024-04-25T08:45:23.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.557+0000 7ff4f48a3640 1 -- 172.21.15.172:0/1002046236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f00cffb0 msgr2=0x7ff4f01f0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:23.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.557+0000 7ff4f48a3640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f00cffb0 0x7ff4f01f0c50 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80098c0 tx=0x7ff4d80046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.558+0000 7ff4f48a3640 1 -- 172.21.15.172:0/1002046236 shutdown_connections 2024-04-25T08:45:23.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.558+0000 7ff4f48a3640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff4d006b4d0 0x7ff4d006d990 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.558+0000 7ff4f48a3640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4f015b980 0x7ff4f00b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.558+0000 7ff4f48a3640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f00cffb0 0x7ff4f01f0c50 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.558+0000 7ff4f48a3640 1 --2- 172.21.15.172:0/1002046236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4f006b5f0 0x7ff4f00b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:23.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.558+0000 7ff4f48a3640 1 -- 172.21.15.172:0/1002046236 >> 172.21.15.172:0/1002046236 conn(0x7ff4f00b2220 msgr2=0x7ff4f00ada70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:23.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.558+0000 7ff4f48a3640 1 -- 172.21.15.172:0/1002046236 shutdown_connections 2024-04-25T08:45:23.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:23.558+0000 7ff4f48a3640 1 -- 172.21.15.172:0/1002046236 wait complete. 2024-04-25T08:45:23.560 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-04-25T08:45:22.547590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":280660,"kb_used_data":6212,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754694060,"statfs":{"total":773094113280,"available":772806717440,"internally_reserved":0,"allocated":6361088,"data_stored":3479160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.763143"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804833+0000","last_change":"2024-04-25T08:45:18.808381+0000","last_active":"2024-04-25T08:45:19.804833+0000","last_peered":"2024-04-25T08:45:19.804833+0000","last_clean":"2024-04-25T08:45:19.804833+0000","last_became_active":"2024-04-25T08:45:18.808133+0000","last_became_peered":"2024-04-25T08:45:18.808133+0000","last_unstale":"2024-04-25T08:45:19.804833+0000","last_undegraded":"2024-04-25T08:45:19.804833+0000","last_fullsized":"2024-04-25T08:45:19.804833+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:45.316373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.821007+0000","last_change":"2024-04-25T08:45:18.816452+0000","last_active":"2024-04-25T08:45:19.821007+0000","last_peered":"2024-04-25T08:45:19.821007+0000","last_clean":"2024-04-25T08:45:19.821007+0000","last_became_active":"2024-04-25T08:45:18.816182+0000","last_became_peered":"2024-04-25T08:45:18.816182+0000","last_unstale":"2024-04-25T08:45:19.821007+0000","last_undegraded":"2024-04-25T08:45:19.821007+0000","last_fullsized":"2024-04-25T08:45:19.821007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:06.045642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818416+0000","last_change":"2024-04-25T08:45:18.812932+0000","last_active":"2024-04-25T08:45:19.818416+0000","last_peered":"2024-04-25T08:45:19.818416+0000","last_clean":"2024-04-25T08:45:19.818416+0000","last_became_active":"2024-04-25T08:45:18.812661+0000","last_became_peered":"2024-04-25T08:45:18.812661+0000","last_unstale":"2024-04-25T08:45:19.818416+0000","last_undegraded":"2024-04-25T08:45:19.818416+0000","last_fullsized":"2024-04-25T08:45:19.818416+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:27.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820758+0000","last_change":"2024-04-25T08:45:18.813517+0000","last_active":"2024-04-25T08:45:19.820758+0000","last_peered":"2024-04-25T08:45:19.820758+0000","last_clean":"2024-04-25T08:45:19.820758+0000","last_became_active":"2024-04-25T08:45:18.812328+0000","last_became_peered":"2024-04-25T08:45:18.812328+0000","last_unstale":"2024-04-25T08:45:19.820758+0000","last_undegraded":"2024-04-25T08:45:19.820758+0000","last_fullsized":"2024-04-25T08:45:19.820758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:59.678260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.824949+0000","last_change":"2024-04-25T08:45:18.820153+0000","last_active":"2024-04-25T08:45:18.824949+0000","last_peered":"2024-04-25T08:45:18.824949+0000","last_clean":"2024-04-25T08:45:18.824949+0000","last_became_active":"2024-04-25T08:45:18.818010+0000","last_became_peered":"2024-04-25T08:45:18.818010+0000","last_unstale":"2024-04-25T08:45:18.824949+0000","last_undegraded":"2024-04-25T08:45:18.824949+0000","last_fullsized":"2024-04-25T08:45:18.824949+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:43.970122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804462+0000","last_change":"2024-04-25T08:45:18.814509+0000","last_active":"2024-04-25T08:45:19.804462+0000","last_peered":"2024-04-25T08:45:19.804462+0000","last_clean":"2024-04-25T08:45:19.804462+0000","last_became_active":"2024-04-25T08:45:18.814250+0000","last_became_peered":"2024-04-25T08:45:18.814250+0000","last_unstale":"2024-04-25T08:45:19.804462+0000","last_undegraded":"2024-04-25T08:45:19.804462+0000","last_fullsized":"2024-04-25T08:45:19.804462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:44.477349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818101+0000","last_change":"2024-04-25T08:45:18.813257+0000","last_active":"2024-04-25T08:45:19.818101+0000","last_peered":"2024-04-25T08:45:19.818101+0000","last_clean":"2024-04-25T08:45:19.818101+0000","last_became_active":"2024-04-25T08:45:18.812942+0000","last_became_peered":"2024-04-25T08:45:18.812942+0000","last_unstale":"2024-04-25T08:45:19.818101+0000","last_undegraded":"2024-04-25T08:45:19.818101+0000","last_fullsized":"2024-04-25T08:45:19.818101+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:58.824000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.814761+0000","last_change":"2024-04-25T08:45:18.811425+0000","last_active":"2024-04-25T08:45:18.814761+0000","last_peered":"2024-04-25T08:45:18.814761+0000","last_clean":"2024-04-25T08:45:18.814761+0000","last_became_active":"2024-04-25T08:45:18.811053+0000","last_became_peered":"2024-04-25T08:45:18.811053+0000","last_unstale":"2024-04-25T08:45:18.814761+0000","last_undegraded":"2024-04-25T08:45:18.814761+0000","last_fullsized":"2024-04-25T08:45:18.814761+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:05.538676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.822045+0000","last_change":"2024-04-25T08:45:18.821468+0000","last_active":"2024-04-25T08:45:18.822045+0000","last_peered":"2024-04-25T08:45:18.822045+0000","last_clean":"2024-04-25T08:45:18.822045+0000","last_became_active":"2024-04-25T08:45:18.820592+0000","last_became_peered":"2024-04-25T08:45:18.820592+0000","last_unstale":"2024-04-25T08:45:18.822045+0000","last_undegraded":"2024-04-25T08:45:18.822045+0000","last_fullsized":"2024-04-25T08:45:18.822045+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:37.225948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804810+0000","last_change":"2024-04-25T08:45:18.816572+0000","last_active":"2024-04-25T08:45:19.804810+0000","last_peered":"2024-04-25T08:45:19.804810+0000","last_clean":"2024-04-25T08:45:19.804810+0000","last_became_active":"2024-04-25T08:45:18.816307+0000","last_became_peered":"2024-04-25T08:45:18.816307+0000","last_unstale":"2024-04-25T08:45:19.804810+0000","last_undegraded":"2024-04-25T08:45:19.804810+0000","last_fullsized":"2024-04-25T08:45:19.804810+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:47.307740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.817107+0000","last_change":"2024-04-25T08:45:18.814478+0000","last_active":"2024-04-25T08:45:18.817107+0000","last_peered":"2024-04-25T08:45:18.817107+0000","last_clean":"2024-04-25T08:45:18.817107+0000","last_became_active":"2024-04-25T08:45:18.814241+0000","last_became_peered":"2024-04-25T08:45:18.814241+0000","last_unstale":"2024-04-25T08:45:18.817107+0000","last_undegraded":"2024-04-25T08:45:18.817107+0000","last_fullsized":"2024-04-25T08:45:18.817107+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:24.794944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.810769+0000","last_change":"2024-04-25T08:45:18.807537+0000","last_active":"2024-04-25T08:45:18.810769+0000","last_peered":"2024-04-25T08:45:18.810769+0000","last_clean":"2024-04-25T08:45:18.810769+0000","last_became_active":"2024-04-25T08:45:18.806588+0000","last_became_peered":"2024-04-25T08:45:18.806588+0000","last_unstale":"2024-04-25T08:45:18.810769+0000","last_undegraded":"2024-04-25T08:45:18.810769+0000","last_fullsized":"2024-04-25T08:45:18.810769+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:21.517873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804507+0000","last_change":"2024-04-25T08:45:18.813226+0000","last_active":"2024-04-25T08:45:19.804507+0000","last_peered":"2024-04-25T08:45:19.804507+0000","last_clean":"2024-04-25T08:45:19.804507+0000","last_became_active":"2024-04-25T08:45:18.812923+0000","last_became_peered":"2024-04-25T08:45:18.812923+0000","last_unstale":"2024-04-25T08:45:19.804507+0000","last_undegraded":"2024-04-25T08:45:19.804507+0000","last_fullsized":"2024-04-25T08:45:19.804507+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:18.141783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818311+0000","last_change":"2024-04-25T08:45:18.817433+0000","last_active":"2024-04-25T08:45:19.818311+0000","last_peered":"2024-04-25T08:45:19.818311+0000","last_clean":"2024-04-25T08:45:19.818311+0000","last_became_active":"2024-04-25T08:45:18.817185+0000","last_became_peered":"2024-04-25T08:45:18.817185+0000","last_unstale":"2024-04-25T08:45:19.818311+0000","last_undegraded":"2024-04-25T08:45:19.818311+0000","last_fullsized":"2024-04-25T08:45:19.818311+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:13.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820608+0000","last_change":"2024-04-25T08:45:18.818766+0000","last_active":"2024-04-25T08:45:19.820608+0000","last_peered":"2024-04-25T08:45:19.820608+0000","last_clean":"2024-04-25T08:45:19.820608+0000","last_became_active":"2024-04-25T08:45:18.818486+0000","last_became_peered":"2024-04-25T08:45:18.818486+0000","last_unstale":"2024-04-25T08:45:19.820608+0000","last_undegraded":"2024-04-25T08:45:19.820608+0000","last_fullsized":"2024-04-25T08:45:19.820608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:39.831346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804271+0000","last_change":"2024-04-25T08:45:18.812328+0000","last_active":"2024-04-25T08:45:19.804271+0000","last_peered":"2024-04-25T08:45:19.804271+0000","last_clean":"2024-04-25T08:45:19.804271+0000","last_became_active":"2024-04-25T08:45:18.812060+0000","last_became_peered":"2024-04-25T08:45:18.812060+0000","last_unstale":"2024-04-25T08:45:19.804271+0000","last_undegraded":"2024-04-25T08:45:19.804271+0000","last_fullsized":"2024-04-25T08:45:19.804271+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:07.421990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818584+0000","last_change":"2024-04-25T08:45:18.811962+0000","last_active":"2024-04-25T08:45:19.818584+0000","last_peered":"2024-04-25T08:45:19.818584+0000","last_clean":"2024-04-25T08:45:19.818584+0000","last_became_active":"2024-04-25T08:45:18.811504+0000","last_became_peered":"2024-04-25T08:45:18.811504+0000","last_unstale":"2024-04-25T08:45:19.818584+0000","last_undegraded":"2024-04-25T08:45:19.818584+0000","last_fullsized":"2024-04-25T08:45:19.818584+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:17.800955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.821074+0000","last_change":"2024-04-25T08:45:18.815126+0000","last_active":"2024-04-25T08:45:19.821074+0000","last_peered":"2024-04-25T08:45:19.821074+0000","last_clean":"2024-04-25T08:45:19.821074+0000","last_became_active":"2024-04-25T08:45:18.814855+0000","last_became_peered":"2024-04-25T08:45:18.814855+0000","last_unstale":"2024-04-25T08:45:19.821074+0000","last_undegraded":"2024-04-25T08:45:19.821074+0000","last_fullsized":"2024-04-25T08:45:19.821074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:01.492205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818492+0000","last_change":"2024-04-25T08:45:18.817199+0000","last_active":"2024-04-25T08:45:19.818492+0000","last_peered":"2024-04-25T08:45:19.818492+0000","last_clean":"2024-04-25T08:45:19.818492+0000","last_became_active":"2024-04-25T08:45:18.816814+0000","last_became_peered":"2024-04-25T08:45:18.816814+0000","last_unstale":"2024-04-25T08:45:19.818492+0000","last_undegraded":"2024-04-25T08:45:19.818492+0000","last_fullsized":"2024-04-25T08:45:19.818492+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:06.813911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803737+0000","last_change":"2024-04-25T08:45:18.817338+0000","last_active":"2024-04-25T08:45:19.803737+0000","last_peered":"2024-04-25T08:45:19.803737+0000","last_clean":"2024-04-25T08:45:19.803737+0000","last_became_active":"2024-04-25T08:45:18.817056+0000","last_became_peered":"2024-04-25T08:45:18.817056+0000","last_unstale":"2024-04-25T08:45:19.803737+0000","last_undegraded":"2024-04-25T08:45:19.803737+0000","last_fullsized":"2024-04-25T08:45:19.803737+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:27.789534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803947+0000","last_change":"2024-04-25T08:45:18.819401+0000","last_active":"2024-04-25T08:45:19.803947+0000","last_peered":"2024-04-25T08:45:19.803947+0000","last_clean":"2024-04-25T08:45:19.803947+0000","last_became_active":"2024-04-25T08:45:18.819138+0000","last_became_peered":"2024-04-25T08:45:18.819138+0000","last_unstale":"2024-04-25T08:45:19.803947+0000","last_undegraded":"2024-04-25T08:45:19.803947+0000","last_fullsized":"2024-04-25T08:45:19.803947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:28.771073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.820962+0000","last_change":"2024-04-25T08:45:18.817815+0000","last_active":"2024-04-25T08:45:18.820962+0000","last_peered":"2024-04-25T08:45:18.820962+0000","last_clean":"2024-04-25T08:45:18.820962+0000","last_became_active":"2024-04-25T08:45:18.816694+0000","last_became_peered":"2024-04-25T08:45:18.816694+0000","last_unstale":"2024-04-25T08:45:18.820962+0000","last_undegraded":"2024-04-25T08:45:18.820962+0000","last_fullsized":"2024-04-25T08:45:18.820962+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:06.813911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.821277+0000","last_change":"2024-04-25T08:45:18.817738+0000","last_active":"2024-04-25T08:45:18.821277+0000","last_peered":"2024-04-25T08:45:18.821277+0000","last_clean":"2024-04-25T08:45:18.821277+0000","last_became_active":"2024-04-25T08:45:18.817465+0000","last_became_peered":"2024-04-25T08:45:18.817465+0000","last_unstale":"2024-04-25T08:45:18.821277+0000","last_undegraded":"2024-04-25T08:45:18.821277+0000","last_fullsized":"2024-04-25T08:45:18.821277+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:56.767629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818062+0000","last_change":"2024-04-25T08:45:18.816702+0000","last_active":"2024-04-25T08:45:19.818062+0000","last_peered":"2024-04-25T08:45:19.818062+0000","last_clean":"2024-04-25T08:45:19.818062+0000","last_became_active":"2024-04-25T08:45:18.816452+0000","last_became_peered":"2024-04-25T08:45:18.816452+0000","last_unstale":"2024-04-25T08:45:19.818062+0000","last_undegraded":"2024-04-25T08:45:19.818062+0000","last_fullsized":"2024-04-25T08:45:19.818062+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:21.517873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818670+0000","last_change":"2024-04-25T08:45:18.813768+0000","last_active":"2024-04-25T08:45:19.818670+0000","last_peered":"2024-04-25T08:45:19.818670+0000","last_clean":"2024-04-25T08:45:19.818670+0000","last_became_active":"2024-04-25T08:45:18.812372+0000","last_became_peered":"2024-04-25T08:45:18.812372+0000","last_unstale":"2024-04-25T08:45:19.818670+0000","last_undegraded":"2024-04-25T08:45:19.818670+0000","last_fullsized":"2024-04-25T08:45:19.818670+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:41.400003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.820219+0000","last_change":"2024-04-25T08:45:18.814137+0000","last_active":"2024-04-25T08:45:18.820219+0000","last_peered":"2024-04-25T08:45:18.820219+0000","last_clean":"2024-04-25T08:45:18.820219+0000","last_became_active":"2024-04-25T08:45:18.813607+0000","last_became_peered":"2024-04-25T08:45:18.813607+0000","last_unstale":"2024-04-25T08:45:18.820219+0000","last_undegraded":"2024-04-25T08:45:18.820219+0000","last_fullsized":"2024-04-25T08:45:18.820219+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:55.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804880+0000","last_change":"2024-04-25T08:45:18.811043+0000","last_active":"2024-04-25T08:45:19.804880+0000","last_peered":"2024-04-25T08:45:19.804880+0000","last_clean":"2024-04-25T08:45:19.804880+0000","last_became_active":"2024-04-25T08:45:18.809769+0000","last_became_peered":"2024-04-25T08:45:18.809769+0000","last_unstale":"2024-04-25T08:45:19.804880+0000","last_undegraded":"2024-04-25T08:45:19.804880+0000","last_fullsized":"2024-04-25T08:45:19.804880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:39.831346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803907+0000","last_change":"2024-04-25T08:45:18.809403+0000","last_active":"2024-04-25T08:45:19.803907+0000","last_peered":"2024-04-25T08:45:19.803907+0000","last_clean":"2024-04-25T08:45:19.803907+0000","last_became_active":"2024-04-25T08:45:18.809134+0000","last_became_peered":"2024-04-25T08:45:18.809134+0000","last_unstale":"2024-04-25T08:45:19.803907+0000","last_undegraded":"2024-04-25T08:45:19.803907+0000","last_fullsized":"2024-04-25T08:45:19.803907+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:07.424894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818328+0000","last_change":"2024-04-25T08:45:18.812719+0000","last_active":"2024-04-25T08:45:19.818328+0000","last_peered":"2024-04-25T08:45:19.818328+0000","last_clean":"2024-04-25T08:45:19.818328+0000","last_became_active":"2024-04-25T08:45:18.812448+0000","last_became_peered":"2024-04-25T08:45:18.812448+0000","last_unstale":"2024-04-25T08:45:19.818328+0000","last_undegraded":"2024-04-25T08:45:19.818328+0000","last_fullsized":"2024-04-25T08:45:19.818328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:56.948524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820676+0000","last_change":"2024-04-25T08:45:18.819965+0000","last_active":"2024-04-25T08:45:19.820676+0000","last_peered":"2024-04-25T08:45:19.820676+0000","last_clean":"2024-04-25T08:45:19.820676+0000","last_became_active":"2024-04-25T08:45:18.819478+0000","last_became_peered":"2024-04-25T08:45:18.819478+0000","last_unstale":"2024-04-25T08:45:19.820676+0000","last_undegraded":"2024-04-25T08:45:19.820676+0000","last_fullsized":"2024-04-25T08:45:19.820676+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:19.149675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818198+0000","last_change":"2024-04-25T08:45:18.812158+0000","last_active":"2024-04-25T08:45:19.818198+0000","last_peered":"2024-04-25T08:45:19.818198+0000","last_clean":"2024-04-25T08:45:19.818198+0000","last_became_active":"2024-04-25T08:45:18.811885+0000","last_became_peered":"2024-04-25T08:45:18.811885+0000","last_unstale":"2024-04-25T08:45:19.818198+0000","last_undegraded":"2024-04-25T08:45:19.818198+0000","last_fullsized":"2024-04-25T08:45:19.818198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:05.538676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803094+0000","last_change":"2024-04-25T08:45:18.806217+0000","last_active":"2024-04-25T08:45:19.803094+0000","last_peered":"2024-04-25T08:45:19.803094+0000","last_clean":"2024-04-25T08:45:19.803094+0000","last_became_active":"2024-04-25T08:45:18.805547+0000","last_became_peered":"2024-04-25T08:45:18.805547+0000","last_unstale":"2024-04-25T08:45:19.803094+0000","last_undegraded":"2024-04-25T08:45:19.803094+0000","last_fullsized":"2024-04-25T08:45:19.803094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:13.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820393+0000","last_change":"2024-04-25T08:45:18.823127+0000","last_active":"2024-04-25T08:45:19.820393+0000","last_peered":"2024-04-25T08:45:19.820393+0000","last_clean":"2024-04-25T08:45:19.820393+0000","last_became_active":"2024-04-25T08:45:18.822827+0000","last_became_peered":"2024-04-25T08:45:18.822827+0000","last_unstale":"2024-04-25T08:45:19.820393+0000","last_undegraded":"2024-04-25T08:45:19.820393+0000","last_fullsized":"2024-04-25T08:45:19.820393+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:45.316373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804028+0000","last_change":"2024-04-25T08:45:17.798176+0000","last_active":"2024-04-25T08:45:19.804028+0000","last_peered":"2024-04-25T08:45:19.804028+0000","last_clean":"2024-04-25T08:45:19.804028+0000","last_became_active":"2024-04-25T08:45:17.797819+0000","last_became_peered":"2024-04-25T08:45:17.797819+0000","last_unstale":"2024-04-25T08:45:19.804028+0000","last_undegraded":"2024-04-25T08:45:19.804028+0000","last_fullsized":"2024-04-25T08:45:19.804028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:23.144816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803606+0000","last_change":"2024-04-25T08:45:18.818475+0000","last_active":"2024-04-25T08:45:19.803606+0000","last_peered":"2024-04-25T08:45:19.803606+0000","last_clean":"2024-04-25T08:45:19.803606+0000","last_became_active":"2024-04-25T08:45:18.818139+0000","last_became_peered":"2024-04-25T08:45:18.818139+0000","last_unstale":"2024-04-25T08:45:19.803606+0000","last_undegraded":"2024-04-25T08:45:19.803606+0000","last_fullsized":"2024-04-25T08:45:19.803606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:27.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804775+0000","last_change":"2024-04-25T08:45:17.809481+0000","last_active":"2024-04-25T08:45:19.804775+0000","last_peered":"2024-04-25T08:45:19.804775+0000","last_clean":"2024-04-25T08:45:19.804775+0000","last_became_active":"2024-04-25T08:45:17.809229+0000","last_became_peered":"2024-04-25T08:45:17.809229+0000","last_unstale":"2024-04-25T08:45:19.804775+0000","last_undegraded":"2024-04-25T08:45:19.804775+0000","last_fullsized":"2024-04-25T08:45:19.804775+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:14.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804496+0000","last_change":"2024-04-25T08:45:18.812140+0000","last_active":"2024-04-25T08:45:19.804496+0000","last_peered":"2024-04-25T08:45:19.804496+0000","last_clean":"2024-04-25T08:45:19.804496+0000","last_became_active":"2024-04-25T08:45:18.811876+0000","last_became_peered":"2024-04-25T08:45:18.811876+0000","last_unstale":"2024-04-25T08:45:19.804496+0000","last_undegraded":"2024-04-25T08:45:19.804496+0000","last_fullsized":"2024-04-25T08:45:19.804496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:07.421990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804848+0000","last_change":"2024-04-25T08:45:17.801691+0000","last_active":"2024-04-25T08:45:19.804848+0000","last_peered":"2024-04-25T08:45:19.804848+0000","last_clean":"2024-04-25T08:45:19.804848+0000","last_became_active":"2024-04-25T08:45:17.800726+0000","last_became_peered":"2024-04-25T08:45:17.800726+0000","last_unstale":"2024-04-25T08:45:19.804848+0000","last_undegraded":"2024-04-25T08:45:19.804848+0000","last_fullsized":"2024-04-25T08:45:19.804848+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:08.963648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.814788+0000","last_change":"2024-04-25T08:45:18.812760+0000","last_active":"2024-04-25T08:45:18.814788+0000","last_peered":"2024-04-25T08:45:18.814788+0000","last_clean":"2024-04-25T08:45:18.814788+0000","last_became_active":"2024-04-25T08:45:18.812525+0000","last_became_peered":"2024-04-25T08:45:18.812525+0000","last_unstale":"2024-04-25T08:45:18.814788+0000","last_undegraded":"2024-04-25T08:45:18.814788+0000","last_fullsized":"2024-04-25T08:45:18.814788+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:13.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803786+0000","last_change":"2024-04-25T08:45:17.802514+0000","last_active":"2024-04-25T08:45:19.803786+0000","last_peered":"2024-04-25T08:45:19.803786+0000","last_clean":"2024-04-25T08:45:19.803786+0000","last_became_active":"2024-04-25T08:45:17.802246+0000","last_became_peered":"2024-04-25T08:45:17.802246+0000","last_unstale":"2024-04-25T08:45:19.803786+0000","last_undegraded":"2024-04-25T08:45:19.803786+0000","last_fullsized":"2024-04-25T08:45:19.803786+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:38.824749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.825087+0000","last_change":"2024-04-25T08:45:18.817582+0000","last_active":"2024-04-25T08:45:18.825087+0000","last_peered":"2024-04-25T08:45:18.825087+0000","last_clean":"2024-04-25T08:45:18.825087+0000","last_became_active":"2024-04-25T08:45:18.817310+0000","last_became_peered":"2024-04-25T08:45:18.817310+0000","last_unstale":"2024-04-25T08:45:18.825087+0000","last_undegraded":"2024-04-25T08:45:18.825087+0000","last_fullsized":"2024-04-25T08:45:18.825087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:39.455423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818296+0000","last_change":"2024-04-25T08:45:17.810355+0000","last_active":"2024-04-25T08:45:19.818296+0000","last_peered":"2024-04-25T08:45:19.818296+0000","last_clean":"2024-04-25T08:45:19.818296+0000","last_became_active":"2024-04-25T08:45:17.809979+0000","last_became_peered":"2024-04-25T08:45:17.809979+0000","last_unstale":"2024-04-25T08:45:19.818296+0000","last_undegraded":"2024-04-25T08:45:19.818296+0000","last_fullsized":"2024-04-25T08:45:19.818296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:28.037489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820804+0000","last_change":"2024-04-25T08:45:18.818362+0000","last_active":"2024-04-25T08:45:19.820804+0000","last_peered":"2024-04-25T08:45:19.820804+0000","last_clean":"2024-04-25T08:45:19.820804+0000","last_became_active":"2024-04-25T08:45:18.818063+0000","last_became_peered":"2024-04-25T08:45:18.818063+0000","last_unstale":"2024-04-25T08:45:19.820804+0000","last_undegraded":"2024-04-25T08:45:19.820804+0000","last_fullsized":"2024-04-25T08:45:19.820804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:32.847694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.829770+0000","last_change":"2024-04-25T08:45:17.800390+0000","last_active":"2024-04-25T08:45:18.829770+0000","last_peered":"2024-04-25T08:45:18.829770+0000","last_clean":"2024-04-25T08:45:18.829770+0000","last_became_active":"2024-04-25T08:45:17.800099+0000","last_became_peered":"2024-04-25T08:45:17.800099+0000","last_unstale":"2024-04-25T08:45:18.829770+0000","last_undegraded":"2024-04-25T08:45:18.829770+0000","last_fullsized":"2024-04-25T08:45:18.829770+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:46.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.820196+0000","last_change":"2024-04-25T08:45:18.813926+0000","last_active":"2024-04-25T08:45:18.820196+0000","last_peered":"2024-04-25T08:45:18.820196+0000","last_clean":"2024-04-25T08:45:18.820196+0000","last_became_active":"2024-04-25T08:45:18.813576+0000","last_became_peered":"2024-04-25T08:45:18.813576+0000","last_unstale":"2024-04-25T08:45:18.820196+0000","last_undegraded":"2024-04-25T08:45:18.820196+0000","last_fullsized":"2024-04-25T08:45:18.820196+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:56.948524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804342+0000","last_change":"2024-04-25T08:45:17.802334+0000","last_active":"2024-04-25T08:45:19.804342+0000","last_peered":"2024-04-25T08:45:19.804342+0000","last_clean":"2024-04-25T08:45:19.804342+0000","last_became_active":"2024-04-25T08:45:17.802078+0000","last_became_peered":"2024-04-25T08:45:17.802078+0000","last_unstale":"2024-04-25T08:45:19.804342+0000","last_undegraded":"2024-04-25T08:45:19.804342+0000","last_fullsized":"2024-04-25T08:45:19.804342+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:19.594037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820804+0000","last_change":"2024-04-25T08:45:18.819710+0000","last_active":"2024-04-25T08:45:19.820804+0000","last_peered":"2024-04-25T08:45:19.820804+0000","last_clean":"2024-04-25T08:45:19.820804+0000","last_became_active":"2024-04-25T08:45:18.819347+0000","last_became_peered":"2024-04-25T08:45:18.819347+0000","last_unstale":"2024-04-25T08:45:19.820804+0000","last_undegraded":"2024-04-25T08:45:19.820804+0000","last_fullsized":"2024-04-25T08:45:19.820804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:12.202880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818079+0000","last_change":"2024-04-25T08:45:17.805228+0000","last_active":"2024-04-25T08:45:19.818079+0000","last_peered":"2024-04-25T08:45:19.818079+0000","last_clean":"2024-04-25T08:45:19.818079+0000","last_became_active":"2024-04-25T08:45:17.804964+0000","last_became_peered":"2024-04-25T08:45:17.804964+0000","last_unstale":"2024-04-25T08:45:19.818079+0000","last_undegraded":"2024-04-25T08:45:19.818079+0000","last_fullsized":"2024-04-25T08:45:19.818079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:27.764477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.816634+0000","last_change":"2024-04-25T08:45:18.814488+0000","last_active":"2024-04-25T08:45:18.816634+0000","last_peered":"2024-04-25T08:45:18.816634+0000","last_clean":"2024-04-25T08:45:18.816634+0000","last_became_active":"2024-04-25T08:45:18.814172+0000","last_became_peered":"2024-04-25T08:45:18.814172+0000","last_unstale":"2024-04-25T08:45:18.816634+0000","last_undegraded":"2024-04-25T08:45:18.816634+0000","last_fullsized":"2024-04-25T08:45:18.816634+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:59.633758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820924+0000","last_change":"2024-04-25T08:45:17.803671+0000","last_active":"2024-04-25T08:45:19.820924+0000","last_peered":"2024-04-25T08:45:19.820924+0000","last_clean":"2024-04-25T08:45:19.820924+0000","last_became_active":"2024-04-25T08:45:17.803356+0000","last_became_peered":"2024-04-25T08:45:17.803356+0000","last_unstale":"2024-04-25T08:45:19.820924+0000","last_undegraded":"2024-04-25T08:45:19.820924+0000","last_fullsized":"2024-04-25T08:45:19.820924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:33.793872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803057+0000","last_change":"2024-04-25T08:45:18.815729+0000","last_active":"2024-04-25T08:45:19.803057+0000","last_peered":"2024-04-25T08:45:19.803057+0000","last_clean":"2024-04-25T08:45:19.803057+0000","last_became_active":"2024-04-25T08:45:18.815460+0000","last_became_peered":"2024-04-25T08:45:18.815460+0000","last_unstale":"2024-04-25T08:45:19.803057+0000","last_undegraded":"2024-04-25T08:45:19.803057+0000","last_fullsized":"2024-04-25T08:45:19.803057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:05.538676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.807571+0000","last_change":"2024-04-25T08:45:17.810448+0000","last_active":"2024-04-25T08:45:18.807571+0000","last_peered":"2024-04-25T08:45:18.807571+0000","last_clean":"2024-04-25T08:45:18.807571+0000","last_became_active":"2024-04-25T08:45:17.810154+0000","last_became_peered":"2024-04-25T08:45:17.810154+0000","last_unstale":"2024-04-25T08:45:18.807571+0000","last_undegraded":"2024-04-25T08:45:18.807571+0000","last_fullsized":"2024-04-25T08:45:18.807571+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:23.502405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818334+0000","last_change":"2024-04-25T08:45:18.816083+0000","last_active":"2024-04-25T08:45:19.818334+0000","last_peered":"2024-04-25T08:45:19.818334+0000","last_clean":"2024-04-25T08:45:19.818334+0000","last_became_active":"2024-04-25T08:45:18.815636+0000","last_became_peered":"2024-04-25T08:45:18.815636+0000","last_unstale":"2024-04-25T08:45:19.818334+0000","last_undegraded":"2024-04-25T08:45:19.818334+0000","last_fullsized":"2024-04-25T08:45:19.818334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:55.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820891+0000","last_change":"2024-04-25T08:45:17.804283+0000","last_active":"2024-04-25T08:45:19.820891+0000","last_peered":"2024-04-25T08:45:19.820891+0000","last_clean":"2024-04-25T08:45:19.820891+0000","last_became_active":"2024-04-25T08:45:17.804027+0000","last_became_peered":"2024-04-25T08:45:17.804027+0000","last_unstale":"2024-04-25T08:45:19.820891+0000","last_undegraded":"2024-04-25T08:45:19.820891+0000","last_fullsized":"2024-04-25T08:45:19.820891+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:27.764477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.816668+0000","last_change":"2024-04-25T08:45:18.813202+0000","last_active":"2024-04-25T08:45:18.816668+0000","last_peered":"2024-04-25T08:45:18.816668+0000","last_clean":"2024-04-25T08:45:18.816668+0000","last_became_active":"2024-04-25T08:45:18.812920+0000","last_became_peered":"2024-04-25T08:45:18.812920+0000","last_unstale":"2024-04-25T08:45:18.816668+0000","last_undegraded":"2024-04-25T08:45:18.816668+0000","last_fullsized":"2024-04-25T08:45:18.816668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:09.193858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"53'6","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.834512+0000","last_change":"2024-04-25T08:45:17.799519+0000","last_active":"2024-04-25T08:45:18.834512+0000","last_peered":"2024-04-25T08:45:18.834512+0000","last_clean":"2024-04-25T08:45:18.834512+0000","last_became_active":"2024-04-25T08:45:17.799208+0000","last_became_peered":"2024-04-25T08:45:17.799208+0000","last_unstale":"2024-04-25T08:45:18.834512+0000","last_undegraded":"2024-04-25T08:45:18.834512+0000","last_fullsized":"2024-04-25T08:45:18.834512+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:11.196284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803414+0000","last_change":"2024-04-25T08:45:18.812390+0000","last_active":"2024-04-25T08:45:19.803414+0000","last_peered":"2024-04-25T08:45:19.803414+0000","last_clean":"2024-04-25T08:45:19.803414+0000","last_became_active":"2024-04-25T08:45:18.812083+0000","last_became_peered":"2024-04-25T08:45:18.812083+0000","last_unstale":"2024-04-25T08:45:19.803414+0000","last_undegraded":"2024-04-25T08:45:19.803414+0000","last_fullsized":"2024-04-25T08:45:19.803414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:55.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818459+0000","last_change":"2024-04-25T08:45:17.806064+0000","last_active":"2024-04-25T08:45:19.818459+0000","last_peered":"2024-04-25T08:45:19.818459+0000","last_clean":"2024-04-25T08:45:19.818459+0000","last_became_active":"2024-04-25T08:45:17.805804+0000","last_became_peered":"2024-04-25T08:45:17.805804+0000","last_unstale":"2024-04-25T08:45:19.818459+0000","last_undegraded":"2024-04-25T08:45:19.818459+0000","last_fullsized":"2024-04-25T08:45:19.818459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:26.782938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818549+0000","last_change":"2024-04-25T08:45:18.819138+0000","last_active":"2024-04-25T08:45:19.818549+0000","last_peered":"2024-04-25T08:45:19.818549+0000","last_clean":"2024-04-25T08:45:19.818549+0000","last_became_active":"2024-04-25T08:45:18.818869+0000","last_became_peered":"2024-04-25T08:45:18.818869+0000","last_unstale":"2024-04-25T08:45:19.818549+0000","last_undegraded":"2024-04-25T08:45:19.818549+0000","last_fullsized":"2024-04-25T08:45:19.818549+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:37.225948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804485+0000","last_change":"2024-04-25T08:45:17.809326+0000","last_active":"2024-04-25T08:45:19.804485+0000","last_peered":"2024-04-25T08:45:19.804485+0000","last_clean":"2024-04-25T08:45:19.804485+0000","last_became_active":"2024-04-25T08:45:17.809042+0000","last_became_peered":"2024-04-25T08:45:17.809042+0000","last_unstale":"2024-04-25T08:45:19.804485+0000","last_undegraded":"2024-04-25T08:45:19.804485+0000","last_fullsized":"2024-04-25T08:45:19.804485+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:14.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.820238+0000","last_change":"2024-04-25T08:45:18.814543+0000","last_active":"2024-04-25T08:45:18.820238+0000","last_peered":"2024-04-25T08:45:18.820238+0000","last_clean":"2024-04-25T08:45:18.820238+0000","last_became_active":"2024-04-25T08:45:18.814271+0000","last_became_peered":"2024-04-25T08:45:18.814271+0000","last_unstale":"2024-04-25T08:45:18.820238+0000","last_undegraded":"2024-04-25T08:45:18.820238+0000","last_fullsized":"2024-04-25T08:45:18.820238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:27.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820697+0000","last_change":"2024-04-25T08:45:17.803988+0000","last_active":"2024-04-25T08:45:19.820697+0000","last_peered":"2024-04-25T08:45:19.820697+0000","last_clean":"2024-04-25T08:45:19.820697+0000","last_became_active":"2024-04-25T08:45:17.803681+0000","last_became_peered":"2024-04-25T08:45:17.803681+0000","last_unstale":"2024-04-25T08:45:19.820697+0000","last_undegraded":"2024-04-25T08:45:19.820697+0000","last_fullsized":"2024-04-25T08:45:19.820697+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:26.782938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818633+0000","last_change":"2024-04-25T08:45:18.817297+0000","last_active":"2024-04-25T08:45:19.818633+0000","last_peered":"2024-04-25T08:45:19.818633+0000","last_clean":"2024-04-25T08:45:19.818633+0000","last_became_active":"2024-04-25T08:45:18.813964+0000","last_became_peered":"2024-04-25T08:45:18.813964+0000","last_unstale":"2024-04-25T08:45:19.818633+0000","last_undegraded":"2024-04-25T08:45:19.818633+0000","last_fullsized":"2024-04-25T08:45:19.818633+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:54.242386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"53'8","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.832490+0000","last_change":"2024-04-25T08:45:17.800781+0000","last_active":"2024-04-25T08:45:18.832490+0000","last_peered":"2024-04-25T08:45:18.832490+0000","last_clean":"2024-04-25T08:45:18.832490+0000","last_became_active":"2024-04-25T08:45:17.800534+0000","last_became_peered":"2024-04-25T08:45:17.800534+0000","last_unstale":"2024-04-25T08:45:18.832490+0000","last_undegraded":"2024-04-25T08:45:18.832490+0000","last_fullsized":"2024-04-25T08:45:18.832490+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:00.485609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.814273+0000","last_change":"2024-04-25T08:45:18.810293+0000","last_active":"2024-04-25T08:45:18.814273+0000","last_peered":"2024-04-25T08:45:18.814273+0000","last_clean":"2024-04-25T08:45:18.814273+0000","last_became_active":"2024-04-25T08:45:18.810028+0000","last_became_peered":"2024-04-25T08:45:18.810028+0000","last_unstale":"2024-04-25T08:45:18.814273+0000","last_undegraded":"2024-04-25T08:45:18.814273+0000","last_fullsized":"2024-04-25T08:45:18.814273+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:58.824000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818735+0000","last_change":"2024-04-25T08:45:17.812248+0000","last_active":"2024-04-25T08:45:19.818735+0000","last_peered":"2024-04-25T08:45:19.818735+0000","last_clean":"2024-04-25T08:45:19.818735+0000","last_became_active":"2024-04-25T08:45:17.811983+0000","last_became_peered":"2024-04-25T08:45:17.811983+0000","last_unstale":"2024-04-25T08:45:19.818735+0000","last_undegraded":"2024-04-25T08:45:19.818735+0000","last_fullsized":"2024-04-25T08:45:19.818735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:33.793872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804293+0000","last_change":"2024-04-25T08:45:18.809234+0000","last_active":"2024-04-25T08:45:19.804293+0000","last_peered":"2024-04-25T08:45:19.804293+0000","last_clean":"2024-04-25T08:45:19.804293+0000","last_became_active":"2024-04-25T08:45:18.808966+0000","last_became_peered":"2024-04-25T08:45:18.808966+0000","last_unstale":"2024-04-25T08:45:19.804293+0000","last_undegraded":"2024-04-25T08:45:19.804293+0000","last_fullsized":"2024-04-25T08:45:19.804293+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:52:14.901643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"53'2","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.824861+0000","last_change":"2024-04-25T08:45:17.798805+0000","last_active":"2024-04-25T08:45:18.824861+0000","last_peered":"2024-04-25T08:45:18.824861+0000","last_clean":"2024-04-25T08:45:18.824861+0000","last_became_active":"2024-04-25T08:45:17.798548+0000","last_became_peered":"2024-04-25T08:45:17.798548+0000","last_unstale":"2024-04-25T08:45:18.824861+0000","last_undegraded":"2024-04-25T08:45:18.824861+0000","last_fullsized":"2024-04-25T08:45:18.824861+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:16.504381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.825020+0000","last_change":"2024-04-25T08:45:18.821542+0000","last_active":"2024-04-25T08:45:18.825020+0000","last_peered":"2024-04-25T08:45:18.825020+0000","last_clean":"2024-04-25T08:45:18.825020+0000","last_became_active":"2024-04-25T08:45:18.821265+0000","last_became_peered":"2024-04-25T08:45:18.821265+0000","last_unstale":"2024-04-25T08:45:18.825020+0000","last_undegraded":"2024-04-25T08:45:18.825020+0000","last_fullsized":"2024-04-25T08:45:18.825020+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.044086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804389+0000","last_change":"2024-04-25T08:45:17.803274+0000","last_active":"2024-04-25T08:45:19.804389+0000","last_peered":"2024-04-25T08:45:19.804389+0000","last_clean":"2024-04-25T08:45:19.804389+0000","last_became_active":"2024-04-25T08:45:17.802955+0000","last_became_peered":"2024-04-25T08:45:17.802955+0000","last_unstale":"2024-04-25T08:45:19.804389+0000","last_undegraded":"2024-04-25T08:45:19.804389+0000","last_fullsized":"2024-04-25T08:45:19.804389+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:32.249645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804519+0000","last_change":"2024-04-25T08:45:18.804429+0000","last_active":"2024-04-25T08:45:19.804519+0000","last_peered":"2024-04-25T08:45:19.804519+0000","last_clean":"2024-04-25T08:45:19.804519+0000","last_became_active":"2024-04-25T08:45:18.804174+0000","last_became_peered":"2024-04-25T08:45:18.804174+0000","last_unstale":"2024-04-25T08:45:19.804519+0000","last_undegraded":"2024-04-25T08:45:19.804519+0000","last_fullsized":"2024-04-25T08:45:19.804519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:23.495679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804054+0000","last_change":"2024-04-25T08:45:17.808334+0000","last_active":"2024-04-25T08:45:19.804054+0000","last_peered":"2024-04-25T08:45:19.804054+0000","last_clean":"2024-04-25T08:45:19.804054+0000","last_became_active":"2024-04-25T08:45:17.808083+0000","last_became_peered":"2024-04-25T08:45:17.808083+0000","last_unstale":"2024-04-25T08:45:19.804054+0000","last_undegraded":"2024-04-25T08:45:19.804054+0000","last_fullsized":"2024-04-25T08:45:19.804054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:46.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803679+0000","last_change":"2024-04-25T08:45:18.813938+0000","last_active":"2024-04-25T08:45:19.803679+0000","last_peered":"2024-04-25T08:45:19.803679+0000","last_clean":"2024-04-25T08:45:19.803679+0000","last_became_active":"2024-04-25T08:45:18.813684+0000","last_became_peered":"2024-04-25T08:45:18.813684+0000","last_unstale":"2024-04-25T08:45:19.803679+0000","last_undegraded":"2024-04-25T08:45:19.803679+0000","last_fullsized":"2024-04-25T08:45:19.803679+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:23.134616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804603+0000","last_change":"2024-04-25T08:45:17.794790+0000","last_active":"2024-04-25T08:45:19.804603+0000","last_peered":"2024-04-25T08:45:19.804603+0000","last_clean":"2024-04-25T08:45:19.804603+0000","last_became_active":"2024-04-25T08:45:17.794372+0000","last_became_peered":"2024-04-25T08:45:17.794372+0000","last_unstale":"2024-04-25T08:45:19.804603+0000","last_undegraded":"2024-04-25T08:45:19.804603+0000","last_fullsized":"2024-04-25T08:45:19.804603+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:46.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804061+0000","last_change":"2024-04-25T08:45:18.816086+0000","last_active":"2024-04-25T08:45:19.804061+0000","last_peered":"2024-04-25T08:45:19.804061+0000","last_clean":"2024-04-25T08:45:19.804061+0000","last_became_active":"2024-04-25T08:45:18.815805+0000","last_became_peered":"2024-04-25T08:45:18.815805+0000","last_unstale":"2024-04-25T08:45:19.804061+0000","last_undegraded":"2024-04-25T08:45:19.804061+0000","last_fullsized":"2024-04-25T08:45:19.804061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:34.800468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.801989+0000","last_change":"2024-04-25T08:45:17.805427+0000","last_active":"2024-04-25T08:45:18.801989+0000","last_peered":"2024-04-25T08:45:18.801989+0000","last_clean":"2024-04-25T08:45:18.801989+0000","last_became_active":"2024-04-25T08:45:17.805189+0000","last_became_peered":"2024-04-25T08:45:17.805189+0000","last_unstale":"2024-04-25T08:45:18.801989+0000","last_undegraded":"2024-04-25T08:45:18.801989+0000","last_fullsized":"2024-04-25T08:45:18.801989+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:31.841098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818560+0000","last_change":"2024-04-25T08:45:18.813716+0000","last_active":"2024-04-25T08:45:19.818560+0000","last_peered":"2024-04-25T08:45:19.818560+0000","last_clean":"2024-04-25T08:45:19.818560+0000","last_became_active":"2024-04-25T08:45:18.813402+0000","last_became_peered":"2024-04-25T08:45:18.813402+0000","last_unstale":"2024-04-25T08:45:19.818560+0000","last_undegraded":"2024-04-25T08:45:19.818560+0000","last_fullsized":"2024-04-25T08:45:19.818560+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:12.775500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818228+0000","last_change":"2024-04-25T08:45:17.810788+0000","last_active":"2024-04-25T08:45:19.818228+0000","last_peered":"2024-04-25T08:45:19.818228+0000","last_clean":"2024-04-25T08:45:19.818228+0000","last_became_active":"2024-04-25T08:45:17.810512+0000","last_became_peered":"2024-04-25T08:45:17.810512+0000","last_unstale":"2024-04-25T08:45:19.818228+0000","last_undegraded":"2024-04-25T08:45:19.818228+0000","last_fullsized":"2024-04-25T08:45:19.818228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:06.418297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804900+0000","last_change":"2024-04-25T08:45:18.809939+0000","last_active":"2024-04-25T08:45:19.804900+0000","last_peered":"2024-04-25T08:45:19.804900+0000","last_clean":"2024-04-25T08:45:19.804900+0000","last_became_active":"2024-04-25T08:45:18.809661+0000","last_became_peered":"2024-04-25T08:45:18.809661+0000","last_unstale":"2024-04-25T08:45:19.804900+0000","last_undegraded":"2024-04-25T08:45:19.804900+0000","last_fullsized":"2024-04-25T08:45:19.804900+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:19.149675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.805314+0000","last_change":"2024-04-25T08:45:17.798455+0000","last_active":"2024-04-25T08:45:18.805314+0000","last_peered":"2024-04-25T08:45:18.805314+0000","last_clean":"2024-04-25T08:45:18.805314+0000","last_became_active":"2024-04-25T08:45:17.798181+0000","last_became_peered":"2024-04-25T08:45:17.798181+0000","last_unstale":"2024-04-25T08:45:18.805314+0000","last_undegraded":"2024-04-25T08:45:18.805314+0000","last_fullsized":"2024-04-25T08:45:18.805314+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:40.232205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803128+0000","last_change":"2024-04-25T08:45:18.806436+0000","last_active":"2024-04-25T08:45:19.803128+0000","last_peered":"2024-04-25T08:45:19.803128+0000","last_clean":"2024-04-25T08:45:19.803128+0000","last_became_active":"2024-04-25T08:45:18.805932+0000","last_became_peered":"2024-04-25T08:45:18.805932+0000","last_unstale":"2024-04-25T08:45:19.803128+0000","last_undegraded":"2024-04-25T08:45:19.803128+0000","last_fullsized":"2024-04-25T08:45:19.803128+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:05.548991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804154+0000","last_change":"2024-04-25T08:45:17.810476+0000","last_active":"2024-04-25T08:45:19.804154+0000","last_peered":"2024-04-25T08:45:19.804154+0000","last_clean":"2024-04-25T08:45:19.804154+0000","last_became_active":"2024-04-25T08:45:17.810125+0000","last_became_peered":"2024-04-25T08:45:17.810125+0000","last_unstale":"2024-04-25T08:45:19.804154+0000","last_undegraded":"2024-04-25T08:45:19.804154+0000","last_fullsized":"2024-04-25T08:45:19.804154+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:06.066759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804519+0000","last_change":"2024-04-25T08:45:18.806583+0000","last_active":"2024-04-25T08:45:19.804519+0000","last_peered":"2024-04-25T08:45:19.804519+0000","last_clean":"2024-04-25T08:45:19.804519+0000","last_became_active":"2024-04-25T08:45:18.806332+0000","last_became_peered":"2024-04-25T08:45:18.806332+0000","last_unstale":"2024-04-25T08:45:19.804519+0000","last_undegraded":"2024-04-25T08:45:19.804519+0000","last_fullsized":"2024-04-25T08:45:19.804519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:02.583352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820933+0000","last_change":"2024-04-25T08:45:17.804780+0000","last_active":"2024-04-25T08:45:19.820933+0000","last_peered":"2024-04-25T08:45:19.820933+0000","last_clean":"2024-04-25T08:45:19.820933+0000","last_became_active":"2024-04-25T08:45:17.804467+0000","last_became_peered":"2024-04-25T08:45:17.804467+0000","last_unstale":"2024-04-25T08:45:19.820933+0000","last_undegraded":"2024-04-25T08:45:19.820933+0000","last_fullsized":"2024-04-25T08:45:19.820933+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:06.418297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.820910+0000","last_change":"2024-04-25T08:45:18.813775+0000","last_active":"2024-04-25T08:45:18.820910+0000","last_peered":"2024-04-25T08:45:18.820910+0000","last_clean":"2024-04-25T08:45:18.820910+0000","last_became_active":"2024-04-25T08:45:18.813301+0000","last_became_peered":"2024-04-25T08:45:18.813301+0000","last_unstale":"2024-04-25T08:45:18.820910+0000","last_undegraded":"2024-04-25T08:45:18.820910+0000","last_fullsized":"2024-04-25T08:45:18.820910+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:05.548991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818252+0000","last_change":"2024-04-25T08:45:17.806261+0000","last_active":"2024-04-25T08:45:19.818252+0000","last_peered":"2024-04-25T08:45:19.818252+0000","last_clean":"2024-04-25T08:45:19.818252+0000","last_became_active":"2024-04-25T08:45:17.805976+0000","last_became_peered":"2024-04-25T08:45:17.805976+0000","last_unstale":"2024-04-25T08:45:19.818252+0000","last_undegraded":"2024-04-25T08:45:19.818252+0000","last_fullsized":"2024-04-25T08:45:19.818252+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:45.401917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818319+0000","last_change":"2024-04-25T08:45:18.816647+0000","last_active":"2024-04-25T08:45:19.818319+0000","last_peered":"2024-04-25T08:45:19.818319+0000","last_clean":"2024-04-25T08:45:19.818319+0000","last_became_active":"2024-04-25T08:45:18.816385+0000","last_became_peered":"2024-04-25T08:45:18.816385+0000","last_unstale":"2024-04-25T08:45:19.818319+0000","last_undegraded":"2024-04-25T08:45:19.818319+0000","last_fullsized":"2024-04-25T08:45:19.818319+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:05.548991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.802893+0000","last_change":"2024-04-25T08:45:17.806083+0000","last_active":"2024-04-25T08:45:18.802893+0000","last_peered":"2024-04-25T08:45:18.802893+0000","last_clean":"2024-04-25T08:45:18.802893+0000","last_became_active":"2024-04-25T08:45:17.805839+0000","last_became_peered":"2024-04-25T08:45:17.805839+0000","last_unstale":"2024-04-25T08:45:18.802893+0000","last_undegraded":"2024-04-25T08:45:18.802893+0000","last_fullsized":"2024-04-25T08:45:18.802893+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:34.657722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803315+0000","last_change":"2024-04-25T08:45:18.813360+0000","last_active":"2024-04-25T08:45:19.803315+0000","last_peered":"2024-04-25T08:45:19.803315+0000","last_clean":"2024-04-25T08:45:19.803315+0000","last_became_active":"2024-04-25T08:45:18.812955+0000","last_became_peered":"2024-04-25T08:45:18.812955+0000","last_unstale":"2024-04-25T08:45:19.803315+0000","last_undegraded":"2024-04-25T08:45:19.803315+0000","last_fullsized":"2024-04-25T08:45:19.803315+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:56.948524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.802129+0000","last_change":"2024-04-25T08:45:17.803961+0000","last_active":"2024-04-25T08:45:18.802129+0000","last_peered":"2024-04-25T08:45:18.802129+0000","last_clean":"2024-04-25T08:45:18.802129+0000","last_became_active":"2024-04-25T08:45:17.803705+0000","last_became_peered":"2024-04-25T08:45:17.803705+0000","last_unstale":"2024-04-25T08:45:18.802129+0000","last_undegraded":"2024-04-25T08:45:18.802129+0000","last_fullsized":"2024-04-25T08:45:18.802129+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:05.039045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818478+0000","last_change":"2024-04-25T08:45:18.818777+0000","last_active":"2024-04-25T08:45:19.818478+0000","last_peered":"2024-04-25T08:45:19.818478+0000","last_clean":"2024-04-25T08:45:19.818478+0000","last_became_active":"2024-04-25T08:45:18.818176+0000","last_became_peered":"2024-04-25T08:45:18.818176+0000","last_unstale":"2024-04-25T08:45:19.818478+0000","last_undegraded":"2024-04-25T08:45:19.818478+0000","last_fullsized":"2024-04-25T08:45:19.818478+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:23.134616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.807562+0000","last_change":"2024-04-25T08:45:17.807674+0000","last_active":"2024-04-25T08:45:18.807562+0000","last_peered":"2024-04-25T08:45:18.807562+0000","last_clean":"2024-04-25T08:45:18.807562+0000","last_became_active":"2024-04-25T08:45:17.807455+0000","last_became_peered":"2024-04-25T08:45:17.807455+0000","last_unstale":"2024-04-25T08:45:18.807562+0000","last_undegraded":"2024-04-25T08:45:18.807562+0000","last_fullsized":"2024-04-25T08:45:18.807562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:08.963648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T08:45:18.821020+0000","last_change":"2024-04-25T08:45:18.815010+0000","last_active":"2024-04-25T08:45:18.821020+0000","last_peered":"2024-04-25T08:45:18.821020+0000","last_clean":"2024-04-25T08:45:18.821020+0000","last_became_active":"2024-04-25T08:45:18.814468+0000","last_became_peered":"2024-04-25T08:45:18.814468+0000","last_unstale":"2024-04-25T08:45:18.821020+0000","last_undegraded":"2024-04-25T08:45:18.821020+0000","last_fullsized":"2024-04-25T08:45:18.821020+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:23.134616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803214+0000","last_change":"2024-04-25T08:45:17.801098+0000","last_active":"2024-04-25T08:45:19.803214+0000","last_peered":"2024-04-25T08:45:19.803214+0000","last_clean":"2024-04-25T08:45:19.803214+0000","last_became_active":"2024-04-25T08:45:17.798374+0000","last_became_peered":"2024-04-25T08:45:17.798374+0000","last_unstale":"2024-04-25T08:45:19.803214+0000","last_undegraded":"2024-04-25T08:45:19.803214+0000","last_fullsized":"2024-04-25T08:45:19.803214+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:18.143078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804248+0000","last_change":"2024-04-25T08:45:18.806073+0000","last_active":"2024-04-25T08:45:19.804248+0000","last_peered":"2024-04-25T08:45:19.804248+0000","last_clean":"2024-04-25T08:45:19.804248+0000","last_became_active":"2024-04-25T08:45:18.805646+0000","last_became_peered":"2024-04-25T08:45:18.805646+0000","last_unstale":"2024-04-25T08:45:19.804248+0000","last_undegraded":"2024-04-25T08:45:19.804248+0000","last_fullsized":"2024-04-25T08:45:19.804248+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:46.408513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"54'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.819898+0000","last_change":"2024-04-25T08:45:17.808409+0000","last_active":"2024-04-25T08:45:19.819898+0000","last_peered":"2024-04-25T08:45:19.819898+0000","last_clean":"2024-04-25T08:45:19.819898+0000","last_became_active":"2024-04-25T08:45:17.808054+0000","last_became_peered":"2024-04-25T08:45:17.808054+0000","last_unstale":"2024-04-25T08:45:19.819898+0000","last_undegraded":"2024-04-25T08:45:19.819898+0000","last_fullsized":"2024-04-25T08:45:19.819898+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:06.415394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820392+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:45:19.820392+0000","last_peered":"2024-04-25T08:45:19.820392+0000","last_clean":"2024-04-25T08:45:19.820392+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:45:19.820392+0000","last_undegraded":"2024-04-25T08:45:19.820392+0000","last_fullsized":"2024-04-25T08:45:19.820392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":879702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":289862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":289210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35964,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335876,"statfs":{"total":96636764160,"available":96599937024,"internally_reserved":0,"allocated":634880,"data_stored":283100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":647168,"data_stored":284152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":643072,"data_stored":284130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":651264,"data_stored":289370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36560,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335280,"statfs":{"total":96636764160,"available":96599326720,"internally_reserved":0,"allocated":1245184,"data_stored":879634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:45:24.049 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T08:45:24.058+0000 7ff2df960640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:45:26.564 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:45:26.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.682+0000 7f2b61693640 1 Processor -- start 2024-04-25T08:45:26.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.682+0000 7f2b61693640 1 -- start start 2024-04-25T08:45:26.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b61693640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2b5c15dbe0 0x7f2b5c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:26.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b61693640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c0b92a0 0x7f2b5c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:26.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b61693640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c0b97a0 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b61693640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c15dfc0 con 0x7f2b5c15dbe0 2024-04-25T08:45:26.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b61693640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0d1a00 con 0x7f2b5c0b92a0 2024-04-25T08:45:26.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b5affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2b5c15dbe0 0x7f2b5c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:26.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b5affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2b5c15dbe0 0x7f2b5c0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47726/0 (socket says 172.21.15.172:47726) 2024-04-25T08:45:26.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b5affd640 1 -- 172.21.15.172:0/848580332 learned_addr learned my addr 172.21.15.172:0/848580332 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:26.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b5b7fe640 1 --2- 172.21.15.172:0/848580332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c0b92a0 0x7f2b5c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:26.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b5affd640 1 -- 172.21.15.172:0/848580332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c0b92a0 msgr2=0x7f2b5c0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:26.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b5affd640 1 --2- 172.21.15.172:0/848580332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c0b92a0 0x7f2b5c0d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:26.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b5affd640 1 -- 172.21.15.172:0/848580332 >> v1:172.21.15.186:6789/0 conn(0x7f2b5c0b2cb0 legacy=0x7f2b5c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:26.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.683+0000 7f2b5affd640 1 -- 172.21.15.172:0/848580332 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c0d1c50 con 0x7f2b5c15dbe0 2024-04-25T08:45:26.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.684+0000 7f2b5affd640 1 --2- 172.21.15.172:0/848580332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c15dbe0 0x7f2b5c0d0910 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009870 tx=0x7f2b4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7546b45314f626d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:26.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.684+0000 7f2b59ffb640 1 -- 172.21.15.172:0/848580332 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c037070 con 0x7f2b5c15dbe0 2024-04-25T08:45:26.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.684+0000 7f2b59ffb640 1 -- 172.21.15.172:0/848580332 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c032440 con 0x7f2b5c15dbe0 2024-04-25T08:45:26.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.684+0000 7f2b59ffb640 1 -- 172.21.15.172:0/848580332 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c032810 con 0x7f2b5c15dbe0 2024-04-25T08:45:26.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.685+0000 7f2b61693640 1 -- 172.21.15.172:0/848580332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c15dbe0 msgr2=0x7f2b5c0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:26.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.685+0000 7f2b61693640 1 --2- 172.21.15.172:0/848580332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c15dbe0 0x7f2b5c0d0910 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009870 tx=0x7f2b4c02a270 comp rx=0 tx=0).stop 2024-04-25T08:45:26.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.685+0000 7f2b61693640 1 -- 172.21.15.172:0/848580332 shutdown_connections 2024-04-25T08:45:26.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.685+0000 7f2b61693640 1 --2- 172.21.15.172:0/848580332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c0b92a0 0x7f2b5c0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:26.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.685+0000 7f2b61693640 1 --2- 172.21.15.172:0/848580332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c15dbe0 0x7f2b5c0d0910 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:26.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.685+0000 7f2b61693640 1 -- 172.21.15.172:0/848580332 >> 172.21.15.172:0/848580332 conn(0x7f2b5c061a20 msgr2=0x7f2b5c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:26.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.685+0000 7f2b61693640 1 -- 172.21.15.172:0/848580332 shutdown_connections 2024-04-25T08:45:26.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.685+0000 7f2b61693640 1 -- 172.21.15.172:0/848580332 wait complete. 2024-04-25T08:45:26.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.686+0000 7f2b61693640 1 Processor -- start 2024-04-25T08:45:26.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.686+0000 7f2b61693640 1 -- start start 2024-04-25T08:45:26.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b61693640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c0b2cb0 0x7f2b5c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:26.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b61693640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b5c0b92a0 0x7f2b5c15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:26.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b61693640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c15dbe0 0x7f2b5c160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:26.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b61693640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0b6ab0 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b61693640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0d2210 con 0x7f2b5c0b92a0 2024-04-25T08:45:26.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b61693640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0b6c30 con 0x7f2b5c15dbe0 2024-04-25T08:45:26.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c0b2cb0 0x7f2b5c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:26.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c0b2cb0 0x7f2b5c0c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47730/0 (socket says 172.21.15.172:47730) 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5affd640 1 -- 172.21.15.172:0/3464267028 learned_addr learned my addr 172.21.15.172:0/3464267028 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5a7fc640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b5c0b92a0 0x7f2b5c15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5b7fe640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c15dbe0 0x7f2b5c160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5affd640 1 -- 172.21.15.172:0/3464267028 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c15dbe0 msgr2=0x7f2b5c160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5affd640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c15dbe0 0x7f2b5c160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5affd640 1 -- 172.21.15.172:0/3464267028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b5c0b92a0 msgr2=0x7f2b5c15fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5affd640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b5c0b92a0 0x7f2b5c15fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5affd640 1 -- 172.21.15.172:0/3464267028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c0cb940 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5a7fc640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b5c0b92a0 0x7f2b5c15fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5b7fe640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c15dbe0 0x7f2b5c160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b5affd640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c0b2cb0 0x7f2b5c0c9c80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c000c00 tx=0x7f2b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.687+0000 7f2b437fe640 1 -- 172.21.15.172:0/3464267028 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c037040 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.688+0000 7f2b437fe640 1 -- 172.21.15.172:0/3464267028 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c042070 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.688+0000 7f2b437fe640 1 -- 172.21.15.172:0/3464267028 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c030880 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.688+0000 7f2b61693640 1 -- 172.21.15.172:0/3464267028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c0cbc20 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.688+0000 7f2b61693640 1 -- 172.21.15.172:0/3464267028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c0cc1e0 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.689+0000 7f2b61693640 1 -- 172.21.15.172:0/3464267028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c073990 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.689+0000 7f2b437fe640 1 -- 172.21.15.172:0/3464267028 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2b4c030a20 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.689+0000 7f2b437fe640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2b4806b4d0 0x7f2b4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:26.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.689+0000 7f2b437fe640 1 -- 172.21.15.172:0/3464267028 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2b4c0aabc0 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.689+0000 7f2b5a7fc640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2b4806b4d0 0x7f2b4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:26.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.690+0000 7f2b5a7fc640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2b4806b4d0 0x7f2b4806d990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0b44c0 tx=0x7f2b50009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:26.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.694+0000 7f2b437fe640 1 -- 172.21.15.172:0/3464267028 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2b4c079940 con 0x7f2b5c0b2cb0 2024-04-25T08:45:26.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.863+0000 7f2b61693640 1 -- 172.21.15.172:0/3464267028 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b5c06b080 con 0x7f2b4806b4d0 2024-04-25T08:45:26.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.869+0000 7f2b437fe640 1 -- 172.21.15.172:0/3464267028 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251881 (secure 0 0 0) 0x7f2b5c06b080 con 0x7f2b4806b4d0 2024-04-25T08:45:26.863 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:26.864 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:45:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 -- 172.21.15.172:0/3464267028 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2b4806b4d0 msgr2=0x7f2b4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2b4806b4d0 0x7f2b4806d990 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0b44c0 tx=0x7f2b50009040 comp rx=0 tx=0).stop 2024-04-25T08:45:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 -- 172.21.15.172:0/3464267028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c0b2cb0 msgr2=0x7f2b5c0c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c0b2cb0 0x7f2b5c0c9c80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c000c00 tx=0x7f2b4c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 -- 172.21.15.172:0/3464267028 shutdown_connections 2024-04-25T08:45:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2b4806b4d0 0x7f2b4806d990 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b5c0b92a0 0x7f2b5c15fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b5c15dbe0 0x7f2b5c160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 --2- 172.21.15.172:0/3464267028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b5c0b2cb0 0x7f2b5c0c9c80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:26.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 -- 172.21.15.172:0/3464267028 >> 172.21.15.172:0/3464267028 conn(0x7f2b5c061a20 msgr2=0x7f2b5c0b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:26.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 -- 172.21.15.172:0/3464267028 shutdown_connections 2024-04-25T08:45:26.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:26.872+0000 7f2b61693640 1 -- 172.21.15.172:0/3464267028 wait complete. 2024-04-25T08:45:26.875 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-04-25T08:45:26.548562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":280672,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754694048,"statfs":{"total":773094113280,"available":772806705152,"internally_reserved":0,"allocated":6397952,"data_stored":3499236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001843"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804833+0000","last_change":"2024-04-25T08:45:18.808381+0000","last_active":"2024-04-25T08:45:19.804833+0000","last_peered":"2024-04-25T08:45:19.804833+0000","last_clean":"2024-04-25T08:45:19.804833+0000","last_became_active":"2024-04-25T08:45:18.808133+0000","last_became_peered":"2024-04-25T08:45:18.808133+0000","last_unstale":"2024-04-25T08:45:19.804833+0000","last_undegraded":"2024-04-25T08:45:19.804833+0000","last_fullsized":"2024-04-25T08:45:19.804833+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:45.316373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.821007+0000","last_change":"2024-04-25T08:45:18.816452+0000","last_active":"2024-04-25T08:45:19.821007+0000","last_peered":"2024-04-25T08:45:19.821007+0000","last_clean":"2024-04-25T08:45:19.821007+0000","last_became_active":"2024-04-25T08:45:18.816182+0000","last_became_peered":"2024-04-25T08:45:18.816182+0000","last_unstale":"2024-04-25T08:45:19.821007+0000","last_undegraded":"2024-04-25T08:45:19.821007+0000","last_fullsized":"2024-04-25T08:45:19.821007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:06.045642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818416+0000","last_change":"2024-04-25T08:45:18.812932+0000","last_active":"2024-04-25T08:45:19.818416+0000","last_peered":"2024-04-25T08:45:19.818416+0000","last_clean":"2024-04-25T08:45:19.818416+0000","last_became_active":"2024-04-25T08:45:18.812661+0000","last_became_peered":"2024-04-25T08:45:18.812661+0000","last_unstale":"2024-04-25T08:45:19.818416+0000","last_undegraded":"2024-04-25T08:45:19.818416+0000","last_fullsized":"2024-04-25T08:45:19.818416+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:27.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820758+0000","last_change":"2024-04-25T08:45:18.813517+0000","last_active":"2024-04-25T08:45:19.820758+0000","last_peered":"2024-04-25T08:45:19.820758+0000","last_clean":"2024-04-25T08:45:19.820758+0000","last_became_active":"2024-04-25T08:45:18.812328+0000","last_became_peered":"2024-04-25T08:45:18.812328+0000","last_unstale":"2024-04-25T08:45:19.820758+0000","last_undegraded":"2024-04-25T08:45:19.820758+0000","last_fullsized":"2024-04-25T08:45:19.820758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:59.678260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033889+0000","last_change":"2024-04-25T08:45:18.820153+0000","last_active":"2024-04-25T08:45:21.033889+0000","last_peered":"2024-04-25T08:45:21.033889+0000","last_clean":"2024-04-25T08:45:21.033889+0000","last_became_active":"2024-04-25T08:45:18.818010+0000","last_became_peered":"2024-04-25T08:45:18.818010+0000","last_unstale":"2024-04-25T08:45:21.033889+0000","last_undegraded":"2024-04-25T08:45:21.033889+0000","last_fullsized":"2024-04-25T08:45:21.033889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:28.771073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804462+0000","last_change":"2024-04-25T08:45:18.814509+0000","last_active":"2024-04-25T08:45:19.804462+0000","last_peered":"2024-04-25T08:45:19.804462+0000","last_clean":"2024-04-25T08:45:19.804462+0000","last_became_active":"2024-04-25T08:45:18.814250+0000","last_became_peered":"2024-04-25T08:45:18.814250+0000","last_unstale":"2024-04-25T08:45:19.804462+0000","last_undegraded":"2024-04-25T08:45:19.804462+0000","last_fullsized":"2024-04-25T08:45:19.804462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:44.477349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818101+0000","last_change":"2024-04-25T08:45:18.813257+0000","last_active":"2024-04-25T08:45:19.818101+0000","last_peered":"2024-04-25T08:45:19.818101+0000","last_clean":"2024-04-25T08:45:19.818101+0000","last_became_active":"2024-04-25T08:45:18.812942+0000","last_became_peered":"2024-04-25T08:45:18.812942+0000","last_unstale":"2024-04-25T08:45:19.818101+0000","last_undegraded":"2024-04-25T08:45:19.818101+0000","last_fullsized":"2024-04-25T08:45:19.818101+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:58.824000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033212+0000","last_change":"2024-04-25T08:45:18.811425+0000","last_active":"2024-04-25T08:45:21.033212+0000","last_peered":"2024-04-25T08:45:21.033212+0000","last_clean":"2024-04-25T08:45:21.033212+0000","last_became_active":"2024-04-25T08:45:18.811053+0000","last_became_peered":"2024-04-25T08:45:18.811053+0000","last_unstale":"2024-04-25T08:45:21.033212+0000","last_undegraded":"2024-04-25T08:45:21.033212+0000","last_fullsized":"2024-04-25T08:45:21.033212+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:17.800955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033904+0000","last_change":"2024-04-25T08:45:18.821468+0000","last_active":"2024-04-25T08:45:21.033904+0000","last_peered":"2024-04-25T08:45:21.033904+0000","last_clean":"2024-04-25T08:45:21.033904+0000","last_became_active":"2024-04-25T08:45:18.820592+0000","last_became_peered":"2024-04-25T08:45:18.820592+0000","last_unstale":"2024-04-25T08:45:21.033904+0000","last_undegraded":"2024-04-25T08:45:21.033904+0000","last_fullsized":"2024-04-25T08:45:21.033904+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:57.071708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804810+0000","last_change":"2024-04-25T08:45:18.816572+0000","last_active":"2024-04-25T08:45:19.804810+0000","last_peered":"2024-04-25T08:45:19.804810+0000","last_clean":"2024-04-25T08:45:19.804810+0000","last_became_active":"2024-04-25T08:45:18.816307+0000","last_became_peered":"2024-04-25T08:45:18.816307+0000","last_unstale":"2024-04-25T08:45:19.804810+0000","last_undegraded":"2024-04-25T08:45:19.804810+0000","last_fullsized":"2024-04-25T08:45:19.804810+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:47.307740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033401+0000","last_change":"2024-04-25T08:45:18.814478+0000","last_active":"2024-04-25T08:45:21.033401+0000","last_peered":"2024-04-25T08:45:21.033401+0000","last_clean":"2024-04-25T08:45:21.033401+0000","last_became_active":"2024-04-25T08:45:18.814241+0000","last_became_peered":"2024-04-25T08:45:18.814241+0000","last_unstale":"2024-04-25T08:45:21.033401+0000","last_undegraded":"2024-04-25T08:45:21.033401+0000","last_fullsized":"2024-04-25T08:45:21.033401+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:57.885205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033719+0000","last_change":"2024-04-25T08:45:18.807537+0000","last_active":"2024-04-25T08:45:21.033719+0000","last_peered":"2024-04-25T08:45:21.033719+0000","last_clean":"2024-04-25T08:45:21.033719+0000","last_became_active":"2024-04-25T08:45:18.806588+0000","last_became_peered":"2024-04-25T08:45:18.806588+0000","last_unstale":"2024-04-25T08:45:21.033719+0000","last_undegraded":"2024-04-25T08:45:21.033719+0000","last_fullsized":"2024-04-25T08:45:21.033719+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:51.360019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804507+0000","last_change":"2024-04-25T08:45:18.813226+0000","last_active":"2024-04-25T08:45:19.804507+0000","last_peered":"2024-04-25T08:45:19.804507+0000","last_clean":"2024-04-25T08:45:19.804507+0000","last_became_active":"2024-04-25T08:45:18.812923+0000","last_became_peered":"2024-04-25T08:45:18.812923+0000","last_unstale":"2024-04-25T08:45:19.804507+0000","last_undegraded":"2024-04-25T08:45:19.804507+0000","last_fullsized":"2024-04-25T08:45:19.804507+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:18.141783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818311+0000","last_change":"2024-04-25T08:45:18.817433+0000","last_active":"2024-04-25T08:45:19.818311+0000","last_peered":"2024-04-25T08:45:19.818311+0000","last_clean":"2024-04-25T08:45:19.818311+0000","last_became_active":"2024-04-25T08:45:18.817185+0000","last_became_peered":"2024-04-25T08:45:18.817185+0000","last_unstale":"2024-04-25T08:45:19.818311+0000","last_undegraded":"2024-04-25T08:45:19.818311+0000","last_fullsized":"2024-04-25T08:45:19.818311+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:13.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820608+0000","last_change":"2024-04-25T08:45:18.818766+0000","last_active":"2024-04-25T08:45:19.820608+0000","last_peered":"2024-04-25T08:45:19.820608+0000","last_clean":"2024-04-25T08:45:19.820608+0000","last_became_active":"2024-04-25T08:45:18.818486+0000","last_became_peered":"2024-04-25T08:45:18.818486+0000","last_unstale":"2024-04-25T08:45:19.820608+0000","last_undegraded":"2024-04-25T08:45:19.820608+0000","last_fullsized":"2024-04-25T08:45:19.820608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:39.831346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804271+0000","last_change":"2024-04-25T08:45:18.812328+0000","last_active":"2024-04-25T08:45:19.804271+0000","last_peered":"2024-04-25T08:45:19.804271+0000","last_clean":"2024-04-25T08:45:19.804271+0000","last_became_active":"2024-04-25T08:45:18.812060+0000","last_became_peered":"2024-04-25T08:45:18.812060+0000","last_unstale":"2024-04-25T08:45:19.804271+0000","last_undegraded":"2024-04-25T08:45:19.804271+0000","last_fullsized":"2024-04-25T08:45:19.804271+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:07.421990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818584+0000","last_change":"2024-04-25T08:45:18.811962+0000","last_active":"2024-04-25T08:45:19.818584+0000","last_peered":"2024-04-25T08:45:19.818584+0000","last_clean":"2024-04-25T08:45:19.818584+0000","last_became_active":"2024-04-25T08:45:18.811504+0000","last_became_peered":"2024-04-25T08:45:18.811504+0000","last_unstale":"2024-04-25T08:45:19.818584+0000","last_undegraded":"2024-04-25T08:45:19.818584+0000","last_fullsized":"2024-04-25T08:45:19.818584+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:17.800955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.821074+0000","last_change":"2024-04-25T08:45:18.815126+0000","last_active":"2024-04-25T08:45:19.821074+0000","last_peered":"2024-04-25T08:45:19.821074+0000","last_clean":"2024-04-25T08:45:19.821074+0000","last_became_active":"2024-04-25T08:45:18.814855+0000","last_became_peered":"2024-04-25T08:45:18.814855+0000","last_unstale":"2024-04-25T08:45:19.821074+0000","last_undegraded":"2024-04-25T08:45:19.821074+0000","last_fullsized":"2024-04-25T08:45:19.821074+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:01.492205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818492+0000","last_change":"2024-04-25T08:45:18.817199+0000","last_active":"2024-04-25T08:45:19.818492+0000","last_peered":"2024-04-25T08:45:19.818492+0000","last_clean":"2024-04-25T08:45:19.818492+0000","last_became_active":"2024-04-25T08:45:18.816814+0000","last_became_peered":"2024-04-25T08:45:18.816814+0000","last_unstale":"2024-04-25T08:45:19.818492+0000","last_undegraded":"2024-04-25T08:45:19.818492+0000","last_fullsized":"2024-04-25T08:45:19.818492+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:06.813911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803737+0000","last_change":"2024-04-25T08:45:18.817338+0000","last_active":"2024-04-25T08:45:19.803737+0000","last_peered":"2024-04-25T08:45:19.803737+0000","last_clean":"2024-04-25T08:45:19.803737+0000","last_became_active":"2024-04-25T08:45:18.817056+0000","last_became_peered":"2024-04-25T08:45:18.817056+0000","last_unstale":"2024-04-25T08:45:19.803737+0000","last_undegraded":"2024-04-25T08:45:19.803737+0000","last_fullsized":"2024-04-25T08:45:19.803737+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:27.789534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803947+0000","last_change":"2024-04-25T08:45:18.819401+0000","last_active":"2024-04-25T08:45:19.803947+0000","last_peered":"2024-04-25T08:45:19.803947+0000","last_clean":"2024-04-25T08:45:19.803947+0000","last_became_active":"2024-04-25T08:45:18.819138+0000","last_became_peered":"2024-04-25T08:45:18.819138+0000","last_unstale":"2024-04-25T08:45:19.803947+0000","last_undegraded":"2024-04-25T08:45:19.803947+0000","last_fullsized":"2024-04-25T08:45:19.803947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:28.771073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033224+0000","last_change":"2024-04-25T08:45:18.817815+0000","last_active":"2024-04-25T08:45:21.033224+0000","last_peered":"2024-04-25T08:45:21.033224+0000","last_clean":"2024-04-25T08:45:21.033224+0000","last_became_active":"2024-04-25T08:45:18.816694+0000","last_became_peered":"2024-04-25T08:45:18.816694+0000","last_unstale":"2024-04-25T08:45:21.033224+0000","last_undegraded":"2024-04-25T08:45:21.033224+0000","last_fullsized":"2024-04-25T08:45:21.033224+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:54.242386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033131+0000","last_change":"2024-04-25T08:45:18.817738+0000","last_active":"2024-04-25T08:45:21.033131+0000","last_peered":"2024-04-25T08:45:21.033131+0000","last_clean":"2024-04-25T08:45:21.033131+0000","last_became_active":"2024-04-25T08:45:18.817465+0000","last_became_peered":"2024-04-25T08:45:18.817465+0000","last_unstale":"2024-04-25T08:45:21.033131+0000","last_undegraded":"2024-04-25T08:45:21.033131+0000","last_fullsized":"2024-04-25T08:45:21.033131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:56.434947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818062+0000","last_change":"2024-04-25T08:45:18.816702+0000","last_active":"2024-04-25T08:45:19.818062+0000","last_peered":"2024-04-25T08:45:19.818062+0000","last_clean":"2024-04-25T08:45:19.818062+0000","last_became_active":"2024-04-25T08:45:18.816452+0000","last_became_peered":"2024-04-25T08:45:18.816452+0000","last_unstale":"2024-04-25T08:45:19.818062+0000","last_undegraded":"2024-04-25T08:45:19.818062+0000","last_fullsized":"2024-04-25T08:45:19.818062+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:21.517873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818670+0000","last_change":"2024-04-25T08:45:18.813768+0000","last_active":"2024-04-25T08:45:19.818670+0000","last_peered":"2024-04-25T08:45:19.818670+0000","last_clean":"2024-04-25T08:45:19.818670+0000","last_became_active":"2024-04-25T08:45:18.812372+0000","last_became_peered":"2024-04-25T08:45:18.812372+0000","last_unstale":"2024-04-25T08:45:19.818670+0000","last_undegraded":"2024-04-25T08:45:19.818670+0000","last_fullsized":"2024-04-25T08:45:19.818670+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:41.400003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033732+0000","last_change":"2024-04-25T08:45:18.814137+0000","last_active":"2024-04-25T08:45:21.033732+0000","last_peered":"2024-04-25T08:45:21.033732+0000","last_clean":"2024-04-25T08:45:21.033732+0000","last_became_active":"2024-04-25T08:45:18.813607+0000","last_became_peered":"2024-04-25T08:45:18.813607+0000","last_unstale":"2024-04-25T08:45:21.033732+0000","last_undegraded":"2024-04-25T08:45:21.033732+0000","last_fullsized":"2024-04-25T08:45:21.033732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:08.093322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804880+0000","last_change":"2024-04-25T08:45:18.811043+0000","last_active":"2024-04-25T08:45:19.804880+0000","last_peered":"2024-04-25T08:45:19.804880+0000","last_clean":"2024-04-25T08:45:19.804880+0000","last_became_active":"2024-04-25T08:45:18.809769+0000","last_became_peered":"2024-04-25T08:45:18.809769+0000","last_unstale":"2024-04-25T08:45:19.804880+0000","last_undegraded":"2024-04-25T08:45:19.804880+0000","last_fullsized":"2024-04-25T08:45:19.804880+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:39.831346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803907+0000","last_change":"2024-04-25T08:45:18.809403+0000","last_active":"2024-04-25T08:45:19.803907+0000","last_peered":"2024-04-25T08:45:19.803907+0000","last_clean":"2024-04-25T08:45:19.803907+0000","last_became_active":"2024-04-25T08:45:18.809134+0000","last_became_peered":"2024-04-25T08:45:18.809134+0000","last_unstale":"2024-04-25T08:45:19.803907+0000","last_undegraded":"2024-04-25T08:45:19.803907+0000","last_fullsized":"2024-04-25T08:45:19.803907+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:07.424894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818328+0000","last_change":"2024-04-25T08:45:18.812719+0000","last_active":"2024-04-25T08:45:19.818328+0000","last_peered":"2024-04-25T08:45:19.818328+0000","last_clean":"2024-04-25T08:45:19.818328+0000","last_became_active":"2024-04-25T08:45:18.812448+0000","last_became_peered":"2024-04-25T08:45:18.812448+0000","last_unstale":"2024-04-25T08:45:19.818328+0000","last_undegraded":"2024-04-25T08:45:19.818328+0000","last_fullsized":"2024-04-25T08:45:19.818328+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:56.948524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820676+0000","last_change":"2024-04-25T08:45:18.819965+0000","last_active":"2024-04-25T08:45:19.820676+0000","last_peered":"2024-04-25T08:45:19.820676+0000","last_clean":"2024-04-25T08:45:19.820676+0000","last_became_active":"2024-04-25T08:45:18.819478+0000","last_became_peered":"2024-04-25T08:45:18.819478+0000","last_unstale":"2024-04-25T08:45:19.820676+0000","last_undegraded":"2024-04-25T08:45:19.820676+0000","last_fullsized":"2024-04-25T08:45:19.820676+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:19.149675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818198+0000","last_change":"2024-04-25T08:45:18.812158+0000","last_active":"2024-04-25T08:45:19.818198+0000","last_peered":"2024-04-25T08:45:19.818198+0000","last_clean":"2024-04-25T08:45:19.818198+0000","last_became_active":"2024-04-25T08:45:18.811885+0000","last_became_peered":"2024-04-25T08:45:18.811885+0000","last_unstale":"2024-04-25T08:45:19.818198+0000","last_undegraded":"2024-04-25T08:45:19.818198+0000","last_fullsized":"2024-04-25T08:45:19.818198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:05.538676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803094+0000","last_change":"2024-04-25T08:45:18.806217+0000","last_active":"2024-04-25T08:45:19.803094+0000","last_peered":"2024-04-25T08:45:19.803094+0000","last_clean":"2024-04-25T08:45:19.803094+0000","last_became_active":"2024-04-25T08:45:18.805547+0000","last_became_peered":"2024-04-25T08:45:18.805547+0000","last_unstale":"2024-04-25T08:45:19.803094+0000","last_undegraded":"2024-04-25T08:45:19.803094+0000","last_fullsized":"2024-04-25T08:45:19.803094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:13.704107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820393+0000","last_change":"2024-04-25T08:45:18.823127+0000","last_active":"2024-04-25T08:45:19.820393+0000","last_peered":"2024-04-25T08:45:19.820393+0000","last_clean":"2024-04-25T08:45:19.820393+0000","last_became_active":"2024-04-25T08:45:18.822827+0000","last_became_peered":"2024-04-25T08:45:18.822827+0000","last_unstale":"2024-04-25T08:45:19.820393+0000","last_undegraded":"2024-04-25T08:45:19.820393+0000","last_fullsized":"2024-04-25T08:45:19.820393+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:45.316373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804028+0000","last_change":"2024-04-25T08:45:17.798176+0000","last_active":"2024-04-25T08:45:19.804028+0000","last_peered":"2024-04-25T08:45:19.804028+0000","last_clean":"2024-04-25T08:45:19.804028+0000","last_became_active":"2024-04-25T08:45:17.797819+0000","last_became_peered":"2024-04-25T08:45:17.797819+0000","last_unstale":"2024-04-25T08:45:19.804028+0000","last_undegraded":"2024-04-25T08:45:19.804028+0000","last_fullsized":"2024-04-25T08:45:19.804028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:23.144816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803606+0000","last_change":"2024-04-25T08:45:18.818475+0000","last_active":"2024-04-25T08:45:19.803606+0000","last_peered":"2024-04-25T08:45:19.803606+0000","last_clean":"2024-04-25T08:45:19.803606+0000","last_became_active":"2024-04-25T08:45:18.818139+0000","last_became_peered":"2024-04-25T08:45:18.818139+0000","last_unstale":"2024-04-25T08:45:19.803606+0000","last_undegraded":"2024-04-25T08:45:19.803606+0000","last_fullsized":"2024-04-25T08:45:19.803606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:27.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804775+0000","last_change":"2024-04-25T08:45:17.809481+0000","last_active":"2024-04-25T08:45:19.804775+0000","last_peered":"2024-04-25T08:45:19.804775+0000","last_clean":"2024-04-25T08:45:19.804775+0000","last_became_active":"2024-04-25T08:45:17.809229+0000","last_became_peered":"2024-04-25T08:45:17.809229+0000","last_unstale":"2024-04-25T08:45:19.804775+0000","last_undegraded":"2024-04-25T08:45:19.804775+0000","last_fullsized":"2024-04-25T08:45:19.804775+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:14.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804496+0000","last_change":"2024-04-25T08:45:18.812140+0000","last_active":"2024-04-25T08:45:19.804496+0000","last_peered":"2024-04-25T08:45:19.804496+0000","last_clean":"2024-04-25T08:45:19.804496+0000","last_became_active":"2024-04-25T08:45:18.811876+0000","last_became_peered":"2024-04-25T08:45:18.811876+0000","last_unstale":"2024-04-25T08:45:19.804496+0000","last_undegraded":"2024-04-25T08:45:19.804496+0000","last_fullsized":"2024-04-25T08:45:19.804496+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:07.421990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804848+0000","last_change":"2024-04-25T08:45:17.801691+0000","last_active":"2024-04-25T08:45:19.804848+0000","last_peered":"2024-04-25T08:45:19.804848+0000","last_clean":"2024-04-25T08:45:19.804848+0000","last_became_active":"2024-04-25T08:45:17.800726+0000","last_became_peered":"2024-04-25T08:45:17.800726+0000","last_unstale":"2024-04-25T08:45:19.804848+0000","last_undegraded":"2024-04-25T08:45:19.804848+0000","last_fullsized":"2024-04-25T08:45:19.804848+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:08.963648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033151+0000","last_change":"2024-04-25T08:45:18.812760+0000","last_active":"2024-04-25T08:45:21.033151+0000","last_peered":"2024-04-25T08:45:21.033151+0000","last_clean":"2024-04-25T08:45:21.033151+0000","last_became_active":"2024-04-25T08:45:18.812525+0000","last_became_peered":"2024-04-25T08:45:18.812525+0000","last_unstale":"2024-04-25T08:45:21.033151+0000","last_undegraded":"2024-04-25T08:45:21.033151+0000","last_fullsized":"2024-04-25T08:45:21.033151+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:12.775500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803786+0000","last_change":"2024-04-25T08:45:17.802514+0000","last_active":"2024-04-25T08:45:19.803786+0000","last_peered":"2024-04-25T08:45:19.803786+0000","last_clean":"2024-04-25T08:45:19.803786+0000","last_became_active":"2024-04-25T08:45:17.802246+0000","last_became_peered":"2024-04-25T08:45:17.802246+0000","last_unstale":"2024-04-25T08:45:19.803786+0000","last_undegraded":"2024-04-25T08:45:19.803786+0000","last_fullsized":"2024-04-25T08:45:19.803786+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:38.824749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033940+0000","last_change":"2024-04-25T08:45:18.817582+0000","last_active":"2024-04-25T08:45:21.033940+0000","last_peered":"2024-04-25T08:45:21.033940+0000","last_clean":"2024-04-25T08:45:21.033940+0000","last_became_active":"2024-04-25T08:45:18.817310+0000","last_became_peered":"2024-04-25T08:45:18.817310+0000","last_unstale":"2024-04-25T08:45:21.033940+0000","last_undegraded":"2024-04-25T08:45:21.033940+0000","last_fullsized":"2024-04-25T08:45:21.033940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:34.800468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818296+0000","last_change":"2024-04-25T08:45:17.810355+0000","last_active":"2024-04-25T08:45:19.818296+0000","last_peered":"2024-04-25T08:45:19.818296+0000","last_clean":"2024-04-25T08:45:19.818296+0000","last_became_active":"2024-04-25T08:45:17.809979+0000","last_became_peered":"2024-04-25T08:45:17.809979+0000","last_unstale":"2024-04-25T08:45:19.818296+0000","last_undegraded":"2024-04-25T08:45:19.818296+0000","last_fullsized":"2024-04-25T08:45:19.818296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:28.037489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820804+0000","last_change":"2024-04-25T08:45:18.818362+0000","last_active":"2024-04-25T08:45:19.820804+0000","last_peered":"2024-04-25T08:45:19.820804+0000","last_clean":"2024-04-25T08:45:19.820804+0000","last_became_active":"2024-04-25T08:45:18.818063+0000","last_became_peered":"2024-04-25T08:45:18.818063+0000","last_unstale":"2024-04-25T08:45:19.820804+0000","last_undegraded":"2024-04-25T08:45:19.820804+0000","last_fullsized":"2024-04-25T08:45:19.820804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:32.847694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033600+0000","last_change":"2024-04-25T08:45:17.800390+0000","last_active":"2024-04-25T08:45:21.033600+0000","last_peered":"2024-04-25T08:45:21.033600+0000","last_clean":"2024-04-25T08:45:21.033600+0000","last_became_active":"2024-04-25T08:45:17.800099+0000","last_became_peered":"2024-04-25T08:45:17.800099+0000","last_unstale":"2024-04-25T08:45:21.033600+0000","last_undegraded":"2024-04-25T08:45:21.033600+0000","last_fullsized":"2024-04-25T08:45:21.033600+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:46.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033899+0000","last_change":"2024-04-25T08:45:18.813926+0000","last_active":"2024-04-25T08:45:21.033899+0000","last_peered":"2024-04-25T08:45:21.033899+0000","last_clean":"2024-04-25T08:45:21.033899+0000","last_became_active":"2024-04-25T08:45:18.813576+0000","last_became_peered":"2024-04-25T08:45:18.813576+0000","last_unstale":"2024-04-25T08:45:21.033899+0000","last_undegraded":"2024-04-25T08:45:21.033899+0000","last_fullsized":"2024-04-25T08:45:21.033899+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:52.892644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804342+0000","last_change":"2024-04-25T08:45:17.802334+0000","last_active":"2024-04-25T08:45:19.804342+0000","last_peered":"2024-04-25T08:45:19.804342+0000","last_clean":"2024-04-25T08:45:19.804342+0000","last_became_active":"2024-04-25T08:45:17.802078+0000","last_became_peered":"2024-04-25T08:45:17.802078+0000","last_unstale":"2024-04-25T08:45:19.804342+0000","last_undegraded":"2024-04-25T08:45:19.804342+0000","last_fullsized":"2024-04-25T08:45:19.804342+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:19.594037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820804+0000","last_change":"2024-04-25T08:45:18.819710+0000","last_active":"2024-04-25T08:45:19.820804+0000","last_peered":"2024-04-25T08:45:19.820804+0000","last_clean":"2024-04-25T08:45:19.820804+0000","last_became_active":"2024-04-25T08:45:18.819347+0000","last_became_peered":"2024-04-25T08:45:18.819347+0000","last_unstale":"2024-04-25T08:45:19.820804+0000","last_undegraded":"2024-04-25T08:45:19.820804+0000","last_fullsized":"2024-04-25T08:45:19.820804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:12.202880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818079+0000","last_change":"2024-04-25T08:45:17.805228+0000","last_active":"2024-04-25T08:45:19.818079+0000","last_peered":"2024-04-25T08:45:19.818079+0000","last_clean":"2024-04-25T08:45:19.818079+0000","last_became_active":"2024-04-25T08:45:17.804964+0000","last_became_peered":"2024-04-25T08:45:17.804964+0000","last_unstale":"2024-04-25T08:45:19.818079+0000","last_undegraded":"2024-04-25T08:45:19.818079+0000","last_fullsized":"2024-04-25T08:45:19.818079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:27.764477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033590+0000","last_change":"2024-04-25T08:45:18.814488+0000","last_active":"2024-04-25T08:45:21.033590+0000","last_peered":"2024-04-25T08:45:21.033590+0000","last_clean":"2024-04-25T08:45:21.033590+0000","last_became_active":"2024-04-25T08:45:18.814172+0000","last_became_peered":"2024-04-25T08:45:18.814172+0000","last_unstale":"2024-04-25T08:45:21.033590+0000","last_undegraded":"2024-04-25T08:45:21.033590+0000","last_fullsized":"2024-04-25T08:45:21.033590+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:27.789534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820924+0000","last_change":"2024-04-25T08:45:17.803671+0000","last_active":"2024-04-25T08:45:19.820924+0000","last_peered":"2024-04-25T08:45:19.820924+0000","last_clean":"2024-04-25T08:45:19.820924+0000","last_became_active":"2024-04-25T08:45:17.803356+0000","last_became_peered":"2024-04-25T08:45:17.803356+0000","last_unstale":"2024-04-25T08:45:19.820924+0000","last_undegraded":"2024-04-25T08:45:19.820924+0000","last_fullsized":"2024-04-25T08:45:19.820924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:33.793872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803057+0000","last_change":"2024-04-25T08:45:18.815729+0000","last_active":"2024-04-25T08:45:19.803057+0000","last_peered":"2024-04-25T08:45:19.803057+0000","last_clean":"2024-04-25T08:45:19.803057+0000","last_became_active":"2024-04-25T08:45:18.815460+0000","last_became_peered":"2024-04-25T08:45:18.815460+0000","last_unstale":"2024-04-25T08:45:19.803057+0000","last_undegraded":"2024-04-25T08:45:19.803057+0000","last_fullsized":"2024-04-25T08:45:19.803057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:05.538676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033877+0000","last_change":"2024-04-25T08:45:17.810448+0000","last_active":"2024-04-25T08:45:21.033877+0000","last_peered":"2024-04-25T08:45:21.033877+0000","last_clean":"2024-04-25T08:45:21.033877+0000","last_became_active":"2024-04-25T08:45:17.810154+0000","last_became_peered":"2024-04-25T08:45:17.810154+0000","last_unstale":"2024-04-25T08:45:21.033877+0000","last_undegraded":"2024-04-25T08:45:21.033877+0000","last_fullsized":"2024-04-25T08:45:21.033877+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:23.502405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818334+0000","last_change":"2024-04-25T08:45:18.816083+0000","last_active":"2024-04-25T08:45:19.818334+0000","last_peered":"2024-04-25T08:45:19.818334+0000","last_clean":"2024-04-25T08:45:19.818334+0000","last_became_active":"2024-04-25T08:45:18.815636+0000","last_became_peered":"2024-04-25T08:45:18.815636+0000","last_unstale":"2024-04-25T08:45:19.818334+0000","last_undegraded":"2024-04-25T08:45:19.818334+0000","last_fullsized":"2024-04-25T08:45:19.818334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:55.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820891+0000","last_change":"2024-04-25T08:45:17.804283+0000","last_active":"2024-04-25T08:45:19.820891+0000","last_peered":"2024-04-25T08:45:19.820891+0000","last_clean":"2024-04-25T08:45:19.820891+0000","last_became_active":"2024-04-25T08:45:17.804027+0000","last_became_peered":"2024-04-25T08:45:17.804027+0000","last_unstale":"2024-04-25T08:45:19.820891+0000","last_undegraded":"2024-04-25T08:45:19.820891+0000","last_fullsized":"2024-04-25T08:45:19.820891+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:27.764477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033961+0000","last_change":"2024-04-25T08:45:18.813202+0000","last_active":"2024-04-25T08:45:21.033961+0000","last_peered":"2024-04-25T08:45:21.033961+0000","last_clean":"2024-04-25T08:45:21.033961+0000","last_became_active":"2024-04-25T08:45:18.812920+0000","last_became_peered":"2024-04-25T08:45:18.812920+0000","last_unstale":"2024-04-25T08:45:21.033961+0000","last_undegraded":"2024-04-25T08:45:21.033961+0000","last_fullsized":"2024-04-25T08:45:21.033961+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:46.408513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"53'6","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033761+0000","last_change":"2024-04-25T08:45:17.799519+0000","last_active":"2024-04-25T08:45:21.033761+0000","last_peered":"2024-04-25T08:45:21.033761+0000","last_clean":"2024-04-25T08:45:21.033761+0000","last_became_active":"2024-04-25T08:45:17.799208+0000","last_became_peered":"2024-04-25T08:45:17.799208+0000","last_unstale":"2024-04-25T08:45:21.033761+0000","last_undegraded":"2024-04-25T08:45:21.033761+0000","last_fullsized":"2024-04-25T08:45:21.033761+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:11.196284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803414+0000","last_change":"2024-04-25T08:45:18.812390+0000","last_active":"2024-04-25T08:45:19.803414+0000","last_peered":"2024-04-25T08:45:19.803414+0000","last_clean":"2024-04-25T08:45:19.803414+0000","last_became_active":"2024-04-25T08:45:18.812083+0000","last_became_peered":"2024-04-25T08:45:18.812083+0000","last_unstale":"2024-04-25T08:45:19.803414+0000","last_undegraded":"2024-04-25T08:45:19.803414+0000","last_fullsized":"2024-04-25T08:45:19.803414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:55.553836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818459+0000","last_change":"2024-04-25T08:45:17.806064+0000","last_active":"2024-04-25T08:45:19.818459+0000","last_peered":"2024-04-25T08:45:19.818459+0000","last_clean":"2024-04-25T08:45:19.818459+0000","last_became_active":"2024-04-25T08:45:17.805804+0000","last_became_peered":"2024-04-25T08:45:17.805804+0000","last_unstale":"2024-04-25T08:45:19.818459+0000","last_undegraded":"2024-04-25T08:45:19.818459+0000","last_fullsized":"2024-04-25T08:45:19.818459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:26.782938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818549+0000","last_change":"2024-04-25T08:45:18.819138+0000","last_active":"2024-04-25T08:45:19.818549+0000","last_peered":"2024-04-25T08:45:19.818549+0000","last_clean":"2024-04-25T08:45:19.818549+0000","last_became_active":"2024-04-25T08:45:18.818869+0000","last_became_peered":"2024-04-25T08:45:18.818869+0000","last_unstale":"2024-04-25T08:45:19.818549+0000","last_undegraded":"2024-04-25T08:45:19.818549+0000","last_fullsized":"2024-04-25T08:45:19.818549+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:37.225948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804485+0000","last_change":"2024-04-25T08:45:17.809326+0000","last_active":"2024-04-25T08:45:19.804485+0000","last_peered":"2024-04-25T08:45:19.804485+0000","last_clean":"2024-04-25T08:45:19.804485+0000","last_became_active":"2024-04-25T08:45:17.809042+0000","last_became_peered":"2024-04-25T08:45:17.809042+0000","last_unstale":"2024-04-25T08:45:19.804485+0000","last_undegraded":"2024-04-25T08:45:19.804485+0000","last_fullsized":"2024-04-25T08:45:19.804485+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:14.109228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033774+0000","last_change":"2024-04-25T08:45:18.814543+0000","last_active":"2024-04-25T08:45:21.033774+0000","last_peered":"2024-04-25T08:45:21.033774+0000","last_clean":"2024-04-25T08:45:21.033774+0000","last_became_active":"2024-04-25T08:45:18.814271+0000","last_became_peered":"2024-04-25T08:45:18.814271+0000","last_unstale":"2024-04-25T08:45:21.033774+0000","last_undegraded":"2024-04-25T08:45:21.033774+0000","last_fullsized":"2024-04-25T08:45:21.033774+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:07.796688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820697+0000","last_change":"2024-04-25T08:45:17.803988+0000","last_active":"2024-04-25T08:45:19.820697+0000","last_peered":"2024-04-25T08:45:19.820697+0000","last_clean":"2024-04-25T08:45:19.820697+0000","last_became_active":"2024-04-25T08:45:17.803681+0000","last_became_peered":"2024-04-25T08:45:17.803681+0000","last_unstale":"2024-04-25T08:45:19.820697+0000","last_undegraded":"2024-04-25T08:45:19.820697+0000","last_fullsized":"2024-04-25T08:45:19.820697+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:26.782938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818633+0000","last_change":"2024-04-25T08:45:18.817297+0000","last_active":"2024-04-25T08:45:19.818633+0000","last_peered":"2024-04-25T08:45:19.818633+0000","last_clean":"2024-04-25T08:45:19.818633+0000","last_became_active":"2024-04-25T08:45:18.813964+0000","last_became_peered":"2024-04-25T08:45:18.813964+0000","last_unstale":"2024-04-25T08:45:19.818633+0000","last_undegraded":"2024-04-25T08:45:19.818633+0000","last_fullsized":"2024-04-25T08:45:19.818633+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:54.242386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033453+0000","last_change":"2024-04-25T08:45:17.800781+0000","last_active":"2024-04-25T08:45:21.033453+0000","last_peered":"2024-04-25T08:45:21.033453+0000","last_clean":"2024-04-25T08:45:21.033453+0000","last_became_active":"2024-04-25T08:45:17.800534+0000","last_became_peered":"2024-04-25T08:45:17.800534+0000","last_unstale":"2024-04-25T08:45:21.033453+0000","last_undegraded":"2024-04-25T08:45:21.033453+0000","last_fullsized":"2024-04-25T08:45:21.033453+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:00.485609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033360+0000","last_change":"2024-04-25T08:45:18.810293+0000","last_active":"2024-04-25T08:45:21.033360+0000","last_peered":"2024-04-25T08:45:21.033360+0000","last_clean":"2024-04-25T08:45:21.033360+0000","last_became_active":"2024-04-25T08:45:18.810028+0000","last_became_peered":"2024-04-25T08:45:18.810028+0000","last_unstale":"2024-04-25T08:45:21.033360+0000","last_undegraded":"2024-04-25T08:45:21.033360+0000","last_fullsized":"2024-04-25T08:45:21.033360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:41.400003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818735+0000","last_change":"2024-04-25T08:45:17.812248+0000","last_active":"2024-04-25T08:45:19.818735+0000","last_peered":"2024-04-25T08:45:19.818735+0000","last_clean":"2024-04-25T08:45:19.818735+0000","last_became_active":"2024-04-25T08:45:17.811983+0000","last_became_peered":"2024-04-25T08:45:17.811983+0000","last_unstale":"2024-04-25T08:45:19.818735+0000","last_undegraded":"2024-04-25T08:45:19.818735+0000","last_fullsized":"2024-04-25T08:45:19.818735+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:33.793872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804293+0000","last_change":"2024-04-25T08:45:18.809234+0000","last_active":"2024-04-25T08:45:19.804293+0000","last_peered":"2024-04-25T08:45:19.804293+0000","last_clean":"2024-04-25T08:45:19.804293+0000","last_became_active":"2024-04-25T08:45:18.808966+0000","last_became_peered":"2024-04-25T08:45:18.808966+0000","last_unstale":"2024-04-25T08:45:19.804293+0000","last_undegraded":"2024-04-25T08:45:19.804293+0000","last_fullsized":"2024-04-25T08:45:19.804293+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:52:14.901643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033498+0000","last_change":"2024-04-25T08:45:17.798805+0000","last_active":"2024-04-25T08:45:21.033498+0000","last_peered":"2024-04-25T08:45:21.033498+0000","last_clean":"2024-04-25T08:45:21.033498+0000","last_became_active":"2024-04-25T08:45:17.798548+0000","last_became_peered":"2024-04-25T08:45:17.798548+0000","last_unstale":"2024-04-25T08:45:21.033498+0000","last_undegraded":"2024-04-25T08:45:21.033498+0000","last_fullsized":"2024-04-25T08:45:21.033498+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:16.504381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033689+0000","last_change":"2024-04-25T08:45:18.821542+0000","last_active":"2024-04-25T08:45:21.033689+0000","last_peered":"2024-04-25T08:45:21.033689+0000","last_clean":"2024-04-25T08:45:21.033689+0000","last_became_active":"2024-04-25T08:45:18.821265+0000","last_became_peered":"2024-04-25T08:45:18.821265+0000","last_unstale":"2024-04-25T08:45:21.033689+0000","last_undegraded":"2024-04-25T08:45:21.033689+0000","last_fullsized":"2024-04-25T08:45:21.033689+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:07.424894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804389+0000","last_change":"2024-04-25T08:45:17.803274+0000","last_active":"2024-04-25T08:45:19.804389+0000","last_peered":"2024-04-25T08:45:19.804389+0000","last_clean":"2024-04-25T08:45:19.804389+0000","last_became_active":"2024-04-25T08:45:17.802955+0000","last_became_peered":"2024-04-25T08:45:17.802955+0000","last_unstale":"2024-04-25T08:45:19.804389+0000","last_undegraded":"2024-04-25T08:45:19.804389+0000","last_fullsized":"2024-04-25T08:45:19.804389+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:32.249645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804519+0000","last_change":"2024-04-25T08:45:18.804429+0000","last_active":"2024-04-25T08:45:19.804519+0000","last_peered":"2024-04-25T08:45:19.804519+0000","last_clean":"2024-04-25T08:45:19.804519+0000","last_became_active":"2024-04-25T08:45:18.804174+0000","last_became_peered":"2024-04-25T08:45:18.804174+0000","last_unstale":"2024-04-25T08:45:19.804519+0000","last_undegraded":"2024-04-25T08:45:19.804519+0000","last_fullsized":"2024-04-25T08:45:19.804519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:23.495679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804054+0000","last_change":"2024-04-25T08:45:17.808334+0000","last_active":"2024-04-25T08:45:19.804054+0000","last_peered":"2024-04-25T08:45:19.804054+0000","last_clean":"2024-04-25T08:45:19.804054+0000","last_became_active":"2024-04-25T08:45:17.808083+0000","last_became_peered":"2024-04-25T08:45:17.808083+0000","last_unstale":"2024-04-25T08:45:19.804054+0000","last_undegraded":"2024-04-25T08:45:19.804054+0000","last_fullsized":"2024-04-25T08:45:19.804054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:46.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803679+0000","last_change":"2024-04-25T08:45:18.813938+0000","last_active":"2024-04-25T08:45:19.803679+0000","last_peered":"2024-04-25T08:45:19.803679+0000","last_clean":"2024-04-25T08:45:19.803679+0000","last_became_active":"2024-04-25T08:45:18.813684+0000","last_became_peered":"2024-04-25T08:45:18.813684+0000","last_unstale":"2024-04-25T08:45:19.803679+0000","last_undegraded":"2024-04-25T08:45:19.803679+0000","last_fullsized":"2024-04-25T08:45:19.803679+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:23.134616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804603+0000","last_change":"2024-04-25T08:45:17.794790+0000","last_active":"2024-04-25T08:45:19.804603+0000","last_peered":"2024-04-25T08:45:19.804603+0000","last_clean":"2024-04-25T08:45:19.804603+0000","last_became_active":"2024-04-25T08:45:17.794372+0000","last_became_peered":"2024-04-25T08:45:17.794372+0000","last_unstale":"2024-04-25T08:45:19.804603+0000","last_undegraded":"2024-04-25T08:45:19.804603+0000","last_fullsized":"2024-04-25T08:45:19.804603+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:08:46.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804061+0000","last_change":"2024-04-25T08:45:18.816086+0000","last_active":"2024-04-25T08:45:19.804061+0000","last_peered":"2024-04-25T08:45:19.804061+0000","last_clean":"2024-04-25T08:45:19.804061+0000","last_became_active":"2024-04-25T08:45:18.815805+0000","last_became_peered":"2024-04-25T08:45:18.815805+0000","last_unstale":"2024-04-25T08:45:19.804061+0000","last_undegraded":"2024-04-25T08:45:19.804061+0000","last_fullsized":"2024-04-25T08:45:19.804061+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:34.800468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033320+0000","last_change":"2024-04-25T08:45:17.805427+0000","last_active":"2024-04-25T08:45:21.033320+0000","last_peered":"2024-04-25T08:45:21.033320+0000","last_clean":"2024-04-25T08:45:21.033320+0000","last_became_active":"2024-04-25T08:45:17.805189+0000","last_became_peered":"2024-04-25T08:45:17.805189+0000","last_unstale":"2024-04-25T08:45:21.033320+0000","last_undegraded":"2024-04-25T08:45:21.033320+0000","last_fullsized":"2024-04-25T08:45:21.033320+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:31.841098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818560+0000","last_change":"2024-04-25T08:45:18.813716+0000","last_active":"2024-04-25T08:45:19.818560+0000","last_peered":"2024-04-25T08:45:19.818560+0000","last_clean":"2024-04-25T08:45:19.818560+0000","last_became_active":"2024-04-25T08:45:18.813402+0000","last_became_peered":"2024-04-25T08:45:18.813402+0000","last_unstale":"2024-04-25T08:45:19.818560+0000","last_undegraded":"2024-04-25T08:45:19.818560+0000","last_fullsized":"2024-04-25T08:45:19.818560+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:12.775500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818228+0000","last_change":"2024-04-25T08:45:17.810788+0000","last_active":"2024-04-25T08:45:19.818228+0000","last_peered":"2024-04-25T08:45:19.818228+0000","last_clean":"2024-04-25T08:45:19.818228+0000","last_became_active":"2024-04-25T08:45:17.810512+0000","last_became_peered":"2024-04-25T08:45:17.810512+0000","last_unstale":"2024-04-25T08:45:19.818228+0000","last_undegraded":"2024-04-25T08:45:19.818228+0000","last_fullsized":"2024-04-25T08:45:19.818228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:06.418297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804900+0000","last_change":"2024-04-25T08:45:18.809939+0000","last_active":"2024-04-25T08:45:19.804900+0000","last_peered":"2024-04-25T08:45:19.804900+0000","last_clean":"2024-04-25T08:45:19.804900+0000","last_became_active":"2024-04-25T08:45:18.809661+0000","last_became_peered":"2024-04-25T08:45:18.809661+0000","last_unstale":"2024-04-25T08:45:19.804900+0000","last_undegraded":"2024-04-25T08:45:19.804900+0000","last_fullsized":"2024-04-25T08:45:19.804900+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:19.149675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033045+0000","last_change":"2024-04-25T08:45:17.798455+0000","last_active":"2024-04-25T08:45:21.033045+0000","last_peered":"2024-04-25T08:45:21.033045+0000","last_clean":"2024-04-25T08:45:21.033045+0000","last_became_active":"2024-04-25T08:45:17.798181+0000","last_became_peered":"2024-04-25T08:45:17.798181+0000","last_unstale":"2024-04-25T08:45:21.033045+0000","last_undegraded":"2024-04-25T08:45:21.033045+0000","last_fullsized":"2024-04-25T08:45:21.033045+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:40.232205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803128+0000","last_change":"2024-04-25T08:45:18.806436+0000","last_active":"2024-04-25T08:45:19.803128+0000","last_peered":"2024-04-25T08:45:19.803128+0000","last_clean":"2024-04-25T08:45:19.803128+0000","last_became_active":"2024-04-25T08:45:18.805932+0000","last_became_peered":"2024-04-25T08:45:18.805932+0000","last_unstale":"2024-04-25T08:45:19.803128+0000","last_undegraded":"2024-04-25T08:45:19.803128+0000","last_fullsized":"2024-04-25T08:45:19.803128+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:05.548991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804154+0000","last_change":"2024-04-25T08:45:17.810476+0000","last_active":"2024-04-25T08:45:19.804154+0000","last_peered":"2024-04-25T08:45:19.804154+0000","last_clean":"2024-04-25T08:45:19.804154+0000","last_became_active":"2024-04-25T08:45:17.810125+0000","last_became_peered":"2024-04-25T08:45:17.810125+0000","last_unstale":"2024-04-25T08:45:19.804154+0000","last_undegraded":"2024-04-25T08:45:19.804154+0000","last_fullsized":"2024-04-25T08:45:19.804154+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:06.066759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804519+0000","last_change":"2024-04-25T08:45:18.806583+0000","last_active":"2024-04-25T08:45:19.804519+0000","last_peered":"2024-04-25T08:45:19.804519+0000","last_clean":"2024-04-25T08:45:19.804519+0000","last_became_active":"2024-04-25T08:45:18.806332+0000","last_became_peered":"2024-04-25T08:45:18.806332+0000","last_unstale":"2024-04-25T08:45:19.804519+0000","last_undegraded":"2024-04-25T08:45:19.804519+0000","last_fullsized":"2024-04-25T08:45:19.804519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:02.583352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820933+0000","last_change":"2024-04-25T08:45:17.804780+0000","last_active":"2024-04-25T08:45:19.820933+0000","last_peered":"2024-04-25T08:45:19.820933+0000","last_clean":"2024-04-25T08:45:19.820933+0000","last_became_active":"2024-04-25T08:45:17.804467+0000","last_became_peered":"2024-04-25T08:45:17.804467+0000","last_unstale":"2024-04-25T08:45:19.820933+0000","last_undegraded":"2024-04-25T08:45:19.820933+0000","last_fullsized":"2024-04-25T08:45:19.820933+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:06.418297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033604+0000","last_change":"2024-04-25T08:45:18.813775+0000","last_active":"2024-04-25T08:45:21.033604+0000","last_peered":"2024-04-25T08:45:21.033604+0000","last_clean":"2024-04-25T08:45:21.033604+0000","last_became_active":"2024-04-25T08:45:18.813301+0000","last_became_peered":"2024-04-25T08:45:18.813301+0000","last_unstale":"2024-04-25T08:45:21.033604+0000","last_undegraded":"2024-04-25T08:45:21.033604+0000","last_fullsized":"2024-04-25T08:45:21.033604+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:07.438915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818252+0000","last_change":"2024-04-25T08:45:17.806261+0000","last_active":"2024-04-25T08:45:19.818252+0000","last_peered":"2024-04-25T08:45:19.818252+0000","last_clean":"2024-04-25T08:45:19.818252+0000","last_became_active":"2024-04-25T08:45:17.805976+0000","last_became_peered":"2024-04-25T08:45:17.805976+0000","last_unstale":"2024-04-25T08:45:19.818252+0000","last_undegraded":"2024-04-25T08:45:19.818252+0000","last_fullsized":"2024-04-25T08:45:19.818252+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:45.401917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818319+0000","last_change":"2024-04-25T08:45:18.816647+0000","last_active":"2024-04-25T08:45:19.818319+0000","last_peered":"2024-04-25T08:45:19.818319+0000","last_clean":"2024-04-25T08:45:19.818319+0000","last_became_active":"2024-04-25T08:45:18.816385+0000","last_became_peered":"2024-04-25T08:45:18.816385+0000","last_unstale":"2024-04-25T08:45:19.818319+0000","last_undegraded":"2024-04-25T08:45:19.818319+0000","last_fullsized":"2024-04-25T08:45:19.818319+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:05.548991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033624+0000","last_change":"2024-04-25T08:45:17.806083+0000","last_active":"2024-04-25T08:45:21.033624+0000","last_peered":"2024-04-25T08:45:21.033624+0000","last_clean":"2024-04-25T08:45:21.033624+0000","last_became_active":"2024-04-25T08:45:17.805839+0000","last_became_peered":"2024-04-25T08:45:17.805839+0000","last_unstale":"2024-04-25T08:45:21.033624+0000","last_undegraded":"2024-04-25T08:45:21.033624+0000","last_fullsized":"2024-04-25T08:45:21.033624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:34.657722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803315+0000","last_change":"2024-04-25T08:45:18.813360+0000","last_active":"2024-04-25T08:45:19.803315+0000","last_peered":"2024-04-25T08:45:19.803315+0000","last_clean":"2024-04-25T08:45:19.803315+0000","last_became_active":"2024-04-25T08:45:18.812955+0000","last_became_peered":"2024-04-25T08:45:18.812955+0000","last_unstale":"2024-04-25T08:45:19.803315+0000","last_undegraded":"2024-04-25T08:45:19.803315+0000","last_fullsized":"2024-04-25T08:45:19.803315+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:56.948524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033399+0000","last_change":"2024-04-25T08:45:17.803961+0000","last_active":"2024-04-25T08:45:21.033399+0000","last_peered":"2024-04-25T08:45:21.033399+0000","last_clean":"2024-04-25T08:45:21.033399+0000","last_became_active":"2024-04-25T08:45:17.803705+0000","last_became_peered":"2024-04-25T08:45:17.803705+0000","last_unstale":"2024-04-25T08:45:21.033399+0000","last_undegraded":"2024-04-25T08:45:21.033399+0000","last_fullsized":"2024-04-25T08:45:21.033399+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:05.039045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.818478+0000","last_change":"2024-04-25T08:45:18.818777+0000","last_active":"2024-04-25T08:45:19.818478+0000","last_peered":"2024-04-25T08:45:19.818478+0000","last_clean":"2024-04-25T08:45:19.818478+0000","last_became_active":"2024-04-25T08:45:18.818176+0000","last_became_peered":"2024-04-25T08:45:18.818176+0000","last_unstale":"2024-04-25T08:45:19.818478+0000","last_undegraded":"2024-04-25T08:45:19.818478+0000","last_fullsized":"2024-04-25T08:45:19.818478+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:23.134616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033530+0000","last_change":"2024-04-25T08:45:17.807674+0000","last_active":"2024-04-25T08:45:21.033530+0000","last_peered":"2024-04-25T08:45:21.033530+0000","last_clean":"2024-04-25T08:45:21.033530+0000","last_became_active":"2024-04-25T08:45:17.807455+0000","last_became_peered":"2024-04-25T08:45:17.807455+0000","last_unstale":"2024-04-25T08:45:21.033530+0000","last_undegraded":"2024-04-25T08:45:21.033530+0000","last_fullsized":"2024-04-25T08:45:21.033530+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:08.963648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:21.033939+0000","last_change":"2024-04-25T08:45:18.815010+0000","last_active":"2024-04-25T08:45:21.033939+0000","last_peered":"2024-04-25T08:45:21.033939+0000","last_clean":"2024-04-25T08:45:21.033939+0000","last_became_active":"2024-04-25T08:45:18.814468+0000","last_became_peered":"2024-04-25T08:45:18.814468+0000","last_unstale":"2024-04-25T08:45:21.033939+0000","last_undegraded":"2024-04-25T08:45:21.033939+0000","last_fullsized":"2024-04-25T08:45:21.033939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:37.320439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.803214+0000","last_change":"2024-04-25T08:45:17.801098+0000","last_active":"2024-04-25T08:45:19.803214+0000","last_peered":"2024-04-25T08:45:19.803214+0000","last_clean":"2024-04-25T08:45:19.803214+0000","last_became_active":"2024-04-25T08:45:17.798374+0000","last_became_peered":"2024-04-25T08:45:17.798374+0000","last_unstale":"2024-04-25T08:45:19.803214+0000","last_undegraded":"2024-04-25T08:45:19.803214+0000","last_fullsized":"2024-04-25T08:45:19.803214+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:18.143078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.804248+0000","last_change":"2024-04-25T08:45:18.806073+0000","last_active":"2024-04-25T08:45:19.804248+0000","last_peered":"2024-04-25T08:45:19.804248+0000","last_clean":"2024-04-25T08:45:19.804248+0000","last_became_active":"2024-04-25T08:45:18.805646+0000","last_became_peered":"2024-04-25T08:45:18.805646+0000","last_unstale":"2024-04-25T08:45:19.804248+0000","last_undegraded":"2024-04-25T08:45:19.804248+0000","last_fullsized":"2024-04-25T08:45:19.804248+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:17.784010+0000","last_clean_scrub_stamp":"2024-04-25T08:45:17.784010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:46.408513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"54'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.819898+0000","last_change":"2024-04-25T08:45:17.808409+0000","last_active":"2024-04-25T08:45:19.819898+0000","last_peered":"2024-04-25T08:45:19.819898+0000","last_clean":"2024-04-25T08:45:19.819898+0000","last_became_active":"2024-04-25T08:45:17.808054+0000","last_became_peered":"2024-04-25T08:45:17.808054+0000","last_unstale":"2024-04-25T08:45:19.819898+0000","last_undegraded":"2024-04-25T08:45:19.819898+0000","last_fullsized":"2024-04-25T08:45:19.819898+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:45:16.777414+0000","last_clean_scrub_stamp":"2024-04-25T08:45:16.777414+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:06.415394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-25T08:45:19.820392+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:45:19.820392+0000","last_peered":"2024-04-25T08:45:19.820392+0000","last_clean":"2024-04-25T08:45:19.820392+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:45:19.820392+0000","last_undegraded":"2024-04-25T08:45:19.820392+0000","last_fullsized":"2024-04-25T08:45:19.820392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":879702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":289862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":643072,"data_stored":289210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35972,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335868,"statfs":{"total":96636764160,"available":96599928832,"internally_reserved":0,"allocated":647168,"data_stored":289792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":659456,"data_stored":290844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":655360,"data_stored":290822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":651264,"data_stored":289370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36560,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335280,"statfs":{"total":96636764160,"available":96599326720,"internally_reserved":0,"allocated":1245184,"data_stored":879634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:45:26.878 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:45:26.878 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:45:27.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.028+0000 7fd2ddd9e640 1 Processor -- start 2024-04-25T08:45:27.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.028+0000 7fd2ddd9e640 1 -- start start 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2ddd9e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd2d80cd4c0 0x7fd2d80cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2ddd9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd2d8150b90 0x7fd2d8151020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2ddd9e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d815e6e0 con 0x7fd2d815b1c0 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2ddd9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d8151560 con 0x7fd2d8150b90 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2ddd9e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d815e9c0 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2d7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd2d8150b90 0x7fd2d8151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2d6ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd2d815b1c0 0x7fd2d815dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39398/0 (socket says 172.21.15.172:39398) 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2d6ffd640 1 -- 172.21.15.172:0/980784566 learned_addr learned my addr 172.21.15.172:0/980784566 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2d77fe640 1 --2- 172.21.15.172:0/980784566 >> v2:172.21.15.186:3300/0 conn(0x7fd2d80cd4c0 0x7fd2d80cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2d7fff640 1 -- 172.21.15.172:0/980784566 >> v2:172.21.15.186:3300/0 conn(0x7fd2d80cd4c0 msgr2=0x7fd2d80cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2d7fff640 1 --2- 172.21.15.172:0/980784566 >> v2:172.21.15.186:3300/0 conn(0x7fd2d80cd4c0 0x7fd2d80cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2d7fff640 1 -- 172.21.15.172:0/980784566 >> v1:172.21.15.172:6789/0 conn(0x7fd2d815b1c0 legacy=0x7fd2d815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2d7fff640 1 -- 172.21.15.172:0/980784566 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d815a9c0 con 0x7fd2d8150b90 2024-04-25T08:45:27.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2d67fc640 1 -- 172.21.15.172:0/980784566 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472028999 0 0) 0x7fd2d815e6e0 con 0x7fd2d815b1c0 2024-04-25T08:45:27.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.029+0000 7fd2d77fe640 1 --2- 172.21.15.172:0/980784566 >> v2:172.21.15.186:3300/0 conn(0x7fd2d80cd4c0 0x7fd2d80cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:27.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.030+0000 7fd2d7fff640 1 --2- 172.21.15.172:0/980784566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d8150b90 0x7fd2d8151020 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd2d806b8e0 tx=0x7fd2d002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d6caa439cc2ce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:27.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.030+0000 7fd2d67fc640 1 -- 172.21.15.172:0/980784566 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0007740 con 0x7fd2d8150b90 2024-04-25T08:45:27.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.030+0000 7fd2d67fc640 1 -- 172.21.15.172:0/980784566 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d00078e0 con 0x7fd2d8150b90 2024-04-25T08:45:27.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.030+0000 7fd2d67fc640 1 -- 172.21.15.172:0/980784566 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0007cb0 con 0x7fd2d8150b90 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.031+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/980784566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d8150b90 msgr2=0x7fd2d8151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.031+0000 7fd2ddd9e640 1 --2- 172.21.15.172:0/980784566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d8150b90 0x7fd2d8151020 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd2d806b8e0 tx=0x7fd2d002a680 comp rx=0 tx=0).stop 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.031+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/980784566 shutdown_connections 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.031+0000 7fd2ddd9e640 1 --2- 172.21.15.172:0/980784566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d8150b90 0x7fd2d8151020 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.031+0000 7fd2ddd9e640 1 --2- 172.21.15.172:0/980784566 >> v2:172.21.15.186:3300/0 conn(0x7fd2d80cd4c0 0x7fd2d80cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.031+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/980784566 >> 172.21.15.172:0/980784566 conn(0x7fd2d806abe0 msgr2=0x7fd2d806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.031+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/980784566 shutdown_connections 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.031+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/980784566 wait complete. 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.032+0000 7fd2ddd9e640 1 Processor -- start 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.032+0000 7fd2ddd9e640 1 -- start start 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2ddd9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80cd4c0 0x7fd2d81541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2ddd9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd2d8150b90 0x7fd2d8155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2ddd9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2d815b1c0 0x7fd2d81562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2ddd9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d815e370 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2ddd9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d815a670 con 0x7fd2d815b1c0 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2ddd9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d806eca0 con 0x7fd2d8150b90 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2d77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80cd4c0 0x7fd2d81541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2d77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80cd4c0 0x7fd2d81541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47740/0 (socket says 172.21.15.172:47740) 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2d77fe640 1 -- 172.21.15.172:0/851780020 learned_addr learned my addr 172.21.15.172:0/851780020 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2d77fe640 1 -- 172.21.15.172:0/851780020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd2d8150b90 msgr2=0x7fd2d8155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2d77fe640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd2d8150b90 0x7fd2d8155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2d77fe640 1 -- 172.21.15.172:0/851780020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2d815b1c0 msgr2=0x7fd2d81562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2d77fe640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2d815b1c0 0x7fd2d81562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2d77fe640 1 -- 172.21.15.172:0/851780020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d80af670 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2d77fe640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80cd4c0 0x7fd2d81541c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c7f0 tx=0x7fd2c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2bffff640 1 -- 172.21.15.172:0/851780020 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8015070 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2bffff640 1 -- 172.21.15.172:0/851780020 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c8007a30 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2bffff640 1 -- 172.21.15.172:0/851780020 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8007e00 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.033+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/851780020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d81568d0 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.034+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/851780020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d8156e90 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.035+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/851780020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d8073a00 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.035+0000 7fd2bffff640 1 -- 172.21.15.172:0/851780020 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2c8018070 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.035+0000 7fd2bffff640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2c406b4d0 0x7fd2c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.035+0000 7fd2d6ffd640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2c406b4d0 0x7fd2c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:27.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.036+0000 7fd2bffff640 1 -- 172.21.15.172:0/851780020 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd2c808a2b0 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.036+0000 7fd2d6ffd640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2c406b4d0 0x7fd2c406d990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc007fd0 tx=0x7fd2cc007960 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:27.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.040+0000 7fd2bffff640 1 -- 172.21.15.172:0/851780020 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2c8059030 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.277+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/851780020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd2d8150970 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.279+0000 7fd2bffff640 1 -- 172.21.15.172:0/851780020 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd2c8058930 con 0x7fd2d80cd4c0 2024-04-25T08:45:27.271 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T08:45:27.271 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:45:27.271 INFO:teuthology.orchestra.run.smithi172.stdout: caps mds = "allow" 2024-04-25T08:45:27.271 INFO:teuthology.orchestra.run.smithi172.stdout: caps mon = "allow r" 2024-04-25T08:45:27.271 INFO:teuthology.orchestra.run.smithi172.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:45:27.271 INFO:teuthology.orchestra.run.smithi172.stderr:updated caps for client.0 2024-04-25T08:45:27.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/851780020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2c406b4d0 msgr2=0x7fd2c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2c406b4d0 0x7fd2c406d990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc007fd0 tx=0x7fd2cc007960 comp rx=0 tx=0).stop 2024-04-25T08:45:27.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/851780020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80cd4c0 msgr2=0x7fd2d81541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80cd4c0 0x7fd2d81541c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c7f0 tx=0x7fd2c800cbf0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/851780020 shutdown_connections 2024-04-25T08:45:27.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd2c406b4d0 0x7fd2c406d990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2d815b1c0 0x7fd2d81562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd2d8150b90 0x7fd2d8155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 --2- 172.21.15.172:0/851780020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80cd4c0 0x7fd2d81541c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/851780020 >> 172.21.15.172:0/851780020 conn(0x7fd2d806abe0 msgr2=0x7fd2d80719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:27.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/851780020 shutdown_connections 2024-04-25T08:45:27.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.281+0000 7fd2ddd9e640 1 -- 172.21.15.172:0/851780020 wait complete. 2024-04-25T08:45:27.284 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:27.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.389+0000 7f576933b640 1 Processor -- start 2024-04-25T08:45:27.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.389+0000 7f576933b640 1 -- start start 2024-04-25T08:45:27.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f576933b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f576415dbe0 0x7f57640d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f576933b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57640b92a0 0x7f57640d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f576933b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57640b97a0 con 0x7f57640b2cb0 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f576933b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576415dfc0 con 0x7f57640b92a0 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f576933b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640d1a00 con 0x7f576415dbe0 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f57637fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57640b92a0 0x7f57640d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f57637fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57640b92a0 0x7f57640d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47752/0 (socket says 172.21.15.172:47752) 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f57637fe640 1 -- 172.21.15.172:0/2587740991 learned_addr learned my addr 172.21.15.172:0/2587740991 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f57637fe640 1 -- 172.21.15.172:0/2587740991 >> v2:172.21.15.186:3300/0 conn(0x7f576415dbe0 msgr2=0x7f57640d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f57637fe640 1 --2- 172.21.15.172:0/2587740991 >> v2:172.21.15.186:3300/0 conn(0x7f576415dbe0 0x7f57640d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f57637fe640 1 -- 172.21.15.172:0/2587740991 >> v1:172.21.15.186:6789/0 conn(0x7f57640b2cb0 legacy=0x7f57640b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.390+0000 7f57637fe640 1 -- 172.21.15.172:0/2587740991 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640d1c50 con 0x7f57640b92a0 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.391+0000 7f57637fe640 1 --2- 172.21.15.172:0/2587740991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 0x7f57640d0e50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f576406c140 tx=0x7f575c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcafff8d9aa857c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.391+0000 7f5761ffb640 1 -- 172.21.15.172:0/2587740991 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c037070 con 0x7f57640b92a0 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.391+0000 7f5761ffb640 1 -- 172.21.15.172:0/2587740991 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c032440 con 0x7f57640b92a0 2024-04-25T08:45:27.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.391+0000 7f5761ffb640 1 -- 172.21.15.172:0/2587740991 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c032810 con 0x7f57640b92a0 2024-04-25T08:45:27.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.391+0000 7f576933b640 1 -- 172.21.15.172:0/2587740991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 msgr2=0x7f57640d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.391+0000 7f576933b640 1 --2- 172.21.15.172:0/2587740991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 0x7f57640d0e50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f576406c140 tx=0x7f575c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.392+0000 7f576933b640 1 -- 172.21.15.172:0/2587740991 shutdown_connections 2024-04-25T08:45:27.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.392+0000 7f576933b640 1 --2- 172.21.15.172:0/2587740991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 0x7f57640d0e50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.392+0000 7f576933b640 1 --2- 172.21.15.172:0/2587740991 >> v2:172.21.15.186:3300/0 conn(0x7f576415dbe0 0x7f57640d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.392+0000 7f576933b640 1 -- 172.21.15.172:0/2587740991 >> 172.21.15.172:0/2587740991 conn(0x7f5764061a20 msgr2=0x7f5764061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:27.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.392+0000 7f576933b640 1 -- 172.21.15.172:0/2587740991 shutdown_connections 2024-04-25T08:45:27.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.392+0000 7f576933b640 1 -- 172.21.15.172:0/2587740991 wait complete. 2024-04-25T08:45:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.393+0000 7f576933b640 1 Processor -- start 2024-04-25T08:45:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.393+0000 7f576933b640 1 -- start start 2024-04-25T08:45:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f576933b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57640b2cb0 0x7f57640c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f576933b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 0x7f57640cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f576933b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f576415dbe0 0x7f57640b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f576933b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640b6ab0 con 0x7f57640b92a0 2024-04-25T08:45:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f576933b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640d2210 con 0x7f57640b2cb0 2024-04-25T08:45:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f576933b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640b6c30 con 0x7f576415dbe0 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f57627fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 0x7f57640cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f57627fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 0x7f57640cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47760/0 (socket says 172.21.15.172:47760) 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f57627fc640 1 -- 172.21.15.172:0/4139854008 learned_addr learned my addr 172.21.15.172:0/4139854008 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f5762ffd640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57640b2cb0 0x7f57640c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f57637fe640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f576415dbe0 0x7f57640b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f57627fc640 1 -- 172.21.15.172:0/4139854008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f576415dbe0 msgr2=0x7f57640b86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f57627fc640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f576415dbe0 0x7f57640b86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f57627fc640 1 -- 172.21.15.172:0/4139854008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57640b2cb0 msgr2=0x7f57640c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f57627fc640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57640b2cb0 0x7f57640c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f57627fc640 1 -- 172.21.15.172:0/4139854008 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576415f580 con 0x7f57640b92a0 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f5762ffd640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57640b2cb0 0x7f57640c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f57627fc640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 0x7f57640cc8a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f575800c400 tx=0x7f575800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f574b7fe640 1 -- 172.21.15.172:0/4139854008 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758017070 con 0x7f57640b92a0 2024-04-25T08:45:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f574b7fe640 1 -- 172.21.15.172:0/4139854008 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57580035f0 con 0x7f57640b92a0 2024-04-25T08:45:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f576933b640 1 -- 172.21.15.172:0/4139854008 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576415f860 con 0x7f57640b92a0 2024-04-25T08:45:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f574b7fe640 1 -- 172.21.15.172:0/4139854008 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5758003a20 con 0x7f57640b92a0 2024-04-25T08:45:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.394+0000 7f576933b640 1 -- 172.21.15.172:0/4139854008 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576415fe20 con 0x7f57640b92a0 2024-04-25T08:45:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.395+0000 7f576933b640 1 -- 172.21.15.172:0/4139854008 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5764073990 con 0x7f57640b92a0 2024-04-25T08:45:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.396+0000 7f574b7fe640 1 -- 172.21.15.172:0/4139854008 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f575801a070 con 0x7f57640b92a0 2024-04-25T08:45:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.396+0000 7f574b7fe640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f575006b4d0 0x7f575006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.396+0000 7f574b7fe640 1 -- 172.21.15.172:0/4139854008 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5758089610 con 0x7f57640b92a0 2024-04-25T08:45:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.396+0000 7f5762ffd640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f575006b4d0 0x7f575006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:27.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.397+0000 7f5762ffd640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f575006b4d0 0x7f575006d990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5754009fa0 tx=0x7f5754009570 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:27.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.400+0000 7f574b7fe640 1 -- 172.21.15.172:0/4139854008 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5758057d40 con 0x7f57640b92a0 2024-04-25T08:45:27.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.608+0000 7f576933b640 1 -- 172.21.15.172:0/4139854008 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57640b28b0 con 0x7f57640b92a0 2024-04-25T08:45:27.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.608+0000 7f574b7fe640 1 -- 172.21.15.172:0/4139854008 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f575805bde0 con 0x7f57640b92a0 2024-04-25T08:45:27.600 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:27.600 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:20.588374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:27.601 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 23 2024-04-25T08:45:27.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 -- 172.21.15.172:0/4139854008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f575006b4d0 msgr2=0x7f575006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f575006b4d0 0x7f575006d990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5754009fa0 tx=0x7f5754009570 comp rx=0 tx=0).stop 2024-04-25T08:45:27.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 -- 172.21.15.172:0/4139854008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 msgr2=0x7f57640cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:27.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 0x7f57640cc8a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f575800c400 tx=0x7f575800c8c0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 -- 172.21.15.172:0/4139854008 shutdown_connections 2024-04-25T08:45:27.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f575006b4d0 0x7f575006d990 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f576415dbe0 0x7f57640b86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57640b92a0 0x7f57640cc8a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 --2- 172.21.15.172:0/4139854008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57640b2cb0 0x7f57640c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:27.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 -- 172.21.15.172:0/4139854008 >> 172.21.15.172:0/4139854008 conn(0x7f5764061a20 msgr2=0x7f576415cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:27.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 -- 172.21.15.172:0/4139854008 shutdown_connections 2024-04-25T08:45:27.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:27.610+0000 7f576933b640 1 -- 172.21.15.172:0/4139854008 wait complete. 2024-04-25T08:45:28.015 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:45:18.132665+0000', 'modified': '2024-04-25T08:45:20.588374+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5877}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5877': {'gid': 5877, 'name': 'd', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6835/3075611853', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6833', 'nonce': 3075611853}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 3075611853}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:45:28.016 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:45:28.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T08:45:28.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.124+0000 7f6b0e15c640 1 Processor -- start 2024-04-25T08:45:28.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.124+0000 7f6b0e15c640 1 -- start start 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b0e15c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6b08158230 0x7f6b080d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b0e15c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080d2020 con 0x7f6b080b4e60 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b0e15c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080d2300 con 0x7f6b080d1b80 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b0e15c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b08158610 con 0x7f6b08158230 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b077fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6b08158230 0x7f6b080d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b07fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6b080b4e60 0x7f6b0806f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49622/0 (socket says 172.21.15.172:49622) 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b07fff640 1 -- 172.21.15.172:0/4283151672 learned_addr learned my addr 172.21.15.172:0/4283151672 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b077fe640 1 -- 172.21.15.172:0/4283151672 >> v1:172.21.15.186:6789/0 conn(0x7f6b080d1b80 legacy=0x7f6b0806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b077fe640 1 -- 172.21.15.172:0/4283151672 >> v1:172.21.15.172:6789/0 conn(0x7f6b080b4e60 legacy=0x7f6b0806f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b077fe640 1 -- 172.21.15.172:0/4283151672 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0806bb30 con 0x7f6b08158230 2024-04-25T08:45:28.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.125+0000 7f6b06ffd640 1 -- 172.21.15.172:0/4283151672 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913601402 0 0) 0x7f6b080d2020 con 0x7f6b080b4e60 2024-04-25T08:45:28.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.126+0000 7f6b077fe640 1 --2- 172.21.15.172:0/4283151672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b08158230 0x7f6b080d1640 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6af80097a0 tx=0x7f6af802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d924a75c885cfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:28.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.126+0000 7f6b06ffd640 1 -- 172.21.15.172:0/4283151672 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8037070 con 0x7f6b08158230 2024-04-25T08:45:28.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.126+0000 7f6b06ffd640 1 -- 172.21.15.172:0/4283151672 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8032440 con 0x7f6b08158230 2024-04-25T08:45:28.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.126+0000 7f6b06ffd640 1 -- 172.21.15.172:0/4283151672 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8032810 con 0x7f6b08158230 2024-04-25T08:45:28.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.126+0000 7f6b0e15c640 1 -- 172.21.15.172:0/4283151672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b08158230 msgr2=0x7f6b080d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.126+0000 7f6b0e15c640 1 --2- 172.21.15.172:0/4283151672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b08158230 0x7f6b080d1640 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6af80097a0 tx=0x7f6af802a230 comp rx=0 tx=0).stop 2024-04-25T08:45:28.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.126+0000 7f6b0e15c640 1 -- 172.21.15.172:0/4283151672 shutdown_connections 2024-04-25T08:45:28.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.126+0000 7f6b0e15c640 1 --2- 172.21.15.172:0/4283151672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b08158230 0x7f6b080d1640 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.126+0000 7f6b0e15c640 1 -- 172.21.15.172:0/4283151672 >> 172.21.15.172:0/4283151672 conn(0x7f6b08061600 msgr2=0x7f6b080619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:28.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.127+0000 7f6b0e15c640 1 -- 172.21.15.172:0/4283151672 shutdown_connections 2024-04-25T08:45:28.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.127+0000 7f6b0e15c640 1 -- 172.21.15.172:0/4283151672 wait complete. 2024-04-25T08:45:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6b0e15c640 1 Processor -- start 2024-04-25T08:45:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6b0e15c640 1 -- start start 2024-04-25T08:45:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6b0e15c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b080b4e60 0x7f6b08149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6b0e15c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b080d1b80 0x7f6b080caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6b0e15c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b08158230 0x7f6b081e8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6b0e15c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0806ca40 con 0x7f6b080d1b80 2024-04-25T08:45:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6b0e15c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0806bea0 con 0x7f6b080b4e60 2024-04-25T08:45:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6b0e15c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0815e320 con 0x7f6b08158230 2024-04-25T08:45:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6afffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b080d1b80 0x7f6b080caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6afffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b080d1b80 0x7f6b080caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34108/0 (socket says 172.21.15.172:34108) 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.128+0000 7f6afffff640 1 -- 172.21.15.172:0/2285977903 learned_addr learned my addr 172.21.15.172:0/2285977903 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6b077fe640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b080b4e60 0x7f6b08149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6b07fff640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b08158230 0x7f6b081e8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6afffff640 1 -- 172.21.15.172:0/2285977903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b08158230 msgr2=0x7f6b081e8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6afffff640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b08158230 0x7f6b081e8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6afffff640 1 -- 172.21.15.172:0/2285977903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b080b4e60 msgr2=0x7f6b08149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6afffff640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b080b4e60 0x7f6b08149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6afffff640 1 -- 172.21.15.172:0/2285977903 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b08149680 con 0x7f6b080d1b80 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6b077fe640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b080b4e60 0x7f6b08149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6afffff640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b080d1b80 0x7f6b080caa60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6af000c340 tx=0x7f6af000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6b04ff9640 1 -- 172.21.15.172:0/2285977903 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0017070 con 0x7f6b080d1b80 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6b04ff9640 1 -- 172.21.15.172:0/2285977903 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af00052d0 con 0x7f6b080d1b80 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6b04ff9640 1 -- 172.21.15.172:0/2285977903 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0005500 con 0x7f6b080d1b80 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6b0e15c640 1 -- 172.21.15.172:0/2285977903 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b080cb2b0 con 0x7f6b080d1b80 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.129+0000 7f6b0e15c640 1 -- 172.21.15.172:0/2285977903 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b080cb870 con 0x7f6b080d1b80 2024-04-25T08:45:28.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.130+0000 7f6b04ff9640 1 -- 172.21.15.172:0/2285977903 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6af001a070 con 0x7f6b080d1b80 2024-04-25T08:45:28.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.131+0000 7f6b04ff9640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ae806b4d0 0x7f6ae806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.131+0000 7f6b04ff9640 1 -- 172.21.15.172:0/2285977903 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6af00896e0 con 0x7f6b080d1b80 2024-04-25T08:45:28.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.131+0000 7f6b077fe640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ae806b4d0 0x7f6ae806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.131+0000 7f6b077fe640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ae806b4d0 0x7f6ae806d990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6af8034000 tx=0x7f6af802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:28.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.132+0000 7f6b10e66740 1 Processor -- start 2024-04-25T08:45:28.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.132+0000 7f6b10e66740 1 -- start start 2024-04-25T08:45:28.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9d8a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9d5ff10 0x5653f9da6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6b10e66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f9cc2a10 con 0x5653f9da7ad0 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6b10e66740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f9c6bb30 con 0x5653f9d5ff10 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6b10e66740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653f9cbec50 con 0x5653f9d8a230 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6afffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6afffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34118/0 (socket says 172.21.15.172:34118) 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6afffff640 1 -- 172.21.15.172:0/1983186875 learned_addr learned my addr 172.21.15.172:0/1983186875 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6b07fff640 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9d5ff10 0x5653f9da6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6b077fe640 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9d8a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6afffff640 1 -- 172.21.15.172:0/1983186875 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 msgr2=0x5653f9d8a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6afffff640 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9d8a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6afffff640 1 -- 172.21.15.172:0/1983186875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9d5ff10 msgr2=0x5653f9da6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6afffff640 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9d5ff10 0x5653f9da6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6afffff640 1 -- 172.21.15.172:0/1983186875 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653f9c80e10 con 0x5653f9da7ad0 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6b07fff640 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9d5ff10 0x5653f9da6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6b077fe640 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9d8a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.133+0000 7f6afffff640 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da8020 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6af005feb0 tx=0x7f6af0057e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d760c63a476ca9d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6afd7fa640 1 -- 172.21.15.172:0/1983186875 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0055fd0 con 0x5653f9da7ad0 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6afd7fa640 1 -- 172.21.15.172:0/1983186875 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af0054340 con 0x5653f9da7ad0 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6afd7fa640 1 -- 172.21.15.172:0/1983186875 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af0057320 con 0x5653f9da7ad0 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6b10e66740 1 -- 172.21.15.172:0/1983186875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 msgr2=0x5653f9da8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6b10e66740 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da8020 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6af005feb0 tx=0x7f6af0057e10 comp rx=0 tx=0).stop 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6b10e66740 1 -- 172.21.15.172:0/1983186875 shutdown_connections 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6b10e66740 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9d5ff10 0x5653f9da6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6b10e66740 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da8020 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6b10e66740 1 --2- 172.21.15.172:0/1983186875 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9d8a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6b10e66740 1 -- 172.21.15.172:0/1983186875 >> 172.21.15.172:0/1983186875 conn(0x5653f9d5c840 msgr2=0x5653f9da5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6b10e66740 1 -- 172.21.15.172:0/1983186875 shutdown_connections 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.134+0000 7f6b10e66740 1 -- 172.21.15.172:0/1983186875 wait complete. 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.135+0000 7f6b10e66740 1 -- start start 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.135+0000 7f6b10e66740 1 Processor -- start 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9d78a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9da7ad0 0x5653f9d8d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d8c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b10e66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f9d60cb0 con 0x5653f9db5b90 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b10e66740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f9c7f0c0 con 0x5653f9da7ad0 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b10e66740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653f9d5a770 con 0x5653f9d8a230 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b10e66740 10 client.0 _ll_register_callbacks cb 0x5653f9c72ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b07fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d8c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b07fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d8c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34128/0 (socket says 172.21.15.172:34128) 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b07fff640 1 -- 172.21.15.172:0/2364986956 learned_addr learned my addr 172.21.15.172:0/2364986956 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:28.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b077fe640 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9d78a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6afffff640 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9da7ad0 0x5653f9d8d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b07fff640 1 -- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 msgr2=0x5653f9d78a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b07fff640 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9d78a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b07fff640 1 -- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9da7ad0 msgr2=0x5653f9d8d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b07fff640 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9da7ad0 0x5653f9d8d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b07fff640 1 -- 172.21.15.172:0/2364986956 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653f99d72d0 con 0x5653f9db5b90 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6afffff640 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9da7ad0 0x5653f9d8d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b07fff640 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d8c910 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000e520 tx=0x7f6b0000e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf272768ea86b28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6ae67fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6ae67fc640 1 -- 172.21.15.172:0/2364986956 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00019060 con 0x5653f9db5b90 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6ae67fc640 1 -- 172.21.15.172:0/2364986956 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6b00014c80 con 0x5653f9db5b90 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6b10e66740 1 -- 172.21.15.172:0/2364986956 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6af0054340 con 0x5653f9db5b90 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.136+0000 7f6ae67fc640 1 -- 172.21.15.172:0/2364986956 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b000070d0 con 0x5653f9db5b90 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6b10e66740 10 client.6051 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:28.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6b10e66740 1 -- 172.21.15.172:0/2364986956 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5653f9aa16b0 con 0x5653f9db5b90 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6ae67fc640 1 -- 172.21.15.172:0/2364986956 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af0054340 con 0x5653f9db5b90 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6ae67fc640 1 -- 172.21.15.172:0/2364986956 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6b00007270 con 0x5653f9db5b90 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6b10e66740 10 client.6051 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6b10e66740 10 client.6051 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6b10e66740 20 client.6051 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6b10e66740 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5653f9db6190 0x5653f9dc3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6b10e66740 4 client.6051 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6b10e66740 1 -- 172.21.15.172:0/2364986956 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653f9d21920 con 0x5653f9db6190 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6b077fe640 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5653f9db6190 0x5653f9dc3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6ae67fc640 10 client.6051 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.137+0000 7f6b077fe640 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5653f9db6190 0x5653f9dc3810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4b952d372f6e1cb server_cookie=171a64d7af3c07ca in_seq=0 out_seq=0 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6ae67fc640 1 -- 172.21.15.172:0/2364986956 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5653f9d21920 con 0x5653f9db6190 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6ae67fc640 10 client.6051 handle_command_reply: tid=0 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 client.6051 shutdown 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 -- 172.21.15.172:0/2364986956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 msgr2=0x5653f9d8c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d8c910 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000e520 tx=0x7f6b0000e9e0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 -- 172.21.15.172:0/2364986956 shutdown_connections 2024-04-25T08:45:28.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9da7ad0 0x5653f9d8d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5653f9db6190 0x5653f9dc3810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d8c910 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6ae67fc640 0 client.6051 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:28.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 --2- 172.21.15.172:0/2364986956 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9d78a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 -- 172.21.15.172:0/2364986956 >> 172.21.15.172:0/2364986956 conn(0x5653f9d5ff10 msgr2=0x5653f9da85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:28.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 -- 172.21.15.172:0/2364986956 shutdown_connections 2024-04-25T08:45:28.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 1 -- 172.21.15.172:0/2364986956 wait complete. 2024-04-25T08:45:28.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.138+0000 7f6b10e66740 20 client.6051 trim_cache size 0 max 16384 2024-04-25T08:45:28.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.154+0000 7f6b10e66740 1 Processor -- start 2024-04-25T08:45:28.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.154+0000 7f6b10e66740 1 -- start start 2024-04-25T08:45:28.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9da5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9da7ad0 0x5653f9da84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d81af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b10e66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081ff670 con 0x5653f9db5b90 2024-04-25T08:45:28.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b10e66740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081f45a0 con 0x5653f9da7ad0 2024-04-25T08:45:28.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b10e66740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081f4ba0 con 0x5653f9d8a230 2024-04-25T08:45:28.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b07fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d81af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b07fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d81af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34142/0 (socket says 172.21.15.172:34142) 2024-04-25T08:45:28.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b07fff640 1 -- 172.21.15.172:0/1299644401 learned_addr learned my addr 172.21.15.172:0/1299644401 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:28.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b07fff640 1 -- 172.21.15.172:0/1299644401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 msgr2=0x5653f9da5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:28.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b07fff640 1 --2- 172.21.15.172:0/1299644401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9da5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b07fff640 1 -- 172.21.15.172:0/1299644401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9da7ad0 msgr2=0x5653f9da84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:28.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b07fff640 1 --2- 172.21.15.172:0/1299644401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9da7ad0 0x5653f9da84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b07fff640 1 -- 172.21.15.172:0/1299644401 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653f9da69a0 con 0x5653f9db5b90 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.155+0000 7f6b07fff640 1 --2- 172.21.15.172:0/1299644401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d81af0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000ea20 tx=0x7f6b0000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d87a191f0e4d755 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6afcff9640 1 -- 172.21.15.172:0/1299644401 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0002c070 con 0x5653f9db5b90 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6afcff9640 1 -- 172.21.15.172:0/1299644401 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000077c0 con 0x5653f9db5b90 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6afcff9640 1 -- 172.21.15.172:0/1299644401 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00013440 con 0x5653f9db5b90 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6b10e66740 1 -- 172.21.15.172:0/1299644401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 msgr2=0x5653f9d81af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6b10e66740 1 --2- 172.21.15.172:0/1299644401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d81af0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000ea20 tx=0x7f6b0000ef90 comp rx=0 tx=0).stop 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6b10e66740 1 -- 172.21.15.172:0/1299644401 shutdown_connections 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6b10e66740 1 --2- 172.21.15.172:0/1299644401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9da7ad0 0x5653f9da84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6b10e66740 1 --2- 172.21.15.172:0/1299644401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9db5b90 0x5653f9d81af0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6b10e66740 1 --2- 172.21.15.172:0/1299644401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9da5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6b10e66740 1 -- 172.21.15.172:0/1299644401 >> 172.21.15.172:0/1299644401 conn(0x5653f9d5ff10 msgr2=0x5653f9d8f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6b10e66740 1 -- 172.21.15.172:0/1299644401 shutdown_connections 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.156+0000 7f6b10e66740 1 -- 172.21.15.172:0/1299644401 wait complete. 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.157+0000 7f6b10e66740 1 -- start start 2024-04-25T08:45:28.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.157+0000 7f6b10e66740 1 Processor -- start 2024-04-25T08:45:28.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9e103f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b10e66740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9db5b90 0x5653f9da5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b10e66740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f9db6010 con 0x5653f9da7ad0 2024-04-25T08:45:28.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b10e66740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f9d8c3f0 con 0x5653f9db5b90 2024-04-25T08:45:28.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b10e66740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653f9d8d060 con 0x5653f9d8a230 2024-04-25T08:45:28.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b10e66740 10 client.0 _ll_register_callbacks cb 0x5653f9d5ac50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:28.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6afffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6afffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34148/0 (socket says 172.21.15.172:34148) 2024-04-25T08:45:28.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6afffff640 1 -- 172.21.15.172:0/3818443796 learned_addr learned my addr 172.21.15.172:0/3818443796 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b077fe640 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9e103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b07fff640 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9db5b90 0x5653f9da5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6afffff640 1 -- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 msgr2=0x5653f9e103f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6afffff640 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9e103f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6afffff640 1 -- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9db5b90 msgr2=0x5653f9da5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6afffff640 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9db5b90 0x5653f9da5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6afffff640 1 -- 172.21.15.172:0/3818443796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653f9e10930 con 0x5653f9da7ad0 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6afffff640 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da57b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6af0087ad0 tx=0x7f6af0087950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5700d7a514992489 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6ae67fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6ae67fc640 1 -- 172.21.15.172:0/3818443796 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af00583d0 con 0x5653f9da7ad0 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6ae67fc640 1 -- 172.21.15.172:0/3818443796 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6af0057120 con 0x5653f9da7ad0 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b10e66740 1 -- 172.21.15.172:0/3818443796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b000077c0 con 0x5653f9da7ad0 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6ae67fc640 1 -- 172.21.15.172:0/3818443796 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6af0057320 con 0x5653f9da7ad0 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b10e66740 10 client.6057 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:28.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.158+0000 7f6b10e66740 1 -- 172.21.15.172:0/3818443796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5653f9d8e3f0 con 0x5653f9da7ad0 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6ae67fc640 1 -- 172.21.15.172:0/3818443796 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b000077c0 con 0x5653f9da7ad0 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6ae67fc640 1 -- 172.21.15.172:0/3818443796 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6af0076ba0 con 0x5653f9da7ad0 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6b10e66740 10 client.6057 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6b10e66740 10 client.6057 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6b10e66740 20 client.6057 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6b10e66740 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5653f9d86170 0x5653f9d86550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6b10e66740 4 client.6057 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6b10e66740 1 -- 172.21.15.172:0/3818443796 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5653f9ccff50 con 0x5653f9d86170 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6b077fe640 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5653f9d86170 0x5653f9d86550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6ae67fc640 10 client.6057 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6b077fe640 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5653f9d86170 0x5653f9d86550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a943e02da958d077 server_cookie=69596412b20e1927 in_seq=0 out_seq=0 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6ae67fc640 1 -- 172.21.15.172:0/3818443796 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5653f9ccff50 con 0x5653f9d86170 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6ae67fc640 10 client.6057 handle_command_reply: tid=0 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.159+0000 7f6b10e66740 1 client.6057 shutdown 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 1 -- 172.21.15.172:0/3818443796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 msgr2=0x5653f9da57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da57b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6af0087ad0 tx=0x7f6af0087950 comp rx=0 tx=0).stop 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 1 -- 172.21.15.172:0/3818443796 shutdown_connections 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5653f9db5b90 0x5653f9da5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5653f9d86170 0x5653f9d86550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5653f9da7ad0 0x5653f9da57b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6ae67fc640 0 client.6057 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 1 --2- 172.21.15.172:0/3818443796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5653f9d8a230 0x5653f9e103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 1 -- 172.21.15.172:0/3818443796 >> 172.21.15.172:0/3818443796 conn(0x5653f9d5ff10 msgr2=0x5653f9da8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 1 -- 172.21.15.172:0/3818443796 shutdown_connections 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 1 -- 172.21.15.172:0/3818443796 wait complete. 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b10e66740 20 client.6057 trim_cache size 0 max 16384 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:28.158 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 5877, 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 9.3497549580000001, 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 23, 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 54, 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 54, 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 14.433479574 2024-04-25T08:45:28.159 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:28.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 -- 172.21.15.172:0/2285977903 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ae806b4d0 msgr2=0x7f6ae806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ae806b4d0 0x7f6ae806d990 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6af8034000 tx=0x7f6af802e000 comp rx=0 tx=0).stop 2024-04-25T08:45:28.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 -- 172.21.15.172:0/2285977903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b080d1b80 msgr2=0x7f6b080caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b080d1b80 0x7f6b080caa60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6af000c340 tx=0x7f6af000c800 comp rx=0 tx=0).stop 2024-04-25T08:45:28.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 -- 172.21.15.172:0/2285977903 shutdown_connections 2024-04-25T08:45:28.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ae806b4d0 0x7f6ae806d990 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b08158230 0x7f6b081e8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b080d1b80 0x7f6b080caa60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 --2- 172.21.15.172:0/2285977903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b080b4e60 0x7f6b08149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 -- 172.21.15.172:0/2285977903 >> 172.21.15.172:0/2285977903 conn(0x7f6b08061600 msgr2=0x7f6b080b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:28.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 -- 172.21.15.172:0/2285977903 shutdown_connections 2024-04-25T08:45:28.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.160+0000 7f6b0e15c640 1 -- 172.21.15.172:0/2285977903 wait complete. 2024-04-25T08:45:28.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:45:28.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.267+0000 7f326459d640 1 Processor -- start 2024-04-25T08:45:28.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.267+0000 7f326459d640 1 -- start start 2024-04-25T08:45:28.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.268+0000 7f326459d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f325c06c1d0 0x7f325c168930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.268+0000 7f326459d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325c0adcf0 con 0x7f325c154ed0 2024-04-25T08:45:28.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.268+0000 7f326459d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325c15ec60 con 0x7f325c071ac0 2024-04-25T08:45:28.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.268+0000 7f326459d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325c15ef40 con 0x7f325c06c1d0 2024-04-25T08:45:28.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.268+0000 7f3262b3a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f325c06c1d0 0x7f325c168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.268+0000 7f3262339640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f325c154ed0 0x7f325c0aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49634/0 (socket says 172.21.15.172:49634) 2024-04-25T08:45:28.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.268+0000 7f3262339640 1 -- 172.21.15.172:0/2349486899 learned_addr learned my addr 172.21.15.172:0/2349486899 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:28.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.269+0000 7f3262b3a640 1 -- 172.21.15.172:0/2349486899 >> v1:172.21.15.186:6789/0 conn(0x7f325c071ac0 legacy=0x7f325c0ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:28.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.269+0000 7f3262b3a640 1 -- 172.21.15.172:0/2349486899 >> v1:172.21.15.172:6789/0 conn(0x7f325c154ed0 legacy=0x7f325c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.269+0000 7f3261337640 1 -- 172.21.15.172:0/2349486899 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984203902 0 0) 0x7f325c0adcf0 con 0x7f325c154ed0 2024-04-25T08:45:28.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.269+0000 7f3262b3a640 1 -- 172.21.15.172:0/2349486899 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c06db90 con 0x7f325c06c1d0 2024-04-25T08:45:28.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.269+0000 7f3262b3a640 1 --2- 172.21.15.172:0/2349486899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c06c1d0 0x7f325c168930 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f32540097a0 tx=0x7f325402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e596ecf29b49bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:28.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.270+0000 7f3261337640 1 -- 172.21.15.172:0/2349486899 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254037070 con 0x7f325c06c1d0 2024-04-25T08:45:28.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.270+0000 7f3261337640 1 -- 172.21.15.172:0/2349486899 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325402ae50 con 0x7f325c06c1d0 2024-04-25T08:45:28.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.270+0000 7f3261337640 1 -- 172.21.15.172:0/2349486899 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254032660 con 0x7f325c06c1d0 2024-04-25T08:45:28.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.270+0000 7f326459d640 1 -- 172.21.15.172:0/2349486899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c06c1d0 msgr2=0x7f325c168930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.270+0000 7f326459d640 1 --2- 172.21.15.172:0/2349486899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c06c1d0 0x7f325c168930 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f32540097a0 tx=0x7f325402a140 comp rx=0 tx=0).stop 2024-04-25T08:45:28.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.270+0000 7f326459d640 1 -- 172.21.15.172:0/2349486899 shutdown_connections 2024-04-25T08:45:28.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.270+0000 7f326459d640 1 --2- 172.21.15.172:0/2349486899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c06c1d0 0x7f325c168930 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.270+0000 7f326459d640 1 -- 172.21.15.172:0/2349486899 >> 172.21.15.172:0/2349486899 conn(0x7f325c0af670 msgr2=0x7f325c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:28.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.270+0000 7f326459d640 1 -- 172.21.15.172:0/2349486899 shutdown_connections 2024-04-25T08:45:28.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.270+0000 7f326459d640 1 -- 172.21.15.172:0/2349486899 wait complete. 2024-04-25T08:45:28.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.271+0000 7f326459d640 1 Processor -- start 2024-04-25T08:45:28.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.271+0000 7f326459d640 1 -- start start 2024-04-25T08:45:28.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.272+0000 7f326459d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f325c071ac0 0x7f325c0b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.272+0000 7f326459d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c154ed0 0x7f325c1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.272+0000 7f326459d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f325c157cd0 0x7f325c1331b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.272+0000 7f326459d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c168ff0 con 0x7f325c154ed0 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.272+0000 7f326459d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c168e70 con 0x7f325c071ac0 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.272+0000 7f326459d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c169170 con 0x7f325c157cd0 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.272+0000 7f3261b38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c154ed0 0x7f325c1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.272+0000 7f3261b38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c154ed0 0x7f325c1491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34176/0 (socket says 172.21.15.172:34176) 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.272+0000 7f3261b38640 1 -- 172.21.15.172:0/2148011823 learned_addr learned my addr 172.21.15.172:0/2148011823 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.272+0000 7f3262339640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f325c071ac0 0x7f325c0b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3262b3a640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f325c157cd0 0x7f325c1331b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3261b38640 1 -- 172.21.15.172:0/2148011823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f325c157cd0 msgr2=0x7f325c1331b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3261b38640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f325c157cd0 0x7f325c1331b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3261b38640 1 -- 172.21.15.172:0/2148011823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f325c071ac0 msgr2=0x7f325c0b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3261b38640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f325c071ac0 0x7f325c0b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3261b38640 1 -- 172.21.15.172:0/2148011823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c0b1b50 con 0x7f325c154ed0 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3262339640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f325c071ac0 0x7f325c0b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3261b38640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c154ed0 0x7f325c1491d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c400 tx=0x7f324c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3252ffd640 1 -- 172.21.15.172:0/2148011823 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c011790 con 0x7f325c154ed0 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3252ffd640 1 -- 172.21.15.172:0/2148011823 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c017070 con 0x7f325c154ed0 2024-04-25T08:45:28.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f326459d640 1 -- 172.21.15.172:0/2148011823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325c0cdd50 con 0x7f325c154ed0 2024-04-25T08:45:28.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f3252ffd640 1 -- 172.21.15.172:0/2148011823 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c011bb0 con 0x7f325c154ed0 2024-04-25T08:45:28.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.273+0000 7f326459d640 1 -- 172.21.15.172:0/2148011823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c0ce310 con 0x7f325c154ed0 2024-04-25T08:45:28.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.274+0000 7f326459d640 1 -- 172.21.15.172:0/2148011823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c0b2b10 con 0x7f325c154ed0 2024-04-25T08:45:28.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.275+0000 7f3252ffd640 1 -- 172.21.15.172:0/2148011823 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f324c01c460 con 0x7f325c154ed0 2024-04-25T08:45:28.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.275+0000 7f3252ffd640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f324006b4d0 0x7f324006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:28.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.275+0000 7f3252ffd640 1 -- 172.21.15.172:0/2148011823 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f324c08a150 con 0x7f325c154ed0 2024-04-25T08:45:28.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.275+0000 7f3262339640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f324006b4d0 0x7f324006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:28.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.275+0000 7f3262339640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f324006b4d0 0x7f324006d990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f32580012e0 tx=0x7f3258005b90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:28.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.279+0000 7f3252ffd640 1 -- 172.21.15.172:0/2148011823 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f324c058ed0 con 0x7f325c154ed0 2024-04-25T08:45:28.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.485+0000 7f326459d640 1 -- 172.21.15.172:0/2148011823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f325c073990 con 0x7f325c154ed0 2024-04-25T08:45:28.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.486+0000 7f3252ffd640 1 -- 172.21.15.172:0/2148011823 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f324c0587d0 con 0x7f325c154ed0 2024-04-25T08:45:28.477 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:45:28.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.487+0000 7f326459d640 1 -- 172.21.15.172:0/2148011823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f324006b4d0 msgr2=0x7f324006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.487+0000 7f326459d640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f324006b4d0 0x7f324006d990 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f32580012e0 tx=0x7f3258005b90 comp rx=0 tx=0).stop 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.487+0000 7f326459d640 1 -- 172.21.15.172:0/2148011823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c154ed0 msgr2=0x7f325c1491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.487+0000 7f326459d640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c154ed0 0x7f325c1491d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c400 tx=0x7f324c00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.487+0000 7f326459d640 1 -- 172.21.15.172:0/2148011823 shutdown_connections 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.487+0000 7f326459d640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f324006b4d0 0x7f324006d990 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.487+0000 7f326459d640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f325c157cd0 0x7f325c1331b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.487+0000 7f326459d640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325c154ed0 0x7f325c1491d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.487+0000 7f326459d640 1 --2- 172.21.15.172:0/2148011823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f325c071ac0 0x7f325c0b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.488+0000 7f326459d640 1 -- 172.21.15.172:0/2148011823 >> 172.21.15.172:0/2148011823 conn(0x7f325c06c1d0 msgr2=0x7f325c14b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.488+0000 7f326459d640 1 -- 172.21.15.172:0/2148011823 shutdown_connections 2024-04-25T08:45:28.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:28.488+0000 7f326459d640 1 -- 172.21.15.172:0/2148011823 wait complete. 2024-04-25T08:45:28.490 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:45:28.490 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:45:28.490 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:45:28.490 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:45:28.490 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:45:28.490 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:45:28.491 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:45:28.491 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:45:28.491 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:45:28.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:28.491 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:45:28.506 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:45:28.506 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:45:28.506 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:45:28.506 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:45:28.506 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42590sec preferred_lft 42590sec 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:45:28.507 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether de:e6:d5:6e:7d:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::dce6:d5ff:fe6e:7d91/64 scope link 2024-04-25T08:45:28.508 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:45:28.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:28.509 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:45:28.568 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:45:28.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:28.570 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:45:28.626 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:45:28.626 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:45:28.626 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:45:28.626 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:45:28.626 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:45:28.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:28.626 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:45:28.627 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:45:28.627 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:45:28.627 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:45:28.627 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:45:28.627 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:45:28.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:28.710 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:45:28.765 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:45:28.765 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:45:28.765 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:45:28.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:28.765 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:45:28.829 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:45:28.829 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:45:28.883 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:45:28.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:45:28.883 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:45:28.938 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:45:28.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:28.938 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:45:29.019 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:45:29.019 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:45:29.019 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:45:29.028 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:45:29.028 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:45:29.028 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:45:29.028 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:45:29.028 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:45:29.040 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:45:29.040 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:45:29.040 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:45:29.040 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:45:29.040 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:45:29.040 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:45:29.040 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:45:29.040 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:45:29.041 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:45:29.041 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:45:29.041 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:45:29.041 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:45:29.041 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:45:29.042 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:45:29.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:29.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:45:29.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:29.107 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:45:29.170 INFO:teuthology.orchestra.run.smithi172.stdout:client5458 2024-04-25T08:45:29.170 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:29.170 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:29.225 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-04-25T08:45:29.225 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-04-25T08:45:29.225 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-04-25T08:45:29.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:29.226 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-04-25T08:45:29.286 DEBUG:teuthology.orchestra.run.smithi172:> stdin-killer -- python3 -c ' 2024-04-25T08:45:29.286 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-04-25T08:45:29.286 DEBUG:teuthology.orchestra.run.smithi172:> import stat 2024-04-25T08:45:29.286 DEBUG:teuthology.orchestra.run.smithi172:> import json 2024-04-25T08:45:29.286 DEBUG:teuthology.orchestra.run.smithi172:> import sys 2024-04-25T08:45:29.286 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:45:29.286 DEBUG:teuthology.orchestra.run.smithi172:> try: 2024-04-25T08:45:29.287 DEBUG:teuthology.orchestra.run.smithi172:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-04-25T08:45:29.287 DEBUG:teuthology.orchestra.run.smithi172:> except OSError as e: 2024-04-25T08:45:29.287 DEBUG:teuthology.orchestra.run.smithi172:> sys.exit(e.errno) 2024-04-25T08:45:29.287 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:45:29.287 DEBUG:teuthology.orchestra.run.smithi172:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T08:45:29.287 DEBUG:teuthology.orchestra.run.smithi172:> print(json.dumps( 2024-04-25T08:45:29.287 DEBUG:teuthology.orchestra.run.smithi172:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T08:45:29.287 DEBUG:teuthology.orchestra.run.smithi172:> indent=2)) 2024-04-25T08:45:29.287 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-04-25T08:45:29.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:29 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-25T08:45:29.401 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-25T08:45:29.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:29.401 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-04-25T08:45:29.459 INFO:teuthology.orchestra.run.smithi172.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-04-25T08:45:29.614 INFO:teuthology.orchestra.run.smithi172.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-04-25T08:45:29.742 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:45:29.745 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:45:32.235 INFO:teuthology.orchestra.run.smithi172.stderr:Updating files: 54% (760/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-04-25T08:45:32.239 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-04-25T08:45:32.239 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-04-25T08:45:32.240 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:32.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.346+0000 7fd7305f5640 1 Processor -- start 2024-04-25T08:45:32.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.346+0000 7fd7305f5640 1 -- start start 2024-04-25T08:45:32.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd7305f5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd728154ed0 0x7fd7280aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd7305f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd728071ac0 0x7fd7280ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd7305f5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd72806c1d0 0x7fd7280ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd7305f5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72815ec60 con 0x7fd72806c1d0 2024-04-25T08:45:32.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd7305f5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72815ef40 con 0x7fd728154ed0 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd7305f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72806db90 con 0x7fd728071ac0 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd72eb92640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd72806c1d0 0x7fd7280ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd72eb92640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd72806c1d0 0x7fd7280ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34178/0 (socket says 172.21.15.172:34178) 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd72eb92640 1 -- 172.21.15.172:0/678583361 learned_addr learned my addr 172.21.15.172:0/678583361 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd72db90640 1 --2- 172.21.15.172:0/678583361 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd728071ac0 0x7fd7280ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd72e391640 1 --2- 172.21.15.172:0/678583361 >> v2:172.21.15.186:3300/0 conn(0x7fd728154ed0 0x7fd7280aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd72eb92640 1 -- 172.21.15.172:0/678583361 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd728071ac0 msgr2=0x7fd7280ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd72eb92640 1 --2- 172.21.15.172:0/678583361 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd728071ac0 0x7fd7280ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd72eb92640 1 -- 172.21.15.172:0/678583361 >> v2:172.21.15.186:3300/0 conn(0x7fd728154ed0 msgr2=0x7fd7280aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd72eb92640 1 --2- 172.21.15.172:0/678583361 >> v2:172.21.15.186:3300/0 conn(0x7fd728154ed0 0x7fd7280aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.347+0000 7fd72eb92640 1 -- 172.21.15.172:0/678583361 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72806de70 con 0x7fd72806c1d0 2024-04-25T08:45:32.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.348+0000 7fd72eb92640 1 --2- 172.21.15.172:0/678583361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72806c1d0 0x7fd7280ad950 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd7280d0ec0 tx=0x7fd72002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230c9f891749dfda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.348+0000 7fd72d38f640 1 -- 172.21.15.172:0/678583361 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720036070 con 0x7fd72806c1d0 2024-04-25T08:45:32.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.348+0000 7fd72d38f640 1 -- 172.21.15.172:0/678583361 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd720031600 con 0x7fd72806c1d0 2024-04-25T08:45:32.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.348+0000 7fd72d38f640 1 -- 172.21.15.172:0/678583361 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7200319d0 con 0x7fd72806c1d0 2024-04-25T08:45:32.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.349+0000 7fd7305f5640 1 -- 172.21.15.172:0/678583361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72806c1d0 msgr2=0x7fd7280ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.349+0000 7fd7305f5640 1 --2- 172.21.15.172:0/678583361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72806c1d0 0x7fd7280ad950 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd7280d0ec0 tx=0x7fd72002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.349+0000 7fd7305f5640 1 -- 172.21.15.172:0/678583361 shutdown_connections 2024-04-25T08:45:32.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.349+0000 7fd7305f5640 1 --2- 172.21.15.172:0/678583361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72806c1d0 0x7fd7280ad950 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.349+0000 7fd7305f5640 1 --2- 172.21.15.172:0/678583361 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd728071ac0 0x7fd7280ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.349+0000 7fd7305f5640 1 --2- 172.21.15.172:0/678583361 >> v2:172.21.15.186:3300/0 conn(0x7fd728154ed0 0x7fd7280aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.349+0000 7fd7305f5640 1 -- 172.21.15.172:0/678583361 >> 172.21.15.172:0/678583361 conn(0x7fd7280af670 msgr2=0x7fd7280b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:32.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.349+0000 7fd7305f5640 1 -- 172.21.15.172:0/678583361 shutdown_connections 2024-04-25T08:45:32.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.349+0000 7fd7305f5640 1 -- 172.21.15.172:0/678583361 wait complete. 2024-04-25T08:45:32.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.350+0000 7fd7305f5640 1 Processor -- start 2024-04-25T08:45:32.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.350+0000 7fd7305f5640 1 -- start start 2024-04-25T08:45:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd7305f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd728071ac0 0x7fd728156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd7305f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd728154ed0 0x7fd7280b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd7305f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280b1340 0x7fd7280b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd7305f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd728161ba0 con 0x7fd728154ed0 2024-04-25T08:45:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd7305f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd728161a20 con 0x7fd728071ac0 2024-04-25T08:45:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd7305f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd728161d20 con 0x7fd7280b1340 2024-04-25T08:45:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72db90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd728154ed0 0x7fd7280b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72db90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd728154ed0 0x7fd7280b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34190/0 (socket says 172.21.15.172:34190) 2024-04-25T08:45:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72db90640 1 -- 172.21.15.172:0/792396176 learned_addr learned my addr 172.21.15.172:0/792396176 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72e391640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd728071ac0 0x7fd728156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72eb92640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280b1340 0x7fd7280b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72db90640 1 -- 172.21.15.172:0/792396176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280b1340 msgr2=0x7fd7280b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72db90640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280b1340 0x7fd7280b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72db90640 1 -- 172.21.15.172:0/792396176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd728071ac0 msgr2=0x7fd728156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72db90640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd728071ac0 0x7fd728156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72db90640 1 -- 172.21.15.172:0/792396176 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd728155970 con 0x7fd728154ed0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd72db90640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd728154ed0 0x7fd7280b4ce0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd71800e860 tx=0x7fd71800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd71effd640 1 -- 172.21.15.172:0/792396176 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718017070 con 0x7fd728154ed0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd71effd640 1 -- 172.21.15.172:0/792396176 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71800c940 con 0x7fd728154ed0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.351+0000 7fd7305f5640 1 -- 172.21.15.172:0/792396176 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd728155c50 con 0x7fd728154ed0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.352+0000 7fd71effd640 1 -- 172.21.15.172:0/792396176 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800cd10 con 0x7fd728154ed0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.352+0000 7fd7305f5640 1 -- 172.21.15.172:0/792396176 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd728156210 con 0x7fd728154ed0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.353+0000 7fd7305f5640 1 -- 172.21.15.172:0/792396176 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd728073990 con 0x7fd728154ed0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.353+0000 7fd71effd640 1 -- 172.21.15.172:0/792396176 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd71801a070 con 0x7fd728154ed0 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.353+0000 7fd71effd640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd70c06b500 0x7fd70c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.354+0000 7fd72e391640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd70c06b500 0x7fd70c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.354+0000 7fd71effd640 1 -- 172.21.15.172:0/792396176 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd71808a3a0 con 0x7fd728154ed0 2024-04-25T08:45:32.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.354+0000 7fd72e391640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd70c06b500 0x7fd70c06d9c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd7281f6f90 tx=0x7fd724008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.358+0000 7fd71effd640 1 -- 172.21.15.172:0/792396176 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd718059090 con 0x7fd728154ed0 2024-04-25T08:45:32.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.564+0000 7fd7305f5640 1 -- 172.21.15.172:0/792396176 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd72814fc60 con 0x7fd728154ed0 2024-04-25T08:45:32.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.564+0000 7fd71effd640 1 -- 172.21.15.172:0/792396176 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fd718058990 con 0x7fd728154ed0 2024-04-25T08:45:32.556 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:32.556 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:20.588374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:32.556 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 23 2024-04-25T08:45:32.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 -- 172.21.15.172:0/792396176 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd70c06b500 msgr2=0x7fd70c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd70c06b500 0x7fd70c06d9c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd7281f6f90 tx=0x7fd724008040 comp rx=0 tx=0).stop 2024-04-25T08:45:32.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 -- 172.21.15.172:0/792396176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd728154ed0 msgr2=0x7fd7280b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd728154ed0 0x7fd7280b4ce0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd71800e860 tx=0x7fd71800ed20 comp rx=0 tx=0).stop 2024-04-25T08:45:32.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 -- 172.21.15.172:0/792396176 shutdown_connections 2024-04-25T08:45:32.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd70c06b500 0x7fd70c06d9c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280b1340 0x7fd7280b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd728154ed0 0x7fd7280b4ce0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 --2- 172.21.15.172:0/792396176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd728071ac0 0x7fd728156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 -- 172.21.15.172:0/792396176 >> 172.21.15.172:0/792396176 conn(0x7fd72806c1d0 msgr2=0x7fd72815ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:32.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 -- 172.21.15.172:0/792396176 shutdown_connections 2024-04-25T08:45:32.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.566+0000 7fd7305f5640 1 -- 172.21.15.172:0/792396176 wait complete. 2024-04-25T08:45:32.569 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path /scrub_test_path/i/dont/exist 2024-04-25T08:45:32.673 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:32.673 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": -2 2024-04-25T08:45:32.673 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:32.682 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2024-04-25T08:45:32.682 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-04-25T08:45:32.682 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:32.682 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-04-25T08:45:32.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.790+0000 7f872dc3a640 1 Processor -- start 2024-04-25T08:45:32.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.790+0000 7f872dc3a640 1 -- start start 2024-04-25T08:45:32.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f872dc3a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f87280b38d0 0x7f87280b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f872dc3a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 0x7f872806c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f872dc3a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872815e020 con 0x7f872806e360 2024-04-25T08:45:32.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f872dc3a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872806b890 con 0x7f87280b38d0 2024-04-25T08:45:32.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f872dc3a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872806ac80 con 0x7f872806bd20 2024-04-25T08:45:32.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f8726ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f87280b38d0 0x7f87280b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f8727fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 0x7f872806c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f8726ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f87280b38d0 0x7f87280b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:58802/0 (socket says 172.21.15.172:58802) 2024-04-25T08:45:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f87277fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f872806e360 0x7f872806e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:40200/0 (socket says 172.21.15.172:40200) 2024-04-25T08:45:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f8726ffd640 1 -- 172.21.15.172:0/406571774 learned_addr learned my addr 172.21.15.172:0/406571774 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f8726ffd640 1 -- 172.21.15.172:0/406571774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 msgr2=0x7f872806c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f8726ffd640 1 --2- 172.21.15.172:0/406571774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 0x7f872806c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f8726ffd640 1 -- 172.21.15.172:0/406571774 >> v1:172.21.15.186:6789/0 conn(0x7f872806e360 legacy=0x7f872806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f8726ffd640 1 -- 172.21.15.172:0/406571774 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872806af60 con 0x7f87280b38d0 2024-04-25T08:45:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f87267fc640 1 -- 172.21.15.172:0/406571774 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749845051 0 0) 0x7f872815e020 con 0x7f872806e360 2024-04-25T08:45:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.791+0000 7f8727fff640 1 --2- 172.21.15.172:0/406571774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 0x7f872806c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.792+0000 7f8726ffd640 1 --2- 172.21.15.172:0/406571774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87280b38d0 0x7f87280b3d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8710009870 tx=0x7f871002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=628f43644ce7543f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.792+0000 7f87267fc640 1 -- 172.21.15.172:0/406571774 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710037070 con 0x7f87280b38d0 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.792+0000 7f87267fc640 1 -- 172.21.15.172:0/406571774 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871002ae50 con 0x7f87280b38d0 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.792+0000 7f87267fc640 1 -- 172.21.15.172:0/406571774 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710032860 con 0x7f87280b38d0 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.793+0000 7f872dc3a640 1 -- 172.21.15.172:0/406571774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87280b38d0 msgr2=0x7f87280b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.793+0000 7f872dc3a640 1 --2- 172.21.15.172:0/406571774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87280b38d0 0x7f87280b3d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8710009870 tx=0x7f871002a300 comp rx=0 tx=0).stop 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.793+0000 7f872dc3a640 1 -- 172.21.15.172:0/406571774 shutdown_connections 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.793+0000 7f872dc3a640 1 --2- 172.21.15.172:0/406571774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 0x7f872806c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.793+0000 7f872dc3a640 1 --2- 172.21.15.172:0/406571774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87280b38d0 0x7f87280b3d10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.793+0000 7f872dc3a640 1 -- 172.21.15.172:0/406571774 >> 172.21.15.172:0/406571774 conn(0x7f87280cfec0 msgr2=0x7f87280d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.793+0000 7f872dc3a640 1 -- 172.21.15.172:0/406571774 shutdown_connections 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.793+0000 7f872dc3a640 1 -- 172.21.15.172:0/406571774 wait complete. 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.794+0000 7f872dc3a640 1 Processor -- start 2024-04-25T08:45:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.794+0000 7f872dc3a640 1 -- start start 2024-04-25T08:45:32.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f872dc3a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 0x7f872814b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f872dc3a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f872806e360 0x7f87280cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f872dc3a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87280b38d0 0x7f87280cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f872dc3a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872806ee50 con 0x7f872806e360 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f872dc3a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872806b520 con 0x7f87280b38d0 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f872dc3a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87280b2fd0 con 0x7f872806bd20 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f8726ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f872806e360 0x7f87280cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f8726ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f872806e360 0x7f87280cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34196/0 (socket says 172.21.15.172:34196) 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f8726ffd640 1 -- 172.21.15.172:0/1048462375 learned_addr learned my addr 172.21.15.172:0/1048462375 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f8727fff640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87280b38d0 0x7f87280cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f87277fe640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 0x7f872814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f8727fff640 1 -- 172.21.15.172:0/1048462375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 msgr2=0x7f872814b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f8727fff640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 0x7f872814b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f8727fff640 1 -- 172.21.15.172:0/1048462375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f872806e360 msgr2=0x7f87280cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f8727fff640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f872806e360 0x7f87280cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f8727fff640 1 -- 172.21.15.172:0/1048462375 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8728152340 con 0x7f87280b38d0 2024-04-25T08:45:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.795+0000 7f8726ffd640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f872806e360 0x7f87280cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.796+0000 7f8727fff640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87280b38d0 0x7f87280cd840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f872000efc0 tx=0x7f872000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.796+0000 7f871ffff640 1 -- 172.21.15.172:0/1048462375 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720018030 con 0x7f87280b38d0 2024-04-25T08:45:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.796+0000 7f871ffff640 1 -- 172.21.15.172:0/1048462375 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872000cd30 con 0x7f87280b38d0 2024-04-25T08:45:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.796+0000 7f872dc3a640 1 -- 172.21.15.172:0/1048462375 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8728152620 con 0x7f87280b38d0 2024-04-25T08:45:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.796+0000 7f871ffff640 1 -- 172.21.15.172:0/1048462375 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720003bb0 con 0x7f87280b38d0 2024-04-25T08:45:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.796+0000 7f872dc3a640 1 -- 172.21.15.172:0/1048462375 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8728152be0 con 0x7f87280b38d0 2024-04-25T08:45:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.797+0000 7f871ffff640 1 -- 172.21.15.172:0/1048462375 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f872001b070 con 0x7f87280b38d0 2024-04-25T08:45:32.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.798+0000 7f871ffff640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f870806b4d0 0x7f870806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.798+0000 7f871ffff640 1 -- 172.21.15.172:0/1048462375 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f872008abc0 con 0x7f87280b38d0 2024-04-25T08:45:32.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.798+0000 7f87277fe640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f870806b4d0 0x7f870806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.798+0000 7f87277fe640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f870806b4d0 0x7f870806d990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8718000f60 tx=0x7f8718007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.798+0000 7f8730a10740 1 Processor -- start 2024-04-25T08:45:32.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.798+0000 7f8730a10740 1 -- start start 2024-04-25T08:45:32.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f8730a10740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb026b0 0x559f2fb02a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f8730a10740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f8730a10740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fad8390 0x559f2fb1e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f8730a10740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2fa3ac60 con 0x559f2fb1ff50 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f8730a10740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2f9e3ee0 con 0x559f2fad8390 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f8730a10740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f2fa36d00 con 0x559f2fb026b0 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f8726ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f8726ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb204a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34198/0 (socket says 172.21.15.172:34198) 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f8726ffd640 1 -- 172.21.15.172:0/2558991748 learned_addr learned my addr 172.21.15.172:0/2558991748 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f8727fff640 1 --2- 172.21.15.172:0/2558991748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fad8390 0x559f2fb1e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.799+0000 7f87277fe640 1 --2- 172.21.15.172:0/2558991748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb026b0 0x559f2fb02a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.800+0000 7f8726ffd640 1 -- 172.21.15.172:0/2558991748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb026b0 msgr2=0x559f2fb02a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.800+0000 7f8726ffd640 1 --2- 172.21.15.172:0/2558991748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb026b0 0x559f2fb02a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.800+0000 7f8726ffd640 1 -- 172.21.15.172:0/2558991748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fad8390 msgr2=0x559f2fb1e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.800+0000 7f8726ffd640 1 --2- 172.21.15.172:0/2558991748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fad8390 0x559f2fb1e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.800+0000 7f8726ffd640 1 -- 172.21.15.172:0/2558991748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f2f81b9f0 con 0x559f2fb1ff50 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.800+0000 7f8727fff640 1 --2- 172.21.15.172:0/2558991748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fad8390 0x559f2fb1e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.800+0000 7f8726ffd640 1 --2- 172.21.15.172:0/2558991748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb204a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f871002a8f0 tx=0x7f871002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451d76f88e66dad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.800+0000 7f871d7fa640 1 -- 172.21.15.172:0/2558991748 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710037040 con 0x559f2fb1ff50 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.800+0000 7f871d7fa640 1 -- 172.21.15.172:0/2558991748 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871002ae50 con 0x559f2fb1ff50 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.800+0000 7f871d7fa640 1 -- 172.21.15.172:0/2558991748 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710004440 con 0x559f2fb1ff50 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 -- 172.21.15.172:0/2558991748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 msgr2=0x559f2fb204a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 --2- 172.21.15.172:0/2558991748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb204a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f871002a8f0 tx=0x7f871002c000 comp rx=0 tx=0).stop 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 -- 172.21.15.172:0/2558991748 shutdown_connections 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 --2- 172.21.15.172:0/2558991748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fad8390 0x559f2fb1e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 --2- 172.21.15.172:0/2558991748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb204a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 --2- 172.21.15.172:0/2558991748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb026b0 0x559f2fb02a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 -- 172.21.15.172:0/2558991748 >> 172.21.15.172:0/2558991748 conn(0x559f2fad4cc0 msgr2=0x559f2fb1d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 -- 172.21.15.172:0/2558991748 shutdown_connections 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 -- 172.21.15.172:0/2558991748 wait complete. 2024-04-25T08:45:32.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 -- start start 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.801+0000 7f8730a10740 1 Processor -- start 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8730a10740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb026b0 0x559f2fb14970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8730a10740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 0x559f2fb15fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8730a10740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb164e0 0x559f2fafea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8730a10740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2fad9130 con 0x559f2fb164e0 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8730a10740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2f9f7470 con 0x559f2fb1ff50 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8730a10740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f2fad2bf0 con 0x559f2fb026b0 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8730a10740 10 client.0 _ll_register_callbacks cb 0x559f2f9c37d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8727fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb164e0 0x559f2fafea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8726ffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 0x559f2fb15fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8727fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb164e0 0x559f2fafea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34204/0 (socket says 172.21.15.172:34204) 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f87277fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb026b0 0x559f2fb14970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.802+0000 7f8727fff640 1 -- 172.21.15.172:0/3620481452 learned_addr learned my addr 172.21.15.172:0/3620481452 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8726ffd640 1 -- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb026b0 msgr2=0x559f2fb14970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8726ffd640 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb026b0 0x559f2fb14970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8726ffd640 1 -- 172.21.15.172:0/3620481452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb164e0 msgr2=0x559f2fafea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8726ffd640 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb164e0 0x559f2fafea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8726ffd640 1 -- 172.21.15.172:0/3620481452 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f2f70f2e0 con 0x559f2fb1ff50 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8727fff640 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb164e0 0x559f2fafea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8726ffd640 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 0x559f2fb15fa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8710009990 tx=0x7f8710004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95576a39e6a2c77f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f87067fc640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f87067fc640 1 -- 172.21.15.172:0/3620481452 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871004b060 con 0x559f2fb1ff50 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f87067fc640 1 -- 172.21.15.172:0/3620481452 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8710032c00 con 0x559f2fb1ff50 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8730a10740 1 -- 172.21.15.172:0/3620481452 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f871002ae50 con 0x559f2fb1ff50 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f87067fc640 1 -- 172.21.15.172:0/3620481452 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8710051050 con 0x559f2fb1ff50 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8730a10740 10 client.5479 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8730a10740 1 -- 172.21.15.172:0/3620481452 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x559f2f87c180 con 0x559f2fb1ff50 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f87067fc640 1 -- 172.21.15.172:0/3620481452 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871002ae50 con 0x559f2fb1ff50 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f87067fc640 1 -- 172.21.15.172:0/3620481452 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8710003610 con 0x559f2fb1ff50 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8730a10740 10 client.5479 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8730a10740 10 client.5479 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:32.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8730a10740 20 client.5479 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8730a10740 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559f2fb30e80 0x559f2fb31260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8730a10740 4 client.5479 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.803+0000 7f8730a10740 1 -- 172.21.15.172:0/3620481452 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f2fa481a0 con 0x559f2fb30e80 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.804+0000 7f87277fe640 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559f2fb30e80 0x559f2fb31260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.804+0000 7f87067fc640 10 client.5479 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.804+0000 7f87277fe640 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559f2fb30e80 0x559f2fb31260 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a13bc58431627e5 server_cookie=45af6c05e8fd582a in_seq=0 out_seq=0 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.804+0000 7f87067fc640 1 -- 172.21.15.172:0/3620481452 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559f2fa481a0 con 0x559f2fb30e80 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.804+0000 7f87067fc640 10 client.5479 handle_command_reply: tid=0 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.804+0000 7f8730a10740 1 client.5479 shutdown 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 1 -- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 msgr2=0x559f2fb15fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 0x559f2fb15fa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8710009990 tx=0x7f8710004730 comp rx=0 tx=0).stop 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 1 -- 172.21.15.172:0/3620481452 shutdown_connections 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 0x559f2fb15fa0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559f2fb30e80 0x559f2fb31260 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb164e0 0x559f2fafea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 1 --2- 172.21.15.172:0/3620481452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb026b0 0x559f2fb14970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f87067fc640 0 client.5479 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:32.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 1 -- 172.21.15.172:0/3620481452 >> 172.21.15.172:0/3620481452 conn(0x559f2fad8390 msgr2=0x559f2fb212d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:32.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 1 -- 172.21.15.172:0/3620481452 shutdown_connections 2024-04-25T08:45:32.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 1 -- 172.21.15.172:0/3620481452 wait complete. 2024-04-25T08:45:32.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.805+0000 7f8730a10740 20 client.5479 trim_cache size 0 max 16384 2024-04-25T08:45:32.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.820+0000 7f8730a10740 1 Processor -- start 2024-04-25T08:45:32.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.820+0000 7f8730a10740 1 -- start start 2024-04-25T08:45:32.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.820+0000 7f8730a10740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb026b0 0x559f2fb01f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.820+0000 7f8730a10740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 0x559f2fad8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.820+0000 7f8730a10740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb305f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.820+0000 7f8730a10740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8728200130 con 0x559f2fb1ff50 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.820+0000 7f8730a10740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87281ff2f0 con 0x559f2fb026b0 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.820+0000 7f8730a10740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87281540e0 con 0x559f2fb164e0 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8727fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8727fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb305f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34214/0 (socket says 172.21.15.172:34214) 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8727fff640 1 -- 172.21.15.172:0/1659544791 learned_addr learned my addr 172.21.15.172:0/1659544791 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8726ffd640 1 --2- 172.21.15.172:0/1659544791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 0x559f2fad8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f87277fe640 1 --2- 172.21.15.172:0/1659544791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb026b0 0x559f2fb01f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8726ffd640 1 -- 172.21.15.172:0/1659544791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb026b0 msgr2=0x559f2fb01f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8726ffd640 1 --2- 172.21.15.172:0/1659544791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb026b0 0x559f2fb01f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8726ffd640 1 -- 172.21.15.172:0/1659544791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 msgr2=0x559f2fb305f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8726ffd640 1 --2- 172.21.15.172:0/1659544791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb305f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8726ffd640 1 -- 172.21.15.172:0/1659544791 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f2fb16310 con 0x559f2fb164e0 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8727fff640 1 --2- 172.21.15.172:0/1659544791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb305f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f8726ffd640 1 --2- 172.21.15.172:0/1659544791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 0x559f2fad8cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f871002a340 tx=0x7f871000b070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74e77da14035b558 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f871cff9640 1 -- 172.21.15.172:0/1659544791 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710037040 con 0x559f2fb164e0 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f871cff9640 1 -- 172.21.15.172:0/1659544791 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710003db0 con 0x559f2fb164e0 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.821+0000 7f871cff9640 1 -- 172.21.15.172:0/1659544791 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710032a00 con 0x559f2fb164e0 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.822+0000 7f8730a10740 1 -- 172.21.15.172:0/1659544791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 msgr2=0x559f2fad8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.822+0000 7f8730a10740 1 --2- 172.21.15.172:0/1659544791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 0x559f2fad8cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f871002a340 tx=0x7f871000b070 comp rx=0 tx=0).stop 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.822+0000 7f8730a10740 1 -- 172.21.15.172:0/1659544791 shutdown_connections 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.822+0000 7f8730a10740 1 --2- 172.21.15.172:0/1659544791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb1ff50 0x559f2fb305f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.822+0000 7f8730a10740 1 --2- 172.21.15.172:0/1659544791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 0x559f2fad8cc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.822+0000 7f8730a10740 1 --2- 172.21.15.172:0/1659544791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb026b0 0x559f2fb01f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.822+0000 7f8730a10740 1 -- 172.21.15.172:0/1659544791 >> 172.21.15.172:0/1659544791 conn(0x559f2fad8390 msgr2=0x559f2fb1e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.822+0000 7f8730a10740 1 -- 172.21.15.172:0/1659544791 shutdown_connections 2024-04-25T08:45:32.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.822+0000 7f8730a10740 1 -- 172.21.15.172:0/1659544791 wait complete. 2024-04-25T08:45:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.822+0000 7f8730a10740 1 -- start start 2024-04-25T08:45:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f8730a10740 1 Processor -- start 2024-04-25T08:45:32.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f8730a10740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb026b0 0x559f2fb1f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f8730a10740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 0x559f2fb1f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f8730a10740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 0x559f2fad6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f8730a10740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f2fa481a0 con 0x559f2fb026b0 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f8730a10740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87281546e0 con 0x559f2fb1ff50 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f8730a10740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f2fad5c10 con 0x559f2fb164e0 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f8730a10740 10 client.0 _ll_register_callbacks cb 0x559f2fad30d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f87277fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb026b0 0x559f2fb1f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f87277fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb026b0 0x559f2fb1f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34226/0 (socket says 172.21.15.172:34226) 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f87277fe640 1 -- 172.21.15.172:0/405843357 learned_addr learned my addr 172.21.15.172:0/405843357 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f8726ffd640 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 0x559f2fb1f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.823+0000 7f8727fff640 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 0x559f2fad6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87277fe640 1 -- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 msgr2=0x559f2fb1f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87277fe640 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 0x559f2fb1f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87277fe640 1 -- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 msgr2=0x559f2fad6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87277fe640 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 0x559f2fad6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87277fe640 1 -- 172.21.15.172:0/405843357 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f2f6e83a0 con 0x559f2fb026b0 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f8726ffd640 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 0x559f2fb1f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87277fe640 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb026b0 0x559f2fb1f3f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x559f2fb16ff0 tx=0x7f8718000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edced5d0953745d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87067fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87067fc640 1 -- 172.21.15.172:0/405843357 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87180077b0 con 0x559f2fb026b0 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87067fc640 1 -- 172.21.15.172:0/405843357 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8718010040 con 0x559f2fb026b0 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f8730a10740 1 -- 172.21.15.172:0/405843357 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8710003db0 con 0x559f2fb026b0 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87067fc640 1 -- 172.21.15.172:0/405843357 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8718038050 con 0x559f2fb026b0 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f8730a10740 10 client.6087 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f8730a10740 1 -- 172.21.15.172:0/405843357 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x559f2fb20330 con 0x559f2fb026b0 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87067fc640 1 -- 172.21.15.172:0/405843357 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710003db0 con 0x559f2fb026b0 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f87067fc640 1 -- 172.21.15.172:0/405843357 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f871803b020 con 0x559f2fb026b0 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f8730a10740 10 client.6087 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f8730a10740 10 client.6087 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f8730a10740 20 client.6087 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:32.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f8730a10740 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559f2fb37b80 0x559f2fad6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f8730a10740 4 client.6087 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.824+0000 7f8730a10740 1 -- 172.21.15.172:0/405843357 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x559f2fa424f0 con 0x559f2fb37b80 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8726ffd640 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559f2fb37b80 0x559f2fad6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8726ffd640 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559f2fb37b80 0x559f2fad6a80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f148b63f744af67d server_cookie=ec4bac40870890a9 in_seq=0 out_seq=0 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f87067fc640 10 client.6087 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f87067fc640 1 -- 172.21.15.172:0/405843357 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x559f2fa424f0 con 0x559f2fb37b80 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f87067fc640 10 client.6087 handle_command_reply: tid=0 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 client.6087 shutdown 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 -- 172.21.15.172:0/405843357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb026b0 msgr2=0x559f2fb1f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb026b0 0x559f2fb1f3f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x559f2fb16ff0 tx=0x7f8718000ed0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 -- 172.21.15.172:0/405843357 shutdown_connections 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559f2fb1ff50 0x559f2fad6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559f2fb37b80 0x559f2fad6a80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559f2fb164e0 0x559f2fb1f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 --2- 172.21.15.172:0/405843357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f2fb026b0 0x559f2fb1f3f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f87067fc640 0 client.6087 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:32.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 -- 172.21.15.172:0/405843357 >> 172.21.15.172:0/405843357 conn(0x559f2fad8390 msgr2=0x559f2fb17340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:32.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 -- 172.21.15.172:0/405843357 shutdown_connections 2024-04-25T08:45:32.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.825+0000 7f8730a10740 1 -- 172.21.15.172:0/405843357 wait complete. 2024-04-25T08:45:32.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f8730a10740 20 client.6087 trim_cache size 0 max 16384 2024-04-25T08:45:32.823 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:32.823 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": -2 2024-04-25T08:45:32.823 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 -- 172.21.15.172:0/1048462375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f870806b4d0 msgr2=0x7f870806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f870806b4d0 0x7f870806d990 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8718000f60 tx=0x7f8718007d50 comp rx=0 tx=0).stop 2024-04-25T08:45:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 -- 172.21.15.172:0/1048462375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87280b38d0 msgr2=0x7f87280cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87280b38d0 0x7f87280cd840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f872000efc0 tx=0x7f872000c490 comp rx=0 tx=0).stop 2024-04-25T08:45:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 -- 172.21.15.172:0/1048462375 shutdown_connections 2024-04-25T08:45:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f870806b4d0 0x7f870806d990 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87280b38d0 0x7f87280cd840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f872806e360 0x7f87280cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 --2- 172.21.15.172:0/1048462375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f872806bd20 0x7f872814b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 -- 172.21.15.172:0/1048462375 >> 172.21.15.172:0/1048462375 conn(0x7f87280cfec0 msgr2=0x7f872815d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 -- 172.21.15.172:0/1048462375 shutdown_connections 2024-04-25T08:45:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.826+0000 7f872dc3a640 1 -- 172.21.15.172:0/1048462375 wait complete. 2024-04-25T08:45:32.828 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-04-25T08:45:32.828 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-04-25T08:45:32.829 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-04-25T08:45:32.829 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:32.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.934+0000 7fd0b9bd5640 1 Processor -- start 2024-04-25T08:45:32.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.934+0000 7fd0b9bd5640 1 -- start start 2024-04-25T08:45:32.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.935+0000 7fd0b9bd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 0x7fd0b41625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.935+0000 7fd0b9bd5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd0b40d1810 0x7fd0b40d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.935+0000 7fd0b9bd5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b40cce50 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.935+0000 7fd0b9bd5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b40d2180 con 0x7fd0b40d1810 2024-04-25T08:45:32.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.935+0000 7fd0b9bd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b4161af0 con 0x7fd0b415dc90 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.935+0000 7fd0b2ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd0b40cc8e0 0x7fd0b415ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49638/0 (socket says 172.21.15.172:49638) 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.935+0000 7fd0b2ffd640 1 -- 172.21.15.172:0/2311484107 learned_addr learned my addr 172.21.15.172:0/2311484107 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.935+0000 7fd0b37fe640 1 --2- 172.21.15.172:0/2311484107 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 0x7fd0b41625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.935+0000 7fd0b3fff640 1 --2- 172.21.15.172:0/2311484107 >> v2:172.21.15.186:3300/0 conn(0x7fd0b40d1810 0x7fd0b40d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.936+0000 7fd0b27fc640 1 -- 172.21.15.172:0/2311484107 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950202360 0 0) 0x7fd0b40cce50 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.936+0000 7fd0b27fc640 1 -- 172.21.15.172:0/2311484107 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd09c003520 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.936+0000 7fd0b37fe640 1 -- 172.21.15.172:0/2311484107 >> v2:172.21.15.186:3300/0 conn(0x7fd0b40d1810 msgr2=0x7fd0b40d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.936+0000 7fd0b37fe640 1 --2- 172.21.15.172:0/2311484107 >> v2:172.21.15.186:3300/0 conn(0x7fd0b40d1810 0x7fd0b40d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.936+0000 7fd0b37fe640 1 -- 172.21.15.172:0/2311484107 >> v1:172.21.15.172:6789/0 conn(0x7fd0b40cc8e0 legacy=0x7fd0b415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.936+0000 7fd0b37fe640 1 -- 172.21.15.172:0/2311484107 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b4161dd0 con 0x7fd0b415dc90 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.936+0000 7fd0b3fff640 1 --2- 172.21.15.172:0/2311484107 >> v2:172.21.15.186:3300/0 conn(0x7fd0b40d1810 0x7fd0b40d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.936+0000 7fd0b37fe640 1 --2- 172.21.15.172:0/2311484107 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 0x7fd0b41625d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40097a0 tx=0x7fd0a402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a644a0192dcd7b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b27fc640 1 -- 172.21.15.172:0/2311484107 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4037070 con 0x7fd0b415dc90 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b27fc640 1 -- 172.21.15.172:0/2311484107 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a402ae50 con 0x7fd0b415dc90 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b27fc640 1 -- 172.21.15.172:0/2311484107 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4032660 con 0x7fd0b415dc90 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/2311484107 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 msgr2=0x7fd0b41625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b9bd5640 1 --2- 172.21.15.172:0/2311484107 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 0x7fd0b41625d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40097a0 tx=0x7fd0a402a100 comp rx=0 tx=0).stop 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/2311484107 shutdown_connections 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b9bd5640 1 --2- 172.21.15.172:0/2311484107 >> v2:172.21.15.186:3300/0 conn(0x7fd0b40d1810 0x7fd0b40d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b9bd5640 1 --2- 172.21.15.172:0/2311484107 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 0x7fd0b41625d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/2311484107 >> 172.21.15.172:0/2311484107 conn(0x7fd0b406f590 msgr2=0x7fd0b406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/2311484107 shutdown_connections 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.937+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/2311484107 wait complete. 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.938+0000 7fd0b9bd5640 1 Processor -- start 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b9bd5640 1 -- start start 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b9bd5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b40cc8e0 0x7fd0b4159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b9bd5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b40d1810 0x7fd0b4155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b9bd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 0x7fd0b41f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b9bd5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b415e070 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b9bd5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40cd130 con 0x7fd0b40d1810 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b9bd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b415e1f0 con 0x7fd0b415dc90 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b40cc8e0 0x7fd0b4159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b40cc8e0 0x7fd0b4159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34234/0 (socket says 172.21.15.172:34234) 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b37fe640 1 -- 172.21.15.172:0/277447170 learned_addr learned my addr 172.21.15.172:0/277447170 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.939+0000 7fd0b2ffd640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b40d1810 0x7fd0b4155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd0b3fff640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 0x7fd0b41f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd0b37fe640 1 -- 172.21.15.172:0/277447170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 msgr2=0x7fd0b41f3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd0b37fe640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 0x7fd0b41f3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd0b37fe640 1 -- 172.21.15.172:0/277447170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b40d1810 msgr2=0x7fd0b4155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd0b37fe640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b40d1810 0x7fd0b4155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd0b37fe640 1 -- 172.21.15.172:0/277447170 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b40b5c60 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd0b37fe640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b40cc8e0 0x7fd0b4159590 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40098c0 tx=0x7fd0a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd09bfff640 1 -- 172.21.15.172:0/277447170 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4041020 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd09bfff640 1 -- 172.21.15.172:0/277447170 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a403c670 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd09bfff640 1 -- 172.21.15.172:0/277447170 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4037040 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/277447170 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b40b5f40 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.940+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/277447170 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b41f4470 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.941+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/277447170 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b4073990 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.941+0000 7fd09bfff640 1 -- 172.21.15.172:0/277447170 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd0a4044020 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.942+0000 7fd09bfff640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd0a006b4d0 0x7fd0a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.942+0000 7fd09bfff640 1 -- 172.21.15.172:0/277447170 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd0a40aaa10 con 0x7fd0b40cc8e0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.942+0000 7fd0b2ffd640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd0a006b4d0 0x7fd0a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:32.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.942+0000 7fd0b2ffd640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd0a006b4d0 0x7fd0a006d990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40b0b20 tx=0x7fd0a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:32.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:32.946+0000 7fd09bfff640 1 -- 172.21.15.172:0/277447170 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd0a404b030 con 0x7fd0b40cc8e0 2024-04-25T08:45:33.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.151+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/277447170 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0b406d1c0 con 0x7fd0b40cc8e0 2024-04-25T08:45:33.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.152+0000 7fd09bfff640 1 -- 172.21.15.172:0/277447170 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fd0a403ca40 con 0x7fd0b40cc8e0 2024-04-25T08:45:33.144 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:33.144 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:20.588374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:33.144 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 23 2024-04-25T08:45:33.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/277447170 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd0a006b4d0 msgr2=0x7fd0a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd0a006b4d0 0x7fd0a006d990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40b0b20 tx=0x7fd0a8009040 comp rx=0 tx=0).stop 2024-04-25T08:45:33.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/277447170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b40cc8e0 msgr2=0x7fd0b4159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b40cc8e0 0x7fd0b4159590 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40098c0 tx=0x7fd0a40046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/277447170 shutdown_connections 2024-04-25T08:45:33.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd0a006b4d0 0x7fd0a006d990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b40d1810 0x7fd0b4155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0b415dc90 0x7fd0b41f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 --2- 172.21.15.172:0/277447170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b40cc8e0 0x7fd0b4159590 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/277447170 >> 172.21.15.172:0/277447170 conn(0x7fd0b406f590 msgr2=0x7fd0b406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:33.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/277447170 shutdown_connections 2024-04-25T08:45:33.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.154+0000 7fd0b9bd5640 1 -- 172.21.15.172:0/277447170 wait complete. 2024-04-25T08:45:33.157 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path /scrub_test_path/ceph-qa-suite/suites 2024-04-25T08:45:33.333 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:33.333 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": 0 2024-04-25T08:45:33.333 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:33.342 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:45:33.342 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-04-25T08:45:33.342 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:33.342 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-04-25T08:45:33.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.452+0000 7f886be41640 1 Processor -- start 2024-04-25T08:45:33.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.452+0000 7f886be41640 1 -- start start 2024-04-25T08:45:33.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f886be41640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88640cc4f0 0x7f88640cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f886be41640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f88640cdb20 0x7f88640cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f886be41640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8864072280 con 0x7f886415b270 2024-04-25T08:45:33.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f886be41640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640ce4c0 con 0x7f88640cdb20 2024-04-25T08:45:33.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f886be41640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8864071270 con 0x7f88640cc4f0 2024-04-25T08:45:33.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f8869bdd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88640cc4f0 0x7f88640cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f88693dc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f88640cdb20 0x7f88640cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f88693dc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f88640cdb20 0x7f88640cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:58862/0 (socket says 172.21.15.172:58862) 2024-04-25T08:45:33.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f8869bdd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88640cc4f0 0x7f88640cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:58512/0 (socket says 172.21.15.172:58512) 2024-04-25T08:45:33.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f88693dc640 1 -- 172.21.15.172:0/3926827967 learned_addr learned my addr 172.21.15.172:0/3926827967 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:33.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f886a3de640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f886415b270 0x7f886415b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:40204/0 (socket says 172.21.15.172:40204) 2024-04-25T08:45:33.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f88693dc640 1 -- 172.21.15.172:0/3926827967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88640cc4f0 msgr2=0x7f88640cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:33.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f88693dc640 1 --2- 172.21.15.172:0/3926827967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88640cc4f0 0x7f88640cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f88693dc640 1 -- 172.21.15.172:0/3926827967 >> v1:172.21.15.186:6789/0 conn(0x7f886415b270 legacy=0x7f886415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f88693dc640 1 -- 172.21.15.172:0/3926827967 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640714c0 con 0x7f88640cdb20 2024-04-25T08:45:33.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.453+0000 7f8869bdd640 1 --2- 172.21.15.172:0/3926827967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88640cc4f0 0x7f88640cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.454+0000 7f88693dc640 1 --2- 172.21.15.172:0/3926827967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88640cdb20 0x7f88640cdf80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f885400bb10 tx=0x7f885402c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80c2e86b75483f8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.454+0000 7f8868bdb640 1 -- 172.21.15.172:0/3926827967 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854036020 con 0x7f88640cdb20 2024-04-25T08:45:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.454+0000 7f8868bdb640 1 -- 172.21.15.172:0/3926827967 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8854032820 con 0x7f88640cdb20 2024-04-25T08:45:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.454+0000 7f8868bdb640 1 -- 172.21.15.172:0/3926827967 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854032bf0 con 0x7f88640cdb20 2024-04-25T08:45:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.455+0000 7f886be41640 1 -- 172.21.15.172:0/3926827967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88640cdb20 msgr2=0x7f88640cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.455+0000 7f886be41640 1 --2- 172.21.15.172:0/3926827967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88640cdb20 0x7f88640cdf80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f885400bb10 tx=0x7f885402c920 comp rx=0 tx=0).stop 2024-04-25T08:45:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.455+0000 7f886be41640 1 -- 172.21.15.172:0/3926827967 shutdown_connections 2024-04-25T08:45:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.455+0000 7f886be41640 1 --2- 172.21.15.172:0/3926827967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88640cdb20 0x7f88640cdf80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.455+0000 7f886be41640 1 --2- 172.21.15.172:0/3926827967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88640cc4f0 0x7f88640cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.455+0000 7f886be41640 1 -- 172.21.15.172:0/3926827967 >> 172.21.15.172:0/3926827967 conn(0x7f886406abe0 msgr2=0x7f886406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.455+0000 7f886be41640 1 -- 172.21.15.172:0/3926827967 shutdown_connections 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.455+0000 7f886be41640 1 -- 172.21.15.172:0/3926827967 wait complete. 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.456+0000 7f886be41640 1 Processor -- start 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.456+0000 7f886be41640 1 -- start start 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f886be41640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88640cc4f0 0x7f88641401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f886be41640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88640cdb20 0x7f88641536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f886be41640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886415b270 0x7f8864153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f886be41640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8864071a80 con 0x7f88640cc4f0 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f886be41640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886415bd90 con 0x7f88640cdb20 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f886be41640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8864071d60 con 0x7f886415b270 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f8869bdd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88640cc4f0 0x7f88641401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f8869bdd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88640cc4f0 0x7f88641401d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34250/0 (socket says 172.21.15.172:34250) 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f8869bdd640 1 -- 172.21.15.172:0/2024403510 learned_addr learned my addr 172.21.15.172:0/2024403510 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f88693dc640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88640cdb20 0x7f88641536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f886a3de640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886415b270 0x7f8864153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f8869bdd640 1 -- 172.21.15.172:0/2024403510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886415b270 msgr2=0x7f8864153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f8869bdd640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886415b270 0x7f8864153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f8869bdd640 1 -- 172.21.15.172:0/2024403510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88640cdb20 msgr2=0x7f88641536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f8869bdd640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88640cdb20 0x7f88641536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.457+0000 7f8869bdd640 1 -- 172.21.15.172:0/2024403510 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864157d50 con 0x7f88640cc4f0 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.458+0000 7f8869bdd640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88640cc4f0 0x7f88641401d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f886000efc0 tx=0x7f886000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.458+0000 7f885a7fc640 1 -- 172.21.15.172:0/2024403510 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860018020 con 0x7f88640cc4f0 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.458+0000 7f885a7fc640 1 -- 172.21.15.172:0/2024403510 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8860014680 con 0x7f88640cc4f0 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.458+0000 7f886be41640 1 -- 172.21.15.172:0/2024403510 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8864156170 con 0x7f88640cc4f0 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.458+0000 7f885a7fc640 1 -- 172.21.15.172:0/2024403510 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860014a50 con 0x7f88640cc4f0 2024-04-25T08:45:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.458+0000 7f886be41640 1 -- 172.21.15.172:0/2024403510 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8864156730 con 0x7f88640cc4f0 2024-04-25T08:45:33.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.459+0000 7f885a7fc640 1 -- 172.21.15.172:0/2024403510 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8860005d10 con 0x7f88640cc4f0 2024-04-25T08:45:33.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.460+0000 7f885a7fc640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884806b4d0 0x7f884806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.460+0000 7f885a7fc640 1 -- 172.21.15.172:0/2024403510 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f886008b060 con 0x7f88640cc4f0 2024-04-25T08:45:33.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.460+0000 7f88693dc640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884806b4d0 0x7f884806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.460+0000 7f88693dc640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884806b4d0 0x7f884806d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8854037000 tx=0x7f885403d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:33.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.461+0000 7f886ec16740 1 Processor -- start 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.461+0000 7f886ec16740 1 -- start start 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886ec16740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede6d00 0x5613eede70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886ec16740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eee05b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886ec16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eee06060 0x5613eedbdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886ec16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613eecf0fe0 con 0x5613eee06060 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886ec16740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613eed22d20 con 0x5613eedc10b0 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886ec16740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613eeccbfa0 con 0x5613eede6d00 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886a3de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eee06060 0x5613eedbdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886a3de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eee06060 0x5613eedbdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34262/0 (socket says 172.21.15.172:34262) 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886a3de640 1 -- 172.21.15.172:0/976629250 learned_addr learned my addr 172.21.15.172:0/976629250 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f8869bdd640 1 --2- 172.21.15.172:0/976629250 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede6d00 0x5613eede70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f88693dc640 1 --2- 172.21.15.172:0/976629250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eee05b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886a3de640 1 -- 172.21.15.172:0/976629250 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede6d00 msgr2=0x5613eede70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886a3de640 1 --2- 172.21.15.172:0/976629250 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede6d00 0x5613eede70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886a3de640 1 -- 172.21.15.172:0/976629250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 msgr2=0x5613eee05b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886a3de640 1 --2- 172.21.15.172:0/976629250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eee05b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886a3de640 1 -- 172.21.15.172:0/976629250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613eeb03b00 con 0x5613eee06060 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f886a3de640 1 --2- 172.21.15.172:0/976629250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eee06060 0x5613eedbdf70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f885c0076e0 tx=0x7f885c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a7c469be01596e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f88477fe640 1 -- 172.21.15.172:0/976629250 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0017b0 con 0x5613eee06060 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f88477fe640 1 -- 172.21.15.172:0/976629250 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c018070 con 0x5613eee06060 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.462+0000 7f88477fe640 1 -- 172.21.15.172:0/976629250 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c001b50 con 0x5613eee06060 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.463+0000 7f886ec16740 1 -- 172.21.15.172:0/976629250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eee06060 msgr2=0x5613eedbdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.463+0000 7f886ec16740 1 --2- 172.21.15.172:0/976629250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eee06060 0x5613eedbdf70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f885c0076e0 tx=0x7f885c004bb0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.463+0000 7f886ec16740 1 -- 172.21.15.172:0/976629250 shutdown_connections 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.463+0000 7f886ec16740 1 --2- 172.21.15.172:0/976629250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eee05b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.463+0000 7f886ec16740 1 --2- 172.21.15.172:0/976629250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eee06060 0x5613eedbdf70 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.463+0000 7f886ec16740 1 --2- 172.21.15.172:0/976629250 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede6d00 0x5613eede70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.463+0000 7f886ec16740 1 -- 172.21.15.172:0/976629250 >> 172.21.15.172:0/976629250 conn(0x5613eed87100 msgr2=0x5613eee049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.463+0000 7f886ec16740 1 -- 172.21.15.172:0/976629250 shutdown_connections 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.463+0000 7f886ec16740 1 -- 172.21.15.172:0/976629250 wait complete. 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.464+0000 7f886ec16740 1 -- start start 2024-04-25T08:45:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.464+0000 7f886ec16740 1 Processor -- start 2024-04-25T08:45:33.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886ec16740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eedd9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886ec16740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede6d00 0x5613eedd81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886ec16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eee06450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886ec16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613eecc1750 con 0x5613eede0760 2024-04-25T08:45:33.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886ec16740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613eed1edc0 con 0x5613eedc10b0 2024-04-25T08:45:33.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886ec16740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613eedbb7a0 con 0x5613eede6d00 2024-04-25T08:45:33.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886ec16740 10 client.0 _ll_register_callbacks cb 0x5613eecd9ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:33.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886a3de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eee06450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886a3de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eee06450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34274/0 (socket says 172.21.15.172:34274) 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886a3de640 1 -- 172.21.15.172:0/1288775839 learned_addr learned my addr 172.21.15.172:0/1288775839 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886a3de640 1 -- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede6d00 msgr2=0x5613eedd81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886a3de640 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede6d00 0x5613eedd81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886a3de640 1 -- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 msgr2=0x5613eedd9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f8869bdd640 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eedd9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886a3de640 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eedd9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886a3de640 1 -- 172.21.15.172:0/1288775839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613ee9f73f0 con 0x5613eede0760 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886a3de640 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eee06450 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f885c014000 tx=0x7f885c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e8d6e7f148973a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f8844ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f8844ff9640 1 -- 172.21.15.172:0/1288775839 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c01d820 con 0x5613eede0760 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f8844ff9640 1 -- 172.21.15.172:0/1288775839 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f885c01d9c0 con 0x5613eede0760 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.465+0000 7f886ec16740 1 -- 172.21.15.172:0/1288775839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f885c018070 con 0x5613eede0760 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f8844ff9640 1 -- 172.21.15.172:0/1288775839 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f885c01dbc0 con 0x5613eede0760 2024-04-25T08:45:33.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f886ec16740 10 client.6102 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f886ec16740 1 -- 172.21.15.172:0/1288775839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5613eeb64290 con 0x5613eede0760 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f8844ff9640 1 -- 172.21.15.172:0/1288775839 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c018070 con 0x5613eede0760 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f8844ff9640 1 -- 172.21.15.172:0/1288775839 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f885c027470 con 0x5613eede0760 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f886ec16740 10 client.6102 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f886ec16740 10 client.6102 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f886ec16740 20 client.6102 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f886ec16740 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5613eeddc480 0x5613eeddf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f886ec16740 4 client.6102 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f886ec16740 1 -- 172.21.15.172:0/1288775839 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613eed30260 con 0x5613eeddc480 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f8869bdd640 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5613eeddc480 0x5613eeddf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f8869bdd640 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5613eeddc480 0x5613eeddf530 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98885823dc864e69 server_cookie=bc79e3ccdad08ec7 in_seq=0 out_seq=0 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.466+0000 7f8844ff9640 10 client.6102 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f8844ff9640 1 -- 172.21.15.172:0/1288775839 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5613eed30260 con 0x5613eeddc480 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f8844ff9640 10 client.6102 handle_command_reply: tid=0 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 client.6102 shutdown 2024-04-25T08:45:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 -- 172.21.15.172:0/1288775839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 msgr2=0x5613eee06450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eee06450 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f885c014000 tx=0x7f885c012000 comp rx=0 tx=0).stop 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 -- 172.21.15.172:0/1288775839 shutdown_connections 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5613eeddc480 0x5613eeddf530 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eee06450 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede6d00 0x5613eedd81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f8844ff9640 0 client.6102 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 --2- 172.21.15.172:0/1288775839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eedd9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 -- 172.21.15.172:0/1288775839 >> 172.21.15.172:0/1288775839 conn(0x5613eed87100 msgr2=0x5613eee087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 -- 172.21.15.172:0/1288775839 shutdown_connections 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 1 -- 172.21.15.172:0/1288775839 wait complete. 2024-04-25T08:45:33.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.467+0000 7f886ec16740 20 client.6102 trim_cache size 0 max 16384 2024-04-25T08:45:33.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.482+0000 7f886ec16740 1 Processor -- start 2024-04-25T08:45:33.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.483+0000 7f886ec16740 1 -- start start 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.483+0000 7f886ec16740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eeddb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.483+0000 7f886ec16740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede0760 0x5613eeddba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.483+0000 7f886ec16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede6d00 0x5613eede2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.483+0000 7f886ec16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88641fc0c0 con 0x5613eede6d00 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.483+0000 7f886ec16740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88641fb2c0 con 0x5613eedc10b0 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.483+0000 7f886ec16740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88641f0520 con 0x5613eede0760 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.483+0000 7f886a3de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede6d00 0x5613eede2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.483+0000 7f886a3de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede6d00 0x5613eede2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34284/0 (socket says 172.21.15.172:34284) 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.483+0000 7f886a3de640 1 -- 172.21.15.172:0/1044310043 learned_addr learned my addr 172.21.15.172:0/1044310043 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f88693dc640 1 --2- 172.21.15.172:0/1044310043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede0760 0x5613eeddba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f8869bdd640 1 --2- 172.21.15.172:0/1044310043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eeddb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f886a3de640 1 -- 172.21.15.172:0/1044310043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede0760 msgr2=0x5613eeddba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f886a3de640 1 --2- 172.21.15.172:0/1044310043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede0760 0x5613eeddba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f886a3de640 1 -- 172.21.15.172:0/1044310043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 msgr2=0x5613eeddb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f886a3de640 1 --2- 172.21.15.172:0/1044310043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eeddb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f886a3de640 1 -- 172.21.15.172:0/1044310043 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613eee067c0 con 0x5613eede6d00 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f8869bdd640 1 --2- 172.21.15.172:0/1044310043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eeddb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f886a3de640 1 --2- 172.21.15.172:0/1044310043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede6d00 0x5613eede2ab0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f885c007260 tx=0x7f885c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b59d41cbf83fea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f8846ffd640 1 -- 172.21.15.172:0/1044310043 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c039070 con 0x5613eede6d00 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f8846ffd640 1 -- 172.21.15.172:0/1044310043 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c018070 con 0x5613eede6d00 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f8846ffd640 1 -- 172.21.15.172:0/1044310043 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c01d820 con 0x5613eede6d00 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f886ec16740 1 -- 172.21.15.172:0/1044310043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede6d00 msgr2=0x5613eede2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.484+0000 7f886ec16740 1 --2- 172.21.15.172:0/1044310043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede6d00 0x5613eede2ab0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f885c007260 tx=0x7f885c00a000 comp rx=0 tx=0).stop 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.485+0000 7f886ec16740 1 -- 172.21.15.172:0/1044310043 shutdown_connections 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.485+0000 7f886ec16740 1 --2- 172.21.15.172:0/1044310043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede6d00 0x5613eede2ab0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.485+0000 7f886ec16740 1 --2- 172.21.15.172:0/1044310043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eede0760 0x5613eeddba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.485+0000 7f886ec16740 1 --2- 172.21.15.172:0/1044310043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eedc10b0 0x5613eeddb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.485+0000 7f886ec16740 1 -- 172.21.15.172:0/1044310043 >> 172.21.15.172:0/1044310043 conn(0x5613eed87100 msgr2=0x5613eedd9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:33.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.485+0000 7f886ec16740 1 -- 172.21.15.172:0/1044310043 shutdown_connections 2024-04-25T08:45:33.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.485+0000 7f886ec16740 1 -- 172.21.15.172:0/1044310043 wait complete. 2024-04-25T08:45:33.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.485+0000 7f886ec16740 1 -- start start 2024-04-25T08:45:33.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.485+0000 7f886ec16740 1 Processor -- start 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f886ec16740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eedc10b0 0x5613eee72660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f886ec16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eede2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f886ec16740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eede6d00 0x5613eede2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f886ec16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613eeded350 con 0x5613eede0760 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f886ec16740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88641f0b20 con 0x5613eede6d00 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f886ec16740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613eede6b60 con 0x5613eedc10b0 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f886ec16740 10 client.0 _ll_register_callbacks cb 0x7f885c007180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f88693dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eede2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f88693dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eede2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34300/0 (socket says 172.21.15.172:34300) 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f88693dc640 1 -- 172.21.15.172:0/2820428 learned_addr learned my addr 172.21.15.172:0/2820428 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f8869bdd640 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eedc10b0 0x5613eee72660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f886a3de640 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eede6d00 0x5613eede2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f88693dc640 1 -- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eedc10b0 msgr2=0x5613eee72660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f88693dc640 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eedc10b0 0x5613eee72660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f88693dc640 1 -- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eede6d00 msgr2=0x5613eede2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f88693dc640 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eede6d00 0x5613eede2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.486+0000 7f88693dc640 1 -- 172.21.15.172:0/2820428 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613ee9d04b0 con 0x5613eede0760 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f88693dc640 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eede2a90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f885402cf10 tx=0x7f885402f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1bf5950cc141c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f8844ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f8844ff9640 1 -- 172.21.15.172:0/2820428 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854057060 con 0x5613eede0760 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f8844ff9640 1 -- 172.21.15.172:0/2820428 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f885403b830 con 0x5613eede0760 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f886ec16740 1 -- 172.21.15.172:0/2820428 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f885c018070 con 0x5613eede0760 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f8844ff9640 1 -- 172.21.15.172:0/2820428 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f885405d050 con 0x5613eede0760 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f886ec16740 10 client.6108 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f886ec16740 1 -- 172.21.15.172:0/2820428 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5613eedbcdf0 con 0x5613eede0760 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f8844ff9640 1 -- 172.21.15.172:0/2820428 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c018070 con 0x5613eede0760 2024-04-25T08:45:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f8844ff9640 1 -- 172.21.15.172:0/2820428 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8854060020 con 0x5613eede0760 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f886ec16740 10 client.6108 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f886ec16740 10 client.6108 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f886ec16740 20 client.6108 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f886ec16740 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5613eee06fe0 0x5613eeddb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f886ec16740 4 client.6108 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f886ec16740 1 -- 172.21.15.172:0/2820428 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x5613eed2a5b0 con 0x5613eee06fe0 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.487+0000 7f8869bdd640 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5613eee06fe0 0x5613eeddb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f8869bdd640 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5613eee06fe0 0x5613eeddb1b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66c357a52a527659 server_cookie=b13367c886fa5c69 in_seq=0 out_seq=0 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f8844ff9640 10 client.6108 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f8844ff9640 1 -- 172.21.15.172:0/2820428 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5613eed2a5b0 con 0x5613eee06fe0 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f8844ff9640 10 client.6108 handle_command_reply: tid=0 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f886ec16740 1 client.6108 shutdown 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f886ec16740 1 -- 172.21.15.172:0/2820428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 msgr2=0x5613eede2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f886ec16740 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eede2a90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f885402cf10 tx=0x7f885402f000 comp rx=0 tx=0).stop 2024-04-25T08:45:33.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f886ec16740 1 -- 172.21.15.172:0/2820428 shutdown_connections 2024-04-25T08:45:33.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f886ec16740 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5613eede6d00 0x5613eede2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f886ec16740 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5613eee06fe0 0x5613eeddb1b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f886ec16740 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613eede0760 0x5613eede2a90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f886ec16740 1 --2- 172.21.15.172:0/2820428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5613eedc10b0 0x5613eee72660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f886ec16740 1 -- 172.21.15.172:0/2820428 >> 172.21.15.172:0/2820428 conn(0x5613eed87100 msgr2=0x5613eedd9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:33.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.488+0000 7f8844ff9640 0 client.6108 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:33.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886ec16740 1 -- 172.21.15.172:0/2820428 shutdown_connections 2024-04-25T08:45:33.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886ec16740 1 -- 172.21.15.172:0/2820428 wait complete. 2024-04-25T08:45:33.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886ec16740 20 client.6108 trim_cache size 0 max 16384 2024-04-25T08:45:33.486 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:45:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "0da3b812-6ef3-4e98-9eef-c83975436523", 2024-04-25T08:45:33.487 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:45:33.487 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 -- 172.21.15.172:0/2024403510 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884806b4d0 msgr2=0x7f884806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884806b4d0 0x7f884806d990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8854037000 tx=0x7f885403d040 comp rx=0 tx=0).stop 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 -- 172.21.15.172:0/2024403510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88640cc4f0 msgr2=0x7f88641401d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88640cc4f0 0x7f88641401d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f886000efc0 tx=0x7f886000c490 comp rx=0 tx=0).stop 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 -- 172.21.15.172:0/2024403510 shutdown_connections 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f884806b4d0 0x7f884806d990 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88640cdb20 0x7f88641536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f886415b270 0x7f8864153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 --2- 172.21.15.172:0/2024403510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88640cc4f0 0x7f88641401d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 -- 172.21.15.172:0/2024403510 >> 172.21.15.172:0/2024403510 conn(0x7f886406abe0 msgr2=0x7f886406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 -- 172.21.15.172:0/2024403510 shutdown_connections 2024-04-25T08:45:33.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.489+0000 7f886be41640 1 -- 172.21.15.172:0/2024403510 wait complete. 2024-04-25T08:45:33.491 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '0da3b812-6ef3-4e98-9eef-c83975436523', 'mode': 'asynchronous'}' 2024-04-25T08:45:33.491 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T08:45:33.492 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-04-25T08:45:33.492 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:33.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.599+0000 7ff2e8415640 1 Processor -- start 2024-04-25T08:45:33.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.599+0000 7ff2e8415640 1 -- start start 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e8415640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2e015dc00 0x7ff2e00c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e8415640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff2e00d1dd0 0x7ff2e00ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e8415640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e015dfe0 con 0x7ff2e00ceb20 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e8415640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00d00c0 con 0x7ff2e015dc00 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e8415640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00d03a0 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e61b1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2e015dc00 0x7ff2e00c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e61b1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2e015dc00 0x7ff2e00c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34312/0 (socket says 172.21.15.172:34312) 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e61b1640 1 -- 172.21.15.172:0/2723022441 learned_addr learned my addr 172.21.15.172:0/2723022441 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e69b2640 1 --2- 172.21.15.172:0/2723022441 >> v2:172.21.15.186:3300/0 conn(0x7ff2e00d1dd0 0x7ff2e00ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e61b1640 1 -- 172.21.15.172:0/2723022441 >> v2:172.21.15.186:3300/0 conn(0x7ff2e00d1dd0 msgr2=0x7ff2e00ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e61b1640 1 --2- 172.21.15.172:0/2723022441 >> v2:172.21.15.186:3300/0 conn(0x7ff2e00d1dd0 0x7ff2e00ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e61b1640 1 -- 172.21.15.172:0/2723022441 >> v1:172.21.15.172:6789/0 conn(0x7ff2e00ceb20 legacy=0x7ff2e00d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e61b1640 1 -- 172.21.15.172:0/2723022441 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00cc440 con 0x7ff2e015dc00 2024-04-25T08:45:33.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.600+0000 7ff2e51af640 1 -- 172.21.15.172:0/2723022441 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411193875 0 0) 0x7ff2d0001110 con 0x7ff2e00ceb20 2024-04-25T08:45:33.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.601+0000 7ff2e61b1640 1 --2- 172.21.15.172:0/2723022441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e015dc00 0x7ff2e00c6df0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00d2500 tx=0x7ff2dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6518ed437a9fcff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:33.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.601+0000 7ff2e51af640 1 -- 172.21.15.172:0/2723022441 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc037070 con 0x7ff2e015dc00 2024-04-25T08:45:33.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.601+0000 7ff2e51af640 1 -- 172.21.15.172:0/2723022441 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc032440 con 0x7ff2e015dc00 2024-04-25T08:45:33.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.601+0000 7ff2e51af640 1 -- 172.21.15.172:0/2723022441 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc032810 con 0x7ff2e015dc00 2024-04-25T08:45:33.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.601+0000 7ff2e8415640 1 -- 172.21.15.172:0/2723022441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e015dc00 msgr2=0x7ff2e00c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.601+0000 7ff2e8415640 1 --2- 172.21.15.172:0/2723022441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e015dc00 0x7ff2e00c6df0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00d2500 tx=0x7ff2dc02a270 comp rx=0 tx=0).stop 2024-04-25T08:45:33.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.602+0000 7ff2e8415640 1 -- 172.21.15.172:0/2723022441 shutdown_connections 2024-04-25T08:45:33.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.602+0000 7ff2e8415640 1 --2- 172.21.15.172:0/2723022441 >> v2:172.21.15.186:3300/0 conn(0x7ff2e00d1dd0 0x7ff2e00ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.602+0000 7ff2e8415640 1 --2- 172.21.15.172:0/2723022441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e015dc00 0x7ff2e00c6df0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.602+0000 7ff2e8415640 1 -- 172.21.15.172:0/2723022441 >> 172.21.15.172:0/2723022441 conn(0x7ff2e006f5d0 msgr2=0x7ff2e006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:33.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.602+0000 7ff2e8415640 1 -- 172.21.15.172:0/2723022441 shutdown_connections 2024-04-25T08:45:33.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.602+0000 7ff2e8415640 1 -- 172.21.15.172:0/2723022441 wait complete. 2024-04-25T08:45:33.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.603+0000 7ff2e8415640 1 Processor -- start 2024-04-25T08:45:33.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.603+0000 7ff2e8415640 1 -- start start 2024-04-25T08:45:33.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.603+0000 7ff2e8415640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2e00ceb20 0x7ff2e014f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.603+0000 7ff2e8415640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e00d1dd0 0x7ff2e00b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.603+0000 7ff2e8415640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e015dc00 0x7ff2e015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.603+0000 7ff2e8415640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00cfd90 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.603+0000 7ff2e8415640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00cc130 con 0x7ff2e015dc00 2024-04-25T08:45:33.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.603+0000 7ff2e8415640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00cdd70 con 0x7ff2e00ceb20 2024-04-25T08:45:33.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.603+0000 7ff2e59b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e00d1dd0 0x7ff2e00b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e69b2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e015dc00 0x7ff2e015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e59b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e00d1dd0 0x7ff2e00b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34314/0 (socket says 172.21.15.172:34314) 2024-04-25T08:45:33.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e59b0640 1 -- 172.21.15.172:0/3407785123 learned_addr learned my addr 172.21.15.172:0/3407785123 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e61b1640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2e00ceb20 0x7ff2e014f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e59b0640 1 -- 172.21.15.172:0/3407785123 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2e00ceb20 msgr2=0x7ff2e014f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e59b0640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2e00ceb20 0x7ff2e014f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e59b0640 1 -- 172.21.15.172:0/3407785123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e015dc00 msgr2=0x7ff2e015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e59b0640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e015dc00 0x7ff2e015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e59b0640 1 -- 172.21.15.172:0/3407785123 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00b5a70 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e59b0640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e00d1dd0 0x7ff2e00b5530 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000c750 tx=0x7ff2d000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2d6ffd640 1 -- 172.21.15.172:0/3407785123 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0017070 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2d6ffd640 1 -- 172.21.15.172:0/3407785123 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d00052b0 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e8415640 1 -- 172.21.15.172:0/3407785123 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e00b5d10 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2d6ffd640 1 -- 172.21.15.172:0/3407785123 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000a880 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.604+0000 7ff2e8415640 1 -- 172.21.15.172:0/3407785123 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e00b62d0 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.605+0000 7ff2e8415640 1 -- 172.21.15.172:0/3407785123 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e0073990 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.606+0000 7ff2d6ffd640 1 -- 172.21.15.172:0/3407785123 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff2d001a070 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.606+0000 7ff2d6ffd640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c406b4d0 0x7ff2c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:33.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.606+0000 7ff2e61b1640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c406b4d0 0x7ff2c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:33.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.606+0000 7ff2d6ffd640 1 -- 172.21.15.172:0/3407785123 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff2d0089570 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.607+0000 7ff2e61b1640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c406b4d0 0x7ff2c406d990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc034000 tx=0x7ff2dc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:33.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.610+0000 7ff2d6ffd640 1 -- 172.21.15.172:0/3407785123 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff2e015dfe0 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.818+0000 7ff2e8415640 1 -- 172.21.15.172:0/3407785123 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2e00b0e20 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.818+0000 7ff2d6ffd640 1 -- 172.21.15.172:0/3407785123 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7ff2d0007d30 con 0x7ff2e00d1dd0 2024-04-25T08:45:33.810 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:33.810 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:20.588374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:33.810 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 23 2024-04-25T08:45:33.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 -- 172.21.15.172:0/3407785123 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c406b4d0 msgr2=0x7ff2c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c406b4d0 0x7ff2c406d990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc034000 tx=0x7ff2dc02e000 comp rx=0 tx=0).stop 2024-04-25T08:45:33.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 -- 172.21.15.172:0/3407785123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e00d1dd0 msgr2=0x7ff2e00b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:33.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e00d1dd0 0x7ff2e00b5530 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000c750 tx=0x7ff2d000cc10 comp rx=0 tx=0).stop 2024-04-25T08:45:33.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 -- 172.21.15.172:0/3407785123 shutdown_connections 2024-04-25T08:45:33.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c406b4d0 0x7ff2c406d990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e015dc00 0x7ff2e015c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e00d1dd0 0x7ff2e00b5530 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 --2- 172.21.15.172:0/3407785123 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2e00ceb20 0x7ff2e014f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:33.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 -- 172.21.15.172:0/3407785123 >> 172.21.15.172:0/3407785123 conn(0x7ff2e006f5d0 msgr2=0x7ff2e00b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:33.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 -- 172.21.15.172:0/3407785123 shutdown_connections 2024-04-25T08:45:33.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:33.820+0000 7ff2e8415640 1 -- 172.21.15.172:0/3407785123 wait complete. 2024-04-25T08:45:33.823 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T08:45:33.929 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:33.929 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": 0 2024-04-25T08:45:33.929 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:33.937 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:45:33.938 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-04-25T08:45:33.938 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:33.938 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T08:45:34.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.047+0000 7f05e9e07640 1 Processor -- start 2024-04-25T08:45:34.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.047+0000 7f05e9e07640 1 -- start start 2024-04-25T08:45:34.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.048+0000 7f05e9e07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e415dc20 0x7f05e40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.048+0000 7f05e9e07640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e406cda0 con 0x7f05e40d32f0 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.048+0000 7f05e9e07640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e415e000 con 0x7f05e4161710 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.048+0000 7f05e9e07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e40d1de0 con 0x7f05e415dc20 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.048+0000 7f05e3fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f05e40d32f0 0x7f05e406c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49664/0 (socket says 172.21.15.172:49664) 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.048+0000 7f05e3fff640 1 -- 172.21.15.172:0/3468199952 learned_addr learned my addr 172.21.15.172:0/3468199952 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.049+0000 7f05e37fe640 1 --2- 172.21.15.172:0/3468199952 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e415dc20 0x7f05e40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.049+0000 7f05e27fc640 1 -- 172.21.15.172:0/3468199952 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727778686 0 0) 0x7f05e406cda0 con 0x7f05e40d32f0 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.049+0000 7f05e27fc640 1 -- 172.21.15.172:0/3468199952 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05cc003520 con 0x7f05e40d32f0 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.049+0000 7f05e27fc640 1 -- 172.21.15.172:0/3468199952 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365162840 0 0) 0x7f05e415e000 con 0x7f05e4161710 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.049+0000 7f05e27fc640 1 -- 172.21.15.172:0/3468199952 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e406cda0 con 0x7f05e4161710 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.049+0000 7f05e27fc640 1 -- 172.21.15.172:0/3468199952 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924458740 0 0) 0x7f05cc003520 con 0x7f05e40d32f0 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.049+0000 7f05e37fe640 1 -- 172.21.15.172:0/3468199952 >> v1:172.21.15.186:6789/0 conn(0x7f05e4161710 legacy=0x7f05e406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.049+0000 7f05e37fe640 1 -- 172.21.15.172:0/3468199952 >> v1:172.21.15.172:6789/0 conn(0x7f05e40d32f0 legacy=0x7f05e406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.049+0000 7f05e37fe640 1 -- 172.21.15.172:0/3468199952 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e4161c60 con 0x7f05e415dc20 2024-04-25T08:45:34.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e37fe640 1 --2- 172.21.15.172:0/3468199952 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e415dc20 0x7f05e40ce670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05d40097d0 tx=0x7f05d402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=731d6a2f53d8be8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e27fc640 1 -- 172.21.15.172:0/3468199952 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4037070 con 0x7f05e415dc20 2024-04-25T08:45:34.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e27fc640 1 -- 172.21.15.172:0/3468199952 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d402ac30 con 0x7f05e415dc20 2024-04-25T08:45:34.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e27fc640 1 -- 172.21.15.172:0/3468199952 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0019f0 con 0x7f05e415dc20 2024-04-25T08:45:34.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e9e07640 1 -- 172.21.15.172:0/3468199952 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e415dc20 msgr2=0x7f05e40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e9e07640 1 --2- 172.21.15.172:0/3468199952 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e415dc20 0x7f05e40ce670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05d40097d0 tx=0x7f05d402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e9e07640 1 -- 172.21.15.172:0/3468199952 shutdown_connections 2024-04-25T08:45:34.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e9e07640 1 --2- 172.21.15.172:0/3468199952 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e415dc20 0x7f05e40ce670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e9e07640 1 -- 172.21.15.172:0/3468199952 >> 172.21.15.172:0/3468199952 conn(0x7f05e40d0420 msgr2=0x7f05e40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e9e07640 1 -- 172.21.15.172:0/3468199952 shutdown_connections 2024-04-25T08:45:34.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.050+0000 7f05e9e07640 1 -- 172.21.15.172:0/3468199952 wait complete. 2024-04-25T08:45:34.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.051+0000 7f05e9e07640 1 Processor -- start 2024-04-25T08:45:34.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.052+0000 7f05e9e07640 1 -- start start 2024-04-25T08:45:34.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.052+0000 7f05e9e07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e40d32f0 0x7f05e415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.052+0000 7f05e9e07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e415dc20 0x7f05e40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.052+0000 7f05e9e07640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4161710 0x7f05e40ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.052+0000 7f05e9e07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4162500 con 0x7f05e415dc20 2024-04-25T08:45:34.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.052+0000 7f05e9e07640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4162220 con 0x7f05e4161710 2024-04-25T08:45:34.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.052+0000 7f05e9e07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e40b5e50 con 0x7f05e40d32f0 2024-04-25T08:45:34.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.052+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e415dc20 0x7f05e40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.052+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e415dc20 0x7f05e40ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34326/0 (socket says 172.21.15.172:34326) 2024-04-25T08:45:34.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.052+0000 7f05e2ffd640 1 -- 172.21.15.172:0/2128736045 learned_addr learned my addr 172.21.15.172:0/2128736045 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05e3fff640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4161710 0x7f05e40ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05e37fe640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e40d32f0 0x7f05e415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05e2ffd640 1 -- 172.21.15.172:0/2128736045 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e40d32f0 msgr2=0x7f05e415cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e40d32f0 0x7f05e415cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05e2ffd640 1 -- 172.21.15.172:0/2128736045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4161710 msgr2=0x7f05e40ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4161710 0x7f05e40ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05e2ffd640 1 -- 172.21.15.172:0/2128736045 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e40ad490 con 0x7f05e415dc20 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e415dc20 0x7f05e40ce340 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c490 tx=0x7f05d800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05cbfff640 1 -- 172.21.15.172:0/2128736045 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80052d0 con 0x7f05e415dc20 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05cbfff640 1 -- 172.21.15.172:0/2128736045 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d8005470 con 0x7f05e415dc20 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05e9e07640 1 -- 172.21.15.172:0/2128736045 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e415f3a0 con 0x7f05e415dc20 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05cbfff640 1 -- 172.21.15.172:0/2128736045 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8012850 con 0x7f05e415dc20 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.053+0000 7f05e9e07640 1 -- 172.21.15.172:0/2128736045 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e415f960 con 0x7f05e415dc20 2024-04-25T08:45:34.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.054+0000 7f05cbfff640 1 -- 172.21.15.172:0/2128736045 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05d80129f0 con 0x7f05e415dc20 2024-04-25T08:45:34.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.055+0000 7f05cbfff640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05d006b4d0 0x7f05d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.055+0000 7f05cbfff640 1 -- 172.21.15.172:0/2128736045 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f05d8089e40 con 0x7f05e415dc20 2024-04-25T08:45:34.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.055+0000 7f05e37fe640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05d006b4d0 0x7f05d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.055+0000 7f05e37fe640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05d006b4d0 0x7f05d006d990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f05d4034000 tx=0x7f05d402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.056+0000 7f05ecbe7740 1 Processor -- start 2024-04-25T08:45:34.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.056+0000 7f05ecbe7740 1 -- start start 2024-04-25T08:45:34.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebd391b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd3b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd38590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ebc57e60 con 0x5614ebcf5130 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ebc01120 con 0x5614ebd1baf0 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ebc53f00 con 0x5614ebd3af60 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd3b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd3b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34340/0 (socket says 172.21.15.172:34340) 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05e2ffd640 1 -- 172.21.15.172:0/3061788623 learned_addr learned my addr 172.21.15.172:0/3061788623 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05e37fe640 1 --2- 172.21.15.172:0/3061788623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebd391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05e3fff640 1 --2- 172.21.15.172:0/3061788623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd38590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05e2ffd640 1 -- 172.21.15.172:0/3061788623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 msgr2=0x5614ebd391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/3061788623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebd391b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05e2ffd640 1 -- 172.21.15.172:0/3061788623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 msgr2=0x5614ebd38590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/3061788623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd38590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.057+0000 7f05e2ffd640 1 -- 172.21.15.172:0/3061788623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614eba38f00 con 0x5614ebcf5130 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.058+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/3061788623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd3b340 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f05d80881e0 tx=0x7f05d805c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf1cbac6f1fdc55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.058+0000 7f05c97fa640 1 -- 172.21.15.172:0/3061788623 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8056870 con 0x5614ebcf5130 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.058+0000 7f05c97fa640 1 -- 172.21.15.172:0/3061788623 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d8012ce0 con 0x5614ebcf5130 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.058+0000 7f05c97fa640 1 -- 172.21.15.172:0/3061788623 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d805c160 con 0x5614ebcf5130 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.058+0000 7f05ecbe7740 1 -- 172.21.15.172:0/3061788623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 msgr2=0x5614ebd3b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.058+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/3061788623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd3b340 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f05d80881e0 tx=0x7f05d805c610 comp rx=0 tx=0).stop 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.059+0000 7f05ecbe7740 1 -- 172.21.15.172:0/3061788623 shutdown_connections 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.059+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/3061788623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd38590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.059+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/3061788623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd3b340 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.059+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/3061788623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebd391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.059+0000 7f05ecbe7740 1 -- 172.21.15.172:0/3061788623 >> 172.21.15.172:0/3061788623 conn(0x5614ebcbbf70 msgr2=0x5614ebcf2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.059+0000 7f05ecbe7740 1 -- 172.21.15.172:0/3061788623 shutdown_connections 2024-04-25T08:45:34.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.059+0000 7f05ecbe7740 1 -- 172.21.15.172:0/3061788623 wait complete. 2024-04-25T08:45:34.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.059+0000 7f05ecbe7740 1 -- start start 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.059+0000 7f05ecbe7740 1 Processor -- start 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd31560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebcf3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebcf4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ebd3a760 con 0x5614ebcf5130 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ebbf6cd0 con 0x5614ebd1baf0 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ebd3a480 con 0x5614ebd3af60 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05ecbe7740 10 client.0 _ll_register_callbacks cb 0x5614eb96c2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd31560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd31560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34352/0 (socket says 172.21.15.172:34352) 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e37fe640 1 -- 172.21.15.172:0/1472668852 learned_addr learned my addr 172.21.15.172:0/1472668852 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e3fff640 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebcf4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebcf3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e37fe640 1 -- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 msgr2=0x5614ebcf4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e37fe640 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebcf4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e37fe640 1 -- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 msgr2=0x5614ebcf3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e37fe640 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebcf3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e37fe640 1 -- 172.21.15.172:0/1472668852 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614eb92c7f0 con 0x5614ebcf5130 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05e37fe640 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd31560 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f05d402a790 tx=0x7f05d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27059bbe2651ea3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.060+0000 7f05c27fc640 1 -- 172.21.15.172:0/1472668852 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4037040 con 0x5614ebcf5130 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05c27fc640 1 -- 172.21.15.172:0/1472668852 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f05d4053c70 con 0x5614ebcf5130 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1472668852 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05d8012ce0 con 0x5614ebcf5130 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05c27fc640 1 -- 172.21.15.172:0/1472668852 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05d4032e60 con 0x5614ebcf5130 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05ecbe7740 10 client.6129 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1472668852 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5614eba99690 con 0x5614ebcf5130 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05c27fc640 1 -- 172.21.15.172:0/1472668852 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d8012ce0 con 0x5614ebcf5130 2024-04-25T08:45:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05c27fc640 1 -- 172.21.15.172:0/1472668852 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f05d405a050 con 0x5614ebcf5130 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05ecbe7740 10 client.6129 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05ecbe7740 10 client.6129 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05ecbe7740 20 client.6129 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5614ebd49c20 0x5614ebd4a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05ecbe7740 4 client.6129 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1472668852 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614ebc653a0 con 0x5614ebd49c20 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.061+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5614ebd49c20 0x5614ebd4a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5614ebd49c20 0x5614ebd4a020 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0787989c907d429 server_cookie=a764b6f56cbf3c5c in_seq=0 out_seq=0 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05c27fc640 10 client.6129 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05c27fc640 1 -- 172.21.15.172:0/1472668852 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5614ebc653a0 con 0x5614ebd49c20 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05c27fc640 10 client.6129 handle_command_reply: tid=0 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 client.6129 shutdown 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1472668852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 msgr2=0x5614ebd31560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd31560 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f05d402a790 tx=0x7f05d4004730 comp rx=0 tx=0).stop 2024-04-25T08:45:34.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1472668852 shutdown_connections 2024-04-25T08:45:34.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebcf3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5614ebd49c20 0x5614ebd4a020 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebcf4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/1472668852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebd31560 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05c27fc640 0 client.6129 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:34.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1472668852 >> 172.21.15.172:0/1472668852 conn(0x5614ebcbbf70 msgr2=0x5614ebd1bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1472668852 shutdown_connections 2024-04-25T08:45:34.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1472668852 wait complete. 2024-04-25T08:45:34.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.062+0000 7f05ecbe7740 20 client.6129 trim_cache size 0 max 16384 2024-04-25T08:45:34.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.077+0000 7f05ecbe7740 1 Processor -- start 2024-04-25T08:45:34.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.077+0000 7f05ecbe7740 1 -- start start 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.078+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebcf3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.078+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd3b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.078+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebd219f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.078+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4200320 con 0x5614ebcf5130 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.078+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e41ff520 con 0x5614ebd1baf0 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.078+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4067180 con 0x5614ebd3af60 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.078+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebcf3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.078+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebcf3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34356/0 (socket says 172.21.15.172:34356) 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.078+0000 7f05e37fe640 1 -- 172.21.15.172:0/1957392996 learned_addr learned my addr 172.21.15.172:0/1957392996 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05e37fe640 1 -- 172.21.15.172:0/1957392996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 msgr2=0x5614ebd219f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05e37fe640 1 --2- 172.21.15.172:0/1957392996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebd219f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05e37fe640 1 -- 172.21.15.172:0/1957392996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 msgr2=0x5614ebd3b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05e37fe640 1 --2- 172.21.15.172:0/1957392996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd3b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05e37fe640 1 -- 172.21.15.172:0/1957392996 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614eb9058b0 con 0x5614ebcf5130 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05e37fe640 1 --2- 172.21.15.172:0/1957392996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebcf3540 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f05d403f040 tx=0x7f05d404b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4062d638b0321e79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05c8ff9640 1 -- 172.21.15.172:0/1957392996 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4037070 con 0x5614ebcf5130 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05c8ff9640 1 -- 172.21.15.172:0/1957392996 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d4061070 con 0x5614ebcf5130 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05c8ff9640 1 -- 172.21.15.172:0/1957392996 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4052810 con 0x5614ebcf5130 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1957392996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 msgr2=0x5614ebcf3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.079+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/1957392996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebcf3540 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f05d403f040 tx=0x7f05d404b070 comp rx=0 tx=0).stop 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.080+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1957392996 shutdown_connections 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.080+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/1957392996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd3b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.080+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/1957392996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebd3af60 0x5614ebd219f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.080+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/1957392996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebcf5130 0x5614ebcf3540 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.080+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1957392996 >> 172.21.15.172:0/1957392996 conn(0x5614ebcbbf70 msgr2=0x5614ebcf0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.080+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1957392996 shutdown_connections 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.080+0000 7f05ecbe7740 1 -- 172.21.15.172:0/1957392996 wait complete. 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.080+0000 7f05ecbe7740 1 -- start start 2024-04-25T08:45:34.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.080+0000 7f05ecbe7740 1 Processor -- start 2024-04-25T08:45:34.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebcf5130 0x5614ebda5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd52f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05ecbe7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebd3af60 0x5614ebd534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614ebd1a210 con 0x5614ebd3af60 2024-04-25T08:45:34.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4067780 con 0x5614ebd1baf0 2024-04-25T08:45:34.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05ecbe7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614ebd338c0 con 0x5614ebcf5130 2024-04-25T08:45:34.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05ecbe7740 10 client.0 _ll_register_callbacks cb 0x7f05d8058340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:34.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebd3af60 0x5614ebd534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebd3af60 0x5614ebd534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34358/0 (socket says 172.21.15.172:34358) 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e3fff640 1 -- 172.21.15.172:0/152045184 learned_addr learned my addr 172.21.15.172:0/152045184 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e37fe640 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebcf5130 0x5614ebda5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd52f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e3fff640 1 -- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebcf5130 msgr2=0x5614ebda5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e3fff640 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebcf5130 0x5614ebda5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e3fff640 1 -- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 msgr2=0x5614ebd52f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e3fff640 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd52f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e3fff640 1 -- 172.21.15.172:0/152045184 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614ebd0cef0 con 0x5614ebd3af60 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e2ffd640 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd52f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05e3fff640 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebd3af60 0x5614ebd534b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f05dc001560 tx=0x7f05dc007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c088c12da4f4aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.081+0000 7f05c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05c27fc640 1 -- 172.21.15.172:0/152045184 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc014d20 con 0x5614ebd3af60 2024-04-25T08:45:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05c27fc640 1 -- 172.21.15.172:0/152045184 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f05dc016420 con 0x5614ebd3af60 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05ecbe7740 1 -- 172.21.15.172:0/152045184 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05d4061070 con 0x5614ebd3af60 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05c27fc640 1 -- 172.21.15.172:0/152045184 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05dc026050 con 0x5614ebd3af60 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05ecbe7740 10 client.6135 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05ecbe7740 1 -- 172.21.15.172:0/152045184 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5614ebd0d4c0 con 0x5614ebd3af60 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05c27fc640 1 -- 172.21.15.172:0/152045184 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d4061070 con 0x5614ebd3af60 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05c27fc640 1 -- 172.21.15.172:0/152045184 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f05dc029020 con 0x5614ebd3af60 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05ecbe7740 10 client.6135 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05ecbe7740 10 client.6135 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05ecbe7740 20 client.6135 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5614ebd1de70 0x5614ebd1e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05ecbe7740 4 client.6135 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05ecbe7740 1 -- 172.21.15.172:0/152045184 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x5614ebc5f6f0 con 0x5614ebd1de70 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.082+0000 7f05e37fe640 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5614ebd1de70 0x5614ebd1e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05e37fe640 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5614ebd1de70 0x5614ebd1e250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=311d403eaa55433e server_cookie=2a24f8c119fb5951 in_seq=0 out_seq=0 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05c27fc640 10 client.6135 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05c27fc640 1 -- 172.21.15.172:0/152045184 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5614ebc5f6f0 con 0x5614ebd1de70 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05c27fc640 10 client.6135 handle_command_reply: tid=0 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 client.6135 shutdown 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 -- 172.21.15.172:0/152045184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebd3af60 msgr2=0x5614ebd534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebd3af60 0x5614ebd534b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f05dc001560 tx=0x7f05dc007bf0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 -- 172.21.15.172:0/152045184 shutdown_connections 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614ebd1baf0 0x5614ebd52f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5614ebd1de70 0x5614ebd1e250 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5614ebd3af60 0x5614ebd534b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 --2- 172.21.15.172:0/152045184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5614ebcf5130 0x5614ebda5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05c27fc640 0 client.6135 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 -- 172.21.15.172:0/152045184 >> 172.21.15.172:0/152045184 conn(0x5614ebcbbf70 msgr2=0x5614ebcf3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 -- 172.21.15.172:0/152045184 shutdown_connections 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 1 -- 172.21.15.172:0/152045184 wait complete. 2024-04-25T08:45:34.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.083+0000 7f05ecbe7740 20 client.6135 trim_cache size 0 max 16384 2024-04-25T08:45:34.081 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:34.081 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:45:34.081 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "e76e497a-4d52-45b1-be2a-d2c761cbf0ed", 2024-04-25T08:45:34.081 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:45:34.081 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:34.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 -- 172.21.15.172:0/2128736045 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05d006b4d0 msgr2=0x7f05d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05d006b4d0 0x7f05d006d990 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f05d4034000 tx=0x7f05d402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:34.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 -- 172.21.15.172:0/2128736045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e415dc20 msgr2=0x7f05e40ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e415dc20 0x7f05e40ce340 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c490 tx=0x7f05d800c950 comp rx=0 tx=0).stop 2024-04-25T08:45:34.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 -- 172.21.15.172:0/2128736045 shutdown_connections 2024-04-25T08:45:34.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f05d006b4d0 0x7f05d006d990 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05e4161710 0x7f05e40ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05e415dc20 0x7f05e40ce340 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 --2- 172.21.15.172:0/2128736045 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05e40d32f0 0x7f05e415cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 -- 172.21.15.172:0/2128736045 >> 172.21.15.172:0/2128736045 conn(0x7f05e40d0420 msgr2=0x7f05e40b8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 -- 172.21.15.172:0/2128736045 shutdown_connections 2024-04-25T08:45:34.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.084+0000 7f05e9e07640 1 -- 172.21.15.172:0/2128736045 wait complete. 2024-04-25T08:45:34.086 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': 'e76e497a-4d52-45b1-be2a-d2c761cbf0ed', 'mode': 'asynchronous'}' 2024-04-25T08:45:34.086 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-04-25T08:45:34.086 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-04-25T08:45:34.086 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:34.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.192+0000 7fe09d25d640 1 Processor -- start 2024-04-25T08:45:34.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.192+0000 7fe09d25d640 1 -- start start 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe09d25d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe0980cfec0 0x7fe0980cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe09d25d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980ce3c0 0x7fe09806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe09d25d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe098071480 con 0x7fe098154ee0 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe09d25d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0980ce830 con 0x7fe0980cfec0 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe09d25d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe098072090 con 0x7fe0980ce3c0 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe09659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe0980cfec0 0x7fe0980cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe096d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe098154ee0 0x7fe0980cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49678/0 (socket says 172.21.15.172:49678) 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe096d9d640 1 -- 172.21.15.172:0/3066165739 learned_addr learned my addr 172.21.15.172:0/3066165739 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe09759e640 1 --2- 172.21.15.172:0/3066165739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980ce3c0 0x7fe09806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe09659c640 1 -- 172.21.15.172:0/3066165739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980ce3c0 msgr2=0x7fe09806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe09659c640 1 --2- 172.21.15.172:0/3066165739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980ce3c0 0x7fe09806d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe09659c640 1 -- 172.21.15.172:0/3066165739 >> v1:172.21.15.172:6789/0 conn(0x7fe098154ee0 legacy=0x7fe0980cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.194+0000 7fe09659c640 1 -- 172.21.15.172:0/3066165739 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098071760 con 0x7fe0980cfec0 2024-04-25T08:45:34.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.193+0000 7fe095d9b640 1 -- 172.21.15.172:0/3066165739 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266563347 0 0) 0x7fe098071480 con 0x7fe098154ee0 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.194+0000 7fe09659c640 1 --2- 172.21.15.172:0/3066165739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980cfec0 0x7fe0980cde80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0097a0 tx=0x7fe08c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fdfc9a1daf3258 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.194+0000 7fe095d9b640 1 -- 172.21.15.172:0/3066165739 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c037070 con 0x7fe0980cfec0 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.194+0000 7fe095d9b640 1 -- 172.21.15.172:0/3066165739 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c032440 con 0x7fe0980cfec0 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.194+0000 7fe095d9b640 1 -- 172.21.15.172:0/3066165739 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c032810 con 0x7fe0980cfec0 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.195+0000 7fe09d25d640 1 -- 172.21.15.172:0/3066165739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980cfec0 msgr2=0x7fe0980cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.195+0000 7fe09d25d640 1 --2- 172.21.15.172:0/3066165739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980cfec0 0x7fe0980cde80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0097a0 tx=0x7fe08c02a180 comp rx=0 tx=0).stop 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.195+0000 7fe09d25d640 1 -- 172.21.15.172:0/3066165739 shutdown_connections 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.195+0000 7fe09d25d640 1 --2- 172.21.15.172:0/3066165739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980ce3c0 0x7fe09806d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.195+0000 7fe09d25d640 1 --2- 172.21.15.172:0/3066165739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980cfec0 0x7fe0980cde80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.195+0000 7fe09d25d640 1 -- 172.21.15.172:0/3066165739 >> 172.21.15.172:0/3066165739 conn(0x7fe09806abe0 msgr2=0x7fe09806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.195+0000 7fe09d25d640 1 -- 172.21.15.172:0/3066165739 shutdown_connections 2024-04-25T08:45:34.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.195+0000 7fe09d25d640 1 -- 172.21.15.172:0/3066165739 wait complete. 2024-04-25T08:45:34.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.196+0000 7fe09d25d640 1 Processor -- start 2024-04-25T08:45:34.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.196+0000 7fe09d25d640 1 -- start start 2024-04-25T08:45:34.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe09d25d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980ce3c0 0x7fe09814a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe09d25d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980cfec0 0x7fe09806e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe09d25d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe098154ee0 0x7fe0981599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe09d25d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098071d20 con 0x7fe0980ce3c0 2024-04-25T08:45:34.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe09d25d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098071230 con 0x7fe098154ee0 2024-04-25T08:45:34.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe09d25d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0981552c0 con 0x7fe0980cfec0 2024-04-25T08:45:34.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe096d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980ce3c0 0x7fe09814a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe096d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980ce3c0 0x7fe09814a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34366/0 (socket says 172.21.15.172:34366) 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe096d9d640 1 -- 172.21.15.172:0/2213587508 learned_addr learned my addr 172.21.15.172:0/2213587508 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe09659c640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980cfec0 0x7fe09806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe09759e640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe098154ee0 0x7fe0981599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe096d9d640 1 -- 172.21.15.172:0/2213587508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980cfec0 msgr2=0x7fe09806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.197+0000 7fe096d9d640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980cfec0 0x7fe09806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe096d9d640 1 -- 172.21.15.172:0/2213587508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe098154ee0 msgr2=0x7fe0981599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe096d9d640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe098154ee0 0x7fe0981599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe096d9d640 1 -- 172.21.15.172:0/2213587508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980a84a0 con 0x7fe0980ce3c0 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe09659c640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980cfec0 0x7fe09806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe09759e640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe098154ee0 0x7fe0981599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe096d9d640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980ce3c0 0x7fe09814a1d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe08800c7c0 tx=0x7fe08800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe07f7fe640 1 -- 172.21.15.172:0/2213587508 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088018070 con 0x7fe0980ce3c0 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe07f7fe640 1 -- 172.21.15.172:0/2213587508 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08800a640 con 0x7fe0980ce3c0 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe07f7fe640 1 -- 172.21.15.172:0/2213587508 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08800aa30 con 0x7fe0980ce3c0 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe09d25d640 1 -- 172.21.15.172:0/2213587508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0980a8780 con 0x7fe0980ce3c0 2024-04-25T08:45:34.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.198+0000 7fe09d25d640 1 -- 172.21.15.172:0/2213587508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0980a8d40 con 0x7fe0980ce3c0 2024-04-25T08:45:34.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.199+0000 7fe09d25d640 1 -- 172.21.15.172:0/2213587508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe098073990 con 0x7fe0980ce3c0 2024-04-25T08:45:34.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.199+0000 7fe07f7fe640 1 -- 172.21.15.172:0/2213587508 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe08801b070 con 0x7fe0980ce3c0 2024-04-25T08:45:34.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.200+0000 7fe07f7fe640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe08406b500 0x7fe08406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.200+0000 7fe07f7fe640 1 -- 172.21.15.172:0/2213587508 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe088089930 con 0x7fe0980ce3c0 2024-04-25T08:45:34.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.200+0000 7fe09659c640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe08406b500 0x7fe08406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.200+0000 7fe09659c640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe08406b500 0x7fe08406d9c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe08c034000 tx=0x7fe08c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.204+0000 7fe07f7fe640 1 -- 172.21.15.172:0/2213587508 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe0880586b0 con 0x7fe0980ce3c0 2024-04-25T08:45:34.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.409+0000 7fe09d25d640 1 -- 172.21.15.172:0/2213587508 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe09806d360 con 0x7fe0980ce3c0 2024-04-25T08:45:34.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.409+0000 7fe07f7fe640 1 -- 172.21.15.172:0/2213587508 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fe088057fb0 con 0x7fe0980ce3c0 2024-04-25T08:45:34.401 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:34.401 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:20.588374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:34.402 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 23 2024-04-25T08:45:34.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.411+0000 7fe09d25d640 1 -- 172.21.15.172:0/2213587508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe08406b500 msgr2=0x7fe08406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.411+0000 7fe09d25d640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe08406b500 0x7fe08406d9c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe08c034000 tx=0x7fe08c02e000 comp rx=0 tx=0).stop 2024-04-25T08:45:34.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.411+0000 7fe09d25d640 1 -- 172.21.15.172:0/2213587508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980ce3c0 msgr2=0x7fe09814a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.411+0000 7fe09d25d640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980ce3c0 0x7fe09814a1d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe08800c7c0 tx=0x7fe08800cc80 comp rx=0 tx=0).stop 2024-04-25T08:45:34.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.411+0000 7fe09d25d640 1 -- 172.21.15.172:0/2213587508 shutdown_connections 2024-04-25T08:45:34.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.411+0000 7fe09d25d640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe08406b500 0x7fe08406d9c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.411+0000 7fe09d25d640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe098154ee0 0x7fe0981599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.411+0000 7fe09d25d640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe0980cfec0 0x7fe09806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.411+0000 7fe09d25d640 1 --2- 172.21.15.172:0/2213587508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0980ce3c0 0x7fe09814a1d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.411+0000 7fe09d25d640 1 -- 172.21.15.172:0/2213587508 >> 172.21.15.172:0/2213587508 conn(0x7fe09806abe0 msgr2=0x7fe0980b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.412+0000 7fe09d25d640 1 -- 172.21.15.172:0/2213587508 shutdown_connections 2024-04-25T08:45:34.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.412+0000 7fe09d25d640 1 -- 172.21.15.172:0/2213587508 wait complete. 2024-04-25T08:45:34.414 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path / 2024-04-25T08:45:34.520 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:34.520 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": 0 2024-04-25T08:45:34.520 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:34.531 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:45:34.531 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-04-25T08:45:34.531 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:34.531 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-04-25T08:45:34.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.640+0000 7f33c406b640 1 Processor -- start 2024-04-25T08:45:34.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.640+0000 7f33c406b640 1 -- start start 2024-04-25T08:45:34.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.641+0000 7f33c406b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 0x7f33bc0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.641+0000 7f33c406b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc06cda0 con 0x7f33bc0d32f0 2024-04-25T08:45:34.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.641+0000 7f33c406b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc15e000 con 0x7f33bc161710 2024-04-25T08:45:34.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.641+0000 7f33c406b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0d1de0 con 0x7f33bc15dc20 2024-04-25T08:45:34.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.641+0000 7f33c2608640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f33bc0d32f0 0x7f33bc06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49684/0 (socket says 172.21.15.172:49684) 2024-04-25T08:45:34.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.641+0000 7f33c2608640 1 -- 172.21.15.172:0/2466083223 learned_addr learned my addr 172.21.15.172:0/2466083223 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.642+0000 7f33c1e07640 1 --2- 172.21.15.172:0/2466083223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 0x7f33bc0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.642+0000 7f33c0e05640 1 -- 172.21.15.172:0/2466083223 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848604460 0 0) 0x7f33bc06cda0 con 0x7f33bc0d32f0 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.642+0000 7f33c0e05640 1 -- 172.21.15.172:0/2466083223 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a8003520 con 0x7f33bc0d32f0 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.642+0000 7f33c0e05640 1 -- 172.21.15.172:0/2466083223 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584036894 0 0) 0x7f33bc15e000 con 0x7f33bc161710 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.642+0000 7f33c0e05640 1 -- 172.21.15.172:0/2466083223 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33bc06cda0 con 0x7f33bc161710 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.642+0000 7f33c1e07640 1 -- 172.21.15.172:0/2466083223 >> v1:172.21.15.186:6789/0 conn(0x7f33bc161710 legacy=0x7f33bc06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.642+0000 7f33c1e07640 1 -- 172.21.15.172:0/2466083223 >> v1:172.21.15.172:6789/0 conn(0x7f33bc0d32f0 legacy=0x7f33bc06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.642+0000 7f33c0e05640 1 -- 172.21.15.172:0/2466083223 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 467583234 0 0) 0x7f33a8003520 con 0x7f33bc0d32f0 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.642+0000 7f33c1e07640 1 -- 172.21.15.172:0/2466083223 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc161c60 con 0x7f33bc15dc20 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c1e07640 1 --2- 172.21.15.172:0/2466083223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 0x7f33bc0ce670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009dc0 tx=0x7f33b802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19cc3585746b2534 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c0e05640 1 -- 172.21.15.172:0/2466083223 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4001670 con 0x7f33bc15dc20 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c0e05640 1 -- 172.21.15.172:0/2466083223 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8007540 con 0x7f33bc15dc20 2024-04-25T08:45:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c0e05640 1 -- 172.21.15.172:0/2466083223 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80078f0 con 0x7f33bc15dc20 2024-04-25T08:45:34.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c406b640 1 -- 172.21.15.172:0/2466083223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 msgr2=0x7f33bc0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c406b640 1 --2- 172.21.15.172:0/2466083223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 0x7f33bc0ce670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009dc0 tx=0x7f33b802a660 comp rx=0 tx=0).stop 2024-04-25T08:45:34.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c406b640 1 -- 172.21.15.172:0/2466083223 shutdown_connections 2024-04-25T08:45:34.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c406b640 1 --2- 172.21.15.172:0/2466083223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 0x7f33bc0ce670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c406b640 1 -- 172.21.15.172:0/2466083223 >> 172.21.15.172:0/2466083223 conn(0x7f33bc0d0420 msgr2=0x7f33bc0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c406b640 1 -- 172.21.15.172:0/2466083223 shutdown_connections 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.643+0000 7f33c406b640 1 -- 172.21.15.172:0/2466083223 wait complete. 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c406b640 1 Processor -- start 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c406b640 1 -- start start 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c406b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33bc0d32f0 0x7f33bc14c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c406b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 0x7f33bc0acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c406b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33bc161710 0x7f33bc0ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c406b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc162500 con 0x7f33bc0d32f0 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c406b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc162220 con 0x7f33bc161710 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c406b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0b5e50 con 0x7f33bc15dc20 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c1e07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33bc0d32f0 0x7f33bc14c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c1e07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33bc0d32f0 0x7f33bc14c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34374/0 (socket says 172.21.15.172:34374) 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c1e07640 1 -- 172.21.15.172:0/1495092001 learned_addr learned my addr 172.21.15.172:0/1495092001 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c1606640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 0x7f33bc0acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.645+0000 7f33c2608640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33bc161710 0x7f33bc0ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33c1e07640 1 -- 172.21.15.172:0/1495092001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 msgr2=0x7f33bc0acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33c1e07640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 0x7f33bc0acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33c1e07640 1 -- 172.21.15.172:0/1495092001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33bc161710 msgr2=0x7f33bc0ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33c1e07640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33bc161710 0x7f33bc0ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33c1e07640 1 -- 172.21.15.172:0/1495092001 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc160900 con 0x7f33bc0d32f0 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33c1606640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 0x7f33bc0acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33c1e07640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33bc0d32f0 0x7f33bc14c1e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009ee0 tx=0x7f33b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33b27fc640 1 -- 172.21.15.172:0/1495092001 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8040070 con 0x7f33bc0d32f0 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33b27fc640 1 -- 172.21.15.172:0/1495092001 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8031c40 con 0x7f33bc0d32f0 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33c406b640 1 -- 172.21.15.172:0/1495092001 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc14cb10 con 0x7f33bc0d32f0 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33b27fc640 1 -- 172.21.15.172:0/1495092001 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8009450 con 0x7f33bc0d32f0 2024-04-25T08:45:34.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.646+0000 7f33c406b640 1 -- 172.21.15.172:0/1495092001 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc15fc10 con 0x7f33bc0d32f0 2024-04-25T08:45:34.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.647+0000 7f33b27fc640 1 -- 172.21.15.172:0/1495092001 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f33b8039040 con 0x7f33bc0d32f0 2024-04-25T08:45:34.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.648+0000 7f33b27fc640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f33a006b500 0x7f33a006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.648+0000 7f33b27fc640 1 -- 172.21.15.172:0/1495092001 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f33b80aba40 con 0x7f33bc0d32f0 2024-04-25T08:45:34.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.648+0000 7f33c1606640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f33a006b500 0x7f33a006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.648+0000 7f33c1606640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f33a006b500 0x7f33a006d9c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0011e0 tx=0x7f33ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.649+0000 7f33c6d6e740 1 Processor -- start 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.649+0000 7f33c6d6e740 1 -- start start 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x5592199757f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199733c0 0x559219975d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559219945c40 0x559219949450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592198aea50 con 0x559219972fe0 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559219857d40 con 0x559219945c40 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592198aaaf0 con 0x5592199733c0 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c1e07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x5592199757f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c1e07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x5592199757f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34390/0 (socket says 172.21.15.172:34390) 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c1e07640 1 -- 172.21.15.172:0/2349409913 learned_addr learned my addr 172.21.15.172:0/2349409913 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c1e07640 1 -- 172.21.15.172:0/2349409913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199733c0 msgr2=0x559219975d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c1e07640 1 --2- 172.21.15.172:0/2349409913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199733c0 0x559219975d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c1e07640 1 -- 172.21.15.172:0/2349409913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559219945c40 msgr2=0x559219949450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c1e07640 1 --2- 172.21.15.172:0/2349409913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559219945c40 0x559219949450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c1e07640 1 -- 172.21.15.172:0/2349409913 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55921968f690 con 0x559219972fe0 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f33c1e07640 1 --2- 172.21.15.172:0/2349409913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x5592199757f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f33b8076520 tx=0x7f33b8043420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf07770e8a17e87a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f339f7fe640 1 -- 172.21.15.172:0/2349409913 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80a8070 con 0x559219972fe0 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f339f7fe640 1 -- 172.21.15.172:0/2349409913 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8091070 con 0x559219972fe0 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.650+0000 7f339f7fe640 1 -- 172.21.15.172:0/2349409913 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b807e210 con 0x559219972fe0 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.651+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2349409913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 msgr2=0x5592199757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.651+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/2349409913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x5592199757f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f33b8076520 tx=0x7f33b8043420 comp rx=0 tx=0).stop 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.651+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2349409913 shutdown_connections 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.651+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/2349409913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559219945c40 0x559219949450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.651+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/2349409913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199733c0 0x559219975d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.651+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/2349409913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x5592199757f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.651+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2349409913 >> 172.21.15.172:0/2349409913 conn(0x559219947eb0 msgr2=0x5592199907f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.651+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2349409913 shutdown_connections 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.651+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2349409913 wait complete. 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.652+0000 7f33c6d6e740 1 -- start start 2024-04-25T08:45:34.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.652+0000 7f33c6d6e740 1 Processor -- start 2024-04-25T08:45:34.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559219972fe0 0x559219992430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199733c0 0x559219944e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199766c0 0x559219976b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921994b060 con 0x5592199733c0 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921984d340 con 0x5592199766c0 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55921994b340 con 0x559219972fe0 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c6d6e740 10 client.0 _ll_register_callbacks cb 0x55921986acb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c1606640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199733c0 0x559219944e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c1606640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199733c0 0x559219944e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34392/0 (socket says 172.21.15.172:34392) 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c1606640 1 -- 172.21.15.172:0/4276354476 learned_addr learned my addr 172.21.15.172:0/4276354476 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c1e07640 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559219972fe0 0x559219992430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c2608640 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199766c0 0x559219976b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c1606640 1 -- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559219972fe0 msgr2=0x559219992430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c1606640 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559219972fe0 0x559219992430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c1606640 1 -- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199766c0 msgr2=0x559219976b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c1606640 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199766c0 0x559219976b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c1606640 1 -- 172.21.15.172:0/4276354476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592196efe20 con 0x5592199733c0 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c2608640 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199766c0 0x559219976b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c1606640 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199733c0 0x559219944e60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f33ac001d90 tx=0x7f33ac00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a9bcc526acbf4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f339cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f339cff9640 1 -- 172.21.15.172:0/4276354476 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac003af0 con 0x5592199733c0 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f339cff9640 1 -- 172.21.15.172:0/4276354476 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f33ac003c90 con 0x5592199733c0 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c6d6e740 1 -- 172.21.15.172:0/4276354476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33b8091070 con 0x5592199733c0 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f339cff9640 1 -- 172.21.15.172:0/4276354476 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33ac013420 con 0x5592199733c0 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c6d6e740 10 client.6156 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.653+0000 7f33c6d6e740 1 -- 172.21.15.172:0/4276354476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x559219582f80 con 0x5592199733c0 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f339cff9640 1 -- 172.21.15.172:0/4276354476 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8091070 con 0x5592199733c0 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f339cff9640 1 -- 172.21.15.172:0/4276354476 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f33ac0135c0 con 0x5592199733c0 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f33c6d6e740 10 client.6156 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f33c6d6e740 10 client.6156 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f33c6d6e740 20 client.6156 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5592199a1090 0x559219969bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f33c6d6e740 4 client.6156 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:34.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f33c6d6e740 1 -- 172.21.15.172:0/4276354476 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592198bbf90 con 0x5592199a1090 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f33c1e07640 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5592199a1090 0x559219969bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f339cff9640 10 client.6156 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.654+0000 7f33c1e07640 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5592199a1090 0x559219969bd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=618111be3b65072e server_cookie=82ff68c41072e692 in_seq=0 out_seq=0 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f339cff9640 1 -- 172.21.15.172:0/4276354476 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5592198bbf90 con 0x5592199a1090 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f339cff9640 10 client.6156 handle_command_reply: tid=0 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 client.6156 shutdown 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 -- 172.21.15.172:0/4276354476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199733c0 msgr2=0x559219944e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199733c0 0x559219944e60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f33ac001d90 tx=0x7f33ac00ebb0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 -- 172.21.15.172:0/4276354476 shutdown_connections 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199766c0 0x559219976b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5592199a1090 0x559219969bd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199733c0 0x559219944e60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/4276354476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559219972fe0 0x559219992430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f339cff9640 0 client.6156 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:34.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 -- 172.21.15.172:0/4276354476 >> 172.21.15.172:0/4276354476 conn(0x559219945c40 msgr2=0x55921994a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 -- 172.21.15.172:0/4276354476 shutdown_connections 2024-04-25T08:45:34.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 1 -- 172.21.15.172:0/4276354476 wait complete. 2024-04-25T08:45:34.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.655+0000 7f33c6d6e740 20 client.6156 trim_cache size 0 max 16384 2024-04-25T08:45:34.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.670+0000 7f33c6d6e740 1 Processor -- start 2024-04-25T08:45:34.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.670+0000 7f33c6d6e740 1 -- start start 2024-04-25T08:45:34.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559219972fe0 0x559219990090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199733c0 0x559219946eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199766c0 0x559219992860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559219994ed0 con 0x5592199766c0 2024-04-25T08:45:34.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc2003c0 con 0x559219972fe0 2024-04-25T08:45:34.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc1ff540 con 0x5592199733c0 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c2608640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199766c0 0x559219992860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c2608640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199766c0 0x559219992860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34404/0 (socket says 172.21.15.172:34404) 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c2608640 1 -- 172.21.15.172:0/792239432 learned_addr learned my addr 172.21.15.172:0/792239432 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c2608640 1 -- 172.21.15.172:0/792239432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199733c0 msgr2=0x559219946eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c2608640 1 --2- 172.21.15.172:0/792239432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199733c0 0x559219946eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c2608640 1 -- 172.21.15.172:0/792239432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559219972fe0 msgr2=0x559219990090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c2608640 1 --2- 172.21.15.172:0/792239432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559219972fe0 0x559219990090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c2608640 1 -- 172.21.15.172:0/792239432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559219979250 con 0x5592199766c0 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.671+0000 7f33c2608640 1 --2- 172.21.15.172:0/792239432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199766c0 0x559219992860 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f33b4001d80 tx=0x7f33b4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473e394def50ca39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f339effd640 1 -- 172.21.15.172:0/792239432 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b401a070 con 0x5592199766c0 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f339effd640 1 -- 172.21.15.172:0/792239432 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b40108e0 con 0x5592199766c0 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f339effd640 1 -- 172.21.15.172:0/792239432 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4010cd0 con 0x5592199766c0 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f33c6d6e740 1 -- 172.21.15.172:0/792239432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199766c0 msgr2=0x559219992860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/792239432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199766c0 0x559219992860 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f33b4001d80 tx=0x7f33b4001e70 comp rx=0 tx=0).stop 2024-04-25T08:45:34.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f33c6d6e740 1 -- 172.21.15.172:0/792239432 shutdown_connections 2024-04-25T08:45:34.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/792239432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592199766c0 0x559219992860 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/792239432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199733c0 0x559219946eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/792239432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559219972fe0 0x559219990090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f33c6d6e740 1 -- 172.21.15.172:0/792239432 >> 172.21.15.172:0/792239432 conn(0x559219945c40 msgr2=0x55921998d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f33c6d6e740 1 -- 172.21.15.172:0/792239432 shutdown_connections 2024-04-25T08:45:34.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.672+0000 7f33c6d6e740 1 -- 172.21.15.172:0/792239432 wait complete. 2024-04-25T08:45:34.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.673+0000 7f33c6d6e740 1 -- start start 2024-04-25T08:45:34.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.673+0000 7f33c6d6e740 1 Processor -- start 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x559219949310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199733c0 0x559219970f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c6d6e740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199766c0 0x5592199aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc1ff0a0 con 0x559219972fe0 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc14e2f0 con 0x5592199733c0 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c6d6e740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x559219992da0 con 0x5592199766c0 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c6d6e740 10 client.0 _ll_register_callbacks cb 0x7f33ac005300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c1e07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x559219949310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c1e07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x559219949310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34412/0 (socket says 172.21.15.172:34412) 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c1e07640 1 -- 172.21.15.172:0/2110402761 learned_addr learned my addr 172.21.15.172:0/2110402761 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c1606640 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199733c0 0x559219970f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c1e07640 1 -- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199766c0 msgr2=0x5592199aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c1e07640 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199766c0 0x5592199aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c1e07640 1 -- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199733c0 msgr2=0x559219970f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c1e07640 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199733c0 0x559219970f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c1e07640 1 -- 172.21.15.172:0/2110402761 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592199b3740 con 0x559219972fe0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c1e07640 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x559219949310 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f33b8043510 tx=0x7f33b80a9d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7331009f64183 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f339cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f339cff9640 1 -- 172.21.15.172:0/2110402761 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b809d060 con 0x559219972fe0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f339cff9640 1 -- 172.21.15.172:0/2110402761 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f33b80783c0 con 0x559219972fe0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2110402761 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33b40108e0 con 0x559219972fe0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f339cff9640 1 -- 172.21.15.172:0/2110402761 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33b80a3050 con 0x559219972fe0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c6d6e740 10 client.6162 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2110402761 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5592199aa9a0 con 0x559219972fe0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.674+0000 7f339cff9640 1 -- 172.21.15.172:0/2110402761 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b40108e0 con 0x559219972fe0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f339cff9640 1 -- 172.21.15.172:0/2110402761 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f33b8076730 con 0x559219972fe0 2024-04-25T08:45:34.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f33c6d6e740 10 client.6162 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f33c6d6e740 10 client.6162 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f33c6d6e740 20 client.6162 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5592199696a0 0x5592199fa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f33c6d6e740 4 client.6162 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2110402761 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0x5592198b62e0 con 0x5592199696a0 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f33c1606640 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5592199696a0 0x5592199fa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f339cff9640 10 client.6162 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f33c1606640 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5592199696a0 0x5592199fa7b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=487f6dce2a077882 server_cookie=7e7de3bb7bee90b1 in_seq=0 out_seq=0 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.675+0000 7f339cff9640 1 -- 172.21.15.172:0/2110402761 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5592198b62e0 con 0x5592199696a0 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f339cff9640 10 client.6162 handle_command_reply: tid=0 2024-04-25T08:45:34.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 client.6162 shutdown 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2110402761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 msgr2=0x559219949310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x559219949310 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f33b8043510 tx=0x7f33b80a9d40 comp rx=0 tx=0).stop 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2110402761 shutdown_connections 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5592199733c0 0x559219970f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5592199696a0 0x5592199fa7b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5592199766c0 0x5592199aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 --2- 172.21.15.172:0/2110402761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559219972fe0 0x559219949310 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f339cff9640 0 client.6162 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2110402761 >> 172.21.15.172:0/2110402761 conn(0x559219945c40 msgr2=0x5592199907f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2110402761 shutdown_connections 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 1 -- 172.21.15.172:0/2110402761 wait complete. 2024-04-25T08:45:34.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c6d6e740 20 client.6162 trim_cache size 0 max 16384 2024-04-25T08:45:34.674 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:34.674 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:45:34.674 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "53229c38-a8f6-4285-88e7-4dd2399d222e", 2024-04-25T08:45:34.674 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:45:34.674 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 -- 172.21.15.172:0/1495092001 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f33a006b500 msgr2=0x7f33a006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f33a006b500 0x7f33a006d9c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0011e0 tx=0x7f33ac009040 comp rx=0 tx=0).stop 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 -- 172.21.15.172:0/1495092001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33bc0d32f0 msgr2=0x7f33bc14c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33bc0d32f0 0x7f33bc14c1e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009ee0 tx=0x7f33b8004a40 comp rx=0 tx=0).stop 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 -- 172.21.15.172:0/1495092001 shutdown_connections 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f33a006b500 0x7f33a006d9c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33bc161710 0x7f33bc0ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33bc15dc20 0x7f33bc0acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 --2- 172.21.15.172:0/1495092001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33bc0d32f0 0x7f33bc14c1e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 -- 172.21.15.172:0/1495092001 >> 172.21.15.172:0/1495092001 conn(0x7f33bc0d0420 msgr2=0x7f33bc0cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 -- 172.21.15.172:0/1495092001 shutdown_connections 2024-04-25T08:45:34.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.676+0000 7f33c406b640 1 -- 172.21.15.172:0/1495092001 wait complete. 2024-04-25T08:45:34.679 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '53229c38-a8f6-4285-88e7-4dd2399d222e', 'mode': 'asynchronous'}' 2024-04-25T08:45:34.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:34.680 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-04-25T08:45:34.696 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-04-25T08:45:34.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:34.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.846+0000 7faa7fbe7640 1 Processor -- start 2024-04-25T08:45:34.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.847+0000 7faa7fbe7640 1 -- start start 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.847+0000 7faa7fbe7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa780b3410 0x7faa780720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.847+0000 7faa7fbe7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780ace70 con 0x7faa7806e3c0 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7fbe7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780b4380 con 0x7faa780b37f0 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7fbe7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7806df30 con 0x7faa780b3410 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7e184640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7faa7806e3c0 0x7faa7806e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49686/0 (socket says 172.21.15.172:49686) 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7e184640 1 -- 172.21.15.172:0/3861654620 learned_addr learned my addr 172.21.15.172:0/3861654620 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299913316 0 0) 0x7faa70001490 con 0x7faa7806e3c0 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa64003520 con 0x7faa7806e3c0 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7d983640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa780b3410 0x7faa780720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585694875 0 0) 0x7faa64003520 con 0x7faa7806e3c0 2024-04-25T08:45:34.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa780b3410 msgr2=0x7faa780720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa780b3410 0x7faa780720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 >> v1:172.21.15.186:6789/0 conn(0x7faa780b37f0 legacy=0x7faa780b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780726d0 con 0x7faa7806e3c0 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7faa70001bc0 con 0x7faa7806e3c0 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 >> v1:172.21.15.172:6789/0 conn(0x7faa7806e3c0 legacy=0x7faa7806e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa780b3410 0x7faa640039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa64003f60 0x7faa64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa64004d40 0x7faa640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7806df30 con 0x7faa64004d40 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6400baa0 con 0x7faa64003f60 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6400bca0 con 0x7faa780b3410 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7e184640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa64004d40 0x7faa640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7d983640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa780b3410 0x7faa640039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.848+0000 7faa7d182640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa64003f60 0x7faa64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.849+0000 7faa7d983640 1 -- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa64003f60 msgr2=0x7faa64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.849+0000 7faa7d983640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa64003f60 0x7faa64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.849+0000 7faa7d983640 1 -- 172.21.15.172:0/3861654620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa64004d40 msgr2=0x7faa640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.849+0000 7faa7d983640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa64004d40 0x7faa640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.849+0000 7faa7d983640 1 -- 172.21.15.172:0/3861654620 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64003520 con 0x7faa780b3410 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.849+0000 7faa7e184640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa64004d40 0x7faa640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.849+0000 7faa7d983640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa780b3410 0x7faa640039e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa74009ac0 tx=0x7faa64005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da5f677ff1906c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.850+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74036070 con 0x7faa780b3410 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.850+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa74031400 con 0x7faa780b3410 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.850+0000 7faa7c981640 1 -- 172.21.15.172:0/3861654620 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74009690 con 0x7faa780b3410 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.850+0000 7faa7fbe7640 1 -- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa780b3410 msgr2=0x7faa640039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.850+0000 7faa7fbe7640 1 --2- 172.21.15.172:0/3861654620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa780b3410 0x7faa640039e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa74009ac0 tx=0x7faa64005830 comp rx=0 tx=0).stop 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.850+0000 7faa7e184640 1 -- 172.21.15.172:0/3861654620 reap_dead start 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.850+0000 7faa7fbe7640 1 -- 172.21.15.172:0/3861654620 shutdown_connections 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.850+0000 7faa7fbe7640 1 -- 172.21.15.172:0/3861654620 >> 172.21.15.172:0/3861654620 conn(0x7faa780cfae0 msgr2=0x7faa780cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:34.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.850+0000 7faa7fbe7640 1 -- 172.21.15.172:0/3861654620 shutdown_connections 2024-04-25T08:45:34.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.850+0000 7faa7fbe7640 1 -- 172.21.15.172:0/3861654620 wait complete. 2024-04-25T08:45:34.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.851+0000 7faa7fbe7640 1 Processor -- start 2024-04-25T08:45:34.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.851+0000 7faa7fbe7640 1 -- start start 2024-04-25T08:45:34.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7fbe7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa780b3410 0x7faa781419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7fbe7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa78142220 0x7faa78143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7fbe7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa78143670 0x7faa781457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7fbe7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa78147890 con 0x7faa78142220 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7fbe7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7806dbc0 con 0x7faa780b3410 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7fbe7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa78147230 con 0x7faa78143670 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7d182640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa78142220 0x7faa78143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7d182640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa78142220 0x7faa78143130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34428/0 (socket says 172.21.15.172:34428) 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7d182640 1 -- 172.21.15.172:0/561252256 learned_addr learned my addr 172.21.15.172:0/561252256 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7e184640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa78143670 0x7faa781457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7d983640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa780b3410 0x7faa781419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7d182640 1 -- 172.21.15.172:0/561252256 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa78143670 msgr2=0x7faa781457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7d182640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa78143670 0x7faa781457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7d182640 1 -- 172.21.15.172:0/561252256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa780b3410 msgr2=0x7faa781419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7d182640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa780b3410 0x7faa781419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7d182640 1 -- 172.21.15.172:0/561252256 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78144bb0 con 0x7faa78142220 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.852+0000 7faa7d983640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa780b3410 0x7faa781419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:34.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.853+0000 7faa7d182640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa78142220 0x7faa78143130 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7faa6800f5f0 tx=0x7faa6800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.853+0000 7faa6e7fc640 1 -- 172.21.15.172:0/561252256 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa680052e0 con 0x7faa78142220 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.853+0000 7faa6e7fc640 1 -- 172.21.15.172:0/561252256 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa68018070 con 0x7faa78142220 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.853+0000 7faa7fbe7640 1 -- 172.21.15.172:0/561252256 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa78143b10 con 0x7faa78142220 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.853+0000 7faa6e7fc640 1 -- 172.21.15.172:0/561252256 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa68003810 con 0x7faa78142220 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.853+0000 7faa7fbe7640 1 -- 172.21.15.172:0/561252256 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa781440d0 con 0x7faa78142220 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.854+0000 7faa7fbe7640 1 -- 172.21.15.172:0/561252256 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa780b5b30 con 0x7faa78142220 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.854+0000 7faa6e7fc640 1 -- 172.21.15.172:0/561252256 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faa680039b0 con 0x7faa78142220 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.855+0000 7faa6e7fc640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa5c06b500 0x7faa5c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.855+0000 7faa7d983640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa5c06b500 0x7faa5c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.855+0000 7faa6e7fc640 1 -- 172.21.15.172:0/561252256 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faa6808a1e0 con 0x7faa78142220 2024-04-25T08:45:34.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.855+0000 7faa7d983640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa5c06b500 0x7faa5c06d9c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faa74033000 tx=0x7faa74008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:34.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:34.859+0000 7faa6e7fc640 1 -- 172.21.15.172:0/561252256 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faa780b5b30 con 0x7faa78142220 2024-04-25T08:45:35.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.065+0000 7faa7fbe7640 1 -- 172.21.15.172:0/561252256 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa78073990 con 0x7faa78142220 2024-04-25T08:45:35.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.065+0000 7faa6e7fc640 1 -- 172.21.15.172:0/561252256 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7faa68058ed0 con 0x7faa78142220 2024-04-25T08:45:35.057 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:35.057 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:20.588374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:35.057 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 23 2024-04-25T08:45:35.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 -- 172.21.15.172:0/561252256 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa5c06b500 msgr2=0x7faa5c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa5c06b500 0x7faa5c06d9c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faa74033000 tx=0x7faa74008030 comp rx=0 tx=0).stop 2024-04-25T08:45:35.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 -- 172.21.15.172:0/561252256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa78142220 msgr2=0x7faa78143130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa78142220 0x7faa78143130 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7faa6800f5f0 tx=0x7faa6800fab0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 -- 172.21.15.172:0/561252256 shutdown_connections 2024-04-25T08:45:35.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa5c06b500 0x7faa5c06d9c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa78143670 0x7faa781457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa78142220 0x7faa78143130 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 --2- 172.21.15.172:0/561252256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa780b3410 0x7faa781419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 -- 172.21.15.172:0/561252256 >> 172.21.15.172:0/561252256 conn(0x7faa780cfae0 msgr2=0x7faa780ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:35.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 -- 172.21.15.172:0/561252256 shutdown_connections 2024-04-25T08:45:35.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.067+0000 7faa7fbe7640 1 -- 172.21.15.172:0/561252256 wait complete. 2024-04-25T08:45:35.070 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-04-25T08:45:35.179 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:35.179 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": 0 2024-04-25T08:45:35.179 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:35.188 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:45:35.188 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:35.188 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:35.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:35.203 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-04-25T08:45:35.266 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:45:35.266 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:45:35.266 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694396 s, 151 MB/s 2024-04-25T08:45:35.267 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-04-25T08:45:35.267 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:35.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.411+0000 7f616fd1b640 1 Processor -- start 2024-04-25T08:45:35.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.412+0000 7f616fd1b640 1 -- start start 2024-04-25T08:45:35.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.412+0000 7f616fd1b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f616815dd80 0x7f616815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.412+0000 7f616fd1b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6168161800 0x7f616806c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.412+0000 7f616fd1b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616806cd30 con 0x7f616806c920 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.412+0000 7f616fd1b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616815e6a0 con 0x7f616815dd80 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.412+0000 7f616fd1b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680cfaf0 con 0x7f6168161800 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.413+0000 7f616dab7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f616815dd80 0x7f616815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.413+0000 7f616e2b8640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f616806c920 0x7f6168099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49696/0 (socket says 172.21.15.172:49696) 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.413+0000 7f616e2b8640 1 -- 172.21.15.172:0/2549188826 learned_addr learned my addr 172.21.15.172:0/2549188826 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.413+0000 7f616d2b6640 1 --2- 172.21.15.172:0/2549188826 >> v2:172.21.15.186:3300/0 conn(0x7f6168161800 0x7f616806c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.413+0000 7f616dab7640 1 -- 172.21.15.172:0/2549188826 >> v2:172.21.15.186:3300/0 conn(0x7f6168161800 msgr2=0x7f616806c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.413+0000 7f616dab7640 1 --2- 172.21.15.172:0/2549188826 >> v2:172.21.15.186:3300/0 conn(0x7f6168161800 0x7f616806c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.413+0000 7f616dab7640 1 -- 172.21.15.172:0/2549188826 >> v1:172.21.15.172:6789/0 conn(0x7f616806c920 legacy=0x7f6168099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.413+0000 7f616cab5640 1 -- 172.21.15.172:0/2549188826 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726479645 0 0) 0x7f6158001490 con 0x7f616806c920 2024-04-25T08:45:35.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.413+0000 7f616dab7640 1 -- 172.21.15.172:0/2549188826 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616815e8e0 con 0x7f616815dd80 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616dab7640 1 --2- 172.21.15.172:0/2549188826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f616815dd80 0x7f616815e160 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6168072970 tx=0x7f616002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e533bf6dbbf1b28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616cab5640 1 -- 172.21.15.172:0/2549188826 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160037070 con 0x7f616815dd80 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616cab5640 1 -- 172.21.15.172:0/2549188826 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160032440 con 0x7f616815dd80 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616cab5640 1 -- 172.21.15.172:0/2549188826 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160032810 con 0x7f616815dd80 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616fd1b640 1 -- 172.21.15.172:0/2549188826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f616815dd80 msgr2=0x7f616815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616fd1b640 1 --2- 172.21.15.172:0/2549188826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f616815dd80 0x7f616815e160 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6168072970 tx=0x7f616002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616fd1b640 1 -- 172.21.15.172:0/2549188826 shutdown_connections 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616fd1b640 1 --2- 172.21.15.172:0/2549188826 >> v2:172.21.15.186:3300/0 conn(0x7f6168161800 0x7f616806c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616fd1b640 1 --2- 172.21.15.172:0/2549188826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f616815dd80 0x7f616815e160 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616fd1b640 1 -- 172.21.15.172:0/2549188826 >> 172.21.15.172:0/2549188826 conn(0x7f61680b3310 msgr2=0x7f61680b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:35.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616fd1b640 1 -- 172.21.15.172:0/2549188826 shutdown_connections 2024-04-25T08:45:35.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.414+0000 7f616fd1b640 1 -- 172.21.15.172:0/2549188826 wait complete. 2024-04-25T08:45:35.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616fd1b640 1 Processor -- start 2024-04-25T08:45:35.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616fd1b640 1 -- start start 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616fd1b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f616806c920 0x7f616815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616fd1b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f616815dd80 0x7f61680c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616fd1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6168161800 0x7f61680b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616fd1b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616815f180 con 0x7f6168161800 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616fd1b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616815eea0 con 0x7f616806c920 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616fd1b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616806c0c0 con 0x7f616815dd80 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616e2b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6168161800 0x7f61680b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616e2b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6168161800 0x7f61680b6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34448/0 (socket says 172.21.15.172:34448) 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616e2b8640 1 -- 172.21.15.172:0/2016256367 learned_addr learned my addr 172.21.15.172:0/2016256367 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616dab7640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f616806c920 0x7f616815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.416+0000 7f616d2b6640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f616815dd80 0x7f61680c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f616e2b8640 1 -- 172.21.15.172:0/2016256367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f616815dd80 msgr2=0x7f61680c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f616e2b8640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f616815dd80 0x7f61680c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f616e2b8640 1 -- 172.21.15.172:0/2016256367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f616806c920 msgr2=0x7f616815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f616e2b8640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f616806c920 0x7f616815bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f616e2b8640 1 -- 172.21.15.172:0/2016256367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680b5bc0 con 0x7f6168161800 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f616e2b8640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6168161800 0x7f61680b6c60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f615800c700 tx=0x7f615800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f61667fc640 1 -- 172.21.15.172:0/2016256367 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158018070 con 0x7f6168161800 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f61667fc640 1 -- 172.21.15.172:0/2016256367 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800ce10 con 0x7f6168161800 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f616fd1b640 1 -- 172.21.15.172:0/2016256367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61680b5ea0 con 0x7f6168161800 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f61667fc640 1 -- 172.21.15.172:0/2016256367 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800a880 con 0x7f6168161800 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.417+0000 7f616fd1b640 1 -- 172.21.15.172:0/2016256367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61680b6460 con 0x7f6168161800 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.418+0000 7f616fd1b640 1 -- 172.21.15.172:0/2016256367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6168073990 con 0x7f6168161800 2024-04-25T08:45:35.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.418+0000 7f61667fc640 1 -- 172.21.15.172:0/2016256367 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f615801b070 con 0x7f6168161800 2024-04-25T08:45:35.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.419+0000 7f61667fc640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f615406b4d0 0x7f615406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.419+0000 7f61667fc640 1 -- 172.21.15.172:0/2016256367 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f61580897b0 con 0x7f6168161800 2024-04-25T08:45:35.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.419+0000 7f616dab7640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f615406b4d0 0x7f615406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.419+0000 7f616dab7640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f615406b4d0 0x7f615406d990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6160034000 tx=0x7f616002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:35.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.423+0000 7f61667fc640 1 -- 172.21.15.172:0/2016256367 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f616806cd30 con 0x7f6168161800 2024-04-25T08:45:35.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.630+0000 7f616fd1b640 1 -- 172.21.15.172:0/2016256367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61680b2e70 con 0x7f6168161800 2024-04-25T08:45:35.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.630+0000 7f61667fc640 1 -- 172.21.15.172:0/2016256367 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f6158057ee0 con 0x7f6168161800 2024-04-25T08:45:35.622 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:35.622 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:20.588374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:35.622 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 23 2024-04-25T08:45:35.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 -- 172.21.15.172:0/2016256367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f615406b4d0 msgr2=0x7f615406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f615406b4d0 0x7f615406d990 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6160034000 tx=0x7f616002e000 comp rx=0 tx=0).stop 2024-04-25T08:45:35.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 -- 172.21.15.172:0/2016256367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6168161800 msgr2=0x7f61680b6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6168161800 0x7f61680b6c60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f615800c700 tx=0x7f615800cbc0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 -- 172.21.15.172:0/2016256367 shutdown_connections 2024-04-25T08:45:35.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f615406b4d0 0x7f615406d990 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6168161800 0x7f61680b6c60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f616815dd80 0x7f61680c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 --2- 172.21.15.172:0/2016256367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f616806c920 0x7f616815bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 -- 172.21.15.172:0/2016256367 >> 172.21.15.172:0/2016256367 conn(0x7f61680b3310 msgr2=0x7f61680cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:35.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 -- 172.21.15.172:0/2016256367 shutdown_connections 2024-04-25T08:45:35.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.632+0000 7f616fd1b640 1 -- 172.21.15.172:0/2016256367 wait complete. 2024-04-25T08:45:35.635 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-04-25T08:45:35.743 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:35.743 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": 0 2024-04-25T08:45:35.744 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:35.753 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:45:35.754 DEBUG:teuthology.orchestra.run.smithi172:> stdin-killer -- python3 -c ' 2024-04-25T08:45:35.754 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-04-25T08:45:35.754 DEBUG:teuthology.orchestra.run.smithi172:> import stat 2024-04-25T08:45:35.754 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:45:35.754 DEBUG:teuthology.orchestra.run.smithi172:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-04-25T08:45:35.754 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-04-25T08:45:35.819 INFO:teuthology.orchestra.run.smithi172.stdout:1099511630186 2024-04-25T08:45:35.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:45:35.829 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:35.829 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T08:45:35.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.976+0000 7f08cdd09640 1 Processor -- start 2024-04-25T08:45:35.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.976+0000 7f08cdd09640 1 -- start start 2024-04-25T08:45:35.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08cdd09640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08c815dac0 0x7f08c80d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08cdd09640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08c80d1f30 0x7f08c80d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08cdd09640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c80d2420 con 0x7f08c80d34c0 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08cdd09640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c80d3030 con 0x7f08c80d1f30 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08cdd09640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80d2700 con 0x7f08c815dac0 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08c6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08c80d1f30 0x7f08c80d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08c7fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f08c80d34c0 0x7f08c80b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49706/0 (socket says 172.21.15.172:49706) 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08c7fff640 1 -- 172.21.15.172:0/3955778568 learned_addr learned my addr 172.21.15.172:0/3955778568 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08c77fe640 1 --2- 172.21.15.172:0/3955778568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08c815dac0 0x7f08c80d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08c6ffd640 1 -- 172.21.15.172:0/3955778568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08c815dac0 msgr2=0x7f08c80d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/3955778568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08c815dac0 0x7f08c80d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08c6ffd640 1 -- 172.21.15.172:0/3955778568 >> v1:172.21.15.172:6789/0 conn(0x7f08c80d34c0 legacy=0x7f08c80b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.977+0000 7f08c6ffd640 1 -- 172.21.15.172:0/3955778568 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c80d29e0 con 0x7f08c80d1f30 2024-04-25T08:45:35.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.978+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/3955778568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d1f30 0x7f08c80d03a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009790 tx=0x7f08bc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4f42e1a824720d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:35.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.978+0000 7f08c67fc640 1 -- 172.21.15.172:0/3955778568 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc037070 con 0x7f08c80d1f30 2024-04-25T08:45:35.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.978+0000 7f08c67fc640 1 -- 172.21.15.172:0/3955778568 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc032440 con 0x7f08c80d1f30 2024-04-25T08:45:35.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.978+0000 7f08c67fc640 1 -- 172.21.15.172:0/3955778568 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc032810 con 0x7f08c80d1f30 2024-04-25T08:45:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.979+0000 7f08cdd09640 1 -- 172.21.15.172:0/3955778568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d1f30 msgr2=0x7f08c80d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.979+0000 7f08cdd09640 1 --2- 172.21.15.172:0/3955778568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d1f30 0x7f08c80d03a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009790 tx=0x7f08bc02a210 comp rx=0 tx=0).stop 2024-04-25T08:45:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.979+0000 7f08cdd09640 1 -- 172.21.15.172:0/3955778568 shutdown_connections 2024-04-25T08:45:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.979+0000 7f08cdd09640 1 --2- 172.21.15.172:0/3955778568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d1f30 0x7f08c80d03a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.979+0000 7f08cdd09640 1 --2- 172.21.15.172:0/3955778568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08c815dac0 0x7f08c80d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.979+0000 7f08cdd09640 1 -- 172.21.15.172:0/3955778568 >> 172.21.15.172:0/3955778568 conn(0x7f08c8061c30 msgr2=0x7f08c806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:35.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.979+0000 7f08cdd09640 1 -- 172.21.15.172:0/3955778568 shutdown_connections 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.979+0000 7f08cdd09640 1 -- 172.21.15.172:0/3955778568 wait complete. 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.980+0000 7f08cdd09640 1 Processor -- start 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.980+0000 7f08cdd09640 1 -- start start 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08cdd09640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08c80d1f30 0x7f08c8151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08cdd09640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d34c0 0x7f08c815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08cdd09640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c815dac0 0x7f08c815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08cdd09640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80b97d0 con 0x7f08c80d34c0 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08cdd09640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c815dea0 con 0x7f08c815dac0 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08cdd09640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c80b9950 con 0x7f08c80d1f30 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d34c0 0x7f08c815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d34c0 0x7f08c815eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34452/0 (socket says 172.21.15.172:34452) 2024-04-25T08:45:35.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c6ffd640 1 -- 172.21.15.172:0/2068780504 learned_addr learned my addr 172.21.15.172:0/2068780504 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c77fe640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08c80d1f30 0x7f08c8151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c7fff640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c815dac0 0x7f08c815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c6ffd640 1 -- 172.21.15.172:0/2068780504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08c80d1f30 msgr2=0x7f08c8151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08c80d1f30 0x7f08c8151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c6ffd640 1 -- 172.21.15.172:0/2068780504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c815dac0 msgr2=0x7f08c815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c815dac0 0x7f08c815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c6ffd640 1 -- 172.21.15.172:0/2068780504 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c81e8ee0 con 0x7f08c80d34c0 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c7fff640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c815dac0 0x7f08c815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d34c0 0x7f08c815eb60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f08bc035040 tx=0x7f08bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08affff640 1 -- 172.21.15.172:0/2068780504 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc037040 con 0x7f08c80d34c0 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08affff640 1 -- 172.21.15.172:0/2068780504 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc005bd0 con 0x7f08c80d34c0 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08cdd09640 1 -- 172.21.15.172:0/2068780504 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c81e91c0 con 0x7f08c80d34c0 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08affff640 1 -- 172.21.15.172:0/2068780504 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc030770 con 0x7f08c80d34c0 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.981+0000 7f08cdd09640 1 -- 172.21.15.172:0/2068780504 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c81e9780 con 0x7f08c80d34c0 2024-04-25T08:45:35.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.983+0000 7f08affff640 1 -- 172.21.15.172:0/2068780504 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f08bc030910 con 0x7f08c80d34c0 2024-04-25T08:45:35.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.983+0000 7f08affff640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f08b406b4d0 0x7f08b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.983+0000 7f08affff640 1 -- 172.21.15.172:0/2068780504 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f08bc0aacf0 con 0x7f08c80d34c0 2024-04-25T08:45:35.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.983+0000 7f08c77fe640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f08b406b4d0 0x7f08b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.984+0000 7f08c77fe640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f08b406b4d0 0x7f08b406d990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f08b80079a0 tx=0x7f08b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:35.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.984+0000 7f08d0a15740 1 Processor -- start 2024-04-25T08:45:35.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.984+0000 7f08d0a15740 1 -- start start 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbaa0 0x556c157be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbe80 0x556c157be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1578e700 0x556c15791f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08d0a15740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c156f7e00 con 0x556c157bbe80 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08d0a15740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c156a0d20 con 0x556c1578e700 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08d0a15740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c156f3ea0 con 0x556c157bbaa0 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08c6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbe80 0x556c157be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08c6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbe80 0x556c157be7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34462/0 (socket says 172.21.15.172:34462) 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08c6ffd640 1 -- 172.21.15.172:0/2799818007 learned_addr learned my addr 172.21.15.172:0/2799818007 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08c77fe640 1 --2- 172.21.15.172:0/2799818007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbaa0 0x556c157be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08c6ffd640 1 -- 172.21.15.172:0/2799818007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbaa0 msgr2=0x556c157be2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/2799818007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbaa0 0x556c157be2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08c6ffd640 1 -- 172.21.15.172:0/2799818007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1578e700 msgr2=0x556c15791f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/2799818007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1578e700 0x556c15791f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08c6ffd640 1 -- 172.21.15.172:0/2799818007 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c156c2df0 con 0x556c157bbe80 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.985+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/2799818007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbe80 0x556c157be7f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0a9030 tx=0x7f08bc078c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844abae67b404d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08ad7fa640 1 -- 172.21.15.172:0/2799818007 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0792e0 con 0x556c157bbe80 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08ad7fa640 1 -- 172.21.15.172:0/2799818007 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc07d430 con 0x556c157bbe80 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08ad7fa640 1 -- 172.21.15.172:0/2799818007 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0819f0 con 0x556c157bbe80 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08d0a15740 1 -- 172.21.15.172:0/2799818007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbe80 msgr2=0x556c157be7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08d0a15740 1 --2- 172.21.15.172:0/2799818007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbe80 0x556c157be7f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0a9030 tx=0x7f08bc078c40 comp rx=0 tx=0).stop 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08d0a15740 1 -- 172.21.15.172:0/2799818007 shutdown_connections 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08d0a15740 1 --2- 172.21.15.172:0/2799818007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1578e700 0x556c15791f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08d0a15740 1 --2- 172.21.15.172:0/2799818007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbe80 0x556c157be7f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08d0a15740 1 --2- 172.21.15.172:0/2799818007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbaa0 0x556c157be2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08d0a15740 1 -- 172.21.15.172:0/2799818007 >> 172.21.15.172:0/2799818007 conn(0x556c15790970 msgr2=0x556c157d92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08d0a15740 1 -- 172.21.15.172:0/2799818007 shutdown_connections 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.986+0000 7f08d0a15740 1 -- 172.21.15.172:0/2799818007 wait complete. 2024-04-25T08:45:35.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.987+0000 7f08d0a15740 1 -- start start 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.987+0000 7f08d0a15740 1 Processor -- start 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c157c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbe80 0x556c157e1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157de850 0x556c157dc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08d0a15740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c156f7e00 con 0x556c157bbaa0 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08d0a15740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c15696590 con 0x556c157de850 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08d0a15740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c15793b20 con 0x556c157bbe80 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08d0a15740 10 client.0 _ll_register_callbacks cb 0x556c156a2e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c157c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c157c04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34470/0 (socket says 172.21.15.172:34470) 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c77fe640 1 -- 172.21.15.172:0/3769864921 learned_addr learned my addr 172.21.15.172:0/3769864921 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbe80 0x556c157e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c7fff640 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157de850 0x556c157dc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c77fe640 1 -- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbe80 msgr2=0x556c157e1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:35.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c77fe640 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbe80 0x556c157e1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c77fe640 1 -- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157de850 msgr2=0x556c157dc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c77fe640 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157de850 0x556c157dc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c77fe640 1 -- 172.21.15.172:0/3769864921 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c1540c3f0 con 0x556c157bbaa0 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c7fff640 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157de850 0x556c157dc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08c77fe640 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c157c04e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f08b8016720 tx=0x7f08b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8842e557a13606 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08a67fc640 1 -- 172.21.15.172:0/3769864921 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8014880 con 0x556c157bbaa0 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08a67fc640 1 -- 172.21.15.172:0/3769864921 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f08b8014a20 con 0x556c157bbaa0 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.988+0000 7f08d0a15740 1 -- 172.21.15.172:0/3769864921 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08bc07d430 con 0x556c157bbaa0 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08a67fc640 1 -- 172.21.15.172:0/3769864921 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08b8014c20 con 0x556c157bbaa0 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08d0a15740 10 client.6192 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08d0a15740 1 -- 172.21.15.172:0/3769864921 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x556c154d67d0 con 0x556c157bbaa0 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08a67fc640 1 -- 172.21.15.172:0/3769864921 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc07d430 con 0x556c157bbaa0 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08a67fc640 1 -- 172.21.15.172:0/3769864921 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f08b8032080 con 0x556c157bbaa0 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08d0a15740 10 client.6192 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:35.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08d0a15740 10 client.6192 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08d0a15740 20 client.6192 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x556c157b53c0 0x556c157dc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08d0a15740 4 client.6192 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08d0a15740 1 -- 172.21.15.172:0/3769864921 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c15705340 con 0x556c157b53c0 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x556c157b53c0 0x556c157dc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x556c157b53c0 0x556c157dc740 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5400b94fa70a9c3e server_cookie=fa1fa1a0fcddee3d in_seq=0 out_seq=0 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.989+0000 7f08a67fc640 10 client.6192 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08a67fc640 1 -- 172.21.15.172:0/3769864921 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556c15705340 con 0x556c157b53c0 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08a67fc640 10 client.6192 handle_command_reply: tid=0 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 client.6192 shutdown 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 -- 172.21.15.172:0/3769864921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 msgr2=0x556c157c04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c157c04e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f08b8016720 tx=0x7f08b8004730 comp rx=0 tx=0).stop 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 -- 172.21.15.172:0/3769864921 shutdown_connections 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157de850 0x556c157dc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x556c157b53c0 0x556c157dc740 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbe80 0x556c157e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3769864921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c157c04e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08a67fc640 0 client.6192 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:35.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 -- 172.21.15.172:0/3769864921 >> 172.21.15.172:0/3769864921 conn(0x556c1578e700 msgr2=0x556c1578f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:35.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 -- 172.21.15.172:0/3769864921 shutdown_connections 2024-04-25T08:45:35.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 1 -- 172.21.15.172:0/3769864921 wait complete. 2024-04-25T08:45:35.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:35.990+0000 7f08d0a15740 20 client.6192 trim_cache size 0 max 16384 2024-04-25T08:45:35.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.002+0000 7f08d0a15740 1 Processor -- start 2024-04-25T08:45:35.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.002+0000 7f08d0a15740 1 -- start start 2024-04-25T08:45:35.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbaa0 0x556c15793110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157bbe80 0x556c157ddba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157de850 0x556c157de0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:35.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08d0a15740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c8200660 con 0x556c157de850 2024-04-25T08:45:35.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08d0a15740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c81ff860 con 0x556c157bbe80 2024-04-25T08:45:35.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08d0a15740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c815c7a0 con 0x556c157bbaa0 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08c7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157de850 0x556c157de0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08c7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157de850 0x556c157de0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34482/0 (socket says 172.21.15.172:34482) 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08c7fff640 1 -- 172.21.15.172:0/2666180825 learned_addr learned my addr 172.21.15.172:0/2666180825 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08c7fff640 1 -- 172.21.15.172:0/2666180825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbaa0 msgr2=0x556c15793110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08c7fff640 1 --2- 172.21.15.172:0/2666180825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbaa0 0x556c15793110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08c7fff640 1 -- 172.21.15.172:0/2666180825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157bbe80 msgr2=0x556c157ddba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/2666180825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157bbe80 0x556c157ddba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08c7fff640 1 --2- 172.21.15.172:0/2666180825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157bbe80 0x556c157ddba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08c7fff640 1 -- 172.21.15.172:0/2666180825 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c1578a690 con 0x556c157de850 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08c7fff640 1 --2- 172.21.15.172:0/2666180825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157de850 0x556c157de0e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f08c80d3920 tx=0x7f08c000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ad570625a3de8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08acff9640 1 -- 172.21.15.172:0/2666180825 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c00070d0 con 0x556c157de850 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08acff9640 1 -- 172.21.15.172:0/2666180825 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0018070 con 0x556c157de850 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.003+0000 7f08acff9640 1 -- 172.21.15.172:0/2666180825 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0007470 con 0x556c157de850 2024-04-25T08:45:35.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.004+0000 7f08d0a15740 1 -- 172.21.15.172:0/2666180825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157de850 msgr2=0x556c157de0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.004+0000 7f08d0a15740 1 --2- 172.21.15.172:0/2666180825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157de850 0x556c157de0e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f08c80d3920 tx=0x7f08c000f5a0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.004+0000 7f08d0a15740 1 -- 172.21.15.172:0/2666180825 shutdown_connections 2024-04-25T08:45:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.004+0000 7f08d0a15740 1 --2- 172.21.15.172:0/2666180825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157bbe80 0x556c157ddba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.004+0000 7f08d0a15740 1 --2- 172.21.15.172:0/2666180825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157de850 0x556c157de0e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.004+0000 7f08d0a15740 1 --2- 172.21.15.172:0/2666180825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157bbaa0 0x556c15793110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.004+0000 7f08d0a15740 1 -- 172.21.15.172:0/2666180825 >> 172.21.15.172:0/2666180825 conn(0x556c1578e700 msgr2=0x556c1578f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.004+0000 7f08d0a15740 1 -- 172.21.15.172:0/2666180825 shutdown_connections 2024-04-25T08:45:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.004+0000 7f08d0a15740 1 -- 172.21.15.172:0/2666180825 wait complete. 2024-04-25T08:45:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08d0a15740 1 -- start start 2024-04-25T08:45:35.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08d0a15740 1 Processor -- start 2024-04-25T08:45:36.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c15842e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157bbe80 0x556c157dd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08d0a15740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157de850 0x556c157ddde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08d0a15740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c157b5240 con 0x556c157bbaa0 2024-04-25T08:45:36.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08d0a15740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c81ff260 con 0x556c157bbe80 2024-04-25T08:45:36.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08d0a15740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c157fc380 con 0x556c157de850 2024-04-25T08:45:36.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08d0a15740 10 client.0 _ll_register_callbacks cb 0x7f08bc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:36.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08c77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c15842e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08c77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c15842e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34492/0 (socket says 172.21.15.172:34492) 2024-04-25T08:45:36.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.005+0000 7f08c77fe640 1 -- 172.21.15.172:0/3850725636 learned_addr learned my addr 172.21.15.172:0/3850725636 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08c7fff640 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157de850 0x556c157ddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08c77fe640 1 -- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157de850 msgr2=0x556c157ddde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08c77fe640 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157de850 0x556c157ddde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08c77fe640 1 -- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157bbe80 msgr2=0x556c157dd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08c77fe640 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157bbe80 0x556c157dd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08c77fe640 1 -- 172.21.15.172:0/3850725636 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c15793360 con 0x556c157bbaa0 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08c77fe640 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c15842e50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f08b8010620 tx=0x7f08b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd309b508fbdf4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08a67fc640 1 -- 172.21.15.172:0/3850725636 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8039610 con 0x556c157bbaa0 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08a67fc640 1 -- 172.21.15.172:0/3850725636 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f08b8022410 con 0x556c157bbaa0 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08d0a15740 1 -- 172.21.15.172:0/3850725636 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08c0018070 con 0x556c157bbaa0 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08a67fc640 1 -- 172.21.15.172:0/3850725636 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08b8022610 con 0x556c157bbaa0 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08d0a15740 10 client.6198 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08d0a15740 1 -- 172.21.15.172:0/3850725636 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x556c157941a0 con 0x556c157bbaa0 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08a67fc640 1 -- 172.21.15.172:0/3850725636 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0018070 con 0x556c157bbaa0 2024-04-25T08:45:36.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08a67fc640 1 -- 172.21.15.172:0/3850725636 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f08b8041050 con 0x556c157bbaa0 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08d0a15740 10 client.6198 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08d0a15740 10 client.6198 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08d0a15740 20 client.6198 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x556c15791f10 0x556c15792320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08d0a15740 4 client.6198 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.006+0000 7f08d0a15740 1 -- 172.21.15.172:0/3850725636 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556c156ff690 con 0x556c15791f10 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x556c15791f10 0x556c15792320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08a67fc640 10 client.6198 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08c6ffd640 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x556c15791f10 0x556c15792320 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39db6d8a027c0689 server_cookie=70085c74a9c0b1 in_seq=0 out_seq=0 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08a67fc640 1 -- 172.21.15.172:0/3850725636 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556c156ff690 con 0x556c15791f10 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08a67fc640 10 client.6198 handle_command_reply: tid=0 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 client.6198 shutdown 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 -- 172.21.15.172:0/3850725636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 msgr2=0x556c15842e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c15842e50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f08b8010620 tx=0x7f08b80046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 -- 172.21.15.172:0/3850725636 shutdown_connections 2024-04-25T08:45:36.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c157bbe80 0x556c157dd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x556c15791f10 0x556c15792320 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556c157de850 0x556c157ddde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 --2- 172.21.15.172:0/3850725636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556c157bbaa0 0x556c15842e50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08a67fc640 0 client.6198 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:36.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 -- 172.21.15.172:0/3850725636 >> 172.21.15.172:0/3850725636 conn(0x556c1578e700 msgr2=0x556c1578d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 -- 172.21.15.172:0/3850725636 shutdown_connections 2024-04-25T08:45:36.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 1 -- 172.21.15.172:0/3850725636 wait complete. 2024-04-25T08:45:36.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.007+0000 7f08d0a15740 20 client.6198 trim_cache size 0 max 16384 2024-04-25T08:45:36.005 INFO:teuthology.orchestra.run.smithi172.stdout:[] 2024-04-25T08:45:36.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 -- 172.21.15.172:0/2068780504 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f08b406b4d0 msgr2=0x7f08b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f08b406b4d0 0x7f08b406d990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f08b80079a0 tx=0x7f08b8008040 comp rx=0 tx=0).stop 2024-04-25T08:45:36.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 -- 172.21.15.172:0/2068780504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d34c0 msgr2=0x7f08c815eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d34c0 0x7f08c815eb60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f08bc035040 tx=0x7f08bc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 -- 172.21.15.172:0/2068780504 shutdown_connections 2024-04-25T08:45:36.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f08b406b4d0 0x7f08b406d990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08c815dac0 0x7f08c815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08c80d34c0 0x7f08c815eb60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 --2- 172.21.15.172:0/2068780504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08c80d1f30 0x7f08c8151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 -- 172.21.15.172:0/2068780504 >> 172.21.15.172:0/2068780504 conn(0x7f08c8061c30 msgr2=0x7f08c80d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 -- 172.21.15.172:0/2068780504 shutdown_connections 2024-04-25T08:45:36.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.008+0000 7f08cdd09640 1 -- 172.21.15.172:0/2068780504 wait complete. 2024-04-25T08:45:36.010 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 1000000096a.00000000 parent 2024-04-25T08:45:36.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.060+0000 7fe408eebf40 1 Processor -- start 2024-04-25T08:45:36.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.060+0000 7fe408eebf40 1 -- start start 2024-04-25T08:45:36.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe408eebf40 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ea061ade0 0x557ea06e8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe408eebf40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea06f40a0 0x557ea06f4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe408eebf40 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x557ea061e3a0 0x557ea06f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe408eebf40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea061d9a0 con 0x557ea06f40a0 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe408eebf40 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea05c3df0 con 0x557ea061ade0 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe408eebf40 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ea061b1f0 con 0x557ea061e3a0 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe4061eb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea06f40a0 0x557ea06f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe4061eb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea06f40a0 0x557ea06f4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34508/0 (socket says 172.21.15.172:34508) 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe4061eb640 1 -- 172.21.15.172:0/147207868 learned_addr learned my addr 172.21.15.172:0/147207868 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe4071ed640 1 --2- 172.21.15.172:0/147207868 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x557ea061e3a0 0x557ea06f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.061+0000 7fe4069ec640 1 --2- 172.21.15.172:0/147207868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ea061ade0 0x557ea06e8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe4061eb640 1 -- 172.21.15.172:0/147207868 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x557ea061e3a0 msgr2=0x557ea06f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe4061eb640 1 --2- 172.21.15.172:0/147207868 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x557ea061e3a0 0x557ea06f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe4061eb640 1 -- 172.21.15.172:0/147207868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ea061ade0 msgr2=0x557ea06e8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe4061eb640 1 --2- 172.21.15.172:0/147207868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ea061ade0 0x557ea06e8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe4061eb640 1 -- 172.21.15.172:0/147207868 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ea0549c50 con 0x557ea06f40a0 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe4061eb640 1 --2- 172.21.15.172:0/147207868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea06f40a0 0x557ea06f4690 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc025bc0 tx=0x7fe3fc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c0592f633fdbcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe4051e9640 1 -- 172.21.15.172:0/147207868 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc065070 con 0x557ea06f40a0 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe4051e9640 1 -- 172.21.15.172:0/147207868 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc0547f0 con 0x557ea06f40a0 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe4051e9640 1 -- 172.21.15.172:0/147207868 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc059040 con 0x557ea06f40a0 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe408eebf40 1 -- 172.21.15.172:0/147207868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea06f40a0 msgr2=0x557ea06f4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe408eebf40 1 --2- 172.21.15.172:0/147207868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea06f40a0 0x557ea06f4690 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc025bc0 tx=0x7fe3fc04e000 comp rx=0 tx=0).stop 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe408eebf40 1 -- 172.21.15.172:0/147207868 shutdown_connections 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe408eebf40 1 --2- 172.21.15.172:0/147207868 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x557ea061e3a0 0x557ea06f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe408eebf40 1 --2- 172.21.15.172:0/147207868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea06f40a0 0x557ea06f4690 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe408eebf40 1 --2- 172.21.15.172:0/147207868 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ea061ade0 0x557ea06e8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe408eebf40 1 -- 172.21.15.172:0/147207868 >> 172.21.15.172:0/147207868 conn(0x557ea061b9b0 msgr2=0x557ea0665510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe408eebf40 1 -- 172.21.15.172:0/147207868 shutdown_connections 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.062+0000 7fe408eebf40 1 -- 172.21.15.172:0/147207868 wait complete. 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.063+0000 7fe408eebf40 1 Processor -- start 2024-04-25T08:45:36.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.063+0000 7fe408eebf40 1 -- start start 2024-04-25T08:45:36.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe408eebf40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea061ade0 0x557ea06f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe408eebf40 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x557ea061e3a0 0x557ea06eecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe408eebf40 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ea06f40a0 0x557ea06f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe408eebf40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea061cf80 con 0x557ea061ade0 2024-04-25T08:45:36.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe408eebf40 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ea06f6770 con 0x557ea06f40a0 2024-04-25T08:45:36.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe408eebf40 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ea06f6c50 con 0x557ea061e3a0 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4069ec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea061ade0 0x557ea06f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4069ec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea061ade0 0x557ea06f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34514/0 (socket says 172.21.15.172:34514) 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4069ec640 1 -- 172.21.15.172:0/2541260367 learned_addr learned my addr 172.21.15.172:0/2541260367 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4061eb640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x557ea061e3a0 0x557ea06eecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4071ed640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ea06f40a0 0x557ea06f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4069ec640 1 -- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x557ea061e3a0 msgr2=0x557ea06eecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4069ec640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x557ea061e3a0 0x557ea06eecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4069ec640 1 -- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ea06f40a0 msgr2=0x557ea06f19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4069ec640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557ea06f40a0 0x557ea06f19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4069ec640 1 -- 172.21.15.172:0/2541260367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ea06ef3b0 con 0x557ea061ade0 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4061eb640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x557ea061e3a0 0x557ea06eecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe4069ec640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea061ade0 0x557ea06f4b40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8008680 tx=0x7fe3f8008770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe3effff640 1 -- 172.21.15.172:0/2541260367 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8019020 con 0x557ea061ade0 2024-04-25T08:45:36.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe3effff640 1 -- 172.21.15.172:0/2541260367 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f8015880 con 0x557ea061ade0 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe408eebf40 1 -- 172.21.15.172:0/2541260367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557ea06ed0b0 con 0x557ea061ade0 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe3effff640 1 -- 172.21.15.172:0/2541260367 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8015c30 con 0x557ea061ade0 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.064+0000 7fe408eebf40 1 -- 172.21.15.172:0/2541260367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ea06ed670 con 0x557ea061ade0 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.066+0000 7fe3effff640 1 -- 172.21.15.172:0/2541260367 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe3f801c020 con 0x557ea061ade0 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.066+0000 7fe3effff640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3f4069ee0 0x7fe3f406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.066+0000 7fe4061eb640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3f4069ee0 0x7fe3f406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.066+0000 7fe3effff640 1 -- 172.21.15.172:0/2541260367 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe3f8089aa0 con 0x557ea061ade0 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.067+0000 7fe408eebf40 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x557ea06f1f30 0x557ea06e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.067+0000 7fe408eebf40 1 -- 172.21.15.172:0/2541260367 --> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] -- osd_op(unknown.0.0:1 8.11 8:88e5eea5:::1000000096a.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54) v9 -- 0x557ea06e6e30 con 0x557ea06f1f30 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.067+0000 7fe4061eb640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3f4069ee0 0x7fe3f406c3a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc062000 tx=0x7fe3fc056040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.067+0000 7fe4071ed640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x557ea06f1f30 0x557ea06e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.067+0000 7fe4071ed640 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x557ea06f1f30 0x557ea06e68f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe4071ed640 1 -- 172.21.15.172:0/2541260367 <== osd.5 v2:172.21.15.186:6800/2784790337 1 ==== osd_op_reply(1 1000000096a.00000000 [rmxattr] v54'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe400002720 con 0x557ea06f1f30 2024-04-25T08:45:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe408eebf40 1 -- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x557ea06f1f30 msgr2=0x557ea06e68f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe408eebf40 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x557ea06f1f30 0x557ea06e68f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe408eebf40 1 -- 172.21.15.172:0/2541260367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3f4069ee0 msgr2=0x7fe3f406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe408eebf40 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3f4069ee0 0x7fe3f406c3a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc062000 tx=0x7fe3fc056040 comp rx=0 tx=0).stop 2024-04-25T08:45:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe408eebf40 1 -- 172.21.15.172:0/2541260367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea061ade0 msgr2=0x557ea06f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe408eebf40 1 --2- 172.21.15.172:0/2541260367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ea061ade0 0x557ea06f4b40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8008680 tx=0x7fe3f8008770 comp rx=0 tx=0).stop 2024-04-25T08:45:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe4071ed640 1 -- 172.21.15.172:0/2541260367 reap_dead start 2024-04-25T08:45:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe408eebf40 1 -- 172.21.15.172:0/2541260367 shutdown_connections 2024-04-25T08:45:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe408eebf40 1 -- 172.21.15.172:0/2541260367 >> 172.21.15.172:0/2541260367 conn(0x557ea061b9b0 msgr2=0x557ea0665510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe408eebf40 1 -- 172.21.15.172:0/2541260367 shutdown_connections 2024-04-25T08:45:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.068+0000 7fe408eebf40 1 -- 172.21.15.172:0/2541260367 wait complete. 2024-04-25T08:45:36.064 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-04-25T08:45:36.064 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:36.064 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-04-25T08:45:36.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.213+0000 7f477b4b3640 1 Processor -- start 2024-04-25T08:45:36.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.213+0000 7f477b4b3640 1 -- start start 2024-04-25T08:45:36.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f477b4b3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f477406c330 0x7f47740b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f477b4b3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f477406c7e0 0x7f47740b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f477b4b3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47740d1d50 con 0x7f4774158230 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f477b4b3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4774158610 con 0x7f477406c7e0 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f477b4b3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477406bea0 con 0x7f477406c330 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f4779a50640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f477406c7e0 0x7f47740b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f477924f640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4774158230 0x7f47740d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49714/0 (socket says 172.21.15.172:49714) 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f477924f640 1 -- 172.21.15.172:0/2448067678 learned_addr learned my addr 172.21.15.172:0/2448067678 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f4778a4e640 1 --2- 172.21.15.172:0/2448067678 >> v2:172.21.15.186:3300/0 conn(0x7f477406c330 0x7f47740b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f4779a50640 1 -- 172.21.15.172:0/2448067678 >> v2:172.21.15.186:3300/0 conn(0x7f477406c330 msgr2=0x7f47740b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f4779a50640 1 --2- 172.21.15.172:0/2448067678 >> v2:172.21.15.186:3300/0 conn(0x7f477406c330 0x7f47740b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f4779a50640 1 -- 172.21.15.172:0/2448067678 >> v1:172.21.15.172:6789/0 conn(0x7f4774158230 legacy=0x7f47740d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f4779a50640 1 -- 172.21.15.172:0/2448067678 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47740d2020 con 0x7f477406c7e0 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.214+0000 7f476bfff640 1 -- 172.21.15.172:0/2448067678 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132466910 0 0) 0x7f47740d1d50 con 0x7f4774158230 2024-04-25T08:45:36.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.215+0000 7f4779a50640 1 --2- 172.21.15.172:0/2448067678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 0x7f47740b53a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f47740b4800 tx=0x7f476c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba80f9f7e948738 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.215+0000 7f476bfff640 1 -- 172.21.15.172:0/2448067678 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c007740 con 0x7f477406c7e0 2024-04-25T08:45:36.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.215+0000 7f476bfff640 1 -- 172.21.15.172:0/2448067678 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c0078e0 con 0x7f477406c7e0 2024-04-25T08:45:36.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.215+0000 7f476bfff640 1 -- 172.21.15.172:0/2448067678 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c007cb0 con 0x7f477406c7e0 2024-04-25T08:45:36.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.216+0000 7f477b4b3640 1 -- 172.21.15.172:0/2448067678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 msgr2=0x7f47740b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.216+0000 7f477b4b3640 1 --2- 172.21.15.172:0/2448067678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 0x7f47740b53a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f47740b4800 tx=0x7f476c02a680 comp rx=0 tx=0).stop 2024-04-25T08:45:36.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.216+0000 7f477b4b3640 1 -- 172.21.15.172:0/2448067678 shutdown_connections 2024-04-25T08:45:36.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.216+0000 7f477b4b3640 1 --2- 172.21.15.172:0/2448067678 >> v2:172.21.15.186:3300/0 conn(0x7f477406c330 0x7f47740b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.216+0000 7f477b4b3640 1 --2- 172.21.15.172:0/2448067678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 0x7f47740b53a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.216+0000 7f477b4b3640 1 -- 172.21.15.172:0/2448067678 >> 172.21.15.172:0/2448067678 conn(0x7f4774061600 msgr2=0x7f47740619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.216+0000 7f477b4b3640 1 -- 172.21.15.172:0/2448067678 shutdown_connections 2024-04-25T08:45:36.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.216+0000 7f477b4b3640 1 -- 172.21.15.172:0/2448067678 wait complete. 2024-04-25T08:45:36.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.217+0000 7f477b4b3640 1 Processor -- start 2024-04-25T08:45:36.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.217+0000 7f477b4b3640 1 -- start start 2024-04-25T08:45:36.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f477b4b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f477406c330 0x7f477415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f477b4b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 0x7f47741e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f477b4b3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4774158230 0x7f47741e44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f477b4b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47740d25e0 con 0x7f477406c7e0 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f477b4b3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477406bb30 con 0x7f4774158230 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f477b4b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477415e320 con 0x7f477406c330 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4778a4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 0x7f47741e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4778a4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 0x7f47741e3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34532/0 (socket says 172.21.15.172:34532) 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4778a4e640 1 -- 172.21.15.172:0/2746155515 learned_addr learned my addr 172.21.15.172:0/2746155515 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f477924f640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f477406c330 0x7f477415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4779a50640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4774158230 0x7f47741e44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4778a4e640 1 -- 172.21.15.172:0/2746155515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f477406c330 msgr2=0x7f477415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4778a4e640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f477406c330 0x7f477415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4778a4e640 1 -- 172.21.15.172:0/2746155515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4774158230 msgr2=0x7f47741e44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4778a4e640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4774158230 0x7f47741e44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4778a4e640 1 -- 172.21.15.172:0/2746155515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47741e7820 con 0x7f477406c7e0 2024-04-25T08:45:36.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4779a50640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4774158230 0x7f47741e44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:36.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4778a4e640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 0x7f47741e3fa0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f476400e8e0 tx=0x7f476400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4769ffb640 1 -- 172.21.15.172:0/2746155515 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764017070 con 0x7f477406c7e0 2024-04-25T08:45:36.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4769ffb640 1 -- 172.21.15.172:0/2746155515 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476400c8e0 con 0x7f477406c7e0 2024-04-25T08:45:36.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f477b4b3640 1 -- 172.21.15.172:0/2746155515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47741e7b00 con 0x7f477406c7e0 2024-04-25T08:45:36.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.218+0000 7f4769ffb640 1 -- 172.21.15.172:0/2746155515 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476400ccb0 con 0x7f477406c7e0 2024-04-25T08:45:36.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.219+0000 7f477b4b3640 1 -- 172.21.15.172:0/2746155515 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47740caf90 con 0x7f477406c7e0 2024-04-25T08:45:36.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.220+0000 7f4769ffb640 1 -- 172.21.15.172:0/2746155515 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f476401a070 con 0x7f477406c7e0 2024-04-25T08:45:36.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.221+0000 7f4769ffb640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f475806b500 0x7f475806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.221+0000 7f4769ffb640 1 -- 172.21.15.172:0/2746155515 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f476408a730 con 0x7f477406c7e0 2024-04-25T08:45:36.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.221+0000 7f477924f640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f475806b500 0x7f475806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.221+0000 7f477924f640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f475806b500 0x7f475806d9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4770000f60 tx=0x7f4770007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f477e1bb740 1 Processor -- start 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f477e1bb740 1 -- start start 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa22360 0x56432fa427d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa29c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432f9ff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f477e1bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432f962ee0 con 0x56432fa01360 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f477e1bb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432f90bc50 con 0x56432fa22360 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f477e1bb740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56432f95ef80 con 0x56432fa2a140 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f4778a4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa29c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f4778a4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa29c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34536/0 (socket says 172.21.15.172:34536) 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.222+0000 7f4778a4e640 1 -- 172.21.15.172:0/2734980468 learned_addr learned my addr 172.21.15.172:0/2734980468 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f477924f640 1 --2- 172.21.15.172:0/2734980468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa22360 0x56432fa427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f4779a50640 1 --2- 172.21.15.172:0/2734980468 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432f9ff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f4778a4e640 1 -- 172.21.15.172:0/2734980468 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 msgr2=0x56432f9ff7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f4778a4e640 1 --2- 172.21.15.172:0/2734980468 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432f9ff7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f4778a4e640 1 -- 172.21.15.172:0/2734980468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa22360 msgr2=0x56432fa427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f4778a4e640 1 --2- 172.21.15.172:0/2734980468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa22360 0x56432fa427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f4778a4e640 1 -- 172.21.15.172:0/2734980468 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56432f743c00 con 0x56432fa01360 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f4778a4e640 1 --2- 172.21.15.172:0/2734980468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa29c00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4764060f00 tx=0x7f476405cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd87f12a59b84bfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f475effd640 1 -- 172.21.15.172:0/2734980468 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764021050 con 0x56432fa01360 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f475effd640 1 -- 172.21.15.172:0/2734980468 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47640570d0 con 0x56432fa01360 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.223+0000 7f475effd640 1 -- 172.21.15.172:0/2734980468 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764058220 con 0x56432fa01360 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 -- 172.21.15.172:0/2734980468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 msgr2=0x56432fa29c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 --2- 172.21.15.172:0/2734980468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa29c00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4764060f00 tx=0x7f476405cfb0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 -- 172.21.15.172:0/2734980468 shutdown_connections 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 --2- 172.21.15.172:0/2734980468 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432f9ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 --2- 172.21.15.172:0/2734980468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa29c00 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 --2- 172.21.15.172:0/2734980468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa22360 0x56432fa427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 -- 172.21.15.172:0/2734980468 >> 172.21.15.172:0/2734980468 conn(0x56432f9c6810 msgr2=0x56432fa44c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 -- 172.21.15.172:0/2734980468 shutdown_connections 2024-04-25T08:45:36.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 -- 172.21.15.172:0/2734980468 wait complete. 2024-04-25T08:45:36.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 -- start start 2024-04-25T08:45:36.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.224+0000 7f477e1bb740 1 Processor -- start 2024-04-25T08:45:36.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa22360 0x56432fa58d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432fa3c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f477e1bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432f9ff330 con 0x56432fa01360 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f477e1bb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432f901340 con 0x56432fa22360 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f477e1bb740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56432f9fa1a0 con 0x56432fa2a140 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f477924f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f477e1bb740 10 client.0 _ll_register_callbacks cb 0x56432f676fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f477924f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34546/0 (socket says 172.21.15.172:34546) 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f477924f640 1 -- 172.21.15.172:0/689542240 learned_addr learned my addr 172.21.15.172:0/689542240 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f4779a50640 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432fa3c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.225+0000 7f4778a4e640 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa22360 0x56432fa58d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477924f640 1 -- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 msgr2=0x56432fa3c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477924f640 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432fa3c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477924f640 1 -- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa22360 msgr2=0x56432fa58d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477924f640 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa22360 0x56432fa58d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477924f640 1 -- 172.21.15.172:0/689542240 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56432f6374f0 con 0x56432fa01360 2024-04-25T08:45:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477924f640 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa587d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f47700139a0 tx=0x7f4770000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a5db4837298e6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f4753fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f4753fff640 1 -- 172.21.15.172:0/689542240 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770013e60 con 0x56432fa01360 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f4753fff640 1 -- 172.21.15.172:0/689542240 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f47700128d0 con 0x56432fa01360 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477e1bb740 1 -- 172.21.15.172:0/689542240 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47640570d0 con 0x56432fa01360 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f4753fff640 1 -- 172.21.15.172:0/689542240 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f477002e050 con 0x56432fa01360 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477e1bb740 10 client.6219 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477e1bb740 1 -- 172.21.15.172:0/689542240 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56432f7a4390 con 0x56432fa01360 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f4753fff640 1 -- 172.21.15.172:0/689542240 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47640570d0 con 0x56432fa01360 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f4753fff640 1 -- 172.21.15.172:0/689542240 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4770031020 con 0x56432fa01360 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477e1bb740 10 client.6219 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477e1bb740 10 client.6219 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477e1bb740 20 client.6219 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477e1bb740 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x56432fa55720 0x56432fa55b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477e1bb740 4 client.6219 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.226+0000 7f477e1bb740 1 -- 172.21.15.172:0/689542240 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56432f970420 con 0x56432fa55720 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.227+0000 7f4778a4e640 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x56432fa55720 0x56432fa55b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.227+0000 7f4778a4e640 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x56432fa55720 0x56432fa55b20 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21618c5d1106cf6c server_cookie=4f09636ea699a11c in_seq=0 out_seq=0 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.227+0000 7f4753fff640 10 client.6219 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.227+0000 7f4753fff640 1 -- 172.21.15.172:0/689542240 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56432f970420 con 0x56432fa55720 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.227+0000 7f4753fff640 10 client.6219 handle_command_reply: tid=0 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.227+0000 7f477e1bb740 1 client.6219 shutdown 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 1 -- 172.21.15.172:0/689542240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 msgr2=0x56432fa587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa587d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f47700139a0 tx=0x7f4770000ed0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 1 -- 172.21.15.172:0/689542240 shutdown_connections 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa22360 0x56432fa58d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x56432fa55720 0x56432fa55b20 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432fa3c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 1 --2- 172.21.15.172:0/689542240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa01360 0x56432fa587d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f4753fff640 0 client.6219 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:36.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 1 -- 172.21.15.172:0/689542240 >> 172.21.15.172:0/689542240 conn(0x56432f9c6810 msgr2=0x56432f9ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 1 -- 172.21.15.172:0/689542240 shutdown_connections 2024-04-25T08:45:36.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 1 -- 172.21.15.172:0/689542240 wait complete. 2024-04-25T08:45:36.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.228+0000 7f477e1bb740 20 client.6219 trim_cache size 0 max 16384 2024-04-25T08:45:36.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.243+0000 7f477e1bb740 1 Processor -- start 2024-04-25T08:45:36.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.243+0000 7f477e1bb740 1 -- start start 2024-04-25T08:45:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.243+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa01360 0x56432fa3b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.243+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa58a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.243+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432fa46f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.243+0000 7f477e1bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774200480 con 0x56432fa22360 2024-04-25T08:45:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.243+0000 7f477e1bb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47741ff6b0 con 0x56432fa01360 2024-04-25T08:45:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.243+0000 7f477e1bb740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47741e6c00 con 0x56432fa2a140 2024-04-25T08:45:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4778a4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa58a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4778a4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa58a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34562/0 (socket says 172.21.15.172:34562) 2024-04-25T08:45:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4778a4e640 1 -- 172.21.15.172:0/1860218427 learned_addr learned my addr 172.21.15.172:0/1860218427 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4779a50640 1 --2- 172.21.15.172:0/1860218427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432fa46f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f477924f640 1 --2- 172.21.15.172:0/1860218427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa01360 0x56432fa3b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4778a4e640 1 -- 172.21.15.172:0/1860218427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 msgr2=0x56432fa46f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4778a4e640 1 --2- 172.21.15.172:0/1860218427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432fa46f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4778a4e640 1 -- 172.21.15.172:0/1860218427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa01360 msgr2=0x56432fa3b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4778a4e640 1 --2- 172.21.15.172:0/1860218427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa01360 0x56432fa3b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4778a4e640 1 -- 172.21.15.172:0/1860218427 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56432f610670 con 0x56432fa22360 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4779a50640 1 --2- 172.21.15.172:0/1860218427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432fa46f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f4778a4e640 1 --2- 172.21.15.172:0/1860218427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa58a80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4764057080 tx=0x7f476405b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f40d5c1f621dada server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f475e7fc640 1 -- 172.21.15.172:0/1860218427 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764021040 con 0x56432fa22360 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f475e7fc640 1 -- 172.21.15.172:0/1860218427 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4764055440 con 0x56432fa22360 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f475e7fc640 1 -- 172.21.15.172:0/1860218427 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764058460 con 0x56432fa22360 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f477e1bb740 1 -- 172.21.15.172:0/1860218427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 msgr2=0x56432fa58a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.244+0000 7f477e1bb740 1 --2- 172.21.15.172:0/1860218427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa58a80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4764057080 tx=0x7f476405b000 comp rx=0 tx=0).stop 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.245+0000 7f477e1bb740 1 -- 172.21.15.172:0/1860218427 shutdown_connections 2024-04-25T08:45:36.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.245+0000 7f477e1bb740 1 --2- 172.21.15.172:0/1860218427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa2a140 0x56432fa46f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.245+0000 7f477e1bb740 1 --2- 172.21.15.172:0/1860218427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa58a80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.245+0000 7f477e1bb740 1 --2- 172.21.15.172:0/1860218427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa01360 0x56432fa3b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.245+0000 7f477e1bb740 1 -- 172.21.15.172:0/1860218427 >> 172.21.15.172:0/1860218427 conn(0x56432f9c6810 msgr2=0x56432fa22740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.245+0000 7f477e1bb740 1 -- 172.21.15.172:0/1860218427 shutdown_connections 2024-04-25T08:45:36.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.245+0000 7f477e1bb740 1 -- 172.21.15.172:0/1860218427 wait complete. 2024-04-25T08:45:36.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.245+0000 7f477e1bb740 1 -- start start 2024-04-25T08:45:36.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.245+0000 7f477e1bb740 1 Processor -- start 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa01360 0x56432faae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa25810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f477e1bb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa2a140 0x56432fa47610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f477e1bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56432fa29d60 con 0x56432fa22360 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f477e1bb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47741e7200 con 0x56432fa2a140 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f477e1bb740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56432f8e3270 con 0x56432fa01360 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f477e1bb740 10 client.0 _ll_register_callbacks cb 0x7f4764058ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f4778a4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa25810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f4778a4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa25810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34572/0 (socket says 172.21.15.172:34572) 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f4778a4e640 1 -- 172.21.15.172:0/1330703139 learned_addr learned my addr 172.21.15.172:0/1330703139 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f477924f640 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa01360 0x56432faae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.246+0000 7f4779a50640 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa2a140 0x56432fa47610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4778a4e640 1 -- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa01360 msgr2=0x56432faae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4778a4e640 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa01360 0x56432faae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4778a4e640 1 -- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa2a140 msgr2=0x56432fa47610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4778a4e640 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa2a140 0x56432fa47610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4778a4e640 1 -- 172.21.15.172:0/1330703139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56432fa48840 con 0x56432fa22360 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4779a50640 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa2a140 0x56432fa47610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4778a4e640 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa25810 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f476400e8b0 tx=0x7f47640096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2855ced1938376 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4753fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4753fff640 1 -- 172.21.15.172:0/1330703139 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764021070 con 0x56432fa22360 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4753fff640 1 -- 172.21.15.172:0/1330703139 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4764058420 con 0x56432fa22360 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f477e1bb740 1 -- 172.21.15.172:0/1330703139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4764055440 con 0x56432fa22360 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4753fff640 1 -- 172.21.15.172:0/1330703139 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f476407f050 con 0x56432fa22360 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f477e1bb740 10 client.6225 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f477e1bb740 1 -- 172.21.15.172:0/1330703139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x56432fa2c680 con 0x56432fa22360 2024-04-25T08:45:36.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4753fff640 1 -- 172.21.15.172:0/1330703139 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4764055440 con 0x56432fa22360 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f4753fff640 1 -- 172.21.15.172:0/1330703139 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4764082020 con 0x56432fa22360 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f477e1bb740 10 client.6225 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f477e1bb740 10 client.6225 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f477e1bb740 20 client.6225 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f477e1bb740 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x56432fa58a80 0x56432fa58e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f477e1bb740 4 client.6225 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f477e1bb740 1 -- 172.21.15.172:0/1330703139 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) v1 -- 0x56432f96a770 con 0x56432fa58a80 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.247+0000 7f477924f640 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x56432fa58a80 0x56432fa58e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477924f640 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x56432fa58a80 0x56432fa58e60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2a4e8c3e6ca8a6 server_cookie=6d7e1a59adf122ed in_seq=0 out_seq=0 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f4753fff640 10 client.6225 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f4753fff640 1 -- 172.21.15.172:0/1330703139 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56432f96a770 con 0x56432fa58a80 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f4753fff640 10 client.6225 handle_command_reply: tid=0 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 client.6225 shutdown 2024-04-25T08:45:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 -- 172.21.15.172:0/1330703139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 msgr2=0x56432fa25810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa25810 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f476400e8b0 tx=0x7f47640096a0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 -- 172.21.15.172:0/1330703139 shutdown_connections 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56432fa2a140 0x56432fa47610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x56432fa58a80 0x56432fa58e60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56432fa22360 0x56432fa25810 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 --2- 172.21.15.172:0/1330703139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56432fa01360 0x56432faae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f4753fff640 0 client.6225 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 -- 172.21.15.172:0/1330703139 >> 172.21.15.172:0/1330703139 conn(0x56432f9c6810 msgr2=0x56432f9fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 -- 172.21.15.172:0/1330703139 shutdown_connections 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.248+0000 7f477e1bb740 1 -- 172.21.15.172:0/1330703139 wait complete. 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477e1bb740 20 client.6225 trim_cache size 0 max 16384 2024-04-25T08:45:36.246 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:36.247 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:45:36.247 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "c1f2bdf3-9562-48ad-a866-88583900e966", 2024-04-25T08:45:36.247 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:45:36.247 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 -- 172.21.15.172:0/2746155515 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f475806b500 msgr2=0x7f475806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f475806b500 0x7f475806d9c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4770000f60 tx=0x7f4770007d50 comp rx=0 tx=0).stop 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 -- 172.21.15.172:0/2746155515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 msgr2=0x7f47741e3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 0x7f47741e3fa0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f476400e8e0 tx=0x7f476400eda0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 -- 172.21.15.172:0/2746155515 shutdown_connections 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f475806b500 0x7f475806d9c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4774158230 0x7f47741e44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f477406c7e0 0x7f47741e3fa0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 --2- 172.21.15.172:0/2746155515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f477406c330 0x7f477415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 -- 172.21.15.172:0/2746155515 >> 172.21.15.172:0/2746155515 conn(0x7f4774061600 msgr2=0x7f47740b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 -- 172.21.15.172:0/2746155515 shutdown_connections 2024-04-25T08:45:36.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.249+0000 7f477b4b3640 1 -- 172.21.15.172:0/2746155515 wait complete. 2024-04-25T08:45:36.249 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T08:45:36.249+0000 7ff2db958640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096a [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v450 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5458=0-4194304@1} caps={5458=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5458 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55e010761600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x1000000096a:[<0x10000000001/new_file_0 v450>,<0x10000000000/ceph-qa-suite v38>,<0x1/scrub_test_path v9>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-04-25T08:45:36.251 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': 'c1f2bdf3-9562-48ad-a866-88583900e966', 'mode': 'asynchronous'}' 2024-04-25T08:45:36.251 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:45:36.252 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T08:45:36.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.360+0000 7f0f8f4f5640 1 Processor -- start 2024-04-25T08:45:36.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.360+0000 7f0f8f4f5640 1 -- start start 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8f4f5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0f880cc4f0 0x7f0f880cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8f4f5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0f8815b980 0x7f0f880cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8f4f5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f88072280 con 0x7f0f880cdb20 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8f4f5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f88071270 con 0x7f0f880cc4f0 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8f4f5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f8815bd80 con 0x7f0f8815b980 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8ca90640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0f880cdb20 0x7f0f8815b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:49724/0 (socket says 172.21.15.172:49724) 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8d291640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0f880cc4f0 0x7f0f880cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8ca90640 1 -- 172.21.15.172:0/3305809007 learned_addr learned my addr 172.21.15.172:0/3305809007 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8da92640 1 --2- 172.21.15.172:0/3305809007 >> v2:172.21.15.186:3300/0 conn(0x7f0f8815b980 0x7f0f880cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8d291640 1 -- 172.21.15.172:0/3305809007 >> v2:172.21.15.186:3300/0 conn(0x7f0f8815b980 msgr2=0x7f0f880cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8d291640 1 --2- 172.21.15.172:0/3305809007 >> v2:172.21.15.186:3300/0 conn(0x7f0f8815b980 0x7f0f880cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8d291640 1 -- 172.21.15.172:0/3305809007 >> v1:172.21.15.172:6789/0 conn(0x7f0f880cdb20 legacy=0x7f0f8815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f8d291640 1 -- 172.21.15.172:0/3305809007 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880714c0 con 0x7f0f880cc4f0 2024-04-25T08:45:36.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.361+0000 7f0f7ffff640 1 -- 172.21.15.172:0/3305809007 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199648509 0 0) 0x7f0f88072280 con 0x7f0f880cdb20 2024-04-25T08:45:36.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.362+0000 7f0f8d291640 1 --2- 172.21.15.172:0/3305809007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cc4f0 0x7f0f880cc8d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0f880b4c00 tx=0x7f0f8402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476b70a29fb30654 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.362+0000 7f0f7ffff640 1 -- 172.21.15.172:0/3305809007 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84037070 con 0x7f0f880cc4f0 2024-04-25T08:45:36.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.362+0000 7f0f7ffff640 1 -- 172.21.15.172:0/3305809007 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f84032440 con 0x7f0f880cc4f0 2024-04-25T08:45:36.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.362+0000 7f0f7ffff640 1 -- 172.21.15.172:0/3305809007 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84032810 con 0x7f0f880cc4f0 2024-04-25T08:45:36.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.363+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3305809007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cc4f0 msgr2=0x7f0f880cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.363+0000 7f0f8f4f5640 1 --2- 172.21.15.172:0/3305809007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cc4f0 0x7f0f880cc8d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0f880b4c00 tx=0x7f0f8402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.363+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3305809007 shutdown_connections 2024-04-25T08:45:36.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.363+0000 7f0f8f4f5640 1 --2- 172.21.15.172:0/3305809007 >> v2:172.21.15.186:3300/0 conn(0x7f0f8815b980 0x7f0f880cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.363+0000 7f0f8f4f5640 1 --2- 172.21.15.172:0/3305809007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cc4f0 0x7f0f880cc8d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.363+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3305809007 >> 172.21.15.172:0/3305809007 conn(0x7f0f8806abe0 msgr2=0x7f0f8806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.363+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3305809007 shutdown_connections 2024-04-25T08:45:36.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.363+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3305809007 wait complete. 2024-04-25T08:45:36.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.364+0000 7f0f8f4f5640 1 Processor -- start 2024-04-25T08:45:36.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.364+0000 7f0f8f4f5640 1 -- start start 2024-04-25T08:45:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.364+0000 7f0f8f4f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f880cc4f0 0x7f0f88142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8f4f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cdb20 0x7f0f880ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8f4f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f8815b980 0x7f0f881e3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8f4f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88071d60 con 0x7f0f880cdb20 2024-04-25T08:45:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8f4f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88071a80 con 0x7f0f8815b980 2024-04-25T08:45:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8f4f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880ae500 con 0x7f0f880cc4f0 2024-04-25T08:45:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8ca90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cdb20 0x7f0f880ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8ca90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cdb20 0x7f0f880ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34584/0 (socket says 172.21.15.172:34584) 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8ca90640 1 -- 172.21.15.172:0/3254292474 learned_addr learned my addr 172.21.15.172:0/3254292474 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8d291640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f880cc4f0 0x7f0f88142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8da92640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f8815b980 0x7f0f881e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8ca90640 1 -- 172.21.15.172:0/3254292474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f880cc4f0 msgr2=0x7f0f88142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f880cc4f0 0x7f0f88142240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8ca90640 1 -- 172.21.15.172:0/3254292474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f8815b980 msgr2=0x7f0f881e3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f8815b980 0x7f0f881e3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8ca90640 1 -- 172.21.15.172:0/3254292474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880af1c0 con 0x7f0f880cdb20 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8d291640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f880cc4f0 0x7f0f88142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cdb20 0x7f0f880ae8c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c500 tx=0x7f0f7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f7dffb640 1 -- 172.21.15.172:0/3254292474 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78018070 con 0x7f0f880cdb20 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f7dffb640 1 -- 172.21.15.172:0/3254292474 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f78007580 con 0x7f0f880cdb20 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3254292474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f880af4a0 con 0x7f0f880cdb20 2024-04-25T08:45:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f7dffb640 1 -- 172.21.15.172:0/3254292474 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78004a20 con 0x7f0f880cdb20 2024-04-25T08:45:36.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.365+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3254292474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f880afcc0 con 0x7f0f880cdb20 2024-04-25T08:45:36.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.367+0000 7f0f7dffb640 1 -- 172.21.15.172:0/3254292474 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0f7801b070 con 0x7f0f880cdb20 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.367+0000 7f0f7dffb640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0f6c06b4d0 0x7f0f6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.367+0000 7f0f7dffb640 1 -- 172.21.15.172:0/3254292474 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0f78089630 con 0x7f0f880cdb20 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.367+0000 7f0f8d291640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0f6c06b4d0 0x7f0f6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.368+0000 7f0f8d291640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0f6c06b4d0 0x7f0f6c06d990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0f84034000 tx=0x7f0f8402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.368+0000 7f0f921f5740 1 Processor -- start 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.368+0000 7f0f921f5740 1 -- start start 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497abb10 0x563e497ae320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e4977e770 0x563e49781f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f921f5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e496e7da0 con 0x563e497abef0 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f921f5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e49690b80 con 0x563e4977e770 2024-04-25T08:45:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f921f5740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e496e3e40 con 0x563e497abb10 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8ca90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8ca90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34590/0 (socket says 172.21.15.172:34590) 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8ca90640 1 -- 172.21.15.172:0/1396756817 learned_addr learned my addr 172.21.15.172:0/1396756817 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8d291640 1 --2- 172.21.15.172:0/1396756817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497abb10 0x563e497ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8da92640 1 --2- 172.21.15.172:0/1396756817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e4977e770 0x563e49781f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8ca90640 1 -- 172.21.15.172:0/1396756817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497abb10 msgr2=0x563e497ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/1396756817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497abb10 0x563e497ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8ca90640 1 -- 172.21.15.172:0/1396756817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e4977e770 msgr2=0x563e49781f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/1396756817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e4977e770 0x563e49781f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8ca90640 1 -- 172.21.15.172:0/1396756817 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e4969af10 con 0x563e497abef0 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.369+0000 7f0f8da92640 1 --2- 172.21.15.172:0/1396756817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e4977e770 0x563e49781f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/1396756817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497ae860 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0f78087a00 tx=0x7f0f78057d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7569ee72a5a54547 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f72ffd640 1 -- 172.21.15.172:0/1396756817 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7805e0c0 con 0x563e497abef0 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f72ffd640 1 -- 172.21.15.172:0/1396756817 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f78055d50 con 0x563e497abef0 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f72ffd640 1 -- 172.21.15.172:0/1396756817 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78054320 con 0x563e497abef0 2024-04-25T08:45:36.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f921f5740 1 -- 172.21.15.172:0/1396756817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 msgr2=0x563e497ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f921f5740 1 --2- 172.21.15.172:0/1396756817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497ae860 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0f78087a00 tx=0x7f0f78057d70 comp rx=0 tx=0).stop 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f921f5740 1 -- 172.21.15.172:0/1396756817 shutdown_connections 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f921f5740 1 --2- 172.21.15.172:0/1396756817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e4977e770 0x563e49781f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f921f5740 1 --2- 172.21.15.172:0/1396756817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497ae860 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f921f5740 1 --2- 172.21.15.172:0/1396756817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497abb10 0x563e497ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f921f5740 1 -- 172.21.15.172:0/1396756817 >> 172.21.15.172:0/1396756817 conn(0x563e497809e0 msgr2=0x563e497c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f921f5740 1 -- 172.21.15.172:0/1396756817 shutdown_connections 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.370+0000 7f0f921f5740 1 -- 172.21.15.172:0/1396756817 wait complete. 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.371+0000 7f0f921f5740 1 -- start start 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.371+0000 7f0f921f5740 1 Processor -- start 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 0x563e497a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497b0ad0 0x563e497ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f921f5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e49783b90 con 0x563e497abef0 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f921f5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e496864b0 con 0x563e497abb10 2024-04-25T08:45:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f921f5740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e49783e70 con 0x563e497b0ad0 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f921f5740 10 client.0 _ll_register_callbacks cb 0x563e496c6180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8ca90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8ca90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34602/0 (socket says 172.21.15.172:34602) 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8ca90640 1 -- 172.21.15.172:0/485725195 learned_addr learned my addr 172.21.15.172:0/485725195 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8da92640 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497b0ad0 0x563e497ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8d291640 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 0x563e497a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8ca90640 1 -- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497b0ad0 msgr2=0x563e497ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497b0ad0 0x563e497ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8ca90640 1 -- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 msgr2=0x563e497a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 0x563e497a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8ca90640 1 -- 172.21.15.172:0/485725195 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e494c67d0 con 0x563e497abef0 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8d291640 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 0x563e497a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497b0590 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0f780579b0 tx=0x7f0f7805a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c497c89a7fab7b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f67fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:36.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f67fff640 1 -- 172.21.15.172:0/485725195 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78004dc0 con 0x563e497abef0 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f67fff640 1 -- 172.21.15.172:0/485725195 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0f78057100 con 0x563e497abef0 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.372+0000 7f0f921f5740 1 -- 172.21.15.172:0/485725195 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f78055d50 con 0x563e497abef0 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f67fff640 1 -- 172.21.15.172:0/485725195 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f78057300 con 0x563e497abef0 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f921f5740 10 client.6240 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f921f5740 1 -- 172.21.15.172:0/485725195 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x563e493fc3f0 con 0x563e497abef0 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f67fff640 1 -- 172.21.15.172:0/485725195 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f78055d50 con 0x563e497abef0 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f67fff640 1 -- 172.21.15.172:0/485725195 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0f78076b80 con 0x563e497abef0 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f921f5740 10 client.6240 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f921f5740 10 client.6240 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f921f5740 20 client.6240 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f921f5740 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x563e497ca920 0x563e497cad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f921f5740 4 client.6240 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f921f5740 1 -- 172.21.15.172:0/485725195 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e496f52e0 con 0x563e497ca920 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f8d291640 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x563e497ca920 0x563e497cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f8d291640 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x563e497ca920 0x563e497cad20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=654f91f580b281a1 server_cookie=74d2abf592e6158a in_seq=0 out_seq=0 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.373+0000 7f0f67fff640 10 client.6240 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f67fff640 1 -- 172.21.15.172:0/485725195 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563e496f52e0 con 0x563e497ca920 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f67fff640 10 client.6240 handle_command_reply: tid=0 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 client.6240 shutdown 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 -- 172.21.15.172:0/485725195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 msgr2=0x563e497b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497b0590 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0f780579b0 tx=0x7f0f7805a040 comp rx=0 tx=0).stop 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 -- 172.21.15.172:0/485725195 shutdown_connections 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x563e497ca920 0x563e497cad20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497b0ad0 0x563e497ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497b0590 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f67fff640 0 client.6240 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 --2- 172.21.15.172:0/485725195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 0x563e497a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 -- 172.21.15.172:0/485725195 >> 172.21.15.172:0/485725195 conn(0x563e4977e770 msgr2=0x563e497ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 -- 172.21.15.172:0/485725195 shutdown_connections 2024-04-25T08:45:36.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 1 -- 172.21.15.172:0/485725195 wait complete. 2024-04-25T08:45:36.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.374+0000 7f0f921f5740 20 client.6240 trim_cache size 0 max 16384 2024-04-25T08:45:36.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.389+0000 7f0f921f5740 1 Processor -- start 2024-04-25T08:45:36.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.389+0000 7f0f921f5740 1 -- start start 2024-04-25T08:45:36.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 0x563e497cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497b0ad0 0x563e4977ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f921f5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f881fdfd0 con 0x563e497abef0 2024-04-25T08:45:36.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f921f5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f881fd170 con 0x563e497abb10 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f921f5740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880b0fc0 con 0x563e497b0ad0 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f8ca90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f8ca90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34614/0 (socket says 172.21.15.172:34614) 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f8ca90640 1 -- 172.21.15.172:0/3673517794 learned_addr learned my addr 172.21.15.172:0/3673517794 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f8da92640 1 --2- 172.21.15.172:0/3673517794 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497b0ad0 0x563e4977ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f8d291640 1 --2- 172.21.15.172:0/3673517794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 0x563e497cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f8ca90640 1 -- 172.21.15.172:0/3673517794 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497b0ad0 msgr2=0x563e4977ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/3673517794 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497b0ad0 0x563e4977ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f8ca90640 1 -- 172.21.15.172:0/3673517794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 msgr2=0x563e497cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/3673517794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 0x563e497cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.390+0000 7f0f8ca90640 1 -- 172.21.15.172:0/3673517794 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e493bc0f0 con 0x563e497abef0 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/3673517794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497cad00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800cec0 tx=0x7f0f78088000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f080bf0be6fe264d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f727fc640 1 -- 172.21.15.172:0/3673517794 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7805be00 con 0x563e497abef0 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f727fc640 1 -- 172.21.15.172:0/3673517794 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f78055d50 con 0x563e497abef0 2024-04-25T08:45:36.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f727fc640 1 -- 172.21.15.172:0/3673517794 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78004bc0 con 0x563e497abef0 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f921f5740 1 -- 172.21.15.172:0/3673517794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 msgr2=0x563e497cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f921f5740 1 --2- 172.21.15.172:0/3673517794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497cad00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800cec0 tx=0x7f0f78088000 comp rx=0 tx=0).stop 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f921f5740 1 -- 172.21.15.172:0/3673517794 shutdown_connections 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f921f5740 1 --2- 172.21.15.172:0/3673517794 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497b0ad0 0x563e4977ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f921f5740 1 --2- 172.21.15.172:0/3673517794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497abef0 0x563e497cad00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f921f5740 1 --2- 172.21.15.172:0/3673517794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abb10 0x563e497cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f921f5740 1 -- 172.21.15.172:0/3673517794 >> 172.21.15.172:0/3673517794 conn(0x563e4977e770 msgr2=0x563e497dbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f921f5740 1 -- 172.21.15.172:0/3673517794 shutdown_connections 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.391+0000 7f0f921f5740 1 -- 172.21.15.172:0/3673517794 wait complete. 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.392+0000 7f0f921f5740 1 -- start start 2024-04-25T08:45:36.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.392+0000 7f0f921f5740 1 Processor -- start 2024-04-25T08:45:36.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497abb10 0x563e4977e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abef0 0x563e497bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f921f5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497b0ad0 0x563e497a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f921f5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e496ea2d0 con 0x563e497b0ad0 2024-04-25T08:45:36.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f921f5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880b15c0 con 0x563e497abef0 2024-04-25T08:45:36.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f921f5740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e497a98d0 con 0x563e497abb10 2024-04-25T08:45:36.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f921f5740 10 client.0 _ll_register_callbacks cb 0x7f0f78053f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:36.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8da92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497b0ad0 0x563e497a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8da92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497b0ad0 0x563e497a8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34626/0 (socket says 172.21.15.172:34626) 2024-04-25T08:45:36.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8da92640 1 -- 172.21.15.172:0/552534307 learned_addr learned my addr 172.21.15.172:0/552534307 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8ca90640 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abef0 0x563e497bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8d291640 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497abb10 0x563e4977e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8da92640 1 -- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497abb10 msgr2=0x563e4977e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8da92640 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497abb10 0x563e4977e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8da92640 1 -- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abef0 msgr2=0x563e497bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8da92640 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abef0 0x563e497bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8da92640 1 -- 172.21.15.172:0/552534307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e497bf5f0 con 0x563e497b0ad0 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f8da92640 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497b0ad0 0x563e497a8b80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0f80007ad0 tx=0x7f0f80007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dbf31feafe0daf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f67fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f67fff640 1 -- 172.21.15.172:0/552534307 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8001e070 con 0x563e497b0ad0 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f67fff640 1 -- 172.21.15.172:0/552534307 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0f80015bc0 con 0x563e497b0ad0 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.393+0000 7f0f921f5740 1 -- 172.21.15.172:0/552534307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f78055d50 con 0x563e497b0ad0 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f67fff640 1 -- 172.21.15.172:0/552534307 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f80015dc0 con 0x563e497b0ad0 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f921f5740 10 client.6246 fetch_fsmap learned FSMap version 23 2024-04-25T08:45:36.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f921f5740 1 -- 172.21.15.172:0/552534307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x563e497dc140 con 0x563e497b0ad0 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f67fff640 1 -- 172.21.15.172:0/552534307 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f78055d50 con 0x563e497b0ad0 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f67fff640 1 -- 172.21.15.172:0/552534307 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0f8002c080 con 0x563e497b0ad0 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f921f5740 10 client.6246 fetch_fsmap finished waiting for FSMap version 23 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f921f5740 10 client.6246 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f921f5740 20 client.6246 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f921f5740 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x563e497dd300 0x563e49837050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f921f5740 4 client.6246 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f921f5740 1 -- 172.21.15.172:0/552534307 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563e496ef630 con 0x563e497dd300 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.394+0000 7f0f8d291640 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x563e497dd300 0x563e49837050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f67fff640 10 client.6246 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f8d291640 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x563e497dd300 0x563e49837050 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b34a6522e62f4d server_cookie=18ac0924aa68eea8 in_seq=0 out_seq=0 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f67fff640 1 -- 172.21.15.172:0/552534307 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+696 (crc 0 0 0) 0x563e496ef630 con 0x563e497dd300 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f67fff640 10 client.6246 handle_command_reply: tid=0 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 client.6246 shutdown 2024-04-25T08:45:36.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 -- 172.21.15.172:0/552534307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497b0ad0 msgr2=0x563e497a8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497b0ad0 0x563e497a8b80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0f80007ad0 tx=0x7f0f80007f90 comp rx=0 tx=0).stop 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 -- 172.21.15.172:0/552534307 shutdown_connections 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563e497abef0 0x563e497bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x563e497dd300 0x563e49837050 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e497b0ad0 0x563e497a8b80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 --2- 172.21.15.172:0/552534307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563e497abb10 0x563e4977e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f67fff640 0 client.6246 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 -- 172.21.15.172:0/552534307 >> 172.21.15.172:0/552534307 conn(0x563e4977e770 msgr2=0x563e497cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 -- 172.21.15.172:0/552534307 shutdown_connections 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 1 -- 172.21.15.172:0/552534307 wait complete. 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.395+0000 7f0f921f5740 20 client.6246 trim_cache size 0 max 16384 2024-04-25T08:45:36.392 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": { 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "53229c38-a8f6-4285-88e7-4dd2399d222e": { 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "/", 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "tag": "53229c38-a8f6-4285-88e7-4dd2399d222e", 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "options": "" 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "c1f2bdf3-9562-48ad-a866-88583900e966": { 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "tag": "c1f2bdf3-9562-48ad-a866-88583900e966", 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "options": "" 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "e76e497a-4d52-45b1-be2a-d2c761cbf0ed": { 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-04-25T08:45:36.393 INFO:teuthology.orchestra.run.smithi172.stdout: "tag": "e76e497a-4d52-45b1-be2a-d2c761cbf0ed", 2024-04-25T08:45:36.394 INFO:teuthology.orchestra.run.smithi172.stdout: "options": "" 2024-04-25T08:45:36.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:36.394 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:36.394 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:36.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3254292474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0f6c06b4d0 msgr2=0x7f0f6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0f6c06b4d0 0x7f0f6c06d990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0f84034000 tx=0x7f0f8402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3254292474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cdb20 msgr2=0x7f0f880ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cdb20 0x7f0f880ae8c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c500 tx=0x7f0f7800c9c0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3254292474 shutdown_connections 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0f6c06b4d0 0x7f0f6c06d990 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f8815b980 0x7f0f881e3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f880cdb20 0x7f0f880ae8c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 --2- 172.21.15.172:0/3254292474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f880cc4f0 0x7f0f88142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3254292474 >> 172.21.15.172:0/3254292474 conn(0x7f0f8806abe0 msgr2=0x7f0f880cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3254292474 shutdown_connections 2024-04-25T08:45:36.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:36.396+0000 7f0f8f4f5640 1 -- 172.21.15.172:0/3254292474 wait complete. 2024-04-25T08:45:39.301 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:45:39.310+0000 7f9415334640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T08:45:41.399 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:45:41.399 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T08:45:41.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.520+0000 7f8b96bab640 1 Processor -- start 2024-04-25T08:45:41.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.520+0000 7f8b96bab640 1 -- start start 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b96bab640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8b900ce230 0x7f8b900cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b96bab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b9015b270 0x7f8b9015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b96bab640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b90072280 con 0x7f8b900cc4f0 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b96bab640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b90071270 con 0x7f8b900ce230 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b96bab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b900714c0 con 0x7f8b9015b270 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b87fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8b900ce230 0x7f8b900cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b87fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8b900ce230 0x7f8b900cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54408/0 (socket says 172.21.15.172:54408) 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b87fff640 1 -- 172.21.15.172:0/1686456525 learned_addr learned my addr 172.21.15.172:0/1686456525 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b95148640 1 --2- 172.21.15.172:0/1686456525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b9015b270 0x7f8b9015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b87fff640 1 -- 172.21.15.172:0/1686456525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b9015b270 msgr2=0x7f8b9015b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b87fff640 1 --2- 172.21.15.172:0/1686456525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b9015b270 0x7f8b9015b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b87fff640 1 -- 172.21.15.172:0/1686456525 >> v1:172.21.15.186:6789/0 conn(0x7f8b900cc4f0 legacy=0x7f8b900cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.521+0000 7f8b87fff640 1 -- 172.21.15.172:0/1686456525 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b900717a0 con 0x7f8b900ce230 2024-04-25T08:45:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.522+0000 7f8b87fff640 1 --2- 172.21.15.172:0/1686456525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b900ce230 0x7f8b900cc8d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000bb10 tx=0x7f8b8002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a37c6ea7eecdf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.522+0000 7f8b877fe640 1 -- 172.21.15.172:0/1686456525 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80036020 con 0x7f8b900ce230 2024-04-25T08:45:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.522+0000 7f8b877fe640 1 -- 172.21.15.172:0/1686456525 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b80032820 con 0x7f8b900ce230 2024-04-25T08:45:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.522+0000 7f8b877fe640 1 -- 172.21.15.172:0/1686456525 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80032bf0 con 0x7f8b900ce230 2024-04-25T08:45:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.523+0000 7f8b96bab640 1 -- 172.21.15.172:0/1686456525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b900ce230 msgr2=0x7f8b900cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.523+0000 7f8b96bab640 1 --2- 172.21.15.172:0/1686456525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b900ce230 0x7f8b900cc8d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000bb10 tx=0x7f8b8002c920 comp rx=0 tx=0).stop 2024-04-25T08:45:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.523+0000 7f8b96bab640 1 -- 172.21.15.172:0/1686456525 shutdown_connections 2024-04-25T08:45:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.523+0000 7f8b96bab640 1 --2- 172.21.15.172:0/1686456525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b9015b270 0x7f8b9015b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.523+0000 7f8b96bab640 1 --2- 172.21.15.172:0/1686456525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b900ce230 0x7f8b900cc8d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.523+0000 7f8b96bab640 1 -- 172.21.15.172:0/1686456525 >> 172.21.15.172:0/1686456525 conn(0x7f8b9006abe0 msgr2=0x7f8b9006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.523+0000 7f8b96bab640 1 -- 172.21.15.172:0/1686456525 shutdown_connections 2024-04-25T08:45:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.523+0000 7f8b96bab640 1 -- 172.21.15.172:0/1686456525 wait complete. 2024-04-25T08:45:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.524+0000 7f8b96bab640 1 Processor -- start 2024-04-25T08:45:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.524+0000 7f8b96bab640 1 -- start start 2024-04-25T08:45:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b96bab640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b900cc4f0 0x7f8b90145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b96bab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b900ce230 0x7f8b90155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b96bab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9015b270 0x7f8b901f7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b96bab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9015bbf0 con 0x7f8b9015b270 2024-04-25T08:45:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b96bab640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b90071d60 con 0x7f8b900cc4f0 2024-04-25T08:45:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b96bab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9015bd70 con 0x7f8b900ce230 2024-04-25T08:45:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b95148640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9015b270 0x7f8b901f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b95148640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9015b270 0x7f8b901f7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54422/0 (socket says 172.21.15.172:54422) 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b95148640 1 -- 172.21.15.172:0/2448331534 learned_addr learned my addr 172.21.15.172:0/2448331534 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b87fff640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b900ce230 0x7f8b90155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b94947640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b900cc4f0 0x7f8b90145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b95148640 1 -- 172.21.15.172:0/2448331534 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b900ce230 msgr2=0x7f8b90155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b95148640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b900ce230 0x7f8b90155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b95148640 1 -- 172.21.15.172:0/2448331534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b900cc4f0 msgr2=0x7f8b90145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b95148640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b900cc4f0 0x7f8b90145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b95148640 1 -- 172.21.15.172:0/2448331534 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b90157f60 con 0x7f8b9015b270 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b87fff640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b900ce230 0x7f8b90155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.525+0000 7f8b94947640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b900cc4f0 0x7f8b90145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.526+0000 7f8b95148640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9015b270 0x7f8b901f7090 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8b88007e70 tx=0x7f8b8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.526+0000 7f8b857fa640 1 -- 172.21.15.172:0/2448331534 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88014620 con 0x7f8b9015b270 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.526+0000 7f8b857fa640 1 -- 172.21.15.172:0/2448331534 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88019070 con 0x7f8b9015b270 2024-04-25T08:45:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.526+0000 7f8b96bab640 1 -- 172.21.15.172:0/2448331534 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b90158240 con 0x7f8b9015b270 2024-04-25T08:45:41.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.526+0000 7f8b857fa640 1 -- 172.21.15.172:0/2448331534 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88014a20 con 0x7f8b9015b270 2024-04-25T08:45:41.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.526+0000 7f8b96bab640 1 -- 172.21.15.172:0/2448331534 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b901531e0 con 0x7f8b9015b270 2024-04-25T08:45:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.527+0000 7f8b857fa640 1 -- 172.21.15.172:0/2448331534 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8b88014bc0 con 0x7f8b9015b270 2024-04-25T08:45:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.528+0000 7f8b857fa640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8b7c06b4d0 0x7f8b7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.528+0000 7f8b94947640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8b7c06b4d0 0x7f8b7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.528+0000 7f8b857fa640 1 -- 172.21.15.172:0/2448331534 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8b8808ac90 con 0x7f8b9015b270 2024-04-25T08:45:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.528+0000 7f8b94947640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8b7c06b4d0 0x7f8b7c06d990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c001660 tx=0x7f8b8c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.529+0000 7f8b99981740 1 Processor -- start 2024-04-25T08:45:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.529+0000 7f8b99981740 1 -- start start 2024-04-25T08:45:41.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b99981740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d0b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b99981740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d08ef0 0x564a11d0b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b99981740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11cdb770 0x564a11cdef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b99981740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a11c44da0 con 0x564a11d08b10 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b99981740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a11bedb80 con 0x564a11d08ef0 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b99981740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a11c40e40 con 0x564a11cdb770 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b94947640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d0b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b94947640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d0b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54426/0 (socket says 172.21.15.172:54426) 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b94947640 1 -- 172.21.15.172:0/631635090 learned_addr learned my addr 172.21.15.172:0/631635090 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b95148640 1 --2- 172.21.15.172:0/631635090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11cdb770 0x564a11cdef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b94947640 1 -- 172.21.15.172:0/631635090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11cdb770 msgr2=0x564a11cdef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b94947640 1 --2- 172.21.15.172:0/631635090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11cdb770 0x564a11cdef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b87fff640 1 --2- 172.21.15.172:0/631635090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d08ef0 0x564a11d0b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b94947640 1 -- 172.21.15.172:0/631635090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d08ef0 msgr2=0x564a11d0b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b94947640 1 --2- 172.21.15.172:0/631635090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d08ef0 0x564a11d0b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b94947640 1 -- 172.21.15.172:0/631635090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a11bf7f10 con 0x564a11d08b10 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b94947640 1 --2- 172.21.15.172:0/631635090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d0b320 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c007fa0 tx=0x7f8b8c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ea86e6f0d5f776 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b767fc640 1 -- 172.21.15.172:0/631635090 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c0035f0 con 0x564a11d08b10 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b767fc640 1 -- 172.21.15.172:0/631635090 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c003790 con 0x564a11d08b10 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.530+0000 7f8b767fc640 1 -- 172.21.15.172:0/631635090 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c003b40 con 0x564a11d08b10 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.531+0000 7f8b99981740 1 -- 172.21.15.172:0/631635090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 msgr2=0x564a11d0b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.531+0000 7f8b99981740 1 --2- 172.21.15.172:0/631635090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d0b320 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c007fa0 tx=0x7f8b8c011000 comp rx=0 tx=0).stop 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.531+0000 7f8b99981740 1 -- 172.21.15.172:0/631635090 shutdown_connections 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.531+0000 7f8b99981740 1 --2- 172.21.15.172:0/631635090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d08ef0 0x564a11d0b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.531+0000 7f8b99981740 1 --2- 172.21.15.172:0/631635090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11cdb770 0x564a11cdef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.531+0000 7f8b99981740 1 --2- 172.21.15.172:0/631635090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d0b320 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.531+0000 7f8b99981740 1 -- 172.21.15.172:0/631635090 >> 172.21.15.172:0/631635090 conn(0x564a11cdd9e0 msgr2=0x564a11d26320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.531+0000 7f8b99981740 1 -- 172.21.15.172:0/631635090 shutdown_connections 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.531+0000 7f8b99981740 1 -- 172.21.15.172:0/631635090 wait complete. 2024-04-25T08:45:41.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.532+0000 7f8b99981740 1 -- start start 2024-04-25T08:45:41.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.532+0000 7f8b99981740 1 Processor -- start 2024-04-25T08:45:41.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b99981740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d22360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b99981740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d1cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b99981740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d00130 0x564a11d1d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b99981740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a11ce0b90 con 0x564a11d08b10 2024-04-25T08:45:41.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b99981740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a11be34b0 con 0x564a11d00130 2024-04-25T08:45:41.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b99981740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a11ce0e70 con 0x564a11d08ef0 2024-04-25T08:45:41.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b99981740 10 client.0 _ll_register_callbacks cb 0x564a11c23180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b94947640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d22360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b94947640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d22360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54436/0 (socket says 172.21.15.172:54436) 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b94947640 1 -- 172.21.15.172:0/2529581475 learned_addr learned my addr 172.21.15.172:0/2529581475 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b87fff640 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d1cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b95148640 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d00130 0x564a11d1d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b94947640 1 -- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 msgr2=0x564a11d1cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b94947640 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d1cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b94947640 1 -- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d00130 msgr2=0x564a11d1d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b94947640 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d00130 0x564a11d1d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b94947640 1 -- 172.21.15.172:0/2529581475 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a11a237d0 con 0x564a11d08b10 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b94947640 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d22360 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c007f70 tx=0x7f8b8c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba945a2dd90a67df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:41.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2529581475 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c021860 con 0x564a11d08b10 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2529581475 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8b8c021a00 con 0x564a11d08b10 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.533+0000 7f8b99981740 1 -- 172.21.15.172:0/2529581475 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b8c003790 con 0x564a11d08b10 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2529581475 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b8c003e30 con 0x564a11d08b10 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b99981740 10 client.6258 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b99981740 1 -- 172.21.15.172:0/2529581475 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x564a119593f0 con 0x564a11d08b10 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2529581475 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c003790 con 0x564a11d08b10 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2529581475 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8b8c021c00 con 0x564a11d08b10 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b99981740 10 client.6258 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b99981740 10 client.6258 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b99981740 20 client.6258 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b99981740 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564a11d1f8b0 0x564a11d1fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b99981740 4 client.6258 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b99981740 1 -- 172.21.15.172:0/2529581475 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a11c522e0 con 0x564a11d1f8b0 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b87fff640 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564a11d1f8b0 0x564a11d1fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b87fff640 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564a11d1f8b0 0x564a11d1fc90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=840f10cc61f591f8 server_cookie=8538ed9d240e5a94 in_seq=0 out_seq=0 2024-04-25T08:45:41.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.534+0000 7f8b6f7fe640 10 client.6258 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2529581475 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564a11c522e0 con 0x564a11d1f8b0 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b6f7fe640 10 client.6258 handle_command_reply: tid=0 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 client.6258 shutdown 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 -- 172.21.15.172:0/2529581475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 msgr2=0x564a11d22360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d22360 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c007f70 tx=0x7f8b8c013000 comp rx=0 tx=0).stop 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 -- 172.21.15.172:0/2529581475 shutdown_connections 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d00130 0x564a11d1d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564a11d1f8b0 0x564a11d1fc90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d1cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 --2- 172.21.15.172:0/2529581475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d22360 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b6f7fe640 0 client.6258 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 -- 172.21.15.172:0/2529581475 >> 172.21.15.172:0/2529581475 conn(0x564a11cdb770 msgr2=0x564a11cdc420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 -- 172.21.15.172:0/2529581475 shutdown_connections 2024-04-25T08:45:41.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 1 -- 172.21.15.172:0/2529581475 wait complete. 2024-04-25T08:45:41.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.535+0000 7f8b99981740 20 client.6258 trim_cache size 0 max 16384 2024-04-25T08:45:41.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.550+0000 7f8b99981740 1 Processor -- start 2024-04-25T08:45:41.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.551+0000 7f8b99981740 1 -- start start 2024-04-25T08:45:41.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.551+0000 7f8b99981740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d00130 0x564a11d2e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.551+0000 7f8b99981740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d3f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.551+0000 7f8b99981740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d3f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.551+0000 7f8b99981740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b90200420 con 0x564a11d08b10 2024-04-25T08:45:41.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.551+0000 7f8b99981740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b901ff630 con 0x564a11d00130 2024-04-25T08:45:41.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.551+0000 7f8b99981740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b901541b0 con 0x564a11d08ef0 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.551+0000 7f8b87fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d3f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.551+0000 7f8b87fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d3f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54440/0 (socket says 172.21.15.172:54440) 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.551+0000 7f8b87fff640 1 -- 172.21.15.172:0/1985889259 learned_addr learned my addr 172.21.15.172:0/1985889259 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.552+0000 7f8b87fff640 1 -- 172.21.15.172:0/1985889259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 msgr2=0x564a11d3f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.552+0000 7f8b87fff640 1 --2- 172.21.15.172:0/1985889259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d3f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.552+0000 7f8b87fff640 1 -- 172.21.15.172:0/1985889259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d00130 msgr2=0x564a11d2e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.552+0000 7f8b94947640 1 --2- 172.21.15.172:0/1985889259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d00130 0x564a11d2e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.552+0000 7f8b87fff640 1 --2- 172.21.15.172:0/1985889259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d00130 0x564a11d2e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.552+0000 7f8b87fff640 1 -- 172.21.15.172:0/1985889259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a119190f0 con 0x564a11d08b10 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.552+0000 7f8b87fff640 1 --2- 172.21.15.172:0/1985889259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d3f460 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000b2c0 tx=0x7f8b80031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3dd332f2f25a4dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.552+0000 7f8b75ffb640 1 -- 172.21.15.172:0/1985889259 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80036040 con 0x564a11d08b10 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.552+0000 7f8b75ffb640 1 -- 172.21.15.172:0/1985889259 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b80046430 con 0x564a11d08b10 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.552+0000 7f8b75ffb640 1 -- 172.21.15.172:0/1985889259 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80046820 con 0x564a11d08b10 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 -- 172.21.15.172:0/1985889259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 msgr2=0x564a11d3f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 --2- 172.21.15.172:0/1985889259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d3f460 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000b2c0 tx=0x7f8b80031000 comp rx=0 tx=0).stop 2024-04-25T08:45:41.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 -- 172.21.15.172:0/1985889259 shutdown_connections 2024-04-25T08:45:41.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 --2- 172.21.15.172:0/1985889259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d3f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 --2- 172.21.15.172:0/1985889259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d08b10 0x564a11d3f460 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 --2- 172.21.15.172:0/1985889259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d00130 0x564a11d2e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 -- 172.21.15.172:0/1985889259 >> 172.21.15.172:0/1985889259 conn(0x564a11cdb770 msgr2=0x564a11d48810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 -- 172.21.15.172:0/1985889259 shutdown_connections 2024-04-25T08:45:41.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 -- 172.21.15.172:0/1985889259 wait complete. 2024-04-25T08:45:41.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 -- start start 2024-04-25T08:45:41.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.553+0000 7f8b99981740 1 Processor -- start 2024-04-25T08:45:41.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b99981740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d00130 0x564a11d906c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b99981740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d08b10 0x564a11d0e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b99981740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d0e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b99981740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a11cff9a0 con 0x564a11d00130 2024-04-25T08:45:41.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b99981740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b901547b0 con 0x564a11d08b10 2024-04-25T08:45:41.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b99981740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a11d0f850 con 0x564a11d08ef0 2024-04-25T08:45:41.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b99981740 10 client.0 _ll_register_callbacks cb 0x7f8b8c0013a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b94947640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d00130 0x564a11d906c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b94947640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d00130 0x564a11d906c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54452/0 (socket says 172.21.15.172:54452) 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b94947640 1 -- 172.21.15.172:0/2316473959 learned_addr learned my addr 172.21.15.172:0/2316473959 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b87fff640 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d08b10 0x564a11d0e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.554+0000 7f8b95148640 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d0e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b94947640 1 -- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 msgr2=0x564a11d0e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b94947640 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d0e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b94947640 1 -- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d08b10 msgr2=0x564a11d0e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b94947640 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d08b10 0x564a11d0e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b94947640 1 -- 172.21.15.172:0/2316473959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a11d35ac0 con 0x564a11d00130 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b95148640 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d0e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b94947640 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d00130 0x564a11d906c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00e5d0 tx=0x7f8b8c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc0c82a342abfbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2316473959 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c02b610 con 0x564a11d00130 2024-04-25T08:45:41.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2316473959 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8b8c038cc0 con 0x564a11d00130 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b99981740 1 -- 172.21.15.172:0/2316473959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b80046430 con 0x564a11d00130 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2316473959 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b8c03e050 con 0x564a11d00130 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b99981740 10 client.6264 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b99981740 1 -- 172.21.15.172:0/2316473959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x564a11d25b90 con 0x564a11d00130 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2316473959 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b80046430 con 0x564a11d00130 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2316473959 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8b8c041020 con 0x564a11d00130 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b99981740 10 client.6264 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b99981740 10 client.6264 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b99981740 20 client.6264 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b99981740 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564a11d22460 0x564a11cdf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b99981740 4 client.6264 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b99981740 1 -- 172.21.15.172:0/2316473959 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564a11c4c630 con 0x564a11d22460 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.555+0000 7f8b87fff640 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564a11d22460 0x564a11cdf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b6f7fe640 10 client.6264 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:41.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b87fff640 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564a11d22460 0x564a11cdf3b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=676759ff46ef3305 server_cookie=5f4ea08cc8e3f81e in_seq=0 out_seq=0 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b6f7fe640 1 -- 172.21.15.172:0/2316473959 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564a11c4c630 con 0x564a11d22460 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b6f7fe640 10 client.6264 handle_command_reply: tid=0 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 client.6264 shutdown 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 -- 172.21.15.172:0/2316473959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d00130 msgr2=0x564a11d906c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d00130 0x564a11d906c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00e5d0 tx=0x7f8b8c000bc0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 -- 172.21.15.172:0/2316473959 shutdown_connections 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564a11d08b10 0x564a11d0e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564a11d22460 0x564a11cdf3b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564a11d08ef0 0x564a11d0e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b6f7fe640 0 client.6264 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 --2- 172.21.15.172:0/2316473959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a11d00130 0x564a11d906c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 -- 172.21.15.172:0/2316473959 >> 172.21.15.172:0/2316473959 conn(0x564a11cdb770 msgr2=0x564a11d3f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 -- 172.21.15.172:0/2316473959 shutdown_connections 2024-04-25T08:45:41.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.556+0000 7f8b99981740 1 -- 172.21.15.172:0/2316473959 wait complete. 2024-04-25T08:45:41.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b99981740 20 client.6264 trim_cache size 0 max 16384 2024-04-25T08:45:41.554 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:41.554 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "no active scrubs running", 2024-04-25T08:45:41.554 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": {} 2024-04-25T08:45:41.554 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 -- 172.21.15.172:0/2448331534 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8b7c06b4d0 msgr2=0x7f8b7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8b7c06b4d0 0x7f8b7c06d990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c001660 tx=0x7f8b8c009040 comp rx=0 tx=0).stop 2024-04-25T08:45:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 -- 172.21.15.172:0/2448331534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9015b270 msgr2=0x7f8b901f7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9015b270 0x7f8b901f7090 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8b88007e70 tx=0x7f8b8800e4b0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 -- 172.21.15.172:0/2448331534 shutdown_connections 2024-04-25T08:45:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8b7c06b4d0 0x7f8b7c06d990 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9015b270 0x7f8b901f7090 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b900ce230 0x7f8b90155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 --2- 172.21.15.172:0/2448331534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b900cc4f0 0x7f8b90145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 -- 172.21.15.172:0/2448331534 >> 172.21.15.172:0/2448331534 conn(0x7f8b9006abe0 msgr2=0x7f8b9006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 -- 172.21.15.172:0/2448331534 shutdown_connections 2024-04-25T08:45:41.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.557+0000 7f8b96bab640 1 -- 172.21.15.172:0/2448331534 wait complete. 2024-04-25T08:45:41.559 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:45:41.559 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:41.560 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T08:45:41.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.668+0000 7f64d58dd640 1 Processor -- start 2024-04-25T08:45:41.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.668+0000 7f64d58dd640 1 -- start start 2024-04-25T08:45:41.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64d58dd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d0161710 0x7f64d00d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64d58dd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d015e000 con 0x7f64d015dc20 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64d58dd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d00d1de0 con 0x7f64d00ced80 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64d58dd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0161c60 con 0x7f64d0161710 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64ceffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f64d015dc20 0x7f64d00ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45404/0 (socket says 172.21.15.172:45404) 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64ceffd640 1 -- 172.21.15.172:0/3869890791 learned_addr learned my addr 172.21.15.172:0/3869890791 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d0161710 0x7f64d00d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132857813 0 0) 0x7f64d015e000 con 0x7f64d015dc20 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b8003520 con 0x7f64d015dc20 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375669609 0 0) 0x7f64d00d1de0 con 0x7f64d00ced80 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d015e000 con 0x7f64d00ced80 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 258690612 0 0) 0x7f64b8003520 con 0x7f64d015dc20 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d0161710 msgr2=0x7f64d00d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64cdffb640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d0161710 0x7f64d00d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 >> v1:172.21.15.186:6789/0 conn(0x7f64d00ced80 legacy=0x7f64d00d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.669+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0161f40 con 0x7f64d015dc20 2024-04-25T08:45:41.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f64c0001670 con 0x7f64d015dc20 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 >> v1:172.21.15.172:6789/0 conn(0x7f64d015dc20 legacy=0x7f64d00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64cdffb640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64b8003b70 0x7f64b8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64cdffb640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 0x7f64b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64cdffb640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d0161710 0x7f64b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0161c60 con 0x7f64b8004800 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b800ba70 con 0x7f64b8003b70 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b800bc40 con 0x7f64d0161710 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 0x7f64b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64ceffd640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64b8003b70 0x7f64b8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d0161710 0x7f64b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64ce7fc640 1 -- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d0161710 msgr2=0x7f64b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d0161710 0x7f64b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64ce7fc640 1 -- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64b8003b70 msgr2=0x7f64b8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64b8003b70 0x7f64b8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.670+0000 7f64ce7fc640 1 -- 172.21.15.172:0/3869890791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8003520 con 0x7f64b8004800 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 0x7f64b8004c80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f64c40018d0 tx=0x7f64b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1ef185b48c8608 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40014f0 con 0x7f64b8004800 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c40052d0 con 0x7f64b8004800 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64cdffb640 1 -- 172.21.15.172:0/3869890791 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c402ac30 con 0x7f64b8004800 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64d58dd640 1 -- 172.21.15.172:0/3869890791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 msgr2=0x7f64b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64d58dd640 1 --2- 172.21.15.172:0/3869890791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 0x7f64b8004c80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f64c40018d0 tx=0x7f64b8005830 comp rx=0 tx=0).stop 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64cf7fe640 1 -- 172.21.15.172:0/3869890791 reap_dead start 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64d58dd640 1 -- 172.21.15.172:0/3869890791 shutdown_connections 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64d58dd640 1 -- 172.21.15.172:0/3869890791 >> 172.21.15.172:0/3869890791 conn(0x7f64d00d0420 msgr2=0x7f64d00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64d58dd640 1 -- 172.21.15.172:0/3869890791 shutdown_connections 2024-04-25T08:45:41.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.671+0000 7f64d58dd640 1 -- 172.21.15.172:0/3869890791 wait complete. 2024-04-25T08:45:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.673+0000 7f64d58dd640 1 Processor -- start 2024-04-25T08:45:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.673+0000 7f64d58dd640 1 -- start start 2024-04-25T08:45:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.673+0000 7f64d58dd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 0x7f64d00c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.673+0000 7f64d58dd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d015f260 0x7f64d0148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.673+0000 7f64d58dd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d015f6e0 0x7f64d01490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.673+0000 7f64d58dd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00b5e50 con 0x7f64b8004800 2024-04-25T08:45:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.673+0000 7f64d58dd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0162500 con 0x7f64d015f6e0 2024-04-25T08:45:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.673+0000 7f64d58dd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00b5fd0 con 0x7f64d015f260 2024-04-25T08:45:41.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.673+0000 7f64ceffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 0x7f64d00c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64ceffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 0x7f64d00c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54466/0 (socket says 172.21.15.172:54466) 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64ceffd640 1 -- 172.21.15.172:0/2084617576 learned_addr learned my addr 172.21.15.172:0/2084617576 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d015f6e0 0x7f64d01490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d015f260 0x7f64d0148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64ceffd640 1 -- 172.21.15.172:0/2084617576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d015f260 msgr2=0x7f64d0148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64ceffd640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d015f260 0x7f64d0148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64ceffd640 1 -- 172.21.15.172:0/2084617576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d015f6e0 msgr2=0x7f64d01490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64ceffd640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d015f6e0 0x7f64d01490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64ceffd640 1 -- 172.21.15.172:0/2084617576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d01496f0 con 0x7f64b8004800 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d015f260 0x7f64d0148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64ceffd640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 0x7f64d00c9d20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f64c00073a0 tx=0x7f64c0007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64b7fff640 1 -- 172.21.15.172:0/2084617576 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c001a070 con 0x7f64b8004800 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64b7fff640 1 -- 172.21.15.172:0/2084617576 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c000f8e0 con 0x7f64b8004800 2024-04-25T08:45:41.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64d58dd640 1 -- 172.21.15.172:0/2084617576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d01499d0 con 0x7f64b8004800 2024-04-25T08:45:41.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64b7fff640 1 -- 172.21.15.172:0/2084617576 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000fc90 con 0x7f64b8004800 2024-04-25T08:45:41.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.674+0000 7f64d58dd640 1 -- 172.21.15.172:0/2084617576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d0159c50 con 0x7f64b8004800 2024-04-25T08:45:41.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.676+0000 7f64b7fff640 1 -- 172.21.15.172:0/2084617576 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64c001d070 con 0x7f64b8004800 2024-04-25T08:45:41.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.676+0000 7f64b7fff640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64bc06b4d0 0x7f64bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.676+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64bc06b4d0 0x7f64bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.676+0000 7f64b7fff640 1 -- 172.21.15.172:0/2084617576 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f64c0089da0 con 0x7f64b8004800 2024-04-25T08:45:41.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.677+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64bc06b4d0 0x7f64bc06d990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f64c4032000 tx=0x7f64c4009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.677+0000 7f64d85db740 1 Processor -- start 2024-04-25T08:45:41.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.677+0000 7f64d85db740 1 -- start start 2024-04-25T08:45:41.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64d85db740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1aa0 0x55cb20ac42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64d85db740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1e80 0x55cb20ac47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64d85db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20a94700 0x55cb20a97f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64d85db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb209fde00 con 0x55cb20a94700 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64d85db740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb209a6d20 con 0x55cb20ac1aa0 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64d85db740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb209f9ea0 con 0x55cb20ac1e80 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64cf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20a94700 0x55cb20a97f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64cf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20a94700 0x55cb20a97f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54470/0 (socket says 172.21.15.172:54470) 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64cf7fe640 1 -- 172.21.15.172:0/3229803462 learned_addr learned my addr 172.21.15.172:0/3229803462 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/3229803462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1e80 0x55cb20ac47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64ceffd640 1 --2- 172.21.15.172:0/3229803462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1aa0 0x55cb20ac42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64cf7fe640 1 -- 172.21.15.172:0/3229803462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1e80 msgr2=0x55cb20ac47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/3229803462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1e80 0x55cb20ac47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64cf7fe640 1 -- 172.21.15.172:0/3229803462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1aa0 msgr2=0x55cb20ac42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/3229803462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1aa0 0x55cb20ac42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64cf7fe640 1 -- 172.21.15.172:0/3229803462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb209c8df0 con 0x55cb20a94700 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.678+0000 7f64ceffd640 1 --2- 172.21.15.172:0/3229803462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1aa0 0x55cb20ac42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.679+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/3229803462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20a94700 0x55cb20a97f10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f64d00b33d0 tx=0x7f64c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2e842b3d14d6a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.679+0000 7f64b57fa640 1 -- 172.21.15.172:0/3229803462 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8016810 con 0x55cb20a94700 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.679+0000 7f64b57fa640 1 -- 172.21.15.172:0/3229803462 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c80169b0 con 0x55cb20a94700 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.679+0000 7f64b57fa640 1 -- 172.21.15.172:0/3229803462 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8016d60 con 0x55cb20a94700 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.679+0000 7f64d85db740 1 -- 172.21.15.172:0/3229803462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20a94700 msgr2=0x55cb20a97f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.679+0000 7f64d85db740 1 --2- 172.21.15.172:0/3229803462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20a94700 0x55cb20a97f10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f64d00b33d0 tx=0x7f64c8009750 comp rx=0 tx=0).stop 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.680+0000 7f64d85db740 1 -- 172.21.15.172:0/3229803462 shutdown_connections 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.680+0000 7f64d85db740 1 --2- 172.21.15.172:0/3229803462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20a94700 0x55cb20a97f10 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.680+0000 7f64d85db740 1 --2- 172.21.15.172:0/3229803462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1e80 0x55cb20ac47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.680+0000 7f64d85db740 1 --2- 172.21.15.172:0/3229803462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1aa0 0x55cb20ac42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.680+0000 7f64d85db740 1 -- 172.21.15.172:0/3229803462 >> 172.21.15.172:0/3229803462 conn(0x55cb20a96970 msgr2=0x55cb20adf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.680+0000 7f64d85db740 1 -- 172.21.15.172:0/3229803462 shutdown_connections 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.680+0000 7f64d85db740 1 -- 172.21.15.172:0/3229803462 wait complete. 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.680+0000 7f64d85db740 1 -- start start 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.680+0000 7f64d85db740 1 Processor -- start 2024-04-25T08:45:41.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64d85db740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20ae2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64d85db740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1e80 0x55cb20ae2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64d85db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ae1e80 0x55cb20ae03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64d85db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb20a99b20 con 0x55cb20ae1e80 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64d85db740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2099c590 con 0x55cb20ac1e80 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64d85db740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb20a99e00 con 0x55cb20ac1aa0 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64d85db740 10 client.0 _ll_register_callbacks cb 0x55cb209a8e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64cf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ae1e80 0x55cb20ae03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64cf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ae1e80 0x55cb20ae03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54480/0 (socket says 172.21.15.172:54480) 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64cf7fe640 1 -- 172.21.15.172:0/519490265 learned_addr learned my addr 172.21.15.172:0/519490265 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1e80 0x55cb20ae2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64ceffd640 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20ae2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64cf7fe640 1 -- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 msgr2=0x55cb20ae2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20ae2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64cf7fe640 1 -- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1e80 msgr2=0x55cb20ae2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1e80 0x55cb20ae2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64cf7fe640 1 -- 172.21.15.172:0/519490265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb207123f0 con 0x55cb20ae1e80 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64ceffd640 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20ae2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ae1e80 0x55cb20ae03e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f64c8020040 tx=0x7f64c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98507753b454e210 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.681+0000 7f64ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64ae7fc640 1 -- 172.21.15.172:0/519490265 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8029880 con 0x55cb20ae1e80 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64ae7fc640 1 -- 172.21.15.172:0/519490265 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f64c8029a20 con 0x55cb20ae1e80 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64d85db740 1 -- 172.21.15.172:0/519490265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64c80169b0 con 0x55cb20ae1e80 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64ae7fc640 1 -- 172.21.15.172:0/519490265 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64c8037050 con 0x55cb20ae1e80 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64d85db740 10 client.6276 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64d85db740 1 -- 172.21.15.172:0/519490265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55cb207dc7d0 con 0x55cb20ae1e80 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64ae7fc640 1 -- 172.21.15.172:0/519490265 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c80169b0 con 0x55cb20ae1e80 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64ae7fc640 1 -- 172.21.15.172:0/519490265 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f64c803a020 con 0x55cb20ae1e80 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64d85db740 10 client.6276 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64d85db740 10 client.6276 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:41.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64d85db740 20 client.6276 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64d85db740 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55cb20ae0920 0x55cb20ae0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64d85db740 4 client.6276 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64d85db740 1 -- 172.21.15.172:0/519490265 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb20a0b340 con 0x55cb20ae0920 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.682+0000 7f64ceffd640 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55cb20ae0920 0x55cb20ae0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64ae7fc640 10 client.6276 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64ceffd640 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55cb20ae0920 0x55cb20ae0d00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eecb2ee5ffbf0790 server_cookie=c4d98ba0b958d84d in_seq=0 out_seq=0 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64ae7fc640 1 -- 172.21.15.172:0/519490265 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cb20a0b340 con 0x55cb20ae0920 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64ae7fc640 10 client.6276 handle_command_reply: tid=0 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 client.6276 shutdown 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 -- 172.21.15.172:0/519490265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ae1e80 msgr2=0x55cb20ae03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ae1e80 0x55cb20ae03e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f64c8020040 tx=0x7f64c8004a40 comp rx=0 tx=0).stop 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 -- 172.21.15.172:0/519490265 shutdown_connections 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ac1e80 0x55cb20ae2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55cb20ae0920 0x55cb20ae0d00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ae1e80 0x55cb20ae03e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 --2- 172.21.15.172:0/519490265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20ae2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64ae7fc640 0 client.6276 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:41.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 -- 172.21.15.172:0/519490265 >> 172.21.15.172:0/519490265 conn(0x55cb20a94700 msgr2=0x55cb20a953b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 -- 172.21.15.172:0/519490265 shutdown_connections 2024-04-25T08:45:41.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 1 -- 172.21.15.172:0/519490265 wait complete. 2024-04-25T08:45:41.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.683+0000 7f64d85db740 20 client.6276 trim_cache size 0 max 16384 2024-04-25T08:45:41.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.695+0000 7f64d85db740 1 Processor -- start 2024-04-25T08:45:41.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.695+0000 7f64d85db740 1 -- start start 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.696+0000 7f64d85db740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20b010a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.696+0000 7f64d85db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20ac8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.696+0000 7f64d85db740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 0x55cb20adeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.696+0000 7f64d85db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d0200b20 con 0x55cb20ac1e80 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.696+0000 7f64d85db740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d01ffd10 con 0x55cb20ae1e80 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.696+0000 7f64d85db740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d01ff170 con 0x55cb20ac1aa0 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.696+0000 7f64ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20ac8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.696+0000 7f64ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20ac8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54490/0 (socket says 172.21.15.172:54490) 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.696+0000 7f64ce7fc640 1 -- 172.21.15.172:0/3235087423 learned_addr learned my addr 172.21.15.172:0/3235087423 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.696+0000 7f64ce7fc640 1 -- 172.21.15.172:0/3235087423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 msgr2=0x55cb20b010a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64ceffd640 1 --2- 172.21.15.172:0/3235087423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20b010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/3235087423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 0x55cb20adeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/3235087423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20b010a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64ce7fc640 1 -- 172.21.15.172:0/3235087423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 msgr2=0x55cb20adeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/3235087423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 0x55cb20adeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64ce7fc640 1 -- 172.21.15.172:0/3235087423 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb20ae0750 con 0x55cb20ac1e80 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/3235087423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 0x55cb20adeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/3235087423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20ac8310 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f64c40019c0 tx=0x7f64c402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9f0ee8949f0e95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64b4ff9640 1 -- 172.21.15.172:0/3235087423 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4006e10 con 0x55cb20ac1e80 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64b4ff9640 1 -- 172.21.15.172:0/3235087423 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4005380 con 0x55cb20ac1e80 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64b4ff9640 1 -- 172.21.15.172:0/3235087423 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4007240 con 0x55cb20ac1e80 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64d85db740 1 -- 172.21.15.172:0/3235087423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 msgr2=0x55cb20ac8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.697+0000 7f64d85db740 1 --2- 172.21.15.172:0/3235087423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20ac8310 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f64c40019c0 tx=0x7f64c402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.698+0000 7f64d85db740 1 -- 172.21.15.172:0/3235087423 shutdown_connections 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.698+0000 7f64d85db740 1 --2- 172.21.15.172:0/3235087423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 0x55cb20adeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.698+0000 7f64d85db740 1 --2- 172.21.15.172:0/3235087423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20ac8310 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.698+0000 7f64d85db740 1 --2- 172.21.15.172:0/3235087423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20b010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.698+0000 7f64d85db740 1 -- 172.21.15.172:0/3235087423 >> 172.21.15.172:0/3235087423 conn(0x55cb20a94700 msgr2=0x55cb20ac0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.698+0000 7f64d85db740 1 -- 172.21.15.172:0/3235087423 shutdown_connections 2024-04-25T08:45:41.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.698+0000 7f64d85db740 1 -- 172.21.15.172:0/3235087423 wait complete. 2024-04-25T08:45:41.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.698+0000 7f64d85db740 1 -- start start 2024-04-25T08:45:41.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.698+0000 7f64d85db740 1 Processor -- start 2024-04-25T08:45:41.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64d85db740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20ab9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64d85db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20aba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64d85db740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 0x55cb20a94f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64d85db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb20a03080 con 0x55cb20ac1e80 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64d85db740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d01ff710 con 0x55cb20ae1e80 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64d85db740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb20adf090 con 0x55cb20ac1aa0 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64d85db740 10 client.0 _ll_register_callbacks cb 0x7f64c8009210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20aba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20aba1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54494/0 (socket says 172.21.15.172:54494) 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ce7fc640 1 -- 172.21.15.172:0/1160010905 learned_addr learned my addr 172.21.15.172:0/1160010905 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ceffd640 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20ab9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 0x55cb20a94f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ce7fc640 1 -- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 msgr2=0x55cb20ab9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20ab9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ce7fc640 1 -- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 msgr2=0x55cb20a94f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 0x55cb20a94f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ce7fc640 1 -- 172.21.15.172:0/1160010905 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb20a94200 con 0x55cb20ac1e80 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ceffd640 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20ab9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:41.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64cf7fe640 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 0x55cb20a94f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ce7fc640 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20aba1a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f64c4006ba0 tx=0x7f64c402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8d3d461d30e2ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.699+0000 7f64ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64ae7fc640 1 -- 172.21.15.172:0/1160010905 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4055070 con 0x55cb20ac1e80 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64ae7fc640 1 -- 172.21.15.172:0/1160010905 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f64c4006e10 con 0x55cb20ac1e80 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64d85db740 1 -- 172.21.15.172:0/1160010905 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64c4005380 con 0x55cb20ac1e80 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64ae7fc640 1 -- 172.21.15.172:0/1160010905 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64c4062050 con 0x55cb20ac1e80 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64d85db740 10 client.6282 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64d85db740 1 -- 172.21.15.172:0/1160010905 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55cb20abee00 con 0x55cb20ac1e80 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64ae7fc640 1 -- 172.21.15.172:0/1160010905 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4005380 con 0x55cb20ac1e80 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64ae7fc640 1 -- 172.21.15.172:0/1160010905 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f64c4065020 con 0x55cb20ac1e80 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64d85db740 10 client.6282 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64d85db740 10 client.6282 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64d85db740 20 client.6282 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64d85db740 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55cb20abea00 0x55cb20a954b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64d85db740 4 client.6282 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64d85db740 1 -- 172.21.15.172:0/1160010905 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cb20ac45e0 con 0x55cb20abea00 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64ceffd640 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55cb20abea00 0x55cb20a954b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64ceffd640 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55cb20abea00 0x55cb20a954b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc888bbedefdf0ca server_cookie=3e46b2dcadf78e10 in_seq=0 out_seq=0 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.700+0000 7f64ae7fc640 10 client.6282 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64ae7fc640 1 -- 172.21.15.172:0/1160010905 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x55cb20ac45e0 con 0x55cb20abea00 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64ae7fc640 10 client.6282 handle_command_reply: tid=0 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 client.6282 shutdown 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 -- 172.21.15.172:0/1160010905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 msgr2=0x55cb20aba1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20aba1a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f64c4006ba0 tx=0x7f64c402c070 comp rx=0 tx=0).stop 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 -- 172.21.15.172:0/1160010905 shutdown_connections 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55cb20ae1e80 0x55cb20a94f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55cb20abea00 0x55cb20a954b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb20ac1e80 0x55cb20aba1a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64ae7fc640 0 client.6282 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:41.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 --2- 172.21.15.172:0/1160010905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55cb20ac1aa0 0x55cb20ab9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 -- 172.21.15.172:0/1160010905 >> 172.21.15.172:0/1160010905 conn(0x55cb20a94700 msgr2=0x55cb20a99d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 -- 172.21.15.172:0/1160010905 shutdown_connections 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 1 -- 172.21.15.172:0/1160010905 wait complete. 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d85db740 20 client.6282 trim_cache size 0 max 16384 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stdout: "damage_type": "backtrace", 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 3281023262, 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 1099511630186, 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:41.699 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:45:41.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d58dd640 1 -- 172.21.15.172:0/2084617576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64bc06b4d0 msgr2=0x7f64bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d58dd640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64bc06b4d0 0x7f64bc06d990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f64c4032000 tx=0x7f64c4009030 comp rx=0 tx=0).stop 2024-04-25T08:45:41.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d58dd640 1 -- 172.21.15.172:0/2084617576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 msgr2=0x7f64d00c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d58dd640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 0x7f64d00c9d20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f64c00073a0 tx=0x7f64c0007860 comp rx=0 tx=0).stop 2024-04-25T08:45:41.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d58dd640 1 -- 172.21.15.172:0/2084617576 shutdown_connections 2024-04-25T08:45:41.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d58dd640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f64bc06b4d0 0x7f64bc06d990 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d58dd640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d015f6e0 0x7f64d01490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d58dd640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64d015f260 0x7f64d0148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d58dd640 1 --2- 172.21.15.172:0/2084617576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64b8004800 0x7f64d00c9d20 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.701+0000 7f64d58dd640 1 -- 172.21.15.172:0/2084617576 >> 172.21.15.172:0/2084617576 conn(0x7f64d00d0420 msgr2=0x7f64d00b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.702+0000 7f64d58dd640 1 -- 172.21.15.172:0/2084617576 shutdown_connections 2024-04-25T08:45:41.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.702+0000 7f64d58dd640 1 -- 172.21.15.172:0/2084617576 wait complete. 2024-04-25T08:45:41.704 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:41.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.811+0000 7f1ef255c640 1 Processor -- start 2024-04-25T08:45:41.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.811+0000 7f1ef255c640 1 -- start start 2024-04-25T08:45:41.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.811+0000 7f1ef255c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1eec1602e0 0x7f1eec0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.811+0000 7f1ef255c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec0cd710 con 0x7f1eec15f5f0 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.811+0000 7f1ef255c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec099b70 con 0x7f1eec15ba00 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.811+0000 7f1ef255c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eec099e50 con 0x7f1eec1602e0 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.812+0000 7f1ef0af9640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1eec15f5f0 0x7f1eec0c52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45412/0 (socket says 172.21.15.172:45412) 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.812+0000 7f1ef0af9640 1 -- 172.21.15.172:0/3848067811 learned_addr learned my addr 172.21.15.172:0/3848067811 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.812+0000 7f1eeb7fe640 1 --2- 172.21.15.172:0/3848067811 >> v2:172.21.15.186:3300/0 conn(0x7f1eec1602e0 0x7f1eec0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.812+0000 7f1eeaffd640 1 -- 172.21.15.172:0/3848067811 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211370389 0 0) 0x7f1ee4001490 con 0x7f1eec15f5f0 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.812+0000 7f1eeaffd640 1 -- 172.21.15.172:0/3848067811 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed4003520 con 0x7f1eec15f5f0 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.812+0000 7f1eeb7fe640 1 -- 172.21.15.172:0/3848067811 >> v1:172.21.15.186:6789/0 conn(0x7f1eec15ba00 legacy=0x7f1eec09a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.812+0000 7f1eeb7fe640 1 -- 172.21.15.172:0/3848067811 >> v1:172.21.15.172:6789/0 conn(0x7f1eec15f5f0 legacy=0x7f1eec0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.812+0000 7f1eeb7fe640 1 -- 172.21.15.172:0/3848067811 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec09a130 con 0x7f1eec1602e0 2024-04-25T08:45:41.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1eeb7fe640 1 --2- 172.21.15.172:0/3848067811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eec1602e0 0x7f1eec0ccda0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00097a0 tx=0x7f1ee002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d836301e3a4cf296 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1eeaffd640 1 -- 172.21.15.172:0/3848067811 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0037070 con 0x7f1eec1602e0 2024-04-25T08:45:41.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1eeaffd640 1 -- 172.21.15.172:0/3848067811 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee0032440 con 0x7f1eec1602e0 2024-04-25T08:45:41.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1eeaffd640 1 -- 172.21.15.172:0/3848067811 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee002ae60 con 0x7f1eec1602e0 2024-04-25T08:45:41.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1ef255c640 1 -- 172.21.15.172:0/3848067811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eec1602e0 msgr2=0x7f1eec0ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1ef255c640 1 --2- 172.21.15.172:0/3848067811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eec1602e0 0x7f1eec0ccda0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00097a0 tx=0x7f1ee002a110 comp rx=0 tx=0).stop 2024-04-25T08:45:41.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1ef255c640 1 -- 172.21.15.172:0/3848067811 shutdown_connections 2024-04-25T08:45:41.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1ef255c640 1 --2- 172.21.15.172:0/3848067811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eec1602e0 0x7f1eec0ccda0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1ef255c640 1 -- 172.21.15.172:0/3848067811 >> 172.21.15.172:0/3848067811 conn(0x7f1eec0b3270 msgr2=0x7f1eec0b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:41.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1ef255c640 1 -- 172.21.15.172:0/3848067811 shutdown_connections 2024-04-25T08:45:41.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.813+0000 7f1ef255c640 1 -- 172.21.15.172:0/3848067811 wait complete. 2024-04-25T08:45:41.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.815+0000 7f1ef255c640 1 Processor -- start 2024-04-25T08:45:41.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.815+0000 7f1ef255c640 1 -- start start 2024-04-25T08:45:41.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.815+0000 7f1ef255c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eec15ba00 0x7f1eec0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.815+0000 7f1ef255c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1eec15f5f0 0x7f1eec06fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.815+0000 7f1ef255c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eec1602e0 0x7f1eec0af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.815+0000 7f1ef255c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0cd460 con 0x7f1eec1602e0 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.815+0000 7f1ef255c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0cd2e0 con 0x7f1eec15ba00 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.815+0000 7f1ef255c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0c59e0 con 0x7f1eec15f5f0 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef0af9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eec1602e0 0x7f1eec0af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef0af9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eec1602e0 0x7f1eec0af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54502/0 (socket says 172.21.15.172:54502) 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef0af9640 1 -- 172.21.15.172:0/1954412779 learned_addr learned my addr 172.21.15.172:0/1954412779 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1eebfff640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eec15ba00 0x7f1eec0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1eeb7fe640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1eec15f5f0 0x7f1eec06fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef0af9640 1 -- 172.21.15.172:0/1954412779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1eec15f5f0 msgr2=0x7f1eec06fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef0af9640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1eec15f5f0 0x7f1eec06fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef0af9640 1 -- 172.21.15.172:0/1954412779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eec15ba00 msgr2=0x7f1eec0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef0af9640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eec15ba00 0x7f1eec0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef0af9640 1 -- 172.21.15.172:0/1954412779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0b2190 con 0x7f1eec1602e0 2024-04-25T08:45:41.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef0af9640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eec1602e0 0x7f1eec0af050 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400cb50 tx=0x7f1ee400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ee8ff9640 1 -- 172.21.15.172:0/1954412779 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4017070 con 0x7f1eec1602e0 2024-04-25T08:45:41.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ee8ff9640 1 -- 172.21.15.172:0/1954412779 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee400ad40 con 0x7f1eec1602e0 2024-04-25T08:45:41.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ee8ff9640 1 -- 172.21.15.172:0/1954412779 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4012620 con 0x7f1eec1602e0 2024-04-25T08:45:41.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef255c640 1 -- 172.21.15.172:0/1954412779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec0b4310 con 0x7f1eec1602e0 2024-04-25T08:45:41.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.816+0000 7f1ef255c640 1 -- 172.21.15.172:0/1954412779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec0b48b0 con 0x7f1eec1602e0 2024-04-25T08:45:41.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.817+0000 7f1ef255c640 1 -- 172.21.15.172:0/1954412779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eec073990 con 0x7f1eec1602e0 2024-04-25T08:45:41.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.818+0000 7f1ee8ff9640 1 -- 172.21.15.172:0/1954412779 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ee401a070 con 0x7f1eec1602e0 2024-04-25T08:45:41.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.818+0000 7f1ee8ff9640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 0x7f1ed806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:41.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.818+0000 7f1ee8ff9640 1 -- 172.21.15.172:0/1954412779 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1ee408a150 con 0x7f1eec1602e0 2024-04-25T08:45:41.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.818+0000 7f1eebfff640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 0x7f1ed806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:41.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.819+0000 7f1eebfff640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 0x7f1ed806d990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1edc000f60 tx=0x7f1edc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:41.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:41.822+0000 7f1ee8ff9640 1 -- 172.21.15.172:0/1954412779 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1eec0cd710 con 0x7f1eec1602e0 2024-04-25T08:45:42.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.027+0000 7f1ef255c640 1 -- 172.21.15.172:0/1954412779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1eec0b2a40 con 0x7f1eec1602e0 2024-04-25T08:45:42.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.028+0000 7f1ee8ff9640 1 -- 172.21.15.172:0/1954412779 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f1ee4058800 con 0x7f1eec1602e0 2024-04-25T08:45:42.020 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:42.020 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:38.835835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:42.020 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 24 2024-04-25T08:45:42.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 -- 172.21.15.172:0/1954412779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 msgr2=0x7f1ed806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 0x7f1ed806d990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1edc000f60 tx=0x7f1edc009040 comp rx=0 tx=0).stop 2024-04-25T08:45:42.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 -- 172.21.15.172:0/1954412779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eec1602e0 msgr2=0x7f1eec0af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eec1602e0 0x7f1eec0af050 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400cb50 tx=0x7f1ee400a430 comp rx=0 tx=0).stop 2024-04-25T08:45:42.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 -- 172.21.15.172:0/1954412779 shutdown_connections 2024-04-25T08:45:42.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 0x7f1ed806d990 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1eec1602e0 0x7f1eec0af050 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1eec15f5f0 0x7f1eec06fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 --2- 172.21.15.172:0/1954412779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eec15ba00 0x7f1eec0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 -- 172.21.15.172:0/1954412779 >> 172.21.15.172:0/1954412779 conn(0x7f1eec0b3270 msgr2=0x7f1eec0c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:42.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 -- 172.21.15.172:0/1954412779 shutdown_connections 2024-04-25T08:45:42.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.030+0000 7f1ef255c640 1 -- 172.21.15.172:0/1954412779 wait complete. 2024-04-25T08:45:42.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d damage rm 3281023262 2024-04-25T08:45:42.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.141+0000 7f032d734640 1 Processor -- start 2024-04-25T08:45:42.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.141+0000 7f032d734640 1 -- start start 2024-04-25T08:45:42.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f032d734640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f03280ced80 0x7f03280d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f032d734640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0328161710 0x7f03280d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f032d734640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032815e000 con 0x7f032815dc20 2024-04-25T08:45:42.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f032d734640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03280d1de0 con 0x7f03280ced80 2024-04-25T08:45:42.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f032d734640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0328161c60 con 0x7f0328161710 2024-04-25T08:45:42.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f03267fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f03280ced80 0x7f03280d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f0326ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f032815dc20 0x7f03280ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45428/0 (socket says 172.21.15.172:45428) 2024-04-25T08:45:42.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f0326ffd640 1 -- 172.21.15.172:0/1099654105 learned_addr learned my addr 172.21.15.172:0/1099654105 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:42.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f03267fc640 1 -- 172.21.15.172:0/1099654105 >> v2:172.21.15.186:3300/0 conn(0x7f0328161710 msgr2=0x7f03280d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:42.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f03267fc640 1 --2- 172.21.15.172:0/1099654105 >> v2:172.21.15.186:3300/0 conn(0x7f0328161710 0x7f03280d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f03267fc640 1 -- 172.21.15.172:0/1099654105 >> v1:172.21.15.172:6789/0 conn(0x7f032815dc20 legacy=0x7f03280ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f03267fc640 1 -- 172.21.15.172:0/1099654105 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0328161f40 con 0x7f03280ced80 2024-04-25T08:45:42.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.142+0000 7f0325ffb640 1 -- 172.21.15.172:0/1099654105 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924900558 0 0) 0x7f032815e000 con 0x7f032815dc20 2024-04-25T08:45:42.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.143+0000 7f03267fc640 1 --2- 172.21.15.172:0/1099654105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03280ced80 0x7f03280d22e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f03280b6570 tx=0x7f031c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d5490ebc0c4516 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.143+0000 7f0325ffb640 1 -- 172.21.15.172:0/1099654105 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c037070 con 0x7f03280ced80 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.143+0000 7f0325ffb640 1 -- 172.21.15.172:0/1099654105 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c032440 con 0x7f03280ced80 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.143+0000 7f0325ffb640 1 -- 172.21.15.172:0/1099654105 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c032810 con 0x7f03280ced80 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.144+0000 7f032d734640 1 -- 172.21.15.172:0/1099654105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03280ced80 msgr2=0x7f03280d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.144+0000 7f032d734640 1 --2- 172.21.15.172:0/1099654105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03280ced80 0x7f03280d22e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f03280b6570 tx=0x7f031c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.144+0000 7f032d734640 1 -- 172.21.15.172:0/1099654105 shutdown_connections 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.144+0000 7f032d734640 1 --2- 172.21.15.172:0/1099654105 >> v2:172.21.15.186:3300/0 conn(0x7f0328161710 0x7f03280d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.144+0000 7f032d734640 1 --2- 172.21.15.172:0/1099654105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03280ced80 0x7f03280d22e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.144+0000 7f032d734640 1 -- 172.21.15.172:0/1099654105 >> 172.21.15.172:0/1099654105 conn(0x7f03280d0420 msgr2=0x7f03280d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.144+0000 7f032d734640 1 -- 172.21.15.172:0/1099654105 shutdown_connections 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.144+0000 7f032d734640 1 -- 172.21.15.172:0/1099654105 wait complete. 2024-04-25T08:45:42.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.145+0000 7f032d734640 1 Processor -- start 2024-04-25T08:45:42.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.145+0000 7f032d734640 1 -- start start 2024-04-25T08:45:42.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f032d734640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03280ced80 0x7f03281e7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f032d734640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f032815dc20 0x7f03281585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f032d734640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0328161710 0x7f0328158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f032d734640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03280b5e50 con 0x7f032815dc20 2024-04-25T08:45:42.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f032d734640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0328162500 con 0x7f03280ced80 2024-04-25T08:45:42.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f032d734640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03280b5fd0 con 0x7f0328161710 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f03267fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f032815dc20 0x7f03281585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f03267fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f032815dc20 0x7f03281585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54528/0 (socket says 172.21.15.172:54528) 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f03267fc640 1 -- 172.21.15.172:0/1762908961 learned_addr learned my addr 172.21.15.172:0/1762908961 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f0326ffd640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03280ced80 0x7f03281e7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f03277fe640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0328161710 0x7f0328158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f03267fc640 1 -- 172.21.15.172:0/1762908961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0328161710 msgr2=0x7f0328158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f03267fc640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0328161710 0x7f0328158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f03267fc640 1 -- 172.21.15.172:0/1762908961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03280ced80 msgr2=0x7f03281e7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f03267fc640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03280ced80 0x7f03281e7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f03267fc640 1 -- 172.21.15.172:0/1762908961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03281f42c0 con 0x7f032815dc20 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f03267fc640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f032815dc20 0x7f03281585a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f031c000c00 tx=0x7f031c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f030f7fe640 1 -- 172.21.15.172:0/1762908961 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c041070 con 0x7f032815dc20 2024-04-25T08:45:42.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f030f7fe640 1 -- 172.21.15.172:0/1762908961 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c03c950 con 0x7f032815dc20 2024-04-25T08:45:42.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f032d734640 1 -- 172.21.15.172:0/1762908961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03281e8d10 con 0x7f032815dc20 2024-04-25T08:45:42.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f030f7fe640 1 -- 172.21.15.172:0/1762908961 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c037040 con 0x7f032815dc20 2024-04-25T08:45:42.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.146+0000 7f032d734640 1 -- 172.21.15.172:0/1762908961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03281e92d0 con 0x7f032815dc20 2024-04-25T08:45:42.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.148+0000 7f030f7fe640 1 -- 172.21.15.172:0/1762908961 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f031c044070 con 0x7f032815dc20 2024-04-25T08:45:42.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.148+0000 7f030f7fe640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f031406b4d0 0x7f031406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.148+0000 7f030f7fe640 1 -- 172.21.15.172:0/1762908961 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f031c0ab0c0 con 0x7f032815dc20 2024-04-25T08:45:42.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.148+0000 7f0326ffd640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f031406b4d0 0x7f031406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.149+0000 7f0326ffd640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f031406b4d0 0x7f031406d990 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f03180012e0 tx=0x7f0318001630 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.149+0000 7f0330439740 1 Processor -- start 2024-04-25T08:45:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.149+0000 7f0330439740 1 -- start start 2024-04-25T08:45:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f0330439740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c10f80 0x559679c13790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f0330439740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c11360 0x559679c13cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f0330439740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679be3be0 0x559679be73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f0330439740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559679b4cac0 con 0x559679be3be0 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f0330439740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559679af5db0 con 0x559679c11360 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f0330439740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x559679b48b60 con 0x559679c10f80 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f03277fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679be3be0 0x559679be73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f03277fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679be3be0 0x559679be73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54536/0 (socket says 172.21.15.172:54536) 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f03277fe640 1 -- 172.21.15.172:0/960404138 learned_addr learned my addr 172.21.15.172:0/960404138 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f03277fe640 1 -- 172.21.15.172:0/960404138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c10f80 msgr2=0x559679c13790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f03277fe640 1 --2- 172.21.15.172:0/960404138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c10f80 0x559679c13790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f03267fc640 1 --2- 172.21.15.172:0/960404138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c11360 0x559679c13cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f03277fe640 1 -- 172.21.15.172:0/960404138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c11360 msgr2=0x559679c13cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f03277fe640 1 --2- 172.21.15.172:0/960404138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c11360 0x559679c13cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f03277fe640 1 -- 172.21.15.172:0/960404138 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55967992d710 con 0x559679be3be0 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.150+0000 7f03267fc640 1 --2- 172.21.15.172:0/960404138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c11360 0x559679c13cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:42.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f03277fe640 1 --2- 172.21.15.172:0/960404138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679be3be0 0x559679be73f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f032000b7c0 tx=0x7f0320006ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900e80620fe5a1a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f030cff9640 1 -- 172.21.15.172:0/960404138 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320019020 con 0x559679be3be0 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f030cff9640 1 -- 172.21.15.172:0/960404138 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032000f980 con 0x559679be3be0 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f030cff9640 1 -- 172.21.15.172:0/960404138 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032000be60 con 0x559679be3be0 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f0330439740 1 -- 172.21.15.172:0/960404138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679be3be0 msgr2=0x559679be73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f0330439740 1 --2- 172.21.15.172:0/960404138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679be3be0 0x559679be73f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f032000b7c0 tx=0x7f0320006ed0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f0330439740 1 -- 172.21.15.172:0/960404138 shutdown_connections 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f0330439740 1 --2- 172.21.15.172:0/960404138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c11360 0x559679c13cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f0330439740 1 --2- 172.21.15.172:0/960404138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679be3be0 0x559679be73f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f0330439740 1 --2- 172.21.15.172:0/960404138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c10f80 0x559679c13790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.151+0000 7f0330439740 1 -- 172.21.15.172:0/960404138 >> 172.21.15.172:0/960404138 conn(0x559679be5e50 msgr2=0x559679c2e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.152+0000 7f0330439740 1 -- 172.21.15.172:0/960404138 shutdown_connections 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.152+0000 7f0330439740 1 -- 172.21.15.172:0/960404138 wait complete. 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.152+0000 7f0330439740 1 -- start start 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.152+0000 7f0330439740 1 Processor -- start 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0330439740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c06d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0330439740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c11360 0x559679c36890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0330439740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679c14660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0330439740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559679be9000 con 0x559679c10f80 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0330439740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559679aeb4e0 con 0x559679c08090 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0330439740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x559679be92e0 con 0x559679c11360 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0326ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c06d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0330439740 10 client.0 _ll_register_callbacks cb 0x559679860af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0326ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c06d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54544/0 (socket says 172.21.15.172:54544) 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0326ffd640 1 -- 172.21.15.172:0/3478327618 learned_addr learned my addr 172.21.15.172:0/3478327618 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0326ffd640 1 -- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c11360 msgr2=0x559679c36890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f03277fe640 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679c14660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0326ffd640 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c11360 0x559679c36890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0326ffd640 1 -- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 msgr2=0x559679c14660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0326ffd640 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679c14660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0326ffd640 1 -- 172.21.15.172:0/3478327618 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55967998dea0 con 0x559679c10f80 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f03277fe640 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679c14660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0326ffd640 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c06d40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f03180159c0 tx=0x7f0318001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0e564d1e526d89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.153+0000 7f0305ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0305ffb640 1 -- 172.21.15.172:0/3478327618 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318015110 con 0x559679c10f80 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0305ffb640 1 -- 172.21.15.172:0/3478327618 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0318023c60 con 0x559679c10f80 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0330439740 1 -- 172.21.15.172:0/3478327618 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f032000f980 con 0x559679c10f80 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0305ffb640 1 -- 172.21.15.172:0/3478327618 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0318023e60 con 0x559679c10f80 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0330439740 10 client.6303 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0330439740 1 -- 172.21.15.172:0/3478327618 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x559679821000 con 0x559679c10f80 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0305ffb640 1 -- 172.21.15.172:0/3478327618 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032000f980 con 0x559679c10f80 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0305ffb640 1 -- 172.21.15.172:0/3478327618 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f031802a050 con 0x559679c10f80 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0330439740 10 client.6303 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0330439740 10 client.6303 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0330439740 20 client.6303 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0330439740 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559679c2fb20 0x559679c2ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0330439740 4 client.6303 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f0330439740 1 -- 172.21.15.172:0/3478327618 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559679b5a000 con 0x559679c2fb20 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.154+0000 7f03267fc640 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559679c2fb20 0x559679c2ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0305ffb640 10 client.6303 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f03267fc640 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559679c2fb20 0x559679c2ff00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2632d75d0f14a48 server_cookie=55db297e779718bb in_seq=0 out_seq=0 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0305ffb640 1 -- 172.21.15.172:0/3478327618 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559679b5a000 con 0x559679c2fb20 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0305ffb640 10 client.6303 handle_command_reply: tid=0 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 client.6303 shutdown 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 -- 172.21.15.172:0/3478327618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 msgr2=0x559679c06d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c06d40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f03180159c0 tx=0x7f0318001400 comp rx=0 tx=0).stop 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 -- 172.21.15.172:0/3478327618 shutdown_connections 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679c14660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559679c2fb20 0x559679c2ff00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c11360 0x559679c36890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0305ffb640 0 client.6303 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:42.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 --2- 172.21.15.172:0/3478327618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c06d40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 -- 172.21.15.172:0/3478327618 >> 172.21.15.172:0/3478327618 conn(0x559679be3be0 msgr2=0x559679c10230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:42.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 -- 172.21.15.172:0/3478327618 shutdown_connections 2024-04-25T08:45:42.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.155+0000 7f0330439740 1 -- 172.21.15.172:0/3478327618 wait complete. 2024-04-25T08:45:42.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.156+0000 7f0330439740 20 client.6303 trim_cache size 0 max 16384 2024-04-25T08:45:42.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.167+0000 7f0330439740 1 Processor -- start 2024-04-25T08:45:42.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.167+0000 7f0330439740 1 -- start start 2024-04-25T08:45:42.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f0330439740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679be3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f0330439740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c159e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f0330439740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c11360 0x559679c15f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f0330439740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03281ff680 con 0x559679c10f80 2024-04-25T08:45:42.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f0330439740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03281feb30 con 0x559679c08090 2024-04-25T08:45:42.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f0330439740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03281ff080 con 0x559679c11360 2024-04-25T08:45:42.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f03267fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f03267fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c159e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54558/0 (socket says 172.21.15.172:54558) 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f03267fc640 1 -- 172.21.15.172:0/2501158371 learned_addr learned my addr 172.21.15.172:0/2501158371 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f03267fc640 1 -- 172.21.15.172:0/2501158371 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c11360 msgr2=0x559679c15f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f03267fc640 1 --2- 172.21.15.172:0/2501158371 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c11360 0x559679c15f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f03267fc640 1 -- 172.21.15.172:0/2501158371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 msgr2=0x559679be3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f03267fc640 1 --2- 172.21.15.172:0/2501158371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679be3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f03267fc640 1 -- 172.21.15.172:0/2501158371 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559679c157e0 con 0x559679c10f80 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f03267fc640 1 --2- 172.21.15.172:0/2501158371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c159e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f031c079580 tx=0x7f031c009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3c3ef411a2b770 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f0307fff640 1 -- 172.21.15.172:0/2501158371 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c04b040 con 0x559679c10f80 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f0307fff640 1 -- 172.21.15.172:0/2501158371 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c081ee0 con 0x559679c10f80 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.168+0000 7f0307fff640 1 -- 172.21.15.172:0/2501158371 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c077b80 con 0x559679c10f80 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.169+0000 7f0330439740 1 -- 172.21.15.172:0/2501158371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 msgr2=0x559679c159e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.169+0000 7f0330439740 1 --2- 172.21.15.172:0/2501158371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c159e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f031c079580 tx=0x7f031c009110 comp rx=0 tx=0).stop 2024-04-25T08:45:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.169+0000 7f0330439740 1 -- 172.21.15.172:0/2501158371 shutdown_connections 2024-04-25T08:45:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.169+0000 7f0330439740 1 --2- 172.21.15.172:0/2501158371 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c11360 0x559679c15f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.169+0000 7f0330439740 1 --2- 172.21.15.172:0/2501158371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c10f80 0x559679c159e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.169+0000 7f0330439740 1 --2- 172.21.15.172:0/2501158371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679be3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.169+0000 7f0330439740 1 -- 172.21.15.172:0/2501158371 >> 172.21.15.172:0/2501158371 conn(0x559679be3be0 msgr2=0x559679c2e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.169+0000 7f0330439740 1 -- 172.21.15.172:0/2501158371 shutdown_connections 2024-04-25T08:45:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.169+0000 7f0330439740 1 -- 172.21.15.172:0/2501158371 wait complete. 2024-04-25T08:45:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.169+0000 7f0330439740 1 -- start start 2024-04-25T08:45:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f0330439740 1 Processor -- start 2024-04-25T08:45:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f0330439740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679c9c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f0330439740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c10f80 0x559679c9ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f0330439740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c11360 0x559679c159c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f0330439740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559679c08630 con 0x559679c11360 2024-04-25T08:45:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f0330439740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559679c07950 con 0x559679c08090 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f0330439740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x559679c14c40 con 0x559679c10f80 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f0330439740 10 client.0 _ll_register_callbacks cb 0x7f032000b380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f03277fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c11360 0x559679c159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f03277fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c11360 0x559679c159c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54574/0 (socket says 172.21.15.172:54574) 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.170+0000 7f03277fe640 1 -- 172.21.15.172:0/1579295711 learned_addr learned my addr 172.21.15.172:0/1579295711 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0326ffd640 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679c9c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f03267fc640 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c10f80 0x559679c9ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f03277fe640 1 -- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c10f80 msgr2=0x559679c9ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f03277fe640 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c10f80 0x559679c9ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f03277fe640 1 -- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 msgr2=0x559679c9c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f03277fe640 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679c9c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f03277fe640 1 -- 172.21.15.172:0/1579295711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559679c99450 con 0x559679c11360 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f03267fc640 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c10f80 0x559679c9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f03277fe640 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c11360 0x559679c159c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0320018040 tx=0x7f0320004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a096a14500139edc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0305ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0305ffb640 1 -- 172.21.15.172:0/1579295711 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320019030 con 0x559679c11360 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0305ffb640 1 -- 172.21.15.172:0/1579295711 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0320014670 con 0x559679c11360 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0330439740 1 -- 172.21.15.172:0/1579295711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f031c081ee0 con 0x559679c11360 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0305ffb640 1 -- 172.21.15.172:0/1579295711 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0320030050 con 0x559679c11360 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0330439740 10 client.6309 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0330439740 1 -- 172.21.15.172:0/1579295711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x559679c10960 con 0x559679c11360 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0305ffb640 1 -- 172.21.15.172:0/1579295711 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c081ee0 con 0x559679c11360 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0305ffb640 1 -- 172.21.15.172:0/1579295711 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0320033020 con 0x559679c11360 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0330439740 10 client.6309 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0330439740 10 client.6309 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0330439740 20 client.6309 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0330439740 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559679be7260 0x559679be7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0330439740 4 client.6309 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3281023262}] 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.171+0000 7f0330439740 1 -- 172.21.15.172:0/1579295711 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3281023262}) v1 -- 0x559679b54350 con 0x559679be7260 2024-04-25T08:45:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0326ffd640 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559679be7260 0x559679be7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0326ffd640 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559679be7260 0x559679be7640 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6168a5cab5183832 server_cookie=587ccbbaf054f66b in_seq=0 out_seq=0 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0305ffb640 10 client.6309 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0305ffb640 1 -- 172.21.15.172:0/1579295711 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x559679b54350 con 0x559679be7260 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0305ffb640 10 client.6309 handle_command_reply: tid=0 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 client.6309 shutdown 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 -- 172.21.15.172:0/1579295711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c11360 msgr2=0x559679c159c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c11360 0x559679c159c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0320018040 tx=0x7f0320004730 comp rx=0 tx=0).stop 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 -- 172.21.15.172:0/1579295711 shutdown_connections 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x559679be7260 0x559679be7640 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559679c11360 0x559679c159c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0305ffb640 0 client.6309 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559679c10f80 0x559679c9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 --2- 172.21.15.172:0/1579295711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559679c08090 0x559679c9c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 -- 172.21.15.172:0/1579295711 >> 172.21.15.172:0/1579295711 conn(0x559679be3be0 msgr2=0x559679be3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 -- 172.21.15.172:0/1579295711 shutdown_connections 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 1 -- 172.21.15.172:0/1579295711 wait complete. 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.172+0000 7f0330439740 20 client.6309 trim_cache size 0 max 16384 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 -- 172.21.15.172:0/1762908961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f031406b4d0 msgr2=0x7f031406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f031406b4d0 0x7f031406d990 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f03180012e0 tx=0x7f0318001630 comp rx=0 tx=0).stop 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 -- 172.21.15.172:0/1762908961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f032815dc20 msgr2=0x7f03281585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f032815dc20 0x7f03281585a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f031c000c00 tx=0x7f031c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 -- 172.21.15.172:0/1762908961 shutdown_connections 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f031406b4d0 0x7f031406d990 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0328161710 0x7f0328158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f032815dc20 0x7f03281585a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 --2- 172.21.15.172:0/1762908961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03280ced80 0x7f03281e7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 -- 172.21.15.172:0/1762908961 >> 172.21.15.172:0/1762908961 conn(0x7f03280d0420 msgr2=0x7f03280b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 -- 172.21.15.172:0/1762908961 shutdown_connections 2024-04-25T08:45:42.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.173+0000 7f032d734640 1 -- 172.21.15.172:0/1762908961 wait complete. 2024-04-25T08:45:42.175 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-04-25T08:45:42.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:42.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.281+0000 7f639325d640 1 Processor -- start 2024-04-25T08:45:42.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.281+0000 7f639325d640 1 -- start start 2024-04-25T08:45:42.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f639325d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f638c15b980 0x7f638c0cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f639325d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f638c0cffb0 0x7f638c15c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f639325d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c15f710 con 0x7f638c06b5f0 2024-04-25T08:45:42.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f639325d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c15f9b0 con 0x7f638c15b980 2024-04-25T08:45:42.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f639325d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c15fc90 con 0x7f638c0cffb0 2024-04-25T08:45:42.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f6390ff9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f638c15b980 0x7f638c0cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f63917fa640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f638c0cffb0 0x7f638c15c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f6390ff9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f638c15b980 0x7f638c0cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:50406/0 (socket says 172.21.15.172:50406) 2024-04-25T08:45:42.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f638bfff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f638c06b5f0 0x7f638c0cf8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:35920/0 (socket says 172.21.15.172:35920) 2024-04-25T08:45:42.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f6390ff9640 1 -- 172.21.15.172:0/1359813360 learned_addr learned my addr 172.21.15.172:0/1359813360 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:42.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f6390ff9640 1 -- 172.21.15.172:0/1359813360 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f638c0cffb0 msgr2=0x7f638c15c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:42.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f6390ff9640 1 --2- 172.21.15.172:0/1359813360 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f638c0cffb0 0x7f638c15c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f6390ff9640 1 -- 172.21.15.172:0/1359813360 >> v1:172.21.15.186:6789/0 conn(0x7f638c06b5f0 legacy=0x7f638c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.282+0000 7f6390ff9640 1 -- 172.21.15.172:0/1359813360 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c15ff70 con 0x7f638c15b980 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.283+0000 7f6390ff9640 1 --2- 172.21.15.172:0/1359813360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f638c15b980 0x7f638c0cc300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6384009e50 tx=0x7f638402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69a74d8fa70e8e99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.283+0000 7f638b7fe640 1 -- 172.21.15.172:0/1359813360 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384036070 con 0x7f638c15b980 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.283+0000 7f638b7fe640 1 -- 172.21.15.172:0/1359813360 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6384031600 con 0x7f638c15b980 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.283+0000 7f638b7fe640 1 -- 172.21.15.172:0/1359813360 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63840319d0 con 0x7f638c15b980 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.284+0000 7f639325d640 1 -- 172.21.15.172:0/1359813360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f638c15b980 msgr2=0x7f638c0cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.284+0000 7f639325d640 1 --2- 172.21.15.172:0/1359813360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f638c15b980 0x7f638c0cc300 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6384009e50 tx=0x7f638402a710 comp rx=0 tx=0).stop 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.284+0000 7f639325d640 1 -- 172.21.15.172:0/1359813360 shutdown_connections 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.284+0000 7f639325d640 1 --2- 172.21.15.172:0/1359813360 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f638c0cffb0 0x7f638c15c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.284+0000 7f639325d640 1 --2- 172.21.15.172:0/1359813360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f638c15b980 0x7f638c0cc300 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.284+0000 7f639325d640 1 -- 172.21.15.172:0/1359813360 >> 172.21.15.172:0/1359813360 conn(0x7f638c0b2220 msgr2=0x7f638c0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.284+0000 7f639325d640 1 -- 172.21.15.172:0/1359813360 shutdown_connections 2024-04-25T08:45:42.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.284+0000 7f639325d640 1 -- 172.21.15.172:0/1359813360 wait complete. 2024-04-25T08:45:42.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.285+0000 7f639325d640 1 Processor -- start 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.285+0000 7f639325d640 1 -- start start 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f639325d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f638c06b5f0 0x7f638c0b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f639325d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c0cffb0 0x7f638c14c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f639325d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f638c15b980 0x7f638c14cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f639325d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0cf550 con 0x7f638c0cffb0 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f639325d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c15bd60 con 0x7f638c06b5f0 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f639325d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0b2d40 con 0x7f638c15b980 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f638bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c0cffb0 0x7f638c14c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f638bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c0cffb0 0x7f638c14c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54578/0 (socket says 172.21.15.172:54578) 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f638bfff640 1 -- 172.21.15.172:0/2593006651 learned_addr learned my addr 172.21.15.172:0/2593006651 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:42.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f6390ff9640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f638c06b5f0 0x7f638c0b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f63917fa640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f638c15b980 0x7f638c14cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f638bfff640 1 -- 172.21.15.172:0/2593006651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f638c15b980 msgr2=0x7f638c14cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f638bfff640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f638c15b980 0x7f638c14cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f638bfff640 1 -- 172.21.15.172:0/2593006651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f638c06b5f0 msgr2=0x7f638c0b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f638bfff640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f638c06b5f0 0x7f638c0b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f638bfff640 1 -- 172.21.15.172:0/2593006651 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c14c420 con 0x7f638c0cffb0 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.286+0000 7f638bfff640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c0cffb0 0x7f638c14c6e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f637400c370 tx=0x7f637400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.287+0000 7f63897fa640 1 -- 172.21.15.172:0/2593006651 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740074e0 con 0x7f638c0cffb0 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.287+0000 7f63897fa640 1 -- 172.21.15.172:0/2593006651 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6374007680 con 0x7f638c0cffb0 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.287+0000 7f639325d640 1 -- 172.21.15.172:0/2593006651 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c14b380 con 0x7f638c0cffb0 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.287+0000 7f63897fa640 1 -- 172.21.15.172:0/2593006651 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740049e0 con 0x7f638c0cffb0 2024-04-25T08:45:42.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.287+0000 7f639325d640 1 -- 172.21.15.172:0/2593006651 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c14b940 con 0x7f638c0cffb0 2024-04-25T08:45:42.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.288+0000 7f639325d640 1 -- 172.21.15.172:0/2593006651 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c073990 con 0x7f638c0cffb0 2024-04-25T08:45:42.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.288+0000 7f63897fa640 1 -- 172.21.15.172:0/2593006651 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f637401a020 con 0x7f638c0cffb0 2024-04-25T08:45:42.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.288+0000 7f63897fa640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f636c06b500 0x7f636c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.289+0000 7f63897fa640 1 -- 172.21.15.172:0/2593006651 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6374089ac0 con 0x7f638c0cffb0 2024-04-25T08:45:42.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.289+0000 7f6390ff9640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f636c06b500 0x7f636c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.289+0000 7f6390ff9640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f636c06b500 0x7f636c06d9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6384033000 tx=0x7f6384009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.293+0000 7f63897fa640 1 -- 172.21.15.172:0/2593006651 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6374010300 con 0x7f638c0cffb0 2024-04-25T08:45:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.500+0000 7f639325d640 1 -- 172.21.15.172:0/2593006651 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f638c0b6670 con 0x7f638c0cffb0 2024-04-25T08:45:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.501+0000 7f63897fa640 1 -- 172.21.15.172:0/2593006651 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f63740587b0 con 0x7f638c0cffb0 2024-04-25T08:45:42.492 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:42.493 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:38.835835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:42.493 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 24 2024-04-25T08:45:42.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 -- 172.21.15.172:0/2593006651 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f636c06b500 msgr2=0x7f636c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f636c06b500 0x7f636c06d9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6384033000 tx=0x7f6384009000 comp rx=0 tx=0).stop 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 -- 172.21.15.172:0/2593006651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c0cffb0 msgr2=0x7f638c14c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c0cffb0 0x7f638c14c6e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f637400c370 tx=0x7f637400c830 comp rx=0 tx=0).stop 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 -- 172.21.15.172:0/2593006651 shutdown_connections 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f636c06b500 0x7f636c06d9c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f638c15b980 0x7f638c14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c0cffb0 0x7f638c14c6e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 --2- 172.21.15.172:0/2593006651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f638c06b5f0 0x7f638c0b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 -- 172.21.15.172:0/2593006651 >> 172.21.15.172:0/2593006651 conn(0x7f638c0b2220 msgr2=0x7f638c0ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 -- 172.21.15.172:0/2593006651 shutdown_connections 2024-04-25T08:45:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.503+0000 7f639325d640 1 -- 172.21.15.172:0/2593006651 wait complete. 2024-04-25T08:45:42.505 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path / 2024-04-25T08:45:42.620 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:42.620 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": 0 2024-04-25T08:45:42.620 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:42.629 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:45:42.630 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-04-25T08:45:42.630 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-04-25T08:45:42.630 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-04-25T08:45:42.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:42.630 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-04-25T08:45:42.645 DEBUG:teuthology.orchestra.run.smithi172:> stdin-killer -- python3 -c ' 2024-04-25T08:45:42.645 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-04-25T08:45:42.645 DEBUG:teuthology.orchestra.run.smithi172:> import stat 2024-04-25T08:45:42.645 DEBUG:teuthology.orchestra.run.smithi172:> import json 2024-04-25T08:45:42.645 DEBUG:teuthology.orchestra.run.smithi172:> import sys 2024-04-25T08:45:42.645 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:45:42.645 DEBUG:teuthology.orchestra.run.smithi172:> try: 2024-04-25T08:45:42.645 DEBUG:teuthology.orchestra.run.smithi172:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-04-25T08:45:42.645 DEBUG:teuthology.orchestra.run.smithi172:> except OSError as e: 2024-04-25T08:45:42.646 DEBUG:teuthology.orchestra.run.smithi172:> sys.exit(e.errno) 2024-04-25T08:45:42.646 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:45:42.646 DEBUG:teuthology.orchestra.run.smithi172:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T08:45:42.646 DEBUG:teuthology.orchestra.run.smithi172:> print(json.dumps( 2024-04-25T08:45:42.646 DEBUG:teuthology.orchestra.run.smithi172:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T08:45:42.646 DEBUG:teuthology.orchestra.run.smithi172:> indent=2)) 2024-04-25T08:45:42.646 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-04-25T08:45:42.751 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: "st_mode": 16877, 2024-04-25T08:45:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: "st_ino": 1099511627777, 2024-04-25T08:45:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: "st_dev": 43, 2024-04-25T08:45:42.751 INFO:teuthology.orchestra.run.smithi172.stdout: "st_nlink": 16, 2024-04-25T08:45:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "st_uid": 1000, 2024-04-25T08:45:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "st_gid": 1316, 2024-04-25T08:45:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "st_size": 18, 2024-04-25T08:45:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "st_atime": 1714034729.4669883, 2024-04-25T08:45:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "st_mtime": 1714034735.2668478, 2024-04-25T08:45:42.752 INFO:teuthology.orchestra.run.smithi172.stdout: "st_ctime": 1714034735.2668478 2024-04-25T08:45:42.752 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:42.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:45:42.760 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-04-25T08:45:42.761 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-04-25T08:45:42.761 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:42.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.906+0000 7f81d4c12640 1 Processor -- start 2024-04-25T08:45:42.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.906+0000 7f81d4c12640 1 -- start start 2024-04-25T08:45:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81d4c12640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f81d00d1dd0 0x7f81d00ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81d4c12640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d015dfe0 con 0x7f81d015dc00 2024-04-25T08:45:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81d4c12640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d00d00c0 con 0x7f81d00c6df0 2024-04-25T08:45:42.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81d4c12640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d00d03a0 con 0x7f81d00d1dd0 2024-04-25T08:45:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81ced9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f81d00d1dd0 0x7f81d00ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81ced9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f81d00d1dd0 0x7f81d00ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54580/0 (socket says 172.21.15.172:54580) 2024-04-25T08:45:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81ce59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f81d015dc00 0x7f81d00ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45434/0 (socket says 172.21.15.172:45434) 2024-04-25T08:45:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81ced9d640 1 -- 172.21.15.172:0/664996786 learned_addr learned my addr 172.21.15.172:0/664996786 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81ced9d640 1 -- 172.21.15.172:0/664996786 >> v1:172.21.15.186:6789/0 conn(0x7f81d00c6df0 legacy=0x7f81d00d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81ced9d640 1 -- 172.21.15.172:0/664996786 >> v1:172.21.15.172:6789/0 conn(0x7f81d015dc00 legacy=0x7f81d00ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81cd59a640 1 -- 172.21.15.172:0/664996786 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786064824 0 0) 0x7f81c0001490 con 0x7f81d015dc00 2024-04-25T08:45:42.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.907+0000 7f81ced9d640 1 -- 172.21.15.172:0/664996786 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00cc440 con 0x7f81d00d1dd0 2024-04-25T08:45:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.908+0000 7f81ced9d640 1 --2- 172.21.15.172:0/664996786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d00d1dd0 0x7f81d00ccc40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009870 tx=0x7f81c802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bac76e300b24db8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.908+0000 7f81cd59a640 1 -- 172.21.15.172:0/664996786 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8037070 con 0x7f81d00d1dd0 2024-04-25T08:45:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.908+0000 7f81cd59a640 1 -- 172.21.15.172:0/664996786 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c802ae50 con 0x7f81d00d1dd0 2024-04-25T08:45:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.908+0000 7f81cd59a640 1 -- 172.21.15.172:0/664996786 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8032860 con 0x7f81d00d1dd0 2024-04-25T08:45:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.909+0000 7f81d4c12640 1 -- 172.21.15.172:0/664996786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d00d1dd0 msgr2=0x7f81d00ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.909+0000 7f81d4c12640 1 --2- 172.21.15.172:0/664996786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d00d1dd0 0x7f81d00ccc40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009870 tx=0x7f81c802a300 comp rx=0 tx=0).stop 2024-04-25T08:45:42.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.909+0000 7f81d4c12640 1 -- 172.21.15.172:0/664996786 shutdown_connections 2024-04-25T08:45:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.909+0000 7f81d4c12640 1 --2- 172.21.15.172:0/664996786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d00d1dd0 0x7f81d00ccc40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.909+0000 7f81d4c12640 1 -- 172.21.15.172:0/664996786 >> 172.21.15.172:0/664996786 conn(0x7f81d006f5d0 msgr2=0x7f81d006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.909+0000 7f81d4c12640 1 -- 172.21.15.172:0/664996786 shutdown_connections 2024-04-25T08:45:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.909+0000 7f81d4c12640 1 -- 172.21.15.172:0/664996786 wait complete. 2024-04-25T08:45:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.910+0000 7f81d4c12640 1 Processor -- start 2024-04-25T08:45:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.910+0000 7f81d4c12640 1 -- start start 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81d4c12640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81d00c6df0 0x7f81d00c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81d4c12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f81d00d1dd0 0x7f81d01530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81d4c12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d015dc00 0x7f81d0153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81d4c12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00cfd90 con 0x7f81d015dc00 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81d4c12640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00cc130 con 0x7f81d00c6df0 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81d4c12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00cdd70 con 0x7f81d00d1dd0 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81ced9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d015dc00 0x7f81d0153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81ced9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d015dc00 0x7f81d0153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54596/0 (socket says 172.21.15.172:54596) 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81ced9d640 1 -- 172.21.15.172:0/404024021 learned_addr learned my addr 172.21.15.172:0/404024021 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81ce59c640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81d00c6df0 0x7f81d00c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.911+0000 7f81cdd9b640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f81d00d1dd0 0x7f81d01530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81ced9d640 1 -- 172.21.15.172:0/404024021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f81d00d1dd0 msgr2=0x7f81d01530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81ced9d640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f81d00d1dd0 0x7f81d01530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81ced9d640 1 -- 172.21.15.172:0/404024021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81d00c6df0 msgr2=0x7f81d00c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81ced9d640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81d00c6df0 0x7f81d00c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81ced9d640 1 -- 172.21.15.172:0/404024021 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00c92d0 con 0x7f81d015dc00 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81ced9d640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d015dc00 0x7f81d0153630 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009870 tx=0x7f81c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81beffd640 1 -- 172.21.15.172:0/404024021 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8037040 con 0x7f81d015dc00 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81beffd640 1 -- 172.21.15.172:0/404024021 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8004250 con 0x7f81d015dc00 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81beffd640 1 -- 172.21.15.172:0/404024021 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8003610 con 0x7f81d015dc00 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81d4c12640 1 -- 172.21.15.172:0/404024021 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d00c9550 con 0x7f81d015dc00 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.912+0000 7f81d4c12640 1 -- 172.21.15.172:0/404024021 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d00c9b10 con 0x7f81d015dc00 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.913+0000 7f81d4c12640 1 -- 172.21.15.172:0/404024021 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d0073990 con 0x7f81d015dc00 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.913+0000 7f81beffd640 1 -- 172.21.15.172:0/404024021 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81c803a070 con 0x7f81d015dc00 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.914+0000 7f81beffd640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f81b006b4d0 0x7f81b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.914+0000 7f81beffd640 1 -- 172.21.15.172:0/404024021 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f81c80aaa70 con 0x7f81d015dc00 2024-04-25T08:45:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.914+0000 7f81ce59c640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f81b006b4d0 0x7f81b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.914+0000 7f81ce59c640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f81b006b4d0 0x7f81b006d990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f81c00012e0 tx=0x7f81c0004d40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:42.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:42.918+0000 7f81beffd640 1 -- 172.21.15.172:0/404024021 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81d00c92d0 con 0x7f81d015dc00 2024-04-25T08:45:43.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.125+0000 7f81d4c12640 1 -- 172.21.15.172:0/404024021 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81d00c66c0 con 0x7f81d015dc00 2024-04-25T08:45:43.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.125+0000 7f81beffd640 1 -- 172.21.15.172:0/404024021 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f81c8041020 con 0x7f81d015dc00 2024-04-25T08:45:43.117 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:43.117 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:38.835835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:43.117 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 24 2024-04-25T08:45:43.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 -- 172.21.15.172:0/404024021 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f81b006b4d0 msgr2=0x7f81b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f81b006b4d0 0x7f81b006d990 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f81c00012e0 tx=0x7f81c0004d40 comp rx=0 tx=0).stop 2024-04-25T08:45:43.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 -- 172.21.15.172:0/404024021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d015dc00 msgr2=0x7f81d0153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d015dc00 0x7f81d0153630 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009870 tx=0x7f81c80046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 -- 172.21.15.172:0/404024021 shutdown_connections 2024-04-25T08:45:43.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f81b006b4d0 0x7f81b006d990 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81d015dc00 0x7f81d0153630 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f81d00d1dd0 0x7f81d01530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 --2- 172.21.15.172:0/404024021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81d00c6df0 0x7f81d00c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 -- 172.21.15.172:0/404024021 >> 172.21.15.172:0/404024021 conn(0x7f81d006f5d0 msgr2=0x7f81d00cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 -- 172.21.15.172:0/404024021 shutdown_connections 2024-04-25T08:45:43.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.127+0000 7f81d4c12640 1 -- 172.21.15.172:0/404024021 wait complete. 2024-04-25T08:45:43.130 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path /scrub_test_path/i/dont/exist 2024-04-25T08:45:43.237 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:43.237 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": -2 2024-04-25T08:45:43.237 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:43.246 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2024-04-25T08:45:43.246 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-04-25T08:45:43.246 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:43.246 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-04-25T08:45:43.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.354+0000 7f0bc816a640 1 Processor -- start 2024-04-25T08:45:43.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.355+0000 7f0bc816a640 1 -- start start 2024-04-25T08:45:43.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.355+0000 7f0bc816a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0bc015bb50 0x7f0bc00c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.355+0000 7f0bc816a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 0x7f0bc00cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.355+0000 7f0bc816a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc00c75e0 con 0x7f0bc00cfb40 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.355+0000 7f0bc816a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc00c8680 con 0x7f0bc015bb50 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.355+0000 7f0bc816a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00c78c0 con 0x7f0bc00c70d0 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc5f06640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0bc015bb50 0x7f0bc00c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc5705640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 0x7f0bc00cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc5f06640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0bc015bb50 0x7f0bc00c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:50448/0 (socket says 172.21.15.172:50448) 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc6707640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f0bc00cfb40 0x7f0bc0070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:35938/0 (socket says 172.21.15.172:35938) 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc5705640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 0x7f0bc00cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:45186/0 (socket says 172.21.15.172:45186) 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc5f06640 1 -- 172.21.15.172:0/910265085 learned_addr learned my addr 172.21.15.172:0/910265085 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc5f06640 1 -- 172.21.15.172:0/910265085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 msgr2=0x7f0bc00cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/910265085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 0x7f0bc00cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc5f06640 1 -- 172.21.15.172:0/910265085 >> v1:172.21.15.186:6789/0 conn(0x7f0bc00cfb40 legacy=0x7f0bc0070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc4f04640 1 -- 172.21.15.172:0/910265085 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572606034 0 0) 0x7f0bc00c75e0 con 0x7f0bc00cfb40 2024-04-25T08:45:43.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.356+0000 7f0bc5f06640 1 -- 172.21.15.172:0/910265085 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc00c7ba0 con 0x7f0bc015bb50 2024-04-25T08:45:43.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.357+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/910265085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc015bb50 0x7f0bc00c6b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009870 tx=0x7f0bb402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d1197376778829b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.357+0000 7f0bc4f04640 1 -- 172.21.15.172:0/910265085 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4037070 con 0x7f0bc015bb50 2024-04-25T08:45:43.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.357+0000 7f0bc4f04640 1 -- 172.21.15.172:0/910265085 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb402ae50 con 0x7f0bc015bb50 2024-04-25T08:45:43.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.357+0000 7f0bc4f04640 1 -- 172.21.15.172:0/910265085 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4032860 con 0x7f0bc015bb50 2024-04-25T08:45:43.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.357+0000 7f0bc816a640 1 -- 172.21.15.172:0/910265085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc015bb50 msgr2=0x7f0bc00c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.357+0000 7f0bc816a640 1 --2- 172.21.15.172:0/910265085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc015bb50 0x7f0bc00c6b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009870 tx=0x7f0bb402a300 comp rx=0 tx=0).stop 2024-04-25T08:45:43.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.357+0000 7f0bc816a640 1 -- 172.21.15.172:0/910265085 shutdown_connections 2024-04-25T08:45:43.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.357+0000 7f0bc816a640 1 --2- 172.21.15.172:0/910265085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 0x7f0bc00cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.357+0000 7f0bc816a640 1 --2- 172.21.15.172:0/910265085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc015bb50 0x7f0bc00c6b90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.357+0000 7f0bc816a640 1 -- 172.21.15.172:0/910265085 >> 172.21.15.172:0/910265085 conn(0x7f0bc006f500 msgr2=0x7f0bc006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.358+0000 7f0bc816a640 1 -- 172.21.15.172:0/910265085 shutdown_connections 2024-04-25T08:45:43.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.358+0000 7f0bc816a640 1 -- 172.21.15.172:0/910265085 wait complete. 2024-04-25T08:45:43.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.359+0000 7f0bc816a640 1 Processor -- start 2024-04-25T08:45:43.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.359+0000 7f0bc816a640 1 -- start start 2024-04-25T08:45:43.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.359+0000 7f0bc816a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 0x7f0bc01f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.359+0000 7f0bc816a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00cfb40 0x7f0bc015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.359+0000 7f0bc816a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bc015bb50 0x7f0bc00b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.359+0000 7f0bc816a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc015f6d0 con 0x7f0bc015bb50 2024-04-25T08:45:43.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.359+0000 7f0bc816a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00c8160 con 0x7f0bc00cfb40 2024-04-25T08:45:43.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.359+0000 7f0bc816a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc015f850 con 0x7f0bc00c70d0 2024-04-25T08:45:43.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc5705640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00cfb40 0x7f0bc015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc6707640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bc015bb50 0x7f0bc00b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc5f06640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 0x7f0bc01f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc5705640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00cfb40 0x7f0bc015e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:50456/0 (socket says 172.21.15.172:50456) 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc5705640 1 -- 172.21.15.172:0/2793194143 learned_addr learned my addr 172.21.15.172:0/2793194143 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc5705640 1 -- 172.21.15.172:0/2793194143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 msgr2=0x7f0bc01f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc5705640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 0x7f0bc01f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc5705640 1 -- 172.21.15.172:0/2793194143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bc015bb50 msgr2=0x7f0bc00b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc5705640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bc015bb50 0x7f0bc00b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc5705640 1 -- 172.21.15.172:0/2793194143 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc01f5fe0 con 0x7f0bc00cfb40 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc5705640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00cfb40 0x7f0bc015e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00e980 tx=0x7f0bbc00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bb27fc640 1 -- 172.21.15.172:0/2793194143 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc017070 con 0x7f0bc00cfb40 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bb27fc640 1 -- 172.21.15.172:0/2793194143 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc00ca00 con 0x7f0bc00cfb40 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc816a640 1 -- 172.21.15.172:0/2793194143 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc00b7450 con 0x7f0bc00cfb40 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bc816a640 1 -- 172.21.15.172:0/2793194143 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc015dc90 con 0x7f0bc00cfb40 2024-04-25T08:45:43.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.360+0000 7f0bb27fc640 1 -- 172.21.15.172:0/2793194143 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00cdd0 con 0x7f0bc00cfb40 2024-04-25T08:45:43.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.362+0000 7f0bb27fc640 1 -- 172.21.15.172:0/2793194143 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0bbc01a070 con 0x7f0bc00cfb40 2024-04-25T08:45:43.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.362+0000 7f0bb27fc640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ba406b4d0 0x7f0ba406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.362+0000 7f0bb27fc640 1 -- 172.21.15.172:0/2793194143 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0bbc08a730 con 0x7f0bc00cfb40 2024-04-25T08:45:43.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.362+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ba406b4d0 0x7f0ba406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.363+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ba406b4d0 0x7f0ba406d990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4034000 tx=0x7f0bb402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.363+0000 7f0bcae5f740 1 Processor -- start 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.363+0000 7f0bcae5f740 1 -- start start 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f10585a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f105a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f1055b390 0x560f105a1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f104bdc60 con 0x560f1055b390 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f10466ee0 con 0x560f105856b0 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f104b9d00 con 0x560f105a2f50 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc6707640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f1055b390 0x560f105a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc6707640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f1055b390 0x560f105a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54616/0 (socket says 172.21.15.172:54616) 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc6707640 1 -- 172.21.15.172:0/1960389294 learned_addr learned my addr 172.21.15.172:0/1960389294 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc5705640 1 --2- 172.21.15.172:0/1960389294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f105a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/1960389294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f10585a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc6707640 1 -- 172.21.15.172:0/1960389294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 msgr2=0x560f105a34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc6707640 1 --2- 172.21.15.172:0/1960389294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f105a34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc6707640 1 -- 172.21.15.172:0/1960389294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 msgr2=0x560f10585a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc6707640 1 --2- 172.21.15.172:0/1960389294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f10585a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc6707640 1 -- 172.21.15.172:0/1960389294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f1029e9f0 con 0x560f1055b390 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0bc6707640 1 --2- 172.21.15.172:0/1960389294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f1055b390 0x560f105a1610 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8001b20 tx=0x7f0bb8001fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707dea80f369d6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0ba37fe640 1 -- 172.21.15.172:0/1960389294 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8007850 con 0x560f1055b390 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0ba37fe640 1 -- 172.21.15.172:0/1960389294 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8018070 con 0x560f1055b390 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.364+0000 7f0ba37fe640 1 -- 172.21.15.172:0/1960389294 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80135f0 con 0x560f1055b390 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.365+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1960389294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f1055b390 msgr2=0x560f105a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.365+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/1960389294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f1055b390 0x560f105a1610 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8001b20 tx=0x7f0bb8001fe0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.365+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1960389294 shutdown_connections 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.365+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/1960389294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f1055b390 0x560f105a1610 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.365+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/1960389294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f105a34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.365+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/1960389294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f10585a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.365+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1960389294 >> 172.21.15.172:0/1960389294 conn(0x560f10557cc0 msgr2=0x560f105a04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.365+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1960389294 shutdown_connections 2024-04-25T08:45:43.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.365+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1960389294 wait complete. 2024-04-25T08:45:43.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.366+0000 7f0bcae5f740 1 -- start start 2024-04-25T08:45:43.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.366+0000 7f0bcae5f740 1 Processor -- start 2024-04-25T08:45:43.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f105b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f10554d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10587ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f1055c130 con 0x560f10587a70 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f1047a470 con 0x560f105856b0 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f10555bf0 con 0x560f105a2f50 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bcae5f740 10 client.0 _ll_register_callbacks cb 0x560f104467d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc5f06640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f105b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc5705640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f10554d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc5f06640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f105b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:50480/0 (socket says 172.21.15.172:50480) 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc6707640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10587ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc5f06640 1 -- 172.21.15.172:0/3980892987 learned_addr learned my addr 172.21.15.172:0/3980892987 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc5705640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f10554d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:45222/0 (socket says 172.21.15.172:45222) 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc6707640 1 -- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 msgr2=0x560f10554d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc6707640 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f10554d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc6707640 1 -- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 msgr2=0x560f105b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc6707640 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f105b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc6707640 1 -- 172.21.15.172:0/3980892987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f101922e0 con 0x560f10587a70 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc5705640 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f10554d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0bc6707640 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10587ed0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x560f105a0490 tx=0x7f0bb8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593e89b8cc8edc9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.367+0000 7f0ba0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/3980892987 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8013900 con 0x560f10587a70 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/3980892987 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0bb8013aa0 con 0x560f10587a70 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0bcae5f740 1 -- 172.21.15.172:0/3980892987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bb8018070 con 0x560f10587a70 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/3980892987 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bb8013cc0 con 0x560f10587a70 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0bcae5f740 10 client.6330 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0bcae5f740 1 -- 172.21.15.172:0/3980892987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x560f102ff180 con 0x560f10587a70 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/3980892987 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8018070 con 0x560f10587a70 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/3980892987 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0bb802b480 con 0x560f10587a70 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0bcae5f740 10 client.6330 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0bcae5f740 10 client.6330 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0bcae5f740 20 client.6330 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560f10581d20 0x560f10597570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0bcae5f740 4 client.6330 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:43.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0bcae5f740 1 -- 172.21.15.172:0/3980892987 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f104cb1a0 con 0x560f10581d20 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.369+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560f10581d20 0x560f10597570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0ba0ff9640 10 client.6330 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560f10581d20 0x560f10597570 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e3636f719ccfb19 server_cookie=87553bd4bc435f49 in_seq=0 out_seq=0 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/3980892987 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560f104cb1a0 con 0x560f10581d20 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0ba0ff9640 10 client.6330 handle_command_reply: tid=0 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0bcae5f740 1 client.6330 shutdown 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0bcae5f740 1 -- 172.21.15.172:0/3980892987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 msgr2=0x560f10587ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10587ed0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x560f105a0490 tx=0x7f0bb8012000 comp rx=0 tx=0).stop 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0bcae5f740 1 -- 172.21.15.172:0/3980892987 shutdown_connections 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560f10581d20 0x560f10597570 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10587ed0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f10554d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0ba0ff9640 0 client.6330 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/3980892987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f105b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.370+0000 7f0bcae5f740 1 -- 172.21.15.172:0/3980892987 >> 172.21.15.172:0/3980892987 conn(0x560f1055b390 msgr2=0x560f105a3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.371+0000 7f0bcae5f740 1 -- 172.21.15.172:0/3980892987 shutdown_connections 2024-04-25T08:45:43.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.371+0000 7f0bcae5f740 1 -- 172.21.15.172:0/3980892987 wait complete. 2024-04-25T08:45:43.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.371+0000 7f0bcae5f740 20 client.6330 trim_cache size 0 max 16384 2024-04-25T08:45:43.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.386+0000 7f0bcae5f740 1 Processor -- start 2024-04-25T08:45:43.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.386+0000 7f0bcae5f740 1 -- start start 2024-04-25T08:45:43.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f105a2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f10587a70 0x560f10595e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f105a2f50 0x560f105a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc01fe190 con 0x560f105a2f50 2024-04-25T08:45:43.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc01fd420 con 0x560f105856b0 2024-04-25T08:45:43.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00c9cd0 con 0x560f10587a70 2024-04-25T08:45:43.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc6707640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f105a2f50 0x560f105a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc6707640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f105a2f50 0x560f105a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54642/0 (socket says 172.21.15.172:54642) 2024-04-25T08:45:43.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc6707640 1 -- 172.21.15.172:0/4265760517 learned_addr learned my addr 172.21.15.172:0/4265760517 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc6707640 1 -- 172.21.15.172:0/4265760517 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f10587a70 msgr2=0x560f10595e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc5705640 1 --2- 172.21.15.172:0/4265760517 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f10587a70 0x560f10595e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/4265760517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f105a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc6707640 1 --2- 172.21.15.172:0/4265760517 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f10587a70 0x560f10595e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc6707640 1 -- 172.21.15.172:0/4265760517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 msgr2=0x560f105a2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc6707640 1 --2- 172.21.15.172:0/4265760517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f105a2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc6707640 1 -- 172.21.15.172:0/4265760517 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f1016b3a0 con 0x560f105a2f50 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0bc6707640 1 --2- 172.21.15.172:0/4265760517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f105a2f50 0x560f105a06b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8007460 tx=0x7f0bb800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c0efebbc8c269e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0ba2ffd640 1 -- 172.21.15.172:0/4265760517 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8039070 con 0x560f105a2f50 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0ba2ffd640 1 -- 172.21.15.172:0/4265760517 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8018070 con 0x560f105a2f50 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.387+0000 7f0ba2ffd640 1 -- 172.21.15.172:0/4265760517 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8013e60 con 0x560f105a2f50 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.388+0000 7f0bcae5f740 1 -- 172.21.15.172:0/4265760517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f105a2f50 msgr2=0x560f105a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.388+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/4265760517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f105a2f50 0x560f105a06b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8007460 tx=0x7f0bb800a000 comp rx=0 tx=0).stop 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.388+0000 7f0bcae5f740 1 -- 172.21.15.172:0/4265760517 shutdown_connections 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.388+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/4265760517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f105a2f50 0x560f105a06b0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.388+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/4265760517 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f10587a70 0x560f10595e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.388+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/4265760517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f105a2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.388+0000 7f0bcae5f740 1 -- 172.21.15.172:0/4265760517 >> 172.21.15.172:0/4265760517 conn(0x560f1055b390 msgr2=0x560f10598640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.388+0000 7f0bcae5f740 1 -- 172.21.15.172:0/4265760517 shutdown_connections 2024-04-25T08:45:43.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.388+0000 7f0bcae5f740 1 -- 172.21.15.172:0/4265760517 wait complete. 2024-04-25T08:45:43.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.389+0000 7f0bcae5f740 1 -- start start 2024-04-25T08:45:43.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.389+0000 7f0bcae5f740 1 Processor -- start 2024-04-25T08:45:43.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f1059fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10586370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bcae5f740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f105868b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00ca2d0 con 0x560f10587a70 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f1059a560 con 0x560f105856b0 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bcae5f740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f1060b9d0 con 0x560f105a2f50 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bcae5f740 10 client.0 _ll_register_callbacks cb 0x560f105560d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5705640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10586370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5705640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10586370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54654/0 (socket says 172.21.15.172:54654) 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5705640 1 -- 172.21.15.172:0/1690869899 learned_addr learned my addr 172.21.15.172:0/1690869899 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f1059fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5705640 1 -- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 msgr2=0x560f105868b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc6707640 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f105868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5705640 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f105868b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5705640 1 -- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 msgr2=0x560f1059fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5705640 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f1059fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5705640 1 -- 172.21.15.172:0/1690869899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f105987e0 con 0x560f10587a70 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f1059fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bc5705640 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10586370 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc006a90 tx=0x7f0bbc009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b00abfd265cce5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0ba0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/1690869899 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc021040 con 0x560f10587a70 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/1690869899 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0bbc058380 con 0x560f10587a70 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1690869899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bb8018070 con 0x560f10587a70 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/1690869899 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bbc05cdd0 con 0x560f10587a70 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bcae5f740 10 client.6336 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.390+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1690869899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x560f105a0130 con 0x560f10587a70 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/1690869899 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8018070 con 0x560f10587a70 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/1690869899 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0bbc054a80 con 0x560f10587a70 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0bcae5f740 10 client.6336 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0bcae5f740 10 client.6336 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0bcae5f740 20 client.6336 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560f105bab30 0x560f10599340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0bcae5f740 4 client.6336 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1690869899 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x560f10585fb0 con 0x560f105bab30 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560f105bab30 0x560f10599340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0bc5f06640 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560f105bab30 0x560f10599340 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=716315b67ac5fdf server_cookie=691ef9933cac1190 in_seq=0 out_seq=0 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0ba0ff9640 10 client.6336 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0ba0ff9640 1 -- 172.21.15.172:0/1690869899 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x560f10585fb0 con 0x560f105bab30 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0ba0ff9640 10 client.6336 handle_command_reply: tid=0 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.391+0000 7f0bcae5f740 1 client.6336 shutdown 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1690869899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 msgr2=0x560f10586370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10586370 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc006a90 tx=0x7f0bbc009f60 comp rx=0 tx=0).stop 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1690869899 shutdown_connections 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560f105bab30 0x560f10599340 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560f105a2f50 0x560f105868b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560f10587a70 0x560f10586370 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 1 --2- 172.21.15.172:0/1690869899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560f105856b0 0x560f1059fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0ba0ff9640 0 client.6336 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1690869899 >> 172.21.15.172:0/1690869899 conn(0x560f1055b390 msgr2=0x560f10554b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1690869899 shutdown_connections 2024-04-25T08:45:43.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 1 -- 172.21.15.172:0/1690869899 wait complete. 2024-04-25T08:45:43.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bcae5f740 20 client.6336 trim_cache size 0 max 16384 2024-04-25T08:45:43.389 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:43.389 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": -2 2024-04-25T08:45:43.389 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:43.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 -- 172.21.15.172:0/2793194143 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ba406b4d0 msgr2=0x7f0ba406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ba406b4d0 0x7f0ba406d990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4034000 tx=0x7f0bb402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:43.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 -- 172.21.15.172:0/2793194143 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00cfb40 msgr2=0x7f0bc015e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00cfb40 0x7f0bc015e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00e980 tx=0x7f0bbc00ee40 comp rx=0 tx=0).stop 2024-04-25T08:45:43.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 -- 172.21.15.172:0/2793194143 shutdown_connections 2024-04-25T08:45:43.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0ba406b4d0 0x7f0ba406d990 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00cfb40 0x7f0bc015e770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bc015bb50 0x7f0bc00b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 --2- 172.21.15.172:0/2793194143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bc00c70d0 0x7f0bc01f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 -- 172.21.15.172:0/2793194143 >> 172.21.15.172:0/2793194143 conn(0x7f0bc006f500 msgr2=0x7f0bc00ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 -- 172.21.15.172:0/2793194143 shutdown_connections 2024-04-25T08:45:43.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.392+0000 7f0bc816a640 1 -- 172.21.15.172:0/2793194143 wait complete. 2024-04-25T08:45:43.394 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-04-25T08:45:43.394 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-04-25T08:45:43.395 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:43.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-04-25T08:45:43.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.503+0000 7fbe9d083640 1 Processor -- start 2024-04-25T08:45:43.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.503+0000 7fbe9d083640 1 -- start start 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.503+0000 7fbe9d083640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbe9806ccd0 0x7fbe980b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.503+0000 7fbe9d083640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 0x7fbe9815e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.503+0000 7fbe9d083640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe980d1770 con 0x7fbe98070dc0 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.503+0000 7fbe9d083640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe981622b0 con 0x7fbe9806ccd0 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.503+0000 7fbe9d083640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980b10f0 con 0x7fbe9815deb0 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe9759e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 0x7fbe9815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe9659c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbe9806ccd0 0x7fbe980b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe96d9d640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fbe98070dc0 0x7fbe980711a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:35950/0 (socket says 172.21.15.172:35950) 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe96d9d640 1 -- 172.21.15.172:0/3091002552 learned_addr learned my addr 172.21.15.172:0/3091002552 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe95d9b640 1 -- 172.21.15.172:0/3091002552 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849589118 0 0) 0x7fbe980d1770 con 0x7fbe98070dc0 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe95d9b640 1 -- 172.21.15.172:0/3091002552 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe80003520 con 0x7fbe98070dc0 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe9759e640 1 -- 172.21.15.172:0/3091002552 >> v2:172.21.15.186:3300/0 conn(0x7fbe9806ccd0 msgr2=0x7fbe980b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe9759e640 1 --2- 172.21.15.172:0/3091002552 >> v2:172.21.15.186:3300/0 conn(0x7fbe9806ccd0 0x7fbe980b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe9759e640 1 -- 172.21.15.172:0/3091002552 >> v1:172.21.15.186:6789/0 conn(0x7fbe98070dc0 legacy=0x7fbe980711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe9759e640 1 -- 172.21.15.172:0/3091002552 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98162740 con 0x7fbe9815deb0 2024-04-25T08:45:43.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.504+0000 7fbe9659c640 1 --2- 172.21.15.172:0/3091002552 >> v2:172.21.15.186:3300/0 conn(0x7fbe9806ccd0 0x7fbe980b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.505+0000 7fbe9759e640 1 --2- 172.21.15.172:0/3091002552 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 0x7fbe9815e340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009d90 tx=0x7fbe9002a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94733ec3627092d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.505+0000 7fbe95d9b640 1 -- 172.21.15.172:0/3091002552 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90007740 con 0x7fbe9815deb0 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.505+0000 7fbe95d9b640 1 -- 172.21.15.172:0/3091002552 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe900078e0 con 0x7fbe9815deb0 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.505+0000 7fbe95d9b640 1 -- 172.21.15.172:0/3091002552 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90007cb0 con 0x7fbe9815deb0 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.505+0000 7fbe9d083640 1 -- 172.21.15.172:0/3091002552 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 msgr2=0x7fbe9815e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.505+0000 7fbe9d083640 1 --2- 172.21.15.172:0/3091002552 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 0x7fbe9815e340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009d90 tx=0x7fbe9002a530 comp rx=0 tx=0).stop 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.505+0000 7fbe9d083640 1 -- 172.21.15.172:0/3091002552 shutdown_connections 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.505+0000 7fbe9d083640 1 --2- 172.21.15.172:0/3091002552 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 0x7fbe9815e340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.505+0000 7fbe9d083640 1 --2- 172.21.15.172:0/3091002552 >> v2:172.21.15.186:3300/0 conn(0x7fbe9806ccd0 0x7fbe980b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.505+0000 7fbe9d083640 1 -- 172.21.15.172:0/3091002552 >> 172.21.15.172:0/3091002552 conn(0x7fbe980b3530 msgr2=0x7fbe980b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.506+0000 7fbe9d083640 1 -- 172.21.15.172:0/3091002552 shutdown_connections 2024-04-25T08:45:43.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.506+0000 7fbe9d083640 1 -- 172.21.15.172:0/3091002552 wait complete. 2024-04-25T08:45:43.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.507+0000 7fbe9d083640 1 Processor -- start 2024-04-25T08:45:43.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.507+0000 7fbe9d083640 1 -- start start 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9d083640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe9806ccd0 0x7fbe9814ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9d083640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe98070dc0 0x7fbe9814e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9d083640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 0x7fbe98160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9d083640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98161f40 con 0x7fbe98070dc0 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9d083640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98161c60 con 0x7fbe9806ccd0 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9d083640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980b5840 con 0x7fbe9815deb0 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe98070dc0 0x7fbe9814e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe98070dc0 0x7fbe9814e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54666/0 (socket says 172.21.15.172:54666) 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9659c640 1 -- 172.21.15.172:0/1355395985 learned_addr learned my addr 172.21.15.172:0/1355395985 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe9806ccd0 0x7fbe9814ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9759e640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 0x7fbe98160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9659c640 1 -- 172.21.15.172:0/1355395985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 msgr2=0x7fbe98160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9659c640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 0x7fbe98160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9659c640 1 -- 172.21.15.172:0/1355395985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe9806ccd0 msgr2=0x7fbe9814ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9659c640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe9806ccd0 0x7fbe9814ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9659c640 1 -- 172.21.15.172:0/1355395985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98160cd0 con 0x7fbe98070dc0 2024-04-25T08:45:43.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9659c640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe98070dc0 0x7fbe9814e3c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00ebe0 tx=0x7fbe8c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe7f7fe640 1 -- 172.21.15.172:0/1355395985 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c017070 con 0x7fbe98070dc0 2024-04-25T08:45:43.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe7f7fe640 1 -- 172.21.15.172:0/1355395985 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c00cc30 con 0x7fbe98070dc0 2024-04-25T08:45:43.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe9d083640 1 -- 172.21.15.172:0/1355395985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe98160fb0 con 0x7fbe98070dc0 2024-04-25T08:45:43.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.508+0000 7fbe7f7fe640 1 -- 172.21.15.172:0/1355395985 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c013470 con 0x7fbe98070dc0 2024-04-25T08:45:43.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.509+0000 7fbe9d083640 1 -- 172.21.15.172:0/1355395985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe980a8920 con 0x7fbe98070dc0 2024-04-25T08:45:43.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.510+0000 7fbe7f7fe640 1 -- 172.21.15.172:0/1355395985 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbe8c01a070 con 0x7fbe98070dc0 2024-04-25T08:45:43.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.510+0000 7fbe7f7fe640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe8406b4d0 0x7fbe8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.510+0000 7fbe7f7fe640 1 -- 172.21.15.172:0/1355395985 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe8c08a610 con 0x7fbe98070dc0 2024-04-25T08:45:43.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.510+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe8406b4d0 0x7fbe8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.511+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe8406b4d0 0x7fbe8406d990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe88005880 tx=0x7fbe88009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.511+0000 7fbe9fd81740 1 Processor -- start 2024-04-25T08:45:43.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe9fd81740 1 -- start start 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b07df10 0x55ca1b080070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b07e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca1afaffe0 con 0x55ca1b0ba5e0 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca1afe1d20 con 0x55ca1b07df10 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca1af8afa0 con 0x55ca1b0a89d0 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe9659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b07e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe9659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b07e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54678/0 (socket says 172.21.15.172:54678) 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe9659c640 1 -- 172.21.15.172:0/3381223389 learned_addr learned my addr 172.21.15.172:0/3381223389 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.512+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b07df10 0x55ca1b080070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe9759e640 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe9659c640 1 -- 172.21.15.172:0/3381223389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 msgr2=0x55ca1b0a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe9659c640 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0a8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe9659c640 1 -- 172.21.15.172:0/3381223389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b07df10 msgr2=0x55ca1b080070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe9659c640 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b07df10 0x55ca1b080070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe9659c640 1 -- 172.21.15.172:0/3381223389 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca1adc2b00 con 0x55ca1b0ba5e0 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b07df10 0x55ca1b080070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe9759e640 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe9659c640 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b07e2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0550f0 tx=0x7fbe8c055040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e840a278b5d660b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe7cff9640 1 -- 172.21.15.172:0/3381223389 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c021070 con 0x55ca1b0ba5e0 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe7cff9640 1 -- 172.21.15.172:0/3381223389 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c05f0c0 con 0x55ca1b0ba5e0 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe7cff9640 1 -- 172.21.15.172:0/3381223389 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c05cde0 con 0x55ca1b0ba5e0 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe9fd81740 1 -- 172.21.15.172:0/3381223389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b0ba5e0 msgr2=0x55ca1b07e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.513+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b07e2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0550f0 tx=0x7fbe8c055040 comp rx=0 tx=0).stop 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.514+0000 7fbe9fd81740 1 -- 172.21.15.172:0/3381223389 shutdown_connections 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.514+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.514+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b07e2f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.514+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/3381223389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b07df10 0x55ca1b080070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.514+0000 7fbe9fd81740 1 -- 172.21.15.172:0/3381223389 >> 172.21.15.172:0/3381223389 conn(0x55ca1b046100 msgr2=0x55ca1b0c39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.514+0000 7fbe9fd81740 1 -- 172.21.15.172:0/3381223389 shutdown_connections 2024-04-25T08:45:43.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.514+0000 7fbe9fd81740 1 -- 172.21.15.172:0/3381223389 wait complete. 2024-04-25T08:45:43.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.514+0000 7fbe9fd81740 1 -- start start 2024-04-25T08:45:43.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.514+0000 7fbe9fd81740 1 Processor -- start 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b0a7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0c1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b0c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca1af80750 con 0x55ca1b07df10 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca1afdddc0 con 0x55ca1b0ba5e0 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca1b0c00c0 con 0x55ca1b0a89d0 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe9fd81740 10 client.0 _ll_register_callbacks cb 0x55ca1af98ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe96d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b0a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe96d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b0a7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54686/0 (socket says 172.21.15.172:54686) 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe96d9d640 1 -- 172.21.15.172:0/1605279511 learned_addr learned my addr 172.21.15.172:0/1605279511 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe9659c640 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe9759e640 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b0c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe96d9d640 1 -- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 msgr2=0x55ca1b0c1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0c1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe96d9d640 1 -- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 msgr2=0x55ca1b0c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b0c16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe96d9d640 1 -- 172.21.15.172:0/1605279511 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca1acb63f0 con 0x55ca1b07df10 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.515+0000 7fbe9759e640 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b0c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b0a7830 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbe88005f30 tx=0x7fbe88000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c25e0e8c50aff59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe75ffb640 1 -- 172.21.15.172:0/1605279511 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88007560 con 0x55ca1b07df10 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe75ffb640 1 -- 172.21.15.172:0/1605279511 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe88021c10 con 0x55ca1b07df10 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe9fd81740 1 -- 172.21.15.172:0/1605279511 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe8c05f0c0 con 0x55ca1b07df10 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe75ffb640 1 -- 172.21.15.172:0/1605279511 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe88007700 con 0x55ca1b07df10 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe9fd81740 10 client.6345 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe9fd81740 1 -- 172.21.15.172:0/1605279511 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55ca1ae23290 con 0x55ca1b07df10 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe75ffb640 1 -- 172.21.15.172:0/1605279511 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c05f0c0 con 0x55ca1b07df10 2024-04-25T08:45:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe75ffb640 1 -- 172.21.15.172:0/1605279511 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbe88021420 con 0x55ca1b07df10 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe9fd81740 10 client.6345 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe9fd81740 10 client.6345 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe9fd81740 20 client.6345 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55ca1b0bed80 0x55ca1b0bf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe9fd81740 4 client.6345 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe9fd81740 1 -- 172.21.15.172:0/1605279511 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca1afef260 con 0x55ca1b0bed80 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.516+0000 7fbe9659c640 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55ca1b0bed80 0x55ca1b0bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe75ffb640 10 client.6345 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9659c640 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55ca1b0bed80 0x55ca1b0bf160 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6acd1f65d68ef63 server_cookie=343e9525a06a063a in_seq=0 out_seq=0 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe75ffb640 1 -- 172.21.15.172:0/1605279511 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ca1afef260 con 0x55ca1b0bed80 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe75ffb640 10 client.6345 handle_command_reply: tid=0 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 client.6345 shutdown 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 -- 172.21.15.172:0/1605279511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 msgr2=0x55ca1b0a7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b0a7830 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbe88005f30 tx=0x7fbe88000ed0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 -- 172.21.15.172:0/1605279511 shutdown_connections 2024-04-25T08:45:43.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b0c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55ca1b0bed80 0x55ca1b0bf160 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0c1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/1605279511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b0a7830 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe75ffb640 0 client.6345 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 -- 172.21.15.172:0/1605279511 >> 172.21.15.172:0/1605279511 conn(0x55ca1b046100 msgr2=0x55ca1b0c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 -- 172.21.15.172:0/1605279511 shutdown_connections 2024-04-25T08:45:43.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 1 -- 172.21.15.172:0/1605279511 wait complete. 2024-04-25T08:45:43.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.517+0000 7fbe9fd81740 20 client.6345 trim_cache size 0 max 16384 2024-04-25T08:45:43.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.532+0000 7fbe9fd81740 1 Processor -- start 2024-04-25T08:45:43.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.532+0000 7fbe9fd81740 1 -- start start 2024-04-25T08:45:43.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b078570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0a89d0 0x55ca1b0a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0ba5e0 0x55ca1b0dc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98200280 con 0x55ca1b07df10 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981ff480 con 0x55ca1b0a89d0 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9815ebd0 con 0x55ca1b0ba5e0 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe96d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe96d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b078570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54692/0 (socket says 172.21.15.172:54692) 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe96d9d640 1 -- 172.21.15.172:0/3459660031 learned_addr learned my addr 172.21.15.172:0/3459660031 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe9659c640 1 --2- 172.21.15.172:0/3459660031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0a89d0 0x55ca1b0a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe9759e640 1 --2- 172.21.15.172:0/3459660031 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0ba5e0 0x55ca1b0dc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe96d9d640 1 -- 172.21.15.172:0/3459660031 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0ba5e0 msgr2=0x55ca1b0dc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/3459660031 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0ba5e0 0x55ca1b0dc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe96d9d640 1 -- 172.21.15.172:0/3459660031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0a89d0 msgr2=0x55ca1b0a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/3459660031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0a89d0 0x55ca1b0a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe96d9d640 1 -- 172.21.15.172:0/3459660031 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca1b0bfc10 con 0x55ca1b07df10 2024-04-25T08:45:43.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.533+0000 7fbe9759e640 1 --2- 172.21.15.172:0/3459660031 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0ba5e0 0x55ca1b0dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/3459660031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b078570 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e6d0 tx=0x7fbe88013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a475ba87cb41ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe77fff640 1 -- 172.21.15.172:0/3459660031 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88007560 con 0x55ca1b07df10 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe77fff640 1 -- 172.21.15.172:0/3459660031 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800eb80 con 0x55ca1b07df10 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe77fff640 1 -- 172.21.15.172:0/3459660031 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88021970 con 0x55ca1b07df10 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe9fd81740 1 -- 172.21.15.172:0/3459660031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 msgr2=0x55ca1b078570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/3459660031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b078570 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800e6d0 tx=0x7fbe88013000 comp rx=0 tx=0).stop 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe9fd81740 1 -- 172.21.15.172:0/3459660031 shutdown_connections 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/3459660031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0a89d0 0x55ca1b0a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/3459660031 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0ba5e0 0x55ca1b0dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/3459660031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b078570 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe9fd81740 1 -- 172.21.15.172:0/3459660031 >> 172.21.15.172:0/3459660031 conn(0x55ca1b046100 msgr2=0x55ca1b0bdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe9fd81740 1 -- 172.21.15.172:0/3459660031 shutdown_connections 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.534+0000 7fbe9fd81740 1 -- 172.21.15.172:0/3459660031 wait complete. 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.535+0000 7fbe9fd81740 1 -- start start 2024-04-25T08:45:43.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.535+0000 7fbe9fd81740 1 Processor -- start 2024-04-25T08:45:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b116e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0dc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9fd81740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b0dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca1b0a7770 con 0x55ca1b07df10 2024-04-25T08:45:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe981ff070 con 0x55ca1b0ba5e0 2024-04-25T08:45:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9fd81740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca1b0be370 con 0x55ca1b0a89d0 2024-04-25T08:45:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9fd81740 10 client.0 _ll_register_callbacks cb 0x7fbe8c0097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:43.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe96d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b116e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe96d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b116e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54698/0 (socket says 172.21.15.172:54698) 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe96d9d640 1 -- 172.21.15.172:0/2404744433 learned_addr learned my addr 172.21.15.172:0/2404744433 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9659c640 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0dc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9759e640 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b0dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe96d9d640 1 -- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 msgr2=0x55ca1b0dc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0dc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe96d9d640 1 -- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 msgr2=0x55ca1b0dcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b0dcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe96d9d640 1 -- 172.21.15.172:0/2404744433 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca1ac8f4b0 con 0x55ca1b07df10 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe96d9d640 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b116e00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbe880078c0 tx=0x7fbe880010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da512e16a622fed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe75ffb640 1 -- 172.21.15.172:0/2404744433 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8803b060 con 0x55ca1b07df10 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe75ffb640 1 -- 172.21.15.172:0/2404744433 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe88021bd0 con 0x55ca1b07df10 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9fd81740 1 -- 172.21.15.172:0/2404744433 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe8800eb80 con 0x55ca1b07df10 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe75ffb640 1 -- 172.21.15.172:0/2404744433 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe88030040 con 0x55ca1b07df10 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9fd81740 10 client.6351 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:43.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.536+0000 7fbe9fd81740 1 -- 172.21.15.172:0/2404744433 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55ca1b12e940 con 0x55ca1b07df10 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe75ffb640 1 -- 172.21.15.172:0/2404744433 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800eb80 con 0x55ca1b07df10 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe75ffb640 1 -- 172.21.15.172:0/2404744433 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbe88005030 con 0x55ca1b07df10 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe9fd81740 10 client.6351 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe9fd81740 10 client.6351 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe9fd81740 20 client.6351 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55ca1b12dca0 0x55ca1b0d53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe9fd81740 4 client.6351 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe9fd81740 1 -- 172.21.15.172:0/2404744433 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x55ca1afe95b0 con 0x55ca1b12dca0 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe9659c640 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55ca1b12dca0 0x55ca1b0d53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe75ffb640 10 client.6351 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.537+0000 7fbe9659c640 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55ca1b12dca0 0x55ca1b0d53c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2140c7d0c2fa192d server_cookie=269a4d241e14634d in_seq=0 out_seq=0 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe75ffb640 1 -- 172.21.15.172:0/2404744433 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ca1afe95b0 con 0x55ca1b12dca0 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe75ffb640 10 client.6351 handle_command_reply: tid=0 2024-04-25T08:45:43.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 client.6351 shutdown 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 -- 172.21.15.172:0/2404744433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 msgr2=0x55ca1b116e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b116e00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbe880078c0 tx=0x7fbe880010a0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 -- 172.21.15.172:0/2404744433 shutdown_connections 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ca1b0ba5e0 0x55ca1b0dcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55ca1b12dca0 0x55ca1b0d53c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ca1b0a89d0 0x55ca1b0dc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 --2- 172.21.15.172:0/2404744433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca1b07df10 0x55ca1b116e00 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 -- 172.21.15.172:0/2404744433 >> 172.21.15.172:0/2404744433 conn(0x55ca1b046100 msgr2=0x55ca1b0a6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe75ffb640 0 client.6351 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 -- 172.21.15.172:0/2404744433 shutdown_connections 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 1 -- 172.21.15.172:0/2404744433 wait complete. 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9fd81740 20 client.6351 trim_cache size 0 max 16384 2024-04-25T08:45:43.535 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:43.536 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:45:43.536 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "b98017d4-888d-4d19-9710-3434cadd80a3", 2024-04-25T08:45:43.536 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:45:43.536 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:43.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9d083640 1 -- 172.21.15.172:0/1355395985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe8406b4d0 msgr2=0x7fbe8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9d083640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe8406b4d0 0x7fbe8406d990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe88005880 tx=0x7fbe88009040 comp rx=0 tx=0).stop 2024-04-25T08:45:43.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9d083640 1 -- 172.21.15.172:0/1355395985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe98070dc0 msgr2=0x7fbe9814e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9d083640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe98070dc0 0x7fbe9814e3c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00ebe0 tx=0x7fbe8c00c520 comp rx=0 tx=0).stop 2024-04-25T08:45:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9d083640 1 -- 172.21.15.172:0/1355395985 shutdown_connections 2024-04-25T08:45:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9d083640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe8406b4d0 0x7fbe8406d990 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9d083640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe9815deb0 0x7fbe98160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9d083640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe98070dc0 0x7fbe9814e3c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9d083640 1 --2- 172.21.15.172:0/1355395985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe9806ccd0 0x7fbe9814ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.538+0000 7fbe9d083640 1 -- 172.21.15.172:0/1355395985 >> 172.21.15.172:0/1355395985 conn(0x7fbe980b3530 msgr2=0x7fbe980b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.539+0000 7fbe9d083640 1 -- 172.21.15.172:0/1355395985 shutdown_connections 2024-04-25T08:45:43.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.539+0000 7fbe9d083640 1 -- 172.21.15.172:0/1355395985 wait complete. 2024-04-25T08:45:43.541 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'b98017d4-888d-4d19-9710-3434cadd80a3', 'mode': 'asynchronous'}' 2024-04-25T08:45:43.541 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-04-25T08:45:43.541 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:43.541 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-04-25T08:45:43.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.649+0000 7f59317be640 1 Processor -- start 2024-04-25T08:45:43.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.649+0000 7f59317be640 1 -- start start 2024-04-25T08:45:43.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59317be640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f592c0d34c0 0x7f592c0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59317be640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f592c0d08e0 0x7f592c0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59317be640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0d2420 con 0x7f592c15dac0 2024-04-25T08:45:43.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59317be640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0d0d50 con 0x7f592c0d34c0 2024-04-25T08:45:43.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59317be640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0d3030 con 0x7f592c0d08e0 2024-04-25T08:45:43.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59227fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f592c0d34c0 0x7f592c0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59227fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f592c0d34c0 0x7f592c0d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54712/0 (socket says 172.21.15.172:54712) 2024-04-25T08:45:43.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59227fc640 1 -- 172.21.15.172:0/3437487200 learned_addr learned my addr 172.21.15.172:0/3437487200 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f592b7fe640 1 --2- 172.21.15.172:0/3437487200 >> v2:172.21.15.186:3300/0 conn(0x7f592c0d08e0 0x7f592c0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59227fc640 1 -- 172.21.15.172:0/3437487200 >> v2:172.21.15.186:3300/0 conn(0x7f592c0d08e0 msgr2=0x7f592c0b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59227fc640 1 --2- 172.21.15.172:0/3437487200 >> v2:172.21.15.186:3300/0 conn(0x7f592c0d08e0 0x7f592c0b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59227fc640 1 -- 172.21.15.172:0/3437487200 >> v1:172.21.15.186:6789/0 conn(0x7f592c15dac0 legacy=0x7f592c0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.650+0000 7f59227fc640 1 -- 172.21.15.172:0/3437487200 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0d2700 con 0x7f592c0d34c0 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.651+0000 7f59227fc640 1 --2- 172.21.15.172:0/3437487200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 0x7f592c0d03a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f592c0d2fa0 tx=0x7f591402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1284f52d642307f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.651+0000 7f592a7fc640 1 -- 172.21.15.172:0/3437487200 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914004230 con 0x7f592c0d34c0 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.651+0000 7f592a7fc640 1 -- 172.21.15.172:0/3437487200 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591402ae50 con 0x7f592c0d34c0 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.651+0000 7f592a7fc640 1 -- 172.21.15.172:0/3437487200 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914003610 con 0x7f592c0d34c0 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.652+0000 7f59317be640 1 -- 172.21.15.172:0/3437487200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 msgr2=0x7f592c0d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.652+0000 7f59317be640 1 --2- 172.21.15.172:0/3437487200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 0x7f592c0d03a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f592c0d2fa0 tx=0x7f591402a300 comp rx=0 tx=0).stop 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.652+0000 7f59317be640 1 -- 172.21.15.172:0/3437487200 shutdown_connections 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.652+0000 7f59317be640 1 --2- 172.21.15.172:0/3437487200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 0x7f592c0d03a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.652+0000 7f59317be640 1 --2- 172.21.15.172:0/3437487200 >> v2:172.21.15.186:3300/0 conn(0x7f592c0d08e0 0x7f592c0b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.652+0000 7f59317be640 1 -- 172.21.15.172:0/3437487200 >> 172.21.15.172:0/3437487200 conn(0x7f592c061c30 msgr2=0x7f592c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.652+0000 7f59317be640 1 -- 172.21.15.172:0/3437487200 shutdown_connections 2024-04-25T08:45:43.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.652+0000 7f59317be640 1 -- 172.21.15.172:0/3437487200 wait complete. 2024-04-25T08:45:43.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.653+0000 7f59317be640 1 Processor -- start 2024-04-25T08:45:43.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.653+0000 7f59317be640 1 -- start start 2024-04-25T08:45:43.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59317be640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f592c0d08e0 0x7f592c149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59317be640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 0x7f592c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59317be640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f592c15dac0 0x7f592c1f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59317be640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0d2100 con 0x7f592c0d34c0 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59317be640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0d2cc0 con 0x7f592c0d08e0 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59317be640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c15dea0 con 0x7f592c15dac0 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59227fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 0x7f592c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59227fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 0x7f592c0cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54724/0 (socket says 172.21.15.172:54724) 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59227fc640 1 -- 172.21.15.172:0/694180990 learned_addr learned my addr 172.21.15.172:0/694180990 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f592b7fe640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f592c15dac0 0x7f592c1f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f592affd640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f592c0d08e0 0x7f592c149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59227fc640 1 -- 172.21.15.172:0/694180990 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f592c15dac0 msgr2=0x7f592c1f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59227fc640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f592c15dac0 0x7f592c1f71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59227fc640 1 -- 172.21.15.172:0/694180990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f592c0d08e0 msgr2=0x7f592c149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59227fc640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f592c0d08e0 0x7f592c149750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59227fc640 1 -- 172.21.15.172:0/694180990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0cbf00 con 0x7f592c0d34c0 2024-04-25T08:45:43.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f59227fc640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 0x7f592c0cb4b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f591402a340 tx=0x7f59140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f5923fff640 1 -- 172.21.15.172:0/694180990 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914042020 con 0x7f592c0d34c0 2024-04-25T08:45:43.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.654+0000 7f5923fff640 1 -- 172.21.15.172:0/694180990 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5914003a20 con 0x7f592c0d34c0 2024-04-25T08:45:43.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.655+0000 7f5923fff640 1 -- 172.21.15.172:0/694180990 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914003e10 con 0x7f592c0d34c0 2024-04-25T08:45:43.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.655+0000 7f59317be640 1 -- 172.21.15.172:0/694180990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c0cc1e0 con 0x7f592c0d34c0 2024-04-25T08:45:43.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.655+0000 7f59317be640 1 -- 172.21.15.172:0/694180990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c14a1d0 con 0x7f592c0d34c0 2024-04-25T08:45:43.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.656+0000 7f5923fff640 1 -- 172.21.15.172:0/694180990 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5914045020 con 0x7f592c0d34c0 2024-04-25T08:45:43.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.656+0000 7f5923fff640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f590c06b4d0 0x7f590c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.657+0000 7f5923fff640 1 -- 172.21.15.172:0/694180990 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f59140aaf50 con 0x7f592c0d34c0 2024-04-25T08:45:43.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.657+0000 7f592affd640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f590c06b4d0 0x7f590c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.657+0000 7f592affd640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f590c06b4d0 0x7f590c06d990 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f591c001500 tx=0x7f591c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.657+0000 7f593459d740 1 Processor -- start 2024-04-25T08:45:43.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.658+0000 7f593459d740 1 -- start start 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.658+0000 7f593459d740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e350d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.658+0000 7f593459d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.658+0000 7f593459d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 0x5562e350c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.658+0000 7f593459d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e342be60 con 0x5562e34c9130 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.658+0000 7f593459d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e33d5120 con 0x5562e34efaf0 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.658+0000 7f593459d740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562e3427f00 con 0x5562e350ef60 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.658+0000 7f59227fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.658+0000 7f59227fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54740/0 (socket says 172.21.15.172:54740) 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.658+0000 7f59227fc640 1 -- 172.21.15.172:0/3377763442 learned_addr learned my addr 172.21.15.172:0/3377763442 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f592b7fe640 1 --2- 172.21.15.172:0/3377763442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 0x5562e350c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f592affd640 1 --2- 172.21.15.172:0/3377763442 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e350d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f59227fc640 1 -- 172.21.15.172:0/3377763442 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 msgr2=0x5562e350d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f59227fc640 1 --2- 172.21.15.172:0/3377763442 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e350d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f59227fc640 1 -- 172.21.15.172:0/3377763442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 msgr2=0x5562e350c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f59227fc640 1 --2- 172.21.15.172:0/3377763442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 0x5562e350c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f59227fc640 1 -- 172.21.15.172:0/3377763442 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e320cf00 con 0x5562e34c9130 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f592b7fe640 1 --2- 172.21.15.172:0/3377763442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 0x5562e350c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f59227fc640 1 --2- 172.21.15.172:0/3377763442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f340 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f59140817b0 tx=0x7f591402bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da2a9568dad3aac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f5920ff9640 1 -- 172.21.15.172:0/3377763442 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914091120 con 0x5562e34c9130 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f5920ff9640 1 -- 172.21.15.172:0/3377763442 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591407d720 con 0x5562e34c9130 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.659+0000 7f5920ff9640 1 -- 172.21.15.172:0/3377763442 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914081ce0 con 0x5562e34c9130 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 -- 172.21.15.172:0/3377763442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 msgr2=0x5562e350f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 --2- 172.21.15.172:0/3377763442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f340 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f59140817b0 tx=0x7f591402bf20 comp rx=0 tx=0).stop 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 -- 172.21.15.172:0/3377763442 shutdown_connections 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 --2- 172.21.15.172:0/3377763442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 0x5562e350c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 --2- 172.21.15.172:0/3377763442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f340 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 --2- 172.21.15.172:0/3377763442 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e350d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 -- 172.21.15.172:0/3377763442 >> 172.21.15.172:0/3377763442 conn(0x5562e348ff70 msgr2=0x5562e34c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 -- 172.21.15.172:0/3377763442 shutdown_connections 2024-04-25T08:45:43.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 -- 172.21.15.172:0/3377763442 wait complete. 2024-04-25T08:45:43.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 -- start start 2024-04-25T08:45:43.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.660+0000 7f593459d740 1 Processor -- start 2024-04-25T08:45:43.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f593459d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34c9130 0x5562e34e9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f593459d740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e34efaf0 0x5562e34f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f593459d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e350ef60 0x5562e34c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f593459d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e342be60 con 0x5562e350ef60 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f593459d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e33cacd0 con 0x5562e34c9130 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f593459d740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562e350e760 con 0x5562e34efaf0 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f593459d740 10 client.0 _ll_register_callbacks cb 0x5562e31402e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f592b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e350ef60 0x5562e34c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f592b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e350ef60 0x5562e34c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54750/0 (socket says 172.21.15.172:54750) 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f592b7fe640 1 -- 172.21.15.172:0/1768990877 learned_addr learned my addr 172.21.15.172:0/1768990877 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f59227fc640 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e34efaf0 0x5562e34f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f592affd640 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34c9130 0x5562e34e9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f592b7fe640 1 -- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e34efaf0 msgr2=0x5562e34f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f592b7fe640 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e34efaf0 0x5562e34f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f592b7fe640 1 -- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34c9130 msgr2=0x5562e34e9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f592b7fe640 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34c9130 0x5562e34e9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.661+0000 7f592b7fe640 1 -- 172.21.15.172:0/1768990877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562e31007f0 con 0x5562e350ef60 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f592b7fe640 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e350ef60 0x5562e34c8880 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5924009fd0 tx=0x7f5924004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c195a9400ae2038f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f5909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f5909ffb640 1 -- 172.21.15.172:0/1768990877 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924007aa0 con 0x5562e350ef60 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f5909ffb640 1 -- 172.21.15.172:0/1768990877 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5924007c40 con 0x5562e350ef60 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f593459d740 1 -- 172.21.15.172:0/1768990877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f591407d720 con 0x5562e350ef60 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f5909ffb640 1 -- 172.21.15.172:0/1768990877 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5924007e40 con 0x5562e350ef60 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f593459d740 10 client.6363 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f593459d740 1 -- 172.21.15.172:0/1768990877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5562e326d690 con 0x5562e350ef60 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f5909ffb640 1 -- 172.21.15.172:0/1768990877 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591407d720 con 0x5562e350ef60 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f5909ffb640 1 -- 172.21.15.172:0/1768990877 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5924025080 con 0x5562e350ef60 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f593459d740 10 client.6363 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f593459d740 10 client.6363 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f593459d740 20 client.6363 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f593459d740 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5562e3508d20 0x5562e350d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f593459d740 4 client.6363 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f593459d740 1 -- 172.21.15.172:0/1768990877 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562e34393a0 con 0x5562e3508d20 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.662+0000 7f592affd640 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5562e3508d20 0x5562e350d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f5909ffb640 10 client.6363 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f592affd640 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5562e3508d20 0x5562e350d680 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e03a9870cd4143 server_cookie=873e5eef829e5600 in_seq=0 out_seq=0 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f5909ffb640 1 -- 172.21.15.172:0/1768990877 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5562e34393a0 con 0x5562e3508d20 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f5909ffb640 10 client.6363 handle_command_reply: tid=0 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 client.6363 shutdown 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 -- 172.21.15.172:0/1768990877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e350ef60 msgr2=0x5562e34c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e350ef60 0x5562e34c8880 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5924009fd0 tx=0x7f5924004750 comp rx=0 tx=0).stop 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 -- 172.21.15.172:0/1768990877 shutdown_connections 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5562e3508d20 0x5562e350d680 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e350ef60 0x5562e34c8880 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e34efaf0 0x5562e34f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 --2- 172.21.15.172:0/1768990877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34c9130 0x5562e34e9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f5909ffb640 0 client.6363 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 -- 172.21.15.172:0/1768990877 >> 172.21.15.172:0/1768990877 conn(0x5562e348ff70 msgr2=0x5562e34ee4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 -- 172.21.15.172:0/1768990877 shutdown_connections 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 1 -- 172.21.15.172:0/1768990877 wait complete. 2024-04-25T08:45:43.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.663+0000 7f593459d740 20 client.6363 trim_cache size 0 max 16384 2024-04-25T08:45:43.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.678+0000 7f593459d740 1 Processor -- start 2024-04-25T08:45:43.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.679+0000 7f593459d740 1 -- start start 2024-04-25T08:45:43.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.679+0000 7f593459d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.679+0000 7f593459d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 0x5562e34c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.679+0000 7f593459d740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e35301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.679+0000 7f593459d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c2005b0 con 0x5562e34c9130 2024-04-25T08:45:43.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.679+0000 7f593459d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c1ff7c0 con 0x5562e34efaf0 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.679+0000 7f593459d740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c14b240 con 0x5562e350ef60 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.679+0000 7f592affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.679+0000 7f592affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54752/0 (socket says 172.21.15.172:54752) 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.679+0000 7f592affd640 1 -- 172.21.15.172:0/518788170 learned_addr learned my addr 172.21.15.172:0/518788170 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f592affd640 1 -- 172.21.15.172:0/518788170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 msgr2=0x5562e35301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f592b7fe640 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e35301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f592affd640 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e35301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f59227fc640 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 0x5562e34c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f592affd640 1 -- 172.21.15.172:0/518788170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 msgr2=0x5562e34c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f592affd640 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 0x5562e34c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f592affd640 1 -- 172.21.15.172:0/518788170 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e30d98b0 con 0x5562e34c9130 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f592b7fe640 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e35301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f59227fc640 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 0x5562e34c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:43.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f592affd640 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f9b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f591c014bd0 tx=0x7f591c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f36ee20a1e6abe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f590bfff640 1 -- 172.21.15.172:0/518788170 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c030070 con 0x5562e34c9130 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f590bfff640 1 -- 172.21.15.172:0/518788170 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c022a70 con 0x5562e34c9130 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f590bfff640 1 -- 172.21.15.172:0/518788170 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c022e40 con 0x5562e34c9130 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f593459d740 1 -- 172.21.15.172:0/518788170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 msgr2=0x5562e350f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f593459d740 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f9b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f591c014bd0 tx=0x7f591c013000 comp rx=0 tx=0).stop 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f593459d740 1 -- 172.21.15.172:0/518788170 shutdown_connections 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f593459d740 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34efaf0 0x5562e34c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f593459d740 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e35301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f593459d740 1 --2- 172.21.15.172:0/518788170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34c9130 0x5562e350f9b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f593459d740 1 -- 172.21.15.172:0/518788170 >> 172.21.15.172:0/518788170 conn(0x5562e348ff70 msgr2=0x5562e34c5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f593459d740 1 -- 172.21.15.172:0/518788170 shutdown_connections 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.680+0000 7f593459d740 1 -- 172.21.15.172:0/518788170 wait complete. 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.681+0000 7f593459d740 1 -- start start 2024-04-25T08:45:43.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.681+0000 7f593459d740 1 Processor -- start 2024-04-25T08:45:43.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f593459d740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34c9130 0x5562e357a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f593459d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34efaf0 0x5562e34e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f593459d740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e351c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f593459d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e3510ee0 con 0x5562e34efaf0 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f593459d740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c14b840 con 0x5562e34c9130 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f593459d740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562e34c5060 con 0x5562e350ef60 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f593459d740 10 client.0 _ll_register_callbacks cb 0x7f5914075870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f59227fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34efaf0 0x5562e34e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f59227fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34efaf0 0x5562e34e8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54754/0 (socket says 172.21.15.172:54754) 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f59227fc640 1 -- 172.21.15.172:0/1447991278 learned_addr learned my addr 172.21.15.172:0/1447991278 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f592affd640 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34c9130 0x5562e357a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f592b7fe640 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e351c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f59227fc640 1 -- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 msgr2=0x5562e351c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f59227fc640 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e351c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f59227fc640 1 -- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34c9130 msgr2=0x5562e357a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f59227fc640 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34c9130 0x5562e357a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f59227fc640 1 -- 172.21.15.172:0/1447991278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562e351fd40 con 0x5562e34efaf0 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f59227fc640 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34efaf0 0x5562e34e8e20 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f59140792d0 tx=0x7f5914048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea53f27c315d4e57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f5909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f5909ffb640 1 -- 172.21.15.172:0/1447991278 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59140465b0 con 0x5562e34efaf0 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f5909ffb640 1 -- 172.21.15.172:0/1447991278 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5914094c50 con 0x5562e34efaf0 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f593459d740 1 -- 172.21.15.172:0/1447991278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f591c022a70 con 0x5562e34efaf0 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f5909ffb640 1 -- 172.21.15.172:0/1447991278 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5914094e50 con 0x5562e34efaf0 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.682+0000 7f593459d740 10 client.6369 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f593459d740 1 -- 172.21.15.172:0/1447991278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5562e34c7400 con 0x5562e34efaf0 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f5909ffb640 1 -- 172.21.15.172:0/1447991278 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c022a70 con 0x5562e34efaf0 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f5909ffb640 1 -- 172.21.15.172:0/1447991278 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f59140a2ce0 con 0x5562e34efaf0 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f593459d740 10 client.6369 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f593459d740 10 client.6369 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f593459d740 20 client.6369 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:43.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f593459d740 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5562e34e9360 0x5562e34f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f593459d740 4 client.6369 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f593459d740 1 -- 172.21.15.172:0/1447991278 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x5562e34336f0 con 0x5562e34e9360 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f592affd640 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5562e34e9360 0x5562e34f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f5909ffb640 10 client.6369 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.683+0000 7f592affd640 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5562e34e9360 0x5562e34f1ae0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ed49f2b36ebb38a server_cookie=718f98fb4ecca7ee in_seq=0 out_seq=0 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f5909ffb640 1 -- 172.21.15.172:0/1447991278 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5562e34336f0 con 0x5562e34e9360 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f5909ffb640 10 client.6369 handle_command_reply: tid=0 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 client.6369 shutdown 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 -- 172.21.15.172:0/1447991278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34efaf0 msgr2=0x5562e34e8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34efaf0 0x5562e34e8e20 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f59140792d0 tx=0x7f5914048000 comp rx=0 tx=0).stop 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 -- 172.21.15.172:0/1447991278 shutdown_connections 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5562e34e9360 0x5562e34f1ae0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5562e350ef60 0x5562e351c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562e34efaf0 0x5562e34e8e20 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 --2- 172.21.15.172:0/1447991278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5562e34c9130 0x5562e357a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 -- 172.21.15.172:0/1447991278 >> 172.21.15.172:0/1447991278 conn(0x5562e348ff70 msgr2=0x5562e35110a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f5909ffb640 0 client.6369 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 -- 172.21.15.172:0/1447991278 shutdown_connections 2024-04-25T08:45:43.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 1 -- 172.21.15.172:0/1447991278 wait complete. 2024-04-25T08:45:43.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f593459d740 20 client.6369 trim_cache size 0 max 16384 2024-04-25T08:45:43.681 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:45:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "28b02a34-05be-4048-bd2f-cc6c006eb0cd", 2024-04-25T08:45:43.681 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:45:43.681 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:43.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f59317be640 1 -- 172.21.15.172:0/694180990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f590c06b4d0 msgr2=0x7f590c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f59317be640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f590c06b4d0 0x7f590c06d990 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f591c001500 tx=0x7f591c009040 comp rx=0 tx=0).stop 2024-04-25T08:45:43.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f59317be640 1 -- 172.21.15.172:0/694180990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 msgr2=0x7f592c0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f59317be640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 0x7f592c0cb4b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f591402a340 tx=0x7f59140046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f59317be640 1 -- 172.21.15.172:0/694180990 shutdown_connections 2024-04-25T08:45:43.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f59317be640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f590c06b4d0 0x7f590c06d990 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f59317be640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f592c15dac0 0x7f592c1f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f59317be640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f592c0d34c0 0x7f592c0cb4b0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.684+0000 7f59317be640 1 --2- 172.21.15.172:0/694180990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f592c0d08e0 0x7f592c149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.685+0000 7f59317be640 1 -- 172.21.15.172:0/694180990 >> 172.21.15.172:0/694180990 conn(0x7f592c061c30 msgr2=0x7f592c0b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.685+0000 7f59317be640 1 -- 172.21.15.172:0/694180990 shutdown_connections 2024-04-25T08:45:43.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.685+0000 7f59317be640 1 -- 172.21.15.172:0/694180990 wait complete. 2024-04-25T08:45:43.687 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '28b02a34-05be-4048-bd2f-cc6c006eb0cd', 'mode': 'asynchronous'}' 2024-04-25T08:45:43.687 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-04-25T08:45:43.687 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:43.687 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-04-25T08:45:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.795+0000 7fd343e6b640 1 Processor -- start 2024-04-25T08:45:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.796+0000 7fd343e6b640 1 -- start start 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd343e6b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c0ce230 0x7fd33c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd343e6b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd33c15b270 0x7fd33c15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd343e6b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c072280 con 0x7fd33c0cc4f0 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd343e6b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c071270 con 0x7fd33c15b270 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd343e6b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0714c0 con 0x7fd33c0ce230 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd341c07640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd33c0cc4f0 0x7fd33c0cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45448/0 (socket says 172.21.15.172:45448) 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd341c07640 1 -- 172.21.15.172:0/3940014336 learned_addr learned my addr 172.21.15.172:0/3940014336 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd341406640 1 --2- 172.21.15.172:0/3940014336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c0ce230 0x7fd33c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd342408640 1 --2- 172.21.15.172:0/3940014336 >> v2:172.21.15.186:3300/0 conn(0x7fd33c15b270 0x7fd33c15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd340c05640 1 -- 172.21.15.172:0/3940014336 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49328369 0 0) 0x7fd33c072280 con 0x7fd33c0cc4f0 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd340c05640 1 -- 172.21.15.172:0/3940014336 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd328003520 con 0x7fd33c0cc4f0 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd341406640 1 -- 172.21.15.172:0/3940014336 >> v2:172.21.15.186:3300/0 conn(0x7fd33c15b270 msgr2=0x7fd33c15b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd341406640 1 --2- 172.21.15.172:0/3940014336 >> v2:172.21.15.186:3300/0 conn(0x7fd33c15b270 0x7fd33c15b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd341406640 1 -- 172.21.15.172:0/3940014336 >> v1:172.21.15.172:6789/0 conn(0x7fd33c0cc4f0 legacy=0x7fd33c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.797+0000 7fd341406640 1 -- 172.21.15.172:0/3940014336 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0717a0 con 0x7fd33c0ce230 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.798+0000 7fd341406640 1 --2- 172.21.15.172:0/3940014336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c0ce230 0x7fd33c0cc8d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0097a0 tx=0x7fd32c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e78692b2c9fb7eb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.798+0000 7fd340c05640 1 -- 172.21.15.172:0/3940014336 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c037070 con 0x7fd33c0ce230 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.798+0000 7fd340c05640 1 -- 172.21.15.172:0/3940014336 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c032440 con 0x7fd33c0ce230 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.798+0000 7fd340c05640 1 -- 172.21.15.172:0/3940014336 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c032810 con 0x7fd33c0ce230 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.799+0000 7fd343e6b640 1 -- 172.21.15.172:0/3940014336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c0ce230 msgr2=0x7fd33c0cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.799+0000 7fd343e6b640 1 --2- 172.21.15.172:0/3940014336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c0ce230 0x7fd33c0cc8d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0097a0 tx=0x7fd32c02a180 comp rx=0 tx=0).stop 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.799+0000 7fd343e6b640 1 -- 172.21.15.172:0/3940014336 shutdown_connections 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.799+0000 7fd343e6b640 1 --2- 172.21.15.172:0/3940014336 >> v2:172.21.15.186:3300/0 conn(0x7fd33c15b270 0x7fd33c15b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.799+0000 7fd343e6b640 1 --2- 172.21.15.172:0/3940014336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c0ce230 0x7fd33c0cc8d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.799+0000 7fd343e6b640 1 -- 172.21.15.172:0/3940014336 >> 172.21.15.172:0/3940014336 conn(0x7fd33c06abe0 msgr2=0x7fd33c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.799+0000 7fd343e6b640 1 -- 172.21.15.172:0/3940014336 shutdown_connections 2024-04-25T08:45:43.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.799+0000 7fd343e6b640 1 -- 172.21.15.172:0/3940014336 wait complete. 2024-04-25T08:45:43.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.800+0000 7fd343e6b640 1 Processor -- start 2024-04-25T08:45:43.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.800+0000 7fd343e6b640 1 -- start start 2024-04-25T08:45:43.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd343e6b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd33c0cc4f0 0x7fd33c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd343e6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd33c0ce230 0x7fd33c1f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd343e6b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c15b270 0x7fd33c1f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd343e6b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c15bc00 con 0x7fd33c0ce230 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd343e6b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c071d60 con 0x7fd33c0cc4f0 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd343e6b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c15bd80 con 0x7fd33c15b270 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd341406640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd33c0ce230 0x7fd33c1f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd341406640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd33c0ce230 0x7fd33c1f3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54758/0 (socket says 172.21.15.172:54758) 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd341406640 1 -- 172.21.15.172:0/3209782305 learned_addr learned my addr 172.21.15.172:0/3209782305 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd341c07640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd33c0cc4f0 0x7fd33c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd342408640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c15b270 0x7fd33c1f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd341406640 1 -- 172.21.15.172:0/3209782305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c15b270 msgr2=0x7fd33c1f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd341406640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c15b270 0x7fd33c1f3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd341406640 1 -- 172.21.15.172:0/3209782305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd33c0cc4f0 msgr2=0x7fd33c0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd341406640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd33c0cc4f0 0x7fd33c0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd341406640 1 -- 172.21.15.172:0/3209782305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0cbb90 con 0x7fd33c0ce230 2024-04-25T08:45:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd341406640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd33c0ce230 0x7fd33c1f3210 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0098c0 tx=0x7fd32c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd3327fc640 1 -- 172.21.15.172:0/3209782305 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c041030 con 0x7fd33c0ce230 2024-04-25T08:45:43.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd3327fc640 1 -- 172.21.15.172:0/3209782305 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c03d4e0 con 0x7fd33c0ce230 2024-04-25T08:45:43.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd343e6b640 1 -- 172.21.15.172:0/3209782305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c156560 con 0x7fd33c0ce230 2024-04-25T08:45:43.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd3327fc640 1 -- 172.21.15.172:0/3209782305 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c037040 con 0x7fd33c0ce230 2024-04-25T08:45:43.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.801+0000 7fd343e6b640 1 -- 172.21.15.172:0/3209782305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c156b20 con 0x7fd33c0ce230 2024-04-25T08:45:43.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.803+0000 7fd3327fc640 1 -- 172.21.15.172:0/3209782305 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd32c044070 con 0x7fd33c0ce230 2024-04-25T08:45:43.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.803+0000 7fd3327fc640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd32006b4d0 0x7fd32006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.803+0000 7fd3327fc640 1 -- 172.21.15.172:0/3209782305 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd32c0aa860 con 0x7fd33c0ce230 2024-04-25T08:45:43.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.803+0000 7fd341c07640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd32006b4d0 0x7fd32006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.804+0000 7fd341c07640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd32006b4d0 0x7fd32006d990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd338005880 tx=0x7fd338009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd346b6c740 1 Processor -- start 2024-04-25T08:45:43.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd346b6c740 1 -- start start 2024-04-25T08:45:43.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b65870edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b6586dec40 0x55b6586e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b65872adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd346b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b658647a50 con 0x55b65872a940 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd346b6c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6585f0d40 con 0x55b6586dec40 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd346b6c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b658643af0 con 0x55b65870e9e0 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd342408640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b65872adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd342408640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b65872adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54766/0 (socket says 172.21.15.172:54766) 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.805+0000 7fd342408640 1 -- 172.21.15.172:0/477175710 learned_addr learned my addr 172.21.15.172:0/477175710 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd341c07640 1 --2- 172.21.15.172:0/477175710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b65870edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd341406640 1 --2- 172.21.15.172:0/477175710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b6586dec40 0x55b6586e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd342408640 1 -- 172.21.15.172:0/477175710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 msgr2=0x55b65870edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd342408640 1 --2- 172.21.15.172:0/477175710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b65870edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd342408640 1 -- 172.21.15.172:0/477175710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b6586dec40 msgr2=0x55b6586e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd342408640 1 --2- 172.21.15.172:0/477175710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b6586dec40 0x55b6586e4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd342408640 1 -- 172.21.15.172:0/477175710 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b658428690 con 0x55b65872a940 2024-04-25T08:45:43.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd342408640 1 --2- 172.21.15.172:0/477175710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b65872adc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd3340115e0 tx=0x7fd334009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd54a2f70a259b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd31f7fe640 1 -- 172.21.15.172:0/477175710 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334015900 con 0x55b65872a940 2024-04-25T08:45:43.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd31f7fe640 1 -- 172.21.15.172:0/477175710 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334015aa0 con 0x55b65872a940 2024-04-25T08:45:43.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.806+0000 7fd31f7fe640 1 -- 172.21.15.172:0/477175710 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334015e50 con 0x55b65872a940 2024-04-25T08:45:43.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 -- 172.21.15.172:0/477175710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 msgr2=0x55b65872adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 --2- 172.21.15.172:0/477175710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b65872adc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd3340115e0 tx=0x7fd334009750 comp rx=0 tx=0).stop 2024-04-25T08:45:43.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 -- 172.21.15.172:0/477175710 shutdown_connections 2024-04-25T08:45:43.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 --2- 172.21.15.172:0/477175710 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b6586dec40 0x55b6586e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 --2- 172.21.15.172:0/477175710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b65872adc0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 --2- 172.21.15.172:0/477175710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b65870edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 -- 172.21.15.172:0/477175710 >> 172.21.15.172:0/477175710 conn(0x55b6586e0eb0 msgr2=0x55b6587297f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 -- 172.21.15.172:0/477175710 shutdown_connections 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 -- 172.21.15.172:0/477175710 wait complete. 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 -- start start 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.807+0000 7fd346b6c740 1 Processor -- start 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65870e9e0 0x55b65870a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b6587208b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65872be50 0x55b65872c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd346b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6586e51b0 con 0x55b65872a940 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd346b6c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6585e6340 con 0x55b65870e9e0 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd346b6c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b6586e47e0 con 0x55b65872be50 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd346b6c740 10 client.0 _ll_register_callbacks cb 0x55b658603cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd341406640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b6587208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd341406640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b6587208b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54770/0 (socket says 172.21.15.172:54770) 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd341406640 1 -- 172.21.15.172:0/3263572196 learned_addr learned my addr 172.21.15.172:0/3263572196 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd342408640 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65872be50 0x55b65872c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.808+0000 7fd341c07640 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65870e9e0 0x55b65870a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd341406640 1 -- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65872be50 msgr2=0x55b65872c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd341406640 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65872be50 0x55b65872c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd341406640 1 -- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65870e9e0 msgr2=0x55b65870a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd341406640 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65870e9e0 0x55b65870a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd341406640 1 -- 172.21.15.172:0/3263572196 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b658488e20 con 0x55b65872a940 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd341406640 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b6587208b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0a8c90 tx=0x7fd32c078990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6981aa4ad9a10d80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd31cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd31cff9640 1 -- 172.21.15.172:0/3263572196 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c090070 con 0x55b65872a940 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd31cff9640 1 -- 172.21.15.172:0/3263572196 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd32c081400 con 0x55b65872a940 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd346b6c740 1 -- 172.21.15.172:0/3263572196 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd334015aa0 con 0x55b65872a940 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd31cff9640 1 -- 172.21.15.172:0/3263572196 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd32c081690 con 0x55b65872a940 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd346b6c740 10 client.6381 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd346b6c740 1 -- 172.21.15.172:0/3263572196 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55b65831bf80 con 0x55b65872a940 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd31cff9640 1 -- 172.21.15.172:0/3263572196 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334015aa0 con 0x55b65872a940 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd31cff9640 1 -- 172.21.15.172:0/3263572196 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd32c04e060 con 0x55b65872a940 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd346b6c740 10 client.6381 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd346b6c740 10 client.6381 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd346b6c740 20 client.6381 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd346b6c740 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55b65873ee90 0x55b65873f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd346b6c740 4 client.6381 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd346b6c740 1 -- 172.21.15.172:0/3263572196 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b658654f90 con 0x55b65873ee90 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.809+0000 7fd341c07640 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55b65873ee90 0x55b65873f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd31cff9640 10 client.6381 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd341c07640 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55b65873ee90 0x55b65873f270 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c5bacd85bf487e3 server_cookie=30e3feb1cd3d6ae7 in_seq=0 out_seq=0 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd31cff9640 1 -- 172.21.15.172:0/3263572196 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b658654f90 con 0x55b65873ee90 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd31cff9640 10 client.6381 handle_command_reply: tid=0 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd346b6c740 1 client.6381 shutdown 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd346b6c740 1 -- 172.21.15.172:0/3263572196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 msgr2=0x55b6587208b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd346b6c740 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b6587208b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0a8c90 tx=0x7fd32c078990 comp rx=0 tx=0).stop 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd346b6c740 1 -- 172.21.15.172:0/3263572196 shutdown_connections 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd346b6c740 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55b65873ee90 0x55b65873f270 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd346b6c740 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65872be50 0x55b65872c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd346b6c740 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872a940 0x55b6587208b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd346b6c740 1 --2- 172.21.15.172:0/3263572196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65870e9e0 0x55b65870a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd31cff9640 0 client.6381 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.810+0000 7fd346b6c740 1 -- 172.21.15.172:0/3263572196 >> 172.21.15.172:0/3263572196 conn(0x55b6586dec40 msgr2=0x55b65872a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.811+0000 7fd346b6c740 1 -- 172.21.15.172:0/3263572196 shutdown_connections 2024-04-25T08:45:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.811+0000 7fd346b6c740 1 -- 172.21.15.172:0/3263572196 wait complete. 2024-04-25T08:45:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.811+0000 7fd346b6c740 20 client.6381 trim_cache size 0 max 16384 2024-04-25T08:45:43.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.826+0000 7fd346b6c740 1 Processor -- start 2024-04-25T08:45:43.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.826+0000 7fd346b6c740 1 -- start start 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.826+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b6586ddb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.826+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65872a940 0x55b6586e2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.826+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b658734d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.826+0000 7fd346b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c1fbff0 con 0x55b65872be50 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.826+0000 7fd346b6c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0cfd10 con 0x55b65872a940 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.826+0000 7fd346b6c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c15d950 con 0x55b65870e9e0 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.826+0000 7fd342408640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b658734d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd342408640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b658734d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54774/0 (socket says 172.21.15.172:54774) 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd342408640 1 -- 172.21.15.172:0/2430307671 learned_addr learned my addr 172.21.15.172:0/2430307671 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd342408640 1 -- 172.21.15.172:0/2430307671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 msgr2=0x55b6586ddb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd341c07640 1 --2- 172.21.15.172:0/2430307671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b6586ddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd342408640 1 --2- 172.21.15.172:0/2430307671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b6586ddb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd341406640 1 --2- 172.21.15.172:0/2430307671 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65872a940 0x55b6586e2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd342408640 1 -- 172.21.15.172:0/2430307671 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65872a940 msgr2=0x55b6586e2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd342408640 1 --2- 172.21.15.172:0/2430307671 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65872a940 0x55b6586e2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd342408640 1 -- 172.21.15.172:0/2430307671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6586e4750 con 0x55b65872be50 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd342408640 1 --2- 172.21.15.172:0/2430307671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b658734d40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd334011580 tx=0x7fd334009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3faf814b3b944 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd31effd640 1 -- 172.21.15.172:0/2430307671 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33402d070 con 0x55b65872be50 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd31effd640 1 -- 172.21.15.172:0/2430307671 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334003e20 con 0x55b65872be50 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.827+0000 7fd31effd640 1 -- 172.21.15.172:0/2430307671 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334015920 con 0x55b65872be50 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 -- 172.21.15.172:0/2430307671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 msgr2=0x55b658734d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 --2- 172.21.15.172:0/2430307671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b658734d40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd334011580 tx=0x7fd334009f90 comp rx=0 tx=0).stop 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 -- 172.21.15.172:0/2430307671 shutdown_connections 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 --2- 172.21.15.172:0/2430307671 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65872a940 0x55b6586e2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 --2- 172.21.15.172:0/2430307671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b658734d40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 --2- 172.21.15.172:0/2430307671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b6586ddb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 -- 172.21.15.172:0/2430307671 >> 172.21.15.172:0/2430307671 conn(0x55b6586dec40 msgr2=0x55b65873f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 -- 172.21.15.172:0/2430307671 shutdown_connections 2024-04-25T08:45:43.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 -- 172.21.15.172:0/2430307671 wait complete. 2024-04-25T08:45:43.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 -- start start 2024-04-25T08:45:43.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.828+0000 7fd346b6c740 1 Processor -- start 2024-04-25T08:45:43.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b658798240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65872a940 0x55b65872a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd346b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b65870cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd346b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0cf710 con 0x55b65872be50 2024-04-25T08:45:43.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd346b6c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b658729260 con 0x55b65872a940 2024-04-25T08:45:43.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd346b6c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b65872baa0 con 0x55b65870e9e0 2024-04-25T08:45:43.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd346b6c740 10 client.0 _ll_register_callbacks cb 0x7fd32c02a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:43.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd342408640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b65870cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd342408640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b65870cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54780/0 (socket says 172.21.15.172:54780) 2024-04-25T08:45:43.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd342408640 1 -- 172.21.15.172:0/2674441512 learned_addr learned my addr 172.21.15.172:0/2674441512 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd341406640 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65872a940 0x55b65872a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd341c07640 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b658798240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd342408640 1 -- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 msgr2=0x55b658798240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.829+0000 7fd342408640 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b658798240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd342408640 1 -- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65872a940 msgr2=0x55b65872a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd342408640 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65872a940 0x55b65872a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd342408640 1 -- 172.21.15.172:0/2674441512 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b658741390 con 0x55b65872be50 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd342408640 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b65870cb60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd334009cf0 tx=0x7fd334014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e098537cdeced1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd31cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd31cff9640 1 -- 172.21.15.172:0/2674441512 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33402d040 con 0x55b65872be50 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd31cff9640 1 -- 172.21.15.172:0/2674441512 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd334004000 con 0x55b65872be50 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd346b6c740 1 -- 172.21.15.172:0/2674441512 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd334003e20 con 0x55b65872be50 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd31cff9640 1 -- 172.21.15.172:0/2674441512 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd334015e30 con 0x55b65872be50 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd346b6c740 10 client.6387 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:43.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd346b6c740 1 -- 172.21.15.172:0/2674441512 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55b65872b6a0 con 0x55b65872be50 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd31cff9640 1 -- 172.21.15.172:0/2674441512 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334003e20 con 0x55b65872be50 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd31cff9640 1 -- 172.21.15.172:0/2674441512 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd33403b440 con 0x55b65872be50 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd346b6c740 10 client.6387 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd346b6c740 10 client.6387 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd346b6c740 20 client.6387 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd346b6c740 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55b658728af0 0x55b6586e2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd346b6c740 4 client.6387 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd346b6c740 1 -- 172.21.15.172:0/2674441512 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0x55b65864f2e0 con 0x55b658728af0 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.830+0000 7fd341c07640 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55b658728af0 0x55b6586e2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd31cff9640 10 client.6387 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd341c07640 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55b658728af0 0x55b6586e2640 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=625c52232cb95441 server_cookie=774950b97f8204b9 in_seq=0 out_seq=0 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd31cff9640 1 -- 172.21.15.172:0/2674441512 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b65864f2e0 con 0x55b658728af0 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd31cff9640 10 client.6387 handle_command_reply: tid=0 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 client.6387 shutdown 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 -- 172.21.15.172:0/2674441512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 msgr2=0x55b65870cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b65870cb60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd334009cf0 tx=0x7fd334014000 comp rx=0 tx=0).stop 2024-04-25T08:45:43.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 -- 172.21.15.172:0/2674441512 shutdown_connections 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65872a940 0x55b65872a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55b658728af0 0x55b6586e2640 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b65872be50 0x55b65870cb60 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 --2- 172.21.15.172:0/2674441512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55b65870e9e0 0x55b658798240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd31cff9640 0 client.6387 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 -- 172.21.15.172:0/2674441512 >> 172.21.15.172:0/2674441512 conn(0x55b6586dec40 msgr2=0x55b65870efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 -- 172.21.15.172:0/2674441512 shutdown_connections 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 1 -- 172.21.15.172:0/2674441512 wait complete. 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.831+0000 7fd346b6c740 20 client.6387 trim_cache size 0 max 16384 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "dbf114be-4d38-434e-9570-6b4118e25a3c", 2024-04-25T08:45:43.828 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:45:43.829 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:43.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 -- 172.21.15.172:0/3209782305 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd32006b4d0 msgr2=0x7fd32006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd32006b4d0 0x7fd32006d990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd338005880 tx=0x7fd338009040 comp rx=0 tx=0).stop 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 -- 172.21.15.172:0/3209782305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd33c0ce230 msgr2=0x7fd33c1f3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd33c0ce230 0x7fd33c1f3210 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0098c0 tx=0x7fd32c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 -- 172.21.15.172:0/3209782305 shutdown_connections 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd32006b4d0 0x7fd32006d990 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd33c15b270 0x7fd33c1f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd33c0ce230 0x7fd33c1f3210 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 --2- 172.21.15.172:0/3209782305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd33c0cc4f0 0x7fd33c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 -- 172.21.15.172:0/3209782305 >> 172.21.15.172:0/3209782305 conn(0x7fd33c06abe0 msgr2=0x7fd33c0b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 -- 172.21.15.172:0/3209782305 shutdown_connections 2024-04-25T08:45:43.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.832+0000 7fd343e6b640 1 -- 172.21.15.172:0/3209782305 wait complete. 2024-04-25T08:45:43.834 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'dbf114be-4d38-434e-9570-6b4118e25a3c', 'mode': 'asynchronous'}' 2024-04-25T08:45:43.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:43.835 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-04-25T08:45:43.851 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-04-25T08:45:43.851 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:43.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.996+0000 7f2aacdd5640 1 Processor -- start 2024-04-25T08:45:43.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.996+0000 7f2aacdd5640 1 -- start start 2024-04-25T08:45:43.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.997+0000 7f2aacdd5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2aa80af720 0x7f2aa80afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.997+0000 7f2aacdd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2aa80d02f0 0x7f2aa80d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.997+0000 7f2aacdd5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa806fe00 con 0x7f2aa8158220 2024-04-25T08:45:43.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.997+0000 7f2aacdd5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa80b3670 con 0x7f2aa80af720 2024-04-25T08:45:43.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.997+0000 7f2aacdd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa8070a10 con 0x7f2aa80d02f0 2024-04-25T08:45:43.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.997+0000 7f2aa5d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2aa80af720 0x7f2aa80afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.997+0000 7f2aa659c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2aa8158220 0x7f2aa815ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45464/0 (socket says 172.21.15.172:45464) 2024-04-25T08:45:43.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.997+0000 7f2aa5d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2aa80af720 0x7f2aa80afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54788/0 (socket says 172.21.15.172:54788) 2024-04-25T08:45:43.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.997+0000 7f2aa659c640 1 -- 172.21.15.172:0/3597407490 learned_addr learned my addr 172.21.15.172:0/3597407490 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:43.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.998+0000 7f2aa6d9d640 1 --2- 172.21.15.172:0/3597407490 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2aa80d02f0 0x7f2aa80d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.998+0000 7f2aa5d9b640 1 -- 172.21.15.172:0/3597407490 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2aa80d02f0 msgr2=0x7f2aa80d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:43.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.998+0000 7f2aa5d9b640 1 --2- 172.21.15.172:0/3597407490 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2aa80d02f0 0x7f2aa80d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.998+0000 7f2aa5d9b640 1 -- 172.21.15.172:0/3597407490 >> v1:172.21.15.172:6789/0 conn(0x7f2aa8158220 legacy=0x7f2aa815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.998+0000 7f2aa5d9b640 1 -- 172.21.15.172:0/3597407490 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa80700e0 con 0x7f2aa80af720 2024-04-25T08:45:43.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.998+0000 7f2aa5d9b640 1 --2- 172.21.15.172:0/3597407490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80af720 0x7f2aa80afba0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0097a0 tx=0x7f2a9c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9fb25f1c723943 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.998+0000 7f2aa559a640 1 -- 172.21.15.172:0/3597407490 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c037070 con 0x7f2aa80af720 2024-04-25T08:45:43.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.998+0000 7f2aa559a640 1 -- 172.21.15.172:0/3597407490 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c032440 con 0x7f2aa80af720 2024-04-25T08:45:43.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.998+0000 7f2aa559a640 1 -- 172.21.15.172:0/3597407490 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c032810 con 0x7f2aa80af720 2024-04-25T08:45:43.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.999+0000 7f2aacdd5640 1 -- 172.21.15.172:0/3597407490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80af720 msgr2=0x7f2aa80afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.999+0000 7f2aacdd5640 1 --2- 172.21.15.172:0/3597407490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80af720 0x7f2aa80afba0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c0097a0 tx=0x7f2a9c02a180 comp rx=0 tx=0).stop 2024-04-25T08:45:43.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.999+0000 7f2aacdd5640 1 -- 172.21.15.172:0/3597407490 shutdown_connections 2024-04-25T08:45:43.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.999+0000 7f2aacdd5640 1 --2- 172.21.15.172:0/3597407490 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2aa80d02f0 0x7f2aa80d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.999+0000 7f2aacdd5640 1 --2- 172.21.15.172:0/3597407490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80af720 0x7f2aa80afba0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.999+0000 7f2aacdd5640 1 -- 172.21.15.172:0/3597407490 >> 172.21.15.172:0/3597407490 conn(0x7f2aa80b2370 msgr2=0x7f2aa80b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:43.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.999+0000 7f2aacdd5640 1 -- 172.21.15.172:0/3597407490 shutdown_connections 2024-04-25T08:45:43.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:43.999+0000 7f2aacdd5640 1 -- 172.21.15.172:0/3597407490 wait complete. 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.000+0000 7f2aacdd5640 1 Processor -- start 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.000+0000 7f2aacdd5640 1 -- start start 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aacdd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2aa80af720 0x7f2aa80cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aacdd5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80d02f0 0x7f2aa815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aacdd5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2aa8158220 0x7f2aa8155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aacdd5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa8158600 con 0x7f2aa80d02f0 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aacdd5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa80706a0 con 0x7f2aa8158220 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aacdd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa8072960 con 0x7f2aa80af720 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aa5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80d02f0 0x7f2aa815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aa5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80d02f0 0x7f2aa815fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54792/0 (socket says 172.21.15.172:54792) 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aa5d9b640 1 -- 172.21.15.172:0/2751913981 learned_addr learned my addr 172.21.15.172:0/2751913981 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aa6d9d640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2aa8158220 0x7f2aa8155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.001+0000 7f2aa659c640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2aa80af720 0x7f2aa80cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2aa5d9b640 1 -- 172.21.15.172:0/2751913981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2aa80af720 msgr2=0x7f2aa80cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2aa5d9b640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2aa80af720 0x7f2aa80cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2aa5d9b640 1 -- 172.21.15.172:0/2751913981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2aa8158220 msgr2=0x7f2aa8155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2aa5d9b640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2aa8158220 0x7f2aa8155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2aa5d9b640 1 -- 172.21.15.172:0/2751913981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa80cbab0 con 0x7f2aa80d02f0 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2aa5d9b640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80d02f0 0x7f2aa815fe20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c035040 tx=0x7f2a9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2a96ffd640 1 -- 172.21.15.172:0/2751913981 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c037040 con 0x7f2aa80d02f0 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2a96ffd640 1 -- 172.21.15.172:0/2751913981 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c030770 con 0x7f2aa80d02f0 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2aacdd5640 1 -- 172.21.15.172:0/2751913981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa80cbd90 con 0x7f2aa80d02f0 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2a96ffd640 1 -- 172.21.15.172:0/2751913981 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c030b80 con 0x7f2aa80d02f0 2024-04-25T08:45:43.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.002+0000 7f2aacdd5640 1 -- 172.21.15.172:0/2751913981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa80cc350 con 0x7f2aa80d02f0 2024-04-25T08:45:43.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.003+0000 7f2aacdd5640 1 -- 172.21.15.172:0/2751913981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa8072700 con 0x7f2aa80d02f0 2024-04-25T08:45:43.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.003+0000 7f2a96ffd640 1 -- 172.21.15.172:0/2751913981 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a9c044020 con 0x7f2aa80d02f0 2024-04-25T08:45:43.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.004+0000 7f2a96ffd640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a8806b4d0 0x7f2a8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:43.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.004+0000 7f2a96ffd640 1 -- 172.21.15.172:0/2751913981 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2a9c0aa870 con 0x7f2aa80d02f0 2024-04-25T08:45:43.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.004+0000 7f2aa659c640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a8806b4d0 0x7f2a8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:43.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.004+0000 7f2aa659c640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a8806b4d0 0x7f2a8806d990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a980012e0 tx=0x7f2a98009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:43.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.008+0000 7f2a96ffd640 1 -- 172.21.15.172:0/2751913981 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2a9c032e20 con 0x7f2aa80d02f0 2024-04-25T08:45:44.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.216+0000 7f2aacdd5640 1 -- 172.21.15.172:0/2751913981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2aa80b20e0 con 0x7f2aa80d02f0 2024-04-25T08:45:44.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.217+0000 7f2a96ffd640 1 -- 172.21.15.172:0/2751913981 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f2a9c0795f0 con 0x7f2aa80d02f0 2024-04-25T08:45:44.208 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:44.208 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:38.835835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:44.209 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 24 2024-04-25T08:45:44.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 -- 172.21.15.172:0/2751913981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a8806b4d0 msgr2=0x7f2a8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:44.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a8806b4d0 0x7f2a8806d990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2a980012e0 tx=0x7f2a98009040 comp rx=0 tx=0).stop 2024-04-25T08:45:44.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 -- 172.21.15.172:0/2751913981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80d02f0 msgr2=0x7f2aa815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:44.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80d02f0 0x7f2aa815fe20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c035040 tx=0x7f2a9c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 -- 172.21.15.172:0/2751913981 shutdown_connections 2024-04-25T08:45:44.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a8806b4d0 0x7f2a8806d990 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2aa8158220 0x7f2aa8155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aa80d02f0 0x7f2aa815fe20 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 --2- 172.21.15.172:0/2751913981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2aa80af720 0x7f2aa80cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 -- 172.21.15.172:0/2751913981 >> 172.21.15.172:0/2751913981 conn(0x7f2aa80b2370 msgr2=0x7f2aa8155d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:44.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 -- 172.21.15.172:0/2751913981 shutdown_connections 2024-04-25T08:45:44.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.219+0000 7f2aacdd5640 1 -- 172.21.15.172:0/2751913981 wait complete. 2024-04-25T08:45:44.221 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-04-25T08:45:44.330 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:44.330 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": 0 2024-04-25T08:45:44.330 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:44.339 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:45:44.339 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:44.339 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:44.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:44.355 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-04-25T08:45:44.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:45:44.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:45:44.418 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726644 s, 144 MB/s 2024-04-25T08:45:44.419 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-04-25T08:45:44.419 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:44.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.565+0000 7f14922e2640 1 Processor -- start 2024-04-25T08:45:44.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.565+0000 7f14922e2640 1 -- start start 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.565+0000 7f14922e2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f148c15dbe0 0x7f148c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.565+0000 7f14922e2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c0b6220 con 0x7f148c0b2cb0 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.565+0000 7f14922e2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c0b97a0 con 0x7f148c0b92a0 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.565+0000 7f14922e2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c15dfc0 con 0x7f148c15dbe0 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f148c0b2cb0 0x7f148c0b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45472/0 (socket says 172.21.15.172:45472) 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148b7fe640 1 -- 172.21.15.172:0/2033259440 learned_addr learned my addr 172.21.15.172:0/2033259440 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148bfff640 1 --2- 172.21.15.172:0/2033259440 >> v2:172.21.15.186:3300/0 conn(0x7f148c15dbe0 0x7f148c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148affd640 1 -- 172.21.15.172:0/2033259440 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443724852 0 0) 0x7f148c0b6220 con 0x7f148c0b2cb0 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148affd640 1 -- 172.21.15.172:0/2033259440 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474003520 con 0x7f148c0b2cb0 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148affd640 1 -- 172.21.15.172:0/2033259440 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547907775 0 0) 0x7f148c0b97a0 con 0x7f148c0b92a0 2024-04-25T08:45:44.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148affd640 1 -- 172.21.15.172:0/2033259440 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f148c0b6220 con 0x7f148c0b92a0 2024-04-25T08:45:44.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148affd640 1 -- 172.21.15.172:0/2033259440 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274776547 0 0) 0x7f1474003520 con 0x7f148c0b2cb0 2024-04-25T08:45:44.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148bfff640 1 -- 172.21.15.172:0/2033259440 >> v1:172.21.15.186:6789/0 conn(0x7f148c0b92a0 legacy=0x7f148c0b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:44.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148bfff640 1 -- 172.21.15.172:0/2033259440 >> v1:172.21.15.172:6789/0 conn(0x7f148c0b2cb0 legacy=0x7f148c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:44.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.566+0000 7f148bfff640 1 -- 172.21.15.172:0/2033259440 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0d1c50 con 0x7f148c15dbe0 2024-04-25T08:45:44.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.567+0000 7f148bfff640 1 --2- 172.21.15.172:0/2033259440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148c15dbe0 0x7f148c0d0910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f147c0097a0 tx=0x7f147c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1483f39f73cf614d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:44.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.567+0000 7f148affd640 1 -- 172.21.15.172:0/2033259440 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c037070 con 0x7f148c15dbe0 2024-04-25T08:45:44.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.567+0000 7f148affd640 1 -- 172.21.15.172:0/2033259440 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c02abc0 con 0x7f148c15dbe0 2024-04-25T08:45:44.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.567+0000 7f148affd640 1 -- 172.21.15.172:0/2033259440 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480001670 con 0x7f148c15dbe0 2024-04-25T08:45:44.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.567+0000 7f14922e2640 1 -- 172.21.15.172:0/2033259440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148c15dbe0 msgr2=0x7f148c0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:44.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.567+0000 7f14922e2640 1 --2- 172.21.15.172:0/2033259440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148c15dbe0 0x7f148c0d0910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f147c0097a0 tx=0x7f147c02a130 comp rx=0 tx=0).stop 2024-04-25T08:45:44.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.567+0000 7f14922e2640 1 -- 172.21.15.172:0/2033259440 shutdown_connections 2024-04-25T08:45:44.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.568+0000 7f14922e2640 1 --2- 172.21.15.172:0/2033259440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148c15dbe0 0x7f148c0d0910 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.568+0000 7f14922e2640 1 -- 172.21.15.172:0/2033259440 >> 172.21.15.172:0/2033259440 conn(0x7f148c061a20 msgr2=0x7f148c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:44.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.568+0000 7f14922e2640 1 -- 172.21.15.172:0/2033259440 shutdown_connections 2024-04-25T08:45:44.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.568+0000 7f14922e2640 1 -- 172.21.15.172:0/2033259440 wait complete. 2024-04-25T08:45:44.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.569+0000 7f14922e2640 1 Processor -- start 2024-04-25T08:45:44.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.569+0000 7f14922e2640 1 -- start start 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f14922e2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148c0b2cb0 0x7f148c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f14922e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f148c0b92a0 0x7f148c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f14922e2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148c15dbe0 0x7f148c14cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f14922e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0d2210 con 0x7f148c0b92a0 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f14922e2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0d1a00 con 0x7f148c0b2cb0 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f14922e2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0b6ab0 con 0x7f148c15dbe0 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f148b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f148c0b92a0 0x7f148c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f148b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f148c0b92a0 0x7f148c0b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54802/0 (socket says 172.21.15.172:54802) 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f148b7fe640 1 -- 172.21.15.172:0/995019083 learned_addr learned my addr 172.21.15.172:0/995019083 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f149087f640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148c15dbe0 0x7f148c14cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f148bfff640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148c0b2cb0 0x7f148c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f148b7fe640 1 -- 172.21.15.172:0/995019083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148c15dbe0 msgr2=0x7f148c14cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:44.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f148b7fe640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148c15dbe0 0x7f148c14cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f148b7fe640 1 -- 172.21.15.172:0/995019083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148c0b2cb0 msgr2=0x7f148c0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f148b7fe640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148c0b2cb0 0x7f148c0cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f148b7fe640 1 -- 172.21.15.172:0/995019083 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0b6010 con 0x7f148c0b92a0 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f149087f640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148c15dbe0 0x7f148c14cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f148b7fe640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f148c0b92a0 0x7f148c0b58a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1480000fd0 tx=0x7f148000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f1488ff9640 1 -- 172.21.15.172:0/995019083 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480017070 con 0x7f148c0b92a0 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f1488ff9640 1 -- 172.21.15.172:0/995019083 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480005ad0 con 0x7f148c0b92a0 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f14922e2640 1 -- 172.21.15.172:0/995019083 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c0cab80 con 0x7f148c0b92a0 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f1488ff9640 1 -- 172.21.15.172:0/995019083 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480007070 con 0x7f148c0b92a0 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.570+0000 7f14922e2640 1 -- 172.21.15.172:0/995019083 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c0cb140 con 0x7f148c0b92a0 2024-04-25T08:45:44.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.571+0000 7f14922e2640 1 -- 172.21.15.172:0/995019083 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c073990 con 0x7f148c0b92a0 2024-04-25T08:45:44.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.572+0000 7f1488ff9640 1 -- 172.21.15.172:0/995019083 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f148001a070 con 0x7f148c0b92a0 2024-04-25T08:45:44.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.572+0000 7f1488ff9640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f147806b4d0 0x7f147806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:44.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.572+0000 7f148bfff640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f147806b4d0 0x7f147806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:44.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.572+0000 7f1488ff9640 1 -- 172.21.15.172:0/995019083 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1480089680 con 0x7f148c0b92a0 2024-04-25T08:45:44.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.573+0000 7f148bfff640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f147806b4d0 0x7f147806d990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f147c034000 tx=0x7f147c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:44.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.577+0000 7f1488ff9640 1 -- 172.21.15.172:0/995019083 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1480057d30 con 0x7f148c0b92a0 2024-04-25T08:45:44.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.780+0000 7f14922e2640 1 -- 172.21.15.172:0/995019083 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f148c06c8d0 con 0x7f148c0b92a0 2024-04-25T08:45:44.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.781+0000 7f1488ff9640 1 -- 172.21.15.172:0/995019083 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f148005bdd0 con 0x7f148c0b92a0 2024-04-25T08:45:44.773 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:44.773 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:38.835835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:44.773 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 24 2024-04-25T08:45:44.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 -- 172.21.15.172:0/995019083 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f147806b4d0 msgr2=0x7f147806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:44.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f147806b4d0 0x7f147806d990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f147c034000 tx=0x7f147c02e000 comp rx=0 tx=0).stop 2024-04-25T08:45:44.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 -- 172.21.15.172:0/995019083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f148c0b92a0 msgr2=0x7f148c0b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:44.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f148c0b92a0 0x7f148c0b58a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1480000fd0 tx=0x7f148000cbe0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 -- 172.21.15.172:0/995019083 shutdown_connections 2024-04-25T08:45:44.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f147806b4d0 0x7f147806d990 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148c15dbe0 0x7f148c14cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f148c0b92a0 0x7f148c0b58a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 --2- 172.21.15.172:0/995019083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148c0b2cb0 0x7f148c0cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:44.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 -- 172.21.15.172:0/995019083 >> 172.21.15.172:0/995019083 conn(0x7f148c061a20 msgr2=0x7f148c15b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:44.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 -- 172.21.15.172:0/995019083 shutdown_connections 2024-04-25T08:45:44.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44.783+0000 7f14922e2640 1 -- 172.21.15.172:0/995019083 wait complete. 2024-04-25T08:45:44.786 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-04-25T08:45:44.893 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:44.893 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": 0 2024-04-25T08:45:44.893 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:44.901 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:45:44.902 DEBUG:teuthology.orchestra.run.smithi172:> stdin-killer -- python3 -c ' 2024-04-25T08:45:44.902 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-04-25T08:45:44.902 DEBUG:teuthology.orchestra.run.smithi172:> import stat 2024-04-25T08:45:44.902 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:45:44.902 DEBUG:teuthology.orchestra.run.smithi172:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-04-25T08:45:44.902 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-04-25T08:45:44.969 INFO:teuthology.orchestra.run.smithi172.stdout:1099511630188 2024-04-25T08:45:44.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:45:44.977 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:44.978 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T08:45:45.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.125+0000 7f4fae4fc640 1 Processor -- start 2024-04-25T08:45:45.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.125+0000 7f4fae4fc640 1 -- start start 2024-04-25T08:45:45.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fae4fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fa81446d0 0x7f4fa80b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fae4fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4fa8144d50 0x7f4fa80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fae4fc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa80cccc0 con 0x7f4fa81452a0 2024-04-25T08:45:45.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fae4fc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa80b2b20 con 0x7f4fa8144d50 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fae4fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa806d400 con 0x7f4fa81446d0 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fa77fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4fa8144d50 0x7f4fa80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fa77fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4fa8144d50 0x7f4fa80b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54812/0 (socket says 172.21.15.172:54812) 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fa77fe640 1 -- 172.21.15.172:0/2624507268 learned_addr learned my addr 172.21.15.172:0/2624507268 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fa77fe640 1 -- 172.21.15.172:0/2624507268 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fa81446d0 msgr2=0x7f4fa80b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/2624507268 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fa81446d0 0x7f4fa80b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fa77fe640 1 -- 172.21.15.172:0/2624507268 >> v1:172.21.15.186:6789/0 conn(0x7f4fa81452a0 legacy=0x7f4fa80cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.126+0000 7f4fa77fe640 1 -- 172.21.15.172:0/2624507268 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa80cc140 con 0x7f4fa8144d50 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.127+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/2624507268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa8144d50 0x7f4fa80b4460 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009870 tx=0x7f4f9c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3acac99cc3f7802 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.127+0000 7f4fa6ffd640 1 -- 172.21.15.172:0/2624507268 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c037070 con 0x7f4fa8144d50 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.127+0000 7f4fa6ffd640 1 -- 172.21.15.172:0/2624507268 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c032440 con 0x7f4fa8144d50 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.127+0000 7f4fa6ffd640 1 -- 172.21.15.172:0/2624507268 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c032810 con 0x7f4fa8144d50 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.127+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2624507268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa8144d50 msgr2=0x7f4fa80b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.127+0000 7f4fae4fc640 1 --2- 172.21.15.172:0/2624507268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa8144d50 0x7f4fa80b4460 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009870 tx=0x7f4f9c02a210 comp rx=0 tx=0).stop 2024-04-25T08:45:45.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.128+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2624507268 shutdown_connections 2024-04-25T08:45:45.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.128+0000 7f4fae4fc640 1 --2- 172.21.15.172:0/2624507268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa8144d50 0x7f4fa80b4460 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.128+0000 7f4fae4fc640 1 --2- 172.21.15.172:0/2624507268 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fa81446d0 0x7f4fa80b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.128+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2624507268 >> 172.21.15.172:0/2624507268 conn(0x7f4fa806abe0 msgr2=0x7f4fa806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.128+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2624507268 shutdown_connections 2024-04-25T08:45:45.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.128+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2624507268 wait complete. 2024-04-25T08:45:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.129+0000 7f4fae4fc640 1 Processor -- start 2024-04-25T08:45:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.129+0000 7f4fae4fc640 1 -- start start 2024-04-25T08:45:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fae4fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa81446d0 0x7f4fa80a8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fae4fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fa8144d50 0x7f4fa80a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fae4fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa81452a0 0x7f4fa81f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fae4fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80cc700 con 0x7f4fa81452a0 2024-04-25T08:45:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fae4fc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80b49a0 con 0x7f4fa81446d0 2024-04-25T08:45:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fae4fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa80cc9e0 con 0x7f4fa8144d50 2024-04-25T08:45:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4faca99640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa81452a0 0x7f4fa81f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4faca99640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa81452a0 0x7f4fa81f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54824/0 (socket says 172.21.15.172:54824) 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4faca99640 1 -- 172.21.15.172:0/2757998643 learned_addr learned my addr 172.21.15.172:0/2757998643 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa81446d0 0x7f4fa80a8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fa8144d50 0x7f4fa80a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4faca99640 1 -- 172.21.15.172:0/2757998643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fa8144d50 msgr2=0x7f4fa80a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4faca99640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fa8144d50 0x7f4fa80a93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4faca99640 1 -- 172.21.15.172:0/2757998643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa81446d0 msgr2=0x7f4fa80a8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4faca99640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa81446d0 0x7f4fa80a8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4faca99640 1 -- 172.21.15.172:0/2757998643 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa80aa090 con 0x7f4fa81452a0 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4faca99640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa81452a0 0x7f4fa81f4d10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000b9c0 tx=0x7f4fa000bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fa4ff9640 1 -- 172.21.15.172:0/2757998643 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0019070 con 0x7f4fa81452a0 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fa4ff9640 1 -- 172.21.15.172:0/2757998643 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa000ca60 con 0x7f4fa81452a0 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fa4ff9640 1 -- 172.21.15.172:0/2757998643 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000ce50 con 0x7f4fa81452a0 2024-04-25T08:45:45.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2757998643 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa80aa370 con 0x7f4fa81452a0 2024-04-25T08:45:45.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.130+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2757998643 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa80aa930 con 0x7f4fa81452a0 2024-04-25T08:45:45.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.132+0000 7f4fa4ff9640 1 -- 172.21.15.172:0/2757998643 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4fa001c070 con 0x7f4fa81452a0 2024-04-25T08:45:45.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.132+0000 7f4fa4ff9640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f9406b670 0x7f4f9406db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.132+0000 7f4fa4ff9640 1 -- 172.21.15.172:0/2757998643 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4fa0089f30 con 0x7f4fa81452a0 2024-04-25T08:45:45.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.132+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f9406b670 0x7f4f9406db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.133+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f9406b670 0x7f4f9406db30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009990 tx=0x7f4f98009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.133+0000 7f4fb1201740 1 Processor -- start 2024-04-25T08:45:45.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.133+0000 7f4fb1201740 1 -- start start 2024-04-25T08:45:45.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983aa0 0x560a879862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983e80 0x560a879867f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87956700 0x560a87959f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4fb1201740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a878bfe00 con 0x560a87956700 2024-04-25T08:45:45.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4fb1201740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a87868d20 con 0x560a87983e80 2024-04-25T08:45:45.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4fb1201740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a878bbea0 con 0x560a87983aa0 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4faca99640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87956700 0x560a87959f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4faca99640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87956700 0x560a87959f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54834/0 (socket says 172.21.15.172:54834) 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4faca99640 1 -- 172.21.15.172:0/2680477500 learned_addr learned my addr 172.21.15.172:0/2680477500 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4faca99640 1 -- 172.21.15.172:0/2680477500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983aa0 msgr2=0x560a879862b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983e80 0x560a879867f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983aa0 0x560a879862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4faca99640 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983aa0 0x560a879862b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4faca99640 1 -- 172.21.15.172:0/2680477500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983e80 msgr2=0x560a879867f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4faca99640 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983e80 0x560a879867f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4faca99640 1 -- 172.21.15.172:0/2680477500 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a8788adf0 con 0x560a87956700 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983e80 0x560a879867f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983aa0 0x560a879862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.134+0000 7f4faca99640 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87956700 0x560a87959f10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0060710 tx=0x7f4fa0058760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a1a31e79351a73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4f8dffb640 1 -- 172.21.15.172:0/2680477500 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00770c0 con 0x560a87956700 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4f8dffb640 1 -- 172.21.15.172:0/2680477500 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0054c50 con 0x560a87956700 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4f8dffb640 1 -- 172.21.15.172:0/2680477500 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00609f0 con 0x560a87956700 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4fb1201740 1 -- 172.21.15.172:0/2680477500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87956700 msgr2=0x560a87959f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4fb1201740 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87956700 0x560a87959f10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0060710 tx=0x7f4fa0058760 comp rx=0 tx=0).stop 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4fb1201740 1 -- 172.21.15.172:0/2680477500 shutdown_connections 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4fb1201740 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983e80 0x560a879867f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4fb1201740 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87956700 0x560a87959f10 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4fb1201740 1 --2- 172.21.15.172:0/2680477500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983aa0 0x560a879862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4fb1201740 1 -- 172.21.15.172:0/2680477500 >> 172.21.15.172:0/2680477500 conn(0x560a87958970 msgr2=0x560a879a12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4fb1201740 1 -- 172.21.15.172:0/2680477500 shutdown_connections 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.135+0000 7f4fb1201740 1 -- 172.21.15.172:0/2680477500 wait complete. 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.136+0000 7f4fb1201740 1 -- start start 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.136+0000 7f4fb1201740 1 Processor -- start 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 0x560a879763f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983e80 0x560a879a4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87982120 0x560a879825a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fb1201740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8795bb20 con 0x560a87983e80 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fb1201740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8785e590 con 0x560a87983aa0 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fb1201740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a8795be00 con 0x560a87982120 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fb1201740 10 client.0 _ll_register_callbacks cb 0x560a8786ae30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983e80 0x560a879a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983e80 0x560a879a4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54840/0 (socket says 172.21.15.172:54840) 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 0x560a879763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa77fe640 1 -- 172.21.15.172:0/3773603829 learned_addr learned my addr 172.21.15.172:0/3773603829 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4faca99640 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87982120 0x560a879825a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa77fe640 1 -- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87982120 msgr2=0x560a879825a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87982120 0x560a879825a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa77fe640 1 -- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 msgr2=0x560a879763f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 0x560a879763f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa77fe640 1 -- 172.21.15.172:0/3773603829 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a875d43f0 con 0x560a87983e80 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 0x560a879763f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983e80 0x560a879a4290 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0090b0 tx=0x7f4f9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e98f7951f010a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4f86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.137+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3773603829 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c042070 con 0x560a87983e80 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3773603829 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4f9c03c410 con 0x560a87983e80 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fb1201740 1 -- 172.21.15.172:0/3773603829 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4fa0054c50 con 0x560a87983e80 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3773603829 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f9c050050 con 0x560a87983e80 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fb1201740 10 client.6414 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fb1201740 1 -- 172.21.15.172:0/3773603829 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x560a8769e7d0 con 0x560a87983e80 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3773603829 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa0054c50 con 0x560a87983e80 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3773603829 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4f9c053020 con 0x560a87983e80 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fb1201740 10 client.6414 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fb1201740 10 client.6414 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fb1201740 20 client.6414 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:45.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560a879806e0 0x560a879a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fb1201740 4 client.6414 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fb1201740 1 -- 172.21.15.172:0/3773603829 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a878cd340 con 0x560a879806e0 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560a879806e0 0x560a879a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4f86ffd640 10 client.6414 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.138+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560a879806e0 0x560a879a23e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2e7caf7d3e05864 server_cookie=9f7aab6c5f3081fe in_seq=0 out_seq=0 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3773603829 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560a878cd340 con 0x560a879806e0 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4f86ffd640 10 client.6414 handle_command_reply: tid=0 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 client.6414 shutdown 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 -- 172.21.15.172:0/3773603829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983e80 msgr2=0x560a879a4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983e80 0x560a879a4290 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0090b0 tx=0x7f4f9c004730 comp rx=0 tx=0).stop 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 -- 172.21.15.172:0/3773603829 shutdown_connections 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560a879806e0 0x560a879a23e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87982120 0x560a879825a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983e80 0x560a879a4290 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3773603829 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 0x560a879763f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 -- 172.21.15.172:0/3773603829 >> 172.21.15.172:0/3773603829 conn(0x560a87956700 msgr2=0x560a87982e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4f86ffd640 0 client.6414 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 -- 172.21.15.172:0/3773603829 shutdown_connections 2024-04-25T08:45:45.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 1 -- 172.21.15.172:0/3773603829 wait complete. 2024-04-25T08:45:45.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.139+0000 7f4fb1201740 20 client.6414 trim_cache size 0 max 16384 2024-04-25T08:45:45.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.151+0000 7f4fb1201740 1 Processor -- start 2024-04-25T08:45:45.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.151+0000 7f4fb1201740 1 -- start start 2024-04-25T08:45:45.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87982120 0x560a87976320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983aa0 0x560a879c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983e80 0x560a8795d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fb1201740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81fe3f0 con 0x560a87983aa0 2024-04-25T08:45:45.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fb1201740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81fd5d0 con 0x560a87982120 2024-04-25T08:45:45.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fb1201740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81fc9d0 con 0x560a87983e80 2024-04-25T08:45:45.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fa77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983aa0 0x560a879c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fa77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983aa0 0x560a879c4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54850/0 (socket says 172.21.15.172:54850) 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fa77fe640 1 -- 172.21.15.172:0/156348108 learned_addr learned my addr 172.21.15.172:0/156348108 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fa77fe640 1 -- 172.21.15.172:0/156348108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983e80 msgr2=0x560a8795d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/156348108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983e80 0x560a8795d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fa77fe640 1 -- 172.21.15.172:0/156348108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87982120 msgr2=0x560a87976320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/156348108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87982120 0x560a87976320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fa77fe640 1 -- 172.21.15.172:0/156348108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a87982910 con 0x560a87983aa0 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/156348108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983aa0 0x560a879c4f30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009210 tx=0x7f4f9c03e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fc9925e76623ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4f8d7fa640 1 -- 172.21.15.172:0/156348108 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c000e60 con 0x560a87983aa0 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4f8d7fa640 1 -- 172.21.15.172:0/156348108 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c0327e0 con 0x560a87983aa0 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.152+0000 7f4f8d7fa640 1 -- 172.21.15.172:0/156348108 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c037040 con 0x560a87983aa0 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.153+0000 7f4fb1201740 1 -- 172.21.15.172:0/156348108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983aa0 msgr2=0x560a879c4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.153+0000 7f4fb1201740 1 --2- 172.21.15.172:0/156348108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983aa0 0x560a879c4f30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009210 tx=0x7f4f9c03e070 comp rx=0 tx=0).stop 2024-04-25T08:45:45.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.153+0000 7f4fb1201740 1 -- 172.21.15.172:0/156348108 shutdown_connections 2024-04-25T08:45:45.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.153+0000 7f4fb1201740 1 --2- 172.21.15.172:0/156348108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983e80 0x560a8795d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.153+0000 7f4fb1201740 1 --2- 172.21.15.172:0/156348108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87983aa0 0x560a879c4f30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.153+0000 7f4fb1201740 1 --2- 172.21.15.172:0/156348108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87982120 0x560a87976320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.153+0000 7f4fb1201740 1 -- 172.21.15.172:0/156348108 >> 172.21.15.172:0/156348108 conn(0x560a87956700 msgr2=0x560a8795bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.153+0000 7f4fb1201740 1 -- 172.21.15.172:0/156348108 shutdown_connections 2024-04-25T08:45:45.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.153+0000 7f4fb1201740 1 -- 172.21.15.172:0/156348108 wait complete. 2024-04-25T08:45:45.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.154+0000 7f4fb1201740 1 -- start start 2024-04-25T08:45:45.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.154+0000 7f4fb1201740 1 Processor -- start 2024-04-25T08:45:45.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.154+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87982120 0x560a8798a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.154+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 0x560a87a0b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.154+0000 7f4fb1201740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983e80 0x560a87956c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.154+0000 7f4fb1201740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a879c5470 con 0x560a87982120 2024-04-25T08:45:45.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.154+0000 7f4fb1201740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81fcfd0 con 0x560a87983aa0 2024-04-25T08:45:45.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.154+0000 7f4fb1201740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a8797eb90 con 0x560a87983e80 2024-04-25T08:45:45.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.154+0000 7f4fb1201740 10 client.0 _ll_register_callbacks cb 0x7f4fa00583b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fa7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87982120 0x560a8798a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fa7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87982120 0x560a8798a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54856/0 (socket says 172.21.15.172:54856) 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fa7fff640 1 -- 172.21.15.172:0/3788845194 learned_addr learned my addr 172.21.15.172:0/3788845194 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 0x560a87a0b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4faca99640 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983e80 0x560a87956c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fa7fff640 1 -- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983e80 msgr2=0x560a87956c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983e80 0x560a87956c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fa7fff640 1 -- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 msgr2=0x560a87a0b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 0x560a87a0b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fa7fff640 1 -- 172.21.15.172:0/3788845194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a879b0cd0 con 0x560a87982120 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fa7fff640 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87982120 0x560a8798a3e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f4f98015730 tx=0x7f4f980047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfe1f0beb5b90a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4f86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:45.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3788845194 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f98030060 con 0x560a87982120 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3788845194 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4f9800f040 con 0x560a87982120 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fb1201740 1 -- 172.21.15.172:0/3788845194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f9c0327e0 con 0x560a87982120 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3788845194 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f98036050 con 0x560a87982120 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fb1201740 10 client.6420 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fb1201740 1 -- 172.21.15.172:0/3788845194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x560a87955ea0 con 0x560a87982120 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3788845194 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c0327e0 con 0x560a87982120 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3788845194 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4f98039020 con 0x560a87982120 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fb1201740 10 client.6420 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fb1201740 10 client.6420 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fb1201740 20 client.6420 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560a879571c0 0x560a8795ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fb1201740 4 client.6420 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.155+0000 7f4fb1201740 1 -- 172.21.15.172:0/3788845194 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560a878c7690 con 0x560a879571c0 2024-04-25T08:45:45.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560a879571c0 0x560a8795ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4f86ffd640 10 client.6420 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fa77fe640 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560a879571c0 0x560a8795ae50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=376be344ba7cbd18 server_cookie=5fbb6b3e140f645d in_seq=0 out_seq=0 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4f86ffd640 1 -- 172.21.15.172:0/3788845194 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560a878c7690 con 0x560a879571c0 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4f86ffd640 10 client.6420 handle_command_reply: tid=0 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 client.6420 shutdown 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 -- 172.21.15.172:0/3788845194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87982120 msgr2=0x560a8798a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87982120 0x560a8798a3e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f4f98015730 tx=0x7f4f980047d0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 -- 172.21.15.172:0/3788845194 shutdown_connections 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560a87983aa0 0x560a87a0b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560a879571c0 0x560a8795ae50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560a87983e80 0x560a87956c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 --2- 172.21.15.172:0/3788845194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a87982120 0x560a8798a3e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4f86ffd640 0 client.6420 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 -- 172.21.15.172:0/3788845194 >> 172.21.15.172:0/3788845194 conn(0x560a87956700 msgr2=0x560a879556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 -- 172.21.15.172:0/3788845194 shutdown_connections 2024-04-25T08:45:45.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.156+0000 7f4fb1201740 1 -- 172.21.15.172:0/3788845194 wait complete. 2024-04-25T08:45:45.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fb1201740 20 client.6420 trim_cache size 0 max 16384 2024-04-25T08:45:45.155 INFO:teuthology.orchestra.run.smithi172.stdout:[] 2024-04-25T08:45:45.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2757998643 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f9406b670 msgr2=0x7f4f9406db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f9406b670 0x7f4f9406db30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009990 tx=0x7f4f98009110 comp rx=0 tx=0).stop 2024-04-25T08:45:45.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2757998643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa81452a0 msgr2=0x7f4fa81f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa81452a0 0x7f4fa81f4d10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000b9c0 tx=0x7f4fa000bdc0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2757998643 shutdown_connections 2024-04-25T08:45:45.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4f9406b670 0x7f4f9406db30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fa81452a0 0x7f4fa81f4d10 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fa8144d50 0x7f4fa80a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 --2- 172.21.15.172:0/2757998643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fa81446d0 0x7f4fa80a8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2757998643 >> 172.21.15.172:0/2757998643 conn(0x7f4fa806abe0 msgr2=0x7f4fa8141a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2757998643 shutdown_connections 2024-04-25T08:45:45.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.157+0000 7f4fae4fc640 1 -- 172.21.15.172:0/2757998643 wait complete. 2024-04-25T08:45:45.159 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 1000000096c.00000000 parent 2024-04-25T08:45:45.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.209+0000 7f66eb501f40 1 Processor -- start 2024-04-25T08:45:45.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.209+0000 7f66eb501f40 1 -- start start 2024-04-25T08:45:45.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66eb501f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a9721a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66eb501f40 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a972119a80 0x55a9720cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66eb501f40 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a9721a6060 0x55a9721a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66eb501f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a972077df0 con 0x55a9720cefb0 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66eb501f40 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a97207bd50 con 0x55a972119a80 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66eb501f40 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a972119f30 con 0x55a9721a6060 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66e9004640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a9721a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66e9004640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a9721a2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54870/0 (socket says 172.21.15.172:54870) 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66e9004640 1 -- 172.21.15.172:0/2498183949 learned_addr learned my addr 172.21.15.172:0/2498183949 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66e9805640 1 --2- 172.21.15.172:0/2498183949 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a9721a6060 0x55a9721a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66e8803640 1 --2- 172.21.15.172:0/2498183949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a972119a80 0x55a9720cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66e9004640 1 -- 172.21.15.172:0/2498183949 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a9721a6060 msgr2=0x55a9721a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66e9004640 1 --2- 172.21.15.172:0/2498183949 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a9721a6060 0x55a9721a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66e9004640 1 -- 172.21.15.172:0/2498183949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a972119a80 msgr2=0x55a9720cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66e9004640 1 --2- 172.21.15.172:0/2498183949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a972119a80 0x55a9720cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.210+0000 7f66e9004640 1 -- 172.21.15.172:0/2498183949 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9721a25b0 con 0x55a9720cefb0 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66e9004640 1 --2- 172.21.15.172:0/2498183949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a9721a2e40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00a440 tx=0x7f66dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1cc1d8d78585ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66db7fe640 1 -- 172.21.15.172:0/2498183949 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc06a070 con 0x55a9720cefb0 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66db7fe640 1 -- 172.21.15.172:0/2498183949 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc052c60 con 0x55a9720cefb0 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66db7fe640 1 -- 172.21.15.172:0/2498183949 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc056040 con 0x55a9720cefb0 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66eb501f40 1 -- 172.21.15.172:0/2498183949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 msgr2=0x55a9721a2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66eb501f40 1 --2- 172.21.15.172:0/2498183949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a9721a2e40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00a440 tx=0x7f66dc051000 comp rx=0 tx=0).stop 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66eb501f40 1 -- 172.21.15.172:0/2498183949 shutdown_connections 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66eb501f40 1 --2- 172.21.15.172:0/2498183949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a972119a80 0x55a9720cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66eb501f40 1 --2- 172.21.15.172:0/2498183949 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a9721a6060 0x55a9721a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66eb501f40 1 --2- 172.21.15.172:0/2498183949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a9721a2e40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66eb501f40 1 -- 172.21.15.172:0/2498183949 >> 172.21.15.172:0/2498183949 conn(0x55a9720cf9b0 msgr2=0x55a9720fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66eb501f40 1 -- 172.21.15.172:0/2498183949 shutdown_connections 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.211+0000 7f66eb501f40 1 -- 172.21.15.172:0/2498183949 wait complete. 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.212+0000 7f66eb501f40 1 Processor -- start 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.212+0000 7f66eb501f40 1 -- start start 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.212+0000 7f66eb501f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a97219bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66eb501f40 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a972119a80 0x55a9720cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66eb501f40 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9721a6060 0x55a9720d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66eb501f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9721a2890 con 0x55a9720cefb0 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66eb501f40 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9720fcab0 con 0x55a9721a6060 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66eb501f40 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a97223aa50 con 0x55a972119a80 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9004640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a97219bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9004640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a97219bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54878/0 (socket says 172.21.15.172:54878) 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9004640 1 -- 172.21.15.172:0/805192371 learned_addr learned my addr 172.21.15.172:0/805192371 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e8803640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a972119a80 0x55a9720cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9805640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9721a6060 0x55a9720d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9004640 1 -- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a972119a80 msgr2=0x55a9720cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9004640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a972119a80 0x55a9720cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9004640 1 -- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9721a6060 msgr2=0x55a9720d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9004640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9721a6060 0x55a9720d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9004640 1 -- 172.21.15.172:0/805192371 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9720fc040 con 0x55a9720cefb0 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9805640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a9721a6060 0x55a9720d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66e9004640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a97219bec0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f66dc052640 tx=0x7f66dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66da7fc640 1 -- 172.21.15.172:0/805192371 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc06a050 con 0x55a9720cefb0 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66da7fc640 1 -- 172.21.15.172:0/805192371 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc074070 con 0x55a9720cefb0 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66eb501f40 1 -- 172.21.15.172:0/805192371 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a9721a1f40 con 0x55a9720cefb0 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66da7fc640 1 -- 172.21.15.172:0/805192371 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc056040 con 0x55a9720cefb0 2024-04-25T08:45:45.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.213+0000 7f66eb501f40 1 -- 172.21.15.172:0/805192371 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9721a21e0 con 0x55a9720cefb0 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.214+0000 7f66da7fc640 1 -- 172.21.15.172:0/805192371 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f66dc059020 con 0x55a9720cefb0 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.215+0000 7f66da7fc640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f66cc069eb0 0x7f66cc06c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.215+0000 7f66da7fc640 1 -- 172.21.15.172:0/805192371 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f66dc0ce760 con 0x55a9720cefb0 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.215+0000 7f66e8803640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f66cc069eb0 0x7f66cc06c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.215+0000 7f66eb501f40 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x55a9720ce820 0x55a9721a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.215+0000 7f66eb501f40 1 -- 172.21.15.172:0/805192371 --> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] -- osd_op(unknown.0.0:1 8.2b 8:d716f75e:::1000000096c.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54) v9 -- 0x55a9721a06f0 con 0x55a9720ce820 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.215+0000 7f66e8803640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f66cc069eb0 0x7f66cc06c370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55a972242090 tx=0x7f66e00038b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.215+0000 7f66e9805640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x55a9720ce820 0x55a9721a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.216+0000 7f66e9805640 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x55a9720ce820 0x55a9721a01b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66e9805640 1 -- 172.21.15.172:0/805192371 <== osd.6 v2:172.21.15.186:6816/2238458508 1 ==== osd_op_reply(1 1000000096c.00000000 [rmxattr] v54'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f66e40044c0 con 0x55a9720ce820 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66eb501f40 1 -- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x55a9720ce820 msgr2=0x55a9721a01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66eb501f40 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x55a9720ce820 0x55a9721a01b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66eb501f40 1 -- 172.21.15.172:0/805192371 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f66cc069eb0 msgr2=0x7f66cc06c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66eb501f40 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f66cc069eb0 0x7f66cc06c370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55a972242090 tx=0x7f66e00038b0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66eb501f40 1 -- 172.21.15.172:0/805192371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 msgr2=0x55a97219bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66eb501f40 1 --2- 172.21.15.172:0/805192371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a9720cefb0 0x55a97219bec0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f66dc052640 tx=0x7f66dc002fb0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66e9805640 1 -- 172.21.15.172:0/805192371 reap_dead start 2024-04-25T08:45:45.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66eb501f40 1 -- 172.21.15.172:0/805192371 shutdown_connections 2024-04-25T08:45:45.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66eb501f40 1 -- 172.21.15.172:0/805192371 >> 172.21.15.172:0/805192371 conn(0x55a9720cf9b0 msgr2=0x55a972116850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66eb501f40 1 -- 172.21.15.172:0/805192371 shutdown_connections 2024-04-25T08:45:45.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.217+0000 7f66eb501f40 1 -- 172.21.15.172:0/805192371 wait complete. 2024-04-25T08:45:45.213 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-04-25T08:45:45.213 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:45.213 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-04-25T08:45:45.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.362+0000 7f1593db0640 1 Processor -- start 2024-04-25T08:45:45.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.362+0000 7f1593db0640 1 -- start start 2024-04-25T08:45:45.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1593db0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f158c06abe0 0x7f158c06afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1593db0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f158c15dd80 0x7f158c0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1593db0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c06b500 con 0x7f158c0ad570 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1593db0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c06e410 con 0x7f158c06abe0 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1593db0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c0b3930 con 0x7f158c15dd80 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1591b4c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f158c06abe0 0x7f158c06afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f159234d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f158c0ad570 0x7f158c06ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45492/0 (socket says 172.21.15.172:45492) 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f159234d640 1 -- 172.21.15.172:0/1574638115 learned_addr learned my addr 172.21.15.172:0/1574638115 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1591b4c640 1 -- 172.21.15.172:0/1574638115 >> v2:172.21.15.186:3300/0 conn(0x7f158c15dd80 msgr2=0x7f158c0b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f159134b640 1 --2- 172.21.15.172:0/1574638115 >> v2:172.21.15.186:3300/0 conn(0x7f158c15dd80 0x7f158c0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1591b4c640 1 --2- 172.21.15.172:0/1574638115 >> v2:172.21.15.186:3300/0 conn(0x7f158c15dd80 0x7f158c0b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1591b4c640 1 -- 172.21.15.172:0/1574638115 >> v1:172.21.15.172:6789/0 conn(0x7f158c0ad570 legacy=0x7f158c06ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1591b4c640 1 -- 172.21.15.172:0/1574638115 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0b3c10 con 0x7f158c06abe0 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f1590b4a640 1 -- 172.21.15.172:0/1574638115 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643973164 0 0) 0x7f158c06b500 con 0x7f158c0ad570 2024-04-25T08:45:45.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.363+0000 7f159134b640 1 --2- 172.21.15.172:0/1574638115 >> v2:172.21.15.186:3300/0 conn(0x7f158c15dd80 0x7f158c0b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:45.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.364+0000 7f1591b4c640 1 --2- 172.21.15.172:0/1574638115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c06abe0 0x7f158c06afc0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f158c06e590 tx=0x7f158802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8b7153794cdea5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.364+0000 7f1590b4a640 1 -- 172.21.15.172:0/1574638115 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588037070 con 0x7f158c06abe0 2024-04-25T08:45:45.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.364+0000 7f1590b4a640 1 -- 172.21.15.172:0/1574638115 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1588032440 con 0x7f158c06abe0 2024-04-25T08:45:45.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.364+0000 7f1590b4a640 1 -- 172.21.15.172:0/1574638115 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588032810 con 0x7f158c06abe0 2024-04-25T08:45:45.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.365+0000 7f1593db0640 1 -- 172.21.15.172:0/1574638115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c06abe0 msgr2=0x7f158c06afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.365+0000 7f1593db0640 1 --2- 172.21.15.172:0/1574638115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c06abe0 0x7f158c06afc0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f158c06e590 tx=0x7f158802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.365+0000 7f1593db0640 1 -- 172.21.15.172:0/1574638115 shutdown_connections 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.365+0000 7f1593db0640 1 --2- 172.21.15.172:0/1574638115 >> v2:172.21.15.186:3300/0 conn(0x7f158c15dd80 0x7f158c0b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.365+0000 7f1593db0640 1 --2- 172.21.15.172:0/1574638115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c06abe0 0x7f158c06afc0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.365+0000 7f1593db0640 1 -- 172.21.15.172:0/1574638115 >> 172.21.15.172:0/1574638115 conn(0x7f158c0b5af0 msgr2=0x7f158c0b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.365+0000 7f1593db0640 1 -- 172.21.15.172:0/1574638115 shutdown_connections 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.365+0000 7f1593db0640 1 -- 172.21.15.172:0/1574638115 wait complete. 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.366+0000 7f1593db0640 1 Processor -- start 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.366+0000 7f1593db0640 1 -- start start 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f1593db0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f158c06abe0 0x7f158c1452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f1593db0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c0ad570 0x7f158c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f1593db0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c15dd80 0x7f158c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f1593db0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c0b57d0 con 0x7f158c15dd80 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f1593db0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c06e940 con 0x7f158c0ad570 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f1593db0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c070280 con 0x7f158c06abe0 2024-04-25T08:45:45.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f159234d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c15dd80 0x7f158c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f159234d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c15dd80 0x7f158c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54888/0 (socket says 172.21.15.172:54888) 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f159234d640 1 -- 172.21.15.172:0/1533183369 learned_addr learned my addr 172.21.15.172:0/1533183369 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f159134b640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c0ad570 0x7f158c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f1591b4c640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f158c06abe0 0x7f158c1452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f159234d640 1 -- 172.21.15.172:0/1533183369 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f158c06abe0 msgr2=0x7f158c1452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f159234d640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f158c06abe0 0x7f158c1452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f159234d640 1 -- 172.21.15.172:0/1533183369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c0ad570 msgr2=0x7f158c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f159234d640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c0ad570 0x7f158c159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f159234d640 1 -- 172.21.15.172:0/1533183369 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c1457e0 con 0x7f158c15dd80 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f159234d640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c15dd80 0x7f158c15a3e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f158400c7d0 tx=0x7f158400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f15827fc640 1 -- 172.21.15.172:0/1533183369 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584018070 con 0x7f158c15dd80 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f15827fc640 1 -- 172.21.15.172:0/1533183369 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158400a640 con 0x7f158c15dd80 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f1593db0640 1 -- 172.21.15.172:0/1533183369 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c156880 con 0x7f158c15dd80 2024-04-25T08:45:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f15827fc640 1 -- 172.21.15.172:0/1533183369 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400aa70 con 0x7f158c15dd80 2024-04-25T08:45:45.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.367+0000 7f1593db0640 1 -- 172.21.15.172:0/1533183369 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c15acf0 con 0x7f158c15dd80 2024-04-25T08:45:45.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.369+0000 7f15827fc640 1 -- 172.21.15.172:0/1533183369 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f158401b070 con 0x7f158c15dd80 2024-04-25T08:45:45.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.369+0000 7f15827fc640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f157006b4d0 0x7f157006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.369+0000 7f15827fc640 1 -- 172.21.15.172:0/1533183369 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1584089830 con 0x7f158c15dd80 2024-04-25T08:45:45.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.369+0000 7f1591b4c640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f157006b4d0 0x7f157006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.370+0000 7f1591b4c640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f157006b4d0 0x7f157006d990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1588034000 tx=0x7f158802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.370+0000 7f1596b90740 1 Processor -- start 2024-04-25T08:45:45.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.370+0000 7f1596b90740 1 -- start start 2024-04-25T08:45:45.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f1596b90740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bbf360 0x564226bdf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f1596b90740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226bc6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f1596b90740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226b9c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f1596b90740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564226affee0 con 0x564226bc7140 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f1596b90740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564226aa8c50 con 0x564226bbf360 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f1596b90740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x564226afbf80 con 0x564226b9e360 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f159234d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226b9c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f159234d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226b9c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54890/0 (socket says 172.21.15.172:54890) 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f159234d640 1 -- 172.21.15.172:0/3002457396 learned_addr learned my addr 172.21.15.172:0/3002457396 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f1591b4c640 1 --2- 172.21.15.172:0/3002457396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bbf360 0x564226bdf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f159134b640 1 --2- 172.21.15.172:0/3002457396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226bc6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f159234d640 1 -- 172.21.15.172:0/3002457396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 msgr2=0x564226bc6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f159234d640 1 --2- 172.21.15.172:0/3002457396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226bc6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f159234d640 1 -- 172.21.15.172:0/3002457396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bbf360 msgr2=0x564226bdf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f159234d640 1 --2- 172.21.15.172:0/3002457396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bbf360 0x564226bdf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.371+0000 7f159234d640 1 -- 172.21.15.172:0/3002457396 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642268e0c00 con 0x564226bc7140 2024-04-25T08:45:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.372+0000 7f159234d640 1 --2- 172.21.15.172:0/3002457396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226b9c7c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1584004fd0 tx=0x7f1584057f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88735b09f8f0c666 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.372+0000 7f156f7fe640 1 -- 172.21.15.172:0/3002457396 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584056000 con 0x564226bc7140 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.372+0000 7f156f7fe640 1 -- 172.21.15.172:0/3002457396 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1584056260 con 0x564226bc7140 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.372+0000 7f156f7fe640 1 -- 172.21.15.172:0/3002457396 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158405e070 con 0x564226bc7140 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.372+0000 7f1596b90740 1 -- 172.21.15.172:0/3002457396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 msgr2=0x564226b9c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.372+0000 7f1596b90740 1 --2- 172.21.15.172:0/3002457396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226b9c7c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1584004fd0 tx=0x7f1584057f60 comp rx=0 tx=0).stop 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.372+0000 7f1596b90740 1 -- 172.21.15.172:0/3002457396 shutdown_connections 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.372+0000 7f1596b90740 1 --2- 172.21.15.172:0/3002457396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226b9c7c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.373+0000 7f1596b90740 1 --2- 172.21.15.172:0/3002457396 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226bc6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.373+0000 7f1596b90740 1 --2- 172.21.15.172:0/3002457396 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bbf360 0x564226bdf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.373+0000 7f1596b90740 1 -- 172.21.15.172:0/3002457396 >> 172.21.15.172:0/3002457396 conn(0x564226b63810 msgr2=0x564226be1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.373+0000 7f1596b90740 1 -- 172.21.15.172:0/3002457396 shutdown_connections 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.373+0000 7f1596b90740 1 -- 172.21.15.172:0/3002457396 wait complete. 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.373+0000 7f1596b90740 1 -- start start 2024-04-25T08:45:45.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.373+0000 7f1596b90740 1 Processor -- start 2024-04-25T08:45:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f1596b90740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226b9e360 0x564226bda320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f1596b90740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226bbf360 0x564226bc9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f1596b90740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226bca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f1596b90740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564226b9c330 con 0x564226bc7140 2024-04-25T08:45:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f1596b90740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564226a9e340 con 0x564226b9e360 2024-04-25T08:45:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f1596b90740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x564226b971a0 con 0x564226bbf360 2024-04-25T08:45:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f1596b90740 10 client.0 _ll_register_callbacks cb 0x564226813fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f159234d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226bca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f159234d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226bca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54896/0 (socket says 172.21.15.172:54896) 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f159234d640 1 -- 172.21.15.172:0/2274226383 learned_addr learned my addr 172.21.15.172:0/2274226383 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f159134b640 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226bbf360 0x564226bc9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.374+0000 7f1591b4c640 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226b9e360 0x564226bda320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.375+0000 7f159234d640 1 -- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226bbf360 msgr2=0x564226bc9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.375+0000 7f159234d640 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226bbf360 0x564226bc9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.375+0000 7f159234d640 1 -- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226b9e360 msgr2=0x564226bda320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.375+0000 7f159234d640 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226b9e360 0x564226bda320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.375+0000 7f159234d640 1 -- 172.21.15.172:0/2274226383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642267d44f0 con 0x564226bc7140 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.375+0000 7f159134b640 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226bbf360 0x564226bc9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.375+0000 7f159234d640 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226bca4f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1584087c30 tx=0x7f1584013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fda2c16b9a19a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.375+0000 7f156cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f156cff9640 1 -- 172.21.15.172:0/2274226383 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584060130 con 0x564226bc7140 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f156cff9640 1 -- 172.21.15.172:0/2274226383 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f15840602d0 con 0x564226bc7140 2024-04-25T08:45:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f1596b90740 1 -- 172.21.15.172:0/2274226383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1584056260 con 0x564226bc7140 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f156cff9640 1 -- 172.21.15.172:0/2274226383 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15840573b0 con 0x564226bc7140 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f1596b90740 10 client.6447 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f1596b90740 1 -- 172.21.15.172:0/2274226383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x564226941390 con 0x564226bc7140 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f156cff9640 1 -- 172.21.15.172:0/2274226383 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1584056260 con 0x564226bc7140 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f156cff9640 1 -- 172.21.15.172:0/2274226383 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1584057550 con 0x564226bc7140 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f1596b90740 10 client.6447 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f1596b90740 10 client.6447 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f1596b90740 20 client.6447 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f1596b90740 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564226bd8c90 0x564226bd9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f1596b90740 4 client.6447 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f1596b90740 1 -- 172.21.15.172:0/2274226383 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564226b0d420 con 0x564226bd8c90 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.377+0000 7f1591b4c640 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564226bd8c90 0x564226bd9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.378+0000 7f156cff9640 10 client.6447 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.378+0000 7f1591b4c640 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564226bd8c90 0x564226bd9070 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84eed543242d4244 server_cookie=755eaf5361182946 in_seq=0 out_seq=0 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.378+0000 7f156cff9640 1 -- 172.21.15.172:0/2274226383 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564226b0d420 con 0x564226bd8c90 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.378+0000 7f156cff9640 10 client.6447 handle_command_reply: tid=0 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.378+0000 7f1596b90740 1 client.6447 shutdown 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 1 -- 172.21.15.172:0/2274226383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 msgr2=0x564226bca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226bca4f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1584087c30 tx=0x7f1584013000 comp rx=0 tx=0).stop 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 1 -- 172.21.15.172:0/2274226383 shutdown_connections 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564226bd8c90 0x564226bd9070 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bc7140 0x564226bca4f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226bbf360 0x564226bc9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 1 --2- 172.21.15.172:0/2274226383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226b9e360 0x564226bda320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f156cff9640 0 client.6447 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 1 -- 172.21.15.172:0/2274226383 >> 172.21.15.172:0/2274226383 conn(0x564226b63810 msgr2=0x564226b9bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 1 -- 172.21.15.172:0/2274226383 shutdown_connections 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 1 -- 172.21.15.172:0/2274226383 wait complete. 2024-04-25T08:45:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.379+0000 7f1596b90740 20 client.6447 trim_cache size 0 max 16384 2024-04-25T08:45:45.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.394+0000 7f1596b90740 1 Processor -- start 2024-04-25T08:45:45.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.394+0000 7f1596b90740 1 -- start start 2024-04-25T08:45:45.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f1596b90740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226bc8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f1596b90740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bf2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f1596b90740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bc7140 0x564226bf2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f1596b90740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564226bc7c20 con 0x564226bbf360 2024-04-25T08:45:45.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f1596b90740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c200350 con 0x564226bc7140 2024-04-25T08:45:45.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f1596b90740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c1ff530 con 0x564226b9e360 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f159134b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bf2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f159134b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bf2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54902/0 (socket says 172.21.15.172:54902) 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f159134b640 1 -- 172.21.15.172:0/1153370964 learned_addr learned my addr 172.21.15.172:0/1153370964 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f159134b640 1 -- 172.21.15.172:0/1153370964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 msgr2=0x564226bc8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f159134b640 1 --2- 172.21.15.172:0/1153370964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226bc8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f159134b640 1 -- 172.21.15.172:0/1153370964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bc7140 msgr2=0x564226bf2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f159134b640 1 --2- 172.21.15.172:0/1153370964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bc7140 0x564226bf2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f159134b640 1 -- 172.21.15.172:0/1153370964 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642267ad670 con 0x564226bbf360 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f159134b640 1 --2- 172.21.15.172:0/1153370964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bf2860 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f158c15e180 tx=0x7f157c015420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a7b23450ad7d57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f156effd640 1 -- 172.21.15.172:0/1153370964 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c022070 con 0x564226bbf360 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f156effd640 1 -- 172.21.15.172:0/1153370964 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c01d430 con 0x564226bbf360 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.395+0000 7f156effd640 1 -- 172.21.15.172:0/1153370964 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c01d7e0 con 0x564226bbf360 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.396+0000 7f1596b90740 1 -- 172.21.15.172:0/1153370964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 msgr2=0x564226bf2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.396+0000 7f1596b90740 1 --2- 172.21.15.172:0/1153370964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bf2860 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f158c15e180 tx=0x7f157c015420 comp rx=0 tx=0).stop 2024-04-25T08:45:45.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.396+0000 7f1596b90740 1 -- 172.21.15.172:0/1153370964 shutdown_connections 2024-04-25T08:45:45.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.396+0000 7f1596b90740 1 --2- 172.21.15.172:0/1153370964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bc7140 0x564226bf2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.396+0000 7f1596b90740 1 --2- 172.21.15.172:0/1153370964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bf2860 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.396+0000 7f1596b90740 1 --2- 172.21.15.172:0/1153370964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226bc8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.396+0000 7f1596b90740 1 -- 172.21.15.172:0/1153370964 >> 172.21.15.172:0/1153370964 conn(0x564226b63810 msgr2=0x564226bc9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.396+0000 7f1596b90740 1 -- 172.21.15.172:0/1153370964 shutdown_connections 2024-04-25T08:45:45.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.396+0000 7f1596b90740 1 -- 172.21.15.172:0/1153370964 wait complete. 2024-04-25T08:45:45.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.396+0000 7f1596b90740 1 -- start start 2024-04-25T08:45:45.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.397+0000 7f1596b90740 1 Processor -- start 2024-04-25T08:45:45.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.397+0000 7f1596b90740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226c4f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.397+0000 7f1596b90740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bfb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.397+0000 7f1596b90740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bc7140 0x564226bfba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f1596b90740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c1fefb0 con 0x564226bbf360 2024-04-25T08:45:45.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f1596b90740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c146bc0 con 0x564226bc7140 2024-04-25T08:45:45.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f1596b90740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x564226bc86a0 con 0x564226b9e360 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f1596b90740 10 client.0 _ll_register_callbacks cb 0x7f1588035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f159134b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bfb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f159134b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bfb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54914/0 (socket says 172.21.15.172:54914) 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f159134b640 1 -- 172.21.15.172:0/873564876 learned_addr learned my addr 172.21.15.172:0/873564876 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f1591b4c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226c4f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f159234d640 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bc7140 0x564226bfba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f159134b640 1 -- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 msgr2=0x564226c4f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f159134b640 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226c4f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f159134b640 1 -- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bc7140 msgr2=0x564226bfba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f159134b640 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bc7140 0x564226bfba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f159134b640 1 -- 172.21.15.172:0/873564876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564226b9be50 con 0x564226bbf360 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f159134b640 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bfb4e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f158c157aa0 tx=0x7f157c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60d3451419a5086 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f156cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:45.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f156cff9640 1 -- 172.21.15.172:0/873564876 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c022040 con 0x564226bbf360 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f156cff9640 1 -- 172.21.15.172:0/873564876 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f157c01d7e0 con 0x564226bbf360 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f1596b90740 1 -- 172.21.15.172:0/873564876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f157c01d430 con 0x564226bbf360 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f156cff9640 1 -- 172.21.15.172:0/873564876 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f157c01d9e0 con 0x564226bbf360 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f1596b90740 10 client.6453 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f1596b90740 1 -- 172.21.15.172:0/873564876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x564226be2950 con 0x564226bbf360 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.398+0000 7f156cff9640 1 -- 172.21.15.172:0/873564876 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c01d430 con 0x564226bbf360 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f156cff9640 1 -- 172.21.15.172:0/873564876 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f157c01db80 con 0x564226bbf360 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f1596b90740 10 client.6453 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f1596b90740 10 client.6453 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f1596b90740 20 client.6453 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f1596b90740 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564226bc3da0 0x564226bbca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f1596b90740 4 client.6453 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f1596b90740 1 -- 172.21.15.172:0/873564876 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) v1 -- 0x564226b07770 con 0x564226bc3da0 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f1591b4c640 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564226bc3da0 0x564226bbca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f1591b4c640 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564226bc3da0 0x564226bbca50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ef70521bb08f7c7 server_cookie=ca39d73d8de01033 in_seq=0 out_seq=0 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f156cff9640 10 client.6453 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f156cff9640 1 -- 172.21.15.172:0/873564876 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564226b07770 con 0x564226bc3da0 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.399+0000 7f156cff9640 10 client.6453 handle_command_reply: tid=0 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 client.6453 shutdown 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 -- 172.21.15.172:0/873564876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 msgr2=0x564226bfb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bfb4e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f158c157aa0 tx=0x7f157c004730 comp rx=0 tx=0).stop 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 -- 172.21.15.172:0/873564876 shutdown_connections 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564226bc7140 0x564226bfba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x564226bc3da0 0x564226bbca50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564226bbf360 0x564226bfb4e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 --2- 172.21.15.172:0/873564876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564226b9e360 0x564226c4f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f156cff9640 0 client.6453 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 -- 172.21.15.172:0/873564876 >> 172.21.15.172:0/873564876 conn(0x564226b63810 msgr2=0x564226b9c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 -- 172.21.15.172:0/873564876 shutdown_connections 2024-04-25T08:45:45.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 1 -- 172.21.15.172:0/873564876 wait complete. 2024-04-25T08:45:45.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1596b90740 20 client.6453 trim_cache size 0 max 16384 2024-04-25T08:45:45.398 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:45.398 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:45:45.398 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "61a2649b-2c1c-446b-94a9-977639aebb3f", 2024-04-25T08:45:45.398 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:45:45.398 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:45.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 -- 172.21.15.172:0/1533183369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f157006b4d0 msgr2=0x7f157006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f157006b4d0 0x7f157006d990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1588034000 tx=0x7f158802e000 comp rx=0 tx=0).stop 2024-04-25T08:45:45.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 -- 172.21.15.172:0/1533183369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c15dd80 msgr2=0x7f158c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c15dd80 0x7f158c15a3e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f158400c7d0 tx=0x7f158400cc90 comp rx=0 tx=0).stop 2024-04-25T08:45:45.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 -- 172.21.15.172:0/1533183369 shutdown_connections 2024-04-25T08:45:45.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f157006b4d0 0x7f157006d990 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f158c0ad570 0x7f158c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c15dd80 0x7f158c15a3e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 --2- 172.21.15.172:0/1533183369 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f158c06abe0 0x7f158c1452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 -- 172.21.15.172:0/1533183369 >> 172.21.15.172:0/1533183369 conn(0x7f158c0b5af0 msgr2=0x7f158c0ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 -- 172.21.15.172:0/1533183369 shutdown_connections 2024-04-25T08:45:45.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.400+0000 7f1593db0640 1 -- 172.21.15.172:0/1533183369 wait complete. 2024-04-25T08:45:45.401 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T08:45:45.399+0000 7ff2db958640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096c [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v473 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5458=0-4194304@1} caps={5458=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5458 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55e010762680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x1000000096c:[<0x10000000001/new_file_1 v473>,<0x10000000000/ceph-qa-suite v53>,<0x1/scrub_test_path v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-04-25T08:45:45.402 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': '61a2649b-2c1c-446b-94a9-977639aebb3f', 'mode': 'asynchronous'}' 2024-04-25T08:45:45.403 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:45:45.403 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T08:45:45.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.511+0000 7f0007ce1640 1 Processor -- start 2024-04-25T08:45:45.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.511+0000 7f0007ce1640 1 -- start start 2024-04-25T08:45:45.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f0007ce1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0000158230 0x7f00000d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f0007ce1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00000d1b80 0x7f000006c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f0007ce1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f000006c870 0x7f00000b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f0007ce1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0000158610 con 0x7f00000d1b80 2024-04-25T08:45:45.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f0007ce1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000006bea0 con 0x7f0000158230 2024-04-25T08:45:45.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f0007ce1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00000d2020 con 0x7f000006c870 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f000527c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00000d1b80 0x7f000006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f000527c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00000d1b80 0x7f000006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54918/0 (socket says 172.21.15.172:54918) 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f000527c640 1 -- 172.21.15.172:0/3664875817 learned_addr learned my addr 172.21.15.172:0/3664875817 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f0005a7d640 1 --2- 172.21.15.172:0/3664875817 >> v2:172.21.15.186:3300/0 conn(0x7f0000158230 0x7f00000d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f000627e640 1 --2- 172.21.15.172:0/3664875817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f000006c870 0x7f00000b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f000527c640 1 -- 172.21.15.172:0/3664875817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f000006c870 msgr2=0x7f00000b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f000527c640 1 --2- 172.21.15.172:0/3664875817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f000006c870 0x7f00000b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f000527c640 1 -- 172.21.15.172:0/3664875817 >> v2:172.21.15.186:3300/0 conn(0x7f0000158230 msgr2=0x7f00000d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f000527c640 1 --2- 172.21.15.172:0/3664875817 >> v2:172.21.15.186:3300/0 conn(0x7f0000158230 0x7f00000d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.512+0000 7f000527c640 1 -- 172.21.15.172:0/3664875817 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00000d2300 con 0x7f00000d1b80 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.513+0000 7f000527c640 1 --2- 172.21.15.172:0/3664875817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000d1b80 0x7f000006c330 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0000070460 tx=0x7efff002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357916d0ebae4590 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.513+0000 7f0004a7b640 1 -- 172.21.15.172:0/3664875817 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0004030 con 0x7f00000d1b80 2024-04-25T08:45:45.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.513+0000 7f0004a7b640 1 -- 172.21.15.172:0/3664875817 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff00041d0 con 0x7f00000d1b80 2024-04-25T08:45:45.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.513+0000 7f0004a7b640 1 -- 172.21.15.172:0/3664875817 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0003610 con 0x7f00000d1b80 2024-04-25T08:45:45.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.513+0000 7f0007ce1640 1 -- 172.21.15.172:0/3664875817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000d1b80 msgr2=0x7f000006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.513+0000 7f0007ce1640 1 --2- 172.21.15.172:0/3664875817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000d1b80 0x7f000006c330 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0000070460 tx=0x7efff002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.514+0000 7f0007ce1640 1 -- 172.21.15.172:0/3664875817 shutdown_connections 2024-04-25T08:45:45.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.514+0000 7f0007ce1640 1 --2- 172.21.15.172:0/3664875817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f000006c870 0x7f00000b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.514+0000 7f0007ce1640 1 --2- 172.21.15.172:0/3664875817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00000d1b80 0x7f000006c330 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.514+0000 7f0007ce1640 1 --2- 172.21.15.172:0/3664875817 >> v2:172.21.15.186:3300/0 conn(0x7f0000158230 0x7f00000d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.514+0000 7f0007ce1640 1 -- 172.21.15.172:0/3664875817 >> 172.21.15.172:0/3664875817 conn(0x7f0000061600 msgr2=0x7f00000619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.514+0000 7f0007ce1640 1 -- 172.21.15.172:0/3664875817 shutdown_connections 2024-04-25T08:45:45.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.514+0000 7f0007ce1640 1 -- 172.21.15.172:0/3664875817 wait complete. 2024-04-25T08:45:45.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.515+0000 7f0007ce1640 1 Processor -- start 2024-04-25T08:45:45.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.515+0000 7f0007ce1640 1 -- start start 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.515+0000 7f0007ce1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000006c870 0x7f00001f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.515+0000 7f0007ce1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00000d1b80 0x7f0000151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.515+0000 7f0007ce1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000158230 0x7f00001f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.515+0000 7f0007ce1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000015e320 con 0x7f0000158230 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.515+0000 7f0007ce1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00000d25e0 con 0x7f000006c870 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.515+0000 7f0007ce1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000015e4a0 con 0x7f00000d1b80 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f000627e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000158230 0x7f00001f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f000627e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000158230 0x7f00001f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54928/0 (socket says 172.21.15.172:54928) 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f000627e640 1 -- 172.21.15.172:0/471627664 learned_addr learned my addr 172.21.15.172:0/471627664 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f0005a7d640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000006c870 0x7f00001f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f000527c640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00000d1b80 0x7f0000151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f000627e640 1 -- 172.21.15.172:0/471627664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00000d1b80 msgr2=0x7f0000151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f000627e640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00000d1b80 0x7f0000151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f000627e640 1 -- 172.21.15.172:0/471627664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000006c870 msgr2=0x7f00001f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f000627e640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000006c870 0x7f00001f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f000627e640 1 -- 172.21.15.172:0/471627664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00001f3c00 con 0x7f0000158230 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f000627e640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000158230 0x7f00001f36c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7efff800efc0 tx=0x7efff800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7efff67fc640 1 -- 172.21.15.172:0/471627664 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8018020 con 0x7f0000158230 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7efff67fc640 1 -- 172.21.15.172:0/471627664 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff8014480 con 0x7f0000158230 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f0007ce1640 1 -- 172.21.15.172:0/471627664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0000145350 con 0x7f0000158230 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7efff67fc640 1 -- 172.21.15.172:0/471627664 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8014870 con 0x7f0000158230 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.516+0000 7f0007ce1640 1 -- 172.21.15.172:0/471627664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0000145910 con 0x7f0000158230 2024-04-25T08:45:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.518+0000 7efff67fc640 1 -- 172.21.15.172:0/471627664 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efff8005d10 con 0x7f0000158230 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.518+0000 7efff67fc640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effe406b4d0 0x7effe406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.519+0000 7efff67fc640 1 -- 172.21.15.172:0/471627664 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efff808ad10 con 0x7f0000158230 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.519+0000 7f0005a7d640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effe406b4d0 0x7effe406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.519+0000 7f0005a7d640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effe406b4d0 0x7effe406d990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efffc009a20 tx=0x7efffc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.519+0000 7f000a9e5740 1 Processor -- start 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000a9e5740 1 -- start start 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 0x5628965e6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965e3ef0 0x5628965e6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965b6770 0x5628965b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000a9e5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289651fda0 con 0x5628965b6770 2024-04-25T08:45:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000a9e5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628964c8b80 con 0x5628965e3ef0 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000a9e5740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56289651be40 con 0x5628965e3b10 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000627e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965b6770 0x5628965b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000627e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965b6770 0x5628965b9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54930/0 (socket says 172.21.15.172:54930) 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000627e640 1 -- 172.21.15.172:0/1021471629 learned_addr learned my addr 172.21.15.172:0/1021471629 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f000527c640 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965e3ef0 0x5628965e6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.520+0000 7f0005a7d640 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 0x5628965e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7f000627e640 1 -- 172.21.15.172:0/1021471629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 msgr2=0x5628965e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7f000627e640 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 0x5628965e6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7f000627e640 1 -- 172.21.15.172:0/1021471629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965e3ef0 msgr2=0x5628965e6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7f000627e640 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965e3ef0 0x5628965e6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7f000627e640 1 -- 172.21.15.172:0/1021471629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628964d2f10 con 0x5628965b6770 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7f000527c640 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965e3ef0 0x5628965e6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7f0005a7d640 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 0x5628965e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7f000627e640 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965b6770 0x5628965b9f80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7efff8089020 tx=0x7efff80594f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec477ba260f1a8f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7effe37fe640 1 -- 172.21.15.172:0/1021471629 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8086020 con 0x5628965b6770 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7effe37fe640 1 -- 172.21.15.172:0/1021471629 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff80576b0 con 0x5628965b6770 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7effe37fe640 1 -- 172.21.15.172:0/1021471629 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8055a20 con 0x5628965b6770 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7f000a9e5740 1 -- 172.21.15.172:0/1021471629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965b6770 msgr2=0x5628965b9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.521+0000 7f000a9e5740 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965b6770 0x5628965b9f80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7efff8089020 tx=0x7efff80594f0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.522+0000 7f000a9e5740 1 -- 172.21.15.172:0/1021471629 shutdown_connections 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.522+0000 7f000a9e5740 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965e3ef0 0x5628965e6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.522+0000 7f000a9e5740 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965b6770 0x5628965b9f80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.522+0000 7f000a9e5740 1 --2- 172.21.15.172:0/1021471629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 0x5628965e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.522+0000 7f000a9e5740 1 -- 172.21.15.172:0/1021471629 >> 172.21.15.172:0/1021471629 conn(0x5628965b89e0 msgr2=0x562896601320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.522+0000 7f000a9e5740 1 -- 172.21.15.172:0/1021471629 shutdown_connections 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.522+0000 7f000a9e5740 1 -- 172.21.15.172:0/1021471629 wait complete. 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.522+0000 7f000a9e5740 1 -- start start 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.522+0000 7f000a9e5740 1 Processor -- start 2024-04-25T08:45:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628966046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3ef0 0x5628965baf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x5628965bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f000a9e5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628965bbb90 con 0x5628965e3b10 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f000a9e5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628964be4b0 con 0x5628965d98d0 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f000a9e5740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628965bbe70 con 0x5628965e3ef0 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f000a9e5740 10 client.0 _ll_register_callbacks cb 0x5628964fe180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f0005a7d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628966046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f0005a7d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628966046c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54940/0 (socket says 172.21.15.172:54940) 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f0005a7d640 1 -- 172.21.15.172:0/739745842 learned_addr learned my addr 172.21.15.172:0/739745842 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f000627e640 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x5628965bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f000527c640 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3ef0 0x5628965baf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f0005a7d640 1 -- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3ef0 msgr2=0x5628965baf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f0005a7d640 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3ef0 0x5628965baf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f0005a7d640 1 -- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 msgr2=0x5628965bb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f0005a7d640 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x5628965bb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f0005a7d640 1 -- 172.21.15.172:0/739745842 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628962fe7d0 con 0x5628965e3b10 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.523+0000 7f000527c640 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3ef0 0x5628965baf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f0005a7d640 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628966046c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7efffc011f70 tx=0x7efffc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415945a212715075 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7effe0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7effe0ff9640 1 -- 172.21.15.172:0/739745842 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc027020 con 0x5628965e3b10 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7effe0ff9640 1 -- 172.21.15.172:0/739745842 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efffc023450 con 0x5628965e3b10 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f000a9e5740 1 -- 172.21.15.172:0/739745842 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efff80576b0 con 0x5628965e3b10 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7effe0ff9640 1 -- 172.21.15.172:0/739745842 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efffc023650 con 0x5628965e3b10 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f000a9e5740 10 client.6465 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f000a9e5740 1 -- 172.21.15.172:0/739745842 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5628962343f0 con 0x5628965e3b10 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7effe0ff9640 1 -- 172.21.15.172:0/739745842 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff80576b0 con 0x5628965e3b10 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7effe0ff9640 1 -- 172.21.15.172:0/739745842 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efffc034080 con 0x5628965e3b10 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f000a9e5740 10 client.6465 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:45.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f000a9e5740 10 client.6465 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f000a9e5740 20 client.6465 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f000a9e5740 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5628965da3a0 0x5628965da7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f000a9e5740 4 client.6465 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f000a9e5740 1 -- 172.21.15.172:0/739745842 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56289652d2e0 con 0x5628965da3a0 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.524+0000 7f000527c640 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5628965da3a0 0x5628965da7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7effe0ff9640 10 client.6465 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7f000527c640 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5628965da3a0 0x5628965da7f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea1910797eb0b1e2 server_cookie=f0ff369042b5809c in_seq=0 out_seq=0 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7effe0ff9640 1 -- 172.21.15.172:0/739745842 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56289652d2e0 con 0x5628965da3a0 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7effe0ff9640 10 client.6465 handle_command_reply: tid=0 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7f000a9e5740 1 client.6465 shutdown 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7f000a9e5740 1 -- 172.21.15.172:0/739745842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 msgr2=0x5628966046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7f000a9e5740 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628966046c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7efffc011f70 tx=0x7efffc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7f000a9e5740 1 -- 172.21.15.172:0/739745842 shutdown_connections 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7f000a9e5740 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x5628965bb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7f000a9e5740 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5628965da3a0 0x5628965da7f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7effe0ff9640 0 client.6465 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7f000a9e5740 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3ef0 0x5628965baf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7f000a9e5740 1 --2- 172.21.15.172:0/739745842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628966046c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.525+0000 7f000a9e5740 1 -- 172.21.15.172:0/739745842 >> 172.21.15.172:0/739745842 conn(0x5628965b6770 msgr2=0x5628965e2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.526+0000 7f000a9e5740 1 -- 172.21.15.172:0/739745842 shutdown_connections 2024-04-25T08:45:45.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.526+0000 7f000a9e5740 1 -- 172.21.15.172:0/739745842 wait complete. 2024-04-25T08:45:45.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.526+0000 7f000a9e5740 20 client.6465 trim_cache size 0 max 16384 2024-04-25T08:45:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.540+0000 7f000a9e5740 1 Processor -- start 2024-04-25T08:45:45.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000a9e5740 1 -- start start 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x5628965bb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965da3a0 0x5628965e1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 0x5628965e2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000a9e5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0000200520 con 0x5628965da3a0 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000a9e5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00001ff6b0 con 0x5628965d98d0 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000a9e5740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0000158c10 con 0x5628965e3b10 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000527c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965da3a0 0x5628965e1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000527c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965da3a0 0x5628965e1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54946/0 (socket says 172.21.15.172:54946) 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000527c640 1 -- 172.21.15.172:0/3288314633 learned_addr learned my addr 172.21.15.172:0/3288314633 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f0005a7d640 1 --2- 172.21.15.172:0/3288314633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x5628965bb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.541+0000 7f000627e640 1 --2- 172.21.15.172:0/3288314633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 0x5628965e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000527c640 1 -- 172.21.15.172:0/3288314633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 msgr2=0x5628965e2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000527c640 1 --2- 172.21.15.172:0/3288314633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 0x5628965e2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000527c640 1 -- 172.21.15.172:0/3288314633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 msgr2=0x5628965bb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000527c640 1 --2- 172.21.15.172:0/3288314633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x5628965bb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000527c640 1 -- 172.21.15.172:0/3288314633 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628961f40f0 con 0x5628965da3a0 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000527c640 1 --2- 172.21.15.172:0/3288314633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965da3a0 0x5628965e1f40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7efff0009910 tx=0x7efff002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dd0e19b0212fd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7effe2ffd640 1 -- 172.21.15.172:0/3288314633 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff004d070 con 0x5628965da3a0 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7effe2ffd640 1 -- 172.21.15.172:0/3288314633 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff0004340 con 0x5628965da3a0 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7effe2ffd640 1 -- 172.21.15.172:0/3288314633 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0005b90 con 0x5628965da3a0 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000a9e5740 1 -- 172.21.15.172:0/3288314633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965da3a0 msgr2=0x5628965e1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000a9e5740 1 --2- 172.21.15.172:0/3288314633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965da3a0 0x5628965e1f40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7efff0009910 tx=0x7efff002c000 comp rx=0 tx=0).stop 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000a9e5740 1 -- 172.21.15.172:0/3288314633 shutdown_connections 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000a9e5740 1 --2- 172.21.15.172:0/3288314633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965e3b10 0x5628965e2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000a9e5740 1 --2- 172.21.15.172:0/3288314633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965da3a0 0x5628965e1f40 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000a9e5740 1 --2- 172.21.15.172:0/3288314633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x5628965bb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.542+0000 7f000a9e5740 1 -- 172.21.15.172:0/3288314633 >> 172.21.15.172:0/3288314633 conn(0x5628965b6770 msgr2=0x5628965fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.543+0000 7f000a9e5740 1 -- 172.21.15.172:0/3288314633 shutdown_connections 2024-04-25T08:45:45.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.543+0000 7f000a9e5740 1 -- 172.21.15.172:0/3288314633 wait complete. 2024-04-25T08:45:45.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.543+0000 7f000a9e5740 1 -- start start 2024-04-25T08:45:45.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.543+0000 7f000a9e5740 1 Processor -- start 2024-04-25T08:45:45.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x56289666e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965da3a0 0x56289666ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000a9e5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628965e99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000a9e5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628965b8490 con 0x5628965e3b10 2024-04-25T08:45:45.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000a9e5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0000159210 con 0x5628965d98d0 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000a9e5740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628965bd850 con 0x5628965da3a0 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000a9e5740 10 client.0 _ll_register_callbacks cb 0x7efff8055650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000627e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628965e99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000627e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628965e99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54948/0 (socket says 172.21.15.172:54948) 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000627e640 1 -- 172.21.15.172:0/3081529302 learned_addr learned my addr 172.21.15.172:0/3081529302 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000527c640 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965da3a0 0x56289666ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f0005a7d640 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x56289666e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000627e640 1 -- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965da3a0 msgr2=0x56289666ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000627e640 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965da3a0 0x56289666ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000627e640 1 -- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 msgr2=0x56289666e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000627e640 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x56289666e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f000627e640 1 -- 172.21.15.172:0/3081529302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628965f79a0 con 0x5628965e3b10 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.544+0000 7f0005a7d640 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x56289666e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:45.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f000627e640 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628965e99f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7efff800ef90 tx=0x7efff805c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d19f24e90a644d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7effe0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7effe0ff9640 1 -- 172.21.15.172:0/3081529302 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8086040 con 0x5628965e3b10 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7effe0ff9640 1 -- 172.21.15.172:0/3081529302 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efff8057730 con 0x5628965e3b10 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f000a9e5740 1 -- 172.21.15.172:0/3081529302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efff0004340 con 0x5628965e3b10 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7effe0ff9640 1 -- 172.21.15.172:0/3081529302 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efff8058800 con 0x5628965e3b10 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f000a9e5740 10 client.6471 fetch_fsmap learned FSMap version 24 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f000a9e5740 1 -- 172.21.15.172:0/3081529302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x56289666f070 con 0x5628965e3b10 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7effe0ff9640 1 -- 172.21.15.172:0/3081529302 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff0004340 con 0x5628965e3b10 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7effe0ff9640 1 -- 172.21.15.172:0/3081529302 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efff80589a0 con 0x5628965e3b10 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f000a9e5740 10 client.6471 fetch_fsmap finished waiting for FSMap version 24 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f000a9e5740 10 client.6471 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f000a9e5740 20 client.6471 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f000a9e5740 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5628965e3ef0 0x5628965b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f000a9e5740 4 client.6471 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f000a9e5740 1 -- 172.21.15.172:0/3081529302 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562896527630 con 0x5628965e3ef0 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.545+0000 7f0005a7d640 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5628965e3ef0 0x5628965b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7effe0ff9640 10 client.6471 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f0005a7d640 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5628965e3ef0 0x5628965b7100 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a16c64e9211d761 server_cookie=7c55486394b3e0b0 in_seq=0 out_seq=0 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7effe0ff9640 1 -- 172.21.15.172:0/3081529302 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+455 (crc 0 0 0) 0x562896527630 con 0x5628965e3ef0 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7effe0ff9640 10 client.6471 handle_command_reply: tid=0 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 client.6471 shutdown 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 -- 172.21.15.172:0/3081529302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 msgr2=0x5628965e99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628965e99f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7efff800ef90 tx=0x7efff805c000 comp rx=0 tx=0).stop 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 -- 172.21.15.172:0/3081529302 shutdown_connections 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x5628965e3ef0 0x5628965b7100 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628965e3b10 0x5628965e99f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5628965da3a0 0x56289666ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7effe0ff9640 0 client.6471 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 --2- 172.21.15.172:0/3081529302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5628965d98d0 0x56289666e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 -- 172.21.15.172:0/3081529302 >> 172.21.15.172:0/3081529302 conn(0x5628965b6770 msgr2=0x562896614d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 -- 172.21.15.172:0/3081529302 shutdown_connections 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 1 -- 172.21.15.172:0/3081529302 wait complete. 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.546+0000 7f000a9e5740 20 client.6471 trim_cache size 0 max 16384 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": { 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stdout: "61a2649b-2c1c-446b-94a9-977639aebb3f": { 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-04-25T08:45:45.544 INFO:teuthology.orchestra.run.smithi172.stdout: "tag": "61a2649b-2c1c-446b-94a9-977639aebb3f", 2024-04-25T08:45:45.545 INFO:teuthology.orchestra.run.smithi172.stdout: "options": "" 2024-04-25T08:45:45.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:45:45.545 INFO:teuthology.orchestra.run.smithi172.stdout: "dbf114be-4d38-434e-9570-6b4118e25a3c": { 2024-04-25T08:45:45.545 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "/", 2024-04-25T08:45:45.545 INFO:teuthology.orchestra.run.smithi172.stdout: "tag": "dbf114be-4d38-434e-9570-6b4118e25a3c", 2024-04-25T08:45:45.545 INFO:teuthology.orchestra.run.smithi172.stdout: "options": "" 2024-04-25T08:45:45.545 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:45.545 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:45.545 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:45.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 -- 172.21.15.172:0/471627664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effe406b4d0 msgr2=0x7effe406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effe406b4d0 0x7effe406d990 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efffc009a20 tx=0x7efffc009190 comp rx=0 tx=0).stop 2024-04-25T08:45:45.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 -- 172.21.15.172:0/471627664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000158230 msgr2=0x7f00001f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:45.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000158230 0x7f00001f36c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7efff800efc0 tx=0x7efff800c490 comp rx=0 tx=0).stop 2024-04-25T08:45:45.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 -- 172.21.15.172:0/471627664 shutdown_connections 2024-04-25T08:45:45.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effe406b4d0 0x7effe406d990 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0000158230 0x7f00001f36c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00000d1b80 0x7f0000151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 --2- 172.21.15.172:0/471627664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f000006c870 0x7f00001f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:45.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 -- 172.21.15.172:0/471627664 >> 172.21.15.172:0/471627664 conn(0x7f0000061600 msgr2=0x7f00000cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:45.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 -- 172.21.15.172:0/471627664 shutdown_connections 2024-04-25T08:45:45.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:45.547+0000 7f0007ce1640 1 -- 172.21.15.172:0/471627664 wait complete. 2024-04-25T08:45:50.549 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:45:50.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T08:45:50.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.669+0000 7f2e4e05d640 1 Processor -- start 2024-04-25T08:45:50.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.669+0000 7f2e4e05d640 1 -- start start 2024-04-25T08:45:50.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e4e05d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2e48070dc0 0x7f2e4806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e4e05d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2e4815deb0 0x7f2e4815e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e4e05d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e480d1770 con 0x7f2e480711a0 2024-04-25T08:45:50.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e4e05d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e480b0eb0 con 0x7f2e4815deb0 2024-04-25T08:45:50.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e4e05d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e481622b0 con 0x7f2e48070dc0 2024-04-25T08:45:50.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e47fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2e4815deb0 0x7f2e4815e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e47fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2e4815deb0 0x7f2e4815e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42196/0 (socket says 172.21.15.172:42196) 2024-04-25T08:45:50.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e47fff640 1 -- 172.21.15.172:0/1818538053 learned_addr learned my addr 172.21.15.172:0/1818538053 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e477fe640 1 --2- 172.21.15.172:0/1818538053 >> v2:172.21.15.186:3300/0 conn(0x7f2e48070dc0 0x7f2e4806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e47fff640 1 -- 172.21.15.172:0/1818538053 >> v2:172.21.15.186:3300/0 conn(0x7f2e48070dc0 msgr2=0x7f2e4806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e47fff640 1 --2- 172.21.15.172:0/1818538053 >> v2:172.21.15.186:3300/0 conn(0x7f2e48070dc0 0x7f2e4806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e47fff640 1 -- 172.21.15.172:0/1818538053 >> v1:172.21.15.186:6789/0 conn(0x7f2e480711a0 legacy=0x7f2e480b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.670+0000 7f2e47fff640 1 -- 172.21.15.172:0/1818538053 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e48162740 con 0x7f2e4815deb0 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.671+0000 7f2e47fff640 1 --2- 172.21.15.172:0/1818538053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e4815deb0 0x7f2e4815e300 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2e48070a00 tx=0x7f2e4002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698fa5a30549fea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.671+0000 7f2e467fc640 1 -- 172.21.15.172:0/1818538053 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40036070 con 0x7f2e4815deb0 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.671+0000 7f2e467fc640 1 -- 172.21.15.172:0/1818538053 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e40031600 con 0x7f2e4815deb0 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.671+0000 7f2e467fc640 1 -- 172.21.15.172:0/1818538053 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e400319d0 con 0x7f2e4815deb0 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.672+0000 7f2e4e05d640 1 -- 172.21.15.172:0/1818538053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e4815deb0 msgr2=0x7f2e4815e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.672+0000 7f2e4e05d640 1 --2- 172.21.15.172:0/1818538053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e4815deb0 0x7f2e4815e300 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2e48070a00 tx=0x7f2e4002a610 comp rx=0 tx=0).stop 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.672+0000 7f2e4e05d640 1 -- 172.21.15.172:0/1818538053 shutdown_connections 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.672+0000 7f2e4e05d640 1 --2- 172.21.15.172:0/1818538053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e4815deb0 0x7f2e4815e300 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.672+0000 7f2e4e05d640 1 --2- 172.21.15.172:0/1818538053 >> v2:172.21.15.186:3300/0 conn(0x7f2e48070dc0 0x7f2e4806ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.672+0000 7f2e4e05d640 1 -- 172.21.15.172:0/1818538053 >> 172.21.15.172:0/1818538053 conn(0x7f2e480b3530 msgr2=0x7f2e480b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.672+0000 7f2e4e05d640 1 -- 172.21.15.172:0/1818538053 shutdown_connections 2024-04-25T08:45:50.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.672+0000 7f2e4e05d640 1 -- 172.21.15.172:0/1818538053 wait complete. 2024-04-25T08:45:50.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.673+0000 7f2e4e05d640 1 Processor -- start 2024-04-25T08:45:50.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.673+0000 7f2e4e05d640 1 -- start start 2024-04-25T08:45:50.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e4e05d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e48070dc0 0x7f2e4815f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e4e05d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480711a0 0x7f2e480b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e4e05d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e4815deb0 0x7f2e480b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e4e05d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48161c60 con 0x7f2e480711a0 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e4e05d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480b10f0 con 0x7f2e48070dc0 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e4e05d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48161f40 con 0x7f2e4815deb0 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480711a0 0x7f2e480b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480711a0 0x7f2e480b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42208/0 (socket says 172.21.15.172:42208) 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e46ffd640 1 -- 172.21.15.172:0/4042678569 learned_addr learned my addr 172.21.15.172:0/4042678569 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e477fe640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e48070dc0 0x7f2e4815f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e47fff640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e4815deb0 0x7f2e480b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e46ffd640 1 -- 172.21.15.172:0/4042678569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e4815deb0 msgr2=0x7f2e480b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e4815deb0 0x7f2e480b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e46ffd640 1 -- 172.21.15.172:0/4042678569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e48070dc0 msgr2=0x7f2e4815f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e48070dc0 0x7f2e4815f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e46ffd640 1 -- 172.21.15.172:0/4042678569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4815f990 con 0x7f2e480711a0 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e477fe640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e48070dc0 0x7f2e4815f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.674+0000 7f2e47fff640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e4815deb0 0x7f2e480b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.675+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480711a0 0x7f2e480b1da0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c400 tx=0x7f2e3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.675+0000 7f2e2ffff640 1 -- 172.21.15.172:0/4042678569 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0052d0 con 0x7f2e480711a0 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.675+0000 7f2e2ffff640 1 -- 172.21.15.172:0/4042678569 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c005490 con 0x7f2e480711a0 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.675+0000 7f2e4e05d640 1 -- 172.21.15.172:0/4042678569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e480cc4e0 con 0x7f2e480711a0 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.675+0000 7f2e2ffff640 1 -- 172.21.15.172:0/4042678569 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c007260 con 0x7f2e480711a0 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.675+0000 7f2e4e05d640 1 -- 172.21.15.172:0/4042678569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4815fc70 con 0x7f2e480711a0 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.676+0000 7f2e2ffff640 1 -- 172.21.15.172:0/4042678569 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e3c007400 con 0x7f2e480711a0 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.677+0000 7f2e2ffff640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e3406b500 0x7f2e3406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.677+0000 7f2e2ffff640 1 -- 172.21.15.172:0/4042678569 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2e3c0897f0 con 0x7f2e480711a0 2024-04-25T08:45:50.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.677+0000 7f2e477fe640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e3406b500 0x7f2e3406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.677+0000 7f2e477fe640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e3406b500 0x7f2e3406d9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009ac0 tx=0x7f2e38008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.678+0000 7f2e50d67740 1 Processor -- start 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.678+0000 7f2e50d67740 1 -- start start 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d473320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d473860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d443770 0x560d8d446f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e50d67740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8d3acda0 con 0x560d8d470ef0 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e50d67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8d355b80 con 0x560d8d443770 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e50d67740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d8d3a8e40 con 0x560d8d470b10 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d473860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e46ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d473860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42216/0 (socket says 172.21.15.172:42216) 2024-04-25T08:45:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e46ffd640 1 -- 172.21.15.172:0/1539498316 learned_addr learned my addr 172.21.15.172:0/1539498316 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e477fe640 1 --2- 172.21.15.172:0/1539498316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d473320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e47fff640 1 --2- 172.21.15.172:0/1539498316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d443770 0x560d8d446f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e46ffd640 1 -- 172.21.15.172:0/1539498316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 msgr2=0x560d8d473320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/1539498316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d473320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e46ffd640 1 -- 172.21.15.172:0/1539498316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d443770 msgr2=0x560d8d446f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/1539498316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d443770 0x560d8d446f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e46ffd640 1 -- 172.21.15.172:0/1539498316 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d8d35ff10 con 0x560d8d470ef0 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.679+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/1539498316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d473860 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001eb0 tx=0x7f2e3c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5dcc355e9d2722 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e2d7fa640 1 -- 172.21.15.172:0/1539498316 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0544e0 con 0x560d8d470ef0 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e2d7fa640 1 -- 172.21.15.172:0/1539498316 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c05e070 con 0x560d8d470ef0 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e2d7fa640 1 -- 172.21.15.172:0/1539498316 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0572c0 con 0x560d8d470ef0 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e50d67740 1 -- 172.21.15.172:0/1539498316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 msgr2=0x560d8d473860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1539498316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d473860 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001eb0 tx=0x7f2e3c00a000 comp rx=0 tx=0).stop 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e50d67740 1 -- 172.21.15.172:0/1539498316 shutdown_connections 2024-04-25T08:45:50.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1539498316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d443770 0x560d8d446f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1539498316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d473860 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1539498316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d473320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e50d67740 1 -- 172.21.15.172:0/1539498316 >> 172.21.15.172:0/1539498316 conn(0x560d8d4459e0 msgr2=0x560d8d48e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e50d67740 1 -- 172.21.15.172:0/1539498316 shutdown_connections 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.680+0000 7f2e50d67740 1 -- 172.21.15.172:0/1539498316 wait complete. 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.681+0000 7f2e50d67740 1 -- start start 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.681+0000 7f2e50d67740 1 Processor -- start 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470b10 0x560d8d495480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d470ef0 0x560d8d4929f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d460e50 0x560d8d492f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e50d67740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8d448b90 con 0x560d8d470b10 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e50d67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8d34b4b0 con 0x560d8d470ef0 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e50d67740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d8d448e70 con 0x560d8d460e50 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e50d67740 10 client.0 _ll_register_callbacks cb 0x560d8d38b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e477fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470b10 0x560d8d495480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e477fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470b10 0x560d8d495480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42218/0 (socket says 172.21.15.172:42218) 2024-04-25T08:45:50.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e477fe640 1 -- 172.21.15.172:0/1221231943 learned_addr learned my addr 172.21.15.172:0/1221231943 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e47fff640 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d460e50 0x560d8d492f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d470ef0 0x560d8d4929f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e477fe640 1 -- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d460e50 msgr2=0x560d8d492f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e477fe640 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d460e50 0x560d8d492f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e477fe640 1 -- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d470ef0 msgr2=0x560d8d4929f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e477fe640 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d470ef0 0x560d8d4929f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e477fe640 1 -- 172.21.15.172:0/1221231943 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d8d18b7d0 con 0x560d8d470b10 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e477fe640 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470b10 0x560d8d495480 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2e380157c0 tx=0x7f2e38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bb29b23c72d583 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.682+0000 7f2e267fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e267fc640 1 -- 172.21.15.172:0/1221231943 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800f040 con 0x560d8d470b10 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e267fc640 1 -- 172.21.15.172:0/1221231943 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2e38016bb0 con 0x560d8d470b10 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e50d67740 1 -- 172.21.15.172:0/1221231943 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e3c05e070 con 0x560d8d470b10 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e267fc640 1 -- 172.21.15.172:0/1221231943 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e3802f050 con 0x560d8d470b10 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e50d67740 10 client.6483 fetch_fsmap learned FSMap version 25 2024-04-25T08:45:50.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e50d67740 1 -- 172.21.15.172:0/1221231943 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x560d8d0c13f0 con 0x560d8d470b10 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e267fc640 1 -- 172.21.15.172:0/1221231943 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c05e070 con 0x560d8d470b10 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e267fc640 1 -- 172.21.15.172:0/1221231943 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2e38032020 con 0x560d8d470b10 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e50d67740 10 client.6483 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e50d67740 10 client.6483 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e50d67740 20 client.6483 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560d8d491580 0x560d8d491960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e50d67740 4 client.6483 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e50d67740 1 -- 172.21.15.172:0/1221231943 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d8d3ba2e0 con 0x560d8d491580 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.683+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560d8d491580 0x560d8d491960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e267fc640 10 client.6483 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560d8d491580 0x560d8d491960 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=853c986405818d1e server_cookie=80271cfe8f26ec10 in_seq=0 out_seq=0 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e267fc640 1 -- 172.21.15.172:0/1221231943 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560d8d3ba2e0 con 0x560d8d491580 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e267fc640 10 client.6483 handle_command_reply: tid=0 2024-04-25T08:45:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e50d67740 1 client.6483 shutdown 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e50d67740 1 -- 172.21.15.172:0/1221231943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470b10 msgr2=0x560d8d495480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470b10 0x560d8d495480 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2e380157c0 tx=0x7f2e38004730 comp rx=0 tx=0).stop 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e50d67740 1 -- 172.21.15.172:0/1221231943 shutdown_connections 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d470ef0 0x560d8d4929f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560d8d491580 0x560d8d491960 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d460e50 0x560d8d492f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1221231943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470b10 0x560d8d495480 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e267fc640 0 client.6483 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e50d67740 1 -- 172.21.15.172:0/1221231943 >> 172.21.15.172:0/1221231943 conn(0x560d8d443770 msgr2=0x560d8d4732e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.684+0000 7f2e50d67740 1 -- 172.21.15.172:0/1221231943 shutdown_connections 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.685+0000 7f2e50d67740 1 -- 172.21.15.172:0/1221231943 wait complete. 2024-04-25T08:45:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.685+0000 7f2e50d67740 20 client.6483 trim_cache size 0 max 16384 2024-04-25T08:45:50.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.699+0000 7f2e50d67740 1 Processor -- start 2024-04-25T08:45:50.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.700+0000 7f2e50d67740 1 -- start start 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.700+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d460e50 0x560d8d48bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.700+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d446f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.700+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d470ef0 0x560d8d4474c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.700+0000 7f2e50d67740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48200640 con 0x560d8d460e50 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.700+0000 7f2e50d67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e481ff7f0 con 0x560d8d470ef0 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.700+0000 7f2e50d67740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e481f7870 con 0x560d8d470b10 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e477fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d460e50 0x560d8d48bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e477fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d460e50 0x560d8d48bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42230/0 (socket says 172.21.15.172:42230) 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e477fe640 1 -- 172.21.15.172:0/401379612 learned_addr learned my addr 172.21.15.172:0/401379612 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e47fff640 1 --2- 172.21.15.172:0/401379612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d470ef0 0x560d8d4474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/401379612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d446f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e477fe640 1 -- 172.21.15.172:0/401379612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 msgr2=0x560d8d446f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e477fe640 1 --2- 172.21.15.172:0/401379612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d446f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e477fe640 1 -- 172.21.15.172:0/401379612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d470ef0 msgr2=0x560d8d4474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e477fe640 1 --2- 172.21.15.172:0/401379612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d470ef0 0x560d8d4474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e477fe640 1 -- 172.21.15.172:0/401379612 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d8d4743d0 con 0x560d8d460e50 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/401379612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d446f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e477fe640 1 --2- 172.21.15.172:0/401379612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d460e50 0x560d8d48bda0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2e38006da0 tx=0x7f2e38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79331ecc318b512e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e2cff9640 1 -- 172.21.15.172:0/401379612 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e380167f0 con 0x560d8d460e50 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e2cff9640 1 -- 172.21.15.172:0/401379612 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38027070 con 0x560d8d460e50 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.701+0000 7f2e2cff9640 1 -- 172.21.15.172:0/401379612 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38016df0 con 0x560d8d460e50 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 -- 172.21.15.172:0/401379612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d460e50 msgr2=0x560d8d48bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 --2- 172.21.15.172:0/401379612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d460e50 0x560d8d48bda0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2e38006da0 tx=0x7f2e38017000 comp rx=0 tx=0).stop 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 -- 172.21.15.172:0/401379612 shutdown_connections 2024-04-25T08:45:50.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 --2- 172.21.15.172:0/401379612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d470ef0 0x560d8d4474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 --2- 172.21.15.172:0/401379612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d446f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 --2- 172.21.15.172:0/401379612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d460e50 0x560d8d48bda0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 -- 172.21.15.172:0/401379612 >> 172.21.15.172:0/401379612 conn(0x560d8d443770 msgr2=0x560d8d4733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 -- 172.21.15.172:0/401379612 shutdown_connections 2024-04-25T08:45:50.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 -- 172.21.15.172:0/401379612 wait complete. 2024-04-25T08:45:50.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 -- start start 2024-04-25T08:45:50.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.702+0000 7f2e50d67740 1 Processor -- start 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d460e50 0x560d8d45f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d494890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e50d67740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d444200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e50d67740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d8d448620 con 0x560d8d470ef0 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e50d67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e481ff1f0 con 0x560d8d460e50 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e50d67740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d8d448840 con 0x560d8d470b10 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e50d67740 10 client.0 _ll_register_callbacks cb 0x7f2e3c057c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e47fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d444200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e47fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d444200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42236/0 (socket says 172.21.15.172:42236) 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e47fff640 1 -- 172.21.15.172:0/1055969686 learned_addr learned my addr 172.21.15.172:0/1055969686 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e46ffd640 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d494890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.703+0000 7f2e477fe640 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d460e50 0x560d8d45f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e47fff640 1 -- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 msgr2=0x560d8d494890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e47fff640 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d494890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e47fff640 1 -- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d460e50 msgr2=0x560d8d45f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e47fff640 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d460e50 0x560d8d45f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e47fff640 1 -- 172.21.15.172:0/1055969686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d8d0810f0 con 0x560d8d470ef0 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e477fe640 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d460e50 0x560d8d45f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e47fff640 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d444200 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2e40034040 tx=0x7f2e40004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccf4dc7e8bb399c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e267fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e267fc640 1 -- 172.21.15.172:0/1055969686 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40036040 con 0x560d8d470ef0 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e267fc640 1 -- 172.21.15.172:0/1055969686 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2e40048c40 con 0x560d8d470ef0 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e50d67740 1 -- 172.21.15.172:0/1055969686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e38027070 con 0x560d8d470ef0 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e267fc640 1 -- 172.21.15.172:0/1055969686 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e40009510 con 0x560d8d470ef0 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e50d67740 10 client.6489 fetch_fsmap learned FSMap version 25 2024-04-25T08:45:50.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e50d67740 1 -- 172.21.15.172:0/1055969686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x560d8d4951e0 con 0x560d8d470ef0 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e267fc640 1 -- 172.21.15.172:0/1055969686 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38027070 con 0x560d8d470ef0 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e267fc640 1 -- 172.21.15.172:0/1055969686 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2e4004f050 con 0x560d8d470ef0 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e50d67740 10 client.6489 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e50d67740 10 client.6489 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e50d67740 20 client.6489 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560d8d494dd0 0x560d8d444740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e50d67740 4 client.6489 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.704+0000 7f2e50d67740 1 -- 172.21.15.172:0/1055969686 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560d8d3b4630 con 0x560d8d494dd0 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e477fe640 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560d8d494dd0 0x560d8d444740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e267fc640 10 client.6489 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e477fe640 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560d8d494dd0 0x560d8d444740 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d695734c8136e636 server_cookie=c5e82967024f0844 in_seq=0 out_seq=0 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e267fc640 1 -- 172.21.15.172:0/1055969686 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560d8d3b4630 con 0x560d8d494dd0 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e267fc640 10 client.6489 handle_command_reply: tid=0 2024-04-25T08:45:50.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 client.6489 shutdown 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 -- 172.21.15.172:0/1055969686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 msgr2=0x560d8d444200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d444200 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2e40034040 tx=0x7f2e40004ab0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 -- 172.21.15.172:0/1055969686 shutdown_connections 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x560d8d494dd0 0x560d8d444740 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560d8d470ef0 0x560d8d444200 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x560d8d470b10 0x560d8d494890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e267fc640 0 client.6489 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 --2- 172.21.15.172:0/1055969686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560d8d460e50 0x560d8d45f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 -- 172.21.15.172:0/1055969686 >> 172.21.15.172:0/1055969686 conn(0x560d8d443770 msgr2=0x560d8d4733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 -- 172.21.15.172:0/1055969686 shutdown_connections 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 1 -- 172.21.15.172:0/1055969686 wait complete. 2024-04-25T08:45:50.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.705+0000 7f2e50d67740 20 client.6489 trim_cache size 0 max 16384 2024-04-25T08:45:50.704 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:45:50.704 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "no active scrubs running", 2024-04-25T08:45:50.704 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": {} 2024-04-25T08:45:50.704 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 -- 172.21.15.172:0/4042678569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e3406b500 msgr2=0x7f2e3406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e3406b500 0x7f2e3406d9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009ac0 tx=0x7f2e38008040 comp rx=0 tx=0).stop 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 -- 172.21.15.172:0/4042678569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480711a0 msgr2=0x7f2e480b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480711a0 0x7f2e480b1da0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c400 tx=0x7f2e3c00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 -- 172.21.15.172:0/4042678569 shutdown_connections 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e3406b500 0x7f2e3406d9c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e4815deb0 0x7f2e480b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e480711a0 0x7f2e480b1da0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 --2- 172.21.15.172:0/4042678569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e48070dc0 0x7f2e4815f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 -- 172.21.15.172:0/4042678569 >> 172.21.15.172:0/4042678569 conn(0x7f2e480b3530 msgr2=0x7f2e480ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 -- 172.21.15.172:0/4042678569 shutdown_connections 2024-04-25T08:45:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.706+0000 7f2e4e05d640 1 -- 172.21.15.172:0/4042678569 wait complete. 2024-04-25T08:45:50.708 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:45:50.708 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:45:50.708 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-04-25T08:45:50.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.817+0000 7fa647c5a640 1 Processor -- start 2024-04-25T08:45:50.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.817+0000 7fa647c5a640 1 -- start start 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa647c5a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa64015dc20 0x7fa6400ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa647c5a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa640161710 0x7fa6400cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa647c5a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64015e000 con 0x7fa6400b9330 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa647c5a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6400d1de0 con 0x7fa64015dc20 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa647c5a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa640161c60 con 0x7fa640161710 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa6459f6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa64015dc20 0x7fa6400ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa6459f6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa64015dc20 0x7fa6400ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42250/0 (socket says 172.21.15.172:42250) 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa6461f7640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa6400b9330 0x7fa64006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51904/0 (socket says 172.21.15.172:51904) 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa6459f6640 1 -- 172.21.15.172:0/2850369173 learned_addr learned my addr 172.21.15.172:0/2850369173 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa6451f5640 1 --2- 172.21.15.172:0/2850369173 >> v2:172.21.15.186:3300/0 conn(0x7fa640161710 0x7fa6400cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa6459f6640 1 -- 172.21.15.172:0/2850369173 >> v2:172.21.15.186:3300/0 conn(0x7fa640161710 msgr2=0x7fa6400cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa6459f6640 1 --2- 172.21.15.172:0/2850369173 >> v2:172.21.15.186:3300/0 conn(0x7fa640161710 0x7fa6400cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa6459f6640 1 -- 172.21.15.172:0/2850369173 >> v1:172.21.15.172:6789/0 conn(0x7fa6400b9330 legacy=0x7fa64006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.818+0000 7fa6459f6640 1 -- 172.21.15.172:0/2850369173 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa640161f40 con 0x7fa64015dc20 2024-04-25T08:45:50.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.819+0000 7fa6459f6640 1 --2- 172.21.15.172:0/2850369173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa64015dc20 0x7fa6400ce670 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa64006da90 tx=0x7fa63c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8906fbc2aedba5d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.819+0000 7fa6449f4640 1 -- 172.21.15.172:0/2850369173 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c037070 con 0x7fa64015dc20 2024-04-25T08:45:50.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.819+0000 7fa6449f4640 1 -- 172.21.15.172:0/2850369173 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c032440 con 0x7fa64015dc20 2024-04-25T08:45:50.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.819+0000 7fa6449f4640 1 -- 172.21.15.172:0/2850369173 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c032810 con 0x7fa64015dc20 2024-04-25T08:45:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.820+0000 7fa647c5a640 1 -- 172.21.15.172:0/2850369173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa64015dc20 msgr2=0x7fa6400ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.820+0000 7fa647c5a640 1 --2- 172.21.15.172:0/2850369173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa64015dc20 0x7fa6400ce670 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa64006da90 tx=0x7fa63c02a270 comp rx=0 tx=0).stop 2024-04-25T08:45:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.820+0000 7fa647c5a640 1 -- 172.21.15.172:0/2850369173 shutdown_connections 2024-04-25T08:45:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.820+0000 7fa647c5a640 1 --2- 172.21.15.172:0/2850369173 >> v2:172.21.15.186:3300/0 conn(0x7fa640161710 0x7fa6400cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.820+0000 7fa647c5a640 1 --2- 172.21.15.172:0/2850369173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa64015dc20 0x7fa6400ce670 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.820+0000 7fa647c5a640 1 -- 172.21.15.172:0/2850369173 >> 172.21.15.172:0/2850369173 conn(0x7fa6400d0420 msgr2=0x7fa6400d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.820+0000 7fa647c5a640 1 -- 172.21.15.172:0/2850369173 shutdown_connections 2024-04-25T08:45:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.820+0000 7fa647c5a640 1 -- 172.21.15.172:0/2850369173 wait complete. 2024-04-25T08:45:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.821+0000 7fa647c5a640 1 Processor -- start 2024-04-25T08:45:50.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.821+0000 7fa647c5a640 1 -- start start 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa647c5a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6400b9330 0x7fa64015d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa647c5a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa64015dc20 0x7fa6400caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa647c5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa640161710 0x7fa6400acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa647c5a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400b5e50 con 0x7fa640161710 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa647c5a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa640162500 con 0x7fa6400b9330 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa647c5a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400b5fd0 con 0x7fa64015dc20 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa6461f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa640161710 0x7fa6400acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa6461f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa640161710 0x7fa6400acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42266/0 (socket says 172.21.15.172:42266) 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa6461f7640 1 -- 172.21.15.172:0/3877976388 learned_addr learned my addr 172.21.15.172:0/3877976388 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa6459f6640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6400b9330 0x7fa64015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa6451f5640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa64015dc20 0x7fa6400caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa6461f7640 1 -- 172.21.15.172:0/3877976388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa64015dc20 msgr2=0x7fa6400caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa6461f7640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa64015dc20 0x7fa6400caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa6461f7640 1 -- 172.21.15.172:0/3877976388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6400b9330 msgr2=0x7fa64015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa6461f7640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6400b9330 0x7fa64015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.822+0000 7fa6461f7640 1 -- 172.21.15.172:0/3877976388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6400cb9b0 con 0x7fa640161710 2024-04-25T08:45:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.823+0000 7fa6461f7640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa640161710 0x7fa6400acd80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa63800c760 tx=0x7fa63800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.823+0000 7fa6367fc640 1 -- 172.21.15.172:0/3877976388 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638017070 con 0x7fa640161710 2024-04-25T08:45:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.823+0000 7fa6367fc640 1 -- 172.21.15.172:0/3877976388 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63800ce10 con 0x7fa640161710 2024-04-25T08:45:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.823+0000 7fa6367fc640 1 -- 172.21.15.172:0/3877976388 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63800a840 con 0x7fa640161710 2024-04-25T08:45:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.823+0000 7fa647c5a640 1 -- 172.21.15.172:0/3877976388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6400cbc90 con 0x7fa640161710 2024-04-25T08:45:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.823+0000 7fa647c5a640 1 -- 172.21.15.172:0/3877976388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6400cc250 con 0x7fa640161710 2024-04-25T08:45:50.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.824+0000 7fa6367fc640 1 -- 172.21.15.172:0/3877976388 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa63801a070 con 0x7fa640161710 2024-04-25T08:45:50.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.825+0000 7fa6367fc640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa62406b500 0x7fa62406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.825+0000 7fa6459f6640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa62406b500 0x7fa62406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.825+0000 7fa6367fc640 1 -- 172.21.15.172:0/3877976388 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa6380897b0 con 0x7fa640161710 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.826+0000 7fa6459f6640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa62406b500 0x7fa62406d9c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa63c034000 tx=0x7fa63c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.826+0000 7fa64aa31740 1 Processor -- start 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.826+0000 7fa64aa31740 1 -- start start 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941aa0 0x55a51a9442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941e80 0x55a51a9447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a914700 0x55a51a917f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa64aa31740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51a87de00 con 0x55a51a914700 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa64aa31740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51a826d20 con 0x55a51a941aa0 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa64aa31740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a51a879ea0 con 0x55a51a941e80 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6461f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a914700 0x55a51a917f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6461f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a914700 0x55a51a917f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42274/0 (socket says 172.21.15.172:42274) 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6461f7640 1 -- 172.21.15.172:0/233988296 learned_addr learned my addr 172.21.15.172:0/233988296 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6461f7640 1 -- 172.21.15.172:0/233988296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941e80 msgr2=0x55a51a9447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6461f7640 1 --2- 172.21.15.172:0/233988296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941e80 0x55a51a9447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6461f7640 1 -- 172.21.15.172:0/233988296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941aa0 msgr2=0x55a51a9442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6461f7640 1 --2- 172.21.15.172:0/233988296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941aa0 0x55a51a9442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6461f7640 1 -- 172.21.15.172:0/233988296 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a51a848df0 con 0x55a51a914700 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6461f7640 1 --2- 172.21.15.172:0/233988296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a914700 0x55a51a917f10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa63805ff80 tx=0x7fa63800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba2b52fbfc04de0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6237fe640 1 -- 172.21.15.172:0/233988296 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63805b070 con 0x55a51a914700 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6237fe640 1 -- 172.21.15.172:0/233988296 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6380604b0 con 0x55a51a914700 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.827+0000 7fa6237fe640 1 -- 172.21.15.172:0/233988296 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63805e0c0 con 0x55a51a914700 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.828+0000 7fa64aa31740 1 -- 172.21.15.172:0/233988296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a914700 msgr2=0x55a51a917f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.828+0000 7fa64aa31740 1 --2- 172.21.15.172:0/233988296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a914700 0x55a51a917f10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa63805ff80 tx=0x7fa63800f000 comp rx=0 tx=0).stop 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.828+0000 7fa64aa31740 1 -- 172.21.15.172:0/233988296 shutdown_connections 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.828+0000 7fa64aa31740 1 --2- 172.21.15.172:0/233988296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a914700 0x55a51a917f10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.828+0000 7fa64aa31740 1 --2- 172.21.15.172:0/233988296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941e80 0x55a51a9447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.828+0000 7fa64aa31740 1 --2- 172.21.15.172:0/233988296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941aa0 0x55a51a9442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.828+0000 7fa64aa31740 1 -- 172.21.15.172:0/233988296 >> 172.21.15.172:0/233988296 conn(0x55a51a916970 msgr2=0x55a51a95f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.828+0000 7fa64aa31740 1 -- 172.21.15.172:0/233988296 shutdown_connections 2024-04-25T08:45:50.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.828+0000 7fa64aa31740 1 -- 172.21.15.172:0/233988296 wait complete. 2024-04-25T08:45:50.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.828+0000 7fa64aa31740 1 -- start start 2024-04-25T08:45:50.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.829+0000 7fa64aa31740 1 Processor -- start 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.829+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941aa0 0x55a51a938f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.829+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a941e80 0x55a51a962280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.829+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a947320 0x55a51a940830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.829+0000 7fa64aa31740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51a919b20 con 0x55a51a941e80 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.829+0000 7fa64aa31740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51a81c590 con 0x55a51a947320 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.829+0000 7fa64aa31740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a51a919e00 con 0x55a51a941aa0 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa64aa31740 10 client.0 _ll_register_callbacks cb 0x55a51a828e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6451f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a941e80 0x55a51a962280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6451f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a941e80 0x55a51a962280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42284/0 (socket says 172.21.15.172:42284) 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6451f5640 1 -- 172.21.15.172:0/2795452230 learned_addr learned my addr 172.21.15.172:0/2795452230 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6459f6640 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941aa0 0x55a51a938f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6461f7640 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a947320 0x55a51a940830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6451f5640 1 -- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941aa0 msgr2=0x55a51a938f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6451f5640 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941aa0 0x55a51a938f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6451f5640 1 -- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a947320 msgr2=0x55a51a940830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6451f5640 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a947320 0x55a51a940830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6451f5640 1 -- 172.21.15.172:0/2795452230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a51a5923f0 con 0x55a51a941e80 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa6451f5640 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a941e80 0x55a51a962280 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa6300115a0 tx=0x7fa630011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c94b61d7c5b903 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa620ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa620ff9640 1 -- 172.21.15.172:0/2795452230 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630019070 con 0x55a51a941e80 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa620ff9640 1 -- 172.21.15.172:0/2795452230 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa630004240 con 0x55a51a941e80 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa64aa31740 1 -- 172.21.15.172:0/2795452230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6380604b0 con 0x55a51a941e80 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa620ff9640 1 -- 172.21.15.172:0/2795452230 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa630024050 con 0x55a51a941e80 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa64aa31740 10 client.6504 fetch_fsmap learned FSMap version 25 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa64aa31740 1 -- 172.21.15.172:0/2795452230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55a51a65c7d0 con 0x55a51a941e80 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.830+0000 7fa620ff9640 1 -- 172.21.15.172:0/2795452230 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6380604b0 con 0x55a51a941e80 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.831+0000 7fa620ff9640 1 -- 172.21.15.172:0/2795452230 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa630027020 con 0x55a51a941e80 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.831+0000 7fa64aa31740 10 client.6504 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.831+0000 7fa64aa31740 10 client.6504 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.831+0000 7fa64aa31740 20 client.6504 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.831+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55a51a9647d0 0x55a51a9603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.831+0000 7fa64aa31740 4 client.6504 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.831+0000 7fa64aa31740 1 -- 172.21.15.172:0/2795452230 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a51a88b340 con 0x55a51a9647d0 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.831+0000 7fa6459f6640 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55a51a9647d0 0x55a51a9603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.831+0000 7fa6459f6640 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55a51a9647d0 0x55a51a9603e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff33ea78d60189e3 server_cookie=af5dc8c3aedad415 in_seq=0 out_seq=0 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.831+0000 7fa620ff9640 10 client.6504 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa620ff9640 1 -- 172.21.15.172:0/2795452230 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a51a88b340 con 0x55a51a9647d0 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa620ff9640 10 client.6504 handle_command_reply: tid=0 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 client.6504 shutdown 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 -- 172.21.15.172:0/2795452230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a941e80 msgr2=0x55a51a962280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a941e80 0x55a51a962280 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa6300115a0 tx=0x7fa630011a60 comp rx=0 tx=0).stop 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 -- 172.21.15.172:0/2795452230 shutdown_connections 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a947320 0x55a51a940830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55a51a9647d0 0x55a51a9603e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a941e80 0x55a51a962280 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2795452230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941aa0 0x55a51a938f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 -- 172.21.15.172:0/2795452230 >> 172.21.15.172:0/2795452230 conn(0x55a51a914700 msgr2=0x55a51a940120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa620ff9640 0 client.6504 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:50.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 -- 172.21.15.172:0/2795452230 shutdown_connections 2024-04-25T08:45:50.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 1 -- 172.21.15.172:0/2795452230 wait complete. 2024-04-25T08:45:50.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.832+0000 7fa64aa31740 20 client.6504 trim_cache size 0 max 16384 2024-04-25T08:45:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.844+0000 7fa64aa31740 1 Processor -- start 2024-04-25T08:45:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.844+0000 7fa64aa31740 1 -- start start 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.844+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941aa0 0x55a51a9477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.844+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941e80 0x55a51a9158a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.844+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a940310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.844+0000 7fa64aa31740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa640200470 con 0x55a51a947320 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.844+0000 7fa64aa31740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6401ff650 con 0x55a51a941aa0 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.844+0000 7fa64aa31740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400ab300 con 0x55a51a941e80 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6461f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a940310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6461f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a940310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42286/0 (socket says 172.21.15.172:42286) 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6461f7640 1 -- 172.21.15.172:0/851138388 learned_addr learned my addr 172.21.15.172:0/851138388 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6451f5640 1 --2- 172.21.15.172:0/851138388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941e80 0x55a51a9158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6459f6640 1 --2- 172.21.15.172:0/851138388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941aa0 0x55a51a9477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6461f7640 1 -- 172.21.15.172:0/851138388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941e80 msgr2=0x55a51a9158a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6461f7640 1 --2- 172.21.15.172:0/851138388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941e80 0x55a51a9158a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6461f7640 1 -- 172.21.15.172:0/851138388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941aa0 msgr2=0x55a51a9477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6461f7640 1 --2- 172.21.15.172:0/851138388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941aa0 0x55a51a9477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6461f7640 1 -- 172.21.15.172:0/851138388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a51a960100 con 0x55a51a947320 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa6461f7640 1 --2- 172.21.15.172:0/851138388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a940310 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa638087ba0 tx=0x7fa638089070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69748b0e9eda521b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa622ffd640 1 -- 172.21.15.172:0/851138388 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63805b070 con 0x55a51a947320 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa622ffd640 1 -- 172.21.15.172:0/851138388 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63805e0c0 con 0x55a51a947320 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.845+0000 7fa622ffd640 1 -- 172.21.15.172:0/851138388 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63806f040 con 0x55a51a947320 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 -- 172.21.15.172:0/851138388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 msgr2=0x55a51a940310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 --2- 172.21.15.172:0/851138388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a940310 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa638087ba0 tx=0x7fa638089070 comp rx=0 tx=0).stop 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 -- 172.21.15.172:0/851138388 shutdown_connections 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 --2- 172.21.15.172:0/851138388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a940310 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 --2- 172.21.15.172:0/851138388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941e80 0x55a51a9158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 --2- 172.21.15.172:0/851138388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941aa0 0x55a51a9477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 -- 172.21.15.172:0/851138388 >> 172.21.15.172:0/851138388 conn(0x55a51a914700 msgr2=0x55a51a962fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 -- 172.21.15.172:0/851138388 shutdown_connections 2024-04-25T08:45:50.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 -- 172.21.15.172:0/851138388 wait complete. 2024-04-25T08:45:50.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 -- start start 2024-04-25T08:45:50.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.846+0000 7fa64aa31740 1 Processor -- start 2024-04-25T08:45:50.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941aa0 0x55a51a9bdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941e80 0x55a51a945180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa64aa31740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a9456c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa64aa31740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51a910690 con 0x55a51a947320 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa64aa31740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6401ff080 con 0x55a51a941e80 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa64aa31740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a51a803d70 con 0x55a51a941aa0 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa64aa31740 10 client.0 _ll_register_callbacks cb 0x7fa63c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa6461f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a9456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa6461f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a9456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42290/0 (socket says 172.21.15.172:42290) 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa6461f7640 1 -- 172.21.15.172:0/2976606814 learned_addr learned my addr 172.21.15.172:0/2976606814 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa6451f5640 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941e80 0x55a51a945180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.847+0000 7fa6459f6640 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941aa0 0x55a51a9bdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa6461f7640 1 -- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941aa0 msgr2=0x55a51a9bdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa6461f7640 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941aa0 0x55a51a9bdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa6461f7640 1 -- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941e80 msgr2=0x55a51a945180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa6461f7640 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941e80 0x55a51a945180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa6461f7640 1 -- 172.21.15.172:0/2976606814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a51a9553b0 con 0x55a51a947320 2024-04-25T08:45:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa6461f7640 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a9456c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa638057b50 tx=0x7fa63801e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e519409825607ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa620ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa620ff9640 1 -- 172.21.15.172:0/2976606814 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638074070 con 0x55a51a947320 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa620ff9640 1 -- 172.21.15.172:0/2976606814 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa63806fb30 con 0x55a51a947320 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa64aa31740 1 -- 172.21.15.172:0/2976606814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa63805e0c0 con 0x55a51a947320 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa620ff9640 1 -- 172.21.15.172:0/2976606814 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa63805b070 con 0x55a51a947320 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa64aa31740 10 client.6510 fetch_fsmap learned FSMap version 25 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa64aa31740 1 -- 172.21.15.172:0/2976606814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55a51a9ced50 con 0x55a51a947320 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa620ff9640 1 -- 172.21.15.172:0/2976606814 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63805e0c0 con 0x55a51a947320 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa620ff9640 1 -- 172.21.15.172:0/2976606814 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa6380572a0 con 0x55a51a947320 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa64aa31740 10 client.6510 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa64aa31740 10 client.6510 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa64aa31740 20 client.6510 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55a51a982810 0x55a51a978d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa64aa31740 4 client.6510 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-25T08:45:50.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa64aa31740 1 -- 172.21.15.172:0/2976606814 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a51a885690 con 0x55a51a982810 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.848+0000 7fa6459f6640 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55a51a982810 0x55a51a978d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa620ff9640 10 client.6510 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa6459f6640 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55a51a982810 0x55a51a978d40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9be6310e5ba70526 server_cookie=a1c401c58f9346b6 in_seq=0 out_seq=0 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa620ff9640 1 -- 172.21.15.172:0/2976606814 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x55a51a885690 con 0x55a51a982810 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa620ff9640 10 client.6510 handle_command_reply: tid=0 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 client.6510 shutdown 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 -- 172.21.15.172:0/2976606814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 msgr2=0x55a51a9456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a9456c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa638057b50 tx=0x7fa63801e070 comp rx=0 tx=0).stop 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 -- 172.21.15.172:0/2976606814 shutdown_connections 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a51a941e80 0x55a51a945180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55a51a982810 0x55a51a978d40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a51a947320 0x55a51a9456c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 --2- 172.21.15.172:0/2976606814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a51a941aa0 0x55a51a9bdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 -- 172.21.15.172:0/2976606814 >> 172.21.15.172:0/2976606814 conn(0x55a51a914700 msgr2=0x55a51a947780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa620ff9640 0 client.6510 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 -- 172.21.15.172:0/2976606814 shutdown_connections 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 1 -- 172.21.15.172:0/2976606814 wait complete. 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.849+0000 7fa64aa31740 20 client.6510 trim_cache size 0 max 16384 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stdout: "damage_type": "backtrace", 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 4279573707, 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 1099511630188, 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-04-25T08:45:50.847 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:45:50.848 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:45:50.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 -- 172.21.15.172:0/3877976388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa62406b500 msgr2=0x7fa62406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa62406b500 0x7fa62406d9c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa63c034000 tx=0x7fa63c02e000 comp rx=0 tx=0).stop 2024-04-25T08:45:50.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 -- 172.21.15.172:0/3877976388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa640161710 msgr2=0x7fa6400acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa640161710 0x7fa6400acd80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa63800c760 tx=0x7fa63800cc20 comp rx=0 tx=0).stop 2024-04-25T08:45:50.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 -- 172.21.15.172:0/3877976388 shutdown_connections 2024-04-25T08:45:50.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa62406b500 0x7fa62406d9c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa640161710 0x7fa6400acd80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa64015dc20 0x7fa6400caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 --2- 172.21.15.172:0/3877976388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6400b9330 0x7fa64015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 -- 172.21.15.172:0/3877976388 >> 172.21.15.172:0/3877976388 conn(0x7fa6400d0420 msgr2=0x7fa6400b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 -- 172.21.15.172:0/3877976388 shutdown_connections 2024-04-25T08:45:50.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.850+0000 7fa647c5a640 1 -- 172.21.15.172:0/3877976388 wait complete. 2024-04-25T08:45:50.852 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:50.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.958+0000 7f263de6f640 1 Processor -- start 2024-04-25T08:45:50.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.958+0000 7f263de6f640 1 -- start start 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.958+0000 7f263de6f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f263815dbe0 0x7f26380d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.958+0000 7f263de6f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f26380b92a0 0x7f26380d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.958+0000 7f263de6f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26380b97a0 con 0x7f26380b2cb0 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.958+0000 7f263de6f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263815dfc0 con 0x7f26380b92a0 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.958+0000 7f263de6f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26380d1a00 con 0x7f263815dbe0 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.959+0000 7f26377fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f263815dbe0 0x7f26380d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.959+0000 7f2637fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f26380b92a0 0x7f26380d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.959+0000 7f26377fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f263815dbe0 0x7f26380d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:40398/0 (socket says 172.21.15.172:40398) 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.959+0000 7f26377fe640 1 -- 172.21.15.172:0/480740761 learned_addr learned my addr 172.21.15.172:0/480740761 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.959+0000 7f26377fe640 1 -- 172.21.15.172:0/480740761 >> v2:172.21.15.186:3300/0 conn(0x7f26380b92a0 msgr2=0x7f26380d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.959+0000 7f26377fe640 1 --2- 172.21.15.172:0/480740761 >> v2:172.21.15.186:3300/0 conn(0x7f26380b92a0 0x7f26380d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.959+0000 7f26377fe640 1 -- 172.21.15.172:0/480740761 >> v1:172.21.15.186:6789/0 conn(0x7f26380b2cb0 legacy=0x7f26380b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.959+0000 7f26377fe640 1 -- 172.21.15.172:0/480740761 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26380d1c50 con 0x7f263815dbe0 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.960+0000 7f26377fe640 1 --2- 172.21.15.172:0/480740761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f263815dbe0 0x7f26380d0910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2628009870 tx=0x7f262802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d7d714a773ca168 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.960+0000 7f26367fc640 1 -- 172.21.15.172:0/480740761 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628037070 con 0x7f263815dbe0 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.960+0000 7f26367fc640 1 -- 172.21.15.172:0/480740761 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2628032440 con 0x7f263815dbe0 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.960+0000 7f26367fc640 1 -- 172.21.15.172:0/480740761 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628032810 con 0x7f263815dbe0 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.961+0000 7f263de6f640 1 -- 172.21.15.172:0/480740761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f263815dbe0 msgr2=0x7f26380d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.961+0000 7f263de6f640 1 --2- 172.21.15.172:0/480740761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f263815dbe0 0x7f26380d0910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2628009870 tx=0x7f262802a270 comp rx=0 tx=0).stop 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.961+0000 7f263de6f640 1 -- 172.21.15.172:0/480740761 shutdown_connections 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.961+0000 7f263de6f640 1 --2- 172.21.15.172:0/480740761 >> v2:172.21.15.186:3300/0 conn(0x7f26380b92a0 0x7f26380d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.961+0000 7f263de6f640 1 --2- 172.21.15.172:0/480740761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f263815dbe0 0x7f26380d0910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.961+0000 7f263de6f640 1 -- 172.21.15.172:0/480740761 >> 172.21.15.172:0/480740761 conn(0x7f2638061a20 msgr2=0x7f2638061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.961+0000 7f263de6f640 1 -- 172.21.15.172:0/480740761 shutdown_connections 2024-04-25T08:45:50.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.961+0000 7f263de6f640 1 -- 172.21.15.172:0/480740761 wait complete. 2024-04-25T08:45:50.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.962+0000 7f263de6f640 1 Processor -- start 2024-04-25T08:45:50.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.962+0000 7f263de6f640 1 -- start start 2024-04-25T08:45:50.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f263de6f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26380b2cb0 0x7f26380b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f263de6f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26380b92a0 0x7f26380caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f263de6f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f263815dbe0 0x7f26380caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f263de6f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26380b6ab0 con 0x7f26380b92a0 2024-04-25T08:45:50.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f263de6f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26380d2210 con 0x7f263815dbe0 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f263de6f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26380b6c30 con 0x7f26380b2cb0 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f2636ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26380b92a0 0x7f26380caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f2636ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26380b92a0 0x7f26380caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42296/0 (socket says 172.21.15.172:42296) 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f2636ffd640 1 -- 172.21.15.172:0/207188836 learned_addr learned my addr 172.21.15.172:0/207188836 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f26377fe640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26380b2cb0 0x7f26380b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f2637fff640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f263815dbe0 0x7f26380caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f2636ffd640 1 -- 172.21.15.172:0/207188836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26380b2cb0 msgr2=0x7f26380b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f2636ffd640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26380b2cb0 0x7f26380b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f2636ffd640 1 -- 172.21.15.172:0/207188836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f263815dbe0 msgr2=0x7f26380caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f2636ffd640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f263815dbe0 0x7f26380caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f2636ffd640 1 -- 172.21.15.172:0/207188836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26380cb660 con 0x7f26380b92a0 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f26377fe640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26380b2cb0 0x7f26380b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.963+0000 7f2636ffd640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26380b92a0 0x7f26380caa50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f262c00c400 tx=0x7f262c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.964+0000 7f261ffff640 1 -- 172.21.15.172:0/207188836 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c0052d0 con 0x7f26380b92a0 2024-04-25T08:45:50.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.964+0000 7f261ffff640 1 -- 172.21.15.172:0/207188836 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c005490 con 0x7f26380b92a0 2024-04-25T08:45:50.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.964+0000 7f263de6f640 1 -- 172.21.15.172:0/207188836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26380cb940 con 0x7f26380b92a0 2024-04-25T08:45:50.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.964+0000 7f261ffff640 1 -- 172.21.15.172:0/207188836 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c007260 con 0x7f26380b92a0 2024-04-25T08:45:50.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.964+0000 7f263de6f640 1 -- 172.21.15.172:0/207188836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26380cbf00 con 0x7f26380b92a0 2024-04-25T08:45:50.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.965+0000 7f263de6f640 1 -- 172.21.15.172:0/207188836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2638073990 con 0x7f26380b92a0 2024-04-25T08:45:50.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.965+0000 7f261ffff640 1 -- 172.21.15.172:0/207188836 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f262c007400 con 0x7f26380b92a0 2024-04-25T08:45:50.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.965+0000 7f261ffff640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262406b4d0 0x7f262406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:50.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.965+0000 7f261ffff640 1 -- 172.21.15.172:0/207188836 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f262c089820 con 0x7f26380b92a0 2024-04-25T08:45:50.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.966+0000 7f26377fe640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262406b4d0 0x7f262406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:50.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.966+0000 7f26377fe640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262406b4d0 0x7f262406d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2628034000 tx=0x7f262802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:50.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:50.970+0000 7f261ffff640 1 -- 172.21.15.172:0/207188836 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f262c057eb0 con 0x7f26380b92a0 2024-04-25T08:45:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.177+0000 7f263de6f640 1 -- 172.21.15.172:0/207188836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26380d2e90 con 0x7f26380b92a0 2024-04-25T08:45:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.178+0000 7f261ffff640 1 -- 172.21.15.172:0/207188836 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f262c05bf50 con 0x7f26380b92a0 2024-04-25T08:45:51.170 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:51.170 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:46.835802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 25 2024-04-25T08:45:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 -- 172.21.15.172:0/207188836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262406b4d0 msgr2=0x7f262406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262406b4d0 0x7f262406d990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2628034000 tx=0x7f262802e000 comp rx=0 tx=0).stop 2024-04-25T08:45:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 -- 172.21.15.172:0/207188836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26380b92a0 msgr2=0x7f26380caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26380b92a0 0x7f26380caa50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f262c00c400 tx=0x7f262c00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 -- 172.21.15.172:0/207188836 shutdown_connections 2024-04-25T08:45:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f262406b4d0 0x7f262406d990 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f263815dbe0 0x7f26380caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26380b92a0 0x7f26380caa50 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 --2- 172.21.15.172:0/207188836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26380b2cb0 0x7f26380b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 -- 172.21.15.172:0/207188836 >> 172.21.15.172:0/207188836 conn(0x7f2638061a20 msgr2=0x7f2638061e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 -- 172.21.15.172:0/207188836 shutdown_connections 2024-04-25T08:45:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.180+0000 7f263de6f640 1 -- 172.21.15.172:0/207188836 wait complete. 2024-04-25T08:45:51.183 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d damage rm 4279573707 2024-04-25T08:45:51.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.291+0000 7fc316d89640 1 Processor -- start 2024-04-25T08:45:51.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.291+0000 7fc316d89640 1 -- start start 2024-04-25T08:45:51.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc316d89640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc3100cf640 0x7fc31006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc316d89640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3100ac8b0 0x7fc3100acd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc316d89640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3100cfad0 con 0x7fc31015b710 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc316d89640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31006f190 con 0x7fc3100ac8b0 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc316d89640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31015e490 con 0x7fc3100cf640 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc315326640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3100ac8b0 0x7fc3100acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc315326640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3100ac8b0 0x7fc3100acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42304/0 (socket says 172.21.15.172:42304) 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc315326640 1 -- 172.21.15.172:0/2380291894 learned_addr learned my addr 172.21.15.172:0/2380291894 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc307fff640 1 --2- 172.21.15.172:0/2380291894 >> v2:172.21.15.186:3300/0 conn(0x7fc3100cf640 0x7fc31006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc315326640 1 -- 172.21.15.172:0/2380291894 >> v2:172.21.15.186:3300/0 conn(0x7fc3100cf640 msgr2=0x7fc31006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc315326640 1 --2- 172.21.15.172:0/2380291894 >> v2:172.21.15.186:3300/0 conn(0x7fc3100cf640 0x7fc31006ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc315326640 1 -- 172.21.15.172:0/2380291894 >> v1:172.21.15.186:6789/0 conn(0x7fc31015b710 legacy=0x7fc31015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.292+0000 7fc315326640 1 -- 172.21.15.172:0/2380291894 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100cfd80 con 0x7fc3100ac8b0 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.293+0000 7fc315326640 1 --2- 172.21.15.172:0/2380291894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3100ac8b0 0x7fc3100acd00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc31006ba10 tx=0x7fc30802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70f707ef10ade63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.293+0000 7fc3077fe640 1 -- 172.21.15.172:0/2380291894 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308036070 con 0x7fc3100ac8b0 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.293+0000 7fc3077fe640 1 -- 172.21.15.172:0/2380291894 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc308031600 con 0x7fc3100ac8b0 2024-04-25T08:45:51.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.293+0000 7fc3077fe640 1 -- 172.21.15.172:0/2380291894 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080319d0 con 0x7fc3100ac8b0 2024-04-25T08:45:51.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.293+0000 7fc316d89640 1 -- 172.21.15.172:0/2380291894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3100ac8b0 msgr2=0x7fc3100acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.293+0000 7fc316d89640 1 --2- 172.21.15.172:0/2380291894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3100ac8b0 0x7fc3100acd00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc31006ba10 tx=0x7fc30802a730 comp rx=0 tx=0).stop 2024-04-25T08:45:51.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.294+0000 7fc316d89640 1 -- 172.21.15.172:0/2380291894 shutdown_connections 2024-04-25T08:45:51.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.294+0000 7fc316d89640 1 --2- 172.21.15.172:0/2380291894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3100ac8b0 0x7fc3100acd00 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.294+0000 7fc316d89640 1 --2- 172.21.15.172:0/2380291894 >> v2:172.21.15.186:3300/0 conn(0x7fc3100cf640 0x7fc31006ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.294+0000 7fc316d89640 1 -- 172.21.15.172:0/2380291894 >> 172.21.15.172:0/2380291894 conn(0x7fc31006abe0 msgr2=0x7fc31006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:51.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.294+0000 7fc316d89640 1 -- 172.21.15.172:0/2380291894 shutdown_connections 2024-04-25T08:45:51.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.294+0000 7fc316d89640 1 -- 172.21.15.172:0/2380291894 wait complete. 2024-04-25T08:45:51.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.295+0000 7fc316d89640 1 Processor -- start 2024-04-25T08:45:51.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.295+0000 7fc316d89640 1 -- start start 2024-04-25T08:45:51.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc316d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3100ac8b0 0x7fc310147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc316d89640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3100cf640 0x7fc3100c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc316d89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc31015b710 0x7fc3100c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc316d89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31015baf0 con 0x7fc31015b710 2024-04-25T08:45:51.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc316d89640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100d0340 con 0x7fc3100cf640 2024-04-25T08:45:51.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc316d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31015bc70 con 0x7fc3100ac8b0 2024-04-25T08:45:51.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc315326640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc31015b710 0x7fc3100c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc315326640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc31015b710 0x7fc3100c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42318/0 (socket says 172.21.15.172:42318) 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc315326640 1 -- 172.21.15.172:0/991438632 learned_addr learned my addr 172.21.15.172:0/991438632 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc314b25640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3100ac8b0 0x7fc310147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc307fff640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3100cf640 0x7fc3100c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc315326640 1 -- 172.21.15.172:0/991438632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3100ac8b0 msgr2=0x7fc310147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc315326640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3100ac8b0 0x7fc310147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc315326640 1 -- 172.21.15.172:0/991438632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3100cf640 msgr2=0x7fc3100c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc315326640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3100cf640 0x7fc3100c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc315326640 1 -- 172.21.15.172:0/991438632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310149af0 con 0x7fc31015b710 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc315326640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc31015b710 0x7fc3100c4c10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc308009f40 tx=0x7fc308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc3057fa640 1 -- 172.21.15.172:0/991438632 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308036050 con 0x7fc31015b710 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc3057fa640 1 -- 172.21.15.172:0/991438632 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc308042070 con 0x7fc31015b710 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc316d89640 1 -- 172.21.15.172:0/991438632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31014b5d0 con 0x7fc31015b710 2024-04-25T08:45:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc3057fa640 1 -- 172.21.15.172:0/991438632 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308009510 con 0x7fc31015b710 2024-04-25T08:45:51.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.296+0000 7fc316d89640 1 -- 172.21.15.172:0/991438632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31014bb90 con 0x7fc31015b710 2024-04-25T08:45:51.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.298+0000 7fc3057fa640 1 -- 172.21.15.172:0/991438632 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc308007bd0 con 0x7fc31015b710 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.298+0000 7fc3057fa640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc2fc06b4d0 0x7fc2fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.298+0000 7fc3057fa640 1 -- 172.21.15.172:0/991438632 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc3080ab150 con 0x7fc31015b710 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.298+0000 7fc314b25640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc2fc06b4d0 0x7fc2fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.299+0000 7fc314b25640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc2fc06b4d0 0x7fc2fc06d990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc30c000f60 tx=0x7fc30c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.299+0000 7fc319b6c740 1 Processor -- start 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.299+0000 7fc319b6c740 1 -- start start 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 0x55f8f4e53790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e51360 0x55f8f4e53cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e23be0 0x55f8f4e273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc319b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f4d8cac0 con 0x55f8f4e23be0 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc319b6c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f4d35db0 con 0x55f8f4e50f80 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc319b6c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8f4d88b60 con 0x55f8f4e51360 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc315326640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e23be0 0x55f8f4e273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc315326640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e23be0 0x55f8f4e273f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42320/0 (socket says 172.21.15.172:42320) 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc315326640 1 -- 172.21.15.172:0/2547653886 learned_addr learned my addr 172.21.15.172:0/2547653886 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc315326640 1 -- 172.21.15.172:0/2547653886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e51360 msgr2=0x55f8f4e53cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc307fff640 1 --2- 172.21.15.172:0/2547653886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e51360 0x55f8f4e53cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc315326640 1 --2- 172.21.15.172:0/2547653886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e51360 0x55f8f4e53cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc315326640 1 -- 172.21.15.172:0/2547653886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 msgr2=0x55f8f4e53790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc314b25640 1 --2- 172.21.15.172:0/2547653886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 0x55f8f4e53790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc315326640 1 --2- 172.21.15.172:0/2547653886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 0x55f8f4e53790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc315326640 1 -- 172.21.15.172:0/2547653886 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8f4b6d710 con 0x55f8f4e23be0 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.300+0000 7fc315326640 1 --2- 172.21.15.172:0/2547653886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e23be0 0x55f8f4e273f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc3080819b0 tx=0x7fc308079310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b373ef2232fadc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc2f67fc640 1 -- 172.21.15.172:0/2547653886 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308045360 con 0x55f8f4e23be0 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc2f67fc640 1 -- 172.21.15.172:0/2547653886 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc308037040 con 0x55f8f4e23be0 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc2f67fc640 1 -- 172.21.15.172:0/2547653886 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308079ed0 con 0x55f8f4e23be0 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc319b6c740 1 -- 172.21.15.172:0/2547653886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e23be0 msgr2=0x55f8f4e273f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc319b6c740 1 --2- 172.21.15.172:0/2547653886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e23be0 0x55f8f4e273f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc3080819b0 tx=0x7fc308079310 comp rx=0 tx=0).stop 2024-04-25T08:45:51.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc319b6c740 1 -- 172.21.15.172:0/2547653886 shutdown_connections 2024-04-25T08:45:51.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc319b6c740 1 --2- 172.21.15.172:0/2547653886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e23be0 0x55f8f4e273f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc319b6c740 1 --2- 172.21.15.172:0/2547653886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e51360 0x55f8f4e53cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc319b6c740 1 --2- 172.21.15.172:0/2547653886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 0x55f8f4e53790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc319b6c740 1 -- 172.21.15.172:0/2547653886 >> 172.21.15.172:0/2547653886 conn(0x55f8f4e25e50 msgr2=0x55f8f4e6e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:51.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc319b6c740 1 -- 172.21.15.172:0/2547653886 shutdown_connections 2024-04-25T08:45:51.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.301+0000 7fc319b6c740 1 -- 172.21.15.172:0/2547653886 wait complete. 2024-04-25T08:45:51.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.302+0000 7fc319b6c740 1 -- start start 2024-04-25T08:45:51.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.302+0000 7fc319b6c740 1 Processor -- start 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e50f80 0x55f8f4e47970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e51360 0x55f8f4e718f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e6d1f0 0x55f8f4e6d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc319b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f4d8cac0 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc319b6c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f4d2b4e0 con 0x55f8f4e51360 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc319b6c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8f4e29000 con 0x55f8f4e50f80 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc319b6c740 10 client.0 _ll_register_callbacks cb 0x55f8f4aa0af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc315326640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e6d1f0 0x55f8f4e6d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc315326640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e6d1f0 0x55f8f4e6d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42326/0 (socket says 172.21.15.172:42326) 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc315326640 1 -- 172.21.15.172:0/1801366245 learned_addr learned my addr 172.21.15.172:0/1801366245 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc315326640 1 -- 172.21.15.172:0/1801366245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e50f80 msgr2=0x55f8f4e47970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc315326640 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e50f80 0x55f8f4e47970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc315326640 1 -- 172.21.15.172:0/1801366245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e51360 msgr2=0x55f8f4e718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:51.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc315326640 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e51360 0x55f8f4e718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc315326640 1 -- 172.21.15.172:0/1801366245 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8f4bcdea0 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc315326640 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e6d1f0 0x55f8f4e6d670 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc3080073c0 tx=0x7fc308009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a9e5563f78fb55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc2ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/1801366245 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080a6070 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/1801366245 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc308078c20 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc319b6c740 1 -- 172.21.15.172:0/1801366245 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc308037040 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.303+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/1801366245 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc308045360 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc319b6c740 10 client.6525 fetch_fsmap learned FSMap version 25 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc319b6c740 1 -- 172.21.15.172:0/1801366245 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55f8f4a61000 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/1801366245 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc308037040 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/1801366245 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc308098190 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc319b6c740 10 client.6525 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc319b6c740 10 client.6525 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:45:51.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc319b6c740 20 client.6525 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc319b6c740 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55f8f4e49780 0x55f8f4e49b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc319b6c740 4 client.6525 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc319b6c740 1 -- 172.21.15.172:0/1801366245 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8f4d9a000 con 0x55f8f4e49780 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc314b25640 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55f8f4e49780 0x55f8f4e49b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc2ef7fe640 10 client.6525 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.304+0000 7fc314b25640 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55f8f4e49780 0x55f8f4e49b60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a92b19caf4ab1065 server_cookie=a19e87ccd7539995 in_seq=0 out_seq=0 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/1801366245 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f8f4d9a000 con 0x55f8f4e49780 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc2ef7fe640 10 client.6525 handle_command_reply: tid=0 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 client.6525 shutdown 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 -- 172.21.15.172:0/1801366245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e6d1f0 msgr2=0x55f8f4e6d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e6d1f0 0x55f8f4e6d670 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc3080073c0 tx=0x7fc308009810 comp rx=0 tx=0).stop 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 -- 172.21.15.172:0/1801366245 shutdown_connections 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e51360 0x55f8f4e718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55f8f4e49780 0x55f8f4e49b60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e6d1f0 0x55f8f4e6d670 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 --2- 172.21.15.172:0/1801366245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e50f80 0x55f8f4e47970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc2ef7fe640 0 client.6525 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:51.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 -- 172.21.15.172:0/1801366245 >> 172.21.15.172:0/1801366245 conn(0x55f8f4e23be0 msgr2=0x55f8f4e53e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:51.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 -- 172.21.15.172:0/1801366245 shutdown_connections 2024-04-25T08:45:51.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 1 -- 172.21.15.172:0/1801366245 wait complete. 2024-04-25T08:45:51.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.305+0000 7fc319b6c740 20 client.6525 trim_cache size 0 max 16384 2024-04-25T08:45:51.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.317+0000 7fc319b6c740 1 Processor -- start 2024-04-25T08:45:51.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.317+0000 7fc319b6c740 1 -- start start 2024-04-25T08:45:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e50f80 0x55f8f4e6e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e51360 0x55f8f4e6eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e6d1f0 0x55f8f4e46640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc319b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3101ff830 con 0x55f8f4e50f80 2024-04-25T08:45:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc319b6c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31014d100 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc319b6c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3101ff230 con 0x55f8f4e51360 2024-04-25T08:45:51.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc314b25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e50f80 0x55f8f4e6e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc314b25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e50f80 0x55f8f4e6e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42338/0 (socket says 172.21.15.172:42338) 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc314b25640 1 -- 172.21.15.172:0/3458312683 learned_addr learned my addr 172.21.15.172:0/3458312683 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc314b25640 1 -- 172.21.15.172:0/3458312683 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e51360 msgr2=0x55f8f4e6eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc314b25640 1 --2- 172.21.15.172:0/3458312683 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e51360 0x55f8f4e6eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc314b25640 1 -- 172.21.15.172:0/3458312683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e6d1f0 msgr2=0x55f8f4e46640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc314b25640 1 --2- 172.21.15.172:0/3458312683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e6d1f0 0x55f8f4e46640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc314b25640 1 -- 172.21.15.172:0/3458312683 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8f4d129f0 con 0x55f8f4e50f80 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc314b25640 1 --2- 172.21.15.172:0/3458312683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e50f80 0x55f8f4e6e980 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc30c001e60 tx=0x7fc30c017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fae8c099a1e0b74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc2f5ffb640 1 -- 172.21.15.172:0/3458312683 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0223a0 con 0x55f8f4e50f80 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.318+0000 7fc2f5ffb640 1 -- 172.21.15.172:0/3458312683 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c027020 con 0x55f8f4e50f80 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.319+0000 7fc2f5ffb640 1 -- 172.21.15.172:0/3458312683 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c022540 con 0x55f8f4e50f80 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.319+0000 7fc319b6c740 1 -- 172.21.15.172:0/3458312683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e50f80 msgr2=0x55f8f4e6e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.319+0000 7fc319b6c740 1 --2- 172.21.15.172:0/3458312683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e50f80 0x55f8f4e6e980 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc30c001e60 tx=0x7fc30c017040 comp rx=0 tx=0).stop 2024-04-25T08:45:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.319+0000 7fc319b6c740 1 -- 172.21.15.172:0/3458312683 shutdown_connections 2024-04-25T08:45:51.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.319+0000 7fc319b6c740 1 --2- 172.21.15.172:0/3458312683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e6d1f0 0x55f8f4e46640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.319+0000 7fc319b6c740 1 --2- 172.21.15.172:0/3458312683 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e51360 0x55f8f4e6eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.319+0000 7fc319b6c740 1 --2- 172.21.15.172:0/3458312683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e50f80 0x55f8f4e6e980 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.319+0000 7fc319b6c740 1 -- 172.21.15.172:0/3458312683 >> 172.21.15.172:0/3458312683 conn(0x55f8f4e23be0 msgr2=0x55f8f4e292e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:51.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.319+0000 7fc319b6c740 1 -- 172.21.15.172:0/3458312683 shutdown_connections 2024-04-25T08:45:51.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.319+0000 7fc319b6c740 1 -- 172.21.15.172:0/3458312683 wait complete. 2024-04-25T08:45:51.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.320+0000 7fc319b6c740 1 -- start start 2024-04-25T08:45:51.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.320+0000 7fc319b6c740 1 Processor -- start 2024-04-25T08:45:51.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.320+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 0x55f8f4e64120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.320+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e51360 0x55f8f4ed8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc319b6c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e6d1f0 0x55f8f4e56670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc319b6c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f4d8cac0 con 0x55f8f4e51360 2024-04-25T08:45:51.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc319b6c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8f4d2b4e0 con 0x55f8f4e50f80 2024-04-25T08:45:51.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc319b6c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8f4e71e30 con 0x55f8f4e6d1f0 2024-04-25T08:45:51.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc319b6c740 10 client.0 _ll_register_callbacks cb 0x7fc308007310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc307fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e51360 0x55f8f4ed8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc307fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e51360 0x55f8f4ed8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42352/0 (socket says 172.21.15.172:42352) 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc307fff640 1 -- 172.21.15.172:0/4294322318 learned_addr learned my addr 172.21.15.172:0/4294322318 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc314b25640 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 0x55f8f4e64120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc315326640 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e6d1f0 0x55f8f4e56670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc307fff640 1 -- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e6d1f0 msgr2=0x55f8f4e56670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc307fff640 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e6d1f0 0x55f8f4e56670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc307fff640 1 -- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 msgr2=0x55f8f4e64120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc307fff640 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 0x55f8f4e64120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc307fff640 1 -- 172.21.15.172:0/4294322318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8f4e28510 con 0x55f8f4e51360 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc314b25640 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 0x55f8f4e64120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc315326640 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e6d1f0 0x55f8f4e56670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc307fff640 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e51360 0x55f8f4ed8220 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc30000edc0 tx=0x7fc3000105c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbe841402a8c7e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc2ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/4294322318 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300018070 con 0x55f8f4e51360 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/4294322318 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc300004230 con 0x55f8f4e51360 2024-04-25T08:45:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc319b6c740 1 -- 172.21.15.172:0/4294322318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc30c027020 con 0x55f8f4e51360 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/4294322318 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc300023050 con 0x55f8f4e51360 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc319b6c740 10 client.6531 fetch_fsmap learned FSMap version 25 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc319b6c740 1 -- 172.21.15.172:0/4294322318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55f8f4ed8c40 con 0x55f8f4e51360 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.321+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/4294322318 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c027020 con 0x55f8f4e51360 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/4294322318 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc300026020 con 0x55f8f4e51360 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc319b6c740 10 client.6531 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc319b6c740 10 client.6531 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc319b6c740 20 client.6531 populate_metadata read hostname 'smithi172' 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc319b6c740 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55f8f4e6c5b0 0x55f8f4e87500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc319b6c740 4 client.6531 mds_command: new command op to 5877 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 4279573707}] 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc319b6c740 1 -- 172.21.15.172:0/4294322318 --> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] -- command(tid 0: {"prefix": "damage rm", "damage_id": 4279573707}) v1 -- 0x55f8f4e4b210 con 0x55f8f4e6c5b0 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc314b25640 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55f8f4e6c5b0 0x55f8f4e87500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc2ef7fe640 10 client.6531 ms_handle_connect on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc314b25640 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55f8f4e6c5b0 0x55f8f4e87500 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e09497d774aaa1a5 server_cookie=9ec531d2cd81ce65 in_seq=0 out_seq=0 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc2ef7fe640 1 -- 172.21.15.172:0/4294322318 <== mds.0 v2:172.21.15.186:6833/3075611853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x55f8f4e4b210 con 0x55f8f4e6c5b0 2024-04-25T08:45:51.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc2ef7fe640 10 client.6531 handle_command_reply: tid=0 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.322+0000 7fc319b6c740 1 client.6531 shutdown 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 1 -- 172.21.15.172:0/4294322318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e51360 msgr2=0x55f8f4ed8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e51360 0x55f8f4ed8220 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc30000edc0 tx=0x7fc3000105c0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 1 -- 172.21.15.172:0/4294322318 shutdown_connections 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:6833/3075611853,v1:172.21.15.186:6835/3075611853] conn(0x55f8f4e6c5b0 0x55f8f4e87500 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f8f4e6d1f0 0x55f8f4e56670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8f4e51360 0x55f8f4ed8220 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc2ef7fe640 0 client.6531 ms_handle_reset on v2:172.21.15.186:6833/3075611853 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 1 --2- 172.21.15.172:0/4294322318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f8f4e50f80 0x55f8f4e64120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 1 -- 172.21.15.172:0/4294322318 >> 172.21.15.172:0/4294322318 conn(0x55f8f4e23be0 msgr2=0x55f8f4e72010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 1 -- 172.21.15.172:0/4294322318 shutdown_connections 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 1 -- 172.21.15.172:0/4294322318 wait complete. 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc319b6c740 20 client.6531 trim_cache size 0 max 16384 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 -- 172.21.15.172:0/991438632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc2fc06b4d0 msgr2=0x7fc2fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc2fc06b4d0 0x7fc2fc06d990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc30c000f60 tx=0x7fc30c009040 comp rx=0 tx=0).stop 2024-04-25T08:45:51.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 -- 172.21.15.172:0/991438632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc31015b710 msgr2=0x7fc3100c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc31015b710 0x7fc3100c4c10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc308009f40 tx=0x7fc308004a40 comp rx=0 tx=0).stop 2024-04-25T08:45:51.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 -- 172.21.15.172:0/991438632 shutdown_connections 2024-04-25T08:45:51.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc2fc06b4d0 0x7fc2fc06d990 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3100cf640 0x7fc3100c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc31015b710 0x7fc3100c4c10 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 --2- 172.21.15.172:0/991438632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3100ac8b0 0x7fc310147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 -- 172.21.15.172:0/991438632 >> 172.21.15.172:0/991438632 conn(0x7fc31006abe0 msgr2=0x7fc31015c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:51.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 -- 172.21.15.172:0/991438632 shutdown_connections 2024-04-25T08:45:51.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.323+0000 7fc316d89640 1 -- 172.21.15.172:0/991438632 wait complete. 2024-04-25T08:45:51.326 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-04-25T08:45:51.326 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:51.374 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:45:51.382+0000 7f9415334640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T08:45:51.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.434+0000 7f8344d09640 1 Processor -- start 2024-04-25T08:45:51.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.434+0000 7f8344d09640 1 -- start start 2024-04-25T08:45:51.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f8344d09640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 0x7f83400aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f8344d09640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8340071ac0 0x7f83400ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f8344d09640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834015ec60 con 0x7f834006c1d0 2024-04-25T08:45:51.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f8344d09640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834015ef40 con 0x7f8340071ac0 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f8344d09640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834006db90 con 0x7f8340154ed0 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f833dd9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8340071ac0 0x7f83400ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f833dd9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8340071ac0 0x7f83400ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42366/0 (socket says 172.21.15.172:42366) 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f833dd9b640 1 -- 172.21.15.172:0/1745934259 learned_addr learned my addr 172.21.15.172:0/1745934259 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f833e59c640 1 --2- 172.21.15.172:0/1745934259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 0x7f83400aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f833dd9b640 1 -- 172.21.15.172:0/1745934259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 msgr2=0x7f83400aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f833dd9b640 1 --2- 172.21.15.172:0/1745934259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 0x7f83400aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f833dd9b640 1 -- 172.21.15.172:0/1745934259 >> v1:172.21.15.186:6789/0 conn(0x7f834006c1d0 legacy=0x7f83401617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.435+0000 7f833dd9b640 1 -- 172.21.15.172:0/1745934259 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834006de70 con 0x7f8340071ac0 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.436+0000 7f833dd9b640 1 --2- 172.21.15.172:0/1745934259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 0x7f83400ad410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f8334009870 tx=0x7f833402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731b896cdd4a3ed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.436+0000 7f833d59a640 1 -- 172.21.15.172:0/1745934259 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334037070 con 0x7f8340071ac0 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.436+0000 7f833d59a640 1 -- 172.21.15.172:0/1745934259 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8334032440 con 0x7f8340071ac0 2024-04-25T08:45:51.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.436+0000 7f833d59a640 1 -- 172.21.15.172:0/1745934259 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334032810 con 0x7f8340071ac0 2024-04-25T08:45:51.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.436+0000 7f8344d09640 1 -- 172.21.15.172:0/1745934259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 msgr2=0x7f83400ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.436+0000 7f8344d09640 1 --2- 172.21.15.172:0/1745934259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 0x7f83400ad410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f8334009870 tx=0x7f833402a270 comp rx=0 tx=0).stop 2024-04-25T08:45:51.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.437+0000 7f8344d09640 1 -- 172.21.15.172:0/1745934259 shutdown_connections 2024-04-25T08:45:51.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.437+0000 7f8344d09640 1 --2- 172.21.15.172:0/1745934259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 0x7f83400ad410 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.437+0000 7f8344d09640 1 --2- 172.21.15.172:0/1745934259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 0x7f83400aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.437+0000 7f8344d09640 1 -- 172.21.15.172:0/1745934259 >> 172.21.15.172:0/1745934259 conn(0x7f83400af670 msgr2=0x7f83400b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:51.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.437+0000 7f8344d09640 1 -- 172.21.15.172:0/1745934259 shutdown_connections 2024-04-25T08:45:51.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.437+0000 7f8344d09640 1 -- 172.21.15.172:0/1745934259 wait complete. 2024-04-25T08:45:51.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.438+0000 7f8344d09640 1 Processor -- start 2024-04-25T08:45:51.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.438+0000 7f8344d09640 1 -- start start 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f8344d09640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 0x7f83400cf310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f8344d09640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 0x7f8340150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f8344d09640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83401510f0 0x7f8340152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f8344d09640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400add20 con 0x7f8340071ac0 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f8344d09640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400adba0 con 0x7f83401510f0 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f8344d09640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8340161ee0 con 0x7f8340154ed0 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 0x7f83400cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 0x7f83400cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42374/0 (socket says 172.21.15.172:42374) 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833e59c640 1 -- 172.21.15.172:0/1864253153 learned_addr learned my addr 172.21.15.172:0/1864253153 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833ed9d640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83401510f0 0x7f8340152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833dd9b640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 0x7f8340150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833e59c640 1 -- 172.21.15.172:0/1864253153 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 msgr2=0x7f8340150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833e59c640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 0x7f8340150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833e59c640 1 -- 172.21.15.172:0/1864253153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83401510f0 msgr2=0x7f8340152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833e59c640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83401510f0 0x7f8340152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833e59c640 1 -- 172.21.15.172:0/1864253153 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83401515b0 con 0x7f8340071ac0 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833ed9d640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83401510f0 0x7f8340152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833dd9b640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 0x7f8340150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f833e59c640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 0x7f83400cf310 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f833000d5f0 tx=0x7f833000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f832effd640 1 -- 172.21.15.172:0/1864253153 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300125f0 con 0x7f8340071ac0 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f832effd640 1 -- 172.21.15.172:0/1864253153 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8330019070 con 0x7f8340071ac0 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f8344d09640 1 -- 172.21.15.172:0/1864253153 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8340153ad0 con 0x7f8340071ac0 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f832effd640 1 -- 172.21.15.172:0/1864253153 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300129d0 con 0x7f8340071ac0 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.439+0000 7f8344d09640 1 -- 172.21.15.172:0/1864253153 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83401545b0 con 0x7f8340071ac0 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.440+0000 7f8344d09640 1 -- 172.21.15.172:0/1864253153 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83400b2b10 con 0x7f8340071ac0 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.441+0000 7f832effd640 1 -- 172.21.15.172:0/1864253153 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8330012b70 con 0x7f8340071ac0 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.441+0000 7f832effd640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b4d0 0x7f832006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:51.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.441+0000 7f832effd640 1 -- 172.21.15.172:0/1864253153 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f833008a710 con 0x7f8340071ac0 2024-04-25T08:45:51.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.441+0000 7f833dd9b640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b4d0 0x7f832006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:51.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.442+0000 7f833dd9b640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b4d0 0x7f832006d990 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8334034000 tx=0x7f833402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:51.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.445+0000 7f832effd640 1 -- 172.21.15.172:0/1864253153 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8330059490 con 0x7f8340071ac0 2024-04-25T08:45:51.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.651+0000 7f8344d09640 1 -- 172.21.15.172:0/1864253153 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8340073990 con 0x7f8340071ac0 2024-04-25T08:45:51.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.651+0000 7f832effd640 1 -- 172.21.15.172:0/1864253153 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f8330058d90 con 0x7f8340071ac0 2024-04-25T08:45:51.643 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:51.643 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:50.836733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:51.643 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 26 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 -- 172.21.15.172:0/1864253153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b4d0 msgr2=0x7f832006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b4d0 0x7f832006d990 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8334034000 tx=0x7f833402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 -- 172.21.15.172:0/1864253153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 msgr2=0x7f83400cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 0x7f83400cf310 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f833000d5f0 tx=0x7f833000dab0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 -- 172.21.15.172:0/1864253153 shutdown_connections 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b4d0 0x7f832006d990 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83401510f0 0x7f8340152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8340154ed0 0x7f8340150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 --2- 172.21.15.172:0/1864253153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8340071ac0 0x7f83400cf310 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 -- 172.21.15.172:0/1864253153 >> 172.21.15.172:0/1864253153 conn(0x7f834006c1d0 msgr2=0x7f834015f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:51.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 -- 172.21.15.172:0/1864253153 shutdown_connections 2024-04-25T08:45:51.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:51.653+0000 7f8344d09640 1 -- 172.21.15.172:0/1864253153 wait complete. 2024-04-25T08:45:51.655 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok flush_path / 2024-04-25T08:45:51.771 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T08:45:51.771 INFO:teuthology.orchestra.run.smithi186.stdout: "return_code": 0 2024-04-25T08:45:51.771 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T08:45:51.781 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2024-04-25T08:45:51.781 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:45:51.781 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:45:51.838 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:45:51.888 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:45:51.889 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:51.889 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:51.904 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:51.904 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:51.959 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:52.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.104+0000 7f0bd55be640 1 Processor -- start 2024-04-25T08:45:52.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.104+0000 7f0bd55be640 1 -- start start 2024-04-25T08:45:52.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.105+0000 7f0bd55be640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd00b2e80 0x7f0bd006d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.105+0000 7f0bd55be640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0bd006df30 0x7f0bd00b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.105+0000 7f0bd55be640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd00b3d70 con 0x7f0bd015a810 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.105+0000 7f0bd55be640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00ae2e0 con 0x7f0bd006df30 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.105+0000 7f0bd55be640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00ae5c0 con 0x7f0bd00b2e80 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd00b2e80 0x7f0bd006d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bcf7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0bd006df30 0x7f0bd00b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bceffd640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f0bd015a810 0x7f0bd00af0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41336/0 (socket says 172.21.15.172:41336) 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bceffd640 1 -- 172.21.15.172:0/2776282362 learned_addr learned my addr 172.21.15.172:0/2776282362 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bcdffb640 1 -- 172.21.15.172:0/2776282362 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700914781 0 0) 0x7f0bc0001490 con 0x7f0bd015a810 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bcdffb640 1 -- 172.21.15.172:0/2776282362 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb8003520 con 0x7f0bd015a810 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bce7fc640 1 -- 172.21.15.172:0/2776282362 >> v2:172.21.15.186:3300/0 conn(0x7f0bd006df30 msgr2=0x7f0bd00b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bce7fc640 1 --2- 172.21.15.172:0/2776282362 >> v2:172.21.15.186:3300/0 conn(0x7f0bd006df30 0x7f0bd00b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bce7fc640 1 -- 172.21.15.172:0/2776282362 >> v1:172.21.15.186:6789/0 conn(0x7f0bd015a810 legacy=0x7f0bd00af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bce7fc640 1 -- 172.21.15.172:0/2776282362 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd00ae8a0 con 0x7f0bd00b2e80 2024-04-25T08:45:52.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.106+0000 7f0bcf7fe640 1 --2- 172.21.15.172:0/2776282362 >> v2:172.21.15.186:3300/0 conn(0x7f0bd006df30 0x7f0bd00b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bce7fc640 1 --2- 172.21.15.172:0/2776282362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd00b2e80 0x7f0bd006d9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40097a0 tx=0x7f0bc402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada7bd8288794e8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bcdffb640 1 -- 172.21.15.172:0/2776282362 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4037070 con 0x7f0bd00b2e80 2024-04-25T08:45:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bcdffb640 1 -- 172.21.15.172:0/2776282362 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc4032440 con 0x7f0bd00b2e80 2024-04-25T08:45:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bcdffb640 1 -- 172.21.15.172:0/2776282362 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40327f0 con 0x7f0bd00b2e80 2024-04-25T08:45:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bd55be640 1 -- 172.21.15.172:0/2776282362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd00b2e80 msgr2=0x7f0bd006d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bd55be640 1 --2- 172.21.15.172:0/2776282362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd00b2e80 0x7f0bd006d9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40097a0 tx=0x7f0bc402a180 comp rx=0 tx=0).stop 2024-04-25T08:45:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bd55be640 1 -- 172.21.15.172:0/2776282362 shutdown_connections 2024-04-25T08:45:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bd55be640 1 --2- 172.21.15.172:0/2776282362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd00b2e80 0x7f0bd006d9f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bd55be640 1 --2- 172.21.15.172:0/2776282362 >> v2:172.21.15.186:3300/0 conn(0x7f0bd006df30 0x7f0bd00b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bd55be640 1 -- 172.21.15.172:0/2776282362 >> 172.21.15.172:0/2776282362 conn(0x7f0bd00cfe10 msgr2=0x7f0bd00d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bd55be640 1 -- 172.21.15.172:0/2776282362 shutdown_connections 2024-04-25T08:45:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.107+0000 7f0bd55be640 1 -- 172.21.15.172:0/2776282362 wait complete. 2024-04-25T08:45:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.109+0000 7f0bd55be640 1 Processor -- start 2024-04-25T08:45:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.109+0000 7f0bd55be640 1 -- start start 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.109+0000 7f0bd55be640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd006df30 0x7f0bd01406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.109+0000 7f0bd55be640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bd00b2e80 0x7f0bd00b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.109+0000 7f0bd55be640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bd015a810 0x7f0bd00b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.109+0000 7f0bd55be640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00af7b0 con 0x7f0bd00b2e80 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.109+0000 7f0bd55be640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd015abf0 con 0x7f0bd015a810 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.109+0000 7f0bd55be640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00b3ff0 con 0x7f0bd006df30 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bd00b2e80 0x7f0bd00b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd006df30 0x7f0bd01406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bd015a810 0x7f0bd00b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bce7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bd00b2e80 0x7f0bd00b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42380/0 (socket says 172.21.15.172:42380) 2024-04-25T08:45:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bceffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd006df30 0x7f0bd01406e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:40488/0 (socket says 172.21.15.172:40488) 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bce7fc640 1 -- 172.21.15.172:0/1237238363 learned_addr learned my addr 172.21.15.172:0/1237238363 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bd015a810 0x7f0bd00b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:34692/0 (socket says 172.21.15.172:34692) 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bce7fc640 1 -- 172.21.15.172:0/1237238363 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd006df30 msgr2=0x7f0bd01406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bce7fc640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd006df30 0x7f0bd01406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bce7fc640 1 -- 172.21.15.172:0/1237238363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bd015a810 msgr2=0x7f0bd00b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bce7fc640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bd015a810 0x7f0bd00b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bce7fc640 1 -- 172.21.15.172:0/1237238363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd0165d30 con 0x7f0bd00b2e80 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bcf7fe640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bd015a810 0x7f0bd00b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bce7fc640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bd00b2e80 0x7f0bd00b0c10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4035040 tx=0x7f0bc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bb77fe640 1 -- 172.21.15.172:0/1237238363 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4037040 con 0x7f0bd00b2e80 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bb77fe640 1 -- 172.21.15.172:0/1237238363 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc4042070 con 0x7f0bd00b2e80 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bd55be640 1 -- 172.21.15.172:0/1237238363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd0166010 con 0x7f0bd00b2e80 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bb77fe640 1 -- 172.21.15.172:0/1237238363 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc403b930 con 0x7f0bd00b2e80 2024-04-25T08:45:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.110+0000 7f0bd55be640 1 -- 172.21.15.172:0/1237238363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd01669f0 con 0x7f0bd00b2e80 2024-04-25T08:45:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.111+0000 7f0bd55be640 1 -- 172.21.15.172:0/1237238363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd0073990 con 0x7f0bd00b2e80 2024-04-25T08:45:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.112+0000 7f0bb77fe640 1 -- 172.21.15.172:0/1237238363 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0bc403bad0 con 0x7f0bd00b2e80 2024-04-25T08:45:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.112+0000 7f0bb77fe640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bbc06b4d0 0x7f0bbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.112+0000 7f0bb77fe640 1 -- 172.21.15.172:0/1237238363 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0bc40aab50 con 0x7f0bd00b2e80 2024-04-25T08:45:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.112+0000 7f0bceffd640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bbc06b4d0 0x7f0bbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.112+0000 7f0bceffd640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bbc06b4d0 0x7f0bbc06d990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0005c00 tx=0x7f0bc0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.116+0000 7f0bb77fe640 1 -- 172.21.15.172:0/1237238363 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0bc4079170 con 0x7f0bd00b2e80 2024-04-25T08:45:52.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.290+0000 7f0bd55be640 1 -- 172.21.15.172:0/1237238363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bd0074270 con 0x7f0bd00b2e80 2024-04-25T08:45:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.291+0000 7f0bb77fe640 1 -- 172.21.15.172:0/1237238363 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17002 (secure 0 0 0) 0x7f0bc407d210 con 0x7f0bd00b2e80 2024-04-25T08:45:52.287 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:52.287 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":54,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:45:19.797206+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:45:16.357665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T08:45:17.104697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 -- 172.21.15.172:0/1237238363 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bbc06b4d0 msgr2=0x7f0bbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bbc06b4d0 0x7f0bbc06d990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0005c00 tx=0x7f0bc0009040 comp rx=0 tx=0).stop 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 -- 172.21.15.172:0/1237238363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bd00b2e80 msgr2=0x7f0bd00b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bd00b2e80 0x7f0bd00b0c10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4035040 tx=0x7f0bc40046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 -- 172.21.15.172:0/1237238363 shutdown_connections 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bbc06b4d0 0x7f0bbc06d990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bd015a810 0x7f0bd00b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bd00b2e80 0x7f0bd00b0c10 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 --2- 172.21.15.172:0/1237238363 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0bd006df30 0x7f0bd01406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 -- 172.21.15.172:0/1237238363 >> 172.21.15.172:0/1237238363 conn(0x7f0bd00cfe10 msgr2=0x7f0bd00afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 -- 172.21.15.172:0/1237238363 shutdown_connections 2024-04-25T08:45:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.293+0000 7f0bd55be640 1 -- 172.21.15.172:0/1237238363 wait complete. 2024-04-25T08:45:52.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:45:16.357665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:45:17.104697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:45:52.296 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:45:52.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.406+0000 7fd1a1693640 1 Processor -- start 2024-04-25T08:45:52.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.406+0000 7fd1a1693640 1 -- start start 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.406+0000 7fd1a1693640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd19c15dc20 0x7fd19c0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.406+0000 7fd1a1693640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c06cda0 con 0x7fd19c0d32f0 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.406+0000 7fd1a1693640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c15e000 con 0x7fd19c161710 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.406+0000 7fd1a1693640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c0d1de0 con 0x7fd19c15dc20 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.407+0000 7fd19b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd19c0d32f0 0x7fd19c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51908/0 (socket says 172.21.15.172:51908) 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.407+0000 7fd19b7fe640 1 -- 172.21.15.172:0/2155069674 learned_addr learned my addr 172.21.15.172:0/2155069674 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.407+0000 7fd19affd640 1 --2- 172.21.15.172:0/2155069674 >> v2:172.21.15.186:3300/0 conn(0x7fd19c15dc20 0x7fd19c0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.407+0000 7fd19a7fc640 1 -- 172.21.15.172:0/2155069674 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361881349 0 0) 0x7fd19c06cda0 con 0x7fd19c0d32f0 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.407+0000 7fd19a7fc640 1 -- 172.21.15.172:0/2155069674 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd188003520 con 0x7fd19c0d32f0 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.407+0000 7fd19affd640 1 -- 172.21.15.172:0/2155069674 >> v1:172.21.15.186:6789/0 conn(0x7fd19c161710 legacy=0x7fd19c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.407+0000 7fd19affd640 1 -- 172.21.15.172:0/2155069674 >> v1:172.21.15.172:6789/0 conn(0x7fd19c0d32f0 legacy=0x7fd19c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.407+0000 7fd19affd640 1 -- 172.21.15.172:0/2155069674 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c161c60 con 0x7fd19c15dc20 2024-04-25T08:45:52.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.408+0000 7fd19affd640 1 --2- 172.21.15.172:0/2155069674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd19c15dc20 0x7fd19c0ce670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0097a0 tx=0x7fd18c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b53af2998d4325c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.408+0000 7fd19a7fc640 1 -- 172.21.15.172:0/2155069674 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c037070 con 0x7fd19c15dc20 2024-04-25T08:45:52.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.408+0000 7fd19a7fc640 1 -- 172.21.15.172:0/2155069674 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c032440 con 0x7fd19c15dc20 2024-04-25T08:45:52.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.408+0000 7fd19a7fc640 1 -- 172.21.15.172:0/2155069674 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c032810 con 0x7fd19c15dc20 2024-04-25T08:45:52.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.408+0000 7fd1a1693640 1 -- 172.21.15.172:0/2155069674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd19c15dc20 msgr2=0x7fd19c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.409+0000 7fd1a1693640 1 --2- 172.21.15.172:0/2155069674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd19c15dc20 0x7fd19c0ce670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0097a0 tx=0x7fd18c02a230 comp rx=0 tx=0).stop 2024-04-25T08:45:52.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.409+0000 7fd1a1693640 1 -- 172.21.15.172:0/2155069674 shutdown_connections 2024-04-25T08:45:52.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.409+0000 7fd1a1693640 1 --2- 172.21.15.172:0/2155069674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd19c15dc20 0x7fd19c0ce670 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.409+0000 7fd1a1693640 1 -- 172.21.15.172:0/2155069674 >> 172.21.15.172:0/2155069674 conn(0x7fd19c0d0420 msgr2=0x7fd19c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:52.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.409+0000 7fd1a1693640 1 -- 172.21.15.172:0/2155069674 shutdown_connections 2024-04-25T08:45:52.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.409+0000 7fd1a1693640 1 -- 172.21.15.172:0/2155069674 wait complete. 2024-04-25T08:45:52.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.410+0000 7fd1a1693640 1 Processor -- start 2024-04-25T08:45:52.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.410+0000 7fd1a1693640 1 -- start start 2024-04-25T08:45:52.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.410+0000 7fd1a1693640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd19c0d32f0 0x7fd19c14c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.410+0000 7fd1a1693640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c15dc20 0x7fd19c0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.410+0000 7fd1a1693640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd19c161710 0x7fd19c0ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.410+0000 7fd1a1693640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c162500 con 0x7fd19c15dc20 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.410+0000 7fd1a1693640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c162220 con 0x7fd19c161710 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.410+0000 7fd1a1693640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0b5e50 con 0x7fd19c0d32f0 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.410+0000 7fd193fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c15dc20 0x7fd19c0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd193fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c15dc20 0x7fd19c0acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42392/0 (socket says 172.21.15.172:42392) 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd193fff640 1 -- 172.21.15.172:0/3907264893 learned_addr learned my addr 172.21.15.172:0/3907264893 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd19affd640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd19c0d32f0 0x7fd19c14c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd19b7fe640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd19c161710 0x7fd19c0ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd193fff640 1 -- 172.21.15.172:0/3907264893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd19c0d32f0 msgr2=0x7fd19c14c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd193fff640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd19c0d32f0 0x7fd19c14c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd193fff640 1 -- 172.21.15.172:0/3907264893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd19c161710 msgr2=0x7fd19c0ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd193fff640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd19c161710 0x7fd19c0ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd193fff640 1 -- 172.21.15.172:0/3907264893 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0cd510 con 0x7fd19c15dc20 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd193fff640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c15dc20 0x7fd19c0acff0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd18400c400 tx=0x7fd18400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd1937fe640 1 -- 172.21.15.172:0/3907264893 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1840052d0 con 0x7fd19c15dc20 2024-04-25T08:45:52.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd1937fe640 1 -- 172.21.15.172:0/3907264893 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd184005490 con 0x7fd19c15dc20 2024-04-25T08:45:52.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd1937fe640 1 -- 172.21.15.172:0/3907264893 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184007260 con 0x7fd19c15dc20 2024-04-25T08:45:52.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd1a1693640 1 -- 172.21.15.172:0/3907264893 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c0cd7f0 con 0x7fd19c15dc20 2024-04-25T08:45:52.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.411+0000 7fd1a1693640 1 -- 172.21.15.172:0/3907264893 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c14ced0 con 0x7fd19c15dc20 2024-04-25T08:45:52.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.412+0000 7fd1a1693640 1 -- 172.21.15.172:0/3907264893 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c073a00 con 0x7fd19c15dc20 2024-04-25T08:45:52.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.413+0000 7fd1937fe640 1 -- 172.21.15.172:0/3907264893 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd184007400 con 0x7fd19c15dc20 2024-04-25T08:45:52.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.413+0000 7fd1937fe640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd17c06b4d0 0x7fd17c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.413+0000 7fd1937fe640 1 -- 172.21.15.172:0/3907264893 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd184089830 con 0x7fd19c15dc20 2024-04-25T08:45:52.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.413+0000 7fd19affd640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd17c06b4d0 0x7fd17c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.413+0000 7fd19affd640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd17c06b4d0 0x7fd17c06d990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd18c034000 tx=0x7fd18c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.417+0000 7fd1937fe640 1 -- 172.21.15.172:0/3907264893 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd184057ed0 con 0x7fd19c15dc20 2024-04-25T08:45:52.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.589+0000 7fd1a1693640 1 -- 172.21.15.172:0/3907264893 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd19c0b5220 con 0x7fd19c15dc20 2024-04-25T08:45:52.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.589+0000 7fd1937fe640 1 -- 172.21.15.172:0/3907264893 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd18405bf70 con 0x7fd19c15dc20 2024-04-25T08:45:52.581 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:45:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 -- 172.21.15.172:0/3907264893 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd17c06b4d0 msgr2=0x7fd17c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd17c06b4d0 0x7fd17c06d990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd18c034000 tx=0x7fd18c02e000 comp rx=0 tx=0).stop 2024-04-25T08:45:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 -- 172.21.15.172:0/3907264893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c15dc20 msgr2=0x7fd19c0acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c15dc20 0x7fd19c0acff0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd18400c400 tx=0x7fd18400c8c0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 -- 172.21.15.172:0/3907264893 shutdown_connections 2024-04-25T08:45:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd17c06b4d0 0x7fd17c06d990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd19c161710 0x7fd19c0ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd19c15dc20 0x7fd19c0acff0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 --2- 172.21.15.172:0/3907264893 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd19c0d32f0 0x7fd19c14c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 -- 172.21.15.172:0/3907264893 >> 172.21.15.172:0/3907264893 conn(0x7fd19c0d0420 msgr2=0x7fd19c0c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 -- 172.21.15.172:0/3907264893 shutdown_connections 2024-04-25T08:45:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.591+0000 7fd1a1693640 1 -- 172.21.15.172:0/3907264893 wait complete. 2024-04-25T08:45:52.594 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:45:52.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.703+0000 7ffb2d009640 1 Processor -- start 2024-04-25T08:45:52.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.703+0000 7ffb2d009640 1 -- start start 2024-04-25T08:45:52.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2d009640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffb28070dc0 0x7ffb2806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2d009640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb2815deb0 0x7ffb2815e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2d009640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb280d1770 con 0x7ffb280711a0 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2d009640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb280b0eb0 con 0x7ffb2815deb0 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2d009640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb281622b0 con 0x7ffb28070dc0 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2759e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb2815deb0 0x7ffb2815e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2659c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ffb280711a0 0x7ffb280b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51914/0 (socket says 172.21.15.172:51914) 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2659c640 1 -- 172.21.15.172:0/2652600172 learned_addr learned my addr 172.21.15.172:0/2652600172 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb26d9d640 1 --2- 172.21.15.172:0/2652600172 >> v2:172.21.15.186:3300/0 conn(0x7ffb28070dc0 0x7ffb2806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2759e640 1 -- 172.21.15.172:0/2652600172 >> v2:172.21.15.186:3300/0 conn(0x7ffb28070dc0 msgr2=0x7ffb2806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2759e640 1 --2- 172.21.15.172:0/2652600172 >> v2:172.21.15.186:3300/0 conn(0x7ffb28070dc0 0x7ffb2806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2759e640 1 -- 172.21.15.172:0/2652600172 >> v1:172.21.15.172:6789/0 conn(0x7ffb280711a0 legacy=0x7ffb280b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb2759e640 1 -- 172.21.15.172:0/2652600172 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb28162740 con 0x7ffb2815deb0 2024-04-25T08:45:52.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb25d9b640 1 -- 172.21.15.172:0/2652600172 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323929140 0 0) 0x7ffb280d1770 con 0x7ffb280711a0 2024-04-25T08:45:52.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.704+0000 7ffb26d9d640 1 --2- 172.21.15.172:0/2652600172 >> v2:172.21.15.186:3300/0 conn(0x7ffb28070dc0 0x7ffb2806ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:52.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.705+0000 7ffb2759e640 1 --2- 172.21.15.172:0/2652600172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 0x7ffb2815e300 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ffb28070a00 tx=0x7ffb2002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cccc348bb20444d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.705+0000 7ffb25d9b640 1 -- 172.21.15.172:0/2652600172 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20037070 con 0x7ffb2815deb0 2024-04-25T08:45:52.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.705+0000 7ffb25d9b640 1 -- 172.21.15.172:0/2652600172 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2002add0 con 0x7ffb2815deb0 2024-04-25T08:45:52.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.705+0000 7ffb25d9b640 1 -- 172.21.15.172:0/2652600172 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20032660 con 0x7ffb2815deb0 2024-04-25T08:45:52.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.706+0000 7ffb2d009640 1 -- 172.21.15.172:0/2652600172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 msgr2=0x7ffb2815e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.706+0000 7ffb2d009640 1 --2- 172.21.15.172:0/2652600172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 0x7ffb2815e300 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ffb28070a00 tx=0x7ffb2002a080 comp rx=0 tx=0).stop 2024-04-25T08:45:52.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.706+0000 7ffb2d009640 1 -- 172.21.15.172:0/2652600172 shutdown_connections 2024-04-25T08:45:52.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.706+0000 7ffb2d009640 1 --2- 172.21.15.172:0/2652600172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 0x7ffb2815e300 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.706+0000 7ffb2d009640 1 --2- 172.21.15.172:0/2652600172 >> v2:172.21.15.186:3300/0 conn(0x7ffb28070dc0 0x7ffb2806ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.706+0000 7ffb2d009640 1 -- 172.21.15.172:0/2652600172 >> 172.21.15.172:0/2652600172 conn(0x7ffb280b3530 msgr2=0x7ffb280b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:52.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.706+0000 7ffb2d009640 1 -- 172.21.15.172:0/2652600172 shutdown_connections 2024-04-25T08:45:52.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.706+0000 7ffb2d009640 1 -- 172.21.15.172:0/2652600172 wait complete. 2024-04-25T08:45:52.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.707+0000 7ffb2d009640 1 Processor -- start 2024-04-25T08:45:52.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.707+0000 7ffb2d009640 1 -- start start 2024-04-25T08:45:52.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2d009640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb28070dc0 0x7ffb28159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2d009640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb280711a0 0x7ffb280cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2d009640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 0x7ffb280cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2d009640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28161c60 con 0x7ffb2815deb0 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2d009640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb280b10f0 con 0x7ffb280711a0 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2d009640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28161f40 con 0x7ffb28070dc0 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2759e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 0x7ffb280cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2759e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 0x7ffb280cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42414/0 (socket says 172.21.15.172:42414) 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2759e640 1 -- 172.21.15.172:0/1859966186 learned_addr learned my addr 172.21.15.172:0/1859966186 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb26d9d640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb28070dc0 0x7ffb28159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2659c640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb280711a0 0x7ffb280cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2759e640 1 -- 172.21.15.172:0/1859966186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb28070dc0 msgr2=0x7ffb28159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2759e640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb28070dc0 0x7ffb28159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2759e640 1 -- 172.21.15.172:0/1859966186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb280711a0 msgr2=0x7ffb280cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2759e640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb280711a0 0x7ffb280cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2759e640 1 -- 172.21.15.172:0/1859966186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb281f6c90 con 0x7ffb2815deb0 2024-04-25T08:45:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.708+0000 7ffb2759e640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 0x7ffb280cf8c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009890 tx=0x7ffb200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.709+0000 7ffb0f7fe640 1 -- 172.21.15.172:0/1859966186 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20037040 con 0x7ffb2815deb0 2024-04-25T08:45:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.709+0000 7ffb0f7fe640 1 -- 172.21.15.172:0/1859966186 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb20042070 con 0x7ffb2815deb0 2024-04-25T08:45:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.709+0000 7ffb0f7fe640 1 -- 172.21.15.172:0/1859966186 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2003b670 con 0x7ffb2815deb0 2024-04-25T08:45:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.709+0000 7ffb2d009640 1 -- 172.21.15.172:0/1859966186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb281f6f50 con 0x7ffb2815deb0 2024-04-25T08:45:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.709+0000 7ffb2d009640 1 -- 172.21.15.172:0/1859966186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb281f7510 con 0x7ffb2815deb0 2024-04-25T08:45:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.710+0000 7ffb2d009640 1 -- 172.21.15.172:0/1859966186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb28073a00 con 0x7ffb2815deb0 2024-04-25T08:45:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.710+0000 7ffb0f7fe640 1 -- 172.21.15.172:0/1859966186 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb2003b810 con 0x7ffb2815deb0 2024-04-25T08:45:52.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.710+0000 7ffb0f7fe640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb1406b4d0 0x7ffb1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.711+0000 7ffb0f7fe640 1 -- 172.21.15.172:0/1859966186 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffb200aa900 con 0x7ffb2815deb0 2024-04-25T08:45:52.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.711+0000 7ffb26d9d640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb1406b4d0 0x7ffb1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.711+0000 7ffb26d9d640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb1406b4d0 0x7ffb1406d990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffb180075b0 tx=0x7ffb18007540 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.715+0000 7ffb0f7fe640 1 -- 172.21.15.172:0/1859966186 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb20079680 con 0x7ffb2815deb0 2024-04-25T08:45:52.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.884+0000 7ffb2d009640 1 -- 172.21.15.172:0/1859966186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb280d1ff0 con 0x7ffb2815deb0 2024-04-25T08:45:52.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.885+0000 7ffb0f7fe640 1 -- 172.21.15.172:0/1859966186 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb20078f80 con 0x7ffb2815deb0 2024-04-25T08:45:52.877 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 -- 172.21.15.172:0/1859966186 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb1406b4d0 msgr2=0x7ffb1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb1406b4d0 0x7ffb1406d990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ffb180075b0 tx=0x7ffb18007540 comp rx=0 tx=0).stop 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 -- 172.21.15.172:0/1859966186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 msgr2=0x7ffb280cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 0x7ffb280cf8c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009890 tx=0x7ffb200046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 -- 172.21.15.172:0/1859966186 shutdown_connections 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb1406b4d0 0x7ffb1406d990 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb280711a0 0x7ffb280cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb2815deb0 0x7ffb280cf8c0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 --2- 172.21.15.172:0/1859966186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb28070dc0 0x7ffb28159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 -- 172.21.15.172:0/1859966186 >> 172.21.15.172:0/1859966186 conn(0x7ffb280b3530 msgr2=0x7ffb280d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:52.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 -- 172.21.15.172:0/1859966186 shutdown_connections 2024-04-25T08:45:52.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.887+0000 7ffb2d009640 1 -- 172.21.15.172:0/1859966186 wait complete. 2024-04-25T08:45:52.889 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:45:52.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.998+0000 7fe30c590640 1 Processor -- start 2024-04-25T08:45:52.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.998+0000 7fe30c590640 1 -- start start 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe30c590640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe3040cadb0 0x7fe3040cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe30c590640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe3040ccfe0 0x7fe3040cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe30c590640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040afc80 con 0x7fe30415de80 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe30c590640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3040cb240 con 0x7fe3040cadb0 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe30c590640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3040ce4d0 con 0x7fe3040ccfe0 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe309b2b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe3040cadb0 0x7fe3040cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe309b2b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe3040cadb0 0x7fe3040cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42428/0 (socket says 172.21.15.172:42428) 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe309b2b640 1 -- 172.21.15.172:0/859742751 learned_addr learned my addr 172.21.15.172:0/859742751 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe30ab2d640 1 --2- 172.21.15.172:0/859742751 >> v2:172.21.15.186:3300/0 conn(0x7fe3040ccfe0 0x7fe3040cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe309b2b640 1 -- 172.21.15.172:0/859742751 >> v2:172.21.15.186:3300/0 conn(0x7fe3040ccfe0 msgr2=0x7fe3040cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe309b2b640 1 --2- 172.21.15.172:0/859742751 >> v2:172.21.15.186:3300/0 conn(0x7fe3040ccfe0 0x7fe3040cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe309b2b640 1 -- 172.21.15.172:0/859742751 >> v1:172.21.15.186:6789/0 conn(0x7fe30415de80 legacy=0x7fe3040cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:52.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:52.999+0000 7fe309b2b640 1 -- 172.21.15.172:0/859742751 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040ce7b0 con 0x7fe3040cadb0 2024-04-25T08:45:52.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.000+0000 7fe30ab2d640 1 --2- 172.21.15.172:0/859742751 >> v2:172.21.15.186:3300/0 conn(0x7fe3040ccfe0 0x7fe3040cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:52.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.000+0000 7fe309b2b640 1 --2- 172.21.15.172:0/859742751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040cadb0 0x7fe3040cf6c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe30406e2a0 tx=0x7fe2f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b73ae9181fa8ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.000+0000 7fe30932a640 1 -- 172.21.15.172:0/859742751 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4037070 con 0x7fe3040cadb0 2024-04-25T08:45:52.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.000+0000 7fe30932a640 1 -- 172.21.15.172:0/859742751 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f4032440 con 0x7fe3040cadb0 2024-04-25T08:45:52.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.000+0000 7fe30932a640 1 -- 172.21.15.172:0/859742751 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4032810 con 0x7fe3040cadb0 2024-04-25T08:45:52.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.001+0000 7fe30c590640 1 -- 172.21.15.172:0/859742751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040cadb0 msgr2=0x7fe3040cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.001+0000 7fe30c590640 1 --2- 172.21.15.172:0/859742751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040cadb0 0x7fe3040cf6c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe30406e2a0 tx=0x7fe2f402a270 comp rx=0 tx=0).stop 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.001+0000 7fe30c590640 1 -- 172.21.15.172:0/859742751 shutdown_connections 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.001+0000 7fe30c590640 1 --2- 172.21.15.172:0/859742751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040cadb0 0x7fe3040cf6c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.001+0000 7fe30c590640 1 --2- 172.21.15.172:0/859742751 >> v2:172.21.15.186:3300/0 conn(0x7fe3040ccfe0 0x7fe3040cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.001+0000 7fe30c590640 1 -- 172.21.15.172:0/859742751 >> 172.21.15.172:0/859742751 conn(0x7fe3040b2390 msgr2=0x7fe3040b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.001+0000 7fe30c590640 1 -- 172.21.15.172:0/859742751 shutdown_connections 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.001+0000 7fe30c590640 1 -- 172.21.15.172:0/859742751 wait complete. 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.002+0000 7fe30c590640 1 Processor -- start 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.002+0000 7fe30c590640 1 -- start start 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe30c590640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3040cadb0 0x7fe3040c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe30c590640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040ccfe0 0x7fe3040ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe30c590640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe30415de80 0x7fe30414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe30c590640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30415e260 con 0x7fe3040ccfe0 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe30c590640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040cfc00 con 0x7fe30415de80 2024-04-25T08:45:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe30c590640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040b2eb0 con 0x7fe3040cadb0 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe309b2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040ccfe0 0x7fe3040ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe309b2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040ccfe0 0x7fe3040ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42444/0 (socket says 172.21.15.172:42444) 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe309b2b640 1 -- 172.21.15.172:0/4000737516 learned_addr learned my addr 172.21.15.172:0/4000737516 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe309b2b640 1 -- 172.21.15.172:0/4000737516 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3040cadb0 msgr2=0x7fe3040c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe309b2b640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3040cadb0 0x7fe3040c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe309b2b640 1 -- 172.21.15.172:0/4000737516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe30415de80 msgr2=0x7fe30414e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe309b2b640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe30415de80 0x7fe30414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe309b2b640 1 -- 172.21.15.172:0/4000737516 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040c8880 con 0x7fe3040ccfe0 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe309b2b640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040ccfe0 0x7fe3040ca170 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe2f402a2b0 tx=0x7fe2f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe2faffd640 1 -- 172.21.15.172:0/4000737516 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4041020 con 0x7fe3040ccfe0 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe2faffd640 1 -- 172.21.15.172:0/4000737516 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40306c0 con 0x7fe3040ccfe0 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.003+0000 7fe30c590640 1 -- 172.21.15.172:0/4000737516 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3040b0ce0 con 0x7fe3040ccfe0 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.004+0000 7fe2faffd640 1 -- 172.21.15.172:0/4000737516 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4037040 con 0x7fe3040ccfe0 2024-04-25T08:45:52.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.004+0000 7fe30c590640 1 -- 172.21.15.172:0/4000737516 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3040b12a0 con 0x7fe3040ccfe0 2024-04-25T08:45:52.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.005+0000 7fe30c590640 1 -- 172.21.15.172:0/4000737516 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe304073a00 con 0x7fe3040ccfe0 2024-04-25T08:45:52.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.005+0000 7fe2faffd640 1 -- 172.21.15.172:0/4000737516 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe2f4044020 con 0x7fe3040ccfe0 2024-04-25T08:45:52.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.005+0000 7fe2faffd640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe2e806b4d0 0x7fe2e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:52.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.006+0000 7fe2faffd640 1 -- 172.21.15.172:0/4000737516 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe2f40aab20 con 0x7fe3040ccfe0 2024-04-25T08:45:52.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.006+0000 7fe30a32c640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe2e806b4d0 0x7fe2e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:52.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.006+0000 7fe30a32c640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe2e806b4d0 0x7fe2e806d990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe300000f60 tx=0x7fe3000079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:53.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.010+0000 7fe2faffd640 1 -- 172.21.15.172:0/4000737516 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2f404b030 con 0x7fe3040ccfe0 2024-04-25T08:45:53.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.178+0000 7fe30c590640 1 -- 172.21.15.172:0/4000737516 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe30415c240 con 0x7fe3040ccfe0 2024-04-25T08:45:53.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.179+0000 7fe2faffd640 1 -- 172.21.15.172:0/4000737516 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2f4079880 con 0x7fe3040ccfe0 2024-04-25T08:45:53.170 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:45:53.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.180+0000 7fe30c590640 1 -- 172.21.15.172:0/4000737516 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe2e806b4d0 msgr2=0x7fe2e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:53.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.180+0000 7fe30c590640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe2e806b4d0 0x7fe2e806d990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe300000f60 tx=0x7fe3000079d0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.180+0000 7fe30c590640 1 -- 172.21.15.172:0/4000737516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040ccfe0 msgr2=0x7fe3040ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:53.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.180+0000 7fe30c590640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040ccfe0 0x7fe3040ca170 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe2f402a2b0 tx=0x7fe2f40046c0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.181+0000 7fe30c590640 1 -- 172.21.15.172:0/4000737516 shutdown_connections 2024-04-25T08:45:53.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.181+0000 7fe30c590640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe2e806b4d0 0x7fe2e806d990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.181+0000 7fe30c590640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe30415de80 0x7fe30414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.181+0000 7fe30c590640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3040ccfe0 0x7fe3040ca170 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.181+0000 7fe30c590640 1 --2- 172.21.15.172:0/4000737516 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3040cadb0 0x7fe3040c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.181+0000 7fe30c590640 1 -- 172.21.15.172:0/4000737516 >> 172.21.15.172:0/4000737516 conn(0x7fe3040b2390 msgr2=0x7fe3040cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:53.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.181+0000 7fe30c590640 1 -- 172.21.15.172:0/4000737516 shutdown_connections 2024-04-25T08:45:53.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.181+0000 7fe30c590640 1 -- 172.21.15.172:0/4000737516 wait complete. 2024-04-25T08:45:53.183 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:45:53.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.289+0000 7fb361189640 1 Processor -- start 2024-04-25T08:45:53.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.289+0000 7fb361189640 1 -- start start 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb361189640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd8a0 0x7fb35c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb361189640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb35c150b90 0x7fb35c151020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb361189640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c15e6e0 con 0x7fb35c0cd4c0 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb361189640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c151560 con 0x7fb35c150b90 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb361189640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c15e9c0 con 0x7fb35c0cd8a0 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb35b59e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb35c150b90 0x7fb35c151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb353fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd8a0 0x7fb35c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb35ad9d640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fb35c0cd4c0 0x7fb35c15dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41358/0 (socket says 172.21.15.172:41358) 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb35ad9d640 1 -- 172.21.15.172:0/1596708509 learned_addr learned my addr 172.21.15.172:0/1596708509 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb35a59c640 1 -- 172.21.15.172:0/1596708509 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812716134 0 0) 0x7fb35c15e6e0 con 0x7fb35c0cd4c0 2024-04-25T08:45:53.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.290+0000 7fb35a59c640 1 -- 172.21.15.172:0/1596708509 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb348003520 con 0x7fb35c0cd4c0 2024-04-25T08:45:53.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.291+0000 7fb35b59e640 1 -- 172.21.15.172:0/1596708509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd8a0 msgr2=0x7fb35c15b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:53.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.291+0000 7fb35b59e640 1 --2- 172.21.15.172:0/1596708509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd8a0 0x7fb35c15b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.291+0000 7fb35b59e640 1 -- 172.21.15.172:0/1596708509 >> v1:172.21.15.186:6789/0 conn(0x7fb35c0cd4c0 legacy=0x7fb35c15dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:53.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.291+0000 7fb35b59e640 1 -- 172.21.15.172:0/1596708509 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c15a9c0 con 0x7fb35c150b90 2024-04-25T08:45:53.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.291+0000 7fb353fff640 1 --2- 172.21.15.172:0/1596708509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd8a0 0x7fb35c15b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:53.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.291+0000 7fb35b59e640 1 --2- 172.21.15.172:0/1596708509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb35c150b90 0x7fb35c151020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb354009d90 tx=0x7fb35402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41814d5719f529f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:53.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.291+0000 7fb35a59c640 1 -- 172.21.15.172:0/1596708509 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354007740 con 0x7fb35c150b90 2024-04-25T08:45:53.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.292+0000 7fb35a59c640 1 -- 172.21.15.172:0/1596708509 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3540078e0 con 0x7fb35c150b90 2024-04-25T08:45:53.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.292+0000 7fb35a59c640 1 -- 172.21.15.172:0/1596708509 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354007c90 con 0x7fb35c150b90 2024-04-25T08:45:53.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.292+0000 7fb361189640 1 -- 172.21.15.172:0/1596708509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb35c150b90 msgr2=0x7fb35c151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:53.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.292+0000 7fb361189640 1 --2- 172.21.15.172:0/1596708509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb35c150b90 0x7fb35c151020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb354009d90 tx=0x7fb35402a660 comp rx=0 tx=0).stop 2024-04-25T08:45:53.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.292+0000 7fb361189640 1 -- 172.21.15.172:0/1596708509 shutdown_connections 2024-04-25T08:45:53.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.292+0000 7fb361189640 1 --2- 172.21.15.172:0/1596708509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd8a0 0x7fb35c15b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.292+0000 7fb361189640 1 --2- 172.21.15.172:0/1596708509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb35c150b90 0x7fb35c151020 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.292+0000 7fb361189640 1 -- 172.21.15.172:0/1596708509 >> 172.21.15.172:0/1596708509 conn(0x7fb35c06abe0 msgr2=0x7fb35c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:53.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.292+0000 7fb361189640 1 -- 172.21.15.172:0/1596708509 shutdown_connections 2024-04-25T08:45:53.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.292+0000 7fb361189640 1 -- 172.21.15.172:0/1596708509 wait complete. 2024-04-25T08:45:53.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.293+0000 7fb361189640 1 Processor -- start 2024-04-25T08:45:53.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.293+0000 7fb361189640 1 -- start start 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb361189640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd4c0 0x7fb35c1501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb361189640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb35c0cd8a0 0x7fb35c13d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb361189640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb35c150b90 0x7fb35c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb361189640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c15e370 con 0x7fb35c150b90 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb361189640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c15a670 con 0x7fb35c0cd8a0 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb361189640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c06eca0 con 0x7fb35c0cd4c0 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb35b59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb35c150b90 0x7fb35c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb35b59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb35c150b90 0x7fb35c15d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42450/0 (socket says 172.21.15.172:42450) 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb35b59e640 1 -- 172.21.15.172:0/3899876694 learned_addr learned my addr 172.21.15.172:0/3899876694 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb353fff640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb35c0cd8a0 0x7fb35c13d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.294+0000 7fb35ad9d640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd4c0 0x7fb35c1501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb35b59e640 1 -- 172.21.15.172:0/3899876694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd4c0 msgr2=0x7fb35c1501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb35b59e640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd4c0 0x7fb35c1501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb35b59e640 1 -- 172.21.15.172:0/3899876694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb35c0cd8a0 msgr2=0x7fb35c13d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:53.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb35b59e640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb35c0cd8a0 0x7fb35c13d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb35b59e640 1 -- 172.21.15.172:0/3899876694 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c150840 con 0x7fb35c150b90 2024-04-25T08:45:53.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb35b59e640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb35c150b90 0x7fb35c15d910 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb354009d90 tx=0x7fb354004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:53.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb3537fe640 1 -- 172.21.15.172:0/3899876694 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354009450 con 0x7fb35c150b90 2024-04-25T08:45:53.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb3537fe640 1 -- 172.21.15.172:0/3899876694 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb354004240 con 0x7fb35c150b90 2024-04-25T08:45:53.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb361189640 1 -- 172.21.15.172:0/3899876694 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35c13cc00 con 0x7fb35c150b90 2024-04-25T08:45:53.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb3537fe640 1 -- 172.21.15.172:0/3899876694 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354004630 con 0x7fb35c150b90 2024-04-25T08:45:53.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.295+0000 7fb361189640 1 -- 172.21.15.172:0/3899876694 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c13d1c0 con 0x7fb35c150b90 2024-04-25T08:45:53.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.296+0000 7fb361189640 1 -- 172.21.15.172:0/3899876694 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c072190 con 0x7fb35c150b90 2024-04-25T08:45:53.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.296+0000 7fb3537fe640 1 -- 172.21.15.172:0/3899876694 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb35403b410 con 0x7fb35c150b90 2024-04-25T08:45:53.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.297+0000 7fb3537fe640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb33c06b4d0 0x7fb33c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:53.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.297+0000 7fb3537fe640 1 -- 172.21.15.172:0/3899876694 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb3540ab210 con 0x7fb35c150b90 2024-04-25T08:45:53.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.297+0000 7fb35ad9d640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb33c06b4d0 0x7fb33c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:53.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.297+0000 7fb35ad9d640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb33c06b4d0 0x7fb33c06d990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb34c005880 tx=0x7fb34c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:53.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.301+0000 7fb3537fe640 1 -- 172.21.15.172:0/3899876694 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb35c072190 con 0x7fb35c150b90 2024-04-25T08:45:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.488+0000 7fb361189640 1 -- 172.21.15.172:0/3899876694 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb35c073a00 con 0x7fb35c150b90 2024-04-25T08:45:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.488+0000 7fb3537fe640 1 -- 172.21.15.172:0/3899876694 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb35403f030 con 0x7fb35c150b90 2024-04-25T08:45:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:45:53.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.490+0000 7fb361189640 1 -- 172.21.15.172:0/3899876694 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb33c06b4d0 msgr2=0x7fb33c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:53.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.490+0000 7fb361189640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb33c06b4d0 0x7fb33c06d990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb34c005880 tx=0x7fb34c009040 comp rx=0 tx=0).stop 2024-04-25T08:45:53.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.490+0000 7fb361189640 1 -- 172.21.15.172:0/3899876694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb35c150b90 msgr2=0x7fb35c15d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:53.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.490+0000 7fb361189640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb35c150b90 0x7fb35c15d910 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb354009d90 tx=0x7fb354004a40 comp rx=0 tx=0).stop 2024-04-25T08:45:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.490+0000 7fb361189640 1 -- 172.21.15.172:0/3899876694 shutdown_connections 2024-04-25T08:45:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.490+0000 7fb361189640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb33c06b4d0 0x7fb33c06d990 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.490+0000 7fb361189640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb35c0cd8a0 0x7fb35c13d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.490+0000 7fb361189640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb35c150b90 0x7fb35c15d910 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.490+0000 7fb361189640 1 --2- 172.21.15.172:0/3899876694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb35c0cd4c0 0x7fb35c1501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.490+0000 7fb361189640 1 -- 172.21.15.172:0/3899876694 >> 172.21.15.172:0/3899876694 conn(0x7fb35c06abe0 msgr2=0x7fb35c06d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.491+0000 7fb361189640 1 -- 172.21.15.172:0/3899876694 shutdown_connections 2024-04-25T08:45:53.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:53.491+0000 7fb361189640 1 -- 172.21.15.172:0/3899876694 wait complete. 2024-04-25T08:45:53.493 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:45:53.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:53.493 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:45:54.857 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:45:54.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:45:54.857 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:45:54.875 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:45:54.875 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:54.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:45:54.890 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:45:54.890 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:54.932 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:45:54.933 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:45:54.933 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:45:54.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:45:54.948 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.085+0000 7f5e2841b640 1 Processor -- start 2024-04-25T08:45:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.085+0000 7f5e2841b640 1 -- start start 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e2841b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200cfec0 0x7f5e200cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e2841b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e20071480 con 0x7f5e20154ee0 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e2841b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e20071760 con 0x7f5e200ce3c0 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e2841b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e20072090 con 0x7f5e200cfec0 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e261b7640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5e20154ee0 0x7f5e200cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51930/0 (socket says 172.21.15.172:51930) 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e261b7640 1 -- 172.21.15.172:0/2670149045 learned_addr learned my addr 172.21.15.172:0/2670149045 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e259b6640 1 --2- 172.21.15.172:0/2670149045 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200cfec0 0x7f5e200cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e251b5640 1 -- 172.21.15.172:0/2670149045 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994061759 0 0) 0x7f5e20071480 con 0x7f5e20154ee0 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e251b5640 1 -- 172.21.15.172:0/2670149045 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e08003520 con 0x7f5e20154ee0 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e251b5640 1 -- 172.21.15.172:0/2670149045 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662411113 0 0) 0x7f5e20071760 con 0x7f5e200ce3c0 2024-04-25T08:45:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e251b5640 1 -- 172.21.15.172:0/2670149045 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e20071480 con 0x7f5e200ce3c0 2024-04-25T08:45:55.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e251b5640 1 -- 172.21.15.172:0/2670149045 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1810766002 0 0) 0x7f5e08003520 con 0x7f5e20154ee0 2024-04-25T08:45:55.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e259b6640 1 -- 172.21.15.172:0/2670149045 >> v1:172.21.15.186:6789/0 conn(0x7f5e200ce3c0 legacy=0x7f5e2006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e259b6640 1 -- 172.21.15.172:0/2670149045 >> v1:172.21.15.172:6789/0 conn(0x7f5e20154ee0 legacy=0x7f5e200cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.086+0000 7f5e259b6640 1 -- 172.21.15.172:0/2670149045 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20071a40 con 0x7f5e200cfec0 2024-04-25T08:45:55.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.087+0000 7f5e259b6640 1 --2- 172.21.15.172:0/2670149045 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200cfec0 0x7f5e200cde80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009dc0 tx=0x7f5e1402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eac5bcf90cf61d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:55.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.087+0000 7f5e251b5640 1 -- 172.21.15.172:0/2670149045 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18001670 con 0x7f5e200cfec0 2024-04-25T08:45:55.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.087+0000 7f5e251b5640 1 -- 172.21.15.172:0/2670149045 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e14007540 con 0x7f5e200cfec0 2024-04-25T08:45:55.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.087+0000 7f5e251b5640 1 -- 172.21.15.172:0/2670149045 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14007910 con 0x7f5e200cfec0 2024-04-25T08:45:55.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.088+0000 7f5e2841b640 1 -- 172.21.15.172:0/2670149045 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200cfec0 msgr2=0x7f5e200cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.088+0000 7f5e2841b640 1 --2- 172.21.15.172:0/2670149045 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200cfec0 0x7f5e200cde80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009dc0 tx=0x7f5e1402a660 comp rx=0 tx=0).stop 2024-04-25T08:45:55.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.088+0000 7f5e2841b640 1 -- 172.21.15.172:0/2670149045 shutdown_connections 2024-04-25T08:45:55.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.088+0000 7f5e2841b640 1 --2- 172.21.15.172:0/2670149045 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200cfec0 0x7f5e200cde80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.088+0000 7f5e2841b640 1 -- 172.21.15.172:0/2670149045 >> 172.21.15.172:0/2670149045 conn(0x7f5e2006abe0 msgr2=0x7f5e2006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:55.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.088+0000 7f5e2841b640 1 -- 172.21.15.172:0/2670149045 shutdown_connections 2024-04-25T08:45:55.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.088+0000 7f5e2841b640 1 -- 172.21.15.172:0/2670149045 wait complete. 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.089+0000 7f5e2841b640 1 Processor -- start 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.089+0000 7f5e2841b640 1 -- start start 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e2841b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200ce3c0 0x7f5e201430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e2841b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e200cfec0 0x7f5e201f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e2841b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e20154ee0 0x7f5e20159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e2841b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200ce800 con 0x7f5e20154ee0 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e2841b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e20071230 con 0x7f5e200cfec0 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e2841b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e201552c0 con 0x7f5e200ce3c0 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e269b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e20154ee0 0x7f5e20159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e269b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e20154ee0 0x7f5e20159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42454/0 (socket says 172.21.15.172:42454) 2024-04-25T08:45:55.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e269b8640 1 -- 172.21.15.172:0/1696909524 learned_addr learned my addr 172.21.15.172:0/1696909524 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e259b6640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e200cfec0 0x7f5e201f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e261b7640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200ce3c0 0x7f5e201430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e269b8640 1 -- 172.21.15.172:0/1696909524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200ce3c0 msgr2=0x7f5e201430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e269b8640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200ce3c0 0x7f5e201430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e269b8640 1 -- 172.21.15.172:0/1696909524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e200cfec0 msgr2=0x7f5e201f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e269b8640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e200cfec0 0x7f5e201f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e269b8640 1 -- 172.21.15.172:0/1696909524 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e201f2b00 con 0x7f5e20154ee0 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e261b7640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200ce3c0 0x7f5e201430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e269b8640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e20154ee0 0x7f5e20159aa0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5e10001eb0 tx=0x7f5e1000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e1effd640 1 -- 172.21.15.172:0/1696909524 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10017070 con 0x7f5e20154ee0 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e1effd640 1 -- 172.21.15.172:0/1696909524 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e100052d0 con 0x7f5e20154ee0 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e1effd640 1 -- 172.21.15.172:0/1696909524 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e100037f0 con 0x7f5e20154ee0 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e2841b640 1 -- 172.21.15.172:0/1696909524 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e20155920 con 0x7f5e20154ee0 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.090+0000 7f5e2841b640 1 -- 172.21.15.172:0/1696909524 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e20155ee0 con 0x7f5e20154ee0 2024-04-25T08:45:55.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.091+0000 7f5e2841b640 1 -- 172.21.15.172:0/1696909524 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e20073990 con 0x7f5e20154ee0 2024-04-25T08:45:55.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.092+0000 7f5e1effd640 1 -- 172.21.15.172:0/1696909524 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e1001a070 con 0x7f5e20154ee0 2024-04-25T08:45:55.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.092+0000 7f5e1effd640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e0c06b4d0 0x7f5e0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.092+0000 7f5e261b7640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e0c06b4d0 0x7f5e0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.092+0000 7f5e1effd640 1 -- 172.21.15.172:0/1696909524 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5e100895a0 con 0x7f5e20154ee0 2024-04-25T08:45:55.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.093+0000 7f5e261b7640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e0c06b4d0 0x7f5e0c06d990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5e18001eb0 tx=0x7f5e18009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:55.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.097+0000 7f5e1effd640 1 -- 172.21.15.172:0/1696909524 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e10057c40 con 0x7f5e20154ee0 2024-04-25T08:45:55.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.301+0000 7f5e2841b640 1 -- 172.21.15.172:0/1696909524 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e2006d360 con 0x7f5e20154ee0 2024-04-25T08:45:55.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.302+0000 7f5e1effd640 1 -- 172.21.15.172:0/1696909524 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f5e1005bce0 con 0x7f5e20154ee0 2024-04-25T08:45:55.294 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:55.294 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:50.836733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:55.294 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 26 2024-04-25T08:45:55.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 -- 172.21.15.172:0/1696909524 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e0c06b4d0 msgr2=0x7f5e0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e0c06b4d0 0x7f5e0c06d990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5e18001eb0 tx=0x7f5e18009040 comp rx=0 tx=0).stop 2024-04-25T08:45:55.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 -- 172.21.15.172:0/1696909524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e20154ee0 msgr2=0x7f5e20159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e20154ee0 0x7f5e20159aa0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5e10001eb0 tx=0x7f5e1000c820 comp rx=0 tx=0).stop 2024-04-25T08:45:55.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 -- 172.21.15.172:0/1696909524 shutdown_connections 2024-04-25T08:45:55.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e0c06b4d0 0x7f5e0c06d990 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e200cfec0 0x7f5e201f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e20154ee0 0x7f5e20159aa0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 --2- 172.21.15.172:0/1696909524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e200ce3c0 0x7f5e201430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 -- 172.21.15.172:0/1696909524 >> 172.21.15.172:0/1696909524 conn(0x7f5e2006abe0 msgr2=0x7f5e2006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:55.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 -- 172.21.15.172:0/1696909524 shutdown_connections 2024-04-25T08:45:55.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.304+0000 7f5e2841b640 1 -- 172.21.15.172:0/1696909524 wait complete. 2024-04-25T08:45:55.307 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:55.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.414+0000 7f5891b34640 1 Processor -- start 2024-04-25T08:45:55.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.414+0000 7f5891b34640 1 -- start start 2024-04-25T08:45:55.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f5891b34640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f588c0ce330 0x7f588c06fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f5891b34640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f588c0700a0 0x7f588c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f5891b34640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588c1626e0 con 0x7f588c06abe0 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f5891b34640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588c0cd270 con 0x7f588c0700a0 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f5891b34640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588c0cd550 con 0x7f588c0ce330 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f588bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f588c0700a0 0x7f588c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f588bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f588c0700a0 0x7f588c15d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42464/0 (socket says 172.21.15.172:42464) 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f588bfff640 1 -- 172.21.15.172:0/596383631 learned_addr learned my addr 172.21.15.172:0/596383631 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f588affd640 1 --2- 172.21.15.172:0/596383631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f588c0ce330 0x7f588c06fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f588bfff640 1 -- 172.21.15.172:0/596383631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f588c0ce330 msgr2=0x7f588c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f588bfff640 1 --2- 172.21.15.172:0/596383631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f588c0ce330 0x7f588c06fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f588bfff640 1 -- 172.21.15.172:0/596383631 >> v1:172.21.15.186:6789/0 conn(0x7f588c06abe0 legacy=0x7f588c06afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.415+0000 7f588bfff640 1 -- 172.21.15.172:0/596383631 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c0cd830 con 0x7f588c0700a0 2024-04-25T08:45:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.416+0000 7f588bfff640 1 --2- 172.21.15.172:0/596383631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c0700a0 0x7f588c15d370 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5884009e50 tx=0x7f588402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40052dd227f2fcf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:55.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.416+0000 7f588a7fc640 1 -- 172.21.15.172:0/596383631 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884036070 con 0x7f588c0700a0 2024-04-25T08:45:55.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.416+0000 7f588a7fc640 1 -- 172.21.15.172:0/596383631 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5884031600 con 0x7f588c0700a0 2024-04-25T08:45:55.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.416+0000 7f588a7fc640 1 -- 172.21.15.172:0/596383631 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840319d0 con 0x7f588c0700a0 2024-04-25T08:45:55.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.417+0000 7f5891b34640 1 -- 172.21.15.172:0/596383631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c0700a0 msgr2=0x7f588c15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.417+0000 7f5891b34640 1 --2- 172.21.15.172:0/596383631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c0700a0 0x7f588c15d370 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5884009e50 tx=0x7f588402a680 comp rx=0 tx=0).stop 2024-04-25T08:45:55.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.417+0000 7f5891b34640 1 -- 172.21.15.172:0/596383631 shutdown_connections 2024-04-25T08:45:55.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.417+0000 7f5891b34640 1 --2- 172.21.15.172:0/596383631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c0700a0 0x7f588c15d370 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.417+0000 7f5891b34640 1 --2- 172.21.15.172:0/596383631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f588c0ce330 0x7f588c06fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.417+0000 7f5891b34640 1 -- 172.21.15.172:0/596383631 >> 172.21.15.172:0/596383631 conn(0x7f588c0b2220 msgr2=0x7f588c0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:55.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.417+0000 7f5891b34640 1 -- 172.21.15.172:0/596383631 shutdown_connections 2024-04-25T08:45:55.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.417+0000 7f5891b34640 1 -- 172.21.15.172:0/596383631 wait complete. 2024-04-25T08:45:55.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.418+0000 7f5891b34640 1 Processor -- start 2024-04-25T08:45:55.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.418+0000 7f5891b34640 1 -- start start 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5891b34640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c06abe0 0x7f588c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5891b34640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f588c0700a0 0x7f588c1495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5891b34640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f588c0ce330 0x7f588c160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5891b34640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c15d8b0 con 0x7f588c06abe0 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5891b34640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c161780 con 0x7f588c0700a0 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5891b34640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588c15da30 con 0x7f588c0ce330 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c06abe0 0x7f588c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c06abe0 0x7f588c148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42480/0 (socket says 172.21.15.172:42480) 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588b7fe640 1 -- 172.21.15.172:0/3931461931 learned_addr learned my addr 172.21.15.172:0/3931461931 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588affd640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f588c0700a0 0x7f588c1495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588bfff640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f588c0ce330 0x7f588c160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588b7fe640 1 -- 172.21.15.172:0/3931461931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f588c0ce330 msgr2=0x7f588c160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588b7fe640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f588c0ce330 0x7f588c160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588b7fe640 1 -- 172.21.15.172:0/3931461931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f588c0700a0 msgr2=0x7f588c1495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588b7fe640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f588c0700a0 0x7f588c1495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588b7fe640 1 -- 172.21.15.172:0/3931461931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c1492e0 con 0x7f588c06abe0 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f588b7fe640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c06abe0 0x7f588c148da0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f587c00c400 tx=0x7f587c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5873fff640 1 -- 172.21.15.172:0/3931461931 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c0052d0 con 0x7f588c06abe0 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5873fff640 1 -- 172.21.15.172:0/3931461931 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c005490 con 0x7f588c06abe0 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5873fff640 1 -- 172.21.15.172:0/3931461931 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c007260 con 0x7f588c06abe0 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5891b34640 1 -- 172.21.15.172:0/3931461931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588c15dfc0 con 0x7f588c06abe0 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.419+0000 7f5891b34640 1 -- 172.21.15.172:0/3931461931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588c15e580 con 0x7f588c06abe0 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.420+0000 7f5891b34640 1 -- 172.21.15.172:0/3931461931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588c0afe50 con 0x7f588c06abe0 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.421+0000 7f5873fff640 1 -- 172.21.15.172:0/3931461931 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f587c007400 con 0x7f588c06abe0 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.421+0000 7f5873fff640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f587806b4d0 0x7f587806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.421+0000 7f5873fff640 1 -- 172.21.15.172:0/3931461931 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f587c0897a0 con 0x7f588c06abe0 2024-04-25T08:45:55.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.421+0000 7f588affd640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f587806b4d0 0x7f587806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.422+0000 7f588affd640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f587806b4d0 0x7f587806d990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f588c06f140 tx=0x7f5880008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:55.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.425+0000 7f5873fff640 1 -- 172.21.15.172:0/3931461931 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f587c057ed0 con 0x7f588c06abe0 2024-04-25T08:45:55.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.596+0000 7f5891b34640 1 -- 172.21.15.172:0/3931461931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f588c0b6670 con 0x7f588c06abe0 2024-04-25T08:45:55.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.597+0000 7f5873fff640 1 -- 172.21.15.172:0/3931461931 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17002 (secure 0 0 0) 0x7f587c05bf70 con 0x7f588c06abe0 2024-04-25T08:45:55.589 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:55.589 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":54,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:45:19.797206+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:45:16.357665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T08:45:17.104697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:55.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 -- 172.21.15.172:0/3931461931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f587806b4d0 msgr2=0x7f587806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f587806b4d0 0x7f587806d990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f588c06f140 tx=0x7f5880008040 comp rx=0 tx=0).stop 2024-04-25T08:45:55.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 -- 172.21.15.172:0/3931461931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c06abe0 msgr2=0x7f588c148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c06abe0 0x7f588c148da0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f587c00c400 tx=0x7f587c00c8c0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 -- 172.21.15.172:0/3931461931 shutdown_connections 2024-04-25T08:45:55.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f587806b4d0 0x7f587806d990 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f588c0700a0 0x7f588c1495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f588c0ce330 0x7f588c160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 --2- 172.21.15.172:0/3931461931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f588c06abe0 0x7f588c148da0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 -- 172.21.15.172:0/3931461931 >> 172.21.15.172:0/3931461931 conn(0x7f588c0b2220 msgr2=0x7f588c0add00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:55.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 -- 172.21.15.172:0/3931461931 shutdown_connections 2024-04-25T08:45:55.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.599+0000 7f5891b34640 1 -- 172.21.15.172:0/3931461931 wait complete. 2024-04-25T08:45:55.602 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:45:16.357665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:45:17.104697+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:45:55.602 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:45:55.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.711+0000 7fd3d2fd5640 1 Processor -- start 2024-04-25T08:45:55.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.711+0000 7fd3d2fd5640 1 -- start start 2024-04-25T08:45:55.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d2fd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc158230 0x7fd3cc0d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d2fd5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd3cc0b4e60 0x7fd3cc0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d2fd5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc0d2020 con 0x7fd3cc0d1b80 2024-04-25T08:45:55.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d2fd5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3cc158610 con 0x7fd3cc0b4e60 2024-04-25T08:45:55.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d2fd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc06bea0 con 0x7fd3cc158230 2024-04-25T08:45:55.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d0d71640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc158230 0x7fd3cc0d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d1572640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd3cc0b4e60 0x7fd3cc0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d1572640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd3cc0b4e60 0x7fd3cc0b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:34818/0 (socket says 172.21.15.172:34818) 2024-04-25T08:45:55.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d0d71640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc158230 0x7fd3cc0d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:40572/0 (socket says 172.21.15.172:40572) 2024-04-25T08:45:55.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d1572640 1 -- 172.21.15.172:0/4241514586 learned_addr learned my addr 172.21.15.172:0/4241514586 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:55.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3cbfff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fd3cc0d1b80 0x7fd3cc06c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41384/0 (socket says 172.21.15.172:41384) 2024-04-25T08:45:55.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d0d71640 1 -- 172.21.15.172:0/4241514586 >> v2:172.21.15.186:3300/0 conn(0x7fd3cc0b4e60 msgr2=0x7fd3cc0b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:55.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d0d71640 1 --2- 172.21.15.172:0/4241514586 >> v2:172.21.15.186:3300/0 conn(0x7fd3cc0b4e60 0x7fd3cc0b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d0d71640 1 -- 172.21.15.172:0/4241514586 >> v1:172.21.15.186:6789/0 conn(0x7fd3cc0d1b80 legacy=0x7fd3cc06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d0d71640 1 -- 172.21.15.172:0/4241514586 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc0d2300 con 0x7fd3cc158230 2024-04-25T08:45:55.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.712+0000 7fd3d1572640 1 --2- 172.21.15.172:0/4241514586 >> v2:172.21.15.186:3300/0 conn(0x7fd3cc0b4e60 0x7fd3cc0b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.713+0000 7fd3d0d71640 1 --2- 172.21.15.172:0/4241514586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc158230 0x7fd3cc0d1640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00097a0 tx=0x7fd3c002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c745a96ebfd9e255 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.713+0000 7fd3cb7fe640 1 -- 172.21.15.172:0/4241514586 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0037070 con 0x7fd3cc158230 2024-04-25T08:45:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.713+0000 7fd3cb7fe640 1 -- 172.21.15.172:0/4241514586 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c0032440 con 0x7fd3cc158230 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.713+0000 7fd3cb7fe640 1 -- 172.21.15.172:0/4241514586 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0032810 con 0x7fd3cc158230 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.714+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/4241514586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc158230 msgr2=0x7fd3cc0d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.714+0000 7fd3d2fd5640 1 --2- 172.21.15.172:0/4241514586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc158230 0x7fd3cc0d1640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00097a0 tx=0x7fd3c002a180 comp rx=0 tx=0).stop 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.714+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/4241514586 shutdown_connections 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.714+0000 7fd3d2fd5640 1 --2- 172.21.15.172:0/4241514586 >> v2:172.21.15.186:3300/0 conn(0x7fd3cc0b4e60 0x7fd3cc0b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.714+0000 7fd3d2fd5640 1 --2- 172.21.15.172:0/4241514586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc158230 0x7fd3cc0d1640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.714+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/4241514586 >> 172.21.15.172:0/4241514586 conn(0x7fd3cc061600 msgr2=0x7fd3cc0619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.714+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/4241514586 shutdown_connections 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.714+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/4241514586 wait complete. 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.715+0000 7fd3d2fd5640 1 Processor -- start 2024-04-25T08:45:55.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.715+0000 7fd3d2fd5640 1 -- start start 2024-04-25T08:45:55.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d2fd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc0b4e60 0x7fd3cc1f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d2fd5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3cc0d1b80 0x7fd3cc0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d2fd5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc158230 0x7fd3cc0cf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d2fd5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0d25e0 con 0x7fd3cc158230 2024-04-25T08:45:55.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d2fd5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0b57b0 con 0x7fd3cc0d1b80 2024-04-25T08:45:55.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d2fd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc06ca40 con 0x7fd3cc0b4e60 2024-04-25T08:45:55.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d1572640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc158230 0x7fd3cc0cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d1572640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc158230 0x7fd3cc0cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42490/0 (socket says 172.21.15.172:42490) 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d1572640 1 -- 172.21.15.172:0/702316667 learned_addr learned my addr 172.21.15.172:0/702316667 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d0d71640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc0b4e60 0x7fd3cc1f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3cbfff640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3cc0d1b80 0x7fd3cc0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d1572640 1 -- 172.21.15.172:0/702316667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc0b4e60 msgr2=0x7fd3cc1f7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d1572640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc0b4e60 0x7fd3cc1f7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d1572640 1 -- 172.21.15.172:0/702316667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3cc0d1b80 msgr2=0x7fd3cc0cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d1572640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3cc0d1b80 0x7fd3cc0cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.716+0000 7fd3d1572640 1 -- 172.21.15.172:0/702316667 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc142fa0 con 0x7fd3cc158230 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.717+0000 7fd3d1572640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc158230 0x7fd3cc0cf110 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400efc0 tx=0x7fd3c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.717+0000 7fd3c97fa640 1 -- 172.21.15.172:0/702316667 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400cbe0 con 0x7fd3cc158230 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.717+0000 7fd3c97fa640 1 -- 172.21.15.172:0/702316667 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c400cd80 con 0x7fd3cc158230 2024-04-25T08:45:55.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.717+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/702316667 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc145200 con 0x7fd3cc158230 2024-04-25T08:45:55.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.717+0000 7fd3c97fa640 1 -- 172.21.15.172:0/702316667 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4003bb0 con 0x7fd3cc158230 2024-04-25T08:45:55.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.717+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/702316667 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc1457c0 con 0x7fd3cc158230 2024-04-25T08:45:55.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.718+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/702316667 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc15dcd0 con 0x7fd3cc158230 2024-04-25T08:45:55.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.718+0000 7fd3c97fa640 1 -- 172.21.15.172:0/702316667 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd3c401b030 con 0x7fd3cc158230 2024-04-25T08:45:55.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.718+0000 7fd3c97fa640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3b006b4d0 0x7fd3b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:55.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.719+0000 7fd3c97fa640 1 -- 172.21.15.172:0/702316667 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd3c408a6f0 con 0x7fd3cc158230 2024-04-25T08:45:55.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.719+0000 7fd3d0d71640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3b006b4d0 0x7fd3b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:55.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.719+0000 7fd3d0d71640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3b006b4d0 0x7fd3b006d990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0034000 tx=0x7fd3c002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:55.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.723+0000 7fd3c97fa640 1 -- 172.21.15.172:0/702316667 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd3c4022020 con 0x7fd3cc158230 2024-04-25T08:45:55.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.893+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/702316667 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3cc073a00 con 0x7fd3cc158230 2024-04-25T08:45:55.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.894+0000 7fd3c97fa640 1 -- 172.21.15.172:0/702316667 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3c4010040 con 0x7fd3cc158230 2024-04-25T08:45:55.885 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:45:55.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/702316667 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3b006b4d0 msgr2=0x7fd3b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3b006b4d0 0x7fd3b006d990 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0034000 tx=0x7fd3c002e000 comp rx=0 tx=0).stop 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/702316667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc158230 msgr2=0x7fd3cc0cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc158230 0x7fd3cc0cf110 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400efc0 tx=0x7fd3c400c490 comp rx=0 tx=0).stop 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/702316667 shutdown_connections 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd3b006b4d0 0x7fd3b006d990 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3cc0d1b80 0x7fd3cc0cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3cc158230 0x7fd3cc0cf110 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 --2- 172.21.15.172:0/702316667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3cc0b4e60 0x7fd3cc1f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/702316667 >> 172.21.15.172:0/702316667 conn(0x7fd3cc061600 msgr2=0x7fd3cc0d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/702316667 shutdown_connections 2024-04-25T08:45:55.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:55.896+0000 7fd3d2fd5640 1 -- 172.21.15.172:0/702316667 wait complete. 2024-04-25T08:45:55.898 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:45:55.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.006+0000 7f9d4c9a5640 1 Processor -- start 2024-04-25T08:45:55.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.006+0000 7f9d4c9a5640 1 -- start start 2024-04-25T08:45:55.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.007+0000 7f9d4c9a5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d481446d0 0x7f9d480b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.007+0000 7f9d4c9a5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9d4806e8a0 0x7f9d480b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.007+0000 7f9d4c9a5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d480cccc0 con 0x7f9d48144d50 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.007+0000 7f9d4c9a5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d480b2b20 con 0x7f9d4806e8a0 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.007+0000 7f9d4c9a5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4806d400 con 0x7f9d481446d0 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.008+0000 7f9d46d9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9d4806e8a0 0x7f9d480b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.008+0000 7f9d4659c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d481446d0 0x7f9d480b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.008+0000 7f9d45d9b640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f9d48144d50 0x7f9d480cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41386/0 (socket says 172.21.15.172:41386) 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.008+0000 7f9d45d9b640 1 -- 172.21.15.172:0/4270701393 learned_addr learned my addr 172.21.15.172:0/4270701393 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.008+0000 7f9d46d9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9d4806e8a0 0x7f9d480b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:34832/0 (socket says 172.21.15.172:34832) 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.008+0000 7f9d4659c640 1 -- 172.21.15.172:0/4270701393 >> v2:172.21.15.186:3300/0 conn(0x7f9d4806e8a0 msgr2=0x7f9d480b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:56.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.008+0000 7f9d4659c640 1 --2- 172.21.15.172:0/4270701393 >> v2:172.21.15.186:3300/0 conn(0x7f9d4806e8a0 0x7f9d480b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.008+0000 7f9d4559a640 1 -- 172.21.15.172:0/4270701393 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637788972 0 0) 0x7f9d480cccc0 con 0x7f9d48144d50 2024-04-25T08:45:56.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.008+0000 7f9d4659c640 1 -- 172.21.15.172:0/4270701393 >> v1:172.21.15.186:6789/0 conn(0x7f9d48144d50 legacy=0x7f9d480cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.008+0000 7f9d4659c640 1 -- 172.21.15.172:0/4270701393 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480cc140 con 0x7f9d481446d0 2024-04-25T08:45:56.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.009+0000 7f9d4659c640 1 --2- 172.21.15.172:0/4270701393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d481446d0 0x7f9d480b3f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9d400097a0 tx=0x7f9d4002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46e534f5485bfd23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.009+0000 7f9d4559a640 1 -- 172.21.15.172:0/4270701393 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40037070 con 0x7f9d481446d0 2024-04-25T08:45:56.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.009+0000 7f9d4559a640 1 -- 172.21.15.172:0/4270701393 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40032440 con 0x7f9d481446d0 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.009+0000 7f9d4559a640 1 -- 172.21.15.172:0/4270701393 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40032810 con 0x7f9d481446d0 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.009+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/4270701393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d481446d0 msgr2=0x7f9d480b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.009+0000 7f9d4c9a5640 1 --2- 172.21.15.172:0/4270701393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d481446d0 0x7f9d480b3f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9d400097a0 tx=0x7f9d4002a180 comp rx=0 tx=0).stop 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.010+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/4270701393 shutdown_connections 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.010+0000 7f9d4c9a5640 1 --2- 172.21.15.172:0/4270701393 >> v2:172.21.15.186:3300/0 conn(0x7f9d4806e8a0 0x7f9d480b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.010+0000 7f9d4c9a5640 1 --2- 172.21.15.172:0/4270701393 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d481446d0 0x7f9d480b3f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.010+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/4270701393 >> 172.21.15.172:0/4270701393 conn(0x7f9d4806abe0 msgr2=0x7f9d4806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.010+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/4270701393 shutdown_connections 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.010+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/4270701393 wait complete. 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.011+0000 7f9d4c9a5640 1 Processor -- start 2024-04-25T08:45:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.011+0000 7f9d4c9a5640 1 -- start start 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d4c9a5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d4806e8a0 0x7f9d4813efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d4c9a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d481446d0 0x7f9d480caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d4c9a5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d48144d50 0x7f9d480c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d4c9a5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480cc700 con 0x7f9d481446d0 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d4c9a5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480b49a0 con 0x7f9d4806e8a0 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d4c9a5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480cc9e0 con 0x7f9d48144d50 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d45d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d481446d0 0x7f9d480caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d45d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d481446d0 0x7f9d480caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42492/0 (socket says 172.21.15.172:42492) 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d45d9b640 1 -- 172.21.15.172:0/2644716629 learned_addr learned my addr 172.21.15.172:0/2644716629 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d46d9d640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d48144d50 0x7f9d480c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d4659c640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d4806e8a0 0x7f9d4813efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d45d9b640 1 -- 172.21.15.172:0/2644716629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d48144d50 msgr2=0x7f9d480c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d45d9b640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d48144d50 0x7f9d480c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d45d9b640 1 -- 172.21.15.172:0/2644716629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d4806e8a0 msgr2=0x7f9d4813efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d45d9b640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d4806e8a0 0x7f9d4813efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d45d9b640 1 -- 172.21.15.172:0/2644716629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480c5a30 con 0x7f9d481446d0 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d45d9b640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d481446d0 0x7f9d480caf90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00c7f0 tx=0x7f9d3c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d36ffd640 1 -- 172.21.15.172:0/2644716629 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c018070 con 0x7f9d481446d0 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d36ffd640 1 -- 172.21.15.172:0/2644716629 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c00a5e0 con 0x7f9d481446d0 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/2644716629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d480ab800 con 0x7f9d481446d0 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d36ffd640 1 -- 172.21.15.172:0/2644716629 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00a9d0 con 0x7f9d481446d0 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.012+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/2644716629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d480ac0a0 con 0x7f9d481446d0 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.013+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/2644716629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d480ab9d0 con 0x7f9d481446d0 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.014+0000 7f9d36ffd640 1 -- 172.21.15.172:0/2644716629 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d3c01b070 con 0x7f9d481446d0 2024-04-25T08:45:56.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.014+0000 7f9d36ffd640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d2806b4d0 0x7f9d2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.014+0000 7f9d36ffd640 1 -- 172.21.15.172:0/2644716629 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9d3c0898c0 con 0x7f9d481446d0 2024-04-25T08:45:56.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.014+0000 7f9d4659c640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d2806b4d0 0x7f9d2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.015+0000 7f9d4659c640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d2806b4d0 0x7f9d2806d990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9d40034000 tx=0x7f9d4002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.018+0000 7f9d36ffd640 1 -- 172.21.15.172:0/2644716629 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d3c057f60 con 0x7f9d481446d0 2024-04-25T08:45:56.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.188+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/2644716629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d48073a00 con 0x7f9d481446d0 2024-04-25T08:45:56.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.188+0000 7f9d36ffd640 1 -- 172.21.15.172:0/2644716629 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d3c05c000 con 0x7f9d481446d0 2024-04-25T08:45:56.180 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:45:56.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/2644716629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d2806b4d0 msgr2=0x7f9d2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d2806b4d0 0x7f9d2806d990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9d40034000 tx=0x7f9d4002e000 comp rx=0 tx=0).stop 2024-04-25T08:45:56.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/2644716629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d481446d0 msgr2=0x7f9d480caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d481446d0 0x7f9d480caf90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00c7f0 tx=0x7f9d3c00ccb0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/2644716629 shutdown_connections 2024-04-25T08:45:56.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d2806b4d0 0x7f9d2806d990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d48144d50 0x7f9d480c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d481446d0 0x7f9d480caf90 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 --2- 172.21.15.172:0/2644716629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d4806e8a0 0x7f9d4813efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/2644716629 >> 172.21.15.172:0/2644716629 conn(0x7f9d4806abe0 msgr2=0x7f9d480af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:56.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/2644716629 shutdown_connections 2024-04-25T08:45:56.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.190+0000 7f9d4c9a5640 1 -- 172.21.15.172:0/2644716629 wait complete. 2024-04-25T08:45:56.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:45:56.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.300+0000 7fd71ce4a640 1 Processor -- start 2024-04-25T08:45:56.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.300+0000 7fd71ce4a640 1 -- start start 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd71ce4a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd71815dd80 0x7fd7180b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd71ce4a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7180ad570 0x7fd71806ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd71ce4a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7180b3930 con 0x7fd71806abe0 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd71ce4a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71806e410 con 0x7fd71815dd80 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd71ce4a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180b3c10 con 0x7fd7180ad570 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd715d9b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd71815dd80 0x7fd7180b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd716d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7180ad570 0x7fd71806ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd71659c640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fd71806abe0 0x7fd71806afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41396/0 (socket says 172.21.15.172:41396) 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd71659c640 1 -- 172.21.15.172:0/3819015259 learned_addr learned my addr 172.21.15.172:0/3819015259 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd715d9b640 1 -- 172.21.15.172:0/3819015259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7180ad570 msgr2=0x7fd71806ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:56.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd715d9b640 1 --2- 172.21.15.172:0/3819015259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7180ad570 0x7fd71806ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd715d9b640 1 -- 172.21.15.172:0/3819015259 >> v1:172.21.15.186:6789/0 conn(0x7fd71806abe0 legacy=0x7fd71806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd715d9b640 1 -- 172.21.15.172:0/3819015259 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71806e660 con 0x7fd71815dd80 2024-04-25T08:45:56.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.301+0000 7fd71559a640 1 -- 172.21.15.172:0/3819015259 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602203494 0 0) 0x7fd7180b3930 con 0x7fd71806abe0 2024-04-25T08:45:56.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.302+0000 7fd715d9b640 1 --2- 172.21.15.172:0/3819015259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71815dd80 0x7fd7180b5290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0097a0 tx=0x7fd70c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=625ee4467e3fbd07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.302+0000 7fd71559a640 1 -- 172.21.15.172:0/3819015259 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c037070 con 0x7fd71815dd80 2024-04-25T08:45:56.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.302+0000 7fd71559a640 1 -- 172.21.15.172:0/3819015259 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c032440 con 0x7fd71815dd80 2024-04-25T08:45:56.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.302+0000 7fd71559a640 1 -- 172.21.15.172:0/3819015259 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c032810 con 0x7fd71815dd80 2024-04-25T08:45:56.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.303+0000 7fd71ce4a640 1 -- 172.21.15.172:0/3819015259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71815dd80 msgr2=0x7fd7180b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.303+0000 7fd71ce4a640 1 --2- 172.21.15.172:0/3819015259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71815dd80 0x7fd7180b5290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0097a0 tx=0x7fd70c02a180 comp rx=0 tx=0).stop 2024-04-25T08:45:56.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.303+0000 7fd71ce4a640 1 -- 172.21.15.172:0/3819015259 shutdown_connections 2024-04-25T08:45:56.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.303+0000 7fd71ce4a640 1 --2- 172.21.15.172:0/3819015259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7180ad570 0x7fd71806ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.303+0000 7fd71ce4a640 1 --2- 172.21.15.172:0/3819015259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71815dd80 0x7fd7180b5290 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.303+0000 7fd71ce4a640 1 -- 172.21.15.172:0/3819015259 >> 172.21.15.172:0/3819015259 conn(0x7fd7180b5af0 msgr2=0x7fd7180b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:56.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.303+0000 7fd71ce4a640 1 -- 172.21.15.172:0/3819015259 shutdown_connections 2024-04-25T08:45:56.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.303+0000 7fd71ce4a640 1 -- 172.21.15.172:0/3819015259 wait complete. 2024-04-25T08:45:56.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.304+0000 7fd71ce4a640 1 Processor -- start 2024-04-25T08:45:56.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.304+0000 7fd71ce4a640 1 -- start start 2024-04-25T08:45:56.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71ce4a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd71806abe0 0x7fd718154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71ce4a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7180ad570 0x7fd7181517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71ce4a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71815dd80 0x7fd7181505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71ce4a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd718070280 con 0x7fd71806abe0 2024-04-25T08:45:56.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71ce4a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180b57d0 con 0x7fd7180ad570 2024-04-25T08:45:56.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71ce4a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd718070400 con 0x7fd71815dd80 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd71806abe0 0x7fd718154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd71806abe0 0x7fd718154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42508/0 (socket says 172.21.15.172:42508) 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71659c640 1 -- 172.21.15.172:0/428639230 learned_addr learned my addr 172.21.15.172:0/428639230 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd715d9b640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7180ad570 0x7fd7181517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd716d9d640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71815dd80 0x7fd7181505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71659c640 1 -- 172.21.15.172:0/428639230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71815dd80 msgr2=0x7fd7181505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71659c640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71815dd80 0x7fd7181505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71659c640 1 -- 172.21.15.172:0/428639230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7180ad570 msgr2=0x7fd7181517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71659c640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7180ad570 0x7fd7181517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd71659c640 1 -- 172.21.15.172:0/428639230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd718150b00 con 0x7fd71806abe0 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.305+0000 7fd716d9d640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71815dd80 0x7fd7181505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.306+0000 7fd71659c640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd71806abe0 0x7fd718154cc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd70800c500 tx=0x7fd70800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.306+0000 7fd706ffd640 1 -- 172.21.15.172:0/428639230 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708018070 con 0x7fd71806abe0 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.306+0000 7fd706ffd640 1 -- 172.21.15.172:0/428639230 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708007580 con 0x7fd71806abe0 2024-04-25T08:45:56.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.306+0000 7fd71ce4a640 1 -- 172.21.15.172:0/428639230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd718155350 con 0x7fd71806abe0 2024-04-25T08:45:56.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.306+0000 7fd706ffd640 1 -- 172.21.15.172:0/428639230 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708004a20 con 0x7fd71806abe0 2024-04-25T08:45:56.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.306+0000 7fd71ce4a640 1 -- 172.21.15.172:0/428639230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71815e6b0 con 0x7fd71806abe0 2024-04-25T08:45:56.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.307+0000 7fd71ce4a640 1 -- 172.21.15.172:0/428639230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd718073a00 con 0x7fd71806abe0 2024-04-25T08:45:56.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.307+0000 7fd706ffd640 1 -- 172.21.15.172:0/428639230 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd70801b070 con 0x7fd71806abe0 2024-04-25T08:45:56.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.307+0000 7fd706ffd640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6f806b4d0 0x7fd6f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.308+0000 7fd706ffd640 1 -- 172.21.15.172:0/428639230 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd708089580 con 0x7fd71806abe0 2024-04-25T08:45:56.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.308+0000 7fd715d9b640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6f806b4d0 0x7fd6f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.308+0000 7fd715d9b640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6f806b4d0 0x7fd6f806d990 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd70c034000 tx=0x7fd70c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.312+0000 7fd706ffd640 1 -- 172.21.15.172:0/428639230 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd708057cb0 con 0x7fd71806abe0 2024-04-25T08:45:56.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.485+0000 7fd71ce4a640 1 -- 172.21.15.172:0/428639230 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7180adaa0 con 0x7fd71806abe0 2024-04-25T08:45:56.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.485+0000 7fd706ffd640 1 -- 172.21.15.172:0/428639230 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd70805bd50 con 0x7fd71806abe0 2024-04-25T08:45:56.477 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:45:56.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 -- 172.21.15.172:0/428639230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6f806b4d0 msgr2=0x7fd6f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6f806b4d0 0x7fd6f806d990 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd70c034000 tx=0x7fd70c02e000 comp rx=0 tx=0).stop 2024-04-25T08:45:56.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 -- 172.21.15.172:0/428639230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd71806abe0 msgr2=0x7fd718154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd71806abe0 0x7fd718154cc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd70800c500 tx=0x7fd70800c9c0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 -- 172.21.15.172:0/428639230 shutdown_connections 2024-04-25T08:45:56.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6f806b4d0 0x7fd6f806d990 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7180ad570 0x7fd7181517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71815dd80 0x7fd7181505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 --2- 172.21.15.172:0/428639230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd71806abe0 0x7fd718154cc0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 -- 172.21.15.172:0/428639230 >> 172.21.15.172:0/428639230 conn(0x7fd7180b5af0 msgr2=0x7fd7180b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:56.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 -- 172.21.15.172:0/428639230 shutdown_connections 2024-04-25T08:45:56.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.487+0000 7fd71ce4a640 1 -- 172.21.15.172:0/428639230 wait complete. 2024-04-25T08:45:56.489 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:56.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.595+0000 7f8c579fe640 1 Processor -- start 2024-04-25T08:45:56.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.596+0000 7f8c579fe640 1 -- start start 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.596+0000 7f8c579fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 0x7f8c500cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.596+0000 7f8c579fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c500cfcf0 0x7f8c500cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.596+0000 7f8c579fe640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c50071480 con 0x7f8c500ce3c0 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.596+0000 7f8c579fe640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c500ce830 con 0x7f8c500cfcf0 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.596+0000 7f8c579fe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c50072090 con 0x7f8c50154ee0 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.597+0000 7f8c54f99640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c500cfcf0 0x7f8c500cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.597+0000 7f8c54f99640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c500cfcf0 0x7f8c500cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42522/0 (socket says 172.21.15.172:42522) 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.597+0000 7f8c54f99640 1 -- 172.21.15.172:0/1362897329 learned_addr learned my addr 172.21.15.172:0/1362897329 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.597+0000 7f8c5579a640 1 --2- 172.21.15.172:0/1362897329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 0x7f8c500cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.597+0000 7f8c54f99640 1 -- 172.21.15.172:0/1362897329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 msgr2=0x7f8c500cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.597+0000 7f8c54f99640 1 --2- 172.21.15.172:0/1362897329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 0x7f8c500cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.597+0000 7f8c54f99640 1 -- 172.21.15.172:0/1362897329 >> v1:172.21.15.186:6789/0 conn(0x7f8c500ce3c0 legacy=0x7f8c5015e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:56.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.597+0000 7f8c54f99640 1 -- 172.21.15.172:0/1362897329 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c50071760 con 0x7f8c500cfcf0 2024-04-25T08:45:56.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.597+0000 7f8c5579a640 1 --2- 172.21.15.172:0/1362897329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 0x7f8c500cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:56.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c54f99640 1 --2- 172.21.15.172:0/1362897329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500cfcf0 0x7f8c500cde80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400bb10 tx=0x7f8c4402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bab1a41cde61d95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c4ffff640 1 -- 172.21.15.172:0/1362897329 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44032790 con 0x7f8c500cfcf0 2024-04-25T08:45:56.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c4ffff640 1 -- 172.21.15.172:0/1362897329 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c44038070 con 0x7f8c500cfcf0 2024-04-25T08:45:56.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c4ffff640 1 -- 172.21.15.172:0/1362897329 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44032b50 con 0x7f8c500cfcf0 2024-04-25T08:45:56.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c579fe640 1 -- 172.21.15.172:0/1362897329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500cfcf0 msgr2=0x7f8c500cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c579fe640 1 --2- 172.21.15.172:0/1362897329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500cfcf0 0x7f8c500cde80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400bb10 tx=0x7f8c4402c8d0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c579fe640 1 -- 172.21.15.172:0/1362897329 shutdown_connections 2024-04-25T08:45:56.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c579fe640 1 --2- 172.21.15.172:0/1362897329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500cfcf0 0x7f8c500cde80 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c579fe640 1 --2- 172.21.15.172:0/1362897329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 0x7f8c500cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c579fe640 1 -- 172.21.15.172:0/1362897329 >> 172.21.15.172:0/1362897329 conn(0x7f8c5006abe0 msgr2=0x7f8c5006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:56.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c579fe640 1 -- 172.21.15.172:0/1362897329 shutdown_connections 2024-04-25T08:45:56.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.598+0000 7f8c579fe640 1 -- 172.21.15.172:0/1362897329 wait complete. 2024-04-25T08:45:56.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c579fe640 1 Processor -- start 2024-04-25T08:45:56.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c579fe640 1 -- start start 2024-04-25T08:45:56.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c579fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500ce3c0 0x7f8c501516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c579fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c500cfcf0 0x7f8c50159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c579fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 0x7f8c5013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c579fe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c50071230 con 0x7f8c500ce3c0 2024-04-25T08:45:56.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c579fe640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c50071d20 con 0x7f8c500cfcf0 2024-04-25T08:45:56.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c579fe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c501552c0 con 0x7f8c50154ee0 2024-04-25T08:45:56.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c5579a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500ce3c0 0x7f8c501516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c5579a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500ce3c0 0x7f8c501516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42538/0 (socket says 172.21.15.172:42538) 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.600+0000 7f8c5579a640 1 -- 172.21.15.172:0/233126430 learned_addr learned my addr 172.21.15.172:0/233126430 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c54f99640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c500cfcf0 0x7f8c50159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c55f9b640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 0x7f8c5013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c5579a640 1 -- 172.21.15.172:0/233126430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 msgr2=0x7f8c5013fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c5579a640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 0x7f8c5013fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c5579a640 1 -- 172.21.15.172:0/233126430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c500cfcf0 msgr2=0x7f8c50159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c5579a640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c500cfcf0 0x7f8c50159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c5579a640 1 -- 172.21.15.172:0/233126430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c501f3c20 con 0x7f8c500ce3c0 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c5579a640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500ce3c0 0x7f8c501516a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800ce00 tx=0x7f8c4800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c4dffb640 1 -- 172.21.15.172:0/233126430 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800f890 con 0x7f8c500ce3c0 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c4dffb640 1 -- 172.21.15.172:0/233126430 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4800fa30 con 0x7f8c500ce3c0 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c579fe640 1 -- 172.21.15.172:0/233126430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c501f3f00 con 0x7f8c500ce3c0 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c4dffb640 1 -- 172.21.15.172:0/233126430 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800fe40 con 0x7f8c500ce3c0 2024-04-25T08:45:56.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.601+0000 7f8c579fe640 1 -- 172.21.15.172:0/233126430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c501f44c0 con 0x7f8c500ce3c0 2024-04-25T08:45:56.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.602+0000 7f8c579fe640 1 -- 172.21.15.172:0/233126430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c50073990 con 0x7f8c500ce3c0 2024-04-25T08:45:56.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.603+0000 7f8c4dffb640 1 -- 172.21.15.172:0/233126430 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c48018400 con 0x7f8c500ce3c0 2024-04-25T08:45:56.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.603+0000 7f8c4dffb640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c3c06b4d0 0x7f8c3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.603+0000 7f8c4dffb640 1 -- 172.21.15.172:0/233126430 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8c4808b1e0 con 0x7f8c500ce3c0 2024-04-25T08:45:56.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.603+0000 7f8c54f99640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c3c06b4d0 0x7f8c3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.597 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.604+0000 7f8c54f99640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c3c06b4d0 0x7f8c3c06d990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8c44037000 tx=0x7f8c44032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.607+0000 7f8c4dffb640 1 -- 172.21.15.172:0/233126430 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c48014030 con 0x7f8c500ce3c0 2024-04-25T08:45:56.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.813+0000 7f8c579fe640 1 -- 172.21.15.172:0/233126430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c5006d360 con 0x7f8c500ce3c0 2024-04-25T08:45:56.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.813+0000 7f8c4dffb640 1 -- 172.21.15.172:0/233126430 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f8c4800ae20 con 0x7f8c500ce3c0 2024-04-25T08:45:56.805 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:56.805 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:54.836472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:56.805 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 27 2024-04-25T08:45:56.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 -- 172.21.15.172:0/233126430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c3c06b4d0 msgr2=0x7f8c3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c3c06b4d0 0x7f8c3c06d990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8c44037000 tx=0x7f8c44032000 comp rx=0 tx=0).stop 2024-04-25T08:45:56.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 -- 172.21.15.172:0/233126430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500ce3c0 msgr2=0x7f8c501516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500ce3c0 0x7f8c501516a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800ce00 tx=0x7f8c4800a650 comp rx=0 tx=0).stop 2024-04-25T08:45:56.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 -- 172.21.15.172:0/233126430 shutdown_connections 2024-04-25T08:45:56.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c3c06b4d0 0x7f8c3c06d990 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c500cfcf0 0x7f8c50159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c50154ee0 0x7f8c5013fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 --2- 172.21.15.172:0/233126430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c500ce3c0 0x7f8c501516a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 -- 172.21.15.172:0/233126430 >> 172.21.15.172:0/233126430 conn(0x7f8c5006abe0 msgr2=0x7f8c5015dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:56.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 -- 172.21.15.172:0/233126430 shutdown_connections 2024-04-25T08:45:56.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.815+0000 7f8c579fe640 1 -- 172.21.15.172:0/233126430 wait complete. 2024-04-25T08:45:56.818 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:56.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.924+0000 7f7c9999e640 1 Processor -- start 2024-04-25T08:45:56.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.924+0000 7f7c9999e640 1 -- start start 2024-04-25T08:45:56.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.924+0000 7f7c9999e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7c940b2cb0 0x7f7c940d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.924+0000 7f7c9999e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940b97a0 con 0x7f7c940d1020 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.924+0000 7f7c9999e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940d1c50 con 0x7f7c9415dbe0 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.924+0000 7f7c9999e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9415dfc0 con 0x7f7c940b2cb0 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.925+0000 7f7c937fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7c940d1020 0x7f7c940d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51936/0 (socket says 172.21.15.172:51936) 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.925+0000 7f7c937fe640 1 -- 172.21.15.172:0/4086714342 learned_addr learned my addr 172.21.15.172:0/4086714342 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.925+0000 7f7c8bfff640 1 --2- 172.21.15.172:0/4086714342 >> v2:172.21.15.186:3300/0 conn(0x7f7c940b2cb0 0x7f7c940d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.925+0000 7f7c927fc640 1 -- 172.21.15.172:0/4086714342 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173429440 0 0) 0x7f7c940b97a0 con 0x7f7c940d1020 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.925+0000 7f7c927fc640 1 -- 172.21.15.172:0/4086714342 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c80003520 con 0x7f7c940d1020 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.925+0000 7f7c927fc640 1 -- 172.21.15.172:0/4086714342 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1304635118 0 0) 0x7f7c80003520 con 0x7f7c940d1020 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.925+0000 7f7c8bfff640 1 -- 172.21.15.172:0/4086714342 >> v1:172.21.15.186:6789/0 conn(0x7f7c9415dbe0 legacy=0x7f7c940d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.925+0000 7f7c8bfff640 1 -- 172.21.15.172:0/4086714342 >> v1:172.21.15.172:6789/0 conn(0x7f7c940d1020 legacy=0x7f7c940d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.925+0000 7f7c8bfff640 1 -- 172.21.15.172:0/4086714342 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940d1f30 con 0x7f7c940b2cb0 2024-04-25T08:45:56.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.926+0000 7f7c8bfff640 1 --2- 172.21.15.172:0/4086714342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c940b2cb0 0x7f7c940d2730 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0097a0 tx=0x7f7c7c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7b3d8dac1f81db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.926+0000 7f7c927fc640 1 -- 172.21.15.172:0/4086714342 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c037070 con 0x7f7c940b2cb0 2024-04-25T08:45:56.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.926+0000 7f7c927fc640 1 -- 172.21.15.172:0/4086714342 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c02ac50 con 0x7f7c940b2cb0 2024-04-25T08:45:56.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.926+0000 7f7c927fc640 1 -- 172.21.15.172:0/4086714342 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c0019f0 con 0x7f7c940b2cb0 2024-04-25T08:45:56.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.927+0000 7f7c9999e640 1 -- 172.21.15.172:0/4086714342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c940b2cb0 msgr2=0x7f7c940d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.927+0000 7f7c9999e640 1 --2- 172.21.15.172:0/4086714342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c940b2cb0 0x7f7c940d2730 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0097a0 tx=0x7f7c7c02a1c0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.927+0000 7f7c9999e640 1 -- 172.21.15.172:0/4086714342 shutdown_connections 2024-04-25T08:45:56.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.927+0000 7f7c9999e640 1 --2- 172.21.15.172:0/4086714342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c940b2cb0 0x7f7c940d2730 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.927+0000 7f7c9999e640 1 -- 172.21.15.172:0/4086714342 >> 172.21.15.172:0/4086714342 conn(0x7f7c94061a20 msgr2=0x7f7c94061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:56.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.927+0000 7f7c9999e640 1 -- 172.21.15.172:0/4086714342 shutdown_connections 2024-04-25T08:45:56.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.927+0000 7f7c9999e640 1 -- 172.21.15.172:0/4086714342 wait complete. 2024-04-25T08:45:56.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.928+0000 7f7c9999e640 1 Processor -- start 2024-04-25T08:45:56.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.928+0000 7f7c9999e640 1 -- start start 2024-04-25T08:45:56.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.928+0000 7f7c9999e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c940b2cb0 0x7f7c94154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.928+0000 7f7c9999e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c940d1020 0x7f7c940b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.928+0000 7f7c9999e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9415dbe0 0x7f7c94157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.928+0000 7f7c9999e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940b92a0 con 0x7f7c9415dbe0 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.928+0000 7f7c9999e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940d1a00 con 0x7f7c940b2cb0 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.928+0000 7f7c9999e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940b9420 con 0x7f7c940d1020 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c937fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9415dbe0 0x7f7c94157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c937fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9415dbe0 0x7f7c94157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42542/0 (socket says 172.21.15.172:42542) 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c937fe640 1 -- 172.21.15.172:0/1705777764 learned_addr learned my addr 172.21.15.172:0/1705777764 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c92ffd640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c940b2cb0 0x7f7c94154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c8bfff640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c940d1020 0x7f7c940b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c937fe640 1 -- 172.21.15.172:0/1705777764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c940d1020 msgr2=0x7f7c940b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c937fe640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c940d1020 0x7f7c940b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c937fe640 1 -- 172.21.15.172:0/1705777764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c940b2cb0 msgr2=0x7f7c94154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c937fe640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c940b2cb0 0x7f7c94154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:56.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c937fe640 1 -- 172.21.15.172:0/1705777764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c941556e0 con 0x7f7c9415dbe0 2024-04-25T08:45:56.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c8bfff640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c940d1020 0x7f7c940b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:56.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c937fe640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9415dbe0 0x7f7c94157d80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00cc30 tx=0x7f7c8c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c90ff9640 1 -- 172.21.15.172:0/1705777764 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c017070 con 0x7f7c9415dbe0 2024-04-25T08:45:56.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c90ff9640 1 -- 172.21.15.172:0/1705777764 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c00ce40 con 0x7f7c9415dbe0 2024-04-25T08:45:56.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c9999e640 1 -- 172.21.15.172:0/1705777764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c940b47b0 con 0x7f7c9415dbe0 2024-04-25T08:45:56.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c90ff9640 1 -- 172.21.15.172:0/1705777764 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c012640 con 0x7f7c9415dbe0 2024-04-25T08:45:56.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.929+0000 7f7c9999e640 1 -- 172.21.15.172:0/1705777764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c94155980 con 0x7f7c9415dbe0 2024-04-25T08:45:56.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.930+0000 7f7c9999e640 1 -- 172.21.15.172:0/1705777764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c94073990 con 0x7f7c9415dbe0 2024-04-25T08:45:56.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.931+0000 7f7c90ff9640 1 -- 172.21.15.172:0/1705777764 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c8c01a070 con 0x7f7c9415dbe0 2024-04-25T08:45:56.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.931+0000 7f7c90ff9640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c7406b4d0 0x7f7c7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:56.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.931+0000 7f7c92ffd640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c7406b4d0 0x7f7c7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:56.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.931+0000 7f7c90ff9640 1 -- 172.21.15.172:0/1705777764 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7c8c08a320 con 0x7f7c9415dbe0 2024-04-25T08:45:56.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.932+0000 7f7c92ffd640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c7406b4d0 0x7f7c7406d990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b5f30 tx=0x7f7c84009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:56.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:56.936+0000 7f7c90ff9640 1 -- 172.21.15.172:0/1705777764 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c8c059020 con 0x7f7c9415dbe0 2024-04-25T08:45:57.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.106+0000 7f7c9999e640 1 -- 172.21.15.172:0/1705777764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c9406cb10 con 0x7f7c9415dbe0 2024-04-25T08:45:57.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.107+0000 7f7c90ff9640 1 -- 172.21.15.172:0/1705777764 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17002 (secure 0 0 0) 0x7f7c8c058920 con 0x7f7c9415dbe0 2024-04-25T08:45:57.099 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:57.099 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":54,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:45:19.797206+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:45:16.357665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T08:45:17.104697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:57.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 -- 172.21.15.172:0/1705777764 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c7406b4d0 msgr2=0x7f7c7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c7406b4d0 0x7f7c7406d990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b5f30 tx=0x7f7c84009040 comp rx=0 tx=0).stop 2024-04-25T08:45:57.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 -- 172.21.15.172:0/1705777764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9415dbe0 msgr2=0x7f7c94157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9415dbe0 0x7f7c94157d80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00cc30 tx=0x7f7c8c00a430 comp rx=0 tx=0).stop 2024-04-25T08:45:57.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 -- 172.21.15.172:0/1705777764 shutdown_connections 2024-04-25T08:45:57.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c7406b4d0 0x7f7c7406d990 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9415dbe0 0x7f7c94157d80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c940d1020 0x7f7c940b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 --2- 172.21.15.172:0/1705777764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c940b2cb0 0x7f7c94154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 -- 172.21.15.172:0/1705777764 >> 172.21.15.172:0/1705777764 conn(0x7f7c94061a20 msgr2=0x7f7c940b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:57.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 -- 172.21.15.172:0/1705777764 shutdown_connections 2024-04-25T08:45:57.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.109+0000 7f7c9999e640 1 -- 172.21.15.172:0/1705777764 wait complete. 2024-04-25T08:45:57.112 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:45:57.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:57.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.219+0000 7fca252e2640 1 Processor -- start 2024-04-25T08:45:57.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.219+0000 7fca252e2640 1 -- start start 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca252e2640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca2015dbe0 0x7fca200d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca252e2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fca200b92a0 0x7fca200d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca252e2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca200b97a0 con 0x7fca200b2cb0 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca252e2640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2015dfc0 con 0x7fca2015dbe0 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca252e2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca200d1a00 con 0x7fca200b92a0 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca1effd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca2015dbe0 0x7fca200d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca17fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fca200b2cb0 0x7fca200b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51938/0 (socket says 172.21.15.172:51938) 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca17fff640 1 -- 172.21.15.172:0/3209077861 learned_addr learned my addr 172.21.15.172:0/3209077861 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca1f7fe640 1 --2- 172.21.15.172:0/3209077861 >> v2:172.21.15.186:3300/0 conn(0x7fca200b92a0 0x7fca200d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca1effd640 1 -- 172.21.15.172:0/3209077861 >> v2:172.21.15.186:3300/0 conn(0x7fca200b92a0 msgr2=0x7fca200d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca1effd640 1 --2- 172.21.15.172:0/3209077861 >> v2:172.21.15.186:3300/0 conn(0x7fca200b92a0 0x7fca200d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca1effd640 1 -- 172.21.15.172:0/3209077861 >> v1:172.21.15.172:6789/0 conn(0x7fca200b2cb0 legacy=0x7fca200b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca1e7fc640 1 -- 172.21.15.172:0/3209077861 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856331016 0 0) 0x7fca200b97a0 con 0x7fca200b2cb0 2024-04-25T08:45:57.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca1effd640 1 -- 172.21.15.172:0/3209077861 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca200d1c50 con 0x7fca2015dbe0 2024-04-25T08:45:57.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.220+0000 7fca1f7fe640 1 --2- 172.21.15.172:0/3209077861 >> v2:172.21.15.186:3300/0 conn(0x7fca200b92a0 0x7fca200d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:57.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.221+0000 7fca1effd640 1 --2- 172.21.15.172:0/3209077861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dbe0 0x7fca200d0910 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fca200cfb90 tx=0x7fca1002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f181590f014a67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:57.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.221+0000 7fca1e7fc640 1 -- 172.21.15.172:0/3209077861 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10037070 con 0x7fca2015dbe0 2024-04-25T08:45:57.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.221+0000 7fca1e7fc640 1 -- 172.21.15.172:0/3209077861 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10032440 con 0x7fca2015dbe0 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.221+0000 7fca1e7fc640 1 -- 172.21.15.172:0/3209077861 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1002ae60 con 0x7fca2015dbe0 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.222+0000 7fca252e2640 1 -- 172.21.15.172:0/3209077861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dbe0 msgr2=0x7fca200d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.222+0000 7fca252e2640 1 --2- 172.21.15.172:0/3209077861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dbe0 0x7fca200d0910 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fca200cfb90 tx=0x7fca1002a110 comp rx=0 tx=0).stop 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.222+0000 7fca252e2640 1 -- 172.21.15.172:0/3209077861 shutdown_connections 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.222+0000 7fca252e2640 1 --2- 172.21.15.172:0/3209077861 >> v2:172.21.15.186:3300/0 conn(0x7fca200b92a0 0x7fca200d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.222+0000 7fca252e2640 1 --2- 172.21.15.172:0/3209077861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dbe0 0x7fca200d0910 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.222+0000 7fca252e2640 1 -- 172.21.15.172:0/3209077861 >> 172.21.15.172:0/3209077861 conn(0x7fca20061a20 msgr2=0x7fca20061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.222+0000 7fca252e2640 1 -- 172.21.15.172:0/3209077861 shutdown_connections 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.222+0000 7fca252e2640 1 -- 172.21.15.172:0/3209077861 wait complete. 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.223+0000 7fca252e2640 1 Processor -- start 2024-04-25T08:45:57.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.223+0000 7fca252e2640 1 -- start start 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca252e2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200b2cb0 0x7fca200caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca252e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca200b92a0 0x7fca20157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca252e2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2015dbe0 0x7fca200ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca252e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca200b6ab0 con 0x7fca200b92a0 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca252e2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca200d2210 con 0x7fca200b2cb0 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca252e2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca200b6c30 con 0x7fca2015dbe0 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca17fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca200b92a0 0x7fca20157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca17fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca200b92a0 0x7fca20157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42568/0 (socket says 172.21.15.172:42568) 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca17fff640 1 -- 172.21.15.172:0/2287092584 learned_addr learned my addr 172.21.15.172:0/2287092584 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca1effd640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200b2cb0 0x7fca200caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca1f7fe640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2015dbe0 0x7fca200ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca17fff640 1 -- 172.21.15.172:0/2287092584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2015dbe0 msgr2=0x7fca200ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca17fff640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2015dbe0 0x7fca200ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca17fff640 1 -- 172.21.15.172:0/2287092584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200b2cb0 msgr2=0x7fca200caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca17fff640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200b2cb0 0x7fca200caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca17fff640 1 -- 172.21.15.172:0/2287092584 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca200cb410 con 0x7fca200b92a0 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca17fff640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca200b92a0 0x7fca20157310 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fca0800c4b0 tx=0x7fca0800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca177fe640 1 -- 172.21.15.172:0/2287092584 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08018070 con 0x7fca200b92a0 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca177fe640 1 -- 172.21.15.172:0/2287092584 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08007500 con 0x7fca200b92a0 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca252e2640 1 -- 172.21.15.172:0/2287092584 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca20155860 con 0x7fca200b92a0 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca177fe640 1 -- 172.21.15.172:0/2287092584 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08004a20 con 0x7fca200b92a0 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.224+0000 7fca252e2640 1 -- 172.21.15.172:0/2287092584 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca200cc380 con 0x7fca200b92a0 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.225+0000 7fca252e2640 1 -- 172.21.15.172:0/2287092584 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca20073990 con 0x7fca200b92a0 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.226+0000 7fca177fe640 1 -- 172.21.15.172:0/2287092584 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca0801b070 con 0x7fca200b92a0 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.226+0000 7fca177fe640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0006b4d0 0x7fca0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.226+0000 7fca177fe640 1 -- 172.21.15.172:0/2287092584 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fca08089760 con 0x7fca200b92a0 2024-04-25T08:45:57.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.226+0000 7fca1effd640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0006b4d0 0x7fca0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.227+0000 7fca1effd640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0006b4d0 0x7fca0006d990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fca10034000 tx=0x7fca1002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:57.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.230+0000 7fca177fe640 1 -- 172.21.15.172:0/2287092584 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca08058470 con 0x7fca200b92a0 2024-04-25T08:45:57.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.437+0000 7fca252e2640 1 -- 172.21.15.172:0/2287092584 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca2006c800 con 0x7fca200b92a0 2024-04-25T08:45:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.438+0000 7fca177fe640 1 -- 172.21.15.172:0/2287092584 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4951 (secure 0 0 0) 0x7fca08057d70 con 0x7fca200b92a0 2024-04-25T08:45:57.430 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:57.430 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:54.836472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:57.430 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 27 2024-04-25T08:45:57.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 -- 172.21.15.172:0/2287092584 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0006b4d0 msgr2=0x7fca0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0006b4d0 0x7fca0006d990 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fca10034000 tx=0x7fca1002e000 comp rx=0 tx=0).stop 2024-04-25T08:45:57.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 -- 172.21.15.172:0/2287092584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca200b92a0 msgr2=0x7fca20157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca200b92a0 0x7fca20157310 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fca0800c4b0 tx=0x7fca0800c970 comp rx=0 tx=0).stop 2024-04-25T08:45:57.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 -- 172.21.15.172:0/2287092584 shutdown_connections 2024-04-25T08:45:57.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0006b4d0 0x7fca0006d990 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2015dbe0 0x7fca200ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca200b92a0 0x7fca20157310 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 --2- 172.21.15.172:0/2287092584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200b2cb0 0x7fca200caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 -- 172.21.15.172:0/2287092584 >> 172.21.15.172:0/2287092584 conn(0x7fca20061a20 msgr2=0x7fca2015ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:57.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 -- 172.21.15.172:0/2287092584 shutdown_connections 2024-04-25T08:45:57.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.440+0000 7fca252e2640 1 -- 172.21.15.172:0/2287092584 wait complete. 2024-04-25T08:45:57.443 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:45:57.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.548+0000 7f562f970640 1 Processor -- start 2024-04-25T08:45:57.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.548+0000 7f562f970640 1 -- start start 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562f970640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5628154ee0 0x7f56280cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562f970640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f56280cfcf0 0x7f56280cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562f970640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5628071480 con 0x7f56280ce3c0 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562f970640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56280ce830 con 0x7f5628154ee0 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562f970640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5628072090 con 0x7f56280cfcf0 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562d70c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5628154ee0 0x7f56280cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562df0d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f56280ce3c0 0x7f562815e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41836/0 (socket says 172.21.15.172:41836) 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562df0d640 1 -- 172.21.15.172:0/3344290089 learned_addr learned my addr 172.21.15.172:0/3344290089 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562d70c640 1 -- 172.21.15.172:0/3344290089 >> v2:172.21.15.186:3300/0 conn(0x7f56280cfcf0 msgr2=0x7f56280cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562cf0b640 1 --2- 172.21.15.172:0/3344290089 >> v2:172.21.15.186:3300/0 conn(0x7f56280cfcf0 0x7f56280cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562d70c640 1 --2- 172.21.15.172:0/3344290089 >> v2:172.21.15.186:3300/0 conn(0x7f56280cfcf0 0x7f56280cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f561ffff640 1 -- 172.21.15.172:0/3344290089 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135353002 0 0) 0x7f5628071480 con 0x7f56280ce3c0 2024-04-25T08:45:57.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562d70c640 1 -- 172.21.15.172:0/3344290089 >> v1:172.21.15.172:6789/0 conn(0x7f56280ce3c0 legacy=0x7f562815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562d70c640 1 -- 172.21.15.172:0/3344290089 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628071760 con 0x7f5628154ee0 2024-04-25T08:45:57.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.549+0000 7f562cf0b640 1 --2- 172.21.15.172:0/3344290089 >> v2:172.21.15.186:3300/0 conn(0x7f56280cfcf0 0x7f56280cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:57.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.550+0000 7f562d70c640 1 --2- 172.21.15.172:0/3344290089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 0x7f56280cf7b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f56280cf560 tx=0x7f562402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecdd609fc0ad464 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:57.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.550+0000 7f561ffff640 1 -- 172.21.15.172:0/3344290089 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624037070 con 0x7f5628154ee0 2024-04-25T08:45:57.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.550+0000 7f561ffff640 1 -- 172.21.15.172:0/3344290089 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5624032440 con 0x7f5628154ee0 2024-04-25T08:45:57.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.550+0000 7f561ffff640 1 -- 172.21.15.172:0/3344290089 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624032810 con 0x7f5628154ee0 2024-04-25T08:45:57.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.550+0000 7f562f970640 1 -- 172.21.15.172:0/3344290089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 msgr2=0x7f56280cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.550+0000 7f562f970640 1 --2- 172.21.15.172:0/3344290089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 0x7f56280cf7b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f56280cf560 tx=0x7f562402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.551+0000 7f562f970640 1 -- 172.21.15.172:0/3344290089 shutdown_connections 2024-04-25T08:45:57.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.551+0000 7f562f970640 1 --2- 172.21.15.172:0/3344290089 >> v2:172.21.15.186:3300/0 conn(0x7f56280cfcf0 0x7f56280cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.551+0000 7f562f970640 1 --2- 172.21.15.172:0/3344290089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 0x7f56280cf7b0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.551+0000 7f562f970640 1 -- 172.21.15.172:0/3344290089 >> 172.21.15.172:0/3344290089 conn(0x7f562806abe0 msgr2=0x7f562806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:57.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.551+0000 7f562f970640 1 -- 172.21.15.172:0/3344290089 shutdown_connections 2024-04-25T08:45:57.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.551+0000 7f562f970640 1 -- 172.21.15.172:0/3344290089 wait complete. 2024-04-25T08:45:57.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.552+0000 7f562f970640 1 Processor -- start 2024-04-25T08:45:57.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.552+0000 7f562f970640 1 -- start start 2024-04-25T08:45:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.552+0000 7f562f970640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56280ce3c0 0x7f5628151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.552+0000 7f562f970640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56280cfcf0 0x7f5628158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.552+0000 7f562f970640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 0x7f56281efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.552+0000 7f562f970640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5628071d20 con 0x7f5628154ee0 2024-04-25T08:45:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.552+0000 7f562f970640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5628071230 con 0x7f56280cfcf0 2024-04-25T08:45:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.552+0000 7f562f970640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56281552c0 con 0x7f56280ce3c0 2024-04-25T08:45:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562df0d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 0x7f56281efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562df0d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 0x7f56281efa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50990/0 (socket says 172.21.15.172:50990) 2024-04-25T08:45:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562df0d640 1 -- 172.21.15.172:0/554527669 learned_addr learned my addr 172.21.15.172:0/554527669 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:57.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562cf0b640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56280cfcf0 0x7f5628158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562df0d640 1 -- 172.21.15.172:0/554527669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56280ce3c0 msgr2=0x7f5628151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562d70c640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56280ce3c0 0x7f5628151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562df0d640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56280ce3c0 0x7f5628151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562df0d640 1 -- 172.21.15.172:0/554527669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56280cfcf0 msgr2=0x7f5628158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562df0d640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56280cfcf0 0x7f5628158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562df0d640 1 -- 172.21.15.172:0/554527669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628159000 con 0x7f5628154ee0 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562cf0b640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56280cfcf0 0x7f5628158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562df0d640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 0x7f56281efa10 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f562000c7d0 tx=0x7f562000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f561dffb640 1 -- 172.21.15.172:0/554527669 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620018070 con 0x7f5628154ee0 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f561dffb640 1 -- 172.21.15.172:0/554527669 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562000a5e0 con 0x7f5628154ee0 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562f970640 1 -- 172.21.15.172:0/554527669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56281592e0 con 0x7f5628154ee0 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f561dffb640 1 -- 172.21.15.172:0/554527669 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562000aa10 con 0x7f5628154ee0 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.553+0000 7f562f970640 1 -- 172.21.15.172:0/554527669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5628159b80 con 0x7f5628154ee0 2024-04-25T08:45:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.554+0000 7f562f970640 1 -- 172.21.15.172:0/554527669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56280d0280 con 0x7f5628154ee0 2024-04-25T08:45:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.555+0000 7f561dffb640 1 -- 172.21.15.172:0/554527669 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f562001b070 con 0x7f5628154ee0 2024-04-25T08:45:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.555+0000 7f561dffb640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f560c06b4d0 0x7f560c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.555+0000 7f561dffb640 1 -- 172.21.15.172:0/554527669 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5620089970 con 0x7f5628154ee0 2024-04-25T08:45:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.555+0000 7f562d70c640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f560c06b4d0 0x7f560c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.556+0000 7f562d70c640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f560c06b4d0 0x7f560c06d990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5624034000 tx=0x7f562402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:57.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.559+0000 7f561dffb640 1 -- 172.21.15.172:0/554527669 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56280d0280 con 0x7f5628154ee0 2024-04-25T08:45:57.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.763+0000 7f562f970640 1 -- 172.21.15.172:0/554527669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5628073990 con 0x7f5628154ee0 2024-04-25T08:45:57.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.764+0000 7f561dffb640 1 -- 172.21.15.172:0/554527669 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f5620058660 con 0x7f5628154ee0 2024-04-25T08:45:57.756 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:57.756 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:45:18.132665+0000","modified":"2024-04-25T08:45:54.836472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5877},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5877":{"gid":5877,"name":"d","rank":0,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.186:6835/3075611853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3075611853},{"type":"v1","addr":"172.21.15.186:6835","nonce":3075611853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T08:45:57.756 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 27 2024-04-25T08:45:57.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 -- 172.21.15.172:0/554527669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f560c06b4d0 msgr2=0x7f560c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f560c06b4d0 0x7f560c06d990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5624034000 tx=0x7f562402e000 comp rx=0 tx=0).stop 2024-04-25T08:45:57.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 -- 172.21.15.172:0/554527669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 msgr2=0x7f56281efa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 0x7f56281efa10 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f562000c7d0 tx=0x7f562000cc90 comp rx=0 tx=0).stop 2024-04-25T08:45:57.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 -- 172.21.15.172:0/554527669 shutdown_connections 2024-04-25T08:45:57.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f560c06b4d0 0x7f560c06d990 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56280cfcf0 0x7f5628158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5628154ee0 0x7f56281efa10 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 --2- 172.21.15.172:0/554527669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56280ce3c0 0x7f5628151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 -- 172.21.15.172:0/554527669 >> 172.21.15.172:0/554527669 conn(0x7f562806abe0 msgr2=0x7f56280b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:57.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 -- 172.21.15.172:0/554527669 shutdown_connections 2024-04-25T08:45:57.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.766+0000 7f562f970640 1 -- 172.21.15.172:0/554527669 wait complete. 2024-04-25T08:45:57.769 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:45:57.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.874+0000 7fbc6413b640 1 Processor -- start 2024-04-25T08:45:57.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.874+0000 7fbc6413b640 1 -- start start 2024-04-25T08:45:57.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.875+0000 7fbc6413b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbc5c071ac0 0x7fbc5c0ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.875+0000 7fbc6413b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c06c1d0 0x7fbc5c06afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.875+0000 7fbc6413b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5c15ec60 con 0x7fbc5c154ed0 2024-04-25T08:45:57.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.875+0000 7fbc6413b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5c15ef40 con 0x7fbc5c071ac0 2024-04-25T08:45:57.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.875+0000 7fbc6413b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c06db90 con 0x7fbc5c06c1d0 2024-04-25T08:45:57.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.876+0000 7fbc626d8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c06c1d0 0x7fbc5c06afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.876+0000 7fbc616d6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbc5c071ac0 0x7fbc5c0ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.876+0000 7fbc616d6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbc5c071ac0 0x7fbc5c0ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:58996/0 (socket says 172.21.15.172:58996) 2024-04-25T08:45:57.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.876+0000 7fbc616d6640 1 -- 172.21.15.172:0/1857652330 learned_addr learned my addr 172.21.15.172:0/1857652330 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:57.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.876+0000 7fbc61ed7640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fbc5c154ed0 0x7fbc5c0aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:48464/0 (socket says 172.21.15.172:48464) 2024-04-25T08:45:57.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.876+0000 7fbc626d8640 1 -- 172.21.15.172:0/1857652330 >> v2:172.21.15.186:3300/0 conn(0x7fbc5c071ac0 msgr2=0x7fbc5c0ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:57.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.876+0000 7fbc626d8640 1 --2- 172.21.15.172:0/1857652330 >> v2:172.21.15.186:3300/0 conn(0x7fbc5c071ac0 0x7fbc5c0ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.876+0000 7fbc626d8640 1 -- 172.21.15.172:0/1857652330 >> v1:172.21.15.186:6789/0 conn(0x7fbc5c154ed0 legacy=0x7fbc5c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.876+0000 7fbc626d8640 1 -- 172.21.15.172:0/1857652330 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c06de70 con 0x7fbc5c06c1d0 2024-04-25T08:45:57.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.876+0000 7fbc616d6640 1 --2- 172.21.15.172:0/1857652330 >> v2:172.21.15.186:3300/0 conn(0x7fbc5c071ac0 0x7fbc5c0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:45:57.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc626d8640 1 --2- 172.21.15.172:0/1857652330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c06c1d0 0x7fbc5c06afa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbc540097a0 tx=0x7fbc5402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7573304de505a144 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:57.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc60ed5640 1 -- 172.21.15.172:0/1857652330 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54037070 con 0x7fbc5c06c1d0 2024-04-25T08:45:57.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc60ed5640 1 -- 172.21.15.172:0/1857652330 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54032440 con 0x7fbc5c06c1d0 2024-04-25T08:45:57.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc60ed5640 1 -- 172.21.15.172:0/1857652330 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54032810 con 0x7fbc5c06c1d0 2024-04-25T08:45:57.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc6413b640 1 -- 172.21.15.172:0/1857652330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c06c1d0 msgr2=0x7fbc5c06afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc6413b640 1 --2- 172.21.15.172:0/1857652330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c06c1d0 0x7fbc5c06afa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbc540097a0 tx=0x7fbc5402a180 comp rx=0 tx=0).stop 2024-04-25T08:45:57.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc6413b640 1 -- 172.21.15.172:0/1857652330 shutdown_connections 2024-04-25T08:45:57.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc6413b640 1 --2- 172.21.15.172:0/1857652330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c06c1d0 0x7fbc5c06afa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc6413b640 1 --2- 172.21.15.172:0/1857652330 >> v2:172.21.15.186:3300/0 conn(0x7fbc5c071ac0 0x7fbc5c0ad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc6413b640 1 -- 172.21.15.172:0/1857652330 >> 172.21.15.172:0/1857652330 conn(0x7fbc5c0af670 msgr2=0x7fbc5c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:57.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc6413b640 1 -- 172.21.15.172:0/1857652330 shutdown_connections 2024-04-25T08:45:57.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.877+0000 7fbc6413b640 1 -- 172.21.15.172:0/1857652330 wait complete. 2024-04-25T08:45:57.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc6413b640 1 Processor -- start 2024-04-25T08:45:57.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc6413b640 1 -- start start 2024-04-25T08:45:57.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc6413b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5c071ac0 0x7fbc5c14bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc6413b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5c154ed0 0x7fbc5c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc6413b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c0b1ed0 0x7fbc5c14fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc6413b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c06b660 con 0x7fbc5c154ed0 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc6413b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c06b4e0 con 0x7fbc5c071ac0 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc6413b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c06b7e0 con 0x7fbc5c0b1ed0 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc616d6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5c154ed0 0x7fbc5c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc616d6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5c154ed0 0x7fbc5c0cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51004/0 (socket says 172.21.15.172:51004) 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc616d6640 1 -- 172.21.15.172:0/1771230664 learned_addr learned my addr 172.21.15.172:0/1771230664 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.879+0000 7fbc61ed7640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5c071ac0 0x7fbc5c14bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc626d8640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c0b1ed0 0x7fbc5c14fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc616d6640 1 -- 172.21.15.172:0/1771230664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c0b1ed0 msgr2=0x7fbc5c14fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc616d6640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c0b1ed0 0x7fbc5c14fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc616d6640 1 -- 172.21.15.172:0/1771230664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5c071ac0 msgr2=0x7fbc5c14bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc616d6640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5c071ac0 0x7fbc5c14bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc616d6640 1 -- 172.21.15.172:0/1771230664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c0ce8c0 con 0x7fbc5c154ed0 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc616d6640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5c154ed0 0x7fbc5c0cd540 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00e9d0 tx=0x7fbc4c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc527fc640 1 -- 172.21.15.172:0/1771230664 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c017070 con 0x7fbc5c154ed0 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc527fc640 1 -- 172.21.15.172:0/1771230664 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c00ca60 con 0x7fbc5c154ed0 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc6413b640 1 -- 172.21.15.172:0/1771230664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c0ce020 con 0x7fbc5c154ed0 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc527fc640 1 -- 172.21.15.172:0/1771230664 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00ce10 con 0x7fbc5c154ed0 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.880+0000 7fbc6413b640 1 -- 172.21.15.172:0/1771230664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c0ce5e0 con 0x7fbc5c154ed0 2024-04-25T08:45:57.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.881+0000 7fbc6413b640 1 -- 172.21.15.172:0/1771230664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c0b2b10 con 0x7fbc5c154ed0 2024-04-25T08:45:57.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.882+0000 7fbc527fc640 1 -- 172.21.15.172:0/1771230664 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbc4c01a070 con 0x7fbc5c154ed0 2024-04-25T08:45:57.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.882+0000 7fbc527fc640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc4006b4d0 0x7fbc4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:57.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.882+0000 7fbc61ed7640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc4006b4d0 0x7fbc4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:57.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.882+0000 7fbc527fc640 1 -- 172.21.15.172:0/1771230664 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbc4c08a5c0 con 0x7fbc5c154ed0 2024-04-25T08:45:57.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.883+0000 7fbc61ed7640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc4006b4d0 0x7fbc4006d990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbc58007fd0 tx=0x7fbc58001630 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:57.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:57.886+0000 7fbc527fc640 1 -- 172.21.15.172:0/1771230664 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc4c058c70 con 0x7fbc5c154ed0 2024-04-25T08:45:58.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.058+0000 7fbc6413b640 1 -- 172.21.15.172:0/1771230664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc5c161c00 con 0x7fbc5c154ed0 2024-04-25T08:45:58.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.059+0000 7fbc527fc640 1 -- 172.21.15.172:0/1771230664 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17002 (secure 0 0 0) 0x7fbc4c05cd10 con 0x7fbc5c154ed0 2024-04-25T08:45:58.051 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:45:58.052 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":54,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:45:19.797206+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:45:16.357665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T08:45:17.104697+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:45:58.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.061+0000 7fbc6413b640 1 -- 172.21.15.172:0/1771230664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc4006b4d0 msgr2=0x7fbc4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.061+0000 7fbc6413b640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc4006b4d0 0x7fbc4006d990 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbc58007fd0 tx=0x7fbc58001630 comp rx=0 tx=0).stop 2024-04-25T08:45:58.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.061+0000 7fbc6413b640 1 -- 172.21.15.172:0/1771230664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5c154ed0 msgr2=0x7fbc5c0cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.061+0000 7fbc6413b640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5c154ed0 0x7fbc5c0cd540 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00e9d0 tx=0x7fbc4c00ee90 comp rx=0 tx=0).stop 2024-04-25T08:45:58.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.061+0000 7fbc6413b640 1 -- 172.21.15.172:0/1771230664 shutdown_connections 2024-04-25T08:45:58.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.061+0000 7fbc6413b640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc4006b4d0 0x7fbc4006d990 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.061+0000 7fbc6413b640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5c0b1ed0 0x7fbc5c14fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.061+0000 7fbc6413b640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5c154ed0 0x7fbc5c0cd540 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.061+0000 7fbc6413b640 1 --2- 172.21.15.172:0/1771230664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5c071ac0 0x7fbc5c14bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.061+0000 7fbc6413b640 1 -- 172.21.15.172:0/1771230664 >> 172.21.15.172:0/1771230664 conn(0x7fbc5c06c1d0 msgr2=0x7fbc5c0aced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:58.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.062+0000 7fbc6413b640 1 -- 172.21.15.172:0/1771230664 shutdown_connections 2024-04-25T08:45:58.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.062+0000 7fbc6413b640 1 -- 172.21.15.172:0/1771230664 wait complete. 2024-04-25T08:45:58.064 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:45:58.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.170+0000 7ff8a68cb640 1 Processor -- start 2024-04-25T08:45:58.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.170+0000 7ff8a68cb640 1 -- start start 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff8a68cb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff8a00af6c0 0x7ff8a006abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff8a68cb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a006b120 0x7ff8a00ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff8a68cb640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a00afb20 con 0x7ff8a015dc70 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff8a68cb640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a006b590 con 0x7ff8a00af6c0 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff8a68cb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00b3590 con 0x7ff8a006b120 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff89f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff8a00af6c0 0x7ff8a006abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff89ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff8a015dc70 0x7ff8a006f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41852/0 (socket says 172.21.15.172:41852) 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff89ffff640 1 -- 172.21.15.172:0/3026793871 learned_addr learned my addr 172.21.15.172:0/3026793871 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff8a4e68640 1 --2- 172.21.15.172:0/3026793871 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a006b120 0x7ff8a00ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff89f7fe640 1 -- 172.21.15.172:0/3026793871 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a006b120 msgr2=0x7ff8a00ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff89f7fe640 1 --2- 172.21.15.172:0/3026793871 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a006b120 0x7ff8a00ad570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff89f7fe640 1 -- 172.21.15.172:0/3026793871 >> v1:172.21.15.172:6789/0 conn(0x7ff8a015dc70 legacy=0x7ff8a006f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff89f7fe640 1 -- 172.21.15.172:0/3026793871 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a006f8a0 con 0x7ff8a00af6c0 2024-04-25T08:45:58.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.171+0000 7ff89effd640 1 -- 172.21.15.172:0/3026793871 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474717089 0 0) 0x7ff8a00afb20 con 0x7ff8a015dc70 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.172+0000 7ff89f7fe640 1 --2- 172.21.15.172:0/3026793871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a00af6c0 0x7ff8a006abe0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ff8940097a0 tx=0x7ff89402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363ccf65cbb5e06b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.172+0000 7ff89effd640 1 -- 172.21.15.172:0/3026793871 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894037070 con 0x7ff8a00af6c0 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.172+0000 7ff89effd640 1 -- 172.21.15.172:0/3026793871 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89402adb0 con 0x7ff8a00af6c0 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.172+0000 7ff89effd640 1 -- 172.21.15.172:0/3026793871 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894032660 con 0x7ff8a00af6c0 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.173+0000 7ff8a68cb640 1 -- 172.21.15.172:0/3026793871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a00af6c0 msgr2=0x7ff8a006abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.173+0000 7ff8a68cb640 1 --2- 172.21.15.172:0/3026793871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a00af6c0 0x7ff8a006abe0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ff8940097a0 tx=0x7ff89402a060 comp rx=0 tx=0).stop 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.173+0000 7ff8a68cb640 1 -- 172.21.15.172:0/3026793871 shutdown_connections 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.173+0000 7ff8a68cb640 1 --2- 172.21.15.172:0/3026793871 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a006b120 0x7ff8a00ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.173+0000 7ff8a68cb640 1 --2- 172.21.15.172:0/3026793871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a00af6c0 0x7ff8a006abe0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.173+0000 7ff8a68cb640 1 -- 172.21.15.172:0/3026793871 >> 172.21.15.172:0/3026793871 conn(0x7ff8a00b5af0 msgr2=0x7ff8a00b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:58.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.173+0000 7ff8a68cb640 1 -- 172.21.15.172:0/3026793871 shutdown_connections 2024-04-25T08:45:58.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.173+0000 7ff8a68cb640 1 -- 172.21.15.172:0/3026793871 wait complete. 2024-04-25T08:45:58.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.174+0000 7ff8a68cb640 1 Processor -- start 2024-04-25T08:45:58.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.174+0000 7ff8a68cb640 1 -- start start 2024-04-25T08:45:58.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a68cb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8a006b120 0x7ff8a015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a68cb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a00af6c0 0x7ff8a0141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a68cb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a015dc70 0x7ff8a01f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a68cb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00b3ac0 con 0x7ff8a015dc70 2024-04-25T08:45:58.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a68cb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00b37e0 con 0x7ff8a006b120 2024-04-25T08:45:58.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a68cb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00b3da0 con 0x7ff8a00af6c0 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a4e68640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a015dc70 0x7ff8a01f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a4e68640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a015dc70 0x7ff8a01f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51020/0 (socket says 172.21.15.172:51020) 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a4e68640 1 -- 172.21.15.172:0/2297945513 learned_addr learned my addr 172.21.15.172:0/2297945513 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff89ffff640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8a006b120 0x7ff8a015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff89f7fe640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a00af6c0 0x7ff8a0141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a4e68640 1 -- 172.21.15.172:0/2297945513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a00af6c0 msgr2=0x7ff8a0141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a4e68640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a00af6c0 0x7ff8a0141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a4e68640 1 -- 172.21.15.172:0/2297945513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8a006b120 msgr2=0x7ff8a015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a4e68640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8a006b120 0x7ff8a015fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a4e68640 1 -- 172.21.15.172:0/2297945513 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a0160a10 con 0x7ff8a015dc70 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff89f7fe640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a00af6c0 0x7ff8a0141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff8a4e68640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a015dc70 0x7ff8a01f2920 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff89800cda0 tx=0x7ff89800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.175+0000 7ff89cff9640 1 -- 172.21.15.172:0/2297945513 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898003b90 con 0x7ff8a015dc70 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.176+0000 7ff89cff9640 1 -- 172.21.15.172:0/2297945513 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff898003d30 con 0x7ff8a015dc70 2024-04-25T08:45:58.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.176+0000 7ff8a68cb640 1 -- 172.21.15.172:0/2297945513 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a0160170 con 0x7ff8a015dc70 2024-04-25T08:45:58.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.176+0000 7ff89cff9640 1 -- 172.21.15.172:0/2297945513 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898004240 con 0x7ff8a015dc70 2024-04-25T08:45:58.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.176+0000 7ff8a68cb640 1 -- 172.21.15.172:0/2297945513 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a0160730 con 0x7ff8a015dc70 2024-04-25T08:45:58.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.177+0000 7ff8a68cb640 1 -- 172.21.15.172:0/2297945513 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a006cc80 con 0x7ff8a015dc70 2024-04-25T08:45:58.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.177+0000 7ff89cff9640 1 -- 172.21.15.172:0/2297945513 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff8980043e0 con 0x7ff8a015dc70 2024-04-25T08:45:58.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.177+0000 7ff89cff9640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff88c06b4d0 0x7ff88c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.178+0000 7ff89ffff640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff88c06b4d0 0x7ff88c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.178+0000 7ff89cff9640 1 -- 172.21.15.172:0/2297945513 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff89808add0 con 0x7ff8a015dc70 2024-04-25T08:45:58.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.178+0000 7ff89ffff640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff88c06b4d0 0x7ff88c06d990 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff890007fd0 tx=0x7ff890007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:58.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.181+0000 7ff89cff9640 1 -- 172.21.15.172:0/2297945513 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff898059ac0 con 0x7ff8a015dc70 2024-04-25T08:45:58.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.393+0000 7ff8a68cb640 1 -- 172.21.15.172:0/2297945513 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff8a00d14f0 con 0x7ff8a015dc70 2024-04-25T08:45:58.385 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:45:58.393+0000 7f9412b2f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:45:58.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.395+0000 7ff89cff9640 1 -- 172.21.15.172:0/2297945513 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff8a00d14f0 con 0x7ff8a015dc70 2024-04-25T08:45:58.386 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 -- 172.21.15.172:0/2297945513 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff88c06b4d0 msgr2=0x7ff88c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff88c06b4d0 0x7ff88c06d990 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff890007fd0 tx=0x7ff890007de0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 -- 172.21.15.172:0/2297945513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a015dc70 msgr2=0x7ff8a01f2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a015dc70 0x7ff8a01f2920 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff89800cda0 tx=0x7ff89800a660 comp rx=0 tx=0).stop 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 -- 172.21.15.172:0/2297945513 shutdown_connections 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff88c06b4d0 0x7ff88c06d990 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a015dc70 0x7ff8a01f2920 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8a00af6c0 0x7ff8a0141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 --2- 172.21.15.172:0/2297945513 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8a006b120 0x7ff8a015fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 -- 172.21.15.172:0/2297945513 >> 172.21.15.172:0/2297945513 conn(0x7ff8a00b5af0 msgr2=0x7ff8a00b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 -- 172.21.15.172:0/2297945513 shutdown_connections 2024-04-25T08:45:58.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.398+0000 7ff8a68cb640 1 -- 172.21.15.172:0/2297945513 wait complete. 2024-04-25T08:45:58.401 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:45:58.430 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:45:58.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.509+0000 7f30d446f640 1 Processor -- start 2024-04-25T08:45:58.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.509+0000 7f30d446f640 1 -- start start 2024-04-25T08:45:58.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d446f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f30cc15eec0 0x7f30cc1689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d446f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc0d1770 con 0x7f30cc070dc0 2024-04-25T08:45:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d446f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc162740 con 0x7f30cc06ccd0 2024-04-25T08:45:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d446f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc0b0eb0 con 0x7f30cc15eec0 2024-04-25T08:45:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d2a0c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f30cc15eec0 0x7f30cc1689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d220b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f30cc070dc0 0x7f30cc0711a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41854/0 (socket says 172.21.15.172:41854) 2024-04-25T08:45:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d2a0c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f30cc15eec0 0x7f30cc1689d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51034/0 (socket says 172.21.15.172:51034) 2024-04-25T08:45:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d220b640 1 -- 172.21.15.172:0/3066478147 learned_addr learned my addr 172.21.15.172:0/3066478147 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d2a0c640 1 -- 172.21.15.172:0/3066478147 >> v1:172.21.15.186:6789/0 conn(0x7f30cc06ccd0 legacy=0x7f30cc0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d2a0c640 1 -- 172.21.15.172:0/3066478147 >> v1:172.21.15.172:6789/0 conn(0x7f30cc070dc0 legacy=0x7f30cc0711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.510+0000 7f30d2a0c640 1 -- 172.21.15.172:0/3066478147 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc161980 con 0x7f30cc15eec0 2024-04-25T08:45:58.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.511+0000 7f30d2a0c640 1 --2- 172.21.15.172:0/3066478147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 0x7f30cc1689d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009d90 tx=0x7f30c402a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294baeb2aa4684c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.511+0000 7f30d1209640 1 -- 172.21.15.172:0/3066478147 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4007740 con 0x7f30cc15eec0 2024-04-25T08:45:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.511+0000 7f30d1209640 1 -- 172.21.15.172:0/3066478147 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c40078e0 con 0x7f30cc15eec0 2024-04-25T08:45:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.511+0000 7f30d1209640 1 -- 172.21.15.172:0/3066478147 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4007cb0 con 0x7f30cc15eec0 2024-04-25T08:45:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.511+0000 7f30d446f640 1 -- 172.21.15.172:0/3066478147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 msgr2=0x7f30cc1689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.511+0000 7f30d446f640 1 --2- 172.21.15.172:0/3066478147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 0x7f30cc1689d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009d90 tx=0x7f30c402a580 comp rx=0 tx=0).stop 2024-04-25T08:45:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.511+0000 7f30d446f640 1 -- 172.21.15.172:0/3066478147 shutdown_connections 2024-04-25T08:45:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.511+0000 7f30d446f640 1 --2- 172.21.15.172:0/3066478147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 0x7f30cc1689d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.511+0000 7f30d446f640 1 -- 172.21.15.172:0/3066478147 >> 172.21.15.172:0/3066478147 conn(0x7f30cc0b3530 msgr2=0x7f30cc0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.512+0000 7f30d446f640 1 -- 172.21.15.172:0/3066478147 shutdown_connections 2024-04-25T08:45:58.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.512+0000 7f30d446f640 1 -- 172.21.15.172:0/3066478147 wait complete. 2024-04-25T08:45:58.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d446f640 1 Processor -- start 2024-04-25T08:45:58.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d446f640 1 -- start start 2024-04-25T08:45:58.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d446f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30cc06ccd0 0x7f30cc0aa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d446f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30cc070dc0 0x7f30cc0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d446f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 0x7f30cc0cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d446f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0b10f0 con 0x7f30cc15eec0 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d446f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc1622b0 con 0x7f30cc06ccd0 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d446f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc161f40 con 0x7f30cc070dc0 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d2a0c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 0x7f30cc0cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d2a0c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 0x7f30cc0cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51046/0 (socket says 172.21.15.172:51046) 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.513+0000 7f30d2a0c640 1 -- 172.21.15.172:0/3724448606 learned_addr learned my addr 172.21.15.172:0/3724448606 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30d220b640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30cc06ccd0 0x7f30cc0aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30d1a0a640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30cc070dc0 0x7f30cc0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30d2a0c640 1 -- 172.21.15.172:0/3724448606 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30cc070dc0 msgr2=0x7f30cc0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30d2a0c640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30cc070dc0 0x7f30cc0cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30d2a0c640 1 -- 172.21.15.172:0/3724448606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30cc06ccd0 msgr2=0x7f30cc0aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30d2a0c640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30cc06ccd0 0x7f30cc0aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30d2a0c640 1 -- 172.21.15.172:0/3724448606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0cb5c0 con 0x7f30cc15eec0 2024-04-25T08:45:58.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30d2a0c640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 0x7f30cc0cddc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009eb0 tx=0x7f30c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30c2ffd640 1 -- 172.21.15.172:0/3724448606 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c403f070 con 0x7f30cc15eec0 2024-04-25T08:45:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30c2ffd640 1 -- 172.21.15.172:0/3724448606 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c4031c40 con 0x7f30cc15eec0 2024-04-25T08:45:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30c2ffd640 1 -- 172.21.15.172:0/3724448606 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4043410 con 0x7f30cc15eec0 2024-04-25T08:45:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30d446f640 1 -- 172.21.15.172:0/3724448606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc0cb8a0 con 0x7f30cc15eec0 2024-04-25T08:45:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.514+0000 7f30d446f640 1 -- 172.21.15.172:0/3724448606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc0cbe60 con 0x7f30cc15eec0 2024-04-25T08:45:58.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.515+0000 7f30d446f640 1 -- 172.21.15.172:0/3724448606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc068470 con 0x7f30cc15eec0 2024-04-25T08:45:58.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.515+0000 7f30c2ffd640 1 -- 172.21.15.172:0/3724448606 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f30c403b410 con 0x7f30cc15eec0 2024-04-25T08:45:58.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.516+0000 7f30c2ffd640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30b006b4d0 0x7f30b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:58.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.516+0000 7f30c2ffd640 1 -- 172.21.15.172:0/3724448606 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f30c40ab7b0 con 0x7f30cc15eec0 2024-04-25T08:45:58.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.516+0000 7f30d220b640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30b006b4d0 0x7f30b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:58.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.516+0000 7f30d220b640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30b006b4d0 0x7f30b006d990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f30c8007fd0 tx=0x7f30c8007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:58.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.520+0000 7f30c2ffd640 1 -- 172.21.15.172:0/3724448606 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30cc068470 con 0x7f30cc15eec0 2024-04-25T08:45:58.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:58.726+0000 7f30d446f640 1 -- 172.21.15.172:0/3724448606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f30cc073a00 con 0x7f30cc15eec0 2024-04-25T08:45:59.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.411+0000 7f30c2ffd640 1 -- 172.21.15.172:0/3724448606 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f30c4079e90 con 0x7f30cc15eec0 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 -- 172.21.15.172:0/3724448606 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30b006b4d0 msgr2=0x7f30b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30b006b4d0 0x7f30b006d990 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f30c8007fd0 tx=0x7f30c8007e80 comp rx=0 tx=0).stop 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 -- 172.21.15.172:0/3724448606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 msgr2=0x7f30cc0cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 0x7f30cc0cddc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009eb0 tx=0x7f30c4004a40 comp rx=0 tx=0).stop 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 -- 172.21.15.172:0/3724448606 shutdown_connections 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30b006b4d0 0x7f30b006d990 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc15eec0 0x7f30cc0cddc0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30cc070dc0 0x7f30cc0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 --2- 172.21.15.172:0/3724448606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30cc06ccd0 0x7f30cc0aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 -- 172.21.15.172:0/3724448606 >> 172.21.15.172:0/3724448606 conn(0x7f30cc0b3530 msgr2=0x7f30cc0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:59.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 -- 172.21.15.172:0/3724448606 shutdown_connections 2024-04-25T08:45:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.414+0000 7f30d446f640 1 -- 172.21.15.172:0/3724448606 wait complete. 2024-04-25T08:45:59.419 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:45:59.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.535+0000 7fad4fe1f640 1 Processor -- start 2024-04-25T08:45:59.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.535+0000 7fad4fe1f640 1 -- start start 2024-04-25T08:45:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.536+0000 7fad4fe1f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fad480ced80 0x7fad480d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.536+0000 7fad4fe1f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4815e000 con 0x7fad48161710 2024-04-25T08:45:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.536+0000 7fad4fe1f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad480d1de0 con 0x7fad4815dc20 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.536+0000 7fad4fe1f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad48161c60 con 0x7fad480ced80 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.536+0000 7fad4e3bc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fad48161710 0x7fad480d2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41856/0 (socket says 172.21.15.172:41856) 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.536+0000 7fad4e3bc640 1 -- 172.21.15.172:0/847091406 learned_addr learned my addr 172.21.15.172:0/847091406 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.536+0000 7fad4d3ba640 1 --2- 172.21.15.172:0/847091406 >> v2:172.21.15.186:3300/0 conn(0x7fad480ced80 0x7fad480d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.536+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301841321 0 0) 0x7fad4815e000 con 0x7fad48161710 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.536+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad34003520 con 0x7fad48161710 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085557572 0 0) 0x7fad34003520 con 0x7fad48161710 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 >> v2:172.21.15.186:3300/0 conn(0x7fad480ced80 msgr2=0x7fad480d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 --2- 172.21.15.172:0/847091406 >> v2:172.21.15.186:3300/0 conn(0x7fad480ced80 0x7fad480d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 >> v1:172.21.15.186:6789/0 conn(0x7fad4815dc20 legacy=0x7fad480ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48161f40 con 0x7fad48161710 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fad400019f0 con 0x7fad48161710 2024-04-25T08:45:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 >> v1:172.21.15.172:6789/0 conn(0x7fad48161710 legacy=0x7fad480d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad340039b0 0x7fad34003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad34004800 0x7fad34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad340051c0 0x7fad3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48161c60 con 0x7fad34004800 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3400c060 con 0x7fad340051c0 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3400c260 con 0x7fad340039b0 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4d3ba640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad34004800 0x7fad34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4dbbb640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad340039b0 0x7fad34003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4e3bc640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad340051c0 0x7fad3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4d3ba640 1 -- 172.21.15.172:0/847091406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad340039b0 msgr2=0x7fad34003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4d3ba640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad340039b0 0x7fad34003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4d3ba640 1 -- 172.21.15.172:0/847091406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad340051c0 msgr2=0x7fad3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:45:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4d3ba640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad340051c0 0x7fad3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4d3ba640 1 -- 172.21.15.172:0/847091406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad34003520 con 0x7fad34004800 2024-04-25T08:45:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.537+0000 7fad4e3bc640 1 -- 172.21.15.172:0/847091406 reap_dead start 2024-04-25T08:45:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.538+0000 7fad4d3ba640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad34004800 0x7fad34004c80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fad38009ac0 tx=0x7fad34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1eef214d4f5ced7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.538+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38036070 con 0x7fad34004800 2024-04-25T08:45:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.538+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad38031400 con 0x7fad34004800 2024-04-25T08:45:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.538+0000 7fad4cbb9640 1 -- 172.21.15.172:0/847091406 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38009690 con 0x7fad34004800 2024-04-25T08:45:59.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.538+0000 7fad4fe1f640 1 -- 172.21.15.172:0/847091406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad34004800 msgr2=0x7fad34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:59.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.538+0000 7fad4fe1f640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad34004800 0x7fad34004c80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fad38009ac0 tx=0x7fad34005830 comp rx=0 tx=0).stop 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.539+0000 7fad4fe1f640 1 -- 172.21.15.172:0/847091406 shutdown_connections 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.539+0000 7fad4fe1f640 1 --2- 172.21.15.172:0/847091406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad34004800 0x7fad34004c80 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.539+0000 7fad4fe1f640 1 -- 172.21.15.172:0/847091406 >> 172.21.15.172:0/847091406 conn(0x7fad480d0420 msgr2=0x7fad480d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.539+0000 7fad4fe1f640 1 -- 172.21.15.172:0/847091406 shutdown_connections 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.539+0000 7fad4fe1f640 1 -- 172.21.15.172:0/847091406 wait complete. 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.540+0000 7fad4fe1f640 1 Processor -- start 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.540+0000 7fad4fe1f640 1 -- start start 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4fe1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad34004800 0x7fad4815c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4fe1f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad480cce20 0x7fad481f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4fe1f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad480cd280 0x7fad480ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:59.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4fe1f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad480b5e50 con 0x7fad480cd280 2024-04-25T08:45:59.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4fe1f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48162500 con 0x7fad480cce20 2024-04-25T08:45:59.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4fe1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad480b5fd0 con 0x7fad34004800 2024-04-25T08:45:59.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4e3bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad480cd280 0x7fad480ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:59.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4e3bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad480cd280 0x7fad480ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51070/0 (socket says 172.21.15.172:51070) 2024-04-25T08:45:59.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4e3bc640 1 -- 172.21.15.172:0/934659678 learned_addr learned my addr 172.21.15.172:0/934659678 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:45:59.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4d3ba640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad480cce20 0x7fad481f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:59.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4dbbb640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad34004800 0x7fad4815c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:59.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4e3bc640 1 -- 172.21.15.172:0/934659678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad34004800 msgr2=0x7fad4815c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:59.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4e3bc640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad34004800 0x7fad4815c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:59.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4e3bc640 1 -- 172.21.15.172:0/934659678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad480cce20 msgr2=0x7fad481f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4e3bc640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad480cce20 0x7fad481f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4e3bc640 1 -- 172.21.15.172:0/934659678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4815c5a0 con 0x7fad480cd280 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4dbbb640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad34004800 0x7fad4815c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4e3bc640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad480cd280 0x7fad480ac930 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fad40000f80 tx=0x7fad40007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad3e7fc640 1 -- 172.21.15.172:0/934659678 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40017020 con 0x7fad480cd280 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad3e7fc640 1 -- 172.21.15.172:0/934659678 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4000aa40 con 0x7fad480cd280 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad3e7fc640 1 -- 172.21.15.172:0/934659678 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000ae30 con 0x7fad480cd280 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4fe1f640 1 -- 172.21.15.172:0/934659678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad480aa740 con 0x7fad480cd280 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.541+0000 7fad4fe1f640 1 -- 172.21.15.172:0/934659678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad480aad00 con 0x7fad480cd280 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.542+0000 7fad4fe1f640 1 -- 172.21.15.172:0/934659678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad480d16b0 con 0x7fad480cd280 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.543+0000 7fad3e7fc640 1 -- 172.21.15.172:0/934659678 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fad4001a020 con 0x7fad480cd280 2024-04-25T08:45:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.543+0000 7fad3e7fc640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad2c06b4d0 0x7fad2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:45:59.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.543+0000 7fad3e7fc640 1 -- 172.21.15.172:0/934659678 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fad4008a930 con 0x7fad480cd280 2024-04-25T08:45:59.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.543+0000 7fad4dbbb640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad2c06b4d0 0x7fad2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:45:59.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.544+0000 7fad4dbbb640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad2c06b4d0 0x7fad2c06d990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fad44000c00 tx=0x7fad44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:45:59.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.548+0000 7fad3e7fc640 1 -- 172.21.15.172:0/934659678 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad40021020 con 0x7fad480cd280 2024-04-25T08:45:59.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:45:59.719+0000 7fad4fe1f640 1 -- 172.21.15.172:0/934659678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad480739e0 con 0x7fad480cd280 2024-04-25T08:45:59.847 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:45:59.850 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:46:00.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.416+0000 7fad3e7fc640 1 -- 172.21.15.172:0/934659678 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7fad400595d0 con 0x7fad480cd280 2024-04-25T08:46:00.408 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 -- 172.21.15.172:0/934659678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad2c06b4d0 msgr2=0x7fad2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad2c06b4d0 0x7fad2c06d990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fad44000c00 tx=0x7fad44009040 comp rx=0 tx=0).stop 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 -- 172.21.15.172:0/934659678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad480cd280 msgr2=0x7fad480ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad480cd280 0x7fad480ac930 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fad40000f80 tx=0x7fad40007a90 comp rx=0 tx=0).stop 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 -- 172.21.15.172:0/934659678 shutdown_connections 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad2c06b4d0 0x7fad2c06d990 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad480cce20 0x7fad481f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad480cd280 0x7fad480ac930 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 --2- 172.21.15.172:0/934659678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad34004800 0x7fad4815c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 -- 172.21.15.172:0/934659678 >> 172.21.15.172:0/934659678 conn(0x7fad480d0420 msgr2=0x7fad480b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:00.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 -- 172.21.15.172:0/934659678 shutdown_connections 2024-04-25T08:46:00.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.420+0000 7fad4fe1f640 1 -- 172.21.15.172:0/934659678 wait complete. 2024-04-25T08:46:00.425 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:46:00.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.537+0000 7fd04951d640 1 Processor -- start 2024-04-25T08:46:00.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.537+0000 7fd04951d640 1 -- start start 2024-04-25T08:46:00.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd04951d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd04415dc20 0x7fd0440ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:00.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd04951d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd044161710 0x7fd0440cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:00.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd04951d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0440b9330 0x7fd04406bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:00.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd04951d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04415e000 con 0x7fd044161710 2024-04-25T08:46:00.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd04951d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0440d1de0 con 0x7fd04415dc20 2024-04-25T08:46:00.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd04951d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd044161c60 con 0x7fd0440b9330 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd03bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd044161710 0x7fd0440cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd03bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd044161710 0x7fd0440cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51074/0 (socket says 172.21.15.172:51074) 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd03bfff640 1 -- 172.21.15.172:0/2283988264 learned_addr learned my addr 172.21.15.172:0/2283988264 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd03bfff640 1 -- 172.21.15.172:0/2283988264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0440b9330 msgr2=0x7fd04406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd0437fe640 1 --2- 172.21.15.172:0/2283988264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0440b9330 0x7fd04406bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd042ffd640 1 --2- 172.21.15.172:0/2283988264 >> v2:172.21.15.186:3300/0 conn(0x7fd04415dc20 0x7fd0440ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd03bfff640 1 --2- 172.21.15.172:0/2283988264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0440b9330 0x7fd04406bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd03bfff640 1 -- 172.21.15.172:0/2283988264 >> v2:172.21.15.186:3300/0 conn(0x7fd04415dc20 msgr2=0x7fd0440ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd03bfff640 1 --2- 172.21.15.172:0/2283988264 >> v2:172.21.15.186:3300/0 conn(0x7fd04415dc20 0x7fd0440ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd03bfff640 1 -- 172.21.15.172:0/2283988264 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044161f40 con 0x7fd044161710 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd0437fe640 1 --2- 172.21.15.172:0/2283988264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0440b9330 0x7fd04406bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.538+0000 7fd042ffd640 1 --2- 172.21.15.172:0/2283988264 >> v2:172.21.15.186:3300/0 conn(0x7fd04415dc20 0x7fd0440ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.539+0000 7fd03bfff640 1 --2- 172.21.15.172:0/2283988264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 0x7fd0440cebb0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd0440d1520 tx=0x7fd02c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e14835d114e5de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.539+0000 7fd0427fc640 1 -- 172.21.15.172:0/2283988264 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c037070 con 0x7fd044161710 2024-04-25T08:46:00.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.539+0000 7fd0427fc640 1 -- 172.21.15.172:0/2283988264 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c032440 con 0x7fd044161710 2024-04-25T08:46:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.539+0000 7fd0427fc640 1 -- 172.21.15.172:0/2283988264 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c032810 con 0x7fd044161710 2024-04-25T08:46:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.539+0000 7fd04951d640 1 -- 172.21.15.172:0/2283988264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 msgr2=0x7fd0440cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.540+0000 7fd04951d640 1 --2- 172.21.15.172:0/2283988264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 0x7fd0440cebb0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd0440d1520 tx=0x7fd02c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.540+0000 7fd04951d640 1 -- 172.21.15.172:0/2283988264 shutdown_connections 2024-04-25T08:46:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.540+0000 7fd04951d640 1 --2- 172.21.15.172:0/2283988264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0440b9330 0x7fd04406bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.540+0000 7fd04951d640 1 --2- 172.21.15.172:0/2283988264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 0x7fd0440cebb0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.540+0000 7fd04951d640 1 --2- 172.21.15.172:0/2283988264 >> v2:172.21.15.186:3300/0 conn(0x7fd04415dc20 0x7fd0440ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.540+0000 7fd04951d640 1 -- 172.21.15.172:0/2283988264 >> 172.21.15.172:0/2283988264 conn(0x7fd0440d0420 msgr2=0x7fd0440d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.540+0000 7fd04951d640 1 -- 172.21.15.172:0/2283988264 shutdown_connections 2024-04-25T08:46:00.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.540+0000 7fd04951d640 1 -- 172.21.15.172:0/2283988264 wait complete. 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.541+0000 7fd04951d640 1 Processor -- start 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.541+0000 7fd04951d640 1 -- start start 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.541+0000 7fd04951d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0440b9330 0x7fd0441519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.541+0000 7fd04951d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd04415dc20 0x7fd0440cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.541+0000 7fd04951d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 0x7fd0440b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.541+0000 7fd04951d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440b5e50 con 0x7fd044161710 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.541+0000 7fd04951d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd044162500 con 0x7fd0440b9330 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.541+0000 7fd04951d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440b5fd0 con 0x7fd04415dc20 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd0437fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 0x7fd0440b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd0437fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 0x7fd0440b8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51090/0 (socket says 172.21.15.172:51090) 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd0437fe640 1 -- 172.21.15.172:0/4217068562 learned_addr learned my addr 172.21.15.172:0/4217068562 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:00.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd042ffd640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0440b9330 0x7fd0441519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd03bfff640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd04415dc20 0x7fd0440cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd0437fe640 1 -- 172.21.15.172:0/4217068562 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd04415dc20 msgr2=0x7fd0440cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd0437fe640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd04415dc20 0x7fd0440cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd0437fe640 1 -- 172.21.15.172:0/4217068562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0440b9330 msgr2=0x7fd0441519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd0437fe640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0440b9330 0x7fd0441519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd0437fe640 1 -- 172.21.15.172:0/4217068562 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044152490 con 0x7fd044161710 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd0437fe640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 0x7fd0440b8270 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00cce0 tx=0x7fd03c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd03b7fe640 1 -- 172.21.15.172:0/4217068562 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c00f680 con 0x7fd044161710 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd03b7fe640 1 -- 172.21.15.172:0/4217068562 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c00f820 con 0x7fd044161710 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd04951d640 1 -- 172.21.15.172:0/4217068562 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd044151f10 con 0x7fd044161710 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd03b7fe640 1 -- 172.21.15.172:0/4217068562 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c00fc10 con 0x7fd044161710 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.542+0000 7fd04951d640 1 -- 172.21.15.172:0/4217068562 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd044160e70 con 0x7fd044161710 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.543+0000 7fd04951d640 1 -- 172.21.15.172:0/4217068562 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd044073a00 con 0x7fd044161710 2024-04-25T08:46:00.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.544+0000 7fd03b7fe640 1 -- 172.21.15.172:0/4217068562 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd03c0213f0 con 0x7fd044161710 2024-04-25T08:46:00.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.544+0000 7fd03b7fe640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd02406b4d0 0x7fd02406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:00.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.544+0000 7fd042ffd640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd02406b4d0 0x7fd02406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:00.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.544+0000 7fd03b7fe640 1 -- 172.21.15.172:0/4217068562 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5749+0+0 (secure 0 0 0) 0x7fd03c08ae20 con 0x7fd044161710 2024-04-25T08:46:00.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.545+0000 7fd042ffd640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd02406b4d0 0x7fd02406d990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd03400a950 tx=0x7fd034008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:00.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.549+0000 7fd03b7fe640 1 -- 172.21.15.172:0/4217068562 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd044152490 con 0x7fd044161710 2024-04-25T08:46:00.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:00.720+0000 7fd04951d640 1 -- 172.21.15.172:0/4217068562 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0440ce0d0 con 0x7fd044161710 2024-04-25T08:46:01.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.421+0000 7fd03b7fe640 1 -- 172.21.15.172:0/4217068562 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd03c014030 con 0x7fd044161710 2024-04-25T08:46:01.413 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2024-04-25T08:46:01.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.424+0000 7fd04951d640 1 -- 172.21.15.172:0/4217068562 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd02406b4d0 msgr2=0x7fd02406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:01.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.424+0000 7fd04951d640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd02406b4d0 0x7fd02406d990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd03400a950 tx=0x7fd034008040 comp rx=0 tx=0).stop 2024-04-25T08:46:01.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.424+0000 7fd04951d640 1 -- 172.21.15.172:0/4217068562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 msgr2=0x7fd0440b8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:01.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.424+0000 7fd04951d640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 0x7fd0440b8270 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00cce0 tx=0x7fd03c00a650 comp rx=0 tx=0).stop 2024-04-25T08:46:01.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.425+0000 7fd04951d640 1 -- 172.21.15.172:0/4217068562 shutdown_connections 2024-04-25T08:46:01.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.425+0000 7fd04951d640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd02406b4d0 0x7fd02406d990 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.425+0000 7fd04951d640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd044161710 0x7fd0440b8270 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.425+0000 7fd04951d640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd04415dc20 0x7fd0440cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.425+0000 7fd04951d640 1 --2- 172.21.15.172:0/4217068562 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0440b9330 0x7fd0441519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.425+0000 7fd04951d640 1 -- 172.21.15.172:0/4217068562 >> 172.21.15.172:0/4217068562 conn(0x7fd0440d0420 msgr2=0x7fd0440d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:01.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.425+0000 7fd04951d640 1 -- 172.21.15.172:0/4217068562 shutdown_connections 2024-04-25T08:46:01.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.425+0000 7fd04951d640 1 -- 172.21.15.172:0/4217068562 wait complete. 2024-04-25T08:46:01.434 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:46:01.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.543+0000 7fb7959f4640 1 Processor -- start 2024-04-25T08:46:01.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.543+0000 7fb7959f4640 1 -- start start 2024-04-25T08:46:01.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb7959f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 0x7fb7900d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb7959f4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb790161710 0x7fb7900d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb7959f4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79015e000 con 0x7fb79015dc20 2024-04-25T08:46:01.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb7959f4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7900d1de0 con 0x7fb790161710 2024-04-25T08:46:01.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb7959f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb790161c60 con 0x7fb7900ced80 2024-04-25T08:46:01.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb78f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb790161710 0x7fb7900d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb78f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb790161710 0x7fb7900d2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51106/0 (socket says 172.21.15.172:51106) 2024-04-25T08:46:01.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb78f7fe640 1 -- 172.21.15.172:0/3976280089 learned_addr learned my addr 172.21.15.172:0/3976280089 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:01.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb78e7fc640 1 --2- 172.21.15.172:0/3976280089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 0x7fb7900d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb78f7fe640 1 -- 172.21.15.172:0/3976280089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 msgr2=0x7fb7900d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:01.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb78f7fe640 1 --2- 172.21.15.172:0/3976280089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 0x7fb7900d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.544+0000 7fb78f7fe640 1 -- 172.21.15.172:0/3976280089 >> v1:172.21.15.186:6789/0 conn(0x7fb79015dc20 legacy=0x7fb7900ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:01.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.545+0000 7fb78f7fe640 1 -- 172.21.15.172:0/3976280089 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb790161f40 con 0x7fb790161710 2024-04-25T08:46:01.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.545+0000 7fb78f7fe640 1 --2- 172.21.15.172:0/3976280089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb790161710 0x7fb7900d2820 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb788009870 tx=0x7fb78802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84908ad748d67aab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:01.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.545+0000 7fb78dffb640 1 -- 172.21.15.172:0/3976280089 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788037070 con 0x7fb790161710 2024-04-25T08:46:01.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.545+0000 7fb78dffb640 1 -- 172.21.15.172:0/3976280089 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb788032440 con 0x7fb790161710 2024-04-25T08:46:01.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.545+0000 7fb78dffb640 1 -- 172.21.15.172:0/3976280089 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788032810 con 0x7fb790161710 2024-04-25T08:46:01.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.546+0000 7fb7959f4640 1 -- 172.21.15.172:0/3976280089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb790161710 msgr2=0x7fb7900d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:01.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.546+0000 7fb7959f4640 1 --2- 172.21.15.172:0/3976280089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb790161710 0x7fb7900d2820 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb788009870 tx=0x7fb78802a210 comp rx=0 tx=0).stop 2024-04-25T08:46:01.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.546+0000 7fb7959f4640 1 -- 172.21.15.172:0/3976280089 shutdown_connections 2024-04-25T08:46:01.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.546+0000 7fb7959f4640 1 --2- 172.21.15.172:0/3976280089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb790161710 0x7fb7900d2820 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.546+0000 7fb7959f4640 1 --2- 172.21.15.172:0/3976280089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 0x7fb7900d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.546+0000 7fb7959f4640 1 -- 172.21.15.172:0/3976280089 >> 172.21.15.172:0/3976280089 conn(0x7fb7900d0420 msgr2=0x7fb7900d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:01.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.546+0000 7fb7959f4640 1 -- 172.21.15.172:0/3976280089 shutdown_connections 2024-04-25T08:46:01.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.546+0000 7fb7959f4640 1 -- 172.21.15.172:0/3976280089 wait complete. 2024-04-25T08:46:01.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.548+0000 7fb7959f4640 1 Processor -- start 2024-04-25T08:46:01.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.553+0000 7fb7959f4640 1 -- start start 2024-04-25T08:46:01.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.554+0000 7fb7959f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 0x7fb7900cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.554+0000 7fb7959f4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb79015dc20 0x7fb7900cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.554+0000 7fb7959f4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790161710 0x7fb7901f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.554+0000 7fb7959f4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900b5e50 con 0x7fb79015dc20 2024-04-25T08:46:01.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.554+0000 7fb7959f4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790162500 con 0x7fb790161710 2024-04-25T08:46:01.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.555+0000 7fb7959f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7900b5fd0 con 0x7fb7900ced80 2024-04-25T08:46:01.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.555+0000 7fb78e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb79015dc20 0x7fb7900cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.556+0000 7fb78e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb79015dc20 0x7fb7900cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51110/0 (socket says 172.21.15.172:51110) 2024-04-25T08:46:01.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.556+0000 7fb78e7fc640 1 -- 172.21.15.172:0/3263583366 learned_addr learned my addr 172.21.15.172:0/3263583366 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:01.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.556+0000 7fb78effd640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 0x7fb7900cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.556+0000 7fb78f7fe640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790161710 0x7fb7901f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.557+0000 7fb78effd640 1 -- 172.21.15.172:0/3263583366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790161710 msgr2=0x7fb7901f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:01.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.557+0000 7fb78effd640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790161710 0x7fb7901f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.557+0000 7fb78effd640 1 -- 172.21.15.172:0/3263583366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb79015dc20 msgr2=0x7fb7900cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:01.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.557+0000 7fb78effd640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb79015dc20 0x7fb7900cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.557+0000 7fb78effd640 1 -- 172.21.15.172:0/3263583366 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7900cc3c0 con 0x7fb7900ced80 2024-04-25T08:46:01.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.558+0000 7fb78effd640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 0x7fb7900cdcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb78000bd50 tx=0x7fb78000be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:01.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.559+0000 7fb777fff640 1 -- 172.21.15.172:0/3263583366 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780019070 con 0x7fb7900ced80 2024-04-25T08:46:01.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.559+0000 7fb777fff640 1 -- 172.21.15.172:0/3263583366 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780014440 con 0x7fb7900ced80 2024-04-25T08:46:01.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.559+0000 7fb777fff640 1 -- 172.21.15.172:0/3263583366 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800148b0 con 0x7fb7900ced80 2024-04-25T08:46:01.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.560+0000 7fb7959f4640 1 -- 172.21.15.172:0/3263583366 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7900cc670 con 0x7fb7900ced80 2024-04-25T08:46:01.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.560+0000 7fb7959f4640 1 -- 172.21.15.172:0/3263583366 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7900ccc30 con 0x7fb7900ced80 2024-04-25T08:46:01.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.563+0000 7fb777fff640 1 -- 172.21.15.172:0/3263583366 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb78001c070 con 0x7fb7900ced80 2024-04-25T08:46:01.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.564+0000 7fb777fff640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb77c06b5a0 0x7fb77c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.564+0000 7fb777fff640 1 -- 172.21.15.172:0/3263583366 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb78008a050 con 0x7fb7900ced80 2024-04-25T08:46:01.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.564+0000 7fb78e7fc640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb77c06b5a0 0x7fb77c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.565+0000 7fb7959f4640 1 -- 172.21.15.172:0/3263583366 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb790073a00 con 0x7fb7900ced80 2024-04-25T08:46:01.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.567+0000 7fb78e7fc640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb77c06b5a0 0x7fb77c06da60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b24d0 tx=0x7fb784008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:01.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.573+0000 7fb777fff640 1 -- 172.21.15.172:0/3263583366 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb7800589d0 con 0x7fb7900ced80 2024-04-25T08:46:01.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.750+0000 7fb7959f4640 1 -- 172.21.15.172:0/3263583366 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb7900d16b0 con 0x7fb7900ced80 2024-04-25T08:46:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.755+0000 7fb777fff640 1 -- 172.21.15.172:0/3263583366 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb78005ca70 con 0x7fb7900ced80 2024-04-25T08:46:01.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 -- 172.21.15.172:0/3263583366 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb77c06b5a0 msgr2=0x7fb77c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:01.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb77c06b5a0 0x7fb77c06da60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b24d0 tx=0x7fb784008040 comp rx=0 tx=0).stop 2024-04-25T08:46:01.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 -- 172.21.15.172:0/3263583366 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 msgr2=0x7fb7900cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:01.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 0x7fb7900cdcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb78000bd50 tx=0x7fb78000be40 comp rx=0 tx=0).stop 2024-04-25T08:46:01.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 -- 172.21.15.172:0/3263583366 shutdown_connections 2024-04-25T08:46:01.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb77c06b5a0 0x7fb77c06da60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb790161710 0x7fb7901f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb79015dc20 0x7fb7900cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 --2- 172.21.15.172:0/3263583366 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7900ced80 0x7fb7900cdcd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 -- 172.21.15.172:0/3263583366 >> 172.21.15.172:0/3263583366 conn(0x7fb7900d0420 msgr2=0x7fb7901601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:01.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 -- 172.21.15.172:0/3263583366 shutdown_connections 2024-04-25T08:46:01.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.757+0000 7fb7959f4640 1 -- 172.21.15.172:0/3263583366 wait complete. 2024-04-25T08:46:01.760 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-04-25T08:46:01.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.865+0000 7ff8b9bf5640 1 Processor -- start 2024-04-25T08:46:01.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.865+0000 7ff8b9bf5640 1 -- start start 2024-04-25T08:46:01.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.866+0000 7ff8b9bf5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff8b40d0aa0 0x7ff8b40b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.866+0000 7ff8b9bf5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8b406fea0 0x7ff8b40b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.866+0000 7ff8b9bf5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b40b3710 con 0x7ff8b415a790 2024-04-25T08:46:01.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.866+0000 7ff8b9bf5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40cf0e0 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.866+0000 7ff8b9bf5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40cf3c0 con 0x7ff8b406fea0 2024-04-25T08:46:01.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.866+0000 7ff8b2ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff8b40d0aa0 0x7ff8b40b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.866+0000 7ff8b2ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff8b40d0aa0 0x7ff8b40b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51112/0 (socket says 172.21.15.172:51112) 2024-04-25T08:46:01.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.866+0000 7ff8b2ffd640 1 -- 172.21.15.172:0/412631663 learned_addr learned my addr 172.21.15.172:0/412631663 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:01.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.867+0000 7ff8b2ffd640 1 -- 172.21.15.172:0/412631663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8b406fea0 msgr2=0x7ff8b40b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:01.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.867+0000 7ff8b2ffd640 1 --2- 172.21.15.172:0/412631663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8b406fea0 0x7ff8b40b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.867+0000 7ff8b2ffd640 1 -- 172.21.15.172:0/412631663 >> v1:172.21.15.186:6789/0 conn(0x7ff8b415a790 legacy=0x7ff8b40d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.867+0000 7ff8b2ffd640 1 -- 172.21.15.172:0/412631663 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40cf6a0 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.867+0000 7ff8b2ffd640 1 --2- 172.21.15.172:0/412631663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 0x7ff8b40b3ea0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800bb10 tx=0x7ff8a802c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5077e3321beb9b97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b27fc640 1 -- 172.21.15.172:0/412631663 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8032790 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b27fc640 1 -- 172.21.15.172:0/412631663 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8038070 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b27fc640 1 -- 172.21.15.172:0/412631663 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8032b50 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/412631663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 msgr2=0x7ff8b40b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b9bf5640 1 --2- 172.21.15.172:0/412631663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 0x7ff8b40b3ea0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800bb10 tx=0x7ff8a802c8d0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/412631663 shutdown_connections 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b9bf5640 1 --2- 172.21.15.172:0/412631663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8b406fea0 0x7ff8b40b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b9bf5640 1 --2- 172.21.15.172:0/412631663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 0x7ff8b40b3ea0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/412631663 >> 172.21.15.172:0/412631663 conn(0x7ff8b40b2370 msgr2=0x7ff8b40b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/412631663 shutdown_connections 2024-04-25T08:46:01.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.868+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/412631663 wait complete. 2024-04-25T08:46:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.869+0000 7ff8b9bf5640 1 Processor -- start 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.870+0000 7ff8b9bf5640 1 -- start start 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.870+0000 7ff8b9bf5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8b406fea0 0x7ff8b4150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.870+0000 7ff8b9bf5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 0x7ff8b41ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.870+0000 7ff8b9bf5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8b415a790 0x7ff8b40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.870+0000 7ff8b9bf5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b415ab70 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.870+0000 7ff8b9bf5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40cf980 con 0x7ff8b406fea0 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.870+0000 7ff8b9bf5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b415acf0 con 0x7ff8b415a790 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.870+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 0x7ff8b41ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.870+0000 7ff8b2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 0x7ff8b41ef5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51122/0 (socket says 172.21.15.172:51122) 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.870+0000 7ff8b2ffd640 1 -- 172.21.15.172:0/4108956668 learned_addr learned my addr 172.21.15.172:0/4108956668 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff8b3fff640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8b415a790 0x7ff8b40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff8b37fe640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8b406fea0 0x7ff8b4150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff8b2ffd640 1 -- 172.21.15.172:0/4108956668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8b415a790 msgr2=0x7ff8b40b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff8b2ffd640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8b415a790 0x7ff8b40b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff8b2ffd640 1 -- 172.21.15.172:0/4108956668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8b406fea0 msgr2=0x7ff8b4150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff8b2ffd640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8b406fea0 0x7ff8b4150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:01.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff8b2ffd640 1 -- 172.21.15.172:0/4108956668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b4152330 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff8b2ffd640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 0x7ff8b41ef5f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800b2c0 tx=0x7ff8a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:01.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff89bfff640 1 -- 172.21.15.172:0/4108956668 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8033830 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff89bfff640 1 -- 172.21.15.172:0/4108956668 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8033a10 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/4108956668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b4151720 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff89bfff640 1 -- 172.21.15.172:0/4108956668 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8033e00 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.871+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/4108956668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b4151ce0 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.872+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/4108956668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b4073990 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.873+0000 7ff89bfff640 1 -- 172.21.15.172:0/4108956668 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff8a804d060 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.873+0000 7ff89bfff640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8a006b500 0x7ff8a006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:01.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.873+0000 7ff89bfff640 1 -- 172.21.15.172:0/4108956668 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff8a80ac8c0 con 0x7ff8b40d0aa0 2024-04-25T08:46:01.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.873+0000 7ff8b37fe640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8a006b500 0x7ff8a006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:01.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.873+0000 7ff8b37fe640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8a006b500 0x7ff8a006d9c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4006fd0 tx=0x7ff8a4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:01.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:01.877+0000 7ff89bfff640 1 -- 172.21.15.172:0/4108956668 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff8a8041070 con 0x7ff8b40d0aa0 2024-04-25T08:46:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.113+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/4108956668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7ff8b406b8b0 con 0x7ff8b40d0aa0 2024-04-25T08:46:02.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.423+0000 7ff89bfff640 1 -- 172.21.15.172:0/4108956668 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v193) v1 ==== 143+0+0 (secure 0 0 0) 0x7ff8a807ba60 con 0x7ff8b40d0aa0 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/4108956668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8a006b500 msgr2=0x7ff8a006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8a006b500 0x7ff8a006d9c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4006fd0 tx=0x7ff8a4008040 comp rx=0 tx=0).stop 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/4108956668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 msgr2=0x7ff8b41ef5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 0x7ff8b41ef5f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800b2c0 tx=0x7ff8a80046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/4108956668 shutdown_connections 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8a006b500 0x7ff8a006d9c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8b415a790 0x7ff8b40b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8b40d0aa0 0x7ff8b41ef5f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 --2- 172.21.15.172:0/4108956668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8b406fea0 0x7ff8b4150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/4108956668 >> 172.21.15.172:0/4108956668 conn(0x7ff8b40b2370 msgr2=0x7ff8b4072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/4108956668 shutdown_connections 2024-04-25T08:46:02.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.425+0000 7ff8b9bf5640 1 -- 172.21.15.172:0/4108956668 wait complete. 2024-04-25T08:46:02.428 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-04-25T08:46:02.428 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T08:46:02.429 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:02.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.536+0000 7effcf7b7640 1 Processor -- start 2024-04-25T08:46:02.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.536+0000 7effcf7b7640 1 -- start start 2024-04-25T08:46:02.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcf7b7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7effc80cc8e0 0x7effc81625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcf7b7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80d1810 0x7effc80d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcf7b7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc80cce50 con 0x7effc815dc90 2024-04-25T08:46:02.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcf7b7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc80d21c0 con 0x7effc80cc8e0 2024-04-25T08:46:02.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcf7b7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc8161af0 con 0x7effc80d1810 2024-04-25T08:46:02.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effccd52640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7effc80cc8e0 0x7effc81625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcdd54640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80d1810 0x7effc80d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcdd54640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80d1810 0x7effc80d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:60956/0 (socket says 172.21.15.172:60956) 2024-04-25T08:46:02.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcdd54640 1 -- 172.21.15.172:0/1813441896 learned_addr learned my addr 172.21.15.172:0/1813441896 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:02.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcdd54640 1 -- 172.21.15.172:0/1813441896 >> v2:172.21.15.186:3300/0 conn(0x7effc80cc8e0 msgr2=0x7effc81625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:02.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcdd54640 1 --2- 172.21.15.172:0/1813441896 >> v2:172.21.15.186:3300/0 conn(0x7effc80cc8e0 0x7effc81625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcdd54640 1 -- 172.21.15.172:0/1813441896 >> v1:172.21.15.186:6789/0 conn(0x7effc815dc90 legacy=0x7effc815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.537+0000 7effcdd54640 1 -- 172.21.15.172:0/1813441896 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8161dd0 con 0x7effc80d1810 2024-04-25T08:46:02.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.538+0000 7effcdd54640 1 --2- 172.21.15.172:0/1813441896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80d1810 0x7effc80d1c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effc0009e50 tx=0x7effc002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b901be125ec733cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:02.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.538+0000 7effbffff640 1 -- 172.21.15.172:0/1813441896 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0036070 con 0x7effc80d1810 2024-04-25T08:46:02.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.538+0000 7effbffff640 1 -- 172.21.15.172:0/1813441896 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc0031600 con 0x7effc80d1810 2024-04-25T08:46:02.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.538+0000 7effbffff640 1 -- 172.21.15.172:0/1813441896 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00319d0 con 0x7effc80d1810 2024-04-25T08:46:02.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.539+0000 7effcf7b7640 1 -- 172.21.15.172:0/1813441896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80d1810 msgr2=0x7effc80d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.539+0000 7effcf7b7640 1 --2- 172.21.15.172:0/1813441896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80d1810 0x7effc80d1c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effc0009e50 tx=0x7effc002a680 comp rx=0 tx=0).stop 2024-04-25T08:46:02.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.539+0000 7effcf7b7640 1 -- 172.21.15.172:0/1813441896 shutdown_connections 2024-04-25T08:46:02.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.539+0000 7effcf7b7640 1 --2- 172.21.15.172:0/1813441896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80d1810 0x7effc80d1c80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.539+0000 7effcf7b7640 1 --2- 172.21.15.172:0/1813441896 >> v2:172.21.15.186:3300/0 conn(0x7effc80cc8e0 0x7effc81625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.539+0000 7effcf7b7640 1 -- 172.21.15.172:0/1813441896 >> 172.21.15.172:0/1813441896 conn(0x7effc806f590 msgr2=0x7effc806f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:02.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.539+0000 7effcf7b7640 1 -- 172.21.15.172:0/1813441896 shutdown_connections 2024-04-25T08:46:02.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.539+0000 7effcf7b7640 1 -- 172.21.15.172:0/1813441896 wait complete. 2024-04-25T08:46:02.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.540+0000 7effcf7b7640 1 Processor -- start 2024-04-25T08:46:02.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.540+0000 7effcf7b7640 1 -- start start 2024-04-25T08:46:02.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effcf7b7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80cc8e0 0x7effc80b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effcf7b7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effc80d1810 0x7effc8159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effcf7b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effc815dc90 0x7effc80b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effcf7b7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc815e070 con 0x7effc815dc90 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effcf7b7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc80cd130 con 0x7effc80d1810 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effcf7b7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc815e1f0 con 0x7effc80cc8e0 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effcdd54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effc815dc90 0x7effc80b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effcdd54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effc815dc90 0x7effc80b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51134/0 (socket says 172.21.15.172:51134) 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effcdd54640 1 -- 172.21.15.172:0/3383188703 learned_addr learned my addr 172.21.15.172:0/3383188703 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effcd553640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80cc8e0 0x7effc80b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.541+0000 7effccd52640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effc80d1810 0x7effc8159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effcdd54640 1 -- 172.21.15.172:0/3383188703 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80cc8e0 msgr2=0x7effc80b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effcdd54640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80cc8e0 0x7effc80b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effcdd54640 1 -- 172.21.15.172:0/3383188703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effc80d1810 msgr2=0x7effc8159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effcdd54640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effc80d1810 0x7effc8159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effcdd54640 1 -- 172.21.15.172:0/3383188703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80b6f80 con 0x7effc815dc90 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effccd52640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effc80d1810 0x7effc8159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:02.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effcdd54640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effc815dc90 0x7effc80b2690 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7effc0009f70 tx=0x7effc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:02.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effbdffb640 1 -- 172.21.15.172:0/3383188703 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc003f020 con 0x7effc815dc90 2024-04-25T08:46:02.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effbdffb640 1 -- 172.21.15.172:0/3383188703 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc0037040 con 0x7effc815dc90 2024-04-25T08:46:02.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effcf7b7640 1 -- 172.21.15.172:0/3383188703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc80c5950 con 0x7effc815dc90 2024-04-25T08:46:02.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effbdffb640 1 -- 172.21.15.172:0/3383188703 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0036070 con 0x7effc815dc90 2024-04-25T08:46:02.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.542+0000 7effcf7b7640 1 -- 172.21.15.172:0/3383188703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc80c5f10 con 0x7effc815dc90 2024-04-25T08:46:02.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.543+0000 7effcf7b7640 1 -- 172.21.15.172:0/3383188703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc8073990 con 0x7effc815dc90 2024-04-25T08:46:02.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.544+0000 7effbdffb640 1 -- 172.21.15.172:0/3383188703 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effc0042020 con 0x7effc815dc90 2024-04-25T08:46:02.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.544+0000 7effbdffb640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effac06b4d0 0x7effac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.544+0000 7effbdffb640 1 -- 172.21.15.172:0/3383188703 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7effc00aa3a0 con 0x7effc815dc90 2024-04-25T08:46:02.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.544+0000 7effcd553640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effac06b4d0 0x7effac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.545+0000 7effcd553640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effac06b4d0 0x7effac06d990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7effc81f85f0 tx=0x7effc4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:02.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.548+0000 7effbdffb640 1 -- 172.21.15.172:0/3383188703 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7effc0049030 con 0x7effc815dc90 2024-04-25T08:46:02.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.721+0000 7effcf7b7640 1 -- 172.21.15.172:0/3383188703 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effc80c5130 con 0x7effc815dc90 2024-04-25T08:46:02.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.721+0000 7effbdffb640 1 -- 172.21.15.172:0/3383188703 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+13355 (secure 0 0 0) 0x7effc0007c70 con 0x7effc815dc90 2024-04-25T08:46:02.713 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:02.713 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":57,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:01.417631+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:6835/3075611853":"2024-04-26T08:45:58.394592+0000","172.21.15.186:6833/3075611853":"2024-04-26T08:45:58.394592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:02.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 -- 172.21.15.172:0/3383188703 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effac06b4d0 msgr2=0x7effac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effac06b4d0 0x7effac06d990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7effc81f85f0 tx=0x7effc4009040 comp rx=0 tx=0).stop 2024-04-25T08:46:02.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 -- 172.21.15.172:0/3383188703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effc815dc90 msgr2=0x7effc80b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effc815dc90 0x7effc80b2690 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7effc0009f70 tx=0x7effc0004a40 comp rx=0 tx=0).stop 2024-04-25T08:46:02.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 -- 172.21.15.172:0/3383188703 shutdown_connections 2024-04-25T08:46:02.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effac06b4d0 0x7effac06d990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effc80d1810 0x7effc8159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effc815dc90 0x7effc80b2690 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 --2- 172.21.15.172:0/3383188703 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7effc80cc8e0 0x7effc80b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 -- 172.21.15.172:0/3383188703 >> 172.21.15.172:0/3383188703 conn(0x7effc806f590 msgr2=0x7effc80cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:02.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 -- 172.21.15.172:0/3383188703 shutdown_connections 2024-04-25T08:46:02.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.723+0000 7effcf7b7640 1 -- 172.21.15.172:0/3383188703 wait complete. 2024-04-25T08:46:02.726 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:46:02.726 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:46:02.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.834+0000 7fd07a2cb640 1 Processor -- start 2024-04-25T08:46:02.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.834+0000 7fd07a2cb640 1 -- start start 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.834+0000 7fd07a2cb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd0740b5620 0x7fd0740b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.834+0000 7fd07a2cb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd07406c2d0 0x7fd07406c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.834+0000 7fd07a2cb640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07406cc80 con 0x7fd07415b7d0 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.834+0000 7fd07a2cb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07406cf50 con 0x7fd0740b5620 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.834+0000 7fd07a2cb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0740ce530 con 0x7fd07406c2d0 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd073fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd07415b7d0 0x7fd0740cf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41872/0 (socket says 172.21.15.172:41872) 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd073fff640 1 -- 172.21.15.172:0/2829210764 learned_addr learned my addr 172.21.15.172:0/2829210764 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635320905 0 0) 0x7fd07406cc80 con 0x7fd07415b7d0 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd05c003520 con 0x7fd07415b7d0 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd0737fe640 1 --2- 172.21.15.172:0/2829210764 >> v2:172.21.15.186:3300/0 conn(0x7fd0740b5620 0x7fd0740b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd078868640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd07406c2d0 0x7fd07406c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2978385839 0 0) 0x7fd05c003520 con 0x7fd07415b7d0 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd07406c2d0 msgr2=0x7fd07406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd07406c2d0 0x7fd07406c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 >> v2:172.21.15.186:3300/0 conn(0x7fd0740b5620 msgr2=0x7fd0740b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 --2- 172.21.15.172:0/2829210764 >> v2:172.21.15.186:3300/0 conn(0x7fd0740b5620 0x7fd0740b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0740ce810 con 0x7fd07415b7d0 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fd064001670 con 0x7fd07415b7d0 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 >> v1:172.21.15.172:6789/0 conn(0x7fd07415b7d0 legacy=0x7fd0740cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd07406c2d0 0x7fd05c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 0x7fd05c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd05c004d40 0x7fd05c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07406cf50 con 0x7fd05c003fe0 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0740ce530 con 0x7fd05c004d40 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c00bac0 con 0x7fd07406c2d0 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd0737fe640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 0x7fd05c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd073fff640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd07406c2d0 0x7fd05c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.835+0000 7fd078868640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd05c004d40 0x7fd05c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.836+0000 7fd0737fe640 1 -- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd07406c2d0 msgr2=0x7fd05c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.836+0000 7fd0737fe640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd07406c2d0 0x7fd05c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.836+0000 7fd0737fe640 1 -- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd05c004d40 msgr2=0x7fd05c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.836+0000 7fd0737fe640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd05c004d40 0x7fd05c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.836+0000 7fd0737fe640 1 -- 172.21.15.172:0/2829210764 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c003520 con 0x7fd05c003fe0 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.836+0000 7fd0737fe640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 0x7fd05c004800 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd06800ba30 tx=0x7fd05c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fb5cf0f939e498 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.836+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068030070 con 0x7fd05c003fe0 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.836+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06802ae10 con 0x7fd05c003fe0 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.836+0000 7fd072ffd640 1 -- 172.21.15.172:0/2829210764 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800b600 con 0x7fd05c003fe0 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.837+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2829210764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 msgr2=0x7fd05c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.837+0000 7fd07a2cb640 1 --2- 172.21.15.172:0/2829210764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 0x7fd05c004800 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd06800ba30 tx=0x7fd05c005830 comp rx=0 tx=0).stop 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.837+0000 7fd078868640 1 -- 172.21.15.172:0/2829210764 reap_dead start 2024-04-25T08:46:02.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.837+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2829210764 shutdown_connections 2024-04-25T08:46:02.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.837+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2829210764 >> 172.21.15.172:0/2829210764 conn(0x7fd0740d0800 msgr2=0x7fd0740d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:02.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.837+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2829210764 shutdown_connections 2024-04-25T08:46:02.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.837+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2829210764 wait complete. 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.838+0000 7fd07a2cb640 1 Processor -- start 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.838+0000 7fd07a2cb640 1 -- start start 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd07a2cb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 0x7fd0740c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd07a2cb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0740c85c0 0x7fd0741522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd07a2cb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0740d1ed0 0x7fd0740d2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd07a2cb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07415bbb0 con 0x7fd05c003fe0 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd07a2cb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07406d230 con 0x7fd0740c85c0 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd07a2cb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07415bd30 con 0x7fd0740d1ed0 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd073fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 0x7fd0740c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd073fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 0x7fd0740c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51150/0 (socket says 172.21.15.172:51150) 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd073fff640 1 -- 172.21.15.172:0/2912512206 learned_addr learned my addr 172.21.15.172:0/2912512206 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:02.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd078868640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0740d1ed0 0x7fd0740d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd0737fe640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0740c85c0 0x7fd0741522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd073fff640 1 -- 172.21.15.172:0/2912512206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0740d1ed0 msgr2=0x7fd0740d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd073fff640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0740d1ed0 0x7fd0740d2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd073fff640 1 -- 172.21.15.172:0/2912512206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0740c85c0 msgr2=0x7fd0741522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd073fff640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0740c85c0 0x7fd0741522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.839+0000 7fd073fff640 1 -- 172.21.15.172:0/2912512206 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd074152810 con 0x7fd05c003fe0 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.840+0000 7fd0737fe640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0740c85c0 0x7fd0741522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.840+0000 7fd078868640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0740d1ed0 0x7fd0740d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.840+0000 7fd073fff640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 0x7fd0740c94b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd064007340 tx=0x7fd064007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.840+0000 7fd070ff9640 1 -- 172.21.15.172:0/2912512206 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06400f860 con 0x7fd05c003fe0 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.840+0000 7fd070ff9640 1 -- 172.21.15.172:0/2912512206 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd064018070 con 0x7fd05c003fe0 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.840+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2912512206 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0740c9c50 con 0x7fd05c003fe0 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.840+0000 7fd070ff9640 1 -- 172.21.15.172:0/2912512206 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06400fc40 con 0x7fd05c003fe0 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.840+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2912512206 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0740ca210 con 0x7fd05c003fe0 2024-04-25T08:46:02.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.841+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2912512206 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0740d2890 con 0x7fd05c003fe0 2024-04-25T08:46:02.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.841+0000 7fd070ff9640 1 -- 172.21.15.172:0/2912512206 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd06401d460 con 0x7fd05c003fe0 2024-04-25T08:46:02.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.842+0000 7fd070ff9640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06006b4d0 0x7fd06006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:02.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.842+0000 7fd0737fe640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06006b4d0 0x7fd06006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:02.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.842+0000 7fd070ff9640 1 -- 172.21.15.172:0/2912512206 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd06408a0b0 con 0x7fd05c003fe0 2024-04-25T08:46:02.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.842+0000 7fd0737fe640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06006b4d0 0x7fd06006d990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd06800ba00 tx=0x7fd068030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:02.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:02.846+0000 7fd070ff9640 1 -- 172.21.15.172:0/2912512206 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd064058ae0 con 0x7fd05c003fe0 2024-04-25T08:46:03.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.015+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2912512206 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd074073a00 con 0x7fd05c003fe0 2024-04-25T08:46:03.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.016+0000 7fd070ff9640 1 -- 172.21.15.172:0/2912512206 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd06405cb80 con 0x7fd05c003fe0 2024-04-25T08:46:03.007 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:46:03.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2912512206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06006b4d0 msgr2=0x7fd06006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06006b4d0 0x7fd06006d990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd06800ba00 tx=0x7fd068030000 comp rx=0 tx=0).stop 2024-04-25T08:46:03.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2912512206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 msgr2=0x7fd0740c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 0x7fd0740c94b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd064007340 tx=0x7fd064007800 comp rx=0 tx=0).stop 2024-04-25T08:46:03.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2912512206 shutdown_connections 2024-04-25T08:46:03.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06006b4d0 0x7fd06006d990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0740c85c0 0x7fd0741522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0740d1ed0 0x7fd0740d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 --2- 172.21.15.172:0/2912512206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd05c003fe0 0x7fd0740c94b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2912512206 >> 172.21.15.172:0/2912512206 conn(0x7fd0740d0800 msgr2=0x7fd0740cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:03.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2912512206 shutdown_connections 2024-04-25T08:46:03.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.018+0000 7fd07a2cb640 1 -- 172.21.15.172:0/2912512206 wait complete. 2024-04-25T08:46:03.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-04-25T08:46:03.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.126+0000 7fbe54129640 1 Processor -- start 2024-04-25T08:46:03.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.126+0000 7fbe54129640 1 -- start start 2024-04-25T08:46:03.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe54129640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c13d190 0x7fbe4c0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe54129640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbe4c15b320 0x7fbe4c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe54129640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c071ed0 con 0x7fbe4c071230 2024-04-25T08:46:03.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe54129640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c13d570 con 0x7fbe4c15b320 2024-04-25T08:46:03.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe54129640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c15a840 con 0x7fbe4c13d190 2024-04-25T08:46:03.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe516c4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbe4c15b320 0x7fbe4c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe51ec5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c13d190 0x7fbe4c0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe516c4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbe4c15b320 0x7fbe4c0cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:59138/0 (socket says 172.21.15.172:59138) 2024-04-25T08:46:03.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe516c4640 1 -- 172.21.15.172:0/1430708148 learned_addr learned my addr 172.21.15.172:0/1430708148 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:03.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe526c6640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fbe4c071230 0x7fbe4c0716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:48530/0 (socket says 172.21.15.172:48530) 2024-04-25T08:46:03.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe516c4640 1 -- 172.21.15.172:0/1430708148 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c13d190 msgr2=0x7fbe4c0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:03.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe516c4640 1 --2- 172.21.15.172:0/1430708148 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c13d190 0x7fbe4c0cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe516c4640 1 -- 172.21.15.172:0/1430708148 >> v1:172.21.15.186:6789/0 conn(0x7fbe4c071230 legacy=0x7fbe4c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe516c4640 1 -- 172.21.15.172:0/1430708148 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c15ab20 con 0x7fbe4c15b320 2024-04-25T08:46:03.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.127+0000 7fbe51ec5640 1 --2- 172.21.15.172:0/1430708148 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c13d190 0x7fbe4c0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:03.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.128+0000 7fbe516c4640 1 --2- 172.21.15.172:0/1430708148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c15b320 0x7fbe4c0cc4f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00bb10 tx=0x7fbe3c02c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6245e46c2c56424 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:03.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.128+0000 7fbe50ec3640 1 -- 172.21.15.172:0/1430708148 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c032790 con 0x7fbe4c15b320 2024-04-25T08:46:03.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.128+0000 7fbe50ec3640 1 -- 172.21.15.172:0/1430708148 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c038070 con 0x7fbe4c15b320 2024-04-25T08:46:03.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.128+0000 7fbe50ec3640 1 -- 172.21.15.172:0/1430708148 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c032b50 con 0x7fbe4c15b320 2024-04-25T08:46:03.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.129+0000 7fbe54129640 1 -- 172.21.15.172:0/1430708148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c15b320 msgr2=0x7fbe4c0cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.129+0000 7fbe54129640 1 --2- 172.21.15.172:0/1430708148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c15b320 0x7fbe4c0cc4f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00bb10 tx=0x7fbe3c02c890 comp rx=0 tx=0).stop 2024-04-25T08:46:03.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.129+0000 7fbe54129640 1 -- 172.21.15.172:0/1430708148 shutdown_connections 2024-04-25T08:46:03.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.129+0000 7fbe54129640 1 --2- 172.21.15.172:0/1430708148 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c15b320 0x7fbe4c0cc4f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.129+0000 7fbe54129640 1 --2- 172.21.15.172:0/1430708148 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c13d190 0x7fbe4c0cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.129+0000 7fbe54129640 1 -- 172.21.15.172:0/1430708148 >> 172.21.15.172:0/1430708148 conn(0x7fbe4c06abe0 msgr2=0x7fbe4c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:03.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.129+0000 7fbe54129640 1 -- 172.21.15.172:0/1430708148 shutdown_connections 2024-04-25T08:46:03.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.129+0000 7fbe54129640 1 -- 172.21.15.172:0/1430708148 wait complete. 2024-04-25T08:46:03.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.130+0000 7fbe54129640 1 Processor -- start 2024-04-25T08:46:03.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.130+0000 7fbe54129640 1 -- start start 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe54129640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c071230 0x7fbe4c1ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe54129640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c13d190 0x7fbe4c154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe54129640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c15b320 0x7fbe4c1f0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe54129640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0cf7a0 con 0x7fbe4c071230 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe54129640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0cf620 con 0x7fbe4c13d190 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe54129640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0cf920 con 0x7fbe4c15b320 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe51ec5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c071230 0x7fbe4c1ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe51ec5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c071230 0x7fbe4c1ef8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51152/0 (socket says 172.21.15.172:51152) 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe51ec5640 1 -- 172.21.15.172:0/1819696105 learned_addr learned my addr 172.21.15.172:0/1819696105 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe516c4640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c13d190 0x7fbe4c154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe526c6640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c15b320 0x7fbe4c1f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe51ec5640 1 -- 172.21.15.172:0/1819696105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c15b320 msgr2=0x7fbe4c1f0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe51ec5640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c15b320 0x7fbe4c1f0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe51ec5640 1 -- 172.21.15.172:0/1819696105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c13d190 msgr2=0x7fbe4c154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe51ec5640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c13d190 0x7fbe4c154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.131+0000 7fbe51ec5640 1 -- 172.21.15.172:0/1819696105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c1553b0 con 0x7fbe4c071230 2024-04-25T08:46:03.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.132+0000 7fbe51ec5640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c071230 0x7fbe4c1ef8a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009f60 tx=0x7fbe48009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:03.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.132+0000 7fbe427fc640 1 -- 172.21.15.172:0/1819696105 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48018020 con 0x7fbe4c071230 2024-04-25T08:46:03.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.132+0000 7fbe54129640 1 -- 172.21.15.172:0/1819696105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c155690 con 0x7fbe4c071230 2024-04-25T08:46:03.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.132+0000 7fbe427fc640 1 -- 172.21.15.172:0/1819696105 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe48014680 con 0x7fbe4c071230 2024-04-25T08:46:03.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.132+0000 7fbe427fc640 1 -- 172.21.15.172:0/1819696105 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48014a50 con 0x7fbe4c071230 2024-04-25T08:46:03.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.132+0000 7fbe54129640 1 -- 172.21.15.172:0/1819696105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c155c50 con 0x7fbe4c071230 2024-04-25T08:46:03.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.133+0000 7fbe54129640 1 -- 172.21.15.172:0/1819696105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c0b2220 con 0x7fbe4c071230 2024-04-25T08:46:03.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.133+0000 7fbe427fc640 1 -- 172.21.15.172:0/1819696105 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbe48005d10 con 0x7fbe4c071230 2024-04-25T08:46:03.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.133+0000 7fbe427fc640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3006b4d0 0x7fbe3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.134+0000 7fbe427fc640 1 -- 172.21.15.172:0/1819696105 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fbe4808af70 con 0x7fbe4c071230 2024-04-25T08:46:03.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.134+0000 7fbe516c4640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3006b4d0 0x7fbe3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.134+0000 7fbe516c4640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3006b4d0 0x7fbe3006d990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c037000 tx=0x7fbe3c03e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:03.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.138+0000 7fbe427fc640 1 -- 172.21.15.172:0/1819696105 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe48022030 con 0x7fbe4c071230 2024-04-25T08:46:03.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.376+0000 7fbe54129640 1 -- 172.21.15.172:0/1819696105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7fbe4c073990 con 0x7fbe4c071230 2024-04-25T08:46:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.428+0000 7fbe427fc640 1 -- 172.21.15.172:0/1819696105 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v194) v1 ==== 146+0+0 (secure 0 0 0) 0x7fbe48010040 con 0x7fbe4c071230 2024-04-25T08:46:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 -- 172.21.15.172:0/1819696105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3006b4d0 msgr2=0x7fbe3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3006b4d0 0x7fbe3006d990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c037000 tx=0x7fbe3c03e040 comp rx=0 tx=0).stop 2024-04-25T08:46:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 -- 172.21.15.172:0/1819696105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c071230 msgr2=0x7fbe4c1ef8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c071230 0x7fbe4c1ef8a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009f60 tx=0x7fbe48009f90 comp rx=0 tx=0).stop 2024-04-25T08:46:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 -- 172.21.15.172:0/1819696105 shutdown_connections 2024-04-25T08:46:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3006b4d0 0x7fbe3006d990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c13d190 0x7fbe4c154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c15b320 0x7fbe4c1f0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 --2- 172.21.15.172:0/1819696105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c071230 0x7fbe4c1ef8a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 -- 172.21.15.172:0/1819696105 >> 172.21.15.172:0/1819696105 conn(0x7fbe4c06abe0 msgr2=0x7fbe4c0cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 -- 172.21.15.172:0/1819696105 shutdown_connections 2024-04-25T08:46:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.430+0000 7fbe54129640 1 -- 172.21.15.172:0/1819696105 wait complete. 2024-04-25T08:46:03.433 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:46:03.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.542+0000 7f4313570640 1 Processor -- start 2024-04-25T08:46:03.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.542+0000 7f4313570640 1 -- start start 2024-04-25T08:46:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f4313570640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f430c0d0a00 0x7f430c162140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f4313570640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f430c0d0de0 0x7f430c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f4313570640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f430c0cd540 0x7f430c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f4313570640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c15e3a0 con 0x7f430c0d0a00 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f4313570640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c0cd9d0 con 0x7f430c0cd540 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f4313570640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0cdc70 con 0x7f430c0d0de0 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f431130c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f430c0d0a00 0x7f430c162140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f431130c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f430c0d0a00 0x7f430c162140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51162/0 (socket says 172.21.15.172:51162) 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f431130c640 1 -- 172.21.15.172:0/3924758929 learned_addr learned my addr 172.21.15.172:0/3924758929 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f4310b0b640 1 --2- 172.21.15.172:0/3924758929 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f430c0d0de0 0x7f430c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f4311b0d640 1 --2- 172.21.15.172:0/3924758929 >> v2:172.21.15.186:3300/0 conn(0x7f430c0cd540 0x7f430c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f431130c640 1 -- 172.21.15.172:0/3924758929 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f430c0d0de0 msgr2=0x7f430c0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f431130c640 1 --2- 172.21.15.172:0/3924758929 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f430c0d0de0 0x7f430c0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f431130c640 1 -- 172.21.15.172:0/3924758929 >> v2:172.21.15.186:3300/0 conn(0x7f430c0cd540 msgr2=0x7f430c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f431130c640 1 --2- 172.21.15.172:0/3924758929 >> v2:172.21.15.186:3300/0 conn(0x7f430c0cd540 0x7f430c0caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.543+0000 7f431130c640 1 -- 172.21.15.172:0/3924758929 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0cdf50 con 0x7f430c0d0a00 2024-04-25T08:46:03.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.544+0000 7f431130c640 1 --2- 172.21.15.172:0/3924758929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 0x7f430c162140 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f430c0731b0 tx=0x7f430802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11134e31d0cc925 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:03.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.544+0000 7f4303fff640 1 -- 172.21.15.172:0/3924758929 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308036070 con 0x7f430c0d0a00 2024-04-25T08:46:03.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.544+0000 7f4303fff640 1 -- 172.21.15.172:0/3924758929 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4308031600 con 0x7f430c0d0a00 2024-04-25T08:46:03.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.544+0000 7f4303fff640 1 -- 172.21.15.172:0/3924758929 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43080319d0 con 0x7f430c0d0a00 2024-04-25T08:46:03.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.545+0000 7f4313570640 1 -- 172.21.15.172:0/3924758929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 msgr2=0x7f430c162140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.545+0000 7f4313570640 1 --2- 172.21.15.172:0/3924758929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 0x7f430c162140 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f430c0731b0 tx=0x7f430802a610 comp rx=0 tx=0).stop 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.545+0000 7f4313570640 1 -- 172.21.15.172:0/3924758929 shutdown_connections 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.545+0000 7f4313570640 1 --2- 172.21.15.172:0/3924758929 >> v2:172.21.15.186:3300/0 conn(0x7f430c0cd540 0x7f430c0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.545+0000 7f4313570640 1 --2- 172.21.15.172:0/3924758929 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f430c0d0de0 0x7f430c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.545+0000 7f4313570640 1 --2- 172.21.15.172:0/3924758929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 0x7f430c162140 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.545+0000 7f4313570640 1 -- 172.21.15.172:0/3924758929 >> 172.21.15.172:0/3924758929 conn(0x7f430c0d17c0 msgr2=0x7f430c0d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.545+0000 7f4313570640 1 -- 172.21.15.172:0/3924758929 shutdown_connections 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.545+0000 7f4313570640 1 -- 172.21.15.172:0/3924758929 wait complete. 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.546+0000 7f4313570640 1 Processor -- start 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.546+0000 7f4313570640 1 -- start start 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4313570640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f430c0cd540 0x7f430c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4313570640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 0x7f430c146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4313570640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f430c0d0de0 0x7f430c06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4313570640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c161c20 con 0x7f430c0d0a00 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4313570640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c161940 con 0x7f430c0d0de0 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4313570640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0d1260 con 0x7f430c0cd540 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4310b0b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 0x7f430c146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4310b0b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 0x7f430c146570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51168/0 (socket says 172.21.15.172:51168) 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4310b0b640 1 -- 172.21.15.172:0/85976572 learned_addr learned my addr 172.21.15.172:0/85976572 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4310b0b640 1 -- 172.21.15.172:0/85976572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f430c0cd540 msgr2=0x7f430c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4310b0b640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f430c0cd540 0x7f430c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4311b0d640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f430c0d0de0 0x7f430c06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4310b0b640 1 -- 172.21.15.172:0/85976572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f430c0d0de0 msgr2=0x7f430c06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4310b0b640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f430c0d0de0 0x7f430c06cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4310b0b640 1 -- 172.21.15.172:0/85976572 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c145000 con 0x7f430c0d0a00 2024-04-25T08:46:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4310b0b640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 0x7f430c146570 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00d620 tx=0x7f42fc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4301ffb640 1 -- 172.21.15.172:0/85976572 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc00b620 con 0x7f430c0d0a00 2024-04-25T08:46:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4301ffb640 1 -- 172.21.15.172:0/85976572 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc019070 con 0x7f430c0d0a00 2024-04-25T08:46:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4313570640 1 -- 172.21.15.172:0/85976572 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c1f7100 con 0x7f430c0d0a00 2024-04-25T08:46:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.547+0000 7f4301ffb640 1 -- 172.21.15.172:0/85976572 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc00ba00 con 0x7f430c0d0a00 2024-04-25T08:46:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.548+0000 7f4313570640 1 -- 172.21.15.172:0/85976572 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c1f76c0 con 0x7f430c0d0a00 2024-04-25T08:46:03.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.549+0000 7f4313570640 1 -- 172.21.15.172:0/85976572 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c071b00 con 0x7f430c0d0a00 2024-04-25T08:46:03.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.549+0000 7f4301ffb640 1 -- 172.21.15.172:0/85976572 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f42fc00bba0 con 0x7f430c0d0a00 2024-04-25T08:46:03.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.549+0000 7f4301ffb640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f42f006b4d0 0x7f42f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:03.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.549+0000 7f4301ffb640 1 -- 172.21.15.172:0/85976572 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f42fc08a410 con 0x7f430c0d0a00 2024-04-25T08:46:03.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.549+0000 7f431130c640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f42f006b4d0 0x7f42f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:03.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.550+0000 7f431130c640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f42f006b4d0 0x7f42f006d990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4308033000 tx=0x7f430802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:03.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.554+0000 7f4301ffb640 1 -- 172.21.15.172:0/85976572 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f430c071b00 con 0x7f430c0d0a00 2024-04-25T08:46:03.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.723+0000 7f4313570640 1 -- 172.21.15.172:0/85976572 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f430c073a00 con 0x7f430c0d0a00 2024-04-25T08:46:03.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.727+0000 7f4301ffb640 1 -- 172.21.15.172:0/85976572 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f42fc059400 con 0x7f430c0d0a00 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 -- 172.21.15.172:0/85976572 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f42f006b4d0 msgr2=0x7f42f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f42f006b4d0 0x7f42f006d990 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4308033000 tx=0x7f430802e000 comp rx=0 tx=0).stop 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 -- 172.21.15.172:0/85976572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 msgr2=0x7f430c146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 0x7f430c146570 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00d620 tx=0x7f42fc00dae0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 -- 172.21.15.172:0/85976572 shutdown_connections 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f42f006b4d0 0x7f42f006d990 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f430c0d0de0 0x7f430c06cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f430c0d0a00 0x7f430c146570 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 --2- 172.21.15.172:0/85976572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f430c0cd540 0x7f430c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 -- 172.21.15.172:0/85976572 >> 172.21.15.172:0/85976572 conn(0x7f430c0d17c0 msgr2=0x7f430c0cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 -- 172.21.15.172:0/85976572 shutdown_connections 2024-04-25T08:46:03.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:03.729+0000 7f4313570640 1 -- 172.21.15.172:0/85976572 wait complete. 2024-04-25T08:46:03.731 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:46:03.731 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:46:03.770 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:46:03.818 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:46:03.841 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:03.841 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:03.855 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:46:03.856 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:46:03.856 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:03.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:46:03.873 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:03.873 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:03.911 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:46:03.911 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:46:03.911 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:03.930 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:46:03.930 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:46:03.930 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:04.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.057+0000 7fd1c9d89640 1 Processor -- start 2024-04-25T08:46:04.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.057+0000 7fd1c9d89640 1 -- start start 2024-04-25T08:46:04.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c9d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c415bd30 0x7fd1c40cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c9d89640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40d0350 con 0x7fd1c40d1b00 2024-04-25T08:46:04.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c9d89640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40d0630 con 0x7fd1c40cfe40 2024-04-25T08:46:04.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c9d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40d0910 con 0x7fd1c415bd30 2024-04-25T08:46:04.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c3fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd1c40d1b00 0x7fd1c40b4a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41876/0 (socket says 172.21.15.172:41876) 2024-04-25T08:46:04.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c3fff640 1 -- 172.21.15.172:0/25484077 learned_addr learned my addr 172.21.15.172:0/25484077 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:04.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c37fe640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c415bd30 0x7fd1c40cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179424317 0 0) 0x7fd1c40d0350 con 0x7fd1c40d1b00 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ac003520 con 0x7fd1c40d1b00 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 245577895 0 0) 0x7fd1ac003520 con 0x7fd1c40d1b00 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c415bd30 msgr2=0x7fd1c40cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c27fc640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c415bd30 0x7fd1c40cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.058+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 >> v1:172.21.15.186:6789/0 conn(0x7fd1c40cfe40 legacy=0x7fd1c40d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40d0bf0 con 0x7fd1c40d1b00 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fd1bc0019f0 con 0x7fd1c40d1b00 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 >> v1:172.21.15.172:6789/0 conn(0x7fd1c40d1b00 legacy=0x7fd1c40b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c27fc640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1ac0039e0 0x7fd1ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c27fc640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c415bd30 0x7fd1ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c27fc640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 0x7fd1ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40d0910 con 0x7fd1ac004d40 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac00b9c0 con 0x7fd1ac0039e0 2024-04-25T08:46:04.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac00bbc0 con 0x7fd1c415bd30 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c3fff640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 0x7fd1ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c37fe640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1ac0039e0 0x7fd1ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c2ffd640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c415bd30 0x7fd1ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c3fff640 1 -- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c415bd30 msgr2=0x7fd1ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c3fff640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c415bd30 0x7fd1ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c3fff640 1 -- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1ac0039e0 msgr2=0x7fd1ac003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c3fff640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1ac0039e0 0x7fd1ac003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.059+0000 7fd1c3fff640 1 -- 172.21.15.172:0/25484077 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac003520 con 0x7fd1ac004d40 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c3fff640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 0x7fd1ac0051c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00a860 tx=0x7fd1ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91643ee8532f96a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00a480 con 0x7fd1ac004d40 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc02f070 con 0x7fd1ac004d40 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c27fc640 1 -- 172.21.15.172:0/25484077 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc02bcd0 con 0x7fd1ac004d40 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c9d89640 1 -- 172.21.15.172:0/25484077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 msgr2=0x7fd1ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c9d89640 1 --2- 172.21.15.172:0/25484077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 0x7fd1ac0051c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00a860 tx=0x7fd1ac005830 comp rx=0 tx=0).stop 2024-04-25T08:46:04.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c3fff640 1 -- 172.21.15.172:0/25484077 reap_dead start 2024-04-25T08:46:04.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c9d89640 1 -- 172.21.15.172:0/25484077 shutdown_connections 2024-04-25T08:46:04.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c9d89640 1 -- 172.21.15.172:0/25484077 >> 172.21.15.172:0/25484077 conn(0x7fd1c406f590 msgr2=0x7fd1c406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:04.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c9d89640 1 -- 172.21.15.172:0/25484077 shutdown_connections 2024-04-25T08:46:04.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.060+0000 7fd1c9d89640 1 -- 172.21.15.172:0/25484077 wait complete. 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.061+0000 7fd1c9d89640 1 Processor -- start 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.062+0000 7fd1c9d89640 1 -- start start 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.062+0000 7fd1c9d89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 0x7fd1c40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.062+0000 7fd1c9d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c40ca8a0 0x7fd1c41f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.062+0000 7fd1c9d89640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1c41f1e30 0x7fd1c41f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.062+0000 7fd1c9d89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40b73b0 con 0x7fd1ac004d40 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.062+0000 7fd1c9d89640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c415c110 con 0x7fd1c41f1e30 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.062+0000 7fd1c9d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40b7530 con 0x7fd1c40ca8a0 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.062+0000 7fd1c37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 0x7fd1c40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.062+0000 7fd1c37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 0x7fd1c40ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51186/0 (socket says 172.21.15.172:51186) 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.062+0000 7fd1c37fe640 1 -- 172.21.15.172:0/506278992 learned_addr learned my addr 172.21.15.172:0/506278992 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c2ffd640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c40ca8a0 0x7fd1c41f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c3fff640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1c41f1e30 0x7fd1c41f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c37fe640 1 -- 172.21.15.172:0/506278992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c40ca8a0 msgr2=0x7fd1c41f18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c37fe640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c40ca8a0 0x7fd1c41f18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c37fe640 1 -- 172.21.15.172:0/506278992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1c41f1e30 msgr2=0x7fd1c41f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c37fe640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1c41f1e30 0x7fd1c41f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c37fe640 1 -- 172.21.15.172:0/506278992 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40cb0e0 con 0x7fd1ac004d40 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c3fff640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1c41f1e30 0x7fd1c41f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c37fe640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 0x7fd1c40ca360 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4011a00 tx=0x7fd1b4011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1abfff640 1 -- 172.21.15.172:0/506278992 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400fb50 con 0x7fd1ac004d40 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1abfff640 1 -- 172.21.15.172:0/506278992 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400fcf0 con 0x7fd1ac004d40 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1abfff640 1 -- 172.21.15.172:0/506278992 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400fea0 con 0x7fd1ac004d40 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c9d89640 1 -- 172.21.15.172:0/506278992 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c41f2ec0 con 0x7fd1ac004d40 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.063+0000 7fd1c9d89640 1 -- 172.21.15.172:0/506278992 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c40cad20 con 0x7fd1ac004d40 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.064+0000 7fd1c9d89640 1 -- 172.21.15.172:0/506278992 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c4073990 con 0x7fd1ac004d40 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.065+0000 7fd1abfff640 1 -- 172.21.15.172:0/506278992 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd1b4012040 con 0x7fd1ac004d40 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.065+0000 7fd1abfff640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1b006b4d0 0x7fd1b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.065+0000 7fd1abfff640 1 -- 172.21.15.172:0/506278992 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd1b408a640 con 0x7fd1ac004d40 2024-04-25T08:46:04.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.065+0000 7fd1c2ffd640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1b006b4d0 0x7fd1b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.065+0000 7fd1c2ffd640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1b006b4d0 0x7fd1b006d990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd1c41f5120 tx=0x7fd1b8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:04.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.069+0000 7fd1abfff640 1 -- 172.21.15.172:0/506278992 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd1b4019030 con 0x7fd1ac004d40 2024-04-25T08:46:04.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.278+0000 7fd1c9d89640 1 -- 172.21.15.172:0/506278992 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1c40b1ae0 con 0x7fd1ac004d40 2024-04-25T08:46:04.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.279+0000 7fd1abfff640 1 -- 172.21.15.172:0/506278992 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3711 (secure 0 0 0) 0x7fd1b40596c0 con 0x7fd1ac004d40 2024-04-25T08:46:04.271 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:04.271 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3132435571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3132435571},{"type":"v1","addr":"172.21.15.186:6834","nonce":3132435571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5862,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2549899470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2549899470},{"type":"v1","addr":"172.21.15.172:6835","nonce":2549899470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2905621525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2905621525},{"type":"v1","addr":"172.21.15.172:6837","nonce":2905621525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/1083107257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":1083107257},{"type":"v1","addr":"172.21.15.186:6835","nonce":1083107257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[]} 2024-04-25T08:46:04.271 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 29 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 -- 172.21.15.172:0/506278992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1b006b4d0 msgr2=0x7fd1b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1b006b4d0 0x7fd1b006d990 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd1c41f5120 tx=0x7fd1b8009040 comp rx=0 tx=0).stop 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 -- 172.21.15.172:0/506278992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 msgr2=0x7fd1c40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 0x7fd1c40ca360 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4011a00 tx=0x7fd1b4011ec0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 -- 172.21.15.172:0/506278992 shutdown_connections 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1b006b4d0 0x7fd1b006d990 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1c41f1e30 0x7fd1c41f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1c40ca8a0 0x7fd1c41f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 --2- 172.21.15.172:0/506278992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac004d40 0x7fd1c40ca360 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 -- 172.21.15.172:0/506278992 >> 172.21.15.172:0/506278992 conn(0x7fd1c406f590 msgr2=0x7fd1c415b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 -- 172.21.15.172:0/506278992 shutdown_connections 2024-04-25T08:46:04.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.281+0000 7fd1c9d89640 1 -- 172.21.15.172:0/506278992 wait complete. 2024-04-25T08:46:04.284 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:46:04.284 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:46:04.284 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:46:04.284 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:04.284 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:46:04.284 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:46:04.285 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:46:04.285 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:04.285 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:46:04.285 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:46:04.285 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:46:04.285 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:04.285 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:46:04.285 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:46:04.286 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:46:04.286 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:04.294 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:46:04.294 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:46:04.295 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:46:04.295 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:46:04.298 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:46:04.298 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:46:04.299 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:46:04.299 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:46:04.337 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:46:04.337 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:04.337 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:46:04.338 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:04.341 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:46:04.341 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:04.341 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:46:04.342 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:04.342 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:46:04.409 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:46:04.410 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:46:04.421 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:46:04.421 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:46:04.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.454+0000 7fd1d98b5640 1 Processor -- start 2024-04-25T08:46:04.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.454+0000 7fd1d98b5640 1 -- start start 2024-04-25T08:46:04.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.455+0000 7fd1d98b5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d40ced80 0x7fd1d40d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.455+0000 7fd1d98b5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd1d4161710 0x7fd1d40d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.455+0000 7fd1d98b5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d415e000 con 0x7fd1d415dc20 2024-04-25T08:46:04.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.455+0000 7fd1d98b5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d40d1de0 con 0x7fd1d4161710 2024-04-25T08:46:04.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.455+0000 7fd1d98b5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4161c60 con 0x7fd1d40ced80 2024-04-25T08:46:04.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.455+0000 7fd1d2ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd1d415dc20 0x7fd1d40ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41894/0 (socket says 172.21.15.172:41894) 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.455+0000 7fd1d2ffd640 1 -- 172.21.15.172:0/195497205 learned_addr learned my addr 172.21.15.172:0/195497205 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.455+0000 7fd1d37fe640 1 --2- 172.21.15.172:0/195497205 >> v2:172.21.15.172:3300/0 conn(0x7fd1d4161710 0x7fd1d40d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.455+0000 7fd1d27fc640 1 --2- 172.21.15.172:0/195497205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d40ced80 0x7fd1d40d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.456+0000 7fd1d1ffb640 1 -- 172.21.15.172:0/195497205 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504408701 0 0) 0x7fd1d415e000 con 0x7fd1d415dc20 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.456+0000 7fd1d1ffb640 1 -- 172.21.15.172:0/195497205 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1bc003520 con 0x7fd1d415dc20 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.456+0000 7fd1d37fe640 1 -- 172.21.15.172:0/195497205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d40ced80 msgr2=0x7fd1d40d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.456+0000 7fd1d37fe640 1 --2- 172.21.15.172:0/195497205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d40ced80 0x7fd1d40d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.456+0000 7fd1d37fe640 1 -- 172.21.15.172:0/195497205 >> v1:172.21.15.172:6789/0 conn(0x7fd1d415dc20 legacy=0x7fd1d40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.456+0000 7fd1d37fe640 1 -- 172.21.15.172:0/195497205 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d4161f40 con 0x7fd1d4161710 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.456+0000 7fd1d37fe640 1 --2- 172.21.15.172:0/195497205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d4161710 0x7fd1d40d2820 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0097a0 tx=0x7fd1cc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe73245a78ecd06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d1ffb640 1 -- 172.21.15.172:0/195497205 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc037070 con 0x7fd1d4161710 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d1ffb640 1 -- 172.21.15.172:0/195497205 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc032440 con 0x7fd1d4161710 2024-04-25T08:46:04.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d1ffb640 1 -- 172.21.15.172:0/195497205 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0327f0 con 0x7fd1d4161710 2024-04-25T08:46:04.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d98b5640 1 -- 172.21.15.172:0/195497205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d4161710 msgr2=0x7fd1d40d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d98b5640 1 --2- 172.21.15.172:0/195497205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d4161710 0x7fd1d40d2820 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0097a0 tx=0x7fd1cc02a180 comp rx=0 tx=0).stop 2024-04-25T08:46:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d98b5640 1 -- 172.21.15.172:0/195497205 shutdown_connections 2024-04-25T08:46:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d98b5640 1 --2- 172.21.15.172:0/195497205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d40ced80 0x7fd1d40d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d98b5640 1 --2- 172.21.15.172:0/195497205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d4161710 0x7fd1d40d2820 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d98b5640 1 -- 172.21.15.172:0/195497205 >> 172.21.15.172:0/195497205 conn(0x7fd1d40d0420 msgr2=0x7fd1d40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d98b5640 1 -- 172.21.15.172:0/195497205 shutdown_connections 2024-04-25T08:46:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.457+0000 7fd1d98b5640 1 -- 172.21.15.172:0/195497205 wait complete. 2024-04-25T08:46:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.459+0000 7fd1d98b5640 1 Processor -- start 2024-04-25T08:46:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.459+0000 7fd1d98b5640 1 -- start start 2024-04-25T08:46:04.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d98b5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d40ced80 0x7fd1d40c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d98b5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d415dc20 0x7fd1d4159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d98b5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1d4161710 0x7fd1d40d3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d98b5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40b5e50 con 0x7fd1d40ced80 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d98b5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4162500 con 0x7fd1d4161710 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d40ced80 0x7fd1d40c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d40ced80 0x7fd1d40c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51220/0 (socket says 172.21.15.172:51220) 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d2ffd640 1 -- 172.21.15.172:0/3901222182 learned_addr learned my addr 172.21.15.172:0/3901222182 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d98b5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40b5fd0 con 0x7fd1d415dc20 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d37fe640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1d4161710 0x7fd1d40d3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d27fc640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d415dc20 0x7fd1d4159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d2ffd640 1 -- 172.21.15.172:0/3901222182 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d415dc20 msgr2=0x7fd1d4159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d2ffd640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d415dc20 0x7fd1d4159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d2ffd640 1 -- 172.21.15.172:0/3901222182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1d4161710 msgr2=0x7fd1d40d3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d2ffd640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1d4161710 0x7fd1d40d3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:04.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d2ffd640 1 -- 172.21.15.172:0/3901222182 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40ca2f0 con 0x7fd1d40ced80 2024-04-25T08:46:04.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1d2ffd640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d40ced80 0x7fd1d40c9db0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400cbc0 tx=0x7fd1c400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:04.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.460+0000 7fd1bbfff640 1 -- 172.21.15.172:0/3901222182 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4017070 con 0x7fd1d40ced80 2024-04-25T08:46:04.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.461+0000 7fd1bbfff640 1 -- 172.21.15.172:0/3901222182 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c400ad40 con 0x7fd1d40ced80 2024-04-25T08:46:04.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.461+0000 7fd1bbfff640 1 -- 172.21.15.172:0/3901222182 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4012620 con 0x7fd1d40ced80 2024-04-25T08:46:04.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.461+0000 7fd1d98b5640 1 -- 172.21.15.172:0/3901222182 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d415a010 con 0x7fd1d40ced80 2024-04-25T08:46:04.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.461+0000 7fd1d98b5640 1 -- 172.21.15.172:0/3901222182 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d415a5d0 con 0x7fd1d40ced80 2024-04-25T08:46:04.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.462+0000 7fd1d98b5640 1 -- 172.21.15.172:0/3901222182 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d4073a00 con 0x7fd1d40ced80 2024-04-25T08:46:04.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.462+0000 7fd1bbfff640 1 -- 172.21.15.172:0/3901222182 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd1c401a070 con 0x7fd1d40ced80 2024-04-25T08:46:04.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.462+0000 7fd1bbfff640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1c006b4d0 0x7fd1c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:04.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.463+0000 7fd1bbfff640 1 -- 172.21.15.172:0/3901222182 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd1c4089e60 con 0x7fd1d40ced80 2024-04-25T08:46:04.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.463+0000 7fd1d27fc640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1c006b4d0 0x7fd1c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:04.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.463+0000 7fd1d27fc640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1c006b4d0 0x7fd1c006d990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4146b60 tx=0x7fd1c8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:04.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.467+0000 7fd1bbfff640 1 -- 172.21.15.172:0/3901222182 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd1c4058ee0 con 0x7fd1d40ced80 2024-04-25T08:46:04.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:04.651+0000 7fd1d98b5640 1 -- 172.21.15.172:0/3901222182 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd1d40d3390 con 0x7fd1d40ced80 2024-04-25T08:46:05.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.438+0000 7fd1bbfff640 1 -- 172.21.15.172:0/3901222182 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd1c40587e0 con 0x7fd1d40ced80 2024-04-25T08:46:05.430 INFO:teuthology.orchestra.run.smithi172.stderr: removed all blocklist entries 2024-04-25T08:46:05.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.440+0000 7fd1d98b5640 1 -- 172.21.15.172:0/3901222182 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1c006b4d0 msgr2=0x7fd1c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.440+0000 7fd1d98b5640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1c006b4d0 0x7fd1c006d990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4146b60 tx=0x7fd1c8008040 comp rx=0 tx=0).stop 2024-04-25T08:46:05.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.440+0000 7fd1d98b5640 1 -- 172.21.15.172:0/3901222182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d40ced80 msgr2=0x7fd1d40c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.440+0000 7fd1d98b5640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d40ced80 0x7fd1d40c9db0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400cbc0 tx=0x7fd1c400a430 comp rx=0 tx=0).stop 2024-04-25T08:46:05.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.440+0000 7fd1d98b5640 1 -- 172.21.15.172:0/3901222182 shutdown_connections 2024-04-25T08:46:05.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.440+0000 7fd1d98b5640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1c006b4d0 0x7fd1c006d990 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.440+0000 7fd1d98b5640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1d4161710 0x7fd1d40d3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.440+0000 7fd1d98b5640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d415dc20 0x7fd1d4159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.440+0000 7fd1d98b5640 1 --2- 172.21.15.172:0/3901222182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d40ced80 0x7fd1d40c9db0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.440+0000 7fd1d98b5640 1 -- 172.21.15.172:0/3901222182 >> 172.21.15.172:0/3901222182 conn(0x7fd1d40d0420 msgr2=0x7fd1d40b8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:05.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.441+0000 7fd1d98b5640 1 -- 172.21.15.172:0/3901222182 shutdown_connections 2024-04-25T08:46:05.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.441+0000 7fd1d98b5640 1 -- 172.21.15.172:0/3901222182 wait complete. 2024-04-25T08:46:05.446 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:46:05.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.556+0000 7eff3e5c8640 1 Processor -- start 2024-04-25T08:46:05.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.557+0000 7eff3e5c8640 1 -- start start 2024-04-25T08:46:05.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.557+0000 7eff3e5c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff38154ee0 0x7eff380cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.557+0000 7eff3e5c8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7eff380cfcf0 0x7eff380cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.557+0000 7eff3e5c8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff38071480 con 0x7eff380ce3c0 2024-04-25T08:46:05.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.557+0000 7eff3e5c8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff380ce830 con 0x7eff380cfcf0 2024-04-25T08:46:05.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.557+0000 7eff3e5c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff38072090 con 0x7eff38154ee0 2024-04-25T08:46:05.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.557+0000 7eff3cb65640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7eff380ce3c0 0x7eff3815e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41910/0 (socket says 172.21.15.172:41910) 2024-04-25T08:46:05.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff3cb65640 1 -- 172.21.15.172:0/3611509969 learned_addr learned my addr 172.21.15.172:0/3611509969 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:05.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff377fe640 1 --2- 172.21.15.172:0/3611509969 >> v2:172.21.15.186:3300/0 conn(0x7eff380cfcf0 0x7eff380cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff37fff640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff38154ee0 0x7eff380cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271737762 0 0) 0x7eff38071480 con 0x7eff380ce3c0 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff20003520 con 0x7eff380ce3c0 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3764869721 0 0) 0x7eff20003520 con 0x7eff380ce3c0 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff38154ee0 msgr2=0x7eff380cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff38154ee0 0x7eff380cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 >> v2:172.21.15.186:3300/0 conn(0x7eff380cfcf0 msgr2=0x7eff380cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 --2- 172.21.15.172:0/3611509969 >> v2:172.21.15.186:3300/0 conn(0x7eff380cfcf0 0x7eff380cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff38071760 con 0x7eff380ce3c0 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7eff300019f0 con 0x7eff380ce3c0 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 >> v1:172.21.15.172:6789/0 conn(0x7eff380ce3c0 legacy=0x7eff3815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 0x7eff20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff20004800 0x7eff20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff200051c0 0x7eff2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380ce830 con 0x7eff200039b0 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2000bf00 con 0x7eff20004800 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2000c080 con 0x7eff200051c0 2024-04-25T08:46:05.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff37fff640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff38154ee0 0x7eff380cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff377fe640 1 --2- 172.21.15.172:0/3611509969 >> v2:172.21.15.186:3300/0 conn(0x7eff380cfcf0 0x7eff380cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff37fff640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 0x7eff20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff3cb65640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff200051c0 0x7eff2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.558+0000 7eff377fe640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff20004800 0x7eff20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.559+0000 7eff37fff640 1 -- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff200051c0 msgr2=0x7eff2000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.559+0000 7eff37fff640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff200051c0 0x7eff2000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.559+0000 7eff37fff640 1 -- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff20004800 msgr2=0x7eff20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.559+0000 7eff37fff640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff20004800 0x7eff20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.559+0000 7eff37fff640 1 -- 172.21.15.172:0/3611509969 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20003520 con 0x7eff200039b0 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.559+0000 7eff37fff640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 0x7eff20003dd0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7eff28009b00 tx=0x7eff20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ba74f673c05807 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.559+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28036070 con 0x7eff200039b0 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.559+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff28004030 con 0x7eff200039b0 2024-04-25T08:46:05.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.559+0000 7eff36ffd640 1 -- 172.21.15.172:0/3611509969 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280097d0 con 0x7eff200039b0 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.560+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3611509969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 msgr2=0x7eff20003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.560+0000 7eff3e5c8640 1 --2- 172.21.15.172:0/3611509969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 0x7eff20003dd0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7eff28009b00 tx=0x7eff20005830 comp rx=0 tx=0).stop 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.560+0000 7eff3cb65640 1 -- 172.21.15.172:0/3611509969 reap_dead start 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.560+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3611509969 shutdown_connections 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.560+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3611509969 >> 172.21.15.172:0/3611509969 conn(0x7eff3806abe0 msgr2=0x7eff3806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.560+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3611509969 shutdown_connections 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.560+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3611509969 wait complete. 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.561+0000 7eff3e5c8640 1 Processor -- start 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.561+0000 7eff3e5c8640 1 -- start start 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff3e5c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 0x7eff380b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff3e5c8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff380b1960 0x7eff3815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff3e5c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff3815c780 0x7eff3815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff3e5c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38071230 con 0x7eff200039b0 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff3e5c8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38071d20 con 0x7eff380b1960 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff3e5c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff381552c0 con 0x7eff3815c780 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 0x7eff380b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 0x7eff380b1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51230/0 (socket says 172.21.15.172:51230) 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff37fff640 1 -- 172.21.15.172:0/3012360425 learned_addr learned my addr 172.21.15.172:0/3012360425 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff37fff640 1 -- 172.21.15.172:0/3012360425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff3815c780 msgr2=0x7eff3815cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff37fff640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff3815c780 0x7eff3815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff37fff640 1 -- 172.21.15.172:0/3012360425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff380b1960 msgr2=0x7eff3815c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff37fff640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff380b1960 0x7eff3815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.562+0000 7eff37fff640 1 -- 172.21.15.172:0/3012360425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff38149b80 con 0x7eff200039b0 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.563+0000 7eff37fff640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 0x7eff380b1420 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7eff28034040 tx=0x7eff28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.563+0000 7eff34ff9640 1 -- 172.21.15.172:0/3012360425 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28041020 con 0x7eff200039b0 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.563+0000 7eff34ff9640 1 -- 172.21.15.172:0/3012360425 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff28037040 con 0x7eff200039b0 2024-04-25T08:46:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.563+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3012360425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff38149e60 con 0x7eff200039b0 2024-04-25T08:46:05.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.563+0000 7eff34ff9640 1 -- 172.21.15.172:0/3012360425 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28036070 con 0x7eff200039b0 2024-04-25T08:46:05.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.563+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3012360425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3814a420 con 0x7eff200039b0 2024-04-25T08:46:05.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.564+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3012360425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff380d0150 con 0x7eff200039b0 2024-04-25T08:46:05.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.564+0000 7eff34ff9640 1 -- 172.21.15.172:0/3012360425 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff28044020 con 0x7eff200039b0 2024-04-25T08:46:05.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.565+0000 7eff34ff9640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff2406b500 0x7eff2406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.565+0000 7eff34ff9640 1 -- 172.21.15.172:0/3012360425 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5249+0+0 (secure 0 0 0) 0x7eff280aa520 con 0x7eff200039b0 2024-04-25T08:46:05.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.565+0000 7eff377fe640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff2406b500 0x7eff2406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.565+0000 7eff377fe640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff2406b500 0x7eff2406d9c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7eff2c006d40 tx=0x7eff2c006cb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:05.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.569+0000 7eff34ff9640 1 -- 172.21.15.172:0/3012360425 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff380d0150 con 0x7eff200039b0 2024-04-25T08:46:05.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.805+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3012360425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7eff38073990 con 0x7eff200039b0 2024-04-25T08:46:05.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.805+0000 7eff34ff9640 1 -- 172.21.15.172:0/3012360425 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7eff2804b030 con 0x7eff200039b0 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: "auth_dump": [ 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.a", 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q==", 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.797 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.b", 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg==", 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.c", 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA==", 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:46:05.798 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.d", 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg==", 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.0", 2024-04-25T08:46:05.799 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ==", 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.1", 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g==", 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.800 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.2", 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g==", 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.3", 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg==", 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.801 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.4", 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw==", 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.5", 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow==", 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:05.802 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.6", 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg==", 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.7", 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q==", 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.803 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.0", 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q==", 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow r", 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.1", 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g==", 2024-04-25T08:46:05.804 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.2", 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw==", 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.805 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.3", 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w==", 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.admin", 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmFmQsIBAAkuAmqIptAT1ivH6T7/1T8A==", 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:46:05.806 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.x", 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw==", 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.y", 2024-04-25T08:46:05.807 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg==", 2024-04-25T08:46:05.808 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:05.808 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:46:05.808 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:46:05.808 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:05.808 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.808 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:05.808 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-25T08:46:05.808 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3012360425 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff2406b500 msgr2=0x7eff2406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff2406b500 0x7eff2406d9c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7eff2c006d40 tx=0x7eff2c006cb0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3012360425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 msgr2=0x7eff380b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 0x7eff380b1420 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7eff28034040 tx=0x7eff28004730 comp rx=0 tx=0).stop 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3012360425 shutdown_connections 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7eff2406b500 0x7eff2406d9c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff380b1960 0x7eff3815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff3815c780 0x7eff3815cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 --2- 172.21.15.172:0/3012360425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff200039b0 0x7eff380b1420 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3012360425 >> 172.21.15.172:0/3012360425 conn(0x7eff3806abe0 msgr2=0x7eff3814e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:05.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3012360425 shutdown_connections 2024-04-25T08:46:05.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.807+0000 7eff3e5c8640 1 -- 172.21.15.172:0/3012360425 wait complete. 2024-04-25T08:46:05.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:05.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.916+0000 7f411fd22640 1 Processor -- start 2024-04-25T08:46:05.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.916+0000 7f411fd22640 1 -- start start 2024-04-25T08:46:05.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.917+0000 7f411fd22640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f411815dc90 0x7f41181625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.917+0000 7f411fd22640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f41180d1810 0x7f41180d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.917+0000 7f411fd22640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41180cce50 con 0x7f41180cc8e0 2024-04-25T08:46:05.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.917+0000 7f411fd22640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41180d21c0 con 0x7f411815dc90 2024-04-25T08:46:05.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.917+0000 7f411fd22640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4118161af0 con 0x7f41180d1810 2024-04-25T08:46:05.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.917+0000 7f411dabe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f411815dc90 0x7f41181625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.917+0000 7f411d2bd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f41180cc8e0 0x7f411815ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41924/0 (socket says 172.21.15.172:41924) 2024-04-25T08:46:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.917+0000 7f411d2bd640 1 -- 172.21.15.172:0/276131174 learned_addr learned my addr 172.21.15.172:0/276131174 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.918+0000 7f411e2bf640 1 --2- 172.21.15.172:0/276131174 >> v2:172.21.15.186:3300/0 conn(0x7f41180d1810 0x7f41180d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.918+0000 7f411dabe640 1 -- 172.21.15.172:0/276131174 >> v2:172.21.15.186:3300/0 conn(0x7f41180d1810 msgr2=0x7f41180d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.918+0000 7f411dabe640 1 --2- 172.21.15.172:0/276131174 >> v2:172.21.15.186:3300/0 conn(0x7f41180d1810 0x7f41180d1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.918+0000 7f411dabe640 1 -- 172.21.15.172:0/276131174 >> v1:172.21.15.172:6789/0 conn(0x7f41180cc8e0 legacy=0x7f411815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.918+0000 7f411dabe640 1 -- 172.21.15.172:0/276131174 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4118161dd0 con 0x7f411815dc90 2024-04-25T08:46:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.918+0000 7f411cabc640 1 -- 172.21.15.172:0/276131174 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710970197 0 0) 0x7f41180cce50 con 0x7f41180cc8e0 2024-04-25T08:46:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.918+0000 7f411e2bf640 1 --2- 172.21.15.172:0/276131174 >> v2:172.21.15.186:3300/0 conn(0x7f41180d1810 0x7f41180d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.918+0000 7f411dabe640 1 --2- 172.21.15.172:0/276131174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f411815dc90 0x7f41181625d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f41180cdbb0 tx=0x7f411402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aefd1d6c1b5737f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411cabc640 1 -- 172.21.15.172:0/276131174 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114037070 con 0x7f411815dc90 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411cabc640 1 -- 172.21.15.172:0/276131174 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4114032440 con 0x7f411815dc90 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411cabc640 1 -- 172.21.15.172:0/276131174 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411402ae60 con 0x7f411815dc90 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411fd22640 1 -- 172.21.15.172:0/276131174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f411815dc90 msgr2=0x7f41181625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411fd22640 1 --2- 172.21.15.172:0/276131174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f411815dc90 0x7f41181625d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f41180cdbb0 tx=0x7f411402a110 comp rx=0 tx=0).stop 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411fd22640 1 -- 172.21.15.172:0/276131174 shutdown_connections 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411fd22640 1 --2- 172.21.15.172:0/276131174 >> v2:172.21.15.186:3300/0 conn(0x7f41180d1810 0x7f41180d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411fd22640 1 --2- 172.21.15.172:0/276131174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f411815dc90 0x7f41181625d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411fd22640 1 -- 172.21.15.172:0/276131174 >> 172.21.15.172:0/276131174 conn(0x7f411806f590 msgr2=0x7f411806f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411fd22640 1 -- 172.21.15.172:0/276131174 shutdown_connections 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.919+0000 7f411fd22640 1 -- 172.21.15.172:0/276131174 wait complete. 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.920+0000 7f411fd22640 1 Processor -- start 2024-04-25T08:46:05.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.920+0000 7f411fd22640 1 -- start start 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.921+0000 7f411fd22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41180cc8e0 0x7f41180c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.921+0000 7f411fd22640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41180d1810 0x7f41180b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.921+0000 7f411fd22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f411815dc90 0x7f41180b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.921+0000 7f411fd22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411815e070 con 0x7f41180cc8e0 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.921+0000 7f411fd22640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41180cd130 con 0x7f41180d1810 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.921+0000 7f411fd22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411815e1f0 con 0x7f411815dc90 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.921+0000 7f411dabe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41180cc8e0 0x7f41180c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.921+0000 7f411dabe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41180cc8e0 0x7f41180c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51248/0 (socket says 172.21.15.172:51248) 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.921+0000 7f411dabe640 1 -- 172.21.15.172:0/4172039882 learned_addr learned my addr 172.21.15.172:0/4172039882 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411e2bf640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f411815dc90 0x7f41180b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411d2bd640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41180d1810 0x7f41180b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411dabe640 1 -- 172.21.15.172:0/4172039882 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f411815dc90 msgr2=0x7f41180b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411dabe640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f411815dc90 0x7f41180b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411dabe640 1 -- 172.21.15.172:0/4172039882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41180d1810 msgr2=0x7f41180b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411dabe640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41180d1810 0x7f41180b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411dabe640 1 -- 172.21.15.172:0/4172039882 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411815fe10 con 0x7f41180cc8e0 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411e2bf640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f411815dc90 0x7f41180b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411d2bd640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41180d1810 0x7f41180b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411dabe640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41180cc8e0 0x7f41180c7c70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f4114009890 tx=0x7f41140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f410e7fc640 1 -- 172.21.15.172:0/4172039882 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114037040 con 0x7f41180cc8e0 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f410e7fc640 1 -- 172.21.15.172:0/4172039882 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4114042070 con 0x7f41180cc8e0 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411fd22640 1 -- 172.21.15.172:0/4172039882 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41181600f0 con 0x7f41180cc8e0 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f410e7fc640 1 -- 172.21.15.172:0/4172039882 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114030a50 con 0x7f41180cc8e0 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.922+0000 7f411fd22640 1 -- 172.21.15.172:0/4172039882 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41181606b0 con 0x7f41180cc8e0 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.923+0000 7f411fd22640 1 -- 172.21.15.172:0/4172039882 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4118073990 con 0x7f41180cc8e0 2024-04-25T08:46:05.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.923+0000 7f410e7fc640 1 -- 172.21.15.172:0/4172039882 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4114030bf0 con 0x7f41180cc8e0 2024-04-25T08:46:05.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.924+0000 7f410e7fc640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40fc06b500 0x7f40fc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:05.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.924+0000 7f410e7fc640 1 -- 172.21.15.172:0/4172039882 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f41140aaa00 con 0x7f41180cc8e0 2024-04-25T08:46:05.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.924+0000 7f411d2bd640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40fc06b500 0x7f40fc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:05.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.924+0000 7f411d2bd640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40fc06b500 0x7f40fc06d9c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f411806ddf0 tx=0x7f4108009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:05.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:05.928+0000 7f410e7fc640 1 -- 172.21.15.172:0/4172039882 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4114045360 con 0x7f41180cc8e0 2024-04-25T08:46:06.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.098+0000 7f411fd22640 1 -- 172.21.15.172:0/4172039882 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41180cf6b0 con 0x7f41180cc8e0 2024-04-25T08:46:06.090 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.099+0000 7f410e7fc640 1 -- 172.21.15.172:0/4172039882 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+13224 (secure 0 0 0) 0x7f4114079bf0 con 0x7f41180cc8e0 2024-04-25T08:46:06.090 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:06.091 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":61,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:05.436194+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 -- 172.21.15.172:0/4172039882 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40fc06b500 msgr2=0x7f40fc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40fc06b500 0x7f40fc06d9c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f411806ddf0 tx=0x7f4108009040 comp rx=0 tx=0).stop 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 -- 172.21.15.172:0/4172039882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41180cc8e0 msgr2=0x7f41180c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41180cc8e0 0x7f41180c7c70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f4114009890 tx=0x7f41140046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 -- 172.21.15.172:0/4172039882 shutdown_connections 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40fc06b500 0x7f40fc06d9c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41180d1810 0x7f41180b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f411815dc90 0x7f41180b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 --2- 172.21.15.172:0/4172039882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41180cc8e0 0x7f41180c7c70 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 -- 172.21.15.172:0/4172039882 >> 172.21.15.172:0/4172039882 conn(0x7f411806f590 msgr2=0x7f41180b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 -- 172.21.15.172:0/4172039882 shutdown_connections 2024-04-25T08:46:06.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.101+0000 7f411fd22640 1 -- 172.21.15.172:0/4172039882 wait complete. 2024-04-25T08:46:06.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:46:06.104 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:46:06.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.213+0000 7f74aade7640 1 Processor -- start 2024-04-25T08:46:06.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.213+0000 7f74aade7640 1 -- start start 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74aade7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f74a4070dc0 0x7f74a406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74aade7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f74a415deb0 0x7f74a415e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74aade7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40d1770 con 0x7f74a40711a0 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74aade7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a40b0eb0 con 0x7f74a4070dc0 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74aade7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a41622b0 con 0x7f74a415deb0 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74a8b83640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f74a4070dc0 0x7f74a406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74a8b83640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f74a4070dc0 0x7f74a406ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51250/0 (socket says 172.21.15.172:51250) 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f749bfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f74a40711a0 0x7f74a40b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41930/0 (socket says 172.21.15.172:41930) 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74a8b83640 1 -- 172.21.15.172:0/3172510024 learned_addr learned my addr 172.21.15.172:0/3172510024 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74a9384640 1 --2- 172.21.15.172:0/3172510024 >> v2:172.21.15.186:3300/0 conn(0x7f74a415deb0 0x7f74a415e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74a8b83640 1 -- 172.21.15.172:0/3172510024 >> v2:172.21.15.186:3300/0 conn(0x7f74a415deb0 msgr2=0x7f74a415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74a8b83640 1 --2- 172.21.15.172:0/3172510024 >> v2:172.21.15.186:3300/0 conn(0x7f74a415deb0 0x7f74a415e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74a8b83640 1 -- 172.21.15.172:0/3172510024 >> v1:172.21.15.172:6789/0 conn(0x7f74a40711a0 legacy=0x7f74a40b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.214+0000 7f74a8b83640 1 -- 172.21.15.172:0/3172510024 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4162740 con 0x7f74a4070dc0 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.215+0000 7f74a8b83640 1 --2- 172.21.15.172:0/3172510024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 0x7f74a406ccd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f74a4070570 tx=0x7f74a002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442c36d4d4d7e373 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.215+0000 7f749b7fe640 1 -- 172.21.15.172:0/3172510024 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0037070 con 0x7f74a4070dc0 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.215+0000 7f749b7fe640 1 -- 172.21.15.172:0/3172510024 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0032440 con 0x7f74a4070dc0 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.215+0000 7f749b7fe640 1 -- 172.21.15.172:0/3172510024 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0032810 con 0x7f74a4070dc0 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.216+0000 7f74aade7640 1 -- 172.21.15.172:0/3172510024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 msgr2=0x7f74a406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.216+0000 7f74aade7640 1 --2- 172.21.15.172:0/3172510024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 0x7f74a406ccd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f74a4070570 tx=0x7f74a002a150 comp rx=0 tx=0).stop 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.216+0000 7f74aade7640 1 -- 172.21.15.172:0/3172510024 shutdown_connections 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.216+0000 7f74aade7640 1 --2- 172.21.15.172:0/3172510024 >> v2:172.21.15.186:3300/0 conn(0x7f74a415deb0 0x7f74a415e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.216+0000 7f74aade7640 1 --2- 172.21.15.172:0/3172510024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 0x7f74a406ccd0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.216+0000 7f74aade7640 1 -- 172.21.15.172:0/3172510024 >> 172.21.15.172:0/3172510024 conn(0x7f74a40b3530 msgr2=0x7f74a40b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.216+0000 7f74aade7640 1 -- 172.21.15.172:0/3172510024 shutdown_connections 2024-04-25T08:46:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.216+0000 7f74aade7640 1 -- 172.21.15.172:0/3172510024 wait complete. 2024-04-25T08:46:06.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.217+0000 7f74aade7640 1 Processor -- start 2024-04-25T08:46:06.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.217+0000 7f74aade7640 1 -- start start 2024-04-25T08:46:06.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74aade7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 0x7f74a4160d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74aade7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74a40711a0 0x7f74a40cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74aade7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74a415deb0 0x7f74a40d0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74aade7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4161c60 con 0x7f74a4070dc0 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74aade7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40b10f0 con 0x7f74a415deb0 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74aade7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4161f40 con 0x7f74a40711a0 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74a8b83640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 0x7f74a4160d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74a8b83640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 0x7f74a4160d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51256/0 (socket says 172.21.15.172:51256) 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74a8b83640 1 -- 172.21.15.172:0/3403067163 learned_addr learned my addr 172.21.15.172:0/3403067163 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74a8b83640 1 -- 172.21.15.172:0/3403067163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74a40711a0 msgr2=0x7f74a40cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74a8b83640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74a40711a0 0x7f74a40cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74a8b83640 1 -- 172.21.15.172:0/3403067163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74a415deb0 msgr2=0x7f74a40d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74a8b83640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74a415deb0 0x7f74a40d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74a8b83640 1 -- 172.21.15.172:0/3403067163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a415e4a0 con 0x7f74a4070dc0 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74a8b83640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 0x7f74a4160d60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000c00 tx=0x7f74a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74997fa640 1 -- 172.21.15.172:0/3403067163 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0041020 con 0x7f74a4070dc0 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74997fa640 1 -- 172.21.15.172:0/3403067163 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0030740 con 0x7f74a4070dc0 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74aade7640 1 -- 172.21.15.172:0/3403067163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a415e780 con 0x7f74a4070dc0 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74997fa640 1 -- 172.21.15.172:0/3403067163 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0037040 con 0x7f74a4070dc0 2024-04-25T08:46:06.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.218+0000 7f74aade7640 1 -- 172.21.15.172:0/3403067163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40cca30 con 0x7f74a4070dc0 2024-04-25T08:46:06.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.219+0000 7f74aade7640 1 -- 172.21.15.172:0/3403067163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a4073a00 con 0x7f74a4070dc0 2024-04-25T08:46:06.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.220+0000 7f74997fa640 1 -- 172.21.15.172:0/3403067163 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f74a0044020 con 0x7f74a4070dc0 2024-04-25T08:46:06.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.220+0000 7f74997fa640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f749006b4d0 0x7f749006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.220+0000 7f74997fa640 1 -- 172.21.15.172:0/3403067163 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f74a00aa910 con 0x7f74a4070dc0 2024-04-25T08:46:06.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.220+0000 7f749bfff640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f749006b4d0 0x7f749006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.221+0000 7f749bfff640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f749006b4d0 0x7f749006d990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7494000f60 tx=0x7f7494007a00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:06.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.224+0000 7f74997fa640 1 -- 172.21.15.172:0/3403067163 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74a004b030 con 0x7f74a4070dc0 2024-04-25T08:46:06.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.398+0000 7f74aade7640 1 -- 172.21.15.172:0/3403067163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74a40b6870 con 0x7f74a4070dc0 2024-04-25T08:46:06.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.398+0000 7f74997fa640 1 -- 172.21.15.172:0/3403067163 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74a0079950 con 0x7f74a4070dc0 2024-04-25T08:46:06.390 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 -- 172.21.15.172:0/3403067163 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f749006b4d0 msgr2=0x7f749006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f749006b4d0 0x7f749006d990 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7494000f60 tx=0x7f7494007a00 comp rx=0 tx=0).stop 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 -- 172.21.15.172:0/3403067163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 msgr2=0x7f74a4160d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 0x7f74a4160d60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f74a0000c00 tx=0x7f74a00046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 -- 172.21.15.172:0/3403067163 shutdown_connections 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f749006b4d0 0x7f749006d990 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74a415deb0 0x7f74a40d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74a40711a0 0x7f74a40cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 --2- 172.21.15.172:0/3403067163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74a4070dc0 0x7f74a4160d60 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 -- 172.21.15.172:0/3403067163 >> 172.21.15.172:0/3403067163 conn(0x7f74a40b3530 msgr2=0x7f74a40b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 -- 172.21.15.172:0/3403067163 shutdown_connections 2024-04-25T08:46:06.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.400+0000 7f74aade7640 1 -- 172.21.15.172:0/3403067163 wait complete. 2024-04-25T08:46:06.403 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:46:06.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.508+0000 7f46036f7640 1 Processor -- start 2024-04-25T08:46:06.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.508+0000 7f46036f7640 1 -- start start 2024-04-25T08:46:06.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f46036f7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 0x7f45fc1616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f46036f7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f45fc0cedf0 0x7f45fc0d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f46036f7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc15e000 con 0x7f45fc0b93a0 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f46036f7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc0b6bb0 con 0x7f45fc0cedf0 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f46036f7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0b6030 con 0x7f45fc15dc20 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f4601c94640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f45fc0cedf0 0x7f45fc0d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f4601c94640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f45fc0cedf0 0x7f45fc0d2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51262/0 (socket says 172.21.15.172:51262) 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f4601c94640 1 -- 172.21.15.172:0/810847700 learned_addr learned my addr 172.21.15.172:0/810847700 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f4601493640 1 --2- 172.21.15.172:0/810847700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 0x7f45fc1616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f4601c94640 1 -- 172.21.15.172:0/810847700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 msgr2=0x7f45fc1616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f4601c94640 1 --2- 172.21.15.172:0/810847700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 0x7f45fc1616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f4601c94640 1 -- 172.21.15.172:0/810847700 >> v1:172.21.15.186:6789/0 conn(0x7f45fc0b93a0 legacy=0x7f45fc0ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.509+0000 7f4601c94640 1 -- 172.21.15.172:0/810847700 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc161de0 con 0x7f45fc0cedf0 2024-04-25T08:46:06.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.510+0000 7f4601c94640 1 --2- 172.21.15.172:0/810847700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0cedf0 0x7f45fc0d2510 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009e80 tx=0x7f45f402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bf68b0c5eb28c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.510+0000 7f45f3fff640 1 -- 172.21.15.172:0/810847700 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4036070 con 0x7f45fc0cedf0 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.510+0000 7f45f3fff640 1 -- 172.21.15.172:0/810847700 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f4031600 con 0x7f45fc0cedf0 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.510+0000 7f45f3fff640 1 -- 172.21.15.172:0/810847700 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f40319d0 con 0x7f45fc0cedf0 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.511+0000 7f46036f7640 1 -- 172.21.15.172:0/810847700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0cedf0 msgr2=0x7f45fc0d2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.511+0000 7f46036f7640 1 --2- 172.21.15.172:0/810847700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0cedf0 0x7f45fc0d2510 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009e80 tx=0x7f45f402a750 comp rx=0 tx=0).stop 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.511+0000 7f46036f7640 1 -- 172.21.15.172:0/810847700 shutdown_connections 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.511+0000 7f46036f7640 1 --2- 172.21.15.172:0/810847700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0cedf0 0x7f45fc0d2510 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.511+0000 7f46036f7640 1 --2- 172.21.15.172:0/810847700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 0x7f45fc1616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.511+0000 7f46036f7640 1 -- 172.21.15.172:0/810847700 >> 172.21.15.172:0/810847700 conn(0x7f45fc0d0490 msgr2=0x7f45fc0d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.511+0000 7f46036f7640 1 -- 172.21.15.172:0/810847700 shutdown_connections 2024-04-25T08:46:06.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.511+0000 7f46036f7640 1 -- 172.21.15.172:0/810847700 wait complete. 2024-04-25T08:46:06.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.512+0000 7f46036f7640 1 Processor -- start 2024-04-25T08:46:06.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.512+0000 7f46036f7640 1 -- start start 2024-04-25T08:46:06.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f46036f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0b93a0 0x7f45fc1498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f46036f7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45fc0cedf0 0x7f45fc148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f46036f7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 0x7f45fc1603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f46036f7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0d2a50 con 0x7f45fc0b93a0 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f46036f7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc1623a0 con 0x7f45fc0cedf0 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f46036f7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0d2bd0 con 0x7f45fc15dc20 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601493640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0b93a0 0x7f45fc1498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601493640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0b93a0 0x7f45fc1498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51274/0 (socket says 172.21.15.172:51274) 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601493640 1 -- 172.21.15.172:0/2214328663 learned_addr learned my addr 172.21.15.172:0/2214328663 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4600c92640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45fc0cedf0 0x7f45fc148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601c94640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 0x7f45fc1603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601493640 1 -- 172.21.15.172:0/2214328663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 msgr2=0x7f45fc1603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601493640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 0x7f45fc1603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601493640 1 -- 172.21.15.172:0/2214328663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45fc0cedf0 msgr2=0x7f45fc148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601493640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45fc0cedf0 0x7f45fc148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601493640 1 -- 172.21.15.172:0/2214328663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc0cb710 con 0x7f45fc0b93a0 2024-04-25T08:46:06.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4600c92640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45fc0cedf0 0x7f45fc148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:06.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601c94640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 0x7f45fc1603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:06.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f4601493640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0b93a0 0x7f45fc1498e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f45f800d5f0 tx=0x7f45f800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:06.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f45f1ffb640 1 -- 172.21.15.172:0/2214328663 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80125f0 con 0x7f45fc0b93a0 2024-04-25T08:46:06.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f45f1ffb640 1 -- 172.21.15.172:0/2214328663 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f8019070 con 0x7f45fc0b93a0 2024-04-25T08:46:06.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f46036f7640 1 -- 172.21.15.172:0/2214328663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc0cb9f0 con 0x7f45fc0b93a0 2024-04-25T08:46:06.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.513+0000 7f45f1ffb640 1 -- 172.21.15.172:0/2214328663 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80129d0 con 0x7f45fc0b93a0 2024-04-25T08:46:06.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.514+0000 7f46036f7640 1 -- 172.21.15.172:0/2214328663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc0cc9a0 con 0x7f45fc0b93a0 2024-04-25T08:46:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.514+0000 7f46036f7640 1 -- 172.21.15.172:0/2214328663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc0cbd30 con 0x7f45fc0b93a0 2024-04-25T08:46:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.515+0000 7f45f1ffb640 1 -- 172.21.15.172:0/2214328663 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f45f8012b70 con 0x7f45fc0b93a0 2024-04-25T08:46:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.515+0000 7f45f1ffb640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45e006b500 0x7f45e006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.515+0000 7f45f1ffb640 1 -- 172.21.15.172:0/2214328663 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f45f808a410 con 0x7f45fc0b93a0 2024-04-25T08:46:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.515+0000 7f4600c92640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45e006b500 0x7f45e006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.516+0000 7f4600c92640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45e006b500 0x7f45e006d9c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f45fc160fa0 tx=0x7f45ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:06.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.520+0000 7f45f1ffb640 1 -- 172.21.15.172:0/2214328663 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f45f8059450 con 0x7f45fc0b93a0 2024-04-25T08:46:06.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.692+0000 7f46036f7640 1 -- 172.21.15.172:0/2214328663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f45fc073990 con 0x7f45fc0b93a0 2024-04-25T08:46:06.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.692+0000 7f45f1ffb640 1 -- 172.21.15.172:0/2214328663 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+65 (secure 0 0 0) 0x7f45f8058d50 con 0x7f45fc0b93a0 2024-04-25T08:46:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:06.684 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:46:06.684 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2024-04-25T08:46:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2024-04-25T08:46:06.685 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:06.685 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:46:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 -- 172.21.15.172:0/2214328663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45e006b500 msgr2=0x7f45e006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45e006b500 0x7f45e006d9c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f45fc160fa0 tx=0x7f45ec009040 comp rx=0 tx=0).stop 2024-04-25T08:46:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 -- 172.21.15.172:0/2214328663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0b93a0 msgr2=0x7f45fc1498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0b93a0 0x7f45fc1498e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f45f800d5f0 tx=0x7f45f800dab0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 -- 172.21.15.172:0/2214328663 shutdown_connections 2024-04-25T08:46:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45e006b500 0x7f45e006d9c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45fc0cedf0 0x7f45fc148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45fc15dc20 0x7f45fc1603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 --2- 172.21.15.172:0/2214328663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45fc0b93a0 0x7f45fc1498e0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 -- 172.21.15.172:0/2214328663 >> 172.21.15.172:0/2214328663 conn(0x7f45fc0d0490 msgr2=0x7f45fc0ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:06.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 -- 172.21.15.172:0/2214328663 shutdown_connections 2024-04-25T08:46:06.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.694+0000 7f46036f7640 1 -- 172.21.15.172:0/2214328663 wait complete. 2024-04-25T08:46:06.697 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:46:06.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:46:06.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.807+0000 7fea6f01f640 1 Processor -- start 2024-04-25T08:46:06.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.807+0000 7fea6f01f640 1 -- start start 2024-04-25T08:46:06.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.807+0000 7fea6f01f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea6815dc20 0x7fea680ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.807+0000 7fea6f01f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fea68161710 0x7fea680cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.807+0000 7fea6f01f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fea680b9330 0x7fea6806bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.807+0000 7fea6f01f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6815e000 con 0x7fea680b9330 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.807+0000 7fea6f01f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea680d1de0 con 0x7fea68161710 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.807+0000 7fea6f01f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea68161c60 con 0x7fea6815dc20 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.808+0000 7fea6d5bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fea680b9330 0x7fea6806bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.808+0000 7fea6d5bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fea680b9330 0x7fea6806bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51288/0 (socket says 172.21.15.172:51288) 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.808+0000 7fea6d5bc640 1 -- 172.21.15.172:0/2128440183 learned_addr learned my addr 172.21.15.172:0/2128440183 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.808+0000 7fea6cdbb640 1 --2- 172.21.15.172:0/2128440183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea6815dc20 0x7fea680ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.808+0000 7fea67fff640 1 --2- 172.21.15.172:0/2128440183 >> v2:172.21.15.186:3300/0 conn(0x7fea68161710 0x7fea680cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.808+0000 7fea6d5bc640 1 -- 172.21.15.172:0/2128440183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea6815dc20 msgr2=0x7fea680ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.808+0000 7fea6d5bc640 1 --2- 172.21.15.172:0/2128440183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea6815dc20 0x7fea680ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.808+0000 7fea6d5bc640 1 -- 172.21.15.172:0/2128440183 >> v2:172.21.15.186:3300/0 conn(0x7fea68161710 msgr2=0x7fea680cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.808+0000 7fea6d5bc640 1 --2- 172.21.15.172:0/2128440183 >> v2:172.21.15.186:3300/0 conn(0x7fea68161710 0x7fea680cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.808+0000 7fea6d5bc640 1 -- 172.21.15.172:0/2128440183 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea68161f40 con 0x7fea680b9330 2024-04-25T08:46:06.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea6d5bc640 1 --2- 172.21.15.172:0/2128440183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea680b9330 0x7fea6806bf80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fea6806d9a0 tx=0x7fea6002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b9e7c317566c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:06.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea677fe640 1 -- 172.21.15.172:0/2128440183 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60036070 con 0x7fea680b9330 2024-04-25T08:46:06.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea677fe640 1 -- 172.21.15.172:0/2128440183 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea60031600 con 0x7fea680b9330 2024-04-25T08:46:06.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea677fe640 1 -- 172.21.15.172:0/2128440183 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600319d0 con 0x7fea680b9330 2024-04-25T08:46:06.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea6f01f640 1 -- 172.21.15.172:0/2128440183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea680b9330 msgr2=0x7fea6806bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea6f01f640 1 --2- 172.21.15.172:0/2128440183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea680b9330 0x7fea6806bf80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fea6806d9a0 tx=0x7fea6002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea6f01f640 1 -- 172.21.15.172:0/2128440183 shutdown_connections 2024-04-25T08:46:06.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea6f01f640 1 --2- 172.21.15.172:0/2128440183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea680b9330 0x7fea6806bf80 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea6f01f640 1 --2- 172.21.15.172:0/2128440183 >> v2:172.21.15.186:3300/0 conn(0x7fea68161710 0x7fea680cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea6f01f640 1 --2- 172.21.15.172:0/2128440183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea6815dc20 0x7fea680ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea6f01f640 1 -- 172.21.15.172:0/2128440183 >> 172.21.15.172:0/2128440183 conn(0x7fea680d0420 msgr2=0x7fea680d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:06.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea6f01f640 1 -- 172.21.15.172:0/2128440183 shutdown_connections 2024-04-25T08:46:06.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.809+0000 7fea6f01f640 1 -- 172.21.15.172:0/2128440183 wait complete. 2024-04-25T08:46:06.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.810+0000 7fea6f01f640 1 Processor -- start 2024-04-25T08:46:06.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.811+0000 7fea6f01f640 1 -- start start 2024-04-25T08:46:06.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.811+0000 7fea6f01f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea680b9330 0x7fea681f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.811+0000 7fea6f01f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea6815dc20 0x7fea681f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.811+0000 7fea6f01f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea68161710 0x7fea6815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.811+0000 7fea6f01f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea680b5e50 con 0x7fea68161710 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.811+0000 7fea6f01f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68162500 con 0x7fea680b9330 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.811+0000 7fea6f01f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea680b5fd0 con 0x7fea6815dc20 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6d5bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea68161710 0x7fea6815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6d5bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea68161710 0x7fea6815cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51304/0 (socket says 172.21.15.172:51304) 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6d5bc640 1 -- 172.21.15.172:0/4111337377 learned_addr learned my addr 172.21.15.172:0/4111337377 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6cdbb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea680b9330 0x7fea681f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea67fff640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea6815dc20 0x7fea681f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6d5bc640 1 -- 172.21.15.172:0/4111337377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea6815dc20 msgr2=0x7fea681f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6d5bc640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea6815dc20 0x7fea681f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6d5bc640 1 -- 172.21.15.172:0/4111337377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea680b9330 msgr2=0x7fea681f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:06.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6d5bc640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea680b9330 0x7fea681f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6d5bc640 1 -- 172.21.15.172:0/4111337377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680aa380 con 0x7fea68161710 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6d5bc640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea68161710 0x7fea6815cc10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fea60009f40 tx=0x7fea60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea657fa640 1 -- 172.21.15.172:0/4111337377 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60041020 con 0x7fea68161710 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea657fa640 1 -- 172.21.15.172:0/4111337377 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea600077a0 con 0x7fea68161710 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6f01f640 1 -- 172.21.15.172:0/4111337377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea681f3ec0 con 0x7fea68161710 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea657fa640 1 -- 172.21.15.172:0/4111337377 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60036040 con 0x7fea68161710 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.812+0000 7fea6f01f640 1 -- 172.21.15.172:0/4111337377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea680aa620 con 0x7fea68161710 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.813+0000 7fea6f01f640 1 -- 172.21.15.172:0/4111337377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea68073a00 con 0x7fea68161710 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.814+0000 7fea657fa640 1 -- 172.21.15.172:0/4111337377 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fea60044020 con 0x7fea68161710 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.814+0000 7fea657fa640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fea5406b4d0 0x7fea5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.814+0000 7fea6cdbb640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fea5406b4d0 0x7fea5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:06.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.814+0000 7fea657fa640 1 -- 172.21.15.172:0/4111337377 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fea600aaac0 con 0x7fea68161710 2024-04-25T08:46:06.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.815+0000 7fea6cdbb640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fea5406b4d0 0x7fea5406d990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fea58003610 tx=0x7fea58008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:06.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.819+0000 7fea657fa640 1 -- 172.21.15.172:0/4111337377 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fea6004b030 con 0x7fea68161710 2024-04-25T08:46:06.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:06.990+0000 7fea6f01f640 1 -- 172.21.15.172:0/4111337377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fea680d16b0 con 0x7fea68161710 2024-04-25T08:46:07.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.439+0000 7fea657fa640 1 -- 172.21.15.172:0/4111337377 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7fea60079600 con 0x7fea68161710 2024-04-25T08:46:07.431 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2024-04-25T08:46:07.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 -- 172.21.15.172:0/4111337377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fea5406b4d0 msgr2=0x7fea5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:07.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fea5406b4d0 0x7fea5406d990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fea58003610 tx=0x7fea58008040 comp rx=0 tx=0).stop 2024-04-25T08:46:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 -- 172.21.15.172:0/4111337377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea68161710 msgr2=0x7fea6815cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea68161710 0x7fea6815cc10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fea60009f40 tx=0x7fea60004a40 comp rx=0 tx=0).stop 2024-04-25T08:46:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 -- 172.21.15.172:0/4111337377 shutdown_connections 2024-04-25T08:46:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fea5406b4d0 0x7fea5406d990 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea68161710 0x7fea6815cc10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea6815dc20 0x7fea681f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 --2- 172.21.15.172:0/4111337377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea680b9330 0x7fea681f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 -- 172.21.15.172:0/4111337377 >> 172.21.15.172:0/4111337377 conn(0x7fea680d0420 msgr2=0x7fea680d3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 -- 172.21.15.172:0/4111337377 shutdown_connections 2024-04-25T08:46:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.442+0000 7fea6f01f640 1 -- 172.21.15.172:0/4111337377 wait complete. 2024-04-25T08:46:07.448 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:46:07.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.561+0000 7fa865563640 1 Processor -- start 2024-04-25T08:46:07.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.561+0000 7fa865563640 1 -- start start 2024-04-25T08:46:07.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.562+0000 7fa865563640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa8601616f0 0x7fa860161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.562+0000 7fa865563640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8600ce0a0 0x7fa8600ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.562+0000 7fa865563640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86006c8d0 con 0x7fa8601610f0 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.562+0000 7fa865563640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600cea50 con 0x7fa8600ce0a0 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.562+0000 7fa865563640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8601614d0 con 0x7fa8601616f0 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.562+0000 7fa85f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8600ce0a0 0x7fa8600ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.562+0000 7fa85effd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa8601610f0 0x7fa86006c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39638/0 (socket says 172.21.15.172:39638) 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.562+0000 7fa85effd640 1 -- 172.21.15.172:0/4252271298 learned_addr learned my addr 172.21.15.172:0/4252271298 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.563+0000 7fa857fff640 1 --2- 172.21.15.172:0/4252271298 >> v2:172.21.15.186:3300/0 conn(0x7fa8601616f0 0x7fa860161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.563+0000 7fa85f7fe640 1 -- 172.21.15.172:0/4252271298 >> v2:172.21.15.186:3300/0 conn(0x7fa8601616f0 msgr2=0x7fa860161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.563+0000 7fa85f7fe640 1 --2- 172.21.15.172:0/4252271298 >> v2:172.21.15.186:3300/0 conn(0x7fa8601616f0 0x7fa860161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.563+0000 7fa85f7fe640 1 -- 172.21.15.172:0/4252271298 >> v1:172.21.15.172:6789/0 conn(0x7fa8601610f0 legacy=0x7fa86006c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.563+0000 7fa85f7fe640 1 -- 172.21.15.172:0/4252271298 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600c6960 con 0x7fa8600ce0a0 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.563+0000 7fa85e7fc640 1 -- 172.21.15.172:0/4252271298 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543770773 0 0) 0x7fa86006c8d0 con 0x7fa8601610f0 2024-04-25T08:46:07.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.563+0000 7fa85f7fe640 1 --2- 172.21.15.172:0/4252271298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8600ce0a0 0x7fa8600ce510 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fa86006f220 tx=0x7fa85802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f690661f2a0372a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa85e7fc640 1 -- 172.21.15.172:0/4252271298 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858007740 con 0x7fa8600ce0a0 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa85e7fc640 1 -- 172.21.15.172:0/4252271298 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8580078e0 con 0x7fa8600ce0a0 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa85e7fc640 1 -- 172.21.15.172:0/4252271298 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858007cb0 con 0x7fa8600ce0a0 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa865563640 1 -- 172.21.15.172:0/4252271298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8600ce0a0 msgr2=0x7fa8600ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa865563640 1 --2- 172.21.15.172:0/4252271298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8600ce0a0 0x7fa8600ce510 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fa86006f220 tx=0x7fa85802a680 comp rx=0 tx=0).stop 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa865563640 1 -- 172.21.15.172:0/4252271298 shutdown_connections 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa865563640 1 --2- 172.21.15.172:0/4252271298 >> v2:172.21.15.186:3300/0 conn(0x7fa8601616f0 0x7fa860161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa865563640 1 --2- 172.21.15.172:0/4252271298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8600ce0a0 0x7fa8600ce510 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa865563640 1 -- 172.21.15.172:0/4252271298 >> 172.21.15.172:0/4252271298 conn(0x7fa86006f500 msgr2=0x7fa86006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa865563640 1 -- 172.21.15.172:0/4252271298 shutdown_connections 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.564+0000 7fa865563640 1 -- 172.21.15.172:0/4252271298 wait complete. 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.565+0000 7fa865563640 1 Processor -- start 2024-04-25T08:46:07.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.565+0000 7fa865563640 1 -- start start 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa865563640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8600ce0a0 0x7fa86014d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa865563640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8601610f0 0x7fa8600b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa865563640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8601616f0 0x7fa8600b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa865563640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600cfa00 con 0x7fa8601616f0 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa865563640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860162540 con 0x7fa8601610f0 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa865563640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600cfce0 con 0x7fa8600ce0a0 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa85f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8601616f0 0x7fa8600b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa85f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8601616f0 0x7fa8600b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59138/0 (socket says 172.21.15.172:59138) 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa85f7fe640 1 -- 172.21.15.172:0/2402429226 learned_addr learned my addr 172.21.15.172:0/2402429226 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa857fff640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8601610f0 0x7fa8600b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.566+0000 7fa85effd640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8600ce0a0 0x7fa86014d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa85f7fe640 1 -- 172.21.15.172:0/2402429226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8600ce0a0 msgr2=0x7fa86014d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa85f7fe640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8600ce0a0 0x7fa86014d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:07.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa85f7fe640 1 -- 172.21.15.172:0/2402429226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8601610f0 msgr2=0x7fa8600b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa85f7fe640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8601610f0 0x7fa8600b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa85f7fe640 1 -- 172.21.15.172:0/2402429226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600b5290 con 0x7fa8601616f0 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa85effd640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8600ce0a0 0x7fa86014d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa85f7fe640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8601616f0 0x7fa8600b6290 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa858009e50 tx=0x7fa858004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa8577fe640 1 -- 172.21.15.172:0/2402429226 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858040070 con 0x7fa8601616f0 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa8577fe640 1 -- 172.21.15.172:0/2402429226 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858031bf0 con 0x7fa8601616f0 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa865563640 1 -- 172.21.15.172:0/2402429226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8600b5570 con 0x7fa8601616f0 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa8577fe640 1 -- 172.21.15.172:0/2402429226 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858045460 con 0x7fa8601616f0 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.567+0000 7fa865563640 1 -- 172.21.15.172:0/2402429226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa860157da0 con 0x7fa8601616f0 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.568+0000 7fa865563640 1 -- 172.21.15.172:0/2402429226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa860157fa0 con 0x7fa8601616f0 2024-04-25T08:46:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.568+0000 7fa8577fe640 1 -- 172.21.15.172:0/2402429226 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa858039040 con 0x7fa8601616f0 2024-04-25T08:46:07.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.569+0000 7fa8577fe640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84006b4d0 0x7fa84006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:07.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.569+0000 7fa8577fe640 1 -- 172.21.15.172:0/2402429226 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fa8580aba70 con 0x7fa8601616f0 2024-04-25T08:46:07.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.569+0000 7fa85effd640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84006b4d0 0x7fa84006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:07.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.569+0000 7fa85effd640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84006b4d0 0x7fa84006d990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa850000f60 tx=0x7fa850007c10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:07.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.573+0000 7fa8577fe640 1 -- 172.21.15.172:0/2402429226 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa860157fa0 con 0x7fa8601616f0 2024-04-25T08:46:07.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:07.745+0000 7fa865563640 1 -- 172.21.15.172:0/2402429226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa860073a00 con 0x7fa8601616f0 2024-04-25T08:46:08.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.442+0000 7fa8577fe640 1 -- 172.21.15.172:0/2402429226 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa85807a9d0 con 0x7fa8601616f0 2024-04-25T08:46:08.434 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2024-04-25T08:46:08.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 -- 172.21.15.172:0/2402429226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84006b4d0 msgr2=0x7fa84006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:08.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84006b4d0 0x7fa84006d990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa850000f60 tx=0x7fa850007c10 comp rx=0 tx=0).stop 2024-04-25T08:46:08.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 -- 172.21.15.172:0/2402429226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8601616f0 msgr2=0x7fa8600b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:08.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8601616f0 0x7fa8600b6290 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa858009e50 tx=0x7fa858004a40 comp rx=0 tx=0).stop 2024-04-25T08:46:08.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 -- 172.21.15.172:0/2402429226 shutdown_connections 2024-04-25T08:46:08.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84006b4d0 0x7fa84006d990 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:08.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8601610f0 0x7fa8600b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:08.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8601616f0 0x7fa8600b6290 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:08.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 --2- 172.21.15.172:0/2402429226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8600ce0a0 0x7fa86014d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:08.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 -- 172.21.15.172:0/2402429226 >> 172.21.15.172:0/2402429226 conn(0x7fa86006f500 msgr2=0x7fa86015db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:08.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 -- 172.21.15.172:0/2402429226 shutdown_connections 2024-04-25T08:46:08.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.444+0000 7fa865563640 1 -- 172.21.15.172:0/2402429226 wait complete. 2024-04-25T08:46:08.457 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:46:08.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.568+0000 7fc5f8334640 1 Processor -- start 2024-04-25T08:46:08.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.568+0000 7fc5f8334640 1 -- start start 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f8334640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc5f015dd80 0x7fc5f00b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f8334640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc5f00ad570 0x7fc5f006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f8334640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f00b3930 con 0x7fc5f006abe0 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f8334640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f006e410 con 0x7fc5f015dd80 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f8334640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f00b3c10 con 0x7fc5f00ad570 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f58cf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc5f015dd80 0x7fc5f00b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f58cf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc5f015dd80 0x7fc5f00b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59154/0 (socket says 172.21.15.172:59154) 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f58cf640 1 -- 172.21.15.172:0/788146057 learned_addr learned my addr 172.21.15.172:0/788146057 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f58cf640 1 -- 172.21.15.172:0/788146057 >> v2:172.21.15.186:3300/0 conn(0x7fc5f00ad570 msgr2=0x7fc5f006ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f58cf640 1 --2- 172.21.15.172:0/788146057 >> v2:172.21.15.186:3300/0 conn(0x7fc5f00ad570 0x7fc5f006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:08.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f58cf640 1 -- 172.21.15.172:0/788146057 >> v1:172.21.15.186:6789/0 conn(0x7fc5f006abe0 legacy=0x7fc5f006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:08.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.569+0000 7fc5f58cf640 1 -- 172.21.15.172:0/788146057 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f006e660 con 0x7fc5f015dd80 2024-04-25T08:46:08.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.570+0000 7fc5f58cf640 1 --2- 172.21.15.172:0/788146057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f015dd80 0x7fc5f00b5290 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0072fe0 tx=0x7fc5e002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433c8461673d329a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:08.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.570+0000 7fc5f50ce640 1 -- 172.21.15.172:0/788146057 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0037070 con 0x7fc5f015dd80 2024-04-25T08:46:08.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.570+0000 7fc5f50ce640 1 -- 172.21.15.172:0/788146057 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e0032440 con 0x7fc5f015dd80 2024-04-25T08:46:08.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.570+0000 7fc5f50ce640 1 -- 172.21.15.172:0/788146057 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0032810 con 0x7fc5f015dd80 2024-04-25T08:46:08.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.571+0000 7fc5f8334640 1 -- 172.21.15.172:0/788146057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f015dd80 msgr2=0x7fc5f00b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:08.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.571+0000 7fc5f8334640 1 --2- 172.21.15.172:0/788146057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f015dd80 0x7fc5f00b5290 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0072fe0 tx=0x7fc5e002a230 comp rx=0 tx=0).stop 2024-04-25T08:46:08.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.571+0000 7fc5f8334640 1 -- 172.21.15.172:0/788146057 shutdown_connections 2024-04-25T08:46:08.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.571+0000 7fc5f8334640 1 --2- 172.21.15.172:0/788146057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f015dd80 0x7fc5f00b5290 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:08.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.571+0000 7fc5f8334640 1 --2- 172.21.15.172:0/788146057 >> v2:172.21.15.186:3300/0 conn(0x7fc5f00ad570 0x7fc5f006ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:08.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.571+0000 7fc5f8334640 1 -- 172.21.15.172:0/788146057 >> 172.21.15.172:0/788146057 conn(0x7fc5f00b5af0 msgr2=0x7fc5f00b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:08.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.571+0000 7fc5f8334640 1 -- 172.21.15.172:0/788146057 shutdown_connections 2024-04-25T08:46:08.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.571+0000 7fc5f8334640 1 -- 172.21.15.172:0/788146057 wait complete. 2024-04-25T08:46:08.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.572+0000 7fc5f8334640 1 Processor -- start 2024-04-25T08:46:08.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.572+0000 7fc5f8334640 1 -- start start 2024-04-25T08:46:08.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.572+0000 7fc5f8334640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f006abe0 0x7fc5f01568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.572+0000 7fc5f8334640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5f00ad570 0x7fc5f01607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.572+0000 7fc5f8334640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5f015dd80 0x7fc5f013d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.572+0000 7fc5f8334640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f0070280 con 0x7fc5f006abe0 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.572+0000 7fc5f8334640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00b57d0 con 0x7fc5f00ad570 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.572+0000 7fc5f8334640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f0070400 con 0x7fc5f015dd80 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f60d0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f006abe0 0x7fc5f01568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f60d0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f006abe0 0x7fc5f01568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59158/0 (socket says 172.21.15.172:59158) 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f60d0640 1 -- 172.21.15.172:0/3871049936 learned_addr learned my addr 172.21.15.172:0/3871049936 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f58cf640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5f00ad570 0x7fc5f01607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f68d1640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5f015dd80 0x7fc5f013d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f60d0640 1 -- 172.21.15.172:0/3871049936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5f015dd80 msgr2=0x7fc5f013d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f60d0640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5f015dd80 0x7fc5f013d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f60d0640 1 -- 172.21.15.172:0/3871049936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5f00ad570 msgr2=0x7fc5f01607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f60d0640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5f00ad570 0x7fc5f01607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:08.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f60d0640 1 -- 172.21.15.172:0/3871049936 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f015f1d0 con 0x7fc5f006abe0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f60d0640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f006abe0 0x7fc5f01568e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00c410 tx=0x7fc5ec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5e6ffd640 1 -- 172.21.15.172:0/3871049936 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec017070 con 0x7fc5f006abe0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5e6ffd640 1 -- 172.21.15.172:0/3871049936 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec0035f0 con 0x7fc5f006abe0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f8334640 1 -- 172.21.15.172:0/3871049936 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f015f4b0 con 0x7fc5f006abe0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5e6ffd640 1 -- 172.21.15.172:0/3871049936 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec003a20 con 0x7fc5f006abe0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.573+0000 7fc5f8334640 1 -- 172.21.15.172:0/3871049936 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f015fa70 con 0x7fc5f006abe0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.574+0000 7fc5f8334640 1 -- 172.21.15.172:0/3871049936 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f0073a00 con 0x7fc5f006abe0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.575+0000 7fc5e6ffd640 1 -- 172.21.15.172:0/3871049936 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc5ec01a070 con 0x7fc5f006abe0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.575+0000 7fc5e6ffd640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5d406b4d0 0x7fc5d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.575+0000 7fc5e6ffd640 1 -- 172.21.15.172:0/3871049936 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fc5ec089820 con 0x7fc5f006abe0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.575+0000 7fc5f58cf640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5d406b4d0 0x7fc5d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:08.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.575+0000 7fc5f58cf640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5d406b4d0 0x7fc5d406d990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0034000 tx=0x7fc5e002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:08.571 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.579+0000 7fc5e6ffd640 1 -- 172.21.15.172:0/3871049936 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5ec0010c0 con 0x7fc5f006abe0 2024-04-25T08:46:08.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:08.787+0000 7fc5f8334640 1 -- 172.21.15.172:0/3871049936 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc5f006b3d0 con 0x7fc5f006abe0 2024-04-25T08:46:09.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.463+0000 7fc5e6ffd640 1 -- 172.21.15.172:0/3871049936 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v32) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc5ec057e90 con 0x7fc5f006abe0 2024-04-25T08:46:09.456 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 9 and data pool 10 2024-04-25T08:46:09.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.468+0000 7fc5f8334640 1 -- 172.21.15.172:0/3871049936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5d406b4d0 msgr2=0x7fc5d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.468+0000 7fc5f8334640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5d406b4d0 0x7fc5d406d990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0034000 tx=0x7fc5e002e000 comp rx=0 tx=0).stop 2024-04-25T08:46:09.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.468+0000 7fc5f8334640 1 -- 172.21.15.172:0/3871049936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f006abe0 msgr2=0x7fc5f01568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.468+0000 7fc5f8334640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f006abe0 0x7fc5f01568e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00c410 tx=0x7fc5ec00c8d0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.469+0000 7fc5f8334640 1 -- 172.21.15.172:0/3871049936 shutdown_connections 2024-04-25T08:46:09.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.469+0000 7fc5f8334640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5d406b4d0 0x7fc5d406d990 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.469+0000 7fc5f8334640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5f00ad570 0x7fc5f01607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.469+0000 7fc5f8334640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5f015dd80 0x7fc5f013d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.469+0000 7fc5f8334640 1 --2- 172.21.15.172:0/3871049936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f006abe0 0x7fc5f01568e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.469+0000 7fc5f8334640 1 -- 172.21.15.172:0/3871049936 >> 172.21.15.172:0/3871049936 conn(0x7fc5f00b5af0 msgr2=0x7fc5f00b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:09.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.469+0000 7fc5f8334640 1 -- 172.21.15.172:0/3871049936 shutdown_connections 2024-04-25T08:46:09.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.469+0000 7fc5f8334640 1 -- 172.21.15.172:0/3871049936 wait complete. 2024-04-25T08:46:09.480 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:09.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.590+0000 7f606b1e7640 1 Processor -- start 2024-04-25T08:46:09.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.590+0000 7f606b1e7640 1 -- start start 2024-04-25T08:46:09.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f606b1e7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f606406abe0 0x7f606406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f606b1e7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60641626e0 con 0x7f606415d370 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f606b1e7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606406b500 con 0x7f60640ce330 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f606b1e7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6064070270 con 0x7f606406abe0 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f6068f83640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f606406abe0 0x7f606406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f6068f83640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f606406abe0 0x7f606406afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59166/0 (socket says 172.21.15.172:59166) 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f6068f83640 1 -- 172.21.15.172:0/835936497 learned_addr learned my addr 172.21.15.172:0/835936497 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f6069784640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f606415d370 0x7f606415d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39644/0 (socket says 172.21.15.172:39644) 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f6068f83640 1 -- 172.21.15.172:0/835936497 >> v1:172.21.15.186:6789/0 conn(0x7f60640ce330 legacy=0x7f606406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f6068f83640 1 -- 172.21.15.172:0/835936497 >> v1:172.21.15.172:6789/0 conn(0x7f606415d370 legacy=0x7f606415d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f6068f83640 1 -- 172.21.15.172:0/835936497 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60640cd270 con 0x7f606406abe0 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.591+0000 7f60637fe640 1 -- 172.21.15.172:0/835936497 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617578314 0 0) 0x7f60641626e0 con 0x7f606415d370 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.592+0000 7f6068f83640 1 --2- 172.21.15.172:0/835936497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606406abe0 0x7f606406afc0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f6058009870 tx=0x7f605802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a68ebddf31342d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.592+0000 7f60637fe640 1 -- 172.21.15.172:0/835936497 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058037070 con 0x7f606406abe0 2024-04-25T08:46:09.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.592+0000 7f60637fe640 1 -- 172.21.15.172:0/835936497 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058032440 con 0x7f606406abe0 2024-04-25T08:46:09.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.592+0000 7f60637fe640 1 -- 172.21.15.172:0/835936497 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058032810 con 0x7f606406abe0 2024-04-25T08:46:09.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.592+0000 7f606b1e7640 1 -- 172.21.15.172:0/835936497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606406abe0 msgr2=0x7f606406afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.592+0000 7f606b1e7640 1 --2- 172.21.15.172:0/835936497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606406abe0 0x7f606406afc0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f6058009870 tx=0x7f605802a270 comp rx=0 tx=0).stop 2024-04-25T08:46:09.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.593+0000 7f606b1e7640 1 -- 172.21.15.172:0/835936497 shutdown_connections 2024-04-25T08:46:09.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.593+0000 7f606b1e7640 1 --2- 172.21.15.172:0/835936497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606406abe0 0x7f606406afc0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.593+0000 7f606b1e7640 1 -- 172.21.15.172:0/835936497 >> 172.21.15.172:0/835936497 conn(0x7f60640b2220 msgr2=0x7f60640b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:09.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.593+0000 7f606b1e7640 1 -- 172.21.15.172:0/835936497 shutdown_connections 2024-04-25T08:46:09.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.593+0000 7f606b1e7640 1 -- 172.21.15.172:0/835936497 wait complete. 2024-04-25T08:46:09.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.594+0000 7f606b1e7640 1 Processor -- start 2024-04-25T08:46:09.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.594+0000 7f606b1e7640 1 -- start start 2024-04-25T08:46:09.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f606b1e7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f606406abe0 0x7f606406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f606b1e7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60640ce330 0x7f60640cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f606b1e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606415d370 0x7f6064155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f606b1e7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60640cdb10 con 0x7f606415d370 2024-04-25T08:46:09.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f606b1e7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60640cd830 con 0x7f60640ce330 2024-04-25T08:46:09.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f606b1e7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6064161780 con 0x7f606406abe0 2024-04-25T08:46:09.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6069784640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606415d370 0x7f6064155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:09.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6069784640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606415d370 0x7f6064155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59168/0 (socket says 172.21.15.172:59168) 2024-04-25T08:46:09.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6069784640 1 -- 172.21.15.172:0/2898726105 learned_addr learned my addr 172.21.15.172:0/2898726105 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:09.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6063fff640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60640ce330 0x7f60640cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:09.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6068f83640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f606406abe0 0x7f606406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:09.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6069784640 1 -- 172.21.15.172:0/2898726105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f606406abe0 msgr2=0x7f606406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6069784640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f606406abe0 0x7f606406e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6069784640 1 -- 172.21.15.172:0/2898726105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60640ce330 msgr2=0x7f60640cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6069784640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60640ce330 0x7f60640cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6069784640 1 -- 172.21.15.172:0/2898726105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606406ecd0 con 0x7f606415d370 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6063fff640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60640ce330 0x7f60640cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f6069784640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606415d370 0x7f6064155d90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f605c00c700 tx=0x7f605c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f60617fa640 1 -- 172.21.15.172:0/2898726105 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c018070 con 0x7f606415d370 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f60617fa640 1 -- 172.21.15.172:0/2898726105 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c00ce10 con 0x7f606415d370 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f606b1e7640 1 -- 172.21.15.172:0/2898726105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606406efb0 con 0x7f606415d370 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f60617fa640 1 -- 172.21.15.172:0/2898726105 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c00a880 con 0x7f606415d370 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.595+0000 7f606b1e7640 1 -- 172.21.15.172:0/2898726105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606406f570 con 0x7f606415d370 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.596+0000 7f606b1e7640 1 -- 172.21.15.172:0/2898726105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60640b6420 con 0x7f606415d370 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.597+0000 7f60617fa640 1 -- 172.21.15.172:0/2898726105 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f605c01b070 con 0x7f606415d370 2024-04-25T08:46:09.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.597+0000 7f60617fa640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f604806b4d0 0x7f604806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.597+0000 7f60617fa640 1 -- 172.21.15.172:0/2898726105 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f605c089920 con 0x7f606415d370 2024-04-25T08:46:09.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.597+0000 7f6068f83640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f604806b4d0 0x7f604806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:09.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.598+0000 7f6068f83640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f604806b4d0 0x7f604806d990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6058034000 tx=0x7f605802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:09.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.602+0000 7f60617fa640 1 -- 172.21.15.172:0/2898726105 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f60640b6420 con 0x7f606415d370 2024-04-25T08:46:09.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.776+0000 7f606b1e7640 1 -- 172.21.15.172:0/2898726105 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60640afe50 con 0x7f606415d370 2024-04-25T08:46:09.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.777+0000 7f60617fa640 1 -- 172.21.15.172:0/2898726105 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f605c058610 con 0x7f606415d370 2024-04-25T08:46:09.769 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:09.769 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":64,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:08.788705+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:07.009926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:07.764108+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:09.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 -- 172.21.15.172:0/2898726105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f604806b4d0 msgr2=0x7f604806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f604806b4d0 0x7f604806d990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6058034000 tx=0x7f605802e000 comp rx=0 tx=0).stop 2024-04-25T08:46:09.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 -- 172.21.15.172:0/2898726105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606415d370 msgr2=0x7f6064155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606415d370 0x7f6064155d90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f605c00c700 tx=0x7f605c00cbc0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 -- 172.21.15.172:0/2898726105 shutdown_connections 2024-04-25T08:46:09.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f604806b4d0 0x7f604806d990 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60640ce330 0x7f60640cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f606415d370 0x7f6064155d90 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 --2- 172.21.15.172:0/2898726105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f606406abe0 0x7f606406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 -- 172.21.15.172:0/2898726105 >> 172.21.15.172:0/2898726105 conn(0x7f60640b2220 msgr2=0x7f60640ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:09.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 -- 172.21.15.172:0/2898726105 shutdown_connections 2024-04-25T08:46:09.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.779+0000 7f606b1e7640 1 -- 172.21.15.172:0/2898726105 wait complete. 2024-04-25T08:46:09.782 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:09.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efea168f640 1 Processor -- start 2024-04-25T08:46:09.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efea168f640 1 -- start start 2024-04-25T08:46:09.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efea168f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe9c15dbe0 0x7efe9c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efea168f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe9c0b2cb0 0x7efe9c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efea168f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c0b97a0 con 0x7efe9c0b92a0 2024-04-25T08:46:09.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efea168f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c15dfc0 con 0x7efe9c15dbe0 2024-04-25T08:46:09.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efea168f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0d1a00 con 0x7efe9c0b2cb0 2024-04-25T08:46:09.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efe9affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe9c15dbe0 0x7efe9c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efe9affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe9c15dbe0 0x7efe9c0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59178/0 (socket says 172.21.15.172:59178) 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efe9affd640 1 -- 172.21.15.172:0/1814427332 learned_addr learned my addr 172.21.15.172:0/1814427332 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efe93fff640 1 --2- 172.21.15.172:0/1814427332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe9c0b2cb0 0x7efe9c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efe9affd640 1 -- 172.21.15.172:0/1814427332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe9c0b2cb0 msgr2=0x7efe9c0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efe9affd640 1 --2- 172.21.15.172:0/1814427332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe9c0b2cb0 0x7efe9c0d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efe9affd640 1 -- 172.21.15.172:0/1814427332 >> v1:172.21.15.172:6789/0 conn(0x7efe9c0b92a0 legacy=0x7efe9c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efe9affd640 1 -- 172.21.15.172:0/1814427332 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c0d1c50 con 0x7efe9c15dbe0 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efe9a7fc640 1 -- 172.21.15.172:0/1814427332 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931380868 0 0) 0x7efe9c0b97a0 con 0x7efe9c0b92a0 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.890+0000 7efe93fff640 1 --2- 172.21.15.172:0/1814427332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe9c0b2cb0 0x7efe9c0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.891+0000 7efe9affd640 1 --2- 172.21.15.172:0/1814427332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c15dbe0 0x7efe9c0d0910 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009870 tx=0x7efe8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137ffbdda0e17c2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.891+0000 7efe9a7fc640 1 -- 172.21.15.172:0/1814427332 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c037070 con 0x7efe9c15dbe0 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.891+0000 7efe9a7fc640 1 -- 172.21.15.172:0/1814427332 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c032440 con 0x7efe9c15dbe0 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.891+0000 7efe9a7fc640 1 -- 172.21.15.172:0/1814427332 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c032810 con 0x7efe9c15dbe0 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.891+0000 7efea168f640 1 -- 172.21.15.172:0/1814427332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c15dbe0 msgr2=0x7efe9c0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.892+0000 7efea168f640 1 --2- 172.21.15.172:0/1814427332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c15dbe0 0x7efe9c0d0910 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009870 tx=0x7efe8c02a270 comp rx=0 tx=0).stop 2024-04-25T08:46:09.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.892+0000 7efea168f640 1 -- 172.21.15.172:0/1814427332 shutdown_connections 2024-04-25T08:46:09.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.892+0000 7efea168f640 1 --2- 172.21.15.172:0/1814427332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe9c0b2cb0 0x7efe9c0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.892+0000 7efea168f640 1 --2- 172.21.15.172:0/1814427332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c15dbe0 0x7efe9c0d0910 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.892+0000 7efea168f640 1 -- 172.21.15.172:0/1814427332 >> 172.21.15.172:0/1814427332 conn(0x7efe9c061a20 msgr2=0x7efe9c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:09.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.892+0000 7efea168f640 1 -- 172.21.15.172:0/1814427332 shutdown_connections 2024-04-25T08:46:09.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.892+0000 7efea168f640 1 -- 172.21.15.172:0/1814427332 wait complete. 2024-04-25T08:46:09.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.893+0000 7efea168f640 1 Processor -- start 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.893+0000 7efea168f640 1 -- start start 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.893+0000 7efea168f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe9c0b2cb0 0x7efe9c152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.893+0000 7efea168f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c0b92a0 0x7efe9c1f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efea168f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe9c15dbe0 0x7efe9c0b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efea168f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0b6ab0 con 0x7efe9c0b92a0 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efea168f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0d2210 con 0x7efe9c0b2cb0 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efea168f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0b6c30 con 0x7efe9c15dbe0 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe93fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c0b92a0 0x7efe9c1f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe93fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c0b92a0 0x7efe9c1f67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59184/0 (socket says 172.21.15.172:59184) 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe93fff640 1 -- 172.21.15.172:0/2709485687 learned_addr learned my addr 172.21.15.172:0/2709485687 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe9affd640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe9c0b2cb0 0x7efe9c152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe93fff640 1 -- 172.21.15.172:0/2709485687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe9c15dbe0 msgr2=0x7efe9c0b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe93fff640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe9c15dbe0 0x7efe9c0b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe93fff640 1 -- 172.21.15.172:0/2709485687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe9c0b2cb0 msgr2=0x7efe9c152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:09.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe93fff640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe9c0b2cb0 0x7efe9c152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe93fff640 1 -- 172.21.15.172:0/2709485687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c152540 con 0x7efe9c0b92a0 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe93fff640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c0b92a0 0x7efe9c1f67b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7efe8400c7f0 tx=0x7efe8400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe937fe640 1 -- 172.21.15.172:0/2709485687 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84015070 con 0x7efe9c0b92a0 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe937fe640 1 -- 172.21.15.172:0/2709485687 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe84007820 con 0x7efe9c0b92a0 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efea168f640 1 -- 172.21.15.172:0/2709485687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9c1f7120 con 0x7efe9c0b92a0 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efe937fe640 1 -- 172.21.15.172:0/2709485687 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84007bd0 con 0x7efe9c0b92a0 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.894+0000 7efea168f640 1 -- 172.21.15.172:0/2709485687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c0cb8c0 con 0x7efe9c0b92a0 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.895+0000 7efea168f640 1 -- 172.21.15.172:0/2709485687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9c073990 con 0x7efe9c0b92a0 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.896+0000 7efe937fe640 1 -- 172.21.15.172:0/2709485687 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe84018070 con 0x7efe9c0b92a0 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.896+0000 7efe937fe640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe7c06b4d0 0x7efe7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.896+0000 7efe937fe640 1 -- 172.21.15.172:0/2709485687 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efe8408a1c0 con 0x7efe9c0b92a0 2024-04-25T08:46:09.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.896+0000 7efe9affd640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe7c06b4d0 0x7efe7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:09.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.897+0000 7efe9affd640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe7c06b4d0 0x7efe7c06d990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efe8c034000 tx=0x7efe8c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:09.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:09.900+0000 7efe937fe640 1 -- 172.21.15.172:0/2709485687 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe9c152540 con 0x7efe9c0b92a0 2024-04-25T08:46:10.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.069+0000 7efea168f640 1 -- 172.21.15.172:0/2709485687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe9c061fa0 con 0x7efe9c0b92a0 2024-04-25T08:46:10.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.070+0000 7efe937fe640 1 -- 172.21.15.172:0/2709485687 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16957 (secure 0 0 0) 0x7efe84058f40 con 0x7efe9c0b92a0 2024-04-25T08:46:10.062 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:10.062 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":64,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:08.788705+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:07.009926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:07.764108+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:10.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.072+0000 7efea168f640 1 -- 172.21.15.172:0/2709485687 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe7c06b4d0 msgr2=0x7efe7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.072+0000 7efea168f640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe7c06b4d0 0x7efe7c06d990 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efe8c034000 tx=0x7efe8c02e000 comp rx=0 tx=0).stop 2024-04-25T08:46:10.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.072+0000 7efea168f640 1 -- 172.21.15.172:0/2709485687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c0b92a0 msgr2=0x7efe9c1f67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.072+0000 7efea168f640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c0b92a0 0x7efe9c1f67b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7efe8400c7f0 tx=0x7efe8400ccb0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.072+0000 7efea168f640 1 -- 172.21.15.172:0/2709485687 shutdown_connections 2024-04-25T08:46:10.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.072+0000 7efea168f640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe7c06b4d0 0x7efe7c06d990 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.072+0000 7efea168f640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe9c15dbe0 0x7efe9c0b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.072+0000 7efea168f640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe9c0b92a0 0x7efe9c1f67b0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.072+0000 7efea168f640 1 --2- 172.21.15.172:0/2709485687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe9c0b2cb0 0x7efe9c152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.072+0000 7efea168f640 1 -- 172.21.15.172:0/2709485687 >> 172.21.15.172:0/2709485687 conn(0x7efe9c061a20 msgr2=0x7efe9c15bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:10.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.073+0000 7efea168f640 1 -- 172.21.15.172:0/2709485687 shutdown_connections 2024-04-25T08:46:10.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.073+0000 7efea168f640 1 -- 172.21.15.172:0/2709485687 wait complete. 2024-04-25T08:46:10.075 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:46:10.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.184+0000 7fbff6a07640 1 Processor -- start 2024-04-25T08:46:10.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.184+0000 7fbff6a07640 1 -- start start 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.184+0000 7fbff6a07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff0158230 0x7fbff00d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.184+0000 7fbff6a07640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbff00d1b80 0x7fbff006c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.184+0000 7fbff6a07640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff00d2020 con 0x7fbff006c870 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.184+0000 7fbff6a07640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff0158610 con 0x7fbff00d1b80 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.184+0000 7fbff6a07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff006bea0 con 0x7fbff0158230 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbfeffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff0158230 0x7fbff00d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbfef7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbff00d1b80 0x7fbff006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbfeffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff0158230 0x7fbff00d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:58400/0 (socket says 172.21.15.172:58400) 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbfef7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbff00d1b80 0x7fbff006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:60416/0 (socket says 172.21.15.172:60416) 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbfeffff640 1 -- 172.21.15.172:0/34972834 learned_addr learned my addr 172.21.15.172:0/34972834 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:10.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbff4fa4640 1 --1- 172.21.15.172:0/34972834 >> v1:172.21.15.186:6789/0 conn(0x7fbff006c870 0x7fbff00b4e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:55442/0 (socket says 172.21.15.172:55442) 2024-04-25T08:46:10.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbfef7fe640 1 -- 172.21.15.172:0/34972834 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff0158230 msgr2=0x7fbff00d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:10.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbfef7fe640 1 --2- 172.21.15.172:0/34972834 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff0158230 0x7fbff00d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbfef7fe640 1 -- 172.21.15.172:0/34972834 >> v1:172.21.15.186:6789/0 conn(0x7fbff006c870 legacy=0x7fbff00b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbfef7fe640 1 -- 172.21.15.172:0/34972834 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00d2300 con 0x7fbff00d1b80 2024-04-25T08:46:10.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.185+0000 7fbfeffff640 1 --2- 172.21.15.172:0/34972834 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff0158230 0x7fbff00d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:10.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.186+0000 7fbfef7fe640 1 --2- 172.21.15.172:0/34972834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff00d1b80 0x7fbff006c330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009790 tx=0x7fbfe402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f85c9ac12df99154 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:10.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.186+0000 7fbfeeffd640 1 -- 172.21.15.172:0/34972834 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4037070 con 0x7fbff00d1b80 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.186+0000 7fbfeeffd640 1 -- 172.21.15.172:0/34972834 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe4032440 con 0x7fbff00d1b80 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.186+0000 7fbfeeffd640 1 -- 172.21.15.172:0/34972834 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4032810 con 0x7fbff00d1b80 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.187+0000 7fbff6a07640 1 -- 172.21.15.172:0/34972834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff00d1b80 msgr2=0x7fbff006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.187+0000 7fbff6a07640 1 --2- 172.21.15.172:0/34972834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff00d1b80 0x7fbff006c330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009790 tx=0x7fbfe402a180 comp rx=0 tx=0).stop 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.187+0000 7fbff6a07640 1 -- 172.21.15.172:0/34972834 shutdown_connections 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.187+0000 7fbff6a07640 1 --2- 172.21.15.172:0/34972834 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff00d1b80 0x7fbff006c330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.187+0000 7fbff6a07640 1 --2- 172.21.15.172:0/34972834 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff0158230 0x7fbff00d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.187+0000 7fbff6a07640 1 -- 172.21.15.172:0/34972834 >> 172.21.15.172:0/34972834 conn(0x7fbff0061600 msgr2=0x7fbff00619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.187+0000 7fbff6a07640 1 -- 172.21.15.172:0/34972834 shutdown_connections 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.187+0000 7fbff6a07640 1 -- 172.21.15.172:0/34972834 wait complete. 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.188+0000 7fbff6a07640 1 Processor -- start 2024-04-25T08:46:10.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.188+0000 7fbff6a07640 1 -- start start 2024-04-25T08:46:10.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbff6a07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff006c870 0x7fbff01494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbff6a07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff00d1b80 0x7fbff01468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbff6a07640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff0158230 0x7fbff0146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbff6a07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff015e320 con 0x7fbff00d1b80 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbff6a07640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00d25e0 con 0x7fbff0158230 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbff6a07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff015e4a0 con 0x7fbff006c870 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfef7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff00d1b80 0x7fbff01468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfef7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff00d1b80 0x7fbff01468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59198/0 (socket says 172.21.15.172:59198) 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfef7fe640 1 -- 172.21.15.172:0/1984637614 learned_addr learned my addr 172.21.15.172:0/1984637614 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbff4fa4640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff0158230 0x7fbff0146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfeffff640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff006c870 0x7fbff01494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfef7fe640 1 -- 172.21.15.172:0/1984637614 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff006c870 msgr2=0x7fbff01494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfef7fe640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff006c870 0x7fbff01494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfef7fe640 1 -- 172.21.15.172:0/1984637614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff0158230 msgr2=0x7fbff0146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfef7fe640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff0158230 0x7fbff0146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfef7fe640 1 -- 172.21.15.172:0/1984637614 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff015b8f0 con 0x7fbff00d1b80 2024-04-25T08:46:10.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfef7fe640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff00d1b80 0x7fbff01468d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fbfe402a1c0 tx=0x7fbfe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.189+0000 7fbfecff9640 1 -- 172.21.15.172:0/1984637614 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4041020 con 0x7fbff00d1b80 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.190+0000 7fbfecff9640 1 -- 172.21.15.172:0/1984637614 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe4030720 con 0x7fbff00d1b80 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.190+0000 7fbff6a07640 1 -- 172.21.15.172:0/1984637614 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff0154d60 con 0x7fbff00d1b80 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.190+0000 7fbfecff9640 1 -- 172.21.15.172:0/1984637614 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4037040 con 0x7fbff00d1b80 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.190+0000 7fbff6a07640 1 -- 172.21.15.172:0/1984637614 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff0155320 con 0x7fbff00d1b80 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.191+0000 7fbff6a07640 1 -- 172.21.15.172:0/1984637614 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff006de50 con 0x7fbff00d1b80 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.191+0000 7fbfecff9640 1 -- 172.21.15.172:0/1984637614 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbfe4044020 con 0x7fbff00d1b80 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.191+0000 7fbfecff9640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbfdc06b4d0 0x7fbfdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.191+0000 7fbfecff9640 1 -- 172.21.15.172:0/1984637614 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbfe40aaaa0 con 0x7fbff00d1b80 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.191+0000 7fbfeffff640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbfdc06b4d0 0x7fbfdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.192+0000 7fbfeffff640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbfdc06b4d0 0x7fbfdc06d990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0006ca0 tx=0x7fbfe0009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:10.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.195+0000 7fbfecff9640 1 -- 172.21.15.172:0/1984637614 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbfe404b030 con 0x7fbff00d1b80 2024-04-25T08:46:10.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.401+0000 7fbff6a07640 1 -- 172.21.15.172:0/1984637614 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbff0073a00 con 0x7fbff00d1b80 2024-04-25T08:46:10.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.464+0000 7fbfecff9640 1 -- 172.21.15.172:0/1984637614 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbfe40790c0 con 0x7fbff00d1b80 2024-04-25T08:46:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 -- 172.21.15.172:0/1984637614 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbfdc06b4d0 msgr2=0x7fbfdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbfdc06b4d0 0x7fbfdc06d990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0006ca0 tx=0x7fbfe0009240 comp rx=0 tx=0).stop 2024-04-25T08:46:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 -- 172.21.15.172:0/1984637614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff00d1b80 msgr2=0x7fbff01468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff00d1b80 0x7fbff01468d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fbfe402a1c0 tx=0x7fbfe40046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 -- 172.21.15.172:0/1984637614 shutdown_connections 2024-04-25T08:46:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbfdc06b4d0 0x7fbfdc06d990 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff0158230 0x7fbff0146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbff00d1b80 0x7fbff01468d0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 --2- 172.21.15.172:0/1984637614 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff006c870 0x7fbff01494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 -- 172.21.15.172:0/1984637614 >> 172.21.15.172:0/1984637614 conn(0x7fbff0061600 msgr2=0x7fbff015d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 -- 172.21.15.172:0/1984637614 shutdown_connections 2024-04-25T08:46:10.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.466+0000 7fbff6a07640 1 -- 172.21.15.172:0/1984637614 wait complete. 2024-04-25T08:46:10.470 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:46:10.471 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:46:10.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.580+0000 7f757a953640 1 Processor -- start 2024-04-25T08:46:10.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.580+0000 7f757a953640 1 -- start start 2024-04-25T08:46:10.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f757a953640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f75740cc4f0 0x7f75740cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f757a953640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f75740cdb20 0x7f75740cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f757a953640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7574072280 con 0x7f757415b270 2024-04-25T08:46:10.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f757a953640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7574071270 con 0x7f75740cdb20 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f757a953640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757415bd80 con 0x7f75740cc4f0 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f75737fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f75740cdb20 0x7f75740cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f7578ef0640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f757415b270 0x7f757415b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39658/0 (socket says 172.21.15.172:39658) 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f7578ef0640 1 -- 172.21.15.172:0/870145187 learned_addr learned my addr 172.21.15.172:0/870145187 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f7573fff640 1 --2- 172.21.15.172:0/870145187 >> v2:172.21.15.186:3300/0 conn(0x7f75740cc4f0 0x7f75740cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f7572ffd640 1 -- 172.21.15.172:0/870145187 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307075909 0 0) 0x7f7574072280 con 0x7f757415b270 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f75737fe640 1 -- 172.21.15.172:0/870145187 >> v2:172.21.15.186:3300/0 conn(0x7f75740cc4f0 msgr2=0x7f75740cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f75737fe640 1 --2- 172.21.15.172:0/870145187 >> v2:172.21.15.186:3300/0 conn(0x7f75740cc4f0 0x7f75740cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f75737fe640 1 -- 172.21.15.172:0/870145187 >> v1:172.21.15.172:6789/0 conn(0x7f757415b270 legacy=0x7f757415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f75737fe640 1 -- 172.21.15.172:0/870145187 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740714c0 con 0x7f75740cdb20 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.581+0000 7f7573fff640 1 --2- 172.21.15.172:0/870145187 >> v2:172.21.15.186:3300/0 conn(0x7f75740cc4f0 0x7f75740cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.582+0000 7f75737fe640 1 --2- 172.21.15.172:0/870145187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75740cdb20 0x7f75740cdfb0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f75740cd290 tx=0x7f756802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c307d88d642b95a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.582+0000 7f7572ffd640 1 -- 172.21.15.172:0/870145187 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568037070 con 0x7f75740cdb20 2024-04-25T08:46:10.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.582+0000 7f7572ffd640 1 -- 172.21.15.172:0/870145187 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568032440 con 0x7f75740cdb20 2024-04-25T08:46:10.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.582+0000 7f7572ffd640 1 -- 172.21.15.172:0/870145187 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568032810 con 0x7f75740cdb20 2024-04-25T08:46:10.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.583+0000 7f757a953640 1 -- 172.21.15.172:0/870145187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75740cdb20 msgr2=0x7f75740cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.583+0000 7f757a953640 1 --2- 172.21.15.172:0/870145187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75740cdb20 0x7f75740cdfb0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f75740cd290 tx=0x7f756802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.583+0000 7f757a953640 1 -- 172.21.15.172:0/870145187 shutdown_connections 2024-04-25T08:46:10.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.583+0000 7f757a953640 1 --2- 172.21.15.172:0/870145187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75740cdb20 0x7f75740cdfb0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.583+0000 7f757a953640 1 --2- 172.21.15.172:0/870145187 >> v2:172.21.15.186:3300/0 conn(0x7f75740cc4f0 0x7f75740cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.583+0000 7f757a953640 1 -- 172.21.15.172:0/870145187 >> 172.21.15.172:0/870145187 conn(0x7f757406abe0 msgr2=0x7f757406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:10.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.583+0000 7f757a953640 1 -- 172.21.15.172:0/870145187 shutdown_connections 2024-04-25T08:46:10.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.583+0000 7f757a953640 1 -- 172.21.15.172:0/870145187 wait complete. 2024-04-25T08:46:10.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.584+0000 7f757a953640 1 Processor -- start 2024-04-25T08:46:10.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.584+0000 7f757a953640 1 -- start start 2024-04-25T08:46:10.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f757a953640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75740cc4f0 0x7f75741556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f757a953640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75740cdb20 0x7f7574155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f757a953640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f757415b270 0x7f75741589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f757a953640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7574071d60 con 0x7f757415b270 2024-04-25T08:46:10.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f757a953640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7574071a80 con 0x7f75740cdb20 2024-04-25T08:46:10.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f757a953640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75740ae500 con 0x7f75740cc4f0 2024-04-25T08:46:10.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f7578ef0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f757415b270 0x7f75741589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f7578ef0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f757415b270 0x7f75741589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59208/0 (socket says 172.21.15.172:59208) 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f7578ef0640 1 -- 172.21.15.172:0/3487485781 learned_addr learned my addr 172.21.15.172:0/3487485781 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f75737fe640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75740cdb20 0x7f7574155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f7578ef0640 1 -- 172.21.15.172:0/3487485781 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75740cc4f0 msgr2=0x7f75741556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f7578ef0640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75740cc4f0 0x7f75741556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f7578ef0640 1 -- 172.21.15.172:0/3487485781 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75740cdb20 msgr2=0x7f7574155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f7578ef0640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75740cdb20 0x7f7574155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f7578ef0640 1 -- 172.21.15.172:0/3487485781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574156160 con 0x7f757415b270 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f75737fe640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75740cdb20 0x7f7574155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.585+0000 7f7578ef0640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f757415b270 0x7f75741589f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f756c00c810 tx=0x7f756c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.586+0000 7f7570ff9640 1 -- 172.21.15.172:0/3487485781 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c018070 con 0x7f757415b270 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.586+0000 7f7570ff9640 1 -- 172.21.15.172:0/3487485781 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c00a640 con 0x7f757415b270 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.586+0000 7f7570ff9640 1 -- 172.21.15.172:0/3487485781 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00aa30 con 0x7f757415b270 2024-04-25T08:46:10.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.586+0000 7f757a953640 1 -- 172.21.15.172:0/3487485781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7574156430 con 0x7f757415b270 2024-04-25T08:46:10.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.586+0000 7f757a953640 1 -- 172.21.15.172:0/3487485781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7574156cd0 con 0x7f757415b270 2024-04-25T08:46:10.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.587+0000 7f757a953640 1 -- 172.21.15.172:0/3487485781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7574073a00 con 0x7f757415b270 2024-04-25T08:46:10.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.587+0000 7f7570ff9640 1 -- 172.21.15.172:0/3487485781 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f756c01b070 con 0x7f757415b270 2024-04-25T08:46:10.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.587+0000 7f7570ff9640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f756006b4d0 0x7f756006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:10.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.588+0000 7f7570ff9640 1 -- 172.21.15.172:0/3487485781 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f756c089980 con 0x7f757415b270 2024-04-25T08:46:10.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.588+0000 7f7573fff640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f756006b4d0 0x7f756006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:10.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.588+0000 7f7573fff640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f756006b4d0 0x7f756006d990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7564006fd0 tx=0x7f7564008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:10.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.592+0000 7f7570ff9640 1 -- 172.21.15.172:0/3487485781 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f756c058700 con 0x7f757415b270 2024-04-25T08:46:10.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:10.798+0000 7f757a953640 1 -- 172.21.15.172:0/3487485781 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f75740cc2a0 con 0x7f757415b270 2024-04-25T08:46:11.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.473+0000 7f7570ff9640 1 -- 172.21.15.172:0/3487485781 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f756c058000 con 0x7f757415b270 2024-04-25T08:46:11.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 -- 172.21.15.172:0/3487485781 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f756006b4d0 msgr2=0x7f756006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f756006b4d0 0x7f756006d990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7564006fd0 tx=0x7f7564008040 comp rx=0 tx=0).stop 2024-04-25T08:46:11.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 -- 172.21.15.172:0/3487485781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f757415b270 msgr2=0x7f75741589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f757415b270 0x7f75741589f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f756c00c810 tx=0x7f756c00ccd0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 -- 172.21.15.172:0/3487485781 shutdown_connections 2024-04-25T08:46:11.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f756006b4d0 0x7f756006d990 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75740cdb20 0x7f7574155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f757415b270 0x7f75741589f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 --2- 172.21.15.172:0/3487485781 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75740cc4f0 0x7f75741556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 -- 172.21.15.172:0/3487485781 >> 172.21.15.172:0/3487485781 conn(0x7f757406abe0 msgr2=0x7f757415d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:11.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 -- 172.21.15.172:0/3487485781 shutdown_connections 2024-04-25T08:46:11.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.476+0000 7f757a953640 1 -- 172.21.15.172:0/3487485781 wait complete. 2024-04-25T08:46:11.480 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:46:11.481 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:11.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.591+0000 7f50febd5640 1 Processor -- start 2024-04-25T08:46:11.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.592+0000 7f50febd5640 1 -- start start 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.592+0000 7f50febd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f815dbe0 0x7f50f80d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.592+0000 7f50febd5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f80b6220 con 0x7f50f80b92a0 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.592+0000 7f50febd5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f80b97a0 con 0x7f50f80b2cb0 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.592+0000 7f50febd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f815dfc0 con 0x7f50f815dbe0 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.592+0000 7f50fd172640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f50f80b92a0 0x7f50f80b5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39666/0 (socket says 172.21.15.172:39666) 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.592+0000 7f50fd172640 1 -- 172.21.15.172:0/4108768974 learned_addr learned my addr 172.21.15.172:0/4108768974 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50fc971640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f815dbe0 0x7f50f80d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830678410 0 0) 0x7f50f80b6220 con 0x7f50f80b92a0 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e0003520 con 0x7f50f80b92a0 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031644160 0 0) 0x7f50f80b97a0 con 0x7f50f80b2cb0 2024-04-25T08:46:11.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f80b6220 con 0x7f50f80b2cb0 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2701565533 0 0) 0x7f50e0003520 con 0x7f50f80b92a0 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f815dbe0 msgr2=0x7f50f80d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f815dbe0 0x7f50f80d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 >> v1:172.21.15.186:6789/0 conn(0x7f50f80b2cb0 legacy=0x7f50f80b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f80d1c50 con 0x7f50f80b92a0 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f50f00019f0 con 0x7f50f80b92a0 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50fc971640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f815dbe0 0x7f50f80d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 >> v1:172.21.15.172:6789/0 conn(0x7f50f80b92a0 legacy=0x7f50f80b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 0x7f50e0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e0004800 0x7f50e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f815dbe0 0x7f50e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e000b9c0 con 0x7f50e0003b70 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e000bb70 con 0x7f50e0004800 2024-04-25T08:46:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e000bd70 con 0x7f50f815dbe0 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50fc971640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 0x7f50e0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50fd172640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f815dbe0 0x7f50e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50f7fff640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e0004800 0x7f50e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50fc971640 1 -- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f815dbe0 msgr2=0x7f50e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50fc971640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f815dbe0 0x7f50e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50fc971640 1 -- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e0004800 msgr2=0x7f50e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50fc971640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e0004800 0x7f50e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.593+0000 7f50fc971640 1 -- 172.21.15.172:0/4108768974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e0003520 con 0x7f50e0003b70 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.594+0000 7f50fc971640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 0x7f50e0003f70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009c60 tx=0x7f50e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36258d07de069727 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.594+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8036070 con 0x7f50e0003b70 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.594+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e8031400 con 0x7f50e0003b70 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.594+0000 7f50f77fe640 1 -- 172.21.15.172:0/4108768974 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8009860 con 0x7f50e0003b70 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.595+0000 7f50febd5640 1 -- 172.21.15.172:0/4108768974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 msgr2=0x7f50e0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.595+0000 7f50febd5640 1 --2- 172.21.15.172:0/4108768974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 0x7f50e0003f70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009c60 tx=0x7f50e0005830 comp rx=0 tx=0).stop 2024-04-25T08:46:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.595+0000 7f50fd172640 1 -- 172.21.15.172:0/4108768974 reap_dead start 2024-04-25T08:46:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.595+0000 7f50febd5640 1 -- 172.21.15.172:0/4108768974 shutdown_connections 2024-04-25T08:46:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.595+0000 7f50febd5640 1 -- 172.21.15.172:0/4108768974 >> 172.21.15.172:0/4108768974 conn(0x7f50f8061a20 msgr2=0x7f50f8061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.595+0000 7f50febd5640 1 -- 172.21.15.172:0/4108768974 shutdown_connections 2024-04-25T08:46:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.595+0000 7f50febd5640 1 -- 172.21.15.172:0/4108768974 wait complete. 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.596+0000 7f50febd5640 1 Processor -- start 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.596+0000 7f50febd5640 1 -- start start 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50febd5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 0x7f50f8151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50febd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f80b82b0 0x7f50f80b8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50febd5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f8154220 0x7f50f81546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50febd5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80d2210 con 0x7f50e0003b70 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50febd5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80d1a00 con 0x7f50f8154220 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50febd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80b6ab0 con 0x7f50f80b82b0 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50fc971640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 0x7f50f8151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50fc971640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 0x7f50f8151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59216/0 (socket says 172.21.15.172:59216) 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50fc971640 1 -- 172.21.15.172:0/718421212 learned_addr learned my addr 172.21.15.172:0/718421212 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50fd172640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f8154220 0x7f50f81546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50f7fff640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f80b82b0 0x7f50f80b8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50fc971640 1 -- 172.21.15.172:0/718421212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f80b82b0 msgr2=0x7f50f80b8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50fc971640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f80b82b0 0x7f50f80b8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50fc971640 1 -- 172.21.15.172:0/718421212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f8154220 msgr2=0x7f50f81546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50fc971640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f8154220 0x7f50f81546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50fc971640 1 -- 172.21.15.172:0/718421212 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f815dfc0 con 0x7f50e0003b70 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.597+0000 7f50f7fff640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f80b82b0 0x7f50f80b8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.598+0000 7f50fc971640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 0x7f50f8151ad0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f50e8000c00 tx=0x7f50e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.598+0000 7f50f57fa640 1 -- 172.21.15.172:0/718421212 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8040070 con 0x7f50e0003b70 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.598+0000 7f50f57fa640 1 -- 172.21.15.172:0/718421212 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e80093e0 con 0x7f50e0003b70 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.598+0000 7f50febd5640 1 -- 172.21.15.172:0/718421212 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f815e2a0 con 0x7f50e0003b70 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.598+0000 7f50f57fa640 1 -- 172.21.15.172:0/718421212 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8036040 con 0x7f50e0003b70 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.598+0000 7f50febd5640 1 -- 172.21.15.172:0/718421212 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f815e860 con 0x7f50e0003b70 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.599+0000 7f50febd5640 1 -- 172.21.15.172:0/718421212 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f8073990 con 0x7f50e0003b70 2024-04-25T08:46:11.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.599+0000 7f50f57fa640 1 -- 172.21.15.172:0/718421212 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f50e8043070 con 0x7f50e0003b70 2024-04-25T08:46:11.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.600+0000 7f50f57fa640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50e406b4d0 0x7f50e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.600+0000 7f50f57fa640 1 -- 172.21.15.172:0/718421212 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f50e80aa920 con 0x7f50e0003b70 2024-04-25T08:46:11.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.600+0000 7f50f7fff640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50e406b4d0 0x7f50e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.600+0000 7f50f7fff640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50e406b4d0 0x7f50e406d990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f50f81557b0 tx=0x7f50ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:11.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.604+0000 7f50f57fa640 1 -- 172.21.15.172:0/718421212 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f50e8078f30 con 0x7f50e0003b70 2024-04-25T08:46:11.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.807+0000 7f50febd5640 1 -- 172.21.15.172:0/718421212 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50f80d3450 con 0x7f50e0003b70 2024-04-25T08:46:11.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.808+0000 7f50f57fa640 1 -- 172.21.15.172:0/718421212 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f50e807cfd0 con 0x7f50e0003b70 2024-04-25T08:46:11.800 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:11.800 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/1572465264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":1572465264},{"type":"v1","addr":"172.21.15.186:6835","nonce":1572465264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6696,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/611108095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":611108095},{"type":"v1","addr":"172.21.15.172:6835","nonce":611108095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3538685014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3538685014},{"type":"v1","addr":"172.21.15.172:6837","nonce":3538685014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:08.789050+0000","modified":"2024-04-25T08:46:10.801148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6705},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6705":{"gid":6705,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6834/550125910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":550125910},{"type":"v1","addr":"172.21.15.186:6834","nonce":550125910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:46:11.800 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 34 2024-04-25T08:46:11.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 -- 172.21.15.172:0/718421212 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50e406b4d0 msgr2=0x7f50e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50e406b4d0 0x7f50e406d990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f50f81557b0 tx=0x7f50ec009040 comp rx=0 tx=0).stop 2024-04-25T08:46:11.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 -- 172.21.15.172:0/718421212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 msgr2=0x7f50f8151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 0x7f50f8151ad0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f50e8000c00 tx=0x7f50e8004730 comp rx=0 tx=0).stop 2024-04-25T08:46:11.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 -- 172.21.15.172:0/718421212 shutdown_connections 2024-04-25T08:46:11.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50e406b4d0 0x7f50e406d990 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50f8154220 0x7f50f81546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50f80b82b0 0x7f50f80b8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 --2- 172.21.15.172:0/718421212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e0003b70 0x7f50f8151ad0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 -- 172.21.15.172:0/718421212 >> 172.21.15.172:0/718421212 conn(0x7f50f8061a20 msgr2=0x7f50f815a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:11.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 -- 172.21.15.172:0/718421212 shutdown_connections 2024-04-25T08:46:11.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.810+0000 7f50febd5640 1 -- 172.21.15.172:0/718421212 wait complete. 2024-04-25T08:46:11.813 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:11.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.919+0000 7f88c9ef7640 1 Processor -- start 2024-04-25T08:46:11.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.919+0000 7f88c9ef7640 1 -- start start 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.919+0000 7f88c9ef7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f88c40d1020 0x7f88c40d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.919+0000 7f88c9ef7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c40b97a0 con 0x7f88c40b2cb0 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.919+0000 7f88c9ef7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c40d1c50 con 0x7f88c415dbe0 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.919+0000 7f88c9ef7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c415dfc0 con 0x7f88c40d1020 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c2ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f88c40b2cb0 0x7f88c40d2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39682/0 (socket says 172.21.15.172:39682) 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c2ffd640 1 -- 172.21.15.172:0/2104858016 learned_addr learned my addr 172.21.15.172:0/2104858016 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557652867 0 0) 0x7f88c40b97a0 con 0x7f88c40b2cb0 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ac003520 con 0x7f88c40b2cb0 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c3fff640 1 --2- 172.21.15.172:0/2104858016 >> v2:172.21.15.186:3300/0 conn(0x7f88c40d1020 0x7f88c40d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1365899876 0 0) 0x7f88ac003520 con 0x7f88c40b2cb0 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 >> v2:172.21.15.186:3300/0 conn(0x7f88c40d1020 msgr2=0x7f88c40d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:11.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 --2- 172.21.15.172:0/2104858016 >> v2:172.21.15.186:3300/0 conn(0x7f88c40d1020 0x7f88c40d2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 >> v1:172.21.15.186:6789/0 conn(0x7f88c415dbe0 legacy=0x7f88c40d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40d1f30 con 0x7f88c40b2cb0 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f88b8001670 con 0x7f88c40b2cb0 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 >> v1:172.21.15.172:6789/0 conn(0x7f88c40b2cb0 legacy=0x7f88c40d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88ac0039b0 0x7f88ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac004800 0x7f88ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88ac0051c0 0x7f88ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac00c030 con 0x7f88ac0039b0 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac00c1e0 con 0x7f88ac0051c0 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac00c3e0 con 0x7f88ac004800 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c37fe640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88ac0039b0 0x7f88ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c3fff640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88ac0051c0 0x7f88ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.920+0000 7f88c2ffd640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac004800 0x7f88ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.921+0000 7f88c37fe640 1 -- 172.21.15.172:0/2104858016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac004800 msgr2=0x7f88ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:11.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.921+0000 7f88c37fe640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac004800 0x7f88ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.921+0000 7f88c37fe640 1 -- 172.21.15.172:0/2104858016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88ac0051c0 msgr2=0x7f88ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.921+0000 7f88c37fe640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88ac0051c0 0x7f88ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.921+0000 7f88c37fe640 1 -- 172.21.15.172:0/2104858016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac003520 con 0x7f88ac0039b0 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.921+0000 7f88c3fff640 1 -- 172.21.15.172:0/2104858016 reap_dead start 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.921+0000 7f88c37fe640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88ac0039b0 0x7f88ac003dd0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f88b4001750 tx=0x7f88ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00608a4f82eb709 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.921+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4001370 con 0x7f88ac0039b0 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.921+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40052d0 con 0x7f88ac0039b0 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.921+0000 7f88c27fc640 1 -- 172.21.15.172:0/2104858016 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b402abc0 con 0x7f88ac0039b0 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.922+0000 7f88c9ef7640 1 -- 172.21.15.172:0/2104858016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88ac0039b0 msgr2=0x7f88ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.922+0000 7f88c9ef7640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88ac0039b0 0x7f88ac003dd0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f88b4001750 tx=0x7f88ac005830 comp rx=0 tx=0).stop 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.922+0000 7f88c9ef7640 1 -- 172.21.15.172:0/2104858016 shutdown_connections 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.922+0000 7f88c9ef7640 1 --2- 172.21.15.172:0/2104858016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88ac0039b0 0x7f88ac003dd0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.922+0000 7f88c9ef7640 1 -- 172.21.15.172:0/2104858016 >> 172.21.15.172:0/2104858016 conn(0x7f88c4061a20 msgr2=0x7f88c4061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.922+0000 7f88c9ef7640 1 -- 172.21.15.172:0/2104858016 shutdown_connections 2024-04-25T08:46:11.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.922+0000 7f88c9ef7640 1 -- 172.21.15.172:0/2104858016 wait complete. 2024-04-25T08:46:11.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.923+0000 7f88c9ef7640 1 Processor -- start 2024-04-25T08:46:11.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.923+0000 7f88c9ef7640 1 -- start start 2024-04-25T08:46:11.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c9ef7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0039b0 0x7f88c40b8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c9ef7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c40b8740 0x7f88c4142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c9ef7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88c4142960 0x7f88c4142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c9ef7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40b92a0 con 0x7f88c40b8740 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c9ef7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40d1a00 con 0x7f88c4142960 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c9ef7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40b9420 con 0x7f88ac0039b0 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c40b8740 0x7f88c4142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c40b8740 0x7f88c4142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59238/0 (socket says 172.21.15.172:59238) 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c2ffd640 1 -- 172.21.15.172:0/3910238026 learned_addr learned my addr 172.21.15.172:0/3910238026 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c37fe640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0039b0 0x7f88c40b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c3fff640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88c4142960 0x7f88c4142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c2ffd640 1 -- 172.21.15.172:0/3910238026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0039b0 msgr2=0x7f88c40b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c2ffd640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0039b0 0x7f88c40b8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c2ffd640 1 -- 172.21.15.172:0/3910238026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88c4142960 msgr2=0x7f88c4142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:11.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c2ffd640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88c4142960 0x7f88c4142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c2ffd640 1 -- 172.21.15.172:0/3910238026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c4157430 con 0x7f88c40b8740 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c37fe640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0039b0 0x7f88c40b8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.924+0000 7f88c3fff640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88c4142960 0x7f88c4142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.925+0000 7f88c2ffd640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c40b8740 0x7f88c4142420 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f88b8007320 tx=0x7f88b80077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.925+0000 7f88abfff640 1 -- 172.21.15.172:0/3910238026 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b801a070 con 0x7f88c40b8740 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.925+0000 7f88abfff640 1 -- 172.21.15.172:0/3910238026 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b800f860 con 0x7f88c40b8740 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.925+0000 7f88c9ef7640 1 -- 172.21.15.172:0/3910238026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c4156b90 con 0x7f88c40b8740 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.925+0000 7f88abfff640 1 -- 172.21.15.172:0/3910238026 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b800fc30 con 0x7f88c40b8740 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.925+0000 7f88c9ef7640 1 -- 172.21.15.172:0/3910238026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c4157150 con 0x7f88c40b8740 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.926+0000 7f88c9ef7640 1 -- 172.21.15.172:0/3910238026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c4073990 con 0x7f88c40b8740 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.926+0000 7f88abfff640 1 -- 172.21.15.172:0/3910238026 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f88b801d070 con 0x7f88c40b8740 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.927+0000 7f88abfff640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f88b006b4d0 0x7f88b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.927+0000 7f88c37fe640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f88b006b4d0 0x7f88b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:11.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.927+0000 7f88abfff640 1 -- 172.21.15.172:0/3910238026 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f88b8089c20 con 0x7f88c40b8740 2024-04-25T08:46:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.927+0000 7f88c37fe640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f88b006b4d0 0x7f88b006d990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f88b4032000 tx=0x7f88b402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:11.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:11.931+0000 7f88abfff640 1 -- 172.21.15.172:0/3910238026 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f88b8058910 con 0x7f88c40b8740 2024-04-25T08:46:12.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.106+0000 7f88c9ef7640 1 -- 172.21.15.172:0/3910238026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88c40b9060 con 0x7f88c40b8740 2024-04-25T08:46:12.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.107+0000 7f88abfff640 1 -- 172.21.15.172:0/3910238026 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16944 (secure 0 0 0) 0x7f88b8058210 con 0x7f88c40b8740 2024-04-25T08:46:12.099 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:12.099 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":65,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:10.450849+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:07.009926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:07.764108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 -- 172.21.15.172:0/3910238026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f88b006b4d0 msgr2=0x7f88b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f88b006b4d0 0x7f88b006d990 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f88b4032000 tx=0x7f88b402e000 comp rx=0 tx=0).stop 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 -- 172.21.15.172:0/3910238026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c40b8740 msgr2=0x7f88c4142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c40b8740 0x7f88c4142420 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f88b8007320 tx=0x7f88b80077e0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 -- 172.21.15.172:0/3910238026 shutdown_connections 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f88b006b4d0 0x7f88b006d990 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88c4142960 0x7f88c4142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88c40b8740 0x7f88c4142420 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 --2- 172.21.15.172:0/3910238026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0039b0 0x7f88c40b8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 -- 172.21.15.172:0/3910238026 >> 172.21.15.172:0/3910238026 conn(0x7f88c4061a20 msgr2=0x7f88c4157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 -- 172.21.15.172:0/3910238026 shutdown_connections 2024-04-25T08:46:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.109+0000 7f88c9ef7640 1 -- 172.21.15.172:0/3910238026 wait complete. 2024-04-25T08:46:12.112 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:46:12.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:46:12.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.217+0000 7f6c0878b640 1 Processor -- start 2024-04-25T08:46:12.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.217+0000 7f6c0878b640 1 -- start start 2024-04-25T08:46:12.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c0878b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6c000cc8e0 0x7f6c001625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c0878b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6c000d1810 0x7f6c000d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c0878b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c000cce50 con 0x7f6c0015dc90 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c0878b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c000d21c0 con 0x7f6c000d1810 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c0878b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c00161af0 con 0x7f6c000cc8e0 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c06d28640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6c000d1810 0x7f6c000d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c06d28640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6c000d1810 0x7f6c000d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59242/0 (socket says 172.21.15.172:59242) 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c06d28640 1 -- 172.21.15.172:0/1313463904 learned_addr learned my addr 172.21.15.172:0/1313463904 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c05d26640 1 --2- 172.21.15.172:0/1313463904 >> v2:172.21.15.186:3300/0 conn(0x7f6c000cc8e0 0x7f6c001625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c06d28640 1 -- 172.21.15.172:0/1313463904 >> v2:172.21.15.186:3300/0 conn(0x7f6c000cc8e0 msgr2=0x7f6c001625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c06d28640 1 --2- 172.21.15.172:0/1313463904 >> v2:172.21.15.186:3300/0 conn(0x7f6c000cc8e0 0x7f6c001625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c06d28640 1 -- 172.21.15.172:0/1313463904 >> v1:172.21.15.186:6789/0 conn(0x7f6c0015dc90 legacy=0x7f6c0015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.218+0000 7f6c06d28640 1 -- 172.21.15.172:0/1313463904 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00161dd0 con 0x7f6c000d1810 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.219+0000 7f6c06d28640 1 --2- 172.21.15.172:0/1313463904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 0x7f6c000d1c80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f6c000c88a0 tx=0x7f6bf802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567d2b230d444a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.219+0000 7f6c05525640 1 -- 172.21.15.172:0/1313463904 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8037070 con 0x7f6c000d1810 2024-04-25T08:46:12.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.219+0000 7f6c05525640 1 -- 172.21.15.172:0/1313463904 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8032440 con 0x7f6c000d1810 2024-04-25T08:46:12.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.219+0000 7f6c05525640 1 -- 172.21.15.172:0/1313463904 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8032810 con 0x7f6c000d1810 2024-04-25T08:46:12.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.220+0000 7f6c0878b640 1 -- 172.21.15.172:0/1313463904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 msgr2=0x7f6c000d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.220+0000 7f6c0878b640 1 --2- 172.21.15.172:0/1313463904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 0x7f6c000d1c80 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f6c000c88a0 tx=0x7f6bf802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.220+0000 7f6c0878b640 1 -- 172.21.15.172:0/1313463904 shutdown_connections 2024-04-25T08:46:12.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.220+0000 7f6c0878b640 1 --2- 172.21.15.172:0/1313463904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 0x7f6c000d1c80 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.220+0000 7f6c0878b640 1 --2- 172.21.15.172:0/1313463904 >> v2:172.21.15.186:3300/0 conn(0x7f6c000cc8e0 0x7f6c001625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.220+0000 7f6c0878b640 1 -- 172.21.15.172:0/1313463904 >> 172.21.15.172:0/1313463904 conn(0x7f6c0006f590 msgr2=0x7f6c0006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:12.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.220+0000 7f6c0878b640 1 -- 172.21.15.172:0/1313463904 shutdown_connections 2024-04-25T08:46:12.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.220+0000 7f6c0878b640 1 -- 172.21.15.172:0/1313463904 wait complete. 2024-04-25T08:46:12.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.221+0000 7f6c0878b640 1 Processor -- start 2024-04-25T08:46:12.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.221+0000 7f6c0878b640 1 -- start start 2024-04-25T08:46:12.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c0878b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c000cc8e0 0x7f6c0015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c0878b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 0x7f6c000c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c0878b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c0015dc90 0x7f6c000b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c0878b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0015e070 con 0x7f6c000d1810 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c0878b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000cd130 con 0x7f6c000cc8e0 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c0878b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0015e1f0 con 0x7f6c0015dc90 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c05d26640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 0x7f6c000c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c05d26640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 0x7f6c000c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59246/0 (socket says 172.21.15.172:59246) 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c05d26640 1 -- 172.21.15.172:0/3426180413 learned_addr learned my addr 172.21.15.172:0/3426180413 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c05d26640 1 -- 172.21.15.172:0/3426180413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c0015dc90 msgr2=0x7f6c000b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c05d26640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c0015dc90 0x7f6c000b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c05d26640 1 -- 172.21.15.172:0/3426180413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c000cc8e0 msgr2=0x7f6c0015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c05d26640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c000cc8e0 0x7f6c0015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c05d26640 1 -- 172.21.15.172:0/3426180413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c000b5700 con 0x7f6c000d1810 2024-04-25T08:46:12.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c05d26640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 0x7f6c000c7a10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000c7f0 tx=0x7f6bf000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:12.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6bf6ffd640 1 -- 172.21.15.172:0/3426180413 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0015070 con 0x7f6c000d1810 2024-04-25T08:46:12.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6bf6ffd640 1 -- 172.21.15.172:0/3426180413 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0004240 con 0x7f6c000d1810 2024-04-25T08:46:12.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c0878b640 1 -- 172.21.15.172:0/3426180413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c000b59e0 con 0x7f6c000d1810 2024-04-25T08:46:12.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6bf6ffd640 1 -- 172.21.15.172:0/3426180413 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0007620 con 0x7f6c000d1810 2024-04-25T08:46:12.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.222+0000 7f6c0878b640 1 -- 172.21.15.172:0/3426180413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c000b5fa0 con 0x7f6c000d1810 2024-04-25T08:46:12.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.223+0000 7f6c0878b640 1 -- 172.21.15.172:0/3426180413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c00073990 con 0x7f6c000d1810 2024-04-25T08:46:12.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.224+0000 7f6bf6ffd640 1 -- 172.21.15.172:0/3426180413 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6bf00079d0 con 0x7f6c000d1810 2024-04-25T08:46:12.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.224+0000 7f6bf6ffd640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6be406b500 0x7f6be406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.224+0000 7f6bf6ffd640 1 -- 172.21.15.172:0/3426180413 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6bf008a370 con 0x7f6c000d1810 2024-04-25T08:46:12.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.224+0000 7f6c06527640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6be406b500 0x7f6be406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.225+0000 7f6c06527640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6be406b500 0x7f6be406d9c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00abb0 tx=0x7f6bfc009250 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:12.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.228+0000 7f6bf6ffd640 1 -- 172.21.15.172:0/3426180413 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6bf00590f0 con 0x7f6c000d1810 2024-04-25T08:46:12.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.395+0000 7f6c0878b640 1 -- 172.21.15.172:0/3426180413 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c0015e660 con 0x7f6be406b500 2024-04-25T08:46:12.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.400+0000 7f6bf6ffd640 1 -- 172.21.15.172:0/3426180413 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247738 (secure 0 0 0) 0x7f6c0015e660 con 0x7f6be406b500 2024-04-25T08:46:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:12.396 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:46:12.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.403+0000 7f6c0878b640 1 -- 172.21.15.172:0/3426180413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6be406b500 msgr2=0x7f6be406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.403+0000 7f6c0878b640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6be406b500 0x7f6be406d9c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00abb0 tx=0x7f6bfc009250 comp rx=0 tx=0).stop 2024-04-25T08:46:12.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.403+0000 7f6c0878b640 1 -- 172.21.15.172:0/3426180413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 msgr2=0x7f6c000c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.403+0000 7f6c0878b640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 0x7f6c000c7a10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000c7f0 tx=0x7f6bf000ccb0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.404+0000 7f6c0878b640 1 -- 172.21.15.172:0/3426180413 shutdown_connections 2024-04-25T08:46:12.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.404+0000 7f6c0878b640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6be406b500 0x7f6be406d9c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.404+0000 7f6c0878b640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c0015dc90 0x7f6c000b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.404+0000 7f6c0878b640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c000d1810 0x7f6c000c7a10 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.404+0000 7f6c0878b640 1 --2- 172.21.15.172:0/3426180413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c000cc8e0 0x7f6c0015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.404+0000 7f6c0878b640 1 -- 172.21.15.172:0/3426180413 >> 172.21.15.172:0/3426180413 conn(0x7f6c0006f590 msgr2=0x7f6c0015b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:12.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.404+0000 7f6c0878b640 1 -- 172.21.15.172:0/3426180413 shutdown_connections 2024-04-25T08:46:12.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.404+0000 7f6c0878b640 1 -- 172.21.15.172:0/3426180413 wait complete. 2024-04-25T08:46:12.406 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2024-04-25T08:46:10.558036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592584,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":193,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":67,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":289916,"kb_used_data":7168,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754684804,"statfs":{"total":773094113280,"available":772797239296,"internally_reserved":0,"allocated":7340032,"data_stored":3940709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2216,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000668"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.483026+0000","last_change":"2024-04-25T08:46:09.475983+0000","last_active":"2024-04-25T08:46:09.483026+0000","last_peered":"2024-04-25T08:46:09.483026+0000","last_clean":"2024-04-25T08:46:09.483026+0000","last_became_active":"2024-04-25T08:46:09.475661+0000","last_became_peered":"2024-04-25T08:46:09.475661+0000","last_unstale":"2024-04-25T08:46:09.483026+0000","last_undegraded":"2024-04-25T08:46:09.483026+0000","last_fullsized":"2024-04-25T08:46:09.483026+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:47.728427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.462507+0000","last_change":"2024-04-25T08:46:09.460878+0000","last_active":"2024-04-25T08:46:09.462507+0000","last_peered":"2024-04-25T08:46:09.462507+0000","last_clean":"2024-04-25T08:46:09.462507+0000","last_became_active":"2024-04-25T08:46:09.460586+0000","last_became_peered":"2024-04-25T08:46:09.460586+0000","last_unstale":"2024-04-25T08:46:09.462507+0000","last_undegraded":"2024-04-25T08:46:09.462507+0000","last_fullsized":"2024-04-25T08:46:09.462507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:58.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.459059+0000","last_change":"2024-04-25T08:46:09.470919+0000","last_active":"2024-04-25T08:46:10.459059+0000","last_peered":"2024-04-25T08:46:10.459059+0000","last_clean":"2024-04-25T08:46:10.459059+0000","last_became_active":"2024-04-25T08:46:09.470656+0000","last_became_peered":"2024-04-25T08:46:09.470656+0000","last_unstale":"2024-04-25T08:46:10.459059+0000","last_undegraded":"2024-04-25T08:46:10.459059+0000","last_fullsized":"2024-04-25T08:46:10.459059+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:15.260790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454048+0000","last_change":"2024-04-25T08:46:09.478800+0000","last_active":"2024-04-25T08:46:10.454048+0000","last_peered":"2024-04-25T08:46:10.454048+0000","last_clean":"2024-04-25T08:46:10.454048+0000","last_became_active":"2024-04-25T08:46:09.478514+0000","last_became_peered":"2024-04-25T08:46:09.478514+0000","last_unstale":"2024-04-25T08:46:10.454048+0000","last_undegraded":"2024-04-25T08:46:10.454048+0000","last_fullsized":"2024-04-25T08:46:10.454048+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:43.473335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.469376+0000","last_change":"2024-04-25T08:46:09.483128+0000","last_active":"2024-04-25T08:46:10.469376+0000","last_peered":"2024-04-25T08:46:10.469376+0000","last_clean":"2024-04-25T08:46:10.469376+0000","last_became_active":"2024-04-25T08:46:09.481786+0000","last_became_peered":"2024-04-25T08:46:09.481786+0000","last_unstale":"2024-04-25T08:46:10.469376+0000","last_undegraded":"2024-04-25T08:46:10.469376+0000","last_fullsized":"2024-04-25T08:46:10.469376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:58.081613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458581+0000","last_change":"2024-04-25T08:46:09.475741+0000","last_active":"2024-04-25T08:46:10.458581+0000","last_peered":"2024-04-25T08:46:10.458581+0000","last_clean":"2024-04-25T08:46:10.458581+0000","last_became_active":"2024-04-25T08:46:09.475449+0000","last_became_peered":"2024-04-25T08:46:09.475449+0000","last_unstale":"2024-04-25T08:46:10.458581+0000","last_undegraded":"2024-04-25T08:46:10.458581+0000","last_fullsized":"2024-04-25T08:46:10.458581+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:18.581989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458455+0000","last_change":"2024-04-25T08:46:09.463090+0000","last_active":"2024-04-25T08:46:10.458455+0000","last_peered":"2024-04-25T08:46:10.458455+0000","last_clean":"2024-04-25T08:46:10.458455+0000","last_became_active":"2024-04-25T08:46:09.462813+0000","last_became_peered":"2024-04-25T08:46:09.462813+0000","last_unstale":"2024-04-25T08:46:10.458455+0000","last_undegraded":"2024-04-25T08:46:10.458455+0000","last_fullsized":"2024-04-25T08:46:10.458455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:42.016738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457697+0000","last_change":"2024-04-25T08:46:09.483923+0000","last_active":"2024-04-25T08:46:10.457697+0000","last_peered":"2024-04-25T08:46:10.457697+0000","last_clean":"2024-04-25T08:46:10.457697+0000","last_became_active":"2024-04-25T08:46:09.483627+0000","last_became_peered":"2024-04-25T08:46:09.483627+0000","last_unstale":"2024-04-25T08:46:10.457697+0000","last_undegraded":"2024-04-25T08:46:10.457697+0000","last_fullsized":"2024-04-25T08:46:10.457697+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:53.164023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458150+0000","last_change":"2024-04-25T08:46:09.470919+0000","last_active":"2024-04-25T08:46:10.458150+0000","last_peered":"2024-04-25T08:46:10.458150+0000","last_clean":"2024-04-25T08:46:10.458150+0000","last_became_active":"2024-04-25T08:46:09.470619+0000","last_became_peered":"2024-04-25T08:46:09.470619+0000","last_unstale":"2024-04-25T08:46:10.458150+0000","last_undegraded":"2024-04-25T08:46:10.458150+0000","last_fullsized":"2024-04-25T08:46:10.458150+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:51.554826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.469329+0000","last_change":"2024-04-25T08:46:09.474374+0000","last_active":"2024-04-25T08:46:10.469329+0000","last_peered":"2024-04-25T08:46:10.469329+0000","last_clean":"2024-04-25T08:46:10.469329+0000","last_became_active":"2024-04-25T08:46:09.474043+0000","last_became_peered":"2024-04-25T08:46:09.474043+0000","last_unstale":"2024-04-25T08:46:10.469329+0000","last_undegraded":"2024-04-25T08:46:10.469329+0000","last_fullsized":"2024-04-25T08:46:10.469329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:19.700804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.483500+0000","last_change":"2024-04-25T08:46:09.480821+0000","last_active":"2024-04-25T08:46:09.483500+0000","last_peered":"2024-04-25T08:46:09.483500+0000","last_clean":"2024-04-25T08:46:09.483500+0000","last_became_active":"2024-04-25T08:46:09.480522+0000","last_became_peered":"2024-04-25T08:46:09.480522+0000","last_unstale":"2024-04-25T08:46:09.483500+0000","last_undegraded":"2024-04-25T08:46:09.483500+0000","last_fullsized":"2024-04-25T08:46:09.483500+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:43.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458582+0000","last_change":"2024-04-25T08:46:09.470004+0000","last_active":"2024-04-25T08:46:10.458582+0000","last_peered":"2024-04-25T08:46:10.458582+0000","last_clean":"2024-04-25T08:46:10.458582+0000","last_became_active":"2024-04-25T08:46:09.469731+0000","last_became_peered":"2024-04-25T08:46:09.469731+0000","last_unstale":"2024-04-25T08:46:10.458582+0000","last_undegraded":"2024-04-25T08:46:10.458582+0000","last_fullsized":"2024-04-25T08:46:10.458582+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:58.453407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.477139+0000","last_change":"2024-04-25T08:46:09.472905+0000","last_active":"2024-04-25T08:46:09.477139+0000","last_peered":"2024-04-25T08:46:09.477139+0000","last_clean":"2024-04-25T08:46:09.477139+0000","last_became_active":"2024-04-25T08:46:09.472619+0000","last_became_peered":"2024-04-25T08:46:09.472619+0000","last_unstale":"2024-04-25T08:46:09.477139+0000","last_undegraded":"2024-04-25T08:46:09.477139+0000","last_fullsized":"2024-04-25T08:46:09.477139+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:37.549173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457640+0000","last_change":"2024-04-25T08:46:09.472285+0000","last_active":"2024-04-25T08:46:10.457640+0000","last_peered":"2024-04-25T08:46:10.457640+0000","last_clean":"2024-04-25T08:46:10.457640+0000","last_became_active":"2024-04-25T08:46:09.472015+0000","last_became_peered":"2024-04-25T08:46:09.472015+0000","last_unstale":"2024-04-25T08:46:10.457640+0000","last_undegraded":"2024-04-25T08:46:10.457640+0000","last_fullsized":"2024-04-25T08:46:10.457640+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:17.865423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.482762+0000","last_change":"2024-04-25T08:46:09.481401+0000","last_active":"2024-04-25T08:46:09.482762+0000","last_peered":"2024-04-25T08:46:09.482762+0000","last_clean":"2024-04-25T08:46:09.482762+0000","last_became_active":"2024-04-25T08:46:09.481157+0000","last_became_peered":"2024-04-25T08:46:09.481157+0000","last_unstale":"2024-04-25T08:46:09.482762+0000","last_undegraded":"2024-04-25T08:46:09.482762+0000","last_fullsized":"2024-04-25T08:46:09.482762+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:31.993328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.482683+0000","last_change":"2024-04-25T08:46:09.481273+0000","last_active":"2024-04-25T08:46:09.482683+0000","last_peered":"2024-04-25T08:46:09.482683+0000","last_clean":"2024-04-25T08:46:09.482683+0000","last_became_active":"2024-04-25T08:46:09.481009+0000","last_became_peered":"2024-04-25T08:46:09.481009+0000","last_unstale":"2024-04-25T08:46:09.482683+0000","last_undegraded":"2024-04-25T08:46:09.482683+0000","last_fullsized":"2024-04-25T08:46:09.482683+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:15.737958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458305+0000","last_change":"2024-04-25T08:46:09.477046+0000","last_active":"2024-04-25T08:46:10.458305+0000","last_peered":"2024-04-25T08:46:10.458305+0000","last_clean":"2024-04-25T08:46:10.458305+0000","last_became_active":"2024-04-25T08:46:09.474958+0000","last_became_peered":"2024-04-25T08:46:09.474958+0000","last_unstale":"2024-04-25T08:46:10.458305+0000","last_undegraded":"2024-04-25T08:46:10.458305+0000","last_fullsized":"2024-04-25T08:46:10.458305+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:30.729111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457800+0000","last_change":"2024-04-25T08:46:09.474286+0000","last_active":"2024-04-25T08:46:10.457800+0000","last_peered":"2024-04-25T08:46:10.457800+0000","last_clean":"2024-04-25T08:46:10.457800+0000","last_became_active":"2024-04-25T08:46:09.474023+0000","last_became_peered":"2024-04-25T08:46:09.474023+0000","last_unstale":"2024-04-25T08:46:10.457800+0000","last_undegraded":"2024-04-25T08:46:10.457800+0000","last_fullsized":"2024-04-25T08:46:10.457800+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:01.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458573+0000","last_change":"2024-04-25T08:46:09.464045+0000","last_active":"2024-04-25T08:46:10.458573+0000","last_peered":"2024-04-25T08:46:10.458573+0000","last_clean":"2024-04-25T08:46:10.458573+0000","last_became_active":"2024-04-25T08:46:09.463724+0000","last_became_peered":"2024-04-25T08:46:09.463724+0000","last_unstale":"2024-04-25T08:46:10.458573+0000","last_undegraded":"2024-04-25T08:46:10.458573+0000","last_fullsized":"2024-04-25T08:46:10.458573+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:58.750041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.474934+0000","last_change":"2024-04-25T08:46:09.473243+0000","last_active":"2024-04-25T08:46:09.474934+0000","last_peered":"2024-04-25T08:46:09.474934+0000","last_clean":"2024-04-25T08:46:09.474934+0000","last_became_active":"2024-04-25T08:46:09.472802+0000","last_became_peered":"2024-04-25T08:46:09.472802+0000","last_unstale":"2024-04-25T08:46:09.474934+0000","last_undegraded":"2024-04-25T08:46:09.474934+0000","last_fullsized":"2024-04-25T08:46:09.474934+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:58.750041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457565+0000","last_change":"2024-04-25T08:46:09.483220+0000","last_active":"2024-04-25T08:46:10.457565+0000","last_peered":"2024-04-25T08:46:10.457565+0000","last_clean":"2024-04-25T08:46:10.457565+0000","last_became_active":"2024-04-25T08:46:09.482924+0000","last_became_peered":"2024-04-25T08:46:09.482924+0000","last_unstale":"2024-04-25T08:46:10.457565+0000","last_undegraded":"2024-04-25T08:46:10.457565+0000","last_fullsized":"2024-04-25T08:46:10.457565+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.887243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458090+0000","last_change":"2024-04-25T08:46:09.464297+0000","last_active":"2024-04-25T08:46:10.458090+0000","last_peered":"2024-04-25T08:46:10.458090+0000","last_clean":"2024-04-25T08:46:10.458090+0000","last_became_active":"2024-04-25T08:46:09.463956+0000","last_became_peered":"2024-04-25T08:46:09.463956+0000","last_unstale":"2024-04-25T08:46:10.458090+0000","last_undegraded":"2024-04-25T08:46:10.458090+0000","last_fullsized":"2024-04-25T08:46:10.458090+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:32.056722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.453932+0000","last_change":"2024-04-25T08:46:09.465192+0000","last_active":"2024-04-25T08:46:10.453932+0000","last_peered":"2024-04-25T08:46:10.453932+0000","last_clean":"2024-04-25T08:46:10.453932+0000","last_became_active":"2024-04-25T08:46:09.464838+0000","last_became_peered":"2024-04-25T08:46:09.464838+0000","last_unstale":"2024-04-25T08:46:10.453932+0000","last_undegraded":"2024-04-25T08:46:10.453932+0000","last_fullsized":"2024-04-25T08:46:10.453932+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:01.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.488519+0000","last_change":"2024-04-25T08:46:08.465954+0000","last_active":"2024-04-25T08:46:09.488519+0000","last_peered":"2024-04-25T08:46:09.488519+0000","last_clean":"2024-04-25T08:46:09.488519+0000","last_became_active":"2024-04-25T08:46:08.465701+0000","last_became_peered":"2024-04-25T08:46:08.465701+0000","last_unstale":"2024-04-25T08:46:09.488519+0000","last_undegraded":"2024-04-25T08:46:09.488519+0000","last_fullsized":"2024-04-25T08:46:09.488519+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:31.052521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458736+0000","last_change":"2024-04-25T08:46:09.479070+0000","last_active":"2024-04-25T08:46:10.458736+0000","last_peered":"2024-04-25T08:46:10.458736+0000","last_clean":"2024-04-25T08:46:10.458736+0000","last_became_active":"2024-04-25T08:46:09.478796+0000","last_became_peered":"2024-04-25T08:46:09.478796+0000","last_unstale":"2024-04-25T08:46:10.458736+0000","last_undegraded":"2024-04-25T08:46:10.458736+0000","last_fullsized":"2024-04-25T08:46:10.458736+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:47.728427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454378+0000","last_change":"2024-04-25T08:46:08.459464+0000","last_active":"2024-04-25T08:46:10.454378+0000","last_peered":"2024-04-25T08:46:10.454378+0000","last_clean":"2024-04-25T08:46:10.454378+0000","last_became_active":"2024-04-25T08:46:08.459210+0000","last_became_peered":"2024-04-25T08:46:08.459210+0000","last_unstale":"2024-04-25T08:46:10.454378+0000","last_undegraded":"2024-04-25T08:46:10.454378+0000","last_fullsized":"2024-04-25T08:46:10.454378+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:21.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454309+0000","last_change":"2024-04-25T08:46:09.465772+0000","last_active":"2024-04-25T08:46:10.454309+0000","last_peered":"2024-04-25T08:46:10.454309+0000","last_clean":"2024-04-25T08:46:10.454309+0000","last_became_active":"2024-04-25T08:46:09.465512+0000","last_became_peered":"2024-04-25T08:46:09.465512+0000","last_unstale":"2024-04-25T08:46:10.454309+0000","last_undegraded":"2024-04-25T08:46:10.454309+0000","last_fullsized":"2024-04-25T08:46:10.454309+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:30.729111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454234+0000","last_change":"2024-04-25T08:46:08.464283+0000","last_active":"2024-04-25T08:46:10.454234+0000","last_peered":"2024-04-25T08:46:10.454234+0000","last_clean":"2024-04-25T08:46:10.454234+0000","last_became_active":"2024-04-25T08:46:08.464012+0000","last_became_peered":"2024-04-25T08:46:08.464012+0000","last_unstale":"2024-04-25T08:46:10.454234+0000","last_undegraded":"2024-04-25T08:46:10.454234+0000","last_fullsized":"2024-04-25T08:46:10.454234+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:44.066370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454137+0000","last_change":"2024-04-25T08:46:08.457421+0000","last_active":"2024-04-25T08:46:10.454137+0000","last_peered":"2024-04-25T08:46:10.454137+0000","last_clean":"2024-04-25T08:46:10.454137+0000","last_became_active":"2024-04-25T08:46:08.456967+0000","last_became_peered":"2024-04-25T08:46:08.456967+0000","last_unstale":"2024-04-25T08:46:10.454137+0000","last_undegraded":"2024-04-25T08:46:10.454137+0000","last_fullsized":"2024-04-25T08:46:10.454137+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:28.201753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.469344+0000","last_change":"2024-04-25T08:46:09.459551+0000","last_active":"2024-04-25T08:46:10.469344+0000","last_peered":"2024-04-25T08:46:10.469344+0000","last_clean":"2024-04-25T08:46:10.469344+0000","last_became_active":"2024-04-25T08:46:09.459268+0000","last_became_peered":"2024-04-25T08:46:09.459268+0000","last_unstale":"2024-04-25T08:46:10.469344+0000","last_undegraded":"2024-04-25T08:46:10.469344+0000","last_fullsized":"2024-04-25T08:46:10.469344+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:18.446253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.482650+0000","last_change":"2024-04-25T08:46:08.461313+0000","last_active":"2024-04-25T08:46:09.482650+0000","last_peered":"2024-04-25T08:46:09.482650+0000","last_clean":"2024-04-25T08:46:09.482650+0000","last_became_active":"2024-04-25T08:46:08.460904+0000","last_became_peered":"2024-04-25T08:46:08.460904+0000","last_unstale":"2024-04-25T08:46:09.482650+0000","last_undegraded":"2024-04-25T08:46:09.482650+0000","last_fullsized":"2024-04-25T08:46:09.482650+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:29.724910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.483541+0000","last_change":"2024-04-25T08:46:09.481881+0000","last_active":"2024-04-25T08:46:09.483541+0000","last_peered":"2024-04-25T08:46:09.483541+0000","last_clean":"2024-04-25T08:46:09.483541+0000","last_became_active":"2024-04-25T08:46:09.481590+0000","last_became_peered":"2024-04-25T08:46:09.481590+0000","last_unstale":"2024-04-25T08:46:09.483541+0000","last_undegraded":"2024-04-25T08:46:09.483541+0000","last_fullsized":"2024-04-25T08:46:09.483541+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.977157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.482686+0000","last_change":"2024-04-25T08:46:08.460314+0000","last_active":"2024-04-25T08:46:09.482686+0000","last_peered":"2024-04-25T08:46:09.482686+0000","last_clean":"2024-04-25T08:46:09.482686+0000","last_became_active":"2024-04-25T08:46:08.459870+0000","last_became_peered":"2024-04-25T08:46:08.459870+0000","last_unstale":"2024-04-25T08:46:09.482686+0000","last_undegraded":"2024-04-25T08:46:09.482686+0000","last_fullsized":"2024-04-25T08:46:09.482686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:52.159821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.452550+0000","last_change":"2024-04-25T08:46:08.463187+0000","last_active":"2024-04-25T08:46:09.452550+0000","last_peered":"2024-04-25T08:46:09.452550+0000","last_clean":"2024-04-25T08:46:09.452550+0000","last_became_active":"2024-04-25T08:46:08.462748+0000","last_became_peered":"2024-04-25T08:46:08.462748+0000","last_unstale":"2024-04-25T08:46:09.452550+0000","last_undegraded":"2024-04-25T08:46:09.452550+0000","last_fullsized":"2024-04-25T08:46:09.452550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:00.537947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.468782+0000","last_change":"2024-04-25T08:46:09.466224+0000","last_active":"2024-04-25T08:46:09.468782+0000","last_peered":"2024-04-25T08:46:09.468782+0000","last_clean":"2024-04-25T08:46:09.468782+0000","last_became_active":"2024-04-25T08:46:09.465937+0000","last_became_peered":"2024-04-25T08:46:09.465937+0000","last_unstale":"2024-04-25T08:46:09.468782+0000","last_undegraded":"2024-04-25T08:46:09.468782+0000","last_fullsized":"2024-04-25T08:46:09.468782+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:18.581989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:07.436528+0000","last_change":"2024-04-25T08:46:07.436528+0000","last_active":"2024-04-25T08:46:07.436528+0000","last_peered":"2024-04-25T08:46:07.436528+0000","last_clean":"2024-04-25T08:46:07.436528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:07.436528+0000","last_undegraded":"2024-04-25T08:46:07.436528+0000","last_fullsized":"2024-04-25T08:46:07.436528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.462909+0000","last_change":"2024-04-25T08:46:09.461398+0000","last_active":"2024-04-25T08:46:09.462909+0000","last_peered":"2024-04-25T08:46:09.462909+0000","last_clean":"2024-04-25T08:46:09.462909+0000","last_became_active":"2024-04-25T08:46:09.461126+0000","last_became_peered":"2024-04-25T08:46:09.461126+0000","last_unstale":"2024-04-25T08:46:09.462909+0000","last_undegraded":"2024-04-25T08:46:09.462909+0000","last_fullsized":"2024-04-25T08:46:09.462909+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:42.016738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:07.436528+0000","last_change":"2024-04-25T08:46:07.436528+0000","last_active":"2024-04-25T08:46:07.436528+0000","last_peered":"2024-04-25T08:46:07.436528+0000","last_clean":"2024-04-25T08:46:07.436528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:07.436528+0000","last_undegraded":"2024-04-25T08:46:07.436528+0000","last_fullsized":"2024-04-25T08:46:07.436528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.477105+0000","last_change":"2024-04-25T08:46:09.472531+0000","last_active":"2024-04-25T08:46:09.477105+0000","last_peered":"2024-04-25T08:46:09.477105+0000","last_clean":"2024-04-25T08:46:09.477105+0000","last_became_active":"2024-04-25T08:46:09.472198+0000","last_became_peered":"2024-04-25T08:46:09.472198+0000","last_unstale":"2024-04-25T08:46:09.477105+0000","last_undegraded":"2024-04-25T08:46:09.477105+0000","last_fullsized":"2024-04-25T08:46:09.477105+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:11.091254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458951+0000","last_change":"2024-04-25T08:46:08.460085+0000","last_active":"2024-04-25T08:46:10.458951+0000","last_peered":"2024-04-25T08:46:10.458951+0000","last_clean":"2024-04-25T08:46:10.458951+0000","last_became_active":"2024-04-25T08:46:08.459787+0000","last_became_peered":"2024-04-25T08:46:08.459787+0000","last_unstale":"2024-04-25T08:46:10.458951+0000","last_undegraded":"2024-04-25T08:46:10.458951+0000","last_fullsized":"2024-04-25T08:46:10.458951+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:55.191193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:07.436528+0000","last_change":"2024-04-25T08:46:07.436528+0000","last_active":"2024-04-25T08:46:07.436528+0000","last_peered":"2024-04-25T08:46:07.436528+0000","last_clean":"2024-04-25T08:46:07.436528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:07.436528+0000","last_undegraded":"2024-04-25T08:46:07.436528+0000","last_fullsized":"2024-04-25T08:46:07.436528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458756+0000","last_change":"2024-04-25T08:46:09.469334+0000","last_active":"2024-04-25T08:46:10.458756+0000","last_peered":"2024-04-25T08:46:10.458756+0000","last_clean":"2024-04-25T08:46:10.458756+0000","last_became_active":"2024-04-25T08:46:09.468764+0000","last_became_peered":"2024-04-25T08:46:09.468764+0000","last_unstale":"2024-04-25T08:46:10.458756+0000","last_undegraded":"2024-04-25T08:46:10.458756+0000","last_fullsized":"2024-04-25T08:46:10.458756+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:43.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.491051+0000","last_change":"2024-04-25T08:46:08.462088+0000","last_active":"2024-04-25T08:46:09.491051+0000","last_peered":"2024-04-25T08:46:09.491051+0000","last_clean":"2024-04-25T08:46:09.491051+0000","last_became_active":"2024-04-25T08:46:08.461759+0000","last_became_peered":"2024-04-25T08:46:08.461759+0000","last_unstale":"2024-04-25T08:46:09.491051+0000","last_undegraded":"2024-04-25T08:46:09.491051+0000","last_fullsized":"2024-04-25T08:46:09.491051+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:07.453472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457983+0000","last_change":"2024-04-25T08:46:09.475751+0000","last_active":"2024-04-25T08:46:10.457983+0000","last_peered":"2024-04-25T08:46:10.457983+0000","last_clean":"2024-04-25T08:46:10.457983+0000","last_became_active":"2024-04-25T08:46:09.475491+0000","last_became_peered":"2024-04-25T08:46:09.475491+0000","last_unstale":"2024-04-25T08:46:10.457983+0000","last_undegraded":"2024-04-25T08:46:10.457983+0000","last_fullsized":"2024-04-25T08:46:10.457983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:44.899105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:07.436528+0000","last_change":"2024-04-25T08:46:07.436528+0000","last_active":"2024-04-25T08:46:07.436528+0000","last_peered":"2024-04-25T08:46:07.436528+0000","last_clean":"2024-04-25T08:46:07.436528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:07.436528+0000","last_undegraded":"2024-04-25T08:46:07.436528+0000","last_fullsized":"2024-04-25T08:46:07.436528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457533+0000","last_change":"2024-04-25T08:46:09.473453+0000","last_active":"2024-04-25T08:46:10.457533+0000","last_peered":"2024-04-25T08:46:10.457533+0000","last_clean":"2024-04-25T08:46:10.457533+0000","last_became_active":"2024-04-25T08:46:09.472991+0000","last_became_peered":"2024-04-25T08:46:09.472991+0000","last_unstale":"2024-04-25T08:46:10.457533+0000","last_undegraded":"2024-04-25T08:46:10.457533+0000","last_fullsized":"2024-04-25T08:46:10.457533+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.548030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457777+0000","last_change":"2024-04-25T08:46:08.458750+0000","last_active":"2024-04-25T08:46:10.457777+0000","last_peered":"2024-04-25T08:46:10.457777+0000","last_clean":"2024-04-25T08:46:10.457777+0000","last_became_active":"2024-04-25T08:46:08.458317+0000","last_became_peered":"2024-04-25T08:46:08.458317+0000","last_unstale":"2024-04-25T08:46:10.457777+0000","last_undegraded":"2024-04-25T08:46:10.457777+0000","last_fullsized":"2024-04-25T08:46:10.457777+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:43.402285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:07.436528+0000","last_change":"2024-04-25T08:46:07.436528+0000","last_active":"2024-04-25T08:46:07.436528+0000","last_peered":"2024-04-25T08:46:07.436528+0000","last_clean":"2024-04-25T08:46:07.436528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:07.436528+0000","last_undegraded":"2024-04-25T08:46:07.436528+0000","last_fullsized":"2024-04-25T08:46:07.436528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.486320+0000","last_change":"2024-04-25T08:46:09.485561+0000","last_active":"2024-04-25T08:46:09.486320+0000","last_peered":"2024-04-25T08:46:09.486320+0000","last_clean":"2024-04-25T08:46:09.486320+0000","last_became_active":"2024-04-25T08:46:09.485210+0000","last_became_peered":"2024-04-25T08:46:09.485210+0000","last_unstale":"2024-04-25T08:46:09.486320+0000","last_undegraded":"2024-04-25T08:46:09.486320+0000","last_fullsized":"2024-04-25T08:46:09.486320+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:15.260790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458105+0000","last_change":"2024-04-25T08:46:08.466405+0000","last_active":"2024-04-25T08:46:10.458105+0000","last_peered":"2024-04-25T08:46:10.458105+0000","last_clean":"2024-04-25T08:46:10.458105+0000","last_became_active":"2024-04-25T08:46:08.466145+0000","last_became_peered":"2024-04-25T08:46:08.466145+0000","last_unstale":"2024-04-25T08:46:10.458105+0000","last_undegraded":"2024-04-25T08:46:10.458105+0000","last_fullsized":"2024-04-25T08:46:10.458105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:48.476518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457572+0000","last_change":"2024-04-25T08:46:08.458502+0000","last_active":"2024-04-25T08:46:10.457572+0000","last_peered":"2024-04-25T08:46:10.457572+0000","last_clean":"2024-04-25T08:46:10.457572+0000","last_became_active":"2024-04-25T08:46:08.457457+0000","last_became_peered":"2024-04-25T08:46:08.457457+0000","last_unstale":"2024-04-25T08:46:10.457572+0000","last_undegraded":"2024-04-25T08:46:10.457572+0000","last_fullsized":"2024-04-25T08:46:10.457572+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:01.282573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:07.436528+0000","last_change":"2024-04-25T08:46:07.436528+0000","last_active":"2024-04-25T08:46:07.436528+0000","last_peered":"2024-04-25T08:46:07.436528+0000","last_clean":"2024-04-25T08:46:07.436528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:07.436528+0000","last_undegraded":"2024-04-25T08:46:07.436528+0000","last_fullsized":"2024-04-25T08:46:07.436528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458842+0000","last_change":"2024-04-25T08:46:09.465621+0000","last_active":"2024-04-25T08:46:10.458842+0000","last_peered":"2024-04-25T08:46:10.458842+0000","last_clean":"2024-04-25T08:46:10.458842+0000","last_became_active":"2024-04-25T08:46:09.465356+0000","last_became_peered":"2024-04-25T08:46:09.465356+0000","last_unstale":"2024-04-25T08:46:10.458842+0000","last_undegraded":"2024-04-25T08:46:10.458842+0000","last_fullsized":"2024-04-25T08:46:10.458842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.977157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:07.436528+0000","last_change":"2024-04-25T08:46:07.436528+0000","last_active":"2024-04-25T08:46:07.436528+0000","last_peered":"2024-04-25T08:46:07.436528+0000","last_clean":"2024-04-25T08:46:07.436528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:07.436528+0000","last_undegraded":"2024-04-25T08:46:07.436528+0000","last_fullsized":"2024-04-25T08:46:07.436528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.452904+0000","last_change":"2024-04-25T08:46:08.462833+0000","last_active":"2024-04-25T08:46:09.452904+0000","last_peered":"2024-04-25T08:46:09.452904+0000","last_clean":"2024-04-25T08:46:09.452904+0000","last_became_active":"2024-04-25T08:46:08.462565+0000","last_became_peered":"2024-04-25T08:46:08.462565+0000","last_unstale":"2024-04-25T08:46:09.452904+0000","last_undegraded":"2024-04-25T08:46:09.452904+0000","last_fullsized":"2024-04-25T08:46:09.452904+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:50.550625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454008+0000","last_change":"2024-04-25T08:46:09.466269+0000","last_active":"2024-04-25T08:46:10.454008+0000","last_peered":"2024-04-25T08:46:10.454008+0000","last_clean":"2024-04-25T08:46:10.454008+0000","last_became_active":"2024-04-25T08:46:09.465943+0000","last_became_peered":"2024-04-25T08:46:09.465943+0000","last_unstale":"2024-04-25T08:46:10.454008+0000","last_undegraded":"2024-04-25T08:46:10.454008+0000","last_fullsized":"2024-04-25T08:46:10.454008+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:51.441413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454070+0000","last_change":"2024-04-25T08:46:08.457924+0000","last_active":"2024-04-25T08:46:10.454070+0000","last_peered":"2024-04-25T08:46:10.454070+0000","last_clean":"2024-04-25T08:46:10.454070+0000","last_became_active":"2024-04-25T08:46:08.457677+0000","last_became_peered":"2024-04-25T08:46:08.457677+0000","last_unstale":"2024-04-25T08:46:10.454070+0000","last_undegraded":"2024-04-25T08:46:10.454070+0000","last_fullsized":"2024-04-25T08:46:10.454070+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:20.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458077+0000","last_change":"2024-04-25T08:46:09.473203+0000","last_active":"2024-04-25T08:46:10.458077+0000","last_peered":"2024-04-25T08:46:10.458077+0000","last_clean":"2024-04-25T08:46:10.458077+0000","last_became_active":"2024-04-25T08:46:09.472683+0000","last_became_peered":"2024-04-25T08:46:09.472683+0000","last_unstale":"2024-04-25T08:46:10.458077+0000","last_undegraded":"2024-04-25T08:46:10.458077+0000","last_fullsized":"2024-04-25T08:46:10.458077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:51.441413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457852+0000","last_change":"2024-04-25T08:46:08.458266+0000","last_active":"2024-04-25T08:46:10.457852+0000","last_peered":"2024-04-25T08:46:10.457852+0000","last_clean":"2024-04-25T08:46:10.457852+0000","last_became_active":"2024-04-25T08:46:08.457829+0000","last_became_peered":"2024-04-25T08:46:08.457829+0000","last_unstale":"2024-04-25T08:46:10.457852+0000","last_undegraded":"2024-04-25T08:46:10.457852+0000","last_fullsized":"2024-04-25T08:46:10.457852+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:44.412450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.453885+0000","last_change":"2024-04-25T08:46:08.463608+0000","last_active":"2024-04-25T08:46:10.453885+0000","last_peered":"2024-04-25T08:46:10.453885+0000","last_clean":"2024-04-25T08:46:10.453885+0000","last_became_active":"2024-04-25T08:46:08.463283+0000","last_became_peered":"2024-04-25T08:46:08.463283+0000","last_unstale":"2024-04-25T08:46:10.453885+0000","last_undegraded":"2024-04-25T08:46:10.453885+0000","last_fullsized":"2024-04-25T08:46:10.453885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:33.552339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454185+0000","last_change":"2024-04-25T08:46:09.476456+0000","last_active":"2024-04-25T08:46:10.454185+0000","last_peered":"2024-04-25T08:46:10.454185+0000","last_clean":"2024-04-25T08:46:10.454185+0000","last_became_active":"2024-04-25T08:46:09.476211+0000","last_became_peered":"2024-04-25T08:46:09.476211+0000","last_unstale":"2024-04-25T08:46:10.454185+0000","last_undegraded":"2024-04-25T08:46:10.454185+0000","last_fullsized":"2024-04-25T08:46:10.454185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:51.554826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458537+0000","last_change":"2024-04-25T08:46:08.463898+0000","last_active":"2024-04-25T08:46:10.458537+0000","last_peered":"2024-04-25T08:46:10.458537+0000","last_clean":"2024-04-25T08:46:10.458537+0000","last_became_active":"2024-04-25T08:46:08.463280+0000","last_became_peered":"2024-04-25T08:46:08.463280+0000","last_unstale":"2024-04-25T08:46:10.458537+0000","last_undegraded":"2024-04-25T08:46:10.458537+0000","last_fullsized":"2024-04-25T08:46:10.458537+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:48.146293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.469568+0000","last_change":"2024-04-25T08:46:09.464793+0000","last_active":"2024-04-25T08:46:10.469568+0000","last_peered":"2024-04-25T08:46:10.469568+0000","last_clean":"2024-04-25T08:46:10.469568+0000","last_became_active":"2024-04-25T08:46:09.464523+0000","last_became_peered":"2024-04-25T08:46:09.464523+0000","last_unstale":"2024-04-25T08:46:10.469568+0000","last_undegraded":"2024-04-25T08:46:10.469568+0000","last_fullsized":"2024-04-25T08:46:10.469568+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:25.457187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"65'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.468951+0000","last_change":"2024-04-25T08:46:08.456375+0000","last_active":"2024-04-25T08:46:10.468951+0000","last_peered":"2024-04-25T08:46:10.468951+0000","last_clean":"2024-04-25T08:46:10.468951+0000","last_became_active":"2024-04-25T08:46:08.455997+0000","last_became_peered":"2024-04-25T08:46:08.455997+0000","last_unstale":"2024-04-25T08:46:10.468951+0000","last_undegraded":"2024-04-25T08:46:10.468951+0000","last_fullsized":"2024-04-25T08:46:10.468951+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:42.719562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458033+0000","last_change":"2024-04-25T08:46:09.473466+0000","last_active":"2024-04-25T08:46:10.458033+0000","last_peered":"2024-04-25T08:46:10.458033+0000","last_clean":"2024-04-25T08:46:10.458033+0000","last_became_active":"2024-04-25T08:46:09.473161+0000","last_became_peered":"2024-04-25T08:46:09.473161+0000","last_unstale":"2024-04-25T08:46:10.458033+0000","last_undegraded":"2024-04-25T08:46:10.458033+0000","last_fullsized":"2024-04-25T08:46:10.458033+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:43.473335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454301+0000","last_change":"2024-04-25T08:46:08.462841+0000","last_active":"2024-04-25T08:46:10.454301+0000","last_peered":"2024-04-25T08:46:10.454301+0000","last_clean":"2024-04-25T08:46:10.454301+0000","last_became_active":"2024-04-25T08:46:08.462289+0000","last_became_peered":"2024-04-25T08:46:08.462289+0000","last_unstale":"2024-04-25T08:46:10.454301+0000","last_undegraded":"2024-04-25T08:46:10.454301+0000","last_fullsized":"2024-04-25T08:46:10.454301+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:11.524534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.457615+0000","last_change":"2024-04-25T08:46:08.461792+0000","last_active":"2024-04-25T08:46:09.457615+0000","last_peered":"2024-04-25T08:46:09.457615+0000","last_clean":"2024-04-25T08:46:09.457615+0000","last_became_active":"2024-04-25T08:46:08.461441+0000","last_became_peered":"2024-04-25T08:46:08.461441+0000","last_unstale":"2024-04-25T08:46:09.457615+0000","last_undegraded":"2024-04-25T08:46:09.457615+0000","last_fullsized":"2024-04-25T08:46:09.457615+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:43.894904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:07.436528+0000","last_change":"2024-04-25T08:46:07.436528+0000","last_active":"2024-04-25T08:46:07.436528+0000","last_peered":"2024-04-25T08:46:07.436528+0000","last_clean":"2024-04-25T08:46:07.436528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:07.436528+0000","last_undegraded":"2024-04-25T08:46:07.436528+0000","last_fullsized":"2024-04-25T08:46:07.436528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458312+0000","last_change":"2024-04-25T08:46:09.485797+0000","last_active":"2024-04-25T08:46:10.458312+0000","last_peered":"2024-04-25T08:46:10.458312+0000","last_clean":"2024-04-25T08:46:10.458312+0000","last_became_active":"2024-04-25T08:46:09.485336+0000","last_became_peered":"2024-04-25T08:46:09.485336+0000","last_unstale":"2024-04-25T08:46:10.458312+0000","last_undegraded":"2024-04-25T08:46:10.458312+0000","last_fullsized":"2024-04-25T08:46:10.458312+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:58.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.452753+0000","last_change":"2024-04-25T08:46:08.458469+0000","last_active":"2024-04-25T08:46:09.452753+0000","last_peered":"2024-04-25T08:46:09.452753+0000","last_clean":"2024-04-25T08:46:09.452753+0000","last_became_active":"2024-04-25T08:46:08.458204+0000","last_became_peered":"2024-04-25T08:46:08.458204+0000","last_unstale":"2024-04-25T08:46:09.452753+0000","last_undegraded":"2024-04-25T08:46:09.452753+0000","last_fullsized":"2024-04-25T08:46:09.452753+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:50.437212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.482386+0000","last_change":"2024-04-25T08:46:09.474590+0000","last_active":"2024-04-25T08:46:09.482386+0000","last_peered":"2024-04-25T08:46:09.482386+0000","last_clean":"2024-04-25T08:46:09.482386+0000","last_became_active":"2024-04-25T08:46:09.474237+0000","last_became_peered":"2024-04-25T08:46:09.474237+0000","last_unstale":"2024-04-25T08:46:09.482386+0000","last_undegraded":"2024-04-25T08:46:09.482386+0000","last_fullsized":"2024-04-25T08:46:09.482386+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:58.453407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.452759+0000","last_change":"2024-04-25T08:46:08.462393+0000","last_active":"2024-04-25T08:46:09.452759+0000","last_peered":"2024-04-25T08:46:09.452759+0000","last_clean":"2024-04-25T08:46:09.452759+0000","last_became_active":"2024-04-25T08:46:08.462141+0000","last_became_peered":"2024-04-25T08:46:08.462141+0000","last_unstale":"2024-04-25T08:46:09.452759+0000","last_undegraded":"2024-04-25T08:46:09.452759+0000","last_fullsized":"2024-04-25T08:46:09.452759+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:42.469134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.469391+0000","last_change":"2024-04-25T08:46:09.474080+0000","last_active":"2024-04-25T08:46:10.469391+0000","last_peered":"2024-04-25T08:46:10.469391+0000","last_clean":"2024-04-25T08:46:10.469391+0000","last_became_active":"2024-04-25T08:46:09.473731+0000","last_became_peered":"2024-04-25T08:46:09.473731+0000","last_unstale":"2024-04-25T08:46:10.469391+0000","last_undegraded":"2024-04-25T08:46:10.469391+0000","last_fullsized":"2024-04-25T08:46:10.469391+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:19.427792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.457234+0000","last_change":"2024-04-25T08:46:08.455975+0000","last_active":"2024-04-25T08:46:09.457234+0000","last_peered":"2024-04-25T08:46:09.457234+0000","last_clean":"2024-04-25T08:46:09.457234+0000","last_became_active":"2024-04-25T08:46:08.455667+0000","last_became_peered":"2024-04-25T08:46:08.455667+0000","last_unstale":"2024-04-25T08:46:09.457234+0000","last_undegraded":"2024-04-25T08:46:09.457234+0000","last_fullsized":"2024-04-25T08:46:09.457234+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:02.428018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:08.440729+0000","last_change":"2024-04-25T08:46:08.440729+0000","last_active":"2024-04-25T08:46:08.440729+0000","last_peered":"2024-04-25T08:46:08.440729+0000","last_clean":"2024-04-25T08:46:08.440729+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:08.440729+0000","last_undegraded":"2024-04-25T08:46:08.440729+0000","last_fullsized":"2024-04-25T08:46:08.440729+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.452467+0000","last_change":"2024-04-25T08:46:08.461253+0000","last_active":"2024-04-25T08:46:09.452467+0000","last_peered":"2024-04-25T08:46:09.452467+0000","last_clean":"2024-04-25T08:46:09.452467+0000","last_became_active":"2024-04-25T08:46:08.460969+0000","last_became_peered":"2024-04-25T08:46:08.460969+0000","last_unstale":"2024-04-25T08:46:09.452467+0000","last_undegraded":"2024-04-25T08:46:09.452467+0000","last_fullsized":"2024-04-25T08:46:09.452467+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:16.861222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":246,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-04-25T08:46:06.249351+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:46:06.249351+0000","last_peered":"2024-04-25T08:46:06.249351+0000","last_clean":"2024-04-25T08:46:06.249351+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:46:06.249351+0000","last_undegraded":"2024-04-25T08:46:06.249351+0000","last_fullsized":"2024-04-25T08:46:06.249351+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":6},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2216,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1318912,"data_stored":915008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36064,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":737280,"data_stored":330159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36104,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335736,"statfs":{"total":96636764160,"available":96599793664,"internally_reserved":0,"allocated":778240,"data_stored":350216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36112,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335728,"statfs":{"total":96636764160,"available":96599785472,"internally_reserved":0,"allocated":786432,"data_stored":351806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36104,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335736,"statfs":{"total":96636764160,"available":96599793664,"internally_reserved":0,"allocated":774144,"data_stored":350194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36096,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335744,"statfs":{"total":96636764160,"available":96599801856,"internally_reserved":0,"allocated":774144,"data_stored":350194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":802816,"data_stored":352570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36676,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335164,"statfs":{"total":96636764160,"available":96599207936,"internally_reserved":0,"allocated":1368064,"data_stored":940562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:46:12.411 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:46:12.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.553+0000 7f26b055a640 1 Processor -- start 2024-04-25T08:46:12.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.553+0000 7f26b055a640 1 -- start start 2024-04-25T08:46:12.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26b055a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a8155fe0 0x7f26a815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26b055a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f26a80721d0 0x7f26a806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26b055a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a806de40 con 0x7f26a80adbc0 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26b055a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a80ad0e0 con 0x7f26a80721d0 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26b055a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80ad3c0 con 0x7f26a8155fe0 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26aeaf7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f26a80721d0 0x7f26a806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26aeaf7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f26a80721d0 0x7f26a806abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59262/0 (socket says 172.21.15.172:59262) 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26aeaf7640 1 -- 172.21.15.172:0/3885249545 learned_addr learned my addr 172.21.15.172:0/3885249545 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26ae2f6640 1 --2- 172.21.15.172:0/3885249545 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a8155fe0 0x7f26a815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26aeaf7640 1 -- 172.21.15.172:0/3885249545 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a8155fe0 msgr2=0x7f26a815c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26aeaf7640 1 --2- 172.21.15.172:0/3885249545 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a8155fe0 0x7f26a815c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26aeaf7640 1 -- 172.21.15.172:0/3885249545 >> v1:172.21.15.186:6789/0 conn(0x7f26a80adbc0 legacy=0x7f26a8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26aeaf7640 1 -- 172.21.15.172:0/3885249545 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a80ad6a0 con 0x7f26a80721d0 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.554+0000 7f26ae2f6640 1 --2- 172.21.15.172:0/3885249545 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a8155fe0 0x7f26a815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.555+0000 7f26aeaf7640 1 --2- 172.21.15.172:0/3885249545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a80721d0 0x7f26a806abe0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009e50 tx=0x7f26a002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbc8dece922122f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:12.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.555+0000 7f26ad2f4640 1 -- 172.21.15.172:0/3885249545 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a0036070 con 0x7f26a80721d0 2024-04-25T08:46:12.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.555+0000 7f26ad2f4640 1 -- 172.21.15.172:0/3885249545 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a0031600 con 0x7f26a80721d0 2024-04-25T08:46:12.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.555+0000 7f26ad2f4640 1 -- 172.21.15.172:0/3885249545 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a00319d0 con 0x7f26a80721d0 2024-04-25T08:46:12.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.556+0000 7f26b055a640 1 -- 172.21.15.172:0/3885249545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a80721d0 msgr2=0x7f26a806abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.556+0000 7f26b055a640 1 --2- 172.21.15.172:0/3885249545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a80721d0 0x7f26a806abe0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009e50 tx=0x7f26a002a6c0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.556+0000 7f26b055a640 1 -- 172.21.15.172:0/3885249545 shutdown_connections 2024-04-25T08:46:12.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.556+0000 7f26b055a640 1 --2- 172.21.15.172:0/3885249545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a80721d0 0x7f26a806abe0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.556+0000 7f26b055a640 1 --2- 172.21.15.172:0/3885249545 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a8155fe0 0x7f26a815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.556+0000 7f26b055a640 1 -- 172.21.15.172:0/3885249545 >> 172.21.15.172:0/3885249545 conn(0x7f26a80af670 msgr2=0x7f26a80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:12.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.556+0000 7f26b055a640 1 -- 172.21.15.172:0/3885249545 shutdown_connections 2024-04-25T08:46:12.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.556+0000 7f26b055a640 1 -- 172.21.15.172:0/3885249545 wait complete. 2024-04-25T08:46:12.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.557+0000 7f26b055a640 1 Processor -- start 2024-04-25T08:46:12.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.557+0000 7f26b055a640 1 -- start start 2024-04-25T08:46:12.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26b055a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a80adbc0 0x7f26a809c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26b055a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a8155fe0 0x7f26a8099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26b055a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a809a810 0x7f26a80cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26b055a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a806fa00 con 0x7f26a8155fe0 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26b055a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a806f880 con 0x7f26a809a810 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26b055a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80ae020 con 0x7f26a80adbc0 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26adaf5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a8155fe0 0x7f26a8099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26adaf5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a8155fe0 0x7f26a8099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59270/0 (socket says 172.21.15.172:59270) 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26adaf5640 1 -- 172.21.15.172:0/2465817466 learned_addr learned my addr 172.21.15.172:0/2465817466 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26ae2f6640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a80adbc0 0x7f26a809c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26aeaf7640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a809a810 0x7f26a80cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26adaf5640 1 -- 172.21.15.172:0/2465817466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a80adbc0 msgr2=0x7f26a809c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26adaf5640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a80adbc0 0x7f26a809c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26adaf5640 1 -- 172.21.15.172:0/2465817466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a809a810 msgr2=0x7f26a80cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26adaf5640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a809a810 0x7f26a80cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26adaf5640 1 -- 172.21.15.172:0/2465817466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a809db10 con 0x7f26a8155fe0 2024-04-25T08:46:12.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26ae2f6640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a80adbc0 0x7f26a809c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:12.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.558+0000 7f26adaf5640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a8155fe0 0x7f26a8099a40 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f269800c430 tx=0x7f269800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:12.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.559+0000 7f269effd640 1 -- 172.21.15.172:0/2465817466 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698011790 con 0x7f26a8155fe0 2024-04-25T08:46:12.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.559+0000 7f269effd640 1 -- 172.21.15.172:0/2465817466 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2698017070 con 0x7f26a8155fe0 2024-04-25T08:46:12.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.559+0000 7f26b055a640 1 -- 172.21.15.172:0/2465817466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a809ca70 con 0x7f26a8155fe0 2024-04-25T08:46:12.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.559+0000 7f269effd640 1 -- 172.21.15.172:0/2465817466 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698011bb0 con 0x7f26a8155fe0 2024-04-25T08:46:12.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.559+0000 7f26b055a640 1 -- 172.21.15.172:0/2465817466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a809d030 con 0x7f26a8155fe0 2024-04-25T08:46:12.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.560+0000 7f26b055a640 1 -- 172.21.15.172:0/2465817466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a809d800 con 0x7f26a8155fe0 2024-04-25T08:46:12.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.560+0000 7f269effd640 1 -- 172.21.15.172:0/2465817466 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f269801c460 con 0x7f26a8155fe0 2024-04-25T08:46:12.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.561+0000 7f269effd640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f268c06b4d0 0x7f268c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.561+0000 7f26ae2f6640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f268c06b4d0 0x7f268c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.561+0000 7f269effd640 1 -- 172.21.15.172:0/2465817466 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f269808a1c0 con 0x7f26a8155fe0 2024-04-25T08:46:12.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.561+0000 7f26ae2f6640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f268c06b4d0 0x7f268c06d990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f26a400a990 tx=0x7f26a4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:12.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.565+0000 7f269effd640 1 -- 172.21.15.172:0/2465817466 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2698058f40 con 0x7f26a8155fe0 2024-04-25T08:46:12.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.732+0000 7f26b055a640 1 -- 172.21.15.172:0/2465817466 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26a8073990 con 0x7f268c06b4d0 2024-04-25T08:46:12.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.738+0000 7f269effd640 1 -- 172.21.15.172:0/2465817466 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252004 (secure 0 0 0) 0x7f26a8073990 con 0x7f268c06b4d0 2024-04-25T08:46:12.732 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:12.733 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:46:12.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 -- 172.21.15.172:0/2465817466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f268c06b4d0 msgr2=0x7f268c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f268c06b4d0 0x7f268c06d990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f26a400a990 tx=0x7f26a4008040 comp rx=0 tx=0).stop 2024-04-25T08:46:12.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 -- 172.21.15.172:0/2465817466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a8155fe0 msgr2=0x7f26a8099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a8155fe0 0x7f26a8099a40 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f269800c430 tx=0x7f269800c8f0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 -- 172.21.15.172:0/2465817466 shutdown_connections 2024-04-25T08:46:12.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f268c06b4d0 0x7f268c06d990 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26a809a810 0x7f26a80cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26a8155fe0 0x7f26a8099a40 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 --2- 172.21.15.172:0/2465817466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26a80adbc0 0x7f26a809c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 -- 172.21.15.172:0/2465817466 >> 172.21.15.172:0/2465817466 conn(0x7f26a80721d0 msgr2=0x7f26a815aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:12.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 -- 172.21.15.172:0/2465817466 shutdown_connections 2024-04-25T08:46:12.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.741+0000 7f26b055a640 1 -- 172.21.15.172:0/2465817466 wait complete. 2024-04-25T08:46:12.744 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-04-25T08:46:12.558430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":290040,"kb_used_data":7296,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754684680,"statfs":{"total":773094113280,"available":772797112320,"internally_reserved":0,"allocated":7471104,"data_stored":4000492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.116912"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.483026+0000","last_change":"2024-04-25T08:46:09.475983+0000","last_active":"2024-04-25T08:46:09.483026+0000","last_peered":"2024-04-25T08:46:09.483026+0000","last_clean":"2024-04-25T08:46:09.483026+0000","last_became_active":"2024-04-25T08:46:09.475661+0000","last_became_peered":"2024-04-25T08:46:09.475661+0000","last_unstale":"2024-04-25T08:46:09.483026+0000","last_undegraded":"2024-04-25T08:46:09.483026+0000","last_fullsized":"2024-04-25T08:46:09.483026+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:47.728427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.462507+0000","last_change":"2024-04-25T08:46:09.460878+0000","last_active":"2024-04-25T08:46:09.462507+0000","last_peered":"2024-04-25T08:46:09.462507+0000","last_clean":"2024-04-25T08:46:09.462507+0000","last_became_active":"2024-04-25T08:46:09.460586+0000","last_became_peered":"2024-04-25T08:46:09.460586+0000","last_unstale":"2024-04-25T08:46:09.462507+0000","last_undegraded":"2024-04-25T08:46:09.462507+0000","last_fullsized":"2024-04-25T08:46:09.462507+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:58.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951613+0000","last_change":"2024-04-25T08:46:09.482107+0000","last_active":"2024-04-25T08:46:10.951613+0000","last_peered":"2024-04-25T08:46:10.951613+0000","last_clean":"2024-04-25T08:46:10.951613+0000","last_became_active":"2024-04-25T08:46:09.481670+0000","last_became_peered":"2024-04-25T08:46:09.481670+0000","last_unstale":"2024-04-25T08:46:10.951613+0000","last_undegraded":"2024-04-25T08:46:10.951613+0000","last_fullsized":"2024-04-25T08:46:10.951613+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:17.865423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.459059+0000","last_change":"2024-04-25T08:46:09.470919+0000","last_active":"2024-04-25T08:46:10.459059+0000","last_peered":"2024-04-25T08:46:10.459059+0000","last_clean":"2024-04-25T08:46:10.459059+0000","last_became_active":"2024-04-25T08:46:09.470656+0000","last_became_peered":"2024-04-25T08:46:09.470656+0000","last_unstale":"2024-04-25T08:46:10.459059+0000","last_undegraded":"2024-04-25T08:46:10.459059+0000","last_fullsized":"2024-04-25T08:46:10.459059+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:15.260790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950822+0000","last_change":"2024-04-25T08:46:09.481999+0000","last_active":"2024-04-25T08:46:10.950822+0000","last_peered":"2024-04-25T08:46:10.950822+0000","last_clean":"2024-04-25T08:46:10.950822+0000","last_became_active":"2024-04-25T08:46:09.481725+0000","last_became_peered":"2024-04-25T08:46:09.481725+0000","last_unstale":"2024-04-25T08:46:10.950822+0000","last_undegraded":"2024-04-25T08:46:10.950822+0000","last_fullsized":"2024-04-25T08:46:10.950822+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:47.728427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454048+0000","last_change":"2024-04-25T08:46:09.478800+0000","last_active":"2024-04-25T08:46:10.454048+0000","last_peered":"2024-04-25T08:46:10.454048+0000","last_clean":"2024-04-25T08:46:10.454048+0000","last_became_active":"2024-04-25T08:46:09.478514+0000","last_became_peered":"2024-04-25T08:46:09.478514+0000","last_unstale":"2024-04-25T08:46:10.454048+0000","last_undegraded":"2024-04-25T08:46:10.454048+0000","last_fullsized":"2024-04-25T08:46:10.454048+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:43.473335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.469376+0000","last_change":"2024-04-25T08:46:09.483128+0000","last_active":"2024-04-25T08:46:10.469376+0000","last_peered":"2024-04-25T08:46:10.469376+0000","last_clean":"2024-04-25T08:46:10.469376+0000","last_became_active":"2024-04-25T08:46:09.481786+0000","last_became_peered":"2024-04-25T08:46:09.481786+0000","last_unstale":"2024-04-25T08:46:10.469376+0000","last_undegraded":"2024-04-25T08:46:10.469376+0000","last_fullsized":"2024-04-25T08:46:10.469376+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:58.081613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458581+0000","last_change":"2024-04-25T08:46:09.475741+0000","last_active":"2024-04-25T08:46:10.458581+0000","last_peered":"2024-04-25T08:46:10.458581+0000","last_clean":"2024-04-25T08:46:10.458581+0000","last_became_active":"2024-04-25T08:46:09.475449+0000","last_became_peered":"2024-04-25T08:46:09.475449+0000","last_unstale":"2024-04-25T08:46:10.458581+0000","last_undegraded":"2024-04-25T08:46:10.458581+0000","last_fullsized":"2024-04-25T08:46:10.458581+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:18.581989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951441+0000","last_change":"2024-04-25T08:46:09.477309+0000","last_active":"2024-04-25T08:46:10.951441+0000","last_peered":"2024-04-25T08:46:10.951441+0000","last_clean":"2024-04-25T08:46:10.951441+0000","last_became_active":"2024-04-25T08:46:09.477024+0000","last_became_peered":"2024-04-25T08:46:09.477024+0000","last_unstale":"2024-04-25T08:46:10.951441+0000","last_undegraded":"2024-04-25T08:46:10.951441+0000","last_fullsized":"2024-04-25T08:46:10.951441+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.548030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951080+0000","last_change":"2024-04-25T08:46:09.472223+0000","last_active":"2024-04-25T08:46:10.951080+0000","last_peered":"2024-04-25T08:46:10.951080+0000","last_clean":"2024-04-25T08:46:10.951080+0000","last_became_active":"2024-04-25T08:46:09.471947+0000","last_became_peered":"2024-04-25T08:46:09.471947+0000","last_unstale":"2024-04-25T08:46:10.951080+0000","last_undegraded":"2024-04-25T08:46:10.951080+0000","last_fullsized":"2024-04-25T08:46:10.951080+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:21.965129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458455+0000","last_change":"2024-04-25T08:46:09.463090+0000","last_active":"2024-04-25T08:46:10.458455+0000","last_peered":"2024-04-25T08:46:10.458455+0000","last_clean":"2024-04-25T08:46:10.458455+0000","last_became_active":"2024-04-25T08:46:09.462813+0000","last_became_peered":"2024-04-25T08:46:09.462813+0000","last_unstale":"2024-04-25T08:46:10.458455+0000","last_undegraded":"2024-04-25T08:46:10.458455+0000","last_fullsized":"2024-04-25T08:46:10.458455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:42.016738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457697+0000","last_change":"2024-04-25T08:46:09.483923+0000","last_active":"2024-04-25T08:46:10.457697+0000","last_peered":"2024-04-25T08:46:10.457697+0000","last_clean":"2024-04-25T08:46:10.457697+0000","last_became_active":"2024-04-25T08:46:09.483627+0000","last_became_peered":"2024-04-25T08:46:09.483627+0000","last_unstale":"2024-04-25T08:46:10.457697+0000","last_undegraded":"2024-04-25T08:46:10.457697+0000","last_fullsized":"2024-04-25T08:46:10.457697+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:53.164023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458150+0000","last_change":"2024-04-25T08:46:09.470919+0000","last_active":"2024-04-25T08:46:10.458150+0000","last_peered":"2024-04-25T08:46:10.458150+0000","last_clean":"2024-04-25T08:46:10.458150+0000","last_became_active":"2024-04-25T08:46:09.470619+0000","last_became_peered":"2024-04-25T08:46:09.470619+0000","last_unstale":"2024-04-25T08:46:10.458150+0000","last_undegraded":"2024-04-25T08:46:10.458150+0000","last_fullsized":"2024-04-25T08:46:10.458150+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:51.554826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951329+0000","last_change":"2024-04-25T08:46:09.482730+0000","last_active":"2024-04-25T08:46:10.951329+0000","last_peered":"2024-04-25T08:46:10.951329+0000","last_clean":"2024-04-25T08:46:10.951329+0000","last_became_active":"2024-04-25T08:46:09.481201+0000","last_became_peered":"2024-04-25T08:46:09.481201+0000","last_unstale":"2024-04-25T08:46:10.951329+0000","last_undegraded":"2024-04-25T08:46:10.951329+0000","last_fullsized":"2024-04-25T08:46:10.951329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.407047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951488+0000","last_change":"2024-04-25T08:46:09.480627+0000","last_active":"2024-04-25T08:46:10.951488+0000","last_peered":"2024-04-25T08:46:10.951488+0000","last_clean":"2024-04-25T08:46:10.951488+0000","last_became_active":"2024-04-25T08:46:09.480368+0000","last_became_peered":"2024-04-25T08:46:09.480368+0000","last_unstale":"2024-04-25T08:46:10.951488+0000","last_undegraded":"2024-04-25T08:46:10.951488+0000","last_fullsized":"2024-04-25T08:46:10.951488+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.887243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.469329+0000","last_change":"2024-04-25T08:46:09.474374+0000","last_active":"2024-04-25T08:46:10.469329+0000","last_peered":"2024-04-25T08:46:10.469329+0000","last_clean":"2024-04-25T08:46:10.469329+0000","last_became_active":"2024-04-25T08:46:09.474043+0000","last_became_peered":"2024-04-25T08:46:09.474043+0000","last_unstale":"2024-04-25T08:46:10.469329+0000","last_undegraded":"2024-04-25T08:46:10.469329+0000","last_fullsized":"2024-04-25T08:46:10.469329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:19.700804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.483500+0000","last_change":"2024-04-25T08:46:09.480821+0000","last_active":"2024-04-25T08:46:09.483500+0000","last_peered":"2024-04-25T08:46:09.483500+0000","last_clean":"2024-04-25T08:46:09.483500+0000","last_became_active":"2024-04-25T08:46:09.480522+0000","last_became_peered":"2024-04-25T08:46:09.480522+0000","last_unstale":"2024-04-25T08:46:09.483500+0000","last_undegraded":"2024-04-25T08:46:09.483500+0000","last_fullsized":"2024-04-25T08:46:09.483500+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:43.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458582+0000","last_change":"2024-04-25T08:46:09.470004+0000","last_active":"2024-04-25T08:46:10.458582+0000","last_peered":"2024-04-25T08:46:10.458582+0000","last_clean":"2024-04-25T08:46:10.458582+0000","last_became_active":"2024-04-25T08:46:09.469731+0000","last_became_peered":"2024-04-25T08:46:09.469731+0000","last_unstale":"2024-04-25T08:46:10.458582+0000","last_undegraded":"2024-04-25T08:46:10.458582+0000","last_fullsized":"2024-04-25T08:46:10.458582+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:58.453407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950624+0000","last_change":"2024-04-25T08:46:09.470045+0000","last_active":"2024-04-25T08:46:10.950624+0000","last_peered":"2024-04-25T08:46:10.950624+0000","last_clean":"2024-04-25T08:46:10.950624+0000","last_became_active":"2024-04-25T08:46:09.469648+0000","last_became_peered":"2024-04-25T08:46:09.469648+0000","last_unstale":"2024-04-25T08:46:10.950624+0000","last_undegraded":"2024-04-25T08:46:10.950624+0000","last_fullsized":"2024-04-25T08:46:10.950624+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:58.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.477139+0000","last_change":"2024-04-25T08:46:09.472905+0000","last_active":"2024-04-25T08:46:09.477139+0000","last_peered":"2024-04-25T08:46:09.477139+0000","last_clean":"2024-04-25T08:46:09.477139+0000","last_became_active":"2024-04-25T08:46:09.472619+0000","last_became_peered":"2024-04-25T08:46:09.472619+0000","last_unstale":"2024-04-25T08:46:09.477139+0000","last_undegraded":"2024-04-25T08:46:09.477139+0000","last_fullsized":"2024-04-25T08:46:09.477139+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:37.549173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457640+0000","last_change":"2024-04-25T08:46:09.472285+0000","last_active":"2024-04-25T08:46:10.457640+0000","last_peered":"2024-04-25T08:46:10.457640+0000","last_clean":"2024-04-25T08:46:10.457640+0000","last_became_active":"2024-04-25T08:46:09.472015+0000","last_became_peered":"2024-04-25T08:46:09.472015+0000","last_unstale":"2024-04-25T08:46:10.457640+0000","last_undegraded":"2024-04-25T08:46:10.457640+0000","last_fullsized":"2024-04-25T08:46:10.457640+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:17.865423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.482762+0000","last_change":"2024-04-25T08:46:09.481401+0000","last_active":"2024-04-25T08:46:09.482762+0000","last_peered":"2024-04-25T08:46:09.482762+0000","last_clean":"2024-04-25T08:46:09.482762+0000","last_became_active":"2024-04-25T08:46:09.481157+0000","last_became_peered":"2024-04-25T08:46:09.481157+0000","last_unstale":"2024-04-25T08:46:09.482762+0000","last_undegraded":"2024-04-25T08:46:09.482762+0000","last_fullsized":"2024-04-25T08:46:09.482762+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:31.993328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.482683+0000","last_change":"2024-04-25T08:46:09.481273+0000","last_active":"2024-04-25T08:46:09.482683+0000","last_peered":"2024-04-25T08:46:09.482683+0000","last_clean":"2024-04-25T08:46:09.482683+0000","last_became_active":"2024-04-25T08:46:09.481009+0000","last_became_peered":"2024-04-25T08:46:09.481009+0000","last_unstale":"2024-04-25T08:46:09.482683+0000","last_undegraded":"2024-04-25T08:46:09.482683+0000","last_fullsized":"2024-04-25T08:46:09.482683+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:15.737958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950918+0000","last_change":"2024-04-25T08:46:09.475315+0000","last_active":"2024-04-25T08:46:10.950918+0000","last_peered":"2024-04-25T08:46:10.950918+0000","last_clean":"2024-04-25T08:46:10.950918+0000","last_became_active":"2024-04-25T08:46:09.475018+0000","last_became_peered":"2024-04-25T08:46:09.475018+0000","last_unstale":"2024-04-25T08:46:10.950918+0000","last_undegraded":"2024-04-25T08:46:10.950918+0000","last_fullsized":"2024-04-25T08:46:10.950918+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:22.840417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458305+0000","last_change":"2024-04-25T08:46:09.477046+0000","last_active":"2024-04-25T08:46:10.458305+0000","last_peered":"2024-04-25T08:46:10.458305+0000","last_clean":"2024-04-25T08:46:10.458305+0000","last_became_active":"2024-04-25T08:46:09.474958+0000","last_became_peered":"2024-04-25T08:46:09.474958+0000","last_unstale":"2024-04-25T08:46:10.458305+0000","last_undegraded":"2024-04-25T08:46:10.458305+0000","last_fullsized":"2024-04-25T08:46:10.458305+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:30.729111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457800+0000","last_change":"2024-04-25T08:46:09.474286+0000","last_active":"2024-04-25T08:46:10.457800+0000","last_peered":"2024-04-25T08:46:10.457800+0000","last_clean":"2024-04-25T08:46:10.457800+0000","last_became_active":"2024-04-25T08:46:09.474023+0000","last_became_peered":"2024-04-25T08:46:09.474023+0000","last_unstale":"2024-04-25T08:46:10.457800+0000","last_undegraded":"2024-04-25T08:46:10.457800+0000","last_fullsized":"2024-04-25T08:46:10.457800+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:01.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458573+0000","last_change":"2024-04-25T08:46:09.464045+0000","last_active":"2024-04-25T08:46:10.458573+0000","last_peered":"2024-04-25T08:46:10.458573+0000","last_clean":"2024-04-25T08:46:10.458573+0000","last_became_active":"2024-04-25T08:46:09.463724+0000","last_became_peered":"2024-04-25T08:46:09.463724+0000","last_unstale":"2024-04-25T08:46:10.458573+0000","last_undegraded":"2024-04-25T08:46:10.458573+0000","last_fullsized":"2024-04-25T08:46:10.458573+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:58.750041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.474934+0000","last_change":"2024-04-25T08:46:09.473243+0000","last_active":"2024-04-25T08:46:09.474934+0000","last_peered":"2024-04-25T08:46:09.474934+0000","last_clean":"2024-04-25T08:46:09.474934+0000","last_became_active":"2024-04-25T08:46:09.472802+0000","last_became_peered":"2024-04-25T08:46:09.472802+0000","last_unstale":"2024-04-25T08:46:09.474934+0000","last_undegraded":"2024-04-25T08:46:09.474934+0000","last_fullsized":"2024-04-25T08:46:09.474934+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:58.750041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951303+0000","last_change":"2024-04-25T08:46:09.484611+0000","last_active":"2024-04-25T08:46:10.951303+0000","last_peered":"2024-04-25T08:46:10.951303+0000","last_clean":"2024-04-25T08:46:10.951303+0000","last_became_active":"2024-04-25T08:46:09.484201+0000","last_became_peered":"2024-04-25T08:46:09.484201+0000","last_unstale":"2024-04-25T08:46:10.951303+0000","last_undegraded":"2024-04-25T08:46:10.951303+0000","last_fullsized":"2024-04-25T08:46:10.951303+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:11.870298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457565+0000","last_change":"2024-04-25T08:46:09.483220+0000","last_active":"2024-04-25T08:46:10.457565+0000","last_peered":"2024-04-25T08:46:10.457565+0000","last_clean":"2024-04-25T08:46:10.457565+0000","last_became_active":"2024-04-25T08:46:09.482924+0000","last_became_peered":"2024-04-25T08:46:09.482924+0000","last_unstale":"2024-04-25T08:46:10.457565+0000","last_undegraded":"2024-04-25T08:46:10.457565+0000","last_fullsized":"2024-04-25T08:46:10.457565+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:11.887243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458090+0000","last_change":"2024-04-25T08:46:09.464297+0000","last_active":"2024-04-25T08:46:10.458090+0000","last_peered":"2024-04-25T08:46:10.458090+0000","last_clean":"2024-04-25T08:46:10.458090+0000","last_became_active":"2024-04-25T08:46:09.463956+0000","last_became_peered":"2024-04-25T08:46:09.463956+0000","last_unstale":"2024-04-25T08:46:10.458090+0000","last_undegraded":"2024-04-25T08:46:10.458090+0000","last_fullsized":"2024-04-25T08:46:10.458090+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:32.056722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.453932+0000","last_change":"2024-04-25T08:46:09.465192+0000","last_active":"2024-04-25T08:46:10.453932+0000","last_peered":"2024-04-25T08:46:10.453932+0000","last_clean":"2024-04-25T08:46:10.453932+0000","last_became_active":"2024-04-25T08:46:09.464838+0000","last_became_peered":"2024-04-25T08:46:09.464838+0000","last_unstale":"2024-04-25T08:46:10.453932+0000","last_undegraded":"2024-04-25T08:46:10.453932+0000","last_fullsized":"2024-04-25T08:46:10.453932+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:01.542148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951163+0000","last_change":"2024-04-25T08:46:09.471955+0000","last_active":"2024-04-25T08:46:10.951163+0000","last_peered":"2024-04-25T08:46:10.951163+0000","last_clean":"2024-04-25T08:46:10.951163+0000","last_became_active":"2024-04-25T08:46:09.470691+0000","last_became_peered":"2024-04-25T08:46:09.470691+0000","last_unstale":"2024-04-25T08:46:10.951163+0000","last_undegraded":"2024-04-25T08:46:10.951163+0000","last_fullsized":"2024-04-25T08:46:10.951163+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:05.596718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.488519+0000","last_change":"2024-04-25T08:46:08.465954+0000","last_active":"2024-04-25T08:46:09.488519+0000","last_peered":"2024-04-25T08:46:09.488519+0000","last_clean":"2024-04-25T08:46:09.488519+0000","last_became_active":"2024-04-25T08:46:08.465701+0000","last_became_peered":"2024-04-25T08:46:08.465701+0000","last_unstale":"2024-04-25T08:46:09.488519+0000","last_undegraded":"2024-04-25T08:46:09.488519+0000","last_fullsized":"2024-04-25T08:46:09.488519+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:31.052521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458736+0000","last_change":"2024-04-25T08:46:09.479070+0000","last_active":"2024-04-25T08:46:10.458736+0000","last_peered":"2024-04-25T08:46:10.458736+0000","last_clean":"2024-04-25T08:46:10.458736+0000","last_became_active":"2024-04-25T08:46:09.478796+0000","last_became_peered":"2024-04-25T08:46:09.478796+0000","last_unstale":"2024-04-25T08:46:10.458736+0000","last_undegraded":"2024-04-25T08:46:10.458736+0000","last_fullsized":"2024-04-25T08:46:10.458736+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:47.728427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454378+0000","last_change":"2024-04-25T08:46:08.459464+0000","last_active":"2024-04-25T08:46:10.454378+0000","last_peered":"2024-04-25T08:46:10.454378+0000","last_clean":"2024-04-25T08:46:10.454378+0000","last_became_active":"2024-04-25T08:46:08.459210+0000","last_became_peered":"2024-04-25T08:46:08.459210+0000","last_unstale":"2024-04-25T08:46:10.454378+0000","last_undegraded":"2024-04-25T08:46:10.454378+0000","last_fullsized":"2024-04-25T08:46:10.454378+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:21.836216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454309+0000","last_change":"2024-04-25T08:46:09.465772+0000","last_active":"2024-04-25T08:46:10.454309+0000","last_peered":"2024-04-25T08:46:10.454309+0000","last_clean":"2024-04-25T08:46:10.454309+0000","last_became_active":"2024-04-25T08:46:09.465512+0000","last_became_peered":"2024-04-25T08:46:09.465512+0000","last_unstale":"2024-04-25T08:46:10.454309+0000","last_undegraded":"2024-04-25T08:46:10.454309+0000","last_fullsized":"2024-04-25T08:46:10.454309+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:30.729111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454234+0000","last_change":"2024-04-25T08:46:08.464283+0000","last_active":"2024-04-25T08:46:10.454234+0000","last_peered":"2024-04-25T08:46:10.454234+0000","last_clean":"2024-04-25T08:46:10.454234+0000","last_became_active":"2024-04-25T08:46:08.464012+0000","last_became_peered":"2024-04-25T08:46:08.464012+0000","last_unstale":"2024-04-25T08:46:10.454234+0000","last_undegraded":"2024-04-25T08:46:10.454234+0000","last_fullsized":"2024-04-25T08:46:10.454234+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:44.066370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951088+0000","last_change":"2024-04-25T08:46:09.472311+0000","last_active":"2024-04-25T08:46:10.951088+0000","last_peered":"2024-04-25T08:46:10.951088+0000","last_clean":"2024-04-25T08:46:10.951088+0000","last_became_active":"2024-04-25T08:46:09.472033+0000","last_became_peered":"2024-04-25T08:46:09.472033+0000","last_unstale":"2024-04-25T08:46:10.951088+0000","last_undegraded":"2024-04-25T08:46:10.951088+0000","last_fullsized":"2024-04-25T08:46:10.951088+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:34.556540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454137+0000","last_change":"2024-04-25T08:46:08.457421+0000","last_active":"2024-04-25T08:46:10.454137+0000","last_peered":"2024-04-25T08:46:10.454137+0000","last_clean":"2024-04-25T08:46:10.454137+0000","last_became_active":"2024-04-25T08:46:08.456967+0000","last_became_peered":"2024-04-25T08:46:08.456967+0000","last_unstale":"2024-04-25T08:46:10.454137+0000","last_undegraded":"2024-04-25T08:46:10.454137+0000","last_fullsized":"2024-04-25T08:46:10.454137+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:28.201753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.469344+0000","last_change":"2024-04-25T08:46:09.459551+0000","last_active":"2024-04-25T08:46:10.469344+0000","last_peered":"2024-04-25T08:46:10.469344+0000","last_clean":"2024-04-25T08:46:10.469344+0000","last_became_active":"2024-04-25T08:46:09.459268+0000","last_became_peered":"2024-04-25T08:46:09.459268+0000","last_unstale":"2024-04-25T08:46:10.469344+0000","last_undegraded":"2024-04-25T08:46:10.469344+0000","last_fullsized":"2024-04-25T08:46:10.469344+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:18.446253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.482650+0000","last_change":"2024-04-25T08:46:08.461313+0000","last_active":"2024-04-25T08:46:09.482650+0000","last_peered":"2024-04-25T08:46:09.482650+0000","last_clean":"2024-04-25T08:46:09.482650+0000","last_became_active":"2024-04-25T08:46:08.460904+0000","last_became_peered":"2024-04-25T08:46:08.460904+0000","last_unstale":"2024-04-25T08:46:09.482650+0000","last_undegraded":"2024-04-25T08:46:09.482650+0000","last_fullsized":"2024-04-25T08:46:09.482650+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:29.724910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.483541+0000","last_change":"2024-04-25T08:46:09.481881+0000","last_active":"2024-04-25T08:46:09.483541+0000","last_peered":"2024-04-25T08:46:09.483541+0000","last_clean":"2024-04-25T08:46:09.483541+0000","last_became_active":"2024-04-25T08:46:09.481590+0000","last_became_peered":"2024-04-25T08:46:09.481590+0000","last_unstale":"2024-04-25T08:46:09.483541+0000","last_undegraded":"2024-04-25T08:46:09.483541+0000","last_fullsized":"2024-04-25T08:46:09.483541+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.977157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.482686+0000","last_change":"2024-04-25T08:46:08.460314+0000","last_active":"2024-04-25T08:46:09.482686+0000","last_peered":"2024-04-25T08:46:09.482686+0000","last_clean":"2024-04-25T08:46:09.482686+0000","last_became_active":"2024-04-25T08:46:08.459870+0000","last_became_peered":"2024-04-25T08:46:08.459870+0000","last_unstale":"2024-04-25T08:46:09.482686+0000","last_undegraded":"2024-04-25T08:46:09.482686+0000","last_fullsized":"2024-04-25T08:46:09.482686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:52.159821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950484+0000","last_change":"2024-04-25T08:46:09.473216+0000","last_active":"2024-04-25T08:46:10.950484+0000","last_peered":"2024-04-25T08:46:10.950484+0000","last_clean":"2024-04-25T08:46:10.950484+0000","last_became_active":"2024-04-25T08:46:09.472896+0000","last_became_peered":"2024-04-25T08:46:09.472896+0000","last_unstale":"2024-04-25T08:46:10.950484+0000","last_undegraded":"2024-04-25T08:46:10.950484+0000","last_fullsized":"2024-04-25T08:46:10.950484+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:32.056722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.452550+0000","last_change":"2024-04-25T08:46:08.463187+0000","last_active":"2024-04-25T08:46:09.452550+0000","last_peered":"2024-04-25T08:46:09.452550+0000","last_clean":"2024-04-25T08:46:09.452550+0000","last_became_active":"2024-04-25T08:46:08.462748+0000","last_became_peered":"2024-04-25T08:46:08.462748+0000","last_unstale":"2024-04-25T08:46:09.452550+0000","last_undegraded":"2024-04-25T08:46:09.452550+0000","last_fullsized":"2024-04-25T08:46:09.452550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:00.537947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.468782+0000","last_change":"2024-04-25T08:46:09.466224+0000","last_active":"2024-04-25T08:46:09.468782+0000","last_peered":"2024-04-25T08:46:09.468782+0000","last_clean":"2024-04-25T08:46:09.468782+0000","last_became_active":"2024-04-25T08:46:09.465937+0000","last_became_peered":"2024-04-25T08:46:09.465937+0000","last_unstale":"2024-04-25T08:46:09.468782+0000","last_undegraded":"2024-04-25T08:46:09.468782+0000","last_fullsized":"2024-04-25T08:46:09.468782+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:18.581989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950633+0000","last_change":"2024-04-25T08:46:08.459389+0000","last_active":"2024-04-25T08:46:10.950633+0000","last_peered":"2024-04-25T08:46:10.950633+0000","last_clean":"2024-04-25T08:46:10.950633+0000","last_became_active":"2024-04-25T08:46:08.459090+0000","last_became_peered":"2024-04-25T08:46:08.459090+0000","last_unstale":"2024-04-25T08:46:10.950633+0000","last_undegraded":"2024-04-25T08:46:10.950633+0000","last_fullsized":"2024-04-25T08:46:10.950633+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:25.316836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.462909+0000","last_change":"2024-04-25T08:46:09.461398+0000","last_active":"2024-04-25T08:46:09.462909+0000","last_peered":"2024-04-25T08:46:09.462909+0000","last_clean":"2024-04-25T08:46:09.462909+0000","last_became_active":"2024-04-25T08:46:09.461126+0000","last_became_peered":"2024-04-25T08:46:09.461126+0000","last_unstale":"2024-04-25T08:46:09.462909+0000","last_undegraded":"2024-04-25T08:46:09.462909+0000","last_fullsized":"2024-04-25T08:46:09.462909+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:42.016738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951568+0000","last_change":"2024-04-25T08:46:08.465821+0000","last_active":"2024-04-25T08:46:10.951568+0000","last_peered":"2024-04-25T08:46:10.951568+0000","last_clean":"2024-04-25T08:46:10.951568+0000","last_became_active":"2024-04-25T08:46:08.465507+0000","last_became_peered":"2024-04-25T08:46:08.465507+0000","last_unstale":"2024-04-25T08:46:10.951568+0000","last_undegraded":"2024-04-25T08:46:10.951568+0000","last_fullsized":"2024-04-25T08:46:10.951568+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:14.256589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.477105+0000","last_change":"2024-04-25T08:46:09.472531+0000","last_active":"2024-04-25T08:46:09.477105+0000","last_peered":"2024-04-25T08:46:09.477105+0000","last_clean":"2024-04-25T08:46:09.477105+0000","last_became_active":"2024-04-25T08:46:09.472198+0000","last_became_peered":"2024-04-25T08:46:09.472198+0000","last_unstale":"2024-04-25T08:46:09.477105+0000","last_undegraded":"2024-04-25T08:46:09.477105+0000","last_fullsized":"2024-04-25T08:46:09.477105+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:11.091254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458951+0000","last_change":"2024-04-25T08:46:08.460085+0000","last_active":"2024-04-25T08:46:10.458951+0000","last_peered":"2024-04-25T08:46:10.458951+0000","last_clean":"2024-04-25T08:46:10.458951+0000","last_became_active":"2024-04-25T08:46:08.459787+0000","last_became_peered":"2024-04-25T08:46:08.459787+0000","last_unstale":"2024-04-25T08:46:10.458951+0000","last_undegraded":"2024-04-25T08:46:10.458951+0000","last_fullsized":"2024-04-25T08:46:10.458951+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:55.191193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951505+0000","last_change":"2024-04-25T08:46:09.475561+0000","last_active":"2024-04-25T08:46:10.951505+0000","last_peered":"2024-04-25T08:46:10.951505+0000","last_clean":"2024-04-25T08:46:10.951505+0000","last_became_active":"2024-04-25T08:46:09.475286+0000","last_became_peered":"2024-04-25T08:46:09.475286+0000","last_unstale":"2024-04-25T08:46:10.951505+0000","last_undegraded":"2024-04-25T08:46:10.951505+0000","last_fullsized":"2024-04-25T08:46:10.951505+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:29.342822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951570+0000","last_change":"2024-04-25T08:46:08.464581+0000","last_active":"2024-04-25T08:46:10.951570+0000","last_peered":"2024-04-25T08:46:10.951570+0000","last_clean":"2024-04-25T08:46:10.951570+0000","last_became_active":"2024-04-25T08:46:08.464289+0000","last_became_peered":"2024-04-25T08:46:08.464289+0000","last_unstale":"2024-04-25T08:46:10.951570+0000","last_undegraded":"2024-04-25T08:46:10.951570+0000","last_fullsized":"2024-04-25T08:46:10.951570+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:46.724226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458756+0000","last_change":"2024-04-25T08:46:09.469334+0000","last_active":"2024-04-25T08:46:10.458756+0000","last_peered":"2024-04-25T08:46:10.458756+0000","last_clean":"2024-04-25T08:46:10.458756+0000","last_became_active":"2024-04-25T08:46:09.468764+0000","last_became_peered":"2024-04-25T08:46:09.468764+0000","last_unstale":"2024-04-25T08:46:10.458756+0000","last_undegraded":"2024-04-25T08:46:10.458756+0000","last_fullsized":"2024-04-25T08:46:10.458756+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:43.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.491051+0000","last_change":"2024-04-25T08:46:08.462088+0000","last_active":"2024-04-25T08:46:09.491051+0000","last_peered":"2024-04-25T08:46:09.491051+0000","last_clean":"2024-04-25T08:46:09.491051+0000","last_became_active":"2024-04-25T08:46:08.461759+0000","last_became_peered":"2024-04-25T08:46:08.461759+0000","last_unstale":"2024-04-25T08:46:09.491051+0000","last_undegraded":"2024-04-25T08:46:09.491051+0000","last_fullsized":"2024-04-25T08:46:09.491051+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:07.453472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457983+0000","last_change":"2024-04-25T08:46:09.475751+0000","last_active":"2024-04-25T08:46:10.457983+0000","last_peered":"2024-04-25T08:46:10.457983+0000","last_clean":"2024-04-25T08:46:10.457983+0000","last_became_active":"2024-04-25T08:46:09.475491+0000","last_became_peered":"2024-04-25T08:46:09.475491+0000","last_unstale":"2024-04-25T08:46:10.457983+0000","last_undegraded":"2024-04-25T08:46:10.457983+0000","last_fullsized":"2024-04-25T08:46:10.457983+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:44.899105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951445+0000","last_change":"2024-04-25T08:46:08.466086+0000","last_active":"2024-04-25T08:46:10.951445+0000","last_peered":"2024-04-25T08:46:10.951445+0000","last_clean":"2024-04-25T08:46:10.951445+0000","last_became_active":"2024-04-25T08:46:08.465788+0000","last_became_peered":"2024-04-25T08:46:08.465788+0000","last_unstale":"2024-04-25T08:46:10.951445+0000","last_undegraded":"2024-04-25T08:46:10.951445+0000","last_fullsized":"2024-04-25T08:46:10.951445+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:28.338621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457533+0000","last_change":"2024-04-25T08:46:09.473453+0000","last_active":"2024-04-25T08:46:10.457533+0000","last_peered":"2024-04-25T08:46:10.457533+0000","last_clean":"2024-04-25T08:46:10.457533+0000","last_became_active":"2024-04-25T08:46:09.472991+0000","last_became_peered":"2024-04-25T08:46:09.472991+0000","last_unstale":"2024-04-25T08:46:10.457533+0000","last_undegraded":"2024-04-25T08:46:10.457533+0000","last_fullsized":"2024-04-25T08:46:10.457533+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:29.548030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457777+0000","last_change":"2024-04-25T08:46:08.458750+0000","last_active":"2024-04-25T08:46:10.457777+0000","last_peered":"2024-04-25T08:46:10.457777+0000","last_clean":"2024-04-25T08:46:10.457777+0000","last_became_active":"2024-04-25T08:46:08.458317+0000","last_became_peered":"2024-04-25T08:46:08.458317+0000","last_unstale":"2024-04-25T08:46:10.457777+0000","last_undegraded":"2024-04-25T08:46:10.457777+0000","last_fullsized":"2024-04-25T08:46:10.457777+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:43.402285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950960+0000","last_change":"2024-04-25T08:46:09.469773+0000","last_active":"2024-04-25T08:46:10.950960+0000","last_peered":"2024-04-25T08:46:10.950960+0000","last_clean":"2024-04-25T08:46:10.950960+0000","last_became_active":"2024-04-25T08:46:09.469505+0000","last_became_peered":"2024-04-25T08:46:09.469505+0000","last_unstale":"2024-04-25T08:46:10.950960+0000","last_undegraded":"2024-04-25T08:46:10.950960+0000","last_fullsized":"2024-04-25T08:46:10.950960+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.977157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951601+0000","last_change":"2024-04-25T08:46:08.461582+0000","last_active":"2024-04-25T08:46:10.951601+0000","last_peered":"2024-04-25T08:46:10.951601+0000","last_clean":"2024-04-25T08:46:10.951601+0000","last_became_active":"2024-04-25T08:46:08.461290+0000","last_became_peered":"2024-04-25T08:46:08.461290+0000","last_unstale":"2024-04-25T08:46:10.951601+0000","last_undegraded":"2024-04-25T08:46:10.951601+0000","last_fullsized":"2024-04-25T08:46:10.951601+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:04.592517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.486320+0000","last_change":"2024-04-25T08:46:09.485561+0000","last_active":"2024-04-25T08:46:09.486320+0000","last_peered":"2024-04-25T08:46:09.486320+0000","last_clean":"2024-04-25T08:46:09.486320+0000","last_became_active":"2024-04-25T08:46:09.485210+0000","last_became_peered":"2024-04-25T08:46:09.485210+0000","last_unstale":"2024-04-25T08:46:09.486320+0000","last_undegraded":"2024-04-25T08:46:09.486320+0000","last_fullsized":"2024-04-25T08:46:09.486320+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:15.260790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458105+0000","last_change":"2024-04-25T08:46:08.466405+0000","last_active":"2024-04-25T08:46:10.458105+0000","last_peered":"2024-04-25T08:46:10.458105+0000","last_clean":"2024-04-25T08:46:10.458105+0000","last_became_active":"2024-04-25T08:46:08.466145+0000","last_became_peered":"2024-04-25T08:46:08.466145+0000","last_unstale":"2024-04-25T08:46:10.458105+0000","last_undegraded":"2024-04-25T08:46:10.458105+0000","last_fullsized":"2024-04-25T08:46:10.458105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:48.476518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950780+0000","last_change":"2024-04-25T08:46:09.483795+0000","last_active":"2024-04-25T08:46:10.950780+0000","last_peered":"2024-04-25T08:46:10.950780+0000","last_clean":"2024-04-25T08:46:10.950780+0000","last_became_active":"2024-04-25T08:46:09.483521+0000","last_became_peered":"2024-04-25T08:46:09.483521+0000","last_unstale":"2024-04-25T08:46:10.950780+0000","last_undegraded":"2024-04-25T08:46:10.950780+0000","last_fullsized":"2024-04-25T08:46:10.950780+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:29.205954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457572+0000","last_change":"2024-04-25T08:46:08.458502+0000","last_active":"2024-04-25T08:46:10.457572+0000","last_peered":"2024-04-25T08:46:10.457572+0000","last_clean":"2024-04-25T08:46:10.457572+0000","last_became_active":"2024-04-25T08:46:08.457457+0000","last_became_peered":"2024-04-25T08:46:08.457457+0000","last_unstale":"2024-04-25T08:46:10.457572+0000","last_undegraded":"2024-04-25T08:46:10.457572+0000","last_fullsized":"2024-04-25T08:46:10.457572+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:01.282573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950677+0000","last_change":"2024-04-25T08:46:09.477055+0000","last_active":"2024-04-25T08:46:10.950677+0000","last_peered":"2024-04-25T08:46:10.950677+0000","last_clean":"2024-04-25T08:46:10.950677+0000","last_became_active":"2024-04-25T08:46:09.476789+0000","last_became_peered":"2024-04-25T08:46:09.476789+0000","last_unstale":"2024-04-25T08:46:10.950677+0000","last_undegraded":"2024-04-25T08:46:10.950677+0000","last_fullsized":"2024-04-25T08:46:10.950677+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:58.750041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951222+0000","last_change":"2024-04-25T08:46:08.466681+0000","last_active":"2024-04-25T08:46:10.951222+0000","last_peered":"2024-04-25T08:46:10.951222+0000","last_clean":"2024-04-25T08:46:10.951222+0000","last_became_active":"2024-04-25T08:46:08.466389+0000","last_became_peered":"2024-04-25T08:46:08.466389+0000","last_unstale":"2024-04-25T08:46:10.951222+0000","last_undegraded":"2024-04-25T08:46:10.951222+0000","last_fullsized":"2024-04-25T08:46:10.951222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:26.972956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458842+0000","last_change":"2024-04-25T08:46:09.465621+0000","last_active":"2024-04-25T08:46:10.458842+0000","last_peered":"2024-04-25T08:46:10.458842+0000","last_clean":"2024-04-25T08:46:10.458842+0000","last_became_active":"2024-04-25T08:46:09.465356+0000","last_became_peered":"2024-04-25T08:46:09.465356+0000","last_unstale":"2024-04-25T08:46:10.458842+0000","last_undegraded":"2024-04-25T08:46:10.458842+0000","last_fullsized":"2024-04-25T08:46:10.458842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.977157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951687+0000","last_change":"2024-04-25T08:46:08.464632+0000","last_active":"2024-04-25T08:46:10.951687+0000","last_peered":"2024-04-25T08:46:10.951687+0000","last_clean":"2024-04-25T08:46:10.951687+0000","last_became_active":"2024-04-25T08:46:08.464370+0000","last_became_peered":"2024-04-25T08:46:08.464370+0000","last_unstale":"2024-04-25T08:46:10.951687+0000","last_undegraded":"2024-04-25T08:46:10.951687+0000","last_fullsized":"2024-04-25T08:46:10.951687+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:42.545161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950671+0000","last_change":"2024-04-25T08:46:09.471191+0000","last_active":"2024-04-25T08:46:10.950671+0000","last_peered":"2024-04-25T08:46:10.950671+0000","last_clean":"2024-04-25T08:46:10.950671+0000","last_became_active":"2024-04-25T08:46:09.470320+0000","last_became_peered":"2024-04-25T08:46:09.470320+0000","last_unstale":"2024-04-25T08:46:10.950671+0000","last_undegraded":"2024-04-25T08:46:10.950671+0000","last_fullsized":"2024-04-25T08:46:10.950671+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:42.016738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.452904+0000","last_change":"2024-04-25T08:46:08.462833+0000","last_active":"2024-04-25T08:46:09.452904+0000","last_peered":"2024-04-25T08:46:09.452904+0000","last_clean":"2024-04-25T08:46:09.452904+0000","last_became_active":"2024-04-25T08:46:08.462565+0000","last_became_peered":"2024-04-25T08:46:08.462565+0000","last_unstale":"2024-04-25T08:46:09.452904+0000","last_undegraded":"2024-04-25T08:46:09.452904+0000","last_fullsized":"2024-04-25T08:46:09.452904+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:50.550625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454008+0000","last_change":"2024-04-25T08:46:09.466269+0000","last_active":"2024-04-25T08:46:10.454008+0000","last_peered":"2024-04-25T08:46:10.454008+0000","last_clean":"2024-04-25T08:46:10.454008+0000","last_became_active":"2024-04-25T08:46:09.465943+0000","last_became_peered":"2024-04-25T08:46:09.465943+0000","last_unstale":"2024-04-25T08:46:10.454008+0000","last_undegraded":"2024-04-25T08:46:10.454008+0000","last_fullsized":"2024-04-25T08:46:10.454008+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:51.441413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454070+0000","last_change":"2024-04-25T08:46:08.457924+0000","last_active":"2024-04-25T08:46:10.454070+0000","last_peered":"2024-04-25T08:46:10.454070+0000","last_clean":"2024-04-25T08:46:10.454070+0000","last_became_active":"2024-04-25T08:46:08.457677+0000","last_became_peered":"2024-04-25T08:46:08.457677+0000","last_unstale":"2024-04-25T08:46:10.454070+0000","last_undegraded":"2024-04-25T08:46:10.454070+0000","last_fullsized":"2024-04-25T08:46:10.454070+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:20.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458077+0000","last_change":"2024-04-25T08:46:09.473203+0000","last_active":"2024-04-25T08:46:10.458077+0000","last_peered":"2024-04-25T08:46:10.458077+0000","last_clean":"2024-04-25T08:46:10.458077+0000","last_became_active":"2024-04-25T08:46:09.472683+0000","last_became_peered":"2024-04-25T08:46:09.472683+0000","last_unstale":"2024-04-25T08:46:10.458077+0000","last_undegraded":"2024-04-25T08:46:10.458077+0000","last_fullsized":"2024-04-25T08:46:10.458077+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:51.441413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.457852+0000","last_change":"2024-04-25T08:46:08.458266+0000","last_active":"2024-04-25T08:46:10.457852+0000","last_peered":"2024-04-25T08:46:10.457852+0000","last_clean":"2024-04-25T08:46:10.457852+0000","last_became_active":"2024-04-25T08:46:08.457829+0000","last_became_peered":"2024-04-25T08:46:08.457829+0000","last_unstale":"2024-04-25T08:46:10.457852+0000","last_undegraded":"2024-04-25T08:46:10.457852+0000","last_fullsized":"2024-04-25T08:46:10.457852+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:44.412450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950787+0000","last_change":"2024-04-25T08:46:09.474415+0000","last_active":"2024-04-25T08:46:10.950787+0000","last_peered":"2024-04-25T08:46:10.950787+0000","last_clean":"2024-04-25T08:46:10.950787+0000","last_became_active":"2024-04-25T08:46:09.474154+0000","last_became_peered":"2024-04-25T08:46:09.474154+0000","last_unstale":"2024-04-25T08:46:10.950787+0000","last_undegraded":"2024-04-25T08:46:10.950787+0000","last_fullsized":"2024-04-25T08:46:10.950787+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:58.453407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.453885+0000","last_change":"2024-04-25T08:46:08.463608+0000","last_active":"2024-04-25T08:46:10.453885+0000","last_peered":"2024-04-25T08:46:10.453885+0000","last_clean":"2024-04-25T08:46:10.453885+0000","last_became_active":"2024-04-25T08:46:08.463283+0000","last_became_peered":"2024-04-25T08:46:08.463283+0000","last_unstale":"2024-04-25T08:46:10.453885+0000","last_undegraded":"2024-04-25T08:46:10.453885+0000","last_fullsized":"2024-04-25T08:46:10.453885+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:33.552339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454185+0000","last_change":"2024-04-25T08:46:09.476456+0000","last_active":"2024-04-25T08:46:10.454185+0000","last_peered":"2024-04-25T08:46:10.454185+0000","last_clean":"2024-04-25T08:46:10.454185+0000","last_became_active":"2024-04-25T08:46:09.476211+0000","last_became_peered":"2024-04-25T08:46:09.476211+0000","last_unstale":"2024-04-25T08:46:10.454185+0000","last_undegraded":"2024-04-25T08:46:10.454185+0000","last_fullsized":"2024-04-25T08:46:10.454185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:51.554826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458537+0000","last_change":"2024-04-25T08:46:08.463898+0000","last_active":"2024-04-25T08:46:10.458537+0000","last_peered":"2024-04-25T08:46:10.458537+0000","last_clean":"2024-04-25T08:46:10.458537+0000","last_became_active":"2024-04-25T08:46:08.463280+0000","last_became_peered":"2024-04-25T08:46:08.463280+0000","last_unstale":"2024-04-25T08:46:10.458537+0000","last_undegraded":"2024-04-25T08:46:10.458537+0000","last_fullsized":"2024-04-25T08:46:10.458537+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:48.146293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.469568+0000","last_change":"2024-04-25T08:46:09.464793+0000","last_active":"2024-04-25T08:46:10.469568+0000","last_peered":"2024-04-25T08:46:10.469568+0000","last_clean":"2024-04-25T08:46:10.469568+0000","last_became_active":"2024-04-25T08:46:09.464523+0000","last_became_peered":"2024-04-25T08:46:09.464523+0000","last_unstale":"2024-04-25T08:46:10.469568+0000","last_undegraded":"2024-04-25T08:46:10.469568+0000","last_fullsized":"2024-04-25T08:46:10.469568+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:25.457187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"65'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.468951+0000","last_change":"2024-04-25T08:46:08.456375+0000","last_active":"2024-04-25T08:46:10.468951+0000","last_peered":"2024-04-25T08:46:10.468951+0000","last_clean":"2024-04-25T08:46:10.468951+0000","last_became_active":"2024-04-25T08:46:08.455997+0000","last_became_peered":"2024-04-25T08:46:08.455997+0000","last_unstale":"2024-04-25T08:46:10.468951+0000","last_undegraded":"2024-04-25T08:46:10.468951+0000","last_fullsized":"2024-04-25T08:46:10.468951+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:42.719562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458033+0000","last_change":"2024-04-25T08:46:09.473466+0000","last_active":"2024-04-25T08:46:10.458033+0000","last_peered":"2024-04-25T08:46:10.458033+0000","last_clean":"2024-04-25T08:46:10.458033+0000","last_became_active":"2024-04-25T08:46:09.473161+0000","last_became_peered":"2024-04-25T08:46:09.473161+0000","last_unstale":"2024-04-25T08:46:10.458033+0000","last_undegraded":"2024-04-25T08:46:10.458033+0000","last_fullsized":"2024-04-25T08:46:10.458033+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:43.473335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.454301+0000","last_change":"2024-04-25T08:46:08.462841+0000","last_active":"2024-04-25T08:46:10.454301+0000","last_peered":"2024-04-25T08:46:10.454301+0000","last_clean":"2024-04-25T08:46:10.454301+0000","last_became_active":"2024-04-25T08:46:08.462289+0000","last_became_peered":"2024-04-25T08:46:08.462289+0000","last_unstale":"2024-04-25T08:46:10.454301+0000","last_undegraded":"2024-04-25T08:46:10.454301+0000","last_fullsized":"2024-04-25T08:46:10.454301+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:11.524534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950828+0000","last_change":"2024-04-25T08:46:09.469151+0000","last_active":"2024-04-25T08:46:10.950828+0000","last_peered":"2024-04-25T08:46:10.950828+0000","last_clean":"2024-04-25T08:46:10.950828+0000","last_became_active":"2024-04-25T08:46:09.468814+0000","last_became_peered":"2024-04-25T08:46:09.468814+0000","last_unstale":"2024-04-25T08:46:10.950828+0000","last_undegraded":"2024-04-25T08:46:10.950828+0000","last_fullsized":"2024-04-25T08:46:10.950828+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:43.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.457615+0000","last_change":"2024-04-25T08:46:08.461792+0000","last_active":"2024-04-25T08:46:09.457615+0000","last_peered":"2024-04-25T08:46:09.457615+0000","last_clean":"2024-04-25T08:46:09.457615+0000","last_became_active":"2024-04-25T08:46:08.461441+0000","last_became_peered":"2024-04-25T08:46:08.461441+0000","last_unstale":"2024-04-25T08:46:09.457615+0000","last_undegraded":"2024-04-25T08:46:09.457615+0000","last_fullsized":"2024-04-25T08:46:09.457615+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:43.894904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950434+0000","last_change":"2024-04-25T08:46:09.464695+0000","last_active":"2024-04-25T08:46:10.950434+0000","last_peered":"2024-04-25T08:46:10.950434+0000","last_clean":"2024-04-25T08:46:10.950434+0000","last_became_active":"2024-04-25T08:46:09.464338+0000","last_became_peered":"2024-04-25T08:46:09.464338+0000","last_unstale":"2024-04-25T08:46:10.950434+0000","last_undegraded":"2024-04-25T08:46:10.950434+0000","last_fullsized":"2024-04-25T08:46:10.950434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:44.899105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.951442+0000","last_change":"2024-04-25T08:46:08.461106+0000","last_active":"2024-04-25T08:46:10.951442+0000","last_peered":"2024-04-25T08:46:10.951442+0000","last_clean":"2024-04-25T08:46:10.951442+0000","last_became_active":"2024-04-25T08:46:08.460570+0000","last_became_peered":"2024-04-25T08:46:08.460570+0000","last_unstale":"2024-04-25T08:46:10.951442+0000","last_undegraded":"2024-04-25T08:46:10.951442+0000","last_fullsized":"2024-04-25T08:46:10.951442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:56.150819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.458312+0000","last_change":"2024-04-25T08:46:09.485797+0000","last_active":"2024-04-25T08:46:10.458312+0000","last_peered":"2024-04-25T08:46:10.458312+0000","last_clean":"2024-04-25T08:46:10.458312+0000","last_became_active":"2024-04-25T08:46:09.485336+0000","last_became_peered":"2024-04-25T08:46:09.485336+0000","last_unstale":"2024-04-25T08:46:10.458312+0000","last_undegraded":"2024-04-25T08:46:10.458312+0000","last_fullsized":"2024-04-25T08:46:10.458312+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:58.095634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.452753+0000","last_change":"2024-04-25T08:46:08.458469+0000","last_active":"2024-04-25T08:46:09.452753+0000","last_peered":"2024-04-25T08:46:09.452753+0000","last_clean":"2024-04-25T08:46:09.452753+0000","last_became_active":"2024-04-25T08:46:08.458204+0000","last_became_peered":"2024-04-25T08:46:08.458204+0000","last_unstale":"2024-04-25T08:46:09.452753+0000","last_undegraded":"2024-04-25T08:46:09.452753+0000","last_fullsized":"2024-04-25T08:46:09.452753+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:50.437212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.482386+0000","last_change":"2024-04-25T08:46:09.474590+0000","last_active":"2024-04-25T08:46:09.482386+0000","last_peered":"2024-04-25T08:46:09.482386+0000","last_clean":"2024-04-25T08:46:09.482386+0000","last_became_active":"2024-04-25T08:46:09.474237+0000","last_became_peered":"2024-04-25T08:46:09.474237+0000","last_unstale":"2024-04-25T08:46:09.482386+0000","last_undegraded":"2024-04-25T08:46:09.482386+0000","last_fullsized":"2024-04-25T08:46:09.482386+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:58.453407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.452759+0000","last_change":"2024-04-25T08:46:08.462393+0000","last_active":"2024-04-25T08:46:09.452759+0000","last_peered":"2024-04-25T08:46:09.452759+0000","last_clean":"2024-04-25T08:46:09.452759+0000","last_became_active":"2024-04-25T08:46:08.462141+0000","last_became_peered":"2024-04-25T08:46:08.462141+0000","last_unstale":"2024-04-25T08:46:09.452759+0000","last_undegraded":"2024-04-25T08:46:09.452759+0000","last_fullsized":"2024-04-25T08:46:09.452759+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:42.469134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.469391+0000","last_change":"2024-04-25T08:46:09.474080+0000","last_active":"2024-04-25T08:46:10.469391+0000","last_peered":"2024-04-25T08:46:10.469391+0000","last_clean":"2024-04-25T08:46:10.469391+0000","last_became_active":"2024-04-25T08:46:09.473731+0000","last_became_peered":"2024-04-25T08:46:09.473731+0000","last_unstale":"2024-04-25T08:46:10.469391+0000","last_undegraded":"2024-04-25T08:46:10.469391+0000","last_fullsized":"2024-04-25T08:46:10.469391+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:19.427792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.457234+0000","last_change":"2024-04-25T08:46:08.455975+0000","last_active":"2024-04-25T08:46:09.457234+0000","last_peered":"2024-04-25T08:46:09.457234+0000","last_clean":"2024-04-25T08:46:09.457234+0000","last_became_active":"2024-04-25T08:46:08.455667+0000","last_became_peered":"2024-04-25T08:46:08.455667+0000","last_unstale":"2024-04-25T08:46:09.457234+0000","last_undegraded":"2024-04-25T08:46:09.457234+0000","last_fullsized":"2024-04-25T08:46:09.457234+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:02.428018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950996+0000","last_change":"2024-04-25T08:46:09.471754+0000","last_active":"2024-04-25T08:46:10.950996+0000","last_peered":"2024-04-25T08:46:10.950996+0000","last_clean":"2024-04-25T08:46:10.950996+0000","last_became_active":"2024-04-25T08:46:09.471439+0000","last_became_peered":"2024-04-25T08:46:09.471439+0000","last_unstale":"2024-04-25T08:46:10.950996+0000","last_undegraded":"2024-04-25T08:46:10.950996+0000","last_fullsized":"2024-04-25T08:46:10.950996+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:08.440729+0000","last_clean_scrub_stamp":"2024-04-25T08:46:08.440729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:15.260790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-25T08:46:09.452467+0000","last_change":"2024-04-25T08:46:08.461253+0000","last_active":"2024-04-25T08:46:09.452467+0000","last_peered":"2024-04-25T08:46:09.452467+0000","last_clean":"2024-04-25T08:46:09.452467+0000","last_became_active":"2024-04-25T08:46:08.460969+0000","last_became_peered":"2024-04-25T08:46:08.460969+0000","last_unstale":"2024-04-25T08:46:09.452467+0000","last_undegraded":"2024-04-25T08:46:09.452467+0000","last_fullsized":"2024-04-25T08:46:09.452467+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:07.436528+0000","last_clean_scrub_stamp":"2024-04-25T08:46:07.436528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:16.861222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":254,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T08:46:10.950991+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:46:10.950991+0000","last_peered":"2024-04-25T08:46:10.950991+0000","last_clean":"2024-04-25T08:46:10.950991+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:46:10.950991+0000","last_undegraded":"2024-04-25T08:46:10.950991+0000","last_fullsized":"2024-04-25T08:46:10.950991+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1396736,"data_stored":948030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":790528,"data_stored":356920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36104,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335736,"statfs":{"total":96636764160,"available":96599793664,"internally_reserved":0,"allocated":778240,"data_stored":350216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36112,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335728,"statfs":{"total":96636764160,"available":96599785472,"internally_reserved":0,"allocated":786432,"data_stored":351806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36104,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335736,"statfs":{"total":96636764160,"available":96599793664,"internally_reserved":0,"allocated":774144,"data_stored":350194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36096,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335744,"statfs":{"total":96636764160,"available":96599801856,"internally_reserved":0,"allocated":774144,"data_stored":350194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":802816,"data_stored":352570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36676,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335164,"statfs":{"total":96636764160,"available":96599207936,"internally_reserved":0,"allocated":1368064,"data_stored":940562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:46:12.747 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:46:12.748 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:46:12.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.897+0000 7fa9f83d5640 1 Processor -- start 2024-04-25T08:46:12.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.897+0000 7fa9f83d5640 1 -- start start 2024-04-25T08:46:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f83d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 0x7fa9f00d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f83d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa9f00d0ab0 0x7fa9f00b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f83d5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f00d2420 con 0x7fa9f00d1f30 2024-04-25T08:46:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f83d5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00d3030 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f83d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00d2700 con 0x7fa9f015dac0 2024-04-25T08:46:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f6972640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa9f00d0ab0 0x7fa9f00b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f5970640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa9f00d1f30 0x7fa9f00d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39694/0 (socket says 172.21.15.172:39694) 2024-04-25T08:46:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f5970640 1 -- 172.21.15.172:0/4076071214 learned_addr learned my addr 172.21.15.172:0/4076071214 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f6171640 1 --2- 172.21.15.172:0/4076071214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 0x7fa9f00d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f6972640 1 -- 172.21.15.172:0/4076071214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 msgr2=0x7fa9f00d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f6972640 1 --2- 172.21.15.172:0/4076071214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 0x7fa9f00d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f6972640 1 -- 172.21.15.172:0/4076071214 >> v1:172.21.15.172:6789/0 conn(0x7fa9f00d1f30 legacy=0x7fa9f00d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f6972640 1 -- 172.21.15.172:0/4076071214 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00d29e0 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f516f640 1 -- 172.21.15.172:0/4076071214 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216740350 0 0) 0x7fa9f00d2420 con 0x7fa9f00d1f30 2024-04-25T08:46:12.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.898+0000 7fa9f6171640 1 --2- 172.21.15.172:0/4076071214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 0x7fa9f00d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:12.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.899+0000 7fa9f6972640 1 --2- 172.21.15.172:0/4076071214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 0x7fa9f00b6990 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009d90 tx=0x7fa9e802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13827108638c5b9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:12.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.899+0000 7fa9f516f640 1 -- 172.21.15.172:0/4076071214 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8007740 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.899+0000 7fa9f516f640 1 -- 172.21.15.172:0/4076071214 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e80078e0 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.899+0000 7fa9f516f640 1 -- 172.21.15.172:0/4076071214 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8007cb0 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.900+0000 7fa9f83d5640 1 -- 172.21.15.172:0/4076071214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 msgr2=0x7fa9f00b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.900+0000 7fa9f83d5640 1 --2- 172.21.15.172:0/4076071214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 0x7fa9f00b6990 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009d90 tx=0x7fa9e802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.900+0000 7fa9f83d5640 1 -- 172.21.15.172:0/4076071214 shutdown_connections 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.900+0000 7fa9f83d5640 1 --2- 172.21.15.172:0/4076071214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 0x7fa9f00b6990 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.900+0000 7fa9f83d5640 1 --2- 172.21.15.172:0/4076071214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 0x7fa9f00d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.900+0000 7fa9f83d5640 1 -- 172.21.15.172:0/4076071214 >> 172.21.15.172:0/4076071214 conn(0x7fa9f0061c30 msgr2=0x7fa9f006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.900+0000 7fa9f83d5640 1 -- 172.21.15.172:0/4076071214 shutdown_connections 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.900+0000 7fa9f83d5640 1 -- 172.21.15.172:0/4076071214 wait complete. 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.901+0000 7fa9f83d5640 1 Processor -- start 2024-04-25T08:46:12.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.901+0000 7fa9f83d5640 1 -- start start 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f83d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 0x7fa9f0146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f83d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9f00d1f30 0x7fa9f01f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f83d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 0x7fa9f00c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f83d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00b97d0 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f83d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f015dea0 con 0x7fa9f00d1f30 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f83d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00b9950 con 0x7fa9f015dac0 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f6171640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 0x7fa9f0146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f6171640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 0x7fa9f0146360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59290/0 (socket says 172.21.15.172:59290) 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f6171640 1 -- 172.21.15.172:0/833904442 learned_addr learned my addr 172.21.15.172:0/833904442 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f6972640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 0x7fa9f00c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f5970640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9f00d1f30 0x7fa9f01f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f6171640 1 -- 172.21.15.172:0/833904442 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 msgr2=0x7fa9f00c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f6171640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 0x7fa9f00c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f6171640 1 -- 172.21.15.172:0/833904442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9f00d1f30 msgr2=0x7fa9f01f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f6171640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9f00d1f30 0x7fa9f01f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f6171640 1 -- 172.21.15.172:0/833904442 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00ca2d0 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f6171640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 0x7fa9f0146360 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00c820 tx=0x7fa9ec00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9e6ffd640 1 -- 172.21.15.172:0/833904442 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec015070 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9e6ffd640 1 -- 172.21.15.172:0/833904442 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec007a30 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9f83d5640 1 -- 172.21.15.172:0/833904442 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f00c9230 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.902+0000 7fa9e6ffd640 1 -- 172.21.15.172:0/833904442 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec007de0 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.903+0000 7fa9f83d5640 1 -- 172.21.15.172:0/833904442 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f00c97f0 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.903+0000 7fa9f83d5640 1 -- 172.21.15.172:0/833904442 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f0073a00 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.904+0000 7fa9e6ffd640 1 -- 172.21.15.172:0/833904442 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa9ec018070 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.904+0000 7fa9e6ffd640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9d406b4d0 0x7fa9d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.904+0000 7fa9e6ffd640 1 -- 172.21.15.172:0/833904442 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa9ec08a2c0 con 0x7fa9f00d0ab0 2024-04-25T08:46:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.904+0000 7fa9f5970640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9d406b4d0 0x7fa9d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:12.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.905+0000 7fa9f5970640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9d406b4d0 0x7fa9d406d990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00b63e0 tx=0x7fa9e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:12.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:12.909+0000 7fa9e6ffd640 1 -- 172.21.15.172:0/833904442 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9ec058fb0 con 0x7fa9f00d0ab0 2024-04-25T08:46:13.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.143+0000 7fa9f83d5640 1 -- 172.21.15.172:0/833904442 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa9f00c8f40 con 0x7fa9f00d0ab0 2024-04-25T08:46:13.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.145+0000 7fa9e6ffd640 1 -- 172.21.15.172:0/833904442 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa9ec0588b0 con 0x7fa9f00d0ab0 2024-04-25T08:46:13.137 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T08:46:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:46:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: caps mds = "allow" 2024-04-25T08:46:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: caps mon = "allow r" 2024-04-25T08:46:13.137 INFO:teuthology.orchestra.run.smithi172.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:46:13.137 INFO:teuthology.orchestra.run.smithi172.stderr:updated caps for client.0 2024-04-25T08:46:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 -- 172.21.15.172:0/833904442 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9d406b4d0 msgr2=0x7fa9d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9d406b4d0 0x7fa9d406d990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00b63e0 tx=0x7fa9e0009040 comp rx=0 tx=0).stop 2024-04-25T08:46:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 -- 172.21.15.172:0/833904442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 msgr2=0x7fa9f0146360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 0x7fa9f0146360 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00c820 tx=0x7fa9ec00cce0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 -- 172.21.15.172:0/833904442 shutdown_connections 2024-04-25T08:46:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9d406b4d0 0x7fa9d406d990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9f00d1f30 0x7fa9f01f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9f015dac0 0x7fa9f00c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 --2- 172.21.15.172:0/833904442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f00d0ab0 0x7fa9f0146360 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 -- 172.21.15.172:0/833904442 >> 172.21.15.172:0/833904442 conn(0x7fa9f0061c30 msgr2=0x7fa9f00b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:13.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 -- 172.21.15.172:0/833904442 shutdown_connections 2024-04-25T08:46:13.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.147+0000 7fa9f83d5640 1 -- 172.21.15.172:0/833904442 wait complete. 2024-04-25T08:46:13.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:13.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.255+0000 7f8c1e33b640 1 Processor -- start 2024-04-25T08:46:13.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.255+0000 7f8c1e33b640 1 -- start start 2024-04-25T08:46:13.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c1e33b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c1815c9e0 0x7f8c18071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c1e33b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8c18072000 0x7f8c1806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c1e33b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c18072400 con 0x7f8c18155fe0 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c1e33b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1815ce70 con 0x7f8c1815c9e0 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c1e33b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1806de40 con 0x7f8c18072000 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c177fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c1815c9e0 0x7f8c18071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c17fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8c18155fe0 0x7f8c180adbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39696/0 (socket says 172.21.15.172:39696) 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c17fff640 1 -- 172.21.15.172:0/534816803 learned_addr learned my addr 172.21.15.172:0/534816803 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c177fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c1815c9e0 0x7f8c18071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59296/0 (socket says 172.21.15.172:59296) 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c1c8d8640 1 --2- 172.21.15.172:0/534816803 >> v2:172.21.15.186:3300/0 conn(0x7f8c18072000 0x7f8c1806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c177fe640 1 -- 172.21.15.172:0/534816803 >> v2:172.21.15.186:3300/0 conn(0x7f8c18072000 msgr2=0x7f8c1806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c177fe640 1 --2- 172.21.15.172:0/534816803 >> v2:172.21.15.186:3300/0 conn(0x7f8c18072000 0x7f8c1806abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c177fe640 1 -- 172.21.15.172:0/534816803 >> v1:172.21.15.172:6789/0 conn(0x7f8c18155fe0 legacy=0x7f8c180adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.257+0000 7f8c177fe640 1 -- 172.21.15.172:0/534816803 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180ad0e0 con 0x7f8c1815c9e0 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.256+0000 7f8c16ffd640 1 -- 172.21.15.172:0/534816803 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40637921 0 0) 0x7f8c18072400 con 0x7f8c18155fe0 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.257+0000 7f8c177fe640 1 --2- 172.21.15.172:0/534816803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815c9e0 0x7f8c18071ac0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8c18061950 tx=0x7f8c0c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdfdc852690de05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.257+0000 7f8c16ffd640 1 -- 172.21.15.172:0/534816803 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c037070 con 0x7f8c1815c9e0 2024-04-25T08:46:13.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.257+0000 7f8c16ffd640 1 -- 172.21.15.172:0/534816803 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c032440 con 0x7f8c1815c9e0 2024-04-25T08:46:13.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.257+0000 7f8c16ffd640 1 -- 172.21.15.172:0/534816803 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c02ae60 con 0x7f8c1815c9e0 2024-04-25T08:46:13.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.258+0000 7f8c1e33b640 1 -- 172.21.15.172:0/534816803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815c9e0 msgr2=0x7f8c18071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.258+0000 7f8c1e33b640 1 --2- 172.21.15.172:0/534816803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815c9e0 0x7f8c18071ac0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8c18061950 tx=0x7f8c0c02a110 comp rx=0 tx=0).stop 2024-04-25T08:46:13.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.258+0000 7f8c1e33b640 1 -- 172.21.15.172:0/534816803 shutdown_connections 2024-04-25T08:46:13.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.258+0000 7f8c1e33b640 1 --2- 172.21.15.172:0/534816803 >> v2:172.21.15.186:3300/0 conn(0x7f8c18072000 0x7f8c1806abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.258+0000 7f8c1e33b640 1 --2- 172.21.15.172:0/534816803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815c9e0 0x7f8c18071ac0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.258+0000 7f8c1e33b640 1 -- 172.21.15.172:0/534816803 >> 172.21.15.172:0/534816803 conn(0x7f8c180af670 msgr2=0x7f8c180b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:13.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.258+0000 7f8c1e33b640 1 -- 172.21.15.172:0/534816803 shutdown_connections 2024-04-25T08:46:13.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.258+0000 7f8c1e33b640 1 -- 172.21.15.172:0/534816803 wait complete. 2024-04-25T08:46:13.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.259+0000 7f8c1e33b640 1 Processor -- start 2024-04-25T08:46:13.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.259+0000 7f8c1e33b640 1 -- start start 2024-04-25T08:46:13.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1e33b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c18155fe0 0x7f8c180b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1e33b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c1815c9e0 0x7f8c1815a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1e33b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815ae90 0x7f8c18143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1e33b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c181563c0 con 0x7f8c1815ae90 2024-04-25T08:46:13.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1e33b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180ad6a0 con 0x7f8c1815c9e0 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1e33b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1806f880 con 0x7f8c18155fe0 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1c8d8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815ae90 0x7f8c18143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1c8d8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815ae90 0x7f8c18143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59304/0 (socket says 172.21.15.172:59304) 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1c8d8640 1 -- 172.21.15.172:0/2555676041 learned_addr learned my addr 172.21.15.172:0/2555676041 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c177fe640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c1815c9e0 0x7f8c1815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1c8d8640 1 -- 172.21.15.172:0/2555676041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c18155fe0 msgr2=0x7f8c180b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c17fff640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c18155fe0 0x7f8c180b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1c8d8640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c18155fe0 0x7f8c180b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1c8d8640 1 -- 172.21.15.172:0/2555676041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c1815c9e0 msgr2=0x7f8c1815a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1c8d8640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c1815c9e0 0x7f8c1815a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.260+0000 7f8c1c8d8640 1 -- 172.21.15.172:0/2555676041 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18144070 con 0x7f8c1815ae90 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.261+0000 7f8c177fe640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c1815c9e0 0x7f8c1815a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.261+0000 7f8c17fff640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c18155fe0 0x7f8c180b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.261+0000 7f8c1c8d8640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815ae90 0x7f8c18143300 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f8c10007d20 tx=0x7f8c1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:13.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.261+0000 7f8c14ff9640 1 -- 172.21.15.172:0/2555676041 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10014420 con 0x7f8c1815ae90 2024-04-25T08:46:13.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.261+0000 7f8c14ff9640 1 -- 172.21.15.172:0/2555676041 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c10019070 con 0x7f8c1815ae90 2024-04-25T08:46:13.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.261+0000 7f8c1e33b640 1 -- 172.21.15.172:0/2555676041 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c18144350 con 0x7f8c1815ae90 2024-04-25T08:46:13.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.261+0000 7f8c14ff9640 1 -- 172.21.15.172:0/2555676041 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10014820 con 0x7f8c1815ae90 2024-04-25T08:46:13.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.261+0000 7f8c1e33b640 1 -- 172.21.15.172:0/2555676041 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c18144910 con 0x7f8c1815ae90 2024-04-25T08:46:13.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.262+0000 7f8c1e33b640 1 -- 172.21.15.172:0/2555676041 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c18073990 con 0x7f8c1815ae90 2024-04-25T08:46:13.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.262+0000 7f8c14ff9640 1 -- 172.21.15.172:0/2555676041 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8c100149c0 con 0x7f8c1815ae90 2024-04-25T08:46:13.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.263+0000 7f8c14ff9640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c0406b4d0 0x7f8c0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.263+0000 7f8c14ff9640 1 -- 172.21.15.172:0/2555676041 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8c1008ac20 con 0x7f8c1815ae90 2024-04-25T08:46:13.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.263+0000 7f8c17fff640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c0406b4d0 0x7f8c0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.263+0000 7f8c17fff640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c0406b4d0 0x7f8c0406d990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8c08000f60 tx=0x7f8c08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:13.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.267+0000 7f8c14ff9640 1 -- 172.21.15.172:0/2555676041 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c10011260 con 0x7f8c1815ae90 2024-04-25T08:46:13.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.473+0000 7f8c1e33b640 1 -- 172.21.15.172:0/2555676041 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c180b20e0 con 0x7f8c1815ae90 2024-04-25T08:46:13.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.473+0000 7f8c14ff9640 1 -- 172.21.15.172:0/2555676041 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f8c10059910 con 0x7f8c1815ae90 2024-04-25T08:46:13.465 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:13.465 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/1572465264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":1572465264},{"type":"v1","addr":"172.21.15.186:6835","nonce":1572465264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6696,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/611108095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":611108095},{"type":"v1","addr":"172.21.15.172:6835","nonce":611108095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3538685014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3538685014},{"type":"v1","addr":"172.21.15.172:6837","nonce":3538685014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:08.789050+0000","modified":"2024-04-25T08:46:10.801148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6705},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6705":{"gid":6705,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6834/550125910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":550125910},{"type":"v1","addr":"172.21.15.186:6834","nonce":550125910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:46:13.465 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 34 2024-04-25T08:46:13.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 -- 172.21.15.172:0/2555676041 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c0406b4d0 msgr2=0x7f8c0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c0406b4d0 0x7f8c0406d990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8c08000f60 tx=0x7f8c08009040 comp rx=0 tx=0).stop 2024-04-25T08:46:13.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 -- 172.21.15.172:0/2555676041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815ae90 msgr2=0x7f8c18143300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815ae90 0x7f8c18143300 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f8c10007d20 tx=0x7f8c1000e4b0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 -- 172.21.15.172:0/2555676041 shutdown_connections 2024-04-25T08:46:13.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8c0406b4d0 0x7f8c0406d990 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c1815c9e0 0x7f8c1815a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c1815ae90 0x7f8c18143300 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 --2- 172.21.15.172:0/2555676041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c18155fe0 0x7f8c180b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 -- 172.21.15.172:0/2555676041 >> 172.21.15.172:0/2555676041 conn(0x7f8c18072000 msgr2=0x7f8c180cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:13.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 -- 172.21.15.172:0/2555676041 shutdown_connections 2024-04-25T08:46:13.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.475+0000 7f8c1e33b640 1 -- 172.21.15.172:0/2555676041 wait complete. 2024-04-25T08:46:13.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:46:08.789050+0000', 'modified': '2024-04-25T08:46:10.801148+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6705}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6705': {'gid': 6705, 'name': 'b', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6834/550125910', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6832', 'nonce': 550125910}, {'type': 'v1', 'addr': '172.21.15.186:6834', 'nonce': 550125910}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:46:13.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:46:13.883 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T08:46:13.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.992+0000 7fcdb33f4640 1 Processor -- start 2024-04-25T08:46:13.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.993+0000 7fcdb33f4640 1 -- start start 2024-04-25T08:46:13.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.993+0000 7fcdb33f4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcdac15dc20 0x7fcdac0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.993+0000 7fcdb33f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdac161710 0x7fcdac0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.993+0000 7fcdb33f4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac15e000 con 0x7fcdac0b9330 2024-04-25T08:46:13.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.993+0000 7fcdb33f4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0d1de0 con 0x7fcdac15dc20 2024-04-25T08:46:13.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.993+0000 7fcdb33f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac161c60 con 0x7fcdac161710 2024-04-25T08:46:13.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.993+0000 7fcdb1190640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcdac15dc20 0x7fcdac0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.993+0000 7fcdb1991640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcdac0b9330 0x7fcdac06bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39710/0 (socket says 172.21.15.172:39710) 2024-04-25T08:46:13.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.993+0000 7fcdb1991640 1 -- 172.21.15.172:0/159610374 learned_addr learned my addr 172.21.15.172:0/159610374 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:13.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.994+0000 7fcdb098f640 1 --2- 172.21.15.172:0/159610374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdac161710 0x7fcdac0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.994+0000 7fcdb1190640 1 -- 172.21.15.172:0/159610374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdac161710 msgr2=0x7fcdac0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:13.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.994+0000 7fcdb1190640 1 --2- 172.21.15.172:0/159610374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdac161710 0x7fcdac0cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.994+0000 7fcdb1190640 1 -- 172.21.15.172:0/159610374 >> v1:172.21.15.172:6789/0 conn(0x7fcdac0b9330 legacy=0x7fcdac06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.994+0000 7fcdabfff640 1 -- 172.21.15.172:0/159610374 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666957007 0 0) 0x7fcdac15e000 con 0x7fcdac0b9330 2024-04-25T08:46:13.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.994+0000 7fcdb1190640 1 -- 172.21.15.172:0/159610374 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac161f40 con 0x7fcdac15dc20 2024-04-25T08:46:13.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.994+0000 7fcdb1190640 1 --2- 172.21.15.172:0/159610374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac15dc20 0x7fcdac0ce670 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009d90 tx=0x7fcd9c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fe80c9b57b6357 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:13.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdabfff640 1 -- 172.21.15.172:0/159610374 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c007740 con 0x7fcdac15dc20 2024-04-25T08:46:13.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdabfff640 1 -- 172.21.15.172:0/159610374 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0078e0 con 0x7fcdac15dc20 2024-04-25T08:46:13.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdabfff640 1 -- 172.21.15.172:0/159610374 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c007cb0 con 0x7fcdac15dc20 2024-04-25T08:46:13.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdb33f4640 1 -- 172.21.15.172:0/159610374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac15dc20 msgr2=0x7fcdac0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdb33f4640 1 --2- 172.21.15.172:0/159610374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac15dc20 0x7fcdac0ce670 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009d90 tx=0x7fcd9c02a660 comp rx=0 tx=0).stop 2024-04-25T08:46:13.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdb33f4640 1 -- 172.21.15.172:0/159610374 shutdown_connections 2024-04-25T08:46:13.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdb33f4640 1 --2- 172.21.15.172:0/159610374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdac161710 0x7fcdac0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdb33f4640 1 --2- 172.21.15.172:0/159610374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac15dc20 0x7fcdac0ce670 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdb33f4640 1 -- 172.21.15.172:0/159610374 >> 172.21.15.172:0/159610374 conn(0x7fcdac0d0420 msgr2=0x7fcdac0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:13.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdb33f4640 1 -- 172.21.15.172:0/159610374 shutdown_connections 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.995+0000 7fcdb33f4640 1 -- 172.21.15.172:0/159610374 wait complete. 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.996+0000 7fcdb33f4640 1 Processor -- start 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.996+0000 7fcdb33f4640 1 -- start start 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb33f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdac0b9330 0x7fcdac0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb33f4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdac15dc20 0x7fcdac1f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb33f4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac161710 0x7fcdac1f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb33f4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0b5e50 con 0x7fcdac161710 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb33f4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac162500 con 0x7fcdac15dc20 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb33f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0b5fd0 con 0x7fcdac0b9330 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb1991640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac161710 0x7fcdac1f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb1991640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac161710 0x7fcdac1f69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59318/0 (socket says 172.21.15.172:59318) 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb1991640 1 -- 172.21.15.172:0/2826806682 learned_addr learned my addr 172.21.15.172:0/2826806682 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb1991640 1 -- 172.21.15.172:0/2826806682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdac0b9330 msgr2=0x7fcdac0cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb1190640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdac0b9330 0x7fcdac0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb098f640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdac15dc20 0x7fcdac1f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb1991640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdac0b9330 0x7fcdac0cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb1991640 1 -- 172.21.15.172:0/2826806682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdac15dc20 msgr2=0x7fcdac1f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb1991640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdac15dc20 0x7fcdac1f2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.997+0000 7fcdb1991640 1 -- 172.21.15.172:0/2826806682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0cbad0 con 0x7fcdac161710 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.998+0000 7fcdb1991640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac161710 0x7fcdac1f69d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fcda400c410 tx=0x7fcda400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.998+0000 7fcda9ffb640 1 -- 172.21.15.172:0/2826806682 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda40074e0 con 0x7fcdac161710 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.998+0000 7fcda9ffb640 1 -- 172.21.15.172:0/2826806682 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda4007680 con 0x7fcdac161710 2024-04-25T08:46:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.998+0000 7fcdb33f4640 1 -- 172.21.15.172:0/2826806682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac0cbdb0 con 0x7fcdac161710 2024-04-25T08:46:13.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.998+0000 7fcda9ffb640 1 -- 172.21.15.172:0/2826806682 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4004a20 con 0x7fcdac161710 2024-04-25T08:46:13.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.998+0000 7fcdb33f4640 1 -- 172.21.15.172:0/2826806682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac0cc370 con 0x7fcdac161710 2024-04-25T08:46:14.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:13.999+0000 7fcda9ffb640 1 -- 172.21.15.172:0/2826806682 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcda4011070 con 0x7fcdac161710 2024-04-25T08:46:14.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.000+0000 7fcda9ffb640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd9806b500 0x7fcd9806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.000+0000 7fcda9ffb640 1 -- 172.21.15.172:0/2826806682 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcda4089e20 con 0x7fcdac161710 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.000+0000 7fcdb1190640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd9806b500 0x7fcd9806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.000+0000 7fcdb1190640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd9806b500 0x7fcd9806d9c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c034000 tx=0x7fcd9c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb61cb740 1 Processor -- start 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb61cb740 1 -- start start 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f620610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f63e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f5f5f10 0x55f37f63c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37f558a10 con 0x55f37f620230 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37f501b30 con 0x55f37f5f5f10 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f37f554c50 con 0x55f37f63dad0 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb1190640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f620610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb1190640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f620610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59332/0 (socket says 172.21.15.172:59332) 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.001+0000 7fcdb1190640 1 -- 172.21.15.172:0/1380553097 learned_addr learned my addr 172.21.15.172:0/1380553097 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcdb1991640 1 --2- 172.21.15.172:0/1380553097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f5f5f10 0x55f37f63c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcdb098f640 1 --2- 172.21.15.172:0/1380553097 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f63e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcdb1190640 1 -- 172.21.15.172:0/1380553097 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 msgr2=0x55f37f63e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcdb1190640 1 --2- 172.21.15.172:0/1380553097 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f63e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcdb1190640 1 -- 172.21.15.172:0/1380553097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f5f5f10 msgr2=0x55f37f63c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcdb1190640 1 --2- 172.21.15.172:0/1380553097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f5f5f10 0x55f37f63c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcdb1190640 1 -- 172.21.15.172:0/1380553097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f37f516e10 con 0x55f37f620230 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcdb1190640 1 --2- 172.21.15.172:0/1380553097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f620610 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c02ac50 tx=0x7fcd9c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e70ead8f4fc118 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcd92ffd640 1 -- 172.21.15.172:0/1380553097 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c04d070 con 0x55f37f620230 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcd92ffd640 1 -- 172.21.15.172:0/1380553097 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c004850 con 0x55f37f620230 2024-04-25T08:46:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.002+0000 7fcd92ffd640 1 -- 172.21.15.172:0/1380553097 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c007760 con 0x55f37f620230 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1380553097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 msgr2=0x55f37f620610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/1380553097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f620610 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c02ac50 tx=0x7fcd9c02e000 comp rx=0 tx=0).stop 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1380553097 shutdown_connections 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/1380553097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f5f5f10 0x55f37f63c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/1380553097 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f63e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/1380553097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f620610 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1380553097 >> 172.21.15.172:0/1380553097 conn(0x55f37f5f2840 msgr2=0x55f37f63b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1380553097 shutdown_connections 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1380553097 wait complete. 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 -- start start 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.003+0000 7fcdb61cb740 1 Processor -- start 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f620230 0x55f37f61b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f63dad0 0x55f37f623450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f633bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37f5f6cb0 con 0x55f37f633770 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37f5150c0 con 0x55f37f63dad0 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f37f5f0770 con 0x55f37f620230 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb61cb740 10 client.0 _ll_register_callbacks cb 0x55f37f508ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb1991640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f633bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb1991640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f633bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59346/0 (socket says 172.21.15.172:59346) 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb1991640 1 -- 172.21.15.172:0/4054469210 learned_addr learned my addr 172.21.15.172:0/4054469210 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb098f640 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f63dad0 0x55f37f623450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.004+0000 7fcdb1190640 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f620230 0x55f37f61b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb1991640 1 -- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f620230 msgr2=0x55f37f61b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb1991640 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f620230 0x55f37f61b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb1991640 1 -- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f63dad0 msgr2=0x55f37f623450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb1991640 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f63dad0 0x55f37f623450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb1991640 1 -- 172.21.15.172:0/4054469210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f37f26d2d0 con 0x55f37f633770 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb1991640 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f633bf0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fcda40583a0 tx=0x7fcda405c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d988503ea27aded6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcd8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcd8bfff640 1 -- 172.21.15.172:0/4054469210 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda405c350 con 0x55f37f633770 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4054469210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd9c004850 con 0x55f37f633770 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcd8bfff640 1 -- 172.21.15.172:0/4054469210 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcda406ecb0 con 0x55f37f633770 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcd8bfff640 1 -- 172.21.15.172:0/4054469210 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcda406eed0 con 0x55f37f633770 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb61cb740 10 client.6855 fetch_fsmap learned FSMap version 34 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4054469210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55f37f3376b0 con 0x55f37f633770 2024-04-25T08:46:14.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcd8bfff640 1 -- 172.21.15.172:0/4054469210 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c004850 con 0x55f37f633770 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcd8bfff640 1 -- 172.21.15.172:0/4054469210 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcda4004bc0 con 0x55f37f633770 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb61cb740 10 client.6855 fetch_fsmap finished waiting for FSMap version 34 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb61cb740 10 client.6855 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb61cb740 20 client.6855 populate_metadata read hostname 'smithi172' 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:6832/550125910,v1:172.21.15.186:6834/550125910] conn(0x55f37f64ee60 0x55f37f621930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb61cb740 4 client.6855 mds_command: new command op to 6705 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4054469210 --> [v2:172.21.15.186:6832/550125910,v1:172.21.15.186:6834/550125910] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f37f5b7920 con 0x55f37f64ee60 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.005+0000 7fcdb1190640 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:6832/550125910,v1:172.21.15.186:6834/550125910] conn(0x55f37f64ee60 0x55f37f621930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.006+0000 7fcdb1190640 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:6832/550125910,v1:172.21.15.186:6834/550125910] conn(0x55f37f64ee60 0x55f37f621930 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e2b3868565c284e server_cookie=aafb27af71eb03ce in_seq=0 out_seq=0 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.006+0000 7fcd8bfff640 10 client.6855 ms_handle_connect on v2:172.21.15.186:6832/550125910 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcd8bfff640 1 -- 172.21.15.172:0/4054469210 <== mds.0 v2:172.21.15.186:6832/550125910 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f37f5b7920 con 0x55f37f64ee60 2024-04-25T08:46:14.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcd8bfff640 10 client.6855 handle_command_reply: tid=0 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 client.6855 shutdown 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4054469210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 msgr2=0x55f37f633bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f633bf0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fcda40583a0 tx=0x7fcda405c6a0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4054469210 shutdown_connections 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:6832/550125910,v1:172.21.15.186:6834/550125910] conn(0x55f37f64ee60 0x55f37f621930 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f63dad0 0x55f37f623450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f633bf0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/4054469210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f620230 0x55f37f61b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcd8bfff640 0 client.6855 ms_handle_reset on v2:172.21.15.186:6832/550125910 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4054469210 >> 172.21.15.172:0/4054469210 conn(0x55f37f5f5f10 msgr2=0x55f37f63ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4054469210 shutdown_connections 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4054469210 wait complete. 2024-04-25T08:46:14.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.007+0000 7fcdb61cb740 20 client.6855 trim_cache size 0 max 16384 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.023+0000 7fcdb61cb740 1 Processor -- start 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.023+0000 7fcdb61cb740 1 -- start start 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.023+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f620230 0x55f37f65dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.023+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f5f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.023+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f5ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.023+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1ff5f0 con 0x55f37f633770 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.023+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac14dd10 con 0x55f37f620230 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.023+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1feff0 con 0x55f37f63dad0 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb098f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f5f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb098f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f5f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59354/0 (socket says 172.21.15.172:59354) 2024-04-25T08:46:14.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb098f640 1 -- 172.21.15.172:0/4128026833 learned_addr learned my addr 172.21.15.172:0/4128026833 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb1991640 1 --2- 172.21.15.172:0/4128026833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f5ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb1190640 1 --2- 172.21.15.172:0/4128026833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f620230 0x55f37f65dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb098f640 1 -- 172.21.15.172:0/4128026833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 msgr2=0x55f37f5ef4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb098f640 1 --2- 172.21.15.172:0/4128026833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f5ef4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb098f640 1 -- 172.21.15.172:0/4128026833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f620230 msgr2=0x55f37f65dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb098f640 1 --2- 172.21.15.172:0/4128026833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f620230 0x55f37f65dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb098f640 1 -- 172.21.15.172:0/4128026833 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f37f63a340 con 0x55f37f633770 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcdb098f640 1 --2- 172.21.15.172:0/4128026833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f5f55e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fcda000d9b0 tx=0x7fcda000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5b7146d169ea91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcd927fc640 1 -- 172.21.15.172:0/4128026833 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0012de0 con 0x55f37f633770 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcd927fc640 1 -- 172.21.15.172:0/4128026833 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda001e410 con 0x55f37f633770 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.024+0000 7fcd927fc640 1 -- 172.21.15.172:0/4128026833 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda001e7c0 con 0x55f37f633770 2024-04-25T08:46:14.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4128026833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 msgr2=0x55f37f5f55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/4128026833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f5f55e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fcda000d9b0 tx=0x7fcda000de70 comp rx=0 tx=0).stop 2024-04-25T08:46:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4128026833 shutdown_connections 2024-04-25T08:46:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/4128026833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f5ef4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/4128026833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f633770 0x55f37f5f55e0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/4128026833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f620230 0x55f37f65dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4128026833 >> 172.21.15.172:0/4128026833 conn(0x55f37f5f5f10 msgr2=0x55f37f63b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4128026833 shutdown_connections 2024-04-25T08:46:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 -- 172.21.15.172:0/4128026833 wait complete. 2024-04-25T08:46:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 -- start start 2024-04-25T08:46:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.025+0000 7fcdb61cb740 1 Processor -- start 2024-04-25T08:46:14.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.026+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f5ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.026+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f633770 0x55f37f6220a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.026+0000 7fcdb61cb740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f64d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.026+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37f64ece0 con 0x55f37f620230 2024-04-25T08:46:14.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.026+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37f6333a0 con 0x55f37f633770 2024-04-25T08:46:14.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.026+0000 7fcdb61cb740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f37f64f250 con 0x55f37f63dad0 2024-04-25T08:46:14.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.026+0000 7fcdb61cb740 10 client.0 _ll_register_callbacks cb 0x55f37f5f0c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:46:14.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.026+0000 7fcdb1190640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f5ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.026+0000 7fcdb1190640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f5ef8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59358/0 (socket says 172.21.15.172:59358) 2024-04-25T08:46:14.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.026+0000 7fcdb1190640 1 -- 172.21.15.172:0/1861973720 learned_addr learned my addr 172.21.15.172:0/1861973720 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:14.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb1190640 1 -- 172.21.15.172:0/1861973720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 msgr2=0x55f37f64d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:14.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb1190640 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f64d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb1190640 1 -- 172.21.15.172:0/1861973720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f633770 msgr2=0x55f37f6220a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb1190640 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f633770 0x55f37f6220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb1190640 1 -- 172.21.15.172:0/1861973720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f37f5efde0 con 0x55f37f620230 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb1190640 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f5ef8a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c000f80 tx=0x7fcd9c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a19e8074d3a4bb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcd8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcd8bfff640 1 -- 172.21.15.172:0/1861973720 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c062060 con 0x55f37f620230 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcd8bfff640 1 -- 172.21.15.172:0/1861973720 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcd9c05d7c0 con 0x55f37f620230 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1861973720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcda001e410 con 0x55f37f620230 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcd8bfff640 1 -- 172.21.15.172:0/1861973720 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd9c068050 con 0x55f37f620230 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb61cb740 10 client.6861 fetch_fsmap learned FSMap version 34 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1861973720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55f37f64e1f0 con 0x55f37f620230 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcd8bfff640 1 -- 172.21.15.172:0/1861973720 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda001e410 con 0x55f37f620230 2024-04-25T08:46:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcd8bfff640 1 -- 172.21.15.172:0/1861973720 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcd9c06b020 con 0x55f37f620230 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb61cb740 10 client.6861 fetch_fsmap finished waiting for FSMap version 34 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb61cb740 10 client.6861 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb61cb740 20 client.6861 populate_metadata read hostname 'smithi172' 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.186:6832/550125910,v1:172.21.15.186:6834/550125910] conn(0x55f37f6a5890 0x55f37f63bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb61cb740 4 client.6861 mds_command: new command op to 6705 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.027+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1861973720 --> [v2:172.21.15.186:6832/550125910,v1:172.21.15.186:6834/550125910] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f37f565f50 con 0x55f37f6a5890 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb098f640 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.186:6832/550125910,v1:172.21.15.186:6834/550125910] conn(0x55f37f6a5890 0x55f37f63bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb098f640 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.186:6832/550125910,v1:172.21.15.186:6834/550125910] conn(0x55f37f6a5890 0x55f37f63bf30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39838307ec11b69b server_cookie=a01378e03c7e4223 in_seq=0 out_seq=0 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcd8bfff640 10 client.6861 ms_handle_connect on v2:172.21.15.186:6832/550125910 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcd8bfff640 1 -- 172.21.15.172:0/1861973720 <== mds.0 v2:172.21.15.186:6832/550125910 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f37f565f50 con 0x55f37f6a5890 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcd8bfff640 10 client.6861 handle_command_reply: tid=0 2024-04-25T08:46:14.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb61cb740 1 client.6861 shutdown 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1861973720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 msgr2=0x55f37f5ef8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f5ef8a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c000f80 tx=0x7fcd9c004ab0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1861973720 shutdown_connections 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.186:6832/550125910,v1:172.21.15.186:6834/550125910] conn(0x55f37f6a5890 0x55f37f63bf30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f37f633770 0x55f37f6220a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f37f63dad0 0x55f37f64d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb61cb740 1 --2- 172.21.15.172:0/1861973720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f37f620230 0x55f37f5ef8a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcd8bfff640 0 client.6861 ms_handle_reset on v2:172.21.15.186:6832/550125910 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.028+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1861973720 >> 172.21.15.172:0/1861973720 conn(0x55f37f5f5f10 msgr2=0x55f37f5ebbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1861973720 shutdown_connections 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb61cb740 1 -- 172.21.15.172:0/1861973720 wait complete. 2024-04-25T08:46:14.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb61cb740 20 client.6861 trim_cache size 0 max 16384 2024-04-25T08:46:14.028 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:46:14.028 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:46:14.028 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:46:14.028 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 6705, 2024-04-25T08:46:14.028 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:46:14.028 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:46:14.028 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:46:14.028 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 4.5656148590000001, 2024-04-25T08:46:14.028 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 34, 2024-04-25T08:46:14.029 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 65, 2024-04-25T08:46:14.029 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 65, 2024-04-25T08:46:14.029 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 9.5972263669999993 2024-04-25T08:46:14.029 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:46:14.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 -- 172.21.15.172:0/2826806682 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd9806b500 msgr2=0x7fcd9806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd9806b500 0x7fcd9806d9c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c034000 tx=0x7fcd9c02f000 comp rx=0 tx=0).stop 2024-04-25T08:46:14.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 -- 172.21.15.172:0/2826806682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac161710 msgr2=0x7fcdac1f69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac161710 0x7fcdac1f69d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fcda400c410 tx=0x7fcda400c8d0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 -- 172.21.15.172:0/2826806682 shutdown_connections 2024-04-25T08:46:14.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd9806b500 0x7fcd9806d9c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdac15dc20 0x7fcdac1f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdac161710 0x7fcdac1f69d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 --2- 172.21.15.172:0/2826806682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdac0b9330 0x7fcdac0cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 -- 172.21.15.172:0/2826806682 >> 172.21.15.172:0/2826806682 conn(0x7fcdac0d0420 msgr2=0x7fcdac0b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:14.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 -- 172.21.15.172:0/2826806682 shutdown_connections 2024-04-25T08:46:14.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.029+0000 7fcdb33f4640 1 -- 172.21.15.172:0/2826806682 wait complete. 2024-04-25T08:46:14.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:46:14.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.137+0000 7f9d3d19e640 1 Processor -- start 2024-04-25T08:46:14.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.138+0000 7f9d3d19e640 1 -- start start 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.138+0000 7f9d3d19e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380b2cb0 0x7f9d380d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.138+0000 7f9d3d19e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9d380d1020 0x7f9d380d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.138+0000 7f9d3d19e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d380b97a0 con 0x7f9d3815dbe0 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.138+0000 7f9d3d19e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3815dfc0 con 0x7f9d380d1020 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.138+0000 7f9d3d19e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380d1a00 con 0x7f9d380b2cb0 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.138+0000 7f9d3759e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9d380d1020 0x7f9d380d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.138+0000 7f9d36d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9d3815dbe0 0x7f9d380d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39714/0 (socket says 172.21.15.172:39714) 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.138+0000 7f9d36d9d640 1 -- 172.21.15.172:0/3588722099 learned_addr learned my addr 172.21.15.172:0/3588722099 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.138+0000 7f9d3759e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9d380d1020 0x7f9d380d2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59364/0 (socket says 172.21.15.172:59364) 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.139+0000 7f9d2ffff640 1 --2- 172.21.15.172:0/3588722099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380b2cb0 0x7f9d380d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.139+0000 7f9d3759e640 1 -- 172.21.15.172:0/3588722099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380b2cb0 msgr2=0x7f9d380d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.139+0000 7f9d3759e640 1 --2- 172.21.15.172:0/3588722099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380b2cb0 0x7f9d380d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.139+0000 7f9d3759e640 1 -- 172.21.15.172:0/3588722099 >> v1:172.21.15.172:6789/0 conn(0x7f9d3815dbe0 legacy=0x7f9d380d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.139+0000 7f9d3759e640 1 -- 172.21.15.172:0/3588722099 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380d1c50 con 0x7f9d380d1020 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.139+0000 7f9d3759e640 1 --2- 172.21.15.172:0/3588722099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380d1020 0x7f9d380d2c70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009d90 tx=0x7f9d3002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b03cfe5428e980 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3659c640 1 -- 172.21.15.172:0/3588722099 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30007740 con 0x7f9d380d1020 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3659c640 1 -- 172.21.15.172:0/3588722099 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d300078e0 con 0x7f9d380d1020 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3659c640 1 -- 172.21.15.172:0/3588722099 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30007cb0 con 0x7f9d380d1020 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3588722099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380d1020 msgr2=0x7f9d380d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3d19e640 1 --2- 172.21.15.172:0/3588722099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380d1020 0x7f9d380d2c70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009d90 tx=0x7f9d3002a660 comp rx=0 tx=0).stop 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3588722099 shutdown_connections 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3d19e640 1 --2- 172.21.15.172:0/3588722099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380b2cb0 0x7f9d380d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3d19e640 1 --2- 172.21.15.172:0/3588722099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380d1020 0x7f9d380d2c70 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3588722099 >> 172.21.15.172:0/3588722099 conn(0x7f9d38061a20 msgr2=0x7f9d38061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3588722099 shutdown_connections 2024-04-25T08:46:14.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.140+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3588722099 wait complete. 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.141+0000 7f9d3d19e640 1 Processor -- start 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.142+0000 7f9d3d19e640 1 -- start start 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.142+0000 7f9d3d19e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380b2cb0 0x7f9d38153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.142+0000 7f9d3d19e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380d1020 0x7f9d38156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.142+0000 7f9d3d19e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3815dbe0 0x7f9d380b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.142+0000 7f9d3d19e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380b92a0 con 0x7f9d380b2cb0 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.142+0000 7f9d3d19e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380d2210 con 0x7f9d3815dbe0 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.142+0000 7f9d3d19e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380b9420 con 0x7f9d380d1020 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.142+0000 7f9d36d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380b2cb0 0x7f9d38153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.142+0000 7f9d36d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380b2cb0 0x7f9d38153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59370/0 (socket says 172.21.15.172:59370) 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.142+0000 7f9d36d9d640 1 -- 172.21.15.172:0/3471439457 learned_addr learned my addr 172.21.15.172:0/3471439457 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d2ffff640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380d1020 0x7f9d38156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d3759e640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3815dbe0 0x7f9d380b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d36d9d640 1 -- 172.21.15.172:0/3471439457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380d1020 msgr2=0x7f9d38156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d36d9d640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380d1020 0x7f9d38156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d36d9d640 1 -- 172.21.15.172:0/3471439457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3815dbe0 msgr2=0x7f9d380b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d36d9d640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3815dbe0 0x7f9d380b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d36d9d640 1 -- 172.21.15.172:0/3471439457 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380b3340 con 0x7f9d380b2cb0 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d2ffff640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380d1020 0x7f9d38156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d36d9d640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380b2cb0 0x7f9d38153610 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800c3f0 tx=0x7f9d2800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d2f7fe640 1 -- 172.21.15.172:0/3471439457 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d28017070 con 0x7f9d380b2cb0 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d2f7fe640 1 -- 172.21.15.172:0/3471439457 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d28005ce0 con 0x7f9d380b2cb0 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3471439457 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d380b35e0 con 0x7f9d380b2cb0 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d2f7fe640 1 -- 172.21.15.172:0/3471439457 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d280072f0 con 0x7f9d380b2cb0 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.143+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3471439457 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d380b3ba0 con 0x7f9d380b2cb0 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.144+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3471439457 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d38073990 con 0x7f9d380b2cb0 2024-04-25T08:46:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.144+0000 7f9d2f7fe640 1 -- 172.21.15.172:0/3471439457 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d2801a070 con 0x7f9d380b2cb0 2024-04-25T08:46:14.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.145+0000 7f9d2f7fe640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d1806b4d0 0x7f9d1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:14.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.145+0000 7f9d2ffff640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d1806b4d0 0x7f9d1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:14.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.145+0000 7f9d2f7fe640 1 -- 172.21.15.172:0/3471439457 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9d28089730 con 0x7f9d380b2cb0 2024-04-25T08:46:14.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.145+0000 7f9d2ffff640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d1806b4d0 0x7f9d1806d990 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9d380d4060 tx=0x7f9d20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:14.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.149+0000 7f9d2f7fe640 1 -- 172.21.15.172:0/3471439457 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d28058420 con 0x7f9d380b2cb0 2024-04-25T08:46:14.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.356+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3471439457 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9d380b2a90 con 0x7f9d380b2cb0 2024-04-25T08:46:14.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.356+0000 7f9d2f7fe640 1 -- 172.21.15.172:0/3471439457 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9d28057d20 con 0x7f9d380b2cb0 2024-04-25T08:46:14.348 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:46:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3471439457 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d1806b4d0 msgr2=0x7f9d1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d1806b4d0 0x7f9d1806d990 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9d380d4060 tx=0x7f9d20008040 comp rx=0 tx=0).stop 2024-04-25T08:46:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3471439457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380b2cb0 msgr2=0x7f9d38153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380b2cb0 0x7f9d38153610 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800c3f0 tx=0x7f9d2800c8b0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3471439457 shutdown_connections 2024-04-25T08:46:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d1806b4d0 0x7f9d1806d990 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d3815dbe0 0x7f9d380b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9d380d1020 0x7f9d38156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 --2- 172.21.15.172:0/3471439457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d380b2cb0 0x7f9d38153610 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:14.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3471439457 >> 172.21.15.172:0/3471439457 conn(0x7f9d38061a20 msgr2=0x7f9d3815b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:14.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3471439457 shutdown_connections 2024-04-25T08:46:14.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:14.358+0000 7f9d3d19e640 1 -- 172.21.15.172:0/3471439457 wait complete. 2024-04-25T08:46:14.361 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:46:14.361 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:46:14.361 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:46:14.361 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:46:14.361 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:46:14.361 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:46:14.361 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:46:14.361 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:46:14.361 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:46:14.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:14.362 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:46:14.377 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:46:14.377 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:46:14.377 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:46:14.377 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:14.377 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:46:14.377 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:14.377 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:46:14.377 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:46:14.377 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42544sec preferred_lft 42544sec 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:46:14.378 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether de:e6:d5:6e:7d:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::dce6:d5ff:fe6e:7d91/64 scope link 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:14.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:14.380 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:46:14.439 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:46:14.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:14.441 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:46:14.497 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:46:14.497 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:46:14.497 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:46:14.497 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:46:14.497 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:46:14.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:14.497 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:46:14.498 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:46:14.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:46:14.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:46:14.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:46:14.498 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:46:14.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:14.581 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:46:14.636 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:46:14.636 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:46:14.636 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:46:14.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:14.636 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:46:14.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:46:14.700 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:46:14.724 INFO:tasks.ceph.mds.b.smithi186.stderr:2024-04-25T08:46:14.733+0000 7f6e7d22e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:46:14.755 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:46:14.755 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:46:14.755 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:46:14.809 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:46:14.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:14.810 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:46:14.891 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:46:14.891 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:46:14.891 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:46:14.900 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:46:14.900 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:46:14.900 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:46:14.900 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:46:14.900 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:46:14.907 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:46:14.907 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:46:14.907 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:46:14.907 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:46:14.907 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:46:14.907 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:46:14.907 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:46:14.907 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:46:14.909 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:46:14.910 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:46:14.910 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:46:14.910 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:46:14.910 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:46:14.910 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:46:14.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:14.910 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:46:14.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:14.981 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:46:15.043 INFO:teuthology.orchestra.run.smithi172.stdout:client6073 2024-04-25T08:46:15.043 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:15.043 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:15.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:15.098 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-04-25T08:46:15.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:15.158 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-04-25T08:46:15.215 DEBUG:teuthology.orchestra.run.smithi172:> stdin-killer -- python3 -c ' 2024-04-25T08:46:15.216 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-04-25T08:46:15.216 DEBUG:teuthology.orchestra.run.smithi172:> import stat 2024-04-25T08:46:15.216 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:46:15.216 DEBUG:teuthology.orchestra.run.smithi172:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-04-25T08:46:15.216 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-04-25T08:46:15.319 INFO:teuthology.orchestra.run.smithi172.stdout:1099511627776 2024-04-25T08:46:15.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:46:15.328 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:15.328 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:15.383 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:15.384 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:15.438 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:15.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.585+0000 7f530e19d640 1 Processor -- start 2024-04-25T08:46:15.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.585+0000 7f530e19d640 1 -- start start 2024-04-25T08:46:15.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f530e19d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f53080cfec0 0x7f53080cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f530e19d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53080ce3c0 0x7f530806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f530e19d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5308071480 con 0x7f5308154ee0 2024-04-25T08:46:15.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f530e19d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080ce830 con 0x7f53080cfec0 2024-04-25T08:46:15.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f530e19d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5308072090 con 0x7f53080ce3c0 2024-04-25T08:46:15.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53077fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5308154ee0 0x7f53080cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39720/0 (socket says 172.21.15.172:39720) 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53077fe640 1 -- 172.21.15.172:0/935292617 learned_addr learned my addr 172.21.15.172:0/935292617 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102623497 0 0) 0x7f5308071480 con 0x7f5308154ee0 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f0003520 con 0x7f5308154ee0 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f5306ffd640 1 --2- 172.21.15.172:0/935292617 >> v2:172.21.15.186:3300/0 conn(0x7f53080cfec0 0x7f53080cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f5307fff640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53080ce3c0 0x7f530806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1704472339 0 0) 0x7f52f0003520 con 0x7f5308154ee0 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53080ce3c0 msgr2=0x7f530806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53067fc640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53080ce3c0 0x7f530806d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 >> v2:172.21.15.186:3300/0 conn(0x7f53080cfec0 msgr2=0x7f53080cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53067fc640 1 --2- 172.21.15.172:0/935292617 >> v2:172.21.15.186:3300/0 conn(0x7f53080cfec0 0x7f53080cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5308071760 con 0x7f5308154ee0 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f52f8001670 con 0x7f5308154ee0 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f5306ffd640 1 --2- 172.21.15.172:0/935292617 >> v2:172.21.15.186:3300/0 conn(0x7f53080cfec0 0x7f53080cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:15.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.586+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 >> v1:172.21.15.172:6789/0 conn(0x7f5308154ee0 legacy=0x7f53080cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53067fc640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52f00039b0 0x7f52f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53067fc640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53080ce3c0 0x7f52f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53067fc640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52f0004d40 0x7f52f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53080ce830 con 0x7f52f00039b0 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f000b9c0 con 0x7f52f0004d40 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f000bb70 con 0x7f53080ce3c0 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53077fe640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52f00039b0 0x7f52f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f5306ffd640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53080ce3c0 0x7f52f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f5307fff640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52f0004d40 0x7f52f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53077fe640 1 -- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53080ce3c0 msgr2=0x7f52f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53077fe640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53080ce3c0 0x7f52f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53077fe640 1 -- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52f0004d40 msgr2=0x7f52f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53077fe640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52f0004d40 0x7f52f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f53077fe640 1 -- 172.21.15.172:0/935292617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0003520 con 0x7f52f00039b0 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.587+0000 7f5307fff640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52f0004d40 0x7f52f00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f53077fe640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52f00039b0 0x7f52f0003dd0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f52f8007fd0 tx=0x7f52f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf31f07772800e10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8007d50 con 0x7f52f00039b0 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f8005ad0 con 0x7f52f00039b0 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f53067fc640 1 -- 172.21.15.172:0/935292617 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8007070 con 0x7f52f00039b0 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f530e19d640 1 -- 172.21.15.172:0/935292617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52f00039b0 msgr2=0x7f52f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f530e19d640 1 --2- 172.21.15.172:0/935292617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52f00039b0 0x7f52f0003dd0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f52f8007fd0 tx=0x7f52f0005830 comp rx=0 tx=0).stop 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f5307fff640 1 -- 172.21.15.172:0/935292617 reap_dead start 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f530e19d640 1 -- 172.21.15.172:0/935292617 shutdown_connections 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f530e19d640 1 -- 172.21.15.172:0/935292617 >> 172.21.15.172:0/935292617 conn(0x7f530806abe0 msgr2=0x7f530806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f530e19d640 1 -- 172.21.15.172:0/935292617 shutdown_connections 2024-04-25T08:46:15.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.588+0000 7f530e19d640 1 -- 172.21.15.172:0/935292617 wait complete. 2024-04-25T08:46:15.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.589+0000 7f530e19d640 1 Processor -- start 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.590+0000 7f530e19d640 1 -- start start 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.590+0000 7f530e19d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52f00039b0 0x7f53081f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.590+0000 7f530e19d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53081467b0 0x7f53080b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.590+0000 7f530e19d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5308146c30 0x7f53080b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.590+0000 7f530e19d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308071d20 con 0x7f53081467b0 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.590+0000 7f530e19d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308071230 con 0x7f5308146c30 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.590+0000 7f530e19d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53081552c0 con 0x7f52f00039b0 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.590+0000 7f5306ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53081467b0 0x7f53080b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.590+0000 7f5306ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53081467b0 0x7f53080b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59392/0 (socket says 172.21.15.172:59392) 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.590+0000 7f5306ffd640 1 -- 172.21.15.172:0/2989408111 learned_addr learned my addr 172.21.15.172:0/2989408111 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f53077fe640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52f00039b0 0x7f53081f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f5307fff640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5308146c30 0x7f53080b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f5306ffd640 1 -- 172.21.15.172:0/2989408111 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52f00039b0 msgr2=0x7f53081f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f5306ffd640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52f00039b0 0x7f53081f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f5306ffd640 1 -- 172.21.15.172:0/2989408111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5308146c30 msgr2=0x7f53080b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f5306ffd640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5308146c30 0x7f53080b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f5306ffd640 1 -- 172.21.15.172:0/2989408111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080ae0f0 con 0x7f53081467b0 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f5306ffd640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53081467b0 0x7f53080b3f90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0116d0 tx=0x7f52fc011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f52effff640 1 -- 172.21.15.172:0/2989408111 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc019070 con 0x7f53081467b0 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f52effff640 1 -- 172.21.15.172:0/2989408111 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc004220 con 0x7f53081467b0 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f52effff640 1 -- 172.21.15.172:0/2989408111 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc00f040 con 0x7f53081467b0 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f530e19d640 1 -- 172.21.15.172:0/2989408111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53081f7ac0 con 0x7f53081467b0 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.591+0000 7f530e19d640 1 -- 172.21.15.172:0/2989408111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53081f39d0 con 0x7f53081467b0 2024-04-25T08:46:15.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.592+0000 7f530e19d640 1 -- 172.21.15.172:0/2989408111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5308073990 con 0x7f53081467b0 2024-04-25T08:46:15.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.593+0000 7f52effff640 1 -- 172.21.15.172:0/2989408111 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52fc00f760 con 0x7f53081467b0 2024-04-25T08:46:15.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.593+0000 7f52effff640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52f406b4d0 0x7f52f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.593+0000 7f53077fe640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52f406b4d0 0x7f52f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.593+0000 7f52effff640 1 -- 172.21.15.172:0/2989408111 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f52fc08a630 con 0x7f53081467b0 2024-04-25T08:46:15.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.594+0000 7f53077fe640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52f406b4d0 0x7f52f406d990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f52f8007fd0 tx=0x7f52f8009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:15.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.597+0000 7f52effff640 1 -- 172.21.15.172:0/2989408111 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52fc059320 con 0x7f53081467b0 2024-04-25T08:46:15.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.770+0000 7f530e19d640 1 -- 172.21.15.172:0/2989408111 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53080ae930 con 0x7f53081467b0 2024-04-25T08:46:15.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.771+0000 7f52effff640 1 -- 172.21.15.172:0/2989408111 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16944 (secure 0 0 0) 0x7f52fc058c20 con 0x7f53081467b0 2024-04-25T08:46:15.763 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:15.763 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":65,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:10.450849+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:07.009926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:07.764108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 -- 172.21.15.172:0/2989408111 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52f406b4d0 msgr2=0x7f52f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52f406b4d0 0x7f52f406d990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f52f8007fd0 tx=0x7f52f8009030 comp rx=0 tx=0).stop 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 -- 172.21.15.172:0/2989408111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53081467b0 msgr2=0x7f53080b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53081467b0 0x7f53080b3f90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0116d0 tx=0x7f52fc011b90 comp rx=0 tx=0).stop 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 -- 172.21.15.172:0/2989408111 shutdown_connections 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52f406b4d0 0x7f52f406d990 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5308146c30 0x7f53080b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53081467b0 0x7f53080b3f90 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 --2- 172.21.15.172:0/2989408111 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52f00039b0 0x7f53081f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 -- 172.21.15.172:0/2989408111 >> 172.21.15.172:0/2989408111 conn(0x7f530806abe0 msgr2=0x7f53080b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:15.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 -- 172.21.15.172:0/2989408111 shutdown_connections 2024-04-25T08:46:15.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.773+0000 7f530e19d640 1 -- 172.21.15.172:0/2989408111 wait complete. 2024-04-25T08:46:15.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:46:07.009926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:46:07.764108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:46:15.776 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:46:15.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.884+0000 7f5b499c1640 1 Processor -- start 2024-04-25T08:46:15.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.885+0000 7f5b499c1640 1 -- start start 2024-04-25T08:46:15.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.885+0000 7f5b499c1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5b440d0ab0 0x7f5b44168670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.885+0000 7f5b499c1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b440d2420 con 0x7f5b440d34c0 2024-04-25T08:46:15.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.885+0000 7f5b499c1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b440d2700 con 0x7f5b4415dac0 2024-04-25T08:46:15.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.885+0000 7f5b499c1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b440d3030 con 0x7f5b440d0ab0 2024-04-25T08:46:15.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.885+0000 7f5b437fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5b440d0ab0 0x7f5b44168670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.885+0000 7f5b427fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5b440d34c0 0x7f5b440d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39736/0 (socket says 172.21.15.172:39736) 2024-04-25T08:46:15.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.885+0000 7f5b427fc640 1 -- 172.21.15.172:0/4257386689 learned_addr learned my addr 172.21.15.172:0/4257386689 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:15.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.886+0000 7f5b437fe640 1 -- 172.21.15.172:0/4257386689 >> v1:172.21.15.186:6789/0 conn(0x7f5b4415dac0 legacy=0x7f5b440d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:15.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.886+0000 7f5b437fe640 1 -- 172.21.15.172:0/4257386689 >> v1:172.21.15.172:6789/0 conn(0x7f5b440d34c0 legacy=0x7f5b440d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:15.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.886+0000 7f5b437fe640 1 -- 172.21.15.172:0/4257386689 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b440d29e0 con 0x7f5b440d0ab0 2024-04-25T08:46:15.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.886+0000 7f5b41ffb640 1 -- 172.21.15.172:0/4257386689 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784668826 0 0) 0x7f5b440d2420 con 0x7f5b440d34c0 2024-04-25T08:46:15.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.886+0000 7f5b437fe640 1 --2- 172.21.15.172:0/4257386689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b440d0ab0 0x7f5b44168670 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5b440d31b0 tx=0x7f5b3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84af592d9554634c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:15.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.887+0000 7f5b41ffb640 1 -- 172.21.15.172:0/4257386689 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c037070 con 0x7f5b440d0ab0 2024-04-25T08:46:15.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.887+0000 7f5b41ffb640 1 -- 172.21.15.172:0/4257386689 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c032440 con 0x7f5b440d0ab0 2024-04-25T08:46:15.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.887+0000 7f5b41ffb640 1 -- 172.21.15.172:0/4257386689 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c032810 con 0x7f5b440d0ab0 2024-04-25T08:46:15.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.887+0000 7f5b499c1640 1 -- 172.21.15.172:0/4257386689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b440d0ab0 msgr2=0x7f5b44168670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:15.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.887+0000 7f5b499c1640 1 --2- 172.21.15.172:0/4257386689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b440d0ab0 0x7f5b44168670 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5b440d31b0 tx=0x7f5b3c02a270 comp rx=0 tx=0).stop 2024-04-25T08:46:15.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.887+0000 7f5b499c1640 1 -- 172.21.15.172:0/4257386689 shutdown_connections 2024-04-25T08:46:15.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.887+0000 7f5b499c1640 1 --2- 172.21.15.172:0/4257386689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b440d0ab0 0x7f5b44168670 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.887+0000 7f5b499c1640 1 -- 172.21.15.172:0/4257386689 >> 172.21.15.172:0/4257386689 conn(0x7f5b44061c30 msgr2=0x7f5b4406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:15.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.887+0000 7f5b499c1640 1 -- 172.21.15.172:0/4257386689 shutdown_connections 2024-04-25T08:46:15.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.887+0000 7f5b499c1640 1 -- 172.21.15.172:0/4257386689 wait complete. 2024-04-25T08:46:15.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.888+0000 7f5b499c1640 1 Processor -- start 2024-04-25T08:46:15.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.888+0000 7f5b499c1640 1 -- start start 2024-04-25T08:46:15.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b499c1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b440d0ab0 0x7f5b44152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b499c1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b440d34c0 0x7f5b4415e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b499c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b4415dac0 0x7f5b4415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b499c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4415dea0 con 0x7f5b4415dac0 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b499c1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b440d2100 con 0x7f5b440d34c0 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b499c1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b440b97d0 con 0x7f5b440d0ab0 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b437fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b4415dac0 0x7f5b4415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b437fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b4415dac0 0x7f5b4415ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59416/0 (socket says 172.21.15.172:59416) 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b437fe640 1 -- 172.21.15.172:0/3305046444 learned_addr learned my addr 172.21.15.172:0/3305046444 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b427fc640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b440d34c0 0x7f5b4415e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.889+0000 7f5b437fe640 1 -- 172.21.15.172:0/3305046444 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b440d0ab0 msgr2=0x7f5b44152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b42ffd640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b440d0ab0 0x7f5b44152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b437fe640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b440d0ab0 0x7f5b44152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b437fe640 1 -- 172.21.15.172:0/3305046444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b440d34c0 msgr2=0x7f5b4415e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b437fe640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b440d34c0 0x7f5b4415e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b437fe640 1 -- 172.21.15.172:0/3305046444 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b440ccfe0 con 0x7f5b4415dac0 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b427fc640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b440d34c0 0x7f5b4415e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:15.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b42ffd640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b440d0ab0 0x7f5b44152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:15.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b437fe640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b4415dac0 0x7f5b4415ebc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009890 tx=0x7f5b3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:15.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b2bfff640 1 -- 172.21.15.172:0/3305046444 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c037040 con 0x7f5b4415dac0 2024-04-25T08:46:15.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b2bfff640 1 -- 172.21.15.172:0/3305046444 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c004230 con 0x7f5b4415dac0 2024-04-25T08:46:15.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b499c1640 1 -- 172.21.15.172:0/3305046444 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b440cd2c0 con 0x7f5b4415dac0 2024-04-25T08:46:15.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b2bfff640 1 -- 172.21.15.172:0/3305046444 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c032e20 con 0x7f5b4415dac0 2024-04-25T08:46:15.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.890+0000 7f5b499c1640 1 -- 172.21.15.172:0/3305046444 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b440b43d0 con 0x7f5b4415dac0 2024-04-25T08:46:15.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.891+0000 7f5b499c1640 1 -- 172.21.15.172:0/3305046444 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b440b45d0 con 0x7f5b4415dac0 2024-04-25T08:46:15.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.891+0000 7f5b2bfff640 1 -- 172.21.15.172:0/3305046444 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b3c030770 con 0x7f5b4415dac0 2024-04-25T08:46:15.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.892+0000 7f5b2bfff640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b3006b4d0 0x7f5b3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:15.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.892+0000 7f5b2bfff640 1 -- 172.21.15.172:0/3305046444 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5b3c0ab590 con 0x7f5b4415dac0 2024-04-25T08:46:15.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.892+0000 7f5b42ffd640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b3006b4d0 0x7f5b3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:15.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.892+0000 7f5b42ffd640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b3006b4d0 0x7f5b3006d990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5b34007e90 tx=0x7f5b340073a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:15.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:15.896+0000 7f5b2bfff640 1 -- 172.21.15.172:0/3305046444 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b440b45d0 con 0x7f5b4415dac0 2024-04-25T08:46:16.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.065+0000 7f5b499c1640 1 -- 172.21.15.172:0/3305046444 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b440b3ee0 con 0x7f5b4415dac0 2024-04-25T08:46:16.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.066+0000 7f5b2bfff640 1 -- 172.21.15.172:0/3305046444 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b3c07a310 con 0x7f5b4415dac0 2024-04-25T08:46:16.057 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:46:16.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.067+0000 7f5b499c1640 1 -- 172.21.15.172:0/3305046444 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b3006b4d0 msgr2=0x7f5b3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.067+0000 7f5b499c1640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b3006b4d0 0x7f5b3006d990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5b34007e90 tx=0x7f5b340073a0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.067+0000 7f5b499c1640 1 -- 172.21.15.172:0/3305046444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b4415dac0 msgr2=0x7f5b4415ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.067+0000 7f5b499c1640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b4415dac0 0x7f5b4415ebc0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009890 tx=0x7f5b3c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.068+0000 7f5b499c1640 1 -- 172.21.15.172:0/3305046444 shutdown_connections 2024-04-25T08:46:16.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.068+0000 7f5b499c1640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b3006b4d0 0x7f5b3006d990 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.068+0000 7f5b499c1640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b440d34c0 0x7f5b4415e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.068+0000 7f5b499c1640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b4415dac0 0x7f5b4415ebc0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.068+0000 7f5b499c1640 1 --2- 172.21.15.172:0/3305046444 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b440d0ab0 0x7f5b44152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.068+0000 7f5b499c1640 1 -- 172.21.15.172:0/3305046444 >> 172.21.15.172:0/3305046444 conn(0x7f5b44061c30 msgr2=0x7f5b440b85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:16.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.068+0000 7f5b499c1640 1 -- 172.21.15.172:0/3305046444 shutdown_connections 2024-04-25T08:46:16.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.068+0000 7f5b499c1640 1 -- 172.21.15.172:0/3305046444 wait complete. 2024-04-25T08:46:16.070 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:46:16.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.179+0000 7fd08f88f640 1 Processor -- start 2024-04-25T08:46:16.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.179+0000 7fd08f88f640 1 -- start start 2024-04-25T08:46:16.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.180+0000 7fd08f88f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd088161710 0x7fd0880d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.180+0000 7fd08f88f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08815e000 con 0x7fd08815dc20 2024-04-25T08:46:16.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.180+0000 7fd08f88f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0880d1de0 con 0x7fd0880ced80 2024-04-25T08:46:16.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.180+0000 7fd08f88f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd088161c60 con 0x7fd088161710 2024-04-25T08:46:16.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.180+0000 7fd08d62b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd08815dc20 0x7fd0880ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39752/0 (socket says 172.21.15.172:39752) 2024-04-25T08:46:16.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.180+0000 7fd08de2c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd088161710 0x7fd0880d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.180+0000 7fd08d62b640 1 -- 172.21.15.172:0/195250317 learned_addr learned my addr 172.21.15.172:0/195250317 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:16.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.181+0000 7fd07ffff640 1 -- 172.21.15.172:0/195250317 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262875233 0 0) 0x7fd08815e000 con 0x7fd08815dc20 2024-04-25T08:46:16.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.181+0000 7fd07ffff640 1 -- 172.21.15.172:0/195250317 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd074003520 con 0x7fd08815dc20 2024-04-25T08:46:16.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.181+0000 7fd08de2c640 1 -- 172.21.15.172:0/195250317 >> v1:172.21.15.186:6789/0 conn(0x7fd0880ced80 legacy=0x7fd0880d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:16.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.181+0000 7fd08de2c640 1 -- 172.21.15.172:0/195250317 >> v1:172.21.15.172:6789/0 conn(0x7fd08815dc20 legacy=0x7fd0880ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.181+0000 7fd08de2c640 1 -- 172.21.15.172:0/195250317 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088161f40 con 0x7fd088161710 2024-04-25T08:46:16.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.181+0000 7fd08de2c640 1 --2- 172.21.15.172:0/195250317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd088161710 0x7fd0880d29f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd0800097a0 tx=0x7fd08002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce107d84810279a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.181+0000 7fd07ffff640 1 -- 172.21.15.172:0/195250317 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080037070 con 0x7fd088161710 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.181+0000 7fd07ffff640 1 -- 172.21.15.172:0/195250317 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080032440 con 0x7fd088161710 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.181+0000 7fd07ffff640 1 -- 172.21.15.172:0/195250317 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080032810 con 0x7fd088161710 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.182+0000 7fd08f88f640 1 -- 172.21.15.172:0/195250317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd088161710 msgr2=0x7fd0880d29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.182+0000 7fd08f88f640 1 --2- 172.21.15.172:0/195250317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd088161710 0x7fd0880d29f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd0800097a0 tx=0x7fd08002a230 comp rx=0 tx=0).stop 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.182+0000 7fd08f88f640 1 -- 172.21.15.172:0/195250317 shutdown_connections 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.182+0000 7fd08f88f640 1 --2- 172.21.15.172:0/195250317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd088161710 0x7fd0880d29f0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.182+0000 7fd08f88f640 1 -- 172.21.15.172:0/195250317 >> 172.21.15.172:0/195250317 conn(0x7fd0880d0420 msgr2=0x7fd0880d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.182+0000 7fd08f88f640 1 -- 172.21.15.172:0/195250317 shutdown_connections 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.182+0000 7fd08f88f640 1 -- 172.21.15.172:0/195250317 wait complete. 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.183+0000 7fd08f88f640 1 Processor -- start 2024-04-25T08:46:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.183+0000 7fd08f88f640 1 -- start start 2024-04-25T08:46:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08f88f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0880ced80 0x7fd088160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08f88f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd08815dc20 0x7fd0880c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08f88f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd088161710 0x7fd08815f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08f88f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880b5e50 con 0x7fd0880ced80 2024-04-25T08:46:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08f88f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd088162500 con 0x7fd088161710 2024-04-25T08:46:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08f88f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880b5fd0 con 0x7fd08815dc20 2024-04-25T08:46:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08d62b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0880ced80 0x7fd088160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08d62b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0880ced80 0x7fd088160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59430/0 (socket says 172.21.15.172:59430) 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08d62b640 1 -- 172.21.15.172:0/1852415506 learned_addr learned my addr 172.21.15.172:0/1852415506 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08d62b640 1 -- 172.21.15.172:0/1852415506 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd08815dc20 msgr2=0x7fd0880c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08d62b640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd08815dc20 0x7fd0880c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08d62b640 1 -- 172.21.15.172:0/1852415506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd088161710 msgr2=0x7fd08815f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08d62b640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd088161710 0x7fd08815f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08d62b640 1 -- 172.21.15.172:0/1852415506 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0880c7320 con 0x7fd0880ced80 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.184+0000 7fd08d62b640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0880ced80 0x7fd088160a50 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd08400cbc0 tx=0x7fd08400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.185+0000 7fd07dffb640 1 -- 172.21.15.172:0/1852415506 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084017070 con 0x7fd0880ced80 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.185+0000 7fd07dffb640 1 -- 172.21.15.172:0/1852415506 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08400ad40 con 0x7fd0880ced80 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.185+0000 7fd08f88f640 1 -- 172.21.15.172:0/1852415506 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0880c7600 con 0x7fd0880ced80 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.185+0000 7fd07dffb640 1 -- 172.21.15.172:0/1852415506 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084012600 con 0x7fd0880ced80 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.185+0000 7fd08f88f640 1 -- 172.21.15.172:0/1852415506 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0880c7bc0 con 0x7fd0880ced80 2024-04-25T08:46:16.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.186+0000 7fd08f88f640 1 -- 172.21.15.172:0/1852415506 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd088073a00 con 0x7fd0880ced80 2024-04-25T08:46:16.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.186+0000 7fd07dffb640 1 -- 172.21.15.172:0/1852415506 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd08401a070 con 0x7fd0880ced80 2024-04-25T08:46:16.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.186+0000 7fd07dffb640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06c06b500 0x7fd06c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.187+0000 7fd07dffb640 1 -- 172.21.15.172:0/1852415506 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd08408a0c0 con 0x7fd0880ced80 2024-04-25T08:46:16.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.187+0000 7fd08ce2a640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06c06b500 0x7fd06c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.187+0000 7fd08ce2a640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06c06b500 0x7fd06c06d9c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd078000f60 tx=0x7fd0780079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:16.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.191+0000 7fd07dffb640 1 -- 172.21.15.172:0/1852415506 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd084058760 con 0x7fd0880ced80 2024-04-25T08:46:16.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.360+0000 7fd08f88f640 1 -- 172.21.15.172:0/1852415506 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0880d2db0 con 0x7fd0880ced80 2024-04-25T08:46:16.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.361+0000 7fd07dffb640 1 -- 172.21.15.172:0/1852415506 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd08405c800 con 0x7fd0880ced80 2024-04-25T08:46:16.352 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:46:16.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 -- 172.21.15.172:0/1852415506 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06c06b500 msgr2=0x7fd06c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06c06b500 0x7fd06c06d9c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd078000f60 tx=0x7fd0780079d0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 -- 172.21.15.172:0/1852415506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0880ced80 msgr2=0x7fd088160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0880ced80 0x7fd088160a50 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd08400cbc0 tx=0x7fd08400a430 comp rx=0 tx=0).stop 2024-04-25T08:46:16.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 -- 172.21.15.172:0/1852415506 shutdown_connections 2024-04-25T08:46:16.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd06c06b500 0x7fd06c06d9c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd088161710 0x7fd08815f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd08815dc20 0x7fd0880c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 --2- 172.21.15.172:0/1852415506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0880ced80 0x7fd088160a50 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 -- 172.21.15.172:0/1852415506 >> 172.21.15.172:0/1852415506 conn(0x7fd0880d0420 msgr2=0x7fd0880b8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:16.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 -- 172.21.15.172:0/1852415506 shutdown_connections 2024-04-25T08:46:16.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.363+0000 7fd08f88f640 1 -- 172.21.15.172:0/1852415506 wait complete. 2024-04-25T08:46:16.365 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:46:16.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.475+0000 7f0268ecb640 1 Processor -- start 2024-04-25T08:46:16.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.475+0000 7f0268ecb640 1 -- start start 2024-04-25T08:46:16.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0268ecb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02641454a0 0x7f02640aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0268ecb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f026406b2f0 0x7f026415d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0268ecb640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02640af540 con 0x7f026415c970 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0268ecb640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02640af820 con 0x7f026406b2f0 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0268ecb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02640afb00 con 0x7f02641454a0 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0262d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f026406b2f0 0x7f026415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0262d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f026406b2f0 0x7f026415d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59440/0 (socket says 172.21.15.172:59440) 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0262d9d640 1 -- 172.21.15.172:0/2411076897 learned_addr learned my addr 172.21.15.172:0/2411076897 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f026259c640 1 --2- 172.21.15.172:0/2411076897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02641454a0 0x7f02640aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0262d9d640 1 -- 172.21.15.172:0/2411076897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02641454a0 msgr2=0x7f02640aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0262d9d640 1 --2- 172.21.15.172:0/2411076897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02641454a0 0x7f02640aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0262d9d640 1 -- 172.21.15.172:0/2411076897 >> v1:172.21.15.186:6789/0 conn(0x7f026415c970 legacy=0x7f026406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f0262d9d640 1 -- 172.21.15.172:0/2411076897 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02640afde0 con 0x7f026406b2f0 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.476+0000 7f026259c640 1 --2- 172.21.15.172:0/2411076897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02641454a0 0x7f02640aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.477+0000 7f0262d9d640 1 --2- 172.21.15.172:0/2411076897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f026406b2f0 0x7f026415d490 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f025c009e50 tx=0x7f025c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c483ba9236a60c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.477+0000 7f0261d9b640 1 -- 172.21.15.172:0/2411076897 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c036070 con 0x7f026406b2f0 2024-04-25T08:46:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.477+0000 7f0261d9b640 1 -- 172.21.15.172:0/2411076897 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c031600 con 0x7f026406b2f0 2024-04-25T08:46:16.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.477+0000 7f0261d9b640 1 -- 172.21.15.172:0/2411076897 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c0319d0 con 0x7f026406b2f0 2024-04-25T08:46:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.478+0000 7f0268ecb640 1 -- 172.21.15.172:0/2411076897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f026406b2f0 msgr2=0x7f026415d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.478+0000 7f0268ecb640 1 --2- 172.21.15.172:0/2411076897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f026406b2f0 0x7f026415d490 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f025c009e50 tx=0x7f025c02a6c0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.478+0000 7f0268ecb640 1 -- 172.21.15.172:0/2411076897 shutdown_connections 2024-04-25T08:46:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.478+0000 7f0268ecb640 1 --2- 172.21.15.172:0/2411076897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f026406b2f0 0x7f026415d490 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.478+0000 7f0268ecb640 1 --2- 172.21.15.172:0/2411076897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02641454a0 0x7f02640aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.478+0000 7f0268ecb640 1 -- 172.21.15.172:0/2411076897 >> 172.21.15.172:0/2411076897 conn(0x7f02640b5af0 msgr2=0x7f02640b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.478+0000 7f0268ecb640 1 -- 172.21.15.172:0/2411076897 shutdown_connections 2024-04-25T08:46:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.478+0000 7f0268ecb640 1 -- 172.21.15.172:0/2411076897 wait complete. 2024-04-25T08:46:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.479+0000 7f0268ecb640 1 Processor -- start 2024-04-25T08:46:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.479+0000 7f0268ecb640 1 -- start start 2024-04-25T08:46:16.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f0268ecb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f026406b2f0 0x7f02641f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f0268ecb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02641454a0 0x7f026413f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f0268ecb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f026415c970 0x7f026413f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f0268ecb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026415db50 con 0x7f02641454a0 2024-04-25T08:46:16.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f0268ecb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026415d9d0 con 0x7f026415c970 2024-04-25T08:46:16.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f0268ecb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026415dcd0 con 0x7f026406b2f0 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f025bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02641454a0 0x7f026413f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f025bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02641454a0 0x7f026413f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59450/0 (socket says 172.21.15.172:59450) 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f025bfff640 1 -- 172.21.15.172:0/2047983820 learned_addr learned my addr 172.21.15.172:0/2047983820 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f0262d9d640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f026415c970 0x7f026413f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f026259c640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f026406b2f0 0x7f02641f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f025bfff640 1 -- 172.21.15.172:0/2047983820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f026406b2f0 msgr2=0x7f02641f3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f025bfff640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f026406b2f0 0x7f02641f3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f025bfff640 1 -- 172.21.15.172:0/2047983820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f026415c970 msgr2=0x7f026413f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f025bfff640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f026415c970 0x7f026413f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f025bfff640 1 -- 172.21.15.172:0/2047983820 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026413ff30 con 0x7f02641454a0 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f026259c640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f026406b2f0 0x7f02641f3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.480+0000 7f025bfff640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02641454a0 0x7f026413f3c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f024c00b410 tx=0x7f024c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.481+0000 7f025affd640 1 -- 172.21.15.172:0/2047983820 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c015020 con 0x7f02641454a0 2024-04-25T08:46:16.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.481+0000 7f025affd640 1 -- 172.21.15.172:0/2047983820 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c011830 con 0x7f02641454a0 2024-04-25T08:46:16.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.481+0000 7f0268ecb640 1 -- 172.21.15.172:0/2047983820 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0264140210 con 0x7f02641454a0 2024-04-25T08:46:16.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.481+0000 7f025affd640 1 -- 172.21.15.172:0/2047983820 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c011c20 con 0x7f02641454a0 2024-04-25T08:46:16.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.481+0000 7f0268ecb640 1 -- 172.21.15.172:0/2047983820 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0264150db0 con 0x7f02641454a0 2024-04-25T08:46:16.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.482+0000 7f0268ecb640 1 -- 172.21.15.172:0/2047983820 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0264073a00 con 0x7f02641454a0 2024-04-25T08:46:16.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.482+0000 7f025affd640 1 -- 172.21.15.172:0/2047983820 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f024c018020 con 0x7f02641454a0 2024-04-25T08:46:16.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.483+0000 7f025affd640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f024406b4d0 0x7f024406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.483+0000 7f026259c640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f024406b4d0 0x7f024406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.483+0000 7f025affd640 1 -- 172.21.15.172:0/2047983820 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f024c08a310 con 0x7f02641454a0 2024-04-25T08:46:16.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.483+0000 7f026259c640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f024406b4d0 0x7f024406d990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0254006fd0 tx=0x7f0254008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:16.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.489+0000 7f025affd640 1 -- 172.21.15.172:0/2047983820 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f024c01f020 con 0x7f02641454a0 2024-04-25T08:46:16.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.664+0000 7f0268ecb640 1 -- 172.21.15.172:0/2047983820 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f026415e5e0 con 0x7f02641454a0 2024-04-25T08:46:16.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.664+0000 7f025affd640 1 -- 172.21.15.172:0/2047983820 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7f024c0172c0 con 0x7f02641454a0 2024-04-25T08:46:16.656 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:46:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 -- 172.21.15.172:0/2047983820 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f024406b4d0 msgr2=0x7f024406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f024406b4d0 0x7f024406d990 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0254006fd0 tx=0x7f0254008040 comp rx=0 tx=0).stop 2024-04-25T08:46:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 -- 172.21.15.172:0/2047983820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02641454a0 msgr2=0x7f026413f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02641454a0 0x7f026413f3c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f024c00b410 tx=0x7f024c00b8d0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 -- 172.21.15.172:0/2047983820 shutdown_connections 2024-04-25T08:46:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f024406b4d0 0x7f024406d990 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f026415c970 0x7f026413f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02641454a0 0x7f026413f3c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 --2- 172.21.15.172:0/2047983820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f026406b2f0 0x7f02641f3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 -- 172.21.15.172:0/2047983820 >> 172.21.15.172:0/2047983820 conn(0x7f02640b5af0 msgr2=0x7f02640b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:16.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 -- 172.21.15.172:0/2047983820 shutdown_connections 2024-04-25T08:46:16.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.666+0000 7f0268ecb640 1 -- 172.21.15.172:0/2047983820 wait complete. 2024-04-25T08:46:16.669 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:46:16.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.777+0000 7fb8113f4640 1 Processor -- start 2024-04-25T08:46:16.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.777+0000 7fb8113f4640 1 -- start start 2024-04-25T08:46:16.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.778+0000 7fb8113f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c15a9f0 0x7fb80c0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.778+0000 7fb8113f4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb80c0cdbf0 0x7fb80c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.778+0000 7fb8113f4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80c0c6940 con 0x7fb80c0cd520 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.778+0000 7fb8113f4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80c0b0020 con 0x7fb80c0cdbf0 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.778+0000 7fb8113f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0cb5a0 con 0x7fb80c15a9f0 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80a7fc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb80c0cdbf0 0x7fb80c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80affd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c15a9f0 0x7fb80c0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80a7fc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb80c0cdbf0 0x7fb80c0ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:60632/0 (socket says 172.21.15.172:60632) 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80b7fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fb80c0cd520 0x7fb80c0ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:55514/0 (socket says 172.21.15.172:55514) 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80a7fc640 1 -- 172.21.15.172:0/17344019 learned_addr learned my addr 172.21.15.172:0/17344019 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80affd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c15a9f0 0x7fb80c0c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:58656/0 (socket says 172.21.15.172:58656) 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80a7fc640 1 -- 172.21.15.172:0/17344019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c15a9f0 msgr2=0x7fb80c0c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80a7fc640 1 --2- 172.21.15.172:0/17344019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c15a9f0 0x7fb80c0c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80a7fc640 1 -- 172.21.15.172:0/17344019 >> v1:172.21.15.186:6789/0 conn(0x7fb80c0cd520 legacy=0x7fb80c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80a7fc640 1 -- 172.21.15.172:0/17344019 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c15add0 con 0x7fb80c0cdbf0 2024-04-25T08:46:16.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.779+0000 7fb80affd640 1 --2- 172.21.15.172:0/17344019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c15a9f0 0x7fb80c0c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.780+0000 7fb80a7fc640 1 --2- 172.21.15.172:0/17344019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c0cdbf0 0x7fb80c0ccfe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb80000bb10 tx=0x7fb80002c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbacf1dddfc5e595 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.780+0000 7fb809ffb640 1 -- 172.21.15.172:0/17344019 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800036020 con 0x7fb80c0cdbf0 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.780+0000 7fb809ffb640 1 -- 172.21.15.172:0/17344019 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800032820 con 0x7fb80c0cdbf0 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.780+0000 7fb809ffb640 1 -- 172.21.15.172:0/17344019 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800032bf0 con 0x7fb80c0cdbf0 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.780+0000 7fb8113f4640 1 -- 172.21.15.172:0/17344019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c0cdbf0 msgr2=0x7fb80c0ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.780+0000 7fb8113f4640 1 --2- 172.21.15.172:0/17344019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c0cdbf0 0x7fb80c0ccfe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb80000bb10 tx=0x7fb80002c920 comp rx=0 tx=0).stop 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.780+0000 7fb8113f4640 1 -- 172.21.15.172:0/17344019 shutdown_connections 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.780+0000 7fb8113f4640 1 --2- 172.21.15.172:0/17344019 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c0cdbf0 0x7fb80c0ccfe0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.780+0000 7fb8113f4640 1 --2- 172.21.15.172:0/17344019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c15a9f0 0x7fb80c0c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.780+0000 7fb8113f4640 1 -- 172.21.15.172:0/17344019 >> 172.21.15.172:0/17344019 conn(0x7fb80c0b2390 msgr2=0x7fb80c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.781+0000 7fb8113f4640 1 -- 172.21.15.172:0/17344019 shutdown_connections 2024-04-25T08:46:16.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.781+0000 7fb8113f4640 1 -- 172.21.15.172:0/17344019 wait complete. 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.782+0000 7fb8113f4640 1 Processor -- start 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.782+0000 7fb8113f4640 1 -- start start 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.782+0000 7fb8113f4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb80c0cd520 0x7fb80c14c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb8113f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c0cdbf0 0x7fb80c1f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb8113f4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c15a9f0 0x7fb80c159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb8113f4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0cb230 con 0x7fb80c0cd520 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb8113f4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0caf50 con 0x7fb80c15a9f0 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb8113f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0ce070 con 0x7fb80c0cdbf0 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb80c0cd520 0x7fb80c14c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb80c0cd520 0x7fb80c14c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59452/0 (socket says 172.21.15.172:59452) 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80affd640 1 -- 172.21.15.172:0/1140356439 learned_addr learned my addr 172.21.15.172:0/1140356439 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80a7fc640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c0cdbf0 0x7fb80c1f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80b7fe640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c15a9f0 0x7fb80c159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80affd640 1 -- 172.21.15.172:0/1140356439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c0cdbf0 msgr2=0x7fb80c1f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80affd640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c0cdbf0 0x7fb80c1f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80affd640 1 -- 172.21.15.172:0/1140356439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c15a9f0 msgr2=0x7fb80c159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80affd640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c15a9f0 0x7fb80c159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80affd640 1 -- 172.21.15.172:0/1140356439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c158270 con 0x7fb80c0cd520 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb80affd640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb80c0cd520 0x7fb80c14c110 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009ec0 tx=0x7fb7fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb7f37fe640 1 -- 172.21.15.172:0/1140356439 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc018020 con 0x7fb80c0cd520 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb7f37fe640 1 -- 172.21.15.172:0/1140356439 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc014680 con 0x7fb80c0cd520 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb8113f4640 1 -- 172.21.15.172:0/1140356439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80c158550 con 0x7fb80c0cd520 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb7f37fe640 1 -- 172.21.15.172:0/1140356439 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc014a50 con 0x7fb80c0cd520 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.783+0000 7fb8113f4640 1 -- 172.21.15.172:0/1140356439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c158b10 con 0x7fb80c0cd520 2024-04-25T08:46:16.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.784+0000 7fb8113f4640 1 -- 172.21.15.172:0/1140356439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c06cc80 con 0x7fb80c0cd520 2024-04-25T08:46:16.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.785+0000 7fb7f37fe640 1 -- 172.21.15.172:0/1140356439 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb7fc005d10 con 0x7fb80c0cd520 2024-04-25T08:46:16.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.785+0000 7fb7f37fe640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb7f806b4d0 0x7fb7f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:16.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.785+0000 7fb7f37fe640 1 -- 172.21.15.172:0/1140356439 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb7fc08b010 con 0x7fb80c0cd520 2024-04-25T08:46:16.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.785+0000 7fb80a7fc640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb7f806b4d0 0x7fb7f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:16.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.786+0000 7fb80a7fc640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb7f806b4d0 0x7fb7f806d990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb800037000 tx=0x7fb80003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:16.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.789+0000 7fb7f37fe640 1 -- 172.21.15.172:0/1140356439 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb7fc022030 con 0x7fb80c0cd520 2024-04-25T08:46:16.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.970+0000 7fb8113f4640 1 -- 172.21.15.172:0/1140356439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb80c073a00 con 0x7fb80c0cd520 2024-04-25T08:46:16.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.970+0000 7fb7f37fe640 1 -- 172.21.15.172:0/1140356439 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb7fc010040 con 0x7fb80c0cd520 2024-04-25T08:46:16.962 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:46:16.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 -- 172.21.15.172:0/1140356439 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb7f806b4d0 msgr2=0x7fb7f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb7f806b4d0 0x7fb7f806d990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb800037000 tx=0x7fb80003d040 comp rx=0 tx=0).stop 2024-04-25T08:46:16.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 -- 172.21.15.172:0/1140356439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb80c0cd520 msgr2=0x7fb80c14c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:16.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb80c0cd520 0x7fb80c14c110 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009ec0 tx=0x7fb7fc00c490 comp rx=0 tx=0).stop 2024-04-25T08:46:16.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 -- 172.21.15.172:0/1140356439 shutdown_connections 2024-04-25T08:46:16.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb7f806b4d0 0x7fb7f806d990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c15a9f0 0x7fb80c159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c0cdbf0 0x7fb80c1f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 --2- 172.21.15.172:0/1140356439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb80c0cd520 0x7fb80c14c110 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:16.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 -- 172.21.15.172:0/1140356439 >> 172.21.15.172:0/1140356439 conn(0x7fb80c0b2390 msgr2=0x7fb80c0b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:16.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 -- 172.21.15.172:0/1140356439 shutdown_connections 2024-04-25T08:46:16.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:16.972+0000 7fb8113f4640 1 -- 172.21.15.172:0/1140356439 wait complete. 2024-04-25T08:46:16.975 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:46:16.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:16.975 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:46:17.017 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:46:17.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:17.017 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:46:17.072 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:17.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.218+0000 7f1062796640 1 Processor -- start 2024-04-25T08:46:17.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.218+0000 7f1062796640 1 -- start start 2024-04-25T08:46:17.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f1062796640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f105c15dd30 0x7f105c0b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f1062796640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 0x7f105c0b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f1062796640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c0d1df0 con 0x7f105c0b9770 2024-04-25T08:46:17.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f1062796640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c0d20d0 con 0x7f105c15dd30 2024-04-25T08:46:17.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f1062796640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0d23b0 con 0x7f105c0d0ad0 2024-04-25T08:46:17.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f1060d33640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 0x7f105c0b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f105bfff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f105c15dd30 0x7f105c0b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f105b7fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f105c0b9770 0x7f105c0d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:55520/0 (socket says 172.21.15.172:55520) 2024-04-25T08:46:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f105b7fe640 1 -- 172.21.15.172:0/498517244 learned_addr learned my addr 172.21.15.172:0/498517244 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f105bfff640 1 --2- 172.21.15.172:0/498517244 >> v2:172.21.15.186:3300/0 conn(0x7f105c15dd30 0x7f105c0b9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:60648/0 (socket says 172.21.15.172:60648) 2024-04-25T08:46:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.219+0000 7f1060d33640 1 --2- 172.21.15.172:0/498517244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 0x7f105c0b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:58680/0 (socket says 172.21.15.172:58680) 2024-04-25T08:46:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.220+0000 7f1060d33640 1 -- 172.21.15.172:0/498517244 >> v2:172.21.15.186:3300/0 conn(0x7f105c15dd30 msgr2=0x7f105c0b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.220+0000 7f1060d33640 1 --2- 172.21.15.172:0/498517244 >> v2:172.21.15.186:3300/0 conn(0x7f105c15dd30 0x7f105c0b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.220+0000 7f1060d33640 1 -- 172.21.15.172:0/498517244 >> v1:172.21.15.186:6789/0 conn(0x7f105c0b9770 legacy=0x7f105c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.220+0000 7f1060d33640 1 -- 172.21.15.172:0/498517244 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0d2690 con 0x7f105c0d0ad0 2024-04-25T08:46:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.220+0000 7f105affd640 1 -- 172.21.15.172:0/498517244 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153170055 0 0) 0x7f105c0d1df0 con 0x7f105c0b9770 2024-04-25T08:46:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.220+0000 7f105bfff640 1 --2- 172.21.15.172:0/498517244 >> v2:172.21.15.186:3300/0 conn(0x7f105c15dd30 0x7f105c0b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:17.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.220+0000 7f1060d33640 1 --2- 172.21.15.172:0/498517244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 0x7f105c0b6a40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1054009d90 tx=0x7f105402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e53c9f5b49155e94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f105affd640 1 -- 172.21.15.172:0/498517244 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054031600 con 0x7f105c0d0ad0 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f105affd640 1 -- 172.21.15.172:0/498517244 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10540317a0 con 0x7f105c0d0ad0 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f105affd640 1 -- 172.21.15.172:0/498517244 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054031b70 con 0x7f105c0d0ad0 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f1062796640 1 -- 172.21.15.172:0/498517244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 msgr2=0x7f105c0b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f1062796640 1 --2- 172.21.15.172:0/498517244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 0x7f105c0b6a40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1054009d90 tx=0x7f105402a5d0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f1062796640 1 -- 172.21.15.172:0/498517244 shutdown_connections 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f1062796640 1 --2- 172.21.15.172:0/498517244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 0x7f105c0b6a40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f1062796640 1 --2- 172.21.15.172:0/498517244 >> v2:172.21.15.186:3300/0 conn(0x7f105c15dd30 0x7f105c0b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f1062796640 1 -- 172.21.15.172:0/498517244 >> 172.21.15.172:0/498517244 conn(0x7f105c061c30 msgr2=0x7f105c06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f1062796640 1 -- 172.21.15.172:0/498517244 shutdown_connections 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.221+0000 7f1062796640 1 -- 172.21.15.172:0/498517244 wait complete. 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.222+0000 7f1062796640 1 Processor -- start 2024-04-25T08:46:17.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.222+0000 7f1062796640 1 -- start start 2024-04-25T08:46:17.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f1062796640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105c0b9770 0x7f105c1f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f1062796640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 0x7f105c0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f1062796640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105c15dd30 0x7f105c156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f1062796640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0d1b90 con 0x7f105c15dd30 2024-04-25T08:46:17.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f1062796640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0d1a10 con 0x7f105c0b9770 2024-04-25T08:46:17.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f1062796640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0d2e90 con 0x7f105c0d0ad0 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f1060d33640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105c15dd30 0x7f105c156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f1060d33640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105c15dd30 0x7f105c156f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59464/0 (socket says 172.21.15.172:59464) 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f1060d33640 1 -- 172.21.15.172:0/416451812 learned_addr learned my addr 172.21.15.172:0/416451812 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f105bfff640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105c0b9770 0x7f105c1f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.223+0000 7f105b7fe640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 0x7f105c0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1060d33640 1 -- 172.21.15.172:0/416451812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 msgr2=0x7f105c0c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1060d33640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 0x7f105c0c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1060d33640 1 -- 172.21.15.172:0/416451812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105c0b9770 msgr2=0x7f105c1f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1060d33640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105c0b9770 0x7f105c1f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1060d33640 1 -- 172.21.15.172:0/416451812 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c1574c0 con 0x7f105c15dd30 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1060d33640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105c15dd30 0x7f105c156f80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1054009eb0 tx=0x7f1054004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1058ff9640 1 -- 172.21.15.172:0/416451812 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054040070 con 0x7f105c15dd30 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1062796640 1 -- 172.21.15.172:0/416451812 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c0b4240 con 0x7f105c15dd30 2024-04-25T08:46:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1058ff9640 1 -- 172.21.15.172:0/416451812 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1054030b60 con 0x7f105c15dd30 2024-04-25T08:46:17.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1058ff9640 1 -- 172.21.15.172:0/416451812 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054009450 con 0x7f105c15dd30 2024-04-25T08:46:17.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.224+0000 7f1062796640 1 -- 172.21.15.172:0/416451812 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c0b4800 con 0x7f105c15dd30 2024-04-25T08:46:17.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.225+0000 7f1062796640 1 -- 172.21.15.172:0/416451812 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c073990 con 0x7f105c15dd30 2024-04-25T08:46:17.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.225+0000 7f1058ff9640 1 -- 172.21.15.172:0/416451812 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1054039040 con 0x7f105c15dd30 2024-04-25T08:46:17.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.226+0000 7f1058ff9640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f104806b500 0x7f104806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.226+0000 7f105bfff640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f104806b500 0x7f104806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.226+0000 7f1058ff9640 1 -- 172.21.15.172:0/416451812 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f10540ab8a0 con 0x7f105c15dd30 2024-04-25T08:46:17.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.226+0000 7f105bfff640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f104806b500 0x7f104806d9c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f104c009560 tx=0x7f104c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.230+0000 7f1058ff9640 1 -- 172.21.15.172:0/416451812 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1054079ec0 con 0x7f105c15dd30 2024-04-25T08:46:17.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.434+0000 7f1062796640 1 -- 172.21.15.172:0/416451812 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f105c06b210 con 0x7f105c15dd30 2024-04-25T08:46:17.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.435+0000 7f1058ff9640 1 -- 172.21.15.172:0/416451812 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4945 (secure 0 0 0) 0x7f105407df60 con 0x7f105c15dd30 2024-04-25T08:46:17.426 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:17.426 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/1572465264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":1572465264},{"type":"v1","addr":"172.21.15.186:6835","nonce":1572465264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6696,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/611108095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":611108095},{"type":"v1","addr":"172.21.15.172:6835","nonce":611108095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6699,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3538685014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3538685014},{"type":"v1","addr":"172.21.15.172:6837","nonce":3538685014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:08.789050+0000","modified":"2024-04-25T08:46:10.801148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6705},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6705":{"gid":6705,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6834/550125910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":550125910},{"type":"v1","addr":"172.21.15.186:6834","nonce":550125910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:46:17.427 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 34 2024-04-25T08:46:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.436+0000 7f1062796640 1 -- 172.21.15.172:0/416451812 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f104806b500 msgr2=0x7f104806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.436+0000 7f1062796640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f104806b500 0x7f104806d9c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f104c009560 tx=0x7f104c009190 comp rx=0 tx=0).stop 2024-04-25T08:46:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.437+0000 7f1062796640 1 -- 172.21.15.172:0/416451812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105c15dd30 msgr2=0x7f105c156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.437+0000 7f1062796640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105c15dd30 0x7f105c156f80 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1054009eb0 tx=0x7f1054004a40 comp rx=0 tx=0).stop 2024-04-25T08:46:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.437+0000 7f1062796640 1 -- 172.21.15.172:0/416451812 shutdown_connections 2024-04-25T08:46:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.437+0000 7f1062796640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f104806b500 0x7f104806d9c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.437+0000 7f1062796640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f105c15dd30 0x7f105c156f80 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.437+0000 7f1062796640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f105c0d0ad0 0x7f105c0c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.437+0000 7f1062796640 1 --2- 172.21.15.172:0/416451812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f105c0b9770 0x7f105c1f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.437+0000 7f1062796640 1 -- 172.21.15.172:0/416451812 >> 172.21.15.172:0/416451812 conn(0x7f105c061c30 msgr2=0x7f105c0b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.437+0000 7f1062796640 1 -- 172.21.15.172:0/416451812 shutdown_connections 2024-04-25T08:46:17.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.437+0000 7f1062796640 1 -- 172.21.15.172:0/416451812 wait complete. 2024-04-25T08:46:17.439 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-25T08:46:17.575 INFO:teuthology.orchestra.run.smithi186.stdout:{"message":"","return_code":0} 2024-04-25T08:46:17.576 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T08:46:17.576 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:46:17.576 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:17.576 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:46:17.577 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:17.577 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:46:17.577 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:17.577 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:46:17.577 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:17.586 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:46:17.587 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:17.587 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:46:17.587 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:17.588 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:46:17.589 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:17.589 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:46:17.589 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:17.589 DEBUG:teuthology.orchestra.run.smithi172:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-04-25T08:46:17.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.679+0000 7f20bc6e7f40 1 Processor -- start 2024-04-25T08:46:17.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.679+0000 7f20bc6e7f40 1 -- start start 2024-04-25T08:46:17.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20bc6e7f40 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56421ed1dde0 0x56421edef610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20bc6e7f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ed68790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20bc6e7f40 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56421edf2b90 0x56421ee891b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20bc6e7f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421ed1e1f0 con 0x56421edf70a0 2024-04-25T08:46:17.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20bc6e7f40 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421ed209a0 con 0x56421edf2b90 2024-04-25T08:46:17.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20bc6e7f40 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421ed691a0 con 0x56421ed1dde0 2024-04-25T08:46:17.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b99e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ed68790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b99e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ed68790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33088/0 (socket says 172.21.15.172:33088) 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b99e7640 1 -- 172.21.15.172:0/3641564060 learned_addr learned my addr 172.21.15.172:0/3641564060 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20ba9e9640 1 --2- 172.21.15.172:0/3641564060 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56421edf2b90 0x56421ee891b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20ba1e8640 1 --2- 172.21.15.172:0/3641564060 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56421ed1dde0 0x56421edef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b99e7640 1 -- 172.21.15.172:0/3641564060 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56421ed1dde0 msgr2=0x56421edef610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b99e7640 1 --2- 172.21.15.172:0/3641564060 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56421ed1dde0 0x56421edef610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b99e7640 1 -- 172.21.15.172:0/3641564060 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56421edf2b90 msgr2=0x56421ee891b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b99e7640 1 --2- 172.21.15.172:0/3641564060 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56421edf2b90 0x56421ee891b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b99e7640 1 -- 172.21.15.172:0/3641564060 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56421ec60de0 con 0x56421edf70a0 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b99e7640 1 --2- 172.21.15.172:0/3641564060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ed68790 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f20b000a7a0 tx=0x7f20b000a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bf20cd35096169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b89e5640 1 -- 172.21.15.172:0/3641564060 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0019070 con 0x56421edf70a0 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b89e5640 1 -- 172.21.15.172:0/3641564060 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b0007600 con 0x56421edf70a0 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.680+0000 7f20b89e5640 1 -- 172.21.15.172:0/3641564060 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b00079d0 con 0x56421edf70a0 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.681+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/3641564060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 msgr2=0x56421ed68790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.681+0000 7f20bc6e7f40 1 --2- 172.21.15.172:0/3641564060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ed68790 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f20b000a7a0 tx=0x7f20b000a890 comp rx=0 tx=0).stop 2024-04-25T08:46:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.681+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/3641564060 shutdown_connections 2024-04-25T08:46:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.681+0000 7f20bc6e7f40 1 --2- 172.21.15.172:0/3641564060 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56421edf2b90 0x56421ee891b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.681+0000 7f20bc6e7f40 1 --2- 172.21.15.172:0/3641564060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ed68790 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.681+0000 7f20bc6e7f40 1 --2- 172.21.15.172:0/3641564060 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56421ed1dde0 0x56421edef610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.681+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/3641564060 >> 172.21.15.172:0/3641564060 conn(0x56421ed1e9b0 msgr2=0x56421ed4d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.681+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/3641564060 shutdown_connections 2024-04-25T08:46:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.681+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/3641564060 wait complete. 2024-04-25T08:46:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20bc6e7f40 1 Processor -- start 2024-04-25T08:46:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20bc6e7f40 1 -- start start 2024-04-25T08:46:17.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20bc6e7f40 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56421ed1dde0 0x56421edeb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20bc6e7f40 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56421edf2b90 0x56421ede16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20bc6e7f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ede7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20bc6e7f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421ed63660 con 0x56421edf70a0 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20bc6e7f40 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421edfa6f0 con 0x56421edf2b90 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20bc6e7f40 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421ed1fd00 con 0x56421ed1dde0 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20ba9e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ede7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20b99e7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56421edf2b90 0x56421ede16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20ba1e8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56421ed1dde0 0x56421edeb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20ba9e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ede7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33102/0 (socket says 172.21.15.172:33102) 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.682+0000 7f20ba9e9640 1 -- 172.21.15.172:0/1089506783 learned_addr learned my addr 172.21.15.172:0/1089506783 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20ba9e9640 1 -- 172.21.15.172:0/1089506783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56421ed1dde0 msgr2=0x56421edeb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20ba9e9640 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56421ed1dde0 0x56421edeb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20ba9e9640 1 -- 172.21.15.172:0/1089506783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56421edf2b90 msgr2=0x56421ede16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20ba9e9640 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56421edf2b90 0x56421ede16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20ba9e9640 1 -- 172.21.15.172:0/1089506783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56421ec4cc50 con 0x56421edf70a0 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20b99e7640 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56421edf2b90 0x56421ede16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20ba9e9640 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ede7410 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f20b400c240 tx=0x7f20b400c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20ab7fe640 1 -- 172.21.15.172:0/1089506783 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4017020 con 0x56421edf70a0 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20ab7fe640 1 -- 172.21.15.172:0/1089506783 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b4013670 con 0x56421edf70a0 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20ab7fe640 1 -- 172.21.15.172:0/1089506783 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4013a40 con 0x56421edf70a0 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/1089506783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56421edeb850 con 0x56421edf70a0 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.683+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/1089506783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56421ede1c00 con 0x56421edf70a0 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.684+0000 7f20ab7fe640 1 -- 172.21.15.172:0/1089506783 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f20b401a020 con 0x56421edf70a0 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.685+0000 7f20ab7fe640 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f209c069ee0 0x7f209c06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.685+0000 7f20ab7fe640 1 -- 172.21.15.172:0/1089506783 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f20b4089230 con 0x56421edf70a0 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.685+0000 7f20ba1e8640 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f209c069ee0 0x7f209c06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.685+0000 7f20bc6e7f40 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x56421edea2c0 0x56421edea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.685+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/1089506783 --> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] -- osd_op(unknown.0.0:1 9.10 9:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65) v9 -- 0x56421edeabe0 con 0x56421edea2c0 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.685+0000 7f20ba1e8640 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f209c069ee0 0x7f209c06c3a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f20ac057000 tx=0x7f20ac052000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.685+0000 7f20b99e7640 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x56421edea2c0 0x56421edea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.686+0000 7f20b99e7640 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x56421edea2c0 0x56421edea6a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20b99e7640 1 -- 172.21.15.172:0/1089506783 <== osd.4 v2:172.21.15.186:6808/1547498830 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v65'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f20b00077b0 con 0x56421edea2c0 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/1089506783 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x56421edea2c0 msgr2=0x56421edea6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20bc6e7f40 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x56421edea2c0 0x56421edea6a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/1089506783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f209c069ee0 msgr2=0x7f209c06c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20bc6e7f40 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f209c069ee0 0x7f209c06c3a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f20ac057000 tx=0x7f20ac052000 comp rx=0 tx=0).stop 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/1089506783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 msgr2=0x56421ede7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20bc6e7f40 1 --2- 172.21.15.172:0/1089506783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56421edf70a0 0x56421ede7410 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f20b400c240 tx=0x7f20b400c700 comp rx=0 tx=0).stop 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20ba9e9640 1 -- 172.21.15.172:0/1089506783 reap_dead start 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/1089506783 shutdown_connections 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/1089506783 >> 172.21.15.172:0/1089506783 conn(0x56421ed1e9b0 msgr2=0x56421ed68820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:17.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/1089506783 shutdown_connections 2024-04-25T08:46:17.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.687+0000 7f20bc6e7f40 1 -- 172.21.15.172:0/1089506783 wait complete. 2024-04-25T08:46:17.683 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-04-25T08:46:17.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-04-25T08:46:17.683 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-04-25T08:46:17.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-04-25T08:46:17.684 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-04-25T08:46:17.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-04-25T08:46:17.684 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-04-25T08:46:17.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-04-25T08:46:17.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.836+0000 7ffb61ff4640 1 Processor -- start 2024-04-25T08:46:17.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.836+0000 7f3fc4d90640 1 Processor -- start 2024-04-25T08:46:17.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.836+0000 7ffb61ff4640 1 -- start start 2024-04-25T08:46:17.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.836+0000 7f3fc4d90640 1 -- start start 2024-04-25T08:46:17.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb61ff4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c0ced80 0x7ffb5c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb61ff4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb5c161710 0x7ffb5c0d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fc4d90640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc00b5c40 0x7f3fc00ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fc4d90640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3fc015b980 0x7f3fc00ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fc4d90640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc00cf320 con 0x7f3fc015b5a0 2024-04-25T08:46:17.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fc4d90640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00ced90 con 0x7f3fc015b980 2024-04-25T08:46:17.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fc4d90640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00cf040 con 0x7f3fc00b5c40 2024-04-25T08:46:17.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb61ff4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c15e000 con 0x7ffb5c15dc20 2024-04-25T08:46:17.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb61ff4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5c0d1de0 con 0x7ffb5c161710 2024-04-25T08:46:17.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb61ff4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c161c60 con 0x7ffb5c0ced80 2024-04-25T08:46:17.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fbe59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3fc015b5a0 0x7f3fc00b5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55608/0 (socket says 172.21.15.172:55608) 2024-04-25T08:46:17.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fbe59c640 1 -- 172.21.15.172:0/3250734113 learned_addr learned my addr 172.21.15.172:0/3250734113 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:17.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb5b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ffb5c15dc20 0x7ffb5c0ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55606/0 (socket says 172.21.15.172:55606) 2024-04-25T08:46:17.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb5b7fe640 1 -- 172.21.15.172:0/2230133468 learned_addr learned my addr 172.21.15.172:0/2230133468 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:17.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fb7fff640 1 --2- 172.21.15.172:0/3250734113 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc00b5c40 0x7f3fc00ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb5bfff640 1 --2- 172.21.15.172:0/2230133468 >> v2:172.21.15.172:3300/0 conn(0x7ffb5c161710 0x7ffb5c0d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb5affd640 1 --2- 172.21.15.172:0/2230133468 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c0ced80 0x7ffb5c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fbed9d640 1 --2- 172.21.15.172:0/3250734113 >> v2:172.21.15.186:3300/0 conn(0x7f3fc015b980 0x7f3fc00ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fbdd9b640 1 -- 172.21.15.172:0/3250734113 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338606936 0 0) 0x7f3fb0001110 con 0x7f3fc015b5a0 2024-04-25T08:46:17.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb5bfff640 1 -- 172.21.15.172:0/2230133468 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c0ced80 msgr2=0x7ffb5c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:17.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb5bfff640 1 --2- 172.21.15.172:0/2230133468 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c0ced80 0x7ffb5c0d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb5bfff640 1 -- 172.21.15.172:0/2230133468 >> v1:172.21.15.172:6789/0 conn(0x7ffb5c15dc20 legacy=0x7ffb5c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7ffb5bfff640 1 -- 172.21.15.172:0/2230133468 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c161f40 con 0x7ffb5c161710 2024-04-25T08:46:17.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.837+0000 7f3fbdd9b640 1 -- 172.21.15.172:0/3250734113 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fac003520 con 0x7f3fc015b5a0 2024-04-25T08:46:17.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7f3fbdd9b640 1 -- 172.21.15.172:0/3250734113 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3094671067 0 0) 0x7f3fac003520 con 0x7f3fc015b5a0 2024-04-25T08:46:17.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7f3fbed9d640 1 -- 172.21.15.172:0/3250734113 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc00b5c40 msgr2=0x7f3fc00ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:17.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7f3fbed9d640 1 --2- 172.21.15.172:0/3250734113 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc00b5c40 0x7f3fc00ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7f3fbed9d640 1 -- 172.21.15.172:0/3250734113 >> v1:172.21.15.172:6789/0 conn(0x7f3fc015b5a0 legacy=0x7f3fc00b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7f3fbed9d640 1 -- 172.21.15.172:0/3250734113 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc0161970 con 0x7f3fc015b980 2024-04-25T08:46:17.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7f3fb7fff640 1 --2- 172.21.15.172:0/3250734113 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc00b5c40 0x7f3fc00ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:17.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7ffb5bfff640 1 --2- 172.21.15.172:0/2230133468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c161710 0x7ffb5c0d2820 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009d90 tx=0x7ffb5402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2484d47a8720c3ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7ffb5a7fc640 1 -- 172.21.15.172:0/2230133468 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54007740 con 0x7ffb5c161710 2024-04-25T08:46:17.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7ffb5a7fc640 1 -- 172.21.15.172:0/2230133468 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb540078e0 con 0x7ffb5c161710 2024-04-25T08:46:17.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7ffb5a7fc640 1 -- 172.21.15.172:0/2230133468 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54007cb0 con 0x7ffb5c161710 2024-04-25T08:46:17.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.838+0000 7f3fbed9d640 1 --2- 172.21.15.172:0/3250734113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b980 0x7f3fc00ce850 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009d90 tx=0x7f3fb802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9539fa314dcc0b6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7f3fbdd9b640 1 -- 172.21.15.172:0/3250734113 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0001840 con 0x7f3fc015b980 2024-04-25T08:46:17.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7f3fbdd9b640 1 -- 172.21.15.172:0/3250734113 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8007540 con 0x7f3fc015b980 2024-04-25T08:46:17.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7f3fbdd9b640 1 -- 172.21.15.172:0/3250734113 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb80078f0 con 0x7f3fc015b980 2024-04-25T08:46:17.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7ffb61ff4640 1 -- 172.21.15.172:0/2230133468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c161710 msgr2=0x7ffb5c0d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7ffb61ff4640 1 --2- 172.21.15.172:0/2230133468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c161710 0x7ffb5c0d2820 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009d90 tx=0x7ffb5402a660 comp rx=0 tx=0).stop 2024-04-25T08:46:17.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7ffb61ff4640 1 -- 172.21.15.172:0/2230133468 shutdown_connections 2024-04-25T08:46:17.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7ffb61ff4640 1 --2- 172.21.15.172:0/2230133468 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c0ced80 0x7ffb5c0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7ffb61ff4640 1 --2- 172.21.15.172:0/2230133468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c161710 0x7ffb5c0d2820 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7ffb61ff4640 1 -- 172.21.15.172:0/2230133468 >> 172.21.15.172:0/2230133468 conn(0x7ffb5c0d0420 msgr2=0x7ffb5c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:17.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7ffb61ff4640 1 -- 172.21.15.172:0/2230133468 shutdown_connections 2024-04-25T08:46:17.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7ffb61ff4640 1 -- 172.21.15.172:0/2230133468 wait complete. 2024-04-25T08:46:17.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3250734113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b980 msgr2=0x7f3fc00ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7f3fc4d90640 1 --2- 172.21.15.172:0/3250734113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b980 0x7f3fc00ce850 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8009d90 tx=0x7f3fb802a5f0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3250734113 shutdown_connections 2024-04-25T08:46:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7f3fc4d90640 1 --2- 172.21.15.172:0/3250734113 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b980 0x7f3fc00ce850 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7f3fc4d90640 1 --2- 172.21.15.172:0/3250734113 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc00b5c40 0x7f3fc00ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.839+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3250734113 >> 172.21.15.172:0/3250734113 conn(0x7f3fc00d0530 msgr2=0x7f3fc00d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.840+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3250734113 shutdown_connections 2024-04-25T08:46:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.840+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3250734113 wait complete. 2024-04-25T08:46:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.840+0000 7f996d007640 1 Processor -- start 2024-04-25T08:46:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.840+0000 7f996d007640 1 -- start start 2024-04-25T08:46:17.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7ffb61ff4640 1 Processor -- start 2024-04-25T08:46:17.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7f3fc4d90640 1 Processor -- start 2024-04-25T08:46:17.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7f3fc4d90640 1 -- start start 2024-04-25T08:46:17.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7ffb61ff4640 1 -- start start 2024-04-25T08:46:17.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7fb12eb41640 1 Processor -- start 2024-04-25T08:46:17.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7f996d007640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 0x7f99680c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7f996d007640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f99680cdbf0 0x7f99680ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7fb12eb41640 1 -- start start 2024-04-25T08:46:17.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7f996d007640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99680c6940 con 0x7f99680cd520 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7f996d007640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99680b0020 con 0x7f99680cdbf0 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.841+0000 7f996d007640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680cb5a0 con 0x7f996815a9f0 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f9966d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 0x7f99680c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f996759e640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f99680cd520 0x7f99680ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:40542/0 (socket says 172.21.15.172:40542) 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f996659c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f99680cdbf0 0x7f99680ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f996759e640 1 -- 172.21.15.172:0/4017613334 learned_addr learned my addr 172.21.15.172:0/4017613334 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f9965d9b640 1 -- 172.21.15.172:0/4017613334 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742888519 0 0) 0x7f9960001490 con 0x7f99680cd520 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f9966d9d640 1 -- 172.21.15.172:0/4017613334 >> v2:172.21.15.186:3300/0 conn(0x7f99680cdbf0 msgr2=0x7f99680ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f9966d9d640 1 --2- 172.21.15.172:0/4017613334 >> v2:172.21.15.186:3300/0 conn(0x7f99680cdbf0 0x7f99680ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f9966d9d640 1 -- 172.21.15.172:0/4017613334 >> v1:172.21.15.186:6789/0 conn(0x7f99680cd520 legacy=0x7f99680ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f9966d9d640 1 -- 172.21.15.172:0/4017613334 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996815add0 con 0x7f996815a9f0 2024-04-25T08:46:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f996659c640 1 --2- 172.21.15.172:0/4017613334 >> v2:172.21.15.186:3300/0 conn(0x7f99680cdbf0 0x7f99680ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fc4d90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc00b5c40 0x7f3fc00ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fc4d90640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b5a0 0x7f3fc0151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fc4d90640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc015b980 0x7f3fc01f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fc4d90640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc0162450 con 0x7f3fc00b5c40 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fc4d90640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc0161f30 con 0x7f3fc015b5a0 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fc4d90640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc01625d0 con 0x7f3fc015b980 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fbe59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc00b5c40 0x7f3fc00ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fb7fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b5a0 0x7f3fc0151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fb7fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b5a0 0x7f3fc0151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:60634/0 (socket says 172.21.15.172:60634) 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fbe59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc00b5c40 0x7f3fc00ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33112/0 (socket says 172.21.15.172:33112) 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fb7fff640 1 -- 172.21.15.172:0/3894331419 learned_addr learned my addr 172.21.15.172:0/3894331419 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7f3fbed9d640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc015b980 0x7f3fc01f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7ffb61ff4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c0ced80 0x7ffb5c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7ffb61ff4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c15dc20 0x7ffb5c0b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.842+0000 7ffb61ff4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c161710 0x7ffb5c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fb7fff640 1 -- 172.21.15.172:0/3894331419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc015b980 msgr2=0x7f3fc01f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fb7fff640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc015b980 0x7f3fc01f3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fb7fff640 1 -- 172.21.15.172:0/3894331419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc00b5c40 msgr2=0x7f3fc00ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fb7fff640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc00b5c40 0x7f3fc00ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fb7fff640 1 -- 172.21.15.172:0/3894331419 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc01524c0 con 0x7f3fc015b5a0 2024-04-25T08:46:17.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fbe59c640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc00b5c40 0x7f3fc00ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:17.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb12eb41640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb12806bbf0 0x7fb12806bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb12eb41640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1280acd80 0x7fb1280c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb61ff4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0b5e50 con 0x7ffb5c161710 2024-04-25T08:46:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb61ff4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c162500 con 0x7ffb5c0ced80 2024-04-25T08:46:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb61ff4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0b5fd0 con 0x7ffb5c15dc20 2024-04-25T08:46:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb5affd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c15dc20 0x7ffb5c0b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb5affd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c15dc20 0x7ffb5c0b8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43454/0 (socket says 172.21.15.172:43454) 2024-04-25T08:46:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb5affd640 1 -- 172.21.15.172:0/627037302 learned_addr learned my addr 172.21.15.172:0/627037302 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb5bfff640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c161710 0x7ffb5c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb12eb41640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12806c510 con 0x7fb1280cda20 2024-04-25T08:46:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb12eb41640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1280c5ac0 con 0x7fb12806bbf0 2024-04-25T08:46:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb12eb41640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280c4eb0 con 0x7fb1280acd80 2024-04-25T08:46:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb5b7fe640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c0ced80 0x7ffb5c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb12d0de640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb1280cda20 0x7fb1280cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55622/0 (socket says 172.21.15.172:55622) 2024-04-25T08:46:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb12d0de640 1 -- 172.21.15.172:0/3534298208 learned_addr learned my addr 172.21.15.172:0/3534298208 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb127fff640 1 --2- 172.21.15.172:0/3534298208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1280acd80 0x7fb1280c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb12c8dd640 1 --2- 172.21.15.172:0/3534298208 >> v2:172.21.15.172:3300/0 conn(0x7fb12806bbf0 0x7fb12806bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fb7fff640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b5a0 0x7f3fc0151f80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800ebe0 tx=0x7f3fa800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f9966d9d640 1 --2- 172.21.15.172:0/4017613334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 0x7f99680c6010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f99580097a0 tx=0x7f995802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49ad9b59a2af068b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb5affd640 1 -- 172.21.15.172:0/627037302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c0ced80 msgr2=0x7ffb5c14fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb5affd640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c0ced80 0x7ffb5c14fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb5affd640 1 -- 172.21.15.172:0/627037302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c161710 msgr2=0x7ffb5c0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb5affd640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c161710 0x7ffb5c0b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7ffb5affd640 1 -- 172.21.15.172:0/627037302 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c1e8f10 con 0x7ffb5c15dc20 2024-04-25T08:46:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fb6ffd640 1 -- 172.21.15.172:0/3894331419 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800cc30 con 0x7f3fc015b5a0 2024-04-25T08:46:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fb6ffd640 1 -- 172.21.15.172:0/3894331419 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa800cdd0 con 0x7f3fc015b5a0 2024-04-25T08:46:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3894331419 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc0151200 con 0x7f3fc015b5a0 2024-04-25T08:46:17.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f9965d9b640 1 -- 172.21.15.172:0/4017613334 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958037070 con 0x7f996815a9f0 2024-04-25T08:46:17.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f9965d9b640 1 -- 172.21.15.172:0/4017613334 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9958032440 con 0x7f996815a9f0 2024-04-25T08:46:17.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb127fff640 1 -- 172.21.15.172:0/3534298208 >> v2:172.21.15.172:3300/0 conn(0x7fb12806bbf0 msgr2=0x7fb12806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:17.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb127fff640 1 --2- 172.21.15.172:0/3534298208 >> v2:172.21.15.172:3300/0 conn(0x7fb12806bbf0 0x7fb12806bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb127fff640 1 -- 172.21.15.172:0/3534298208 >> v1:172.21.15.172:6789/0 conn(0x7fb1280cda20 legacy=0x7fb1280cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f9965d9b640 1 -- 172.21.15.172:0/4017613334 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958032810 con 0x7f996815a9f0 2024-04-25T08:46:17.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3894331419 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc0151a60 con 0x7f3fc015b5a0 2024-04-25T08:46:17.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7fb127fff640 1 -- 172.21.15.172:0/3534298208 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280c5190 con 0x7fb1280acd80 2024-04-25T08:46:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.843+0000 7f3fb6ffd640 1 -- 172.21.15.172:0/3894331419 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa8005bb0 con 0x7f3fc015b5a0 2024-04-25T08:46:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7ffb5affd640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c15dc20 0x7ffb5c0b8120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000e870 tx=0x7ffb5000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7ffb43fff640 1 -- 172.21.15.172:0/627037302 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50017070 con 0x7ffb5c15dc20 2024-04-25T08:46:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7ffb43fff640 1 -- 172.21.15.172:0/627037302 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5000c940 con 0x7ffb5c15dc20 2024-04-25T08:46:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7ffb43fff640 1 -- 172.21.15.172:0/627037302 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5000cd30 con 0x7ffb5c15dc20 2024-04-25T08:46:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7ffb61ff4640 1 -- 172.21.15.172:0/627037302 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5c1e91f0 con 0x7ffb5c15dc20 2024-04-25T08:46:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7ffb61ff4640 1 -- 172.21.15.172:0/627037302 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c1e97b0 con 0x7ffb5c15dc20 2024-04-25T08:46:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7f996d007640 1 -- 172.21.15.172:0/4017613334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 msgr2=0x7f99680c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7f996d007640 1 --2- 172.21.15.172:0/4017613334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 0x7f99680c6010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f99580097a0 tx=0x7f995802a180 comp rx=0 tx=0).stop 2024-04-25T08:46:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7f996d007640 1 -- 172.21.15.172:0/4017613334 shutdown_connections 2024-04-25T08:46:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7fb127fff640 1 --2- 172.21.15.172:0/3534298208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1280acd80 0x7fb1280c5fc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb11400ba50 tx=0x7fb11402c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72560bbb14e1d294 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7f996d007640 1 --2- 172.21.15.172:0/4017613334 >> v2:172.21.15.186:3300/0 conn(0x7f99680cdbf0 0x7f99680ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.844+0000 7f996d007640 1 --2- 172.21.15.172:0/4017613334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 0x7f99680c6010 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.845+0000 7f996d007640 1 -- 172.21.15.172:0/4017613334 >> 172.21.15.172:0/4017613334 conn(0x7f99680b2390 msgr2=0x7f99680b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.845+0000 7fb1277fe640 1 -- 172.21.15.172:0/3534298208 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11403b070 con 0x7fb1280acd80 2024-04-25T08:46:17.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.845+0000 7f996d007640 1 -- 172.21.15.172:0/4017613334 shutdown_connections 2024-04-25T08:46:17.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.845+0000 7fb1277fe640 1 -- 172.21.15.172:0/3534298208 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb114032050 con 0x7fb1280acd80 2024-04-25T08:46:17.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.845+0000 7f996d007640 1 -- 172.21.15.172:0/4017613334 wait complete. 2024-04-25T08:46:17.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.845+0000 7fb1277fe640 1 -- 172.21.15.172:0/3534298208 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11403b070 con 0x7fb1280acd80 2024-04-25T08:46:17.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.845+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3894331419 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc01513d0 con 0x7f3fc015b5a0 2024-04-25T08:46:17.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.845+0000 7ffb61ff4640 1 -- 172.21.15.172:0/627037302 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c0cf6c0 con 0x7ffb5c15dc20 2024-04-25T08:46:17.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.845+0000 7f3fb6ffd640 1 -- 172.21.15.172:0/3894331419 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3fa8006030 con 0x7f3fc015b5a0 2024-04-25T08:46:17.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7fb12eb41640 1 -- 172.21.15.172:0/3534298208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1280acd80 msgr2=0x7fb1280c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7fb12eb41640 1 --2- 172.21.15.172:0/3534298208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1280acd80 0x7fb1280c5fc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb11400ba50 tx=0x7fb11402c840 comp rx=0 tx=0).stop 2024-04-25T08:46:17.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7fb12eb41640 1 -- 172.21.15.172:0/3534298208 shutdown_connections 2024-04-25T08:46:17.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7fb12eb41640 1 --2- 172.21.15.172:0/3534298208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb1280acd80 0x7fb1280c5fc0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb11400ba50 tx=0x7fb11402c840 comp rx=0 tx=0).stop 2024-04-25T08:46:17.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7fb12eb41640 1 --2- 172.21.15.172:0/3534298208 >> v2:172.21.15.172:3300/0 conn(0x7fb12806bbf0 0x7fb12806bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7fb12eb41640 1 -- 172.21.15.172:0/3534298208 >> 172.21.15.172:0/3534298208 conn(0x7fb128071af0 msgr2=0x7fb128071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:17.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7ffb43fff640 1 -- 172.21.15.172:0/627037302 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb5001a070 con 0x7ffb5c15dc20 2024-04-25T08:46:17.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7fb12eb41640 1 -- 172.21.15.172:0/3534298208 shutdown_connections 2024-04-25T08:46:17.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7f3fb6ffd640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fa006b4d0 0x7f3fa006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7f3fb6ffd640 1 -- 172.21.15.172:0/3894331419 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3fa808a7c0 con 0x7f3fc015b5a0 2024-04-25T08:46:17.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7fb12eb41640 1 -- 172.21.15.172:0/3534298208 wait complete. 2024-04-25T08:46:17.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7f3fbe59c640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fa006b4d0 0x7f3fa006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7ffb43fff640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb4806b4d0 0x7ffb4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.846+0000 7ffb43fff640 1 -- 172.21.15.172:0/627037302 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffb5008a1a0 con 0x7ffb5c15dc20 2024-04-25T08:46:17.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.847+0000 7ffb5b7fe640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb4806b4d0 0x7ffb4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.847+0000 7f3fbe59c640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fa006b4d0 0x7f3fa006d990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00019b0 tx=0x7f3fb00012d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.847+0000 7f996d007640 1 Processor -- start 2024-04-25T08:46:17.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.847+0000 7ffb5b7fe640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb4806b4d0 0x7ffb4806d990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c000f60 tx=0x7ffb4c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.847+0000 7f996d007640 1 -- start start 2024-04-25T08:46:17.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7fb12eb41640 1 Processor -- start 2024-04-25T08:46:17.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996d007640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99680cd520 0x7f99680b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7fb12eb41640 1 -- start start 2024-04-25T08:46:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996d007640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99680cdbf0 0x7f996814c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996d007640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 0x7f99680c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996d007640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680cb230 con 0x7f99680cd520 2024-04-25T08:46:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996d007640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680caf50 con 0x7f99680cdbf0 2024-04-25T08:46:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996d007640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680ce070 con 0x7f996815a9f0 2024-04-25T08:46:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f9966d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99680cd520 0x7f99680b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f9966d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99680cd520 0x7f99680b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33134/0 (socket says 172.21.15.172:33134) 2024-04-25T08:46:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f9966d9d640 1 -- 172.21.15.172:0/817059767 learned_addr learned my addr 172.21.15.172:0/817059767 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:17.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996659c640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99680cdbf0 0x7f996814c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996759e640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 0x7f99680c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996659c640 1 -- 172.21.15.172:0/817059767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 msgr2=0x7f99680c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996659c640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 0x7f99680c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996659c640 1 -- 172.21.15.172:0/817059767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99680cd520 msgr2=0x7f99680b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996659c640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99680cd520 0x7f99680b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.848+0000 7f996659c640 1 -- 172.21.15.172:0/817059767 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680b61c0 con 0x7f99680cdbf0 2024-04-25T08:46:17.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7f996659c640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99680cdbf0 0x7f996814c230 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f995c011b00 tx=0x7f995c00f370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12eb41640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb12806bbf0 0x7fb1280b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12eb41640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1280cda20 0x7fb1280b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12eb41640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb12814c8b0 0x7fb12814f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12eb41640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280c6500 con 0x7fb1280cda20 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12eb41640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280c5750 con 0x7fb12814c8b0 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12eb41640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280c6960 con 0x7fb12806bbf0 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb127fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1280cda20 0x7fb1280b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12c8dd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb12806bbf0 0x7fb1280b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12c8dd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb12806bbf0 0x7fb1280b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43482/0 (socket says 172.21.15.172:43482) 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12d0de640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb12814c8b0 0x7fb12814f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12c8dd640 1 -- 172.21.15.172:0/4031922066 learned_addr learned my addr 172.21.15.172:0/4031922066 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12c8dd640 1 -- 172.21.15.172:0/4031922066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb12814c8b0 msgr2=0x7fb12814f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12c8dd640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb12814c8b0 0x7fb12814f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12c8dd640 1 -- 172.21.15.172:0/4031922066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1280cda20 msgr2=0x7fb1280b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12c8dd640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1280cda20 0x7fb1280b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:17.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12c8dd640 1 -- 172.21.15.172:0/4031922066 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280b5ad0 con 0x7fb12806bbf0 2024-04-25T08:46:17.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb127fff640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1280cda20 0x7fb1280b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:17.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.849+0000 7fb12c8dd640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb12806bbf0 0x7fb1280b53c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00e9b0 tx=0x7fb11c00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.854+0000 7f994f7fe640 1 -- 172.21.15.172:0/817059767 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c00fda0 con 0x7f99680cdbf0 2024-04-25T08:46:17.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.854+0000 7f994f7fe640 1 -- 172.21.15.172:0/817059767 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c004030 con 0x7f99680cdbf0 2024-04-25T08:46:17.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.854+0000 7f996d007640 1 -- 172.21.15.172:0/817059767 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996814c770 con 0x7f99680cdbf0 2024-04-25T08:46:17.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.854+0000 7f994f7fe640 1 -- 172.21.15.172:0/817059767 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c004420 con 0x7f99680cdbf0 2024-04-25T08:46:17.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.854+0000 7f996d007640 1 -- 172.21.15.172:0/817059767 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99680ca250 con 0x7f99680cdbf0 2024-04-25T08:46:17.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.855+0000 7f3fb6ffd640 1 -- 172.21.15.172:0/3894331419 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3fc01524c0 con 0x7f3fc015b5a0 2024-04-25T08:46:17.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.855+0000 7f996d007640 1 -- 172.21.15.172:0/817059767 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996806cc80 con 0x7f99680cdbf0 2024-04-25T08:46:17.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.855+0000 7fb1257fa640 1 -- 172.21.15.172:0/4031922066 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c017070 con 0x7fb12806bbf0 2024-04-25T08:46:17.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.856+0000 7fb1257fa640 1 -- 172.21.15.172:0/4031922066 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c00c9a0 con 0x7fb12806bbf0 2024-04-25T08:46:17.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.856+0000 7fb1257fa640 1 -- 172.21.15.172:0/4031922066 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c00cd90 con 0x7fb12806bbf0 2024-04-25T08:46:17.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.856+0000 7fb12eb41640 1 -- 172.21.15.172:0/4031922066 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280b5db0 con 0x7fb12806bbf0 2024-04-25T08:46:17.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.856+0000 7fb12eb41640 1 -- 172.21.15.172:0/4031922066 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1280c8380 con 0x7fb12806bbf0 2024-04-25T08:46:17.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.856+0000 7ffb43fff640 1 -- 172.21.15.172:0/627037302 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb5c0cf6c0 con 0x7ffb5c15dc20 2024-04-25T08:46:17.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.856+0000 7f994f7fe640 1 -- 172.21.15.172:0/817059767 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f995c022020 con 0x7f99680cdbf0 2024-04-25T08:46:17.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.856+0000 7f994f7fe640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f995406b4d0 0x7f995406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.856+0000 7f994f7fe640 1 -- 172.21.15.172:0/817059767 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f995c08c100 con 0x7f99680cdbf0 2024-04-25T08:46:17.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.857+0000 7f9966d9d640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f995406b4d0 0x7f995406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.857+0000 7fb12eb41640 1 -- 172.21.15.172:0/4031922066 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb128073a00 con 0x7fb12806bbf0 2024-04-25T08:46:17.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.857+0000 7f9966d9d640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f995406b4d0 0x7f995406d990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f995802a1c0 tx=0x7f995802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.858+0000 7fb1257fa640 1 -- 172.21.15.172:0/4031922066 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb11c01a070 con 0x7fb12806bbf0 2024-04-25T08:46:17.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.858+0000 7fb1257fa640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb10c06b4d0 0x7fb10c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:17.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.858+0000 7fb1257fa640 1 -- 172.21.15.172:0/4031922066 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb11c08aad0 con 0x7fb12806bbf0 2024-04-25T08:46:17.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.859+0000 7fb127fff640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb10c06b4d0 0x7fb10c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:17.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.859+0000 7fb127fff640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb10c06b4d0 0x7fb10c06d990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb114038000 tx=0x7fb114031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:17.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.865+0000 7f994f7fe640 1 -- 172.21.15.172:0/817059767 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f996814c770 con 0x7f99680cdbf0 2024-04-25T08:46:17.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:17.866+0000 7fb1257fa640 1 -- 172.21.15.172:0/4031922066 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb11c0591e0 con 0x7fb12806bbf0 2024-04-25T08:46:18.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.107+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3894331419 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f3fc0073a00 con 0x7f3fc015b5a0 2024-04-25T08:46:18.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.108+0000 7ffb61ff4640 1 -- 172.21.15.172:0/627037302 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7ffb5c0d16b0 con 0x7ffb5c15dc20 2024-04-25T08:46:18.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.130+0000 7fb12eb41640 1 -- 172.21.15.172:0/4031922066 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7fb1280743a0 con 0x7fb12806bbf0 2024-04-25T08:46:18.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.131+0000 7f996d007640 1 -- 172.21.15.172:0/817059767 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f99680739e0 con 0x7f99680cdbf0 2024-04-25T08:46:18.489 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:46:18.498+0000 7f941032a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:46:18.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.498+0000 7f3fb6ffd640 1 -- 172.21.15.172:0/3894331419 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6699 v35) v1 ==== 95+0+0 (secure 0 0 0) 0x7f3fa8017020 con 0x7f3fc015b5a0 2024-04-25T08:46:18.490 INFO:teuthology.orchestra.run.smithi172.stderr:failed mds gid 6699 2024-04-25T08:46:18.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3894331419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fa006b4d0 msgr2=0x7f3fa006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:18.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fa006b4d0 0x7f3fa006d990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00019b0 tx=0x7f3fb00012d0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3894331419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b5a0 msgr2=0x7f3fc0151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b5a0 0x7f3fc0151f80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800ebe0 tx=0x7f3fa800c520 comp rx=0 tx=0).stop 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3894331419 shutdown_connections 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fa006b4d0 0x7f3fa006d990 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fc015b5a0 0x7f3fc0151f80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fc015b980 0x7f3fc01f3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 --2- 172.21.15.172:0/3894331419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fc00b5c40 0x7f3fc00ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3894331419 >> 172.21.15.172:0/3894331419 conn(0x7f3fc00d0530 msgr2=0x7f3fc00d3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3894331419 shutdown_connections 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7f3fc4d90640 1 -- 172.21.15.172:0/3894331419 wait complete. 2024-04-25T08:46:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.501+0000 7ffb43fff640 1 -- 172.21.15.172:0/627037302 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6705 v36) v1 ==== 95+0+0 (secure 0 0 0) 0x7ffb50058840 con 0x7ffb5c15dc20 2024-04-25T08:46:18.494 INFO:teuthology.orchestra.run.smithi172.stderr:failed mds gid 6705 2024-04-25T08:46:18.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 -- 172.21.15.172:0/627037302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb4806b4d0 msgr2=0x7ffb4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:18.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb4806b4d0 0x7ffb4806d990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c000f60 tx=0x7ffb4c009040 comp rx=0 tx=0).stop 2024-04-25T08:46:18.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 -- 172.21.15.172:0/627037302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c15dc20 msgr2=0x7ffb5c0b8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:18.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c15dc20 0x7ffb5c0b8120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000e870 tx=0x7ffb5000ed30 comp rx=0 tx=0).stop 2024-04-25T08:46:18.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 -- 172.21.15.172:0/627037302 shutdown_connections 2024-04-25T08:46:18.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb4806b4d0 0x7ffb4806d990 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb5c161710 0x7ffb5c0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb5c15dc20 0x7ffb5c0b8120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 --2- 172.21.15.172:0/627037302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c0ced80 0x7ffb5c14fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 -- 172.21.15.172:0/627037302 >> 172.21.15.172:0/627037302 conn(0x7ffb5c0d0420 msgr2=0x7ffb5c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:18.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 -- 172.21.15.172:0/627037302 shutdown_connections 2024-04-25T08:46:18.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.504+0000 7ffb61ff4640 1 -- 172.21.15.172:0/627037302 wait complete. 2024-04-25T08:46:18.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.506+0000 7fb1257fa640 1 -- 172.21.15.172:0/4031922066 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5510 v37) v1 ==== 95+0+0 (secure 0 0 0) 0x7fb11c05d280 con 0x7fb12806bbf0 2024-04-25T08:46:18.498 INFO:teuthology.orchestra.run.smithi172.stderr:failed mds gid 5510 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 -- 172.21.15.172:0/4031922066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb10c06b4d0 msgr2=0x7fb10c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb10c06b4d0 0x7fb10c06d990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb114038000 tx=0x7fb114031000 comp rx=0 tx=0).stop 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 -- 172.21.15.172:0/4031922066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb12806bbf0 msgr2=0x7fb1280b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb12806bbf0 0x7fb1280b53c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00e9b0 tx=0x7fb11c00ee70 comp rx=0 tx=0).stop 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 -- 172.21.15.172:0/4031922066 shutdown_connections 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb10c06b4d0 0x7fb10c06d990 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb12814c8b0 0x7fb12814f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1280cda20 0x7fb1280b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 --2- 172.21.15.172:0/4031922066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb12806bbf0 0x7fb1280b53c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 -- 172.21.15.172:0/4031922066 >> 172.21.15.172:0/4031922066 conn(0x7fb128071af0 msgr2=0x7fb128159980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 -- 172.21.15.172:0/4031922066 shutdown_connections 2024-04-25T08:46:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:18.509+0000 7fb12eb41640 1 -- 172.21.15.172:0/4031922066 wait complete. 2024-04-25T08:46:18.510 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:46:18.510 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:46:18.511 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:46:18.511 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:46:18.514 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:46:18.514 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:18.515 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:46:18.515 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:46:18.516 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:46:18.516 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:18.518 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:46:18.518 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:18.586 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:46:18.588 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:46:18.589 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:46:19.489 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:46:19.497+0000 7f941032a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:46:19.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.509+0000 7f994f7fe640 1 -- 172.21.15.172:0/817059767 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6696 v38) v1 ==== 95+0+0 (secure 0 0 0) 0x7f99680b61c0 con 0x7f99680cdbf0 2024-04-25T08:46:19.500 INFO:teuthology.orchestra.run.smithi172.stderr:failed mds gid 6696 2024-04-25T08:46:19.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 -- 172.21.15.172:0/817059767 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f995406b4d0 msgr2=0x7f995406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:19.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f995406b4d0 0x7f995406d990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f995802a1c0 tx=0x7f995802e000 comp rx=0 tx=0).stop 2024-04-25T08:46:19.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 -- 172.21.15.172:0/817059767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99680cdbf0 msgr2=0x7f996814c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:19.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99680cdbf0 0x7f996814c230 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f995c011b00 tx=0x7f995c00f370 comp rx=0 tx=0).stop 2024-04-25T08:46:19.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 -- 172.21.15.172:0/817059767 shutdown_connections 2024-04-25T08:46:19.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f995406b4d0 0x7f995406d990 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99680cdbf0 0x7f996814c230 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f996815a9f0 0x7f99680c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 --2- 172.21.15.172:0/817059767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99680cd520 0x7f99680b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 -- 172.21.15.172:0/817059767 >> 172.21.15.172:0/817059767 conn(0x7f99680b2390 msgr2=0x7f996806e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:19.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 -- 172.21.15.172:0/817059767 shutdown_connections 2024-04-25T08:46:19.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.511+0000 7f996d007640 1 -- 172.21.15.172:0/817059767 wait complete. 2024-04-25T08:46:19.520 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:46:19.520 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:46:19.522 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:46:19.522 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:19.523 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:19.600 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:46:19.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.634+0000 7fe3290f5640 1 Processor -- start 2024-04-25T08:46:19.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.634+0000 7fe3290f5640 1 -- start start 2024-04-25T08:46:19.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.635+0000 7fe3290f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe32415dbe0 0x7fe3240d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:19.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.635+0000 7fe3290f5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe3240b92a0 0x7fe3240d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:19.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.635+0000 7fe3290f5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3240b97a0 con 0x7fe3240b2cb0 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.635+0000 7fe3290f5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32415dfc0 con 0x7fe3240b92a0 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.635+0000 7fe3290f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240d1a00 con 0x7fe32415dbe0 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.636+0000 7fe322d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe32415dbe0 0x7fe3240d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.636+0000 7fe32359e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe3240b92a0 0x7fe3240d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.636+0000 7fe32259c640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fe3240b2cb0 0x7fe3240b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:40560/0 (socket says 172.21.15.172:40560) 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.636+0000 7fe32259c640 1 -- 172.21.15.172:0/4144594580 learned_addr learned my addr 172.21.15.172:0/4144594580 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.636+0000 7fe322d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe32415dbe0 0x7fe3240d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:43524/0 (socket says 172.21.15.172:43524) 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.636+0000 7fe322d9d640 1 -- 172.21.15.172:0/4144594580 >> v2:172.21.15.186:3300/0 conn(0x7fe3240b92a0 msgr2=0x7fe3240d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.636+0000 7fe322d9d640 1 --2- 172.21.15.172:0/4144594580 >> v2:172.21.15.186:3300/0 conn(0x7fe3240b92a0 0x7fe3240d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.636+0000 7fe322d9d640 1 -- 172.21.15.172:0/4144594580 >> v1:172.21.15.186:6789/0 conn(0x7fe3240b2cb0 legacy=0x7fe3240b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.636+0000 7fe322d9d640 1 -- 172.21.15.172:0/4144594580 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3240d1c50 con 0x7fe32415dbe0 2024-04-25T08:46:19.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe322d9d640 1 --2- 172.21.15.172:0/4144594580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe32415dbe0 0x7fe3240d0910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe3140097a0 tx=0x7fe31402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f58cf19b9a643775 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:19.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe321d9b640 1 -- 172.21.15.172:0/4144594580 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314037070 con 0x7fe32415dbe0 2024-04-25T08:46:19.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe321d9b640 1 -- 172.21.15.172:0/4144594580 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe314032440 con 0x7fe32415dbe0 2024-04-25T08:46:19.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe321d9b640 1 -- 172.21.15.172:0/4144594580 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314032810 con 0x7fe32415dbe0 2024-04-25T08:46:19.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe3290f5640 1 -- 172.21.15.172:0/4144594580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe32415dbe0 msgr2=0x7fe3240d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:19.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe3290f5640 1 --2- 172.21.15.172:0/4144594580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe32415dbe0 0x7fe3240d0910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe3140097a0 tx=0x7fe31402a180 comp rx=0 tx=0).stop 2024-04-25T08:46:19.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe3290f5640 1 -- 172.21.15.172:0/4144594580 shutdown_connections 2024-04-25T08:46:19.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe3290f5640 1 --2- 172.21.15.172:0/4144594580 >> v2:172.21.15.186:3300/0 conn(0x7fe3240b92a0 0x7fe3240d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe3290f5640 1 --2- 172.21.15.172:0/4144594580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe32415dbe0 0x7fe3240d0910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe3290f5640 1 -- 172.21.15.172:0/4144594580 >> 172.21.15.172:0/4144594580 conn(0x7fe324061a20 msgr2=0x7fe324061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:19.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe3290f5640 1 -- 172.21.15.172:0/4144594580 shutdown_connections 2024-04-25T08:46:19.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.637+0000 7fe3290f5640 1 -- 172.21.15.172:0/4144594580 wait complete. 2024-04-25T08:46:19.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.639+0000 7fe3290f5640 1 Processor -- start 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.639+0000 7fe3290f5640 1 -- start start 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.639+0000 7fe3290f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240b2cb0 0x7fe3241f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe3290f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3240b92a0 0x7fe3240b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe3290f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe32415dbe0 0x7fe32415f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe3290f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240b6ab0 con 0x7fe3240b2cb0 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe3290f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240d2210 con 0x7fe32415dbe0 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe3290f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240b6c30 con 0x7fe3240b92a0 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe322d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240b2cb0 0x7fe3241f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe322d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240b2cb0 0x7fe3241f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33182/0 (socket says 172.21.15.172:33182) 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe322d9d640 1 -- 172.21.15.172:0/2075042858 learned_addr learned my addr 172.21.15.172:0/2075042858 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe32259c640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3240b92a0 0x7fe3240b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe32359e640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe32415dbe0 0x7fe32415f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:19.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe322d9d640 1 -- 172.21.15.172:0/2075042858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3240b92a0 msgr2=0x7fe3240b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe322d9d640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3240b92a0 0x7fe3240b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe322d9d640 1 -- 172.21.15.172:0/2075042858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe32415dbe0 msgr2=0x7fe32415f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe322d9d640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe32415dbe0 0x7fe32415f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe322d9d640 1 -- 172.21.15.172:0/2075042858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3240b5b10 con 0x7fe3240b2cb0 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe32359e640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe32415dbe0 0x7fe32415f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe322d9d640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240b2cb0 0x7fe3241f3ba0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe31402a1c0 tx=0x7fe3140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe30b7fe640 1 -- 172.21.15.172:0/2075042858 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314041020 con 0x7fe3240b2cb0 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe30b7fe640 1 -- 172.21.15.172:0/2075042858 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe314030700 con 0x7fe3240b2cb0 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe30b7fe640 1 -- 172.21.15.172:0/2075042858 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314037040 con 0x7fe3240b2cb0 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.640+0000 7fe3290f5640 1 -- 172.21.15.172:0/2075042858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3240caca0 con 0x7fe3240b2cb0 2024-04-25T08:46:19.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.641+0000 7fe3290f5640 1 -- 172.21.15.172:0/2075042858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3240cb260 con 0x7fe3240b2cb0 2024-04-25T08:46:19.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.642+0000 7fe3290f5640 1 -- 172.21.15.172:0/2075042858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3240caa30 con 0x7fe3240b2cb0 2024-04-25T08:46:19.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.642+0000 7fe30b7fe640 1 -- 172.21.15.172:0/2075042858 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe314044020 con 0x7fe3240b2cb0 2024-04-25T08:46:19.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.642+0000 7fe30b7fe640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe31006b4d0 0x7fe31006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:19.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.642+0000 7fe30b7fe640 1 -- 172.21.15.172:0/2075042858 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fe3140aabc0 con 0x7fe3240b2cb0 2024-04-25T08:46:19.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.642+0000 7fe32259c640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe31006b4d0 0x7fe31006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:19.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.643+0000 7fe32259c640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe31006b4d0 0x7fe31006d990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe3240b63e0 tx=0x7fe318007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:19.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.647+0000 7fe30b7fe640 1 -- 172.21.15.172:0/2075042858 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe31404b030 con 0x7fe3240b2cb0 2024-04-25T08:46:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.852+0000 7fe3290f5640 1 -- 172.21.15.172:0/2075042858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3240d2a40 con 0x7fe3240b2cb0 2024-04-25T08:46:19.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.852+0000 7fe30b7fe640 1 -- 172.21.15.172:0/2075042858 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4140 (secure 0 0 0) 0x7fe314079810 con 0x7fe3240b2cb0 2024-04-25T08:46:19.844 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:19.844 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/384277594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":384277594},{"type":"v1","addr":"172.21.15.186:6833","nonce":384277594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/842443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":842443},{"type":"v1","addr":"172.21.15.186:6835","nonce":842443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:08.789050+0000","modified":"2024-04-25T08:46:19.504549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"a","rank":0,"incarnation":39,"state":"up:replay","state_seq":1,"addr":"172.21.15.172:6835/311149179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":311149179},{"type":"v1","addr":"172.21.15.172:6835","nonce":311149179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:46:19.844 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 39 2024-04-25T08:46:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 -- 172.21.15.172:0/2075042858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe31006b4d0 msgr2=0x7fe31006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe31006b4d0 0x7fe31006d990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe3240b63e0 tx=0x7fe318007e80 comp rx=0 tx=0).stop 2024-04-25T08:46:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 -- 172.21.15.172:0/2075042858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240b2cb0 msgr2=0x7fe3241f3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240b2cb0 0x7fe3241f3ba0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe31402a1c0 tx=0x7fe3140046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 -- 172.21.15.172:0/2075042858 shutdown_connections 2024-04-25T08:46:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe31006b4d0 0x7fe31006d990 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe32415dbe0 0x7fe32415f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3240b92a0 0x7fe3240b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 --2- 172.21.15.172:0/2075042858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240b2cb0 0x7fe3241f3ba0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 -- 172.21.15.172:0/2075042858 >> 172.21.15.172:0/2075042858 conn(0x7fe324061a20 msgr2=0x7fe32415bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:19.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 -- 172.21.15.172:0/2075042858 shutdown_connections 2024-04-25T08:46:19.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:19.854+0000 7fe3290f5640 1 -- 172.21.15.172:0/2075042858 wait complete. 2024-04-25T08:46:20.260 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:46:08.789050+0000', 'modified': '2024-04-25T08:46:19.504549+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6960}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6960': {'gid': 6960, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/311149179', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 311149179}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 311149179}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:46:20.260 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6960:up:replay 2024-04-25T08:46:21.261 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:21.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.380+0000 7f5fb7c9a640 1 Processor -- start 2024-04-25T08:46:21.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.381+0000 7f5fb7c9a640 1 -- start start 2024-04-25T08:46:21.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.381+0000 7f5fb7c9a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5fb015dbe0 0x7f5fb00d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.381+0000 7f5fb7c9a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5fb00b92a0 0x7f5fb00d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.381+0000 7f5fb7c9a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00b97a0 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.381+0000 7f5fb7c9a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb015dfc0 con 0x7f5fb00b92a0 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.381+0000 7f5fb7c9a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00d1a00 con 0x7f5fb015dbe0 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.382+0000 7f5fb6237640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5fb00b92a0 0x7f5fb00d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.382+0000 7f5fb5235640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5fb00b2cb0 0x7f5fb00b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55638/0 (socket says 172.21.15.172:55638) 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.382+0000 7f5fb5235640 1 -- 172.21.15.172:0/1363270558 learned_addr learned my addr 172.21.15.172:0/1363270558 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.382+0000 7f5fb5a36640 1 --2- 172.21.15.172:0/1363270558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5fb015dbe0 0x7f5fb00d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.382+0000 7f5fb6237640 1 -- 172.21.15.172:0/1363270558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5fb015dbe0 msgr2=0x7f5fb00d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.382+0000 7f5fb6237640 1 --2- 172.21.15.172:0/1363270558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5fb015dbe0 0x7f5fb00d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:21.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.382+0000 7f5fb6237640 1 -- 172.21.15.172:0/1363270558 >> v1:172.21.15.172:6789/0 conn(0x7f5fb00b2cb0 legacy=0x7f5fb00b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.382+0000 7f5fb4a34640 1 -- 172.21.15.172:0/1363270558 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331630161 0 0) 0x7f5fb00b97a0 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.382+0000 7f5fb6237640 1 -- 172.21.15.172:0/1363270558 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00d1c50 con 0x7f5fb00b92a0 2024-04-25T08:46:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.383+0000 7f5fb6237640 1 --2- 172.21.15.172:0/1363270558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b92a0 0x7f5fb00d0e50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009d90 tx=0x7f5fa802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89e72ae927fd037 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.383+0000 7f5fb4a34640 1 -- 172.21.15.172:0/1363270558 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8007740 con 0x7f5fb00b92a0 2024-04-25T08:46:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.383+0000 7f5fb4a34640 1 -- 172.21.15.172:0/1363270558 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa80078e0 con 0x7f5fb00b92a0 2024-04-25T08:46:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.383+0000 7f5fb4a34640 1 -- 172.21.15.172:0/1363270558 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8007cb0 con 0x7f5fb00b92a0 2024-04-25T08:46:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.383+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/1363270558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b92a0 msgr2=0x7f5fb00d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:21.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.383+0000 7f5fb7c9a640 1 --2- 172.21.15.172:0/1363270558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b92a0 0x7f5fb00d0e50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009d90 tx=0x7f5fa802a660 comp rx=0 tx=0).stop 2024-04-25T08:46:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.384+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/1363270558 shutdown_connections 2024-04-25T08:46:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.384+0000 7f5fb7c9a640 1 --2- 172.21.15.172:0/1363270558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b92a0 0x7f5fb00d0e50 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.384+0000 7f5fb7c9a640 1 --2- 172.21.15.172:0/1363270558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5fb015dbe0 0x7f5fb00d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.384+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/1363270558 >> 172.21.15.172:0/1363270558 conn(0x7f5fb0061a20 msgr2=0x7f5fb0061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.384+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/1363270558 shutdown_connections 2024-04-25T08:46:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.384+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/1363270558 wait complete. 2024-04-25T08:46:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.385+0000 7f5fb7c9a640 1 Processor -- start 2024-04-25T08:46:21.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.385+0000 7f5fb7c9a640 1 -- start start 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb7c9a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b2cb0 0x7f5fb00ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb7c9a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5fb00b92a0 0x7f5fb00cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb7c9a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fb015dbe0 0x7f5fb00d29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb7c9a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00b6ab0 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb7c9a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00d2210 con 0x7f5fb015dbe0 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb7c9a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00b6c30 con 0x7f5fb00b92a0 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb5a36640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b2cb0 0x7f5fb00ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb5a36640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b2cb0 0x7f5fb00ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33206/0 (socket says 172.21.15.172:33206) 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb5a36640 1 -- 172.21.15.172:0/2073335206 learned_addr learned my addr 172.21.15.172:0/2073335206 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb5235640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5fb00b92a0 0x7f5fb00cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb6237640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fb015dbe0 0x7f5fb00d29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb5a36640 1 -- 172.21.15.172:0/2073335206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5fb00b92a0 msgr2=0x7f5fb00cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:21.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb5a36640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5fb00b92a0 0x7f5fb00cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb5a36640 1 -- 172.21.15.172:0/2073335206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fb015dbe0 msgr2=0x7f5fb00d29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb5a36640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fb015dbe0 0x7f5fb00d29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb5a36640 1 -- 172.21.15.172:0/2073335206 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00b3410 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb6237640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fb015dbe0 0x7f5fb00d29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb5a36640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b2cb0 0x7f5fb00ccdc0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00e870 tx=0x7f5fac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fa27fc640 1 -- 172.21.15.172:0/2073335206 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac017070 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fa27fc640 1 -- 172.21.15.172:0/2073335206 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac00c940 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fa27fc640 1 -- 172.21.15.172:0/2073335206 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00cd30 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/2073335206 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb0160ee0 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.386+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/2073335206 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb015fd80 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.387+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/2073335206 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb0073990 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.388+0000 7f5fa27fc640 1 -- 172.21.15.172:0/2073335206 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5fac01a070 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.388+0000 7f5fa27fc640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f9406b500 0x7f5f9406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:21.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.388+0000 7f5fa27fc640 1 -- 172.21.15.172:0/2073335206 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f5fac08a2a0 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.388+0000 7f5fb5235640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f9406b500 0x7f5f9406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:21.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.389+0000 7f5fb5235640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f9406b500 0x7f5f9406d9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5fb01f0f80 tx=0x7f5fa4007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:21.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.392+0000 7f5fa27fc640 1 -- 172.21.15.172:0/2073335206 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5fac058ef0 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.601+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/2073335206 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fb0062210 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.601+0000 7f5fa27fc640 1 -- 172.21.15.172:0/2073335206 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f5fac0587f0 con 0x7f5fb00b2cb0 2024-04-25T08:46:21.593 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:21.593 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":41,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/384277594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":384277594},{"type":"v1","addr":"172.21.15.186:6833","nonce":384277594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/842443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":842443},{"type":"v1","addr":"172.21.15.186:6835","nonce":842443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2655968938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2655968938},{"type":"v1","addr":"172.21.15.172:6837","nonce":2655968938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:08.789050+0000","modified":"2024-04-25T08:46:20.520539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"a","rank":0,"incarnation":39,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.172:6835/311149179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":311149179},{"type":"v1","addr":"172.21.15.172:6835","nonce":311149179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:46:21.593 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 41 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/2073335206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f9406b500 msgr2=0x7f5f9406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f9406b500 0x7f5f9406d9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5fb01f0f80 tx=0x7f5fa4007b50 comp rx=0 tx=0).stop 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/2073335206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b2cb0 msgr2=0x7f5fb00ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b2cb0 0x7f5fb00ccdc0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00e870 tx=0x7f5fac00ed30 comp rx=0 tx=0).stop 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/2073335206 shutdown_connections 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f9406b500 0x7f5f9406d9c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5fb015dbe0 0x7f5fb00d29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5fb00b92a0 0x7f5fb00cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 --2- 172.21.15.172:0/2073335206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb00b2cb0 0x7f5fb00ccdc0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/2073335206 >> 172.21.15.172:0/2073335206 conn(0x7f5fb0061a20 msgr2=0x7f5fb00ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:21.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/2073335206 shutdown_connections 2024-04-25T08:46:21.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:21.603+0000 7f5fb7c9a640 1 -- 172.21.15.172:0/2073335206 wait complete. 2024-04-25T08:46:22.008 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:46:08.789050+0000', 'modified': '2024-04-25T08:46:20.520539+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6960}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6960': {'gid': 6960, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.172:6835/311149179', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 311149179}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 311149179}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:46:22.008 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6960:up:rejoin 2024-04-25T08:46:23.009 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:23.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.127+0000 7f3ab26ee640 1 Processor -- start 2024-04-25T08:46:23.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.127+0000 7f3ab26ee640 1 -- start start 2024-04-25T08:46:23.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3ab26ee640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3aac13d190 0x7f3aac0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3ab26ee640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac071ed0 con 0x7f3aac15b320 2024-04-25T08:46:23.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3ab26ee640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac15a840 con 0x7f3aac071940 2024-04-25T08:46:23.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3ab26ee640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac13d570 con 0x7f3aac13d190 2024-04-25T08:46:23.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aab7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3aac15b320 0x7f3aac071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55652/0 (socket says 172.21.15.172:55652) 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aab7fe640 1 -- 172.21.15.172:0/3726808027 learned_addr learned my addr 172.21.15.172:0/3726808027 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aabfff640 1 --2- 172.21.15.172:0/3726808027 >> v2:172.21.15.186:3300/0 conn(0x7f3aac13d190 0x7f3aac0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274280552 0 0) 0x7f3aac071ed0 con 0x7f3aac15b320 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a94003520 con 0x7f3aac15b320 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2402984549 0 0) 0x7f3a94003520 con 0x7f3aac15b320 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 >> v2:172.21.15.186:3300/0 conn(0x7f3aac13d190 msgr2=0x7f3aac0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 --2- 172.21.15.172:0/3726808027 >> v2:172.21.15.186:3300/0 conn(0x7f3aac13d190 0x7f3aac0cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 >> v1:172.21.15.186:6789/0 conn(0x7f3aac071940 legacy=0x7f3aac15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac15ab20 con 0x7f3aac15b320 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f3aa0001670 con 0x7f3aac15b320 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 >> v1:172.21.15.172:6789/0 conn(0x7f3aac15b320 legacy=0x7f3aac071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a940039b0 0x7f3a94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a94004800 0x7f3a94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a940051c0 0x7f3a9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac13d570 con 0x7f3a940039b0 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9400c160 con 0x7f3a94004800 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.128+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9400e570 con 0x7f3a940051c0 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.129+0000 7f3aabfff640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a940039b0 0x7f3a94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.129+0000 7f3aab7fe640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a94004800 0x7f3a94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.129+0000 7f3ab0c8b640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a940051c0 0x7f3a9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.129+0000 7f3aabfff640 1 -- 172.21.15.172:0/3726808027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a940051c0 msgr2=0x7f3a9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.129+0000 7f3aabfff640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a940051c0 0x7f3a9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.129+0000 7f3aabfff640 1 -- 172.21.15.172:0/3726808027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a94004800 msgr2=0x7f3a94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.129+0000 7f3aabfff640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a94004800 0x7f3a94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.129+0000 7f3aabfff640 1 -- 172.21.15.172:0/3726808027 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a94003520 con 0x7f3a940039b0 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.129+0000 7f3ab0c8b640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a940051c0 0x7f3a9400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.129+0000 7f3ab0c8b640 1 -- 172.21.15.172:0/3726808027 reap_dead start 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3aabfff640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a940039b0 0x7f3a94003dd0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009ac0 tx=0x7f3a94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40b7734e95460c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c036070 con 0x7f3a940039b0 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c031400 con 0x7f3a940039b0 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3aaaffd640 1 -- 172.21.15.172:0/3726808027 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c009690 con 0x7f3a940039b0 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3ab26ee640 1 -- 172.21.15.172:0/3726808027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a940039b0 msgr2=0x7f3a94003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3ab26ee640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a940039b0 0x7f3a94003dd0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009ac0 tx=0x7f3a94005830 comp rx=0 tx=0).stop 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3ab26ee640 1 -- 172.21.15.172:0/3726808027 shutdown_connections 2024-04-25T08:46:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3ab26ee640 1 --2- 172.21.15.172:0/3726808027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a940039b0 0x7f3a94003dd0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3ab26ee640 1 -- 172.21.15.172:0/3726808027 >> 172.21.15.172:0/3726808027 conn(0x7f3aac06abe0 msgr2=0x7f3aac06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:23.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3ab26ee640 1 -- 172.21.15.172:0/3726808027 shutdown_connections 2024-04-25T08:46:23.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.130+0000 7f3ab26ee640 1 -- 172.21.15.172:0/3726808027 wait complete. 2024-04-25T08:46:23.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.132+0000 7f3ab26ee640 1 Processor -- start 2024-04-25T08:46:23.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.132+0000 7f3ab26ee640 1 -- start start 2024-04-25T08:46:23.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3ab26ee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a940039b0 0x7f3aac0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3ab26ee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aac0ade30 0x7f3aac147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3ab26ee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aac155080 0x7f3aac155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3ab26ee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0713b0 con 0x7f3aac0ade30 2024-04-25T08:46:23.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3ab26ee640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac071230 con 0x7f3a940039b0 2024-04-25T08:46:23.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3ab26ee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac071530 con 0x7f3aac155080 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aab7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aac0ade30 0x7f3aac147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aab7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aac0ade30 0x7f3aac147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33216/0 (socket says 172.21.15.172:33216) 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aab7fe640 1 -- 172.21.15.172:0/1955683164 learned_addr learned my addr 172.21.15.172:0/1955683164 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aabfff640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a940039b0 0x7f3aac0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3ab0c8b640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aac155080 0x7f3aac155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aab7fe640 1 -- 172.21.15.172:0/1955683164 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aac155080 msgr2=0x7f3aac155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aab7fe640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aac155080 0x7f3aac155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aab7fe640 1 -- 172.21.15.172:0/1955683164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a940039b0 msgr2=0x7f3aac0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aab7fe640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a940039b0 0x7f3aac0b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aab7fe640 1 -- 172.21.15.172:0/1955683164 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0ad880 con 0x7f3aac0ade30 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aab7fe640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aac0ade30 0x7f3aac147ef0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00072c0 tx=0x7f3aa0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:23.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aa8ff9640 1 -- 172.21.15.172:0/1955683164 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa001a070 con 0x7f3aac0ade30 2024-04-25T08:46:23.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aa8ff9640 1 -- 172.21.15.172:0/1955683164 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa000fa20 con 0x7f3aac0ade30 2024-04-25T08:46:23.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3ab26ee640 1 -- 172.21.15.172:0/1955683164 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac0b2f20 con 0x7f3aac0ade30 2024-04-25T08:46:23.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3aa8ff9640 1 -- 172.21.15.172:0/1955683164 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa000fdd0 con 0x7f3aac0ade30 2024-04-25T08:46:23.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.133+0000 7f3ab26ee640 1 -- 172.21.15.172:0/1955683164 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac0ad5a0 con 0x7f3aac0ade30 2024-04-25T08:46:23.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.135+0000 7f3ab26ee640 1 -- 172.21.15.172:0/1955683164 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac073990 con 0x7f3aac0ade30 2024-04-25T08:46:23.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.135+0000 7f3aa8ff9640 1 -- 172.21.15.172:0/1955683164 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3aa001d070 con 0x7f3aac0ade30 2024-04-25T08:46:23.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.135+0000 7f3aa8ff9640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a9806b500 0x7f3a9806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.135+0000 7f3aa8ff9640 1 -- 172.21.15.172:0/1955683164 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f3aa0089f60 con 0x7f3aac0ade30 2024-04-25T08:46:23.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.135+0000 7f3aabfff640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a9806b500 0x7f3a9806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.136+0000 7f3aabfff640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a9806b500 0x7f3a9806d9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c033000 tx=0x7f3a9c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:23.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.140+0000 7f3aa8ff9640 1 -- 172.21.15.172:0/1955683164 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3aa0058c30 con 0x7f3aac0ade30 2024-04-25T08:46:23.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.344+0000 7f3ab26ee640 1 -- 172.21.15.172:0/1955683164 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3aac0af240 con 0x7f3aac0ade30 2024-04-25T08:46:23.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.344+0000 7f3aa8ff9640 1 -- 172.21.15.172:0/1955683164 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4934 (secure 0 0 0) 0x7f3aa0058530 con 0x7f3aac0ade30 2024-04-25T08:46:23.336 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:23.336 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":42,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/384277594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":384277594},{"type":"v1","addr":"172.21.15.186:6833","nonce":384277594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/842443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":842443},{"type":"v1","addr":"172.21.15.186:6835","nonce":842443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2655968938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2655968938},{"type":"v1","addr":"172.21.15.172:6837","nonce":2655968938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:08.789050+0000","modified":"2024-04-25T08:46:21.527505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6835/311149179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":311149179},{"type":"v1","addr":"172.21.15.172:6835","nonce":311149179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:46:23.336 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 42 2024-04-25T08:46:23.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 -- 172.21.15.172:0/1955683164 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a9806b500 msgr2=0x7f3a9806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a9806b500 0x7f3a9806d9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c033000 tx=0x7f3a9c008030 comp rx=0 tx=0).stop 2024-04-25T08:46:23.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 -- 172.21.15.172:0/1955683164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aac0ade30 msgr2=0x7f3aac147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aac0ade30 0x7f3aac147ef0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00072c0 tx=0x7f3aa0007780 comp rx=0 tx=0).stop 2024-04-25T08:46:23.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 -- 172.21.15.172:0/1955683164 shutdown_connections 2024-04-25T08:46:23.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3a9806b500 0x7f3a9806d9c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aac155080 0x7f3aac155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aac0ade30 0x7f3aac147ef0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 --2- 172.21.15.172:0/1955683164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a940039b0 0x7f3aac0b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 -- 172.21.15.172:0/1955683164 >> 172.21.15.172:0/1955683164 conn(0x7f3aac06abe0 msgr2=0x7f3aac06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:23.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 -- 172.21.15.172:0/1955683164 shutdown_connections 2024-04-25T08:46:23.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.346+0000 7f3ab26ee640 1 -- 172.21.15.172:0/1955683164 wait complete. 2024-04-25T08:46:23.751 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:46:08.789050+0000', 'modified': '2024-04-25T08:46:21.527505+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6960}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6960': {'gid': 6960, 'name': 'a', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.172:6835/311149179', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 311149179}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 311149179}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:46:23.751 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:46:23.752 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T08:46:23.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.864+0000 7f39c9163640 1 Processor -- start 2024-04-25T08:46:23.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.864+0000 7f39c9163640 1 -- start start 2024-04-25T08:46:23.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c9163640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39c406abe0 0x7f39c406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c9163640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c406b500 con 0x7f39c415dd80 2024-04-25T08:46:23.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c9163640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c40b3930 con 0x7f39c40ad570 2024-04-25T08:46:23.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c9163640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c406e410 con 0x7f39c406abe0 2024-04-25T08:46:23.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c2d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39c406abe0 0x7f39c406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c2d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39c406abe0 0x7f39c406afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33220/0 (socket says 172.21.15.172:33220) 2024-04-25T08:46:23.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c2d9d640 1 -- 172.21.15.172:0/3363358535 learned_addr learned my addr 172.21.15.172:0/3363358535 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:23.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c2d9d640 1 -- 172.21.15.172:0/3363358535 >> v1:172.21.15.186:6789/0 conn(0x7f39c40ad570 legacy=0x7f39c406ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c2d9d640 1 -- 172.21.15.172:0/3363358535 >> v1:172.21.15.172:6789/0 conn(0x7f39c415dd80 legacy=0x7f39c40b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c2d9d640 1 -- 172.21.15.172:0/3363358535 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c40b3c10 con 0x7f39c406abe0 2024-04-25T08:46:23.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.865+0000 7f39c259c640 1 -- 172.21.15.172:0/3363358535 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475022536 0 0) 0x7f39c406b500 con 0x7f39c415dd80 2024-04-25T08:46:23.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.866+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/3363358535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 0x7f39c406afc0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009870 tx=0x7f39b402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964c1aec63c933a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:23.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.866+0000 7f39c259c640 1 -- 172.21.15.172:0/3363358535 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4037070 con 0x7f39c406abe0 2024-04-25T08:46:23.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.866+0000 7f39c259c640 1 -- 172.21.15.172:0/3363358535 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4032440 con 0x7f39c406abe0 2024-04-25T08:46:23.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.866+0000 7f39c259c640 1 -- 172.21.15.172:0/3363358535 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4032810 con 0x7f39c406abe0 2024-04-25T08:46:23.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.867+0000 7f39c9163640 1 -- 172.21.15.172:0/3363358535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 msgr2=0x7f39c406afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.867+0000 7f39c9163640 1 --2- 172.21.15.172:0/3363358535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 0x7f39c406afc0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009870 tx=0x7f39b402a2a0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.867+0000 7f39c9163640 1 -- 172.21.15.172:0/3363358535 shutdown_connections 2024-04-25T08:46:23.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.867+0000 7f39c9163640 1 --2- 172.21.15.172:0/3363358535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 0x7f39c406afc0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.867+0000 7f39c9163640 1 -- 172.21.15.172:0/3363358535 >> 172.21.15.172:0/3363358535 conn(0x7f39c40b5af0 msgr2=0x7f39c40b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:23.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.867+0000 7f39c9163640 1 -- 172.21.15.172:0/3363358535 shutdown_connections 2024-04-25T08:46:23.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.867+0000 7f39c9163640 1 -- 172.21.15.172:0/3363358535 wait complete. 2024-04-25T08:46:23.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.868+0000 7f39c9163640 1 Processor -- start 2024-04-25T08:46:23.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.868+0000 7f39c9163640 1 -- start start 2024-04-25T08:46:23.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c9163640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 0x7f39c41568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c9163640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c40ad570 0x7f39c4152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c9163640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c415dd80 0x7f39c41550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c9163640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c4070280 con 0x7f39c406abe0 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c9163640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c406e940 con 0x7f39c415dd80 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c9163640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c4070400 con 0x7f39c40ad570 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 0x7f39c41568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 0x7f39c41568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33232/0 (socket says 172.21.15.172:33232) 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c2d9d640 1 -- 172.21.15.172:0/2115012190 learned_addr learned my addr 172.21.15.172:0/2115012190 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c359e640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c415dd80 0x7f39c41550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c2d9d640 1 -- 172.21.15.172:0/2115012190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c40ad570 msgr2=0x7f39c4152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39bbfff640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c40ad570 0x7f39c4152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c40ad570 0x7f39c4152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c2d9d640 1 -- 172.21.15.172:0/2115012190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c415dd80 msgr2=0x7f39c41550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c415dd80 0x7f39c41550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c2d9d640 1 -- 172.21.15.172:0/2115012190 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c415c780 con 0x7f39c406abe0 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c359e640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c415dd80 0x7f39c41550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:23.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39bbfff640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c40ad570 0x7f39c4152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:23.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 0x7f39c41568b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009870 tx=0x7f39b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:23.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39bb7fe640 1 -- 172.21.15.172:0/2115012190 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4041070 con 0x7f39c406abe0 2024-04-25T08:46:23.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39bb7fe640 1 -- 172.21.15.172:0/2115012190 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b403c870 con 0x7f39c406abe0 2024-04-25T08:46:23.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c9163640 1 -- 172.21.15.172:0/2115012190 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c415ca60 con 0x7f39c406abe0 2024-04-25T08:46:23.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39bb7fe640 1 -- 172.21.15.172:0/2115012190 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4037040 con 0x7f39c406abe0 2024-04-25T08:46:23.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.869+0000 7f39c9163640 1 -- 172.21.15.172:0/2115012190 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c4155630 con 0x7f39c406abe0 2024-04-25T08:46:23.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.871+0000 7f39bb7fe640 1 -- 172.21.15.172:0/2115012190 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f39b4044070 con 0x7f39c406abe0 2024-04-25T08:46:23.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.871+0000 7f39bb7fe640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a406b4d0 0x7f39a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.872+0000 7f39bbfff640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a406b4d0 0x7f39a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.872+0000 7f39bb7fe640 1 -- 172.21.15.172:0/2115012190 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f39b40ab1e0 con 0x7f39c406abe0 2024-04-25T08:46:23.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.872+0000 7f39bbfff640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a406b4d0 0x7f39a406d990 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f39c40b3220 tx=0x7f39ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:23.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.872+0000 7f39cbe6f740 1 Processor -- start 2024-04-25T08:46:23.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.873+0000 7f39cbe6f740 1 -- start start 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.873+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ebfc230 0x55ea6ebfc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.873+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ec19ad0 0x55ea6ec1a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.873+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebd1f10 0x55ea6ec18190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.873+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6eb34a10 con 0x55ea6ebfc230 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.873+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6eaddb30 con 0x55ea6ebd1f10 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.873+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea6eb30c50 con 0x55ea6ec19ad0 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.873+0000 7f39c2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ebfc230 0x55ea6ebfc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.873+0000 7f39c2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ebfc230 0x55ea6ebfc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33234/0 (socket says 172.21.15.172:33234) 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39c2d9d640 1 -- 172.21.15.172:0/1012455382 learned_addr learned my addr 172.21.15.172:0/1012455382 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39bbfff640 1 --2- 172.21.15.172:0/1012455382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ec19ad0 0x55ea6ec1a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39c359e640 1 --2- 172.21.15.172:0/1012455382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebd1f10 0x55ea6ec18190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39c2d9d640 1 -- 172.21.15.172:0/1012455382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ec19ad0 msgr2=0x55ea6ec1a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/1012455382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ec19ad0 0x55ea6ec1a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39c2d9d640 1 -- 172.21.15.172:0/1012455382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebd1f10 msgr2=0x55ea6ec18190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/1012455382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebd1f10 0x55ea6ec18190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39c2d9d640 1 -- 172.21.15.172:0/1012455382 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea6eaf2e10 con 0x55ea6ebfc230 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/1012455382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ebfc230 0x55ea6ebfc610 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f39b4081ab0 tx=0x7f39b40792f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6c5ca73ebff38f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39b8ff9640 1 -- 172.21.15.172:0/1012455382 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b404b040 con 0x55ea6ebfc230 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39b8ff9640 1 -- 172.21.15.172:0/1012455382 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b407da20 con 0x55ea6ebfc230 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.874+0000 7f39b8ff9640 1 -- 172.21.15.172:0/1012455382 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4081fe0 con 0x55ea6ebfc230 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1012455382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ebfc230 msgr2=0x55ea6ebfc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/1012455382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ebfc230 0x55ea6ebfc610 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f39b4081ab0 tx=0x7f39b40792f0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1012455382 shutdown_connections 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/1012455382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebd1f10 0x55ea6ec18190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/1012455382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ec19ad0 0x55ea6ec1a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/1012455382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ebfc230 0x55ea6ebfc610 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1012455382 >> 172.21.15.172:0/1012455382 conn(0x55ea6ebce840 msgr2=0x55ea6ec17040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1012455382 shutdown_connections 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1012455382 wait complete. 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 -- start start 2024-04-25T08:46:23.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.875+0000 7f39cbe6f740 1 Processor -- start 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ebfc230 0x55ea6ebf9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec0ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ec1aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6ebd2cb0 con 0x55ea6ec19ad0 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6eaf10c0 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea6ebcc770 con 0x55ea6ebfc230 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39cbe6f740 10 client.0 _ll_register_callbacks cb 0x55ea6eae4ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39bbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec0ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39bbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec0ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33240/0 (socket says 172.21.15.172:33240) 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39bbfff640 1 -- 172.21.15.172:0/1268246959 learned_addr learned my addr 172.21.15.172:0/1268246959 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ebfc230 0x55ea6ebf9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39c359e640 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ec1aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.876+0000 7f39bbfff640 1 -- 172.21.15.172:0/1268246959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ebfc230 msgr2=0x55ea6ebf9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39bbfff640 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ebfc230 0x55ea6ebf9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39bbfff640 1 -- 172.21.15.172:0/1268246959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec1a5c0 msgr2=0x55ea6ec1aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39bbfff640 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ec1aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39bbfff640 1 -- 172.21.15.172:0/1268246959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea6e8492d0 con 0x55ea6ec19ad0 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39c359e640 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ec1aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39bbfff640 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec0ee30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f39c409a810 tx=0x7f39ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348d335d721a6abb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39a1ffb640 1 -- 172.21.15.172:0/1268246959 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac024060 con 0x55ea6ec19ad0 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39a1ffb640 1 -- 172.21.15.172:0/1268246959 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f39ac01f670 con 0x55ea6ec19ad0 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1268246959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39b407da20 con 0x55ea6ec19ad0 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39a1ffb640 1 -- 172.21.15.172:0/1268246959 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39ac02a050 con 0x55ea6ec19ad0 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39cbe6f740 10 client.7002 fetch_fsmap learned FSMap version 42 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1268246959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55ea6e9136b0 con 0x55ea6ec19ad0 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39a1ffb640 1 -- 172.21.15.172:0/1268246959 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b407da20 con 0x55ea6ec19ad0 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39a1ffb640 1 -- 172.21.15.172:0/1268246959 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f39ac02d020 con 0x55ea6ec19ad0 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39cbe6f740 10 client.7002 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T08:46:23.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39cbe6f740 10 client.7002 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39cbe6f740 20 client.7002 populate_metadata read hostname 'smithi172' 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55ea6ec0ff60 0x55ea6ec10340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39cbe6f740 4 client.7002 mds_command: new command op to 6960 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.877+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1268246959 --> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea6eb93920 con 0x55ea6ec0ff60 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.878+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55ea6ec0ff60 0x55ea6ec10340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.878+0000 7f39a1ffb640 10 client.7002 ms_handle_connect on v2:172.21.15.172:6834/311149179 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.878+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55ea6ec0ff60 0x55ea6ec10340 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c651e9443e0e9592 server_cookie=9598e2887a1fb9f3 in_seq=0 out_seq=0 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.878+0000 7f39a1ffb640 1 -- 172.21.15.172:0/1268246959 <== mds.0 v2:172.21.15.172:6834/311149179 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ea6eb93920 con 0x55ea6ec0ff60 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.878+0000 7f39a1ffb640 10 client.7002 handle_command_reply: tid=0 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.878+0000 7f39cbe6f740 1 client.7002 shutdown 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.878+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1268246959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec19ad0 msgr2=0x55ea6ec0ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.878+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec0ee30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f39c409a810 tx=0x7f39ac000ed0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.879+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1268246959 shutdown_connections 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.879+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55ea6ec0ff60 0x55ea6ec10340 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.879+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ec1aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.879+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec0ee30 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.879+0000 7f39a1ffb640 0 client.7002 ms_handle_reset on v2:172.21.15.172:6834/311149179 2024-04-25T08:46:23.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.879+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/1268246959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ebfc230 0x55ea6ebf9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.879+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1268246959 >> 172.21.15.172:0/1268246959 conn(0x55ea6ebd1f10 msgr2=0x55ea6ec166c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:23.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.879+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1268246959 shutdown_connections 2024-04-25T08:46:23.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.879+0000 7f39cbe6f740 1 -- 172.21.15.172:0/1268246959 wait complete. 2024-04-25T08:46:23.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.879+0000 7f39cbe6f740 20 client.7002 trim_cache size 0 max 16384 2024-04-25T08:46:23.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.894+0000 7f39cbe6f740 1 Processor -- start 2024-04-25T08:46:23.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.894+0000 7f39cbe6f740 1 -- start start 2024-04-25T08:46:23.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ebfc230 0x55ea6ebd17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec12db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c42006e0 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c41ff8c0 con 0x55ea6ec19ad0 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c415b210 con 0x55ea6ebfc230 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39c359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39c359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33252/0 (socket says 172.21.15.172:33252) 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39c359e640 1 -- 172.21.15.172:0/692479240 learned_addr learned my addr 172.21.15.172:0/692479240 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39bbfff640 1 --2- 172.21.15.172:0/692479240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec12db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/692479240 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ebfc230 0x55ea6ebd17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39c359e640 1 -- 172.21.15.172:0/692479240 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ebfc230 msgr2=0x55ea6ebd17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39c359e640 1 --2- 172.21.15.172:0/692479240 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ebfc230 0x55ea6ebd17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39c359e640 1 -- 172.21.15.172:0/692479240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec19ad0 msgr2=0x55ea6ec12db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39c359e640 1 --2- 172.21.15.172:0/692479240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec12db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39c359e640 1 -- 172.21.15.172:0/692479240 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea6ebcdd00 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.895+0000 7f39bbfff640 1 --2- 172.21.15.172:0/692479240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec12db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39c359e640 1 --2- 172.21.15.172:0/692479240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd22f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f39bc001da0 tx=0x7f39bc010240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7459867b71b3d1ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39a3fff640 1 -- 172.21.15.172:0/692479240 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc010e80 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39a3fff640 1 -- 172.21.15.172:0/692479240 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc019070 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39a3fff640 1 -- 172.21.15.172:0/692479240 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc003b70 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39cbe6f740 1 -- 172.21.15.172:0/692479240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 msgr2=0x55ea6ebd22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/692479240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd22f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f39bc001da0 tx=0x7f39bc010240 comp rx=0 tx=0).stop 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39cbe6f740 1 -- 172.21.15.172:0/692479240 shutdown_connections 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/692479240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ec19ad0 0x55ea6ec12db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/692479240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd22f0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/692479240 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ebfc230 0x55ea6ebd17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39cbe6f740 1 -- 172.21.15.172:0/692479240 >> 172.21.15.172:0/692479240 conn(0x55ea6ebd1f10 msgr2=0x55ea6ec10340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39cbe6f740 1 -- 172.21.15.172:0/692479240 shutdown_connections 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.896+0000 7f39cbe6f740 1 -- 172.21.15.172:0/692479240 wait complete. 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.897+0000 7f39cbe6f740 1 -- start start 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.897+0000 7f39cbe6f740 1 Processor -- start 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebfc230 0x55ea6ec816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ec19ad0 0x55ea6ebd03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39cbe6f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6ebfef00 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c41ff2c0 con 0x55ea6ebfc230 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39cbe6f740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea6ebff7a0 con 0x55ea6ec19ad0 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39cbe6f740 10 client.0 _ll_register_callbacks cb 0x55ea6ebccc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33254/0 (socket says 172.21.15.172:33254) 2024-04-25T08:46:23.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c359e640 1 -- 172.21.15.172:0/2119041904 learned_addr learned my addr 172.21.15.172:0/2119041904 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebfc230 0x55ea6ec816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39bbfff640 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ec19ad0 0x55ea6ebd03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c359e640 1 -- 172.21.15.172:0/2119041904 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ec19ad0 msgr2=0x55ea6ebd03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c359e640 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ec19ad0 0x55ea6ebd03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c359e640 1 -- 172.21.15.172:0/2119041904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebfc230 msgr2=0x55ea6ec816a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c359e640 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebfc230 0x55ea6ec816a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c359e640 1 -- 172.21.15.172:0/2119041904 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea6ec171b0 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebfc230 0x55ea6ec816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39c359e640 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd0900 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f39bc010740 tx=0x7f39bc001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae62eeb308c803b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39a1ffb640 1 -- 172.21.15.172:0/2119041904 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc003d80 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39a1ffb640 1 -- 172.21.15.172:0/2119041904 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f39bc0050d0 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39cbe6f740 1 -- 172.21.15.172:0/2119041904 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39bc019070 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39a1ffb640 1 -- 172.21.15.172:0/2119041904 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39bc031050 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39cbe6f740 10 client.7008 fetch_fsmap learned FSMap version 42 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.898+0000 7f39cbe6f740 1 -- 172.21.15.172:0/2119041904 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55ea6ec25bd0 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39a1ffb640 1 -- 172.21.15.172:0/2119041904 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc019070 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39a1ffb640 1 -- 172.21.15.172:0/2119041904 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f39bc034020 con 0x55ea6ec1a5c0 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 10 client.7008 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 10 client.7008 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 20 client.7008 populate_metadata read hostname 'smithi172' 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55ea6ec85f40 0x55ea6ec29250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 4 client.7008 mds_command: new command op to 6960 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 -- 172.21.15.172:0/2119041904 --> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ea6eb41f50 con 0x55ea6ec85f40 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55ea6ec85f40 0x55ea6ec29250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39c2d9d640 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55ea6ec85f40 0x55ea6ec29250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd34cebbf71169bc server_cookie=e9eb6d2596eb7f6b in_seq=0 out_seq=0 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39a1ffb640 10 client.7008 ms_handle_connect on v2:172.21.15.172:6834/311149179 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39a1ffb640 1 -- 172.21.15.172:0/2119041904 <== mds.0 v2:172.21.15.172:6834/311149179 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ea6eb41f50 con 0x55ea6ec85f40 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39a1ffb640 10 client.7008 handle_command_reply: tid=0 2024-04-25T08:46:23.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 client.7008 shutdown 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 -- 172.21.15.172:0/2119041904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 msgr2=0x55ea6ebd0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd0900 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f39bc010740 tx=0x7f39bc001330 comp rx=0 tx=0).stop 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 -- 172.21.15.172:0/2119041904 shutdown_connections 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55ea6ec85f40 0x55ea6ec29250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ea6ec1a5c0 0x55ea6ebd0900 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39a1ffb640 0 client.7008 ms_handle_reset on v2:172.21.15.172:6834/311149179 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ea6ec19ad0 0x55ea6ebd03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 --2- 172.21.15.172:0/2119041904 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ea6ebfc230 0x55ea6ec816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 -- 172.21.15.172:0/2119041904 >> 172.21.15.172:0/2119041904 conn(0x55ea6ebd1f10 msgr2=0x55ea6ec10340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 -- 172.21.15.172:0/2119041904 shutdown_connections 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.899+0000 7f39cbe6f740 1 -- 172.21.15.172:0/2119041904 wait complete. 2024-04-25T08:46:23.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39cbe6f740 20 client.7008 trim_cache size 0 max 16384 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 6960, 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 4.3867257149999999, 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 42, 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 69, 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 69, 2024-04-25T08:46:23.899 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 5.3028962369999997 2024-04-25T08:46:23.900 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:46:23.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 -- 172.21.15.172:0/2115012190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a406b4d0 msgr2=0x7f39a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a406b4d0 0x7f39a406d990 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f39c40b3220 tx=0x7f39ac009040 comp rx=0 tx=0).stop 2024-04-25T08:46:23.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 -- 172.21.15.172:0/2115012190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 msgr2=0x7f39c41568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:23.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 0x7f39c41568b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009870 tx=0x7f39b40046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 -- 172.21.15.172:0/2115012190 shutdown_connections 2024-04-25T08:46:23.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a406b4d0 0x7f39a406d990 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c415dd80 0x7f39c41550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c40ad570 0x7f39c4152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 --2- 172.21.15.172:0/2115012190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c406abe0 0x7f39c41568b0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:23.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 -- 172.21.15.172:0/2115012190 >> 172.21.15.172:0/2115012190 conn(0x7f39c40b5af0 msgr2=0x7f39c40b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:23.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 -- 172.21.15.172:0/2115012190 shutdown_connections 2024-04-25T08:46:23.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:23.900+0000 7f39c9163640 1 -- 172.21.15.172:0/2115012190 wait complete. 2024-04-25T08:46:23.902 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:46:24.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.009+0000 7f76aa66b640 1 Processor -- start 2024-04-25T08:46:24.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.009+0000 7f76aa66b640 1 -- start start 2024-04-25T08:46:24.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.009+0000 7f76aa66b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f76a415ba00 0x7f76a409a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:24.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.009+0000 7f76aa66b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f76a415f5f0 0x7f76a415fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:24.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.009+0000 7f76aa66b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a40cd710 con 0x7f76a41602e0 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.009+0000 7f76aa66b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a415ff80 con 0x7f76a415ba00 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.009+0000 7f76aa66b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a40cd4b0 con 0x7f76a415f5f0 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.010+0000 7f76a3fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f76a415ba00 0x7f76a409a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.010+0000 7f76a37fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f76a41602e0 0x7f76a40ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55664/0 (socket says 172.21.15.172:55664) 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.010+0000 7f76a37fe640 1 -- 172.21.15.172:0/1281635373 learned_addr learned my addr 172.21.15.172:0/1281635373 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.010+0000 7f76a3fff640 1 -- 172.21.15.172:0/1281635373 >> v2:172.21.15.186:3300/0 conn(0x7f76a415f5f0 msgr2=0x7f76a415fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.010+0000 7f76a8c08640 1 --2- 172.21.15.172:0/1281635373 >> v2:172.21.15.186:3300/0 conn(0x7f76a415f5f0 0x7f76a415fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.010+0000 7f76a2ffd640 1 -- 172.21.15.172:0/1281635373 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557897421 0 0) 0x7f7694001110 con 0x7f76a41602e0 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.010+0000 7f76a3fff640 1 --2- 172.21.15.172:0/1281635373 >> v2:172.21.15.186:3300/0 conn(0x7f76a415f5f0 0x7f76a415fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.010+0000 7f76a3fff640 1 -- 172.21.15.172:0/1281635373 >> v1:172.21.15.172:6789/0 conn(0x7f76a41602e0 legacy=0x7f76a40ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.010+0000 7f76a3fff640 1 -- 172.21.15.172:0/1281635373 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4099b70 con 0x7f76a415ba00 2024-04-25T08:46:24.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.010+0000 7f76a8c08640 1 --2- 172.21.15.172:0/1281635373 >> v2:172.21.15.186:3300/0 conn(0x7f76a415f5f0 0x7f76a415fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76a3fff640 1 --2- 172.21.15.172:0/1281635373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415ba00 0x7f76a409a930 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f76a4072b10 tx=0x7f769802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4acb15628aa6e94a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76a2ffd640 1 -- 172.21.15.172:0/1281635373 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698037070 con 0x7f76a415ba00 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76a2ffd640 1 -- 172.21.15.172:0/1281635373 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769802adc0 con 0x7f76a415ba00 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76a2ffd640 1 -- 172.21.15.172:0/1281635373 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698032660 con 0x7f76a415ba00 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76aa66b640 1 -- 172.21.15.172:0/1281635373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415ba00 msgr2=0x7f76a409a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76aa66b640 1 --2- 172.21.15.172:0/1281635373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415ba00 0x7f76a409a930 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f76a4072b10 tx=0x7f769802a0b0 comp rx=0 tx=0).stop 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76aa66b640 1 -- 172.21.15.172:0/1281635373 shutdown_connections 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76aa66b640 1 --2- 172.21.15.172:0/1281635373 >> v2:172.21.15.186:3300/0 conn(0x7f76a415f5f0 0x7f76a415fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76aa66b640 1 --2- 172.21.15.172:0/1281635373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415ba00 0x7f76a409a930 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76aa66b640 1 -- 172.21.15.172:0/1281635373 >> 172.21.15.172:0/1281635373 conn(0x7f76a40b3270 msgr2=0x7f76a40b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76aa66b640 1 -- 172.21.15.172:0/1281635373 shutdown_connections 2024-04-25T08:46:24.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.011+0000 7f76aa66b640 1 -- 172.21.15.172:0/1281635373 wait complete. 2024-04-25T08:46:24.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.012+0000 7f76aa66b640 1 Processor -- start 2024-04-25T08:46:24.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.013+0000 7f76aa66b640 1 -- start start 2024-04-25T08:46:24.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.013+0000 7f76aa66b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76a415ba00 0x7f76a4156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:24.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.013+0000 7f76aa66b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415f5f0 0x7f76a40b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:24.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.013+0000 7f76aa66b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76a41602e0 0x7f76a40b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:24.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.013+0000 7f76aa66b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a409ae70 con 0x7f76a415f5f0 2024-04-25T08:46:24.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.013+0000 7f76aa66b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a409a130 con 0x7f76a415ba00 2024-04-25T08:46:24.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.013+0000 7f76aa66b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a415bde0 con 0x7f76a41602e0 2024-04-25T08:46:24.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415f5f0 0x7f76a40b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415f5f0 0x7f76a40b6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33264/0 (socket says 172.21.15.172:33264) 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a37fe640 1 -- 172.21.15.172:0/3046387365 learned_addr learned my addr 172.21.15.172:0/3046387365 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a8c08640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76a41602e0 0x7f76a40b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a3fff640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76a415ba00 0x7f76a4156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a37fe640 1 -- 172.21.15.172:0/3046387365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76a41602e0 msgr2=0x7f76a40b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a37fe640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76a41602e0 0x7f76a40b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a37fe640 1 -- 172.21.15.172:0/3046387365 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76a415ba00 msgr2=0x7f76a4156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a37fe640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76a415ba00 0x7f76a4156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a37fe640 1 -- 172.21.15.172:0/3046387365 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a40cb090 con 0x7f76a415f5f0 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a37fe640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415f5f0 0x7f76a40b6570 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f769400c780 tx=0x7f769400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a0ff9640 1 -- 172.21.15.172:0/3046387365 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694018070 con 0x7f76a415f5f0 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a0ff9640 1 -- 172.21.15.172:0/3046387365 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76940072d0 con 0x7f76a415f5f0 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76aa66b640 1 -- 172.21.15.172:0/3046387365 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a40cb330 con 0x7f76a415f5f0 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76a0ff9640 1 -- 172.21.15.172:0/3046387365 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76940047e0 con 0x7f76a415f5f0 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.014+0000 7f76aa66b640 1 -- 172.21.15.172:0/3046387365 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a40cb8f0 con 0x7f76a415f5f0 2024-04-25T08:46:24.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.015+0000 7f76aa66b640 1 -- 172.21.15.172:0/3046387365 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a40cbb30 con 0x7f76a415f5f0 2024-04-25T08:46:24.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.016+0000 7f76a0ff9640 1 -- 172.21.15.172:0/3046387365 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f769401b070 con 0x7f76a415f5f0 2024-04-25T08:46:24.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.016+0000 7f76a0ff9640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f769006b4d0 0x7f769006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:24.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.016+0000 7f76a0ff9640 1 -- 172.21.15.172:0/3046387365 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f7694089780 con 0x7f76a415f5f0 2024-04-25T08:46:24.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.016+0000 7f76a3fff640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f769006b4d0 0x7f769006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:24.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.017+0000 7f76a3fff640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f769006b4d0 0x7f769006d990 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7698034000 tx=0x7f769802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:24.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.020+0000 7f76a0ff9640 1 -- 172.21.15.172:0/3046387365 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f76a40cd710 con 0x7f76a415f5f0 2024-04-25T08:46:24.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.226+0000 7f76aa66b640 1 -- 172.21.15.172:0/3046387365 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76a4073990 con 0x7f76a415f5f0 2024-04-25T08:46:24.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.227+0000 7f76a0ff9640 1 -- 172.21.15.172:0/3046387365 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7694057cc0 con 0x7f76a415f5f0 2024-04-25T08:46:24.218 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:46:24.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 -- 172.21.15.172:0/3046387365 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f769006b4d0 msgr2=0x7f769006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:24.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f769006b4d0 0x7f769006d990 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7698034000 tx=0x7f769802e000 comp rx=0 tx=0).stop 2024-04-25T08:46:24.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 -- 172.21.15.172:0/3046387365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415f5f0 msgr2=0x7f76a40b6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:24.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415f5f0 0x7f76a40b6570 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f769400c780 tx=0x7f769400cc40 comp rx=0 tx=0).stop 2024-04-25T08:46:24.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 -- 172.21.15.172:0/3046387365 shutdown_connections 2024-04-25T08:46:24.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f769006b4d0 0x7f769006d990 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:24.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76a41602e0 0x7f76a40b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:24.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76a415f5f0 0x7f76a40b6570 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:24.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 --2- 172.21.15.172:0/3046387365 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76a415ba00 0x7f76a4156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:24.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 -- 172.21.15.172:0/3046387365 >> 172.21.15.172:0/3046387365 conn(0x7f76a40b3270 msgr2=0x7f76a40cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:24.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 -- 172.21.15.172:0/3046387365 shutdown_connections 2024-04-25T08:46:24.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:24.229+0000 7f76aa66b640 1 -- 172.21.15.172:0/3046387365 wait complete. 2024-04-25T08:46:24.232 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:46:24.232 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:46:24.232 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:46:24.232 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:46:24.232 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:46:24.232 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:46:24.232 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:46:24.232 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:46:24.232 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:46:24.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:24.232 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:46:24.247 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:46:24.248 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42535sec preferred_lft 42535sec 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:46:24.249 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link 2024-04-25T08:46:24.250 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:24.250 INFO:teuthology.orchestra.run.smithi172.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:46:24.250 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether de:e6:d5:6e:7d:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:46:24.250 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::dce6:d5ff:fe6e:7d91/64 scope link 2024-04-25T08:46:24.250 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:46:24.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:24.250 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:46:24.310 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:46:24.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:24.312 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:46:24.368 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:46:24.368 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:46:24.368 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:46:24.368 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:46:24.368 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:46:24.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:24.369 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:46:24.369 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:46:24.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:46:24.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:46:24.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:46:24.369 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:46:24.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:24.452 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:46:24.499 INFO:tasks.ceph.mds.a.smithi172.stderr:2024-04-25T08:46:24.508+0000 7fbe9eac8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:46:24.507 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:46:24.507 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:46:24.508 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:46:24.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:24.508 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:46:24.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:46:24.572 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:46:24.627 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:46:24.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:46:24.627 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:46:24.682 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:46:24.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:24.682 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:46:24.764 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:46:24.764 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:46:24.764 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:46:24.772 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:46:24.773 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:46:24.773 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:46:24.773 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:46:24.773 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:46:24.782 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:46:24.782 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:46:24.782 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:46:24.782 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:46:24.783 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:46:24.783 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:46:24.783 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:46:24.783 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:46:24.783 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:46:24.783 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:46:24.783 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:46:24.783 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:46:24.784 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:46:24.785 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:46:24.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:24.785 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:46:24.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:24.850 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:46:24.906 INFO:teuthology.orchestra.run.smithi172.stdout:client7020 2024-04-25T08:46:24.907 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:24.907 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:24.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:24.963 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-04-25T08:46:25.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:46:25.019 INFO:teuthology.orchestra.run.smithi172.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-04-25T08:46:25.019 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-04-25T08:46:25.019 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:46:25.019 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start /scrub_repair_path repair 2024-04-25T08:46:25.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.169+0000 7f9a6b015640 1 Processor -- start 2024-04-25T08:46:25.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.169+0000 7f9a6b015640 1 -- start start 2024-04-25T08:46:25.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.170+0000 7f9a6b015640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9a6406c330 0x7f9a640b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.170+0000 7f9a6b015640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c7e0 0x7f9a640b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.170+0000 7f9a6b015640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a640d1d50 con 0x7f9a64158230 2024-04-25T08:46:25.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.170+0000 7f9a6b015640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a64158610 con 0x7f9a6406c330 2024-04-25T08:46:25.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.170+0000 7f9a6b015640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6406bea0 con 0x7f9a6406c7e0 2024-04-25T08:46:25.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a63fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9a6406c330 0x7f9a640b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a695b2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c7e0 0x7f9a640b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a68db1640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f9a64158230 0x7f9a640d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:40596/0 (socket says 172.21.15.172:40596) 2024-04-25T08:46:25.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a68db1640 1 -- 172.21.15.172:0/769398349 learned_addr learned my addr 172.21.15.172:0/769398349 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:25.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a637fe640 1 -- 172.21.15.172:0/769398349 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845804614 0 0) 0x7f9a640d1d50 con 0x7f9a64158230 2024-04-25T08:46:25.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a637fe640 1 -- 172.21.15.172:0/769398349 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a4c003520 con 0x7f9a64158230 2024-04-25T08:46:25.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a695b2640 1 -- 172.21.15.172:0/769398349 >> v2:172.21.15.186:3300/0 conn(0x7f9a6406c330 msgr2=0x7f9a640b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:25.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a695b2640 1 --2- 172.21.15.172:0/769398349 >> v2:172.21.15.186:3300/0 conn(0x7f9a6406c330 0x7f9a640b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a695b2640 1 -- 172.21.15.172:0/769398349 >> v1:172.21.15.186:6789/0 conn(0x7f9a64158230 legacy=0x7f9a640d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:25.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a695b2640 1 -- 172.21.15.172:0/769398349 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a640d2020 con 0x7f9a6406c7e0 2024-04-25T08:46:25.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.171+0000 7f9a63fff640 1 --2- 172.21.15.172:0/769398349 >> v2:172.21.15.186:3300/0 conn(0x7f9a6406c330 0x7f9a640b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:25.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a695b2640 1 --2- 172.21.15.172:0/769398349 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c7e0 0x7f9a640b53a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009d90 tx=0x7f9a5c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3553dc7fd413f700 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a637fe640 1 -- 172.21.15.172:0/769398349 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c007740 con 0x7f9a6406c7e0 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a637fe640 1 -- 172.21.15.172:0/769398349 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0078e0 con 0x7f9a6406c7e0 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a637fe640 1 -- 172.21.15.172:0/769398349 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c007c90 con 0x7f9a6406c7e0 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a6b015640 1 -- 172.21.15.172:0/769398349 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c7e0 msgr2=0x7f9a640b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a6b015640 1 --2- 172.21.15.172:0/769398349 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c7e0 0x7f9a640b53a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009d90 tx=0x7f9a5c02a660 comp rx=0 tx=0).stop 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a6b015640 1 -- 172.21.15.172:0/769398349 shutdown_connections 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a6b015640 1 --2- 172.21.15.172:0/769398349 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c7e0 0x7f9a640b53a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a6b015640 1 --2- 172.21.15.172:0/769398349 >> v2:172.21.15.186:3300/0 conn(0x7f9a6406c330 0x7f9a640b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a6b015640 1 -- 172.21.15.172:0/769398349 >> 172.21.15.172:0/769398349 conn(0x7f9a64061600 msgr2=0x7f9a640619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a6b015640 1 -- 172.21.15.172:0/769398349 shutdown_connections 2024-04-25T08:46:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.172+0000 7f9a6b015640 1 -- 172.21.15.172:0/769398349 wait complete. 2024-04-25T08:46:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.174+0000 7f9a6b015640 1 Processor -- start 2024-04-25T08:46:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.174+0000 7f9a6b015640 1 -- start start 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.174+0000 7f9a6b015640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c330 0x7f9a6414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.174+0000 7f9a6b015640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a6406c7e0 0x7f9a64152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.174+0000 7f9a6b015640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a64158230 0x7f9a640d0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.174+0000 7f9a6b015640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a640d25e0 con 0x7f9a6406c7e0 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.174+0000 7f9a6b015640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6406bb30 con 0x7f9a64158230 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.174+0000 7f9a6b015640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6415e320 con 0x7f9a6406c330 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a6406c7e0 0x7f9a64152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a68db1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c330 0x7f9a6414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a695b2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a64158230 0x7f9a640d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a6406c7e0 0x7f9a64152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33274/0 (socket says 172.21.15.172:33274) 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a63fff640 1 -- 172.21.15.172:0/1223211916 learned_addr learned my addr 172.21.15.172:0/1223211916 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a68db1640 1 -- 172.21.15.172:0/1223211916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a64158230 msgr2=0x7f9a640d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a68db1640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a64158230 0x7f9a640d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a68db1640 1 -- 172.21.15.172:0/1223211916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a6406c7e0 msgr2=0x7f9a64152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:25.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a68db1640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a6406c7e0 0x7f9a64152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a68db1640 1 -- 172.21.15.172:0/1223211916 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a641f4050 con 0x7f9a6406c330 2024-04-25T08:46:25.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a68db1640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c330 0x7f9a6414f660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400c390 tx=0x7f9a54001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:25.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a617fa640 1 -- 172.21.15.172:0/1223211916 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a54017070 con 0x7f9a6406c330 2024-04-25T08:46:25.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a617fa640 1 -- 172.21.15.172:0/1223211916 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a54005ce0 con 0x7f9a6406c330 2024-04-25T08:46:25.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a617fa640 1 -- 172.21.15.172:0/1223211916 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a540072f0 con 0x7f9a6406c330 2024-04-25T08:46:25.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a6b015640 1 -- 172.21.15.172:0/1223211916 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a641f4330 con 0x7f9a6406c330 2024-04-25T08:46:25.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.175+0000 7f9a6b015640 1 -- 172.21.15.172:0/1223211916 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a641f48f0 con 0x7f9a6406c330 2024-04-25T08:46:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.177+0000 7f9a617fa640 1 -- 172.21.15.172:0/1223211916 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9a5401a070 con 0x7f9a6406c330 2024-04-25T08:46:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.177+0000 7f9a617fa640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a5006b4d0 0x7f9a5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.178+0000 7f9a63fff640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a5006b4d0 0x7f9a5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.178+0000 7f9a617fa640 1 -- 172.21.15.172:0/1223211916 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f9a540895d0 con 0x7f9a6406c330 2024-04-25T08:46:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.178+0000 7f9a63fff640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a5006b4d0 0x7f9a5006d990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009500 tx=0x7f9a58009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.178+0000 7f9a6ddf9740 1 Processor -- start 2024-04-25T08:46:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.178+0000 7f9a6ddf9740 1 -- start start 2024-04-25T08:46:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782ba16d20 0x55782b9c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f9e40 0x55782b9f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9700 0x55782b9ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782b931f40 con 0x55782b9f9700 2024-04-25T08:46:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782b8d10d0 con 0x55782b9f9e40 2024-04-25T08:46:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55782b92dfe0 con 0x55782ba16d20 2024-04-25T08:46:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a695b2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9700 0x55782b9ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a695b2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9700 0x55782b9ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33278/0 (socket says 172.21.15.172:33278) 2024-04-25T08:46:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a695b2640 1 -- 172.21.15.172:0/1535950043 learned_addr learned my addr 172.21.15.172:0/1535950043 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a68db1640 1 --2- 172.21.15.172:0/1535950043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782ba16d20 0x55782b9c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a63fff640 1 --2- 172.21.15.172:0/1535950043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f9e40 0x55782b9f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a695b2640 1 -- 172.21.15.172:0/1535950043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782ba16d20 msgr2=0x55782b9c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a695b2640 1 --2- 172.21.15.172:0/1535950043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782ba16d20 0x55782b9c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a695b2640 1 -- 172.21.15.172:0/1535950043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f9e40 msgr2=0x55782b9f91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a695b2640 1 --2- 172.21.15.172:0/1535950043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f9e40 0x55782b9f91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.179+0000 7f9a695b2640 1 -- 172.21.15.172:0/1535950043 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782b712af0 con 0x55782b9f9700 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a695b2640 1 --2- 172.21.15.172:0/1535950043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9700 0x55782b9ce510 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c02ac50 tx=0x7f9a5c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631b0dcbfde30edf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a4a7fc640 1 -- 172.21.15.172:0/1535950043 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c007880 con 0x55782b9f9700 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a4a7fc640 1 -- 172.21.15.172:0/1535950043 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c007a20 con 0x55782b9f9700 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a4a7fc640 1 -- 172.21.15.172:0/1535950043 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c007df0 con 0x55782b9f9700 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1535950043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9700 msgr2=0x55782b9ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/1535950043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9700 0x55782b9ce510 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c02ac50 tx=0x7f9a5c02e000 comp rx=0 tx=0).stop 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1535950043 shutdown_connections 2024-04-25T08:46:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/1535950043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f9e40 0x55782b9f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/1535950043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9700 0x55782b9ce510 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/1535950043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782ba16d20 0x55782b9c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1535950043 >> 172.21.15.172:0/1535950043 conn(0x55782b9cb920 msgr2=0x55782ba141c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:25.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1535950043 shutdown_connections 2024-04-25T08:46:25.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.180+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1535950043 wait complete. 2024-04-25T08:46:25.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.181+0000 7f9a6ddf9740 1 -- start start 2024-04-25T08:46:25.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.181+0000 7f9a6ddf9740 1 Processor -- start 2024-04-25T08:46:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f9e40 0x55782ba28280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba0ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 0x55782b9fb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782b9cdad0 con 0x55782ba16d20 2024-04-25T08:46:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782b8ceba0 con 0x55782b9f9e40 2024-04-25T08:46:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55782b9ccec0 con 0x55782b9f1020 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a6ddf9740 10 client.0 _ll_register_callbacks cb 0x55782b8ce570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba0ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba0ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33294/0 (socket says 172.21.15.172:33294) 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a63fff640 1 -- 172.21.15.172:0/678695551 learned_addr learned my addr 172.21.15.172:0/678695551 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a68db1640 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f9e40 0x55782ba28280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a695b2640 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 0x55782b9fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a63fff640 1 -- 172.21.15.172:0/678695551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 msgr2=0x55782b9fb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a63fff640 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 0x55782b9fb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a63fff640 1 -- 172.21.15.172:0/678695551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f9e40 msgr2=0x55782ba28280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a63fff640 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f9e40 0x55782ba28280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a63fff640 1 -- 172.21.15.172:0/678695551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55782b6063e0 con 0x55782ba16d20 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a695b2640 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 0x55782b9fb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a63fff640 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba0ae80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9a58005f70 tx=0x7f9a580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a7df2af1bd453d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a437fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.182+0000 7f9a437fe640 1 -- 172.21.15.172:0/678695551 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58026070 con 0x55782ba16d20 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a437fe640 1 -- 172.21.15.172:0/678695551 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f9a58004020 con 0x55782ba16d20 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/678695551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a5c007a20 con 0x55782ba16d20 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a437fe640 1 -- 172.21.15.172:0/678695551 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a58004220 con 0x55782ba16d20 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a6ddf9740 10 client.7029 fetch_fsmap learned FSMap version 42 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/678695551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55782b773280 con 0x55782ba16d20 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a437fe640 1 -- 172.21.15.172:0/678695551 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c007a20 con 0x55782ba16d20 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a437fe640 1 -- 172.21.15.172:0/678695551 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9a58033080 con 0x55782ba16d20 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a6ddf9740 10 client.7029 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a6ddf9740 10 client.7029 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a6ddf9740 20 client.7029 populate_metadata read hostname 'smithi172' 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55782b9ce3a0 0x55782b9fa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a6ddf9740 4 client.7029 mds_command: new command op to 6960 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:46:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/678695551 --> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55782b93f480 con 0x55782b9ce3a0 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a68db1640 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55782b9ce3a0 0x55782b9fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a437fe640 10 client.7029 ms_handle_connect on v2:172.21.15.172:6834/311149179 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.183+0000 7f9a68db1640 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55782b9ce3a0 0x55782b9fa330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1f7d8b925ab816 server_cookie=ef0c25c850dc4ccc in_seq=0 out_seq=0 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a437fe640 1 -- 172.21.15.172:0/678695551 <== mds.0 v2:172.21.15.172:6834/311149179 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55782b93f480 con 0x55782b9ce3a0 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a437fe640 10 client.7029 handle_command_reply: tid=0 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 client.7029 shutdown 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/678695551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 msgr2=0x55782ba0ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba0ae80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9a58005f70 tx=0x7f9a580046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/678695551 shutdown_connections 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55782b9ce3a0 0x55782b9fa330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 0x55782b9fb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba0ae80 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/678695551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f9e40 0x55782ba28280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a437fe640 0 client.7029 ms_handle_reset on v2:172.21.15.172:6834/311149179 2024-04-25T08:46:25.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/678695551 >> 172.21.15.172:0/678695551 conn(0x55782b9f9700 msgr2=0x55782b9f5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:25.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/678695551 shutdown_connections 2024-04-25T08:46:25.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/678695551 wait complete. 2024-04-25T08:46:25.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.184+0000 7f9a6ddf9740 20 client.7029 trim_cache size 0 max 16384 2024-04-25T08:46:25.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.199+0000 7f9a6ddf9740 1 Processor -- start 2024-04-25T08:46:25.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.199+0000 7f9a6ddf9740 1 -- start start 2024-04-25T08:46:25.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f1020 0x55782b9cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f9e40 0x55782b9ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba15fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a64200620 con 0x55782ba16d20 2024-04-25T08:46:25.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a641ff830 con 0x55782b9f1020 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a640cbfa0 con 0x55782b9f9e40 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a695b2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba15fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a695b2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba15fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33304/0 (socket says 172.21.15.172:33304) 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a695b2640 1 -- 172.21.15.172:0/3619031160 learned_addr learned my addr 172.21.15.172:0/3619031160 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a68db1640 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f1020 0x55782b9cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a63fff640 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f9e40 0x55782b9ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a695b2640 1 -- 172.21.15.172:0/3619031160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f9e40 msgr2=0x55782b9ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a695b2640 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f9e40 0x55782b9ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a695b2640 1 -- 172.21.15.172:0/3619031160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f1020 msgr2=0x55782b9cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a695b2640 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f1020 0x55782b9cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a695b2640 1 -- 172.21.15.172:0/3619031160 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782b5df560 con 0x55782ba16d20 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a68db1640 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f1020 0x55782b9cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:25.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a63fff640 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f9e40 0x55782b9ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.200+0000 7f9a695b2640 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba15fd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c03d000 tx=0x7f9a5c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56edbfd2ca11713 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a49ffb640 1 -- 172.21.15.172:0/3619031160 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c003a10 con 0x55782ba16d20 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a49ffb640 1 -- 172.21.15.172:0/3619031160 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c003bb0 con 0x55782ba16d20 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a49ffb640 1 -- 172.21.15.172:0/3619031160 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c007680 con 0x55782ba16d20 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/3619031160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 msgr2=0x55782ba15fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba15fd0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c03d000 tx=0x7f9a5c030000 comp rx=0 tx=0).stop 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/3619031160 shutdown_connections 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782ba16d20 0x55782ba15fd0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f9e40 0x55782b9ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/3619031160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782b9f1020 0x55782b9cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/3619031160 >> 172.21.15.172:0/3619031160 conn(0x55782b9f9700 msgr2=0x55782b9f0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/3619031160 shutdown_connections 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.201+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/3619031160 wait complete. 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.202+0000 7f9a6ddf9740 1 -- start start 2024-04-25T08:46:25.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.202+0000 7f9a6ddf9740 1 Processor -- start 2024-04-25T08:46:25.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 0x55782b9cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9e40 0x55782b9fc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a6ddf9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782ba16d20 0x55782ba7f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782ba12630 con 0x55782b9f9e40 2024-04-25T08:46:25.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a640cc5a0 con 0x55782ba16d20 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a6ddf9740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55782b9fb780 con 0x55782b9f1020 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a6ddf9740 10 client.0 _ll_register_callbacks cb 0x55782b9c94b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9e40 0x55782b9fc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9e40 0x55782b9fc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33312/0 (socket says 172.21.15.172:33312) 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a63fff640 1 -- 172.21.15.172:0/1376155357 learned_addr learned my addr 172.21.15.172:0/1376155357 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a695b2640 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782ba16d20 0x55782ba7f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a68db1640 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 0x55782b9cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a63fff640 1 -- 172.21.15.172:0/1376155357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 msgr2=0x55782b9cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a63fff640 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 0x55782b9cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a63fff640 1 -- 172.21.15.172:0/1376155357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782ba16d20 msgr2=0x55782ba7f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a63fff640 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782ba16d20 0x55782ba7f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a63fff640 1 -- 172.21.15.172:0/1376155357 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55782b9f42d0 con 0x55782b9f9e40 2024-04-25T08:46:25.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a63fff640 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9e40 0x55782b9fc7a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9a58011ae0 tx=0x7f9a58019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6989254db0e7a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a437fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a437fe640 1 -- 172.21.15.172:0/1376155357 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58041060 con 0x55782b9f9e40 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a437fe640 1 -- 172.21.15.172:0/1376155357 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f9a5803c430 con 0x55782b9f9e40 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.203+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1376155357 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a5c003bb0 con 0x55782b9f9e40 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a437fe640 1 -- 172.21.15.172:0/1376155357 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a58047050 con 0x55782b9f9e40 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a6ddf9740 10 client.7035 fetch_fsmap learned FSMap version 42 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1376155357 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55782b9c8850 con 0x55782b9f9e40 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a437fe640 1 -- 172.21.15.172:0/1376155357 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c003bb0 con 0x55782b9f9e40 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a437fe640 1 -- 172.21.15.172:0/1376155357 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9a5804a020 con 0x55782b9f9e40 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a6ddf9740 10 client.7035 fetch_fsmap finished waiting for FSMap version 42 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a6ddf9740 10 client.7035 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a6ddf9740 20 client.7035 populate_metadata read hostname 'smithi172' 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55782ba0c7d0 0x55782ba0cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a6ddf9740 4 client.7035 mds_command: new command op to 6960 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1376155357 --> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) v1 -- 0x55782b9397d0 con 0x55782ba0c7d0 2024-04-25T08:46:25.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a68db1640 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55782ba0c7d0 0x55782ba0cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a437fe640 10 client.7035 ms_handle_connect on v2:172.21.15.172:6834/311149179 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.204+0000 7f9a68db1640 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55782ba0c7d0 0x55782ba0cbb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3bfec684b76e757 server_cookie=8594962125c89d1a in_seq=0 out_seq=0 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a437fe640 1 -- 172.21.15.172:0/1376155357 <== mds.0 v2:172.21.15.172:6834/311149179 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55782b9397d0 con 0x55782ba0c7d0 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a437fe640 10 client.7035 handle_command_reply: tid=0 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 client.7035 shutdown 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1376155357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9e40 msgr2=0x55782b9fc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9e40 0x55782b9fc7a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9a58011ae0 tx=0x7f9a58019000 comp rx=0 tx=0).stop 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1376155357 shutdown_connections 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.172:6834/311149179,v1:172.21.15.172:6835/311149179] conn(0x55782ba0c7d0 0x55782ba0cbb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55782ba16d20 0x55782ba7f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55782b9f9e40 0x55782b9fc7a0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a437fe640 0 client.7035 ms_handle_reset on v2:172.21.15.172:6834/311149179 2024-04-25T08:46:25.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 --2- 172.21.15.172:0/1376155357 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55782b9f1020 0x55782b9cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1376155357 >> 172.21.15.172:0/1376155357 conn(0x55782b9f9700 msgr2=0x55782ba15fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:25.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1376155357 shutdown_connections 2024-04-25T08:46:25.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 1 -- 172.21.15.172:0/1376155357 wait complete. 2024-04-25T08:46:25.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6ddf9740 20 client.7035 trim_cache size 0 max 16384 2024-04-25T08:46:25.203 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:46:25.203 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:46:25.203 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "fc327b2a-8dd2-4d41-bd02-b73c27bb9949", 2024-04-25T08:46:25.204 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:46:25.204 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:46:25.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6b015640 1 -- 172.21.15.172:0/1223211916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a5006b4d0 msgr2=0x7f9a5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:25.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.205+0000 7f9a6b015640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a5006b4d0 0x7f9a5006d990 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009500 tx=0x7f9a58009110 comp rx=0 tx=0).stop 2024-04-25T08:46:25.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.206+0000 7f9a6b015640 1 -- 172.21.15.172:0/1223211916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c330 msgr2=0x7f9a6414f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:25.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.206+0000 7f9a6b015640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c330 0x7f9a6414f660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400c390 tx=0x7f9a54001e70 comp rx=0 tx=0).stop 2024-04-25T08:46:25.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.206+0000 7f9a6b015640 1 -- 172.21.15.172:0/1223211916 shutdown_connections 2024-04-25T08:46:25.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.206+0000 7f9a6b015640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a5006b4d0 0x7f9a5006d990 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.206+0000 7f9a6b015640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a64158230 0x7f9a640d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.206+0000 7f9a6b015640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a6406c7e0 0x7f9a64152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.206+0000 7f9a6b015640 1 --2- 172.21.15.172:0/1223211916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a6406c330 0x7f9a6414f660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:25.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.206+0000 7f9a6b015640 1 -- 172.21.15.172:0/1223211916 >> 172.21.15.172:0/1223211916 conn(0x7f9a64061600 msgr2=0x7f9a640ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:25.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.206+0000 7f9a6b015640 1 -- 172.21.15.172:0/1223211916 shutdown_connections 2024-04-25T08:46:25.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:25.206+0000 7f9a6b015640 1 -- 172.21.15.172:0/1223211916 wait complete. 2024-04-25T08:46:25.207 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': 'fc327b2a-8dd2-4d41-bd02-b73c27bb9949', 'mode': 'asynchronous'}' 2024-04-25T08:46:29.913 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:46:29.916 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:46:35.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:35.208 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-04-25T08:46:35.229 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:46:35.229 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:46:35.311 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:46:35.355 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:46:35.355 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:35.355 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:35.372 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:35.372 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:35.429 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:35.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.583+0000 7f5690df9640 1 Processor -- start 2024-04-25T08:46:35.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.583+0000 7f5690df9640 1 -- start start 2024-04-25T08:46:35.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.584+0000 7f5690df9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f568c0b3410 0x7f568c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.584+0000 7f5690df9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c0ace70 con 0x7f568c06e3c0 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.584+0000 7f5690df9640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c0b43b0 con 0x7f568c0b37f0 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.584+0000 7f5690df9640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c06df30 con 0x7f568c0b3410 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.584+0000 7f568ad9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f568c06e3c0 0x7f568c06e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57336/0 (socket says 172.21.15.172:57336) 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.584+0000 7f568ad9d640 1 -- 172.21.15.172:0/2451771467 learned_addr learned my addr 172.21.15.172:0/2451771467 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.584+0000 7f568a59c640 1 --2- 172.21.15.172:0/2451771467 >> v2:172.21.15.186:3300/0 conn(0x7f568c0b3410 0x7f568c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.584+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032714614 0 0) 0x7f5684001110 con 0x7f568c06e3c0 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.584+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5674003520 con 0x7f568c06e3c0 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 689235065 0 0) 0x7f5674003520 con 0x7f568c06e3c0 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 >> v2:172.21.15.186:3300/0 conn(0x7f568c0b3410 msgr2=0x7f568c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 --2- 172.21.15.172:0/2451771467 >> v2:172.21.15.186:3300/0 conn(0x7f568c0b3410 0x7f568c0720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 >> v1:172.21.15.186:6789/0 conn(0x7f568c0b37f0 legacy=0x7f568c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0726d0 con 0x7f568c06e3c0 2024-04-25T08:46:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f5684001840 con 0x7f568c06e3c0 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 >> v1:172.21.15.172:6789/0 conn(0x7f568c06e3c0 legacy=0x7f568c06e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56740039b0 0x7f5674003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5674004800 0x7f5674004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740051c0 0x7f567400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c06df30 con 0x7f56740039b0 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567400c060 con 0x7f56740051c0 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567400c260 con 0x7f5674004800 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568a59c640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56740039b0 0x7f5674003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568ad9d640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740051c0 0x7f567400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f5689d9b640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5674004800 0x7f5674004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568a59c640 1 -- 172.21.15.172:0/2451771467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5674004800 msgr2=0x7f5674004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568a59c640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5674004800 0x7f5674004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568a59c640 1 -- 172.21.15.172:0/2451771467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740051c0 msgr2=0x7f567400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568a59c640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740051c0 0x7f567400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568a59c640 1 -- 172.21.15.172:0/2451771467 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5674003520 con 0x7f56740039b0 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f5689d9b640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5674004800 0x7f5674004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568ad9d640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740051c0 0x7f567400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.585+0000 7f568ad9d640 1 -- 172.21.15.172:0/2451771467 reap_dead start 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.586+0000 7f568a59c640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56740039b0 0x7f5674003dd0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f567c009fc0 tx=0x7f5674005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63afd287c992f40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.586+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c009c10 con 0x7f56740039b0 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.586+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c036070 con 0x7f56740039b0 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.586+0000 7f568959a640 1 -- 172.21.15.172:0/2451771467 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c031880 con 0x7f56740039b0 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.587+0000 7f5690df9640 1 -- 172.21.15.172:0/2451771467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56740039b0 msgr2=0x7f5674003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.587+0000 7f5690df9640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56740039b0 0x7f5674003dd0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f567c009fc0 tx=0x7f5674005830 comp rx=0 tx=0).stop 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.587+0000 7f5690df9640 1 -- 172.21.15.172:0/2451771467 shutdown_connections 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.587+0000 7f5690df9640 1 --2- 172.21.15.172:0/2451771467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56740039b0 0x7f5674003dd0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.587+0000 7f5690df9640 1 -- 172.21.15.172:0/2451771467 >> 172.21.15.172:0/2451771467 conn(0x7f568c0cfae0 msgr2=0x7f568c0cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:35.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.587+0000 7f5690df9640 1 -- 172.21.15.172:0/2451771467 shutdown_connections 2024-04-25T08:46:35.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.587+0000 7f5690df9640 1 -- 172.21.15.172:0/2451771467 wait complete. 2024-04-25T08:46:35.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.588+0000 7f5690df9640 1 Processor -- start 2024-04-25T08:46:35.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.588+0000 7f5690df9640 1 -- start start 2024-04-25T08:46:35.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f5690df9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740039b0 0x7f568c15f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f5690df9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f568c160a70 0x7f568c15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f5690df9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c143210 0x7f568c14f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f5690df9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c147890 con 0x7f568c143210 2024-04-25T08:46:35.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f5690df9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c06dbc0 con 0x7f56740039b0 2024-04-25T08:46:35.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f5690df9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c147230 con 0x7f568c160a70 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c143210 0x7f568c14f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c143210 0x7f568c14f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55406/0 (socket says 172.21.15.172:55406) 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568ad9d640 1 -- 172.21.15.172:0/2012287623 learned_addr learned my addr 172.21.15.172:0/2012287623 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f5689d9b640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f568c160a70 0x7f568c15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568a59c640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740039b0 0x7f568c15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568ad9d640 1 -- 172.21.15.172:0/2012287623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f568c160a70 msgr2=0x7f568c15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568ad9d640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f568c160a70 0x7f568c15d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568ad9d640 1 -- 172.21.15.172:0/2012287623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740039b0 msgr2=0x7f568c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568ad9d640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740039b0 0x7f568c15f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568ad9d640 1 -- 172.21.15.172:0/2012287623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c15f9d0 con 0x7f568c143210 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568a59c640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740039b0 0x7f568c15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.589+0000 7f568ad9d640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c143210 0x7f568c14f380 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f568c0b2e90 tx=0x7f5684007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.590+0000 7f567affd640 1 -- 172.21.15.172:0/2012287623 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684005e50 con 0x7f568c143210 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.590+0000 7f567affd640 1 -- 172.21.15.172:0/2012287623 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684018070 con 0x7f568c143210 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.590+0000 7f5690df9640 1 -- 172.21.15.172:0/2012287623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c15fcb0 con 0x7f568c143210 2024-04-25T08:46:35.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.590+0000 7f567affd640 1 -- 172.21.15.172:0/2012287623 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400e890 con 0x7f568c143210 2024-04-25T08:46:35.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.590+0000 7f5690df9640 1 -- 172.21.15.172:0/2012287623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c160270 con 0x7f568c143210 2024-04-25T08:46:35.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.591+0000 7f5690df9640 1 -- 172.21.15.172:0/2012287623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c073990 con 0x7f568c143210 2024-04-25T08:46:35.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.591+0000 7f567affd640 1 -- 172.21.15.172:0/2012287623 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f568400ea30 con 0x7f568c143210 2024-04-25T08:46:35.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.591+0000 7f567affd640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f566c06b670 0x7f566c06db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.591+0000 7f567affd640 1 -- 172.21.15.172:0/2012287623 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f568408a030 con 0x7f568c143210 2024-04-25T08:46:35.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.591+0000 7f568a59c640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f566c06b670 0x7f566c06db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.592+0000 7f568a59c640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f566c06b670 0x7f566c06db30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f567c035000 tx=0x7f567c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:35.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.596+0000 7f567affd640 1 -- 172.21.15.172:0/2012287623 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f568c0ace70 con 0x7f568c143210 2024-04-25T08:46:35.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.771+0000 7f5690df9640 1 -- 172.21.15.172:0/2012287623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f568c1620a0 con 0x7f568c143210 2024-04-25T08:46:35.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.772+0000 7f567affd640 1 -- 172.21.15.172:0/2012287623 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17203 (secure 0 0 0) 0x7f5684058c70 con 0x7f568c143210 2024-04-25T08:46:35.764 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:35.764 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":69,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:19.498396+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:07.009926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:07.764108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/611108095":"2024-04-26T08:46:19.498370+0000","172.21.15.172:6834/611108095":"2024-04-26T08:46:19.498370+0000","172.21.15.186:6834/550125910":"2024-04-26T08:46:18.498889+0000","172.21.15.186:6832/550125910":"2024-04-26T08:46:18.498889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:35.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.774+0000 7f5690df9640 1 -- 172.21.15.172:0/2012287623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f566c06b670 msgr2=0x7f566c06db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:35.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.774+0000 7f5690df9640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f566c06b670 0x7f566c06db30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f567c035000 tx=0x7f567c02f000 comp rx=0 tx=0).stop 2024-04-25T08:46:35.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.774+0000 7f5690df9640 1 -- 172.21.15.172:0/2012287623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c143210 msgr2=0x7f568c14f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:35.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.774+0000 7f5690df9640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c143210 0x7f568c14f380 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f568c0b2e90 tx=0x7f5684007420 comp rx=0 tx=0).stop 2024-04-25T08:46:35.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.774+0000 7f5690df9640 1 -- 172.21.15.172:0/2012287623 shutdown_connections 2024-04-25T08:46:35.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.774+0000 7f5690df9640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f566c06b670 0x7f566c06db30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.775+0000 7f5690df9640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c143210 0x7f568c14f380 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.775+0000 7f5690df9640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f568c160a70 0x7f568c15d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.775+0000 7f5690df9640 1 --2- 172.21.15.172:0/2012287623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56740039b0 0x7f568c15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.775+0000 7f5690df9640 1 -- 172.21.15.172:0/2012287623 >> 172.21.15.172:0/2012287623 conn(0x7f568c0cfae0 msgr2=0x7f568c0716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:35.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.775+0000 7f5690df9640 1 -- 172.21.15.172:0/2012287623 shutdown_connections 2024-04-25T08:46:35.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.775+0000 7f5690df9640 1 -- 172.21.15.172:0/2012287623 wait complete. 2024-04-25T08:46:35.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:46:07.009926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:46:07.764108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:46:35.777 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:46:35.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.886+0000 7fe9826a3640 1 Processor -- start 2024-04-25T08:46:35.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.886+0000 7fe9826a3640 1 -- start start 2024-04-25T08:46:35.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe9826a3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe97c070dc0 0x7fe97c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe9826a3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe97c0711a0 0x7fe97c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe9826a3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe97c0b4830 0x7fe97c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe9826a3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97c1622b0 con 0x7fe97c070dc0 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe9826a3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97c0b10f0 con 0x7fe97c0b4830 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe9826a3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c0d1770 con 0x7fe97c0711a0 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe97bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe97c070dc0 0x7fe97c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe97bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe97c070dc0 0x7fe97c06ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55412/0 (socket says 172.21.15.172:55412) 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe97bfff640 1 -- 172.21.15.172:0/3039258432 learned_addr learned my addr 172.21.15.172:0/3039258432 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe97bfff640 1 -- 172.21.15.172:0/3039258432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe97c0711a0 msgr2=0x7fe97c0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe97bfff640 1 --2- 172.21.15.172:0/3039258432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe97c0711a0 0x7fe97c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe97bfff640 1 -- 172.21.15.172:0/3039258432 >> v2:172.21.15.186:3300/0 conn(0x7fe97c0b4830 msgr2=0x7fe97c0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe97bfff640 1 --2- 172.21.15.172:0/3039258432 >> v2:172.21.15.186:3300/0 conn(0x7fe97c0b4830 0x7fe97c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.887+0000 7fe97bfff640 1 -- 172.21.15.172:0/3039258432 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c162740 con 0x7fe97c070dc0 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.888+0000 7fe97bfff640 1 --2- 172.21.15.172:0/3039258432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c070dc0 0x7fe97c06ccd0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0b4150 tx=0x7fe96c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66afed3ab54133fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.888+0000 7fe97affd640 1 -- 172.21.15.172:0/3039258432 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c037070 con 0x7fe97c070dc0 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.888+0000 7fe97affd640 1 -- 172.21.15.172:0/3039258432 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c02ae10 con 0x7fe97c070dc0 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.888+0000 7fe97affd640 1 -- 172.21.15.172:0/3039258432 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c032660 con 0x7fe97c070dc0 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.889+0000 7fe9826a3640 1 -- 172.21.15.172:0/3039258432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c070dc0 msgr2=0x7fe97c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.889+0000 7fe9826a3640 1 --2- 172.21.15.172:0/3039258432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c070dc0 0x7fe97c06ccd0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0b4150 tx=0x7fe96c02a100 comp rx=0 tx=0).stop 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.889+0000 7fe9826a3640 1 -- 172.21.15.172:0/3039258432 shutdown_connections 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.889+0000 7fe9826a3640 1 --2- 172.21.15.172:0/3039258432 >> v2:172.21.15.186:3300/0 conn(0x7fe97c0b4830 0x7fe97c0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.889+0000 7fe9826a3640 1 --2- 172.21.15.172:0/3039258432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe97c0711a0 0x7fe97c0b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.889+0000 7fe9826a3640 1 --2- 172.21.15.172:0/3039258432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c070dc0 0x7fe97c06ccd0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.889+0000 7fe9826a3640 1 -- 172.21.15.172:0/3039258432 >> 172.21.15.172:0/3039258432 conn(0x7fe97c0b3530 msgr2=0x7fe97c0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:35.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.889+0000 7fe9826a3640 1 -- 172.21.15.172:0/3039258432 shutdown_connections 2024-04-25T08:46:35.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.889+0000 7fe9826a3640 1 -- 172.21.15.172:0/3039258432 wait complete. 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.890+0000 7fe9826a3640 1 Processor -- start 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.890+0000 7fe9826a3640 1 -- start start 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe9826a3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe97c070dc0 0x7fe97c0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe9826a3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe97c0711a0 0x7fe97c145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe9826a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c0b4830 0x7fe97c152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe9826a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c161f40 con 0x7fe97c0b4830 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe9826a3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c161c60 con 0x7fe97c0711a0 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe9826a3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c071600 con 0x7fe97c070dc0 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe980c40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c0b4830 0x7fe97c152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe980c40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c0b4830 0x7fe97c152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55414/0 (socket says 172.21.15.172:55414) 2024-04-25T08:46:35.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe980c40640 1 -- 172.21.15.172:0/2434653647 learned_addr learned my addr 172.21.15.172:0/2434653647 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe97bfff640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe97c070dc0 0x7fe97c0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe97b7fe640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe97c0711a0 0x7fe97c145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe980c40640 1 -- 172.21.15.172:0/2434653647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe97c070dc0 msgr2=0x7fe97c0cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe980c40640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe97c070dc0 0x7fe97c0cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe980c40640 1 -- 172.21.15.172:0/2434653647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe97c0711a0 msgr2=0x7fe97c145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe980c40640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe97c0711a0 0x7fe97c145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe980c40640 1 -- 172.21.15.172:0/2434653647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c1532f0 con 0x7fe97c0b4830 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.891+0000 7fe980c40640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c0b4830 0x7fe97c152db0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe97400b970 tx=0x7fe97400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.892+0000 7fe978ff9640 1 -- 172.21.15.172:0/2434653647 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974019070 con 0x7fe97c0b4830 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.892+0000 7fe978ff9640 1 -- 172.21.15.172:0/2434653647 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97400cb60 con 0x7fe97c0b4830 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.892+0000 7fe978ff9640 1 -- 172.21.15.172:0/2434653647 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974014440 con 0x7fe97c0b4830 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.892+0000 7fe9826a3640 1 -- 172.21.15.172:0/2434653647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c153590 con 0x7fe97c0b4830 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.892+0000 7fe9826a3640 1 -- 172.21.15.172:0/2434653647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c153b50 con 0x7fe97c0b4830 2024-04-25T08:46:35.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.893+0000 7fe9826a3640 1 -- 172.21.15.172:0/2434653647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c073a00 con 0x7fe97c0b4830 2024-04-25T08:46:35.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.893+0000 7fe978ff9640 1 -- 172.21.15.172:0/2434653647 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe97401c070 con 0x7fe97c0b4830 2024-04-25T08:46:35.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.893+0000 7fe978ff9640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe96806b4d0 0x7fe96806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:35.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.894+0000 7fe978ff9640 1 -- 172.21.15.172:0/2434653647 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fe97408a140 con 0x7fe97c0b4830 2024-04-25T08:46:35.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.894+0000 7fe97bfff640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe96806b4d0 0x7fe96806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:35.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.894+0000 7fe97bfff640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe96806b4d0 0x7fe96806d990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe96c034000 tx=0x7fe96c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:35.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:35.898+0000 7fe978ff9640 1 -- 172.21.15.172:0/2434653647 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe974058d80 con 0x7fe97c0b4830 2024-04-25T08:46:36.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.068+0000 7fe9826a3640 1 -- 172.21.15.172:0/2434653647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe97c06d120 con 0x7fe97c0b4830 2024-04-25T08:46:36.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.068+0000 7fe978ff9640 1 -- 172.21.15.172:0/2434653647 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe974058680 con 0x7fe97c0b4830 2024-04-25T08:46:36.060 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:46:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 -- 172.21.15.172:0/2434653647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe96806b4d0 msgr2=0x7fe96806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe96806b4d0 0x7fe96806d990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe96c034000 tx=0x7fe96c02e000 comp rx=0 tx=0).stop 2024-04-25T08:46:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 -- 172.21.15.172:0/2434653647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c0b4830 msgr2=0x7fe97c152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c0b4830 0x7fe97c152db0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe97400b970 tx=0x7fe97400be30 comp rx=0 tx=0).stop 2024-04-25T08:46:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 -- 172.21.15.172:0/2434653647 shutdown_connections 2024-04-25T08:46:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe96806b4d0 0x7fe96806d990 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe97c0711a0 0x7fe97c145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97c0b4830 0x7fe97c152db0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 --2- 172.21.15.172:0/2434653647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe97c070dc0 0x7fe97c0cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 -- 172.21.15.172:0/2434653647 >> 172.21.15.172:0/2434653647 conn(0x7fe97c0b3530 msgr2=0x7fe97c0cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 -- 172.21.15.172:0/2434653647 shutdown_connections 2024-04-25T08:46:36.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.070+0000 7fe9826a3640 1 -- 172.21.15.172:0/2434653647 wait complete. 2024-04-25T08:46:36.073 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:46:36.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.181+0000 7f7a12276640 1 Processor -- start 2024-04-25T08:46:36.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.181+0000 7f7a12276640 1 -- start start 2024-04-25T08:46:36.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a12276640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7a0c070dc0 0x7f7a0c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a12276640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7a0c0711a0 0x7f7a0c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a12276640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0c0d1770 con 0x7f7a0c0b4830 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a12276640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0c1622b0 con 0x7f7a0c0711a0 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a12276640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0c0b10f0 con 0x7f7a0c070dc0 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a0b7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7a0c0711a0 0x7f7a0c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a10813640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7a0c0b4830 0x7f7a0c0b4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57352/0 (socket says 172.21.15.172:57352) 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a10813640 1 -- 172.21.15.172:0/363730968 learned_addr learned my addr 172.21.15.172:0/363730968 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a0bfff640 1 --2- 172.21.15.172:0/363730968 >> v2:172.21.15.186:3300/0 conn(0x7f7a0c070dc0 0x7f7a0c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a0b7fe640 1 -- 172.21.15.172:0/363730968 >> v2:172.21.15.186:3300/0 conn(0x7f7a0c070dc0 msgr2=0x7f7a0c06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a0b7fe640 1 --2- 172.21.15.172:0/363730968 >> v2:172.21.15.186:3300/0 conn(0x7f7a0c070dc0 0x7f7a0c06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a0b7fe640 1 -- 172.21.15.172:0/363730968 >> v1:172.21.15.172:6789/0 conn(0x7f7a0c0b4830 legacy=0x7f7a0c0b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a0b7fe640 1 -- 172.21.15.172:0/363730968 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c162740 con 0x7f7a0c0711a0 2024-04-25T08:46:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.182+0000 7f7a0affd640 1 -- 172.21.15.172:0/363730968 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984251873 0 0) 0x7f7a0c0d1770 con 0x7f7a0c0b4830 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.183+0000 7f7a0b7fe640 1 --2- 172.21.15.172:0/363730968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 0x7f7a0c0b07a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c070a00 tx=0x7f7a0002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196612bd13187d56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.183+0000 7f7a0affd640 1 -- 172.21.15.172:0/363730968 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00037070 con 0x7f7a0c0711a0 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.183+0000 7f7a0affd640 1 -- 172.21.15.172:0/363730968 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0002add0 con 0x7f7a0c0711a0 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.183+0000 7f7a0affd640 1 -- 172.21.15.172:0/363730968 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00032660 con 0x7f7a0c0711a0 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.184+0000 7f7a12276640 1 -- 172.21.15.172:0/363730968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 msgr2=0x7f7a0c0b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.184+0000 7f7a12276640 1 --2- 172.21.15.172:0/363730968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 0x7f7a0c0b07a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c070a00 tx=0x7f7a0002a080 comp rx=0 tx=0).stop 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.184+0000 7f7a12276640 1 -- 172.21.15.172:0/363730968 shutdown_connections 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.184+0000 7f7a12276640 1 --2- 172.21.15.172:0/363730968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 0x7f7a0c0b07a0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.184+0000 7f7a12276640 1 --2- 172.21.15.172:0/363730968 >> v2:172.21.15.186:3300/0 conn(0x7f7a0c070dc0 0x7f7a0c06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.184+0000 7f7a12276640 1 -- 172.21.15.172:0/363730968 >> 172.21.15.172:0/363730968 conn(0x7f7a0c0b3530 msgr2=0x7f7a0c0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.184+0000 7f7a12276640 1 -- 172.21.15.172:0/363730968 shutdown_connections 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.184+0000 7f7a12276640 1 -- 172.21.15.172:0/363730968 wait complete. 2024-04-25T08:46:36.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.185+0000 7f7a12276640 1 Processor -- start 2024-04-25T08:46:36.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.185+0000 7f7a12276640 1 -- start start 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a12276640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a0c070dc0 0x7f7a0c148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a12276640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 0x7f7a0c1f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a12276640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a0c0b4830 0x7f7a0c1f7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a12276640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c161f40 con 0x7f7a0c0711a0 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a12276640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c161c60 con 0x7f7a0c0b4830 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a12276640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c071630 con 0x7f7a0c070dc0 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a0b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 0x7f7a0c1f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a0b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 0x7f7a0c1f6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55436/0 (socket says 172.21.15.172:55436) 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a0b7fe640 1 -- 172.21.15.172:0/3676273187 learned_addr learned my addr 172.21.15.172:0/3676273187 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a0b7fe640 1 -- 172.21.15.172:0/3676273187 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a0c070dc0 msgr2=0x7f7a0c148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a10813640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a0c0b4830 0x7f7a0c1f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a0bfff640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a0c070dc0 0x7f7a0c148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a0b7fe640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a0c070dc0 0x7f7a0c148890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a0b7fe640 1 -- 172.21.15.172:0/3676273187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a0c0b4830 msgr2=0x7f7a0c1f7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a0b7fe640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a0c0b4830 0x7f7a0c1f7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a0b7fe640 1 -- 172.21.15.172:0/3676273187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c0cd570 con 0x7f7a0c0711a0 2024-04-25T08:46:36.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a0b7fe640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 0x7f7a0c1f6ad0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009890 tx=0x7f7a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:36.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a08ff9640 1 -- 172.21.15.172:0/3676273187 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00037040 con 0x7f7a0c0711a0 2024-04-25T08:46:36.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a08ff9640 1 -- 172.21.15.172:0/3676273187 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a00042070 con 0x7f7a0c0711a0 2024-04-25T08:46:36.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a08ff9640 1 -- 172.21.15.172:0/3676273187 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0003b890 con 0x7f7a0c0711a0 2024-04-25T08:46:36.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a12276640 1 -- 172.21.15.172:0/3676273187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0c148dd0 con 0x7f7a0c0711a0 2024-04-25T08:46:36.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.186+0000 7f7a12276640 1 -- 172.21.15.172:0/3676273187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0c149200 con 0x7f7a0c0711a0 2024-04-25T08:46:36.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.187+0000 7f7a12276640 1 -- 172.21.15.172:0/3676273187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0c073a00 con 0x7f7a0c0711a0 2024-04-25T08:46:36.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.188+0000 7f7a08ff9640 1 -- 172.21.15.172:0/3676273187 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a0002ac50 con 0x7f7a0c0711a0 2024-04-25T08:46:36.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.188+0000 7f7a08ff9640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79f806b4d0 0x7f79f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.188+0000 7f7a08ff9640 1 -- 172.21.15.172:0/3676273187 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f7a000aaa90 con 0x7f7a0c0711a0 2024-04-25T08:46:36.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.188+0000 7f7a0bfff640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79f806b4d0 0x7f79f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.189+0000 7f7a0bfff640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79f806b4d0 0x7f79f806d990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f79fc006fd0 tx=0x7f79fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:36.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.192+0000 7f7a08ff9640 1 -- 172.21.15.172:0/3676273187 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a00030e20 con 0x7f7a0c0711a0 2024-04-25T08:46:36.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.363+0000 7f7a12276640 1 -- 172.21.15.172:0/3676273187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a0c0cf830 con 0x7f7a0c0711a0 2024-04-25T08:46:36.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.364+0000 7f7a08ff9640 1 -- 172.21.15.172:0/3676273187 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a000796d0 con 0x7f7a0c0711a0 2024-04-25T08:46:36.355 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 -- 172.21.15.172:0/3676273187 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79f806b4d0 msgr2=0x7f79f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79f806b4d0 0x7f79f806d990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f79fc006fd0 tx=0x7f79fc008040 comp rx=0 tx=0).stop 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 -- 172.21.15.172:0/3676273187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 msgr2=0x7f7a0c1f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 0x7f7a0c1f6ad0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009890 tx=0x7f7a000046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 -- 172.21.15.172:0/3676273187 shutdown_connections 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79f806b4d0 0x7f79f806d990 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a0c0b4830 0x7f7a0c1f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a0c0711a0 0x7f7a0c1f6ad0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 --2- 172.21.15.172:0/3676273187 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a0c070dc0 0x7f7a0c148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 -- 172.21.15.172:0/3676273187 >> 172.21.15.172:0/3676273187 conn(0x7f7a0c0b3530 msgr2=0x7f7a0c0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 -- 172.21.15.172:0/3676273187 shutdown_connections 2024-04-25T08:46:36.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.366+0000 7f7a12276640 1 -- 172.21.15.172:0/3676273187 wait complete. 2024-04-25T08:46:36.368 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:46:36.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.476+0000 7f519e93b640 1 Processor -- start 2024-04-25T08:46:36.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.477+0000 7f519e93b640 1 -- start start 2024-04-25T08:46:36.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.477+0000 7f519e93b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f519815de30 0x7f51980b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.477+0000 7f519e93b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51980b3b70 con 0x7f51980ad570 2024-04-25T08:46:36.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.477+0000 7f519e93b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519806e5b0 con 0x7f51980b5270 2024-04-25T08:46:36.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.477+0000 7f519e93b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980b3e50 con 0x7f519815de30 2024-04-25T08:46:36.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.478+0000 7f5197fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f519815de30 0x7f51980b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.478+0000 7f519ced8640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f51980ad570 0x7f519806abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57364/0 (socket says 172.21.15.172:57364) 2024-04-25T08:46:36.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.478+0000 7f519ced8640 1 -- 172.21.15.172:0/4290309400 learned_addr learned my addr 172.21.15.172:0/4290309400 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:36.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.478+0000 7f5197fff640 1 -- 172.21.15.172:0/4290309400 >> v1:172.21.15.186:6789/0 conn(0x7f51980b5270 legacy=0x7f519806f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.478+0000 7f5197fff640 1 -- 172.21.15.172:0/4290309400 >> v1:172.21.15.172:6789/0 conn(0x7f51980ad570 legacy=0x7f519806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.478+0000 7f5197fff640 1 -- 172.21.15.172:0/4290309400 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519806e890 con 0x7f519815de30 2024-04-25T08:46:36.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.478+0000 7f5196ffd640 1 -- 172.21.15.172:0/4290309400 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023529615 0 0) 0x7f51980b3b70 con 0x7f51980ad570 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.478+0000 7f5197fff640 1 --2- 172.21.15.172:0/4290309400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f519815de30 0x7f51980b3590 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f51880097a0 tx=0x7f518802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c0f27ae3db6399 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.479+0000 7f5196ffd640 1 -- 172.21.15.172:0/4290309400 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188037070 con 0x7f519815de30 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.479+0000 7f5196ffd640 1 -- 172.21.15.172:0/4290309400 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188032440 con 0x7f519815de30 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.479+0000 7f5196ffd640 1 -- 172.21.15.172:0/4290309400 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188032810 con 0x7f519815de30 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.479+0000 7f519e93b640 1 -- 172.21.15.172:0/4290309400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f519815de30 msgr2=0x7f51980b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.479+0000 7f519e93b640 1 --2- 172.21.15.172:0/4290309400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f519815de30 0x7f51980b3590 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f51880097a0 tx=0x7f518802a230 comp rx=0 tx=0).stop 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.479+0000 7f519e93b640 1 -- 172.21.15.172:0/4290309400 shutdown_connections 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.479+0000 7f519e93b640 1 --2- 172.21.15.172:0/4290309400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f519815de30 0x7f51980b3590 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.479+0000 7f519e93b640 1 -- 172.21.15.172:0/4290309400 >> 172.21.15.172:0/4290309400 conn(0x7f51980b5af0 msgr2=0x7f51980b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.479+0000 7f519e93b640 1 -- 172.21.15.172:0/4290309400 shutdown_connections 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.479+0000 7f519e93b640 1 -- 172.21.15.172:0/4290309400 wait complete. 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.480+0000 7f519e93b640 1 Processor -- start 2024-04-25T08:46:36.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.481+0000 7f519e93b640 1 -- start start 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.481+0000 7f519e93b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51980ad570 0x7f51981554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.481+0000 7f519e93b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51980b5270 0x7f5198154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.481+0000 7f519e93b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f519815de30 0x7f519809b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.481+0000 7f519e93b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51980b5700 con 0x7f51980b5270 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.481+0000 7f519e93b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519806ec00 con 0x7f51980ad570 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.481+0000 7f519e93b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51980b5880 con 0x7f519815de30 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.481+0000 7f51977fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51980b5270 0x7f5198154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.481+0000 7f51977fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51980b5270 0x7f5198154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55454/0 (socket says 172.21.15.172:55454) 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.481+0000 7f51977fe640 1 -- 172.21.15.172:0/508016733 learned_addr learned my addr 172.21.15.172:0/508016733 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f5197fff640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51980ad570 0x7f51981554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f519ced8640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f519815de30 0x7f519809b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f51977fe640 1 -- 172.21.15.172:0/508016733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f519815de30 msgr2=0x7f519809b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f51977fe640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f519815de30 0x7f519809b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f51977fe640 1 -- 172.21.15.172:0/508016733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51980ad570 msgr2=0x7f51981554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f51977fe640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51980ad570 0x7f51981554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f51977fe640 1 -- 172.21.15.172:0/508016733 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519809ba70 con 0x7f51980b5270 2024-04-25T08:46:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f51977fe640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51980b5270 0x7f5198154e10 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c4b0 tx=0x7f518c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f5194ff9640 1 -- 172.21.15.172:0/508016733 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c0052d0 con 0x7f51980b5270 2024-04-25T08:46:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f5194ff9640 1 -- 172.21.15.172:0/508016733 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c005470 con 0x7f51980b5270 2024-04-25T08:46:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f519e93b640 1 -- 172.21.15.172:0/508016733 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519815b200 con 0x7f51980b5270 2024-04-25T08:46:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f5194ff9640 1 -- 172.21.15.172:0/508016733 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c012870 con 0x7f51980b5270 2024-04-25T08:46:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.482+0000 7f519e93b640 1 -- 172.21.15.172:0/508016733 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519815b7c0 con 0x7f51980b5270 2024-04-25T08:46:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.483+0000 7f519e93b640 1 -- 172.21.15.172:0/508016733 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519806cc80 con 0x7f51980b5270 2024-04-25T08:46:36.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.483+0000 7f5194ff9640 1 -- 172.21.15.172:0/508016733 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f518c012a10 con 0x7f51980b5270 2024-04-25T08:46:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.484+0000 7f5194ff9640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f518406b4d0 0x7f518406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.484+0000 7f5197fff640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f518406b4d0 0x7f518406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.484+0000 7f5194ff9640 1 -- 172.21.15.172:0/508016733 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f518c08a040 con 0x7f51980b5270 2024-04-25T08:46:36.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.484+0000 7f5197fff640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f518406b4d0 0x7f518406d990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5188034000 tx=0x7f518802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:36.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.488+0000 7f5194ff9640 1 -- 172.21.15.172:0/508016733 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f518c058d10 con 0x7f51980b5270 2024-04-25T08:46:36.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.661+0000 7f519e93b640 1 -- 172.21.15.172:0/508016733 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f519815b9c0 con 0x7f51980b5270 2024-04-25T08:46:36.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.662+0000 7f5194ff9640 1 -- 172.21.15.172:0/508016733 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f519815b9c0 con 0x7f51980b5270 2024-04-25T08:46:36.653 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:46:36.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 -- 172.21.15.172:0/508016733 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f518406b4d0 msgr2=0x7f518406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f518406b4d0 0x7f518406d990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5188034000 tx=0x7f518802e000 comp rx=0 tx=0).stop 2024-04-25T08:46:36.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 -- 172.21.15.172:0/508016733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51980b5270 msgr2=0x7f5198154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51980b5270 0x7f5198154e10 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c4b0 tx=0x7f518c00c970 comp rx=0 tx=0).stop 2024-04-25T08:46:36.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 -- 172.21.15.172:0/508016733 shutdown_connections 2024-04-25T08:46:36.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f518406b4d0 0x7f518406d990 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f519815de30 0x7f519809b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51980b5270 0x7f5198154e10 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 --2- 172.21.15.172:0/508016733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51980ad570 0x7f51981554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 -- 172.21.15.172:0/508016733 >> 172.21.15.172:0/508016733 conn(0x7f51980b5af0 msgr2=0x7f51980b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:36.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 -- 172.21.15.172:0/508016733 shutdown_connections 2024-04-25T08:46:36.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.664+0000 7f519e93b640 1 -- 172.21.15.172:0/508016733 wait complete. 2024-04-25T08:46:36.666 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:46:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.773+0000 7f41e54ea640 1 Processor -- start 2024-04-25T08:46:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.774+0000 7f41e54ea640 1 -- start start 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.774+0000 7f41e54ea640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e015dc20 0x7f41e00ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.774+0000 7f41e54ea640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f41e00d32f0 0x7f41e00cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.774+0000 7f41e54ea640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e015e000 con 0x7f41e0161710 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.774+0000 7f41e54ea640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e00d1de0 con 0x7f41e00d32f0 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.774+0000 7f41e54ea640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0161c60 con 0x7f41e015dc20 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.774+0000 7f41d7fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f41e0161710 0x7f41e006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57380/0 (socket says 172.21.15.172:57380) 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.774+0000 7f41d7fff640 1 -- 172.21.15.172:0/2420992094 learned_addr learned my addr 172.21.15.172:0/2420992094 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41df7fe640 1 --2- 172.21.15.172:0/2420992094 >> v2:172.21.15.186:3300/0 conn(0x7f41e00d32f0 0x7f41e00cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41deffd640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e015dc20 0x7f41e00ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354901678 0 0) 0x7f41e015e000 con 0x7f41e0161710 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41cc003520 con 0x7f41e0161710 2024-04-25T08:46:36.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 712275293 0 0) 0x7f41cc003520 con 0x7f41e0161710 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e015dc20 msgr2=0x7f41e00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e015dc20 0x7f41e00ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 >> v2:172.21.15.186:3300/0 conn(0x7f41e00d32f0 msgr2=0x7f41e00cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 --2- 172.21.15.172:0/2420992094 >> v2:172.21.15.186:3300/0 conn(0x7f41e00d32f0 0x7f41e00cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0161f40 con 0x7f41e0161710 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f41c8001670 con 0x7f41e0161710 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 >> v1:172.21.15.172:6789/0 conn(0x7f41e0161710 legacy=0x7f41e006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41cc0039b0 0x7f41cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e015dc20 0x7f41cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00d1de0 con 0x7f41cc004d40 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0161c60 con 0x7f41cc0039b0 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc00b9c0 con 0x7f41e015dc20 2024-04-25T08:46:36.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41df7fe640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41d7fff640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e015dc20 0x7f41cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41deffd640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41cc0039b0 0x7f41cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41df7fe640 1 -- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e015dc20 msgr2=0x7f41cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41df7fe640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e015dc20 0x7f41cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41df7fe640 1 -- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41cc0039b0 msgr2=0x7f41cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.775+0000 7f41df7fe640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41cc0039b0 0x7f41cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.776+0000 7f41df7fe640 1 -- 172.21.15.172:0/2420992094 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc003520 con 0x7f41cc004d40 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.776+0000 7f41df7fe640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009f90 tx=0x7f41cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92f7aea33a306f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.776+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8009c10 con 0x7f41cc004d40 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.776+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8036070 con 0x7f41cc004d40 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.776+0000 7f41de7fc640 1 -- 172.21.15.172:0/2420992094 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8031840 con 0x7f41cc004d40 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.777+0000 7f41e54ea640 1 -- 172.21.15.172:0/2420992094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41cc004d40 msgr2=0x7f41cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.777+0000 7f41e54ea640 1 --2- 172.21.15.172:0/2420992094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009f90 tx=0x7f41cc005830 comp rx=0 tx=0).stop 2024-04-25T08:46:36.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.777+0000 7f41df7fe640 1 -- 172.21.15.172:0/2420992094 reap_dead start 2024-04-25T08:46:36.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.777+0000 7f41e54ea640 1 -- 172.21.15.172:0/2420992094 shutdown_connections 2024-04-25T08:46:36.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.777+0000 7f41e54ea640 1 -- 172.21.15.172:0/2420992094 >> 172.21.15.172:0/2420992094 conn(0x7f41e00d0420 msgr2=0x7f41e00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:36.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.777+0000 7f41e54ea640 1 -- 172.21.15.172:0/2420992094 shutdown_connections 2024-04-25T08:46:36.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.777+0000 7f41e54ea640 1 -- 172.21.15.172:0/2420992094 wait complete. 2024-04-25T08:46:36.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.778+0000 7f41e54ea640 1 Processor -- start 2024-04-25T08:46:36.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.778+0000 7f41e54ea640 1 -- start start 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41e54ea640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e0157ce0 0x7f41e00c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41e54ea640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e01580c0 0x7f41e015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41e54ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41e00c9f80 0x7f41e015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41e54ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00b5e50 con 0x7f41e00c9f80 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41e54ea640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0162500 con 0x7f41e0157ce0 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41e54ea640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00b5fd0 con 0x7f41e01580c0 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41e00c9f80 0x7f41e015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41e00c9f80 0x7f41e015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55462/0 (socket says 172.21.15.172:55462) 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41df7fe640 1 -- 172.21.15.172:0/1899273929 learned_addr learned my addr 172.21.15.172:0/1899273929 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41d7fff640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e01580c0 0x7f41e015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41deffd640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e0157ce0 0x7f41e00c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41df7fe640 1 -- 172.21.15.172:0/1899273929 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e01580c0 msgr2=0x7f41e015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41df7fe640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e01580c0 0x7f41e015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41df7fe640 1 -- 172.21.15.172:0/1899273929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e0157ce0 msgr2=0x7f41e00c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41df7fe640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e0157ce0 0x7f41e00c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41df7fe640 1 -- 172.21.15.172:0/1899273929 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00c7570 con 0x7f41e00c9f80 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.779+0000 7f41deffd640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e0157ce0 0x7f41e00c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.780+0000 7f41df7fe640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41e00c9f80 0x7f41e015cf00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f41d800e230 tx=0x7f41d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.780+0000 7f41d77fe640 1 -- 172.21.15.172:0/1899273929 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8009c10 con 0x7f41e00c9f80 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.780+0000 7f41d77fe640 1 -- 172.21.15.172:0/1899273929 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8031d10 con 0x7f41e00c9f80 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.780+0000 7f41d77fe640 1 -- 172.21.15.172:0/1899273929 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8045670 con 0x7f41e00c9f80 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.780+0000 7f41e54ea640 1 -- 172.21.15.172:0/1899273929 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e00c7850 con 0x7f41e00c9f80 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.780+0000 7f41e54ea640 1 -- 172.21.15.172:0/1899273929 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e00c7e10 con 0x7f41e00c9f80 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.781+0000 7f41e54ea640 1 -- 172.21.15.172:0/1899273929 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e00c72e0 con 0x7f41e00c9f80 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.781+0000 7f41d77fe640 1 -- 172.21.15.172:0/1899273929 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f41d8005d10 con 0x7f41e00c9f80 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.781+0000 7f41d77fe640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41c006b4d0 0x7f41c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.782+0000 7f41d77fe640 1 -- 172.21.15.172:0/1899273929 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f41d80ab3d0 con 0x7f41e00c9f80 2024-04-25T08:46:36.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.782+0000 7f41deffd640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41c006b4d0 0x7f41c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:36.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.782+0000 7f41deffd640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41c006b4d0 0x7f41c006d990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009bc0 tx=0x7f41d0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:36.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.786+0000 7f41d77fe640 1 -- 172.21.15.172:0/1899273929 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f41d80799c0 con 0x7f41e00c9f80 2024-04-25T08:46:36.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.968+0000 7f41e54ea640 1 -- 172.21.15.172:0/1899273929 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41e0073a00 con 0x7f41e00c9f80 2024-04-25T08:46:36.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.968+0000 7f41d77fe640 1 -- 172.21.15.172:0/1899273929 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v69) v1 ==== 80+0+244 (secure 0 0 0) 0x7f41d807da60 con 0x7f41e00c9f80 2024-04-25T08:46:36.960 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172:6835/611108095 2024-04-26T08:46:19.498370+0000 2024-04-25T08:46:36.960 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172:6834/611108095 2024-04-26T08:46:19.498370+0000 2024-04-25T08:46:36.960 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.186:6834/550125910 2024-04-26T08:46:18.498889+0000 2024-04-25T08:46:36.960 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.186:6832/550125910 2024-04-26T08:46:18.498889+0000 2024-04-25T08:46:36.960 INFO:teuthology.orchestra.run.smithi172.stderr:listed 4 entries 2024-04-25T08:46:36.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 -- 172.21.15.172:0/1899273929 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41c006b4d0 msgr2=0x7f41c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41c006b4d0 0x7f41c006d990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009bc0 tx=0x7f41d0008040 comp rx=0 tx=0).stop 2024-04-25T08:46:36.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 -- 172.21.15.172:0/1899273929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41e00c9f80 msgr2=0x7f41e015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:36.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41e00c9f80 0x7f41e015cf00 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f41d800e230 tx=0x7f41d8009750 comp rx=0 tx=0).stop 2024-04-25T08:46:36.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 -- 172.21.15.172:0/1899273929 shutdown_connections 2024-04-25T08:46:36.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41c006b4d0 0x7f41c006d990 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41e00c9f80 0x7f41e015cf00 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41e01580c0 0x7f41e015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 --2- 172.21.15.172:0/1899273929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e0157ce0 0x7f41e00c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:36.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 -- 172.21.15.172:0/1899273929 >> 172.21.15.172:0/1899273929 conn(0x7f41e00d0420 msgr2=0x7f41e00b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:36.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 -- 172.21.15.172:0/1899273929 shutdown_connections 2024-04-25T08:46:36.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:36.970+0000 7f41e54ea640 1 -- 172.21.15.172:0/1899273929 wait complete. 2024-04-25T08:46:36.972 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:46:36.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:36.973 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:46:37.002 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:46:37.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:46:37.002 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:46:37.058 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:46:37.058 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:37.076 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:46:37.077 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:37.077 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:37.113 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:46:37.113 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:46:37.113 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:37.135 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:46:37.135 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:37.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.258+0000 7fa4382ee640 1 Processor -- start 2024-04-25T08:46:37.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.258+0000 7fa4382ee640 1 -- start start 2024-04-25T08:46:37.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.259+0000 7fa4382ee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa43015dbe0 0x7fa4300d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.259+0000 7fa4382ee640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4300b92a0 0x7fa4300d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.259+0000 7fa4382ee640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4300b97a0 con 0x7fa4300b2cb0 2024-04-25T08:46:37.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.259+0000 7fa4382ee640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43015dfc0 con 0x7fa4300b92a0 2024-04-25T08:46:37.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.259+0000 7fa4382ee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300d1a00 con 0x7fa43015dbe0 2024-04-25T08:46:37.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.260+0000 7fa43688b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4300b92a0 0x7fa4300d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.260+0000 7fa43688b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4300b92a0 0x7fa4300d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55478/0 (socket says 172.21.15.172:55478) 2024-04-25T08:46:37.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.260+0000 7fa43688b640 1 -- 172.21.15.172:0/4284210117 learned_addr learned my addr 172.21.15.172:0/4284210117 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:37.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.260+0000 7fa43608a640 1 --2- 172.21.15.172:0/4284210117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa43015dbe0 0x7fa4300d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.260+0000 7fa43688b640 1 -- 172.21.15.172:0/4284210117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa43015dbe0 msgr2=0x7fa4300d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:37.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.260+0000 7fa43688b640 1 --2- 172.21.15.172:0/4284210117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa43015dbe0 0x7fa4300d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.260+0000 7fa435088640 1 -- 172.21.15.172:0/4284210117 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497762397 0 0) 0x7fa4300b97a0 con 0x7fa4300b2cb0 2024-04-25T08:46:37.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.260+0000 7fa43688b640 1 -- 172.21.15.172:0/4284210117 >> v1:172.21.15.172:6789/0 conn(0x7fa4300b2cb0 legacy=0x7fa4300b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.260+0000 7fa43688b640 1 -- 172.21.15.172:0/4284210117 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300d1c50 con 0x7fa4300b92a0 2024-04-25T08:46:37.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa43688b640 1 --2- 172.21.15.172:0/4284210117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4300b92a0 0x7fa4300d0e50 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fa428009e50 tx=0x7fa42802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287a33813bae931b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:37.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa435088640 1 -- 172.21.15.172:0/4284210117 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa428036070 con 0x7fa4300b92a0 2024-04-25T08:46:37.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa435088640 1 -- 172.21.15.172:0/4284210117 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa428031600 con 0x7fa4300b92a0 2024-04-25T08:46:37.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa435088640 1 -- 172.21.15.172:0/4284210117 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4280319d0 con 0x7fa4300b92a0 2024-04-25T08:46:37.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa4382ee640 1 -- 172.21.15.172:0/4284210117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4300b92a0 msgr2=0x7fa4300d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa4382ee640 1 --2- 172.21.15.172:0/4284210117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4300b92a0 0x7fa4300d0e50 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fa428009e50 tx=0x7fa42802a710 comp rx=0 tx=0).stop 2024-04-25T08:46:37.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa4382ee640 1 -- 172.21.15.172:0/4284210117 shutdown_connections 2024-04-25T08:46:37.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa4382ee640 1 --2- 172.21.15.172:0/4284210117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4300b92a0 0x7fa4300d0e50 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa4382ee640 1 --2- 172.21.15.172:0/4284210117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa43015dbe0 0x7fa4300d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa4382ee640 1 -- 172.21.15.172:0/4284210117 >> 172.21.15.172:0/4284210117 conn(0x7fa430061a20 msgr2=0x7fa430061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:37.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa4382ee640 1 -- 172.21.15.172:0/4284210117 shutdown_connections 2024-04-25T08:46:37.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.261+0000 7fa4382ee640 1 -- 172.21.15.172:0/4284210117 wait complete. 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.262+0000 7fa4382ee640 1 Processor -- start 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.262+0000 7fa4382ee640 1 -- start start 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa4382ee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4300b2cb0 0x7fa430151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa4382ee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4300b92a0 0x7fa4300caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa4382ee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa43015dbe0 0x7fa4300cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa4382ee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300b6ab0 con 0x7fa43015dbe0 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa4382ee640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300d2210 con 0x7fa4300b92a0 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa4382ee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300b6c30 con 0x7fa4300b2cb0 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa43688b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa43015dbe0 0x7fa4300cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa43688b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa43015dbe0 0x7fa4300cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55488/0 (socket says 172.21.15.172:55488) 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa43688b640 1 -- 172.21.15.172:0/1713661054 learned_addr learned my addr 172.21.15.172:0/1713661054 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa43688b640 1 -- 172.21.15.172:0/1713661054 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4300b2cb0 msgr2=0x7fa430151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa43688b640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4300b2cb0 0x7fa430151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa43688b640 1 -- 172.21.15.172:0/1713661054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4300b92a0 msgr2=0x7fa4300caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.263+0000 7fa43688b640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4300b92a0 0x7fa4300caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.264+0000 7fa43688b640 1 -- 172.21.15.172:0/1713661054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300cb430 con 0x7fa43015dbe0 2024-04-25T08:46:37.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.264+0000 7fa43688b640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa43015dbe0 0x7fa4300cc390 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fa428009f70 tx=0x7fa428004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:37.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.264+0000 7fa426ffd640 1 -- 172.21.15.172:0/1713661054 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42803f020 con 0x7fa43015dbe0 2024-04-25T08:46:37.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.264+0000 7fa426ffd640 1 -- 172.21.15.172:0/1713661054 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa428037040 con 0x7fa43015dbe0 2024-04-25T08:46:37.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.264+0000 7fa4382ee640 1 -- 172.21.15.172:0/1713661054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4300cb710 con 0x7fa43015dbe0 2024-04-25T08:46:37.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.264+0000 7fa426ffd640 1 -- 172.21.15.172:0/1713661054 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa428036070 con 0x7fa43015dbe0 2024-04-25T08:46:37.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.264+0000 7fa4382ee640 1 -- 172.21.15.172:0/1713661054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4300cbcd0 con 0x7fa43015dbe0 2024-04-25T08:46:37.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.265+0000 7fa4382ee640 1 -- 172.21.15.172:0/1713661054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa430073990 con 0x7fa43015dbe0 2024-04-25T08:46:37.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.265+0000 7fa426ffd640 1 -- 172.21.15.172:0/1713661054 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa428042020 con 0x7fa43015dbe0 2024-04-25T08:46:37.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.266+0000 7fa426ffd640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa41406b500 0x7fa41406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.266+0000 7fa426ffd640 1 -- 172.21.15.172:0/1713661054 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fa4280aa990 con 0x7fa43015dbe0 2024-04-25T08:46:37.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.266+0000 7fa43608a640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa41406b500 0x7fa41406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.266+0000 7fa43608a640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa41406b500 0x7fa41406d9c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa4300b5da0 tx=0x7fa420008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:37.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.270+0000 7fa426ffd640 1 -- 172.21.15.172:0/1713661054 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa428049030 con 0x7fa43015dbe0 2024-04-25T08:46:37.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.475+0000 7fa4382ee640 1 -- 172.21.15.172:0/1713661054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa43015b420 con 0x7fa43015dbe0 2024-04-25T08:46:37.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.475+0000 7fa426ffd640 1 -- 172.21.15.172:0/1713661054 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fa428078f80 con 0x7fa43015dbe0 2024-04-25T08:46:37.467 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:37.467 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":42,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/384277594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":384277594},{"type":"v1","addr":"172.21.15.186:6833","nonce":384277594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/842443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":842443},{"type":"v1","addr":"172.21.15.186:6835","nonce":842443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2655968938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2655968938},{"type":"v1","addr":"172.21.15.172:6837","nonce":2655968938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:08.789050+0000","modified":"2024-04-25T08:46:21.527505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6835/311149179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":311149179},{"type":"v1","addr":"172.21.15.172:6835","nonce":311149179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:46:37.467 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 42 2024-04-25T08:46:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 -- 172.21.15.172:0/1713661054 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa41406b500 msgr2=0x7fa41406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa41406b500 0x7fa41406d9c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa4300b5da0 tx=0x7fa420008040 comp rx=0 tx=0).stop 2024-04-25T08:46:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 -- 172.21.15.172:0/1713661054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa43015dbe0 msgr2=0x7fa4300cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa43015dbe0 0x7fa4300cc390 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fa428009f70 tx=0x7fa428004a40 comp rx=0 tx=0).stop 2024-04-25T08:46:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 -- 172.21.15.172:0/1713661054 shutdown_connections 2024-04-25T08:46:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa41406b500 0x7fa41406d9c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4300b92a0 0x7fa4300caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa43015dbe0 0x7fa4300cc390 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 --2- 172.21.15.172:0/1713661054 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4300b2cb0 0x7fa430151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 -- 172.21.15.172:0/1713661054 >> 172.21.15.172:0/1713661054 conn(0x7fa430061a20 msgr2=0x7fa43015b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:37.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 -- 172.21.15.172:0/1713661054 shutdown_connections 2024-04-25T08:46:37.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.477+0000 7fa4382ee640 1 -- 172.21.15.172:0/1713661054 wait complete. 2024-04-25T08:46:37.480 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:37.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.587+0000 7fb3c7a8f640 1 Processor -- start 2024-04-25T08:46:37.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.587+0000 7fb3c7a8f640 1 -- start start 2024-04-25T08:46:37.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.588+0000 7fb3c7a8f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb3c015dc00 0x7fb3c00c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.588+0000 7fb3c7a8f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00d1dd0 0x7fb3c00ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.588+0000 7fb3c7a8f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c015dfe0 con 0x7fb3c00ceb20 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.588+0000 7fb3c7a8f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c00d00c0 con 0x7fb3c015dc00 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.588+0000 7fb3c7a8f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00d03a0 con 0x7fb3c00d1dd0 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.588+0000 7fb3c502a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb3c00ceb20 0x7fb3c00d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58300/0 (socket says 172.21.15.172:58300) 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.588+0000 7fb3c502a640 1 -- 172.21.15.172:0/403549581 learned_addr learned my addr 172.21.15.172:0/403549581 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.588+0000 7fb3c602c640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00d1dd0 0x7fb3c00ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.588+0000 7fb3c582b640 1 --2- 172.21.15.172:0/403549581 >> v2:172.21.15.186:3300/0 conn(0x7fb3c015dc00 0x7fb3c00c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642660505 0 0) 0x7fb3b0001110 con 0x7fb3c00ceb20 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3ac003520 con 0x7fb3c00ceb20 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 368796566 0 0) 0x7fb3ac003520 con 0x7fb3c00ceb20 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00d1dd0 msgr2=0x7fb3c00ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:37.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00d1dd0 0x7fb3c00ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 >> v2:172.21.15.186:3300/0 conn(0x7fb3c015dc00 msgr2=0x7fb3c00c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 --2- 172.21.15.172:0/403549581 >> v2:172.21.15.186:3300/0 conn(0x7fb3c015dc00 0x7fb3c00c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00cc440 con 0x7fb3c00ceb20 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fb3b0001840 con 0x7fb3c00ceb20 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 >> v1:172.21.15.172:6789/0 conn(0x7fb3c00ceb20 legacy=0x7fb3c00d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00d1dd0 0x7fb3ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3ac003f30 0x7fb3ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 0x7fb3ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00d00c0 con 0x7fb3ac004d40 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00d03a0 con 0x7fb3ac003f30 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac00b9c0 con 0x7fb3c00d1dd0 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c602c640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 0x7fb3ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c582b640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00d1dd0 0x7fb3ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c502a640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3ac003f30 0x7fb3ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c602c640 1 -- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00d1dd0 msgr2=0x7fb3ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c602c640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00d1dd0 0x7fb3ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c602c640 1 -- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3ac003f30 msgr2=0x7fb3ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c602c640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3ac003f30 0x7fb3ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c602c640 1 -- 172.21.15.172:0/403549581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac003520 con 0x7fb3ac004d40 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.589+0000 7fb3c502a640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3ac003f30 0x7fb3ac004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.590+0000 7fb3c602c640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 0x7fb3ac0051c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009a90 tx=0x7fb3ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702f0748fe54316b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.590+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8036070 con 0x7fb3ac004d40 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.590+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b8031400 con 0x7fb3ac004d40 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.590+0000 7fb3c4829640 1 -- 172.21.15.172:0/403549581 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8009690 con 0x7fb3ac004d40 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.591+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/403549581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 msgr2=0x7fb3ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.591+0000 7fb3c7a8f640 1 --2- 172.21.15.172:0/403549581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 0x7fb3ac0051c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009a90 tx=0x7fb3ac005830 comp rx=0 tx=0).stop 2024-04-25T08:46:37.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.591+0000 7fb3c602c640 1 -- 172.21.15.172:0/403549581 reap_dead start 2024-04-25T08:46:37.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.591+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/403549581 shutdown_connections 2024-04-25T08:46:37.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.591+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/403549581 >> 172.21.15.172:0/403549581 conn(0x7fb3c006f5d0 msgr2=0x7fb3c006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:37.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.591+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/403549581 shutdown_connections 2024-04-25T08:46:37.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.591+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/403549581 wait complete. 2024-04-25T08:46:37.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.592+0000 7fb3c7a8f640 1 Processor -- start 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.592+0000 7fb3c7a8f640 1 -- start start 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c7a8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 0x7fb3c0150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c7a8f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00cb230 0x7fb3c00b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c7a8f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3c00b5920 0x7fb3c01e8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c7a8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00cfd90 con 0x7fb3ac004d40 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c7a8f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00cc130 con 0x7fb3c00b5920 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c7a8f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00cdd70 con 0x7fb3c00cb230 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c582b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 0x7fb3c0150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c582b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 0x7fb3c0150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48336/0 (socket says 172.21.15.172:48336) 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c582b640 1 -- 172.21.15.172:0/4229398379 learned_addr learned my addr 172.21.15.172:0/4229398379 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c502a640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00cb230 0x7fb3c00b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c602c640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3c00b5920 0x7fb3c01e8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c582b640 1 -- 172.21.15.172:0/4229398379 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00cb230 msgr2=0x7fb3c00b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c582b640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00cb230 0x7fb3c00b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c582b640 1 -- 172.21.15.172:0/4229398379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3c00b5920 msgr2=0x7fb3c01e8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c582b640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3c00b5920 0x7fb3c01e8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c582b640 1 -- 172.21.15.172:0/4229398379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0150540 con 0x7fb3ac004d40 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c502a640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00cb230 0x7fb3c00b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c602c640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3c00b5920 0x7fb3c01e8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c582b640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 0x7fb3c0150000 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc011e90 tx=0x7fb3bc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3b67fc640 1 -- 172.21.15.172:0/4229398379 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc015630 con 0x7fb3ac004d40 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3b67fc640 1 -- 172.21.15.172:0/4229398379 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc0157d0 con 0x7fb3ac004d40 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/4229398379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c00ca190 con 0x7fb3ac004d40 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3b67fc640 1 -- 172.21.15.172:0/4229398379 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc015ba0 con 0x7fb3ac004d40 2024-04-25T08:46:37.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.593+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/4229398379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c00ca750 con 0x7fb3ac004d40 2024-04-25T08:46:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.594+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/4229398379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c0073990 con 0x7fb3ac004d40 2024-04-25T08:46:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.595+0000 7fb3b67fc640 1 -- 172.21.15.172:0/4229398379 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb3bc01d400 con 0x7fb3ac004d40 2024-04-25T08:46:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.595+0000 7fb3b67fc640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb3a406b500 0x7fb3a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.595+0000 7fb3c502a640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb3a406b500 0x7fb3a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.595+0000 7fb3b67fc640 1 -- 172.21.15.172:0/4229398379 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb3bc08b660 con 0x7fb3ac004d40 2024-04-25T08:46:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.596+0000 7fb3c502a640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb3a406b500 0x7fb3a406d9c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00012b0 tx=0x7fb3b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.600+0000 7fb3b67fc640 1 -- 172.21.15.172:0/4229398379 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3bc019030 con 0x7fb3ac004d40 2024-04-25T08:46:37.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.773+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/4229398379 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3c00c66c0 con 0x7fb3ac004d40 2024-04-25T08:46:37.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.774+0000 7fb3b67fc640 1 -- 172.21.15.172:0/4229398379 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17203 (secure 0 0 0) 0x7fb3bc010040 con 0x7fb3ac004d40 2024-04-25T08:46:37.765 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:37.765 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":69,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:19.498396+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:07.009926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:07.764108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/611108095":"2024-04-26T08:46:19.498370+0000","172.21.15.172:6834/611108095":"2024-04-26T08:46:19.498370+0000","172.21.15.186:6834/550125910":"2024-04-26T08:46:18.498889+0000","172.21.15.186:6832/550125910":"2024-04-26T08:46:18.498889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:37.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/4229398379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb3a406b500 msgr2=0x7fb3a406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb3a406b500 0x7fb3a406d9c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00012b0 tx=0x7fb3b0009040 comp rx=0 tx=0).stop 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/4229398379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 msgr2=0x7fb3c0150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 0x7fb3c0150000 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc011e90 tx=0x7fb3bc00f580 comp rx=0 tx=0).stop 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/4229398379 shutdown_connections 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb3a406b500 0x7fb3a406d9c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3c00b5920 0x7fb3c01e8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3c00cb230 0x7fb3c00b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 --2- 172.21.15.172:0/4229398379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ac004d40 0x7fb3c0150000 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/4229398379 >> 172.21.15.172:0/4229398379 conn(0x7fb3c006f5d0 msgr2=0x7fb3c006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/4229398379 shutdown_connections 2024-04-25T08:46:37.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.776+0000 7fb3c7a8f640 1 -- 172.21.15.172:0/4229398379 wait complete. 2024-04-25T08:46:37.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:46:07.009926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:46:07.764108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:46:37.779 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:46:37.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.887+0000 7ff3ad3c8640 1 Processor -- start 2024-04-25T08:46:37.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.887+0000 7ff3ad3c8640 1 -- start start 2024-04-25T08:46:37.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.887+0000 7ff3ad3c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff3a80ced80 0x7ff3a80d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.887+0000 7ff3ad3c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3a8161710 0x7ff3a80d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3ad3c8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a815e000 con 0x7ff3a815dc20 2024-04-25T08:46:37.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3ad3c8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a80d1de0 con 0x7ff3a80ced80 2024-04-25T08:46:37.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3ad3c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a8161c60 con 0x7ff3a8161710 2024-04-25T08:46:37.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3a67fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff3a80ced80 0x7ff3a80d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3a67fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff3a80ced80 0x7ff3a80d22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48344/0 (socket says 172.21.15.172:48344) 2024-04-25T08:46:37.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3a67fc640 1 -- 172.21.15.172:0/3753943333 learned_addr learned my addr 172.21.15.172:0/3753943333 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:37.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3a77fe640 1 --2- 172.21.15.172:0/3753943333 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3a8161710 0x7ff3a80d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3a67fc640 1 -- 172.21.15.172:0/3753943333 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3a8161710 msgr2=0x7ff3a80d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3a67fc640 1 --2- 172.21.15.172:0/3753943333 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3a8161710 0x7ff3a80d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3a67fc640 1 -- 172.21.15.172:0/3753943333 >> v1:172.21.15.186:6789/0 conn(0x7ff3a815dc20 legacy=0x7ff3a80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.888+0000 7ff3a67fc640 1 -- 172.21.15.172:0/3753943333 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a8161f40 con 0x7ff3a80ced80 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3a67fc640 1 --2- 172.21.15.172:0/3753943333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 0x7ff3a80d22e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff39c009870 tx=0x7ff39c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2679f70108a7940e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3a5ffb640 1 -- 172.21.15.172:0/3753943333 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c037070 con 0x7ff3a80ced80 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3a5ffb640 1 -- 172.21.15.172:0/3753943333 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c032440 con 0x7ff3a80ced80 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3a5ffb640 1 -- 172.21.15.172:0/3753943333 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c032810 con 0x7ff3a80ced80 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/3753943333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 msgr2=0x7ff3a80d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3ad3c8640 1 --2- 172.21.15.172:0/3753943333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 0x7ff3a80d22e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff39c009870 tx=0x7ff39c02a270 comp rx=0 tx=0).stop 2024-04-25T08:46:37.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/3753943333 shutdown_connections 2024-04-25T08:46:37.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3ad3c8640 1 --2- 172.21.15.172:0/3753943333 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3a8161710 0x7ff3a80d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3ad3c8640 1 --2- 172.21.15.172:0/3753943333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 0x7ff3a80d22e0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/3753943333 >> 172.21.15.172:0/3753943333 conn(0x7ff3a80d0420 msgr2=0x7ff3a80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:37.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/3753943333 shutdown_connections 2024-04-25T08:46:37.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.889+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/3753943333 wait complete. 2024-04-25T08:46:37.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.891+0000 7ff3ad3c8640 1 Processor -- start 2024-04-25T08:46:37.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.891+0000 7ff3ad3c8640 1 -- start start 2024-04-25T08:46:37.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.891+0000 7ff3ad3c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 0x7ff3a80c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.891+0000 7ff3ad3c8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3a815dc20 0x7ff3a8150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.891+0000 7ff3ad3c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3a8161710 0x7ff3a80cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.891+0000 7ff3ad3c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80b5e50 con 0x7ff3a80ced80 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.891+0000 7ff3ad3c8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a8162500 con 0x7ff3a815dc20 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.891+0000 7ff3ad3c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a80b5fd0 con 0x7ff3a8161710 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.891+0000 7ff3a6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 0x7ff3a80c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 0x7ff3a80c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48346/0 (socket says 172.21.15.172:48346) 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a6ffd640 1 -- 172.21.15.172:0/1421855202 learned_addr learned my addr 172.21.15.172:0/1421855202 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a67fc640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3a815dc20 0x7ff3a8150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a77fe640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3a8161710 0x7ff3a80cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a6ffd640 1 -- 172.21.15.172:0/1421855202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3a8161710 msgr2=0x7ff3a80cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a6ffd640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3a8161710 0x7ff3a80cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a6ffd640 1 -- 172.21.15.172:0/1421855202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3a815dc20 msgr2=0x7ff3a8150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a6ffd640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3a815dc20 0x7ff3a8150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a6ffd640 1 -- 172.21.15.172:0/1421855202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a80cc380 con 0x7ff3a80ced80 2024-04-25T08:46:37.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a67fc640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3a815dc20 0x7ff3a8150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3a6ffd640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 0x7ff3a80c9e80 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff39800c3c0 tx=0x7ff39800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff38f7fe640 1 -- 172.21.15.172:0/1421855202 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3980052d0 con 0x7ff3a80ced80 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff38f7fe640 1 -- 172.21.15.172:0/1421855202 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398005490 con 0x7ff3a80ced80 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff38f7fe640 1 -- 172.21.15.172:0/1421855202 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398007260 con 0x7ff3a80ced80 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/1421855202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a80cdd10 con 0x7ff3a80ced80 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.892+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/1421855202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a80c9680 con 0x7ff3a80ced80 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.893+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/1421855202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a8073a00 con 0x7ff3a80ced80 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.893+0000 7ff38f7fe640 1 -- 172.21.15.172:0/1421855202 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff398007400 con 0x7ff3a80ced80 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.894+0000 7ff38f7fe640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39406b500 0x7ff39406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.894+0000 7ff38f7fe640 1 -- 172.21.15.172:0/1421855202 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7ff398089890 con 0x7ff3a80ced80 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.894+0000 7ff3a67fc640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39406b500 0x7ff39406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.894+0000 7ff3a67fc640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39406b500 0x7ff39406d9c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff39c034000 tx=0x7ff39c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:37.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:37.898+0000 7ff38f7fe640 1 -- 172.21.15.172:0/1421855202 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff3980584d0 con 0x7ff3a80ced80 2024-04-25T08:46:38.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.068+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/1421855202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3a80d16b0 con 0x7ff3a80ced80 2024-04-25T08:46:38.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.069+0000 7ff38f7fe640 1 -- 172.21.15.172:0/1421855202 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff398057dd0 con 0x7ff3a80ced80 2024-04-25T08:46:38.060 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/1421855202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39406b500 msgr2=0x7ff39406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39406b500 0x7ff39406d9c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff39c034000 tx=0x7ff39c02e000 comp rx=0 tx=0).stop 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/1421855202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 msgr2=0x7ff3a80c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 0x7ff3a80c9e80 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff39800c3c0 tx=0x7ff39800c880 comp rx=0 tx=0).stop 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/1421855202 shutdown_connections 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff39406b500 0x7ff39406d9c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3a815dc20 0x7ff3a8150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3a8161710 0x7ff3a80cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 --2- 172.21.15.172:0/1421855202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3a80ced80 0x7ff3a80c9e80 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/1421855202 >> 172.21.15.172:0/1421855202 conn(0x7ff3a80d0420 msgr2=0x7ff3a80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/1421855202 shutdown_connections 2024-04-25T08:46:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.071+0000 7ff3ad3c8640 1 -- 172.21.15.172:0/1421855202 wait complete. 2024-04-25T08:46:38.073 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:46:38.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.181+0000 7f84b5438640 1 Processor -- start 2024-04-25T08:46:38.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.182+0000 7f84b5438640 1 -- start start 2024-04-25T08:46:38.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.182+0000 7f84b5438640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f84b0161240 0x7f84b00b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.182+0000 7f84b5438640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b0161890 0x7f84b00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.182+0000 7f84b5438640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b0161620 con 0x7f84b00b54a0 2024-04-25T08:46:38.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.182+0000 7f84b5438640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b00b7120 con 0x7f84b0161240 2024-04-25T08:46:38.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.182+0000 7f84b5438640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0161e00 con 0x7f84b0161890 2024-04-25T08:46:38.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.182+0000 7f84aeffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f84b0161240 0x7f84b00b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.182+0000 7f84af7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f84b00b54a0 0x7f84b00d1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58316/0 (socket says 172.21.15.172:58316) 2024-04-25T08:46:38.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.182+0000 7f84af7fe640 1 -- 172.21.15.172:0/3010743404 learned_addr learned my addr 172.21.15.172:0/3010743404 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:38.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.183+0000 7f84ae7fc640 1 --2- 172.21.15.172:0/3010743404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b0161890 0x7f84b00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.183+0000 7f84aeffd640 1 -- 172.21.15.172:0/3010743404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b0161890 msgr2=0x7f84b00ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:38.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.183+0000 7f84aeffd640 1 --2- 172.21.15.172:0/3010743404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b0161890 0x7f84b00ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.183+0000 7f84aeffd640 1 -- 172.21.15.172:0/3010743404 >> v1:172.21.15.172:6789/0 conn(0x7f84b00b54a0 legacy=0x7f84b00d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.183+0000 7f84adffb640 1 -- 172.21.15.172:0/3010743404 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344024404 0 0) 0x7f84b0161620 con 0x7f84b00b54a0 2024-04-25T08:46:38.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.183+0000 7f84aeffd640 1 -- 172.21.15.172:0/3010743404 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b01620e0 con 0x7f84b0161240 2024-04-25T08:46:38.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.183+0000 7f84aeffd640 1 --2- 172.21.15.172:0/3010743404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b0161240 0x7f84b00b6be0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009d90 tx=0x7f84a002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319ca2817e6ff41f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:38.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84adffb640 1 -- 172.21.15.172:0/3010743404 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0007740 con 0x7f84b0161240 2024-04-25T08:46:38.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84adffb640 1 -- 172.21.15.172:0/3010743404 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00078e0 con 0x7f84b0161240 2024-04-25T08:46:38.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84adffb640 1 -- 172.21.15.172:0/3010743404 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0007cb0 con 0x7f84b0161240 2024-04-25T08:46:38.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84b5438640 1 -- 172.21.15.172:0/3010743404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b0161240 msgr2=0x7f84b00b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84b5438640 1 --2- 172.21.15.172:0/3010743404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b0161240 0x7f84b00b6be0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009d90 tx=0x7f84a002a660 comp rx=0 tx=0).stop 2024-04-25T08:46:38.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84b5438640 1 -- 172.21.15.172:0/3010743404 shutdown_connections 2024-04-25T08:46:38.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84b5438640 1 --2- 172.21.15.172:0/3010743404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b0161890 0x7f84b00ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84b5438640 1 --2- 172.21.15.172:0/3010743404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b0161240 0x7f84b00b6be0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84b5438640 1 -- 172.21.15.172:0/3010743404 >> 172.21.15.172:0/3010743404 conn(0x7f84b00d04a0 msgr2=0x7f84b00d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:38.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84b5438640 1 -- 172.21.15.172:0/3010743404 shutdown_connections 2024-04-25T08:46:38.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.184+0000 7f84b5438640 1 -- 172.21.15.172:0/3010743404 wait complete. 2024-04-25T08:46:38.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84b5438640 1 Processor -- start 2024-04-25T08:46:38.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84b5438640 1 -- start start 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84b5438640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b00b54a0 0x7f84b00cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84b5438640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b0161240 0x7f84b0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84b5438640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b0161890 0x7f84b015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84b5438640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00d15f0 con 0x7f84b00b54a0 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84b5438640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b01626a0 con 0x7f84b0161240 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84b5438640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00cf000 con 0x7f84b0161890 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84aeffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b00b54a0 0x7f84b00cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84aeffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b00b54a0 0x7f84b00cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48368/0 (socket says 172.21.15.172:48368) 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.186+0000 7f84aeffd640 1 -- 172.21.15.172:0/3348303092 learned_addr learned my addr 172.21.15.172:0/3348303092 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84af7fe640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b0161890 0x7f84b015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84ae7fc640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b0161240 0x7f84b0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84aeffd640 1 -- 172.21.15.172:0/3348303092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b0161890 msgr2=0x7f84b015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84aeffd640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b0161890 0x7f84b015b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84aeffd640 1 -- 172.21.15.172:0/3348303092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b0161240 msgr2=0x7f84b0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84aeffd640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b0161240 0x7f84b0154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84aeffd640 1 -- 172.21.15.172:0/3348303092 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00cd450 con 0x7f84b00b54a0 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84ae7fc640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b0161240 0x7f84b0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84aeffd640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b00b54a0 0x7f84b00cb500 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009d90 tx=0x7f84a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84977fe640 1 -- 172.21.15.172:0/3348303092 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0040070 con 0x7f84b00b54a0 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84977fe640 1 -- 172.21.15.172:0/3348303092 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a0031c40 con 0x7f84b00b54a0 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84b5438640 1 -- 172.21.15.172:0/3348303092 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b00cd730 con 0x7f84b00b54a0 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84977fe640 1 -- 172.21.15.172:0/3348303092 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a003c420 con 0x7f84b00b54a0 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.187+0000 7f84b5438640 1 -- 172.21.15.172:0/3348303092 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b00c7a10 con 0x7f84b00b54a0 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.188+0000 7f84b5438640 1 -- 172.21.15.172:0/3348303092 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b00c7550 con 0x7f84b00b54a0 2024-04-25T08:46:38.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.188+0000 7f84977fe640 1 -- 172.21.15.172:0/3348303092 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f84a0039040 con 0x7f84b00b54a0 2024-04-25T08:46:38.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.189+0000 7f84977fe640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f849c06b500 0x7f849c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.189+0000 7f84ae7fc640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f849c06b500 0x7f849c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.189+0000 7f84977fe640 1 -- 172.21.15.172:0/3348303092 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f84a00ab9c0 con 0x7f84b00b54a0 2024-04-25T08:46:38.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.189+0000 7f84ae7fc640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f849c06b500 0x7f849c06d9c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f84a4006fd0 tx=0x7f84a4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:38.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.193+0000 7f84977fe640 1 -- 172.21.15.172:0/3348303092 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f84b00c7550 con 0x7f84b00b54a0 2024-04-25T08:46:38.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.362+0000 7f84b5438640 1 -- 172.21.15.172:0/3348303092 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84b00ce330 con 0x7f84b00b54a0 2024-04-25T08:46:38.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.363+0000 7f84977fe640 1 -- 172.21.15.172:0/3348303092 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f84b00ce330 con 0x7f84b00b54a0 2024-04-25T08:46:38.354 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:46:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.364+0000 7f84b5438640 1 -- 172.21.15.172:0/3348303092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f849c06b500 msgr2=0x7f849c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.364+0000 7f84b5438640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f849c06b500 0x7f849c06d9c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f84a4006fd0 tx=0x7f84a4008040 comp rx=0 tx=0).stop 2024-04-25T08:46:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.364+0000 7f84b5438640 1 -- 172.21.15.172:0/3348303092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b00b54a0 msgr2=0x7f84b00cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.364+0000 7f84b5438640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b00b54a0 0x7f84b00cb500 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009d90 tx=0x7f84a0004a40 comp rx=0 tx=0).stop 2024-04-25T08:46:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.365+0000 7f84b5438640 1 -- 172.21.15.172:0/3348303092 shutdown_connections 2024-04-25T08:46:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.365+0000 7f84b5438640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f849c06b500 0x7f849c06d9c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.365+0000 7f84b5438640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b0161240 0x7f84b0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.365+0000 7f84b5438640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b0161890 0x7f84b015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.365+0000 7f84b5438640 1 --2- 172.21.15.172:0/3348303092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b00b54a0 0x7f84b00cb500 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.365+0000 7f84b5438640 1 -- 172.21.15.172:0/3348303092 >> 172.21.15.172:0/3348303092 conn(0x7f84b00d04a0 msgr2=0x7f84b00b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.365+0000 7f84b5438640 1 -- 172.21.15.172:0/3348303092 shutdown_connections 2024-04-25T08:46:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.365+0000 7f84b5438640 1 -- 172.21.15.172:0/3348303092 wait complete. 2024-04-25T08:46:38.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:46:38.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.475+0000 7fba3a97e640 1 Processor -- start 2024-04-25T08:46:38.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.475+0000 7fba3a97e640 1 -- start start 2024-04-25T08:46:38.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.476+0000 7fba3a97e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba34099cb0 0x7fba340b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.476+0000 7fba3a97e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fba340cfd30 0x7fba3415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.476+0000 7fba3a97e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba340cc5e0 con 0x7fba3409a090 2024-04-25T08:46:38.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.476+0000 7fba3a97e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba340cc3b0 con 0x7fba340cfd30 2024-04-25T08:46:38.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.476+0000 7fba3a97e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba340d0210 con 0x7fba34099cb0 2024-04-25T08:46:38.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.476+0000 7fba337fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fba340cfd30 0x7fba3415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.476+0000 7fba337fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fba340cfd30 0x7fba3415ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48370/0 (socket says 172.21.15.172:48370) 2024-04-25T08:46:38.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.476+0000 7fba337fe640 1 -- 172.21.15.172:0/3334067790 learned_addr learned my addr 172.21.15.172:0/3334067790 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:38.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.477+0000 7fba337fe640 1 -- 172.21.15.172:0/3334067790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba34099cb0 msgr2=0x7fba340b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:38.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.477+0000 7fba337fe640 1 --2- 172.21.15.172:0/3334067790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba34099cb0 0x7fba340b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.477+0000 7fba337fe640 1 -- 172.21.15.172:0/3334067790 >> v1:172.21.15.186:6789/0 conn(0x7fba3409a090 legacy=0x7fba3415f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:38.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.477+0000 7fba337fe640 1 -- 172.21.15.172:0/3334067790 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba340d04f0 con 0x7fba340cfd30 2024-04-25T08:46:38.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.477+0000 7fba337fe640 1 --2- 172.21.15.172:0/3334067790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 0x7fba3415ecc0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fba28009870 tx=0x7fba2802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ad2d3504339251 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:38.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.477+0000 7fba32ffd640 1 -- 172.21.15.172:0/3334067790 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28037070 con 0x7fba340cfd30 2024-04-25T08:46:38.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.477+0000 7fba32ffd640 1 -- 172.21.15.172:0/3334067790 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba28032440 con 0x7fba340cfd30 2024-04-25T08:46:38.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.478+0000 7fba32ffd640 1 -- 172.21.15.172:0/3334067790 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28032810 con 0x7fba340cfd30 2024-04-25T08:46:38.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.478+0000 7fba3a97e640 1 -- 172.21.15.172:0/3334067790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 msgr2=0x7fba3415ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.478+0000 7fba3a97e640 1 --2- 172.21.15.172:0/3334067790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 0x7fba3415ecc0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fba28009870 tx=0x7fba2802a180 comp rx=0 tx=0).stop 2024-04-25T08:46:38.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.478+0000 7fba3a97e640 1 -- 172.21.15.172:0/3334067790 shutdown_connections 2024-04-25T08:46:38.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.478+0000 7fba3a97e640 1 --2- 172.21.15.172:0/3334067790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 0x7fba3415ecc0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.478+0000 7fba3a97e640 1 --2- 172.21.15.172:0/3334067790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba34099cb0 0x7fba340b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.478+0000 7fba3a97e640 1 -- 172.21.15.172:0/3334067790 >> 172.21.15.172:0/3334067790 conn(0x7fba340b3290 msgr2=0x7fba340b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:38.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.478+0000 7fba3a97e640 1 -- 172.21.15.172:0/3334067790 shutdown_connections 2024-04-25T08:46:38.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.478+0000 7fba3a97e640 1 -- 172.21.15.172:0/3334067790 wait complete. 2024-04-25T08:46:38.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.479+0000 7fba3a97e640 1 Processor -- start 2024-04-25T08:46:38.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.479+0000 7fba3a97e640 1 -- start start 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba3a97e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba34099cb0 0x7fba3414f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba3a97e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba3409a090 0x7fba340c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba3a97e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 0x7fba340c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba3a97e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba340c52f0 con 0x7fba340cfd30 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba3a97e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba340d07d0 con 0x7fba34099cb0 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba3a97e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba340c5470 con 0x7fba3409a090 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba38f1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 0x7fba340c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba38f1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 0x7fba340c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48376/0 (socket says 172.21.15.172:48376) 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba38f1b640 1 -- 172.21.15.172:0/2420169324 learned_addr learned my addr 172.21.15.172:0/2420169324 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba337fe640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba3409a090 0x7fba340c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.480+0000 7fba33fff640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba34099cb0 0x7fba3414f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba38f1b640 1 -- 172.21.15.172:0/2420169324 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba3409a090 msgr2=0x7fba340c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba38f1b640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba3409a090 0x7fba340c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba38f1b640 1 -- 172.21.15.172:0/2420169324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba34099cb0 msgr2=0x7fba3414f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba38f1b640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba34099cb0 0x7fba3414f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba38f1b640 1 -- 172.21.15.172:0/2420169324 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3406d470 con 0x7fba340cfd30 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba33fff640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba34099cb0 0x7fba3414f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba38f1b640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 0x7fba340c8db0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00c780 tx=0x7fba2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba30ff9640 1 -- 172.21.15.172:0/2420169324 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c004b60 con 0x7fba340cfd30 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba30ff9640 1 -- 172.21.15.172:0/2420169324 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c004d00 con 0x7fba340cfd30 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba3a97e640 1 -- 172.21.15.172:0/2420169324 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3415c770 con 0x7fba340cfd30 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba30ff9640 1 -- 172.21.15.172:0/2420169324 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00aa90 con 0x7fba340cfd30 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.481+0000 7fba3a97e640 1 -- 172.21.15.172:0/2420169324 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3406da60 con 0x7fba340cfd30 2024-04-25T08:46:38.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.482+0000 7fba3a97e640 1 -- 172.21.15.172:0/2420169324 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3406dcf0 con 0x7fba340cfd30 2024-04-25T08:46:38.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.482+0000 7fba30ff9640 1 -- 172.21.15.172:0/2420169324 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba2c00ac30 con 0x7fba340cfd30 2024-04-25T08:46:38.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.483+0000 7fba30ff9640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fba2006b4d0 0x7fba2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.483+0000 7fba30ff9640 1 -- 172.21.15.172:0/2420169324 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fba2c08a9c0 con 0x7fba340cfd30 2024-04-25T08:46:38.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.483+0000 7fba33fff640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fba2006b4d0 0x7fba2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.483+0000 7fba33fff640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fba2006b4d0 0x7fba2006d990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fba2400a870 tx=0x7fba24008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:38.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.487+0000 7fba30ff9640 1 -- 172.21.15.172:0/2420169324 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba2c08ce20 con 0x7fba340cfd30 2024-04-25T08:46:38.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.661+0000 7fba3a97e640 1 -- 172.21.15.172:0/2420169324 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba34073a00 con 0x7fba340cfd30 2024-04-25T08:46:38.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.662+0000 7fba30ff9640 1 -- 172.21.15.172:0/2420169324 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7fba2c059600 con 0x7fba340cfd30 2024-04-25T08:46:38.653 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:46:38.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 -- 172.21.15.172:0/2420169324 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fba2006b4d0 msgr2=0x7fba2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fba2006b4d0 0x7fba2006d990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fba2400a870 tx=0x7fba24008040 comp rx=0 tx=0).stop 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 -- 172.21.15.172:0/2420169324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 msgr2=0x7fba340c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 0x7fba340c8db0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00c780 tx=0x7fba2c00cc40 comp rx=0 tx=0).stop 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 -- 172.21.15.172:0/2420169324 shutdown_connections 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fba2006b4d0 0x7fba2006d990 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340cfd30 0x7fba340c8db0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba3409a090 0x7fba340c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 --2- 172.21.15.172:0/2420169324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba34099cb0 0x7fba3414f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 -- 172.21.15.172:0/2420169324 >> 172.21.15.172:0/2420169324 conn(0x7fba340b3290 msgr2=0x7fba3406fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 -- 172.21.15.172:0/2420169324 shutdown_connections 2024-04-25T08:46:38.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.664+0000 7fba3a97e640 1 -- 172.21.15.172:0/2420169324 wait complete. 2024-04-25T08:46:38.666 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:38.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.772+0000 7faff09d5640 1 Processor -- start 2024-04-25T08:46:38.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.772+0000 7faff09d5640 1 -- start start 2024-04-25T08:46:38.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.773+0000 7faff09d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fafec0cfec0 0x7fafec0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.773+0000 7faff09d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 0x7fafec06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.773+0000 7faff09d5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafec071480 con 0x7fafec154ee0 2024-04-25T08:46:38.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.773+0000 7faff09d5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafec0ce830 con 0x7fafec0cfec0 2024-04-25T08:46:38.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.773+0000 7faff09d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec072090 con 0x7fafec0ce3c0 2024-04-25T08:46:38.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.773+0000 7fafe9d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fafec0cfec0 0x7fafec0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.774+0000 7fafe9d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fafec0cfec0 0x7fafec0cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48380/0 (socket says 172.21.15.172:48380) 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.774+0000 7fafe9d9b640 1 -- 172.21.15.172:0/3650410722 learned_addr learned my addr 172.21.15.172:0/3650410722 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.774+0000 7fafead9d640 1 --2- 172.21.15.172:0/3650410722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 0x7fafec06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.774+0000 7fafe9d9b640 1 -- 172.21.15.172:0/3650410722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 msgr2=0x7fafec06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.774+0000 7fafe9d9b640 1 --2- 172.21.15.172:0/3650410722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 0x7fafec06d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.774+0000 7fafe9d9b640 1 -- 172.21.15.172:0/3650410722 >> v1:172.21.15.186:6789/0 conn(0x7fafec154ee0 legacy=0x7fafec0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.774+0000 7fafe9d9b640 1 -- 172.21.15.172:0/3650410722 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec071760 con 0x7fafec0cfec0 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.774+0000 7fafead9d640 1 --2- 172.21.15.172:0/3650410722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 0x7fafec06d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7fafe9d9b640 1 --2- 172.21.15.172:0/3650410722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 0x7fafec0cde80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fafe000bb10 tx=0x7fafe002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2654395f2db4dd13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7fafe959a640 1 -- 172.21.15.172:0/3650410722 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0036020 con 0x7fafec0cfec0 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7fafe959a640 1 -- 172.21.15.172:0/3650410722 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe0032820 con 0x7fafec0cfec0 2024-04-25T08:46:38.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7fafe959a640 1 -- 172.21.15.172:0/3650410722 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0032bf0 con 0x7fafec0cfec0 2024-04-25T08:46:38.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7faff09d5640 1 -- 172.21.15.172:0/3650410722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 msgr2=0x7fafec0cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7faff09d5640 1 --2- 172.21.15.172:0/3650410722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 0x7fafec0cde80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fafe000bb10 tx=0x7fafe002c920 comp rx=0 tx=0).stop 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7faff09d5640 1 -- 172.21.15.172:0/3650410722 shutdown_connections 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7faff09d5640 1 --2- 172.21.15.172:0/3650410722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 0x7fafec06d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7faff09d5640 1 --2- 172.21.15.172:0/3650410722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 0x7fafec0cde80 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7faff09d5640 1 -- 172.21.15.172:0/3650410722 >> 172.21.15.172:0/3650410722 conn(0x7fafec06abe0 msgr2=0x7fafec06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7faff09d5640 1 -- 172.21.15.172:0/3650410722 shutdown_connections 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.775+0000 7faff09d5640 1 -- 172.21.15.172:0/3650410722 wait complete. 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7faff09d5640 1 Processor -- start 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7faff09d5640 1 -- start start 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7faff09d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 0x7fafec144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7faff09d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 0x7fafec155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7faff09d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafec154ee0 0x7fafec150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7faff09d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec071d20 con 0x7fafec0cfec0 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7faff09d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec071230 con 0x7fafec154ee0 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7faff09d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec1552c0 con 0x7fafec0ce3c0 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7fafe9d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 0x7fafec155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7fafe9d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 0x7fafec155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48392/0 (socket says 172.21.15.172:48392) 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.777+0000 7fafe9d9b640 1 -- 172.21.15.172:0/349050613 learned_addr learned my addr 172.21.15.172:0/349050613 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafead9d640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafec154ee0 0x7fafec150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafea59c640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 0x7fafec144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafe9d9b640 1 -- 172.21.15.172:0/349050613 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 msgr2=0x7fafec144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafe9d9b640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 0x7fafec144100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafe9d9b640 1 -- 172.21.15.172:0/349050613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafec154ee0 msgr2=0x7fafec150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafe9d9b640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafec154ee0 0x7fafec150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafe9d9b640 1 -- 172.21.15.172:0/349050613 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec155b50 con 0x7fafec0cfec0 2024-04-25T08:46:38.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafead9d640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafec154ee0 0x7fafec150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:38.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafe9d9b640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 0x7fafec155610 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fafe000b2c0 tx=0x7fafe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:38.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafdaffd640 1 -- 172.21.15.172:0/349050613 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0036040 con 0x7fafec0cfec0 2024-04-25T08:46:38.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafdaffd640 1 -- 172.21.15.172:0/349050613 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe003cd70 con 0x7fafec0cfec0 2024-04-25T08:46:38.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7faff09d5640 1 -- 172.21.15.172:0/349050613 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec14eaf0 con 0x7fafec0cfec0 2024-04-25T08:46:38.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7fafdaffd640 1 -- 172.21.15.172:0/349050613 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0046630 con 0x7fafec0cfec0 2024-04-25T08:46:38.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.778+0000 7faff09d5640 1 -- 172.21.15.172:0/349050613 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec14f0b0 con 0x7fafec0cfec0 2024-04-25T08:46:38.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.779+0000 7faff09d5640 1 -- 172.21.15.172:0/349050613 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec073990 con 0x7fafec0cfec0 2024-04-25T08:46:38.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.779+0000 7fafdaffd640 1 -- 172.21.15.172:0/349050613 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fafe004d060 con 0x7fafec0cfec0 2024-04-25T08:46:38.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.780+0000 7fafdaffd640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafcc06b4d0 0x7fafcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:38.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.780+0000 7fafdaffd640 1 -- 172.21.15.172:0/349050613 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fafe00ad540 con 0x7fafec0cfec0 2024-04-25T08:46:38.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.780+0000 7fafea59c640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafcc06b4d0 0x7fafcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:38.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.780+0000 7fafea59c640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafcc06b4d0 0x7fafcc06d990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007fd0 tx=0x7fafdc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:38.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.784+0000 7fafdaffd640 1 -- 172.21.15.172:0/349050613 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fafe0041070 con 0x7fafec0cfec0 2024-04-25T08:46:38.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.989+0000 7faff09d5640 1 -- 172.21.15.172:0/349050613 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafec06d360 con 0x7fafec0cfec0 2024-04-25T08:46:38.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.989+0000 7fafdaffd640 1 -- 172.21.15.172:0/349050613 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fafe002f070 con 0x7fafec0cfec0 2024-04-25T08:46:38.981 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:38.981 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":42,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/384277594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":384277594},{"type":"v1","addr":"172.21.15.186:6833","nonce":384277594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/842443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":842443},{"type":"v1","addr":"172.21.15.186:6835","nonce":842443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2655968938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2655968938},{"type":"v1","addr":"172.21.15.172:6837","nonce":2655968938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:08.789050+0000","modified":"2024-04-25T08:46:21.527505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6835/311149179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":311149179},{"type":"v1","addr":"172.21.15.172:6835","nonce":311149179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:46:38.981 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 42 2024-04-25T08:46:38.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 -- 172.21.15.172:0/349050613 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafcc06b4d0 msgr2=0x7fafcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafcc06b4d0 0x7fafcc06d990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007fd0 tx=0x7fafdc009040 comp rx=0 tx=0).stop 2024-04-25T08:46:38.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 -- 172.21.15.172:0/349050613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 msgr2=0x7fafec155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:38.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 0x7fafec155610 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fafe000b2c0 tx=0x7fafe00046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 -- 172.21.15.172:0/349050613 shutdown_connections 2024-04-25T08:46:38.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafcc06b4d0 0x7fafcc06d990 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafec154ee0 0x7fafec150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafec0cfec0 0x7fafec155610 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 --2- 172.21.15.172:0/349050613 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafec0ce3c0 0x7fafec144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:38.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 -- 172.21.15.172:0/349050613 >> 172.21.15.172:0/349050613 conn(0x7fafec06abe0 msgr2=0x7fafec0b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:38.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 -- 172.21.15.172:0/349050613 shutdown_connections 2024-04-25T08:46:38.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:38.991+0000 7faff09d5640 1 -- 172.21.15.172:0/349050613 wait complete. 2024-04-25T08:46:38.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:39.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.099+0000 7f3e3051b640 1 Processor -- start 2024-04-25T08:46:39.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.099+0000 7f3e3051b640 1 -- start start 2024-04-25T08:46:39.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.100+0000 7f3e3051b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3e2815a790 0x7f3e280d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.100+0000 7f3e3051b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e280b4eb0 0x7f3e280d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.100+0000 7f3e3051b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e280b3710 con 0x7f3e2806fea0 2024-04-25T08:46:39.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.100+0000 7f3e3051b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e280cf0e0 con 0x7f3e2815a790 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.100+0000 7f3e3051b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280cf3c0 con 0x7f3e280b4eb0 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.101+0000 7f3e2e2b7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3e2815a790 0x7f3e280d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.101+0000 7f3e2eab8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e280b4eb0 0x7f3e280d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.101+0000 7f3e2dab6640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f3e2806fea0 0x7f3e28072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:52222/0 (socket says 172.21.15.172:52222) 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.101+0000 7f3e2eab8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e280b4eb0 0x7f3e280d08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:59480/0 (socket says 172.21.15.172:59480) 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.101+0000 7f3e2dab6640 1 -- 172.21.15.172:0/1634412539 learned_addr learned my addr 172.21.15.172:0/1634412539 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.101+0000 7f3e2eab8640 1 -- 172.21.15.172:0/1634412539 >> v2:172.21.15.186:3300/0 conn(0x7f3e2815a790 msgr2=0x7f3e280d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.101+0000 7f3e2eab8640 1 --2- 172.21.15.172:0/1634412539 >> v2:172.21.15.186:3300/0 conn(0x7f3e2815a790 0x7f3e280d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.101+0000 7f3e2eab8640 1 -- 172.21.15.172:0/1634412539 >> v1:172.21.15.186:6789/0 conn(0x7f3e2806fea0 legacy=0x7f3e28072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.101+0000 7f3e2eab8640 1 -- 172.21.15.172:0/1634412539 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e280cf6a0 con 0x7f3e280b4eb0 2024-04-25T08:46:39.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.101+0000 7f3e2e2b7640 1 --2- 172.21.15.172:0/1634412539 >> v2:172.21.15.186:3300/0 conn(0x7f3e2815a790 0x7f3e280d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:39.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.102+0000 7f3e2eab8640 1 --2- 172.21.15.172:0/1634412539 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e280b4eb0 0x7f3e280d08d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009d90 tx=0x7f3e2402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1340cef2baa280a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:39.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.102+0000 7f3e2d2b5640 1 -- 172.21.15.172:0/1634412539 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24007740 con 0x7f3e280b4eb0 2024-04-25T08:46:39.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.102+0000 7f3e2d2b5640 1 -- 172.21.15.172:0/1634412539 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e240078e0 con 0x7f3e280b4eb0 2024-04-25T08:46:39.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.102+0000 7f3e2d2b5640 1 -- 172.21.15.172:0/1634412539 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24007cb0 con 0x7f3e280b4eb0 2024-04-25T08:46:39.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.103+0000 7f3e3051b640 1 -- 172.21.15.172:0/1634412539 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e280b4eb0 msgr2=0x7f3e280d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.103+0000 7f3e3051b640 1 --2- 172.21.15.172:0/1634412539 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e280b4eb0 0x7f3e280d08d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009d90 tx=0x7f3e2402a660 comp rx=0 tx=0).stop 2024-04-25T08:46:39.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.103+0000 7f3e3051b640 1 -- 172.21.15.172:0/1634412539 shutdown_connections 2024-04-25T08:46:39.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.103+0000 7f3e3051b640 1 --2- 172.21.15.172:0/1634412539 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e280b4eb0 0x7f3e280d08d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.103+0000 7f3e3051b640 1 --2- 172.21.15.172:0/1634412539 >> v2:172.21.15.186:3300/0 conn(0x7f3e2815a790 0x7f3e280d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.103+0000 7f3e3051b640 1 -- 172.21.15.172:0/1634412539 >> 172.21.15.172:0/1634412539 conn(0x7f3e280b2370 msgr2=0x7f3e280b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:39.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.103+0000 7f3e3051b640 1 -- 172.21.15.172:0/1634412539 shutdown_connections 2024-04-25T08:46:39.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.103+0000 7f3e3051b640 1 -- 172.21.15.172:0/1634412539 wait complete. 2024-04-25T08:46:39.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.104+0000 7f3e3051b640 1 Processor -- start 2024-04-25T08:46:39.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.104+0000 7f3e3051b640 1 -- start start 2024-04-25T08:46:39.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.104+0000 7f3e3051b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e2806fea0 0x7f3e28145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.104+0000 7f3e3051b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e280b4eb0 0x7f3e280ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e3051b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e2815a790 0x7f3e280cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e3051b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2815ab70 con 0x7f3e2815a790 2024-04-25T08:46:39.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e3051b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e280cf980 con 0x7f3e280b4eb0 2024-04-25T08:46:39.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e3051b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2815acf0 con 0x7f3e2806fea0 2024-04-25T08:46:39.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2eab8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e2815a790 0x7f3e280cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2eab8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e2815a790 0x7f3e280cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48396/0 (socket says 172.21.15.172:48396) 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2eab8640 1 -- 172.21.15.172:0/805503912 learned_addr learned my addr 172.21.15.172:0/805503912 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2dab6640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e280b4eb0 0x7f3e280ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2e2b7640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e2806fea0 0x7f3e28145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2eab8640 1 -- 172.21.15.172:0/805503912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e2806fea0 msgr2=0x7f3e28145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2eab8640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e2806fea0 0x7f3e28145510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2eab8640 1 -- 172.21.15.172:0/805503912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e280b4eb0 msgr2=0x7f3e280ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2eab8640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e280b4eb0 0x7f3e280ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2eab8640 1 -- 172.21.15.172:0/805503912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e28145e80 con 0x7f3e2815a790 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2e2b7640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e2806fea0 0x7f3e28145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2dab6640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e280b4eb0 0x7f3e280ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e2eab8640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e2815a790 0x7f3e280cfd40 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009eb0 tx=0x7f3e24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e1effd640 1 -- 172.21.15.172:0/805503912 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24040070 con 0x7f3e2815a790 2024-04-25T08:46:39.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e1effd640 1 -- 172.21.15.172:0/805503912 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e24031bc0 con 0x7f3e2815a790 2024-04-25T08:46:39.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e3051b640 1 -- 172.21.15.172:0/805503912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e280af1a0 con 0x7f3e2815a790 2024-04-25T08:46:39.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e1effd640 1 -- 172.21.15.172:0/805503912 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24009450 con 0x7f3e2815a790 2024-04-25T08:46:39.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.105+0000 7f3e3051b640 1 -- 172.21.15.172:0/805503912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2815b360 con 0x7f3e2815a790 2024-04-25T08:46:39.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.106+0000 7f3e3051b640 1 -- 172.21.15.172:0/805503912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2815aea0 con 0x7f3e2815a790 2024-04-25T08:46:39.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.107+0000 7f3e1effd640 1 -- 172.21.15.172:0/805503912 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e24039040 con 0x7f3e2815a790 2024-04-25T08:46:39.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.107+0000 7f3e1effd640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e0c06b4d0 0x7f3e0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.107+0000 7f3e2e2b7640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e0c06b4d0 0x7f3e0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.107+0000 7f3e1effd640 1 -- 172.21.15.172:0/805503912 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f3e240abd60 con 0x7f3e2815a790 2024-04-25T08:46:39.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.108+0000 7f3e2e2b7640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e0c06b4d0 0x7f3e0c06d990 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009ac0 tx=0x7f3e20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:39.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.112+0000 7f3e1effd640 1 -- 172.21.15.172:0/805503912 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e2815aea0 con 0x7f3e2815a790 2024-04-25T08:46:39.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.282+0000 7f3e3051b640 1 -- 172.21.15.172:0/805503912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e28073990 con 0x7f3e2815a790 2024-04-25T08:46:39.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.283+0000 7f3e1effd640 1 -- 172.21.15.172:0/805503912 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17203 (secure 0 0 0) 0x7f3e2407a920 con 0x7f3e2815a790 2024-04-25T08:46:39.275 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:39.275 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":69,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:19.498396+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:07.009926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:07.764108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/611108095":"2024-04-26T08:46:19.498370+0000","172.21.15.172:6834/611108095":"2024-04-26T08:46:19.498370+0000","172.21.15.186:6834/550125910":"2024-04-26T08:46:18.498889+0000","172.21.15.186:6832/550125910":"2024-04-26T08:46:18.498889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:39.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 -- 172.21.15.172:0/805503912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e0c06b4d0 msgr2=0x7f3e0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e0c06b4d0 0x7f3e0c06d990 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009ac0 tx=0x7f3e20008040 comp rx=0 tx=0).stop 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 -- 172.21.15.172:0/805503912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e2815a790 msgr2=0x7f3e280cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e2815a790 0x7f3e280cfd40 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009eb0 tx=0x7f3e24004a40 comp rx=0 tx=0).stop 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 -- 172.21.15.172:0/805503912 shutdown_connections 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e0c06b4d0 0x7f3e0c06d990 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e280b4eb0 0x7f3e280ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e2815a790 0x7f3e280cfd40 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 --2- 172.21.15.172:0/805503912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e2806fea0 0x7f3e28145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 -- 172.21.15.172:0/805503912 >> 172.21.15.172:0/805503912 conn(0x7f3e280b2370 msgr2=0x7f3e280af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 -- 172.21.15.172:0/805503912 shutdown_connections 2024-04-25T08:46:39.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.285+0000 7f3e3051b640 1 -- 172.21.15.172:0/805503912 wait complete. 2024-04-25T08:46:39.287 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:46:39.287 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:39.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.392+0000 7fc695a07640 1 Processor -- start 2024-04-25T08:46:39.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.392+0000 7fc695a07640 1 -- start start 2024-04-25T08:46:39.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc695a07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 0x7fc69009a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc695a07640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6901602e0 0x7fc6900ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc695a07640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc69015f5f0 0x7fc69015faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc695a07640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900cd710 con 0x7fc6901602e0 2024-04-25T08:46:39.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc695a07640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc690099b70 con 0x7fc69015f5f0 2024-04-25T08:46:39.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc695a07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc690099e50 con 0x7fc69015ba00 2024-04-25T08:46:39.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc68e7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6901602e0 0x7fc6900ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc68e7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6901602e0 0x7fc6900ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48406/0 (socket says 172.21.15.172:48406) 2024-04-25T08:46:39.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc68e7fc640 1 -- 172.21.15.172:0/23844290 learned_addr learned my addr 172.21.15.172:0/23844290 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:39.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc68effd640 1 --2- 172.21.15.172:0/23844290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 0x7fc69009a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.393+0000 7fc68f7fe640 1 --2- 172.21.15.172:0/23844290 >> v2:172.21.15.186:3300/0 conn(0x7fc69015f5f0 0x7fc69015faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.394+0000 7fc68e7fc640 1 -- 172.21.15.172:0/23844290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 msgr2=0x7fc69009a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:39.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.394+0000 7fc68e7fc640 1 --2- 172.21.15.172:0/23844290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 0x7fc69009a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.394+0000 7fc68e7fc640 1 -- 172.21.15.172:0/23844290 >> v2:172.21.15.186:3300/0 conn(0x7fc69015f5f0 msgr2=0x7fc69015faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:39.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.394+0000 7fc68e7fc640 1 --2- 172.21.15.172:0/23844290 >> v2:172.21.15.186:3300/0 conn(0x7fc69015f5f0 0x7fc69015faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.394+0000 7fc68e7fc640 1 -- 172.21.15.172:0/23844290 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69009a130 con 0x7fc6901602e0 2024-04-25T08:46:39.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.394+0000 7fc68f7fe640 1 --2- 172.21.15.172:0/23844290 >> v2:172.21.15.186:3300/0 conn(0x7fc69015f5f0 0x7fc69015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.394+0000 7fc68e7fc640 1 --2- 172.21.15.172:0/23844290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 0x7fc6900ccda0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fc6900cbd10 tx=0x7fc68402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48f69465456ec67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.394+0000 7fc68dffb640 1 -- 172.21.15.172:0/23844290 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684037070 con 0x7fc6901602e0 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc68dffb640 1 -- 172.21.15.172:0/23844290 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68402ae00 con 0x7fc6901602e0 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc68dffb640 1 -- 172.21.15.172:0/23844290 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684032660 con 0x7fc6901602e0 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc695a07640 1 -- 172.21.15.172:0/23844290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 msgr2=0x7fc6900ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc695a07640 1 --2- 172.21.15.172:0/23844290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 0x7fc6900ccda0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fc6900cbd10 tx=0x7fc68402a0b0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc695a07640 1 -- 172.21.15.172:0/23844290 shutdown_connections 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc695a07640 1 --2- 172.21.15.172:0/23844290 >> v2:172.21.15.186:3300/0 conn(0x7fc69015f5f0 0x7fc69015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc695a07640 1 --2- 172.21.15.172:0/23844290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 0x7fc6900ccda0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc695a07640 1 --2- 172.21.15.172:0/23844290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 0x7fc69009a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc695a07640 1 -- 172.21.15.172:0/23844290 >> 172.21.15.172:0/23844290 conn(0x7fc6900b3270 msgr2=0x7fc6900b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc695a07640 1 -- 172.21.15.172:0/23844290 shutdown_connections 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.395+0000 7fc695a07640 1 -- 172.21.15.172:0/23844290 wait complete. 2024-04-25T08:46:39.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.396+0000 7fc695a07640 1 Processor -- start 2024-04-25T08:46:39.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.396+0000 7fc695a07640 1 -- start start 2024-04-25T08:46:39.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc695a07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 0x7fc69009d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc695a07640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69015f5f0 0x7fc69009ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc695a07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 0x7fc69009bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc695a07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69015bde0 con 0x7fc6901602e0 2024-04-25T08:46:39.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc695a07640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900cd2e0 con 0x7fc69015f5f0 2024-04-25T08:46:39.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc695a07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69009de80 con 0x7fc69015ba00 2024-04-25T08:46:39.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc68f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 0x7fc69009bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc68f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 0x7fc69009bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48408/0 (socket says 172.21.15.172:48408) 2024-04-25T08:46:39.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc68f7fe640 1 -- 172.21.15.172:0/4068042438 learned_addr learned my addr 172.21.15.172:0/4068042438 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:39.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc68effd640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 0x7fc69009d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc68e7fc640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69015f5f0 0x7fc69009ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc68f7fe640 1 -- 172.21.15.172:0/4068042438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 msgr2=0x7fc69009d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc68f7fe640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 0x7fc69009d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc68f7fe640 1 -- 172.21.15.172:0/4068042438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69015f5f0 msgr2=0x7fc69009ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.397+0000 7fc68f7fe640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69015f5f0 0x7fc69009ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.398+0000 7fc68f7fe640 1 -- 172.21.15.172:0/4068042438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69009e160 con 0x7fc6901602e0 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.398+0000 7fc68effd640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 0x7fc69009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.398+0000 7fc68e7fc640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69015f5f0 0x7fc69009ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.398+0000 7fc68f7fe640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 0x7fc69009bf80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fc68800d7d0 tx=0x7fc68800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.398+0000 7fc677fff640 1 -- 172.21.15.172:0/4068042438 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688004030 con 0x7fc6901602e0 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.398+0000 7fc677fff640 1 -- 172.21.15.172:0/4068042438 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6880041d0 con 0x7fc6901602e0 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.398+0000 7fc695a07640 1 -- 172.21.15.172:0/4068042438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69009e440 con 0x7fc6901602e0 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.398+0000 7fc677fff640 1 -- 172.21.15.172:0/4068042438 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6880096a0 con 0x7fc6901602e0 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.398+0000 7fc695a07640 1 -- 172.21.15.172:0/4068042438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69009ea00 con 0x7fc6901602e0 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.399+0000 7fc695a07640 1 -- 172.21.15.172:0/4068042438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc690073990 con 0x7fc6901602e0 2024-04-25T08:46:39.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.399+0000 7fc677fff640 1 -- 172.21.15.172:0/4068042438 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc688009840 con 0x7fc6901602e0 2024-04-25T08:46:39.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.400+0000 7fc677fff640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc67c06b4d0 0x7fc67c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.400+0000 7fc68effd640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc67c06b4d0 0x7fc67c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.400+0000 7fc677fff640 1 -- 172.21.15.172:0/4068042438 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fc68808a750 con 0x7fc6901602e0 2024-04-25T08:46:39.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.400+0000 7fc68effd640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc67c06b4d0 0x7fc67c06d990 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc6900cb140 tx=0x7fc68000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:39.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.404+0000 7fc677fff640 1 -- 172.21.15.172:0/4068042438 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc688059420 con 0x7fc6901602e0 2024-04-25T08:46:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.610+0000 7fc695a07640 1 -- 172.21.15.172:0/4068042438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6900b40a0 con 0x7fc6901602e0 2024-04-25T08:46:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.611+0000 7fc677fff640 1 -- 172.21.15.172:0/4068042438 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fc688058d20 con 0x7fc6901602e0 2024-04-25T08:46:39.602 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:39.602 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":42,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/384277594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":384277594},{"type":"v1","addr":"172.21.15.186:6833","nonce":384277594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/842443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":842443},{"type":"v1","addr":"172.21.15.186:6835","nonce":842443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2655968938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2655968938},{"type":"v1","addr":"172.21.15.172:6837","nonce":2655968938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:08.789050+0000","modified":"2024-04-25T08:46:21.527505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6835/311149179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":311149179},{"type":"v1","addr":"172.21.15.172:6835","nonce":311149179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:46:39.603 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 42 2024-04-25T08:46:39.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 -- 172.21.15.172:0/4068042438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc67c06b4d0 msgr2=0x7fc67c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc67c06b4d0 0x7fc67c06d990 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc6900cb140 tx=0x7fc68000b040 comp rx=0 tx=0).stop 2024-04-25T08:46:39.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 -- 172.21.15.172:0/4068042438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 msgr2=0x7fc69009bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 0x7fc69009bf80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fc68800d7d0 tx=0x7fc68800dc90 comp rx=0 tx=0).stop 2024-04-25T08:46:39.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 -- 172.21.15.172:0/4068042438 shutdown_connections 2024-04-25T08:46:39.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc67c06b4d0 0x7fc67c06d990 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69015f5f0 0x7fc69009ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6901602e0 0x7fc69009bf80 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 --2- 172.21.15.172:0/4068042438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69015ba00 0x7fc69009d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 -- 172.21.15.172:0/4068042438 >> 172.21.15.172:0/4068042438 conn(0x7fc6900b3270 msgr2=0x7fc6900cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:39.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 -- 172.21.15.172:0/4068042438 shutdown_connections 2024-04-25T08:46:39.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.613+0000 7fc695a07640 1 -- 172.21.15.172:0/4068042438 wait complete. 2024-04-25T08:46:39.615 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:39.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.721+0000 7fc5b7e12640 1 Processor -- start 2024-04-25T08:46:39.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.721+0000 7fc5b7e12640 1 -- start start 2024-04-25T08:46:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.722+0000 7fc5b7e12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 0x7fc5b00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.722+0000 7fc5b7e12640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc5b00b37f0 0x7fc5b00b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.722+0000 7fc5b7e12640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b00ace70 con 0x7fc5b00b41b0 2024-04-25T08:46:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.722+0000 7fc5b7e12640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b006df30 con 0x7fc5b00b37f0 2024-04-25T08:46:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.722+0000 7fc5b7e12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00726d0 con 0x7fc5b00b3410 2024-04-25T08:46:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.722+0000 7fc5b5bae640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 0x7fc5b00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.722+0000 7fc5b53ad640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc5b00b37f0 0x7fc5b00b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.722+0000 7fc5b63af640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fc5b00b41b0 0x7fc5b0161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:52228/0 (socket says 172.21.15.172:52228) 2024-04-25T08:46:39.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.722+0000 7fc5b63af640 1 -- 172.21.15.172:0/1727181077 learned_addr learned my addr 172.21.15.172:0/1727181077 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:39.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.723+0000 7fc5b5bae640 1 -- 172.21.15.172:0/1727181077 >> v2:172.21.15.186:3300/0 conn(0x7fc5b00b37f0 msgr2=0x7fc5b00b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:39.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.723+0000 7fc5b5bae640 1 --2- 172.21.15.172:0/1727181077 >> v2:172.21.15.186:3300/0 conn(0x7fc5b00b37f0 0x7fc5b00b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.723+0000 7fc5b5bae640 1 -- 172.21.15.172:0/1727181077 >> v1:172.21.15.186:6789/0 conn(0x7fc5b00b41b0 legacy=0x7fc5b0161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.723+0000 7fc5b5bae640 1 -- 172.21.15.172:0/1727181077 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b006d8e0 con 0x7fc5b00b3410 2024-04-25T08:46:39.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.723+0000 7fc5b4bac640 1 -- 172.21.15.172:0/1727181077 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411035668 0 0) 0x7fc5a8001490 con 0x7fc5b00b41b0 2024-04-25T08:46:39.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.723+0000 7fc5b53ad640 1 --2- 172.21.15.172:0/1727181077 >> v2:172.21.15.186:3300/0 conn(0x7fc5b00b37f0 0x7fc5b00b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:39.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.723+0000 7fc5b5bae640 1 --2- 172.21.15.172:0/1727181077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 0x7fc5b00720f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0097a0 tx=0x7fc5ac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2055563a83cb80e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:39.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b4bac640 1 -- 172.21.15.172:0/1727181077 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac037070 con 0x7fc5b00b3410 2024-04-25T08:46:39.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b4bac640 1 -- 172.21.15.172:0/1727181077 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac032440 con 0x7fc5b00b3410 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b4bac640 1 -- 172.21.15.172:0/1727181077 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac032810 con 0x7fc5b00b3410 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b7e12640 1 -- 172.21.15.172:0/1727181077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 msgr2=0x7fc5b00720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b7e12640 1 --2- 172.21.15.172:0/1727181077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 0x7fc5b00720f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0097a0 tx=0x7fc5ac02a180 comp rx=0 tx=0).stop 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b7e12640 1 -- 172.21.15.172:0/1727181077 shutdown_connections 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b7e12640 1 --2- 172.21.15.172:0/1727181077 >> v2:172.21.15.186:3300/0 conn(0x7fc5b00b37f0 0x7fc5b00b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b7e12640 1 --2- 172.21.15.172:0/1727181077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 0x7fc5b00720f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b7e12640 1 -- 172.21.15.172:0/1727181077 >> 172.21.15.172:0/1727181077 conn(0x7fc5b00cfae0 msgr2=0x7fc5b00cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b7e12640 1 -- 172.21.15.172:0/1727181077 shutdown_connections 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.724+0000 7fc5b7e12640 1 -- 172.21.15.172:0/1727181077 wait complete. 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.725+0000 7fc5b7e12640 1 Processor -- start 2024-04-25T08:46:39.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.725+0000 7fc5b7e12640 1 -- start start 2024-04-25T08:46:39.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b7e12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 0x7fc5b01459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b7e12640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5b00b37f0 0x7fc5b0143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b7e12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5b00b41b0 0x7fc5b015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b7e12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b006f3d0 con 0x7fc5b00b41b0 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b7e12640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b0147890 con 0x7fc5b00b37f0 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b7e12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b006f550 con 0x7fc5b00b3410 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b63af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5b00b41b0 0x7fc5b015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b63af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5b00b41b0 0x7fc5b015d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48422/0 (socket says 172.21.15.172:48422) 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b63af640 1 -- 172.21.15.172:0/3526420610 learned_addr learned my addr 172.21.15.172:0/3526420610 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b5bae640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 0x7fc5b01459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.726+0000 7fc5b53ad640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5b00b37f0 0x7fc5b0143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5b63af640 1 -- 172.21.15.172:0/3526420610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 msgr2=0x7fc5b01459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5b63af640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 0x7fc5b01459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5b63af640 1 -- 172.21.15.172:0/3526420610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5b00b37f0 msgr2=0x7fc5b0143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5b63af640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5b00b37f0 0x7fc5b0143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5b63af640 1 -- 172.21.15.172:0/3526420610 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b013f280 con 0x7fc5b00b41b0 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5b63af640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5b00b41b0 0x7fc5b015d730 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800c730 tx=0x7fc5a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5a67fc640 1 -- 172.21.15.172:0/3526420610 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8018070 con 0x7fc5b00b41b0 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5a67fc640 1 -- 172.21.15.172:0/3526420610 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a800ce40 con 0x7fc5b00b41b0 2024-04-25T08:46:39.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5a67fc640 1 -- 172.21.15.172:0/3526420610 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a800a800 con 0x7fc5b00b41b0 2024-04-25T08:46:39.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5b7e12640 1 -- 172.21.15.172:0/3526420610 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b015dc70 con 0x7fc5b00b41b0 2024-04-25T08:46:39.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.727+0000 7fc5b7e12640 1 -- 172.21.15.172:0/3526420610 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b0145fd0 con 0x7fc5b00b41b0 2024-04-25T08:46:39.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.728+0000 7fc5b7e12640 1 -- 172.21.15.172:0/3526420610 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b00b4830 con 0x7fc5b00b41b0 2024-04-25T08:46:39.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.728+0000 7fc5a67fc640 1 -- 172.21.15.172:0/3526420610 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc5a801b070 con 0x7fc5b00b41b0 2024-04-25T08:46:39.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.729+0000 7fc5a67fc640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc59406b4d0 0x7fc59406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:39.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.729+0000 7fc5b5bae640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc59406b4d0 0x7fc59406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:39.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.729+0000 7fc5a67fc640 1 -- 172.21.15.172:0/3526420610 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fc5a80898b0 con 0x7fc5b00b41b0 2024-04-25T08:46:39.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.729+0000 7fc5b5bae640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc59406b4d0 0x7fc59406d990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac034000 tx=0x7fc5ac02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:39.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.733+0000 7fc5a67fc640 1 -- 172.21.15.172:0/3526420610 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5b00b4830 con 0x7fc5b00b41b0 2024-04-25T08:46:39.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.941+0000 7fc5b7e12640 1 -- 172.21.15.172:0/3526420610 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5b00b5b30 con 0x7fc5b00b41b0 2024-04-25T08:46:39.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.941+0000 7fc5a67fc640 1 -- 172.21.15.172:0/3526420610 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4934 (secure 0 0 0) 0x7fc5b00b5b30 con 0x7fc5b00b41b0 2024-04-25T08:46:39.933 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:39.933 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":42,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/384277594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":384277594},{"type":"v1","addr":"172.21.15.186:6833","nonce":384277594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/842443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":842443},{"type":"v1","addr":"172.21.15.186:6835","nonce":842443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2655968938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2655968938},{"type":"v1","addr":"172.21.15.172:6837","nonce":2655968938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:08.789050+0000","modified":"2024-04-25T08:46:21.527505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6960},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6960":{"gid":6960,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6835/311149179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":311149179},{"type":"v1","addr":"172.21.15.172:6835","nonce":311149179}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T08:46:39.933 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 42 2024-04-25T08:46:39.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.943+0000 7fc5b7e12640 1 -- 172.21.15.172:0/3526420610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc59406b4d0 msgr2=0x7fc59406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.943+0000 7fc5b7e12640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc59406b4d0 0x7fc59406d990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac034000 tx=0x7fc5ac02e000 comp rx=0 tx=0).stop 2024-04-25T08:46:39.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.943+0000 7fc5b7e12640 1 -- 172.21.15.172:0/3526420610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5b00b41b0 msgr2=0x7fc5b015d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:39.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.943+0000 7fc5b7e12640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5b00b41b0 0x7fc5b015d730 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800c730 tx=0x7fc5a800cbf0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.943+0000 7fc5b7e12640 1 -- 172.21.15.172:0/3526420610 shutdown_connections 2024-04-25T08:46:39.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.943+0000 7fc5b7e12640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc59406b4d0 0x7fc59406d990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.943+0000 7fc5b7e12640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5b00b37f0 0x7fc5b0143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.943+0000 7fc5b7e12640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5b00b41b0 0x7fc5b015d730 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.943+0000 7fc5b7e12640 1 --2- 172.21.15.172:0/3526420610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5b00b3410 0x7fc5b01459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:39.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.943+0000 7fc5b7e12640 1 -- 172.21.15.172:0/3526420610 >> 172.21.15.172:0/3526420610 conn(0x7fc5b00cfae0 msgr2=0x7fc5b006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:39.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.944+0000 7fc5b7e12640 1 -- 172.21.15.172:0/3526420610 shutdown_connections 2024-04-25T08:46:39.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:39.944+0000 7fc5b7e12640 1 -- 172.21.15.172:0/3526420610 wait complete. 2024-04-25T08:46:39.946 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:40.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.052+0000 7f8ddd95c640 1 Processor -- start 2024-04-25T08:46:40.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.052+0000 7f8ddd95c640 1 -- start start 2024-04-25T08:46:40.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8ddd95c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8dd815db70 0x7f8dd8162150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8ddd95c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8dd80b6cb0 0x7f8dd80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8ddd95c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd8162690 con 0x7f8dd80b5a60 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8ddd95c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd80d3800 con 0x7f8dd815db70 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8ddd95c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd80ceee0 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8dd6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8dd815db70 0x7f8dd8162150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8dd6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8dd815db70 0x7f8dd8162150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48426/0 (socket says 172.21.15.172:48426) 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8dd6ffd640 1 -- 172.21.15.172:0/562665399 learned_addr learned my addr 172.21.15.172:0/562665399 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8dd67fc640 1 --2- 172.21.15.172:0/562665399 >> v2:172.21.15.186:3300/0 conn(0x7f8dd80b6cb0 0x7f8dd80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8dd6ffd640 1 -- 172.21.15.172:0/562665399 >> v2:172.21.15.186:3300/0 conn(0x7f8dd80b6cb0 msgr2=0x7f8dd80b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8dd6ffd640 1 --2- 172.21.15.172:0/562665399 >> v2:172.21.15.186:3300/0 conn(0x7f8dd80b6cb0 0x7f8dd80b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8dd6ffd640 1 -- 172.21.15.172:0/562665399 >> v1:172.21.15.186:6789/0 conn(0x7f8dd80b5a60 legacy=0x7f8dd806c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8dd6ffd640 1 -- 172.21.15.172:0/562665399 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd80d1d10 con 0x7f8dd815db70 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.053+0000 7f8dd67fc640 1 --2- 172.21.15.172:0/562665399 >> v2:172.21.15.186:3300/0 conn(0x7f8dd80b6cb0 0x7f8dd80b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.054+0000 7f8dd6ffd640 1 --2- 172.21.15.172:0/562665399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd815db70 0x7f8dd8162150 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80d3980 tx=0x7f8dc802a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75751f54e2e5900 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:40.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.054+0000 7f8dd5ffb640 1 -- 172.21.15.172:0/562665399 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8036070 con 0x7f8dd815db70 2024-04-25T08:46:40.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.054+0000 7f8dd5ffb640 1 -- 172.21.15.172:0/562665399 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8031600 con 0x7f8dd815db70 2024-04-25T08:46:40.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.054+0000 7f8dd5ffb640 1 -- 172.21.15.172:0/562665399 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80319d0 con 0x7f8dd815db70 2024-04-25T08:46:40.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.055+0000 7f8ddd95c640 1 -- 172.21.15.172:0/562665399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd815db70 msgr2=0x7f8dd8162150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.055+0000 7f8ddd95c640 1 --2- 172.21.15.172:0/562665399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd815db70 0x7f8dd8162150 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80d3980 tx=0x7f8dc802a640 comp rx=0 tx=0).stop 2024-04-25T08:46:40.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.055+0000 7f8ddd95c640 1 -- 172.21.15.172:0/562665399 shutdown_connections 2024-04-25T08:46:40.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.055+0000 7f8ddd95c640 1 --2- 172.21.15.172:0/562665399 >> v2:172.21.15.186:3300/0 conn(0x7f8dd80b6cb0 0x7f8dd80b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.055+0000 7f8ddd95c640 1 --2- 172.21.15.172:0/562665399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd815db70 0x7f8dd8162150 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.055+0000 7f8ddd95c640 1 -- 172.21.15.172:0/562665399 >> 172.21.15.172:0/562665399 conn(0x7f8dd80d0520 msgr2=0x7f8dd80d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:40.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.055+0000 7f8ddd95c640 1 -- 172.21.15.172:0/562665399 shutdown_connections 2024-04-25T08:46:40.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.055+0000 7f8ddd95c640 1 -- 172.21.15.172:0/562665399 wait complete. 2024-04-25T08:46:40.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.056+0000 7f8ddd95c640 1 Processor -- start 2024-04-25T08:46:40.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.056+0000 7f8ddd95c640 1 -- start start 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8ddd95c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dd80b5a60 0x7f8dd8158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8ddd95c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd80b6cb0 0x7f8dd815ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8ddd95c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dd815db70 0x7f8dd8151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8ddd95c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd815df50 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8ddd95c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80d22d0 con 0x7f8dd815db70 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8ddd95c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80ce530 con 0x7f8dd80b5a60 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd67fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd80b6cb0 0x7f8dd815ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd67fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd80b6cb0 0x7f8dd815ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48440/0 (socket says 172.21.15.172:48440) 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd67fc640 1 -- 172.21.15.172:0/3362443992 learned_addr learned my addr 172.21.15.172:0/3362443992 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd6ffd640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dd80b5a60 0x7f8dd8158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd77fe640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dd815db70 0x7f8dd8151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd67fc640 1 -- 172.21.15.172:0/3362443992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dd80b5a60 msgr2=0x7f8dd8158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd67fc640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dd80b5a60 0x7f8dd8158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd67fc640 1 -- 172.21.15.172:0/3362443992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dd815db70 msgr2=0x7f8dd8151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd67fc640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dd815db70 0x7f8dd8151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd67fc640 1 -- 172.21.15.172:0/3362443992 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd81556b0 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd77fe640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dd815db70 0x7f8dd8151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.057+0000 7f8dd6ffd640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dd80b5a60 0x7f8dd8158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.058+0000 7f8dd67fc640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd80b6cb0 0x7f8dd815ec30 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00c7f0 tx=0x7f8dcc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.058+0000 7f8dbffff640 1 -- 172.21.15.172:0/3362443992 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc015070 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.058+0000 7f8dbffff640 1 -- 172.21.15.172:0/3362443992 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc007a30 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.058+0000 7f8ddd95c640 1 -- 172.21.15.172:0/3362443992 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd8161050 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.058+0000 7f8dbffff640 1 -- 172.21.15.172:0/3362443992 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc007e00 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.058+0000 7f8ddd95c640 1 -- 172.21.15.172:0/3362443992 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd8160d00 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.059+0000 7f8ddd95c640 1 -- 172.21.15.172:0/3362443992 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd8073990 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.059+0000 7f8dbffff640 1 -- 172.21.15.172:0/3362443992 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8dcc018070 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.059+0000 7f8dbffff640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8dc406b4d0 0x7f8dc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.059+0000 7f8dbffff640 1 -- 172.21.15.172:0/3362443992 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f8dcc08a370 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.059+0000 7f8dd6ffd640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8dc406b4d0 0x7f8dc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.060+0000 7f8dd6ffd640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8dc406b4d0 0x7f8dc406d990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8033000 tx=0x7f8dc8009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:40.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.064+0000 7f8dbffff640 1 -- 172.21.15.172:0/3362443992 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8dcc059040 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.234+0000 7f8ddd95c640 1 -- 172.21.15.172:0/3362443992 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dd8158f60 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.235+0000 7f8dbffff640 1 -- 172.21.15.172:0/3362443992 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17203 (secure 0 0 0) 0x7f8dcc058940 con 0x7f8dd80b6cb0 2024-04-25T08:46:40.227 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:40.227 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":69,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:19.498396+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:07.009926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:07.764108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/611108095":"2024-04-26T08:46:19.498370+0000","172.21.15.172:6834/611108095":"2024-04-26T08:46:19.498370+0000","172.21.15.186:6834/550125910":"2024-04-26T08:46:18.498889+0000","172.21.15.186:6832/550125910":"2024-04-26T08:46:18.498889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:40.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.237+0000 7f8ddd95c640 1 -- 172.21.15.172:0/3362443992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8dc406b4d0 msgr2=0x7f8dc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.237+0000 7f8ddd95c640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8dc406b4d0 0x7f8dc406d990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8033000 tx=0x7f8dc8009000 comp rx=0 tx=0).stop 2024-04-25T08:46:40.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.237+0000 7f8ddd95c640 1 -- 172.21.15.172:0/3362443992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd80b6cb0 msgr2=0x7f8dd815ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.237+0000 7f8ddd95c640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd80b6cb0 0x7f8dd815ec30 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00c7f0 tx=0x7f8dcc00ccb0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.237+0000 7f8ddd95c640 1 -- 172.21.15.172:0/3362443992 shutdown_connections 2024-04-25T08:46:40.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.238+0000 7f8ddd95c640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8dc406b4d0 0x7f8dc406d990 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.238+0000 7f8ddd95c640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dd815db70 0x7f8dd8151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.238+0000 7f8ddd95c640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dd80b6cb0 0x7f8dd815ec30 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.238+0000 7f8ddd95c640 1 --2- 172.21.15.172:0/3362443992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dd80b5a60 0x7f8dd8158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.238+0000 7f8ddd95c640 1 -- 172.21.15.172:0/3362443992 >> 172.21.15.172:0/3362443992 conn(0x7f8dd80d0520 msgr2=0x7f8dd80b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:40.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.238+0000 7f8ddd95c640 1 -- 172.21.15.172:0/3362443992 shutdown_connections 2024-04-25T08:46:40.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.238+0000 7f8ddd95c640 1 -- 172.21.15.172:0/3362443992 wait complete. 2024-04-25T08:46:40.240 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:46:40.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.346+0000 7f291146a640 1 Processor -- start 2024-04-25T08:46:40.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.346+0000 7f291146a640 1 -- start start 2024-04-25T08:46:40.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f291146a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f290c15dc20 0x7f290c0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f291146a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c161710 0x7f290c0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f291146a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290c15e000 con 0x7f290c0b9330 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f291146a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290c0d1de0 con 0x7f290c15dc20 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f291146a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290c161c60 con 0x7f290c161710 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f290affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f290c15dc20 0x7f290c0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f290b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f290c0b9330 0x7f290c06bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58318/0 (socket says 172.21.15.172:58318) 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f290affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f290c15dc20 0x7f290c0ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48444/0 (socket says 172.21.15.172:48444) 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f290b7fe640 1 -- 172.21.15.172:0/597659858 learned_addr learned my addr 172.21.15.172:0/597659858 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f290affd640 1 -- 172.21.15.172:0/597659858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c161710 msgr2=0x7f290c0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f290affd640 1 --2- 172.21.15.172:0/597659858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c161710 0x7f290c0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f290affd640 1 -- 172.21.15.172:0/597659858 >> v1:172.21.15.172:6789/0 conn(0x7f290c0b9330 legacy=0x7f290c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f290affd640 1 -- 172.21.15.172:0/597659858 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c161f40 con 0x7f290c15dc20 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.347+0000 7f2909ffb640 1 -- 172.21.15.172:0/597659858 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081358739 0 0) 0x7f290c15e000 con 0x7f290c0b9330 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.348+0000 7f290affd640 1 --2- 172.21.15.172:0/597659858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c15dc20 0x7f290c0ce670 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0097a0 tx=0x7f28fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7b4fd14b80148f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.348+0000 7f2909ffb640 1 -- 172.21.15.172:0/597659858 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc037070 con 0x7f290c15dc20 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.348+0000 7f2909ffb640 1 -- 172.21.15.172:0/597659858 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc032440 con 0x7f290c15dc20 2024-04-25T08:46:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.348+0000 7f2909ffb640 1 -- 172.21.15.172:0/597659858 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc032810 con 0x7f290c15dc20 2024-04-25T08:46:40.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.349+0000 7f291146a640 1 -- 172.21.15.172:0/597659858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c15dc20 msgr2=0x7f290c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.349+0000 7f291146a640 1 --2- 172.21.15.172:0/597659858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c15dc20 0x7f290c0ce670 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0097a0 tx=0x7f28fc02a180 comp rx=0 tx=0).stop 2024-04-25T08:46:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.349+0000 7f291146a640 1 -- 172.21.15.172:0/597659858 shutdown_connections 2024-04-25T08:46:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.349+0000 7f291146a640 1 --2- 172.21.15.172:0/597659858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c161710 0x7f290c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.349+0000 7f291146a640 1 --2- 172.21.15.172:0/597659858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c15dc20 0x7f290c0ce670 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.349+0000 7f291146a640 1 -- 172.21.15.172:0/597659858 >> 172.21.15.172:0/597659858 conn(0x7f290c0d0420 msgr2=0x7f290c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.349+0000 7f291146a640 1 -- 172.21.15.172:0/597659858 shutdown_connections 2024-04-25T08:46:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.349+0000 7f291146a640 1 -- 172.21.15.172:0/597659858 wait complete. 2024-04-25T08:46:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.350+0000 7f291146a640 1 Processor -- start 2024-04-25T08:46:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.350+0000 7f291146a640 1 -- start start 2024-04-25T08:46:40.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f291146a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c0b9330 0x7f290c0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f291146a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c15dc20 0x7f290c160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f291146a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c161710 0x7f290c148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f291146a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c0b5e50 con 0x7f290c161710 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f291146a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c162500 con 0x7f290c0b9330 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f291146a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290c0b5fd0 con 0x7f290c15dc20 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c161710 0x7f290c148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c161710 0x7f290c148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48448/0 (socket says 172.21.15.172:48448) 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290b7fe640 1 -- 172.21.15.172:0/3890214919 learned_addr learned my addr 172.21.15.172:0/3890214919 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290affd640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c0b9330 0x7f290c0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290b7fe640 1 -- 172.21.15.172:0/3890214919 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c15dc20 msgr2=0x7f290c160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290a7fc640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c15dc20 0x7f290c160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290b7fe640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c15dc20 0x7f290c160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290b7fe640 1 -- 172.21.15.172:0/3890214919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c0b9330 msgr2=0x7f290c0cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290b7fe640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c0b9330 0x7f290c0cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290b7fe640 1 -- 172.21.15.172:0/3890214919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c15fcb0 con 0x7f290c161710 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290affd640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c0b9330 0x7f290c0cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290a7fc640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c15dc20 0x7f290c160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:40.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f290b7fe640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c161710 0x7f290c148bf0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f290400c780 tx=0x7f290400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f28f37fe640 1 -- 172.21.15.172:0/3890214919 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904018070 con 0x7f290c161710 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f28f37fe640 1 -- 172.21.15.172:0/3890214919 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290400ce30 con 0x7f290c161710 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f291146a640 1 -- 172.21.15.172:0/3890214919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290c157870 con 0x7f290c161710 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f28f37fe640 1 -- 172.21.15.172:0/3890214919 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290400a840 con 0x7f290c161710 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.351+0000 7f291146a640 1 -- 172.21.15.172:0/3890214919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290c0cd990 con 0x7f290c161710 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.353+0000 7f291146a640 1 -- 172.21.15.172:0/3890214919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290c073a00 con 0x7f290c161710 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.353+0000 7f28f37fe640 1 -- 172.21.15.172:0/3890214919 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f290401b070 con 0x7f290c161710 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.353+0000 7f28f37fe640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28f806b4d0 0x7f28f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.353+0000 7f28f37fe640 1 -- 172.21.15.172:0/3890214919 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f2904089940 con 0x7f290c161710 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.353+0000 7f290affd640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28f806b4d0 0x7f28f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.354+0000 7f290affd640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28f806b4d0 0x7f28f806d990 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f28fc034000 tx=0x7f28fc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:40.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.357+0000 7f28f37fe640 1 -- 172.21.15.172:0/3890214919 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2904058610 con 0x7f290c161710 2024-04-25T08:46:40.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.569+0000 7f291146a640 1 -- 172.21.15.172:0/3890214919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f290c0d16b0 con 0x7f290c161710 2024-04-25T08:46:40.561 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:46:40.570+0000 7f9412b2f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:46:40.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.571+0000 7f28f37fe640 1 -- 172.21.15.172:0/3890214919 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2904057f10 con 0x7f290c161710 2024-04-25T08:46:40.563 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 -- 172.21.15.172:0/3890214919 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28f806b4d0 msgr2=0x7f28f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28f806b4d0 0x7f28f806d990 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f28fc034000 tx=0x7f28fc02e000 comp rx=0 tx=0).stop 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 -- 172.21.15.172:0/3890214919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c161710 msgr2=0x7f290c148bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c161710 0x7f290c148bf0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f290400c780 tx=0x7f290400cc40 comp rx=0 tx=0).stop 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 -- 172.21.15.172:0/3890214919 shutdown_connections 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28f806b4d0 0x7f28f806d990 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f290c161710 0x7f290c148bf0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c15dc20 0x7f290c160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 --2- 172.21.15.172:0/3890214919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c0b9330 0x7f290c0cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 -- 172.21.15.172:0/3890214919 >> 172.21.15.172:0/3890214919 conn(0x7f290c0d0420 msgr2=0x7f290c0b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 -- 172.21.15.172:0/3890214919 shutdown_connections 2024-04-25T08:46:40.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.574+0000 7f291146a640 1 -- 172.21.15.172:0/3890214919 wait complete. 2024-04-25T08:46:40.567 INFO:tasks.ceph.mds.a.smithi172.stderr: -2331> 2024-04-25T08:46:24.508+0000 7fbe9eac8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:46:40.577 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:46:40.595 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:46:40.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.688+0000 7fa86b963640 1 Processor -- start 2024-04-25T08:46:40.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.688+0000 7fa86b963640 1 -- start start 2024-04-25T08:46:40.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa86b963640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa864144d20 0x7fa8640ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa86b963640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8640ceba0 con 0x7fa8641454b0 2024-04-25T08:46:40.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa86b963640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8640cee80 con 0x7fa8640714d0 2024-04-25T08:46:40.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa86b963640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8640b4830 con 0x7fa864144d20 2024-04-25T08:46:40.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa868efe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa8641454b0 0x7fa864070dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58326/0 (socket says 172.21.15.172:58326) 2024-04-25T08:46:40.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa868efe640 1 -- 172.21.15.172:0/3033855301 learned_addr learned my addr 172.21.15.172:0/3033855301 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:40.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802703969 0 0) 0x7fa8640ceba0 con 0x7fa8641454b0 2024-04-25T08:46:40.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa850003520 con 0x7fa8641454b0 2024-04-25T08:46:40.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa8696ff640 1 --2- 172.21.15.172:0/3033855301 >> v2:172.21.15.186:3300/0 conn(0x7fa864144d20 0x7fa8640ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 992385943 0 0) 0x7fa850003520 con 0x7fa8641454b0 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 >> v2:172.21.15.186:3300/0 conn(0x7fa864144d20 msgr2=0x7fa8640ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 --2- 172.21.15.172:0/3033855301 >> v2:172.21.15.186:3300/0 conn(0x7fa864144d20 0x7fa8640ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 >> v1:172.21.15.186:6789/0 conn(0x7fa8640714d0 legacy=0x7fa8640b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8640cf160 con 0x7fa8641454b0 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fa854001670 con 0x7fa8641454b0 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 >> v1:172.21.15.172:6789/0 conn(0x7fa8641454b0 legacy=0x7fa864070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8500039b0 0x7fa850003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa850004800 0x7fa850004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.689+0000 7fa85bfff640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8500051c0 0x7fa85000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8640b4830 con 0x7fa850004800 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85000c090 con 0x7fa8500051c0 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85000c290 con 0x7fa8500039b0 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa868efe640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa850004800 0x7fa850004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa869f00640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8500051c0 0x7fa85000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa8696ff640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8500039b0 0x7fa850003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa868efe640 1 -- 172.21.15.172:0/3033855301 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8500039b0 msgr2=0x7fa850003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa868efe640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8500039b0 0x7fa850003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa868efe640 1 -- 172.21.15.172:0/3033855301 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8500051c0 msgr2=0x7fa85000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa868efe640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8500051c0 0x7fa85000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa868efe640 1 -- 172.21.15.172:0/3033855301 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850003520 con 0x7fa850004800 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa869f00640 1 -- 172.21.15.172:0/3033855301 reap_dead start 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.690+0000 7fa8696ff640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8500039b0 0x7fa850003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa868efe640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa850004800 0x7fa850004c80 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa85400c240 tx=0x7fa850005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644d97dfb326f43c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854007cf0 con 0x7fa850004800 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8540058d0 con 0x7fa850004800 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa85bfff640 1 -- 172.21.15.172:0/3033855301 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854005ca0 con 0x7fa850004800 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa86b963640 1 -- 172.21.15.172:0/3033855301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa850004800 msgr2=0x7fa850004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa86b963640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa850004800 0x7fa850004c80 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa85400c240 tx=0x7fa850005830 comp rx=0 tx=0).stop 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa86b963640 1 -- 172.21.15.172:0/3033855301 shutdown_connections 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa86b963640 1 --2- 172.21.15.172:0/3033855301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa850004800 0x7fa850004c80 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa86b963640 1 -- 172.21.15.172:0/3033855301 >> 172.21.15.172:0/3033855301 conn(0x7fa8640b3530 msgr2=0x7fa8640b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:40.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa86b963640 1 -- 172.21.15.172:0/3033855301 shutdown_connections 2024-04-25T08:46:40.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.691+0000 7fa86b963640 1 -- 172.21.15.172:0/3033855301 wait complete. 2024-04-25T08:46:40.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.692+0000 7fa86b963640 1 Processor -- start 2024-04-25T08:46:40.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa86b963640 1 -- start start 2024-04-25T08:46:40.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa86b963640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa850004800 0x7fa8641f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa86b963640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86415a980 0x7fa86415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa86b963640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa86413abc0 0x7fa86413b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa86b963640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa864145280 con 0x7fa86415a980 2024-04-25T08:46:40.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa86b963640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa864145100 con 0x7fa850004800 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa86b963640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa864070dc0 con 0x7fa86413abc0 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa868efe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86415a980 0x7fa86415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa868efe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86415a980 0x7fa86415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48482/0 (socket says 172.21.15.172:48482) 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa868efe640 1 -- 172.21.15.172:0/4162679181 learned_addr learned my addr 172.21.15.172:0/4162679181 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa869f00640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa86413abc0 0x7fa86413b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.693+0000 7fa8696ff640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa850004800 0x7fa8641f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa868efe640 1 -- 172.21.15.172:0/4162679181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa86413abc0 msgr2=0x7fa86413b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa868efe640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa86413abc0 0x7fa86413b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa868efe640 1 -- 172.21.15.172:0/4162679181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa850004800 msgr2=0x7fa8641f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa868efe640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa850004800 0x7fa8641f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa868efe640 1 -- 172.21.15.172:0/4162679181 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86413b590 con 0x7fa86415a980 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa8696ff640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa850004800 0x7fa8641f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa868efe640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86415a980 0x7fa86415ade0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa85400c360 tx=0x7fa8640cf050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa859ffb640 1 -- 172.21.15.172:0/4162679181 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854040030 con 0x7fa86415a980 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa859ffb640 1 -- 172.21.15.172:0/4162679181 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8540049f0 con 0x7fa86415a980 2024-04-25T08:46:40.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa86b963640 1 -- 172.21.15.172:0/4162679181 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86413b840 con 0x7fa86415a980 2024-04-25T08:46:40.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa859ffb640 1 -- 172.21.15.172:0/4162679181 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854007cf0 con 0x7fa86415a980 2024-04-25T08:46:40.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.694+0000 7fa86b963640 1 -- 172.21.15.172:0/4162679181 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa864136db0 con 0x7fa86415a980 2024-04-25T08:46:40.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.695+0000 7fa86b963640 1 -- 172.21.15.172:0/4162679181 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa864073a00 con 0x7fa86415a980 2024-04-25T08:46:40.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.695+0000 7fa859ffb640 1 -- 172.21.15.172:0/4162679181 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa854043070 con 0x7fa86415a980 2024-04-25T08:46:40.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.696+0000 7fa859ffb640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84806b500 0x7fa84806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:40.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.696+0000 7fa859ffb640 1 -- 172.21.15.172:0/4162679181 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fa854038070 con 0x7fa86415a980 2024-04-25T08:46:40.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.696+0000 7fa8696ff640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84806b500 0x7fa84806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:40.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.696+0000 7fa8696ff640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84806b500 0x7fa84806d9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa864068290 tx=0x7fa860008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:40.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.700+0000 7fa859ffb640 1 -- 172.21.15.172:0/4162679181 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa85403b360 con 0x7fa86415a980 2024-04-25T08:46:40.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:40.906+0000 7fa86b963640 1 -- 172.21.15.172:0/4162679181 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa86415bd00 con 0x7fa86415a980 2024-04-25T08:46:41.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.573+0000 7fa859ffb640 1 -- 172.21.15.172:0/4162679181 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa854078970 con 0x7fa86415a980 2024-04-25T08:46:41.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 -- 172.21.15.172:0/4162679181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84806b500 msgr2=0x7fa84806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:41.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84806b500 0x7fa84806d9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa864068290 tx=0x7fa860008040 comp rx=0 tx=0).stop 2024-04-25T08:46:41.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 -- 172.21.15.172:0/4162679181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86415a980 msgr2=0x7fa86415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:41.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86415a980 0x7fa86415ade0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa85400c360 tx=0x7fa8640cf050 comp rx=0 tx=0).stop 2024-04-25T08:46:41.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 -- 172.21.15.172:0/4162679181 shutdown_connections 2024-04-25T08:46:41.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa84806b500 0x7fa84806d9c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:41.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa86413abc0 0x7fa86413b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:41.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86415a980 0x7fa86415ade0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:41.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 --2- 172.21.15.172:0/4162679181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa850004800 0x7fa8641f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:41.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 -- 172.21.15.172:0/4162679181 >> 172.21.15.172:0/4162679181 conn(0x7fa8640b3530 msgr2=0x7fa864141250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:41.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 -- 172.21.15.172:0/4162679181 shutdown_connections 2024-04-25T08:46:41.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.575+0000 7fa86b963640 1 -- 172.21.15.172:0/4162679181 wait complete. 2024-04-25T08:46:41.579 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:46:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.729+0000 7fdf8129e640 1 Processor -- start 2024-04-25T08:46:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.729+0000 7fdf8129e640 1 -- start start 2024-04-25T08:46:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.730+0000 7fdf8129e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c144d50 0x7fdf7c06d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.730+0000 7fdf8129e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdf7c1452a0 0x7fdf7c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.730+0000 7fdf8129e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7c0cccc0 con 0x7fdf7c1446d0 2024-04-25T08:46:41.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.730+0000 7fdf8129e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7c0b2b20 con 0x7fdf7c1452a0 2024-04-25T08:46:41.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.730+0000 7fdf8129e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c06d400 con 0x7fdf7c144d50 2024-04-25T08:46:41.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.730+0000 7fdf7a7fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c144d50 0x7fdf7c06d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.731+0000 7fdf7b7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdf7c1452a0 0x7fdf7c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.731+0000 7fdf7affd640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fdf7c1446d0 0x7fdf7c0b3f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:52264/0 (socket says 172.21.15.172:52264) 2024-04-25T08:46:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.731+0000 7fdf7a7fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c144d50 0x7fdf7c06d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:59620/0 (socket says 172.21.15.172:59620) 2024-04-25T08:46:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.731+0000 7fdf7affd640 1 -- 172.21.15.172:0/2629075739 learned_addr learned my addr 172.21.15.172:0/2629075739 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.731+0000 7fdf7a7fc640 1 -- 172.21.15.172:0/2629075739 >> v2:172.21.15.186:3300/0 conn(0x7fdf7c1452a0 msgr2=0x7fdf7c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.731+0000 7fdf7a7fc640 1 --2- 172.21.15.172:0/2629075739 >> v2:172.21.15.186:3300/0 conn(0x7fdf7c1452a0 0x7fdf7c06ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.731+0000 7fdf7a7fc640 1 -- 172.21.15.172:0/2629075739 >> v1:172.21.15.186:6789/0 conn(0x7fdf7c1446d0 legacy=0x7fdf7c0b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.731+0000 7fdf7a7fc640 1 -- 172.21.15.172:0/2629075739 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0cc140 con 0x7fdf7c144d50 2024-04-25T08:46:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.731+0000 7fdf7b7fe640 1 --2- 172.21.15.172:0/2629075739 >> v2:172.21.15.186:3300/0 conn(0x7fdf7c1452a0 0x7fdf7c06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:41.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf7a7fc640 1 --2- 172.21.15.172:0/2629075739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c144d50 0x7fdf7c06d890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdf700097a0 tx=0x7fdf7002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c4f499941963828 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf79ffb640 1 -- 172.21.15.172:0/2629075739 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70037070 con 0x7fdf7c144d50 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf79ffb640 1 -- 172.21.15.172:0/2629075739 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf70032440 con 0x7fdf7c144d50 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf79ffb640 1 -- 172.21.15.172:0/2629075739 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70032810 con 0x7fdf7c144d50 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf8129e640 1 -- 172.21.15.172:0/2629075739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c144d50 msgr2=0x7fdf7c06d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf8129e640 1 --2- 172.21.15.172:0/2629075739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c144d50 0x7fdf7c06d890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdf700097a0 tx=0x7fdf7002a180 comp rx=0 tx=0).stop 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf8129e640 1 -- 172.21.15.172:0/2629075739 shutdown_connections 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf8129e640 1 --2- 172.21.15.172:0/2629075739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c144d50 0x7fdf7c06d890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf8129e640 1 --2- 172.21.15.172:0/2629075739 >> v2:172.21.15.186:3300/0 conn(0x7fdf7c1452a0 0x7fdf7c06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf8129e640 1 -- 172.21.15.172:0/2629075739 >> 172.21.15.172:0/2629075739 conn(0x7fdf7c06abe0 msgr2=0x7fdf7c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf8129e640 1 -- 172.21.15.172:0/2629075739 shutdown_connections 2024-04-25T08:46:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.732+0000 7fdf8129e640 1 -- 172.21.15.172:0/2629075739 wait complete. 2024-04-25T08:46:41.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.734+0000 7fdf8129e640 1 Processor -- start 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.734+0000 7fdf8129e640 1 -- start start 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.734+0000 7fdf8129e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7c1446d0 0x7fdf7c0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.734+0000 7fdf8129e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf7c144d50 0x7fdf7c1e1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf8129e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c1452a0 0x7fdf7c1e24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf8129e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0cc9e0 con 0x7fdf7c1446d0 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf8129e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0cc700 con 0x7fdf7c144d50 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf8129e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c144ab0 con 0x7fdf7c1452a0 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7c1446d0 0x7fdf7c0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7c1446d0 0x7fdf7c0b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48496/0 (socket says 172.21.15.172:48496) 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7affd640 1 -- 172.21.15.172:0/614581607 learned_addr learned my addr 172.21.15.172:0/614581607 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7a7fc640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf7c144d50 0x7fdf7c1e1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7b7fe640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c1452a0 0x7fdf7c1e24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7affd640 1 -- 172.21.15.172:0/614581607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c1452a0 msgr2=0x7fdf7c1e24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:41.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7affd640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c1452a0 0x7fdf7c1e24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7affd640 1 -- 172.21.15.172:0/614581607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf7c144d50 msgr2=0x7fdf7c1e1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7affd640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf7c144d50 0x7fdf7c1e1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7affd640 1 -- 172.21.15.172:0/614581607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c1e4ac0 con 0x7fdf7c1446d0 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7b7fe640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c1452a0 0x7fdf7c1e24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf7affd640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7c1446d0 0x7fdf7c0b08e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00c430 tx=0x7fdf6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf637fe640 1 -- 172.21.15.172:0/614581607 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c017070 con 0x7fdf7c1446d0 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf637fe640 1 -- 172.21.15.172:0/614581607 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c005ce0 con 0x7fdf7c1446d0 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf8129e640 1 -- 172.21.15.172:0/614581607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c1e0d00 con 0x7fdf7c1446d0 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf637fe640 1 -- 172.21.15.172:0/614581607 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0072f0 con 0x7fdf7c1446d0 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.735+0000 7fdf8129e640 1 -- 172.21.15.172:0/614581607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c1e12c0 con 0x7fdf7c1446d0 2024-04-25T08:46:41.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.736+0000 7fdf8129e640 1 -- 172.21.15.172:0/614581607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7c073a00 con 0x7fdf7c1446d0 2024-04-25T08:46:41.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.737+0000 7fdf637fe640 1 -- 172.21.15.172:0/614581607 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf6c01a070 con 0x7fdf7c1446d0 2024-04-25T08:46:41.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.737+0000 7fdf637fe640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdf6806b4d0 0x7fdf6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:41.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.737+0000 7fdf637fe640 1 -- 172.21.15.172:0/614581607 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6359+0+0 (secure 0 0 0) 0x7fdf6c089800 con 0x7fdf7c1446d0 2024-04-25T08:46:41.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.737+0000 7fdf7a7fc640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdf6806b4d0 0x7fdf6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:41.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.737+0000 7fdf7a7fc640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdf6806b4d0 0x7fdf6806d990 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdf70034000 tx=0x7fdf7002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:41.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.741+0000 7fdf637fe640 1 -- 172.21.15.172:0/614581607 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf6c057da0 con 0x7fdf7c1446d0 2024-04-25T08:46:41.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:41.910+0000 7fdf8129e640 1 -- 172.21.15.172:0/614581607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdf7c142160 con 0x7fdf7c1446d0 2024-04-25T08:46:42.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.661+0000 7fdf637fe640 1 -- 172.21.15.172:0/614581607 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdf6c05be40 con 0x7fdf7c1446d0 2024-04-25T08:46:42.652 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:46:42.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.665+0000 7fdf8129e640 1 -- 172.21.15.172:0/614581607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdf6806b4d0 msgr2=0x7fdf6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:42.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.665+0000 7fdf8129e640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdf6806b4d0 0x7fdf6806d990 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdf70034000 tx=0x7fdf7002e000 comp rx=0 tx=0).stop 2024-04-25T08:46:42.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.665+0000 7fdf8129e640 1 -- 172.21.15.172:0/614581607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7c1446d0 msgr2=0x7fdf7c0b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:42.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.665+0000 7fdf8129e640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7c1446d0 0x7fdf7c0b08e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00c430 tx=0x7fdf6c00c8f0 comp rx=0 tx=0).stop 2024-04-25T08:46:42.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.665+0000 7fdf8129e640 1 -- 172.21.15.172:0/614581607 shutdown_connections 2024-04-25T08:46:42.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.665+0000 7fdf8129e640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdf6806b4d0 0x7fdf6806d990 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:42.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.665+0000 7fdf8129e640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf7c144d50 0x7fdf7c1e1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:42.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.665+0000 7fdf8129e640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf7c1452a0 0x7fdf7c1e24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:42.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.665+0000 7fdf8129e640 1 --2- 172.21.15.172:0/614581607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf7c1446d0 0x7fdf7c0b08e0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:42.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.665+0000 7fdf8129e640 1 -- 172.21.15.172:0/614581607 >> 172.21.15.172:0/614581607 conn(0x7fdf7c06abe0 msgr2=0x7fdf7c0af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:42.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.666+0000 7fdf8129e640 1 -- 172.21.15.172:0/614581607 shutdown_connections 2024-04-25T08:46:42.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.666+0000 7fdf8129e640 1 -- 172.21.15.172:0/614581607 wait complete. 2024-04-25T08:46:42.671 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:46:42.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.786+0000 7fca283b0640 1 Processor -- start 2024-04-25T08:46:42.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.786+0000 7fca283b0640 1 -- start start 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca283b0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2006abe0 0x7fca2006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca283b0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca2015dd80 0x7fca200b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca283b0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2006b500 con 0x7fca200ad570 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca283b0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2006e410 con 0x7fca2015dd80 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca283b0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca200b3930 con 0x7fca2006abe0 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca2594b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca2015dd80 0x7fca200b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca2694d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fca200ad570 0x7fca2006ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58336/0 (socket says 172.21.15.172:58336) 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca2694d640 1 -- 172.21.15.172:0/3980506850 learned_addr learned my addr 172.21.15.172:0/3980506850 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca2594b640 1 -- 172.21.15.172:0/3980506850 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2006abe0 msgr2=0x7fca2006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca2614c640 1 --2- 172.21.15.172:0/3980506850 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2006abe0 0x7fca2006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca2514a640 1 -- 172.21.15.172:0/3980506850 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135734259 0 0) 0x7fca2006b500 con 0x7fca200ad570 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca2594b640 1 --2- 172.21.15.172:0/3980506850 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2006abe0 0x7fca2006afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:42.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca2594b640 1 -- 172.21.15.172:0/3980506850 >> v1:172.21.15.172:6789/0 conn(0x7fca200ad570 legacy=0x7fca2006ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:42.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.787+0000 7fca2594b640 1 -- 172.21.15.172:0/3980506850 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca200b3c10 con 0x7fca2015dd80 2024-04-25T08:46:42.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.788+0000 7fca2594b640 1 --2- 172.21.15.172:0/3980506850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 0x7fca200b5290 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fca100097a0 tx=0x7fca1002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca82046d12015c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:42.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.788+0000 7fca2514a640 1 -- 172.21.15.172:0/3980506850 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10037070 con 0x7fca2015dd80 2024-04-25T08:46:42.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.788+0000 7fca2514a640 1 -- 172.21.15.172:0/3980506850 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10032440 con 0x7fca2015dd80 2024-04-25T08:46:42.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.788+0000 7fca2514a640 1 -- 172.21.15.172:0/3980506850 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10032810 con 0x7fca2015dd80 2024-04-25T08:46:42.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.788+0000 7fca283b0640 1 -- 172.21.15.172:0/3980506850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 msgr2=0x7fca200b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:42.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.788+0000 7fca283b0640 1 --2- 172.21.15.172:0/3980506850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 0x7fca200b5290 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fca100097a0 tx=0x7fca1002a180 comp rx=0 tx=0).stop 2024-04-25T08:46:42.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.789+0000 7fca283b0640 1 -- 172.21.15.172:0/3980506850 shutdown_connections 2024-04-25T08:46:42.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.789+0000 7fca283b0640 1 --2- 172.21.15.172:0/3980506850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 0x7fca200b5290 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:42.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.789+0000 7fca283b0640 1 --2- 172.21.15.172:0/3980506850 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2006abe0 0x7fca2006afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:42.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.789+0000 7fca283b0640 1 -- 172.21.15.172:0/3980506850 >> 172.21.15.172:0/3980506850 conn(0x7fca200b5af0 msgr2=0x7fca200b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:42.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.789+0000 7fca283b0640 1 -- 172.21.15.172:0/3980506850 shutdown_connections 2024-04-25T08:46:42.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.789+0000 7fca283b0640 1 -- 172.21.15.172:0/3980506850 wait complete. 2024-04-25T08:46:42.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.790+0000 7fca283b0640 1 Processor -- start 2024-04-25T08:46:42.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.790+0000 7fca283b0640 1 -- start start 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.790+0000 7fca283b0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2006abe0 0x7fca2014ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca283b0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200ad570 0x7fca20152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca283b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 0x7fca20154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca283b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca200b57d0 con 0x7fca2015dd80 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca283b0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2006e940 con 0x7fca200ad570 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca283b0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca20070280 con 0x7fca2006abe0 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2694d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 0x7fca20154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2694d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 0x7fca20154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48514/0 (socket says 172.21.15.172:48514) 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2694d640 1 -- 172.21.15.172:0/2824611639 learned_addr learned my addr 172.21.15.172:0/2824611639 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2614c640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2006abe0 0x7fca2014ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2594b640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200ad570 0x7fca20152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2694d640 1 -- 172.21.15.172:0/2824611639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2006abe0 msgr2=0x7fca2014ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2694d640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2006abe0 0x7fca2014ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2694d640 1 -- 172.21.15.172:0/2824611639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200ad570 msgr2=0x7fca20152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:42.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2694d640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200ad570 0x7fca20152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:42.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2694d640 1 -- 172.21.15.172:0/2824611639 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca201536d0 con 0x7fca2015dd80 2024-04-25T08:46:42.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2594b640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200ad570 0x7fca20152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:42.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca2694d640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 0x7fca20154ed0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fca1800c7a0 tx=0x7fca1800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:42.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca16ffd640 1 -- 172.21.15.172:0/2824611639 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18018070 con 0x7fca2015dd80 2024-04-25T08:46:42.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca16ffd640 1 -- 172.21.15.172:0/2824611639 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1800a640 con 0x7fca2015dd80 2024-04-25T08:46:42.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca16ffd640 1 -- 172.21.15.172:0/2824611639 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1800aab0 con 0x7fca2015dd80 2024-04-25T08:46:42.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca283b0640 1 -- 172.21.15.172:0/2824611639 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca20159f80 con 0x7fca2015dd80 2024-04-25T08:46:42.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.791+0000 7fca283b0640 1 -- 172.21.15.172:0/2824611639 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2015a540 con 0x7fca2015dd80 2024-04-25T08:46:42.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.792+0000 7fca283b0640 1 -- 172.21.15.172:0/2824611639 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca20073a00 con 0x7fca2015dd80 2024-04-25T08:46:42.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.793+0000 7fca16ffd640 1 -- 172.21.15.172:0/2824611639 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca1801b070 con 0x7fca2015dd80 2024-04-25T08:46:42.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.793+0000 7fca16ffd640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0406b500 0x7fca0406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:42.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.793+0000 7fca16ffd640 1 -- 172.21.15.172:0/2824611639 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5921+0+0 (secure 0 0 0) 0x7fca18089900 con 0x7fca2015dd80 2024-04-25T08:46:42.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.793+0000 7fca2614c640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0406b500 0x7fca0406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:42.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.794+0000 7fca2614c640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0406b500 0x7fca0406d9c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00a970 tx=0x7fca1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:42.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.797+0000 7fca16ffd640 1 -- 172.21.15.172:0/2824611639 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca180586a0 con 0x7fca2015dd80 2024-04-25T08:46:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:42.967+0000 7fca283b0640 1 -- 172.21.15.172:0/2824611639 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca2006b340 con 0x7fca2015dd80 2024-04-25T08:46:43.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.662+0000 7fca16ffd640 1 -- 172.21.15.172:0/2824611639 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) v1 ==== 169+0+0 (secure 0 0 0) 0x7fca18057fa0 con 0x7fca2015dd80 2024-04-25T08:46:43.654 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.665+0000 7fca283b0640 1 -- 172.21.15.172:0/2824611639 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0406b500 msgr2=0x7fca0406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.665+0000 7fca283b0640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0406b500 0x7fca0406d9c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00a970 tx=0x7fca1c008040 comp rx=0 tx=0).stop 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.665+0000 7fca283b0640 1 -- 172.21.15.172:0/2824611639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 msgr2=0x7fca20154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.665+0000 7fca283b0640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 0x7fca20154ed0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fca1800c7a0 tx=0x7fca1800cc60 comp rx=0 tx=0).stop 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.666+0000 7fca283b0640 1 -- 172.21.15.172:0/2824611639 shutdown_connections 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.666+0000 7fca283b0640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca0406b500 0x7fca0406d9c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.666+0000 7fca283b0640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca200ad570 0x7fca20152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.666+0000 7fca283b0640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca2015dd80 0x7fca20154ed0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.666+0000 7fca283b0640 1 --2- 172.21.15.172:0/2824611639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca2006abe0 0x7fca2014ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.666+0000 7fca283b0640 1 -- 172.21.15.172:0/2824611639 >> 172.21.15.172:0/2824611639 conn(0x7fca200b5af0 msgr2=0x7fca2006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.666+0000 7fca283b0640 1 -- 172.21.15.172:0/2824611639 shutdown_connections 2024-04-25T08:46:43.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.666+0000 7fca283b0640 1 -- 172.21.15.172:0/2824611639 wait complete. 2024-04-25T08:46:43.673 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:46:43.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.784+0000 7ff942d28640 1 Processor -- start 2024-04-25T08:46:43.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.784+0000 7ff942d28640 1 -- start start 2024-04-25T08:46:43.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff942d28640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff93c155f80 0x7ff93c06f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:43.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff942d28640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c0b4d80 con 0x7ff93c06fa00 2024-04-25T08:46:43.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff942d28640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c0cef70 con 0x7ff93c0ce900 2024-04-25T08:46:43.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff942d28640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c0ced30 con 0x7ff93c155f80 2024-04-25T08:46:43.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93bfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff93c06fa00 0x7ff93c0ce1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58338/0 (socket says 172.21.15.172:58338) 2024-04-25T08:46:43.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93bfff640 1 -- 172.21.15.172:0/58454279 learned_addr learned my addr 172.21.15.172:0/58454279 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:43.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484145173 0 0) 0x7ff93c0b4d80 con 0x7ff93c06fa00 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff92c003520 con 0x7ff93c06fa00 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff940ac4640 1 --2- 172.21.15.172:0/58454279 >> v2:172.21.15.186:3300/0 conn(0x7ff93c155f80 0x7ff93c06f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3717353897 0 0) 0x7ff92c003520 con 0x7ff93c06fa00 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 >> v2:172.21.15.186:3300/0 conn(0x7ff93c155f80 msgr2=0x7ff93c06f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 --2- 172.21.15.172:0/58454279 >> v2:172.21.15.186:3300/0 conn(0x7ff93c155f80 0x7ff93c06f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 >> v1:172.21.15.186:6789/0 conn(0x7ff93c0ce900 legacy=0x7ff93c0b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0b5020 con 0x7ff93c06fa00 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7ff928001810 con 0x7ff93c06fa00 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff940ac4640 1 --2- 172.21.15.172:0/58454279 >> v2:172.21.15.186:3300/0 conn(0x7ff93c155f80 0x7ff93c06f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 >> v1:172.21.15.172:6789/0 conn(0x7ff93c06fa00 legacy=0x7ff93c0ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff92c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:43.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff92c004800 0x7ff92c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff92c0051c0 0x7ff92c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0ced30 con 0x7ff92c0039b0 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c00c110 con 0x7ff92c0051c0 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c00c310 con 0x7ff92c004800 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.785+0000 7ff940ac4640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff92c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.786+0000 7ff9412c5640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff92c0051c0 0x7ff92c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.786+0000 7ff93bfff640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff92c004800 0x7ff92c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.786+0000 7ff940ac4640 1 -- 172.21.15.172:0/58454279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff92c004800 msgr2=0x7ff92c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.786+0000 7ff940ac4640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff92c004800 0x7ff92c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.786+0000 7ff940ac4640 1 -- 172.21.15.172:0/58454279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff92c0051c0 msgr2=0x7ff92c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.786+0000 7ff940ac4640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff92c0051c0 0x7ff92c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.786+0000 7ff9412c5640 1 -- 172.21.15.172:0/58454279 reap_dead start 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.786+0000 7ff940ac4640 1 -- 172.21.15.172:0/58454279 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c003520 con 0x7ff92c0039b0 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.786+0000 7ff940ac4640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff92c003dd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff9300098a0 tx=0x7ff92c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978b18267b93159e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:43.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.787+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93000f040 con 0x7ff92c0039b0 2024-04-25T08:46:43.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.787+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93002ace0 con 0x7ff92c0039b0 2024-04-25T08:46:43.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.787+0000 7ff93b7fe640 1 -- 172.21.15.172:0/58454279 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930004250 con 0x7ff92c0039b0 2024-04-25T08:46:43.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.787+0000 7ff942d28640 1 -- 172.21.15.172:0/58454279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 msgr2=0x7ff92c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:43.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.787+0000 7ff942d28640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff92c003dd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff9300098a0 tx=0x7ff92c005830 comp rx=0 tx=0).stop 2024-04-25T08:46:43.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.787+0000 7ff942d28640 1 -- 172.21.15.172:0/58454279 shutdown_connections 2024-04-25T08:46:43.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.787+0000 7ff942d28640 1 --2- 172.21.15.172:0/58454279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff92c003dd0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.787+0000 7ff942d28640 1 -- 172.21.15.172:0/58454279 >> 172.21.15.172:0/58454279 conn(0x7ff93c061600 msgr2=0x7ff93c0619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:43.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.787+0000 7ff942d28640 1 -- 172.21.15.172:0/58454279 shutdown_connections 2024-04-25T08:46:43.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.787+0000 7ff942d28640 1 -- 172.21.15.172:0/58454279 wait complete. 2024-04-25T08:46:43.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.788+0000 7ff942d28640 1 Processor -- start 2024-04-25T08:46:43.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.788+0000 7ff942d28640 1 -- start start 2024-04-25T08:46:43.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.789+0000 7ff942d28640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff93c14ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:43.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.789+0000 7ff942d28640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff93c139890 0x7ff93c139d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:43.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.789+0000 7ff942d28640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff93c1f5280 0x7ff93c1f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:43.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.789+0000 7ff942d28640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0d07f0 con 0x7ff92c0039b0 2024-04-25T08:46:43.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.789+0000 7ff942d28640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0b5390 con 0x7ff93c139890 2024-04-25T08:46:43.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.789+0000 7ff942d28640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0cf250 con 0x7ff93c1f5280 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.789+0000 7ff940ac4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff93c14ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.789+0000 7ff940ac4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff93c14ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48540/0 (socket says 172.21.15.172:48540) 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.789+0000 7ff940ac4640 1 -- 172.21.15.172:0/3305936744 learned_addr learned my addr 172.21.15.172:0/3305936744 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff93bfff640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff93c139890 0x7ff93c139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff9412c5640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff93c1f5280 0x7ff93c1f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff940ac4640 1 -- 172.21.15.172:0/3305936744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff93c1f5280 msgr2=0x7ff93c1f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff940ac4640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff93c1f5280 0x7ff93c1f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff940ac4640 1 -- 172.21.15.172:0/3305936744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff93c139890 msgr2=0x7ff93c139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff940ac4640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff93c139890 0x7ff93c139d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff940ac4640 1 -- 172.21.15.172:0/3305936744 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c14d1e0 con 0x7ff92c0039b0 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff940ac4640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff93c14ca50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff930034040 tx=0x7ff930004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff9397fa640 1 -- 172.21.15.172:0/3305936744 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930041070 con 0x7ff92c0039b0 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff9397fa640 1 -- 172.21.15.172:0/3305936744 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93002aae0 con 0x7ff92c0039b0 2024-04-25T08:46:43.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff942d28640 1 -- 172.21.15.172:0/3305936744 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c14d4c0 con 0x7ff92c0039b0 2024-04-25T08:46:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff9397fa640 1 -- 172.21.15.172:0/3305936744 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93003d430 con 0x7ff92c0039b0 2024-04-25T08:46:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.790+0000 7ff942d28640 1 -- 172.21.15.172:0/3305936744 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c14da80 con 0x7ff92c0039b0 2024-04-25T08:46:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.791+0000 7ff942d28640 1 -- 172.21.15.172:0/3305936744 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c073a00 con 0x7ff92c0039b0 2024-04-25T08:46:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.791+0000 7ff9397fa640 1 -- 172.21.15.172:0/3305936744 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff930044070 con 0x7ff92c0039b0 2024-04-25T08:46:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.792+0000 7ff9397fa640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff92006b500 0x7ff92006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.792+0000 7ff9397fa640 1 -- 172.21.15.172:0/3305936744 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5507+0+0 (secure 0 0 0) 0x7ff9300aa8d0 con 0x7ff92c0039b0 2024-04-25T08:46:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.792+0000 7ff93bfff640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff92006b500 0x7ff92006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:43.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.792+0000 7ff93bfff640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff92006b500 0x7ff92006d9c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff93c155a90 tx=0x7ff928009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:43.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.796+0000 7ff9397fa640 1 -- 172.21.15.172:0/3305936744 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff930079780 con 0x7ff92c0039b0 2024-04-25T08:46:43.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.967+0000 7ff942d28640 1 -- 172.21.15.172:0/3305936744 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff93c0b1030 con 0x7ff92c0039b0 2024-04-25T08:46:43.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.971+0000 7ff9397fa640 1 -- 172.21.15.172:0/3305936744 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff930079080 con 0x7ff92c0039b0 2024-04-25T08:46:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 -- 172.21.15.172:0/3305936744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff92006b500 msgr2=0x7ff92006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff92006b500 0x7ff92006d9c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff93c155a90 tx=0x7ff928009040 comp rx=0 tx=0).stop 2024-04-25T08:46:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 -- 172.21.15.172:0/3305936744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 msgr2=0x7ff93c14ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff93c14ca50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff930034040 tx=0x7ff930004730 comp rx=0 tx=0).stop 2024-04-25T08:46:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 -- 172.21.15.172:0/3305936744 shutdown_connections 2024-04-25T08:46:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff92006b500 0x7ff92006d9c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff93c139890 0x7ff93c139d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff93c1f5280 0x7ff93c1f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 --2- 172.21.15.172:0/3305936744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff92c0039b0 0x7ff93c14ca50 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 -- 172.21.15.172:0/3305936744 >> 172.21.15.172:0/3305936744 conn(0x7ff93c061600 msgr2=0x7ff93c15c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 -- 172.21.15.172:0/3305936744 shutdown_connections 2024-04-25T08:46:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:43.973+0000 7ff942d28640 1 -- 172.21.15.172:0/3305936744 wait complete. 2024-04-25T08:46:43.975 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-04-25T08:46:44.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.083+0000 7f64b197e640 1 Processor -- start 2024-04-25T08:46:44.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.083+0000 7f64b197e640 1 -- start start 2024-04-25T08:46:44.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64b197e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64ac15da70 0x7f64ac0d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64b197e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64ac0c7730 0x7f64ac0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64b197e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f64ac0c7b90 0x7f64ac0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64b197e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac0c8030 con 0x7f64ac0c7730 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64b197e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ac0c8310 con 0x7f64ac0c7b90 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64b197e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0c85f0 con 0x7f64ac15da70 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64a3fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64ac0c7730 0x7f64ac0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64a3fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64ac0c7730 0x7f64ac0ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48556/0 (socket says 172.21.15.172:48556) 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64a3fff640 1 -- 172.21.15.172:0/1283064470 learned_addr learned my addr 172.21.15.172:0/1283064470 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64a3fff640 1 -- 172.21.15.172:0/1283064470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64ac15da70 msgr2=0x7f64ac0d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64a3fff640 1 --2- 172.21.15.172:0/1283064470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64ac15da70 0x7f64ac0d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64a3fff640 1 -- 172.21.15.172:0/1283064470 >> v2:172.21.15.186:3300/0 conn(0x7f64ac0c7b90 msgr2=0x7f64ac0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64a3fff640 1 --2- 172.21.15.172:0/1283064470 >> v2:172.21.15.186:3300/0 conn(0x7f64ac0c7b90 0x7f64ac0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.084+0000 7f64a3fff640 1 -- 172.21.15.172:0/1283064470 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac06bb30 con 0x7f64ac0c7730 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.085+0000 7f64a3fff640 1 --2- 172.21.15.172:0/1283064470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 0x7f64ac0ce1c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0c67e0 tx=0x7f649402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecdbb630e5d2b0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.085+0000 7f64aa7fc640 1 -- 172.21.15.172:0/1283064470 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494037070 con 0x7f64ac0c7730 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.085+0000 7f64aa7fc640 1 -- 172.21.15.172:0/1283064470 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6494032440 con 0x7f64ac0c7730 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.085+0000 7f64aa7fc640 1 -- 172.21.15.172:0/1283064470 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494032810 con 0x7f64ac0c7730 2024-04-25T08:46:44.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.086+0000 7f64b197e640 1 -- 172.21.15.172:0/1283064470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 msgr2=0x7f64ac0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.086+0000 7f64b197e640 1 --2- 172.21.15.172:0/1283064470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 0x7f64ac0ce1c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0c67e0 tx=0x7f649402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.086+0000 7f64b197e640 1 -- 172.21.15.172:0/1283064470 shutdown_connections 2024-04-25T08:46:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.086+0000 7f64b197e640 1 --2- 172.21.15.172:0/1283064470 >> v2:172.21.15.186:3300/0 conn(0x7f64ac0c7b90 0x7f64ac0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.086+0000 7f64b197e640 1 --2- 172.21.15.172:0/1283064470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 0x7f64ac0ce1c0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.086+0000 7f64b197e640 1 --2- 172.21.15.172:0/1283064470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64ac15da70 0x7f64ac0d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.086+0000 7f64b197e640 1 -- 172.21.15.172:0/1283064470 >> 172.21.15.172:0/1283064470 conn(0x7f64ac0b33e0 msgr2=0x7f64ac0b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.086+0000 7f64b197e640 1 -- 172.21.15.172:0/1283064470 shutdown_connections 2024-04-25T08:46:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.086+0000 7f64b197e640 1 -- 172.21.15.172:0/1283064470 wait complete. 2024-04-25T08:46:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.087+0000 7f64b197e640 1 Processor -- start 2024-04-25T08:46:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.087+0000 7f64b197e640 1 -- start start 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64b197e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 0x7f64ac0c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64b197e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64ac0c7b90 0x7f64ac159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64b197e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64ac15da70 0x7f64ac14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64b197e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac070c60 con 0x7f64ac0c7730 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64b197e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac15de50 con 0x7f64ac0c7b90 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64b197e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac070de0 con 0x7f64ac15da70 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64aaffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 0x7f64ac0c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64aaffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 0x7f64ac0c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48566/0 (socket says 172.21.15.172:48566) 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64aaffd640 1 -- 172.21.15.172:0/2066120418 learned_addr learned my addr 172.21.15.172:0/2066120418 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64ab7fe640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64ac15da70 0x7f64ac14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64a3fff640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64ac0c7b90 0x7f64ac159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64aaffd640 1 -- 172.21.15.172:0/2066120418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64ac15da70 msgr2=0x7f64ac14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64aaffd640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64ac15da70 0x7f64ac14be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64aaffd640 1 -- 172.21.15.172:0/2066120418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64ac0c7b90 msgr2=0x7f64ac159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64aaffd640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64ac0c7b90 0x7f64ac159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64aaffd640 1 -- 172.21.15.172:0/2066120418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0caf80 con 0x7f64ac0c7730 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64a3fff640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64ac0c7b90 0x7f64ac159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64aaffd640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 0x7f64ac0c96e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f649c00b440 tx=0x7f649c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64a8ff9640 1 -- 172.21.15.172:0/2066120418 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c015020 con 0x7f64ac0c7730 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64a8ff9640 1 -- 172.21.15.172:0/2066120418 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649c011890 con 0x7f64ac0c7730 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64a8ff9640 1 -- 172.21.15.172:0/2066120418 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c011c80 con 0x7f64ac0c7730 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64b197e640 1 -- 172.21.15.172:0/2066120418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac0c8920 con 0x7f64ac0c7730 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.088+0000 7f64b197e640 1 -- 172.21.15.172:0/2066120418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac0c8ee0 con 0x7f64ac0c7730 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.089+0000 7f64b197e640 1 -- 172.21.15.172:0/2066120418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac073990 con 0x7f64ac0c7730 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.090+0000 7f64a8ff9640 1 -- 172.21.15.172:0/2066120418 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f649c018020 con 0x7f64ac0c7730 2024-04-25T08:46:44.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.090+0000 7f64a8ff9640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f648c06b4d0 0x7f648c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.090+0000 7f64a3fff640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f648c06b4d0 0x7f648c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.090+0000 7f64a8ff9640 1 -- 172.21.15.172:0/2066120418 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f649c08a270 con 0x7f64ac0c7730 2024-04-25T08:46:44.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.091+0000 7f64a3fff640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f648c06b4d0 0x7f648c06d990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6494034000 tx=0x7f649402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:44.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.094+0000 7f64a8ff9640 1 -- 172.21.15.172:0/2066120418 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f649c01f020 con 0x7f64ac0c7730 2024-04-25T08:46:44.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.329+0000 7f64b197e640 1 -- 172.21.15.172:0/2066120418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7f64ac06e530 con 0x7f64ac0c7730 2024-04-25T08:46:44.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.673+0000 7f64a8ff9640 1 -- 172.21.15.172:0/2066120418 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v231) v1 ==== 143+0+0 (secure 0 0 0) 0x7f649c00d040 con 0x7f64ac0c7730 2024-04-25T08:46:44.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.675+0000 7f64b197e640 1 -- 172.21.15.172:0/2066120418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f648c06b4d0 msgr2=0x7f648c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.675+0000 7f64b197e640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f648c06b4d0 0x7f648c06d990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6494034000 tx=0x7f649402e000 comp rx=0 tx=0).stop 2024-04-25T08:46:44.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.675+0000 7f64b197e640 1 -- 172.21.15.172:0/2066120418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 msgr2=0x7f64ac0c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.675+0000 7f64b197e640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 0x7f64ac0c96e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f649c00b440 tx=0x7f649c00b900 comp rx=0 tx=0).stop 2024-04-25T08:46:44.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.675+0000 7f64b197e640 1 -- 172.21.15.172:0/2066120418 shutdown_connections 2024-04-25T08:46:44.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.675+0000 7f64b197e640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f648c06b4d0 0x7f648c06d990 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.675+0000 7f64b197e640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64ac0c7b90 0x7f64ac159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.675+0000 7f64b197e640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f64ac15da70 0x7f64ac14be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.675+0000 7f64b197e640 1 --2- 172.21.15.172:0/2066120418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64ac0c7730 0x7f64ac0c96e0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.676+0000 7f64b197e640 1 -- 172.21.15.172:0/2066120418 >> 172.21.15.172:0/2066120418 conn(0x7f64ac0b33e0 msgr2=0x7f64ac0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:44.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.676+0000 7f64b197e640 1 -- 172.21.15.172:0/2066120418 shutdown_connections 2024-04-25T08:46:44.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.676+0000 7f64b197e640 1 -- 172.21.15.172:0/2066120418 wait complete. 2024-04-25T08:46:44.678 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-04-25T08:46:44.679 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-04-25T08:46:44.679 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-04-25T08:46:44.679 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:44.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.784+0000 7fdb10afc640 1 Processor -- start 2024-04-25T08:46:44.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.784+0000 7fdb10afc640 1 -- start start 2024-04-25T08:46:44.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.785+0000 7fdb10afc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdb0c154ee0 0x7fdb0c0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.785+0000 7fdb10afc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb0c0cfcf0 0x7fdb0c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.785+0000 7fdb10afc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c071480 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.785+0000 7fdb10afc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c0ce830 con 0x7fdb0c0cfcf0 2024-04-25T08:46:44.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.785+0000 7fdb10afc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c072090 con 0x7fdb0c154ee0 2024-04-25T08:46:44.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.786+0000 7fdb09d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb0c0cfcf0 0x7fdb0c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.786+0000 7fdb0ad9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fdb0c0ce3c0 0x7fdb0c15e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58348/0 (socket says 172.21.15.172:58348) 2024-04-25T08:46:44.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.786+0000 7fdb09d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb0c0cfcf0 0x7fdb0c0cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48574/0 (socket says 172.21.15.172:48574) 2024-04-25T08:46:44.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.786+0000 7fdb0ad9d640 1 -- 172.21.15.172:0/3927430545 learned_addr learned my addr 172.21.15.172:0/3927430545 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:44.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.786+0000 7fdb0a59c640 1 --2- 172.21.15.172:0/3927430545 >> v2:172.21.15.186:3300/0 conn(0x7fdb0c154ee0 0x7fdb0c0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.786+0000 7fdb09d9b640 1 -- 172.21.15.172:0/3927430545 >> v2:172.21.15.186:3300/0 conn(0x7fdb0c154ee0 msgr2=0x7fdb0c0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:44.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.786+0000 7fdb09d9b640 1 --2- 172.21.15.172:0/3927430545 >> v2:172.21.15.186:3300/0 conn(0x7fdb0c154ee0 0x7fdb0c0cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.786+0000 7fdb09d9b640 1 -- 172.21.15.172:0/3927430545 >> v1:172.21.15.172:6789/0 conn(0x7fdb0c0ce3c0 legacy=0x7fdb0c15e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.786+0000 7fdb09d9b640 1 -- 172.21.15.172:0/3927430545 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c071760 con 0x7fdb0c0cfcf0 2024-04-25T08:46:44.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.786+0000 7fdb0959a640 1 -- 172.21.15.172:0/3927430545 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082904816 0 0) 0x7fdb0c071480 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb09d9b640 1 --2- 172.21.15.172:0/3927430545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0cfcf0 0x7fdb0c0cde80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0d02e0 tx=0x7fdaf402c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b921c6c3cd52ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:44.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb0959a640 1 -- 172.21.15.172:0/3927430545 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4032770 con 0x7fdb0c0cfcf0 2024-04-25T08:46:44.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb0959a640 1 -- 172.21.15.172:0/3927430545 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf4038070 con 0x7fdb0c0cfcf0 2024-04-25T08:46:44.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb0959a640 1 -- 172.21.15.172:0/3927430545 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4032b30 con 0x7fdb0c0cfcf0 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb10afc640 1 -- 172.21.15.172:0/3927430545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0cfcf0 msgr2=0x7fdb0c0cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb10afc640 1 --2- 172.21.15.172:0/3927430545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0cfcf0 0x7fdb0c0cde80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0d02e0 tx=0x7fdaf402c870 comp rx=0 tx=0).stop 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb10afc640 1 -- 172.21.15.172:0/3927430545 shutdown_connections 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb10afc640 1 --2- 172.21.15.172:0/3927430545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0cfcf0 0x7fdb0c0cde80 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb10afc640 1 --2- 172.21.15.172:0/3927430545 >> v2:172.21.15.186:3300/0 conn(0x7fdb0c154ee0 0x7fdb0c0cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb10afc640 1 -- 172.21.15.172:0/3927430545 >> 172.21.15.172:0/3927430545 conn(0x7fdb0c06abe0 msgr2=0x7fdb0c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb10afc640 1 -- 172.21.15.172:0/3927430545 shutdown_connections 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.787+0000 7fdb10afc640 1 -- 172.21.15.172:0/3927430545 wait complete. 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.789+0000 7fdb10afc640 1 Processor -- start 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.789+0000 7fdb10afc640 1 -- start start 2024-04-25T08:46:44.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.789+0000 7fdb10afc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0ce3c0 0x7fdb0c143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.789+0000 7fdb10afc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb0c0cfcf0 0x7fdb0c0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.789+0000 7fdb10afc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb0c154ee0 0x7fdb0c157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.789+0000 7fdb10afc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c071d20 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.789+0000 7fdb10afc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c071230 con 0x7fdb0c0cfcf0 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.789+0000 7fdb10afc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1552c0 con 0x7fdb0c154ee0 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0ce3c0 0x7fdb0c143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0ce3c0 0x7fdb0c143710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48584/0 (socket says 172.21.15.172:48584) 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0a59c640 1 -- 172.21.15.172:0/2761827356 learned_addr learned my addr 172.21.15.172:0/2761827356 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb09d9b640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb0c0cfcf0 0x7fdb0c0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0ad9d640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb0c154ee0 0x7fdb0c157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0a59c640 1 -- 172.21.15.172:0/2761827356 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb0c154ee0 msgr2=0x7fdb0c157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0a59c640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb0c154ee0 0x7fdb0c157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0a59c640 1 -- 172.21.15.172:0/2761827356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb0c0cfcf0 msgr2=0x7fdb0c0a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0a59c640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb0c0cfcf0 0x7fdb0c0a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0a59c640 1 -- 172.21.15.172:0/2761827356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c1417d0 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0ad9d640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb0c154ee0 0x7fdb0c157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:44.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb0a59c640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0ce3c0 0x7fdb0c143710 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fdb04007e40 tx=0x7fdb0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:44.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb02ffd640 1 -- 172.21.15.172:0/2761827356 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04014620 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb02ffd640 1 -- 172.21.15.172:0/2761827356 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04019070 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb10afc640 1 -- 172.21.15.172:0/2761827356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c141ab0 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb02ffd640 1 -- 172.21.15.172:0/2761827356 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04014a00 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.790+0000 7fdb10afc640 1 -- 172.21.15.172:0/2761827356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c142070 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.791+0000 7fdb10afc640 1 -- 172.21.15.172:0/2761827356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c1424b0 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.791+0000 7fdb02ffd640 1 -- 172.21.15.172:0/2761827356 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdb04014ba0 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.792+0000 7fdb02ffd640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdaec06b4d0 0x7fdaec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:44.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.792+0000 7fdb02ffd640 1 -- 172.21.15.172:0/2761827356 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fdb0408a970 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.792+0000 7fdb09d9b640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdaec06b4d0 0x7fdaec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:44.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.792+0000 7fdb09d9b640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdaec06b4d0 0x7fdaec06d990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4037000 tx=0x7fdaf4032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:44.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.796+0000 7fdb02ffd640 1 -- 172.21.15.172:0/2761827356 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb04059940 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.965+0000 7fdb10afc640 1 -- 172.21.15.172:0/2761827356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb0c073990 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.966+0000 7fdb02ffd640 1 -- 172.21.15.172:0/2761827356 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+13614 (secure 0 0 0) 0x7fdb04059240 con 0x7fdb0c0ce3c0 2024-04-25T08:46:44.957 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:44.957 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":72,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:43.662145+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/311149179":"2024-04-26T08:46:40.570962+0000","172.21.15.172:6834/311149179":"2024-04-26T08:46:40.570962+0000","172.21.15.172:6835/611108095":"2024-04-26T08:46:19.498370+0000","172.21.15.172:6834/611108095":"2024-04-26T08:46:19.498370+0000","172.21.15.186:6834/550125910":"2024-04-26T08:46:18.498889+0000","172.21.15.186:6832/550125910":"2024-04-26T08:46:18.498889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:44.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 -- 172.21.15.172:0/2761827356 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdaec06b4d0 msgr2=0x7fdaec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdaec06b4d0 0x7fdaec06d990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4037000 tx=0x7fdaf4032000 comp rx=0 tx=0).stop 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 -- 172.21.15.172:0/2761827356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0ce3c0 msgr2=0x7fdb0c143710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0ce3c0 0x7fdb0c143710 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fdb04007e40 tx=0x7fdb0400e4b0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 -- 172.21.15.172:0/2761827356 shutdown_connections 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdaec06b4d0 0x7fdaec06d990 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb0c0cfcf0 0x7fdb0c0a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb0c154ee0 0x7fdb0c157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 --2- 172.21.15.172:0/2761827356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c0ce3c0 0x7fdb0c143710 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 -- 172.21.15.172:0/2761827356 >> 172.21.15.172:0/2761827356 conn(0x7fdb0c06abe0 msgr2=0x7fdb0c15d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 -- 172.21.15.172:0/2761827356 shutdown_connections 2024-04-25T08:46:44.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:44.968+0000 7fdb10afc640 1 -- 172.21.15.172:0/2761827356 wait complete. 2024-04-25T08:46:44.971 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:46:44.972 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:46:45.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.080+0000 7f89ad09e640 1 Processor -- start 2024-04-25T08:46:45.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.081+0000 7f89ad09e640 1 -- start start 2024-04-25T08:46:45.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.081+0000 7f89ad09e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f89a815bb50 0x7f89a80c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.081+0000 7f89ad09e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89a80c70d0 0x7f89a80cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.081+0000 7f89ad09e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a80c75e0 con 0x7f89a80cfb40 2024-04-25T08:46:45.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.081+0000 7f89ad09e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a80c8680 con 0x7f89a815bb50 2024-04-25T08:46:45.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.081+0000 7f89ad09e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a80c78c0 con 0x7f89a80c70d0 2024-04-25T08:46:45.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.082+0000 7f89a6d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f89a815bb50 0x7f89a80c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.082+0000 7f89a759e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f89a80cfb40 0x7f89a8070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58350/0 (socket says 172.21.15.172:58350) 2024-04-25T08:46:45.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.082+0000 7f89a759e640 1 -- 172.21.15.172:0/4101218635 learned_addr learned my addr 172.21.15.172:0/4101218635 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:45.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.082+0000 7f89a6d9d640 1 -- 172.21.15.172:0/4101218635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89a80c70d0 msgr2=0x7f89a80cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:45.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.082+0000 7f89a6d9d640 1 --2- 172.21.15.172:0/4101218635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89a80c70d0 0x7f89a80cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.082+0000 7f89a6d9d640 1 -- 172.21.15.172:0/4101218635 >> v1:172.21.15.172:6789/0 conn(0x7f89a80cfb40 legacy=0x7f89a8070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.082+0000 7f89a6d9d640 1 -- 172.21.15.172:0/4101218635 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a80c7ba0 con 0x7f89a815bb50 2024-04-25T08:46:45.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.082+0000 7f89a659c640 1 -- 172.21.15.172:0/4101218635 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660430085 0 0) 0x7f89a80c75e0 con 0x7f89a80cfb40 2024-04-25T08:46:45.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89a6d9d640 1 --2- 172.21.15.172:0/4101218635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 0x7f89a80c6b90 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f89980097a0 tx=0x7f899802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e34e2210b25f11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:45.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89a659c640 1 -- 172.21.15.172:0/4101218635 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998037070 con 0x7f89a815bb50 2024-04-25T08:46:45.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89a659c640 1 -- 172.21.15.172:0/4101218635 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8998032440 con 0x7f89a815bb50 2024-04-25T08:46:45.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89a659c640 1 -- 172.21.15.172:0/4101218635 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998032810 con 0x7f89a815bb50 2024-04-25T08:46:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89ad09e640 1 -- 172.21.15.172:0/4101218635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 msgr2=0x7f89a80c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89ad09e640 1 --2- 172.21.15.172:0/4101218635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 0x7f89a80c6b90 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f89980097a0 tx=0x7f899802a210 comp rx=0 tx=0).stop 2024-04-25T08:46:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89ad09e640 1 -- 172.21.15.172:0/4101218635 shutdown_connections 2024-04-25T08:46:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89ad09e640 1 --2- 172.21.15.172:0/4101218635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89a80c70d0 0x7f89a80cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89ad09e640 1 --2- 172.21.15.172:0/4101218635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 0x7f89a80c6b90 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89ad09e640 1 -- 172.21.15.172:0/4101218635 >> 172.21.15.172:0/4101218635 conn(0x7f89a806f500 msgr2=0x7f89a806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89ad09e640 1 -- 172.21.15.172:0/4101218635 shutdown_connections 2024-04-25T08:46:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.083+0000 7f89ad09e640 1 -- 172.21.15.172:0/4101218635 wait complete. 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89ad09e640 1 Processor -- start 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89ad09e640 1 -- start start 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89ad09e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89a80c70d0 0x7f89a8153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89ad09e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89a80cfb40 0x7f89a80b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89ad09e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 0x7f89a8158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89ad09e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a815f6d0 con 0x7f89a815bb50 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89ad09e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a80c8160 con 0x7f89a80cfb40 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89ad09e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a815f850 con 0x7f89a80c70d0 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89a759e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 0x7f89a8158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89a759e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 0x7f89a8158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48608/0 (socket says 172.21.15.172:48608) 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.085+0000 7f89a759e640 1 -- 172.21.15.172:0/100087347 learned_addr learned my addr 172.21.15.172:0/100087347 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f89a6d9d640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89a80c70d0 0x7f89a8153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f899ffff640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89a80cfb40 0x7f89a80b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f89a759e640 1 -- 172.21.15.172:0/100087347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89a80c70d0 msgr2=0x7f89a8153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f89a759e640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89a80c70d0 0x7f89a8153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f89a759e640 1 -- 172.21.15.172:0/100087347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89a80cfb40 msgr2=0x7f89a80b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f89a759e640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89a80cfb40 0x7f89a80b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f89a759e640 1 -- 172.21.15.172:0/100087347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a80b4520 con 0x7f89a815bb50 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f89a6d9d640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89a80c70d0 0x7f89a8153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f899ffff640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89a80cfb40 0x7f89a80b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f89a759e640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 0x7f89a8158fc0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f89a000c7d0 tx=0x7f89a000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f899f7fe640 1 -- 172.21.15.172:0/100087347 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0018070 con 0x7f89a815bb50 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f899f7fe640 1 -- 172.21.15.172:0/100087347 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a000a640 con 0x7f89a815bb50 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f89ad09e640 1 -- 172.21.15.172:0/100087347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a80b4800 con 0x7f89a815bb50 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f899f7fe640 1 -- 172.21.15.172:0/100087347 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000aa70 con 0x7f89a815bb50 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.086+0000 7f89ad09e640 1 -- 172.21.15.172:0/100087347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a80b4dc0 con 0x7f89a815bb50 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.087+0000 7f89ad09e640 1 -- 172.21.15.172:0/100087347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a8073a00 con 0x7f89a815bb50 2024-04-25T08:46:45.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.087+0000 7f899f7fe640 1 -- 172.21.15.172:0/100087347 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f89a001b070 con 0x7f89a815bb50 2024-04-25T08:46:45.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.088+0000 7f899f7fe640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f898806b4d0 0x7f898806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.088+0000 7f89a6d9d640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f898806b4d0 0x7f898806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.088+0000 7f899f7fe640 1 -- 172.21.15.172:0/100087347 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f89a0089720 con 0x7f89a815bb50 2024-04-25T08:46:45.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.088+0000 7f89a6d9d640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f898806b4d0 0x7f898806d990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8998034000 tx=0x7f899802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:45.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.092+0000 7f899f7fe640 1 -- 172.21.15.172:0/100087347 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89a0058660 con 0x7f89a815bb50 2024-04-25T08:46:45.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.264+0000 7f89ad09e640 1 -- 172.21.15.172:0/100087347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89a80cc060 con 0x7f89a815bb50 2024-04-25T08:46:45.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.264+0000 7f899f7fe640 1 -- 172.21.15.172:0/100087347 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89a0057f60 con 0x7f89a815bb50 2024-04-25T08:46:45.256 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 -- 172.21.15.172:0/100087347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f898806b4d0 msgr2=0x7f898806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f898806b4d0 0x7f898806d990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8998034000 tx=0x7f899802e000 comp rx=0 tx=0).stop 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 -- 172.21.15.172:0/100087347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 msgr2=0x7f89a8158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 0x7f89a8158fc0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f89a000c7d0 tx=0x7f89a000cc90 comp rx=0 tx=0).stop 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 -- 172.21.15.172:0/100087347 shutdown_connections 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f898806b4d0 0x7f898806d990 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89a80cfb40 0x7f89a80b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a815bb50 0x7f89a8158fc0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 --2- 172.21.15.172:0/100087347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89a80c70d0 0x7f89a8153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 -- 172.21.15.172:0/100087347 >> 172.21.15.172:0/100087347 conn(0x7f89a806f500 msgr2=0x7f89a80cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 -- 172.21.15.172:0/100087347 shutdown_connections 2024-04-25T08:46:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.266+0000 7f89ad09e640 1 -- 172.21.15.172:0/100087347 wait complete. 2024-04-25T08:46:45.268 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-04-25T08:46:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.375+0000 7fc0ed1f9640 1 Processor -- start 2024-04-25T08:46:45.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.375+0000 7fc0ed1f9640 1 -- start start 2024-04-25T08:46:45.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0ed1f9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc0e80c6df0 0x7fc0e80d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0ed1f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc0e80d1c00 0x7fc0e80ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0ed1f9640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e815dfe0 con 0x7fc0e815dc00 2024-04-25T08:46:45.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0ed1f9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e80d2070 con 0x7fc0e80d1c00 2024-04-25T08:46:45.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0ed1f9640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e80d00c0 con 0x7fc0e80c6df0 2024-04-25T08:46:45.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0e759e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc0e80d1c00 0x7fc0e80ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0e759e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc0e80d1c00 0x7fc0e80ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48620/0 (socket says 172.21.15.172:48620) 2024-04-25T08:46:45.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0e759e640 1 -- 172.21.15.172:0/2371353247 learned_addr learned my addr 172.21.15.172:0/2371353247 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:45.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0dffff640 1 --2- 172.21.15.172:0/2371353247 >> v2:172.21.15.186:3300/0 conn(0x7fc0e80c6df0 0x7fc0e80d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0e759e640 1 -- 172.21.15.172:0/2371353247 >> v2:172.21.15.186:3300/0 conn(0x7fc0e80c6df0 msgr2=0x7fc0e80d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:45.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0e759e640 1 --2- 172.21.15.172:0/2371353247 >> v2:172.21.15.186:3300/0 conn(0x7fc0e80c6df0 0x7fc0e80d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0e759e640 1 -- 172.21.15.172:0/2371353247 >> v1:172.21.15.186:6789/0 conn(0x7fc0e815dc00 legacy=0x7fc0e80ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.376+0000 7fc0e759e640 1 -- 172.21.15.172:0/2371353247 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e80d03a0 con 0x7fc0e80d1c00 2024-04-25T08:46:45.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0e759e640 1 --2- 172.21.15.172:0/2371353247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e80d1c00 0x7fc0e80ccc40 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80c8820 tx=0x7fc0e002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4173b25d1ff0570 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:45.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0e659c640 1 -- 172.21.15.172:0/2371353247 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0036070 con 0x7fc0e80d1c00 2024-04-25T08:46:45.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0e659c640 1 -- 172.21.15.172:0/2371353247 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e0031600 con 0x7fc0e80d1c00 2024-04-25T08:46:45.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0e659c640 1 -- 172.21.15.172:0/2371353247 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e00319d0 con 0x7fc0e80d1c00 2024-04-25T08:46:45.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/2371353247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e80d1c00 msgr2=0x7fc0e80ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0ed1f9640 1 --2- 172.21.15.172:0/2371353247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e80d1c00 0x7fc0e80ccc40 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80c8820 tx=0x7fc0e002a730 comp rx=0 tx=0).stop 2024-04-25T08:46:45.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/2371353247 shutdown_connections 2024-04-25T08:46:45.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0ed1f9640 1 --2- 172.21.15.172:0/2371353247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e80d1c00 0x7fc0e80ccc40 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0ed1f9640 1 --2- 172.21.15.172:0/2371353247 >> v2:172.21.15.186:3300/0 conn(0x7fc0e80c6df0 0x7fc0e80d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/2371353247 >> 172.21.15.172:0/2371353247 conn(0x7fc0e806f5d0 msgr2=0x7fc0e806f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:45.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.377+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/2371353247 shutdown_connections 2024-04-25T08:46:45.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.378+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/2371353247 wait complete. 2024-04-25T08:46:45.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.379+0000 7fc0ed1f9640 1 Processor -- start 2024-04-25T08:46:45.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.379+0000 7fc0ed1f9640 1 -- start start 2024-04-25T08:46:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.379+0000 7fc0ed1f9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0e80c6df0 0x7fc0e80b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.379+0000 7fc0ed1f9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0e80d1c00 0x7fc0e8149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.379+0000 7fc0ed1f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e815dc00 0x7fc0e80b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.379+0000 7fc0ed1f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80cc130 con 0x7fc0e815dc00 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.379+0000 7fc0ed1f9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80cc720 con 0x7fc0e80d1c00 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.379+0000 7fc0ed1f9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80cfd90 con 0x7fc0e80c6df0 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e759e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e815dc00 0x7fc0e80b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e759e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e815dc00 0x7fc0e80b6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48634/0 (socket says 172.21.15.172:48634) 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e759e640 1 -- 172.21.15.172:0/1622350660 learned_addr learned my addr 172.21.15.172:0/1622350660 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0dffff640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0e80d1c00 0x7fc0e8149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e6d9d640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0e80c6df0 0x7fc0e80b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e759e640 1 -- 172.21.15.172:0/1622350660 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0e80c6df0 msgr2=0x7fc0e80b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e759e640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0e80c6df0 0x7fc0e80b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e759e640 1 -- 172.21.15.172:0/1622350660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0e80d1c00 msgr2=0x7fc0e8149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e759e640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0e80d1c00 0x7fc0e8149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e759e640 1 -- 172.21.15.172:0/1622350660 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e81496d0 con 0x7fc0e815dc00 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e6d9d640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0e80c6df0 0x7fc0e80b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0e759e640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e815dc00 0x7fc0e80b6880 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009f40 tx=0x7fc0e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0df7fe640 1 -- 172.21.15.172:0/1622350660 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e003f020 con 0x7fc0e815dc00 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0df7fe640 1 -- 172.21.15.172:0/1622350660 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e0037040 con 0x7fc0e815dc00 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0df7fe640 1 -- 172.21.15.172:0/1622350660 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0036070 con 0x7fc0e815dc00 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/1622350660 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e80b5270 con 0x7fc0e815dc00 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.380+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/1622350660 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e806bd70 con 0x7fc0e815dc00 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.381+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/1622350660 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e8073990 con 0x7fc0e815dc00 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.382+0000 7fc0df7fe640 1 -- 172.21.15.172:0/1622350660 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc0e0042020 con 0x7fc0e815dc00 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.382+0000 7fc0df7fe640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc0c806b500 0x7fc0c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.382+0000 7fc0df7fe640 1 -- 172.21.15.172:0/1622350660 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fc0e00aa480 con 0x7fc0e815dc00 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.382+0000 7fc0e6d9d640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc0c806b500 0x7fc0c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.382+0000 7fc0e6d9d640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc0c806b500 0x7fc0c806d9c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8001660 tx=0x7fc0d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:45.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.386+0000 7fc0df7fe640 1 -- 172.21.15.172:0/1622350660 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc0e0049030 con 0x7fc0e815dc00 2024-04-25T08:46:45.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.623+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/1622350660 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7fc0e80c66c0 con 0x7fc0e815dc00 2024-04-25T08:46:45.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.674+0000 7fc0df7fe640 1 -- 172.21.15.172:0/1622350660 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v232) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc0e00793c0 con 0x7fc0e815dc00 2024-04-25T08:46:45.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/1622350660 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc0c806b500 msgr2=0x7fc0c806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc0c806b500 0x7fc0c806d9c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8001660 tx=0x7fc0d8009040 comp rx=0 tx=0).stop 2024-04-25T08:46:45.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/1622350660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e815dc00 msgr2=0x7fc0e80b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e815dc00 0x7fc0e80b6880 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009f40 tx=0x7fc0e0004a40 comp rx=0 tx=0).stop 2024-04-25T08:46:45.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/1622350660 shutdown_connections 2024-04-25T08:46:45.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc0c806b500 0x7fc0c806d9c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0e80d1c00 0x7fc0e8149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0e815dc00 0x7fc0e80b6880 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 --2- 172.21.15.172:0/1622350660 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0e80c6df0 0x7fc0e80b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/1622350660 >> 172.21.15.172:0/1622350660 conn(0x7fc0e806f5d0 msgr2=0x7fc0e8156a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:45.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/1622350660 shutdown_connections 2024-04-25T08:46:45.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.676+0000 7fc0ed1f9640 1 -- 172.21.15.172:0/1622350660 wait complete. 2024-04-25T08:46:45.679 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:46:45.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.788+0000 7f00af189640 1 Processor -- start 2024-04-25T08:46:45.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.788+0000 7f00af189640 1 -- start start 2024-04-25T08:46:45.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00af189640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8070dc0 0x7f00a806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00af189640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a80d1770 con 0x7f00a80711a0 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00af189640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a8162740 con 0x7f00a815deb0 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00af189640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80b0eb0 con 0x7f00a8070dc0 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a7fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f00a80711a0 0x7f00a80b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58354/0 (socket says 172.21.15.172:58354) 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a7fff640 1 -- 172.21.15.172:0/4035041533 learned_addr learned my addr 172.21.15.172:0/4035041533 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00acf25640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8070dc0 0x7f00a806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319525279 0 0) 0x7f00a80d1770 con 0x7f00a80711a0 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0098003520 con 0x7f00a80711a0 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2828528281 0 0) 0x7f0098003520 con 0x7f00a80711a0 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8070dc0 msgr2=0x7f00a806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8070dc0 0x7f00a806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 >> v1:172.21.15.186:6789/0 conn(0x7f00a815deb0 legacy=0x7f00a815e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a8161980 con 0x7f00a80711a0 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f0094001670 con 0x7f00a80711a0 2024-04-25T08:46:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 >> v1:172.21.15.172:6789/0 conn(0x7f00a80711a0 legacy=0x7f00a80b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00980039e0 0x7f0098003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8070dc0 0x7f0098004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0098004d40 0x7f00980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80b0eb0 con 0x7f0098004d40 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009800bb50 con 0x7f00980039e0 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009800bd20 con 0x7f00a8070dc0 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00ad726640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0098004d40 0x7f00980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.789+0000 7f00acf25640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00980039e0 0x7f0098003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.790+0000 7f00a7fff640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8070dc0 0x7f0098004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.790+0000 7f00ad726640 1 -- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8070dc0 msgr2=0x7f0098004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.790+0000 7f00ad726640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8070dc0 0x7f0098004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.790+0000 7f00ad726640 1 -- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00980039e0 msgr2=0x7f0098003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.790+0000 7f00ad726640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00980039e0 0x7f0098003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.790+0000 7f00ad726640 1 -- 172.21.15.172:0/4035041533 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098003520 con 0x7f0098004d40 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.790+0000 7f00ad726640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0098004d40 0x7f00980051c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f00a0001f90 tx=0x7f0098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0a2d92a444286e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.790+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0001b30 con 0x7f0098004d40 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.791+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a0031620 con 0x7f0098004d40 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.791+0000 7f00a77fe640 1 -- 172.21.15.172:0/4035041533 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0031a10 con 0x7f0098004d40 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.791+0000 7f00af189640 1 -- 172.21.15.172:0/4035041533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0098004d40 msgr2=0x7f00980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.791+0000 7f00af189640 1 --2- 172.21.15.172:0/4035041533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0098004d40 0x7f00980051c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f00a0001f90 tx=0x7f0098005830 comp rx=0 tx=0).stop 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.791+0000 7f00ad726640 1 -- 172.21.15.172:0/4035041533 reap_dead start 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.791+0000 7f00af189640 1 -- 172.21.15.172:0/4035041533 shutdown_connections 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.791+0000 7f00af189640 1 -- 172.21.15.172:0/4035041533 >> 172.21.15.172:0/4035041533 conn(0x7f00a80b3530 msgr2=0x7f00a80b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.791+0000 7f00af189640 1 -- 172.21.15.172:0/4035041533 shutdown_connections 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.791+0000 7f00af189640 1 -- 172.21.15.172:0/4035041533 wait complete. 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.792+0000 7f00af189640 1 Processor -- start 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.792+0000 7f00af189640 1 -- start start 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00af189640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0098004d40 0x7f00a8145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00af189640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a80b1820 0x7f00a80b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00af189640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8154900 0x7f00a8154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00af189640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80b10f0 con 0x7f00a80b1820 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00af189640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a81622b0 con 0x7f0098004d40 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00af189640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a8161f40 con 0x7f00a8154900 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00a7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a80b1820 0x7f00a80b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00a7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a80b1820 0x7f00a80b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48658/0 (socket says 172.21.15.172:48658) 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00a7fff640 1 -- 172.21.15.172:0/2794192464 learned_addr learned my addr 172.21.15.172:0/2794192464 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00acf25640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0098004d40 0x7f00a8145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.793+0000 7f00ad726640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8154900 0x7f00a8154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00a7fff640 1 -- 172.21.15.172:0/2794192464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8154900 msgr2=0x7f00a8154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00a7fff640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8154900 0x7f00a8154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00a7fff640 1 -- 172.21.15.172:0/2794192464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0098004d40 msgr2=0x7f00a8145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00a7fff640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0098004d40 0x7f00a8145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00a7fff640 1 -- 172.21.15.172:0/2794192464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a81533a0 con 0x7f00a80b1820 2024-04-25T08:46:45.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00acf25640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0098004d40 0x7f00a8145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00a7fff640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a80b1820 0x7f00a80b1ca0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0094007340 tx=0x7f0094007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00a57fa640 1 -- 172.21.15.172:0/2794192464 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009400f860 con 0x7f00a80b1820 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00a57fa640 1 -- 172.21.15.172:0/2794192464 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0094018070 con 0x7f00a80b1820 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00af189640 1 -- 172.21.15.172:0/2794192464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a81457b0 con 0x7f00a80b1820 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00a57fa640 1 -- 172.21.15.172:0/2794192464 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009400fc80 con 0x7f00a80b1820 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.794+0000 7f00af189640 1 -- 172.21.15.172:0/2794192464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a8153920 con 0x7f00a80b1820 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.795+0000 7f00af189640 1 -- 172.21.15.172:0/2794192464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a8073a00 con 0x7f00a80b1820 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.795+0000 7f00a57fa640 1 -- 172.21.15.172:0/2794192464 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f009401d460 con 0x7f00a80b1820 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.796+0000 7f00a57fa640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f008c06b4d0 0x7f008c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.796+0000 7f00a57fa640 1 -- 172.21.15.172:0/2794192464 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f009408a190 con 0x7f00a80b1820 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.796+0000 7f00acf25640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f008c06b4d0 0x7f008c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:45.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.796+0000 7f00acf25640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f008c06b4d0 0x7f008c06d990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f009c009bc0 tx=0x7f009c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:45.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.800+0000 7f00a57fa640 1 -- 172.21.15.172:0/2794192464 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f00940590d0 con 0x7f00a80b1820 2024-04-25T08:46:45.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.971+0000 7f00af189640 1 -- 172.21.15.172:0/2794192464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f00a80b0a50 con 0x7f00a80b1820 2024-04-25T08:46:45.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.975+0000 7f00a57fa640 1 -- 172.21.15.172:0/2794192464 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f00940589d0 con 0x7f00a80b1820 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 -- 172.21.15.172:0/2794192464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f008c06b4d0 msgr2=0x7f008c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f008c06b4d0 0x7f008c06d990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f009c009bc0 tx=0x7f009c008040 comp rx=0 tx=0).stop 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 -- 172.21.15.172:0/2794192464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a80b1820 msgr2=0x7f00a80b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a80b1820 0x7f00a80b1ca0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0094007340 tx=0x7f0094007800 comp rx=0 tx=0).stop 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 -- 172.21.15.172:0/2794192464 shutdown_connections 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f008c06b4d0 0x7f008c06d990 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00a8154900 0x7f00a8154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a80b1820 0x7f00a80b1ca0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 --2- 172.21.15.172:0/2794192464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0098004d40 0x7f00a8145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 -- 172.21.15.172:0/2794192464 >> 172.21.15.172:0/2794192464 conn(0x7f00a80b3530 msgr2=0x7f00a80d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 -- 172.21.15.172:0/2794192464 shutdown_connections 2024-04-25T08:46:45.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:45.977+0000 7f00af189640 1 -- 172.21.15.172:0/2794192464 wait complete. 2024-04-25T08:46:45.979 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:46:45.980 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:46:46.019 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:46:46.065 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:46:46.065 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:46.065 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:46.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:46:46.081 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:46:46.081 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:46.098 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:46:46.098 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:46:46.098 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:46.136 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:46:46.136 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:46:46.136 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:46:46.156 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:46:46.156 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:46:46.156 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:46.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.283+0000 7f3195acb640 1 Processor -- start 2024-04-25T08:46:46.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.283+0000 7f3195acb640 1 -- start start 2024-04-25T08:46:46.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f3195acb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31900ce920 0x7f31900ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:46.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f3195acb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f319006d290 0x7f319006d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:46.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f3195acb640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3190144b30 con 0x7f3190144750 2024-04-25T08:46:46.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f3195acb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31900712d0 con 0x7f319006d290 2024-04-25T08:46:46.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f3195acb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31900715b0 con 0x7f31900ce920 2024-04-25T08:46:46.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f318f7fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f3190144750 0x7f319006e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:52288/0 (socket says 172.21.15.172:52288) 2024-04-25T08:46:46.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f318ffff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f319006d290 0x7f319006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:46.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f318f7fe640 1 -- 172.21.15.172:0/3145880126 learned_addr learned my addr 172.21.15.172:0/3145880126 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:46.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f318effd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31900ce920 0x7f31900ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:46.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f318effd640 1 -- 172.21.15.172:0/3145880126 >> v2:172.21.15.186:3300/0 conn(0x7f319006d290 msgr2=0x7f319006d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:46.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f318effd640 1 --2- 172.21.15.172:0/3145880126 >> v2:172.21.15.186:3300/0 conn(0x7f319006d290 0x7f319006d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:46.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f318effd640 1 -- 172.21.15.172:0/3145880126 >> v1:172.21.15.186:6789/0 conn(0x7f3190144750 legacy=0x7f319006e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f318effd640 1 -- 172.21.15.172:0/3145880126 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190071890 con 0x7f31900ce920 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.284+0000 7f318ffff640 1 --2- 172.21.15.172:0/3145880126 >> v2:172.21.15.186:3300/0 conn(0x7f319006d290 0x7f319006d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.285+0000 7f318effd640 1 --2- 172.21.15.172:0/3145880126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31900ce920 0x7f31900ced80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f31800097a0 tx=0x7f318002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb6f656b4f1c7317 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.285+0000 7f318e7fc640 1 -- 172.21.15.172:0/3145880126 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180037070 con 0x7f31900ce920 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.285+0000 7f318e7fc640 1 -- 172.21.15.172:0/3145880126 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3180032440 con 0x7f31900ce920 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.285+0000 7f318e7fc640 1 -- 172.21.15.172:0/3145880126 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180032810 con 0x7f31900ce920 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.286+0000 7f3195acb640 1 -- 172.21.15.172:0/3145880126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31900ce920 msgr2=0x7f31900ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.286+0000 7f3195acb640 1 --2- 172.21.15.172:0/3145880126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31900ce920 0x7f31900ced80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f31800097a0 tx=0x7f318002a180 comp rx=0 tx=0).stop 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.286+0000 7f3195acb640 1 -- 172.21.15.172:0/3145880126 shutdown_connections 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.286+0000 7f3195acb640 1 --2- 172.21.15.172:0/3145880126 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f31900ce920 0x7f31900ced80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.286+0000 7f3195acb640 1 --2- 172.21.15.172:0/3145880126 >> v2:172.21.15.186:3300/0 conn(0x7f319006d290 0x7f319006d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.286+0000 7f3195acb640 1 -- 172.21.15.172:0/3145880126 >> 172.21.15.172:0/3145880126 conn(0x7f319006abe0 msgr2=0x7f319006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.286+0000 7f3195acb640 1 -- 172.21.15.172:0/3145880126 shutdown_connections 2024-04-25T08:46:46.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.286+0000 7f3195acb640 1 -- 172.21.15.172:0/3145880126 wait complete. 2024-04-25T08:46:46.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.287+0000 7f3195acb640 1 Processor -- start 2024-04-25T08:46:46.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.287+0000 7f3195acb640 1 -- start start 2024-04-25T08:46:46.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f3195acb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f319006d290 0x7f3190142410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:46.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f3195acb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31900ce920 0x7f3190142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f3195acb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3190144750 0x7f3190142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f3195acb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319006f020 con 0x7f3190144750 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f3195acb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319006ece0 con 0x7f31900ce920 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f3195acb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3190145450 con 0x7f319006d290 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f318ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3190144750 0x7f3190142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f318ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3190144750 0x7f3190142e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48660/0 (socket says 172.21.15.172:48660) 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f318ffff640 1 -- 172.21.15.172:0/1464521751 learned_addr learned my addr 172.21.15.172:0/1464521751 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f318effd640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31900ce920 0x7f3190142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f318f7fe640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f319006d290 0x7f3190142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f318ffff640 1 -- 172.21.15.172:0/1464521751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f319006d290 msgr2=0x7f3190142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f318ffff640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f319006d290 0x7f3190142410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f318ffff640 1 -- 172.21.15.172:0/1464521751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31900ce920 msgr2=0x7f3190142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f318ffff640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31900ce920 0x7f3190142950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.288+0000 7f318ffff640 1 -- 172.21.15.172:0/1464521751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31901e62d0 con 0x7f3190144750 2024-04-25T08:46:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.289+0000 7f318ffff640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3190144750 0x7f3190142e90 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3188009e60 tx=0x7f318800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:46.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.289+0000 7f3177fff640 1 -- 172.21.15.172:0/1464521751 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188018030 con 0x7f3190144750 2024-04-25T08:46:46.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.289+0000 7f3177fff640 1 -- 172.21.15.172:0/1464521751 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800cdf0 con 0x7f3190144750 2024-04-25T08:46:46.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.289+0000 7f3195acb640 1 -- 172.21.15.172:0/1464521751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31901e65b0 con 0x7f3190144750 2024-04-25T08:46:46.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.289+0000 7f3177fff640 1 -- 172.21.15.172:0/1464521751 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188003bb0 con 0x7f3190144750 2024-04-25T08:46:46.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.289+0000 7f3195acb640 1 -- 172.21.15.172:0/1464521751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31901e6b70 con 0x7f3190144750 2024-04-25T08:46:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.290+0000 7f3195acb640 1 -- 172.21.15.172:0/1464521751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3190073990 con 0x7f3190144750 2024-04-25T08:46:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.290+0000 7f3177fff640 1 -- 172.21.15.172:0/1464521751 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f318801b070 con 0x7f3190144750 2024-04-25T08:46:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.291+0000 7f3177fff640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f317c06b4d0 0x7f317c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.291+0000 7f3177fff640 1 -- 172.21.15.172:0/1464521751 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f318808aa90 con 0x7f3190144750 2024-04-25T08:46:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.291+0000 7f318f7fe640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f317c06b4d0 0x7f317c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:46.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.291+0000 7f318f7fe640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f317c06b4d0 0x7f317c06d990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3184000f60 tx=0x7f3184009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:46.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.295+0000 7f3177fff640 1 -- 172.21.15.172:0/1464521751 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3188010040 con 0x7f3190144750 2024-04-25T08:46:46.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.502+0000 7f3195acb640 1 -- 172.21.15.172:0/1464521751 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31900d0510 con 0x7f3190144750 2024-04-25T08:46:46.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.502+0000 7f3177fff640 1 -- 172.21.15.172:0/1464521751 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f3188059a60 con 0x7f3190144750 2024-04-25T08:46:46.494 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:46.494 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/384277594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":384277594},{"type":"v1","addr":"172.21.15.186:6833","nonce":384277594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6145,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/842443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":842443},{"type":"v1","addr":"172.21.15.186:6835","nonce":842443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6969,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2655968938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2655968938},{"type":"v1","addr":"172.21.15.172:6837","nonce":2655968938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1448808800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1448808800},{"type":"v1","addr":"172.21.15.172:6835","nonce":1448808800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[]} 2024-04-25T08:46:46.494 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 44 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 -- 172.21.15.172:0/1464521751 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f317c06b4d0 msgr2=0x7f317c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f317c06b4d0 0x7f317c06d990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3184000f60 tx=0x7f3184009040 comp rx=0 tx=0).stop 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 -- 172.21.15.172:0/1464521751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3190144750 msgr2=0x7f3190142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3190144750 0x7f3190142e90 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3188009e60 tx=0x7f318800c490 comp rx=0 tx=0).stop 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 -- 172.21.15.172:0/1464521751 shutdown_connections 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f317c06b4d0 0x7f317c06d990 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31900ce920 0x7f3190142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3190144750 0x7f3190142e90 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 --2- 172.21.15.172:0/1464521751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f319006d290 0x7f3190142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 -- 172.21.15.172:0/1464521751 >> 172.21.15.172:0/1464521751 conn(0x7f319006abe0 msgr2=0x7f319006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 -- 172.21.15.172:0/1464521751 shutdown_connections 2024-04-25T08:46:46.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:46.504+0000 7f3195acb640 1 -- 172.21.15.172:0/1464521751 wait complete. 2024-04-25T08:46:46.507 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:46:46.507 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:46:46.507 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:46:46.507 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:46.508 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:46:46.508 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:46:46.508 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:46:46.508 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:46.509 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:46:46.509 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:46:46.509 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:46:46.509 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:46.509 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:46:46.509 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:46:46.510 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:46:46.510 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:46:46.517 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:46:46.517 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:46:46.518 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:46:46.518 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:46:46.526 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:46:46.526 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:46:46.559 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:46:46.559 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:46.560 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:46:46.560 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:46.568 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:46:46.568 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:46.631 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:46:46.632 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:46:46.632 INFO:tasks.ceph.mds.c.smithi172.stderr:2024-04-25T08:46:46.641+0000 7fe3fad94640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-25T08:46:46.648 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:46:47.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-25T08:46:52.526 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:46:52.527 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:46:52.530 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:46:52.530 DEBUG:teuthology.parallel:result is None 2024-04-25T08:46:52.530 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:46:52.613 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:46:52.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.650+0000 7f6080c6b640 1 Processor -- start 2024-04-25T08:46:52.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.650+0000 7f6080c6b640 1 -- start start 2024-04-25T08:46:52.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f6080c6b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f607c15dcd0 0x7f607c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:52.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f6080c6b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c06b8c0 0x7f607c0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:52.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f6080c6b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f607c0b49f0 0x7f607c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:52.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f6080c6b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c0b3450 con 0x7f607c0b49f0 2024-04-25T08:46:52.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f6080c6b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607c0b36f0 con 0x7f607c15dcd0 2024-04-25T08:46:52.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f6080c6b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c0b39d0 con 0x7f607c06b8c0 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f607ad9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f607c0b49f0 0x7f607c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f607ad9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f607c0b49f0 0x7f607c06e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49950/0 (socket says 172.21.15.172:49950) 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f607ad9d640 1 -- 172.21.15.172:0/3896111001 learned_addr learned my addr 172.21.15.172:0/3896111001 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f607a59c640 1 --2- 172.21.15.172:0/3896111001 >> v2:172.21.15.186:3300/0 conn(0x7f607c15dcd0 0x7f607c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f6073fff640 1 --2- 172.21.15.172:0/3896111001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c06b8c0 0x7f607c0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f607ad9d640 1 -- 172.21.15.172:0/3896111001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c06b8c0 msgr2=0x7f607c0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f607ad9d640 1 --2- 172.21.15.172:0/3896111001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c06b8c0 0x7f607c0b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f607ad9d640 1 -- 172.21.15.172:0/3896111001 >> v2:172.21.15.186:3300/0 conn(0x7f607c15dcd0 msgr2=0x7f607c06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f607ad9d640 1 --2- 172.21.15.172:0/3896111001 >> v2:172.21.15.186:3300/0 conn(0x7f607c15dcd0 0x7f607c06d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f607ad9d640 1 -- 172.21.15.172:0/3896111001 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c0b3cb0 con 0x7f607c0b49f0 2024-04-25T08:46:52.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.651+0000 7f607a59c640 1 --2- 172.21.15.172:0/3896111001 >> v2:172.21.15.186:3300/0 conn(0x7f607c15dcd0 0x7f607c06d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:52.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.652+0000 7f607ad9d640 1 --2- 172.21.15.172:0/3896111001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c0b49f0 0x7f607c06e2f0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f607c0712a0 tx=0x7f607402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544b81da01477414 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:52.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.652+0000 7f6079d9b640 1 -- 172.21.15.172:0/3896111001 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074036070 con 0x7f607c0b49f0 2024-04-25T08:46:52.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.652+0000 7f6079d9b640 1 -- 172.21.15.172:0/3896111001 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074031600 con 0x7f607c0b49f0 2024-04-25T08:46:52.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.652+0000 7f6079d9b640 1 -- 172.21.15.172:0/3896111001 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60740319d0 con 0x7f607c0b49f0 2024-04-25T08:46:52.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.653+0000 7f6080c6b640 1 -- 172.21.15.172:0/3896111001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c0b49f0 msgr2=0x7f607c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:52.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.653+0000 7f6080c6b640 1 --2- 172.21.15.172:0/3896111001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c0b49f0 0x7f607c06e2f0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f607c0712a0 tx=0x7f607402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:46:52.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.653+0000 7f6080c6b640 1 -- 172.21.15.172:0/3896111001 shutdown_connections 2024-04-25T08:46:52.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.653+0000 7f6080c6b640 1 --2- 172.21.15.172:0/3896111001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c0b49f0 0x7f607c06e2f0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:52.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.653+0000 7f6080c6b640 1 --2- 172.21.15.172:0/3896111001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c06b8c0 0x7f607c0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:52.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.653+0000 7f6080c6b640 1 --2- 172.21.15.172:0/3896111001 >> v2:172.21.15.186:3300/0 conn(0x7f607c15dcd0 0x7f607c06d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:52.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.653+0000 7f6080c6b640 1 -- 172.21.15.172:0/3896111001 >> 172.21.15.172:0/3896111001 conn(0x7f607c06abe0 msgr2=0x7f607c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:52.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.653+0000 7f6080c6b640 1 -- 172.21.15.172:0/3896111001 shutdown_connections 2024-04-25T08:46:52.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.653+0000 7f6080c6b640 1 -- 172.21.15.172:0/3896111001 wait complete. 2024-04-25T08:46:52.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.654+0000 7f6080c6b640 1 Processor -- start 2024-04-25T08:46:52.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.654+0000 7f6080c6b640 1 -- start start 2024-04-25T08:46:52.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f6080c6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c06b8c0 0x7f607c15ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:52.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f6080c6b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c0b49f0 0x7f607c160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:52.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f6080c6b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f607c15dcd0 0x7f607c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:52.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f6080c6b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c06dda0 con 0x7f607c06b8c0 2024-04-25T08:46:52.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f6080c6b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c06dc20 con 0x7f607c15dcd0 2024-04-25T08:46:52.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f6080c6b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c06e830 con 0x7f607c0b49f0 2024-04-25T08:46:52.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f607a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c06b8c0 0x7f607c15ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:52.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f607a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c06b8c0 0x7f607c15ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49966/0 (socket says 172.21.15.172:49966) 2024-04-25T08:46:52.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f607a59c640 1 -- 172.21.15.172:0/2567954808 learned_addr learned my addr 172.21.15.172:0/2567954808 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:52.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f607ad9d640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f607c15dcd0 0x7f607c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:52.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f6073fff640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c0b49f0 0x7f607c160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:52.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f607a59c640 1 -- 172.21.15.172:0/2567954808 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c0b49f0 msgr2=0x7f607c160950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:52.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f607a59c640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c0b49f0 0x7f607c160950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:52.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f607a59c640 1 -- 172.21.15.172:0/2567954808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f607c15dcd0 msgr2=0x7f607c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:52.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.655+0000 7f607a59c640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f607c15dcd0 0x7f607c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:52.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.656+0000 7f607a59c640 1 -- 172.21.15.172:0/2567954808 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c15bf50 con 0x7f607c06b8c0 2024-04-25T08:46:52.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.656+0000 7f6073fff640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c0b49f0 0x7f607c160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.656+0000 7f607a59c640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c06b8c0 0x7f607c15ba10 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f606c00e960 tx=0x7f606c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.656+0000 7f6072ffd640 1 -- 172.21.15.172:0/2567954808 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c017070 con 0x7f607c06b8c0 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.656+0000 7f6072ffd640 1 -- 172.21.15.172:0/2567954808 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c00ca00 con 0x7f607c06b8c0 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.656+0000 7f6080c6b640 1 -- 172.21.15.172:0/2567954808 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c159ed0 con 0x7f607c06b8c0 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.656+0000 7f6072ffd640 1 -- 172.21.15.172:0/2567954808 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c00cdd0 con 0x7f607c06b8c0 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.656+0000 7f6080c6b640 1 -- 172.21.15.172:0/2567954808 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c15a490 con 0x7f607c06b8c0 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.657+0000 7f6080c6b640 1 -- 172.21.15.172:0/2567954808 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c073a00 con 0x7f607c06b8c0 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.657+0000 7f6072ffd640 1 -- 172.21.15.172:0/2567954808 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f606c01a070 con 0x7f607c06b8c0 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.658+0000 7f6072ffd640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f605c06b4d0 0x7f605c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.658+0000 7f6072ffd640 1 -- 172.21.15.172:0/2567954808 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f606c08a010 con 0x7f607c06b8c0 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.658+0000 7f6073fff640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f605c06b4d0 0x7f605c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:52.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.658+0000 7f6073fff640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f605c06b4d0 0x7f605c06d990 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f607c06fce0 tx=0x7f6064008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:52.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.662+0000 7f6072ffd640 1 -- 172.21.15.172:0/2567954808 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f606c058f50 con 0x7f607c06b8c0 2024-04-25T08:46:52.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:52.845+0000 7f6080c6b640 1 -- 172.21.15.172:0/2567954808 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f607c0685d0 con 0x7f607c06b8c0 2024-04-25T08:46:53.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.690+0000 7f6072ffd640 1 -- 172.21.15.172:0/2567954808 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7f606c058850 con 0x7f607c06b8c0 2024-04-25T08:46:53.681 INFO:teuthology.orchestra.run.smithi172.stderr: removed all blocklist entries 2024-04-25T08:46:53.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.692+0000 7f6080c6b640 1 -- 172.21.15.172:0/2567954808 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f605c06b4d0 msgr2=0x7f605c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:53.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.692+0000 7f6080c6b640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f605c06b4d0 0x7f605c06d990 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f607c06fce0 tx=0x7f6064008040 comp rx=0 tx=0).stop 2024-04-25T08:46:53.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.692+0000 7f6080c6b640 1 -- 172.21.15.172:0/2567954808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c06b8c0 msgr2=0x7f607c15ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:53.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.692+0000 7f6080c6b640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c06b8c0 0x7f607c15ba10 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f606c00e960 tx=0x7f606c00ee20 comp rx=0 tx=0).stop 2024-04-25T08:46:53.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.692+0000 7f6080c6b640 1 -- 172.21.15.172:0/2567954808 shutdown_connections 2024-04-25T08:46:53.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.692+0000 7f6080c6b640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f605c06b4d0 0x7f605c06d990 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:53.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.692+0000 7f6080c6b640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f607c15dcd0 0x7f607c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:53.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.692+0000 7f6080c6b640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f607c0b49f0 0x7f607c160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:53.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.692+0000 7f6080c6b640 1 --2- 172.21.15.172:0/2567954808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f607c06b8c0 0x7f607c15ba10 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:53.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.692+0000 7f6080c6b640 1 -- 172.21.15.172:0/2567954808 >> 172.21.15.172:0/2567954808 conn(0x7f607c06abe0 msgr2=0x7f607c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:53.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.693+0000 7f6080c6b640 1 -- 172.21.15.172:0/2567954808 shutdown_connections 2024-04-25T08:46:53.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.693+0000 7f6080c6b640 1 -- 172.21.15.172:0/2567954808 wait complete. 2024-04-25T08:46:53.696 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:46:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.804+0000 7f1b84c9c640 1 Processor -- start 2024-04-25T08:46:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.804+0000 7f1b84c9c640 1 -- start start 2024-04-25T08:46:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b84c9c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 0x7f1b800d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b84c9c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1b800c7b90 0x7f1b8006c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b84c9c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b800c8030 con 0x7f1b800c7730 2024-04-25T08:46:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b84c9c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b800c8310 con 0x7f1b800c7b90 2024-04-25T08:46:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b84c9c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b800c85f0 con 0x7f1b8015da70 2024-04-25T08:46:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b7ed9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1b800c7b90 0x7f1b8006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b7e59c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 0x7f1b800d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b7ed9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1b800c7b90 0x7f1b8006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:39938/0 (socket says 172.21.15.172:39938) 2024-04-25T08:46:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b7ed9d640 1 -- 172.21.15.172:0/3235159015 learned_addr learned my addr 172.21.15.172:0/3235159015 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b7e59c640 1 -- 172.21.15.172:0/3235159015 >> v2:172.21.15.186:3300/0 conn(0x7f1b800c7b90 msgr2=0x7f1b8006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b7e59c640 1 --2- 172.21.15.172:0/3235159015 >> v2:172.21.15.186:3300/0 conn(0x7f1b800c7b90 0x7f1b8006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b7e59c640 1 -- 172.21.15.172:0/3235159015 >> v1:172.21.15.186:6789/0 conn(0x7f1b800c7730 legacy=0x7f1b800ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b7e59c640 1 -- 172.21.15.172:0/3235159015 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8006bb30 con 0x7f1b8015da70 2024-04-25T08:46:53.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.805+0000 7f1b7ed9d640 1 --2- 172.21.15.172:0/3235159015 >> v2:172.21.15.186:3300/0 conn(0x7f1b800c7b90 0x7f1b8006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:53.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.806+0000 7f1b7e59c640 1 --2- 172.21.15.172:0/3235159015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 0x7f1b800d0170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b700097a0 tx=0x7f1b7002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c9d4ff16596701 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:53.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.806+0000 7f1b7dd9b640 1 -- 172.21.15.172:0/3235159015 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70037070 con 0x7f1b8015da70 2024-04-25T08:46:53.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.806+0000 7f1b7dd9b640 1 -- 172.21.15.172:0/3235159015 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b70032440 con 0x7f1b8015da70 2024-04-25T08:46:53.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.806+0000 7f1b7dd9b640 1 -- 172.21.15.172:0/3235159015 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70032810 con 0x7f1b8015da70 2024-04-25T08:46:53.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.807+0000 7f1b84c9c640 1 -- 172.21.15.172:0/3235159015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 msgr2=0x7f1b800d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:53.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.807+0000 7f1b84c9c640 1 --2- 172.21.15.172:0/3235159015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 0x7f1b800d0170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b700097a0 tx=0x7f1b7002a180 comp rx=0 tx=0).stop 2024-04-25T08:46:53.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.807+0000 7f1b84c9c640 1 -- 172.21.15.172:0/3235159015 shutdown_connections 2024-04-25T08:46:53.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.807+0000 7f1b84c9c640 1 --2- 172.21.15.172:0/3235159015 >> v2:172.21.15.186:3300/0 conn(0x7f1b800c7b90 0x7f1b8006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:53.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.807+0000 7f1b84c9c640 1 --2- 172.21.15.172:0/3235159015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 0x7f1b800d0170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:53.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.807+0000 7f1b84c9c640 1 -- 172.21.15.172:0/3235159015 >> 172.21.15.172:0/3235159015 conn(0x7f1b800b33e0 msgr2=0x7f1b800b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:53.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.807+0000 7f1b84c9c640 1 -- 172.21.15.172:0/3235159015 shutdown_connections 2024-04-25T08:46:53.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.807+0000 7f1b84c9c640 1 -- 172.21.15.172:0/3235159015 wait complete. 2024-04-25T08:46:53.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.808+0000 7f1b84c9c640 1 Processor -- start 2024-04-25T08:46:53.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.808+0000 7f1b84c9c640 1 -- start start 2024-04-25T08:46:53.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b84c9c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b800c7730 0x7f1b800c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b84c9c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b800c7b90 0x7f1b80159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b84c9c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 0x7f1b800b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b84c9c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b800ce8d0 con 0x7f1b800c7730 2024-04-25T08:46:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b84c9c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8015de50 con 0x7f1b800c7b90 2024-04-25T08:46:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b84c9c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b800cea50 con 0x7f1b8015da70 2024-04-25T08:46:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b7e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b800c7730 0x7f1b800c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b7e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b800c7730 0x7f1b800c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49978/0 (socket says 172.21.15.172:49978) 2024-04-25T08:46:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b7e59c640 1 -- 172.21.15.172:0/2845819809 learned_addr learned my addr 172.21.15.172:0/2845819809 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b77fff640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b800c7b90 0x7f1b80159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:53.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b7ed9d640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 0x7f1b800b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b7e59c640 1 -- 172.21.15.172:0/2845819809 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 msgr2=0x7f1b800b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b7e59c640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 0x7f1b800b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b7e59c640 1 -- 172.21.15.172:0/2845819809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b800c7b90 msgr2=0x7f1b80159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b7e59c640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b800c7b90 0x7f1b80159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b7e59c640 1 -- 172.21.15.172:0/2845819809 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800c9180 con 0x7f1b800c7730 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.809+0000 7f1b77fff640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b800c7b90 0x7f1b80159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.810+0000 7f1b7e59c640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b800c7730 0x7f1b800c8880 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f1b7002a1c0 tx=0x7f1b700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.810+0000 7f1b76ffd640 1 -- 172.21.15.172:0/2845819809 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70037040 con 0x7f1b800c7730 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.810+0000 7f1b76ffd640 1 -- 172.21.15.172:0/2845819809 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b70042070 con 0x7f1b800c7730 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.810+0000 7f1b76ffd640 1 -- 172.21.15.172:0/2845819809 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70030920 con 0x7f1b800c7730 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.810+0000 7f1b84c9c640 1 -- 172.21.15.172:0/2845819809 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b800c9460 con 0x7f1b800c7730 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.810+0000 7f1b84c9c640 1 -- 172.21.15.172:0/2845819809 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b800c9a20 con 0x7f1b800c7730 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.811+0000 7f1b84c9c640 1 -- 172.21.15.172:0/2845819809 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b800ca220 con 0x7f1b800c7730 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.811+0000 7f1b76ffd640 1 -- 172.21.15.172:0/2845819809 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1b70030ac0 con 0x7f1b800c7730 2024-04-25T08:46:53.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.812+0000 7f1b76ffd640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b6006b4d0 0x7f1b6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:53.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.812+0000 7f1b76ffd640 1 -- 172.21.15.172:0/2845819809 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1b700aa970 con 0x7f1b800c7730 2024-04-25T08:46:53.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.812+0000 7f1b77fff640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b6006b4d0 0x7f1b6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:53.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.812+0000 7f1b77fff640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b6006b4d0 0x7f1b6006d990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1b800ac9d0 tx=0x7f1b68009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:53.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:53.816+0000 7f1b76ffd640 1 -- 172.21.15.172:0/2845819809 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b700793f0 con 0x7f1b800c7730 2024-04-25T08:46:54.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.051+0000 7f1b84c9c640 1 -- 172.21.15.172:0/2845819809 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1b800b7580 con 0x7f1b800c7730 2024-04-25T08:46:54.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.051+0000 7f1b76ffd640 1 -- 172.21.15.172:0/2845819809 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1b7007d490 con 0x7f1b800c7730 2024-04-25T08:46:54.043 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:54.043 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: "auth_dump": [ 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.a", 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q==", 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.045 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.b", 2024-04-25T08:46:54.045 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg==", 2024-04-25T08:46:54.045 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:54.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:46:54.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:46:54.045 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.045 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.c", 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA==", 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.d", 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg==", 2024-04-25T08:46:54.046 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.0", 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ==", 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.1", 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g==", 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.049 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.2", 2024-04-25T08:46:54.049 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g==", 2024-04-25T08:46:54.049 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.049 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:54.049 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:54.049 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.049 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.3", 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg==", 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.4", 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw==", 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.050 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.5", 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow==", 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.051 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.6", 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg==", 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.7", 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q==", 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:46:54.052 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.0", 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q==", 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow r", 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.1", 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g==", 2024-04-25T08:46:54.053 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.2", 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw==", 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:46:54.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.3", 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w==", 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.admin", 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmFmQsIBAAkuAmqIptAT1ivH6T7/1T8A==", 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.x", 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw==", 2024-04-25T08:46:54.056 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.y", 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg==", 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-25T08:46:54.057 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:46:54.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.053+0000 7f1b84c9c640 1 -- 172.21.15.172:0/2845819809 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b6006b4d0 msgr2=0x7f1b6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.053+0000 7f1b84c9c640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b6006b4d0 0x7f1b6006d990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1b800ac9d0 tx=0x7f1b68009040 comp rx=0 tx=0).stop 2024-04-25T08:46:54.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.053+0000 7f1b84c9c640 1 -- 172.21.15.172:0/2845819809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b800c7730 msgr2=0x7f1b800c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.053+0000 7f1b84c9c640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b800c7730 0x7f1b800c8880 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f1b7002a1c0 tx=0x7f1b700046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.053+0000 7f1b84c9c640 1 -- 172.21.15.172:0/2845819809 shutdown_connections 2024-04-25T08:46:54.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.053+0000 7f1b84c9c640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b6006b4d0 0x7f1b6006d990 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.053+0000 7f1b84c9c640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b800c7b90 0x7f1b80159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.053+0000 7f1b84c9c640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b8015da70 0x7f1b800b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.053+0000 7f1b84c9c640 1 --2- 172.21.15.172:0/2845819809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b800c7730 0x7f1b800c8880 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.053+0000 7f1b84c9c640 1 -- 172.21.15.172:0/2845819809 >> 172.21.15.172:0/2845819809 conn(0x7f1b800b33e0 msgr2=0x7f1b800cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:54.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.054+0000 7f1b84c9c640 1 -- 172.21.15.172:0/2845819809 shutdown_connections 2024-04-25T08:46:54.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.054+0000 7f1b84c9c640 1 -- 172.21.15.172:0/2845819809 wait complete. 2024-04-25T08:46:54.060 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:54.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.166+0000 7ff3cf7be640 1 Processor -- start 2024-04-25T08:46:54.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.166+0000 7ff3cf7be640 1 -- start start 2024-04-25T08:46:54.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.167+0000 7ff3cf7be640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff3c815dd30 0x7ff3c80b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.167+0000 7ff3cf7be640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c80d0ad0 0x7ff3c80b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.167+0000 7ff3cf7be640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c80d1df0 con 0x7ff3c80b9770 2024-04-25T08:46:54.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.167+0000 7ff3cf7be640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c80d20d0 con 0x7ff3c815dd30 2024-04-25T08:46:54.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.167+0000 7ff3cf7be640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80d23b0 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3cdd5b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c80d0ad0 0x7ff3c80b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3cd55a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff3c815dd30 0x7ff3c80b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3cdd5b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c80d0ad0 0x7ff3c80b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:60664/0 (socket says 172.21.15.172:60664) 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3cdd5b640 1 -- 172.21.15.172:0/1069309734 learned_addr learned my addr 172.21.15.172:0/1069309734 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3cd55a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff3c815dd30 0x7ff3c80b9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:39958/0 (socket says 172.21.15.172:39958) 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3ccd59640 1 --1- 172.21.15.172:0/1069309734 >> v1:172.21.15.186:6789/0 conn(0x7ff3c80b9770 0x7ff3c80d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:48568/0 (socket says 172.21.15.172:48568) 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3cdd5b640 1 -- 172.21.15.172:0/1069309734 >> v2:172.21.15.186:3300/0 conn(0x7ff3c815dd30 msgr2=0x7ff3c80b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3cdd5b640 1 --2- 172.21.15.172:0/1069309734 >> v2:172.21.15.186:3300/0 conn(0x7ff3c815dd30 0x7ff3c80b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3cdd5b640 1 -- 172.21.15.172:0/1069309734 >> v1:172.21.15.186:6789/0 conn(0x7ff3c80b9770 legacy=0x7ff3c80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3cdd5b640 1 -- 172.21.15.172:0/1069309734 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80d2690 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.168+0000 7ff3cd55a640 1 --2- 172.21.15.172:0/1069309734 >> v2:172.21.15.186:3300/0 conn(0x7ff3c815dd30 0x7ff3c80b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.169+0000 7ff3cdd5b640 1 --2- 172.21.15.172:0/1069309734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c80d0ad0 0x7ff3c80b6a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009870 tx=0x7ff3c002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b7001fddf6743df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.169+0000 7ff3bffff640 1 -- 172.21.15.172:0/1069309734 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0037070 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.169+0000 7ff3bffff640 1 -- 172.21.15.172:0/1069309734 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0032440 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.169+0000 7ff3bffff640 1 -- 172.21.15.172:0/1069309734 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0032810 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.169+0000 7ff3cf7be640 1 -- 172.21.15.172:0/1069309734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c80d0ad0 msgr2=0x7ff3c80b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.169+0000 7ff3cf7be640 1 --2- 172.21.15.172:0/1069309734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c80d0ad0 0x7ff3c80b6a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009870 tx=0x7ff3c002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.170+0000 7ff3cf7be640 1 -- 172.21.15.172:0/1069309734 shutdown_connections 2024-04-25T08:46:54.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.170+0000 7ff3cf7be640 1 --2- 172.21.15.172:0/1069309734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c80d0ad0 0x7ff3c80b6a40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.170+0000 7ff3cf7be640 1 --2- 172.21.15.172:0/1069309734 >> v2:172.21.15.186:3300/0 conn(0x7ff3c815dd30 0x7ff3c80b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.170+0000 7ff3cf7be640 1 -- 172.21.15.172:0/1069309734 >> 172.21.15.172:0/1069309734 conn(0x7ff3c8061c30 msgr2=0x7ff3c806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:54.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.170+0000 7ff3cf7be640 1 -- 172.21.15.172:0/1069309734 shutdown_connections 2024-04-25T08:46:54.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.170+0000 7ff3cf7be640 1 -- 172.21.15.172:0/1069309734 wait complete. 2024-04-25T08:46:54.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.171+0000 7ff3cf7be640 1 Processor -- start 2024-04-25T08:46:54.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.171+0000 7ff3cf7be640 1 -- start start 2024-04-25T08:46:54.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3cf7be640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3c80b9770 0x7ff3c8157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3cf7be640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c80d0ad0 0x7ff3c815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3cf7be640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c815dd30 0x7ff3c81f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3cf7be640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80d1b90 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3cf7be640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80d1a10 con 0x7ff3c80b9770 2024-04-25T08:46:54.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3cf7be640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80d2e90 con 0x7ff3c815dd30 2024-04-25T08:46:54.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3ccd59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c80d0ad0 0x7ff3c815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3ccd59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c80d0ad0 0x7ff3c815b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49984/0 (socket says 172.21.15.172:49984) 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3ccd59640 1 -- 172.21.15.172:0/563684583 learned_addr learned my addr 172.21.15.172:0/563684583 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3cd55a640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3c80b9770 0x7ff3c8157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3cdd5b640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c815dd30 0x7ff3c81f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3ccd59640 1 -- 172.21.15.172:0/563684583 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c815dd30 msgr2=0x7ff3c81f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3ccd59640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c815dd30 0x7ff3c81f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3ccd59640 1 -- 172.21.15.172:0/563684583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3c80b9770 msgr2=0x7ff3c8157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3ccd59640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3c80b9770 0x7ff3c8157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3ccd59640 1 -- 172.21.15.172:0/563684583 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c81f4590 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3ccd59640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c80d0ad0 0x7ff3c815b1c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800c400 tx=0x7ff3b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3bdffb640 1 -- 172.21.15.172:0/563684583 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8017070 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3bdffb640 1 -- 172.21.15.172:0/563684583 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b8005c70 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3cf7be640 1 -- 172.21.15.172:0/563684583 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c81589d0 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.172+0000 7ff3bdffb640 1 -- 172.21.15.172:0/563684583 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8005e60 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.173+0000 7ff3cf7be640 1 -- 172.21.15.172:0/563684583 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c8158f90 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.174+0000 7ff3cf7be640 1 -- 172.21.15.172:0/563684583 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c8073990 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.174+0000 7ff3bdffb640 1 -- 172.21.15.172:0/563684583 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff3b801a070 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.174+0000 7ff3bdffb640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff3ac06b500 0x7ff3ac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.174+0000 7ff3bdffb640 1 -- 172.21.15.172:0/563684583 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ff3b8089280 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.174+0000 7ff3cd55a640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff3ac06b500 0x7ff3ac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.175+0000 7ff3cd55a640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff3ac06b500 0x7ff3ac06d9c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff3c815f2d0 tx=0x7ff3c400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:54.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.178+0000 7ff3bdffb640 1 -- 172.21.15.172:0/563684583 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff3b8057c70 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-25T08:46:54.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.350+0000 7ff3cf7be640 1 -- 172.21.15.172:0/563684583 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3c80ca2f0 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.351+0000 7ff3bdffb640 1 -- 172.21.15.172:0/563684583 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+13225 (secure 0 0 0) 0x7ff3b805bd10 con 0x7ff3c80d0ad0 2024-04-25T08:46:54.343 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:54.343 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":77,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:53.690092+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 -- 172.21.15.172:0/563684583 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff3ac06b500 msgr2=0x7ff3ac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff3ac06b500 0x7ff3ac06d9c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff3c815f2d0 tx=0x7ff3c400b040 comp rx=0 tx=0).stop 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 -- 172.21.15.172:0/563684583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c80d0ad0 msgr2=0x7ff3c815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c80d0ad0 0x7ff3c815b1c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff3b800c400 tx=0x7ff3b800c8c0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 -- 172.21.15.172:0/563684583 shutdown_connections 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff3ac06b500 0x7ff3ac06d9c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3c815dd30 0x7ff3c81f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3c80d0ad0 0x7ff3c815b1c0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 --2- 172.21.15.172:0/563684583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff3c80b9770 0x7ff3c8157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 -- 172.21.15.172:0/563684583 >> 172.21.15.172:0/563684583 conn(0x7ff3c8061c30 msgr2=0x7ff3c80c85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:54.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 -- 172.21.15.172:0/563684583 shutdown_connections 2024-04-25T08:46:54.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.353+0000 7ff3cf7be640 1 -- 172.21.15.172:0/563684583 wait complete. 2024-04-25T08:46:54.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:46:54.356 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:46:54.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.465+0000 7f36637a9640 1 Processor -- start 2024-04-25T08:46:54.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.466+0000 7f36637a9640 1 -- start start 2024-04-25T08:46:54.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.466+0000 7f36637a9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f365c0cc4f0 0x7f365c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.466+0000 7f36637a9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f365c0cdb20 0x7f365c0cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.466+0000 7f36637a9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c072280 con 0x7f365c15b270 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.466+0000 7f36637a9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c071270 con 0x7f365c0cdb20 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.466+0000 7f36637a9640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c15bd80 con 0x7f365c0cc4f0 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.466+0000 7f3660d44640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f365c0cdb20 0x7f365c0cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.467+0000 7f3661d46640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f365c15b270 0x7f365c15b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55968/0 (socket says 172.21.15.172:55968) 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.467+0000 7f3661d46640 1 -- 172.21.15.172:0/3050038201 learned_addr learned my addr 172.21.15.172:0/3050038201 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.467+0000 7f3661545640 1 --2- 172.21.15.172:0/3050038201 >> v2:172.21.15.186:3300/0 conn(0x7f365c0cc4f0 0x7f365c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.467+0000 7f3660d44640 1 -- 172.21.15.172:0/3050038201 >> v2:172.21.15.186:3300/0 conn(0x7f365c0cc4f0 msgr2=0x7f365c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.467+0000 7f3660d44640 1 --2- 172.21.15.172:0/3050038201 >> v2:172.21.15.186:3300/0 conn(0x7f365c0cc4f0 0x7f365c0cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.467+0000 7f3660d44640 1 -- 172.21.15.172:0/3050038201 >> v1:172.21.15.172:6789/0 conn(0x7f365c15b270 legacy=0x7f365c15b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.467+0000 7f3660d44640 1 -- 172.21.15.172:0/3050038201 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0714c0 con 0x7f365c0cdb20 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.467+0000 7f3653fff640 1 -- 172.21.15.172:0/3050038201 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913538352 0 0) 0x7f365c072280 con 0x7f365c15b270 2024-04-25T08:46:54.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.467+0000 7f3660d44640 1 --2- 172.21.15.172:0/3050038201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 0x7f365c0cdfb0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f365c0cd290 tx=0x7f364c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3465fb535550495 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:54.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f3653fff640 1 -- 172.21.15.172:0/3050038201 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c037070 con 0x7f365c0cdb20 2024-04-25T08:46:54.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f3653fff640 1 -- 172.21.15.172:0/3050038201 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c032440 con 0x7f365c0cdb20 2024-04-25T08:46:54.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f3653fff640 1 -- 172.21.15.172:0/3050038201 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c032810 con 0x7f365c0cdb20 2024-04-25T08:46:54.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f36637a9640 1 -- 172.21.15.172:0/3050038201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 msgr2=0x7f365c0cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f36637a9640 1 --2- 172.21.15.172:0/3050038201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 0x7f365c0cdfb0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f365c0cd290 tx=0x7f364c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f36637a9640 1 -- 172.21.15.172:0/3050038201 shutdown_connections 2024-04-25T08:46:54.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f36637a9640 1 --2- 172.21.15.172:0/3050038201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 0x7f365c0cdfb0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f36637a9640 1 --2- 172.21.15.172:0/3050038201 >> v2:172.21.15.186:3300/0 conn(0x7f365c0cc4f0 0x7f365c0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f36637a9640 1 -- 172.21.15.172:0/3050038201 >> 172.21.15.172:0/3050038201 conn(0x7f365c06abe0 msgr2=0x7f365c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:54.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f36637a9640 1 -- 172.21.15.172:0/3050038201 shutdown_connections 2024-04-25T08:46:54.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.468+0000 7f36637a9640 1 -- 172.21.15.172:0/3050038201 wait complete. 2024-04-25T08:46:54.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f36637a9640 1 Processor -- start 2024-04-25T08:46:54.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f36637a9640 1 -- start start 2024-04-25T08:46:54.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f36637a9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f365c0cc4f0 0x7f365c0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f36637a9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 0x7f365c1f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f36637a9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f365c15b270 0x7f365c15c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f36637a9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c071d60 con 0x7f365c0cdb20 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f36637a9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c071a80 con 0x7f365c15b270 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f36637a9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0ae500 con 0x7f365c0cc4f0 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f3660d44640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 0x7f365c1f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f3660d44640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 0x7f365c1f0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50000/0 (socket says 172.21.15.172:50000) 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f3660d44640 1 -- 172.21.15.172:0/38034715 learned_addr learned my addr 172.21.15.172:0/38034715 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f3661545640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f365c0cc4f0 0x7f365c0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.470+0000 7f3661d46640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f365c15b270 0x7f365c15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f3660d44640 1 -- 172.21.15.172:0/38034715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f365c0cc4f0 msgr2=0x7f365c0b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f3660d44640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f365c0cc4f0 0x7f365c0b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f3660d44640 1 -- 172.21.15.172:0/38034715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f365c15b270 msgr2=0x7f365c15c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f3660d44640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f365c15b270 0x7f365c15c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f3660d44640 1 -- 172.21.15.172:0/38034715 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c1f0f70 con 0x7f365c0cdb20 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f3660d44640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 0x7f365c1f0480 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f364c000c00 tx=0x7f364c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:54.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f3651ffb640 1 -- 172.21.15.172:0/38034715 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c037040 con 0x7f365c0cdb20 2024-04-25T08:46:54.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f3651ffb640 1 -- 172.21.15.172:0/38034715 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c030ae0 con 0x7f365c0cdb20 2024-04-25T08:46:54.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f3651ffb640 1 -- 172.21.15.172:0/38034715 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c044480 con 0x7f365c0cdb20 2024-04-25T08:46:54.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f36637a9640 1 -- 172.21.15.172:0/38034715 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c1f1250 con 0x7f365c0cdb20 2024-04-25T08:46:54.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.471+0000 7f36637a9640 1 -- 172.21.15.172:0/38034715 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c1f1b70 con 0x7f365c0cdb20 2024-04-25T08:46:54.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.472+0000 7f36637a9640 1 -- 172.21.15.172:0/38034715 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365c0cd6e0 con 0x7f365c0cdb20 2024-04-25T08:46:54.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.473+0000 7f3651ffb640 1 -- 172.21.15.172:0/38034715 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f364c04d3f0 con 0x7f365c0cdb20 2024-04-25T08:46:54.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.473+0000 7f3651ffb640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f364006b4d0 0x7f364006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.473+0000 7f3651ffb640 1 -- 172.21.15.172:0/38034715 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f364c0ac580 con 0x7f365c0cdb20 2024-04-25T08:46:54.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.473+0000 7f3661545640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f364006b4d0 0x7f364006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.473+0000 7f3661545640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f364006b4d0 0x7f364006d990 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3658003aa0 tx=0x7f3658009830 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:54.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.477+0000 7f3651ffb640 1 -- 172.21.15.172:0/38034715 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f365c0cd6e0 con 0x7f365c0cdb20 2024-04-25T08:46:54.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.649+0000 7f36637a9640 1 -- 172.21.15.172:0/38034715 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f365c073a00 con 0x7f365c0cdb20 2024-04-25T08:46:54.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.650+0000 7f3651ffb640 1 -- 172.21.15.172:0/38034715 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f364c07b000 con 0x7f365c0cdb20 2024-04-25T08:46:54.641 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:46:54.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.651+0000 7f36637a9640 1 -- 172.21.15.172:0/38034715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f364006b4d0 msgr2=0x7f364006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.651+0000 7f36637a9640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f364006b4d0 0x7f364006d990 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3658003aa0 tx=0x7f3658009830 comp rx=0 tx=0).stop 2024-04-25T08:46:54.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.651+0000 7f36637a9640 1 -- 172.21.15.172:0/38034715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 msgr2=0x7f365c1f0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.651+0000 7f36637a9640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 0x7f365c1f0480 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f364c000c00 tx=0x7f364c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.652+0000 7f36637a9640 1 -- 172.21.15.172:0/38034715 shutdown_connections 2024-04-25T08:46:54.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.652+0000 7f36637a9640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f364006b4d0 0x7f364006d990 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.652+0000 7f36637a9640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f365c15b270 0x7f365c15c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.652+0000 7f36637a9640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f365c0cdb20 0x7f365c1f0480 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.652+0000 7f36637a9640 1 --2- 172.21.15.172:0/38034715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f365c0cc4f0 0x7f365c0b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.652+0000 7f36637a9640 1 -- 172.21.15.172:0/38034715 >> 172.21.15.172:0/38034715 conn(0x7f365c06abe0 msgr2=0x7f365c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:54.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.652+0000 7f36637a9640 1 -- 172.21.15.172:0/38034715 shutdown_connections 2024-04-25T08:46:54.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.652+0000 7f36637a9640 1 -- 172.21.15.172:0/38034715 wait complete. 2024-04-25T08:46:54.655 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:46:54.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.761+0000 7fa6f69cf640 1 Processor -- start 2024-04-25T08:46:54.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.761+0000 7fa6f69cf640 1 -- start start 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.762+0000 7fa6f69cf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa6f015ba00 0x7fa6f009a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.762+0000 7fa6f69cf640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa6f015f5f0 0x7fa6f015fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.762+0000 7fa6f69cf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f00cd710 con 0x7fa6f01602e0 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.762+0000 7fa6f69cf640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f015ff80 con 0x7fa6f015ba00 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.762+0000 7fa6f69cf640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f00cd4b0 con 0x7fa6f015f5f0 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.762+0000 7fa6effff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa6f015ba00 0x7fa6f009a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.762+0000 7fa6ef7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa6f01602e0 0x7fa6f00ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55984/0 (socket says 172.21.15.172:55984) 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.762+0000 7fa6ef7fe640 1 -- 172.21.15.172:0/2142356982 learned_addr learned my addr 172.21.15.172:0/2142356982 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.763+0000 7fa6f4f6c640 1 --2- 172.21.15.172:0/2142356982 >> v2:172.21.15.186:3300/0 conn(0x7fa6f015f5f0 0x7fa6f015fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.763+0000 7fa6effff640 1 -- 172.21.15.172:0/2142356982 >> v2:172.21.15.186:3300/0 conn(0x7fa6f015f5f0 msgr2=0x7fa6f015fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:54.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.763+0000 7fa6effff640 1 --2- 172.21.15.172:0/2142356982 >> v2:172.21.15.186:3300/0 conn(0x7fa6f015f5f0 0x7fa6f015fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.763+0000 7fa6effff640 1 -- 172.21.15.172:0/2142356982 >> v1:172.21.15.172:6789/0 conn(0x7fa6f01602e0 legacy=0x7fa6f00ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.763+0000 7fa6eeffd640 1 -- 172.21.15.172:0/2142356982 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048581036 0 0) 0x7fa6e4001110 con 0x7fa6f01602e0 2024-04-25T08:46:54.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.763+0000 7fa6effff640 1 -- 172.21.15.172:0/2142356982 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f0099b70 con 0x7fa6f015ba00 2024-04-25T08:46:54.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.763+0000 7fa6effff640 1 --2- 172.21.15.172:0/2142356982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015ba00 0x7fa6f009a930 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0072b10 tx=0x7fa6e002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f789b28306df9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:54.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6eeffd640 1 -- 172.21.15.172:0/2142356982 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0037070 con 0x7fa6f015ba00 2024-04-25T08:46:54.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6eeffd640 1 -- 172.21.15.172:0/2142356982 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e002adc0 con 0x7fa6f015ba00 2024-04-25T08:46:54.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6eeffd640 1 -- 172.21.15.172:0/2142356982 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0032660 con 0x7fa6f015ba00 2024-04-25T08:46:54.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6f69cf640 1 -- 172.21.15.172:0/2142356982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015ba00 msgr2=0x7fa6f009a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6f69cf640 1 --2- 172.21.15.172:0/2142356982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015ba00 0x7fa6f009a930 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0072b10 tx=0x7fa6e002a0b0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6f69cf640 1 -- 172.21.15.172:0/2142356982 shutdown_connections 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6f69cf640 1 --2- 172.21.15.172:0/2142356982 >> v2:172.21.15.186:3300/0 conn(0x7fa6f015f5f0 0x7fa6f015fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6f69cf640 1 --2- 172.21.15.172:0/2142356982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015ba00 0x7fa6f009a930 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6f69cf640 1 -- 172.21.15.172:0/2142356982 >> 172.21.15.172:0/2142356982 conn(0x7fa6f00b3270 msgr2=0x7fa6f00b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6f69cf640 1 -- 172.21.15.172:0/2142356982 shutdown_connections 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.764+0000 7fa6f69cf640 1 -- 172.21.15.172:0/2142356982 wait complete. 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.765+0000 7fa6f69cf640 1 Processor -- start 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.765+0000 7fa6f69cf640 1 -- start start 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6f69cf640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6f015ba00 0x7fa6f01580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6f69cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015f5f0 0x7fa6f00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6f69cf640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6f01602e0 0x7fa6f009b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6f69cf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f009ae70 con 0x7fa6f015f5f0 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6f69cf640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f009a130 con 0x7fa6f01602e0 2024-04-25T08:46:54.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6f69cf640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f015bde0 con 0x7fa6f015ba00 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6ef7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015f5f0 0x7fa6f00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6ef7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015f5f0 0x7fa6f00caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50022/0 (socket says 172.21.15.172:50022) 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6ef7fe640 1 -- 172.21.15.172:0/230332807 learned_addr learned my addr 172.21.15.172:0/230332807 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6f4f6c640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6f01602e0 0x7fa6f009b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.766+0000 7fa6effff640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6f015ba00 0x7fa6f01580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6ef7fe640 1 -- 172.21.15.172:0/230332807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6f015ba00 msgr2=0x7fa6f01580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6ef7fe640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6f015ba00 0x7fa6f01580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6ef7fe640 1 -- 172.21.15.172:0/230332807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6f01602e0 msgr2=0x7fa6f009b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6ef7fe640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6f01602e0 0x7fa6f009b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6ef7fe640 1 -- 172.21.15.172:0/230332807 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f00cb860 con 0x7fa6f015f5f0 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6effff640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6f015ba00 0x7fa6f01580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6ef7fe640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015f5f0 0x7fa6f00caf40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c780 tx=0x7fa6e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6ecff9640 1 -- 172.21.15.172:0/230332807 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4018070 con 0x7fa6f015f5f0 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6ecff9640 1 -- 172.21.15.172:0/230332807 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e40072d0 con 0x7fa6f015f5f0 2024-04-25T08:46:54.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6ecff9640 1 -- 172.21.15.172:0/230332807 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40047e0 con 0x7fa6f015f5f0 2024-04-25T08:46:54.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6f69cf640 1 -- 172.21.15.172:0/230332807 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f00cbb40 con 0x7fa6f015f5f0 2024-04-25T08:46:54.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.767+0000 7fa6f69cf640 1 -- 172.21.15.172:0/230332807 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f00b5ac0 con 0x7fa6f015f5f0 2024-04-25T08:46:54.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.768+0000 7fa6f69cf640 1 -- 172.21.15.172:0/230332807 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f0073990 con 0x7fa6f015f5f0 2024-04-25T08:46:54.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.768+0000 7fa6ecff9640 1 -- 172.21.15.172:0/230332807 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa6e401b070 con 0x7fa6f015f5f0 2024-04-25T08:46:54.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.769+0000 7fa6ecff9640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6dc06b4d0 0x7fa6dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:54.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.769+0000 7fa6ecff9640 1 -- 172.21.15.172:0/230332807 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa6e4089290 con 0x7fa6f015f5f0 2024-04-25T08:46:54.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.769+0000 7fa6effff640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6dc06b4d0 0x7fa6dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:54.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.769+0000 7fa6effff640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6dc06b4d0 0x7fa6dc06d990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0034000 tx=0x7fa6e002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:54.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.773+0000 7fa6ecff9640 1 -- 172.21.15.172:0/230332807 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa6f00cd710 con 0x7fa6f015f5f0 2024-04-25T08:46:54.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.944+0000 7fa6f69cf640 1 -- 172.21.15.172:0/230332807 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa6f00b40a0 con 0x7fa6f015f5f0 2024-04-25T08:46:54.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.944+0000 7fa6ecff9640 1 -- 172.21.15.172:0/230332807 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa6e4058360 con 0x7fa6f015f5f0 2024-04-25T08:46:54.936 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:54.936 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:46:54.936 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:46:54.936 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2024-04-25T08:46:54.936 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2024-04-25T08:46:54.936 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:46:54.936 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:46:54.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 -- 172.21.15.172:0/230332807 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6dc06b4d0 msgr2=0x7fa6dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6dc06b4d0 0x7fa6dc06d990 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0034000 tx=0x7fa6e002e000 comp rx=0 tx=0).stop 2024-04-25T08:46:54.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 -- 172.21.15.172:0/230332807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015f5f0 msgr2=0x7fa6f00caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:54.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015f5f0 0x7fa6f00caf40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c780 tx=0x7fa6e400cc40 comp rx=0 tx=0).stop 2024-04-25T08:46:54.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 -- 172.21.15.172:0/230332807 shutdown_connections 2024-04-25T08:46:54.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6dc06b4d0 0x7fa6dc06d990 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6f01602e0 0x7fa6f009b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6f015f5f0 0x7fa6f00caf40 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 --2- 172.21.15.172:0/230332807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6f015ba00 0x7fa6f01580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:54.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 -- 172.21.15.172:0/230332807 >> 172.21.15.172:0/230332807 conn(0x7fa6f00b3270 msgr2=0x7fa6f00c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:54.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 -- 172.21.15.172:0/230332807 shutdown_connections 2024-04-25T08:46:54.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:54.946+0000 7fa6f69cf640 1 -- 172.21.15.172:0/230332807 wait complete. 2024-04-25T08:46:54.948 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:46:54.949 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:46:55.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.058+0000 7fa37106b640 1 Processor -- start 2024-04-25T08:46:55.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.058+0000 7fa37106b640 1 -- start start 2024-04-25T08:46:55.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa37106b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c158230 0x7fa36c0d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa37106b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa36c0b4e60 0x7fa36c0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa37106b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36c0d2020 con 0x7fa36c0d1b80 2024-04-25T08:46:55.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa37106b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36c158610 con 0x7fa36c0b4e60 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa37106b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c06bea0 con 0x7fa36c158230 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa36b59e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa36c0b4e60 0x7fa36c0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa36b59e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa36c0b4e60 0x7fa36c0b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50026/0 (socket says 172.21.15.172:50026) 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa36b59e640 1 -- 172.21.15.172:0/2618092892 learned_addr learned my addr 172.21.15.172:0/2618092892 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa36a59c640 1 --1- 172.21.15.172:0/2618092892 >> v1:172.21.15.172:6789/0 conn(0x7fa36c0d1b80 0x7fa36c06c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:55990/0 (socket says 172.21.15.172:55990) 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa36ad9d640 1 --2- 172.21.15.172:0/2618092892 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c158230 0x7fa36c0d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa36b59e640 1 -- 172.21.15.172:0/2618092892 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c158230 msgr2=0x7fa36c0d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa36b59e640 1 --2- 172.21.15.172:0/2618092892 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c158230 0x7fa36c0d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa36b59e640 1 -- 172.21.15.172:0/2618092892 >> v1:172.21.15.172:6789/0 conn(0x7fa36c0d1b80 legacy=0x7fa36c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa36b59e640 1 -- 172.21.15.172:0/2618092892 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c0d2300 con 0x7fa36c0b4e60 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa369d9b640 1 -- 172.21.15.172:0/2618092892 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235085637 0 0) 0x7fa36c0d2020 con 0x7fa36c0d1b80 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.059+0000 7fa36ad9d640 1 --2- 172.21.15.172:0/2618092892 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c158230 0x7fa36c0d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.060+0000 7fa36b59e640 1 --2- 172.21.15.172:0/2618092892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 0x7fa36c0b5270 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa364009870 tx=0x7fa36402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4f77f6395dea93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.060+0000 7fa369d9b640 1 -- 172.21.15.172:0/2618092892 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364037070 con 0x7fa36c0b4e60 2024-04-25T08:46:55.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.060+0000 7fa369d9b640 1 -- 172.21.15.172:0/2618092892 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa364032440 con 0x7fa36c0b4e60 2024-04-25T08:46:55.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.060+0000 7fa369d9b640 1 -- 172.21.15.172:0/2618092892 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364032810 con 0x7fa36c0b4e60 2024-04-25T08:46:55.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.061+0000 7fa37106b640 1 -- 172.21.15.172:0/2618092892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 msgr2=0x7fa36c0b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:55.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.061+0000 7fa37106b640 1 --2- 172.21.15.172:0/2618092892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 0x7fa36c0b5270 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa364009870 tx=0x7fa36402a270 comp rx=0 tx=0).stop 2024-04-25T08:46:55.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.061+0000 7fa37106b640 1 -- 172.21.15.172:0/2618092892 shutdown_connections 2024-04-25T08:46:55.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.061+0000 7fa37106b640 1 --2- 172.21.15.172:0/2618092892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 0x7fa36c0b5270 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.061+0000 7fa37106b640 1 --2- 172.21.15.172:0/2618092892 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c158230 0x7fa36c0d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.061+0000 7fa37106b640 1 -- 172.21.15.172:0/2618092892 >> 172.21.15.172:0/2618092892 conn(0x7fa36c061600 msgr2=0x7fa36c0619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:55.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.061+0000 7fa37106b640 1 -- 172.21.15.172:0/2618092892 shutdown_connections 2024-04-25T08:46:55.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.061+0000 7fa37106b640 1 -- 172.21.15.172:0/2618092892 wait complete. 2024-04-25T08:46:55.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.062+0000 7fa37106b640 1 Processor -- start 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.062+0000 7fa37106b640 1 -- start start 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa37106b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 0x7fa36c0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa37106b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c0d1b80 0x7fa36c1f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa37106b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa36c158230 0x7fa36c1f72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa37106b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c0d25e0 con 0x7fa36c0b4e60 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa37106b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c0b57b0 con 0x7fa36c158230 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa37106b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c06ca40 con 0x7fa36c0d1b80 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 0x7fa36c0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 0x7fa36c0cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50042/0 (socket says 172.21.15.172:50042) 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36ad9d640 1 -- 172.21.15.172:0/4046992617 learned_addr learned my addr 172.21.15.172:0/4046992617 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36a59c640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c0d1b80 0x7fa36c1f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36ad9d640 1 -- 172.21.15.172:0/4046992617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c0d1b80 msgr2=0x7fa36c1f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36b59e640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa36c158230 0x7fa36c1f72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36ad9d640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c0d1b80 0x7fa36c1f6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36ad9d640 1 -- 172.21.15.172:0/4046992617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa36c158230 msgr2=0x7fa36c1f72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36ad9d640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa36c158230 0x7fa36c1f72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36ad9d640 1 -- 172.21.15.172:0/4046992617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c0cc380 con 0x7fa36c0b4e60 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa36ad9d640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 0x7fa36c0cd700 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009fc0 tx=0x7fa35c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.063+0000 7fa3537fe640 1 -- 172.21.15.172:0/4046992617 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c01a070 con 0x7fa36c0b4e60 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.064+0000 7fa3537fe640 1 -- 172.21.15.172:0/4046992617 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c003b90 con 0x7fa36c0b4e60 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.064+0000 7fa3537fe640 1 -- 172.21.15.172:0/4046992617 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c004030 con 0x7fa36c0b4e60 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.064+0000 7fa37106b640 1 -- 172.21.15.172:0/4046992617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c0cc660 con 0x7fa36c0b4e60 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.064+0000 7fa37106b640 1 -- 172.21.15.172:0/4046992617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c0ccc20 con 0x7fa36c0b4e60 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.064+0000 7fa37106b640 1 -- 172.21.15.172:0/4046992617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c073a00 con 0x7fa36c0b4e60 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.065+0000 7fa3537fe640 1 -- 172.21.15.172:0/4046992617 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa35c01d070 con 0x7fa36c0b4e60 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.065+0000 7fa3537fe640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa35806b4d0 0x7fa35806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.065+0000 7fa36a59c640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa35806b4d0 0x7fa35806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.065+0000 7fa3537fe640 1 -- 172.21.15.172:0/4046992617 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa35c08a280 con 0x7fa36c0b4e60 2024-04-25T08:46:55.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.066+0000 7fa36a59c640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa35806b4d0 0x7fa35806d990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa360001230 tx=0x7fa360009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:55.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.070+0000 7fa3537fe640 1 -- 172.21.15.172:0/4046992617 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa35c010070 con 0x7fa36c0b4e60 2024-04-25T08:46:55.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.241+0000 7fa37106b640 1 -- 172.21.15.172:0/4046992617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa36c061b10 con 0x7fa36c0b4e60 2024-04-25T08:46:55.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.696+0000 7fa3537fe640 1 -- 172.21.15.172:0/4046992617 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa35c058c70 con 0x7fa36c0b4e60 2024-04-25T08:46:55.688 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2024-04-25T08:46:55.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.698+0000 7fa37106b640 1 -- 172.21.15.172:0/4046992617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa35806b4d0 msgr2=0x7fa35806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:55.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.698+0000 7fa37106b640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa35806b4d0 0x7fa35806d990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa360001230 tx=0x7fa360009040 comp rx=0 tx=0).stop 2024-04-25T08:46:55.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.698+0000 7fa37106b640 1 -- 172.21.15.172:0/4046992617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 msgr2=0x7fa36c0cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:55.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.698+0000 7fa37106b640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 0x7fa36c0cd700 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009fc0 tx=0x7fa35c00d560 comp rx=0 tx=0).stop 2024-04-25T08:46:55.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.698+0000 7fa37106b640 1 -- 172.21.15.172:0/4046992617 shutdown_connections 2024-04-25T08:46:55.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.698+0000 7fa37106b640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa35806b4d0 0x7fa35806d990 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.698+0000 7fa37106b640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa36c158230 0x7fa36c1f72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.698+0000 7fa37106b640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa36c0d1b80 0x7fa36c1f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.698+0000 7fa37106b640 1 --2- 172.21.15.172:0/4046992617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa36c0b4e60 0x7fa36c0cd700 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.698+0000 7fa37106b640 1 -- 172.21.15.172:0/4046992617 >> 172.21.15.172:0/4046992617 conn(0x7fa36c061600 msgr2=0x7fa36c0ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:55.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.699+0000 7fa37106b640 1 -- 172.21.15.172:0/4046992617 shutdown_connections 2024-04-25T08:46:55.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.699+0000 7fa37106b640 1 -- 172.21.15.172:0/4046992617 wait complete. 2024-04-25T08:46:55.705 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:46:55.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.819+0000 7f01d3431640 1 Processor -- start 2024-04-25T08:46:55.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.819+0000 7f01d3431640 1 -- start start 2024-04-25T08:46:55.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d3431640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f01cc15dc70 0x7f01cc0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d3431640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f01cc06f190 0x7f01cc06abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d3431640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc06f5f0 0x7f01cc06b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d3431640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc0b3590 con 0x7f01cc06f190 2024-04-25T08:46:55.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d3431640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc0b56e0 con 0x7f01cc15dc70 2024-04-25T08:46:55.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d3431640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0b37e0 con 0x7f01cc06f5f0 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d09cc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f01cc06f190 0x7f01cc06abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d09cc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f01cc06f190 0x7f01cc06abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50054/0 (socket says 172.21.15.172:50054) 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d09cc640 1 -- 172.21.15.172:0/386368359 learned_addr learned my addr 172.21.15.172:0/386368359 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d11cd640 1 --2- 172.21.15.172:0/386368359 >> v2:172.21.15.186:3300/0 conn(0x7f01cc15dc70 0x7f01cc0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.820+0000 7f01d19ce640 1 --2- 172.21.15.172:0/386368359 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc06f5f0 0x7f01cc06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.821+0000 7f01d09cc640 1 -- 172.21.15.172:0/386368359 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc06f5f0 msgr2=0x7f01cc06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.821+0000 7f01d09cc640 1 --2- 172.21.15.172:0/386368359 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc06f5f0 0x7f01cc06b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.821+0000 7f01d09cc640 1 -- 172.21.15.172:0/386368359 >> v2:172.21.15.186:3300/0 conn(0x7f01cc15dc70 msgr2=0x7f01cc0af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.821+0000 7f01d09cc640 1 --2- 172.21.15.172:0/386368359 >> v2:172.21.15.186:3300/0 conn(0x7f01cc15dc70 0x7f01cc0af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.821+0000 7f01d09cc640 1 -- 172.21.15.172:0/386368359 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0b3ac0 con 0x7f01cc06f190 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.821+0000 7f01d19ce640 1 --2- 172.21.15.172:0/386368359 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc06f5f0 0x7f01cc06b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:55.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.821+0000 7f01d09cc640 1 --2- 172.21.15.172:0/386368359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 0x7f01cc06abe0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0625e0 tx=0x7f01bc02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f54b160c549b77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:55.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.821+0000 7f01c3fff640 1 -- 172.21.15.172:0/386368359 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc037070 con 0x7f01cc06f190 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.821+0000 7f01c3fff640 1 -- 172.21.15.172:0/386368359 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc02ae00 con 0x7f01cc06f190 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.821+0000 7f01c3fff640 1 -- 172.21.15.172:0/386368359 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc032660 con 0x7f01cc06f190 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.822+0000 7f01d3431640 1 -- 172.21.15.172:0/386368359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 msgr2=0x7f01cc06abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.822+0000 7f01d3431640 1 --2- 172.21.15.172:0/386368359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 0x7f01cc06abe0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0625e0 tx=0x7f01bc02a0b0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.822+0000 7f01d3431640 1 -- 172.21.15.172:0/386368359 shutdown_connections 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.822+0000 7f01d3431640 1 --2- 172.21.15.172:0/386368359 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc06f5f0 0x7f01cc06b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.822+0000 7f01d3431640 1 --2- 172.21.15.172:0/386368359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 0x7f01cc06abe0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.822+0000 7f01d3431640 1 --2- 172.21.15.172:0/386368359 >> v2:172.21.15.186:3300/0 conn(0x7f01cc15dc70 0x7f01cc0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.822+0000 7f01d3431640 1 -- 172.21.15.172:0/386368359 >> 172.21.15.172:0/386368359 conn(0x7f01cc0b5af0 msgr2=0x7f01cc0b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.822+0000 7f01d3431640 1 -- 172.21.15.172:0/386368359 shutdown_connections 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.822+0000 7f01d3431640 1 -- 172.21.15.172:0/386368359 wait complete. 2024-04-25T08:46:55.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.823+0000 7f01d3431640 1 Processor -- start 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.823+0000 7f01d3431640 1 -- start start 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d3431640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 0x7f01cc153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d3431640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01cc06f5f0 0x7f01cc1e7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d3431640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc15dc70 0x7f01cc154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d3431640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0701d0 con 0x7f01cc06f190 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d3431640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc15e050 con 0x7f01cc06f5f0 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d3431640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc070350 con 0x7f01cc15dc70 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d11cd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 0x7f01cc153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d11cd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 0x7f01cc153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50062/0 (socket says 172.21.15.172:50062) 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d11cd640 1 -- 172.21.15.172:0/4030720778 learned_addr learned my addr 172.21.15.172:0/4030720778 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d09cc640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01cc06f5f0 0x7f01cc1e7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d19ce640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc15dc70 0x7f01cc154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d11cd640 1 -- 172.21.15.172:0/4030720778 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc15dc70 msgr2=0x7f01cc154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d11cd640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc15dc70 0x7f01cc154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d11cd640 1 -- 172.21.15.172:0/4030720778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01cc06f5f0 msgr2=0x7f01cc1e7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.824+0000 7f01d11cd640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01cc06f5f0 0x7f01cc1e7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.825+0000 7f01d11cd640 1 -- 172.21.15.172:0/4030720778 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc1e9d70 con 0x7f01cc06f190 2024-04-25T08:46:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.825+0000 7f01d11cd640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 0x7f01cc153b40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f01c800d800 tx=0x7f01c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.825+0000 7f01c1ffb640 1 -- 172.21.15.172:0/4030720778 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c800b660 con 0x7f01cc06f190 2024-04-25T08:46:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.825+0000 7f01c1ffb640 1 -- 172.21.15.172:0/4030720778 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8019070 con 0x7f01cc06f190 2024-04-25T08:46:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.825+0000 7f01c1ffb640 1 -- 172.21.15.172:0/4030720778 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c800ba20 con 0x7f01cc06f190 2024-04-25T08:46:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.825+0000 7f01d3431640 1 -- 172.21.15.172:0/4030720778 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc1ea050 con 0x7f01cc06f190 2024-04-25T08:46:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.825+0000 7f01d3431640 1 -- 172.21.15.172:0/4030720778 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc1e8c40 con 0x7f01cc06f190 2024-04-25T08:46:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.826+0000 7f01d3431640 1 -- 172.21.15.172:0/4030720778 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc06cc80 con 0x7f01cc06f190 2024-04-25T08:46:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.826+0000 7f01c1ffb640 1 -- 172.21.15.172:0/4030720778 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f01c800bbc0 con 0x7f01cc06f190 2024-04-25T08:46:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.827+0000 7f01c1ffb640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01b006b4d0 0x7f01b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.827+0000 7f01c1ffb640 1 -- 172.21.15.172:0/4030720778 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f01c808a3a0 con 0x7f01cc06f190 2024-04-25T08:46:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.827+0000 7f01d09cc640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01b006b4d0 0x7f01b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.827+0000 7f01d09cc640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01b006b4d0 0x7f01b006d990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f01bc034000 tx=0x7f01bc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:55.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:55.831+0000 7f01c1ffb640 1 -- 172.21.15.172:0/4030720778 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f01c8058cb0 con 0x7f01cc06f190 2024-04-25T08:46:55.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.002+0000 7f01d3431640 1 -- 172.21.15.172:0/4030720778 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f01cc073a00 con 0x7f01cc06f190 2024-04-25T08:46:56.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.698+0000 7f01c1ffb640 1 -- 172.21.15.172:0/4030720778 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) v1 ==== 170+0+0 (secure 0 0 0) 0x7f01c805cd50 con 0x7f01cc06f190 2024-04-25T08:46:56.690 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2024-04-25T08:46:56.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 -- 172.21.15.172:0/4030720778 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01b006b4d0 msgr2=0x7f01b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:56.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01b006b4d0 0x7f01b006d990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f01bc034000 tx=0x7f01bc02e000 comp rx=0 tx=0).stop 2024-04-25T08:46:56.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 -- 172.21.15.172:0/4030720778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 msgr2=0x7f01cc153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:56.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 0x7f01cc153b40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f01c800d800 tx=0x7f01c800dcc0 comp rx=0 tx=0).stop 2024-04-25T08:46:56.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 -- 172.21.15.172:0/4030720778 shutdown_connections 2024-04-25T08:46:56.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f01b006b4d0 0x7f01b006d990 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:56.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01cc06f5f0 0x7f01cc1e7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:56.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01cc15dc70 0x7f01cc154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:56.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 --2- 172.21.15.172:0/4030720778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01cc06f190 0x7f01cc153b40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:56.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 -- 172.21.15.172:0/4030720778 >> 172.21.15.172:0/4030720778 conn(0x7f01cc0b5af0 msgr2=0x7f01cc0af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:56.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 -- 172.21.15.172:0/4030720778 shutdown_connections 2024-04-25T08:46:56.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.701+0000 7f01d3431640 1 -- 172.21.15.172:0/4030720778 wait complete. 2024-04-25T08:46:56.717 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:46:56.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.828+0000 7f71d506f640 1 Processor -- start 2024-04-25T08:46:56.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.828+0000 7f71d506f640 1 -- start start 2024-04-25T08:46:56.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.829+0000 7f71d506f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f71d015dc20 0x7f71d00ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:56.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.829+0000 7f71d506f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f71d0161710 0x7f71d00cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.829+0000 7f71d506f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d015e000 con 0x7f71d00b9330 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.829+0000 7f71d506f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d00d1de0 con 0x7f71d015dc20 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.829+0000 7f71d506f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d0161c60 con 0x7f71d0161710 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.829+0000 7f71ced9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f71d015dc20 0x7f71d00ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.829+0000 7f71cf59e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f71d00b9330 0x7f71d006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:56002/0 (socket says 172.21.15.172:56002) 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.829+0000 7f71cf59e640 1 -- 172.21.15.172:0/4163539289 learned_addr learned my addr 172.21.15.172:0/4163539289 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.829+0000 7f71ced9d640 1 --2- 172.21.15.172:0/4163539289 >> v2:172.21.15.172:3300/0 conn(0x7f71d015dc20 0x7f71d00ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50068/0 (socket says 172.21.15.172:50068) 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.830+0000 7f71ce59c640 1 --2- 172.21.15.172:0/4163539289 >> v2:172.21.15.186:3300/0 conn(0x7f71d0161710 0x7f71d00cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.830+0000 7f71ced9d640 1 -- 172.21.15.172:0/4163539289 >> v2:172.21.15.186:3300/0 conn(0x7f71d0161710 msgr2=0x7f71d00cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.830+0000 7f71ced9d640 1 --2- 172.21.15.172:0/4163539289 >> v2:172.21.15.186:3300/0 conn(0x7f71d0161710 0x7f71d00cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.830+0000 7f71ced9d640 1 -- 172.21.15.172:0/4163539289 >> v1:172.21.15.172:6789/0 conn(0x7f71d00b9330 legacy=0x7f71d006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.830+0000 7f71cdd9b640 1 -- 172.21.15.172:0/4163539289 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683142266 0 0) 0x7f71d015e000 con 0x7f71d00b9330 2024-04-25T08:46:56.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.830+0000 7f71ced9d640 1 -- 172.21.15.172:0/4163539289 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0161f40 con 0x7f71d015dc20 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.830+0000 7f71ce59c640 1 --2- 172.21.15.172:0/4163539289 >> v2:172.21.15.186:3300/0 conn(0x7f71d0161710 0x7f71d00cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.830+0000 7f71ced9d640 1 --2- 172.21.15.172:0/4163539289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d015dc20 0x7f71d00ce670 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f71d006da90 tx=0x7f71c002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8747cc245839c4b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.830+0000 7f71cdd9b640 1 -- 172.21.15.172:0/4163539289 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0007740 con 0x7f71d015dc20 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.831+0000 7f71cdd9b640 1 -- 172.21.15.172:0/4163539289 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c00078e0 con 0x7f71d015dc20 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.831+0000 7f71cdd9b640 1 -- 172.21.15.172:0/4163539289 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0007cb0 con 0x7f71d015dc20 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.831+0000 7f71d506f640 1 -- 172.21.15.172:0/4163539289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d015dc20 msgr2=0x7f71d00ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.831+0000 7f71d506f640 1 --2- 172.21.15.172:0/4163539289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d015dc20 0x7f71d00ce670 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f71d006da90 tx=0x7f71c002a680 comp rx=0 tx=0).stop 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.831+0000 7f71d506f640 1 -- 172.21.15.172:0/4163539289 shutdown_connections 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.831+0000 7f71d506f640 1 --2- 172.21.15.172:0/4163539289 >> v2:172.21.15.186:3300/0 conn(0x7f71d0161710 0x7f71d00cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.831+0000 7f71d506f640 1 --2- 172.21.15.172:0/4163539289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d015dc20 0x7f71d00ce670 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.831+0000 7f71d506f640 1 -- 172.21.15.172:0/4163539289 >> 172.21.15.172:0/4163539289 conn(0x7f71d00d0420 msgr2=0x7f71d00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.831+0000 7f71d506f640 1 -- 172.21.15.172:0/4163539289 shutdown_connections 2024-04-25T08:46:56.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.831+0000 7f71d506f640 1 -- 172.21.15.172:0/4163539289 wait complete. 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.832+0000 7f71d506f640 1 Processor -- start 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71d506f640 1 -- start start 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71d506f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71d00b9330 0x7f71d015a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71d506f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71d015dc20 0x7f71d015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71d506f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0161710 0x7f71d0157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71d506f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00b5e50 con 0x7f71d0161710 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71d506f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0162500 con 0x7f71d00b9330 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71d506f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00b5fd0 con 0x7f71d015dc20 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71cf59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0161710 0x7f71d0157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71cf59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0161710 0x7f71d0157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50084/0 (socket says 172.21.15.172:50084) 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71cf59e640 1 -- 172.21.15.172:0/1438188268 learned_addr learned my addr 172.21.15.172:0/1438188268 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.833+0000 7f71ced9d640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71d00b9330 0x7f71d015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:56.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71ce59c640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71d015dc20 0x7f71d015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71cf59e640 1 -- 172.21.15.172:0/1438188268 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71d015dc20 msgr2=0x7f71d015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71cf59e640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71d015dc20 0x7f71d015ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71cf59e640 1 -- 172.21.15.172:0/1438188268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71d00b9330 msgr2=0x7f71d015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71cf59e640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71d00b9330 0x7f71d015a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71cf59e640 1 -- 172.21.15.172:0/1438188268 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d015f820 con 0x7f71d0161710 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71cf59e640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0161710 0x7f71d0157620 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c410 tx=0x7f71c800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71b77fe640 1 -- 172.21.15.172:0/1438188268 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80074e0 con 0x7f71d0161710 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71b77fe640 1 -- 172.21.15.172:0/1438188268 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c8007680 con 0x7f71d0161710 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71d506f640 1 -- 172.21.15.172:0/1438188268 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d015fb00 con 0x7f71d0161710 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71b77fe640 1 -- 172.21.15.172:0/1438188268 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8004a20 con 0x7f71d0161710 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.834+0000 7f71d506f640 1 -- 172.21.15.172:0/1438188268 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d01600c0 con 0x7f71d0161710 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.835+0000 7f71d506f640 1 -- 172.21.15.172:0/1438188268 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d0073a00 con 0x7f71d0161710 2024-04-25T08:46:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.836+0000 7f71b77fe640 1 -- 172.21.15.172:0/1438188268 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71c8011070 con 0x7f71d0161710 2024-04-25T08:46:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.836+0000 7f71b77fe640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71bc06b4d0 0x7f71bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.836+0000 7f71ced9d640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71bc06b4d0 0x7f71bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.836+0000 7f71b77fe640 1 -- 172.21.15.172:0/1438188268 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f71c8089d50 con 0x7f71d0161710 2024-04-25T08:46:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.837+0000 7f71ced9d640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71bc06b4d0 0x7f71bc06d990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f71c0034000 tx=0x7f71c002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:56.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:56.841+0000 7f71b77fe640 1 -- 172.21.15.172:0/1438188268 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71c808d030 con 0x7f71d0161710 2024-04-25T08:46:57.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.046+0000 7f71d506f640 1 -- 172.21.15.172:0/1438188268 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f71d00b5b20 con 0x7f71d0161710 2024-04-25T08:46:57.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.718+0000 7f71b77fe640 1 -- 172.21.15.172:0/1438188268 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7f71c8058450 con 0x7f71d0161710 2024-04-25T08:46:57.710 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 11 and data pool 12 2024-04-25T08:46:57.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 -- 172.21.15.172:0/1438188268 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71bc06b4d0 msgr2=0x7f71bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:57.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71bc06b4d0 0x7f71bc06d990 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f71c0034000 tx=0x7f71c002f000 comp rx=0 tx=0).stop 2024-04-25T08:46:57.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 -- 172.21.15.172:0/1438188268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0161710 msgr2=0x7f71d0157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:57.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0161710 0x7f71d0157620 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c410 tx=0x7f71c800c8d0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 -- 172.21.15.172:0/1438188268 shutdown_connections 2024-04-25T08:46:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71bc06b4d0 0x7f71bc06d990 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0161710 0x7f71d0157620 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71d015dc20 0x7f71d015ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 --2- 172.21.15.172:0/1438188268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71d00b9330 0x7f71d015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 -- 172.21.15.172:0/1438188268 >> 172.21.15.172:0/1438188268 conn(0x7f71d00d0420 msgr2=0x7f71d00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 -- 172.21.15.172:0/1438188268 shutdown_connections 2024-04-25T08:46:57.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.722+0000 7f71d506f640 1 -- 172.21.15.172:0/1438188268 wait complete. 2024-04-25T08:46:57.739 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:57.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.848+0000 7fae9e86f640 1 Processor -- start 2024-04-25T08:46:57.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.848+0000 7fae9e86f640 1 -- start start 2024-04-25T08:46:57.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.849+0000 7fae9e86f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fae980ce590 0x7fae98165900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:57.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.849+0000 7fae9e86f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae98071480 con 0x7fae980cfec0 2024-04-25T08:46:57.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.849+0000 7fae9e86f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae98071760 con 0x7fae98154ee0 2024-04-25T08:46:57.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.849+0000 7fae9e86f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae98072090 con 0x7fae980ce590 2024-04-25T08:46:57.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.849+0000 7fae977fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fae980cfec0 0x7fae980cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46548/0 (socket says 172.21.15.172:46548) 2024-04-25T08:46:57.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.849+0000 7fae977fe640 1 -- 172.21.15.172:0/4178293944 learned_addr learned my addr 172.21.15.172:0/4178293944 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.849+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468796691 0 0) 0x7fae98071480 con 0x7fae980cfec0 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.849+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae80003520 con 0x7fae980cfec0 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.849+0000 7fae9ce0c640 1 --2- 172.21.15.172:0/4178293944 >> v2:172.21.15.186:3300/0 conn(0x7fae980ce590 0x7fae98165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310604595 0 0) 0x7fae80003520 con 0x7fae980cfec0 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 >> v2:172.21.15.186:3300/0 conn(0x7fae980ce590 msgr2=0x7fae98165900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 --2- 172.21.15.172:0/4178293944 >> v2:172.21.15.186:3300/0 conn(0x7fae980ce590 0x7fae98165900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 >> v1:172.21.15.186:6789/0 conn(0x7fae98154ee0 legacy=0x7fae980cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae98071a40 con 0x7fae980cfec0 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fae8c001670 con 0x7fae980cfec0 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 >> v1:172.21.15.172:6789/0 conn(0x7fae980cfec0 legacy=0x7fae980cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae800039b0 0x7fae80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae80004800 0x7fae80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae800051c0 0x7fae8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:57.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8000c030 con 0x7fae800051c0 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8000c1e0 con 0x7fae80004800 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8000c3e0 con 0x7fae800039b0 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae9ce0c640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae800051c0 0x7fae8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae977fe640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae80004800 0x7fae80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae97fff640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae800039b0 0x7fae80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae9ce0c640 1 -- 172.21.15.172:0/4178293944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae800039b0 msgr2=0x7fae80003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae9ce0c640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae800039b0 0x7fae80003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae9ce0c640 1 -- 172.21.15.172:0/4178293944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae80004800 msgr2=0x7fae80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae9ce0c640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae80004800 0x7fae80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.850+0000 7fae9ce0c640 1 -- 172.21.15.172:0/4178293944 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80003520 con 0x7fae800051c0 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.851+0000 7fae9ce0c640 1 -- 172.21.15.172:0/4178293944 reap_dead start 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.851+0000 7fae9ce0c640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae800051c0 0x7fae8000b9c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fae90009f90 tx=0x7fae80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1c032cabb94f78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.851+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90035020 con 0x7fae800051c0 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.851+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90003b90 con 0x7fae800051c0 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.851+0000 7fae96ffd640 1 -- 172.21.15.172:0/4178293944 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90009c10 con 0x7fae800051c0 2024-04-25T08:46:57.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.851+0000 7fae9e86f640 1 -- 172.21.15.172:0/4178293944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae800051c0 msgr2=0x7fae8000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:57.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.851+0000 7fae9e86f640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae800051c0 0x7fae8000b9c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fae90009f90 tx=0x7fae80005830 comp rx=0 tx=0).stop 2024-04-25T08:46:57.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.851+0000 7fae9e86f640 1 -- 172.21.15.172:0/4178293944 shutdown_connections 2024-04-25T08:46:57.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.851+0000 7fae9e86f640 1 --2- 172.21.15.172:0/4178293944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae800051c0 0x7fae8000b9c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.852+0000 7fae9e86f640 1 -- 172.21.15.172:0/4178293944 >> 172.21.15.172:0/4178293944 conn(0x7fae9806abe0 msgr2=0x7fae9806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:57.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.852+0000 7fae9e86f640 1 -- 172.21.15.172:0/4178293944 shutdown_connections 2024-04-25T08:46:57.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.852+0000 7fae9e86f640 1 -- 172.21.15.172:0/4178293944 wait complete. 2024-04-25T08:46:57.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.853+0000 7fae9e86f640 1 Processor -- start 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.853+0000 7fae9e86f640 1 -- start start 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9e86f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae800051c0 0x7fae980a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9e86f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae98159770 0x7fae98152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9e86f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9815a1c0 0x7fae9815a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9e86f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae981552c0 con 0x7fae9815a1c0 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9e86f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae98071230 con 0x7fae800051c0 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9e86f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae98155440 con 0x7fae98159770 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9ce0c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9815a1c0 0x7fae9815a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9ce0c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9815a1c0 0x7fae9815a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33760/0 (socket says 172.21.15.172:33760) 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9ce0c640 1 -- 172.21.15.172:0/1094804218 learned_addr learned my addr 172.21.15.172:0/1094804218 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae97fff640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae800051c0 0x7fae980a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae977fe640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae98159770 0x7fae98152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9ce0c640 1 -- 172.21.15.172:0/1094804218 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae98159770 msgr2=0x7fae98152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9ce0c640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae98159770 0x7fae98152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9ce0c640 1 -- 172.21.15.172:0/1094804218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae800051c0 msgr2=0x7fae980a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9ce0c640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae800051c0 0x7fae980a97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9ce0c640 1 -- 172.21.15.172:0/1094804218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae980a9e70 con 0x7fae9815a1c0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9ce0c640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9815a1c0 0x7fae9815a640 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fae9000e230 tx=0x7fae90009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae94ff9640 1 -- 172.21.15.172:0/1094804218 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90035070 con 0x7fae9815a1c0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae94ff9640 1 -- 172.21.15.172:0/1094804218 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90041070 con 0x7fae9815a1c0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9e86f640 1 -- 172.21.15.172:0/1094804218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae980aa150 con 0x7fae9815a1c0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae94ff9640 1 -- 172.21.15.172:0/1094804218 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90009c10 con 0x7fae9815a1c0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.854+0000 7fae9e86f640 1 -- 172.21.15.172:0/1094804218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae980aa710 con 0x7fae9815a1c0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.855+0000 7fae9e86f640 1 -- 172.21.15.172:0/1094804218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae98073990 con 0x7fae9815a1c0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.856+0000 7fae94ff9640 1 -- 172.21.15.172:0/1094804218 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae90005d10 con 0x7fae9815a1c0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.856+0000 7fae94ff9640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8406b500 0x7fae8406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.856+0000 7fae94ff9640 1 -- 172.21.15.172:0/1094804218 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fae900aae90 con 0x7fae9815a1c0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.856+0000 7fae97fff640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8406b500 0x7fae8406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.857+0000 7fae97fff640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8406b500 0x7fae8406d9c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fae88000c00 tx=0x7fae88009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:57.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:57.860+0000 7fae94ff9640 1 -- 172.21.15.172:0/1094804218 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae90079c10 con 0x7fae9815a1c0 2024-04-25T08:46:58.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.030+0000 7fae9e86f640 1 -- 172.21.15.172:0/1094804218 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae9806d360 con 0x7fae9815a1c0 2024-04-25T08:46:58.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.032+0000 7fae94ff9640 1 -- 172.21.15.172:0/1094804218 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+17018 (secure 0 0 0) 0x7fae90079510 con 0x7fae9815a1c0 2024-04-25T08:46:58.023 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:58.023 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":80,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:57.047996+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:55.259890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:56.021748+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:58.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.033+0000 7fae9e86f640 1 -- 172.21.15.172:0/1094804218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8406b500 msgr2=0x7fae8406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.033+0000 7fae9e86f640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8406b500 0x7fae8406d9c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fae88000c00 tx=0x7fae88009040 comp rx=0 tx=0).stop 2024-04-25T08:46:58.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.033+0000 7fae9e86f640 1 -- 172.21.15.172:0/1094804218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9815a1c0 msgr2=0x7fae9815a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.033+0000 7fae9e86f640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9815a1c0 0x7fae9815a640 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fae9000e230 tx=0x7fae90009750 comp rx=0 tx=0).stop 2024-04-25T08:46:58.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.033+0000 7fae9e86f640 1 -- 172.21.15.172:0/1094804218 shutdown_connections 2024-04-25T08:46:58.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.033+0000 7fae9e86f640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae8406b500 0x7fae8406d9c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.033+0000 7fae9e86f640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae9815a1c0 0x7fae9815a640 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.033+0000 7fae9e86f640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae98159770 0x7fae98152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.033+0000 7fae9e86f640 1 --2- 172.21.15.172:0/1094804218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae800051c0 0x7fae980a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.034+0000 7fae9e86f640 1 -- 172.21.15.172:0/1094804218 >> 172.21.15.172:0/1094804218 conn(0x7fae9806abe0 msgr2=0x7fae9815d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.034+0000 7fae9e86f640 1 -- 172.21.15.172:0/1094804218 shutdown_connections 2024-04-25T08:46:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.034+0000 7fae9e86f640 1 -- 172.21.15.172:0/1094804218 wait complete. 2024-04-25T08:46:58.037 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:46:58.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.142+0000 7fa9a539d640 1 Processor -- start 2024-04-25T08:46:58.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.142+0000 7fa9a539d640 1 -- start start 2024-04-25T08:46:58.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa9a539d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa9a015dbe0 0x7fa9a00d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa9a539d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 0x7fa9a00d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa9a539d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a00b97a0 con 0x7fa9a00b92a0 2024-04-25T08:46:58.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa9a539d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a015dfc0 con 0x7fa9a015dbe0 2024-04-25T08:46:58.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa9a539d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00d1a00 con 0x7fa9a00b2cb0 2024-04-25T08:46:58.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa99effd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa9a015dbe0 0x7fa9a00d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa99e7fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 0x7fa9a00d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa99f7fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fa9a00b92a0 0x7fa9a00b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:48538/0 (socket says 172.21.15.172:48538) 2024-04-25T08:46:58.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa99f7fe640 1 -- 172.21.15.172:0/3063733586 learned_addr learned my addr 172.21.15.172:0/3063733586 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:58.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa99e7fc640 1 -- 172.21.15.172:0/3063733586 >> v2:172.21.15.186:3300/0 conn(0x7fa9a015dbe0 msgr2=0x7fa9a00d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:58.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa99dffb640 1 -- 172.21.15.172:0/3063733586 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090657249 0 0) 0x7fa9a00b97a0 con 0x7fa9a00b92a0 2024-04-25T08:46:58.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa99e7fc640 1 --2- 172.21.15.172:0/3063733586 >> v2:172.21.15.186:3300/0 conn(0x7fa9a015dbe0 0x7fa9a00d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa99e7fc640 1 -- 172.21.15.172:0/3063733586 >> v1:172.21.15.186:6789/0 conn(0x7fa9a00b92a0 legacy=0x7fa9a00b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.143+0000 7fa99e7fc640 1 -- 172.21.15.172:0/3063733586 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a00d1c50 con 0x7fa9a00b2cb0 2024-04-25T08:46:58.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.144+0000 7fa99e7fc640 1 --2- 172.21.15.172:0/3063733586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 0x7fa9a00d0e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa9940097a0 tx=0x7fa99402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b33996a646c87e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:58.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.144+0000 7fa99dffb640 1 -- 172.21.15.172:0/3063733586 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994037070 con 0x7fa9a00b2cb0 2024-04-25T08:46:58.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.144+0000 7fa99dffb640 1 -- 172.21.15.172:0/3063733586 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa994032440 con 0x7fa9a00b2cb0 2024-04-25T08:46:58.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.144+0000 7fa99dffb640 1 -- 172.21.15.172:0/3063733586 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994032810 con 0x7fa9a00b2cb0 2024-04-25T08:46:58.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.145+0000 7fa9a539d640 1 -- 172.21.15.172:0/3063733586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 msgr2=0x7fa9a00d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.145+0000 7fa9a539d640 1 --2- 172.21.15.172:0/3063733586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 0x7fa9a00d0e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa9940097a0 tx=0x7fa99402a180 comp rx=0 tx=0).stop 2024-04-25T08:46:58.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.145+0000 7fa9a539d640 1 -- 172.21.15.172:0/3063733586 shutdown_connections 2024-04-25T08:46:58.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.145+0000 7fa9a539d640 1 --2- 172.21.15.172:0/3063733586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 0x7fa9a00d0e50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.145+0000 7fa9a539d640 1 --2- 172.21.15.172:0/3063733586 >> v2:172.21.15.186:3300/0 conn(0x7fa9a015dbe0 0x7fa9a00d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.145+0000 7fa9a539d640 1 -- 172.21.15.172:0/3063733586 >> 172.21.15.172:0/3063733586 conn(0x7fa9a0061a20 msgr2=0x7fa9a0061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:58.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.145+0000 7fa9a539d640 1 -- 172.21.15.172:0/3063733586 shutdown_connections 2024-04-25T08:46:58.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.145+0000 7fa9a539d640 1 -- 172.21.15.172:0/3063733586 wait complete. 2024-04-25T08:46:58.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.146+0000 7fa9a539d640 1 Processor -- start 2024-04-25T08:46:58.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.146+0000 7fa9a539d640 1 -- start start 2024-04-25T08:46:58.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa9a539d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 0x7fa9a0151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa9a539d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a00b92a0 0x7fa9a01606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa9a539d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9a015dbe0 0x7fa9a0160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa9a539d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00b6ab0 con 0x7fa9a00b92a0 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa9a539d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00d2210 con 0x7fa9a015dbe0 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa9a539d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00b6c30 con 0x7fa9a00b2cb0 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a00b92a0 0x7fa9a01606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a00b92a0 0x7fa9a01606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33774/0 (socket says 172.21.15.172:33774) 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99e7fc640 1 -- 172.21.15.172:0/2796046647 learned_addr learned my addr 172.21.15.172:0/2796046647 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99f7fe640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9a015dbe0 0x7fa9a0160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99effd640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 0x7fa9a0151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99e7fc640 1 -- 172.21.15.172:0/2796046647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 msgr2=0x7fa9a0151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99e7fc640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 0x7fa9a0151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99e7fc640 1 -- 172.21.15.172:0/2796046647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9a015dbe0 msgr2=0x7fa9a0160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99e7fc640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9a015dbe0 0x7fa9a0160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99e7fc640 1 -- 172.21.15.172:0/2796046647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a01f4110 con 0x7fa9a00b92a0 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.147+0000 7fa99effd640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 0x7fa9a0151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:58.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.148+0000 7fa99e7fc640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a00b92a0 0x7fa9a01606b0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa994000c00 tx=0x7fa9940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:58.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.148+0000 7fa9877fe640 1 -- 172.21.15.172:0/2796046647 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994037050 con 0x7fa9a00b92a0 2024-04-25T08:46:58.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.148+0000 7fa9877fe640 1 -- 172.21.15.172:0/2796046647 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa994038040 con 0x7fa9a00b92a0 2024-04-25T08:46:58.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.148+0000 7fa9a539d640 1 -- 172.21.15.172:0/2796046647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a01f68c0 con 0x7fa9a00b92a0 2024-04-25T08:46:58.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.148+0000 7fa9877fe640 1 -- 172.21.15.172:0/2796046647 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994004470 con 0x7fa9a00b92a0 2024-04-25T08:46:58.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.148+0000 7fa9a539d640 1 -- 172.21.15.172:0/2796046647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a01f6e80 con 0x7fa9a00b92a0 2024-04-25T08:46:58.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.149+0000 7fa9a539d640 1 -- 172.21.15.172:0/2796046647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a0073990 con 0x7fa9a00b92a0 2024-04-25T08:46:58.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.149+0000 7fa9877fe640 1 -- 172.21.15.172:0/2796046647 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa99403c6d0 con 0x7fa9a00b92a0 2024-04-25T08:46:58.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.149+0000 7fa9877fe640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98c06b4d0 0x7fa98c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.150+0000 7fa9877fe640 1 -- 172.21.15.172:0/2796046647 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa9940aad10 con 0x7fa9a00b92a0 2024-04-25T08:46:58.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.150+0000 7fa99effd640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98c06b4d0 0x7fa98c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.150+0000 7fa99effd640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98c06b4d0 0x7fa98c06d990 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa990009b90 tx=0x7fa990008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:58.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.154+0000 7fa9877fe640 1 -- 172.21.15.172:0/2796046647 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa994079a00 con 0x7fa9a00b92a0 2024-04-25T08:46:58.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.325+0000 7fa9a539d640 1 -- 172.21.15.172:0/2796046647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9a006b080 con 0x7fa9a00b92a0 2024-04-25T08:46:58.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.326+0000 7fa9877fe640 1 -- 172.21.15.172:0/2796046647 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+17018 (secure 0 0 0) 0x7fa994079300 con 0x7fa9a00b92a0 2024-04-25T08:46:58.317 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:46:58.317 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":80,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:57.047996+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:55.259890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:56.021748+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:46:58.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 -- 172.21.15.172:0/2796046647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98c06b4d0 msgr2=0x7fa98c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98c06b4d0 0x7fa98c06d990 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa990009b90 tx=0x7fa990008040 comp rx=0 tx=0).stop 2024-04-25T08:46:58.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 -- 172.21.15.172:0/2796046647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a00b92a0 msgr2=0x7fa9a01606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a00b92a0 0x7fa9a01606b0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa994000c00 tx=0x7fa9940046c0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 -- 172.21.15.172:0/2796046647 shutdown_connections 2024-04-25T08:46:58.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98c06b4d0 0x7fa98c06d990 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9a015dbe0 0x7fa9a0160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9a00b92a0 0x7fa9a01606b0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 --2- 172.21.15.172:0/2796046647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9a00b2cb0 0x7fa9a0151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 -- 172.21.15.172:0/2796046647 >> 172.21.15.172:0/2796046647 conn(0x7fa9a0061a20 msgr2=0x7fa9a00ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:58.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 -- 172.21.15.172:0/2796046647 shutdown_connections 2024-04-25T08:46:58.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.328+0000 7fa9a539d640 1 -- 172.21.15.172:0/2796046647 wait complete. 2024-04-25T08:46:58.330 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:46:58.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.439+0000 7fc18a84d640 1 Processor -- start 2024-04-25T08:46:58.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.439+0000 7fc18a84d640 1 -- start start 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc18a84d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc18406c330 0x7fc1840b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc18a84d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18406c7e0 0x7fc1840b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc18a84d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1840d1d50 con 0x7fc184158230 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc18a84d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc184158610 con 0x7fc18406c330 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc18a84d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18406bea0 con 0x7fc18406c7e0 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc183fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc184158230 0x7fc1840d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46560/0 (socket says 172.21.15.172:46560) 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc183fff640 1 -- 172.21.15.172:0/2269584841 learned_addr learned my addr 172.21.15.172:0/2269584841 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637573281 0 0) 0x7fc1840d1d50 con 0x7fc184158230 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc16c003520 con 0x7fc184158230 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc1837fe640 1 --2- 172.21.15.172:0/2269584841 >> v2:172.21.15.186:3300/0 conn(0x7fc18406c330 0x7fc1840b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc188dea640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18406c7e0 0x7fc1840b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321405156 0 0) 0x7fc16c003520 con 0x7fc184158230 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18406c7e0 msgr2=0x7fc1840b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18406c7e0 0x7fc1840b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 >> v2:172.21.15.186:3300/0 conn(0x7fc18406c330 msgr2=0x7fc1840b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 --2- 172.21.15.172:0/2269584841 >> v2:172.21.15.186:3300/0 conn(0x7fc18406c330 0x7fc1840b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840d2020 con 0x7fc184158230 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fc174001670 con 0x7fc184158230 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc1837fe640 1 --2- 172.21.15.172:0/2269584841 >> v2:172.21.15.186:3300/0 conn(0x7fc18406c330 0x7fc1840b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 >> v1:172.21.15.172:6789/0 conn(0x7fc184158230 legacy=0x7fc1840d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18406c7e0 0x7fc16c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16c003fe0 0x7fc16c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc16c004d40 0x7fc16c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc184158610 con 0x7fc16c003fe0 2024-04-25T08:46:58.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18406bea0 con 0x7fc16c004d40 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.440+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c00bac0 con 0x7fc18406c7e0 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.441+0000 7fc1837fe640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16c003fe0 0x7fc16c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.441+0000 7fc183fff640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18406c7e0 0x7fc16c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.441+0000 7fc188dea640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc16c004d40 0x7fc16c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.441+0000 7fc1837fe640 1 -- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18406c7e0 msgr2=0x7fc16c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.441+0000 7fc1837fe640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18406c7e0 0x7fc16c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.441+0000 7fc1837fe640 1 -- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc16c004d40 msgr2=0x7fc16c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.441+0000 7fc1837fe640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc16c004d40 0x7fc16c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.441+0000 7fc1837fe640 1 -- 172.21.15.172:0/2269584841 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c003520 con 0x7fc16c003fe0 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.441+0000 7fc1837fe640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16c003fe0 0x7fc16c004800 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc1780098b0 tx=0x7fc16c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e6f10ab01bb82d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.442+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178037070 con 0x7fc16c003fe0 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.442+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17802ad20 con 0x7fc16c003fe0 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.442+0000 7fc182ffd640 1 -- 172.21.15.172:0/2269584841 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800f040 con 0x7fc16c003fe0 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.442+0000 7fc18a84d640 1 -- 172.21.15.172:0/2269584841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16c003fe0 msgr2=0x7fc16c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.442+0000 7fc18a84d640 1 --2- 172.21.15.172:0/2269584841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16c003fe0 0x7fc16c004800 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc1780098b0 tx=0x7fc16c005830 comp rx=0 tx=0).stop 2024-04-25T08:46:58.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.442+0000 7fc188dea640 1 -- 172.21.15.172:0/2269584841 reap_dead start 2024-04-25T08:46:58.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.442+0000 7fc18a84d640 1 -- 172.21.15.172:0/2269584841 shutdown_connections 2024-04-25T08:46:58.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.442+0000 7fc18a84d640 1 -- 172.21.15.172:0/2269584841 >> 172.21.15.172:0/2269584841 conn(0x7fc184061600 msgr2=0x7fc1840619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:58.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.442+0000 7fc18a84d640 1 -- 172.21.15.172:0/2269584841 shutdown_connections 2024-04-25T08:46:58.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.442+0000 7fc18a84d640 1 -- 172.21.15.172:0/2269584841 wait complete. 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.443+0000 7fc18a84d640 1 Processor -- start 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.444+0000 7fc18a84d640 1 -- start start 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.444+0000 7fc18a84d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc16c003fe0 0x7fc1840cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.444+0000 7fc18a84d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1840b27e0 0x7fc1840b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.444+0000 7fc18a84d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18415ae80 0x7fc18415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.444+0000 7fc18a84d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840d25e0 con 0x7fc1840b27e0 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.444+0000 7fc18a84d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18406bb30 con 0x7fc16c003fe0 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.444+0000 7fc18a84d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18415e320 con 0x7fc18415ae80 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.444+0000 7fc1837fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1840b27e0 0x7fc1840b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.444+0000 7fc1837fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1840b27e0 0x7fc1840b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33792/0 (socket says 172.21.15.172:33792) 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.444+0000 7fc1837fe640 1 -- 172.21.15.172:0/1500421973 learned_addr learned my addr 172.21.15.172:0/1500421973 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:58.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc183fff640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc16c003fe0 0x7fc1840cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc188dea640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18415ae80 0x7fc18415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc1837fe640 1 -- 172.21.15.172:0/1500421973 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18415ae80 msgr2=0x7fc18415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc1837fe640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18415ae80 0x7fc18415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc1837fe640 1 -- 172.21.15.172:0/1500421973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc16c003fe0 msgr2=0x7fc1840cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc1837fe640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc16c003fe0 0x7fc1840cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc1837fe640 1 -- 172.21.15.172:0/1500421973 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840b31a0 con 0x7fc1840b27e0 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc188dea640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18415ae80 0x7fc18415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc1837fe640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1840b27e0 0x7fc1840b2c60 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc17802a810 tx=0x7fc178004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc180ff9640 1 -- 172.21.15.172:0/1500421973 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178040020 con 0x7fc1840b27e0 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc180ff9640 1 -- 172.21.15.172:0/1500421973 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc178038040 con 0x7fc1840b27e0 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc180ff9640 1 -- 172.21.15.172:0/1500421973 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178037070 con 0x7fc1840b27e0 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc18a84d640 1 -- 172.21.15.172:0/1500421973 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1840b3460 con 0x7fc1840b27e0 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.445+0000 7fc18a84d640 1 -- 172.21.15.172:0/1500421973 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1840b3a20 con 0x7fc1840b27e0 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.446+0000 7fc18a84d640 1 -- 172.21.15.172:0/1500421973 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18406de50 con 0x7fc1840b27e0 2024-04-25T08:46:58.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.446+0000 7fc180ff9640 1 -- 172.21.15.172:0/1500421973 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc178043020 con 0x7fc1840b27e0 2024-04-25T08:46:58.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.447+0000 7fc180ff9640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 0x7fc17006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.447+0000 7fc183fff640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 0x7fc17006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.447+0000 7fc180ff9640 1 -- 172.21.15.172:0/1500421973 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc1780aa470 con 0x7fc1840b27e0 2024-04-25T08:46:58.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.447+0000 7fc183fff640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 0x7fc17006d990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc174001eb0 tx=0x7fc174009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:58.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.451+0000 7fc180ff9640 1 -- 172.21.15.172:0/1500421973 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc17804a020 con 0x7fc1840b27e0 2024-04-25T08:46:58.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.657+0000 7fc18a84d640 1 -- 172.21.15.172:0/1500421973 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc184073a00 con 0x7fc1840b27e0 2024-04-25T08:46:58.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.739+0000 7fc180ff9640 1 -- 172.21.15.172:0/1500421973 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc17800f000 con 0x7fc1840b27e0 2024-04-25T08:46:58.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.741+0000 7fc18a84d640 1 -- 172.21.15.172:0/1500421973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 msgr2=0x7fc17006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.741+0000 7fc18a84d640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 0x7fc17006d990 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc174001eb0 tx=0x7fc174009040 comp rx=0 tx=0).stop 2024-04-25T08:46:58.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.741+0000 7fc18a84d640 1 -- 172.21.15.172:0/1500421973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1840b27e0 msgr2=0x7fc1840b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.741+0000 7fc18a84d640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1840b27e0 0x7fc1840b2c60 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc17802a810 tx=0x7fc178004730 comp rx=0 tx=0).stop 2024-04-25T08:46:58.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.741+0000 7fc18a84d640 1 -- 172.21.15.172:0/1500421973 shutdown_connections 2024-04-25T08:46:58.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.741+0000 7fc18a84d640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc17006b4d0 0x7fc17006d990 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.741+0000 7fc18a84d640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18415ae80 0x7fc18415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.741+0000 7fc18a84d640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1840b27e0 0x7fc1840b2c60 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.741+0000 7fc18a84d640 1 --2- 172.21.15.172:0/1500421973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc16c003fe0 0x7fc1840cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.741+0000 7fc18a84d640 1 -- 172.21.15.172:0/1500421973 >> 172.21.15.172:0/1500421973 conn(0x7fc184061600 msgr2=0x7fc1840ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:58.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.742+0000 7fc18a84d640 1 -- 172.21.15.172:0/1500421973 shutdown_connections 2024-04-25T08:46:58.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.742+0000 7fc18a84d640 1 -- 172.21.15.172:0/1500421973 wait complete. 2024-04-25T08:46:58.744 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:46:58.744 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:46:58.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.855+0000 7f869d48f640 1 Processor -- start 2024-04-25T08:46:58.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.855+0000 7f869d48f640 1 -- start start 2024-04-25T08:46:58.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f869d48f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f869815dc20 0x7f86980ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f869d48f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8698161710 0x7f86980cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f869d48f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869815e000 con 0x7f86980b9330 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f869d48f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86980d1de0 con 0x7f8698161710 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f869d48f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8698161c60 con 0x7f869815dc20 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f86967fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8698161710 0x7f86980cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f86967fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8698161710 0x7f86980cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33806/0 (socket says 172.21.15.172:33806) 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f86967fc640 1 -- 172.21.15.172:0/1795165052 learned_addr learned my addr 172.21.15.172:0/1795165052 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f8696ffd640 1 --2- 172.21.15.172:0/1795165052 >> v2:172.21.15.186:3300/0 conn(0x7f869815dc20 0x7f86980ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f86967fc640 1 -- 172.21.15.172:0/1795165052 >> v2:172.21.15.186:3300/0 conn(0x7f869815dc20 msgr2=0x7f86980ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f86967fc640 1 --2- 172.21.15.172:0/1795165052 >> v2:172.21.15.186:3300/0 conn(0x7f869815dc20 0x7f86980ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f86967fc640 1 -- 172.21.15.172:0/1795165052 >> v1:172.21.15.186:6789/0 conn(0x7f86980b9330 legacy=0x7f869806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f86967fc640 1 -- 172.21.15.172:0/1795165052 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8698161f40 con 0x7f8698161710 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.856+0000 7f8696ffd640 1 --2- 172.21.15.172:0/1795165052 >> v2:172.21.15.186:3300/0 conn(0x7f869815dc20 0x7f86980ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.857+0000 7f86967fc640 1 --2- 172.21.15.172:0/1795165052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8698161710 0x7f86980cebb0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f86980d1520 tx=0x7f868c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6795a19002ef161f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.857+0000 7f8695ffb640 1 -- 172.21.15.172:0/1795165052 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c037070 con 0x7f8698161710 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.857+0000 7f8695ffb640 1 -- 172.21.15.172:0/1795165052 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c032440 con 0x7f8698161710 2024-04-25T08:46:58.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.857+0000 7f8695ffb640 1 -- 172.21.15.172:0/1795165052 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c032810 con 0x7f8698161710 2024-04-25T08:46:58.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.858+0000 7f869d48f640 1 -- 172.21.15.172:0/1795165052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8698161710 msgr2=0x7f86980cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.858+0000 7f869d48f640 1 --2- 172.21.15.172:0/1795165052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8698161710 0x7f86980cebb0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f86980d1520 tx=0x7f868c02a230 comp rx=0 tx=0).stop 2024-04-25T08:46:58.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.858+0000 7f869d48f640 1 -- 172.21.15.172:0/1795165052 shutdown_connections 2024-04-25T08:46:58.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.858+0000 7f869d48f640 1 --2- 172.21.15.172:0/1795165052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8698161710 0x7f86980cebb0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.858+0000 7f869d48f640 1 --2- 172.21.15.172:0/1795165052 >> v2:172.21.15.186:3300/0 conn(0x7f869815dc20 0x7f86980ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.858+0000 7f869d48f640 1 -- 172.21.15.172:0/1795165052 >> 172.21.15.172:0/1795165052 conn(0x7f86980d0420 msgr2=0x7f86980d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.858+0000 7f869d48f640 1 -- 172.21.15.172:0/1795165052 shutdown_connections 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.858+0000 7f869d48f640 1 -- 172.21.15.172:0/1795165052 wait complete. 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.859+0000 7f869d48f640 1 Processor -- start 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.859+0000 7f869d48f640 1 -- start start 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f869d48f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86980b9330 0x7f869815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f869d48f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f869815dc20 0x7f86980aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f869d48f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8698161710 0x7f86980cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f869d48f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86980b5e50 con 0x7f86980b9330 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f869d48f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8698162500 con 0x7f869815dc20 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f869d48f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86980b5fd0 con 0x7f8698161710 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f8696ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86980b9330 0x7f869815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f8696ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86980b9330 0x7f869815cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33810/0 (socket says 172.21.15.172:33810) 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f8696ffd640 1 -- 172.21.15.172:0/4147325797 learned_addr learned my addr 172.21.15.172:0/4147325797 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:58.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f8696ffd640 1 -- 172.21.15.172:0/4147325797 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8698161710 msgr2=0x7f86980cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f8696ffd640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8698161710 0x7f86980cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f8696ffd640 1 -- 172.21.15.172:0/4147325797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f869815dc20 msgr2=0x7f86980aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:58.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f8696ffd640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f869815dc20 0x7f86980aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:58.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f8696ffd640 1 -- 172.21.15.172:0/4147325797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869815d480 con 0x7f86980b9330 2024-04-25T08:46:58.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f8696ffd640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86980b9330 0x7f869815cf40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f868800c7f0 tx=0x7f868800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:58.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f867f7fe640 1 -- 172.21.15.172:0/4147325797 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688015070 con 0x7f86980b9330 2024-04-25T08:46:58.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f867f7fe640 1 -- 172.21.15.172:0/4147325797 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8688007820 con 0x7f86980b9330 2024-04-25T08:46:58.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f869d48f640 1 -- 172.21.15.172:0/4147325797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86981f7e00 con 0x7f86980b9330 2024-04-25T08:46:58.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f867f7fe640 1 -- 172.21.15.172:0/4147325797 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688007bd0 con 0x7f86980b9330 2024-04-25T08:46:58.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.860+0000 7f869d48f640 1 -- 172.21.15.172:0/4147325797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86980cbab0 con 0x7f86980b9330 2024-04-25T08:46:58.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.861+0000 7f869d48f640 1 -- 172.21.15.172:0/4147325797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8698073a00 con 0x7f86980b9330 2024-04-25T08:46:58.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.862+0000 7f867f7fe640 1 -- 172.21.15.172:0/4147325797 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8688018070 con 0x7f86980b9330 2024-04-25T08:46:58.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.862+0000 7f867f7fe640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f868406b4d0 0x7f868406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:58.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.862+0000 7f867f7fe640 1 -- 172.21.15.172:0/4147325797 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f868808a470 con 0x7f86980b9330 2024-04-25T08:46:58.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.862+0000 7f86967fc640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f868406b4d0 0x7f868406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:58.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.863+0000 7f86967fc640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f868406b4d0 0x7f868406d990 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f868c034000 tx=0x7f868c02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:58.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:58.867+0000 7f867f7fe640 1 -- 172.21.15.172:0/4147325797 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f869815d480 con 0x7f86980b9330 2024-04-25T08:46:59.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.072+0000 7f869d48f640 1 -- 172.21.15.172:0/4147325797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f86980b8ca0 con 0x7f86980b9330 2024-04-25T08:46:59.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.742+0000 7f867f7fe640 1 -- 172.21.15.172:0/4147325797 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86880591f0 con 0x7f86980b9330 2024-04-25T08:46:59.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 -- 172.21.15.172:0/4147325797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f868406b4d0 msgr2=0x7f868406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f868406b4d0 0x7f868406d990 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f868c034000 tx=0x7f868c02c000 comp rx=0 tx=0).stop 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 -- 172.21.15.172:0/4147325797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86980b9330 msgr2=0x7f869815cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86980b9330 0x7f869815cf40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f868800c7f0 tx=0x7f868800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 -- 172.21.15.172:0/4147325797 shutdown_connections 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f868406b4d0 0x7f868406d990 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f869815dc20 0x7f86980aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8698161710 0x7f86980cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 --2- 172.21.15.172:0/4147325797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86980b9330 0x7f869815cf40 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 -- 172.21.15.172:0/4147325797 >> 172.21.15.172:0/4147325797 conn(0x7f86980d0420 msgr2=0x7f86980b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 -- 172.21.15.172:0/4147325797 shutdown_connections 2024-04-25T08:46:59.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.745+0000 7f869d48f640 1 -- 172.21.15.172:0/4147325797 wait complete. 2024-04-25T08:46:59.750 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:46:59.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:46:59.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.861+0000 7f810204a640 1 Processor -- start 2024-04-25T08:46:59.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.861+0000 7f810204a640 1 -- start start 2024-04-25T08:46:59.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.861+0000 7f810204a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80fc15dc00 0x7f80fc0c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:59.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f810204a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80fc0ceb20 0x7f80fc0d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f810204a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f80fc0d1c00 0x7f80fc0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f810204a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc0d2060 con 0x7f80fc0ceb20 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f810204a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc15dfe0 con 0x7f80fc0d1c00 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f810204a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0d00c0 con 0x7f80fc15dc00 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f80faffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80fc0ceb20 0x7f80fc0d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f80faffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80fc0ceb20 0x7f80fc0d16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33824/0 (socket says 172.21.15.172:33824) 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f80faffd640 1 -- 172.21.15.172:0/455294808 learned_addr learned my addr 172.21.15.172:0/455294808 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f80fbfff640 1 --2- 172.21.15.172:0/455294808 >> v2:172.21.15.186:3300/0 conn(0x7f80fc0d1c00 0x7f80fc0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f80fb7fe640 1 --2- 172.21.15.172:0/455294808 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80fc15dc00 0x7f80fc0c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f80faffd640 1 -- 172.21.15.172:0/455294808 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80fc15dc00 msgr2=0x7f80fc0c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f80faffd640 1 --2- 172.21.15.172:0/455294808 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80fc15dc00 0x7f80fc0c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f80faffd640 1 -- 172.21.15.172:0/455294808 >> v2:172.21.15.186:3300/0 conn(0x7f80fc0d1c00 msgr2=0x7f80fc0ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f80faffd640 1 --2- 172.21.15.172:0/455294808 >> v2:172.21.15.186:3300/0 conn(0x7f80fc0d1c00 0x7f80fc0ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.862+0000 7f80faffd640 1 -- 172.21.15.172:0/455294808 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0d03a0 con 0x7f80fc0ceb20 2024-04-25T08:46:59.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f80faffd640 1 --2- 172.21.15.172:0/455294808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0ceb20 0x7f80fc0d16c0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0b7a10 tx=0x7f80f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50e36551bebfa7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:59.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f80fa7fc640 1 -- 172.21.15.172:0/455294808 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0037070 con 0x7f80fc0ceb20 2024-04-25T08:46:59.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f80fa7fc640 1 -- 172.21.15.172:0/455294808 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0032440 con 0x7f80fc0ceb20 2024-04-25T08:46:59.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f80fa7fc640 1 -- 172.21.15.172:0/455294808 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0032810 con 0x7f80fc0ceb20 2024-04-25T08:46:59.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f810204a640 1 -- 172.21.15.172:0/455294808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0ceb20 msgr2=0x7f80fc0d16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:59.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f810204a640 1 --2- 172.21.15.172:0/455294808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0ceb20 0x7f80fc0d16c0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0b7a10 tx=0x7f80f002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f810204a640 1 -- 172.21.15.172:0/455294808 shutdown_connections 2024-04-25T08:46:59.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f810204a640 1 --2- 172.21.15.172:0/455294808 >> v2:172.21.15.186:3300/0 conn(0x7f80fc0d1c00 0x7f80fc0ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f810204a640 1 --2- 172.21.15.172:0/455294808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0ceb20 0x7f80fc0d16c0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f810204a640 1 --2- 172.21.15.172:0/455294808 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80fc15dc00 0x7f80fc0c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.863+0000 7f810204a640 1 -- 172.21.15.172:0/455294808 >> 172.21.15.172:0/455294808 conn(0x7f80fc06f5d0 msgr2=0x7f80fc06f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:46:59.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.864+0000 7f810204a640 1 -- 172.21.15.172:0/455294808 shutdown_connections 2024-04-25T08:46:59.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.864+0000 7f810204a640 1 -- 172.21.15.172:0/455294808 wait complete. 2024-04-25T08:46:59.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.865+0000 7f810204a640 1 Processor -- start 2024-04-25T08:46:59.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.865+0000 7f810204a640 1 -- start start 2024-04-25T08:46:59.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.865+0000 7f810204a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80fc0ceb20 0x7f80fc15c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:59.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.865+0000 7f810204a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0d1c00 0x7f80fc1f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:59.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.865+0000 7f810204a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80fc15dc00 0x7f80fc0b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:59.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.865+0000 7f810204a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0cc130 con 0x7f80fc0d1c00 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.865+0000 7f810204a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0cc720 con 0x7f80fc0ceb20 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.865+0000 7f810204a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0cfd90 con 0x7f80fc15dc00 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80faffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0d1c00 0x7f80fc1f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80faffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0d1c00 0x7f80fc1f41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33828/0 (socket says 172.21.15.172:33828) 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80faffd640 1 -- 172.21.15.172:0/3347784984 learned_addr learned my addr 172.21.15.172:0/3347784984 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80fb7fe640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80fc0ceb20 0x7f80fc15c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80fbfff640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80fc15dc00 0x7f80fc0b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80faffd640 1 -- 172.21.15.172:0/3347784984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80fc15dc00 msgr2=0x7f80fc0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80faffd640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80fc15dc00 0x7f80fc0b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80faffd640 1 -- 172.21.15.172:0/3347784984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80fc0ceb20 msgr2=0x7f80fc15c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80faffd640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80fc0ceb20 0x7f80fc15c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80faffd640 1 -- 172.21.15.172:0/3347784984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0b5f50 con 0x7f80fc0d1c00 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80faffd640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0d1c00 0x7f80fc1f41a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f80f002a220 tx=0x7f80f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80e3fff640 1 -- 172.21.15.172:0/3347784984 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0041020 con 0x7f80fc0d1c00 2024-04-25T08:46:59.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80e3fff640 1 -- 172.21.15.172:0/3347784984 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f003d620 con 0x7f80fc0d1c00 2024-04-25T08:46:59.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f810204a640 1 -- 172.21.15.172:0/3347784984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc15cc00 con 0x7f80fc0d1c00 2024-04-25T08:46:59.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f80e3fff640 1 -- 172.21.15.172:0/3347784984 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0037040 con 0x7f80fc0d1c00 2024-04-25T08:46:59.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.866+0000 7f810204a640 1 -- 172.21.15.172:0/3347784984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc15cec0 con 0x7f80fc0d1c00 2024-04-25T08:46:59.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.867+0000 7f810204a640 1 -- 172.21.15.172:0/3347784984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80fc073990 con 0x7f80fc0d1c00 2024-04-25T08:46:59.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.868+0000 7f80e3fff640 1 -- 172.21.15.172:0/3347784984 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f80f0044020 con 0x7f80fc0d1c00 2024-04-25T08:46:59.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.868+0000 7f80e3fff640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f80e806b4d0 0x7f80e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:46:59.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.868+0000 7f80e3fff640 1 -- 172.21.15.172:0/3347784984 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f80f00aa900 con 0x7f80fc0d1c00 2024-04-25T08:46:59.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.868+0000 7f80fb7fe640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f80e806b4d0 0x7f80e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:46:59.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.868+0000 7f80fb7fe640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f80e806b4d0 0x7f80e806d990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f80fc06cd50 tx=0x7f80ec009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:46:59.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:46:59.872+0000 7f80e3fff640 1 -- 172.21.15.172:0/3347784984 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f80f004b030 con 0x7f80fc0d1c00 2024-04-25T08:46:59.968 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:46:59.970 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:47:00.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.083+0000 7f810204a640 1 -- 172.21.15.172:0/3347784984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80fc0c7110 con 0x7f80fc0d1c00 2024-04-25T08:47:00.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.084+0000 7f80e3fff640 1 -- 172.21.15.172:0/3347784984 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f80fc0b5f50 con 0x7f80fc0d1c00 2024-04-25T08:47:00.075 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:47:00.075 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":49,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1549593613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1549593613},{"type":"v1","addr":"172.21.15.186:6833","nonce":1549593613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2002207643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2002207643},{"type":"v1","addr":"172.21.15.186:6835","nonce":2002207643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2584048606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2584048606},{"type":"v1","addr":"172.21.15.172:6836","nonce":2584048606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:57.048324+0000","modified":"2024-04-25T08:46:59.073682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6837/1878763904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1878763904},{"type":"v1","addr":"172.21.15.172:6837","nonce":1878763904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:47:00.076 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 49 2024-04-25T08:47:00.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 -- 172.21.15.172:0/3347784984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f80e806b4d0 msgr2=0x7f80e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f80e806b4d0 0x7f80e806d990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f80fc06cd50 tx=0x7f80ec009190 comp rx=0 tx=0).stop 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 -- 172.21.15.172:0/3347784984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0d1c00 msgr2=0x7f80fc1f41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0d1c00 0x7f80fc1f41a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f80f002a220 tx=0x7f80f00046c0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 -- 172.21.15.172:0/3347784984 shutdown_connections 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f80e806b4d0 0x7f80e806d990 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80fc15dc00 0x7f80fc0b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80fc0d1c00 0x7f80fc1f41a0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 --2- 172.21.15.172:0/3347784984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80fc0ceb20 0x7f80fc15c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 -- 172.21.15.172:0/3347784984 >> 172.21.15.172:0/3347784984 conn(0x7f80fc06f5d0 msgr2=0x7f80fc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 -- 172.21.15.172:0/3347784984 shutdown_connections 2024-04-25T08:47:00.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.086+0000 7f810204a640 1 -- 172.21.15.172:0/3347784984 wait complete. 2024-04-25T08:47:00.088 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:47:00.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.194+0000 7fa013c1f640 1 Processor -- start 2024-04-25T08:47:00.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.195+0000 7fa013c1f640 1 -- start start 2024-04-25T08:47:00.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.195+0000 7fa013c1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 0x7fa00c15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.195+0000 7fa013c1f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa00c06abe0 0x7fa00c06b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.195+0000 7fa013c1f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa00c072620 0x7fa00c072a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.195+0000 7fa013c1f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c06b580 con 0x7fa00c072620 2024-04-25T08:47:00.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.195+0000 7fa013c1f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c0cfa60 con 0x7fa00c06abe0 2024-04-25T08:47:00.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.195+0000 7fa013c1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0cfd40 con 0x7fa00c15b9c0 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0121bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa00c072620 0x7fa00c072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0121bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa00c072620 0x7fa00c072a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33830/0 (socket says 172.21.15.172:33830) 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0121bc640 1 -- 172.21.15.172:0/3354803424 learned_addr learned my addr 172.21.15.172:0/3354803424 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0111ba640 1 --2- 172.21.15.172:0/3354803424 >> v2:172.21.15.186:3300/0 conn(0x7fa00c06abe0 0x7fa00c06b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0119bb640 1 --2- 172.21.15.172:0/3354803424 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 0x7fa00c15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0121bc640 1 -- 172.21.15.172:0/3354803424 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 msgr2=0x7fa00c15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0121bc640 1 --2- 172.21.15.172:0/3354803424 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 0x7fa00c15bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0121bc640 1 -- 172.21.15.172:0/3354803424 >> v2:172.21.15.186:3300/0 conn(0x7fa00c06abe0 msgr2=0x7fa00c06b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0121bc640 1 --2- 172.21.15.172:0/3354803424 >> v2:172.21.15.186:3300/0 conn(0x7fa00c06abe0 0x7fa00c06b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0121bc640 1 -- 172.21.15.172:0/3354803424 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0d0020 con 0x7fa00c072620 2024-04-25T08:47:00.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.196+0000 7fa0119bb640 1 --2- 172.21.15.172:0/3354803424 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 0x7fa00c15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa0121bc640 1 --2- 172.21.15.172:0/3354803424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c072620 0x7fa00c072a90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0b59b0 tx=0x7fa00802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94768c4b94119427 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa0109b9640 1 -- 172.21.15.172:0/3354803424 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008036070 con 0x7fa00c072620 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa0109b9640 1 -- 172.21.15.172:0/3354803424 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa008031600 con 0x7fa00c072620 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa0109b9640 1 -- 172.21.15.172:0/3354803424 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080319d0 con 0x7fa00c072620 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa013c1f640 1 -- 172.21.15.172:0/3354803424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c072620 msgr2=0x7fa00c072a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa013c1f640 1 --2- 172.21.15.172:0/3354803424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c072620 0x7fa00c072a90 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0b59b0 tx=0x7fa00802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa013c1f640 1 -- 172.21.15.172:0/3354803424 shutdown_connections 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa013c1f640 1 --2- 172.21.15.172:0/3354803424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c072620 0x7fa00c072a90 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa013c1f640 1 --2- 172.21.15.172:0/3354803424 >> v2:172.21.15.186:3300/0 conn(0x7fa00c06abe0 0x7fa00c06b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa013c1f640 1 --2- 172.21.15.172:0/3354803424 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 0x7fa00c15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa013c1f640 1 -- 172.21.15.172:0/3354803424 >> 172.21.15.172:0/3354803424 conn(0x7fa00c0b2370 msgr2=0x7fa00c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:00.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa013c1f640 1 -- 172.21.15.172:0/3354803424 shutdown_connections 2024-04-25T08:47:00.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.197+0000 7fa013c1f640 1 -- 172.21.15.172:0/3354803424 wait complete. 2024-04-25T08:47:00.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.198+0000 7fa013c1f640 1 Processor -- start 2024-04-25T08:47:00.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.199+0000 7fa013c1f640 1 -- start start 2024-04-25T08:47:00.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.199+0000 7fa013c1f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c06abe0 0x7fa00c157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.199+0000 7fa013c1f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa00c072620 0x7fa00c158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.199+0000 7fa013c1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 0x7fa00c158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.199+0000 7fa013c1f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c15c2e0 con 0x7fa00c06abe0 2024-04-25T08:47:00.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.199+0000 7fa013c1f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0cf710 con 0x7fa00c072620 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.199+0000 7fa013c1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c072fd0 con 0x7fa00c15b9c0 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.199+0000 7fa0119bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c06abe0 0x7fa00c157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.199+0000 7fa0119bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c06abe0 0x7fa00c157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33836/0 (socket says 172.21.15.172:33836) 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.199+0000 7fa0119bb640 1 -- 172.21.15.172:0/3776222937 learned_addr learned my addr 172.21.15.172:0/3776222937 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0111ba640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa00c072620 0x7fa00c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0121bc640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 0x7fa00c158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0119bb640 1 -- 172.21.15.172:0/3776222937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 msgr2=0x7fa00c158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0119bb640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 0x7fa00c158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0119bb640 1 -- 172.21.15.172:0/3776222937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa00c072620 msgr2=0x7fa00c158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0119bb640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa00c072620 0x7fa00c158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0119bb640 1 -- 172.21.15.172:0/3776222937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c14c6d0 con 0x7fa00c06abe0 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0121bc640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 0x7fa00c158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0111ba640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa00c072620 0x7fa00c158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0119bb640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c06abe0 0x7fa00c157c00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa00400c820 tx=0x7fa00400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:00.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0027fc640 1 -- 172.21.15.172:0/3776222937 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004015070 con 0x7fa00c06abe0 2024-04-25T08:47:00.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0027fc640 1 -- 172.21.15.172:0/3776222937 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa004007a30 con 0x7fa00c06abe0 2024-04-25T08:47:00.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa013c1f640 1 -- 172.21.15.172:0/3776222937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c150af0 con 0x7fa00c06abe0 2024-04-25T08:47:00.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa0027fc640 1 -- 172.21.15.172:0/3776222937 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004007de0 con 0x7fa00c06abe0 2024-04-25T08:47:00.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.200+0000 7fa013c1f640 1 -- 172.21.15.172:0/3776222937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c14d630 con 0x7fa00c06abe0 2024-04-25T08:47:00.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.201+0000 7fa013c1f640 1 -- 172.21.15.172:0/3776222937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c073990 con 0x7fa00c06abe0 2024-04-25T08:47:00.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.201+0000 7fa0027fc640 1 -- 172.21.15.172:0/3776222937 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa004018070 con 0x7fa00c06abe0 2024-04-25T08:47:00.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.202+0000 7fa0027fc640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9ff006b4d0 0x7f9ff006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.202+0000 7fa0111ba640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9ff006b4d0 0x7f9ff006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.202+0000 7fa0027fc640 1 -- 172.21.15.172:0/3776222937 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa00408a1b0 con 0x7fa00c06abe0 2024-04-25T08:47:00.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.202+0000 7fa0111ba640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9ff006b4d0 0x7f9ff006d990 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0cdb30 tx=0x7f9ffc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:00.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.206+0000 7fa0027fc640 1 -- 172.21.15.172:0/3776222937 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa004058f30 con 0x7fa00c06abe0 2024-04-25T08:47:00.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.378+0000 7fa013c1f640 1 -- 172.21.15.172:0/3776222937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa00c15b1e0 con 0x7fa00c06abe0 2024-04-25T08:47:00.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.379+0000 7fa0027fc640 1 -- 172.21.15.172:0/3776222937 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17005 (secure 0 0 0) 0x7fa004058830 con 0x7fa00c06abe0 2024-04-25T08:47:00.371 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:47:00.371 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":81,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:46:58.719393+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:55.259890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:56.021748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:47:00.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 -- 172.21.15.172:0/3776222937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9ff006b4d0 msgr2=0x7f9ff006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9ff006b4d0 0x7f9ff006d990 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0cdb30 tx=0x7f9ffc008040 comp rx=0 tx=0).stop 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 -- 172.21.15.172:0/3776222937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c06abe0 msgr2=0x7fa00c157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c06abe0 0x7fa00c157c00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa00400c820 tx=0x7fa00400cce0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 -- 172.21.15.172:0/3776222937 shutdown_connections 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9ff006b4d0 0x7f9ff006d990 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa00c072620 0x7fa00c158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa00c15b9c0 0x7fa00c158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 --2- 172.21.15.172:0/3776222937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa00c06abe0 0x7fa00c157c00 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 -- 172.21.15.172:0/3776222937 >> 172.21.15.172:0/3776222937 conn(0x7fa00c0b2370 msgr2=0x7fa00c0cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 -- 172.21.15.172:0/3776222937 shutdown_connections 2024-04-25T08:47:00.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.381+0000 7fa013c1f640 1 -- 172.21.15.172:0/3776222937 wait complete. 2024-04-25T08:47:00.384 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:47:00.384 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:47:00.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.489+0000 7f53a8491640 1 Processor -- start 2024-04-25T08:47:00.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.489+0000 7f53a8491640 1 -- start start 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.490+0000 7f53a8491640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53a015dd80 0x7f53a015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.490+0000 7f53a8491640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a0161800 0x7f53a006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.490+0000 7f53a8491640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a00cfaf0 con 0x7f53a006c920 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.490+0000 7f53a8491640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a015e6a0 con 0x7f53a015dd80 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.490+0000 7f53a8491640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a006cd70 con 0x7f53a0161800 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.490+0000 7f53a622d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53a015dd80 0x7f53a015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.490+0000 7f53a6a2e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f53a006c920 0x7f53a0099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46562/0 (socket says 172.21.15.172:46562) 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.490+0000 7f53a622d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53a015dd80 0x7f53a015e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33850/0 (socket says 172.21.15.172:33850) 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.490+0000 7f53a6a2e640 1 -- 172.21.15.172:0/4178775830 learned_addr learned my addr 172.21.15.172:0/4178775830 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.491+0000 7f53a5a2c640 1 --2- 172.21.15.172:0/4178775830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a0161800 0x7f53a006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.491+0000 7f53a622d640 1 -- 172.21.15.172:0/4178775830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a0161800 msgr2=0x7f53a006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.491+0000 7f53a622d640 1 --2- 172.21.15.172:0/4178775830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a0161800 0x7f53a006c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.491+0000 7f53a622d640 1 -- 172.21.15.172:0/4178775830 >> v1:172.21.15.172:6789/0 conn(0x7f53a006c920 legacy=0x7f53a0099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.491+0000 7f53a622d640 1 -- 172.21.15.172:0/4178775830 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a015e8e0 con 0x7f53a015dd80 2024-04-25T08:47:00.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.491+0000 7f53a522b640 1 -- 172.21.15.172:0/4178775830 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900258390 0 0) 0x7f53a00cfaf0 con 0x7f53a006c920 2024-04-25T08:47:00.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.491+0000 7f53a5a2c640 1 --2- 172.21.15.172:0/4178775830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a0161800 0x7f53a006c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:00.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.491+0000 7f53a622d640 1 --2- 172.21.15.172:0/4178775830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a015dd80 0x7f53a015e160 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f5398009d90 tx=0x7f539802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e7930c2d330d44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:00.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a522b640 1 -- 172.21.15.172:0/4178775830 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398007740 con 0x7f53a015dd80 2024-04-25T08:47:00.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a522b640 1 -- 172.21.15.172:0/4178775830 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53980078e0 con 0x7f53a015dd80 2024-04-25T08:47:00.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a522b640 1 -- 172.21.15.172:0/4178775830 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398007cb0 con 0x7f53a015dd80 2024-04-25T08:47:00.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a8491640 1 -- 172.21.15.172:0/4178775830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a015dd80 msgr2=0x7f53a015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a8491640 1 --2- 172.21.15.172:0/4178775830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a015dd80 0x7f53a015e160 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f5398009d90 tx=0x7f539802a660 comp rx=0 tx=0).stop 2024-04-25T08:47:00.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a8491640 1 -- 172.21.15.172:0/4178775830 shutdown_connections 2024-04-25T08:47:00.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a8491640 1 --2- 172.21.15.172:0/4178775830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a0161800 0x7f53a006c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a8491640 1 --2- 172.21.15.172:0/4178775830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a015dd80 0x7f53a015e160 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a8491640 1 -- 172.21.15.172:0/4178775830 >> 172.21.15.172:0/4178775830 conn(0x7f53a00b3310 msgr2=0x7f53a00b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:00.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a8491640 1 -- 172.21.15.172:0/4178775830 shutdown_connections 2024-04-25T08:47:00.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.492+0000 7f53a8491640 1 -- 172.21.15.172:0/4178775830 wait complete. 2024-04-25T08:47:00.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.493+0000 7f53a8491640 1 Processor -- start 2024-04-25T08:47:00.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.493+0000 7f53a8491640 1 -- start start 2024-04-25T08:47:00.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a8491640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a006c920 0x7f53a00b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a8491640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a015dd80 0x7f53a015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a8491640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a0161800 0x7f53a015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a8491640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a015f180 con 0x7f53a0161800 2024-04-25T08:47:00.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a8491640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a015eea0 con 0x7f53a015dd80 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a8491640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a006c0c0 con 0x7f53a006c920 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a6a2e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a0161800 0x7f53a015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a6a2e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a0161800 0x7f53a015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33854/0 (socket says 172.21.15.172:33854) 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a6a2e640 1 -- 172.21.15.172:0/2306155994 learned_addr learned my addr 172.21.15.172:0/2306155994 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a622d640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a006c920 0x7f53a00b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a5a2c640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a015dd80 0x7f53a015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a6a2e640 1 -- 172.21.15.172:0/2306155994 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a006c920 msgr2=0x7f53a00b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a6a2e640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a006c920 0x7f53a00b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a6a2e640 1 -- 172.21.15.172:0/2306155994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a015dd80 msgr2=0x7f53a015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a6a2e640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a015dd80 0x7f53a015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a6a2e640 1 -- 172.21.15.172:0/2306155994 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a00c8d50 con 0x7f53a0161800 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.494+0000 7f53a5a2c640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a015dd80 0x7f53a015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.495+0000 7f53a6a2e640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a0161800 0x7f53a015b090 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f539c00c410 tx=0x7f539c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.495+0000 7f5396ffd640 1 -- 172.21.15.172:0/2306155994 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0074e0 con 0x7f53a0161800 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.495+0000 7f5396ffd640 1 -- 172.21.15.172:0/2306155994 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c0047e0 con 0x7f53a0161800 2024-04-25T08:47:00.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.495+0000 7f53a8491640 1 -- 172.21.15.172:0/2306155994 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a00c9030 con 0x7f53a0161800 2024-04-25T08:47:00.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.495+0000 7f5396ffd640 1 -- 172.21.15.172:0/2306155994 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c004bd0 con 0x7f53a0161800 2024-04-25T08:47:00.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.495+0000 7f53a8491640 1 -- 172.21.15.172:0/2306155994 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a00c95f0 con 0x7f53a0161800 2024-04-25T08:47:00.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.496+0000 7f53a8491640 1 -- 172.21.15.172:0/2306155994 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a0073990 con 0x7f53a0161800 2024-04-25T08:47:00.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.496+0000 7f5396ffd640 1 -- 172.21.15.172:0/2306155994 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f539c011070 con 0x7f53a0161800 2024-04-25T08:47:00.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.497+0000 7f5396ffd640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f538406b4d0 0x7f538406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.497+0000 7f53a622d640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f538406b4d0 0x7f538406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.497+0000 7f5396ffd640 1 -- 172.21.15.172:0/2306155994 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f539c089f20 con 0x7f53a0161800 2024-04-25T08:47:00.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.497+0000 7f53a622d640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f538406b4d0 0x7f538406d990 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5398034000 tx=0x7f5398033040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:00.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.501+0000 7f5396ffd640 1 -- 172.21.15.172:0/2306155994 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f539c01a2b0 con 0x7f53a0161800 2024-04-25T08:47:00.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.670+0000 7f53a8491640 1 -- 172.21.15.172:0/2306155994 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53a00b77a0 con 0x7f538406b4d0 2024-04-25T08:47:00.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.675+0000 7f5396ffd640 1 -- 172.21.15.172:0/2306155994 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248962 (secure 0 0 0) 0x7f53a00b77a0 con 0x7f538406b4d0 2024-04-25T08:47:00.669 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:47:00.670 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.678+0000 7f53a8491640 1 -- 172.21.15.172:0/2306155994 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f538406b4d0 msgr2=0x7f538406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.678+0000 7f53a8491640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f538406b4d0 0x7f538406d990 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5398034000 tx=0x7f5398033040 comp rx=0 tx=0).stop 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.678+0000 7f53a8491640 1 -- 172.21.15.172:0/2306155994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a0161800 msgr2=0x7f53a015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.678+0000 7f53a8491640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a0161800 0x7f53a015b090 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f539c00c410 tx=0x7f539c00c8d0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.678+0000 7f53a8491640 1 -- 172.21.15.172:0/2306155994 shutdown_connections 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.678+0000 7f53a8491640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f538406b4d0 0x7f538406d990 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.678+0000 7f53a8491640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a015dd80 0x7f53a015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.678+0000 7f53a8491640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a0161800 0x7f53a015b090 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.678+0000 7f53a8491640 1 --2- 172.21.15.172:0/2306155994 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a006c920 0x7f53a00b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.678+0000 7f53a8491640 1 -- 172.21.15.172:0/2306155994 >> 172.21.15.172:0/2306155994 conn(0x7f53a00b3310 msgr2=0x7f53a00cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:00.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.679+0000 7f53a8491640 1 -- 172.21.15.172:0/2306155994 shutdown_connections 2024-04-25T08:47:00.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.679+0000 7f53a8491640 1 -- 172.21.15.172:0/2306155994 wait complete. 2024-04-25T08:47:00.682 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-04-25T08:47:00.568379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":291632,"kb_used_data":8880,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754683088,"statfs":{"total":773094113280,"available":772795482112,"internally_reserved":0,"allocated":9093120,"data_stored":4800222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.868639"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816620+0000","last_change":"2024-04-25T08:46:57.748857+0000","last_active":"2024-04-25T08:46:58.816620+0000","last_peered":"2024-04-25T08:46:58.816620+0000","last_clean":"2024-04-25T08:46:58.816620+0000","last_became_active":"2024-04-25T08:46:57.748557+0000","last_became_peered":"2024-04-25T08:46:57.748557+0000","last_unstale":"2024-04-25T08:46:58.816620+0000","last_undegraded":"2024-04-25T08:46:58.816620+0000","last_fullsized":"2024-04-25T08:46:58.816620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.872215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725285+0000","last_change":"2024-04-25T08:46:57.733902+0000","last_active":"2024-04-25T08:46:58.725285+0000","last_peered":"2024-04-25T08:46:58.725285+0000","last_clean":"2024-04-25T08:46:58.725285+0000","last_became_active":"2024-04-25T08:46:57.733591+0000","last_became_peered":"2024-04-25T08:46:57.733591+0000","last_unstale":"2024-04-25T08:46:58.725285+0000","last_undegraded":"2024-04-25T08:46:58.725285+0000","last_fullsized":"2024-04-25T08:46:58.725285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:55.569414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724257+0000","last_change":"2024-04-25T08:46:57.734366+0000","last_active":"2024-04-25T08:46:58.724257+0000","last_peered":"2024-04-25T08:46:58.724257+0000","last_clean":"2024-04-25T08:46:58.724257+0000","last_became_active":"2024-04-25T08:46:57.733738+0000","last_became_peered":"2024-04-25T08:46:57.733738+0000","last_unstale":"2024-04-25T08:46:58.724257+0000","last_undegraded":"2024-04-25T08:46:58.724257+0000","last_fullsized":"2024-04-25T08:46:58.724257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816404+0000","last_change":"2024-04-25T08:46:57.750494+0000","last_active":"2024-04-25T08:46:58.816404+0000","last_peered":"2024-04-25T08:46:58.816404+0000","last_clean":"2024-04-25T08:46:58.816404+0000","last_became_active":"2024-04-25T08:46:57.750234+0000","last_became_peered":"2024-04-25T08:46:57.750234+0000","last_unstale":"2024-04-25T08:46:58.816404+0000","last_undegraded":"2024-04-25T08:46:58.816404+0000","last_fullsized":"2024-04-25T08:46:58.816404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:53.853355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815579+0000","last_change":"2024-04-25T08:46:57.736898+0000","last_active":"2024-04-25T08:46:58.815579+0000","last_peered":"2024-04-25T08:46:58.815579+0000","last_clean":"2024-04-25T08:46:58.815579+0000","last_became_active":"2024-04-25T08:46:57.736617+0000","last_became_peered":"2024-04-25T08:46:57.736617+0000","last_unstale":"2024-04-25T08:46:58.815579+0000","last_undegraded":"2024-04-25T08:46:58.815579+0000","last_fullsized":"2024-04-25T08:46:58.815579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815743+0000","last_change":"2024-04-25T08:46:57.749375+0000","last_active":"2024-04-25T08:46:58.815743+0000","last_peered":"2024-04-25T08:46:58.815743+0000","last_clean":"2024-04-25T08:46:58.815743+0000","last_became_active":"2024-04-25T08:46:57.749039+0000","last_became_peered":"2024-04-25T08:46:57.749039+0000","last_unstale":"2024-04-25T08:46:58.815743+0000","last_undegraded":"2024-04-25T08:46:58.815743+0000","last_fullsized":"2024-04-25T08:46:58.815743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:35.985064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724725+0000","last_change":"2024-04-25T08:46:57.740018+0000","last_active":"2024-04-25T08:46:58.724725+0000","last_peered":"2024-04-25T08:46:58.724725+0000","last_clean":"2024-04-25T08:46:58.724725+0000","last_became_active":"2024-04-25T08:46:57.738781+0000","last_became_peered":"2024-04-25T08:46:57.738781+0000","last_unstale":"2024-04-25T08:46:58.724725+0000","last_undegraded":"2024-04-25T08:46:58.724725+0000","last_fullsized":"2024-04-25T08:46:58.724725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:59.347891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724516+0000","last_change":"2024-04-25T08:46:57.742552+0000","last_active":"2024-04-25T08:46:58.724516+0000","last_peered":"2024-04-25T08:46:58.724516+0000","last_clean":"2024-04-25T08:46:58.724516+0000","last_became_active":"2024-04-25T08:46:57.742253+0000","last_became_peered":"2024-04-25T08:46:57.742253+0000","last_unstale":"2024-04-25T08:46:58.724516+0000","last_undegraded":"2024-04-25T08:46:58.724516+0000","last_fullsized":"2024-04-25T08:46:58.724516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:32.530004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815758+0000","last_change":"2024-04-25T08:46:57.750527+0000","last_active":"2024-04-25T08:46:58.815758+0000","last_peered":"2024-04-25T08:46:58.815758+0000","last_clean":"2024-04-25T08:46:58.815758+0000","last_became_active":"2024-04-25T08:46:57.749570+0000","last_became_peered":"2024-04-25T08:46:57.749570+0000","last_unstale":"2024-04-25T08:46:58.815758+0000","last_undegraded":"2024-04-25T08:46:58.815758+0000","last_fullsized":"2024-04-25T08:46:58.815758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:32.530004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724344+0000","last_change":"2024-04-25T08:46:57.737397+0000","last_active":"2024-04-25T08:46:58.724344+0000","last_peered":"2024-04-25T08:46:58.724344+0000","last_clean":"2024-04-25T08:46:58.724344+0000","last_became_active":"2024-04-25T08:46:57.736776+0000","last_became_peered":"2024-04-25T08:46:57.736776+0000","last_unstale":"2024-04-25T08:46:58.724344+0000","last_undegraded":"2024-04-25T08:46:58.724344+0000","last_fullsized":"2024-04-25T08:46:58.724344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816369+0000","last_change":"2024-04-25T08:46:57.755588+0000","last_active":"2024-04-25T08:46:58.816369+0000","last_peered":"2024-04-25T08:46:58.816369+0000","last_clean":"2024-04-25T08:46:58.816369+0000","last_became_active":"2024-04-25T08:46:57.755324+0000","last_became_peered":"2024-04-25T08:46:57.755324+0000","last_unstale":"2024-04-25T08:46:58.816369+0000","last_undegraded":"2024-04-25T08:46:58.816369+0000","last_fullsized":"2024-04-25T08:46:58.816369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:45.411656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815712+0000","last_change":"2024-04-25T08:46:57.736823+0000","last_active":"2024-04-25T08:46:58.815712+0000","last_peered":"2024-04-25T08:46:58.815712+0000","last_clean":"2024-04-25T08:46:58.815712+0000","last_became_active":"2024-04-25T08:46:57.736547+0000","last_became_peered":"2024-04-25T08:46:57.736547+0000","last_unstale":"2024-04-25T08:46:58.815712+0000","last_undegraded":"2024-04-25T08:46:58.815712+0000","last_fullsized":"2024-04-25T08:46:58.815712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:09.706138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815516+0000","last_change":"2024-04-25T08:46:57.745848+0000","last_active":"2024-04-25T08:46:58.815516+0000","last_peered":"2024-04-25T08:46:58.815516+0000","last_clean":"2024-04-25T08:46:58.815516+0000","last_became_active":"2024-04-25T08:46:57.745243+0000","last_became_peered":"2024-04-25T08:46:57.745243+0000","last_unstale":"2024-04-25T08:46:58.815516+0000","last_undegraded":"2024-04-25T08:46:58.815516+0000","last_fullsized":"2024-04-25T08:46:58.815516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:16.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816601+0000","last_change":"2024-04-25T08:46:57.753708+0000","last_active":"2024-04-25T08:46:58.816601+0000","last_peered":"2024-04-25T08:46:58.816601+0000","last_clean":"2024-04-25T08:46:58.816601+0000","last_became_active":"2024-04-25T08:46:57.753453+0000","last_became_peered":"2024-04-25T08:46:57.753453+0000","last_unstale":"2024-04-25T08:46:58.816601+0000","last_undegraded":"2024-04-25T08:46:58.816601+0000","last_fullsized":"2024-04-25T08:46:58.816601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:32.663123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725290+0000","last_change":"2024-04-25T08:46:57.729860+0000","last_active":"2024-04-25T08:46:58.725290+0000","last_peered":"2024-04-25T08:46:58.725290+0000","last_clean":"2024-04-25T08:46:58.725290+0000","last_became_active":"2024-04-25T08:46:57.729559+0000","last_became_peered":"2024-04-25T08:46:57.729559+0000","last_unstale":"2024-04-25T08:46:58.725290+0000","last_undegraded":"2024-04-25T08:46:58.725290+0000","last_fullsized":"2024-04-25T08:46:58.725290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:56.215702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815923+0000","last_change":"2024-04-25T08:46:57.750649+0000","last_active":"2024-04-25T08:46:58.815923+0000","last_peered":"2024-04-25T08:46:58.815923+0000","last_clean":"2024-04-25T08:46:58.815923+0000","last_became_active":"2024-04-25T08:46:57.750400+0000","last_became_peered":"2024-04-25T08:46:57.750400+0000","last_unstale":"2024-04-25T08:46:58.815923+0000","last_undegraded":"2024-04-25T08:46:58.815923+0000","last_fullsized":"2024-04-25T08:46:58.815923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.377815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815835+0000","last_change":"2024-04-25T08:46:57.747932+0000","last_active":"2024-04-25T08:46:58.815835+0000","last_peered":"2024-04-25T08:46:58.815835+0000","last_clean":"2024-04-25T08:46:58.815835+0000","last_became_active":"2024-04-25T08:46:57.747664+0000","last_became_peered":"2024-04-25T08:46:57.747664+0000","last_unstale":"2024-04-25T08:46:58.815835+0000","last_undegraded":"2024-04-25T08:46:58.815835+0000","last_fullsized":"2024-04-25T08:46:58.815835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.805999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724229+0000","last_change":"2024-04-25T08:46:57.733118+0000","last_active":"2024-04-25T08:46:58.724229+0000","last_peered":"2024-04-25T08:46:58.724229+0000","last_clean":"2024-04-25T08:46:58.724229+0000","last_became_active":"2024-04-25T08:46:57.732601+0000","last_became_peered":"2024-04-25T08:46:57.732601+0000","last_unstale":"2024-04-25T08:46:58.724229+0000","last_undegraded":"2024-04-25T08:46:58.724229+0000","last_fullsized":"2024-04-25T08:46:58.724229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:18.985748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816376+0000","last_change":"2024-04-25T08:46:57.755439+0000","last_active":"2024-04-25T08:46:58.816376+0000","last_peered":"2024-04-25T08:46:58.816376+0000","last_clean":"2024-04-25T08:46:58.816376+0000","last_became_active":"2024-04-25T08:46:57.755165+0000","last_became_peered":"2024-04-25T08:46:57.755165+0000","last_unstale":"2024-04-25T08:46:58.816376+0000","last_undegraded":"2024-04-25T08:46:58.816376+0000","last_fullsized":"2024-04-25T08:46:58.816376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:48.272205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724123+0000","last_change":"2024-04-25T08:46:57.734179+0000","last_active":"2024-04-25T08:46:58.724123+0000","last_peered":"2024-04-25T08:46:58.724123+0000","last_clean":"2024-04-25T08:46:58.724123+0000","last_became_active":"2024-04-25T08:46:57.733836+0000","last_became_peered":"2024-04-25T08:46:57.733836+0000","last_unstale":"2024-04-25T08:46:58.724123+0000","last_undegraded":"2024-04-25T08:46:58.724123+0000","last_fullsized":"2024-04-25T08:46:58.724123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:39.811462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816657+0000","last_change":"2024-04-25T08:46:57.752623+0000","last_active":"2024-04-25T08:46:58.816657+0000","last_peered":"2024-04-25T08:46:58.816657+0000","last_clean":"2024-04-25T08:46:58.816657+0000","last_became_active":"2024-04-25T08:46:57.752243+0000","last_became_peered":"2024-04-25T08:46:57.752243+0000","last_unstale":"2024-04-25T08:46:58.816657+0000","last_undegraded":"2024-04-25T08:46:58.816657+0000","last_fullsized":"2024-04-25T08:46:58.816657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:09.706138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816089+0000","last_change":"2024-04-25T08:46:57.751393+0000","last_active":"2024-04-25T08:46:58.816089+0000","last_peered":"2024-04-25T08:46:58.816089+0000","last_clean":"2024-04-25T08:46:58.816089+0000","last_became_active":"2024-04-25T08:46:57.751133+0000","last_became_peered":"2024-04-25T08:46:57.751133+0000","last_unstale":"2024-04-25T08:46:58.816089+0000","last_undegraded":"2024-04-25T08:46:58.816089+0000","last_fullsized":"2024-04-25T08:46:58.816089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:15.717132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724709+0000","last_change":"2024-04-25T08:46:57.736072+0000","last_active":"2024-04-25T08:46:58.724709+0000","last_peered":"2024-04-25T08:46:58.724709+0000","last_clean":"2024-04-25T08:46:58.724709+0000","last_became_active":"2024-04-25T08:46:57.735781+0000","last_became_peered":"2024-04-25T08:46:57.735781+0000","last_unstale":"2024-04-25T08:46:58.724709+0000","last_undegraded":"2024-04-25T08:46:58.724709+0000","last_fullsized":"2024-04-25T08:46:58.724709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:39.399037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815958+0000","last_change":"2024-04-25T08:46:57.746722+0000","last_active":"2024-04-25T08:46:58.815958+0000","last_peered":"2024-04-25T08:46:58.815958+0000","last_clean":"2024-04-25T08:46:58.815958+0000","last_became_active":"2024-04-25T08:46:57.746456+0000","last_became_peered":"2024-04-25T08:46:57.746456+0000","last_unstale":"2024-04-25T08:46:58.815958+0000","last_undegraded":"2024-04-25T08:46:58.815958+0000","last_fullsized":"2024-04-25T08:46:58.815958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:16.233794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816279+0000","last_change":"2024-04-25T08:46:57.744323+0000","last_active":"2024-04-25T08:46:58.816279+0000","last_peered":"2024-04-25T08:46:58.816279+0000","last_clean":"2024-04-25T08:46:58.816279+0000","last_became_active":"2024-04-25T08:46:57.744049+0000","last_became_peered":"2024-04-25T08:46:57.744049+0000","last_unstale":"2024-04-25T08:46:58.816279+0000","last_undegraded":"2024-04-25T08:46:58.816279+0000","last_fullsized":"2024-04-25T08:46:58.816279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:32.048360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725023+0000","last_change":"2024-04-25T08:46:57.749566+0000","last_active":"2024-04-25T08:46:58.725023+0000","last_peered":"2024-04-25T08:46:58.725023+0000","last_clean":"2024-04-25T08:46:58.725023+0000","last_became_active":"2024-04-25T08:46:57.749266+0000","last_became_peered":"2024-04-25T08:46:57.749266+0000","last_unstale":"2024-04-25T08:46:58.725023+0000","last_undegraded":"2024-04-25T08:46:58.725023+0000","last_fullsized":"2024-04-25T08:46:58.725023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.249964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724942+0000","last_change":"2024-04-25T08:46:57.730151+0000","last_active":"2024-04-25T08:46:58.724942+0000","last_peered":"2024-04-25T08:46:58.724942+0000","last_clean":"2024-04-25T08:46:58.724942+0000","last_became_active":"2024-04-25T08:46:57.729538+0000","last_became_peered":"2024-04-25T08:46:57.729538+0000","last_unstale":"2024-04-25T08:46:58.724942+0000","last_undegraded":"2024-04-25T08:46:58.724942+0000","last_fullsized":"2024-04-25T08:46:58.724942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:03.994595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816685+0000","last_change":"2024-04-25T08:46:56.719653+0000","last_active":"2024-04-25T08:46:58.816685+0000","last_peered":"2024-04-25T08:46:58.816685+0000","last_clean":"2024-04-25T08:46:58.816685+0000","last_became_active":"2024-04-25T08:46:56.719238+0000","last_became_peered":"2024-04-25T08:46:56.719238+0000","last_unstale":"2024-04-25T08:46:58.816685+0000","last_undegraded":"2024-04-25T08:46:58.816685+0000","last_fullsized":"2024-04-25T08:46:58.816685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:05.131808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815432+0000","last_change":"2024-04-25T08:46:57.746062+0000","last_active":"2024-04-25T08:46:58.815432+0000","last_peered":"2024-04-25T08:46:58.815432+0000","last_clean":"2024-04-25T08:46:58.815432+0000","last_became_active":"2024-04-25T08:46:57.745591+0000","last_became_peered":"2024-04-25T08:46:57.745591+0000","last_unstale":"2024-04-25T08:46:58.815432+0000","last_undegraded":"2024-04-25T08:46:58.815432+0000","last_fullsized":"2024-04-25T08:46:58.815432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704223+0000","last_change":"2024-04-25T08:46:55.704223+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704223+0000","last_undegraded":"2024-04-25T08:46:55.704223+0000","last_fullsized":"2024-04-25T08:46:55.704223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725070+0000","last_change":"2024-04-25T08:46:57.738075+0000","last_active":"2024-04-25T08:46:58.725070+0000","last_peered":"2024-04-25T08:46:58.725070+0000","last_clean":"2024-04-25T08:46:58.725070+0000","last_became_active":"2024-04-25T08:46:57.737179+0000","last_became_peered":"2024-04-25T08:46:57.737179+0000","last_unstale":"2024-04-25T08:46:58.725070+0000","last_undegraded":"2024-04-25T08:46:58.725070+0000","last_fullsized":"2024-04-25T08:46:58.725070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:03.994595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.705046+0000","last_change":"2024-04-25T08:46:55.705046+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.705046+0000","last_undegraded":"2024-04-25T08:46:55.705046+0000","last_fullsized":"2024-04-25T08:46:55.705046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724375+0000","last_change":"2024-04-25T08:46:57.732893+0000","last_active":"2024-04-25T08:46:58.724375+0000","last_peered":"2024-04-25T08:46:58.724375+0000","last_clean":"2024-04-25T08:46:58.724375+0000","last_became_active":"2024-04-25T08:46:57.732276+0000","last_became_peered":"2024-04-25T08:46:57.732276+0000","last_unstale":"2024-04-25T08:46:58.724375+0000","last_undegraded":"2024-04-25T08:46:58.724375+0000","last_fullsized":"2024-04-25T08:46:58.724375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:06.838625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.701079+0000","last_change":"2024-04-25T08:46:55.701079+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.701079+0000","last_undegraded":"2024-04-25T08:46:55.701079+0000","last_fullsized":"2024-04-25T08:46:55.701079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816821+0000","last_change":"2024-04-25T08:46:57.749067+0000","last_active":"2024-04-25T08:46:58.816821+0000","last_peered":"2024-04-25T08:46:58.816821+0000","last_clean":"2024-04-25T08:46:58.816821+0000","last_became_active":"2024-04-25T08:46:57.748799+0000","last_became_peered":"2024-04-25T08:46:57.748799+0000","last_unstale":"2024-04-25T08:46:58.816821+0000","last_undegraded":"2024-04-25T08:46:58.816821+0000","last_fullsized":"2024-04-25T08:46:58.816821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.377815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724477+0000","last_change":"2024-04-25T08:46:56.719347+0000","last_active":"2024-04-25T08:46:58.724477+0000","last_peered":"2024-04-25T08:46:58.724477+0000","last_clean":"2024-04-25T08:46:58.724477+0000","last_became_active":"2024-04-25T08:46:56.719044+0000","last_became_peered":"2024-04-25T08:46:56.719044+0000","last_unstale":"2024-04-25T08:46:58.724477+0000","last_undegraded":"2024-04-25T08:46:58.724477+0000","last_fullsized":"2024-04-25T08:46:58.724477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:59.124963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815885+0000","last_change":"2024-04-25T08:46:57.749814+0000","last_active":"2024-04-25T08:46:58.815885+0000","last_peered":"2024-04-25T08:46:58.815885+0000","last_clean":"2024-04-25T08:46:58.815885+0000","last_became_active":"2024-04-25T08:46:57.749188+0000","last_became_peered":"2024-04-25T08:46:57.749188+0000","last_unstale":"2024-04-25T08:46:58.815885+0000","last_undegraded":"2024-04-25T08:46:58.815885+0000","last_fullsized":"2024-04-25T08:46:58.815885+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:39.399037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.723907+0000","last_change":"2024-04-25T08:46:56.716040+0000","last_active":"2024-04-25T08:46:58.723907+0000","last_peered":"2024-04-25T08:46:58.723907+0000","last_clean":"2024-04-25T08:46:58.723907+0000","last_became_active":"2024-04-25T08:46:56.715756+0000","last_became_peered":"2024-04-25T08:46:56.715756+0000","last_unstale":"2024-04-25T08:46:58.723907+0000","last_undegraded":"2024-04-25T08:46:58.723907+0000","last_fullsized":"2024-04-25T08:46:58.723907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:38.648803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725238+0000","last_change":"2024-04-25T08:46:57.736923+0000","last_active":"2024-04-25T08:46:58.725238+0000","last_peered":"2024-04-25T08:46:58.725238+0000","last_clean":"2024-04-25T08:46:58.725238+0000","last_became_active":"2024-04-25T08:46:57.736642+0000","last_became_peered":"2024-04-25T08:46:57.736642+0000","last_unstale":"2024-04-25T08:46:58.725238+0000","last_undegraded":"2024-04-25T08:46:58.725238+0000","last_fullsized":"2024-04-25T08:46:58.725238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.249964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815517+0000","last_change":"2024-04-25T08:46:56.716582+0000","last_active":"2024-04-25T08:46:58.815517+0000","last_peered":"2024-04-25T08:46:58.815517+0000","last_clean":"2024-04-25T08:46:58.815517+0000","last_became_active":"2024-04-25T08:46:56.715623+0000","last_became_peered":"2024-04-25T08:46:56.715623+0000","last_unstale":"2024-04-25T08:46:58.815517+0000","last_undegraded":"2024-04-25T08:46:58.815517+0000","last_fullsized":"2024-04-25T08:46:58.815517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:22.233368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815824+0000","last_change":"2024-04-25T08:46:56.712775+0000","last_active":"2024-04-25T08:46:58.815824+0000","last_peered":"2024-04-25T08:46:58.815824+0000","last_clean":"2024-04-25T08:46:58.815824+0000","last_became_active":"2024-04-25T08:46:56.712444+0000","last_became_peered":"2024-04-25T08:46:56.712444+0000","last_unstale":"2024-04-25T08:46:58.815824+0000","last_undegraded":"2024-04-25T08:46:58.815824+0000","last_fullsized":"2024-04-25T08:46:58.815824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.460375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815270+0000","last_change":"2024-04-25T08:46:57.745023+0000","last_active":"2024-04-25T08:46:58.815270+0000","last_peered":"2024-04-25T08:46:58.815270+0000","last_clean":"2024-04-25T08:46:58.815270+0000","last_became_active":"2024-04-25T08:46:57.744756+0000","last_became_peered":"2024-04-25T08:46:57.744756+0000","last_unstale":"2024-04-25T08:46:58.815270+0000","last_undegraded":"2024-04-25T08:46:58.815270+0000","last_fullsized":"2024-04-25T08:46:58.815270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704057+0000","last_change":"2024-04-25T08:46:55.704057+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704057+0000","last_undegraded":"2024-04-25T08:46:55.704057+0000","last_fullsized":"2024-04-25T08:46:55.704057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.723978+0000","last_change":"2024-04-25T08:46:57.734433+0000","last_active":"2024-04-25T08:46:58.723978+0000","last_peered":"2024-04-25T08:46:58.723978+0000","last_clean":"2024-04-25T08:46:58.723978+0000","last_became_active":"2024-04-25T08:46:57.733784+0000","last_became_peered":"2024-04-25T08:46:57.733784+0000","last_unstale":"2024-04-25T08:46:58.723978+0000","last_undegraded":"2024-04-25T08:46:58.723978+0000","last_fullsized":"2024-04-25T08:46:58.723978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:09.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724821+0000","last_change":"2024-04-25T08:46:56.716712+0000","last_active":"2024-04-25T08:46:58.724821+0000","last_peered":"2024-04-25T08:46:58.724821+0000","last_clean":"2024-04-25T08:46:58.724821+0000","last_became_active":"2024-04-25T08:46:56.716458+0000","last_became_peered":"2024-04-25T08:46:56.716458+0000","last_unstale":"2024-04-25T08:46:58.724821+0000","last_undegraded":"2024-04-25T08:46:58.724821+0000","last_fullsized":"2024-04-25T08:46:58.724821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:29.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816109+0000","last_change":"2024-04-25T08:46:57.731222+0000","last_active":"2024-04-25T08:46:58.816109+0000","last_peered":"2024-04-25T08:46:58.816109+0000","last_clean":"2024-04-25T08:46:58.816109+0000","last_became_active":"2024-04-25T08:46:57.730957+0000","last_became_peered":"2024-04-25T08:46:57.730957+0000","last_unstale":"2024-04-25T08:46:58.816109+0000","last_undegraded":"2024-04-25T08:46:58.816109+0000","last_fullsized":"2024-04-25T08:46:58.816109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:21.844424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816667+0000","last_change":"2024-04-25T08:46:56.718059+0000","last_active":"2024-04-25T08:46:58.816667+0000","last_peered":"2024-04-25T08:46:58.816667+0000","last_clean":"2024-04-25T08:46:58.816667+0000","last_became_active":"2024-04-25T08:46:56.717753+0000","last_became_peered":"2024-04-25T08:46:56.717753+0000","last_unstale":"2024-04-25T08:46:58.816667+0000","last_undegraded":"2024-04-25T08:46:58.816667+0000","last_fullsized":"2024-04-25T08:46:58.816667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:44.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725106+0000","last_change":"2024-04-25T08:46:57.733968+0000","last_active":"2024-04-25T08:46:58.725106+0000","last_peered":"2024-04-25T08:46:58.725106+0000","last_clean":"2024-04-25T08:46:58.725106+0000","last_became_active":"2024-04-25T08:46:57.733726+0000","last_became_peered":"2024-04-25T08:46:57.733726+0000","last_unstale":"2024-04-25T08:46:58.725106+0000","last_undegraded":"2024-04-25T08:46:58.725106+0000","last_fullsized":"2024-04-25T08:46:58.725106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.700618+0000","last_change":"2024-04-25T08:46:55.700618+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.700618+0000","last_undegraded":"2024-04-25T08:46:55.700618+0000","last_fullsized":"2024-04-25T08:46:55.700618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724430+0000","last_change":"2024-04-25T08:46:57.737605+0000","last_active":"2024-04-25T08:46:58.724430+0000","last_peered":"2024-04-25T08:46:58.724430+0000","last_clean":"2024-04-25T08:46:58.724430+0000","last_became_active":"2024-04-25T08:46:57.737151+0000","last_became_peered":"2024-04-25T08:46:57.737151+0000","last_unstale":"2024-04-25T08:46:58.724430+0000","last_undegraded":"2024-04-25T08:46:58.724430+0000","last_fullsized":"2024-04-25T08:46:58.724430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:16.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724038+0000","last_change":"2024-04-25T08:46:56.711797+0000","last_active":"2024-04-25T08:46:58.724038+0000","last_peered":"2024-04-25T08:46:58.724038+0000","last_clean":"2024-04-25T08:46:58.724038+0000","last_became_active":"2024-04-25T08:46:56.711502+0000","last_became_peered":"2024-04-25T08:46:56.711502+0000","last_unstale":"2024-04-25T08:46:58.724038+0000","last_undegraded":"2024-04-25T08:46:58.724038+0000","last_fullsized":"2024-04-25T08:46:58.724038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:36.752145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704371+0000","last_change":"2024-04-25T08:46:55.704371+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704371+0000","last_undegraded":"2024-04-25T08:46:55.704371+0000","last_fullsized":"2024-04-25T08:46:55.704371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816130+0000","last_change":"2024-04-25T08:46:56.719424+0000","last_active":"2024-04-25T08:46:58.816130+0000","last_peered":"2024-04-25T08:46:58.816130+0000","last_clean":"2024-04-25T08:46:58.816130+0000","last_became_active":"2024-04-25T08:46:56.718888+0000","last_became_peered":"2024-04-25T08:46:56.718888+0000","last_unstale":"2024-04-25T08:46:58.816130+0000","last_undegraded":"2024-04-25T08:46:58.816130+0000","last_fullsized":"2024-04-25T08:46:58.816130+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:33.465219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816826+0000","last_change":"2024-04-25T08:46:56.720535+0000","last_active":"2024-04-25T08:46:58.816826+0000","last_peered":"2024-04-25T08:46:58.816826+0000","last_clean":"2024-04-25T08:46:58.816826+0000","last_became_active":"2024-04-25T08:46:56.720261+0000","last_became_peered":"2024-04-25T08:46:56.720261+0000","last_unstale":"2024-04-25T08:46:58.816826+0000","last_undegraded":"2024-04-25T08:46:58.816826+0000","last_fullsized":"2024-04-25T08:46:58.816826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:51.425671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815216+0000","last_change":"2024-04-25T08:46:57.751224+0000","last_active":"2024-04-25T08:46:58.815216+0000","last_peered":"2024-04-25T08:46:58.815216+0000","last_clean":"2024-04-25T08:46:58.815216+0000","last_became_active":"2024-04-25T08:46:57.750992+0000","last_became_peered":"2024-04-25T08:46:57.750992+0000","last_unstale":"2024-04-25T08:46:58.815216+0000","last_undegraded":"2024-04-25T08:46:58.815216+0000","last_fullsized":"2024-04-25T08:46:58.815216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.872215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.703575+0000","last_change":"2024-04-25T08:46:55.703575+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.703575+0000","last_undegraded":"2024-04-25T08:46:55.703575+0000","last_fullsized":"2024-04-25T08:46:55.703575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816051+0000","last_change":"2024-04-25T08:46:57.754454+0000","last_active":"2024-04-25T08:46:58.816051+0000","last_peered":"2024-04-25T08:46:58.816051+0000","last_clean":"2024-04-25T08:46:58.816051+0000","last_became_active":"2024-04-25T08:46:57.754033+0000","last_became_peered":"2024-04-25T08:46:57.754033+0000","last_unstale":"2024-04-25T08:46:58.816051+0000","last_undegraded":"2024-04-25T08:46:58.816051+0000","last_fullsized":"2024-04-25T08:46:58.816051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:03.517427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725191+0000","last_change":"2024-04-25T08:46:56.717064+0000","last_active":"2024-04-25T08:46:58.725191+0000","last_peered":"2024-04-25T08:46:58.725191+0000","last_clean":"2024-04-25T08:46:58.725191+0000","last_became_active":"2024-04-25T08:46:56.716743+0000","last_became_peered":"2024-04-25T08:46:56.716743+0000","last_unstale":"2024-04-25T08:46:58.725191+0000","last_undegraded":"2024-04-25T08:46:58.725191+0000","last_fullsized":"2024-04-25T08:46:58.725191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:21.811205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816271+0000","last_change":"2024-04-25T08:46:57.754149+0000","last_active":"2024-04-25T08:46:58.816271+0000","last_peered":"2024-04-25T08:46:58.816271+0000","last_clean":"2024-04-25T08:46:58.816271+0000","last_became_active":"2024-04-25T08:46:57.753872+0000","last_became_peered":"2024-04-25T08:46:57.753872+0000","last_unstale":"2024-04-25T08:46:58.816271+0000","last_undegraded":"2024-04-25T08:46:58.816271+0000","last_fullsized":"2024-04-25T08:46:58.816271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.599459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816754+0000","last_change":"2024-04-25T08:46:56.711294+0000","last_active":"2024-04-25T08:46:58.816754+0000","last_peered":"2024-04-25T08:46:58.816754+0000","last_clean":"2024-04-25T08:46:58.816754+0000","last_became_active":"2024-04-25T08:46:56.710929+0000","last_became_peered":"2024-04-25T08:46:56.710929+0000","last_unstale":"2024-04-25T08:46:58.816754+0000","last_undegraded":"2024-04-25T08:46:58.816754+0000","last_fullsized":"2024-04-25T08:46:58.816754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:15.137332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815873+0000","last_change":"2024-04-25T08:46:57.750015+0000","last_active":"2024-04-25T08:46:58.815873+0000","last_peered":"2024-04-25T08:46:58.815873+0000","last_clean":"2024-04-25T08:46:58.815873+0000","last_became_active":"2024-04-25T08:46:57.749748+0000","last_became_peered":"2024-04-25T08:46:57.749748+0000","last_unstale":"2024-04-25T08:46:58.815873+0000","last_undegraded":"2024-04-25T08:46:58.815873+0000","last_fullsized":"2024-04-25T08:46:58.815873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:40.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725139+0000","last_change":"2024-04-25T08:46:56.709724+0000","last_active":"2024-04-25T08:46:58.725139+0000","last_peered":"2024-04-25T08:46:58.725139+0000","last_clean":"2024-04-25T08:46:58.725139+0000","last_became_active":"2024-04-25T08:46:56.709479+0000","last_became_peered":"2024-04-25T08:46:56.709479+0000","last_unstale":"2024-04-25T08:46:58.725139+0000","last_undegraded":"2024-04-25T08:46:58.725139+0000","last_fullsized":"2024-04-25T08:46:58.725139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:48.796813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816653+0000","last_change":"2024-04-25T08:46:57.742949+0000","last_active":"2024-04-25T08:46:58.816653+0000","last_peered":"2024-04-25T08:46:58.816653+0000","last_clean":"2024-04-25T08:46:58.816653+0000","last_became_active":"2024-04-25T08:46:57.742695+0000","last_became_peered":"2024-04-25T08:46:57.742695+0000","last_unstale":"2024-04-25T08:46:58.816653+0000","last_undegraded":"2024-04-25T08:46:58.816653+0000","last_fullsized":"2024-04-25T08:46:58.816653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815962+0000","last_change":"2024-04-25T08:46:56.720535+0000","last_active":"2024-04-25T08:46:58.815962+0000","last_peered":"2024-04-25T08:46:58.815962+0000","last_clean":"2024-04-25T08:46:58.815962+0000","last_became_active":"2024-04-25T08:46:56.720274+0000","last_became_peered":"2024-04-25T08:46:56.720274+0000","last_unstale":"2024-04-25T08:46:58.815962+0000","last_undegraded":"2024-04-25T08:46:58.815962+0000","last_fullsized":"2024-04-25T08:46:58.815962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:07.975454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816821+0000","last_change":"2024-04-25T08:46:57.736236+0000","last_active":"2024-04-25T08:46:58.816821+0000","last_peered":"2024-04-25T08:46:58.816821+0000","last_clean":"2024-04-25T08:46:58.816821+0000","last_became_active":"2024-04-25T08:46:57.735060+0000","last_became_peered":"2024-04-25T08:46:57.735060+0000","last_unstale":"2024-04-25T08:46:58.816821+0000","last_undegraded":"2024-04-25T08:46:58.816821+0000","last_fullsized":"2024-04-25T08:46:58.816821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:40.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815674+0000","last_change":"2024-04-25T08:46:56.718380+0000","last_active":"2024-04-25T08:46:58.815674+0000","last_peered":"2024-04-25T08:46:58.815674+0000","last_clean":"2024-04-25T08:46:58.815674+0000","last_became_active":"2024-04-25T08:46:56.717887+0000","last_became_peered":"2024-04-25T08:46:56.717887+0000","last_unstale":"2024-04-25T08:46:58.815674+0000","last_undegraded":"2024-04-25T08:46:58.815674+0000","last_fullsized":"2024-04-25T08:46:58.815674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:08.545923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815353+0000","last_change":"2024-04-25T08:46:56.717331+0000","last_active":"2024-04-25T08:46:58.815353+0000","last_peered":"2024-04-25T08:46:58.815353+0000","last_clean":"2024-04-25T08:46:58.815353+0000","last_became_active":"2024-04-25T08:46:56.716965+0000","last_became_peered":"2024-04-25T08:46:56.716965+0000","last_unstale":"2024-04-25T08:46:58.815353+0000","last_undegraded":"2024-04-25T08:46:58.815353+0000","last_fullsized":"2024-04-25T08:46:58.815353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:51.465906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724909+0000","last_change":"2024-04-25T08:46:57.739952+0000","last_active":"2024-04-25T08:46:58.724909+0000","last_peered":"2024-04-25T08:46:58.724909+0000","last_clean":"2024-04-25T08:46:58.724909+0000","last_became_active":"2024-04-25T08:46:57.739588+0000","last_became_peered":"2024-04-25T08:46:57.739588+0000","last_unstale":"2024-04-25T08:46:58.724909+0000","last_undegraded":"2024-04-25T08:46:58.724909+0000","last_fullsized":"2024-04-25T08:46:58.724909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:25.805809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724054+0000","last_change":"2024-04-25T08:46:56.714869+0000","last_active":"2024-04-25T08:46:58.724054+0000","last_peered":"2024-04-25T08:46:58.724054+0000","last_clean":"2024-04-25T08:46:58.724054+0000","last_became_active":"2024-04-25T08:46:56.714573+0000","last_became_peered":"2024-04-25T08:46:56.714573+0000","last_unstale":"2024-04-25T08:46:58.724054+0000","last_undegraded":"2024-04-25T08:46:58.724054+0000","last_fullsized":"2024-04-25T08:46:58.724054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:25.662938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:59.725301+0000","last_change":"2024-04-25T08:46:56.714486+0000","last_active":"2024-04-25T08:46:59.725301+0000","last_peered":"2024-04-25T08:46:59.725301+0000","last_clean":"2024-04-25T08:46:59.725301+0000","last_became_active":"2024-04-25T08:46:56.714227+0000","last_became_peered":"2024-04-25T08:46:56.714227+0000","last_unstale":"2024-04-25T08:46:59.725301+0000","last_undegraded":"2024-04-25T08:46:59.725301+0000","last_fullsized":"2024-04-25T08:46:59.725301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:03.785847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725238+0000","last_change":"2024-04-25T08:46:57.739412+0000","last_active":"2024-04-25T08:46:58.725238+0000","last_peered":"2024-04-25T08:46:58.725238+0000","last_clean":"2024-04-25T08:46:58.725238+0000","last_became_active":"2024-04-25T08:46:57.736752+0000","last_became_peered":"2024-04-25T08:46:57.736752+0000","last_unstale":"2024-04-25T08:46:58.725238+0000","last_undegraded":"2024-04-25T08:46:58.725238+0000","last_fullsized":"2024-04-25T08:46:58.725238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704641+0000","last_change":"2024-04-25T08:46:55.704641+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704641+0000","last_undegraded":"2024-04-25T08:46:55.704641+0000","last_fullsized":"2024-04-25T08:46:55.704641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816412+0000","last_change":"2024-04-25T08:46:57.744908+0000","last_active":"2024-04-25T08:46:58.816412+0000","last_peered":"2024-04-25T08:46:58.816412+0000","last_clean":"2024-04-25T08:46:58.816412+0000","last_became_active":"2024-04-25T08:46:57.744655+0000","last_became_peered":"2024-04-25T08:46:57.744655+0000","last_unstale":"2024-04-25T08:46:58.816412+0000","last_undegraded":"2024-04-25T08:46:58.816412+0000","last_fullsized":"2024-04-25T08:46:58.816412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:34.197715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.703337+0000","last_change":"2024-04-25T08:46:55.703337+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.703337+0000","last_undegraded":"2024-04-25T08:46:55.703337+0000","last_fullsized":"2024-04-25T08:46:55.703337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.700416+0000","last_change":"2024-04-25T08:46:55.700416+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.700416+0000","last_undegraded":"2024-04-25T08:46:55.700416+0000","last_fullsized":"2024-04-25T08:46:55.700416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816439+0000","last_change":"2024-04-25T08:46:56.719242+0000","last_active":"2024-04-25T08:46:58.816439+0000","last_peered":"2024-04-25T08:46:58.816439+0000","last_clean":"2024-04-25T08:46:58.816439+0000","last_became_active":"2024-04-25T08:46:56.719000+0000","last_became_peered":"2024-04-25T08:46:56.719000+0000","last_unstale":"2024-04-25T08:46:58.816439+0000","last_undegraded":"2024-04-25T08:46:58.816439+0000","last_fullsized":"2024-04-25T08:46:58.816439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:34.859908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725338+0000","last_change":"2024-04-25T08:46:57.734806+0000","last_active":"2024-04-25T08:46:58.725338+0000","last_peered":"2024-04-25T08:46:58.725338+0000","last_clean":"2024-04-25T08:46:58.725338+0000","last_became_active":"2024-04-25T08:46:57.734533+0000","last_became_peered":"2024-04-25T08:46:57.734533+0000","last_unstale":"2024-04-25T08:46:58.725338+0000","last_undegraded":"2024-04-25T08:46:58.725338+0000","last_fullsized":"2024-04-25T08:46:58.725338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:51.496043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.701349+0000","last_change":"2024-04-25T08:46:55.701349+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.701349+0000","last_undegraded":"2024-04-25T08:46:55.701349+0000","last_fullsized":"2024-04-25T08:46:55.701349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725351+0000","last_change":"2024-04-25T08:46:57.741952+0000","last_active":"2024-04-25T08:46:58.725351+0000","last_peered":"2024-04-25T08:46:58.725351+0000","last_clean":"2024-04-25T08:46:58.725351+0000","last_became_active":"2024-04-25T08:46:57.741689+0000","last_became_peered":"2024-04-25T08:46:57.741689+0000","last_unstale":"2024-04-25T08:46:58.725351+0000","last_undegraded":"2024-04-25T08:46:58.725351+0000","last_fullsized":"2024-04-25T08:46:58.725351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:30.852428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725011+0000","last_change":"2024-04-25T08:46:56.716730+0000","last_active":"2024-04-25T08:46:58.725011+0000","last_peered":"2024-04-25T08:46:58.725011+0000","last_clean":"2024-04-25T08:46:58.725011+0000","last_became_active":"2024-04-25T08:46:56.716477+0000","last_became_peered":"2024-04-25T08:46:56.716477+0000","last_unstale":"2024-04-25T08:46:58.725011+0000","last_undegraded":"2024-04-25T08:46:58.725011+0000","last_fullsized":"2024-04-25T08:46:58.725011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:40.418688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815970+0000","last_change":"2024-04-25T08:46:56.721484+0000","last_active":"2024-04-25T08:46:58.815970+0000","last_peered":"2024-04-25T08:46:58.815970+0000","last_clean":"2024-04-25T08:46:58.815970+0000","last_became_active":"2024-04-25T08:46:56.721115+0000","last_became_peered":"2024-04-25T08:46:56.721115+0000","last_unstale":"2024-04-25T08:46:58.815970+0000","last_undegraded":"2024-04-25T08:46:58.815970+0000","last_fullsized":"2024-04-25T08:46:58.815970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:20.574350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-25T08:46:55.705281+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:46:55.705281+0000","last_peered":"2024-04-25T08:46:55.705281+0000","last_clean":"2024-04-25T08:46:55.705281+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:46:55.705281+0000","last_undegraded":"2024-04-25T08:46:55.705281+0000","last_fullsized":"2024-04-25T08:46:55.705281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36852,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334988,"statfs":{"total":96636764160,"available":96599027712,"internally_reserved":0,"allocated":1548288,"data_stored":1027011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":954368,"data_stored":436643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":995328,"data_stored":457203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1011712,"data_stored":458885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":995328,"data_stored":457751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":457911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":457281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1585152,"data_stored":1047537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:47:00.686 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:47:00.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.829+0000 7f1a8d037640 1 Processor -- start 2024-04-25T08:47:00.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.830+0000 7f1a8d037640 1 -- start start 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.830+0000 7f1a8d037640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1a880b2cb0 0x7f1a880d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.830+0000 7f1a8d037640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a880d1020 0x7f1a880d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.830+0000 7f1a8d037640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a880b97a0 con 0x7f1a8815dbe0 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.830+0000 7f1a8d037640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8815dfc0 con 0x7f1a880b2cb0 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.830+0000 7f1a8d037640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a880d1a00 con 0x7f1a880d1020 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.830+0000 7f1a8659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1a880b2cb0 0x7f1a880d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.830+0000 7f1a86d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1a8815dbe0 0x7f1a880d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46566/0 (socket says 172.21.15.172:46566) 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.831+0000 7f1a8659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1a880b2cb0 0x7f1a880d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33864/0 (socket says 172.21.15.172:33864) 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.831+0000 7f1a86d9d640 1 -- 172.21.15.172:0/109403455 learned_addr learned my addr 172.21.15.172:0/109403455 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.831+0000 7f1a8759e640 1 --2- 172.21.15.172:0/109403455 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a880d1020 0x7f1a880d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.831+0000 7f1a8659c640 1 -- 172.21.15.172:0/109403455 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a880d1020 msgr2=0x7f1a880d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.831+0000 7f1a8659c640 1 --2- 172.21.15.172:0/109403455 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a880d1020 0x7f1a880d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.831+0000 7f1a8659c640 1 -- 172.21.15.172:0/109403455 >> v1:172.21.15.172:6789/0 conn(0x7f1a8815dbe0 legacy=0x7f1a880d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.831+0000 7f1a8659c640 1 -- 172.21.15.172:0/109403455 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a880d1c50 con 0x7f1a880b2cb0 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.831+0000 7f1a8659c640 1 --2- 172.21.15.172:0/109403455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 0x7f1a880d2730 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f1a700097a0 tx=0x7f1a7002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b0e890e428305f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a85d9b640 1 -- 172.21.15.172:0/109403455 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70037070 con 0x7f1a880b2cb0 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a85d9b640 1 -- 172.21.15.172:0/109403455 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70032440 con 0x7f1a880b2cb0 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a85d9b640 1 -- 172.21.15.172:0/109403455 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70032810 con 0x7f1a880b2cb0 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a8d037640 1 -- 172.21.15.172:0/109403455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 msgr2=0x7f1a880d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a8d037640 1 --2- 172.21.15.172:0/109403455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 0x7f1a880d2730 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f1a700097a0 tx=0x7f1a7002a180 comp rx=0 tx=0).stop 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a8d037640 1 -- 172.21.15.172:0/109403455 shutdown_connections 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a8d037640 1 --2- 172.21.15.172:0/109403455 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a880d1020 0x7f1a880d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a8d037640 1 --2- 172.21.15.172:0/109403455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 0x7f1a880d2730 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a8d037640 1 -- 172.21.15.172:0/109403455 >> 172.21.15.172:0/109403455 conn(0x7f1a88061a20 msgr2=0x7f1a88061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a8d037640 1 -- 172.21.15.172:0/109403455 shutdown_connections 2024-04-25T08:47:00.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.832+0000 7f1a8d037640 1 -- 172.21.15.172:0/109403455 wait complete. 2024-04-25T08:47:00.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.834+0000 7f1a8d037640 1 Processor -- start 2024-04-25T08:47:00.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.834+0000 7f1a8d037640 1 -- start start 2024-04-25T08:47:00.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.834+0000 7f1a8d037640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 0x7f1a881f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.834+0000 7f1a8d037640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a880d1020 0x7f1a8815e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.834+0000 7f1a8d037640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a8815dbe0 0x7f1a880b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.834+0000 7f1a8d037640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a880b92a0 con 0x7f1a880b2cb0 2024-04-25T08:47:00.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.834+0000 7f1a8d037640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a880d2210 con 0x7f1a880d1020 2024-04-25T08:47:00.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.834+0000 7f1a8d037640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a880b9420 con 0x7f1a8815dbe0 2024-04-25T08:47:00.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.834+0000 7f1a86d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 0x7f1a881f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a86d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 0x7f1a881f6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33870/0 (socket says 172.21.15.172:33870) 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a86d9d640 1 -- 172.21.15.172:0/2906220066 learned_addr learned my addr 172.21.15.172:0/2906220066 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a8759e640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a8815dbe0 0x7f1a880b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a8659c640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a880d1020 0x7f1a8815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a86d9d640 1 -- 172.21.15.172:0/2906220066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a8815dbe0 msgr2=0x7f1a880b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a86d9d640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a8815dbe0 0x7f1a880b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a86d9d640 1 -- 172.21.15.172:0/2906220066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a880d1020 msgr2=0x7f1a8815e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a86d9d640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a880d1020 0x7f1a8815e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a86d9d640 1 -- 172.21.15.172:0/2906220066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8815ec10 con 0x7f1a880b2cb0 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a8659c640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a880d1020 0x7f1a8815e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a86d9d640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 0x7f1a881f6620 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800c3c0 tx=0x7f1a7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a7f7fe640 1 -- 172.21.15.172:0/2906220066 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78017070 con 0x7f1a880b2cb0 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a7f7fe640 1 -- 172.21.15.172:0/2906220066 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a78005ce0 con 0x7f1a880b2cb0 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a8d037640 1 -- 172.21.15.172:0/2906220066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8815eef0 con 0x7f1a880b2cb0 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a7f7fe640 1 -- 172.21.15.172:0/2906220066 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a780072f0 con 0x7f1a880b2cb0 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.835+0000 7f1a8d037640 1 -- 172.21.15.172:0/2906220066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8815f4b0 con 0x7f1a880b2cb0 2024-04-25T08:47:00.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.836+0000 7f1a8d037640 1 -- 172.21.15.172:0/2906220066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a88073990 con 0x7f1a880b2cb0 2024-04-25T08:47:00.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.837+0000 7f1a7f7fe640 1 -- 172.21.15.172:0/2906220066 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1a7801a070 con 0x7f1a880b2cb0 2024-04-25T08:47:00.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.837+0000 7f1a7f7fe640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a6806b4d0 0x7f1a6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:00.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.837+0000 7f1a7f7fe640 1 -- 172.21.15.172:0/2906220066 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1a78089750 con 0x7f1a880b2cb0 2024-04-25T08:47:00.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.837+0000 7f1a8659c640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a6806b4d0 0x7f1a6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:00.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.837+0000 7f1a8659c640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a6806b4d0 0x7f1a6806d990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1a70034000 tx=0x7f1a7002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:00.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:00.841+0000 7f1a7f7fe640 1 -- 172.21.15.172:0/2906220066 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1a78058450 con 0x7f1a880b2cb0 2024-04-25T08:47:01.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.009+0000 7f1a8d037640 1 -- 172.21.15.172:0/2906220066 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a880c9fc0 con 0x7f1a6806b4d0 2024-04-25T08:47:01.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.015+0000 7f1a7f7fe640 1 -- 172.21.15.172:0/2906220066 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248962 (secure 0 0 0) 0x7f1a880c9fc0 con 0x7f1a6806b4d0 2024-04-25T08:47:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:47:01.010 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:47:01.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 -- 172.21.15.172:0/2906220066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a6806b4d0 msgr2=0x7f1a6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a6806b4d0 0x7f1a6806d990 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1a70034000 tx=0x7f1a7002e000 comp rx=0 tx=0).stop 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 -- 172.21.15.172:0/2906220066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 msgr2=0x7f1a881f6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 0x7f1a881f6620 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800c3c0 tx=0x7f1a7800c880 comp rx=0 tx=0).stop 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 -- 172.21.15.172:0/2906220066 shutdown_connections 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a6806b4d0 0x7f1a6806d990 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a880d1020 0x7f1a8815e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a8815dbe0 0x7f1a880b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 --2- 172.21.15.172:0/2906220066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a880b2cb0 0x7f1a881f6620 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 -- 172.21.15.172:0/2906220066 >> 172.21.15.172:0/2906220066 conn(0x7f1a88061a20 msgr2=0x7f1a880d2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 -- 172.21.15.172:0/2906220066 shutdown_connections 2024-04-25T08:47:01.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.018+0000 7f1a8d037640 1 -- 172.21.15.172:0/2906220066 wait complete. 2024-04-25T08:47:01.020 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-04-25T08:47:00.568379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":291632,"kb_used_data":8880,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754683088,"statfs":{"total":773094113280,"available":772795482112,"internally_reserved":0,"allocated":9093120,"data_stored":4800222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.868639"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816620+0000","last_change":"2024-04-25T08:46:57.748857+0000","last_active":"2024-04-25T08:46:58.816620+0000","last_peered":"2024-04-25T08:46:58.816620+0000","last_clean":"2024-04-25T08:46:58.816620+0000","last_became_active":"2024-04-25T08:46:57.748557+0000","last_became_peered":"2024-04-25T08:46:57.748557+0000","last_unstale":"2024-04-25T08:46:58.816620+0000","last_undegraded":"2024-04-25T08:46:58.816620+0000","last_fullsized":"2024-04-25T08:46:58.816620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.872215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725285+0000","last_change":"2024-04-25T08:46:57.733902+0000","last_active":"2024-04-25T08:46:58.725285+0000","last_peered":"2024-04-25T08:46:58.725285+0000","last_clean":"2024-04-25T08:46:58.725285+0000","last_became_active":"2024-04-25T08:46:57.733591+0000","last_became_peered":"2024-04-25T08:46:57.733591+0000","last_unstale":"2024-04-25T08:46:58.725285+0000","last_undegraded":"2024-04-25T08:46:58.725285+0000","last_fullsized":"2024-04-25T08:46:58.725285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:55.569414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724257+0000","last_change":"2024-04-25T08:46:57.734366+0000","last_active":"2024-04-25T08:46:58.724257+0000","last_peered":"2024-04-25T08:46:58.724257+0000","last_clean":"2024-04-25T08:46:58.724257+0000","last_became_active":"2024-04-25T08:46:57.733738+0000","last_became_peered":"2024-04-25T08:46:57.733738+0000","last_unstale":"2024-04-25T08:46:58.724257+0000","last_undegraded":"2024-04-25T08:46:58.724257+0000","last_fullsized":"2024-04-25T08:46:58.724257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816404+0000","last_change":"2024-04-25T08:46:57.750494+0000","last_active":"2024-04-25T08:46:58.816404+0000","last_peered":"2024-04-25T08:46:58.816404+0000","last_clean":"2024-04-25T08:46:58.816404+0000","last_became_active":"2024-04-25T08:46:57.750234+0000","last_became_peered":"2024-04-25T08:46:57.750234+0000","last_unstale":"2024-04-25T08:46:58.816404+0000","last_undegraded":"2024-04-25T08:46:58.816404+0000","last_fullsized":"2024-04-25T08:46:58.816404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:53.853355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815579+0000","last_change":"2024-04-25T08:46:57.736898+0000","last_active":"2024-04-25T08:46:58.815579+0000","last_peered":"2024-04-25T08:46:58.815579+0000","last_clean":"2024-04-25T08:46:58.815579+0000","last_became_active":"2024-04-25T08:46:57.736617+0000","last_became_peered":"2024-04-25T08:46:57.736617+0000","last_unstale":"2024-04-25T08:46:58.815579+0000","last_undegraded":"2024-04-25T08:46:58.815579+0000","last_fullsized":"2024-04-25T08:46:58.815579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815743+0000","last_change":"2024-04-25T08:46:57.749375+0000","last_active":"2024-04-25T08:46:58.815743+0000","last_peered":"2024-04-25T08:46:58.815743+0000","last_clean":"2024-04-25T08:46:58.815743+0000","last_became_active":"2024-04-25T08:46:57.749039+0000","last_became_peered":"2024-04-25T08:46:57.749039+0000","last_unstale":"2024-04-25T08:46:58.815743+0000","last_undegraded":"2024-04-25T08:46:58.815743+0000","last_fullsized":"2024-04-25T08:46:58.815743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:35.985064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724725+0000","last_change":"2024-04-25T08:46:57.740018+0000","last_active":"2024-04-25T08:46:58.724725+0000","last_peered":"2024-04-25T08:46:58.724725+0000","last_clean":"2024-04-25T08:46:58.724725+0000","last_became_active":"2024-04-25T08:46:57.738781+0000","last_became_peered":"2024-04-25T08:46:57.738781+0000","last_unstale":"2024-04-25T08:46:58.724725+0000","last_undegraded":"2024-04-25T08:46:58.724725+0000","last_fullsized":"2024-04-25T08:46:58.724725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:59.347891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724516+0000","last_change":"2024-04-25T08:46:57.742552+0000","last_active":"2024-04-25T08:46:58.724516+0000","last_peered":"2024-04-25T08:46:58.724516+0000","last_clean":"2024-04-25T08:46:58.724516+0000","last_became_active":"2024-04-25T08:46:57.742253+0000","last_became_peered":"2024-04-25T08:46:57.742253+0000","last_unstale":"2024-04-25T08:46:58.724516+0000","last_undegraded":"2024-04-25T08:46:58.724516+0000","last_fullsized":"2024-04-25T08:46:58.724516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:32.530004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815758+0000","last_change":"2024-04-25T08:46:57.750527+0000","last_active":"2024-04-25T08:46:58.815758+0000","last_peered":"2024-04-25T08:46:58.815758+0000","last_clean":"2024-04-25T08:46:58.815758+0000","last_became_active":"2024-04-25T08:46:57.749570+0000","last_became_peered":"2024-04-25T08:46:57.749570+0000","last_unstale":"2024-04-25T08:46:58.815758+0000","last_undegraded":"2024-04-25T08:46:58.815758+0000","last_fullsized":"2024-04-25T08:46:58.815758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:32.530004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724344+0000","last_change":"2024-04-25T08:46:57.737397+0000","last_active":"2024-04-25T08:46:58.724344+0000","last_peered":"2024-04-25T08:46:58.724344+0000","last_clean":"2024-04-25T08:46:58.724344+0000","last_became_active":"2024-04-25T08:46:57.736776+0000","last_became_peered":"2024-04-25T08:46:57.736776+0000","last_unstale":"2024-04-25T08:46:58.724344+0000","last_undegraded":"2024-04-25T08:46:58.724344+0000","last_fullsized":"2024-04-25T08:46:58.724344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816369+0000","last_change":"2024-04-25T08:46:57.755588+0000","last_active":"2024-04-25T08:46:58.816369+0000","last_peered":"2024-04-25T08:46:58.816369+0000","last_clean":"2024-04-25T08:46:58.816369+0000","last_became_active":"2024-04-25T08:46:57.755324+0000","last_became_peered":"2024-04-25T08:46:57.755324+0000","last_unstale":"2024-04-25T08:46:58.816369+0000","last_undegraded":"2024-04-25T08:46:58.816369+0000","last_fullsized":"2024-04-25T08:46:58.816369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:45.411656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815712+0000","last_change":"2024-04-25T08:46:57.736823+0000","last_active":"2024-04-25T08:46:58.815712+0000","last_peered":"2024-04-25T08:46:58.815712+0000","last_clean":"2024-04-25T08:46:58.815712+0000","last_became_active":"2024-04-25T08:46:57.736547+0000","last_became_peered":"2024-04-25T08:46:57.736547+0000","last_unstale":"2024-04-25T08:46:58.815712+0000","last_undegraded":"2024-04-25T08:46:58.815712+0000","last_fullsized":"2024-04-25T08:46:58.815712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:09.706138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815516+0000","last_change":"2024-04-25T08:46:57.745848+0000","last_active":"2024-04-25T08:46:58.815516+0000","last_peered":"2024-04-25T08:46:58.815516+0000","last_clean":"2024-04-25T08:46:58.815516+0000","last_became_active":"2024-04-25T08:46:57.745243+0000","last_became_peered":"2024-04-25T08:46:57.745243+0000","last_unstale":"2024-04-25T08:46:58.815516+0000","last_undegraded":"2024-04-25T08:46:58.815516+0000","last_fullsized":"2024-04-25T08:46:58.815516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:16.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816601+0000","last_change":"2024-04-25T08:46:57.753708+0000","last_active":"2024-04-25T08:46:58.816601+0000","last_peered":"2024-04-25T08:46:58.816601+0000","last_clean":"2024-04-25T08:46:58.816601+0000","last_became_active":"2024-04-25T08:46:57.753453+0000","last_became_peered":"2024-04-25T08:46:57.753453+0000","last_unstale":"2024-04-25T08:46:58.816601+0000","last_undegraded":"2024-04-25T08:46:58.816601+0000","last_fullsized":"2024-04-25T08:46:58.816601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:32.663123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725290+0000","last_change":"2024-04-25T08:46:57.729860+0000","last_active":"2024-04-25T08:46:58.725290+0000","last_peered":"2024-04-25T08:46:58.725290+0000","last_clean":"2024-04-25T08:46:58.725290+0000","last_became_active":"2024-04-25T08:46:57.729559+0000","last_became_peered":"2024-04-25T08:46:57.729559+0000","last_unstale":"2024-04-25T08:46:58.725290+0000","last_undegraded":"2024-04-25T08:46:58.725290+0000","last_fullsized":"2024-04-25T08:46:58.725290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:56.215702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815923+0000","last_change":"2024-04-25T08:46:57.750649+0000","last_active":"2024-04-25T08:46:58.815923+0000","last_peered":"2024-04-25T08:46:58.815923+0000","last_clean":"2024-04-25T08:46:58.815923+0000","last_became_active":"2024-04-25T08:46:57.750400+0000","last_became_peered":"2024-04-25T08:46:57.750400+0000","last_unstale":"2024-04-25T08:46:58.815923+0000","last_undegraded":"2024-04-25T08:46:58.815923+0000","last_fullsized":"2024-04-25T08:46:58.815923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.377815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815835+0000","last_change":"2024-04-25T08:46:57.747932+0000","last_active":"2024-04-25T08:46:58.815835+0000","last_peered":"2024-04-25T08:46:58.815835+0000","last_clean":"2024-04-25T08:46:58.815835+0000","last_became_active":"2024-04-25T08:46:57.747664+0000","last_became_peered":"2024-04-25T08:46:57.747664+0000","last_unstale":"2024-04-25T08:46:58.815835+0000","last_undegraded":"2024-04-25T08:46:58.815835+0000","last_fullsized":"2024-04-25T08:46:58.815835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.805999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724229+0000","last_change":"2024-04-25T08:46:57.733118+0000","last_active":"2024-04-25T08:46:58.724229+0000","last_peered":"2024-04-25T08:46:58.724229+0000","last_clean":"2024-04-25T08:46:58.724229+0000","last_became_active":"2024-04-25T08:46:57.732601+0000","last_became_peered":"2024-04-25T08:46:57.732601+0000","last_unstale":"2024-04-25T08:46:58.724229+0000","last_undegraded":"2024-04-25T08:46:58.724229+0000","last_fullsized":"2024-04-25T08:46:58.724229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:18.985748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816376+0000","last_change":"2024-04-25T08:46:57.755439+0000","last_active":"2024-04-25T08:46:58.816376+0000","last_peered":"2024-04-25T08:46:58.816376+0000","last_clean":"2024-04-25T08:46:58.816376+0000","last_became_active":"2024-04-25T08:46:57.755165+0000","last_became_peered":"2024-04-25T08:46:57.755165+0000","last_unstale":"2024-04-25T08:46:58.816376+0000","last_undegraded":"2024-04-25T08:46:58.816376+0000","last_fullsized":"2024-04-25T08:46:58.816376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:48.272205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724123+0000","last_change":"2024-04-25T08:46:57.734179+0000","last_active":"2024-04-25T08:46:58.724123+0000","last_peered":"2024-04-25T08:46:58.724123+0000","last_clean":"2024-04-25T08:46:58.724123+0000","last_became_active":"2024-04-25T08:46:57.733836+0000","last_became_peered":"2024-04-25T08:46:57.733836+0000","last_unstale":"2024-04-25T08:46:58.724123+0000","last_undegraded":"2024-04-25T08:46:58.724123+0000","last_fullsized":"2024-04-25T08:46:58.724123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:39.811462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816657+0000","last_change":"2024-04-25T08:46:57.752623+0000","last_active":"2024-04-25T08:46:58.816657+0000","last_peered":"2024-04-25T08:46:58.816657+0000","last_clean":"2024-04-25T08:46:58.816657+0000","last_became_active":"2024-04-25T08:46:57.752243+0000","last_became_peered":"2024-04-25T08:46:57.752243+0000","last_unstale":"2024-04-25T08:46:58.816657+0000","last_undegraded":"2024-04-25T08:46:58.816657+0000","last_fullsized":"2024-04-25T08:46:58.816657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:09.706138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816089+0000","last_change":"2024-04-25T08:46:57.751393+0000","last_active":"2024-04-25T08:46:58.816089+0000","last_peered":"2024-04-25T08:46:58.816089+0000","last_clean":"2024-04-25T08:46:58.816089+0000","last_became_active":"2024-04-25T08:46:57.751133+0000","last_became_peered":"2024-04-25T08:46:57.751133+0000","last_unstale":"2024-04-25T08:46:58.816089+0000","last_undegraded":"2024-04-25T08:46:58.816089+0000","last_fullsized":"2024-04-25T08:46:58.816089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:15.717132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724709+0000","last_change":"2024-04-25T08:46:57.736072+0000","last_active":"2024-04-25T08:46:58.724709+0000","last_peered":"2024-04-25T08:46:58.724709+0000","last_clean":"2024-04-25T08:46:58.724709+0000","last_became_active":"2024-04-25T08:46:57.735781+0000","last_became_peered":"2024-04-25T08:46:57.735781+0000","last_unstale":"2024-04-25T08:46:58.724709+0000","last_undegraded":"2024-04-25T08:46:58.724709+0000","last_fullsized":"2024-04-25T08:46:58.724709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:39.399037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815958+0000","last_change":"2024-04-25T08:46:57.746722+0000","last_active":"2024-04-25T08:46:58.815958+0000","last_peered":"2024-04-25T08:46:58.815958+0000","last_clean":"2024-04-25T08:46:58.815958+0000","last_became_active":"2024-04-25T08:46:57.746456+0000","last_became_peered":"2024-04-25T08:46:57.746456+0000","last_unstale":"2024-04-25T08:46:58.815958+0000","last_undegraded":"2024-04-25T08:46:58.815958+0000","last_fullsized":"2024-04-25T08:46:58.815958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:16.233794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816279+0000","last_change":"2024-04-25T08:46:57.744323+0000","last_active":"2024-04-25T08:46:58.816279+0000","last_peered":"2024-04-25T08:46:58.816279+0000","last_clean":"2024-04-25T08:46:58.816279+0000","last_became_active":"2024-04-25T08:46:57.744049+0000","last_became_peered":"2024-04-25T08:46:57.744049+0000","last_unstale":"2024-04-25T08:46:58.816279+0000","last_undegraded":"2024-04-25T08:46:58.816279+0000","last_fullsized":"2024-04-25T08:46:58.816279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:32.048360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725023+0000","last_change":"2024-04-25T08:46:57.749566+0000","last_active":"2024-04-25T08:46:58.725023+0000","last_peered":"2024-04-25T08:46:58.725023+0000","last_clean":"2024-04-25T08:46:58.725023+0000","last_became_active":"2024-04-25T08:46:57.749266+0000","last_became_peered":"2024-04-25T08:46:57.749266+0000","last_unstale":"2024-04-25T08:46:58.725023+0000","last_undegraded":"2024-04-25T08:46:58.725023+0000","last_fullsized":"2024-04-25T08:46:58.725023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.249964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724942+0000","last_change":"2024-04-25T08:46:57.730151+0000","last_active":"2024-04-25T08:46:58.724942+0000","last_peered":"2024-04-25T08:46:58.724942+0000","last_clean":"2024-04-25T08:46:58.724942+0000","last_became_active":"2024-04-25T08:46:57.729538+0000","last_became_peered":"2024-04-25T08:46:57.729538+0000","last_unstale":"2024-04-25T08:46:58.724942+0000","last_undegraded":"2024-04-25T08:46:58.724942+0000","last_fullsized":"2024-04-25T08:46:58.724942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:03.994595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816685+0000","last_change":"2024-04-25T08:46:56.719653+0000","last_active":"2024-04-25T08:46:58.816685+0000","last_peered":"2024-04-25T08:46:58.816685+0000","last_clean":"2024-04-25T08:46:58.816685+0000","last_became_active":"2024-04-25T08:46:56.719238+0000","last_became_peered":"2024-04-25T08:46:56.719238+0000","last_unstale":"2024-04-25T08:46:58.816685+0000","last_undegraded":"2024-04-25T08:46:58.816685+0000","last_fullsized":"2024-04-25T08:46:58.816685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:05.131808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815432+0000","last_change":"2024-04-25T08:46:57.746062+0000","last_active":"2024-04-25T08:46:58.815432+0000","last_peered":"2024-04-25T08:46:58.815432+0000","last_clean":"2024-04-25T08:46:58.815432+0000","last_became_active":"2024-04-25T08:46:57.745591+0000","last_became_peered":"2024-04-25T08:46:57.745591+0000","last_unstale":"2024-04-25T08:46:58.815432+0000","last_undegraded":"2024-04-25T08:46:58.815432+0000","last_fullsized":"2024-04-25T08:46:58.815432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704223+0000","last_change":"2024-04-25T08:46:55.704223+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704223+0000","last_undegraded":"2024-04-25T08:46:55.704223+0000","last_fullsized":"2024-04-25T08:46:55.704223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725070+0000","last_change":"2024-04-25T08:46:57.738075+0000","last_active":"2024-04-25T08:46:58.725070+0000","last_peered":"2024-04-25T08:46:58.725070+0000","last_clean":"2024-04-25T08:46:58.725070+0000","last_became_active":"2024-04-25T08:46:57.737179+0000","last_became_peered":"2024-04-25T08:46:57.737179+0000","last_unstale":"2024-04-25T08:46:58.725070+0000","last_undegraded":"2024-04-25T08:46:58.725070+0000","last_fullsized":"2024-04-25T08:46:58.725070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:03.994595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.705046+0000","last_change":"2024-04-25T08:46:55.705046+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.705046+0000","last_undegraded":"2024-04-25T08:46:55.705046+0000","last_fullsized":"2024-04-25T08:46:55.705046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724375+0000","last_change":"2024-04-25T08:46:57.732893+0000","last_active":"2024-04-25T08:46:58.724375+0000","last_peered":"2024-04-25T08:46:58.724375+0000","last_clean":"2024-04-25T08:46:58.724375+0000","last_became_active":"2024-04-25T08:46:57.732276+0000","last_became_peered":"2024-04-25T08:46:57.732276+0000","last_unstale":"2024-04-25T08:46:58.724375+0000","last_undegraded":"2024-04-25T08:46:58.724375+0000","last_fullsized":"2024-04-25T08:46:58.724375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:06.838625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.701079+0000","last_change":"2024-04-25T08:46:55.701079+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.701079+0000","last_undegraded":"2024-04-25T08:46:55.701079+0000","last_fullsized":"2024-04-25T08:46:55.701079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816821+0000","last_change":"2024-04-25T08:46:57.749067+0000","last_active":"2024-04-25T08:46:58.816821+0000","last_peered":"2024-04-25T08:46:58.816821+0000","last_clean":"2024-04-25T08:46:58.816821+0000","last_became_active":"2024-04-25T08:46:57.748799+0000","last_became_peered":"2024-04-25T08:46:57.748799+0000","last_unstale":"2024-04-25T08:46:58.816821+0000","last_undegraded":"2024-04-25T08:46:58.816821+0000","last_fullsized":"2024-04-25T08:46:58.816821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.377815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724477+0000","last_change":"2024-04-25T08:46:56.719347+0000","last_active":"2024-04-25T08:46:58.724477+0000","last_peered":"2024-04-25T08:46:58.724477+0000","last_clean":"2024-04-25T08:46:58.724477+0000","last_became_active":"2024-04-25T08:46:56.719044+0000","last_became_peered":"2024-04-25T08:46:56.719044+0000","last_unstale":"2024-04-25T08:46:58.724477+0000","last_undegraded":"2024-04-25T08:46:58.724477+0000","last_fullsized":"2024-04-25T08:46:58.724477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:59.124963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815885+0000","last_change":"2024-04-25T08:46:57.749814+0000","last_active":"2024-04-25T08:46:58.815885+0000","last_peered":"2024-04-25T08:46:58.815885+0000","last_clean":"2024-04-25T08:46:58.815885+0000","last_became_active":"2024-04-25T08:46:57.749188+0000","last_became_peered":"2024-04-25T08:46:57.749188+0000","last_unstale":"2024-04-25T08:46:58.815885+0000","last_undegraded":"2024-04-25T08:46:58.815885+0000","last_fullsized":"2024-04-25T08:46:58.815885+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:39.399037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.723907+0000","last_change":"2024-04-25T08:46:56.716040+0000","last_active":"2024-04-25T08:46:58.723907+0000","last_peered":"2024-04-25T08:46:58.723907+0000","last_clean":"2024-04-25T08:46:58.723907+0000","last_became_active":"2024-04-25T08:46:56.715756+0000","last_became_peered":"2024-04-25T08:46:56.715756+0000","last_unstale":"2024-04-25T08:46:58.723907+0000","last_undegraded":"2024-04-25T08:46:58.723907+0000","last_fullsized":"2024-04-25T08:46:58.723907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:38.648803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725238+0000","last_change":"2024-04-25T08:46:57.736923+0000","last_active":"2024-04-25T08:46:58.725238+0000","last_peered":"2024-04-25T08:46:58.725238+0000","last_clean":"2024-04-25T08:46:58.725238+0000","last_became_active":"2024-04-25T08:46:57.736642+0000","last_became_peered":"2024-04-25T08:46:57.736642+0000","last_unstale":"2024-04-25T08:46:58.725238+0000","last_undegraded":"2024-04-25T08:46:58.725238+0000","last_fullsized":"2024-04-25T08:46:58.725238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.249964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815517+0000","last_change":"2024-04-25T08:46:56.716582+0000","last_active":"2024-04-25T08:46:58.815517+0000","last_peered":"2024-04-25T08:46:58.815517+0000","last_clean":"2024-04-25T08:46:58.815517+0000","last_became_active":"2024-04-25T08:46:56.715623+0000","last_became_peered":"2024-04-25T08:46:56.715623+0000","last_unstale":"2024-04-25T08:46:58.815517+0000","last_undegraded":"2024-04-25T08:46:58.815517+0000","last_fullsized":"2024-04-25T08:46:58.815517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:22.233368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815824+0000","last_change":"2024-04-25T08:46:56.712775+0000","last_active":"2024-04-25T08:46:58.815824+0000","last_peered":"2024-04-25T08:46:58.815824+0000","last_clean":"2024-04-25T08:46:58.815824+0000","last_became_active":"2024-04-25T08:46:56.712444+0000","last_became_peered":"2024-04-25T08:46:56.712444+0000","last_unstale":"2024-04-25T08:46:58.815824+0000","last_undegraded":"2024-04-25T08:46:58.815824+0000","last_fullsized":"2024-04-25T08:46:58.815824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.460375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815270+0000","last_change":"2024-04-25T08:46:57.745023+0000","last_active":"2024-04-25T08:46:58.815270+0000","last_peered":"2024-04-25T08:46:58.815270+0000","last_clean":"2024-04-25T08:46:58.815270+0000","last_became_active":"2024-04-25T08:46:57.744756+0000","last_became_peered":"2024-04-25T08:46:57.744756+0000","last_unstale":"2024-04-25T08:46:58.815270+0000","last_undegraded":"2024-04-25T08:46:58.815270+0000","last_fullsized":"2024-04-25T08:46:58.815270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704057+0000","last_change":"2024-04-25T08:46:55.704057+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704057+0000","last_undegraded":"2024-04-25T08:46:55.704057+0000","last_fullsized":"2024-04-25T08:46:55.704057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.723978+0000","last_change":"2024-04-25T08:46:57.734433+0000","last_active":"2024-04-25T08:46:58.723978+0000","last_peered":"2024-04-25T08:46:58.723978+0000","last_clean":"2024-04-25T08:46:58.723978+0000","last_became_active":"2024-04-25T08:46:57.733784+0000","last_became_peered":"2024-04-25T08:46:57.733784+0000","last_unstale":"2024-04-25T08:46:58.723978+0000","last_undegraded":"2024-04-25T08:46:58.723978+0000","last_fullsized":"2024-04-25T08:46:58.723978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:09.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724821+0000","last_change":"2024-04-25T08:46:56.716712+0000","last_active":"2024-04-25T08:46:58.724821+0000","last_peered":"2024-04-25T08:46:58.724821+0000","last_clean":"2024-04-25T08:46:58.724821+0000","last_became_active":"2024-04-25T08:46:56.716458+0000","last_became_peered":"2024-04-25T08:46:56.716458+0000","last_unstale":"2024-04-25T08:46:58.724821+0000","last_undegraded":"2024-04-25T08:46:58.724821+0000","last_fullsized":"2024-04-25T08:46:58.724821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:29.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816109+0000","last_change":"2024-04-25T08:46:57.731222+0000","last_active":"2024-04-25T08:46:58.816109+0000","last_peered":"2024-04-25T08:46:58.816109+0000","last_clean":"2024-04-25T08:46:58.816109+0000","last_became_active":"2024-04-25T08:46:57.730957+0000","last_became_peered":"2024-04-25T08:46:57.730957+0000","last_unstale":"2024-04-25T08:46:58.816109+0000","last_undegraded":"2024-04-25T08:46:58.816109+0000","last_fullsized":"2024-04-25T08:46:58.816109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:21.844424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816667+0000","last_change":"2024-04-25T08:46:56.718059+0000","last_active":"2024-04-25T08:46:58.816667+0000","last_peered":"2024-04-25T08:46:58.816667+0000","last_clean":"2024-04-25T08:46:58.816667+0000","last_became_active":"2024-04-25T08:46:56.717753+0000","last_became_peered":"2024-04-25T08:46:56.717753+0000","last_unstale":"2024-04-25T08:46:58.816667+0000","last_undegraded":"2024-04-25T08:46:58.816667+0000","last_fullsized":"2024-04-25T08:46:58.816667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:44.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725106+0000","last_change":"2024-04-25T08:46:57.733968+0000","last_active":"2024-04-25T08:46:58.725106+0000","last_peered":"2024-04-25T08:46:58.725106+0000","last_clean":"2024-04-25T08:46:58.725106+0000","last_became_active":"2024-04-25T08:46:57.733726+0000","last_became_peered":"2024-04-25T08:46:57.733726+0000","last_unstale":"2024-04-25T08:46:58.725106+0000","last_undegraded":"2024-04-25T08:46:58.725106+0000","last_fullsized":"2024-04-25T08:46:58.725106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.700618+0000","last_change":"2024-04-25T08:46:55.700618+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.700618+0000","last_undegraded":"2024-04-25T08:46:55.700618+0000","last_fullsized":"2024-04-25T08:46:55.700618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724430+0000","last_change":"2024-04-25T08:46:57.737605+0000","last_active":"2024-04-25T08:46:58.724430+0000","last_peered":"2024-04-25T08:46:58.724430+0000","last_clean":"2024-04-25T08:46:58.724430+0000","last_became_active":"2024-04-25T08:46:57.737151+0000","last_became_peered":"2024-04-25T08:46:57.737151+0000","last_unstale":"2024-04-25T08:46:58.724430+0000","last_undegraded":"2024-04-25T08:46:58.724430+0000","last_fullsized":"2024-04-25T08:46:58.724430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:16.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724038+0000","last_change":"2024-04-25T08:46:56.711797+0000","last_active":"2024-04-25T08:46:58.724038+0000","last_peered":"2024-04-25T08:46:58.724038+0000","last_clean":"2024-04-25T08:46:58.724038+0000","last_became_active":"2024-04-25T08:46:56.711502+0000","last_became_peered":"2024-04-25T08:46:56.711502+0000","last_unstale":"2024-04-25T08:46:58.724038+0000","last_undegraded":"2024-04-25T08:46:58.724038+0000","last_fullsized":"2024-04-25T08:46:58.724038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:36.752145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704371+0000","last_change":"2024-04-25T08:46:55.704371+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704371+0000","last_undegraded":"2024-04-25T08:46:55.704371+0000","last_fullsized":"2024-04-25T08:46:55.704371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816130+0000","last_change":"2024-04-25T08:46:56.719424+0000","last_active":"2024-04-25T08:46:58.816130+0000","last_peered":"2024-04-25T08:46:58.816130+0000","last_clean":"2024-04-25T08:46:58.816130+0000","last_became_active":"2024-04-25T08:46:56.718888+0000","last_became_peered":"2024-04-25T08:46:56.718888+0000","last_unstale":"2024-04-25T08:46:58.816130+0000","last_undegraded":"2024-04-25T08:46:58.816130+0000","last_fullsized":"2024-04-25T08:46:58.816130+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:33.465219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816826+0000","last_change":"2024-04-25T08:46:56.720535+0000","last_active":"2024-04-25T08:46:58.816826+0000","last_peered":"2024-04-25T08:46:58.816826+0000","last_clean":"2024-04-25T08:46:58.816826+0000","last_became_active":"2024-04-25T08:46:56.720261+0000","last_became_peered":"2024-04-25T08:46:56.720261+0000","last_unstale":"2024-04-25T08:46:58.816826+0000","last_undegraded":"2024-04-25T08:46:58.816826+0000","last_fullsized":"2024-04-25T08:46:58.816826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:51.425671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815216+0000","last_change":"2024-04-25T08:46:57.751224+0000","last_active":"2024-04-25T08:46:58.815216+0000","last_peered":"2024-04-25T08:46:58.815216+0000","last_clean":"2024-04-25T08:46:58.815216+0000","last_became_active":"2024-04-25T08:46:57.750992+0000","last_became_peered":"2024-04-25T08:46:57.750992+0000","last_unstale":"2024-04-25T08:46:58.815216+0000","last_undegraded":"2024-04-25T08:46:58.815216+0000","last_fullsized":"2024-04-25T08:46:58.815216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.872215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.703575+0000","last_change":"2024-04-25T08:46:55.703575+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.703575+0000","last_undegraded":"2024-04-25T08:46:55.703575+0000","last_fullsized":"2024-04-25T08:46:55.703575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816051+0000","last_change":"2024-04-25T08:46:57.754454+0000","last_active":"2024-04-25T08:46:58.816051+0000","last_peered":"2024-04-25T08:46:58.816051+0000","last_clean":"2024-04-25T08:46:58.816051+0000","last_became_active":"2024-04-25T08:46:57.754033+0000","last_became_peered":"2024-04-25T08:46:57.754033+0000","last_unstale":"2024-04-25T08:46:58.816051+0000","last_undegraded":"2024-04-25T08:46:58.816051+0000","last_fullsized":"2024-04-25T08:46:58.816051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:03.517427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725191+0000","last_change":"2024-04-25T08:46:56.717064+0000","last_active":"2024-04-25T08:46:58.725191+0000","last_peered":"2024-04-25T08:46:58.725191+0000","last_clean":"2024-04-25T08:46:58.725191+0000","last_became_active":"2024-04-25T08:46:56.716743+0000","last_became_peered":"2024-04-25T08:46:56.716743+0000","last_unstale":"2024-04-25T08:46:58.725191+0000","last_undegraded":"2024-04-25T08:46:58.725191+0000","last_fullsized":"2024-04-25T08:46:58.725191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:21.811205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816271+0000","last_change":"2024-04-25T08:46:57.754149+0000","last_active":"2024-04-25T08:46:58.816271+0000","last_peered":"2024-04-25T08:46:58.816271+0000","last_clean":"2024-04-25T08:46:58.816271+0000","last_became_active":"2024-04-25T08:46:57.753872+0000","last_became_peered":"2024-04-25T08:46:57.753872+0000","last_unstale":"2024-04-25T08:46:58.816271+0000","last_undegraded":"2024-04-25T08:46:58.816271+0000","last_fullsized":"2024-04-25T08:46:58.816271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.599459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816754+0000","last_change":"2024-04-25T08:46:56.711294+0000","last_active":"2024-04-25T08:46:58.816754+0000","last_peered":"2024-04-25T08:46:58.816754+0000","last_clean":"2024-04-25T08:46:58.816754+0000","last_became_active":"2024-04-25T08:46:56.710929+0000","last_became_peered":"2024-04-25T08:46:56.710929+0000","last_unstale":"2024-04-25T08:46:58.816754+0000","last_undegraded":"2024-04-25T08:46:58.816754+0000","last_fullsized":"2024-04-25T08:46:58.816754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:15.137332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815873+0000","last_change":"2024-04-25T08:46:57.750015+0000","last_active":"2024-04-25T08:46:58.815873+0000","last_peered":"2024-04-25T08:46:58.815873+0000","last_clean":"2024-04-25T08:46:58.815873+0000","last_became_active":"2024-04-25T08:46:57.749748+0000","last_became_peered":"2024-04-25T08:46:57.749748+0000","last_unstale":"2024-04-25T08:46:58.815873+0000","last_undegraded":"2024-04-25T08:46:58.815873+0000","last_fullsized":"2024-04-25T08:46:58.815873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:40.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725139+0000","last_change":"2024-04-25T08:46:56.709724+0000","last_active":"2024-04-25T08:46:58.725139+0000","last_peered":"2024-04-25T08:46:58.725139+0000","last_clean":"2024-04-25T08:46:58.725139+0000","last_became_active":"2024-04-25T08:46:56.709479+0000","last_became_peered":"2024-04-25T08:46:56.709479+0000","last_unstale":"2024-04-25T08:46:58.725139+0000","last_undegraded":"2024-04-25T08:46:58.725139+0000","last_fullsized":"2024-04-25T08:46:58.725139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:48.796813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816653+0000","last_change":"2024-04-25T08:46:57.742949+0000","last_active":"2024-04-25T08:46:58.816653+0000","last_peered":"2024-04-25T08:46:58.816653+0000","last_clean":"2024-04-25T08:46:58.816653+0000","last_became_active":"2024-04-25T08:46:57.742695+0000","last_became_peered":"2024-04-25T08:46:57.742695+0000","last_unstale":"2024-04-25T08:46:58.816653+0000","last_undegraded":"2024-04-25T08:46:58.816653+0000","last_fullsized":"2024-04-25T08:46:58.816653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815962+0000","last_change":"2024-04-25T08:46:56.720535+0000","last_active":"2024-04-25T08:46:58.815962+0000","last_peered":"2024-04-25T08:46:58.815962+0000","last_clean":"2024-04-25T08:46:58.815962+0000","last_became_active":"2024-04-25T08:46:56.720274+0000","last_became_peered":"2024-04-25T08:46:56.720274+0000","last_unstale":"2024-04-25T08:46:58.815962+0000","last_undegraded":"2024-04-25T08:46:58.815962+0000","last_fullsized":"2024-04-25T08:46:58.815962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:07.975454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816821+0000","last_change":"2024-04-25T08:46:57.736236+0000","last_active":"2024-04-25T08:46:58.816821+0000","last_peered":"2024-04-25T08:46:58.816821+0000","last_clean":"2024-04-25T08:46:58.816821+0000","last_became_active":"2024-04-25T08:46:57.735060+0000","last_became_peered":"2024-04-25T08:46:57.735060+0000","last_unstale":"2024-04-25T08:46:58.816821+0000","last_undegraded":"2024-04-25T08:46:58.816821+0000","last_fullsized":"2024-04-25T08:46:58.816821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:40.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815674+0000","last_change":"2024-04-25T08:46:56.718380+0000","last_active":"2024-04-25T08:46:58.815674+0000","last_peered":"2024-04-25T08:46:58.815674+0000","last_clean":"2024-04-25T08:46:58.815674+0000","last_became_active":"2024-04-25T08:46:56.717887+0000","last_became_peered":"2024-04-25T08:46:56.717887+0000","last_unstale":"2024-04-25T08:46:58.815674+0000","last_undegraded":"2024-04-25T08:46:58.815674+0000","last_fullsized":"2024-04-25T08:46:58.815674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:08.545923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815353+0000","last_change":"2024-04-25T08:46:56.717331+0000","last_active":"2024-04-25T08:46:58.815353+0000","last_peered":"2024-04-25T08:46:58.815353+0000","last_clean":"2024-04-25T08:46:58.815353+0000","last_became_active":"2024-04-25T08:46:56.716965+0000","last_became_peered":"2024-04-25T08:46:56.716965+0000","last_unstale":"2024-04-25T08:46:58.815353+0000","last_undegraded":"2024-04-25T08:46:58.815353+0000","last_fullsized":"2024-04-25T08:46:58.815353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:51.465906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724909+0000","last_change":"2024-04-25T08:46:57.739952+0000","last_active":"2024-04-25T08:46:58.724909+0000","last_peered":"2024-04-25T08:46:58.724909+0000","last_clean":"2024-04-25T08:46:58.724909+0000","last_became_active":"2024-04-25T08:46:57.739588+0000","last_became_peered":"2024-04-25T08:46:57.739588+0000","last_unstale":"2024-04-25T08:46:58.724909+0000","last_undegraded":"2024-04-25T08:46:58.724909+0000","last_fullsized":"2024-04-25T08:46:58.724909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:25.805809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724054+0000","last_change":"2024-04-25T08:46:56.714869+0000","last_active":"2024-04-25T08:46:58.724054+0000","last_peered":"2024-04-25T08:46:58.724054+0000","last_clean":"2024-04-25T08:46:58.724054+0000","last_became_active":"2024-04-25T08:46:56.714573+0000","last_became_peered":"2024-04-25T08:46:56.714573+0000","last_unstale":"2024-04-25T08:46:58.724054+0000","last_undegraded":"2024-04-25T08:46:58.724054+0000","last_fullsized":"2024-04-25T08:46:58.724054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:25.662938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:59.725301+0000","last_change":"2024-04-25T08:46:56.714486+0000","last_active":"2024-04-25T08:46:59.725301+0000","last_peered":"2024-04-25T08:46:59.725301+0000","last_clean":"2024-04-25T08:46:59.725301+0000","last_became_active":"2024-04-25T08:46:56.714227+0000","last_became_peered":"2024-04-25T08:46:56.714227+0000","last_unstale":"2024-04-25T08:46:59.725301+0000","last_undegraded":"2024-04-25T08:46:59.725301+0000","last_fullsized":"2024-04-25T08:46:59.725301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:03.785847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725238+0000","last_change":"2024-04-25T08:46:57.739412+0000","last_active":"2024-04-25T08:46:58.725238+0000","last_peered":"2024-04-25T08:46:58.725238+0000","last_clean":"2024-04-25T08:46:58.725238+0000","last_became_active":"2024-04-25T08:46:57.736752+0000","last_became_peered":"2024-04-25T08:46:57.736752+0000","last_unstale":"2024-04-25T08:46:58.725238+0000","last_undegraded":"2024-04-25T08:46:58.725238+0000","last_fullsized":"2024-04-25T08:46:58.725238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704641+0000","last_change":"2024-04-25T08:46:55.704641+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704641+0000","last_undegraded":"2024-04-25T08:46:55.704641+0000","last_fullsized":"2024-04-25T08:46:55.704641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816412+0000","last_change":"2024-04-25T08:46:57.744908+0000","last_active":"2024-04-25T08:46:58.816412+0000","last_peered":"2024-04-25T08:46:58.816412+0000","last_clean":"2024-04-25T08:46:58.816412+0000","last_became_active":"2024-04-25T08:46:57.744655+0000","last_became_peered":"2024-04-25T08:46:57.744655+0000","last_unstale":"2024-04-25T08:46:58.816412+0000","last_undegraded":"2024-04-25T08:46:58.816412+0000","last_fullsized":"2024-04-25T08:46:58.816412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:34.197715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.703337+0000","last_change":"2024-04-25T08:46:55.703337+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.703337+0000","last_undegraded":"2024-04-25T08:46:55.703337+0000","last_fullsized":"2024-04-25T08:46:55.703337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.700416+0000","last_change":"2024-04-25T08:46:55.700416+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.700416+0000","last_undegraded":"2024-04-25T08:46:55.700416+0000","last_fullsized":"2024-04-25T08:46:55.700416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816439+0000","last_change":"2024-04-25T08:46:56.719242+0000","last_active":"2024-04-25T08:46:58.816439+0000","last_peered":"2024-04-25T08:46:58.816439+0000","last_clean":"2024-04-25T08:46:58.816439+0000","last_became_active":"2024-04-25T08:46:56.719000+0000","last_became_peered":"2024-04-25T08:46:56.719000+0000","last_unstale":"2024-04-25T08:46:58.816439+0000","last_undegraded":"2024-04-25T08:46:58.816439+0000","last_fullsized":"2024-04-25T08:46:58.816439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:34.859908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725338+0000","last_change":"2024-04-25T08:46:57.734806+0000","last_active":"2024-04-25T08:46:58.725338+0000","last_peered":"2024-04-25T08:46:58.725338+0000","last_clean":"2024-04-25T08:46:58.725338+0000","last_became_active":"2024-04-25T08:46:57.734533+0000","last_became_peered":"2024-04-25T08:46:57.734533+0000","last_unstale":"2024-04-25T08:46:58.725338+0000","last_undegraded":"2024-04-25T08:46:58.725338+0000","last_fullsized":"2024-04-25T08:46:58.725338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:51.496043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.701349+0000","last_change":"2024-04-25T08:46:55.701349+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.701349+0000","last_undegraded":"2024-04-25T08:46:55.701349+0000","last_fullsized":"2024-04-25T08:46:55.701349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725351+0000","last_change":"2024-04-25T08:46:57.741952+0000","last_active":"2024-04-25T08:46:58.725351+0000","last_peered":"2024-04-25T08:46:58.725351+0000","last_clean":"2024-04-25T08:46:58.725351+0000","last_became_active":"2024-04-25T08:46:57.741689+0000","last_became_peered":"2024-04-25T08:46:57.741689+0000","last_unstale":"2024-04-25T08:46:58.725351+0000","last_undegraded":"2024-04-25T08:46:58.725351+0000","last_fullsized":"2024-04-25T08:46:58.725351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:30.852428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725011+0000","last_change":"2024-04-25T08:46:56.716730+0000","last_active":"2024-04-25T08:46:58.725011+0000","last_peered":"2024-04-25T08:46:58.725011+0000","last_clean":"2024-04-25T08:46:58.725011+0000","last_became_active":"2024-04-25T08:46:56.716477+0000","last_became_peered":"2024-04-25T08:46:56.716477+0000","last_unstale":"2024-04-25T08:46:58.725011+0000","last_undegraded":"2024-04-25T08:46:58.725011+0000","last_fullsized":"2024-04-25T08:46:58.725011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:40.418688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815970+0000","last_change":"2024-04-25T08:46:56.721484+0000","last_active":"2024-04-25T08:46:58.815970+0000","last_peered":"2024-04-25T08:46:58.815970+0000","last_clean":"2024-04-25T08:46:58.815970+0000","last_became_active":"2024-04-25T08:46:56.721115+0000","last_became_peered":"2024-04-25T08:46:56.721115+0000","last_unstale":"2024-04-25T08:46:58.815970+0000","last_undegraded":"2024-04-25T08:46:58.815970+0000","last_fullsized":"2024-04-25T08:46:58.815970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:20.574350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-25T08:46:55.705281+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:46:55.705281+0000","last_peered":"2024-04-25T08:46:55.705281+0000","last_clean":"2024-04-25T08:46:55.705281+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:46:55.705281+0000","last_undegraded":"2024-04-25T08:46:55.705281+0000","last_fullsized":"2024-04-25T08:46:55.705281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36852,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334988,"statfs":{"total":96636764160,"available":96599027712,"internally_reserved":0,"allocated":1548288,"data_stored":1027011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":954368,"data_stored":436643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":995328,"data_stored":457203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1011712,"data_stored":458885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":995328,"data_stored":457751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":457911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":457281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1585152,"data_stored":1047537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:47:01.024 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:47:01.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.168+0000 7fe5106dd640 1 Processor -- start 2024-04-25T08:47:01.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.168+0000 7fe5106dd640 1 -- start start 2024-04-25T08:47:01.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe5106dd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe5080cfec0 0x7fe5080cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe5106dd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5080ce3c0 0x7fe50806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe5106dd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe508071480 con 0x7fe508154ee0 2024-04-25T08:47:01.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe5106dd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5080ce830 con 0x7fe5080cfec0 2024-04-25T08:47:01.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe5106dd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe508072090 con 0x7fe5080ce3c0 2024-04-25T08:47:01.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe50dc78640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe5080cfec0 0x7fe5080cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe50dc78640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe5080cfec0 0x7fe5080cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33876/0 (socket says 172.21.15.172:33876) 2024-04-25T08:47:01.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe50dc78640 1 -- 172.21.15.172:0/4153884224 learned_addr learned my addr 172.21.15.172:0/4153884224 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:01.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe50ec7a640 1 --2- 172.21.15.172:0/4153884224 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5080ce3c0 0x7fe50806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe50dc78640 1 -- 172.21.15.172:0/4153884224 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5080ce3c0 msgr2=0x7fe50806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:01.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe50dc78640 1 --2- 172.21.15.172:0/4153884224 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5080ce3c0 0x7fe50806d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe50dc78640 1 -- 172.21.15.172:0/4153884224 >> v1:172.21.15.186:6789/0 conn(0x7fe508154ee0 legacy=0x7fe5080cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.169+0000 7fe50dc78640 1 -- 172.21.15.172:0/4153884224 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe508071760 con 0x7fe5080cfec0 2024-04-25T08:47:01.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.170+0000 7fe50dc78640 1 --2- 172.21.15.172:0/4153884224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080cfec0 0x7fe5080cde80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009870 tx=0x7fe4f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fd87fe57e145bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:01.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.170+0000 7fe50d477640 1 -- 172.21.15.172:0/4153884224 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8037070 con 0x7fe5080cfec0 2024-04-25T08:47:01.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.170+0000 7fe50d477640 1 -- 172.21.15.172:0/4153884224 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f8032440 con 0x7fe5080cfec0 2024-04-25T08:47:01.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.170+0000 7fe50d477640 1 -- 172.21.15.172:0/4153884224 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8032810 con 0x7fe5080cfec0 2024-04-25T08:47:01.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.170+0000 7fe5106dd640 1 -- 172.21.15.172:0/4153884224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080cfec0 msgr2=0x7fe5080cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.170+0000 7fe5106dd640 1 --2- 172.21.15.172:0/4153884224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080cfec0 0x7fe5080cde80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009870 tx=0x7fe4f802a270 comp rx=0 tx=0).stop 2024-04-25T08:47:01.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.171+0000 7fe5106dd640 1 -- 172.21.15.172:0/4153884224 shutdown_connections 2024-04-25T08:47:01.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.171+0000 7fe5106dd640 1 --2- 172.21.15.172:0/4153884224 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5080ce3c0 0x7fe50806d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.171+0000 7fe5106dd640 1 --2- 172.21.15.172:0/4153884224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080cfec0 0x7fe5080cde80 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.171+0000 7fe5106dd640 1 -- 172.21.15.172:0/4153884224 >> 172.21.15.172:0/4153884224 conn(0x7fe50806abe0 msgr2=0x7fe50806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:01.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.171+0000 7fe5106dd640 1 -- 172.21.15.172:0/4153884224 shutdown_connections 2024-04-25T08:47:01.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.171+0000 7fe5106dd640 1 -- 172.21.15.172:0/4153884224 wait complete. 2024-04-25T08:47:01.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.172+0000 7fe5106dd640 1 Processor -- start 2024-04-25T08:47:01.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.172+0000 7fe5106dd640 1 -- start start 2024-04-25T08:47:01.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.172+0000 7fe5106dd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080ce3c0 0x7fe50815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.172+0000 7fe5106dd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5080cfec0 0x7fe50815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.172+0000 7fe5106dd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe508154ee0 0x7fe50814df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.172+0000 7fe5106dd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508071d20 con 0x7fe5080ce3c0 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.172+0000 7fe5106dd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508071230 con 0x7fe5080cfec0 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.172+0000 7fe5106dd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5081552c0 con 0x7fe508154ee0 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50e479640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080ce3c0 0x7fe50815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50e479640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080ce3c0 0x7fe50815c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33880/0 (socket says 172.21.15.172:33880) 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50e479640 1 -- 172.21.15.172:0/888981537 learned_addr learned my addr 172.21.15.172:0/888981537 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50ec7a640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe508154ee0 0x7fe50814df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50dc78640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5080cfec0 0x7fe50815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50e479640 1 -- 172.21.15.172:0/888981537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe508154ee0 msgr2=0x7fe50814df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50e479640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe508154ee0 0x7fe50814df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50e479640 1 -- 172.21.15.172:0/888981537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5080cfec0 msgr2=0x7fe50815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50e479640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5080cfec0 0x7fe50815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50e479640 1 -- 172.21.15.172:0/888981537 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5081421b0 con 0x7fe5080ce3c0 2024-04-25T08:47:01.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50dc78640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5080cfec0 0x7fe50815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:01.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe50e479640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080ce3c0 0x7fe50815c1d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fe50400c3c0 tx=0x7fe50400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:01.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe4feffd640 1 -- 172.21.15.172:0/888981537 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5040052d0 con 0x7fe5080ce3c0 2024-04-25T08:47:01.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe4feffd640 1 -- 172.21.15.172:0/888981537 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe504005490 con 0x7fe5080ce3c0 2024-04-25T08:47:01.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe5106dd640 1 -- 172.21.15.172:0/888981537 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe508142490 con 0x7fe5080ce3c0 2024-04-25T08:47:01.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe4feffd640 1 -- 172.21.15.172:0/888981537 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504007260 con 0x7fe5080ce3c0 2024-04-25T08:47:01.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.173+0000 7fe5106dd640 1 -- 172.21.15.172:0/888981537 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5080af270 con 0x7fe5080ce3c0 2024-04-25T08:47:01.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.174+0000 7fe5106dd640 1 -- 172.21.15.172:0/888981537 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe508073990 con 0x7fe5080ce3c0 2024-04-25T08:47:01.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.175+0000 7fe4feffd640 1 -- 172.21.15.172:0/888981537 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe504007400 con 0x7fe5080ce3c0 2024-04-25T08:47:01.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.175+0000 7fe4feffd640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe4ec06b4d0 0x7fe4ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.175+0000 7fe4feffd640 1 -- 172.21.15.172:0/888981537 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe504089830 con 0x7fe5080ce3c0 2024-04-25T08:47:01.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.175+0000 7fe50dc78640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe4ec06b4d0 0x7fe4ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.175+0000 7fe50dc78640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe4ec06b4d0 0x7fe4ec06d990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8034000 tx=0x7fe4f802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:01.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.179+0000 7fe4feffd640 1 -- 172.21.15.172:0/888981537 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe504058520 con 0x7fe5080ce3c0 2024-04-25T08:47:01.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.346+0000 7fe5106dd640 1 -- 172.21.15.172:0/888981537 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5080af4b0 con 0x7fe4ec06b4d0 2024-04-25T08:47:01.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.352+0000 7fe4feffd640 1 -- 172.21.15.172:0/888981537 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248962 (secure 0 0 0) 0x7fe4f803c460 con 0x7fe4ec06b4d0 2024-04-25T08:47:01.345 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:47:01.347 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:47:01.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 -- 172.21.15.172:0/888981537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe4ec06b4d0 msgr2=0x7fe4ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe4ec06b4d0 0x7fe4ec06d990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8034000 tx=0x7fe4f802e000 comp rx=0 tx=0).stop 2024-04-25T08:47:01.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 -- 172.21.15.172:0/888981537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080ce3c0 msgr2=0x7fe50815c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080ce3c0 0x7fe50815c1d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fe50400c3c0 tx=0x7fe50400c880 comp rx=0 tx=0).stop 2024-04-25T08:47:01.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 -- 172.21.15.172:0/888981537 shutdown_connections 2024-04-25T08:47:01.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe4ec06b4d0 0x7fe4ec06d990 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5080cfec0 0x7fe50815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe508154ee0 0x7fe50814df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 --2- 172.21.15.172:0/888981537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5080ce3c0 0x7fe50815c1d0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 -- 172.21.15.172:0/888981537 >> 172.21.15.172:0/888981537 conn(0x7fe50806abe0 msgr2=0x7fe5080cc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:01.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 -- 172.21.15.172:0/888981537 shutdown_connections 2024-04-25T08:47:01.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.355+0000 7fe5106dd640 1 -- 172.21.15.172:0/888981537 wait complete. 2024-04-25T08:47:01.357 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-04-25T08:47:00.568379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":291632,"kb_used_data":8880,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754683088,"statfs":{"total":773094113280,"available":772795482112,"internally_reserved":0,"allocated":9093120,"data_stored":4800222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.868639"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816620+0000","last_change":"2024-04-25T08:46:57.748857+0000","last_active":"2024-04-25T08:46:58.816620+0000","last_peered":"2024-04-25T08:46:58.816620+0000","last_clean":"2024-04-25T08:46:58.816620+0000","last_became_active":"2024-04-25T08:46:57.748557+0000","last_became_peered":"2024-04-25T08:46:57.748557+0000","last_unstale":"2024-04-25T08:46:58.816620+0000","last_undegraded":"2024-04-25T08:46:58.816620+0000","last_fullsized":"2024-04-25T08:46:58.816620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.872215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725285+0000","last_change":"2024-04-25T08:46:57.733902+0000","last_active":"2024-04-25T08:46:58.725285+0000","last_peered":"2024-04-25T08:46:58.725285+0000","last_clean":"2024-04-25T08:46:58.725285+0000","last_became_active":"2024-04-25T08:46:57.733591+0000","last_became_peered":"2024-04-25T08:46:57.733591+0000","last_unstale":"2024-04-25T08:46:58.725285+0000","last_undegraded":"2024-04-25T08:46:58.725285+0000","last_fullsized":"2024-04-25T08:46:58.725285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:55.569414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724257+0000","last_change":"2024-04-25T08:46:57.734366+0000","last_active":"2024-04-25T08:46:58.724257+0000","last_peered":"2024-04-25T08:46:58.724257+0000","last_clean":"2024-04-25T08:46:58.724257+0000","last_became_active":"2024-04-25T08:46:57.733738+0000","last_became_peered":"2024-04-25T08:46:57.733738+0000","last_unstale":"2024-04-25T08:46:58.724257+0000","last_undegraded":"2024-04-25T08:46:58.724257+0000","last_fullsized":"2024-04-25T08:46:58.724257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816404+0000","last_change":"2024-04-25T08:46:57.750494+0000","last_active":"2024-04-25T08:46:58.816404+0000","last_peered":"2024-04-25T08:46:58.816404+0000","last_clean":"2024-04-25T08:46:58.816404+0000","last_became_active":"2024-04-25T08:46:57.750234+0000","last_became_peered":"2024-04-25T08:46:57.750234+0000","last_unstale":"2024-04-25T08:46:58.816404+0000","last_undegraded":"2024-04-25T08:46:58.816404+0000","last_fullsized":"2024-04-25T08:46:58.816404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:53.853355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815579+0000","last_change":"2024-04-25T08:46:57.736898+0000","last_active":"2024-04-25T08:46:58.815579+0000","last_peered":"2024-04-25T08:46:58.815579+0000","last_clean":"2024-04-25T08:46:58.815579+0000","last_became_active":"2024-04-25T08:46:57.736617+0000","last_became_peered":"2024-04-25T08:46:57.736617+0000","last_unstale":"2024-04-25T08:46:58.815579+0000","last_undegraded":"2024-04-25T08:46:58.815579+0000","last_fullsized":"2024-04-25T08:46:58.815579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815743+0000","last_change":"2024-04-25T08:46:57.749375+0000","last_active":"2024-04-25T08:46:58.815743+0000","last_peered":"2024-04-25T08:46:58.815743+0000","last_clean":"2024-04-25T08:46:58.815743+0000","last_became_active":"2024-04-25T08:46:57.749039+0000","last_became_peered":"2024-04-25T08:46:57.749039+0000","last_unstale":"2024-04-25T08:46:58.815743+0000","last_undegraded":"2024-04-25T08:46:58.815743+0000","last_fullsized":"2024-04-25T08:46:58.815743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:35.985064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724725+0000","last_change":"2024-04-25T08:46:57.740018+0000","last_active":"2024-04-25T08:46:58.724725+0000","last_peered":"2024-04-25T08:46:58.724725+0000","last_clean":"2024-04-25T08:46:58.724725+0000","last_became_active":"2024-04-25T08:46:57.738781+0000","last_became_peered":"2024-04-25T08:46:57.738781+0000","last_unstale":"2024-04-25T08:46:58.724725+0000","last_undegraded":"2024-04-25T08:46:58.724725+0000","last_fullsized":"2024-04-25T08:46:58.724725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:59.347891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724516+0000","last_change":"2024-04-25T08:46:57.742552+0000","last_active":"2024-04-25T08:46:58.724516+0000","last_peered":"2024-04-25T08:46:58.724516+0000","last_clean":"2024-04-25T08:46:58.724516+0000","last_became_active":"2024-04-25T08:46:57.742253+0000","last_became_peered":"2024-04-25T08:46:57.742253+0000","last_unstale":"2024-04-25T08:46:58.724516+0000","last_undegraded":"2024-04-25T08:46:58.724516+0000","last_fullsized":"2024-04-25T08:46:58.724516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:32.530004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815758+0000","last_change":"2024-04-25T08:46:57.750527+0000","last_active":"2024-04-25T08:46:58.815758+0000","last_peered":"2024-04-25T08:46:58.815758+0000","last_clean":"2024-04-25T08:46:58.815758+0000","last_became_active":"2024-04-25T08:46:57.749570+0000","last_became_peered":"2024-04-25T08:46:57.749570+0000","last_unstale":"2024-04-25T08:46:58.815758+0000","last_undegraded":"2024-04-25T08:46:58.815758+0000","last_fullsized":"2024-04-25T08:46:58.815758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:32.530004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724344+0000","last_change":"2024-04-25T08:46:57.737397+0000","last_active":"2024-04-25T08:46:58.724344+0000","last_peered":"2024-04-25T08:46:58.724344+0000","last_clean":"2024-04-25T08:46:58.724344+0000","last_became_active":"2024-04-25T08:46:57.736776+0000","last_became_peered":"2024-04-25T08:46:57.736776+0000","last_unstale":"2024-04-25T08:46:58.724344+0000","last_undegraded":"2024-04-25T08:46:58.724344+0000","last_fullsized":"2024-04-25T08:46:58.724344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816369+0000","last_change":"2024-04-25T08:46:57.755588+0000","last_active":"2024-04-25T08:46:58.816369+0000","last_peered":"2024-04-25T08:46:58.816369+0000","last_clean":"2024-04-25T08:46:58.816369+0000","last_became_active":"2024-04-25T08:46:57.755324+0000","last_became_peered":"2024-04-25T08:46:57.755324+0000","last_unstale":"2024-04-25T08:46:58.816369+0000","last_undegraded":"2024-04-25T08:46:58.816369+0000","last_fullsized":"2024-04-25T08:46:58.816369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:45.411656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815712+0000","last_change":"2024-04-25T08:46:57.736823+0000","last_active":"2024-04-25T08:46:58.815712+0000","last_peered":"2024-04-25T08:46:58.815712+0000","last_clean":"2024-04-25T08:46:58.815712+0000","last_became_active":"2024-04-25T08:46:57.736547+0000","last_became_peered":"2024-04-25T08:46:57.736547+0000","last_unstale":"2024-04-25T08:46:58.815712+0000","last_undegraded":"2024-04-25T08:46:58.815712+0000","last_fullsized":"2024-04-25T08:46:58.815712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:09.706138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815516+0000","last_change":"2024-04-25T08:46:57.745848+0000","last_active":"2024-04-25T08:46:58.815516+0000","last_peered":"2024-04-25T08:46:58.815516+0000","last_clean":"2024-04-25T08:46:58.815516+0000","last_became_active":"2024-04-25T08:46:57.745243+0000","last_became_peered":"2024-04-25T08:46:57.745243+0000","last_unstale":"2024-04-25T08:46:58.815516+0000","last_undegraded":"2024-04-25T08:46:58.815516+0000","last_fullsized":"2024-04-25T08:46:58.815516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:16.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816601+0000","last_change":"2024-04-25T08:46:57.753708+0000","last_active":"2024-04-25T08:46:58.816601+0000","last_peered":"2024-04-25T08:46:58.816601+0000","last_clean":"2024-04-25T08:46:58.816601+0000","last_became_active":"2024-04-25T08:46:57.753453+0000","last_became_peered":"2024-04-25T08:46:57.753453+0000","last_unstale":"2024-04-25T08:46:58.816601+0000","last_undegraded":"2024-04-25T08:46:58.816601+0000","last_fullsized":"2024-04-25T08:46:58.816601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:32.663123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725290+0000","last_change":"2024-04-25T08:46:57.729860+0000","last_active":"2024-04-25T08:46:58.725290+0000","last_peered":"2024-04-25T08:46:58.725290+0000","last_clean":"2024-04-25T08:46:58.725290+0000","last_became_active":"2024-04-25T08:46:57.729559+0000","last_became_peered":"2024-04-25T08:46:57.729559+0000","last_unstale":"2024-04-25T08:46:58.725290+0000","last_undegraded":"2024-04-25T08:46:58.725290+0000","last_fullsized":"2024-04-25T08:46:58.725290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:56.215702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815923+0000","last_change":"2024-04-25T08:46:57.750649+0000","last_active":"2024-04-25T08:46:58.815923+0000","last_peered":"2024-04-25T08:46:58.815923+0000","last_clean":"2024-04-25T08:46:58.815923+0000","last_became_active":"2024-04-25T08:46:57.750400+0000","last_became_peered":"2024-04-25T08:46:57.750400+0000","last_unstale":"2024-04-25T08:46:58.815923+0000","last_undegraded":"2024-04-25T08:46:58.815923+0000","last_fullsized":"2024-04-25T08:46:58.815923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.377815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815835+0000","last_change":"2024-04-25T08:46:57.747932+0000","last_active":"2024-04-25T08:46:58.815835+0000","last_peered":"2024-04-25T08:46:58.815835+0000","last_clean":"2024-04-25T08:46:58.815835+0000","last_became_active":"2024-04-25T08:46:57.747664+0000","last_became_peered":"2024-04-25T08:46:57.747664+0000","last_unstale":"2024-04-25T08:46:58.815835+0000","last_undegraded":"2024-04-25T08:46:58.815835+0000","last_fullsized":"2024-04-25T08:46:58.815835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.805999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724229+0000","last_change":"2024-04-25T08:46:57.733118+0000","last_active":"2024-04-25T08:46:58.724229+0000","last_peered":"2024-04-25T08:46:58.724229+0000","last_clean":"2024-04-25T08:46:58.724229+0000","last_became_active":"2024-04-25T08:46:57.732601+0000","last_became_peered":"2024-04-25T08:46:57.732601+0000","last_unstale":"2024-04-25T08:46:58.724229+0000","last_undegraded":"2024-04-25T08:46:58.724229+0000","last_fullsized":"2024-04-25T08:46:58.724229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:18.985748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816376+0000","last_change":"2024-04-25T08:46:57.755439+0000","last_active":"2024-04-25T08:46:58.816376+0000","last_peered":"2024-04-25T08:46:58.816376+0000","last_clean":"2024-04-25T08:46:58.816376+0000","last_became_active":"2024-04-25T08:46:57.755165+0000","last_became_peered":"2024-04-25T08:46:57.755165+0000","last_unstale":"2024-04-25T08:46:58.816376+0000","last_undegraded":"2024-04-25T08:46:58.816376+0000","last_fullsized":"2024-04-25T08:46:58.816376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:48.272205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724123+0000","last_change":"2024-04-25T08:46:57.734179+0000","last_active":"2024-04-25T08:46:58.724123+0000","last_peered":"2024-04-25T08:46:58.724123+0000","last_clean":"2024-04-25T08:46:58.724123+0000","last_became_active":"2024-04-25T08:46:57.733836+0000","last_became_peered":"2024-04-25T08:46:57.733836+0000","last_unstale":"2024-04-25T08:46:58.724123+0000","last_undegraded":"2024-04-25T08:46:58.724123+0000","last_fullsized":"2024-04-25T08:46:58.724123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:39.811462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816657+0000","last_change":"2024-04-25T08:46:57.752623+0000","last_active":"2024-04-25T08:46:58.816657+0000","last_peered":"2024-04-25T08:46:58.816657+0000","last_clean":"2024-04-25T08:46:58.816657+0000","last_became_active":"2024-04-25T08:46:57.752243+0000","last_became_peered":"2024-04-25T08:46:57.752243+0000","last_unstale":"2024-04-25T08:46:58.816657+0000","last_undegraded":"2024-04-25T08:46:58.816657+0000","last_fullsized":"2024-04-25T08:46:58.816657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:09.706138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816089+0000","last_change":"2024-04-25T08:46:57.751393+0000","last_active":"2024-04-25T08:46:58.816089+0000","last_peered":"2024-04-25T08:46:58.816089+0000","last_clean":"2024-04-25T08:46:58.816089+0000","last_became_active":"2024-04-25T08:46:57.751133+0000","last_became_peered":"2024-04-25T08:46:57.751133+0000","last_unstale":"2024-04-25T08:46:58.816089+0000","last_undegraded":"2024-04-25T08:46:58.816089+0000","last_fullsized":"2024-04-25T08:46:58.816089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:15.717132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724709+0000","last_change":"2024-04-25T08:46:57.736072+0000","last_active":"2024-04-25T08:46:58.724709+0000","last_peered":"2024-04-25T08:46:58.724709+0000","last_clean":"2024-04-25T08:46:58.724709+0000","last_became_active":"2024-04-25T08:46:57.735781+0000","last_became_peered":"2024-04-25T08:46:57.735781+0000","last_unstale":"2024-04-25T08:46:58.724709+0000","last_undegraded":"2024-04-25T08:46:58.724709+0000","last_fullsized":"2024-04-25T08:46:58.724709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:39.399037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815958+0000","last_change":"2024-04-25T08:46:57.746722+0000","last_active":"2024-04-25T08:46:58.815958+0000","last_peered":"2024-04-25T08:46:58.815958+0000","last_clean":"2024-04-25T08:46:58.815958+0000","last_became_active":"2024-04-25T08:46:57.746456+0000","last_became_peered":"2024-04-25T08:46:57.746456+0000","last_unstale":"2024-04-25T08:46:58.815958+0000","last_undegraded":"2024-04-25T08:46:58.815958+0000","last_fullsized":"2024-04-25T08:46:58.815958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:16.233794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816279+0000","last_change":"2024-04-25T08:46:57.744323+0000","last_active":"2024-04-25T08:46:58.816279+0000","last_peered":"2024-04-25T08:46:58.816279+0000","last_clean":"2024-04-25T08:46:58.816279+0000","last_became_active":"2024-04-25T08:46:57.744049+0000","last_became_peered":"2024-04-25T08:46:57.744049+0000","last_unstale":"2024-04-25T08:46:58.816279+0000","last_undegraded":"2024-04-25T08:46:58.816279+0000","last_fullsized":"2024-04-25T08:46:58.816279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:32.048360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725023+0000","last_change":"2024-04-25T08:46:57.749566+0000","last_active":"2024-04-25T08:46:58.725023+0000","last_peered":"2024-04-25T08:46:58.725023+0000","last_clean":"2024-04-25T08:46:58.725023+0000","last_became_active":"2024-04-25T08:46:57.749266+0000","last_became_peered":"2024-04-25T08:46:57.749266+0000","last_unstale":"2024-04-25T08:46:58.725023+0000","last_undegraded":"2024-04-25T08:46:58.725023+0000","last_fullsized":"2024-04-25T08:46:58.725023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.249964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724942+0000","last_change":"2024-04-25T08:46:57.730151+0000","last_active":"2024-04-25T08:46:58.724942+0000","last_peered":"2024-04-25T08:46:58.724942+0000","last_clean":"2024-04-25T08:46:58.724942+0000","last_became_active":"2024-04-25T08:46:57.729538+0000","last_became_peered":"2024-04-25T08:46:57.729538+0000","last_unstale":"2024-04-25T08:46:58.724942+0000","last_undegraded":"2024-04-25T08:46:58.724942+0000","last_fullsized":"2024-04-25T08:46:58.724942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:03.994595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816685+0000","last_change":"2024-04-25T08:46:56.719653+0000","last_active":"2024-04-25T08:46:58.816685+0000","last_peered":"2024-04-25T08:46:58.816685+0000","last_clean":"2024-04-25T08:46:58.816685+0000","last_became_active":"2024-04-25T08:46:56.719238+0000","last_became_peered":"2024-04-25T08:46:56.719238+0000","last_unstale":"2024-04-25T08:46:58.816685+0000","last_undegraded":"2024-04-25T08:46:58.816685+0000","last_fullsized":"2024-04-25T08:46:58.816685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:05.131808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815432+0000","last_change":"2024-04-25T08:46:57.746062+0000","last_active":"2024-04-25T08:46:58.815432+0000","last_peered":"2024-04-25T08:46:58.815432+0000","last_clean":"2024-04-25T08:46:58.815432+0000","last_became_active":"2024-04-25T08:46:57.745591+0000","last_became_peered":"2024-04-25T08:46:57.745591+0000","last_unstale":"2024-04-25T08:46:58.815432+0000","last_undegraded":"2024-04-25T08:46:58.815432+0000","last_fullsized":"2024-04-25T08:46:58.815432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704223+0000","last_change":"2024-04-25T08:46:55.704223+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704223+0000","last_undegraded":"2024-04-25T08:46:55.704223+0000","last_fullsized":"2024-04-25T08:46:55.704223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725070+0000","last_change":"2024-04-25T08:46:57.738075+0000","last_active":"2024-04-25T08:46:58.725070+0000","last_peered":"2024-04-25T08:46:58.725070+0000","last_clean":"2024-04-25T08:46:58.725070+0000","last_became_active":"2024-04-25T08:46:57.737179+0000","last_became_peered":"2024-04-25T08:46:57.737179+0000","last_unstale":"2024-04-25T08:46:58.725070+0000","last_undegraded":"2024-04-25T08:46:58.725070+0000","last_fullsized":"2024-04-25T08:46:58.725070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:03.994595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.705046+0000","last_change":"2024-04-25T08:46:55.705046+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.705046+0000","last_undegraded":"2024-04-25T08:46:55.705046+0000","last_fullsized":"2024-04-25T08:46:55.705046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724375+0000","last_change":"2024-04-25T08:46:57.732893+0000","last_active":"2024-04-25T08:46:58.724375+0000","last_peered":"2024-04-25T08:46:58.724375+0000","last_clean":"2024-04-25T08:46:58.724375+0000","last_became_active":"2024-04-25T08:46:57.732276+0000","last_became_peered":"2024-04-25T08:46:57.732276+0000","last_unstale":"2024-04-25T08:46:58.724375+0000","last_undegraded":"2024-04-25T08:46:58.724375+0000","last_fullsized":"2024-04-25T08:46:58.724375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:06.838625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.701079+0000","last_change":"2024-04-25T08:46:55.701079+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.701079+0000","last_undegraded":"2024-04-25T08:46:55.701079+0000","last_fullsized":"2024-04-25T08:46:55.701079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816821+0000","last_change":"2024-04-25T08:46:57.749067+0000","last_active":"2024-04-25T08:46:58.816821+0000","last_peered":"2024-04-25T08:46:58.816821+0000","last_clean":"2024-04-25T08:46:58.816821+0000","last_became_active":"2024-04-25T08:46:57.748799+0000","last_became_peered":"2024-04-25T08:46:57.748799+0000","last_unstale":"2024-04-25T08:46:58.816821+0000","last_undegraded":"2024-04-25T08:46:58.816821+0000","last_fullsized":"2024-04-25T08:46:58.816821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.377815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724477+0000","last_change":"2024-04-25T08:46:56.719347+0000","last_active":"2024-04-25T08:46:58.724477+0000","last_peered":"2024-04-25T08:46:58.724477+0000","last_clean":"2024-04-25T08:46:58.724477+0000","last_became_active":"2024-04-25T08:46:56.719044+0000","last_became_peered":"2024-04-25T08:46:56.719044+0000","last_unstale":"2024-04-25T08:46:58.724477+0000","last_undegraded":"2024-04-25T08:46:58.724477+0000","last_fullsized":"2024-04-25T08:46:58.724477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:59.124963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815885+0000","last_change":"2024-04-25T08:46:57.749814+0000","last_active":"2024-04-25T08:46:58.815885+0000","last_peered":"2024-04-25T08:46:58.815885+0000","last_clean":"2024-04-25T08:46:58.815885+0000","last_became_active":"2024-04-25T08:46:57.749188+0000","last_became_peered":"2024-04-25T08:46:57.749188+0000","last_unstale":"2024-04-25T08:46:58.815885+0000","last_undegraded":"2024-04-25T08:46:58.815885+0000","last_fullsized":"2024-04-25T08:46:58.815885+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:39.399037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.723907+0000","last_change":"2024-04-25T08:46:56.716040+0000","last_active":"2024-04-25T08:46:58.723907+0000","last_peered":"2024-04-25T08:46:58.723907+0000","last_clean":"2024-04-25T08:46:58.723907+0000","last_became_active":"2024-04-25T08:46:56.715756+0000","last_became_peered":"2024-04-25T08:46:56.715756+0000","last_unstale":"2024-04-25T08:46:58.723907+0000","last_undegraded":"2024-04-25T08:46:58.723907+0000","last_fullsized":"2024-04-25T08:46:58.723907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:38.648803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725238+0000","last_change":"2024-04-25T08:46:57.736923+0000","last_active":"2024-04-25T08:46:58.725238+0000","last_peered":"2024-04-25T08:46:58.725238+0000","last_clean":"2024-04-25T08:46:58.725238+0000","last_became_active":"2024-04-25T08:46:57.736642+0000","last_became_peered":"2024-04-25T08:46:57.736642+0000","last_unstale":"2024-04-25T08:46:58.725238+0000","last_undegraded":"2024-04-25T08:46:58.725238+0000","last_fullsized":"2024-04-25T08:46:58.725238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.249964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815517+0000","last_change":"2024-04-25T08:46:56.716582+0000","last_active":"2024-04-25T08:46:58.815517+0000","last_peered":"2024-04-25T08:46:58.815517+0000","last_clean":"2024-04-25T08:46:58.815517+0000","last_became_active":"2024-04-25T08:46:56.715623+0000","last_became_peered":"2024-04-25T08:46:56.715623+0000","last_unstale":"2024-04-25T08:46:58.815517+0000","last_undegraded":"2024-04-25T08:46:58.815517+0000","last_fullsized":"2024-04-25T08:46:58.815517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:22.233368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815824+0000","last_change":"2024-04-25T08:46:56.712775+0000","last_active":"2024-04-25T08:46:58.815824+0000","last_peered":"2024-04-25T08:46:58.815824+0000","last_clean":"2024-04-25T08:46:58.815824+0000","last_became_active":"2024-04-25T08:46:56.712444+0000","last_became_peered":"2024-04-25T08:46:56.712444+0000","last_unstale":"2024-04-25T08:46:58.815824+0000","last_undegraded":"2024-04-25T08:46:58.815824+0000","last_fullsized":"2024-04-25T08:46:58.815824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.460375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815270+0000","last_change":"2024-04-25T08:46:57.745023+0000","last_active":"2024-04-25T08:46:58.815270+0000","last_peered":"2024-04-25T08:46:58.815270+0000","last_clean":"2024-04-25T08:46:58.815270+0000","last_became_active":"2024-04-25T08:46:57.744756+0000","last_became_peered":"2024-04-25T08:46:57.744756+0000","last_unstale":"2024-04-25T08:46:58.815270+0000","last_undegraded":"2024-04-25T08:46:58.815270+0000","last_fullsized":"2024-04-25T08:46:58.815270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704057+0000","last_change":"2024-04-25T08:46:55.704057+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704057+0000","last_undegraded":"2024-04-25T08:46:55.704057+0000","last_fullsized":"2024-04-25T08:46:55.704057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.723978+0000","last_change":"2024-04-25T08:46:57.734433+0000","last_active":"2024-04-25T08:46:58.723978+0000","last_peered":"2024-04-25T08:46:58.723978+0000","last_clean":"2024-04-25T08:46:58.723978+0000","last_became_active":"2024-04-25T08:46:57.733784+0000","last_became_peered":"2024-04-25T08:46:57.733784+0000","last_unstale":"2024-04-25T08:46:58.723978+0000","last_undegraded":"2024-04-25T08:46:58.723978+0000","last_fullsized":"2024-04-25T08:46:58.723978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:09.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724821+0000","last_change":"2024-04-25T08:46:56.716712+0000","last_active":"2024-04-25T08:46:58.724821+0000","last_peered":"2024-04-25T08:46:58.724821+0000","last_clean":"2024-04-25T08:46:58.724821+0000","last_became_active":"2024-04-25T08:46:56.716458+0000","last_became_peered":"2024-04-25T08:46:56.716458+0000","last_unstale":"2024-04-25T08:46:58.724821+0000","last_undegraded":"2024-04-25T08:46:58.724821+0000","last_fullsized":"2024-04-25T08:46:58.724821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:29.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816109+0000","last_change":"2024-04-25T08:46:57.731222+0000","last_active":"2024-04-25T08:46:58.816109+0000","last_peered":"2024-04-25T08:46:58.816109+0000","last_clean":"2024-04-25T08:46:58.816109+0000","last_became_active":"2024-04-25T08:46:57.730957+0000","last_became_peered":"2024-04-25T08:46:57.730957+0000","last_unstale":"2024-04-25T08:46:58.816109+0000","last_undegraded":"2024-04-25T08:46:58.816109+0000","last_fullsized":"2024-04-25T08:46:58.816109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:21.844424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816667+0000","last_change":"2024-04-25T08:46:56.718059+0000","last_active":"2024-04-25T08:46:58.816667+0000","last_peered":"2024-04-25T08:46:58.816667+0000","last_clean":"2024-04-25T08:46:58.816667+0000","last_became_active":"2024-04-25T08:46:56.717753+0000","last_became_peered":"2024-04-25T08:46:56.717753+0000","last_unstale":"2024-04-25T08:46:58.816667+0000","last_undegraded":"2024-04-25T08:46:58.816667+0000","last_fullsized":"2024-04-25T08:46:58.816667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:44.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725106+0000","last_change":"2024-04-25T08:46:57.733968+0000","last_active":"2024-04-25T08:46:58.725106+0000","last_peered":"2024-04-25T08:46:58.725106+0000","last_clean":"2024-04-25T08:46:58.725106+0000","last_became_active":"2024-04-25T08:46:57.733726+0000","last_became_peered":"2024-04-25T08:46:57.733726+0000","last_unstale":"2024-04-25T08:46:58.725106+0000","last_undegraded":"2024-04-25T08:46:58.725106+0000","last_fullsized":"2024-04-25T08:46:58.725106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.700618+0000","last_change":"2024-04-25T08:46:55.700618+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.700618+0000","last_undegraded":"2024-04-25T08:46:55.700618+0000","last_fullsized":"2024-04-25T08:46:55.700618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724430+0000","last_change":"2024-04-25T08:46:57.737605+0000","last_active":"2024-04-25T08:46:58.724430+0000","last_peered":"2024-04-25T08:46:58.724430+0000","last_clean":"2024-04-25T08:46:58.724430+0000","last_became_active":"2024-04-25T08:46:57.737151+0000","last_became_peered":"2024-04-25T08:46:57.737151+0000","last_unstale":"2024-04-25T08:46:58.724430+0000","last_undegraded":"2024-04-25T08:46:58.724430+0000","last_fullsized":"2024-04-25T08:46:58.724430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:16.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724038+0000","last_change":"2024-04-25T08:46:56.711797+0000","last_active":"2024-04-25T08:46:58.724038+0000","last_peered":"2024-04-25T08:46:58.724038+0000","last_clean":"2024-04-25T08:46:58.724038+0000","last_became_active":"2024-04-25T08:46:56.711502+0000","last_became_peered":"2024-04-25T08:46:56.711502+0000","last_unstale":"2024-04-25T08:46:58.724038+0000","last_undegraded":"2024-04-25T08:46:58.724038+0000","last_fullsized":"2024-04-25T08:46:58.724038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:36.752145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704371+0000","last_change":"2024-04-25T08:46:55.704371+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704371+0000","last_undegraded":"2024-04-25T08:46:55.704371+0000","last_fullsized":"2024-04-25T08:46:55.704371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816130+0000","last_change":"2024-04-25T08:46:56.719424+0000","last_active":"2024-04-25T08:46:58.816130+0000","last_peered":"2024-04-25T08:46:58.816130+0000","last_clean":"2024-04-25T08:46:58.816130+0000","last_became_active":"2024-04-25T08:46:56.718888+0000","last_became_peered":"2024-04-25T08:46:56.718888+0000","last_unstale":"2024-04-25T08:46:58.816130+0000","last_undegraded":"2024-04-25T08:46:58.816130+0000","last_fullsized":"2024-04-25T08:46:58.816130+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:33.465219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816826+0000","last_change":"2024-04-25T08:46:56.720535+0000","last_active":"2024-04-25T08:46:58.816826+0000","last_peered":"2024-04-25T08:46:58.816826+0000","last_clean":"2024-04-25T08:46:58.816826+0000","last_became_active":"2024-04-25T08:46:56.720261+0000","last_became_peered":"2024-04-25T08:46:56.720261+0000","last_unstale":"2024-04-25T08:46:58.816826+0000","last_undegraded":"2024-04-25T08:46:58.816826+0000","last_fullsized":"2024-04-25T08:46:58.816826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:51.425671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815216+0000","last_change":"2024-04-25T08:46:57.751224+0000","last_active":"2024-04-25T08:46:58.815216+0000","last_peered":"2024-04-25T08:46:58.815216+0000","last_clean":"2024-04-25T08:46:58.815216+0000","last_became_active":"2024-04-25T08:46:57.750992+0000","last_became_peered":"2024-04-25T08:46:57.750992+0000","last_unstale":"2024-04-25T08:46:58.815216+0000","last_undegraded":"2024-04-25T08:46:58.815216+0000","last_fullsized":"2024-04-25T08:46:58.815216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.872215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.703575+0000","last_change":"2024-04-25T08:46:55.703575+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.703575+0000","last_undegraded":"2024-04-25T08:46:55.703575+0000","last_fullsized":"2024-04-25T08:46:55.703575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816051+0000","last_change":"2024-04-25T08:46:57.754454+0000","last_active":"2024-04-25T08:46:58.816051+0000","last_peered":"2024-04-25T08:46:58.816051+0000","last_clean":"2024-04-25T08:46:58.816051+0000","last_became_active":"2024-04-25T08:46:57.754033+0000","last_became_peered":"2024-04-25T08:46:57.754033+0000","last_unstale":"2024-04-25T08:46:58.816051+0000","last_undegraded":"2024-04-25T08:46:58.816051+0000","last_fullsized":"2024-04-25T08:46:58.816051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:03.517427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725191+0000","last_change":"2024-04-25T08:46:56.717064+0000","last_active":"2024-04-25T08:46:58.725191+0000","last_peered":"2024-04-25T08:46:58.725191+0000","last_clean":"2024-04-25T08:46:58.725191+0000","last_became_active":"2024-04-25T08:46:56.716743+0000","last_became_peered":"2024-04-25T08:46:56.716743+0000","last_unstale":"2024-04-25T08:46:58.725191+0000","last_undegraded":"2024-04-25T08:46:58.725191+0000","last_fullsized":"2024-04-25T08:46:58.725191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:21.811205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816271+0000","last_change":"2024-04-25T08:46:57.754149+0000","last_active":"2024-04-25T08:46:58.816271+0000","last_peered":"2024-04-25T08:46:58.816271+0000","last_clean":"2024-04-25T08:46:58.816271+0000","last_became_active":"2024-04-25T08:46:57.753872+0000","last_became_peered":"2024-04-25T08:46:57.753872+0000","last_unstale":"2024-04-25T08:46:58.816271+0000","last_undegraded":"2024-04-25T08:46:58.816271+0000","last_fullsized":"2024-04-25T08:46:58.816271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.599459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816754+0000","last_change":"2024-04-25T08:46:56.711294+0000","last_active":"2024-04-25T08:46:58.816754+0000","last_peered":"2024-04-25T08:46:58.816754+0000","last_clean":"2024-04-25T08:46:58.816754+0000","last_became_active":"2024-04-25T08:46:56.710929+0000","last_became_peered":"2024-04-25T08:46:56.710929+0000","last_unstale":"2024-04-25T08:46:58.816754+0000","last_undegraded":"2024-04-25T08:46:58.816754+0000","last_fullsized":"2024-04-25T08:46:58.816754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:15.137332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815873+0000","last_change":"2024-04-25T08:46:57.750015+0000","last_active":"2024-04-25T08:46:58.815873+0000","last_peered":"2024-04-25T08:46:58.815873+0000","last_clean":"2024-04-25T08:46:58.815873+0000","last_became_active":"2024-04-25T08:46:57.749748+0000","last_became_peered":"2024-04-25T08:46:57.749748+0000","last_unstale":"2024-04-25T08:46:58.815873+0000","last_undegraded":"2024-04-25T08:46:58.815873+0000","last_fullsized":"2024-04-25T08:46:58.815873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:40.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725139+0000","last_change":"2024-04-25T08:46:56.709724+0000","last_active":"2024-04-25T08:46:58.725139+0000","last_peered":"2024-04-25T08:46:58.725139+0000","last_clean":"2024-04-25T08:46:58.725139+0000","last_became_active":"2024-04-25T08:46:56.709479+0000","last_became_peered":"2024-04-25T08:46:56.709479+0000","last_unstale":"2024-04-25T08:46:58.725139+0000","last_undegraded":"2024-04-25T08:46:58.725139+0000","last_fullsized":"2024-04-25T08:46:58.725139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:48.796813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816653+0000","last_change":"2024-04-25T08:46:57.742949+0000","last_active":"2024-04-25T08:46:58.816653+0000","last_peered":"2024-04-25T08:46:58.816653+0000","last_clean":"2024-04-25T08:46:58.816653+0000","last_became_active":"2024-04-25T08:46:57.742695+0000","last_became_peered":"2024-04-25T08:46:57.742695+0000","last_unstale":"2024-04-25T08:46:58.816653+0000","last_undegraded":"2024-04-25T08:46:58.816653+0000","last_fullsized":"2024-04-25T08:46:58.816653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815962+0000","last_change":"2024-04-25T08:46:56.720535+0000","last_active":"2024-04-25T08:46:58.815962+0000","last_peered":"2024-04-25T08:46:58.815962+0000","last_clean":"2024-04-25T08:46:58.815962+0000","last_became_active":"2024-04-25T08:46:56.720274+0000","last_became_peered":"2024-04-25T08:46:56.720274+0000","last_unstale":"2024-04-25T08:46:58.815962+0000","last_undegraded":"2024-04-25T08:46:58.815962+0000","last_fullsized":"2024-04-25T08:46:58.815962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:07.975454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816821+0000","last_change":"2024-04-25T08:46:57.736236+0000","last_active":"2024-04-25T08:46:58.816821+0000","last_peered":"2024-04-25T08:46:58.816821+0000","last_clean":"2024-04-25T08:46:58.816821+0000","last_became_active":"2024-04-25T08:46:57.735060+0000","last_became_peered":"2024-04-25T08:46:57.735060+0000","last_unstale":"2024-04-25T08:46:58.816821+0000","last_undegraded":"2024-04-25T08:46:58.816821+0000","last_fullsized":"2024-04-25T08:46:58.816821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:40.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815674+0000","last_change":"2024-04-25T08:46:56.718380+0000","last_active":"2024-04-25T08:46:58.815674+0000","last_peered":"2024-04-25T08:46:58.815674+0000","last_clean":"2024-04-25T08:46:58.815674+0000","last_became_active":"2024-04-25T08:46:56.717887+0000","last_became_peered":"2024-04-25T08:46:56.717887+0000","last_unstale":"2024-04-25T08:46:58.815674+0000","last_undegraded":"2024-04-25T08:46:58.815674+0000","last_fullsized":"2024-04-25T08:46:58.815674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:08.545923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815353+0000","last_change":"2024-04-25T08:46:56.717331+0000","last_active":"2024-04-25T08:46:58.815353+0000","last_peered":"2024-04-25T08:46:58.815353+0000","last_clean":"2024-04-25T08:46:58.815353+0000","last_became_active":"2024-04-25T08:46:56.716965+0000","last_became_peered":"2024-04-25T08:46:56.716965+0000","last_unstale":"2024-04-25T08:46:58.815353+0000","last_undegraded":"2024-04-25T08:46:58.815353+0000","last_fullsized":"2024-04-25T08:46:58.815353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:51.465906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724909+0000","last_change":"2024-04-25T08:46:57.739952+0000","last_active":"2024-04-25T08:46:58.724909+0000","last_peered":"2024-04-25T08:46:58.724909+0000","last_clean":"2024-04-25T08:46:58.724909+0000","last_became_active":"2024-04-25T08:46:57.739588+0000","last_became_peered":"2024-04-25T08:46:57.739588+0000","last_unstale":"2024-04-25T08:46:58.724909+0000","last_undegraded":"2024-04-25T08:46:58.724909+0000","last_fullsized":"2024-04-25T08:46:58.724909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:25.805809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724054+0000","last_change":"2024-04-25T08:46:56.714869+0000","last_active":"2024-04-25T08:46:58.724054+0000","last_peered":"2024-04-25T08:46:58.724054+0000","last_clean":"2024-04-25T08:46:58.724054+0000","last_became_active":"2024-04-25T08:46:56.714573+0000","last_became_peered":"2024-04-25T08:46:56.714573+0000","last_unstale":"2024-04-25T08:46:58.724054+0000","last_undegraded":"2024-04-25T08:46:58.724054+0000","last_fullsized":"2024-04-25T08:46:58.724054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:25.662938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:59.725301+0000","last_change":"2024-04-25T08:46:56.714486+0000","last_active":"2024-04-25T08:46:59.725301+0000","last_peered":"2024-04-25T08:46:59.725301+0000","last_clean":"2024-04-25T08:46:59.725301+0000","last_became_active":"2024-04-25T08:46:56.714227+0000","last_became_peered":"2024-04-25T08:46:56.714227+0000","last_unstale":"2024-04-25T08:46:59.725301+0000","last_undegraded":"2024-04-25T08:46:59.725301+0000","last_fullsized":"2024-04-25T08:46:59.725301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:03.785847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725238+0000","last_change":"2024-04-25T08:46:57.739412+0000","last_active":"2024-04-25T08:46:58.725238+0000","last_peered":"2024-04-25T08:46:58.725238+0000","last_clean":"2024-04-25T08:46:58.725238+0000","last_became_active":"2024-04-25T08:46:57.736752+0000","last_became_peered":"2024-04-25T08:46:57.736752+0000","last_unstale":"2024-04-25T08:46:58.725238+0000","last_undegraded":"2024-04-25T08:46:58.725238+0000","last_fullsized":"2024-04-25T08:46:58.725238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704641+0000","last_change":"2024-04-25T08:46:55.704641+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704641+0000","last_undegraded":"2024-04-25T08:46:55.704641+0000","last_fullsized":"2024-04-25T08:46:55.704641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816412+0000","last_change":"2024-04-25T08:46:57.744908+0000","last_active":"2024-04-25T08:46:58.816412+0000","last_peered":"2024-04-25T08:46:58.816412+0000","last_clean":"2024-04-25T08:46:58.816412+0000","last_became_active":"2024-04-25T08:46:57.744655+0000","last_became_peered":"2024-04-25T08:46:57.744655+0000","last_unstale":"2024-04-25T08:46:58.816412+0000","last_undegraded":"2024-04-25T08:46:58.816412+0000","last_fullsized":"2024-04-25T08:46:58.816412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:34.197715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.703337+0000","last_change":"2024-04-25T08:46:55.703337+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.703337+0000","last_undegraded":"2024-04-25T08:46:55.703337+0000","last_fullsized":"2024-04-25T08:46:55.703337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.700416+0000","last_change":"2024-04-25T08:46:55.700416+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.700416+0000","last_undegraded":"2024-04-25T08:46:55.700416+0000","last_fullsized":"2024-04-25T08:46:55.700416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816439+0000","last_change":"2024-04-25T08:46:56.719242+0000","last_active":"2024-04-25T08:46:58.816439+0000","last_peered":"2024-04-25T08:46:58.816439+0000","last_clean":"2024-04-25T08:46:58.816439+0000","last_became_active":"2024-04-25T08:46:56.719000+0000","last_became_peered":"2024-04-25T08:46:56.719000+0000","last_unstale":"2024-04-25T08:46:58.816439+0000","last_undegraded":"2024-04-25T08:46:58.816439+0000","last_fullsized":"2024-04-25T08:46:58.816439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:34.859908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725338+0000","last_change":"2024-04-25T08:46:57.734806+0000","last_active":"2024-04-25T08:46:58.725338+0000","last_peered":"2024-04-25T08:46:58.725338+0000","last_clean":"2024-04-25T08:46:58.725338+0000","last_became_active":"2024-04-25T08:46:57.734533+0000","last_became_peered":"2024-04-25T08:46:57.734533+0000","last_unstale":"2024-04-25T08:46:58.725338+0000","last_undegraded":"2024-04-25T08:46:58.725338+0000","last_fullsized":"2024-04-25T08:46:58.725338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:51.496043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.701349+0000","last_change":"2024-04-25T08:46:55.701349+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.701349+0000","last_undegraded":"2024-04-25T08:46:55.701349+0000","last_fullsized":"2024-04-25T08:46:55.701349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725351+0000","last_change":"2024-04-25T08:46:57.741952+0000","last_active":"2024-04-25T08:46:58.725351+0000","last_peered":"2024-04-25T08:46:58.725351+0000","last_clean":"2024-04-25T08:46:58.725351+0000","last_became_active":"2024-04-25T08:46:57.741689+0000","last_became_peered":"2024-04-25T08:46:57.741689+0000","last_unstale":"2024-04-25T08:46:58.725351+0000","last_undegraded":"2024-04-25T08:46:58.725351+0000","last_fullsized":"2024-04-25T08:46:58.725351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:30.852428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725011+0000","last_change":"2024-04-25T08:46:56.716730+0000","last_active":"2024-04-25T08:46:58.725011+0000","last_peered":"2024-04-25T08:46:58.725011+0000","last_clean":"2024-04-25T08:46:58.725011+0000","last_became_active":"2024-04-25T08:46:56.716477+0000","last_became_peered":"2024-04-25T08:46:56.716477+0000","last_unstale":"2024-04-25T08:46:58.725011+0000","last_undegraded":"2024-04-25T08:46:58.725011+0000","last_fullsized":"2024-04-25T08:46:58.725011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:40.418688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815970+0000","last_change":"2024-04-25T08:46:56.721484+0000","last_active":"2024-04-25T08:46:58.815970+0000","last_peered":"2024-04-25T08:46:58.815970+0000","last_clean":"2024-04-25T08:46:58.815970+0000","last_became_active":"2024-04-25T08:46:56.721115+0000","last_became_peered":"2024-04-25T08:46:56.721115+0000","last_unstale":"2024-04-25T08:46:58.815970+0000","last_undegraded":"2024-04-25T08:46:58.815970+0000","last_fullsized":"2024-04-25T08:46:58.815970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:20.574350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-25T08:46:55.705281+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:46:55.705281+0000","last_peered":"2024-04-25T08:46:55.705281+0000","last_clean":"2024-04-25T08:46:55.705281+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:46:55.705281+0000","last_undegraded":"2024-04-25T08:46:55.705281+0000","last_fullsized":"2024-04-25T08:46:55.705281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36852,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334988,"statfs":{"total":96636764160,"available":96599027712,"internally_reserved":0,"allocated":1548288,"data_stored":1027011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":954368,"data_stored":436643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":995328,"data_stored":457203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1011712,"data_stored":458885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":995328,"data_stored":457751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":457911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":457281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1585152,"data_stored":1047537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:47:01.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2024-04-25T08:47:01.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.704223+0000', 'last_change': '2024-04-25T08:46:55.704223+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.704223+0000', 'last_undegraded': '2024-04-25T08:46:55.704223+0000', 'last_fullsized': '2024-04-25T08:46:55.704223+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.705046+0000', 'last_change': '2024-04-25T08:46:55.705046+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.705046+0000', 'last_undegraded': '2024-04-25T08:46:55.705046+0000', 'last_fullsized': '2024-04-25T08:46:55.705046+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.701079+0000', 'last_change': '2024-04-25T08:46:55.701079+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.701079+0000', 'last_undegraded': '2024-04-25T08:46:55.701079+0000', 'last_fullsized': '2024-04-25T08:46:55.701079+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.704057+0000', 'last_change': '2024-04-25T08:46:55.704057+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.704057+0000', 'last_undegraded': '2024-04-25T08:46:55.704057+0000', 'last_fullsized': '2024-04-25T08:46:55.704057+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.700618+0000', 'last_change': '2024-04-25T08:46:55.700618+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.700618+0000', 'last_undegraded': '2024-04-25T08:46:55.700618+0000', 'last_fullsized': '2024-04-25T08:46:55.700618+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2024-04-25T08:47:01.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.704371+0000', 'last_change': '2024-04-25T08:46:55.704371+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.704371+0000', 'last_undegraded': '2024-04-25T08:46:55.704371+0000', 'last_fullsized': '2024-04-25T08:46:55.704371+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.703575+0000', 'last_change': '2024-04-25T08:46:55.703575+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.703575+0000', 'last_undegraded': '2024-04-25T08:46:55.703575+0000', 'last_fullsized': '2024-04-25T08:46:55.703575+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2024-04-25T08:47:01.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.704641+0000', 'last_change': '2024-04-25T08:46:55.704641+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.704641+0000', 'last_undegraded': '2024-04-25T08:46:55.704641+0000', 'last_fullsized': '2024-04-25T08:46:55.704641+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.703337+0000', 'last_change': '2024-04-25T08:46:55.703337+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.703337+0000', 'last_undegraded': '2024-04-25T08:46:55.703337+0000', 'last_fullsized': '2024-04-25T08:46:55.703337+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.700416+0000', 'last_change': '2024-04-25T08:46:55.700416+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.700416+0000', 'last_undegraded': '2024-04-25T08:46:55.700416+0000', 'last_fullsized': '2024-04-25T08:46:55.700416+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:46:55.701349+0000', 'last_change': '2024-04-25T08:46:55.701349+0000', 'last_active': '2024-04-25T08:46:55.695394+0000', 'last_peered': '2024-04-25T08:46:55.695394+0000', 'last_clean': '2024-04-25T08:46:55.695394+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:55.701349+0000', 'last_undegraded': '2024-04-25T08:46:55.701349+0000', 'last_fullsized': '2024-04-25T08:46:55.701349+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:55.695394+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:47:01.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2024-04-25T08:47:01.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:46:56.697365+0000', 'last_change': '2024-04-25T08:46:56.697365+0000', 'last_active': '2024-04-25T08:46:56.697365+0000', 'last_peered': '2024-04-25T08:46:56.697365+0000', 'last_clean': '2024-04-25T08:46:56.697365+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:46:56.697365+0000', 'last_undegraded': '2024-04-25T08:46:56.697365+0000', 'last_fullsized': '2024-04-25T08:46:56.697365+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'last_clean_scrub_stamp': '2024-04-25T08:46:56.697365+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:47:01.365 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:47:01.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.502+0000 7f77514e2640 1 Processor -- start 2024-04-25T08:47:01.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.502+0000 7f77514e2640 1 -- start start 2024-04-25T08:47:01.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.503+0000 7f77514e2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f774c15ba00 0x7f774c09a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.503+0000 7f77514e2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c0cd710 con 0x7f774c1602e0 2024-04-25T08:47:01.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.503+0000 7f77514e2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f774c099b70 con 0x7f774c15f5f0 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.503+0000 7f77514e2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774c0cd4b0 con 0x7f774c15ba00 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.503+0000 7f774a7fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f774c1602e0 0x7f774c0ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46578/0 (socket says 172.21.15.172:46578) 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.503+0000 7f774a7fc640 1 -- 172.21.15.172:0/2245135518 learned_addr learned my addr 172.21.15.172:0/2245135518 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.503+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595293316 0 0) 0x7f7740001110 con 0x7f774c1602e0 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.503+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7734003520 con 0x7f774c1602e0 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.503+0000 7f774affd640 1 --2- 172.21.15.172:0/2245135518 >> v2:172.21.15.186:3300/0 conn(0x7f774c15ba00 0x7f774c09a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.503+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2669939460 0 0) 0x7f7734003520 con 0x7f774c1602e0 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 >> v2:172.21.15.186:3300/0 conn(0x7f774c15ba00 msgr2=0x7f774c09a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 --2- 172.21.15.172:0/2245135518 >> v2:172.21.15.186:3300/0 conn(0x7f774c15ba00 0x7f774c09a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 >> v1:172.21.15.186:6789/0 conn(0x7f774c15f5f0 legacy=0x7f774c0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c099e50 con 0x7f774c1602e0 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f7740001840 con 0x7f774c1602e0 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 >> v1:172.21.15.172:6789/0 conn(0x7f774c1602e0 legacy=0x7f774c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77340039b0 0x7f7734003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7734004800 0x7f7734004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340052e0 0x7f773400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c0cd4b0 con 0x7f77340039b0 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773400c1b0 con 0x7f7734004800 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773400c3b0 con 0x7f77340052e0 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f774affd640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77340039b0 0x7f7734003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f774a7fc640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7734004800 0x7f7734004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f774b7fe640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340052e0 0x7f773400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f774affd640 1 -- 172.21.15.172:0/2245135518 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340052e0 msgr2=0x7f773400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f774affd640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340052e0 0x7f773400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f774affd640 1 -- 172.21.15.172:0/2245135518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7734004800 msgr2=0x7f7734004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f774affd640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7734004800 0x7f7734004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f774affd640 1 -- 172.21.15.172:0/2245135518 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734003520 con 0x7f77340039b0 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f774b7fe640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340052e0 0x7f773400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.504+0000 7f774b7fe640 1 -- 172.21.15.172:0/2245135518 reap_dead start 2024-04-25T08:47:01.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f774affd640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77340039b0 0x7f7734003dd0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f773c009a90 tx=0x7f7734005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4886735dc665ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:01.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c036070 con 0x7f77340039b0 2024-04-25T08:47:01.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c031400 con 0x7f77340039b0 2024-04-25T08:47:01.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f7749ffb640 1 -- 172.21.15.172:0/2245135518 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c009690 con 0x7f77340039b0 2024-04-25T08:47:01.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f77514e2640 1 -- 172.21.15.172:0/2245135518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77340039b0 msgr2=0x7f7734003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f77514e2640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77340039b0 0x7f7734003dd0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f773c009a90 tx=0x7f7734005830 comp rx=0 tx=0).stop 2024-04-25T08:47:01.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f77514e2640 1 -- 172.21.15.172:0/2245135518 shutdown_connections 2024-04-25T08:47:01.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f77514e2640 1 --2- 172.21.15.172:0/2245135518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77340039b0 0x7f7734003dd0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f77514e2640 1 -- 172.21.15.172:0/2245135518 >> 172.21.15.172:0/2245135518 conn(0x7f774c0b3270 msgr2=0x7f774c0b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:01.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f77514e2640 1 -- 172.21.15.172:0/2245135518 shutdown_connections 2024-04-25T08:47:01.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.505+0000 7f77514e2640 1 -- 172.21.15.172:0/2245135518 wait complete. 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f77514e2640 1 Processor -- start 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f77514e2640 1 -- start start 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f77514e2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340039b0 0x7f774c14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f77514e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f774c0c5c90 0x7f774c0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f77514e2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f774c0b4560 0x7f774c0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f77514e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c15bde0 con 0x7f774c0c5c90 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f77514e2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774c15fa40 con 0x7f774c0b4560 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f77514e2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774c15cd90 con 0x7f77340039b0 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f774a7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f774c0c5c90 0x7f774c0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f774a7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f774c0c5c90 0x7f774c0c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33892/0 (socket says 172.21.15.172:33892) 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.507+0000 7f774a7fc640 1 -- 172.21.15.172:0/2336789203 learned_addr learned my addr 172.21.15.172:0/2336789203 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f774affd640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340039b0 0x7f774c14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f774a7fc640 1 -- 172.21.15.172:0/2336789203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340039b0 msgr2=0x7f774c14ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f774b7fe640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f774c0b4560 0x7f774c0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f774a7fc640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340039b0 0x7f774c14ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f774a7fc640 1 -- 172.21.15.172:0/2336789203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f774c0b4560 msgr2=0x7f774c0b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f774a7fc640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f774c0b4560 0x7f774c0b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f774a7fc640 1 -- 172.21.15.172:0/2336789203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c15ca40 con 0x7f774c0c5c90 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f774a7fc640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f774c0c5c90 0x7f774c0c6110 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f7740007340 tx=0x7f7740007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f77337fe640 1 -- 172.21.15.172:0/2336789203 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774000f940 con 0x7f774c0c5c90 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f77337fe640 1 -- 172.21.15.172:0/2336789203 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740018070 con 0x7f774c0c5c90 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f77514e2640 1 -- 172.21.15.172:0/2336789203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f774c0c6710 con 0x7f774c0c5c90 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f77337fe640 1 -- 172.21.15.172:0/2336789203 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774000fd60 con 0x7f774c0c5c90 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.508+0000 7f77514e2640 1 -- 172.21.15.172:0/2336789203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f774c156e40 con 0x7f774c0c5c90 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.509+0000 7f77514e2640 1 -- 172.21.15.172:0/2336789203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774c073990 con 0x7f774c0c5c90 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.509+0000 7f77337fe640 1 -- 172.21.15.172:0/2336789203 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f774001d460 con 0x7f774c0c5c90 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.510+0000 7f77337fe640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f773806b4d0 0x7f773806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.510+0000 7f77337fe640 1 -- 172.21.15.172:0/2336789203 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f774008a3e0 con 0x7f774c0c5c90 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.510+0000 7f774affd640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f773806b4d0 0x7f773806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.510+0000 7f774affd640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f773806b4d0 0x7f773806d990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f773c033000 tx=0x7f773c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:01.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.514+0000 7f77337fe640 1 -- 172.21.15.172:0/2336789203 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f774c0cd710 con 0x7f774c0c5c90 2024-04-25T08:47:01.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.751+0000 7f77514e2640 1 -- 172.21.15.172:0/2336789203 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f774c0b40a0 con 0x7f774c0c5c90 2024-04-25T08:47:01.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.752+0000 7f77337fe640 1 -- 172.21.15.172:0/2336789203 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1724 (secure 0 0 0) 0x7f77400590d0 con 0x7f774c0c5c90 2024-04-25T08:47:01.743 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:47:01.743 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":297,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":71},{"state_name":"unknown","count":15},{"state_name":"creating+peering","count":11}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":591144,"bytes_used":298631168,"bytes_avail":772795482112,"bytes_total":773094113280,"unknown_pgs_ratio":0.15463916957378387,"inactive_pgs_ratio":0.11340206116437912,"write_bytes_sec":2103,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":49,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":7224}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-04-25T08:46:40.564800+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:47:01.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 -- 172.21.15.172:0/2336789203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f773806b4d0 msgr2=0x7f773806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f773806b4d0 0x7f773806d990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f773c033000 tx=0x7f773c008030 comp rx=0 tx=0).stop 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 -- 172.21.15.172:0/2336789203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f774c0c5c90 msgr2=0x7f774c0c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f774c0c5c90 0x7f774c0c6110 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f7740007340 tx=0x7f7740007800 comp rx=0 tx=0).stop 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 -- 172.21.15.172:0/2336789203 shutdown_connections 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f773806b4d0 0x7f773806d990 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f774c0b4560 0x7f774c0b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f774c0c5c90 0x7f774c0c6110 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 --2- 172.21.15.172:0/2336789203 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77340039b0 0x7f774c14ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 -- 172.21.15.172:0/2336789203 >> 172.21.15.172:0/2336789203 conn(0x7f774c0b3270 msgr2=0x7f774c06c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 -- 172.21.15.172:0/2336789203 shutdown_connections 2024-04-25T08:47:01.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.754+0000 7f77514e2640 1 -- 172.21.15.172:0/2336789203 wait complete. 2024-04-25T08:47:01.757 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:47:01.757 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:47:01.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.863+0000 7f6b27815640 1 Processor -- start 2024-04-25T08:47:01.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.863+0000 7f6b27815640 1 -- start start 2024-04-25T08:47:01.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b27815640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 0x7f6b200ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b27815640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6b200ce700 0x7f6b2006c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b27815640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b200c8030 con 0x7f6b2015da70 2024-04-25T08:47:01.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b27815640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b200ceb50 con 0x7f6b200ce700 2024-04-25T08:47:01.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b27815640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200c8310 con 0x7f6b200d0170 2024-04-25T08:47:01.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b24db0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 0x7f6b200ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b25db2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6b200ce700 0x7f6b2006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b24db0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 0x7f6b200ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:45868/0 (socket says 172.21.15.172:45868) 2024-04-25T08:47:01.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b24db0640 1 -- 172.21.15.172:0/1108318315 learned_addr learned my addr 172.21.15.172:0/1108318315 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:01.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b255b1640 1 --1- 172.21.15.172:0/1108318315 >> v1:172.21.15.186:6789/0 conn(0x7f6b2015da70 0x7f6b200c7730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:48582/0 (socket says 172.21.15.172:48582) 2024-04-25T08:47:01.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b17fff640 1 -- 172.21.15.172:0/1108318315 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732832216 0 0) 0x7f6b200c8030 con 0x7f6b2015da70 2024-04-25T08:47:01.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b17fff640 1 -- 172.21.15.172:0/1108318315 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b0c003520 con 0x7f6b2015da70 2024-04-25T08:47:01.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b24db0640 1 -- 172.21.15.172:0/1108318315 >> v2:172.21.15.186:3300/0 conn(0x7f6b200ce700 msgr2=0x7f6b2006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:01.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b24db0640 1 --2- 172.21.15.172:0/1108318315 >> v2:172.21.15.186:3300/0 conn(0x7f6b200ce700 0x7f6b2006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b24db0640 1 -- 172.21.15.172:0/1108318315 >> v1:172.21.15.186:6789/0 conn(0x7f6b2015da70 legacy=0x7f6b200c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b24db0640 1 -- 172.21.15.172:0/1108318315 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200c85f0 con 0x7f6b200d0170 2024-04-25T08:47:01.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.864+0000 7f6b25db2640 1 --2- 172.21.15.172:0/1108318315 >> v2:172.21.15.186:3300/0 conn(0x7f6b200ce700 0x7f6b2006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:47:01.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.865+0000 7f6b24db0640 1 --2- 172.21.15.172:0/1108318315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 0x7f6b200ce1c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009870 tx=0x7f6b1002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7fb8a65668e52e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:01.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.865+0000 7f6b17fff640 1 -- 172.21.15.172:0/1108318315 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10037070 con 0x7f6b200d0170 2024-04-25T08:47:01.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.865+0000 7f6b17fff640 1 -- 172.21.15.172:0/1108318315 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10032440 con 0x7f6b200d0170 2024-04-25T08:47:01.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.865+0000 7f6b17fff640 1 -- 172.21.15.172:0/1108318315 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b100327f0 con 0x7f6b200d0170 2024-04-25T08:47:01.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.866+0000 7f6b27815640 1 -- 172.21.15.172:0/1108318315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 msgr2=0x7f6b200ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.866+0000 7f6b27815640 1 --2- 172.21.15.172:0/1108318315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 0x7f6b200ce1c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6b10009870 tx=0x7f6b1002a270 comp rx=0 tx=0).stop 2024-04-25T08:47:01.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.866+0000 7f6b27815640 1 -- 172.21.15.172:0/1108318315 shutdown_connections 2024-04-25T08:47:01.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.866+0000 7f6b27815640 1 --2- 172.21.15.172:0/1108318315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 0x7f6b200ce1c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.866+0000 7f6b27815640 1 --2- 172.21.15.172:0/1108318315 >> v2:172.21.15.186:3300/0 conn(0x7f6b200ce700 0x7f6b2006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.866+0000 7f6b27815640 1 -- 172.21.15.172:0/1108318315 >> 172.21.15.172:0/1108318315 conn(0x7f6b200b33e0 msgr2=0x7f6b200b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:01.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.866+0000 7f6b27815640 1 -- 172.21.15.172:0/1108318315 shutdown_connections 2024-04-25T08:47:01.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.866+0000 7f6b27815640 1 -- 172.21.15.172:0/1108318315 wait complete. 2024-04-25T08:47:01.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.867+0000 7f6b27815640 1 Processor -- start 2024-04-25T08:47:01.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.867+0000 7f6b27815640 1 -- start start 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b27815640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b200ce700 0x7f6b2015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b27815640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 0x7f6b201475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b27815640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b2015da70 0x7f6b2015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b27815640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2015de50 con 0x7f6b200ce700 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b27815640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2006be10 con 0x7f6b2015da70 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b27815640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2006c870 con 0x7f6b200d0170 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b255b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b200ce700 0x7f6b2015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b255b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b200ce700 0x7f6b2015cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33898/0 (socket says 172.21.15.172:33898) 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b255b1640 1 -- 172.21.15.172:0/1550922833 learned_addr learned my addr 172.21.15.172:0/1550922833 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b25db2640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b2015da70 0x7f6b2015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b24db0640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 0x7f6b201475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b255b1640 1 -- 172.21.15.172:0/1550922833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 msgr2=0x7f6b201475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b255b1640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 0x7f6b201475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b255b1640 1 -- 172.21.15.172:0/1550922833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b2015da70 msgr2=0x7f6b2015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b255b1640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b2015da70 0x7f6b2015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.868+0000 7f6b255b1640 1 -- 172.21.15.172:0/1550922833 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2015ed30 con 0x7f6b200ce700 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.869+0000 7f6b255b1640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b200ce700 0x7f6b2015cf10 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800c700 tx=0x7f6b1800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.869+0000 7f6b15ffb640 1 -- 172.21.15.172:0/1550922833 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18017070 con 0x7f6b200ce700 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.869+0000 7f6b15ffb640 1 -- 172.21.15.172:0/1550922833 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b18007070 con 0x7f6b200ce700 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.869+0000 7f6b27815640 1 -- 172.21.15.172:0/1550922833 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2015e490 con 0x7f6b200ce700 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.869+0000 7f6b15ffb640 1 -- 172.21.15.172:0/1550922833 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18007440 con 0x7f6b200ce700 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.869+0000 7f6b27815640 1 -- 172.21.15.172:0/1550922833 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2015ea50 con 0x7f6b200ce700 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.870+0000 7f6b27815640 1 -- 172.21.15.172:0/1550922833 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b20073990 con 0x7f6b200ce700 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.870+0000 7f6b15ffb640 1 -- 172.21.15.172:0/1550922833 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6b1801a070 con 0x7f6b200ce700 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.870+0000 7f6b15ffb640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b0406b4d0 0x7f6b0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.871+0000 7f6b15ffb640 1 -- 172.21.15.172:0/1550922833 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6b18089920 con 0x7f6b200ce700 2024-04-25T08:47:01.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.871+0000 7f6b24db0640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b0406b4d0 0x7f6b0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.871+0000 7f6b24db0640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b0406b4d0 0x7f6b0406d990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6b10034000 tx=0x7f6b1002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:01.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:01.875+0000 7f6b15ffb640 1 -- 172.21.15.172:0/1550922833 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b18057f30 con 0x7f6b200ce700 2024-04-25T08:47:01.976 INFO:tasks.ceph.mds.c.smithi172.stderr:2024-04-25T08:47:01.985+0000 7fe3f4d88640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:47:02.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.041+0000 7f6b27815640 1 -- 172.21.15.172:0/1550922833 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b200b1470 con 0x7f6b0406b4d0 2024-04-25T08:47:02.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.047+0000 7f6b15ffb640 1 -- 172.21.15.172:0/1550922833 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248962 (secure 0 0 0) 0x7f6b200b1470 con 0x7f6b0406b4d0 2024-04-25T08:47:02.040 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:47:02.042 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:47:02.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 -- 172.21.15.172:0/1550922833 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b0406b4d0 msgr2=0x7f6b0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:02.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b0406b4d0 0x7f6b0406d990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6b10034000 tx=0x7f6b1002e000 comp rx=0 tx=0).stop 2024-04-25T08:47:02.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 -- 172.21.15.172:0/1550922833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b200ce700 msgr2=0x7f6b2015cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:02.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b200ce700 0x7f6b2015cf10 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800c700 tx=0x7f6b1800cb00 comp rx=0 tx=0).stop 2024-04-25T08:47:02.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 -- 172.21.15.172:0/1550922833 shutdown_connections 2024-04-25T08:47:02.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6b0406b4d0 0x7f6b0406d990 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:02.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b2015da70 0x7f6b2015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:02.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6b200d0170 0x7f6b201475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:02.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 --2- 172.21.15.172:0/1550922833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b200ce700 0x7f6b2015cf10 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:02.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 -- 172.21.15.172:0/1550922833 >> 172.21.15.172:0/1550922833 conn(0x7f6b200b33e0 msgr2=0x7f6b200b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:02.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 -- 172.21.15.172:0/1550922833 shutdown_connections 2024-04-25T08:47:02.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:02.050+0000 7f6b27815640 1 -- 172.21.15.172:0/1550922833 wait complete. 2024-04-25T08:47:02.052 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-04-25T08:47:00.568379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":291632,"kb_used_data":8880,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754683088,"statfs":{"total":773094113280,"available":772795482112,"internally_reserved":0,"allocated":9093120,"data_stored":4800222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.868639"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816620+0000","last_change":"2024-04-25T08:46:57.748857+0000","last_active":"2024-04-25T08:46:58.816620+0000","last_peered":"2024-04-25T08:46:58.816620+0000","last_clean":"2024-04-25T08:46:58.816620+0000","last_became_active":"2024-04-25T08:46:57.748557+0000","last_became_peered":"2024-04-25T08:46:57.748557+0000","last_unstale":"2024-04-25T08:46:58.816620+0000","last_undegraded":"2024-04-25T08:46:58.816620+0000","last_fullsized":"2024-04-25T08:46:58.816620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.872215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725285+0000","last_change":"2024-04-25T08:46:57.733902+0000","last_active":"2024-04-25T08:46:58.725285+0000","last_peered":"2024-04-25T08:46:58.725285+0000","last_clean":"2024-04-25T08:46:58.725285+0000","last_became_active":"2024-04-25T08:46:57.733591+0000","last_became_peered":"2024-04-25T08:46:57.733591+0000","last_unstale":"2024-04-25T08:46:58.725285+0000","last_undegraded":"2024-04-25T08:46:58.725285+0000","last_fullsized":"2024-04-25T08:46:58.725285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:55.569414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724257+0000","last_change":"2024-04-25T08:46:57.734366+0000","last_active":"2024-04-25T08:46:58.724257+0000","last_peered":"2024-04-25T08:46:58.724257+0000","last_clean":"2024-04-25T08:46:58.724257+0000","last_became_active":"2024-04-25T08:46:57.733738+0000","last_became_peered":"2024-04-25T08:46:57.733738+0000","last_unstale":"2024-04-25T08:46:58.724257+0000","last_undegraded":"2024-04-25T08:46:58.724257+0000","last_fullsized":"2024-04-25T08:46:58.724257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816404+0000","last_change":"2024-04-25T08:46:57.750494+0000","last_active":"2024-04-25T08:46:58.816404+0000","last_peered":"2024-04-25T08:46:58.816404+0000","last_clean":"2024-04-25T08:46:58.816404+0000","last_became_active":"2024-04-25T08:46:57.750234+0000","last_became_peered":"2024-04-25T08:46:57.750234+0000","last_unstale":"2024-04-25T08:46:58.816404+0000","last_undegraded":"2024-04-25T08:46:58.816404+0000","last_fullsized":"2024-04-25T08:46:58.816404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:53.853355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815579+0000","last_change":"2024-04-25T08:46:57.736898+0000","last_active":"2024-04-25T08:46:58.815579+0000","last_peered":"2024-04-25T08:46:58.815579+0000","last_clean":"2024-04-25T08:46:58.815579+0000","last_became_active":"2024-04-25T08:46:57.736617+0000","last_became_peered":"2024-04-25T08:46:57.736617+0000","last_unstale":"2024-04-25T08:46:58.815579+0000","last_undegraded":"2024-04-25T08:46:58.815579+0000","last_fullsized":"2024-04-25T08:46:58.815579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815743+0000","last_change":"2024-04-25T08:46:57.749375+0000","last_active":"2024-04-25T08:46:58.815743+0000","last_peered":"2024-04-25T08:46:58.815743+0000","last_clean":"2024-04-25T08:46:58.815743+0000","last_became_active":"2024-04-25T08:46:57.749039+0000","last_became_peered":"2024-04-25T08:46:57.749039+0000","last_unstale":"2024-04-25T08:46:58.815743+0000","last_undegraded":"2024-04-25T08:46:58.815743+0000","last_fullsized":"2024-04-25T08:46:58.815743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:35.985064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724725+0000","last_change":"2024-04-25T08:46:57.740018+0000","last_active":"2024-04-25T08:46:58.724725+0000","last_peered":"2024-04-25T08:46:58.724725+0000","last_clean":"2024-04-25T08:46:58.724725+0000","last_became_active":"2024-04-25T08:46:57.738781+0000","last_became_peered":"2024-04-25T08:46:57.738781+0000","last_unstale":"2024-04-25T08:46:58.724725+0000","last_undegraded":"2024-04-25T08:46:58.724725+0000","last_fullsized":"2024-04-25T08:46:58.724725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:59.347891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724516+0000","last_change":"2024-04-25T08:46:57.742552+0000","last_active":"2024-04-25T08:46:58.724516+0000","last_peered":"2024-04-25T08:46:58.724516+0000","last_clean":"2024-04-25T08:46:58.724516+0000","last_became_active":"2024-04-25T08:46:57.742253+0000","last_became_peered":"2024-04-25T08:46:57.742253+0000","last_unstale":"2024-04-25T08:46:58.724516+0000","last_undegraded":"2024-04-25T08:46:58.724516+0000","last_fullsized":"2024-04-25T08:46:58.724516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:32.530004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815758+0000","last_change":"2024-04-25T08:46:57.750527+0000","last_active":"2024-04-25T08:46:58.815758+0000","last_peered":"2024-04-25T08:46:58.815758+0000","last_clean":"2024-04-25T08:46:58.815758+0000","last_became_active":"2024-04-25T08:46:57.749570+0000","last_became_peered":"2024-04-25T08:46:57.749570+0000","last_unstale":"2024-04-25T08:46:58.815758+0000","last_undegraded":"2024-04-25T08:46:58.815758+0000","last_fullsized":"2024-04-25T08:46:58.815758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:32.530004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724344+0000","last_change":"2024-04-25T08:46:57.737397+0000","last_active":"2024-04-25T08:46:58.724344+0000","last_peered":"2024-04-25T08:46:58.724344+0000","last_clean":"2024-04-25T08:46:58.724344+0000","last_became_active":"2024-04-25T08:46:57.736776+0000","last_became_peered":"2024-04-25T08:46:57.736776+0000","last_unstale":"2024-04-25T08:46:58.724344+0000","last_undegraded":"2024-04-25T08:46:58.724344+0000","last_fullsized":"2024-04-25T08:46:58.724344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816369+0000","last_change":"2024-04-25T08:46:57.755588+0000","last_active":"2024-04-25T08:46:58.816369+0000","last_peered":"2024-04-25T08:46:58.816369+0000","last_clean":"2024-04-25T08:46:58.816369+0000","last_became_active":"2024-04-25T08:46:57.755324+0000","last_became_peered":"2024-04-25T08:46:57.755324+0000","last_unstale":"2024-04-25T08:46:58.816369+0000","last_undegraded":"2024-04-25T08:46:58.816369+0000","last_fullsized":"2024-04-25T08:46:58.816369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:45.411656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815712+0000","last_change":"2024-04-25T08:46:57.736823+0000","last_active":"2024-04-25T08:46:58.815712+0000","last_peered":"2024-04-25T08:46:58.815712+0000","last_clean":"2024-04-25T08:46:58.815712+0000","last_became_active":"2024-04-25T08:46:57.736547+0000","last_became_peered":"2024-04-25T08:46:57.736547+0000","last_unstale":"2024-04-25T08:46:58.815712+0000","last_undegraded":"2024-04-25T08:46:58.815712+0000","last_fullsized":"2024-04-25T08:46:58.815712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:09.706138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815516+0000","last_change":"2024-04-25T08:46:57.745848+0000","last_active":"2024-04-25T08:46:58.815516+0000","last_peered":"2024-04-25T08:46:58.815516+0000","last_clean":"2024-04-25T08:46:58.815516+0000","last_became_active":"2024-04-25T08:46:57.745243+0000","last_became_peered":"2024-04-25T08:46:57.745243+0000","last_unstale":"2024-04-25T08:46:58.815516+0000","last_undegraded":"2024-04-25T08:46:58.815516+0000","last_fullsized":"2024-04-25T08:46:58.815516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:16.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816601+0000","last_change":"2024-04-25T08:46:57.753708+0000","last_active":"2024-04-25T08:46:58.816601+0000","last_peered":"2024-04-25T08:46:58.816601+0000","last_clean":"2024-04-25T08:46:58.816601+0000","last_became_active":"2024-04-25T08:46:57.753453+0000","last_became_peered":"2024-04-25T08:46:57.753453+0000","last_unstale":"2024-04-25T08:46:58.816601+0000","last_undegraded":"2024-04-25T08:46:58.816601+0000","last_fullsized":"2024-04-25T08:46:58.816601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:32.663123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725290+0000","last_change":"2024-04-25T08:46:57.729860+0000","last_active":"2024-04-25T08:46:58.725290+0000","last_peered":"2024-04-25T08:46:58.725290+0000","last_clean":"2024-04-25T08:46:58.725290+0000","last_became_active":"2024-04-25T08:46:57.729559+0000","last_became_peered":"2024-04-25T08:46:57.729559+0000","last_unstale":"2024-04-25T08:46:58.725290+0000","last_undegraded":"2024-04-25T08:46:58.725290+0000","last_fullsized":"2024-04-25T08:46:58.725290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:56.215702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815923+0000","last_change":"2024-04-25T08:46:57.750649+0000","last_active":"2024-04-25T08:46:58.815923+0000","last_peered":"2024-04-25T08:46:58.815923+0000","last_clean":"2024-04-25T08:46:58.815923+0000","last_became_active":"2024-04-25T08:46:57.750400+0000","last_became_peered":"2024-04-25T08:46:57.750400+0000","last_unstale":"2024-04-25T08:46:58.815923+0000","last_undegraded":"2024-04-25T08:46:58.815923+0000","last_fullsized":"2024-04-25T08:46:58.815923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.377815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815835+0000","last_change":"2024-04-25T08:46:57.747932+0000","last_active":"2024-04-25T08:46:58.815835+0000","last_peered":"2024-04-25T08:46:58.815835+0000","last_clean":"2024-04-25T08:46:58.815835+0000","last_became_active":"2024-04-25T08:46:57.747664+0000","last_became_peered":"2024-04-25T08:46:57.747664+0000","last_unstale":"2024-04-25T08:46:58.815835+0000","last_undegraded":"2024-04-25T08:46:58.815835+0000","last_fullsized":"2024-04-25T08:46:58.815835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.805999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724229+0000","last_change":"2024-04-25T08:46:57.733118+0000","last_active":"2024-04-25T08:46:58.724229+0000","last_peered":"2024-04-25T08:46:58.724229+0000","last_clean":"2024-04-25T08:46:58.724229+0000","last_became_active":"2024-04-25T08:46:57.732601+0000","last_became_peered":"2024-04-25T08:46:57.732601+0000","last_unstale":"2024-04-25T08:46:58.724229+0000","last_undegraded":"2024-04-25T08:46:58.724229+0000","last_fullsized":"2024-04-25T08:46:58.724229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:18.985748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816376+0000","last_change":"2024-04-25T08:46:57.755439+0000","last_active":"2024-04-25T08:46:58.816376+0000","last_peered":"2024-04-25T08:46:58.816376+0000","last_clean":"2024-04-25T08:46:58.816376+0000","last_became_active":"2024-04-25T08:46:57.755165+0000","last_became_peered":"2024-04-25T08:46:57.755165+0000","last_unstale":"2024-04-25T08:46:58.816376+0000","last_undegraded":"2024-04-25T08:46:58.816376+0000","last_fullsized":"2024-04-25T08:46:58.816376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:48.272205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724123+0000","last_change":"2024-04-25T08:46:57.734179+0000","last_active":"2024-04-25T08:46:58.724123+0000","last_peered":"2024-04-25T08:46:58.724123+0000","last_clean":"2024-04-25T08:46:58.724123+0000","last_became_active":"2024-04-25T08:46:57.733836+0000","last_became_peered":"2024-04-25T08:46:57.733836+0000","last_unstale":"2024-04-25T08:46:58.724123+0000","last_undegraded":"2024-04-25T08:46:58.724123+0000","last_fullsized":"2024-04-25T08:46:58.724123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:39.811462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816657+0000","last_change":"2024-04-25T08:46:57.752623+0000","last_active":"2024-04-25T08:46:58.816657+0000","last_peered":"2024-04-25T08:46:58.816657+0000","last_clean":"2024-04-25T08:46:58.816657+0000","last_became_active":"2024-04-25T08:46:57.752243+0000","last_became_peered":"2024-04-25T08:46:57.752243+0000","last_unstale":"2024-04-25T08:46:58.816657+0000","last_undegraded":"2024-04-25T08:46:58.816657+0000","last_fullsized":"2024-04-25T08:46:58.816657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:09.706138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816089+0000","last_change":"2024-04-25T08:46:57.751393+0000","last_active":"2024-04-25T08:46:58.816089+0000","last_peered":"2024-04-25T08:46:58.816089+0000","last_clean":"2024-04-25T08:46:58.816089+0000","last_became_active":"2024-04-25T08:46:57.751133+0000","last_became_peered":"2024-04-25T08:46:57.751133+0000","last_unstale":"2024-04-25T08:46:58.816089+0000","last_undegraded":"2024-04-25T08:46:58.816089+0000","last_fullsized":"2024-04-25T08:46:58.816089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:15.717132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724709+0000","last_change":"2024-04-25T08:46:57.736072+0000","last_active":"2024-04-25T08:46:58.724709+0000","last_peered":"2024-04-25T08:46:58.724709+0000","last_clean":"2024-04-25T08:46:58.724709+0000","last_became_active":"2024-04-25T08:46:57.735781+0000","last_became_peered":"2024-04-25T08:46:57.735781+0000","last_unstale":"2024-04-25T08:46:58.724709+0000","last_undegraded":"2024-04-25T08:46:58.724709+0000","last_fullsized":"2024-04-25T08:46:58.724709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:39.399037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815958+0000","last_change":"2024-04-25T08:46:57.746722+0000","last_active":"2024-04-25T08:46:58.815958+0000","last_peered":"2024-04-25T08:46:58.815958+0000","last_clean":"2024-04-25T08:46:58.815958+0000","last_became_active":"2024-04-25T08:46:57.746456+0000","last_became_peered":"2024-04-25T08:46:57.746456+0000","last_unstale":"2024-04-25T08:46:58.815958+0000","last_undegraded":"2024-04-25T08:46:58.815958+0000","last_fullsized":"2024-04-25T08:46:58.815958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:16.233794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816279+0000","last_change":"2024-04-25T08:46:57.744323+0000","last_active":"2024-04-25T08:46:58.816279+0000","last_peered":"2024-04-25T08:46:58.816279+0000","last_clean":"2024-04-25T08:46:58.816279+0000","last_became_active":"2024-04-25T08:46:57.744049+0000","last_became_peered":"2024-04-25T08:46:57.744049+0000","last_unstale":"2024-04-25T08:46:58.816279+0000","last_undegraded":"2024-04-25T08:46:58.816279+0000","last_fullsized":"2024-04-25T08:46:58.816279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:32.048360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725023+0000","last_change":"2024-04-25T08:46:57.749566+0000","last_active":"2024-04-25T08:46:58.725023+0000","last_peered":"2024-04-25T08:46:58.725023+0000","last_clean":"2024-04-25T08:46:58.725023+0000","last_became_active":"2024-04-25T08:46:57.749266+0000","last_became_peered":"2024-04-25T08:46:57.749266+0000","last_unstale":"2024-04-25T08:46:58.725023+0000","last_undegraded":"2024-04-25T08:46:58.725023+0000","last_fullsized":"2024-04-25T08:46:58.725023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.249964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724942+0000","last_change":"2024-04-25T08:46:57.730151+0000","last_active":"2024-04-25T08:46:58.724942+0000","last_peered":"2024-04-25T08:46:58.724942+0000","last_clean":"2024-04-25T08:46:58.724942+0000","last_became_active":"2024-04-25T08:46:57.729538+0000","last_became_peered":"2024-04-25T08:46:57.729538+0000","last_unstale":"2024-04-25T08:46:58.724942+0000","last_undegraded":"2024-04-25T08:46:58.724942+0000","last_fullsized":"2024-04-25T08:46:58.724942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:03.994595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816685+0000","last_change":"2024-04-25T08:46:56.719653+0000","last_active":"2024-04-25T08:46:58.816685+0000","last_peered":"2024-04-25T08:46:58.816685+0000","last_clean":"2024-04-25T08:46:58.816685+0000","last_became_active":"2024-04-25T08:46:56.719238+0000","last_became_peered":"2024-04-25T08:46:56.719238+0000","last_unstale":"2024-04-25T08:46:58.816685+0000","last_undegraded":"2024-04-25T08:46:58.816685+0000","last_fullsized":"2024-04-25T08:46:58.816685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:05.131808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815432+0000","last_change":"2024-04-25T08:46:57.746062+0000","last_active":"2024-04-25T08:46:58.815432+0000","last_peered":"2024-04-25T08:46:58.815432+0000","last_clean":"2024-04-25T08:46:58.815432+0000","last_became_active":"2024-04-25T08:46:57.745591+0000","last_became_peered":"2024-04-25T08:46:57.745591+0000","last_unstale":"2024-04-25T08:46:58.815432+0000","last_undegraded":"2024-04-25T08:46:58.815432+0000","last_fullsized":"2024-04-25T08:46:58.815432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704223+0000","last_change":"2024-04-25T08:46:55.704223+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704223+0000","last_undegraded":"2024-04-25T08:46:55.704223+0000","last_fullsized":"2024-04-25T08:46:55.704223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725070+0000","last_change":"2024-04-25T08:46:57.738075+0000","last_active":"2024-04-25T08:46:58.725070+0000","last_peered":"2024-04-25T08:46:58.725070+0000","last_clean":"2024-04-25T08:46:58.725070+0000","last_became_active":"2024-04-25T08:46:57.737179+0000","last_became_peered":"2024-04-25T08:46:57.737179+0000","last_unstale":"2024-04-25T08:46:58.725070+0000","last_undegraded":"2024-04-25T08:46:58.725070+0000","last_fullsized":"2024-04-25T08:46:58.725070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:03.994595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.705046+0000","last_change":"2024-04-25T08:46:55.705046+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.705046+0000","last_undegraded":"2024-04-25T08:46:55.705046+0000","last_fullsized":"2024-04-25T08:46:55.705046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724375+0000","last_change":"2024-04-25T08:46:57.732893+0000","last_active":"2024-04-25T08:46:58.724375+0000","last_peered":"2024-04-25T08:46:58.724375+0000","last_clean":"2024-04-25T08:46:58.724375+0000","last_became_active":"2024-04-25T08:46:57.732276+0000","last_became_peered":"2024-04-25T08:46:57.732276+0000","last_unstale":"2024-04-25T08:46:58.724375+0000","last_undegraded":"2024-04-25T08:46:58.724375+0000","last_fullsized":"2024-04-25T08:46:58.724375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:06.838625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.701079+0000","last_change":"2024-04-25T08:46:55.701079+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.701079+0000","last_undegraded":"2024-04-25T08:46:55.701079+0000","last_fullsized":"2024-04-25T08:46:55.701079+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816821+0000","last_change":"2024-04-25T08:46:57.749067+0000","last_active":"2024-04-25T08:46:58.816821+0000","last_peered":"2024-04-25T08:46:58.816821+0000","last_clean":"2024-04-25T08:46:58.816821+0000","last_became_active":"2024-04-25T08:46:57.748799+0000","last_became_peered":"2024-04-25T08:46:57.748799+0000","last_unstale":"2024-04-25T08:46:58.816821+0000","last_undegraded":"2024-04-25T08:46:58.816821+0000","last_fullsized":"2024-04-25T08:46:58.816821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.377815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724477+0000","last_change":"2024-04-25T08:46:56.719347+0000","last_active":"2024-04-25T08:46:58.724477+0000","last_peered":"2024-04-25T08:46:58.724477+0000","last_clean":"2024-04-25T08:46:58.724477+0000","last_became_active":"2024-04-25T08:46:56.719044+0000","last_became_peered":"2024-04-25T08:46:56.719044+0000","last_unstale":"2024-04-25T08:46:58.724477+0000","last_undegraded":"2024-04-25T08:46:58.724477+0000","last_fullsized":"2024-04-25T08:46:58.724477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:59.124963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815885+0000","last_change":"2024-04-25T08:46:57.749814+0000","last_active":"2024-04-25T08:46:58.815885+0000","last_peered":"2024-04-25T08:46:58.815885+0000","last_clean":"2024-04-25T08:46:58.815885+0000","last_became_active":"2024-04-25T08:46:57.749188+0000","last_became_peered":"2024-04-25T08:46:57.749188+0000","last_unstale":"2024-04-25T08:46:58.815885+0000","last_undegraded":"2024-04-25T08:46:58.815885+0000","last_fullsized":"2024-04-25T08:46:58.815885+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:39.399037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.723907+0000","last_change":"2024-04-25T08:46:56.716040+0000","last_active":"2024-04-25T08:46:58.723907+0000","last_peered":"2024-04-25T08:46:58.723907+0000","last_clean":"2024-04-25T08:46:58.723907+0000","last_became_active":"2024-04-25T08:46:56.715756+0000","last_became_peered":"2024-04-25T08:46:56.715756+0000","last_unstale":"2024-04-25T08:46:58.723907+0000","last_undegraded":"2024-04-25T08:46:58.723907+0000","last_fullsized":"2024-04-25T08:46:58.723907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:38.648803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725238+0000","last_change":"2024-04-25T08:46:57.736923+0000","last_active":"2024-04-25T08:46:58.725238+0000","last_peered":"2024-04-25T08:46:58.725238+0000","last_clean":"2024-04-25T08:46:58.725238+0000","last_became_active":"2024-04-25T08:46:57.736642+0000","last_became_peered":"2024-04-25T08:46:57.736642+0000","last_unstale":"2024-04-25T08:46:58.725238+0000","last_undegraded":"2024-04-25T08:46:58.725238+0000","last_fullsized":"2024-04-25T08:46:58.725238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.249964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815517+0000","last_change":"2024-04-25T08:46:56.716582+0000","last_active":"2024-04-25T08:46:58.815517+0000","last_peered":"2024-04-25T08:46:58.815517+0000","last_clean":"2024-04-25T08:46:58.815517+0000","last_became_active":"2024-04-25T08:46:56.715623+0000","last_became_peered":"2024-04-25T08:46:56.715623+0000","last_unstale":"2024-04-25T08:46:58.815517+0000","last_undegraded":"2024-04-25T08:46:58.815517+0000","last_fullsized":"2024-04-25T08:46:58.815517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:22.233368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815824+0000","last_change":"2024-04-25T08:46:56.712775+0000","last_active":"2024-04-25T08:46:58.815824+0000","last_peered":"2024-04-25T08:46:58.815824+0000","last_clean":"2024-04-25T08:46:58.815824+0000","last_became_active":"2024-04-25T08:46:56.712444+0000","last_became_peered":"2024-04-25T08:46:56.712444+0000","last_unstale":"2024-04-25T08:46:58.815824+0000","last_undegraded":"2024-04-25T08:46:58.815824+0000","last_fullsized":"2024-04-25T08:46:58.815824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.460375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815270+0000","last_change":"2024-04-25T08:46:57.745023+0000","last_active":"2024-04-25T08:46:58.815270+0000","last_peered":"2024-04-25T08:46:58.815270+0000","last_clean":"2024-04-25T08:46:58.815270+0000","last_became_active":"2024-04-25T08:46:57.744756+0000","last_became_peered":"2024-04-25T08:46:57.744756+0000","last_unstale":"2024-04-25T08:46:58.815270+0000","last_undegraded":"2024-04-25T08:46:58.815270+0000","last_fullsized":"2024-04-25T08:46:58.815270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704057+0000","last_change":"2024-04-25T08:46:55.704057+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704057+0000","last_undegraded":"2024-04-25T08:46:55.704057+0000","last_fullsized":"2024-04-25T08:46:55.704057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.723978+0000","last_change":"2024-04-25T08:46:57.734433+0000","last_active":"2024-04-25T08:46:58.723978+0000","last_peered":"2024-04-25T08:46:58.723978+0000","last_clean":"2024-04-25T08:46:58.723978+0000","last_became_active":"2024-04-25T08:46:57.733784+0000","last_became_peered":"2024-04-25T08:46:57.733784+0000","last_unstale":"2024-04-25T08:46:58.723978+0000","last_undegraded":"2024-04-25T08:46:58.723978+0000","last_fullsized":"2024-04-25T08:46:58.723978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:09.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724821+0000","last_change":"2024-04-25T08:46:56.716712+0000","last_active":"2024-04-25T08:46:58.724821+0000","last_peered":"2024-04-25T08:46:58.724821+0000","last_clean":"2024-04-25T08:46:58.724821+0000","last_became_active":"2024-04-25T08:46:56.716458+0000","last_became_peered":"2024-04-25T08:46:56.716458+0000","last_unstale":"2024-04-25T08:46:58.724821+0000","last_undegraded":"2024-04-25T08:46:58.724821+0000","last_fullsized":"2024-04-25T08:46:58.724821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:29.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816109+0000","last_change":"2024-04-25T08:46:57.731222+0000","last_active":"2024-04-25T08:46:58.816109+0000","last_peered":"2024-04-25T08:46:58.816109+0000","last_clean":"2024-04-25T08:46:58.816109+0000","last_became_active":"2024-04-25T08:46:57.730957+0000","last_became_peered":"2024-04-25T08:46:57.730957+0000","last_unstale":"2024-04-25T08:46:58.816109+0000","last_undegraded":"2024-04-25T08:46:58.816109+0000","last_fullsized":"2024-04-25T08:46:58.816109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:21.844424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816667+0000","last_change":"2024-04-25T08:46:56.718059+0000","last_active":"2024-04-25T08:46:58.816667+0000","last_peered":"2024-04-25T08:46:58.816667+0000","last_clean":"2024-04-25T08:46:58.816667+0000","last_became_active":"2024-04-25T08:46:56.717753+0000","last_became_peered":"2024-04-25T08:46:56.717753+0000","last_unstale":"2024-04-25T08:46:58.816667+0000","last_undegraded":"2024-04-25T08:46:58.816667+0000","last_fullsized":"2024-04-25T08:46:58.816667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:44.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725106+0000","last_change":"2024-04-25T08:46:57.733968+0000","last_active":"2024-04-25T08:46:58.725106+0000","last_peered":"2024-04-25T08:46:58.725106+0000","last_clean":"2024-04-25T08:46:58.725106+0000","last_became_active":"2024-04-25T08:46:57.733726+0000","last_became_peered":"2024-04-25T08:46:57.733726+0000","last_unstale":"2024-04-25T08:46:58.725106+0000","last_undegraded":"2024-04-25T08:46:58.725106+0000","last_fullsized":"2024-04-25T08:46:58.725106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.700618+0000","last_change":"2024-04-25T08:46:55.700618+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.700618+0000","last_undegraded":"2024-04-25T08:46:55.700618+0000","last_fullsized":"2024-04-25T08:46:55.700618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724430+0000","last_change":"2024-04-25T08:46:57.737605+0000","last_active":"2024-04-25T08:46:58.724430+0000","last_peered":"2024-04-25T08:46:58.724430+0000","last_clean":"2024-04-25T08:46:58.724430+0000","last_became_active":"2024-04-25T08:46:57.737151+0000","last_became_peered":"2024-04-25T08:46:57.737151+0000","last_unstale":"2024-04-25T08:46:58.724430+0000","last_undegraded":"2024-04-25T08:46:58.724430+0000","last_fullsized":"2024-04-25T08:46:58.724430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:16.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724038+0000","last_change":"2024-04-25T08:46:56.711797+0000","last_active":"2024-04-25T08:46:58.724038+0000","last_peered":"2024-04-25T08:46:58.724038+0000","last_clean":"2024-04-25T08:46:58.724038+0000","last_became_active":"2024-04-25T08:46:56.711502+0000","last_became_peered":"2024-04-25T08:46:56.711502+0000","last_unstale":"2024-04-25T08:46:58.724038+0000","last_undegraded":"2024-04-25T08:46:58.724038+0000","last_fullsized":"2024-04-25T08:46:58.724038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:36.752145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704371+0000","last_change":"2024-04-25T08:46:55.704371+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704371+0000","last_undegraded":"2024-04-25T08:46:55.704371+0000","last_fullsized":"2024-04-25T08:46:55.704371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816130+0000","last_change":"2024-04-25T08:46:56.719424+0000","last_active":"2024-04-25T08:46:58.816130+0000","last_peered":"2024-04-25T08:46:58.816130+0000","last_clean":"2024-04-25T08:46:58.816130+0000","last_became_active":"2024-04-25T08:46:56.718888+0000","last_became_peered":"2024-04-25T08:46:56.718888+0000","last_unstale":"2024-04-25T08:46:58.816130+0000","last_undegraded":"2024-04-25T08:46:58.816130+0000","last_fullsized":"2024-04-25T08:46:58.816130+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:33.465219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816826+0000","last_change":"2024-04-25T08:46:56.720535+0000","last_active":"2024-04-25T08:46:58.816826+0000","last_peered":"2024-04-25T08:46:58.816826+0000","last_clean":"2024-04-25T08:46:58.816826+0000","last_became_active":"2024-04-25T08:46:56.720261+0000","last_became_peered":"2024-04-25T08:46:56.720261+0000","last_unstale":"2024-04-25T08:46:58.816826+0000","last_undegraded":"2024-04-25T08:46:58.816826+0000","last_fullsized":"2024-04-25T08:46:58.816826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:51.425671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815216+0000","last_change":"2024-04-25T08:46:57.751224+0000","last_active":"2024-04-25T08:46:58.815216+0000","last_peered":"2024-04-25T08:46:58.815216+0000","last_clean":"2024-04-25T08:46:58.815216+0000","last_became_active":"2024-04-25T08:46:57.750992+0000","last_became_peered":"2024-04-25T08:46:57.750992+0000","last_unstale":"2024-04-25T08:46:58.815216+0000","last_undegraded":"2024-04-25T08:46:58.815216+0000","last_fullsized":"2024-04-25T08:46:58.815216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.872215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.703575+0000","last_change":"2024-04-25T08:46:55.703575+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.703575+0000","last_undegraded":"2024-04-25T08:46:55.703575+0000","last_fullsized":"2024-04-25T08:46:55.703575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816051+0000","last_change":"2024-04-25T08:46:57.754454+0000","last_active":"2024-04-25T08:46:58.816051+0000","last_peered":"2024-04-25T08:46:58.816051+0000","last_clean":"2024-04-25T08:46:58.816051+0000","last_became_active":"2024-04-25T08:46:57.754033+0000","last_became_peered":"2024-04-25T08:46:57.754033+0000","last_unstale":"2024-04-25T08:46:58.816051+0000","last_undegraded":"2024-04-25T08:46:58.816051+0000","last_fullsized":"2024-04-25T08:46:58.816051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:03.517427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725191+0000","last_change":"2024-04-25T08:46:56.717064+0000","last_active":"2024-04-25T08:46:58.725191+0000","last_peered":"2024-04-25T08:46:58.725191+0000","last_clean":"2024-04-25T08:46:58.725191+0000","last_became_active":"2024-04-25T08:46:56.716743+0000","last_became_peered":"2024-04-25T08:46:56.716743+0000","last_unstale":"2024-04-25T08:46:58.725191+0000","last_undegraded":"2024-04-25T08:46:58.725191+0000","last_fullsized":"2024-04-25T08:46:58.725191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:21.811205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816271+0000","last_change":"2024-04-25T08:46:57.754149+0000","last_active":"2024-04-25T08:46:58.816271+0000","last_peered":"2024-04-25T08:46:58.816271+0000","last_clean":"2024-04-25T08:46:58.816271+0000","last_became_active":"2024-04-25T08:46:57.753872+0000","last_became_peered":"2024-04-25T08:46:57.753872+0000","last_unstale":"2024-04-25T08:46:58.816271+0000","last_undegraded":"2024-04-25T08:46:58.816271+0000","last_fullsized":"2024-04-25T08:46:58.816271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.599459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816754+0000","last_change":"2024-04-25T08:46:56.711294+0000","last_active":"2024-04-25T08:46:58.816754+0000","last_peered":"2024-04-25T08:46:58.816754+0000","last_clean":"2024-04-25T08:46:58.816754+0000","last_became_active":"2024-04-25T08:46:56.710929+0000","last_became_peered":"2024-04-25T08:46:56.710929+0000","last_unstale":"2024-04-25T08:46:58.816754+0000","last_undegraded":"2024-04-25T08:46:58.816754+0000","last_fullsized":"2024-04-25T08:46:58.816754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:15.137332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815873+0000","last_change":"2024-04-25T08:46:57.750015+0000","last_active":"2024-04-25T08:46:58.815873+0000","last_peered":"2024-04-25T08:46:58.815873+0000","last_clean":"2024-04-25T08:46:58.815873+0000","last_became_active":"2024-04-25T08:46:57.749748+0000","last_became_peered":"2024-04-25T08:46:57.749748+0000","last_unstale":"2024-04-25T08:46:58.815873+0000","last_undegraded":"2024-04-25T08:46:58.815873+0000","last_fullsized":"2024-04-25T08:46:58.815873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:40.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725139+0000","last_change":"2024-04-25T08:46:56.709724+0000","last_active":"2024-04-25T08:46:58.725139+0000","last_peered":"2024-04-25T08:46:58.725139+0000","last_clean":"2024-04-25T08:46:58.725139+0000","last_became_active":"2024-04-25T08:46:56.709479+0000","last_became_peered":"2024-04-25T08:46:56.709479+0000","last_unstale":"2024-04-25T08:46:58.725139+0000","last_undegraded":"2024-04-25T08:46:58.725139+0000","last_fullsized":"2024-04-25T08:46:58.725139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:48.796813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816653+0000","last_change":"2024-04-25T08:46:57.742949+0000","last_active":"2024-04-25T08:46:58.816653+0000","last_peered":"2024-04-25T08:46:58.816653+0000","last_clean":"2024-04-25T08:46:58.816653+0000","last_became_active":"2024-04-25T08:46:57.742695+0000","last_became_peered":"2024-04-25T08:46:57.742695+0000","last_unstale":"2024-04-25T08:46:58.816653+0000","last_undegraded":"2024-04-25T08:46:58.816653+0000","last_fullsized":"2024-04-25T08:46:58.816653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815962+0000","last_change":"2024-04-25T08:46:56.720535+0000","last_active":"2024-04-25T08:46:58.815962+0000","last_peered":"2024-04-25T08:46:58.815962+0000","last_clean":"2024-04-25T08:46:58.815962+0000","last_became_active":"2024-04-25T08:46:56.720274+0000","last_became_peered":"2024-04-25T08:46:56.720274+0000","last_unstale":"2024-04-25T08:46:58.815962+0000","last_undegraded":"2024-04-25T08:46:58.815962+0000","last_fullsized":"2024-04-25T08:46:58.815962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:07.975454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816821+0000","last_change":"2024-04-25T08:46:57.736236+0000","last_active":"2024-04-25T08:46:58.816821+0000","last_peered":"2024-04-25T08:46:58.816821+0000","last_clean":"2024-04-25T08:46:58.816821+0000","last_became_active":"2024-04-25T08:46:57.735060+0000","last_became_peered":"2024-04-25T08:46:57.735060+0000","last_unstale":"2024-04-25T08:46:58.816821+0000","last_undegraded":"2024-04-25T08:46:58.816821+0000","last_fullsized":"2024-04-25T08:46:58.816821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:40.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815674+0000","last_change":"2024-04-25T08:46:56.718380+0000","last_active":"2024-04-25T08:46:58.815674+0000","last_peered":"2024-04-25T08:46:58.815674+0000","last_clean":"2024-04-25T08:46:58.815674+0000","last_became_active":"2024-04-25T08:46:56.717887+0000","last_became_peered":"2024-04-25T08:46:56.717887+0000","last_unstale":"2024-04-25T08:46:58.815674+0000","last_undegraded":"2024-04-25T08:46:58.815674+0000","last_fullsized":"2024-04-25T08:46:58.815674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:08.545923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815353+0000","last_change":"2024-04-25T08:46:56.717331+0000","last_active":"2024-04-25T08:46:58.815353+0000","last_peered":"2024-04-25T08:46:58.815353+0000","last_clean":"2024-04-25T08:46:58.815353+0000","last_became_active":"2024-04-25T08:46:56.716965+0000","last_became_peered":"2024-04-25T08:46:56.716965+0000","last_unstale":"2024-04-25T08:46:58.815353+0000","last_undegraded":"2024-04-25T08:46:58.815353+0000","last_fullsized":"2024-04-25T08:46:58.815353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:51.465906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724909+0000","last_change":"2024-04-25T08:46:57.739952+0000","last_active":"2024-04-25T08:46:58.724909+0000","last_peered":"2024-04-25T08:46:58.724909+0000","last_clean":"2024-04-25T08:46:58.724909+0000","last_became_active":"2024-04-25T08:46:57.739588+0000","last_became_peered":"2024-04-25T08:46:57.739588+0000","last_unstale":"2024-04-25T08:46:58.724909+0000","last_undegraded":"2024-04-25T08:46:58.724909+0000","last_fullsized":"2024-04-25T08:46:58.724909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:25.805809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724054+0000","last_change":"2024-04-25T08:46:56.714869+0000","last_active":"2024-04-25T08:46:58.724054+0000","last_peered":"2024-04-25T08:46:58.724054+0000","last_clean":"2024-04-25T08:46:58.724054+0000","last_became_active":"2024-04-25T08:46:56.714573+0000","last_became_peered":"2024-04-25T08:46:56.714573+0000","last_unstale":"2024-04-25T08:46:58.724054+0000","last_undegraded":"2024-04-25T08:46:58.724054+0000","last_fullsized":"2024-04-25T08:46:58.724054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:25.662938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:59.725301+0000","last_change":"2024-04-25T08:46:56.714486+0000","last_active":"2024-04-25T08:46:59.725301+0000","last_peered":"2024-04-25T08:46:59.725301+0000","last_clean":"2024-04-25T08:46:59.725301+0000","last_became_active":"2024-04-25T08:46:56.714227+0000","last_became_peered":"2024-04-25T08:46:56.714227+0000","last_unstale":"2024-04-25T08:46:59.725301+0000","last_undegraded":"2024-04-25T08:46:59.725301+0000","last_fullsized":"2024-04-25T08:46:59.725301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:03.785847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725238+0000","last_change":"2024-04-25T08:46:57.739412+0000","last_active":"2024-04-25T08:46:58.725238+0000","last_peered":"2024-04-25T08:46:58.725238+0000","last_clean":"2024-04-25T08:46:58.725238+0000","last_became_active":"2024-04-25T08:46:57.736752+0000","last_became_peered":"2024-04-25T08:46:57.736752+0000","last_unstale":"2024-04-25T08:46:58.725238+0000","last_undegraded":"2024-04-25T08:46:58.725238+0000","last_fullsized":"2024-04-25T08:46:58.725238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.704641+0000","last_change":"2024-04-25T08:46:55.704641+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.704641+0000","last_undegraded":"2024-04-25T08:46:55.704641+0000","last_fullsized":"2024-04-25T08:46:55.704641+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816412+0000","last_change":"2024-04-25T08:46:57.744908+0000","last_active":"2024-04-25T08:46:58.816412+0000","last_peered":"2024-04-25T08:46:58.816412+0000","last_clean":"2024-04-25T08:46:58.816412+0000","last_became_active":"2024-04-25T08:46:57.744655+0000","last_became_peered":"2024-04-25T08:46:57.744655+0000","last_unstale":"2024-04-25T08:46:58.816412+0000","last_undegraded":"2024-04-25T08:46:58.816412+0000","last_fullsized":"2024-04-25T08:46:58.816412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:34.197715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.703337+0000","last_change":"2024-04-25T08:46:55.703337+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.703337+0000","last_undegraded":"2024-04-25T08:46:55.703337+0000","last_fullsized":"2024-04-25T08:46:55.703337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.700416+0000","last_change":"2024-04-25T08:46:55.700416+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.700416+0000","last_undegraded":"2024-04-25T08:46:55.700416+0000","last_fullsized":"2024-04-25T08:46:55.700416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816439+0000","last_change":"2024-04-25T08:46:56.719242+0000","last_active":"2024-04-25T08:46:58.816439+0000","last_peered":"2024-04-25T08:46:58.816439+0000","last_clean":"2024-04-25T08:46:58.816439+0000","last_became_active":"2024-04-25T08:46:56.719000+0000","last_became_peered":"2024-04-25T08:46:56.719000+0000","last_unstale":"2024-04-25T08:46:58.816439+0000","last_undegraded":"2024-04-25T08:46:58.816439+0000","last_fullsized":"2024-04-25T08:46:58.816439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:34.859908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725338+0000","last_change":"2024-04-25T08:46:57.734806+0000","last_active":"2024-04-25T08:46:58.725338+0000","last_peered":"2024-04-25T08:46:58.725338+0000","last_clean":"2024-04-25T08:46:58.725338+0000","last_became_active":"2024-04-25T08:46:57.734533+0000","last_became_peered":"2024-04-25T08:46:57.734533+0000","last_unstale":"2024-04-25T08:46:58.725338+0000","last_undegraded":"2024-04-25T08:46:58.725338+0000","last_fullsized":"2024-04-25T08:46:58.725338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:51.496043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T08:46:55.701349+0000","last_change":"2024-04-25T08:46:55.701349+0000","last_active":"2024-04-25T08:46:55.695394+0000","last_peered":"2024-04-25T08:46:55.695394+0000","last_clean":"2024-04-25T08:46:55.695394+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:55.701349+0000","last_undegraded":"2024-04-25T08:46:55.701349+0000","last_fullsized":"2024-04-25T08:46:55.701349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725351+0000","last_change":"2024-04-25T08:46:57.741952+0000","last_active":"2024-04-25T08:46:58.725351+0000","last_peered":"2024-04-25T08:46:58.725351+0000","last_clean":"2024-04-25T08:46:58.725351+0000","last_became_active":"2024-04-25T08:46:57.741689+0000","last_became_peered":"2024-04-25T08:46:57.741689+0000","last_unstale":"2024-04-25T08:46:58.725351+0000","last_undegraded":"2024-04-25T08:46:58.725351+0000","last_fullsized":"2024-04-25T08:46:58.725351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:30.852428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725011+0000","last_change":"2024-04-25T08:46:56.716730+0000","last_active":"2024-04-25T08:46:58.725011+0000","last_peered":"2024-04-25T08:46:58.725011+0000","last_clean":"2024-04-25T08:46:58.725011+0000","last_became_active":"2024-04-25T08:46:56.716477+0000","last_became_peered":"2024-04-25T08:46:56.716477+0000","last_unstale":"2024-04-25T08:46:58.725011+0000","last_undegraded":"2024-04-25T08:46:58.725011+0000","last_fullsized":"2024-04-25T08:46:58.725011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:40.418688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:46:56.697365+0000","last_change":"2024-04-25T08:46:56.697365+0000","last_active":"2024-04-25T08:46:56.697365+0000","last_peered":"2024-04-25T08:46:56.697365+0000","last_clean":"2024-04-25T08:46:56.697365+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:46:56.697365+0000","last_undegraded":"2024-04-25T08:46:56.697365+0000","last_fullsized":"2024-04-25T08:46:56.697365+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815970+0000","last_change":"2024-04-25T08:46:56.721484+0000","last_active":"2024-04-25T08:46:58.815970+0000","last_peered":"2024-04-25T08:46:58.815970+0000","last_clean":"2024-04-25T08:46:58.815970+0000","last_became_active":"2024-04-25T08:46:56.721115+0000","last_became_peered":"2024-04-25T08:46:56.721115+0000","last_unstale":"2024-04-25T08:46:58.815970+0000","last_undegraded":"2024-04-25T08:46:58.815970+0000","last_fullsized":"2024-04-25T08:46:58.815970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:20.574350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-25T08:46:55.705281+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:46:55.705281+0000","last_peered":"2024-04-25T08:46:55.705281+0000","last_clean":"2024-04-25T08:46:55.705281+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:46:55.705281+0000","last_undegraded":"2024-04-25T08:46:55.705281+0000","last_fullsized":"2024-04-25T08:46:55.705281+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":98,"acting":98,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36852,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334988,"statfs":{"total":96636764160,"available":96599027712,"internally_reserved":0,"allocated":1548288,"data_stored":1027011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":954368,"data_stored":436643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":995328,"data_stored":457203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1011712,"data_stored":458885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":995328,"data_stored":457751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":457911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":457281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1585152,"data_stored":1047537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:47:05.057 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:47:05.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.174+0000 7fe1dfaf7640 1 Processor -- start 2024-04-25T08:47:05.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.175+0000 7fe1dfaf7640 1 -- start start 2024-04-25T08:47:05.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.175+0000 7fe1dfaf7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe1d8071ac0 0x7fe1d80ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.175+0000 7fe1dfaf7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d806c1d0 0x7fe1d806afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.175+0000 7fe1dfaf7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d815ec60 con 0x7fe1d8154ed0 2024-04-25T08:47:05.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.175+0000 7fe1dfaf7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d815ef40 con 0x7fe1d8071ac0 2024-04-25T08:47:05.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.175+0000 7fe1dfaf7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d806db90 con 0x7fe1d806c1d0 2024-04-25T08:47:05.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.176+0000 7fe1dd092640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe1d8071ac0 0x7fe1d80ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.176+0000 7fe1dd092640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe1d8071ac0 0x7fe1d80ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33902/0 (socket says 172.21.15.172:33902) 2024-04-25T08:47:05.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.176+0000 7fe1dd092640 1 -- 172.21.15.172:0/2475413632 learned_addr learned my addr 172.21.15.172:0/2475413632 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:05.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.176+0000 7fe1de094640 1 --2- 172.21.15.172:0/2475413632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d806c1d0 0x7fe1d806afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.176+0000 7fe1dd092640 1 -- 172.21.15.172:0/2475413632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d806c1d0 msgr2=0x7fe1d806afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:05.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.176+0000 7fe1dd092640 1 --2- 172.21.15.172:0/2475413632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d806c1d0 0x7fe1d806afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.176+0000 7fe1dd092640 1 -- 172.21.15.172:0/2475413632 >> v1:172.21.15.186:6789/0 conn(0x7fe1d8154ed0 legacy=0x7fe1d80aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.176+0000 7fe1dd092640 1 -- 172.21.15.172:0/2475413632 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d806de70 con 0x7fe1d8071ac0 2024-04-25T08:47:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.177+0000 7fe1dd092640 1 --2- 172.21.15.172:0/2475413632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8071ac0 0x7fe1d80ad5e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009870 tx=0x7fe1cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89a0f37d2552acc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.177+0000 7fe1dc891640 1 -- 172.21.15.172:0/2475413632 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc037070 con 0x7fe1d8071ac0 2024-04-25T08:47:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.177+0000 7fe1dc891640 1 -- 172.21.15.172:0/2475413632 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc032440 con 0x7fe1d8071ac0 2024-04-25T08:47:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.177+0000 7fe1dc891640 1 -- 172.21.15.172:0/2475413632 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc032810 con 0x7fe1d8071ac0 2024-04-25T08:47:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.177+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/2475413632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8071ac0 msgr2=0x7fe1d80ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.177+0000 7fe1dfaf7640 1 --2- 172.21.15.172:0/2475413632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8071ac0 0x7fe1d80ad5e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009870 tx=0x7fe1cc02a270 comp rx=0 tx=0).stop 2024-04-25T08:47:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.177+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/2475413632 shutdown_connections 2024-04-25T08:47:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.177+0000 7fe1dfaf7640 1 --2- 172.21.15.172:0/2475413632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d806c1d0 0x7fe1d806afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.177+0000 7fe1dfaf7640 1 --2- 172.21.15.172:0/2475413632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8071ac0 0x7fe1d80ad5e0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.178+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/2475413632 >> 172.21.15.172:0/2475413632 conn(0x7fe1d80af670 msgr2=0x7fe1d80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.178+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/2475413632 shutdown_connections 2024-04-25T08:47:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.178+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/2475413632 wait complete. 2024-04-25T08:47:05.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.179+0000 7fe1dfaf7640 1 Processor -- start 2024-04-25T08:47:05.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.179+0000 7fe1dfaf7640 1 -- start start 2024-04-25T08:47:05.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.179+0000 7fe1dfaf7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d8071ac0 0x7fe1d8150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.179+0000 7fe1dfaf7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8154ed0 0x7fe1d8142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.179+0000 7fe1dfaf7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1d81510f0 0x7fe1d8151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.179+0000 7fe1dfaf7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d806b660 con 0x7fe1d8154ed0 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.179+0000 7fe1dfaf7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d806b4e0 con 0x7fe1d81510f0 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.179+0000 7fe1dfaf7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d806b7e0 con 0x7fe1d8071ac0 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dd092640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8154ed0 0x7fe1d8142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dd092640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8154ed0 0x7fe1d8142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33908/0 (socket says 172.21.15.172:33908) 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dd092640 1 -- 172.21.15.172:0/3091743982 learned_addr learned my addr 172.21.15.172:0/3091743982 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1de094640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1d81510f0 0x7fe1d8151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dd893640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d8071ac0 0x7fe1d8150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dd092640 1 -- 172.21.15.172:0/3091743982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d8071ac0 msgr2=0x7fe1d8150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dd092640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d8071ac0 0x7fe1d8150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dd092640 1 -- 172.21.15.172:0/3091743982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1d81510f0 msgr2=0x7fe1d8151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dd092640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1d81510f0 0x7fe1d8151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dd092640 1 -- 172.21.15.172:0/3091743982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d81534a0 con 0x7fe1d8154ed0 2024-04-25T08:47:05.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dd092640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8154ed0 0x7fe1d8142f90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc000c00 tx=0x7fe1cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:05.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1d67fc640 1 -- 172.21.15.172:0/3091743982 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc037040 con 0x7fe1d8154ed0 2024-04-25T08:47:05.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1d67fc640 1 -- 172.21.15.172:0/3091743982 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc042070 con 0x7fe1d8154ed0 2024-04-25T08:47:05.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/3091743982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d8153780 con 0x7fe1d8154ed0 2024-04-25T08:47:05.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1d67fc640 1 -- 172.21.15.172:0/3091743982 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc030880 con 0x7fe1d8154ed0 2024-04-25T08:47:05.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.180+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/3091743982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d8153d40 con 0x7fe1d8154ed0 2024-04-25T08:47:05.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.181+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/3091743982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d80b2b10 con 0x7fe1d8154ed0 2024-04-25T08:47:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.182+0000 7fe1d67fc640 1 -- 172.21.15.172:0/3091743982 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe1cc030a20 con 0x7fe1d8154ed0 2024-04-25T08:47:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.182+0000 7fe1d67fc640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c406b4d0 0x7fe1c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.182+0000 7fe1d67fc640 1 -- 172.21.15.172:0/3091743982 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe1cc0aaba0 con 0x7fe1d8154ed0 2024-04-25T08:47:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.182+0000 7fe1dd893640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c406b4d0 0x7fe1c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.183+0000 7fe1dd893640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c406b4d0 0x7fe1c406d990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0001e70 tx=0x7fe1d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.186+0000 7fe1d67fc640 1 -- 172.21.15.172:0/3091743982 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1cc0791a0 con 0x7fe1d8154ed0 2024-04-25T08:47:05.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.352+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/3091743982 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1d81434d0 con 0x7fe1c406b4d0 2024-04-25T08:47:05.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.358+0000 7fe1d67fc640 1 -- 172.21.15.172:0/3091743982 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252073 (secure 0 0 0) 0x7fe1d000fe00 con 0x7fe1c406b4d0 2024-04-25T08:47:05.352 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:47:05.353 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.361+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/3091743982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c406b4d0 msgr2=0x7fe1c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.361+0000 7fe1dfaf7640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c406b4d0 0x7fe1c406d990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0001e70 tx=0x7fe1d0009040 comp rx=0 tx=0).stop 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.361+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/3091743982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8154ed0 msgr2=0x7fe1d8142f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.361+0000 7fe1dfaf7640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8154ed0 0x7fe1d8142f90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc000c00 tx=0x7fe1cc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.361+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/3091743982 shutdown_connections 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.361+0000 7fe1dfaf7640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c406b4d0 0x7fe1c406d990 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.361+0000 7fe1dfaf7640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1d81510f0 0x7fe1d8151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.361+0000 7fe1dfaf7640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1d8154ed0 0x7fe1d8142f90 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.361+0000 7fe1dfaf7640 1 --2- 172.21.15.172:0/3091743982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d8071ac0 0x7fe1d8150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.361+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/3091743982 >> 172.21.15.172:0/3091743982 conn(0x7fe1d806c1d0 msgr2=0x7fe1d80b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.362+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/3091743982 shutdown_connections 2024-04-25T08:47:05.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.362+0000 7fe1dfaf7640 1 -- 172.21.15.172:0/3091743982 wait complete. 2024-04-25T08:47:05.363 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-04-25T08:47:04.569397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":291724,"kb_used_data":8968,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754682996,"statfs":{"total":773094113280,"available":772795387904,"internally_reserved":0,"allocated":9183232,"data_stored":4842908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.869296"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816348+0000","last_change":"2024-04-25T08:46:57.747017+0000","last_active":"2024-04-25T08:46:58.816348+0000","last_peered":"2024-04-25T08:46:58.816348+0000","last_clean":"2024-04-25T08:46:58.816348+0000","last_became_active":"2024-04-25T08:46:57.746720+0000","last_became_peered":"2024-04-25T08:46:57.746720+0000","last_unstale":"2024-04-25T08:46:58.816348+0000","last_undegraded":"2024-04-25T08:46:58.816348+0000","last_fullsized":"2024-04-25T08:46:58.816348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:06.326899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816620+0000","last_change":"2024-04-25T08:46:57.748857+0000","last_active":"2024-04-25T08:46:58.816620+0000","last_peered":"2024-04-25T08:46:58.816620+0000","last_clean":"2024-04-25T08:46:58.816620+0000","last_became_active":"2024-04-25T08:46:57.748557+0000","last_became_peered":"2024-04-25T08:46:57.748557+0000","last_unstale":"2024-04-25T08:46:58.816620+0000","last_undegraded":"2024-04-25T08:46:58.816620+0000","last_fullsized":"2024-04-25T08:46:58.816620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.872215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725285+0000","last_change":"2024-04-25T08:46:57.733902+0000","last_active":"2024-04-25T08:46:58.725285+0000","last_peered":"2024-04-25T08:46:58.725285+0000","last_clean":"2024-04-25T08:46:58.725285+0000","last_became_active":"2024-04-25T08:46:57.733591+0000","last_became_peered":"2024-04-25T08:46:57.733591+0000","last_unstale":"2024-04-25T08:46:58.725285+0000","last_undegraded":"2024-04-25T08:46:58.725285+0000","last_fullsized":"2024-04-25T08:46:58.725285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:55.569414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724257+0000","last_change":"2024-04-25T08:46:57.734366+0000","last_active":"2024-04-25T08:46:58.724257+0000","last_peered":"2024-04-25T08:46:58.724257+0000","last_clean":"2024-04-25T08:46:58.724257+0000","last_became_active":"2024-04-25T08:46:57.733738+0000","last_became_peered":"2024-04-25T08:46:57.733738+0000","last_unstale":"2024-04-25T08:46:58.724257+0000","last_undegraded":"2024-04-25T08:46:58.724257+0000","last_fullsized":"2024-04-25T08:46:58.724257+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816404+0000","last_change":"2024-04-25T08:46:57.750494+0000","last_active":"2024-04-25T08:46:58.816404+0000","last_peered":"2024-04-25T08:46:58.816404+0000","last_clean":"2024-04-25T08:46:58.816404+0000","last_became_active":"2024-04-25T08:46:57.750234+0000","last_became_peered":"2024-04-25T08:46:57.750234+0000","last_unstale":"2024-04-25T08:46:58.816404+0000","last_undegraded":"2024-04-25T08:46:58.816404+0000","last_fullsized":"2024-04-25T08:46:58.816404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:53.853355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815579+0000","last_change":"2024-04-25T08:46:57.736898+0000","last_active":"2024-04-25T08:46:58.815579+0000","last_peered":"2024-04-25T08:46:58.815579+0000","last_clean":"2024-04-25T08:46:58.815579+0000","last_became_active":"2024-04-25T08:46:57.736617+0000","last_became_peered":"2024-04-25T08:46:57.736617+0000","last_unstale":"2024-04-25T08:46:58.815579+0000","last_undegraded":"2024-04-25T08:46:58.815579+0000","last_fullsized":"2024-04-25T08:46:58.815579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815804+0000","last_change":"2024-04-25T08:46:57.749459+0000","last_active":"2024-04-25T08:46:58.815804+0000","last_peered":"2024-04-25T08:46:58.815804+0000","last_clean":"2024-04-25T08:46:58.815804+0000","last_became_active":"2024-04-25T08:46:57.749197+0000","last_became_peered":"2024-04-25T08:46:57.749197+0000","last_unstale":"2024-04-25T08:46:58.815804+0000","last_undegraded":"2024-04-25T08:46:58.815804+0000","last_fullsized":"2024-04-25T08:46:58.815804+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815743+0000","last_change":"2024-04-25T08:46:57.749375+0000","last_active":"2024-04-25T08:46:58.815743+0000","last_peered":"2024-04-25T08:46:58.815743+0000","last_clean":"2024-04-25T08:46:58.815743+0000","last_became_active":"2024-04-25T08:46:57.749039+0000","last_became_peered":"2024-04-25T08:46:57.749039+0000","last_unstale":"2024-04-25T08:46:58.815743+0000","last_undegraded":"2024-04-25T08:46:58.815743+0000","last_fullsized":"2024-04-25T08:46:58.815743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:35.985064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724725+0000","last_change":"2024-04-25T08:46:57.740018+0000","last_active":"2024-04-25T08:46:58.724725+0000","last_peered":"2024-04-25T08:46:58.724725+0000","last_clean":"2024-04-25T08:46:58.724725+0000","last_became_active":"2024-04-25T08:46:57.738781+0000","last_became_peered":"2024-04-25T08:46:57.738781+0000","last_unstale":"2024-04-25T08:46:58.724725+0000","last_undegraded":"2024-04-25T08:46:58.724725+0000","last_fullsized":"2024-04-25T08:46:58.724725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:59.347891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724516+0000","last_change":"2024-04-25T08:46:57.742552+0000","last_active":"2024-04-25T08:46:58.724516+0000","last_peered":"2024-04-25T08:46:58.724516+0000","last_clean":"2024-04-25T08:46:58.724516+0000","last_became_active":"2024-04-25T08:46:57.742253+0000","last_became_peered":"2024-04-25T08:46:57.742253+0000","last_unstale":"2024-04-25T08:46:58.724516+0000","last_undegraded":"2024-04-25T08:46:58.724516+0000","last_fullsized":"2024-04-25T08:46:58.724516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:32.530004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815758+0000","last_change":"2024-04-25T08:46:57.750527+0000","last_active":"2024-04-25T08:46:58.815758+0000","last_peered":"2024-04-25T08:46:58.815758+0000","last_clean":"2024-04-25T08:46:58.815758+0000","last_became_active":"2024-04-25T08:46:57.749570+0000","last_became_peered":"2024-04-25T08:46:57.749570+0000","last_unstale":"2024-04-25T08:46:58.815758+0000","last_undegraded":"2024-04-25T08:46:58.815758+0000","last_fullsized":"2024-04-25T08:46:58.815758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:32.530004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724344+0000","last_change":"2024-04-25T08:46:57.737397+0000","last_active":"2024-04-25T08:46:58.724344+0000","last_peered":"2024-04-25T08:46:58.724344+0000","last_clean":"2024-04-25T08:46:58.724344+0000","last_became_active":"2024-04-25T08:46:57.736776+0000","last_became_peered":"2024-04-25T08:46:57.736776+0000","last_unstale":"2024-04-25T08:46:58.724344+0000","last_undegraded":"2024-04-25T08:46:58.724344+0000","last_fullsized":"2024-04-25T08:46:58.724344+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816369+0000","last_change":"2024-04-25T08:46:57.755588+0000","last_active":"2024-04-25T08:46:58.816369+0000","last_peered":"2024-04-25T08:46:58.816369+0000","last_clean":"2024-04-25T08:46:58.816369+0000","last_became_active":"2024-04-25T08:46:57.755324+0000","last_became_peered":"2024-04-25T08:46:57.755324+0000","last_unstale":"2024-04-25T08:46:58.816369+0000","last_undegraded":"2024-04-25T08:46:58.816369+0000","last_fullsized":"2024-04-25T08:46:58.816369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:45.411656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815712+0000","last_change":"2024-04-25T08:46:57.736823+0000","last_active":"2024-04-25T08:46:58.815712+0000","last_peered":"2024-04-25T08:46:58.815712+0000","last_clean":"2024-04-25T08:46:58.815712+0000","last_became_active":"2024-04-25T08:46:57.736547+0000","last_became_peered":"2024-04-25T08:46:57.736547+0000","last_unstale":"2024-04-25T08:46:58.815712+0000","last_undegraded":"2024-04-25T08:46:58.815712+0000","last_fullsized":"2024-04-25T08:46:58.815712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:09.706138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815516+0000","last_change":"2024-04-25T08:46:57.745848+0000","last_active":"2024-04-25T08:46:58.815516+0000","last_peered":"2024-04-25T08:46:58.815516+0000","last_clean":"2024-04-25T08:46:58.815516+0000","last_became_active":"2024-04-25T08:46:57.745243+0000","last_became_peered":"2024-04-25T08:46:57.745243+0000","last_unstale":"2024-04-25T08:46:58.815516+0000","last_undegraded":"2024-04-25T08:46:58.815516+0000","last_fullsized":"2024-04-25T08:46:58.815516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:16.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815752+0000","last_change":"2024-04-25T08:46:57.735474+0000","last_active":"2024-04-25T08:46:58.815752+0000","last_peered":"2024-04-25T08:46:58.815752+0000","last_clean":"2024-04-25T08:46:58.815752+0000","last_became_active":"2024-04-25T08:46:57.735185+0000","last_became_peered":"2024-04-25T08:46:57.735185+0000","last_unstale":"2024-04-25T08:46:58.815752+0000","last_undegraded":"2024-04-25T08:46:58.815752+0000","last_fullsized":"2024-04-25T08:46:58.815752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:59.406655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816601+0000","last_change":"2024-04-25T08:46:57.753708+0000","last_active":"2024-04-25T08:46:58.816601+0000","last_peered":"2024-04-25T08:46:58.816601+0000","last_clean":"2024-04-25T08:46:58.816601+0000","last_became_active":"2024-04-25T08:46:57.753453+0000","last_became_peered":"2024-04-25T08:46:57.753453+0000","last_unstale":"2024-04-25T08:46:58.816601+0000","last_undegraded":"2024-04-25T08:46:58.816601+0000","last_fullsized":"2024-04-25T08:46:58.816601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:32.663123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725290+0000","last_change":"2024-04-25T08:46:57.729860+0000","last_active":"2024-04-25T08:46:58.725290+0000","last_peered":"2024-04-25T08:46:58.725290+0000","last_clean":"2024-04-25T08:46:58.725290+0000","last_became_active":"2024-04-25T08:46:57.729559+0000","last_became_peered":"2024-04-25T08:46:57.729559+0000","last_unstale":"2024-04-25T08:46:58.725290+0000","last_undegraded":"2024-04-25T08:46:58.725290+0000","last_fullsized":"2024-04-25T08:46:58.725290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:56.215702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815923+0000","last_change":"2024-04-25T08:46:57.750649+0000","last_active":"2024-04-25T08:46:58.815923+0000","last_peered":"2024-04-25T08:46:58.815923+0000","last_clean":"2024-04-25T08:46:58.815923+0000","last_became_active":"2024-04-25T08:46:57.750400+0000","last_became_peered":"2024-04-25T08:46:57.750400+0000","last_unstale":"2024-04-25T08:46:58.815923+0000","last_undegraded":"2024-04-25T08:46:58.815923+0000","last_fullsized":"2024-04-25T08:46:58.815923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.377815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815835+0000","last_change":"2024-04-25T08:46:57.747932+0000","last_active":"2024-04-25T08:46:58.815835+0000","last_peered":"2024-04-25T08:46:58.815835+0000","last_clean":"2024-04-25T08:46:58.815835+0000","last_became_active":"2024-04-25T08:46:57.747664+0000","last_became_peered":"2024-04-25T08:46:57.747664+0000","last_unstale":"2024-04-25T08:46:58.815835+0000","last_undegraded":"2024-04-25T08:46:58.815835+0000","last_fullsized":"2024-04-25T08:46:58.815835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:31.805999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724229+0000","last_change":"2024-04-25T08:46:57.733118+0000","last_active":"2024-04-25T08:46:58.724229+0000","last_peered":"2024-04-25T08:46:58.724229+0000","last_clean":"2024-04-25T08:46:58.724229+0000","last_became_active":"2024-04-25T08:46:57.732601+0000","last_became_peered":"2024-04-25T08:46:57.732601+0000","last_unstale":"2024-04-25T08:46:58.724229+0000","last_undegraded":"2024-04-25T08:46:58.724229+0000","last_fullsized":"2024-04-25T08:46:58.724229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:18.985748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816376+0000","last_change":"2024-04-25T08:46:57.755439+0000","last_active":"2024-04-25T08:46:58.816376+0000","last_peered":"2024-04-25T08:46:58.816376+0000","last_clean":"2024-04-25T08:46:58.816376+0000","last_became_active":"2024-04-25T08:46:57.755165+0000","last_became_peered":"2024-04-25T08:46:57.755165+0000","last_unstale":"2024-04-25T08:46:58.816376+0000","last_undegraded":"2024-04-25T08:46:58.816376+0000","last_fullsized":"2024-04-25T08:46:58.816376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:48.272205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724123+0000","last_change":"2024-04-25T08:46:57.734179+0000","last_active":"2024-04-25T08:46:58.724123+0000","last_peered":"2024-04-25T08:46:58.724123+0000","last_clean":"2024-04-25T08:46:58.724123+0000","last_became_active":"2024-04-25T08:46:57.733836+0000","last_became_peered":"2024-04-25T08:46:57.733836+0000","last_unstale":"2024-04-25T08:46:58.724123+0000","last_undegraded":"2024-04-25T08:46:58.724123+0000","last_fullsized":"2024-04-25T08:46:58.724123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:39.811462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816657+0000","last_change":"2024-04-25T08:46:57.752623+0000","last_active":"2024-04-25T08:46:58.816657+0000","last_peered":"2024-04-25T08:46:58.816657+0000","last_clean":"2024-04-25T08:46:58.816657+0000","last_became_active":"2024-04-25T08:46:57.752243+0000","last_became_peered":"2024-04-25T08:46:57.752243+0000","last_unstale":"2024-04-25T08:46:58.816657+0000","last_undegraded":"2024-04-25T08:46:58.816657+0000","last_fullsized":"2024-04-25T08:46:58.816657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:09.706138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816089+0000","last_change":"2024-04-25T08:46:57.751393+0000","last_active":"2024-04-25T08:46:58.816089+0000","last_peered":"2024-04-25T08:46:58.816089+0000","last_clean":"2024-04-25T08:46:58.816089+0000","last_became_active":"2024-04-25T08:46:57.751133+0000","last_became_peered":"2024-04-25T08:46:57.751133+0000","last_unstale":"2024-04-25T08:46:58.816089+0000","last_undegraded":"2024-04-25T08:46:58.816089+0000","last_fullsized":"2024-04-25T08:46:58.816089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:15.717132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724709+0000","last_change":"2024-04-25T08:46:57.736072+0000","last_active":"2024-04-25T08:46:58.724709+0000","last_peered":"2024-04-25T08:46:58.724709+0000","last_clean":"2024-04-25T08:46:58.724709+0000","last_became_active":"2024-04-25T08:46:57.735781+0000","last_became_peered":"2024-04-25T08:46:57.735781+0000","last_unstale":"2024-04-25T08:46:58.724709+0000","last_undegraded":"2024-04-25T08:46:58.724709+0000","last_fullsized":"2024-04-25T08:46:58.724709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:39.399037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816799+0000","last_change":"2024-04-25T08:46:57.742030+0000","last_active":"2024-04-25T08:46:58.816799+0000","last_peered":"2024-04-25T08:46:58.816799+0000","last_clean":"2024-04-25T08:46:58.816799+0000","last_became_active":"2024-04-25T08:46:57.741736+0000","last_became_peered":"2024-04-25T08:46:57.741736+0000","last_unstale":"2024-04-25T08:46:58.816799+0000","last_undegraded":"2024-04-25T08:46:58.816799+0000","last_fullsized":"2024-04-25T08:46:58.816799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815958+0000","last_change":"2024-04-25T08:46:57.746722+0000","last_active":"2024-04-25T08:46:58.815958+0000","last_peered":"2024-04-25T08:46:58.815958+0000","last_clean":"2024-04-25T08:46:58.815958+0000","last_became_active":"2024-04-25T08:46:57.746456+0000","last_became_peered":"2024-04-25T08:46:57.746456+0000","last_unstale":"2024-04-25T08:46:58.815958+0000","last_undegraded":"2024-04-25T08:46:58.815958+0000","last_fullsized":"2024-04-25T08:46:58.815958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:16.233794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816279+0000","last_change":"2024-04-25T08:46:57.744323+0000","last_active":"2024-04-25T08:46:58.816279+0000","last_peered":"2024-04-25T08:46:58.816279+0000","last_clean":"2024-04-25T08:46:58.816279+0000","last_became_active":"2024-04-25T08:46:57.744049+0000","last_became_peered":"2024-04-25T08:46:57.744049+0000","last_unstale":"2024-04-25T08:46:58.816279+0000","last_undegraded":"2024-04-25T08:46:58.816279+0000","last_fullsized":"2024-04-25T08:46:58.816279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:32.048360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816717+0000","last_change":"2024-04-25T08:46:57.736111+0000","last_active":"2024-04-25T08:46:58.816717+0000","last_peered":"2024-04-25T08:46:58.816717+0000","last_clean":"2024-04-25T08:46:58.816717+0000","last_became_active":"2024-04-25T08:46:57.735813+0000","last_became_peered":"2024-04-25T08:46:57.735813+0000","last_unstale":"2024-04-25T08:46:58.816717+0000","last_undegraded":"2024-04-25T08:46:58.816717+0000","last_fullsized":"2024-04-25T08:46:58.816717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:09.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725023+0000","last_change":"2024-04-25T08:46:57.749566+0000","last_active":"2024-04-25T08:46:58.725023+0000","last_peered":"2024-04-25T08:46:58.725023+0000","last_clean":"2024-04-25T08:46:58.725023+0000","last_became_active":"2024-04-25T08:46:57.749266+0000","last_became_peered":"2024-04-25T08:46:57.749266+0000","last_unstale":"2024-04-25T08:46:58.725023+0000","last_undegraded":"2024-04-25T08:46:58.725023+0000","last_fullsized":"2024-04-25T08:46:58.725023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.249964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816718+0000","last_change":"2024-04-25T08:46:57.741039+0000","last_active":"2024-04-25T08:46:58.816718+0000","last_peered":"2024-04-25T08:46:58.816718+0000","last_clean":"2024-04-25T08:46:58.816718+0000","last_became_active":"2024-04-25T08:46:57.740723+0000","last_became_peered":"2024-04-25T08:46:57.740723+0000","last_unstale":"2024-04-25T08:46:58.816718+0000","last_undegraded":"2024-04-25T08:46:58.816718+0000","last_fullsized":"2024-04-25T08:46:58.816718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724942+0000","last_change":"2024-04-25T08:46:57.730151+0000","last_active":"2024-04-25T08:46:58.724942+0000","last_peered":"2024-04-25T08:46:58.724942+0000","last_clean":"2024-04-25T08:46:58.724942+0000","last_became_active":"2024-04-25T08:46:57.729538+0000","last_became_peered":"2024-04-25T08:46:57.729538+0000","last_unstale":"2024-04-25T08:46:58.724942+0000","last_undegraded":"2024-04-25T08:46:58.724942+0000","last_fullsized":"2024-04-25T08:46:58.724942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:03.994595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816685+0000","last_change":"2024-04-25T08:46:56.719653+0000","last_active":"2024-04-25T08:46:58.816685+0000","last_peered":"2024-04-25T08:46:58.816685+0000","last_clean":"2024-04-25T08:46:58.816685+0000","last_became_active":"2024-04-25T08:46:56.719238+0000","last_became_peered":"2024-04-25T08:46:56.719238+0000","last_unstale":"2024-04-25T08:46:58.816685+0000","last_undegraded":"2024-04-25T08:46:58.816685+0000","last_fullsized":"2024-04-25T08:46:58.816685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:05.131808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815432+0000","last_change":"2024-04-25T08:46:57.746062+0000","last_active":"2024-04-25T08:46:58.815432+0000","last_peered":"2024-04-25T08:46:58.815432+0000","last_clean":"2024-04-25T08:46:58.815432+0000","last_became_active":"2024-04-25T08:46:57.745591+0000","last_became_peered":"2024-04-25T08:46:57.745591+0000","last_unstale":"2024-04-25T08:46:58.815432+0000","last_undegraded":"2024-04-25T08:46:58.815432+0000","last_fullsized":"2024-04-25T08:46:58.815432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:21.576322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816089+0000","last_change":"2024-04-25T08:46:56.719631+0000","last_active":"2024-04-25T08:46:58.816089+0000","last_peered":"2024-04-25T08:46:58.816089+0000","last_clean":"2024-04-25T08:46:58.816089+0000","last_became_active":"2024-04-25T08:46:56.718826+0000","last_became_peered":"2024-04-25T08:46:56.718826+0000","last_unstale":"2024-04-25T08:46:58.816089+0000","last_undegraded":"2024-04-25T08:46:58.816089+0000","last_fullsized":"2024-04-25T08:46:58.816089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:51.425671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725070+0000","last_change":"2024-04-25T08:46:57.738075+0000","last_active":"2024-04-25T08:46:58.725070+0000","last_peered":"2024-04-25T08:46:58.725070+0000","last_clean":"2024-04-25T08:46:58.725070+0000","last_became_active":"2024-04-25T08:46:57.737179+0000","last_became_peered":"2024-04-25T08:46:57.737179+0000","last_unstale":"2024-04-25T08:46:58.725070+0000","last_undegraded":"2024-04-25T08:46:58.725070+0000","last_fullsized":"2024-04-25T08:46:58.725070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:03.994595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816273+0000","last_change":"2024-04-25T08:46:56.723211+0000","last_active":"2024-04-25T08:46:58.816273+0000","last_peered":"2024-04-25T08:46:58.816273+0000","last_clean":"2024-04-25T08:46:58.816273+0000","last_became_active":"2024-04-25T08:46:56.722945+0000","last_became_peered":"2024-04-25T08:46:56.722945+0000","last_unstale":"2024-04-25T08:46:58.816273+0000","last_undegraded":"2024-04-25T08:46:58.816273+0000","last_fullsized":"2024-04-25T08:46:58.816273+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:03.785847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724375+0000","last_change":"2024-04-25T08:46:57.732893+0000","last_active":"2024-04-25T08:46:58.724375+0000","last_peered":"2024-04-25T08:46:58.724375+0000","last_clean":"2024-04-25T08:46:58.724375+0000","last_became_active":"2024-04-25T08:46:57.732276+0000","last_became_peered":"2024-04-25T08:46:57.732276+0000","last_unstale":"2024-04-25T08:46:58.724375+0000","last_undegraded":"2024-04-25T08:46:58.724375+0000","last_fullsized":"2024-04-25T08:46:58.724375+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:06.838625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816460+0000","last_change":"2024-04-25T08:46:56.719137+0000","last_active":"2024-04-25T08:46:58.816460+0000","last_peered":"2024-04-25T08:46:58.816460+0000","last_clean":"2024-04-25T08:46:58.816460+0000","last_became_active":"2024-04-25T08:46:56.718826+0000","last_became_peered":"2024-04-25T08:46:56.718826+0000","last_unstale":"2024-04-25T08:46:58.816460+0000","last_undegraded":"2024-04-25T08:46:58.816460+0000","last_fullsized":"2024-04-25T08:46:58.816460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:40.418688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816821+0000","last_change":"2024-04-25T08:46:57.749067+0000","last_active":"2024-04-25T08:46:58.816821+0000","last_peered":"2024-04-25T08:46:58.816821+0000","last_clean":"2024-04-25T08:46:58.816821+0000","last_became_active":"2024-04-25T08:46:57.748799+0000","last_became_peered":"2024-04-25T08:46:57.748799+0000","last_unstale":"2024-04-25T08:46:58.816821+0000","last_undegraded":"2024-04-25T08:46:58.816821+0000","last_fullsized":"2024-04-25T08:46:58.816821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.377815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724477+0000","last_change":"2024-04-25T08:46:56.719347+0000","last_active":"2024-04-25T08:46:58.724477+0000","last_peered":"2024-04-25T08:46:58.724477+0000","last_clean":"2024-04-25T08:46:58.724477+0000","last_became_active":"2024-04-25T08:46:56.719044+0000","last_became_peered":"2024-04-25T08:46:56.719044+0000","last_unstale":"2024-04-25T08:46:58.724477+0000","last_undegraded":"2024-04-25T08:46:58.724477+0000","last_fullsized":"2024-04-25T08:46:58.724477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:59.124963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815885+0000","last_change":"2024-04-25T08:46:57.749814+0000","last_active":"2024-04-25T08:46:58.815885+0000","last_peered":"2024-04-25T08:46:58.815885+0000","last_clean":"2024-04-25T08:46:58.815885+0000","last_became_active":"2024-04-25T08:46:57.749188+0000","last_became_peered":"2024-04-25T08:46:57.749188+0000","last_unstale":"2024-04-25T08:46:58.815885+0000","last_undegraded":"2024-04-25T08:46:58.815885+0000","last_fullsized":"2024-04-25T08:46:58.815885+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:39.399037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.723907+0000","last_change":"2024-04-25T08:46:56.716040+0000","last_active":"2024-04-25T08:46:58.723907+0000","last_peered":"2024-04-25T08:46:58.723907+0000","last_clean":"2024-04-25T08:46:58.723907+0000","last_became_active":"2024-04-25T08:46:56.715756+0000","last_became_peered":"2024-04-25T08:46:56.715756+0000","last_unstale":"2024-04-25T08:46:58.723907+0000","last_undegraded":"2024-04-25T08:46:58.723907+0000","last_fullsized":"2024-04-25T08:46:58.723907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:38.648803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725238+0000","last_change":"2024-04-25T08:46:57.736923+0000","last_active":"2024-04-25T08:46:58.725238+0000","last_peered":"2024-04-25T08:46:58.725238+0000","last_clean":"2024-04-25T08:46:58.725238+0000","last_became_active":"2024-04-25T08:46:57.736642+0000","last_became_peered":"2024-04-25T08:46:57.736642+0000","last_unstale":"2024-04-25T08:46:58.725238+0000","last_undegraded":"2024-04-25T08:46:58.725238+0000","last_fullsized":"2024-04-25T08:46:58.725238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:20.249964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815517+0000","last_change":"2024-04-25T08:46:56.716582+0000","last_active":"2024-04-25T08:46:58.815517+0000","last_peered":"2024-04-25T08:46:58.815517+0000","last_clean":"2024-04-25T08:46:58.815517+0000","last_became_active":"2024-04-25T08:46:56.715623+0000","last_became_peered":"2024-04-25T08:46:56.715623+0000","last_unstale":"2024-04-25T08:46:58.815517+0000","last_undegraded":"2024-04-25T08:46:58.815517+0000","last_fullsized":"2024-04-25T08:46:58.815517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:22.233368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816368+0000","last_change":"2024-04-25T08:46:57.749426+0000","last_active":"2024-04-25T08:46:58.816368+0000","last_peered":"2024-04-25T08:46:58.816368+0000","last_clean":"2024-04-25T08:46:58.816368+0000","last_became_active":"2024-04-25T08:46:57.749086+0000","last_became_peered":"2024-04-25T08:46:57.749086+0000","last_unstale":"2024-04-25T08:46:58.816368+0000","last_undegraded":"2024-04-25T08:46:58.816368+0000","last_fullsized":"2024-04-25T08:46:58.816368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:51.496043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815824+0000","last_change":"2024-04-25T08:46:56.712775+0000","last_active":"2024-04-25T08:46:58.815824+0000","last_peered":"2024-04-25T08:46:58.815824+0000","last_clean":"2024-04-25T08:46:58.815824+0000","last_became_active":"2024-04-25T08:46:56.712444+0000","last_became_peered":"2024-04-25T08:46:56.712444+0000","last_unstale":"2024-04-25T08:46:58.815824+0000","last_undegraded":"2024-04-25T08:46:58.815824+0000","last_fullsized":"2024-04-25T08:46:58.815824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.460375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815270+0000","last_change":"2024-04-25T08:46:57.745023+0000","last_active":"2024-04-25T08:46:58.815270+0000","last_peered":"2024-04-25T08:46:58.815270+0000","last_clean":"2024-04-25T08:46:58.815270+0000","last_became_active":"2024-04-25T08:46:57.744756+0000","last_became_peered":"2024-04-25T08:46:57.744756+0000","last_unstale":"2024-04-25T08:46:58.815270+0000","last_undegraded":"2024-04-25T08:46:58.815270+0000","last_fullsized":"2024-04-25T08:46:58.815270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:08.977425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816247+0000","last_change":"2024-04-25T08:46:56.719880+0000","last_active":"2024-04-25T08:46:58.816247+0000","last_peered":"2024-04-25T08:46:58.816247+0000","last_clean":"2024-04-25T08:46:58.816247+0000","last_became_active":"2024-04-25T08:46:56.719588+0000","last_became_peered":"2024-04-25T08:46:56.719588+0000","last_unstale":"2024-04-25T08:46:58.816247+0000","last_undegraded":"2024-04-25T08:46:58.816247+0000","last_fullsized":"2024-04-25T08:46:58.816247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:25.662938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.723978+0000","last_change":"2024-04-25T08:46:57.734433+0000","last_active":"2024-04-25T08:46:58.723978+0000","last_peered":"2024-04-25T08:46:58.723978+0000","last_clean":"2024-04-25T08:46:58.723978+0000","last_became_active":"2024-04-25T08:46:57.733784+0000","last_became_peered":"2024-04-25T08:46:57.733784+0000","last_unstale":"2024-04-25T08:46:58.723978+0000","last_undegraded":"2024-04-25T08:46:58.723978+0000","last_fullsized":"2024-04-25T08:46:58.723978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:09.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724821+0000","last_change":"2024-04-25T08:46:56.716712+0000","last_active":"2024-04-25T08:46:58.724821+0000","last_peered":"2024-04-25T08:46:58.724821+0000","last_clean":"2024-04-25T08:46:58.724821+0000","last_became_active":"2024-04-25T08:46:56.716458+0000","last_became_peered":"2024-04-25T08:46:56.716458+0000","last_unstale":"2024-04-25T08:46:58.724821+0000","last_undegraded":"2024-04-25T08:46:58.724821+0000","last_fullsized":"2024-04-25T08:46:58.724821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:29.109432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816109+0000","last_change":"2024-04-25T08:46:57.731222+0000","last_active":"2024-04-25T08:46:58.816109+0000","last_peered":"2024-04-25T08:46:58.816109+0000","last_clean":"2024-04-25T08:46:58.816109+0000","last_became_active":"2024-04-25T08:46:57.730957+0000","last_became_peered":"2024-04-25T08:46:57.730957+0000","last_unstale":"2024-04-25T08:46:58.816109+0000","last_undegraded":"2024-04-25T08:46:58.816109+0000","last_fullsized":"2024-04-25T08:46:58.816109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:21.844424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816667+0000","last_change":"2024-04-25T08:46:56.718059+0000","last_active":"2024-04-25T08:46:58.816667+0000","last_peered":"2024-04-25T08:46:58.816667+0000","last_clean":"2024-04-25T08:46:58.816667+0000","last_became_active":"2024-04-25T08:46:56.717753+0000","last_became_peered":"2024-04-25T08:46:56.717753+0000","last_unstale":"2024-04-25T08:46:58.816667+0000","last_undegraded":"2024-04-25T08:46:58.816667+0000","last_fullsized":"2024-04-25T08:46:58.816667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:44.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725106+0000","last_change":"2024-04-25T08:46:57.733968+0000","last_active":"2024-04-25T08:46:58.725106+0000","last_peered":"2024-04-25T08:46:58.725106+0000","last_clean":"2024-04-25T08:46:58.725106+0000","last_became_active":"2024-04-25T08:46:57.733726+0000","last_became_peered":"2024-04-25T08:46:57.733726+0000","last_unstale":"2024-04-25T08:46:58.725106+0000","last_undegraded":"2024-04-25T08:46:58.725106+0000","last_fullsized":"2024-04-25T08:46:58.725106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"80'6","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816462+0000","last_change":"2024-04-25T08:46:56.713717+0000","last_active":"2024-04-25T08:46:58.816462+0000","last_peered":"2024-04-25T08:46:58.816462+0000","last_clean":"2024-04-25T08:46:58.816462+0000","last_became_active":"2024-04-25T08:46:56.713444+0000","last_became_peered":"2024-04-25T08:46:56.713444+0000","last_unstale":"2024-04-25T08:46:58.816462+0000","last_undegraded":"2024-04-25T08:46:58.816462+0000","last_fullsized":"2024-04-25T08:46:58.816462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:48.796813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724430+0000","last_change":"2024-04-25T08:46:57.737605+0000","last_active":"2024-04-25T08:46:58.724430+0000","last_peered":"2024-04-25T08:46:58.724430+0000","last_clean":"2024-04-25T08:46:58.724430+0000","last_became_active":"2024-04-25T08:46:57.737151+0000","last_became_peered":"2024-04-25T08:46:57.737151+0000","last_unstale":"2024-04-25T08:46:58.724430+0000","last_undegraded":"2024-04-25T08:46:58.724430+0000","last_fullsized":"2024-04-25T08:46:58.724430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:16.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724038+0000","last_change":"2024-04-25T08:46:56.711797+0000","last_active":"2024-04-25T08:46:58.724038+0000","last_peered":"2024-04-25T08:46:58.724038+0000","last_clean":"2024-04-25T08:46:58.724038+0000","last_became_active":"2024-04-25T08:46:56.711502+0000","last_became_peered":"2024-04-25T08:46:56.711502+0000","last_unstale":"2024-04-25T08:46:58.724038+0000","last_undegraded":"2024-04-25T08:46:58.724038+0000","last_fullsized":"2024-04-25T08:46:58.724038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:36.752145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816326+0000","last_change":"2024-04-25T08:46:57.741886+0000","last_active":"2024-04-25T08:46:58.816326+0000","last_peered":"2024-04-25T08:46:58.816326+0000","last_clean":"2024-04-25T08:46:58.816326+0000","last_became_active":"2024-04-25T08:46:57.741611+0000","last_became_peered":"2024-04-25T08:46:57.741611+0000","last_unstale":"2024-04-25T08:46:58.816326+0000","last_undegraded":"2024-04-25T08:46:58.816326+0000","last_fullsized":"2024-04-25T08:46:58.816326+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:56.215702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816234+0000","last_change":"2024-04-25T08:46:56.721185+0000","last_active":"2024-04-25T08:46:58.816234+0000","last_peered":"2024-04-25T08:46:58.816234+0000","last_clean":"2024-04-25T08:46:58.816234+0000","last_became_active":"2024-04-25T08:46:56.720902+0000","last_became_peered":"2024-04-25T08:46:56.720902+0000","last_unstale":"2024-04-25T08:46:58.816234+0000","last_undegraded":"2024-04-25T08:46:58.816234+0000","last_fullsized":"2024-04-25T08:46:58.816234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:50.261467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816731+0000","last_change":"2024-04-25T08:46:57.746384+0000","last_active":"2024-04-25T08:46:58.816731+0000","last_peered":"2024-04-25T08:46:58.816731+0000","last_clean":"2024-04-25T08:46:58.816731+0000","last_became_active":"2024-04-25T08:46:57.746107+0000","last_became_peered":"2024-04-25T08:46:57.746107+0000","last_unstale":"2024-04-25T08:46:58.816731+0000","last_undegraded":"2024-04-25T08:46:58.816731+0000","last_fullsized":"2024-04-25T08:46:58.816731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:31.662438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816130+0000","last_change":"2024-04-25T08:46:56.719424+0000","last_active":"2024-04-25T08:46:58.816130+0000","last_peered":"2024-04-25T08:46:58.816130+0000","last_clean":"2024-04-25T08:46:58.816130+0000","last_became_active":"2024-04-25T08:46:56.718888+0000","last_became_peered":"2024-04-25T08:46:56.718888+0000","last_unstale":"2024-04-25T08:46:58.816130+0000","last_undegraded":"2024-04-25T08:46:58.816130+0000","last_fullsized":"2024-04-25T08:46:58.816130+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:33.465219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816420+0000","last_change":"2024-04-25T08:46:57.745345+0000","last_active":"2024-04-25T08:46:58.816420+0000","last_peered":"2024-04-25T08:46:58.816420+0000","last_clean":"2024-04-25T08:46:58.816420+0000","last_became_active":"2024-04-25T08:46:57.745041+0000","last_became_peered":"2024-04-25T08:46:57.745041+0000","last_unstale":"2024-04-25T08:46:58.816420+0000","last_undegraded":"2024-04-25T08:46:58.816420+0000","last_fullsized":"2024-04-25T08:46:58.816420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:32.205789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816826+0000","last_change":"2024-04-25T08:46:56.720535+0000","last_active":"2024-04-25T08:46:58.816826+0000","last_peered":"2024-04-25T08:46:58.816826+0000","last_clean":"2024-04-25T08:46:58.816826+0000","last_became_active":"2024-04-25T08:46:56.720261+0000","last_became_peered":"2024-04-25T08:46:56.720261+0000","last_unstale":"2024-04-25T08:46:58.816826+0000","last_undegraded":"2024-04-25T08:46:58.816826+0000","last_fullsized":"2024-04-25T08:46:58.816826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:51.425671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815216+0000","last_change":"2024-04-25T08:46:57.751224+0000","last_active":"2024-04-25T08:46:58.815216+0000","last_peered":"2024-04-25T08:46:58.815216+0000","last_clean":"2024-04-25T08:46:58.815216+0000","last_became_active":"2024-04-25T08:46:57.750992+0000","last_became_peered":"2024-04-25T08:46:57.750992+0000","last_unstale":"2024-04-25T08:46:58.815216+0000","last_undegraded":"2024-04-25T08:46:58.815216+0000","last_fullsized":"2024-04-25T08:46:58.815216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:49.872215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816355+0000","last_change":"2024-04-25T08:46:56.722116+0000","last_active":"2024-04-25T08:46:58.816355+0000","last_peered":"2024-04-25T08:46:58.816355+0000","last_clean":"2024-04-25T08:46:58.816355+0000","last_became_active":"2024-04-25T08:46:56.721809+0000","last_became_peered":"2024-04-25T08:46:56.721809+0000","last_unstale":"2024-04-25T08:46:58.816355+0000","last_undegraded":"2024-04-25T08:46:58.816355+0000","last_fullsized":"2024-04-25T08:46:58.816355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:36.752145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816051+0000","last_change":"2024-04-25T08:46:57.754454+0000","last_active":"2024-04-25T08:46:58.816051+0000","last_peered":"2024-04-25T08:46:58.816051+0000","last_clean":"2024-04-25T08:46:58.816051+0000","last_became_active":"2024-04-25T08:46:57.754033+0000","last_became_peered":"2024-04-25T08:46:57.754033+0000","last_unstale":"2024-04-25T08:46:58.816051+0000","last_undegraded":"2024-04-25T08:46:58.816051+0000","last_fullsized":"2024-04-25T08:46:58.816051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:03.517427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725191+0000","last_change":"2024-04-25T08:46:56.717064+0000","last_active":"2024-04-25T08:46:58.725191+0000","last_peered":"2024-04-25T08:46:58.725191+0000","last_clean":"2024-04-25T08:46:58.725191+0000","last_became_active":"2024-04-25T08:46:56.716743+0000","last_became_peered":"2024-04-25T08:46:56.716743+0000","last_unstale":"2024-04-25T08:46:58.725191+0000","last_undegraded":"2024-04-25T08:46:58.725191+0000","last_fullsized":"2024-04-25T08:46:58.725191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:21.811205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816271+0000","last_change":"2024-04-25T08:46:57.754149+0000","last_active":"2024-04-25T08:46:58.816271+0000","last_peered":"2024-04-25T08:46:58.816271+0000","last_clean":"2024-04-25T08:46:58.816271+0000","last_became_active":"2024-04-25T08:46:57.753872+0000","last_became_peered":"2024-04-25T08:46:57.753872+0000","last_unstale":"2024-04-25T08:46:58.816271+0000","last_undegraded":"2024-04-25T08:46:58.816271+0000","last_fullsized":"2024-04-25T08:46:58.816271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:17.599459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816754+0000","last_change":"2024-04-25T08:46:56.711294+0000","last_active":"2024-04-25T08:46:58.816754+0000","last_peered":"2024-04-25T08:46:58.816754+0000","last_clean":"2024-04-25T08:46:58.816754+0000","last_became_active":"2024-04-25T08:46:56.710929+0000","last_became_peered":"2024-04-25T08:46:56.710929+0000","last_unstale":"2024-04-25T08:46:58.816754+0000","last_undegraded":"2024-04-25T08:46:58.816754+0000","last_fullsized":"2024-04-25T08:46:58.816754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:15.137332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815873+0000","last_change":"2024-04-25T08:46:57.750015+0000","last_active":"2024-04-25T08:46:58.815873+0000","last_peered":"2024-04-25T08:46:58.815873+0000","last_clean":"2024-04-25T08:46:58.815873+0000","last_became_active":"2024-04-25T08:46:57.749748+0000","last_became_peered":"2024-04-25T08:46:57.749748+0000","last_unstale":"2024-04-25T08:46:58.815873+0000","last_undegraded":"2024-04-25T08:46:58.815873+0000","last_fullsized":"2024-04-25T08:46:58.815873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:40.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725139+0000","last_change":"2024-04-25T08:46:56.709724+0000","last_active":"2024-04-25T08:46:58.725139+0000","last_peered":"2024-04-25T08:46:58.725139+0000","last_clean":"2024-04-25T08:46:58.725139+0000","last_became_active":"2024-04-25T08:46:56.709479+0000","last_became_peered":"2024-04-25T08:46:56.709479+0000","last_unstale":"2024-04-25T08:46:58.725139+0000","last_undegraded":"2024-04-25T08:46:58.725139+0000","last_fullsized":"2024-04-25T08:46:58.725139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:48.796813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816653+0000","last_change":"2024-04-25T08:46:57.742949+0000","last_active":"2024-04-25T08:46:58.816653+0000","last_peered":"2024-04-25T08:46:58.816653+0000","last_clean":"2024-04-25T08:46:58.816653+0000","last_became_active":"2024-04-25T08:46:57.742695+0000","last_became_peered":"2024-04-25T08:46:57.742695+0000","last_unstale":"2024-04-25T08:46:58.816653+0000","last_undegraded":"2024-04-25T08:46:58.816653+0000","last_fullsized":"2024-04-25T08:46:58.816653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:25.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815962+0000","last_change":"2024-04-25T08:46:56.720535+0000","last_active":"2024-04-25T08:46:58.815962+0000","last_peered":"2024-04-25T08:46:58.815962+0000","last_clean":"2024-04-25T08:46:58.815962+0000","last_became_active":"2024-04-25T08:46:56.720274+0000","last_became_peered":"2024-04-25T08:46:56.720274+0000","last_unstale":"2024-04-25T08:46:58.815962+0000","last_undegraded":"2024-04-25T08:46:58.815962+0000","last_fullsized":"2024-04-25T08:46:58.815962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:07.975454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816821+0000","last_change":"2024-04-25T08:46:57.736236+0000","last_active":"2024-04-25T08:46:58.816821+0000","last_peered":"2024-04-25T08:46:58.816821+0000","last_clean":"2024-04-25T08:46:58.816821+0000","last_became_active":"2024-04-25T08:46:57.735060+0000","last_became_peered":"2024-04-25T08:46:57.735060+0000","last_unstale":"2024-04-25T08:46:58.816821+0000","last_undegraded":"2024-04-25T08:46:58.816821+0000","last_fullsized":"2024-04-25T08:46:58.816821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:40.350282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815674+0000","last_change":"2024-04-25T08:46:56.718380+0000","last_active":"2024-04-25T08:46:58.815674+0000","last_peered":"2024-04-25T08:46:58.815674+0000","last_clean":"2024-04-25T08:46:58.815674+0000","last_became_active":"2024-04-25T08:46:56.717887+0000","last_became_peered":"2024-04-25T08:46:56.717887+0000","last_unstale":"2024-04-25T08:46:58.815674+0000","last_undegraded":"2024-04-25T08:46:58.815674+0000","last_fullsized":"2024-04-25T08:46:58.815674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:08.545923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816517+0000","last_change":"2024-04-25T08:46:57.742610+0000","last_active":"2024-04-25T08:46:58.816517+0000","last_peered":"2024-04-25T08:46:58.816517+0000","last_clean":"2024-04-25T08:46:58.816517+0000","last_became_active":"2024-04-25T08:46:57.742351+0000","last_became_peered":"2024-04-25T08:46:57.742351+0000","last_unstale":"2024-04-25T08:46:58.816517+0000","last_undegraded":"2024-04-25T08:46:58.816517+0000","last_fullsized":"2024-04-25T08:46:58.816517+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:47.175453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815353+0000","last_change":"2024-04-25T08:46:56.717331+0000","last_active":"2024-04-25T08:46:58.815353+0000","last_peered":"2024-04-25T08:46:58.815353+0000","last_clean":"2024-04-25T08:46:58.815353+0000","last_became_active":"2024-04-25T08:46:56.716965+0000","last_became_peered":"2024-04-25T08:46:56.716965+0000","last_unstale":"2024-04-25T08:46:58.815353+0000","last_undegraded":"2024-04-25T08:46:58.815353+0000","last_fullsized":"2024-04-25T08:46:58.815353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:51.465906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724909+0000","last_change":"2024-04-25T08:46:57.739952+0000","last_active":"2024-04-25T08:46:58.724909+0000","last_peered":"2024-04-25T08:46:58.724909+0000","last_clean":"2024-04-25T08:46:58.724909+0000","last_became_active":"2024-04-25T08:46:57.739588+0000","last_became_peered":"2024-04-25T08:46:57.739588+0000","last_unstale":"2024-04-25T08:46:58.724909+0000","last_undegraded":"2024-04-25T08:46:58.724909+0000","last_fullsized":"2024-04-25T08:46:58.724909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:25.805809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.724054+0000","last_change":"2024-04-25T08:46:56.714869+0000","last_active":"2024-04-25T08:46:58.724054+0000","last_peered":"2024-04-25T08:46:58.724054+0000","last_clean":"2024-04-25T08:46:58.724054+0000","last_became_active":"2024-04-25T08:46:56.714573+0000","last_became_peered":"2024-04-25T08:46:56.714573+0000","last_unstale":"2024-04-25T08:46:58.724054+0000","last_undegraded":"2024-04-25T08:46:58.724054+0000","last_fullsized":"2024-04-25T08:46:58.724054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:25.662938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816260+0000","last_change":"2024-04-25T08:46:57.745310+0000","last_active":"2024-04-25T08:46:58.816260+0000","last_peered":"2024-04-25T08:46:58.816260+0000","last_clean":"2024-04-25T08:46:58.816260+0000","last_became_active":"2024-04-25T08:46:57.745009+0000","last_became_peered":"2024-04-25T08:46:57.745009+0000","last_unstale":"2024-04-25T08:46:58.816260+0000","last_undegraded":"2024-04-25T08:46:58.816260+0000","last_fullsized":"2024-04-25T08:46:58.816260+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:55.569414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:59.725301+0000","last_change":"2024-04-25T08:46:56.714486+0000","last_active":"2024-04-25T08:46:59.725301+0000","last_peered":"2024-04-25T08:46:59.725301+0000","last_clean":"2024-04-25T08:46:59.725301+0000","last_became_active":"2024-04-25T08:46:56.714227+0000","last_became_peered":"2024-04-25T08:46:56.714227+0000","last_unstale":"2024-04-25T08:46:59.725301+0000","last_undegraded":"2024-04-25T08:46:59.725301+0000","last_fullsized":"2024-04-25T08:46:59.725301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:03.785847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725238+0000","last_change":"2024-04-25T08:46:57.739412+0000","last_active":"2024-04-25T08:46:58.725238+0000","last_peered":"2024-04-25T08:46:58.725238+0000","last_clean":"2024-04-25T08:46:58.725238+0000","last_became_active":"2024-04-25T08:46:57.736752+0000","last_became_peered":"2024-04-25T08:46:57.736752+0000","last_unstale":"2024-04-25T08:46:58.725238+0000","last_undegraded":"2024-04-25T08:46:58.725238+0000","last_fullsized":"2024-04-25T08:46:58.725238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:14.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816568+0000","last_change":"2024-04-25T08:46:56.717943+0000","last_active":"2024-04-25T08:46:58.816568+0000","last_peered":"2024-04-25T08:46:58.816568+0000","last_clean":"2024-04-25T08:46:58.816568+0000","last_became_active":"2024-04-25T08:46:56.717644+0000","last_became_peered":"2024-04-25T08:46:56.717644+0000","last_unstale":"2024-04-25T08:46:58.816568+0000","last_undegraded":"2024-04-25T08:46:58.816568+0000","last_fullsized":"2024-04-25T08:46:58.816568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:17.541482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816412+0000","last_change":"2024-04-25T08:46:57.744908+0000","last_active":"2024-04-25T08:46:58.816412+0000","last_peered":"2024-04-25T08:46:58.816412+0000","last_clean":"2024-04-25T08:46:58.816412+0000","last_became_active":"2024-04-25T08:46:57.744655+0000","last_became_peered":"2024-04-25T08:46:57.744655+0000","last_unstale":"2024-04-25T08:46:58.816412+0000","last_undegraded":"2024-04-25T08:46:58.816412+0000","last_fullsized":"2024-04-25T08:46:58.816412+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:34.197715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816073+0000","last_change":"2024-04-25T08:46:56.718946+0000","last_active":"2024-04-25T08:46:58.816073+0000","last_peered":"2024-04-25T08:46:58.816073+0000","last_clean":"2024-04-25T08:46:58.816073+0000","last_became_active":"2024-04-25T08:46:56.718657+0000","last_became_peered":"2024-04-25T08:46:56.718657+0000","last_unstale":"2024-04-25T08:46:58.816073+0000","last_undegraded":"2024-04-25T08:46:58.816073+0000","last_fullsized":"2024-04-25T08:46:58.816073+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:22.233368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816386+0000","last_change":"2024-04-25T08:46:57.746596+0000","last_active":"2024-04-25T08:46:58.816386+0000","last_peered":"2024-04-25T08:46:58.816386+0000","last_clean":"2024-04-25T08:46:58.816386+0000","last_became_active":"2024-04-25T08:46:57.745378+0000","last_became_peered":"2024-04-25T08:46:57.745378+0000","last_unstale":"2024-04-25T08:46:58.816386+0000","last_undegraded":"2024-04-25T08:46:58.816386+0000","last_fullsized":"2024-04-25T08:46:58.816386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:50.061747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815660+0000","last_change":"2024-04-25T08:46:56.719086+0000","last_active":"2024-04-25T08:46:58.815660+0000","last_peered":"2024-04-25T08:46:58.815660+0000","last_clean":"2024-04-25T08:46:58.815660+0000","last_became_active":"2024-04-25T08:46:56.718795+0000","last_became_peered":"2024-04-25T08:46:56.718795+0000","last_unstale":"2024-04-25T08:46:58.815660+0000","last_undegraded":"2024-04-25T08:46:58.815660+0000","last_fullsized":"2024-04-25T08:46:58.815660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:59.141908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816335+0000","last_change":"2024-04-25T08:46:57.749556+0000","last_active":"2024-04-25T08:46:58.816335+0000","last_peered":"2024-04-25T08:46:58.816335+0000","last_clean":"2024-04-25T08:46:58.816335+0000","last_became_active":"2024-04-25T08:46:57.749305+0000","last_became_peered":"2024-04-25T08:46:57.749305+0000","last_unstale":"2024-04-25T08:46:58.816335+0000","last_undegraded":"2024-04-25T08:46:58.816335+0000","last_fullsized":"2024-04-25T08:46:58.816335+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:30.852428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816439+0000","last_change":"2024-04-25T08:46:56.719242+0000","last_active":"2024-04-25T08:46:58.816439+0000","last_peered":"2024-04-25T08:46:58.816439+0000","last_clean":"2024-04-25T08:46:58.816439+0000","last_became_active":"2024-04-25T08:46:56.719000+0000","last_became_peered":"2024-04-25T08:46:56.719000+0000","last_unstale":"2024-04-25T08:46:58.816439+0000","last_undegraded":"2024-04-25T08:46:58.816439+0000","last_fullsized":"2024-04-25T08:46:58.816439+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:34.859908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725338+0000","last_change":"2024-04-25T08:46:57.734806+0000","last_active":"2024-04-25T08:46:58.725338+0000","last_peered":"2024-04-25T08:46:58.725338+0000","last_clean":"2024-04-25T08:46:58.725338+0000","last_became_active":"2024-04-25T08:46:57.734533+0000","last_became_peered":"2024-04-25T08:46:57.734533+0000","last_unstale":"2024-04-25T08:46:58.725338+0000","last_undegraded":"2024-04-25T08:46:58.725338+0000","last_fullsized":"2024-04-25T08:46:58.725338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:51.496043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815874+0000","last_change":"2024-04-25T08:46:56.719950+0000","last_active":"2024-04-25T08:46:58.815874+0000","last_peered":"2024-04-25T08:46:58.815874+0000","last_clean":"2024-04-25T08:46:58.815874+0000","last_became_active":"2024-04-25T08:46:56.719669+0000","last_became_peered":"2024-04-25T08:46:56.719669+0000","last_unstale":"2024-04-25T08:46:58.815874+0000","last_undegraded":"2024-04-25T08:46:58.815874+0000","last_fullsized":"2024-04-25T08:46:58.815874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:05.120088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725351+0000","last_change":"2024-04-25T08:46:57.741952+0000","last_active":"2024-04-25T08:46:58.725351+0000","last_peered":"2024-04-25T08:46:58.725351+0000","last_clean":"2024-04-25T08:46:58.725351+0000","last_became_active":"2024-04-25T08:46:57.741689+0000","last_became_peered":"2024-04-25T08:46:57.741689+0000","last_unstale":"2024-04-25T08:46:58.725351+0000","last_undegraded":"2024-04-25T08:46:58.725351+0000","last_fullsized":"2024-04-25T08:46:58.725351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:30.852428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.725011+0000","last_change":"2024-04-25T08:46:56.716730+0000","last_active":"2024-04-25T08:46:58.725011+0000","last_peered":"2024-04-25T08:46:58.725011+0000","last_clean":"2024-04-25T08:46:58.725011+0000","last_became_active":"2024-04-25T08:46:56.716477+0000","last_became_peered":"2024-04-25T08:46:56.716477+0000","last_unstale":"2024-04-25T08:46:58.725011+0000","last_undegraded":"2024-04-25T08:46:58.725011+0000","last_fullsized":"2024-04-25T08:46:58.725011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:40.418688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.816510+0000","last_change":"2024-04-25T08:46:57.742936+0000","last_active":"2024-04-25T08:46:58.816510+0000","last_peered":"2024-04-25T08:46:58.816510+0000","last_clean":"2024-04-25T08:46:58.816510+0000","last_became_active":"2024-04-25T08:46:57.742052+0000","last_became_peered":"2024-04-25T08:46:57.742052+0000","last_unstale":"2024-04-25T08:46:58.816510+0000","last_undegraded":"2024-04-25T08:46:58.816510+0000","last_fullsized":"2024-04-25T08:46:58.816510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:56.697365+0000","last_clean_scrub_stamp":"2024-04-25T08:46:56.697365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:52.467878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815970+0000","last_change":"2024-04-25T08:46:56.721484+0000","last_active":"2024-04-25T08:46:58.815970+0000","last_peered":"2024-04-25T08:46:58.815970+0000","last_clean":"2024-04-25T08:46:58.815970+0000","last_became_active":"2024-04-25T08:46:56.721115+0000","last_became_peered":"2024-04-25T08:46:56.721115+0000","last_unstale":"2024-04-25T08:46:58.815970+0000","last_undegraded":"2024-04-25T08:46:58.815970+0000","last_fullsized":"2024-04-25T08:46:58.815970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:46:55.695394+0000","last_clean_scrub_stamp":"2024-04-25T08:46:55.695394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:20.574350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":283,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T08:46:58.815815+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:46:58.815815+0000","last_peered":"2024-04-25T08:46:58.815815+0000","last_clean":"2024-04-25T08:46:58.815815+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:46:58.815815+0000","last_undegraded":"2024-04-25T08:46:58.815815+0000","last_fullsized":"2024-04-25T08:46:58.815815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1589248,"data_stored":1047559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36328,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335512,"statfs":{"total":96636764160,"available":96599564288,"internally_reserved":0,"allocated":1003520,"data_stored":458781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":995328,"data_stored":457203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1011712,"data_stored":458885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":995328,"data_stored":457751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":457911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":457281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1585152,"data_stored":1047537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:47:05.367 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:47:05.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:47:05.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.518+0000 7ff9a8370640 1 Processor -- start 2024-04-25T08:47:05.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.518+0000 7ff9a8370640 1 -- start start 2024-04-25T08:47:05.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a8370640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9a00cc4f0 0x7ff9a00cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a8370640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff9a00cdb20 0x7ff9a00cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a8370640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a015b270 0x7ff9a015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a8370640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a0071270 con 0x7ff9a00cc4f0 2024-04-25T08:47:05.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a8370640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a0072280 con 0x7ff9a00cdb20 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a8370640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00714c0 con 0x7ff9a015b270 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a610c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9a00cc4f0 0x7ff9a00cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a610c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9a00cc4f0 0x7ff9a00cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33924/0 (socket says 172.21.15.172:33924) 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a610c640 1 -- 172.21.15.172:0/3785964004 learned_addr learned my addr 172.21.15.172:0/3785964004 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a590b640 1 --2- 172.21.15.172:0/3785964004 >> v2:172.21.15.186:3300/0 conn(0x7ff9a00cdb20 0x7ff9a00cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a690d640 1 --2- 172.21.15.172:0/3785964004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a015b270 0x7ff9a015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a610c640 1 -- 172.21.15.172:0/3785964004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a015b270 msgr2=0x7ff9a015b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a610c640 1 --2- 172.21.15.172:0/3785964004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a015b270 0x7ff9a015b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a610c640 1 -- 172.21.15.172:0/3785964004 >> v2:172.21.15.186:3300/0 conn(0x7ff9a00cdb20 msgr2=0x7ff9a00cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a610c640 1 --2- 172.21.15.172:0/3785964004 >> v2:172.21.15.186:3300/0 conn(0x7ff9a00cdb20 0x7ff9a00cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.519+0000 7ff9a610c640 1 -- 172.21.15.172:0/3785964004 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a00717a0 con 0x7ff9a00cc4f0 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.520+0000 7ff9a610c640 1 --2- 172.21.15.172:0/3785964004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cc4f0 0x7ff9a00cc8d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0158aa0 tx=0x7ff99c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d94d804f7c4061 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.520+0000 7ff9a510a640 1 -- 172.21.15.172:0/3785964004 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c032790 con 0x7ff9a00cc4f0 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.520+0000 7ff9a510a640 1 -- 172.21.15.172:0/3785964004 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c038070 con 0x7ff9a00cc4f0 2024-04-25T08:47:05.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.520+0000 7ff9a510a640 1 -- 172.21.15.172:0/3785964004 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c032b50 con 0x7ff9a00cc4f0 2024-04-25T08:47:05.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.521+0000 7ff9a8370640 1 -- 172.21.15.172:0/3785964004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cc4f0 msgr2=0x7ff9a00cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.521+0000 7ff9a8370640 1 --2- 172.21.15.172:0/3785964004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cc4f0 0x7ff9a00cc8d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0158aa0 tx=0x7ff99c02c890 comp rx=0 tx=0).stop 2024-04-25T08:47:05.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.521+0000 7ff9a8370640 1 -- 172.21.15.172:0/3785964004 shutdown_connections 2024-04-25T08:47:05.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.521+0000 7ff9a8370640 1 --2- 172.21.15.172:0/3785964004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a015b270 0x7ff9a015b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.521+0000 7ff9a8370640 1 --2- 172.21.15.172:0/3785964004 >> v2:172.21.15.186:3300/0 conn(0x7ff9a00cdb20 0x7ff9a00cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.521+0000 7ff9a8370640 1 --2- 172.21.15.172:0/3785964004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cc4f0 0x7ff9a00cc8d0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.521+0000 7ff9a8370640 1 -- 172.21.15.172:0/3785964004 >> 172.21.15.172:0/3785964004 conn(0x7ff9a006abe0 msgr2=0x7ff9a006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:05.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.521+0000 7ff9a8370640 1 -- 172.21.15.172:0/3785964004 shutdown_connections 2024-04-25T08:47:05.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.521+0000 7ff9a8370640 1 -- 172.21.15.172:0/3785964004 wait complete. 2024-04-25T08:47:05.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.522+0000 7ff9a8370640 1 Processor -- start 2024-04-25T08:47:05.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.522+0000 7ff9a8370640 1 -- start start 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a8370640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a00cc4f0 0x7ff9a015c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a8370640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cdb20 0x7ff9a0158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a8370640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a015b270 0x7ff9a0158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a8370640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a015bc00 con 0x7ff9a00cdb20 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a8370640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0071d60 con 0x7ff9a015b270 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a8370640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a015bd80 con 0x7ff9a00cc4f0 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a590b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cdb20 0x7ff9a0158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a590b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cdb20 0x7ff9a0158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33930/0 (socket says 172.21.15.172:33930) 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a590b640 1 -- 172.21.15.172:0/1705965523 learned_addr learned my addr 172.21.15.172:0/1705965523 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a690d640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a015b270 0x7ff9a0158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a610c640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a00cc4f0 0x7ff9a015c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a590b640 1 -- 172.21.15.172:0/1705965523 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a00cc4f0 msgr2=0x7ff9a015c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a590b640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a00cc4f0 0x7ff9a015c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a590b640 1 -- 172.21.15.172:0/1705965523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a015b270 msgr2=0x7ff9a0158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a590b640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a015b270 0x7ff9a0158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a590b640 1 -- 172.21.15.172:0/1705965523 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a01591d0 con 0x7ff9a00cdb20 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a690d640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a015b270 0x7ff9a0158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a590b640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cdb20 0x7ff9a0158650 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff99000e890 tx=0x7ff99000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff996ffd640 1 -- 172.21.15.172:0/1705965523 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990017070 con 0x7ff9a00cdb20 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff996ffd640 1 -- 172.21.15.172:0/1705965523 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99000c940 con 0x7ff9a00cdb20 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a8370640 1 -- 172.21.15.172:0/1705965523 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a01594b0 con 0x7ff9a00cdb20 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff996ffd640 1 -- 172.21.15.172:0/1705965523 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000cd10 con 0x7ff9a00cdb20 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.523+0000 7ff9a8370640 1 -- 172.21.15.172:0/1705965523 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a0159a70 con 0x7ff9a00cdb20 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.524+0000 7ff9a8370640 1 -- 172.21.15.172:0/1705965523 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0073a00 con 0x7ff9a00cdb20 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.525+0000 7ff996ffd640 1 -- 172.21.15.172:0/1705965523 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff99001a070 con 0x7ff9a00cdb20 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.525+0000 7ff996ffd640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98406b4d0 0x7ff98406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.525+0000 7ff996ffd640 1 -- 172.21.15.172:0/1705965523 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff99008a6e0 con 0x7ff9a00cdb20 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.525+0000 7ff9a610c640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98406b4d0 0x7ff98406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.526+0000 7ff9a610c640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98406b4d0 0x7ff98406d990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff99c037000 tx=0x7ff99c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:05.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.529+0000 7ff996ffd640 1 -- 172.21.15.172:0/1705965523 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9900593d0 con 0x7ff9a00cdb20 2024-04-25T08:47:05.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.769+0000 7ff9a8370640 1 -- 172.21.15.172:0/1705965523 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff9a015de60 con 0x7ff9a00cdb20 2024-04-25T08:47:05.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.770+0000 7ff996ffd640 1 -- 172.21.15.172:0/1705965523 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff990058cd0 con 0x7ff9a00cdb20 2024-04-25T08:47:05.761 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T08:47:05.762 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:47:05.762 INFO:teuthology.orchestra.run.smithi172.stdout: caps mds = "allow" 2024-04-25T08:47:05.762 INFO:teuthology.orchestra.run.smithi172.stdout: caps mon = "allow r" 2024-04-25T08:47:05.762 INFO:teuthology.orchestra.run.smithi172.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:47:05.762 INFO:teuthology.orchestra.run.smithi172.stderr:updated caps for client.0 2024-04-25T08:47:05.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 -- 172.21.15.172:0/1705965523 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98406b4d0 msgr2=0x7ff98406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98406b4d0 0x7ff98406d990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff99c037000 tx=0x7ff99c008040 comp rx=0 tx=0).stop 2024-04-25T08:47:05.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 -- 172.21.15.172:0/1705965523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cdb20 msgr2=0x7ff9a0158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cdb20 0x7ff9a0158650 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff99000e890 tx=0x7ff99000ed50 comp rx=0 tx=0).stop 2024-04-25T08:47:05.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 -- 172.21.15.172:0/1705965523 shutdown_connections 2024-04-25T08:47:05.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff98406b4d0 0x7ff98406d990 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9a015b270 0x7ff9a0158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9a00cdb20 0x7ff9a0158650 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 --2- 172.21.15.172:0/1705965523 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9a00cc4f0 0x7ff9a015c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 -- 172.21.15.172:0/1705965523 >> 172.21.15.172:0/1705965523 conn(0x7ff9a006abe0 msgr2=0x7ff9a00b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:05.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 -- 172.21.15.172:0/1705965523 shutdown_connections 2024-04-25T08:47:05.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.772+0000 7ff9a8370640 1 -- 172.21.15.172:0/1705965523 wait complete. 2024-04-25T08:47:05.775 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:47:05.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.880+0000 7f10d3c10640 1 Processor -- start 2024-04-25T08:47:05.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.880+0000 7f10d3c10640 1 -- start start 2024-04-25T08:47:05.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.881+0000 7f10d3c10640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f10cc0ce590 0x7f10cc165900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.881+0000 7f10d3c10640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc071480 con 0x7f10cc0cfec0 2024-04-25T08:47:05.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.881+0000 7f10d3c10640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc071760 con 0x7f10cc154ee0 2024-04-25T08:47:05.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.881+0000 7f10d3c10640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc072090 con 0x7f10cc0ce590 2024-04-25T08:47:05.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.881+0000 7f10d11ab640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f10cc0cfec0 0x7f10cc0cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46584/0 (socket says 172.21.15.172:46584) 2024-04-25T08:47:05.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.881+0000 7f10d11ab640 1 -- 172.21.15.172:0/2414008055 learned_addr learned my addr 172.21.15.172:0/2414008055 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:47:05.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.881+0000 7f10d21ad640 1 --2- 172.21.15.172:0/2414008055 >> v2:172.21.15.186:3300/0 conn(0x7f10cc0ce590 0x7f10cc165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.881+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459309274 0 0) 0x7f10cc071480 con 0x7f10cc0cfec0 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.881+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10b8003520 con 0x7f10cc0cfec0 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2918429870 0 0) 0x7f10b8003520 con 0x7f10cc0cfec0 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 >> v2:172.21.15.186:3300/0 conn(0x7f10cc0ce590 msgr2=0x7f10cc165900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 --2- 172.21.15.172:0/2414008055 >> v2:172.21.15.186:3300/0 conn(0x7f10cc0ce590 0x7f10cc165900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 >> v1:172.21.15.186:6789/0 conn(0x7f10cc154ee0 legacy=0x7f10cc0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc071a40 con 0x7f10cc0cfec0 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f10bc001670 con 0x7f10cc0cfec0 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 >> v1:172.21.15.172:6789/0 conn(0x7f10cc0cfec0 legacy=0x7f10cc0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10b80039b0 0x7f10b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b8004800 0x7f10b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10b80051c0 0x7f10b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b800c030 con 0x7f10b80051c0 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b800c1e0 con 0x7f10b8004800 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b800c3e0 con 0x7f10b80039b0 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d21ad640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10b80051c0 0x7f10b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d11ab640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b8004800 0x7f10b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d19ac640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10b80039b0 0x7f10b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d21ad640 1 -- 172.21.15.172:0/2414008055 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10b80039b0 msgr2=0x7f10b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d21ad640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10b80039b0 0x7f10b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d21ad640 1 -- 172.21.15.172:0/2414008055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b8004800 msgr2=0x7f10b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d21ad640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10b8004800 0x7f10b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.882+0000 7f10d21ad640 1 -- 172.21.15.172:0/2414008055 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b8003520 con 0x7f10b80051c0 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.883+0000 7f10d21ad640 1 -- 172.21.15.172:0/2414008055 reap_dead start 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.883+0000 7f10d21ad640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10b80051c0 0x7f10b800b9c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009a90 tx=0x7f10b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9169ad6f9c4e916e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.883+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4009690 con 0x7f10b80051c0 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.883+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4004020 con 0x7f10b80051c0 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.883+0000 7f10d09aa640 1 -- 172.21.15.172:0/2414008055 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4004410 con 0x7f10b80051c0 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.883+0000 7f10d3c10640 1 -- 172.21.15.172:0/2414008055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10b80051c0 msgr2=0x7f10b800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.883+0000 7f10d3c10640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10b80051c0 0x7f10b800b9c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009a90 tx=0x7f10b8005830 comp rx=0 tx=0).stop 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.883+0000 7f10d3c10640 1 -- 172.21.15.172:0/2414008055 shutdown_connections 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.883+0000 7f10d3c10640 1 --2- 172.21.15.172:0/2414008055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10b80051c0 0x7f10b800b9c0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.883+0000 7f10d3c10640 1 -- 172.21.15.172:0/2414008055 >> 172.21.15.172:0/2414008055 conn(0x7f10cc06abe0 msgr2=0x7f10cc06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:05.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.884+0000 7f10d3c10640 1 -- 172.21.15.172:0/2414008055 shutdown_connections 2024-04-25T08:47:05.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.884+0000 7f10d3c10640 1 -- 172.21.15.172:0/2414008055 wait complete. 2024-04-25T08:47:05.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.885+0000 7f10d3c10640 1 Processor -- start 2024-04-25T08:47:05.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.885+0000 7f10d3c10640 1 -- start start 2024-04-25T08:47:05.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.885+0000 7f10d3c10640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10b80051c0 0x7f10cc142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.885+0000 7f10d3c10640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc1e5500 0x7f10cc1e38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.885+0000 7f10d3c10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc1e6220 0x7f10cc1e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.885+0000 7f10d3c10640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc1552c0 con 0x7f10cc1e6220 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.885+0000 7f10d3c10640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc071230 con 0x7f10cc1e5500 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.885+0000 7f10d3c10640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc155440 con 0x7f10b80051c0 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d21ad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc1e6220 0x7f10cc1e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d21ad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc1e6220 0x7f10cc1e66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33944/0 (socket says 172.21.15.172:33944) 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d21ad640 1 -- 172.21.15.172:0/3486713022 learned_addr learned my addr 172.21.15.172:0/3486713022 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d19ac640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10b80051c0 0x7f10cc142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d11ab640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc1e5500 0x7f10cc1e38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d21ad640 1 -- 172.21.15.172:0/3486713022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10b80051c0 msgr2=0x7f10cc142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d21ad640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10b80051c0 0x7f10cc142050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d21ad640 1 -- 172.21.15.172:0/3486713022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc1e5500 msgr2=0x7f10cc1e38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d21ad640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc1e5500 0x7f10cc1e38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d21ad640 1 -- 172.21.15.172:0/3486713022 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc142590 con 0x7f10cc1e6220 2024-04-25T08:47:05.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d21ad640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc1e6220 0x7f10cc1e66d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f10c402abb0 tx=0x7f10c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10c27fc640 1 -- 172.21.15.172:0/3486713022 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4003e20 con 0x7f10cc1e6220 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10c27fc640 1 -- 172.21.15.172:0/3486713022 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4038450 con 0x7f10cc1e6220 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d3c10640 1 -- 172.21.15.172:0/3486713022 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc151c00 con 0x7f10cc1e6220 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10c27fc640 1 -- 172.21.15.172:0/3486713022 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4038840 con 0x7f10cc1e6220 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.886+0000 7f10d3c10640 1 -- 172.21.15.172:0/3486713022 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc1521c0 con 0x7f10cc1e6220 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.887+0000 7f10d3c10640 1 -- 172.21.15.172:0/3486713022 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc073990 con 0x7f10cc1e6220 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.888+0000 7f10c27fc640 1 -- 172.21.15.172:0/3486713022 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10c40389e0 con 0x7f10cc1e6220 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.888+0000 7f10c27fc640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10b006b500 0x7f10b006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.888+0000 7f10d19ac640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10b006b500 0x7f10b006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.888+0000 7f10c27fc640 1 -- 172.21.15.172:0/3486713022 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f10c40ac510 con 0x7f10cc1e6220 2024-04-25T08:47:05.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.889+0000 7f10d19ac640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10b006b500 0x7f10b006d9c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f10c8000f80 tx=0x7f10c8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:05.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:05.892+0000 7f10c27fc640 1 -- 172.21.15.172:0/3486713022 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10cc142590 con 0x7f10cc1e6220 2024-04-25T08:47:06.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.097+0000 7f10d3c10640 1 -- 172.21.15.172:0/3486713022 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10cc06d360 con 0x7f10cc1e6220 2024-04-25T08:47:06.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.097+0000 7f10c27fc640 1 -- 172.21.15.172:0/3486713022 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f10c407abb0 con 0x7f10cc1e6220 2024-04-25T08:47:06.089 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:47:06.089 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":49,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1549593613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1549593613},{"type":"v1","addr":"172.21.15.186:6833","nonce":1549593613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2002207643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2002207643},{"type":"v1","addr":"172.21.15.186:6835","nonce":2002207643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2584048606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2584048606},{"type":"v1","addr":"172.21.15.172:6836","nonce":2584048606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:46:57.048324+0000","modified":"2024-04-25T08:46:59.073682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6837/1878763904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1878763904},{"type":"v1","addr":"172.21.15.172:6837","nonce":1878763904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:47:06.089 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 49 2024-04-25T08:47:06.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 -- 172.21.15.172:0/3486713022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10b006b500 msgr2=0x7f10b006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10b006b500 0x7f10b006d9c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f10c8000f80 tx=0x7f10c8009040 comp rx=0 tx=0).stop 2024-04-25T08:47:06.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 -- 172.21.15.172:0/3486713022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc1e6220 msgr2=0x7f10cc1e66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc1e6220 0x7f10cc1e66d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f10c402abb0 tx=0x7f10c4004730 comp rx=0 tx=0).stop 2024-04-25T08:47:06.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 -- 172.21.15.172:0/3486713022 shutdown_connections 2024-04-25T08:47:06.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10b006b500 0x7f10b006d9c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc1e5500 0x7f10cc1e38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc1e6220 0x7f10cc1e66d0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 --2- 172.21.15.172:0/3486713022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10b80051c0 0x7f10cc142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 -- 172.21.15.172:0/3486713022 >> 172.21.15.172:0/3486713022 conn(0x7f10cc06abe0 msgr2=0x7f10cc15ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:06.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 -- 172.21.15.172:0/3486713022 shutdown_connections 2024-04-25T08:47:06.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.099+0000 7f10d3c10640 1 -- 172.21.15.172:0/3486713022 wait complete. 2024-04-25T08:47:06.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:46:57.048324+0000', 'modified': '2024-04-25T08:46:59.073682+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7224}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7224': {'gid': 7224, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.172:6837/1878763904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6835', 'nonce': 1878763904}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 1878763904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:47:06.505 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:47:06.505 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T08:47:06.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.614+0000 7fdabb05d640 1 Processor -- start 2024-04-25T08:47:06.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.615+0000 7fdabb05d640 1 -- start start 2024-04-25T08:47:06.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.615+0000 7fdabb05d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab4070dc0 0x7fdab406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.615+0000 7fdabb05d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdab415deb0 0x7fdab415e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.615+0000 7fdabb05d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab40d1770 con 0x7fdab40711a0 2024-04-25T08:47:06.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.615+0000 7fdabb05d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab40b0eb0 con 0x7fdab415deb0 2024-04-25T08:47:06.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.615+0000 7fdabb05d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab41622b0 con 0x7fdab4070dc0 2024-04-25T08:47:06.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.616+0000 7fdab8df9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab4070dc0 0x7fdab406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.616+0000 7fdab95fa640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdab415deb0 0x7fdab415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.616+0000 7fdab3fff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fdab40711a0 0x7fdab40b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:48612/0 (socket says 172.21.15.172:48612) 2024-04-25T08:47:06.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.616+0000 7fdab3fff640 1 -- 172.21.15.172:0/1383624520 learned_addr learned my addr 172.21.15.172:0/1383624520 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:47:06.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.616+0000 7fdab8df9640 1 -- 172.21.15.172:0/1383624520 >> v2:172.21.15.186:3300/0 conn(0x7fdab415deb0 msgr2=0x7fdab415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:06.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.616+0000 7fdab8df9640 1 --2- 172.21.15.172:0/1383624520 >> v2:172.21.15.186:3300/0 conn(0x7fdab415deb0 0x7fdab415e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.616+0000 7fdab8df9640 1 -- 172.21.15.172:0/1383624520 >> v1:172.21.15.186:6789/0 conn(0x7fdab40711a0 legacy=0x7fdab40b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.616+0000 7fdab8df9640 1 -- 172.21.15.172:0/1383624520 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4162740 con 0x7fdab4070dc0 2024-04-25T08:47:06.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.616+0000 7fdab95fa640 1 --2- 172.21.15.172:0/1383624520 >> v2:172.21.15.186:3300/0 conn(0x7fdab415deb0 0x7fdab415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:47:06.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.617+0000 7fdab8df9640 1 --2- 172.21.15.172:0/1383624520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab4070dc0 0x7fdab406ccd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80097a0 tx=0x7fdaa802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e274fa2351f482f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:06.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.617+0000 7fdab37fe640 1 -- 172.21.15.172:0/1383624520 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8037070 con 0x7fdab4070dc0 2024-04-25T08:47:06.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.617+0000 7fdab37fe640 1 -- 172.21.15.172:0/1383624520 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa802adb0 con 0x7fdab4070dc0 2024-04-25T08:47:06.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.617+0000 7fdab37fe640 1 -- 172.21.15.172:0/1383624520 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8032660 con 0x7fdab4070dc0 2024-04-25T08:47:06.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.618+0000 7fdabb05d640 1 -- 172.21.15.172:0/1383624520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab4070dc0 msgr2=0x7fdab406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.618+0000 7fdabb05d640 1 --2- 172.21.15.172:0/1383624520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab4070dc0 0x7fdab406ccd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80097a0 tx=0x7fdaa802a060 comp rx=0 tx=0).stop 2024-04-25T08:47:06.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.618+0000 7fdabb05d640 1 -- 172.21.15.172:0/1383624520 shutdown_connections 2024-04-25T08:47:06.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.618+0000 7fdabb05d640 1 --2- 172.21.15.172:0/1383624520 >> v2:172.21.15.186:3300/0 conn(0x7fdab415deb0 0x7fdab415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.618+0000 7fdabb05d640 1 --2- 172.21.15.172:0/1383624520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab4070dc0 0x7fdab406ccd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.618+0000 7fdabb05d640 1 -- 172.21.15.172:0/1383624520 >> 172.21.15.172:0/1383624520 conn(0x7fdab40b3530 msgr2=0x7fdab40b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:06.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.618+0000 7fdabb05d640 1 -- 172.21.15.172:0/1383624520 shutdown_connections 2024-04-25T08:47:06.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.618+0000 7fdabb05d640 1 -- 172.21.15.172:0/1383624520 wait complete. 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.619+0000 7fdabb05d640 1 Processor -- start 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.619+0000 7fdabb05d640 1 -- start start 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdabb05d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab4070dc0 0x7fdab40ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdabb05d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40711a0 0x7fdab41f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdabb05d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab415deb0 0x7fdab415ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdabb05d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab4161c60 con 0x7fdab40711a0 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdabb05d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40b10f0 con 0x7fdab4070dc0 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdabb05d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab4161f40 con 0x7fdab415deb0 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40711a0 0x7fdab41f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40711a0 0x7fdab41f0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33956/0 (socket says 172.21.15.172:33956) 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab3fff640 1 -- 172.21.15.172:0/225088302 learned_addr learned my addr 172.21.15.172:0/225088302 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab95fa640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab415deb0 0x7fdab415ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab8df9640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab4070dc0 0x7fdab40ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab3fff640 1 -- 172.21.15.172:0/225088302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab415deb0 msgr2=0x7fdab415ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab3fff640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab415deb0 0x7fdab415ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab3fff640 1 -- 172.21.15.172:0/225088302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab4070dc0 msgr2=0x7fdab40ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab3fff640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab4070dc0 0x7fdab40ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab3fff640 1 -- 172.21.15.172:0/225088302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab41f71b0 con 0x7fdab40711a0 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab8df9640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab4070dc0 0x7fdab40ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.620+0000 7fdab3fff640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40711a0 0x7fdab41f0f10 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000c400 tx=0x7fdaa000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.621+0000 7fdab17fa640 1 -- 172.21.15.172:0/225088302 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0017070 con 0x7fdab40711a0 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.621+0000 7fdab17fa640 1 -- 172.21.15.172:0/225088302 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa0005ce0 con 0x7fdab40711a0 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.621+0000 7fdabb05d640 1 -- 172.21.15.172:0/225088302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab41f7490 con 0x7fdab40711a0 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.621+0000 7fdab17fa640 1 -- 172.21.15.172:0/225088302 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00072f0 con 0x7fdab40711a0 2024-04-25T08:47:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.621+0000 7fdabb05d640 1 -- 172.21.15.172:0/225088302 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab41f7a50 con 0x7fdab40711a0 2024-04-25T08:47:06.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.622+0000 7fdab17fa640 1 -- 172.21.15.172:0/225088302 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdaa001a070 con 0x7fdab40711a0 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.623+0000 7fdab17fa640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 0x7fda9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.623+0000 7fdab8df9640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 0x7fda9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.623+0000 7fdab17fa640 1 -- 172.21.15.172:0/225088302 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdaa00897b0 con 0x7fdab40711a0 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.623+0000 7fdab8df9640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 0x7fda9806d990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8034000 tx=0x7fdaa802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdabdd65740 1 Processor -- start 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdabdd65740 1 -- start start 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c802610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c81fad0 0x56019c820020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c7d7f10 0x56019c81e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdabdd65740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56019c73aa10 con 0x56019c81fad0 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdabdd65740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56019c6e3b30 con 0x56019c7d7f10 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdabdd65740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56019c736c50 con 0x56019c802230 2024-04-25T08:47:06.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdab3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c81fad0 0x56019c820020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdab3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c81fad0 0x56019c820020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33968/0 (socket says 172.21.15.172:33968) 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.624+0000 7fdab3fff640 1 -- 172.21.15.172:0/2882150807 learned_addr learned my addr 172.21.15.172:0/2882150807 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fdab8df9640 1 --2- 172.21.15.172:0/2882150807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c802610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fdab95fa640 1 --2- 172.21.15.172:0/2882150807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c7d7f10 0x56019c81e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fdab3fff640 1 -- 172.21.15.172:0/2882150807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 msgr2=0x56019c802610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fdab3fff640 1 --2- 172.21.15.172:0/2882150807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c802610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fdab3fff640 1 -- 172.21.15.172:0/2882150807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c7d7f10 msgr2=0x56019c81e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fdab3fff640 1 --2- 172.21.15.172:0/2882150807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c7d7f10 0x56019c81e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fdab3fff640 1 -- 172.21.15.172:0/2882150807 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56019c6f8e10 con 0x56019c81fad0 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fdab95fa640 1 --2- 172.21.15.172:0/2882150807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c7d7f10 0x56019c81e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fdab3fff640 1 --2- 172.21.15.172:0/2882150807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c81fad0 0x56019c820020 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fdaa005fee0 tx=0x7fdaa00584c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af54e9b72226f4ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fda9e7fc640 1 -- 172.21.15.172:0/2882150807 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0060410 con 0x56019c81fad0 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fda9e7fc640 1 -- 172.21.15.172:0/2882150807 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa005e070 con 0x56019c81fad0 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.625+0000 7fda9e7fc640 1 -- 172.21.15.172:0/2882150807 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0054370 con 0x56019c81fad0 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 -- 172.21.15.172:0/2882150807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c81fad0 msgr2=0x56019c820020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 --2- 172.21.15.172:0/2882150807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c81fad0 0x56019c820020 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fdaa005fee0 tx=0x7fdaa00584c0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 -- 172.21.15.172:0/2882150807 shutdown_connections 2024-04-25T08:47:06.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 --2- 172.21.15.172:0/2882150807 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c7d7f10 0x56019c81e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 --2- 172.21.15.172:0/2882150807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c81fad0 0x56019c820020 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 --2- 172.21.15.172:0/2882150807 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c802610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 -- 172.21.15.172:0/2882150807 >> 172.21.15.172:0/2882150807 conn(0x56019c7d4840 msgr2=0x56019c81d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:06.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 -- 172.21.15.172:0/2882150807 shutdown_connections 2024-04-25T08:47:06.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 -- 172.21.15.172:0/2882150807 wait complete. 2024-04-25T08:47:06.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 -- start start 2024-04-25T08:47:06.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.626+0000 7fdabdd65740 1 Processor -- start 2024-04-25T08:47:06.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c815430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c7f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c8056c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdabdd65740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56019c7d8cb0 con 0x56019c8047e0 2024-04-25T08:47:06.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdabdd65740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56019c6f70c0 con 0x56019c81fad0 2024-04-25T08:47:06.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdabdd65740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56019c7d2770 con 0x56019c802230 2024-04-25T08:47:06.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdabdd65740 10 client.0 _ll_register_callbacks cb 0x56019c6eaec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:47:06.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdab95fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c8056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdab95fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c8056c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33970/0 (socket says 172.21.15.172:33970) 2024-04-25T08:47:06.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdab95fa640 1 -- 172.21.15.172:0/3921845202 learned_addr learned my addr 172.21.15.172:0/3921845202 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdab8df9640 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c815430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.627+0000 7fdab3fff640 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c7f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdab95fa640 1 -- 172.21.15.172:0/3921845202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 msgr2=0x56019c815430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdab95fa640 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c815430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdab95fa640 1 -- 172.21.15.172:0/3921845202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 msgr2=0x56019c7f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdab95fa640 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c7f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdab95fa640 1 -- 172.21.15.172:0/3921845202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56019c44f2d0 con 0x56019c8047e0 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdab95fa640 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c8056c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fdaac007dd0 tx=0x7fdaac012610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32af03ce358a7c7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fda937fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fda937fe640 1 -- 172.21.15.172:0/3921845202 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac01c030 con 0x56019c8047e0 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fda937fe640 1 -- 172.21.15.172:0/3921845202 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdaac003990 con 0x56019c8047e0 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdabdd65740 1 -- 172.21.15.172:0/3921845202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdaa005e070 con 0x56019c8047e0 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fda937fe640 1 -- 172.21.15.172:0/3921845202 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdaac025050 con 0x56019c8047e0 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdabdd65740 10 client.7383 fetch_fsmap learned FSMap version 49 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdabdd65740 1 -- 172.21.15.172:0/3921845202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x56019c5196b0 con 0x56019c8047e0 2024-04-25T08:47:06.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fda937fe640 1 -- 172.21.15.172:0/3921845202 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa005e070 con 0x56019c8047e0 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fda937fe640 1 -- 172.21.15.172:0/3921845202 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdaac028020 con 0x56019c8047e0 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdabdd65740 10 client.7383 fetch_fsmap finished waiting for FSMap version 49 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdabdd65740 10 client.7383 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdabdd65740 20 client.7383 populate_metadata read hostname 'smithi172' 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56019c7f14e0 0x56019c8146a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdabdd65740 4 client.7383 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdabdd65740 1 -- 172.21.15.172:0/3921845202 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56019c799920 con 0x56019c7f14e0 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.628+0000 7fdab8df9640 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56019c7f14e0 0x56019c8146a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fda937fe640 10 client.7383 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fdab8df9640 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56019c7f14e0 0x56019c8146a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d493046eadc77fa0 server_cookie=1bab8e8849876afe in_seq=0 out_seq=0 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fda937fe640 1 -- 172.21.15.172:0/3921845202 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56019c799920 con 0x56019c7f14e0 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fda937fe640 10 client.7383 handle_command_reply: tid=0 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fdabdd65740 1 client.7383 shutdown 2024-04-25T08:47:06.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fdabdd65740 1 -- 172.21.15.172:0/3921845202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 msgr2=0x56019c8056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c8056c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fdaac007dd0 tx=0x7fdaac012610 comp rx=0 tx=0).stop 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fdabdd65740 1 -- 172.21.15.172:0/3921845202 shutdown_connections 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56019c7f14e0 0x56019c8146a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c7f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c8056c0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fda937fe640 0 client.7383 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3921845202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c815430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.629+0000 7fdabdd65740 1 -- 172.21.15.172:0/3921845202 >> 172.21.15.172:0/3921845202 conn(0x56019c7d7f10 msgr2=0x56019c820e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.630+0000 7fdabdd65740 1 -- 172.21.15.172:0/3921845202 shutdown_connections 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.630+0000 7fdabdd65740 1 -- 172.21.15.172:0/3921845202 wait complete. 2024-04-25T08:47:06.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.630+0000 7fdabdd65740 20 client.7383 trim_cache size 0 max 16384 2024-04-25T08:47:06.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.645+0000 7fdabdd65740 1 Processor -- start 2024-04-25T08:47:06.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.645+0000 7fdabdd65740 1 -- start start 2024-04-25T08:47:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c7d84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c7d5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c7d6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdabdd65740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab41ff670 con 0x56019c8047e0 2024-04-25T08:47:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdabdd65740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab415ec30 con 0x56019c81fad0 2024-04-25T08:47:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdabdd65740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab41ff2b0 con 0x56019c802230 2024-04-25T08:47:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdab3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c7d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdab3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c7d5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33974/0 (socket says 172.21.15.172:33974) 2024-04-25T08:47:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdab3fff640 1 -- 172.21.15.172:0/358668255 learned_addr learned my addr 172.21.15.172:0/358668255 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdab3fff640 1 -- 172.21.15.172:0/358668255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 msgr2=0x56019c7d84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdab3fff640 1 --2- 172.21.15.172:0/358668255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c7d84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdab3fff640 1 -- 172.21.15.172:0/358668255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 msgr2=0x56019c7d6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdab95fa640 1 --2- 172.21.15.172:0/358668255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c7d6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdab3fff640 1 --2- 172.21.15.172:0/358668255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c7d6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdab3fff640 1 -- 172.21.15.172:0/358668255 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56019c813f20 con 0x56019c8047e0 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.646+0000 7fdab3fff640 1 --2- 172.21.15.172:0/358668255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c7d5de0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0057ec0 tx=0x7fdaa005e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a981441a2539b893 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fda9dffb640 1 -- 172.21.15.172:0/358668255 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0001120 con 0x56019c8047e0 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fda9dffb640 1 -- 172.21.15.172:0/358668255 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa0060410 con 0x56019c8047e0 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fda9dffb640 1 -- 172.21.15.172:0/358668255 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0054370 con 0x56019c8047e0 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fdabdd65740 1 -- 172.21.15.172:0/358668255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 msgr2=0x56019c7d5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fdabdd65740 1 --2- 172.21.15.172:0/358668255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c7d5de0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0057ec0 tx=0x7fdaa005e000 comp rx=0 tx=0).stop 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fdabdd65740 1 -- 172.21.15.172:0/358668255 shutdown_connections 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fdabdd65740 1 --2- 172.21.15.172:0/358668255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c7d6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fdabdd65740 1 --2- 172.21.15.172:0/358668255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c7d5de0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fdabdd65740 1 --2- 172.21.15.172:0/358668255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c7d84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fdabdd65740 1 -- 172.21.15.172:0/358668255 >> 172.21.15.172:0/358668255 conn(0x56019c7d7f10 msgr2=0x56019c816df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:06.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fdabdd65740 1 -- 172.21.15.172:0/358668255 shutdown_connections 2024-04-25T08:47:06.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.647+0000 7fdabdd65740 1 -- 172.21.15.172:0/358668255 wait complete. 2024-04-25T08:47:06.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.648+0000 7fdabdd65740 1 -- start start 2024-04-25T08:47:06.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.648+0000 7fdabdd65740 1 Processor -- start 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c889490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c885e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdabdd65740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c81eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdabdd65740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56019c7f1360 con 0x56019c8047e0 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdabdd65740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56019c803fe0 con 0x56019c81fad0 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdabdd65740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56019c7f1960 con 0x56019c802230 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdabdd65740 10 client.0 _ll_register_callbacks cb 0x56019c7d2c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c885e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c885e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33980/0 (socket says 172.21.15.172:33980) 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab3fff640 1 -- 172.21.15.172:0/3869616991 learned_addr learned my addr 172.21.15.172:0/3869616991 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab95fa640 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c81eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab8df9640 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c889490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab3fff640 1 -- 172.21.15.172:0/3869616991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 msgr2=0x56019c889490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab3fff640 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c889490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab3fff640 1 -- 172.21.15.172:0/3869616991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 msgr2=0x56019c81eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab3fff640 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c81eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab3fff640 1 -- 172.21.15.172:0/3869616991 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56019c817500 con 0x56019c8047e0 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab8df9640 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c889490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdab3fff640 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c885e80 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00585b0 tx=0x7fdaa0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d01e1c779298f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fda937fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fda937fe640 1 -- 172.21.15.172:0/3869616991 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00076a0 con 0x56019c8047e0 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fda937fe640 1 -- 172.21.15.172:0/3869616991 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdaa0076bd0 con 0x56019c8047e0 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdabdd65740 1 -- 172.21.15.172:0/3869616991 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdaa0060410 con 0x56019c8047e0 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fda937fe640 1 -- 172.21.15.172:0/3869616991 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdaa007d050 con 0x56019c8047e0 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdabdd65740 10 client.7389 fetch_fsmap learned FSMap version 49 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.649+0000 7fdabdd65740 1 -- 172.21.15.172:0/3869616991 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x56019c8060d0 con 0x56019c8047e0 2024-04-25T08:47:06.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fda937fe640 1 -- 172.21.15.172:0/3869616991 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa0060410 con 0x56019c8047e0 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fda937fe640 1 -- 172.21.15.172:0/3869616991 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdaa0080020 con 0x56019c8047e0 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdabdd65740 10 client.7389 fetch_fsmap finished waiting for FSMap version 49 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdabdd65740 10 client.7389 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdabdd65740 20 client.7389 populate_metadata read hostname 'smithi172' 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56019c800f40 0x56019c801320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdabdd65740 4 client.7389 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdabdd65740 1 -- 172.21.15.172:0/3869616991 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56019c747f50 con 0x56019c800f40 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdab8df9640 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56019c800f40 0x56019c801320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdab8df9640 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56019c800f40 0x56019c801320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72802ea0b0edea2 server_cookie=91073da6a0a665ef in_seq=0 out_seq=0 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fda937fe640 10 client.7389 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fda937fe640 1 -- 172.21.15.172:0/3869616991 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56019c747f50 con 0x56019c800f40 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fda937fe640 10 client.7389 handle_command_reply: tid=0 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdabdd65740 1 client.7389 shutdown 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdabdd65740 1 -- 172.21.15.172:0/3869616991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 msgr2=0x56019c885e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.650+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c885e80 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00585b0 tx=0x7fdaa0014040 comp rx=0 tx=0).stop 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabdd65740 1 -- 172.21.15.172:0/3869616991 shutdown_connections 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56019c800f40 0x56019c801320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56019c81fad0 0x56019c81eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56019c8047e0 0x56019c885e80 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabdd65740 1 --2- 172.21.15.172:0/3869616991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56019c802230 0x56019c889490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabdd65740 1 -- 172.21.15.172:0/3869616991 >> 172.21.15.172:0/3869616991 conn(0x56019c7d7f10 msgr2=0x56019c8054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fda937fe640 0 client.7389 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabdd65740 1 -- 172.21.15.172:0/3869616991 shutdown_connections 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabdd65740 1 -- 172.21.15.172:0/3869616991 wait complete. 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabdd65740 20 client.7389 trim_cache size 0 max 16384 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:47:06.648 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 7224, 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 8.9316503059999999, 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 49, 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 81, 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 81, 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 20.008561016000002 2024-04-25T08:47:06.649 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:47:06.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 -- 172.21.15.172:0/225088302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 msgr2=0x7fda9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 0x7fda9806d990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8034000 tx=0x7fdaa802e000 comp rx=0 tx=0).stop 2024-04-25T08:47:06.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 -- 172.21.15.172:0/225088302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40711a0 msgr2=0x7fdab41f0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40711a0 0x7fdab41f0f10 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000c400 tx=0x7fdaa000c800 comp rx=0 tx=0).stop 2024-04-25T08:47:06.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 -- 172.21.15.172:0/225088302 shutdown_connections 2024-04-25T08:47:06.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 0x7fda9806d990 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab415deb0 0x7fdab415ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40711a0 0x7fdab41f0f10 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 --2- 172.21.15.172:0/225088302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab4070dc0 0x7fdab40ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 -- 172.21.15.172:0/225088302 >> 172.21.15.172:0/225088302 conn(0x7fdab40b3530 msgr2=0x7fdab40b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:06.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 -- 172.21.15.172:0/225088302 shutdown_connections 2024-04-25T08:47:06.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.651+0000 7fdabb05d640 1 -- 172.21.15.172:0/225088302 wait complete. 2024-04-25T08:47:06.653 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:47:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.760+0000 7f363548f640 1 Processor -- start 2024-04-25T08:47:06.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.760+0000 7f363548f640 1 -- start start 2024-04-25T08:47:06.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.760+0000 7f363548f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f36300b2cb0 0x7f36300d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.760+0000 7f363548f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f36300d1020 0x7f36300d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.760+0000 7f363548f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36300b97a0 con 0x7f363015dbe0 2024-04-25T08:47:06.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.760+0000 7f363548f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363015dfc0 con 0x7f36300b2cb0 2024-04-25T08:47:06.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.760+0000 7f363548f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36300d1a00 con 0x7f36300d1020 2024-04-25T08:47:06.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.761+0000 7f362e7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f36300b2cb0 0x7f36300d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.761+0000 7f362e7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f36300b2cb0 0x7f36300d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33986/0 (socket says 172.21.15.172:33986) 2024-04-25T08:47:06.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.761+0000 7f362effd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f363015dbe0 0x7f36300d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46598/0 (socket says 172.21.15.172:46598) 2024-04-25T08:47:06.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.761+0000 7f362e7fc640 1 -- 172.21.15.172:0/1568109453 learned_addr learned my addr 172.21.15.172:0/1568109453 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:06.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.761+0000 7f362f7fe640 1 --2- 172.21.15.172:0/1568109453 >> v2:172.21.15.186:3300/0 conn(0x7f36300d1020 0x7f36300d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.761+0000 7f362e7fc640 1 -- 172.21.15.172:0/1568109453 >> v2:172.21.15.186:3300/0 conn(0x7f36300d1020 msgr2=0x7f36300d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:06.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.761+0000 7f362e7fc640 1 --2- 172.21.15.172:0/1568109453 >> v2:172.21.15.186:3300/0 conn(0x7f36300d1020 0x7f36300d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.761+0000 7f362e7fc640 1 -- 172.21.15.172:0/1568109453 >> v1:172.21.15.172:6789/0 conn(0x7f363015dbe0 legacy=0x7f36300d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.761+0000 7f362dffb640 1 -- 172.21.15.172:0/1568109453 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312248082 0 0) 0x7f36300b97a0 con 0x7f363015dbe0 2024-04-25T08:47:06.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.761+0000 7f362e7fc640 1 -- 172.21.15.172:0/1568109453 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300d1c50 con 0x7f36300b2cb0 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f362e7fc640 1 --2- 172.21.15.172:0/1568109453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300b2cb0 0x7f36300d2730 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f36300cf570 tx=0x7f362402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0cad469655dd70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f362dffb640 1 -- 172.21.15.172:0/1568109453 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624037070 con 0x7f36300b2cb0 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f362dffb640 1 -- 172.21.15.172:0/1568109453 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3624032440 con 0x7f36300b2cb0 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f362dffb640 1 -- 172.21.15.172:0/1568109453 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624032810 con 0x7f36300b2cb0 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f363548f640 1 -- 172.21.15.172:0/1568109453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300b2cb0 msgr2=0x7f36300d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f363548f640 1 --2- 172.21.15.172:0/1568109453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300b2cb0 0x7f36300d2730 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f36300cf570 tx=0x7f362402a270 comp rx=0 tx=0).stop 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f363548f640 1 -- 172.21.15.172:0/1568109453 shutdown_connections 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f363548f640 1 --2- 172.21.15.172:0/1568109453 >> v2:172.21.15.186:3300/0 conn(0x7f36300d1020 0x7f36300d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f363548f640 1 --2- 172.21.15.172:0/1568109453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300b2cb0 0x7f36300d2730 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f363548f640 1 -- 172.21.15.172:0/1568109453 >> 172.21.15.172:0/1568109453 conn(0x7f3630061a20 msgr2=0x7f3630061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f363548f640 1 -- 172.21.15.172:0/1568109453 shutdown_connections 2024-04-25T08:47:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.762+0000 7f363548f640 1 -- 172.21.15.172:0/1568109453 wait complete. 2024-04-25T08:47:06.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f363548f640 1 Processor -- start 2024-04-25T08:47:06.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f363548f640 1 -- start start 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f363548f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36300b2cb0 0x7f3630160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f363548f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300d1020 0x7f3630151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f363548f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f363015dbe0 0x7f3630151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f363548f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300b92a0 con 0x7f36300d1020 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f363548f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300d2210 con 0x7f363015dbe0 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f363548f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36300b9420 con 0x7f36300b2cb0 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f362e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300d1020 0x7f3630151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f362e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300d1020 0x7f3630151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34002/0 (socket says 172.21.15.172:34002) 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.764+0000 7f362e7fc640 1 -- 172.21.15.172:0/2801614768 learned_addr learned my addr 172.21.15.172:0/2801614768 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f362f7fe640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f363015dbe0 0x7f3630151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f362effd640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36300b2cb0 0x7f3630160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f362e7fc640 1 -- 172.21.15.172:0/2801614768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36300b2cb0 msgr2=0x7f3630160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f362e7fc640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36300b2cb0 0x7f3630160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f362e7fc640 1 -- 172.21.15.172:0/2801614768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f363015dbe0 msgr2=0x7f3630151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f362e7fc640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f363015dbe0 0x7f3630151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f362e7fc640 1 -- 172.21.15.172:0/2801614768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300cba60 con 0x7f36300d1020 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f362e7fc640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300d1020 0x7f3630151940 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f3624000c00 tx=0x7f36240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f36177fe640 1 -- 172.21.15.172:0/2801614768 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624041020 con 0x7f36300d1020 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f36177fe640 1 -- 172.21.15.172:0/2801614768 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36240306c0 con 0x7f36300d1020 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f363548f640 1 -- 172.21.15.172:0/2801614768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36300caca0 con 0x7f36300d1020 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f36177fe640 1 -- 172.21.15.172:0/2801614768 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624037040 con 0x7f36300d1020 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.765+0000 7f363548f640 1 -- 172.21.15.172:0/2801614768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36300cb260 con 0x7f36300d1020 2024-04-25T08:47:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.766+0000 7f363548f640 1 -- 172.21.15.172:0/2801614768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36300caa30 con 0x7f36300d1020 2024-04-25T08:47:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.767+0000 7f36177fe640 1 -- 172.21.15.172:0/2801614768 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3624044020 con 0x7f36300d1020 2024-04-25T08:47:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.767+0000 7f36177fe640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f361c06b4d0 0x7f361c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.767+0000 7f36177fe640 1 -- 172.21.15.172:0/2801614768 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f36240aab30 con 0x7f36300d1020 2024-04-25T08:47:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.767+0000 7f362effd640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f361c06b4d0 0x7f361c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.768+0000 7f362effd640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f361c06b4d0 0x7f361c06d990 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f36200012e0 tx=0x7f3620005eb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.773+0000 7f36177fe640 1 -- 172.21.15.172:0/2801614768 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f362404b030 con 0x7f36300d1020 2024-04-25T08:47:06.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.976+0000 7f363548f640 1 -- 172.21.15.172:0/2801614768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3630073990 con 0x7f36300d1020 2024-04-25T08:47:06.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.977+0000 7f36177fe640 1 -- 172.21.15.172:0/2801614768 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f36240798b0 con 0x7f36300d1020 2024-04-25T08:47:06.968 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:47:06.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 -- 172.21.15.172:0/2801614768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f361c06b4d0 msgr2=0x7f361c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f361c06b4d0 0x7f361c06d990 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f36200012e0 tx=0x7f3620005eb0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 -- 172.21.15.172:0/2801614768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300d1020 msgr2=0x7f3630151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:06.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300d1020 0x7f3630151940 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f3624000c00 tx=0x7f36240046c0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 -- 172.21.15.172:0/2801614768 shutdown_connections 2024-04-25T08:47:06.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f361c06b4d0 0x7f361c06d990 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f363015dbe0 0x7f3630151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36300d1020 0x7f3630151940 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 --2- 172.21.15.172:0/2801614768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36300b2cb0 0x7f3630160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:06.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 -- 172.21.15.172:0/2801614768 >> 172.21.15.172:0/2801614768 conn(0x7f3630061a20 msgr2=0x7f363015c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:06.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 -- 172.21.15.172:0/2801614768 shutdown_connections 2024-04-25T08:47:06.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:06.979+0000 7f363548f640 1 -- 172.21.15.172:0/2801614768 wait complete. 2024-04-25T08:47:06.981 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:47:06.981 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:47:06.981 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:47:06.981 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:47:06.981 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:47:06.981 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:47:06.981 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:47:06.981 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:47:06.981 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:47:06.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:06.981 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:47:06.997 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42492sec preferred_lft 42492sec 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:47:06.998 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:47:06.999 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:47:06.999 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link 2024-04-25T08:47:06.999 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:47:06.999 INFO:teuthology.orchestra.run.smithi172.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:47:06.999 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether de:e6:d5:6e:7d:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:47:06.999 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::dce6:d5ff:fe6e:7d91/64 scope link 2024-04-25T08:47:06.999 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:47:06.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:06.999 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:47:07.059 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:47:07.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:07.060 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:47:07.116 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:47:07.116 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:47:07.116 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:47:07.116 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:47:07.116 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:47:07.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:07.117 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:47:07.117 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:47:07.117 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:47:07.117 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:47:07.117 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:47:07.117 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:47:07.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:07.199 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:47:07.255 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:47:07.255 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:47:07.255 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:47:07.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:07.256 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:47:07.319 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:47:07.319 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:47:07.375 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:47:07.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:47:07.375 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:47:07.429 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:47:07.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:07.429 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:47:07.511 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:47:07.511 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:47:07.511 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:47:07.519 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:47:07.519 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:47:07.519 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:47:07.519 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:47:07.519 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:47:07.524 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:47:07.524 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:47:07.524 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:47:07.524 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:47:07.524 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:47:07.524 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:47:07.524 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:47:07.525 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:47:07.528 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:47:07.528 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:47:07.528 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:47:07.528 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:47:07.529 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:47:07.529 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:47:07.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:07.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:47:07.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:07.599 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:47:07.659 INFO:teuthology.orchestra.run.smithi172.stdout:client6475 2024-04-25T08:47:07.659 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:47:07.659 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:47:07.714 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-04-25T08:47:07.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.865+0000 7fc86a13b640 1 Processor -- start 2024-04-25T08:47:07.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.865+0000 7fc86a13b640 1 -- start start 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.865+0000 7fc86a13b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8640ced80 0x7fc8640d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.865+0000 7fc86a13b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86415e000 con 0x7fc86415dc20 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.865+0000 7fc86a13b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8640d1de0 con 0x7fc864161710 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.865+0000 7fc86a13b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc864161c60 con 0x7fc8640ced80 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8637fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc86415dc20 0x7fc8640ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38492/0 (socket says 172.21.15.172:38492) 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8637fe640 1 -- 172.21.15.172:0/3964239496 learned_addr learned my addr 172.21.15.172:0/3964239496 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc862ffd640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8640ced80 0x7fc8640d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44231570 0 0) 0x7fc86415e000 con 0x7fc86415dc20 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc84c003520 con 0x7fc86415dc20 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4153798635 0 0) 0x7fc84c003520 con 0x7fc86415dc20 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8640ced80 msgr2=0x7fc8640d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8640ced80 0x7fc8640d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:07.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 >> v1:172.21.15.186:6789/0 conn(0x7fc864161710 legacy=0x7fc8640d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc864161f40 con 0x7fc86415dc20 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fc854001670 con 0x7fc86415dc20 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 >> v1:172.21.15.172:6789/0 conn(0x7fc86415dc20 legacy=0x7fc8640ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8640ced80 0x7fc84c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 0x7fc84c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc84c004d40 0x7fc84c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc864161c60 con 0x7fc84c003fb0 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c00bb00 con 0x7fc84c004d40 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c00bd00 con 0x7fc8640ced80 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc862ffd640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 0x7fc84c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc8637fe640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8640ced80 0x7fc84c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.866+0000 7fc863fff640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc84c004d40 0x7fc84c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.867+0000 7fc862ffd640 1 -- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8640ced80 msgr2=0x7fc84c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.867+0000 7fc862ffd640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8640ced80 0x7fc84c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:07.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.867+0000 7fc862ffd640 1 -- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc84c004d40 msgr2=0x7fc84c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.867+0000 7fc862ffd640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc84c004d40 0x7fc84c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.867+0000 7fc862ffd640 1 -- 172.21.15.172:0/3964239496 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c003520 con 0x7fc84c003fb0 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.867+0000 7fc863fff640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc84c004d40 0x7fc84c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.867+0000 7fc862ffd640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 0x7fc84c004800 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc858009ac0 tx=0x7fc84c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1770c3f37ade9895 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.867+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858036070 con 0x7fc84c003fb0 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.867+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc858031400 con 0x7fc84c003fb0 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.867+0000 7fc8627fc640 1 -- 172.21.15.172:0/3964239496 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858009690 con 0x7fc84c003fb0 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.868+0000 7fc86a13b640 1 -- 172.21.15.172:0/3964239496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 msgr2=0x7fc84c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.868+0000 7fc86a13b640 1 --2- 172.21.15.172:0/3964239496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 0x7fc84c004800 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc858009ac0 tx=0x7fc84c005830 comp rx=0 tx=0).stop 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.868+0000 7fc863fff640 1 -- 172.21.15.172:0/3964239496 reap_dead start 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.868+0000 7fc86a13b640 1 -- 172.21.15.172:0/3964239496 shutdown_connections 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.868+0000 7fc86a13b640 1 -- 172.21.15.172:0/3964239496 >> 172.21.15.172:0/3964239496 conn(0x7fc8640d0420 msgr2=0x7fc8640d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.868+0000 7fc86a13b640 1 -- 172.21.15.172:0/3964239496 shutdown_connections 2024-04-25T08:47:07.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.868+0000 7fc86a13b640 1 -- 172.21.15.172:0/3964239496 wait complete. 2024-04-25T08:47:07.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.869+0000 7fc86a13b640 1 Processor -- start 2024-04-25T08:47:07.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.869+0000 7fc86a13b640 1 -- start start 2024-04-25T08:47:07.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc86a13b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 0x7fc8640cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:07.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc86a13b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8641f7740 0x7fc8640caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:07.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc86a13b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8641603e0 0x7fc864160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:07.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc86a13b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640b5e50 con 0x7fc84c003fb0 2024-04-25T08:47:07.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc86a13b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc864162500 con 0x7fc8641603e0 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc86a13b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640b5fd0 con 0x7fc8641f7740 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc8637fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 0x7fc8640cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc8637fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 0x7fc8640cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:45660/0 (socket says 172.21.15.172:45660) 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc8637fe640 1 -- 172.21.15.172:0/3315008188 learned_addr learned my addr 172.21.15.172:0/3315008188 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc862ffd640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8641f7740 0x7fc8640caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc863fff640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8641603e0 0x7fc864160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc8637fe640 1 -- 172.21.15.172:0/3315008188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8641f7740 msgr2=0x7fc8640caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc8637fe640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8641f7740 0x7fc8640caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc8637fe640 1 -- 172.21.15.172:0/3315008188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8641603e0 msgr2=0x7fc864160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc8637fe640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8641603e0 0x7fc864160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc8637fe640 1 -- 172.21.15.172:0/3315008188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8640cafb0 con 0x7fc84c003fb0 2024-04-25T08:47:07.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc862ffd640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8641f7740 0x7fc8640caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.870+0000 7fc863fff640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8641603e0 0x7fc864160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.871+0000 7fc8637fe640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 0x7fc8640cd710 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fc8540072c0 tx=0x7fc8540076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.871+0000 7fc84bfff640 1 -- 172.21.15.172:0/3315008188 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85401a070 con 0x7fc84c003fb0 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.871+0000 7fc84bfff640 1 -- 172.21.15.172:0/3315008188 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85400f960 con 0x7fc84c003fb0 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.871+0000 7fc84bfff640 1 -- 172.21.15.172:0/3315008188 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400fd30 con 0x7fc84c003fb0 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.871+0000 7fc86a13b640 1 -- 172.21.15.172:0/3315008188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8640cb230 con 0x7fc84c003fb0 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.871+0000 7fc86a13b640 1 -- 172.21.15.172:0/3315008188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8641f6f40 con 0x7fc84c003fb0 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.872+0000 7fc86a13b640 1 -- 172.21.15.172:0/3315008188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc864073a00 con 0x7fc84c003fb0 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.872+0000 7fc84bfff640 1 -- 172.21.15.172:0/3315008188 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc85401d070 con 0x7fc84c003fb0 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.873+0000 7fc84bfff640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 0x7fc85006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.873+0000 7fc84bfff640 1 -- 172.21.15.172:0/3315008188 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc854089e30 con 0x7fc84c003fb0 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.873+0000 7fc862ffd640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 0x7fc85006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:07.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.873+0000 7fc862ffd640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 0x7fc85006d990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc858033000 tx=0x7fc858008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:07.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:07.877+0000 7fc84bfff640 1 -- 172.21.15.172:0/3315008188 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc8640cafb0 con 0x7fc84c003fb0 2024-04-25T08:47:08.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.085+0000 7fc86a13b640 1 -- 172.21.15.172:0/3315008188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc8640d16b0 con 0x7fc84c003fb0 2024-04-25T08:47:08.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.780+0000 7fc84bfff640 1 -- 172.21.15.172:0/3315008188 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v50) v1 ==== 167+0+0 (secure 0 0 0) 0x7fc854058b20 con 0x7fc84c003fb0 2024-04-25T08:47:08.772 INFO:teuthology.orchestra.run.smithi172.stderr:enabled new snapshots 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 -- 172.21.15.172:0/3315008188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 msgr2=0x7fc85006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 0x7fc85006d990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc858033000 tx=0x7fc858008030 comp rx=0 tx=0).stop 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 -- 172.21.15.172:0/3315008188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 msgr2=0x7fc8640cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 0x7fc8640cd710 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fc8540072c0 tx=0x7fc8540076c0 comp rx=0 tx=0).stop 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 -- 172.21.15.172:0/3315008188 shutdown_connections 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 0x7fc85006d990 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8641603e0 0x7fc864160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8641f7740 0x7fc8640caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 --2- 172.21.15.172:0/3315008188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc84c003fb0 0x7fc8640cd710 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 -- 172.21.15.172:0/3315008188 >> 172.21.15.172:0/3315008188 conn(0x7fc8640d0420 msgr2=0x7fc8640d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 -- 172.21.15.172:0/3315008188 shutdown_connections 2024-04-25T08:47:08.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:08.783+0000 7fc86a13b640 1 -- 172.21.15.172:0/3315008188 wait complete. 2024-04-25T08:47:08.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:08.786 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-04-25T08:47:08.807 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:47:08.807 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:47:08.863 DEBUG:teuthology.orchestra.run.smithi172:> stdin-killer -- python3 -c ' 2024-04-25T08:47:08.863 DEBUG:teuthology.orchestra.run.smithi172:> import os 2024-04-25T08:47:08.863 DEBUG:teuthology.orchestra.run.smithi172:> import uuid 2024-04-25T08:47:08.863 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> n = 2000 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> create_hard_links = False 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> if 3 > 0: 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> create_hard_links = True 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> dpath = os.path.dirname(path) 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> fnameprefix = os.path.basename(path) 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> os.makedirs(dpath, exist_ok=True) 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> try: 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> for i in range(n): 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> with open(fpath, '"'"'w'"'"') as f: 2024-04-25T08:47:08.864 DEBUG:teuthology.orchestra.run.smithi172:> f.write(f"{i}") 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> if False: 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> f.flush() 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> os.fsync(f.fileno()) 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> if False: 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> os.unlink(fpath) 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> if False: 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> os.fsync(dirfd) 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> if create_hard_links: 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> for j in range(3): 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> if False: 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> os.fsync(dirfd) 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> finally: 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> os.close(dirfd) 2024-04-25T08:47:08.865 DEBUG:teuthology.orchestra.run.smithi172:> ' 2024-04-25T08:47:25.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T08:47:25.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:25.178 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T08:47:25.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:25.479 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-04-25T08:47:30.116 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:47:30.119 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:47:51.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:51.915 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-04-25T08:47:51.936 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:47:51.937 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2024-04-25T08:47:52.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.105+0000 7fdd76ee2640 1 Processor -- start 2024-04-25T08:47:52.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.105+0000 7fdd76ee2640 1 -- start start 2024-04-25T08:47:52.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd76ee2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdd7015fd40 0x7fdd700b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd76ee2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700af5e0 0x7fdd7006c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd76ee2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd700b52f0 con 0x7fdd700b4f10 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd76ee2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7006bc40 con 0x7fdd7015fd40 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd76ee2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700adaa0 con 0x7fdd700af5e0 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd7547f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700af5e0 0x7fdd7006c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd6ffff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdd7015fd40 0x7fdd700b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd6ffff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdd7015fd40 0x7fdd700b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:33908/0 (socket says 172.21.15.172:33908) 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd74c7e640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fdd700b4f10 0x7fdd7015f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:40446/0 (socket says 172.21.15.172:40446) 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd7547f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700af5e0 0x7fdd7006c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:56622/0 (socket says 172.21.15.172:56622) 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd6ffff640 1 -- 172.21.15.172:0/2505136256 learned_addr learned my addr 172.21.15.172:0/2505136256 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd7547f640 1 -- 172.21.15.172:0/2505136256 >> v2:172.21.15.186:3300/0 conn(0x7fdd7015fd40 msgr2=0x7fdd700b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd6f7fe640 1 -- 172.21.15.172:0/2505136256 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479574459 0 0) 0x7fdd700b52f0 con 0x7fdd700b4f10 2024-04-25T08:47:52.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd7547f640 1 --2- 172.21.15.172:0/2505136256 >> v2:172.21.15.186:3300/0 conn(0x7fdd7015fd40 0x7fdd700b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd7547f640 1 -- 172.21.15.172:0/2505136256 >> v1:172.21.15.186:6789/0 conn(0x7fdd700b4f10 legacy=0x7fdd7015f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.106+0000 7fdd7547f640 1 -- 172.21.15.172:0/2505136256 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700add80 con 0x7fdd700af5e0 2024-04-25T08:47:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.107+0000 7fdd7547f640 1 --2- 172.21.15.172:0/2505136256 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700af5e0 0x7fdd7006c0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009d90 tx=0x7fdd6802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2fa19915763ef66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.107+0000 7fdd6f7fe640 1 -- 172.21.15.172:0/2505136256 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68007740 con 0x7fdd700af5e0 2024-04-25T08:47:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.107+0000 7fdd6f7fe640 1 -- 172.21.15.172:0/2505136256 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd680078e0 con 0x7fdd700af5e0 2024-04-25T08:47:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.107+0000 7fdd6f7fe640 1 -- 172.21.15.172:0/2505136256 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68007cb0 con 0x7fdd700af5e0 2024-04-25T08:47:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.108+0000 7fdd76ee2640 1 -- 172.21.15.172:0/2505136256 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700af5e0 msgr2=0x7fdd7006c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.108+0000 7fdd76ee2640 1 --2- 172.21.15.172:0/2505136256 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700af5e0 0x7fdd7006c0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009d90 tx=0x7fdd6802a660 comp rx=0 tx=0).stop 2024-04-25T08:47:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.108+0000 7fdd76ee2640 1 -- 172.21.15.172:0/2505136256 shutdown_connections 2024-04-25T08:47:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.108+0000 7fdd76ee2640 1 --2- 172.21.15.172:0/2505136256 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700af5e0 0x7fdd7006c0d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.108+0000 7fdd76ee2640 1 --2- 172.21.15.172:0/2505136256 >> v2:172.21.15.186:3300/0 conn(0x7fdd7015fd40 0x7fdd700b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.108+0000 7fdd76ee2640 1 -- 172.21.15.172:0/2505136256 >> 172.21.15.172:0/2505136256 conn(0x7fdd700cfec0 msgr2=0x7fdd700d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.108+0000 7fdd76ee2640 1 -- 172.21.15.172:0/2505136256 shutdown_connections 2024-04-25T08:47:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.108+0000 7fdd76ee2640 1 -- 172.21.15.172:0/2505136256 wait complete. 2024-04-25T08:47:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.109+0000 7fdd76ee2640 1 Processor -- start 2024-04-25T08:47:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.109+0000 7fdd76ee2640 1 -- start start 2024-04-25T08:47:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd76ee2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd700af5e0 0x7fdd700afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd76ee2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700b4f10 0x7fdd700b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd76ee2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd7015fd40 0x7fdd7009bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd76ee2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700ad730 con 0x7fdd7015fd40 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd76ee2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7006b8d0 con 0x7fdd700af5e0 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd76ee2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700b3910 con 0x7fdd700b4f10 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd7547f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd7015fd40 0x7fdd7009bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd7547f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd7015fd40 0x7fdd7009bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48506/0 (socket says 172.21.15.172:48506) 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd7547f640 1 -- 172.21.15.172:0/3844157604 learned_addr learned my addr 172.21.15.172:0/3844157604 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700b4f10 0x7fdd700b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.110+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd700af5e0 0x7fdd700afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd6ffff640 1 -- 172.21.15.172:0/3844157604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd700af5e0 msgr2=0x7fdd700afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd700af5e0 0x7fdd700afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd6ffff640 1 -- 172.21.15.172:0/3844157604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd7015fd40 msgr2=0x7fdd7009bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd7015fd40 0x7fdd7009bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd6ffff640 1 -- 172.21.15.172:0/3844157604 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd701f5960 con 0x7fdd700b4f10 2024-04-25T08:47:52.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700b4f10 0x7fdd700b01a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00e8a0 tx=0x7fdd5c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd6d7fa640 1 -- 172.21.15.172:0/3844157604 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c017070 con 0x7fdd700b4f10 2024-04-25T08:47:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd6d7fa640 1 -- 172.21.15.172:0/3844157604 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c00c940 con 0x7fdd700b4f10 2024-04-25T08:47:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd76ee2640 1 -- 172.21.15.172:0/3844157604 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd701f4ba0 con 0x7fdd700b4f10 2024-04-25T08:47:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd6d7fa640 1 -- 172.21.15.172:0/3844157604 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c009e60 con 0x7fdd700b4f10 2024-04-25T08:47:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.111+0000 7fdd76ee2640 1 -- 172.21.15.172:0/3844157604 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd701f5160 con 0x7fdd700b4f10 2024-04-25T08:47:52.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.112+0000 7fdd6d7fa640 1 -- 172.21.15.172:0/3844157604 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd5c01a070 con 0x7fdd700b4f10 2024-04-25T08:47:52.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.113+0000 7fdd6d7fa640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd5406b500 0x7fdd5406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.113+0000 7fdd6d7fa640 1 -- 172.21.15.172:0/3844157604 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdd5c08a3d0 con 0x7fdd700b4f10 2024-04-25T08:47:52.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.113+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd5406b500 0x7fdd5406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.113+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd5406b500 0x7fdd5406d9c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdd64000f60 tx=0x7fdd64007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.114+0000 7fdd79be2740 1 Processor -- start 2024-04-25T08:47:52.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.114+0000 7fdd79be2740 1 -- start start 2024-04-25T08:47:52.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.114+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x563843460e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.114+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x56384345f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.114+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x563843489be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.114+0000 7fdd79be2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638433c1b90 con 0x56384345eca0 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.114+0000 7fdd79be2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56384336ae40 con 0x563843489760 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.114+0000 7fdd79be2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638433bdc30 con 0x56384349b370 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd74c7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x563843460e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd74c7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x563843460e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48520/0 (socket says 172.21.15.172:48520) 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd74c7e640 1 -- 172.21.15.172:0/3606142343 learned_addr learned my addr 172.21.15.172:0/3606142343 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/3606142343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x56384345f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd7547f640 1 --2- 172.21.15.172:0/3606142343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x563843489be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd74c7e640 1 -- 172.21.15.172:0/3606142343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 msgr2=0x56384345f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/3606142343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x56384345f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd74c7e640 1 -- 172.21.15.172:0/3606142343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 msgr2=0x563843489be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/3606142343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x563843489be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd74c7e640 1 -- 172.21.15.172:0/3606142343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638431a07d0 con 0x56384345eca0 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/3606142343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x563843460e00 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fdd64004fc0 tx=0x7fdd64013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3154baea9e24bd2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd5a7fc640 1 -- 172.21.15.172:0/3606142343 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd64026070 con 0x56384345eca0 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd5a7fc640 1 -- 172.21.15.172:0/3606142343 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd64013b80 con 0x56384345eca0 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.115+0000 7fdd5a7fc640 1 -- 172.21.15.172:0/3606142343 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd64012350 con 0x56384345eca0 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.116+0000 7fdd79be2740 1 -- 172.21.15.172:0/3606142343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 msgr2=0x563843460e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.116+0000 7fdd79be2740 1 --2- 172.21.15.172:0/3606142343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x563843460e00 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fdd64004fc0 tx=0x7fdd64013000 comp rx=0 tx=0).stop 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.116+0000 7fdd79be2740 1 -- 172.21.15.172:0/3606142343 shutdown_connections 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.116+0000 7fdd79be2740 1 --2- 172.21.15.172:0/3606142343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x563843489be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.116+0000 7fdd79be2740 1 --2- 172.21.15.172:0/3606142343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x56384345f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.116+0000 7fdd79be2740 1 --2- 172.21.15.172:0/3606142343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x563843460e00 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.116+0000 7fdd79be2740 1 -- 172.21.15.172:0/3606142343 >> 172.21.15.172:0/3606142343 conn(0x563843426870 msgr2=0x5638434a4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.116+0000 7fdd79be2740 1 -- 172.21.15.172:0/3606142343 shutdown_connections 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.116+0000 7fdd79be2740 1 -- 172.21.15.172:0/3606142343 wait complete. 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.116+0000 7fdd79be2740 1 -- start start 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd79be2740 1 Processor -- start 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384348b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x56384349e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x56384349e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd79be2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56384337e3e0 con 0x56384345eca0 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd79be2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638434872b0 con 0x563843489760 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd79be2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56384349d4d0 con 0x56384349b370 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd79be2740 10 client.0 _ll_register_callbacks cb 0x56384337ddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd74c7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384348b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd74c7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384348b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48524/0 (socket says 172.21.15.172:48524) 2024-04-25T08:47:52.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd74c7e640 1 -- 172.21.15.172:0/4168793485 learned_addr learned my addr 172.21.15.172:0/4168793485 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd7547f640 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x56384349e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.117+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x56384349e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd74c7e640 1 -- 172.21.15.172:0/4168793485 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 msgr2=0x56384349e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x56384349e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd74c7e640 1 -- 172.21.15.172:0/4168793485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 msgr2=0x56384349e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x56384349e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd74c7e640 1 -- 172.21.15.172:0/4168793485 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638430960f0 con 0x56384345eca0 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384348b540 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fdd64022a40 tx=0x7fdd64000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb0c0269b6ce907 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/4168793485 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd64026040 con 0x56384345eca0 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/4168793485 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdd64013d30 con 0x56384345eca0 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd79be2740 1 -- 172.21.15.172:0/4168793485 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd64013b80 con 0x56384345eca0 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/4168793485 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd64038050 con 0x56384345eca0 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd79be2740 10 client.7413 fetch_fsmap learned FSMap version 50 2024-04-25T08:47:52.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd79be2740 1 -- 172.21.15.172:0/4168793485 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x563843200f60 con 0x56384345eca0 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/4168793485 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd64013b80 con 0x56384345eca0 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/4168793485 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdd6403b020 con 0x56384345eca0 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd79be2740 10 client.7413 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd79be2740 10 client.7413 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd79be2740 20 client.7413 populate_metadata read hostname 'smithi172' 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd79be2740 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x5638434b7d10 0x5638434b8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd79be2740 4 client.7413 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.118+0000 7fdd79be2740 1 -- 172.21.15.172:0/4168793485 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638433cf0d0 con 0x5638434b7d10 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.119+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x5638434b7d10 0x5638434b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.119+0000 7fdd4f7fe640 10 client.7413 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.119+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x5638434b7d10 0x5638434b8120 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1b82c247ddb442 server_cookie=4e6a76bb25895a16 in_seq=0 out_seq=0 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.119+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/4168793485 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5638433cf0d0 con 0x5638434b7d10 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.119+0000 7fdd4f7fe640 10 client.7413 handle_command_reply: tid=0 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.119+0000 7fdd79be2740 1 client.7413 shutdown 2024-04-25T08:47:52.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 1 -- 172.21.15.172:0/4168793485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 msgr2=0x56384348b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384348b540 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fdd64022a40 tx=0x7fdd64000ed0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 1 -- 172.21.15.172:0/4168793485 shutdown_connections 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x5638434b7d10 0x5638434b8120 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x56384349e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x56384349e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 1 --2- 172.21.15.172:0/4168793485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384348b540 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd4f7fe640 0 client.7413 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 1 -- 172.21.15.172:0/4168793485 >> 172.21.15.172:0/4168793485 conn(0x563843426870 msgr2=0x563843486a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 1 -- 172.21.15.172:0/4168793485 shutdown_connections 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 1 -- 172.21.15.172:0/4168793485 wait complete. 2024-04-25T08:47:52.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.120+0000 7fdd79be2740 20 client.7413 trim_cache size 0 max 16384 2024-04-25T08:47:52.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.134+0000 7fdd79be2740 1 Processor -- start 2024-04-25T08:47:52.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.134+0000 7fdd79be2740 1 -- start start 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56384345eca0 0x56384348b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563843489760 0x5638434b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x563843488c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd79be2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd701fe0b0 con 0x563843489760 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd79be2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd701fd210 con 0x56384345eca0 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd79be2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7009aad0 con 0x56384349b370 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd6ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563843489760 0x5638434b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd6ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563843489760 0x5638434b76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48534/0 (socket says 172.21.15.172:48534) 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd6ffff640 1 -- 172.21.15.172:0/710208397 learned_addr learned my addr 172.21.15.172:0/710208397 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/710208397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56384345eca0 0x56384348b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd7547f640 1 --2- 172.21.15.172:0/710208397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x563843488c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd6ffff640 1 -- 172.21.15.172:0/710208397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 msgr2=0x563843488c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/710208397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x563843488c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd6ffff640 1 -- 172.21.15.172:0/710208397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56384345eca0 msgr2=0x56384348b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/710208397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56384345eca0 0x56384348b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd6ffff640 1 -- 172.21.15.172:0/710208397 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56384306f1b0 con 0x563843489760 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/710208397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563843489760 0x5638434b76b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c054f60 tx=0x7fdd5c0886d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e01d7af9de8cfe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd59ffb640 1 -- 172.21.15.172:0/710208397 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c021040 con 0x563843489760 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd59ffb640 1 -- 172.21.15.172:0/710208397 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c056e00 con 0x563843489760 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.135+0000 7fdd59ffb640 1 -- 172.21.15.172:0/710208397 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c00cd10 con 0x563843489760 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.136+0000 7fdd79be2740 1 -- 172.21.15.172:0/710208397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563843489760 msgr2=0x5638434b76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.136+0000 7fdd79be2740 1 --2- 172.21.15.172:0/710208397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563843489760 0x5638434b76b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c054f60 tx=0x7fdd5c0886d0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.136+0000 7fdd79be2740 1 -- 172.21.15.172:0/710208397 shutdown_connections 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.136+0000 7fdd79be2740 1 --2- 172.21.15.172:0/710208397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x563843488c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.136+0000 7fdd79be2740 1 --2- 172.21.15.172:0/710208397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563843489760 0x5638434b76b0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.136+0000 7fdd79be2740 1 --2- 172.21.15.172:0/710208397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56384345eca0 0x56384348b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.136+0000 7fdd79be2740 1 -- 172.21.15.172:0/710208397 >> 172.21.15.172:0/710208397 conn(0x563843426870 msgr2=0x5638434a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.136+0000 7fdd79be2740 1 -- 172.21.15.172:0/710208397 shutdown_connections 2024-04-25T08:47:52.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.136+0000 7fdd79be2740 1 -- 172.21.15.172:0/710208397 wait complete. 2024-04-25T08:47:52.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.136+0000 7fdd79be2740 1 -- start start 2024-04-25T08:47:52.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.137+0000 7fdd79be2740 1 Processor -- start 2024-04-25T08:47:52.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.137+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384350e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.137+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x563843485b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.137+0000 7fdd79be2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x563843486040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.137+0000 7fdd79be2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd701fcd90 con 0x56384345eca0 2024-04-25T08:47:52.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.137+0000 7fdd79be2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56384349f710 con 0x563843489760 2024-04-25T08:47:52.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.137+0000 7fdd79be2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638434c3830 con 0x56384349b370 2024-04-25T08:47:52.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.137+0000 7fdd79be2740 10 client.0 _ll_register_callbacks cb 0x7fdd64024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:47:52.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.137+0000 7fdd74c7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384350e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd74c7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384350e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48544/0 (socket says 172.21.15.172:48544) 2024-04-25T08:47:52.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd74c7e640 1 -- 172.21.15.172:0/3903983289 learned_addr learned my addr 172.21.15.172:0/3903983289 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd7547f640 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x563843486040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x563843485b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd74c7e640 1 -- 172.21.15.172:0/3903983289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 msgr2=0x563843486040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x563843486040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd74c7e640 1 -- 172.21.15.172:0/3903983289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 msgr2=0x563843485b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x563843485b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd74c7e640 1 -- 172.21.15.172:0/3903983289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56384345e420 con 0x56384345eca0 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd74c7e640 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384350e400 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fdd64022a40 tx=0x7fdd64009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a2d3e5a78152fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/3903983289 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd64026040 con 0x56384345eca0 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/3903983289 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdd64020420 con 0x56384345eca0 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd79be2740 1 -- 172.21.15.172:0/3903983289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd5c056e00 con 0x56384345eca0 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/3903983289 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd64049050 con 0x56384345eca0 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd79be2740 10 client.7419 fetch_fsmap learned FSMap version 50 2024-04-25T08:47:52.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd79be2740 1 -- 172.21.15.172:0/3903983289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x5638434c3570 con 0x56384345eca0 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/3903983289 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c056e00 con 0x56384345eca0 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/3903983289 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdd6404c020 con 0x56384345eca0 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd79be2740 10 client.7419 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd79be2740 10 client.7419 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.138+0000 7fdd79be2740 20 client.7419 populate_metadata read hostname 'smithi172' 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.139+0000 7fdd79be2740 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56384349d6f0 0x56384348a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.139+0000 7fdd79be2740 4 client.7419 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.139+0000 7fdd79be2740 1 -- 172.21.15.172:0/3903983289 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x5638433c9420 con 0x56384349d6f0 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.139+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56384349d6f0 0x56384348a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.139+0000 7fdd4f7fe640 10 client.7419 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.139+0000 7fdd6ffff640 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56384349d6f0 0x56384348a4e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ddf870084b3ae88 server_cookie=7c61015917bcf833 in_seq=0 out_seq=0 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.139+0000 7fdd4f7fe640 1 -- 172.21.15.172:0/3903983289 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17929 (crc 0 0 0) 0x5638433c9420 con 0x56384349d6f0 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.139+0000 7fdd4f7fe640 10 client.7419 handle_command_reply: tid=0 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.139+0000 7fdd79be2740 1 client.7419 shutdown 2024-04-25T08:47:52.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 1 -- 172.21.15.172:0/3903983289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 msgr2=0x56384350e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384350e400 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fdd64022a40 tx=0x7fdd64009030 comp rx=0 tx=0).stop 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 1 -- 172.21.15.172:0/3903983289 shutdown_connections 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x56384349d6f0 0x56384348a4e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563843489760 0x563843485b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56384349b370 0x563843486040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd4f7fe640 0 client.7419 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 1 --2- 172.21.15.172:0/3903983289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56384345eca0 0x56384350e400 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 1 -- 172.21.15.172:0/3903983289 >> 172.21.15.172:0/3903983289 conn(0x563843426870 msgr2=0x5638434b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 1 -- 172.21.15.172:0/3903983289 shutdown_connections 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 1 -- 172.21.15.172:0/3903983289 wait complete. 2024-04-25T08:47:52.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd79be2740 20 client.7419 trim_cache size 0 max 16384 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1410, 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1410, 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 565669, 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 18255817, 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 9, 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.200896841, 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.114240493, 2024-04-25T08:47:52.138 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.026615160, 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.048362600, 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1409, 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.465244884, 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000330195 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000158, 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000079 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.139 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 28768, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 51260, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 9059397, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 55855670, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 7, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 2.854302000, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 2.220315984, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 1.039544984, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.044831215, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 51259, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.334194838, 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000026028 2024-04-25T08:47:52.140 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 49595, 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.008338947, 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000168 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 115552, 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 18480 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 2290, 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2304, 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 569576, 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 48452466, 2024-04-25T08:47:52.141 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.325957198, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.183752960, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.049820293, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.078945182, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2303, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.324526111, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000140914 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.142 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 107392 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1289, 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 16.354039486, 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.012687385 2024-04-25T08:47:52.143 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1601, 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.943951255, 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000589601 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 25652, 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 25652, 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 25652, 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 281.270430688, 2024-04-25T08:47:52.144 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.010964853 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 12, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 19747, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 19747, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 19747, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-04-25T08:47:52.145 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 58, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 58, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 46565, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 46176, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 100, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-04-25T08:47:52.146 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-04-25T08:47:52.147 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 1350, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 4042, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 4103, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 3263, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 17, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 14017 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-04-25T08:47:52.148 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 1664, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 4073, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 1944, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 2169, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-04-25T08:47:52.149 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 30251, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 30251, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 49, 2024-04-25T08:47:52.150 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 49, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 4, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 105371416, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2595, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 84.164025947, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.032433150 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-04-25T08:47:52.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 2014, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 2014, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 0, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 13, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 13, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 0, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 19747, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 19748, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 1, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 58, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 2315, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 2257, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 113668, 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215396 2024-04-25T08:47:52.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 28496, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 25652, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 3, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2000, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.429438752, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000714719 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 29, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.004279944, 2024-04-25T08:47:52.153 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000147584 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6000, 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 7.019271372, 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001169878 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7441, 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 6.500271986, 2024-04-25T08:47:52.154 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000873575 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000039989, 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000039989 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.156 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002757826, 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002757826 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.236674615, 2024-04-25T08:47:52.157 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.236674615 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8, 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.500241188, 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.187530148 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2169, 2024-04-25T08:47:52.158 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 248.304724516, 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.114478895 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.159 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.006052644, 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006052644 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000249184, 2024-04-25T08:47:52.160 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000249184 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.161 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8000, 2024-04-25T08:47:52.162 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 16.266428672, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002033303 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 1, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-04-25T08:47:52.163 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 18820, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 18820, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 44, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T08:47:52.164 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-04-25T08:47:52.165 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 19757098, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 7030, 2024-04-25T08:47:52.166 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 440, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 5, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 5424, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 76, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 21740005, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 891498, 2024-04-25T08:47:52.167 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 4732, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 101459796, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 37, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 4732, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4732, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 21.983467754, 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004645703 2024-04-25T08:47:52.168 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4732, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4819 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 4732, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 33, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 4699, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 11, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 33, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 2628, 2024-04-25T08:47:52.169 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 23, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 1608, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 372, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 22, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-04-25T08:47:52.170 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-04-25T08:47:52.171 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 81, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 1, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 8, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 8, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 93, 2024-04-25T08:47:52.172 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 29 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-04-25T08:47:52.173 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 32, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 1944, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 1944, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 32463, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 7710603, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 32463, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:47:52.174 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 32463, 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 7710603, 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:47:52.175 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 4732, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 101669004, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4732, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 101669004, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-04-25T08:47:52.176 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 4732, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 4732, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4732, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 4732, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.177 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1944, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 209208, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1944, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 33, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 209208, 2024-04-25T08:47:52.178 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x563d9d4606e0": { 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 201348, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 30251, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 101177112, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 30251, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:47:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:47:52.180 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2595, 2024-04-25T08:47:52.180 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 100975764, 2024-04-25T08:47:52.180 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:47:52.180 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:47:52.180 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:47:52.180 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:47:52.180 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.180 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.180 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:47:52.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 -- 172.21.15.172:0/3844157604 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd5406b500 msgr2=0x7fdd5406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd5406b500 0x7fdd5406d9c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdd64000f60 tx=0x7fdd64007d50 comp rx=0 tx=0).stop 2024-04-25T08:47:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 -- 172.21.15.172:0/3844157604 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700b4f10 msgr2=0x7fdd700b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700b4f10 0x7fdd700b01a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00e8a0 tx=0x7fdd5c00ed60 comp rx=0 tx=0).stop 2024-04-25T08:47:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 -- 172.21.15.172:0/3844157604 shutdown_connections 2024-04-25T08:47:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd5406b500 0x7fdd5406d9c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd7015fd40 0x7fdd7009bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd700b4f10 0x7fdd700b01a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 --2- 172.21.15.172:0/3844157604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd700af5e0 0x7fdd700afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 -- 172.21.15.172:0/3844157604 >> 172.21.15.172:0/3844157604 conn(0x7fdd700cfec0 msgr2=0x7fdd700b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 -- 172.21.15.172:0/3844157604 shutdown_connections 2024-04-25T08:47:52.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.140+0000 7fdd76ee2640 1 -- 172.21.15.172:0/3844157604 wait complete. 2024-04-25T08:47:52.183 INFO:tasks.cephfs.test_scrub_checks:num of strays: 1664 2024-04-25T08:47:52.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:52.183 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start '~mdsdir' recursive 2024-04-25T08:47:52.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.293+0000 7f2a4408f640 1 Processor -- start 2024-04-25T08:47:52.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.294+0000 7f2a4408f640 1 -- start start 2024-04-25T08:47:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.294+0000 7f2a4408f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 0x7f2a3c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.294+0000 7f2a4408f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c072280 con 0x7f2a3c0cc4f0 2024-04-25T08:47:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.294+0000 7f2a4408f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c0714c0 con 0x7f2a3c15b270 2024-04-25T08:47:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.294+0000 7f2a4408f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c071270 con 0x7f2a3c0ce230 2024-04-25T08:47:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.295+0000 7f2a41e2b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2a3c0cc4f0 0x7f2a3c0cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54052/0 (socket says 172.21.15.172:54052) 2024-04-25T08:47:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.295+0000 7f2a41e2b640 1 -- 172.21.15.172:0/3961323590 learned_addr learned my addr 172.21.15.172:0/3961323590 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:47:52.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.295+0000 7f2a4162a640 1 --2- 172.21.15.172:0/3961323590 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 0x7f2a3c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.295+0000 7f2a40e29640 1 -- 172.21.15.172:0/3961323590 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452571060 0 0) 0x7f2a3c072280 con 0x7f2a3c0cc4f0 2024-04-25T08:47:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.295+0000 7f2a40e29640 1 -- 172.21.15.172:0/3961323590 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a28003520 con 0x7f2a3c0cc4f0 2024-04-25T08:47:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.295+0000 7f2a40e29640 1 -- 172.21.15.172:0/3961323590 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495530378 0 0) 0x7f2a3c0714c0 con 0x7f2a3c15b270 2024-04-25T08:47:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.295+0000 7f2a4162a640 1 -- 172.21.15.172:0/3961323590 >> v1:172.21.15.186:6789/0 conn(0x7f2a3c15b270 legacy=0x7f2a3c15b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.295+0000 7f2a4162a640 1 -- 172.21.15.172:0/3961323590 >> v1:172.21.15.172:6789/0 conn(0x7f2a3c0cc4f0 legacy=0x7f2a3c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.295+0000 7f2a4162a640 1 -- 172.21.15.172:0/3961323590 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c0717a0 con 0x7f2a3c0ce230 2024-04-25T08:47:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a4162a640 1 --2- 172.21.15.172:0/3961323590 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 0x7f2a3c0cc8d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097d0 tx=0x7f2a2c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27dc95446625df7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a40e29640 1 -- 172.21.15.172:0/3961323590 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c037070 con 0x7f2a3c0ce230 2024-04-25T08:47:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a40e29640 1 -- 172.21.15.172:0/3961323590 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c032440 con 0x7f2a3c0ce230 2024-04-25T08:47:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a40e29640 1 -- 172.21.15.172:0/3961323590 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0327f0 con 0x7f2a3c0ce230 2024-04-25T08:47:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a4408f640 1 -- 172.21.15.172:0/3961323590 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 msgr2=0x7f2a3c0cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a4408f640 1 --2- 172.21.15.172:0/3961323590 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 0x7f2a3c0cc8d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097d0 tx=0x7f2a2c02a210 comp rx=0 tx=0).stop 2024-04-25T08:47:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a4408f640 1 -- 172.21.15.172:0/3961323590 shutdown_connections 2024-04-25T08:47:52.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a4408f640 1 --2- 172.21.15.172:0/3961323590 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 0x7f2a3c0cc8d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a4408f640 1 -- 172.21.15.172:0/3961323590 >> 172.21.15.172:0/3961323590 conn(0x7f2a3c06abe0 msgr2=0x7f2a3c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a4408f640 1 -- 172.21.15.172:0/3961323590 shutdown_connections 2024-04-25T08:47:52.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.296+0000 7f2a4408f640 1 -- 172.21.15.172:0/3961323590 wait complete. 2024-04-25T08:47:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4408f640 1 Processor -- start 2024-04-25T08:47:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4408f640 1 -- start start 2024-04-25T08:47:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4408f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a3c0cc4f0 0x7f2a3c0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4408f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 0x7f2a3c14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4408f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a3c15b270 0x7f2a3c0a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4408f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c06e8a0 con 0x7f2a3c15b270 2024-04-25T08:47:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4408f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c071d60 con 0x7f2a3c0cc4f0 2024-04-25T08:47:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4408f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0ae500 con 0x7f2a3c0ce230 2024-04-25T08:47:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4262c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a3c15b270 0x7f2a3c0a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4162a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 0x7f2a3c14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a41e2b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a3c0cc4f0 0x7f2a3c0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4262c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a3c15b270 0x7f2a3c0a9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48552/0 (socket says 172.21.15.172:48552) 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.298+0000 7f2a4262c640 1 -- 172.21.15.172:0/968623678 learned_addr learned my addr 172.21.15.172:0/968623678 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a4262c640 1 -- 172.21.15.172:0/968623678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 msgr2=0x7f2a3c14f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a4262c640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 0x7f2a3c14f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a4262c640 1 -- 172.21.15.172:0/968623678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a3c0cc4f0 msgr2=0x7f2a3c0adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a4262c640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a3c0cc4f0 0x7f2a3c0adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a4262c640 1 -- 172.21.15.172:0/968623678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c14fa00 con 0x7f2a3c15b270 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a4162a640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 0x7f2a3c14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a4262c640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a3c15b270 0x7f2a3c0a9100 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800c460 tx=0x7f2a3800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a327fc640 1 -- 172.21.15.172:0/968623678 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38017070 con 0x7f2a3c15b270 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a327fc640 1 -- 172.21.15.172:0/968623678 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a380035f0 con 0x7f2a3c15b270 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a4408f640 1 -- 172.21.15.172:0/968623678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c15a600 con 0x7f2a3c15b270 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a327fc640 1 -- 172.21.15.172:0/968623678 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a380039e0 con 0x7f2a3c15b270 2024-04-25T08:47:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.299+0000 7f2a4408f640 1 -- 172.21.15.172:0/968623678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c0ae910 con 0x7f2a3c15b270 2024-04-25T08:47:52.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.301+0000 7f2a327fc640 1 -- 172.21.15.172:0/968623678 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a3801a070 con 0x7f2a3c15b270 2024-04-25T08:47:52.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.301+0000 7f2a327fc640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a2006b4d0 0x7f2a2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.301+0000 7f2a327fc640 1 -- 172.21.15.172:0/968623678 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2a38089550 con 0x7f2a3c15b270 2024-04-25T08:47:52.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.301+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a2006b4d0 0x7f2a2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.301+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a2006b4d0 0x7f2a2006d990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005c00 tx=0x7f2a34009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.302+0000 7f2a46d8e740 1 Processor -- start 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.302+0000 7f2a46d8e740 1 -- start start 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9080 0x55f9f8cd9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8ca9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8ca9740 0x55f9f8cd1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f8c120a0 con 0x55f9f8cd9080 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f8bbad40 con 0x55f9f8cd9aa0 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9f8c0e140 con 0x55f9f8ca9740 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a41e2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9080 0x55f9f8cd9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a41e2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9080 0x55f9f8cd9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48568/0 (socket says 172.21.15.172:48568) 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a41e2b640 1 -- 172.21.15.172:0/2046075924 learned_addr learned my addr 172.21.15.172:0/2046075924 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a4262c640 1 --2- 172.21.15.172:0/2046075924 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8ca9740 0x55f9f8cd1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a41e2b640 1 -- 172.21.15.172:0/2046075924 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8ca9740 msgr2=0x55f9f8cd1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/2046075924 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8ca9740 0x55f9f8cd1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a41e2b640 1 -- 172.21.15.172:0/2046075924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9aa0 msgr2=0x55f9f8ca9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a4162a640 1 --2- 172.21.15.172:0/2046075924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8ca9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/2046075924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8ca9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a41e2b640 1 -- 172.21.15.172:0/2046075924 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9f89f2a20 con 0x55f9f8cd9080 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/2046075924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9080 0x55f9f8cd9460 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2a34015590 tx=0x7f2a34001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af14295d6d018e4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a1f7fe640 1 -- 172.21.15.172:0/2046075924 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34025070 con 0x55f9f8cd9080 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a1f7fe640 1 -- 172.21.15.172:0/2046075924 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34013680 con 0x55f9f8cd9080 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.303+0000 7f2a1f7fe640 1 -- 172.21.15.172:0/2046075924 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34013a30 con 0x55f9f8cd9080 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.304+0000 7f2a46d8e740 1 -- 172.21.15.172:0/2046075924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9080 msgr2=0x55f9f8cd9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.304+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/2046075924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9080 0x55f9f8cd9460 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f2a34015590 tx=0x7f2a34001250 comp rx=0 tx=0).stop 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.304+0000 7f2a46d8e740 1 -- 172.21.15.172:0/2046075924 shutdown_connections 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.304+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/2046075924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8ca9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.304+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/2046075924 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8ca9740 0x55f9f8cd1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.304+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/2046075924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9080 0x55f9f8cd9460 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.304+0000 7f2a46d8e740 1 -- 172.21.15.172:0/2046075924 >> 172.21.15.172:0/2046075924 conn(0x55f9f8cab470 msgr2=0x55f9f8cf3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.304+0000 7f2a46d8e740 1 -- 172.21.15.172:0/2046075924 shutdown_connections 2024-04-25T08:47:52.298 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.304+0000 7f2a46d8e740 1 -- 172.21.15.172:0/2046075924 wait complete. 2024-04-25T08:47:52.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.305+0000 7f2a46d8e740 1 -- start start 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.305+0000 7f2a46d8e740 1 Processor -- start 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9080 0x55f9f8d078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cd9aa0 0x55f9f8cd7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8cd7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f8cd57d0 con 0x55f9f8cc9c90 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f8bb03d0 con 0x55f9f8cd9080 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9f8cd5a70 con 0x55f9f8cd9aa0 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a46d8e740 10 client.0 _ll_register_callbacks cb 0x55f9f8925e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a4262c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8cd7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a4262c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8cd7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48584/0 (socket says 172.21.15.172:48584) 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a4262c640 1 -- 172.21.15.172:0/978051000 learned_addr learned my addr 172.21.15.172:0/978051000 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9080 0x55f9f8d078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a4162a640 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cd9aa0 0x55f9f8cd7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a4262c640 1 -- 172.21.15.172:0/978051000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cd9aa0 msgr2=0x55f9f8cd7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a4262c640 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cd9aa0 0x55f9f8cd7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a4262c640 1 -- 172.21.15.172:0/978051000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9080 msgr2=0x55f9f8d078a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a4262c640 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9080 0x55f9f8d078a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a4262c640 1 -- 172.21.15.172:0/978051000 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9f88e6310 con 0x55f9f8cc9c90 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a4262c640 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8cd7ac0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2a3805fdb0 tx=0x7f2a380576a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f11ba500da2834 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a1cff9640 1 -- 172.21.15.172:0/978051000 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38060050 con 0x55f9f8cc9c90 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a1cff9640 1 -- 172.21.15.172:0/978051000 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2a38003b80 con 0x55f9f8cc9c90 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a46d8e740 1 -- 172.21.15.172:0/978051000 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a34013680 con 0x55f9f8cc9c90 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a1cff9640 1 -- 172.21.15.172:0/978051000 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a380602e0 con 0x55f9f8cc9c90 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a46d8e740 10 client.7431 fetch_fsmap learned FSMap version 50 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.306+0000 7f2a46d8e740 1 -- 172.21.15.172:0/978051000 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55f9f8a531b0 con 0x55f9f8cc9c90 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a1cff9640 1 -- 172.21.15.172:0/978051000 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34013680 con 0x55f9f8cc9c90 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a1cff9640 1 -- 172.21.15.172:0/978051000 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a3806bb90 con 0x55f9f8cc9c90 2024-04-25T08:47:52.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a46d8e740 10 client.7431 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a46d8e740 10 client.7431 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a46d8e740 20 client.7431 populate_metadata read hostname 'smithi172' 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f9f8ccc210 0x55f9f8ccc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a46d8e740 4 client.7431 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a46d8e740 1 -- 172.21.15.172:0/978051000 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9f8c1f5e0 con 0x55f9f8ccc210 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f9f8ccc210 0x55f9f8ccc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a1cff9640 10 client.7431 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.307+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f9f8ccc210 0x55f9f8ccc5f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dce16fe7b571841f server_cookie=31e332a5ae980acf in_seq=0 out_seq=0 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a1cff9640 1 -- 172.21.15.172:0/978051000 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f9f8c1f5e0 con 0x55f9f8ccc210 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a1cff9640 10 client.7431 handle_command_reply: tid=0 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 client.7431 shutdown 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 -- 172.21.15.172:0/978051000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 msgr2=0x55f9f8cd7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8cd7ac0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2a3805fdb0 tx=0x7f2a380576a0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 -- 172.21.15.172:0/978051000 shutdown_connections 2024-04-25T08:47:52.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f9f8ccc210 0x55f9f8ccc5f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8cd7ac0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cd9aa0 0x55f9f8cd7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/978051000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9080 0x55f9f8d078a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a1cff9640 0 client.7431 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 -- 172.21.15.172:0/978051000 >> 172.21.15.172:0/978051000 conn(0x55f9f8ca9740 msgr2=0x55f9f8cacc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 -- 172.21.15.172:0/978051000 shutdown_connections 2024-04-25T08:47:52.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 1 -- 172.21.15.172:0/978051000 wait complete. 2024-04-25T08:47:52.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.308+0000 7f2a46d8e740 20 client.7431 trim_cache size 0 max 16384 2024-04-25T08:47:52.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.323+0000 7f2a46d8e740 1 Processor -- start 2024-04-25T08:47:52.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.323+0000 7f2a46d8e740 1 -- start start 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cc9c90 0x55f9f8ccee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9080 0x55f9f8d072a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8d077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c200070 con 0x55f9f8cd9aa0 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c1ff230 con 0x55f9f8cd9080 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0afb10 con 0x55f9f8cc9c90 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a4262c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8d077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a4262c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8d077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48596/0 (socket says 172.21.15.172:48596) 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a4262c640 1 -- 172.21.15.172:0/2577297849 learned_addr learned my addr 172.21.15.172:0/2577297849 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a4262c640 1 -- 172.21.15.172:0/2577297849 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cc9c90 msgr2=0x55f9f8ccee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a4262c640 1 --2- 172.21.15.172:0/2577297849 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cc9c90 0x55f9f8ccee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a4262c640 1 -- 172.21.15.172:0/2577297849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9080 msgr2=0x55f9f8d072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a4262c640 1 --2- 172.21.15.172:0/2577297849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9080 0x55f9f8d072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.324+0000 7f2a4262c640 1 -- 172.21.15.172:0/2577297849 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9f8cc9470 con 0x55f9f8cd9aa0 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a4262c640 1 --2- 172.21.15.172:0/2577297849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8d077e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2a38057980 tx=0x7f2a38014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd175dd3ddc80e8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a1effd640 1 -- 172.21.15.172:0/2577297849 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38073070 con 0x55f9f8cd9aa0 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a1effd640 1 -- 172.21.15.172:0/2577297849 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3806bb90 con 0x55f9f8cd9aa0 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a1effd640 1 -- 172.21.15.172:0/2577297849 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a380570d0 con 0x55f9f8cd9aa0 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a46d8e740 1 -- 172.21.15.172:0/2577297849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9aa0 msgr2=0x55f9f8d077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/2577297849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8d077e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2a38057980 tx=0x7f2a38014000 comp rx=0 tx=0).stop 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a46d8e740 1 -- 172.21.15.172:0/2577297849 shutdown_connections 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/2577297849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9080 0x55f9f8d072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/2577297849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8d077e0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/2577297849 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cc9c90 0x55f9f8ccee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a46d8e740 1 -- 172.21.15.172:0/2577297849 >> 172.21.15.172:0/2577297849 conn(0x55f9f8ca9740 msgr2=0x55f9f8ccbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a46d8e740 1 -- 172.21.15.172:0/2577297849 shutdown_connections 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.325+0000 7f2a46d8e740 1 -- 172.21.15.172:0/2577297849 wait complete. 2024-04-25T08:47:52.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.326+0000 7f2a46d8e740 1 -- start start 2024-04-25T08:47:52.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.326+0000 7f2a46d8e740 1 Processor -- start 2024-04-25T08:47:52.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8d039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cd9080 0x55f9f8cacf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a46d8e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8d58fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0b0110 con 0x55f9f8cc9c90 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9f8bce050 con 0x55f9f8cd9aa0 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a46d8e740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9f8cae550 con 0x55f9f8cd9080 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a46d8e740 10 client.0 _ll_register_callbacks cb 0x7f2a3400feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a41e2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8d039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a41e2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8d039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48610/0 (socket says 172.21.15.172:48610) 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a41e2b640 1 -- 172.21.15.172:0/3872885056 learned_addr learned my addr 172.21.15.172:0/3872885056 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a4162a640 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cd9080 0x55f9f8cacf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a4262c640 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8d58fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a41e2b640 1 -- 172.21.15.172:0/3872885056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cd9080 msgr2=0x55f9f8cacf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cd9080 0x55f9f8cacf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a41e2b640 1 -- 172.21.15.172:0/3872885056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9aa0 msgr2=0x55f9f8d58fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8d58fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a41e2b640 1 -- 172.21.15.172:0/3872885056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9f88bf490 con 0x55f9f8cc9c90 2024-04-25T08:47:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a41e2b640 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8d039c0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x55f9f8caa910 tx=0x7f2a340019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55a67b84f387e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a1cff9640 1 -- 172.21.15.172:0/3872885056 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34025040 con 0x55f9f8cc9c90 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a1cff9640 1 -- 172.21.15.172:0/3872885056 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2a34013680 con 0x55f9f8cc9c90 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a46d8e740 1 -- 172.21.15.172:0/3872885056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a3806bb90 con 0x55f9f8cc9c90 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.327+0000 7f2a1cff9640 1 -- 172.21.15.172:0/3872885056 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a3403e050 con 0x55f9f8cc9c90 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a46d8e740 10 client.7437 fetch_fsmap learned FSMap version 50 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a46d8e740 1 -- 172.21.15.172:0/3872885056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55f9f8cae100 con 0x55f9f8cc9c90 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a1cff9640 1 -- 172.21.15.172:0/3872885056 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3806bb90 con 0x55f9f8cc9c90 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a1cff9640 1 -- 172.21.15.172:0/3872885056 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a34041020 con 0x55f9f8cc9c90 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a46d8e740 10 client.7437 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a46d8e740 10 client.7437 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a46d8e740 20 client.7437 populate_metadata read hostname 'smithi172' 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f9f8cca8e0 0x55f9f8ccacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a46d8e740 4 client.7437 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a46d8e740 1 -- 172.21.15.172:0/3872885056 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) v1 -- 0x55f9f8cce210 con 0x55f9f8cca8e0 2024-04-25T08:47:52.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a4162a640 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f9f8cca8e0 0x55f9f8ccacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a4162a640 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f9f8cca8e0 0x55f9f8ccacf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=132f4375bb2f3771 server_cookie=84646863a6736a9b in_seq=0 out_seq=0 2024-04-25T08:47:52.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.328+0000 7f2a1cff9640 10 client.7437 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a1cff9640 1 -- 172.21.15.172:0/3872885056 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f9f8cce210 con 0x55f9f8cca8e0 2024-04-25T08:47:52.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a1cff9640 10 client.7437 handle_command_reply: tid=0 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 client.7437 shutdown 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 -- 172.21.15.172:0/3872885056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 msgr2=0x55f9f8d039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8d039c0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x55f9f8caa910 tx=0x7f2a340019d0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 -- 172.21.15.172:0/3872885056 shutdown_connections 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f9f8cca8e0 0x55f9f8ccacf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f9f8cd9aa0 0x55f9f8d58fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f9f8cd9080 0x55f9f8cacf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 --2- 172.21.15.172:0/3872885056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f9f8cc9c90 0x55f9f8d039c0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 -- 172.21.15.172:0/3872885056 >> 172.21.15.172:0/3872885056 conn(0x55f9f8ca9740 msgr2=0x55f9f8d072a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a1cff9640 0 client.7437 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 -- 172.21.15.172:0/3872885056 shutdown_connections 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 1 -- 172.21.15.172:0/3872885056 wait complete. 2024-04-25T08:47:52.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.336+0000 7f2a46d8e740 20 client.7437 trim_cache size 0 max 16384 2024-04-25T08:47:52.329 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:47:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:47:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "9c0e005d-f6b6-4750-a6dd-b312eae3e4b4", 2024-04-25T08:47:52.329 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:47:52.329 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 -- 172.21.15.172:0/968623678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a2006b4d0 msgr2=0x7f2a2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a2006b4d0 0x7f2a2006d990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005c00 tx=0x7f2a34009040 comp rx=0 tx=0).stop 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 -- 172.21.15.172:0/968623678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a3c15b270 msgr2=0x7f2a3c0a9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a3c15b270 0x7f2a3c0a9100 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800c460 tx=0x7f2a3800c920 comp rx=0 tx=0).stop 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 -- 172.21.15.172:0/968623678 shutdown_connections 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a2006b4d0 0x7f2a2006d990 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a3c15b270 0x7f2a3c0a9100 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a3c0ce230 0x7f2a3c14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 --2- 172.21.15.172:0/968623678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a3c0cc4f0 0x7f2a3c0adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 -- 172.21.15.172:0/968623678 >> 172.21.15.172:0/968623678 conn(0x7f2a3c06abe0 msgr2=0x7f2a3c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 -- 172.21.15.172:0/968623678 shutdown_connections 2024-04-25T08:47:52.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.337+0000 7f2a4408f640 1 -- 172.21.15.172:0/968623678 wait complete. 2024-04-25T08:47:52.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:47:52.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T08:47:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.494+0000 7f7ec23d5640 1 Processor -- start 2024-04-25T08:47:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.494+0000 7f7ec23d5640 1 -- start start 2024-04-25T08:47:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.495+0000 7f7ec23d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 0x7f7ebc06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.495+0000 7f7ec23d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7ebc06ec30 0x7f7ebc0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.495+0000 7f7ec23d5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ebc16e5a0 con 0x7f7ebc16a720 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.495+0000 7f7ec23d5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ebc16f170 con 0x7f7ebc06ec30 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.495+0000 7f7ec23d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc16e840 con 0x7f7ebc072220 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.495+0000 7f7ec0972640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7ebc06ec30 0x7f7ebc0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.495+0000 7f7ec0972640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7ebc06ec30 0x7f7ebc0cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48626/0 (socket says 172.21.15.172:48626) 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.495+0000 7f7ec0972640 1 -- 172.21.15.172:0/108226069 learned_addr learned my addr 172.21.15.172:0/108226069 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.495+0000 7f7ebbfff640 1 --1- 172.21.15.172:0/108226069 >> v1:172.21.15.172:6789/0 conn(0x7f7ebc16a720 0x7f7ebc071b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:54062/0 (socket says 172.21.15.172:54062) 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.495+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/108226069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 0x7f7ebc06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.533+0000 7f7ec0972640 1 -- 172.21.15.172:0/108226069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 msgr2=0x7f7ebc06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.533+0000 7f7ec0972640 1 --2- 172.21.15.172:0/108226069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 0x7f7ebc06e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.533+0000 7f7ec0972640 1 -- 172.21.15.172:0/108226069 >> v1:172.21.15.172:6789/0 conn(0x7f7ebc16a720 legacy=0x7f7ebc071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.533+0000 7f7ec0972640 1 -- 172.21.15.172:0/108226069 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc16eb20 con 0x7f7ebc06ec30 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.533+0000 7f7ebaffd640 1 -- 172.21.15.172:0/108226069 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529424419 0 0) 0x7f7ebc16e5a0 con 0x7f7ebc16a720 2024-04-25T08:47:52.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.533+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/108226069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 0x7f7ebc06e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:47:52.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.534+0000 7f7ec0972640 1 --2- 172.21.15.172:0/108226069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ebc06ec30 0x7f7ebc0cecc0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4007eb0 tx=0x7f7eb402bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b40445d23a158e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.534+0000 7f7ebaffd640 1 -- 172.21.15.172:0/108226069 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb402d8b0 con 0x7f7ebc06ec30 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.534+0000 7f7ebaffd640 1 -- 172.21.15.172:0/108226069 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb402da50 con 0x7f7ebc06ec30 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.534+0000 7f7ebaffd640 1 -- 172.21.15.172:0/108226069 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb402de20 con 0x7f7ebc06ec30 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.535+0000 7f7ec23d5640 1 -- 172.21.15.172:0/108226069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ebc06ec30 msgr2=0x7f7ebc0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.535+0000 7f7ec23d5640 1 --2- 172.21.15.172:0/108226069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ebc06ec30 0x7f7ebc0cecc0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4007eb0 tx=0x7f7eb402bb50 comp rx=0 tx=0).stop 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.535+0000 7f7ec23d5640 1 -- 172.21.15.172:0/108226069 shutdown_connections 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.535+0000 7f7ec23d5640 1 --2- 172.21.15.172:0/108226069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 0x7f7ebc06e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.535+0000 7f7ec23d5640 1 --2- 172.21.15.172:0/108226069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ebc06ec30 0x7f7ebc0cecc0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.535+0000 7f7ec23d5640 1 -- 172.21.15.172:0/108226069 >> 172.21.15.172:0/108226069 conn(0x7f7ebc06abe0 msgr2=0x7f7ebc06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.536+0000 7f7ec23d5640 1 -- 172.21.15.172:0/108226069 shutdown_connections 2024-04-25T08:47:52.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.536+0000 7f7ec23d5640 1 -- 172.21.15.172:0/108226069 wait complete. 2024-04-25T08:47:52.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.537+0000 7f7ec23d5640 1 Processor -- start 2024-04-25T08:47:52.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.538+0000 7f7ec23d5640 1 -- start start 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ec23d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ebc06ec30 0x7f7ebc089ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ec23d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 0x7f7ebc160c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ec23d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ebc16a720 0x7f7ebc1611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ec23d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc16ab00 con 0x7f7ebc16a720 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ec23d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc06f080 con 0x7f7ebc06ec30 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ec23d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc16ac80 con 0x7f7ebc072220 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ebbfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ebc06ec30 0x7f7ebc089ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ebbfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ebc06ec30 0x7f7ebc089ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:33994/0 (socket says 172.21.15.172:33994) 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ebbfff640 1 -- 172.21.15.172:0/2487156272 learned_addr learned my addr 172.21.15.172:0/2487156272 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 0x7f7ebc160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ec0972640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ebc16a720 0x7f7ebc1611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ebbfff640 1 -- 172.21.15.172:0/2487156272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 msgr2=0x7f7ebc160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 0x7f7ebc160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ebbfff640 1 -- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ebc16a720 msgr2=0x7f7ebc1611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ebc16a720 0x7f7ebc1611b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.539+0000 7f7ebbfff640 1 -- 172.21.15.172:0/2487156272 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc168fe0 con 0x7f7ebc06ec30 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.540+0000 7f7ec0972640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ebc16a720 0x7f7ebc1611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.540+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 0x7f7ebc160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.540+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ebc06ec30 0x7f7ebc089ef0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00c420 tx=0x7f7eac00c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.540+0000 7f7eb8ff9640 1 -- 172.21.15.172:0/2487156272 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0074e0 con 0x7f7ebc06ec30 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.540+0000 7f7eb8ff9640 1 -- 172.21.15.172:0/2487156272 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac0047e0 con 0x7f7ebc06ec30 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.540+0000 7f7ec23d5640 1 -- 172.21.15.172:0/2487156272 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ebc1692c0 con 0x7f7ebc06ec30 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.541+0000 7f7eb8ff9640 1 -- 172.21.15.172:0/2487156272 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac004c10 con 0x7f7ebc06ec30 2024-04-25T08:47:52.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.541+0000 7f7ec23d5640 1 -- 172.21.15.172:0/2487156272 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ebc169880 con 0x7f7ebc06ec30 2024-04-25T08:47:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.542+0000 7f7eb8ff9640 1 -- 172.21.15.172:0/2487156272 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7eac011070 con 0x7f7ebc06ec30 2024-04-25T08:47:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.543+0000 7f7eb8ff9640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7ea806b4d0 0x7f7ea806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.543+0000 7f7eb8ff9640 1 -- 172.21.15.172:0/2487156272 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7eac089ee0 con 0x7f7ebc06ec30 2024-04-25T08:47:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.543+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7ea806b4d0 0x7f7ea806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.544+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7ea806b4d0 0x7f7ea806d990 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc0cbbb0 tx=0x7f7eb0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.545+0000 7f7ec51b2740 1 Processor -- start 2024-04-25T08:47:52.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.545+0000 7f7ec51b2740 1 -- start start 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea45320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea45860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea15770 0x55f19ea18f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19e97eda0 con 0x55f19ea15770 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19e927b80 con 0x55f19ea42ef0 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f19e97ae40 con 0x55f19ea42b10 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ebbfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea45320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ebbfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea45320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:56734/0 (socket says 172.21.15.172:56734) 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ebbfff640 1 -- 172.21.15.172:0/3583085029 learned_addr learned my addr 172.21.15.172:0/3583085029 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea45860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ec0972640 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea15770 0x55f19ea18f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ebbfff640 1 -- 172.21.15.172:0/3583085029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 msgr2=0x55f19ea45860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea45860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ebbfff640 1 -- 172.21.15.172:0/3583085029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea15770 msgr2=0x55f19ea18f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea15770 0x55f19ea18f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ebbfff640 1 -- 172.21.15.172:0/3583085029 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f19e931f10 con 0x55f19ea42b10 2024-04-25T08:47:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea45860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.546+0000 7f7ec0972640 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea15770 0x55f19ea18f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:47:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.547+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea45320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0881b0 tx=0x7f7eac0583c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb772387c7a1fcdc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.547+0000 7f7ea1ffb640 1 -- 172.21.15.172:0/3583085029 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac05c610 con 0x55f19ea42b10 2024-04-25T08:47:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.547+0000 7f7ea1ffb640 1 -- 172.21.15.172:0/3583085029 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac060bd0 con 0x55f19ea42b10 2024-04-25T08:47:52.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.547+0000 7f7ea1ffb640 1 -- 172.21.15.172:0/3583085029 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0882f0 con 0x55f19ea42b10 2024-04-25T08:47:52.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.548+0000 7f7ec51b2740 1 -- 172.21.15.172:0/3583085029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 msgr2=0x55f19ea45320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.548+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea45320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0881b0 tx=0x7f7eac0583c0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.548+0000 7f7ec51b2740 1 -- 172.21.15.172:0/3583085029 shutdown_connections 2024-04-25T08:47:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.548+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea45860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.548+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea15770 0x55f19ea18f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.548+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/3583085029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea45320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.548+0000 7f7ec51b2740 1 -- 172.21.15.172:0/3583085029 >> 172.21.15.172:0/3583085029 conn(0x55f19ea179e0 msgr2=0x55f19ea60320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.549+0000 7f7ec51b2740 1 -- 172.21.15.172:0/3583085029 shutdown_connections 2024-04-25T08:47:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.549+0000 7f7ec51b2740 1 -- 172.21.15.172:0/3583085029 wait complete. 2024-04-25T08:47:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.550+0000 7f7ec51b2740 1 -- start start 2024-04-25T08:47:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.550+0000 7f7ec51b2740 1 Processor -- start 2024-04-25T08:47:52.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea2a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea2aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19ea1ab90 con 0x55f19ea39a00 2024-04-25T08:47:52.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19e91d4b0 con 0x55f19ea42ef0 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f19ea1ae70 con 0x55f19ea42b10 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ec0972640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea2aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ebbfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ebbfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:56742/0 (socket says 172.21.15.172:56742) 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ec0972640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea2aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48658/0 (socket says 172.21.15.172:48658) 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ebbfff640 1 -- 172.21.15.172:0/1503367029 learned_addr learned my addr 172.21.15.172:0/1503367029 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ebb7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea2a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.551+0000 7f7ec51b2740 10 client.0 _ll_register_callbacks cb 0x55f19e95d180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7ebbfff640 1 -- 172.21.15.172:0/1503367029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 msgr2=0x55f19ea2a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea2a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7ebbfff640 1 -- 172.21.15.172:0/1503367029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 msgr2=0x55f19ea2aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea2aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7ebbfff640 1 -- 172.21.15.172:0/1503367029 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f19e75d7d0 con 0x55f19ea42b10 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea2a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea452a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7eac056770 tx=0x7f7eac00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9315fe4ec583247 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7e9affd640 10 client.0 ms_handle_connect on v2:172.21.15.186:3301/0 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7e9affd640 1 -- 172.21.15.172:0/1503367029 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac086060 con 0x55f19ea42b10 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7ec51b2740 1 -- 172.21.15.172:0/1503367029 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7eac060bd0 con 0x55f19ea42b10 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.552+0000 7f7e9affd640 1 -- 172.21.15.172:0/1503367029 <== mon.2 v2:172.21.15.186:3301/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7eac081bd0 con 0x55f19ea42b10 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7e9affd640 1 -- 172.21.15.172:0/1503367029 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7eac076050 con 0x55f19ea42b10 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7ec51b2740 10 client.5912 fetch_fsmap learned FSMap version 50 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7ec51b2740 1 -- 172.21.15.172:0/1503367029 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55f19e6933f0 con 0x55f19ea42b10 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7e9affd640 1 -- 172.21.15.172:0/1503367029 <== mon.2 v2:172.21.15.186:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac060bd0 con 0x55f19ea42b10 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7e9affd640 1 -- 172.21.15.172:0/1503367029 <== mon.2 v2:172.21.15.186:3301/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7eac05c160 con 0x55f19ea42b10 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7ec51b2740 10 client.5912 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7ec51b2740 10 client.5912 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7ec51b2740 20 client.5912 populate_metadata read hostname 'smithi172' 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f19ea629e0 0x55f19ea62de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7ec51b2740 4 client.5912 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:47:52.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7ec51b2740 1 -- 172.21.15.172:0/1503367029 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f19e98c2e0 con 0x55f19ea629e0 2024-04-25T08:47:52.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.553+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f19ea629e0 0x55f19ea62de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.554+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f19ea629e0 0x55f19ea62de0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=340cb1510a686d1a server_cookie=d4ebfbeace237dd3 in_seq=0 out_seq=0 2024-04-25T08:47:52.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.554+0000 7f7e9affd640 10 client.5912 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.555+0000 7f7e9affd640 1 -- 172.21.15.172:0/1503367029 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f19e98c2e0 con 0x55f19ea629e0 2024-04-25T08:47:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.555+0000 7f7e9affd640 10 client.5912 handle_command_reply: tid=0 2024-04-25T08:47:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.555+0000 7f7ec51b2740 1 client.5912 shutdown 2024-04-25T08:47:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.555+0000 7f7ec51b2740 1 -- 172.21.15.172:0/1503367029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 msgr2=0x55f19ea452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.555+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea452a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7eac056770 tx=0x7f7eac00cf90 comp rx=0 tx=0).stop 2024-04-25T08:47:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.556+0000 7f7ec51b2740 1 -- 172.21.15.172:0/1503367029 shutdown_connections 2024-04-25T08:47:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.556+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f19ea629e0 0x55f19ea62de0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.556+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea2a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.556+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea2aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.556+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/1503367029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19ea452a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.556+0000 7f7ec51b2740 1 -- 172.21.15.172:0/1503367029 >> 172.21.15.172:0/1503367029 conn(0x55f19ea15770 msgr2=0x55f19ea1a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.556+0000 7f7e9affd640 0 client.5912 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.556+0000 7f7ec51b2740 1 -- 172.21.15.172:0/1503367029 shutdown_connections 2024-04-25T08:47:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.556+0000 7f7ec51b2740 1 -- 172.21.15.172:0/1503367029 wait complete. 2024-04-25T08:47:52.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.556+0000 7f7ec51b2740 20 client.5912 trim_cache size 0 max 16384 2024-04-25T08:47:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ec51b2740 1 Processor -- start 2024-04-25T08:47:52.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ec51b2740 1 -- start start 2024-04-25T08:47:52.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea19860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19eaccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea62d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19ea7a4d0 con 0x55f19ea39a00 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc20d020 con 0x55f19ea42ef0 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc20c1c0 con 0x55f19ea42b10 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ebbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea19860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ebbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea19860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48664/0 (socket says 172.21.15.172:48664) 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ec0972640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea62d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ebbfff640 1 -- 172.21.15.172:0/4275328632 learned_addr learned my addr 172.21.15.172:0/4275328632 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.582+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/4275328632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19eaccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ebb7fe640 1 -- 172.21.15.172:0/4275328632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 msgr2=0x55f19ea62d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/4275328632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea62d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ebb7fe640 1 -- 172.21.15.172:0/4275328632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 msgr2=0x55f19ea19860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/4275328632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea19860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ebb7fe640 1 -- 172.21.15.172:0/4275328632 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f19e6530f0 con 0x55f19ea42b10 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/4275328632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea19860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ec0972640 1 --2- 172.21.15.172:0/4275328632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea62d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/4275328632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19eaccc40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55f19ea18580 tx=0x7f7eb0016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=643bec66234c368b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ea17fa640 1 -- 172.21.15.172:0/4275328632 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb002a030 con 0x55f19ea42b10 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ea17fa640 1 -- 172.21.15.172:0/4275328632 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0030070 con 0x55f19ea42b10 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.583+0000 7f7ea17fa640 1 -- 172.21.15.172:0/4275328632 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb002a1d0 con 0x55f19ea42b10 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.584+0000 7f7ec51b2740 1 -- 172.21.15.172:0/4275328632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 msgr2=0x55f19eaccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.584+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/4275328632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19eaccc40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55f19ea18580 tx=0x7f7eb0016000 comp rx=0 tx=0).stop 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.584+0000 7f7ec51b2740 1 -- 172.21.15.172:0/4275328632 shutdown_connections 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.584+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/4275328632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea42ef0 0x55f19ea62d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.584+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/4275328632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42b10 0x55f19eaccc40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.584+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/4275328632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea39a00 0x55f19ea19860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.584+0000 7f7ec51b2740 1 -- 172.21.15.172:0/4275328632 >> 172.21.15.172:0/4275328632 conn(0x55f19ea15770 msgr2=0x55f19ea408c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.584+0000 7f7ec51b2740 1 -- 172.21.15.172:0/4275328632 shutdown_connections 2024-04-25T08:47:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.584+0000 7f7ec51b2740 1 -- 172.21.15.172:0/4275328632 wait complete. 2024-04-25T08:47:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.584+0000 7f7ec51b2740 1 -- start start 2024-04-25T08:47:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.585+0000 7f7ec51b2740 1 Processor -- start 2024-04-25T08:47:52.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.585+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea39a00 0x55f19ea632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.585+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea42b10 0x55f19ea372a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.585+0000 7f7ec51b2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42ef0 0x55f19eac72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.585+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc20bbc0 con 0x55f19ea42b10 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.585+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc201660 con 0x55f19ea39a00 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.585+0000 7f7ec51b2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f19ea1b830 con 0x55f19ea42ef0 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.585+0000 7f7ec51b2740 10 client.0 _ll_register_callbacks cb 0x7f7eac007680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.585+0000 7f7ebb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea42b10 0x55f19ea372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.585+0000 7f7ebb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea42b10 0x55f19ea372a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48666/0 (socket says 172.21.15.172:48666) 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ebb7fe640 1 -- 172.21.15.172:0/296204163 learned_addr learned my addr 172.21.15.172:0/296204163 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ec0972640 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42ef0 0x55f19eac72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea39a00 0x55f19ea632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ebb7fe640 1 -- 172.21.15.172:0/296204163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42ef0 msgr2=0x55f19eac72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42ef0 0x55f19eac72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ebb7fe640 1 -- 172.21.15.172:0/296204163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea39a00 msgr2=0x55f19ea632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea39a00 0x55f19ea632d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ebb7fe640 1 -- 172.21.15.172:0/296204163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f19ea55cb0 con 0x55f19ea42b10 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea39a00 0x55f19ea632d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ec0972640 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42ef0 0x55f19eac72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ebb7fe640 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea42b10 0x55f19ea372a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7eb002d040 tx=0x7f7eb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74a5a08679318bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7e9affd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7e9affd640 1 -- 172.21.15.172:0/296204163 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00202d0 con 0x55f19ea42b10 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7e9affd640 1 -- 172.21.15.172:0/296204163 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7eb002a030 con 0x55f19ea42b10 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ec51b2740 1 -- 172.21.15.172:0/296204163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7eb0030070 con 0x55f19ea42b10 2024-04-25T08:47:52.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7e9affd640 1 -- 172.21.15.172:0/296204163 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7eb002a230 con 0x55f19ea42b10 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ec51b2740 10 client.7455 fetch_fsmap learned FSMap version 50 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7ec51b2740 1 -- 172.21.15.172:0/296204163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55f19ea55ec0 con 0x55f19ea42b10 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7e9affd640 1 -- 172.21.15.172:0/296204163 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb002a3d0 con 0x55f19ea42b10 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.586+0000 7f7e9affd640 1 -- 172.21.15.172:0/296204163 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7eb0028070 con 0x55f19ea42b10 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.587+0000 7f7ec51b2740 10 client.7455 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.587+0000 7f7ec51b2740 10 client.7455 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.587+0000 7f7ec51b2740 20 client.7455 populate_metadata read hostname 'smithi172' 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.587+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f19ea6f650 0x55f19ea15c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.587+0000 7f7ec51b2740 4 client.7455 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.587+0000 7f7ec51b2740 1 -- 172.21.15.172:0/296204163 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f7eb0030070 con 0x55f19ea6f650 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.587+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f19ea6f650 0x55f19ea15c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.587+0000 7f7e9affd640 10 client.7455 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.587+0000 7f7ebbfff640 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f19ea6f650 0x55f19ea15c50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15a0a54c75064573 server_cookie=82c0544936bc09c3 in_seq=0 out_seq=0 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7e9affd640 1 -- 172.21.15.172:0/296204163 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+257 (crc 0 0 0) 0x7f7eb0030070 con 0x55f19ea6f650 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7e9affd640 10 client.7455 handle_command_reply: tid=0 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 client.7455 shutdown 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 -- 172.21.15.172:0/296204163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea42b10 msgr2=0x55f19ea372a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea42b10 0x55f19ea372a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7eb002d040 tx=0x7f7eb0004730 comp rx=0 tx=0).stop 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 -- 172.21.15.172:0/296204163 shutdown_connections 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55f19ea6f650 0x55f19ea15c50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55f19ea42ef0 0x55f19eac72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f19ea42b10 0x55f19ea372a0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 --2- 172.21.15.172:0/296204163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55f19ea39a00 0x55f19ea632d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7e9affd640 0 client.7455 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 -- 172.21.15.172:0/296204163 >> 172.21.15.172:0/296204163 conn(0x55f19ea15770 msgr2=0x55f19ea8b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 -- 172.21.15.172:0/296204163 shutdown_connections 2024-04-25T08:47:52.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 1 -- 172.21.15.172:0/296204163 wait complete. 2024-04-25T08:47:52.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec51b2740 20 client.7455 trim_cache size 0 max 16384 2024-04-25T08:47:52.586 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:47:52.586 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:47:52.586 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": { 2024-04-25T08:47:52.586 INFO:teuthology.orchestra.run.smithi172.stdout: "9c0e005d-f6b6-4750-a6dd-b312eae3e4b4": { 2024-04-25T08:47:52.586 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "~mds0", 2024-04-25T08:47:52.586 INFO:teuthology.orchestra.run.smithi172.stdout: "tag": "9c0e005d-f6b6-4750-a6dd-b312eae3e4b4", 2024-04-25T08:47:52.586 INFO:teuthology.orchestra.run.smithi172.stdout: "options": "recursive" 2024-04-25T08:47:52.586 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.586 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:47:52.587 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:47:52.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec23d5640 1 -- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7ea806b4d0 msgr2=0x7f7ea806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec23d5640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7ea806b4d0 0x7f7ea806d990 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc0cbbb0 tx=0x7f7eb0008040 comp rx=0 tx=0).stop 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec23d5640 1 -- 172.21.15.172:0/2487156272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ebc06ec30 msgr2=0x7f7ebc089ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec23d5640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ebc06ec30 0x7f7ebc089ef0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00c420 tx=0x7f7eac00c8e0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec23d5640 1 -- 172.21.15.172:0/2487156272 shutdown_connections 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec23d5640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7ea806b4d0 0x7f7ea806d990 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec23d5640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ebc16a720 0x7f7ebc1611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec23d5640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7ebc072220 0x7f7ebc160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec23d5640 1 --2- 172.21.15.172:0/2487156272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ebc06ec30 0x7f7ebc089ef0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.588+0000 7f7ec23d5640 1 -- 172.21.15.172:0/2487156272 >> 172.21.15.172:0/2487156272 conn(0x7f7ebc06abe0 msgr2=0x7f7ebc16d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.589+0000 7f7ec23d5640 1 -- 172.21.15.172:0/2487156272 shutdown_connections 2024-04-25T08:47:52.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:47:52.589+0000 7f7ec23d5640 1 -- 172.21.15.172:0/2487156272 wait complete. 2024-04-25T08:47:52.590 INFO:tasks.cephfs.filesystem:scrub status for tag:9c0e005d-f6b6-4750-a6dd-b312eae3e4b4 - {'path': '~mds0', 'tag': '9c0e005d-f6b6-4750-a6dd-b312eae3e4b4', 'options': 'recursive'} 2024-04-25T08:48:00.273 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:48:00.276 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:48:22.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:22.592 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T08:48:22.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.712+0000 7fe9e5d70640 1 Processor -- start 2024-04-25T08:48:22.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.712+0000 7fe9e5d70640 1 -- start start 2024-04-25T08:48:22.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.713+0000 7fe9e5d70640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 0x7fe9e006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.713+0000 7fe9e5d70640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe9e006e2f0 0x7fe9e006e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.713+0000 7fe9e5d70640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e00b3450 con 0x7fe9e006b8c0 2024-04-25T08:48:22.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.713+0000 7fe9e5d70640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e00b36f0 con 0x7fe9e006e2f0 2024-04-25T08:48:22.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.713+0000 7fe9e5d70640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00b39d0 con 0x7fe9e015dcd0 2024-04-25T08:48:22.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.714+0000 7fe9dffff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe9e006e2f0 0x7fe9e006e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.714+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 0x7fe9e006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.714+0000 7fe9dffff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe9e006e2f0 0x7fe9e006e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:36976/0 (socket says 172.21.15.172:36976) 2024-04-25T08:48:22.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.714+0000 7fe9deffd640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fe9e006b8c0 0x7fe9e00b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:59034/0 (socket says 172.21.15.172:59034) 2024-04-25T08:48:22.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.714+0000 7fe9dffff640 1 -- 172.21.15.172:0/2729116690 learned_addr learned my addr 172.21.15.172:0/2729116690 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.714+0000 7fe9dffff640 1 -- 172.21.15.172:0/2729116690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 msgr2=0x7fe9e006d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.714+0000 7fe9dffff640 1 --2- 172.21.15.172:0/2729116690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 0x7fe9e006d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.714+0000 7fe9dffff640 1 -- 172.21.15.172:0/2729116690 >> v1:172.21.15.186:6789/0 conn(0x7fe9e006b8c0 legacy=0x7fe9e00b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.714+0000 7fe9dffff640 1 -- 172.21.15.172:0/2729116690 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00b3cb0 con 0x7fe9e006e2f0 2024-04-25T08:48:22.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.714+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/2729116690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 0x7fe9e006d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.715+0000 7fe9dffff640 1 --2- 172.21.15.172:0/2729116690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e006e2f0 0x7fe9e006e780 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009e50 tx=0x7fe9d802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef16ea0dd69c24d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.715+0000 7fe9de7fc640 1 -- 172.21.15.172:0/2729116690 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8036070 con 0x7fe9e006e2f0 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.715+0000 7fe9de7fc640 1 -- 172.21.15.172:0/2729116690 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8031600 con 0x7fe9e006e2f0 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.715+0000 7fe9de7fc640 1 -- 172.21.15.172:0/2729116690 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80319d0 con 0x7fe9e006e2f0 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.715+0000 7fe9e5d70640 1 -- 172.21.15.172:0/2729116690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e006e2f0 msgr2=0x7fe9e006e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.715+0000 7fe9e5d70640 1 --2- 172.21.15.172:0/2729116690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e006e2f0 0x7fe9e006e780 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009e50 tx=0x7fe9d802a710 comp rx=0 tx=0).stop 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.715+0000 7fe9e5d70640 1 -- 172.21.15.172:0/2729116690 shutdown_connections 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.715+0000 7fe9e5d70640 1 --2- 172.21.15.172:0/2729116690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e006e2f0 0x7fe9e006e780 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.715+0000 7fe9e5d70640 1 --2- 172.21.15.172:0/2729116690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 0x7fe9e006d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.715+0000 7fe9e5d70640 1 -- 172.21.15.172:0/2729116690 >> 172.21.15.172:0/2729116690 conn(0x7fe9e006abe0 msgr2=0x7fe9e006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.716+0000 7fe9e5d70640 1 -- 172.21.15.172:0/2729116690 shutdown_connections 2024-04-25T08:48:22.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.716+0000 7fe9e5d70640 1 -- 172.21.15.172:0/2729116690 wait complete. 2024-04-25T08:48:22.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.717+0000 7fe9e5d70640 1 Processor -- start 2024-04-25T08:48:22.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.717+0000 7fe9e5d70640 1 -- start start 2024-04-25T08:48:22.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9e5d70640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e006b8c0 0x7fe9e0160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9e5d70640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e006e2f0 0x7fe9e00adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9e5d70640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 0x7fe9e014b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9e5d70640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e006dc20 con 0x7fe9e006e2f0 2024-04-25T08:48:22.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9e5d70640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e00b4bc0 con 0x7fe9e006b8c0 2024-04-25T08:48:22.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9e5d70640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e006dda0 con 0x7fe9e015dcd0 2024-04-25T08:48:22.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e006e2f0 0x7fe9e00adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e006e2f0 0x7fe9e00adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54010/0 (socket says 172.21.15.172:54010) 2024-04-25T08:48:22.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9deffd640 1 -- 172.21.15.172:0/3314928936 learned_addr learned my addr 172.21.15.172:0/3314928936 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e006b8c0 0x7fe9e0160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9dffff640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 0x7fe9e014b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9deffd640 1 -- 172.21.15.172:0/3314928936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 msgr2=0x7fe9e014b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9deffd640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 0x7fe9e014b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9deffd640 1 -- 172.21.15.172:0/3314928936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e006b8c0 msgr2=0x7fe9e0160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9deffd640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e006b8c0 0x7fe9e0160a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9deffd640 1 -- 172.21.15.172:0/3314928936 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e015e150 con 0x7fe9e006e2f0 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9deffd640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e006e2f0 0x7fe9e00adbb0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400c450 tx=0x7fe9d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9c7fff640 1 -- 172.21.15.172:0/3314928936 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4018070 con 0x7fe9e006e2f0 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9c7fff640 1 -- 172.21.15.172:0/3314928936 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d4007480 con 0x7fe9e006e2f0 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9c7fff640 1 -- 172.21.15.172:0/3314928936 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40047e0 con 0x7fe9e006e2f0 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.718+0000 7fe9e5d70640 1 -- 172.21.15.172:0/3314928936 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e00ce9d0 con 0x7fe9e006e2f0 2024-04-25T08:48:22.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.719+0000 7fe9e5d70640 1 -- 172.21.15.172:0/3314928936 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e00cf270 con 0x7fe9e006e2f0 2024-04-25T08:48:22.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.720+0000 7fe9c7fff640 1 -- 172.21.15.172:0/3314928936 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe9d401b070 con 0x7fe9e006e2f0 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.720+0000 7fe9c7fff640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe9cc06b4d0 0x7fe9cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.721+0000 7fe9c7fff640 1 -- 172.21.15.172:0/3314928936 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fe9d40894a0 con 0x7fe9e006e2f0 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.721+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe9cc06b4d0 0x7fe9cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.721+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe9cc06b4d0 0x7fe9cc06d990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009560 tx=0x7fe9d0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.721+0000 7fe9e8a70740 1 Processor -- start 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.722+0000 7fe9e8a70740 1 -- start start 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.722+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884b10 0x562372887320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.722+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884ef0 0x562372887860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.722+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372857770 0x56237285af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.722+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623727c0da0 con 0x562372857770 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.722+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562372769b80 con 0x562372884ef0 2024-04-25T08:48:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.722+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623727bce40 con 0x562372884b10 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372857770 0x56237285af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372857770 0x56237285af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54022/0 (socket says 172.21.15.172:54022) 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9dffff640 1 -- 172.21.15.172:0/1740259682 learned_addr learned my addr 172.21.15.172:0/1740259682 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9deffd640 1 --2- 172.21.15.172:0/1740259682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884ef0 0x562372887860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/1740259682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884b10 0x562372887320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9dffff640 1 -- 172.21.15.172:0/1740259682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884b10 msgr2=0x562372887320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9dffff640 1 --2- 172.21.15.172:0/1740259682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884b10 0x562372887320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9dffff640 1 -- 172.21.15.172:0/1740259682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884ef0 msgr2=0x562372887860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9dffff640 1 --2- 172.21.15.172:0/1740259682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884ef0 0x562372887860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9dffff640 1 -- 172.21.15.172:0/1740259682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562372773f10 con 0x562372857770 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9deffd640 1 --2- 172.21.15.172:0/1740259682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884ef0 0x562372887860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9dffff640 1 --2- 172.21.15.172:0/1740259682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372857770 0x56237285af80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009e50 tx=0x7fe9d802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801497cd0fa4172e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9c57fa640 1 -- 172.21.15.172:0/1740259682 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8036040 con 0x562372857770 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9c57fa640 1 -- 172.21.15.172:0/1740259682 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8031760 con 0x562372857770 2024-04-25T08:48:22.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.723+0000 7fe9c57fa640 1 -- 172.21.15.172:0/1740259682 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8031b50 con 0x562372857770 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.724+0000 7fe9e8a70740 1 -- 172.21.15.172:0/1740259682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372857770 msgr2=0x56237285af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.724+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/1740259682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372857770 0x56237285af80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009e50 tx=0x7fe9d802e000 comp rx=0 tx=0).stop 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.724+0000 7fe9e8a70740 1 -- 172.21.15.172:0/1740259682 shutdown_connections 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.724+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/1740259682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884ef0 0x562372887860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.724+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/1740259682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372857770 0x56237285af80 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.724+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/1740259682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884b10 0x562372887320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.724+0000 7fe9e8a70740 1 -- 172.21.15.172:0/1740259682 >> 172.21.15.172:0/1740259682 conn(0x5623728599e0 msgr2=0x5623728a2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.724+0000 7fe9e8a70740 1 -- 172.21.15.172:0/1740259682 shutdown_connections 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.724+0000 7fe9e8a70740 1 -- 172.21.15.172:0/1740259682 wait complete. 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.725+0000 7fe9e8a70740 1 -- start start 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.725+0000 7fe9e8a70740 1 Processor -- start 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.725+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884b10 0x562372882be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.725+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884ef0 0x56237287d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.725+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372883190 0x562372883610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.725+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237285cb90 con 0x562372884ef0 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.725+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237275f4b0 con 0x562372884b10 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.725+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56237285ce70 con 0x562372883190 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.725+0000 7fe9e8a70740 10 client.0 _ll_register_callbacks cb 0x56237279f180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.725+0000 7fe9deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884ef0 0x56237287d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884ef0 0x56237287d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54030/0 (socket says 172.21.15.172:54030) 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9deffd640 1 -- 172.21.15.172:0/3932574579 learned_addr learned my addr 172.21.15.172:0/3932574579 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9dffff640 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372883190 0x562372883610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884b10 0x562372882be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9deffd640 1 -- 172.21.15.172:0/3932574579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372883190 msgr2=0x562372883610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9deffd640 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372883190 0x562372883610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9deffd640 1 -- 172.21.15.172:0/3932574579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884b10 msgr2=0x562372882be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9deffd640 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884b10 0x562372882be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9deffd640 1 -- 172.21.15.172:0/3932574579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56237259f7d0 con 0x562372884ef0 2024-04-25T08:48:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9deffd640 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884ef0 0x56237287d190 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4054010 tx=0x7fe9d40602d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0763f4964945e7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3932574579 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d405ff80 con 0x562372884ef0 2024-04-25T08:48:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3932574579 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fe9d405cb70 con 0x562372884ef0 2024-04-25T08:48:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3932574579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9d8031760 con 0x562372884ef0 2024-04-25T08:48:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3932574579 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9d405cd70 con 0x562372884ef0 2024-04-25T08:48:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9e8a70740 10 client.7464 fetch_fsmap learned FSMap version 50 2024-04-25T08:48:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3932574579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x5623724d53f0 con 0x562372884ef0 2024-04-25T08:48:22.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.726+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3932574579 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8031760 con 0x562372884ef0 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.727+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3932574579 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe9d4057000 con 0x562372884ef0 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.727+0000 7fe9e8a70740 10 client.7464 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.727+0000 7fe9e8a70740 10 client.7464 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.727+0000 7fe9e8a70740 20 client.7464 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.727+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x5623728a3920 0x5623728a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.727+0000 7fe9e8a70740 4 client.7464 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.727+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3932574579 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623727ce2e0 con 0x5623728a3920 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.727+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x5623728a3920 0x5623728a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.727+0000 7fe9be7fc640 10 client.7464 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.727+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x5623728a3920 0x5623728a3d40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ea60e5e155c4cf9 server_cookie=9c3af4315402569b in_seq=0 out_seq=0 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3932574579 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5623727ce2e0 con 0x5623728a3920 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9be7fc640 10 client.7464 handle_command_reply: tid=0 2024-04-25T08:48:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 client.7464 shutdown 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3932574579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884ef0 msgr2=0x56237287d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884ef0 0x56237287d190 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4054010 tx=0x7fe9d40602d0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3932574579 shutdown_connections 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x5623728a3920 0x5623728a3d40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372883190 0x562372883610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884ef0 0x56237287d190 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3932574579 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884b10 0x562372882be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9be7fc640 0 client.7464 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3932574579 >> 172.21.15.172:0/3932574579 conn(0x562372857770 msgr2=0x56237287f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3932574579 shutdown_connections 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3932574579 wait complete. 2024-04-25T08:48:22.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.728+0000 7fe9e8a70740 20 client.7464 trim_cache size 0 max 16384 2024-04-25T08:48:22.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.743+0000 7fe9e8a70740 1 Processor -- start 2024-04-25T08:48:22.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.743+0000 7fe9e8a70740 1 -- start start 2024-04-25T08:48:22.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372883190 0x562372882be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884b10 0x5623728c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884ef0 0x562372856600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e02003a0 con 0x562372883190 2024-04-25T08:48:22.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e01ff5c0 con 0x562372884b10 2024-04-25T08:48:22.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e015ef10 con 0x562372884ef0 2024-04-25T08:48:22.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372883190 0x562372882be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372883190 0x562372882be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54042/0 (socket says 172.21.15.172:54042) 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9df7fe640 1 -- 172.21.15.172:0/3241913491 learned_addr learned my addr 172.21.15.172:0/3241913491 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9df7fe640 1 -- 172.21.15.172:0/3241913491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884ef0 msgr2=0x562372856600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3241913491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884ef0 0x562372856600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9df7fe640 1 -- 172.21.15.172:0/3241913491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884b10 msgr2=0x5623728c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3241913491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884b10 0x5623728c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.744+0000 7fe9df7fe640 1 -- 172.21.15.172:0/3241913491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623724950f0 con 0x562372883190 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3241913491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372883190 0x562372882be0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x5623728a43f0 tx=0x7fe9d0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802dde0485e0c9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9c4ff9640 1 -- 172.21.15.172:0/3241913491 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d002ab70 con 0x562372883190 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9c4ff9640 1 -- 172.21.15.172:0/3241913491 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d002f070 con 0x562372883190 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9c4ff9640 1 -- 172.21.15.172:0/3241913491 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d002ad30 con 0x562372883190 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3241913491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372883190 msgr2=0x562372882be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3241913491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372883190 0x562372882be0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x5623728a43f0 tx=0x7fe9d0018000 comp rx=0 tx=0).stop 2024-04-25T08:48:22.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3241913491 shutdown_connections 2024-04-25T08:48:22.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3241913491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372884b10 0x5623728c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3241913491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884ef0 0x562372856600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3241913491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372883190 0x562372882be0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3241913491 >> 172.21.15.172:0/3241913491 conn(0x562372857770 msgr2=0x56237287cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3241913491 shutdown_connections 2024-04-25T08:48:22.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.745+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3241913491 wait complete. 2024-04-25T08:48:22.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.746+0000 7fe9e8a70740 1 -- start start 2024-04-25T08:48:22.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.746+0000 7fe9e8a70740 1 Processor -- start 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372883190 0x5623728f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884b10 0x562372883f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9e8a70740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884ef0 0x562372856600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562372881cf0 con 0x562372884b10 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e015f510 con 0x562372883190 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9e8a70740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623728a3050 con 0x562372884ef0 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9e8a70740 10 client.0 _ll_register_callbacks cb 0x7fe9d0009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884b10 0x562372883f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884b10 0x562372883f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54054/0 (socket says 172.21.15.172:54054) 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9deffd640 1 -- 172.21.15.172:0/3401230585 learned_addr learned my addr 172.21.15.172:0/3401230585 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372883190 0x5623728f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9dffff640 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884ef0 0x562372856600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9deffd640 1 -- 172.21.15.172:0/3401230585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884ef0 msgr2=0x562372856600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9deffd640 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884ef0 0x562372856600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9deffd640 1 -- 172.21.15.172:0/3401230585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372883190 msgr2=0x5623728f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9deffd640 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372883190 0x5623728f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9deffd640 1 -- 172.21.15.172:0/3401230585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56237287f6e0 con 0x562372884b10 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9deffd640 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884b10 0x562372883f80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4057480 tx=0x7fe9d4087780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1473159ecd8b92c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3401230585 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d407b060 con 0x562372884b10 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3401230585 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fe9d405ff90 con 0x562372884b10 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.747+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3401230585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9d002f070 con 0x562372884b10 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3401230585 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9d40576f0 con 0x562372884b10 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9e8a70740 10 client.7470 fetch_fsmap learned FSMap version 50 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3401230585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x56237287f6e0 con 0x562372884b10 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3401230585 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d002f070 con 0x562372884b10 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3401230585 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe9d4053900 con 0x562372884b10 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9e8a70740 10 client.7470 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T08:48:22.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9e8a70740 10 client.7470 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9e8a70740 20 client.7470 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x562372856b90 0x562372897cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9e8a70740 4 client.7470 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3401230585 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5623727c8630 con 0x562372856b90 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x562372856b90 0x562372897cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9df7fe640 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x562372856b90 0x562372897cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48fb9cf1da0c43c4 server_cookie=5fe2e6305362c479 in_seq=0 out_seq=0 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9be7fc640 10 client.7470 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9be7fc640 1 -- 172.21.15.172:0/3401230585 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5623727c8630 con 0x562372856b90 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9be7fc640 10 client.7470 handle_command_reply: tid=0 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.748+0000 7fe9e8a70740 1 client.7470 shutdown 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3401230585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884b10 msgr2=0x562372883f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884b10 0x562372883f80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4057480 tx=0x7fe9d4087780 comp rx=0 tx=0).stop 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3401230585 shutdown_connections 2024-04-25T08:48:22.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x562372856b90 0x562372897cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562372884ef0 0x562372856600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562372884b10 0x562372883f80 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9be7fc640 0 client.7470 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:48:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 1 --2- 172.21.15.172:0/3401230585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562372883190 0x5623728f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3401230585 >> 172.21.15.172:0/3401230585 conn(0x562372857770 msgr2=0x5623728829a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3401230585 shutdown_connections 2024-04-25T08:48:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 1 -- 172.21.15.172:0/3401230585 wait complete. 2024-04-25T08:48:22.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e8a70740 20 client.7470 trim_cache size 0 max 16384 2024-04-25T08:48:22.747 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:48:22.747 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "no active scrubs running", 2024-04-25T08:48:22.748 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": {} 2024-04-25T08:48:22.748 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:48:22.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 -- 172.21.15.172:0/3314928936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe9cc06b4d0 msgr2=0x7fe9cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe9cc06b4d0 0x7fe9cc06d990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009560 tx=0x7fe9d0009190 comp rx=0 tx=0).stop 2024-04-25T08:48:22.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 -- 172.21.15.172:0/3314928936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e006e2f0 msgr2=0x7fe9e00adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e006e2f0 0x7fe9e00adbb0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400c450 tx=0x7fe9d400c910 comp rx=0 tx=0).stop 2024-04-25T08:48:22.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 -- 172.21.15.172:0/3314928936 shutdown_connections 2024-04-25T08:48:22.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe9cc06b4d0 0x7fe9cc06d990 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9e015dcd0 0x7fe9e014b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e006e2f0 0x7fe9e00adbb0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 --2- 172.21.15.172:0/3314928936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9e006b8c0 0x7fe9e0160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 -- 172.21.15.172:0/3314928936 >> 172.21.15.172:0/3314928936 conn(0x7fe9e006abe0 msgr2=0x7fe9e015ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 -- 172.21.15.172:0/3314928936 shutdown_connections 2024-04-25T08:48:22.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.749+0000 7fe9e5d70640 1 -- 172.21.15.172:0/3314928936 wait complete. 2024-04-25T08:48:22.751 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:48:22.751 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T08:48:22.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2024-04-25T08:48:22.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.859+0000 7fbd6485d640 1 Processor -- start 2024-04-25T08:48:22.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.859+0000 7fbd6485d640 1 -- start start 2024-04-25T08:48:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd6485d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbd600ced80 0x7fbd600d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd6485d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd60161710 0x7fbd600d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd6485d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6015e000 con 0x7fbd6015dc20 2024-04-25T08:48:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd6485d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd600d1de0 con 0x7fbd600ced80 2024-04-25T08:48:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd6485d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60161c60 con 0x7fbd60161710 2024-04-25T08:48:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd57fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbd600ced80 0x7fbd600d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd5ed9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd60161710 0x7fbd600d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd57fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbd600ced80 0x7fbd600d22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:37026/0 (socket says 172.21.15.172:37026) 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd57fff640 1 -- 172.21.15.172:0/3240033081 learned_addr learned my addr 172.21.15.172:0/3240033081 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd5e59c640 1 --1- 172.21.15.172:0/3240033081 >> v1:172.21.15.186:6789/0 conn(0x7fbd6015dc20 0x7fbd600ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:59040/0 (socket says 172.21.15.172:59040) 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd57fff640 1 -- 172.21.15.172:0/3240033081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd60161710 msgr2=0x7fbd600d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd57fff640 1 --2- 172.21.15.172:0/3240033081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd60161710 0x7fbd600d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd57fff640 1 -- 172.21.15.172:0/3240033081 >> v1:172.21.15.186:6789/0 conn(0x7fbd6015dc20 legacy=0x7fbd600ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.860+0000 7fbd57fff640 1 -- 172.21.15.172:0/3240033081 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd60161f40 con 0x7fbd600ced80 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.861+0000 7fbd57fff640 1 --2- 172.21.15.172:0/3240033081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd600ced80 0x7fbd600d22e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009870 tx=0x7fbd4802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=999a6edeed629290 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.861+0000 7fbd5dd9b640 1 -- 172.21.15.172:0/3240033081 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48037070 con 0x7fbd600ced80 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.861+0000 7fbd5dd9b640 1 -- 172.21.15.172:0/3240033081 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd48032440 con 0x7fbd600ced80 2024-04-25T08:48:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.861+0000 7fbd5dd9b640 1 -- 172.21.15.172:0/3240033081 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48032810 con 0x7fbd600ced80 2024-04-25T08:48:22.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.862+0000 7fbd6485d640 1 -- 172.21.15.172:0/3240033081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd600ced80 msgr2=0x7fbd600d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.862+0000 7fbd6485d640 1 --2- 172.21.15.172:0/3240033081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd600ced80 0x7fbd600d22e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009870 tx=0x7fbd4802a270 comp rx=0 tx=0).stop 2024-04-25T08:48:22.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.862+0000 7fbd6485d640 1 -- 172.21.15.172:0/3240033081 shutdown_connections 2024-04-25T08:48:22.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.862+0000 7fbd6485d640 1 --2- 172.21.15.172:0/3240033081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd60161710 0x7fbd600d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.862+0000 7fbd6485d640 1 --2- 172.21.15.172:0/3240033081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd600ced80 0x7fbd600d22e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.862+0000 7fbd6485d640 1 -- 172.21.15.172:0/3240033081 >> 172.21.15.172:0/3240033081 conn(0x7fbd600d0420 msgr2=0x7fbd600d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.862+0000 7fbd6485d640 1 -- 172.21.15.172:0/3240033081 shutdown_connections 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.862+0000 7fbd6485d640 1 -- 172.21.15.172:0/3240033081 wait complete. 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.863+0000 7fbd6485d640 1 Processor -- start 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.863+0000 7fbd6485d640 1 -- start start 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd6485d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd600ced80 0x7fbd600c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd6485d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6015dc20 0x7fbd60150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd6485d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd60161710 0x7fbd600cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd6485d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b5e50 con 0x7fbd600ced80 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd6485d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60162500 con 0x7fbd6015dc20 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd6485d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b5fd0 con 0x7fbd60161710 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd5e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd600ced80 0x7fbd600c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd5e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd600ced80 0x7fbd600c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54058/0 (socket says 172.21.15.172:54058) 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd5e59c640 1 -- 172.21.15.172:0/2247832585 learned_addr learned my addr 172.21.15.172:0/2247832585 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd5ed9d640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd60161710 0x7fbd600cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd57fff640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6015dc20 0x7fbd60150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd5e59c640 1 -- 172.21.15.172:0/2247832585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd60161710 msgr2=0x7fbd600cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd60161710 0x7fbd600cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd5e59c640 1 -- 172.21.15.172:0/2247832585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6015dc20 msgr2=0x7fbd60150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6015dc20 0x7fbd60150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.864+0000 7fbd5e59c640 1 -- 172.21.15.172:0/2247832585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd600cc380 con 0x7fbd600ced80 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.865+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd600ced80 0x7fbd600c9e80 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000c3c0 tx=0x7fbd5000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.865+0000 7fbd56ffd640 1 -- 172.21.15.172:0/2247832585 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500074e0 con 0x7fbd600ced80 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.865+0000 7fbd56ffd640 1 -- 172.21.15.172:0/2247832585 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50007680 con 0x7fbd600ced80 2024-04-25T08:48:22.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.865+0000 7fbd6485d640 1 -- 172.21.15.172:0/2247832585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd600cdd10 con 0x7fbd600ced80 2024-04-25T08:48:22.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.865+0000 7fbd56ffd640 1 -- 172.21.15.172:0/2247832585 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50004a00 con 0x7fbd600ced80 2024-04-25T08:48:22.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.865+0000 7fbd6485d640 1 -- 172.21.15.172:0/2247832585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd600c9680 con 0x7fbd600ced80 2024-04-25T08:48:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.867+0000 7fbd56ffd640 1 -- 172.21.15.172:0/2247832585 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd5001a020 con 0x7fbd600ced80 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.867+0000 7fbd56ffd640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd4006b500 0x7fbd4006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.867+0000 7fbd56ffd640 1 -- 172.21.15.172:0/2247832585 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fbd50089a00 con 0x7fbd600ced80 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.867+0000 7fbd57fff640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd4006b500 0x7fbd4006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.868+0000 7fbd57fff640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd4006b500 0x7fbd4006d9c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbd48034000 tx=0x7fbd4802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.868+0000 7fbd671fd740 1 Processor -- start 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.868+0000 7fbd671fd740 1 -- start start 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702c7cca0 0x55c702c7ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702c7d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702ca7760 0x55c702ca7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd671fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c702bdfb90 con 0x55c702c7cca0 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd671fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c702b88e40 con 0x55c702ca7760 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd671fd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c702bdbc30 con 0x55c702cb9370 2024-04-25T08:48:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd5e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702c7cca0 0x55c702c7ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd5e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702c7cca0 0x55c702c7ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54072/0 (socket says 172.21.15.172:54072) 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd5e59c640 1 -- 172.21.15.172:0/994521327 learned_addr learned my addr 172.21.15.172:0/994521327 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd5ed9d640 1 --2- 172.21.15.172:0/994521327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702ca7760 0x55c702ca7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd57fff640 1 --2- 172.21.15.172:0/994521327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702c7d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd5e59c640 1 -- 172.21.15.172:0/994521327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 msgr2=0x55c702c7d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/994521327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702c7d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd5e59c640 1 -- 172.21.15.172:0/994521327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702ca7760 msgr2=0x55c702ca7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/994521327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702ca7760 0x55c702ca7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd5e59c640 1 -- 172.21.15.172:0/994521327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7029be7d0 con 0x55c702c7cca0 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.869+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/994521327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702c7cca0 0x55c702c7ee00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fbd50087d20 tx=0x7fbd5005c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38262f1c4525f0a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd3ffff640 1 -- 172.21.15.172:0/994521327 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50054670 con 0x55c702c7cca0 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd3ffff640 1 -- 172.21.15.172:0/994521327 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50058260 con 0x55c702c7cca0 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd3ffff640 1 -- 172.21.15.172:0/994521327 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500601d0 con 0x55c702c7cca0 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd671fd740 1 -- 172.21.15.172:0/994521327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702c7cca0 msgr2=0x55c702c7ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd671fd740 1 --2- 172.21.15.172:0/994521327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702c7cca0 0x55c702c7ee00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fbd50087d20 tx=0x7fbd5005c1e0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd671fd740 1 -- 172.21.15.172:0/994521327 shutdown_connections 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd671fd740 1 --2- 172.21.15.172:0/994521327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702ca7760 0x55c702ca7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd671fd740 1 --2- 172.21.15.172:0/994521327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702c7d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd671fd740 1 --2- 172.21.15.172:0/994521327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702c7cca0 0x55c702c7ee00 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd671fd740 1 -- 172.21.15.172:0/994521327 >> 172.21.15.172:0/994521327 conn(0x55c702c44870 msgr2=0x55c702cc2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd671fd740 1 -- 172.21.15.172:0/994521327 shutdown_connections 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.870+0000 7fbd671fd740 1 -- 172.21.15.172:0/994521327 wait complete. 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.871+0000 7fbd671fd740 1 -- start start 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.871+0000 7fbd671fd740 1 Processor -- start 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 0x55c702cd5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702caa520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd671fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c702b9c3e0 con 0x55c702ca7760 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd671fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c702ca52b0 con 0x55c702c7cca0 2024-04-25T08:48:22.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd671fd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c702cbc680 con 0x55c702cb9370 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd671fd740 10 client.0 _ll_register_callbacks cb 0x55c702b9bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd57fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd57fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54080/0 (socket says 172.21.15.172:54080) 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd57fff640 1 -- 172.21.15.172:0/1019052420 learned_addr learned my addr 172.21.15.172:0/1019052420 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd5ed9d640 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702caa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 0x55c702cd5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd57fff640 1 -- 172.21.15.172:0/1019052420 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 msgr2=0x55c702caa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd57fff640 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702caa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd57fff640 1 -- 172.21.15.172:0/1019052420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 msgr2=0x55c702cd5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd57fff640 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 0x55c702cd5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.872+0000 7fbd57fff640 1 -- 172.21.15.172:0/1019052420 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7028b40f0 con 0x55c702ca7760 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd57fff640 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9fe0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fbd4802a2b0 tx=0x7fbd4802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1db12dc63fcfc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1019052420 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48037040 con 0x55c702ca7760 2024-04-25T08:48:22.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1019052420 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fbd4804a670 con 0x55c702ca7760 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd671fd740 1 -- 172.21.15.172:0/1019052420 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd50058260 con 0x55c702ca7760 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1019052420 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd4804a870 con 0x55c702ca7760 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd671fd740 10 client.7479 fetch_fsmap learned FSMap version 50 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd671fd740 1 -- 172.21.15.172:0/1019052420 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55c702a1ef60 con 0x55c702ca7760 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1019052420 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50058260 con 0x55c702ca7760 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1019052420 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbd4804aa10 con 0x55c702ca7760 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd671fd740 10 client.7479 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd671fd740 10 client.7479 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd671fd740 20 client.7479 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55c702c9a160 0x55c702cb9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd671fd740 4 client.7479 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd671fd740 1 -- 172.21.15.172:0/1019052420 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c702bed0d0 con 0x55c702c9a160 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.873+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55c702c9a160 0x55c702cb9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd3d7fa640 10 client.7479 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55c702c9a160 0x55c702cb9ca0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=288977c09004cc06 server_cookie=408c53537734d7cc in_seq=0 out_seq=0 2024-04-25T08:48:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1019052420 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c702bed0d0 con 0x55c702c9a160 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd3d7fa640 10 client.7479 handle_command_reply: tid=0 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 client.7479 shutdown 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 -- 172.21.15.172:0/1019052420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 msgr2=0x55c702ca9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9fe0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fbd4802a2b0 tx=0x7fbd4802c070 comp rx=0 tx=0).stop 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 -- 172.21.15.172:0/1019052420 shutdown_connections 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55c702c9a160 0x55c702cb9ca0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702caa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9fe0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1019052420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 0x55c702cd5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd3d7fa640 0 client.7479 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 -- 172.21.15.172:0/1019052420 >> 172.21.15.172:0/1019052420 conn(0x55c702c44870 msgr2=0x55c702cc5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 -- 172.21.15.172:0/1019052420 shutdown_connections 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.874+0000 7fbd671fd740 1 -- 172.21.15.172:0/1019052420 wait complete. 2024-04-25T08:48:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.875+0000 7fbd671fd740 20 client.7479 trim_cache size 0 max 16384 2024-04-25T08:48:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.888+0000 7fbd671fd740 1 Processor -- start 2024-04-25T08:48:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.888+0000 7fbd671fd740 1 -- start start 2024-04-25T08:48:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702c7cca0 0x55c702c98f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702cc58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702cb9370 0x55c702cc5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd671fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd602005a0 con 0x55c702ca7760 2024-04-25T08:48:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd671fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd601ff7b0 con 0x55c702cb9370 2024-04-25T08:48:22.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd671fd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600c7be0 con 0x55c702c7cca0 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd57fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702cc58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd57fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702cc58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54090/0 (socket says 172.21.15.172:54090) 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd57fff640 1 -- 172.21.15.172:0/3369946901 learned_addr learned my addr 172.21.15.172:0/3369946901 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd57fff640 1 -- 172.21.15.172:0/3369946901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702c7cca0 msgr2=0x55c702c98f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd57fff640 1 --2- 172.21.15.172:0/3369946901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702c7cca0 0x55c702c98f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd57fff640 1 -- 172.21.15.172:0/3369946901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702cb9370 msgr2=0x55c702cc5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd57fff640 1 --2- 172.21.15.172:0/3369946901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702cb9370 0x55c702cc5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.889+0000 7fbd57fff640 1 -- 172.21.15.172:0/3369946901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c70288d1b0 con 0x55c702ca7760 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd57fff640 1 --2- 172.21.15.172:0/3369946901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702cc58a0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbd48032a30 tx=0x7fbd4803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423ed834cecea739 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd3f7fe640 1 -- 172.21.15.172:0/3369946901 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48037040 con 0x55c702ca7760 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd3f7fe640 1 -- 172.21.15.172:0/3369946901 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4804f070 con 0x55c702ca7760 2024-04-25T08:48:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd3f7fe640 1 -- 172.21.15.172:0/3369946901 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4804a670 con 0x55c702ca7760 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd671fd740 1 -- 172.21.15.172:0/3369946901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 msgr2=0x55c702cc58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd671fd740 1 --2- 172.21.15.172:0/3369946901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702cc58a0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbd48032a30 tx=0x7fbd4803c000 comp rx=0 tx=0).stop 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd671fd740 1 -- 172.21.15.172:0/3369946901 shutdown_connections 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd671fd740 1 --2- 172.21.15.172:0/3369946901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702cb9370 0x55c702cc5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd671fd740 1 --2- 172.21.15.172:0/3369946901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702cc58a0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd671fd740 1 --2- 172.21.15.172:0/3369946901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702c7cca0 0x55c702c98f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd671fd740 1 -- 172.21.15.172:0/3369946901 >> 172.21.15.172:0/3369946901 conn(0x55c702c44870 msgr2=0x55c702c72f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd671fd740 1 -- 172.21.15.172:0/3369946901 shutdown_connections 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.890+0000 7fbd671fd740 1 -- 172.21.15.172:0/3369946901 wait complete. 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.891+0000 7fbd671fd740 1 -- start start 2024-04-25T08:48:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.891+0000 7fbd671fd740 1 Processor -- start 2024-04-25T08:48:22.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 0x55c702d29980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd671fd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702caa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd671fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd601ff2d0 con 0x55c702ca7760 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd671fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c702d2dab0 con 0x55c702c7cca0 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd671fd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c702c99260 con 0x55c702cb9370 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd671fd740 10 client.0 _ll_register_callbacks cb 0x7fbd580095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd57fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd57fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54096/0 (socket says 172.21.15.172:54096) 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd57fff640 1 -- 172.21.15.172:0/1381782844 learned_addr learned my addr 172.21.15.172:0/1381782844 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd5ed9d640 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702caa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 0x55c702d29980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd57fff640 1 -- 172.21.15.172:0/1381782844 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 msgr2=0x55c702caa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd57fff640 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702caa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd57fff640 1 -- 172.21.15.172:0/1381782844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 msgr2=0x55c702d29980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd57fff640 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 0x55c702d29980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd57fff640 1 -- 172.21.15.172:0/1381782844 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c702d2c6a0 con 0x55c702ca7760 2024-04-25T08:48:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd5ed9d640 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702caa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 0x55c702d29980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd57fff640 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9e80 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fbd480090b0 tx=0x7fbd48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aff9f099c477ad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1381782844 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48037040 con 0x55c702ca7760 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1381782844 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fbd48066c70 con 0x55c702ca7760 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.892+0000 7fbd671fd740 1 -- 172.21.15.172:0/1381782844 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd4804f070 con 0x55c702ca7760 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1381782844 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd4803c910 con 0x55c702ca7760 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd671fd740 10 client.7485 fetch_fsmap learned FSMap version 50 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd671fd740 1 -- 172.21.15.172:0/1381782844 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55c702d2d7f0 con 0x55c702ca7760 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1381782844 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4804f070 con 0x55c702ca7760 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1381782844 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbd4803cab0 con 0x55c702ca7760 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd671fd740 10 client.7485 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T08:48:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd671fd740 10 client.7485 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd671fd740 20 client.7485 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55c702cd6780 0x55c702c7ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd671fd740 4 client.7485 mds_command: new command op to 7224 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd671fd740 1 -- 172.21.15.172:0/1381782844 --> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x55c702be7420 con 0x55c702cd6780 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55c702cd6780 0x55c702c7ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd3d7fa640 10 client.7485 ms_handle_connect on v2:172.21.15.172:6835/1878763904 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.893+0000 7fbd5e59c640 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55c702cd6780 0x55c702c7ba20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f04a1d4f62880c server_cookie=61789d5365609f37 in_seq=0 out_seq=0 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd3d7fa640 1 -- 172.21.15.172:0/1381782844 <== mds.0 v2:172.21.15.172:6835/1878763904 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17938 (crc 0 0 0) 0x55c702be7420 con 0x55c702cd6780 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd3d7fa640 10 client.7485 handle_command_reply: tid=0 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 client.7485 shutdown 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 -- 172.21.15.172:0/1381782844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 msgr2=0x55c702ca9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9e80 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fbd480090b0 tx=0x7fbd48004730 comp rx=0 tx=0).stop 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 -- 172.21.15.172:0/1381782844 shutdown_connections 2024-04-25T08:48:22.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.172:6835/1878763904,v1:172.21.15.172:6837/1878763904] conn(0x55c702cd6780 0x55c702c7ba20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c702cb9370 0x55c702caa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd3d7fa640 0 client.7485 ms_handle_reset on v2:172.21.15.172:6835/1878763904 2024-04-25T08:48:22.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c702ca7760 0x55c702ca9e80 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 --2- 172.21.15.172:0/1381782844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c702c7cca0 0x55c702d29980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 -- 172.21.15.172:0/1381782844 >> 172.21.15.172:0/1381782844 conn(0x55c702c44870 msgr2=0x55c702cbc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 -- 172.21.15.172:0/1381782844 shutdown_connections 2024-04-25T08:48:22.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 1 -- 172.21.15.172:0/1381782844 wait complete. 2024-04-25T08:48:22.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.894+0000 7fbd671fd740 20 client.7485 trim_cache size 0 max 16384 2024-04-25T08:48:22.892 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:48:22.892 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 2867, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2867, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1103303, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 20198990, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 17, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.338842807, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.154211241, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.049514114, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.117759552, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2866, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.572979280, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000199922 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.893 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 10, 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000971, 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000097 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 29578, 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 52038, 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 9271289, 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 56113428, 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 7, 2024-04-25T08:48:22.894 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 2.905791191, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 2.237238227, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 1.051759633, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.062142474, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 52037, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.397072274, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000026847 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 49604, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.008343344, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000168 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.895 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 119696, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 25344 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 3442, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 3462, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 862832, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 48842485, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.435848756, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.212578790, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.065049471, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.140550967, 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T08:48:22.896 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3461, 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.424851049, 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000122753 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 118192 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-04-25T08:48:22.897 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2366, 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 16.732819904, 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.007072197 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3202, 2024-04-25T08:48:22.898 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.116850709, 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000348797 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 25652, 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 25652, 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 25652, 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 281.270430688, 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.010964853 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-04-25T08:48:22.899 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 12, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 17747, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 17747, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 17747, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 2, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 2, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-04-25T08:48:22.900 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 46566, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 46177, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 100, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-04-25T08:48:22.901 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 1675, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 1675, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 11, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 1, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 10, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 1664, 2024-04-25T08:48:22.902 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 1350, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 4042, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 4103, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 3263, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 18, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 14017 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-04-25T08:48:22.903 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 4073, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 3608, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 2169, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-04-25T08:48:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 1, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 31922, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 31922, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-04-25T08:48:22.905 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 51, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 51, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 4, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 106372708, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2599, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 84.189539783, 2024-04-25T08:48:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.032393051 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 14, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 2015, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 2001, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 13, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 13, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 0, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 17747, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 19748, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 2001, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 2, 2024-04-25T08:48:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 2315, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 2313, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 100828, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215396 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 28496, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 25652, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 5, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2000, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.429438752, 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000714719 2024-04-25T08:48:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 29, 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.004279944, 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000147584 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6000, 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 7.019271372, 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001169878 2024-04-25T08:48:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7441, 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 6.500271986, 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000873575 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.910 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000039989, 2024-04-25T08:48:22.911 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000039989 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002757826, 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002757826 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.912 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.236674615, 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.236674615 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8, 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.500241188, 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.187530148 2024-04-25T08:48:22.913 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2169, 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 248.304724516, 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.114478895 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.914 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.006052644, 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006052644 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.915 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000249184, 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000249184 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.916 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8000, 2024-04-25T08:48:22.917 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 16.266428672, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002033303 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 1, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-04-25T08:48:22.918 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 18820, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 18820, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 74, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T08:48:22.919 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T08:48:22.920 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 250176, 2024-04-25T08:48:22.921 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 92, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 440, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 5, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 5528, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 78, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-04-25T08:48:22.922 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 13364373, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 660122, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 8095, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 102841247, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 37, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 8095, 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-04-25T08:48:22.923 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8095, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 31.233243852, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003858337 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8095, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 8185 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 8095, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 1715, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 6380, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-04-25T08:48:22.924 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 11, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 39, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 2637, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 27, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 1608, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 2036, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1676, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 22, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-04-25T08:48:22.925 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-04-25T08:48:22.926 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 83, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 3, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 8, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 8, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 98, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-04-25T08:48:22.927 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 31 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 32, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 32, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 3608, 2024-04-25T08:48:22.928 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 3608, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 35882, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 8445546, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 35882, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 35882, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 8445546, 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:48:22.929 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-04-25T08:48:22.930 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 8095, 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 103218519, 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 8095, 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 103218519, 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:48:22.931 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 8095, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 8095, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 8095, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 8095, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-04-25T08:48:22.932 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 3608, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 377272, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 3608, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 38, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 377272, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x563d9d4606e0": { 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 31922, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 102178404, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 31922, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2599, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 102178404, 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-04-25T08:48:22.934 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-04-25T08:48:22.935 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-04-25T08:48:22.935 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-04-25T08:48:22.935 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:22.935 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:22.935 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:48:22.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 -- 172.21.15.172:0/2247832585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd4006b500 msgr2=0x7fbd4006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd4006b500 0x7fbd4006d9c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbd48034000 tx=0x7fbd4802e000 comp rx=0 tx=0).stop 2024-04-25T08:48:22.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 -- 172.21.15.172:0/2247832585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd600ced80 msgr2=0x7fbd600c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:22.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd600ced80 0x7fbd600c9e80 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000c3c0 tx=0x7fbd5000c880 comp rx=0 tx=0).stop 2024-04-25T08:48:22.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 -- 172.21.15.172:0/2247832585 shutdown_connections 2024-04-25T08:48:22.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd4006b500 0x7fbd4006d9c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd6015dc20 0x7fbd60150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd60161710 0x7fbd600cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 --2- 172.21.15.172:0/2247832585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd600ced80 0x7fbd600c9e80 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:22.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 -- 172.21.15.172:0/2247832585 >> 172.21.15.172:0/2247832585 conn(0x7fbd600d0420 msgr2=0x7fbd600d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:22.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 -- 172.21.15.172:0/2247832585 shutdown_connections 2024-04-25T08:48:22.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:22.895+0000 7fbd6485d640 1 -- 172.21.15.172:0/2247832585 wait complete. 2024-04-25T08:48:22.938 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:48:22.938 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:48:22.979 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:48:23.029 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:48:23.029 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:48:23.029 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:48:23.044 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:48:23.044 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:48:23.100 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:48:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.246+0000 7f9b76e1f640 1 Processor -- start 2024-04-25T08:48:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.246+0000 7f9b76e1f640 1 -- start start 2024-04-25T08:48:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.247+0000 7f9b76e1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700d0ad0 0x7f9b70168760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.247+0000 7f9b76e1f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b700b9940 con 0x7f9b7015dd30 2024-04-25T08:48:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.247+0000 7f9b76e1f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b700d1df0 con 0x7f9b700d2e90 2024-04-25T08:48:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.247+0000 7f9b76e1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700b7a50 con 0x7f9b700d0ad0 2024-04-25T08:48:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.247+0000 7f9b74bbb640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9b7015dd30 0x7f9b700b9230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58934/0 (socket says 172.21.15.172:58934) 2024-04-25T08:48:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.247+0000 7f9b74bbb640 1 -- 172.21.15.172:0/1464213742 learned_addr learned my addr 172.21.15.172:0/1464213742 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.247+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723853581 0 0) 0x7f9b700b9940 con 0x7f9b7015dd30 2024-04-25T08:48:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.247+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b60003520 con 0x7f9b7015dd30 2024-04-25T08:48:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.247+0000 7f9b753bc640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700d0ad0 0x7f9b70168760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 567928631 0 0) 0x7f9b60003520 con 0x7f9b7015dd30 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700d0ad0 msgr2=0x7f9b70168760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700d0ad0 0x7f9b70168760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 >> v1:172.21.15.186:6789/0 conn(0x7f9b700d2e90 legacy=0x7f9b700d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b700d20d0 con 0x7f9b7015dd30 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f9b64001670 con 0x7f9b7015dd30 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 >> v1:172.21.15.172:6789/0 conn(0x7f9b7015dd30 legacy=0x7f9b700b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 0x7f9b60003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700d0ad0 0x7f9b60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b60004d40 0x7f9b600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700b7a50 con 0x7f9b600039e0 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6000baf0 con 0x7f9b60004d40 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6000bcf0 con 0x7f9b700d0ad0 2024-04-25T08:48:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b74bbb640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 0x7f9b60003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6ffff640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700d0ad0 0x7f9b60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b753bc640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b60004d40 0x7f9b600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b74bbb640 1 -- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700d0ad0 msgr2=0x7f9b60004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b74bbb640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700d0ad0 0x7f9b60004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b74bbb640 1 -- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b60004d40 msgr2=0x7f9b600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b74bbb640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b60004d40 0x7f9b600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b74bbb640 1 -- 172.21.15.172:0/1464213742 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b60003520 con 0x7f9b600039e0 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.248+0000 7f9b6ffff640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700d0ad0 0x7f9b60004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b74bbb640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 0x7f9b60003e00 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400c240 tx=0x7f9b60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27591ed97a8ce308 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64007d10 con 0x7f9b600039e0 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b64005ad0 con 0x7f9b600039e0 2024-04-25T08:48:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b6f7fe640 1 -- 172.21.15.172:0/1464213742 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64007070 con 0x7f9b600039e0 2024-04-25T08:48:23.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b76e1f640 1 -- 172.21.15.172:0/1464213742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 msgr2=0x7f9b60003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b76e1f640 1 --2- 172.21.15.172:0/1464213742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 0x7f9b60003e00 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400c240 tx=0x7f9b60005830 comp rx=0 tx=0).stop 2024-04-25T08:48:23.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b753bc640 1 -- 172.21.15.172:0/1464213742 reap_dead start 2024-04-25T08:48:23.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b76e1f640 1 -- 172.21.15.172:0/1464213742 shutdown_connections 2024-04-25T08:48:23.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b76e1f640 1 -- 172.21.15.172:0/1464213742 >> 172.21.15.172:0/1464213742 conn(0x7f9b70061c30 msgr2=0x7f9b7006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:23.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b76e1f640 1 -- 172.21.15.172:0/1464213742 shutdown_connections 2024-04-25T08:48:23.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.249+0000 7f9b76e1f640 1 -- 172.21.15.172:0/1464213742 wait complete. 2024-04-25T08:48:23.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.251+0000 7f9b76e1f640 1 Processor -- start 2024-04-25T08:48:23.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.251+0000 7f9b76e1f640 1 -- start start 2024-04-25T08:48:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.251+0000 7f9b76e1f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 0x7f9b700c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.251+0000 7f9b76e1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700cdc90 0x7f9b701564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.251+0000 7f9b76e1f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b701572b0 0x7f9b70157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.251+0000 7f9b76e1f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700d2970 con 0x7f9b600039e0 2024-04-25T08:48:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.251+0000 7f9b76e1f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700d2690 con 0x7f9b701572b0 2024-04-25T08:48:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.251+0000 7f9b76e1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b700d1a10 con 0x7f9b700cdc90 2024-04-25T08:48:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b74bbb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 0x7f9b700c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b74bbb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 0x7f9b700c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54114/0 (socket says 172.21.15.172:54114) 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b74bbb640 1 -- 172.21.15.172:0/672470602 learned_addr learned my addr 172.21.15.172:0/672470602 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b74bbb640 1 -- 172.21.15.172:0/672470602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700cdc90 msgr2=0x7f9b701564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b74bbb640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700cdc90 0x7f9b701564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b74bbb640 1 -- 172.21.15.172:0/672470602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b701572b0 msgr2=0x7f9b70157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b74bbb640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b701572b0 0x7f9b70157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b74bbb640 1 -- 172.21.15.172:0/672470602 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b70159d20 con 0x7f9b600039e0 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b74bbb640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 0x7f9b700c9410 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400c2a0 tx=0x7f9b700d1fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b6d7fa640 1 -- 172.21.15.172:0/672470602 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64040020 con 0x7f9b600039e0 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b6d7fa640 1 -- 172.21.15.172:0/672470602 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b64001430 con 0x7f9b600039e0 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b76e1f640 1 -- 172.21.15.172:0/672470602 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b70159fc0 con 0x7f9b600039e0 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b6d7fa640 1 -- 172.21.15.172:0/672470602 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64037040 con 0x7f9b600039e0 2024-04-25T08:48:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.252+0000 7f9b76e1f640 1 -- 172.21.15.172:0/672470602 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7015a580 con 0x7f9b600039e0 2024-04-25T08:48:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.253+0000 7f9b76e1f640 1 -- 172.21.15.172:0/672470602 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b70073990 con 0x7f9b600039e0 2024-04-25T08:48:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.254+0000 7f9b6d7fa640 1 -- 172.21.15.172:0/672470602 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b64043020 con 0x7f9b600039e0 2024-04-25T08:48:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.254+0000 7f9b6d7fa640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b5406b4c0 0x7f9b5406d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.254+0000 7f9b6d7fa640 1 -- 172.21.15.172:0/672470602 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f9b640a9780 con 0x7f9b600039e0 2024-04-25T08:48:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.254+0000 7f9b6ffff640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b5406b4c0 0x7f9b5406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.254+0000 7f9b6ffff640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b5406b4c0 0x7f9b5406d980 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0079b0 tx=0x7f9b5c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.258+0000 7f9b6d7fa640 1 -- 172.21.15.172:0/672470602 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b64078570 con 0x7f9b600039e0 2024-04-25T08:48:23.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.430+0000 7f9b76e1f640 1 -- 172.21.15.172:0/672470602 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b700b82c0 con 0x7f9b600039e0 2024-04-25T08:48:23.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.431+0000 7f9b6d7fa640 1 -- 172.21.15.172:0/672470602 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f9b64077e70 con 0x7f9b600039e0 2024-04-25T08:48:23.423 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:23.423 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":83,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:04.271283+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:55.259890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:56.021748+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":82,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:48:23.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 -- 172.21.15.172:0/672470602 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b5406b4c0 msgr2=0x7f9b5406d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b5406b4c0 0x7f9b5406d980 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0079b0 tx=0x7f9b5c009040 comp rx=0 tx=0).stop 2024-04-25T08:48:23.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 -- 172.21.15.172:0/672470602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 msgr2=0x7f9b700c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 0x7f9b700c9410 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400c2a0 tx=0x7f9b700d1fc0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 -- 172.21.15.172:0/672470602 shutdown_connections 2024-04-25T08:48:23.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b5406b4c0 0x7f9b5406d980 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b701572b0 0x7f9b70157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b700cdc90 0x7f9b701564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 --2- 172.21.15.172:0/672470602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b600039e0 0x7f9b700c9410 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 -- 172.21.15.172:0/672470602 >> 172.21.15.172:0/672470602 conn(0x7f9b70061c30 msgr2=0x7f9b700b8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:23.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 -- 172.21.15.172:0/672470602 shutdown_connections 2024-04-25T08:48:23.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.433+0000 7f9b76e1f640 1 -- 172.21.15.172:0/672470602 wait complete. 2024-04-25T08:48:23.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:46:55.259890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:46:56.021748+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 82, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:48:23.436 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:48:23.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.545+0000 7fae74f5c640 1 Processor -- start 2024-04-25T08:48:23.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.545+0000 7fae74f5c640 1 -- start start 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.546+0000 7fae74f5c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fae7006abe0 0x7fae700acec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.546+0000 7fae74f5c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7006db40 con 0x7fae700b3db0 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.546+0000 7fae74f5c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7006de20 con 0x7fae700b3920 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.546+0000 7fae74f5c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7006e100 con 0x7fae7006abe0 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.546+0000 7fae6ed9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fae700b3db0 0x7fae7006ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58940/0 (socket says 172.21.15.172:58940) 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.546+0000 7fae6ed9d640 1 -- 172.21.15.172:0/2682897912 learned_addr learned my addr 172.21.15.172:0/2682897912 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.546+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959343002 0 0) 0x7fae7006db40 con 0x7fae700b3db0 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.546+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae58003520 con 0x7fae700b3db0 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6e59c640 1 --2- 172.21.15.172:0/2682897912 >> v2:172.21.15.186:3300/0 conn(0x7fae7006abe0 0x7fae700acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 822380050 0 0) 0x7fae58003520 con 0x7fae700b3db0 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 >> v2:172.21.15.186:3300/0 conn(0x7fae7006abe0 msgr2=0x7fae700acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 --2- 172.21.15.172:0/2682897912 >> v2:172.21.15.186:3300/0 conn(0x7fae7006abe0 0x7fae700acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 >> v1:172.21.15.186:6789/0 conn(0x7fae700b3920 legacy=0x7fae7006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7006e3e0 con 0x7fae700b3db0 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fae680019f0 con 0x7fae700b3db0 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 >> v1:172.21.15.172:6789/0 conn(0x7fae700b3db0 legacy=0x7fae7006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae580039b0 0x7fae58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae58004800 0x7fae58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7006e100 con 0x7fae580052e0 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5800c1b0 con 0x7fae580039b0 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5800c3b0 con 0x7fae58004800 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6ed9d640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6e59c640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae580039b0 0x7fae58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6dd9b640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae58004800 0x7fae58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6ed9d640 1 -- 172.21.15.172:0/2682897912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae58004800 msgr2=0x7fae58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6ed9d640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae58004800 0x7fae58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6ed9d640 1 -- 172.21.15.172:0/2682897912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae580039b0 msgr2=0x7fae58003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6ed9d640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae580039b0 0x7fae58003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.547+0000 7fae6ed9d640 1 -- 172.21.15.172:0/2682897912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58003520 con 0x7fae580052e0 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.548+0000 7fae6ed9d640 1 -- 172.21.15.172:0/2682897912 reap_dead start 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.548+0000 7fae6ed9d640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae5800b9c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fae6800a810 tx=0x7fae58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c208cbbe96d92e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.548+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800a460 con 0x7fae580052e0 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.548+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6802f070 con 0x7fae580052e0 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.548+0000 7fae6d59a640 1 -- 172.21.15.172:0/2682897912 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6802bc90 con 0x7fae580052e0 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.548+0000 7fae74f5c640 1 -- 172.21.15.172:0/2682897912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 msgr2=0x7fae5800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.548+0000 7fae74f5c640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae5800b9c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fae6800a810 tx=0x7fae58005830 comp rx=0 tx=0).stop 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.549+0000 7fae74f5c640 1 -- 172.21.15.172:0/2682897912 shutdown_connections 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.549+0000 7fae74f5c640 1 --2- 172.21.15.172:0/2682897912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae5800b9c0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.549+0000 7fae74f5c640 1 -- 172.21.15.172:0/2682897912 >> 172.21.15.172:0/2682897912 conn(0x7fae700cfec0 msgr2=0x7fae700d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.549+0000 7fae74f5c640 1 -- 172.21.15.172:0/2682897912 shutdown_connections 2024-04-25T08:48:23.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.549+0000 7fae74f5c640 1 -- 172.21.15.172:0/2682897912 wait complete. 2024-04-25T08:48:23.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.550+0000 7fae74f5c640 1 Processor -- start 2024-04-25T08:48:23.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.550+0000 7fae74f5c640 1 -- start start 2024-04-25T08:48:23.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae74f5c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae70141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae74f5c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae70142460 0x7fae70144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae74f5c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae70143aa0 0x7fae7006b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae74f5c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700ad040 con 0x7fae580052e0 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae74f5c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700acec0 con 0x7fae70143aa0 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae74f5c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae700ad1c0 con 0x7fae70142460 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae6e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae70141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae6e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae70141ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54118/0 (socket says 172.21.15.172:54118) 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae6e59c640 1 -- 172.21.15.172:0/4179703130 learned_addr learned my addr 172.21.15.172:0/4179703130 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae6e59c640 1 -- 172.21.15.172:0/4179703130 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae70142460 msgr2=0x7fae70144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae6e59c640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae70142460 0x7fae70144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae6e59c640 1 -- 172.21.15.172:0/4179703130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae70143aa0 msgr2=0x7fae7006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae6e59c640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae70143aa0 0x7fae7006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae6e59c640 1 -- 172.21.15.172:0/4179703130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae70145440 con 0x7fae580052e0 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae6e59c640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae70141ca0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fae6400b7c0 tx=0x7fae6400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae5effd640 1 -- 172.21.15.172:0/4179703130 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64018070 con 0x7fae580052e0 2024-04-25T08:48:23.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae5effd640 1 -- 172.21.15.172:0/4179703130 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae640107d0 con 0x7fae580052e0 2024-04-25T08:48:23.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae74f5c640 1 -- 172.21.15.172:0/4179703130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae70142a00 con 0x7fae580052e0 2024-04-25T08:48:23.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae5effd640 1 -- 172.21.15.172:0/4179703130 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64010ba0 con 0x7fae580052e0 2024-04-25T08:48:23.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.551+0000 7fae74f5c640 1 -- 172.21.15.172:0/4179703130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae70142fc0 con 0x7fae580052e0 2024-04-25T08:48:23.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.552+0000 7fae74f5c640 1 -- 172.21.15.172:0/4179703130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae70073a00 con 0x7fae580052e0 2024-04-25T08:48:23.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.553+0000 7fae5effd640 1 -- 172.21.15.172:0/4179703130 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae6401b070 con 0x7fae580052e0 2024-04-25T08:48:23.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.553+0000 7fae5effd640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae5006b4d0 0x7fae5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.553+0000 7fae5effd640 1 -- 172.21.15.172:0/4179703130 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fae6408a810 con 0x7fae580052e0 2024-04-25T08:48:23.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.553+0000 7fae6dd9b640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae5006b4d0 0x7fae5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.554+0000 7fae6dd9b640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae5006b4d0 0x7fae5006d990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fae70148900 tx=0x7fae60009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:23.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.557+0000 7fae5effd640 1 -- 172.21.15.172:0/4179703130 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae70145440 con 0x7fae580052e0 2024-04-25T08:48:23.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.727+0000 7fae74f5c640 1 -- 172.21.15.172:0/4179703130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae7006f5c0 con 0x7fae580052e0 2024-04-25T08:48:23.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.727+0000 7fae5effd640 1 -- 172.21.15.172:0/4179703130 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae640594e0 con 0x7fae580052e0 2024-04-25T08:48:23.719 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:48:23.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.729+0000 7fae74f5c640 1 -- 172.21.15.172:0/4179703130 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae5006b4d0 msgr2=0x7fae5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.729+0000 7fae74f5c640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae5006b4d0 0x7fae5006d990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fae70148900 tx=0x7fae60009040 comp rx=0 tx=0).stop 2024-04-25T08:48:23.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.729+0000 7fae74f5c640 1 -- 172.21.15.172:0/4179703130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 msgr2=0x7fae70141ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.729+0000 7fae74f5c640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae70141ca0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fae6400b7c0 tx=0x7fae6400bc80 comp rx=0 tx=0).stop 2024-04-25T08:48:23.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.729+0000 7fae74f5c640 1 -- 172.21.15.172:0/4179703130 shutdown_connections 2024-04-25T08:48:23.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.729+0000 7fae74f5c640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae5006b4d0 0x7fae5006d990 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.729+0000 7fae74f5c640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae70143aa0 0x7fae7006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.729+0000 7fae74f5c640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae70142460 0x7fae70144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.729+0000 7fae74f5c640 1 --2- 172.21.15.172:0/4179703130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae580052e0 0x7fae70141ca0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.729+0000 7fae74f5c640 1 -- 172.21.15.172:0/4179703130 >> 172.21.15.172:0/4179703130 conn(0x7fae700cfec0 msgr2=0x7fae700b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:23.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.730+0000 7fae74f5c640 1 -- 172.21.15.172:0/4179703130 shutdown_connections 2024-04-25T08:48:23.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.730+0000 7fae74f5c640 1 -- 172.21.15.172:0/4179703130 wait complete. 2024-04-25T08:48:23.732 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:48:23.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.841+0000 7efe52d96640 1 Processor -- start 2024-04-25T08:48:23.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.841+0000 7efe52d96640 1 -- start start 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe52d96640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7efe4c15dac0 0x7efe4c0d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe52d96640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c0d0ab0 0x7efe4c0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe52d96640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4c0d2420 con 0x7efe4c0d1f30 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe52d96640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c0d3030 con 0x7efe4c15dac0 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe52d96640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0d2700 con 0x7efe4c0d0ab0 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe43fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efe4c0d1f30 0x7efe4c0d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58942/0 (socket says 172.21.15.172:58942) 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe43fff640 1 -- 172.21.15.172:0/1355780644 learned_addr learned my addr 172.21.15.172:0/1355780644 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe51333640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c0d0ab0 0x7efe4c0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe50b32640 1 --2- 172.21.15.172:0/1355780644 >> v2:172.21.15.186:3300/0 conn(0x7efe4c15dac0 0x7efe4c0d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926402354 0 0) 0x7efe4c0d2420 con 0x7efe4c0d1f30 2024-04-25T08:48:23.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe34003520 con 0x7efe4c0d1f30 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 506927263 0 0) 0x7efe34003520 con 0x7efe4c0d1f30 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c0d0ab0 msgr2=0x7efe4c0b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe437fe640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c0d0ab0 0x7efe4c0b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 >> v2:172.21.15.186:3300/0 conn(0x7efe4c15dac0 msgr2=0x7efe4c0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe437fe640 1 --2- 172.21.15.172:0/1355780644 >> v2:172.21.15.186:3300/0 conn(0x7efe4c15dac0 0x7efe4c0d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c0d29e0 con 0x7efe4c0d1f30 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7efe3c0017f0 con 0x7efe4c0d1f30 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe51333640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c0d0ab0 0x7efe4c0b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.842+0000 7efe50b32640 1 --2- 172.21.15.172:0/1355780644 >> v2:172.21.15.186:3300/0 conn(0x7efe4c15dac0 0x7efe4c0d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 >> v1:172.21.15.172:6789/0 conn(0x7efe4c0d1f30 legacy=0x7efe4c0d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe437fe640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c0d0ab0 0x7efe340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe437fe640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe34003ef0 0x7efe34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe437fe640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe34004d40 0x7efe340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0d3030 con 0x7efe34004d40 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0d2700 con 0x7efe34003ef0 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3400b9c0 con 0x7efe4c0d0ab0 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe51333640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe34004d40 0x7efe340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe50b32640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c0d0ab0 0x7efe340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe43fff640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe34003ef0 0x7efe34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe51333640 1 -- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c0d0ab0 msgr2=0x7efe340039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe51333640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c0d0ab0 0x7efe340039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe51333640 1 -- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe34003ef0 msgr2=0x7efe34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe51333640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe34003ef0 0x7efe34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.843+0000 7efe51333640 1 -- 172.21.15.172:0/1355780644 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34003520 con 0x7efe34004d40 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe51333640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe34004d40 0x7efe340051c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7efe4400e350 tx=0x7efe34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3208ff0211187333 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:23.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe44033070 con 0x7efe34004d40 2024-04-25T08:48:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4402f660 con 0x7efe34004d40 2024-04-25T08:48:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe437fe640 1 -- 172.21.15.172:0/1355780644 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe44009de0 con 0x7efe34004d40 2024-04-25T08:48:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe52d96640 1 -- 172.21.15.172:0/1355780644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe34004d40 msgr2=0x7efe340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe52d96640 1 --2- 172.21.15.172:0/1355780644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe34004d40 0x7efe340051c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7efe4400e350 tx=0x7efe34005830 comp rx=0 tx=0).stop 2024-04-25T08:48:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe51333640 1 -- 172.21.15.172:0/1355780644 reap_dead start 2024-04-25T08:48:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe52d96640 1 -- 172.21.15.172:0/1355780644 shutdown_connections 2024-04-25T08:48:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe52d96640 1 -- 172.21.15.172:0/1355780644 >> 172.21.15.172:0/1355780644 conn(0x7efe4c061c30 msgr2=0x7efe4c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe52d96640 1 -- 172.21.15.172:0/1355780644 shutdown_connections 2024-04-25T08:48:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.844+0000 7efe52d96640 1 -- 172.21.15.172:0/1355780644 wait complete. 2024-04-25T08:48:23.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.846+0000 7efe52d96640 1 Processor -- start 2024-04-25T08:48:23.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.846+0000 7efe52d96640 1 -- start start 2024-04-25T08:48:23.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.846+0000 7efe52d96640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe34004d40 0x7efe4c157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.846+0000 7efe52d96640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c152ef0 0x7efe4c156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.846+0000 7efe52d96640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c156a80 0x7efe4c15f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.846+0000 7efe52d96640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0b97d0 con 0x7efe4c156a80 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.846+0000 7efe52d96640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c15dea0 con 0x7efe34004d40 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.846+0000 7efe52d96640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0b9950 con 0x7efe4c152ef0 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe51333640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c156a80 0x7efe4c15f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe51333640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c156a80 0x7efe4c15f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54128/0 (socket says 172.21.15.172:54128) 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe51333640 1 -- 172.21.15.172:0/147303810 learned_addr learned my addr 172.21.15.172:0/147303810 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe43fff640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c152ef0 0x7efe4c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe50b32640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe34004d40 0x7efe4c157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe51333640 1 -- 172.21.15.172:0/147303810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c152ef0 msgr2=0x7efe4c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe51333640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c152ef0 0x7efe4c156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe51333640 1 -- 172.21.15.172:0/147303810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe34004d40 msgr2=0x7efe4c157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe51333640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe34004d40 0x7efe4c157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe51333640 1 -- 172.21.15.172:0/147303810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c153f90 con 0x7efe4c156a80 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe43fff640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c152ef0 0x7efe4c156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe50b32640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe34004d40 0x7efe4c157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe51333640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c156a80 0x7efe4c15f580 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7efe4400e470 tx=0x7efe44009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe417fa640 1 -- 172.21.15.172:0/147303810 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe44033040 con 0x7efe4c156a80 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe417fa640 1 -- 172.21.15.172:0/147303810 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe44009a50 con 0x7efe4c156a80 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe52d96640 1 -- 172.21.15.172:0/147303810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4c0b4600 con 0x7efe4c156a80 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe417fa640 1 -- 172.21.15.172:0/147303810 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe44009de0 con 0x7efe4c156a80 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.847+0000 7efe52d96640 1 -- 172.21.15.172:0/147303810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c0b4bc0 con 0x7efe4c156a80 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.848+0000 7efe52d96640 1 -- 172.21.15.172:0/147303810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4c073a00 con 0x7efe4c156a80 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.849+0000 7efe417fa640 1 -- 172.21.15.172:0/147303810 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe44036070 con 0x7efe4c156a80 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.849+0000 7efe417fa640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe3806b500 0x7efe3806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:23.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.849+0000 7efe417fa640 1 -- 172.21.15.172:0/147303810 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7efe440aaf30 con 0x7efe4c156a80 2024-04-25T08:48:23.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.849+0000 7efe50b32640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe3806b500 0x7efe3806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:23.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.850+0000 7efe50b32640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe3806b500 0x7efe3806d9c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efe48009cc0 tx=0x7efe48008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:23.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:23.853+0000 7efe417fa640 1 -- 172.21.15.172:0/147303810 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe44047060 con 0x7efe4c156a80 2024-04-25T08:48:24.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.025+0000 7efe52d96640 1 -- 172.21.15.172:0/147303810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efe4c157590 con 0x7efe4c156a80 2024-04-25T08:48:24.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.025+0000 7efe417fa640 1 -- 172.21.15.172:0/147303810 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7efe44079b70 con 0x7efe4c156a80 2024-04-25T08:48:24.016 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:48:24.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 -- 172.21.15.172:0/147303810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe3806b500 msgr2=0x7efe3806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe3806b500 0x7efe3806d9c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efe48009cc0 tx=0x7efe48008040 comp rx=0 tx=0).stop 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 -- 172.21.15.172:0/147303810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c156a80 msgr2=0x7efe4c15f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c156a80 0x7efe4c15f580 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7efe4400e470 tx=0x7efe44009750 comp rx=0 tx=0).stop 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 -- 172.21.15.172:0/147303810 shutdown_connections 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe3806b500 0x7efe3806d9c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c156a80 0x7efe4c15f580 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe4c152ef0 0x7efe4c156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 --2- 172.21.15.172:0/147303810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe34004d40 0x7efe4c157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 -- 172.21.15.172:0/147303810 >> 172.21.15.172:0/147303810 conn(0x7efe4c061c30 msgr2=0x7efe4c0ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 -- 172.21.15.172:0/147303810 shutdown_connections 2024-04-25T08:48:24.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.027+0000 7efe52d96640 1 -- 172.21.15.172:0/147303810 wait complete. 2024-04-25T08:48:24.029 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:48:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.138+0000 7f7d56e1b640 1 Processor -- start 2024-04-25T08:48:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.138+0000 7f7d56e1b640 1 -- start start 2024-04-25T08:48:24.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.139+0000 7f7d56e1b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7d501446d0 0x7f7d500b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.139+0000 7f7d56e1b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d5006e8a0 0x7f7d500b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.139+0000 7f7d56e1b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d500cccc0 con 0x7f7d50144d50 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.139+0000 7f7d56e1b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d500b2b20 con 0x7f7d5006e8a0 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.139+0000 7f7d56e1b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5006d400 con 0x7f7d501446d0 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.139+0000 7f7d553b8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d5006e8a0 0x7f7d500b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.139+0000 7f7d4ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7d50144d50 0x7f7d500cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58958/0 (socket says 172.21.15.172:58958) 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.139+0000 7f7d4ffff640 1 -- 172.21.15.172:0/4147412048 learned_addr learned my addr 172.21.15.172:0/4147412048 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.139+0000 7f7d54bb7640 1 --2- 172.21.15.172:0/4147412048 >> v2:172.21.15.186:3300/0 conn(0x7f7d501446d0 0x7f7d500b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.140+0000 7f7d553b8640 1 -- 172.21.15.172:0/4147412048 >> v2:172.21.15.186:3300/0 conn(0x7f7d501446d0 msgr2=0x7f7d500b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.140+0000 7f7d553b8640 1 --2- 172.21.15.172:0/4147412048 >> v2:172.21.15.186:3300/0 conn(0x7f7d501446d0 0x7f7d500b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.140+0000 7f7d553b8640 1 -- 172.21.15.172:0/4147412048 >> v1:172.21.15.172:6789/0 conn(0x7f7d50144d50 legacy=0x7f7d500cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.140+0000 7f7d4f7fe640 1 -- 172.21.15.172:0/4147412048 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533837164 0 0) 0x7f7d500cccc0 con 0x7f7d50144d50 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.140+0000 7f7d553b8640 1 -- 172.21.15.172:0/4147412048 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500cc140 con 0x7f7d5006e8a0 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.140+0000 7f7d553b8640 1 --2- 172.21.15.172:0/4147412048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d5006e8a0 0x7f7d500b4460 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7d500cf560 tx=0x7f7d4802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7690dd45e71c8a19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.140+0000 7f7d4f7fe640 1 -- 172.21.15.172:0/4147412048 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48007740 con 0x7f7d5006e8a0 2024-04-25T08:48:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.140+0000 7f7d4f7fe640 1 -- 172.21.15.172:0/4147412048 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d480078e0 con 0x7f7d5006e8a0 2024-04-25T08:48:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.140+0000 7f7d4f7fe640 1 -- 172.21.15.172:0/4147412048 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48007cb0 con 0x7f7d5006e8a0 2024-04-25T08:48:24.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.141+0000 7f7d56e1b640 1 -- 172.21.15.172:0/4147412048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d5006e8a0 msgr2=0x7f7d500b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.141+0000 7f7d56e1b640 1 --2- 172.21.15.172:0/4147412048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d5006e8a0 0x7f7d500b4460 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7d500cf560 tx=0x7f7d4802a680 comp rx=0 tx=0).stop 2024-04-25T08:48:24.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.141+0000 7f7d56e1b640 1 -- 172.21.15.172:0/4147412048 shutdown_connections 2024-04-25T08:48:24.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.141+0000 7f7d56e1b640 1 --2- 172.21.15.172:0/4147412048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d5006e8a0 0x7f7d500b4460 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.141+0000 7f7d56e1b640 1 --2- 172.21.15.172:0/4147412048 >> v2:172.21.15.186:3300/0 conn(0x7f7d501446d0 0x7f7d500b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.141+0000 7f7d56e1b640 1 -- 172.21.15.172:0/4147412048 >> 172.21.15.172:0/4147412048 conn(0x7f7d5006abe0 msgr2=0x7f7d5006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.141+0000 7f7d56e1b640 1 -- 172.21.15.172:0/4147412048 shutdown_connections 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.141+0000 7f7d56e1b640 1 -- 172.21.15.172:0/4147412048 wait complete. 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.142+0000 7f7d56e1b640 1 Processor -- start 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.142+0000 7f7d56e1b640 1 -- start start 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d56e1b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d5006e8a0 0x7f7d50150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d56e1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d501446d0 0x7f7d500b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d56e1b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d50144d50 0x7f7d500b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d56e1b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500cc700 con 0x7f7d501446d0 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d56e1b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500b49a0 con 0x7f7d50144d50 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d56e1b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d500cc9e0 con 0x7f7d5006e8a0 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d4ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d501446d0 0x7f7d500b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d4ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d501446d0 0x7f7d500b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54144/0 (socket says 172.21.15.172:54144) 2024-04-25T08:48:24.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d4ffff640 1 -- 172.21.15.172:0/1631572265 learned_addr learned my addr 172.21.15.172:0/1631572265 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d4ffff640 1 -- 172.21.15.172:0/1631572265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d5006e8a0 msgr2=0x7f7d50150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d4ffff640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d5006e8a0 0x7f7d50150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d4ffff640 1 -- 172.21.15.172:0/1631572265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d50144d50 msgr2=0x7f7d500b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d4ffff640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d50144d50 0x7f7d500b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.143+0000 7f7d4ffff640 1 -- 172.21.15.172:0/1631572265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500ad670 con 0x7f7d501446d0 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.144+0000 7f7d4ffff640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d501446d0 0x7f7d500b1d20 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c430 tx=0x7f7d4400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.144+0000 7f7d4d7fa640 1 -- 172.21.15.172:0/1631572265 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440074e0 con 0x7f7d501446d0 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.144+0000 7f7d4d7fa640 1 -- 172.21.15.172:0/1631572265 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d440047e0 con 0x7f7d501446d0 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.144+0000 7f7d56e1b640 1 -- 172.21.15.172:0/1631572265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d500ad950 con 0x7f7d501446d0 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.144+0000 7f7d4d7fa640 1 -- 172.21.15.172:0/1631572265 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44004bd0 con 0x7f7d501446d0 2024-04-25T08:48:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.144+0000 7f7d56e1b640 1 -- 172.21.15.172:0/1631572265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d500adf10 con 0x7f7d501446d0 2024-04-25T08:48:24.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.145+0000 7f7d56e1b640 1 -- 172.21.15.172:0/1631572265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d50073a00 con 0x7f7d501446d0 2024-04-25T08:48:24.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.145+0000 7f7d4d7fa640 1 -- 172.21.15.172:0/1631572265 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d44011070 con 0x7f7d501446d0 2024-04-25T08:48:24.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.146+0000 7f7d4d7fa640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d3c06b4d0 0x7f7d3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.146+0000 7f7d4d7fa640 1 -- 172.21.15.172:0/1631572265 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f7d4408a070 con 0x7f7d501446d0 2024-04-25T08:48:24.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.146+0000 7f7d54bb7640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d3c06b4d0 0x7f7d3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.146+0000 7f7d54bb7640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d3c06b4d0 0x7f7d3c06d990 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7d40006fd0 tx=0x7f7d40008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:24.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.150+0000 7f7d4d7fa640 1 -- 172.21.15.172:0/1631572265 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7d44058d40 con 0x7f7d501446d0 2024-04-25T08:48:24.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.321+0000 7f7d56e1b640 1 -- 172.21.15.172:0/1631572265 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d500ae2b0 con 0x7f7d501446d0 2024-04-25T08:48:24.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.322+0000 7f7d4d7fa640 1 -- 172.21.15.172:0/1631572265 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7d44058640 con 0x7f7d501446d0 2024-04-25T08:48:24.313 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:48:24.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 -- 172.21.15.172:0/1631572265 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d3c06b4d0 msgr2=0x7f7d3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d3c06b4d0 0x7f7d3c06d990 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7d40006fd0 tx=0x7f7d40008040 comp rx=0 tx=0).stop 2024-04-25T08:48:24.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 -- 172.21.15.172:0/1631572265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d501446d0 msgr2=0x7f7d500b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d501446d0 0x7f7d500b1d20 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400c430 tx=0x7f7d4400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 -- 172.21.15.172:0/1631572265 shutdown_connections 2024-04-25T08:48:24.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d3c06b4d0 0x7f7d3c06d990 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d50144d50 0x7f7d500b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d501446d0 0x7f7d500b1d20 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 --2- 172.21.15.172:0/1631572265 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d5006e8a0 0x7f7d50150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 -- 172.21.15.172:0/1631572265 >> 172.21.15.172:0/1631572265 conn(0x7f7d5006abe0 msgr2=0x7f7d500af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:24.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 -- 172.21.15.172:0/1631572265 shutdown_connections 2024-04-25T08:48:24.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.324+0000 7f7d56e1b640 1 -- 172.21.15.172:0/1631572265 wait complete. 2024-04-25T08:48:24.326 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:48:24.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.434+0000 7f3b4db6a640 1 Processor -- start 2024-04-25T08:48:24.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.434+0000 7f3b4db6a640 1 -- start start 2024-04-25T08:48:24.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.435+0000 7f3b4db6a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3b4815dc20 0x7f3b480ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.435+0000 7f3b4db6a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3b48161710 0x7f3b480cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.435+0000 7f3b4db6a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 0x7f3b4806bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.435+0000 7f3b4db6a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4815e000 con 0x7f3b4815dc20 2024-04-25T08:48:24.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.435+0000 7f3b4db6a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b480d1de0 con 0x7f3b48161710 2024-04-25T08:48:24.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.435+0000 7f3b4db6a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b48161c60 con 0x7f3b480b9330 2024-04-25T08:48:24.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.435+0000 7f3b477fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3b4815dc20 0x7f3b480ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.435+0000 7f3b477fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3b4815dc20 0x7f3b480ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54150/0 (socket says 172.21.15.172:54150) 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.435+0000 7f3b477fe640 1 -- 172.21.15.172:0/878004020 learned_addr learned my addr 172.21.15.172:0/878004020 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.436+0000 7f3b47fff640 1 --2- 172.21.15.172:0/878004020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 0x7f3b4806bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.436+0000 7f3b3effd640 1 --2- 172.21.15.172:0/878004020 >> v2:172.21.15.186:3300/0 conn(0x7f3b48161710 0x7f3b480cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.436+0000 7f3b477fe640 1 -- 172.21.15.172:0/878004020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 msgr2=0x7f3b4806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.436+0000 7f3b477fe640 1 --2- 172.21.15.172:0/878004020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 0x7f3b4806bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.436+0000 7f3b477fe640 1 -- 172.21.15.172:0/878004020 >> v2:172.21.15.186:3300/0 conn(0x7f3b48161710 msgr2=0x7f3b480cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.436+0000 7f3b477fe640 1 --2- 172.21.15.172:0/878004020 >> v2:172.21.15.186:3300/0 conn(0x7f3b48161710 0x7f3b480cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.436+0000 7f3b477fe640 1 -- 172.21.15.172:0/878004020 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48161f40 con 0x7f3b4815dc20 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.436+0000 7f3b47fff640 1 --2- 172.21.15.172:0/878004020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 0x7f3b4806bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:24.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.436+0000 7f3b3effd640 1 --2- 172.21.15.172:0/878004020 >> v2:172.21.15.186:3300/0 conn(0x7f3b48161710 0x7f3b480cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:24.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.436+0000 7f3b477fe640 1 --2- 172.21.15.172:0/878004020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 0x7f3b480ce670 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f3b4806da90 tx=0x7f3b3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f008d0cde96ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b46ffd640 1 -- 172.21.15.172:0/878004020 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38037070 con 0x7f3b4815dc20 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b46ffd640 1 -- 172.21.15.172:0/878004020 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b38032440 con 0x7f3b4815dc20 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b46ffd640 1 -- 172.21.15.172:0/878004020 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38032810 con 0x7f3b4815dc20 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b4db6a640 1 -- 172.21.15.172:0/878004020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 msgr2=0x7f3b480ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b4db6a640 1 --2- 172.21.15.172:0/878004020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 0x7f3b480ce670 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f3b4806da90 tx=0x7f3b3802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b4db6a640 1 -- 172.21.15.172:0/878004020 shutdown_connections 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b4db6a640 1 --2- 172.21.15.172:0/878004020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 0x7f3b4806bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b4db6a640 1 --2- 172.21.15.172:0/878004020 >> v2:172.21.15.186:3300/0 conn(0x7f3b48161710 0x7f3b480cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b4db6a640 1 --2- 172.21.15.172:0/878004020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 0x7f3b480ce670 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b4db6a640 1 -- 172.21.15.172:0/878004020 >> 172.21.15.172:0/878004020 conn(0x7f3b480d0420 msgr2=0x7f3b480d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b4db6a640 1 -- 172.21.15.172:0/878004020 shutdown_connections 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.437+0000 7f3b4db6a640 1 -- 172.21.15.172:0/878004020 wait complete. 2024-04-25T08:48:24.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.438+0000 7f3b4db6a640 1 Processor -- start 2024-04-25T08:48:24.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.439+0000 7f3b4db6a640 1 -- start start 2024-04-25T08:48:24.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.439+0000 7f3b4db6a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 0x7f3b480cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.439+0000 7f3b4db6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 0x7f3b4814ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.439+0000 7f3b4db6a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b48161710 0x7f3b48157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.439+0000 7f3b4db6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b480b5e50 con 0x7f3b4815dc20 2024-04-25T08:48:24.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.439+0000 7f3b4db6a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b48162500 con 0x7f3b48161710 2024-04-25T08:48:24.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.439+0000 7f3b4db6a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b480b5fd0 con 0x7f3b480b9330 2024-04-25T08:48:24.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.439+0000 7f3b3effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 0x7f3b4814ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.439+0000 7f3b3effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 0x7f3b4814ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54166/0 (socket says 172.21.15.172:54166) 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.439+0000 7f3b3effd640 1 -- 172.21.15.172:0/1904823289 learned_addr learned my addr 172.21.15.172:0/1904823289 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b47fff640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b48161710 0x7f3b48157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b477fe640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 0x7f3b480cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b3effd640 1 -- 172.21.15.172:0/1904823289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 msgr2=0x7f3b480cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b3effd640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 0x7f3b480cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b3effd640 1 -- 172.21.15.172:0/1904823289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b48161710 msgr2=0x7f3b48157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b3effd640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b48161710 0x7f3b48157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b3effd640 1 -- 172.21.15.172:0/1904823289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48158460 con 0x7f3b4815dc20 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b3effd640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 0x7f3b4814ce40 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000d7d0 tx=0x7f3b3000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b44ff9640 1 -- 172.21.15.172:0/1904823289 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30004030 con 0x7f3b4815dc20 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b44ff9640 1 -- 172.21.15.172:0/1904823289 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b300041d0 con 0x7f3b4815dc20 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b44ff9640 1 -- 172.21.15.172:0/1904823289 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300096a0 con 0x7f3b4815dc20 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b4db6a640 1 -- 172.21.15.172:0/1904823289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b480cc9a0 con 0x7f3b4815dc20 2024-04-25T08:48:24.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.440+0000 7f3b4db6a640 1 -- 172.21.15.172:0/1904823289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b480ccf60 con 0x7f3b4815dc20 2024-04-25T08:48:24.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.441+0000 7f3b4db6a640 1 -- 172.21.15.172:0/1904823289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b48073a00 con 0x7f3b4815dc20 2024-04-25T08:48:24.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.441+0000 7f3b44ff9640 1 -- 172.21.15.172:0/1904823289 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3b30009840 con 0x7f3b4815dc20 2024-04-25T08:48:24.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.442+0000 7f3b44ff9640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b2806b4d0 0x7f3b2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.442+0000 7f3b44ff9640 1 -- 172.21.15.172:0/1904823289 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f3b3008a650 con 0x7f3b4815dc20 2024-04-25T08:48:24.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.442+0000 7f3b477fe640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b2806b4d0 0x7f3b2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.442+0000 7f3b477fe640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b2806b4d0 0x7f3b2806d990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3b38034000 tx=0x7f3b3802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:24.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.446+0000 7f3b44ff9640 1 -- 172.21.15.172:0/1904823289 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b300593b0 con 0x7f3b4815dc20 2024-04-25T08:48:24.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.629+0000 7f3b4db6a640 1 -- 172.21.15.172:0/1904823289 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3b480d3270 con 0x7f3b4815dc20 2024-04-25T08:48:24.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.629+0000 7f3b44ff9640 1 -- 172.21.15.172:0/1904823289 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3b30058cb0 con 0x7f3b4815dc20 2024-04-25T08:48:24.620 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:48:24.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 -- 172.21.15.172:0/1904823289 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b2806b4d0 msgr2=0x7f3b2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b2806b4d0 0x7f3b2806d990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3b38034000 tx=0x7f3b3802e000 comp rx=0 tx=0).stop 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 -- 172.21.15.172:0/1904823289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 msgr2=0x7f3b4814ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 0x7f3b4814ce40 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000d7d0 tx=0x7f3b3000dc90 comp rx=0 tx=0).stop 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 -- 172.21.15.172:0/1904823289 shutdown_connections 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b2806b4d0 0x7f3b2806d990 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b48161710 0x7f3b48157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b4815dc20 0x7f3b4814ce40 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 --2- 172.21.15.172:0/1904823289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b480b9330 0x7f3b480cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 -- 172.21.15.172:0/1904823289 >> 172.21.15.172:0/1904823289 conn(0x7f3b480d0420 msgr2=0x7f3b480b8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 -- 172.21.15.172:0/1904823289 shutdown_connections 2024-04-25T08:48:24.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.631+0000 7f3b4db6a640 1 -- 172.21.15.172:0/1904823289 wait complete. 2024-04-25T08:48:24.633 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:48:24.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:24.634 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:48:24.670 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:48:24.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:24.671 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:48:24.725 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:48:24.726 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:48:24.742 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:48:24.743 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:48:24.743 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:48:24.781 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:48:24.781 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:48:24.781 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:48:24.798 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:48:24.799 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:48:24.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.927+0000 7fcc0f1c4640 1 Processor -- start 2024-04-25T08:48:24.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.927+0000 7fcc0f1c4640 1 -- start start 2024-04-25T08:48:24.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc0f1c4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc08154ee0 0x7fcc080cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc0f1c4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcc080ce590 0x7fcc0806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc0f1c4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc08071480 con 0x7fcc080cfcf0 2024-04-25T08:48:24.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc0f1c4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc08072090 con 0x7fcc080ce590 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc0f1c4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc080d0150 con 0x7fcc08154ee0 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc07fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcc080cfcf0 0x7fcc080cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58968/0 (socket says 172.21.15.172:58968) 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc07fff640 1 -- 172.21.15.172:0/3245206543 learned_addr learned my addr 172.21.15.172:0/3245206543 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc0cf60640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc08154ee0 0x7fcc080cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc0d761640 1 --2- 172.21.15.172:0/3245206543 >> v2:172.21.15.186:3300/0 conn(0x7fcc080ce590 0x7fcc0806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179079776 0 0) 0x7fcc08071480 con 0x7fcc080cfcf0 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf8003520 con 0x7fcc080cfcf0 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 559521562 0 0) 0x7fcbf8003520 con 0x7fcc080cfcf0 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc08154ee0 msgr2=0x7fcc080cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc08154ee0 0x7fcc080cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 >> v2:172.21.15.186:3300/0 conn(0x7fcc080ce590 msgr2=0x7fcc0806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 --2- 172.21.15.172:0/3245206543 >> v2:172.21.15.186:3300/0 conn(0x7fcc080ce590 0x7fcc0806d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08071760 con 0x7fcc080cfcf0 2024-04-25T08:48:24.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fcbf4001670 con 0x7fcc080cfcf0 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 >> v1:172.21.15.172:6789/0 conn(0x7fcc080cfcf0 legacy=0x7fcc080cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 0x7fcbf8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc08154ee0 0x7fcbf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf8004d40 0x7fcbf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf800b9c0 con 0x7fcbf80039b0 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf800bb40 con 0x7fcbf8004d40 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf800bcc0 con 0x7fcc08154ee0 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.928+0000 7fcc0cf60640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 0x7fcbf8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.929+0000 7fcc07fff640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc08154ee0 0x7fcbf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.929+0000 7fcc0d761640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf8004d40 0x7fcbf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.929+0000 7fcc0cf60640 1 -- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc08154ee0 msgr2=0x7fcbf8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.929+0000 7fcc0cf60640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc08154ee0 0x7fcbf8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.929+0000 7fcc0cf60640 1 -- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf8004d40 msgr2=0x7fcbf80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.929+0000 7fcc0cf60640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf8004d40 0x7fcbf80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.929+0000 7fcc0cf60640 1 -- 172.21.15.172:0/3245206543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8003520 con 0x7fcbf80039b0 2024-04-25T08:48:24.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.929+0000 7fcc0d761640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf8004d40 0x7fcbf80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.929+0000 7fcc0cf60640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 0x7fcbf8003dd0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009ac0 tx=0x7fcbf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139d8c894a755205 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.929+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc036070 con 0x7fcbf80039b0 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.930+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc031400 con 0x7fcbf80039b0 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.930+0000 7fcc077fe640 1 -- 172.21.15.172:0/3245206543 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc009690 con 0x7fcbf80039b0 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.930+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/3245206543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 msgr2=0x7fcbf8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.930+0000 7fcc0f1c4640 1 --2- 172.21.15.172:0/3245206543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 0x7fcbf8003dd0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009ac0 tx=0x7fcbf8005830 comp rx=0 tx=0).stop 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.930+0000 7fcc0d761640 1 -- 172.21.15.172:0/3245206543 reap_dead start 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.930+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/3245206543 shutdown_connections 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.930+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/3245206543 >> 172.21.15.172:0/3245206543 conn(0x7fcc0806abe0 msgr2=0x7fcc0806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.930+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/3245206543 shutdown_connections 2024-04-25T08:48:24.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.930+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/3245206543 wait complete. 2024-04-25T08:48:24.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.931+0000 7fcc0f1c4640 1 Processor -- start 2024-04-25T08:48:24.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.931+0000 7fcc0f1c4640 1 -- start start 2024-04-25T08:48:24.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc0f1c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 0x7fcc081525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc0f1c4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc081f3110 0x7fcc081f1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc0f1c4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc081f3590 0x7fcc080ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc0f1c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08071d20 con 0x7fcbf80039b0 2024-04-25T08:48:24.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc0f1c4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08071230 con 0x7fcc081f3110 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc0f1c4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc081552c0 con 0x7fcc081f3590 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc0cf60640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 0x7fcc081525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc0cf60640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 0x7fcc081525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54176/0 (socket says 172.21.15.172:54176) 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc0cf60640 1 -- 172.21.15.172:0/528557984 learned_addr learned my addr 172.21.15.172:0/528557984 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc0d761640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc081f3590 0x7fcc080ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.932+0000 7fcc07fff640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc081f3110 0x7fcc081f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc0cf60640 1 -- 172.21.15.172:0/528557984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc081f3590 msgr2=0x7fcc080ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc0cf60640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc081f3590 0x7fcc080ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc0cf60640 1 -- 172.21.15.172:0/528557984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc081f3110 msgr2=0x7fcc081f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc0cf60640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc081f3110 0x7fcc081f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc0cf60640 1 -- 172.21.15.172:0/528557984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08152b30 con 0x7fcbf80039b0 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc0cf60640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 0x7fcc081525f0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc034040 tx=0x7fcbfc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc057fa640 1 -- 172.21.15.172:0/528557984 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc046070 con 0x7fcbf80039b0 2024-04-25T08:48:24.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc057fa640 1 -- 172.21.15.172:0/528557984 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc003810 con 0x7fcbf80039b0 2024-04-25T08:48:24.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc057fa640 1 -- 172.21.15.172:0/528557984 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc003c00 con 0x7fcbf80039b0 2024-04-25T08:48:24.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/528557984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc081f2070 con 0x7fcbf80039b0 2024-04-25T08:48:24.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.933+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/528557984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc081f2630 con 0x7fcbf80039b0 2024-04-25T08:48:24.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.934+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/528557984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc08073990 con 0x7fcbf80039b0 2024-04-25T08:48:24.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.934+0000 7fcc057fa640 1 -- 172.21.15.172:0/528557984 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcbfc049070 con 0x7fcbf80039b0 2024-04-25T08:48:24.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.935+0000 7fcc057fa640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbec06b4d0 0x7fcbec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:24.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.935+0000 7fcc057fa640 1 -- 172.21.15.172:0/528557984 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fcbfc0abe90 con 0x7fcbf80039b0 2024-04-25T08:48:24.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.935+0000 7fcc07fff640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbec06b4d0 0x7fcbec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:24.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.935+0000 7fcc07fff640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbec06b4d0 0x7fcbec06d990 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4007fd0 tx=0x7fcbf4007970 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:24.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:24.939+0000 7fcc057fa640 1 -- 172.21.15.172:0/528557984 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcbfc03e070 con 0x7fcbf80039b0 2024-04-25T08:48:25.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.140+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/528557984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc0806db20 con 0x7fcbf80039b0 2024-04-25T08:48:25.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.141+0000 7fcc057fa640 1 -- 172.21.15.172:0/528557984 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4952 (secure 0 0 0) 0x7fcbfc07a510 con 0x7fcbf80039b0 2024-04-25T08:48:25.132 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:25.133 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":50,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1549593613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1549593613},{"type":"v1","addr":"172.21.15.186:6833","nonce":1549593613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2002207643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2002207643},{"type":"v1","addr":"172.21.15.186:6835","nonce":2002207643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2584048606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2584048606},{"type":"v1","addr":"172.21.15.172:6836","nonce":2584048606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:46:57.048324+0000","modified":"2024-04-25T08:47:08.087103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6837/1878763904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1878763904},{"type":"v1","addr":"172.21.15.172:6837","nonce":1878763904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:48:25.133 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 50 2024-04-25T08:48:25.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/528557984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbec06b4d0 msgr2=0x7fcbec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbec06b4d0 0x7fcbec06d990 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4007fd0 tx=0x7fcbf4007970 comp rx=0 tx=0).stop 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/528557984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 msgr2=0x7fcc081525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 0x7fcc081525f0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc034040 tx=0x7fcbfc004730 comp rx=0 tx=0).stop 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/528557984 shutdown_connections 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbec06b4d0 0x7fcbec06d990 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc081f3110 0x7fcc081f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc081f3590 0x7fcc080ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 --2- 172.21.15.172:0/528557984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbf80039b0 0x7fcc081525f0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/528557984 >> 172.21.15.172:0/528557984 conn(0x7fcc0806abe0 msgr2=0x7fcc0815d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/528557984 shutdown_connections 2024-04-25T08:48:25.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.143+0000 7fcc0f1c4640 1 -- 172.21.15.172:0/528557984 wait complete. 2024-04-25T08:48:25.145 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:48:25.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.251+0000 7ff9c9bbd640 1 Processor -- start 2024-04-25T08:48:25.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.252+0000 7ff9c9bbd640 1 -- start start 2024-04-25T08:48:25.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.252+0000 7ff9c9bbd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9c4164970 0x7ff9c4166d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.252+0000 7ff9c9bbd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c4144b30 con 0x7ff9c4144750 2024-04-25T08:48:25.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.252+0000 7ff9c9bbd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c40712d0 con 0x7ff9c40ce920 2024-04-25T08:48:25.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.252+0000 7ff9c9bbd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40715b0 con 0x7ff9c4164970 2024-04-25T08:48:25.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.252+0000 7ff9c37fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff9c4144750 0x7ff9c406e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58978/0 (socket says 172.21.15.172:58978) 2024-04-25T08:48:25.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.252+0000 7ff9c37fe640 1 -- 172.21.15.172:0/427693796 learned_addr learned my addr 172.21.15.172:0/427693796 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:25.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c3fff640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9c4164970 0x7ff9c4166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880242521 0 0) 0x7ff9c4144b30 con 0x7ff9c4144750 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b0003520 con 0x7ff9c4144750 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2842135601 0 0) 0x7ff9b0003520 con 0x7ff9c4144750 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9c4164970 msgr2=0x7ff9c4166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9c4164970 0x7ff9c4166d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 >> v1:172.21.15.186:6789/0 conn(0x7ff9c40ce920 legacy=0x7ff9c40cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4071890 con 0x7ff9c4144750 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7ff9b4001670 con 0x7ff9c4144750 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 >> v1:172.21.15.172:6789/0 conn(0x7ff9c4144750 legacy=0x7ff9c406e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b00039e0 0x7ff9b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9b0004390 0x7ff9b0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9b00050b0 0x7ff9b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40715b0 con 0x7ff9b00050b0 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b000bfe0 con 0x7ff9b00039e0 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b000c1e0 con 0x7ff9b0004390 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c3fff640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9c4164970 0x7ff9c4166d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c37fe640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b00039e0 0x7ff9b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9bbfff640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9b0004390 0x7ff9b0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c3fff640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9b00050b0 0x7ff9b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c3fff640 1 -- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9b0004390 msgr2=0x7ff9b0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c3fff640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9b0004390 0x7ff9b0004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c3fff640 1 -- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b00039e0 msgr2=0x7ff9b0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c3fff640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b00039e0 0x7ff9b0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.253+0000 7ff9c3fff640 1 -- 172.21.15.172:0/427693796 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0003520 con 0x7ff9b00050b0 2024-04-25T08:48:25.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.254+0000 7ff9c3fff640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9b00050b0 0x7ff9b000b9c0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40cd590 tx=0x7ff9b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c61c5b21c9cba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.254+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc036070 con 0x7ff9b00050b0 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.254+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc003c50 con 0x7ff9b00050b0 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.254+0000 7ff9c2ffd640 1 -- 172.21.15.172:0/427693796 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc009d40 con 0x7ff9b00050b0 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.255+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/427693796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9b00050b0 msgr2=0x7ff9b000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.255+0000 7ff9c9bbd640 1 --2- 172.21.15.172:0/427693796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9b00050b0 0x7ff9b000b9c0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40cd590 tx=0x7ff9b0005830 comp rx=0 tx=0).stop 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.255+0000 7ff9c3fff640 1 -- 172.21.15.172:0/427693796 reap_dead start 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.255+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/427693796 shutdown_connections 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.255+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/427693796 >> 172.21.15.172:0/427693796 conn(0x7ff9c406abe0 msgr2=0x7ff9c406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.255+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/427693796 shutdown_connections 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.255+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/427693796 wait complete. 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.256+0000 7ff9c9bbd640 1 Processor -- start 2024-04-25T08:48:25.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.256+0000 7ff9c9bbd640 1 -- start start 2024-04-25T08:48:25.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9c9bbd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b00050b0 0x7ff9c40b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9c9bbd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9c415b240 0x7ff9c413fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9c9bbd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9c41403c0 0x7ff9c40af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9c9bbd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4145450 con 0x7ff9c415b240 2024-04-25T08:48:25.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9c9bbd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c406f020 con 0x7ff9b00050b0 2024-04-25T08:48:25.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9c9bbd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c41455d0 con 0x7ff9c41403c0 2024-04-25T08:48:25.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9bbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9c415b240 0x7ff9c413fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9bbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9c415b240 0x7ff9c413fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54186/0 (socket says 172.21.15.172:54186) 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9bbfff640 1 -- 172.21.15.172:0/2085944489 learned_addr learned my addr 172.21.15.172:0/2085944489 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9c3fff640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9c41403c0 0x7ff9c40af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9c37fe640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b00050b0 0x7ff9c40b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9bbfff640 1 -- 172.21.15.172:0/2085944489 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9c41403c0 msgr2=0x7ff9c40af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9bbfff640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9c41403c0 0x7ff9c40af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9bbfff640 1 -- 172.21.15.172:0/2085944489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b00050b0 msgr2=0x7ff9c40b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9bbfff640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b00050b0 0x7ff9c40b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9bbfff640 1 -- 172.21.15.172:0/2085944489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c40b0180 con 0x7ff9c415b240 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9bbfff640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9c415b240 0x7ff9c413fe80 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00f8b0 tx=0x7ff9ac00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:25.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9c0ff9640 1 -- 172.21.15.172:0/2085944489 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0052e0 con 0x7ff9c415b240 2024-04-25T08:48:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.257+0000 7ff9c0ff9640 1 -- 172.21.15.172:0/2085944489 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac018070 con 0x7ff9c415b240 2024-04-25T08:48:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.258+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/2085944489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c40b0980 con 0x7ff9c415b240 2024-04-25T08:48:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.258+0000 7ff9c0ff9640 1 -- 172.21.15.172:0/2085944489 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00d910 con 0x7ff9c415b240 2024-04-25T08:48:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.258+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/2085944489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c40b0f40 con 0x7ff9c415b240 2024-04-25T08:48:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.259+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/2085944489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c41407d0 con 0x7ff9c415b240 2024-04-25T08:48:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.259+0000 7ff9c0ff9640 1 -- 172.21.15.172:0/2085944489 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9ac00dab0 con 0x7ff9c415b240 2024-04-25T08:48:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.259+0000 7ff9c0ff9640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9a406b500 0x7ff9a406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.260+0000 7ff9c0ff9640 1 -- 172.21.15.172:0/2085944489 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7ff9ac08a190 con 0x7ff9c415b240 2024-04-25T08:48:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.260+0000 7ff9c37fe640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9a406b500 0x7ff9a406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.260+0000 7ff9c37fe640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9a406b500 0x7ff9a406d9c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4001eb0 tx=0x7ff9b4000fe0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:25.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.263+0000 7ff9c0ff9640 1 -- 172.21.15.172:0/2085944489 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9c41407d0 con 0x7ff9c415b240 2024-04-25T08:48:25.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.434+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/2085944489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9c40b1110 con 0x7ff9c415b240 2024-04-25T08:48:25.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.436+0000 7ff9c0ff9640 1 -- 172.21.15.172:0/2085944489 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17071 (secure 0 0 0) 0x7ff9ac058ef0 con 0x7ff9c415b240 2024-04-25T08:48:25.427 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:25.427 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":83,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:04.271283+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:55.259890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:56.021748+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":82,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.437+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/2085944489 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9a406b500 msgr2=0x7ff9a406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.437+0000 7ff9c9bbd640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9a406b500 0x7ff9a406d9c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4001eb0 tx=0x7ff9b4000fe0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.437+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/2085944489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9c415b240 msgr2=0x7ff9c413fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.437+0000 7ff9c9bbd640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9c415b240 0x7ff9c413fe80 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00f8b0 tx=0x7ff9ac00fcb0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.437+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/2085944489 shutdown_connections 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.437+0000 7ff9c9bbd640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9a406b500 0x7ff9a406d9c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.437+0000 7ff9c9bbd640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9c41403c0 0x7ff9c40af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.437+0000 7ff9c9bbd640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9c415b240 0x7ff9c413fe80 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.437+0000 7ff9c9bbd640 1 --2- 172.21.15.172:0/2085944489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b00050b0 0x7ff9c40b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.438+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/2085944489 >> 172.21.15.172:0/2085944489 conn(0x7ff9c406abe0 msgr2=0x7ff9c40ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.438+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/2085944489 shutdown_connections 2024-04-25T08:48:25.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.438+0000 7ff9c9bbd640 1 -- 172.21.15.172:0/2085944489 wait complete. 2024-04-25T08:48:25.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:46:55.259890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:46:56.021748+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 82, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:48:25.441 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:48:25.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.551+0000 7f52c6a9e640 1 Processor -- start 2024-04-25T08:48:25.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.551+0000 7f52c6a9e640 1 -- start start 2024-04-25T08:48:25.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.551+0000 7f52c6a9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f52c0161710 0x7f52c00d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.551+0000 7f52c6a9e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c015e000 con 0x7f52c015dc20 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.551+0000 7f52c6a9e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00d1de0 con 0x7f52c00ced80 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.551+0000 7f52c6a9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c0161c60 con 0x7f52c0161710 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.552+0000 7f52c503b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f52c0161710 0x7f52c00d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.552+0000 7f52c483a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f52c015dc20 0x7f52c00ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:58992/0 (socket says 172.21.15.172:58992) 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.552+0000 7f52c483a640 1 -- 172.21.15.172:0/203985953 learned_addr learned my addr 172.21.15.172:0/203985953 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.552+0000 7f52c503b640 1 --2- 172.21.15.172:0/203985953 >> v2:172.21.15.172:3300/0 conn(0x7f52c0161710 0x7f52c00d29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54190/0 (socket says 172.21.15.172:54190) 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.552+0000 7f52c503b640 1 -- 172.21.15.172:0/203985953 >> v1:172.21.15.186:6789/0 conn(0x7f52c00ced80 legacy=0x7f52c00d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.552+0000 7f52c503b640 1 -- 172.21.15.172:0/203985953 >> v1:172.21.15.172:6789/0 conn(0x7f52c015dc20 legacy=0x7f52c00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.552+0000 7f52c503b640 1 -- 172.21.15.172:0/203985953 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0161f40 con 0x7f52c0161710 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.552+0000 7f52bf7fe640 1 -- 172.21.15.172:0/203985953 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420699105 0 0) 0x7f52c015e000 con 0x7f52c015dc20 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52c503b640 1 --2- 172.21.15.172:0/203985953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 0x7f52c00d29f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f52b00097a0 tx=0x7f52b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6c7b46b872706a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52bf7fe640 1 -- 172.21.15.172:0/203985953 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0037070 con 0x7f52c0161710 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52bf7fe640 1 -- 172.21.15.172:0/203985953 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0032440 con 0x7f52c0161710 2024-04-25T08:48:25.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52bf7fe640 1 -- 172.21.15.172:0/203985953 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0032810 con 0x7f52c0161710 2024-04-25T08:48:25.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52c6a9e640 1 -- 172.21.15.172:0/203985953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 msgr2=0x7f52c00d29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52c6a9e640 1 --2- 172.21.15.172:0/203985953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 0x7f52c00d29f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f52b00097a0 tx=0x7f52b002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52c6a9e640 1 -- 172.21.15.172:0/203985953 shutdown_connections 2024-04-25T08:48:25.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52c6a9e640 1 --2- 172.21.15.172:0/203985953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 0x7f52c00d29f0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52c6a9e640 1 -- 172.21.15.172:0/203985953 >> 172.21.15.172:0/203985953 conn(0x7f52c00d0420 msgr2=0x7f52c00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:25.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52c6a9e640 1 -- 172.21.15.172:0/203985953 shutdown_connections 2024-04-25T08:48:25.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.553+0000 7f52c6a9e640 1 -- 172.21.15.172:0/203985953 wait complete. 2024-04-25T08:48:25.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.554+0000 7f52c6a9e640 1 Processor -- start 2024-04-25T08:48:25.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.554+0000 7f52c6a9e640 1 -- start start 2024-04-25T08:48:25.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.555+0000 7f52c6a9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52c00ced80 0x7f52c015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.555+0000 7f52c6a9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52c015dc20 0x7f52c0157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.555+0000 7f52c6a9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 0x7f52c01582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.555+0000 7f52c6a9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00b5e50 con 0x7f52c0161710 2024-04-25T08:48:25.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.555+0000 7f52c6a9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0162500 con 0x7f52c00ced80 2024-04-25T08:48:25.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.555+0000 7f52c6a9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00b5fd0 con 0x7f52c015dc20 2024-04-25T08:48:25.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.555+0000 7f52c503b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 0x7f52c01582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.555+0000 7f52c503b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 0x7f52c01582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54194/0 (socket says 172.21.15.172:54194) 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.555+0000 7f52c503b640 1 -- 172.21.15.172:0/490947546 learned_addr learned my addr 172.21.15.172:0/490947546 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52bffff640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52c015dc20 0x7f52c0157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52c483a640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52c00ced80 0x7f52c015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52c503b640 1 -- 172.21.15.172:0/490947546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52c015dc20 msgr2=0x7f52c0157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52c503b640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52c015dc20 0x7f52c0157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52c503b640 1 -- 172.21.15.172:0/490947546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52c00ced80 msgr2=0x7f52c015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52c503b640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52c00ced80 0x7f52c015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52c503b640 1 -- 172.21.15.172:0/490947546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c015f400 con 0x7f52c0161710 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52c503b640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 0x7f52c01582e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f52b00097a0 tx=0x7f52b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52bd7fa640 1 -- 172.21.15.172:0/490947546 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0041070 con 0x7f52c0161710 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52bd7fa640 1 -- 172.21.15.172:0/490947546 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b003c870 con 0x7f52c0161710 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52c6a9e640 1 -- 172.21.15.172:0/490947546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c015f6e0 con 0x7f52c0161710 2024-04-25T08:48:25.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52bd7fa640 1 -- 172.21.15.172:0/490947546 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0037040 con 0x7f52c0161710 2024-04-25T08:48:25.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.556+0000 7f52c6a9e640 1 -- 172.21.15.172:0/490947546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c015fca0 con 0x7f52c0161710 2024-04-25T08:48:25.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.557+0000 7f52c6a9e640 1 -- 172.21.15.172:0/490947546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c0073a00 con 0x7f52c0161710 2024-04-25T08:48:25.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.558+0000 7f52bd7fa640 1 -- 172.21.15.172:0/490947546 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52b0044070 con 0x7f52c0161710 2024-04-25T08:48:25.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.558+0000 7f52bd7fa640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52a006b4d0 0x7f52a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.558+0000 7f52bd7fa640 1 -- 172.21.15.172:0/490947546 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f52b00aacd0 con 0x7f52c0161710 2024-04-25T08:48:25.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.558+0000 7f52c483a640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52a006b4d0 0x7f52a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.558+0000 7f52c483a640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52a006b4d0 0x7f52a006d990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f52b80012e0 tx=0x7f52b8001700 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:25.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.562+0000 7f52bd7fa640 1 -- 172.21.15.172:0/490947546 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52b00793e0 con 0x7f52c0161710 2024-04-25T08:48:25.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.733+0000 7f52c6a9e640 1 -- 172.21.15.172:0/490947546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52c00d16b0 con 0x7f52c0161710 2024-04-25T08:48:25.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.734+0000 7f52bd7fa640 1 -- 172.21.15.172:0/490947546 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52b007d480 con 0x7f52c0161710 2024-04-25T08:48:25.725 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:48:25.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 -- 172.21.15.172:0/490947546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52a006b4d0 msgr2=0x7f52a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52a006b4d0 0x7f52a006d990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f52b80012e0 tx=0x7f52b8001700 comp rx=0 tx=0).stop 2024-04-25T08:48:25.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 -- 172.21.15.172:0/490947546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 msgr2=0x7f52c01582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 0x7f52c01582e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f52b00097a0 tx=0x7f52b00046c0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 -- 172.21.15.172:0/490947546 shutdown_connections 2024-04-25T08:48:25.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f52a006b4d0 0x7f52a006d990 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c0161710 0x7f52c01582e0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52c015dc20 0x7f52c0157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 --2- 172.21.15.172:0/490947546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52c00ced80 0x7f52c015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 -- 172.21.15.172:0/490947546 >> 172.21.15.172:0/490947546 conn(0x7f52c00d0420 msgr2=0x7f52c00d3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:25.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 -- 172.21.15.172:0/490947546 shutdown_connections 2024-04-25T08:48:25.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.736+0000 7f52c6a9e640 1 -- 172.21.15.172:0/490947546 wait complete. 2024-04-25T08:48:25.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:48:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.847+0000 7f30bd4e1640 1 Processor -- start 2024-04-25T08:48:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.847+0000 7f30bd4e1640 1 -- start start 2024-04-25T08:48:25.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30bd4e1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f30b80b5620 0x7f30b80b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30bd4e1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b806cf50 con 0x7f30b806c2d0 2024-04-25T08:48:25.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30bd4e1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b80ce530 con 0x7f30b815b7d0 2024-04-25T08:48:25.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30bd4e1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b80ce810 con 0x7f30b80b5620 2024-04-25T08:48:25.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30b77fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f30b806c2d0 0x7f30b806c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59008/0 (socket says 172.21.15.172:59008) 2024-04-25T08:48:25.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30b77fe640 1 -- 172.21.15.172:0/954280740 learned_addr learned my addr 172.21.15.172:0/954280740 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:25.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30b67fc640 1 --2- 172.21.15.172:0/954280740 >> v2:172.21.15.186:3300/0 conn(0x7f30b80b5620 0x7f30b80b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142437101 0 0) 0x7f30b806cf50 con 0x7f30b806c2d0 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30a0003520 con 0x7f30b806c2d0 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3848928583 0 0) 0x7f30a0003520 con 0x7f30b806c2d0 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 >> v2:172.21.15.186:3300/0 conn(0x7f30b80b5620 msgr2=0x7f30b80b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30b5ffb640 1 --2- 172.21.15.172:0/954280740 >> v2:172.21.15.186:3300/0 conn(0x7f30b80b5620 0x7f30b80b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.848+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 >> v1:172.21.15.186:6789/0 conn(0x7f30b815b7d0 legacy=0x7f30b80cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b80ceaf0 con 0x7f30b806c2d0 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f30b00019f0 con 0x7f30b806c2d0 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 >> v1:172.21.15.172:6789/0 conn(0x7f30b806c2d0 legacy=0x7f30b806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b5ffb640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30a00039b0 0x7f30a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b5ffb640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a00043b0 0x7f30a0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b5ffb640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b80ce810 con 0x7f30a0005080 2024-04-25T08:48:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a000bfe0 con 0x7f30a00039b0 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a000c1e0 con 0x7f30a00043b0 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b77fe640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b6ffd640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30a00039b0 0x7f30a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b67fc640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a00043b0 0x7f30a0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b77fe640 1 -- 172.21.15.172:0/954280740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a00043b0 msgr2=0x7f30a0004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b77fe640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a00043b0 0x7f30a0004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b77fe640 1 -- 172.21.15.172:0/954280740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30a00039b0 msgr2=0x7f30a0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b77fe640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30a00039b0 0x7f30a0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.849+0000 7f30b77fe640 1 -- 172.21.15.172:0/954280740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0003520 con 0x7f30a0005080 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30b77fe640 1 -- 172.21.15.172:0/954280740 reap_dead start 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30b77fe640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30a000b9c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f30b000a860 tx=0x7f30a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bf8382ddaa7411 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b000a480 con 0x7f30a0005080 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b002f070 con 0x7f30a0005080 2024-04-25T08:48:25.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30b5ffb640 1 -- 172.21.15.172:0/954280740 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b002bc70 con 0x7f30a0005080 2024-04-25T08:48:25.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30bd4e1640 1 -- 172.21.15.172:0/954280740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 msgr2=0x7f30a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30bd4e1640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30a000b9c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f30b000a860 tx=0x7f30a0005830 comp rx=0 tx=0).stop 2024-04-25T08:48:25.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30bd4e1640 1 -- 172.21.15.172:0/954280740 shutdown_connections 2024-04-25T08:48:25.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30bd4e1640 1 --2- 172.21.15.172:0/954280740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30a000b9c0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30bd4e1640 1 -- 172.21.15.172:0/954280740 >> 172.21.15.172:0/954280740 conn(0x7f30b80d0800 msgr2=0x7f30b80d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:25.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30bd4e1640 1 -- 172.21.15.172:0/954280740 shutdown_connections 2024-04-25T08:48:25.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.850+0000 7f30bd4e1640 1 -- 172.21.15.172:0/954280740 wait complete. 2024-04-25T08:48:25.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.852+0000 7f30bd4e1640 1 Processor -- start 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.852+0000 7f30bd4e1640 1 -- start start 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.852+0000 7f30bd4e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30b80c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.852+0000 7f30bd4e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30b81514e0 0x7f30b81f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30bd4e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30b80cc450 0x7f30b80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30bd4e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b815bd30 con 0x7f30a0005080 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30bd4e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b815bbb0 con 0x7f30b80cc450 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30bd4e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b80b5ab0 con 0x7f30b81514e0 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30b80c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30b80c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54210/0 (socket says 172.21.15.172:54210) 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b6ffd640 1 -- 172.21.15.172:0/3127083042 learned_addr learned my addr 172.21.15.172:0/3127083042 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b77fe640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30b80cc450 0x7f30b80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b67fc640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30b81514e0 0x7f30b81f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b6ffd640 1 -- 172.21.15.172:0/3127083042 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30b81514e0 msgr2=0x7f30b81f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b6ffd640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30b81514e0 0x7f30b81f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b6ffd640 1 -- 172.21.15.172:0/3127083042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30b80cc450 msgr2=0x7f30b80cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b6ffd640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30b80cc450 0x7f30b80cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b6ffd640 1 -- 172.21.15.172:0/3127083042 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b80cd1b0 con 0x7f30a0005080 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30b6ffd640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30b80c9f40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f30a800f7f0 tx=0x7f30a800fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f309f7fe640 1 -- 172.21.15.172:0/3127083042 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a80050d0 con 0x7f30a0005080 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f309f7fe640 1 -- 172.21.15.172:0/3127083042 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a8018070 con 0x7f30a0005080 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30bd4e1640 1 -- 172.21.15.172:0/3127083042 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b80cd490 con 0x7f30a0005080 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f309f7fe640 1 -- 172.21.15.172:0/3127083042 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a800d730 con 0x7f30a0005080 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.853+0000 7f30bd4e1640 1 -- 172.21.15.172:0/3127083042 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b8151c50 con 0x7f30a0005080 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.854+0000 7f30bd4e1640 1 -- 172.21.15.172:0/3127083042 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b8073a00 con 0x7f30a0005080 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.855+0000 7f309f7fe640 1 -- 172.21.15.172:0/3127083042 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f30a800d8d0 con 0x7f30a0005080 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.855+0000 7f309f7fe640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30a406b4d0 0x7f30a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.855+0000 7f309f7fe640 1 -- 172.21.15.172:0/3127083042 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f30a808a160 con 0x7f30a0005080 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.855+0000 7f30b67fc640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30a406b4d0 0x7f30a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:25.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.855+0000 7f30b67fc640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30a406b4d0 0x7f30a406d990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f30b80b3580 tx=0x7f30ac009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:25.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:25.859+0000 7f309f7fe640 1 -- 172.21.15.172:0/3127083042 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30a8058e30 con 0x7f30a0005080 2024-04-25T08:48:26.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.027+0000 7f30bd4e1640 1 -- 172.21.15.172:0/3127083042 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30b8160ae0 con 0x7f30a0005080 2024-04-25T08:48:26.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.027+0000 7f309f7fe640 1 -- 172.21.15.172:0/3127083042 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30a8058730 con 0x7f30a0005080 2024-04-25T08:48:26.019 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:48:26.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 -- 172.21.15.172:0/3127083042 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30a406b4d0 msgr2=0x7f30a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30a406b4d0 0x7f30a406d990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f30b80b3580 tx=0x7f30ac009190 comp rx=0 tx=0).stop 2024-04-25T08:48:26.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 -- 172.21.15.172:0/3127083042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 msgr2=0x7f30b80c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30b80c9f40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f30a800f7f0 tx=0x7f30a800fbf0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 -- 172.21.15.172:0/3127083042 shutdown_connections 2024-04-25T08:48:26.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f30a406b4d0 0x7f30a406d990 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30b80cc450 0x7f30b80cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30b81514e0 0x7f30b81f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 --2- 172.21.15.172:0/3127083042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0005080 0x7f30b80c9f40 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 -- 172.21.15.172:0/3127083042 >> 172.21.15.172:0/3127083042 conn(0x7f30b80d0800 msgr2=0x7f30b80b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:26.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 -- 172.21.15.172:0/3127083042 shutdown_connections 2024-04-25T08:48:26.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.029+0000 7f30bd4e1640 1 -- 172.21.15.172:0/3127083042 wait complete. 2024-04-25T08:48:26.031 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:48:26.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.140+0000 7fb88b84c640 1 Processor -- start 2024-04-25T08:48:26.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.140+0000 7fb88b84c640 1 -- start start 2024-04-25T08:48:26.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb88b84c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8840cc4f0 0x7fb8840cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb88b84c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8840cdb20 0x7fb8840cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb88b84c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb88415b270 0x7fb88415b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb88b84c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8840ce4c0 con 0x7fb8840cdb20 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb88b84c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb884071270 con 0x7fb88415b270 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb88b84c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb884072280 con 0x7fb8840cc4f0 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb888de7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8840cdb20 0x7fb8840cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb888de7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8840cdb20 0x7fb8840cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54224/0 (socket says 172.21.15.172:54224) 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb888de7640 1 -- 172.21.15.172:0/3043453713 learned_addr learned my addr 172.21.15.172:0/3043453713 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb889de9640 1 --2- 172.21.15.172:0/3043453713 >> v2:172.21.15.186:3300/0 conn(0x7fb88415b270 0x7fb88415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb8895e8640 1 --2- 172.21.15.172:0/3043453713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8840cc4f0 0x7fb8840cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb888de7640 1 -- 172.21.15.172:0/3043453713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8840cc4f0 msgr2=0x7fb8840cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb888de7640 1 --2- 172.21.15.172:0/3043453713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8840cc4f0 0x7fb8840cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb888de7640 1 -- 172.21.15.172:0/3043453713 >> v2:172.21.15.186:3300/0 conn(0x7fb88415b270 msgr2=0x7fb88415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb888de7640 1 --2- 172.21.15.172:0/3043453713 >> v2:172.21.15.186:3300/0 conn(0x7fb88415b270 0x7fb88415b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb888de7640 1 -- 172.21.15.172:0/3043453713 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8840714c0 con 0x7fb8840cdb20 2024-04-25T08:48:26.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.141+0000 7fb8895e8640 1 --2- 172.21.15.172:0/3043453713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8840cc4f0 0x7fb8840cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.142+0000 7fb888de7640 1 --2- 172.21.15.172:0/3043453713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 0x7fb8840cdf80 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb884158aa0 tx=0x7fb87402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc5555cc9bd0bf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.142+0000 7fb87bfff640 1 -- 172.21.15.172:0/3043453713 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874037070 con 0x7fb8840cdb20 2024-04-25T08:48:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.142+0000 7fb87bfff640 1 -- 172.21.15.172:0/3043453713 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874032440 con 0x7fb8840cdb20 2024-04-25T08:48:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.142+0000 7fb87bfff640 1 -- 172.21.15.172:0/3043453713 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874032810 con 0x7fb8840cdb20 2024-04-25T08:48:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.143+0000 7fb88b84c640 1 -- 172.21.15.172:0/3043453713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 msgr2=0x7fb8840cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.143+0000 7fb88b84c640 1 --2- 172.21.15.172:0/3043453713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 0x7fb8840cdf80 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb884158aa0 tx=0x7fb87402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.143+0000 7fb88b84c640 1 -- 172.21.15.172:0/3043453713 shutdown_connections 2024-04-25T08:48:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.143+0000 7fb88b84c640 1 --2- 172.21.15.172:0/3043453713 >> v2:172.21.15.186:3300/0 conn(0x7fb88415b270 0x7fb88415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.143+0000 7fb88b84c640 1 --2- 172.21.15.172:0/3043453713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 0x7fb8840cdf80 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.143+0000 7fb88b84c640 1 --2- 172.21.15.172:0/3043453713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8840cc4f0 0x7fb8840cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.143+0000 7fb88b84c640 1 -- 172.21.15.172:0/3043453713 >> 172.21.15.172:0/3043453713 conn(0x7fb88406abe0 msgr2=0x7fb88406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.143+0000 7fb88b84c640 1 -- 172.21.15.172:0/3043453713 shutdown_connections 2024-04-25T08:48:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.143+0000 7fb88b84c640 1 -- 172.21.15.172:0/3043453713 wait complete. 2024-04-25T08:48:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.144+0000 7fb88b84c640 1 Processor -- start 2024-04-25T08:48:26.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.144+0000 7fb88b84c640 1 -- start start 2024-04-25T08:48:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb88b84c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8840cc4f0 0x7fb884152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb88b84c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 0x7fb8840cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb88b84c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb88415b270 0x7fb884159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb88b84c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb884071d60 con 0x7fb8840cdb20 2024-04-25T08:48:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb88b84c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb884071a80 con 0x7fb8840cc4f0 2024-04-25T08:48:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb88b84c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88415bbc0 con 0x7fb88415b270 2024-04-25T08:48:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb888de7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 0x7fb8840cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb888de7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 0x7fb8840cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54234/0 (socket says 172.21.15.172:54234) 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb888de7640 1 -- 172.21.15.172:0/2427127300 learned_addr learned my addr 172.21.15.172:0/2427127300 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb8895e8640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8840cc4f0 0x7fb884152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb889de9640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb88415b270 0x7fb884159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb888de7640 1 -- 172.21.15.172:0/2427127300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb88415b270 msgr2=0x7fb884159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb888de7640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb88415b270 0x7fb884159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb888de7640 1 -- 172.21.15.172:0/2427127300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8840cc4f0 msgr2=0x7fb884152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb888de7640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8840cc4f0 0x7fb884152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb888de7640 1 -- 172.21.15.172:0/2427127300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884153810 con 0x7fb8840cdb20 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb888de7640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 0x7fb8840cba30 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fb87402a220 tx=0x7fb8740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb879ffb640 1 -- 172.21.15.172:0/2427127300 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874037040 con 0x7fb8840cdb20 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb879ffb640 1 -- 172.21.15.172:0/2427127300 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874042070 con 0x7fb8840cdb20 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb88b84c640 1 -- 172.21.15.172:0/2427127300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8840cbfd0 con 0x7fb8840cdb20 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb879ffb640 1 -- 172.21.15.172:0/2427127300 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874030880 con 0x7fb8840cdb20 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.145+0000 7fb88b84c640 1 -- 172.21.15.172:0/2427127300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb884153530 con 0x7fb8840cdb20 2024-04-25T08:48:26.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.146+0000 7fb88b84c640 1 -- 172.21.15.172:0/2427127300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb884073a00 con 0x7fb8840cdb20 2024-04-25T08:48:26.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.147+0000 7fb879ffb640 1 -- 172.21.15.172:0/2427127300 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb874030a20 con 0x7fb8840cdb20 2024-04-25T08:48:26.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.147+0000 7fb879ffb640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb86806b4d0 0x7fb86806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.147+0000 7fb879ffb640 1 -- 172.21.15.172:0/2427127300 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fb8740aabe0 con 0x7fb8840cdb20 2024-04-25T08:48:26.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.147+0000 7fb8895e8640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb86806b4d0 0x7fb86806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.148+0000 7fb8895e8640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb86806b4d0 0x7fb86806d990 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb880006fd0 tx=0x7fb880008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:26.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.151+0000 7fb879ffb640 1 -- 172.21.15.172:0/2427127300 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb874079940 con 0x7fb8840cdb20 2024-04-25T08:48:26.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.322+0000 7fb88b84c640 1 -- 172.21.15.172:0/2427127300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb88406d3a0 con 0x7fb8840cdb20 2024-04-25T08:48:26.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.323+0000 7fb879ffb640 1 -- 172.21.15.172:0/2427127300 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb874079240 con 0x7fb8840cdb20 2024-04-25T08:48:26.314 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:48:26.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 -- 172.21.15.172:0/2427127300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb86806b4d0 msgr2=0x7fb86806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb86806b4d0 0x7fb86806d990 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb880006fd0 tx=0x7fb880008040 comp rx=0 tx=0).stop 2024-04-25T08:48:26.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 -- 172.21.15.172:0/2427127300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 msgr2=0x7fb8840cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 0x7fb8840cba30 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fb87402a220 tx=0x7fb8740046c0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 -- 172.21.15.172:0/2427127300 shutdown_connections 2024-04-25T08:48:26.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb86806b4d0 0x7fb86806d990 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb88415b270 0x7fb884159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8840cdb20 0x7fb8840cba30 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 --2- 172.21.15.172:0/2427127300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8840cc4f0 0x7fb884152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 -- 172.21.15.172:0/2427127300 >> 172.21.15.172:0/2427127300 conn(0x7fb88406abe0 msgr2=0x7fb8840cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:26.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 -- 172.21.15.172:0/2427127300 shutdown_connections 2024-04-25T08:48:26.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.325+0000 7fb88b84c640 1 -- 172.21.15.172:0/2427127300 wait complete. 2024-04-25T08:48:26.326 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:48:26.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.433+0000 7f336e44a640 1 Processor -- start 2024-04-25T08:48:26.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.433+0000 7f336e44a640 1 -- start start 2024-04-25T08:48:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.433+0000 7f336e44a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f336815a790 0x7f33680d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f336e44a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f33680b4eb0 0x7f33680d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f336e44a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33680b3710 con 0x7f336806fea0 2024-04-25T08:48:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f336e44a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33680cf0e0 con 0x7f33680b4eb0 2024-04-25T08:48:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f336e44a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33680cf3c0 con 0x7f336815a790 2024-04-25T08:48:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f33677fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f336806fea0 0x7f3368072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:59090/0 (socket says 172.21.15.172:59090) 2024-04-25T08:48:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f33677fe640 1 -- 172.21.15.172:0/2638671546 learned_addr learned my addr 172.21.15.172:0/2638671546 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f3367fff640 1 --2- 172.21.15.172:0/2638671546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f336815a790 0x7f33680d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f336c9e7640 1 --2- 172.21.15.172:0/2638671546 >> v2:172.21.15.186:3300/0 conn(0x7f33680b4eb0 0x7f33680d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f3366ffd640 1 -- 172.21.15.172:0/2638671546 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460440995 0 0) 0x7f33680b3710 con 0x7f336806fea0 2024-04-25T08:48:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f3366ffd640 1 -- 172.21.15.172:0/2638671546 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3350003520 con 0x7f336806fea0 2024-04-25T08:48:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f336c9e7640 1 -- 172.21.15.172:0/2638671546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f336815a790 msgr2=0x7f33680d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f336c9e7640 1 --2- 172.21.15.172:0/2638671546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f336815a790 0x7f33680d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f336c9e7640 1 -- 172.21.15.172:0/2638671546 >> v1:172.21.15.186:6789/0 conn(0x7f336806fea0 legacy=0x7f3368072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f336c9e7640 1 -- 172.21.15.172:0/2638671546 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680cf6a0 con 0x7f33680b4eb0 2024-04-25T08:48:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.434+0000 7f3367fff640 1 --2- 172.21.15.172:0/2638671546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f336815a790 0x7f33680d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:48:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.435+0000 7f336c9e7640 1 --2- 172.21.15.172:0/2638671546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33680b4eb0 0x7f33680d08d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3360009d90 tx=0x7f336002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5697923497ca3fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.435+0000 7f3366ffd640 1 -- 172.21.15.172:0/2638671546 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360007740 con 0x7f33680b4eb0 2024-04-25T08:48:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.435+0000 7f3366ffd640 1 -- 172.21.15.172:0/2638671546 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33600078e0 con 0x7f33680b4eb0 2024-04-25T08:48:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.435+0000 7f3366ffd640 1 -- 172.21.15.172:0/2638671546 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360007cb0 con 0x7f33680b4eb0 2024-04-25T08:48:26.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.436+0000 7f336e44a640 1 -- 172.21.15.172:0/2638671546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33680b4eb0 msgr2=0x7f33680d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.436+0000 7f336e44a640 1 --2- 172.21.15.172:0/2638671546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33680b4eb0 0x7f33680d08d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3360009d90 tx=0x7f336002a660 comp rx=0 tx=0).stop 2024-04-25T08:48:26.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.436+0000 7f336e44a640 1 -- 172.21.15.172:0/2638671546 shutdown_connections 2024-04-25T08:48:26.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.436+0000 7f336e44a640 1 --2- 172.21.15.172:0/2638671546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f33680b4eb0 0x7f33680d08d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.436+0000 7f336e44a640 1 --2- 172.21.15.172:0/2638671546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f336815a790 0x7f33680d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.436+0000 7f336e44a640 1 -- 172.21.15.172:0/2638671546 >> 172.21.15.172:0/2638671546 conn(0x7f33680b2370 msgr2=0x7f33680b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:26.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.436+0000 7f336e44a640 1 -- 172.21.15.172:0/2638671546 shutdown_connections 2024-04-25T08:48:26.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.436+0000 7f336e44a640 1 -- 172.21.15.172:0/2638671546 wait complete. 2024-04-25T08:48:26.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.437+0000 7f336e44a640 1 Processor -- start 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.437+0000 7f336e44a640 1 -- start start 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f336e44a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336806fea0 0x7f3368147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f336e44a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33680b4eb0 0x7f33681f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f336e44a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f336815a790 0x7f3368158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f336e44a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336815ab70 con 0x7f336806fea0 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f336e44a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33680cf980 con 0x7f336815a790 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f336e44a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336815acf0 con 0x7f33680b4eb0 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f3367fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336806fea0 0x7f3368147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f3367fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336806fea0 0x7f3368147990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54236/0 (socket says 172.21.15.172:54236) 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f3367fff640 1 -- 172.21.15.172:0/222741150 learned_addr learned my addr 172.21.15.172:0/222741150 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f33677fe640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33680b4eb0 0x7f33681f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f336c9e7640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f336815a790 0x7f3368158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f3367fff640 1 -- 172.21.15.172:0/222741150 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33680b4eb0 msgr2=0x7f33681f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f3367fff640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33680b4eb0 0x7f33681f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f3367fff640 1 -- 172.21.15.172:0/222741150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f336815a790 msgr2=0x7f3368158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f3367fff640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f336815a790 0x7f3368158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f3367fff640 1 -- 172.21.15.172:0/222741150 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368148050 con 0x7f336806fea0 2024-04-25T08:48:26.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f3367fff640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336806fea0 0x7f3368147990 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f335800e960 tx=0x7f335800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:26.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.438+0000 7f3364ff9640 1 -- 172.21.15.172:0/222741150 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358017070 con 0x7f336806fea0 2024-04-25T08:48:26.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.439+0000 7f3364ff9640 1 -- 172.21.15.172:0/222741150 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335800ca00 con 0x7f336806fea0 2024-04-25T08:48:26.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.439+0000 7f336e44a640 1 -- 172.21.15.172:0/222741150 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3368148330 con 0x7f336806fea0 2024-04-25T08:48:26.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.439+0000 7f3364ff9640 1 -- 172.21.15.172:0/222741150 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335800cdd0 con 0x7f336806fea0 2024-04-25T08:48:26.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.439+0000 7f336e44a640 1 -- 172.21.15.172:0/222741150 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3368145a60 con 0x7f336806fea0 2024-04-25T08:48:26.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.439+0000 7f336e44a640 1 -- 172.21.15.172:0/222741150 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3368073990 con 0x7f336806fea0 2024-04-25T08:48:26.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.440+0000 7f3364ff9640 1 -- 172.21.15.172:0/222741150 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f335801a070 con 0x7f336806fea0 2024-04-25T08:48:26.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.440+0000 7f3364ff9640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f335406b4d0 0x7f335406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.440+0000 7f3364ff9640 1 -- 172.21.15.172:0/222741150 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f335808a4d0 con 0x7f336806fea0 2024-04-25T08:48:26.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.440+0000 7f33677fe640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f335406b4d0 0x7f335406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.441+0000 7f33677fe640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f335406b4d0 0x7f335406d990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f33681549c0 tx=0x7f335c007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:26.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.445+0000 7f3364ff9640 1 -- 172.21.15.172:0/222741150 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3358058be0 con 0x7f336806fea0 2024-04-25T08:48:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.652+0000 7f336e44a640 1 -- 172.21.15.172:0/222741150 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33681f5310 con 0x7f336806fea0 2024-04-25T08:48:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.653+0000 7f3364ff9640 1 -- 172.21.15.172:0/222741150 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f335805cc80 con 0x7f336806fea0 2024-04-25T08:48:26.644 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:26.644 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":50,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1549593613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1549593613},{"type":"v1","addr":"172.21.15.186:6833","nonce":1549593613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2002207643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2002207643},{"type":"v1","addr":"172.21.15.186:6835","nonce":2002207643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2584048606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2584048606},{"type":"v1","addr":"172.21.15.172:6836","nonce":2584048606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:46:57.048324+0000","modified":"2024-04-25T08:47:08.087103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6837/1878763904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1878763904},{"type":"v1","addr":"172.21.15.172:6837","nonce":1878763904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:48:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 50 2024-04-25T08:48:26.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 -- 172.21.15.172:0/222741150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f335406b4d0 msgr2=0x7f335406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f335406b4d0 0x7f335406d990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f33681549c0 tx=0x7f335c007d30 comp rx=0 tx=0).stop 2024-04-25T08:48:26.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 -- 172.21.15.172:0/222741150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336806fea0 msgr2=0x7f3368147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336806fea0 0x7f3368147990 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f335800e960 tx=0x7f335800ee20 comp rx=0 tx=0).stop 2024-04-25T08:48:26.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 -- 172.21.15.172:0/222741150 shutdown_connections 2024-04-25T08:48:26.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f335406b4d0 0x7f335406d990 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f336815a790 0x7f3368158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f33680b4eb0 0x7f33681f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 --2- 172.21.15.172:0/222741150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336806fea0 0x7f3368147990 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 -- 172.21.15.172:0/222741150 >> 172.21.15.172:0/222741150 conn(0x7f33680b2370 msgr2=0x7f33680d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:26.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 -- 172.21.15.172:0/222741150 shutdown_connections 2024-04-25T08:48:26.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.655+0000 7f336e44a640 1 -- 172.21.15.172:0/222741150 wait complete. 2024-04-25T08:48:26.657 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:48:26.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.765+0000 7fc856b0a640 1 Processor -- start 2024-04-25T08:48:26.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.765+0000 7fc856b0a640 1 -- start start 2024-04-25T08:48:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc856b0a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc850144750 0x7fc85006e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc856b0a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc850144b30 con 0x7fc8500cf030 2024-04-25T08:48:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc856b0a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8500712d0 con 0x7fc85006eb10 2024-04-25T08:48:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc856b0a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8500715b0 con 0x7fc850144750 2024-04-25T08:48:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc8548a6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc850144750 0x7fc85006e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc8550a7640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc8500cf030 0x7fc85006d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59010/0 (socket says 172.21.15.172:59010) 2024-04-25T08:48:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc8550a7640 1 -- 172.21.15.172:0/2939981562 learned_addr learned my addr 172.21.15.172:0/2939981562 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc8548a6640 1 -- 172.21.15.172:0/2939981562 >> v1:172.21.15.186:6789/0 conn(0x7fc85006eb10 legacy=0x7fc8500ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc8548a6640 1 -- 172.21.15.172:0/2939981562 >> v1:172.21.15.172:6789/0 conn(0x7fc8500cf030 legacy=0x7fc85006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc84f7fe640 1 -- 172.21.15.172:0/2939981562 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729732955 0 0) 0x7fc850144b30 con 0x7fc8500cf030 2024-04-25T08:48:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.766+0000 7fc8548a6640 1 -- 172.21.15.172:0/2939981562 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc850071890 con 0x7fc850144750 2024-04-25T08:48:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc8548a6640 1 --2- 172.21.15.172:0/2939981562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc850144750 0x7fc85006e5d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc8440097a0 tx=0x7fc84402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378a3a8ac9eac973 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc84f7fe640 1 -- 172.21.15.172:0/2939981562 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844037070 con 0x7fc850144750 2024-04-25T08:48:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc84f7fe640 1 -- 172.21.15.172:0/2939981562 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844032440 con 0x7fc850144750 2024-04-25T08:48:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc84f7fe640 1 -- 172.21.15.172:0/2939981562 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844032810 con 0x7fc850144750 2024-04-25T08:48:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc856b0a640 1 -- 172.21.15.172:0/2939981562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc850144750 msgr2=0x7fc85006e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc856b0a640 1 --2- 172.21.15.172:0/2939981562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc850144750 0x7fc85006e5d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc8440097a0 tx=0x7fc84402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc856b0a640 1 -- 172.21.15.172:0/2939981562 shutdown_connections 2024-04-25T08:48:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc856b0a640 1 --2- 172.21.15.172:0/2939981562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc850144750 0x7fc85006e5d0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc856b0a640 1 -- 172.21.15.172:0/2939981562 >> 172.21.15.172:0/2939981562 conn(0x7fc85006abe0 msgr2=0x7fc85006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc856b0a640 1 -- 172.21.15.172:0/2939981562 shutdown_connections 2024-04-25T08:48:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.767+0000 7fc856b0a640 1 -- 172.21.15.172:0/2939981562 wait complete. 2024-04-25T08:48:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.769+0000 7fc856b0a640 1 Processor -- start 2024-04-25T08:48:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.769+0000 7fc856b0a640 1 -- start start 2024-04-25T08:48:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.769+0000 7fc856b0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85006eb10 0x7fc85015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.769+0000 7fc856b0a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8500cf030 0x7fc85015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.769+0000 7fc856b0a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc850144750 0x7fc85015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.769+0000 7fc856b0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8501455d0 con 0x7fc85006eb10 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.769+0000 7fc856b0a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc850145450 con 0x7fc8500cf030 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.769+0000 7fc856b0a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85015c000 con 0x7fc850144750 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8548a6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85006eb10 0x7fc85015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8548a6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85006eb10 0x7fc85015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54254/0 (socket says 172.21.15.172:54254) 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8548a6640 1 -- 172.21.15.172:0/1218302283 learned_addr learned my addr 172.21.15.172:0/1218302283 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc84ffff640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8500cf030 0x7fc85015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8550a7640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc850144750 0x7fc85015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8548a6640 1 -- 172.21.15.172:0/1218302283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc850144750 msgr2=0x7fc85015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8548a6640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc850144750 0x7fc85015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8548a6640 1 -- 172.21.15.172:0/1218302283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8500cf030 msgr2=0x7fc85015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8548a6640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8500cf030 0x7fc85015d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8548a6640 1 -- 172.21.15.172:0/1218302283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85013fab0 con 0x7fc85006eb10 2024-04-25T08:48:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8550a7640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc850144750 0x7fc85015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc8548a6640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85006eb10 0x7fc85015d3b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc8440097a0 tx=0x7fc8440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc84d7fa640 1 -- 172.21.15.172:0/1218302283 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844037040 con 0x7fc85006eb10 2024-04-25T08:48:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc84d7fa640 1 -- 172.21.15.172:0/1218302283 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844004250 con 0x7fc85006eb10 2024-04-25T08:48:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc856b0a640 1 -- 172.21.15.172:0/1218302283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8501425d0 con 0x7fc85006eb10 2024-04-25T08:48:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc84d7fa640 1 -- 172.21.15.172:0/1218302283 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844032e20 con 0x7fc85006eb10 2024-04-25T08:48:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.770+0000 7fc856b0a640 1 -- 172.21.15.172:0/1218302283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85015b3d0 con 0x7fc85006eb10 2024-04-25T08:48:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.771+0000 7fc856b0a640 1 -- 172.21.15.172:0/1218302283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc850073990 con 0x7fc85006eb10 2024-04-25T08:48:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.772+0000 7fc84d7fa640 1 -- 172.21.15.172:0/1218302283 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc844030770 con 0x7fc85006eb10 2024-04-25T08:48:26.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.772+0000 7fc84d7fa640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc83406b4d0 0x7fc83406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:26.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.772+0000 7fc84ffff640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc83406b4d0 0x7fc83406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:26.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.772+0000 7fc84d7fa640 1 -- 172.21.15.172:0/1218302283 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7fc8440ab6c0 con 0x7fc85006eb10 2024-04-25T08:48:26.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.773+0000 7fc84ffff640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc83406b4d0 0x7fc83406d990 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc83c006fd0 tx=0x7fc83c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.776+0000 7fc84d7fa640 1 -- 172.21.15.172:0/1218302283 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc84407a300 con 0x7fc85006eb10 2024-04-25T08:48:26.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.949+0000 7fc856b0a640 1 -- 172.21.15.172:0/1218302283 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8500d0510 con 0x7fc85006eb10 2024-04-25T08:48:26.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.950+0000 7fc84d7fa640 1 -- 172.21.15.172:0/1218302283 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17071 (secure 0 0 0) 0x7fc844079c00 con 0x7fc85006eb10 2024-04-25T08:48:26.941 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:26.942 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":83,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:04.271283+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:55.259890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:56.021748+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":82,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.952+0000 7fc856b0a640 1 -- 172.21.15.172:0/1218302283 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc83406b4d0 msgr2=0x7fc83406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.952+0000 7fc856b0a640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc83406b4d0 0x7fc83406d990 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc83c006fd0 tx=0x7fc83c008040 comp rx=0 tx=0).stop 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.952+0000 7fc856b0a640 1 -- 172.21.15.172:0/1218302283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85006eb10 msgr2=0x7fc85015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.952+0000 7fc856b0a640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85006eb10 0x7fc85015d3b0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc8440097a0 tx=0x7fc8440046c0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.952+0000 7fc856b0a640 1 -- 172.21.15.172:0/1218302283 shutdown_connections 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.952+0000 7fc856b0a640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc83406b4d0 0x7fc83406d990 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.952+0000 7fc856b0a640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8500cf030 0x7fc85015d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.952+0000 7fc856b0a640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc850144750 0x7fc85015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.952+0000 7fc856b0a640 1 --2- 172.21.15.172:0/1218302283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc85006eb10 0x7fc85015d3b0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.952+0000 7fc856b0a640 1 -- 172.21.15.172:0/1218302283 >> 172.21.15.172:0/1218302283 conn(0x7fc85006abe0 msgr2=0x7fc8500b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:26.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.953+0000 7fc856b0a640 1 -- 172.21.15.172:0/1218302283 shutdown_connections 2024-04-25T08:48:26.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:26.953+0000 7fc856b0a640 1 -- 172.21.15.172:0/1218302283 wait complete. 2024-04-25T08:48:26.958 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:48:26.958 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:48:27.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.064+0000 7f2bbd82a640 1 Processor -- start 2024-04-25T08:48:27.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.064+0000 7f2bbd82a640 1 -- start start 2024-04-25T08:48:27.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.064+0000 7f2bbd82a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2bb815dbe0 0x7f2bb80d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.064+0000 7f2bbd82a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2bb80b92a0 0x7f2bb80d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.064+0000 7f2bbd82a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb80b97a0 con 0x7f2bb80b2cb0 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.064+0000 7f2bbd82a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb815dfc0 con 0x7f2bb815dbe0 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.064+0000 7f2bbd82a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb80d1a00 con 0x7f2bb80b92a0 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.065+0000 7f2bb6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2bb815dbe0 0x7f2bb80d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.065+0000 7f2bb67fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2bb80b2cb0 0x7f2bb80b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59026/0 (socket says 172.21.15.172:59026) 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.065+0000 7f2bb67fc640 1 -- 172.21.15.172:0/3910987215 learned_addr learned my addr 172.21.15.172:0/3910987215 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.065+0000 7f2bb77fe640 1 --2- 172.21.15.172:0/3910987215 >> v2:172.21.15.186:3300/0 conn(0x7f2bb80b92a0 0x7f2bb80d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.065+0000 7f2bb6ffd640 1 -- 172.21.15.172:0/3910987215 >> v2:172.21.15.186:3300/0 conn(0x7f2bb80b92a0 msgr2=0x7f2bb80d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.065+0000 7f2bb6ffd640 1 --2- 172.21.15.172:0/3910987215 >> v2:172.21.15.186:3300/0 conn(0x7f2bb80b92a0 0x7f2bb80d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.065+0000 7f2bb6ffd640 1 -- 172.21.15.172:0/3910987215 >> v1:172.21.15.172:6789/0 conn(0x7f2bb80b2cb0 legacy=0x7f2bb80b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.065+0000 7f2bb6ffd640 1 -- 172.21.15.172:0/3910987215 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80d1c50 con 0x7f2bb815dbe0 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.065+0000 7f2bb5ffb640 1 -- 172.21.15.172:0/3910987215 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115800407 0 0) 0x7f2bb80b97a0 con 0x7f2bb80b2cb0 2024-04-25T08:48:27.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bb6ffd640 1 --2- 172.21.15.172:0/3910987215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb815dbe0 0x7f2bb80d0910 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80cfb90 tx=0x7f2ba802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9544809bb39f65c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:27.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bb5ffb640 1 -- 172.21.15.172:0/3910987215 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8037070 con 0x7f2bb815dbe0 2024-04-25T08:48:27.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bb5ffb640 1 -- 172.21.15.172:0/3910987215 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba8032440 con 0x7f2bb815dbe0 2024-04-25T08:48:27.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bb5ffb640 1 -- 172.21.15.172:0/3910987215 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba802ae60 con 0x7f2bb815dbe0 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bbd82a640 1 -- 172.21.15.172:0/3910987215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb815dbe0 msgr2=0x7f2bb80d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bbd82a640 1 --2- 172.21.15.172:0/3910987215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb815dbe0 0x7f2bb80d0910 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80cfb90 tx=0x7f2ba802a110 comp rx=0 tx=0).stop 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bbd82a640 1 -- 172.21.15.172:0/3910987215 shutdown_connections 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bbd82a640 1 --2- 172.21.15.172:0/3910987215 >> v2:172.21.15.186:3300/0 conn(0x7f2bb80b92a0 0x7f2bb80d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bbd82a640 1 --2- 172.21.15.172:0/3910987215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb815dbe0 0x7f2bb80d0910 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bbd82a640 1 -- 172.21.15.172:0/3910987215 >> 172.21.15.172:0/3910987215 conn(0x7f2bb8061a20 msgr2=0x7f2bb8061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bbd82a640 1 -- 172.21.15.172:0/3910987215 shutdown_connections 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.066+0000 7f2bbd82a640 1 -- 172.21.15.172:0/3910987215 wait complete. 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.067+0000 7f2bbd82a640 1 Processor -- start 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.068+0000 7f2bbd82a640 1 -- start start 2024-04-25T08:48:27.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.068+0000 7f2bbd82a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb80b2cb0 0x7f2bb80c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.068+0000 7f2bbd82a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb80b92a0 0x7f2bb80cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.068+0000 7f2bbd82a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb815dbe0 0x7f2bb80cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.068+0000 7f2bbd82a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80b6ab0 con 0x7f2bb80b92a0 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.068+0000 7f2bbd82a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80d2210 con 0x7f2bb815dbe0 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.068+0000 7f2bbd82a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80b6c30 con 0x7f2bb80b2cb0 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.068+0000 7f2bb67fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb80b92a0 0x7f2bb80cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.068+0000 7f2bb67fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb80b92a0 0x7f2bb80cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54262/0 (socket says 172.21.15.172:54262) 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.068+0000 7f2bb67fc640 1 -- 172.21.15.172:0/337367020 learned_addr learned my addr 172.21.15.172:0/337367020 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bb77fe640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb815dbe0 0x7f2bb80cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bb6ffd640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb80b2cb0 0x7f2bb80c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bb67fc640 1 -- 172.21.15.172:0/337367020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb80b2cb0 msgr2=0x7f2bb80c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bb67fc640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb80b2cb0 0x7f2bb80c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bb67fc640 1 -- 172.21.15.172:0/337367020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb815dbe0 msgr2=0x7f2bb80cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bb67fc640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb815dbe0 0x7f2bb80cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bb67fc640 1 -- 172.21.15.172:0/337367020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb815f7f0 con 0x7f2bb80b92a0 2024-04-25T08:48:27.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bb77fe640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb815dbe0 0x7f2bb80cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:27.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bb67fc640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb80b92a0 0x7f2bb80cd1d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00c4b0 tx=0x7f2bac00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:27.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2b9ffff640 1 -- 172.21.15.172:0/337367020 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac018070 con 0x7f2bb80b92a0 2024-04-25T08:48:27.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2b9ffff640 1 -- 172.21.15.172:0/337367020 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac007500 con 0x7f2bb80b92a0 2024-04-25T08:48:27.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bbd82a640 1 -- 172.21.15.172:0/337367020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb815fad0 con 0x7f2bb80b92a0 2024-04-25T08:48:27.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2b9ffff640 1 -- 172.21.15.172:0/337367020 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac004a20 con 0x7f2bb80b92a0 2024-04-25T08:48:27.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.069+0000 7f2bbd82a640 1 -- 172.21.15.172:0/337367020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb8160090 con 0x7f2bb80b92a0 2024-04-25T08:48:27.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.070+0000 7f2bbd82a640 1 -- 172.21.15.172:0/337367020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb8073990 con 0x7f2bb80b92a0 2024-04-25T08:48:27.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.070+0000 7f2b9ffff640 1 -- 172.21.15.172:0/337367020 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2bac01b070 con 0x7f2bb80b92a0 2024-04-25T08:48:27.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.071+0000 7f2b9ffff640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ba406b4d0 0x7f2ba406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.071+0000 7f2b9ffff640 1 -- 172.21.15.172:0/337367020 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f2bac089710 con 0x7f2bb80b92a0 2024-04-25T08:48:27.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.071+0000 7f2bb6ffd640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ba406b4d0 0x7f2ba406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.071+0000 7f2bb6ffd640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ba406b4d0 0x7f2ba406d990 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8034000 tx=0x7f2ba802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:27.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.075+0000 7f2b9ffff640 1 -- 172.21.15.172:0/337367020 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2bac0584a0 con 0x7f2bb80b92a0 2024-04-25T08:48:27.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.284+0000 7f2bbd82a640 1 -- 172.21.15.172:0/337367020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bb8160a80 con 0x7f2bb80b92a0 2024-04-25T08:48:27.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.284+0000 7f2b9ffff640 1 -- 172.21.15.172:0/337367020 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f2bac057da0 con 0x7f2bb80b92a0 2024-04-25T08:48:27.276 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:27.276 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":50,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1549593613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1549593613},{"type":"v1","addr":"172.21.15.186:6833","nonce":1549593613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2002207643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2002207643},{"type":"v1","addr":"172.21.15.186:6835","nonce":2002207643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2584048606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2584048606},{"type":"v1","addr":"172.21.15.172:6836","nonce":2584048606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:46:57.048324+0000","modified":"2024-04-25T08:47:08.087103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6837/1878763904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1878763904},{"type":"v1","addr":"172.21.15.172:6837","nonce":1878763904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:48:27.276 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 50 2024-04-25T08:48:27.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.286+0000 7f2bbd82a640 1 -- 172.21.15.172:0/337367020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ba406b4d0 msgr2=0x7f2ba406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.286+0000 7f2bbd82a640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ba406b4d0 0x7f2ba406d990 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8034000 tx=0x7f2ba802e000 comp rx=0 tx=0).stop 2024-04-25T08:48:27.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.286+0000 7f2bbd82a640 1 -- 172.21.15.172:0/337367020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb80b92a0 msgr2=0x7f2bb80cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.286+0000 7f2bbd82a640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb80b92a0 0x7f2bb80cd1d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00c4b0 tx=0x7f2bac00c970 comp rx=0 tx=0).stop 2024-04-25T08:48:27.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.286+0000 7f2bbd82a640 1 -- 172.21.15.172:0/337367020 shutdown_connections 2024-04-25T08:48:27.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.286+0000 7f2bbd82a640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ba406b4d0 0x7f2ba406d990 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.286+0000 7f2bbd82a640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb815dbe0 0x7f2bb80cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.286+0000 7f2bbd82a640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb80b92a0 0x7f2bb80cd1d0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.286+0000 7f2bbd82a640 1 --2- 172.21.15.172:0/337367020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2bb80b2cb0 0x7f2bb80c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.286+0000 7f2bbd82a640 1 -- 172.21.15.172:0/337367020 >> 172.21.15.172:0/337367020 conn(0x7f2bb8061a20 msgr2=0x7f2bb806c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:27.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.287+0000 7f2bbd82a640 1 -- 172.21.15.172:0/337367020 shutdown_connections 2024-04-25T08:48:27.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.287+0000 7f2bbd82a640 1 -- 172.21.15.172:0/337367020 wait complete. 2024-04-25T08:48:27.288 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:48:27.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.395+0000 7f870eecd640 1 Processor -- start 2024-04-25T08:48:27.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.395+0000 7f870eecd640 1 -- start start 2024-04-25T08:48:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f870eecd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 0x7f87080cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f870eecd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f87080cfcf0 0x7f87080cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f870eecd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8708071480 con 0x7f87080ce3c0 2024-04-25T08:48:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f870eecd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87080ce830 con 0x7f87080cfcf0 2024-04-25T08:48:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f870eecd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8708072090 con 0x7f8708154ee0 2024-04-25T08:48:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f8707fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f87080cfcf0 0x7f87080cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f870d46a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f87080ce3c0 0x7f870815e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59028/0 (socket says 172.21.15.172:59028) 2024-04-25T08:48:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f870d46a640 1 -- 172.21.15.172:0/2868995385 learned_addr learned my addr 172.21.15.172:0/2868995385 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:27.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f8707fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f87080cfcf0 0x7f87080cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54264/0 (socket says 172.21.15.172:54264) 2024-04-25T08:48:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f870cc69640 1 --2- 172.21.15.172:0/2868995385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 0x7f87080cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f8707fff640 1 -- 172.21.15.172:0/2868995385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 msgr2=0x7f87080cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f8707fff640 1 --2- 172.21.15.172:0/2868995385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 0x7f87080cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f8707fff640 1 -- 172.21.15.172:0/2868995385 >> v1:172.21.15.172:6789/0 conn(0x7f87080ce3c0 legacy=0x7f870815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f8707fff640 1 -- 172.21.15.172:0/2868995385 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8708071760 con 0x7f87080cfcf0 2024-04-25T08:48:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.396+0000 7f87077fe640 1 -- 172.21.15.172:0/2868995385 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926987673 0 0) 0x7f8708071480 con 0x7f87080ce3c0 2024-04-25T08:48:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.397+0000 7f8707fff640 1 --2- 172.21.15.172:0/2868995385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080cfcf0 0x7f87080cde80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f86f00097a0 tx=0x7f86f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d95d67e1a2a61b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.397+0000 7f87077fe640 1 -- 172.21.15.172:0/2868995385 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f0037070 con 0x7f87080cfcf0 2024-04-25T08:48:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.397+0000 7f87077fe640 1 -- 172.21.15.172:0/2868995385 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f0032440 con 0x7f87080cfcf0 2024-04-25T08:48:27.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.397+0000 7f87077fe640 1 -- 172.21.15.172:0/2868995385 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f0032810 con 0x7f87080cfcf0 2024-04-25T08:48:27.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.397+0000 7f870eecd640 1 -- 172.21.15.172:0/2868995385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080cfcf0 msgr2=0x7f87080cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.397+0000 7f870eecd640 1 --2- 172.21.15.172:0/2868995385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080cfcf0 0x7f87080cde80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f86f00097a0 tx=0x7f86f002a180 comp rx=0 tx=0).stop 2024-04-25T08:48:27.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.397+0000 7f870eecd640 1 -- 172.21.15.172:0/2868995385 shutdown_connections 2024-04-25T08:48:27.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.397+0000 7f870eecd640 1 --2- 172.21.15.172:0/2868995385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080cfcf0 0x7f87080cde80 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.397+0000 7f870eecd640 1 --2- 172.21.15.172:0/2868995385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 0x7f87080cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.397+0000 7f870eecd640 1 -- 172.21.15.172:0/2868995385 >> 172.21.15.172:0/2868995385 conn(0x7f870806abe0 msgr2=0x7f870806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.398+0000 7f870eecd640 1 -- 172.21.15.172:0/2868995385 shutdown_connections 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.398+0000 7f870eecd640 1 -- 172.21.15.172:0/2868995385 wait complete. 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.399+0000 7f870eecd640 1 Processor -- start 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.399+0000 7f870eecd640 1 -- start start 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870eecd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080ce3c0 0x7f8708149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870eecd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87080cfcf0 0x7f8708150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870eecd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 0x7f8708151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870eecd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8708071230 con 0x7f87080ce3c0 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870eecd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8708071d20 con 0x7f87080cfcf0 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870eecd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87081552c0 con 0x7f8708154ee0 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870cc69640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080ce3c0 0x7f8708149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870cc69640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080ce3c0 0x7f8708149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54278/0 (socket says 172.21.15.172:54278) 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870cc69640 1 -- 172.21.15.172:0/2082524737 learned_addr learned my addr 172.21.15.172:0/2082524737 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f8707fff640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87080cfcf0 0x7f8708150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870d46a640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 0x7f8708151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870cc69640 1 -- 172.21.15.172:0/2082524737 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 msgr2=0x7f8708151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870cc69640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 0x7f8708151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870cc69640 1 -- 172.21.15.172:0/2082524737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87080cfcf0 msgr2=0x7f8708150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870cc69640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87080cfcf0 0x7f8708150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870cc69640 1 -- 172.21.15.172:0/2082524737 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870814d100 con 0x7f87080ce3c0 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870d46a640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 0x7f8708151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870cc69640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080ce3c0 0x7f8708149cf0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8700007e40 tx=0x7f870000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f87057fa640 1 -- 172.21.15.172:0/2082524737 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700014620 con 0x7f87080ce3c0 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f87057fa640 1 -- 172.21.15.172:0/2082524737 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8700019070 con 0x7f87080ce3c0 2024-04-25T08:48:27.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870eecd640 1 -- 172.21.15.172:0/2082524737 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870814d3a0 con 0x7f87080ce3c0 2024-04-25T08:48:27.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f87057fa640 1 -- 172.21.15.172:0/2082524737 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700014a00 con 0x7f87080ce3c0 2024-04-25T08:48:27.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.400+0000 7f870eecd640 1 -- 172.21.15.172:0/2082524737 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8708154680 con 0x7f87080ce3c0 2024-04-25T08:48:27.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.401+0000 7f870eecd640 1 -- 172.21.15.172:0/2082524737 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8708073990 con 0x7f87080ce3c0 2024-04-25T08:48:27.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.402+0000 7f87057fa640 1 -- 172.21.15.172:0/2082524737 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8700014ba0 con 0x7f87080ce3c0 2024-04-25T08:48:27.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.402+0000 7f87057fa640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86e806b4d0 0x7f86e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.402+0000 7f87057fa640 1 -- 172.21.15.172:0/2082524737 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f870008ab20 con 0x7f87080ce3c0 2024-04-25T08:48:27.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.402+0000 7f8707fff640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86e806b4d0 0x7f86e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.402+0000 7f8707fff640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86e806b4d0 0x7f86e806d990 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f86f0034000 tx=0x7f86f002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:27.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.406+0000 7f87057fa640 1 -- 172.21.15.172:0/2082524737 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8700059880 con 0x7f87080ce3c0 2024-04-25T08:48:27.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.614+0000 7f870eecd640 1 -- 172.21.15.172:0/2082524737 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f870806d360 con 0x7f87080ce3c0 2024-04-25T08:48:27.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.614+0000 7f87057fa640 1 -- 172.21.15.172:0/2082524737 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f8700059180 con 0x7f87080ce3c0 2024-04-25T08:48:27.606 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:27.606 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":50,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1549593613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1549593613},{"type":"v1","addr":"172.21.15.186:6833","nonce":1549593613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2002207643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2002207643},{"type":"v1","addr":"172.21.15.186:6835","nonce":2002207643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2584048606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2584048606},{"type":"v1","addr":"172.21.15.172:6836","nonce":2584048606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-04-25T08:46:57.048324+0000","modified":"2024-04-25T08:47:08.087103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6837/1878763904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":1878763904},{"type":"v1","addr":"172.21.15.172:6837","nonce":1878763904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T08:48:27.606 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 50 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.616+0000 7f870eecd640 1 -- 172.21.15.172:0/2082524737 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86e806b4d0 msgr2=0x7f86e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.616+0000 7f870eecd640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86e806b4d0 0x7f86e806d990 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f86f0034000 tx=0x7f86f002e000 comp rx=0 tx=0).stop 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.616+0000 7f870eecd640 1 -- 172.21.15.172:0/2082524737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080ce3c0 msgr2=0x7f8708149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.616+0000 7f870eecd640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080ce3c0 0x7f8708149cf0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8700007e40 tx=0x7f870000e4b0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.616+0000 7f870eecd640 1 -- 172.21.15.172:0/2082524737 shutdown_connections 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.616+0000 7f870eecd640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86e806b4d0 0x7f86e806d990 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.616+0000 7f870eecd640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87080cfcf0 0x7f8708150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.617+0000 7f870eecd640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8708154ee0 0x7f8708151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.617+0000 7f870eecd640 1 --2- 172.21.15.172:0/2082524737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87080ce3c0 0x7f8708149cf0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.617+0000 7f870eecd640 1 -- 172.21.15.172:0/2082524737 >> 172.21.15.172:0/2082524737 conn(0x7f870806abe0 msgr2=0x7f870806d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.617+0000 7f870eecd640 1 -- 172.21.15.172:0/2082524737 shutdown_connections 2024-04-25T08:48:27.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.617+0000 7f870eecd640 1 -- 172.21.15.172:0/2082524737 wait complete. 2024-04-25T08:48:27.618 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:48:27.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.726+0000 7f1d51b13640 1 Processor -- start 2024-04-25T08:48:27.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.726+0000 7f1d51b13640 1 -- start start 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.726+0000 7f1d51b13640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1d4c06ce10 0x7f1d4c0d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.726+0000 7f1d51b13640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d4c09a450 0x7f1d4c0cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.726+0000 7f1d51b13640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c06c220 con 0x7f1d4c15dc70 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.726+0000 7f1d51b13640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0d0c90 con 0x7f1d4c06ce10 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.726+0000 7f1d51b13640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0d0080 con 0x7f1d4c09a450 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.727+0000 7f1d43fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1d4c06ce10 0x7f1d4c0d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.727+0000 7f1d43fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1d4c06ce10 0x7f1d4c0d1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51184/0 (socket says 172.21.15.172:51184) 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.727+0000 7f1d43fff640 1 -- 172.21.15.172:0/564933915 learned_addr learned my addr 172.21.15.172:0/564933915 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.727+0000 7f1d4bfff640 1 --2- 172.21.15.172:0/564933915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d4c09a450 0x7f1d4c0cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.727+0000 7f1d43fff640 1 -- 172.21.15.172:0/564933915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d4c09a450 msgr2=0x7f1d4c0cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.727+0000 7f1d43fff640 1 --2- 172.21.15.172:0/564933915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d4c09a450 0x7f1d4c0cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.727+0000 7f1d43fff640 1 -- 172.21.15.172:0/564933915 >> v1:172.21.15.186:6789/0 conn(0x7f1d4c15dc70 legacy=0x7f1d4c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.727+0000 7f1d43fff640 1 -- 172.21.15.172:0/564933915 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0d0360 con 0x7f1d4c06ce10 2024-04-25T08:48:27.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d43fff640 1 --2- 172.21.15.172:0/564933915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c06ce10 0x7f1d4c0d1120 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009870 tx=0x7f1d3402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd141b0431a69010 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:27.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d4affd640 1 -- 172.21.15.172:0/564933915 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34037070 con 0x7f1d4c06ce10 2024-04-25T08:48:27.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d4affd640 1 -- 172.21.15.172:0/564933915 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d34032440 con 0x7f1d4c06ce10 2024-04-25T08:48:27.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d4affd640 1 -- 172.21.15.172:0/564933915 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34032810 con 0x7f1d4c06ce10 2024-04-25T08:48:27.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d51b13640 1 -- 172.21.15.172:0/564933915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c06ce10 msgr2=0x7f1d4c0d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d51b13640 1 --2- 172.21.15.172:0/564933915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c06ce10 0x7f1d4c0d1120 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009870 tx=0x7f1d3402a210 comp rx=0 tx=0).stop 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d51b13640 1 -- 172.21.15.172:0/564933915 shutdown_connections 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d51b13640 1 --2- 172.21.15.172:0/564933915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d4c09a450 0x7f1d4c0cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d51b13640 1 --2- 172.21.15.172:0/564933915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c06ce10 0x7f1d4c0d1120 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d51b13640 1 -- 172.21.15.172:0/564933915 >> 172.21.15.172:0/564933915 conn(0x7f1d4c0b3270 msgr2=0x7f1d4c0b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d51b13640 1 -- 172.21.15.172:0/564933915 shutdown_connections 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.728+0000 7f1d51b13640 1 -- 172.21.15.172:0/564933915 wait complete. 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d51b13640 1 Processor -- start 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d51b13640 1 -- start start 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d51b13640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d4c06ce10 0x7f1d4c15c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d51b13640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d4c09a450 0x7f1d4c0b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d51b13640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c15dc70 0x7f1d4c1f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d51b13640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c15e050 con 0x7f1d4c15dc70 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d51b13640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0d0920 con 0x7f1d4c06ce10 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d51b13640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0cbdd0 con 0x7f1d4c09a450 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c15dc70 0x7f1d4c1f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c15dc70 0x7f1d4c1f3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51196/0 (socket says 172.21.15.172:51196) 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.730+0000 7f1d4bfff640 1 -- 172.21.15.172:0/2853672020 learned_addr learned my addr 172.21.15.172:0/2853672020 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d4b7fe640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d4c06ce10 0x7f1d4c15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d43fff640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d4c09a450 0x7f1d4c0b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d4bfff640 1 -- 172.21.15.172:0/2853672020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d4c09a450 msgr2=0x7f1d4c0b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d4bfff640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d4c09a450 0x7f1d4c0b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d4bfff640 1 -- 172.21.15.172:0/2853672020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d4c06ce10 msgr2=0x7f1d4c15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d4bfff640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d4c06ce10 0x7f1d4c15c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d4bfff640 1 -- 172.21.15.172:0/2853672020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0b7430 con 0x7f1d4c15dc70 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d4bfff640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c15dc70 0x7f1d4c1f3f80 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400cd70 tx=0x7f1d4400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:27.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d48ff9640 1 -- 172.21.15.172:0/2853672020 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44003b90 con 0x7f1d4c15dc70 2024-04-25T08:48:27.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d48ff9640 1 -- 172.21.15.172:0/2853672020 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44003d30 con 0x7f1d4c15dc70 2024-04-25T08:48:27.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d48ff9640 1 -- 172.21.15.172:0/2853672020 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44004240 con 0x7f1d4c15dc70 2024-04-25T08:48:27.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d51b13640 1 -- 172.21.15.172:0/2853672020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c0b43b0 con 0x7f1d4c15dc70 2024-04-25T08:48:27.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.731+0000 7f1d51b13640 1 -- 172.21.15.172:0/2853672020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c0b4970 con 0x7f1d4c15dc70 2024-04-25T08:48:27.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.732+0000 7f1d51b13640 1 -- 172.21.15.172:0/2853672020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c073990 con 0x7f1d4c15dc70 2024-04-25T08:48:27.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.733+0000 7f1d48ff9640 1 -- 172.21.15.172:0/2853672020 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1d440043e0 con 0x7f1d4c15dc70 2024-04-25T08:48:27.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.733+0000 7f1d48ff9640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1d3006b500 0x7f1d3006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:27.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.733+0000 7f1d48ff9640 1 -- 172.21.15.172:0/2853672020 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f1d4408adc0 con 0x7f1d4c15dc70 2024-04-25T08:48:27.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.733+0000 7f1d4b7fe640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1d3006b500 0x7f1d3006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:27.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.733+0000 7f1d4b7fe640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1d3006b500 0x7f1d3006d9c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c006fd0 tx=0x7f1d3c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:27.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.737+0000 7f1d48ff9640 1 -- 172.21.15.172:0/2853672020 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1d44059b20 con 0x7f1d4c15dc70 2024-04-25T08:48:27.898 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.907+0000 7f1d51b13640 1 -- 172.21.15.172:0/2853672020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d4c0b40a0 con 0x7f1d4c15dc70 2024-04-25T08:48:27.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.908+0000 7f1d48ff9640 1 -- 172.21.15.172:0/2853672020 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+17071 (secure 0 0 0) 0x7f1d44059420 con 0x7f1d4c15dc70 2024-04-25T08:48:27.900 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:27.900 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":83,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:04.271283+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:46:55.259890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T08:46:56.021748+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":82,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 -- 172.21.15.172:0/2853672020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1d3006b500 msgr2=0x7f1d3006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1d3006b500 0x7f1d3006d9c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c006fd0 tx=0x7f1d3c008040 comp rx=0 tx=0).stop 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 -- 172.21.15.172:0/2853672020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c15dc70 msgr2=0x7f1d4c1f3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c15dc70 0x7f1d4c1f3f80 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400cd70 tx=0x7f1d4400a660 comp rx=0 tx=0).stop 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 -- 172.21.15.172:0/2853672020 shutdown_connections 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1d3006b500 0x7f1d3006d9c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d4c15dc70 0x7f1d4c1f3f80 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d4c09a450 0x7f1d4c0b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 --2- 172.21.15.172:0/2853672020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d4c06ce10 0x7f1d4c15c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 -- 172.21.15.172:0/2853672020 >> 172.21.15.172:0/2853672020 conn(0x7f1d4c0b3270 msgr2=0x7f1d4c070330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 -- 172.21.15.172:0/2853672020 shutdown_connections 2024-04-25T08:48:27.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:27.910+0000 7f1d51b13640 1 -- 172.21.15.172:0/2853672020 wait complete. 2024-04-25T08:48:27.912 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:48:28.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.018+0000 7f00ec622640 1 Processor -- start 2024-04-25T08:48:28.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.018+0000 7f00ec622640 1 -- start start 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.019+0000 7f00ec622640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f00e40cc4f0 0x7f00e40cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.019+0000 7f00ec622640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00e415b980 0x7f00e40cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.019+0000 7f00ec622640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e4072280 con 0x7f00e40cdb20 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.019+0000 7f00ec622640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e4071270 con 0x7f00e415b980 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.019+0000 7f00ec622640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e415bd80 con 0x7f00e40cc4f0 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.019+0000 7f00eabbf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00e415b980 0x7f00e40cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.020+0000 7f00eabbf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00e415b980 0x7f00e40cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51200/0 (socket says 172.21.15.172:51200) 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.020+0000 7f00eabbf640 1 -- 172.21.15.172:0/1999938171 learned_addr learned my addr 172.21.15.172:0/1999938171 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.020+0000 7f00eabbf640 1 -- 172.21.15.172:0/1999938171 >> v2:172.21.15.186:3300/0 conn(0x7f00e40cc4f0 msgr2=0x7f00e40cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.020+0000 7f00ea3be640 1 --2- 172.21.15.172:0/1999938171 >> v2:172.21.15.186:3300/0 conn(0x7f00e40cc4f0 0x7f00e40cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.020+0000 7f00eabbf640 1 --2- 172.21.15.172:0/1999938171 >> v2:172.21.15.186:3300/0 conn(0x7f00e40cc4f0 0x7f00e40cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.020+0000 7f00eabbf640 1 -- 172.21.15.172:0/1999938171 >> v1:172.21.15.186:6789/0 conn(0x7f00e40cdb20 legacy=0x7f00e415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:28.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.020+0000 7f00eabbf640 1 -- 172.21.15.172:0/1999938171 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e40714c0 con 0x7f00e415b980 2024-04-25T08:48:28.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.020+0000 7f00ea3be640 1 --2- 172.21.15.172:0/1999938171 >> v2:172.21.15.186:3300/0 conn(0x7f00e40cc4f0 0x7f00e40cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:28.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00eabbf640 1 --2- 172.21.15.172:0/1999938171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e415b980 0x7f00e40cdfb0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f00e40cd290 tx=0x7f00e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7cfd51d1c2e0a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:28.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00e93bc640 1 -- 172.21.15.172:0/1999938171 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0037070 con 0x7f00e415b980 2024-04-25T08:48:28.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00e93bc640 1 -- 172.21.15.172:0/1999938171 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e0032440 con 0x7f00e415b980 2024-04-25T08:48:28.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00e93bc640 1 -- 172.21.15.172:0/1999938171 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0032810 con 0x7f00e415b980 2024-04-25T08:48:28.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00ec622640 1 -- 172.21.15.172:0/1999938171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e415b980 msgr2=0x7f00e40cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:28.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00ec622640 1 --2- 172.21.15.172:0/1999938171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e415b980 0x7f00e40cdfb0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f00e40cd290 tx=0x7f00e002a270 comp rx=0 tx=0).stop 2024-04-25T08:48:28.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00ec622640 1 -- 172.21.15.172:0/1999938171 shutdown_connections 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00ec622640 1 --2- 172.21.15.172:0/1999938171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e415b980 0x7f00e40cdfb0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00ec622640 1 --2- 172.21.15.172:0/1999938171 >> v2:172.21.15.186:3300/0 conn(0x7f00e40cc4f0 0x7f00e40cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00ec622640 1 -- 172.21.15.172:0/1999938171 >> 172.21.15.172:0/1999938171 conn(0x7f00e406abe0 msgr2=0x7f00e406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00ec622640 1 -- 172.21.15.172:0/1999938171 shutdown_connections 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.021+0000 7f00ec622640 1 -- 172.21.15.172:0/1999938171 wait complete. 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.022+0000 7f00ec622640 1 Processor -- start 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.023+0000 7f00ec622640 1 -- start start 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.023+0000 7f00ec622640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e40cc4f0 0x7f00e40b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.023+0000 7f00ec622640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00e40cdb20 0x7f00e4154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.023+0000 7f00ec622640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00e415b980 0x7f00e414b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.023+0000 7f00ec622640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4071d60 con 0x7f00e40cc4f0 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.023+0000 7f00ec622640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e4071a80 con 0x7f00e40cdb20 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.023+0000 7f00ec622640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40ae500 con 0x7f00e415b980 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.023+0000 7f00ea3be640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e40cc4f0 0x7f00e40b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.023+0000 7f00ea3be640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e40cc4f0 0x7f00e40b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51216/0 (socket says 172.21.15.172:51216) 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.023+0000 7f00ea3be640 1 -- 172.21.15.172:0/1100686821 learned_addr learned my addr 172.21.15.172:0/1100686821 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00ea3be640 1 -- 172.21.15.172:0/1100686821 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00e415b980 msgr2=0x7f00e414b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00ea3be640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00e415b980 0x7f00e414b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00ea3be640 1 -- 172.21.15.172:0/1100686821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00e40cdb20 msgr2=0x7f00e4154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00e9bbd640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00e40cdb20 0x7f00e4154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00ea3be640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00e40cdb20 0x7f00e4154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00ea3be640 1 -- 172.21.15.172:0/1100686821 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e414d9f0 con 0x7f00e40cc4f0 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00ea3be640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e40cc4f0 0x7f00e40b0d40 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00ce00 tx=0x7f00dc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00daffd640 1 -- 172.21.15.172:0/1100686821 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00f890 con 0x7f00e40cc4f0 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00daffd640 1 -- 172.21.15.172:0/1100686821 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc00fa30 con 0x7f00e40cc4f0 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00ec622640 1 -- 172.21.15.172:0/1100686821 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e4157680 con 0x7f00e40cc4f0 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00daffd640 1 -- 172.21.15.172:0/1100686821 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00fe40 con 0x7f00e40cc4f0 2024-04-25T08:48:28.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.024+0000 7f00ec622640 1 -- 172.21.15.172:0/1100686821 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e4157c40 con 0x7f00e40cc4f0 2024-04-25T08:48:28.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.025+0000 7f00ec622640 1 -- 172.21.15.172:0/1100686821 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e4073a00 con 0x7f00e40cc4f0 2024-04-25T08:48:28.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.025+0000 7f00daffd640 1 -- 172.21.15.172:0/1100686821 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f00dc018400 con 0x7f00e40cc4f0 2024-04-25T08:48:28.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.026+0000 7f00daffd640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00c806b4d0 0x7f00c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.026+0000 7f00daffd640 1 -- 172.21.15.172:0/1100686821 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6129+0+0 (secure 0 0 0) 0x7f00dc08b150 con 0x7f00e40cc4f0 2024-04-25T08:48:28.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.026+0000 7f00e9bbd640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00c806b4d0 0x7f00c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.026+0000 7f00e9bbd640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00c806b4d0 0x7f00c806d990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f00e415b5b0 tx=0x7f00d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:28.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.030+0000 7f00daffd640 1 -- 172.21.15.172:0/1100686821 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f00dc014030 con 0x7f00e40cc4f0 2024-04-25T08:48:28.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.237+0000 7f00ec622640 1 -- 172.21.15.172:0/1100686821 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f00e4157fe0 con 0x7f00e40cc4f0 2024-04-25T08:48:28.229 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:48:28.238+0000 7f9412b2f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:48:28.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.239+0000 7f00daffd640 1 -- 172.21.15.172:0/1100686821 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) v1 ==== 161+0+0 (secure 0 0 0) 0x7f00dc00ae20 con 0x7f00e40cc4f0 2024-04-25T08:48:28.230 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:48:28.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 -- 172.21.15.172:0/1100686821 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00c806b4d0 msgr2=0x7f00c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:28.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00c806b4d0 0x7f00c806d990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f00e415b5b0 tx=0x7f00d4009040 comp rx=0 tx=0).stop 2024-04-25T08:48:28.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 -- 172.21.15.172:0/1100686821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e40cc4f0 msgr2=0x7f00e40b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:28.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e40cc4f0 0x7f00e40b0d40 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00ce00 tx=0x7f00dc00a650 comp rx=0 tx=0).stop 2024-04-25T08:48:28.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 -- 172.21.15.172:0/1100686821 shutdown_connections 2024-04-25T08:48:28.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00c806b4d0 0x7f00c806d990 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00e40cdb20 0x7f00e4154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00e415b980 0x7f00e414b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 --2- 172.21.15.172:0/1100686821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e40cc4f0 0x7f00e40b0d40 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 -- 172.21.15.172:0/1100686821 >> 172.21.15.172:0/1100686821 conn(0x7f00e406abe0 msgr2=0x7f00e40b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:28.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 -- 172.21.15.172:0/1100686821 shutdown_connections 2024-04-25T08:48:28.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.242+0000 7f00ec622640 1 -- 172.21.15.172:0/1100686821 wait complete. 2024-04-25T08:48:28.245 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:48:28.270 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:48:28.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.354+0000 7fed5ecab640 1 Processor -- start 2024-04-25T08:48:28.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.355+0000 7fed5ecab640 1 -- start start 2024-04-25T08:48:28.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.355+0000 7fed5ecab640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fed5815dc20 0x7fed580ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.355+0000 7fed5ecab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed58161710 0x7fed580cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.355+0000 7fed5ecab640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5815e000 con 0x7fed580b9330 2024-04-25T08:48:28.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.355+0000 7fed5ecab640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed580d1de0 con 0x7fed5815dc20 2024-04-25T08:48:28.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.355+0000 7fed5ecab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed58161c60 con 0x7fed58161710 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.355+0000 7fed5ca47640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fed5815dc20 0x7fed580ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.355+0000 7fed5ca47640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fed5815dc20 0x7fed580ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51234/0 (socket says 172.21.15.172:51234) 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.355+0000 7fed5d248640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fed580b9330 0x7fed5806bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60220/0 (socket says 172.21.15.172:60220) 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.355+0000 7fed5ca47640 1 -- 172.21.15.172:0/1902267942 learned_addr learned my addr 172.21.15.172:0/1902267942 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.356+0000 7fed57fff640 1 --2- 172.21.15.172:0/1902267942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed58161710 0x7fed580cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.356+0000 7fed5ca47640 1 -- 172.21.15.172:0/1902267942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed58161710 msgr2=0x7fed580cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.356+0000 7fed5ca47640 1 --2- 172.21.15.172:0/1902267942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed58161710 0x7fed580cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.356+0000 7fed5ca47640 1 -- 172.21.15.172:0/1902267942 >> v1:172.21.15.172:6789/0 conn(0x7fed580b9330 legacy=0x7fed5806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.356+0000 7fed5ca47640 1 -- 172.21.15.172:0/1902267942 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed58161f40 con 0x7fed5815dc20 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.356+0000 7fed577fe640 1 -- 172.21.15.172:0/1902267942 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273075848 0 0) 0x7fed5815e000 con 0x7fed580b9330 2024-04-25T08:48:28.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.356+0000 7fed57fff640 1 --2- 172.21.15.172:0/1902267942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed58161710 0x7fed580cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.356+0000 7fed5ca47640 1 --2- 172.21.15.172:0/1902267942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed5815dc20 0x7fed580ce670 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fed48009870 tx=0x7fed4802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70ab389e2fb536e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed577fe640 1 -- 172.21.15.172:0/1902267942 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48037070 con 0x7fed5815dc20 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed577fe640 1 -- 172.21.15.172:0/1902267942 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed48032440 con 0x7fed5815dc20 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed577fe640 1 -- 172.21.15.172:0/1902267942 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48032810 con 0x7fed5815dc20 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed5ecab640 1 -- 172.21.15.172:0/1902267942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed5815dc20 msgr2=0x7fed580ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed5ecab640 1 --2- 172.21.15.172:0/1902267942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed5815dc20 0x7fed580ce670 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fed48009870 tx=0x7fed4802a250 comp rx=0 tx=0).stop 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed5ecab640 1 -- 172.21.15.172:0/1902267942 shutdown_connections 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed5ecab640 1 --2- 172.21.15.172:0/1902267942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed58161710 0x7fed580cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed5ecab640 1 --2- 172.21.15.172:0/1902267942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed5815dc20 0x7fed580ce670 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed5ecab640 1 -- 172.21.15.172:0/1902267942 >> 172.21.15.172:0/1902267942 conn(0x7fed580d0420 msgr2=0x7fed580d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed5ecab640 1 -- 172.21.15.172:0/1902267942 shutdown_connections 2024-04-25T08:48:28.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.357+0000 7fed5ecab640 1 -- 172.21.15.172:0/1902267942 wait complete. 2024-04-25T08:48:28.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.358+0000 7fed5ecab640 1 Processor -- start 2024-04-25T08:48:28.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.358+0000 7fed5ecab640 1 -- start start 2024-04-25T08:48:28.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed5ecab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed580b9330 0x7fed5815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed5ecab640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed5815dc20 0x7fed580cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed5ecab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed58161710 0x7fed58160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed5ecab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580b5e50 con 0x7fed58161710 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed5ecab640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed58162500 con 0x7fed5815dc20 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed5ecab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed580b5fd0 con 0x7fed580b9330 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed5d248640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed58161710 0x7fed58160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed5d248640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed58161710 0x7fed58160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51246/0 (socket says 172.21.15.172:51246) 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed5d248640 1 -- 172.21.15.172:0/2038771183 learned_addr learned my addr 172.21.15.172:0/2038771183 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed5ca47640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed580b9330 0x7fed5815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.359+0000 7fed57fff640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed5815dc20 0x7fed580cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed5d248640 1 -- 172.21.15.172:0/2038771183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed580b9330 msgr2=0x7fed5815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed5d248640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed580b9330 0x7fed5815a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed5d248640 1 -- 172.21.15.172:0/2038771183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed5815dc20 msgr2=0x7fed580cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed5d248640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed5815dc20 0x7fed580cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed5d248640 1 -- 172.21.15.172:0/2038771183 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580cbcd0 con 0x7fed58161710 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed57fff640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed5815dc20 0x7fed580cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed5d248640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed58161710 0x7fed58160380 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fed5000c780 tx=0x7fed5000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed557fa640 1 -- 172.21.15.172:0/2038771183 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed50018070 con 0x7fed58161710 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed557fa640 1 -- 172.21.15.172:0/2038771183 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5000ce30 con 0x7fed58161710 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed5ecab640 1 -- 172.21.15.172:0/2038771183 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed580cbfb0 con 0x7fed58161710 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed557fa640 1 -- 172.21.15.172:0/2038771183 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5000a840 con 0x7fed58161710 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.360+0000 7fed5ecab640 1 -- 172.21.15.172:0/2038771183 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed580ccfd0 con 0x7fed58161710 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.361+0000 7fed5ecab640 1 -- 172.21.15.172:0/2038771183 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed58073a00 con 0x7fed58161710 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.361+0000 7fed557fa640 1 -- 172.21.15.172:0/2038771183 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed5001b070 con 0x7fed58161710 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.362+0000 7fed557fa640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed4406b4d0 0x7fed4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.362+0000 7fed557fa640 1 -- 172.21.15.172:0/2038771183 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fed50089950 con 0x7fed58161710 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.362+0000 7fed5ca47640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed4406b4d0 0x7fed4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:28.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.362+0000 7fed5ca47640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed4406b4d0 0x7fed4406d990 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fed48034000 tx=0x7fed4802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:28.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.366+0000 7fed557fa640 1 -- 172.21.15.172:0/2038771183 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed50058680 con 0x7fed58161710 2024-04-25T08:48:28.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:28.573+0000 7fed5ecab640 1 -- 172.21.15.172:0/2038771183 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fed580d16b0 con 0x7fed58161710 2024-04-25T08:48:29.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.241+0000 7fed557fa640 1 -- 172.21.15.172:0/2038771183 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7fed50057f80 con 0x7fed58161710 2024-04-25T08:48:29.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.243+0000 7fed5ecab640 1 -- 172.21.15.172:0/2038771183 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed4406b4d0 msgr2=0x7fed4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:29.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.243+0000 7fed5ecab640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed4406b4d0 0x7fed4406d990 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fed48034000 tx=0x7fed4802e000 comp rx=0 tx=0).stop 2024-04-25T08:48:29.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.243+0000 7fed5ecab640 1 -- 172.21.15.172:0/2038771183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed58161710 msgr2=0x7fed58160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:29.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.243+0000 7fed5ecab640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed58161710 0x7fed58160380 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fed5000c780 tx=0x7fed5000cc40 comp rx=0 tx=0).stop 2024-04-25T08:48:29.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.244+0000 7fed5ecab640 1 -- 172.21.15.172:0/2038771183 shutdown_connections 2024-04-25T08:48:29.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.244+0000 7fed5ecab640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fed4406b4d0 0x7fed4406d990 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:29.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.244+0000 7fed5ecab640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed5815dc20 0x7fed580cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:29.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.244+0000 7fed5ecab640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed58161710 0x7fed58160380 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:29.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.244+0000 7fed5ecab640 1 --2- 172.21.15.172:0/2038771183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fed580b9330 0x7fed5815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:29.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.244+0000 7fed5ecab640 1 -- 172.21.15.172:0/2038771183 >> 172.21.15.172:0/2038771183 conn(0x7fed580d0420 msgr2=0x7fed580b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:29.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.244+0000 7fed5ecab640 1 -- 172.21.15.172:0/2038771183 shutdown_connections 2024-04-25T08:48:29.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.244+0000 7fed5ecab640 1 -- 172.21.15.172:0/2038771183 wait complete. 2024-04-25T08:48:29.248 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:48:29.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.403+0000 7fbbb4bfe640 1 Processor -- start 2024-04-25T08:48:29.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.403+0000 7fbbb4bfe640 1 -- start start 2024-04-25T08:48:29.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.403+0000 7fbbb4bfe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbbb00ced80 0x7fbbb00d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:29.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.403+0000 7fbbb4bfe640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb015e000 con 0x7fbbb0161710 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.403+0000 7fbbb4bfe640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb00d1de0 con 0x7fbbb015dc20 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.403+0000 7fbbb4bfe640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb0161c60 con 0x7fbbb00ced80 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.404+0000 7fbba7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbbb00ced80 0x7fbbb00d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.404+0000 7fbbaed9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbbb0161710 0x7fbbb00d2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60232/0 (socket says 172.21.15.172:60232) 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.404+0000 7fbbaed9d640 1 -- 172.21.15.172:0/1156127290 learned_addr learned my addr 172.21.15.172:0/1156127290 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.404+0000 7fbba7fff640 1 -- 172.21.15.172:0/1156127290 >> v1:172.21.15.186:6789/0 conn(0x7fbbb015dc20 legacy=0x7fbbb00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.404+0000 7fbba7fff640 1 -- 172.21.15.172:0/1156127290 >> v1:172.21.15.172:6789/0 conn(0x7fbbb0161710 legacy=0x7fbbb00d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.404+0000 7fbba7fff640 1 -- 172.21.15.172:0/1156127290 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb0161f40 con 0x7fbbb00ced80 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.404+0000 7fbbadd9b640 1 -- 172.21.15.172:0/1156127290 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198293802 0 0) 0x7fbbb015e000 con 0x7fbbb0161710 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbba7fff640 1 --2- 172.21.15.172:0/1156127290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb00ced80 0x7fbbb00d22e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fbb980097a0 tx=0x7fbb9802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e77fae97428031 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbbadd9b640 1 -- 172.21.15.172:0/1156127290 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98037070 con 0x7fbbb00ced80 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbbadd9b640 1 -- 172.21.15.172:0/1156127290 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98032440 con 0x7fbbb00ced80 2024-04-25T08:48:29.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbbadd9b640 1 -- 172.21.15.172:0/1156127290 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98032810 con 0x7fbbb00ced80 2024-04-25T08:48:29.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/1156127290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb00ced80 msgr2=0x7fbbb00d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbbb4bfe640 1 --2- 172.21.15.172:0/1156127290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb00ced80 0x7fbbb00d22e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fbb980097a0 tx=0x7fbb9802a230 comp rx=0 tx=0).stop 2024-04-25T08:48:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/1156127290 shutdown_connections 2024-04-25T08:48:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbbb4bfe640 1 --2- 172.21.15.172:0/1156127290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb00ced80 0x7fbbb00d22e0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/1156127290 >> 172.21.15.172:0/1156127290 conn(0x7fbbb00d0420 msgr2=0x7fbbb00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/1156127290 shutdown_connections 2024-04-25T08:48:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.405+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/1156127290 wait complete. 2024-04-25T08:48:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbb4bfe640 1 Processor -- start 2024-04-25T08:48:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbb4bfe640 1 -- start start 2024-04-25T08:48:29.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbb4bfe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbb00ced80 0x7fbbb0154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:29.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbb4bfe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbb015dc20 0x7fbbb00c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:29.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbb4bfe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0161710 0x7fbbb015f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:29.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbb4bfe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00b5e50 con 0x7fbbb0161710 2024-04-25T08:48:29.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbb4bfe640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0162500 con 0x7fbbb00ced80 2024-04-25T08:48:29.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbb4bfe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00b5fd0 con 0x7fbbb015dc20 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbaed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0161710 0x7fbbb015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbaed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0161710 0x7fbbb015f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51250/0 (socket says 172.21.15.172:51250) 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.407+0000 7fbbaed9d640 1 -- 172.21.15.172:0/3657841743 learned_addr learned my addr 172.21.15.172:0/3657841743 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbbae59c640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbb00ced80 0x7fbbb0154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbba7fff640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbb015dc20 0x7fbbb00c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbbaed9d640 1 -- 172.21.15.172:0/3657841743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbb015dc20 msgr2=0x7fbbb00c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbbaed9d640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbb015dc20 0x7fbbb00c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbbaed9d640 1 -- 172.21.15.172:0/3657841743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbb00ced80 msgr2=0x7fbbb0154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbbaed9d640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbb00ced80 0x7fbbb0154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbbaed9d640 1 -- 172.21.15.172:0/3657841743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00c7c00 con 0x7fbbb0161710 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbbaed9d640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0161710 0x7fbbb015f870 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fbba800c800 tx=0x7fbba800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbba6ffd640 1 -- 172.21.15.172:0/3657841743 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8018070 con 0x7fbbb0161710 2024-04-25T08:48:29.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbba6ffd640 1 -- 172.21.15.172:0/3657841743 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba8004d80 con 0x7fbbb0161710 2024-04-25T08:48:29.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/3657841743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb00c7ee0 con 0x7fbbb0161710 2024-04-25T08:48:29.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbba6ffd640 1 -- 172.21.15.172:0/3657841743 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba800a880 con 0x7fbbb0161710 2024-04-25T08:48:29.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.408+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/3657841743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb00c8710 con 0x7fbbb0161710 2024-04-25T08:48:29.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.409+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/3657841743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb0073a00 con 0x7fbbb0161710 2024-04-25T08:48:29.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.410+0000 7fbba6ffd640 1 -- 172.21.15.172:0/3657841743 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbba801b070 con 0x7fbbb0161710 2024-04-25T08:48:29.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.410+0000 7fbba6ffd640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb9006b500 0x7fbb9006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:29.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.410+0000 7fbba6ffd640 1 -- 172.21.15.172:0/3657841743 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fbba8089810 con 0x7fbbb0161710 2024-04-25T08:48:29.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.410+0000 7fbbae59c640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb9006b500 0x7fbb9006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:29.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.410+0000 7fbbae59c640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb9006b500 0x7fbb9006d9c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000f60 tx=0x7fbba0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:29.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.414+0000 7fbba6ffd640 1 -- 172.21.15.172:0/3657841743 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbba8057fb0 con 0x7fbbb0161710 2024-04-25T08:48:29.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:29.585+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/3657841743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbbb015b590 con 0x7fbbb0161710 2024-04-25T08:48:30.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.326+0000 7fbba6ffd640 1 -- 172.21.15.172:0/3657841743 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v85) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbba805c050 con 0x7fbbb0161710 2024-04-25T08:48:30.318 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:48:30.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.329+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/3657841743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb9006b500 msgr2=0x7fbb9006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:30.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.329+0000 7fbbb4bfe640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb9006b500 0x7fbb9006d9c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000f60 tx=0x7fbba0009040 comp rx=0 tx=0).stop 2024-04-25T08:48:30.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.329+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/3657841743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0161710 msgr2=0x7fbbb015f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:30.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.329+0000 7fbbb4bfe640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0161710 0x7fbbb015f870 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fbba800c800 tx=0x7fbba800ccc0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.330+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/3657841743 shutdown_connections 2024-04-25T08:48:30.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.330+0000 7fbbb4bfe640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbb9006b500 0x7fbb9006d9c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.330+0000 7fbbb4bfe640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0161710 0x7fbbb015f870 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.330+0000 7fbbb4bfe640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbb015dc20 0x7fbbb00c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.330+0000 7fbbb4bfe640 1 --2- 172.21.15.172:0/3657841743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbb00ced80 0x7fbbb0154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.330+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/3657841743 >> 172.21.15.172:0/3657841743 conn(0x7fbbb00d0420 msgr2=0x7fbbb00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:30.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.330+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/3657841743 shutdown_connections 2024-04-25T08:48:30.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.330+0000 7fbbb4bfe640 1 -- 172.21.15.172:0/3657841743 wait complete. 2024-04-25T08:48:30.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:48:30.330 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:48:30.338 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:48:30.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.500+0000 7f6a937d5640 1 Processor -- start 2024-04-25T08:48:30.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.500+0000 7f6a937d5640 1 -- start start 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.501+0000 7f6a937d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6a8c0c6010 0x7f6a8c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.501+0000 7f6a937d5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6a8c0cd520 0x7f6a8c0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.501+0000 7f6a937d5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c0c6940 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.501+0000 7f6a937d5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0b0020 con 0x7f6a8c0c6010 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.501+0000 7f6a937d5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0cb5a0 con 0x7f6a8c0cd520 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.501+0000 7f6a90d70640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6a8c0c6010 0x7f6a8c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.501+0000 7f6a91571640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6a8c15a9f0 0x7f6a8c0cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60240/0 (socket says 172.21.15.172:60240) 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.501+0000 7f6a91571640 1 -- 172.21.15.172:0/246669128 learned_addr learned my addr 172.21.15.172:0/246669128 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.502+0000 7f6a90d70640 1 -- 172.21.15.172:0/246669128 >> v2:172.21.15.186:3300/0 conn(0x7f6a8c0cd520 msgr2=0x7f6a8c0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.502+0000 7f6a90d70640 1 --2- 172.21.15.172:0/246669128 >> v2:172.21.15.186:3300/0 conn(0x7f6a8c0cd520 0x7f6a8c0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.502+0000 7f6a90d70640 1 -- 172.21.15.172:0/246669128 >> v1:172.21.15.172:6789/0 conn(0x7f6a8c15a9f0 legacy=0x7f6a8c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.502+0000 7f6a83fff640 1 -- 172.21.15.172:0/246669128 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569103829 0 0) 0x7f6a7c001110 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.502+0000 7f6a90d70640 1 -- 172.21.15.172:0/246669128 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c15add0 con 0x7f6a8c0c6010 2024-04-25T08:48:30.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.502+0000 7f6a90d70640 1 --2- 172.21.15.172:0/246669128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c0c6010 0x7f6a8c0ccfe0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0afd90 tx=0x7f6a8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe02ecb06c33c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:30.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.502+0000 7f6a83fff640 1 -- 172.21.15.172:0/246669128 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88037070 con 0x7f6a8c0c6010 2024-04-25T08:48:30.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.503+0000 7f6a83fff640 1 -- 172.21.15.172:0/246669128 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88032440 con 0x7f6a8c0c6010 2024-04-25T08:48:30.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.503+0000 7f6a83fff640 1 -- 172.21.15.172:0/246669128 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88032810 con 0x7f6a8c0c6010 2024-04-25T08:48:30.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.503+0000 7f6a937d5640 1 -- 172.21.15.172:0/246669128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c0c6010 msgr2=0x7f6a8c0ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:30.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.503+0000 7f6a937d5640 1 --2- 172.21.15.172:0/246669128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c0c6010 0x7f6a8c0ccfe0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0afd90 tx=0x7f6a8802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.503+0000 7f6a937d5640 1 -- 172.21.15.172:0/246669128 shutdown_connections 2024-04-25T08:48:30.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.503+0000 7f6a937d5640 1 --2- 172.21.15.172:0/246669128 >> v2:172.21.15.186:3300/0 conn(0x7f6a8c0cd520 0x7f6a8c0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.503+0000 7f6a937d5640 1 --2- 172.21.15.172:0/246669128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c0c6010 0x7f6a8c0ccfe0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.503+0000 7f6a937d5640 1 -- 172.21.15.172:0/246669128 >> 172.21.15.172:0/246669128 conn(0x7f6a8c0b2390 msgr2=0x7f6a8c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:30.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.503+0000 7f6a937d5640 1 -- 172.21.15.172:0/246669128 shutdown_connections 2024-04-25T08:48:30.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.503+0000 7f6a937d5640 1 -- 172.21.15.172:0/246669128 wait complete. 2024-04-25T08:48:30.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.504+0000 7f6a937d5640 1 Processor -- start 2024-04-25T08:48:30.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.504+0000 7f6a937d5640 1 -- start start 2024-04-25T08:48:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a937d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a8c0c6010 0x7f6a8c0c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a937d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a8c0cd520 0x7f6a8c14c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a937d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c15a9f0 0x7f6a8c14f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a937d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0cb230 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a937d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0caf50 con 0x7f6a8c0c6010 2024-04-25T08:48:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a937d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0cbf70 con 0x7f6a8c0cd520 2024-04-25T08:48:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a91d72640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c15a9f0 0x7f6a8c14f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a91d72640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c15a9f0 0x7f6a8c14f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51270/0 (socket says 172.21.15.172:51270) 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a91d72640 1 -- 172.21.15.172:0/2919575707 learned_addr learned my addr 172.21.15.172:0/2919575707 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a91571640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a8c0c6010 0x7f6a8c0c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a90d70640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a8c0cd520 0x7f6a8c14c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a91d72640 1 -- 172.21.15.172:0/2919575707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a8c0cd520 msgr2=0x7f6a8c14c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a91d72640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a8c0cd520 0x7f6a8c14c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a91d72640 1 -- 172.21.15.172:0/2919575707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a8c0c6010 msgr2=0x7f6a8c0c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a91d72640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a8c0c6010 0x7f6a8c0c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a91d72640 1 -- 172.21.15.172:0/2919575707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c14c540 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.505+0000 7f6a91571640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a8c0c6010 0x7f6a8c0c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.506+0000 7f6a91d72640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c15a9f0 0x7f6a8c14f2a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400b970 tx=0x7f6a8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.506+0000 7f6a81ffb640 1 -- 172.21.15.172:0/2919575707 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84019070 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.506+0000 7f6a81ffb640 1 -- 172.21.15.172:0/2919575707 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8400cb60 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.506+0000 7f6a81ffb640 1 -- 172.21.15.172:0/2919575707 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84014440 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.506+0000 7f6a937d5640 1 -- 172.21.15.172:0/2919575707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c14f7e0 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.506+0000 7f6a937d5640 1 -- 172.21.15.172:0/2919575707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c14ccd0 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.507+0000 7f6a937d5640 1 -- 172.21.15.172:0/2919575707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c06cc80 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.507+0000 7f6a81ffb640 1 -- 172.21.15.172:0/2919575707 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a8401c070 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.508+0000 7f6a81ffb640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6a7006b500 0x7f6a7006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:30.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.508+0000 7f6a81ffb640 1 -- 172.21.15.172:0/2919575707 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5749+0+0 (secure 0 0 0) 0x7f6a84089e80 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.508+0000 7f6a91571640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6a7006b500 0x7f6a7006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:30.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.508+0000 7f6a91571640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6a7006b500 0x7f6a7006d9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c000f60 tx=0x7f6a7c007cc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:30.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.512+0000 7f6a81ffb640 1 -- 172.21.15.172:0/2919575707 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a84058680 con 0x7f6a8c15a9f0 2024-04-25T08:48:30.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:30.685+0000 7f6a937d5640 1 -- 172.21.15.172:0/2919575707 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a8c073a00 con 0x7f6a8c15a9f0 2024-04-25T08:48:31.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.338+0000 7f6a81ffb640 1 -- 172.21.15.172:0/2919575707 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v86) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6a8405c720 con 0x7f6a8c15a9f0 2024-04-25T08:48:31.330 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2024-04-25T08:48:31.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 -- 172.21.15.172:0/2919575707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6a7006b500 msgr2=0x7f6a7006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6a7006b500 0x7f6a7006d9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c000f60 tx=0x7f6a7c007cc0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 -- 172.21.15.172:0/2919575707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c15a9f0 msgr2=0x7f6a8c14f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c15a9f0 0x7f6a8c14f2a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400b970 tx=0x7f6a8400be30 comp rx=0 tx=0).stop 2024-04-25T08:48:31.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 -- 172.21.15.172:0/2919575707 shutdown_connections 2024-04-25T08:48:31.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6a7006b500 0x7f6a7006d9c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a8c15a9f0 0x7f6a8c14f2a0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a8c0cd520 0x7f6a8c14c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 --2- 172.21.15.172:0/2919575707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a8c0c6010 0x7f6a8c0c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 -- 172.21.15.172:0/2919575707 >> 172.21.15.172:0/2919575707 conn(0x7f6a8c0b2390 msgr2=0x7f6a8c159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:31.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 -- 172.21.15.172:0/2919575707 shutdown_connections 2024-04-25T08:48:31.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.341+0000 7f6a937d5640 1 -- 172.21.15.172:0/2919575707 wait complete. 2024-04-25T08:48:31.348 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:48:31.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.460+0000 7f26b46b3640 1 Processor -- start 2024-04-25T08:48:31.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.460+0000 7f26b46b3640 1 -- start start 2024-04-25T08:48:31.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b46b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26ac15dd80 0x7f26ac0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b46b3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f26ac0ad570 0x7f26ac06ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b46b3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ac0b3930 con 0x7f26ac06abe0 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b46b3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ac06e410 con 0x7f26ac0ad570 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b46b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b3c10 con 0x7f26ac15dd80 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b2c50640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f26ac0ad570 0x7f26ac06ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b2c50640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f26ac0ad570 0x7f26ac06ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51284/0 (socket says 172.21.15.172:51284) 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b2c50640 1 -- 172.21.15.172:0/1651566556 learned_addr learned my addr 172.21.15.172:0/1651566556 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b1c4e640 1 --2- 172.21.15.172:0/1651566556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26ac15dd80 0x7f26ac0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b2c50640 1 -- 172.21.15.172:0/1651566556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26ac15dd80 msgr2=0x7f26ac0b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b2c50640 1 --2- 172.21.15.172:0/1651566556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26ac15dd80 0x7f26ac0b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b2c50640 1 -- 172.21.15.172:0/1651566556 >> v1:172.21.15.186:6789/0 conn(0x7f26ac06abe0 legacy=0x7f26ac06afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.461+0000 7f26b2c50640 1 -- 172.21.15.172:0/1651566556 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac06e660 con 0x7f26ac0ad570 2024-04-25T08:48:31.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.462+0000 7f26b2c50640 1 --2- 172.21.15.172:0/1651566556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 0x7f26ac06ee60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009e50 tx=0x7f26a402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809a02387ba99ba4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:31.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.462+0000 7f26b144d640 1 -- 172.21.15.172:0/1651566556 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4036070 con 0x7f26ac0ad570 2024-04-25T08:48:31.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.462+0000 7f26b144d640 1 -- 172.21.15.172:0/1651566556 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4031600 con 0x7f26ac0ad570 2024-04-25T08:48:31.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.462+0000 7f26b144d640 1 -- 172.21.15.172:0/1651566556 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40319d0 con 0x7f26ac0ad570 2024-04-25T08:48:31.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.463+0000 7f26b46b3640 1 -- 172.21.15.172:0/1651566556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 msgr2=0x7f26ac06ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.463+0000 7f26b46b3640 1 --2- 172.21.15.172:0/1651566556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 0x7f26ac06ee60 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009e50 tx=0x7f26a402a710 comp rx=0 tx=0).stop 2024-04-25T08:48:31.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.463+0000 7f26b46b3640 1 -- 172.21.15.172:0/1651566556 shutdown_connections 2024-04-25T08:48:31.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.463+0000 7f26b46b3640 1 --2- 172.21.15.172:0/1651566556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 0x7f26ac06ee60 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.463+0000 7f26b46b3640 1 --2- 172.21.15.172:0/1651566556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26ac15dd80 0x7f26ac0b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.463+0000 7f26b46b3640 1 -- 172.21.15.172:0/1651566556 >> 172.21.15.172:0/1651566556 conn(0x7f26ac0b5af0 msgr2=0x7f26ac0b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:31.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.463+0000 7f26b46b3640 1 -- 172.21.15.172:0/1651566556 shutdown_connections 2024-04-25T08:48:31.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.463+0000 7f26b46b3640 1 -- 172.21.15.172:0/1651566556 wait complete. 2024-04-25T08:48:31.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.464+0000 7f26b46b3640 1 Processor -- start 2024-04-25T08:48:31.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.464+0000 7f26b46b3640 1 -- start start 2024-04-25T08:48:31.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b46b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26ac06abe0 0x7f26ac156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b46b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 0x7f26ac1601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b46b3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26ac15dd80 0x7f26ac160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b46b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac070280 con 0x7f26ac0ad570 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b46b3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b57d0 con 0x7f26ac15dd80 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b46b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac070400 con 0x7f26ac06abe0 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b1c4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 0x7f26ac1601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b1c4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 0x7f26ac1601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51290/0 (socket says 172.21.15.172:51290) 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b1c4e640 1 -- 172.21.15.172:0/872104765 learned_addr learned my addr 172.21.15.172:0/872104765 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b2c50640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26ac15dd80 0x7f26ac160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b244f640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26ac06abe0 0x7f26ac156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b1c4e640 1 -- 172.21.15.172:0/872104765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26ac06abe0 msgr2=0x7f26ac156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b1c4e640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26ac06abe0 0x7f26ac156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b1c4e640 1 -- 172.21.15.172:0/872104765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26ac15dd80 msgr2=0x7f26ac160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b1c4e640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26ac15dd80 0x7f26ac160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b1c4e640 1 -- 172.21.15.172:0/872104765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac1578f0 con 0x7f26ac0ad570 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b2c50640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26ac15dd80 0x7f26ac160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b1c4e640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 0x7f26ac1601c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f269c00d5c0 tx=0x7f269c00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26a2ffd640 1 -- 172.21.15.172:0/872104765 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c0125f0 con 0x7f26ac0ad570 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26a2ffd640 1 -- 172.21.15.172:0/872104765 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c019070 con 0x7f26ac0ad570 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.465+0000 7f26b46b3640 1 -- 172.21.15.172:0/872104765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac09be00 con 0x7f26ac0ad570 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.466+0000 7f26a2ffd640 1 -- 172.21.15.172:0/872104765 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c0129d0 con 0x7f26ac0ad570 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.466+0000 7f26b46b3640 1 -- 172.21.15.172:0/872104765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac09c3c0 con 0x7f26ac0ad570 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.466+0000 7f26b46b3640 1 -- 172.21.15.172:0/872104765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ac073a00 con 0x7f26ac0ad570 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.467+0000 7f26a2ffd640 1 -- 172.21.15.172:0/872104765 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f269c012b70 con 0x7f26ac0ad570 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.467+0000 7f26a2ffd640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f269006b500 0x7f269006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.467+0000 7f26a2ffd640 1 -- 172.21.15.172:0/872104765 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f269c08a450 con 0x7f26ac0ad570 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.467+0000 7f26b244f640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f269006b500 0x7f269006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.468+0000 7f26b244f640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f269006b500 0x7f269006d9c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f26a8001640 tx=0x7f26a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:31.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.471+0000 7f26a2ffd640 1 -- 172.21.15.172:0/872104765 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f269c059440 con 0x7f26ac0ad570 2024-04-25T08:48:31.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.653+0000 7f26b46b3640 1 -- 172.21.15.172:0/872104765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f26ac0ade10 con 0x7f26ac0ad570 2024-04-25T08:48:31.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.656+0000 7f26a2ffd640 1 -- 172.21.15.172:0/872104765 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f269c058d40 con 0x7f26ac0ad570 2024-04-25T08:48:31.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 -- 172.21.15.172:0/872104765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f269006b500 msgr2=0x7f269006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f269006b500 0x7f269006d9c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f26a8001640 tx=0x7f26a8009040 comp rx=0 tx=0).stop 2024-04-25T08:48:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 -- 172.21.15.172:0/872104765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 msgr2=0x7f26ac1601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 0x7f26ac1601c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f269c00d5c0 tx=0x7f269c00da80 comp rx=0 tx=0).stop 2024-04-25T08:48:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 -- 172.21.15.172:0/872104765 shutdown_connections 2024-04-25T08:48:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f269006b500 0x7f269006d9c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26ac15dd80 0x7f26ac160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26ac0ad570 0x7f26ac1601c0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 --2- 172.21.15.172:0/872104765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26ac06abe0 0x7f26ac156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 -- 172.21.15.172:0/872104765 >> 172.21.15.172:0/872104765 conn(0x7f26ac0b5af0 msgr2=0x7f26ac0af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 -- 172.21.15.172:0/872104765 shutdown_connections 2024-04-25T08:48:31.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.658+0000 7f26b46b3640 1 -- 172.21.15.172:0/872104765 wait complete. 2024-04-25T08:48:31.660 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-04-25T08:48:31.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.767+0000 7f8683422640 1 Processor -- start 2024-04-25T08:48:31.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.767+0000 7f8683422640 1 -- start start 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f8683422640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c15b980 0x7f867c0cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f8683422640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f867c0cffb0 0x7f867c15c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f8683422640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c15f710 con 0x7f867c06b5f0 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f8683422640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c15f9b0 con 0x7f867c0cffb0 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f8683422640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c15fc90 con 0x7f867c15b980 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f86819bf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f867c0cffb0 0x7f867c15c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f86809bd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f867c06b5f0 0x7f867c0cf8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60256/0 (socket says 172.21.15.172:60256) 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f86809bd640 1 -- 172.21.15.172:0/3121680591 learned_addr learned my addr 172.21.15.172:0/3121680591 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f86811be640 1 --2- 172.21.15.172:0/3121680591 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c15b980 0x7f867c0cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f86819bf640 1 -- 172.21.15.172:0/3121680591 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c15b980 msgr2=0x7f867c0cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f86819bf640 1 --2- 172.21.15.172:0/3121680591 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c15b980 0x7f867c0cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f8673fff640 1 -- 172.21.15.172:0/3121680591 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655995990 0 0) 0x7f867c15f710 con 0x7f867c06b5f0 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.768+0000 7f86819bf640 1 -- 172.21.15.172:0/3121680591 >> v1:172.21.15.172:6789/0 conn(0x7f867c06b5f0 legacy=0x7f867c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.769+0000 7f86819bf640 1 -- 172.21.15.172:0/3121680591 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c15ff70 con 0x7f867c0cffb0 2024-04-25T08:48:31.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.769+0000 7f86811be640 1 --2- 172.21.15.172:0/3121680591 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c15b980 0x7f867c0cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:31.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.769+0000 7f86819bf640 1 --2- 172.21.15.172:0/3121680591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c0cffb0 0x7f867c15c0f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f86740097a0 tx=0x7f867402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2dc22e9b9baf49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:31.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.769+0000 7f8673fff640 1 -- 172.21.15.172:0/3121680591 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674037070 con 0x7f867c0cffb0 2024-04-25T08:48:31.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.769+0000 7f8673fff640 1 -- 172.21.15.172:0/3121680591 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674032440 con 0x7f867c0cffb0 2024-04-25T08:48:31.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.769+0000 7f8673fff640 1 -- 172.21.15.172:0/3121680591 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674032810 con 0x7f867c0cffb0 2024-04-25T08:48:31.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.770+0000 7f8683422640 1 -- 172.21.15.172:0/3121680591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c0cffb0 msgr2=0x7f867c15c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.770+0000 7f8683422640 1 --2- 172.21.15.172:0/3121680591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c0cffb0 0x7f867c15c0f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f86740097a0 tx=0x7f867402a180 comp rx=0 tx=0).stop 2024-04-25T08:48:31.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.770+0000 7f8683422640 1 -- 172.21.15.172:0/3121680591 shutdown_connections 2024-04-25T08:48:31.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.770+0000 7f8683422640 1 --2- 172.21.15.172:0/3121680591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c0cffb0 0x7f867c15c0f0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.770+0000 7f8683422640 1 --2- 172.21.15.172:0/3121680591 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c15b980 0x7f867c0cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.770+0000 7f8683422640 1 -- 172.21.15.172:0/3121680591 >> 172.21.15.172:0/3121680591 conn(0x7f867c0b2220 msgr2=0x7f867c0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:31.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.770+0000 7f8683422640 1 -- 172.21.15.172:0/3121680591 shutdown_connections 2024-04-25T08:48:31.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.770+0000 7f8683422640 1 -- 172.21.15.172:0/3121680591 wait complete. 2024-04-25T08:48:31.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.771+0000 7f8683422640 1 Processor -- start 2024-04-25T08:48:31.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.771+0000 7f8683422640 1 -- start start 2024-04-25T08:48:31.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f8683422640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c06b5f0 0x7f867c151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f8683422640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f867c0cffb0 0x7f867c1f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f8683422640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c15b980 0x7f867c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f8683422640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0cf550 con 0x7f867c15b980 2024-04-25T08:48:31.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f8683422640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c15bd60 con 0x7f867c0cffb0 2024-04-25T08:48:31.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f8683422640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0b2d40 con 0x7f867c06b5f0 2024-04-25T08:48:31.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86819bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c15b980 0x7f867c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86819bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c15b980 0x7f867c0c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51298/0 (socket says 172.21.15.172:51298) 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86819bf640 1 -- 172.21.15.172:0/3667245307 learned_addr learned my addr 172.21.15.172:0/3667245307 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86809bd640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f867c0cffb0 0x7f867c1f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86811be640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c06b5f0 0x7f867c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86819bf640 1 -- 172.21.15.172:0/3667245307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c06b5f0 msgr2=0x7f867c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86819bf640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c06b5f0 0x7f867c151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86819bf640 1 -- 172.21.15.172:0/3667245307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f867c0cffb0 msgr2=0x7f867c1f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86819bf640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f867c0cffb0 0x7f867c1f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86819bf640 1 -- 172.21.15.172:0/3667245307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c1f5cf0 con 0x7f867c15b980 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86811be640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c06b5f0 0x7f867c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.772+0000 7f86819bf640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c15b980 0x7f867c0c80f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f86740097a0 tx=0x7f86740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.773+0000 7f8671ffb640 1 -- 172.21.15.172:0/3667245307 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674037040 con 0x7f867c15b980 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.773+0000 7f8671ffb640 1 -- 172.21.15.172:0/3667245307 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674042070 con 0x7f867c15b980 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.773+0000 7f8683422640 1 -- 172.21.15.172:0/3667245307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c1f5fd0 con 0x7f867c15b980 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.773+0000 7f8671ffb640 1 -- 172.21.15.172:0/3667245307 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674030b30 con 0x7f867c15b980 2024-04-25T08:48:31.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.773+0000 7f8683422640 1 -- 172.21.15.172:0/3667245307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c151eb0 con 0x7f867c15b980 2024-04-25T08:48:31.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.774+0000 7f8683422640 1 -- 172.21.15.172:0/3667245307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c0cc660 con 0x7f867c15b980 2024-04-25T08:48:31.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.774+0000 7f8671ffb640 1 -- 172.21.15.172:0/3667245307 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8674030cd0 con 0x7f867c15b980 2024-04-25T08:48:31.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.775+0000 7f8671ffb640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f866006b4d0 0x7f866006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:31.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.775+0000 7f86811be640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f866006b4d0 0x7f866006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:31.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.775+0000 7f8671ffb640 1 -- 172.21.15.172:0/3667245307 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f86740aabb0 con 0x7f867c15b980 2024-04-25T08:48:31.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.775+0000 7f86811be640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f866006b4d0 0x7f866006d990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f867800e3d0 tx=0x7f8678007a10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:31.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:31.779+0000 7f8671ffb640 1 -- 172.21.15.172:0/3667245307 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f867c0cc660 con 0x7f867c15b980 2024-04-25T08:48:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.014+0000 7f8683422640 1 -- 172.21.15.172:0/3667245307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7f867c073990 con 0x7f867c15b980 2024-04-25T08:48:32.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.340+0000 7f8671ffb640 1 -- 172.21.15.172:0/3667245307 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v300) v1 ==== 158+0+0 (secure 0 0 0) 0x7f8674079c30 con 0x7f867c15b980 2024-04-25T08:48:32.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 -- 172.21.15.172:0/3667245307 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f866006b4d0 msgr2=0x7f866006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f866006b4d0 0x7f866006d990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f867800e3d0 tx=0x7f8678007a10 comp rx=0 tx=0).stop 2024-04-25T08:48:32.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 -- 172.21.15.172:0/3667245307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c15b980 msgr2=0x7f867c0c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c15b980 0x7f867c0c80f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f86740097a0 tx=0x7f86740046c0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 -- 172.21.15.172:0/3667245307 shutdown_connections 2024-04-25T08:48:32.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f866006b4d0 0x7f866006d990 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f867c0cffb0 0x7f867c1f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f867c15b980 0x7f867c0c80f0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 --2- 172.21.15.172:0/3667245307 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f867c06b5f0 0x7f867c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 -- 172.21.15.172:0/3667245307 >> 172.21.15.172:0/3667245307 conn(0x7f867c0b2220 msgr2=0x7f867c159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:32.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 -- 172.21.15.172:0/3667245307 shutdown_connections 2024-04-25T08:48:32.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.342+0000 7f8683422640 1 -- 172.21.15.172:0/3667245307 wait complete. 2024-04-25T08:48:32.385 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-04-25T08:48:32.385 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T08:48:32.386 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:48:32.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.492+0000 7f6ff6b3b640 1 Processor -- start 2024-04-25T08:48:32.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.492+0000 7f6ff6b3b640 1 -- start start 2024-04-25T08:48:32.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.493+0000 7f6ff6b3b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6ff009a150 0x7f6ff00cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.493+0000 7f6ff6b3b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff00cc3c0 con 0x7f6ff00b0b90 2024-04-25T08:48:32.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.493+0000 7f6ff6b3b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff015f400 con 0x7f6ff015f020 2024-04-25T08:48:32.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.493+0000 7f6ff6b3b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff00cccb0 con 0x7f6ff009a150 2024-04-25T08:48:32.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.493+0000 7f6ff50d8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6ff009a150 0x7f6ff00cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.493+0000 7f6feffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6ff00b0b90 0x7f6ff0099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60270/0 (socket says 172.21.15.172:60270) 2024-04-25T08:48:32.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.493+0000 7f6ff50d8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6ff009a150 0x7f6ff00cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51310/0 (socket says 172.21.15.172:51310) 2024-04-25T08:48:32.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.493+0000 7f6feffff640 1 -- 172.21.15.172:0/2095459695 learned_addr learned my addr 172.21.15.172:0/2095459695 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:32.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.494+0000 7f6ff50d8640 1 -- 172.21.15.172:0/2095459695 >> v1:172.21.15.186:6789/0 conn(0x7f6ff015f020 legacy=0x7f6ff00b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:32.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.494+0000 7f6ff50d8640 1 -- 172.21.15.172:0/2095459695 >> v1:172.21.15.172:6789/0 conn(0x7f6ff00b0b90 legacy=0x7f6ff0099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.494+0000 7f6ff50d8640 1 -- 172.21.15.172:0/2095459695 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff00d0550 con 0x7f6ff009a150 2024-04-25T08:48:32.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.494+0000 7f6fef7fe640 1 -- 172.21.15.172:0/2095459695 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696927768 0 0) 0x7f6ff00cc3c0 con 0x7f6ff00b0b90 2024-04-25T08:48:32.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.494+0000 7f6ff50d8640 1 --2- 172.21.15.172:0/2095459695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 0x7f6ff00cfe00 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009d90 tx=0x7f6fe802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeec8b501baf44a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:32.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.495+0000 7f6fef7fe640 1 -- 172.21.15.172:0/2095459695 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8007740 con 0x7f6ff009a150 2024-04-25T08:48:32.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.495+0000 7f6fef7fe640 1 -- 172.21.15.172:0/2095459695 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe80078e0 con 0x7f6ff009a150 2024-04-25T08:48:32.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.495+0000 7f6fef7fe640 1 -- 172.21.15.172:0/2095459695 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8007cb0 con 0x7f6ff009a150 2024-04-25T08:48:32.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.495+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/2095459695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 msgr2=0x7f6ff00cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.495+0000 7f6ff6b3b640 1 --2- 172.21.15.172:0/2095459695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 0x7f6ff00cfe00 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009d90 tx=0x7f6fe802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.495+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/2095459695 shutdown_connections 2024-04-25T08:48:32.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.495+0000 7f6ff6b3b640 1 --2- 172.21.15.172:0/2095459695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 0x7f6ff00cfe00 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.495+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/2095459695 >> 172.21.15.172:0/2095459695 conn(0x7f6ff00b3310 msgr2=0x7f6ff00b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:32.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.495+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/2095459695 shutdown_connections 2024-04-25T08:48:32.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.495+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/2095459695 wait complete. 2024-04-25T08:48:32.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.496+0000 7f6ff6b3b640 1 Processor -- start 2024-04-25T08:48:32.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.496+0000 7f6ff6b3b640 1 -- start start 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6ff6b3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 0x7f6ff015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6ff6b3b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff00b0b90 0x7f6ff006f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6ff6b3b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff015f020 0x7f6ff01543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6ff6b3b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00cc940 con 0x7f6ff009a150 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6ff6b3b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00cc660 con 0x7f6ff015f020 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6ff6b3b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff00cd140 con 0x7f6ff00b0b90 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6ff48d7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 0x7f6ff015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6ff48d7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 0x7f6ff015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51320/0 (socket says 172.21.15.172:51320) 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6ff48d7640 1 -- 172.21.15.172:0/3646306558 learned_addr learned my addr 172.21.15.172:0/3646306558 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6ff50d8640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff015f020 0x7f6ff01543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.497+0000 7f6feffff640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff00b0b90 0x7f6ff006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6ff48d7640 1 -- 172.21.15.172:0/3646306558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff00b0b90 msgr2=0x7f6ff006f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6ff48d7640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff00b0b90 0x7f6ff006f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6ff48d7640 1 -- 172.21.15.172:0/3646306558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff015f020 msgr2=0x7f6ff01543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6ff48d7640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff015f020 0x7f6ff01543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6ff48d7640 1 -- 172.21.15.172:0/3646306558 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff015b750 con 0x7f6ff009a150 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6ff50d8640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff015f020 0x7f6ff01543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6ff48d7640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 0x7f6ff015ae70 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400b3f0 tx=0x7f6fe400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6fed7fa640 1 -- 172.21.15.172:0/3646306558 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4015020 con 0x7f6ff009a150 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6fed7fa640 1 -- 172.21.15.172:0/3646306558 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4011830 con 0x7f6ff009a150 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/3646306558 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff015ba30 con 0x7f6ff009a150 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6fed7fa640 1 -- 172.21.15.172:0/3646306558 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4011c20 con 0x7f6ff009a150 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.498+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/3646306558 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff015bff0 con 0x7f6ff009a150 2024-04-25T08:48:32.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.499+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/3646306558 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff0073990 con 0x7f6ff009a150 2024-04-25T08:48:32.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.499+0000 7f6fed7fa640 1 -- 172.21.15.172:0/3646306558 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fe4018020 con 0x7f6ff009a150 2024-04-25T08:48:32.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.500+0000 7f6fed7fa640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fd406b500 0x7f6fd406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.500+0000 7f6fed7fa640 1 -- 172.21.15.172:0/3646306558 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6fe4089d50 con 0x7f6ff009a150 2024-04-25T08:48:32.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.500+0000 7f6feffff640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fd406b500 0x7f6fd406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.500+0000 7f6feffff640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fd406b500 0x7f6fd406d9c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6ff015de70 tx=0x7f6fdc007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:32.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.504+0000 7f6fed7fa640 1 -- 172.21.15.172:0/3646306558 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6fe408d030 con 0x7f6ff009a150 2024-04-25T08:48:32.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.677+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/3646306558 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ff00b0410 con 0x7f6ff009a150 2024-04-25T08:48:32.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.677+0000 7f6fed7fa640 1 -- 172.21.15.172:0/3646306558 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+13356 (secure 0 0 0) 0x7f6fe401f030 con 0x7f6ff009a150 2024-04-25T08:48:32.668 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:32.669 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":86,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:31.333554+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6837/1878763904":"2024-04-26T08:48:28.238974+0000","172.21.15.172:6835/1878763904":"2024-04-26T08:48:28.238974+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.679+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/3646306558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fd406b500 msgr2=0x7f6fd406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.679+0000 7f6ff6b3b640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fd406b500 0x7f6fd406d9c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6ff015de70 tx=0x7f6fdc007b50 comp rx=0 tx=0).stop 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.679+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/3646306558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 msgr2=0x7f6ff015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.679+0000 7f6ff6b3b640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 0x7f6ff015ae70 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400b3f0 tx=0x7f6fe400b8b0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.679+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/3646306558 shutdown_connections 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.679+0000 7f6ff6b3b640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6fd406b500 0x7f6fd406d9c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.679+0000 7f6ff6b3b640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ff015f020 0x7f6ff01543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.679+0000 7f6ff6b3b640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ff00b0b90 0x7f6ff006f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.679+0000 7f6ff6b3b640 1 --2- 172.21.15.172:0/3646306558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff009a150 0x7f6ff015ae70 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.680+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/3646306558 >> 172.21.15.172:0/3646306558 conn(0x7f6ff00b3310 msgr2=0x7f6ff00cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.680+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/3646306558 shutdown_connections 2024-04-25T08:48:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.680+0000 7f6ff6b3b640 1 -- 172.21.15.172:0/3646306558 wait complete. 2024-04-25T08:48:32.682 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:48:32.682 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:48:32.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.791+0000 7f682d109640 1 Processor -- start 2024-04-25T08:48:32.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.791+0000 7f682d109640 1 -- start start 2024-04-25T08:48:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.792+0000 7f682d109640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f682815dc20 0x7f68280ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.792+0000 7f682d109640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f68280d32f0 0x7f68280cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.792+0000 7f682d109640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682815e000 con 0x7f6828161710 2024-04-25T08:48:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.792+0000 7f682d109640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68280d1de0 con 0x7f682815dc20 2024-04-25T08:48:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.792+0000 7f682d109640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6828161c60 con 0x7f68280d32f0 2024-04-25T08:48:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.792+0000 7f6826d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f682815dc20 0x7f68280ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.792+0000 7f682659c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6828161710 0x7f682806bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60284/0 (socket says 172.21.15.172:60284) 2024-04-25T08:48:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.792+0000 7f6826d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f682815dc20 0x7f68280ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51324/0 (socket says 172.21.15.172:51324) 2024-04-25T08:48:32.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.792+0000 7f682659c640 1 -- 172.21.15.172:0/2149008664 learned_addr learned my addr 172.21.15.172:0/2149008664 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:32.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.793+0000 7f682759e640 1 --2- 172.21.15.172:0/2149008664 >> v2:172.21.15.186:3300/0 conn(0x7f68280d32f0 0x7f68280cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.793+0000 7f6826d9d640 1 -- 172.21.15.172:0/2149008664 >> v2:172.21.15.186:3300/0 conn(0x7f68280d32f0 msgr2=0x7f68280cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:32.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.793+0000 7f6826d9d640 1 --2- 172.21.15.172:0/2149008664 >> v2:172.21.15.186:3300/0 conn(0x7f68280d32f0 0x7f68280cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.793+0000 7f6826d9d640 1 -- 172.21.15.172:0/2149008664 >> v1:172.21.15.172:6789/0 conn(0x7f6828161710 legacy=0x7f682806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.793+0000 7f6825d9b640 1 -- 172.21.15.172:0/2149008664 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698548783 0 0) 0x7f682815e000 con 0x7f6828161710 2024-04-25T08:48:32.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.793+0000 7f6826d9d640 1 -- 172.21.15.172:0/2149008664 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6828161f40 con 0x7f682815dc20 2024-04-25T08:48:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.793+0000 7f6826d9d640 1 --2- 172.21.15.172:0/2149008664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 0x7f68280ce670 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f68280b6910 tx=0x7f681802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41eed739c72ded59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:32.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.793+0000 7f6825d9b640 1 -- 172.21.15.172:0/2149008664 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818007740 con 0x7f682815dc20 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.793+0000 7f6825d9b640 1 -- 172.21.15.172:0/2149008664 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68180078e0 con 0x7f682815dc20 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.794+0000 7f6825d9b640 1 -- 172.21.15.172:0/2149008664 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818007cb0 con 0x7f682815dc20 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.794+0000 7f682d109640 1 -- 172.21.15.172:0/2149008664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 msgr2=0x7f68280ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.794+0000 7f682d109640 1 --2- 172.21.15.172:0/2149008664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 0x7f68280ce670 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f68280b6910 tx=0x7f681802a680 comp rx=0 tx=0).stop 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.794+0000 7f682d109640 1 -- 172.21.15.172:0/2149008664 shutdown_connections 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.794+0000 7f682d109640 1 --2- 172.21.15.172:0/2149008664 >> v2:172.21.15.186:3300/0 conn(0x7f68280d32f0 0x7f68280cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.794+0000 7f682d109640 1 --2- 172.21.15.172:0/2149008664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 0x7f68280ce670 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.794+0000 7f682d109640 1 -- 172.21.15.172:0/2149008664 >> 172.21.15.172:0/2149008664 conn(0x7f68280d0420 msgr2=0x7f68280d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.794+0000 7f682d109640 1 -- 172.21.15.172:0/2149008664 shutdown_connections 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.794+0000 7f682d109640 1 -- 172.21.15.172:0/2149008664 wait complete. 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.795+0000 7f682d109640 1 Processor -- start 2024-04-25T08:48:32.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.796+0000 7f682d109640 1 -- start start 2024-04-25T08:48:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.796+0000 7f682d109640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68280d32f0 0x7f682815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.796+0000 7f682d109640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 0x7f68280cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.796+0000 7f682d109640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6828161710 0x7f68280cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.796+0000 7f682d109640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68280b5e50 con 0x7f682815dc20 2024-04-25T08:48:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.796+0000 7f682d109640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6828162500 con 0x7f6828161710 2024-04-25T08:48:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.796+0000 7f682d109640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68280b5fd0 con 0x7f68280d32f0 2024-04-25T08:48:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.796+0000 7f682659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 0x7f68280cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.796+0000 7f682659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 0x7f68280cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51332/0 (socket says 172.21.15.172:51332) 2024-04-25T08:48:32.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.796+0000 7f682659c640 1 -- 172.21.15.172:0/1443969410 learned_addr learned my addr 172.21.15.172:0/1443969410 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f682759e640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6828161710 0x7f68280cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f6826d9d640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68280d32f0 0x7f682815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f682659c640 1 -- 172.21.15.172:0/1443969410 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68280d32f0 msgr2=0x7f682815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f682659c640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68280d32f0 0x7f682815c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f682659c640 1 -- 172.21.15.172:0/1443969410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6828161710 msgr2=0x7f68280cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f682659c640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6828161710 0x7f68280cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f682659c640 1 -- 172.21.15.172:0/1443969410 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68280cbc90 con 0x7f682815dc20 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f682759e640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6828161710 0x7f68280cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f682659c640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 0x7f68280cd320 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c420 tx=0x7f681c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f680f7fe640 1 -- 172.21.15.172:0/1443969410 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c0074e0 con 0x7f682815dc20 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f680f7fe640 1 -- 172.21.15.172:0/1443969410 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c0047e0 con 0x7f682815dc20 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f682d109640 1 -- 172.21.15.172:0/1443969410 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68280cbf70 con 0x7f682815dc20 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f680f7fe640 1 -- 172.21.15.172:0/1443969410 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c004c10 con 0x7f682815dc20 2024-04-25T08:48:32.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.797+0000 7f682d109640 1 -- 172.21.15.172:0/1443969410 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68280cc530 con 0x7f682815dc20 2024-04-25T08:48:32.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.798+0000 7f682d109640 1 -- 172.21.15.172:0/1443969410 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6828073a00 con 0x7f682815dc20 2024-04-25T08:48:32.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.798+0000 7f680f7fe640 1 -- 172.21.15.172:0/1443969410 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f681c011070 con 0x7f682815dc20 2024-04-25T08:48:32.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.799+0000 7f680f7fe640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f681406b4d0 0x7f681406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:32.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.799+0000 7f680f7fe640 1 -- 172.21.15.172:0/1443969410 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f681c089d20 con 0x7f682815dc20 2024-04-25T08:48:32.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.799+0000 7f6826d9d640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f681406b4d0 0x7f681406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:32.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.799+0000 7f6826d9d640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f681406b4d0 0x7f681406d990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6818034000 tx=0x7f6818033040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:32.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.803+0000 7f680f7fe640 1 -- 172.21.15.172:0/1443969410 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f681c058c90 con 0x7f682815dc20 2024-04-25T08:48:32.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.973+0000 7f682d109640 1 -- 172.21.15.172:0/1443969410 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f682815d440 con 0x7f682815dc20 2024-04-25T08:48:32.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.973+0000 7f680f7fe640 1 -- 172.21.15.172:0/1443969410 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f681c058590 con 0x7f682815dc20 2024-04-25T08:48:32.964 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:48:32.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 -- 172.21.15.172:0/1443969410 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f681406b4d0 msgr2=0x7f681406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f681406b4d0 0x7f681406d990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6818034000 tx=0x7f6818033040 comp rx=0 tx=0).stop 2024-04-25T08:48:32.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 -- 172.21.15.172:0/1443969410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 msgr2=0x7f68280cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:32.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 0x7f68280cd320 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c420 tx=0x7f681c00c8e0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 -- 172.21.15.172:0/1443969410 shutdown_connections 2024-04-25T08:48:32.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f681406b4d0 0x7f681406d990 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6828161710 0x7f68280cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f682815dc20 0x7f68280cd320 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 --2- 172.21.15.172:0/1443969410 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68280d32f0 0x7f682815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:32.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 -- 172.21.15.172:0/1443969410 >> 172.21.15.172:0/1443969410 conn(0x7f68280d0420 msgr2=0x7f68280d41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:32.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 -- 172.21.15.172:0/1443969410 shutdown_connections 2024-04-25T08:48:32.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:32.975+0000 7f682d109640 1 -- 172.21.15.172:0/1443969410 wait complete. 2024-04-25T08:48:32.977 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-04-25T08:48:33.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.085+0000 7f536753b640 1 Processor -- start 2024-04-25T08:48:33.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.085+0000 7f536753b640 1 -- start start 2024-04-25T08:48:33.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f536753b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5360165680 0x7f53600aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f536753b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f53600cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f536753b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53600cf330 con 0x7f53600cec70 2024-04-25T08:48:33.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f536753b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600cf100 con 0x7f5360165680 2024-04-25T08:48:33.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f536753b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5360072340 con 0x7f53600b2650 2024-04-25T08:48:33.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f5365ad8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f53600cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f53652d7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5360165680 0x7f53600aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f5365ad8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f53600cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:37638/0 (socket says 172.21.15.172:37638) 2024-04-25T08:48:33.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f5365ad8640 1 -- 172.21.15.172:0/884968406 learned_addr learned my addr 172.21.15.172:0/884968406 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:33.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f53652d7640 1 -- 172.21.15.172:0/884968406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 msgr2=0x7f53600cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:33.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f53652d7640 1 --2- 172.21.15.172:0/884968406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f53600cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f53652d7640 1 -- 172.21.15.172:0/884968406 >> v1:172.21.15.186:6789/0 conn(0x7f53600cec70 legacy=0x7f53600cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f53652d7640 1 -- 172.21.15.172:0/884968406 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360071d80 con 0x7f5360165680 2024-04-25T08:48:33.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.086+0000 7f5365ad8640 1 --2- 172.21.15.172:0/884968406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f53600cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:48:33.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.087+0000 7f53652d7640 1 --2- 172.21.15.172:0/884968406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5360165680 0x7f53600aecf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f535c0097a0 tx=0x7f535c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20e7457ddb69f3d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:33.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.087+0000 7f5357fff640 1 -- 172.21.15.172:0/884968406 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c037070 con 0x7f5360165680 2024-04-25T08:48:33.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.087+0000 7f5357fff640 1 -- 172.21.15.172:0/884968406 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c02ae50 con 0x7f5360165680 2024-04-25T08:48:33.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.087+0000 7f5357fff640 1 -- 172.21.15.172:0/884968406 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c032660 con 0x7f5360165680 2024-04-25T08:48:33.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.088+0000 7f536753b640 1 -- 172.21.15.172:0/884968406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5360165680 msgr2=0x7f53600aecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.088+0000 7f536753b640 1 --2- 172.21.15.172:0/884968406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5360165680 0x7f53600aecf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f535c0097a0 tx=0x7f535c02a100 comp rx=0 tx=0).stop 2024-04-25T08:48:33.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.088+0000 7f536753b640 1 -- 172.21.15.172:0/884968406 shutdown_connections 2024-04-25T08:48:33.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.088+0000 7f536753b640 1 --2- 172.21.15.172:0/884968406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f53600cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.088+0000 7f536753b640 1 --2- 172.21.15.172:0/884968406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5360165680 0x7f53600aecf0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.088+0000 7f536753b640 1 -- 172.21.15.172:0/884968406 >> 172.21.15.172:0/884968406 conn(0x7f536006abe0 msgr2=0x7f536006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:33.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.088+0000 7f536753b640 1 -- 172.21.15.172:0/884968406 shutdown_connections 2024-04-25T08:48:33.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.088+0000 7f536753b640 1 -- 172.21.15.172:0/884968406 wait complete. 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.089+0000 7f536753b640 1 Processor -- start 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.089+0000 7f536753b640 1 -- start start 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f536753b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f536015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f536753b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53600cec70 0x7f5360161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f536753b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360165680 0x7f5360161c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f536753b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536006ea30 con 0x7f5360165680 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f536753b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360071670 con 0x7f53600cec70 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f536753b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5360165a60 con 0x7f53600b2650 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5365ad8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360165680 0x7f5360161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5365ad8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360165680 0x7f5360161c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51340/0 (socket says 172.21.15.172:51340) 2024-04-25T08:48:33.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5365ad8640 1 -- 172.21.15.172:0/1701772676 learned_addr learned my addr 172.21.15.172:0/1701772676 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f53652d7640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f536015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5364ad6640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53600cec70 0x7f5360161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5365ad8640 1 -- 172.21.15.172:0/1701772676 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 msgr2=0x7f536015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5365ad8640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f536015f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5365ad8640 1 -- 172.21.15.172:0/1701772676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53600cec70 msgr2=0x7f5360161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5365ad8640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53600cec70 0x7f5360161740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5365ad8640 1 -- 172.21.15.172:0/1701772676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536015fae0 con 0x7f5360165680 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f53652d7640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f536015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5365ad8640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360165680 0x7f5360161c80 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f535800efc0 tx=0x7f535800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5355ffb640 1 -- 172.21.15.172:0/1701772676 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800cbe0 con 0x7f5360165680 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.090+0000 7f5355ffb640 1 -- 172.21.15.172:0/1701772676 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535800cd80 con 0x7f5360165680 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.091+0000 7f536753b640 1 -- 172.21.15.172:0/1701772676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536015e500 con 0x7f5360165680 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.091+0000 7f5355ffb640 1 -- 172.21.15.172:0/1701772676 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358003bb0 con 0x7f5360165680 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.091+0000 7f536753b640 1 -- 172.21.15.172:0/1701772676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536015eac0 con 0x7f5360165680 2024-04-25T08:48:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.092+0000 7f536753b640 1 -- 172.21.15.172:0/1701772676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5360073990 con 0x7f5360165680 2024-04-25T08:48:33.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.092+0000 7f5355ffb640 1 -- 172.21.15.172:0/1701772676 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f535801b030 con 0x7f5360165680 2024-04-25T08:48:33.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.092+0000 7f5355ffb640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f534406b4d0 0x7f534406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.092+0000 7f5355ffb640 1 -- 172.21.15.172:0/1701772676 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f535808a350 con 0x7f5360165680 2024-04-25T08:48:33.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.092+0000 7f53652d7640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f534406b4d0 0x7f534406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.093+0000 7f53652d7640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f534406b4d0 0x7f534406d990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f535c034000 tx=0x7f535c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:33.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.096+0000 7f5355ffb640 1 -- 172.21.15.172:0/1701772676 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5358022020 con 0x7f5360165680 2024-04-25T08:48:33.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.335+0000 7f536753b640 1 -- 172.21.15.172:0/1701772676 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7f536015ccd0 con 0x7f5360165680 2024-04-25T08:48:33.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.344+0000 7f5355ffb640 1 -- 172.21.15.172:0/1701772676 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v301) v1 ==== 147+0+0 (secure 0 0 0) 0x7f5358010040 con 0x7f5360165680 2024-04-25T08:48:33.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 -- 172.21.15.172:0/1701772676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f534406b4d0 msgr2=0x7f534406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f534406b4d0 0x7f534406d990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f535c034000 tx=0x7f535c02e000 comp rx=0 tx=0).stop 2024-04-25T08:48:33.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 -- 172.21.15.172:0/1701772676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360165680 msgr2=0x7f5360161c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360165680 0x7f5360161c80 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f535800efc0 tx=0x7f535800c490 comp rx=0 tx=0).stop 2024-04-25T08:48:33.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 -- 172.21.15.172:0/1701772676 shutdown_connections 2024-04-25T08:48:33.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f534406b4d0 0x7f534406d990 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53600cec70 0x7f5360161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5360165680 0x7f5360161c80 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 --2- 172.21.15.172:0/1701772676 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53600b2650 0x7f536015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 -- 172.21.15.172:0/1701772676 >> 172.21.15.172:0/1701772676 conn(0x7f536006abe0 msgr2=0x7f53601623e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:33.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 -- 172.21.15.172:0/1701772676 shutdown_connections 2024-04-25T08:48:33.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.347+0000 7f536753b640 1 -- 172.21.15.172:0/1701772676 wait complete. 2024-04-25T08:48:33.349 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:48:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.458+0000 7f635ca37640 1 Processor -- start 2024-04-25T08:48:33.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.459+0000 7f635ca37640 1 -- start start 2024-04-25T08:48:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.459+0000 7f635ca37640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63580cfd30 0x7f635815ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.459+0000 7f635ca37640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63580cc5e0 con 0x7f635809a090 2024-04-25T08:48:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.459+0000 7f635ca37640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63580b2ee0 con 0x7f6358099cb0 2024-04-25T08:48:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.459+0000 7f635ca37640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63580cc3b0 con 0x7f63580cfd30 2024-04-25T08:48:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.460+0000 7f634ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63580cfd30 0x7f635815ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.460+0000 7f6356d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f635809a090 0x7f63580ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60298/0 (socket says 172.21.15.172:60298) 2024-04-25T08:48:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.460+0000 7f634ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63580cfd30 0x7f635815ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51344/0 (socket says 172.21.15.172:51344) 2024-04-25T08:48:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.460+0000 7f6356d9d640 1 -- 172.21.15.172:0/462573314 learned_addr learned my addr 172.21.15.172:0/462573314 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.460+0000 7f634ffff640 1 -- 172.21.15.172:0/462573314 >> v1:172.21.15.186:6789/0 conn(0x7f6358099cb0 legacy=0x7f63580b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:33.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.460+0000 7f634ffff640 1 -- 172.21.15.172:0/462573314 >> v1:172.21.15.172:6789/0 conn(0x7f635809a090 legacy=0x7f63580ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.460+0000 7f634ffff640 1 -- 172.21.15.172:0/462573314 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63580d0210 con 0x7f63580cfd30 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f634ffff640 1 --2- 172.21.15.172:0/462573314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cfd30 0x7f635815ecc0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f63400097a0 tx=0x7f634002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26016a59b60f6ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f6355d9b640 1 -- 172.21.15.172:0/462573314 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340037070 con 0x7f63580cfd30 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f6355d9b640 1 -- 172.21.15.172:0/462573314 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6340032440 con 0x7f63580cfd30 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f6355d9b640 1 -- 172.21.15.172:0/462573314 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340032810 con 0x7f63580cfd30 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f635ca37640 1 -- 172.21.15.172:0/462573314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cfd30 msgr2=0x7f635815ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f635ca37640 1 --2- 172.21.15.172:0/462573314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cfd30 0x7f635815ecc0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f63400097a0 tx=0x7f634002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f635ca37640 1 -- 172.21.15.172:0/462573314 shutdown_connections 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f635ca37640 1 --2- 172.21.15.172:0/462573314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63580cfd30 0x7f635815ecc0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f635ca37640 1 -- 172.21.15.172:0/462573314 >> 172.21.15.172:0/462573314 conn(0x7f63580b3290 msgr2=0x7f63580b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f635ca37640 1 -- 172.21.15.172:0/462573314 shutdown_connections 2024-04-25T08:48:33.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.461+0000 7f635ca37640 1 -- 172.21.15.172:0/462573314 wait complete. 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635ca37640 1 Processor -- start 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635ca37640 1 -- start start 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635ca37640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6358099cb0 0x7f6358155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635ca37640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635809a090 0x7f6358157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635ca37640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63580cfd30 0x7f63580b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635ca37640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63580d07d0 con 0x7f6358099cb0 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635ca37640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63580cc880 con 0x7f635809a090 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635ca37640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63580c52f0 con 0x7f63580cfd30 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6358099cb0 0x7f6358155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6358099cb0 0x7f6358155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51348/0 (socket says 172.21.15.172:51348) 2024-04-25T08:48:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.463+0000 7f635659c640 1 -- 172.21.15.172:0/971915946 learned_addr learned my addr 172.21.15.172:0/971915946 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f634ffff640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635809a090 0x7f6358157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f6356d9d640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63580cfd30 0x7f63580b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f635659c640 1 -- 172.21.15.172:0/971915946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63580cfd30 msgr2=0x7f63580b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f635659c640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63580cfd30 0x7f63580b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f635659c640 1 -- 172.21.15.172:0/971915946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635809a090 msgr2=0x7f6358157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f635659c640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635809a090 0x7f6358157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f635659c640 1 -- 172.21.15.172:0/971915946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6358158010 con 0x7f6358099cb0 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f634ffff640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635809a090 0x7f6358157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f635659c640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6358099cb0 0x7f6358155600 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f634800c430 tx=0x7f634800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f634effd640 1 -- 172.21.15.172:0/971915946 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348011790 con 0x7f6358099cb0 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f634effd640 1 -- 172.21.15.172:0/971915946 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6348017070 con 0x7f6358099cb0 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f635ca37640 1 -- 172.21.15.172:0/971915946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63581582f0 con 0x7f6358099cb0 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f634effd640 1 -- 172.21.15.172:0/971915946 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348011b70 con 0x7f6358099cb0 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.464+0000 7f635ca37640 1 -- 172.21.15.172:0/971915946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6358157980 con 0x7f6358099cb0 2024-04-25T08:48:33.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.465+0000 7f635ca37640 1 -- 172.21.15.172:0/971915946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6358073a00 con 0x7f6358099cb0 2024-04-25T08:48:33.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.466+0000 7f634effd640 1 -- 172.21.15.172:0/971915946 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6348011d10 con 0x7f6358099cb0 2024-04-25T08:48:33.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.466+0000 7f634effd640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f633806b4d0 0x7f633806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.466+0000 7f634effd640 1 -- 172.21.15.172:0/971915946 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6348089f50 con 0x7f6358099cb0 2024-04-25T08:48:33.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.466+0000 7f634ffff640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f633806b4d0 0x7f633806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.466+0000 7f634ffff640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f633806b4d0 0x7f633806d990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6340034000 tx=0x7f634002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:33.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.470+0000 7f634effd640 1 -- 172.21.15.172:0/971915946 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6348058f40 con 0x7f6358099cb0 2024-04-25T08:48:33.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.640+0000 7f635ca37640 1 -- 172.21.15.172:0/971915946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f63580b4180 con 0x7f6358099cb0 2024-04-25T08:48:33.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.643+0000 7f634effd640 1 -- 172.21.15.172:0/971915946 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6348058840 con 0x7f6358099cb0 2024-04-25T08:48:33.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 -- 172.21.15.172:0/971915946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f633806b4d0 msgr2=0x7f633806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f633806b4d0 0x7f633806d990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6340034000 tx=0x7f634002e000 comp rx=0 tx=0).stop 2024-04-25T08:48:33.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 -- 172.21.15.172:0/971915946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6358099cb0 msgr2=0x7f6358155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6358099cb0 0x7f6358155600 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f634800c430 tx=0x7f634800c8f0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 -- 172.21.15.172:0/971915946 shutdown_connections 2024-04-25T08:48:33.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f633806b4d0 0x7f633806d990 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f635809a090 0x7f6358157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63580cfd30 0x7f63580b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 --2- 172.21.15.172:0/971915946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6358099cb0 0x7f6358155600 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 -- 172.21.15.172:0/971915946 >> 172.21.15.172:0/971915946 conn(0x7f63580b3290 msgr2=0x7f63580b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:33.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 -- 172.21.15.172:0/971915946 shutdown_connections 2024-04-25T08:48:33.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.645+0000 7f635ca37640 1 -- 172.21.15.172:0/971915946 wait complete. 2024-04-25T08:48:33.647 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:48:33.648 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:48:33.693 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:48:33.738 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:48:33.738 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:48:33.738 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:48:33.753 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:48:33.754 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:48:33.754 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:48:33.796 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:48:33.796 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:48:33.797 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:48:33.811 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:48:33.811 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:48:33.811 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:48:33.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:48:33.853 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:48:33.854 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:48:33.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.959+0000 7f7c7757e640 1 Processor -- start 2024-04-25T08:48:33.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.960+0000 7f7c7757e640 1 -- start start 2024-04-25T08:48:33.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.960+0000 7f7c7757e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7c7015dd80 0x7f7c7015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.960+0000 7f7c7757e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7c70161800 0x7f7c7006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.960+0000 7f7c7757e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c7006c920 0x7f7c70099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.960+0000 7f7c7757e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7015e6a0 con 0x7f7c70161800 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.960+0000 7f7c7757e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7006cd50 con 0x7f7c7015dd80 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.960+0000 7f7c7757e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700cfaf0 con 0x7f7c7006c920 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.960+0000 7f7c74b19640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7c70161800 0x7f7c7006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.961+0000 7f7c74b19640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7c70161800 0x7f7c7006c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51356/0 (socket says 172.21.15.172:51356) 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.961+0000 7f7c74b19640 1 -- 172.21.15.172:0/452386625 learned_addr learned my addr 172.21.15.172:0/452386625 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.961+0000 7f7c7531a640 1 --2- 172.21.15.172:0/452386625 >> v2:172.21.15.186:3300/0 conn(0x7f7c7015dd80 0x7f7c7015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.961+0000 7f7c75b1b640 1 --2- 172.21.15.172:0/452386625 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c7006c920 0x7f7c70099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.961+0000 7f7c74b19640 1 -- 172.21.15.172:0/452386625 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c7006c920 msgr2=0x7f7c70099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.961+0000 7f7c74b19640 1 --2- 172.21.15.172:0/452386625 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c7006c920 0x7f7c70099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.961+0000 7f7c74b19640 1 -- 172.21.15.172:0/452386625 >> v2:172.21.15.186:3300/0 conn(0x7f7c7015dd80 msgr2=0x7f7c7015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.961+0000 7f7c74b19640 1 --2- 172.21.15.172:0/452386625 >> v2:172.21.15.186:3300/0 conn(0x7f7c7015dd80 0x7f7c7015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.961+0000 7f7c74b19640 1 -- 172.21.15.172:0/452386625 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7015e8e0 con 0x7f7c70161800 2024-04-25T08:48:33.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.961+0000 7f7c74b19640 1 --2- 172.21.15.172:0/452386625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c70161800 0x7f7c7006c3e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7c70072ae0 tx=0x7f7c6002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb5b89cbe01d0aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:33.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c67fff640 1 -- 172.21.15.172:0/452386625 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60037070 con 0x7f7c70161800 2024-04-25T08:48:33.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c67fff640 1 -- 172.21.15.172:0/452386625 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c60032440 con 0x7f7c70161800 2024-04-25T08:48:33.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c67fff640 1 -- 172.21.15.172:0/452386625 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60032810 con 0x7f7c70161800 2024-04-25T08:48:33.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c7757e640 1 -- 172.21.15.172:0/452386625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c70161800 msgr2=0x7f7c7006c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c7757e640 1 --2- 172.21.15.172:0/452386625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c70161800 0x7f7c7006c3e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7c70072ae0 tx=0x7f7c6002a210 comp rx=0 tx=0).stop 2024-04-25T08:48:33.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c7757e640 1 -- 172.21.15.172:0/452386625 shutdown_connections 2024-04-25T08:48:33.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c7757e640 1 --2- 172.21.15.172:0/452386625 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c7006c920 0x7f7c70099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c7757e640 1 --2- 172.21.15.172:0/452386625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c70161800 0x7f7c7006c3e0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c7757e640 1 --2- 172.21.15.172:0/452386625 >> v2:172.21.15.186:3300/0 conn(0x7f7c7015dd80 0x7f7c7015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c7757e640 1 -- 172.21.15.172:0/452386625 >> 172.21.15.172:0/452386625 conn(0x7f7c700b3310 msgr2=0x7f7c700b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:33.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c7757e640 1 -- 172.21.15.172:0/452386625 shutdown_connections 2024-04-25T08:48:33.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.962+0000 7f7c7757e640 1 -- 172.21.15.172:0/452386625 wait complete. 2024-04-25T08:48:33.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.963+0000 7f7c7757e640 1 Processor -- start 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.963+0000 7f7c7757e640 1 -- start start 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c7757e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c7006c920 0x7f7c70158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c7757e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c7015dd80 0x7f7c701f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c7757e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c70161800 0x7f7c7015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c7757e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7015f180 con 0x7f7c7015dd80 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c7757e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7015eea0 con 0x7f7c7006c920 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c7757e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7006c0c0 con 0x7f7c70161800 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c74b19640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c7015dd80 0x7f7c701f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c74b19640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c7015dd80 0x7f7c701f3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51368/0 (socket says 172.21.15.172:51368) 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c74b19640 1 -- 172.21.15.172:0/13350350 learned_addr learned my addr 172.21.15.172:0/13350350 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c7531a640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c7006c920 0x7f7c70158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c74b19640 1 -- 172.21.15.172:0/13350350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c70161800 msgr2=0x7f7c7015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c74b19640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c70161800 0x7f7c7015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c74b19640 1 -- 172.21.15.172:0/13350350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c7006c920 msgr2=0x7f7c70158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c74b19640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c7006c920 0x7f7c70158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.964+0000 7f7c74b19640 1 -- 172.21.15.172:0/13350350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c700b5480 con 0x7f7c7015dd80 2024-04-25T08:48:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.965+0000 7f7c74b19640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c7015dd80 0x7f7c701f3eb0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7c60000c00 tx=0x7f7c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.965+0000 7f7c65ffb640 1 -- 172.21.15.172:0/13350350 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60041020 con 0x7f7c7015dd80 2024-04-25T08:48:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.965+0000 7f7c65ffb640 1 -- 172.21.15.172:0/13350350 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c600306c0 con 0x7f7c7015dd80 2024-04-25T08:48:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.965+0000 7f7c7757e640 1 -- 172.21.15.172:0/13350350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c700b5760 con 0x7f7c7015dd80 2024-04-25T08:48:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.965+0000 7f7c65ffb640 1 -- 172.21.15.172:0/13350350 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60037040 con 0x7f7c7015dd80 2024-04-25T08:48:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.965+0000 7f7c7757e640 1 -- 172.21.15.172:0/13350350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c700b5d20 con 0x7f7c7015dd80 2024-04-25T08:48:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.966+0000 7f7c7757e640 1 -- 172.21.15.172:0/13350350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c70073990 con 0x7f7c7015dd80 2024-04-25T08:48:33.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.966+0000 7f7c65ffb640 1 -- 172.21.15.172:0/13350350 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c60044020 con 0x7f7c7015dd80 2024-04-25T08:48:33.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.967+0000 7f7c65ffb640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c5406b4d0 0x7f7c5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:33.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.967+0000 7f7c65ffb640 1 -- 172.21.15.172:0/13350350 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7c600aa810 con 0x7f7c7015dd80 2024-04-25T08:48:33.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.967+0000 7f7c7531a640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c5406b4d0 0x7f7c5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:33.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.967+0000 7f7c7531a640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c5406b4d0 0x7f7c5406d990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7c7015bb30 tx=0x7f7c6c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:33.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:33.971+0000 7f7c65ffb640 1 -- 172.21.15.172:0/13350350 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c6004b030 con 0x7f7c7015dd80 2024-04-25T08:48:34.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.173+0000 7f7c7757e640 1 -- 172.21.15.172:0/13350350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c700b77a0 con 0x7f7c7015dd80 2024-04-25T08:48:34.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.174+0000 7f7c65ffb640 1 -- 172.21.15.172:0/13350350 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f7c60079800 con 0x7f7c7015dd80 2024-04-25T08:48:34.165 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:34.165 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5777,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1549593613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1549593613},{"type":"v1","addr":"172.21.15.186:6833","nonce":1549593613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2002207643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2002207643},{"type":"v1","addr":"172.21.15.186:6835","nonce":2002207643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":46},{"gid":7221,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2584048606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2584048606},{"type":"v1","addr":"172.21.15.172:6836","nonce":2584048606}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":7596,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2278707138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":2278707138},{"type":"v1","addr":"172.21.15.172:6837","nonce":2278707138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[]} 2024-04-25T08:48:34.166 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 52 2024-04-25T08:48:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 -- 172.21.15.172:0/13350350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c5406b4d0 msgr2=0x7f7c5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c5406b4d0 0x7f7c5406d990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7c7015bb30 tx=0x7f7c6c00b040 comp rx=0 tx=0).stop 2024-04-25T08:48:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 -- 172.21.15.172:0/13350350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c7015dd80 msgr2=0x7f7c701f3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c7015dd80 0x7f7c701f3eb0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7c60000c00 tx=0x7f7c600046c0 comp rx=0 tx=0).stop 2024-04-25T08:48:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 -- 172.21.15.172:0/13350350 shutdown_connections 2024-04-25T08:48:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7c5406b4d0 0x7f7c5406d990 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c70161800 0x7f7c7015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c7015dd80 0x7f7c701f3eb0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 --2- 172.21.15.172:0/13350350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c7006c920 0x7f7c70158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 -- 172.21.15.172:0/13350350 >> 172.21.15.172:0/13350350 conn(0x7f7c700b3310 msgr2=0x7f7c7006f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 -- 172.21.15.172:0/13350350 shutdown_connections 2024-04-25T08:48:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.176+0000 7f7c7757e640 1 -- 172.21.15.172:0/13350350 wait complete. 2024-04-25T08:48:34.178 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:48:34.178 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:48:34.179 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:48:34.179 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:48:34.179 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:48:34.179 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:48:34.179 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:48:34.179 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:48:34.179 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:48:34.179 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:48:34.180 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:48:34.180 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:48:34.180 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:48:34.180 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:48:34.180 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:48:34.180 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:48:34.188 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:48:34.189 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:48:34.190 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:48:34.190 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:48:34.192 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:48:34.192 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:48:34.193 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:48:34.193 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:48:34.231 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:48:34.231 DEBUG:teuthology.parallel:result is None 2024-04-25T08:48:34.232 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:48:34.232 DEBUG:teuthology.parallel:result is None 2024-04-25T08:48:34.235 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:48:34.236 DEBUG:teuthology.parallel:result is None 2024-04-25T08:48:34.236 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:48:34.237 DEBUG:teuthology.parallel:result is None 2024-04-25T08:48:34.237 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:48:34.304 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:48:34.305 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:48:34.317 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:48:34.317 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:48:34.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.350+0000 7febf0637640 1 Processor -- start 2024-04-25T08:48:34.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.350+0000 7febf0637640 1 -- start start 2024-04-25T08:48:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.350+0000 7febf0637640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7febe81610f0 0x7febe806c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febf0637640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febe80ce7b0 0x7febe8161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febf0637640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe80c6960 con 0x7febe81616f0 2024-04-25T08:48:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febf0637640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe81614d0 con 0x7febe80ce7b0 2024-04-25T08:48:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febf0637640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe8162260 con 0x7febe81610f0 2024-04-25T08:48:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febeebd4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febe80ce7b0 0x7febe8161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:34.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febeebd4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febe80ce7b0 0x7febe8161b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51414/0 (socket says 172.21.15.172:51414) 2024-04-25T08:48:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febeebd4640 1 -- 172.21.15.172:0/4155145721 learned_addr learned my addr 172.21.15.172:0/4155145721 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febee3d3640 1 --2- 172.21.15.172:0/4155145721 >> v2:172.21.15.186:3300/0 conn(0x7febe81610f0 0x7febe806c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febeebd4640 1 -- 172.21.15.172:0/4155145721 >> v2:172.21.15.186:3300/0 conn(0x7febe81610f0 msgr2=0x7febe806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febeebd4640 1 --2- 172.21.15.172:0/4155145721 >> v2:172.21.15.186:3300/0 conn(0x7febe81610f0 0x7febe806c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febeebd4640 1 -- 172.21.15.172:0/4155145721 >> v1:172.21.15.186:6789/0 conn(0x7febe81616f0 legacy=0x7febe80ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febeebd4640 1 -- 172.21.15.172:0/4155145721 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8162540 con 0x7febe80ce7b0 2024-04-25T08:48:34.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.351+0000 7febee3d3640 1 --2- 172.21.15.172:0/4155145721 >> v2:172.21.15.186:3300/0 conn(0x7febe81610f0 0x7febe806c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:34.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.352+0000 7febeebd4640 1 --2- 172.21.15.172:0/4155145721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe80ce7b0 0x7febe8161b50 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7febe8071fb0 tx=0x7febe002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee49e797b2e33eda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:34.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.352+0000 7febed3d1640 1 -- 172.21.15.172:0/4155145721 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0036070 con 0x7febe80ce7b0 2024-04-25T08:48:34.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.352+0000 7febed3d1640 1 -- 172.21.15.172:0/4155145721 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0031600 con 0x7febe80ce7b0 2024-04-25T08:48:34.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.352+0000 7febed3d1640 1 -- 172.21.15.172:0/4155145721 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00319d0 con 0x7febe80ce7b0 2024-04-25T08:48:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.353+0000 7febf0637640 1 -- 172.21.15.172:0/4155145721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe80ce7b0 msgr2=0x7febe8161b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.353+0000 7febf0637640 1 --2- 172.21.15.172:0/4155145721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe80ce7b0 0x7febe8161b50 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7febe8071fb0 tx=0x7febe002a730 comp rx=0 tx=0).stop 2024-04-25T08:48:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.353+0000 7febf0637640 1 -- 172.21.15.172:0/4155145721 shutdown_connections 2024-04-25T08:48:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.353+0000 7febf0637640 1 --2- 172.21.15.172:0/4155145721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe80ce7b0 0x7febe8161b50 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.353+0000 7febf0637640 1 --2- 172.21.15.172:0/4155145721 >> v2:172.21.15.186:3300/0 conn(0x7febe81610f0 0x7febe806c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.353+0000 7febf0637640 1 -- 172.21.15.172:0/4155145721 >> 172.21.15.172:0/4155145721 conn(0x7febe806f500 msgr2=0x7febe806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.353+0000 7febf0637640 1 -- 172.21.15.172:0/4155145721 shutdown_connections 2024-04-25T08:48:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.353+0000 7febf0637640 1 -- 172.21.15.172:0/4155145721 wait complete. 2024-04-25T08:48:34.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.354+0000 7febf0637640 1 Processor -- start 2024-04-25T08:48:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.355+0000 7febf0637640 1 -- start start 2024-04-25T08:48:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.355+0000 7febf0637640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7febe80ce7b0 0x7febe81450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.355+0000 7febf0637640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe81610f0 0x7febe81f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febf0637640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe81616f0 0x7febe81f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febedbd2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe81610f0 0x7febe81f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febedbd2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe81610f0 0x7febe81f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51424/0 (socket says 172.21.15.172:51424) 2024-04-25T08:48:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febf0637640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80cf690 con 0x7febe81610f0 2024-04-25T08:48:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febedbd2640 1 -- 172.21.15.172:0/2087053668 learned_addr learned my addr 172.21.15.172:0/2087053668 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febee3d3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7febe80ce7b0 0x7febe81450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80cfce0 con 0x7febe81616f0 2024-04-25T08:48:34.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe806c700 con 0x7febe80ce7b0 2024-04-25T08:48:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febeebd4640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe81616f0 0x7febe81f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febedbd2640 1 -- 172.21.15.172:0/2087053668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7febe80ce7b0 msgr2=0x7febe81450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febedbd2640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7febe80ce7b0 0x7febe81450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febedbd2640 1 -- 172.21.15.172:0/2087053668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe81616f0 msgr2=0x7febe81f7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febedbd2640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe81616f0 0x7febe81f7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febedbd2640 1 -- 172.21.15.172:0/2087053668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8145600 con 0x7febe81610f0 2024-04-25T08:48:34.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.356+0000 7febedbd2640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe81610f0 0x7febe81f6ee0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7febd800c3c0 tx=0x7febd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:34.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.358+0000 7febdeffd640 1 -- 172.21.15.172:0/2087053668 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd80052d0 con 0x7febe81610f0 2024-04-25T08:48:34.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.358+0000 7febdeffd640 1 -- 172.21.15.172:0/2087053668 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd8005490 con 0x7febe81610f0 2024-04-25T08:48:34.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.358+0000 7febdeffd640 1 -- 172.21.15.172:0/2087053668 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8007260 con 0x7febe81610f0 2024-04-25T08:48:34.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.358+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe815acc0 con 0x7febe81610f0 2024-04-25T08:48:34.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.358+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe815b690 con 0x7febe81610f0 2024-04-25T08:48:34.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.359+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe8073a00 con 0x7febe81610f0 2024-04-25T08:48:34.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.360+0000 7febdeffd640 1 -- 172.21.15.172:0/2087053668 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7febd8007400 con 0x7febe81610f0 2024-04-25T08:48:34.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.360+0000 7febdeffd640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febcc06b4d0 0x7febcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:34.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.360+0000 7febdeffd640 1 -- 172.21.15.172:0/2087053668 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5335+0+0 (secure 0 0 0) 0x7febd80894d0 con 0x7febe81610f0 2024-04-25T08:48:34.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.360+0000 7febee3d3640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febcc06b4d0 0x7febcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:34.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.361+0000 7febee3d3640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febcc06b4d0 0x7febcc06d990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7febe4006fd0 tx=0x7febe4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:34.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.365+0000 7febdeffd640 1 -- 172.21.15.172:0/2087053668 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7febd8057e60 con 0x7febe81610f0 2024-04-25T08:48:34.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:34.549+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7febe80cf150 con 0x7febe81610f0 2024-04-25T08:48:35.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.371+0000 7febdeffd640 1 -- 172.21.15.172:0/2087053668 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v91) v1 ==== 97+0+0 (secure 0 0 0) 0x7febd805ce20 con 0x7febe81610f0 2024-04-25T08:48:35.363 INFO:teuthology.orchestra.run.smithi172.stderr: removed all blocklist entries 2024-04-25T08:48:35.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febcc06b4d0 msgr2=0x7febcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febcc06b4d0 0x7febcc06d990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7febe4006fd0 tx=0x7febe4008040 comp rx=0 tx=0).stop 2024-04-25T08:48:35.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe81610f0 msgr2=0x7febe81f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.365 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe81610f0 0x7febe81f6ee0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7febd800c3c0 tx=0x7febd800c880 comp rx=0 tx=0).stop 2024-04-25T08:48:35.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 shutdown_connections 2024-04-25T08:48:35.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febcc06b4d0 0x7febcc06d990 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe81616f0 0x7febe81f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe81610f0 0x7febe81f6ee0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 --2- 172.21.15.172:0/2087053668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7febe80ce7b0 0x7febe81450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 >> 172.21.15.172:0/2087053668 conn(0x7febe806f500 msgr2=0x7febe81573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:35.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 shutdown_connections 2024-04-25T08:48:35.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.374+0000 7febf0637640 1 -- 172.21.15.172:0/2087053668 wait complete. 2024-04-25T08:48:35.379 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:48:35.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.491+0000 7efd00a22640 1 Processor -- start 2024-04-25T08:48:35.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.492+0000 7efd00a22640 1 -- start start 2024-04-25T08:48:35.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.492+0000 7efd00a22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcfc15dbe0 0x7efcfc0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.492+0000 7efd00a22640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcfc0b6220 con 0x7efcfc0b92a0 2024-04-25T08:48:35.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.492+0000 7efd00a22640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcfc0b97a0 con 0x7efcfc0b2cb0 2024-04-25T08:48:35.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.492+0000 7efd00a22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc15dfc0 con 0x7efcfc15dbe0 2024-04-25T08:48:35.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcfad9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efcfc0b92a0 0x7efcfc0b5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60318/0 (socket says 172.21.15.172:60318) 2024-04-25T08:48:35.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcfad9d640 1 -- 172.21.15.172:0/3599529160 learned_addr learned my addr 172.21.15.172:0/3599529160 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:35.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcfa59c640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcfc15dbe0 0x7efcfc0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766863684 0 0) 0x7efcfc0b6220 con 0x7efcfc0b92a0 2024-04-25T08:48:35.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce8003520 con 0x7efcfc0b92a0 2024-04-25T08:48:35.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922516851 0 0) 0x7efcfc0b97a0 con 0x7efcfc0b2cb0 2024-04-25T08:48:35.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcfc0b6220 con 0x7efcfc0b2cb0 2024-04-25T08:48:35.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3145929333 0 0) 0x7efce8003520 con 0x7efcfc0b92a0 2024-04-25T08:48:35.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcfc15dbe0 msgr2=0x7efcfc0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:35.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcfc15dbe0 0x7efcfc0d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 >> v1:172.21.15.186:6789/0 conn(0x7efcfc0b2cb0 legacy=0x7efcfc0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc0d1c50 con 0x7efcfc0b92a0 2024-04-25T08:48:35.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7efcf40019f0 con 0x7efcfc0b92a0 2024-04-25T08:48:35.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 >> v1:172.21.15.172:6789/0 conn(0x7efcfc0b92a0 legacy=0x7efcfc0b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce8003b70 0x7efce8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efce8004800 0x7efce8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcfc15dbe0 0x7efce80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce800ba70 con 0x7efce8004800 2024-04-25T08:48:35.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce800bbf0 con 0x7efce8003b70 2024-04-25T08:48:35.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce800bdc0 con 0x7efcfc15dbe0 2024-04-25T08:48:35.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcf9d9b640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efce8004800 0x7efce8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcfa59c640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce8003b70 0x7efce8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.493+0000 7efcfad9d640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcfc15dbe0 0x7efce80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.494+0000 7efcf9d9b640 1 -- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcfc15dbe0 msgr2=0x7efce80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:35.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.494+0000 7efcf9d9b640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcfc15dbe0 0x7efce80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.494+0000 7efcf9d9b640 1 -- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce8003b70 msgr2=0x7efce8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:35.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.494+0000 7efcf9d9b640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efce8003b70 0x7efce8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.494+0000 7efcf9d9b640 1 -- 172.21.15.172:0/3599529160 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8003520 con 0x7efce8004800 2024-04-25T08:48:35.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.494+0000 7efcf9d9b640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efce8004800 0x7efce8004c80 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7efcec0018d0 tx=0x7efce8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebde95c7152284 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:35.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.494+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec0014f0 con 0x7efce8004800 2024-04-25T08:48:35.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.495+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec0052d0 con 0x7efce8004800 2024-04-25T08:48:35.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.495+0000 7efcf959a640 1 -- 172.21.15.172:0/3599529160 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec02ac30 con 0x7efce8004800 2024-04-25T08:48:35.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.495+0000 7efd00a22640 1 -- 172.21.15.172:0/3599529160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efce8004800 msgr2=0x7efce8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.495+0000 7efd00a22640 1 --2- 172.21.15.172:0/3599529160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efce8004800 0x7efce8004c80 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7efcec0018d0 tx=0x7efce8005830 comp rx=0 tx=0).stop 2024-04-25T08:48:35.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.495+0000 7efcfad9d640 1 -- 172.21.15.172:0/3599529160 reap_dead start 2024-04-25T08:48:35.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.495+0000 7efd00a22640 1 -- 172.21.15.172:0/3599529160 shutdown_connections 2024-04-25T08:48:35.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.495+0000 7efd00a22640 1 -- 172.21.15.172:0/3599529160 >> 172.21.15.172:0/3599529160 conn(0x7efcfc061a20 msgr2=0x7efcfc061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:35.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.495+0000 7efd00a22640 1 -- 172.21.15.172:0/3599529160 shutdown_connections 2024-04-25T08:48:35.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.495+0000 7efd00a22640 1 -- 172.21.15.172:0/3599529160 wait complete. 2024-04-25T08:48:35.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efd00a22640 1 Processor -- start 2024-04-25T08:48:35.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efd00a22640 1 -- start start 2024-04-25T08:48:35.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efd00a22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efce8004800 0x7efcfc154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efd00a22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0b5cb0 0x7efcfc153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efd00a22640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efcfc157650 0x7efcfc159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efd00a22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0d2210 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efd00a22640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0d1a00 con 0x7efcfc157650 2024-04-25T08:48:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efd00a22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0b6ab0 con 0x7efce8004800 2024-04-25T08:48:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efcf9d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0b5cb0 0x7efcfc153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efcf9d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0b5cb0 0x7efcfc153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51450/0 (socket says 172.21.15.172:51450) 2024-04-25T08:48:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.497+0000 7efcf9d9b640 1 -- 172.21.15.172:0/3012876732 learned_addr learned my addr 172.21.15.172:0/3012876732 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcfad9d640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efcfc157650 0x7efcfc159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcfa59c640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efce8004800 0x7efcfc154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcf9d9b640 1 -- 172.21.15.172:0/3012876732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efce8004800 msgr2=0x7efcfc154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcf9d9b640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efce8004800 0x7efcfc154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcf9d9b640 1 -- 172.21.15.172:0/3012876732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efcfc157650 msgr2=0x7efcfc159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcf9d9b640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efcfc157650 0x7efcfc159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcf9d9b640 1 -- 172.21.15.172:0/3012876732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc15e060 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcf9d9b640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0b5cb0 0x7efcfc153b60 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7efcec0019f0 tx=0x7efcec0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:35.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcf2ffd640 1 -- 172.21.15.172:0/3012876732 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec03f020 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcf2ffd640 1 -- 172.21.15.172:0/3012876732 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec006e50 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efd00a22640 1 -- 172.21.15.172:0/3012876732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc15e340 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efcf2ffd640 1 -- 172.21.15.172:0/3012876732 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec037040 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.498+0000 7efd00a22640 1 -- 172.21.15.172:0/3012876732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc15e900 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.499+0000 7efd00a22640 1 -- 172.21.15.172:0/3012876732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcfc073990 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.499+0000 7efcf2ffd640 1 -- 172.21.15.172:0/3012876732 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efcec042020 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.500+0000 7efcf2ffd640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efcdc06b4d0 0x7efcdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.500+0000 7efcf2ffd640 1 -- 172.21.15.172:0/3012876732 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5249+0+0 (secure 0 0 0) 0x7efcec0a9c50 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.500+0000 7efcfa59c640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efcdc06b4d0 0x7efcdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.500+0000 7efcfa59c640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efcdc06b4d0 0x7efcdc06d990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efce4009a20 tx=0x7efce4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:35.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.504+0000 7efcf2ffd640 1 -- 172.21.15.172:0/3012876732 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efcec0af020 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.741+0000 7efd00a22640 1 -- 172.21.15.172:0/3012876732 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efcfc15c420 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.741+0000 7efcf2ffd640 1 -- 172.21.15.172:0/3012876732 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7efcec049030 con 0x7efcfc0b5cb0 2024-04-25T08:48:35.732 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:35.732 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "auth_dump": [ 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.a", 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q==", 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.733 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.b", 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg==", 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.c", 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA==", 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:48:35.734 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.d", 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg==", 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.0", 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ==", 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.736 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.1", 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g==", 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.2", 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g==", 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:48:35.737 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.3", 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg==", 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.4", 2024-04-25T08:48:35.738 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw==", 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.5", 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow==", 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.739 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.6", 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg==", 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.7", 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q==", 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:48:35.740 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.0", 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q==", 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow r", 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.1", 2024-04-25T08:48:35.741 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g==", 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.2", 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw==", 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:48:35.742 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.3", 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w==", 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:48:35.743 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.admin", 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmFmQsIBAAkuAmqIptAT1ivH6T7/1T8A==", 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.x", 2024-04-25T08:48:35.744 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw==", 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.y", 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg==", 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.745 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:35.746 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-25T08:48:35.746 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:48:35.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 -- 172.21.15.172:0/3012876732 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efcdc06b4d0 msgr2=0x7efcdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efcdc06b4d0 0x7efcdc06d990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efce4009a20 tx=0x7efce4008040 comp rx=0 tx=0).stop 2024-04-25T08:48:35.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 -- 172.21.15.172:0/3012876732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0b5cb0 msgr2=0x7efcfc153b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0b5cb0 0x7efcfc153b60 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7efcec0019f0 tx=0x7efcec0012d0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 -- 172.21.15.172:0/3012876732 shutdown_connections 2024-04-25T08:48:35.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efcdc06b4d0 0x7efcdc06d990 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efcfc157650 0x7efcfc159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0b5cb0 0x7efcfc153b60 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 --2- 172.21.15.172:0/3012876732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efce8004800 0x7efcfc154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 -- 172.21.15.172:0/3012876732 >> 172.21.15.172:0/3012876732 conn(0x7efcfc061a20 msgr2=0x7efcfc0b6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:35.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 -- 172.21.15.172:0/3012876732 shutdown_connections 2024-04-25T08:48:35.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.743+0000 7efd00a22640 1 -- 172.21.15.172:0/3012876732 wait complete. 2024-04-25T08:48:35.749 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:48:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.855+0000 7fec3ec88640 1 Processor -- start 2024-04-25T08:48:35.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.855+0000 7fec3ec88640 1 -- start start 2024-04-25T08:48:35.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.855+0000 7fec3ec88640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec38072d30 0x7fec3806b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.855+0000 7fec3ec88640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec380cfa60 con 0x7fec3815b9c0 2024-04-25T08:48:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.855+0000 7fec3ec88640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec380cfd40 con 0x7fec3806abe0 2024-04-25T08:48:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.855+0000 7fec3ec88640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec380731a0 con 0x7fec38072d30 2024-04-25T08:48:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.855+0000 7fec3ca24640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fec3815b9c0 0x7fec3815bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60322/0 (socket says 172.21.15.172:60322) 2024-04-25T08:48:35.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.855+0000 7fec3ca24640 1 -- 172.21.15.172:0/3165812601 learned_addr learned my addr 172.21.15.172:0/3165812601 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec3d225640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec38072d30 0x7fec3806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912274043 0 0) 0x7fec380cfa60 con 0x7fec3815b9c0 2024-04-25T08:48:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec24003520 con 0x7fec3815b9c0 2024-04-25T08:48:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370301127 0 0) 0x7fec380cfd40 con 0x7fec3806abe0 2024-04-25T08:48:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec380cfa60 con 0x7fec3806abe0 2024-04-25T08:48:35.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2297663718 0 0) 0x7fec24003520 con 0x7fec3815b9c0 2024-04-25T08:48:35.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec38072d30 msgr2=0x7fec3806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:35.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec38072d30 0x7fec3806b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 >> v1:172.21.15.186:6789/0 conn(0x7fec3806abe0 legacy=0x7fec38072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec380d0020 con 0x7fec3815b9c0 2024-04-25T08:48:35.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fec30001a10 con 0x7fec3815b9c0 2024-04-25T08:48:35.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 >> v1:172.21.15.172:6789/0 conn(0x7fec3815b9c0 legacy=0x7fec3815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec24003b70 0x7fec24003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec24004800 0x7fec24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec38072d30 0x7fec240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380731a0 con 0x7fec24004800 2024-04-25T08:48:35.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2400ba70 con 0x7fec24003b70 2024-04-25T08:48:35.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2400bc40 con 0x7fec38072d30 2024-04-25T08:48:35.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec37fff640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec24004800 0x7fec24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec3ca24640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec24003b70 0x7fec24003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec3d225640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec38072d30 0x7fec240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec37fff640 1 -- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec38072d30 msgr2=0x7fec240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec37fff640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec38072d30 0x7fec240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec37fff640 1 -- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec24003b70 msgr2=0x7fec24003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec37fff640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec24003b70 0x7fec24003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.856+0000 7fec37fff640 1 -- 172.21.15.172:0/3165812601 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec24003520 con 0x7fec24004800 2024-04-25T08:48:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.857+0000 7fec37fff640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec24004800 0x7fec24004c80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fec280018d0 tx=0x7fec24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e129b3976d114af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.857+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280014f0 con 0x7fec24004800 2024-04-25T08:48:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.857+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec280052d0 con 0x7fec24004800 2024-04-25T08:48:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.857+0000 7fec377fe640 1 -- 172.21.15.172:0/3165812601 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2802ac30 con 0x7fec24004800 2024-04-25T08:48:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.858+0000 7fec3ec88640 1 -- 172.21.15.172:0/3165812601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec24004800 msgr2=0x7fec24004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.858+0000 7fec3ec88640 1 --2- 172.21.15.172:0/3165812601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec24004800 0x7fec24004c80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fec280018d0 tx=0x7fec24005830 comp rx=0 tx=0).stop 2024-04-25T08:48:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.858+0000 7fec3d225640 1 -- 172.21.15.172:0/3165812601 reap_dead start 2024-04-25T08:48:35.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.858+0000 7fec3ec88640 1 -- 172.21.15.172:0/3165812601 shutdown_connections 2024-04-25T08:48:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.858+0000 7fec3ec88640 1 -- 172.21.15.172:0/3165812601 >> 172.21.15.172:0/3165812601 conn(0x7fec380b2370 msgr2=0x7fec380b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.858+0000 7fec3ec88640 1 -- 172.21.15.172:0/3165812601 shutdown_connections 2024-04-25T08:48:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.858+0000 7fec3ec88640 1 -- 172.21.15.172:0/3165812601 wait complete. 2024-04-25T08:48:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.859+0000 7fec3ec88640 1 Processor -- start 2024-04-25T08:48:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.859+0000 7fec3ec88640 1 -- start start 2024-04-25T08:48:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec3ec88640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec24004800 0x7fec38150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec3ec88640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec3813ecd0 0x7fec381415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec3ec88640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec38141b00 0x7fec38154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec3ec88640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3806b070 con 0x7fec3813ecd0 2024-04-25T08:48:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec3ec88640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380cf710 con 0x7fec38141b00 2024-04-25T08:48:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec3ec88640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3806b1f0 con 0x7fec24004800 2024-04-25T08:48:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec3813ecd0 0x7fec381415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec3813ecd0 0x7fec381415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51460/0 (socket says 172.21.15.172:51460) 2024-04-25T08:48:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec37fff640 1 -- 172.21.15.172:0/115150959 learned_addr learned my addr 172.21.15.172:0/115150959 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec3ca24640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec24004800 0x7fec38150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec3d225640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec38141b00 0x7fec38154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec37fff640 1 -- 172.21.15.172:0/115150959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec24004800 msgr2=0x7fec38150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec37fff640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec24004800 0x7fec38150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec37fff640 1 -- 172.21.15.172:0/115150959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec38141b00 msgr2=0x7fec38154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:35.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec37fff640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec38141b00 0x7fec38154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:35.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.860+0000 7fec37fff640 1 -- 172.21.15.172:0/115150959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38141f80 con 0x7fec3813ecd0 2024-04-25T08:48:35.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.861+0000 7fec37fff640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec3813ecd0 0x7fec381415c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fec280019f0 tx=0x7fec280012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:35.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.861+0000 7fec357fa640 1 -- 172.21.15.172:0/115150959 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2803f020 con 0x7fec3813ecd0 2024-04-25T08:48:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.861+0000 7fec357fa640 1 -- 172.21.15.172:0/115150959 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec28006e50 con 0x7fec3813ecd0 2024-04-25T08:48:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.861+0000 7fec357fa640 1 -- 172.21.15.172:0/115150959 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28037040 con 0x7fec3813ecd0 2024-04-25T08:48:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.861+0000 7fec3ec88640 1 -- 172.21.15.172:0/115150959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec38150820 con 0x7fec3813ecd0 2024-04-25T08:48:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.861+0000 7fec3ec88640 1 -- 172.21.15.172:0/115150959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec38150de0 con 0x7fec3813ecd0 2024-04-25T08:48:35.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.862+0000 7fec3ec88640 1 -- 172.21.15.172:0/115150959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec38073990 con 0x7fec3813ecd0 2024-04-25T08:48:35.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.862+0000 7fec357fa640 1 -- 172.21.15.172:0/115150959 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fec28042020 con 0x7fec3813ecd0 2024-04-25T08:48:35.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.863+0000 7fec357fa640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fec1806b4d0 0x7fec1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:35.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.863+0000 7fec357fa640 1 -- 172.21.15.172:0/115150959 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fec280a9f40 con 0x7fec3813ecd0 2024-04-25T08:48:35.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.863+0000 7fec3ca24640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fec1806b4d0 0x7fec1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:35.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.863+0000 7fec3ca24640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fec1806b4d0 0x7fec1806d990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fec3806bcc0 tx=0x7fec30006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:35.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:35.867+0000 7fec357fa640 1 -- 172.21.15.172:0/115150959 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fec28049020 con 0x7fec3813ecd0 2024-04-25T08:48:36.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.039+0000 7fec3ec88640 1 -- 172.21.15.172:0/115150959 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec381590f0 con 0x7fec3813ecd0 2024-04-25T08:48:36.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.040+0000 7fec357fa640 1 -- 172.21.15.172:0/115150959 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+13225 (secure 0 0 0) 0x7fec28078ef0 con 0x7fec3813ecd0 2024-04-25T08:48:36.031 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:36.031 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":91,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:35.366604+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:48:36.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 -- 172.21.15.172:0/115150959 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fec1806b4d0 msgr2=0x7fec1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fec1806b4d0 0x7fec1806d990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fec3806bcc0 tx=0x7fec30006040 comp rx=0 tx=0).stop 2024-04-25T08:48:36.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 -- 172.21.15.172:0/115150959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec3813ecd0 msgr2=0x7fec381415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec3813ecd0 0x7fec381415c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fec280019f0 tx=0x7fec280012d0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 -- 172.21.15.172:0/115150959 shutdown_connections 2024-04-25T08:48:36.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fec1806b4d0 0x7fec1806d990 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec38141b00 0x7fec38154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec3813ecd0 0x7fec381415c0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 --2- 172.21.15.172:0/115150959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fec24004800 0x7fec38150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 -- 172.21.15.172:0/115150959 >> 172.21.15.172:0/115150959 conn(0x7fec380b2370 msgr2=0x7fec38072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:36.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 -- 172.21.15.172:0/115150959 shutdown_connections 2024-04-25T08:48:36.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.042+0000 7fec3ec88640 1 -- 172.21.15.172:0/115150959 wait complete. 2024-04-25T08:48:36.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:48:36.045 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:48:36.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.155+0000 7fb31064a640 1 Processor -- start 2024-04-25T08:48:36.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.155+0000 7fb31064a640 1 -- start start 2024-04-25T08:48:36.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb31064a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb3080cd4c0 0x7fb3080cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb31064a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb30815b1c0 0x7fb30815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb31064a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30815e6e0 con 0x7fb30815e1a0 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb31064a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30815e9c0 con 0x7fb30815b1c0 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb31064a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30815a9c0 con 0x7fb3080cd4c0 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb30dbe5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb30815b1c0 0x7fb30815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb30dbe5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb30815b1c0 0x7fb30815dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51472/0 (socket says 172.21.15.172:51472) 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb30dbe5640 1 -- 172.21.15.172:0/3281004772 learned_addr learned my addr 172.21.15.172:0/3281004772 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb30e3e6640 1 --2- 172.21.15.172:0/3281004772 >> v2:172.21.15.186:3300/0 conn(0x7fb3080cd4c0 0x7fb3080cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb30dbe5640 1 -- 172.21.15.172:0/3281004772 >> v2:172.21.15.186:3300/0 conn(0x7fb3080cd4c0 msgr2=0x7fb3080cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb30dbe5640 1 --2- 172.21.15.172:0/3281004772 >> v2:172.21.15.186:3300/0 conn(0x7fb3080cd4c0 0x7fb3080cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb30dbe5640 1 -- 172.21.15.172:0/3281004772 >> v1:172.21.15.172:6789/0 conn(0x7fb30815e1a0 legacy=0x7fb308150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb30d3e4640 1 -- 172.21.15.172:0/3281004772 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131990104 0 0) 0x7fb30815e6e0 con 0x7fb30815e1a0 2024-04-25T08:48:36.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.156+0000 7fb30dbe5640 1 -- 172.21.15.172:0/3281004772 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30815aca0 con 0x7fb30815b1c0 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.157+0000 7fb30dbe5640 1 --2- 172.21.15.172:0/3281004772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30815b1c0 0x7fb30815dc60 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fb30806b8e0 tx=0x7fb2f802b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdf17545f6d5e45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.157+0000 7fb30d3e4640 1 -- 172.21.15.172:0/3281004772 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800b040 con 0x7fb30815b1c0 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.157+0000 7fb30d3e4640 1 -- 172.21.15.172:0/3281004772 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f802be50 con 0x7fb30815b1c0 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.157+0000 7fb30d3e4640 1 -- 172.21.15.172:0/3281004772 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8030930 con 0x7fb30815b1c0 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.158+0000 7fb31064a640 1 -- 172.21.15.172:0/3281004772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30815b1c0 msgr2=0x7fb30815dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.158+0000 7fb31064a640 1 --2- 172.21.15.172:0/3281004772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30815b1c0 0x7fb30815dc60 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fb30806b8e0 tx=0x7fb2f802b630 comp rx=0 tx=0).stop 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.158+0000 7fb31064a640 1 -- 172.21.15.172:0/3281004772 shutdown_connections 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.158+0000 7fb31064a640 1 --2- 172.21.15.172:0/3281004772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb30815b1c0 0x7fb30815dc60 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.158+0000 7fb31064a640 1 --2- 172.21.15.172:0/3281004772 >> v2:172.21.15.186:3300/0 conn(0x7fb3080cd4c0 0x7fb3080cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.158+0000 7fb31064a640 1 -- 172.21.15.172:0/3281004772 >> 172.21.15.172:0/3281004772 conn(0x7fb30806abe0 msgr2=0x7fb30806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:36.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.158+0000 7fb31064a640 1 -- 172.21.15.172:0/3281004772 shutdown_connections 2024-04-25T08:48:36.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.158+0000 7fb31064a640 1 -- 172.21.15.172:0/3281004772 wait complete. 2024-04-25T08:48:36.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.159+0000 7fb31064a640 1 Processor -- start 2024-04-25T08:48:36.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.159+0000 7fb31064a640 1 -- start start 2024-04-25T08:48:36.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb31064a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3080cd4c0 0x7fb30813f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb31064a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb30815b1c0 0x7fb308157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb31064a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb30815e1a0 0x7fb308140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb31064a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30806ee20 con 0x7fb3080cd4c0 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb31064a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30806eca0 con 0x7fb30815b1c0 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb31064a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3081512a0 con 0x7fb30815e1a0 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb30e3e6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3080cd4c0 0x7fb30813f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb30e3e6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3080cd4c0 0x7fb30813f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51476/0 (socket says 172.21.15.172:51476) 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb30e3e6640 1 -- 172.21.15.172:0/1821238465 learned_addr learned my addr 172.21.15.172:0/1821238465 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb30e3e6640 1 -- 172.21.15.172:0/1821238465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb30815e1a0 msgr2=0x7fb308140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb30e3e6640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb30815e1a0 0x7fb308140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb30e3e6640 1 -- 172.21.15.172:0/1821238465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb30815b1c0 msgr2=0x7fb308157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb30e3e6640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb30815b1c0 0x7fb308157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb30e3e6640 1 -- 172.21.15.172:0/1821238465 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30813f770 con 0x7fb3080cd4c0 2024-04-25T08:48:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb30e3e6640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3080cd4c0 0x7fb30813f0e0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fb30400d830 tx=0x7fb30400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:36.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb2feffd640 1 -- 172.21.15.172:0/1821238465 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30400b6c0 con 0x7fb3080cd4c0 2024-04-25T08:48:36.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb2feffd640 1 -- 172.21.15.172:0/1821238465 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb304019070 con 0x7fb3080cd4c0 2024-04-25T08:48:36.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb31064a640 1 -- 172.21.15.172:0/1821238465 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30813fa50 con 0x7fb3080cd4c0 2024-04-25T08:48:36.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb2feffd640 1 -- 172.21.15.172:0/1821238465 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30400ba80 con 0x7fb3080cd4c0 2024-04-25T08:48:36.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.160+0000 7fb31064a640 1 -- 172.21.15.172:0/1821238465 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb308140010 con 0x7fb3080cd4c0 2024-04-25T08:48:36.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.161+0000 7fb31064a640 1 -- 172.21.15.172:0/1821238465 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb308073a00 con 0x7fb3080cd4c0 2024-04-25T08:48:36.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.162+0000 7fb2feffd640 1 -- 172.21.15.172:0/1821238465 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb30401e460 con 0x7fb3080cd4c0 2024-04-25T08:48:36.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.162+0000 7fb2feffd640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb2ec06b4d0 0x7fb2ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.162+0000 7fb2feffd640 1 -- 172.21.15.172:0/1821238465 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb30408a690 con 0x7fb3080cd4c0 2024-04-25T08:48:36.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.162+0000 7fb30dbe5640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb2ec06b4d0 0x7fb2ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.163+0000 7fb30dbe5640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb2ec06b4d0 0x7fb2ec06d990 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8035000 tx=0x7fb2f802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:36.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.166+0000 7fb2feffd640 1 -- 172.21.15.172:0/1821238465 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb304059760 con 0x7fb3080cd4c0 2024-04-25T08:48:36.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.338+0000 7fb31064a640 1 -- 172.21.15.172:0/1821238465 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3080ccb10 con 0x7fb3080cd4c0 2024-04-25T08:48:36.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.338+0000 7fb2feffd640 1 -- 172.21.15.172:0/1821238465 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb304059060 con 0x7fb3080cd4c0 2024-04-25T08:48:36.329 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 -- 172.21.15.172:0/1821238465 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb2ec06b4d0 msgr2=0x7fb2ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb2ec06b4d0 0x7fb2ec06d990 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8035000 tx=0x7fb2f802f000 comp rx=0 tx=0).stop 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 -- 172.21.15.172:0/1821238465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3080cd4c0 msgr2=0x7fb30813f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3080cd4c0 0x7fb30813f0e0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fb30400d830 tx=0x7fb30400dcf0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 -- 172.21.15.172:0/1821238465 shutdown_connections 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb2ec06b4d0 0x7fb2ec06d990 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb30815b1c0 0x7fb308157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb30815e1a0 0x7fb308140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 --2- 172.21.15.172:0/1821238465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3080cd4c0 0x7fb30813f0e0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 -- 172.21.15.172:0/1821238465 >> 172.21.15.172:0/1821238465 conn(0x7fb30806abe0 msgr2=0x7fb3080cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 -- 172.21.15.172:0/1821238465 shutdown_connections 2024-04-25T08:48:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.340+0000 7fb31064a640 1 -- 172.21.15.172:0/1821238465 wait complete. 2024-04-25T08:48:36.343 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:48:36.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.448+0000 7f7a62615640 1 Processor -- start 2024-04-25T08:48:36.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.448+0000 7f7a62615640 1 -- start start 2024-04-25T08:48:36.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.449+0000 7f7a62615640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c15ba00 0x7f7a5c09a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.449+0000 7f7a62615640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7a5c15f5f0 0x7f7a5c15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.449+0000 7f7a62615640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c0cd710 con 0x7f7a5c1602e0 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.449+0000 7f7a62615640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0cd4b0 con 0x7f7a5c15f5f0 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.449+0000 7f7a62615640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c099b70 con 0x7f7a5c15ba00 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.449+0000 7f7a60bb2640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7a5c15f5f0 0x7f7a5c15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.449+0000 7f7a60bb2640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7a5c15f5f0 0x7f7a5c15faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51490/0 (socket says 172.21.15.172:51490) 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.449+0000 7f7a60bb2640 1 -- 172.21.15.172:0/60720194 learned_addr learned my addr 172.21.15.172:0/60720194 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.450+0000 7f7a5bfff640 1 --2- 172.21.15.172:0/60720194 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c15ba00 0x7f7a5c09a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.450+0000 7f7a60bb2640 1 -- 172.21.15.172:0/60720194 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c15ba00 msgr2=0x7f7a5c09a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.450+0000 7f7a60bb2640 1 --2- 172.21.15.172:0/60720194 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c15ba00 0x7f7a5c09a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.450+0000 7f7a60bb2640 1 -- 172.21.15.172:0/60720194 >> v1:172.21.15.186:6789/0 conn(0x7f7a5c1602e0 legacy=0x7f7a5c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.450+0000 7f7a60bb2640 1 -- 172.21.15.172:0/60720194 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c099e50 con 0x7f7a5c15f5f0 2024-04-25T08:48:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.450+0000 7f7a5bfff640 1 --2- 172.21.15.172:0/60720194 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c15ba00 0x7f7a5c09a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:36.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.450+0000 7f7a60bb2640 1 --2- 172.21.15.172:0/60720194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15f5f0 0x7f7a5c15faa0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7a54009e50 tx=0x7f7a5402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2b0927b6208a78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:36.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a5affd640 1 -- 172.21.15.172:0/60720194 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54036070 con 0x7f7a5c15f5f0 2024-04-25T08:48:36.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a5affd640 1 -- 172.21.15.172:0/60720194 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a54031600 con 0x7f7a5c15f5f0 2024-04-25T08:48:36.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a5affd640 1 -- 172.21.15.172:0/60720194 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a540319d0 con 0x7f7a5c15f5f0 2024-04-25T08:48:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a62615640 1 -- 172.21.15.172:0/60720194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15f5f0 msgr2=0x7f7a5c15faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a62615640 1 --2- 172.21.15.172:0/60720194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15f5f0 0x7f7a5c15faa0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7a54009e50 tx=0x7f7a5402a5f0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a62615640 1 -- 172.21.15.172:0/60720194 shutdown_connections 2024-04-25T08:48:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a62615640 1 --2- 172.21.15.172:0/60720194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15f5f0 0x7f7a5c15faa0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a62615640 1 --2- 172.21.15.172:0/60720194 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c15ba00 0x7f7a5c09a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a62615640 1 -- 172.21.15.172:0/60720194 >> 172.21.15.172:0/60720194 conn(0x7f7a5c0b3270 msgr2=0x7f7a5c0b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a62615640 1 -- 172.21.15.172:0/60720194 shutdown_connections 2024-04-25T08:48:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.451+0000 7f7a62615640 1 -- 172.21.15.172:0/60720194 wait complete. 2024-04-25T08:48:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.452+0000 7f7a62615640 1 Processor -- start 2024-04-25T08:48:36.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a62615640 1 -- start start 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a62615640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15ba00 0x7f7a5c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a62615640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a5c15f5f0 0x7f7a5c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a62615640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c1602e0 0x7f7a5c0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a62615640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c15bde0 con 0x7f7a5c15ba00 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a62615640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c09ae70 con 0x7f7a5c15f5f0 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a62615640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0c9dc0 con 0x7f7a5c1602e0 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a5bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15ba00 0x7f7a5c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a5bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15ba00 0x7f7a5c1556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51494/0 (socket says 172.21.15.172:51494) 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a5bfff640 1 -- 172.21.15.172:0/370742469 learned_addr learned my addr 172.21.15.172:0/370742469 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a5b7fe640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a5c15f5f0 0x7f7a5c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.453+0000 7f7a60bb2640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c1602e0 0x7f7a5c0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a5bfff640 1 -- 172.21.15.172:0/370742469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c1602e0 msgr2=0x7f7a5c0b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a5bfff640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c1602e0 0x7f7a5c0b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a5bfff640 1 -- 172.21.15.172:0/370742469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a5c15f5f0 msgr2=0x7f7a5c0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a5bfff640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a5c15f5f0 0x7f7a5c0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a5bfff640 1 -- 172.21.15.172:0/370742469 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0ca010 con 0x7f7a5c15ba00 2024-04-25T08:48:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a5b7fe640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a5c15f5f0 0x7f7a5c0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a5bfff640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15ba00 0x7f7a5c1556f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00e7e0 tx=0x7f7a4c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a58ff9640 1 -- 172.21.15.172:0/370742469 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c00f040 con 0x7f7a5c15ba00 2024-04-25T08:48:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a58ff9640 1 -- 172.21.15.172:0/370742469 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c004030 con 0x7f7a5c15ba00 2024-04-25T08:48:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a62615640 1 -- 172.21.15.172:0/370742469 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c0ca2f0 con 0x7f7a5c15ba00 2024-04-25T08:48:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a58ff9640 1 -- 172.21.15.172:0/370742469 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c004400 con 0x7f7a5c15ba00 2024-04-25T08:48:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.454+0000 7f7a62615640 1 -- 172.21.15.172:0/370742469 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c0ca8b0 con 0x7f7a5c15ba00 2024-04-25T08:48:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.455+0000 7f7a62615640 1 -- 172.21.15.172:0/370742469 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c15f330 con 0x7f7a5c15ba00 2024-04-25T08:48:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.455+0000 7f7a58ff9640 1 -- 172.21.15.172:0/370742469 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a4c00c6d0 con 0x7f7a5c15ba00 2024-04-25T08:48:36.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.456+0000 7f7a58ff9640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a4806b4d0 0x7f7a4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.456+0000 7f7a58ff9640 1 -- 172.21.15.172:0/370742469 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7a4c089e20 con 0x7f7a5c15ba00 2024-04-25T08:48:36.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.456+0000 7f7a5b7fe640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a4806b4d0 0x7f7a4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.456+0000 7f7a5b7fe640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a4806b4d0 0x7f7a4806d990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c15eda0 tx=0x7f7a50009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:36.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.460+0000 7f7a58ff9640 1 -- 172.21.15.172:0/370742469 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a5c15f330 con 0x7f7a5c15ba00 2024-04-25T08:48:36.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.633+0000 7f7a62615640 1 -- 172.21.15.172:0/370742469 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7a5c0cbed0 con 0x7f7a5c15ba00 2024-04-25T08:48:36.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.633+0000 7f7a58ff9640 1 -- 172.21.15.172:0/370742469 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v91) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7a5c0cbed0 con 0x7f7a5c15ba00 2024-04-25T08:48:36.625 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:36.625 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:48:36.626 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:48:36.626 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2024-04-25T08:48:36.626 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2024-04-25T08:48:36.626 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:36.626 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:48:36.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 -- 172.21.15.172:0/370742469 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a4806b4d0 msgr2=0x7f7a4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a4806b4d0 0x7f7a4806d990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c15eda0 tx=0x7f7a50009040 comp rx=0 tx=0).stop 2024-04-25T08:48:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 -- 172.21.15.172:0/370742469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15ba00 msgr2=0x7f7a5c1556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15ba00 0x7f7a5c1556f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00e7e0 tx=0x7f7a4c00eca0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 -- 172.21.15.172:0/370742469 shutdown_connections 2024-04-25T08:48:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7a4806b4d0 0x7f7a4806d990 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a5c15f5f0 0x7f7a5c0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a5c1602e0 0x7f7a5c0b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 --2- 172.21.15.172:0/370742469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c15ba00 0x7f7a5c1556f0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 -- 172.21.15.172:0/370742469 >> 172.21.15.172:0/370742469 conn(0x7f7a5c0b3270 msgr2=0x7f7a5c0ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.635+0000 7f7a62615640 1 -- 172.21.15.172:0/370742469 shutdown_connections 2024-04-25T08:48:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.636+0000 7f7a62615640 1 -- 172.21.15.172:0/370742469 wait complete. 2024-04-25T08:48:36.638 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:48:36.638 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:48:36.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.749+0000 7f45e7bf4640 1 Processor -- start 2024-04-25T08:48:36.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.749+0000 7f45e7bf4640 1 -- start start 2024-04-25T08:48:36.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e7bf4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f45e0144d20 0x7f45e00ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e7bf4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e01454b0 0x7f45e0070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e7bf4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00ceba0 con 0x7f45e0071300 2024-04-25T08:48:36.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e7bf4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e0071750 con 0x7f45e0144d20 2024-04-25T08:48:36.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e7bf4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00b4830 con 0x7f45e01454b0 2024-04-25T08:48:36.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e5990640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f45e0144d20 0x7f45e00ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e518f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e01454b0 0x7f45e0070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e5990640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f45e0144d20 0x7f45e00ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:43352/0 (socket says 172.21.15.172:43352) 2024-04-25T08:48:36.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e5990640 1 -- 172.21.15.172:0/1945458158 learned_addr learned my addr 172.21.15.172:0/1945458158 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:36.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e6191640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f45e0071300 0x7f45e015f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:56598/0 (socket says 172.21.15.172:56598) 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.750+0000 7f45e518f640 1 --2- 172.21.15.172:0/1945458158 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e01454b0 0x7f45e0070dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:37810/0 (socket says 172.21.15.172:37810) 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.751+0000 7f45e5990640 1 -- 172.21.15.172:0/1945458158 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e01454b0 msgr2=0x7f45e0070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.751+0000 7f45e5990640 1 --2- 172.21.15.172:0/1945458158 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e01454b0 0x7f45e0070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.751+0000 7f45e5990640 1 -- 172.21.15.172:0/1945458158 >> v1:172.21.15.186:6789/0 conn(0x7f45e0071300 legacy=0x7f45e015f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.751+0000 7f45e5990640 1 -- 172.21.15.172:0/1945458158 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00cee80 con 0x7f45e0144d20 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.751+0000 7f45e498e640 1 -- 172.21.15.172:0/1945458158 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937113204 0 0) 0x7f45e00ceba0 con 0x7f45e0071300 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.751+0000 7f45e518f640 1 --2- 172.21.15.172:0/1945458158 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e01454b0 0x7f45e0070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.751+0000 7f45e5990640 1 --2- 172.21.15.172:0/1945458158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45e0144d20 0x7f45e00ce350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009870 tx=0x7f45d802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=440f8fac2305d821 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e498e640 1 -- 172.21.15.172:0/1945458158 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8037070 con 0x7f45e0144d20 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e498e640 1 -- 172.21.15.172:0/1945458158 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d8032440 con 0x7f45e0144d20 2024-04-25T08:48:36.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e498e640 1 -- 172.21.15.172:0/1945458158 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8032810 con 0x7f45e0144d20 2024-04-25T08:48:36.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e7bf4640 1 -- 172.21.15.172:0/1945458158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45e0144d20 msgr2=0x7f45e00ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e7bf4640 1 --2- 172.21.15.172:0/1945458158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45e0144d20 0x7f45e00ce350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009870 tx=0x7f45d802a270 comp rx=0 tx=0).stop 2024-04-25T08:48:36.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e7bf4640 1 -- 172.21.15.172:0/1945458158 shutdown_connections 2024-04-25T08:48:36.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e7bf4640 1 --2- 172.21.15.172:0/1945458158 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e01454b0 0x7f45e0070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e7bf4640 1 --2- 172.21.15.172:0/1945458158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45e0144d20 0x7f45e00ce350 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e7bf4640 1 -- 172.21.15.172:0/1945458158 >> 172.21.15.172:0/1945458158 conn(0x7f45e00b3530 msgr2=0x7f45e00b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e7bf4640 1 -- 172.21.15.172:0/1945458158 shutdown_connections 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.752+0000 7f45e7bf4640 1 -- 172.21.15.172:0/1945458158 wait complete. 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.753+0000 7f45e7bf4640 1 Processor -- start 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.753+0000 7f45e7bf4640 1 -- start start 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e7bf4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e0071300 0x7f45e006c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e7bf4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45e0144d20 0x7f45e006cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e7bf4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e01454b0 0x7f45e01f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e7bf4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00ce890 con 0x7f45e01454b0 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e7bf4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00cf440 con 0x7f45e0144d20 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e7bf4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0145100 con 0x7f45e0071300 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e6191640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e01454b0 0x7f45e01f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e6191640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e01454b0 0x7f45e01f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51508/0 (socket says 172.21.15.172:51508) 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e6191640 1 -- 172.21.15.172:0/3252405334 learned_addr learned my addr 172.21.15.172:0/3252405334 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e518f640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45e0144d20 0x7f45e006cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e5990640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e0071300 0x7f45e006c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e6191640 1 -- 172.21.15.172:0/3252405334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e0071300 msgr2=0x7f45e006c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e6191640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e0071300 0x7f45e006c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e6191640 1 -- 172.21.15.172:0/3252405334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45e0144d20 msgr2=0x7f45e006cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e6191640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45e0144d20 0x7f45e006cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.754+0000 7f45e6191640 1 -- 172.21.15.172:0/3252405334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e01f47e0 con 0x7f45e01454b0 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.755+0000 7f45e518f640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45e0144d20 0x7f45e006cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.755+0000 7f45e6191640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e01454b0 0x7f45e01f3a70 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f45d000c7a0 tx=0x7f45d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.755+0000 7f45de7fc640 1 -- 172.21.15.172:0/3252405334 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0018070 con 0x7f45e01454b0 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.755+0000 7f45de7fc640 1 -- 172.21.15.172:0/3252405334 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d000a640 con 0x7f45e01454b0 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.755+0000 7f45e7bf4640 1 -- 172.21.15.172:0/3252405334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e00ccbc0 con 0x7f45e01454b0 2024-04-25T08:48:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.755+0000 7f45de7fc640 1 -- 172.21.15.172:0/3252405334 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000aab0 con 0x7f45e01454b0 2024-04-25T08:48:36.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.755+0000 7f45e7bf4640 1 -- 172.21.15.172:0/3252405334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e00cd180 con 0x7f45e01454b0 2024-04-25T08:48:36.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.756+0000 7f45e7bf4640 1 -- 172.21.15.172:0/3252405334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e0073a00 con 0x7f45e01454b0 2024-04-25T08:48:36.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.756+0000 7f45de7fc640 1 -- 172.21.15.172:0/3252405334 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f45d001b070 con 0x7f45e01454b0 2024-04-25T08:48:36.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.757+0000 7f45de7fc640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45cc06b4d0 0x7f45cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:36.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.757+0000 7f45de7fc640 1 -- 172.21.15.172:0/3252405334 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f45d00895e0 con 0x7f45e01454b0 2024-04-25T08:48:36.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.757+0000 7f45e5990640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45cc06b4d0 0x7f45cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:36.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.757+0000 7f45e5990640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45cc06b4d0 0x7f45cc06d990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f45d8034000 tx=0x7f45d802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:36.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.761+0000 7f45de7fc640 1 -- 172.21.15.172:0/3252405334 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f45d00586b0 con 0x7f45e01454b0 2024-04-25T08:48:36.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:36.932+0000 7f45e7bf4640 1 -- 172.21.15.172:0/3252405334 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f45e00b0f50 con 0x7f45e01454b0 2024-04-25T08:48:37.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.377+0000 7f45de7fc640 1 -- 172.21.15.172:0/3252405334 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v92) v1 ==== 138+0+0 (secure 0 0 0) 0x7f45d0057fb0 con 0x7f45e01454b0 2024-04-25T08:48:37.368 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2024-04-25T08:48:37.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 -- 172.21.15.172:0/3252405334 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45cc06b4d0 msgr2=0x7f45cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:37.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45cc06b4d0 0x7f45cc06d990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f45d8034000 tx=0x7f45d802e000 comp rx=0 tx=0).stop 2024-04-25T08:48:37.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 -- 172.21.15.172:0/3252405334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e01454b0 msgr2=0x7f45e01f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:37.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e01454b0 0x7f45e01f3a70 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f45d000c7a0 tx=0x7f45d000cc60 comp rx=0 tx=0).stop 2024-04-25T08:48:37.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 -- 172.21.15.172:0/3252405334 shutdown_connections 2024-04-25T08:48:37.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f45cc06b4d0 0x7f45cc06d990 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:37.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45e0144d20 0x7f45e006cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:37.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e01454b0 0x7f45e01f3a70 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:37.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 --2- 172.21.15.172:0/3252405334 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f45e0071300 0x7f45e006c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:37.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 -- 172.21.15.172:0/3252405334 >> 172.21.15.172:0/3252405334 conn(0x7f45e00b3530 msgr2=0x7f45e00b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:37.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 -- 172.21.15.172:0/3252405334 shutdown_connections 2024-04-25T08:48:37.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.380+0000 7f45e7bf4640 1 -- 172.21.15.172:0/3252405334 wait complete. 2024-04-25T08:48:37.385 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:48:37.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.499+0000 7fcf96c76640 1 Processor -- start 2024-04-25T08:48:37.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.499+0000 7fcf96c76640 1 -- start start 2024-04-25T08:48:37.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.500+0000 7fcf96c76640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf9015dac0 0x7fcf900d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:37.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.500+0000 7fcf96c76640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf900d2420 con 0x7fcf900d1f30 2024-04-25T08:48:37.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.500+0000 7fcf96c76640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf900d2700 con 0x7fcf900d0ab0 2024-04-25T08:48:37.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.500+0000 7fcf96c76640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900d3030 con 0x7fcf9015dac0 2024-04-25T08:48:37.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.500+0000 7fcf8ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcf900d1f30 0x7fcf900d03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38336/0 (socket says 172.21.15.172:38336) 2024-04-25T08:48:37.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.500+0000 7fcf8ffff640 1 -- 172.21.15.172:0/2309493687 learned_addr learned my addr 172.21.15.172:0/2309493687 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:37.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf94a12640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf9015dac0 0x7fcf900d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947527308 0 0) 0x7fcf900d2420 con 0x7fcf900d1f30 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf78003520 con 0x7fcf900d1f30 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3227655476 0 0) 0x7fcf78003520 con 0x7fcf900d1f30 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf9015dac0 msgr2=0x7fcf900d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf9015dac0 0x7fcf900d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 >> v1:172.21.15.186:6789/0 conn(0x7fcf900d0ab0 legacy=0x7fcf900b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf900d29e0 con 0x7fcf900d1f30 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fcf840017f0 con 0x7fcf900d1f30 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 >> v1:172.21.15.172:6789/0 conn(0x7fcf900d1f30 legacy=0x7fcf900d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 0x7fcf78003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf9015dac0 0x7fcf78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78004d40 0x7fcf780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900d3030 con 0x7fcf780039e0 2024-04-25T08:48:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7800ba70 con 0x7fcf78004d40 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7800bbf0 con 0x7fcf9015dac0 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf94a12640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 0x7fcf78003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf8ffff640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf9015dac0 0x7fcf78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf95213640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78004d40 0x7fcf780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf94a12640 1 -- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf9015dac0 msgr2=0x7fcf78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf94a12640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf9015dac0 0x7fcf78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf94a12640 1 -- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78004d40 msgr2=0x7fcf780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf94a12640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78004d40 0x7fcf780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf94a12640 1 -- 172.21.15.172:0/2309493687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78003520 con 0x7fcf780039e0 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.501+0000 7fcf95213640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78004d40 0x7fcf780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.502+0000 7fcf94a12640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 0x7fcf78003de0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009ac0 tx=0x7fcf78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ab1e3f69f2483e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.502+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80036070 con 0x7fcf780039e0 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.502+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf80031400 con 0x7fcf780039e0 2024-04-25T08:48:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.502+0000 7fcf8f7fe640 1 -- 172.21.15.172:0/2309493687 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80009690 con 0x7fcf780039e0 2024-04-25T08:48:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.503+0000 7fcf96c76640 1 -- 172.21.15.172:0/2309493687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 msgr2=0x7fcf78003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.503+0000 7fcf96c76640 1 --2- 172.21.15.172:0/2309493687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 0x7fcf78003de0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009ac0 tx=0x7fcf78005830 comp rx=0 tx=0).stop 2024-04-25T08:48:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.503+0000 7fcf95213640 1 -- 172.21.15.172:0/2309493687 reap_dead start 2024-04-25T08:48:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.503+0000 7fcf96c76640 1 -- 172.21.15.172:0/2309493687 shutdown_connections 2024-04-25T08:48:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.503+0000 7fcf96c76640 1 -- 172.21.15.172:0/2309493687 >> 172.21.15.172:0/2309493687 conn(0x7fcf90061c30 msgr2=0x7fcf9006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.503+0000 7fcf96c76640 1 -- 172.21.15.172:0/2309493687 shutdown_connections 2024-04-25T08:48:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.503+0000 7fcf96c76640 1 -- 172.21.15.172:0/2309493687 wait complete. 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.504+0000 7fcf96c76640 1 Processor -- start 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.504+0000 7fcf96c76640 1 -- start start 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf96c76640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 0x7fcf901606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf96c76640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf900cd4d0 0x7fcf90145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf96c76640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf901461b0 0x7fcf90143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf96c76640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900b97d0 con 0x7fcf780039e0 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf96c76640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9015dea0 con 0x7fcf901461b0 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf96c76640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900b9950 con 0x7fcf900cd4d0 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf94a12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 0x7fcf901606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf94a12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 0x7fcf901606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36658/0 (socket says 172.21.15.172:36658) 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf94a12640 1 -- 172.21.15.172:0/3118847362 learned_addr learned my addr 172.21.15.172:0/3118847362 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf8ffff640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf900cd4d0 0x7fcf90145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf95213640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf901461b0 0x7fcf90143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf94a12640 1 -- 172.21.15.172:0/3118847362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf900cd4d0 msgr2=0x7fcf90145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf94a12640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf900cd4d0 0x7fcf90145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf94a12640 1 -- 172.21.15.172:0/3118847362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf901461b0 msgr2=0x7fcf90143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf94a12640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf901461b0 0x7fcf90143c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf94a12640 1 -- 172.21.15.172:0/3118847362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf901f35c0 con 0x7fcf780039e0 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf8ffff640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf900cd4d0 0x7fcf90145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.505+0000 7fcf94a12640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 0x7fcf901606e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009be0 tx=0x7fcf80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.506+0000 7fcf8d7fa640 1 -- 172.21.15.172:0/3118847362 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80040020 con 0x7fcf780039e0 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.506+0000 7fcf8d7fa640 1 -- 172.21.15.172:0/3118847362 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf80003bc0 con 0x7fcf780039e0 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.506+0000 7fcf96c76640 1 -- 172.21.15.172:0/3118847362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf900c7560 con 0x7fcf780039e0 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.506+0000 7fcf8d7fa640 1 -- 172.21.15.172:0/3118847362 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80036040 con 0x7fcf780039e0 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.506+0000 7fcf96c76640 1 -- 172.21.15.172:0/3118847362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9015fee0 con 0x7fcf780039e0 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.507+0000 7fcf96c76640 1 -- 172.21.15.172:0/3118847362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf90073a00 con 0x7fcf780039e0 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.507+0000 7fcf8d7fa640 1 -- 172.21.15.172:0/3118847362 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf80043020 con 0x7fcf780039e0 2024-04-25T08:48:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.507+0000 7fcf8d7fa640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcf7c06b4d0 0x7fcf7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:37.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.508+0000 7fcf8d7fa640 1 -- 172.21.15.172:0/3118847362 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fcf800aa420 con 0x7fcf780039e0 2024-04-25T08:48:37.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.508+0000 7fcf8ffff640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcf7c06b4d0 0x7fcf7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:37.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.508+0000 7fcf8ffff640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcf7c06b4d0 0x7fcf7c06d990 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcf90143af0 tx=0x7fcf84009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.512+0000 7fcf8d7fa640 1 -- 172.21.15.172:0/3118847362 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf8004a030 con 0x7fcf780039e0 2024-04-25T08:48:37.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:37.683+0000 7fcf96c76640 1 -- 172.21.15.172:0/3118847362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcf900cd8b0 con 0x7fcf780039e0 2024-04-25T08:48:38.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.383+0000 7fcf8d7fa640 1 -- 172.21.15.172:0/3118847362 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v93) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcf800044e0 con 0x7fcf780039e0 2024-04-25T08:48:38.374 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2024-04-25T08:48:38.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.386+0000 7fcf96c76640 1 -- 172.21.15.172:0/3118847362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcf7c06b4d0 msgr2=0x7fcf7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:38.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.386+0000 7fcf96c76640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcf7c06b4d0 0x7fcf7c06d990 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcf90143af0 tx=0x7fcf84009040 comp rx=0 tx=0).stop 2024-04-25T08:48:38.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.386+0000 7fcf96c76640 1 -- 172.21.15.172:0/3118847362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 msgr2=0x7fcf901606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:38.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.386+0000 7fcf96c76640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 0x7fcf901606e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009be0 tx=0x7fcf80004730 comp rx=0 tx=0).stop 2024-04-25T08:48:38.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.387+0000 7fcf96c76640 1 -- 172.21.15.172:0/3118847362 shutdown_connections 2024-04-25T08:48:38.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.387+0000 7fcf96c76640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcf7c06b4d0 0x7fcf7c06d990 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:38.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.387+0000 7fcf96c76640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf901461b0 0x7fcf90143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:38.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.387+0000 7fcf96c76640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf900cd4d0 0x7fcf90145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:38.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.387+0000 7fcf96c76640 1 --2- 172.21.15.172:0/3118847362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf780039e0 0x7fcf901606e0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:38.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.387+0000 7fcf96c76640 1 -- 172.21.15.172:0/3118847362 >> 172.21.15.172:0/3118847362 conn(0x7fcf90061c30 msgr2=0x7fcf900ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:38.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.391+0000 7fcf96c76640 1 -- 172.21.15.172:0/3118847362 shutdown_connections 2024-04-25T08:48:38.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.395+0000 7fcf96c76640 1 -- 172.21.15.172:0/3118847362 wait complete. 2024-04-25T08:48:38.406 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:48:38.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.519+0000 7f373c369640 1 Processor -- start 2024-04-25T08:48:38.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.519+0000 7f373c369640 1 -- start start 2024-04-25T08:48:38.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.520+0000 7f373c369640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37340ced80 0x7f37340d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:38.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.520+0000 7f373c369640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3734161710 0x7f37340d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:38.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.520+0000 7f373c369640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373415e000 con 0x7f373415dc20 2024-04-25T08:48:38.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.520+0000 7f373c369640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37340d1de0 con 0x7f3734161710 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.520+0000 7f373c369640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3734161c60 con 0x7f37340ced80 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f373a105640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f373415dc20 0x7f37340ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38338/0 (socket says 172.21.15.172:38338) 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f373a105640 1 -- 172.21.15.172:0/435006030 learned_addr learned my addr 172.21.15.172:0/435006030 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f373a906640 1 --2- 172.21.15.172:0/435006030 >> v2:172.21.15.186:3300/0 conn(0x7f3734161710 0x7f37340d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f3739904640 1 --2- 172.21.15.172:0/435006030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37340ced80 0x7f37340d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f3739103640 1 -- 172.21.15.172:0/435006030 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224505553 0 0) 0x7f373415e000 con 0x7f373415dc20 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f3739103640 1 -- 172.21.15.172:0/435006030 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3720003520 con 0x7f373415dc20 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f3739103640 1 -- 172.21.15.172:0/435006030 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3455215540 0 0) 0x7f3720003520 con 0x7f373415dc20 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f373a906640 1 -- 172.21.15.172:0/435006030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37340ced80 msgr2=0x7f37340d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f373a906640 1 --2- 172.21.15.172:0/435006030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37340ced80 0x7f37340d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f373a906640 1 -- 172.21.15.172:0/435006030 >> v1:172.21.15.172:6789/0 conn(0x7f373415dc20 legacy=0x7f37340ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:38.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.521+0000 7f373a906640 1 -- 172.21.15.172:0/435006030 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734161f40 con 0x7f3734161710 2024-04-25T08:48:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.522+0000 7f373a906640 1 --2- 172.21.15.172:0/435006030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3734161710 0x7f37340d2820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f372c009d90 tx=0x7f372c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fec7e683f0c205a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.522+0000 7f3739103640 1 -- 172.21.15.172:0/435006030 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730001670 con 0x7f3734161710 2024-04-25T08:48:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.522+0000 7f3739103640 1 -- 172.21.15.172:0/435006030 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c007540 con 0x7f3734161710 2024-04-25T08:48:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.522+0000 7f3739103640 1 -- 172.21.15.172:0/435006030 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c0078f0 con 0x7f3734161710 2024-04-25T08:48:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.523+0000 7f373c369640 1 -- 172.21.15.172:0/435006030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3734161710 msgr2=0x7f37340d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.523+0000 7f373c369640 1 --2- 172.21.15.172:0/435006030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3734161710 0x7f37340d2820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f372c009d90 tx=0x7f372c02a5f0 comp rx=0 tx=0).stop 2024-04-25T08:48:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.523+0000 7f373c369640 1 -- 172.21.15.172:0/435006030 shutdown_connections 2024-04-25T08:48:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.523+0000 7f373c369640 1 --2- 172.21.15.172:0/435006030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3734161710 0x7f37340d2820 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.523+0000 7f373c369640 1 --2- 172.21.15.172:0/435006030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37340ced80 0x7f37340d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:38.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.523+0000 7f373c369640 1 -- 172.21.15.172:0/435006030 >> 172.21.15.172:0/435006030 conn(0x7f37340d0420 msgr2=0x7f37340d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.523+0000 7f373c369640 1 -- 172.21.15.172:0/435006030 shutdown_connections 2024-04-25T08:48:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.523+0000 7f373c369640 1 -- 172.21.15.172:0/435006030 wait complete. 2024-04-25T08:48:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.524+0000 7f373c369640 1 Processor -- start 2024-04-25T08:48:38.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.524+0000 7f373c369640 1 -- start start 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373c369640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37340ced80 0x7f373415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373c369640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f373415dc20 0x7f373415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373c369640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3734161710 0x7f3734158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373c369640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37340b5e50 con 0x7f3734161710 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373c369640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734162500 con 0x7f373415dc20 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373c369640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37340b5fd0 con 0x7f37340ced80 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373a906640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3734161710 0x7f3734158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373a906640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3734161710 0x7f3734158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36662/0 (socket says 172.21.15.172:36662) 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373a906640 1 -- 172.21.15.172:0/2455161688 learned_addr learned my addr 172.21.15.172:0/2455161688 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373a105640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37340ced80 0x7f373415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f3739904640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f373415dc20 0x7f373415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373a906640 1 -- 172.21.15.172:0/2455161688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37340ced80 msgr2=0x7f373415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373a906640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37340ced80 0x7f373415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:38.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373a906640 1 -- 172.21.15.172:0/2455161688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f373415dc20 msgr2=0x7f373415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:38.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373a906640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f373415dc20 0x7f373415a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:38.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373a906640 1 -- 172.21.15.172:0/2455161688 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373415b5a0 con 0x7f3734161710 2024-04-25T08:48:38.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373a906640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3734161710 0x7f3734158ad0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f372c009eb0 tx=0x7f372c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:38.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f372affd640 1 -- 172.21.15.172:0/2455161688 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c040070 con 0x7f3734161710 2024-04-25T08:48:38.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f372affd640 1 -- 172.21.15.172:0/2455161688 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c03c830 con 0x7f3734161710 2024-04-25T08:48:38.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f372affd640 1 -- 172.21.15.172:0/2455161688 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c03cc20 con 0x7f3734161710 2024-04-25T08:48:38.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373c369640 1 -- 172.21.15.172:0/2455161688 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373415b880 con 0x7f3734161710 2024-04-25T08:48:38.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.525+0000 7f373c369640 1 -- 172.21.15.172:0/2455161688 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373415be40 con 0x7f3734161710 2024-04-25T08:48:38.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.526+0000 7f373c369640 1 -- 172.21.15.172:0/2455161688 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37340cf940 con 0x7f3734161710 2024-04-25T08:48:38.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.527+0000 7f372affd640 1 -- 172.21.15.172:0/2455161688 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f372c039040 con 0x7f3734161710 2024-04-25T08:48:38.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.527+0000 7f372affd640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f371806b4d0 0x7f371806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:38.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.527+0000 7f372affd640 1 -- 172.21.15.172:0/2455161688 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f372c0ab5a0 con 0x7f3734161710 2024-04-25T08:48:38.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.527+0000 7f373a105640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f371806b4d0 0x7f371806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:38.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.528+0000 7f373a105640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f371806b4d0 0x7f371806d990 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f37300011e0 tx=0x7f3730009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:38.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.532+0000 7f372affd640 1 -- 172.21.15.172:0/2455161688 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f37340cf940 con 0x7f3734161710 2024-04-25T08:48:38.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:38.740+0000 7f373c369640 1 -- 172.21.15.172:0/2455161688 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3734073a00 con 0x7f3734161710 2024-04-25T08:48:39.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.395+0000 7f372affd640 1 -- 172.21.15.172:0/2455161688 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f372c0303a0 con 0x7f3734161710 2024-04-25T08:48:39.387 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 13 and data pool 14 2024-04-25T08:48:39.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.399+0000 7f373c369640 1 -- 172.21.15.172:0/2455161688 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f371806b4d0 msgr2=0x7f371806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.399+0000 7f373c369640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f371806b4d0 0x7f371806d990 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f37300011e0 tx=0x7f3730009040 comp rx=0 tx=0).stop 2024-04-25T08:48:39.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.399+0000 7f373c369640 1 -- 172.21.15.172:0/2455161688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3734161710 msgr2=0x7f3734158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.399+0000 7f373c369640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3734161710 0x7f3734158ad0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f372c009eb0 tx=0x7f372c004a40 comp rx=0 tx=0).stop 2024-04-25T08:48:39.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.403+0000 7f373c369640 1 -- 172.21.15.172:0/2455161688 shutdown_connections 2024-04-25T08:48:39.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.403+0000 7f373c369640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f371806b4d0 0x7f371806d990 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.403+0000 7f373c369640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f373415dc20 0x7f373415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.403+0000 7f373c369640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3734161710 0x7f3734158ad0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.403+0000 7f373c369640 1 --2- 172.21.15.172:0/2455161688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37340ced80 0x7f373415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.403+0000 7f373c369640 1 -- 172.21.15.172:0/2455161688 >> 172.21.15.172:0/2455161688 conn(0x7f37340d0420 msgr2=0x7f37340d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:39.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.409+0000 7f373c369640 1 -- 172.21.15.172:0/2455161688 shutdown_connections 2024-04-25T08:48:39.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.409+0000 7f373c369640 1 -- 172.21.15.172:0/2455161688 wait complete. 2024-04-25T08:48:39.415 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:48:39.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.522+0000 7f0be6334640 1 Processor -- start 2024-04-25T08:48:39.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.522+0000 7f0be6334640 1 -- start start 2024-04-25T08:48:39.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0be6334640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0be00ce920 0x7f0be00cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0be6334640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be0144b30 con 0x7f0be006d290 2024-04-25T08:48:39.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0be6334640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be00712d0 con 0x7f0be0144750 2024-04-25T08:48:39.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0be6334640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be00715b0 con 0x7f0be00ce920 2024-04-25T08:48:39.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0bdf7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0be00ce920 0x7f0be00cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0be48d1640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0be006d290 0x7f0be006d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38340/0 (socket says 172.21.15.172:38340) 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0bdf7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0be00ce920 0x7f0be00cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36674/0 (socket says 172.21.15.172:36674) 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0be48d1640 1 -- 172.21.15.172:0/2026913353 learned_addr learned my addr 172.21.15.172:0/2026913353 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0bdf7fe640 1 -- 172.21.15.172:0/2026913353 >> v1:172.21.15.186:6789/0 conn(0x7f0be0144750 legacy=0x7f0be006e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0bdf7fe640 1 -- 172.21.15.172:0/2026913353 >> v1:172.21.15.172:6789/0 conn(0x7f0be006d290 legacy=0x7f0be006d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.523+0000 7f0bdf7fe640 1 -- 172.21.15.172:0/2026913353 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be0071890 con 0x7f0be00ce920 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.524+0000 7f0bdf7fe640 1 --2- 172.21.15.172:0/2026913353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be00ce920 0x7f0be00cedb0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00097a0 tx=0x7f0bd002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a15302e61ca2289 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.524+0000 7f0bdeffd640 1 -- 172.21.15.172:0/2026913353 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0037070 con 0x7f0be00ce920 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.524+0000 7f0bdeffd640 1 -- 172.21.15.172:0/2026913353 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd0032440 con 0x7f0be00ce920 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.524+0000 7f0bdeffd640 1 -- 172.21.15.172:0/2026913353 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd0032810 con 0x7f0be00ce920 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.524+0000 7f0be6334640 1 -- 172.21.15.172:0/2026913353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be00ce920 msgr2=0x7f0be00cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.524+0000 7f0be6334640 1 --2- 172.21.15.172:0/2026913353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be00ce920 0x7f0be00cedb0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00097a0 tx=0x7f0bd002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.525+0000 7f0be6334640 1 -- 172.21.15.172:0/2026913353 shutdown_connections 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.525+0000 7f0be6334640 1 --2- 172.21.15.172:0/2026913353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be00ce920 0x7f0be00cedb0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.525+0000 7f0be6334640 1 -- 172.21.15.172:0/2026913353 >> 172.21.15.172:0/2026913353 conn(0x7f0be006abe0 msgr2=0x7f0be006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.525+0000 7f0be6334640 1 -- 172.21.15.172:0/2026913353 shutdown_connections 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.525+0000 7f0be6334640 1 -- 172.21.15.172:0/2026913353 wait complete. 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.526+0000 7f0be6334640 1 Processor -- start 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.526+0000 7f0be6334640 1 -- start start 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0be6334640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be006d290 0x7f0be00b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0be6334640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be00ce920 0x7f0be01e5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0be6334640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0be0144750 0x7f0be0157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0be6334640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be006f020 con 0x7f0be006d290 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0be6334640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be006ece0 con 0x7f0be00ce920 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0be6334640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0145450 con 0x7f0be0144750 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be006d290 0x7f0be00b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be006d290 0x7f0be00b0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36688/0 (socket says 172.21.15.172:36688) 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdffff640 1 -- 172.21.15.172:0/3958502949 learned_addr learned my addr 172.21.15.172:0/3958502949 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0be48d1640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0be0144750 0x7f0be0157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdf7fe640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be00ce920 0x7f0be01e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdffff640 1 -- 172.21.15.172:0/3958502949 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0be0144750 msgr2=0x7f0be0157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdffff640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0be0144750 0x7f0be0157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdffff640 1 -- 172.21.15.172:0/3958502949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be00ce920 msgr2=0x7f0be01e5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdffff640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be00ce920 0x7f0be01e5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdffff640 1 -- 172.21.15.172:0/3958502949 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be01e6e20 con 0x7f0be006d290 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdf7fe640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be00ce920 0x7f0be01e5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:39.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0be48d1640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0be0144750 0x7f0be0157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdffff640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be006d290 0x7f0be00b0f80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400c430 tx=0x7f0bd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdcff9640 1 -- 172.21.15.172:0/3958502949 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4011790 con 0x7f0be006d290 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdcff9640 1 -- 172.21.15.172:0/3958502949 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd4017070 con 0x7f0be006d290 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0be6334640 1 -- 172.21.15.172:0/3958502949 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be01e5de0 con 0x7f0be006d290 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0bdcff9640 1 -- 172.21.15.172:0/3958502949 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4011bb0 con 0x7f0be006d290 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.527+0000 7f0be6334640 1 -- 172.21.15.172:0/3958502949 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be01e6620 con 0x7f0be006d290 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.528+0000 7f0be6334640 1 -- 172.21.15.172:0/3958502949 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be0073990 con 0x7f0be006d290 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.529+0000 7f0bdcff9640 1 -- 172.21.15.172:0/3958502949 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0bd401c460 con 0x7f0be006d290 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.529+0000 7f0bdcff9640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bcc06b4d0 0x7f0bcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.529+0000 7f0bdcff9640 1 -- 172.21.15.172:0/3958502949 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0bd408a280 con 0x7f0be006d290 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.529+0000 7f0bdf7fe640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bcc06b4d0 0x7f0bcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.530+0000 7f0bdf7fe640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bcc06b4d0 0x7f0bcc06d990 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0034000 tx=0x7f0bd002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:39.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.534+0000 7f0bdcff9640 1 -- 172.21.15.172:0/3958502949 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0be01e5de0 con 0x7f0be006d290 2024-04-25T08:48:39.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.704+0000 7f0be6334640 1 -- 172.21.15.172:0/3958502949 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0be00d0510 con 0x7f0be006d290 2024-04-25T08:48:39.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.705+0000 7f0bdcff9640 1 -- 172.21.15.172:0/3958502949 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16958 (secure 0 0 0) 0x7f0bd4058f70 con 0x7f0be006d290 2024-04-25T08:48:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:39.697 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":94,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:38.741590+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:48:36.951495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T08:48:37.702925+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:48:39.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 -- 172.21.15.172:0/3958502949 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bcc06b4d0 msgr2=0x7f0bcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bcc06b4d0 0x7f0bcc06d990 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0034000 tx=0x7f0bd002e000 comp rx=0 tx=0).stop 2024-04-25T08:48:39.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 -- 172.21.15.172:0/3958502949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be006d290 msgr2=0x7f0be00b0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be006d290 0x7f0be00b0f80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400c430 tx=0x7f0bd400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 -- 172.21.15.172:0/3958502949 shutdown_connections 2024-04-25T08:48:39.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0bcc06b4d0 0x7f0bcc06d990 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be00ce920 0x7f0be01e5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0be0144750 0x7f0be0157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 --2- 172.21.15.172:0/3958502949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0be006d290 0x7f0be00b0f80 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 -- 172.21.15.172:0/3958502949 >> 172.21.15.172:0/3958502949 conn(0x7f0be006abe0 msgr2=0x7f0be006e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:39.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 -- 172.21.15.172:0/3958502949 shutdown_connections 2024-04-25T08:48:39.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.707+0000 7f0be6334640 1 -- 172.21.15.172:0/3958502949 wait complete. 2024-04-25T08:48:39.710 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:48:39.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.816+0000 7fab04e9a640 1 Processor -- start 2024-04-25T08:48:39.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.816+0000 7fab04e9a640 1 -- start start 2024-04-25T08:48:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7fab04e9a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab0015b980 0x7fab000cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7fab04e9a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fab000cffb0 0x7fab0015c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7fab04e9a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0015f710 con 0x7fab0006b5f0 2024-04-25T08:48:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7fab04e9a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0015f9b0 con 0x7fab000cffb0 2024-04-25T08:48:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7fab04e9a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0015fc90 con 0x7fab0015b980 2024-04-25T08:48:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7faafed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fab000cffb0 0x7fab0015c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7faafdd9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fab0006b5f0 0x7fab000cf8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38348/0 (socket says 172.21.15.172:38348) 2024-04-25T08:48:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7faafdd9b640 1 -- 172.21.15.172:0/2013958571 learned_addr learned my addr 172.21.15.172:0/2013958571 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7faafed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fab000cffb0 0x7fab0015c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36694/0 (socket says 172.21.15.172:36694) 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7faafe59c640 1 --2- 172.21.15.172:0/2013958571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab0015b980 0x7fab000cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7faafed9d640 1 -- 172.21.15.172:0/2013958571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab0015b980 msgr2=0x7fab000cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7faafed9d640 1 --2- 172.21.15.172:0/2013958571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab0015b980 0x7fab000cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7faafed9d640 1 -- 172.21.15.172:0/2013958571 >> v1:172.21.15.172:6789/0 conn(0x7fab0006b5f0 legacy=0x7fab000cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7faafed9d640 1 -- 172.21.15.172:0/2013958571 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0015ff70 con 0x7fab000cffb0 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.817+0000 7faafd59a640 1 -- 172.21.15.172:0/2013958571 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027642401 0 0) 0x7fab0015f710 con 0x7fab0006b5f0 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.818+0000 7faafed9d640 1 --2- 172.21.15.172:0/2013958571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 0x7fab0015c0f0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009d90 tx=0x7faaf802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954db8c56e06de48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.818+0000 7faafd59a640 1 -- 172.21.15.172:0/2013958571 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8007740 con 0x7fab000cffb0 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.818+0000 7faafd59a640 1 -- 172.21.15.172:0/2013958571 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf80078e0 con 0x7fab000cffb0 2024-04-25T08:48:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.818+0000 7faafd59a640 1 -- 172.21.15.172:0/2013958571 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8007cb0 con 0x7fab000cffb0 2024-04-25T08:48:39.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.819+0000 7fab04e9a640 1 -- 172.21.15.172:0/2013958571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 msgr2=0x7fab0015c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.819+0000 7fab04e9a640 1 --2- 172.21.15.172:0/2013958571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 0x7fab0015c0f0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009d90 tx=0x7faaf802a660 comp rx=0 tx=0).stop 2024-04-25T08:48:39.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.819+0000 7fab04e9a640 1 -- 172.21.15.172:0/2013958571 shutdown_connections 2024-04-25T08:48:39.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.819+0000 7fab04e9a640 1 --2- 172.21.15.172:0/2013958571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 0x7fab0015c0f0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.819+0000 7fab04e9a640 1 --2- 172.21.15.172:0/2013958571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab0015b980 0x7fab000cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.819+0000 7fab04e9a640 1 -- 172.21.15.172:0/2013958571 >> 172.21.15.172:0/2013958571 conn(0x7fab000b2220 msgr2=0x7fab000b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.819+0000 7fab04e9a640 1 -- 172.21.15.172:0/2013958571 shutdown_connections 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.819+0000 7fab04e9a640 1 -- 172.21.15.172:0/2013958571 wait complete. 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.820+0000 7fab04e9a640 1 Processor -- start 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.820+0000 7fab04e9a640 1 -- start start 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7fab04e9a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab0006b5f0 0x7fab000b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7fab04e9a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 0x7fab000c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7fab04e9a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab0015b980 0x7fab000c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7fab04e9a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000cf550 con 0x7fab000cffb0 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7fab04e9a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0015bd60 con 0x7fab0006b5f0 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7fab04e9a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab000b2d40 con 0x7fab0015b980 2024-04-25T08:48:39.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 0x7fab000c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 0x7fab000c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36704/0 (socket says 172.21.15.172:36704) 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafdd9b640 1 -- 172.21.15.172:0/894841528 learned_addr learned my addr 172.21.15.172:0/894841528 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafe59c640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab0006b5f0 0x7fab000b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafed9d640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab0015b980 0x7fab000c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafdd9b640 1 -- 172.21.15.172:0/894841528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab0015b980 msgr2=0x7fab000c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafdd9b640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab0015b980 0x7fab000c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafdd9b640 1 -- 172.21.15.172:0/894841528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab0006b5f0 msgr2=0x7fab000b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafdd9b640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab0006b5f0 0x7fab000b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafdd9b640 1 -- 172.21.15.172:0/894841528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000b3310 con 0x7fab000cffb0 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafe59c640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab0006b5f0 0x7fab000b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faafdd9b640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 0x7fab000c5e90 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c4b0 tx=0x7faaf400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faaeeffd640 1 -- 172.21.15.172:0/894841528 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4018070 con 0x7fab000cffb0 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7faaeeffd640 1 -- 172.21.15.172:0/894841528 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf4007500 con 0x7fab000cffb0 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.821+0000 7fab04e9a640 1 -- 172.21.15.172:0/894841528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab000b35f0 con 0x7fab000cffb0 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.822+0000 7faaeeffd640 1 -- 172.21.15.172:0/894841528 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4004a20 con 0x7fab000cffb0 2024-04-25T08:48:39.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.822+0000 7fab04e9a640 1 -- 172.21.15.172:0/894841528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab000b3bb0 con 0x7fab000cffb0 2024-04-25T08:48:39.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.822+0000 7fab04e9a640 1 -- 172.21.15.172:0/894841528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab000b1c30 con 0x7fab000cffb0 2024-04-25T08:48:39.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.823+0000 7faaeeffd640 1 -- 172.21.15.172:0/894841528 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faaf401b070 con 0x7fab000cffb0 2024-04-25T08:48:39.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.823+0000 7faaeeffd640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faae006b4d0 0x7faae006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:39.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.823+0000 7faaeeffd640 1 -- 172.21.15.172:0/894841528 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faaf4089660 con 0x7fab000cffb0 2024-04-25T08:48:39.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.823+0000 7faafe59c640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faae006b4d0 0x7faae006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:39.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.824+0000 7faafe59c640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faae006b4d0 0x7faae006d990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faaf0006fd0 tx=0x7faaf0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:39.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:39.827+0000 7faaeeffd640 1 -- 172.21.15.172:0/894841528 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab000b1c30 con 0x7fab000cffb0 2024-04-25T08:48:39.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.000+0000 7fab04e9a640 1 -- 172.21.15.172:0/894841528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab00073990 con 0x7fab000cffb0 2024-04-25T08:48:39.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.001+0000 7faaeeffd640 1 -- 172.21.15.172:0/894841528 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+16958 (secure 0 0 0) 0x7faaf4087e20 con 0x7fab000cffb0 2024-04-25T08:48:39.993 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:39.993 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":94,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:38.741590+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:48:36.951495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T08:48:37.702925+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:48:39.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 -- 172.21.15.172:0/894841528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faae006b4d0 msgr2=0x7faae006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faae006b4d0 0x7faae006d990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faaf0006fd0 tx=0x7faaf0008040 comp rx=0 tx=0).stop 2024-04-25T08:48:39.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 -- 172.21.15.172:0/894841528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 msgr2=0x7fab000c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:39.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 0x7fab000c5e90 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c4b0 tx=0x7faaf400c970 comp rx=0 tx=0).stop 2024-04-25T08:48:39.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 -- 172.21.15.172:0/894841528 shutdown_connections 2024-04-25T08:48:39.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faae006b4d0 0x7faae006d990 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab0015b980 0x7fab000c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab000cffb0 0x7fab000c5e90 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 --2- 172.21.15.172:0/894841528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab0006b5f0 0x7fab000b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:39.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 -- 172.21.15.172:0/894841528 >> 172.21.15.172:0/894841528 conn(0x7fab000b2220 msgr2=0x7fab000aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:39.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 -- 172.21.15.172:0/894841528 shutdown_connections 2024-04-25T08:48:39.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.003+0000 7fab04e9a640 1 -- 172.21.15.172:0/894841528 wait complete. 2024-04-25T08:48:40.006 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:48:40.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.115+0000 7f15dee41640 1 Processor -- start 2024-04-25T08:48:40.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.115+0000 7f15dee41640 1 -- start start 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15dee41640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f15d80cc4f0 0x7f15d80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15dee41640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d8072280 con 0x7f15d815b980 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15dee41640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d80714c0 con 0x7f15d80cdb20 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15dee41640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d8071270 con 0x7f15d80cc4f0 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15dd3de640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f15d815b980 0x7f15d80ae500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38350/0 (socket says 172.21.15.172:38350) 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15dd3de640 1 -- 172.21.15.172:0/943857608 learned_addr learned my addr 172.21.15.172:0/943857608 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15dcbdd640 1 --2- 172.21.15.172:0/943857608 >> v2:172.21.15.186:3300/0 conn(0x7f15d80cc4f0 0x7f15d80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794610537 0 0) 0x7f15d8072280 con 0x7f15d815b980 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c8003520 con 0x7f15d815b980 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1490090923 0 0) 0x7f15c8003520 con 0x7f15d815b980 2024-04-25T08:48:40.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 >> v2:172.21.15.186:3300/0 conn(0x7f15d80cc4f0 msgr2=0x7f15d80cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 --2- 172.21.15.172:0/943857608 >> v2:172.21.15.186:3300/0 conn(0x7f15d80cc4f0 0x7f15d80cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 >> v1:172.21.15.186:6789/0 conn(0x7f15d80cdb20 legacy=0x7f15d815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d80717a0 con 0x7f15d815b980 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f15d00019f0 con 0x7f15d815b980 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 >> v1:172.21.15.172:6789/0 conn(0x7f15d815b980 legacy=0x7f15d80ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15c8004800 0x7f15c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15c80051c0 0x7f15c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d8071270 con 0x7f15c80039b0 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c800c060 con 0x7f15c80051c0 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.116+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c800c260 con 0x7f15c8004800 2024-04-25T08:48:40.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15dcbdd640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15dd3de640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15c80051c0 0x7f15c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15d7fff640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15c8004800 0x7f15c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15dcbdd640 1 -- 172.21.15.172:0/943857608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15c8004800 msgr2=0x7f15c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:40.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15dcbdd640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15c8004800 0x7f15c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15dcbdd640 1 -- 172.21.15.172:0/943857608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15c80051c0 msgr2=0x7f15c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:40.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15dcbdd640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15c80051c0 0x7f15c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15dcbdd640 1 -- 172.21.15.172:0/943857608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8003520 con 0x7f15c80039b0 2024-04-25T08:48:40.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15dd3de640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15c80051c0 0x7f15c800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:40.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15dd3de640 1 -- 172.21.15.172:0/943857608 reap_dead start 2024-04-25T08:48:40.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.117+0000 7f15dcbdd640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15c8003dd0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009ac0 tx=0x7f15c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ed224423181138 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:40.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.118+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc036070 con 0x7f15c80039b0 2024-04-25T08:48:40.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.118+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc031400 con 0x7f15c80039b0 2024-04-25T08:48:40.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.118+0000 7f15d77fe640 1 -- 172.21.15.172:0/943857608 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc009690 con 0x7f15c80039b0 2024-04-25T08:48:40.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.118+0000 7f15dee41640 1 -- 172.21.15.172:0/943857608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 msgr2=0x7f15c8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.118+0000 7f15dee41640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15c8003dd0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009ac0 tx=0x7f15c8005830 comp rx=0 tx=0).stop 2024-04-25T08:48:40.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.118+0000 7f15dee41640 1 -- 172.21.15.172:0/943857608 shutdown_connections 2024-04-25T08:48:40.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.118+0000 7f15dee41640 1 --2- 172.21.15.172:0/943857608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15c8003dd0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.118+0000 7f15dee41640 1 -- 172.21.15.172:0/943857608 >> 172.21.15.172:0/943857608 conn(0x7f15d806abe0 msgr2=0x7f15d806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:40.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.118+0000 7f15dee41640 1 -- 172.21.15.172:0/943857608 shutdown_connections 2024-04-25T08:48:40.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.118+0000 7f15dee41640 1 -- 172.21.15.172:0/943857608 wait complete. 2024-04-25T08:48:40.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.119+0000 7f15dee41640 1 Processor -- start 2024-04-25T08:48:40.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.119+0000 7f15dee41640 1 -- start start 2024-04-25T08:48:40.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dee41640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15d8155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dee41640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15d81e5330 0x7f15d81e4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dee41640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15d81e57b0 0x7f15d813be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dee41640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d8071d60 con 0x7f15c80039b0 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dee41640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d815bd80 con 0x7f15d81e5330 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dee41640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d80cc8d0 con 0x7f15d81e57b0 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dcbdd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15d8155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dcbdd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15d8155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36724/0 (socket says 172.21.15.172:36724) 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dcbdd640 1 -- 172.21.15.172:0/426544955 learned_addr learned my addr 172.21.15.172:0/426544955 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dcbdd640 1 -- 172.21.15.172:0/426544955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15d81e57b0 msgr2=0x7f15d813be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.120+0000 7f15dcbdd640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15d81e57b0 0x7f15d813be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.121+0000 7f15dcbdd640 1 -- 172.21.15.172:0/426544955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15d81e5330 msgr2=0x7f15d81e4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.121+0000 7f15dcbdd640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15d81e5330 0x7f15d81e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.121+0000 7f15dcbdd640 1 -- 172.21.15.172:0/426544955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d814d720 con 0x7f15c80039b0 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.121+0000 7f15dcbdd640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15d8155600 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009be0 tx=0x7f15cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:40.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.121+0000 7f15d57fa640 1 -- 172.21.15.172:0/426544955 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc03f020 con 0x7f15c80039b0 2024-04-25T08:48:40.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.121+0000 7f15d57fa640 1 -- 172.21.15.172:0/426544955 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc037040 con 0x7f15c80039b0 2024-04-25T08:48:40.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.121+0000 7f15d57fa640 1 -- 172.21.15.172:0/426544955 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc036070 con 0x7f15c80039b0 2024-04-25T08:48:40.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.121+0000 7f15dee41640 1 -- 172.21.15.172:0/426544955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d813a140 con 0x7f15c80039b0 2024-04-25T08:48:40.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.121+0000 7f15dee41640 1 -- 172.21.15.172:0/426544955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d813a700 con 0x7f15c80039b0 2024-04-25T08:48:40.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.122+0000 7f15dee41640 1 -- 172.21.15.172:0/426544955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d8073a00 con 0x7f15c80039b0 2024-04-25T08:48:40.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.122+0000 7f15d57fa640 1 -- 172.21.15.172:0/426544955 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f15cc042020 con 0x7f15c80039b0 2024-04-25T08:48:40.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.123+0000 7f15d57fa640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15bc06b4d0 0x7f15bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.123+0000 7f15d57fa640 1 -- 172.21.15.172:0/426544955 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f15cc0aa280 con 0x7f15c80039b0 2024-04-25T08:48:40.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.123+0000 7f15d7fff640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15bc06b4d0 0x7f15bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.123+0000 7f15d7fff640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15bc06b4d0 0x7f15bc06d990 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f15c4007fd0 tx=0x7f15c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:40.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.127+0000 7f15d57fa640 1 -- 172.21.15.172:0/426544955 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f15cc049030 con 0x7f15c80039b0 2024-04-25T08:48:40.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.335+0000 7f15dee41640 1 -- 172.21.15.172:0/426544955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f15d806d3a0 con 0x7f15c80039b0 2024-04-25T08:48:40.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.395+0000 7f15d57fa640 1 -- 172.21.15.172:0/426544955 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7f15cc0790c0 con 0x7f15c80039b0 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 -- 172.21.15.172:0/426544955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15bc06b4d0 msgr2=0x7f15bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15bc06b4d0 0x7f15bc06d990 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f15c4007fd0 tx=0x7f15c4009040 comp rx=0 tx=0).stop 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 -- 172.21.15.172:0/426544955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 msgr2=0x7f15d8155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15d8155600 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009be0 tx=0x7f15cc004730 comp rx=0 tx=0).stop 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 -- 172.21.15.172:0/426544955 shutdown_connections 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15bc06b4d0 0x7f15bc06d990 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15d81e5330 0x7f15d81e4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15d81e57b0 0x7f15d813be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 --2- 172.21.15.172:0/426544955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15c80039b0 0x7f15d8155600 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 -- 172.21.15.172:0/426544955 >> 172.21.15.172:0/426544955 conn(0x7f15d806abe0 msgr2=0x7f15d806e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 -- 172.21.15.172:0/426544955 shutdown_connections 2024-04-25T08:48:40.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.397+0000 7f15dee41640 1 -- 172.21.15.172:0/426544955 wait complete. 2024-04-25T08:48:40.399 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:48:40.400 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:48:40.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.509+0000 7f53aa7bd640 1 Processor -- start 2024-04-25T08:48:40.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.509+0000 7f53aa7bd640 1 -- start start 2024-04-25T08:48:40.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53aa7bd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 0x7f53a40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53aa7bd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53a415deb0 0x7f53a415e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53aa7bd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40d1770 con 0x7f53a4070dc0 2024-04-25T08:48:40.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53aa7bd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a41622b0 con 0x7f53a415deb0 2024-04-25T08:48:40.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53aa7bd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40b10f0 con 0x7f53a406ccd0 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a8d5a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53a415deb0 0x7f53a415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a8d5a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53a415deb0 0x7f53a415e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36730/0 (socket says 172.21.15.172:36730) 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a3fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f53a4070dc0 0x7f53a40711a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38356/0 (socket says 172.21.15.172:38356) 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a8d5a640 1 -- 172.21.15.172:0/4038397544 learned_addr learned my addr 172.21.15.172:0/4038397544 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a37fe640 1 --2- 172.21.15.172:0/4038397544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 0x7f53a40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a8d5a640 1 -- 172.21.15.172:0/4038397544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 msgr2=0x7f53a40b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a8d5a640 1 --2- 172.21.15.172:0/4038397544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 0x7f53a40b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a8d5a640 1 -- 172.21.15.172:0/4038397544 >> v1:172.21.15.172:6789/0 conn(0x7f53a4070dc0 legacy=0x7f53a40711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a2ffd640 1 -- 172.21.15.172:0/4038397544 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133451255 0 0) 0x7f53a40d1770 con 0x7f53a4070dc0 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a8d5a640 1 -- 172.21.15.172:0/4038397544 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4162740 con 0x7f53a415deb0 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.510+0000 7f53a37fe640 1 --2- 172.21.15.172:0/4038397544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 0x7f53a40b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.511+0000 7f53a8d5a640 1 --2- 172.21.15.172:0/4038397544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 0x7f53a415e340 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f539c009e50 tx=0x7f539c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52121ec3fefc8b70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.511+0000 7f53a2ffd640 1 -- 172.21.15.172:0/4038397544 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c036070 con 0x7f53a415deb0 2024-04-25T08:48:40.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.511+0000 7f53a2ffd640 1 -- 172.21.15.172:0/4038397544 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c031600 con 0x7f53a415deb0 2024-04-25T08:48:40.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.511+0000 7f53a2ffd640 1 -- 172.21.15.172:0/4038397544 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0319d0 con 0x7f53a415deb0 2024-04-25T08:48:40.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.512+0000 7f53aa7bd640 1 -- 172.21.15.172:0/4038397544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 msgr2=0x7f53a415e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.512+0000 7f53aa7bd640 1 --2- 172.21.15.172:0/4038397544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 0x7f53a415e340 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f539c009e50 tx=0x7f539c02a5f0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.512+0000 7f53aa7bd640 1 -- 172.21.15.172:0/4038397544 shutdown_connections 2024-04-25T08:48:40.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.512+0000 7f53aa7bd640 1 --2- 172.21.15.172:0/4038397544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 0x7f53a40b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.512+0000 7f53aa7bd640 1 --2- 172.21.15.172:0/4038397544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 0x7f53a415e340 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.512+0000 7f53aa7bd640 1 -- 172.21.15.172:0/4038397544 >> 172.21.15.172:0/4038397544 conn(0x7f53a40b3530 msgr2=0x7f53a40b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:40.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.512+0000 7f53aa7bd640 1 -- 172.21.15.172:0/4038397544 shutdown_connections 2024-04-25T08:48:40.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.512+0000 7f53aa7bd640 1 -- 172.21.15.172:0/4038397544 wait complete. 2024-04-25T08:48:40.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.513+0000 7f53aa7bd640 1 Processor -- start 2024-04-25T08:48:40.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.513+0000 7f53aa7bd640 1 -- start start 2024-04-25T08:48:40.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53aa7bd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 0x7f53a41f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53aa7bd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a4070dc0 0x7f53a41f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53aa7bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 0x7f53a41f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53aa7bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4161f40 con 0x7f53a415deb0 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53aa7bd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4161c60 con 0x7f53a4070dc0 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53aa7bd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40b5840 con 0x7f53a406ccd0 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53a8d5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 0x7f53a41f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53a8d5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 0x7f53a41f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36732/0 (socket says 172.21.15.172:36732) 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53a8d5a640 1 -- 172.21.15.172:0/2879578641 learned_addr learned my addr 172.21.15.172:0/2879578641 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53a37fe640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a4070dc0 0x7f53a41f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53a3fff640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 0x7f53a41f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53a8d5a640 1 -- 172.21.15.172:0/2879578641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 msgr2=0x7f53a41f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53a8d5a640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 0x7f53a41f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53a8d5a640 1 -- 172.21.15.172:0/2879578641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a4070dc0 msgr2=0x7f53a41f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53a8d5a640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a4070dc0 0x7f53a41f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.514+0000 7f53a8d5a640 1 -- 172.21.15.172:0/2879578641 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a415f1b0 con 0x7f53a415deb0 2024-04-25T08:48:40.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.515+0000 7f53a8d5a640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 0x7f53a41f7590 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f539c009e50 tx=0x7f539c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.515+0000 7f53a0ff9640 1 -- 172.21.15.172:0/2879578641 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c041070 con 0x7f53a415deb0 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.515+0000 7f53a0ff9640 1 -- 172.21.15.172:0/2879578641 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c003990 con 0x7f53a415deb0 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.515+0000 7f53a0ff9640 1 -- 172.21.15.172:0/2879578641 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c036040 con 0x7f53a415deb0 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.515+0000 7f53aa7bd640 1 -- 172.21.15.172:0/2879578641 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a415f490 con 0x7f53a415deb0 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.515+0000 7f53aa7bd640 1 -- 172.21.15.172:0/2879578641 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a415fa50 con 0x7f53a415deb0 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.516+0000 7f53aa7bd640 1 -- 172.21.15.172:0/2879578641 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a4073a00 con 0x7f53a415deb0 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.516+0000 7f53a0ff9640 1 -- 172.21.15.172:0/2879578641 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f539c007800 con 0x7f53a415deb0 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.517+0000 7f53a0ff9640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f539006b4d0 0x7f539006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.517+0000 7f53a0ff9640 1 -- 172.21.15.172:0/2879578641 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f539c0ab090 con 0x7f53a415deb0 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.517+0000 7f53a3fff640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f539006b4d0 0x7f539006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:40.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.517+0000 7f53a3fff640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f539006b4d0 0x7f539006d990 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5394000f60 tx=0x7f5394007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:40.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.521+0000 7f53a0ff9640 1 -- 172.21.15.172:0/2879578641 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f539c04b020 con 0x7f53a415deb0 2024-04-25T08:48:40.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:40.730+0000 7f53aa7bd640 1 -- 172.21.15.172:0/2879578641 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f53a4160e40 con 0x7f53a415deb0 2024-04-25T08:48:41.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.403+0000 7f53a0ff9640 1 -- 172.21.15.172:0/2879578641 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) v1 ==== 122+0+0 (secure 0 0 0) 0x7f539c079d80 con 0x7f53a415deb0 2024-04-25T08:48:41.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 -- 172.21.15.172:0/2879578641 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f539006b4d0 msgr2=0x7f539006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f539006b4d0 0x7f539006d990 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5394000f60 tx=0x7f5394007b50 comp rx=0 tx=0).stop 2024-04-25T08:48:41.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 -- 172.21.15.172:0/2879578641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 msgr2=0x7f53a41f7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 0x7f53a41f7590 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f539c009e50 tx=0x7f539c004a40 comp rx=0 tx=0).stop 2024-04-25T08:48:41.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 -- 172.21.15.172:0/2879578641 shutdown_connections 2024-04-25T08:48:41.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f539006b4d0 0x7f539006d990 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53a4070dc0 0x7f53a41f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a415deb0 0x7f53a41f7590 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 --2- 172.21.15.172:0/2879578641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53a406ccd0 0x7f53a41f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 -- 172.21.15.172:0/2879578641 >> 172.21.15.172:0/2879578641 conn(0x7f53a40b3530 msgr2=0x7f53a40b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:41.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 -- 172.21.15.172:0/2879578641 shutdown_connections 2024-04-25T08:48:41.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.406+0000 7f53aa7bd640 1 -- 172.21.15.172:0/2879578641 wait complete. 2024-04-25T08:48:41.410 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:48:41.411 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:48:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.523+0000 7fbfb6909640 1 Processor -- start 2024-04-25T08:48:41.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.523+0000 7fbfb6909640 1 -- start start 2024-04-25T08:48:41.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfb6909640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbfb006abe0 0x7fbfb006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfb6909640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbfb00ce330 0x7fbfb006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfb6909640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb01626e0 con 0x7fbfb00700a0 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfb6909640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb006b500 con 0x7fbfb006abe0 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfb6909640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00cd270 con 0x7fbfb00ce330 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfaffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbfb006abe0 0x7fbfb006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfaffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbfb006abe0 0x7fbfb006afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36734/0 (socket says 172.21.15.172:36734) 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfaffff640 1 -- 172.21.15.172:0/98892168 learned_addr learned my addr 172.21.15.172:0/98892168 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfaf7fe640 1 --2- 172.21.15.172:0/98892168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbfb00ce330 0x7fbfb006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfaffff640 1 -- 172.21.15.172:0/98892168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbfb00ce330 msgr2=0x7fbfb006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfaffff640 1 --2- 172.21.15.172:0/98892168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbfb00ce330 0x7fbfb006fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfaffff640 1 -- 172.21.15.172:0/98892168 >> v1:172.21.15.186:6789/0 conn(0x7fbfb00700a0 legacy=0x7fbfb006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.524+0000 7fbfaffff640 1 -- 172.21.15.172:0/98892168 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00cd550 con 0x7fbfb006abe0 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.525+0000 7fbfaffff640 1 --2- 172.21.15.172:0/98892168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 0x7fbfb006afc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009870 tx=0x7fbfa002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e46dea90481fe2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.525+0000 7fbfaeffd640 1 -- 172.21.15.172:0/98892168 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0037070 con 0x7fbfb006abe0 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.525+0000 7fbfaeffd640 1 -- 172.21.15.172:0/98892168 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa0032440 con 0x7fbfb006abe0 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.525+0000 7fbfaeffd640 1 -- 172.21.15.172:0/98892168 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0032810 con 0x7fbfb006abe0 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.526+0000 7fbfb6909640 1 -- 172.21.15.172:0/98892168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 msgr2=0x7fbfb006afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.526+0000 7fbfb6909640 1 --2- 172.21.15.172:0/98892168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 0x7fbfb006afc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009870 tx=0x7fbfa002a180 comp rx=0 tx=0).stop 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.526+0000 7fbfb6909640 1 -- 172.21.15.172:0/98892168 shutdown_connections 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.526+0000 7fbfb6909640 1 --2- 172.21.15.172:0/98892168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbfb00ce330 0x7fbfb006fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.526+0000 7fbfb6909640 1 --2- 172.21.15.172:0/98892168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 0x7fbfb006afc0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.526+0000 7fbfb6909640 1 -- 172.21.15.172:0/98892168 >> 172.21.15.172:0/98892168 conn(0x7fbfb00b2220 msgr2=0x7fbfb00b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.526+0000 7fbfb6909640 1 -- 172.21.15.172:0/98892168 shutdown_connections 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.526+0000 7fbfb6909640 1 -- 172.21.15.172:0/98892168 wait complete. 2024-04-25T08:48:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.527+0000 7fbfb6909640 1 Processor -- start 2024-04-25T08:48:41.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.527+0000 7fbfb6909640 1 -- start start 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfb6909640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 0x7fbfb015cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfb6909640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfb00700a0 0x7fbfb00b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfb6909640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbfb00ce330 0x7fbfb01f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfb6909640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0161780 con 0x7fbfb006abe0 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfb6909640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00cdb10 con 0x7fbfb00700a0 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfb6909640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb006eb00 con 0x7fbfb00ce330 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfaffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 0x7fbfb015cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfaffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 0x7fbfb015cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36740/0 (socket says 172.21.15.172:36740) 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfaffff640 1 -- 172.21.15.172:0/1998391220 learned_addr learned my addr 172.21.15.172:0/1998391220 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfb4ea6640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbfb00ce330 0x7fbfb01f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfaf7fe640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfb00700a0 0x7fbfb00b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfaffff640 1 -- 172.21.15.172:0/1998391220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbfb00ce330 msgr2=0x7fbfb01f3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfaffff640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbfb00ce330 0x7fbfb01f3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfaffff640 1 -- 172.21.15.172:0/1998391220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfb00700a0 msgr2=0x7fbfb00b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfaffff640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfb00700a0 0x7fbfb00b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfaffff640 1 -- 172.21.15.172:0/1998391220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb014ca20 con 0x7fbfb006abe0 2024-04-25T08:48:41.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.528+0000 7fbfaf7fe640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfb00700a0 0x7fbfb00b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:41.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.529+0000 7fbfaffff640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 0x7fbfb015cd10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009870 tx=0x7fbfa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:41.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.529+0000 7fbfacff9640 1 -- 172.21.15.172:0/1998391220 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0041070 con 0x7fbfb006abe0 2024-04-25T08:48:41.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.529+0000 7fbfacff9640 1 -- 172.21.15.172:0/1998391220 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa003c890 con 0x7fbfb006abe0 2024-04-25T08:48:41.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.529+0000 7fbfacff9640 1 -- 172.21.15.172:0/1998391220 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0037040 con 0x7fbfb006abe0 2024-04-25T08:48:41.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.529+0000 7fbfb6909640 1 -- 172.21.15.172:0/1998391220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb014cd00 con 0x7fbfb006abe0 2024-04-25T08:48:41.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.529+0000 7fbfb6909640 1 -- 172.21.15.172:0/1998391220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb014d5a0 con 0x7fbfb006abe0 2024-04-25T08:48:41.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.530+0000 7fbfb6909640 1 -- 172.21.15.172:0/1998391220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb014ced0 con 0x7fbfb006abe0 2024-04-25T08:48:41.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.530+0000 7fbfacff9640 1 -- 172.21.15.172:0/1998391220 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbfa0044070 con 0x7fbfb006abe0 2024-04-25T08:48:41.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.531+0000 7fbfacff9640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf9c06b4d0 0x7fbf9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.531+0000 7fbfacff9640 1 -- 172.21.15.172:0/1998391220 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbfa00aaca0 con 0x7fbfb006abe0 2024-04-25T08:48:41.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.531+0000 7fbfaf7fe640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf9c06b4d0 0x7fbf9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.531+0000 7fbfaf7fe640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf9c06b4d0 0x7fbf9c06d990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4006fd0 tx=0x7fbfa4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:41.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.535+0000 7fbfacff9640 1 -- 172.21.15.172:0/1998391220 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbfa0079340 con 0x7fbfb006abe0 2024-04-25T08:48:41.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.743+0000 7fbfb6909640 1 -- 172.21.15.172:0/1998391220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfb00afe50 con 0x7fbfb006abe0 2024-04-25T08:48:41.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.743+0000 7fbfacff9640 1 -- 172.21.15.172:0/1998391220 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fbfa007d3e0 con 0x7fbfb006abe0 2024-04-25T08:48:41.734 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:41.735 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/154236059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":154236059},{"type":"v1","addr":"172.21.15.172:6837","nonce":154236059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/985041095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":985041095},{"type":"v1","addr":"172.21.15.186:6835","nonce":985041095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7686,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1301700155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1301700155},{"type":"v1","addr":"172.21.15.172:6836","nonce":1301700155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:48:38.741906+0000","modified":"2024-04-25T08:48:40.732152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6834/246475597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":246475597},{"type":"v1","addr":"172.21.15.186:6834","nonce":246475597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:48:41.735 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 56 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.745+0000 7fbfb6909640 1 -- 172.21.15.172:0/1998391220 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf9c06b4d0 msgr2=0x7fbf9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.745+0000 7fbfb6909640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf9c06b4d0 0x7fbf9c06d990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4006fd0 tx=0x7fbfa4008040 comp rx=0 tx=0).stop 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.745+0000 7fbfb6909640 1 -- 172.21.15.172:0/1998391220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 msgr2=0x7fbfb015cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.745+0000 7fbfb6909640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 0x7fbfb015cd10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009870 tx=0x7fbfa00046c0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.745+0000 7fbfb6909640 1 -- 172.21.15.172:0/1998391220 shutdown_connections 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.745+0000 7fbfb6909640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf9c06b4d0 0x7fbf9c06d990 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.745+0000 7fbfb6909640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfb00700a0 0x7fbfb00b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.745+0000 7fbfb6909640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbfb00ce330 0x7fbfb01f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.745+0000 7fbfb6909640 1 --2- 172.21.15.172:0/1998391220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfb006abe0 0x7fbfb015cd10 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.745+0000 7fbfb6909640 1 -- 172.21.15.172:0/1998391220 >> 172.21.15.172:0/1998391220 conn(0x7fbfb00b2220 msgr2=0x7fbfb0161990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:41.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.746+0000 7fbfb6909640 1 -- 172.21.15.172:0/1998391220 shutdown_connections 2024-04-25T08:48:41.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.746+0000 7fbfb6909640 1 -- 172.21.15.172:0/1998391220 wait complete. 2024-04-25T08:48:41.748 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:48:41.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.854+0000 7f47a65e0640 1 Processor -- start 2024-04-25T08:48:41.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.854+0000 7f47a65e0640 1 -- start start 2024-04-25T08:48:41.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.855+0000 7f47a65e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a006c1d0 0x7f47a0168930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.855+0000 7f47a65e0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a00adcf0 con 0x7f47a0071ac0 2024-04-25T08:48:41.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.855+0000 7f47a65e0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a015ec60 con 0x7f47a0154ed0 2024-04-25T08:48:41.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.855+0000 7f47a65e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a015ef40 con 0x7f47a006c1d0 2024-04-25T08:48:41.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.855+0000 7f479f7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f47a0071ac0 0x7f47a00ad5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38370/0 (socket says 172.21.15.172:38370) 2024-04-25T08:48:41.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.855+0000 7f479f7fe640 1 -- 172.21.15.172:0/1079023551 learned_addr learned my addr 172.21.15.172:0/1079023551 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:41.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.855+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491666464 0 0) 0x7f47a00adcf0 con 0x7f47a0071ac0 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.855+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4788003520 con 0x7f47a0071ac0 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.855+0000 7f47a4b7d640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a006c1d0 0x7f47a0168930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1273204396 0 0) 0x7f4788003520 con 0x7f47a0071ac0 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a006c1d0 msgr2=0x7f47a0168930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a006c1d0 0x7f47a0168930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 >> v1:172.21.15.186:6789/0 conn(0x7f47a0154ed0 legacy=0x7f47a00aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a006db90 con 0x7f47a0071ac0 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f4794001670 con 0x7f47a0071ac0 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 >> v1:172.21.15.172:6789/0 conn(0x7f47a0071ac0 legacy=0x7f47a00ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a006c1d0 0x7f47880039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4788004060 0x7f4788004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4788004d40 0x7f47880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a015ef40 con 0x7f4788004060 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478800bc00 con 0x7f4788004d40 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478800be00 con 0x7f47a006c1d0 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479f7fe640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4788004060 0x7f4788004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f47a4b7d640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4788004d40 0x7f47880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479ffff640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a006c1d0 0x7f47880039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479f7fe640 1 -- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a006c1d0 msgr2=0x7f47880039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479f7fe640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a006c1d0 0x7f47880039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479f7fe640 1 -- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4788004d40 msgr2=0x7f47880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479f7fe640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4788004d40 0x7f47880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479f7fe640 1 -- 172.21.15.172:0/1079023551 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4788003520 con 0x7f4788004060 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f47a4b7d640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4788004d40 0x7f47880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.856+0000 7f479ffff640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a006c1d0 0x7f47880039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.857+0000 7f479f7fe640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4788004060 0x7f4788004800 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f47a0071ea0 tx=0x7f4788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323dae2615f27fd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:41.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.857+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794007c60 con 0x7f4788004060 2024-04-25T08:48:41.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.857+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794005af0 con 0x7f4788004060 2024-04-25T08:48:41.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.857+0000 7f479effd640 1 -- 172.21.15.172:0/1079023551 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794007070 con 0x7f4788004060 2024-04-25T08:48:41.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.857+0000 7f47a65e0640 1 -- 172.21.15.172:0/1079023551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4788004060 msgr2=0x7f4788004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.857+0000 7f47a65e0640 1 --2- 172.21.15.172:0/1079023551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4788004060 0x7f4788004800 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f47a0071ea0 tx=0x7f4788005830 comp rx=0 tx=0).stop 2024-04-25T08:48:41.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.857+0000 7f47a4b7d640 1 -- 172.21.15.172:0/1079023551 reap_dead start 2024-04-25T08:48:41.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.858+0000 7f47a65e0640 1 -- 172.21.15.172:0/1079023551 shutdown_connections 2024-04-25T08:48:41.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.858+0000 7f47a65e0640 1 -- 172.21.15.172:0/1079023551 >> 172.21.15.172:0/1079023551 conn(0x7f47a00af670 msgr2=0x7f47a00b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:41.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.858+0000 7f47a65e0640 1 -- 172.21.15.172:0/1079023551 shutdown_connections 2024-04-25T08:48:41.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.858+0000 7f47a65e0640 1 -- 172.21.15.172:0/1079023551 wait complete. 2024-04-25T08:48:41.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.859+0000 7f47a65e0640 1 Processor -- start 2024-04-25T08:48:41.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.859+0000 7f47a65e0640 1 -- start start 2024-04-25T08:48:41.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f47a65e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a013d7a0 0x7f47a0161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f47a65e0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47a0161ca0 0x7f47a00b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f47a65e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a00b4810 0x7f47a00cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f47a65e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0166aa0 con 0x7f47a013d7a0 2024-04-25T08:48:41.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f47a65e0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0166920 con 0x7f47a0161ca0 2024-04-25T08:48:41.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f47a65e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0166c20 con 0x7f47a00b4810 2024-04-25T08:48:41.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a013d7a0 0x7f47a0161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a013d7a0 0x7f47a0161760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36754/0 (socket says 172.21.15.172:36754) 2024-04-25T08:48:41.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479ffff640 1 -- 172.21.15.172:0/1283605360 learned_addr learned my addr 172.21.15.172:0/1283605360 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:41.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f47a4b7d640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a00b4810 0x7f47a00cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479f7fe640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47a0161ca0 0x7f47a00b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479ffff640 1 -- 172.21.15.172:0/1283605360 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a00b4810 msgr2=0x7f47a00cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479ffff640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a00b4810 0x7f47a00cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479ffff640 1 -- 172.21.15.172:0/1283605360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47a0161ca0 msgr2=0x7f47a00b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479ffff640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47a0161ca0 0x7f47a00b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479ffff640 1 -- 172.21.15.172:0/1283605360 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a00b2f30 con 0x7f47a013d7a0 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479ffff640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a013d7a0 0x7f47a0161760 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f479000e580 tx=0x7f479000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479cff9640 1 -- 172.21.15.172:0/1283605360 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900052e0 con 0x7f47a013d7a0 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479cff9640 1 -- 172.21.15.172:0/1283605360 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790018070 con 0x7f47a013d7a0 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f47a65e0640 1 -- 172.21.15.172:0/1283605360 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a00b3210 con 0x7f47a013d7a0 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f479cff9640 1 -- 172.21.15.172:0/1283605360 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790003830 con 0x7f47a013d7a0 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.860+0000 7f47a65e0640 1 -- 172.21.15.172:0/1283605360 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a00b37d0 con 0x7f47a013d7a0 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.861+0000 7f47a65e0640 1 -- 172.21.15.172:0/1283605360 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a0073990 con 0x7f47a013d7a0 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.862+0000 7f479cff9640 1 -- 172.21.15.172:0/1283605360 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f47900039d0 con 0x7f47a013d7a0 2024-04-25T08:48:41.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.862+0000 7f479cff9640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f478c06b4d0 0x7f478c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:41.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.862+0000 7f479f7fe640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f478c06b4d0 0x7f478c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:41.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.862+0000 7f479cff9640 1 -- 172.21.15.172:0/1283605360 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f479008a060 con 0x7f47a013d7a0 2024-04-25T08:48:41.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.863+0000 7f479f7fe640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f478c06b4d0 0x7f478c06d990 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4794001050 tx=0x7f4794009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:41.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:41.866+0000 7f479cff9640 1 -- 172.21.15.172:0/1283605360 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4790058d60 con 0x7f47a013d7a0 2024-04-25T08:48:42.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.040+0000 7f47a65e0640 1 -- 172.21.15.172:0/1283605360 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47a00cf6e0 con 0x7f47a013d7a0 2024-04-25T08:48:42.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.042+0000 7f479cff9640 1 -- 172.21.15.172:0/1283605360 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16945 (secure 0 0 0) 0x7f4790058660 con 0x7f47a013d7a0 2024-04-25T08:48:42.033 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:42.033 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":95,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:40.385755+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:48:36.951495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T08:48:37.702925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:48:42.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 -- 172.21.15.172:0/1283605360 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f478c06b4d0 msgr2=0x7f478c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f478c06b4d0 0x7f478c06d990 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4794001050 tx=0x7f4794009030 comp rx=0 tx=0).stop 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 -- 172.21.15.172:0/1283605360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a013d7a0 msgr2=0x7f47a0161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a013d7a0 0x7f47a0161760 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f479000e580 tx=0x7f479000ea40 comp rx=0 tx=0).stop 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 -- 172.21.15.172:0/1283605360 shutdown_connections 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f478c06b4d0 0x7f478c06d990 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47a0161ca0 0x7f47a00b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47a00b4810 0x7f47a00cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 --2- 172.21.15.172:0/1283605360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47a013d7a0 0x7f47a0161760 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 -- 172.21.15.172:0/1283605360 >> 172.21.15.172:0/1283605360 conn(0x7f4788004060 msgr2=0x7f47a0160350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 -- 172.21.15.172:0/1283605360 shutdown_connections 2024-04-25T08:48:42.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.044+0000 7f47a65e0640 1 -- 172.21.15.172:0/1283605360 wait complete. 2024-04-25T08:48:42.046 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:48:42.047 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:48:42.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.153+0000 7f2ea7f90640 1 Processor -- start 2024-04-25T08:48:42.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.153+0000 7f2ea7f90640 1 -- start start 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.154+0000 7f2ea7f90640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2ea00aecf0 0x7f2ea00cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.154+0000 7f2ea7f90640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ea00b2650 0x7f2ea00cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.154+0000 7f2ea7f90640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea00cf330 con 0x7f2ea0165680 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.154+0000 7f2ea7f90640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea0072340 con 0x7f2ea00b2650 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.154+0000 7f2ea7f90640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0071670 con 0x7f2ea00aecf0 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.154+0000 7f2ea652d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ea00b2650 0x7f2ea00cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.154+0000 7f2ea652d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ea00b2650 0x7f2ea00cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36762/0 (socket says 172.21.15.172:36762) 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.154+0000 7f2ea652d640 1 -- 172.21.15.172:0/2132938627 learned_addr learned my addr 172.21.15.172:0/2132938627 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.154+0000 7f2ea552b640 1 --2- 172.21.15.172:0/2132938627 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2ea00aecf0 0x7f2ea00cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.155+0000 7f2ea652d640 1 -- 172.21.15.172:0/2132938627 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2ea00aecf0 msgr2=0x7f2ea00cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.155+0000 7f2ea652d640 1 --2- 172.21.15.172:0/2132938627 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2ea00aecf0 0x7f2ea00cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.155+0000 7f2ea652d640 1 -- 172.21.15.172:0/2132938627 >> v1:172.21.15.172:6789/0 conn(0x7f2ea0165680 legacy=0x7f2ea00cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.155+0000 7f2ea652d640 1 -- 172.21.15.172:0/2132938627 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0071d80 con 0x7f2ea00b2650 2024-04-25T08:48:42.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.155+0000 7f2ea4d2a640 1 -- 172.21.15.172:0/2132938627 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443740728 0 0) 0x7f2ea00cf330 con 0x7f2ea0165680 2024-04-25T08:48:42.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.155+0000 7f2ea652d640 1 --2- 172.21.15.172:0/2132938627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 0x7f2ea00cf580 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009e50 tx=0x7f2e9802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bac2ea41bb15cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:42.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.155+0000 7f2ea4d2a640 1 -- 172.21.15.172:0/2132938627 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98036070 con 0x7f2ea00b2650 2024-04-25T08:48:42.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.155+0000 7f2ea4d2a640 1 -- 172.21.15.172:0/2132938627 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e98031600 con 0x7f2ea00b2650 2024-04-25T08:48:42.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.155+0000 7f2ea4d2a640 1 -- 172.21.15.172:0/2132938627 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980319d0 con 0x7f2ea00b2650 2024-04-25T08:48:42.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.156+0000 7f2ea7f90640 1 -- 172.21.15.172:0/2132938627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 msgr2=0x7f2ea00cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.156+0000 7f2ea7f90640 1 --2- 172.21.15.172:0/2132938627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 0x7f2ea00cf580 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009e50 tx=0x7f2e9802a680 comp rx=0 tx=0).stop 2024-04-25T08:48:42.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.156+0000 7f2ea7f90640 1 -- 172.21.15.172:0/2132938627 shutdown_connections 2024-04-25T08:48:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.156+0000 7f2ea7f90640 1 --2- 172.21.15.172:0/2132938627 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2ea00aecf0 0x7f2ea00cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.156+0000 7f2ea7f90640 1 --2- 172.21.15.172:0/2132938627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 0x7f2ea00cf580 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.156+0000 7f2ea7f90640 1 -- 172.21.15.172:0/2132938627 >> 172.21.15.172:0/2132938627 conn(0x7f2ea006abe0 msgr2=0x7f2ea006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.156+0000 7f2ea7f90640 1 -- 172.21.15.172:0/2132938627 shutdown_connections 2024-04-25T08:48:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.156+0000 7f2ea7f90640 1 -- 172.21.15.172:0/2132938627 wait complete. 2024-04-25T08:48:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.157+0000 7f2ea7f90640 1 Processor -- start 2024-04-25T08:48:42.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.157+0000 7f2ea7f90640 1 -- start start 2024-04-25T08:48:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea7f90640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ea00aecf0 0x7f2ea00adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea7f90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 0x7f2ea014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea7f90640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2ea0165680 0x7f2ea01601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea7f90640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0165a60 con 0x7f2ea00b2650 2024-04-25T08:48:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea7f90640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea006ea30 con 0x7f2ea00aecf0 2024-04-25T08:48:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea7f90640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00b2a80 con 0x7f2ea0165680 2024-04-25T08:48:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea552b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 0x7f2ea014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea552b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 0x7f2ea014c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36766/0 (socket says 172.21.15.172:36766) 2024-04-25T08:48:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea552b640 1 -- 172.21.15.172:0/450436481 learned_addr learned my addr 172.21.15.172:0/450436481 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:42.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea652d640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2ea0165680 0x7f2ea01601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea5d2c640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ea00aecf0 0x7f2ea00adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea552b640 1 -- 172.21.15.172:0/450436481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2ea0165680 msgr2=0x7f2ea01601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea552b640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2ea0165680 0x7f2ea01601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea552b640 1 -- 172.21.15.172:0/450436481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ea00aecf0 msgr2=0x7f2ea00adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea552b640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ea00aecf0 0x7f2ea00adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea552b640 1 -- 172.21.15.172:0/450436481 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea00ae040 con 0x7f2ea00b2650 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.158+0000 7f2ea552b640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 0x7f2ea014c1a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000d830 tx=0x7f2e9000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.159+0000 7f2e967fc640 1 -- 172.21.15.172:0/450436481 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9000b6c0 con 0x7f2ea00b2650 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.159+0000 7f2e967fc640 1 -- 172.21.15.172:0/450436481 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e90019070 con 0x7f2ea00b2650 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.159+0000 7f2e967fc640 1 -- 172.21.15.172:0/450436481 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9000ba80 con 0x7f2ea00b2650 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.159+0000 7f2ea7f90640 1 -- 172.21.15.172:0/450436481 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea015e4a0 con 0x7f2ea00b2650 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.159+0000 7f2ea7f90640 1 -- 172.21.15.172:0/450436481 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea015ea60 con 0x7f2ea00b2650 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.160+0000 7f2ea7f90640 1 -- 172.21.15.172:0/450436481 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea0073990 con 0x7f2ea00b2650 2024-04-25T08:48:42.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.160+0000 7f2e967fc640 1 -- 172.21.15.172:0/450436481 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e9001e460 con 0x7f2ea00b2650 2024-04-25T08:48:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.160+0000 7f2e967fc640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e8406b4d0 0x7f2e8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.161+0000 7f2e967fc640 1 -- 172.21.15.172:0/450436481 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2e9008aa40 con 0x7f2ea00b2650 2024-04-25T08:48:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.161+0000 7f2ea5d2c640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e8406b4d0 0x7f2e8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.161+0000 7f2ea5d2c640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e8406b4d0 0x7f2e8406d990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c007fd0 tx=0x7f2e9c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:42.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.165+0000 7f2e967fc640 1 -- 172.21.15.172:0/450436481 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e90059730 con 0x7f2ea00b2650 2024-04-25T08:48:42.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.333+0000 7f2ea7f90640 1 -- 172.21.15.172:0/450436481 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ea0159830 con 0x7f2e8406b4d0 2024-04-25T08:48:42.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.339+0000 7f2e967fc640 1 -- 172.21.15.172:0/450436481 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240277 (secure 0 0 0) 0x7f2ea0159830 con 0x7f2e8406b4d0 2024-04-25T08:48:42.333 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:42.334 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:48:42.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 -- 172.21.15.172:0/450436481 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e8406b4d0 msgr2=0x7f2e8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e8406b4d0 0x7f2e8406d990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c007fd0 tx=0x7f2e9c009040 comp rx=0 tx=0).stop 2024-04-25T08:48:42.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 -- 172.21.15.172:0/450436481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 msgr2=0x7f2ea014c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 0x7f2ea014c1a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000d830 tx=0x7f2e9000dcf0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 -- 172.21.15.172:0/450436481 shutdown_connections 2024-04-25T08:48:42.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e8406b4d0 0x7f2e8406d990 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2ea0165680 0x7f2ea01601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ea00b2650 0x7f2ea014c1a0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 --2- 172.21.15.172:0/450436481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ea00aecf0 0x7f2ea00adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 -- 172.21.15.172:0/450436481 >> 172.21.15.172:0/450436481 conn(0x7f2ea006abe0 msgr2=0x7f2ea00b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:42.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 -- 172.21.15.172:0/450436481 shutdown_connections 2024-04-25T08:48:42.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.342+0000 7f2ea7f90640 1 -- 172.21.15.172:0/450436481 wait complete. 2024-04-25T08:48:42.344 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-04-25T08:48:40.589846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":38,"acting":38,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":348212,"kb_used_data":9904,"kb_used_omap":12,"kb_used_meta":338163,"kb_avail":754626508,"statfs":{"total":773094113280,"available":772737544192,"internally_reserved":0,"allocated":10141696,"data_stored":5310910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":346279472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000643"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.412612+0000","last_change":"2024-04-25T08:48:39.407461+0000","last_active":"2024-04-25T08:48:39.412612+0000","last_peered":"2024-04-25T08:48:39.412612+0000","last_clean":"2024-04-25T08:48:39.412612+0000","last_became_active":"2024-04-25T08:48:39.407201+0000","last_became_peered":"2024-04-25T08:48:39.407201+0000","last_unstale":"2024-04-25T08:48:39.412612+0000","last_undegraded":"2024-04-25T08:48:39.412612+0000","last_fullsized":"2024-04-25T08:48:39.412612+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:33.404941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392526+0000","last_change":"2024-04-25T08:48:39.408768+0000","last_active":"2024-04-25T08:48:40.392526+0000","last_peered":"2024-04-25T08:48:40.392526+0000","last_clean":"2024-04-25T08:48:40.392526+0000","last_became_active":"2024-04-25T08:48:39.408467+0000","last_became_peered":"2024-04-25T08:48:39.408467+0000","last_unstale":"2024-04-25T08:48:40.392526+0000","last_undegraded":"2024-04-25T08:48:40.392526+0000","last_fullsized":"2024-04-25T08:48:40.392526+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.913355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.406682+0000","last_change":"2024-04-25T08:48:39.399561+0000","last_active":"2024-04-25T08:48:39.406682+0000","last_peered":"2024-04-25T08:48:39.406682+0000","last_clean":"2024-04-25T08:48:39.406682+0000","last_became_active":"2024-04-25T08:48:39.399253+0000","last_became_peered":"2024-04-25T08:48:39.399253+0000","last_unstale":"2024-04-25T08:48:39.406682+0000","last_undegraded":"2024-04-25T08:48:39.406682+0000","last_fullsized":"2024-04-25T08:48:39.406682+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:42.892417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.406636+0000","last_change":"2024-04-25T08:48:39.399574+0000","last_active":"2024-04-25T08:48:39.406636+0000","last_peered":"2024-04-25T08:48:39.406636+0000","last_clean":"2024-04-25T08:48:39.406636+0000","last_became_active":"2024-04-25T08:48:39.399315+0000","last_became_peered":"2024-04-25T08:48:39.399315+0000","last_unstale":"2024-04-25T08:48:39.406636+0000","last_undegraded":"2024-04-25T08:48:39.406636+0000","last_fullsized":"2024-04-25T08:48:39.406636+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:36.810580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.407005+0000","last_change":"2024-04-25T08:48:39.403324+0000","last_active":"2024-04-25T08:48:39.407005+0000","last_peered":"2024-04-25T08:48:39.407005+0000","last_clean":"2024-04-25T08:48:39.407005+0000","last_became_active":"2024-04-25T08:48:39.403065+0000","last_became_peered":"2024-04-25T08:48:39.403065+0000","last_unstale":"2024-04-25T08:48:39.407005+0000","last_undegraded":"2024-04-25T08:48:39.407005+0000","last_fullsized":"2024-04-25T08:48:39.407005+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:29.992641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393051+0000","last_change":"2024-04-25T08:48:39.401706+0000","last_active":"2024-04-25T08:48:40.393051+0000","last_peered":"2024-04-25T08:48:40.393051+0000","last_clean":"2024-04-25T08:48:40.393051+0000","last_became_active":"2024-04-25T08:48:39.401433+0000","last_became_peered":"2024-04-25T08:48:39.401433+0000","last_unstale":"2024-04-25T08:48:40.393051+0000","last_undegraded":"2024-04-25T08:48:40.393051+0000","last_fullsized":"2024-04-25T08:48:40.393051+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:24.257267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392500+0000","last_change":"2024-04-25T08:48:39.409820+0000","last_active":"2024-04-25T08:48:40.392500+0000","last_peered":"2024-04-25T08:48:40.392500+0000","last_clean":"2024-04-25T08:48:40.392500+0000","last_became_active":"2024-04-25T08:48:39.409186+0000","last_became_peered":"2024-04-25T08:48:39.409186+0000","last_unstale":"2024-04-25T08:48:40.392500+0000","last_undegraded":"2024-04-25T08:48:40.392500+0000","last_fullsized":"2024-04-25T08:48:40.392500+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:36.810580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.396294+0000","last_change":"2024-04-25T08:48:38.397889+0000","last_active":"2024-04-25T08:48:39.396294+0000","last_peered":"2024-04-25T08:48:39.396294+0000","last_clean":"2024-04-25T08:48:39.396294+0000","last_became_active":"2024-04-25T08:48:38.397619+0000","last_became_peered":"2024-04-25T08:48:38.397619+0000","last_unstale":"2024-04-25T08:48:39.396294+0000","last_undegraded":"2024-04-25T08:48:39.396294+0000","last_fullsized":"2024-04-25T08:48:39.396294+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:17.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393356+0000","last_change":"2024-04-25T08:48:38.402528+0000","last_active":"2024-04-25T08:48:40.393356+0000","last_peered":"2024-04-25T08:48:40.393356+0000","last_clean":"2024-04-25T08:48:40.393356+0000","last_became_active":"2024-04-25T08:48:38.402209+0000","last_became_peered":"2024-04-25T08:48:38.402209+0000","last_unstale":"2024-04-25T08:48:40.393356+0000","last_undegraded":"2024-04-25T08:48:40.393356+0000","last_fullsized":"2024-04-25T08:48:40.393356+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:01.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.393338+0000","last_change":"2024-04-25T08:48:38.404914+0000","last_active":"2024-04-25T08:48:39.393338+0000","last_peered":"2024-04-25T08:48:39.393338+0000","last_clean":"2024-04-25T08:48:39.393338+0000","last_became_active":"2024-04-25T08:48:38.404625+0000","last_became_peered":"2024-04-25T08:48:38.404625+0000","last_unstale":"2024-04-25T08:48:39.393338+0000","last_undegraded":"2024-04-25T08:48:39.393338+0000","last_fullsized":"2024-04-25T08:48:39.393338+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:01.209437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.406657+0000","last_change":"2024-04-25T08:48:39.401832+0000","last_active":"2024-04-25T08:48:39.406657+0000","last_peered":"2024-04-25T08:48:39.406657+0000","last_clean":"2024-04-25T08:48:39.406657+0000","last_became_active":"2024-04-25T08:48:39.401577+0000","last_became_peered":"2024-04-25T08:48:39.401577+0000","last_unstale":"2024-04-25T08:48:39.406657+0000","last_undegraded":"2024-04-25T08:48:39.406657+0000","last_fullsized":"2024-04-25T08:48:39.406657+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.913355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392325+0000","last_change":"2024-04-25T08:48:38.398082+0000","last_active":"2024-04-25T08:48:40.392325+0000","last_peered":"2024-04-25T08:48:40.392325+0000","last_clean":"2024-04-25T08:48:40.392325+0000","last_became_active":"2024-04-25T08:48:38.397778+0000","last_became_peered":"2024-04-25T08:48:38.397778+0000","last_unstale":"2024-04-25T08:48:40.392325+0000","last_undegraded":"2024-04-25T08:48:40.392325+0000","last_fullsized":"2024-04-25T08:48:40.392325+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:05.344046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392577+0000","last_change":"2024-04-25T08:48:39.410054+0000","last_active":"2024-04-25T08:48:40.392577+0000","last_peered":"2024-04-25T08:48:40.392577+0000","last_clean":"2024-04-25T08:48:40.392577+0000","last_became_active":"2024-04-25T08:48:39.409552+0000","last_became_peered":"2024-04-25T08:48:39.409552+0000","last_unstale":"2024-04-25T08:48:40.392577+0000","last_undegraded":"2024-04-25T08:48:40.392577+0000","last_fullsized":"2024-04-25T08:48:40.392577+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:29.992641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392133+0000","last_change":"2024-04-25T08:48:39.408656+0000","last_active":"2024-04-25T08:48:40.392133+0000","last_peered":"2024-04-25T08:48:40.392133+0000","last_clean":"2024-04-25T08:48:40.392133+0000","last_became_active":"2024-04-25T08:48:39.408371+0000","last_became_peered":"2024-04-25T08:48:39.408371+0000","last_unstale":"2024-04-25T08:48:40.392133+0000","last_undegraded":"2024-04-25T08:48:40.392133+0000","last_fullsized":"2024-04-25T08:48:40.392133+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:42.892417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392610+0000","last_change":"2024-04-25T08:48:38.403080+0000","last_active":"2024-04-25T08:48:40.392610+0000","last_peered":"2024-04-25T08:48:40.392610+0000","last_clean":"2024-04-25T08:48:40.392610+0000","last_became_active":"2024-04-25T08:48:38.402620+0000","last_became_peered":"2024-04-25T08:48:38.402620+0000","last_unstale":"2024-04-25T08:48:40.392610+0000","last_undegraded":"2024-04-25T08:48:40.392610+0000","last_fullsized":"2024-04-25T08:48:40.392610+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:39.395739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393241+0000","last_change":"2024-04-25T08:48:39.403523+0000","last_active":"2024-04-25T08:48:40.393241+0000","last_peered":"2024-04-25T08:48:40.393241+0000","last_clean":"2024-04-25T08:48:40.393241+0000","last_became_active":"2024-04-25T08:48:39.403234+0000","last_became_peered":"2024-04-25T08:48:39.403234+0000","last_unstale":"2024-04-25T08:48:40.393241+0000","last_undegraded":"2024-04-25T08:48:40.393241+0000","last_fullsized":"2024-04-25T08:48:40.393241+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:33.404941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.407060+0000","last_change":"2024-04-25T08:48:39.406008+0000","last_active":"2024-04-25T08:48:39.407060+0000","last_peered":"2024-04-25T08:48:39.407060+0000","last_clean":"2024-04-25T08:48:39.407060+0000","last_became_active":"2024-04-25T08:48:39.405754+0000","last_became_peered":"2024-04-25T08:48:39.405754+0000","last_unstale":"2024-04-25T08:48:39.407060+0000","last_undegraded":"2024-04-25T08:48:39.407060+0000","last_fullsized":"2024-04-25T08:48:39.407060+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:24.257267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392118+0000","last_change":"2024-04-25T08:48:38.398631+0000","last_active":"2024-04-25T08:48:40.392118+0000","last_peered":"2024-04-25T08:48:40.392118+0000","last_clean":"2024-04-25T08:48:40.392118+0000","last_became_active":"2024-04-25T08:48:38.398321+0000","last_became_peered":"2024-04-25T08:48:38.398321+0000","last_unstale":"2024-04-25T08:48:40.392118+0000","last_undegraded":"2024-04-25T08:48:40.392118+0000","last_fullsized":"2024-04-25T08:48:40.392118+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:25.112343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:38.378679+0000","last_change":"2024-04-25T08:48:38.378679+0000","last_active":"2024-04-25T08:48:38.378679+0000","last_peered":"2024-04-25T08:48:38.378679+0000","last_clean":"2024-04-25T08:48:38.378679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:38.378679+0000","last_undegraded":"2024-04-25T08:48:38.378679+0000","last_fullsized":"2024-04-25T08:48:38.378679+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:48:37.373734+0000","last_change":"2024-04-25T08:48:37.373734+0000","last_active":"2024-04-25T08:48:37.373734+0000","last_peered":"2024-04-25T08:48:37.373734+0000","last_clean":"2024-04-25T08:48:37.373734+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:48:37.373734+0000","last_undegraded":"2024-04-25T08:48:37.373734+0000","last_fullsized":"2024-04-25T08:48:37.373734+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":303,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T08:48:36.270136+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:48:36.270136+0000","last_peered":"2024-04-25T08:48:36.270136+0000","last_clean":"2024-04-25T08:48:36.270136+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:48:36.270136+0000","last_undegraded":"2024-04-25T08:48:36.270136+0000","last_fullsized":"2024-04-25T08:48:36.270136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":12,"acting":12,"num_store_stats":2},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41172,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330668,"statfs":{"total":96636764160,"available":96594604032,"internally_reserved":0,"allocated":1703936,"data_stored":1101635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40604,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331236,"statfs":{"total":96636764160,"available":96595185664,"internally_reserved":0,"allocated":1122304,"data_stored":516786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40640,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331200,"statfs":{"total":96636764160,"available":96595148800,"internally_reserved":0,"allocated":1159168,"data_stored":536829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46160,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325680,"statfs":{"total":96636764160,"available":96589496320,"internally_reserved":0,"allocated":1110016,"data_stored":511267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46200,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325640,"statfs":{"total":96636764160,"available":96589455360,"internally_reserved":0,"allocated":1159168,"data_stored":536829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46128,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325712,"statfs":{"total":96636764160,"available":96589529088,"internally_reserved":0,"allocated":1085440,"data_stored":500197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40572,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331268,"statfs":{"total":96636764160,"available":96595218432,"internally_reserved":0,"allocated":1097728,"data_stored":505732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46736,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325104,"statfs":{"total":96636764160,"available":96588906496,"internally_reserved":0,"allocated":1703936,"data_stored":1101635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:48:42.348 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:48:42.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.489+0000 7fa558510640 1 Processor -- start 2024-04-25T08:48:42.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.489+0000 7fa558510640 1 -- start start 2024-04-25T08:48:42.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.490+0000 7fa558510640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa55015dbe0 0x7fa5500d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.490+0000 7fa558510640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa5500b2cb0 0x7fa5500d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.490+0000 7fa558510640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5500b92a0 0x7fa5500b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.490+0000 7fa558510640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55015dfc0 con 0x7fa5500b92a0 2024-04-25T08:48:42.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.490+0000 7fa558510640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5500d1a00 con 0x7fa5500b2cb0 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.490+0000 7fa558510640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500b97a0 con 0x7fa55015dbe0 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.490+0000 7fa556aad640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5500b92a0 0x7fa5500b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa556aad640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5500b92a0 0x7fa5500b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36778/0 (socket says 172.21.15.172:36778) 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa556aad640 1 -- 172.21.15.172:0/1406179447 learned_addr learned my addr 172.21.15.172:0/1406179447 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa555aab640 1 --2- 172.21.15.172:0/1406179447 >> v2:172.21.15.186:3300/0 conn(0x7fa5500b2cb0 0x7fa5500d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa556aad640 1 -- 172.21.15.172:0/1406179447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa55015dbe0 msgr2=0x7fa5500d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa5562ac640 1 --2- 172.21.15.172:0/1406179447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa55015dbe0 0x7fa5500d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa556aad640 1 --2- 172.21.15.172:0/1406179447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa55015dbe0 0x7fa5500d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa556aad640 1 -- 172.21.15.172:0/1406179447 >> v2:172.21.15.186:3300/0 conn(0x7fa5500b2cb0 msgr2=0x7fa5500d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa556aad640 1 --2- 172.21.15.172:0/1406179447 >> v2:172.21.15.186:3300/0 conn(0x7fa5500b2cb0 0x7fa5500d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa556aad640 1 -- 172.21.15.172:0/1406179447 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5500d1c50 con 0x7fa5500b92a0 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa555aab640 1 --2- 172.21.15.172:0/1406179447 >> v2:172.21.15.186:3300/0 conn(0x7fa5500b2cb0 0x7fa5500d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:42.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.491+0000 7fa556aad640 1 --2- 172.21.15.172:0/1406179447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5500b92a0 0x7fa5500b5400 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa5500b64d0 tx=0x7fa54802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fb1d9b88becd2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa5552aa640 1 -- 172.21.15.172:0/1406179447 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548037070 con 0x7fa5500b92a0 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa5552aa640 1 -- 172.21.15.172:0/1406179447 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548032440 con 0x7fa5500b92a0 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa5552aa640 1 -- 172.21.15.172:0/1406179447 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548032810 con 0x7fa5500b92a0 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa558510640 1 -- 172.21.15.172:0/1406179447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5500b92a0 msgr2=0x7fa5500b5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa558510640 1 --2- 172.21.15.172:0/1406179447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5500b92a0 0x7fa5500b5400 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa5500b64d0 tx=0x7fa54802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa558510640 1 -- 172.21.15.172:0/1406179447 shutdown_connections 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa558510640 1 --2- 172.21.15.172:0/1406179447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5500b92a0 0x7fa5500b5400 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa558510640 1 --2- 172.21.15.172:0/1406179447 >> v2:172.21.15.186:3300/0 conn(0x7fa5500b2cb0 0x7fa5500d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa558510640 1 --2- 172.21.15.172:0/1406179447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa55015dbe0 0x7fa5500d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa558510640 1 -- 172.21.15.172:0/1406179447 >> 172.21.15.172:0/1406179447 conn(0x7fa550061a20 msgr2=0x7fa550061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa558510640 1 -- 172.21.15.172:0/1406179447 shutdown_connections 2024-04-25T08:48:42.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.492+0000 7fa558510640 1 -- 172.21.15.172:0/1406179447 wait complete. 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.493+0000 7fa558510640 1 Processor -- start 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.494+0000 7fa558510640 1 -- start start 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.494+0000 7fa558510640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5500b2cb0 0x7fa5500cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.494+0000 7fa558510640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5500b92a0 0x7fa550160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.494+0000 7fa558510640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa55015dbe0 0x7fa5501549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.494+0000 7fa558510640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500b6ab0 con 0x7fa55015dbe0 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.494+0000 7fa558510640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500d2210 con 0x7fa5500b2cb0 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.494+0000 7fa558510640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500b6c30 con 0x7fa5500b92a0 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.494+0000 7fa556aad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa55015dbe0 0x7fa5501549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.494+0000 7fa556aad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa55015dbe0 0x7fa5501549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36782/0 (socket says 172.21.15.172:36782) 2024-04-25T08:48:42.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.494+0000 7fa556aad640 1 -- 172.21.15.172:0/3967803930 learned_addr learned my addr 172.21.15.172:0/3967803930 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa555aab640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5500b92a0 0x7fa550160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa5562ac640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5500b2cb0 0x7fa5500cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa556aad640 1 -- 172.21.15.172:0/3967803930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5500b92a0 msgr2=0x7fa550160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa556aad640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5500b92a0 0x7fa550160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa556aad640 1 -- 172.21.15.172:0/3967803930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5500b2cb0 msgr2=0x7fa5500cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa556aad640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5500b2cb0 0x7fa5500cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa556aad640 1 -- 172.21.15.172:0/3967803930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5500cc1d0 con 0x7fa55015dbe0 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa555aab640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5500b92a0 0x7fa550160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa5562ac640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5500b2cb0 0x7fa5500cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa556aad640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa55015dbe0 0x7fa5501549c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa5480090b0 tx=0x7fa5480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa546ffd640 1 -- 172.21.15.172:0/3967803930 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548037040 con 0x7fa55015dbe0 2024-04-25T08:48:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa546ffd640 1 -- 172.21.15.172:0/3967803930 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548042070 con 0x7fa55015dbe0 2024-04-25T08:48:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa558510640 1 -- 172.21.15.172:0/3967803930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5500cc4b0 con 0x7fa55015dbe0 2024-04-25T08:48:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa546ffd640 1 -- 172.21.15.172:0/3967803930 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548030bd0 con 0x7fa55015dbe0 2024-04-25T08:48:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.495+0000 7fa558510640 1 -- 172.21.15.172:0/3967803930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5500cca70 con 0x7fa55015dbe0 2024-04-25T08:48:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.496+0000 7fa558510640 1 -- 172.21.15.172:0/3967803930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa550073990 con 0x7fa55015dbe0 2024-04-25T08:48:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.497+0000 7fa546ffd640 1 -- 172.21.15.172:0/3967803930 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa548047460 con 0x7fa55015dbe0 2024-04-25T08:48:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.497+0000 7fa546ffd640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa53406b4d0 0x7fa53406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.497+0000 7fa546ffd640 1 -- 172.21.15.172:0/3967803930 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa5480ab060 con 0x7fa55015dbe0 2024-04-25T08:48:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.497+0000 7fa5562ac640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa53406b4d0 0x7fa53406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.498+0000 7fa5562ac640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa53406b4d0 0x7fa53406d990 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa55015cdf0 tx=0x7fa54c0073a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.501+0000 7fa546ffd640 1 -- 172.21.15.172:0/3967803930 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa548079d50 con 0x7fa55015dbe0 2024-04-25T08:48:42.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.669+0000 7fa558510640 1 -- 172.21.15.172:0/3967803930 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa550159ca0 con 0x7fa53406b4d0 2024-04-25T08:48:42.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.675+0000 7fa546ffd640 1 -- 172.21.15.172:0/3967803930 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252040 (secure 0 0 0) 0x7fa550159ca0 con 0x7fa53406b4d0 2024-04-25T08:48:42.668 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:42.669 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:48:42.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 -- 172.21.15.172:0/3967803930 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa53406b4d0 msgr2=0x7fa53406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa53406b4d0 0x7fa53406d990 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa55015cdf0 tx=0x7fa54c0073a0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 -- 172.21.15.172:0/3967803930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa55015dbe0 msgr2=0x7fa5501549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa55015dbe0 0x7fa5501549c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa5480090b0 tx=0x7fa5480046c0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 -- 172.21.15.172:0/3967803930 shutdown_connections 2024-04-25T08:48:42.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa53406b4d0 0x7fa53406d990 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa55015dbe0 0x7fa5501549c0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5500b92a0 0x7fa550160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 --2- 172.21.15.172:0/3967803930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5500b2cb0 0x7fa5500cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 -- 172.21.15.172:0/3967803930 >> 172.21.15.172:0/3967803930 conn(0x7fa550061a20 msgr2=0x7fa550159590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:42.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 -- 172.21.15.172:0/3967803930 shutdown_connections 2024-04-25T08:48:42.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.678+0000 7fa558510640 1 -- 172.21.15.172:0/3967803930 wait complete. 2024-04-25T08:48:42.680 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-04-25T08:48:42.590154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":348620,"kb_used_data":10316,"kb_used_omap":12,"kb_used_meta":338163,"kb_avail":754626100,"statfs":{"total":773094113280,"available":772737126400,"internally_reserved":0,"allocated":10563584,"data_stored":5500264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":346279472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.211086"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.412612+0000","last_change":"2024-04-25T08:48:39.407461+0000","last_active":"2024-04-25T08:48:39.412612+0000","last_peered":"2024-04-25T08:48:39.412612+0000","last_clean":"2024-04-25T08:48:39.412612+0000","last_became_active":"2024-04-25T08:48:39.407201+0000","last_became_peered":"2024-04-25T08:48:39.407201+0000","last_unstale":"2024-04-25T08:48:39.412612+0000","last_undegraded":"2024-04-25T08:48:39.412612+0000","last_fullsized":"2024-04-25T08:48:39.412612+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:33.404941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392526+0000","last_change":"2024-04-25T08:48:39.408768+0000","last_active":"2024-04-25T08:48:40.392526+0000","last_peered":"2024-04-25T08:48:40.392526+0000","last_clean":"2024-04-25T08:48:40.392526+0000","last_became_active":"2024-04-25T08:48:39.408467+0000","last_became_peered":"2024-04-25T08:48:39.408467+0000","last_unstale":"2024-04-25T08:48:40.392526+0000","last_undegraded":"2024-04-25T08:48:40.392526+0000","last_fullsized":"2024-04-25T08:48:40.392526+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.913355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.406682+0000","last_change":"2024-04-25T08:48:39.399561+0000","last_active":"2024-04-25T08:48:39.406682+0000","last_peered":"2024-04-25T08:48:39.406682+0000","last_clean":"2024-04-25T08:48:39.406682+0000","last_became_active":"2024-04-25T08:48:39.399253+0000","last_became_peered":"2024-04-25T08:48:39.399253+0000","last_unstale":"2024-04-25T08:48:39.406682+0000","last_undegraded":"2024-04-25T08:48:39.406682+0000","last_fullsized":"2024-04-25T08:48:39.406682+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:42.892417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.404685+0000","last_change":"2024-04-25T08:48:39.402826+0000","last_active":"2024-04-25T08:48:39.404685+0000","last_peered":"2024-04-25T08:48:39.404685+0000","last_clean":"2024-04-25T08:48:39.404685+0000","last_became_active":"2024-04-25T08:48:39.402575+0000","last_became_peered":"2024-04-25T08:48:39.402575+0000","last_unstale":"2024-04-25T08:48:39.404685+0000","last_undegraded":"2024-04-25T08:48:39.404685+0000","last_fullsized":"2024-04-25T08:48:39.404685+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:50:59.960692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393576+0000","last_change":"2024-04-25T08:48:39.405018+0000","last_active":"2024-04-25T08:48:40.393576+0000","last_peered":"2024-04-25T08:48:40.393576+0000","last_clean":"2024-04-25T08:48:40.393576+0000","last_became_active":"2024-04-25T08:48:39.402984+0000","last_became_peered":"2024-04-25T08:48:39.402984+0000","last_unstale":"2024-04-25T08:48:40.393576+0000","last_undegraded":"2024-04-25T08:48:40.393576+0000","last_fullsized":"2024-04-25T08:48:40.393576+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:40.400684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.415190+0000","last_change":"2024-04-25T08:48:39.406089+0000","last_active":"2024-04-25T08:48:39.415190+0000","last_peered":"2024-04-25T08:48:39.415190+0000","last_clean":"2024-04-25T08:48:39.415190+0000","last_became_active":"2024-04-25T08:48:39.405772+0000","last_became_peered":"2024-04-25T08:48:39.405772+0000","last_unstale":"2024-04-25T08:48:39.415190+0000","last_undegraded":"2024-04-25T08:48:39.415190+0000","last_fullsized":"2024-04-25T08:48:39.415190+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:03.357731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830021+0000","last_change":"2024-04-25T08:48:39.407498+0000","last_active":"2024-04-25T08:48:40.830021+0000","last_peered":"2024-04-25T08:48:40.830021+0000","last_clean":"2024-04-25T08:48:40.830021+0000","last_became_active":"2024-04-25T08:48:39.407227+0000","last_became_peered":"2024-04-25T08:48:39.407227+0000","last_unstale":"2024-04-25T08:48:40.830021+0000","last_undegraded":"2024-04-25T08:48:40.830021+0000","last_fullsized":"2024-04-25T08:48:40.830021+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:36.810580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.413737+0000","last_change":"2024-04-25T08:48:39.410683+0000","last_active":"2024-04-25T08:48:39.413737+0000","last_peered":"2024-04-25T08:48:39.413737+0000","last_clean":"2024-04-25T08:48:39.413737+0000","last_became_active":"2024-04-25T08:48:39.410442+0000","last_became_peered":"2024-04-25T08:48:39.410442+0000","last_unstale":"2024-04-25T08:48:39.413737+0000","last_undegraded":"2024-04-25T08:48:39.413737+0000","last_fullsized":"2024-04-25T08:48:39.413737+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:57.702924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392830+0000","last_change":"2024-04-25T08:48:39.399788+0000","last_active":"2024-04-25T08:48:40.392830+0000","last_peered":"2024-04-25T08:48:40.392830+0000","last_clean":"2024-04-25T08:48:40.392830+0000","last_became_active":"2024-04-25T08:48:39.399507+0000","last_became_peered":"2024-04-25T08:48:39.399507+0000","last_unstale":"2024-04-25T08:48:40.392830+0000","last_undegraded":"2024-04-25T08:48:40.392830+0000","last_fullsized":"2024-04-25T08:48:40.392830+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:01.769276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.389047+0000","last_change":"2024-04-25T08:48:39.409377+0000","last_active":"2024-04-25T08:48:40.389047+0000","last_peered":"2024-04-25T08:48:40.389047+0000","last_clean":"2024-04-25T08:48:40.389047+0000","last_became_active":"2024-04-25T08:48:39.409140+0000","last_became_peered":"2024-04-25T08:48:39.409140+0000","last_unstale":"2024-04-25T08:48:40.389047+0000","last_undegraded":"2024-04-25T08:48:40.389047+0000","last_fullsized":"2024-04-25T08:48:40.389047+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:48.008214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393429+0000","last_change":"2024-04-25T08:48:39.398888+0000","last_active":"2024-04-25T08:48:40.393429+0000","last_peered":"2024-04-25T08:48:40.393429+0000","last_clean":"2024-04-25T08:48:40.393429+0000","last_became_active":"2024-04-25T08:48:39.398244+0000","last_became_peered":"2024-04-25T08:48:39.398244+0000","last_unstale":"2024-04-25T08:48:40.393429+0000","last_undegraded":"2024-04-25T08:48:40.393429+0000","last_fullsized":"2024-04-25T08:48:40.393429+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:34:48.715671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.388885+0000","last_change":"2024-04-25T08:48:39.408416+0000","last_active":"2024-04-25T08:48:40.388885+0000","last_peered":"2024-04-25T08:48:40.388885+0000","last_clean":"2024-04-25T08:48:40.388885+0000","last_became_active":"2024-04-25T08:48:39.408143+0000","last_became_peered":"2024-04-25T08:48:39.408143+0000","last_unstale":"2024-04-25T08:48:40.388885+0000","last_undegraded":"2024-04-25T08:48:40.388885+0000","last_fullsized":"2024-04-25T08:48:40.388885+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:04.894137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.412899+0000","last_change":"2024-04-25T08:48:39.409074+0000","last_active":"2024-04-25T08:48:39.412899+0000","last_peered":"2024-04-25T08:48:39.412899+0000","last_clean":"2024-04-25T08:48:39.412899+0000","last_became_active":"2024-04-25T08:48:39.408811+0000","last_became_peered":"2024-04-25T08:48:39.408811+0000","last_unstale":"2024-04-25T08:48:39.412899+0000","last_undegraded":"2024-04-25T08:48:39.412899+0000","last_fullsized":"2024-04-25T08:48:39.412899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:50.357819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392774+0000","last_change":"2024-04-25T08:48:39.409267+0000","last_active":"2024-04-25T08:48:40.392774+0000","last_peered":"2024-04-25T08:48:40.392774+0000","last_clean":"2024-04-25T08:48:40.392774+0000","last_became_active":"2024-04-25T08:48:39.409001+0000","last_became_peered":"2024-04-25T08:48:39.409001+0000","last_unstale":"2024-04-25T08:48:40.392774+0000","last_undegraded":"2024-04-25T08:48:40.392774+0000","last_fullsized":"2024-04-25T08:48:40.392774+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:10.559840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.410955+0000","last_change":"2024-04-25T08:48:39.407344+0000","last_active":"2024-04-25T08:48:39.410955+0000","last_peered":"2024-04-25T08:48:39.410955+0000","last_clean":"2024-04-25T08:48:39.410955+0000","last_became_active":"2024-04-25T08:48:39.407100+0000","last_became_peered":"2024-04-25T08:48:39.407100+0000","last_unstale":"2024-04-25T08:48:39.410955+0000","last_undegraded":"2024-04-25T08:48:39.410955+0000","last_fullsized":"2024-04-25T08:48:39.410955+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:25.478883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.415503+0000","last_change":"2024-04-25T08:48:39.407935+0000","last_active":"2024-04-25T08:48:39.415503+0000","last_peered":"2024-04-25T08:48:39.415503+0000","last_clean":"2024-04-25T08:48:39.415503+0000","last_became_active":"2024-04-25T08:48:39.407689+0000","last_became_peered":"2024-04-25T08:48:39.407689+0000","last_unstale":"2024-04-25T08:48:39.415503+0000","last_undegraded":"2024-04-25T08:48:39.415503+0000","last_fullsized":"2024-04-25T08:48:39.415503+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:06.382641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.415303+0000","last_change":"2024-04-25T08:48:39.407392+0000","last_active":"2024-04-25T08:48:39.415303+0000","last_peered":"2024-04-25T08:48:39.415303+0000","last_clean":"2024-04-25T08:48:39.415303+0000","last_became_active":"2024-04-25T08:48:39.407140+0000","last_became_peered":"2024-04-25T08:48:39.407140+0000","last_unstale":"2024-04-25T08:48:39.415303+0000","last_undegraded":"2024-04-25T08:48:39.415303+0000","last_fullsized":"2024-04-25T08:48:39.415303+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:04.347821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.406636+0000","last_change":"2024-04-25T08:48:39.399574+0000","last_active":"2024-04-25T08:48:39.406636+0000","last_peered":"2024-04-25T08:48:39.406636+0000","last_clean":"2024-04-25T08:48:39.406636+0000","last_became_active":"2024-04-25T08:48:39.399315+0000","last_became_peered":"2024-04-25T08:48:39.399315+0000","last_unstale":"2024-04-25T08:48:39.406636+0000","last_undegraded":"2024-04-25T08:48:39.406636+0000","last_fullsized":"2024-04-25T08:48:39.406636+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:36.810580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393490+0000","last_change":"2024-04-25T08:48:39.406751+0000","last_active":"2024-04-25T08:48:40.393490+0000","last_peered":"2024-04-25T08:48:40.393490+0000","last_clean":"2024-04-25T08:48:40.393490+0000","last_became_active":"2024-04-25T08:48:39.406500+0000","last_became_peered":"2024-04-25T08:48:39.406500+0000","last_unstale":"2024-04-25T08:48:40.393490+0000","last_undegraded":"2024-04-25T08:48:40.393490+0000","last_fullsized":"2024-04-25T08:48:40.393490+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:04.860452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.412371+0000","last_change":"2024-04-25T08:48:39.407540+0000","last_active":"2024-04-25T08:48:39.412371+0000","last_peered":"2024-04-25T08:48:39.412371+0000","last_clean":"2024-04-25T08:48:39.412371+0000","last_became_active":"2024-04-25T08:48:39.407277+0000","last_became_peered":"2024-04-25T08:48:39.407277+0000","last_unstale":"2024-04-25T08:48:39.412371+0000","last_undegraded":"2024-04-25T08:48:39.412371+0000","last_fullsized":"2024-04-25T08:48:39.412371+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:25.825366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393133+0000","last_change":"2024-04-25T08:48:39.404753+0000","last_active":"2024-04-25T08:48:40.393133+0000","last_peered":"2024-04-25T08:48:40.393133+0000","last_clean":"2024-04-25T08:48:40.393133+0000","last_became_active":"2024-04-25T08:48:39.404495+0000","last_became_peered":"2024-04-25T08:48:39.404495+0000","last_unstale":"2024-04-25T08:48:40.393133+0000","last_undegraded":"2024-04-25T08:48:40.393133+0000","last_fullsized":"2024-04-25T08:48:40.393133+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:41.820618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392189+0000","last_change":"2024-04-25T08:48:39.407520+0000","last_active":"2024-04-25T08:48:40.392189+0000","last_peered":"2024-04-25T08:48:40.392189+0000","last_clean":"2024-04-25T08:48:40.392189+0000","last_became_active":"2024-04-25T08:48:39.407056+0000","last_became_peered":"2024-04-25T08:48:39.407056+0000","last_unstale":"2024-04-25T08:48:40.392189+0000","last_undegraded":"2024-04-25T08:48:40.392189+0000","last_fullsized":"2024-04-25T08:48:40.392189+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:33.053919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830066+0000","last_change":"2024-04-25T08:48:39.406086+0000","last_active":"2024-04-25T08:48:40.830066+0000","last_peered":"2024-04-25T08:48:40.830066+0000","last_clean":"2024-04-25T08:48:40.830066+0000","last_became_active":"2024-04-25T08:48:39.405794+0000","last_became_peered":"2024-04-25T08:48:39.405794+0000","last_unstale":"2024-04-25T08:48:40.830066+0000","last_undegraded":"2024-04-25T08:48:40.830066+0000","last_fullsized":"2024-04-25T08:48:40.830066+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:58.167721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.407005+0000","last_change":"2024-04-25T08:48:39.403324+0000","last_active":"2024-04-25T08:48:39.407005+0000","last_peered":"2024-04-25T08:48:39.407005+0000","last_clean":"2024-04-25T08:48:39.407005+0000","last_became_active":"2024-04-25T08:48:39.403065+0000","last_became_peered":"2024-04-25T08:48:39.403065+0000","last_unstale":"2024-04-25T08:48:39.407005+0000","last_undegraded":"2024-04-25T08:48:39.407005+0000","last_fullsized":"2024-04-25T08:48:39.407005+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:29.992641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393051+0000","last_change":"2024-04-25T08:48:39.401706+0000","last_active":"2024-04-25T08:48:40.393051+0000","last_peered":"2024-04-25T08:48:40.393051+0000","last_clean":"2024-04-25T08:48:40.393051+0000","last_became_active":"2024-04-25T08:48:39.401433+0000","last_became_peered":"2024-04-25T08:48:39.401433+0000","last_unstale":"2024-04-25T08:48:40.393051+0000","last_undegraded":"2024-04-25T08:48:40.393051+0000","last_fullsized":"2024-04-25T08:48:40.393051+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:24.257267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393183+0000","last_change":"2024-04-25T08:48:39.407581+0000","last_active":"2024-04-25T08:48:40.393183+0000","last_peered":"2024-04-25T08:48:40.393183+0000","last_clean":"2024-04-25T08:48:40.393183+0000","last_became_active":"2024-04-25T08:48:39.407253+0000","last_became_peered":"2024-04-25T08:48:39.407253+0000","last_unstale":"2024-04-25T08:48:40.393183+0000","last_undegraded":"2024-04-25T08:48:40.393183+0000","last_fullsized":"2024-04-25T08:48:40.393183+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:05.449725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.388979+0000","last_change":"2024-04-25T08:48:39.402468+0000","last_active":"2024-04-25T08:48:40.388979+0000","last_peered":"2024-04-25T08:48:40.388979+0000","last_clean":"2024-04-25T08:48:40.388979+0000","last_became_active":"2024-04-25T08:48:39.402237+0000","last_became_peered":"2024-04-25T08:48:39.402237+0000","last_unstale":"2024-04-25T08:48:40.388979+0000","last_undegraded":"2024-04-25T08:48:40.388979+0000","last_fullsized":"2024-04-25T08:48:40.388979+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:41.087969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.403840+0000","last_change":"2024-04-25T08:48:39.401602+0000","last_active":"2024-04-25T08:48:39.403840+0000","last_peered":"2024-04-25T08:48:39.403840+0000","last_clean":"2024-04-25T08:48:39.403840+0000","last_became_active":"2024-04-25T08:48:39.401329+0000","last_became_peered":"2024-04-25T08:48:39.401329+0000","last_unstale":"2024-04-25T08:48:39.403840+0000","last_undegraded":"2024-04-25T08:48:39.403840+0000","last_fullsized":"2024-04-25T08:48:39.403840+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:10.265568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830514+0000","last_change":"2024-04-25T08:48:39.401635+0000","last_active":"2024-04-25T08:48:40.830514+0000","last_peered":"2024-04-25T08:48:40.830514+0000","last_clean":"2024-04-25T08:48:40.830514+0000","last_became_active":"2024-04-25T08:48:39.401374+0000","last_became_peered":"2024-04-25T08:48:39.401374+0000","last_unstale":"2024-04-25T08:48:40.830514+0000","last_undegraded":"2024-04-25T08:48:40.830514+0000","last_fullsized":"2024-04-25T08:48:40.830514+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:33.404941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392759+0000","last_change":"2024-04-25T08:48:39.400426+0000","last_active":"2024-04-25T08:48:40.392759+0000","last_peered":"2024-04-25T08:48:40.392759+0000","last_clean":"2024-04-25T08:48:40.392759+0000","last_became_active":"2024-04-25T08:48:39.400177+0000","last_became_peered":"2024-04-25T08:48:39.400177+0000","last_unstale":"2024-04-25T08:48:40.392759+0000","last_undegraded":"2024-04-25T08:48:40.392759+0000","last_fullsized":"2024-04-25T08:48:40.392759+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:58.167721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392500+0000","last_change":"2024-04-25T08:48:39.409820+0000","last_active":"2024-04-25T08:48:40.392500+0000","last_peered":"2024-04-25T08:48:40.392500+0000","last_clean":"2024-04-25T08:48:40.392500+0000","last_became_active":"2024-04-25T08:48:39.409186+0000","last_became_peered":"2024-04-25T08:48:39.409186+0000","last_unstale":"2024-04-25T08:48:40.392500+0000","last_undegraded":"2024-04-25T08:48:40.392500+0000","last_fullsized":"2024-04-25T08:48:40.392500+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:36.810580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.405155+0000","last_change":"2024-04-25T08:48:39.400785+0000","last_active":"2024-04-25T08:48:39.405155+0000","last_peered":"2024-04-25T08:48:39.405155+0000","last_clean":"2024-04-25T08:48:39.405155+0000","last_became_active":"2024-04-25T08:48:39.400340+0000","last_became_peered":"2024-04-25T08:48:39.400340+0000","last_unstale":"2024-04-25T08:48:39.405155+0000","last_undegraded":"2024-04-25T08:48:39.405155+0000","last_fullsized":"2024-04-25T08:48:39.405155+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:08.833752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.398972+0000","last_change":"2024-04-25T08:48:39.392233+0000","last_active":"2024-04-25T08:48:39.398972+0000","last_peered":"2024-04-25T08:48:39.398972+0000","last_clean":"2024-04-25T08:48:39.398972+0000","last_became_active":"2024-04-25T08:48:39.391974+0000","last_became_peered":"2024-04-25T08:48:39.391974+0000","last_unstale":"2024-04-25T08:48:39.398972+0000","last_undegraded":"2024-04-25T08:48:39.398972+0000","last_fullsized":"2024-04-25T08:48:39.398972+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:52.729186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"94'4","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830371+0000","last_change":"2024-04-25T08:48:38.402395+0000","last_active":"2024-04-25T08:48:40.830371+0000","last_peered":"2024-04-25T08:48:40.830371+0000","last_clean":"2024-04-25T08:48:40.830371+0000","last_became_active":"2024-04-25T08:48:38.401737+0000","last_became_peered":"2024-04-25T08:48:38.401737+0000","last_unstale":"2024-04-25T08:48:40.830371+0000","last_undegraded":"2024-04-25T08:48:40.830371+0000","last_fullsized":"2024-04-25T08:48:40.830371+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:20.865341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.403030+0000","last_change":"2024-04-25T08:48:39.397041+0000","last_active":"2024-04-25T08:48:39.403030+0000","last_peered":"2024-04-25T08:48:39.403030+0000","last_clean":"2024-04-25T08:48:39.403030+0000","last_became_active":"2024-04-25T08:48:39.396704+0000","last_became_peered":"2024-04-25T08:48:39.396704+0000","last_unstale":"2024-04-25T08:48:39.403030+0000","last_undegraded":"2024-04-25T08:48:39.403030+0000","last_fullsized":"2024-04-25T08:48:39.403030+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:47.404426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393296+0000","last_change":"2024-04-25T08:48:38.396513+0000","last_active":"2024-04-25T08:48:40.393296+0000","last_peered":"2024-04-25T08:48:40.393296+0000","last_clean":"2024-04-25T08:48:40.393296+0000","last_became_active":"2024-04-25T08:48:38.395919+0000","last_became_peered":"2024-04-25T08:48:38.395919+0000","last_unstale":"2024-04-25T08:48:40.393296+0000","last_undegraded":"2024-04-25T08:48:40.393296+0000","last_fullsized":"2024-04-25T08:48:40.393296+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:32.440310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830138+0000","last_change":"2024-04-25T08:48:39.408703+0000","last_active":"2024-04-25T08:48:40.830138+0000","last_peered":"2024-04-25T08:48:40.830138+0000","last_clean":"2024-04-25T08:48:40.830138+0000","last_became_active":"2024-04-25T08:48:39.408361+0000","last_became_peered":"2024-04-25T08:48:39.408361+0000","last_unstale":"2024-04-25T08:48:40.830138+0000","last_undegraded":"2024-04-25T08:48:40.830138+0000","last_fullsized":"2024-04-25T08:48:40.830138+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.913355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830334+0000","last_change":"2024-04-25T08:48:38.400502+0000","last_active":"2024-04-25T08:48:40.830334+0000","last_peered":"2024-04-25T08:48:40.830334+0000","last_clean":"2024-04-25T08:48:40.830334+0000","last_became_active":"2024-04-25T08:48:38.400229+0000","last_became_peered":"2024-04-25T08:48:38.400229+0000","last_unstale":"2024-04-25T08:48:40.830334+0000","last_undegraded":"2024-04-25T08:48:40.830334+0000","last_fullsized":"2024-04-25T08:48:40.830334+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:25.112343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.411164+0000","last_change":"2024-04-25T08:48:39.403858+0000","last_active":"2024-04-25T08:48:39.411164+0000","last_peered":"2024-04-25T08:48:39.411164+0000","last_clean":"2024-04-25T08:48:39.411164+0000","last_became_active":"2024-04-25T08:48:39.403595+0000","last_became_peered":"2024-04-25T08:48:39.403595+0000","last_unstale":"2024-04-25T08:48:39.411164+0000","last_undegraded":"2024-04-25T08:48:39.411164+0000","last_fullsized":"2024-04-25T08:48:39.411164+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:10.795022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830654+0000","last_change":"2024-04-25T08:48:38.403345+0000","last_active":"2024-04-25T08:48:40.830654+0000","last_peered":"2024-04-25T08:48:40.830654+0000","last_clean":"2024-04-25T08:48:40.830654+0000","last_became_active":"2024-04-25T08:48:38.403017+0000","last_became_peered":"2024-04-25T08:48:38.403017+0000","last_unstale":"2024-04-25T08:48:40.830654+0000","last_undegraded":"2024-04-25T08:48:40.830654+0000","last_fullsized":"2024-04-25T08:48:40.830654+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:08.585281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.408522+0000","last_change":"2024-04-25T08:48:39.406711+0000","last_active":"2024-04-25T08:48:39.408522+0000","last_peered":"2024-04-25T08:48:39.408522+0000","last_clean":"2024-04-25T08:48:39.408522+0000","last_became_active":"2024-04-25T08:48:39.406451+0000","last_became_peered":"2024-04-25T08:48:39.406451+0000","last_unstale":"2024-04-25T08:48:39.408522+0000","last_undegraded":"2024-04-25T08:48:39.408522+0000","last_fullsized":"2024-04-25T08:48:39.408522+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:09.590226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393335+0000","last_change":"2024-04-25T08:48:38.399587+0000","last_active":"2024-04-25T08:48:40.393335+0000","last_peered":"2024-04-25T08:48:40.393335+0000","last_clean":"2024-04-25T08:48:40.393335+0000","last_became_active":"2024-04-25T08:48:38.399320+0000","last_became_peered":"2024-04-25T08:48:38.399320+0000","last_unstale":"2024-04-25T08:48:40.393335+0000","last_undegraded":"2024-04-25T08:48:40.393335+0000","last_fullsized":"2024-04-25T08:48:40.393335+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:59.026292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830139+0000","last_change":"2024-04-25T08:48:39.404604+0000","last_active":"2024-04-25T08:48:40.830139+0000","last_peered":"2024-04-25T08:48:40.830139+0000","last_clean":"2024-04-25T08:48:40.830139+0000","last_became_active":"2024-04-25T08:48:39.404305+0000","last_became_peered":"2024-04-25T08:48:39.404305+0000","last_unstale":"2024-04-25T08:48:40.830139+0000","last_undegraded":"2024-04-25T08:48:40.830139+0000","last_fullsized":"2024-04-25T08:48:40.830139+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:23.568612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"94'1","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.414542+0000","last_change":"2024-04-25T08:48:38.399086+0000","last_active":"2024-04-25T08:48:39.414542+0000","last_peered":"2024-04-25T08:48:39.414542+0000","last_clean":"2024-04-25T08:48:39.414542+0000","last_became_active":"2024-04-25T08:48:38.398800+0000","last_became_peered":"2024-04-25T08:48:38.398800+0000","last_unstale":"2024-04-25T08:48:39.414542+0000","last_undegraded":"2024-04-25T08:48:39.414542+0000","last_fullsized":"2024-04-25T08:48:39.414542+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:11.969912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.415168+0000","last_change":"2024-04-25T08:48:39.405718+0000","last_active":"2024-04-25T08:48:39.415168+0000","last_peered":"2024-04-25T08:48:39.415168+0000","last_clean":"2024-04-25T08:48:39.415168+0000","last_became_active":"2024-04-25T08:48:39.405180+0000","last_became_peered":"2024-04-25T08:48:39.405180+0000","last_unstale":"2024-04-25T08:48:39.415168+0000","last_undegraded":"2024-04-25T08:48:39.415168+0000","last_fullsized":"2024-04-25T08:48:39.415168+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:37.866048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.396294+0000","last_change":"2024-04-25T08:48:38.397889+0000","last_active":"2024-04-25T08:48:39.396294+0000","last_peered":"2024-04-25T08:48:39.396294+0000","last_clean":"2024-04-25T08:48:39.396294+0000","last_became_active":"2024-04-25T08:48:38.397619+0000","last_became_peered":"2024-04-25T08:48:38.397619+0000","last_unstale":"2024-04-25T08:48:39.396294+0000","last_undegraded":"2024-04-25T08:48:39.396294+0000","last_fullsized":"2024-04-25T08:48:39.396294+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:17.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.404712+0000","last_change":"2024-04-25T08:48:39.403384+0000","last_active":"2024-04-25T08:48:39.404712+0000","last_peered":"2024-04-25T08:48:39.404712+0000","last_clean":"2024-04-25T08:48:39.404712+0000","last_became_active":"2024-04-25T08:48:39.403117+0000","last_became_peered":"2024-04-25T08:48:39.403117+0000","last_unstale":"2024-04-25T08:48:39.404712+0000","last_undegraded":"2024-04-25T08:48:39.404712+0000","last_fullsized":"2024-04-25T08:48:39.404712+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:29.708370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.829894+0000","last_change":"2024-04-25T08:48:38.403977+0000","last_active":"2024-04-25T08:48:40.829894+0000","last_peered":"2024-04-25T08:48:40.829894+0000","last_clean":"2024-04-25T08:48:40.829894+0000","last_became_active":"2024-04-25T08:48:38.403469+0000","last_became_peered":"2024-04-25T08:48:38.403469+0000","last_unstale":"2024-04-25T08:48:40.829894+0000","last_undegraded":"2024-04-25T08:48:40.829894+0000","last_fullsized":"2024-04-25T08:48:40.829894+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:01.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393080+0000","last_change":"2024-04-25T08:48:39.404159+0000","last_active":"2024-04-25T08:48:40.393080+0000","last_peered":"2024-04-25T08:48:40.393080+0000","last_clean":"2024-04-25T08:48:40.393080+0000","last_became_active":"2024-04-25T08:48:39.402953+0000","last_became_peered":"2024-04-25T08:48:39.402953+0000","last_unstale":"2024-04-25T08:48:40.393080+0000","last_undegraded":"2024-04-25T08:48:40.393080+0000","last_fullsized":"2024-04-25T08:48:40.393080+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:23.568612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393356+0000","last_change":"2024-04-25T08:48:38.402528+0000","last_active":"2024-04-25T08:48:40.393356+0000","last_peered":"2024-04-25T08:48:40.393356+0000","last_clean":"2024-04-25T08:48:40.393356+0000","last_became_active":"2024-04-25T08:48:38.402209+0000","last_became_peered":"2024-04-25T08:48:38.402209+0000","last_unstale":"2024-04-25T08:48:40.393356+0000","last_undegraded":"2024-04-25T08:48:40.393356+0000","last_fullsized":"2024-04-25T08:48:40.393356+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:01.048276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830207+0000","last_change":"2024-04-25T08:48:39.402357+0000","last_active":"2024-04-25T08:48:40.830207+0000","last_peered":"2024-04-25T08:48:40.830207+0000","last_clean":"2024-04-25T08:48:40.830207+0000","last_became_active":"2024-04-25T08:48:39.402098+0000","last_became_peered":"2024-04-25T08:48:39.402098+0000","last_unstale":"2024-04-25T08:48:40.830207+0000","last_undegraded":"2024-04-25T08:48:40.830207+0000","last_fullsized":"2024-04-25T08:48:40.830207+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:24.257267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.393338+0000","last_change":"2024-04-25T08:48:38.404914+0000","last_active":"2024-04-25T08:48:39.393338+0000","last_peered":"2024-04-25T08:48:39.393338+0000","last_clean":"2024-04-25T08:48:39.393338+0000","last_became_active":"2024-04-25T08:48:38.404625+0000","last_became_peered":"2024-04-25T08:48:38.404625+0000","last_unstale":"2024-04-25T08:48:39.393338+0000","last_undegraded":"2024-04-25T08:48:39.393338+0000","last_fullsized":"2024-04-25T08:48:39.393338+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:01.209437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.406657+0000","last_change":"2024-04-25T08:48:39.401832+0000","last_active":"2024-04-25T08:48:39.406657+0000","last_peered":"2024-04-25T08:48:39.406657+0000","last_clean":"2024-04-25T08:48:39.406657+0000","last_became_active":"2024-04-25T08:48:39.401577+0000","last_became_peered":"2024-04-25T08:48:39.401577+0000","last_unstale":"2024-04-25T08:48:39.406657+0000","last_undegraded":"2024-04-25T08:48:39.406657+0000","last_fullsized":"2024-04-25T08:48:39.406657+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.913355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"94'3","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393562+0000","last_change":"2024-04-25T08:48:38.404275+0000","last_active":"2024-04-25T08:48:40.393562+0000","last_peered":"2024-04-25T08:48:40.393562+0000","last_clean":"2024-04-25T08:48:40.393562+0000","last_became_active":"2024-04-25T08:48:38.403913+0000","last_became_peered":"2024-04-25T08:48:38.403913+0000","last_unstale":"2024-04-25T08:48:40.393562+0000","last_undegraded":"2024-04-25T08:48:40.393562+0000","last_fullsized":"2024-04-25T08:48:40.393562+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:58.630570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.412761+0000","last_change":"2024-04-25T08:48:39.408330+0000","last_active":"2024-04-25T08:48:39.412761+0000","last_peered":"2024-04-25T08:48:39.412761+0000","last_clean":"2024-04-25T08:48:39.412761+0000","last_became_active":"2024-04-25T08:48:39.408051+0000","last_became_peered":"2024-04-25T08:48:39.408051+0000","last_unstale":"2024-04-25T08:48:39.412761+0000","last_undegraded":"2024-04-25T08:48:39.412761+0000","last_fullsized":"2024-04-25T08:48:39.412761+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:21.870286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"94'6","reported_seq":18,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.418164+0000","last_change":"2024-04-25T08:48:38.396453+0000","last_active":"2024-04-25T08:48:39.418164+0000","last_peered":"2024-04-25T08:48:39.418164+0000","last_clean":"2024-04-25T08:48:39.418164+0000","last_became_active":"2024-04-25T08:48:38.396142+0000","last_became_peered":"2024-04-25T08:48:38.396142+0000","last_unstale":"2024-04-25T08:48:39.418164+0000","last_undegraded":"2024-04-25T08:48:39.418164+0000","last_fullsized":"2024-04-25T08:48:39.418164+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:40.966815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.413715+0000","last_change":"2024-04-25T08:48:39.410343+0000","last_active":"2024-04-25T08:48:39.413715+0000","last_peered":"2024-04-25T08:48:39.413715+0000","last_clean":"2024-04-25T08:48:39.413715+0000","last_became_active":"2024-04-25T08:48:39.410088+0000","last_became_peered":"2024-04-25T08:48:39.410088+0000","last_unstale":"2024-04-25T08:48:39.413715+0000","last_undegraded":"2024-04-25T08:48:39.413715+0000","last_fullsized":"2024-04-25T08:48:39.413715+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:45.973104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830537+0000","last_change":"2024-04-25T08:48:38.404807+0000","last_active":"2024-04-25T08:48:40.830537+0000","last_peered":"2024-04-25T08:48:40.830537+0000","last_clean":"2024-04-25T08:48:40.830537+0000","last_became_active":"2024-04-25T08:48:38.404486+0000","last_became_peered":"2024-04-25T08:48:38.404486+0000","last_unstale":"2024-04-25T08:48:40.830537+0000","last_undegraded":"2024-04-25T08:48:40.830537+0000","last_fullsized":"2024-04-25T08:48:40.830537+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:05.344046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392080+0000","last_change":"2024-04-25T08:48:39.402806+0000","last_active":"2024-04-25T08:48:40.392080+0000","last_peered":"2024-04-25T08:48:40.392080+0000","last_clean":"2024-04-25T08:48:40.392080+0000","last_became_active":"2024-04-25T08:48:39.402506+0000","last_became_peered":"2024-04-25T08:48:39.402506+0000","last_unstale":"2024-04-25T08:48:40.392080+0000","last_undegraded":"2024-04-25T08:48:40.392080+0000","last_fullsized":"2024-04-25T08:48:40.392080+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:04.992891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.388139+0000","last_change":"2024-04-25T08:48:38.402891+0000","last_active":"2024-04-25T08:48:39.388139+0000","last_peered":"2024-04-25T08:48:39.388139+0000","last_clean":"2024-04-25T08:48:39.388139+0000","last_became_active":"2024-04-25T08:48:38.402614+0000","last_became_peered":"2024-04-25T08:48:38.402614+0000","last_unstale":"2024-04-25T08:48:39.388139+0000","last_undegraded":"2024-04-25T08:48:39.388139+0000","last_fullsized":"2024-04-25T08:48:39.388139+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:30.846747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.388747+0000","last_change":"2024-04-25T08:48:39.407743+0000","last_active":"2024-04-25T08:48:40.388747+0000","last_peered":"2024-04-25T08:48:40.388747+0000","last_clean":"2024-04-25T08:48:40.388747+0000","last_became_active":"2024-04-25T08:48:39.407478+0000","last_became_peered":"2024-04-25T08:48:39.407478+0000","last_unstale":"2024-04-25T08:48:40.388747+0000","last_undegraded":"2024-04-25T08:48:40.388747+0000","last_fullsized":"2024-04-25T08:48:40.388747+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:06.055363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.394640+0000","last_change":"2024-04-25T08:48:38.405614+0000","last_active":"2024-04-25T08:48:39.394640+0000","last_peered":"2024-04-25T08:48:39.394640+0000","last_clean":"2024-04-25T08:48:39.394640+0000","last_became_active":"2024-04-25T08:48:38.405315+0000","last_became_peered":"2024-04-25T08:48:38.405315+0000","last_unstale":"2024-04-25T08:48:39.394640+0000","last_undegraded":"2024-04-25T08:48:39.394640+0000","last_fullsized":"2024-04-25T08:48:39.394640+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:41.583960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.388947+0000","last_change":"2024-04-25T08:48:39.402020+0000","last_active":"2024-04-25T08:48:40.388947+0000","last_peered":"2024-04-25T08:48:40.388947+0000","last_clean":"2024-04-25T08:48:40.388947+0000","last_became_active":"2024-04-25T08:48:39.401748+0000","last_became_peered":"2024-04-25T08:48:39.401748+0000","last_unstale":"2024-04-25T08:48:40.388947+0000","last_undegraded":"2024-04-25T08:48:40.388947+0000","last_fullsized":"2024-04-25T08:48:40.388947+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:11.860789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"94'8","reported_seq":20,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.418104+0000","last_change":"2024-04-25T08:48:38.396410+0000","last_active":"2024-04-25T08:48:39.418104+0000","last_peered":"2024-04-25T08:48:39.418104+0000","last_clean":"2024-04-25T08:48:39.418104+0000","last_became_active":"2024-04-25T08:48:38.396084+0000","last_became_peered":"2024-04-25T08:48:38.396084+0000","last_unstale":"2024-04-25T08:48:39.418104+0000","last_undegraded":"2024-04-25T08:48:39.418104+0000","last_fullsized":"2024-04-25T08:48:39.418104+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:55.221335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.399002+0000","last_change":"2024-04-25T08:48:39.393100+0000","last_active":"2024-04-25T08:48:39.399002+0000","last_peered":"2024-04-25T08:48:39.399002+0000","last_clean":"2024-04-25T08:48:39.399002+0000","last_became_active":"2024-04-25T08:48:39.392825+0000","last_became_peered":"2024-04-25T08:48:39.392825+0000","last_unstale":"2024-04-25T08:48:39.399002+0000","last_undegraded":"2024-04-25T08:48:39.399002+0000","last_fullsized":"2024-04-25T08:48:39.399002+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:36.652572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830484+0000","last_change":"2024-04-25T08:48:38.400277+0000","last_active":"2024-04-25T08:48:40.830484+0000","last_peered":"2024-04-25T08:48:40.830484+0000","last_clean":"2024-04-25T08:48:40.830484+0000","last_became_active":"2024-04-25T08:48:38.400016+0000","last_became_peered":"2024-04-25T08:48:38.400016+0000","last_unstale":"2024-04-25T08:48:40.830484+0000","last_undegraded":"2024-04-25T08:48:40.830484+0000","last_fullsized":"2024-04-25T08:48:40.830484+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:49.352874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830118+0000","last_change":"2024-04-25T08:48:39.406235+0000","last_active":"2024-04-25T08:48:40.830118+0000","last_peered":"2024-04-25T08:48:40.830118+0000","last_clean":"2024-04-25T08:48:40.830118+0000","last_became_active":"2024-04-25T08:48:39.405948+0000","last_became_peered":"2024-04-25T08:48:39.405948+0000","last_unstale":"2024-04-25T08:48:40.830118+0000","last_undegraded":"2024-04-25T08:48:40.830118+0000","last_fullsized":"2024-04-25T08:48:40.830118+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:01.769276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830257+0000","last_change":"2024-04-25T08:48:38.399507+0000","last_active":"2024-04-25T08:48:40.830257+0000","last_peered":"2024-04-25T08:48:40.830257+0000","last_clean":"2024-04-25T08:48:40.830257+0000","last_became_active":"2024-04-25T08:48:38.399215+0000","last_became_peered":"2024-04-25T08:48:38.399215+0000","last_unstale":"2024-04-25T08:48:40.830257+0000","last_undegraded":"2024-04-25T08:48:40.830257+0000","last_fullsized":"2024-04-25T08:48:40.830257+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:39.395739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393470+0000","last_change":"2024-04-25T08:48:39.396971+0000","last_active":"2024-04-25T08:48:40.393470+0000","last_peered":"2024-04-25T08:48:40.393470+0000","last_clean":"2024-04-25T08:48:40.393470+0000","last_became_active":"2024-04-25T08:48:39.396682+0000","last_became_peered":"2024-04-25T08:48:39.396682+0000","last_unstale":"2024-04-25T08:48:40.393470+0000","last_undegraded":"2024-04-25T08:48:40.393470+0000","last_fullsized":"2024-04-25T08:48:40.393470+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:20.039588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"94'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393635+0000","last_change":"2024-04-25T08:48:38.395135+0000","last_active":"2024-04-25T08:48:40.393635+0000","last_peered":"2024-04-25T08:48:40.393635+0000","last_clean":"2024-04-25T08:48:40.393635+0000","last_became_active":"2024-04-25T08:48:38.394817+0000","last_became_peered":"2024-04-25T08:48:38.394817+0000","last_unstale":"2024-04-25T08:48:40.393635+0000","last_undegraded":"2024-04-25T08:48:40.393635+0000","last_fullsized":"2024-04-25T08:48:40.393635+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:41.583960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.415092+0000","last_change":"2024-04-25T08:48:39.405018+0000","last_active":"2024-04-25T08:48:39.415092+0000","last_peered":"2024-04-25T08:48:39.415092+0000","last_clean":"2024-04-25T08:48:39.415092+0000","last_became_active":"2024-04-25T08:48:39.404234+0000","last_became_peered":"2024-04-25T08:48:39.404234+0000","last_unstale":"2024-04-25T08:48:39.415092+0000","last_undegraded":"2024-04-25T08:48:39.415092+0000","last_fullsized":"2024-04-25T08:48:39.415092+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:54.023665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392325+0000","last_change":"2024-04-25T08:48:38.398082+0000","last_active":"2024-04-25T08:48:40.392325+0000","last_peered":"2024-04-25T08:48:40.392325+0000","last_clean":"2024-04-25T08:48:40.392325+0000","last_became_active":"2024-04-25T08:48:38.397778+0000","last_became_peered":"2024-04-25T08:48:38.397778+0000","last_unstale":"2024-04-25T08:48:40.392325+0000","last_undegraded":"2024-04-25T08:48:40.392325+0000","last_fullsized":"2024-04-25T08:48:40.392325+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:05.344046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392577+0000","last_change":"2024-04-25T08:48:39.410054+0000","last_active":"2024-04-25T08:48:40.392577+0000","last_peered":"2024-04-25T08:48:40.392577+0000","last_clean":"2024-04-25T08:48:40.392577+0000","last_became_active":"2024-04-25T08:48:39.409552+0000","last_became_peered":"2024-04-25T08:48:39.409552+0000","last_unstale":"2024-04-25T08:48:40.392577+0000","last_undegraded":"2024-04-25T08:48:40.392577+0000","last_fullsized":"2024-04-25T08:48:40.392577+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:29.992641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.388738+0000","last_change":"2024-04-25T08:48:38.398747+0000","last_active":"2024-04-25T08:48:40.388738+0000","last_peered":"2024-04-25T08:48:40.388738+0000","last_clean":"2024-04-25T08:48:40.388738+0000","last_became_active":"2024-04-25T08:48:38.398471+0000","last_became_peered":"2024-04-25T08:48:38.398471+0000","last_unstale":"2024-04-25T08:48:40.388738+0000","last_undegraded":"2024-04-25T08:48:40.388738+0000","last_fullsized":"2024-04-25T08:48:40.388738+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:33.104012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392133+0000","last_change":"2024-04-25T08:48:39.408656+0000","last_active":"2024-04-25T08:48:40.392133+0000","last_peered":"2024-04-25T08:48:40.392133+0000","last_clean":"2024-04-25T08:48:40.392133+0000","last_became_active":"2024-04-25T08:48:39.408371+0000","last_became_peered":"2024-04-25T08:48:39.408371+0000","last_unstale":"2024-04-25T08:48:40.392133+0000","last_undegraded":"2024-04-25T08:48:40.392133+0000","last_fullsized":"2024-04-25T08:48:40.392133+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:42.892417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392610+0000","last_change":"2024-04-25T08:48:38.403080+0000","last_active":"2024-04-25T08:48:40.392610+0000","last_peered":"2024-04-25T08:48:40.392610+0000","last_clean":"2024-04-25T08:48:40.392610+0000","last_became_active":"2024-04-25T08:48:38.402620+0000","last_became_peered":"2024-04-25T08:48:38.402620+0000","last_unstale":"2024-04-25T08:48:40.392610+0000","last_undegraded":"2024-04-25T08:48:40.392610+0000","last_fullsized":"2024-04-25T08:48:40.392610+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:39.395739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.411802+0000","last_change":"2024-04-25T08:48:39.403316+0000","last_active":"2024-04-25T08:48:39.411802+0000","last_peered":"2024-04-25T08:48:39.411802+0000","last_clean":"2024-04-25T08:48:39.411802+0000","last_became_active":"2024-04-25T08:48:39.400796+0000","last_became_peered":"2024-04-25T08:48:39.400796+0000","last_unstale":"2024-04-25T08:48:39.411802+0000","last_undegraded":"2024-04-25T08:48:39.411802+0000","last_fullsized":"2024-04-25T08:48:39.411802+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:18.254905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.388701+0000","last_change":"2024-04-25T08:48:38.396804+0000","last_active":"2024-04-25T08:48:40.388701+0000","last_peered":"2024-04-25T08:48:40.388701+0000","last_clean":"2024-04-25T08:48:40.388701+0000","last_became_active":"2024-04-25T08:48:38.396527+0000","last_became_peered":"2024-04-25T08:48:38.396527+0000","last_unstale":"2024-04-25T08:48:40.388701+0000","last_undegraded":"2024-04-25T08:48:40.388701+0000","last_fullsized":"2024-04-25T08:48:40.388701+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:03.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830486+0000","last_change":"2024-04-25T08:48:39.407035+0000","last_active":"2024-04-25T08:48:40.830486+0000","last_peered":"2024-04-25T08:48:40.830486+0000","last_clean":"2024-04-25T08:48:40.830486+0000","last_became_active":"2024-04-25T08:48:39.406744+0000","last_became_peered":"2024-04-25T08:48:39.406744+0000","last_unstale":"2024-04-25T08:48:40.830486+0000","last_undegraded":"2024-04-25T08:48:40.830486+0000","last_fullsized":"2024-04-25T08:48:40.830486+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:41.820618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"94'2","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830275+0000","last_change":"2024-04-25T08:48:38.402200+0000","last_active":"2024-04-25T08:48:40.830275+0000","last_peered":"2024-04-25T08:48:40.830275+0000","last_clean":"2024-04-25T08:48:40.830275+0000","last_became_active":"2024-04-25T08:48:38.401035+0000","last_became_peered":"2024-04-25T08:48:38.401035+0000","last_unstale":"2024-04-25T08:48:40.830275+0000","last_undegraded":"2024-04-25T08:48:40.830275+0000","last_fullsized":"2024-04-25T08:48:40.830275+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:29.322548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.397206+0000","last_change":"2024-04-25T08:48:39.393744+0000","last_active":"2024-04-25T08:48:39.397206+0000","last_peered":"2024-04-25T08:48:39.397206+0000","last_clean":"2024-04-25T08:48:39.397206+0000","last_became_active":"2024-04-25T08:48:39.393497+0000","last_became_peered":"2024-04-25T08:48:39.393497+0000","last_unstale":"2024-04-25T08:48:39.397206+0000","last_undegraded":"2024-04-25T08:48:39.397206+0000","last_fullsized":"2024-04-25T08:48:39.397206+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:58.465883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"95'1","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.402135+0000","last_change":"2024-04-25T08:48:38.397829+0000","last_active":"2024-04-25T08:48:40.402135+0000","last_peered":"2024-04-25T08:48:40.402135+0000","last_clean":"2024-04-25T08:48:40.402135+0000","last_became_active":"2024-04-25T08:48:38.397465+0000","last_became_peered":"2024-04-25T08:48:38.397465+0000","last_unstale":"2024-04-25T08:48:40.402135+0000","last_undegraded":"2024-04-25T08:48:40.402135+0000","last_fullsized":"2024-04-25T08:48:40.402135+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:55.221335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.415172+0000","last_change":"2024-04-25T08:48:39.405838+0000","last_active":"2024-04-25T08:48:39.415172+0000","last_peered":"2024-04-25T08:48:39.415172+0000","last_clean":"2024-04-25T08:48:39.415172+0000","last_became_active":"2024-04-25T08:48:39.400640+0000","last_became_peered":"2024-04-25T08:48:39.400640+0000","last_unstale":"2024-04-25T08:48:39.415172+0000","last_undegraded":"2024-04-25T08:48:39.415172+0000","last_fullsized":"2024-04-25T08:48:39.415172+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:04.360656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393633+0000","last_change":"2024-04-25T08:48:38.401991+0000","last_active":"2024-04-25T08:48:40.393633+0000","last_peered":"2024-04-25T08:48:40.393633+0000","last_clean":"2024-04-25T08:48:40.393633+0000","last_became_active":"2024-04-25T08:48:38.401725+0000","last_became_peered":"2024-04-25T08:48:38.401725+0000","last_unstale":"2024-04-25T08:48:40.393633+0000","last_undegraded":"2024-04-25T08:48:40.393633+0000","last_fullsized":"2024-04-25T08:48:40.393633+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:04.739909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.393241+0000","last_change":"2024-04-25T08:48:39.403523+0000","last_active":"2024-04-25T08:48:40.393241+0000","last_peered":"2024-04-25T08:48:40.393241+0000","last_clean":"2024-04-25T08:48:40.393241+0000","last_became_active":"2024-04-25T08:48:39.403234+0000","last_became_peered":"2024-04-25T08:48:39.403234+0000","last_unstale":"2024-04-25T08:48:40.393241+0000","last_undegraded":"2024-04-25T08:48:40.393241+0000","last_fullsized":"2024-04-25T08:48:40.393241+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:33.404941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830669+0000","last_change":"2024-04-25T08:48:38.399724+0000","last_active":"2024-04-25T08:48:40.830669+0000","last_peered":"2024-04-25T08:48:40.830669+0000","last_clean":"2024-04-25T08:48:40.830669+0000","last_became_active":"2024-04-25T08:48:38.399428+0000","last_became_peered":"2024-04-25T08:48:38.399428+0000","last_unstale":"2024-04-25T08:48:40.830669+0000","last_undegraded":"2024-04-25T08:48:40.830669+0000","last_fullsized":"2024-04-25T08:48:40.830669+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:24.473938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.388713+0000","last_change":"2024-04-25T08:48:39.401352+0000","last_active":"2024-04-25T08:48:40.388713+0000","last_peered":"2024-04-25T08:48:40.388713+0000","last_clean":"2024-04-25T08:48:40.388713+0000","last_became_active":"2024-04-25T08:48:39.401111+0000","last_became_peered":"2024-04-25T08:48:39.401111+0000","last_unstale":"2024-04-25T08:48:40.388713+0000","last_undegraded":"2024-04-25T08:48:40.388713+0000","last_fullsized":"2024-04-25T08:48:40.388713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:28.860105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.388010+0000","last_change":"2024-04-25T08:48:38.403828+0000","last_active":"2024-04-25T08:48:39.388010+0000","last_peered":"2024-04-25T08:48:39.388010+0000","last_clean":"2024-04-25T08:48:39.388010+0000","last_became_active":"2024-04-25T08:48:38.403568+0000","last_became_peered":"2024-04-25T08:48:38.403568+0000","last_unstale":"2024-04-25T08:48:39.388010+0000","last_undegraded":"2024-04-25T08:48:39.388010+0000","last_fullsized":"2024-04-25T08:48:39.388010+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:32.399996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.407060+0000","last_change":"2024-04-25T08:48:39.406008+0000","last_active":"2024-04-25T08:48:39.407060+0000","last_peered":"2024-04-25T08:48:39.407060+0000","last_clean":"2024-04-25T08:48:39.407060+0000","last_became_active":"2024-04-25T08:48:39.405754+0000","last_became_peered":"2024-04-25T08:48:39.405754+0000","last_unstale":"2024-04-25T08:48:39.407060+0000","last_undegraded":"2024-04-25T08:48:39.407060+0000","last_fullsized":"2024-04-25T08:48:39.407060+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:24.257267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.392118+0000","last_change":"2024-04-25T08:48:38.398631+0000","last_active":"2024-04-25T08:48:40.392118+0000","last_peered":"2024-04-25T08:48:40.392118+0000","last_clean":"2024-04-25T08:48:40.392118+0000","last_became_active":"2024-04-25T08:48:38.398321+0000","last_became_peered":"2024-04-25T08:48:38.398321+0000","last_unstale":"2024-04-25T08:48:40.392118+0000","last_undegraded":"2024-04-25T08:48:40.392118+0000","last_fullsized":"2024-04-25T08:48:40.392118+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:25.112343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.829917+0000","last_change":"2024-04-25T08:48:39.406427+0000","last_active":"2024-04-25T08:48:40.829917+0000","last_peered":"2024-04-25T08:48:40.829917+0000","last_clean":"2024-04-25T08:48:40.829917+0000","last_became_active":"2024-04-25T08:48:39.406132+0000","last_became_peered":"2024-04-25T08:48:39.406132+0000","last_unstale":"2024-04-25T08:48:40.829917+0000","last_undegraded":"2024-04-25T08:48:40.829917+0000","last_fullsized":"2024-04-25T08:48:40.829917+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:10.559840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830290+0000","last_change":"2024-04-25T08:48:38.402034+0000","last_active":"2024-04-25T08:48:40.830290+0000","last_peered":"2024-04-25T08:48:40.830290+0000","last_clean":"2024-04-25T08:48:40.830290+0000","last_became_active":"2024-04-25T08:48:38.400988+0000","last_became_peered":"2024-04-25T08:48:38.400988+0000","last_unstale":"2024-04-25T08:48:40.830290+0000","last_undegraded":"2024-04-25T08:48:40.830290+0000","last_fullsized":"2024-04-25T08:48:40.830290+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:24.820421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.415146+0000","last_change":"2024-04-25T08:48:39.405294+0000","last_active":"2024-04-25T08:48:39.415146+0000","last_peered":"2024-04-25T08:48:39.415146+0000","last_clean":"2024-04-25T08:48:39.415146+0000","last_became_active":"2024-04-25T08:48:39.401378+0000","last_became_peered":"2024-04-25T08:48:39.401378+0000","last_unstale":"2024-04-25T08:48:39.415146+0000","last_undegraded":"2024-04-25T08:48:39.415146+0000","last_fullsized":"2024-04-25T08:48:39.415146+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:21.696843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.829901+0000","last_change":"2024-04-25T08:48:38.405434+0000","last_active":"2024-04-25T08:48:40.829901+0000","last_peered":"2024-04-25T08:48:40.829901+0000","last_clean":"2024-04-25T08:48:40.829901+0000","last_became_active":"2024-04-25T08:48:38.404971+0000","last_became_peered":"2024-04-25T08:48:38.404971+0000","last_unstale":"2024-04-25T08:48:40.829901+0000","last_undegraded":"2024-04-25T08:48:40.829901+0000","last_fullsized":"2024-04-25T08:48:40.829901+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:32.710201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.830149+0000","last_change":"2024-04-25T08:48:39.409301+0000","last_active":"2024-04-25T08:48:40.830149+0000","last_peered":"2024-04-25T08:48:40.830149+0000","last_clean":"2024-04-25T08:48:40.830149+0000","last_became_active":"2024-04-25T08:48:39.407986+0000","last_became_peered":"2024-04-25T08:48:39.407986+0000","last_unstale":"2024-04-25T08:48:40.830149+0000","last_undegraded":"2024-04-25T08:48:40.830149+0000","last_fullsized":"2024-04-25T08:48:40.830149+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:38.378679+0000","last_clean_scrub_stamp":"2024-04-25T08:48:38.378679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:29.992641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T08:48:39.395708+0000","last_change":"2024-04-25T08:48:38.397376+0000","last_active":"2024-04-25T08:48:39.395708+0000","last_peered":"2024-04-25T08:48:39.395708+0000","last_clean":"2024-04-25T08:48:39.395708+0000","last_became_active":"2024-04-25T08:48:38.397067+0000","last_became_peered":"2024-04-25T08:48:38.397067+0000","last_unstale":"2024-04-25T08:48:39.395708+0000","last_undegraded":"2024-04-25T08:48:39.395708+0000","last_fullsized":"2024-04-25T08:48:39.395708+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:48:37.373734+0000","last_clean_scrub_stamp":"2024-04-25T08:48:37.373734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:32.440310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":311,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-25T08:48:40.829972+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:48:40.829972+0000","last_peered":"2024-04-25T08:48:40.829972+0000","last_clean":"2024-04-25T08:48:40.829972+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:48:40.829972+0000","last_undegraded":"2024-04-25T08:48:40.829972+0000","last_fullsized":"2024-04-25T08:48:40.829972+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41232,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330608,"statfs":{"total":96636764160,"available":96594542592,"internally_reserved":0,"allocated":1773568,"data_stored":1133945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40668,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331172,"statfs":{"total":96636764160,"available":96595120128,"internally_reserved":0,"allocated":1191936,"data_stored":545737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40640,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331200,"statfs":{"total":96636764160,"available":96595148800,"internally_reserved":0,"allocated":1159168,"data_stored":536829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46224,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325616,"statfs":{"total":96636764160,"available":96589430784,"internally_reserved":0,"allocated":1179648,"data_stored":543681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46200,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325640,"statfs":{"total":96636764160,"available":96589455360,"internally_reserved":0,"allocated":1159168,"data_stored":536829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46204,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325636,"statfs":{"total":96636764160,"available":96589451264,"internally_reserved":0,"allocated":1159168,"data_stored":536829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40640,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331200,"statfs":{"total":96636764160,"available":96595148800,"internally_reserved":0,"allocated":1163264,"data_stored":536899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46812,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325028,"statfs":{"total":96636764160,"available":96588828672,"internally_reserved":0,"allocated":1777664,"data_stored":1129515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:48:42.683 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:48:42.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:48:42.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.835+0000 7ff2e1529640 1 Processor -- start 2024-04-25T08:48:42.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.835+0000 7ff2e1529640 1 -- start start 2024-04-25T08:48:42.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2e1529640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2dc0ce230 0x7ff2dc0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2e1529640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2dc15b270 0x7ff2dc15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2e1529640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc072280 con 0x7ff2dc0cc4f0 2024-04-25T08:48:42.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2e1529640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc071270 con 0x7ff2dc0ce230 2024-04-25T08:48:42.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2e1529640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0714c0 con 0x7ff2dc15b270 2024-04-25T08:48:42.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2da7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2dc0ce230 0x7ff2dc0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2da7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2dc0ce230 0x7ff2dc0cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36786/0 (socket says 172.21.15.172:36786) 2024-04-25T08:48:42.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2da7fc640 1 -- 172.21.15.172:0/3907471139 learned_addr learned my addr 172.21.15.172:0/3907471139 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:42.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2db7fe640 1 --2- 172.21.15.172:0/3907471139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2dc15b270 0x7ff2dc15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2da7fc640 1 -- 172.21.15.172:0/3907471139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2dc15b270 msgr2=0x7ff2dc15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:42.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2da7fc640 1 --2- 172.21.15.172:0/3907471139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2dc15b270 0x7ff2dc15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2da7fc640 1 -- 172.21.15.172:0/3907471139 >> v1:172.21.15.186:6789/0 conn(0x7ff2dc0cc4f0 legacy=0x7ff2dc0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.836+0000 7ff2da7fc640 1 -- 172.21.15.172:0/3907471139 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0717a0 con 0x7ff2dc0ce230 2024-04-25T08:48:42.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.837+0000 7ff2da7fc640 1 --2- 172.21.15.172:0/3907471139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc0ce230 0x7ff2dc0cc8d0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009870 tx=0x7ff2d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39f409bca1af479 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:42.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.837+0000 7ff2d9ffb640 1 -- 172.21.15.172:0/3907471139 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0037070 con 0x7ff2dc0ce230 2024-04-25T08:48:42.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.837+0000 7ff2d9ffb640 1 -- 172.21.15.172:0/3907471139 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d0032440 con 0x7ff2dc0ce230 2024-04-25T08:48:42.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.837+0000 7ff2d9ffb640 1 -- 172.21.15.172:0/3907471139 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0032810 con 0x7ff2dc0ce230 2024-04-25T08:48:42.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.838+0000 7ff2e1529640 1 -- 172.21.15.172:0/3907471139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc0ce230 msgr2=0x7ff2dc0cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.838+0000 7ff2e1529640 1 --2- 172.21.15.172:0/3907471139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc0ce230 0x7ff2dc0cc8d0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009870 tx=0x7ff2d002a270 comp rx=0 tx=0).stop 2024-04-25T08:48:42.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.838+0000 7ff2e1529640 1 -- 172.21.15.172:0/3907471139 shutdown_connections 2024-04-25T08:48:42.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.838+0000 7ff2e1529640 1 --2- 172.21.15.172:0/3907471139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2dc15b270 0x7ff2dc15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.838+0000 7ff2e1529640 1 --2- 172.21.15.172:0/3907471139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc0ce230 0x7ff2dc0cc8d0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.838+0000 7ff2e1529640 1 -- 172.21.15.172:0/3907471139 >> 172.21.15.172:0/3907471139 conn(0x7ff2dc06abe0 msgr2=0x7ff2dc06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:42.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.838+0000 7ff2e1529640 1 -- 172.21.15.172:0/3907471139 shutdown_connections 2024-04-25T08:48:42.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.838+0000 7ff2e1529640 1 -- 172.21.15.172:0/3907471139 wait complete. 2024-04-25T08:48:42.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.839+0000 7ff2e1529640 1 Processor -- start 2024-04-25T08:48:42.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.839+0000 7ff2e1529640 1 -- start start 2024-04-25T08:48:42.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2e1529640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2dc0cc4f0 0x7ff2dc137c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2e1529640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2dc0ce230 0x7ff2dc1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2e1529640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc15b270 0x7ff2dc143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2e1529640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc15bbf0 con 0x7ff2dc15b270 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2e1529640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc071d60 con 0x7ff2dc0cc4f0 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2e1529640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc15bd70 con 0x7ff2dc0ce230 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2db7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc15b270 0x7ff2dc143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2db7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc15b270 0x7ff2dc143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36802/0 (socket says 172.21.15.172:36802) 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2db7fe640 1 -- 172.21.15.172:0/3857329144 learned_addr learned my addr 172.21.15.172:0/3857329144 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2da7fc640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2dc0ce230 0x7ff2dc1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2daffd640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2dc0cc4f0 0x7ff2dc137c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2db7fe640 1 -- 172.21.15.172:0/3857329144 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2dc0ce230 msgr2=0x7ff2dc1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2db7fe640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2dc0ce230 0x7ff2dc1465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2db7fe640 1 -- 172.21.15.172:0/3857329144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2dc0cc4f0 msgr2=0x7ff2dc137c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2db7fe640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2dc0cc4f0 0x7ff2dc137c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:42.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2db7fe640 1 -- 172.21.15.172:0/3857329144 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc146b00 con 0x7ff2dc15b270 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2db7fe640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc15b270 0x7ff2dc143770 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400e960 tx=0x7ff2d400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.840+0000 7ff2c37fe640 1 -- 172.21.15.172:0/3857329144 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4017070 con 0x7ff2dc15b270 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.841+0000 7ff2c37fe640 1 -- 172.21.15.172:0/3857329144 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d400c980 con 0x7ff2dc15b270 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.841+0000 7ff2e1529640 1 -- 172.21.15.172:0/3857329144 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc13fed0 con 0x7ff2dc15b270 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.841+0000 7ff2c37fe640 1 -- 172.21.15.172:0/3857329144 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400cd70 con 0x7ff2dc15b270 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.841+0000 7ff2e1529640 1 -- 172.21.15.172:0/3857329144 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc145dc0 con 0x7ff2dc15b270 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.841+0000 7ff2e1529640 1 -- 172.21.15.172:0/3857329144 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc073a00 con 0x7ff2dc15b270 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.842+0000 7ff2c37fe640 1 -- 172.21.15.172:0/3857329144 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff2d401a070 con 0x7ff2dc15b270 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.842+0000 7ff2c37fe640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c806b500 0x7ff2c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.842+0000 7ff2c37fe640 1 -- 172.21.15.172:0/3857329144 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff2d408a790 con 0x7ff2dc15b270 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.842+0000 7ff2daffd640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c806b500 0x7ff2c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:42.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.843+0000 7ff2daffd640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c806b500 0x7ff2c806d9c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc007fd0 tx=0x7ff2cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:42.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:42.846+0000 7ff2c37fe640 1 -- 172.21.15.172:0/3857329144 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff2d40593f0 con 0x7ff2dc15b270 2024-04-25T08:48:43.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.083+0000 7ff2e1529640 1 -- 172.21.15.172:0/3857329144 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff2dc0b4960 con 0x7ff2dc15b270 2024-04-25T08:48:43.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.085+0000 7ff2c37fe640 1 -- 172.21.15.172:0/3857329144 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff2d4058cf0 con 0x7ff2dc15b270 2024-04-25T08:48:43.076 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T08:48:43.077 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:48:43.077 INFO:teuthology.orchestra.run.smithi172.stdout: caps mds = "allow" 2024-04-25T08:48:43.077 INFO:teuthology.orchestra.run.smithi172.stdout: caps mon = "allow r" 2024-04-25T08:48:43.077 INFO:teuthology.orchestra.run.smithi172.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:48:43.077 INFO:teuthology.orchestra.run.smithi172.stderr:updated caps for client.0 2024-04-25T08:48:43.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.087+0000 7ff2e1529640 1 -- 172.21.15.172:0/3857329144 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c806b500 msgr2=0x7ff2c806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.087+0000 7ff2e1529640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c806b500 0x7ff2c806d9c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc007fd0 tx=0x7ff2cc009040 comp rx=0 tx=0).stop 2024-04-25T08:48:43.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.088+0000 7ff2e1529640 1 -- 172.21.15.172:0/3857329144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc15b270 msgr2=0x7ff2dc143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.088+0000 7ff2e1529640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc15b270 0x7ff2dc143770 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400e960 tx=0x7ff2d400ee20 comp rx=0 tx=0).stop 2024-04-25T08:48:43.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.088+0000 7ff2e1529640 1 -- 172.21.15.172:0/3857329144 shutdown_connections 2024-04-25T08:48:43.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.088+0000 7ff2e1529640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff2c806b500 0x7ff2c806d9c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.088+0000 7ff2e1529640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2dc15b270 0x7ff2dc143770 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.088+0000 7ff2e1529640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2dc0ce230 0x7ff2dc1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.088+0000 7ff2e1529640 1 --2- 172.21.15.172:0/3857329144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2dc0cc4f0 0x7ff2dc137c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.088+0000 7ff2e1529640 1 -- 172.21.15.172:0/3857329144 >> 172.21.15.172:0/3857329144 conn(0x7ff2dc06abe0 msgr2=0x7ff2dc0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:43.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.088+0000 7ff2e1529640 1 -- 172.21.15.172:0/3857329144 shutdown_connections 2024-04-25T08:48:43.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.088+0000 7ff2e1529640 1 -- 172.21.15.172:0/3857329144 wait complete. 2024-04-25T08:48:43.090 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:48:43.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.197+0000 7f96c922a640 1 Processor -- start 2024-04-25T08:48:43.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.197+0000 7f96c922a640 1 -- start start 2024-04-25T08:48:43.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96c922a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 0x7f96c40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96c922a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f96c4099a40 0x7f96c4099ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96c922a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40cc3c0 con 0x7f96c415f020 2024-04-25T08:48:43.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96c922a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40cccb0 con 0x7f96c4099a40 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96c922a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c415f400 con 0x7f96c40b0b90 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96c359e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f96c4099a40 0x7f96c4099ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96c359e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f96c4099a40 0x7f96c4099ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36814/0 (socket says 172.21.15.172:36814) 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96c359e640 1 -- 172.21.15.172:0/1478867713 learned_addr learned my addr 172.21.15.172:0/1478867713 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96ba59c640 1 --2- 172.21.15.172:0/1478867713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 0x7f96c40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96c359e640 1 -- 172.21.15.172:0/1478867713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 msgr2=0x7f96c40cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.198+0000 7f96c359e640 1 --2- 172.21.15.172:0/1478867713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 0x7f96c40cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.199+0000 7f96c359e640 1 -- 172.21.15.172:0/1478867713 >> v1:172.21.15.186:6789/0 conn(0x7f96c415f020 legacy=0x7f96c40b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.199+0000 7f96c359e640 1 -- 172.21.15.172:0/1478867713 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40d0550 con 0x7f96c4099a40 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.199+0000 7f96ba59c640 1 --2- 172.21.15.172:0/1478867713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 0x7f96c40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.199+0000 7f96c359e640 1 --2- 172.21.15.172:0/1478867713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c4099a40 0x7f96c4099ed0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009e50 tx=0x7f96bc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340cf681ade43e9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.199+0000 7f96c259c640 1 -- 172.21.15.172:0/1478867713 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc036070 con 0x7f96c4099a40 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.199+0000 7f96c259c640 1 -- 172.21.15.172:0/1478867713 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc031600 con 0x7f96c4099a40 2024-04-25T08:48:43.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.199+0000 7f96c259c640 1 -- 172.21.15.172:0/1478867713 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0319d0 con 0x7f96c4099a40 2024-04-25T08:48:43.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.200+0000 7f96c922a640 1 -- 172.21.15.172:0/1478867713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c4099a40 msgr2=0x7f96c4099ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.200+0000 7f96c922a640 1 --2- 172.21.15.172:0/1478867713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c4099a40 0x7f96c4099ed0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009e50 tx=0x7f96bc02a710 comp rx=0 tx=0).stop 2024-04-25T08:48:43.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.200+0000 7f96c922a640 1 -- 172.21.15.172:0/1478867713 shutdown_connections 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.200+0000 7f96c922a640 1 --2- 172.21.15.172:0/1478867713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c4099a40 0x7f96c4099ed0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.200+0000 7f96c922a640 1 --2- 172.21.15.172:0/1478867713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 0x7f96c40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.200+0000 7f96c922a640 1 -- 172.21.15.172:0/1478867713 >> 172.21.15.172:0/1478867713 conn(0x7f96c40b3310 msgr2=0x7f96c40b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.200+0000 7f96c922a640 1 -- 172.21.15.172:0/1478867713 shutdown_connections 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.200+0000 7f96c922a640 1 -- 172.21.15.172:0/1478867713 wait complete. 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.201+0000 7f96c922a640 1 Processor -- start 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.201+0000 7f96c922a640 1 -- start start 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c922a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96c4099a40 0x7f96c40b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c922a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 0x7f96c40c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c922a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c415f020 0x7f96c4159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c922a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cc940 con 0x7f96c415f020 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c922a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cc660 con 0x7f96c4099a40 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c922a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cd140 con 0x7f96c40b0b90 2024-04-25T08:48:43.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c415f020 0x7f96c4159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c415f020 0x7f96c4159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36818/0 (socket says 172.21.15.172:36818) 2024-04-25T08:48:43.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c359e640 1 -- 172.21.15.172:0/2596616340 learned_addr learned my addr 172.21.15.172:0/2596616340 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:43.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c2d9d640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96c4099a40 0x7f96c40b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96ba59c640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 0x7f96c40c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.202+0000 7f96c359e640 1 -- 172.21.15.172:0/2596616340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 msgr2=0x7f96c40c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.203+0000 7f96c359e640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 0x7f96c40c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.203+0000 7f96c359e640 1 -- 172.21.15.172:0/2596616340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96c4099a40 msgr2=0x7f96c40b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.203+0000 7f96c359e640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96c4099a40 0x7f96c40b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.203+0000 7f96c359e640 1 -- 172.21.15.172:0/2596616340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40c5c80 con 0x7f96c415f020 2024-04-25T08:48:43.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.203+0000 7f96c359e640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c415f020 0x7f96c4159a60 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009e50 tx=0x7f96bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:43.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.203+0000 7f96bbfff640 1 -- 172.21.15.172:0/2596616340 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc041020 con 0x7f96c415f020 2024-04-25T08:48:43.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.203+0000 7f96bbfff640 1 -- 172.21.15.172:0/2596616340 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc0077a0 con 0x7f96c415f020 2024-04-25T08:48:43.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.203+0000 7f96c922a640 1 -- 172.21.15.172:0/2596616340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c40c91a0 con 0x7f96c415f020 2024-04-25T08:48:43.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.203+0000 7f96bbfff640 1 -- 172.21.15.172:0/2596616340 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc036040 con 0x7f96c415f020 2024-04-25T08:48:43.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.203+0000 7f96c922a640 1 -- 172.21.15.172:0/2596616340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c40c5890 con 0x7f96c415f020 2024-04-25T08:48:43.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.204+0000 7f96c922a640 1 -- 172.21.15.172:0/2596616340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c4073990 con 0x7f96c415f020 2024-04-25T08:48:43.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.204+0000 7f96bbfff640 1 -- 172.21.15.172:0/2596616340 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f96bc044020 con 0x7f96c415f020 2024-04-25T08:48:43.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.205+0000 7f96bbfff640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f96a406b4d0 0x7f96a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.205+0000 7f96bbfff640 1 -- 172.21.15.172:0/2596616340 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f96bc0ab000 con 0x7f96c415f020 2024-04-25T08:48:43.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.205+0000 7f96c2d9d640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f96a406b4d0 0x7f96a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.205+0000 7f96c2d9d640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f96a406b4d0 0x7f96a406d990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f96b4007fd0 tx=0x7f96b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:43.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.209+0000 7f96bbfff640 1 -- 172.21.15.172:0/2596616340 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f96bc04b030 con 0x7f96c415f020 2024-04-25T08:48:43.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.415+0000 7f96c922a640 1 -- 172.21.15.172:0/2596616340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96c40b77a0 con 0x7f96c415f020 2024-04-25T08:48:43.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.415+0000 7f96bbfff640 1 -- 172.21.15.172:0/2596616340 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f96bc079d80 con 0x7f96c415f020 2024-04-25T08:48:43.406 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/154236059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":154236059},{"type":"v1","addr":"172.21.15.172:6837","nonce":154236059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/985041095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":985041095},{"type":"v1","addr":"172.21.15.186:6835","nonce":985041095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7686,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1301700155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1301700155},{"type":"v1","addr":"172.21.15.172:6836","nonce":1301700155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:48:38.741906+0000","modified":"2024-04-25T08:48:40.732152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6834/246475597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":246475597},{"type":"v1","addr":"172.21.15.186:6834","nonce":246475597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:48:43.407 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 56 2024-04-25T08:48:43.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 -- 172.21.15.172:0/2596616340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f96a406b4d0 msgr2=0x7f96a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f96a406b4d0 0x7f96a406d990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f96b4007fd0 tx=0x7f96b4009040 comp rx=0 tx=0).stop 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 -- 172.21.15.172:0/2596616340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c415f020 msgr2=0x7f96c4159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c415f020 0x7f96c4159a60 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009e50 tx=0x7f96bc004a40 comp rx=0 tx=0).stop 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 -- 172.21.15.172:0/2596616340 shutdown_connections 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f96a406b4d0 0x7f96a406d990 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c415f020 0x7f96c4159a60 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96c40b0b90 0x7f96c40c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 --2- 172.21.15.172:0/2596616340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96c4099a40 0x7f96c40b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 -- 172.21.15.172:0/2596616340 >> 172.21.15.172:0/2596616340 conn(0x7f96c40b3310 msgr2=0x7f96c415fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.417+0000 7f96c922a640 1 -- 172.21.15.172:0/2596616340 shutdown_connections 2024-04-25T08:48:43.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.418+0000 7f96c922a640 1 -- 172.21.15.172:0/2596616340 wait complete. 2024-04-25T08:48:43.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:48:38.741906+0000', 'modified': '2024-04-25T08:48:40.732152+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7704': {'gid': 7704, 'name': 'd', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6834/246475597', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6832', 'nonce': 246475597}, {'type': 'v1', 'addr': '172.21.15.186:6834', 'nonce': 246475597}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:48:43.824 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:48:43.824 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T08:48:43.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.932+0000 7f1b17c9e640 1 Processor -- start 2024-04-25T08:48:43.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.932+0000 7f1b17c9e640 1 -- start start 2024-04-25T08:48:43.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.933+0000 7f1b17c9e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1b1015dc20 0x7f1b100ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.933+0000 7f1b17c9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 0x7f1b100cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.933+0000 7f1b17c9e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1015e000 con 0x7f1b100b9330 2024-04-25T08:48:43.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.933+0000 7f1b17c9e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b100d1de0 con 0x7f1b1015dc20 2024-04-25T08:48:43.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.933+0000 7f1b17c9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10161c60 con 0x7f1b10161710 2024-04-25T08:48:43.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.934+0000 7f1b15239640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 0x7f1b100cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.934+0000 7f1b15a3a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1b1015dc20 0x7f1b100ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.934+0000 7f1b1623b640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f1b100b9330 0x7f1b1006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:39838/0 (socket says 172.21.15.172:39838) 2024-04-25T08:48:43.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.934+0000 7f1b1623b640 1 -- 172.21.15.172:0/1373132742 learned_addr learned my addr 172.21.15.172:0/1373132742 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:43.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.934+0000 7f1b15239640 1 -- 172.21.15.172:0/1373132742 >> v2:172.21.15.186:3300/0 conn(0x7f1b1015dc20 msgr2=0x7f1b100ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:43.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.934+0000 7f1b15239640 1 --2- 172.21.15.172:0/1373132742 >> v2:172.21.15.186:3300/0 conn(0x7f1b1015dc20 0x7f1b100ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.934+0000 7f1b15239640 1 -- 172.21.15.172:0/1373132742 >> v1:172.21.15.186:6789/0 conn(0x7f1b100b9330 legacy=0x7f1b1006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.934+0000 7f1b15239640 1 -- 172.21.15.172:0/1373132742 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10161f40 con 0x7f1b10161710 2024-04-25T08:48:43.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.934+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/1373132742 >> v2:172.21.15.186:3300/0 conn(0x7f1b1015dc20 0x7f1b100ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.935+0000 7f1b15239640 1 --2- 172.21.15.172:0/1373132742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 0x7f1b100cebb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b000097a0 tx=0x7f1b0002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5652c1ed4d5b748 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.935+0000 7f1b14a38640 1 -- 172.21.15.172:0/1373132742 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00037070 con 0x7f1b10161710 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.935+0000 7f1b14a38640 1 -- 172.21.15.172:0/1373132742 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b00032440 con 0x7f1b10161710 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.935+0000 7f1b14a38640 1 -- 172.21.15.172:0/1373132742 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00032810 con 0x7f1b10161710 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.935+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1373132742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 msgr2=0x7f1b100cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.935+0000 7f1b17c9e640 1 --2- 172.21.15.172:0/1373132742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 0x7f1b100cebb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b000097a0 tx=0x7f1b0002a180 comp rx=0 tx=0).stop 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.936+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1373132742 shutdown_connections 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.936+0000 7f1b17c9e640 1 --2- 172.21.15.172:0/1373132742 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 0x7f1b100cebb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.936+0000 7f1b17c9e640 1 --2- 172.21.15.172:0/1373132742 >> v2:172.21.15.186:3300/0 conn(0x7f1b1015dc20 0x7f1b100ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.936+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1373132742 >> 172.21.15.172:0/1373132742 conn(0x7f1b100d0420 msgr2=0x7f1b100d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:43.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.936+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1373132742 shutdown_connections 2024-04-25T08:48:43.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.936+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1373132742 wait complete. 2024-04-25T08:48:43.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.937+0000 7f1b17c9e640 1 Processor -- start 2024-04-25T08:48:43.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.937+0000 7f1b17c9e640 1 -- start start 2024-04-25T08:48:43.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.937+0000 7f1b17c9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b100b9330 0x7f1b100b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.937+0000 7f1b17c9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b1015dc20 0x7f1b100cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.937+0000 7f1b17c9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 0x7f1b100aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.937+0000 7f1b17c9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100b5e50 con 0x7f1b100b9330 2024-04-25T08:48:43.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.937+0000 7f1b17c9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10162500 con 0x7f1b1015dc20 2024-04-25T08:48:43.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.937+0000 7f1b17c9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100b5fd0 con 0x7f1b10161710 2024-04-25T08:48:43.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b15a3a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b100b9330 0x7f1b100b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b15a3a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b100b9330 0x7f1b100b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36826/0 (socket says 172.21.15.172:36826) 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b15a3a640 1 -- 172.21.15.172:0/1387751574 learned_addr learned my addr 172.21.15.172:0/1387751574 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b15239640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b1015dc20 0x7f1b100cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b1623b640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 0x7f1b100aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b15a3a640 1 -- 172.21.15.172:0/1387751574 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 msgr2=0x7f1b100aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 0x7f1b100aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b15a3a640 1 -- 172.21.15.172:0/1387751574 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b1015dc20 msgr2=0x7f1b100cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b1015dc20 0x7f1b100cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b15a3a640 1 -- 172.21.15.172:0/1387751574 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b100aaab0 con 0x7f1b100b9330 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b100b9330 0x7f1b100b1a20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009ec0 tx=0x7f1b0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b067fc640 1 -- 172.21.15.172:0/1387751574 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c018020 con 0x7f1b100b9330 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b067fc640 1 -- 172.21.15.172:0/1387751574 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c014680 con 0x7f1b100b9330 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1387751574 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b100aad90 con 0x7f1b100b9330 2024-04-25T08:48:43.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b067fc640 1 -- 172.21.15.172:0/1387751574 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c014a50 con 0x7f1b100b9330 2024-04-25T08:48:43.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.938+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1387751574 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b100ab350 con 0x7f1b100b9330 2024-04-25T08:48:43.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.940+0000 7f1b067fc640 1 -- 172.21.15.172:0/1387751574 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1b0c005d10 con 0x7f1b100b9330 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.940+0000 7f1b067fc640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1af406b4d0 0x7f1af406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.940+0000 7f1b067fc640 1 -- 172.21.15.172:0/1387751574 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1b0c08b1a0 con 0x7f1b100b9330 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.940+0000 7f1b15239640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1af406b4d0 0x7f1af406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.941+0000 7f1b15239640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1af406b4d0 0x7f1af406d990 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1b00034000 tx=0x7f1b0002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.941+0000 7f1b1a9a2740 1 Processor -- start 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.941+0000 7f1b1a9a2740 1 -- start start 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cf6230 0x55dc69cf6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d14020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69ccbf10 0x55dc69d12190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc69c2ea10 con 0x55dc69d13ad0 2024-04-25T08:48:43.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc69bd7b30 con 0x55dc69cf6230 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc69c2ac50 con 0x55dc69ccbf10 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b15239640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d14020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b15239640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d14020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36832/0 (socket says 172.21.15.172:36832) 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b15239640 1 -- 172.21.15.172:0/3527329529 learned_addr learned my addr 172.21.15.172:0/3527329529 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/3527329529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cf6230 0x55dc69cf6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b1623b640 1 --2- 172.21.15.172:0/3527329529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69ccbf10 0x55dc69d12190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b15239640 1 -- 172.21.15.172:0/3527329529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69ccbf10 msgr2=0x55dc69d12190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b15239640 1 --2- 172.21.15.172:0/3527329529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69ccbf10 0x55dc69d12190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b15239640 1 -- 172.21.15.172:0/3527329529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cf6230 msgr2=0x55dc69cf6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b15239640 1 --2- 172.21.15.172:0/3527329529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cf6230 0x55dc69cf6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b15239640 1 -- 172.21.15.172:0/3527329529 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc69bece10 con 0x55dc69d13ad0 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.942+0000 7f1b15239640 1 --2- 172.21.15.172:0/3527329529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d14020 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1b00035040 tx=0x7f1b0002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa9bb92a20ff7d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:43.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1af37fe640 1 -- 172.21.15.172:0/3527329529 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0004e070 con 0x55dc69d13ad0 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1af37fe640 1 -- 172.21.15.172:0/3527329529 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b00032da0 con 0x55dc69d13ad0 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1af37fe640 1 -- 172.21.15.172:0/3527329529 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00037040 con 0x55dc69d13ad0 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/3527329529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 msgr2=0x55dc69d14020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/3527329529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d14020 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1b00035040 tx=0x7f1b0002c000 comp rx=0 tx=0).stop 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/3527329529 shutdown_connections 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/3527329529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69ccbf10 0x55dc69d12190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/3527329529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d14020 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/3527329529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cf6230 0x55dc69cf6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/3527329529 >> 172.21.15.172:0/3527329529 conn(0x55dc69cc8840 msgr2=0x55dc69d11040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/3527329529 shutdown_connections 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.943+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/3527329529 wait complete. 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.944+0000 7f1b1a9a2740 1 -- start start 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.944+0000 7f1b1a9a2740 1 Processor -- start 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 0x55dc69ce2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69d13ad0 0x55dc69cc5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cdf830 0x55dc69cc5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc69ccccb0 con 0x55dc69cdf830 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc69beb0c0 con 0x55dc69d13ad0 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc69cc6770 con 0x55dc69cf6230 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1a9a2740 10 client.0 _ll_register_callbacks cb 0x55dc69bdeec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1623b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cdf830 0x55dc69cc5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1623b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cdf830 0x55dc69cc5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36834/0 (socket says 172.21.15.172:36834) 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1623b640 1 -- 172.21.15.172:0/1962842946 learned_addr learned my addr 172.21.15.172:0/1962842946 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b15a3a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 0x55dc69ce2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b15239640 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69d13ad0 0x55dc69cc5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1623b640 1 -- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 msgr2=0x55dc69ce2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1623b640 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 0x55dc69ce2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1623b640 1 -- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69d13ad0 msgr2=0x55dc69cc5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1623b640 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69d13ad0 0x55dc69cc5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1623b640 1 -- 172.21.15.172:0/1962842946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc699432d0 con 0x55dc69cdf830 2024-04-25T08:48:43.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b15239640 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69d13ad0 0x55dc69cc5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1b1623b640 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cdf830 0x55dc69cc5a80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1b08007580 tx=0x7f1b080105b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dab283ea9123f4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1af0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.945+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1962842946 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08018020 con 0x55dc69cdf830 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1962842946 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1b08014400 con 0x55dc69cdf830 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1962842946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b00032da0 con 0x55dc69cdf830 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1962842946 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b08022050 con 0x55dc69cdf830 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1b1a9a2740 10 client.7836 fetch_fsmap learned FSMap version 56 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1962842946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55dc69a0d6b0 con 0x55dc69cdf830 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1962842946 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b00032da0 con 0x55dc69cdf830 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1962842946 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1b08025020 con 0x55dc69cdf830 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1b1a9a2740 10 client.7836 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T08:48:43.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1b1a9a2740 10 client.7836 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1b1a9a2740 20 client.7836 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55dc69cf49e0 0x55dc69ce0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1b1a9a2740 4 client.7836 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1962842946 --> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc69c8d920 con 0x55dc69cf49e0 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.946+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55dc69cf49e0 0x55dc69ce0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1af0ff9640 10 client.7836 ms_handle_connect on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55dc69cf49e0 0x55dc69ce0be0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cb5045bad901ec2 server_cookie=1d7a106ffbb27043 in_seq=0 out_seq=0 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1962842946 <== mds.0 v2:172.21.15.186:6832/246475597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dc69c8d920 con 0x55dc69cf49e0 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1af0ff9640 10 client.7836 handle_command_reply: tid=0 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 client.7836 shutdown 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1962842946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cdf830 msgr2=0x55dc69cc5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cdf830 0x55dc69cc5a80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1b08007580 tx=0x7f1b080105b0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1962842946 shutdown_connections 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55dc69cf49e0 0x55dc69ce0be0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69d13ad0 0x55dc69cc5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cdf830 0x55dc69cc5a80 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1af0ff9640 0 client.7836 ms_handle_reset on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:43.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1962842946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 0x55dc69ce2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1962842946 >> 172.21.15.172:0/1962842946 conn(0x55dc69ccbf10 msgr2=0x55dc69d145c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:43.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1962842946 shutdown_connections 2024-04-25T08:48:43.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.947+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1962842946 wait complete. 2024-04-25T08:48:43.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.948+0000 7f1b1a9a2740 20 client.7836 trim_cache size 0 max 16384 2024-04-25T08:48:43.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.963+0000 7f1b1a9a2740 1 Processor -- start 2024-04-25T08:48:43.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.963+0000 7f1b1a9a2740 1 -- start start 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 0x55dc69cf9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 0x55dc69ccc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d2a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101ff7d0 con 0x55dc69d13ad0 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100cc3d0 con 0x55dc69cdf830 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101ff470 con 0x55dc69cf6230 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1623b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d2a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1623b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d2a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36844/0 (socket says 172.21.15.172:36844) 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1623b640 1 -- 172.21.15.172:0/636725409 learned_addr learned my addr 172.21.15.172:0/636725409 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/636725409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 0x55dc69cf9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b15239640 1 --2- 172.21.15.172:0/636725409 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 0x55dc69ccc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1623b640 1 -- 172.21.15.172:0/636725409 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 msgr2=0x55dc69ccc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:43.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1623b640 1 --2- 172.21.15.172:0/636725409 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 0x55dc69ccc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1623b640 1 -- 172.21.15.172:0/636725409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 msgr2=0x55dc69cf9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1623b640 1 --2- 172.21.15.172:0/636725409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 0x55dc69cf9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1623b640 1 -- 172.21.15.172:0/636725409 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc69cdfc10 con 0x55dc69d13ad0 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b15239640 1 --2- 172.21.15.172:0/636725409 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 0x55dc69ccc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1b1623b640 1 --2- 172.21.15.172:0/636725409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d2a3f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1b08010f00 tx=0x7f1b0800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f98c24a0d9cbf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1af2ffd640 1 -- 172.21.15.172:0/636725409 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0802b070 con 0x55dc69d13ad0 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1af2ffd640 1 -- 172.21.15.172:0/636725409 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b08010ab0 con 0x55dc69d13ad0 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.964+0000 7f1af2ffd640 1 -- 172.21.15.172:0/636725409 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08018030 con 0x55dc69d13ad0 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.965+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/636725409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 msgr2=0x55dc69d2a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.965+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/636725409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d2a3f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1b08010f00 tx=0x7f1b0800c000 comp rx=0 tx=0).stop 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.965+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/636725409 shutdown_connections 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.965+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/636725409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69d13ad0 0x55dc69d2a3f0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.965+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/636725409 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69cf6230 0x55dc69ccc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.965+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/636725409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 0x55dc69cf9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.965+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/636725409 >> 172.21.15.172:0/636725409 conn(0x55dc69ccbf10 msgr2=0x55dc69cc54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:43.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.965+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/636725409 shutdown_connections 2024-04-25T08:48:43.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.965+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/636725409 wait complete. 2024-04-25T08:48:43.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.966+0000 7f1b1a9a2740 1 -- start start 2024-04-25T08:48:43.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.966+0000 7f1b1a9a2740 1 Processor -- start 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.966+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 0x55dc69d7bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.966+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cf6230 0x55dc69d10fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b1a9a2740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69d13ad0 0x55dc69ce1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc69cf4860 con 0x55dc69cf6230 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc69ce0030 con 0x55dc69cdf830 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b1a9a2740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc69cf4e60 con 0x55dc69d13ad0 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b1a9a2740 10 client.0 _ll_register_callbacks cb 0x55dc69cc6c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15239640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cf6230 0x55dc69d10fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15239640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cf6230 0x55dc69d10fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36852/0 (socket says 172.21.15.172:36852) 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15239640 1 -- 172.21.15.172:0/1310601353 learned_addr learned my addr 172.21.15.172:0/1310601353 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b1623b640 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69d13ad0 0x55dc69ce1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 0x55dc69d7bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15239640 1 -- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69d13ad0 msgr2=0x55dc69ce1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15239640 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69d13ad0 0x55dc69ce1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15239640 1 -- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 msgr2=0x55dc69d7bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15239640 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 0x55dc69d7bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15239640 1 -- 172.21.15.172:0/1310601353 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc69cfa190 con 0x55dc69cf6230 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b1623b640 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69d13ad0 0x55dc69ce1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 0x55dc69d7bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b15239640 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cf6230 0x55dc69d10fc0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f1b000098c0 tx=0x7f1b00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4063f55fc37614c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1af0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1310601353 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00059060 con 0x55dc69cf6230 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1310601353 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1b00049af0 con 0x55dc69cf6230 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1310601353 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b08010ab0 con 0x55dc69cf6230 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1310601353 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b0004e070 con 0x55dc69cf6230 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b1a9a2740 10 client.7842 fetch_fsmap learned FSMap version 56 2024-04-25T08:48:43.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.967+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1310601353 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55dc69d11560 con 0x55dc69cf6230 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1310601353 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b08010ab0 con 0x55dc69cf6230 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1310601353 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1b0003e460 con 0x55dc69cf6230 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1b1a9a2740 10 client.7842 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1b1a9a2740 10 client.7842 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1b1a9a2740 20 client.7842 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55dc69d12820 0x55dc69d069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1b1a9a2740 4 client.7842 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1310601353 --> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dc69c3bf50 con 0x55dc69d12820 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55dc69d12820 0x55dc69d069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1b15a3a640 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55dc69d12820 0x55dc69d069d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2286894cd327c4a server_cookie=c634ddfc58e37aa4 in_seq=0 out_seq=0 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1af0ff9640 10 client.7842 ms_handle_connect on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:43.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1af0ff9640 1 -- 172.21.15.172:0/1310601353 <== mds.0 v2:172.21.15.186:6832/246475597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55dc69c3bf50 con 0x55dc69d12820 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.968+0000 7f1af0ff9640 10 client.7842 handle_command_reply: tid=0 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 client.7842 shutdown 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1310601353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cf6230 msgr2=0x55dc69d10fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cf6230 0x55dc69d10fc0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f1b000098c0 tx=0x7f1b00004730 comp rx=0 tx=0).stop 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1310601353 shutdown_connections 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55dc69d13ad0 0x55dc69ce1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc69cf6230 0x55dc69d10fc0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55dc69d12820 0x55dc69d069d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 --2- 172.21.15.172:0/1310601353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55dc69cdf830 0x55dc69d7bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1af0ff9640 0 client.7842 ms_handle_reset on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1310601353 >> 172.21.15.172:0/1310601353 conn(0x55dc69ccbf10 msgr2=0x55dc69cc54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1310601353 shutdown_connections 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 1 -- 172.21.15.172:0/1310601353 wait complete. 2024-04-25T08:48:43.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b1a9a2740 20 client.7842 trim_cache size 0 max 16384 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 7704, 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 4.5742050939999999, 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 56, 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 95, 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 95, 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 9.6408252890000004 2024-04-25T08:48:43.967 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:48:43.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1387751574 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1af406b4d0 msgr2=0x7f1af406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1af406b4d0 0x7f1af406d990 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1b00034000 tx=0x7f1b0002e000 comp rx=0 tx=0).stop 2024-04-25T08:48:43.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1387751574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b100b9330 msgr2=0x7f1b100b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:43.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b100b9330 0x7f1b100b1a20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009ec0 tx=0x7f1b0c00c490 comp rx=0 tx=0).stop 2024-04-25T08:48:43.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1387751574 shutdown_connections 2024-04-25T08:48:43.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1af406b4d0 0x7f1af406d990 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b1015dc20 0x7f1b100cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b10161710 0x7f1b100aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 --2- 172.21.15.172:0/1387751574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b100b9330 0x7f1b100b1a20 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:43.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1387751574 >> 172.21.15.172:0/1387751574 conn(0x7f1b100d0420 msgr2=0x7f1b100b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:43.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1387751574 shutdown_connections 2024-04-25T08:48:43.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:43.969+0000 7f1b17c9e640 1 -- 172.21.15.172:0/1387751574 wait complete. 2024-04-25T08:48:43.971 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:48:44.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.078+0000 7f25ecfb0640 1 Processor -- start 2024-04-25T08:48:44.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.078+0000 7f25ecfb0640 1 -- start start 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.079+0000 7f25ecfb0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f25e80d2e90 0x7f25e80d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.079+0000 7f25ecfb0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f25e80d0900 0x7f25e80b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.079+0000 7f25ecfb0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e80b9940 con 0x7f25e815dd30 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.079+0000 7f25ecfb0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e80d0d40 con 0x7f25e80d0900 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.079+0000 7f25ecfb0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e80d1df0 con 0x7f25e80d2e90 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.079+0000 7f25e659c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f25e815dd30 0x7f25e80b9230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38388/0 (socket says 172.21.15.172:38388) 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.079+0000 7f25e659c640 1 -- 172.21.15.172:0/518539798 learned_addr learned my addr 172.21.15.172:0/518539798 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.079+0000 7f25e6d9d640 1 --2- 172.21.15.172:0/518539798 >> v2:172.21.15.172:3300/0 conn(0x7f25e80d0900 0x7f25e80b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.079+0000 7f25e5d9b640 1 --2- 172.21.15.172:0/518539798 >> v2:172.21.15.186:3300/0 conn(0x7f25e80d2e90 0x7f25e80d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.080+0000 7f25e559a640 1 -- 172.21.15.172:0/518539798 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410622618 0 0) 0x7f25e80b9940 con 0x7f25e815dd30 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.080+0000 7f25e559a640 1 -- 172.21.15.172:0/518539798 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25d0003520 con 0x7f25e815dd30 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.080+0000 7f25e6d9d640 1 -- 172.21.15.172:0/518539798 >> v2:172.21.15.186:3300/0 conn(0x7f25e80d2e90 msgr2=0x7f25e80d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:44.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.080+0000 7f25e6d9d640 1 --2- 172.21.15.172:0/518539798 >> v2:172.21.15.186:3300/0 conn(0x7f25e80d2e90 0x7f25e80d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.080+0000 7f25e6d9d640 1 -- 172.21.15.172:0/518539798 >> v1:172.21.15.172:6789/0 conn(0x7f25e815dd30 legacy=0x7f25e80b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:44.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.080+0000 7f25e6d9d640 1 -- 172.21.15.172:0/518539798 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80d20d0 con 0x7f25e80d0900 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.080+0000 7f25e6d9d640 1 --2- 172.21.15.172:0/518539798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d0900 0x7f25e80b6a40 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f25e80b6540 tx=0x7f25e002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9bc02f0e60fbed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.080+0000 7f25e559a640 1 -- 172.21.15.172:0/518539798 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0037070 con 0x7f25e80d0900 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.081+0000 7f25e559a640 1 -- 172.21.15.172:0/518539798 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e002add0 con 0x7f25e80d0900 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.081+0000 7f25e559a640 1 -- 172.21.15.172:0/518539798 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0032660 con 0x7f25e80d0900 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.081+0000 7f25ecfb0640 1 -- 172.21.15.172:0/518539798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d0900 msgr2=0x7f25e80b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.081+0000 7f25ecfb0640 1 --2- 172.21.15.172:0/518539798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d0900 0x7f25e80b6a40 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f25e80b6540 tx=0x7f25e002a080 comp rx=0 tx=0).stop 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.081+0000 7f25ecfb0640 1 -- 172.21.15.172:0/518539798 shutdown_connections 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.081+0000 7f25ecfb0640 1 --2- 172.21.15.172:0/518539798 >> v2:172.21.15.186:3300/0 conn(0x7f25e80d2e90 0x7f25e80d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.081+0000 7f25ecfb0640 1 --2- 172.21.15.172:0/518539798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d0900 0x7f25e80b6a40 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.081+0000 7f25ecfb0640 1 -- 172.21.15.172:0/518539798 >> 172.21.15.172:0/518539798 conn(0x7f25e8061c30 msgr2=0x7f25e806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.081+0000 7f25ecfb0640 1 -- 172.21.15.172:0/518539798 shutdown_connections 2024-04-25T08:48:44.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.081+0000 7f25ecfb0640 1 -- 172.21.15.172:0/518539798 wait complete. 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.082+0000 7f25ecfb0640 1 Processor -- start 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.083+0000 7f25ecfb0640 1 -- start start 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.083+0000 7f25ecfb0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25e80d0900 0x7f25e81560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.083+0000 7f25ecfb0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d2e90 0x7f25e8149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.083+0000 7f25ecfb0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25e815dd30 0x7f25e80b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.083+0000 7f25ecfb0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80d2970 con 0x7f25e80d2e90 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.083+0000 7f25ecfb0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80d2690 con 0x7f25e815dd30 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.083+0000 7f25ecfb0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80d1a10 con 0x7f25e80d0900 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.083+0000 7f25e5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d2e90 0x7f25e8149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.083+0000 7f25e5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d2e90 0x7f25e8149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36874/0 (socket says 172.21.15.172:36874) 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.083+0000 7f25e5d9b640 1 -- 172.21.15.172:0/450934953 learned_addr learned my addr 172.21.15.172:0/450934953 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:44.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25e6d9d640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25e815dd30 0x7f25e80b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25e5d9b640 1 -- 172.21.15.172:0/450934953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25e80d0900 msgr2=0x7f25e81560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25e5d9b640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25e80d0900 0x7f25e81560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25e5d9b640 1 -- 172.21.15.172:0/450934953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25e815dd30 msgr2=0x7f25e80b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25e5d9b640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25e815dd30 0x7f25e80b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25e5d9b640 1 -- 172.21.15.172:0/450934953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e8152f50 con 0x7f25e80d2e90 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25e5d9b640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d2e90 0x7f25e8149d40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00e900 tx=0x7f25dc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25d6ffd640 1 -- 172.21.15.172:0/450934953 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc017070 con 0x7f25e80d2e90 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25d6ffd640 1 -- 172.21.15.172:0/450934953 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc00c9a0 con 0x7f25e80d2e90 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25d6ffd640 1 -- 172.21.15.172:0/450934953 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00cd50 con 0x7f25e80d2e90 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25ecfb0640 1 -- 172.21.15.172:0/450934953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e8154330 con 0x7f25e80d2e90 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.084+0000 7f25ecfb0640 1 -- 172.21.15.172:0/450934953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e81548f0 con 0x7f25e80d2e90 2024-04-25T08:48:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.085+0000 7f25ecfb0640 1 -- 172.21.15.172:0/450934953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e8073990 con 0x7f25e80d2e90 2024-04-25T08:48:44.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.085+0000 7f25d6ffd640 1 -- 172.21.15.172:0/450934953 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f25dc01a070 con 0x7f25e80d2e90 2024-04-25T08:48:44.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.086+0000 7f25d6ffd640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25c806b4d0 0x7f25c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:44.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.086+0000 7f25e659c640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25c806b4d0 0x7f25c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:44.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.086+0000 7f25d6ffd640 1 -- 172.21.15.172:0/450934953 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f25dc08a7c0 con 0x7f25e80d2e90 2024-04-25T08:48:44.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.086+0000 7f25e659c640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25c806b4d0 0x7f25c806d990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f25d80012e0 tx=0x7f25d80015b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:44.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.090+0000 7f25d6ffd640 1 -- 172.21.15.172:0/450934953 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f25e8152f50 con 0x7f25e80d2e90 2024-04-25T08:48:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.298+0000 7f25ecfb0640 1 -- 172.21.15.172:0/450934953 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f25e80b8540 con 0x7f25e80d2e90 2024-04-25T08:48:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.298+0000 7f25d6ffd640 1 -- 172.21.15.172:0/450934953 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f25dc059420 con 0x7f25e80d2e90 2024-04-25T08:48:44.289 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 -- 172.21.15.172:0/450934953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25c806b4d0 msgr2=0x7f25c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25c806b4d0 0x7f25c806d990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f25d80012e0 tx=0x7f25d80015b0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 -- 172.21.15.172:0/450934953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d2e90 msgr2=0x7f25e8149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d2e90 0x7f25e8149d40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00e900 tx=0x7f25dc00edc0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 -- 172.21.15.172:0/450934953 shutdown_connections 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25c806b4d0 0x7f25c806d990 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25e815dd30 0x7f25e80b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25e80d2e90 0x7f25e8149d40 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 --2- 172.21.15.172:0/450934953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25e80d0900 0x7f25e81560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 -- 172.21.15.172:0/450934953 >> 172.21.15.172:0/450934953 conn(0x7f25e8061c30 msgr2=0x7f25e815cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:44.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 -- 172.21.15.172:0/450934953 shutdown_connections 2024-04-25T08:48:44.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:44.300+0000 7f25ecfb0640 1 -- 172.21.15.172:0/450934953 wait complete. 2024-04-25T08:48:44.303 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:48:44.303 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:48:44.303 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:48:44.303 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:48:44.303 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:48:44.303 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:48:44.303 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:48:44.303 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:48:44.303 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:48:44.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:44.304 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:48:44.319 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42395sec preferred_lft 42395sec 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:48:44.320 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:48:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link 2024-04-25T08:48:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:48:44.321 INFO:teuthology.orchestra.run.smithi172.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:48:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether de:e6:d5:6e:7d:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:48:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::dce6:d5ff:fe6e:7d91/64 scope link 2024-04-25T08:48:44.321 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:48:44.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:44.321 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:48:44.381 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:48:44.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:44.383 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:48:44.438 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:48:44.439 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:48:44.439 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:48:44.439 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:48:44.439 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:48:44.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:44.439 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:48:44.439 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:44.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:48:44.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:48:44.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:48:44.439 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:44.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:44.523 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:48:44.537 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:48:44.537 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:48:44.537 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:48:44.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:44.538 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:48:44.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:48:44.602 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:48:44.640 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T08:48:44.650+0000 7fd325da5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:48:44.658 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:48:44.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:48:44.658 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:48:44.712 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:48:44.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:44.712 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:48:44.793 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:48:44.793 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:48:44.793 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:48:44.801 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:48:44.801 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:48:44.801 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:48:44.802 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:48:44.802 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:48:44.807 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:48:44.807 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:48:44.807 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:48:44.807 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:48:44.807 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:48:44.807 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:48:44.807 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:48:44.807 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:48:44.808 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:48:44.808 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:48:44.808 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:48:44.808 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:48:44.808 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:48:44.809 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:48:44.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:44.810 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:48:44.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:44.874 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:48:44.936 INFO:teuthology.orchestra.run.smithi172.stdout:client6140 2024-04-25T08:48:44.937 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:48:44.937 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:48:44.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:44.992 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:44.992 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:44.992 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T08:48:44.993 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:44.993 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:44.993 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:44.993 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:45.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.067 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075933 s, 138 MB/s 2024-04-25T08:48:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.076 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008492 s, 123 MB/s 2024-04-25T08:48:45.085 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.085 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.085 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750497 s, 140 MB/s 2024-04-25T08:48:45.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.094 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824369 s, 127 MB/s 2024-04-25T08:48:45.102 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.103 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.103 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767251 s, 137 MB/s 2024-04-25T08:48:45.109 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.109 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.109 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563616 s, 186 MB/s 2024-04-25T08:48:45.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.118 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072597 s, 144 MB/s 2024-04-25T08:48:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.124 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589442 s, 178 MB/s 2024-04-25T08:48:45.132 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.132 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.133 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739072 s, 142 MB/s 2024-04-25T08:48:45.141 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.142 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083396 s, 126 MB/s 2024-04-25T08:48:45.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.149 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683702 s, 153 MB/s 2024-04-25T08:48:45.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.158 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707454 s, 148 MB/s 2024-04-25T08:48:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683433 s, 153 MB/s 2024-04-25T08:48:45.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.172 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593135 s, 177 MB/s 2024-04-25T08:48:45.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.180 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701118 s, 150 MB/s 2024-04-25T08:48:45.188 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.188 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.188 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753789 s, 139 MB/s 2024-04-25T08:48:45.196 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.196 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.196 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700719 s, 150 MB/s 2024-04-25T08:48:45.203 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.203 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.203 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655367 s, 160 MB/s 2024-04-25T08:48:45.211 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.211 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.211 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700056 s, 150 MB/s 2024-04-25T08:48:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.218 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.218 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565406 s, 185 MB/s 2024-04-25T08:48:45.225 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.225 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.225 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650654 s, 161 MB/s 2024-04-25T08:48:45.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.234 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.234 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756684 s, 139 MB/s 2024-04-25T08:48:45.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.240 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558413 s, 188 MB/s 2024-04-25T08:48:45.249 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.249 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.249 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825591 s, 127 MB/s 2024-04-25T08:48:45.256 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.256 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.256 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561686 s, 187 MB/s 2024-04-25T08:48:45.263 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.263 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.263 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614261 s, 171 MB/s 2024-04-25T08:48:45.270 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.270 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.270 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633288 s, 166 MB/s 2024-04-25T08:48:45.277 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.277 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.277 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654551 s, 160 MB/s 2024-04-25T08:48:45.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.286 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719564 s, 146 MB/s 2024-04-25T08:48:45.292 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.292 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.292 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556598 s, 188 MB/s 2024-04-25T08:48:45.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.299 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635699 s, 165 MB/s 2024-04-25T08:48:45.307 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.307 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.307 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602334 s, 174 MB/s 2024-04-25T08:48:45.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:45.307 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:45.307 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:45.308 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T08:48:45.308 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:45.308 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:45.308 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:45.308 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:45.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.374 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733492 s, 143 MB/s 2024-04-25T08:48:45.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.380 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578371 s, 181 MB/s 2024-04-25T08:48:45.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.388 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657649 s, 159 MB/s 2024-04-25T08:48:45.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.394 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564038 s, 186 MB/s 2024-04-25T08:48:45.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.403 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734444 s, 143 MB/s 2024-04-25T08:48:45.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.410 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651003 s, 161 MB/s 2024-04-25T08:48:45.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.418 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708749 s, 148 MB/s 2024-04-25T08:48:45.424 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.425 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.425 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579045 s, 181 MB/s 2024-04-25T08:48:45.431 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.431 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.431 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574376 s, 183 MB/s 2024-04-25T08:48:45.439 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.439 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.439 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064734 s, 162 MB/s 2024-04-25T08:48:45.446 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.447 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707677 s, 148 MB/s 2024-04-25T08:48:45.454 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.454 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.454 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066117 s, 159 MB/s 2024-04-25T08:48:45.462 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.462 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.462 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069333 s, 151 MB/s 2024-04-25T08:48:45.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.469 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057973 s, 181 MB/s 2024-04-25T08:48:45.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.477 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720515 s, 146 MB/s 2024-04-25T08:48:45.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.484 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.484 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566137 s, 185 MB/s 2024-04-25T08:48:45.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.491 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.491 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633645 s, 165 MB/s 2024-04-25T08:48:45.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.497 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569356 s, 184 MB/s 2024-04-25T08:48:45.505 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.505 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.505 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703134 s, 149 MB/s 2024-04-25T08:48:45.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.512 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057781 s, 181 MB/s 2024-04-25T08:48:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641013 s, 164 MB/s 2024-04-25T08:48:45.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.527 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688312 s, 152 MB/s 2024-04-25T08:48:45.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.534 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567174 s, 185 MB/s 2024-04-25T08:48:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.542 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740108 s, 142 MB/s 2024-04-25T08:48:45.549 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.549 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.549 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638189 s, 164 MB/s 2024-04-25T08:48:45.557 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726049 s, 144 MB/s 2024-04-25T08:48:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656639 s, 160 MB/s 2024-04-25T08:48:45.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.572 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594459 s, 176 MB/s 2024-04-25T08:48:45.578 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.578 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.578 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549671 s, 191 MB/s 2024-04-25T08:48:45.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.585 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578671 s, 181 MB/s 2024-04-25T08:48:45.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.593 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703525 s, 149 MB/s 2024-04-25T08:48:45.601 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.601 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.601 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707533 s, 148 MB/s 2024-04-25T08:48:45.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:45.602 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:45.602 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:45.602 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T08:48:45.603 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:45.603 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:45.603 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:45.603 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:45.667 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.667 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.667 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060117 s, 174 MB/s 2024-04-25T08:48:45.674 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.674 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.674 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626516 s, 167 MB/s 2024-04-25T08:48:45.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.681 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576906 s, 182 MB/s 2024-04-25T08:48:45.687 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.687 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.687 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587545 s, 178 MB/s 2024-04-25T08:48:45.694 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.694 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.694 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590624 s, 178 MB/s 2024-04-25T08:48:45.701 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.701 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.701 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586099 s, 179 MB/s 2024-04-25T08:48:45.709 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.709 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.709 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712568 s, 147 MB/s 2024-04-25T08:48:45.716 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.716 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.716 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559035 s, 188 MB/s 2024-04-25T08:48:45.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.723 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592026 s, 177 MB/s 2024-04-25T08:48:45.730 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.730 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.730 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650294 s, 161 MB/s 2024-04-25T08:48:45.736 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.736 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.736 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564756 s, 186 MB/s 2024-04-25T08:48:45.743 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.743 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.743 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591371 s, 177 MB/s 2024-04-25T08:48:45.752 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.752 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.752 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735339 s, 143 MB/s 2024-04-25T08:48:45.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.758 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583716 s, 180 MB/s 2024-04-25T08:48:45.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.766 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703438 s, 149 MB/s 2024-04-25T08:48:45.774 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.774 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.774 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693802 s, 151 MB/s 2024-04-25T08:48:45.780 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.781 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00548245 s, 191 MB/s 2024-04-25T08:48:45.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.789 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697451 s, 150 MB/s 2024-04-25T08:48:45.794 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.795 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00545019 s, 192 MB/s 2024-04-25T08:48:45.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.801 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00540334 s, 194 MB/s 2024-04-25T08:48:45.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.808 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565413 s, 185 MB/s 2024-04-25T08:48:45.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.816 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724625 s, 145 MB/s 2024-04-25T08:48:45.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.823 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613373 s, 171 MB/s 2024-04-25T08:48:45.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.831 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676904 s, 155 MB/s 2024-04-25T08:48:45.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.838 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697212 s, 150 MB/s 2024-04-25T08:48:45.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.845 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553749 s, 189 MB/s 2024-04-25T08:48:45.851 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.851 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.851 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00545862 s, 192 MB/s 2024-04-25T08:48:45.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.859 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699171 s, 150 MB/s 2024-04-25T08:48:45.865 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.865 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.865 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00546566 s, 192 MB/s 2024-04-25T08:48:45.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.874 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074934 s, 140 MB/s 2024-04-25T08:48:45.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.882 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.882 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701348 s, 150 MB/s 2024-04-25T08:48:45.888 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.888 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.889 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059755 s, 175 MB/s 2024-04-25T08:48:45.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:45.890 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:45.890 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:45.890 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T08:48:45.890 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:45.890 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:45.890 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:45.890 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:45.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.954 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649299 s, 161 MB/s 2024-04-25T08:48:45.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.961 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576168 s, 182 MB/s 2024-04-25T08:48:45.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.968 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00550421 s, 191 MB/s 2024-04-25T08:48:45.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.974 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549686 s, 191 MB/s 2024-04-25T08:48:45.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.982 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730331 s, 144 MB/s 2024-04-25T08:48:45.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.988 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00547617 s, 191 MB/s 2024-04-25T08:48:45.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:45.997 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:45.997 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724494 s, 145 MB/s 2024-04-25T08:48:46.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.004 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626117 s, 167 MB/s 2024-04-25T08:48:46.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.011 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682105 s, 154 MB/s 2024-04-25T08:48:46.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.018 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621037 s, 169 MB/s 2024-04-25T08:48:46.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.025 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564947 s, 186 MB/s 2024-04-25T08:48:46.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.032 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595232 s, 176 MB/s 2024-04-25T08:48:46.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.038 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570609 s, 184 MB/s 2024-04-25T08:48:46.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.046 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626331 s, 167 MB/s 2024-04-25T08:48:46.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.053 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643147 s, 163 MB/s 2024-04-25T08:48:46.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.060 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674548 s, 155 MB/s 2024-04-25T08:48:46.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.068 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070709 s, 148 MB/s 2024-04-25T08:48:46.074 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.074 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.075 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0054216 s, 193 MB/s 2024-04-25T08:48:46.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.082 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064689 s, 162 MB/s 2024-04-25T08:48:46.089 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.090 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665877 s, 157 MB/s 2024-04-25T08:48:46.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.098 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.098 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720743 s, 145 MB/s 2024-04-25T08:48:46.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.105 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636183 s, 165 MB/s 2024-04-25T08:48:46.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.112 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062992 s, 166 MB/s 2024-04-25T08:48:46.119 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.119 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.119 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632916 s, 166 MB/s 2024-04-25T08:48:46.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.126 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572689 s, 183 MB/s 2024-04-25T08:48:46.133 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.133 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.133 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643355 s, 163 MB/s 2024-04-25T08:48:46.141 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.141 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.141 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721307 s, 145 MB/s 2024-04-25T08:48:46.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.149 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711628 s, 147 MB/s 2024-04-25T08:48:46.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.157 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711944 s, 147 MB/s 2024-04-25T08:48:46.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.164 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566885 s, 185 MB/s 2024-04-25T08:48:46.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.172 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714135 s, 147 MB/s 2024-04-25T08:48:46.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.179 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006408 s, 164 MB/s 2024-04-25T08:48:46.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:46.180 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:46.180 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:46.180 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T08:48:46.181 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:46.181 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:46.181 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:46.181 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:46.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.246 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688767 s, 152 MB/s 2024-04-25T08:48:46.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.252 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565965 s, 185 MB/s 2024-04-25T08:48:46.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.259 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566072 s, 185 MB/s 2024-04-25T08:48:46.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.265 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554122 s, 189 MB/s 2024-04-25T08:48:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.273 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701828 s, 149 MB/s 2024-04-25T08:48:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.281 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724361 s, 145 MB/s 2024-04-25T08:48:46.288 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.289 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686512 s, 153 MB/s 2024-04-25T08:48:46.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.296 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642164 s, 163 MB/s 2024-04-25T08:48:46.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.303 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654842 s, 160 MB/s 2024-04-25T08:48:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055752 s, 188 MB/s 2024-04-25T08:48:46.316 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.316 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.316 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564067 s, 186 MB/s 2024-04-25T08:48:46.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.323 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00548321 s, 191 MB/s 2024-04-25T08:48:46.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.331 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070125 s, 150 MB/s 2024-04-25T08:48:46.337 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.337 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.338 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588287 s, 178 MB/s 2024-04-25T08:48:46.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.345 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635644 s, 165 MB/s 2024-04-25T08:48:46.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.353 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713163 s, 147 MB/s 2024-04-25T08:48:46.359 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.359 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.359 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056085 s, 187 MB/s 2024-04-25T08:48:46.367 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.367 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.367 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708142 s, 148 MB/s 2024-04-25T08:48:46.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.376 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726466 s, 144 MB/s 2024-04-25T08:48:46.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.384 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756994 s, 139 MB/s 2024-04-25T08:48:46.393 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.393 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.394 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878461 s, 119 MB/s 2024-04-25T08:48:46.401 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.401 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.401 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659216 s, 159 MB/s 2024-04-25T08:48:46.408 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.408 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.408 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633667 s, 165 MB/s 2024-04-25T08:48:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553473 s, 189 MB/s 2024-04-25T08:48:46.422 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.422 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.422 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629829 s, 166 MB/s 2024-04-25T08:48:46.429 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.429 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.429 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583463 s, 180 MB/s 2024-04-25T08:48:46.436 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.436 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.436 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642873 s, 163 MB/s 2024-04-25T08:48:46.444 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.444 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.444 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713414 s, 147 MB/s 2024-04-25T08:48:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.451 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00551196 s, 190 MB/s 2024-04-25T08:48:46.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.458 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063756 s, 164 MB/s 2024-04-25T08:48:46.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.464 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563329 s, 186 MB/s 2024-04-25T08:48:46.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.471 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558513 s, 188 MB/s 2024-04-25T08:48:46.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:46.472 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:46.472 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:46.472 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T08:48:46.472 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:46.472 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:46.472 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:46.472 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:46.538 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.538 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.538 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742817 s, 141 MB/s 2024-04-25T08:48:46.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.546 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702663 s, 149 MB/s 2024-04-25T08:48:46.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.553 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063328 s, 166 MB/s 2024-04-25T08:48:46.560 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.561 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.561 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651223 s, 161 MB/s 2024-04-25T08:48:46.568 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.568 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.568 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635994 s, 165 MB/s 2024-04-25T08:48:46.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.576 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733789 s, 143 MB/s 2024-04-25T08:48:46.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.585 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785148 s, 134 MB/s 2024-04-25T08:48:46.594 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.594 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.594 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631412 s, 166 MB/s 2024-04-25T08:48:46.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647721 s, 162 MB/s 2024-04-25T08:48:46.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.606 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562655 s, 186 MB/s 2024-04-25T08:48:46.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.614 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702074 s, 149 MB/s 2024-04-25T08:48:46.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.621 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630317 s, 166 MB/s 2024-04-25T08:48:46.627 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.628 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563096 s, 186 MB/s 2024-04-25T08:48:46.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.636 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.636 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698642 s, 150 MB/s 2024-04-25T08:48:46.642 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.643 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617736 s, 170 MB/s 2024-04-25T08:48:46.651 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.651 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.651 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738443 s, 142 MB/s 2024-04-25T08:48:46.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.658 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657377 s, 160 MB/s 2024-04-25T08:48:46.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.666 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647253 s, 162 MB/s 2024-04-25T08:48:46.672 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.672 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.673 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585395 s, 179 MB/s 2024-04-25T08:48:46.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.681 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738055 s, 142 MB/s 2024-04-25T08:48:46.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.688 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663695 s, 158 MB/s 2024-04-25T08:48:46.695 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.695 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.695 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577038 s, 182 MB/s 2024-04-25T08:48:46.702 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.702 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.702 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576795 s, 182 MB/s 2024-04-25T08:48:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592533 s, 177 MB/s 2024-04-25T08:48:46.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.717 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733911 s, 143 MB/s 2024-04-25T08:48:46.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.725 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710378 s, 148 MB/s 2024-04-25T08:48:46.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.732 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061791 s, 170 MB/s 2024-04-25T08:48:46.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.740 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707633 s, 148 MB/s 2024-04-25T08:48:46.748 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.748 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.748 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728952 s, 144 MB/s 2024-04-25T08:48:46.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.755 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617597 s, 170 MB/s 2024-04-25T08:48:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644455 s, 163 MB/s 2024-04-25T08:48:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588537 s, 178 MB/s 2024-04-25T08:48:46.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:46.770 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:46.771 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:46.771 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T08:48:46.771 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:46.771 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:46.771 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:46.771 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:46.835 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.836 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.836 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660658 s, 159 MB/s 2024-04-25T08:48:46.843 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.843 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.843 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072356 s, 145 MB/s 2024-04-25T08:48:46.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.850 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055156 s, 190 MB/s 2024-04-25T08:48:46.856 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.857 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058475 s, 179 MB/s 2024-04-25T08:48:46.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.864 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069 s, 152 MB/s 2024-04-25T08:48:46.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.871 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00547339 s, 192 MB/s 2024-04-25T08:48:46.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.877 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555284 s, 189 MB/s 2024-04-25T08:48:46.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.885 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.885 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625265 s, 168 MB/s 2024-04-25T08:48:46.892 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.892 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.892 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065517 s, 160 MB/s 2024-04-25T08:48:46.898 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.898 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.898 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554509 s, 189 MB/s 2024-04-25T08:48:46.906 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.906 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.906 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638635 s, 164 MB/s 2024-04-25T08:48:46.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.913 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593035 s, 177 MB/s 2024-04-25T08:48:46.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.921 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729919 s, 144 MB/s 2024-04-25T08:48:46.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.929 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.929 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687518 s, 153 MB/s 2024-04-25T08:48:46.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.937 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.937 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718504 s, 146 MB/s 2024-04-25T08:48:46.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.943 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583277 s, 180 MB/s 2024-04-25T08:48:46.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.952 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732821 s, 143 MB/s 2024-04-25T08:48:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665139 s, 158 MB/s 2024-04-25T08:48:46.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.967 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671626 s, 156 MB/s 2024-04-25T08:48:46.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.975 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700501 s, 150 MB/s 2024-04-25T08:48:46.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.982 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066785 s, 157 MB/s 2024-04-25T08:48:46.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.990 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.990 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065307 s, 161 MB/s 2024-04-25T08:48:46.997 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:46.997 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:46.997 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062941 s, 167 MB/s 2024-04-25T08:48:47.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.005 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619689 s, 169 MB/s 2024-04-25T08:48:47.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.010 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055972 s, 187 MB/s 2024-04-25T08:48:47.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.019 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726988 s, 144 MB/s 2024-04-25T08:48:47.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.026 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659775 s, 159 MB/s 2024-04-25T08:48:47.033 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.033 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.033 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580638 s, 181 MB/s 2024-04-25T08:48:47.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.041 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715583 s, 147 MB/s 2024-04-25T08:48:47.048 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.048 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.048 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636757 s, 165 MB/s 2024-04-25T08:48:47.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.056 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707284 s, 148 MB/s 2024-04-25T08:48:47.063 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.063 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.063 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632503 s, 166 MB/s 2024-04-25T08:48:47.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:47.065 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:47.065 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:47.065 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T08:48:47.065 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:47.065 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:47.065 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:47.065 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:47.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.129 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649897 s, 161 MB/s 2024-04-25T08:48:47.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.136 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617741 s, 170 MB/s 2024-04-25T08:48:47.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749995 s, 140 MB/s 2024-04-25T08:48:47.152 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.153 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723233 s, 145 MB/s 2024-04-25T08:48:47.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.159 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056243 s, 186 MB/s 2024-04-25T08:48:47.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.166 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558871 s, 188 MB/s 2024-04-25T08:48:47.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.173 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631768 s, 166 MB/s 2024-04-25T08:48:47.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.180 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590504 s, 178 MB/s 2024-04-25T08:48:47.187 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.187 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.187 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628851 s, 167 MB/s 2024-04-25T08:48:47.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.195 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.195 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698576 s, 150 MB/s 2024-04-25T08:48:47.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.201 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571595 s, 183 MB/s 2024-04-25T08:48:47.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.209 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700714 s, 150 MB/s 2024-04-25T08:48:47.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.216 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558 s, 188 MB/s 2024-04-25T08:48:47.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.224 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702319 s, 149 MB/s 2024-04-25T08:48:47.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.231 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660876 s, 159 MB/s 2024-04-25T08:48:47.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.240 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733751 s, 143 MB/s 2024-04-25T08:48:47.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.247 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614964 s, 171 MB/s 2024-04-25T08:48:47.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.254 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702866 s, 149 MB/s 2024-04-25T08:48:47.260 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.260 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.260 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00540301 s, 194 MB/s 2024-04-25T08:48:47.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055765 s, 188 MB/s 2024-04-25T08:48:47.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.274 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635913 s, 165 MB/s 2024-04-25T08:48:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.282 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.282 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637993 s, 164 MB/s 2024-04-25T08:48:47.288 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.288 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.289 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583726 s, 180 MB/s 2024-04-25T08:48:47.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.296 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661824 s, 158 MB/s 2024-04-25T08:48:47.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.303 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662681 s, 158 MB/s 2024-04-25T08:48:47.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.311 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.311 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644725 s, 163 MB/s 2024-04-25T08:48:47.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.318 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638606 s, 164 MB/s 2024-04-25T08:48:47.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.325 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573082 s, 183 MB/s 2024-04-25T08:48:47.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.332 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059206 s, 177 MB/s 2024-04-25T08:48:47.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654809 s, 160 MB/s 2024-04-25T08:48:47.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.347 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705358 s, 149 MB/s 2024-04-25T08:48:47.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.354 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650624 s, 161 MB/s 2024-04-25T08:48:47.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:47.356 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:47.356 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:47.356 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T08:48:47.356 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:47.356 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:47.356 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:47.356 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:47.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.419 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056187 s, 187 MB/s 2024-04-25T08:48:47.425 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569147 s, 184 MB/s 2024-04-25T08:48:47.432 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.432 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.432 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567798 s, 185 MB/s 2024-04-25T08:48:47.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.441 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726407 s, 144 MB/s 2024-04-25T08:48:47.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.448 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624025 s, 168 MB/s 2024-04-25T08:48:47.454 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.454 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.454 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619058 s, 169 MB/s 2024-04-25T08:48:47.461 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.461 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.461 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594629 s, 176 MB/s 2024-04-25T08:48:47.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.469 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706005 s, 149 MB/s 2024-04-25T08:48:47.476 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.476 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.477 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659977 s, 159 MB/s 2024-04-25T08:48:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.483 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563697 s, 186 MB/s 2024-04-25T08:48:47.489 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.490 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559125 s, 188 MB/s 2024-04-25T08:48:47.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.497 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635825 s, 165 MB/s 2024-04-25T08:48:47.505 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.505 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.505 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704664 s, 149 MB/s 2024-04-25T08:48:47.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.511 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570158 s, 184 MB/s 2024-04-25T08:48:47.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.518 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562071 s, 187 MB/s 2024-04-25T08:48:47.525 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.525 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640225 s, 164 MB/s 2024-04-25T08:48:47.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.533 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691019 s, 152 MB/s 2024-04-25T08:48:47.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.540 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555038 s, 189 MB/s 2024-04-25T08:48:47.547 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.547 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.547 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630445 s, 166 MB/s 2024-04-25T08:48:47.555 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.555 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.555 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755315 s, 139 MB/s 2024-04-25T08:48:47.563 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.563 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.563 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726576 s, 144 MB/s 2024-04-25T08:48:47.570 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.570 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.570 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059069 s, 178 MB/s 2024-04-25T08:48:47.578 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.578 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.578 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698277 s, 150 MB/s 2024-04-25T08:48:47.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.586 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661114 s, 159 MB/s 2024-04-25T08:48:47.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.592 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587671 s, 178 MB/s 2024-04-25T08:48:47.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617346 s, 170 MB/s 2024-04-25T08:48:47.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.606 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555654 s, 189 MB/s 2024-04-25T08:48:47.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.614 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712179 s, 147 MB/s 2024-04-25T08:48:47.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.621 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624559 s, 168 MB/s 2024-04-25T08:48:47.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.630 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767432 s, 137 MB/s 2024-04-25T08:48:47.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.637 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696738 s, 150 MB/s 2024-04-25T08:48:47.644 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.644 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.644 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563222 s, 186 MB/s 2024-04-25T08:48:47.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:47.645 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:47.645 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:47.645 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T08:48:47.645 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:47.645 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:47.645 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:47.645 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:47.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.710 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731292 s, 143 MB/s 2024-04-25T08:48:47.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.718 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725995 s, 144 MB/s 2024-04-25T08:48:47.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.725 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587546 s, 178 MB/s 2024-04-25T08:48:47.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.731 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00547416 s, 192 MB/s 2024-04-25T08:48:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.738 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570442 s, 184 MB/s 2024-04-25T08:48:47.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.745 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667247 s, 157 MB/s 2024-04-25T08:48:47.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.753 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656468 s, 160 MB/s 2024-04-25T08:48:47.760 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.760 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.760 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633992 s, 165 MB/s 2024-04-25T08:48:47.768 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.768 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.768 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718752 s, 146 MB/s 2024-04-25T08:48:47.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.776 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700592 s, 150 MB/s 2024-04-25T08:48:47.782 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.782 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.782 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005573 s, 188 MB/s 2024-04-25T08:48:47.789 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.789 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.790 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643761 s, 163 MB/s 2024-04-25T08:48:47.797 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.797 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.797 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694722 s, 151 MB/s 2024-04-25T08:48:47.804 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.804 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.804 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056536 s, 185 MB/s 2024-04-25T08:48:47.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.810 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057268 s, 183 MB/s 2024-04-25T08:48:47.818 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.818 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.818 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696839 s, 150 MB/s 2024-04-25T08:48:47.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.825 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595513 s, 176 MB/s 2024-04-25T08:48:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634789 s, 165 MB/s 2024-04-25T08:48:47.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.840 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700736 s, 150 MB/s 2024-04-25T08:48:47.848 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.848 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.848 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710181 s, 148 MB/s 2024-04-25T08:48:47.855 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.855 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.855 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062633 s, 167 MB/s 2024-04-25T08:48:47.863 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.863 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.863 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715198 s, 147 MB/s 2024-04-25T08:48:47.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.871 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652762 s, 161 MB/s 2024-04-25T08:48:47.878 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.878 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.878 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654164 s, 160 MB/s 2024-04-25T08:48:47.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.886 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712182 s, 147 MB/s 2024-04-25T08:48:47.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.893 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626549 s, 167 MB/s 2024-04-25T08:48:47.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.900 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615008 s, 170 MB/s 2024-04-25T08:48:47.908 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.908 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.908 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070723 s, 148 MB/s 2024-04-25T08:48:47.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.915 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.915 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563302 s, 186 MB/s 2024-04-25T08:48:47.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.921 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565045 s, 186 MB/s 2024-04-25T08:48:47.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.929 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.929 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644876 s, 163 MB/s 2024-04-25T08:48:47.935 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:47.935 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:47.935 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057337 s, 183 MB/s 2024-04-25T08:48:47.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:47.936 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:47.936 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:47.937 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T08:48:47.937 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:47.937 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:47.937 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:47.937 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:48.001 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.001 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.002 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702761 s, 149 MB/s 2024-04-25T08:48:48.008 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.008 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.008 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568877 s, 184 MB/s 2024-04-25T08:48:48.014 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.014 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.014 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00544058 s, 193 MB/s 2024-04-25T08:48:48.022 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.022 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.022 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062247 s, 168 MB/s 2024-04-25T08:48:48.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.028 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584092 s, 180 MB/s 2024-04-25T08:48:48.035 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.035 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.035 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625757 s, 168 MB/s 2024-04-25T08:48:48.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.043 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687848 s, 152 MB/s 2024-04-25T08:48:48.050 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.050 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.050 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642154 s, 163 MB/s 2024-04-25T08:48:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.057 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626319 s, 167 MB/s 2024-04-25T08:48:48.064 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.064 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.065 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625722 s, 168 MB/s 2024-04-25T08:48:48.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.072 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665054 s, 158 MB/s 2024-04-25T08:48:48.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.079 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639654 s, 164 MB/s 2024-04-25T08:48:48.087 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.087 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.087 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738609 s, 142 MB/s 2024-04-25T08:48:48.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.094 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561196 s, 187 MB/s 2024-04-25T08:48:48.100 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.100 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.100 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549567 s, 191 MB/s 2024-04-25T08:48:48.107 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.107 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.107 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576408 s, 182 MB/s 2024-04-25T08:48:48.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.115 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708698 s, 148 MB/s 2024-04-25T08:48:48.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.123 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662389 s, 158 MB/s 2024-04-25T08:48:48.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.130 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.130 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620114 s, 169 MB/s 2024-04-25T08:48:48.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.136 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555686 s, 189 MB/s 2024-04-25T08:48:48.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.143 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559661 s, 187 MB/s 2024-04-25T08:48:48.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.150 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630281 s, 166 MB/s 2024-04-25T08:48:48.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.157 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634932 s, 165 MB/s 2024-04-25T08:48:48.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.165 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738858 s, 142 MB/s 2024-04-25T08:48:48.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.172 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581836 s, 180 MB/s 2024-04-25T08:48:48.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.178 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00550659 s, 190 MB/s 2024-04-25T08:48:48.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.186 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070038 s, 150 MB/s 2024-04-25T08:48:48.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.194 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711309 s, 147 MB/s 2024-04-25T08:48:48.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.201 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586073 s, 179 MB/s 2024-04-25T08:48:48.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.208 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569462 s, 184 MB/s 2024-04-25T08:48:48.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.216 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728707 s, 144 MB/s 2024-04-25T08:48:48.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.223 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620875 s, 169 MB/s 2024-04-25T08:48:48.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:48.224 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:48.224 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:48.224 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T08:48:48.225 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:48.225 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:48.225 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:48.225 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:48.288 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.289 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556829 s, 188 MB/s 2024-04-25T08:48:48.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.296 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653578 s, 160 MB/s 2024-04-25T08:48:48.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.304 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715514 s, 147 MB/s 2024-04-25T08:48:48.311 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.311 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.312 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006537 s, 160 MB/s 2024-04-25T08:48:48.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.318 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063994 s, 164 MB/s 2024-04-25T08:48:48.326 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.326 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.326 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723942 s, 145 MB/s 2024-04-25T08:48:48.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.334 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070045 s, 150 MB/s 2024-04-25T08:48:48.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.341 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00550723 s, 190 MB/s 2024-04-25T08:48:48.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.349 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709767 s, 148 MB/s 2024-04-25T08:48:48.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.357 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737548 s, 142 MB/s 2024-04-25T08:48:48.364 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.364 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.364 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579264 s, 181 MB/s 2024-04-25T08:48:48.370 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.370 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.371 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583859 s, 180 MB/s 2024-04-25T08:48:48.378 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.378 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.378 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646569 s, 162 MB/s 2024-04-25T08:48:48.386 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.386 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.386 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007046 s, 149 MB/s 2024-04-25T08:48:48.392 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.392 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.392 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554205 s, 189 MB/s 2024-04-25T08:48:48.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.399 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00547413 s, 192 MB/s 2024-04-25T08:48:48.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.406 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624847 s, 168 MB/s 2024-04-25T08:48:48.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611299 s, 172 MB/s 2024-04-25T08:48:48.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.421 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730215 s, 144 MB/s 2024-04-25T08:48:48.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.428 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580273 s, 181 MB/s 2024-04-25T08:48:48.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.435 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652365 s, 161 MB/s 2024-04-25T08:48:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.443 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652038 s, 161 MB/s 2024-04-25T08:48:48.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.449 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556237 s, 189 MB/s 2024-04-25T08:48:48.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.456 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633338 s, 166 MB/s 2024-04-25T08:48:48.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.465 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739414 s, 142 MB/s 2024-04-25T08:48:48.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.473 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705567 s, 149 MB/s 2024-04-25T08:48:48.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.480 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068975 s, 152 MB/s 2024-04-25T08:48:48.487 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.487 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.487 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591973 s, 177 MB/s 2024-04-25T08:48:48.494 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.494 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.494 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571197 s, 184 MB/s 2024-04-25T08:48:48.501 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.501 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.501 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062182 s, 169 MB/s 2024-04-25T08:48:48.508 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.508 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.508 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570001 s, 184 MB/s 2024-04-25T08:48:48.516 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.516 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.516 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740373 s, 142 MB/s 2024-04-25T08:48:48.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:48.517 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:48.517 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:48.517 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T08:48:48.517 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:48.517 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:48.517 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:48.517 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:48.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.582 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.582 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650388 s, 161 MB/s 2024-04-25T08:48:48.590 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.590 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.590 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749716 s, 140 MB/s 2024-04-25T08:48:48.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.597 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638288 s, 164 MB/s 2024-04-25T08:48:48.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.605 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711487 s, 147 MB/s 2024-04-25T08:48:48.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.613 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680606 s, 154 MB/s 2024-04-25T08:48:48.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.621 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705745 s, 149 MB/s 2024-04-25T08:48:48.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.629 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700064 s, 150 MB/s 2024-04-25T08:48:48.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.638 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639774 s, 164 MB/s 2024-04-25T08:48:48.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.643 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622748 s, 168 MB/s 2024-04-25T08:48:48.649 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.650 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576184 s, 182 MB/s 2024-04-25T08:48:48.656 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.656 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.656 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578478 s, 181 MB/s 2024-04-25T08:48:48.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.664 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700388 s, 150 MB/s 2024-04-25T08:48:48.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.671 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622367 s, 168 MB/s 2024-04-25T08:48:48.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.678 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560277 s, 187 MB/s 2024-04-25T08:48:48.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.685 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629273 s, 167 MB/s 2024-04-25T08:48:48.692 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.692 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.692 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626225 s, 167 MB/s 2024-04-25T08:48:48.699 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.699 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.699 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062887 s, 167 MB/s 2024-04-25T08:48:48.706 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.706 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.706 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575922 s, 182 MB/s 2024-04-25T08:48:48.712 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.712 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.712 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549542 s, 191 MB/s 2024-04-25T08:48:48.719 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.719 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.719 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576813 s, 182 MB/s 2024-04-25T08:48:48.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.727 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665516 s, 158 MB/s 2024-04-25T08:48:48.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.733 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557645 s, 188 MB/s 2024-04-25T08:48:48.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.740 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574333 s, 183 MB/s 2024-04-25T08:48:48.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.747 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603423 s, 174 MB/s 2024-04-25T08:48:48.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.754 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635703 s, 165 MB/s 2024-04-25T08:48:48.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.762 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724876 s, 145 MB/s 2024-04-25T08:48:48.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634514 s, 165 MB/s 2024-04-25T08:48:48.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.777 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711352 s, 147 MB/s 2024-04-25T08:48:48.783 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.784 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554155 s, 189 MB/s 2024-04-25T08:48:48.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.790 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556292 s, 188 MB/s 2024-04-25T08:48:48.798 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.798 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.798 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707239 s, 148 MB/s 2024-04-25T08:48:48.805 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.805 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.805 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062122 s, 169 MB/s 2024-04-25T08:48:48.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:48.806 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:48.806 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:48.806 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T08:48:48.807 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:48.807 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:48.807 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:48.807 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:48.872 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.872 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.872 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703066 s, 149 MB/s 2024-04-25T08:48:48.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.880 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711234 s, 147 MB/s 2024-04-25T08:48:48.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.887 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057414 s, 183 MB/s 2024-04-25T08:48:48.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.894 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575625 s, 182 MB/s 2024-04-25T08:48:48.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.901 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666194 s, 157 MB/s 2024-04-25T08:48:48.907 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.908 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.908 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579456 s, 181 MB/s 2024-04-25T08:48:48.915 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.915 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.915 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614471 s, 171 MB/s 2024-04-25T08:48:48.922 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.922 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.922 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646654 s, 162 MB/s 2024-04-25T08:48:48.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.929 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.929 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569159 s, 184 MB/s 2024-04-25T08:48:48.935 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.935 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.935 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573006 s, 183 MB/s 2024-04-25T08:48:48.942 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.942 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.942 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634109 s, 165 MB/s 2024-04-25T08:48:48.949 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.950 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.950 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621551 s, 169 MB/s 2024-04-25T08:48:48.956 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.956 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.956 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566166 s, 185 MB/s 2024-04-25T08:48:48.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.963 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610334 s, 172 MB/s 2024-04-25T08:48:48.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.970 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640495 s, 164 MB/s 2024-04-25T08:48:48.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.977 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599105 s, 175 MB/s 2024-04-25T08:48:48.984 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.984 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.984 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624953 s, 168 MB/s 2024-04-25T08:48:48.991 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:48.991 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:48.992 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650359 s, 161 MB/s 2024-04-25T08:48:48.999 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.000 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.000 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729468 s, 144 MB/s 2024-04-25T08:48:49.008 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.008 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.008 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722251 s, 145 MB/s 2024-04-25T08:48:49.014 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.014 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.014 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555869 s, 189 MB/s 2024-04-25T08:48:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647174 s, 162 MB/s 2024-04-25T08:48:49.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.029 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648916 s, 162 MB/s 2024-04-25T08:48:49.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.036 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615421 s, 170 MB/s 2024-04-25T08:48:49.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.043 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643316 s, 163 MB/s 2024-04-25T08:48:49.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.051 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710564 s, 148 MB/s 2024-04-25T08:48:49.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.060 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742793 s, 141 MB/s 2024-04-25T08:48:49.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.067 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069982 s, 150 MB/s 2024-04-25T08:48:49.074 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.074 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.074 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563708 s, 186 MB/s 2024-04-25T08:48:49.081 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.081 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.082 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646408 s, 162 MB/s 2024-04-25T08:48:49.089 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.089 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.089 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725045 s, 145 MB/s 2024-04-25T08:48:49.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.097 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634913 s, 165 MB/s 2024-04-25T08:48:49.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:49.098 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:49.098 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:49.098 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T08:48:49.098 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:49.098 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:49.098 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:49.098 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:49.163 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.163 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.163 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719407 s, 146 MB/s 2024-04-25T08:48:49.171 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.171 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.171 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666716 s, 157 MB/s 2024-04-25T08:48:49.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.178 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580594 s, 181 MB/s 2024-04-25T08:48:49.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.186 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713423 s, 147 MB/s 2024-04-25T08:48:49.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.194 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681098 s, 154 MB/s 2024-04-25T08:48:49.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.201 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695717 s, 151 MB/s 2024-04-25T08:48:49.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.208 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565381 s, 185 MB/s 2024-04-25T08:48:49.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.215 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067706 s, 155 MB/s 2024-04-25T08:48:49.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.223 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713558 s, 147 MB/s 2024-04-25T08:48:49.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.230 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574393 s, 183 MB/s 2024-04-25T08:48:49.236 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.236 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.237 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005581 s, 188 MB/s 2024-04-25T08:48:49.244 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.244 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.244 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068557 s, 153 MB/s 2024-04-25T08:48:49.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.254 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675952 s, 155 MB/s 2024-04-25T08:48:49.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.258 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571907 s, 183 MB/s 2024-04-25T08:48:49.266 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.266 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071847 s, 146 MB/s 2024-04-25T08:48:49.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.274 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649453 s, 161 MB/s 2024-04-25T08:48:49.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.281 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058174 s, 180 MB/s 2024-04-25T08:48:49.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.289 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693417 s, 151 MB/s 2024-04-25T08:48:49.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.296 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615933 s, 170 MB/s 2024-04-25T08:48:49.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.303 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634944 s, 165 MB/s 2024-04-25T08:48:49.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634664 s, 165 MB/s 2024-04-25T08:48:49.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559694 s, 187 MB/s 2024-04-25T08:48:49.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.323 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568763 s, 184 MB/s 2024-04-25T08:48:49.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.330 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639858 s, 164 MB/s 2024-04-25T08:48:49.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788114 s, 133 MB/s 2024-04-25T08:48:49.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.348 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771929 s, 136 MB/s 2024-04-25T08:48:49.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.357 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764805 s, 137 MB/s 2024-04-25T08:48:49.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.365 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710219 s, 148 MB/s 2024-04-25T08:48:49.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.373 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651102 s, 161 MB/s 2024-04-25T08:48:49.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.380 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691443 s, 152 MB/s 2024-04-25T08:48:49.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.387 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570988 s, 184 MB/s 2024-04-25T08:48:49.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.397 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912531 s, 115 MB/s 2024-04-25T08:48:49.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:49.398 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:49.398 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:49.398 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T08:48:49.399 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:49.399 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:49.399 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:49.399 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:49.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.463 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666615 s, 157 MB/s 2024-04-25T08:48:49.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.469 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576826 s, 182 MB/s 2024-04-25T08:48:49.476 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.476 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.477 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642034 s, 163 MB/s 2024-04-25T08:48:49.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.483 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562069 s, 187 MB/s 2024-04-25T08:48:49.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.490 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584452 s, 179 MB/s 2024-04-25T08:48:49.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.496 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0054817 s, 191 MB/s 2024-04-25T08:48:49.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.503 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564237 s, 186 MB/s 2024-04-25T08:48:49.510 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.510 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.510 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644398 s, 163 MB/s 2024-04-25T08:48:49.517 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.518 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063232 s, 166 MB/s 2024-04-25T08:48:49.525 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.525 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.525 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650181 s, 161 MB/s 2024-04-25T08:48:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635868 s, 165 MB/s 2024-04-25T08:48:49.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.539 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645032 s, 163 MB/s 2024-04-25T08:48:49.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.546 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559966 s, 187 MB/s 2024-04-25T08:48:49.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.553 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644227 s, 163 MB/s 2024-04-25T08:48:49.560 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.560 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.560 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577432 s, 182 MB/s 2024-04-25T08:48:49.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.567 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665544 s, 158 MB/s 2024-04-25T08:48:49.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.575 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.575 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618907 s, 169 MB/s 2024-04-25T08:48:49.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.582 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.582 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619631 s, 169 MB/s 2024-04-25T08:48:49.588 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.588 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.588 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057965 s, 181 MB/s 2024-04-25T08:48:49.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.596 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701036 s, 150 MB/s 2024-04-25T08:48:49.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.603 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623356 s, 168 MB/s 2024-04-25T08:48:49.610 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.611 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.611 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646468 s, 162 MB/s 2024-04-25T08:48:49.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.617 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582642 s, 180 MB/s 2024-04-25T08:48:49.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.625 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.625 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616798 s, 170 MB/s 2024-04-25T08:48:49.633 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.633 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.633 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723188 s, 145 MB/s 2024-04-25T08:48:49.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.641 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717812 s, 146 MB/s 2024-04-25T08:48:49.649 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.649 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.649 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715651 s, 147 MB/s 2024-04-25T08:48:49.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.658 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574871 s, 182 MB/s 2024-04-25T08:48:49.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.664 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738261 s, 142 MB/s 2024-04-25T08:48:49.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.672 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665936 s, 157 MB/s 2024-04-25T08:48:49.679 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.679 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.679 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069375 s, 151 MB/s 2024-04-25T08:48:49.686 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.686 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.686 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570117 s, 184 MB/s 2024-04-25T08:48:49.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:49.687 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:49.687 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:49.687 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T08:48:49.687 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:49.687 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:49.687 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:49.688 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567399 s, 185 MB/s 2024-04-25T08:48:49.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.758 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623025 s, 168 MB/s 2024-04-25T08:48:49.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.766 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712243 s, 147 MB/s 2024-04-25T08:48:49.773 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.773 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.773 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625063 s, 168 MB/s 2024-04-25T08:48:49.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.781 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703716 s, 149 MB/s 2024-04-25T08:48:49.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.788 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626992 s, 167 MB/s 2024-04-25T08:48:49.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.795 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630002 s, 166 MB/s 2024-04-25T08:48:49.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.801 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055811 s, 188 MB/s 2024-04-25T08:48:49.809 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.810 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710518 s, 148 MB/s 2024-04-25T08:48:49.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.816 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578151 s, 181 MB/s 2024-04-25T08:48:49.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.825 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718794 s, 146 MB/s 2024-04-25T08:48:49.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.832 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.832 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624279 s, 168 MB/s 2024-04-25T08:48:49.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.839 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701185 s, 150 MB/s 2024-04-25T08:48:49.846 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.846 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.846 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574445 s, 183 MB/s 2024-04-25T08:48:49.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.854 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677817 s, 155 MB/s 2024-04-25T08:48:49.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.862 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713293 s, 147 MB/s 2024-04-25T08:48:49.868 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.869 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619878 s, 169 MB/s 2024-04-25T08:48:49.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.878 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.878 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709574 s, 148 MB/s 2024-04-25T08:48:49.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.884 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647557 s, 162 MB/s 2024-04-25T08:48:49.891 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.891 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.891 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657249 s, 160 MB/s 2024-04-25T08:48:49.898 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.898 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.898 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566688 s, 185 MB/s 2024-04-25T08:48:49.904 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.904 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.904 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00544733 s, 192 MB/s 2024-04-25T08:48:49.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.912 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697503 s, 150 MB/s 2024-04-25T08:48:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645348 s, 162 MB/s 2024-04-25T08:48:49.927 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.927 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.927 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629732 s, 167 MB/s 2024-04-25T08:48:49.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.934 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628488 s, 167 MB/s 2024-04-25T08:48:49.941 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.941 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.941 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647185 s, 162 MB/s 2024-04-25T08:48:49.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.948 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560782 s, 187 MB/s 2024-04-25T08:48:49.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.955 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617505 s, 170 MB/s 2024-04-25T08:48:49.962 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.962 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.962 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638856 s, 164 MB/s 2024-04-25T08:48:49.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.970 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662381 s, 158 MB/s 2024-04-25T08:48:49.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:49.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:49.978 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709848 s, 148 MB/s 2024-04-25T08:48:49.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:49.979 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:49.979 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:49.979 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T08:48:49.979 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:49.979 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:49.979 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:49.979 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:50.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.044 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727894 s, 144 MB/s 2024-04-25T08:48:50.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.052 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700554 s, 150 MB/s 2024-04-25T08:48:50.058 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.058 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.058 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565622 s, 185 MB/s 2024-04-25T08:48:50.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.065 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00540918 s, 194 MB/s 2024-04-25T08:48:50.071 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.071 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.071 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563457 s, 186 MB/s 2024-04-25T08:48:50.078 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.078 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.078 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577075 s, 182 MB/s 2024-04-25T08:48:50.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.084 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557321 s, 188 MB/s 2024-04-25T08:48:50.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.091 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560681 s, 187 MB/s 2024-04-25T08:48:50.099 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.099 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.099 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698678 s, 150 MB/s 2024-04-25T08:48:50.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.106 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063383 s, 165 MB/s 2024-04-25T08:48:50.114 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.114 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.114 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690862 s, 152 MB/s 2024-04-25T08:48:50.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.121 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.121 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558736 s, 188 MB/s 2024-04-25T08:48:50.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616897 s, 170 MB/s 2024-04-25T08:48:50.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.135 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700753 s, 150 MB/s 2024-04-25T08:48:50.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731238 s, 143 MB/s 2024-04-25T08:48:50.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.152 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690497 s, 152 MB/s 2024-04-25T08:48:50.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.159 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621606 s, 169 MB/s 2024-04-25T08:48:50.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.165 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00548809 s, 191 MB/s 2024-04-25T08:48:50.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.173 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609066 s, 172 MB/s 2024-04-25T08:48:50.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.179 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627382 s, 167 MB/s 2024-04-25T08:48:50.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.192 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118926 s, 88.2 MB/s 2024-04-25T08:48:50.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.199 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624261 s, 168 MB/s 2024-04-25T08:48:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683738 s, 153 MB/s 2024-04-25T08:48:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616348 s, 170 MB/s 2024-04-25T08:48:50.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.221 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627092 s, 167 MB/s 2024-04-25T08:48:50.227 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.227 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.227 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555697 s, 189 MB/s 2024-04-25T08:48:50.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.235 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712444 s, 147 MB/s 2024-04-25T08:48:50.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.243 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.243 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620953 s, 169 MB/s 2024-04-25T08:48:50.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.250 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614328 s, 171 MB/s 2024-04-25T08:48:50.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.257 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652078 s, 161 MB/s 2024-04-25T08:48:50.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.265 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695096 s, 151 MB/s 2024-04-25T08:48:50.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.273 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.273 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686111 s, 153 MB/s 2024-04-25T08:48:50.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:50.274 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:50.274 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:50.274 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T08:48:50.274 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:50.274 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:50.274 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:50.274 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:50.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.338 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576407 s, 182 MB/s 2024-04-25T08:48:50.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.345 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634292 s, 165 MB/s 2024-04-25T08:48:50.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.352 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643552 s, 163 MB/s 2024-04-25T08:48:50.359 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.359 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.359 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643237 s, 163 MB/s 2024-04-25T08:48:50.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.373 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124382 s, 84.3 MB/s 2024-04-25T08:48:50.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.381 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718096 s, 146 MB/s 2024-04-25T08:48:50.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.387 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549264 s, 191 MB/s 2024-04-25T08:48:50.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.396 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.396 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733526 s, 143 MB/s 2024-04-25T08:48:50.403 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.403 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.403 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668751 s, 157 MB/s 2024-04-25T08:48:50.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.412 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777669 s, 135 MB/s 2024-04-25T08:48:50.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697073 s, 150 MB/s 2024-04-25T08:48:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650047 s, 161 MB/s 2024-04-25T08:48:50.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.434 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623941 s, 168 MB/s 2024-04-25T08:48:50.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.442 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701211 s, 150 MB/s 2024-04-25T08:48:50.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.450 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692312 s, 151 MB/s 2024-04-25T08:48:50.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.457 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677108 s, 155 MB/s 2024-04-25T08:48:50.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.464 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576036 s, 182 MB/s 2024-04-25T08:48:50.470 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.470 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.470 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549259 s, 191 MB/s 2024-04-25T08:48:50.478 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.478 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.478 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710609 s, 148 MB/s 2024-04-25T08:48:50.485 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.485 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.485 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628728 s, 167 MB/s 2024-04-25T08:48:50.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.493 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646081 s, 162 MB/s 2024-04-25T08:48:50.499 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.500 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574163 s, 183 MB/s 2024-04-25T08:48:50.507 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.507 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.507 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071208 s, 147 MB/s 2024-04-25T08:48:50.515 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.515 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.515 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646044 s, 162 MB/s 2024-04-25T08:48:50.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.523 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721371 s, 145 MB/s 2024-04-25T08:48:50.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.530 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.530 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570651 s, 184 MB/s 2024-04-25T08:48:50.537 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.537 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.537 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635052 s, 165 MB/s 2024-04-25T08:48:50.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.543 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558634 s, 188 MB/s 2024-04-25T08:48:50.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629408 s, 167 MB/s 2024-04-25T08:48:50.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706116 s, 148 MB/s 2024-04-25T08:48:50.566 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.566 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.566 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710253 s, 148 MB/s 2024-04-25T08:48:50.573 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.574 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624698 s, 168 MB/s 2024-04-25T08:48:50.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:50.575 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:50.575 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:50.575 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T08:48:50.575 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:50.575 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:50.575 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:50.575 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:50.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.638 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561811 s, 187 MB/s 2024-04-25T08:48:50.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.645 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643351 s, 163 MB/s 2024-04-25T08:48:50.652 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.652 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.652 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601422 s, 174 MB/s 2024-04-25T08:48:50.660 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.660 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.660 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728604 s, 144 MB/s 2024-04-25T08:48:50.667 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.668 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638068 s, 164 MB/s 2024-04-25T08:48:50.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.675 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668686 s, 157 MB/s 2024-04-25T08:48:50.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.682 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554361 s, 189 MB/s 2024-04-25T08:48:50.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.688 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588697 s, 178 MB/s 2024-04-25T08:48:50.697 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.697 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.697 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729437 s, 144 MB/s 2024-04-25T08:48:50.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.705 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702643 s, 149 MB/s 2024-04-25T08:48:50.712 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.712 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.712 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634953 s, 165 MB/s 2024-04-25T08:48:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645229 s, 163 MB/s 2024-04-25T08:48:50.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.726 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587708 s, 178 MB/s 2024-04-25T08:48:50.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.732 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556715 s, 188 MB/s 2024-04-25T08:48:50.739 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.739 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.739 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565149 s, 186 MB/s 2024-04-25T08:48:50.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.747 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729909 s, 144 MB/s 2024-04-25T08:48:50.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.755 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665356 s, 158 MB/s 2024-04-25T08:48:50.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.762 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635185 s, 165 MB/s 2024-04-25T08:48:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702068 s, 149 MB/s 2024-04-25T08:48:50.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.777 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557994 s, 188 MB/s 2024-04-25T08:48:50.783 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.783 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.783 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565016 s, 186 MB/s 2024-04-25T08:48:50.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.790 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640805 s, 164 MB/s 2024-04-25T08:48:50.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.799 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075677 s, 139 MB/s 2024-04-25T08:48:50.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.807 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715036 s, 147 MB/s 2024-04-25T08:48:50.813 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.814 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586182 s, 179 MB/s 2024-04-25T08:48:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.821 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661178 s, 159 MB/s 2024-04-25T08:48:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717967 s, 146 MB/s 2024-04-25T08:48:50.836 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.836 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.836 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616221 s, 170 MB/s 2024-04-25T08:48:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.844 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677636 s, 155 MB/s 2024-04-25T08:48:50.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.852 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070407 s, 149 MB/s 2024-04-25T08:48:50.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.859 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623626 s, 168 MB/s 2024-04-25T08:48:50.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.867 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690486 s, 152 MB/s 2024-04-25T08:48:50.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:50.868 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:50.868 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:50.868 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T08:48:50.868 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:50.868 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:50.868 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:50.868 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:50.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.934 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759818 s, 138 MB/s 2024-04-25T08:48:50.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.941 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622497 s, 168 MB/s 2024-04-25T08:48:50.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.948 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703513 s, 149 MB/s 2024-04-25T08:48:50.956 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.956 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.956 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701035 s, 150 MB/s 2024-04-25T08:48:50.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.963 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578093 s, 181 MB/s 2024-04-25T08:48:50.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.970 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587156 s, 179 MB/s 2024-04-25T08:48:50.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.977 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063712 s, 165 MB/s 2024-04-25T08:48:50.985 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.985 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.985 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733575 s, 143 MB/s 2024-04-25T08:48:50.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.993 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.993 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636712 s, 165 MB/s 2024-04-25T08:48:50.999 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:50.999 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:50.999 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558628 s, 188 MB/s 2024-04-25T08:48:51.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.006 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635172 s, 165 MB/s 2024-04-25T08:48:51.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.013 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583422 s, 180 MB/s 2024-04-25T08:48:51.020 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.020 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.020 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059347 s, 177 MB/s 2024-04-25T08:48:51.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.026 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00546959 s, 192 MB/s 2024-04-25T08:48:51.033 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.033 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.033 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581571 s, 180 MB/s 2024-04-25T08:48:51.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.041 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703464 s, 149 MB/s 2024-04-25T08:48:51.048 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.048 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.048 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668188 s, 157 MB/s 2024-04-25T08:48:51.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.056 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708326 s, 148 MB/s 2024-04-25T08:48:51.063 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.063 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.064 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633802 s, 165 MB/s 2024-04-25T08:48:51.071 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.071 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.071 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672453 s, 156 MB/s 2024-04-25T08:48:51.078 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.078 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.078 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662295 s, 158 MB/s 2024-04-25T08:48:51.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.090 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711021 s, 147 MB/s 2024-04-25T08:48:51.093 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.093 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.093 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055633 s, 188 MB/s 2024-04-25T08:48:51.100 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.100 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.100 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583167 s, 180 MB/s 2024-04-25T08:48:51.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.108 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700747 s, 150 MB/s 2024-04-25T08:48:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.115 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633418 s, 166 MB/s 2024-04-25T08:48:51.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.123 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672317 s, 156 MB/s 2024-04-25T08:48:51.131 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.131 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.131 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741443 s, 141 MB/s 2024-04-25T08:48:51.138 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.138 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.138 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610451 s, 172 MB/s 2024-04-25T08:48:51.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.145 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579363 s, 181 MB/s 2024-04-25T08:48:51.152 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.152 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.152 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649566 s, 161 MB/s 2024-04-25T08:48:51.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.160 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658268 s, 159 MB/s 2024-04-25T08:48:51.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:51.161 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:51.161 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:51.161 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T08:48:51.161 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:51.161 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:51.161 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:51.161 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:51.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.224 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570999 s, 184 MB/s 2024-04-25T08:48:51.232 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.233 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070199 s, 149 MB/s 2024-04-25T08:48:51.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.240 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656261 s, 160 MB/s 2024-04-25T08:48:51.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.248 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703552 s, 149 MB/s 2024-04-25T08:48:51.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.254 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556784 s, 188 MB/s 2024-04-25T08:48:51.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.262 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687235 s, 153 MB/s 2024-04-25T08:48:51.268 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.269 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055851 s, 188 MB/s 2024-04-25T08:48:51.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.276 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639069 s, 164 MB/s 2024-04-25T08:48:51.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.284 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665704 s, 158 MB/s 2024-04-25T08:48:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.290 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056363 s, 186 MB/s 2024-04-25T08:48:51.297 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.297 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.297 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652474 s, 161 MB/s 2024-04-25T08:48:51.305 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.305 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.305 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673398 s, 156 MB/s 2024-04-25T08:48:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.312 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623027 s, 168 MB/s 2024-04-25T08:48:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.318 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00548179 s, 191 MB/s 2024-04-25T08:48:51.326 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.327 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.327 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696201 s, 151 MB/s 2024-04-25T08:48:51.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.334 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711756 s, 147 MB/s 2024-04-25T08:48:51.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.341 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555855 s, 189 MB/s 2024-04-25T08:48:51.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.348 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587707 s, 178 MB/s 2024-04-25T08:48:51.355 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.355 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.356 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686615 s, 153 MB/s 2024-04-25T08:48:51.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.362 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00547919 s, 191 MB/s 2024-04-25T08:48:51.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.369 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654843 s, 160 MB/s 2024-04-25T08:48:51.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.376 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623151 s, 168 MB/s 2024-04-25T08:48:51.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.383 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620374 s, 169 MB/s 2024-04-25T08:48:51.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.391 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661536 s, 159 MB/s 2024-04-25T08:48:51.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.398 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632699 s, 166 MB/s 2024-04-25T08:48:51.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.405 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064181 s, 163 MB/s 2024-04-25T08:48:51.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698627 s, 150 MB/s 2024-04-25T08:48:51.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.420 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624921 s, 168 MB/s 2024-04-25T08:48:51.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.427 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565145 s, 186 MB/s 2024-04-25T08:48:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.433 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549174 s, 191 MB/s 2024-04-25T08:48:51.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.440 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575978 s, 182 MB/s 2024-04-25T08:48:51.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.447 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655158 s, 160 MB/s 2024-04-25T08:48:51.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:51.448 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:51.449 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:51.449 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T08:48:51.449 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:51.449 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:51.449 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:51.449 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.513 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583416 s, 180 MB/s 2024-04-25T08:48:51.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.519 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058709 s, 179 MB/s 2024-04-25T08:48:51.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564796 s, 186 MB/s 2024-04-25T08:48:51.532 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.533 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561508 s, 187 MB/s 2024-04-25T08:48:51.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.540 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638833 s, 164 MB/s 2024-04-25T08:48:51.547 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.547 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.547 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630111 s, 166 MB/s 2024-04-25T08:48:51.555 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.555 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.555 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695275 s, 151 MB/s 2024-04-25T08:48:51.563 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.563 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.563 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068789 s, 152 MB/s 2024-04-25T08:48:51.570 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.570 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.570 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624343 s, 168 MB/s 2024-04-25T08:48:51.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.577 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564823 s, 186 MB/s 2024-04-25T08:48:51.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.584 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654566 s, 160 MB/s 2024-04-25T08:48:51.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.592 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705969 s, 149 MB/s 2024-04-25T08:48:51.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675226 s, 155 MB/s 2024-04-25T08:48:51.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.606 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619724 s, 169 MB/s 2024-04-25T08:48:51.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.614 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661017 s, 159 MB/s 2024-04-25T08:48:51.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.621 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631687 s, 166 MB/s 2024-04-25T08:48:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702191 s, 149 MB/s 2024-04-25T08:48:51.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.636 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560672 s, 187 MB/s 2024-04-25T08:48:51.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.643 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645698 s, 162 MB/s 2024-04-25T08:48:51.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.650 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060101 s, 174 MB/s 2024-04-25T08:48:51.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.657 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666191 s, 157 MB/s 2024-04-25T08:48:51.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.664 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607716 s, 173 MB/s 2024-04-25T08:48:51.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.671 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615058 s, 170 MB/s 2024-04-25T08:48:51.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.678 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561677 s, 187 MB/s 2024-04-25T08:48:51.684 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.684 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.684 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057515 s, 182 MB/s 2024-04-25T08:48:51.691 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.692 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.692 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615285 s, 170 MB/s 2024-04-25T08:48:51.700 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.700 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.700 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715766 s, 146 MB/s 2024-04-25T08:48:51.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.710 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638092 s, 164 MB/s 2024-04-25T08:48:51.714 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.714 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.714 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640691 s, 164 MB/s 2024-04-25T08:48:51.721 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.721 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.721 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626 s, 168 MB/s 2024-04-25T08:48:51.728 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.728 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.728 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581501 s, 180 MB/s 2024-04-25T08:48:51.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.736 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064561 s, 162 MB/s 2024-04-25T08:48:51.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:51.737 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:51.737 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:51.737 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T08:48:51.737 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:51.737 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:51.737 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:51.737 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:51.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.803 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702964 s, 149 MB/s 2024-04-25T08:48:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.809 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595512 s, 176 MB/s 2024-04-25T08:48:51.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.817 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691072 s, 152 MB/s 2024-04-25T08:48:51.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.824 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062442 s, 168 MB/s 2024-04-25T08:48:51.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.831 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580397 s, 181 MB/s 2024-04-25T08:48:51.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.838 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596658 s, 176 MB/s 2024-04-25T08:48:51.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.845 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669457 s, 157 MB/s 2024-04-25T08:48:51.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.852 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613261 s, 171 MB/s 2024-04-25T08:48:51.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.860 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696794 s, 150 MB/s 2024-04-25T08:48:51.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.867 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570283 s, 184 MB/s 2024-04-25T08:48:51.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.874 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576339 s, 182 MB/s 2024-04-25T08:48:51.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.881 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666992 s, 157 MB/s 2024-04-25T08:48:51.888 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.888 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.888 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642873 s, 163 MB/s 2024-04-25T08:48:51.895 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.895 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.895 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590485 s, 178 MB/s 2024-04-25T08:48:51.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.903 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742269 s, 141 MB/s 2024-04-25T08:48:51.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.914 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646432 s, 162 MB/s 2024-04-25T08:48:51.918 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.919 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.919 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701328 s, 150 MB/s 2024-04-25T08:48:51.926 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.926 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.926 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640441 s, 164 MB/s 2024-04-25T08:48:51.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.933 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630565 s, 166 MB/s 2024-04-25T08:48:51.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.940 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562645 s, 186 MB/s 2024-04-25T08:48:51.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.947 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691544 s, 152 MB/s 2024-04-25T08:48:51.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.955 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609475 s, 172 MB/s 2024-04-25T08:48:51.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.962 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.962 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616137 s, 170 MB/s 2024-04-25T08:48:51.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.969 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.969 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619988 s, 169 MB/s 2024-04-25T08:48:51.976 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.976 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.977 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698367 s, 150 MB/s 2024-04-25T08:48:51.984 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.984 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.984 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700987 s, 150 MB/s 2024-04-25T08:48:51.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.992 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688915 s, 152 MB/s 2024-04-25T08:48:51.999 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:51.999 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:51.999 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571223 s, 184 MB/s 2024-04-25T08:48:52.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.006 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635968 s, 165 MB/s 2024-04-25T08:48:52.014 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.014 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.015 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700444 s, 150 MB/s 2024-04-25T08:48:52.020 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.021 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.021 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577133 s, 182 MB/s 2024-04-25T08:48:52.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.028 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662193 s, 158 MB/s 2024-04-25T08:48:52.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:52.029 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:52.029 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:52.029 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T08:48:52.029 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:52.029 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:52.029 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:52.030 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:52.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.094 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058882 s, 178 MB/s 2024-04-25T08:48:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.101 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579927 s, 181 MB/s 2024-04-25T08:48:52.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.108 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640542 s, 164 MB/s 2024-04-25T08:48:52.119 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.119 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.119 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631542 s, 166 MB/s 2024-04-25T08:48:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723941 s, 145 MB/s 2024-04-25T08:48:52.131 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.131 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.131 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702437 s, 149 MB/s 2024-04-25T08:48:52.139 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.139 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.139 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691367 s, 152 MB/s 2024-04-25T08:48:52.146 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.146 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.146 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650693 s, 161 MB/s 2024-04-25T08:48:52.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.153 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620172 s, 169 MB/s 2024-04-25T08:48:52.160 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.161 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063548 s, 165 MB/s 2024-04-25T08:48:52.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.168 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619893 s, 169 MB/s 2024-04-25T08:48:52.176 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.176 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.176 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753095 s, 139 MB/s 2024-04-25T08:48:52.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.183 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632272 s, 166 MB/s 2024-04-25T08:48:52.191 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.191 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.192 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725746 s, 144 MB/s 2024-04-25T08:48:52.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.200 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737981 s, 142 MB/s 2024-04-25T08:48:52.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.207 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642173 s, 163 MB/s 2024-04-25T08:48:52.213 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.213 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.213 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579536 s, 181 MB/s 2024-04-25T08:48:52.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.221 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696628 s, 151 MB/s 2024-04-25T08:48:52.228 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.228 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.228 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560896 s, 187 MB/s 2024-04-25T08:48:52.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.235 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567735 s, 185 MB/s 2024-04-25T08:48:52.241 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.241 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.241 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594672 s, 176 MB/s 2024-04-25T08:48:52.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.249 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613721 s, 171 MB/s 2024-04-25T08:48:52.255 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.255 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.255 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559836 s, 187 MB/s 2024-04-25T08:48:52.261 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.262 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566778 s, 185 MB/s 2024-04-25T08:48:52.268 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.268 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.268 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577649 s, 182 MB/s 2024-04-25T08:48:52.275 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.275 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.275 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00542112 s, 193 MB/s 2024-04-25T08:48:52.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.283 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073933 s, 142 MB/s 2024-04-25T08:48:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.292 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776095 s, 135 MB/s 2024-04-25T08:48:52.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.299 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636722 s, 165 MB/s 2024-04-25T08:48:52.306 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.306 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.306 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616324 s, 170 MB/s 2024-04-25T08:48:52.314 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.314 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.314 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693472 s, 151 MB/s 2024-04-25T08:48:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.322 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697619 s, 150 MB/s 2024-04-25T08:48:52.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:52.323 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:52.323 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:52.323 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T08:48:52.323 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:52.323 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:52.323 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:52.323 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:52.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.388 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708059 s, 148 MB/s 2024-04-25T08:48:52.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.394 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569379 s, 184 MB/s 2024-04-25T08:48:52.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.402 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706235 s, 148 MB/s 2024-04-25T08:48:52.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.410 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648967 s, 162 MB/s 2024-04-25T08:48:52.416 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.417 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.417 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061405 s, 171 MB/s 2024-04-25T08:48:52.424 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.424 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.424 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618901 s, 169 MB/s 2024-04-25T08:48:52.432 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.432 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.432 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715018 s, 147 MB/s 2024-04-25T08:48:52.439 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.439 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.440 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675382 s, 155 MB/s 2024-04-25T08:48:52.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.448 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072374 s, 145 MB/s 2024-04-25T08:48:52.455 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.455 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.455 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633169 s, 166 MB/s 2024-04-25T08:48:52.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.463 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701557 s, 149 MB/s 2024-04-25T08:48:52.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.471 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691517 s, 152 MB/s 2024-04-25T08:48:52.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.477 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573238 s, 183 MB/s 2024-04-25T08:48:52.484 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.484 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.484 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628743 s, 167 MB/s 2024-04-25T08:48:52.491 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.491 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.491 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557658 s, 188 MB/s 2024-04-25T08:48:52.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.497 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00550371 s, 191 MB/s 2024-04-25T08:48:52.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.504 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592425 s, 177 MB/s 2024-04-25T08:48:52.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.512 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687784 s, 152 MB/s 2024-04-25T08:48:52.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.520 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693984 s, 151 MB/s 2024-04-25T08:48:52.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574749 s, 182 MB/s 2024-04-25T08:48:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.534 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646296 s, 162 MB/s 2024-04-25T08:48:52.541 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.542 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687544 s, 153 MB/s 2024-04-25T08:48:52.548 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.549 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609144 s, 172 MB/s 2024-04-25T08:48:52.556 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.556 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.556 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616345 s, 170 MB/s 2024-04-25T08:48:52.562 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.562 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.562 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056984 s, 184 MB/s 2024-04-25T08:48:52.569 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.569 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.569 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636515 s, 165 MB/s 2024-04-25T08:48:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.578 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728973 s, 144 MB/s 2024-04-25T08:48:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.584 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556258 s, 189 MB/s 2024-04-25T08:48:52.591 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.592 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672252 s, 156 MB/s 2024-04-25T08:48:52.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062178 s, 169 MB/s 2024-04-25T08:48:52.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.607 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709299 s, 148 MB/s 2024-04-25T08:48:52.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.614 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637467 s, 164 MB/s 2024-04-25T08:48:52.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:52.615 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:52.615 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:52.615 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T08:48:52.615 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:52.615 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:52.616 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:52.616 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:52.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.681 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696063 s, 151 MB/s 2024-04-25T08:48:52.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.688 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644141 s, 163 MB/s 2024-04-25T08:48:52.695 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.695 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.695 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604086 s, 174 MB/s 2024-04-25T08:48:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.703 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736735 s, 142 MB/s 2024-04-25T08:48:52.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.710 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607305 s, 173 MB/s 2024-04-25T08:48:52.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.718 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654196 s, 160 MB/s 2024-04-25T08:48:52.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.725 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661127 s, 159 MB/s 2024-04-25T08:48:52.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.732 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567661 s, 185 MB/s 2024-04-25T08:48:52.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.739 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.739 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574731 s, 182 MB/s 2024-04-25T08:48:52.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.745 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579493 s, 181 MB/s 2024-04-25T08:48:52.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.753 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673517 s, 156 MB/s 2024-04-25T08:48:52.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.760 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.760 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582121 s, 180 MB/s 2024-04-25T08:48:52.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.766 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571931 s, 183 MB/s 2024-04-25T08:48:52.774 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.774 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.774 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708105 s, 148 MB/s 2024-04-25T08:48:52.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.781 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632271 s, 166 MB/s 2024-04-25T08:48:52.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.788 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00547032 s, 192 MB/s 2024-04-25T08:48:52.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.795 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640103 s, 164 MB/s 2024-04-25T08:48:52.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.802 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631698 s, 166 MB/s 2024-04-25T08:48:52.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.809 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.809 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567972 s, 185 MB/s 2024-04-25T08:48:52.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.815 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579185 s, 181 MB/s 2024-04-25T08:48:52.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.823 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703679 s, 149 MB/s 2024-04-25T08:48:52.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.831 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656991 s, 160 MB/s 2024-04-25T08:48:52.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.839 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576567 s, 182 MB/s 2024-04-25T08:48:52.844 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.844 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.845 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618711 s, 169 MB/s 2024-04-25T08:48:52.851 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.851 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.851 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568199 s, 185 MB/s 2024-04-25T08:48:52.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.859 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700263 s, 150 MB/s 2024-04-25T08:48:52.865 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.865 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.865 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563045 s, 186 MB/s 2024-04-25T08:48:52.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.873 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631415 s, 166 MB/s 2024-04-25T08:48:52.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.880 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604314 s, 174 MB/s 2024-04-25T08:48:52.888 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.888 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.888 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733879 s, 143 MB/s 2024-04-25T08:48:52.896 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.896 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.896 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688414 s, 152 MB/s 2024-04-25T08:48:52.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.903 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561146 s, 187 MB/s 2024-04-25T08:48:52.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:52.904 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:52.904 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:52.904 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T08:48:52.904 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:52.904 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:52.904 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:52.904 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:52.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.968 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627765 s, 167 MB/s 2024-04-25T08:48:52.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.974 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583696 s, 180 MB/s 2024-04-25T08:48:52.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.981 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555215 s, 189 MB/s 2024-04-25T08:48:52.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726045 s, 144 MB/s 2024-04-25T08:48:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:52.996 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563842 s, 186 MB/s 2024-04-25T08:48:53.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.003 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636486 s, 165 MB/s 2024-04-25T08:48:53.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.010 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061407 s, 171 MB/s 2024-04-25T08:48:53.016 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.016 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.016 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00545264 s, 192 MB/s 2024-04-25T08:48:53.023 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.023 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.023 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574965 s, 182 MB/s 2024-04-25T08:48:53.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.030 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.030 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570116 s, 184 MB/s 2024-04-25T08:48:53.037 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.037 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.037 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637466 s, 164 MB/s 2024-04-25T08:48:53.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.044 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625496 s, 168 MB/s 2024-04-25T08:48:53.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.052 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654673 s, 160 MB/s 2024-04-25T08:48:53.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.059 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006925 s, 151 MB/s 2024-04-25T08:48:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.066 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614982 s, 171 MB/s 2024-04-25T08:48:53.073 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.073 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.073 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573364 s, 183 MB/s 2024-04-25T08:48:53.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.080 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057523 s, 182 MB/s 2024-04-25T08:48:53.087 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.087 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.087 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632275 s, 166 MB/s 2024-04-25T08:48:53.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.094 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558011 s, 188 MB/s 2024-04-25T08:48:53.101 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.101 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.101 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638821 s, 164 MB/s 2024-04-25T08:48:53.107 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.108 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590275 s, 178 MB/s 2024-04-25T08:48:53.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.116 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.116 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709297 s, 148 MB/s 2024-04-25T08:48:53.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.123 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644136 s, 163 MB/s 2024-04-25T08:48:53.130 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.130 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.130 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620106 s, 169 MB/s 2024-04-25T08:48:53.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.137 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630554 s, 166 MB/s 2024-04-25T08:48:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624828 s, 168 MB/s 2024-04-25T08:48:53.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.151 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601484 s, 174 MB/s 2024-04-25T08:48:53.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.159 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00546067 s, 192 MB/s 2024-04-25T08:48:53.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.165 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566024 s, 185 MB/s 2024-04-25T08:48:53.171 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.171 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.172 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620901 s, 169 MB/s 2024-04-25T08:48:53.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.178 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563872 s, 186 MB/s 2024-04-25T08:48:53.184 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.184 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.184 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00540939 s, 194 MB/s 2024-04-25T08:48:53.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:53.186 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:53.186 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:53.186 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T08:48:53.186 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:53.186 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:53.186 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:53.186 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:53.251 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.251 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.251 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657649 s, 159 MB/s 2024-04-25T08:48:53.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.259 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723512 s, 145 MB/s 2024-04-25T08:48:53.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720785 s, 145 MB/s 2024-04-25T08:48:53.273 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.273 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.273 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00551167 s, 190 MB/s 2024-04-25T08:48:53.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.281 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715653 s, 147 MB/s 2024-04-25T08:48:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.288 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00550912 s, 190 MB/s 2024-04-25T08:48:53.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.296 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697228 s, 150 MB/s 2024-04-25T08:48:53.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.304 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694295 s, 151 MB/s 2024-04-25T08:48:53.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.311 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.311 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619028 s, 169 MB/s 2024-04-25T08:48:53.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.319 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072119 s, 145 MB/s 2024-04-25T08:48:53.326 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.326 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.326 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618604 s, 170 MB/s 2024-04-25T08:48:53.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.334 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719097 s, 146 MB/s 2024-04-25T08:48:53.340 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.341 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583106 s, 180 MB/s 2024-04-25T08:48:53.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.348 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645902 s, 162 MB/s 2024-04-25T08:48:53.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.354 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556621 s, 188 MB/s 2024-04-25T08:48:53.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.362 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696777 s, 150 MB/s 2024-04-25T08:48:53.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.369 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626558 s, 167 MB/s 2024-04-25T08:48:53.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.376 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569939 s, 184 MB/s 2024-04-25T08:48:53.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.384 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706337 s, 148 MB/s 2024-04-25T08:48:53.392 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.392 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.392 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689887 s, 152 MB/s 2024-04-25T08:48:53.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.398 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056513 s, 186 MB/s 2024-04-25T08:48:53.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.406 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664588 s, 158 MB/s 2024-04-25T08:48:53.414 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.414 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.414 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725598 s, 145 MB/s 2024-04-25T08:48:53.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.421 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630165 s, 166 MB/s 2024-04-25T08:48:53.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.428 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564418 s, 186 MB/s 2024-04-25T08:48:53.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.435 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655618 s, 160 MB/s 2024-04-25T08:48:53.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.442 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639503 s, 164 MB/s 2024-04-25T08:48:53.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.450 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064949 s, 161 MB/s 2024-04-25T08:48:53.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.456 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576075 s, 182 MB/s 2024-04-25T08:48:53.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.464 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609838 s, 172 MB/s 2024-04-25T08:48:53.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.472 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750625 s, 140 MB/s 2024-04-25T08:48:53.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.480 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699481 s, 150 MB/s 2024-04-25T08:48:53.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:53.482 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:53.482 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:53.482 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T08:48:53.482 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:53.482 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:53.482 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:53.483 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:53.545 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.545 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.545 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566376 s, 185 MB/s 2024-04-25T08:48:53.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.554 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553951 s, 189 MB/s 2024-04-25T08:48:53.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629528 s, 167 MB/s 2024-04-25T08:48:53.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.565 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581167 s, 180 MB/s 2024-04-25T08:48:53.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.572 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064455 s, 163 MB/s 2024-04-25T08:48:53.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.579 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549991 s, 191 MB/s 2024-04-25T08:48:53.587 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.587 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.587 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712096 s, 147 MB/s 2024-04-25T08:48:53.594 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.594 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.594 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591466 s, 177 MB/s 2024-04-25T08:48:53.601 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.601 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.602 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670373 s, 156 MB/s 2024-04-25T08:48:53.608 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.609 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.609 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646681 s, 162 MB/s 2024-04-25T08:48:53.616 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.616 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.616 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646347 s, 162 MB/s 2024-04-25T08:48:53.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.624 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700508 s, 150 MB/s 2024-04-25T08:48:53.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598788 s, 175 MB/s 2024-04-25T08:48:53.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.639 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707573 s, 148 MB/s 2024-04-25T08:48:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570777 s, 184 MB/s 2024-04-25T08:48:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056204 s, 187 MB/s 2024-04-25T08:48:53.659 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.659 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.659 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619189 s, 169 MB/s 2024-04-25T08:48:53.665 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.665 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.666 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056152 s, 187 MB/s 2024-04-25T08:48:53.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.673 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643147 s, 163 MB/s 2024-04-25T08:48:53.680 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.680 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.681 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677292 s, 155 MB/s 2024-04-25T08:48:53.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.688 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652031 s, 161 MB/s 2024-04-25T08:48:53.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.696 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714948 s, 147 MB/s 2024-04-25T08:48:53.706 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.707 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.707 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957898 s, 109 MB/s 2024-04-25T08:48:53.713 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.713 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.713 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577339 s, 182 MB/s 2024-04-25T08:48:53.720 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.720 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.720 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615517 s, 170 MB/s 2024-04-25T08:48:53.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.728 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.728 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636816 s, 165 MB/s 2024-04-25T08:48:53.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.736 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071671 s, 146 MB/s 2024-04-25T08:48:53.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.743 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594692 s, 176 MB/s 2024-04-25T08:48:53.751 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.752 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.752 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759051 s, 138 MB/s 2024-04-25T08:48:53.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.759 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075162 s, 140 MB/s 2024-04-25T08:48:53.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.766 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568453 s, 184 MB/s 2024-04-25T08:48:53.775 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.775 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.775 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00822409 s, 128 MB/s 2024-04-25T08:48:53.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:53.776 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:53.777 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:53.777 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T08:48:53.777 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:53.777 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:53.777 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:53.777 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:53.841 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.842 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.842 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705174 s, 149 MB/s 2024-04-25T08:48:53.851 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.851 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.851 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825731 s, 127 MB/s 2024-04-25T08:48:53.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.857 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579886 s, 181 MB/s 2024-04-25T08:48:53.866 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.866 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.866 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767416 s, 137 MB/s 2024-04-25T08:48:53.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.874 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710176 s, 148 MB/s 2024-04-25T08:48:53.882 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.882 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.882 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695966 s, 151 MB/s 2024-04-25T08:48:53.889 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.889 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.889 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665896 s, 157 MB/s 2024-04-25T08:48:53.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.897 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644752 s, 163 MB/s 2024-04-25T08:48:53.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.905 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742143 s, 141 MB/s 2024-04-25T08:48:53.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.913 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665677 s, 158 MB/s 2024-04-25T08:48:53.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.923 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991265 s, 106 MB/s 2024-04-25T08:48:53.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.930 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586048 s, 179 MB/s 2024-04-25T08:48:53.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.938 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670365 s, 156 MB/s 2024-04-25T08:48:53.945 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.945 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.945 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005984 s, 175 MB/s 2024-04-25T08:48:53.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.953 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.953 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675756 s, 155 MB/s 2024-04-25T08:48:53.960 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.960 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.961 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702015 s, 149 MB/s 2024-04-25T08:48:53.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.968 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710176 s, 148 MB/s 2024-04-25T08:48:53.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.975 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060512 s, 173 MB/s 2024-04-25T08:48:53.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.982 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563913 s, 186 MB/s 2024-04-25T08:48:53.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582404 s, 180 MB/s 2024-04-25T08:48:53.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:53.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:53.996 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631529 s, 166 MB/s 2024-04-25T08:48:54.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.004 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697978 s, 150 MB/s 2024-04-25T08:48:54.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.010 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553169 s, 190 MB/s 2024-04-25T08:48:54.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.019 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767026 s, 137 MB/s 2024-04-25T08:48:54.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.025 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556216 s, 189 MB/s 2024-04-25T08:48:54.033 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.033 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.033 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069839 s, 150 MB/s 2024-04-25T08:48:54.040 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.040 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.040 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657313 s, 160 MB/s 2024-04-25T08:48:54.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.052 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100068 s, 105 MB/s 2024-04-25T08:48:54.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.059 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636684 s, 165 MB/s 2024-04-25T08:48:54.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.067 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737179 s, 142 MB/s 2024-04-25T08:48:54.074 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.075 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633053 s, 166 MB/s 2024-04-25T08:48:54.081 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.082 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650385 s, 161 MB/s 2024-04-25T08:48:54.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:54.083 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:48:54.083 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:48:54.083 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T08:48:54.083 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:48:54.083 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:48:54.083 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:48:54.083 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:48:54.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.148 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739285 s, 142 MB/s 2024-04-25T08:48:54.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.155 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636806 s, 165 MB/s 2024-04-25T08:48:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.162 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647027 s, 162 MB/s 2024-04-25T08:48:54.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.169 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617651 s, 170 MB/s 2024-04-25T08:48:54.176 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.176 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.176 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573938 s, 183 MB/s 2024-04-25T08:48:54.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.183 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631057 s, 166 MB/s 2024-04-25T08:48:54.190 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.190 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.190 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058187 s, 180 MB/s 2024-04-25T08:48:54.197 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.197 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.197 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640589 s, 164 MB/s 2024-04-25T08:48:54.204 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.204 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.204 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561214 s, 187 MB/s 2024-04-25T08:48:54.210 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.210 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.210 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00546993 s, 192 MB/s 2024-04-25T08:48:54.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.217 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562026 s, 187 MB/s 2024-04-25T08:48:54.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.223 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555919 s, 189 MB/s 2024-04-25T08:48:54.232 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.232 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.232 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793335 s, 132 MB/s 2024-04-25T08:48:54.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.239 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638355 s, 164 MB/s 2024-04-25T08:48:54.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.246 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564656 s, 186 MB/s 2024-04-25T08:48:54.253 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.253 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.253 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639116 s, 164 MB/s 2024-04-25T08:48:54.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.260 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.260 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564693 s, 186 MB/s 2024-04-25T08:48:54.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635941 s, 165 MB/s 2024-04-25T08:48:54.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.274 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608058 s, 172 MB/s 2024-04-25T08:48:54.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.281 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059504 s, 176 MB/s 2024-04-25T08:48:54.287 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.287 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.287 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562082 s, 187 MB/s 2024-04-25T08:48:54.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.294 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623947 s, 168 MB/s 2024-04-25T08:48:54.301 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.301 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.301 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556468 s, 188 MB/s 2024-04-25T08:48:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00808633 s, 130 MB/s 2024-04-25T08:48:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651696 s, 161 MB/s 2024-04-25T08:48:54.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.325 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637538 s, 164 MB/s 2024-04-25T08:48:54.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.333 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672765 s, 156 MB/s 2024-04-25T08:48:54.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.341 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740273 s, 142 MB/s 2024-04-25T08:48:54.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.349 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694743 s, 151 MB/s 2024-04-25T08:48:54.356 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.356 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.356 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682473 s, 154 MB/s 2024-04-25T08:48:54.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.365 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776404 s, 135 MB/s 2024-04-25T08:48:54.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:48:54.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:48:54.372 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063976 s, 164 MB/s 2024-04-25T08:48:54.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:54.373 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /scrub_control_test_path recursive 2024-04-25T08:48:54.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.525+0000 7f76427b7640 1 Processor -- start 2024-04-25T08:48:54.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.525+0000 7f76427b7640 1 -- start start 2024-04-25T08:48:54.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f76427b7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f763c15eec0 0x7f763c1689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f76427b7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c0d1770 con 0x7f763c06ccd0 2024-04-25T08:48:54.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f76427b7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c162740 con 0x7f763c070dc0 2024-04-25T08:48:54.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f76427b7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0b0eb0 con 0x7f763c15eec0 2024-04-25T08:48:54.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f763b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f763c06ccd0 0x7f763c0b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43430/0 (socket says 172.21.15.172:43430) 2024-04-25T08:48:54.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f763b7fe640 1 -- 172.21.15.172:0/1032902321 learned_addr learned my addr 172.21.15.172:0/1032902321 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:54.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f7640d54640 1 --2- 172.21.15.172:0/1032902321 >> v2:172.21.15.186:3300/0 conn(0x7f763c15eec0 0x7f763c1689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f763affd640 1 -- 172.21.15.172:0/1032902321 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916921468 0 0) 0x7f763c0d1770 con 0x7f763c06ccd0 2024-04-25T08:48:54.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f763affd640 1 -- 172.21.15.172:0/1032902321 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7624003520 con 0x7f763c06ccd0 2024-04-25T08:48:54.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f7640d54640 1 -- 172.21.15.172:0/1032902321 >> v1:172.21.15.186:6789/0 conn(0x7f763c070dc0 legacy=0x7f763c0711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f7640d54640 1 -- 172.21.15.172:0/1032902321 >> v1:172.21.15.172:6789/0 conn(0x7f763c06ccd0 legacy=0x7f763c0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.526+0000 7f7640d54640 1 -- 172.21.15.172:0/1032902321 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c161980 con 0x7f763c15eec0 2024-04-25T08:48:54.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.527+0000 7f7640d54640 1 --2- 172.21.15.172:0/1032902321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f763c15eec0 0x7f763c1689d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7634009d90 tx=0x7f763402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e90caac8d911b8a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.527+0000 7f763affd640 1 -- 172.21.15.172:0/1032902321 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634031600 con 0x7f763c15eec0 2024-04-25T08:48:54.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.527+0000 7f763affd640 1 -- 172.21.15.172:0/1032902321 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76340317a0 con 0x7f763c15eec0 2024-04-25T08:48:54.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.527+0000 7f763affd640 1 -- 172.21.15.172:0/1032902321 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634031b50 con 0x7f763c15eec0 2024-04-25T08:48:54.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.528+0000 7f76427b7640 1 -- 172.21.15.172:0/1032902321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f763c15eec0 msgr2=0x7f763c1689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.528+0000 7f76427b7640 1 --2- 172.21.15.172:0/1032902321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f763c15eec0 0x7f763c1689d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7634009d90 tx=0x7f763402a5d0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.528+0000 7f76427b7640 1 -- 172.21.15.172:0/1032902321 shutdown_connections 2024-04-25T08:48:54.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.528+0000 7f76427b7640 1 --2- 172.21.15.172:0/1032902321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f763c15eec0 0x7f763c1689d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.528+0000 7f76427b7640 1 -- 172.21.15.172:0/1032902321 >> 172.21.15.172:0/1032902321 conn(0x7f763c0b3530 msgr2=0x7f763c0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.528+0000 7f76427b7640 1 -- 172.21.15.172:0/1032902321 shutdown_connections 2024-04-25T08:48:54.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.528+0000 7f76427b7640 1 -- 172.21.15.172:0/1032902321 wait complete. 2024-04-25T08:48:54.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.529+0000 7f76427b7640 1 Processor -- start 2024-04-25T08:48:54.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.529+0000 7f76427b7640 1 -- start start 2024-04-25T08:48:54.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f76427b7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f763c06ccd0 0x7f763c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f76427b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c070dc0 0x7f763c160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f76427b7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f763c15eec0 0x7f763c0cf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f76427b7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0b10f0 con 0x7f763c070dc0 2024-04-25T08:48:54.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f76427b7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c1622b0 con 0x7f763c06ccd0 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f76427b7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c161f40 con 0x7f763c15eec0 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c070dc0 0x7f763c160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c070dc0 0x7f763c160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41450/0 (socket says 172.21.15.172:41450) 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763b7fe640 1 -- 172.21.15.172:0/3472580497 learned_addr learned my addr 172.21.15.172:0/3472580497 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763bfff640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f763c06ccd0 0x7f763c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f7640d54640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f763c15eec0 0x7f763c0cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763b7fe640 1 -- 172.21.15.172:0/3472580497 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f763c15eec0 msgr2=0x7f763c0cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763b7fe640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f763c15eec0 0x7f763c0cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763b7fe640 1 -- 172.21.15.172:0/3472580497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f763c06ccd0 msgr2=0x7f763c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763b7fe640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f763c06ccd0 0x7f763c154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763b7fe640 1 -- 172.21.15.172:0/3472580497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c154290 con 0x7f763c070dc0 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f7640d54640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f763c15eec0 0x7f763c0cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763bfff640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f763c06ccd0 0x7f763c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f763b7fe640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c070dc0 0x7f763c160780 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f763000c500 tx=0x7f763000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f7638ff9640 1 -- 172.21.15.172:0/3472580497 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630017070 con 0x7f763c070dc0 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f7638ff9640 1 -- 172.21.15.172:0/3472580497 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630005ce0 con 0x7f763c070dc0 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f76427b7640 1 -- 172.21.15.172:0/3472580497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c0d0410 con 0x7f763c070dc0 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f7638ff9640 1 -- 172.21.15.172:0/3472580497 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630007330 con 0x7f763c070dc0 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.530+0000 7f76427b7640 1 -- 172.21.15.172:0/3472580497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c0d06f0 con 0x7f763c070dc0 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.532+0000 7f7638ff9640 1 -- 172.21.15.172:0/3472580497 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f763001a070 con 0x7f763c070dc0 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.532+0000 7f7638ff9640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f762806b4d0 0x7f762806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.532+0000 7f7638ff9640 1 -- 172.21.15.172:0/3472580497 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7630089850 con 0x7f763c070dc0 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.532+0000 7f763bfff640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f762806b4d0 0x7f762806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.533+0000 7f763bfff640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f762806b4d0 0x7f762806d990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f762c001700 tx=0x7f762c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.533+0000 7f764559a740 1 Processor -- start 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.533+0000 7f764559a740 1 -- start start 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f764559a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5630073f2200 0x5630073f4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f764559a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300742e8d0 0x5630073f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f764559a740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300741ccc0 0x56300741d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f764559a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007356000 con 0x5630073f2200 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f764559a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630072fef20 con 0x56300742e8d0 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f764559a740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630073520a0 con 0x56300741ccc0 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f763bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5630073f2200 0x5630073f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f763bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5630073f2200 0x5630073f4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41462/0 (socket says 172.21.15.172:41462) 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f763bfff640 1 -- 172.21.15.172:0/2237159715 learned_addr learned my addr 172.21.15.172:0/2237159715 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f7640d54640 1 --2- 172.21.15.172:0/2237159715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300741ccc0 0x56300741d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f763b7fe640 1 --2- 172.21.15.172:0/2237159715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300742e8d0 0x5630073f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f763bfff640 1 -- 172.21.15.172:0/2237159715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300741ccc0 msgr2=0x56300741d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f763bfff640 1 --2- 172.21.15.172:0/2237159715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300741ccc0 0x56300741d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f763bfff640 1 -- 172.21.15.172:0/2237159715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300742e8d0 msgr2=0x5630073f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f763bfff640 1 --2- 172.21.15.172:0/2237159715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300742e8d0 0x5630073f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f763bfff640 1 -- 172.21.15.172:0/2237159715 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563007136ba0 con 0x5630073f2200 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.534+0000 7f763bfff640 1 --2- 172.21.15.172:0/2237159715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5630073f2200 0x5630073f4360 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f762c005120 tx=0x7f762c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b0521e1cfdd41e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f7621ffb640 1 -- 172.21.15.172:0/2237159715 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0035f0 con 0x5630073f2200 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f7621ffb640 1 -- 172.21.15.172:0/2237159715 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c003790 con 0x5630073f2200 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f7621ffb640 1 -- 172.21.15.172:0/2237159715 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c003b40 con 0x5630073f2200 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f764559a740 1 -- 172.21.15.172:0/2237159715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5630073f2200 msgr2=0x5630073f4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f764559a740 1 --2- 172.21.15.172:0/2237159715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5630073f2200 0x5630073f4360 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f762c005120 tx=0x7f762c011000 comp rx=0 tx=0).stop 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f764559a740 1 -- 172.21.15.172:0/2237159715 shutdown_connections 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f764559a740 1 --2- 172.21.15.172:0/2237159715 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300742e8d0 0x5630073f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f764559a740 1 --2- 172.21.15.172:0/2237159715 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300741ccc0 0x56300741d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f764559a740 1 --2- 172.21.15.172:0/2237159715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5630073f2200 0x5630073f4360 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f764559a740 1 -- 172.21.15.172:0/2237159715 >> 172.21.15.172:0/2237159715 conn(0x5630073ba050 msgr2=0x563007437cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f764559a740 1 -- 172.21.15.172:0/2237159715 shutdown_connections 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.535+0000 7f764559a740 1 -- 172.21.15.172:0/2237159715 wait complete. 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.536+0000 7f764559a740 1 -- start start 2024-04-25T08:48:54.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.536+0000 7f764559a740 1 Processor -- start 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f764559a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630073f2200 0x563007413490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f764559a740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300741ccc0 0x563007416670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f764559a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x563007416bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f764559a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630072f4610 con 0x56300742e8d0 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f764559a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300741a810 con 0x5630073f2200 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f764559a740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x563007410c10 con 0x56300741ccc0 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f764559a740 10 client.0 _ll_register_callbacks cb 0x56300730cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f7640d54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x563007416bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f763bfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630073f2200 0x563007413490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f7640d54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x563007416bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41478/0 (socket says 172.21.15.172:41478) 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f7640d54640 1 -- 172.21.15.172:0/2072507380 learned_addr learned my addr 172.21.15.172:0/2072507380 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f763b7fe640 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300741ccc0 0x563007416670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f763bfff640 1 -- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300741ccc0 msgr2=0x563007416670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f763bfff640 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300741ccc0 0x563007416670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f763bfff640 1 -- 172.21.15.172:0/2072507380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 msgr2=0x563007416bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f763bfff640 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x563007416bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f763bfff640 1 -- 172.21.15.172:0/2072507380 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56300702a490 con 0x5630073f2200 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f7640d54640 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x563007416bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f763bfff640 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630073f2200 0x563007413490 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f762c020000 tx=0x7f762c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd229533fe7c6fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.537+0000 7f761affd640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f761affd640 1 -- 172.21.15.172:0/2072507380 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0035f0 con 0x5630073f2200 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f761affd640 1 -- 172.21.15.172:0/2072507380 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f762c02cc50 con 0x5630073f2200 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f764559a740 1 -- 172.21.15.172:0/2072507380 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f762c003790 con 0x5630073f2200 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f761affd640 1 -- 172.21.15.172:0/2072507380 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f762c02ce50 con 0x5630073f2200 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f764559a740 10 client.6811 fetch_fsmap learned FSMap version 56 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f764559a740 1 -- 172.21.15.172:0/2072507380 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x563007197330 con 0x5630073f2200 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f761affd640 1 -- 172.21.15.172:0/2072507380 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c003790 con 0x5630073f2200 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f761affd640 1 -- 172.21.15.172:0/2072507380 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f762c033050 con 0x5630073f2200 2024-04-25T08:48:54.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f764559a740 10 client.6811 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f764559a740 10 client.6811 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f764559a740 20 client.6811 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f764559a740 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x5630074037a0 0x56300744b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f764559a740 4 client.6811 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f764559a740 1 -- 172.21.15.172:0/2072507380 --> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563007363540 con 0x5630074037a0 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.538+0000 7f763b7fe640 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x5630074037a0 0x56300744b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f761affd640 10 client.6811 ms_handle_connect on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f763b7fe640 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x5630074037a0 0x56300744b010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5945554c48ea58d server_cookie=b6386c840bd9b242 in_seq=0 out_seq=0 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f761affd640 1 -- 172.21.15.172:0/2072507380 <== mds.0 v2:172.21.15.186:6832/246475597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563007363540 con 0x5630074037a0 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f761affd640 10 client.6811 handle_command_reply: tid=0 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 client.6811 shutdown 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 -- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630073f2200 msgr2=0x563007413490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630073f2200 0x563007413490 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f762c020000 tx=0x7f762c000bc0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 -- 172.21.15.172:0/2072507380 shutdown_connections 2024-04-25T08:48:54.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x563007416bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300741ccc0 0x563007416670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x5630074037a0 0x56300744b010 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 --2- 172.21.15.172:0/2072507380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630073f2200 0x563007413490 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f761affd640 0 client.6811 ms_handle_reset on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 -- 172.21.15.172:0/2072507380 >> 172.21.15.172:0/2072507380 conn(0x5630073ba050 msgr2=0x56300743b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 -- 172.21.15.172:0/2072507380 shutdown_connections 2024-04-25T08:48:54.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.539+0000 7f764559a740 1 -- 172.21.15.172:0/2072507380 wait complete. 2024-04-25T08:48:54.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.540+0000 7f764559a740 20 client.6811 trim_cache size 0 max 16384 2024-04-25T08:48:54.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.554+0000 7f764559a740 1 Processor -- start 2024-04-25T08:48:54.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.555+0000 7f764559a740 1 -- start start 2024-04-25T08:48:54.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.555+0000 7f764559a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630073f2200 0x5630073e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.555+0000 7f764559a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300741ccc0 0x563007451720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.555+0000 7f764559a740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300742e8d0 0x56300740f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.555+0000 7f764559a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c200240 con 0x56300741ccc0 2024-04-25T08:48:54.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.555+0000 7f764559a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0cb820 con 0x5630073f2200 2024-04-25T08:48:54.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.555+0000 7f764559a740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0cbe20 con 0x56300742e8d0 2024-04-25T08:48:54.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.555+0000 7f763b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300741ccc0 0x563007451720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.555+0000 7f763b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300741ccc0 0x563007451720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41494/0 (socket says 172.21.15.172:41494) 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.555+0000 7f763b7fe640 1 -- 172.21.15.172:0/2898390383 learned_addr learned my addr 172.21.15.172:0/2898390383 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f763b7fe640 1 -- 172.21.15.172:0/2898390383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300742e8d0 msgr2=0x56300740f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f763b7fe640 1 --2- 172.21.15.172:0/2898390383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300742e8d0 0x56300740f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f763b7fe640 1 -- 172.21.15.172:0/2898390383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630073f2200 msgr2=0x5630073e85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f763b7fe640 1 --2- 172.21.15.172:0/2898390383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630073f2200 0x5630073e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f763b7fe640 1 -- 172.21.15.172:0/2898390383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563007003610 con 0x56300741ccc0 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f763b7fe640 1 --2- 172.21.15.172:0/2898390383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300741ccc0 0x563007451720 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f7630057c10 tx=0x7f7630087b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f21053c0557689 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f76217fa640 1 -- 172.21.15.172:0/2898390383 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630086070 con 0x56300741ccc0 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f76217fa640 1 -- 172.21.15.172:0/2898390383 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630073070 con 0x56300741ccc0 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f76217fa640 1 -- 172.21.15.172:0/2898390383 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630075320 con 0x56300741ccc0 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f764559a740 1 -- 172.21.15.172:0/2898390383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300741ccc0 msgr2=0x563007451720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f764559a740 1 --2- 172.21.15.172:0/2898390383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300741ccc0 0x563007451720 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f7630057c10 tx=0x7f7630087b50 comp rx=0 tx=0).stop 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f764559a740 1 -- 172.21.15.172:0/2898390383 shutdown_connections 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f764559a740 1 --2- 172.21.15.172:0/2898390383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56300742e8d0 0x56300740f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f764559a740 1 --2- 172.21.15.172:0/2898390383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300741ccc0 0x563007451720 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f764559a740 1 --2- 172.21.15.172:0/2898390383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5630073f2200 0x5630073e85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f764559a740 1 -- 172.21.15.172:0/2898390383 >> 172.21.15.172:0/2898390383 conn(0x5630073ba050 msgr2=0x56300745a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f764559a740 1 -- 172.21.15.172:0/2898390383 shutdown_connections 2024-04-25T08:48:54.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.556+0000 7f764559a740 1 -- 172.21.15.172:0/2898390383 wait complete. 2024-04-25T08:48:54.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.557+0000 7f764559a740 1 -- start start 2024-04-25T08:48:54.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.557+0000 7f764559a740 1 Processor -- start 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f764559a740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5630073f2200 0x563007494580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f764559a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300741ccc0 0x5630074168f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f764559a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x56300744a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f764559a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630073ee470 con 0x56300742e8d0 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f764559a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007363540 con 0x56300741ccc0 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f764559a740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56300744aeb0 con 0x5630073f2200 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f764559a740 10 client.0 _ll_register_callbacks cb 0x7f762c001de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f7640d54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x56300744a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f7640d54640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x56300744a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41500/0 (socket says 172.21.15.172:41500) 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f7640d54640 1 -- 172.21.15.172:0/1990469934 learned_addr learned my addr 172.21.15.172:0/1990469934 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f763b7fe640 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300741ccc0 0x5630074168f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f763bfff640 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5630073f2200 0x563007494580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f7640d54640 1 -- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5630073f2200 msgr2=0x563007494580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f7640d54640 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5630073f2200 0x563007494580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f7640d54640 1 -- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300741ccc0 msgr2=0x5630074168f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f7640d54640 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300741ccc0 0x5630074168f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f7640d54640 1 -- 172.21.15.172:0/1990469934 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563007498b20 con 0x56300742e8d0 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f763b7fe640 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300741ccc0 0x5630074168f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f7640d54640 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x56300744a350 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f76340044a0 tx=0x7f7634004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa11b8923a94cbd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.558+0000 7f761affd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f761affd640 1 -- 172.21.15.172:0/1990469934 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763403c620 con 0x56300742e8d0 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f761affd640 1 -- 172.21.15.172:0/1990469934 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f763403c7c0 con 0x56300742e8d0 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f764559a740 1 -- 172.21.15.172:0/1990469934 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7630073070 con 0x56300742e8d0 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f761affd640 1 -- 172.21.15.172:0/1990469934 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7634050050 con 0x56300742e8d0 2024-04-25T08:48:54.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f764559a740 10 client.7869 fetch_fsmap learned FSMap version 56 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f764559a740 1 -- 172.21.15.172:0/1990469934 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x563007416ef0 con 0x56300742e8d0 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f761affd640 1 -- 172.21.15.172:0/1990469934 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630073070 con 0x56300742e8d0 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f761affd640 1 -- 172.21.15.172:0/1990469934 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7634053020 con 0x56300742e8d0 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f764559a740 10 client.7869 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f764559a740 10 client.7869 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f764559a740 20 client.7869 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f764559a740 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x563007495170 0x56300743b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f764559a740 4 client.7869 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f764559a740 1 -- 172.21.15.172:0/1990469934 --> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x56300735d890 con 0x563007495170 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f763bfff640 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x563007495170 0x56300743b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f761affd640 10 client.7869 ms_handle_connect on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.559+0000 7f763bfff640 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x563007495170 0x56300743b240 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cdaabb95d16416e server_cookie=bda72b655d8a4b91 in_seq=0 out_seq=0 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f761affd640 1 -- 172.21.15.172:0/1990469934 <== mds.0 v2:172.21.15.186:6832/246475597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56300735d890 con 0x563007495170 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f761affd640 10 client.7869 handle_command_reply: tid=0 2024-04-25T08:48:54.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 client.7869 shutdown 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 -- 172.21.15.172:0/1990469934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 msgr2=0x56300744a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x56300744a350 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f76340044a0 tx=0x7f7634004a40 comp rx=0 tx=0).stop 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 -- 172.21.15.172:0/1990469934 shutdown_connections 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x563007495170 0x56300743b240 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56300741ccc0 0x5630074168f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56300742e8d0 0x56300744a350 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f761affd640 0 client.7869 ms_handle_reset on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 --2- 172.21.15.172:0/1990469934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5630073f2200 0x563007494580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 -- 172.21.15.172:0/1990469934 >> 172.21.15.172:0/1990469934 conn(0x5630073ba050 msgr2=0x5630073e8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 -- 172.21.15.172:0/1990469934 shutdown_connections 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 1 -- 172.21.15.172:0/1990469934 wait complete. 2024-04-25T08:48:54.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.562+0000 7f764559a740 20 client.7869 trim_cache size 0 max 16384 2024-04-25T08:48:54.558 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:48:54.558 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:48:54.558 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "cb3767cf-24e0-40b4-8d66-30c9c3d2a9df", 2024-04-25T08:48:54.558 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:48:54.558 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:48:54.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 -- 172.21.15.172:0/3472580497 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f762806b4d0 msgr2=0x7f762806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f762806b4d0 0x7f762806d990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f762c001700 tx=0x7f762c009040 comp rx=0 tx=0).stop 2024-04-25T08:48:54.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 -- 172.21.15.172:0/3472580497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c070dc0 msgr2=0x7f763c160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c070dc0 0x7f763c160780 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f763000c500 tx=0x7f763000c9c0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 -- 172.21.15.172:0/3472580497 shutdown_connections 2024-04-25T08:48:54.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f762806b4d0 0x7f762806d990 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f763c15eec0 0x7f763c0cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f763c070dc0 0x7f763c160780 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 --2- 172.21.15.172:0/3472580497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f763c06ccd0 0x7f763c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 -- 172.21.15.172:0/3472580497 >> 172.21.15.172:0/3472580497 conn(0x7f763c0b3530 msgr2=0x7f763c0d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 -- 172.21.15.172:0/3472580497 shutdown_connections 2024-04-25T08:48:54.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.563+0000 7f76427b7640 1 -- 172.21.15.172:0/3472580497 wait complete. 2024-04-25T08:48:54.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:48:54.565 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub abort 2024-04-25T08:48:54.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.690+0000 7fae44238640 1 Processor -- start 2024-04-25T08:48:54.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.690+0000 7fae44238640 1 -- start start 2024-04-25T08:48:54.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae44238640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae3c070dc0 0x7fae3c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae44238640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae3c15deb0 0x7fae3c15e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae44238640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0d1770 con 0x7fae3c0711a0 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae44238640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c0b0eb0 con 0x7fae3c15deb0 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae44238640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1622b0 con 0x7fae3c070dc0 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae427d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae3c15deb0 0x7fae3c15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae417d3640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fae3c0711a0 0x7fae3c0b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43442/0 (socket says 172.21.15.172:43442) 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae427d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae3c15deb0 0x7fae3c15e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41510/0 (socket says 172.21.15.172:41510) 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae417d3640 1 -- 172.21.15.172:0/2540421772 learned_addr learned my addr 172.21.15.172:0/2540421772 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae41fd4640 1 --2- 172.21.15.172:0/2540421772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae3c070dc0 0x7fae3c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae427d5640 1 -- 172.21.15.172:0/2540421772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae3c070dc0 msgr2=0x7fae3c06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae427d5640 1 --2- 172.21.15.172:0/2540421772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae3c070dc0 0x7fae3c06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae427d5640 1 -- 172.21.15.172:0/2540421772 >> v1:172.21.15.172:6789/0 conn(0x7fae3c0711a0 legacy=0x7fae3c0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae427d5640 1 -- 172.21.15.172:0/2540421772 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c162740 con 0x7fae3c15deb0 2024-04-25T08:48:54.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.691+0000 7fae40fd2640 1 -- 172.21.15.172:0/2540421772 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904263130 0 0) 0x7fae3c0d1770 con 0x7fae3c0711a0 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.692+0000 7fae427d5640 1 --2- 172.21.15.172:0/2540421772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 0x7fae3c15e340 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fae34009d90 tx=0x7fae3402a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d60b92c3cefb46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.692+0000 7fae40fd2640 1 -- 172.21.15.172:0/2540421772 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34007740 con 0x7fae3c15deb0 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.692+0000 7fae40fd2640 1 -- 172.21.15.172:0/2540421772 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae340078e0 con 0x7fae3c15deb0 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.692+0000 7fae40fd2640 1 -- 172.21.15.172:0/2540421772 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34007cb0 con 0x7fae3c15deb0 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.693+0000 7fae44238640 1 -- 172.21.15.172:0/2540421772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 msgr2=0x7fae3c15e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.693+0000 7fae44238640 1 --2- 172.21.15.172:0/2540421772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 0x7fae3c15e340 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fae34009d90 tx=0x7fae3402a530 comp rx=0 tx=0).stop 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.693+0000 7fae44238640 1 -- 172.21.15.172:0/2540421772 shutdown_connections 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.693+0000 7fae44238640 1 --2- 172.21.15.172:0/2540421772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 0x7fae3c15e340 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.693+0000 7fae44238640 1 --2- 172.21.15.172:0/2540421772 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae3c070dc0 0x7fae3c06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.693+0000 7fae44238640 1 -- 172.21.15.172:0/2540421772 >> 172.21.15.172:0/2540421772 conn(0x7fae3c0b3530 msgr2=0x7fae3c0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.693+0000 7fae44238640 1 -- 172.21.15.172:0/2540421772 shutdown_connections 2024-04-25T08:48:54.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.693+0000 7fae44238640 1 -- 172.21.15.172:0/2540421772 wait complete. 2024-04-25T08:48:54.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.694+0000 7fae44238640 1 Processor -- start 2024-04-25T08:48:54.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.694+0000 7fae44238640 1 -- start start 2024-04-25T08:48:54.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae44238640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae3c070dc0 0x7fae3c1f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae44238640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae3c0711a0 0x7fae3c15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae44238640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 0x7fae3c15ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae44238640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c161c60 con 0x7fae3c15deb0 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae44238640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0b10f0 con 0x7fae3c070dc0 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae44238640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c161f40 con 0x7fae3c0711a0 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae427d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 0x7fae3c15ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae427d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 0x7fae3c15ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41518/0 (socket says 172.21.15.172:41518) 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae427d5640 1 -- 172.21.15.172:0/4267659947 learned_addr learned my addr 172.21.15.172:0/4267659947 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae417d3640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae3c0711a0 0x7fae3c15f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae41fd4640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae3c070dc0 0x7fae3c1f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae427d5640 1 -- 172.21.15.172:0/4267659947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae3c0711a0 msgr2=0x7fae3c15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae427d5640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae3c0711a0 0x7fae3c15f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae427d5640 1 -- 172.21.15.172:0/4267659947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae3c070dc0 msgr2=0x7fae3c1f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae427d5640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae3c070dc0 0x7fae3c1f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae427d5640 1 -- 172.21.15.172:0/4267659947 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c15e360 con 0x7fae3c15deb0 2024-04-25T08:48:54.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae427d5640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 0x7fae3c15ffc0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fae34009eb0 tx=0x7fae34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.695+0000 7fae327fc640 1 -- 172.21.15.172:0/4267659947 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3403f070 con 0x7fae3c15deb0 2024-04-25T08:48:54.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.696+0000 7fae327fc640 1 -- 172.21.15.172:0/4267659947 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae34031bc0 con 0x7fae3c15deb0 2024-04-25T08:48:54.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.696+0000 7fae44238640 1 -- 172.21.15.172:0/4267659947 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c15e5d0 con 0x7fae3c15deb0 2024-04-25T08:48:54.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.696+0000 7fae327fc640 1 -- 172.21.15.172:0/4267659947 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34009450 con 0x7fae3c15deb0 2024-04-25T08:48:54.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.696+0000 7fae44238640 1 -- 172.21.15.172:0/4267659947 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c148840 con 0x7fae3c15deb0 2024-04-25T08:48:54.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.697+0000 7fae327fc640 1 -- 172.21.15.172:0/4267659947 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae3403b410 con 0x7fae3c15deb0 2024-04-25T08:48:54.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.698+0000 7fae327fc640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae2006b4d0 0x7fae2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.698+0000 7fae327fc640 1 -- 172.21.15.172:0/4267659947 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fae340ab950 con 0x7fae3c15deb0 2024-04-25T08:48:54.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.698+0000 7fae41fd4640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae2006b4d0 0x7fae2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.698+0000 7fae41fd4640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae2006b4d0 0x7fae2006d990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fae38009b40 tx=0x7fae38009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.699+0000 7fae4701c740 1 Processor -- start 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.699+0000 7fae4701c740 1 -- start start 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae4701c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d56588ca0 0x556d5658ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae4701c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d56589080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae4701c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 0x556d565b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae4701c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d564ebb90 con 0x556d565c5370 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae4701c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d56494e40 con 0x556d56588ca0 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae4701c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d564e7c30 con 0x556d565b3760 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae417d3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d56589080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae417d3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d56589080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41520/0 (socket says 172.21.15.172:41520) 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae417d3640 1 -- 172.21.15.172:0/1965828874 learned_addr learned my addr 172.21.15.172:0/1965828874 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae41fd4640 1 --2- 172.21.15.172:0/1965828874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d56588ca0 0x556d5658ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae427d5640 1 --2- 172.21.15.172:0/1965828874 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 0x556d565b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae417d3640 1 -- 172.21.15.172:0/1965828874 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 msgr2=0x556d565b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae417d3640 1 --2- 172.21.15.172:0/1965828874 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 0x556d565b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae417d3640 1 -- 172.21.15.172:0/1965828874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d56588ca0 msgr2=0x556d5658ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae417d3640 1 --2- 172.21.15.172:0/1965828874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d56588ca0 0x556d5658ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae417d3640 1 -- 172.21.15.172:0/1965828874 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d562ca7d0 con 0x556d565c5370 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae427d5640 1 --2- 172.21.15.172:0/1965828874 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 0x556d565b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae417d3640 1 --2- 172.21.15.172:0/1965828874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d56589080 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fae2c007680 tx=0x7fae2c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcb3b39b00f35a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae1f7fe640 1 -- 172.21.15.172:0/1965828874 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c001790 con 0x556d565c5370 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae1f7fe640 1 -- 172.21.15.172:0/1965828874 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c018070 con 0x556d565c5370 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.700+0000 7fae1f7fe640 1 -- 172.21.15.172:0/1965828874 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c001b50 con 0x556d565c5370 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.701+0000 7fae4701c740 1 -- 172.21.15.172:0/1965828874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 msgr2=0x556d56589080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.701+0000 7fae4701c740 1 --2- 172.21.15.172:0/1965828874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d56589080 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fae2c007680 tx=0x7fae2c004bb0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.701+0000 7fae4701c740 1 -- 172.21.15.172:0/1965828874 shutdown_connections 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.701+0000 7fae4701c740 1 --2- 172.21.15.172:0/1965828874 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 0x556d565b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.701+0000 7fae4701c740 1 --2- 172.21.15.172:0/1965828874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d56589080 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.701+0000 7fae4701c740 1 --2- 172.21.15.172:0/1965828874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d56588ca0 0x556d5658ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.701+0000 7fae4701c740 1 -- 172.21.15.172:0/1965828874 >> 172.21.15.172:0/1965828874 conn(0x556d56550870 msgr2=0x556d565ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.701+0000 7fae4701c740 1 -- 172.21.15.172:0/1965828874 shutdown_connections 2024-04-25T08:48:54.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.701+0000 7fae4701c740 1 -- 172.21.15.172:0/1965828874 wait complete. 2024-04-25T08:48:54.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.701+0000 7fae4701c740 1 -- start start 2024-04-25T08:48:54.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.702+0000 7fae4701c740 1 Processor -- start 2024-04-25T08:48:54.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.702+0000 7fae4701c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d56588ca0 0x556d565c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.702+0000 7fae4701c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d565b3760 0x556d565c5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.702+0000 7fae4701c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565c5370 0x556d565a0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.702+0000 7fae4701c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d564a83e0 con 0x556d56588ca0 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.702+0000 7fae4701c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d565b12b0 con 0x556d565b3760 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.702+0000 7fae4701c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d565a1580 con 0x556d565c5370 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.702+0000 7fae4701c740 10 client.0 _ll_register_callbacks cb 0x556d564a7db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae41fd4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d56588ca0 0x556d565c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae41fd4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d56588ca0 0x556d565c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41532/0 (socket says 172.21.15.172:41532) 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae417d3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d565b3760 0x556d565c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae41fd4640 1 -- 172.21.15.172:0/350074533 learned_addr learned my addr 172.21.15.172:0/350074533 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae427d5640 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565c5370 0x556d565a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae41fd4640 1 -- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565c5370 msgr2=0x556d565a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae41fd4640 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565c5370 0x556d565a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae41fd4640 1 -- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d565b3760 msgr2=0x556d565c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae41fd4640 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d565b3760 0x556d565c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae41fd4640 1 -- 172.21.15.172:0/350074533 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d561c00f0 con 0x556d56588ca0 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae41fd4640 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d56588ca0 0x556d565c71f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fae380038c0 tx=0x7fae380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdecf35d2714852 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae1cff9640 1 -- 172.21.15.172:0/350074533 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38027070 con 0x556d56588ca0 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae1cff9640 1 -- 172.21.15.172:0/350074533 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fae38014650 con 0x556d56588ca0 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae4701c740 1 -- 172.21.15.172:0/350074533 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae2c018070 con 0x556d56588ca0 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae1cff9640 1 -- 172.21.15.172:0/350074533 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae38032050 con 0x556d56588ca0 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae4701c740 10 client.7884 fetch_fsmap learned FSMap version 56 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae4701c740 1 -- 172.21.15.172:0/350074533 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x556d5632af60 con 0x556d56588ca0 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae1cff9640 1 -- 172.21.15.172:0/350074533 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c018070 con 0x556d56588ca0 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.703+0000 7fae1cff9640 1 -- 172.21.15.172:0/350074533 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fae38035020 con 0x556d56588ca0 2024-04-25T08:48:54.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.704+0000 7fae4701c740 10 client.7884 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.704+0000 7fae4701c740 10 client.7884 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.704+0000 7fae4701c740 20 client.7884 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.704+0000 7fae4701c740 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x556d565aff70 0x556d565b0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.704+0000 7fae4701c740 4 client.7884 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.704+0000 7fae4701c740 1 -- 172.21.15.172:0/350074533 --> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d564f90d0 con 0x556d565aff70 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.704+0000 7fae417d3640 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x556d565aff70 0x556d565b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.704+0000 7fae1cff9640 10 client.7884 ms_handle_connect on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.704+0000 7fae417d3640 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x556d565aff70 0x556d565b0370 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af98f51287a21028 server_cookie=7073ec93d393da60 in_seq=0 out_seq=0 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae1cff9640 1 -- 172.21.15.172:0/350074533 <== mds.0 v2:172.21.15.186:6832/246475597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556d564f90d0 con 0x556d565aff70 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae1cff9640 10 client.7884 handle_command_reply: tid=0 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 client.7884 shutdown 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 -- 172.21.15.172:0/350074533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d56588ca0 msgr2=0x556d565c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d56588ca0 0x556d565c71f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fae380038c0 tx=0x7fae380046c0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 -- 172.21.15.172:0/350074533 shutdown_connections 2024-04-25T08:48:54.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x556d565aff70 0x556d565b0370 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d565b3760 0x556d565c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565c5370 0x556d565a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae1cff9640 0 client.7884 ms_handle_reset on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 --2- 172.21.15.172:0/350074533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d56588ca0 0x556d565c71f0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 -- 172.21.15.172:0/350074533 >> 172.21.15.172:0/350074533 conn(0x556d56550870 msgr2=0x556d565b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 -- 172.21.15.172:0/350074533 shutdown_connections 2024-04-25T08:48:54.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 1 -- 172.21.15.172:0/350074533 wait complete. 2024-04-25T08:48:54.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.705+0000 7fae4701c740 20 client.7884 trim_cache size 0 max 16384 2024-04-25T08:48:54.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.719+0000 7fae4701c740 1 Processor -- start 2024-04-25T08:48:54.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.720+0000 7fae4701c740 1 -- start start 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.720+0000 7fae4701c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d56588ca0 0x556d565c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.720+0000 7fae4701c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565b3760 0x556d565b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.720+0000 7fae4701c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d565c5370 0x556d565b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.720+0000 7fae4701c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c200310 con 0x556d565b3760 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.720+0000 7fae4701c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1ff4f0 con 0x556d565c5370 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.720+0000 7fae4701c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0cc750 con 0x556d56588ca0 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.720+0000 7fae417d3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565b3760 0x556d565b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.720+0000 7fae417d3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565b3760 0x556d565b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41534/0 (socket says 172.21.15.172:41534) 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.720+0000 7fae417d3640 1 -- 172.21.15.172:0/1120372682 learned_addr learned my addr 172.21.15.172:0/1120372682 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae41fd4640 1 --2- 172.21.15.172:0/1120372682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d56588ca0 0x556d565c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae427d5640 1 --2- 172.21.15.172:0/1120372682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d565c5370 0x556d565b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae417d3640 1 -- 172.21.15.172:0/1120372682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d56588ca0 msgr2=0x556d565c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae417d3640 1 --2- 172.21.15.172:0/1120372682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d56588ca0 0x556d565c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae417d3640 1 -- 172.21.15.172:0/1120372682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d565c5370 msgr2=0x556d565b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae417d3640 1 --2- 172.21.15.172:0/1120372682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d565c5370 0x556d565b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae417d3640 1 -- 172.21.15.172:0/1120372682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d56587000 con 0x556d565b3760 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae417d3640 1 --2- 172.21.15.172:0/1120372682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565b3760 0x556d565b1050 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0012b0 tx=0x7fae2c009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e7f7f06af24d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae1effd640 1 -- 172.21.15.172:0/1120372682 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c02e070 con 0x556d565b3760 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae1effd640 1 -- 172.21.15.172:0/1120372682 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c018070 con 0x556d565b3760 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae1effd640 1 -- 172.21.15.172:0/1120372682 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c028650 con 0x556d565b3760 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae4701c740 1 -- 172.21.15.172:0/1120372682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565b3760 msgr2=0x556d565b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae4701c740 1 --2- 172.21.15.172:0/1120372682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565b3760 0x556d565b1050 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0012b0 tx=0x7fae2c009030 comp rx=0 tx=0).stop 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae4701c740 1 -- 172.21.15.172:0/1120372682 shutdown_connections 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae4701c740 1 --2- 172.21.15.172:0/1120372682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d565c5370 0x556d565b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae4701c740 1 --2- 172.21.15.172:0/1120372682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565b3760 0x556d565b1050 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae4701c740 1 --2- 172.21.15.172:0/1120372682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d56588ca0 0x556d565c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae4701c740 1 -- 172.21.15.172:0/1120372682 >> 172.21.15.172:0/1120372682 conn(0x556d56550870 msgr2=0x556d5659f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae4701c740 1 -- 172.21.15.172:0/1120372682 shutdown_connections 2024-04-25T08:48:54.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.721+0000 7fae4701c740 1 -- 172.21.15.172:0/1120372682 wait complete. 2024-04-25T08:48:54.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.722+0000 7fae4701c740 1 -- start start 2024-04-25T08:48:54.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.722+0000 7fae4701c740 1 Processor -- start 2024-04-25T08:48:54.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae4701c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d56588ca0 0x556d565b1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae4701c740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 0x556d565b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae4701c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d565dcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae4701c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d565c57c0 con 0x556d565c5370 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae4701c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1fef20 con 0x556d56588ca0 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae4701c740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d565a0100 con 0x556d565b3760 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae4701c740 10 client.0 _ll_register_callbacks cb 0x7fae38011bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae427d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d565dcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae427d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d565dcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41550/0 (socket says 172.21.15.172:41550) 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae427d5640 1 -- 172.21.15.172:0/1728875275 learned_addr learned my addr 172.21.15.172:0/1728875275 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae417d3640 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 0x556d565b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae41fd4640 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d56588ca0 0x556d565b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae427d5640 1 -- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 msgr2=0x556d565b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae427d5640 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 0x556d565b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae427d5640 1 -- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d56588ca0 msgr2=0x556d565b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae427d5640 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d56588ca0 0x556d565b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.723+0000 7fae427d5640 1 -- 172.21.15.172:0/1728875275 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d561991b0 con 0x556d565c5370 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae427d5640 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d565dcf50 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fae340a9cf0 tx=0x7fae34009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480301675a976d3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae1cff9640 1 -- 172.21.15.172:0/1728875275 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3407a250 con 0x556d565c5370 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae1cff9640 1 -- 172.21.15.172:0/1728875275 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fae3407a3f0 con 0x556d565c5370 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae4701c740 1 -- 172.21.15.172:0/1728875275 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae2c018070 con 0x556d565c5370 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae1cff9640 1 -- 172.21.15.172:0/1728875275 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae340821c0 con 0x556d565c5370 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae4701c740 10 client.7890 fetch_fsmap learned FSMap version 56 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae4701c740 1 -- 172.21.15.172:0/1728875275 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x556d56587650 con 0x556d565c5370 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae1cff9640 1 -- 172.21.15.172:0/1728875275 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c018070 con 0x556d565c5370 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae1cff9640 1 -- 172.21.15.172:0/1728875275 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fae340800b0 con 0x556d565c5370 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae4701c740 10 client.7890 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae4701c740 10 client.7890 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae4701c740 20 client.7890 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae4701c740 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x556d5658a720 0x556d565dd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae4701c740 4 client.7890 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae4701c740 1 -- 172.21.15.172:0/1728875275 --> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x556d564f3420 con 0x556d5658a720 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.724+0000 7fae41fd4640 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x556d5658a720 0x556d565dd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae1cff9640 10 client.7890 ms_handle_connect on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae41fd4640 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x556d5658a720 0x556d565dd490 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eecab0fabf41b01 server_cookie=99c67896031606a3 in_seq=0 out_seq=0 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae1cff9640 1 -- 172.21.15.172:0/1728875275 <== mds.0 v2:172.21.15.186:6832/246475597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x556d564f3420 con 0x556d5658a720 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae1cff9640 10 client.7890 handle_command_reply: tid=0 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 client.7890 shutdown 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 -- 172.21.15.172:0/1728875275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 msgr2=0x556d565dcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d565dcf50 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fae340a9cf0 tx=0x7fae34009750 comp rx=0 tx=0).stop 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 -- 172.21.15.172:0/1728875275 shutdown_connections 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556d565c5370 0x556d565dcf50 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x556d565b3760 0x556d565b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x556d5658a720 0x556d565dd490 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 --2- 172.21.15.172:0/1728875275 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556d56588ca0 0x556d565b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 -- 172.21.15.172:0/1728875275 >> 172.21.15.172:0/1728875275 conn(0x556d56550870 msgr2=0x556d565c4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae1cff9640 0 client.7890 ms_handle_reset on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 -- 172.21.15.172:0/1728875275 shutdown_connections 2024-04-25T08:48:54.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 1 -- 172.21.15.172:0/1728875275 wait complete. 2024-04-25T08:48:54.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.725+0000 7fae4701c740 20 client.7890 trim_cache size 0 max 16384 2024-04-25T08:48:54.722 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:48:54.722 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0 2024-04-25T08:48:54.722 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:48:54.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 -- 172.21.15.172:0/4267659947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae2006b4d0 msgr2=0x7fae2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae2006b4d0 0x7fae2006d990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fae38009b40 tx=0x7fae38009190 comp rx=0 tx=0).stop 2024-04-25T08:48:54.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 -- 172.21.15.172:0/4267659947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 msgr2=0x7fae3c15ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 0x7fae3c15ffc0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fae34009eb0 tx=0x7fae34004a40 comp rx=0 tx=0).stop 2024-04-25T08:48:54.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 -- 172.21.15.172:0/4267659947 shutdown_connections 2024-04-25T08:48:54.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae2006b4d0 0x7fae2006d990 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae3c15deb0 0x7fae3c15ffc0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae3c0711a0 0x7fae3c15f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 --2- 172.21.15.172:0/4267659947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae3c070dc0 0x7fae3c1f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 -- 172.21.15.172:0/4267659947 >> 172.21.15.172:0/4267659947 conn(0x7fae3c0b3530 msgr2=0x7fae3c0b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 -- 172.21.15.172:0/4267659947 shutdown_connections 2024-04-25T08:48:54.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.726+0000 7fae44238640 1 -- 172.21.15.172:0/4267659947 wait complete. 2024-04-25T08:48:54.727 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:48:54.727 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T08:48:54.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.835+0000 7f67f6658640 1 Processor -- start 2024-04-25T08:48:54.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.835+0000 7f67f6658640 1 -- start start 2024-04-25T08:48:54.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f6658640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f01454b0 0x7f67f0070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f6658640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67f0071300 0x7f67f00b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f6658640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f00ceba0 con 0x7f67f0144d20 2024-04-25T08:48:54.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f6658640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f0071750 con 0x7f67f0071300 2024-04-25T08:48:54.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f6658640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00b4830 con 0x7f67f01454b0 2024-04-25T08:48:54.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f4bf5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67f0071300 0x7f67f00b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f4bf5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67f0071300 0x7f67f00b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41564/0 (socket says 172.21.15.172:41564) 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f4bf5640 1 -- 172.21.15.172:0/567206431 learned_addr learned my addr 172.21.15.172:0/567206431 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/567206431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f01454b0 0x7f67f0070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f4bf5640 1 -- 172.21.15.172:0/567206431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f01454b0 msgr2=0x7f67f0070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f4bf5640 1 --2- 172.21.15.172:0/567206431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f01454b0 0x7f67f0070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f4bf5640 1 -- 172.21.15.172:0/567206431 >> v1:172.21.15.186:6789/0 conn(0x7f67f0144d20 legacy=0x7f67f00ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.836+0000 7f67f4bf5640 1 -- 172.21.15.172:0/567206431 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00cee80 con 0x7f67f0071300 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.837+0000 7f67f4bf5640 1 --2- 172.21.15.172:0/567206431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0071300 0x7f67f00b4ca0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009e50 tx=0x7f67e802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca44f9fbc410501 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.837+0000 7f67eeffd640 1 -- 172.21.15.172:0/567206431 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8036070 con 0x7f67f0071300 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.837+0000 7f67eeffd640 1 -- 172.21.15.172:0/567206431 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8031600 con 0x7f67f0071300 2024-04-25T08:48:54.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.837+0000 7f67eeffd640 1 -- 172.21.15.172:0/567206431 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80319d0 con 0x7f67f0071300 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.838+0000 7f67f6658640 1 -- 172.21.15.172:0/567206431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0071300 msgr2=0x7f67f00b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.838+0000 7f67f6658640 1 --2- 172.21.15.172:0/567206431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0071300 0x7f67f00b4ca0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009e50 tx=0x7f67e802a710 comp rx=0 tx=0).stop 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.838+0000 7f67f6658640 1 -- 172.21.15.172:0/567206431 shutdown_connections 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.838+0000 7f67f6658640 1 --2- 172.21.15.172:0/567206431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0071300 0x7f67f00b4ca0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.838+0000 7f67f6658640 1 --2- 172.21.15.172:0/567206431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f01454b0 0x7f67f0070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.838+0000 7f67f6658640 1 -- 172.21.15.172:0/567206431 >> 172.21.15.172:0/567206431 conn(0x7f67f00b3530 msgr2=0x7f67f00b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.838+0000 7f67f6658640 1 -- 172.21.15.172:0/567206431 shutdown_connections 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.838+0000 7f67f6658640 1 -- 172.21.15.172:0/567206431 wait complete. 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.839+0000 7f67f6658640 1 Processor -- start 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.839+0000 7f67f6658640 1 -- start start 2024-04-25T08:48:54.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67f6658640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f0071300 0x7f67f01e44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67f6658640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0144d20 0x7f67f01e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67f6658640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67f01454b0 0x7f67f015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67f6658640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0145100 con 0x7f67f0144d20 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67f6658640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00cf440 con 0x7f67f01454b0 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67f6658640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0145280 con 0x7f67f0071300 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67ef7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0144d20 0x7f67f01e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67ef7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0144d20 0x7f67f01e5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41572/0 (socket says 172.21.15.172:41572) 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67ef7fe640 1 -- 172.21.15.172:0/474060686 learned_addr learned my addr 172.21.15.172:0/474060686 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67f4bf5640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67f01454b0 0x7f67f015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67effff640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f0071300 0x7f67f01e44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67ef7fe640 1 -- 172.21.15.172:0/474060686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f0071300 msgr2=0x7f67f01e44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f0071300 0x7f67f01e44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67ef7fe640 1 -- 172.21.15.172:0/474060686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67f01454b0 msgr2=0x7f67f015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67f01454b0 0x7f67f015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67ef7fe640 1 -- 172.21.15.172:0/474060686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f01e4b00 con 0x7f67f0144d20 2024-04-25T08:48:54.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67effff640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f0071300 0x7f67f01e44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:48:54.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.840+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0144d20 0x7f67f01e5ba0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f67e400e870 tx=0x7f67e400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.841+0000 7f67ecff9640 1 -- 172.21.15.172:0/474060686 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4017070 con 0x7f67f0144d20 2024-04-25T08:48:54.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.841+0000 7f67ecff9640 1 -- 172.21.15.172:0/474060686 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e400c940 con 0x7f67f0144d20 2024-04-25T08:48:54.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.841+0000 7f67f6658640 1 -- 172.21.15.172:0/474060686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f01e4de0 con 0x7f67f0144d20 2024-04-25T08:48:54.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.841+0000 7f67ecff9640 1 -- 172.21.15.172:0/474060686 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e400cd30 con 0x7f67f0144d20 2024-04-25T08:48:54.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.841+0000 7f67f6658640 1 -- 172.21.15.172:0/474060686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f01e53a0 con 0x7f67f0144d20 2024-04-25T08:48:54.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.842+0000 7f67ecff9640 1 -- 172.21.15.172:0/474060686 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f67e401a070 con 0x7f67f0144d20 2024-04-25T08:48:54.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.842+0000 7f67ecff9640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67dc06b4d0 0x7f67dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.843+0000 7f67ecff9640 1 -- 172.21.15.172:0/474060686 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f67e408a560 con 0x7f67f0144d20 2024-04-25T08:48:54.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.843+0000 7f67effff640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67dc06b4d0 0x7f67dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.843+0000 7f67effff640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67dc06b4d0 0x7f67dc06d990 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f67e0001700 tx=0x7f67e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.843+0000 7f67f9436740 1 Processor -- start 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.843+0000 7f67f9436740 1 -- start start 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67f9436740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb757a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67f9436740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb754a770 0x55adb75507a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67f9436740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7596470 0x55adb75968f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67f9436740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb74b3da0 con 0x55adb754a770 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67f9436740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb745cb80 con 0x55adb7596470 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67f9436740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adb74afe40 con 0x55adb757a510 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67ef7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb754a770 0x55adb75507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67ef7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb754a770 0x55adb75507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41576/0 (socket says 172.21.15.172:41576) 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67ef7fe640 1 -- 172.21.15.172:0/1681034184 learned_addr learned my addr 172.21.15.172:0/1681034184 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67effff640 1 --2- 172.21.15.172:0/1681034184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb757a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67f4bf5640 1 --2- 172.21.15.172:0/1681034184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7596470 0x55adb75968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67ef7fe640 1 -- 172.21.15.172:0/1681034184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 msgr2=0x55adb757a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/1681034184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb757a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67ef7fe640 1 -- 172.21.15.172:0/1681034184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7596470 msgr2=0x55adb75968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/1681034184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7596470 0x55adb75968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.844+0000 7f67ef7fe640 1 -- 172.21.15.172:0/1681034184 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adb7466f10 con 0x55adb754a770 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/1681034184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb754a770 0x55adb75507a0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f67e4088870 tx=0x7f67e4058870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac97e6239eaf6efd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67d5ffb640 1 -- 172.21.15.172:0/1681034184 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4021050 con 0x55adb754a770 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67d5ffb640 1 -- 172.21.15.172:0/1681034184 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e4061260 con 0x55adb754a770 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67d5ffb640 1 -- 172.21.15.172:0/1681034184 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4055270 con 0x55adb754a770 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67f9436740 1 -- 172.21.15.172:0/1681034184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb754a770 msgr2=0x55adb75507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67f9436740 1 --2- 172.21.15.172:0/1681034184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb754a770 0x55adb75507a0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f67e4088870 tx=0x7f67e4058870 comp rx=0 tx=0).stop 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67f9436740 1 -- 172.21.15.172:0/1681034184 shutdown_connections 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67f9436740 1 --2- 172.21.15.172:0/1681034184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7596470 0x55adb75968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67f9436740 1 --2- 172.21.15.172:0/1681034184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb754a770 0x55adb75507a0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67f9436740 1 --2- 172.21.15.172:0/1681034184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb757a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67f9436740 1 -- 172.21.15.172:0/1681034184 >> 172.21.15.172:0/1681034184 conn(0x55adb754c9e0 msgr2=0x55adb7595320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67f9436740 1 -- 172.21.15.172:0/1681034184 shutdown_connections 2024-04-25T08:48:54.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.845+0000 7f67f9436740 1 -- 172.21.15.172:0/1681034184 wait complete. 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.846+0000 7f67f9436740 1 -- start start 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.846+0000 7f67f9436740 1 Processor -- start 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67f9436740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb757a510 0x55adb7577630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67f9436740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb7596470 0x55adb757d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67f9436740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7575890 0x55adb7575d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67f9436740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb74b3da0 con 0x55adb757a510 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67f9436740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb74524b0 con 0x55adb7575890 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67f9436740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adb7550ce0 con 0x55adb7596470 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67f9436740 10 client.0 _ll_register_callbacks cb 0x55adb7492180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67effff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb757a510 0x55adb7577630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67effff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb757a510 0x55adb7577630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41588/0 (socket says 172.21.15.172:41588) 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67effff640 1 -- 172.21.15.172:0/3577990263 learned_addr learned my addr 172.21.15.172:0/3577990263 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb7596470 0x55adb757d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67f4bf5640 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7575890 0x55adb7575d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67effff640 1 -- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb7596470 msgr2=0x55adb757d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67effff640 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb7596470 0x55adb757d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67effff640 1 -- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7575890 msgr2=0x55adb7575d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67effff640 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7575890 0x55adb7575d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67effff640 1 -- 172.21.15.172:0/3577990263 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55adb72927d0 con 0x55adb757a510 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67effff640 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb757a510 0x55adb7577630 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f67e000ea90 tx=0x7f67e0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c885db8a760cb3b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.847+0000 7f67ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67ceffd640 1 -- 172.21.15.172:0/3577990263 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0027060 con 0x55adb757a510 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67ceffd640 1 -- 172.21.15.172:0/3577990263 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f67e0010040 con 0x55adb757a510 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67f9436740 1 -- 172.21.15.172:0/3577990263 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67e4061260 con 0x55adb757a510 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67ceffd640 1 -- 172.21.15.172:0/3577990263 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67e0005480 con 0x55adb757a510 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67f9436740 10 client.7902 fetch_fsmap learned FSMap version 56 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67f9436740 1 -- 172.21.15.172:0/3577990263 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55adb71c83f0 con 0x55adb757a510 2024-04-25T08:48:54.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67ceffd640 1 -- 172.21.15.172:0/3577990263 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e4061260 con 0x55adb757a510 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67ceffd640 1 -- 172.21.15.172:0/3577990263 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f67e0022430 con 0x55adb757a510 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67f9436740 10 client.7902 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67f9436740 10 client.7902 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67f9436740 20 client.7902 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67f9436740 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55adb757b420 0x55adb757b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67f9436740 4 client.7902 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67f9436740 1 -- 172.21.15.172:0/3577990263 --> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55adb74c12e0 con 0x55adb757b420 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.848+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55adb757b420 0x55adb757b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55adb757b420 0x55adb757b830 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d60ea4f75ecc60b server_cookie=a44da2f038d49f19 in_seq=0 out_seq=0 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67ceffd640 10 client.7902 ms_handle_connect on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67ceffd640 1 -- 172.21.15.172:0/3577990263 <== mds.0 v2:172.21.15.186:6832/246475597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55adb74c12e0 con 0x55adb757b420 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67ceffd640 10 client.7902 handle_command_reply: tid=0 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 client.7902 shutdown 2024-04-25T08:48:54.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 -- 172.21.15.172:0/3577990263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb757a510 msgr2=0x55adb7577630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb757a510 0x55adb7577630 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f67e000ea90 tx=0x7f67e0000bc0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 -- 172.21.15.172:0/3577990263 shutdown_connections 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55adb757b420 0x55adb757b830 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7575890 0x55adb7575d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb7596470 0x55adb757d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 --2- 172.21.15.172:0/3577990263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb757a510 0x55adb7577630 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67ceffd640 0 client.7902 ms_handle_reset on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 -- 172.21.15.172:0/3577990263 >> 172.21.15.172:0/3577990263 conn(0x55adb754a770 msgr2=0x55adb7549e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 -- 172.21.15.172:0/3577990263 shutdown_connections 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 1 -- 172.21.15.172:0/3577990263 wait complete. 2024-04-25T08:48:54.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.849+0000 7f67f9436740 20 client.7902 trim_cache size 0 max 16384 2024-04-25T08:48:54.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.864+0000 7f67f9436740 1 Processor -- start 2024-04-25T08:48:54.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.864+0000 7f67f9436740 1 -- start start 2024-04-25T08:48:54.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f9436740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7575890 0x55adb75a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f9436740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb75a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f9436740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7596470 0x55adb75ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f9436740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f01fc1e0 con 0x55adb7596470 2024-04-25T08:48:54.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f9436740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f006d1b0 con 0x55adb7575890 2024-04-25T08:48:54.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f9436740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00c8b20 con 0x55adb757a510 2024-04-25T08:48:54.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f4bf5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7596470 0x55adb75ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f4bf5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7596470 0x55adb75ac490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41602/0 (socket says 172.21.15.172:41602) 2024-04-25T08:48:54.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f4bf5640 1 -- 172.21.15.172:0/4141966500 learned_addr learned my addr 172.21.15.172:0/4141966500 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f4bf5640 1 -- 172.21.15.172:0/4141966500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 msgr2=0x55adb75a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/4141966500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb75a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f4bf5640 1 --2- 172.21.15.172:0/4141966500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb75a8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f4bf5640 1 -- 172.21.15.172:0/4141966500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7575890 msgr2=0x55adb75a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67effff640 1 --2- 172.21.15.172:0/4141966500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7575890 0x55adb75a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f4bf5640 1 --2- 172.21.15.172:0/4141966500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7575890 0x55adb75a8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.865+0000 7f67f4bf5640 1 -- 172.21.15.172:0/4141966500 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adb7576080 con 0x55adb7596470 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67f4bf5640 1 --2- 172.21.15.172:0/4141966500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7596470 0x55adb75ac490 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009e50 tx=0x7f67e802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f6fc57e888bf3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67d57fa640 1 -- 172.21.15.172:0/4141966500 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8036040 con 0x55adb7596470 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67d57fa640 1 -- 172.21.15.172:0/4141966500 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8037040 con 0x55adb7596470 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67d57fa640 1 -- 172.21.15.172:0/4141966500 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8031900 con 0x55adb7596470 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67f9436740 1 -- 172.21.15.172:0/4141966500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7596470 msgr2=0x55adb75ac490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67f9436740 1 --2- 172.21.15.172:0/4141966500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7596470 0x55adb75ac490 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009e50 tx=0x7f67e802e000 comp rx=0 tx=0).stop 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67f9436740 1 -- 172.21.15.172:0/4141966500 shutdown_connections 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67f9436740 1 --2- 172.21.15.172:0/4141966500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7596470 0x55adb75ac490 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67f9436740 1 --2- 172.21.15.172:0/4141966500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb75a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67f9436740 1 --2- 172.21.15.172:0/4141966500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7575890 0x55adb75a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67f9436740 1 -- 172.21.15.172:0/4141966500 >> 172.21.15.172:0/4141966500 conn(0x55adb754a770 msgr2=0x55adb7545db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67f9436740 1 -- 172.21.15.172:0/4141966500 shutdown_connections 2024-04-25T08:48:54.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.866+0000 7f67f9436740 1 -- 172.21.15.172:0/4141966500 wait complete. 2024-04-25T08:48:54.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.867+0000 7f67f9436740 1 -- start start 2024-04-25T08:48:54.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.867+0000 7f67f9436740 1 Processor -- start 2024-04-25T08:48:54.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67f9436740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7575890 0x55adb75ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67f9436740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb75ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67f9436740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7596470 0x55adb75745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67f9436740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adb754b190 con 0x55adb7575890 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67f9436740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f01f5d20 con 0x55adb7596470 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67f9436740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adb74754b0 con 0x55adb757a510 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67f9436740 10 client.0 _ll_register_callbacks cb 0x7f67e400ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67effff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7575890 0x55adb75ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67effff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7575890 0x55adb75ac490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:41610/0 (socket says 172.21.15.172:41610) 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67effff640 1 -- 172.21.15.172:0/3192702879 learned_addr learned my addr 172.21.15.172:0/3192702879 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb75ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67effff640 1 -- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 msgr2=0x55adb75ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67f4bf5640 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7596470 0x55adb75745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67effff640 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb75ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67effff640 1 -- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7596470 msgr2=0x55adb75745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67effff640 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7596470 0x55adb75745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67effff640 1 -- 172.21.15.172:0/3192702879 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55adb71880f0 con 0x55adb7575890 2024-04-25T08:48:54.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67effff640 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7575890 0x55adb75ac490 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f67e0005620 tx=0x7f67e0005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0622843171e361 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.868+0000 7f67ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67ceffd640 1 -- 172.21.15.172:0/3192702879 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00039c0 con 0x55adb7575890 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67ceffd640 1 -- 172.21.15.172:0/3192702879 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f67e0031030 con 0x55adb7575890 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67f9436740 1 -- 172.21.15.172:0/3192702879 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67e8037040 con 0x55adb7575890 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67ceffd640 1 -- 172.21.15.172:0/3192702879 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67e0001ce0 con 0x55adb7575890 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67f9436740 10 client.7908 fetch_fsmap learned FSMap version 56 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67f9436740 1 -- 172.21.15.172:0/3192702879 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55adb75b8cd0 con 0x55adb7575890 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67ceffd640 1 -- 172.21.15.172:0/3192702879 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8037040 con 0x55adb7575890 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67ceffd640 1 -- 172.21.15.172:0/3192702879 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f67e0023ce0 con 0x55adb7575890 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67f9436740 10 client.7908 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67f9436740 10 client.7908 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67f9436740 20 client.7908 populate_metadata read hostname 'smithi172' 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67f9436740 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55adb7603ea0 0x55adb7574b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:54.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67f9436740 4 client.7908 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67f9436740 1 -- 172.21.15.172:0/3192702879 --> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55adb754bdf0 con 0x55adb7603ea0 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55adb7603ea0 0x55adb7574b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67ceffd640 10 client.7908 ms_handle_connect on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.869+0000 7f67ef7fe640 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55adb7603ea0 0x55adb7574b20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0bef38cedd6a24f server_cookie=67dd0fe6a50b3ee9 in_seq=0 out_seq=0 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67ceffd640 1 -- 172.21.15.172:0/3192702879 <== mds.0 v2:172.21.15.186:6832/246475597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x55adb754bdf0 con 0x55adb7603ea0 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67ceffd640 10 client.7908 handle_command_reply: tid=0 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 client.7908 shutdown 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 -- 172.21.15.172:0/3192702879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7575890 msgr2=0x55adb75ac490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7575890 0x55adb75ac490 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f67e0005620 tx=0x7f67e0005000 comp rx=0 tx=0).stop 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 -- 172.21.15.172:0/3192702879 shutdown_connections 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55adb7603ea0 0x55adb7574b20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55adb7596470 0x55adb75745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55adb757a510 0x55adb75ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 --2- 172.21.15.172:0/3192702879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55adb7575890 0x55adb75ac490 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67ceffd640 0 client.7908 ms_handle_reset on v2:172.21.15.186:6832/246475597 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 -- 172.21.15.172:0/3192702879 >> 172.21.15.172:0/3192702879 conn(0x55adb754a770 msgr2=0x55adb7545b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 -- 172.21.15.172:0/3192702879 shutdown_connections 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 1 -- 172.21.15.172:0/3192702879 wait complete. 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f9436740 20 client.7908 trim_cache size 0 max 16384 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": { 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "cb3767cf-24e0-40b4-8d66-30c9c3d2a9df": { 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "/scrub_control_test_path", 2024-04-25T08:48:54.867 INFO:teuthology.orchestra.run.smithi172.stdout: "tag": "cb3767cf-24e0-40b4-8d66-30c9c3d2a9df", 2024-04-25T08:48:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: "options": "recursive" 2024-04-25T08:48:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:54.868 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:48:54.868 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f6658640 1 -- 172.21.15.172:0/474060686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67dc06b4d0 msgr2=0x7f67dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f6658640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67dc06b4d0 0x7f67dc06d990 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f67e0001700 tx=0x7f67e0009040 comp rx=0 tx=0).stop 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f6658640 1 -- 172.21.15.172:0/474060686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0144d20 msgr2=0x7f67f01e5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f6658640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0144d20 0x7f67f01e5ba0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f67e400e870 tx=0x7f67e400ed30 comp rx=0 tx=0).stop 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f6658640 1 -- 172.21.15.172:0/474060686 shutdown_connections 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f6658640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67dc06b4d0 0x7f67dc06d990 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f6658640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67f01454b0 0x7f67f015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f6658640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67f0144d20 0x7f67f01e5ba0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f6658640 1 --2- 172.21.15.172:0/474060686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67f0071300 0x7f67f01e44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.870+0000 7f67f6658640 1 -- 172.21.15.172:0/474060686 >> 172.21.15.172:0/474060686 conn(0x7f67f00b3530 msgr2=0x7f67f00c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:54.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.871+0000 7f67f6658640 1 -- 172.21.15.172:0/474060686 shutdown_connections 2024-04-25T08:48:54.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:54.871+0000 7f67f6658640 1 -- 172.21.15.172:0/474060686 wait complete. 2024-04-25T08:48:59.873 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:48:59.873 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T08:48:59.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.994+0000 7f5a750c4640 1 Processor -- start 2024-04-25T08:48:59.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.994+0000 7f5a750c4640 1 -- start start 2024-04-25T08:48:59.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a750c4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a70070dc0 0x7f5a7006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a750c4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700d1770 con 0x7f5a7015deb0 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a750c4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a70162740 con 0x7f5a700711a0 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a750c4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700b0eb0 con 0x7f5a70070dc0 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6f59e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5a7015deb0 0x7f5a7015e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:36422/0 (socket says 172.21.15.172:36422) 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6f59e640 1 -- 172.21.15.172:0/1864150740 learned_addr learned my addr 172.21.15.172:0/1864150740 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a70070dc0 0x7f5a7006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505867112 0 0) 0x7f5a700d1770 con 0x7f5a7015deb0 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a58003520 con 0x7f5a7015deb0 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154607011 0 0) 0x7f5a70162740 con 0x7f5a700711a0 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a700d1770 con 0x7f5a700711a0 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 860588357 0 0) 0x7f5a58003520 con 0x7f5a7015deb0 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a70070dc0 msgr2=0x7f5a7006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a70070dc0 0x7f5a7006ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:59.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 >> v1:172.21.15.186:6789/0 conn(0x7f5a700711a0 legacy=0x7f5a700b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70161980 con 0x7f5a7015deb0 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f5a680019f0 con 0x7f5a7015deb0 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 >> v1:172.21.15.172:6789/0 conn(0x7f5a7015deb0 legacy=0x7f5a7015e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a58003b70 0x7f5a58003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a70070dc0 0x7f5a58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a58004d40 0x7f5a580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700b0eb0 con 0x7f5a58004d40 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5800bb80 con 0x7f5a58003b70 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.995+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5800bd80 con 0x7f5a70070dc0 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.996+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a58004d40 0x7f5a580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:59.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.996+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a58003b70 0x7f5a58003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.996+0000 7f5a6e59c640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a70070dc0 0x7f5a58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.996+0000 7f5a6f59e640 1 -- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a70070dc0 msgr2=0x7f5a58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.996+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a70070dc0 0x7f5a58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.996+0000 7f5a6f59e640 1 -- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a58003b70 msgr2=0x7f5a58003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.996+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a58003b70 0x7f5a58003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.996+0000 7f5a6f59e640 1 -- 172.21.15.172:0/1864150740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a58003520 con 0x7f5a58004d40 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a58004d40 0x7f5a580051c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800a7e0 tx=0x7f5a58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d2061433d5a931 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800a430 con 0x7f5a58004d40 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6802f070 con 0x7f5a58004d40 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a6dd9b640 1 -- 172.21.15.172:0/1864150740 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6802bc30 con 0x7f5a58004d40 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a750c4640 1 -- 172.21.15.172:0/1864150740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a58004d40 msgr2=0x7f5a580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a750c4640 1 --2- 172.21.15.172:0/1864150740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a58004d40 0x7f5a580051c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800a7e0 tx=0x7f5a58005830 comp rx=0 tx=0).stop 2024-04-25T08:48:59.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a6f59e640 1 -- 172.21.15.172:0/1864150740 reap_dead start 2024-04-25T08:48:59.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a750c4640 1 -- 172.21.15.172:0/1864150740 shutdown_connections 2024-04-25T08:48:59.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a750c4640 1 -- 172.21.15.172:0/1864150740 >> 172.21.15.172:0/1864150740 conn(0x7f5a700b3530 msgr2=0x7f5a700b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:48:59.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a750c4640 1 -- 172.21.15.172:0/1864150740 shutdown_connections 2024-04-25T08:48:59.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.997+0000 7f5a750c4640 1 -- 172.21.15.172:0/1864150740 wait complete. 2024-04-25T08:48:59.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.999+0000 7f5a750c4640 1 Processor -- start 2024-04-25T08:48:59.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:48:59.999+0000 7f5a750c4640 1 -- start start 2024-04-25T08:48:59.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a750c4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a701529c0 0x7f5a701f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a750c4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a701591e0 0x7f5a700ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a750c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a700cd450 0x7f5a701548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a750c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700b10f0 con 0x7f5a700cd450 2024-04-25T08:48:59.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a750c4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a701622b0 con 0x7f5a701529c0 2024-04-25T08:48:59.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a750c4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70161f40 con 0x7f5a701591e0 2024-04-25T08:48:59.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a700cd450 0x7f5a701548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a700cd450 0x7f5a701548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50738/0 (socket says 172.21.15.172:50738) 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6f59e640 1 -- 172.21.15.172:0/539004765 learned_addr learned my addr 172.21.15.172:0/539004765 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a701529c0 0x7f5a701f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6e59c640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a701591e0 0x7f5a700ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6f59e640 1 -- 172.21.15.172:0/539004765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a701591e0 msgr2=0x7f5a700ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a701591e0 0x7f5a700ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6f59e640 1 -- 172.21.15.172:0/539004765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a701529c0 msgr2=0x7f5a701f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a701529c0 0x7f5a701f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6f59e640 1 -- 172.21.15.172:0/539004765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a701f4480 con 0x7f5a700cd450 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a700cd450 0x7f5a701548a0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800a900 tx=0x7f5a70162220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a577fe640 1 -- 172.21.15.172:0/539004765 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800a430 con 0x7f5a700cd450 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a577fe640 1 -- 172.21.15.172:0/539004765 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6802bbe0 con 0x7f5a700cd450 2024-04-25T08:48:59.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a750c4640 1 -- 172.21.15.172:0/539004765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a70152da0 con 0x7f5a700cd450 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a577fe640 1 -- 172.21.15.172:0/539004765 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68001f70 con 0x7f5a700cd450 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.000+0000 7f5a750c4640 1 -- 172.21.15.172:0/539004765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a70153570 con 0x7f5a700cd450 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.002+0000 7f5a577fe640 1 -- 172.21.15.172:0/539004765 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5a68034470 con 0x7f5a700cd450 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.002+0000 7f5a577fe640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a5c06b500 0x7f5a5c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.002+0000 7f5a577fe640 1 -- 172.21.15.172:0/539004765 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5a680a9f80 con 0x7f5a700cd450 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.002+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a5c06b500 0x7f5a5c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.003+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a5c06b500 0x7f5a5c06d9c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5a7006d400 tx=0x7f5a60009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.003+0000 7f5a77dc8740 1 Processor -- start 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.003+0000 7f5a77dc8740 1 -- start start 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d08320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05ef0 0x55bd22d08860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cd8770 0x55bd22cdbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd22c41da0 con 0x55bd22d05b10 2024-04-25T08:48:59.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd22beab80 con 0x55bd22d05ef0 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bd22c3de40 con 0x55bd22cd8770 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d08320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d08320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50754/0 (socket says 172.21.15.172:50754) 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6ed9d640 1 -- 172.21.15.172:0/707929577 learned_addr learned my addr 172.21.15.172:0/707929577 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6e59c640 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05ef0 0x55bd22d08860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cd8770 0x55bd22cdbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6ed9d640 1 -- 172.21.15.172:0/707929577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cd8770 msgr2=0x55bd22cdbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cd8770 0x55bd22cdbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6ed9d640 1 -- 172.21.15.172:0/707929577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05ef0 msgr2=0x55bd22d08860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05ef0 0x55bd22d08860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6ed9d640 1 -- 172.21.15.172:0/707929577 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd22bf4f10 con 0x55bd22d05b10 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6e59c640 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05ef0 0x55bd22d08860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.004+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cd8770 0x55bd22cdbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:00.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.005+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d08320 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5a60006a90 tx=0x7f5a60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efeddd64931034cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.005+0000 7f5a54ff9640 1 -- 172.21.15.172:0/707929577 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6001b070 con 0x55bd22d05b10 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.005+0000 7f5a54ff9640 1 -- 172.21.15.172:0/707929577 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a60003da0 con 0x55bd22d05b10 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.005+0000 7f5a54ff9640 1 -- 172.21.15.172:0/707929577 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60022630 con 0x55bd22d05b10 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.005+0000 7f5a77dc8740 1 -- 172.21.15.172:0/707929577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 msgr2=0x55bd22d08320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.005+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d08320 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5a60006a90 tx=0x7f5a60017000 comp rx=0 tx=0).stop 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.006+0000 7f5a77dc8740 1 -- 172.21.15.172:0/707929577 shutdown_connections 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.006+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05ef0 0x55bd22d08860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.006+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cd8770 0x55bd22cdbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.006+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/707929577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d08320 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.006+0000 7f5a77dc8740 1 -- 172.21.15.172:0/707929577 >> 172.21.15.172:0/707929577 conn(0x55bd22cda9e0 msgr2=0x55bd22d23320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.006+0000 7f5a77dc8740 1 -- 172.21.15.172:0/707929577 shutdown_connections 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.006+0000 7f5a77dc8740 1 -- 172.21.15.172:0/707929577 wait complete. 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.006+0000 7f5a77dc8740 1 -- start start 2024-04-25T08:49:00.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.006+0000 7f5a77dc8740 1 Processor -- start 2024-04-25T08:49:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d1d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22d05ef0 0x55bd22cfc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 0x55bd22d07ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd22cddb90 con 0x55bd22d05b10 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd22be04b0 con 0x55bd22cfcb00 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bd22cdde70 con 0x55bd22d05ef0 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a77dc8740 10 client.0 _ll_register_callbacks cb 0x55bd22c20180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d1d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d1d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50768/0 (socket says 172.21.15.172:50768) 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6ed9d640 1 -- 172.21.15.172:0/2786594967 learned_addr learned my addr 172.21.15.172:0/2786594967 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6e59c640 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22d05ef0 0x55bd22cfc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 0x55bd22d07ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6ed9d640 1 -- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22d05ef0 msgr2=0x55bd22cfc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22d05ef0 0x55bd22cfc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6ed9d640 1 -- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 msgr2=0x55bd22d07ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 0x55bd22d07ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6ed9d640 1 -- 172.21.15.172:0/2786594967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd22a207d0 con 0x55bd22d05b10 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.007+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 0x55bd22d07ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d1d950 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f5a60022b90 tx=0x7f5a600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6620768225dbd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a4dffb640 1 -- 172.21.15.172:0/2786594967 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60039060 con 0x55bd22d05b10 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a4dffb640 1 -- 172.21.15.172:0/2786594967 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5a60034420 con 0x55bd22d05b10 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2786594967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a60003da0 con 0x55bd22d05b10 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a4dffb640 1 -- 172.21.15.172:0/2786594967 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a6003f050 con 0x55bd22d05b10 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a77dc8740 10 client.7920 fetch_fsmap learned FSMap version 56 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2786594967 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55bd229563f0 con 0x55bd22d05b10 2024-04-25T08:49:00.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a4dffb640 1 -- 172.21.15.172:0/2786594967 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a60003da0 con 0x55bd22d05b10 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a4dffb640 1 -- 172.21.15.172:0/2786594967 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5a60042020 con 0x55bd22d05b10 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a77dc8740 10 client.7920 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a77dc8740 10 client.7920 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a77dc8740 20 client.7920 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55bd22d25e40 0x55bd22d26220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a77dc8740 4 client.7920 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2786594967 --> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bd22c4f2e0 con 0x55bd22d25e40 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.008+0000 7f5a6e59c640 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55bd22d25e40 0x55bd22d26220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a4dffb640 10 client.7920 ms_handle_connect on v2:172.21.15.186:6832/246475597 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a6e59c640 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55bd22d25e40 0x55bd22d26220 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32e9969bbf98149e server_cookie=1f1cdebd4453bcd8 in_seq=0 out_seq=0 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a4dffb640 1 -- 172.21.15.172:0/2786594967 <== mds.0 v2:172.21.15.186:6832/246475597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bd22c4f2e0 con 0x55bd22d25e40 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a4dffb640 10 client.7920 handle_command_reply: tid=0 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a77dc8740 1 client.7920 shutdown 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2786594967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 msgr2=0x55bd22d1d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d1d950 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f5a60022b90 tx=0x7f5a600046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2786594967 shutdown_connections 2024-04-25T08:49:00.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55bd22d25e40 0x55bd22d26220 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 0x55bd22d07ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a4dffb640 0 client.7920 ms_handle_reset on v2:172.21.15.186:6832/246475597 2024-04-25T08:49:00.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.009+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22d05ef0 0x55bd22cfc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.010+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/2786594967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05b10 0x55bd22d1d950 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.010+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2786594967 >> 172.21.15.172:0/2786594967 conn(0x55bd22cd8770 msgr2=0x55bd22cdd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:00.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.010+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2786594967 shutdown_connections 2024-04-25T08:49:00.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.010+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2786594967 wait complete. 2024-04-25T08:49:00.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.010+0000 7f5a77dc8740 20 client.7920 trim_cache size 0 max 16384 2024-04-25T08:49:00.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.025+0000 7f5a77dc8740 1 Processor -- start 2024-04-25T08:49:00.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.025+0000 7f5a77dc8740 1 -- start start 2024-04-25T08:49:00.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.025+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 0x55bd22cfc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.025+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22d05b10 0x55bd22d8f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.025+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cf76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.025+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70201070 con 0x55bd22d05ef0 2024-04-25T08:49:00.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.025+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70200210 con 0x55bd22cfcb00 2024-04-25T08:49:00.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.025+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a701ff660 con 0x55bd22d05b10 2024-04-25T08:49:00.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cf76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cf76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50770/0 (socket says 172.21.15.172:50770) 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6f59e640 1 -- 172.21.15.172:0/2815436450 learned_addr learned my addr 172.21.15.172:0/2815436450 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6e59c640 1 --2- 172.21.15.172:0/2815436450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22d05b10 0x55bd22d8f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/2815436450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 0x55bd22cfc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6f59e640 1 -- 172.21.15.172:0/2815436450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22d05b10 msgr2=0x55bd22d8f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/2815436450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22d05b10 0x55bd22d8f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6f59e640 1 -- 172.21.15.172:0/2815436450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 msgr2=0x55bd22cfc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/2815436450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 0x55bd22cfc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6f59e640 1 -- 172.21.15.172:0/2815436450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd229160f0 con 0x55bd22d05ef0 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/2815436450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cf76c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f5a680a8320 tx=0x7f5a68078150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2e522ee5748a57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a4ffff640 1 -- 172.21.15.172:0/2815436450 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680a7070 con 0x55bd22d05ef0 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a4ffff640 1 -- 172.21.15.172:0/2815436450 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6802f040 con 0x55bd22d05ef0 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.026+0000 7f5a4ffff640 1 -- 172.21.15.172:0/2815436450 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68080dd0 con 0x55bd22d05ef0 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2815436450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 msgr2=0x55bd22cf76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/2815436450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cf76c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f5a680a8320 tx=0x7f5a68078150 comp rx=0 tx=0).stop 2024-04-25T08:49:00.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2815436450 shutdown_connections 2024-04-25T08:49:00.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/2815436450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cf76c0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/2815436450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22d05b10 0x55bd22d8f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/2815436450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22cfcb00 0x55bd22cfc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2815436450 >> 172.21.15.172:0/2815436450 conn(0x55bd22cd8770 msgr2=0x55bd22cd8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:00.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2815436450 shutdown_connections 2024-04-25T08:49:00.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 -- 172.21.15.172:0/2815436450 wait complete. 2024-04-25T08:49:00.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 -- start start 2024-04-25T08:49:00.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.027+0000 7f5a77dc8740 1 Processor -- start 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cfcb00 0x55bd22d8c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05b10 0x55bd22d1c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a77dc8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cd8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd22d32e90 con 0x55bd22d05ef0 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a701ffc10 con 0x55bd22d05b10 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a77dc8740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bd22d03bd0 con 0x55bd22cfcb00 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a77dc8740 10 client.0 _ll_register_callbacks cb 0x7f5a600098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a6f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cd8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a6f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cd8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50786/0 (socket says 172.21.15.172:50786) 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a6f59e640 1 -- 172.21.15.172:0/3029412050 learned_addr learned my addr 172.21.15.172:0/3029412050 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cfcb00 0x55bd22d8c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a6e59c640 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05b10 0x55bd22d1c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a6f59e640 1 -- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cfcb00 msgr2=0x55bd22d8c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cfcb00 0x55bd22d8c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a6f59e640 1 -- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05b10 msgr2=0x55bd22d1c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.028+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05b10 0x55bd22d1c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a6f59e640 1 -- 172.21.15.172:0/3029412050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd22d23560 con 0x55bd22d05ef0 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a6f59e640 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cd8c50 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f5a680a8400 tx=0x7f5a68001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca4e4d988c8d5c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a4dffb640 1 -- 172.21.15.172:0/3029412050 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680a7050 con 0x55bd22d05ef0 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a4dffb640 1 -- 172.21.15.172:0/3029412050 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5a68080940 con 0x55bd22d05ef0 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a77dc8740 1 -- 172.21.15.172:0/3029412050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a6802f040 con 0x55bd22d05ef0 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a4dffb640 1 -- 172.21.15.172:0/3029412050 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a68080dd0 con 0x55bd22d05ef0 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a77dc8740 10 client.7926 fetch_fsmap learned FSMap version 56 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a77dc8740 1 -- 172.21.15.172:0/3029412050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55bd22d23560 con 0x55bd22d05ef0 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a4dffb640 1 -- 172.21.15.172:0/3029412050 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6802f040 con 0x55bd22d05ef0 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a4dffb640 1 -- 172.21.15.172:0/3029412050 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5a68077b10 con 0x55bd22d05ef0 2024-04-25T08:49:00.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a77dc8740 10 client.7926 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a77dc8740 10 client.7926 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a77dc8740 20 client.7926 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55bd22d1cf20 0x55bd22cd9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a77dc8740 4 client.7926 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a77dc8740 1 -- 172.21.15.172:0/3029412050 --> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bd22c49630 con 0x55bd22d1cf20 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.029+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55bd22d1cf20 0x55bd22cd9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a6ed9d640 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55bd22d1cf20 0x55bd22cd9190 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=256aa159e1641a0c server_cookie=d674c35fbdbe0638 in_seq=0 out_seq=0 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a4dffb640 10 client.7926 ms_handle_connect on v2:172.21.15.186:6832/246475597 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a4dffb640 1 -- 172.21.15.172:0/3029412050 <== mds.0 v2:172.21.15.186:6832/246475597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55bd22c49630 con 0x55bd22d1cf20 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a4dffb640 10 client.7926 handle_command_reply: tid=0 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 client.7926 shutdown 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 -- 172.21.15.172:0/3029412050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 msgr2=0x55bd22cd8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cd8c50 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f5a680a8400 tx=0x7f5a68001b00 comp rx=0 tx=0).stop 2024-04-25T08:49:00.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 -- 172.21.15.172:0/3029412050 shutdown_connections 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:6832/246475597,v1:172.21.15.186:6834/246475597] conn(0x55bd22d1cf20 0x55bd22cd9190 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55bd22d05b10 0x55bd22d1c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd22d05ef0 0x55bd22cd8c50 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 --2- 172.21.15.172:0/3029412050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55bd22cfcb00 0x55bd22d8c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 -- 172.21.15.172:0/3029412050 >> 172.21.15.172:0/3029412050 conn(0x55bd22cd8770 msgr2=0x55bd22cdc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a4dffb640 0 client.7926 ms_handle_reset on v2:172.21.15.186:6832/246475597 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 -- 172.21.15.172:0/3029412050 shutdown_connections 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 1 -- 172.21.15.172:0/3029412050 wait complete. 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.030+0000 7f5a77dc8740 20 client.7926 trim_cache size 0 max 16384 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:49:00.027 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "no active scrubs running", 2024-04-25T08:49:00.028 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": {} 2024-04-25T08:49:00.028 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:49:00.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 -- 172.21.15.172:0/539004765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a5c06b500 msgr2=0x7f5a5c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a5c06b500 0x7f5a5c06d9c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5a7006d400 tx=0x7f5a60009190 comp rx=0 tx=0).stop 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 -- 172.21.15.172:0/539004765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a700cd450 msgr2=0x7f5a701548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a700cd450 0x7f5a701548a0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800a900 tx=0x7f5a70162220 comp rx=0 tx=0).stop 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 -- 172.21.15.172:0/539004765 shutdown_connections 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a5c06b500 0x7f5a5c06d9c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a700cd450 0x7f5a701548a0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a701591e0 0x7f5a700ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 --2- 172.21.15.172:0/539004765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a701529c0 0x7f5a701f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 -- 172.21.15.172:0/539004765 >> 172.21.15.172:0/539004765 conn(0x7f5a700b3530 msgr2=0x7f5a7015c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 -- 172.21.15.172:0/539004765 shutdown_connections 2024-04-25T08:49:00.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.031+0000 7f5a750c4640 1 -- 172.21.15.172:0/539004765 wait complete. 2024-04-25T08:49:00.032 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:49:00.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:00.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.139+0000 7f7d6fcac640 1 Processor -- start 2024-04-25T08:49:00.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.140+0000 7f7d6fcac640 1 -- start start 2024-04-25T08:49:00.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.140+0000 7f7d6fcac640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7d6806caf0 0x7f7d6815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.140+0000 7f7d6fcac640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d68161800 0x7f7d680cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.140+0000 7f7d6fcac640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d680cfaf0 con 0x7f7d6815dd80 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.140+0000 7f7d6fcac640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6815e6a0 con 0x7f7d68161800 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.140+0000 7f7d6fcac640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6815e8e0 con 0x7f7d6806caf0 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.141+0000 7f7d6e249640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d68161800 0x7f7d680cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.141+0000 7f7d6da48640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7d6815dd80 0x7f7d6806c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:36430/0 (socket says 172.21.15.172:36430) 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.141+0000 7f7d6e249640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d68161800 0x7f7d680cffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50790/0 (socket says 172.21.15.172:50790) 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.141+0000 7f7d6da48640 1 -- 172.21.15.172:0/4071865207 learned_addr learned my addr 172.21.15.172:0/4071865207 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.141+0000 7f7d6d247640 1 --2- 172.21.15.172:0/4071865207 >> v2:172.21.15.186:3300/0 conn(0x7f7d6806caf0 0x7f7d6815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.141+0000 7f7d6e249640 1 -- 172.21.15.172:0/4071865207 >> v2:172.21.15.186:3300/0 conn(0x7f7d6806caf0 msgr2=0x7f7d6815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.141+0000 7f7d6e249640 1 --2- 172.21.15.172:0/4071865207 >> v2:172.21.15.186:3300/0 conn(0x7f7d6806caf0 0x7f7d6815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.141+0000 7f7d6e249640 1 -- 172.21.15.172:0/4071865207 >> v1:172.21.15.172:6789/0 conn(0x7f7d6815dd80 legacy=0x7f7d6806c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.141+0000 7f7d6ca46640 1 -- 172.21.15.172:0/4071865207 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125724154 0 0) 0x7f7d680cfaf0 con 0x7f7d6815dd80 2024-04-25T08:49:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.141+0000 7f7d6e249640 1 -- 172.21.15.172:0/4071865207 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6815ebc0 con 0x7f7d68161800 2024-04-25T08:49:00.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6e249640 1 --2- 172.21.15.172:0/4071865207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 0x7f7d680cffd0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7d68072830 tx=0x7f7d6002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5518e53e56b8b95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:00.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6ca46640 1 -- 172.21.15.172:0/4071865207 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60007740 con 0x7f7d68161800 2024-04-25T08:49:00.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6ca46640 1 -- 172.21.15.172:0/4071865207 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d600078e0 con 0x7f7d68161800 2024-04-25T08:49:00.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6ca46640 1 -- 172.21.15.172:0/4071865207 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60007cb0 con 0x7f7d68161800 2024-04-25T08:49:00.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6fcac640 1 -- 172.21.15.172:0/4071865207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 msgr2=0x7f7d680cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6fcac640 1 --2- 172.21.15.172:0/4071865207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 0x7f7d680cffd0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7d68072830 tx=0x7f7d6002a680 comp rx=0 tx=0).stop 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6fcac640 1 -- 172.21.15.172:0/4071865207 shutdown_connections 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6fcac640 1 --2- 172.21.15.172:0/4071865207 >> v2:172.21.15.186:3300/0 conn(0x7f7d6806caf0 0x7f7d6815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6fcac640 1 --2- 172.21.15.172:0/4071865207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 0x7f7d680cffd0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6fcac640 1 -- 172.21.15.172:0/4071865207 >> 172.21.15.172:0/4071865207 conn(0x7f7d680b3310 msgr2=0x7f7d680b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6fcac640 1 -- 172.21.15.172:0/4071865207 shutdown_connections 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.142+0000 7f7d6fcac640 1 -- 172.21.15.172:0/4071865207 wait complete. 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6fcac640 1 Processor -- start 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6fcac640 1 -- start start 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6fcac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6806caf0 0x7f7d6815ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6fcac640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6815dd80 0x7f7d680cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6fcac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 0x7f7d680b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6fcac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6806c0c0 con 0x7f7d68161800 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6fcac640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6815f180 con 0x7f7d6815dd80 2024-04-25T08:49:00.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6fcac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d680d0510 con 0x7f7d6806caf0 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6e249640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 0x7f7d680b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6e249640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 0x7f7d680b6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50800/0 (socket says 172.21.15.172:50800) 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.144+0000 7f7d6e249640 1 -- 172.21.15.172:0/3013273257 learned_addr learned my addr 172.21.15.172:0/3013273257 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d6da48640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6806caf0 0x7f7d6815ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d6d247640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6815dd80 0x7f7d680cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d6e249640 1 -- 172.21.15.172:0/3013273257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6806caf0 msgr2=0x7f7d6815ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d6e249640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6806caf0 0x7f7d6815ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d6e249640 1 -- 172.21.15.172:0/3013273257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6815dd80 msgr2=0x7f7d680cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d6e249640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6815dd80 0x7f7d680cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d6e249640 1 -- 172.21.15.172:0/3013273257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d680c9480 con 0x7f7d68161800 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d6e249640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 0x7f7d680b6640 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009e80 tx=0x7f7d60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d5a7fc640 1 -- 172.21.15.172:0/3013273257 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6003f070 con 0x7f7d68161800 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d5a7fc640 1 -- 172.21.15.172:0/3013273257 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d60031c40 con 0x7f7d68161800 2024-04-25T08:49:00.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d6fcac640 1 -- 172.21.15.172:0/3013273257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d680c9760 con 0x7f7d68161800 2024-04-25T08:49:00.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d5a7fc640 1 -- 172.21.15.172:0/3013273257 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60009450 con 0x7f7d68161800 2024-04-25T08:49:00.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.145+0000 7f7d6fcac640 1 -- 172.21.15.172:0/3013273257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d680c9d20 con 0x7f7d68161800 2024-04-25T08:49:00.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.146+0000 7f7d6fcac640 1 -- 172.21.15.172:0/3013273257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d68073990 con 0x7f7d68161800 2024-04-25T08:49:00.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.147+0000 7f7d5a7fc640 1 -- 172.21.15.172:0/3013273257 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d60003b90 con 0x7f7d68161800 2024-04-25T08:49:00.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.147+0000 7f7d5a7fc640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d4c06b500 0x7f7d4c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.147+0000 7f7d5a7fc640 1 -- 172.21.15.172:0/3013273257 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7d600ab460 con 0x7f7d68161800 2024-04-25T08:49:00.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.147+0000 7f7d6da48640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d4c06b500 0x7f7d4c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.147+0000 7f7d6da48640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d4c06b500 0x7f7d4c06d9c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7d64000f60 tx=0x7f7d64007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:00.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.151+0000 7f7d5a7fc640 1 -- 172.21.15.172:0/3013273257 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7d6007a1e0 con 0x7f7d68161800 2024-04-25T08:49:00.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.356+0000 7f7d6fcac640 1 -- 172.21.15.172:0/3013273257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d6815c120 con 0x7f7d68161800 2024-04-25T08:49:00.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.357+0000 7f7d5a7fc640 1 -- 172.21.15.172:0/3013273257 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f7d60079ae0 con 0x7f7d68161800 2024-04-25T08:49:00.348 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:00.348 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/154236059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":154236059},{"type":"v1","addr":"172.21.15.172:6837","nonce":154236059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/985041095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":985041095},{"type":"v1","addr":"172.21.15.186:6835","nonce":985041095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7686,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1301700155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1301700155},{"type":"v1","addr":"172.21.15.172:6836","nonce":1301700155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:48:38.741906+0000","modified":"2024-04-25T08:48:40.732152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6834/246475597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":246475597},{"type":"v1","addr":"172.21.15.186:6834","nonce":246475597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:49:00.348 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 56 2024-04-25T08:49:00.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.358+0000 7f7d6fcac640 1 -- 172.21.15.172:0/3013273257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d4c06b500 msgr2=0x7f7d4c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.358+0000 7f7d6fcac640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d4c06b500 0x7f7d4c06d9c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7d64000f60 tx=0x7f7d64007b70 comp rx=0 tx=0).stop 2024-04-25T08:49:00.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.358+0000 7f7d6fcac640 1 -- 172.21.15.172:0/3013273257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 msgr2=0x7f7d680b6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.359+0000 7f7d6fcac640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 0x7f7d680b6640 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009e80 tx=0x7f7d60004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:00.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.359+0000 7f7d6fcac640 1 -- 172.21.15.172:0/3013273257 shutdown_connections 2024-04-25T08:49:00.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.359+0000 7f7d6fcac640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d4c06b500 0x7f7d4c06d9c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.359+0000 7f7d6fcac640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6815dd80 0x7f7d680cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.359+0000 7f7d6fcac640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d68161800 0x7f7d680b6640 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.359+0000 7f7d6fcac640 1 --2- 172.21.15.172:0/3013273257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6806caf0 0x7f7d6815ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.359+0000 7f7d6fcac640 1 -- 172.21.15.172:0/3013273257 >> 172.21.15.172:0/3013273257 conn(0x7f7d680b3310 msgr2=0x7f7d680d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:00.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.359+0000 7f7d6fcac640 1 -- 172.21.15.172:0/3013273257 shutdown_connections 2024-04-25T08:49:00.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.359+0000 7f7d6fcac640 1 -- 172.21.15.172:0/3013273257 wait complete. 2024-04-25T08:49:00.360 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T08:49:00.361 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:49:00.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.467+0000 7fd46a85a640 1 Processor -- start 2024-04-25T08:49:00.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.467+0000 7fd46a85a640 1 -- start start 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd46a85a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd464154ed0 0x7fd4640aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd46a85a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd46406c1d0 0x7fd46406afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd46a85a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46415ec60 con 0x7fd464071ac0 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd46a85a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46415ef40 con 0x7fd464154ed0 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd46a85a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46406db90 con 0x7fd46406c1d0 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd463fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd464154ed0 0x7fd4640aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd463fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd464154ed0 0x7fd4640aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50810/0 (socket says 172.21.15.172:50810) 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd463fff640 1 -- 172.21.15.172:0/326229079 learned_addr learned my addr 172.21.15.172:0/326229079 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd468df7640 1 --2- 172.21.15.172:0/326229079 >> v2:172.21.15.186:3300/0 conn(0x7fd46406c1d0 0x7fd46406afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd463fff640 1 -- 172.21.15.172:0/326229079 >> v2:172.21.15.186:3300/0 conn(0x7fd46406c1d0 msgr2=0x7fd46406afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:00.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd463fff640 1 --2- 172.21.15.172:0/326229079 >> v2:172.21.15.186:3300/0 conn(0x7fd46406c1d0 0x7fd46406afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd463fff640 1 -- 172.21.15.172:0/326229079 >> v1:172.21.15.186:6789/0 conn(0x7fd464071ac0 legacy=0x7fd4640ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.468+0000 7fd463fff640 1 -- 172.21.15.172:0/326229079 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46406de70 con 0x7fd464154ed0 2024-04-25T08:49:00.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.469+0000 7fd463fff640 1 --2- 172.21.15.172:0/326229079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 0x7fd4640aced0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fd4640cc3d0 tx=0x7fd45402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b274a8a34812b83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:00.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.469+0000 7fd462ffd640 1 -- 172.21.15.172:0/326229079 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454037070 con 0x7fd464154ed0 2024-04-25T08:49:00.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.469+0000 7fd462ffd640 1 -- 172.21.15.172:0/326229079 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd454032440 con 0x7fd464154ed0 2024-04-25T08:49:00.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.469+0000 7fd462ffd640 1 -- 172.21.15.172:0/326229079 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454032810 con 0x7fd464154ed0 2024-04-25T08:49:00.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.470+0000 7fd46a85a640 1 -- 172.21.15.172:0/326229079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 msgr2=0x7fd4640aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.470+0000 7fd46a85a640 1 --2- 172.21.15.172:0/326229079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 0x7fd4640aced0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fd4640cc3d0 tx=0x7fd45402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.470+0000 7fd46a85a640 1 -- 172.21.15.172:0/326229079 shutdown_connections 2024-04-25T08:49:00.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.470+0000 7fd46a85a640 1 --2- 172.21.15.172:0/326229079 >> v2:172.21.15.186:3300/0 conn(0x7fd46406c1d0 0x7fd46406afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.470+0000 7fd46a85a640 1 --2- 172.21.15.172:0/326229079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 0x7fd4640aced0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.470+0000 7fd46a85a640 1 -- 172.21.15.172:0/326229079 >> 172.21.15.172:0/326229079 conn(0x7fd4640af670 msgr2=0x7fd4640b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:00.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.470+0000 7fd46a85a640 1 -- 172.21.15.172:0/326229079 shutdown_connections 2024-04-25T08:49:00.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.470+0000 7fd46a85a640 1 -- 172.21.15.172:0/326229079 wait complete. 2024-04-25T08:49:00.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.471+0000 7fd46a85a640 1 Processor -- start 2024-04-25T08:49:00.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.471+0000 7fd46a85a640 1 -- start start 2024-04-25T08:49:00.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd46a85a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd464071ac0 0x7fd464151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd46a85a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 0x7fd464152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd46a85a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd464152790 0x7fd4641436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd46a85a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46406b660 con 0x7fd464154ed0 2024-04-25T08:49:00.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd46a85a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46406b4e0 con 0x7fd464152790 2024-04-25T08:49:00.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd46a85a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46406b7e0 con 0x7fd464071ac0 2024-04-25T08:49:00.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd4637fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 0x7fd464152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd4637fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 0x7fd464152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50826/0 (socket says 172.21.15.172:50826) 2024-04-25T08:49:00.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd4637fe640 1 -- 172.21.15.172:0/1125957375 learned_addr learned my addr 172.21.15.172:0/1125957375 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd468df7640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd464152790 0x7fd4641436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd463fff640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd464071ac0 0x7fd464151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd4637fe640 1 -- 172.21.15.172:0/1125957375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd464071ac0 msgr2=0x7fd464151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd4637fe640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd464071ac0 0x7fd464151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd4637fe640 1 -- 172.21.15.172:0/1125957375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd464152790 msgr2=0x7fd4641436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd4637fe640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd464152790 0x7fd4641436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd4637fe640 1 -- 172.21.15.172:0/1125957375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd464152c90 con 0x7fd464154ed0 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd463fff640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd464071ac0 0x7fd464151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd468df7640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd464152790 0x7fd4641436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd4637fe640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 0x7fd464152250 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c440 tx=0x7fd458001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd460ff9640 1 -- 172.21.15.172:0/1125957375 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4580052d0 con 0x7fd464154ed0 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd460ff9640 1 -- 172.21.15.172:0/1125957375 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd458005470 con 0x7fd464154ed0 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd46a85a640 1 -- 172.21.15.172:0/1125957375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd464152f50 con 0x7fd464154ed0 2024-04-25T08:49:00.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd460ff9640 1 -- 172.21.15.172:0/1125957375 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458007260 con 0x7fd464154ed0 2024-04-25T08:49:00.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.472+0000 7fd46a85a640 1 -- 172.21.15.172:0/1125957375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd464151b90 con 0x7fd464154ed0 2024-04-25T08:49:00.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.474+0000 7fd46a85a640 1 -- 172.21.15.172:0/1125957375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4640b2b10 con 0x7fd464154ed0 2024-04-25T08:49:00.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.474+0000 7fd460ff9640 1 -- 172.21.15.172:0/1125957375 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd458007400 con 0x7fd464154ed0 2024-04-25T08:49:00.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.474+0000 7fd460ff9640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd45006b4d0 0x7fd45006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:00.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.474+0000 7fd463fff640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd45006b4d0 0x7fd45006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:00.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.474+0000 7fd460ff9640 1 -- 172.21.15.172:0/1125957375 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd458089830 con 0x7fd464154ed0 2024-04-25T08:49:00.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.475+0000 7fd463fff640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd45006b4d0 0x7fd45006d990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd454034000 tx=0x7fd45402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:00.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.479+0000 7fd460ff9640 1 -- 172.21.15.172:0/1125957375 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd4580585b0 con 0x7fd464154ed0 2024-04-25T08:49:00.687 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:49:00.690 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:49:00.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.719+0000 7fd46a85a640 1 -- 172.21.15.172:0/1125957375 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd464073990 con 0x7fd464154ed0 2024-04-25T08:49:00.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.719+0000 7fd460ff9640 1 -- 172.21.15.172:0/1125957375 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1026 (secure 0 0 0) 0x7fd458057eb0 con 0x7fd464154ed0 2024-04-25T08:49:00.710 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:00.710 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":416,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076561783,"bytes_used":2545876992,"bytes_avail":770548236288,"bytes_total":773094113280,"write_bytes_sec":83015656,"read_op_per_sec":0,"write_op_per_sec":81},"fsmap":{"epoch":56,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7704}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-04-25T08:48:28.587854+0000","services":{}},"progress_events":{}} 2024-04-25T08:49:00.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 -- 172.21.15.172:0/1125957375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd45006b4d0 msgr2=0x7fd45006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd45006b4d0 0x7fd45006d990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd454034000 tx=0x7fd45402e000 comp rx=0 tx=0).stop 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 -- 172.21.15.172:0/1125957375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 msgr2=0x7fd464152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 0x7fd464152250 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c440 tx=0x7fd458001e70 comp rx=0 tx=0).stop 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 -- 172.21.15.172:0/1125957375 shutdown_connections 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd45006b4d0 0x7fd45006d990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd464152790 0x7fd4641436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd464154ed0 0x7fd464152250 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 --2- 172.21.15.172:0/1125957375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd464071ac0 0x7fd464151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 -- 172.21.15.172:0/1125957375 >> 172.21.15.172:0/1125957375 conn(0x7fd46406c1d0 msgr2=0x7fd4640b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 -- 172.21.15.172:0/1125957375 shutdown_connections 2024-04-25T08:49:00.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:00.721+0000 7fd46a85a640 1 -- 172.21.15.172:0/1125957375 wait complete. 2024-04-25T08:49:00.723 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:49:00.724 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:49:00.836 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:49:00.885 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:49:00.886 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:00.886 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:00.902 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:00.902 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:00.958 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:01.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.104+0000 7f9506c76640 1 Processor -- start 2024-04-25T08:49:01.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.104+0000 7f9506c76640 1 -- start start 2024-04-25T08:49:01.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.104+0000 7f9506c76640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9500154ee0 0x7f95000cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.104+0000 7f9506c76640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f95000cfcf0 0x7f95000cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.104+0000 7f9506c76640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9500071480 con 0x7f95000ce3c0 2024-04-25T08:49:01.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f9506c76640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95000ce830 con 0x7f95000cfcf0 2024-04-25T08:49:01.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f9506c76640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9500072090 con 0x7f9500154ee0 2024-04-25T08:49:01.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f94fffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f95000cfcf0 0x7f95000cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f94fffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f95000cfcf0 0x7f95000cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50840/0 (socket says 172.21.15.172:50840) 2024-04-25T08:49:01.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f94fffff640 1 -- 172.21.15.172:0/3530491561 learned_addr learned my addr 172.21.15.172:0/3530491561 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:01.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f94fffff640 1 -- 172.21.15.172:0/3530491561 >> v2:172.21.15.186:3300/0 conn(0x7f9500154ee0 msgr2=0x7f95000cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:01.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f9504a12640 1 --2- 172.21.15.172:0/3530491561 >> v2:172.21.15.186:3300/0 conn(0x7f9500154ee0 0x7f95000cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f94fffff640 1 --2- 172.21.15.172:0/3530491561 >> v2:172.21.15.186:3300/0 conn(0x7f9500154ee0 0x7f95000cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f94fffff640 1 -- 172.21.15.172:0/3530491561 >> v1:172.21.15.186:6789/0 conn(0x7f95000ce3c0 legacy=0x7f950015e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f94fffff640 1 -- 172.21.15.172:0/3530491561 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500071760 con 0x7f95000cfcf0 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.105+0000 7f9504a12640 1 --2- 172.21.15.172:0/3530491561 >> v2:172.21.15.186:3300/0 conn(0x7f9500154ee0 0x7f95000cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f94fffff640 1 --2- 172.21.15.172:0/3530491561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95000cfcf0 0x7f95000cde80 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f95000d02e0 tx=0x7f94ec02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd41c461fca082b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f94ff7fe640 1 -- 172.21.15.172:0/3530491561 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec0325a0 con 0x7f95000cfcf0 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f94ff7fe640 1 -- 172.21.15.172:0/3530491561 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec038070 con 0x7f95000cfcf0 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f94ff7fe640 1 -- 172.21.15.172:0/3530491561 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec032960 con 0x7f95000cfcf0 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f9506c76640 1 -- 172.21.15.172:0/3530491561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95000cfcf0 msgr2=0x7f95000cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f9506c76640 1 --2- 172.21.15.172:0/3530491561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95000cfcf0 0x7f95000cde80 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f95000d02e0 tx=0x7f94ec02c8e0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f9506c76640 1 -- 172.21.15.172:0/3530491561 shutdown_connections 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f9506c76640 1 --2- 172.21.15.172:0/3530491561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95000cfcf0 0x7f95000cde80 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f9506c76640 1 --2- 172.21.15.172:0/3530491561 >> v2:172.21.15.186:3300/0 conn(0x7f9500154ee0 0x7f95000cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f9506c76640 1 -- 172.21.15.172:0/3530491561 >> 172.21.15.172:0/3530491561 conn(0x7f950006abe0 msgr2=0x7f950006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:01.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f9506c76640 1 -- 172.21.15.172:0/3530491561 shutdown_connections 2024-04-25T08:49:01.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.106+0000 7f9506c76640 1 -- 172.21.15.172:0/3530491561 wait complete. 2024-04-25T08:49:01.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.107+0000 7f9506c76640 1 Processor -- start 2024-04-25T08:49:01.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.108+0000 7f9506c76640 1 -- start start 2024-04-25T08:49:01.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.108+0000 7f9506c76640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95000ce3c0 0x7f95001579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.108+0000 7f9506c76640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f95000cfcf0 0x7f95001471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.108+0000 7f9506c76640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9500154ee0 0x7f950015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.108+0000 7f9506c76640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500071d20 con 0x7f9500154ee0 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.108+0000 7f9506c76640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500071230 con 0x7f95000ce3c0 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.108+0000 7f9506c76640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95001552c0 con 0x7f95000cfcf0 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9505213640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9500154ee0 0x7f950015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9505213640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9500154ee0 0x7f950015a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50842/0 (socket says 172.21.15.172:50842) 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9505213640 1 -- 172.21.15.172:0/1719076347 learned_addr learned my addr 172.21.15.172:0/1719076347 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9504a12640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95000ce3c0 0x7f95001579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f94fffff640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f95000cfcf0 0x7f95001471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9505213640 1 -- 172.21.15.172:0/1719076347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f95000cfcf0 msgr2=0x7f95001471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9505213640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f95000cfcf0 0x7f95001471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9505213640 1 -- 172.21.15.172:0/1719076347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95000ce3c0 msgr2=0x7f95001579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9505213640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95000ce3c0 0x7f95001579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9505213640 1 -- 172.21.15.172:0/1719076347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500158010 con 0x7f9500154ee0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9505213640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9500154ee0 0x7f950015a000 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f94f800c7b0 tx=0x7f94f800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f94fd7fa640 1 -- 172.21.15.172:0/1719076347 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8004b60 con 0x7f9500154ee0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f94fd7fa640 1 -- 172.21.15.172:0/1719076347 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f8004d00 con 0x7f9500154ee0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9506c76640 1 -- 172.21.15.172:0/1719076347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95001560a0 con 0x7f9500154ee0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f94fd7fa640 1 -- 172.21.15.172:0/1719076347 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f800aa90 con 0x7f9500154ee0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.109+0000 7f9506c76640 1 -- 172.21.15.172:0/1719076347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9500156660 con 0x7f9500154ee0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.110+0000 7f9506c76640 1 -- 172.21.15.172:0/1719076347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9500073990 con 0x7f9500154ee0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.111+0000 7f94fd7fa640 1 -- 172.21.15.172:0/1719076347 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f94f800ac30 con 0x7f9500154ee0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.111+0000 7f94fd7fa640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f94e406b500 0x7f94e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.111+0000 7f94fd7fa640 1 -- 172.21.15.172:0/1719076347 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f94f808a720 con 0x7f9500154ee0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.111+0000 7f9504a12640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f94e406b500 0x7f94e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.111+0000 7f9504a12640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f94e406b500 0x7f94e406d9c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f94f400aac0 tx=0x7f94f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.115+0000 7f94fd7fa640 1 -- 172.21.15.172:0/1719076347 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f94f8058e50 con 0x7f9500154ee0 2024-04-25T08:49:01.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.285+0000 7f9506c76640 1 -- 172.21.15.172:0/1719076347 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f950006e9a0 con 0x7f9500154ee0 2024-04-25T08:49:01.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.286+0000 7f94fd7fa640 1 -- 172.21.15.172:0/1719076347 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16945 (secure 0 0 0) 0x7f94f805cef0 con 0x7f9500154ee0 2024-04-25T08:49:01.277 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:01.277 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":95,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:40.385755+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:48:36.951495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T08:48:37.702925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:01.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 -- 172.21.15.172:0/1719076347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f94e406b500 msgr2=0x7f94e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f94e406b500 0x7f94e406d9c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f94f400aac0 tx=0x7f94f4008040 comp rx=0 tx=0).stop 2024-04-25T08:49:01.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 -- 172.21.15.172:0/1719076347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9500154ee0 msgr2=0x7f950015a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9500154ee0 0x7f950015a000 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f94f800c7b0 tx=0x7f94f800cc70 comp rx=0 tx=0).stop 2024-04-25T08:49:01.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 -- 172.21.15.172:0/1719076347 shutdown_connections 2024-04-25T08:49:01.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f94e406b500 0x7f94e406d9c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9500154ee0 0x7f950015a000 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f95000cfcf0 0x7f95001471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 --2- 172.21.15.172:0/1719076347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f95000ce3c0 0x7f95001579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 -- 172.21.15.172:0/1719076347 >> 172.21.15.172:0/1719076347 conn(0x7f950006abe0 msgr2=0x7f95000cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:01.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 -- 172.21.15.172:0/1719076347 shutdown_connections 2024-04-25T08:49:01.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.288+0000 7f9506c76640 1 -- 172.21.15.172:0/1719076347 wait complete. 2024-04-25T08:49:01.290 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:48:36.951495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:48:37.702925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:49:01.291 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:49:01.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.399+0000 7f833aff5640 1 Processor -- start 2024-04-25T08:49:01.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.399+0000 7f833aff5640 1 -- start start 2024-04-25T08:49:01.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f833aff5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f83340cc4f0 0x7f83340cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f833aff5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83340cdb20 0x7f83340cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f833aff5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f833415b270 0x7f833415b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f833aff5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8334071270 con 0x7f83340cdb20 2024-04-25T08:49:01.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f833aff5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8334072280 con 0x7f83340cc4f0 2024-04-25T08:49:01.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f833aff5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83340714c0 con 0x7f833415b270 2024-04-25T08:49:01.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f8333fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83340cdb20 0x7f83340cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f8333fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83340cdb20 0x7f83340cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50852/0 (socket says 172.21.15.172:50852) 2024-04-25T08:49:01.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f8333fff640 1 -- 172.21.15.172:0/225227317 learned_addr learned my addr 172.21.15.172:0/225227317 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f8339592640 1 --2- 172.21.15.172:0/225227317 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f833415b270 0x7f833415b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f8338d91640 1 --2- 172.21.15.172:0/225227317 >> v2:172.21.15.186:3300/0 conn(0x7f83340cc4f0 0x7f83340cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f8333fff640 1 -- 172.21.15.172:0/225227317 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f833415b270 msgr2=0x7f833415b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f8333fff640 1 --2- 172.21.15.172:0/225227317 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f833415b270 0x7f833415b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f8333fff640 1 -- 172.21.15.172:0/225227317 >> v2:172.21.15.186:3300/0 conn(0x7f83340cc4f0 msgr2=0x7f83340cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f8333fff640 1 --2- 172.21.15.172:0/225227317 >> v2:172.21.15.186:3300/0 conn(0x7f83340cc4f0 0x7f83340cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.400+0000 7f8333fff640 1 -- 172.21.15.172:0/225227317 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83340717a0 con 0x7f83340cdb20 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.401+0000 7f8333fff640 1 --2- 172.21.15.172:0/225227317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83340cdb20 0x7f83340cdfb0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f83340cd290 tx=0x7f832802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee4c5089ef70e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.401+0000 7f83337fe640 1 -- 172.21.15.172:0/225227317 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328037070 con 0x7f83340cdb20 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.401+0000 7f83337fe640 1 -- 172.21.15.172:0/225227317 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8328032440 con 0x7f83340cdb20 2024-04-25T08:49:01.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.401+0000 7f83337fe640 1 -- 172.21.15.172:0/225227317 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8328032810 con 0x7f83340cdb20 2024-04-25T08:49:01.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.402+0000 7f833aff5640 1 -- 172.21.15.172:0/225227317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83340cdb20 msgr2=0x7f83340cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.402+0000 7f833aff5640 1 --2- 172.21.15.172:0/225227317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83340cdb20 0x7f83340cdfb0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f83340cd290 tx=0x7f832802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.402+0000 7f833aff5640 1 -- 172.21.15.172:0/225227317 shutdown_connections 2024-04-25T08:49:01.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.402+0000 7f833aff5640 1 --2- 172.21.15.172:0/225227317 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f833415b270 0x7f833415b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.402+0000 7f833aff5640 1 --2- 172.21.15.172:0/225227317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83340cdb20 0x7f83340cdfb0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.402+0000 7f833aff5640 1 --2- 172.21.15.172:0/225227317 >> v2:172.21.15.186:3300/0 conn(0x7f83340cc4f0 0x7f83340cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.402+0000 7f833aff5640 1 -- 172.21.15.172:0/225227317 >> 172.21.15.172:0/225227317 conn(0x7f833406abe0 msgr2=0x7f833406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:01.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.402+0000 7f833aff5640 1 -- 172.21.15.172:0/225227317 shutdown_connections 2024-04-25T08:49:01.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.402+0000 7f833aff5640 1 -- 172.21.15.172:0/225227317 wait complete. 2024-04-25T08:49:01.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.403+0000 7f833aff5640 1 Processor -- start 2024-04-25T08:49:01.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.403+0000 7f833aff5640 1 -- start start 2024-04-25T08:49:01.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f833aff5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83340cc4f0 0x7f833413dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f833aff5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83340cdb20 0x7f833413f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f833aff5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f833415b270 0x7f833406d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f833aff5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833415bc00 con 0x7f833415b270 2024-04-25T08:49:01.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f833aff5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8334071d60 con 0x7f83340cc4f0 2024-04-25T08:49:01.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f833aff5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833415bd80 con 0x7f83340cdb20 2024-04-25T08:49:01.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8339592640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f833415b270 0x7f833406d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8339592640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f833415b270 0x7f833406d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50856/0 (socket says 172.21.15.172:50856) 2024-04-25T08:49:01.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8339592640 1 -- 172.21.15.172:0/1349607546 learned_addr learned my addr 172.21.15.172:0/1349607546 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:01.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8333fff640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83340cdb20 0x7f833413f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8338d91640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83340cc4f0 0x7f833413dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8339592640 1 -- 172.21.15.172:0/1349607546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83340cdb20 msgr2=0x7f833413f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8339592640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83340cdb20 0x7f833413f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8339592640 1 -- 172.21.15.172:0/1349607546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83340cc4f0 msgr2=0x7f833413dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8339592640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83340cc4f0 0x7f833413dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8339592640 1 -- 172.21.15.172:0/1349607546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833413e420 con 0x7f833415b270 2024-04-25T08:49:01.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.404+0000 7f8339592640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f833415b270 0x7f833406d890 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f832400c820 tx=0x7f832400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.405+0000 7f83317fa640 1 -- 172.21.15.172:0/1349607546 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324015070 con 0x7f833415b270 2024-04-25T08:49:01.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.405+0000 7f83317fa640 1 -- 172.21.15.172:0/1349607546 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8324004020 con 0x7f833415b270 2024-04-25T08:49:01.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.405+0000 7f83317fa640 1 -- 172.21.15.172:0/1349607546 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324004410 con 0x7f833415b270 2024-04-25T08:49:01.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.405+0000 7f833aff5640 1 -- 172.21.15.172:0/1349607546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83341562e0 con 0x7f833415b270 2024-04-25T08:49:01.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.405+0000 7f833aff5640 1 -- 172.21.15.172:0/1349607546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833413ead0 con 0x7f833415b270 2024-04-25T08:49:01.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.406+0000 7f833aff5640 1 -- 172.21.15.172:0/1349607546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8334073a00 con 0x7f833415b270 2024-04-25T08:49:01.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.406+0000 7f83317fa640 1 -- 172.21.15.172:0/1349607546 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8324007830 con 0x7f833415b270 2024-04-25T08:49:01.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.406+0000 7f83317fa640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b500 0x7f832006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.407+0000 7f83317fa640 1 -- 172.21.15.172:0/1349607546 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f832408a190 con 0x7f833415b270 2024-04-25T08:49:01.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.407+0000 7f8338d91640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b500 0x7f832006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.407+0000 7f8338d91640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b500 0x7f832006d9c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f832c0070b0 tx=0x7f832c007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.411+0000 7f83317fa640 1 -- 172.21.15.172:0/1349607546 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8324058e80 con 0x7f833415b270 2024-04-25T08:49:01.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.582+0000 7f833aff5640 1 -- 172.21.15.172:0/1349607546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f833406d3a0 con 0x7f833415b270 2024-04-25T08:49:01.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.583+0000 7f83317fa640 1 -- 172.21.15.172:0/1349607546 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8324058780 con 0x7f833415b270 2024-04-25T08:49:01.574 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:49:01.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 -- 172.21.15.172:0/1349607546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b500 msgr2=0x7f832006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b500 0x7f832006d9c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f832c0070b0 tx=0x7f832c007040 comp rx=0 tx=0).stop 2024-04-25T08:49:01.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 -- 172.21.15.172:0/1349607546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f833415b270 msgr2=0x7f833406d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f833415b270 0x7f833406d890 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f832400c820 tx=0x7f832400cce0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.576 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 -- 172.21.15.172:0/1349607546 shutdown_connections 2024-04-25T08:49:01.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f832006b500 0x7f832006d9c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f833415b270 0x7f833406d890 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83340cdb20 0x7f833413f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 --2- 172.21.15.172:0/1349607546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83340cc4f0 0x7f833413dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 -- 172.21.15.172:0/1349607546 >> 172.21.15.172:0/1349607546 conn(0x7f833406abe0 msgr2=0x7f833406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:01.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 -- 172.21.15.172:0/1349607546 shutdown_connections 2024-04-25T08:49:01.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.585+0000 7f833aff5640 1 -- 172.21.15.172:0/1349607546 wait complete. 2024-04-25T08:49:01.587 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:49:01.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.696+0000 7f29f74cd640 1 Processor -- start 2024-04-25T08:49:01.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.697+0000 7f29f74cd640 1 -- start start 2024-04-25T08:49:01.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.697+0000 7f29f74cd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f29f015dc20 0x7f29f00ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.697+0000 7f29f74cd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f29f00d32f0 0x7f29f00cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f74cd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f015e000 con 0x7f29f0161710 2024-04-25T08:49:01.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f74cd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f00d1de0 con 0x7f29f00d32f0 2024-04-25T08:49:01.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f74cd640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f0161c60 con 0x7f29f015dc20 2024-04-25T08:49:01.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f5a6a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f29f00d32f0 0x7f29f00cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f5a6a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f29f00d32f0 0x7f29f00cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50872/0 (socket says 172.21.15.172:50872) 2024-04-25T08:49:01.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f5a6a640 1 -- 172.21.15.172:0/3122380277 learned_addr learned my addr 172.21.15.172:0/3122380277 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:01.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f4a68640 1 --1- 172.21.15.172:0/3122380277 >> v1:172.21.15.172:6789/0 conn(0x7f29f0161710 0x7f29f006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:36434/0 (socket says 172.21.15.172:36434) 2024-04-25T08:49:01.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f5269640 1 --2- 172.21.15.172:0/3122380277 >> v2:172.21.15.186:3300/0 conn(0x7f29f015dc20 0x7f29f00ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f5a6a640 1 -- 172.21.15.172:0/3122380277 >> v2:172.21.15.186:3300/0 conn(0x7f29f015dc20 msgr2=0x7f29f00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:01.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f5a6a640 1 --2- 172.21.15.172:0/3122380277 >> v2:172.21.15.186:3300/0 conn(0x7f29f015dc20 0x7f29f00ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f5a6a640 1 -- 172.21.15.172:0/3122380277 >> v1:172.21.15.172:6789/0 conn(0x7f29f0161710 legacy=0x7f29f006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29e3fff640 1 -- 172.21.15.172:0/3122380277 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997524196 0 0) 0x7f29f015e000 con 0x7f29f0161710 2024-04-25T08:49:01.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.698+0000 7f29f5a6a640 1 -- 172.21.15.172:0/3122380277 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f0161f40 con 0x7f29f00d32f0 2024-04-25T08:49:01.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29f5a6a640 1 --2- 172.21.15.172:0/3122380277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f00d32f0 0x7f29f00cebb0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f29f00d1520 tx=0x7f29e802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d66538b9c5d7fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29e3fff640 1 -- 172.21.15.172:0/3122380277 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8036070 con 0x7f29f00d32f0 2024-04-25T08:49:01.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29e3fff640 1 -- 172.21.15.172:0/3122380277 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e8031600 con 0x7f29f00d32f0 2024-04-25T08:49:01.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29e3fff640 1 -- 172.21.15.172:0/3122380277 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e80319d0 con 0x7f29f00d32f0 2024-04-25T08:49:01.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29f74cd640 1 -- 172.21.15.172:0/3122380277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f00d32f0 msgr2=0x7f29f00cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29f74cd640 1 --2- 172.21.15.172:0/3122380277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f00d32f0 0x7f29f00cebb0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f29f00d1520 tx=0x7f29e802a730 comp rx=0 tx=0).stop 2024-04-25T08:49:01.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29f74cd640 1 -- 172.21.15.172:0/3122380277 shutdown_connections 2024-04-25T08:49:01.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29f74cd640 1 --2- 172.21.15.172:0/3122380277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f00d32f0 0x7f29f00cebb0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29f74cd640 1 --2- 172.21.15.172:0/3122380277 >> v2:172.21.15.186:3300/0 conn(0x7f29f015dc20 0x7f29f00ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29f74cd640 1 -- 172.21.15.172:0/3122380277 >> 172.21.15.172:0/3122380277 conn(0x7f29f00d0420 msgr2=0x7f29f00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:01.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29f74cd640 1 -- 172.21.15.172:0/3122380277 shutdown_connections 2024-04-25T08:49:01.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.699+0000 7f29f74cd640 1 -- 172.21.15.172:0/3122380277 wait complete. 2024-04-25T08:49:01.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f74cd640 1 Processor -- start 2024-04-25T08:49:01.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f74cd640 1 -- start start 2024-04-25T08:49:01.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f74cd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29f00d32f0 0x7f29f01f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f74cd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f015dc20 0x7f29f01f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f74cd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0161710 0x7f29f01f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f74cd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f00b5e50 con 0x7f29f0161710 2024-04-25T08:49:01.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f74cd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0162500 con 0x7f29f015dc20 2024-04-25T08:49:01.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f74cd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f00b5fd0 con 0x7f29f00d32f0 2024-04-25T08:49:01.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f5a6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0161710 0x7f29f01f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f5a6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0161710 0x7f29f01f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50874/0 (socket says 172.21.15.172:50874) 2024-04-25T08:49:01.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.701+0000 7f29f5a6a640 1 -- 172.21.15.172:0/3520858685 learned_addr learned my addr 172.21.15.172:0/3520858685 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29f4a68640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f015dc20 0x7f29f01f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29f5269640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29f00d32f0 0x7f29f01f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29f5a6a640 1 -- 172.21.15.172:0/3520858685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29f00d32f0 msgr2=0x7f29f01f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29f5a6a640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29f00d32f0 0x7f29f01f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29f5a6a640 1 -- 172.21.15.172:0/3520858685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f015dc20 msgr2=0x7f29f01f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29f5a6a640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f015dc20 0x7f29f01f72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29f5a6a640 1 -- 172.21.15.172:0/3520858685 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f0150210 con 0x7f29f0161710 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29f5a6a640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0161710 0x7f29f01f25c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f29e8034040 tx=0x7f29e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29e1ffb640 1 -- 172.21.15.172:0/3520858685 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8041020 con 0x7f29f0161710 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29e1ffb640 1 -- 172.21.15.172:0/3520858685 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e8037040 con 0x7f29f0161710 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29f74cd640 1 -- 172.21.15.172:0/3520858685 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f00aa8f0 con 0x7f29f0161710 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29e1ffb640 1 -- 172.21.15.172:0/3520858685 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8036050 con 0x7f29f0161710 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.702+0000 7f29f74cd640 1 -- 172.21.15.172:0/3520858685 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f00cb9e0 con 0x7f29f0161710 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.703+0000 7f29f74cd640 1 -- 172.21.15.172:0/3520858685 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f0073a00 con 0x7f29f0161710 2024-04-25T08:49:01.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.704+0000 7f29e1ffb640 1 -- 172.21.15.172:0/3520858685 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f29e8007c30 con 0x7f29f0161710 2024-04-25T08:49:01.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.704+0000 7f29e1ffb640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f29d406b4d0 0x7f29d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.704+0000 7f29e1ffb640 1 -- 172.21.15.172:0/3520858685 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f29e80aa9f0 con 0x7f29f0161710 2024-04-25T08:49:01.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.704+0000 7f29f5269640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f29d406b4d0 0x7f29d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.704+0000 7f29f5269640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f29d406b4d0 0x7f29d406d990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f29ec006fd0 tx=0x7f29ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.708+0000 7f29e1ffb640 1 -- 172.21.15.172:0/3520858685 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29e804b060 con 0x7f29f0161710 2024-04-25T08:49:01.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.877+0000 7f29f74cd640 1 -- 172.21.15.172:0/3520858685 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29f00d0ba0 con 0x7f29f0161710 2024-04-25T08:49:01.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.878+0000 7f29e1ffb640 1 -- 172.21.15.172:0/3520858685 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29e80aa0a0 con 0x7f29f0161710 2024-04-25T08:49:01.869 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:49:01.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.879+0000 7f29f74cd640 1 -- 172.21.15.172:0/3520858685 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f29d406b4d0 msgr2=0x7f29d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.879+0000 7f29f74cd640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f29d406b4d0 0x7f29d406d990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f29ec006fd0 tx=0x7f29ec008040 comp rx=0 tx=0).stop 2024-04-25T08:49:01.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.879+0000 7f29f74cd640 1 -- 172.21.15.172:0/3520858685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0161710 msgr2=0x7f29f01f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.879+0000 7f29f74cd640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0161710 0x7f29f01f25c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f29e8034040 tx=0x7f29e8004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:01.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.880+0000 7f29f74cd640 1 -- 172.21.15.172:0/3520858685 shutdown_connections 2024-04-25T08:49:01.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.880+0000 7f29f74cd640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f29d406b4d0 0x7f29d406d990 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.880+0000 7f29f74cd640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29f015dc20 0x7f29f01f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.880+0000 7f29f74cd640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29f0161710 0x7f29f01f25c0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.880+0000 7f29f74cd640 1 --2- 172.21.15.172:0/3520858685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29f00d32f0 0x7f29f01f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.880+0000 7f29f74cd640 1 -- 172.21.15.172:0/3520858685 >> 172.21.15.172:0/3520858685 conn(0x7f29f00d0420 msgr2=0x7f29f00b7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:01.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.880+0000 7f29f74cd640 1 -- 172.21.15.172:0/3520858685 shutdown_connections 2024-04-25T08:49:01.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.880+0000 7f29f74cd640 1 -- 172.21.15.172:0/3520858685 wait complete. 2024-04-25T08:49:01.881 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:49:01.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.992+0000 7f21ccde7640 1 Processor -- start 2024-04-25T08:49:01.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.992+0000 7f21ccde7640 1 -- start start 2024-04-25T08:49:01.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.992+0000 7f21ccde7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21c815bb20 0x7f21c80cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.992+0000 7f21ccde7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f21c80d00e0 0x7f21c80ad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.992+0000 7f21ccde7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c80cb190 con 0x7f21c80ccdd0 2024-04-25T08:49:01.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.992+0000 7f21ccde7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80cb470 con 0x7f21c815bb20 2024-04-25T08:49:01.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.992+0000 7f21ccde7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80cb750 con 0x7f21c80d00e0 2024-04-25T08:49:01.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.993+0000 7f21c659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21c815bb20 0x7f21c80cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.993+0000 7f21c659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21c815bb20 0x7f21c80cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50882/0 (socket says 172.21.15.172:50882) 2024-04-25T08:49:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.993+0000 7f21c659c640 1 -- 172.21.15.172:0/101086555 learned_addr learned my addr 172.21.15.172:0/101086555 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.993+0000 7f21c659c640 1 -- 172.21.15.172:0/101086555 >> v2:172.21.15.186:3300/0 conn(0x7f21c80d00e0 msgr2=0x7f21c80ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.993+0000 7f21c659c640 1 --2- 172.21.15.172:0/101086555 >> v2:172.21.15.186:3300/0 conn(0x7f21c80d00e0 0x7f21c80ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.993+0000 7f21c659c640 1 -- 172.21.15.172:0/101086555 >> v1:172.21.15.186:6789/0 conn(0x7f21c80ccdd0 legacy=0x7f21c80cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.993+0000 7f21c659c640 1 -- 172.21.15.172:0/101086555 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c80cba30 con 0x7f21c815bb20 2024-04-25T08:49:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21c659c640 1 --2- 172.21.15.172:0/101086555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c815bb20 0x7f21c80cc230 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f21c80af5d0 tx=0x7f21b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6268817aec78ca18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21c5d9b640 1 -- 172.21.15.172:0/101086555 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8037070 con 0x7f21c815bb20 2024-04-25T08:49:01.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21c5d9b640 1 -- 172.21.15.172:0/101086555 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8032440 con 0x7f21c815bb20 2024-04-25T08:49:01.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21c5d9b640 1 -- 172.21.15.172:0/101086555 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8032810 con 0x7f21c815bb20 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21ccde7640 1 -- 172.21.15.172:0/101086555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c815bb20 msgr2=0x7f21c80cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21ccde7640 1 --2- 172.21.15.172:0/101086555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c815bb20 0x7f21c80cc230 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f21c80af5d0 tx=0x7f21b802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21ccde7640 1 -- 172.21.15.172:0/101086555 shutdown_connections 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21ccde7640 1 --2- 172.21.15.172:0/101086555 >> v2:172.21.15.186:3300/0 conn(0x7f21c80d00e0 0x7f21c80ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21ccde7640 1 --2- 172.21.15.172:0/101086555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c815bb20 0x7f21c80cc230 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21ccde7640 1 -- 172.21.15.172:0/101086555 >> 172.21.15.172:0/101086555 conn(0x7f21c80b2390 msgr2=0x7f21c80b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21ccde7640 1 -- 172.21.15.172:0/101086555 shutdown_connections 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.994+0000 7f21ccde7640 1 -- 172.21.15.172:0/101086555 wait complete. 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21ccde7640 1 Processor -- start 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21ccde7640 1 -- start start 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21ccde7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c80ccdd0 0x7f21c81479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21ccde7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21c80d00e0 0x7f21c80b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21ccde7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21c815bb20 0x7f21c81451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21ccde7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c815bf00 con 0x7f21c80ccdd0 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21ccde7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80cc770 con 0x7f21c815bb20 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21ccde7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c815c080 con 0x7f21c80d00e0 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21c659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c80ccdd0 0x7f21c81479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21c659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c80ccdd0 0x7f21c81479f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50898/0 (socket says 172.21.15.172:50898) 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.996+0000 7f21c659c640 1 -- 172.21.15.172:0/916393585 learned_addr learned my addr 172.21.15.172:0/916393585 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21bffff640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21c80d00e0 0x7f21c80b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21c659c640 1 -- 172.21.15.172:0/916393585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21c80d00e0 msgr2=0x7f21c80b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21c6d9d640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21c815bb20 0x7f21c81451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21c659c640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21c80d00e0 0x7f21c80b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21c659c640 1 -- 172.21.15.172:0/916393585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21c815bb20 msgr2=0x7f21c81451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21c659c640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21c815bb20 0x7f21c81451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21c659c640 1 -- 172.21.15.172:0/916393585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8148950 con 0x7f21c80ccdd0 2024-04-25T08:49:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21c659c640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c80ccdd0 0x7f21c81479f0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f21b8000c00 tx=0x7f21b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21beffd640 1 -- 172.21.15.172:0/916393585 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8041070 con 0x7f21c80ccdd0 2024-04-25T08:49:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21beffd640 1 -- 172.21.15.172:0/916393585 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b803c870 con 0x7f21c80ccdd0 2024-04-25T08:49:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21ccde7640 1 -- 172.21.15.172:0/916393585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c81480b0 con 0x7f21c80ccdd0 2024-04-25T08:49:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21beffd640 1 -- 172.21.15.172:0/916393585 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8037040 con 0x7f21c80ccdd0 2024-04-25T08:49:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.997+0000 7f21ccde7640 1 -- 172.21.15.172:0/916393585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c8148670 con 0x7f21c80ccdd0 2024-04-25T08:49:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.998+0000 7f21ccde7640 1 -- 172.21.15.172:0/916393585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c8067be0 con 0x7f21c80ccdd0 2024-04-25T08:49:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.998+0000 7f21beffd640 1 -- 172.21.15.172:0/916393585 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f21b8044070 con 0x7f21c80ccdd0 2024-04-25T08:49:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.999+0000 7f21beffd640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21a806b500 0x7f21a806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.999+0000 7f21beffd640 1 -- 172.21.15.172:0/916393585 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f21b80aaed0 con 0x7f21c80ccdd0 2024-04-25T08:49:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.999+0000 7f21bffff640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21a806b500 0x7f21a806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:01.999+0000 7f21bffff640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21a806b500 0x7f21a806d9c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f21c81f7320 tx=0x7f21b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.003+0000 7f21beffd640 1 -- 172.21.15.172:0/916393585 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f21c8067be0 con 0x7f21c80ccdd0 2024-04-25T08:49:02.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.175+0000 7f21ccde7640 1 -- 172.21.15.172:0/916393585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21c80b1dc0 con 0x7f21c80ccdd0 2024-04-25T08:49:02.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.176+0000 7f21beffd640 1 -- 172.21.15.172:0/916393585 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21b8079c50 con 0x7f21c80ccdd0 2024-04-25T08:49:02.167 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:49:02.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.177+0000 7f21ccde7640 1 -- 172.21.15.172:0/916393585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21a806b500 msgr2=0x7f21a806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:02.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21a806b500 0x7f21a806d9c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f21c81f7320 tx=0x7f21b0009040 comp rx=0 tx=0).stop 2024-04-25T08:49:02.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 -- 172.21.15.172:0/916393585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c80ccdd0 msgr2=0x7f21c81479f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:02.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c80ccdd0 0x7f21c81479f0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f21b8000c00 tx=0x7f21b80046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 -- 172.21.15.172:0/916393585 shutdown_connections 2024-04-25T08:49:02.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21a806b500 0x7f21a806d9c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21c815bb20 0x7f21c81451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21c80d00e0 0x7f21c80b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 --2- 172.21.15.172:0/916393585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21c80ccdd0 0x7f21c81479f0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 -- 172.21.15.172:0/916393585 >> 172.21.15.172:0/916393585 conn(0x7f21c80b2390 msgr2=0x7f21c806e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 -- 172.21.15.172:0/916393585 shutdown_connections 2024-04-25T08:49:02.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.178+0000 7f21ccde7640 1 -- 172.21.15.172:0/916393585 wait complete. 2024-04-25T08:49:02.180 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:49:02.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.288+0000 7f19dc31d640 1 Processor -- start 2024-04-25T08:49:02.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.288+0000 7f19dc31d640 1 -- start start 2024-04-25T08:49:02.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.289+0000 7f19dc31d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d415bb50 0x7f19d40c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:02.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.289+0000 7f19dc31d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d40c75e0 con 0x7f19d40cfd10 2024-04-25T08:49:02.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.289+0000 7f19dc31d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d40c78c0 con 0x7f19d40c70d0 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.289+0000 7f19dc31d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40c8680 con 0x7f19d415bb50 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.289+0000 7f19da8ba640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f19d40cfd10 0x7f19d40cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:36438/0 (socket says 172.21.15.172:36438) 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.290+0000 7f19da8ba640 1 -- 172.21.15.172:0/3255116134 learned_addr learned my addr 172.21.15.172:0/3255116134 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.290+0000 7f19da0b9640 1 --2- 172.21.15.172:0/3255116134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d415bb50 0x7f19d40c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.290+0000 7f19d90b7640 1 -- 172.21.15.172:0/3255116134 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711488240 0 0) 0x7f19d40c75e0 con 0x7f19d40cfd10 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.290+0000 7f19d90b7640 1 -- 172.21.15.172:0/3255116134 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c0003520 con 0x7f19d40cfd10 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.290+0000 7f19d90b7640 1 -- 172.21.15.172:0/3255116134 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786358037 0 0) 0x7f19d40c78c0 con 0x7f19d40c70d0 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.290+0000 7f19d90b7640 1 -- 172.21.15.172:0/3255116134 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d40c75e0 con 0x7f19d40c70d0 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.290+0000 7f19da0b9640 1 -- 172.21.15.172:0/3255116134 >> v1:172.21.15.186:6789/0 conn(0x7f19d40c70d0 legacy=0x7f19d40cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.290+0000 7f19da0b9640 1 -- 172.21.15.172:0/3255116134 >> v1:172.21.15.172:6789/0 conn(0x7f19d40cfd10 legacy=0x7f19d40cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.290+0000 7f19da0b9640 1 -- 172.21.15.172:0/3255116134 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d40c7ba0 con 0x7f19d415bb50 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.291+0000 7f19da0b9640 1 --2- 172.21.15.172:0/3255116134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d415bb50 0x7f19d40c6b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f19d00097d0 tx=0x7f19d002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=879245fd8a1b4a62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.291+0000 7f19d90b7640 1 -- 172.21.15.172:0/3255116134 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0037070 con 0x7f19d415bb50 2024-04-25T08:49:02.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.291+0000 7f19d90b7640 1 -- 172.21.15.172:0/3255116134 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0032440 con 0x7f19d415bb50 2024-04-25T08:49:02.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.291+0000 7f19d90b7640 1 -- 172.21.15.172:0/3255116134 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d00327f0 con 0x7f19d415bb50 2024-04-25T08:49:02.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.291+0000 7f19dc31d640 1 -- 172.21.15.172:0/3255116134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d415bb50 msgr2=0x7f19d40c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:02.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.291+0000 7f19dc31d640 1 --2- 172.21.15.172:0/3255116134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d415bb50 0x7f19d40c6b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f19d00097d0 tx=0x7f19d002a290 comp rx=0 tx=0).stop 2024-04-25T08:49:02.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.292+0000 7f19dc31d640 1 -- 172.21.15.172:0/3255116134 shutdown_connections 2024-04-25T08:49:02.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.292+0000 7f19dc31d640 1 --2- 172.21.15.172:0/3255116134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d415bb50 0x7f19d40c6b90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.292+0000 7f19dc31d640 1 -- 172.21.15.172:0/3255116134 >> 172.21.15.172:0/3255116134 conn(0x7f19d406f500 msgr2=0x7f19d406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:02.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.292+0000 7f19dc31d640 1 -- 172.21.15.172:0/3255116134 shutdown_connections 2024-04-25T08:49:02.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.292+0000 7f19dc31d640 1 -- 172.21.15.172:0/3255116134 wait complete. 2024-04-25T08:49:02.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.293+0000 7f19dc31d640 1 Processor -- start 2024-04-25T08:49:02.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.293+0000 7f19dc31d640 1 -- start start 2024-04-25T08:49:02.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.293+0000 7f19dc31d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d40c70d0 0x7f19d41423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:02.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.293+0000 7f19dc31d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19d40cfd10 0x7f19d40b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:02.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19dc31d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19d415bb50 0x7f19d40b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:02.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19dc31d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d415f6d0 con 0x7f19d415bb50 2024-04-25T08:49:02.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19dc31d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40c8160 con 0x7f19d40cfd10 2024-04-25T08:49:02.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19dc31d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d415f850 con 0x7f19d40c70d0 2024-04-25T08:49:02.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19da8ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19d415bb50 0x7f19d40b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:02.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19da8ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19d415bb50 0x7f19d40b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50914/0 (socket says 172.21.15.172:50914) 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19da8ba640 1 -- 172.21.15.172:0/2032603989 learned_addr learned my addr 172.21.15.172:0/2032603989 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19da0b9640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d40c70d0 0x7f19d41423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19d98b8640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19d40cfd10 0x7f19d40b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19da8ba640 1 -- 172.21.15.172:0/2032603989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d40c70d0 msgr2=0x7f19d41423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19da8ba640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d40c70d0 0x7f19d41423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19da8ba640 1 -- 172.21.15.172:0/2032603989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19d40cfd10 msgr2=0x7f19d40b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19da8ba640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19d40cfd10 0x7f19d40b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19da8ba640 1 -- 172.21.15.172:0/2032603989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d4159b80 con 0x7f19d415bb50 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19da8ba640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19d415bb50 0x7f19d40b5ae0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00cba0 tx=0x7f19cc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19caffd640 1 -- 172.21.15.172:0/2032603989 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc017070 con 0x7f19d415bb50 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19caffd640 1 -- 172.21.15.172:0/2032603989 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc00ace0 con 0x7f19d415bb50 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19dc31d640 1 -- 172.21.15.172:0/2032603989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d4159e60 con 0x7f19d415bb50 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19caffd640 1 -- 172.21.15.172:0/2032603989 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc012620 con 0x7f19d415bb50 2024-04-25T08:49:02.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.294+0000 7f19dc31d640 1 -- 172.21.15.172:0/2032603989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d40c88f0 con 0x7f19d415bb50 2024-04-25T08:49:02.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.296+0000 7f19dc31d640 1 -- 172.21.15.172:0/2032603989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d4073a00 con 0x7f19d415bb50 2024-04-25T08:49:02.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.296+0000 7f19caffd640 1 -- 172.21.15.172:0/2032603989 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f19cc01a070 con 0x7f19d415bb50 2024-04-25T08:49:02.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.296+0000 7f19caffd640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f19b806b500 0x7f19b806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:02.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.296+0000 7f19da0b9640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f19b806b500 0x7f19b806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:02.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.296+0000 7f19caffd640 1 -- 172.21.15.172:0/2032603989 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f19cc08a0f0 con 0x7f19d415bb50 2024-04-25T08:49:02.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.297+0000 7f19da0b9640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f19b806b500 0x7f19b806d9c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f19d0034000 tx=0x7f19d002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:02.291 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.301+0000 7f19caffd640 1 -- 172.21.15.172:0/2032603989 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f19cc058790 con 0x7f19d415bb50 2024-04-25T08:49:02.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.484+0000 7f19dc31d640 1 -- 172.21.15.172:0/2032603989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f19d40cf150 con 0x7f19d415bb50 2024-04-25T08:49:02.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.484+0000 7f19caffd640 1 -- 172.21.15.172:0/2032603989 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v95) v1 ==== 80+0+0 (secure 0 0 0) 0x7f19cc05c830 con 0x7f19d415bb50 2024-04-25T08:49:02.475 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:49:02.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 -- 172.21.15.172:0/2032603989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f19b806b500 msgr2=0x7f19b806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f19b806b500 0x7f19b806d9c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f19d0034000 tx=0x7f19d002e000 comp rx=0 tx=0).stop 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 -- 172.21.15.172:0/2032603989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19d415bb50 msgr2=0x7f19d40b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19d415bb50 0x7f19d40b5ae0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00cba0 tx=0x7f19cc00a430 comp rx=0 tx=0).stop 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 -- 172.21.15.172:0/2032603989 shutdown_connections 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f19b806b500 0x7f19b806d9c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19d40cfd10 0x7f19d40b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19d415bb50 0x7f19d40b5ae0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 --2- 172.21.15.172:0/2032603989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f19d40c70d0 0x7f19d41423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 -- 172.21.15.172:0/2032603989 >> 172.21.15.172:0/2032603989 conn(0x7f19d406f500 msgr2=0x7f19d40ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.486+0000 7f19dc31d640 1 -- 172.21.15.172:0/2032603989 shutdown_connections 2024-04-25T08:49:02.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:02.487+0000 7f19dc31d640 1 -- 172.21.15.172:0/2032603989 wait complete. 2024-04-25T08:49:02.488 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:49:02.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:02.488 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:49:03.114 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:49:03.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:03.114 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:49:03.130 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:49:03.130 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:03.145 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:49:03.145 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:03.145 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:03.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:49:03.185 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:49:03.185 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:03.203 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:49:03.203 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:03.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.331+0000 7fcfda64d640 1 Processor -- start 2024-04-25T08:49:03.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.331+0000 7fcfda64d640 1 -- start start 2024-04-25T08:49:03.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.331+0000 7fcfda64d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcfd413d190 0x7fcfd40cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.331+0000 7fcfda64d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd4071ed0 con 0x7fcfd415b320 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.331+0000 7fcfda64d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd415a840 con 0x7fcfd4071940 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.331+0000 7fcfda64d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd413d570 con 0x7fcfd413d190 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.332+0000 7fcfd37fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcfd415b320 0x7fcfd4071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:36442/0 (socket says 172.21.15.172:36442) 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.332+0000 7fcfd37fe640 1 -- 172.21.15.172:0/4010067228 learned_addr learned my addr 172.21.15.172:0/4010067228 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.332+0000 7fcfd3fff640 1 --2- 172.21.15.172:0/4010067228 >> v2:172.21.15.186:3300/0 conn(0x7fcfd413d190 0x7fcfd40cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.332+0000 7fcfd2ffd640 1 -- 172.21.15.172:0/4010067228 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167311412 0 0) 0x7fcfd4071ed0 con 0x7fcfd415b320 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.332+0000 7fcfd2ffd640 1 -- 172.21.15.172:0/4010067228 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc0003520 con 0x7fcfd415b320 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.332+0000 7fcfd2ffd640 1 -- 172.21.15.172:0/4010067228 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603732025 0 0) 0x7fcfd415a840 con 0x7fcfd4071940 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.332+0000 7fcfd2ffd640 1 -- 172.21.15.172:0/4010067228 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfd4071ed0 con 0x7fcfd4071940 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.332+0000 7fcfd3fff640 1 -- 172.21.15.172:0/4010067228 >> v1:172.21.15.186:6789/0 conn(0x7fcfd4071940 legacy=0x7fcfd415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.332+0000 7fcfd3fff640 1 -- 172.21.15.172:0/4010067228 >> v1:172.21.15.172:6789/0 conn(0x7fcfd415b320 legacy=0x7fcfd4071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.332+0000 7fcfd3fff640 1 -- 172.21.15.172:0/4010067228 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd415ab20 con 0x7fcfd413d190 2024-04-25T08:49:03.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.333+0000 7fcfd3fff640 1 --2- 172.21.15.172:0/4010067228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd413d190 0x7fcfd40cbfb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0097a0 tx=0x7fcfbc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a7dd56fac997635 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.333+0000 7fcfd2ffd640 1 -- 172.21.15.172:0/4010067228 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc037070 con 0x7fcfd413d190 2024-04-25T08:49:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.333+0000 7fcfd2ffd640 1 -- 172.21.15.172:0/4010067228 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc032440 con 0x7fcfd413d190 2024-04-25T08:49:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.333+0000 7fcfd2ffd640 1 -- 172.21.15.172:0/4010067228 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc0327f0 con 0x7fcfd413d190 2024-04-25T08:49:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.333+0000 7fcfda64d640 1 -- 172.21.15.172:0/4010067228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd413d190 msgr2=0x7fcfd40cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.333+0000 7fcfda64d640 1 --2- 172.21.15.172:0/4010067228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd413d190 0x7fcfd40cbfb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0097a0 tx=0x7fcfbc02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.333+0000 7fcfda64d640 1 -- 172.21.15.172:0/4010067228 shutdown_connections 2024-04-25T08:49:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.333+0000 7fcfda64d640 1 --2- 172.21.15.172:0/4010067228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd413d190 0x7fcfd40cbfb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.333+0000 7fcfda64d640 1 -- 172.21.15.172:0/4010067228 >> 172.21.15.172:0/4010067228 conn(0x7fcfd406abe0 msgr2=0x7fcfd406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.334+0000 7fcfda64d640 1 -- 172.21.15.172:0/4010067228 shutdown_connections 2024-04-25T08:49:03.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.334+0000 7fcfda64d640 1 -- 172.21.15.172:0/4010067228 wait complete. 2024-04-25T08:49:03.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.335+0000 7fcfda64d640 1 Processor -- start 2024-04-25T08:49:03.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.335+0000 7fcfda64d640 1 -- start start 2024-04-25T08:49:03.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.335+0000 7fcfda64d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfd4071940 0x7fcfd40b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.335+0000 7fcfda64d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcfd413d190 0x7fcfd4138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.335+0000 7fcfda64d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd415b320 0x7fcfd406df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.335+0000 7fcfda64d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40cc670 con 0x7fcfd4071940 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.335+0000 7fcfda64d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40cc4f0 con 0x7fcfd415b320 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.335+0000 7fcfda64d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40cc7f0 con 0x7fcfd413d190 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfd4071940 0x7fcfd40b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfd4071940 0x7fcfd40b1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50924/0 (socket says 172.21.15.172:50924) 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd3fff640 1 -- 172.21.15.172:0/1085399382 learned_addr learned my addr 172.21.15.172:0/1085399382 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd8bea640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd415b320 0x7fcfd406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd37fe640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcfd413d190 0x7fcfd4138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd3fff640 1 -- 172.21.15.172:0/1085399382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcfd413d190 msgr2=0x7fcfd4138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd3fff640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcfd413d190 0x7fcfd4138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd3fff640 1 -- 172.21.15.172:0/1085399382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd415b320 msgr2=0x7fcfd406df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd3fff640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd415b320 0x7fcfd406df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd3fff640 1 -- 172.21.15.172:0/1085399382 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4138fe0 con 0x7fcfd4071940 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd37fe640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcfd413d190 0x7fcfd4138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd8bea640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd415b320 0x7fcfd406df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd3fff640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfd4071940 0x7fcfd40b1900 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc000c00 tx=0x7fcfbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd0ff9640 1 -- 172.21.15.172:0/1085399382 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc041030 con 0x7fcfd4071940 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd0ff9640 1 -- 172.21.15.172:0/1085399382 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc03d4e0 con 0x7fcfd4071940 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfda64d640 1 -- 172.21.15.172:0/1085399382 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd41392c0 con 0x7fcfd4071940 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfd0ff9640 1 -- 172.21.15.172:0/1085399382 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc037040 con 0x7fcfd4071940 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.336+0000 7fcfda64d640 1 -- 172.21.15.172:0/1085399382 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd4139880 con 0x7fcfd4071940 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.337+0000 7fcfda64d640 1 -- 172.21.15.172:0/1085399382 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd4073990 con 0x7fcfd4071940 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.338+0000 7fcfd0ff9640 1 -- 172.21.15.172:0/1085399382 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcfbc044070 con 0x7fcfd4071940 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.338+0000 7fcfd0ff9640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcfb406b500 0x7fcfb406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.338+0000 7fcfd0ff9640 1 -- 172.21.15.172:0/1085399382 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcfbc0aa2c0 con 0x7fcfd4071940 2024-04-25T08:49:03.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.338+0000 7fcfd37fe640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcfb406b500 0x7fcfb406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.338+0000 7fcfd37fe640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcfb406b500 0x7fcfb406d9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcfd413ca50 tx=0x7fcfc4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:03.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.342+0000 7fcfd0ff9640 1 -- 172.21.15.172:0/1085399382 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfbc04b020 con 0x7fcfd4071940 2024-04-25T08:49:03.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.554+0000 7fcfda64d640 1 -- 172.21.15.172:0/1085399382 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfd40ce8d0 con 0x7fcfd4071940 2024-04-25T08:49:03.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.554+0000 7fcfd0ff9640 1 -- 172.21.15.172:0/1085399382 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fcfbc030e20 con 0x7fcfd4071940 2024-04-25T08:49:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:03.546 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/154236059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":154236059},{"type":"v1","addr":"172.21.15.172:6837","nonce":154236059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/985041095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":985041095},{"type":"v1","addr":"172.21.15.186:6835","nonce":985041095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7686,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1301700155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1301700155},{"type":"v1","addr":"172.21.15.172:6836","nonce":1301700155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:48:38.741906+0000","modified":"2024-04-25T08:48:40.732152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6834/246475597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":246475597},{"type":"v1","addr":"172.21.15.186:6834","nonce":246475597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:49:03.546 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 56 2024-04-25T08:49:03.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 -- 172.21.15.172:0/1085399382 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcfb406b500 msgr2=0x7fcfb406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcfb406b500 0x7fcfb406d9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcfd413ca50 tx=0x7fcfc4009040 comp rx=0 tx=0).stop 2024-04-25T08:49:03.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 -- 172.21.15.172:0/1085399382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfd4071940 msgr2=0x7fcfd40b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfd4071940 0x7fcfd40b1900 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc000c00 tx=0x7fcfbc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 -- 172.21.15.172:0/1085399382 shutdown_connections 2024-04-25T08:49:03.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcfb406b500 0x7fcfb406d9c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcfd415b320 0x7fcfd406df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcfd413d190 0x7fcfd4138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 --2- 172.21.15.172:0/1085399382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfd4071940 0x7fcfd40b1900 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 -- 172.21.15.172:0/1085399382 >> 172.21.15.172:0/1085399382 conn(0x7fcfd406abe0 msgr2=0x7fcfd4159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:03.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.556+0000 7fcfda64d640 1 -- 172.21.15.172:0/1085399382 shutdown_connections 2024-04-25T08:49:03.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.557+0000 7fcfda64d640 1 -- 172.21.15.172:0/1085399382 wait complete. 2024-04-25T08:49:03.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:03.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.667+0000 7fd28ae1f640 1 Processor -- start 2024-04-25T08:49:03.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.667+0000 7fd28ae1f640 1 -- start start 2024-04-25T08:49:03.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd28ae1f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd284144750 0x7fd28406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd28ae1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 0x7fd2840ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd28ae1f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd284144b30 con 0x7fd2840cee60 2024-04-25T08:49:03.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd28ae1f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2840712d0 con 0x7fd284144750 2024-04-25T08:49:03.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd28ae1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840715b0 con 0x7fd28406eb10 2024-04-25T08:49:03.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd288bbb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd284144750 0x7fd28406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd2893bc640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fd2840cee60 0x7fd28415f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:33314/0 (socket says 172.21.15.172:33314) 2024-04-25T08:49:03.660 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd2893bc640 1 -- 172.21.15.172:0/90035246 learned_addr learned my addr 172.21.15.172:0/90035246 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd283fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 0x7fd2840ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd2837fe640 1 -- 172.21.15.172:0/90035246 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817301682 0 0) 0x7fd284144b30 con 0x7fd2840cee60 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd2837fe640 1 -- 172.21.15.172:0/90035246 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd274003520 con 0x7fd2840cee60 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd288bbb640 1 -- 172.21.15.172:0/90035246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 msgr2=0x7fd2840ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd288bbb640 1 --2- 172.21.15.172:0/90035246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 0x7fd2840ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd288bbb640 1 -- 172.21.15.172:0/90035246 >> v1:172.21.15.186:6789/0 conn(0x7fd2840cee60 legacy=0x7fd28415f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd288bbb640 1 -- 172.21.15.172:0/90035246 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284071890 con 0x7fd284144750 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.668+0000 7fd283fff640 1 --2- 172.21.15.172:0/90035246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 0x7fd2840ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.669+0000 7fd288bbb640 1 --2- 172.21.15.172:0/90035246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd284144750 0x7fd28406e5d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd2780097a0 tx=0x7fd27802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c708ca6f0824adbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.669+0000 7fd2837fe640 1 -- 172.21.15.172:0/90035246 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278037070 con 0x7fd284144750 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.669+0000 7fd2837fe640 1 -- 172.21.15.172:0/90035246 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd278032440 con 0x7fd284144750 2024-04-25T08:49:03.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.669+0000 7fd2837fe640 1 -- 172.21.15.172:0/90035246 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2780327f0 con 0x7fd284144750 2024-04-25T08:49:03.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.670+0000 7fd28ae1f640 1 -- 172.21.15.172:0/90035246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd284144750 msgr2=0x7fd28406e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.670+0000 7fd28ae1f640 1 --2- 172.21.15.172:0/90035246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd284144750 0x7fd28406e5d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd2780097a0 tx=0x7fd27802a180 comp rx=0 tx=0).stop 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.670+0000 7fd28ae1f640 1 -- 172.21.15.172:0/90035246 shutdown_connections 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.670+0000 7fd28ae1f640 1 --2- 172.21.15.172:0/90035246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 0x7fd2840ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.670+0000 7fd28ae1f640 1 --2- 172.21.15.172:0/90035246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd284144750 0x7fd28406e5d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.670+0000 7fd28ae1f640 1 -- 172.21.15.172:0/90035246 >> 172.21.15.172:0/90035246 conn(0x7fd28406abe0 msgr2=0x7fd28406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.670+0000 7fd28ae1f640 1 -- 172.21.15.172:0/90035246 shutdown_connections 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.670+0000 7fd28ae1f640 1 -- 172.21.15.172:0/90035246 wait complete. 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.671+0000 7fd28ae1f640 1 Processor -- start 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.671+0000 7fd28ae1f640 1 -- start start 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd28ae1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 0x7fd2841393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd28ae1f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2840cee60 0x7fd28413cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd28ae1f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd284144750 0x7fd284140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd28ae1f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd284145450 con 0x7fd284144750 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd28ae1f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28406f020 con 0x7fd2840cee60 2024-04-25T08:49:03.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd28ae1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2841455d0 con 0x7fd28406eb10 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd2893bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd284144750 0x7fd284140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd2893bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd284144750 0x7fd284140b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50940/0 (socket says 172.21.15.172:50940) 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd2893bc640 1 -- 172.21.15.172:0/2807048364 learned_addr learned my addr 172.21.15.172:0/2807048364 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd283fff640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2840cee60 0x7fd28413cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd288bbb640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 0x7fd2841393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd2893bc640 1 -- 172.21.15.172:0/2807048364 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 msgr2=0x7fd2841393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd2893bc640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 0x7fd2841393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd2893bc640 1 -- 172.21.15.172:0/2807048364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2840cee60 msgr2=0x7fd28413cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd2893bc640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2840cee60 0x7fd28413cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd2893bc640 1 -- 172.21.15.172:0/2807048364 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284139920 con 0x7fd284144750 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.672+0000 7fd2893bc640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd284144750 0x7fd284140b80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00cb40 tx=0x7fd27c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.673+0000 7fd2817fa640 1 -- 172.21.15.172:0/2807048364 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c017070 con 0x7fd284144750 2024-04-25T08:49:03.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.673+0000 7fd2817fa640 1 -- 172.21.15.172:0/2807048364 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c00ac40 con 0x7fd284144750 2024-04-25T08:49:03.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.673+0000 7fd28ae1f640 1 -- 172.21.15.172:0/2807048364 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2840a8840 con 0x7fd284144750 2024-04-25T08:49:03.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.673+0000 7fd2817fa640 1 -- 172.21.15.172:0/2807048364 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c012620 con 0x7fd284144750 2024-04-25T08:49:03.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.673+0000 7fd28ae1f640 1 -- 172.21.15.172:0/2807048364 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2840a8e00 con 0x7fd284144750 2024-04-25T08:49:03.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.674+0000 7fd28ae1f640 1 -- 172.21.15.172:0/2807048364 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd284073990 con 0x7fd284144750 2024-04-25T08:49:03.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.674+0000 7fd2817fa640 1 -- 172.21.15.172:0/2807048364 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd27c01a070 con 0x7fd284144750 2024-04-25T08:49:03.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.674+0000 7fd2817fa640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd26806b4d0 0x7fd26806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.675+0000 7fd2817fa640 1 -- 172.21.15.172:0/2807048364 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd27c08a160 con 0x7fd284144750 2024-04-25T08:49:03.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.675+0000 7fd288bbb640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd26806b4d0 0x7fd26806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.675+0000 7fd288bbb640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd26806b4d0 0x7fd26806d990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd278034000 tx=0x7fd27802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:03.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.679+0000 7fd2817fa640 1 -- 172.21.15.172:0/2807048364 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd27c058770 con 0x7fd284144750 2024-04-25T08:49:03.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.850+0000 7fd28ae1f640 1 -- 172.21.15.172:0/2807048364 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2840d0510 con 0x7fd284144750 2024-04-25T08:49:03.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.852+0000 7fd2817fa640 1 -- 172.21.15.172:0/2807048364 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16945 (secure 0 0 0) 0x7fd27c05c810 con 0x7fd284144750 2024-04-25T08:49:03.843 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:03.843 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":95,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:40.385755+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:48:36.951495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T08:48:37.702925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:03.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 -- 172.21.15.172:0/2807048364 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd26806b4d0 msgr2=0x7fd26806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd26806b4d0 0x7fd26806d990 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd278034000 tx=0x7fd27802e000 comp rx=0 tx=0).stop 2024-04-25T08:49:03.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 -- 172.21.15.172:0/2807048364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd284144750 msgr2=0x7fd284140b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd284144750 0x7fd284140b80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00cb40 tx=0x7fd27c00a060 comp rx=0 tx=0).stop 2024-04-25T08:49:03.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 -- 172.21.15.172:0/2807048364 shutdown_connections 2024-04-25T08:49:03.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd26806b4d0 0x7fd26806d990 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2840cee60 0x7fd28413cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd284144750 0x7fd284140b80 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 --2- 172.21.15.172:0/2807048364 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28406eb10 0x7fd2841393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 -- 172.21.15.172:0/2807048364 >> 172.21.15.172:0/2807048364 conn(0x7fd28406abe0 msgr2=0x7fd2840ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:03.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 -- 172.21.15.172:0/2807048364 shutdown_connections 2024-04-25T08:49:03.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.854+0000 7fd28ae1f640 1 -- 172.21.15.172:0/2807048364 wait complete. 2024-04-25T08:49:03.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:48:36.951495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:48:37.702925+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:49:03.857 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:49:03.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.967+0000 7fb9185ab640 1 Processor -- start 2024-04-25T08:49:03.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.967+0000 7fb9185ab640 1 -- start start 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb9185ab640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb9100cc4f0 0x7fb9100cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb9185ab640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb9100cdb20 0x7fb9100cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb9185ab640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb910072280 con 0x7fb91015b270 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb9185ab640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb910071270 con 0x7fb9100cc4f0 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb9185ab640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91015bd80 con 0x7fb9100cdb20 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb916347640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb9100cc4f0 0x7fb9100cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb916347640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb9100cc4f0 0x7fb9100cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50952/0 (socket says 172.21.15.172:50952) 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb916347640 1 -- 172.21.15.172:0/3504391532 learned_addr learned my addr 172.21.15.172:0/3504391532 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb915b46640 1 --2- 172.21.15.172:0/3504391532 >> v2:172.21.15.186:3300/0 conn(0x7fb9100cdb20 0x7fb9100cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb916347640 1 -- 172.21.15.172:0/3504391532 >> v2:172.21.15.186:3300/0 conn(0x7fb9100cdb20 msgr2=0x7fb9100cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb916347640 1 --2- 172.21.15.172:0/3504391532 >> v2:172.21.15.186:3300/0 conn(0x7fb9100cdb20 0x7fb9100cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb916347640 1 -- 172.21.15.172:0/3504391532 >> v1:172.21.15.186:6789/0 conn(0x7fb91015b270 legacy=0x7fb91015b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:03.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.968+0000 7fb916347640 1 -- 172.21.15.172:0/3504391532 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9100714c0 con 0x7fb9100cc4f0 2024-04-25T08:49:03.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.969+0000 7fb916347640 1 --2- 172.21.15.172:0/3504391532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cc4f0 0x7fb9100cc8d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fb910158aa0 tx=0x7fb90c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a4cc002a07938d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:03.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.969+0000 7fb915345640 1 -- 172.21.15.172:0/3504391532 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c037070 con 0x7fb9100cc4f0 2024-04-25T08:49:03.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.969+0000 7fb915345640 1 -- 172.21.15.172:0/3504391532 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c032440 con 0x7fb9100cc4f0 2024-04-25T08:49:03.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.969+0000 7fb915345640 1 -- 172.21.15.172:0/3504391532 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c032810 con 0x7fb9100cc4f0 2024-04-25T08:49:03.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.969+0000 7fb9185ab640 1 -- 172.21.15.172:0/3504391532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cc4f0 msgr2=0x7fb9100cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.969+0000 7fb9185ab640 1 --2- 172.21.15.172:0/3504391532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cc4f0 0x7fb9100cc8d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fb910158aa0 tx=0x7fb90c02a230 comp rx=0 tx=0).stop 2024-04-25T08:49:03.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.970+0000 7fb9185ab640 1 -- 172.21.15.172:0/3504391532 shutdown_connections 2024-04-25T08:49:03.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.970+0000 7fb9185ab640 1 --2- 172.21.15.172:0/3504391532 >> v2:172.21.15.186:3300/0 conn(0x7fb9100cdb20 0x7fb9100cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.970+0000 7fb9185ab640 1 --2- 172.21.15.172:0/3504391532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cc4f0 0x7fb9100cc8d0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.970+0000 7fb9185ab640 1 -- 172.21.15.172:0/3504391532 >> 172.21.15.172:0/3504391532 conn(0x7fb91006abe0 msgr2=0x7fb91006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:03.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.970+0000 7fb9185ab640 1 -- 172.21.15.172:0/3504391532 shutdown_connections 2024-04-25T08:49:03.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.970+0000 7fb9185ab640 1 -- 172.21.15.172:0/3504391532 wait complete. 2024-04-25T08:49:03.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.971+0000 7fb9185ab640 1 Processor -- start 2024-04-25T08:49:03.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.971+0000 7fb9185ab640 1 -- start start 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.971+0000 7fb9185ab640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9100cc4f0 0x7fb910140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.971+0000 7fb9185ab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cdb20 0x7fb9101f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb9185ab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91015b270 0x7fb9101f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb9185ab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910071d60 con 0x7fb9100cdb20 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb9185ab640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910071a80 con 0x7fb9100cc4f0 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb9185ab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9100ae500 con 0x7fb91015b270 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb915b46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cdb20 0x7fb9101f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb915b46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cdb20 0x7fb9101f3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50960/0 (socket says 172.21.15.172:50960) 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb915b46640 1 -- 172.21.15.172:0/264560214 learned_addr learned my addr 172.21.15.172:0/264560214 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb916347640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9100cc4f0 0x7fb910140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb916b48640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91015b270 0x7fb9101f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb915b46640 1 -- 172.21.15.172:0/264560214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91015b270 msgr2=0x7fb9101f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb915b46640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91015b270 0x7fb9101f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb915b46640 1 -- 172.21.15.172:0/264560214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9100cc4f0 msgr2=0x7fb910140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb915b46640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9100cc4f0 0x7fb910140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb915b46640 1 -- 172.21.15.172:0/264560214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910143140 con 0x7fb9100cdb20 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb915b46640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cdb20 0x7fb9101f3ce0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fb90000eac0 tx=0x7fb90000ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb906ffd640 1 -- 172.21.15.172:0/264560214 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900004220 con 0x7fb9100cdb20 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb906ffd640 1 -- 172.21.15.172:0/264560214 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9000043c0 con 0x7fb9100cdb20 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb906ffd640 1 -- 172.21.15.172:0/264560214 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900007bd0 con 0x7fb9100cdb20 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb9185ab640 1 -- 172.21.15.172:0/264560214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9101420a0 con 0x7fb9100cdb20 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.972+0000 7fb9185ab640 1 -- 172.21.15.172:0/264560214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb910142660 con 0x7fb9100cdb20 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.973+0000 7fb9185ab640 1 -- 172.21.15.172:0/264560214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb910073a00 con 0x7fb9100cdb20 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.974+0000 7fb906ffd640 1 -- 172.21.15.172:0/264560214 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb90000b030 con 0x7fb9100cdb20 2024-04-25T08:49:03.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.974+0000 7fb906ffd640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8f406b4d0 0x7fb8f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:03.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.974+0000 7fb906ffd640 1 -- 172.21.15.172:0/264560214 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb90008c610 con 0x7fb9100cdb20 2024-04-25T08:49:03.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.974+0000 7fb916347640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8f406b4d0 0x7fb8f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:03.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.975+0000 7fb916347640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8f406b4d0 0x7fb8f406d990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb90c034000 tx=0x7fb90c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:03.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:03.978+0000 7fb906ffd640 1 -- 172.21.15.172:0/264560214 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb90005b300 con 0x7fb9100cdb20 2024-04-25T08:49:04.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.146+0000 7fb9185ab640 1 -- 172.21.15.172:0/264560214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb91006d3a0 con 0x7fb9100cdb20 2024-04-25T08:49:04.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.146+0000 7fb906ffd640 1 -- 172.21.15.172:0/264560214 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb90005ac00 con 0x7fb9100cdb20 2024-04-25T08:49:04.137 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:49:04.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 -- 172.21.15.172:0/264560214 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8f406b4d0 msgr2=0x7fb8f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8f406b4d0 0x7fb8f406d990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb90c034000 tx=0x7fb90c02e000 comp rx=0 tx=0).stop 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 -- 172.21.15.172:0/264560214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cdb20 msgr2=0x7fb9101f3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cdb20 0x7fb9101f3ce0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fb90000eac0 tx=0x7fb90000ef80 comp rx=0 tx=0).stop 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 -- 172.21.15.172:0/264560214 shutdown_connections 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8f406b4d0 0x7fb8f406d990 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb91015b270 0x7fb9101f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9100cdb20 0x7fb9101f3ce0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 --2- 172.21.15.172:0/264560214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9100cc4f0 0x7fb910140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 -- 172.21.15.172:0/264560214 >> 172.21.15.172:0/264560214 conn(0x7fb91006abe0 msgr2=0x7fb9101582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 -- 172.21.15.172:0/264560214 shutdown_connections 2024-04-25T08:49:04.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.148+0000 7fb9185ab640 1 -- 172.21.15.172:0/264560214 wait complete. 2024-04-25T08:49:04.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:49:04.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.259+0000 7fce3366b640 1 Processor -- start 2024-04-25T08:49:04.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.259+0000 7fce3366b640 1 -- start start 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.260+0000 7fce3366b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce2c15a9f0 0x7fce2c0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.260+0000 7fce3366b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c0cdbf0 0x7fce2c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.260+0000 7fce3366b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fce2c0cd520 0x7fce2c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.260+0000 7fce3366b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2c0b0020 con 0x7fce2c15a9f0 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.260+0000 7fce3366b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce2c0cb5a0 con 0x7fce2c0cd520 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.260+0000 7fce3366b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0c6940 con 0x7fce2c0cdbf0 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.260+0000 7fce31407640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce2c15a9f0 0x7fce2c0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.260+0000 7fce31407640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce2c15a9f0 0x7fce2c0c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50970/0 (socket says 172.21.15.172:50970) 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.260+0000 7fce31407640 1 -- 172.21.15.172:0/912300186 learned_addr learned my addr 172.21.15.172:0/912300186 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.261+0000 7fce31c08640 1 --2- 172.21.15.172:0/912300186 >> v2:172.21.15.186:3300/0 conn(0x7fce2c0cd520 0x7fce2c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.261+0000 7fce30c06640 1 --2- 172.21.15.172:0/912300186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c0cdbf0 0x7fce2c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.261+0000 7fce31407640 1 -- 172.21.15.172:0/912300186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c0cdbf0 msgr2=0x7fce2c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:04.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.261+0000 7fce31407640 1 --2- 172.21.15.172:0/912300186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c0cdbf0 0x7fce2c0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.261+0000 7fce31407640 1 -- 172.21.15.172:0/912300186 >> v2:172.21.15.186:3300/0 conn(0x7fce2c0cd520 msgr2=0x7fce2c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:04.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.261+0000 7fce31407640 1 --2- 172.21.15.172:0/912300186 >> v2:172.21.15.186:3300/0 conn(0x7fce2c0cd520 0x7fce2c0ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.261+0000 7fce31407640 1 -- 172.21.15.172:0/912300186 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c15add0 con 0x7fce2c15a9f0 2024-04-25T08:49:04.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.261+0000 7fce31c08640 1 --2- 172.21.15.172:0/912300186 >> v2:172.21.15.186:3300/0 conn(0x7fce2c0cd520 0x7fce2c0ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:04.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.261+0000 7fce31407640 1 --2- 172.21.15.172:0/912300186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c15a9f0 0x7fce2c0c6010 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0b6950 tx=0x7fce2802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef10ea46c2d1c80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce23fff640 1 -- 172.21.15.172:0/912300186 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28036070 con 0x7fce2c15a9f0 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce23fff640 1 -- 172.21.15.172:0/912300186 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28031600 con 0x7fce2c15a9f0 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce23fff640 1 -- 172.21.15.172:0/912300186 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280319d0 con 0x7fce2c15a9f0 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce3366b640 1 -- 172.21.15.172:0/912300186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c15a9f0 msgr2=0x7fce2c0c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce3366b640 1 --2- 172.21.15.172:0/912300186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c15a9f0 0x7fce2c0c6010 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0b6950 tx=0x7fce2802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce3366b640 1 -- 172.21.15.172:0/912300186 shutdown_connections 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce3366b640 1 --2- 172.21.15.172:0/912300186 >> v2:172.21.15.186:3300/0 conn(0x7fce2c0cd520 0x7fce2c0ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce3366b640 1 --2- 172.21.15.172:0/912300186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c0cdbf0 0x7fce2c0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce3366b640 1 --2- 172.21.15.172:0/912300186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c15a9f0 0x7fce2c0c6010 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce3366b640 1 -- 172.21.15.172:0/912300186 >> 172.21.15.172:0/912300186 conn(0x7fce2c0b2390 msgr2=0x7fce2c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:04.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce3366b640 1 -- 172.21.15.172:0/912300186 shutdown_connections 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.262+0000 7fce3366b640 1 -- 172.21.15.172:0/912300186 wait complete. 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.263+0000 7fce3366b640 1 Processor -- start 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.263+0000 7fce3366b640 1 -- start start 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce3366b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c0cd520 0x7fce2c156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce3366b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce2c0cdbf0 0x7fce2c0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce3366b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c15a9f0 0x7fce2c0c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce3366b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0cb230 con 0x7fce2c0cd520 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce3366b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0caf50 con 0x7fce2c0cdbf0 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce3366b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0ce070 con 0x7fce2c15a9f0 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce31407640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c0cd520 0x7fce2c156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce31407640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c0cd520 0x7fce2c156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50980/0 (socket says 172.21.15.172:50980) 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce31407640 1 -- 172.21.15.172:0/339838337 learned_addr learned my addr 172.21.15.172:0/339838337 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce30c06640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce2c0cdbf0 0x7fce2c0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.264+0000 7fce31c08640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c15a9f0 0x7fce2c0c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce31407640 1 -- 172.21.15.172:0/339838337 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c15a9f0 msgr2=0x7fce2c0c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce31407640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c15a9f0 0x7fce2c0c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce31407640 1 -- 172.21.15.172:0/339838337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce2c0cdbf0 msgr2=0x7fce2c0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce31407640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce2c0cdbf0 0x7fce2c0c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce31407640 1 -- 172.21.15.172:0/339838337 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c0c9d00 con 0x7fce2c0cd520 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce31c08640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c15a9f0 0x7fce2c0c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce31407640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c0cd520 0x7fce2c156de0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fce28034040 tx=0x7fce28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce21ffb640 1 -- 172.21.15.172:0/339838337 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28036050 con 0x7fce2c0cd520 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce21ffb640 1 -- 172.21.15.172:0/339838337 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28042070 con 0x7fce2c0cd520 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce21ffb640 1 -- 172.21.15.172:0/339838337 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28009510 con 0x7fce2c0cd520 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce3366b640 1 -- 172.21.15.172:0/339838337 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c0c9fe0 con 0x7fce2c0cd520 2024-04-25T08:49:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.265+0000 7fce3366b640 1 -- 172.21.15.172:0/339838337 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2c157320 con 0x7fce2c0cd520 2024-04-25T08:49:04.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.266+0000 7fce3366b640 1 -- 172.21.15.172:0/339838337 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2c06cc80 con 0x7fce2c0cd520 2024-04-25T08:49:04.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.267+0000 7fce21ffb640 1 -- 172.21.15.172:0/339838337 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fce28007c30 con 0x7fce2c0cd520 2024-04-25T08:49:04.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.267+0000 7fce21ffb640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce1006b4d0 0x7fce1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.267+0000 7fce30c06640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce1006b4d0 0x7fce1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.267+0000 7fce21ffb640 1 -- 172.21.15.172:0/339838337 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fce280ab2f0 con 0x7fce2c0cd520 2024-04-25T08:49:04.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.268+0000 7fce30c06640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce1006b4d0 0x7fce1006d990 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fce2c09e8d0 tx=0x7fce1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:04.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.271+0000 7fce21ffb640 1 -- 172.21.15.172:0/339838337 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fce2807a070 con 0x7fce2c0cd520 2024-04-25T08:49:04.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.442+0000 7fce3366b640 1 -- 172.21.15.172:0/339838337 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce2c073a00 con 0x7fce2c0cd520 2024-04-25T08:49:04.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.442+0000 7fce21ffb640 1 -- 172.21.15.172:0/339838337 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce28079970 con 0x7fce2c0cd520 2024-04-25T08:49:04.433 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:49:04.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 -- 172.21.15.172:0/339838337 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce1006b4d0 msgr2=0x7fce1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce1006b4d0 0x7fce1006d990 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fce2c09e8d0 tx=0x7fce1c008040 comp rx=0 tx=0).stop 2024-04-25T08:49:04.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 -- 172.21.15.172:0/339838337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c0cd520 msgr2=0x7fce2c156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c0cd520 0x7fce2c156de0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fce28034040 tx=0x7fce28004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:04.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 -- 172.21.15.172:0/339838337 shutdown_connections 2024-04-25T08:49:04.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fce1006b4d0 0x7fce1006d990 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fce2c0cdbf0 0x7fce2c0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fce2c15a9f0 0x7fce2c0c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 --2- 172.21.15.172:0/339838337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce2c0cd520 0x7fce2c156de0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 -- 172.21.15.172:0/339838337 >> 172.21.15.172:0/339838337 conn(0x7fce2c0b2390 msgr2=0x7fce2c0cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:04.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 -- 172.21.15.172:0/339838337 shutdown_connections 2024-04-25T08:49:04.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.444+0000 7fce3366b640 1 -- 172.21.15.172:0/339838337 wait complete. 2024-04-25T08:49:04.446 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:49:04.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.556+0000 7f198997e640 1 Processor -- start 2024-04-25T08:49:04.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.556+0000 7f198997e640 1 -- start start 2024-04-25T08:49:04.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f198997e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f198415dc20 0x7f19840ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f198997e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1984161710 0x7f19840cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f198997e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198415e000 con 0x7f19840b9330 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f198997e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19840d1de0 con 0x7f198415dc20 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f198997e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1984161c60 con 0x7f1984161710 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f1982ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f198415dc20 0x7f19840ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f1982ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f198415dc20 0x7f19840ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50992/0 (socket says 172.21.15.172:50992) 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f1982ffd640 1 -- 172.21.15.172:0/2612624180 learned_addr learned my addr 172.21.15.172:0/2612624180 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f1982ffd640 1 -- 172.21.15.172:0/2612624180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1984161710 msgr2=0x7f19840cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f1982ffd640 1 --2- 172.21.15.172:0/2612624180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1984161710 0x7f19840cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f1982ffd640 1 -- 172.21.15.172:0/2612624180 >> v1:172.21.15.186:6789/0 conn(0x7f19840b9330 legacy=0x7f198406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.557+0000 7f1982ffd640 1 -- 172.21.15.172:0/2612624180 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1984161f40 con 0x7f198415dc20 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.558+0000 7f1982ffd640 1 --2- 172.21.15.172:0/2612624180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 0x7f19840ce670 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f1974009870 tx=0x7f197402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdb3df9fe189f8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.558+0000 7f1981ffb640 1 -- 172.21.15.172:0/2612624180 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974037070 con 0x7f198415dc20 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.558+0000 7f1981ffb640 1 -- 172.21.15.172:0/2612624180 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1974032440 con 0x7f198415dc20 2024-04-25T08:49:04.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.558+0000 7f1981ffb640 1 -- 172.21.15.172:0/2612624180 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974032810 con 0x7f198415dc20 2024-04-25T08:49:04.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.558+0000 7f198997e640 1 -- 172.21.15.172:0/2612624180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 msgr2=0x7f19840ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.558+0000 7f198997e640 1 --2- 172.21.15.172:0/2612624180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 0x7f19840ce670 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f1974009870 tx=0x7f197402a210 comp rx=0 tx=0).stop 2024-04-25T08:49:04.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.559+0000 7f198997e640 1 -- 172.21.15.172:0/2612624180 shutdown_connections 2024-04-25T08:49:04.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.559+0000 7f198997e640 1 --2- 172.21.15.172:0/2612624180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1984161710 0x7f19840cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.559+0000 7f198997e640 1 --2- 172.21.15.172:0/2612624180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 0x7f19840ce670 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.559+0000 7f198997e640 1 -- 172.21.15.172:0/2612624180 >> 172.21.15.172:0/2612624180 conn(0x7f19840d0420 msgr2=0x7f19840d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:04.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.559+0000 7f198997e640 1 -- 172.21.15.172:0/2612624180 shutdown_connections 2024-04-25T08:49:04.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.559+0000 7f198997e640 1 -- 172.21.15.172:0/2612624180 wait complete. 2024-04-25T08:49:04.553 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.560+0000 7f198997e640 1 Processor -- start 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.560+0000 7f198997e640 1 -- start start 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f198997e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b9330 0x7f198414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f198997e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 0x7f19840c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f198997e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1984161710 0x7f19840c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f198997e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19840b5e50 con 0x7f198415dc20 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f198997e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1984162500 con 0x7f19840b9330 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f198997e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840b5fd0 con 0x7f1984161710 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f19827fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 0x7f19840c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f19827fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 0x7f19840c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51002/0 (socket says 172.21.15.172:51002) 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f19827fc640 1 -- 172.21.15.172:0/2226121332 learned_addr learned my addr 172.21.15.172:0/2226121332 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f1982ffd640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b9330 0x7f198414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f19837fe640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1984161710 0x7f19840c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f19827fc640 1 -- 172.21.15.172:0/2226121332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1984161710 msgr2=0x7f19840c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.554 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f19827fc640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1984161710 0x7f19840c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f19827fc640 1 -- 172.21.15.172:0/2226121332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b9330 msgr2=0x7f198414dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f19827fc640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b9330 0x7f198414dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f19827fc640 1 -- 172.21.15.172:0/2226121332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198414c980 con 0x7f198415dc20 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f1982ffd640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b9330 0x7f198414dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f19827fc640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 0x7f19840c93d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f197800b410 tx=0x7f197800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f196bfff640 1 -- 172.21.15.172:0/2226121332 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978015020 con 0x7f198415dc20 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f196bfff640 1 -- 172.21.15.172:0/2226121332 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978011850 con 0x7f198415dc20 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f198997e640 1 -- 172.21.15.172:0/2226121332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198414cc60 con 0x7f198415dc20 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f196bfff640 1 -- 172.21.15.172:0/2226121332 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978011c40 con 0x7f198415dc20 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.561+0000 7f198997e640 1 -- 172.21.15.172:0/2226121332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198414d220 con 0x7f198415dc20 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.562+0000 7f198997e640 1 -- 172.21.15.172:0/2226121332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1984073a00 con 0x7f198415dc20 2024-04-25T08:49:04.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.563+0000 7f196bfff640 1 -- 172.21.15.172:0/2226121332 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1978018020 con 0x7f198415dc20 2024-04-25T08:49:04.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.563+0000 7f196bfff640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197006b4d0 0x7f197006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.563+0000 7f196bfff640 1 -- 172.21.15.172:0/2226121332 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f197808a340 con 0x7f198415dc20 2024-04-25T08:49:04.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.563+0000 7f1982ffd640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197006b4d0 0x7f197006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.564+0000 7f1982ffd640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197006b4d0 0x7f197006d990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1974034000 tx=0x7f197402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:04.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.567+0000 7f196bfff640 1 -- 172.21.15.172:0/2226121332 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f197801f020 con 0x7f198415dc20 2024-04-25T08:49:04.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.737+0000 7f198997e640 1 -- 172.21.15.172:0/2226121332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f198415c7b0 con 0x7f198415dc20 2024-04-25T08:49:04.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.737+0000 7f196bfff640 1 -- 172.21.15.172:0/2226121332 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19780172c0 con 0x7f198415dc20 2024-04-25T08:49:04.728 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:49:04.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 -- 172.21.15.172:0/2226121332 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197006b4d0 msgr2=0x7f197006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197006b4d0 0x7f197006d990 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1974034000 tx=0x7f197402e000 comp rx=0 tx=0).stop 2024-04-25T08:49:04.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 -- 172.21.15.172:0/2226121332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 msgr2=0x7f19840c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 0x7f19840c93d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f197800b410 tx=0x7f197800b8d0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 -- 172.21.15.172:0/2226121332 shutdown_connections 2024-04-25T08:49:04.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197006b4d0 0x7f197006d990 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1984161710 0x7f19840c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198415dc20 0x7f19840c93d0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 --2- 172.21.15.172:0/2226121332 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19840b9330 0x7f198414dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 -- 172.21.15.172:0/2226121332 >> 172.21.15.172:0/2226121332 conn(0x7f19840d0420 msgr2=0x7f198415bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:04.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 -- 172.21.15.172:0/2226121332 shutdown_connections 2024-04-25T08:49:04.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.739+0000 7f198997e640 1 -- 172.21.15.172:0/2226121332 wait complete. 2024-04-25T08:49:04.741 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:04.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.848+0000 7fe1d9058640 1 Processor -- start 2024-04-25T08:49:04.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.848+0000 7fe1d9058640 1 -- start start 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.848+0000 7fe1d9058640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40cc8e0 0x7fe1d41625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.848+0000 7fe1d9058640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d40cce50 con 0x7fe1d40d1810 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.848+0000 7fe1d9058640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d4161af0 con 0x7fe1d415dc90 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.848+0000 7fe1d9058640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4161dd0 con 0x7fe1d40cc8e0 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d359e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe1d40d1810 0x7fe1d40cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:36444/0 (socket says 172.21.15.172:36444) 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d359e640 1 -- 172.21.15.172:0/692809288 learned_addr learned my addr 172.21.15.172:0/692809288 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d259c640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40cc8e0 0x7fe1d41625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202842403 0 0) 0x7fe1d40cce50 con 0x7fe1d40d1810 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1bc003520 con 0x7fe1d40d1810 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 165820003 0 0) 0x7fe1bc003520 con 0x7fe1d40d1810 2024-04-25T08:49:04.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40cc8e0 msgr2=0x7fe1d41625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40cc8e0 0x7fe1d41625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 >> v1:172.21.15.186:6789/0 conn(0x7fe1d415dc90 legacy=0x7fe1d415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d41620b0 con 0x7fe1d40d1810 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fe1c40019f0 con 0x7fe1d40d1810 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 >> v1:172.21.15.172:6789/0 conn(0x7fe1d40d1810 legacy=0x7fe1d40cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 0x7fe1bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40cc8e0 0x7fe1bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1bc004d40 0x7fe1bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4161dd0 con 0x7fe1bc0039e0 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc00baa0 con 0x7fe1bc004d40 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1bc00bca0 con 0x7fe1d40cc8e0 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d2d9d640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 0x7fe1bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d259c640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40cc8e0 0x7fe1bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.849+0000 7fe1d359e640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1bc004d40 0x7fe1bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.850+0000 7fe1d2d9d640 1 -- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40cc8e0 msgr2=0x7fe1bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.850+0000 7fe1d2d9d640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40cc8e0 0x7fe1bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.850+0000 7fe1d2d9d640 1 -- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1bc004d40 msgr2=0x7fe1bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.850+0000 7fe1d2d9d640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1bc004d40 0x7fe1bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.850+0000 7fe1d2d9d640 1 -- 172.21.15.172:0/692809288 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc003520 con 0x7fe1bc0039e0 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.850+0000 7fe1d359e640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1bc004d40 0x7fe1bc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.850+0000 7fe1d2d9d640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 0x7fe1bc003dc0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc001860 tx=0x7fe1bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7560b48cea5a1867 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.850+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc037070 con 0x7fe1bc0039e0 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.850+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc02ac30 con 0x7fe1bc0039e0 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.850+0000 7fe1d1d9b640 1 -- 172.21.15.172:0/692809288 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc001430 con 0x7fe1bc0039e0 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.851+0000 7fe1d9058640 1 -- 172.21.15.172:0/692809288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 msgr2=0x7fe1bc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.851+0000 7fe1d9058640 1 --2- 172.21.15.172:0/692809288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 0x7fe1bc003dc0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc001860 tx=0x7fe1bc005830 comp rx=0 tx=0).stop 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.851+0000 7fe1d359e640 1 -- 172.21.15.172:0/692809288 reap_dead start 2024-04-25T08:49:04.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.851+0000 7fe1d9058640 1 -- 172.21.15.172:0/692809288 shutdown_connections 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.851+0000 7fe1d9058640 1 -- 172.21.15.172:0/692809288 >> 172.21.15.172:0/692809288 conn(0x7fe1d406f590 msgr2=0x7fe1d406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.851+0000 7fe1d9058640 1 -- 172.21.15.172:0/692809288 shutdown_connections 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.851+0000 7fe1d9058640 1 -- 172.21.15.172:0/692809288 wait complete. 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.852+0000 7fe1d9058640 1 Processor -- start 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.852+0000 7fe1d9058640 1 -- start start 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d9058640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 0x7fe1d41611f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d9058640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1d414f1a0 0x7fe1d414e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d9058640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40b62a0 0x7fe1d415e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d9058640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d415e1f0 con 0x7fe1bc0039e0 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d9058640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d415e070 con 0x7fe1d414f1a0 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d9058640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d41625d0 con 0x7fe1d40b62a0 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 0x7fe1d41611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 0x7fe1d41611f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51018/0 (socket says 172.21.15.172:51018) 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d2d9d640 1 -- 172.21.15.172:0/3126913101 learned_addr learned my addr 172.21.15.172:0/3126913101 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:04.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d259c640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1d414f1a0 0x7fe1d414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.853+0000 7fe1d359e640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40b62a0 0x7fe1d415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1d2d9d640 1 -- 172.21.15.172:0/3126913101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40b62a0 msgr2=0x7fe1d415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1d2d9d640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40b62a0 0x7fe1d415e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1d2d9d640 1 -- 172.21.15.172:0/3126913101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1d414f1a0 msgr2=0x7fe1d414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1d2d9d640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1d414f1a0 0x7fe1d414e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1d2d9d640 1 -- 172.21.15.172:0/3126913101 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d40b5200 con 0x7fe1bc0039e0 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1d359e640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40b62a0 0x7fe1d415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1d2d9d640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 0x7fe1d41611f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc02a6c0 tx=0x7fe1cc001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1bb7fe640 1 -- 172.21.15.172:0/3126913101 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc040020 con 0x7fe1bc0039e0 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1bb7fe640 1 -- 172.21.15.172:0/3126913101 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc005270 con 0x7fe1bc0039e0 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1bb7fe640 1 -- 172.21.15.172:0/3126913101 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc037040 con 0x7fe1bc0039e0 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1d9058640 1 -- 172.21.15.172:0/3126913101 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d40b54e0 con 0x7fe1bc0039e0 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.854+0000 7fe1d9058640 1 -- 172.21.15.172:0/3126913101 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d40b5aa0 con 0x7fe1bc0039e0 2024-04-25T08:49:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.855+0000 7fe1d9058640 1 -- 172.21.15.172:0/3126913101 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d4073990 con 0x7fe1bc0039e0 2024-04-25T08:49:04.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.855+0000 7fe1bb7fe640 1 -- 172.21.15.172:0/3126913101 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe1cc043020 con 0x7fe1bc0039e0 2024-04-25T08:49:04.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.856+0000 7fe1bb7fe640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c006b4d0 0x7fe1c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:04.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.856+0000 7fe1bb7fe640 1 -- 172.21.15.172:0/3126913101 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe1cc0aa560 con 0x7fe1bc0039e0 2024-04-25T08:49:04.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.856+0000 7fe1d259c640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c006b4d0 0x7fe1c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:04.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.856+0000 7fe1d259c640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c006b4d0 0x7fe1c006d990 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe1d41f7620 tx=0x7fe1c8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:04.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:04.860+0000 7fe1bb7fe640 1 -- 172.21.15.172:0/3126913101 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1cc04a030 con 0x7fe1bc0039e0 2024-04-25T08:49:05.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.065+0000 7fe1d9058640 1 -- 172.21.15.172:0/3126913101 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1d40b7680 con 0x7fe1bc0039e0 2024-04-25T08:49:05.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.066+0000 7fe1bb7fe640 1 -- 172.21.15.172:0/3126913101 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fe1cc079400 con 0x7fe1bc0039e0 2024-04-25T08:49:05.057 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:05.057 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/154236059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":154236059},{"type":"v1","addr":"172.21.15.172:6837","nonce":154236059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/985041095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":985041095},{"type":"v1","addr":"172.21.15.186:6835","nonce":985041095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7686,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1301700155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1301700155},{"type":"v1","addr":"172.21.15.172:6836","nonce":1301700155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:48:38.741906+0000","modified":"2024-04-25T08:48:40.732152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6834/246475597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":246475597},{"type":"v1","addr":"172.21.15.186:6834","nonce":246475597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:49:05.057 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 56 2024-04-25T08:49:05.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 -- 172.21.15.172:0/3126913101 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c006b4d0 msgr2=0x7fe1c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c006b4d0 0x7fe1c006d990 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe1d41f7620 tx=0x7fe1c8009190 comp rx=0 tx=0).stop 2024-04-25T08:49:05.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 -- 172.21.15.172:0/3126913101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 msgr2=0x7fe1d41611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 0x7fe1d41611f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc02a6c0 tx=0x7fe1cc001230 comp rx=0 tx=0).stop 2024-04-25T08:49:05.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 -- 172.21.15.172:0/3126913101 shutdown_connections 2024-04-25T08:49:05.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe1c006b4d0 0x7fe1c006d990 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1d414f1a0 0x7fe1d414e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1d40b62a0 0x7fe1d415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 --2- 172.21.15.172:0/3126913101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1bc0039e0 0x7fe1d41611f0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 -- 172.21.15.172:0/3126913101 >> 172.21.15.172:0/3126913101 conn(0x7fe1d406f590 msgr2=0x7fe1d40b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:05.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 -- 172.21.15.172:0/3126913101 shutdown_connections 2024-04-25T08:49:05.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.068+0000 7fe1d9058640 1 -- 172.21.15.172:0/3126913101 wait complete. 2024-04-25T08:49:05.071 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:05.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.176+0000 7f2b08e1f640 1 Processor -- start 2024-04-25T08:49:05.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.176+0000 7f2b08e1f640 1 -- start start 2024-04-25T08:49:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.177+0000 7f2b08e1f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2b0406b2f0 0x7f2b0415f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.177+0000 7f2b08e1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b040b2d40 0x7f2b0415fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.177+0000 7f2b08e1f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b040d0480 con 0x7f2b041597d0 2024-04-25T08:49:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.177+0000 7f2b08e1f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0415c1b0 con 0x7f2b0406b2f0 2024-04-25T08:49:05.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.177+0000 7f2b08e1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0415c490 con 0x7f2b040b2d40 2024-04-25T08:49:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.177+0000 7f2b01d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2b0406b2f0 0x7f2b0415f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.177+0000 7f2b0259c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2b041597d0 0x7f2b0406abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:36450/0 (socket says 172.21.15.172:36450) 2024-04-25T08:49:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.178+0000 7f2b0259c640 1 -- 172.21.15.172:0/3021089395 learned_addr learned my addr 172.21.15.172:0/3021089395 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.178+0000 7f2b01d9b640 1 -- 172.21.15.172:0/3021089395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b040b2d40 msgr2=0x7f2b0415fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.178+0000 7f2b02d9d640 1 --2- 172.21.15.172:0/3021089395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b040b2d40 0x7f2b0415fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.178+0000 7f2b01d9b640 1 --2- 172.21.15.172:0/3021089395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b040b2d40 0x7f2b0415fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.178+0000 7f2b0159a640 1 -- 172.21.15.172:0/3021089395 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305425011 0 0) 0x7f2b040d0480 con 0x7f2b041597d0 2024-04-25T08:49:05.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.178+0000 7f2b01d9b640 1 -- 172.21.15.172:0/3021089395 >> v1:172.21.15.172:6789/0 conn(0x7f2b041597d0 legacy=0x7f2b0406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.178+0000 7f2b01d9b640 1 -- 172.21.15.172:0/3021089395 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0415c770 con 0x7f2b0406b2f0 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b01d9b640 1 --2- 172.21.15.172:0/3021089395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b0406b2f0 0x7f2b0415f690 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0097a0 tx=0x7f2aec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1505ea041a9ece8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b0159a640 1 -- 172.21.15.172:0/3021089395 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec037070 con 0x7f2b0406b2f0 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b0159a640 1 -- 172.21.15.172:0/3021089395 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec032440 con 0x7f2b0406b2f0 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b0159a640 1 -- 172.21.15.172:0/3021089395 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec032810 con 0x7f2b0406b2f0 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b08e1f640 1 -- 172.21.15.172:0/3021089395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b0406b2f0 msgr2=0x7f2b0415f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b08e1f640 1 --2- 172.21.15.172:0/3021089395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b0406b2f0 0x7f2b0415f690 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0097a0 tx=0x7f2aec02a180 comp rx=0 tx=0).stop 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b08e1f640 1 -- 172.21.15.172:0/3021089395 shutdown_connections 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b08e1f640 1 --2- 172.21.15.172:0/3021089395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b040b2d40 0x7f2b0415fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b08e1f640 1 --2- 172.21.15.172:0/3021089395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b0406b2f0 0x7f2b0415f690 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b08e1f640 1 -- 172.21.15.172:0/3021089395 >> 172.21.15.172:0/3021089395 conn(0x7f2b040b2220 msgr2=0x7f2b040b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b08e1f640 1 -- 172.21.15.172:0/3021089395 shutdown_connections 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.179+0000 7f2b08e1f640 1 -- 172.21.15.172:0/3021089395 wait complete. 2024-04-25T08:49:05.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.181+0000 7f2b08e1f640 1 Processor -- start 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.181+0000 7f2b08e1f640 1 -- start start 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.181+0000 7f2b08e1f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b0406b2f0 0x7f2b040c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.181+0000 7f2b08e1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b040b2d40 0x7f2b0414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.181+0000 7f2b08e1f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b041597d0 0x7f2b040c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.181+0000 7f2b08e1f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0406b920 con 0x7f2b041597d0 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.181+0000 7f2b08e1f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0406b7a0 con 0x7f2b0406b2f0 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.181+0000 7f2b08e1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040cc320 con 0x7f2b040b2d40 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.181+0000 7f2b02d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b041597d0 0x7f2b040c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.181+0000 7f2b02d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b041597d0 0x7f2b040c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51026/0 (socket says 172.21.15.172:51026) 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b02d9d640 1 -- 172.21.15.172:0/2432926721 learned_addr learned my addr 172.21.15.172:0/2432926721 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b01d9b640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b040b2d40 0x7f2b0414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b0259c640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b0406b2f0 0x7f2b040c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b02d9d640 1 -- 172.21.15.172:0/2432926721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b040b2d40 msgr2=0x7f2b0414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b02d9d640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b040b2d40 0x7f2b0414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b02d9d640 1 -- 172.21.15.172:0/2432926721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b0406b2f0 msgr2=0x7f2b040c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b02d9d640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b0406b2f0 0x7f2b040c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b02d9d640 1 -- 172.21.15.172:0/2432926721 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b040c7000 con 0x7f2b041597d0 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b02d9d640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b041597d0 0x7f2b040c48d0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c7f0 tx=0x7f2af400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2afaffd640 1 -- 172.21.15.172:0/2432926721 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4015070 con 0x7f2b041597d0 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2afaffd640 1 -- 172.21.15.172:0/2432926721 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af4004220 con 0x7f2b041597d0 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b08e1f640 1 -- 172.21.15.172:0/2432926721 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0415ab80 con 0x7f2b041597d0 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2afaffd640 1 -- 172.21.15.172:0/2432926721 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4007620 con 0x7f2b041597d0 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.182+0000 7f2b08e1f640 1 -- 172.21.15.172:0/2432926721 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0415b420 con 0x7f2b041597d0 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.183+0000 7f2b08e1f640 1 -- 172.21.15.172:0/2432926721 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b04073990 con 0x7f2b041597d0 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.184+0000 7f2afaffd640 1 -- 172.21.15.172:0/2432926721 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2af40079d0 con 0x7f2b041597d0 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.184+0000 7f2afaffd640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ae406b4d0 0x7f2ae406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.184+0000 7f2b0259c640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ae406b4d0 0x7f2ae406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.184+0000 7f2afaffd640 1 -- 172.21.15.172:0/2432926721 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2af408a460 con 0x7f2b041597d0 2024-04-25T08:49:05.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.185+0000 7f2b0259c640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ae406b4d0 0x7f2ae406d990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2afc007ed0 tx=0x7f2afc007e60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:05.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.188+0000 7f2afaffd640 1 -- 172.21.15.172:0/2432926721 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2af4059150 con 0x7f2b041597d0 2024-04-25T08:49:05.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.359+0000 7f2b08e1f640 1 -- 172.21.15.172:0/2432926721 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b040cf540 con 0x7f2b041597d0 2024-04-25T08:49:05.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.360+0000 7f2afaffd640 1 -- 172.21.15.172:0/2432926721 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16945 (secure 0 0 0) 0x7f2af4058a50 con 0x7f2b041597d0 2024-04-25T08:49:05.351 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:05.351 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":95,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:40.385755+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:48:36.951495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T08:48:37.702925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:05.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 -- 172.21.15.172:0/2432926721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ae406b4d0 msgr2=0x7f2ae406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ae406b4d0 0x7f2ae406d990 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2afc007ed0 tx=0x7f2afc007e60 comp rx=0 tx=0).stop 2024-04-25T08:49:05.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 -- 172.21.15.172:0/2432926721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b041597d0 msgr2=0x7f2b040c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b041597d0 0x7f2b040c48d0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c7f0 tx=0x7f2af400ccb0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 -- 172.21.15.172:0/2432926721 shutdown_connections 2024-04-25T08:49:05.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2ae406b4d0 0x7f2ae406d990 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b041597d0 0x7f2b040c48d0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2b040b2d40 0x7f2b0414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 --2- 172.21.15.172:0/2432926721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b0406b2f0 0x7f2b040c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 -- 172.21.15.172:0/2432926721 >> 172.21.15.172:0/2432926721 conn(0x7f2b040b2220 msgr2=0x7f2b040cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:05.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 -- 172.21.15.172:0/2432926721 shutdown_connections 2024-04-25T08:49:05.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.362+0000 7f2b08e1f640 1 -- 172.21.15.172:0/2432926721 wait complete. 2024-04-25T08:49:05.364 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:49:05.364 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:05.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.473+0000 7fa71337e640 1 Processor -- start 2024-04-25T08:49:05.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.473+0000 7fa71337e640 1 -- start start 2024-04-25T08:49:05.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.474+0000 7fa71337e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 0x7fa70c0c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.474+0000 7fa71337e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa70c0d1dd0 0x7fa70c0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.474+0000 7fa71337e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70c15dfe0 con 0x7fa70c0ceb20 2024-04-25T08:49:05.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.474+0000 7fa71337e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70c0d00c0 con 0x7fa70c0d1dd0 2024-04-25T08:49:05.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.474+0000 7fa71337e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0d03a0 con 0x7fa70c15dc00 2024-04-25T08:49:05.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.474+0000 7fa71111a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 0x7fa70c0c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.474+0000 7fa71191b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa70c0d1dd0 0x7fa70c0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.475+0000 7fa71111a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 0x7fa70c0c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:57532/0 (socket says 172.21.15.172:57532) 2024-04-25T08:49:05.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.475+0000 7fa71111a640 1 -- 172.21.15.172:0/1427219996 learned_addr learned my addr 172.21.15.172:0/1427219996 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:05.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.475+0000 7fa71191b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa70c0d1dd0 0x7fa70c0ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:60758/0 (socket says 172.21.15.172:60758) 2024-04-25T08:49:05.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.475+0000 7fa710919640 1 --1- 172.21.15.172:0/1427219996 >> v1:172.21.15.186:6789/0 conn(0x7fa70c0ceb20 0x7fa70c0d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:33338/0 (socket says 172.21.15.172:33338) 2024-04-25T08:49:05.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.475+0000 7fa71191b640 1 -- 172.21.15.172:0/1427219996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 msgr2=0x7fa70c0c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.475+0000 7fa71191b640 1 --2- 172.21.15.172:0/1427219996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 0x7fa70c0c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.475+0000 7fa71191b640 1 -- 172.21.15.172:0/1427219996 >> v1:172.21.15.186:6789/0 conn(0x7fa70c0ceb20 legacy=0x7fa70c0d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.475+0000 7fa71191b640 1 -- 172.21.15.172:0/1427219996 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c0cc440 con 0x7fa70c0d1dd0 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.475+0000 7fa703fff640 1 -- 172.21.15.172:0/1427219996 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429233817 0 0) 0x7fa6fc001110 con 0x7fa70c0ceb20 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa71191b640 1 --2- 172.21.15.172:0/1427219996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70c0d1dd0 0x7fa70c0ccc40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa7040097a0 tx=0x7fa70402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8ea3d2a3104e698 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa703fff640 1 -- 172.21.15.172:0/1427219996 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704037070 con 0x7fa70c0d1dd0 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa703fff640 1 -- 172.21.15.172:0/1427219996 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa704032440 con 0x7fa70c0d1dd0 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa703fff640 1 -- 172.21.15.172:0/1427219996 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704032810 con 0x7fa70c0d1dd0 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa71337e640 1 -- 172.21.15.172:0/1427219996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70c0d1dd0 msgr2=0x7fa70c0ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa71337e640 1 --2- 172.21.15.172:0/1427219996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70c0d1dd0 0x7fa70c0ccc40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa7040097a0 tx=0x7fa70402a180 comp rx=0 tx=0).stop 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa71337e640 1 -- 172.21.15.172:0/1427219996 shutdown_connections 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa71337e640 1 --2- 172.21.15.172:0/1427219996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70c0d1dd0 0x7fa70c0ccc40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa71337e640 1 --2- 172.21.15.172:0/1427219996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 0x7fa70c0c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa71337e640 1 -- 172.21.15.172:0/1427219996 >> 172.21.15.172:0/1427219996 conn(0x7fa70c06f5d0 msgr2=0x7fa70c06f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:05.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa71337e640 1 -- 172.21.15.172:0/1427219996 shutdown_connections 2024-04-25T08:49:05.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.476+0000 7fa71337e640 1 -- 172.21.15.172:0/1427219996 wait complete. 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71337e640 1 Processor -- start 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71337e640 1 -- start start 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71337e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa70c0ceb20 0x7fa70c0b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71337e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70c0d1dd0 0x7fa70c0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71337e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 0x7fa70c1f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71337e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0cfd90 con 0x7fa70c0ceb20 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71337e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0cc130 con 0x7fa70c0d1dd0 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71337e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c0cdd70 con 0x7fa70c15dc00 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71111a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa70c0ceb20 0x7fa70c0b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71111a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa70c0ceb20 0x7fa70c0b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51034/0 (socket says 172.21.15.172:51034) 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa71111a640 1 -- 172.21.15.172:0/735082638 learned_addr learned my addr 172.21.15.172:0/735082638 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.478+0000 7fa710919640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70c0d1dd0 0x7fa70c0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa71191b640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 0x7fa70c1f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa71111a640 1 -- 172.21.15.172:0/735082638 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 msgr2=0x7fa70c1f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa71111a640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 0x7fa70c1f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa71111a640 1 -- 172.21.15.172:0/735082638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70c0d1dd0 msgr2=0x7fa70c0c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa71111a640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70c0d1dd0 0x7fa70c0c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa71111a640 1 -- 172.21.15.172:0/735082638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c0b4e10 con 0x7fa70c0ceb20 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa71111a640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa70c0ceb20 0x7fa70c0b44a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fa70800efc0 tx=0x7fa70800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa701ffb640 1 -- 172.21.15.172:0/735082638 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70800cda0 con 0x7fa70c0ceb20 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa701ffb640 1 -- 172.21.15.172:0/735082638 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa708019070 con 0x7fa70c0ceb20 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa71337e640 1 -- 172.21.15.172:0/735082638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70c0b50f0 con 0x7fa70c0ceb20 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa701ffb640 1 -- 172.21.15.172:0/735082638 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080146a0 con 0x7fa70c0ceb20 2024-04-25T08:49:05.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.479+0000 7fa71337e640 1 -- 172.21.15.172:0/735082638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c0b56b0 con 0x7fa70c0ceb20 2024-04-25T08:49:05.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.480+0000 7fa71337e640 1 -- 172.21.15.172:0/735082638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c073990 con 0x7fa70c0ceb20 2024-04-25T08:49:05.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.481+0000 7fa701ffb640 1 -- 172.21.15.172:0/735082638 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa708005d10 con 0x7fa70c0ceb20 2024-04-25T08:49:05.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.481+0000 7fa701ffb640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6f006b4d0 0x7fa6f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.481+0000 7fa710919640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6f006b4d0 0x7fa6f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.481+0000 7fa701ffb640 1 -- 172.21.15.172:0/735082638 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa70808a620 con 0x7fa70c0ceb20 2024-04-25T08:49:05.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.482+0000 7fa710919640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6f006b4d0 0x7fa6f006d990 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0680d0 tx=0x7fa6fc007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:05.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.486+0000 7fa701ffb640 1 -- 172.21.15.172:0/735082638 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa708010040 con 0x7fa70c0ceb20 2024-04-25T08:49:05.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.692+0000 7fa71337e640 1 -- 172.21.15.172:0/735082638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa70c0c66c0 con 0x7fa70c0ceb20 2024-04-25T08:49:05.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.692+0000 7fa701ffb640 1 -- 172.21.15.172:0/735082638 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fa708058d50 con 0x7fa70c0ceb20 2024-04-25T08:49:05.683 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:05.683 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/154236059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":154236059},{"type":"v1","addr":"172.21.15.172:6837","nonce":154236059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/985041095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":985041095},{"type":"v1","addr":"172.21.15.186:6835","nonce":985041095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7686,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1301700155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1301700155},{"type":"v1","addr":"172.21.15.172:6836","nonce":1301700155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:48:38.741906+0000","modified":"2024-04-25T08:48:40.732152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6834/246475597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":246475597},{"type":"v1","addr":"172.21.15.186:6834","nonce":246475597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:49:05.684 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 56 2024-04-25T08:49:05.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 -- 172.21.15.172:0/735082638 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6f006b4d0 msgr2=0x7fa6f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6f006b4d0 0x7fa6f006d990 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0680d0 tx=0x7fa6fc007b50 comp rx=0 tx=0).stop 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 -- 172.21.15.172:0/735082638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa70c0ceb20 msgr2=0x7fa70c0b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa70c0ceb20 0x7fa70c0b44a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fa70800efc0 tx=0x7fa70800c490 comp rx=0 tx=0).stop 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 -- 172.21.15.172:0/735082638 shutdown_connections 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa6f006b4d0 0x7fa6f006d990 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa70c0d1dd0 0x7fa70c0c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa70c15dc00 0x7fa70c1f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 --2- 172.21.15.172:0/735082638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa70c0ceb20 0x7fa70c0b44a0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 -- 172.21.15.172:0/735082638 >> 172.21.15.172:0/735082638 conn(0x7fa70c06f5d0 msgr2=0x7fa70c0b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 -- 172.21.15.172:0/735082638 shutdown_connections 2024-04-25T08:49:05.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.694+0000 7fa71337e640 1 -- 172.21.15.172:0/735082638 wait complete. 2024-04-25T08:49:05.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:05.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.803+0000 7f60ba114640 1 Processor -- start 2024-04-25T08:49:05.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.803+0000 7f60ba114640 1 -- start start 2024-04-25T08:49:05.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.804+0000 7f60ba114640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f60b415dbe0 0x7f60b40d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.804+0000 7f60ba114640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b40b92a0 0x7f60b40d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.804+0000 7f60ba114640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b40b97a0 con 0x7f60b40b2cb0 2024-04-25T08:49:05.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.804+0000 7f60ba114640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b415dfc0 con 0x7f60b415dbe0 2024-04-25T08:49:05.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.804+0000 7f60ba114640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40d1a00 con 0x7f60b40b92a0 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.804+0000 7f60b37fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f60b415dbe0 0x7f60b40d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.804+0000 7f60b37fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f60b415dbe0 0x7f60b40d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51036/0 (socket says 172.21.15.172:51036) 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.804+0000 7f60b37fe640 1 -- 172.21.15.172:0/1115370775 learned_addr learned my addr 172.21.15.172:0/1115370775 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.805+0000 7f60b37fe640 1 -- 172.21.15.172:0/1115370775 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b40b92a0 msgr2=0x7f60b40d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.805+0000 7f60b3fff640 1 --2- 172.21.15.172:0/1115370775 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b40b92a0 0x7f60b40d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.805+0000 7f60b37fe640 1 --2- 172.21.15.172:0/1115370775 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b40b92a0 0x7f60b40d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.805+0000 7f60b37fe640 1 -- 172.21.15.172:0/1115370775 >> v1:172.21.15.186:6789/0 conn(0x7f60b40b2cb0 legacy=0x7f60b40b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.805+0000 7f60b37fe640 1 -- 172.21.15.172:0/1115370775 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b40d1c50 con 0x7f60b415dbe0 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.805+0000 7f60b3fff640 1 --2- 172.21.15.172:0/1115370775 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b40b92a0 0x7f60b40d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.805+0000 7f60b37fe640 1 --2- 172.21.15.172:0/1115370775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b415dbe0 0x7f60b40d0910 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009870 tx=0x7f60a402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fc343c01a38a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.805+0000 7f60b2ffd640 1 -- 172.21.15.172:0/1115370775 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4037070 con 0x7f60b415dbe0 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.806+0000 7f60b2ffd640 1 -- 172.21.15.172:0/1115370775 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a4032440 con 0x7f60b415dbe0 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.806+0000 7f60b2ffd640 1 -- 172.21.15.172:0/1115370775 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4032810 con 0x7f60b415dbe0 2024-04-25T08:49:05.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.806+0000 7f60ba114640 1 -- 172.21.15.172:0/1115370775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b415dbe0 msgr2=0x7f60b40d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.806+0000 7f60ba114640 1 --2- 172.21.15.172:0/1115370775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b415dbe0 0x7f60b40d0910 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009870 tx=0x7f60a402a250 comp rx=0 tx=0).stop 2024-04-25T08:49:05.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.806+0000 7f60ba114640 1 -- 172.21.15.172:0/1115370775 shutdown_connections 2024-04-25T08:49:05.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.806+0000 7f60ba114640 1 --2- 172.21.15.172:0/1115370775 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b40b92a0 0x7f60b40d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.806+0000 7f60ba114640 1 --2- 172.21.15.172:0/1115370775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b415dbe0 0x7f60b40d0910 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.806+0000 7f60ba114640 1 -- 172.21.15.172:0/1115370775 >> 172.21.15.172:0/1115370775 conn(0x7f60b4061a20 msgr2=0x7f60b4061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:05.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.806+0000 7f60ba114640 1 -- 172.21.15.172:0/1115370775 shutdown_connections 2024-04-25T08:49:05.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.806+0000 7f60ba114640 1 -- 172.21.15.172:0/1115370775 wait complete. 2024-04-25T08:49:05.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.807+0000 7f60ba114640 1 Processor -- start 2024-04-25T08:49:05.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.807+0000 7f60ba114640 1 -- start start 2024-04-25T08:49:05.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60ba114640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60b40b2cb0 0x7f60b40caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60ba114640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b40b92a0 0x7f60b4147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60ba114640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b415dbe0 0x7f60b40b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60ba114640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40b6ab0 con 0x7f60b40b92a0 2024-04-25T08:49:05.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60ba114640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40d2210 con 0x7f60b40b2cb0 2024-04-25T08:49:05.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60ba114640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b40b6c30 con 0x7f60b415dbe0 2024-04-25T08:49:05.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60aaffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b40b92a0 0x7f60b4147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60aaffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b40b92a0 0x7f60b4147e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51050/0 (socket says 172.21.15.172:51050) 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60aaffd640 1 -- 172.21.15.172:0/2694545858 learned_addr learned my addr 172.21.15.172:0/2694545858 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60b37fe640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60b40b2cb0 0x7f60b40caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.808+0000 7f60b3fff640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b415dbe0 0x7f60b40b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60aaffd640 1 -- 172.21.15.172:0/2694545858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b415dbe0 msgr2=0x7f60b40b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60aaffd640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b415dbe0 0x7f60b40b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60aaffd640 1 -- 172.21.15.172:0/2694545858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60b40b2cb0 msgr2=0x7f60b40caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60aaffd640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60b40b2cb0 0x7f60b40caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60aaffd640 1 -- 172.21.15.172:0/2694545858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b40b4c20 con 0x7f60b40b92a0 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60b37fe640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60b40b2cb0 0x7f60b40caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60aaffd640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b40b92a0 0x7f60b4147e60 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c440 tx=0x7f609c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60b0ff9640 1 -- 172.21.15.172:0/2694545858 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c0052d0 con 0x7f60b40b92a0 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60b0ff9640 1 -- 172.21.15.172:0/2694545858 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c005470 con 0x7f60b40b92a0 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60ba114640 1 -- 172.21.15.172:0/2694545858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b40b5070 con 0x7f60b40b92a0 2024-04-25T08:49:05.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60b0ff9640 1 -- 172.21.15.172:0/2694545858 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c007260 con 0x7f60b40b92a0 2024-04-25T08:49:05.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.809+0000 7f60ba114640 1 -- 172.21.15.172:0/2694545858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b41f3c00 con 0x7f60b40b92a0 2024-04-25T08:49:05.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.810+0000 7f60ba114640 1 -- 172.21.15.172:0/2694545858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b4073990 con 0x7f60b40b92a0 2024-04-25T08:49:05.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.810+0000 7f60b0ff9640 1 -- 172.21.15.172:0/2694545858 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f609c007400 con 0x7f60b40b92a0 2024-04-25T08:49:05.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.811+0000 7f60b0ff9640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f609406b4d0 0x7f609406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:05.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.811+0000 7f60b37fe640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f609406b4d0 0x7f609406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:05.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.811+0000 7f60b0ff9640 1 -- 172.21.15.172:0/2694545858 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f609c0898a0 con 0x7f60b40b92a0 2024-04-25T08:49:05.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.811+0000 7f60b37fe640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f609406b4d0 0x7f609406d990 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f60a4034000 tx=0x7f60a402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:05.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:05.815+0000 7f60b0ff9640 1 -- 172.21.15.172:0/2694545858 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f60b40b4c20 con 0x7f60b40b92a0 2024-04-25T08:49:06.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.020+0000 7f60ba114640 1 -- 172.21.15.172:0/2694545858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60b406c850 con 0x7f60b40b92a0 2024-04-25T08:49:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.021+0000 7f60b0ff9640 1 -- 172.21.15.172:0/2694545858 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f609c058590 con 0x7f60b40b92a0 2024-04-25T08:49:06.012 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:06.012 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/154236059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":154236059},{"type":"v1","addr":"172.21.15.172:6837","nonce":154236059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/985041095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":985041095},{"type":"v1","addr":"172.21.15.186:6835","nonce":985041095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7686,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1301700155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1301700155},{"type":"v1","addr":"172.21.15.172:6836","nonce":1301700155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:48:38.741906+0000","modified":"2024-04-25T08:48:40.732152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"d","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6834/246475597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":246475597},{"type":"v1","addr":"172.21.15.186:6834","nonce":246475597}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T08:49:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 56 2024-04-25T08:49:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 -- 172.21.15.172:0/2694545858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f609406b4d0 msgr2=0x7f609406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f609406b4d0 0x7f609406d990 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f60a4034000 tx=0x7f60a402e000 comp rx=0 tx=0).stop 2024-04-25T08:49:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 -- 172.21.15.172:0/2694545858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b40b92a0 msgr2=0x7f60b4147e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b40b92a0 0x7f60b4147e60 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c440 tx=0x7f609c001e70 comp rx=0 tx=0).stop 2024-04-25T08:49:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 -- 172.21.15.172:0/2694545858 shutdown_connections 2024-04-25T08:49:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f609406b4d0 0x7f609406d990 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60b415dbe0 0x7f60b40b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60b40b92a0 0x7f60b4147e60 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 --2- 172.21.15.172:0/2694545858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60b40b2cb0 0x7f60b40caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 -- 172.21.15.172:0/2694545858 >> 172.21.15.172:0/2694545858 conn(0x7f60b4061a20 msgr2=0x7f60b415c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:06.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 -- 172.21.15.172:0/2694545858 shutdown_connections 2024-04-25T08:49:06.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.023+0000 7f60ba114640 1 -- 172.21.15.172:0/2694545858 wait complete. 2024-04-25T08:49:06.025 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:06.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.132+0000 7efebb2fc640 1 Processor -- start 2024-04-25T08:49:06.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.132+0000 7efebb2fc640 1 -- start start 2024-04-25T08:49:06.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efebb2fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efeb4071ac0 0x7efeb40ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efebb2fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb406c1d0 0x7efeb406afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efebb2fc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb415ec60 con 0x7efeb4154ed0 2024-04-25T08:49:06.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efebb2fc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb415ef40 con 0x7efeb4071ac0 2024-04-25T08:49:06.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efebb2fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb406db90 con 0x7efeb406c1d0 2024-04-25T08:49:06.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efeb8897640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efeb4071ac0 0x7efeb40ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efeb9098640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efeb4154ed0 0x7efeb40aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:36452/0 (socket says 172.21.15.172:36452) 2024-04-25T08:49:06.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efeb9098640 1 -- 172.21.15.172:0/2341998019 learned_addr learned my addr 172.21.15.172:0/2341998019 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:06.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efeb8897640 1 -- 172.21.15.172:0/2341998019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb406c1d0 msgr2=0x7efeb406afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:06.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efeb9899640 1 --2- 172.21.15.172:0/2341998019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb406c1d0 0x7efeb406afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efeb8897640 1 --2- 172.21.15.172:0/2341998019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb406c1d0 0x7efeb406afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efeabfff640 1 -- 172.21.15.172:0/2341998019 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180931956 0 0) 0x7efeb415ec60 con 0x7efeb4154ed0 2024-04-25T08:49:06.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efeb8897640 1 -- 172.21.15.172:0/2341998019 >> v1:172.21.15.172:6789/0 conn(0x7efeb4154ed0 legacy=0x7efeb40aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efeb8897640 1 -- 172.21.15.172:0/2341998019 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb406de70 con 0x7efeb4071ac0 2024-04-25T08:49:06.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.133+0000 7efeb9899640 1 --2- 172.21.15.172:0/2341998019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb406c1d0 0x7efeb406afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.134+0000 7efeb8897640 1 --2- 172.21.15.172:0/2341998019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb4071ac0 0x7efeb40ad5e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7efea40097a0 tx=0x7efea402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab529df14cb6b796 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.134+0000 7efeabfff640 1 -- 172.21.15.172:0/2341998019 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4037070 con 0x7efeb4071ac0 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.134+0000 7efeabfff640 1 -- 172.21.15.172:0/2341998019 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea4032440 con 0x7efeb4071ac0 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.134+0000 7efeabfff640 1 -- 172.21.15.172:0/2341998019 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4032810 con 0x7efeb4071ac0 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.134+0000 7efebb2fc640 1 -- 172.21.15.172:0/2341998019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb4071ac0 msgr2=0x7efeb40ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.134+0000 7efebb2fc640 1 --2- 172.21.15.172:0/2341998019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb4071ac0 0x7efeb40ad5e0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7efea40097a0 tx=0x7efea402a180 comp rx=0 tx=0).stop 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.134+0000 7efebb2fc640 1 -- 172.21.15.172:0/2341998019 shutdown_connections 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.135+0000 7efebb2fc640 1 --2- 172.21.15.172:0/2341998019 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb406c1d0 0x7efeb406afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.135+0000 7efebb2fc640 1 --2- 172.21.15.172:0/2341998019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb4071ac0 0x7efeb40ad5e0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.135+0000 7efebb2fc640 1 -- 172.21.15.172:0/2341998019 >> 172.21.15.172:0/2341998019 conn(0x7efeb40af670 msgr2=0x7efeb40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.135+0000 7efebb2fc640 1 -- 172.21.15.172:0/2341998019 shutdown_connections 2024-04-25T08:49:06.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.135+0000 7efebb2fc640 1 -- 172.21.15.172:0/2341998019 wait complete. 2024-04-25T08:49:06.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.136+0000 7efebb2fc640 1 Processor -- start 2024-04-25T08:49:06.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.136+0000 7efebb2fc640 1 -- start start 2024-04-25T08:49:06.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.136+0000 7efebb2fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efeb4071ac0 0x7efeb40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.136+0000 7efebb2fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb4154ed0 0x7efeb4142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.136+0000 7efebb2fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb40b2ce0 0x7efeb40b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.136+0000 7efebb2fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb406b660 con 0x7efeb40b2ce0 2024-04-25T08:49:06.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.136+0000 7efebb2fc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb406b4e0 con 0x7efeb4071ac0 2024-04-25T08:49:06.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.136+0000 7efebb2fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb406b7e0 con 0x7efeb4154ed0 2024-04-25T08:49:06.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb9899640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb40b2ce0 0x7efeb40b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb9899640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb40b2ce0 0x7efeb40b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51058/0 (socket says 172.21.15.172:51058) 2024-04-25T08:49:06.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb9899640 1 -- 172.21.15.172:0/3515300589 learned_addr learned my addr 172.21.15.172:0/3515300589 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:06.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb8897640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb4154ed0 0x7efeb4142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb9098640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efeb4071ac0 0x7efeb40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb9899640 1 -- 172.21.15.172:0/3515300589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb4154ed0 msgr2=0x7efeb4142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb9899640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb4154ed0 0x7efeb4142860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb9899640 1 -- 172.21.15.172:0/3515300589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efeb4071ac0 msgr2=0x7efeb40b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb9899640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efeb4071ac0 0x7efeb40b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb9899640 1 -- 172.21.15.172:0/3515300589 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb4142da0 con 0x7efeb40b2ce0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efeb9899640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb40b2ce0 0x7efeb40b0be0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7efeac00ce40 tx=0x7efeac00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efea9ffb640 1 -- 172.21.15.172:0/3515300589 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac01a070 con 0x7efeb40b2ce0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efea9ffb640 1 -- 172.21.15.172:0/3515300589 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac00d840 con 0x7efeb40b2ce0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efebb2fc640 1 -- 172.21.15.172:0/3515300589 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb40b48b0 con 0x7efeb40b2ce0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efea9ffb640 1 -- 172.21.15.172:0/3515300589 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00dc30 con 0x7efeb40b2ce0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.137+0000 7efebb2fc640 1 -- 172.21.15.172:0/3515300589 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb40b3530 con 0x7efeb40b2ce0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.138+0000 7efebb2fc640 1 -- 172.21.15.172:0/3515300589 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb40b2b10 con 0x7efeb40b2ce0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.139+0000 7efea9ffb640 1 -- 172.21.15.172:0/3515300589 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efeac01d070 con 0x7efeb40b2ce0 2024-04-25T08:49:06.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.139+0000 7efea9ffb640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe9806b500 0x7efe9806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.139+0000 7efea9ffb640 1 -- 172.21.15.172:0/3515300589 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efeac08ab40 con 0x7efeb40b2ce0 2024-04-25T08:49:06.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.139+0000 7efeb9098640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe9806b500 0x7efe9806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.140+0000 7efeb9098640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe9806b500 0x7efe9806d9c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efeb0000f60 tx=0x7efeb0007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:06.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.143+0000 7efea9ffb640 1 -- 172.21.15.172:0/3515300589 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efeb4142da0 con 0x7efeb40b2ce0 2024-04-25T08:49:06.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.313+0000 7efebb2fc640 1 -- 172.21.15.172:0/3515300589 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeb4073990 con 0x7efeb40b2ce0 2024-04-25T08:49:06.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.314+0000 7efea9ffb640 1 -- 172.21.15.172:0/3515300589 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16945 (secure 0 0 0) 0x7efeac059830 con 0x7efeb40b2ce0 2024-04-25T08:49:06.305 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:06.305 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":95,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:48:40.385755+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:48:36.951495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T08:48:37.702925+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:06.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 -- 172.21.15.172:0/3515300589 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe9806b500 msgr2=0x7efe9806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe9806b500 0x7efe9806d9c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efeb0000f60 tx=0x7efeb0007c00 comp rx=0 tx=0).stop 2024-04-25T08:49:06.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 -- 172.21.15.172:0/3515300589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb40b2ce0 msgr2=0x7efeb40b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb40b2ce0 0x7efeb40b0be0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7efeac00ce40 tx=0x7efeac00a710 comp rx=0 tx=0).stop 2024-04-25T08:49:06.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 -- 172.21.15.172:0/3515300589 shutdown_connections 2024-04-25T08:49:06.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efe9806b500 0x7efe9806d9c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeb40b2ce0 0x7efeb40b0be0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efeb4154ed0 0x7efeb4142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 --2- 172.21.15.172:0/3515300589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efeb4071ac0 0x7efeb40b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 -- 172.21.15.172:0/3515300589 >> 172.21.15.172:0/3515300589 conn(0x7efeb406c1d0 msgr2=0x7efeb415f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:06.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 -- 172.21.15.172:0/3515300589 shutdown_connections 2024-04-25T08:49:06.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.316+0000 7efebb2fc640 1 -- 172.21.15.172:0/3515300589 wait complete. 2024-04-25T08:49:06.319 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:49:06.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.427+0000 7f4e7dbfe640 1 Processor -- start 2024-04-25T08:49:06.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.427+0000 7f4e7dbfe640 1 -- start start 2024-04-25T08:49:06.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e7dbfe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4e781446d0 0x7f4e780b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e7dbfe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e7806e8a0 0x7f4e780b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e7dbfe640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e780cccc0 con 0x7f4e78144d50 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e7dbfe640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e780b2b20 con 0x7f4e781446d0 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e7dbfe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7806d400 con 0x7f4e7806e8a0 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e777fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4e781446d0 0x7f4e780b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e777fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4e781446d0 0x7f4e780b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51064/0 (socket says 172.21.15.172:51064) 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e777fe640 1 -- 172.21.15.172:0/274841770 learned_addr learned my addr 172.21.15.172:0/274841770 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e77fff640 1 --2- 172.21.15.172:0/274841770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e7806e8a0 0x7f4e780b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e777fe640 1 -- 172.21.15.172:0/274841770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e7806e8a0 msgr2=0x7f4e780b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e777fe640 1 --2- 172.21.15.172:0/274841770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e7806e8a0 0x7f4e780b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e777fe640 1 -- 172.21.15.172:0/274841770 >> v1:172.21.15.186:6789/0 conn(0x7f4e78144d50 legacy=0x7f4e780cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.428+0000 7f4e777fe640 1 -- 172.21.15.172:0/274841770 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e780cc140 con 0x7f4e781446d0 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e777fe640 1 --2- 172.21.15.172:0/274841770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e781446d0 0x7f4e780b3f20 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009870 tx=0x7f4e6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3657498a638dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e767fc640 1 -- 172.21.15.172:0/274841770 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68037070 con 0x7f4e781446d0 2024-04-25T08:49:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e767fc640 1 -- 172.21.15.172:0/274841770 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e68032440 con 0x7f4e781446d0 2024-04-25T08:49:06.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e767fc640 1 -- 172.21.15.172:0/274841770 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68032810 con 0x7f4e781446d0 2024-04-25T08:49:06.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/274841770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e781446d0 msgr2=0x7f4e780b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e7dbfe640 1 --2- 172.21.15.172:0/274841770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e781446d0 0x7f4e780b3f20 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009870 tx=0x7f4e6802a270 comp rx=0 tx=0).stop 2024-04-25T08:49:06.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/274841770 shutdown_connections 2024-04-25T08:49:06.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e7dbfe640 1 --2- 172.21.15.172:0/274841770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e7806e8a0 0x7f4e780b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e7dbfe640 1 --2- 172.21.15.172:0/274841770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e781446d0 0x7f4e780b3f20 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/274841770 >> 172.21.15.172:0/274841770 conn(0x7f4e7806abe0 msgr2=0x7f4e7806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:06.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.429+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/274841770 shutdown_connections 2024-04-25T08:49:06.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.430+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/274841770 wait complete. 2024-04-25T08:49:06.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.431+0000 7f4e7dbfe640 1 Processor -- start 2024-04-25T08:49:06.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.431+0000 7f4e7dbfe640 1 -- start start 2024-04-25T08:49:06.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.431+0000 7f4e7dbfe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e7806e8a0 0x7f4e7813b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.431+0000 7f4e7dbfe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e781446d0 0x7f4e780aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.431+0000 7f4e7dbfe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e78144d50 0x7f4e780ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.431+0000 7f4e7dbfe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780cc700 con 0x7f4e78144d50 2024-04-25T08:49:06.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.431+0000 7f4e7dbfe640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780b49a0 con 0x7f4e7806e8a0 2024-04-25T08:49:06.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.431+0000 7f4e7dbfe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780cc9e0 con 0x7f4e781446d0 2024-04-25T08:49:06.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e77fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e78144d50 0x7f4e780ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e77fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e78144d50 0x7f4e780ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51074/0 (socket says 172.21.15.172:51074) 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e77fff640 1 -- 172.21.15.172:0/3473447418 learned_addr learned my addr 172.21.15.172:0/3473447418 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e777fe640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e7806e8a0 0x7f4e7813b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e76ffd640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e781446d0 0x7f4e780aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e77fff640 1 -- 172.21.15.172:0/3473447418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e781446d0 msgr2=0x7f4e780aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e77fff640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e781446d0 0x7f4e780aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e77fff640 1 -- 172.21.15.172:0/3473447418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e7806e8a0 msgr2=0x7f4e7813b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e77fff640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e7806e8a0 0x7f4e7813b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e77fff640 1 -- 172.21.15.172:0/3473447418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7813e410 con 0x7f4e78144d50 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e76ffd640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e781446d0 0x7f4e780aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e77fff640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e78144d50 0x7f4e780ab460 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f4e70007e30 tx=0x7f4e7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:06.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e5ffff640 1 -- 172.21.15.172:0/3473447418 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70014620 con 0x7f4e78144d50 2024-04-25T08:49:06.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e5ffff640 1 -- 172.21.15.172:0/3473447418 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e70019070 con 0x7f4e78144d50 2024-04-25T08:49:06.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/3473447418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7813e6f0 con 0x7f4e78144d50 2024-04-25T08:49:06.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e5ffff640 1 -- 172.21.15.172:0/3473447418 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70014a00 con 0x7f4e78144d50 2024-04-25T08:49:06.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.432+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/3473447418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e780a8af0 con 0x7f4e78144d50 2024-04-25T08:49:06.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.433+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/3473447418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e780a8cf0 con 0x7f4e78144d50 2024-04-25T08:49:06.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.434+0000 7f4e5ffff640 1 -- 172.21.15.172:0/3473447418 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4e70014ba0 con 0x7f4e78144d50 2024-04-25T08:49:06.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.434+0000 7f4e5ffff640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4e6406b4d0 0x7f4e6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.434+0000 7f4e5ffff640 1 -- 172.21.15.172:0/3473447418 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4e7008ac80 con 0x7f4e78144d50 2024-04-25T08:49:06.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.434+0000 7f4e777fe640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4e6406b4d0 0x7f4e6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.434+0000 7f4e777fe640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4e6406b4d0 0x7f4e6406d990 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4e68034000 tx=0x7f4e6802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:06.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.438+0000 7f4e5ffff640 1 -- 172.21.15.172:0/3473447418 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e780a8cf0 con 0x7f4e78144d50 2024-04-25T08:49:06.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.646+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/3473447418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4e78142be0 con 0x7f4e78144d50 2024-04-25T08:49:06.638 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:49:06.647+0000 7f9412b2f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:49:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.648+0000 7f4e5ffff640 1 -- 172.21.15.172:0/3473447418 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4e70059970 con 0x7f4e78144d50 2024-04-25T08:49:06.639 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:49:06.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/3473447418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4e6406b4d0 msgr2=0x7f4e6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4e6406b4d0 0x7f4e6406d990 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4e68034000 tx=0x7f4e6802e000 comp rx=0 tx=0).stop 2024-04-25T08:49:06.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/3473447418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e78144d50 msgr2=0x7f4e780ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e78144d50 0x7f4e780ab460 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f4e70007e30 tx=0x7f4e7000e4b0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/3473447418 shutdown_connections 2024-04-25T08:49:06.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4e6406b4d0 0x7f4e6406d990 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e78144d50 0x7f4e780ab460 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e781446d0 0x7f4e780aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 --2- 172.21.15.172:0/3473447418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e7806e8a0 0x7f4e7813b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/3473447418 >> 172.21.15.172:0/3473447418 conn(0x7f4e7806abe0 msgr2=0x7f4e781433e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:06.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/3473447418 shutdown_connections 2024-04-25T08:49:06.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.651+0000 7f4e7dbfe640 1 -- 172.21.15.172:0/3473447418 wait complete. 2024-04-25T08:49:06.653 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:49:06.682 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:49:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.764+0000 7f9be8c3a640 1 Processor -- start 2024-04-25T08:49:06.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.764+0000 7f9be8c3a640 1 -- start start 2024-04-25T08:49:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be8c3a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9be4070dc0 0x7f9be406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be8c3a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9be40711a0 0x7f9be40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be8c3a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40b4830 0x7f9be40b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be8c3a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be41622b0 con 0x7f9be40711a0 2024-04-25T08:49:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be8c3a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be40b10f0 con 0x7f9be4070dc0 2024-04-25T08:49:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be8c3a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be40d1770 con 0x7f9be40b4830 2024-04-25T08:49:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be1d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9be40711a0 0x7f9be40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be1d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9be40711a0 0x7f9be40b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51090/0 (socket says 172.21.15.172:51090) 2024-04-25T08:49:06.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be1d9b640 1 -- 172.21.15.172:0/3443010685 learned_addr learned my addr 172.21.15.172:0/3443010685 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be259c640 1 --2- 172.21.15.172:0/3443010685 >> v2:172.21.15.186:3300/0 conn(0x7f9be4070dc0 0x7f9be406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be2d9d640 1 --2- 172.21.15.172:0/3443010685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40b4830 0x7f9be40b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be1d9b640 1 -- 172.21.15.172:0/3443010685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40b4830 msgr2=0x7f9be40b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be1d9b640 1 --2- 172.21.15.172:0/3443010685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40b4830 0x7f9be40b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be1d9b640 1 -- 172.21.15.172:0/3443010685 >> v2:172.21.15.186:3300/0 conn(0x7f9be4070dc0 msgr2=0x7f9be406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be1d9b640 1 --2- 172.21.15.172:0/3443010685 >> v2:172.21.15.186:3300/0 conn(0x7f9be4070dc0 0x7f9be406ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be1d9b640 1 -- 172.21.15.172:0/3443010685 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4162740 con 0x7f9be40711a0 2024-04-25T08:49:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be259c640 1 --2- 172.21.15.172:0/3443010685 >> v2:172.21.15.186:3300/0 conn(0x7f9be4070dc0 0x7f9be406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:06.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.765+0000 7f9be2d9d640 1 --2- 172.21.15.172:0/3443010685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40b4830 0x7f9be40b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be1d9b640 1 --2- 172.21.15.172:0/3443010685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40711a0 0x7f9be40b07a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f9be4070a00 tx=0x7f9bd802a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fb70092d04a225 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be159a640 1 -- 172.21.15.172:0/3443010685 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8037070 con 0x7f9be40711a0 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be159a640 1 -- 172.21.15.172:0/3443010685 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd802adf0 con 0x7f9be40711a0 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be159a640 1 -- 172.21.15.172:0/3443010685 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8032660 con 0x7f9be40711a0 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3443010685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40711a0 msgr2=0x7f9be40b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be8c3a640 1 --2- 172.21.15.172:0/3443010685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40711a0 0x7f9be40b07a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f9be4070a00 tx=0x7f9bd802a0e0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3443010685 shutdown_connections 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be8c3a640 1 --2- 172.21.15.172:0/3443010685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40b4830 0x7f9be40b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be8c3a640 1 --2- 172.21.15.172:0/3443010685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40711a0 0x7f9be40b07a0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be8c3a640 1 --2- 172.21.15.172:0/3443010685 >> v2:172.21.15.186:3300/0 conn(0x7f9be4070dc0 0x7f9be406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.766+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3443010685 >> 172.21.15.172:0/3443010685 conn(0x7f9be40b3530 msgr2=0x7f9be40b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.767+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3443010685 shutdown_connections 2024-04-25T08:49:06.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.767+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3443010685 wait complete. 2024-04-25T08:49:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.768+0000 7f9be8c3a640 1 Processor -- start 2024-04-25T08:49:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.768+0000 7f9be8c3a640 1 -- start start 2024-04-25T08:49:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be8c3a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9be4070dc0 0x7f9be415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be8c3a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40711a0 0x7f9be41482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be8c3a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40b4830 0x7f9be4160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be8c3a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be4161f40 con 0x7f9be40b4830 2024-04-25T08:49:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be8c3a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be4161c60 con 0x7f9be4070dc0 2024-04-25T08:49:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be8c3a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be4071630 con 0x7f9be40711a0 2024-04-25T08:49:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40b4830 0x7f9be4160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40b4830 0x7f9be4160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51094/0 (socket says 172.21.15.172:51094) 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be2d9d640 1 -- 172.21.15.172:0/3015740998 learned_addr learned my addr 172.21.15.172:0/3015740998 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be1d9b640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40711a0 0x7f9be41482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be259c640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9be4070dc0 0x7f9be415deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be2d9d640 1 -- 172.21.15.172:0/3015740998 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40711a0 msgr2=0x7f9be41482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be2d9d640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40711a0 0x7f9be41482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be2d9d640 1 -- 172.21.15.172:0/3015740998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9be4070dc0 msgr2=0x7f9be415deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be2d9d640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9be4070dc0 0x7f9be415deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be2d9d640 1 -- 172.21.15.172:0/3015740998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be415e490 con 0x7f9be40b4830 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be2d9d640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40b4830 0x7f9be4160370 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00cd80 tx=0x7f9bdc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9bd2ffd640 1 -- 172.21.15.172:0/3015740998 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00f680 con 0x7f9be40b4830 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9bd2ffd640 1 -- 172.21.15.172:0/3015740998 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc00f840 con 0x7f9be40b4830 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3015740998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be415e770 con 0x7f9be40b4830 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9bd2ffd640 1 -- 172.21.15.172:0/3015740998 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00fc30 con 0x7f9be40b4830 2024-04-25T08:49:06.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.769+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3015740998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be415ed30 con 0x7f9be40b4830 2024-04-25T08:49:06.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.770+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3015740998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be4073a00 con 0x7f9be40b4830 2024-04-25T08:49:06.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.771+0000 7f9bd2ffd640 1 -- 172.21.15.172:0/3015740998 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9bdc0213f0 con 0x7f9be40b4830 2024-04-25T08:49:06.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.771+0000 7f9bd2ffd640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9bc406b4d0 0x7f9bc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:06.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.771+0000 7f9bd2ffd640 1 -- 172.21.15.172:0/3015740998 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9bdc08b200 con 0x7f9be40b4830 2024-04-25T08:49:06.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.771+0000 7f9be259c640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9bc406b4d0 0x7f9bc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:06.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.772+0000 7f9be259c640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9bc406b4d0 0x7f9bc406d990 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4006b10 tx=0x7f9bd4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:06.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.776+0000 7f9bd2ffd640 1 -- 172.21.15.172:0/3015740998 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9bdc014030 con 0x7f9be40b4830 2024-04-25T08:49:06.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:06.981+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3015740998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9be40cf360 con 0x7f9be40b4830 2024-04-25T08:49:07.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.650+0000 7f9bd2ffd640 1 -- 172.21.15.172:0/3015740998 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9bdc059ea0 con 0x7f9be40b4830 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.652+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3015740998 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9bc406b4d0 msgr2=0x7f9bc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.652+0000 7f9be8c3a640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9bc406b4d0 0x7f9bc406d990 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4006b10 tx=0x7f9bd4008040 comp rx=0 tx=0).stop 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.652+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3015740998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40b4830 msgr2=0x7f9be4160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.652+0000 7f9be8c3a640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40b4830 0x7f9be4160370 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00cd80 tx=0x7f9bdc00a650 comp rx=0 tx=0).stop 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.652+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3015740998 shutdown_connections 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.652+0000 7f9be8c3a640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9bc406b4d0 0x7f9bc406d990 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.652+0000 7f9be8c3a640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9be40b4830 0x7f9be4160370 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.652+0000 7f9be8c3a640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9be40711a0 0x7f9be41482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.652+0000 7f9be8c3a640 1 --2- 172.21.15.172:0/3015740998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9be4070dc0 0x7f9be415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.652+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3015740998 >> 172.21.15.172:0/3015740998 conn(0x7f9be40b3530 msgr2=0x7f9be40b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.653+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3015740998 shutdown_connections 2024-04-25T08:49:07.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.653+0000 7f9be8c3a640 1 -- 172.21.15.172:0/3015740998 wait complete. 2024-04-25T08:49:07.656 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:49:07.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.768+0000 7f5b344bc640 1 Processor -- start 2024-04-25T08:49:07.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.768+0000 7f5b344bc640 1 -- start start 2024-04-25T08:49:07.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b344bc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5b2c162140 0x7f5b2c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:07.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b344bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5b2c0cd540 0x7f5b2c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:07.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b344bc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c15e3a0 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b344bc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c1625c0 con 0x7f5b2c0cd540 2024-04-25T08:49:07.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b344bc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c0cd9d0 con 0x7f5b2c162140 2024-04-25T08:49:07.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b32a59640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5b2c0cd540 0x7f5b2c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:07.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b32a59640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5b2c0cd540 0x7f5b2c0caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50498/0 (socket says 172.21.15.172:50498) 2024-04-25T08:49:07.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b32a59640 1 -- 172.21.15.172:0/3840002285 learned_addr learned my addr 172.21.15.172:0/3840002285 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:07.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b31a57640 1 --2- 172.21.15.172:0/3840002285 >> v2:172.21.15.186:3300/0 conn(0x7f5b2c162140 0x7f5b2c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:07.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b32a59640 1 -- 172.21.15.172:0/3840002285 >> v2:172.21.15.186:3300/0 conn(0x7f5b2c162140 msgr2=0x7f5b2c0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:07.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b32a59640 1 --2- 172.21.15.172:0/3840002285 >> v2:172.21.15.186:3300/0 conn(0x7f5b2c162140 0x7f5b2c0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:07.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b32a59640 1 -- 172.21.15.172:0/3840002285 >> v1:172.21.15.186:6789/0 conn(0x7f5b2c0d0a00 legacy=0x7f5b2c0d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:07.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b32a59640 1 -- 172.21.15.172:0/3840002285 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0cdc70 con 0x7f5b2c0cd540 2024-04-25T08:49:07.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.769+0000 7f5b31a57640 1 --2- 172.21.15.172:0/3840002285 >> v2:172.21.15.186:3300/0 conn(0x7f5b2c162140 0x7f5b2c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:07.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.770+0000 7f5b32a59640 1 --2- 172.21.15.172:0/3840002285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0cd540 0x7f5b2c0caad0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06ded0 tx=0x7f5b2402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55e8bb94ed7175a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:07.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.770+0000 7f5b31256640 1 -- 172.21.15.172:0/3840002285 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24036070 con 0x7f5b2c0cd540 2024-04-25T08:49:07.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.770+0000 7f5b31256640 1 -- 172.21.15.172:0/3840002285 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b24031600 con 0x7f5b2c0cd540 2024-04-25T08:49:07.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.770+0000 7f5b31256640 1 -- 172.21.15.172:0/3840002285 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240319d0 con 0x7f5b2c0cd540 2024-04-25T08:49:07.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.771+0000 7f5b344bc640 1 -- 172.21.15.172:0/3840002285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0cd540 msgr2=0x7f5b2c0caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:07.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.771+0000 7f5b344bc640 1 --2- 172.21.15.172:0/3840002285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0cd540 0x7f5b2c0caad0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06ded0 tx=0x7f5b2402a660 comp rx=0 tx=0).stop 2024-04-25T08:49:07.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.771+0000 7f5b344bc640 1 -- 172.21.15.172:0/3840002285 shutdown_connections 2024-04-25T08:49:07.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.771+0000 7f5b344bc640 1 --2- 172.21.15.172:0/3840002285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0cd540 0x7f5b2c0caad0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:07.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.771+0000 7f5b344bc640 1 --2- 172.21.15.172:0/3840002285 >> v2:172.21.15.186:3300/0 conn(0x7f5b2c162140 0x7f5b2c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:07.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.771+0000 7f5b344bc640 1 -- 172.21.15.172:0/3840002285 >> 172.21.15.172:0/3840002285 conn(0x7f5b2c0d17c0 msgr2=0x7f5b2c0d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.771+0000 7f5b344bc640 1 -- 172.21.15.172:0/3840002285 shutdown_connections 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.771+0000 7f5b344bc640 1 -- 172.21.15.172:0/3840002285 wait complete. 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.772+0000 7f5b344bc640 1 Processor -- start 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.772+0000 7f5b344bc640 1 -- start start 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b344bc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b2c0cd540 0x7f5b2c142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b344bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0d0a00 0x7f5b2c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b344bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b2c162140 0x7f5b2c0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b344bc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c161940 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b344bc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c161660 con 0x7f5b2c0cd540 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b344bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c161c20 con 0x7f5b2c162140 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b31a57640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0d0a00 0x7f5b2c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b31a57640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0d0a00 0x7f5b2c0cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50502/0 (socket says 172.21.15.172:50502) 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b31a57640 1 -- 172.21.15.172:0/3264761070 learned_addr learned my addr 172.21.15.172:0/3264761070 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b32258640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b2c0cd540 0x7f5b2c142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b32a59640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b2c162140 0x7f5b2c0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b31a57640 1 -- 172.21.15.172:0/3264761070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b2c162140 msgr2=0x7f5b2c0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b31a57640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b2c162140 0x7f5b2c0cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b31a57640 1 -- 172.21.15.172:0/3264761070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b2c0cd540 msgr2=0x7f5b2c142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b31a57640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b2c0cd540 0x7f5b2c142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b31a57640 1 -- 172.21.15.172:0/3264761070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c143400 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b32258640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b2c0cd540 0x7f5b2c142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b31a57640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0d0a00 0x7f5b2c0cf3d0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c7f0 tx=0x7f5b1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b22ffd640 1 -- 172.21.15.172:0/3264761070 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c015070 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b22ffd640 1 -- 172.21.15.172:0/3264761070 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c007820 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b344bc640 1 -- 172.21.15.172:0/3264761070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c1301d0 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b22ffd640 1 -- 172.21.15.172:0/3264761070 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c007bd0 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.773+0000 7f5b344bc640 1 -- 172.21.15.172:0/3264761070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c130790 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.774+0000 7f5b344bc640 1 -- 172.21.15.172:0/3264761070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c073a00 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.775+0000 7f5b22ffd640 1 -- 172.21.15.172:0/3264761070 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b1c018070 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.775+0000 7f5b22ffd640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b1006b4d0 0x7f5b1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:07.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.775+0000 7f5b22ffd640 1 -- 172.21.15.172:0/3264761070 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f5b1c08a510 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.775+0000 7f5b32258640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b1006b4d0 0x7f5b1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:07.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.775+0000 7f5b32258640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b1006b4d0 0x7f5b1006d990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0b4af0 tx=0x7f5b28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:07.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.779+0000 7f5b22ffd640 1 -- 172.21.15.172:0/3264761070 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b1c0591b0 con 0x7f5b2c0d0a00 2024-04-25T08:49:07.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:07.950+0000 7f5b344bc640 1 -- 172.21.15.172:0/3264761070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5b2c15ea40 con 0x7f5b2c0d0a00 2024-04-25T08:49:08.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.651+0000 7f5b22ffd640 1 -- 172.21.15.172:0/3264761070 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5b1c058ab0 con 0x7f5b2c0d0a00 2024-04-25T08:49:08.642 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:49:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 -- 172.21.15.172:0/3264761070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b1006b4d0 msgr2=0x7f5b1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b1006b4d0 0x7f5b1006d990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0b4af0 tx=0x7f5b28009040 comp rx=0 tx=0).stop 2024-04-25T08:49:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 -- 172.21.15.172:0/3264761070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0d0a00 msgr2=0x7f5b2c0cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0d0a00 0x7f5b2c0cf3d0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c7f0 tx=0x7f5b1c00ccb0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 -- 172.21.15.172:0/3264761070 shutdown_connections 2024-04-25T08:49:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5b1006b4d0 0x7f5b1006d990 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b2c162140 0x7f5b2c0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b2c0d0a00 0x7f5b2c0cf3d0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 --2- 172.21.15.172:0/3264761070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b2c0cd540 0x7f5b2c142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 -- 172.21.15.172:0/3264761070 >> 172.21.15.172:0/3264761070 conn(0x7f5b2c0d17c0 msgr2=0x7f5b2c1601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 -- 172.21.15.172:0/3264761070 shutdown_connections 2024-04-25T08:49:08.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.654+0000 7f5b344bc640 1 -- 172.21.15.172:0/3264761070 wait complete. 2024-04-25T08:49:08.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:49:08.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.770+0000 7fc39b522640 1 Processor -- start 2024-04-25T08:49:08.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.771+0000 7fc39b522640 1 -- start start 2024-04-25T08:49:08.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.771+0000 7fc39b522640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3940cc4f0 0x7fc3940cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.771+0000 7fc39b522640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc3940cdb20 0x7fc3940cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.771+0000 7fc39b522640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc39415b270 0x7fc39415b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.771+0000 7fc39b522640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940ce4c0 con 0x7fc39415b270 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.771+0000 7fc39b522640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc394071270 con 0x7fc3940cdb20 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.771+0000 7fc39b522640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc394072280 con 0x7fc3940cc4f0 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.772+0000 7fc399abf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc39415b270 0x7fc39415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.772+0000 7fc399abf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc39415b270 0x7fc39415b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50512/0 (socket says 172.21.15.172:50512) 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.772+0000 7fc399abf640 1 -- 172.21.15.172:0/3795678899 learned_addr learned my addr 172.21.15.172:0/3795678899 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.772+0000 7fc399abf640 1 -- 172.21.15.172:0/3795678899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3940cc4f0 msgr2=0x7fc3940cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.772+0000 7fc399abf640 1 --2- 172.21.15.172:0/3795678899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3940cc4f0 0x7fc3940cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.772+0000 7fc399abf640 1 -- 172.21.15.172:0/3795678899 >> v2:172.21.15.186:3300/0 conn(0x7fc3940cdb20 msgr2=0x7fc3940cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.772+0000 7fc398abd640 1 --2- 172.21.15.172:0/3795678899 >> v2:172.21.15.186:3300/0 conn(0x7fc3940cdb20 0x7fc3940cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:08.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.772+0000 7fc399abf640 1 --2- 172.21.15.172:0/3795678899 >> v2:172.21.15.186:3300/0 conn(0x7fc3940cdb20 0x7fc3940cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.772+0000 7fc399abf640 1 -- 172.21.15.172:0/3795678899 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940714c0 con 0x7fc39415b270 2024-04-25T08:49:08.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc399abf640 1 --2- 172.21.15.172:0/3795678899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 0x7fc39415b680 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fc39406b960 tx=0x7fc38c02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb60fa41ca1aea79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:08.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc38bfff640 1 -- 172.21.15.172:0/3795678899 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00b2e0 con 0x7fc39415b270 2024-04-25T08:49:08.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc38bfff640 1 -- 172.21.15.172:0/3795678899 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c009600 con 0x7fc39415b270 2024-04-25T08:49:08.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc38bfff640 1 -- 172.21.15.172:0/3795678899 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00b480 con 0x7fc39415b270 2024-04-25T08:49:08.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc39b522640 1 -- 172.21.15.172:0/3795678899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 msgr2=0x7fc39415b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:08.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc39b522640 1 --2- 172.21.15.172:0/3795678899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 0x7fc39415b680 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fc39406b960 tx=0x7fc38c02c8a0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc39b522640 1 -- 172.21.15.172:0/3795678899 shutdown_connections 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc39b522640 1 --2- 172.21.15.172:0/3795678899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 0x7fc39415b680 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc39b522640 1 --2- 172.21.15.172:0/3795678899 >> v2:172.21.15.186:3300/0 conn(0x7fc3940cdb20 0x7fc3940cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc39b522640 1 --2- 172.21.15.172:0/3795678899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3940cc4f0 0x7fc3940cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc39b522640 1 -- 172.21.15.172:0/3795678899 >> 172.21.15.172:0/3795678899 conn(0x7fc39406abe0 msgr2=0x7fc39406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc39b522640 1 -- 172.21.15.172:0/3795678899 shutdown_connections 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.773+0000 7fc39b522640 1 -- 172.21.15.172:0/3795678899 wait complete. 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc39b522640 1 Processor -- start 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc39b522640 1 -- start start 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc39b522640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3940cc4f0 0x7fc394143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc39b522640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3940cdb20 0x7fc394151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc39b522640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 0x7fc3940ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc39b522640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc394071d60 con 0x7fc39415b270 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc39b522640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc394071a80 con 0x7fc3940cc4f0 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc39b522640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39415bbc0 con 0x7fc3940cdb20 2024-04-25T08:49:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc399abf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 0x7fc3940ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc399abf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 0x7fc3940ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50518/0 (socket says 172.21.15.172:50518) 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc399abf640 1 -- 172.21.15.172:0/2921694713 learned_addr learned my addr 172.21.15.172:0/2921694713 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc398abd640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3940cdb20 0x7fc394151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.775+0000 7fc3992be640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3940cc4f0 0x7fc394143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc399abf640 1 -- 172.21.15.172:0/2921694713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3940cdb20 msgr2=0x7fc394151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc399abf640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3940cdb20 0x7fc394151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc399abf640 1 -- 172.21.15.172:0/2921694713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3940cc4f0 msgr2=0x7fc394143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc399abf640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3940cc4f0 0x7fc394143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc399abf640 1 -- 172.21.15.172:0/2921694713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940c99d0 con 0x7fc39415b270 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc399abf640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 0x7fc3940ca4d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fc38c02ce90 tx=0x7fc38c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc389ffb640 1 -- 172.21.15.172:0/2921694713 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c042070 con 0x7fc39415b270 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc389ffb640 1 -- 172.21.15.172:0/2921694713 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c03c840 con 0x7fc39415b270 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc39b522640 1 -- 172.21.15.172:0/2921694713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc394156780 con 0x7fc39415b270 2024-04-25T08:49:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc389ffb640 1 -- 172.21.15.172:0/2921694713 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c03cc30 con 0x7fc39415b270 2024-04-25T08:49:08.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.776+0000 7fc39b522640 1 -- 172.21.15.172:0/2921694713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc394156d40 con 0x7fc39415b270 2024-04-25T08:49:08.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.777+0000 7fc39b522640 1 -- 172.21.15.172:0/2921694713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc394073a00 con 0x7fc39415b270 2024-04-25T08:49:08.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.778+0000 7fc389ffb640 1 -- 172.21.15.172:0/2921694713 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc38c0093f0 con 0x7fc39415b270 2024-04-25T08:49:08.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.778+0000 7fc389ffb640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc37806b4d0 0x7fc37806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:08.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.778+0000 7fc389ffb640 1 -- 172.21.15.172:0/2921694713 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5749+0+0 (secure 0 0 0) 0x7fc38c030020 con 0x7fc39415b270 2024-04-25T08:49:08.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.778+0000 7fc3992be640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc37806b4d0 0x7fc37806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:08.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.779+0000 7fc3992be640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc37806b4d0 0x7fc37806d990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc3840098e0 tx=0x7fc384009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:08.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.782+0000 7fc389ffb640 1 -- 172.21.15.172:0/2921694713 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc38c04b030 con 0x7fc39415b270 2024-04-25T08:49:08.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:08.954+0000 7fc39b522640 1 -- 172.21.15.172:0/2921694713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc394156f10 con 0x7fc39415b270 2024-04-25T08:49:09.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.655+0000 7fc389ffb640 1 -- 172.21.15.172:0/2921694713 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc38c079810 con 0x7fc39415b270 2024-04-25T08:49:09.647 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2024-04-25T08:49:09.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.660+0000 7fc39b522640 1 -- 172.21.15.172:0/2921694713 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc37806b4d0 msgr2=0x7fc37806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:09.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.660+0000 7fc39b522640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc37806b4d0 0x7fc37806d990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc3840098e0 tx=0x7fc384009060 comp rx=0 tx=0).stop 2024-04-25T08:49:09.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.660+0000 7fc39b522640 1 -- 172.21.15.172:0/2921694713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 msgr2=0x7fc3940ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:09.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.660+0000 7fc39b522640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 0x7fc3940ca4d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fc38c02ce90 tx=0x7fc38c004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:09.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.661+0000 7fc39b522640 1 -- 172.21.15.172:0/2921694713 shutdown_connections 2024-04-25T08:49:09.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.661+0000 7fc39b522640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc37806b4d0 0x7fc37806d990 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:09.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.661+0000 7fc39b522640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc39415b270 0x7fc3940ca4d0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:09.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.661+0000 7fc39b522640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3940cdb20 0x7fc394151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:09.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.661+0000 7fc39b522640 1 --2- 172.21.15.172:0/2921694713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3940cc4f0 0x7fc394143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:09.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.661+0000 7fc39b522640 1 -- 172.21.15.172:0/2921694713 >> 172.21.15.172:0/2921694713 conn(0x7fc39406abe0 msgr2=0x7fc39406d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:09.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.661+0000 7fc39b522640 1 -- 172.21.15.172:0/2921694713 shutdown_connections 2024-04-25T08:49:09.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.661+0000 7fc39b522640 1 -- 172.21.15.172:0/2921694713 wait complete. 2024-04-25T08:49:09.668 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:49:09.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.794+0000 7fe58763f640 1 Processor -- start 2024-04-25T08:49:09.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.794+0000 7fe58763f640 1 -- start start 2024-04-25T08:49:09.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe58763f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe58015de00 0x7fe5800b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe58763f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800ccf20 0x7fe5800cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe58763f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58006fc90 con 0x7fe5800cf620 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe58763f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5800cffc0 con 0x7fe58015de00 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe58763f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58006ff70 con 0x7fe5800ccf20 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe5853db640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe58015de00 0x7fe5800b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe585bdc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800ccf20 0x7fe5800cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe5853db640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe58015de00 0x7fe5800b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:36320/0 (socket says 172.21.15.172:36320) 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe585bdc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800ccf20 0x7fe5800cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:59292/0 (socket says 172.21.15.172:59292) 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe584bda640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fe5800cf620 0x7fe5800722e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:60792/0 (socket says 172.21.15.172:60792) 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.795+0000 7fe5853db640 1 -- 172.21.15.172:0/1829850001 learned_addr learned my addr 172.21.15.172:0/1829850001 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.796+0000 7fe585bdc640 1 -- 172.21.15.172:0/1829850001 >> v2:172.21.15.186:3300/0 conn(0x7fe58015de00 msgr2=0x7fe5800b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.796+0000 7fe585bdc640 1 --2- 172.21.15.172:0/1829850001 >> v2:172.21.15.186:3300/0 conn(0x7fe58015de00 0x7fe5800b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:09.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.796+0000 7fe585bdc640 1 -- 172.21.15.172:0/1829850001 >> v1:172.21.15.186:6789/0 conn(0x7fe5800cf620 legacy=0x7fe5800722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:09.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.796+0000 7fe585bdc640 1 -- 172.21.15.172:0/1829850001 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580070250 con 0x7fe5800ccf20 2024-04-25T08:49:09.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.797+0000 7fe585bdc640 1 --2- 172.21.15.172:0/1829850001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800ccf20 0x7fe5800cfa80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe578009d90 tx=0x7fe57802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fce3429664c8188a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:09.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.797+0000 7fe573fff640 1 -- 172.21.15.172:0/1829850001 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578007740 con 0x7fe5800ccf20 2024-04-25T08:49:09.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.797+0000 7fe573fff640 1 -- 172.21.15.172:0/1829850001 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5780078e0 con 0x7fe5800ccf20 2024-04-25T08:49:09.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.797+0000 7fe573fff640 1 -- 172.21.15.172:0/1829850001 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578007cb0 con 0x7fe5800ccf20 2024-04-25T08:49:09.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.798+0000 7fe58763f640 1 -- 172.21.15.172:0/1829850001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800ccf20 msgr2=0x7fe5800cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:09.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.798+0000 7fe58763f640 1 --2- 172.21.15.172:0/1829850001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800ccf20 0x7fe5800cfa80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe578009d90 tx=0x7fe57802a660 comp rx=0 tx=0).stop 2024-04-25T08:49:09.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.798+0000 7fe58763f640 1 -- 172.21.15.172:0/1829850001 shutdown_connections 2024-04-25T08:49:09.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.798+0000 7fe58763f640 1 --2- 172.21.15.172:0/1829850001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800ccf20 0x7fe5800cfa80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:09.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.798+0000 7fe58763f640 1 --2- 172.21.15.172:0/1829850001 >> v2:172.21.15.186:3300/0 conn(0x7fe58015de00 0x7fe5800b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:09.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.798+0000 7fe58763f640 1 -- 172.21.15.172:0/1829850001 >> 172.21.15.172:0/1829850001 conn(0x7fe5800b23e0 msgr2=0x7fe5800b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:09.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.798+0000 7fe58763f640 1 -- 172.21.15.172:0/1829850001 shutdown_connections 2024-04-25T08:49:09.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.798+0000 7fe58763f640 1 -- 172.21.15.172:0/1829850001 wait complete. 2024-04-25T08:49:09.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.800+0000 7fe58763f640 1 Processor -- start 2024-04-25T08:49:09.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.800+0000 7fe58763f640 1 -- start start 2024-04-25T08:49:09.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe58763f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5800ccf20 0x7fe5801f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe58763f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800cf620 0x7fe5801efc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe58763f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe58015de00 0x7fe5800b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe58763f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800cf110 con 0x7fe58015de00 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe58763f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580070810 con 0x7fe5800ccf20 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe58763f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800cf290 con 0x7fe5800cf620 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe585bdc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe58015de00 0x7fe5800b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe585bdc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe58015de00 0x7fe5800b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50528/0 (socket says 172.21.15.172:50528) 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe585bdc640 1 -- 172.21.15.172:0/563775299 learned_addr learned my addr 172.21.15.172:0/563775299 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe584bda640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800cf620 0x7fe5801efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe5853db640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5800ccf20 0x7fe5801f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe585bdc640 1 -- 172.21.15.172:0/563775299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800cf620 msgr2=0x7fe5801efc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe585bdc640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800cf620 0x7fe5801efc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe585bdc640 1 -- 172.21.15.172:0/563775299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5800ccf20 msgr2=0x7fe5801f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:09.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.801+0000 7fe585bdc640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5800ccf20 0x7fe5801f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:09.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.802+0000 7fe585bdc640 1 -- 172.21.15.172:0/563775299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5801f0520 con 0x7fe58015de00 2024-04-25T08:49:09.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.802+0000 7fe585bdc640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe58015de00 0x7fe5800b4010 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fe578009eb0 tx=0x7fe578004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:09.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.802+0000 7fe571ffb640 1 -- 172.21.15.172:0/563775299 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578040070 con 0x7fe58015de00 2024-04-25T08:49:09.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.802+0000 7fe571ffb640 1 -- 172.21.15.172:0/563775299 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe578031bc0 con 0x7fe58015de00 2024-04-25T08:49:09.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.802+0000 7fe571ffb640 1 -- 172.21.15.172:0/563775299 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578009450 con 0x7fe58015de00 2024-04-25T08:49:09.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.802+0000 7fe58763f640 1 -- 172.21.15.172:0/563775299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5801f0800 con 0x7fe58015de00 2024-04-25T08:49:09.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.802+0000 7fe58763f640 1 -- 172.21.15.172:0/563775299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5801f32d0 con 0x7fe58015de00 2024-04-25T08:49:09.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.804+0000 7fe58763f640 1 -- 172.21.15.172:0/563775299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580073a00 con 0x7fe58015de00 2024-04-25T08:49:09.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.804+0000 7fe571ffb640 1 -- 172.21.15.172:0/563775299 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe578039040 con 0x7fe58015de00 2024-04-25T08:49:09.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.804+0000 7fe571ffb640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe56406b4d0 0x7fe56406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:09.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.804+0000 7fe571ffb640 1 -- 172.21.15.172:0/563775299 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe5780ab880 con 0x7fe58015de00 2024-04-25T08:49:09.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.805+0000 7fe5853db640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe56406b4d0 0x7fe56406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:09.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.805+0000 7fe5853db640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe56406b4d0 0x7fe56406d990 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe574009a10 tx=0x7fe574008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:09.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:09.810+0000 7fe571ffb640 1 -- 172.21.15.172:0/563775299 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe57807a990 con 0x7fe58015de00 2024-04-25T08:49:10.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.018+0000 7fe58763f640 1 -- 172.21.15.172:0/563775299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe580156a30 con 0x7fe58015de00 2024-04-25T08:49:10.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.021+0000 7fe571ffb640 1 -- 172.21.15.172:0/563775299 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe57807a290 con 0x7fe58015de00 2024-04-25T08:49:10.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 -- 172.21.15.172:0/563775299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe56406b4d0 msgr2=0x7fe56406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe56406b4d0 0x7fe56406d990 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe574009a10 tx=0x7fe574008040 comp rx=0 tx=0).stop 2024-04-25T08:49:10.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 -- 172.21.15.172:0/563775299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe58015de00 msgr2=0x7fe5800b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe58015de00 0x7fe5800b4010 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fe578009eb0 tx=0x7fe578004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:10.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 -- 172.21.15.172:0/563775299 shutdown_connections 2024-04-25T08:49:10.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe56406b4d0 0x7fe56406d990 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe58015de00 0x7fe5800b4010 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe5800cf620 0x7fe5801efc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 --2- 172.21.15.172:0/563775299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5800ccf20 0x7fe5801f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 -- 172.21.15.172:0/563775299 >> 172.21.15.172:0/563775299 conn(0x7fe5800b23e0 msgr2=0x7fe5800d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:10.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 -- 172.21.15.172:0/563775299 shutdown_connections 2024-04-25T08:49:10.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.024+0000 7fe58763f640 1 -- 172.21.15.172:0/563775299 wait complete. 2024-04-25T08:49:10.027 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-04-25T08:49:10.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.143+0000 7fe750691640 1 Processor -- start 2024-04-25T08:49:10.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.143+0000 7fe750691640 1 -- start start 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.144+0000 7fe750691640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7480cc6c0 0x7fe748071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.144+0000 7fe750691640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe74815b320 0x7fe748071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.144+0000 7fe750691640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe748071ed0 con 0x7fe74813d190 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.144+0000 7fe750691640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe748071cb0 con 0x7fe74815b320 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.144+0000 7fe750691640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74813d570 con 0x7fe7480cc6c0 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.144+0000 7fe74e42d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe74813d190 0x7fe7480cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59606/0 (socket says 172.21.15.172:59606) 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.144+0000 7fe74e42d640 1 -- 172.21.15.172:0/1502812220 learned_addr learned my addr 172.21.15.172:0/1502812220 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.144+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434108635 0 0) 0x7fe748071ed0 con 0x7fe74813d190 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe734003520 con 0x7fe74813d190 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74ec2e640 1 --2- 172.21.15.172:0/1502812220 >> v2:172.21.15.186:3300/0 conn(0x7fe74815b320 0x7fe748071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74dc2c640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7480cc6c0 0x7fe748071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4100821201 0 0) 0x7fe734003520 con 0x7fe74813d190 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7480cc6c0 msgr2=0x7fe748071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7480cc6c0 0x7fe748071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 >> v2:172.21.15.186:3300/0 conn(0x7fe74815b320 msgr2=0x7fe748071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 --2- 172.21.15.172:0/1502812220 >> v2:172.21.15.186:3300/0 conn(0x7fe74815b320 0x7fe748071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74815a840 con 0x7fe74813d190 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fe7440019f0 con 0x7fe74813d190 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 >> v1:172.21.15.172:6789/0 conn(0x7fe74813d190 legacy=0x7fe7480cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7340039b0 0x7fe734003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 0x7fe734004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7480cc6c0 0x7fe7340051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe748071cb0 con 0x7fe734004800 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74813d570 con 0x7fe7340039b0 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73400bb80 con 0x7fe7480cc6c0 2024-04-25T08:49:10.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74ec2e640 1 --2- 172.21.15.172:0/1502812220 >> v2:172.21.15.186:3300/0 conn(0x7fe74815b320 0x7fe748071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74dc2c640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 0x7fe734004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74e42d640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7340039b0 0x7fe734003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74ec2e640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7480cc6c0 0x7fe7340051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74dc2c640 1 -- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7480cc6c0 msgr2=0x7fe7340051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74dc2c640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7480cc6c0 0x7fe7340051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74dc2c640 1 -- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7340039b0 msgr2=0x7fe734003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74dc2c640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7340039b0 0x7fe734003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.145+0000 7fe74dc2c640 1 -- 172.21.15.172:0/1502812220 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe734003520 con 0x7fe734004800 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.146+0000 7fe74dc2c640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 0x7fe734004c80 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fe73800ba30 tx=0x7fe734005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbb0a2d4447c04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.146+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738030070 con 0x7fe734004800 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.146+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73802ade0 con 0x7fe734004800 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.146+0000 7fe74d42b640 1 -- 172.21.15.172:0/1502812220 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73800b600 con 0x7fe734004800 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.147+0000 7fe750691640 1 -- 172.21.15.172:0/1502812220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 msgr2=0x7fe734004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.147+0000 7fe750691640 1 --2- 172.21.15.172:0/1502812220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 0x7fe734004c80 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fe73800ba30 tx=0x7fe734005830 comp rx=0 tx=0).stop 2024-04-25T08:49:10.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.147+0000 7fe74ec2e640 1 -- 172.21.15.172:0/1502812220 reap_dead start 2024-04-25T08:49:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.147+0000 7fe750691640 1 -- 172.21.15.172:0/1502812220 shutdown_connections 2024-04-25T08:49:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.147+0000 7fe750691640 1 -- 172.21.15.172:0/1502812220 >> 172.21.15.172:0/1502812220 conn(0x7fe74806abe0 msgr2=0x7fe74806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.147+0000 7fe750691640 1 -- 172.21.15.172:0/1502812220 shutdown_connections 2024-04-25T08:49:10.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.147+0000 7fe750691640 1 -- 172.21.15.172:0/1502812220 wait complete. 2024-04-25T08:49:10.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.148+0000 7fe750691640 1 Processor -- start 2024-04-25T08:49:10.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.148+0000 7fe750691640 1 -- start start 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe750691640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 0x7fe74815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe750691640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe748146bd0 0x7fe7480af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe750691640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7480af800 0x7fe7480afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe750691640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe748071230 con 0x7fe734004800 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe750691640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74815ae00 con 0x7fe7480af800 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe750691640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480713b0 con 0x7fe748146bd0 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74e42d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 0x7fe74815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74e42d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 0x7fe74815ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50550/0 (socket says 172.21.15.172:50550) 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74e42d640 1 -- 172.21.15.172:0/3880804730 learned_addr learned my addr 172.21.15.172:0/3880804730 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74dc2c640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe748146bd0 0x7fe7480af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74ec2e640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7480af800 0x7fe7480afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74e42d640 1 -- 172.21.15.172:0/3880804730 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe748146bd0 msgr2=0x7fe7480af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74e42d640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe748146bd0 0x7fe7480af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74e42d640 1 -- 172.21.15.172:0/3880804730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7480af800 msgr2=0x7fe7480afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74e42d640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7480af800 0x7fe7480afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74e42d640 1 -- 172.21.15.172:0/3880804730 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe748147f90 con 0x7fe734004800 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe74e42d640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 0x7fe74815ca90 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fe7440079a0 tx=0x7fe74400a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe73effd640 1 -- 172.21.15.172:0/3880804730 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744017020 con 0x7fe734004800 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe73effd640 1 -- 172.21.15.172:0/3880804730 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe744007a90 con 0x7fe734004800 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe73effd640 1 -- 172.21.15.172:0/3880804730 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744013630 con 0x7fe734004800 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe750691640 1 -- 172.21.15.172:0/3880804730 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe748148270 con 0x7fe734004800 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.149+0000 7fe750691640 1 -- 172.21.15.172:0/3880804730 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7480b0c20 con 0x7fe734004800 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.150+0000 7fe750691640 1 -- 172.21.15.172:0/3880804730 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe748073990 con 0x7fe734004800 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.151+0000 7fe73effd640 1 -- 172.21.15.172:0/3880804730 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe74401a020 con 0x7fe734004800 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.151+0000 7fe73effd640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe72c06b4d0 0x7fe72c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.151+0000 7fe73effd640 1 -- 172.21.15.172:0/3880804730 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe74408abf0 con 0x7fe734004800 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.151+0000 7fe74dc2c640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe72c06b4d0 0x7fe72c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.152+0000 7fe74dc2c640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe72c06b4d0 0x7fe72c06d990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe73800ba00 tx=0x7fe738030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:10.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.155+0000 7fe73effd640 1 -- 172.21.15.172:0/3880804730 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe744021020 con 0x7fe734004800 2024-04-25T08:49:10.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.390+0000 7fe750691640 1 -- 172.21.15.172:0/3880804730 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7fe7480b0df0 con 0x7fe734004800 2024-04-25T08:49:10.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.657+0000 7fe73effd640 1 -- 172.21.15.172:0/3880804730 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v332) v1 ==== 144+0+0 (secure 0 0 0) 0x7fe744059be0 con 0x7fe734004800 2024-04-25T08:49:10.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 -- 172.21.15.172:0/3880804730 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe72c06b4d0 msgr2=0x7fe72c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe72c06b4d0 0x7fe72c06d990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe73800ba00 tx=0x7fe738030000 comp rx=0 tx=0).stop 2024-04-25T08:49:10.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 -- 172.21.15.172:0/3880804730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 msgr2=0x7fe74815ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 0x7fe74815ca90 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fe7440079a0 tx=0x7fe74400a6a0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 -- 172.21.15.172:0/3880804730 shutdown_connections 2024-04-25T08:49:10.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe72c06b4d0 0x7fe72c06d990 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7480af800 0x7fe7480afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe748146bd0 0x7fe7480af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 --2- 172.21.15.172:0/3880804730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734004800 0x7fe74815ca90 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 -- 172.21.15.172:0/3880804730 >> 172.21.15.172:0/3880804730 conn(0x7fe74806abe0 msgr2=0x7fe74806e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:10.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 -- 172.21.15.172:0/3880804730 shutdown_connections 2024-04-25T08:49:10.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.659+0000 7fe750691640 1 -- 172.21.15.172:0/3880804730 wait complete. 2024-04-25T08:49:10.662 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T08:49:10.663 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T08:49:10.663 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:10.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.771+0000 7f0dcedce640 1 Processor -- start 2024-04-25T08:49:10.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.771+0000 7f0dcedce640 1 -- start start 2024-04-25T08:49:10.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dcedce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc8071ac0 0x7f0dc80ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dcedce640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc815ec60 con 0x7f0dc8154ed0 2024-04-25T08:49:10.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dcedce640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc815ef40 con 0x7f0dc806c1d0 2024-04-25T08:49:10.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dcedce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc806db90 con 0x7f0dc8071ac0 2024-04-25T08:49:10.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dccb6a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0dc8154ed0 0x7f0dc80aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59622/0 (socket says 172.21.15.172:59622) 2024-04-25T08:49:10.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dccb6a640 1 -- 172.21.15.172:0/2701475504 learned_addr learned my addr 172.21.15.172:0/2701475504 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:10.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc7fff640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc8071ac0 0x7f0dc80ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277904147 0 0) 0x7f0dc815ec60 con 0x7f0dc8154ed0 2024-04-25T08:49:10.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db4003520 con 0x7f0dc8154ed0 2024-04-25T08:49:10.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3066318919 0 0) 0x7f0db4003520 con 0x7f0dc8154ed0 2024-04-25T08:49:10.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc8071ac0 msgr2=0x7f0dc80ad5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:10.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc8071ac0 0x7f0dc80ad5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 >> v1:172.21.15.186:6789/0 conn(0x7f0dc806c1d0 legacy=0x7f0dc806afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc806de70 con 0x7f0dc8154ed0 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f0db8001670 con 0x7f0dc8154ed0 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 >> v1:172.21.15.172:6789/0 conn(0x7f0dc8154ed0 legacy=0x7f0dc80aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0db40039e0 0x7f0db4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db4004390 0x7f0db4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc8071ac0 0x7f0db40050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc806db90 con 0x7f0db4004390 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db400b9c0 con 0x7f0db40039e0 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.772+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db400bbc0 con 0x7f0dc8071ac0 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.773+0000 7f0dc7fff640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db4004390 0x7f0db4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.773+0000 7f0dccb6a640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0db40039e0 0x7f0db4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.773+0000 7f0dcd36b640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc8071ac0 0x7f0db40050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.773+0000 7f0dc7fff640 1 -- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc8071ac0 msgr2=0x7f0db40050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:10.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.773+0000 7f0dc7fff640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc8071ac0 0x7f0db40050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.773+0000 7f0dc7fff640 1 -- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0db40039e0 msgr2=0x7f0db4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.773+0000 7f0dc7fff640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0db40039e0 0x7f0db4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.773+0000 7f0dc7fff640 1 -- 172.21.15.172:0/2701475504 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4003520 con 0x7f0db4004390 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.773+0000 7f0dc7fff640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db4004390 0x7f0db4004860 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009f90 tx=0x7f0db4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a36dfe508a1b82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.774+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0009c10 con 0x7f0db4004390 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.774+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc0036070 con 0x7f0db4004390 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.774+0000 7f0dc77fe640 1 -- 172.21.15.172:0/2701475504 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0031850 con 0x7f0db4004390 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.774+0000 7f0dcedce640 1 -- 172.21.15.172:0/2701475504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db4004390 msgr2=0x7f0db4004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.774+0000 7f0dcedce640 1 --2- 172.21.15.172:0/2701475504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0db4004390 0x7f0db4004860 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009f90 tx=0x7f0db4005830 comp rx=0 tx=0).stop 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.774+0000 7f0dcd36b640 1 -- 172.21.15.172:0/2701475504 reap_dead start 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.774+0000 7f0dcedce640 1 -- 172.21.15.172:0/2701475504 shutdown_connections 2024-04-25T08:49:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.774+0000 7f0dcedce640 1 -- 172.21.15.172:0/2701475504 >> 172.21.15.172:0/2701475504 conn(0x7f0dc80af670 msgr2=0x7f0dc80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:10.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.774+0000 7f0dcedce640 1 -- 172.21.15.172:0/2701475504 shutdown_connections 2024-04-25T08:49:10.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.774+0000 7f0dcedce640 1 -- 172.21.15.172:0/2701475504 wait complete. 2024-04-25T08:49:10.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.775+0000 7f0dcedce640 1 Processor -- start 2024-04-25T08:49:10.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.775+0000 7f0dcedce640 1 -- start start 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dcedce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dc814d910 0x7f0dc8153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dcedce640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dc814dcf0 0x7f0dc80b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dcedce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc80cb620 0x7f0dc80b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dcedce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80ad9f0 con 0x7f0dc814d910 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dcedce640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80ad870 con 0x7f0dc814dcf0 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dcedce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80adb70 con 0x7f0dc80cb620 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dccb6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dc814d910 0x7f0dc8153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dccb6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dc814d910 0x7f0dc8153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50570/0 (socket says 172.21.15.172:50570) 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dccb6a640 1 -- 172.21.15.172:0/2818942771 learned_addr learned my addr 172.21.15.172:0/2818942771 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dcd36b640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc80cb620 0x7f0dc80b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.776+0000 7f0dc7fff640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dc814dcf0 0x7f0dc80b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dccb6a640 1 -- 172.21.15.172:0/2818942771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc80cb620 msgr2=0x7f0dc80b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dccb6a640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc80cb620 0x7f0dc80b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dccb6a640 1 -- 172.21.15.172:0/2818942771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dc814dcf0 msgr2=0x7f0dc80b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dccb6a640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dc814dcf0 0x7f0dc80b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dccb6a640 1 -- 172.21.15.172:0/2818942771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80cc770 con 0x7f0dc814d910 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dcd36b640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc80cb620 0x7f0dc80b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dccb6a640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dc814d910 0x7f0dc8153ab0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f0db8007340 tx=0x7f0db8007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dc57fa640 1 -- 172.21.15.172:0/2818942771 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db801a070 con 0x7f0dc814d910 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dc57fa640 1 -- 172.21.15.172:0/2818942771 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db800f8c0 con 0x7f0dc814d910 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dc57fa640 1 -- 172.21.15.172:0/2818942771 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db800fcb0 con 0x7f0dc814d910 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dcedce640 1 -- 172.21.15.172:0/2818942771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc80cca50 con 0x7f0dc814d910 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.777+0000 7f0dcedce640 1 -- 172.21.15.172:0/2818942771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc80cd010 con 0x7f0dc814d910 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.778+0000 7f0dcedce640 1 -- 172.21.15.172:0/2818942771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc80b2b10 con 0x7f0dc814d910 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.778+0000 7f0dc57fa640 1 -- 172.21.15.172:0/2818942771 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0db801d070 con 0x7f0dc814d910 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.779+0000 7f0dc57fa640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0da806b4d0 0x7f0da806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.779+0000 7f0dc57fa640 1 -- 172.21.15.172:0/2818942771 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0db8089a30 con 0x7f0dc814d910 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.779+0000 7f0dc7fff640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0da806b4d0 0x7f0da806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.779+0000 7f0dc7fff640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0da806b4d0 0x7f0da806d990 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009f90 tx=0x7f0dc002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:10.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.783+0000 7f0dc57fa640 1 -- 172.21.15.172:0/2818942771 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0db8058a20 con 0x7f0dc814d910 2024-04-25T08:49:10.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.955+0000 7f0dcedce640 1 -- 172.21.15.172:0/2818942771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dc8073990 con 0x7f0dc814d910 2024-04-25T08:49:10.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.956+0000 7f0dc57fa640 1 -- 172.21.15.172:0/2818942771 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+13354 (secure 0 0 0) 0x7f0db8058320 con 0x7f0dc814d910 2024-04-25T08:49:10.946 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:10.947 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":98,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:09.652957+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:6834/246475597":"2024-04-26T08:49:06.648048+0000","172.21.15.186:6832/246475597":"2024-04-26T08:49:06.648048+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.957+0000 7f0dcedce640 1 -- 172.21.15.172:0/2818942771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0da806b4d0 msgr2=0x7f0da806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.957+0000 7f0dcedce640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0da806b4d0 0x7f0da806d990 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009f90 tx=0x7f0dc002f000 comp rx=0 tx=0).stop 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.957+0000 7f0dcedce640 1 -- 172.21.15.172:0/2818942771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dc814d910 msgr2=0x7f0dc8153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.957+0000 7f0dcedce640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dc814d910 0x7f0dc8153ab0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f0db8007340 tx=0x7f0db8007800 comp rx=0 tx=0).stop 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.958+0000 7f0dcedce640 1 -- 172.21.15.172:0/2818942771 shutdown_connections 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.958+0000 7f0dcedce640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0da806b4d0 0x7f0da806d990 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.958+0000 7f0dcedce640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dc814dcf0 0x7f0dc80b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.958+0000 7f0dcedce640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dc80cb620 0x7f0dc80b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.958+0000 7f0dcedce640 1 --2- 172.21.15.172:0/2818942771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dc814d910 0x7f0dc8153ab0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.958+0000 7f0dcedce640 1 -- 172.21.15.172:0/2818942771 >> 172.21.15.172:0/2818942771 conn(0x7f0db4004390 msgr2=0x7f0dc815f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.958+0000 7f0dcedce640 1 -- 172.21.15.172:0/2818942771 shutdown_connections 2024-04-25T08:49:10.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:10.958+0000 7f0dcedce640 1 -- 172.21.15.172:0/2818942771 wait complete. 2024-04-25T08:49:10.960 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:49:10.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:49:11.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.069+0000 7f212c54c640 1 Processor -- start 2024-04-25T08:49:11.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.069+0000 7f212c54c640 1 -- start start 2024-04-25T08:49:11.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212c54c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21241446d0 0x7f21240b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212c54c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2124144d50 0x7f21240b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212c54c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21240cccc0 con 0x7f21241452a0 2024-04-25T08:49:11.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212c54c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21240b2b20 con 0x7f21241446d0 2024-04-25T08:49:11.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212c54c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212406d400 con 0x7f2124144d50 2024-04-25T08:49:11.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212a2e8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21241446d0 0x7f21240b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212aae9640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f21241452a0 0x7f21240cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59628/0 (socket says 172.21.15.172:59628) 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212a2e8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21241446d0 0x7f21240b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50578/0 (socket says 172.21.15.172:50578) 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212aae9640 1 -- 172.21.15.172:0/2292476906 learned_addr learned my addr 172.21.15.172:0/2292476906 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f2129ae7640 1 --2- 172.21.15.172:0/2292476906 >> v2:172.21.15.186:3300/0 conn(0x7f2124144d50 0x7f21240b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212a2e8640 1 -- 172.21.15.172:0/2292476906 >> v2:172.21.15.186:3300/0 conn(0x7f2124144d50 msgr2=0x7f21240b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212a2e8640 1 --2- 172.21.15.172:0/2292476906 >> v2:172.21.15.186:3300/0 conn(0x7f2124144d50 0x7f21240b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212a2e8640 1 -- 172.21.15.172:0/2292476906 >> v1:172.21.15.172:6789/0 conn(0x7f21241452a0 legacy=0x7f21240cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f212a2e8640 1 -- 172.21.15.172:0/2292476906 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21240cc140 con 0x7f21241446d0 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.070+0000 7f21292e6640 1 -- 172.21.15.172:0/2292476906 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838438643 0 0) 0x7f21240cccc0 con 0x7f21241452a0 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.071+0000 7f2129ae7640 1 --2- 172.21.15.172:0/2292476906 >> v2:172.21.15.186:3300/0 conn(0x7f2124144d50 0x7f21240b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.071+0000 7f212a2e8640 1 --2- 172.21.15.172:0/2292476906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 0x7f21240b3f20 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f2124071c70 tx=0x7f212002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef0e278b587d08e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.071+0000 7f21292e6640 1 -- 172.21.15.172:0/2292476906 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120007740 con 0x7f21241446d0 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.071+0000 7f21292e6640 1 -- 172.21.15.172:0/2292476906 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21200078e0 con 0x7f21241446d0 2024-04-25T08:49:11.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.071+0000 7f21292e6640 1 -- 172.21.15.172:0/2292476906 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120007cb0 con 0x7f21241446d0 2024-04-25T08:49:11.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.072+0000 7f212c54c640 1 -- 172.21.15.172:0/2292476906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 msgr2=0x7f21240b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.072+0000 7f212c54c640 1 --2- 172.21.15.172:0/2292476906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 0x7f21240b3f20 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f2124071c70 tx=0x7f212002a680 comp rx=0 tx=0).stop 2024-04-25T08:49:11.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.072+0000 7f212c54c640 1 -- 172.21.15.172:0/2292476906 shutdown_connections 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.072+0000 7f212c54c640 1 --2- 172.21.15.172:0/2292476906 >> v2:172.21.15.186:3300/0 conn(0x7f2124144d50 0x7f21240b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.072+0000 7f212c54c640 1 --2- 172.21.15.172:0/2292476906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 0x7f21240b3f20 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.072+0000 7f212c54c640 1 -- 172.21.15.172:0/2292476906 >> 172.21.15.172:0/2292476906 conn(0x7f212406abe0 msgr2=0x7f212406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.072+0000 7f212c54c640 1 -- 172.21.15.172:0/2292476906 shutdown_connections 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.072+0000 7f212c54c640 1 -- 172.21.15.172:0/2292476906 wait complete. 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.073+0000 7f212c54c640 1 Processor -- start 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.073+0000 7f212c54c640 1 -- start start 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212c54c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 0x7f21241f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212c54c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2124144d50 0x7f212414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212c54c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21241452a0 0x7f212414e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212c54c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21240cc700 con 0x7f21241446d0 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212c54c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21240b49a0 con 0x7f21241452a0 2024-04-25T08:49:11.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212c54c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21240cc9e0 con 0x7f2124144d50 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212a2e8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 0x7f21241f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212a2e8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 0x7f21241f45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50590/0 (socket says 172.21.15.172:50590) 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212a2e8640 1 -- 172.21.15.172:0/3970102571 learned_addr learned my addr 172.21.15.172:0/3970102571 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212a2e8640 1 -- 172.21.15.172:0/3970102571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2124144d50 msgr2=0x7f212414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212a2e8640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2124144d50 0x7f212414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212a2e8640 1 -- 172.21.15.172:0/3970102571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21241452a0 msgr2=0x7f212414e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212a2e8640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21241452a0 0x7f212414e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212a2e8640 1 -- 172.21.15.172:0/3970102571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212414ecb0 con 0x7f21241446d0 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212a2e8640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 0x7f21241f45a0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f2120009e80 tx=0x7f2120004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f211affd640 1 -- 172.21.15.172:0/3970102571 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212003f070 con 0x7f21241446d0 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f211affd640 1 -- 172.21.15.172:0/3970102571 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120031c40 con 0x7f21241446d0 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.074+0000 7f212c54c640 1 -- 172.21.15.172:0/3970102571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212414ef90 con 0x7f21241446d0 2024-04-25T08:49:11.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.075+0000 7f211affd640 1 -- 172.21.15.172:0/3970102571 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120043410 con 0x7f21241446d0 2024-04-25T08:49:11.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.075+0000 7f212c54c640 1 -- 172.21.15.172:0/3970102571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212414f550 con 0x7f21241446d0 2024-04-25T08:49:11.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.076+0000 7f212c54c640 1 -- 172.21.15.172:0/3970102571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2124073a00 con 0x7f21241446d0 2024-04-25T08:49:11.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.076+0000 7f211affd640 1 -- 172.21.15.172:0/3970102571 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f21200435b0 con 0x7f21241446d0 2024-04-25T08:49:11.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.076+0000 7f211affd640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210806b4d0 0x7f210806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.076+0000 7f211affd640 1 -- 172.21.15.172:0/3970102571 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f21200ab6d0 con 0x7f21241446d0 2024-04-25T08:49:11.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.076+0000 7f2129ae7640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210806b4d0 0x7f210806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.077+0000 7f2129ae7640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210806b4d0 0x7f210806d990 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2114006fd0 tx=0x7f2114008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:11.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.081+0000 7f211affd640 1 -- 172.21.15.172:0/3970102571 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f212007a630 con 0x7f21241446d0 2024-04-25T08:49:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.250+0000 7f212c54c640 1 -- 172.21.15.172:0/3970102571 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f212413e820 con 0x7f21241446d0 2024-04-25T08:49:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.250+0000 7f211affd640 1 -- 172.21.15.172:0/3970102571 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2120079f30 con 0x7f21241446d0 2024-04-25T08:49:11.241 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:49:11.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 -- 172.21.15.172:0/3970102571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210806b4d0 msgr2=0x7f210806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210806b4d0 0x7f210806d990 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2114006fd0 tx=0x7f2114008040 comp rx=0 tx=0).stop 2024-04-25T08:49:11.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 -- 172.21.15.172:0/3970102571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 msgr2=0x7f21241f45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 0x7f21241f45a0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f2120009e80 tx=0x7f2120004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:11.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 -- 172.21.15.172:0/3970102571 shutdown_connections 2024-04-25T08:49:11.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f210806b4d0 0x7f210806d990 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21241452a0 0x7f212414e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2124144d50 0x7f212414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 --2- 172.21.15.172:0/3970102571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21241446d0 0x7f21241f45a0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 -- 172.21.15.172:0/3970102571 >> 172.21.15.172:0/3970102571 conn(0x7f212406abe0 msgr2=0x7f212406d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:11.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 -- 172.21.15.172:0/3970102571 shutdown_connections 2024-04-25T08:49:11.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.252+0000 7f212c54c640 1 -- 172.21.15.172:0/3970102571 wait complete. 2024-04-25T08:49:11.254 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-04-25T08:49:11.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.361+0000 7fca56c38640 1 Processor -- start 2024-04-25T08:49:11.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.361+0000 7fca56c38640 1 -- start start 2024-04-25T08:49:11.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca56c38640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca500cfec0 0x7fca500cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca56c38640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fca500ce3c0 0x7fca5006d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca56c38640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca50071480 con 0x7fca50154ee0 2024-04-25T08:49:11.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca56c38640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca500ce830 con 0x7fca500cfec0 2024-04-25T08:49:11.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca56c38640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca50072090 con 0x7fca500ce3c0 2024-04-25T08:49:11.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca4ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca500cfec0 0x7fca500cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca4ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca500cfec0 0x7fca500cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50596/0 (socket says 172.21.15.172:50596) 2024-04-25T08:49:11.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca4ffff640 1 -- 172.21.15.172:0/1724649064 learned_addr learned my addr 172.21.15.172:0/1724649064 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:11.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca551d5640 1 --2- 172.21.15.172:0/1724649064 >> v2:172.21.15.186:3300/0 conn(0x7fca500ce3c0 0x7fca5006d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca4ffff640 1 -- 172.21.15.172:0/1724649064 >> v2:172.21.15.186:3300/0 conn(0x7fca500ce3c0 msgr2=0x7fca5006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:11.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca4ffff640 1 --2- 172.21.15.172:0/1724649064 >> v2:172.21.15.186:3300/0 conn(0x7fca500ce3c0 0x7fca5006d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca4ffff640 1 -- 172.21.15.172:0/1724649064 >> v1:172.21.15.186:6789/0 conn(0x7fca50154ee0 legacy=0x7fca500cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.362+0000 7fca4ffff640 1 -- 172.21.15.172:0/1724649064 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca50071760 con 0x7fca500cfec0 2024-04-25T08:49:11.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.363+0000 7fca4ffff640 1 --2- 172.21.15.172:0/1724649064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500cfec0 0x7fca500cde80 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fca5006f240 tx=0x7fca3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9abc9c6941685d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:11.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.363+0000 7fca4f7fe640 1 -- 172.21.15.172:0/1724649064 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38037070 con 0x7fca500cfec0 2024-04-25T08:49:11.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.363+0000 7fca4f7fe640 1 -- 172.21.15.172:0/1724649064 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca38032440 con 0x7fca500cfec0 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.363+0000 7fca4f7fe640 1 -- 172.21.15.172:0/1724649064 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38032810 con 0x7fca500cfec0 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.364+0000 7fca56c38640 1 -- 172.21.15.172:0/1724649064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500cfec0 msgr2=0x7fca500cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.364+0000 7fca56c38640 1 --2- 172.21.15.172:0/1724649064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500cfec0 0x7fca500cde80 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fca5006f240 tx=0x7fca3802a270 comp rx=0 tx=0).stop 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.364+0000 7fca56c38640 1 -- 172.21.15.172:0/1724649064 shutdown_connections 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.364+0000 7fca56c38640 1 --2- 172.21.15.172:0/1724649064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500cfec0 0x7fca500cde80 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.364+0000 7fca56c38640 1 --2- 172.21.15.172:0/1724649064 >> v2:172.21.15.186:3300/0 conn(0x7fca500ce3c0 0x7fca5006d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.364+0000 7fca56c38640 1 -- 172.21.15.172:0/1724649064 >> 172.21.15.172:0/1724649064 conn(0x7fca5006abe0 msgr2=0x7fca5006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.364+0000 7fca56c38640 1 -- 172.21.15.172:0/1724649064 shutdown_connections 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.364+0000 7fca56c38640 1 -- 172.21.15.172:0/1724649064 wait complete. 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.365+0000 7fca56c38640 1 Processor -- start 2024-04-25T08:49:11.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.365+0000 7fca56c38640 1 -- start start 2024-04-25T08:49:11.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca56c38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500ce3c0 0x7fca50151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca56c38640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca500cfec0 0x7fca5015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca56c38640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca50154ee0 0x7fca501f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca56c38640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca50071d20 con 0x7fca500ce3c0 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca56c38640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca50071230 con 0x7fca50154ee0 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca56c38640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca501552c0 con 0x7fca500cfec0 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca549d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500ce3c0 0x7fca50151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca549d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500ce3c0 0x7fca50151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50608/0 (socket says 172.21.15.172:50608) 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca549d4640 1 -- 172.21.15.172:0/356207070 learned_addr learned my addr 172.21.15.172:0/356207070 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca551d5640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca50154ee0 0x7fca501f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca4ffff640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca500cfec0 0x7fca5015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca549d4640 1 -- 172.21.15.172:0/356207070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca500cfec0 msgr2=0x7fca5015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca549d4640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca500cfec0 0x7fca5015c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca549d4640 1 -- 172.21.15.172:0/356207070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca50154ee0 msgr2=0x7fca501f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca549d4640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca50154ee0 0x7fca501f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca549d4640 1 -- 172.21.15.172:0/356207070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca50151aa0 con 0x7fca500ce3c0 2024-04-25T08:49:11.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.366+0000 7fca549d4640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500ce3c0 0x7fca50151560 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fca4800c730 tx=0x7fca4800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:11.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.367+0000 7fca4d7fa640 1 -- 172.21.15.172:0/356207070 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48016020 con 0x7fca500ce3c0 2024-04-25T08:49:11.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.367+0000 7fca4d7fa640 1 -- 172.21.15.172:0/356207070 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca48006d50 con 0x7fca500ce3c0 2024-04-25T08:49:11.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.367+0000 7fca56c38640 1 -- 172.21.15.172:0/356207070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca50151d70 con 0x7fca500ce3c0 2024-04-25T08:49:11.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.367+0000 7fca4d7fa640 1 -- 172.21.15.172:0/356207070 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48003bb0 con 0x7fca500ce3c0 2024-04-25T08:49:11.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.367+0000 7fca56c38640 1 -- 172.21.15.172:0/356207070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca501f5140 con 0x7fca500ce3c0 2024-04-25T08:49:11.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.368+0000 7fca56c38640 1 -- 172.21.15.172:0/356207070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca500cee10 con 0x7fca500ce3c0 2024-04-25T08:49:11.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.368+0000 7fca4d7fa640 1 -- 172.21.15.172:0/356207070 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca4800a850 con 0x7fca500ce3c0 2024-04-25T08:49:11.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.368+0000 7fca4d7fa640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca3006b4d0 0x7fca3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.368+0000 7fca4d7fa640 1 -- 172.21.15.172:0/356207070 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fca48089b20 con 0x7fca500ce3c0 2024-04-25T08:49:11.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.369+0000 7fca4ffff640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca3006b4d0 0x7fca3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.369+0000 7fca4ffff640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca3006b4d0 0x7fca3006d990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fca38034000 tx=0x7fca3802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:11.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.373+0000 7fca4d7fa640 1 -- 172.21.15.172:0/356207070 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca500cee10 con 0x7fca500ce3c0 2024-04-25T08:49:11.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.611+0000 7fca56c38640 1 -- 172.21.15.172:0/356207070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7fca50073990 con 0x7fca500ce3c0 2024-04-25T08:49:11.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.658+0000 7fca4d7fa640 1 -- 172.21.15.172:0/356207070 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v333) v1 ==== 158+0+0 (secure 0 0 0) 0x7fca48020020 con 0x7fca500ce3c0 2024-04-25T08:49:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.660+0000 7fca56c38640 1 -- 172.21.15.172:0/356207070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca3006b4d0 msgr2=0x7fca3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.660+0000 7fca56c38640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca3006b4d0 0x7fca3006d990 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fca38034000 tx=0x7fca3802e000 comp rx=0 tx=0).stop 2024-04-25T08:49:11.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.660+0000 7fca56c38640 1 -- 172.21.15.172:0/356207070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500ce3c0 msgr2=0x7fca50151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.660+0000 7fca56c38640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500ce3c0 0x7fca50151560 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fca4800c730 tx=0x7fca4800cbf0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.660+0000 7fca56c38640 1 -- 172.21.15.172:0/356207070 shutdown_connections 2024-04-25T08:49:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.660+0000 7fca56c38640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca3006b4d0 0x7fca3006d990 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.660+0000 7fca56c38640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca50154ee0 0x7fca501f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.660+0000 7fca56c38640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca500cfec0 0x7fca5015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.660+0000 7fca56c38640 1 --2- 172.21.15.172:0/356207070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca500ce3c0 0x7fca50151560 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.660+0000 7fca56c38640 1 -- 172.21.15.172:0/356207070 >> 172.21.15.172:0/356207070 conn(0x7fca5006abe0 msgr2=0x7fca501537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.661+0000 7fca56c38640 1 -- 172.21.15.172:0/356207070 shutdown_connections 2024-04-25T08:49:11.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.661+0000 7fca56c38640 1 -- 172.21.15.172:0/356207070 wait complete. 2024-04-25T08:49:11.663 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:49:11.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.773+0000 7f3d20930640 1 Processor -- start 2024-04-25T08:49:11.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.773+0000 7f3d20930640 1 -- start start 2024-04-25T08:49:11.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.774+0000 7f3d20930640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c162140 0x7f3d1c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.774+0000 7f3d20930640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3d1c0cd540 0x7f3d1c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.774+0000 7f3d20930640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1c15e3a0 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.774+0000 7f3d20930640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1c1625c0 con 0x7f3d1c0cd540 2024-04-25T08:49:11.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.774+0000 7f3d20930640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c0cd9d0 con 0x7f3d1c162140 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.774+0000 7f3d13fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c162140 0x7f3d1c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.774+0000 7f3d1ad9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3d1c0cd540 0x7f3d1c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.774+0000 7f3d1a59c640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f3d1c0d0a00 0x7f3d1c0d0de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:60824/0 (socket says 172.21.15.172:60824) 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.774+0000 7f3d1a59c640 1 -- 172.21.15.172:0/3792059223 learned_addr learned my addr 172.21.15.172:0/3792059223 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.775+0000 7f3d19d9b640 1 -- 172.21.15.172:0/3792059223 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583039784 0 0) 0x7f3d1c15e3a0 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.775+0000 7f3d19d9b640 1 -- 172.21.15.172:0/3792059223 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d08003520 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.775+0000 7f3d13fff640 1 -- 172.21.15.172:0/3792059223 >> v2:172.21.15.186:3300/0 conn(0x7f3d1c0cd540 msgr2=0x7f3d1c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.775+0000 7f3d13fff640 1 --2- 172.21.15.172:0/3792059223 >> v2:172.21.15.186:3300/0 conn(0x7f3d1c0cd540 0x7f3d1c0caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.775+0000 7f3d13fff640 1 -- 172.21.15.172:0/3792059223 >> v1:172.21.15.186:6789/0 conn(0x7f3d1c0d0a00 legacy=0x7f3d1c0d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.775+0000 7f3d13fff640 1 -- 172.21.15.172:0/3792059223 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c0cdc70 con 0x7f3d1c162140 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d13fff640 1 --2- 172.21.15.172:0/3792059223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c162140 0x7f3d1c0cd000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d040097d0 tx=0x7f3d0402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2d7a0cc69a099c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d19d9b640 1 -- 172.21.15.172:0/3792059223 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04037070 con 0x7f3d1c162140 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d19d9b640 1 -- 172.21.15.172:0/3792059223 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0402ae40 con 0x7f3d1c162140 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d19d9b640 1 -- 172.21.15.172:0/3792059223 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04032640 con 0x7f3d1c162140 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d20930640 1 -- 172.21.15.172:0/3792059223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c162140 msgr2=0x7f3d1c0cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d20930640 1 --2- 172.21.15.172:0/3792059223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c162140 0x7f3d1c0cd000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d040097d0 tx=0x7f3d0402a130 comp rx=0 tx=0).stop 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d20930640 1 -- 172.21.15.172:0/3792059223 shutdown_connections 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d20930640 1 --2- 172.21.15.172:0/3792059223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c162140 0x7f3d1c0cd000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d20930640 1 --2- 172.21.15.172:0/3792059223 >> v2:172.21.15.186:3300/0 conn(0x7f3d1c0cd540 0x7f3d1c0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d20930640 1 -- 172.21.15.172:0/3792059223 >> 172.21.15.172:0/3792059223 conn(0x7f3d1c0d17c0 msgr2=0x7f3d1c0d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d20930640 1 -- 172.21.15.172:0/3792059223 shutdown_connections 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.776+0000 7f3d20930640 1 -- 172.21.15.172:0/3792059223 wait complete. 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d20930640 1 Processor -- start 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d20930640 1 -- start start 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d20930640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c0cd540 0x7f3d1c0b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d20930640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d1c0d0a00 0x7f3d1c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d20930640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d1c162140 0x7f3d1c0b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d20930640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c161940 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d20930640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c161660 con 0x7f3d1c162140 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d20930640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c161c20 con 0x7f3d1c0cd540 2024-04-25T08:49:11.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d13fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d1c0d0a00 0x7f3d1c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d13fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d1c0d0a00 0x7f3d1c15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50620/0 (socket says 172.21.15.172:50620) 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.778+0000 7f3d13fff640 1 -- 172.21.15.172:0/3577501205 learned_addr learned my addr 172.21.15.172:0/3577501205 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d1a59c640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c0cd540 0x7f3d1c0b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d1ad9d640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d1c162140 0x7f3d1c0b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d13fff640 1 -- 172.21.15.172:0/3577501205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c0cd540 msgr2=0x7f3d1c0b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d13fff640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c0cd540 0x7f3d1c0b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d13fff640 1 -- 172.21.15.172:0/3577501205 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d1c162140 msgr2=0x7f3d1c0b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d13fff640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d1c162140 0x7f3d1c0b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d13fff640 1 -- 172.21.15.172:0/3577501205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c0b6a20 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d13fff640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d1c0d0a00 0x7f3d1c15d9a0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3d04000c00 tx=0x7f3d040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d12ffd640 1 -- 172.21.15.172:0/3577501205 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04041070 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d12ffd640 1 -- 172.21.15.172:0/3577501205 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0403c460 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d12ffd640 1 -- 172.21.15.172:0/3577501205 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04037040 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d20930640 1 -- 172.21.15.172:0/3577501205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1c0b6d00 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.779+0000 7f3d20930640 1 -- 172.21.15.172:0/3577501205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c0b72c0 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.780+0000 7f3d20930640 1 -- 172.21.15.172:0/3577501205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1c1f3770 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.780+0000 7f3d12ffd640 1 -- 172.21.15.172:0/3577501205 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3d04044070 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.781+0000 7f3d12ffd640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3cfc06b4d0 0x7f3cfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:11.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.781+0000 7f3d12ffd640 1 -- 172.21.15.172:0/3577501205 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f3d040aa610 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.781+0000 7f3d1a59c640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3cfc06b4d0 0x7f3cfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:11.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.781+0000 7f3d1a59c640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3cfc06b4d0 0x7f3cfc06d990 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c007fd0 tx=0x7f3d0c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:11.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.785+0000 7f3d12ffd640 1 -- 172.21.15.172:0/3577501205 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3d040797b0 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.958+0000 7f3d20930640 1 -- 172.21.15.172:0/3577501205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3d1c073a00 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.964+0000 7f3d12ffd640 1 -- 172.21.15.172:0/3577501205 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d040790b0 con 0x7f3d1c0d0a00 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 -- 172.21.15.172:0/3577501205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3cfc06b4d0 msgr2=0x7f3cfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3cfc06b4d0 0x7f3cfc06d990 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c007fd0 tx=0x7f3d0c009040 comp rx=0 tx=0).stop 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 -- 172.21.15.172:0/3577501205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d1c0d0a00 msgr2=0x7f3d1c15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d1c0d0a00 0x7f3d1c15d9a0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3d04000c00 tx=0x7f3d040046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 -- 172.21.15.172:0/3577501205 shutdown_connections 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3cfc06b4d0 0x7f3cfc06d990 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d1c162140 0x7f3d1c0b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d1c0d0a00 0x7f3d1c15d9a0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 --2- 172.21.15.172:0/3577501205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d1c0cd540 0x7f3d1c0b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 -- 172.21.15.172:0/3577501205 >> 172.21.15.172:0/3577501205 conn(0x7f3d1c0d17c0 msgr2=0x7f3d1c06d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:11.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 -- 172.21.15.172:0/3577501205 shutdown_connections 2024-04-25T08:49:11.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:11.966+0000 7f3d20930640 1 -- 172.21.15.172:0/3577501205 wait complete. 2024-04-25T08:49:11.968 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:49:11.968 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:49:12.004 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:49:12.061 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:49:12.061 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:12.061 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:12.077 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:49:12.077 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:49:12.077 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:12.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:49:12.094 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:12.094 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:12.131 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:49:12.131 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:49:12.131 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:12.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:49:12.151 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:49:12.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:12.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.277+0000 7ff581b7e640 1 Processor -- start 2024-04-25T08:49:12.268 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.277+0000 7ff581b7e640 1 -- start start 2024-04-25T08:49:12.270 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff581b7e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 0x7ff57c0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff581b7e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff57c0cfcf0 0x7ff57c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff581b7e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff57c0ce3c0 0x7ff57c15e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff581b7e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57c0ce830 con 0x7ff57c0ce3c0 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff581b7e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57c072090 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff581b7e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c0d0150 con 0x7ff57c154ee0 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff57bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff57c0ce3c0 0x7ff57c15e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff57bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff57c0ce3c0 0x7ff57c15e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50634/0 (socket says 172.21.15.172:50634) 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff57bfff640 1 -- 172.21.15.172:0/3520942863 learned_addr learned my addr 172.21.15.172:0/3520942863 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff57b7fe640 1 --2- 172.21.15.172:0/3520942863 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 0x7ff57c0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff57affd640 1 --2- 172.21.15.172:0/3520942863 >> v2:172.21.15.186:3300/0 conn(0x7ff57c0cfcf0 0x7ff57c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff57bfff640 1 -- 172.21.15.172:0/3520942863 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 msgr2=0x7ff57c0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff57bfff640 1 --2- 172.21.15.172:0/3520942863 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 0x7ff57c0cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff57bfff640 1 -- 172.21.15.172:0/3520942863 >> v2:172.21.15.186:3300/0 conn(0x7ff57c0cfcf0 msgr2=0x7ff57c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:12.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff57bfff640 1 --2- 172.21.15.172:0/3520942863 >> v2:172.21.15.186:3300/0 conn(0x7ff57c0cfcf0 0x7ff57c0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.278+0000 7ff57bfff640 1 -- 172.21.15.172:0/3520942863 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c071480 con 0x7ff57c0ce3c0 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff57bfff640 1 --2- 172.21.15.172:0/3520942863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0ce3c0 0x7ff57c15e570 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0cd350 tx=0x7ff57402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec1f77f25bb3e57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff57a7fc640 1 -- 172.21.15.172:0/3520942863 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574036070 con 0x7ff57c0ce3c0 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff57a7fc640 1 -- 172.21.15.172:0/3520942863 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff574031600 con 0x7ff57c0ce3c0 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff57a7fc640 1 -- 172.21.15.172:0/3520942863 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5740319d0 con 0x7ff57c0ce3c0 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff581b7e640 1 -- 172.21.15.172:0/3520942863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0ce3c0 msgr2=0x7ff57c15e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff581b7e640 1 --2- 172.21.15.172:0/3520942863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0ce3c0 0x7ff57c15e570 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0cd350 tx=0x7ff57402a6c0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff581b7e640 1 -- 172.21.15.172:0/3520942863 shutdown_connections 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff581b7e640 1 --2- 172.21.15.172:0/3520942863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0ce3c0 0x7ff57c15e570 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff581b7e640 1 --2- 172.21.15.172:0/3520942863 >> v2:172.21.15.186:3300/0 conn(0x7ff57c0cfcf0 0x7ff57c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff581b7e640 1 --2- 172.21.15.172:0/3520942863 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 0x7ff57c0cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.279+0000 7ff581b7e640 1 -- 172.21.15.172:0/3520942863 >> 172.21.15.172:0/3520942863 conn(0x7ff57c06abe0 msgr2=0x7ff57c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.280+0000 7ff581b7e640 1 -- 172.21.15.172:0/3520942863 shutdown_connections 2024-04-25T08:49:12.272 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.280+0000 7ff581b7e640 1 -- 172.21.15.172:0/3520942863 wait complete. 2024-04-25T08:49:12.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.281+0000 7ff581b7e640 1 Processor -- start 2024-04-25T08:49:12.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.281+0000 7ff581b7e640 1 -- start start 2024-04-25T08:49:12.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.281+0000 7ff581b7e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff57c0ce3c0 0x7ff57c1f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.281+0000 7ff581b7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0cfcf0 0x7ff57c0af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.281+0000 7ff581b7e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 0x7ff57c0af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff581b7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c071a40 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff581b7e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c071230 con 0x7ff57c0ce3c0 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff581b7e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c071d20 con 0x7ff57c154ee0 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0cfcf0 0x7ff57c0af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0cfcf0 0x7ff57c0af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50642/0 (socket says 172.21.15.172:50642) 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57affd640 1 -- 172.21.15.172:0/461913528 learned_addr learned my addr 172.21.15.172:0/461913528 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57bfff640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 0x7ff57c0af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57b7fe640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff57c0ce3c0 0x7ff57c1f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57affd640 1 -- 172.21.15.172:0/461913528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 msgr2=0x7ff57c0af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57affd640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 0x7ff57c0af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57affd640 1 -- 172.21.15.172:0/461913528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff57c0ce3c0 msgr2=0x7ff57c1f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57affd640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff57c0ce3c0 0x7ff57c1f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57affd640 1 -- 172.21.15.172:0/461913528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c141db0 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57bfff640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 0x7ff57c0af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57b7fe640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff57c0ce3c0 0x7ff57c1f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff57affd640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0cfcf0 0x7ff57c0af190 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ff57000d830 tx=0x7ff57000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff563fff640 1 -- 172.21.15.172:0/461913528 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570018020 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff563fff640 1 -- 172.21.15.172:0/461913528 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5700096a0 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff581b7e640 1 -- 172.21.15.172:0/461913528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c13eed0 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff563fff640 1 -- 172.21.15.172:0/461913528 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570009a70 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.282+0000 7ff581b7e640 1 -- 172.21.15.172:0/461913528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c13f490 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.283+0000 7ff581b7e640 1 -- 172.21.15.172:0/461913528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c073990 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.284+0000 7ff563fff640 1 -- 172.21.15.172:0/461913528 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff57001b020 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.284+0000 7ff563fff640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff56806b500 0x7ff56806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.284+0000 7ff57b7fe640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff56806b500 0x7ff56806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.284+0000 7ff563fff640 1 -- 172.21.15.172:0/461913528 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff57008a7d0 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.285+0000 7ff57b7fe640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff56806b500 0x7ff56806d9c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff56c006fd0 tx=0x7ff56c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:12.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.288+0000 7ff563fff640 1 -- 172.21.15.172:0/461913528 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff570022020 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.496+0000 7ff581b7e640 1 -- 172.21.15.172:0/461913528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff57c1536b0 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.497+0000 7ff563fff640 1 -- 172.21.15.172:0/461913528 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3705 (secure 0 0 0) 0x7ff570011340 con 0x7ff57c0cfcf0 2024-04-25T08:49:12.488 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:12.488 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":58,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/154236059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":154236059},{"type":"v1","addr":"172.21.15.172:6837","nonce":154236059}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6047,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/985041095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":985041095},{"type":"v1","addr":"172.21.15.186:6835","nonce":985041095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6940,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/1263246596","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1263246596},{"type":"v1","addr":"172.21.15.186:6834","nonce":1263246596}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7686,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/1301700155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1301700155},{"type":"v1","addr":"172.21.15.172:6836","nonce":1301700155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[]} 2024-04-25T08:49:12.488 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 58 2024-04-25T08:49:12.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.498+0000 7ff581b7e640 1 -- 172.21.15.172:0/461913528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff56806b500 msgr2=0x7ff56806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.498+0000 7ff581b7e640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff56806b500 0x7ff56806d9c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff56c006fd0 tx=0x7ff56c008040 comp rx=0 tx=0).stop 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.498+0000 7ff581b7e640 1 -- 172.21.15.172:0/461913528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0cfcf0 msgr2=0x7ff57c0af190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.498+0000 7ff581b7e640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0cfcf0 0x7ff57c0af190 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7ff57000d830 tx=0x7ff57000dcf0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.498+0000 7ff581b7e640 1 -- 172.21.15.172:0/461913528 shutdown_connections 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.498+0000 7ff581b7e640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff56806b500 0x7ff56806d9c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.498+0000 7ff581b7e640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff57c154ee0 0x7ff57c0af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.498+0000 7ff581b7e640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff57c0cfcf0 0x7ff57c0af190 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.498+0000 7ff581b7e640 1 --2- 172.21.15.172:0/461913528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff57c0ce3c0 0x7ff57c1f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.499+0000 7ff581b7e640 1 -- 172.21.15.172:0/461913528 >> 172.21.15.172:0/461913528 conn(0x7ff57c06abe0 msgr2=0x7ff57c15a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.499+0000 7ff581b7e640 1 -- 172.21.15.172:0/461913528 shutdown_connections 2024-04-25T08:49:12.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.499+0000 7ff581b7e640 1 -- 172.21.15.172:0/461913528 wait complete. 2024-04-25T08:49:12.502 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:49:12.502 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:49:12.502 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:49:12.503 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:49:12.503 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:49:12.503 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:49:12.503 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:49:12.503 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:49:12.503 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:49:12.503 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:49:12.504 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:49:12.504 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:49:12.504 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:49:12.504 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:49:12.504 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:49:12.504 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:49:12.512 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:49:12.512 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:49:12.513 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:49:12.513 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:49:12.515 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:49:12.515 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:49:12.516 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:49:12.516 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:49:12.554 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:49:12.554 DEBUG:teuthology.parallel:result is None 2024-04-25T08:49:12.555 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:49:12.555 DEBUG:teuthology.parallel:result is None 2024-04-25T08:49:12.558 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:49:12.558 DEBUG:teuthology.parallel:result is None 2024-04-25T08:49:12.559 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:49:12.559 DEBUG:teuthology.parallel:result is None 2024-04-25T08:49:12.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:49:12.628 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:49:12.628 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:49:12.641 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:49:12.641 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:49:12.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.672+0000 7f097b410640 1 Processor -- start 2024-04-25T08:49:12.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.672+0000 7f097b410640 1 -- start start 2024-04-25T08:49:12.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.673+0000 7f097b410640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0974161710 0x7f09740d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.673+0000 7f097b410640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097415e000 con 0x7f097415dc20 2024-04-25T08:49:12.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.673+0000 7f097b410640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09740d1de0 con 0x7f09740ced80 2024-04-25T08:49:12.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.673+0000 7f097b410640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0974161c60 con 0x7f0974161710 2024-04-25T08:49:12.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.673+0000 7f09791ac640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f097415dc20 0x7f09740ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59642/0 (socket says 172.21.15.172:59642) 2024-04-25T08:49:12.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.673+0000 7f09791ac640 1 -- 172.21.15.172:0/3134261634 learned_addr learned my addr 172.21.15.172:0/3134261634 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:12.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.673+0000 7f09799ad640 1 --2- 172.21.15.172:0/3134261634 >> v2:172.21.15.186:3300/0 conn(0x7f0974161710 0x7f09740d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.673+0000 7f096bfff640 1 -- 172.21.15.172:0/3134261634 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013742492 0 0) 0x7f097415e000 con 0x7f097415dc20 2024-04-25T08:49:12.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.673+0000 7f096bfff640 1 -- 172.21.15.172:0/3134261634 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0960003520 con 0x7f097415dc20 2024-04-25T08:49:12.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.673+0000 7f09799ad640 1 -- 172.21.15.172:0/3134261634 >> v1:172.21.15.186:6789/0 conn(0x7f09740ced80 legacy=0x7f09740d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:12.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.674+0000 7f09799ad640 1 -- 172.21.15.172:0/3134261634 >> v1:172.21.15.172:6789/0 conn(0x7f097415dc20 legacy=0x7f09740ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:12.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.674+0000 7f09799ad640 1 -- 172.21.15.172:0/3134261634 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0974161f40 con 0x7f0974161710 2024-04-25T08:49:12.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.674+0000 7f09799ad640 1 --2- 172.21.15.172:0/3134261634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0974161710 0x7f09740d29f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f096c009d90 tx=0x7f096c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=430dc1426bdfee74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:12.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.674+0000 7f096bfff640 1 -- 172.21.15.172:0/3134261634 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c007740 con 0x7f0974161710 2024-04-25T08:49:12.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.674+0000 7f096bfff640 1 -- 172.21.15.172:0/3134261634 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c0078e0 con 0x7f0974161710 2024-04-25T08:49:12.666 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.674+0000 7f096bfff640 1 -- 172.21.15.172:0/3134261634 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c007cb0 con 0x7f0974161710 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.675+0000 7f097b410640 1 -- 172.21.15.172:0/3134261634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0974161710 msgr2=0x7f09740d29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.675+0000 7f097b410640 1 --2- 172.21.15.172:0/3134261634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0974161710 0x7f09740d29f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f096c009d90 tx=0x7f096c02a6f0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.675+0000 7f097b410640 1 -- 172.21.15.172:0/3134261634 shutdown_connections 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.675+0000 7f097b410640 1 --2- 172.21.15.172:0/3134261634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0974161710 0x7f09740d29f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.675+0000 7f097b410640 1 -- 172.21.15.172:0/3134261634 >> 172.21.15.172:0/3134261634 conn(0x7f09740d0420 msgr2=0x7f09740d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.675+0000 7f097b410640 1 -- 172.21.15.172:0/3134261634 shutdown_connections 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.675+0000 7f097b410640 1 -- 172.21.15.172:0/3134261634 wait complete. 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.676+0000 7f097b410640 1 Processor -- start 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.676+0000 7f097b410640 1 -- start start 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f097b410640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09740ced80 0x7f097414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f097b410640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f097415dc20 0x7f09740c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f097b410640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0974161710 0x7f09740c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f097b410640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09740b5e50 con 0x7f0974161710 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f097b410640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0974162500 con 0x7f097415dc20 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f097b410640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09740b5fd0 con 0x7f09740ced80 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f09799ad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0974161710 0x7f09740c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f09799ad640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0974161710 0x7f09740c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50674/0 (socket says 172.21.15.172:50674) 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f09799ad640 1 -- 172.21.15.172:0/3248850823 learned_addr learned my addr 172.21.15.172:0/3248850823 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f09791ac640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09740ced80 0x7f097414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.677+0000 7f09789ab640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f097415dc20 0x7f09740c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.678+0000 7f09799ad640 1 -- 172.21.15.172:0/3248850823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09740ced80 msgr2=0x7f097414ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.678+0000 7f09799ad640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09740ced80 0x7f097414ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.678+0000 7f09799ad640 1 -- 172.21.15.172:0/3248850823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f097415dc20 msgr2=0x7f09740c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.678+0000 7f09799ad640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f097415dc20 0x7f09740c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:12.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.678+0000 7f09799ad640 1 -- 172.21.15.172:0/3248850823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097414f200 con 0x7f0974161710 2024-04-25T08:49:12.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.678+0000 7f09799ad640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0974161710 0x7f09740c9a70 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f096c009eb0 tx=0x7f096c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:12.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.680+0000 7f0969ffb640 1 -- 172.21.15.172:0/3248850823 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c040070 con 0x7f0974161710 2024-04-25T08:49:12.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.680+0000 7f097b410640 1 -- 172.21.15.172:0/3248850823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097415eda0 con 0x7f0974161710 2024-04-25T08:49:12.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.680+0000 7f0969ffb640 1 -- 172.21.15.172:0/3248850823 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c031bc0 con 0x7f0974161710 2024-04-25T08:49:12.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.680+0000 7f0969ffb640 1 -- 172.21.15.172:0/3248850823 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c009450 con 0x7f0974161710 2024-04-25T08:49:12.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.681+0000 7f097b410640 1 -- 172.21.15.172:0/3248850823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097415f360 con 0x7f0974161710 2024-04-25T08:49:12.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.682+0000 7f097b410640 1 -- 172.21.15.172:0/3248850823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097415b720 con 0x7f0974161710 2024-04-25T08:49:12.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.682+0000 7f0969ffb640 1 -- 172.21.15.172:0/3248850823 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f096c039040 con 0x7f0974161710 2024-04-25T08:49:12.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.682+0000 7f0969ffb640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f095806b4d0 0x7f095806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:12.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.682+0000 7f0969ffb640 1 -- 172.21.15.172:0/3248850823 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f096c0ab840 con 0x7f0974161710 2024-04-25T08:49:12.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.683+0000 7f09791ac640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f095806b4d0 0x7f095806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:12.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.683+0000 7f09791ac640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f095806b4d0 0x7f095806d990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f09700011e0 tx=0x7f0970007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:12.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.688+0000 7f0969ffb640 1 -- 172.21.15.172:0/3248850823 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f097415b720 con 0x7f0974161710 2024-04-25T08:49:12.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:12.870+0000 7f097b410640 1 -- 172.21.15.172:0/3248850823 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0974073a00 con 0x7f0974161710 2024-04-25T08:49:13.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.683+0000 7f0969ffb640 1 -- 172.21.15.172:0/3248850823 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v103) v1 ==== 97+0+0 (secure 0 0 0) 0x7f096c07a280 con 0x7f0974161710 2024-04-25T08:49:13.674 INFO:teuthology.orchestra.run.smithi172.stderr: removed all blocklist entries 2024-04-25T08:49:13.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 -- 172.21.15.172:0/3248850823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f095806b4d0 msgr2=0x7f095806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f095806b4d0 0x7f095806d990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f09700011e0 tx=0x7f0970007d30 comp rx=0 tx=0).stop 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 -- 172.21.15.172:0/3248850823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0974161710 msgr2=0x7f09740c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0974161710 0x7f09740c9a70 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f096c009eb0 tx=0x7f096c004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 -- 172.21.15.172:0/3248850823 shutdown_connections 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f095806b4d0 0x7f095806d990 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f097415dc20 0x7f09740c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0974161710 0x7f09740c9a70 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 --2- 172.21.15.172:0/3248850823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09740ced80 0x7f097414ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 -- 172.21.15.172:0/3248850823 >> 172.21.15.172:0/3248850823 conn(0x7f09740d0420 msgr2=0x7f09740d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 -- 172.21.15.172:0/3248850823 shutdown_connections 2024-04-25T08:49:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.685+0000 7f097b410640 1 -- 172.21.15.172:0/3248850823 wait complete. 2024-04-25T08:49:13.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:49:13.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.795+0000 7f48649e7640 1 Processor -- start 2024-04-25T08:49:13.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.796+0000 7f48649e7640 1 -- start start 2024-04-25T08:49:13.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.796+0000 7f48649e7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48600b2cb0 0x7f48600d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:13.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.796+0000 7f48649e7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48600b97a0 con 0x7f48600d1020 2024-04-25T08:49:13.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.796+0000 7f48649e7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48600d1c50 con 0x7f486015dbe0 2024-04-25T08:49:13.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.796+0000 7f48649e7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486015dfc0 con 0x7f48600b2cb0 2024-04-25T08:49:13.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485ed9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f48600d1020 0x7f48600d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59656/0 (socket says 172.21.15.172:59656) 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485ed9d640 1 -- 172.21.15.172:0/624879873 learned_addr learned my addr 172.21.15.172:0/624879873 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485dd9b640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48600b2cb0 0x7f48600d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883757105 0 0) 0x7f48600b97a0 con 0x7f48600d1020 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f484c003520 con 0x7f48600d1020 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 575017832 0 0) 0x7f484c003520 con 0x7f48600d1020 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48600b2cb0 msgr2=0x7f48600d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48600b2cb0 0x7f48600d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 >> v1:172.21.15.186:6789/0 conn(0x7f486015dbe0 legacy=0x7f48600d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600d1f30 con 0x7f48600d1020 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f4850001670 con 0x7f48600d1020 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 >> v1:172.21.15.172:6789/0 conn(0x7f48600d1020 legacy=0x7f48600d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48600b2cb0 0x7f484c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 0x7f484c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f484c004d40 0x7f484c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c00b9f0 con 0x7f484c003f20 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c00bba0 con 0x7f484c004d40 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c00bda0 con 0x7f48600b2cb0 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485dd9b640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 0x7f484c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485ed9d640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f484c004d40 0x7f484c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.797+0000 7f485e59c640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48600b2cb0 0x7f484c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485dd9b640 1 -- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48600b2cb0 msgr2=0x7f484c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485dd9b640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48600b2cb0 0x7f484c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485dd9b640 1 -- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f484c004d40 msgr2=0x7f484c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485dd9b640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f484c004d40 0x7f484c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485dd9b640 1 -- 172.21.15.172:0/624879873 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c003520 con 0x7f484c003f20 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485ed9d640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f484c004d40 0x7f484c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485e59c640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48600b2cb0 0x7f484c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485dd9b640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 0x7f484c004800 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4848009ac0 tx=0x7f484c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88098dce368b573 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848036070 con 0x7f484c003f20 2024-04-25T08:49:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4848031400 con 0x7f484c003f20 2024-04-25T08:49:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.798+0000 7f485d59a640 1 -- 172.21.15.172:0/624879873 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848009690 con 0x7f484c003f20 2024-04-25T08:49:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.799+0000 7f48649e7640 1 -- 172.21.15.172:0/624879873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 msgr2=0x7f484c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.799+0000 7f48649e7640 1 --2- 172.21.15.172:0/624879873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 0x7f484c004800 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4848009ac0 tx=0x7f484c005830 comp rx=0 tx=0).stop 2024-04-25T08:49:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.799+0000 7f485ed9d640 1 -- 172.21.15.172:0/624879873 reap_dead start 2024-04-25T08:49:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.799+0000 7f48649e7640 1 -- 172.21.15.172:0/624879873 shutdown_connections 2024-04-25T08:49:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.799+0000 7f48649e7640 1 -- 172.21.15.172:0/624879873 >> 172.21.15.172:0/624879873 conn(0x7f4860061a20 msgr2=0x7f4860061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.799+0000 7f48649e7640 1 -- 172.21.15.172:0/624879873 shutdown_connections 2024-04-25T08:49:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.799+0000 7f48649e7640 1 -- 172.21.15.172:0/624879873 wait complete. 2024-04-25T08:49:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.800+0000 7f48649e7640 1 Processor -- start 2024-04-25T08:49:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.800+0000 7f48649e7640 1 -- start start 2024-04-25T08:49:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f48649e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 0x7f48600c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f48649e7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f486015dfc0 0x7f486015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f48649e7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f486015e440 0x7f486015f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f48649e7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600b92a0 con 0x7f484c003f20 2024-04-25T08:49:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f48649e7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600d1a00 con 0x7f486015e440 2024-04-25T08:49:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f48649e7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600b9420 con 0x7f486015dfc0 2024-04-25T08:49:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f485e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 0x7f48600c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f485e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 0x7f48600c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50702/0 (socket says 172.21.15.172:50702) 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f485e59c640 1 -- 172.21.15.172:0/3567332388 learned_addr learned my addr 172.21.15.172:0/3567332388 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f485ed9d640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f486015e440 0x7f486015f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f485e59c640 1 -- 172.21.15.172:0/3567332388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f486015dfc0 msgr2=0x7f486015ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f485e59c640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f486015dfc0 0x7f486015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f485e59c640 1 -- 172.21.15.172:0/3567332388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f486015e440 msgr2=0x7f486015f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f485e59c640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f486015e440 0x7f486015f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f485e59c640 1 -- 172.21.15.172:0/3567332388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600cadc0 con 0x7f484c003f20 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.801+0000 7f485ed9d640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f486015e440 0x7f486015f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.802+0000 7f485e59c640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 0x7f48600c9410 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f485800eba0 tx=0x7f485800c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.802+0000 7f4856ffd640 1 -- 172.21.15.172:0/3567332388 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485800cbc0 con 0x7f484c003f20 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.802+0000 7f4856ffd640 1 -- 172.21.15.172:0/3567332388 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4858018070 con 0x7f484c003f20 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.802+0000 7f48649e7640 1 -- 172.21.15.172:0/3567332388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48600cb0a0 con 0x7f484c003f20 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.802+0000 7f4856ffd640 1 -- 172.21.15.172:0/3567332388 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858003970 con 0x7f484c003f20 2024-04-25T08:49:13.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.802+0000 7f48649e7640 1 -- 172.21.15.172:0/3567332388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48600cb660 con 0x7f484c003f20 2024-04-25T08:49:13.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.803+0000 7f48649e7640 1 -- 172.21.15.172:0/3567332388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4860073990 con 0x7f484c003f20 2024-04-25T08:49:13.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.803+0000 7f4856ffd640 1 -- 172.21.15.172:0/3567332388 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4858003b10 con 0x7f484c003f20 2024-04-25T08:49:13.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.803+0000 7f4856ffd640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f484006b4d0 0x7f484006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:13.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.804+0000 7f4856ffd640 1 -- 172.21.15.172:0/3567332388 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f485808a380 con 0x7f484c003f20 2024-04-25T08:49:13.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.804+0000 7f485dd9b640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f484006b4d0 0x7f484006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:13.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.804+0000 7f485dd9b640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f484006b4d0 0x7f484006d990 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4848033000 tx=0x7f484802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:13.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:13.808+0000 7f4856ffd640 1 -- 172.21.15.172:0/3567332388 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f48580593c0 con 0x7f484c003f20 2024-04-25T08:49:14.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.043+0000 7f48649e7640 1 -- 172.21.15.172:0/3567332388 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4860067f10 con 0x7f484c003f20 2024-04-25T08:49:14.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.043+0000 7f4856ffd640 1 -- 172.21.15.172:0/3567332388 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f485805f0c0 con 0x7f484c003f20 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: "auth_dump": [ 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.a", 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q==", 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.035 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.b", 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg==", 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.c", 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA==", 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:14.036 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.d", 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg==", 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.037 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.0", 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ==", 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.1", 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g==", 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:14.038 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.2", 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g==", 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.3", 2024-04-25T08:49:14.039 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg==", 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.4", 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw==", 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.5", 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow==", 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.6", 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg==", 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:14.041 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.7", 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q==", 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.042 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.0", 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q==", 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow r", 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.1", 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g==", 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:49:14.043 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.2", 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw==", 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.3", 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w==", 2024-04-25T08:49:14.044 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.admin", 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmFmQsIBAAkuAmqIptAT1ivH6T7/1T8A==", 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.045 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.x", 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw==", 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.y", 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg==", 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:14.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.047 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.047 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-25T08:49:14.047 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:49:14.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 -- 172.21.15.172:0/3567332388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f484006b4d0 msgr2=0x7f484006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f484006b4d0 0x7f484006d990 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4848033000 tx=0x7f484802e000 comp rx=0 tx=0).stop 2024-04-25T08:49:14.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 -- 172.21.15.172:0/3567332388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 msgr2=0x7f48600c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 0x7f48600c9410 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f485800eba0 tx=0x7f485800c4b0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 -- 172.21.15.172:0/3567332388 shutdown_connections 2024-04-25T08:49:14.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f484006b4d0 0x7f484006d990 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f486015e440 0x7f486015f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f486015dfc0 0x7f486015ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 --2- 172.21.15.172:0/3567332388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f484c003f20 0x7f48600c9410 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 -- 172.21.15.172:0/3567332388 >> 172.21.15.172:0/3567332388 conn(0x7f4860061a20 msgr2=0x7f48600b7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:14.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 -- 172.21.15.172:0/3567332388 shutdown_connections 2024-04-25T08:49:14.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.045+0000 7f48649e7640 1 -- 172.21.15.172:0/3567332388 wait complete. 2024-04-25T08:49:14.049 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:14.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.155+0000 7f0102e07640 1 Processor -- start 2024-04-25T08:49:14.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.155+0000 7f0102e07640 1 -- start start 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f0102e07640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00fc15dc90 0x7f00fc1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f0102e07640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00fc0cce50 con 0x7f00fc0cc8e0 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f0102e07640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00fc161af0 con 0x7f00fc0d1810 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f0102e07640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00fc161dd0 con 0x7f00fc15dc90 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f0100ba3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00fc15dc90 0x7f00fc1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f00fbfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f00fc0cc8e0 0x7f00fc15ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59670/0 (socket says 172.21.15.172:59670) 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f00fbfff640 1 -- 172.21.15.172:0/4163092819 learned_addr learned my addr 172.21.15.172:0/4163092819 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f0100ba3640 1 -- 172.21.15.172:0/4163092819 >> v1:172.21.15.186:6789/0 conn(0x7f00fc0d1810 legacy=0x7f00fc0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f0100ba3640 1 -- 172.21.15.172:0/4163092819 >> v1:172.21.15.172:6789/0 conn(0x7f00fc0cc8e0 legacy=0x7f00fc15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f00fb7fe640 1 -- 172.21.15.172:0/4163092819 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723548224 0 0) 0x7f00fc0cce50 con 0x7f00fc0cc8e0 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.156+0000 7f0100ba3640 1 -- 172.21.15.172:0/4163092819 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc1620b0 con 0x7f00fc15dc90 2024-04-25T08:49:14.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.157+0000 7f0100ba3640 1 --2- 172.21.15.172:0/4163092819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc15dc90 0x7f00fc1625d0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f00f00097a0 tx=0x7f00f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a376dae712869ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:14.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.157+0000 7f00fb7fe640 1 -- 172.21.15.172:0/4163092819 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0037070 con 0x7f00fc15dc90 2024-04-25T08:49:14.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.157+0000 7f00fb7fe640 1 -- 172.21.15.172:0/4163092819 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f0032440 con 0x7f00fc15dc90 2024-04-25T08:49:14.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.157+0000 7f00fb7fe640 1 -- 172.21.15.172:0/4163092819 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0032810 con 0x7f00fc15dc90 2024-04-25T08:49:14.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.157+0000 7f0102e07640 1 -- 172.21.15.172:0/4163092819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc15dc90 msgr2=0x7f00fc1625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.157+0000 7f0102e07640 1 --2- 172.21.15.172:0/4163092819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc15dc90 0x7f00fc1625d0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f00f00097a0 tx=0x7f00f002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.158+0000 7f0102e07640 1 -- 172.21.15.172:0/4163092819 shutdown_connections 2024-04-25T08:49:14.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.158+0000 7f0102e07640 1 --2- 172.21.15.172:0/4163092819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc15dc90 0x7f00fc1625d0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.158+0000 7f0102e07640 1 -- 172.21.15.172:0/4163092819 >> 172.21.15.172:0/4163092819 conn(0x7f00fc06f590 msgr2=0x7f00fc06f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:14.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.158+0000 7f0102e07640 1 -- 172.21.15.172:0/4163092819 shutdown_connections 2024-04-25T08:49:14.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.158+0000 7f0102e07640 1 -- 172.21.15.172:0/4163092819 wait complete. 2024-04-25T08:49:14.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.159+0000 7f0102e07640 1 Processor -- start 2024-04-25T08:49:14.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.159+0000 7f0102e07640 1 -- start start 2024-04-25T08:49:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f0102e07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00fc0cc8e0 0x7f00fc159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f0102e07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc0d1810 0x7f00fc156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f0102e07640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00fc15dc90 0x7f00fc0c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f0102e07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc15e1f0 con 0x7f00fc0d1810 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f0102e07640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc15e070 con 0x7f00fc15dc90 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f0102e07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc0d1c80 con 0x7f00fc0cc8e0 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00fbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc0d1810 0x7f00fc156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00fbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc0d1810 0x7f00fc156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50724/0 (socket says 172.21.15.172:50724) 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00fbfff640 1 -- 172.21.15.172:0/1157680296 learned_addr learned my addr 172.21.15.172:0/1157680296 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f01013a4640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00fc15dc90 0x7f00fc0c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f0100ba3640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00fc0cc8e0 0x7f00fc159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00fbfff640 1 -- 172.21.15.172:0/1157680296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00fc0cc8e0 msgr2=0x7f00fc159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00fbfff640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00fc0cc8e0 0x7f00fc159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00fbfff640 1 -- 172.21.15.172:0/1157680296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00fc15dc90 msgr2=0x7f00fc0c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00fbfff640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00fc15dc90 0x7f00fc0c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00fbfff640 1 -- 172.21.15.172:0/1157680296 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc157130 con 0x7f00fc0d1810 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f01013a4640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00fc15dc90 0x7f00fc0c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00fbfff640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc0d1810 0x7f00fc156180 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f00e800c4a0 tx=0x7f00e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:14.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00f97fa640 1 -- 172.21.15.172:0/1157680296 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8018070 con 0x7f00fc0d1810 2024-04-25T08:49:14.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00f97fa640 1 -- 172.21.15.172:0/1157680296 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e80074e0 con 0x7f00fc0d1810 2024-04-25T08:49:14.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f0102e07640 1 -- 172.21.15.172:0/1157680296 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc0c7190 con 0x7f00fc0d1810 2024-04-25T08:49:14.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f00f97fa640 1 -- 172.21.15.172:0/1157680296 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8004a20 con 0x7f00fc0d1810 2024-04-25T08:49:14.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.160+0000 7f0102e07640 1 -- 172.21.15.172:0/1157680296 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc1f7840 con 0x7f00fc0d1810 2024-04-25T08:49:14.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.161+0000 7f0102e07640 1 -- 172.21.15.172:0/1157680296 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc073990 con 0x7f00fc0d1810 2024-04-25T08:49:14.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.162+0000 7f00f97fa640 1 -- 172.21.15.172:0/1157680296 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f00e801b070 con 0x7f00fc0d1810 2024-04-25T08:49:14.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.162+0000 7f00f97fa640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00e006b4d0 0x7f00e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.162+0000 7f00f97fa640 1 -- 172.21.15.172:0/1157680296 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f00e8089380 con 0x7f00fc0d1810 2024-04-25T08:49:14.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.162+0000 7f0100ba3640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00e006b4d0 0x7f00e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.163+0000 7f0100ba3640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00e006b4d0 0x7f00e006d990 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f00f0034000 tx=0x7f00f002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:14.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.166+0000 7f00f97fa640 1 -- 172.21.15.172:0/1157680296 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f00e80583c0 con 0x7f00fc0d1810 2024-04-25T08:49:14.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.338+0000 7f0102e07640 1 -- 172.21.15.172:0/1157680296 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00fc0cf6b0 con 0x7f00fc0d1810 2024-04-25T08:49:14.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.339+0000 7f00f97fa640 1 -- 172.21.15.172:0/1157680296 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+13226 (secure 0 0 0) 0x7f00e805e0c0 con 0x7f00fc0d1810 2024-04-25T08:49:14.330 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:14.330 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":103,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:13.682730+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 -- 172.21.15.172:0/1157680296 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00e006b4d0 msgr2=0x7f00e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00e006b4d0 0x7f00e006d990 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f00f0034000 tx=0x7f00f002e000 comp rx=0 tx=0).stop 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 -- 172.21.15.172:0/1157680296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc0d1810 msgr2=0x7f00fc156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc0d1810 0x7f00fc156180 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f00e800c4a0 tx=0x7f00e800c960 comp rx=0 tx=0).stop 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 -- 172.21.15.172:0/1157680296 shutdown_connections 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f00e006b4d0 0x7f00e006d990 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00fc15dc90 0x7f00fc0c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00fc0d1810 0x7f00fc156180 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 --2- 172.21.15.172:0/1157680296 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00fc0cc8e0 0x7f00fc159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 -- 172.21.15.172:0/1157680296 >> 172.21.15.172:0/1157680296 conn(0x7f00fc06f590 msgr2=0x7f00fc0c4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 -- 172.21.15.172:0/1157680296 shutdown_connections 2024-04-25T08:49:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.341+0000 7f0102e07640 1 -- 172.21.15.172:0/1157680296 wait complete. 2024-04-25T08:49:14.343 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:49:14.343 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:49:14.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.452+0000 7ff5a2ef5640 1 Processor -- start 2024-04-25T08:49:14.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.452+0000 7ff5a2ef5640 1 -- start start 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.453+0000 7ff5a2ef5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff59c0ced80 0x7ff59c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.453+0000 7ff5a2ef5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff59c161710 0x7ff59c0d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.453+0000 7ff5a2ef5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c15e000 con 0x7ff59c15dc20 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.453+0000 7ff5a2ef5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c0d1de0 con 0x7ff59c161710 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.453+0000 7ff5a2ef5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c161c60 con 0x7ff59c0ced80 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.453+0000 7ff5a1492640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff59c161710 0x7ff59c0d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.453+0000 7ff5a0c91640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff59c15dc20 0x7ff59c0ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59672/0 (socket says 172.21.15.172:59672) 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.453+0000 7ff5a0c91640 1 -- 172.21.15.172:0/1921688761 learned_addr learned my addr 172.21.15.172:0/1921688761 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.454+0000 7ff59bfff640 1 --2- 172.21.15.172:0/1921688761 >> v2:172.21.15.186:3300/0 conn(0x7ff59c0ced80 0x7ff59c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.454+0000 7ff5a1492640 1 -- 172.21.15.172:0/1921688761 >> v2:172.21.15.186:3300/0 conn(0x7ff59c0ced80 msgr2=0x7ff59c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.454+0000 7ff5a1492640 1 --2- 172.21.15.172:0/1921688761 >> v2:172.21.15.186:3300/0 conn(0x7ff59c0ced80 0x7ff59c0d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.454+0000 7ff5a1492640 1 -- 172.21.15.172:0/1921688761 >> v1:172.21.15.172:6789/0 conn(0x7ff59c15dc20 legacy=0x7ff59c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.454+0000 7ff59b7fe640 1 -- 172.21.15.172:0/1921688761 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107334705 0 0) 0x7ff59c15e000 con 0x7ff59c15dc20 2024-04-25T08:49:14.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.454+0000 7ff5a1492640 1 -- 172.21.15.172:0/1921688761 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c161f40 con 0x7ff59c161710 2024-04-25T08:49:14.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.454+0000 7ff5a1492640 1 --2- 172.21.15.172:0/1921688761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c161710 0x7ff59c0d2820 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7ff59c06da90 tx=0x7ff59402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c6486f8c656b86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:14.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.454+0000 7ff59b7fe640 1 -- 172.21.15.172:0/1921688761 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594007740 con 0x7ff59c161710 2024-04-25T08:49:14.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.455+0000 7ff59b7fe640 1 -- 172.21.15.172:0/1921688761 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5940078e0 con 0x7ff59c161710 2024-04-25T08:49:14.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.455+0000 7ff59b7fe640 1 -- 172.21.15.172:0/1921688761 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594007cb0 con 0x7ff59c161710 2024-04-25T08:49:14.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.455+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1921688761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c161710 msgr2=0x7ff59c0d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.455+0000 7ff5a2ef5640 1 --2- 172.21.15.172:0/1921688761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c161710 0x7ff59c0d2820 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7ff59c06da90 tx=0x7ff59402a680 comp rx=0 tx=0).stop 2024-04-25T08:49:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.455+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1921688761 shutdown_connections 2024-04-25T08:49:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.455+0000 7ff5a2ef5640 1 --2- 172.21.15.172:0/1921688761 >> v2:172.21.15.186:3300/0 conn(0x7ff59c0ced80 0x7ff59c0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.455+0000 7ff5a2ef5640 1 --2- 172.21.15.172:0/1921688761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c161710 0x7ff59c0d2820 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.455+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1921688761 >> 172.21.15.172:0/1921688761 conn(0x7ff59c0d0420 msgr2=0x7ff59c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.455+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1921688761 shutdown_connections 2024-04-25T08:49:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.455+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1921688761 wait complete. 2024-04-25T08:49:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.456+0000 7ff5a2ef5640 1 Processor -- start 2024-04-25T08:49:14.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.456+0000 7ff5a2ef5640 1 -- start start 2024-04-25T08:49:14.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a2ef5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c0ced80 0x7ff59c15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a2ef5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff59c15dc20 0x7ff59c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a2ef5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff59c161710 0x7ff59c0c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a2ef5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0b5e50 con 0x7ff59c0ced80 2024-04-25T08:49:14.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a2ef5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c162500 con 0x7ff59c161710 2024-04-25T08:49:14.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a2ef5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0b5fd0 con 0x7ff59c15dc20 2024-04-25T08:49:14.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a0c91640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c0ced80 0x7ff59c15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a0c91640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c0ced80 0x7ff59c15e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50740/0 (socket says 172.21.15.172:50740) 2024-04-25T08:49:14.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a0c91640 1 -- 172.21.15.172:0/1842382025 learned_addr learned my addr 172.21.15.172:0/1842382025 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:14.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff59bfff640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff59c15dc20 0x7ff59c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a1492640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff59c161710 0x7ff59c0c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a0c91640 1 -- 172.21.15.172:0/1842382025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff59c15dc20 msgr2=0x7ff59c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a0c91640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff59c15dc20 0x7ff59c15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.457+0000 7ff5a0c91640 1 -- 172.21.15.172:0/1842382025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff59c161710 msgr2=0x7ff59c0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.458+0000 7ff5a0c91640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff59c161710 0x7ff59c0c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.458+0000 7ff5a0c91640 1 -- 172.21.15.172:0/1842382025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c15f500 con 0x7ff59c0ced80 2024-04-25T08:49:14.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.458+0000 7ff5a1492640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff59c161710 0x7ff59c0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.458+0000 7ff59bfff640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff59c15dc20 0x7ff59c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.458+0000 7ff5a0c91640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c0ced80 0x7ff59c15e6a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00c430 tx=0x7ff58c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.458+0000 7ff5997fa640 1 -- 172.21.15.172:0/1842382025 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0074e0 con 0x7ff59c0ced80 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.458+0000 7ff5997fa640 1 -- 172.21.15.172:0/1842382025 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c0047e0 con 0x7ff59c0ced80 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.458+0000 7ff5997fa640 1 -- 172.21.15.172:0/1842382025 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c004bd0 con 0x7ff59c0ced80 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.458+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1842382025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c1e81e0 con 0x7ff59c0ced80 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.458+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1842382025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c1e87a0 con 0x7ff59c0ced80 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.459+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1842382025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c0cf380 con 0x7ff59c0ced80 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.459+0000 7ff5997fa640 1 -- 172.21.15.172:0/1842382025 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff58c011070 con 0x7ff59c0ced80 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.460+0000 7ff5997fa640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff58806b4d0 0x7ff58806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.460+0000 7ff5997fa640 1 -- 172.21.15.172:0/1842382025 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ff58c089cb0 con 0x7ff59c0ced80 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.460+0000 7ff59bfff640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff58806b4d0 0x7ff58806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.460+0000 7ff59bfff640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff58806b4d0 0x7ff58806d990 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff590006fd0 tx=0x7ff590008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:14.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.464+0000 7ff5997fa640 1 -- 172.21.15.172:0/1842382025 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff59c0cf380 con 0x7ff59c0ced80 2024-04-25T08:49:14.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.635+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1842382025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff59c073a00 con 0x7ff59c0ced80 2024-04-25T08:49:14.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.636+0000 7ff5997fa640 1 -- 172.21.15.172:0/1842382025 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff58c058cf0 con 0x7ff59c0ced80 2024-04-25T08:49:14.627 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:49:14.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1842382025 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff58806b4d0 msgr2=0x7ff58806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff58806b4d0 0x7ff58806d990 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff590006fd0 tx=0x7ff590008040 comp rx=0 tx=0).stop 2024-04-25T08:49:14.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1842382025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c0ced80 msgr2=0x7ff59c15e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c0ced80 0x7ff59c15e6a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00c430 tx=0x7ff58c00c8f0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1842382025 shutdown_connections 2024-04-25T08:49:14.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff58806b4d0 0x7ff58806d990 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff59c161710 0x7ff59c0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff59c15dc20 0x7ff59c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 --2- 172.21.15.172:0/1842382025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff59c0ced80 0x7ff59c15e6a0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1842382025 >> 172.21.15.172:0/1842382025 conn(0x7ff59c0d0420 msgr2=0x7ff59c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:14.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1842382025 shutdown_connections 2024-04-25T08:49:14.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.638+0000 7ff5a2ef5640 1 -- 172.21.15.172:0/1842382025 wait complete. 2024-04-25T08:49:14.640 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:49:14.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.748+0000 7fa72ad90640 1 Processor -- start 2024-04-25T08:49:14.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.748+0000 7fa72ad90640 1 -- start start 2024-04-25T08:49:14.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72ad90640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72413d190 0x7fa7240cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72ad90640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa724071940 0x7fa7240cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72ad90640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa724071ed0 con 0x7fa72415b320 2024-04-25T08:49:14.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72ad90640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72413d570 con 0x7fa724071940 2024-04-25T08:49:14.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72ad90640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72415a840 con 0x7fa72413d190 2024-04-25T08:49:14.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72932d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa724071940 0x7fa7240cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72932d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa724071940 0x7fa7240cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50756/0 (socket says 172.21.15.172:50756) 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72932d640 1 -- 172.21.15.172:0/805770537 learned_addr learned my addr 172.21.15.172:0/805770537 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa728b2c640 1 --2- 172.21.15.172:0/805770537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72413d190 0x7fa7240cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72932d640 1 -- 172.21.15.172:0/805770537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72413d190 msgr2=0x7fa7240cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72932d640 1 --2- 172.21.15.172:0/805770537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72413d190 0x7fa7240cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72932d640 1 -- 172.21.15.172:0/805770537 >> v1:172.21.15.186:6789/0 conn(0x7fa72415b320 legacy=0x7fa724071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.749+0000 7fa72932d640 1 -- 172.21.15.172:0/805770537 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72415ab20 con 0x7fa724071940 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.750+0000 7fa72932d640 1 --2- 172.21.15.172:0/805770537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa724071940 0x7fa7240cc4f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00d150 tx=0x7fa71c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852c6b5c39c9b27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.750+0000 7fa7237fe640 1 -- 172.21.15.172:0/805770537 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c039070 con 0x7fa724071940 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.750+0000 7fa7237fe640 1 -- 172.21.15.172:0/805770537 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c009600 con 0x7fa724071940 2024-04-25T08:49:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.750+0000 7fa7237fe640 1 -- 172.21.15.172:0/805770537 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c0099d0 con 0x7fa724071940 2024-04-25T08:49:14.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.751+0000 7fa72ad90640 1 -- 172.21.15.172:0/805770537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa724071940 msgr2=0x7fa7240cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.751+0000 7fa72ad90640 1 --2- 172.21.15.172:0/805770537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa724071940 0x7fa7240cc4f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00d150 tx=0x7fa71c02c890 comp rx=0 tx=0).stop 2024-04-25T08:49:14.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.751+0000 7fa72ad90640 1 -- 172.21.15.172:0/805770537 shutdown_connections 2024-04-25T08:49:14.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.751+0000 7fa72ad90640 1 --2- 172.21.15.172:0/805770537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa724071940 0x7fa7240cc4f0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.751+0000 7fa72ad90640 1 --2- 172.21.15.172:0/805770537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72413d190 0x7fa7240cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.751+0000 7fa72ad90640 1 -- 172.21.15.172:0/805770537 >> 172.21.15.172:0/805770537 conn(0x7fa72406abe0 msgr2=0x7fa72406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:14.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.751+0000 7fa72ad90640 1 -- 172.21.15.172:0/805770537 shutdown_connections 2024-04-25T08:49:14.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.751+0000 7fa72ad90640 1 -- 172.21.15.172:0/805770537 wait complete. 2024-04-25T08:49:14.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.752+0000 7fa72ad90640 1 Processor -- start 2024-04-25T08:49:14.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.752+0000 7fa72ad90640 1 -- start start 2024-04-25T08:49:14.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa72ad90640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa724071940 0x7fa724155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa72ad90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa72413d190 0x7fa7240cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa72ad90640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72415b320 0x7fa724136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa72ad90640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7240cf7a0 con 0x7fa72413d190 2024-04-25T08:49:14.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa72ad90640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7240cf620 con 0x7fa724071940 2024-04-25T08:49:14.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa72ad90640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7240cf920 con 0x7fa72415b320 2024-04-25T08:49:14.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa723fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa72413d190 0x7fa7240cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa723fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa72413d190 0x7fa7240cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50772/0 (socket says 172.21.15.172:50772) 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa723fff640 1 -- 172.21.15.172:0/863891342 learned_addr learned my addr 172.21.15.172:0/863891342 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa728b2c640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa724071940 0x7fa724155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa72932d640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72415b320 0x7fa724136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa723fff640 1 -- 172.21.15.172:0/863891342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72415b320 msgr2=0x7fa724136dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa723fff640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72415b320 0x7fa724136dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa723fff640 1 -- 172.21.15.172:0/863891342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa724071940 msgr2=0x7fa724155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa723fff640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa724071940 0x7fa724155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa723fff640 1 -- 172.21.15.172:0/863891342 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7241f3ca0 con 0x7fa72413d190 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.753+0000 7fa723fff640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa72413d190 0x7fa7240cd770 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fa71800c3f0 tx=0x7fa71800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.754+0000 7fa7217fa640 1 -- 172.21.15.172:0/863891342 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718017070 con 0x7fa72413d190 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.754+0000 7fa7217fa640 1 -- 172.21.15.172:0/863891342 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7180052f0 con 0x7fa72413d190 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.754+0000 7fa72ad90640 1 -- 172.21.15.172:0/863891342 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7241549d0 con 0x7fa72413d190 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.754+0000 7fa7217fa640 1 -- 172.21.15.172:0/863891342 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718003830 con 0x7fa72413d190 2024-04-25T08:49:14.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.754+0000 7fa72ad90640 1 -- 172.21.15.172:0/863891342 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa724154f90 con 0x7fa72413d190 2024-04-25T08:49:14.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.755+0000 7fa72ad90640 1 -- 172.21.15.172:0/863891342 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa724073990 con 0x7fa72413d190 2024-04-25T08:49:14.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.755+0000 7fa7217fa640 1 -- 172.21.15.172:0/863891342 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa71801a070 con 0x7fa72413d190 2024-04-25T08:49:14.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.755+0000 7fa7217fa640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71006b4d0 0x7fa71006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:14.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.756+0000 7fa728b2c640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71006b4d0 0x7fa71006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:14.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.756+0000 7fa7217fa640 1 -- 172.21.15.172:0/863891342 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa718089350 con 0x7fa72413d190 2024-04-25T08:49:14.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.756+0000 7fa728b2c640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71006b4d0 0x7fa71006d990 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa714006fd0 tx=0x7fa714008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:14.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.760+0000 7fa7217fa640 1 -- 172.21.15.172:0/863891342 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa718058390 con 0x7fa72413d190 2024-04-25T08:49:14.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.935+0000 7fa72ad90640 1 -- 172.21.15.172:0/863891342 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa7240cfeb0 con 0x7fa72413d190 2024-04-25T08:49:14.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.935+0000 7fa7217fa640 1 -- 172.21.15.172:0/863891342 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa718057c90 con 0x7fa72413d190 2024-04-25T08:49:14.927 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:14.927 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:49:14.927 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:14.927 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2024-04-25T08:49:14.927 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2024-04-25T08:49:14.927 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:14.927 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:49:14.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 -- 172.21.15.172:0/863891342 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71006b4d0 msgr2=0x7fa71006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71006b4d0 0x7fa71006d990 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa714006fd0 tx=0x7fa714008040 comp rx=0 tx=0).stop 2024-04-25T08:49:14.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 -- 172.21.15.172:0/863891342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa72413d190 msgr2=0x7fa7240cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:14.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa72413d190 0x7fa7240cd770 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fa71800c3f0 tx=0x7fa71800c8b0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 -- 172.21.15.172:0/863891342 shutdown_connections 2024-04-25T08:49:14.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71006b4d0 0x7fa71006d990 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72415b320 0x7fa724136dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa72413d190 0x7fa7240cd770 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 --2- 172.21.15.172:0/863891342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa724071940 0x7fa724155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:14.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 -- 172.21.15.172:0/863891342 >> 172.21.15.172:0/863891342 conn(0x7fa72406abe0 msgr2=0x7fa724071230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:14.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 -- 172.21.15.172:0/863891342 shutdown_connections 2024-04-25T08:49:14.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:14.937+0000 7fa72ad90640 1 -- 172.21.15.172:0/863891342 wait complete. 2024-04-25T08:49:14.939 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:49:14.939 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:49:15.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.049+0000 7fbdd6528640 1 Processor -- start 2024-04-25T08:49:15.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.050+0000 7fbdd6528640 1 -- start start 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.050+0000 7fbdd6528640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01616f0 0x7fbdd0161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.050+0000 7fbdd6528640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbdd00ce0a0 0x7fbdd00ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.050+0000 7fbdd6528640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd006c8d0 con 0x7fbdd01610f0 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.050+0000 7fbdd6528640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd01614d0 con 0x7fbdd00ce0a0 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.050+0000 7fbdd6528640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00c6960 con 0x7fbdd01616f0 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.050+0000 7fbdd4ac5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbdd00ce0a0 0x7fbdd00ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.050+0000 7fbdd4ac5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbdd00ce0a0 0x7fbdd00ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50774/0 (socket says 172.21.15.172:50774) 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.051+0000 7fbdd4ac5640 1 -- 172.21.15.172:0/3273619785 learned_addr learned my addr 172.21.15.172:0/3273619785 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.051+0000 7fbdcf7fe640 1 --2- 172.21.15.172:0/3273619785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01616f0 0x7fbdd0161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.051+0000 7fbdd4ac5640 1 -- 172.21.15.172:0/3273619785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01616f0 msgr2=0x7fbdd0161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.051+0000 7fbdd4ac5640 1 --2- 172.21.15.172:0/3273619785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01616f0 0x7fbdd0161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.051+0000 7fbdd4ac5640 1 -- 172.21.15.172:0/3273619785 >> v1:172.21.15.186:6789/0 conn(0x7fbdd01610f0 legacy=0x7fbdd006c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:15.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.051+0000 7fbdd4ac5640 1 -- 172.21.15.172:0/3273619785 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd0162260 con 0x7fbdd00ce0a0 2024-04-25T08:49:15.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.051+0000 7fbdcf7fe640 1 --2- 172.21.15.172:0/3273619785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01616f0 0x7fbdd0161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:15.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.051+0000 7fbdd4ac5640 1 --2- 172.21.15.172:0/3273619785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd00ce0a0 0x7fbdd00ce530 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009e50 tx=0x7fbdc802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ea608f6d29b437 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:15.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdceffd640 1 -- 172.21.15.172:0/3273619785 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8036070 con 0x7fbdd00ce0a0 2024-04-25T08:49:15.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdceffd640 1 -- 172.21.15.172:0/3273619785 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8031600 con 0x7fbdd00ce0a0 2024-04-25T08:49:15.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdceffd640 1 -- 172.21.15.172:0/3273619785 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc80319d0 con 0x7fbdd00ce0a0 2024-04-25T08:49:15.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdd6528640 1 -- 172.21.15.172:0/3273619785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd00ce0a0 msgr2=0x7fbdd00ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:15.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdd6528640 1 --2- 172.21.15.172:0/3273619785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd00ce0a0 0x7fbdd00ce530 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009e50 tx=0x7fbdc802a6c0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdd6528640 1 -- 172.21.15.172:0/3273619785 shutdown_connections 2024-04-25T08:49:15.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdd6528640 1 --2- 172.21.15.172:0/3273619785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd00ce0a0 0x7fbdd00ce530 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdd6528640 1 --2- 172.21.15.172:0/3273619785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01616f0 0x7fbdd0161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdd6528640 1 -- 172.21.15.172:0/3273619785 >> 172.21.15.172:0/3273619785 conn(0x7fbdd006f500 msgr2=0x7fbdd006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:15.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdd6528640 1 -- 172.21.15.172:0/3273619785 shutdown_connections 2024-04-25T08:49:15.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.052+0000 7fbdd6528640 1 -- 172.21.15.172:0/3273619785 wait complete. 2024-04-25T08:49:15.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.053+0000 7fbdd6528640 1 Processor -- start 2024-04-25T08:49:15.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.053+0000 7fbdd6528640 1 -- start start 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdd6528640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd00ce0a0 0x7fbdd015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdd6528640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01610f0 0x7fbdd00b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdd6528640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd01616f0 0x7fbdd00b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdd6528640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00cfce0 con 0x7fbdd01616f0 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdd6528640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00cfa00 con 0x7fbdd00ce0a0 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdd6528640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00cf690 con 0x7fbdd01610f0 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdd4ac5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd01616f0 0x7fbdd00b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdd4ac5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd01616f0 0x7fbdd00b4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50788/0 (socket says 172.21.15.172:50788) 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdd4ac5640 1 -- 172.21.15.172:0/2419644744 learned_addr learned my addr 172.21.15.172:0/2419644744 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdcf7fe640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01610f0 0x7fbdd00b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.054+0000 7fbdcffff640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd00ce0a0 0x7fbdd015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdd4ac5640 1 -- 172.21.15.172:0/2419644744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01610f0 msgr2=0x7fbdd00b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdd4ac5640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01610f0 0x7fbdd00b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdd4ac5640 1 -- 172.21.15.172:0/2419644744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd00ce0a0 msgr2=0x7fbdd015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdd4ac5640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd00ce0a0 0x7fbdd015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdd4ac5640 1 -- 172.21.15.172:0/2419644744 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00b5cb0 con 0x7fbdd01616f0 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdcf7fe640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01610f0 0x7fbdd00b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdd4ac5640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd01616f0 0x7fbdd00b4a60 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009f70 tx=0x7fbdc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdccff9640 1 -- 172.21.15.172:0/2419644744 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc803f020 con 0x7fbdd01616f0 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdccff9640 1 -- 172.21.15.172:0/2419644744 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8037040 con 0x7fbdd01616f0 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdccff9640 1 -- 172.21.15.172:0/2419644744 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8036070 con 0x7fbdd01616f0 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdd6528640 1 -- 172.21.15.172:0/2419644744 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd00b5130 con 0x7fbdd01616f0 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.055+0000 7fbdd6528640 1 -- 172.21.15.172:0/2419644744 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd00b56f0 con 0x7fbdd01616f0 2024-04-25T08:49:15.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.056+0000 7fbdd6528640 1 -- 172.21.15.172:0/2419644744 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd0073a00 con 0x7fbdd01616f0 2024-04-25T08:49:15.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.056+0000 7fbdccff9640 1 -- 172.21.15.172:0/2419644744 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbdc8042020 con 0x7fbdd01616f0 2024-04-25T08:49:15.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.057+0000 7fbdccff9640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdbc06b4d0 0x7fbdbc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.057+0000 7fbdccff9640 1 -- 172.21.15.172:0/2419644744 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fbdc80aa720 con 0x7fbdd01616f0 2024-04-25T08:49:15.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.057+0000 7fbdcffff640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdbc06b4d0 0x7fbdbc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.057+0000 7fbdcffff640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdbc06b4d0 0x7fbdbc06d990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0003d90 tx=0x7fbdc0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:15.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.061+0000 7fbdccff9640 1 -- 172.21.15.172:0/2419644744 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbdc8049030 con 0x7fbdd01616f0 2024-04-25T08:49:15.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.230+0000 7fbdd6528640 1 -- 172.21.15.172:0/2419644744 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbdd00cf150 con 0x7fbdd01616f0 2024-04-25T08:49:15.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.690+0000 7fbdccff9640 1 -- 172.21.15.172:0/2419644744 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v104) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbdc8007c70 con 0x7fbdd01616f0 2024-04-25T08:49:15.681 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2024-04-25T08:49:15.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 -- 172.21.15.172:0/2419644744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdbc06b4d0 msgr2=0x7fbdbc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:15.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdbc06b4d0 0x7fbdbc06d990 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0003d90 tx=0x7fbdc0009040 comp rx=0 tx=0).stop 2024-04-25T08:49:15.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 -- 172.21.15.172:0/2419644744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd01616f0 msgr2=0x7fbdd00b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:15.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd01616f0 0x7fbdd00b4a60 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009f70 tx=0x7fbdc8004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:15.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 -- 172.21.15.172:0/2419644744 shutdown_connections 2024-04-25T08:49:15.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbdbc06b4d0 0x7fbdbc06d990 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbdd01616f0 0x7fbdd00b4a60 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdd01610f0 0x7fbdd00b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 --2- 172.21.15.172:0/2419644744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdd00ce0a0 0x7fbdd015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 -- 172.21.15.172:0/2419644744 >> 172.21.15.172:0/2419644744 conn(0x7fbdd006f500 msgr2=0x7fbdd00b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:15.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 -- 172.21.15.172:0/2419644744 shutdown_connections 2024-04-25T08:49:15.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.692+0000 7fbdd6528640 1 -- 172.21.15.172:0/2419644744 wait complete. 2024-04-25T08:49:15.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:49:15.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.812+0000 7f77f92d2640 1 Processor -- start 2024-04-25T08:49:15.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.812+0000 7f77f92d2640 1 -- start start 2024-04-25T08:49:15.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f92d2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77f415b5a0 0x7f77f40b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f92d2640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77f415b980 0x7f77f40b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f92d2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f40cf320 con 0x7f77f4162450 2024-04-25T08:49:15.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f92d2640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f40cf040 con 0x7f77f415b980 2024-04-25T08:49:15.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f92d2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f4161970 con 0x7f77f415b5a0 2024-04-25T08:49:15.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f27fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77f415b980 0x7f77f40b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f37fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f77f4162450 0x7f77f40ce310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59688/0 (socket says 172.21.15.172:59688) 2024-04-25T08:49:15.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f37fe640 1 -- 172.21.15.172:0/2026938274 learned_addr learned my addr 172.21.15.172:0/2026938274 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:15.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f2ffd640 1 --2- 172.21.15.172:0/2026938274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77f415b5a0 0x7f77f40b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f27fc640 1 -- 172.21.15.172:0/2026938274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77f415b5a0 msgr2=0x7f77f40b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:15.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f27fc640 1 --2- 172.21.15.172:0/2026938274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77f415b5a0 0x7f77f40b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f27fc640 1 -- 172.21.15.172:0/2026938274 >> v1:172.21.15.172:6789/0 conn(0x7f77f4162450 legacy=0x7f77f40ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f1ffb640 1 -- 172.21.15.172:0/2026938274 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659799801 0 0) 0x7f77ec001110 con 0x7f77f4162450 2024-04-25T08:49:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.813+0000 7f77f27fc640 1 -- 172.21.15.172:0/2026938274 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4161c50 con 0x7f77f415b980 2024-04-25T08:49:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.814+0000 7f77f27fc640 1 --2- 172.21.15.172:0/2026938274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 0x7f77f40b5a70 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009790 tx=0x7f77e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7666dc965c9e88b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.814+0000 7f77f1ffb640 1 -- 172.21.15.172:0/2026938274 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8037070 con 0x7f77f415b980 2024-04-25T08:49:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.814+0000 7f77f1ffb640 1 -- 172.21.15.172:0/2026938274 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e8032440 con 0x7f77f415b980 2024-04-25T08:49:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.814+0000 7f77f1ffb640 1 -- 172.21.15.172:0/2026938274 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8032810 con 0x7f77f415b980 2024-04-25T08:49:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.815+0000 7f77f92d2640 1 -- 172.21.15.172:0/2026938274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 msgr2=0x7f77f40b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.815+0000 7f77f92d2640 1 --2- 172.21.15.172:0/2026938274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 0x7f77f40b5a70 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009790 tx=0x7f77e802a180 comp rx=0 tx=0).stop 2024-04-25T08:49:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.815+0000 7f77f92d2640 1 -- 172.21.15.172:0/2026938274 shutdown_connections 2024-04-25T08:49:15.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.815+0000 7f77f92d2640 1 --2- 172.21.15.172:0/2026938274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 0x7f77f40b5a70 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.815+0000 7f77f92d2640 1 --2- 172.21.15.172:0/2026938274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77f415b5a0 0x7f77f40b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.815+0000 7f77f92d2640 1 -- 172.21.15.172:0/2026938274 >> 172.21.15.172:0/2026938274 conn(0x7f77f40d0530 msgr2=0x7f77f40d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.815+0000 7f77f92d2640 1 -- 172.21.15.172:0/2026938274 shutdown_connections 2024-04-25T08:49:15.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.815+0000 7f77f92d2640 1 -- 172.21.15.172:0/2026938274 wait complete. 2024-04-25T08:49:15.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.816+0000 7f77f92d2640 1 Processor -- start 2024-04-25T08:49:15.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.816+0000 7f77f92d2640 1 -- start start 2024-04-25T08:49:15.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f92d2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77f415b5a0 0x7f77f41f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f92d2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 0x7f77f40cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f92d2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77f4162450 0x7f77f40c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f92d2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40ceba0 con 0x7f77f415b980 2024-04-25T08:49:15.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f92d2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40cea20 con 0x7f77f4162450 2024-04-25T08:49:15.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f92d2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40ced20 con 0x7f77f415b5a0 2024-04-25T08:49:15.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f27fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 0x7f77f40cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f27fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 0x7f77f40cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50802/0 (socket says 172.21.15.172:50802) 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f27fc640 1 -- 172.21.15.172:0/132247645 learned_addr learned my addr 172.21.15.172:0/132247645 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f37fe640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77f4162450 0x7f77f40c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f2ffd640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77f415b5a0 0x7f77f41f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f27fc640 1 -- 172.21.15.172:0/132247645 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77f415b5a0 msgr2=0x7f77f41f7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f27fc640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77f415b5a0 0x7f77f41f7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f27fc640 1 -- 172.21.15.172:0/132247645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77f4162450 msgr2=0x7f77f40c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f27fc640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77f4162450 0x7f77f40c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f27fc640 1 -- 172.21.15.172:0/132247645 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f40cb0c0 con 0x7f77f415b980 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.817+0000 7f77f27fc640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 0x7f77f40cab80 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f77e8035040 tx=0x7f77e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.818+0000 7f77db7fe640 1 -- 172.21.15.172:0/132247645 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8037040 con 0x7f77f415b980 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.818+0000 7f77db7fe640 1 -- 172.21.15.172:0/132247645 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e8005bd0 con 0x7f77f415b980 2024-04-25T08:49:15.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.818+0000 7f77f92d2640 1 -- 172.21.15.172:0/132247645 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f40cd7a0 con 0x7f77f415b980 2024-04-25T08:49:15.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.818+0000 7f77db7fe640 1 -- 172.21.15.172:0/132247645 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8030770 con 0x7f77f415b980 2024-04-25T08:49:15.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.818+0000 7f77f92d2640 1 -- 172.21.15.172:0/132247645 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f40ca000 con 0x7f77f415b980 2024-04-25T08:49:15.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.819+0000 7f77f92d2640 1 -- 172.21.15.172:0/132247645 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f4073a00 con 0x7f77f415b980 2024-04-25T08:49:15.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.819+0000 7f77db7fe640 1 -- 172.21.15.172:0/132247645 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f77e8030910 con 0x7f77f415b980 2024-04-25T08:49:15.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.820+0000 7f77db7fe640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f77e006b4d0 0x7f77e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:15.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.820+0000 7f77f2ffd640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f77e006b4d0 0x7f77e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:15.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.820+0000 7f77db7fe640 1 -- 172.21.15.172:0/132247645 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f77e80aabf0 con 0x7f77f415b980 2024-04-25T08:49:15.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.820+0000 7f77f2ffd640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f77e006b4d0 0x7f77e006d990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009a60 tx=0x7f77e4003990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:15.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.824+0000 7f77db7fe640 1 -- 172.21.15.172:0/132247645 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f77e8032e20 con 0x7f77f415b980 2024-04-25T08:49:15.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:15.994+0000 7f77f92d2640 1 -- 172.21.15.172:0/132247645 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f77f40d17c0 con 0x7f77f415b980 2024-04-25T08:49:16.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.692+0000 7f77db7fe640 1 -- 172.21.15.172:0/132247645 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v105) v1 ==== 170+0+0 (secure 0 0 0) 0x7f77e8079aa0 con 0x7f77f415b980 2024-04-25T08:49:16.683 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 -- 172.21.15.172:0/132247645 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f77e006b4d0 msgr2=0x7f77e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f77e006b4d0 0x7f77e006d990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009a60 tx=0x7f77e4003990 comp rx=0 tx=0).stop 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 -- 172.21.15.172:0/132247645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 msgr2=0x7f77f40cab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 0x7f77f40cab80 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f77e8035040 tx=0x7f77e80046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 -- 172.21.15.172:0/132247645 shutdown_connections 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f77e006b4d0 0x7f77e006d990 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77f4162450 0x7f77f40c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77f415b980 0x7f77f40cab80 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 --2- 172.21.15.172:0/132247645 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77f415b5a0 0x7f77f41f7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 -- 172.21.15.172:0/132247645 >> 172.21.15.172:0/132247645 conn(0x7f77f40d0530 msgr2=0x7f77f415d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:16.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 -- 172.21.15.172:0/132247645 shutdown_connections 2024-04-25T08:49:16.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.695+0000 7f77f92d2640 1 -- 172.21.15.172:0/132247645 wait complete. 2024-04-25T08:49:16.715 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:49:16.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.826+0000 7fb0796dd640 1 Processor -- start 2024-04-25T08:49:16.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.826+0000 7fb0796dd640 1 -- start start 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.827+0000 7fb0796dd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0740d00e0 0x7fb0740ad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.827+0000 7fb0796dd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0740cb190 con 0x7fb07415bb20 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.827+0000 7fb0796dd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0740cb470 con 0x7fb0740ccdd0 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.827+0000 7fb0796dd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740cb750 con 0x7fb0740d00e0 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.827+0000 7fb072ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb07415bb20 0x7fb0740cc230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59704/0 (socket says 172.21.15.172:59704) 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.827+0000 7fb072ffd640 1 -- 172.21.15.172:0/2876372033 learned_addr learned my addr 172.21.15.172:0/2876372033 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156009612 0 0) 0x7fb0740cb190 con 0x7fb07415bb20 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb060003520 con 0x7fb07415bb20 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0737fe640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0740d00e0 0x7fb0740ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2450507471 0 0) 0x7fb060003520 con 0x7fb07415bb20 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0740d00e0 msgr2=0x7fb0740ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:16.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0740d00e0 0x7fb0740ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 >> v1:172.21.15.186:6789/0 conn(0x7fb0740ccdd0 legacy=0x7fb0740cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0740cba30 con 0x7fb07415bb20 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fb064001670 con 0x7fb07415bb20 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 >> v1:172.21.15.172:6789/0 conn(0x7fb07415bb20 legacy=0x7fb0740cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 0x7fb060003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0740d00e0 0x7fb060004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb060004d40 0x7fb0600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740cb750 con 0x7fb0600039e0 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06000bb20 con 0x7fb060004d40 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06000bd20 con 0x7fb0740d00e0 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb072ffd640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 0x7fb060003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb0737fe640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb060004d40 0x7fb0600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb06a7fc640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0740d00e0 0x7fb060004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb072ffd640 1 -- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0740d00e0 msgr2=0x7fb060004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:16.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb072ffd640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0740d00e0 0x7fb060004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb072ffd640 1 -- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb060004d40 msgr2=0x7fb0600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb072ffd640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb060004d40 0x7fb0600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb072ffd640 1 -- 172.21.15.172:0/2876372033 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb060003520 con 0x7fb0600039e0 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.828+0000 7fb06a7fc640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0740d00e0 0x7fb060004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.829+0000 7fb072ffd640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 0x7fb060003e00 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c240 tx=0x7fb060005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c453d01fa3bda17a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.829+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064007d10 con 0x7fb0600039e0 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.829+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb064005ad0 con 0x7fb0600039e0 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.829+0000 7fb0727fc640 1 -- 172.21.15.172:0/2876372033 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064007070 con 0x7fb0600039e0 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.830+0000 7fb0796dd640 1 -- 172.21.15.172:0/2876372033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 msgr2=0x7fb060003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.830+0000 7fb0796dd640 1 --2- 172.21.15.172:0/2876372033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 0x7fb060003e00 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c240 tx=0x7fb060005830 comp rx=0 tx=0).stop 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.830+0000 7fb0737fe640 1 -- 172.21.15.172:0/2876372033 reap_dead start 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.830+0000 7fb0796dd640 1 -- 172.21.15.172:0/2876372033 shutdown_connections 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.830+0000 7fb0796dd640 1 -- 172.21.15.172:0/2876372033 >> 172.21.15.172:0/2876372033 conn(0x7fb0740b2390 msgr2=0x7fb0740b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.830+0000 7fb0796dd640 1 -- 172.21.15.172:0/2876372033 shutdown_connections 2024-04-25T08:49:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.830+0000 7fb0796dd640 1 -- 172.21.15.172:0/2876372033 wait complete. 2024-04-25T08:49:16.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.831+0000 7fb0796dd640 1 Processor -- start 2024-04-25T08:49:16.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.831+0000 7fb0796dd640 1 -- start start 2024-04-25T08:49:16.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb0796dd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 0x7fb0740b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:16.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb0796dd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0740b5750 0x7fb0741478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb0796dd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb074147e00 0x7fb074148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb0796dd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07415c080 con 0x7fb0600039e0 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb0796dd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07415bf00 con 0x7fb0740b5750 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb0796dd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740cadb0 con 0x7fb074147e00 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb072ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 0x7fb0740b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb072ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 0x7fb0740b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50820/0 (socket says 172.21.15.172:50820) 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb072ffd640 1 -- 172.21.15.172:0/3132127436 learned_addr learned my addr 172.21.15.172:0/3132127436 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb06a7fc640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0740b5750 0x7fb0741478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb0737fe640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb074147e00 0x7fb074148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb072ffd640 1 -- 172.21.15.172:0/3132127436 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb074147e00 msgr2=0x7fb074148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb072ffd640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb074147e00 0x7fb074148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb072ffd640 1 -- 172.21.15.172:0/3132127436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0740b5750 msgr2=0x7fb0741478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb072ffd640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0740b5750 0x7fb0741478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb072ffd640 1 -- 172.21.15.172:0/3132127436 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0740b5fd0 con 0x7fb0600039e0 2024-04-25T08:49:16.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb06a7fc640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0740b5750 0x7fb0741478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb072ffd640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 0x7fb0740b5210 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fb06402ad60 tx=0x7fb0740cb360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.832+0000 7fb06bfff640 1 -- 172.21.15.172:0/3132127436 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064041020 con 0x7fb0600039e0 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.833+0000 7fb06bfff640 1 -- 172.21.15.172:0/3132127436 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb064001430 con 0x7fb0600039e0 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.833+0000 7fb0796dd640 1 -- 172.21.15.172:0/3132127436 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0740b62b0 con 0x7fb0600039e0 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.833+0000 7fb06bfff640 1 -- 172.21.15.172:0/3132127436 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064007070 con 0x7fb0600039e0 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.833+0000 7fb0796dd640 1 -- 172.21.15.172:0/3132127436 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0741487c0 con 0x7fb0600039e0 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.833+0000 7fb0796dd640 1 -- 172.21.15.172:0/3132127436 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb074073a00 con 0x7fb0600039e0 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.834+0000 7fb06bfff640 1 -- 172.21.15.172:0/3132127436 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb064044020 con 0x7fb0600039e0 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.834+0000 7fb06bfff640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb05406b500 0x7fb05406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.834+0000 7fb06bfff640 1 -- 172.21.15.172:0/3132127436 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fb0640aa6d0 con 0x7fb0600039e0 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.835+0000 7fb06a7fc640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb05406b500 0x7fb05406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:16.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.835+0000 7fb06a7fc640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb05406b500 0x7fb05406d9c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb074155790 tx=0x7fb05c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:16.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:16.839+0000 7fb06bfff640 1 -- 172.21.15.172:0/3132127436 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb064079550 con 0x7fb0600039e0 2024-04-25T08:49:17.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.042+0000 7fb0796dd640 1 -- 172.21.15.172:0/3132127436 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb0740b1af0 con 0x7fb0600039e0 2024-04-25T08:49:17.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.716+0000 7fb06bfff640 1 -- 172.21.15.172:0/3132127436 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v60) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb064078e50 con 0x7fb0600039e0 2024-04-25T08:49:17.707 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 15 and data pool 16 2024-04-25T08:49:17.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.719+0000 7fb0796dd640 1 -- 172.21.15.172:0/3132127436 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb05406b500 msgr2=0x7fb05406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:17.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.719+0000 7fb0796dd640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb05406b500 0x7fb05406d9c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb074155790 tx=0x7fb05c009040 comp rx=0 tx=0).stop 2024-04-25T08:49:17.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.720+0000 7fb0796dd640 1 -- 172.21.15.172:0/3132127436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 msgr2=0x7fb0740b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:17.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.720+0000 7fb0796dd640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 0x7fb0740b5210 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fb06402ad60 tx=0x7fb0740cb360 comp rx=0 tx=0).stop 2024-04-25T08:49:17.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.721+0000 7fb0796dd640 1 -- 172.21.15.172:0/3132127436 shutdown_connections 2024-04-25T08:49:17.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.721+0000 7fb0796dd640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb05406b500 0x7fb05406d9c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:17.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.721+0000 7fb0796dd640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0740b5750 0x7fb0741478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:17.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.721+0000 7fb0796dd640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb074147e00 0x7fb074148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:17.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.721+0000 7fb0796dd640 1 --2- 172.21.15.172:0/3132127436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0600039e0 0x7fb0740b5210 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:17.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.721+0000 7fb0796dd640 1 -- 172.21.15.172:0/3132127436 >> 172.21.15.172:0/3132127436 conn(0x7fb0740b2390 msgr2=0x7fb07406fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:17.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.721+0000 7fb0796dd640 1 -- 172.21.15.172:0/3132127436 shutdown_connections 2024-04-25T08:49:17.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.724+0000 7fb0796dd640 1 -- 172.21.15.172:0/3132127436 wait complete. 2024-04-25T08:49:17.744 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:17.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.851+0000 7f0b81d69640 1 Processor -- start 2024-04-25T08:49:17.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.851+0000 7f0b81d69640 1 -- start start 2024-04-25T08:49:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.852+0000 7f0b81d69640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b7c0d1020 0x7f0b7c0d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.852+0000 7f0b81d69640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c0b97a0 con 0x7f0b7c15dbe0 2024-04-25T08:49:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.852+0000 7f0b81d69640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c0d1c50 con 0x7f0b7c0b2cb0 2024-04-25T08:49:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.852+0000 7f0b81d69640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c15dfc0 con 0x7f0b7c0d1020 2024-04-25T08:49:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.852+0000 7f0b7b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0b7c15dbe0 0x7f0b7c0d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40792/0 (socket says 172.21.15.172:40792) 2024-04-25T08:49:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.852+0000 7f0b7b7fe640 1 -- 172.21.15.172:0/2891087484 learned_addr learned my addr 172.21.15.172:0/2891087484 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:17.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7bfff640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b7c0d1020 0x7f0b7c0d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223004795 0 0) 0x7f0b7c0b97a0 con 0x7f0b7c15dbe0 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b64003520 con 0x7f0b7c15dbe0 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882739531 0 0) 0x7f0b7c0d1c50 con 0x7f0b7c0b2cb0 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b7c0b97a0 con 0x7f0b7c0b2cb0 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1829868189 0 0) 0x7f0b64003520 con 0x7f0b7c15dbe0 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b7c0d1020 msgr2=0x7f0b7c0d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b7c0d1020 0x7f0b7c0d2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 >> v1:172.21.15.186:6789/0 conn(0x7f0b7c0b2cb0 legacy=0x7f0b7c0d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0d1f30 con 0x7f0b7c15dbe0 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f0b6c001670 con 0x7f0b7c15dbe0 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 >> v1:172.21.15.172:6789/0 conn(0x7f0b7c15dbe0 legacy=0x7f0b7c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b7c0d1020 0x7f0b64003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:17.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b640040d0 0x7f0b64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b64004d40 0x7f0b640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6400ba70 con 0x7f0b64004d40 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6400bc20 con 0x7f0b640040d0 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6400be20 con 0x7f0b7c0d1020 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7bfff640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b64004d40 0x7f0b640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7b7fe640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b7c0d1020 0x7f0b64003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7affd640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b640040d0 0x7f0b64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7bfff640 1 -- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b7c0d1020 msgr2=0x7f0b64003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7bfff640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b7c0d1020 0x7f0b64003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7bfff640 1 -- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b640040d0 msgr2=0x7f0b64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7bfff640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b640040d0 0x7f0b64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.853+0000 7f0b7bfff640 1 -- 172.21.15.172:0/2891087484 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64003520 con 0x7f0b64004d40 2024-04-25T08:49:17.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.854+0000 7f0b7bfff640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b64004d40 0x7f0b640051c0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009f90 tx=0x7f0b64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60ea28f3d6d85fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.854+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74009c10 con 0x7f0b64004d40 2024-04-25T08:49:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.854+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74036070 con 0x7f0b64004d40 2024-04-25T08:49:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.854+0000 7f0b7a7fc640 1 -- 172.21.15.172:0/2891087484 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74031850 con 0x7f0b64004d40 2024-04-25T08:49:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.855+0000 7f0b81d69640 1 -- 172.21.15.172:0/2891087484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b64004d40 msgr2=0x7f0b640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.855+0000 7f0b81d69640 1 --2- 172.21.15.172:0/2891087484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b64004d40 0x7f0b640051c0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009f90 tx=0x7f0b64005830 comp rx=0 tx=0).stop 2024-04-25T08:49:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.855+0000 7f0b7bfff640 1 -- 172.21.15.172:0/2891087484 reap_dead start 2024-04-25T08:49:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.855+0000 7f0b81d69640 1 -- 172.21.15.172:0/2891087484 shutdown_connections 2024-04-25T08:49:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.855+0000 7f0b81d69640 1 -- 172.21.15.172:0/2891087484 >> 172.21.15.172:0/2891087484 conn(0x7f0b7c061a20 msgr2=0x7f0b7c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.855+0000 7f0b81d69640 1 -- 172.21.15.172:0/2891087484 shutdown_connections 2024-04-25T08:49:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.855+0000 7f0b81d69640 1 -- 172.21.15.172:0/2891087484 wait complete. 2024-04-25T08:49:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.856+0000 7f0b81d69640 1 Processor -- start 2024-04-25T08:49:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.856+0000 7f0b81d69640 1 -- start start 2024-04-25T08:49:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b81d69640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b64004d40 0x7f0b7c1f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b81d69640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b7c0b5b00 0x7f0b7c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b81d69640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0ccc10 0x7f0b7c15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b81d69640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0b92a0 con 0x7f0b7c0ccc10 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b81d69640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0d1a00 con 0x7f0b7c0b5b00 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b81d69640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0b9420 con 0x7f0b64004d40 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0ccc10 0x7f0b7c15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0ccc10 0x7f0b7c15dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54776/0 (socket says 172.21.15.172:54776) 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7bfff640 1 -- 172.21.15.172:0/3237907430 learned_addr learned my addr 172.21.15.172:0/3237907430 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7affd640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b7c0b5b00 0x7f0b7c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7b7fe640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b64004d40 0x7f0b7c1f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7bfff640 1 -- 172.21.15.172:0/3237907430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b64004d40 msgr2=0x7f0b7c1f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7bfff640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b64004d40 0x7f0b7c1f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7bfff640 1 -- 172.21.15.172:0/3237907430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b7c0b5b00 msgr2=0x7f0b7c0cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7bfff640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b7c0b5b00 0x7f0b7c0cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7bfff640 1 -- 172.21.15.172:0/3237907430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0b4db0 con 0x7f0b7c0ccc10 2024-04-25T08:49:17.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.857+0000 7f0b7b7fe640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b64004d40 0x7f0b7c1f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.858+0000 7f0b7bfff640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0ccc10 0x7f0b7c15dfc0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400e230 tx=0x7f0b74009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.858+0000 7f0b63fff640 1 -- 172.21.15.172:0/3237907430 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74009c10 con 0x7f0b7c0ccc10 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.858+0000 7f0b63fff640 1 -- 172.21.15.172:0/3237907430 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74040030 con 0x7f0b7c0ccc10 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.858+0000 7f0b81d69640 1 -- 172.21.15.172:0/3237907430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c0b5020 con 0x7f0b7c0ccc10 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.858+0000 7f0b63fff640 1 -- 172.21.15.172:0/3237907430 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74003df0 con 0x7f0b7c0ccc10 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.858+0000 7f0b81d69640 1 -- 172.21.15.172:0/3237907430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c1f43d0 con 0x7f0b7c0ccc10 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.859+0000 7f0b81d69640 1 -- 172.21.15.172:0/3237907430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c073990 con 0x7f0b7c0ccc10 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.859+0000 7f0b63fff640 1 -- 172.21.15.172:0/3237907430 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b74005d10 con 0x7f0b7c0ccc10 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.860+0000 7f0b63fff640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0b6806b4d0 0x7f0b6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.860+0000 7f0b63fff640 1 -- 172.21.15.172:0/3237907430 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0b740ab7c0 con 0x7f0b7c0ccc10 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.860+0000 7f0b7b7fe640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0b6806b4d0 0x7f0b6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:17.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.860+0000 7f0b7b7fe640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0b6806b4d0 0x7f0b6806d990 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c007d40 tx=0x7f0b6c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:17.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:17.864+0000 7f0b63fff640 1 -- 172.21.15.172:0/3237907430 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b7404a020 con 0x7f0b7c0ccc10 2024-04-25T08:49:18.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.036+0000 7f0b81d69640 1 -- 172.21.15.172:0/3237907430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b7c15cc90 con 0x7f0b7c0ccc10 2024-04-25T08:49:18.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.037+0000 7f0b63fff640 1 -- 172.21.15.172:0/3237907430 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f0b7402e050 con 0x7f0b7c0ccc10 2024-04-25T08:49:18.028 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:18.028 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":106,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:17.044125+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:49:15.250034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T08:49:16.013750+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:18.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 -- 172.21.15.172:0/3237907430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0b6806b4d0 msgr2=0x7f0b6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0b6806b4d0 0x7f0b6806d990 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c007d40 tx=0x7f0b6c009040 comp rx=0 tx=0).stop 2024-04-25T08:49:18.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 -- 172.21.15.172:0/3237907430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0ccc10 msgr2=0x7f0b7c15dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0ccc10 0x7f0b7c15dfc0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0b7400e230 tx=0x7f0b74009750 comp rx=0 tx=0).stop 2024-04-25T08:49:18.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 -- 172.21.15.172:0/3237907430 shutdown_connections 2024-04-25T08:49:18.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0b6806b4d0 0x7f0b6806d990 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b7c0b5b00 0x7f0b7c0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b7c0ccc10 0x7f0b7c15dfc0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 --2- 172.21.15.172:0/3237907430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0b64004d40 0x7f0b7c1f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 -- 172.21.15.172:0/3237907430 >> 172.21.15.172:0/3237907430 conn(0x7f0b7c061a20 msgr2=0x7f0b7c15c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:18.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 -- 172.21.15.172:0/3237907430 shutdown_connections 2024-04-25T08:49:18.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.039+0000 7f0b81d69640 1 -- 172.21.15.172:0/3237907430 wait complete. 2024-04-25T08:49:18.042 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:18.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.148+0000 7f903c84a640 1 Processor -- start 2024-04-25T08:49:18.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.148+0000 7f903c84a640 1 -- start start 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.149+0000 7f903c84a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f903815f020 0x7f90380cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.149+0000 7f903c84a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9038099a40 0x7f9038099ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.149+0000 7f903c84a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90380cc3c0 con 0x7f90380b0b90 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.149+0000 7f903c84a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90380cccb0 con 0x7f903815f020 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.149+0000 7f903c84a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903815f400 con 0x7f9038099a40 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.150+0000 7f903659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f903815f020 0x7f90380cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.150+0000 7f9035d9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f90380b0b90 0x7f90380b10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40802/0 (socket says 172.21.15.172:40802) 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.150+0000 7f9035d9b640 1 -- 172.21.15.172:0/3427417395 learned_addr learned my addr 172.21.15.172:0/3427417395 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.150+0000 7f9036d9d640 1 --2- 172.21.15.172:0/3427417395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9038099a40 0x7f9038099ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.150+0000 7f903659c640 1 -- 172.21.15.172:0/3427417395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9038099a40 msgr2=0x7f9038099ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.150+0000 7f903659c640 1 --2- 172.21.15.172:0/3427417395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9038099a40 0x7f9038099ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.150+0000 7f903659c640 1 -- 172.21.15.172:0/3427417395 >> v1:172.21.15.172:6789/0 conn(0x7f90380b0b90 legacy=0x7f90380b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.150+0000 7f903659c640 1 -- 172.21.15.172:0/3427417395 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380d0550 con 0x7f903815f020 2024-04-25T08:49:18.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.150+0000 7f903559a640 1 -- 172.21.15.172:0/3427417395 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336243120 0 0) 0x7f90380cc3c0 con 0x7f90380b0b90 2024-04-25T08:49:18.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903659c640 1 --2- 172.21.15.172:0/3427417395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 0x7f90380cfe00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f902c0097a0 tx=0x7f902c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd1b463adf12766 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:18.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903559a640 1 -- 172.21.15.172:0/3427417395 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c037070 con 0x7f903815f020 2024-04-25T08:49:18.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903559a640 1 -- 172.21.15.172:0/3427417395 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c032440 con 0x7f903815f020 2024-04-25T08:49:18.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903559a640 1 -- 172.21.15.172:0/3427417395 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c032810 con 0x7f903815f020 2024-04-25T08:49:18.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903c84a640 1 -- 172.21.15.172:0/3427417395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 msgr2=0x7f90380cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903c84a640 1 --2- 172.21.15.172:0/3427417395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 0x7f90380cfe00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f902c0097a0 tx=0x7f902c02a180 comp rx=0 tx=0).stop 2024-04-25T08:49:18.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903c84a640 1 -- 172.21.15.172:0/3427417395 shutdown_connections 2024-04-25T08:49:18.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903c84a640 1 --2- 172.21.15.172:0/3427417395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9038099a40 0x7f9038099ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903c84a640 1 --2- 172.21.15.172:0/3427417395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 0x7f90380cfe00 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903c84a640 1 -- 172.21.15.172:0/3427417395 >> 172.21.15.172:0/3427417395 conn(0x7f90380b3310 msgr2=0x7f90380b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:18.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903c84a640 1 -- 172.21.15.172:0/3427417395 shutdown_connections 2024-04-25T08:49:18.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.151+0000 7f903c84a640 1 -- 172.21.15.172:0/3427417395 wait complete. 2024-04-25T08:49:18.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.153+0000 7f903c84a640 1 Processor -- start 2024-04-25T08:49:18.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.153+0000 7f903c84a640 1 -- start start 2024-04-25T08:49:18.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.153+0000 7f903c84a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9038099a40 0x7f90380c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.153+0000 7f903c84a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90380b0b90 0x7f90380b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.153+0000 7f903c84a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 0x7f903815def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.153+0000 7f903c84a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380cc940 con 0x7f903815f020 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.153+0000 7f903c84a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380cc660 con 0x7f90380b0b90 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.153+0000 7f903c84a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380cd140 con 0x7f9038099a40 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.153+0000 7f9036d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 0x7f903815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.153+0000 7f9036d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 0x7f903815def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54790/0 (socket says 172.21.15.172:54790) 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9036d9d640 1 -- 172.21.15.172:0/3772268093 learned_addr learned my addr 172.21.15.172:0/3772268093 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9035d9b640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90380b0b90 0x7f90380b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f903659c640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9038099a40 0x7f90380c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9036d9d640 1 -- 172.21.15.172:0/3772268093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9038099a40 msgr2=0x7f90380c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9036d9d640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9038099a40 0x7f90380c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9036d9d640 1 -- 172.21.15.172:0/3772268093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90380b0b90 msgr2=0x7f90380b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9036d9d640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90380b0b90 0x7f90380b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9036d9d640 1 -- 172.21.15.172:0/3772268093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380ca4b0 con 0x7f903815f020 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9036d9d640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 0x7f903815def0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f9030007e40 tx=0x7f903000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9026ffd640 1 -- 172.21.15.172:0/3772268093 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030014620 con 0x7f903815f020 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9026ffd640 1 -- 172.21.15.172:0/3772268093 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9030019070 con 0x7f903815f020 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f903c84a640 1 -- 172.21.15.172:0/3772268093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90380ca790 con 0x7f903815f020 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f9026ffd640 1 -- 172.21.15.172:0/3772268093 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030014a20 con 0x7f903815f020 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.154+0000 7f903c84a640 1 -- 172.21.15.172:0/3772268093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90380cad50 con 0x7f903815f020 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.155+0000 7f903c84a640 1 -- 172.21.15.172:0/3772268093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9038073990 con 0x7f903815f020 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.156+0000 7f9026ffd640 1 -- 172.21.15.172:0/3772268093 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9030014bc0 con 0x7f903815f020 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.156+0000 7f9026ffd640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f901806b500 0x7f901806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.156+0000 7f9026ffd640 1 -- 172.21.15.172:0/3772268093 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f903008abd0 con 0x7f903815f020 2024-04-25T08:49:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.156+0000 7f903659c640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f901806b500 0x7f901806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.156+0000 7f903659c640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f901806b500 0x7f901806d9c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f902c034000 tx=0x7f902c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:18.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.160+0000 7f9026ffd640 1 -- 172.21.15.172:0/3772268093 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9030059950 con 0x7f903815f020 2024-04-25T08:49:18.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.330+0000 7f903c84a640 1 -- 172.21.15.172:0/3772268093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90380b77a0 con 0x7f903815f020 2024-04-25T08:49:18.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.331+0000 7f9026ffd640 1 -- 172.21.15.172:0/3772268093 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f9030059250 con 0x7f903815f020 2024-04-25T08:49:18.322 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:18.322 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":106,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:17.044125+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:49:15.250034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T08:49:16.013750+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:18.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 -- 172.21.15.172:0/3772268093 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f901806b500 msgr2=0x7f901806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f901806b500 0x7f901806d9c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f902c034000 tx=0x7f902c02e000 comp rx=0 tx=0).stop 2024-04-25T08:49:18.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 -- 172.21.15.172:0/3772268093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 msgr2=0x7f903815def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 0x7f903815def0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f9030007e40 tx=0x7f903000e4b0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 -- 172.21.15.172:0/3772268093 shutdown_connections 2024-04-25T08:49:18.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f901806b500 0x7f901806d9c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90380b0b90 0x7f90380b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f903815f020 0x7f903815def0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 --2- 172.21.15.172:0/3772268093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9038099a40 0x7f90380c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 -- 172.21.15.172:0/3772268093 >> 172.21.15.172:0/3772268093 conn(0x7f90380b3310 msgr2=0x7f903806fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:18.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 -- 172.21.15.172:0/3772268093 shutdown_connections 2024-04-25T08:49:18.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.333+0000 7f903c84a640 1 -- 172.21.15.172:0/3772268093 wait complete. 2024-04-25T08:49:18.337 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:49:18.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.447+0000 7f57d14ee640 1 Processor -- start 2024-04-25T08:49:18.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.447+0000 7f57d14ee640 1 -- start start 2024-04-25T08:49:18.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.447+0000 7f57d14ee640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57cc15dc20 0x7f57cc0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.447+0000 7f57d14ee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc0d32f0 0x7f57cc0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.447+0000 7f57d14ee640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57cc15e000 con 0x7f57cc161710 2024-04-25T08:49:18.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.447+0000 7f57d14ee640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc0d1de0 con 0x7f57cc15dc20 2024-04-25T08:49:18.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.447+0000 7f57d14ee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc161c60 con 0x7f57cc0d32f0 2024-04-25T08:49:18.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.448+0000 7f57caffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57cc15dc20 0x7f57cc0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.448+0000 7f57caffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57cc15dc20 0x7f57cc0ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54792/0 (socket says 172.21.15.172:54792) 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.448+0000 7f57caffd640 1 -- 172.21.15.172:0/2136536680 learned_addr learned my addr 172.21.15.172:0/2136536680 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.448+0000 7f57cb7fe640 1 --2- 172.21.15.172:0/2136536680 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc0d32f0 0x7f57cc0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.448+0000 7f57caffd640 1 -- 172.21.15.172:0/2136536680 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc0d32f0 msgr2=0x7f57cc0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.448+0000 7f57caffd640 1 --2- 172.21.15.172:0/2136536680 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc0d32f0 0x7f57cc0cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.448+0000 7f57caffd640 1 -- 172.21.15.172:0/2136536680 >> v1:172.21.15.186:6789/0 conn(0x7f57cc161710 legacy=0x7f57cc06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.448+0000 7f57caffd640 1 -- 172.21.15.172:0/2136536680 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc161f40 con 0x7f57cc15dc20 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.448+0000 7f57cb7fe640 1 --2- 172.21.15.172:0/2136536680 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc0d32f0 0x7f57cc0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57caffd640 1 --2- 172.21.15.172:0/2136536680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc15dc20 0x7f57cc0ce670 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009870 tx=0x7f57bc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fae18313eb6c225 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57ca7fc640 1 -- 172.21.15.172:0/2136536680 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc037070 con 0x7f57cc15dc20 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57ca7fc640 1 -- 172.21.15.172:0/2136536680 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc032440 con 0x7f57cc15dc20 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57ca7fc640 1 -- 172.21.15.172:0/2136536680 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc032810 con 0x7f57cc15dc20 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57d14ee640 1 -- 172.21.15.172:0/2136536680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc15dc20 msgr2=0x7f57cc0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57d14ee640 1 --2- 172.21.15.172:0/2136536680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc15dc20 0x7f57cc0ce670 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009870 tx=0x7f57bc02a250 comp rx=0 tx=0).stop 2024-04-25T08:49:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57d14ee640 1 -- 172.21.15.172:0/2136536680 shutdown_connections 2024-04-25T08:49:18.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57d14ee640 1 --2- 172.21.15.172:0/2136536680 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc0d32f0 0x7f57cc0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57d14ee640 1 --2- 172.21.15.172:0/2136536680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc15dc20 0x7f57cc0ce670 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57d14ee640 1 -- 172.21.15.172:0/2136536680 >> 172.21.15.172:0/2136536680 conn(0x7f57cc0d0420 msgr2=0x7f57cc0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:18.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57d14ee640 1 -- 172.21.15.172:0/2136536680 shutdown_connections 2024-04-25T08:49:18.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.449+0000 7f57d14ee640 1 -- 172.21.15.172:0/2136536680 wait complete. 2024-04-25T08:49:18.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.450+0000 7f57d14ee640 1 Processor -- start 2024-04-25T08:49:18.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.451+0000 7f57d14ee640 1 -- start start 2024-04-25T08:49:18.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.451+0000 7f57d14ee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc0d32f0 0x7f57cc0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.451+0000 7f57d14ee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc15dc20 0x7f57cc0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.451+0000 7f57d14ee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57cc161710 0x7f57cc1f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.451+0000 7f57d14ee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc0b5e50 con 0x7f57cc0d32f0 2024-04-25T08:49:18.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.451+0000 7f57d14ee640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc162500 con 0x7f57cc161710 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.451+0000 7f57d14ee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc0b5fd0 con 0x7f57cc15dc20 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.451+0000 7f57caffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc0d32f0 0x7f57cc0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.451+0000 7f57caffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc0d32f0 0x7f57cc0cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54794/0 (socket says 172.21.15.172:54794) 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.451+0000 7f57caffd640 1 -- 172.21.15.172:0/2017077000 learned_addr learned my addr 172.21.15.172:0/2017077000 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57c27fc640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc15dc20 0x7f57cc0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57cb7fe640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57cc161710 0x7f57cc1f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57caffd640 1 -- 172.21.15.172:0/2017077000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc15dc20 msgr2=0x7f57cc0cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57caffd640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc15dc20 0x7f57cc0cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57caffd640 1 -- 172.21.15.172:0/2017077000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57cc161710 msgr2=0x7f57cc1f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57caffd640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57cc161710 0x7f57cc1f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57caffd640 1 -- 172.21.15.172:0/2017077000 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc0cbbd0 con 0x7f57cc0d32f0 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57c27fc640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc15dc20 0x7f57cc0cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57cb7fe640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57cc161710 0x7f57cc1f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57caffd640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc0d32f0 0x7f57cc0cd650 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f57bc000c00 tx=0x7f57bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57c3fff640 1 -- 172.21.15.172:0/2017077000 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc037040 con 0x7f57cc0d32f0 2024-04-25T08:49:18.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57c3fff640 1 -- 172.21.15.172:0/2017077000 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc042070 con 0x7f57cc0d32f0 2024-04-25T08:49:18.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57d14ee640 1 -- 172.21.15.172:0/2017077000 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57cc0cbeb0 con 0x7f57cc0d32f0 2024-04-25T08:49:18.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57c3fff640 1 -- 172.21.15.172:0/2017077000 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc030bb0 con 0x7f57cc0d32f0 2024-04-25T08:49:18.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.452+0000 7f57d14ee640 1 -- 172.21.15.172:0/2017077000 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57cc0cc470 con 0x7f57cc0d32f0 2024-04-25T08:49:18.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.453+0000 7f57d14ee640 1 -- 172.21.15.172:0/2017077000 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57cc073a00 con 0x7f57cc0d32f0 2024-04-25T08:49:18.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.453+0000 7f57c3fff640 1 -- 172.21.15.172:0/2017077000 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f57bc047460 con 0x7f57cc0d32f0 2024-04-25T08:49:18.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.454+0000 7f57c3fff640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ac06b4d0 0x7f57ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.454+0000 7f57c3fff640 1 -- 172.21.15.172:0/2017077000 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f57bc0ab040 con 0x7f57cc0d32f0 2024-04-25T08:49:18.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.454+0000 7f57c27fc640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ac06b4d0 0x7f57ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.454+0000 7f57c27fc640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ac06b4d0 0x7f57ac06d990 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f57b4007fd0 tx=0x7f57b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:18.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.458+0000 7f57c3fff640 1 -- 172.21.15.172:0/2017077000 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f57bc079d30 con 0x7f57cc0d32f0 2024-04-25T08:49:18.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.666+0000 7f57d14ee640 1 -- 172.21.15.172:0/2017077000 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f57cc0d16b0 con 0x7f57cc0d32f0 2024-04-25T08:49:18.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.731+0000 7f57c3fff640 1 -- 172.21.15.172:0/2017077000 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7f57bc079630 con 0x7f57cc0d32f0 2024-04-25T08:49:18.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.733+0000 7f57d14ee640 1 -- 172.21.15.172:0/2017077000 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ac06b4d0 msgr2=0x7f57ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.733+0000 7f57d14ee640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ac06b4d0 0x7f57ac06d990 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f57b4007fd0 tx=0x7f57b4009040 comp rx=0 tx=0).stop 2024-04-25T08:49:18.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.733+0000 7f57d14ee640 1 -- 172.21.15.172:0/2017077000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc0d32f0 msgr2=0x7f57cc0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.733+0000 7f57d14ee640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc0d32f0 0x7f57cc0cd650 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f57bc000c00 tx=0x7f57bc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.733+0000 7f57d14ee640 1 -- 172.21.15.172:0/2017077000 shutdown_connections 2024-04-25T08:49:18.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.733+0000 7f57d14ee640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ac06b4d0 0x7f57ac06d990 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.733+0000 7f57d14ee640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57cc161710 0x7f57cc1f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.733+0000 7f57d14ee640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57cc15dc20 0x7f57cc0cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.733+0000 7f57d14ee640 1 --2- 172.21.15.172:0/2017077000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57cc0d32f0 0x7f57cc0cd650 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.733+0000 7f57d14ee640 1 -- 172.21.15.172:0/2017077000 >> 172.21.15.172:0/2017077000 conn(0x7f57cc0d0420 msgr2=0x7f57cc0b8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:18.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.734+0000 7f57d14ee640 1 -- 172.21.15.172:0/2017077000 shutdown_connections 2024-04-25T08:49:18.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.734+0000 7f57d14ee640 1 -- 172.21.15.172:0/2017077000 wait complete. 2024-04-25T08:49:18.735 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:49:18.736 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:49:18.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.845+0000 7f5d31f13640 1 Processor -- start 2024-04-25T08:49:18.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.845+0000 7f5d31f13640 1 -- start start 2024-04-25T08:49:18.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d31f13640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d2c06ccd0 0x7f5d2c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d31f13640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5d2c15deb0 0x7f5d2c15e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d31f13640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c0d1770 con 0x7f5d2c070dc0 2024-04-25T08:49:18.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d31f13640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c1622b0 con 0x7f5d2c06ccd0 2024-04-25T08:49:18.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d31f13640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c0b10f0 con 0x7f5d2c15deb0 2024-04-25T08:49:18.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d2affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d2c06ccd0 0x7f5d2c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d2affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d2c06ccd0 0x7f5d2c0b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54810/0 (socket says 172.21.15.172:54810) 2024-04-25T08:49:18.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d2affd640 1 -- 172.21.15.172:0/3117397300 learned_addr learned my addr 172.21.15.172:0/3117397300 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:18.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d2bfff640 1 --2- 172.21.15.172:0/3117397300 >> v2:172.21.15.186:3300/0 conn(0x7f5d2c15deb0 0x7f5d2c15e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d2affd640 1 -- 172.21.15.172:0/3117397300 >> v2:172.21.15.186:3300/0 conn(0x7f5d2c15deb0 msgr2=0x7f5d2c15e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:18.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d2affd640 1 --2- 172.21.15.172:0/3117397300 >> v2:172.21.15.186:3300/0 conn(0x7f5d2c15deb0 0x7f5d2c15e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d2affd640 1 -- 172.21.15.172:0/3117397300 >> v1:172.21.15.186:6789/0 conn(0x7f5d2c070dc0 legacy=0x7f5d2c0711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.846+0000 7f5d2affd640 1 -- 172.21.15.172:0/3117397300 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c162740 con 0x7f5d2c06ccd0 2024-04-25T08:49:18.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.847+0000 7f5d2affd640 1 --2- 172.21.15.172:0/3117397300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c06ccd0 0x7f5d2c0b07a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c06de30 tx=0x7f5d2002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ea10993e27aded server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:18.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.847+0000 7f5d2a7fc640 1 -- 172.21.15.172:0/3117397300 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20037070 con 0x7f5d2c06ccd0 2024-04-25T08:49:18.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.847+0000 7f5d2a7fc640 1 -- 172.21.15.172:0/3117397300 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d20032440 con 0x7f5d2c06ccd0 2024-04-25T08:49:18.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.847+0000 7f5d2a7fc640 1 -- 172.21.15.172:0/3117397300 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20032810 con 0x7f5d2c06ccd0 2024-04-25T08:49:18.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.848+0000 7f5d31f13640 1 -- 172.21.15.172:0/3117397300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c06ccd0 msgr2=0x7f5d2c0b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.848+0000 7f5d31f13640 1 --2- 172.21.15.172:0/3117397300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c06ccd0 0x7f5d2c0b07a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c06de30 tx=0x7f5d2002a150 comp rx=0 tx=0).stop 2024-04-25T08:49:18.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.848+0000 7f5d31f13640 1 -- 172.21.15.172:0/3117397300 shutdown_connections 2024-04-25T08:49:18.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.848+0000 7f5d31f13640 1 --2- 172.21.15.172:0/3117397300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c06ccd0 0x7f5d2c0b07a0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.848+0000 7f5d31f13640 1 --2- 172.21.15.172:0/3117397300 >> v2:172.21.15.186:3300/0 conn(0x7f5d2c15deb0 0x7f5d2c15e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.848+0000 7f5d31f13640 1 -- 172.21.15.172:0/3117397300 >> 172.21.15.172:0/3117397300 conn(0x7f5d2c0b3530 msgr2=0x7f5d2c0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:18.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.848+0000 7f5d31f13640 1 -- 172.21.15.172:0/3117397300 shutdown_connections 2024-04-25T08:49:18.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.848+0000 7f5d31f13640 1 -- 172.21.15.172:0/3117397300 wait complete. 2024-04-25T08:49:18.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.849+0000 7f5d31f13640 1 Processor -- start 2024-04-25T08:49:18.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.849+0000 7f5d31f13640 1 -- start start 2024-04-25T08:49:18.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d31f13640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d2c06ccd0 0x7f5d2c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d31f13640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c070dc0 0x7f5d2c160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d31f13640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d2c15deb0 0x7f5d2c14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d31f13640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c161f40 con 0x7f5d2c070dc0 2024-04-25T08:49:18.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d31f13640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c161c60 con 0x7f5d2c15deb0 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d31f13640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0b5840 con 0x7f5d2c06ccd0 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c070dc0 0x7f5d2c160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c070dc0 0x7f5d2c160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54812/0 (socket says 172.21.15.172:54812) 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2affd640 1 -- 172.21.15.172:0/2119973100 learned_addr learned my addr 172.21.15.172:0/2119973100 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2bfff640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d2c15deb0 0x7f5d2c14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2b7fe640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d2c06ccd0 0x7f5d2c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2affd640 1 -- 172.21.15.172:0/2119973100 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d2c06ccd0 msgr2=0x7f5d2c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2affd640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d2c06ccd0 0x7f5d2c15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2affd640 1 -- 172.21.15.172:0/2119973100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d2c15deb0 msgr2=0x7f5d2c14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2affd640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d2c15deb0 0x7f5d2c14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2affd640 1 -- 172.21.15.172:0/2119973100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c1611f0 con 0x7f5d2c070dc0 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2bfff640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d2c15deb0 0x7f5d2c14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.850+0000 7f5d2affd640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c070dc0 0x7f5d2c160cb0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f5d2002a190 tx=0x7f5d200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.851+0000 7f5d13fff640 1 -- 172.21.15.172:0/2119973100 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20037040 con 0x7f5d2c070dc0 2024-04-25T08:49:18.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.851+0000 7f5d13fff640 1 -- 172.21.15.172:0/2119973100 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d20042070 con 0x7f5d2c070dc0 2024-04-25T08:49:18.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.851+0000 7f5d31f13640 1 -- 172.21.15.172:0/2119973100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c15f970 con 0x7f5d2c070dc0 2024-04-25T08:49:18.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.851+0000 7f5d13fff640 1 -- 172.21.15.172:0/2119973100 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20030920 con 0x7f5d2c070dc0 2024-04-25T08:49:18.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.851+0000 7f5d31f13640 1 -- 172.21.15.172:0/2119973100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c15ff30 con 0x7f5d2c070dc0 2024-04-25T08:49:18.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.852+0000 7f5d31f13640 1 -- 172.21.15.172:0/2119973100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c073a00 con 0x7f5d2c070dc0 2024-04-25T08:49:18.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.852+0000 7f5d13fff640 1 -- 172.21.15.172:0/2119973100 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d20030ac0 con 0x7f5d2c070dc0 2024-04-25T08:49:18.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.852+0000 7f5d13fff640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d1806b4d0 0x7f5d1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:18.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.852+0000 7f5d13fff640 1 -- 172.21.15.172:0/2119973100 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5d200aaca0 con 0x7f5d2c070dc0 2024-04-25T08:49:18.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.852+0000 7f5d2b7fe640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d1806b4d0 0x7f5d1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:18.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.853+0000 7f5d2b7fe640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d1806b4d0 0x7f5d1806d990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c001640 tx=0x7f5d1c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:18.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:18.857+0000 7f5d13fff640 1 -- 172.21.15.172:0/2119973100 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d20079a20 con 0x7f5d2c070dc0 2024-04-25T08:49:19.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.065+0000 7f5d31f13640 1 -- 172.21.15.172:0/2119973100 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5d2c0b65f0 con 0x7f5d2c070dc0 2024-04-25T08:49:19.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.738+0000 7f5d13fff640 1 -- 172.21.15.172:0/2119973100 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d20079320 con 0x7f5d2c070dc0 2024-04-25T08:49:19.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 -- 172.21.15.172:0/2119973100 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d1806b4d0 msgr2=0x7f5d1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:19.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d1806b4d0 0x7f5d1806d990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c001640 tx=0x7f5d1c009040 comp rx=0 tx=0).stop 2024-04-25T08:49:19.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 -- 172.21.15.172:0/2119973100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c070dc0 msgr2=0x7f5d2c160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:19.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c070dc0 0x7f5d2c160cb0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f5d2002a190 tx=0x7f5d200046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:19.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 -- 172.21.15.172:0/2119973100 shutdown_connections 2024-04-25T08:49:19.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d1806b4d0 0x7f5d1806d990 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:19.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d2c15deb0 0x7f5d2c14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:19.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d2c070dc0 0x7f5d2c160cb0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:19.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 --2- 172.21.15.172:0/2119973100 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d2c06ccd0 0x7f5d2c15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:19.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 -- 172.21.15.172:0/2119973100 >> 172.21.15.172:0/2119973100 conn(0x7f5d2c0b3530 msgr2=0x7f5d2c0b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:19.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 -- 172.21.15.172:0/2119973100 shutdown_connections 2024-04-25T08:49:19.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.741+0000 7f5d31f13640 1 -- 172.21.15.172:0/2119973100 wait complete. 2024-04-25T08:49:19.743 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:49:19.743 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:19.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.850+0000 7faab3dc1640 1 Processor -- start 2024-04-25T08:49:19.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.851+0000 7faab3dc1640 1 -- start start 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.851+0000 7faab3dc1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faaac0b2cb0 0x7faaac0d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.851+0000 7faab3dc1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac0b97a0 con 0x7faaac0d1020 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.851+0000 7faab3dc1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac0d1c50 con 0x7faaac15dbe0 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.851+0000 7faab3dc1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac15dfc0 con 0x7faaac0b2cb0 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.851+0000 7faab135c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faaac0b2cb0 0x7faaac0d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.851+0000 7faab235e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7faaac0d1020 0x7faaac0d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40808/0 (socket says 172.21.15.172:40808) 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.851+0000 7faab235e640 1 -- 172.21.15.172:0/1529717561 learned_addr learned my addr 172.21.15.172:0/1529717561 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.852+0000 7faab135c640 1 -- 172.21.15.172:0/1529717561 >> v1:172.21.15.186:6789/0 conn(0x7faaac15dbe0 legacy=0x7faaac0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.852+0000 7faab135c640 1 -- 172.21.15.172:0/1529717561 >> v1:172.21.15.172:6789/0 conn(0x7faaac0d1020 legacy=0x7faaac0d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.852+0000 7faab0b5b640 1 -- 172.21.15.172:0/1529717561 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763833030 0 0) 0x7faaac0b97a0 con 0x7faaac0d1020 2024-04-25T08:49:19.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.852+0000 7faab135c640 1 -- 172.21.15.172:0/1529717561 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0d1f30 con 0x7faaac0b2cb0 2024-04-25T08:49:19.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.852+0000 7faab135c640 1 --2- 172.21.15.172:0/1529717561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac0b2cb0 0x7faaac0d2730 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0097a0 tx=0x7faa9c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5219cd3d6f7d2717 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:19.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.853+0000 7faab0b5b640 1 -- 172.21.15.172:0/1529717561 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c037070 con 0x7faaac0b2cb0 2024-04-25T08:49:19.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.853+0000 7faab0b5b640 1 -- 172.21.15.172:0/1529717561 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c032440 con 0x7faaac0b2cb0 2024-04-25T08:49:19.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.853+0000 7faab0b5b640 1 -- 172.21.15.172:0/1529717561 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c032810 con 0x7faaac0b2cb0 2024-04-25T08:49:19.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.853+0000 7faab3dc1640 1 -- 172.21.15.172:0/1529717561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac0b2cb0 msgr2=0x7faaac0d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:19.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.853+0000 7faab3dc1640 1 --2- 172.21.15.172:0/1529717561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac0b2cb0 0x7faaac0d2730 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0097a0 tx=0x7faa9c02a230 comp rx=0 tx=0).stop 2024-04-25T08:49:19.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.853+0000 7faab3dc1640 1 -- 172.21.15.172:0/1529717561 shutdown_connections 2024-04-25T08:49:19.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.853+0000 7faab3dc1640 1 --2- 172.21.15.172:0/1529717561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac0b2cb0 0x7faaac0d2730 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.853+0000 7faab3dc1640 1 -- 172.21.15.172:0/1529717561 >> 172.21.15.172:0/1529717561 conn(0x7faaac061a20 msgr2=0x7faaac061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.853+0000 7faab3dc1640 1 -- 172.21.15.172:0/1529717561 shutdown_connections 2024-04-25T08:49:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.853+0000 7faab3dc1640 1 -- 172.21.15.172:0/1529717561 wait complete. 2024-04-25T08:49:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.854+0000 7faab3dc1640 1 Processor -- start 2024-04-25T08:49:19.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab3dc1640 1 -- start start 2024-04-25T08:49:19.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab3dc1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaac0b2cb0 0x7faaac0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:19.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab3dc1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaac0d1020 0x7faaac0b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:19.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab3dc1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac15dbe0 0x7faaac145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab3dc1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0b92a0 con 0x7faaac15dbe0 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab3dc1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0d1a00 con 0x7faaac0d1020 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab3dc1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0b9420 con 0x7faaac0b2cb0 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab235e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac15dbe0 0x7faaac145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab235e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac15dbe0 0x7faaac145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54826/0 (socket says 172.21.15.172:54826) 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab235e640 1 -- 172.21.15.172:0/2079474748 learned_addr learned my addr 172.21.15.172:0/2079474748 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab135c640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaac0d1020 0x7faaac0b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.855+0000 7faab1b5d640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaac0b2cb0 0x7faaac0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faab235e640 1 -- 172.21.15.172:0/2079474748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaac0b2cb0 msgr2=0x7faaac0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faab235e640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaac0b2cb0 0x7faaac0b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faab235e640 1 -- 172.21.15.172:0/2079474748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaac0d1020 msgr2=0x7faaac0b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faab235e640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaac0d1020 0x7faaac0b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faab235e640 1 -- 172.21.15.172:0/2079474748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0b41f0 con 0x7faaac15dbe0 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faab135c640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaac0d1020 0x7faaac0b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:19.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faab235e640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac15dbe0 0x7faaac145450 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c480 tx=0x7faaa400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:19.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faaa27fc640 1 -- 172.21.15.172:0/2079474748 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4018070 con 0x7faaac15dbe0 2024-04-25T08:49:19.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faaa27fc640 1 -- 172.21.15.172:0/2079474748 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4007500 con 0x7faaac15dbe0 2024-04-25T08:49:19.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faab3dc1640 1 -- 172.21.15.172:0/2079474748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac0b44d0 con 0x7faaac15dbe0 2024-04-25T08:49:19.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faaa27fc640 1 -- 172.21.15.172:0/2079474748 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4004a20 con 0x7faaac15dbe0 2024-04-25T08:49:19.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.856+0000 7faab3dc1640 1 -- 172.21.15.172:0/2079474748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac0b4a90 con 0x7faaac15dbe0 2024-04-25T08:49:19.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.857+0000 7faab3dc1640 1 -- 172.21.15.172:0/2079474748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac073990 con 0x7faaac15dbe0 2024-04-25T08:49:19.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.857+0000 7faaa27fc640 1 -- 172.21.15.172:0/2079474748 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faaa401b070 con 0x7faaac15dbe0 2024-04-25T08:49:19.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.858+0000 7faaa27fc640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa9006b4d0 0x7faa9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:19.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.858+0000 7faaa27fc640 1 -- 172.21.15.172:0/2079474748 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faaa40896b0 con 0x7faaac15dbe0 2024-04-25T08:49:19.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.858+0000 7faab1b5d640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa9006b4d0 0x7faa9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:19.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.858+0000 7faab1b5d640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa9006b4d0 0x7faa9006d990 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7faaa80012e0 tx=0x7faaa8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:19.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:19.862+0000 7faaa27fc640 1 -- 172.21.15.172:0/2079474748 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faaa40583a0 con 0x7faaac15dbe0 2024-04-25T08:49:20.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.067+0000 7faab3dc1640 1 -- 172.21.15.172:0/2079474748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaac062260 con 0x7faaac15dbe0 2024-04-25T08:49:20.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.067+0000 7faaa27fc640 1 -- 172.21.15.172:0/2079474748 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7faaa4057ca0 con 0x7faaac15dbe0 2024-04-25T08:49:20.059 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:20.059 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:20.059 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:20.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.069+0000 7faab3dc1640 1 -- 172.21.15.172:0/2079474748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa9006b4d0 msgr2=0x7faa9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.069+0000 7faab3dc1640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa9006b4d0 0x7faa9006d990 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7faaa80012e0 tx=0x7faaa8009040 comp rx=0 tx=0).stop 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.069+0000 7faab3dc1640 1 -- 172.21.15.172:0/2079474748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac15dbe0 msgr2=0x7faaac145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.069+0000 7faab3dc1640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac15dbe0 0x7faaac145450 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c480 tx=0x7faaa400c940 comp rx=0 tx=0).stop 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.069+0000 7faab3dc1640 1 -- 172.21.15.172:0/2079474748 shutdown_connections 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.069+0000 7faab3dc1640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faa9006b4d0 0x7faa9006d990 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.069+0000 7faab3dc1640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faaac0d1020 0x7faaac0b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.069+0000 7faab3dc1640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaac15dbe0 0x7faaac145450 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.069+0000 7faab3dc1640 1 --2- 172.21.15.172:0/2079474748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faaac0b2cb0 0x7faaac0b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.069+0000 7faab3dc1640 1 -- 172.21.15.172:0/2079474748 >> 172.21.15.172:0/2079474748 conn(0x7faaac061a20 msgr2=0x7faaac15c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.070+0000 7faab3dc1640 1 -- 172.21.15.172:0/2079474748 shutdown_connections 2024-04-25T08:49:20.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.070+0000 7faab3dc1640 1 -- 172.21.15.172:0/2079474748 wait complete. 2024-04-25T08:49:20.072 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:20.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.178+0000 7f72db99e640 1 Processor -- start 2024-04-25T08:49:20.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.178+0000 7f72db99e640 1 -- start start 2024-04-25T08:49:20.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72db99e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f72d40cfec0 0x7f72d40cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72db99e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72d40ce3c0 0x7f72d406d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72db99e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d4071480 con 0x7f72d4154ee0 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72db99e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d40ce830 con 0x7f72d40cfec0 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72db99e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4072090 con 0x7f72d40ce3c0 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72d8f39640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f72d40cfec0 0x7f72d40cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72d973a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f72d4154ee0 0x7f72d40cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40814/0 (socket says 172.21.15.172:40814) 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72d973a640 1 -- 172.21.15.172:0/257022210 learned_addr learned my addr 172.21.15.172:0/257022210 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72d9f3b640 1 --2- 172.21.15.172:0/257022210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72d40ce3c0 0x7f72d406d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72d8f39640 1 -- 172.21.15.172:0/257022210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72d40ce3c0 msgr2=0x7f72d406d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72d8f39640 1 --2- 172.21.15.172:0/257022210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72d40ce3c0 0x7f72d406d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72d8f39640 1 -- 172.21.15.172:0/257022210 >> v1:172.21.15.172:6789/0 conn(0x7f72d4154ee0 legacy=0x7f72d40cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72d8f39640 1 -- 172.21.15.172:0/257022210 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4071760 con 0x7f72d40cfec0 2024-04-25T08:49:20.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.179+0000 7f72cbfff640 1 -- 172.21.15.172:0/257022210 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366186747 0 0) 0x7f72d4071480 con 0x7f72d4154ee0 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.180+0000 7f72d8f39640 1 --2- 172.21.15.172:0/257022210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d40cfec0 0x7f72d40cde80 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f72c40097a0 tx=0x7f72c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b123a9be742e4f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.180+0000 7f72cbfff640 1 -- 172.21.15.172:0/257022210 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4037070 con 0x7f72d40cfec0 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.180+0000 7f72cbfff640 1 -- 172.21.15.172:0/257022210 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4032440 con 0x7f72d40cfec0 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.180+0000 7f72cbfff640 1 -- 172.21.15.172:0/257022210 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4032810 con 0x7f72d40cfec0 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.181+0000 7f72db99e640 1 -- 172.21.15.172:0/257022210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d40cfec0 msgr2=0x7f72d40cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.181+0000 7f72db99e640 1 --2- 172.21.15.172:0/257022210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d40cfec0 0x7f72d40cde80 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f72c40097a0 tx=0x7f72c402a180 comp rx=0 tx=0).stop 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.181+0000 7f72db99e640 1 -- 172.21.15.172:0/257022210 shutdown_connections 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.181+0000 7f72db99e640 1 --2- 172.21.15.172:0/257022210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72d40ce3c0 0x7f72d406d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.181+0000 7f72db99e640 1 --2- 172.21.15.172:0/257022210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d40cfec0 0x7f72d40cde80 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.181+0000 7f72db99e640 1 -- 172.21.15.172:0/257022210 >> 172.21.15.172:0/257022210 conn(0x7f72d406abe0 msgr2=0x7f72d406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.181+0000 7f72db99e640 1 -- 172.21.15.172:0/257022210 shutdown_connections 2024-04-25T08:49:20.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.181+0000 7f72db99e640 1 -- 172.21.15.172:0/257022210 wait complete. 2024-04-25T08:49:20.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.182+0000 7f72db99e640 1 Processor -- start 2024-04-25T08:49:20.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.182+0000 7f72db99e640 1 -- start start 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72db99e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72d40ce3c0 0x7f72d406e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72db99e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72d40cfec0 0x7f72d40a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72db99e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d4154ee0 0x7f72d4152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72db99e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4071d20 con 0x7f72d4154ee0 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72db99e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4071230 con 0x7f72d40ce3c0 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72db99e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d41552c0 con 0x7f72d40cfec0 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d9f3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d4154ee0 0x7f72d4152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d9f3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d4154ee0 0x7f72d4152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54854/0 (socket says 172.21.15.172:54854) 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d9f3b640 1 -- 172.21.15.172:0/2619618625 learned_addr learned my addr 172.21.15.172:0/2619618625 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d973a640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72d40ce3c0 0x7f72d406e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d9f3b640 1 -- 172.21.15.172:0/2619618625 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72d40cfec0 msgr2=0x7f72d40a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d8f39640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72d40cfec0 0x7f72d40a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d9f3b640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72d40cfec0 0x7f72d40a86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d9f3b640 1 -- 172.21.15.172:0/2619618625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72d40ce3c0 msgr2=0x7f72d406e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d9f3b640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72d40ce3c0 0x7f72d406e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d9f3b640 1 -- 172.21.15.172:0/2619618625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4158790 con 0x7f72d4154ee0 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d973a640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72d40ce3c0 0x7f72d406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72d9f3b640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d4154ee0 0x7f72d4152270 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00e930 tx=0x7f72cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.183+0000 7f72c9ffb640 1 -- 172.21.15.172:0/2619618625 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc017070 con 0x7f72d4154ee0 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.184+0000 7f72c9ffb640 1 -- 172.21.15.172:0/2619618625 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc00c980 con 0x7f72d4154ee0 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.184+0000 7f72db99e640 1 -- 172.21.15.172:0/2619618625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d4158c90 con 0x7f72d4154ee0 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.184+0000 7f72c9ffb640 1 -- 172.21.15.172:0/2619618625 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc00cd70 con 0x7f72d4154ee0 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.184+0000 7f72db99e640 1 -- 172.21.15.172:0/2619618625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d4159250 con 0x7f72d4154ee0 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.185+0000 7f72db99e640 1 -- 172.21.15.172:0/2619618625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d4073990 con 0x7f72d4154ee0 2024-04-25T08:49:20.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.185+0000 7f72c9ffb640 1 -- 172.21.15.172:0/2619618625 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f72cc01a070 con 0x7f72d4154ee0 2024-04-25T08:49:20.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.186+0000 7f72c9ffb640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72b806b500 0x7f72b806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.186+0000 7f72c9ffb640 1 -- 172.21.15.172:0/2619618625 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72cc08a340 con 0x7f72d4154ee0 2024-04-25T08:49:20.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.186+0000 7f72d973a640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72b806b500 0x7f72b806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.186+0000 7f72d973a640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72b806b500 0x7f72b806d9c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f72d0007fd0 tx=0x7f72d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:20.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.190+0000 7f72c9ffb640 1 -- 172.21.15.172:0/2619618625 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f72cc0590f0 con 0x7f72d4154ee0 2024-04-25T08:49:20.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.361+0000 7f72db99e640 1 -- 172.21.15.172:0/2619618625 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72d40b1f70 con 0x7f72d4154ee0 2024-04-25T08:49:20.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.363+0000 7f72c9ffb640 1 -- 172.21.15.172:0/2619618625 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16944 (secure 0 0 0) 0x7f72cc0589f0 con 0x7f72d4154ee0 2024-04-25T08:49:20.354 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:20.354 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":107,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:18.717539+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:49:15.250034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T08:49:16.013750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 -- 172.21.15.172:0/2619618625 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72b806b500 msgr2=0x7f72b806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72b806b500 0x7f72b806d9c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f72d0007fd0 tx=0x7f72d0009040 comp rx=0 tx=0).stop 2024-04-25T08:49:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 -- 172.21.15.172:0/2619618625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d4154ee0 msgr2=0x7f72d4152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d4154ee0 0x7f72d4152270 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00e930 tx=0x7f72cc00edf0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 -- 172.21.15.172:0/2619618625 shutdown_connections 2024-04-25T08:49:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f72b806b500 0x7f72b806d9c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72d4154ee0 0x7f72d4152270 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f72d40cfec0 0x7f72d40a86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 --2- 172.21.15.172:0/2619618625 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f72d40ce3c0 0x7f72d406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 -- 172.21.15.172:0/2619618625 >> 172.21.15.172:0/2619618625 conn(0x7f72d406abe0 msgr2=0x7f72d40b2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:20.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 -- 172.21.15.172:0/2619618625 shutdown_connections 2024-04-25T08:49:20.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.365+0000 7f72db99e640 1 -- 172.21.15.172:0/2619618625 wait complete. 2024-04-25T08:49:20.367 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:49:20.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:49:20.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.474+0000 7f829831d640 1 Processor -- start 2024-04-25T08:49:20.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.474+0000 7f829831d640 1 -- start start 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f829831d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82900d1f20 0x7f82901625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f829831d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82900cce50 con 0x7f82900cc8e0 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f829831d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8290161af0 con 0x7f829015dc90 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f829831d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8290161dd0 con 0x7f82900d1f20 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82958b8640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f82900cc8e0 0x7f82900d1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40820/0 (socket says 172.21.15.172:40820) 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82958b8640 1 -- 172.21.15.172:0/2489179190 learned_addr learned my addr 172.21.15.172:0/2489179190 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82968ba640 1 --2- 172.21.15.172:0/2489179190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82900d1f20 0x7f82901625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82950b7640 1 -- 172.21.15.172:0/2489179190 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582260883 0 0) 0x7f82900cce50 con 0x7f82900cc8e0 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82950b7640 1 -- 172.21.15.172:0/2489179190 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f827c003520 con 0x7f82900cc8e0 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82950b7640 1 -- 172.21.15.172:0/2489179190 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679727921 0 0) 0x7f8290161af0 con 0x7f829015dc90 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82950b7640 1 -- 172.21.15.172:0/2489179190 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82900cce50 con 0x7f829015dc90 2024-04-25T08:49:20.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82968ba640 1 -- 172.21.15.172:0/2489179190 >> v1:172.21.15.186:6789/0 conn(0x7f829015dc90 legacy=0x7f829015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82950b7640 1 -- 172.21.15.172:0/2489179190 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3625369662 0 0) 0x7f827c003520 con 0x7f82900cc8e0 2024-04-25T08:49:20.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82968ba640 1 -- 172.21.15.172:0/2489179190 >> v1:172.21.15.172:6789/0 conn(0x7f82900cc8e0 legacy=0x7f82900d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.475+0000 7f82968ba640 1 -- 172.21.15.172:0/2489179190 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82901620b0 con 0x7f82900d1f20 2024-04-25T08:49:20.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.476+0000 7f82968ba640 1 --2- 172.21.15.172:0/2489179190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82900d1f20 0x7f82901625d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8288009dc0 tx=0x7f828802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6774f6d0c21dbc22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:20.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.476+0000 7f82950b7640 1 -- 172.21.15.172:0/2489179190 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280001670 con 0x7f82900d1f20 2024-04-25T08:49:20.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.476+0000 7f82950b7640 1 -- 172.21.15.172:0/2489179190 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288007540 con 0x7f82900d1f20 2024-04-25T08:49:20.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.476+0000 7f82950b7640 1 -- 172.21.15.172:0/2489179190 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288007910 con 0x7f82900d1f20 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.477+0000 7f829831d640 1 -- 172.21.15.172:0/2489179190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82900d1f20 msgr2=0x7f82901625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.477+0000 7f829831d640 1 --2- 172.21.15.172:0/2489179190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82900d1f20 0x7f82901625d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8288009dc0 tx=0x7f828802a5d0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.477+0000 7f829831d640 1 -- 172.21.15.172:0/2489179190 shutdown_connections 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.477+0000 7f829831d640 1 --2- 172.21.15.172:0/2489179190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82900d1f20 0x7f82901625d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.477+0000 7f829831d640 1 -- 172.21.15.172:0/2489179190 >> 172.21.15.172:0/2489179190 conn(0x7f829006f590 msgr2=0x7f829006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.477+0000 7f829831d640 1 -- 172.21.15.172:0/2489179190 shutdown_connections 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.477+0000 7f829831d640 1 -- 172.21.15.172:0/2489179190 wait complete. 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.478+0000 7f829831d640 1 Processor -- start 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.478+0000 7f829831d640 1 -- start start 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.478+0000 7f829831d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82900cc8e0 0x7f82900c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.478+0000 7f829831d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82900d1f20 0x7f82901509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.478+0000 7f829831d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f829015dc90 0x7f82901f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f829831d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829015e1f0 con 0x7f82900cc8e0 2024-04-25T08:49:20.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f829831d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829015e070 con 0x7f82900d1f20 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f829831d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900cfde0 con 0x7f829015dc90 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82960b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82900cc8e0 0x7f82900c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82960b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82900cc8e0 0x7f82900c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54868/0 (socket says 172.21.15.172:54868) 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82960b9640 1 -- 172.21.15.172:0/1131814084 learned_addr learned my addr 172.21.15.172:0/1131814084 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82958b8640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82900d1f20 0x7f82901509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82968ba640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f829015dc90 0x7f82901f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82960b9640 1 -- 172.21.15.172:0/1131814084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f829015dc90 msgr2=0x7f82901f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82960b9640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f829015dc90 0x7f82901f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82960b9640 1 -- 172.21.15.172:0/1131814084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82900d1f20 msgr2=0x7f82901509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82960b9640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82900d1f20 0x7f82901509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82960b9640 1 -- 172.21.15.172:0/1131814084 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900c9c30 con 0x7f82900cc8e0 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f82960b9640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82900cc8e0 0x7f82900c8b10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f828c00c460 tx=0x7f828c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f8286ffd640 1 -- 172.21.15.172:0/1131814084 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0052d0 con 0x7f82900cc8e0 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f8286ffd640 1 -- 172.21.15.172:0/1131814084 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c005490 con 0x7f82900cc8e0 2024-04-25T08:49:20.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f829831d640 1 -- 172.21.15.172:0/1131814084 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82900c9f10 con 0x7f82900cc8e0 2024-04-25T08:49:20.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f8286ffd640 1 -- 172.21.15.172:0/1131814084 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c012870 con 0x7f82900cc8e0 2024-04-25T08:49:20.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.479+0000 7f829831d640 1 -- 172.21.15.172:0/1131814084 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82900c9050 con 0x7f82900cc8e0 2024-04-25T08:49:20.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.480+0000 7f829831d640 1 -- 172.21.15.172:0/1131814084 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8290073990 con 0x7f82900cc8e0 2024-04-25T08:49:20.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.481+0000 7f8286ffd640 1 -- 172.21.15.172:0/1131814084 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f828c012a10 con 0x7f82900cc8e0 2024-04-25T08:49:20.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.481+0000 7f8286ffd640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827406b4d0 0x7f827406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.481+0000 7f8286ffd640 1 -- 172.21.15.172:0/1131814084 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f828c08a010 con 0x7f82900cc8e0 2024-04-25T08:49:20.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.481+0000 7f82958b8640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827406b4d0 0x7f827406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.481+0000 7f82958b8640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827406b4d0 0x7f827406d990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f82900cc260 tx=0x7f8280009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:20.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.485+0000 7f8286ffd640 1 -- 172.21.15.172:0/1131814084 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f828c058c80 con 0x7f82900cc8e0 2024-04-25T08:49:20.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.655+0000 7f829831d640 1 -- 172.21.15.172:0/1131814084 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82900cf6b0 con 0x7f827406b4d0 2024-04-25T08:49:20.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.660+0000 7f8286ffd640 1 -- 172.21.15.172:0/1131814084 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241078 (secure 0 0 0) 0x7f82900cf6b0 con 0x7f827406b4d0 2024-04-25T08:49:20.654 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:20.655 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 -- 172.21.15.172:0/1131814084 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827406b4d0 msgr2=0x7f827406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827406b4d0 0x7f827406d990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f82900cc260 tx=0x7f8280009040 comp rx=0 tx=0).stop 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 -- 172.21.15.172:0/1131814084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82900cc8e0 msgr2=0x7f82900c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82900cc8e0 0x7f82900c8b10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f828c00c460 tx=0x7f828c00c920 comp rx=0 tx=0).stop 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 -- 172.21.15.172:0/1131814084 shutdown_connections 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827406b4d0 0x7f827406d990 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82900d1f20 0x7f82901509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f829015dc90 0x7f82901f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 --2- 172.21.15.172:0/1131814084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82900cc8e0 0x7f82900c8b10 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 -- 172.21.15.172:0/1131814084 >> 172.21.15.172:0/1131814084 conn(0x7f829006f590 msgr2=0x7f82900b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:20.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 -- 172.21.15.172:0/1131814084 shutdown_connections 2024-04-25T08:49:20.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.663+0000 7f829831d640 1 -- 172.21.15.172:0/1131814084 wait complete. 2024-04-25T08:49:20.665 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-04-25T08:49:20.597708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":369008,"kb_used_data":11256,"kb_used_omap":12,"kb_used_meta":357619,"kb_avail":754605712,"statfs":{"total":773094113280,"available":772716249088,"internally_reserved":0,"allocated":11526144,"data_stored":5961727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":366202416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905853"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409655+0000","last_change":"2024-04-25T08:49:17.740216+0000","last_active":"2024-04-25T08:49:19.409655+0000","last_peered":"2024-04-25T08:49:19.409655+0000","last_clean":"2024-04-25T08:49:19.409655+0000","last_became_active":"2024-04-25T08:49:17.739849+0000","last_became_peered":"2024-04-25T08:49:17.739849+0000","last_unstale":"2024-04-25T08:49:19.409655+0000","last_undegraded":"2024-04-25T08:49:19.409655+0000","last_fullsized":"2024-04-25T08:49:19.409655+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:13.994651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722296+0000","last_change":"2024-04-25T08:49:17.747710+0000","last_active":"2024-04-25T08:49:18.722296+0000","last_peered":"2024-04-25T08:49:18.722296+0000","last_clean":"2024-04-25T08:49:18.722296+0000","last_became_active":"2024-04-25T08:49:17.747407+0000","last_became_peered":"2024-04-25T08:49:17.747407+0000","last_unstale":"2024-04-25T08:49:18.722296+0000","last_undegraded":"2024-04-25T08:49:18.722296+0000","last_fullsized":"2024-04-25T08:49:18.722296+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:22.674559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409585+0000","last_change":"2024-04-25T08:49:17.726362+0000","last_active":"2024-04-25T08:49:19.409585+0000","last_peered":"2024-04-25T08:49:19.409585+0000","last_clean":"2024-04-25T08:49:19.409585+0000","last_became_active":"2024-04-25T08:49:17.725965+0000","last_became_peered":"2024-04-25T08:49:17.725965+0000","last_unstale":"2024-04-25T08:49:19.409585+0000","last_undegraded":"2024-04-25T08:49:19.409585+0000","last_fullsized":"2024-04-25T08:49:19.409585+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:30.493678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722456+0000","last_change":"2024-04-25T08:49:17.736872+0000","last_active":"2024-04-25T08:49:18.722456+0000","last_peered":"2024-04-25T08:49:18.722456+0000","last_clean":"2024-04-25T08:49:18.722456+0000","last_became_active":"2024-04-25T08:49:17.736604+0000","last_became_peered":"2024-04-25T08:49:17.736604+0000","last_unstale":"2024-04-25T08:49:18.722456+0000","last_undegraded":"2024-04-25T08:49:18.722456+0000","last_fullsized":"2024-04-25T08:49:18.722456+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:18.968390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"106'4","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409944+0000","last_change":"2024-04-25T08:49:16.709134+0000","last_active":"2024-04-25T08:49:19.409944+0000","last_peered":"2024-04-25T08:49:19.409944+0000","last_clean":"2024-04-25T08:49:19.409944+0000","last_became_active":"2024-04-25T08:49:16.708639+0000","last_became_peered":"2024-04-25T08:49:16.708639+0000","last_unstale":"2024-04-25T08:49:19.409944+0000","last_undegraded":"2024-04-25T08:49:19.409944+0000","last_fullsized":"2024-04-25T08:49:19.409944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:03.975037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722409+0000","last_change":"2024-04-25T08:49:17.740392+0000","last_active":"2024-04-25T08:49:18.722409+0000","last_peered":"2024-04-25T08:49:18.722409+0000","last_clean":"2024-04-25T08:49:18.722409+0000","last_became_active":"2024-04-25T08:49:17.739619+0000","last_became_peered":"2024-04-25T08:49:17.739619+0000","last_unstale":"2024-04-25T08:49:18.722409+0000","last_undegraded":"2024-04-25T08:49:18.722409+0000","last_fullsized":"2024-04-25T08:49:18.722409+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:44.615111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409784+0000","last_change":"2024-04-25T08:49:17.736418+0000","last_active":"2024-04-25T08:49:19.409784+0000","last_peered":"2024-04-25T08:49:19.409784+0000","last_clean":"2024-04-25T08:49:19.409784+0000","last_became_active":"2024-04-25T08:49:17.735998+0000","last_became_peered":"2024-04-25T08:49:17.735998+0000","last_unstale":"2024-04-25T08:49:19.409784+0000","last_undegraded":"2024-04-25T08:49:19.409784+0000","last_fullsized":"2024-04-25T08:49:19.409784+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:17.881581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.704241+0000","last_change":"2024-04-25T08:49:15.704241+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.704241+0000","last_undegraded":"2024-04-25T08:49:15.704241+0000","last_fullsized":"2024-04-25T08:49:15.704241+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721906+0000","last_change":"2024-04-25T08:49:16.710332+0000","last_active":"2024-04-25T08:49:18.721906+0000","last_peered":"2024-04-25T08:49:18.721906+0000","last_clean":"2024-04-25T08:49:18.721906+0000","last_became_active":"2024-04-25T08:49:16.710022+0000","last_became_peered":"2024-04-25T08:49:16.710022+0000","last_unstale":"2024-04-25T08:49:18.721906+0000","last_undegraded":"2024-04-25T08:49:18.721906+0000","last_fullsized":"2024-04-25T08:49:18.721906+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:40.668279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409950+0000","last_change":"2024-04-25T08:49:17.729394+0000","last_active":"2024-04-25T08:49:19.409950+0000","last_peered":"2024-04-25T08:49:19.409950+0000","last_clean":"2024-04-25T08:49:19.409950+0000","last_became_active":"2024-04-25T08:49:17.728130+0000","last_became_peered":"2024-04-25T08:49:17.728130+0000","last_unstale":"2024-04-25T08:49:19.409950+0000","last_undegraded":"2024-04-25T08:49:19.409950+0000","last_fullsized":"2024-04-25T08:49:19.409950+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:28.345178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409460+0000","last_change":"2024-04-25T08:49:16.709288+0000","last_active":"2024-04-25T08:49:19.409460+0000","last_peered":"2024-04-25T08:49:19.409460+0000","last_clean":"2024-04-25T08:49:19.409460+0000","last_became_active":"2024-04-25T08:49:16.707237+0000","last_became_peered":"2024-04-25T08:49:16.707237+0000","last_unstale":"2024-04-25T08:49:19.409460+0000","last_undegraded":"2024-04-25T08:49:19.409460+0000","last_fullsized":"2024-04-25T08:49:19.409460+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:07.367751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.705347+0000","last_change":"2024-04-25T08:49:15.705347+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.705347+0000","last_undegraded":"2024-04-25T08:49:15.705347+0000","last_fullsized":"2024-04-25T08:49:15.705347+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698445+0000","last_change":"2024-04-25T08:49:15.698445+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698445+0000","last_undegraded":"2024-04-25T08:49:15.698445+0000","last_fullsized":"2024-04-25T08:49:15.698445+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721938+0000","last_change":"2024-04-25T08:49:17.734692+0000","last_active":"2024-04-25T08:49:18.721938+0000","last_peered":"2024-04-25T08:49:18.721938+0000","last_clean":"2024-04-25T08:49:18.721938+0000","last_became_active":"2024-04-25T08:49:17.734182+0000","last_became_peered":"2024-04-25T08:49:17.734182+0000","last_unstale":"2024-04-25T08:49:18.721938+0000","last_undegraded":"2024-04-25T08:49:18.721938+0000","last_fullsized":"2024-04-25T08:49:18.721938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:46.183230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409430+0000","last_change":"2024-04-25T08:49:16.706179+0000","last_active":"2024-04-25T08:49:19.409430+0000","last_peered":"2024-04-25T08:49:19.409430+0000","last_clean":"2024-04-25T08:49:19.409430+0000","last_became_active":"2024-04-25T08:49:16.705248+0000","last_became_peered":"2024-04-25T08:49:16.705248+0000","last_unstale":"2024-04-25T08:49:19.409430+0000","last_undegraded":"2024-04-25T08:49:19.409430+0000","last_fullsized":"2024-04-25T08:49:19.409430+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:21.345771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698510+0000","last_change":"2024-04-25T08:49:15.698510+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698510+0000","last_undegraded":"2024-04-25T08:49:15.698510+0000","last_fullsized":"2024-04-25T08:49:15.698510+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.704252+0000","last_change":"2024-04-25T08:49:15.704252+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.704252+0000","last_undegraded":"2024-04-25T08:49:15.704252+0000","last_fullsized":"2024-04-25T08:49:15.704252+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722040+0000","last_change":"2024-04-25T08:49:16.709045+0000","last_active":"2024-04-25T08:49:18.722040+0000","last_peered":"2024-04-25T08:49:18.722040+0000","last_clean":"2024-04-25T08:49:18.722040+0000","last_became_active":"2024-04-25T08:49:16.708749+0000","last_became_peered":"2024-04-25T08:49:16.708749+0000","last_unstale":"2024-04-25T08:49:18.722040+0000","last_undegraded":"2024-04-25T08:49:18.722040+0000","last_fullsized":"2024-04-25T08:49:18.722040+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:41.671204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409789+0000","last_change":"2024-04-25T08:49:17.743976+0000","last_active":"2024-04-25T08:49:19.409789+0000","last_peered":"2024-04-25T08:49:19.409789+0000","last_clean":"2024-04-25T08:49:19.409789+0000","last_became_active":"2024-04-25T08:49:17.743708+0000","last_became_peered":"2024-04-25T08:49:17.743708+0000","last_unstale":"2024-04-25T08:49:19.409789+0000","last_undegraded":"2024-04-25T08:49:19.409789+0000","last_fullsized":"2024-04-25T08:49:19.409789+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:23.966690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.699002+0000","last_change":"2024-04-25T08:49:15.699002+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.699002+0000","last_undegraded":"2024-04-25T08:49:15.699002+0000","last_fullsized":"2024-04-25T08:49:15.699002+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409425+0000","last_change":"2024-04-25T08:49:17.743472+0000","last_active":"2024-04-25T08:49:19.409425+0000","last_peered":"2024-04-25T08:49:19.409425+0000","last_clean":"2024-04-25T08:49:19.409425+0000","last_became_active":"2024-04-25T08:49:17.743158+0000","last_became_peered":"2024-04-25T08:49:17.743158+0000","last_unstale":"2024-04-25T08:49:19.409425+0000","last_undegraded":"2024-04-25T08:49:19.409425+0000","last_fullsized":"2024-04-25T08:49:19.409425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:14.288500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698472+0000","last_change":"2024-04-25T08:49:15.698472+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698472+0000","last_undegraded":"2024-04-25T08:49:15.698472+0000","last_fullsized":"2024-04-25T08:49:15.698472+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722255+0000","last_change":"2024-04-25T08:49:17.735470+0000","last_active":"2024-04-25T08:49:18.722255+0000","last_peered":"2024-04-25T08:49:18.722255+0000","last_clean":"2024-04-25T08:49:18.722255+0000","last_became_active":"2024-04-25T08:49:17.735219+0000","last_became_peered":"2024-04-25T08:49:17.735219+0000","last_unstale":"2024-04-25T08:49:18.722255+0000","last_undegraded":"2024-04-25T08:49:18.722255+0000","last_fullsized":"2024-04-25T08:49:18.722255+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:07.433714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698434+0000","last_change":"2024-04-25T08:49:15.698434+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698434+0000","last_undegraded":"2024-04-25T08:49:15.698434+0000","last_fullsized":"2024-04-25T08:49:15.698434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722589+0000","last_change":"2024-04-25T08:49:17.738471+0000","last_active":"2024-04-25T08:49:18.722589+0000","last_peered":"2024-04-25T08:49:18.722589+0000","last_clean":"2024-04-25T08:49:18.722589+0000","last_became_active":"2024-04-25T08:49:17.738191+0000","last_became_peered":"2024-04-25T08:49:17.738191+0000","last_unstale":"2024-04-25T08:49:18.722589+0000","last_undegraded":"2024-04-25T08:49:18.722589+0000","last_fullsized":"2024-04-25T08:49:18.722589+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:14.288500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721802+0000","last_change":"2024-04-25T08:49:17.730576+0000","last_active":"2024-04-25T08:49:18.721802+0000","last_peered":"2024-04-25T08:49:18.721802+0000","last_clean":"2024-04-25T08:49:18.721802+0000","last_became_active":"2024-04-25T08:49:17.730275+0000","last_became_peered":"2024-04-25T08:49:17.730275+0000","last_unstale":"2024-04-25T08:49:18.721802+0000","last_undegraded":"2024-04-25T08:49:18.721802+0000","last_fullsized":"2024-04-25T08:49:18.721802+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:18.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":325,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T08:49:15.705622+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:49:15.705622+0000","last_peered":"2024-04-25T08:49:15.705622+0000","last_clean":"2024-04-25T08:49:15.705622+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:49:15.705622+0000","last_undegraded":"2024-04-25T08:49:15.705622+0000","last_fullsized":"2024-04-25T08:49:15.705622+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":26,"acting":26,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41340,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330500,"statfs":{"total":96636764160,"available":96594432000,"internally_reserved":0,"allocated":1884160,"data_stored":1186582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46328,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325512,"statfs":{"total":96636764160,"available":96589324288,"internally_reserved":0,"allocated":1290240,"data_stored":596214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40804,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331036,"statfs":{"total":96636764160,"available":96594980864,"internally_reserved":0,"allocated":1327104,"data_stored":616740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50488,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321352,"statfs":{"total":96636764160,"available":96585064448,"internally_reserved":0,"allocated":1277952,"data_stored":590005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50528,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321312,"statfs":{"total":96636764160,"available":96585023488,"internally_reserved":0,"allocated":1331200,"data_stored":617322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46316,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325524,"statfs":{"total":96636764160,"available":96589336576,"internally_reserved":0,"allocated":1277952,"data_stored":590005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46304,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325536,"statfs":{"total":96636764160,"available":96589348864,"internally_reserved":0,"allocated":1265664,"data_stored":584486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46900,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324940,"statfs":{"total":96636764160,"available":96588738560,"internally_reserved":0,"allocated":1871872,"data_stored":1180373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:49:20.669 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:49:20.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.812+0000 7fb048f4c640 1 Processor -- start 2024-04-25T08:49:20.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.812+0000 7fb048f4c640 1 -- start start 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb048f4c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb0440ce590 0x7fb044165900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb048f4c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb044071480 con 0x7fb0440cfec0 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb048f4c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb044071760 con 0x7fb044154ee0 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb048f4c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb044072090 con 0x7fb0440ce590 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb042d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb0440ce590 0x7fb044165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb041d9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb0440cfec0 0x7fb0440cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40824/0 (socket says 172.21.15.172:40824) 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb041d9b640 1 -- 172.21.15.172:0/507852056 learned_addr learned my addr 172.21.15.172:0/507852056 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb042d9d640 1 -- 172.21.15.172:0/507852056 >> v1:172.21.15.186:6789/0 conn(0x7fb044154ee0 legacy=0x7fb0440cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb042d9d640 1 -- 172.21.15.172:0/507852056 >> v1:172.21.15.172:6789/0 conn(0x7fb0440cfec0 legacy=0x7fb0440cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb042d9d640 1 -- 172.21.15.172:0/507852056 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb044071a40 con 0x7fb0440ce590 2024-04-25T08:49:20.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.813+0000 7fb04159a640 1 -- 172.21.15.172:0/507852056 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470712884 0 0) 0x7fb044071480 con 0x7fb0440cfec0 2024-04-25T08:49:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.814+0000 7fb042d9d640 1 --2- 172.21.15.172:0/507852056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440ce590 0x7fb044165900 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009d90 tx=0x7fb03c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3e40fc2340c2a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.814+0000 7fb04159a640 1 -- 172.21.15.172:0/507852056 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c007740 con 0x7fb0440ce590 2024-04-25T08:49:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.814+0000 7fb04159a640 1 -- 172.21.15.172:0/507852056 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c0078e0 con 0x7fb0440ce590 2024-04-25T08:49:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.814+0000 7fb04159a640 1 -- 172.21.15.172:0/507852056 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c007cb0 con 0x7fb0440ce590 2024-04-25T08:49:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.814+0000 7fb048f4c640 1 -- 172.21.15.172:0/507852056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440ce590 msgr2=0x7fb044165900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.814+0000 7fb048f4c640 1 --2- 172.21.15.172:0/507852056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440ce590 0x7fb044165900 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009d90 tx=0x7fb03c02a6f0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.815+0000 7fb048f4c640 1 -- 172.21.15.172:0/507852056 shutdown_connections 2024-04-25T08:49:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.815+0000 7fb048f4c640 1 --2- 172.21.15.172:0/507852056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440ce590 0x7fb044165900 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.815+0000 7fb048f4c640 1 -- 172.21.15.172:0/507852056 >> 172.21.15.172:0/507852056 conn(0x7fb04406abe0 msgr2=0x7fb04406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.815+0000 7fb048f4c640 1 -- 172.21.15.172:0/507852056 shutdown_connections 2024-04-25T08:49:20.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.815+0000 7fb048f4c640 1 -- 172.21.15.172:0/507852056 wait complete. 2024-04-25T08:49:20.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.816+0000 7fb048f4c640 1 Processor -- start 2024-04-25T08:49:20.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.816+0000 7fb048f4c640 1 -- start start 2024-04-25T08:49:20.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb048f4c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0440ce590 0x7fb0441459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb048f4c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440cfec0 0x7fb04414cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb048f4c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb044154ee0 0x7fb04414d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb048f4c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0441552c0 con 0x7fb0440cfec0 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb048f4c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044071230 con 0x7fb0440ce590 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb048f4c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb044155440 con 0x7fb044154ee0 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb041d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440cfec0 0x7fb04414cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb041d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440cfec0 0x7fb04414cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54892/0 (socket says 172.21.15.172:54892) 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb041d9b640 1 -- 172.21.15.172:0/2209268150 learned_addr learned my addr 172.21.15.172:0/2209268150 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb041d9b640 1 -- 172.21.15.172:0/2209268150 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb044154ee0 msgr2=0x7fb04414d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb041d9b640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb044154ee0 0x7fb04414d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb041d9b640 1 -- 172.21.15.172:0/2209268150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0440ce590 msgr2=0x7fb0441459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb04259c640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0440ce590 0x7fb0441459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb041d9b640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0440ce590 0x7fb0441459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb041d9b640 1 -- 172.21.15.172:0/2209268150 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0440b08e0 con 0x7fb0440cfec0 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb041d9b640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440cfec0 0x7fb04414cfb0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fb03800c4d0 tx=0x7fb03800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb032ffd640 1 -- 172.21.15.172:0/2209268150 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038018070 con 0x7fb0440cfec0 2024-04-25T08:49:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb032ffd640 1 -- 172.21.15.172:0/2209268150 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0380074e0 con 0x7fb0440cfec0 2024-04-25T08:49:20.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb048f4c640 1 -- 172.21.15.172:0/2209268150 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04414bf10 con 0x7fb0440cfec0 2024-04-25T08:49:20.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb032ffd640 1 -- 172.21.15.172:0/2209268150 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038004a20 con 0x7fb0440cfec0 2024-04-25T08:49:20.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.817+0000 7fb048f4c640 1 -- 172.21.15.172:0/2209268150 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04414c4d0 con 0x7fb0440cfec0 2024-04-25T08:49:20.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.818+0000 7fb048f4c640 1 -- 172.21.15.172:0/2209268150 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb044073990 con 0x7fb0440cfec0 2024-04-25T08:49:20.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.819+0000 7fb032ffd640 1 -- 172.21.15.172:0/2209268150 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb03801b070 con 0x7fb0440cfec0 2024-04-25T08:49:20.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.819+0000 7fb032ffd640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb02406b4d0 0x7fb02406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:20.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.819+0000 7fb032ffd640 1 -- 172.21.15.172:0/2209268150 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb038089670 con 0x7fb0440cfec0 2024-04-25T08:49:20.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.819+0000 7fb04259c640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb02406b4d0 0x7fb02406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:20.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.820+0000 7fb04259c640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb02406b4d0 0x7fb02406d990 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb034000f60 tx=0x7fb034009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:20.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.823+0000 7fb032ffd640 1 -- 172.21.15.172:0/2209268150 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb0380583d0 con 0x7fb0440cfec0 2024-04-25T08:49:20.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.993+0000 7fb048f4c640 1 -- 172.21.15.172:0/2209268150 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0440b2540 con 0x7fb02406b4d0 2024-04-25T08:49:20.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:20.998+0000 7fb032ffd640 1 -- 172.21.15.172:0/2209268150 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241078 (secure 0 0 0) 0x7fb0440b2540 con 0x7fb02406b4d0 2024-04-25T08:49:20.991 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:20.992 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:49:20.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 -- 172.21.15.172:0/2209268150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb02406b4d0 msgr2=0x7fb02406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb02406b4d0 0x7fb02406d990 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fb034000f60 tx=0x7fb034009040 comp rx=0 tx=0).stop 2024-04-25T08:49:20.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 -- 172.21.15.172:0/2209268150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440cfec0 msgr2=0x7fb04414cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:20.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440cfec0 0x7fb04414cfb0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fb03800c4d0 tx=0x7fb03800c990 comp rx=0 tx=0).stop 2024-04-25T08:49:20.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 -- 172.21.15.172:0/2209268150 shutdown_connections 2024-04-25T08:49:20.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb02406b4d0 0x7fb02406d990 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb044154ee0 0x7fb04414d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0440cfec0 0x7fb04414cfb0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 --2- 172.21.15.172:0/2209268150 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0440ce590 0x7fb0441459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:20.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 -- 172.21.15.172:0/2209268150 >> 172.21.15.172:0/2209268150 conn(0x7fb04406abe0 msgr2=0x7fb04415d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:20.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 -- 172.21.15.172:0/2209268150 shutdown_connections 2024-04-25T08:49:20.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.001+0000 7fb048f4c640 1 -- 172.21.15.172:0/2209268150 wait complete. 2024-04-25T08:49:21.003 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-04-25T08:49:20.597708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":369008,"kb_used_data":11256,"kb_used_omap":12,"kb_used_meta":357619,"kb_avail":754605712,"statfs":{"total":773094113280,"available":772716249088,"internally_reserved":0,"allocated":11526144,"data_stored":5961727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":366202416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905853"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409655+0000","last_change":"2024-04-25T08:49:17.740216+0000","last_active":"2024-04-25T08:49:19.409655+0000","last_peered":"2024-04-25T08:49:19.409655+0000","last_clean":"2024-04-25T08:49:19.409655+0000","last_became_active":"2024-04-25T08:49:17.739849+0000","last_became_peered":"2024-04-25T08:49:17.739849+0000","last_unstale":"2024-04-25T08:49:19.409655+0000","last_undegraded":"2024-04-25T08:49:19.409655+0000","last_fullsized":"2024-04-25T08:49:19.409655+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:13.994651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722296+0000","last_change":"2024-04-25T08:49:17.747710+0000","last_active":"2024-04-25T08:49:18.722296+0000","last_peered":"2024-04-25T08:49:18.722296+0000","last_clean":"2024-04-25T08:49:18.722296+0000","last_became_active":"2024-04-25T08:49:17.747407+0000","last_became_peered":"2024-04-25T08:49:17.747407+0000","last_unstale":"2024-04-25T08:49:18.722296+0000","last_undegraded":"2024-04-25T08:49:18.722296+0000","last_fullsized":"2024-04-25T08:49:18.722296+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:22.674559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409585+0000","last_change":"2024-04-25T08:49:17.726362+0000","last_active":"2024-04-25T08:49:19.409585+0000","last_peered":"2024-04-25T08:49:19.409585+0000","last_clean":"2024-04-25T08:49:19.409585+0000","last_became_active":"2024-04-25T08:49:17.725965+0000","last_became_peered":"2024-04-25T08:49:17.725965+0000","last_unstale":"2024-04-25T08:49:19.409585+0000","last_undegraded":"2024-04-25T08:49:19.409585+0000","last_fullsized":"2024-04-25T08:49:19.409585+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:30.493678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722456+0000","last_change":"2024-04-25T08:49:17.736872+0000","last_active":"2024-04-25T08:49:18.722456+0000","last_peered":"2024-04-25T08:49:18.722456+0000","last_clean":"2024-04-25T08:49:18.722456+0000","last_became_active":"2024-04-25T08:49:17.736604+0000","last_became_peered":"2024-04-25T08:49:17.736604+0000","last_unstale":"2024-04-25T08:49:18.722456+0000","last_undegraded":"2024-04-25T08:49:18.722456+0000","last_fullsized":"2024-04-25T08:49:18.722456+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:18.968390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"106'4","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409944+0000","last_change":"2024-04-25T08:49:16.709134+0000","last_active":"2024-04-25T08:49:19.409944+0000","last_peered":"2024-04-25T08:49:19.409944+0000","last_clean":"2024-04-25T08:49:19.409944+0000","last_became_active":"2024-04-25T08:49:16.708639+0000","last_became_peered":"2024-04-25T08:49:16.708639+0000","last_unstale":"2024-04-25T08:49:19.409944+0000","last_undegraded":"2024-04-25T08:49:19.409944+0000","last_fullsized":"2024-04-25T08:49:19.409944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:03.975037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722409+0000","last_change":"2024-04-25T08:49:17.740392+0000","last_active":"2024-04-25T08:49:18.722409+0000","last_peered":"2024-04-25T08:49:18.722409+0000","last_clean":"2024-04-25T08:49:18.722409+0000","last_became_active":"2024-04-25T08:49:17.739619+0000","last_became_peered":"2024-04-25T08:49:17.739619+0000","last_unstale":"2024-04-25T08:49:18.722409+0000","last_undegraded":"2024-04-25T08:49:18.722409+0000","last_fullsized":"2024-04-25T08:49:18.722409+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:44.615111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409784+0000","last_change":"2024-04-25T08:49:17.736418+0000","last_active":"2024-04-25T08:49:19.409784+0000","last_peered":"2024-04-25T08:49:19.409784+0000","last_clean":"2024-04-25T08:49:19.409784+0000","last_became_active":"2024-04-25T08:49:17.735998+0000","last_became_peered":"2024-04-25T08:49:17.735998+0000","last_unstale":"2024-04-25T08:49:19.409784+0000","last_undegraded":"2024-04-25T08:49:19.409784+0000","last_fullsized":"2024-04-25T08:49:19.409784+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:17.881581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.704241+0000","last_change":"2024-04-25T08:49:15.704241+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.704241+0000","last_undegraded":"2024-04-25T08:49:15.704241+0000","last_fullsized":"2024-04-25T08:49:15.704241+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721906+0000","last_change":"2024-04-25T08:49:16.710332+0000","last_active":"2024-04-25T08:49:18.721906+0000","last_peered":"2024-04-25T08:49:18.721906+0000","last_clean":"2024-04-25T08:49:18.721906+0000","last_became_active":"2024-04-25T08:49:16.710022+0000","last_became_peered":"2024-04-25T08:49:16.710022+0000","last_unstale":"2024-04-25T08:49:18.721906+0000","last_undegraded":"2024-04-25T08:49:18.721906+0000","last_fullsized":"2024-04-25T08:49:18.721906+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:40.668279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409950+0000","last_change":"2024-04-25T08:49:17.729394+0000","last_active":"2024-04-25T08:49:19.409950+0000","last_peered":"2024-04-25T08:49:19.409950+0000","last_clean":"2024-04-25T08:49:19.409950+0000","last_became_active":"2024-04-25T08:49:17.728130+0000","last_became_peered":"2024-04-25T08:49:17.728130+0000","last_unstale":"2024-04-25T08:49:19.409950+0000","last_undegraded":"2024-04-25T08:49:19.409950+0000","last_fullsized":"2024-04-25T08:49:19.409950+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:28.345178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409460+0000","last_change":"2024-04-25T08:49:16.709288+0000","last_active":"2024-04-25T08:49:19.409460+0000","last_peered":"2024-04-25T08:49:19.409460+0000","last_clean":"2024-04-25T08:49:19.409460+0000","last_became_active":"2024-04-25T08:49:16.707237+0000","last_became_peered":"2024-04-25T08:49:16.707237+0000","last_unstale":"2024-04-25T08:49:19.409460+0000","last_undegraded":"2024-04-25T08:49:19.409460+0000","last_fullsized":"2024-04-25T08:49:19.409460+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:07.367751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.705347+0000","last_change":"2024-04-25T08:49:15.705347+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.705347+0000","last_undegraded":"2024-04-25T08:49:15.705347+0000","last_fullsized":"2024-04-25T08:49:15.705347+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698445+0000","last_change":"2024-04-25T08:49:15.698445+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698445+0000","last_undegraded":"2024-04-25T08:49:15.698445+0000","last_fullsized":"2024-04-25T08:49:15.698445+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721938+0000","last_change":"2024-04-25T08:49:17.734692+0000","last_active":"2024-04-25T08:49:18.721938+0000","last_peered":"2024-04-25T08:49:18.721938+0000","last_clean":"2024-04-25T08:49:18.721938+0000","last_became_active":"2024-04-25T08:49:17.734182+0000","last_became_peered":"2024-04-25T08:49:17.734182+0000","last_unstale":"2024-04-25T08:49:18.721938+0000","last_undegraded":"2024-04-25T08:49:18.721938+0000","last_fullsized":"2024-04-25T08:49:18.721938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:46.183230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409430+0000","last_change":"2024-04-25T08:49:16.706179+0000","last_active":"2024-04-25T08:49:19.409430+0000","last_peered":"2024-04-25T08:49:19.409430+0000","last_clean":"2024-04-25T08:49:19.409430+0000","last_became_active":"2024-04-25T08:49:16.705248+0000","last_became_peered":"2024-04-25T08:49:16.705248+0000","last_unstale":"2024-04-25T08:49:19.409430+0000","last_undegraded":"2024-04-25T08:49:19.409430+0000","last_fullsized":"2024-04-25T08:49:19.409430+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:21.345771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698510+0000","last_change":"2024-04-25T08:49:15.698510+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698510+0000","last_undegraded":"2024-04-25T08:49:15.698510+0000","last_fullsized":"2024-04-25T08:49:15.698510+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.704252+0000","last_change":"2024-04-25T08:49:15.704252+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.704252+0000","last_undegraded":"2024-04-25T08:49:15.704252+0000","last_fullsized":"2024-04-25T08:49:15.704252+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722040+0000","last_change":"2024-04-25T08:49:16.709045+0000","last_active":"2024-04-25T08:49:18.722040+0000","last_peered":"2024-04-25T08:49:18.722040+0000","last_clean":"2024-04-25T08:49:18.722040+0000","last_became_active":"2024-04-25T08:49:16.708749+0000","last_became_peered":"2024-04-25T08:49:16.708749+0000","last_unstale":"2024-04-25T08:49:18.722040+0000","last_undegraded":"2024-04-25T08:49:18.722040+0000","last_fullsized":"2024-04-25T08:49:18.722040+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:41.671204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409789+0000","last_change":"2024-04-25T08:49:17.743976+0000","last_active":"2024-04-25T08:49:19.409789+0000","last_peered":"2024-04-25T08:49:19.409789+0000","last_clean":"2024-04-25T08:49:19.409789+0000","last_became_active":"2024-04-25T08:49:17.743708+0000","last_became_peered":"2024-04-25T08:49:17.743708+0000","last_unstale":"2024-04-25T08:49:19.409789+0000","last_undegraded":"2024-04-25T08:49:19.409789+0000","last_fullsized":"2024-04-25T08:49:19.409789+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:23.966690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.699002+0000","last_change":"2024-04-25T08:49:15.699002+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.699002+0000","last_undegraded":"2024-04-25T08:49:15.699002+0000","last_fullsized":"2024-04-25T08:49:15.699002+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409425+0000","last_change":"2024-04-25T08:49:17.743472+0000","last_active":"2024-04-25T08:49:19.409425+0000","last_peered":"2024-04-25T08:49:19.409425+0000","last_clean":"2024-04-25T08:49:19.409425+0000","last_became_active":"2024-04-25T08:49:17.743158+0000","last_became_peered":"2024-04-25T08:49:17.743158+0000","last_unstale":"2024-04-25T08:49:19.409425+0000","last_undegraded":"2024-04-25T08:49:19.409425+0000","last_fullsized":"2024-04-25T08:49:19.409425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:14.288500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698472+0000","last_change":"2024-04-25T08:49:15.698472+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698472+0000","last_undegraded":"2024-04-25T08:49:15.698472+0000","last_fullsized":"2024-04-25T08:49:15.698472+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722255+0000","last_change":"2024-04-25T08:49:17.735470+0000","last_active":"2024-04-25T08:49:18.722255+0000","last_peered":"2024-04-25T08:49:18.722255+0000","last_clean":"2024-04-25T08:49:18.722255+0000","last_became_active":"2024-04-25T08:49:17.735219+0000","last_became_peered":"2024-04-25T08:49:17.735219+0000","last_unstale":"2024-04-25T08:49:18.722255+0000","last_undegraded":"2024-04-25T08:49:18.722255+0000","last_fullsized":"2024-04-25T08:49:18.722255+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:07.433714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698434+0000","last_change":"2024-04-25T08:49:15.698434+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698434+0000","last_undegraded":"2024-04-25T08:49:15.698434+0000","last_fullsized":"2024-04-25T08:49:15.698434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722589+0000","last_change":"2024-04-25T08:49:17.738471+0000","last_active":"2024-04-25T08:49:18.722589+0000","last_peered":"2024-04-25T08:49:18.722589+0000","last_clean":"2024-04-25T08:49:18.722589+0000","last_became_active":"2024-04-25T08:49:17.738191+0000","last_became_peered":"2024-04-25T08:49:17.738191+0000","last_unstale":"2024-04-25T08:49:18.722589+0000","last_undegraded":"2024-04-25T08:49:18.722589+0000","last_fullsized":"2024-04-25T08:49:18.722589+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:14.288500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721802+0000","last_change":"2024-04-25T08:49:17.730576+0000","last_active":"2024-04-25T08:49:18.721802+0000","last_peered":"2024-04-25T08:49:18.721802+0000","last_clean":"2024-04-25T08:49:18.721802+0000","last_became_active":"2024-04-25T08:49:17.730275+0000","last_became_peered":"2024-04-25T08:49:17.730275+0000","last_unstale":"2024-04-25T08:49:18.721802+0000","last_undegraded":"2024-04-25T08:49:18.721802+0000","last_fullsized":"2024-04-25T08:49:18.721802+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:18.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":325,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T08:49:15.705622+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:49:15.705622+0000","last_peered":"2024-04-25T08:49:15.705622+0000","last_clean":"2024-04-25T08:49:15.705622+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:49:15.705622+0000","last_undegraded":"2024-04-25T08:49:15.705622+0000","last_fullsized":"2024-04-25T08:49:15.705622+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":26,"acting":26,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41340,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330500,"statfs":{"total":96636764160,"available":96594432000,"internally_reserved":0,"allocated":1884160,"data_stored":1186582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46328,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325512,"statfs":{"total":96636764160,"available":96589324288,"internally_reserved":0,"allocated":1290240,"data_stored":596214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40804,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331036,"statfs":{"total":96636764160,"available":96594980864,"internally_reserved":0,"allocated":1327104,"data_stored":616740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50488,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321352,"statfs":{"total":96636764160,"available":96585064448,"internally_reserved":0,"allocated":1277952,"data_stored":590005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50528,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321312,"statfs":{"total":96636764160,"available":96585023488,"internally_reserved":0,"allocated":1331200,"data_stored":617322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46316,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325524,"statfs":{"total":96636764160,"available":96589336576,"internally_reserved":0,"allocated":1277952,"data_stored":590005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46304,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325536,"statfs":{"total":96636764160,"available":96589348864,"internally_reserved":0,"allocated":1265664,"data_stored":584486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46900,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324940,"statfs":{"total":96636764160,"available":96588738560,"internally_reserved":0,"allocated":1871872,"data_stored":1180373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:49:21.007 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:49:21.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.151+0000 7fbf1e26b640 1 Processor -- start 2024-04-25T08:49:21.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.151+0000 7fbf1e26b640 1 -- start start 2024-04-25T08:49:21.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.151+0000 7fbf1e26b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbf180b2cb0 0x7fbf180d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.151+0000 7fbf1e26b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbf180d1020 0x7fbf180d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.151+0000 7fbf1e26b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf180b97a0 con 0x7fbf1815dbe0 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.151+0000 7fbf1e26b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1815dfc0 con 0x7fbf180d1020 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.151+0000 7fbf1e26b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180d1a00 con 0x7fbf180b2cb0 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.152+0000 7fbf17fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbf1815dbe0 0x7fbf180d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40836/0 (socket says 172.21.15.172:40836) 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.152+0000 7fbf17fff640 1 -- 172.21.15.172:0/1378700168 learned_addr learned my addr 172.21.15.172:0/1378700168 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.152+0000 7fbf1c808640 1 --2- 172.21.15.172:0/1378700168 >> v2:172.21.15.172:3300/0 conn(0x7fbf180d1020 0x7fbf180d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.152+0000 7fbf177fe640 1 --2- 172.21.15.172:0/1378700168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbf180b2cb0 0x7fbf180d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.152+0000 7fbf16ffd640 1 -- 172.21.15.172:0/1378700168 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698413683 0 0) 0x7fbf180b97a0 con 0x7fbf1815dbe0 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.152+0000 7fbf16ffd640 1 -- 172.21.15.172:0/1378700168 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf00003520 con 0x7fbf1815dbe0 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.152+0000 7fbf1c808640 1 -- 172.21.15.172:0/1378700168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbf180b2cb0 msgr2=0x7fbf180d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.152+0000 7fbf1c808640 1 --2- 172.21.15.172:0/1378700168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbf180b2cb0 0x7fbf180d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.152+0000 7fbf1c808640 1 -- 172.21.15.172:0/1378700168 >> v1:172.21.15.172:6789/0 conn(0x7fbf1815dbe0 legacy=0x7fbf180d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.152+0000 7fbf1c808640 1 -- 172.21.15.172:0/1378700168 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180d1c50 con 0x7fbf180d1020 2024-04-25T08:49:21.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf1c808640 1 --2- 172.21.15.172:0/1378700168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 0x7fbf180d2c70 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009d90 tx=0x7fbf1002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb13a2339fb04c1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:21.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf16ffd640 1 -- 172.21.15.172:0/1378700168 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf10007740 con 0x7fbf180d1020 2024-04-25T08:49:21.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf16ffd640 1 -- 172.21.15.172:0/1378700168 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf100078e0 con 0x7fbf180d1020 2024-04-25T08:49:21.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf16ffd640 1 -- 172.21.15.172:0/1378700168 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf10007c90 con 0x7fbf180d1020 2024-04-25T08:49:21.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf1e26b640 1 -- 172.21.15.172:0/1378700168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 msgr2=0x7fbf180d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf1e26b640 1 --2- 172.21.15.172:0/1378700168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 0x7fbf180d2c70 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009d90 tx=0x7fbf1002a660 comp rx=0 tx=0).stop 2024-04-25T08:49:21.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf1e26b640 1 -- 172.21.15.172:0/1378700168 shutdown_connections 2024-04-25T08:49:21.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf1e26b640 1 --2- 172.21.15.172:0/1378700168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbf180b2cb0 0x7fbf180d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf1e26b640 1 --2- 172.21.15.172:0/1378700168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 0x7fbf180d2c70 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf1e26b640 1 -- 172.21.15.172:0/1378700168 >> 172.21.15.172:0/1378700168 conn(0x7fbf18061a20 msgr2=0x7fbf18061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:21.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf1e26b640 1 -- 172.21.15.172:0/1378700168 shutdown_connections 2024-04-25T08:49:21.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.153+0000 7fbf1e26b640 1 -- 172.21.15.172:0/1378700168 wait complete. 2024-04-25T08:49:21.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.154+0000 7fbf1e26b640 1 Processor -- start 2024-04-25T08:49:21.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.155+0000 7fbf1e26b640 1 -- start start 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.155+0000 7fbf1e26b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf180b2cb0 0x7fbf181f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.155+0000 7fbf1e26b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 0x7fbf181519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.155+0000 7fbf1e26b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbf1815dbe0 0x7fbf1815e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.155+0000 7fbf1e26b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180b92a0 con 0x7fbf180d1020 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.155+0000 7fbf1e26b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180d2210 con 0x7fbf180b2cb0 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.155+0000 7fbf1e26b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180b9420 con 0x7fbf1815dbe0 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf177fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 0x7fbf181519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf177fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 0x7fbf181519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54914/0 (socket says 172.21.15.172:54914) 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf177fe640 1 -- 172.21.15.172:0/827147298 learned_addr learned my addr 172.21.15.172:0/827147298 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf17fff640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf180b2cb0 0x7fbf181f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf1c808640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbf1815dbe0 0x7fbf1815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf177fe640 1 -- 172.21.15.172:0/827147298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbf1815dbe0 msgr2=0x7fbf1815e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf177fe640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbf1815dbe0 0x7fbf1815e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf177fe640 1 -- 172.21.15.172:0/827147298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf180b2cb0 msgr2=0x7fbf181f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf177fe640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf180b2cb0 0x7fbf181f34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf177fe640 1 -- 172.21.15.172:0/827147298 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf181f3b50 con 0x7fbf180d1020 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf177fe640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 0x7fbf181519b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800d830 tx=0x7fbf0800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf14ff9640 1 -- 172.21.15.172:0/827147298 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800b6c0 con 0x7fbf180d1020 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf14ff9640 1 -- 172.21.15.172:0/827147298 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf08019070 con 0x7fbf180d1020 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf1e26b640 1 -- 172.21.15.172:0/827147298 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf181f3e30 con 0x7fbf180d1020 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf14ff9640 1 -- 172.21.15.172:0/827147298 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800ba80 con 0x7fbf180d1020 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.156+0000 7fbf1e26b640 1 -- 172.21.15.172:0/827147298 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf181f43f0 con 0x7fbf180d1020 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.157+0000 7fbf1e26b640 1 -- 172.21.15.172:0/827147298 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf180b62b0 con 0x7fbf180d1020 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.158+0000 7fbf14ff9640 1 -- 172.21.15.172:0/827147298 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbf0801e460 con 0x7fbf180d1020 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.158+0000 7fbf14ff9640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf0406b4d0 0x7fbf0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.158+0000 7fbf14ff9640 1 -- 172.21.15.172:0/827147298 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbf0808a8f0 con 0x7fbf180d1020 2024-04-25T08:49:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.158+0000 7fbf17fff640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf0406b4d0 0x7fbf0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.159+0000 7fbf17fff640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf0406b4d0 0x7fbf0406d990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c005880 tx=0x7fbf0c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:21.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.162+0000 7fbf14ff9640 1 -- 172.21.15.172:0/827147298 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbf08059020 con 0x7fbf180d1020 2024-04-25T08:49:21.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.331+0000 7fbf1e26b640 1 -- 172.21.15.172:0/827147298 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf18073990 con 0x7fbf0406b4d0 2024-04-25T08:49:21.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.336+0000 7fbf14ff9640 1 -- 172.21.15.172:0/827147298 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241078 (secure 0 0 0) 0x7fbf18073990 con 0x7fbf0406b4d0 2024-04-25T08:49:21.330 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:21.331 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:49:21.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 -- 172.21.15.172:0/827147298 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf0406b4d0 msgr2=0x7fbf0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf0406b4d0 0x7fbf0406d990 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c005880 tx=0x7fbf0c009040 comp rx=0 tx=0).stop 2024-04-25T08:49:21.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 -- 172.21.15.172:0/827147298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 msgr2=0x7fbf181519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 0x7fbf181519b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800d830 tx=0x7fbf0800dcf0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 -- 172.21.15.172:0/827147298 shutdown_connections 2024-04-25T08:49:21.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbf0406b4d0 0x7fbf0406d990 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbf1815dbe0 0x7fbf1815e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf180d1020 0x7fbf181519b0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 --2- 172.21.15.172:0/827147298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbf180b2cb0 0x7fbf181f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 -- 172.21.15.172:0/827147298 >> 172.21.15.172:0/827147298 conn(0x7fbf18061a20 msgr2=0x7fbf18159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:21.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 -- 172.21.15.172:0/827147298 shutdown_connections 2024-04-25T08:49:21.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.339+0000 7fbf1e26b640 1 -- 172.21.15.172:0/827147298 wait complete. 2024-04-25T08:49:21.341 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-04-25T08:49:20.597708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":369008,"kb_used_data":11256,"kb_used_omap":12,"kb_used_meta":357619,"kb_avail":754605712,"statfs":{"total":773094113280,"available":772716249088,"internally_reserved":0,"allocated":11526144,"data_stored":5961727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":366202416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905853"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409655+0000","last_change":"2024-04-25T08:49:17.740216+0000","last_active":"2024-04-25T08:49:19.409655+0000","last_peered":"2024-04-25T08:49:19.409655+0000","last_clean":"2024-04-25T08:49:19.409655+0000","last_became_active":"2024-04-25T08:49:17.739849+0000","last_became_peered":"2024-04-25T08:49:17.739849+0000","last_unstale":"2024-04-25T08:49:19.409655+0000","last_undegraded":"2024-04-25T08:49:19.409655+0000","last_fullsized":"2024-04-25T08:49:19.409655+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:13.994651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722296+0000","last_change":"2024-04-25T08:49:17.747710+0000","last_active":"2024-04-25T08:49:18.722296+0000","last_peered":"2024-04-25T08:49:18.722296+0000","last_clean":"2024-04-25T08:49:18.722296+0000","last_became_active":"2024-04-25T08:49:17.747407+0000","last_became_peered":"2024-04-25T08:49:17.747407+0000","last_unstale":"2024-04-25T08:49:18.722296+0000","last_undegraded":"2024-04-25T08:49:18.722296+0000","last_fullsized":"2024-04-25T08:49:18.722296+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:22.674559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409585+0000","last_change":"2024-04-25T08:49:17.726362+0000","last_active":"2024-04-25T08:49:19.409585+0000","last_peered":"2024-04-25T08:49:19.409585+0000","last_clean":"2024-04-25T08:49:19.409585+0000","last_became_active":"2024-04-25T08:49:17.725965+0000","last_became_peered":"2024-04-25T08:49:17.725965+0000","last_unstale":"2024-04-25T08:49:19.409585+0000","last_undegraded":"2024-04-25T08:49:19.409585+0000","last_fullsized":"2024-04-25T08:49:19.409585+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:30.493678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722456+0000","last_change":"2024-04-25T08:49:17.736872+0000","last_active":"2024-04-25T08:49:18.722456+0000","last_peered":"2024-04-25T08:49:18.722456+0000","last_clean":"2024-04-25T08:49:18.722456+0000","last_became_active":"2024-04-25T08:49:17.736604+0000","last_became_peered":"2024-04-25T08:49:17.736604+0000","last_unstale":"2024-04-25T08:49:18.722456+0000","last_undegraded":"2024-04-25T08:49:18.722456+0000","last_fullsized":"2024-04-25T08:49:18.722456+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:18.968390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"106'4","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409944+0000","last_change":"2024-04-25T08:49:16.709134+0000","last_active":"2024-04-25T08:49:19.409944+0000","last_peered":"2024-04-25T08:49:19.409944+0000","last_clean":"2024-04-25T08:49:19.409944+0000","last_became_active":"2024-04-25T08:49:16.708639+0000","last_became_peered":"2024-04-25T08:49:16.708639+0000","last_unstale":"2024-04-25T08:49:19.409944+0000","last_undegraded":"2024-04-25T08:49:19.409944+0000","last_fullsized":"2024-04-25T08:49:19.409944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:03.975037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722409+0000","last_change":"2024-04-25T08:49:17.740392+0000","last_active":"2024-04-25T08:49:18.722409+0000","last_peered":"2024-04-25T08:49:18.722409+0000","last_clean":"2024-04-25T08:49:18.722409+0000","last_became_active":"2024-04-25T08:49:17.739619+0000","last_became_peered":"2024-04-25T08:49:17.739619+0000","last_unstale":"2024-04-25T08:49:18.722409+0000","last_undegraded":"2024-04-25T08:49:18.722409+0000","last_fullsized":"2024-04-25T08:49:18.722409+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:44.615111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409784+0000","last_change":"2024-04-25T08:49:17.736418+0000","last_active":"2024-04-25T08:49:19.409784+0000","last_peered":"2024-04-25T08:49:19.409784+0000","last_clean":"2024-04-25T08:49:19.409784+0000","last_became_active":"2024-04-25T08:49:17.735998+0000","last_became_peered":"2024-04-25T08:49:17.735998+0000","last_unstale":"2024-04-25T08:49:19.409784+0000","last_undegraded":"2024-04-25T08:49:19.409784+0000","last_fullsized":"2024-04-25T08:49:19.409784+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:17.881581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.704241+0000","last_change":"2024-04-25T08:49:15.704241+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.704241+0000","last_undegraded":"2024-04-25T08:49:15.704241+0000","last_fullsized":"2024-04-25T08:49:15.704241+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721906+0000","last_change":"2024-04-25T08:49:16.710332+0000","last_active":"2024-04-25T08:49:18.721906+0000","last_peered":"2024-04-25T08:49:18.721906+0000","last_clean":"2024-04-25T08:49:18.721906+0000","last_became_active":"2024-04-25T08:49:16.710022+0000","last_became_peered":"2024-04-25T08:49:16.710022+0000","last_unstale":"2024-04-25T08:49:18.721906+0000","last_undegraded":"2024-04-25T08:49:18.721906+0000","last_fullsized":"2024-04-25T08:49:18.721906+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:40.668279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409950+0000","last_change":"2024-04-25T08:49:17.729394+0000","last_active":"2024-04-25T08:49:19.409950+0000","last_peered":"2024-04-25T08:49:19.409950+0000","last_clean":"2024-04-25T08:49:19.409950+0000","last_became_active":"2024-04-25T08:49:17.728130+0000","last_became_peered":"2024-04-25T08:49:17.728130+0000","last_unstale":"2024-04-25T08:49:19.409950+0000","last_undegraded":"2024-04-25T08:49:19.409950+0000","last_fullsized":"2024-04-25T08:49:19.409950+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:28.345178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409460+0000","last_change":"2024-04-25T08:49:16.709288+0000","last_active":"2024-04-25T08:49:19.409460+0000","last_peered":"2024-04-25T08:49:19.409460+0000","last_clean":"2024-04-25T08:49:19.409460+0000","last_became_active":"2024-04-25T08:49:16.707237+0000","last_became_peered":"2024-04-25T08:49:16.707237+0000","last_unstale":"2024-04-25T08:49:19.409460+0000","last_undegraded":"2024-04-25T08:49:19.409460+0000","last_fullsized":"2024-04-25T08:49:19.409460+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:07.367751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.705347+0000","last_change":"2024-04-25T08:49:15.705347+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.705347+0000","last_undegraded":"2024-04-25T08:49:15.705347+0000","last_fullsized":"2024-04-25T08:49:15.705347+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698445+0000","last_change":"2024-04-25T08:49:15.698445+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698445+0000","last_undegraded":"2024-04-25T08:49:15.698445+0000","last_fullsized":"2024-04-25T08:49:15.698445+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721938+0000","last_change":"2024-04-25T08:49:17.734692+0000","last_active":"2024-04-25T08:49:18.721938+0000","last_peered":"2024-04-25T08:49:18.721938+0000","last_clean":"2024-04-25T08:49:18.721938+0000","last_became_active":"2024-04-25T08:49:17.734182+0000","last_became_peered":"2024-04-25T08:49:17.734182+0000","last_unstale":"2024-04-25T08:49:18.721938+0000","last_undegraded":"2024-04-25T08:49:18.721938+0000","last_fullsized":"2024-04-25T08:49:18.721938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:46.183230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409430+0000","last_change":"2024-04-25T08:49:16.706179+0000","last_active":"2024-04-25T08:49:19.409430+0000","last_peered":"2024-04-25T08:49:19.409430+0000","last_clean":"2024-04-25T08:49:19.409430+0000","last_became_active":"2024-04-25T08:49:16.705248+0000","last_became_peered":"2024-04-25T08:49:16.705248+0000","last_unstale":"2024-04-25T08:49:19.409430+0000","last_undegraded":"2024-04-25T08:49:19.409430+0000","last_fullsized":"2024-04-25T08:49:19.409430+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:21.345771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698510+0000","last_change":"2024-04-25T08:49:15.698510+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698510+0000","last_undegraded":"2024-04-25T08:49:15.698510+0000","last_fullsized":"2024-04-25T08:49:15.698510+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.704252+0000","last_change":"2024-04-25T08:49:15.704252+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.704252+0000","last_undegraded":"2024-04-25T08:49:15.704252+0000","last_fullsized":"2024-04-25T08:49:15.704252+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722040+0000","last_change":"2024-04-25T08:49:16.709045+0000","last_active":"2024-04-25T08:49:18.722040+0000","last_peered":"2024-04-25T08:49:18.722040+0000","last_clean":"2024-04-25T08:49:18.722040+0000","last_became_active":"2024-04-25T08:49:16.708749+0000","last_became_peered":"2024-04-25T08:49:16.708749+0000","last_unstale":"2024-04-25T08:49:18.722040+0000","last_undegraded":"2024-04-25T08:49:18.722040+0000","last_fullsized":"2024-04-25T08:49:18.722040+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:41.671204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409789+0000","last_change":"2024-04-25T08:49:17.743976+0000","last_active":"2024-04-25T08:49:19.409789+0000","last_peered":"2024-04-25T08:49:19.409789+0000","last_clean":"2024-04-25T08:49:19.409789+0000","last_became_active":"2024-04-25T08:49:17.743708+0000","last_became_peered":"2024-04-25T08:49:17.743708+0000","last_unstale":"2024-04-25T08:49:19.409789+0000","last_undegraded":"2024-04-25T08:49:19.409789+0000","last_fullsized":"2024-04-25T08:49:19.409789+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:23.966690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.699002+0000","last_change":"2024-04-25T08:49:15.699002+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.699002+0000","last_undegraded":"2024-04-25T08:49:15.699002+0000","last_fullsized":"2024-04-25T08:49:15.699002+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409425+0000","last_change":"2024-04-25T08:49:17.743472+0000","last_active":"2024-04-25T08:49:19.409425+0000","last_peered":"2024-04-25T08:49:19.409425+0000","last_clean":"2024-04-25T08:49:19.409425+0000","last_became_active":"2024-04-25T08:49:17.743158+0000","last_became_peered":"2024-04-25T08:49:17.743158+0000","last_unstale":"2024-04-25T08:49:19.409425+0000","last_undegraded":"2024-04-25T08:49:19.409425+0000","last_fullsized":"2024-04-25T08:49:19.409425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:14.288500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698472+0000","last_change":"2024-04-25T08:49:15.698472+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698472+0000","last_undegraded":"2024-04-25T08:49:15.698472+0000","last_fullsized":"2024-04-25T08:49:15.698472+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722255+0000","last_change":"2024-04-25T08:49:17.735470+0000","last_active":"2024-04-25T08:49:18.722255+0000","last_peered":"2024-04-25T08:49:18.722255+0000","last_clean":"2024-04-25T08:49:18.722255+0000","last_became_active":"2024-04-25T08:49:17.735219+0000","last_became_peered":"2024-04-25T08:49:17.735219+0000","last_unstale":"2024-04-25T08:49:18.722255+0000","last_undegraded":"2024-04-25T08:49:18.722255+0000","last_fullsized":"2024-04-25T08:49:18.722255+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:07.433714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698434+0000","last_change":"2024-04-25T08:49:15.698434+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698434+0000","last_undegraded":"2024-04-25T08:49:15.698434+0000","last_fullsized":"2024-04-25T08:49:15.698434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722589+0000","last_change":"2024-04-25T08:49:17.738471+0000","last_active":"2024-04-25T08:49:18.722589+0000","last_peered":"2024-04-25T08:49:18.722589+0000","last_clean":"2024-04-25T08:49:18.722589+0000","last_became_active":"2024-04-25T08:49:17.738191+0000","last_became_peered":"2024-04-25T08:49:17.738191+0000","last_unstale":"2024-04-25T08:49:18.722589+0000","last_undegraded":"2024-04-25T08:49:18.722589+0000","last_fullsized":"2024-04-25T08:49:18.722589+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:14.288500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721802+0000","last_change":"2024-04-25T08:49:17.730576+0000","last_active":"2024-04-25T08:49:18.721802+0000","last_peered":"2024-04-25T08:49:18.721802+0000","last_clean":"2024-04-25T08:49:18.721802+0000","last_became_active":"2024-04-25T08:49:17.730275+0000","last_became_peered":"2024-04-25T08:49:17.730275+0000","last_unstale":"2024-04-25T08:49:18.721802+0000","last_undegraded":"2024-04-25T08:49:18.721802+0000","last_fullsized":"2024-04-25T08:49:18.721802+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:18.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":325,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T08:49:15.705622+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:49:15.705622+0000","last_peered":"2024-04-25T08:49:15.705622+0000","last_clean":"2024-04-25T08:49:15.705622+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:49:15.705622+0000","last_undegraded":"2024-04-25T08:49:15.705622+0000","last_fullsized":"2024-04-25T08:49:15.705622+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":26,"acting":26,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41340,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330500,"statfs":{"total":96636764160,"available":96594432000,"internally_reserved":0,"allocated":1884160,"data_stored":1186582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46328,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325512,"statfs":{"total":96636764160,"available":96589324288,"internally_reserved":0,"allocated":1290240,"data_stored":596214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40804,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331036,"statfs":{"total":96636764160,"available":96594980864,"internally_reserved":0,"allocated":1327104,"data_stored":616740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50488,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321352,"statfs":{"total":96636764160,"available":96585064448,"internally_reserved":0,"allocated":1277952,"data_stored":590005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50528,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321312,"statfs":{"total":96636764160,"available":96585023488,"internally_reserved":0,"allocated":1331200,"data_stored":617322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46316,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325524,"statfs":{"total":96636764160,"available":96589336576,"internally_reserved":0,"allocated":1277952,"data_stored":590005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46304,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325536,"statfs":{"total":96636764160,"available":96589348864,"internally_reserved":0,"allocated":1265664,"data_stored":584486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46900,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324940,"statfs":{"total":96636764160,"available":96588738560,"internally_reserved":0,"allocated":1871872,"data_stored":1180373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:49:21.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2024-04-25T08:49:21.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2024-04-25T08:49:21.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2024-04-25T08:49:21.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2024-04-25T08:49:21.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2024-04-25T08:49:21.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2024-04-25T08:49:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2024-04-25T08:49:21.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:49:15.704241+0000', 'last_change': '2024-04-25T08:49:15.704241+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.704241+0000', 'last_undegraded': '2024-04-25T08:49:15.704241+0000', 'last_fullsized': '2024-04-25T08:49:15.704241+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2024-04-25T08:49:21.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:49:15.705347+0000', 'last_change': '2024-04-25T08:49:15.705347+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.705347+0000', 'last_undegraded': '2024-04-25T08:49:15.705347+0000', 'last_fullsized': '2024-04-25T08:49:15.705347+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:49:15.698445+0000', 'last_change': '2024-04-25T08:49:15.698445+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.698445+0000', 'last_undegraded': '2024-04-25T08:49:15.698445+0000', 'last_fullsized': '2024-04-25T08:49:15.698445+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2024-04-25T08:49:21.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2024-04-25T08:49:21.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2024-04-25T08:49:21.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2024-04-25T08:49:21.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2024-04-25T08:49:21.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2024-04-25T08:49:21.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:49:15.698510+0000', 'last_change': '2024-04-25T08:49:15.698510+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.698510+0000', 'last_undegraded': '2024-04-25T08:49:15.698510+0000', 'last_fullsized': '2024-04-25T08:49:15.698510+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:49:21.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2024-04-25T08:49:21.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2024-04-25T08:49:21.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:49:15.704252+0000', 'last_change': '2024-04-25T08:49:15.704252+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.704252+0000', 'last_undegraded': '2024-04-25T08:49:15.704252+0000', 'last_fullsized': '2024-04-25T08:49:15.704252+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T08:49:21.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2024-04-25T08:49:21.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2024-04-25T08:49:21.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2024-04-25T08:49:21.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2024-04-25T08:49:21.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2024-04-25T08:49:21.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2024-04-25T08:49:21.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:49:15.699002+0000', 'last_change': '2024-04-25T08:49:15.699002+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.699002+0000', 'last_undegraded': '2024-04-25T08:49:15.699002+0000', 'last_fullsized': '2024-04-25T08:49:15.699002+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:49:21.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2024-04-25T08:49:21.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:49:15.698472+0000', 'last_change': '2024-04-25T08:49:15.698472+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.698472+0000', 'last_undegraded': '2024-04-25T08:49:15.698472+0000', 'last_fullsized': '2024-04-25T08:49:15.698472+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2024-04-25T08:49:21.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2024-04-25T08:49:21.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:16.690964+0000', 'last_change': '2024-04-25T08:49:16.690964+0000', 'last_active': '2024-04-25T08:49:16.690964+0000', 'last_peered': '2024-04-25T08:49:16.690964+0000', 'last_clean': '2024-04-25T08:49:16.690964+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:16.690964+0000', 'last_undegraded': '2024-04-25T08:49:16.690964+0000', 'last_fullsized': '2024-04-25T08:49:16.690964+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:16.690964+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2024-04-25T08:49:21.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 104, 'state': 'creating+peering', 'last_fresh': '2024-04-25T08:49:15.698434+0000', 'last_change': '2024-04-25T08:49:15.698434+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.698434+0000', 'last_undegraded': '2024-04-25T08:49:15.698434+0000', 'last_fullsized': '2024-04-25T08:49:15.698434+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T08:49:21.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2024-04-25T08:49:21.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2024-04-25T08:49:21.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T08:49:15.689228+0000', 'last_change': '2024-04-25T08:49:15.689228+0000', 'last_active': '2024-04-25T08:49:15.689228+0000', 'last_peered': '2024-04-25T08:49:15.689228+0000', 'last_clean': '2024-04-25T08:49:15.689228+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T08:49:15.689228+0000', 'last_undegraded': '2024-04-25T08:49:15.689228+0000', 'last_fullsized': '2024-04-25T08:49:15.689228+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'last_clean_scrub_stamp': '2024-04-25T08:49:15.689228+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T08:49:21.360 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:49:21.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.487+0000 7fd1d5d6a640 1 Processor -- start 2024-04-25T08:49:21.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.487+0000 7fd1d5d6a640 1 -- start start 2024-04-25T08:49:21.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.488+0000 7fd1d5d6a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d00d2e90 0x7fd1d00d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.488+0000 7fd1d5d6a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd1d00d0900 0x7fd1d00b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.488+0000 7fd1d5d6a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d00b9940 con 0x7fd1d015dd30 2024-04-25T08:49:21.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.488+0000 7fd1d5d6a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d00d0d70 con 0x7fd1d00d0900 2024-04-25T08:49:21.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.488+0000 7fd1d5d6a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00d1df0 con 0x7fd1d00d2e90 2024-04-25T08:49:21.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.488+0000 7fd1cffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd1d00d0900 0x7fd1d00b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.488+0000 7fd1cffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd1d00d0900 0x7fd1d00b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54928/0 (socket says 172.21.15.172:54928) 2024-04-25T08:49:21.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.488+0000 7fd1cffff640 1 -- 172.21.15.172:0/2957503628 learned_addr learned my addr 172.21.15.172:0/2957503628 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:21.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.488+0000 7fd1ceffd640 1 --2- 172.21.15.172:0/2957503628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d00d2e90 0x7fd1d00d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.489+0000 7fd1cffff640 1 -- 172.21.15.172:0/2957503628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d00d2e90 msgr2=0x7fd1d00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:21.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.489+0000 7fd1cffff640 1 --2- 172.21.15.172:0/2957503628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d00d2e90 0x7fd1d00d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.489+0000 7fd1cffff640 1 -- 172.21.15.172:0/2957503628 >> v1:172.21.15.186:6789/0 conn(0x7fd1d015dd30 legacy=0x7fd1d00b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.489+0000 7fd1cffff640 1 -- 172.21.15.172:0/2957503628 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00d20d0 con 0x7fd1d00d0900 2024-04-25T08:49:21.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.489+0000 7fd1cffff640 1 --2- 172.21.15.172:0/2957503628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d00d0900 0x7fd1d00b6a40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009e50 tx=0x7fd1c802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334c06bd3b6da332 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:21.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.489+0000 7fd1ce7fc640 1 -- 172.21.15.172:0/2957503628 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8036070 con 0x7fd1d00d0900 2024-04-25T08:49:21.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.489+0000 7fd1ce7fc640 1 -- 172.21.15.172:0/2957503628 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8031600 con 0x7fd1d00d0900 2024-04-25T08:49:21.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.489+0000 7fd1ce7fc640 1 -- 172.21.15.172:0/2957503628 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80319d0 con 0x7fd1d00d0900 2024-04-25T08:49:21.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.490+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/2957503628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d00d0900 msgr2=0x7fd1d00b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.490+0000 7fd1d5d6a640 1 --2- 172.21.15.172:0/2957503628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d00d0900 0x7fd1d00b6a40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009e50 tx=0x7fd1c802a680 comp rx=0 tx=0).stop 2024-04-25T08:49:21.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.490+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/2957503628 shutdown_connections 2024-04-25T08:49:21.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.490+0000 7fd1d5d6a640 1 --2- 172.21.15.172:0/2957503628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d00d0900 0x7fd1d00b6a40 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.490+0000 7fd1d5d6a640 1 --2- 172.21.15.172:0/2957503628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d00d2e90 0x7fd1d00d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.490+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/2957503628 >> 172.21.15.172:0/2957503628 conn(0x7fd1d0061c30 msgr2=0x7fd1d006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:21.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.490+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/2957503628 shutdown_connections 2024-04-25T08:49:21.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.490+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/2957503628 wait complete. 2024-04-25T08:49:21.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.491+0000 7fd1d5d6a640 1 Processor -- start 2024-04-25T08:49:21.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.491+0000 7fd1d5d6a640 1 -- start start 2024-04-25T08:49:21.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1d5d6a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1d00d0900 0x7fd1d0160550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1d5d6a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d00d2e90 0x7fd1d00b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1d5d6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d015dd30 0x7fd1d014a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1d5d6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00d2970 con 0x7fd1d015dd30 2024-04-25T08:49:21.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1d5d6a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00d2690 con 0x7fd1d00d0900 2024-04-25T08:49:21.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1d5d6a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d00d1a10 con 0x7fd1d00d2e90 2024-04-25T08:49:21.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1cffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d015dd30 0x7fd1d014a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1cffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d015dd30 0x7fd1d014a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54934/0 (socket says 172.21.15.172:54934) 2024-04-25T08:49:21.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1cffff640 1 -- 172.21.15.172:0/285230836 learned_addr learned my addr 172.21.15.172:0/285230836 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:21.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1cf7fe640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1d00d0900 0x7fd1d0160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.492+0000 7fd1ceffd640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d00d2e90 0x7fd1d00b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1cffff640 1 -- 172.21.15.172:0/285230836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d00d2e90 msgr2=0x7fd1d00b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1cffff640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d00d2e90 0x7fd1d00b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1cffff640 1 -- 172.21.15.172:0/285230836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1d00d0900 msgr2=0x7fd1d0160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1cffff640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1d00d0900 0x7fd1d0160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1cffff640 1 -- 172.21.15.172:0/285230836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00caa80 con 0x7fd1d015dd30 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1cffff640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d015dd30 0x7fd1d014a8b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8034040 tx=0x7fd1c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1b7fff640 1 -- 172.21.15.172:0/285230836 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8036050 con 0x7fd1d015dd30 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1b7fff640 1 -- 172.21.15.172:0/285230836 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8042070 con 0x7fd1d015dd30 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/285230836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d00cad20 con 0x7fd1d015dd30 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1b7fff640 1 -- 172.21.15.172:0/285230836 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8009510 con 0x7fd1d015dd30 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.493+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/285230836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d00cb2e0 con 0x7fd1d015dd30 2024-04-25T08:49:21.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.494+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/285230836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d0073990 con 0x7fd1d015dd30 2024-04-25T08:49:21.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.494+0000 7fd1b7fff640 1 -- 172.21.15.172:0/285230836 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd1c8007bd0 con 0x7fd1d015dd30 2024-04-25T08:49:21.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.495+0000 7fd1b7fff640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1bc06b500 0x7fd1bc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.495+0000 7fd1b7fff640 1 -- 172.21.15.172:0/285230836 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd1c80ab080 con 0x7fd1d015dd30 2024-04-25T08:49:21.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.495+0000 7fd1cf7fe640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1bc06b500 0x7fd1bc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.495+0000 7fd1cf7fe640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1bc06b500 0x7fd1bc06d9c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00016e0 tx=0x7fd1c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:21.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.499+0000 7fd1b7fff640 1 -- 172.21.15.172:0/285230836 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd1c8079720 con 0x7fd1d015dd30 2024-04-25T08:49:21.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.743+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/285230836 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd1d00b2920 con 0x7fd1d015dd30 2024-04-25T08:49:21.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.743+0000 7fd1b7fff640 1 -- 172.21.15.172:0/285230836 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1175 (secure 0 0 0) 0x7fd1c807d7c0 con 0x7fd1d015dd30 2024-04-25T08:49:21.734 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:21.734 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":437,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":70},{"state_name":"active+clean","count":19},{"state_name":"creating+peering","count":8}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590950,"bytes_used":377864192,"bytes_avail":772716249088,"bytes_total":773094113280,"unknown_pgs_ratio":0.72164946794509888,"inactive_pgs_ratio":0.082474224269390106,"write_bytes_sec":208,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":62,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":8124}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-04-25T08:48:28.587854+0000","services":{}},"progress_events":{}} 2024-04-25T08:49:21.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/285230836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1bc06b500 msgr2=0x7fd1bc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1bc06b500 0x7fd1bc06d9c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00016e0 tx=0x7fd1c0009040 comp rx=0 tx=0).stop 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/285230836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d015dd30 msgr2=0x7fd1d014a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d015dd30 0x7fd1d014a8b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8034040 tx=0x7fd1c8004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/285230836 shutdown_connections 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd1bc06b500 0x7fd1bc06d9c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d015dd30 0x7fd1d014a8b0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1d00d2e90 0x7fd1d00b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 --2- 172.21.15.172:0/285230836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1d00d0900 0x7fd1d0160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/285230836 >> 172.21.15.172:0/285230836 conn(0x7fd1d0061c30 msgr2=0x7fd1d00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/285230836 shutdown_connections 2024-04-25T08:49:21.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.745+0000 7fd1d5d6a640 1 -- 172.21.15.172:0/285230836 wait complete. 2024-04-25T08:49:21.747 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:49:21.748 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:49:21.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.854+0000 7f8c08aac640 1 Processor -- start 2024-04-25T08:49:21.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.854+0000 7f8c08aac640 1 -- start start 2024-04-25T08:49:21.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8c08aac640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c040cc6c0 0x7f8c04071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8c08aac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c0415b320 0x7f8c04071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8c08aac640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c04071ed0 con 0x7f8c0413d190 2024-04-25T08:49:21.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8c08aac640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c04071cb0 con 0x7f8c040cc6c0 2024-04-25T08:49:21.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8c08aac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0413d570 con 0x7f8c0415b320 2024-04-25T08:49:21.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8bfbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c040cc6c0 0x7f8c04071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8bfbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c040cc6c0 0x7f8c04071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54938/0 (socket says 172.21.15.172:54938) 2024-04-25T08:49:21.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8bfbfff640 1 -- 172.21.15.172:0/3769074094 learned_addr learned my addr 172.21.15.172:0/3769074094 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:21.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8c02d9d640 1 --2- 172.21.15.172:0/3769074094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c0415b320 0x7f8c04071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8bfbfff640 1 -- 172.21.15.172:0/3769074094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c0415b320 msgr2=0x7f8c04071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:21.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8bfbfff640 1 --2- 172.21.15.172:0/3769074094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c0415b320 0x7f8c04071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8bfbfff640 1 -- 172.21.15.172:0/3769074094 >> v1:172.21.15.186:6789/0 conn(0x7f8c0413d190 legacy=0x7f8c040cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.855+0000 7f8bfbfff640 1 -- 172.21.15.172:0/3769074094 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0415a840 con 0x7f8c040cc6c0 2024-04-25T08:49:21.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.856+0000 7f8bfbfff640 1 --2- 172.21.15.172:0/3769074094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c040cc6c0 0x7f8c04071230 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009870 tx=0x7f8bec02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dde9afa8bb0979 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:21.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.856+0000 7f8c01d9b640 1 -- 172.21.15.172:0/3769074094 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec037070 con 0x7f8c040cc6c0 2024-04-25T08:49:21.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.856+0000 7f8c01d9b640 1 -- 172.21.15.172:0/3769074094 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec032440 con 0x7f8c040cc6c0 2024-04-25T08:49:21.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.856+0000 7f8c01d9b640 1 -- 172.21.15.172:0/3769074094 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec032810 con 0x7f8c040cc6c0 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.857+0000 7f8c08aac640 1 -- 172.21.15.172:0/3769074094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c040cc6c0 msgr2=0x7f8c04071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.857+0000 7f8c08aac640 1 --2- 172.21.15.172:0/3769074094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c040cc6c0 0x7f8c04071230 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009870 tx=0x7f8bec02a1c0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.857+0000 7f8c08aac640 1 -- 172.21.15.172:0/3769074094 shutdown_connections 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.857+0000 7f8c08aac640 1 --2- 172.21.15.172:0/3769074094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c0415b320 0x7f8c04071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.857+0000 7f8c08aac640 1 --2- 172.21.15.172:0/3769074094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c040cc6c0 0x7f8c04071230 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.857+0000 7f8c08aac640 1 -- 172.21.15.172:0/3769074094 >> 172.21.15.172:0/3769074094 conn(0x7f8c0406abe0 msgr2=0x7f8c0406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.857+0000 7f8c08aac640 1 -- 172.21.15.172:0/3769074094 shutdown_connections 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.857+0000 7f8c08aac640 1 -- 172.21.15.172:0/3769074094 wait complete. 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.858+0000 7f8c08aac640 1 Processor -- start 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.858+0000 7f8c08aac640 1 -- start start 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c08aac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c040cc6c0 0x7f8c04139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c08aac640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c0413d190 0x7f8c04157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c08aac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c0415b320 0x7f8c0415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c08aac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040cf620 con 0x7f8c0415b320 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c08aac640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0415ae00 con 0x7f8c0413d190 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c08aac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040cf7a0 con 0x7f8c040cc6c0 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c02d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c0415b320 0x7f8c0415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c02d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c0415b320 0x7f8c0415ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54946/0 (socket says 172.21.15.172:54946) 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c02d9d640 1 -- 172.21.15.172:0/1851483974 learned_addr learned my addr 172.21.15.172:0/1851483974 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8bfbfff640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c0413d190 0x7f8c04157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c0259c640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c040cc6c0 0x7f8c04139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c02d9d640 1 -- 172.21.15.172:0/1851483974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c040cc6c0 msgr2=0x7f8c04139aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c02d9d640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c040cc6c0 0x7f8c04139aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c02d9d640 1 -- 172.21.15.172:0/1851483974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c0413d190 msgr2=0x7f8c04157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c02d9d640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c0413d190 0x7f8c04157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:21.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c02d9d640 1 -- 172.21.15.172:0/1851483974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04154050 con 0x7f8c0415b320 2024-04-25T08:49:21.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c02d9d640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c0415b320 0x7f8c0415ca90 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00efc0 tx=0x7f8bfc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:21.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8bfaffd640 1 -- 172.21.15.172:0/1851483974 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc018020 con 0x7f8c0415b320 2024-04-25T08:49:21.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8bfaffd640 1 -- 172.21.15.172:0/1851483974 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc014480 con 0x7f8c0415b320 2024-04-25T08:49:21.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c08aac640 1 -- 172.21.15.172:0/1851483974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c040b1520 con 0x7f8c0415b320 2024-04-25T08:49:21.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8bfaffd640 1 -- 172.21.15.172:0/1851483974 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc014870 con 0x7f8c0415b320 2024-04-25T08:49:21.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.859+0000 7f8c08aac640 1 -- 172.21.15.172:0/1851483974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c040b1ae0 con 0x7f8c0415b320 2024-04-25T08:49:21.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.860+0000 7f8c08aac640 1 -- 172.21.15.172:0/1851483974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c040b2000 con 0x7f8c0415b320 2024-04-25T08:49:21.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.861+0000 7f8bfaffd640 1 -- 172.21.15.172:0/1851483974 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8bfc005d10 con 0x7f8c0415b320 2024-04-25T08:49:21.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.861+0000 7f8bfaffd640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8be406b4d0 0x7f8be406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:21.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.861+0000 7f8c0259c640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8be406b4d0 0x7f8be406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:21.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.861+0000 7f8bfaffd640 1 -- 172.21.15.172:0/1851483974 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8bfc08ade0 con 0x7f8c0415b320 2024-04-25T08:49:21.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.862+0000 7f8c0259c640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8be406b4d0 0x7f8be406d990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4001640 tx=0x7f8bf4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:21.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:21.865+0000 7f8bfaffd640 1 -- 172.21.15.172:0/1851483974 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c040b2000 con 0x7f8c0415b320 2024-04-25T08:49:22.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.034+0000 7f8c08aac640 1 -- 172.21.15.172:0/1851483974 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c040b1e30 con 0x7f8be406b4d0 2024-04-25T08:49:22.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.040+0000 7f8bfaffd640 1 -- 172.21.15.172:0/1851483974 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241078 (secure 0 0 0) 0x7f8c040b1e30 con 0x7f8be406b4d0 2024-04-25T08:49:22.033 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:22.034 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:49:22.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 -- 172.21.15.172:0/1851483974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8be406b4d0 msgr2=0x7f8be406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8be406b4d0 0x7f8be406d990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4001640 tx=0x7f8bf4009040 comp rx=0 tx=0).stop 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 -- 172.21.15.172:0/1851483974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c0415b320 msgr2=0x7f8c0415ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c0415b320 0x7f8c0415ca90 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00efc0 tx=0x7f8bfc00c490 comp rx=0 tx=0).stop 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 -- 172.21.15.172:0/1851483974 shutdown_connections 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8be406b4d0 0x7f8be406d990 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c0413d190 0x7f8c04157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c0415b320 0x7f8c0415ca90 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 --2- 172.21.15.172:0/1851483974 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c040cc6c0 0x7f8c04139aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 -- 172.21.15.172:0/1851483974 >> 172.21.15.172:0/1851483974 conn(0x7f8c0406abe0 msgr2=0x7f8c04159430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 -- 172.21.15.172:0/1851483974 shutdown_connections 2024-04-25T08:49:22.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:22.043+0000 7f8c08aac640 1 -- 172.21.15.172:0/1851483974 wait complete. 2024-04-25T08:49:22.046 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-04-25T08:49:20.597708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":369008,"kb_used_data":11256,"kb_used_omap":12,"kb_used_meta":357619,"kb_avail":754605712,"statfs":{"total":773094113280,"available":772716249088,"internally_reserved":0,"allocated":11526144,"data_stored":5961727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":366202416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905853"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409655+0000","last_change":"2024-04-25T08:49:17.740216+0000","last_active":"2024-04-25T08:49:19.409655+0000","last_peered":"2024-04-25T08:49:19.409655+0000","last_clean":"2024-04-25T08:49:19.409655+0000","last_became_active":"2024-04-25T08:49:17.739849+0000","last_became_peered":"2024-04-25T08:49:17.739849+0000","last_unstale":"2024-04-25T08:49:19.409655+0000","last_undegraded":"2024-04-25T08:49:19.409655+0000","last_fullsized":"2024-04-25T08:49:19.409655+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:13.994651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722296+0000","last_change":"2024-04-25T08:49:17.747710+0000","last_active":"2024-04-25T08:49:18.722296+0000","last_peered":"2024-04-25T08:49:18.722296+0000","last_clean":"2024-04-25T08:49:18.722296+0000","last_became_active":"2024-04-25T08:49:17.747407+0000","last_became_peered":"2024-04-25T08:49:17.747407+0000","last_unstale":"2024-04-25T08:49:18.722296+0000","last_undegraded":"2024-04-25T08:49:18.722296+0000","last_fullsized":"2024-04-25T08:49:18.722296+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:22.674559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409585+0000","last_change":"2024-04-25T08:49:17.726362+0000","last_active":"2024-04-25T08:49:19.409585+0000","last_peered":"2024-04-25T08:49:19.409585+0000","last_clean":"2024-04-25T08:49:19.409585+0000","last_became_active":"2024-04-25T08:49:17.725965+0000","last_became_peered":"2024-04-25T08:49:17.725965+0000","last_unstale":"2024-04-25T08:49:19.409585+0000","last_undegraded":"2024-04-25T08:49:19.409585+0000","last_fullsized":"2024-04-25T08:49:19.409585+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:30.493678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722456+0000","last_change":"2024-04-25T08:49:17.736872+0000","last_active":"2024-04-25T08:49:18.722456+0000","last_peered":"2024-04-25T08:49:18.722456+0000","last_clean":"2024-04-25T08:49:18.722456+0000","last_became_active":"2024-04-25T08:49:17.736604+0000","last_became_peered":"2024-04-25T08:49:17.736604+0000","last_unstale":"2024-04-25T08:49:18.722456+0000","last_undegraded":"2024-04-25T08:49:18.722456+0000","last_fullsized":"2024-04-25T08:49:18.722456+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:18.968390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"106'4","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409944+0000","last_change":"2024-04-25T08:49:16.709134+0000","last_active":"2024-04-25T08:49:19.409944+0000","last_peered":"2024-04-25T08:49:19.409944+0000","last_clean":"2024-04-25T08:49:19.409944+0000","last_became_active":"2024-04-25T08:49:16.708639+0000","last_became_peered":"2024-04-25T08:49:16.708639+0000","last_unstale":"2024-04-25T08:49:19.409944+0000","last_undegraded":"2024-04-25T08:49:19.409944+0000","last_fullsized":"2024-04-25T08:49:19.409944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:03.975037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722409+0000","last_change":"2024-04-25T08:49:17.740392+0000","last_active":"2024-04-25T08:49:18.722409+0000","last_peered":"2024-04-25T08:49:18.722409+0000","last_clean":"2024-04-25T08:49:18.722409+0000","last_became_active":"2024-04-25T08:49:17.739619+0000","last_became_peered":"2024-04-25T08:49:17.739619+0000","last_unstale":"2024-04-25T08:49:18.722409+0000","last_undegraded":"2024-04-25T08:49:18.722409+0000","last_fullsized":"2024-04-25T08:49:18.722409+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:44.615111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409784+0000","last_change":"2024-04-25T08:49:17.736418+0000","last_active":"2024-04-25T08:49:19.409784+0000","last_peered":"2024-04-25T08:49:19.409784+0000","last_clean":"2024-04-25T08:49:19.409784+0000","last_became_active":"2024-04-25T08:49:17.735998+0000","last_became_peered":"2024-04-25T08:49:17.735998+0000","last_unstale":"2024-04-25T08:49:19.409784+0000","last_undegraded":"2024-04-25T08:49:19.409784+0000","last_fullsized":"2024-04-25T08:49:19.409784+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:17.881581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.704241+0000","last_change":"2024-04-25T08:49:15.704241+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.704241+0000","last_undegraded":"2024-04-25T08:49:15.704241+0000","last_fullsized":"2024-04-25T08:49:15.704241+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721906+0000","last_change":"2024-04-25T08:49:16.710332+0000","last_active":"2024-04-25T08:49:18.721906+0000","last_peered":"2024-04-25T08:49:18.721906+0000","last_clean":"2024-04-25T08:49:18.721906+0000","last_became_active":"2024-04-25T08:49:16.710022+0000","last_became_peered":"2024-04-25T08:49:16.710022+0000","last_unstale":"2024-04-25T08:49:18.721906+0000","last_undegraded":"2024-04-25T08:49:18.721906+0000","last_fullsized":"2024-04-25T08:49:18.721906+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:40.668279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409950+0000","last_change":"2024-04-25T08:49:17.729394+0000","last_active":"2024-04-25T08:49:19.409950+0000","last_peered":"2024-04-25T08:49:19.409950+0000","last_clean":"2024-04-25T08:49:19.409950+0000","last_became_active":"2024-04-25T08:49:17.728130+0000","last_became_peered":"2024-04-25T08:49:17.728130+0000","last_unstale":"2024-04-25T08:49:19.409950+0000","last_undegraded":"2024-04-25T08:49:19.409950+0000","last_fullsized":"2024-04-25T08:49:19.409950+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:28.345178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409460+0000","last_change":"2024-04-25T08:49:16.709288+0000","last_active":"2024-04-25T08:49:19.409460+0000","last_peered":"2024-04-25T08:49:19.409460+0000","last_clean":"2024-04-25T08:49:19.409460+0000","last_became_active":"2024-04-25T08:49:16.707237+0000","last_became_peered":"2024-04-25T08:49:16.707237+0000","last_unstale":"2024-04-25T08:49:19.409460+0000","last_undegraded":"2024-04-25T08:49:19.409460+0000","last_fullsized":"2024-04-25T08:49:19.409460+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:07.367751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.705347+0000","last_change":"2024-04-25T08:49:15.705347+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.705347+0000","last_undegraded":"2024-04-25T08:49:15.705347+0000","last_fullsized":"2024-04-25T08:49:15.705347+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698445+0000","last_change":"2024-04-25T08:49:15.698445+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698445+0000","last_undegraded":"2024-04-25T08:49:15.698445+0000","last_fullsized":"2024-04-25T08:49:15.698445+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721938+0000","last_change":"2024-04-25T08:49:17.734692+0000","last_active":"2024-04-25T08:49:18.721938+0000","last_peered":"2024-04-25T08:49:18.721938+0000","last_clean":"2024-04-25T08:49:18.721938+0000","last_became_active":"2024-04-25T08:49:17.734182+0000","last_became_peered":"2024-04-25T08:49:17.734182+0000","last_unstale":"2024-04-25T08:49:18.721938+0000","last_undegraded":"2024-04-25T08:49:18.721938+0000","last_fullsized":"2024-04-25T08:49:18.721938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:46.183230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409430+0000","last_change":"2024-04-25T08:49:16.706179+0000","last_active":"2024-04-25T08:49:19.409430+0000","last_peered":"2024-04-25T08:49:19.409430+0000","last_clean":"2024-04-25T08:49:19.409430+0000","last_became_active":"2024-04-25T08:49:16.705248+0000","last_became_peered":"2024-04-25T08:49:16.705248+0000","last_unstale":"2024-04-25T08:49:19.409430+0000","last_undegraded":"2024-04-25T08:49:19.409430+0000","last_fullsized":"2024-04-25T08:49:19.409430+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:21.345771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698510+0000","last_change":"2024-04-25T08:49:15.698510+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698510+0000","last_undegraded":"2024-04-25T08:49:15.698510+0000","last_fullsized":"2024-04-25T08:49:15.698510+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.704252+0000","last_change":"2024-04-25T08:49:15.704252+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.704252+0000","last_undegraded":"2024-04-25T08:49:15.704252+0000","last_fullsized":"2024-04-25T08:49:15.704252+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722040+0000","last_change":"2024-04-25T08:49:16.709045+0000","last_active":"2024-04-25T08:49:18.722040+0000","last_peered":"2024-04-25T08:49:18.722040+0000","last_clean":"2024-04-25T08:49:18.722040+0000","last_became_active":"2024-04-25T08:49:16.708749+0000","last_became_peered":"2024-04-25T08:49:16.708749+0000","last_unstale":"2024-04-25T08:49:18.722040+0000","last_undegraded":"2024-04-25T08:49:18.722040+0000","last_fullsized":"2024-04-25T08:49:18.722040+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:41.671204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409789+0000","last_change":"2024-04-25T08:49:17.743976+0000","last_active":"2024-04-25T08:49:19.409789+0000","last_peered":"2024-04-25T08:49:19.409789+0000","last_clean":"2024-04-25T08:49:19.409789+0000","last_became_active":"2024-04-25T08:49:17.743708+0000","last_became_peered":"2024-04-25T08:49:17.743708+0000","last_unstale":"2024-04-25T08:49:19.409789+0000","last_undegraded":"2024-04-25T08:49:19.409789+0000","last_fullsized":"2024-04-25T08:49:19.409789+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:23.966690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.699002+0000","last_change":"2024-04-25T08:49:15.699002+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.699002+0000","last_undegraded":"2024-04-25T08:49:15.699002+0000","last_fullsized":"2024-04-25T08:49:15.699002+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409425+0000","last_change":"2024-04-25T08:49:17.743472+0000","last_active":"2024-04-25T08:49:19.409425+0000","last_peered":"2024-04-25T08:49:19.409425+0000","last_clean":"2024-04-25T08:49:19.409425+0000","last_became_active":"2024-04-25T08:49:17.743158+0000","last_became_peered":"2024-04-25T08:49:17.743158+0000","last_unstale":"2024-04-25T08:49:19.409425+0000","last_undegraded":"2024-04-25T08:49:19.409425+0000","last_fullsized":"2024-04-25T08:49:19.409425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:14.288500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698472+0000","last_change":"2024-04-25T08:49:15.698472+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698472+0000","last_undegraded":"2024-04-25T08:49:15.698472+0000","last_fullsized":"2024-04-25T08:49:15.698472+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722255+0000","last_change":"2024-04-25T08:49:17.735470+0000","last_active":"2024-04-25T08:49:18.722255+0000","last_peered":"2024-04-25T08:49:18.722255+0000","last_clean":"2024-04-25T08:49:18.722255+0000","last_became_active":"2024-04-25T08:49:17.735219+0000","last_became_peered":"2024-04-25T08:49:17.735219+0000","last_unstale":"2024-04-25T08:49:18.722255+0000","last_undegraded":"2024-04-25T08:49:18.722255+0000","last_fullsized":"2024-04-25T08:49:18.722255+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:07.433714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:16.690964+0000","last_change":"2024-04-25T08:49:16.690964+0000","last_active":"2024-04-25T08:49:16.690964+0000","last_peered":"2024-04-25T08:49:16.690964+0000","last_clean":"2024-04-25T08:49:16.690964+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:16.690964+0000","last_undegraded":"2024-04-25T08:49:16.690964+0000","last_fullsized":"2024-04-25T08:49:16.690964+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"creating+peering","last_fresh":"2024-04-25T08:49:15.698434+0000","last_change":"2024-04-25T08:49:15.698434+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.698434+0000","last_undegraded":"2024-04-25T08:49:15.698434+0000","last_fullsized":"2024-04-25T08:49:15.698434+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722589+0000","last_change":"2024-04-25T08:49:17.738471+0000","last_active":"2024-04-25T08:49:18.722589+0000","last_peered":"2024-04-25T08:49:18.722589+0000","last_clean":"2024-04-25T08:49:18.722589+0000","last_became_active":"2024-04-25T08:49:17.738191+0000","last_became_peered":"2024-04-25T08:49:17.738191+0000","last_unstale":"2024-04-25T08:49:18.722589+0000","last_undegraded":"2024-04-25T08:49:18.722589+0000","last_fullsized":"2024-04-25T08:49:18.722589+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:14.288500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721802+0000","last_change":"2024-04-25T08:49:17.730576+0000","last_active":"2024-04-25T08:49:18.721802+0000","last_peered":"2024-04-25T08:49:18.721802+0000","last_clean":"2024-04-25T08:49:18.721802+0000","last_became_active":"2024-04-25T08:49:17.730275+0000","last_became_peered":"2024-04-25T08:49:17.730275+0000","last_unstale":"2024-04-25T08:49:18.721802+0000","last_undegraded":"2024-04-25T08:49:18.721802+0000","last_fullsized":"2024-04-25T08:49:18.721802+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:18.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:49:15.689228+0000","last_change":"2024-04-25T08:49:15.689228+0000","last_active":"2024-04-25T08:49:15.689228+0000","last_peered":"2024-04-25T08:49:15.689228+0000","last_clean":"2024-04-25T08:49:15.689228+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:49:15.689228+0000","last_undegraded":"2024-04-25T08:49:15.689228+0000","last_fullsized":"2024-04-25T08:49:15.689228+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":325,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T08:49:15.705622+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:49:15.705622+0000","last_peered":"2024-04-25T08:49:15.705622+0000","last_clean":"2024-04-25T08:49:15.705622+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:49:15.705622+0000","last_undegraded":"2024-04-25T08:49:15.705622+0000","last_fullsized":"2024-04-25T08:49:15.705622+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":2},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":26,"acting":26,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41340,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330500,"statfs":{"total":96636764160,"available":96594432000,"internally_reserved":0,"allocated":1884160,"data_stored":1186582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46328,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325512,"statfs":{"total":96636764160,"available":96589324288,"internally_reserved":0,"allocated":1290240,"data_stored":596214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40804,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331036,"statfs":{"total":96636764160,"available":96594980864,"internally_reserved":0,"allocated":1327104,"data_stored":616740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50488,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321352,"statfs":{"total":96636764160,"available":96585064448,"internally_reserved":0,"allocated":1277952,"data_stored":590005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50528,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321312,"statfs":{"total":96636764160,"available":96585023488,"internally_reserved":0,"allocated":1331200,"data_stored":617322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46316,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325524,"statfs":{"total":96636764160,"available":96589336576,"internally_reserved":0,"allocated":1277952,"data_stored":590005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46304,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325536,"statfs":{"total":96636764160,"available":96589348864,"internally_reserved":0,"allocated":1265664,"data_stored":584486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46900,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324940,"statfs":{"total":96636764160,"available":96588738560,"internally_reserved":0,"allocated":1871872,"data_stored":1180373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:49:22.962 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T08:49:22.971+0000 7f396298f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:49:25.051 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:49:25.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.172+0000 7f3c3acac640 1 Processor -- start 2024-04-25T08:49:25.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.172+0000 7f3c3acac640 1 -- start start 2024-04-25T08:49:25.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c3acac640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3c3406b1a0 0x7f3c3406f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c3acac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c3406b580 0x7f3c340cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c3acac640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c34161960 con 0x7f3c340cffa0 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c3acac640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c340d0430 con 0x7f3c3406b1a0 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c3acac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340cbd50 con 0x7f3c3406b580 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c38a48640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3c3406b1a0 0x7f3c3406f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c38a48640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3c3406b1a0 0x7f3c3406f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54962/0 (socket says 172.21.15.172:54962) 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c38a48640 1 -- 172.21.15.172:0/3045885168 learned_addr learned my addr 172.21.15.172:0/3045885168 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c38a48640 1 -- 172.21.15.172:0/3045885168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c3406b580 msgr2=0x7f3c340cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c33fff640 1 --2- 172.21.15.172:0/3045885168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c3406b580 0x7f3c340cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c38a48640 1 --2- 172.21.15.172:0/3045885168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c3406b580 0x7f3c340cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c38a48640 1 -- 172.21.15.172:0/3045885168 >> v1:172.21.15.186:6789/0 conn(0x7f3c340cffa0 legacy=0x7f3c3406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c38a48640 1 -- 172.21.15.172:0/3045885168 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34161c40 con 0x7f3c3406b1a0 2024-04-25T08:49:25.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.173+0000 7f3c33fff640 1 --2- 172.21.15.172:0/3045885168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c3406b580 0x7f3c340cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.174+0000 7f3c38a48640 1 --2- 172.21.15.172:0/3045885168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 0x7f3c3406f9c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009870 tx=0x7f3c2802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb0db8d41799fee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.174+0000 7f3c337fe640 1 -- 172.21.15.172:0/3045885168 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28037070 con 0x7f3c3406b1a0 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.174+0000 7f3c337fe640 1 -- 172.21.15.172:0/3045885168 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28032440 con 0x7f3c3406b1a0 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.174+0000 7f3c337fe640 1 -- 172.21.15.172:0/3045885168 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28032810 con 0x7f3c3406b1a0 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.175+0000 7f3c3acac640 1 -- 172.21.15.172:0/3045885168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 msgr2=0x7f3c3406f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.175+0000 7f3c3acac640 1 --2- 172.21.15.172:0/3045885168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 0x7f3c3406f9c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009870 tx=0x7f3c2802a180 comp rx=0 tx=0).stop 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.175+0000 7f3c3acac640 1 -- 172.21.15.172:0/3045885168 shutdown_connections 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.175+0000 7f3c3acac640 1 --2- 172.21.15.172:0/3045885168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c3406b580 0x7f3c340cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.175+0000 7f3c3acac640 1 --2- 172.21.15.172:0/3045885168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 0x7f3c3406f9c0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.175+0000 7f3c3acac640 1 -- 172.21.15.172:0/3045885168 >> 172.21.15.172:0/3045885168 conn(0x7f3c340b2220 msgr2=0x7f3c340b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.175+0000 7f3c3acac640 1 -- 172.21.15.172:0/3045885168 shutdown_connections 2024-04-25T08:49:25.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.175+0000 7f3c3acac640 1 -- 172.21.15.172:0/3045885168 wait complete. 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.176+0000 7f3c3acac640 1 Processor -- start 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.176+0000 7f3c3acac640 1 -- start start 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c3acac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 0x7f3c340c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c3acac640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c3406b580 0x7f3c34155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c3acac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c340cffa0 0x7f3c341590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c3acac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34162720 con 0x7f3c3406b1a0 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c3acac640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34162200 con 0x7f3c3406b580 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c3acac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34070330 con 0x7f3c340cffa0 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c38a48640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 0x7f3c340c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c38a48640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 0x7f3c340c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54970/0 (socket says 172.21.15.172:54970) 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c38a48640 1 -- 172.21.15.172:0/910649826 learned_addr learned my addr 172.21.15.172:0/910649826 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:25.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c33fff640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c3406b580 0x7f3c34155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c39249640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c340cffa0 0x7f3c341590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c38a48640 1 -- 172.21.15.172:0/910649826 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c340cffa0 msgr2=0x7f3c341590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c38a48640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c340cffa0 0x7f3c341590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c38a48640 1 -- 172.21.15.172:0/910649826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c3406b580 msgr2=0x7f3c34155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c38a48640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c3406b580 0x7f3c34155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c38a48640 1 -- 172.21.15.172:0/910649826 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340c6640 con 0x7f3c3406b1a0 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c39249640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c340cffa0 0x7f3c341590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.177+0000 7f3c38a48640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 0x7f3c340c6100 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f3c28000c00 tx=0x7f3c280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.178+0000 7f3c317fa640 1 -- 172.21.15.172:0/910649826 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28037040 con 0x7f3c3406b1a0 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.178+0000 7f3c317fa640 1 -- 172.21.15.172:0/910649826 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28042070 con 0x7f3c3406b1a0 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.178+0000 7f3c317fa640 1 -- 172.21.15.172:0/910649826 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28030bd0 con 0x7f3c3406b1a0 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.178+0000 7f3c3acac640 1 -- 172.21.15.172:0/910649826 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c341562a0 con 0x7f3c3406b1a0 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.178+0000 7f3c3acac640 1 -- 172.21.15.172:0/910649826 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3415e230 con 0x7f3c3406b1a0 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.179+0000 7f3c3acac640 1 -- 172.21.15.172:0/910649826 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c340af9c0 con 0x7f3c3406b1a0 2024-04-25T08:49:25.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.179+0000 7f3c317fa640 1 -- 172.21.15.172:0/910649826 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3c28047460 con 0x7f3c3406b1a0 2024-04-25T08:49:25.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.179+0000 7f3c317fa640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3c1806b4d0 0x7f3c1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.180+0000 7f3c317fa640 1 -- 172.21.15.172:0/910649826 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3c280aaff0 con 0x7f3c3406b1a0 2024-04-25T08:49:25.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.180+0000 7f3c33fff640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3c1806b4d0 0x7f3c1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.180+0000 7f3c33fff640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3c1806b4d0 0x7f3c1806d990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3c340ce120 tx=0x7f3c20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:25.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.184+0000 7f3c317fa640 1 -- 172.21.15.172:0/910649826 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3c28045360 con 0x7f3c3406b1a0 2024-04-25T08:49:25.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.353+0000 7f3c3acac640 1 -- 172.21.15.172:0/910649826 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c3406ba50 con 0x7f3c1806b4d0 2024-04-25T08:49:25.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.359+0000 7f3c317fa640 1 -- 172.21.15.172:0/910649826 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252484 (secure 0 0 0) 0x7f3c3406ba50 con 0x7f3c1806b4d0 2024-04-25T08:49:25.353 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:25.354 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:49:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 -- 172.21.15.172:0/910649826 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3c1806b4d0 msgr2=0x7f3c1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3c1806b4d0 0x7f3c1806d990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3c340ce120 tx=0x7f3c20008040 comp rx=0 tx=0).stop 2024-04-25T08:49:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 -- 172.21.15.172:0/910649826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 msgr2=0x7f3c340c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 0x7f3c340c6100 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f3c28000c00 tx=0x7f3c280046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 -- 172.21.15.172:0/910649826 shutdown_connections 2024-04-25T08:49:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3c1806b4d0 0x7f3c1806d990 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c3406b580 0x7f3c34155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c340cffa0 0x7f3c341590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 --2- 172.21.15.172:0/910649826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3406b1a0 0x7f3c340c6100 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 -- 172.21.15.172:0/910649826 >> 172.21.15.172:0/910649826 conn(0x7f3c340b2220 msgr2=0x7f3c340cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 -- 172.21.15.172:0/910649826 shutdown_connections 2024-04-25T08:49:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.362+0000 7f3c3acac640 1 -- 172.21.15.172:0/910649826 wait complete. 2024-04-25T08:49:25.364 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-04-25T08:49:24.598648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":369340,"kb_used_data":11592,"kb_used_omap":12,"kb_used_meta":357619,"kb_avail":754605380,"statfs":{"total":773094113280,"available":772715909120,"internally_reserved":0,"allocated":11870208,"data_stored":6119476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":366202416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.904825"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720847+0000","last_change":"2024-04-25T08:49:17.730310+0000","last_active":"2024-04-25T08:49:18.720847+0000","last_peered":"2024-04-25T08:49:18.720847+0000","last_clean":"2024-04-25T08:49:18.720847+0000","last_became_active":"2024-04-25T08:49:17.730056+0000","last_became_peered":"2024-04-25T08:49:17.730056+0000","last_unstale":"2024-04-25T08:49:18.720847+0000","last_undegraded":"2024-04-25T08:49:18.720847+0000","last_fullsized":"2024-04-25T08:49:18.720847+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:19.168520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410569+0000","last_change":"2024-04-25T08:49:17.748916+0000","last_active":"2024-04-25T08:49:19.410569+0000","last_peered":"2024-04-25T08:49:19.410569+0000","last_clean":"2024-04-25T08:49:19.410569+0000","last_became_active":"2024-04-25T08:49:17.748574+0000","last_became_peered":"2024-04-25T08:49:17.748574+0000","last_unstale":"2024-04-25T08:49:19.410569+0000","last_undegraded":"2024-04-25T08:49:19.410569+0000","last_fullsized":"2024-04-25T08:49:19.410569+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:44.694926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720715+0000","last_change":"2024-04-25T08:49:17.742597+0000","last_active":"2024-04-25T08:49:18.720715+0000","last_peered":"2024-04-25T08:49:18.720715+0000","last_clean":"2024-04-25T08:49:18.720715+0000","last_became_active":"2024-04-25T08:49:17.742331+0000","last_became_peered":"2024-04-25T08:49:17.742331+0000","last_unstale":"2024-04-25T08:49:18.720715+0000","last_undegraded":"2024-04-25T08:49:18.720715+0000","last_fullsized":"2024-04-25T08:49:18.720715+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:19.703991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409655+0000","last_change":"2024-04-25T08:49:17.740216+0000","last_active":"2024-04-25T08:49:19.409655+0000","last_peered":"2024-04-25T08:49:19.409655+0000","last_clean":"2024-04-25T08:49:19.409655+0000","last_became_active":"2024-04-25T08:49:17.739849+0000","last_became_peered":"2024-04-25T08:49:17.739849+0000","last_unstale":"2024-04-25T08:49:19.409655+0000","last_undegraded":"2024-04-25T08:49:19.409655+0000","last_fullsized":"2024-04-25T08:49:19.409655+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:13.994651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409716+0000","last_change":"2024-04-25T08:49:17.740308+0000","last_active":"2024-04-25T08:49:19.409716+0000","last_peered":"2024-04-25T08:49:19.409716+0000","last_clean":"2024-04-25T08:49:19.409716+0000","last_became_active":"2024-04-25T08:49:17.740061+0000","last_became_peered":"2024-04-25T08:49:17.740061+0000","last_unstale":"2024-04-25T08:49:19.409716+0000","last_undegraded":"2024-04-25T08:49:19.409716+0000","last_fullsized":"2024-04-25T08:49:19.409716+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:49.107307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410335+0000","last_change":"2024-04-25T08:49:17.741428+0000","last_active":"2024-04-25T08:49:19.410335+0000","last_peered":"2024-04-25T08:49:19.410335+0000","last_clean":"2024-04-25T08:49:19.410335+0000","last_became_active":"2024-04-25T08:49:17.741178+0000","last_became_peered":"2024-04-25T08:49:17.741178+0000","last_unstale":"2024-04-25T08:49:19.410335+0000","last_undegraded":"2024-04-25T08:49:19.410335+0000","last_fullsized":"2024-04-25T08:49:19.410335+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:16.178333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410704+0000","last_change":"2024-04-25T08:49:17.745069+0000","last_active":"2024-04-25T08:49:19.410704+0000","last_peered":"2024-04-25T08:49:19.410704+0000","last_clean":"2024-04-25T08:49:19.410704+0000","last_became_active":"2024-04-25T08:49:17.741032+0000","last_became_peered":"2024-04-25T08:49:17.741032+0000","last_unstale":"2024-04-25T08:49:19.410704+0000","last_undegraded":"2024-04-25T08:49:19.410704+0000","last_fullsized":"2024-04-25T08:49:19.410704+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:30.398694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254854+0000","last_change":"2024-04-25T08:49:17.738930+0000","last_active":"2024-04-25T08:49:19.254854+0000","last_peered":"2024-04-25T08:49:19.254854+0000","last_clean":"2024-04-25T08:49:19.254854+0000","last_became_active":"2024-04-25T08:49:17.738665+0000","last_became_peered":"2024-04-25T08:49:17.738665+0000","last_unstale":"2024-04-25T08:49:19.254854+0000","last_undegraded":"2024-04-25T08:49:19.254854+0000","last_fullsized":"2024-04-25T08:49:19.254854+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:40.081561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410506+0000","last_change":"2024-04-25T08:49:17.742466+0000","last_active":"2024-04-25T08:49:19.410506+0000","last_peered":"2024-04-25T08:49:19.410506+0000","last_clean":"2024-04-25T08:49:19.410506+0000","last_became_active":"2024-04-25T08:49:17.742145+0000","last_became_peered":"2024-04-25T08:49:17.742145+0000","last_unstale":"2024-04-25T08:49:19.410506+0000","last_undegraded":"2024-04-25T08:49:19.410506+0000","last_fullsized":"2024-04-25T08:49:19.410506+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:42.672941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409830+0000","last_change":"2024-04-25T08:49:17.742283+0000","last_active":"2024-04-25T08:49:19.409830+0000","last_peered":"2024-04-25T08:49:19.409830+0000","last_clean":"2024-04-25T08:49:19.409830+0000","last_became_active":"2024-04-25T08:49:17.741974+0000","last_became_peered":"2024-04-25T08:49:17.741974+0000","last_unstale":"2024-04-25T08:49:19.409830+0000","last_undegraded":"2024-04-25T08:49:19.409830+0000","last_fullsized":"2024-04-25T08:49:19.409830+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:00.009128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722296+0000","last_change":"2024-04-25T08:49:17.747710+0000","last_active":"2024-04-25T08:49:18.722296+0000","last_peered":"2024-04-25T08:49:18.722296+0000","last_clean":"2024-04-25T08:49:18.722296+0000","last_became_active":"2024-04-25T08:49:17.747407+0000","last_became_peered":"2024-04-25T08:49:17.747407+0000","last_unstale":"2024-04-25T08:49:18.722296+0000","last_undegraded":"2024-04-25T08:49:18.722296+0000","last_fullsized":"2024-04-25T08:49:18.722296+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:22.674559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722961+0000","last_change":"2024-04-25T08:49:17.738884+0000","last_active":"2024-04-25T08:49:18.722961+0000","last_peered":"2024-04-25T08:49:18.722961+0000","last_clean":"2024-04-25T08:49:18.722961+0000","last_became_active":"2024-04-25T08:49:17.733171+0000","last_became_peered":"2024-04-25T08:49:17.733171+0000","last_unstale":"2024-04-25T08:49:18.722961+0000","last_undegraded":"2024-04-25T08:49:18.722961+0000","last_fullsized":"2024-04-25T08:49:18.722961+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:08.369488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409585+0000","last_change":"2024-04-25T08:49:17.726362+0000","last_active":"2024-04-25T08:49:19.409585+0000","last_peered":"2024-04-25T08:49:19.409585+0000","last_clean":"2024-04-25T08:49:19.409585+0000","last_became_active":"2024-04-25T08:49:17.725965+0000","last_became_peered":"2024-04-25T08:49:17.725965+0000","last_unstale":"2024-04-25T08:49:19.409585+0000","last_undegraded":"2024-04-25T08:49:19.409585+0000","last_fullsized":"2024-04-25T08:49:19.409585+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:30.493678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410063+0000","last_change":"2024-04-25T08:49:17.741809+0000","last_active":"2024-04-25T08:49:19.410063+0000","last_peered":"2024-04-25T08:49:19.410063+0000","last_clean":"2024-04-25T08:49:19.410063+0000","last_became_active":"2024-04-25T08:49:17.741531+0000","last_became_peered":"2024-04-25T08:49:17.741531+0000","last_unstale":"2024-04-25T08:49:19.410063+0000","last_undegraded":"2024-04-25T08:49:19.410063+0000","last_fullsized":"2024-04-25T08:49:19.410063+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:18.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410054+0000","last_change":"2024-04-25T08:49:17.742479+0000","last_active":"2024-04-25T08:49:19.410054+0000","last_peered":"2024-04-25T08:49:19.410054+0000","last_clean":"2024-04-25T08:49:19.410054+0000","last_became_active":"2024-04-25T08:49:17.742202+0000","last_became_peered":"2024-04-25T08:49:17.742202+0000","last_unstale":"2024-04-25T08:49:19.410054+0000","last_undegraded":"2024-04-25T08:49:19.410054+0000","last_fullsized":"2024-04-25T08:49:19.410054+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:46.183230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409980+0000","last_change":"2024-04-25T08:49:17.744746+0000","last_active":"2024-04-25T08:49:19.409980+0000","last_peered":"2024-04-25T08:49:19.409980+0000","last_clean":"2024-04-25T08:49:19.409980+0000","last_became_active":"2024-04-25T08:49:17.744481+0000","last_became_peered":"2024-04-25T08:49:17.744481+0000","last_unstale":"2024-04-25T08:49:19.409980+0000","last_undegraded":"2024-04-25T08:49:19.409980+0000","last_fullsized":"2024-04-25T08:49:19.409980+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:27.110585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720868+0000","last_change":"2024-04-25T08:49:17.743748+0000","last_active":"2024-04-25T08:49:18.720868+0000","last_peered":"2024-04-25T08:49:18.720868+0000","last_clean":"2024-04-25T08:49:18.720868+0000","last_became_active":"2024-04-25T08:49:17.743491+0000","last_became_peered":"2024-04-25T08:49:17.743491+0000","last_unstale":"2024-04-25T08:49:18.720868+0000","last_undegraded":"2024-04-25T08:49:18.720868+0000","last_fullsized":"2024-04-25T08:49:18.720868+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:20.997589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410566+0000","last_change":"2024-04-25T08:49:17.741115+0000","last_active":"2024-04-25T08:49:19.410566+0000","last_peered":"2024-04-25T08:49:19.410566+0000","last_clean":"2024-04-25T08:49:19.410566+0000","last_became_active":"2024-04-25T08:49:17.740753+0000","last_became_peered":"2024-04-25T08:49:17.740753+0000","last_unstale":"2024-04-25T08:49:19.410566+0000","last_undegraded":"2024-04-25T08:49:19.410566+0000","last_fullsized":"2024-04-25T08:49:19.410566+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:42.660105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720864+0000","last_change":"2024-04-25T08:49:17.745176+0000","last_active":"2024-04-25T08:49:18.720864+0000","last_peered":"2024-04-25T08:49:18.720864+0000","last_clean":"2024-04-25T08:49:18.720864+0000","last_became_active":"2024-04-25T08:49:17.744891+0000","last_became_peered":"2024-04-25T08:49:17.744891+0000","last_unstale":"2024-04-25T08:49:18.720864+0000","last_undegraded":"2024-04-25T08:49:18.720864+0000","last_fullsized":"2024-04-25T08:49:18.720864+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:40.465811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722996+0000","last_change":"2024-04-25T08:49:17.740754+0000","last_active":"2024-04-25T08:49:18.722996+0000","last_peered":"2024-04-25T08:49:18.722996+0000","last_clean":"2024-04-25T08:49:18.722996+0000","last_became_active":"2024-04-25T08:49:17.738607+0000","last_became_peered":"2024-04-25T08:49:17.738607+0000","last_unstale":"2024-04-25T08:49:18.722996+0000","last_undegraded":"2024-04-25T08:49:18.722996+0000","last_fullsized":"2024-04-25T08:49:18.722996+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:04.976774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254886+0000","last_change":"2024-04-25T08:49:17.746747+0000","last_active":"2024-04-25T08:49:19.254886+0000","last_peered":"2024-04-25T08:49:19.254886+0000","last_clean":"2024-04-25T08:49:19.254886+0000","last_became_active":"2024-04-25T08:49:17.746292+0000","last_became_peered":"2024-04-25T08:49:17.746292+0000","last_unstale":"2024-04-25T08:49:19.254886+0000","last_undegraded":"2024-04-25T08:49:19.254886+0000","last_fullsized":"2024-04-25T08:49:19.254886+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:20.132903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409970+0000","last_change":"2024-04-25T08:49:17.732598+0000","last_active":"2024-04-25T08:49:19.409970+0000","last_peered":"2024-04-25T08:49:19.409970+0000","last_clean":"2024-04-25T08:49:19.409970+0000","last_became_active":"2024-04-25T08:49:17.731263+0000","last_became_peered":"2024-04-25T08:49:17.731263+0000","last_unstale":"2024-04-25T08:49:19.409970+0000","last_undegraded":"2024-04-25T08:49:19.409970+0000","last_fullsized":"2024-04-25T08:49:19.409970+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:41.670016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720614+0000","last_change":"2024-04-25T08:49:17.741632+0000","last_active":"2024-04-25T08:49:18.720614+0000","last_peered":"2024-04-25T08:49:18.720614+0000","last_clean":"2024-04-25T08:49:18.720614+0000","last_became_active":"2024-04-25T08:49:17.741370+0000","last_became_peered":"2024-04-25T08:49:17.741370+0000","last_unstale":"2024-04-25T08:49:18.720614+0000","last_undegraded":"2024-04-25T08:49:18.720614+0000","last_fullsized":"2024-04-25T08:49:18.720614+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:18.513374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409797+0000","last_change":"2024-04-25T08:49:17.733386+0000","last_active":"2024-04-25T08:49:19.409797+0000","last_peered":"2024-04-25T08:49:19.409797+0000","last_clean":"2024-04-25T08:49:19.409797+0000","last_became_active":"2024-04-25T08:49:17.732959+0000","last_became_peered":"2024-04-25T08:49:17.732959+0000","last_unstale":"2024-04-25T08:49:19.409797+0000","last_undegraded":"2024-04-25T08:49:19.409797+0000","last_fullsized":"2024-04-25T08:49:19.409797+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:32.335950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722306+0000","last_change":"2024-04-25T08:49:17.746972+0000","last_active":"2024-04-25T08:49:18.722306+0000","last_peered":"2024-04-25T08:49:18.722306+0000","last_clean":"2024-04-25T08:49:18.722306+0000","last_became_active":"2024-04-25T08:49:17.746670+0000","last_became_peered":"2024-04-25T08:49:17.746670+0000","last_unstale":"2024-04-25T08:49:18.722306+0000","last_undegraded":"2024-04-25T08:49:18.722306+0000","last_fullsized":"2024-04-25T08:49:18.722306+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:09.640308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722164+0000","last_change":"2024-04-25T08:49:17.744379+0000","last_active":"2024-04-25T08:49:18.722164+0000","last_peered":"2024-04-25T08:49:18.722164+0000","last_clean":"2024-04-25T08:49:18.722164+0000","last_became_active":"2024-04-25T08:49:17.744080+0000","last_became_peered":"2024-04-25T08:49:17.744080+0000","last_unstale":"2024-04-25T08:49:18.722164+0000","last_undegraded":"2024-04-25T08:49:18.722164+0000","last_fullsized":"2024-04-25T08:49:18.722164+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:42.660105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722456+0000","last_change":"2024-04-25T08:49:17.736872+0000","last_active":"2024-04-25T08:49:18.722456+0000","last_peered":"2024-04-25T08:49:18.722456+0000","last_clean":"2024-04-25T08:49:18.722456+0000","last_became_active":"2024-04-25T08:49:17.736604+0000","last_became_peered":"2024-04-25T08:49:17.736604+0000","last_unstale":"2024-04-25T08:49:18.722456+0000","last_undegraded":"2024-04-25T08:49:18.722456+0000","last_fullsized":"2024-04-25T08:49:18.722456+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:18.968390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410818+0000","last_change":"2024-04-25T08:49:17.743081+0000","last_active":"2024-04-25T08:49:19.410818+0000","last_peered":"2024-04-25T08:49:19.410818+0000","last_clean":"2024-04-25T08:49:19.410818+0000","last_became_active":"2024-04-25T08:49:17.742779+0000","last_became_peered":"2024-04-25T08:49:17.742779+0000","last_unstale":"2024-04-25T08:49:19.410818+0000","last_undegraded":"2024-04-25T08:49:19.410818+0000","last_fullsized":"2024-04-25T08:49:19.410818+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:04.976774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.255179+0000","last_change":"2024-04-25T08:49:17.736406+0000","last_active":"2024-04-25T08:49:19.255179+0000","last_peered":"2024-04-25T08:49:19.255179+0000","last_clean":"2024-04-25T08:49:19.255179+0000","last_became_active":"2024-04-25T08:49:17.736002+0000","last_became_peered":"2024-04-25T08:49:17.736002+0000","last_unstale":"2024-04-25T08:49:19.255179+0000","last_undegraded":"2024-04-25T08:49:19.255179+0000","last_fullsized":"2024-04-25T08:49:19.255179+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:18.712969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722301+0000","last_change":"2024-04-25T08:49:17.746929+0000","last_active":"2024-04-25T08:49:18.722301+0000","last_peered":"2024-04-25T08:49:18.722301+0000","last_clean":"2024-04-25T08:49:18.722301+0000","last_became_active":"2024-04-25T08:49:17.746639+0000","last_became_peered":"2024-04-25T08:49:17.746639+0000","last_unstale":"2024-04-25T08:49:18.722301+0000","last_undegraded":"2024-04-25T08:49:18.722301+0000","last_fullsized":"2024-04-25T08:49:18.722301+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:44.694926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410427+0000","last_change":"2024-04-25T08:49:17.743700+0000","last_active":"2024-04-25T08:49:19.410427+0000","last_peered":"2024-04-25T08:49:19.410427+0000","last_clean":"2024-04-25T08:49:19.410427+0000","last_became_active":"2024-04-25T08:49:17.740793+0000","last_became_peered":"2024-04-25T08:49:17.740793+0000","last_unstale":"2024-04-25T08:49:19.410427+0000","last_undegraded":"2024-04-25T08:49:19.410427+0000","last_fullsized":"2024-04-25T08:49:19.410427+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:41.670016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254871+0000","last_change":"2024-04-25T08:49:17.737151+0000","last_active":"2024-04-25T08:49:19.254871+0000","last_peered":"2024-04-25T08:49:19.254871+0000","last_clean":"2024-04-25T08:49:19.254871+0000","last_became_active":"2024-04-25T08:49:17.735603+0000","last_became_peered":"2024-04-25T08:49:17.735603+0000","last_unstale":"2024-04-25T08:49:19.254871+0000","last_undegraded":"2024-04-25T08:49:19.254871+0000","last_fullsized":"2024-04-25T08:49:19.254871+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:01.880897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720799+0000","last_change":"2024-04-25T08:49:17.741162+0000","last_active":"2024-04-25T08:49:18.720799+0000","last_peered":"2024-04-25T08:49:18.720799+0000","last_clean":"2024-04-25T08:49:18.720799+0000","last_became_active":"2024-04-25T08:49:17.740709+0000","last_became_peered":"2024-04-25T08:49:17.740709+0000","last_unstale":"2024-04-25T08:49:18.720799+0000","last_undegraded":"2024-04-25T08:49:18.720799+0000","last_fullsized":"2024-04-25T08:49:18.720799+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:00.317649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"106'4","reported_seq":18,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409944+0000","last_change":"2024-04-25T08:49:16.709134+0000","last_active":"2024-04-25T08:49:19.409944+0000","last_peered":"2024-04-25T08:49:19.409944+0000","last_clean":"2024-04-25T08:49:19.409944+0000","last_became_active":"2024-04-25T08:49:16.708639+0000","last_became_peered":"2024-04-25T08:49:16.708639+0000","last_unstale":"2024-04-25T08:49:19.409944+0000","last_undegraded":"2024-04-25T08:49:19.409944+0000","last_fullsized":"2024-04-25T08:49:19.409944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:03.975037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254936+0000","last_change":"2024-04-25T08:49:17.734972+0000","last_active":"2024-04-25T08:49:19.254936+0000","last_peered":"2024-04-25T08:49:19.254936+0000","last_clean":"2024-04-25T08:49:19.254936+0000","last_became_active":"2024-04-25T08:49:17.734709+0000","last_became_peered":"2024-04-25T08:49:17.734709+0000","last_unstale":"2024-04-25T08:49:19.254936+0000","last_undegraded":"2024-04-25T08:49:19.254936+0000","last_fullsized":"2024-04-25T08:49:19.254936+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:43.762010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254931+0000","last_change":"2024-04-25T08:49:16.706717+0000","last_active":"2024-04-25T08:49:19.254931+0000","last_peered":"2024-04-25T08:49:19.254931+0000","last_clean":"2024-04-25T08:49:19.254931+0000","last_became_active":"2024-04-25T08:49:16.706392+0000","last_became_peered":"2024-04-25T08:49:16.706392+0000","last_unstale":"2024-04-25T08:49:19.254931+0000","last_undegraded":"2024-04-25T08:49:19.254931+0000","last_fullsized":"2024-04-25T08:49:19.254931+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:33.536828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722513+0000","last_change":"2024-04-25T08:49:17.732724+0000","last_active":"2024-04-25T08:49:18.722513+0000","last_peered":"2024-04-25T08:49:18.722513+0000","last_clean":"2024-04-25T08:49:18.722513+0000","last_became_active":"2024-04-25T08:49:17.732397+0000","last_became_peered":"2024-04-25T08:49:17.732397+0000","last_unstale":"2024-04-25T08:49:18.722513+0000","last_undegraded":"2024-04-25T08:49:18.722513+0000","last_fullsized":"2024-04-25T08:49:18.722513+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:30.398694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.723097+0000","last_change":"2024-04-25T08:49:16.710515+0000","last_active":"2024-04-25T08:49:18.723097+0000","last_peered":"2024-04-25T08:49:18.723097+0000","last_clean":"2024-04-25T08:49:18.723097+0000","last_became_active":"2024-04-25T08:49:16.709994+0000","last_became_peered":"2024-04-25T08:49:16.709994+0000","last_unstale":"2024-04-25T08:49:18.723097+0000","last_undegraded":"2024-04-25T08:49:18.723097+0000","last_fullsized":"2024-04-25T08:49:18.723097+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:13.963120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722409+0000","last_change":"2024-04-25T08:49:17.740392+0000","last_active":"2024-04-25T08:49:18.722409+0000","last_peered":"2024-04-25T08:49:18.722409+0000","last_clean":"2024-04-25T08:49:18.722409+0000","last_became_active":"2024-04-25T08:49:17.739619+0000","last_became_peered":"2024-04-25T08:49:17.739619+0000","last_unstale":"2024-04-25T08:49:18.722409+0000","last_undegraded":"2024-04-25T08:49:18.722409+0000","last_fullsized":"2024-04-25T08:49:18.722409+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:44.615111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410106+0000","last_change":"2024-04-25T08:49:16.712925+0000","last_active":"2024-04-25T08:49:19.410106+0000","last_peered":"2024-04-25T08:49:19.410106+0000","last_clean":"2024-04-25T08:49:19.410106+0000","last_became_active":"2024-04-25T08:49:16.712656+0000","last_became_peered":"2024-04-25T08:49:16.712656+0000","last_unstale":"2024-04-25T08:49:19.410106+0000","last_undegraded":"2024-04-25T08:49:19.410106+0000","last_fullsized":"2024-04-25T08:49:19.410106+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.567815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409784+0000","last_change":"2024-04-25T08:49:17.736418+0000","last_active":"2024-04-25T08:49:19.409784+0000","last_peered":"2024-04-25T08:49:19.409784+0000","last_clean":"2024-04-25T08:49:19.409784+0000","last_became_active":"2024-04-25T08:49:17.735998+0000","last_became_peered":"2024-04-25T08:49:17.735998+0000","last_unstale":"2024-04-25T08:49:19.409784+0000","last_undegraded":"2024-04-25T08:49:19.409784+0000","last_fullsized":"2024-04-25T08:49:19.409784+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:52:17.881581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410164+0000","last_change":"2024-04-25T08:49:16.708938+0000","last_active":"2024-04-25T08:49:19.410164+0000","last_peered":"2024-04-25T08:49:19.410164+0000","last_clean":"2024-04-25T08:49:19.410164+0000","last_became_active":"2024-04-25T08:49:16.708655+0000","last_became_peered":"2024-04-25T08:49:16.708655+0000","last_unstale":"2024-04-25T08:49:19.410164+0000","last_undegraded":"2024-04-25T08:49:19.410164+0000","last_fullsized":"2024-04-25T08:49:19.410164+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:08.638571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720993+0000","last_change":"2024-04-25T08:49:17.745514+0000","last_active":"2024-04-25T08:49:18.720993+0000","last_peered":"2024-04-25T08:49:18.720993+0000","last_clean":"2024-04-25T08:49:18.720993+0000","last_became_active":"2024-04-25T08:49:17.744636+0000","last_became_peered":"2024-04-25T08:49:17.744636+0000","last_unstale":"2024-04-25T08:49:18.720993+0000","last_undegraded":"2024-04-25T08:49:18.720993+0000","last_fullsized":"2024-04-25T08:49:18.720993+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:14.093852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721906+0000","last_change":"2024-04-25T08:49:16.710332+0000","last_active":"2024-04-25T08:49:18.721906+0000","last_peered":"2024-04-25T08:49:18.721906+0000","last_clean":"2024-04-25T08:49:18.721906+0000","last_became_active":"2024-04-25T08:49:16.710022+0000","last_became_peered":"2024-04-25T08:49:16.710022+0000","last_unstale":"2024-04-25T08:49:18.721906+0000","last_undegraded":"2024-04-25T08:49:18.721906+0000","last_fullsized":"2024-04-25T08:49:18.721906+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:40.668279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410791+0000","last_change":"2024-04-25T08:49:17.742612+0000","last_active":"2024-04-25T08:49:19.410791+0000","last_peered":"2024-04-25T08:49:19.410791+0000","last_clean":"2024-04-25T08:49:19.410791+0000","last_became_active":"2024-04-25T08:49:17.742342+0000","last_became_peered":"2024-04-25T08:49:17.742342+0000","last_unstale":"2024-04-25T08:49:19.410791+0000","last_undegraded":"2024-04-25T08:49:19.410791+0000","last_fullsized":"2024-04-25T08:49:19.410791+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:08.369488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722116+0000","last_change":"2024-04-25T08:49:16.707247+0000","last_active":"2024-04-25T08:49:18.722116+0000","last_peered":"2024-04-25T08:49:18.722116+0000","last_clean":"2024-04-25T08:49:18.722116+0000","last_became_active":"2024-04-25T08:49:16.706967+0000","last_became_peered":"2024-04-25T08:49:16.706967+0000","last_unstale":"2024-04-25T08:49:18.722116+0000","last_undegraded":"2024-04-25T08:49:18.722116+0000","last_fullsized":"2024-04-25T08:49:18.722116+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:35.776431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409950+0000","last_change":"2024-04-25T08:49:17.729394+0000","last_active":"2024-04-25T08:49:19.409950+0000","last_peered":"2024-04-25T08:49:19.409950+0000","last_clean":"2024-04-25T08:49:19.409950+0000","last_became_active":"2024-04-25T08:49:17.728130+0000","last_became_peered":"2024-04-25T08:49:17.728130+0000","last_unstale":"2024-04-25T08:49:19.409950+0000","last_undegraded":"2024-04-25T08:49:19.409950+0000","last_fullsized":"2024-04-25T08:49:19.409950+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:28.345178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409460+0000","last_change":"2024-04-25T08:49:16.709288+0000","last_active":"2024-04-25T08:49:19.409460+0000","last_peered":"2024-04-25T08:49:19.409460+0000","last_clean":"2024-04-25T08:49:19.409460+0000","last_became_active":"2024-04-25T08:49:16.707237+0000","last_became_peered":"2024-04-25T08:49:16.707237+0000","last_unstale":"2024-04-25T08:49:19.409460+0000","last_undegraded":"2024-04-25T08:49:19.409460+0000","last_fullsized":"2024-04-25T08:49:19.409460+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:07.367751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720634+0000","last_change":"2024-04-25T08:49:17.745711+0000","last_active":"2024-04-25T08:49:18.720634+0000","last_peered":"2024-04-25T08:49:18.720634+0000","last_clean":"2024-04-25T08:49:18.720634+0000","last_became_active":"2024-04-25T08:49:17.744754+0000","last_became_peered":"2024-04-25T08:49:17.744754+0000","last_unstale":"2024-04-25T08:49:18.720634+0000","last_undegraded":"2024-04-25T08:49:18.720634+0000","last_fullsized":"2024-04-25T08:49:18.720634+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:05.827176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722408+0000","last_change":"2024-04-25T08:49:16.710147+0000","last_active":"2024-04-25T08:49:18.722408+0000","last_peered":"2024-04-25T08:49:18.722408+0000","last_clean":"2024-04-25T08:49:18.722408+0000","last_became_active":"2024-04-25T08:49:16.709756+0000","last_became_peered":"2024-04-25T08:49:16.709756+0000","last_unstale":"2024-04-25T08:49:18.722408+0000","last_undegraded":"2024-04-25T08:49:18.722408+0000","last_fullsized":"2024-04-25T08:49:18.722408+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:24.714974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409924+0000","last_change":"2024-04-25T08:49:17.733183+0000","last_active":"2024-04-25T08:49:19.409924+0000","last_peered":"2024-04-25T08:49:19.409924+0000","last_clean":"2024-04-25T08:49:19.409924+0000","last_became_active":"2024-04-25T08:49:17.732884+0000","last_became_peered":"2024-04-25T08:49:17.732884+0000","last_unstale":"2024-04-25T08:49:19.409924+0000","last_undegraded":"2024-04-25T08:49:19.409924+0000","last_fullsized":"2024-04-25T08:49:19.409924+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:42.672941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720602+0000","last_change":"2024-04-25T08:49:16.699841+0000","last_active":"2024-04-25T08:49:18.720602+0000","last_peered":"2024-04-25T08:49:18.720602+0000","last_clean":"2024-04-25T08:49:18.720602+0000","last_became_active":"2024-04-25T08:49:16.699564+0000","last_became_peered":"2024-04-25T08:49:16.699564+0000","last_unstale":"2024-04-25T08:49:18.720602+0000","last_undegraded":"2024-04-25T08:49:18.720602+0000","last_fullsized":"2024-04-25T08:49:18.720602+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:34.242020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254770+0000","last_change":"2024-04-25T08:49:17.743001+0000","last_active":"2024-04-25T08:49:19.254770+0000","last_peered":"2024-04-25T08:49:19.254770+0000","last_clean":"2024-04-25T08:49:19.254770+0000","last_became_active":"2024-04-25T08:49:17.742721+0000","last_became_peered":"2024-04-25T08:49:17.742721+0000","last_unstale":"2024-04-25T08:49:19.254770+0000","last_undegraded":"2024-04-25T08:49:19.254770+0000","last_fullsized":"2024-04-25T08:49:19.254770+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:11.366204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"106'3","reported_seq":17,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410064+0000","last_change":"2024-04-25T08:49:16.712255+0000","last_active":"2024-04-25T08:49:19.410064+0000","last_peered":"2024-04-25T08:49:19.410064+0000","last_clean":"2024-04-25T08:49:19.410064+0000","last_became_active":"2024-04-25T08:49:16.711870+0000","last_became_peered":"2024-04-25T08:49:16.711870+0000","last_unstale":"2024-04-25T08:49:19.410064+0000","last_undegraded":"2024-04-25T08:49:19.410064+0000","last_fullsized":"2024-04-25T08:49:19.410064+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:41.658369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409998+0000","last_change":"2024-04-25T08:49:17.732612+0000","last_active":"2024-04-25T08:49:19.409998+0000","last_peered":"2024-04-25T08:49:19.409998+0000","last_clean":"2024-04-25T08:49:19.409998+0000","last_became_active":"2024-04-25T08:49:17.732361+0000","last_became_peered":"2024-04-25T08:49:17.732361+0000","last_unstale":"2024-04-25T08:49:19.409998+0000","last_undegraded":"2024-04-25T08:49:19.409998+0000","last_fullsized":"2024-04-25T08:49:19.409998+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:42.660105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"106'6","reported_seq":20,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410733+0000","last_change":"2024-04-25T08:49:16.710451+0000","last_active":"2024-04-25T08:49:19.410733+0000","last_peered":"2024-04-25T08:49:19.410733+0000","last_clean":"2024-04-25T08:49:19.410733+0000","last_became_active":"2024-04-25T08:49:16.710171+0000","last_became_peered":"2024-04-25T08:49:16.710171+0000","last_unstale":"2024-04-25T08:49:19.410733+0000","last_undegraded":"2024-04-25T08:49:19.410733+0000","last_fullsized":"2024-04-25T08:49:19.410733+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.567815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721938+0000","last_change":"2024-04-25T08:49:17.734692+0000","last_active":"2024-04-25T08:49:18.721938+0000","last_peered":"2024-04-25T08:49:18.721938+0000","last_clean":"2024-04-25T08:49:18.721938+0000","last_became_active":"2024-04-25T08:49:17.734182+0000","last_became_peered":"2024-04-25T08:49:17.734182+0000","last_unstale":"2024-04-25T08:49:18.721938+0000","last_undegraded":"2024-04-25T08:49:18.721938+0000","last_fullsized":"2024-04-25T08:49:18.721938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:46.183230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410026+0000","last_change":"2024-04-25T08:49:16.711215+0000","last_active":"2024-04-25T08:49:19.410026+0000","last_peered":"2024-04-25T08:49:19.410026+0000","last_clean":"2024-04-25T08:49:19.410026+0000","last_became_active":"2024-04-25T08:49:16.710888+0000","last_became_peered":"2024-04-25T08:49:16.710888+0000","last_unstale":"2024-04-25T08:49:19.410026+0000","last_undegraded":"2024-04-25T08:49:19.410026+0000","last_fullsized":"2024-04-25T08:49:19.410026+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:07.303189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410905+0000","last_change":"2024-04-25T08:49:17.743006+0000","last_active":"2024-04-25T08:49:19.410905+0000","last_peered":"2024-04-25T08:49:19.410905+0000","last_clean":"2024-04-25T08:49:19.410905+0000","last_became_active":"2024-04-25T08:49:17.742703+0000","last_became_peered":"2024-04-25T08:49:17.742703+0000","last_unstale":"2024-04-25T08:49:19.410905+0000","last_undegraded":"2024-04-25T08:49:19.410905+0000","last_fullsized":"2024-04-25T08:49:19.410905+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:22.347508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409430+0000","last_change":"2024-04-25T08:49:16.706179+0000","last_active":"2024-04-25T08:49:19.409430+0000","last_peered":"2024-04-25T08:49:19.409430+0000","last_clean":"2024-04-25T08:49:19.409430+0000","last_became_active":"2024-04-25T08:49:16.705248+0000","last_became_peered":"2024-04-25T08:49:16.705248+0000","last_unstale":"2024-04-25T08:49:19.409430+0000","last_undegraded":"2024-04-25T08:49:19.409430+0000","last_fullsized":"2024-04-25T08:49:19.409430+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:21.345771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254983+0000","last_change":"2024-04-25T08:49:17.736730+0000","last_active":"2024-04-25T08:49:19.254983+0000","last_peered":"2024-04-25T08:49:19.254983+0000","last_clean":"2024-04-25T08:49:19.254983+0000","last_became_active":"2024-04-25T08:49:17.736454+0000","last_became_peered":"2024-04-25T08:49:17.736454+0000","last_unstale":"2024-04-25T08:49:19.254983+0000","last_undegraded":"2024-04-25T08:49:19.254983+0000","last_fullsized":"2024-04-25T08:49:19.254983+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:27.027956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254792+0000","last_change":"2024-04-25T08:49:16.709471+0000","last_active":"2024-04-25T08:49:19.254792+0000","last_peered":"2024-04-25T08:49:19.254792+0000","last_clean":"2024-04-25T08:49:19.254792+0000","last_became_active":"2024-04-25T08:49:16.709155+0000","last_became_peered":"2024-04-25T08:49:16.709155+0000","last_unstale":"2024-04-25T08:49:19.254792+0000","last_undegraded":"2024-04-25T08:49:19.254792+0000","last_fullsized":"2024-04-25T08:49:19.254792+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:01.998651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720976+0000","last_change":"2024-04-25T08:49:17.743127+0000","last_active":"2024-04-25T08:49:18.720976+0000","last_peered":"2024-04-25T08:49:18.720976+0000","last_clean":"2024-04-25T08:49:18.720976+0000","last_became_active":"2024-04-25T08:49:17.742826+0000","last_became_peered":"2024-04-25T08:49:17.742826+0000","last_unstale":"2024-04-25T08:49:18.720976+0000","last_undegraded":"2024-04-25T08:49:18.720976+0000","last_fullsized":"2024-04-25T08:49:18.720976+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:47.704925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"106'8","reported_seq":22,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721785+0000","last_change":"2024-04-25T08:49:16.706014+0000","last_active":"2024-04-25T08:49:18.721785+0000","last_peered":"2024-04-25T08:49:18.721785+0000","last_clean":"2024-04-25T08:49:18.721785+0000","last_became_active":"2024-04-25T08:49:16.705027+0000","last_became_peered":"2024-04-25T08:49:16.705027+0000","last_unstale":"2024-04-25T08:49:18.721785+0000","last_undegraded":"2024-04-25T08:49:18.721785+0000","last_fullsized":"2024-04-25T08:49:18.721785+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:09.162240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.255022+0000","last_change":"2024-04-25T08:49:17.728957+0000","last_active":"2024-04-25T08:49:19.255022+0000","last_peered":"2024-04-25T08:49:19.255022+0000","last_clean":"2024-04-25T08:49:19.255022+0000","last_became_active":"2024-04-25T08:49:17.728662+0000","last_became_peered":"2024-04-25T08:49:17.728662+0000","last_unstale":"2024-04-25T08:49:19.255022+0000","last_undegraded":"2024-04-25T08:49:19.255022+0000","last_fullsized":"2024-04-25T08:49:19.255022+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:58.351873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410415+0000","last_change":"2024-04-25T08:49:16.711407+0000","last_active":"2024-04-25T08:49:19.410415+0000","last_peered":"2024-04-25T08:49:19.410415+0000","last_clean":"2024-04-25T08:49:19.410415+0000","last_became_active":"2024-04-25T08:49:16.711130+0000","last_became_peered":"2024-04-25T08:49:16.711130+0000","last_unstale":"2024-04-25T08:49:19.410415+0000","last_undegraded":"2024-04-25T08:49:19.410415+0000","last_fullsized":"2024-04-25T08:49:19.410415+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:19.282309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410579+0000","last_change":"2024-04-25T08:49:17.740420+0000","last_active":"2024-04-25T08:49:19.410579+0000","last_peered":"2024-04-25T08:49:19.410579+0000","last_clean":"2024-04-25T08:49:19.410579+0000","last_became_active":"2024-04-25T08:49:17.740150+0000","last_became_peered":"2024-04-25T08:49:17.740150+0000","last_unstale":"2024-04-25T08:49:19.410579+0000","last_undegraded":"2024-04-25T08:49:19.410579+0000","last_fullsized":"2024-04-25T08:49:19.410579+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:09.640308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410180+0000","last_change":"2024-04-25T08:49:16.703647+0000","last_active":"2024-04-25T08:49:19.410180+0000","last_peered":"2024-04-25T08:49:19.410180+0000","last_clean":"2024-04-25T08:49:19.410180+0000","last_became_active":"2024-04-25T08:49:16.703378+0000","last_became_peered":"2024-04-25T08:49:16.703378+0000","last_unstale":"2024-04-25T08:49:19.410180+0000","last_undegraded":"2024-04-25T08:49:19.410180+0000","last_fullsized":"2024-04-25T08:49:19.410180+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:09:43.693189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409855+0000","last_change":"2024-04-25T08:49:17.740204+0000","last_active":"2024-04-25T08:49:19.409855+0000","last_peered":"2024-04-25T08:49:19.409855+0000","last_clean":"2024-04-25T08:49:19.409855+0000","last_became_active":"2024-04-25T08:49:17.738712+0000","last_became_peered":"2024-04-25T08:49:17.738712+0000","last_unstale":"2024-04-25T08:49:19.409855+0000","last_undegraded":"2024-04-25T08:49:19.409855+0000","last_fullsized":"2024-04-25T08:49:19.409855+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:16.178333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722040+0000","last_change":"2024-04-25T08:49:16.709045+0000","last_active":"2024-04-25T08:49:18.722040+0000","last_peered":"2024-04-25T08:49:18.722040+0000","last_clean":"2024-04-25T08:49:18.722040+0000","last_became_active":"2024-04-25T08:49:16.708749+0000","last_became_peered":"2024-04-25T08:49:16.708749+0000","last_unstale":"2024-04-25T08:49:18.722040+0000","last_undegraded":"2024-04-25T08:49:18.722040+0000","last_fullsized":"2024-04-25T08:49:18.722040+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:41.671204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720749+0000","last_change":"2024-04-25T08:49:17.735078+0000","last_active":"2024-04-25T08:49:18.720749+0000","last_peered":"2024-04-25T08:49:18.720749+0000","last_clean":"2024-04-25T08:49:18.720749+0000","last_became_active":"2024-04-25T08:49:17.734840+0000","last_became_peered":"2024-04-25T08:49:17.734840+0000","last_unstale":"2024-04-25T08:49:18.720749+0000","last_undegraded":"2024-04-25T08:49:18.720749+0000","last_fullsized":"2024-04-25T08:49:18.720749+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:13.102881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.255044+0000","last_change":"2024-04-25T08:49:16.712381+0000","last_active":"2024-04-25T08:49:19.255044+0000","last_peered":"2024-04-25T08:49:19.255044+0000","last_clean":"2024-04-25T08:49:19.255044+0000","last_became_active":"2024-04-25T08:49:16.709722+0000","last_became_peered":"2024-04-25T08:49:16.709722+0000","last_unstale":"2024-04-25T08:49:19.255044+0000","last_undegraded":"2024-04-25T08:49:19.255044+0000","last_fullsized":"2024-04-25T08:49:19.255044+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:10.755803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720869+0000","last_change":"2024-04-25T08:49:17.735105+0000","last_active":"2024-04-25T08:49:18.720869+0000","last_peered":"2024-04-25T08:49:18.720869+0000","last_clean":"2024-04-25T08:49:18.720869+0000","last_became_active":"2024-04-25T08:49:17.734786+0000","last_became_peered":"2024-04-25T08:49:17.734786+0000","last_unstale":"2024-04-25T08:49:18.720869+0000","last_undegraded":"2024-04-25T08:49:18.720869+0000","last_fullsized":"2024-04-25T08:49:18.720869+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:49.088082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254669+0000","last_change":"2024-04-25T08:49:16.707115+0000","last_active":"2024-04-25T08:49:19.254669+0000","last_peered":"2024-04-25T08:49:19.254669+0000","last_clean":"2024-04-25T08:49:19.254669+0000","last_became_active":"2024-04-25T08:49:16.706830+0000","last_became_peered":"2024-04-25T08:49:16.706830+0000","last_unstale":"2024-04-25T08:49:19.254669+0000","last_undegraded":"2024-04-25T08:49:19.254669+0000","last_fullsized":"2024-04-25T08:49:19.254669+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:36.946063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409789+0000","last_change":"2024-04-25T08:49:17.743976+0000","last_active":"2024-04-25T08:49:19.409789+0000","last_peered":"2024-04-25T08:49:19.409789+0000","last_clean":"2024-04-25T08:49:19.409789+0000","last_became_active":"2024-04-25T08:49:17.743708+0000","last_became_peered":"2024-04-25T08:49:17.743708+0000","last_unstale":"2024-04-25T08:49:19.409789+0000","last_undegraded":"2024-04-25T08:49:19.409789+0000","last_fullsized":"2024-04-25T08:49:19.409789+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:23.966690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410683+0000","last_change":"2024-04-25T08:49:16.710722+0000","last_active":"2024-04-25T08:49:19.410683+0000","last_peered":"2024-04-25T08:49:19.410683+0000","last_clean":"2024-04-25T08:49:19.410683+0000","last_became_active":"2024-04-25T08:49:16.710439+0000","last_became_peered":"2024-04-25T08:49:16.710439+0000","last_unstale":"2024-04-25T08:49:19.410683+0000","last_undegraded":"2024-04-25T08:49:19.410683+0000","last_fullsized":"2024-04-25T08:49:19.410683+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:27.223903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.255068+0000","last_change":"2024-04-25T08:49:17.734935+0000","last_active":"2024-04-25T08:49:19.255068+0000","last_peered":"2024-04-25T08:49:19.255068+0000","last_clean":"2024-04-25T08:49:19.255068+0000","last_became_active":"2024-04-25T08:49:17.734661+0000","last_became_peered":"2024-04-25T08:49:17.734661+0000","last_unstale":"2024-04-25T08:49:19.255068+0000","last_undegraded":"2024-04-25T08:49:19.255068+0000","last_fullsized":"2024-04-25T08:49:19.255068+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:43.172737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254975+0000","last_change":"2024-04-25T08:49:16.707295+0000","last_active":"2024-04-25T08:49:19.254975+0000","last_peered":"2024-04-25T08:49:19.254975+0000","last_clean":"2024-04-25T08:49:19.254975+0000","last_became_active":"2024-04-25T08:49:16.706073+0000","last_became_peered":"2024-04-25T08:49:16.706073+0000","last_unstale":"2024-04-25T08:49:19.254975+0000","last_undegraded":"2024-04-25T08:49:19.254975+0000","last_fullsized":"2024-04-25T08:49:19.254975+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:43.055402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.720661+0000","last_change":"2024-04-25T08:49:17.737775+0000","last_active":"2024-04-25T08:49:18.720661+0000","last_peered":"2024-04-25T08:49:18.720661+0000","last_clean":"2024-04-25T08:49:18.720661+0000","last_became_active":"2024-04-25T08:49:17.737464+0000","last_became_peered":"2024-04-25T08:49:17.737464+0000","last_unstale":"2024-04-25T08:49:18.720661+0000","last_undegraded":"2024-04-25T08:49:18.720661+0000","last_fullsized":"2024-04-25T08:49:18.720661+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:48.663455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409585+0000","last_change":"2024-04-25T08:49:16.711257+0000","last_active":"2024-04-25T08:49:19.409585+0000","last_peered":"2024-04-25T08:49:19.409585+0000","last_clean":"2024-04-25T08:49:19.409585+0000","last_became_active":"2024-04-25T08:49:16.710953+0000","last_became_peered":"2024-04-25T08:49:16.710953+0000","last_unstale":"2024-04-25T08:49:19.409585+0000","last_undegraded":"2024-04-25T08:49:19.409585+0000","last_fullsized":"2024-04-25T08:49:19.409585+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:27.223903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722028+0000","last_change":"2024-04-25T08:49:17.732659+0000","last_active":"2024-04-25T08:49:18.722028+0000","last_peered":"2024-04-25T08:49:18.722028+0000","last_clean":"2024-04-25T08:49:18.722028+0000","last_became_active":"2024-04-25T08:49:17.732345+0000","last_became_peered":"2024-04-25T08:49:17.732345+0000","last_unstale":"2024-04-25T08:49:18.722028+0000","last_undegraded":"2024-04-25T08:49:18.722028+0000","last_fullsized":"2024-04-25T08:49:18.722028+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:41.670016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"107'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.726232+0000","last_change":"2024-04-25T08:49:16.708025+0000","last_active":"2024-04-25T08:49:19.726232+0000","last_peered":"2024-04-25T08:49:19.726232+0000","last_clean":"2024-04-25T08:49:19.726232+0000","last_became_active":"2024-04-25T08:49:16.707746+0000","last_became_peered":"2024-04-25T08:49:16.707746+0000","last_unstale":"2024-04-25T08:49:19.726232+0000","last_undegraded":"2024-04-25T08:49:19.726232+0000","last_fullsized":"2024-04-25T08:49:19.726232+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:55.239733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409425+0000","last_change":"2024-04-25T08:49:17.743472+0000","last_active":"2024-04-25T08:49:19.409425+0000","last_peered":"2024-04-25T08:49:19.409425+0000","last_clean":"2024-04-25T08:49:19.409425+0000","last_became_active":"2024-04-25T08:49:17.743158+0000","last_became_peered":"2024-04-25T08:49:17.743158+0000","last_unstale":"2024-04-25T08:49:19.409425+0000","last_undegraded":"2024-04-25T08:49:19.409425+0000","last_fullsized":"2024-04-25T08:49:19.409425+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:14.288500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410841+0000","last_change":"2024-04-25T08:49:16.709219+0000","last_active":"2024-04-25T08:49:19.410841+0000","last_peered":"2024-04-25T08:49:19.410841+0000","last_clean":"2024-04-25T08:49:19.410841+0000","last_became_active":"2024-04-25T08:49:16.708094+0000","last_became_peered":"2024-04-25T08:49:16.708094+0000","last_unstale":"2024-04-25T08:49:19.410841+0000","last_undegraded":"2024-04-25T08:49:19.410841+0000","last_fullsized":"2024-04-25T08:49:19.410841+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:10.715489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722255+0000","last_change":"2024-04-25T08:49:17.735470+0000","last_active":"2024-04-25T08:49:18.722255+0000","last_peered":"2024-04-25T08:49:18.722255+0000","last_clean":"2024-04-25T08:49:18.722255+0000","last_became_active":"2024-04-25T08:49:17.735219+0000","last_became_peered":"2024-04-25T08:49:17.735219+0000","last_unstale":"2024-04-25T08:49:18.722255+0000","last_undegraded":"2024-04-25T08:49:18.722255+0000","last_fullsized":"2024-04-25T08:49:18.722255+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:07.433714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410166+0000","last_change":"2024-04-25T08:49:16.711612+0000","last_active":"2024-04-25T08:49:19.410166+0000","last_peered":"2024-04-25T08:49:19.410166+0000","last_clean":"2024-04-25T08:49:19.410166+0000","last_became_active":"2024-04-25T08:49:16.710450+0000","last_became_peered":"2024-04-25T08:49:16.710450+0000","last_unstale":"2024-04-25T08:49:19.410166+0000","last_undegraded":"2024-04-25T08:49:19.410166+0000","last_fullsized":"2024-04-25T08:49:19.410166+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:10.715489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254833+0000","last_change":"2024-04-25T08:49:17.739533+0000","last_active":"2024-04-25T08:49:19.254833+0000","last_peered":"2024-04-25T08:49:19.254833+0000","last_clean":"2024-04-25T08:49:19.254833+0000","last_became_active":"2024-04-25T08:49:17.739278+0000","last_became_peered":"2024-04-25T08:49:17.739278+0000","last_unstale":"2024-04-25T08:49:19.254833+0000","last_undegraded":"2024-04-25T08:49:19.254833+0000","last_fullsized":"2024-04-25T08:49:19.254833+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:48.872125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722620+0000","last_change":"2024-04-25T08:49:16.709674+0000","last_active":"2024-04-25T08:49:18.722620+0000","last_peered":"2024-04-25T08:49:18.722620+0000","last_clean":"2024-04-25T08:49:18.722620+0000","last_became_active":"2024-04-25T08:49:16.709386+0000","last_became_peered":"2024-04-25T08:49:16.709386+0000","last_unstale":"2024-04-25T08:49:18.722620+0000","last_undegraded":"2024-04-25T08:49:18.722620+0000","last_fullsized":"2024-04-25T08:49:18.722620+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:30.039734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254843+0000","last_change":"2024-04-25T08:49:17.731870+0000","last_active":"2024-04-25T08:49:19.254843+0000","last_peered":"2024-04-25T08:49:19.254843+0000","last_clean":"2024-04-25T08:49:19.254843+0000","last_became_active":"2024-04-25T08:49:17.731636+0000","last_became_peered":"2024-04-25T08:49:17.731636+0000","last_unstale":"2024-04-25T08:49:19.254843+0000","last_undegraded":"2024-04-25T08:49:19.254843+0000","last_fullsized":"2024-04-25T08:49:19.254843+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:36.480006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.254786+0000","last_change":"2024-04-25T08:49:16.711724+0000","last_active":"2024-04-25T08:49:19.254786+0000","last_peered":"2024-04-25T08:49:19.254786+0000","last_clean":"2024-04-25T08:49:19.254786+0000","last_became_active":"2024-04-25T08:49:16.711469+0000","last_became_peered":"2024-04-25T08:49:16.711469+0000","last_unstale":"2024-04-25T08:49:19.254786+0000","last_undegraded":"2024-04-25T08:49:19.254786+0000","last_fullsized":"2024-04-25T08:49:19.254786+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:37.341785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410285+0000","last_change":"2024-04-25T08:49:17.742343+0000","last_active":"2024-04-25T08:49:19.410285+0000","last_peered":"2024-04-25T08:49:19.410285+0000","last_clean":"2024-04-25T08:49:19.410285+0000","last_became_active":"2024-04-25T08:49:17.742048+0000","last_became_peered":"2024-04-25T08:49:17.742048+0000","last_unstale":"2024-04-25T08:49:19.410285+0000","last_undegraded":"2024-04-25T08:49:19.410285+0000","last_fullsized":"2024-04-25T08:49:19.410285+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:14:07.433714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.410793+0000","last_change":"2024-04-25T08:49:16.707522+0000","last_active":"2024-04-25T08:49:19.410793+0000","last_peered":"2024-04-25T08:49:19.410793+0000","last_clean":"2024-04-25T08:49:19.410793+0000","last_became_active":"2024-04-25T08:49:16.706772+0000","last_became_peered":"2024-04-25T08:49:16.706772+0000","last_unstale":"2024-04-25T08:49:19.410793+0000","last_undegraded":"2024-04-25T08:49:19.410793+0000","last_fullsized":"2024-04-25T08:49:19.410793+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:07.303189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.722589+0000","last_change":"2024-04-25T08:49:17.738471+0000","last_active":"2024-04-25T08:49:18.722589+0000","last_peered":"2024-04-25T08:49:18.722589+0000","last_clean":"2024-04-25T08:49:18.722589+0000","last_became_active":"2024-04-25T08:49:17.738191+0000","last_became_peered":"2024-04-25T08:49:17.738191+0000","last_unstale":"2024-04-25T08:49:18.722589+0000","last_undegraded":"2024-04-25T08:49:18.722589+0000","last_fullsized":"2024-04-25T08:49:18.722589+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:14.288500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.255061+0000","last_change":"2024-04-25T08:49:16.711948+0000","last_active":"2024-04-25T08:49:19.255061+0000","last_peered":"2024-04-25T08:49:19.255061+0000","last_clean":"2024-04-25T08:49:19.255061+0000","last_became_active":"2024-04-25T08:49:16.710125+0000","last_became_peered":"2024-04-25T08:49:16.710125+0000","last_unstale":"2024-04-25T08:49:19.255061+0000","last_undegraded":"2024-04-25T08:49:19.255061+0000","last_fullsized":"2024-04-25T08:49:19.255061+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:19.899453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:18.721802+0000","last_change":"2024-04-25T08:49:17.730576+0000","last_active":"2024-04-25T08:49:18.721802+0000","last_peered":"2024-04-25T08:49:18.721802+0000","last_clean":"2024-04-25T08:49:18.721802+0000","last_became_active":"2024-04-25T08:49:17.730275+0000","last_became_peered":"2024-04-25T08:49:17.730275+0000","last_unstale":"2024-04-25T08:49:18.721802+0000","last_undegraded":"2024-04-25T08:49:18.721802+0000","last_fullsized":"2024-04-25T08:49:18.721802+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:16.690964+0000","last_clean_scrub_stamp":"2024-04-25T08:49:16.690964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:18.160821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.255036+0000","last_change":"2024-04-25T08:49:16.706670+0000","last_active":"2024-04-25T08:49:19.255036+0000","last_peered":"2024-04-25T08:49:19.255036+0000","last_clean":"2024-04-25T08:49:19.255036+0000","last_became_active":"2024-04-25T08:49:16.706382+0000","last_became_peered":"2024-04-25T08:49:16.706382+0000","last_unstale":"2024-04-25T08:49:19.255036+0000","last_undegraded":"2024-04-25T08:49:19.255036+0000","last_fullsized":"2024-04-25T08:49:19.255036+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:49:15.689228+0000","last_clean_scrub_stamp":"2024-04-25T08:49:15.689228+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:47.576116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":331,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T08:49:19.409788+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:49:19.409788+0000","last_peered":"2024-04-25T08:49:19.409788+0000","last_clean":"2024-04-25T08:49:19.409788+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:49:19.409788+0000","last_undegraded":"2024-04-25T08:49:19.409788+0000","last_fullsized":"2024-04-25T08:49:19.409788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41388,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330452,"statfs":{"total":96636764160,"available":96594382848,"internally_reserved":0,"allocated":1929216,"data_stored":1207268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46384,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325456,"statfs":{"total":96636764160,"available":96589266944,"internally_reserved":0,"allocated":1347584,"data_stored":618956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40804,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331036,"statfs":{"total":96636764160,"available":96594980864,"internally_reserved":0,"allocated":1327104,"data_stored":616740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50532,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321308,"statfs":{"total":96636764160,"available":96585019392,"internally_reserved":0,"allocated":1335296,"data_stored":616832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50528,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321312,"statfs":{"total":96636764160,"available":96585023488,"internally_reserved":0,"allocated":1331200,"data_stored":617322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46372,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325468,"statfs":{"total":96636764160,"available":96589279232,"internally_reserved":0,"allocated":1331200,"data_stored":616774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46372,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325468,"statfs":{"total":96636764160,"available":96589279232,"internally_reserved":0,"allocated":1331200,"data_stored":616774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46960,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324880,"statfs":{"total":96636764160,"available":96588677120,"internally_reserved":0,"allocated":1937408,"data_stored":1208810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:49:25.408 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:49:25.408 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:49:25.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.522+0000 7f54c1f22640 1 Processor -- start 2024-04-25T08:49:25.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.522+0000 7f54c1f22640 1 -- start start 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54c1f22640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f54bc06ccd0 0x7f54bc0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54c1f22640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f54bc15deb0 0x7f54bc15e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54c1f22640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0d1770 con 0x7f54bc070dc0 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54c1f22640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc1622b0 con 0x7f54bc15deb0 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54c1f22640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc0b10f0 con 0x7f54bc06ccd0 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54bbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f54bc15deb0 0x7f54bc15e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54bbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f54bc15deb0 0x7f54bc15e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54978/0 (socket says 172.21.15.172:54978) 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54bbfff640 1 -- 172.21.15.172:0/2690181902 learned_addr learned my addr 172.21.15.172:0/2690181902 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54baffd640 1 --2- 172.21.15.172:0/2690181902 >> v2:172.21.15.186:3300/0 conn(0x7f54bc06ccd0 0x7f54bc0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54bbfff640 1 -- 172.21.15.172:0/2690181902 >> v2:172.21.15.186:3300/0 conn(0x7f54bc06ccd0 msgr2=0x7f54bc0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54bbfff640 1 --2- 172.21.15.172:0/2690181902 >> v2:172.21.15.186:3300/0 conn(0x7f54bc06ccd0 0x7f54bc0b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54bbfff640 1 -- 172.21.15.172:0/2690181902 >> v1:172.21.15.186:6789/0 conn(0x7f54bc070dc0 legacy=0x7f54bc0711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.523+0000 7f54bbfff640 1 -- 172.21.15.172:0/2690181902 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc162740 con 0x7f54bc15deb0 2024-04-25T08:49:25.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54bbfff640 1 --2- 172.21.15.172:0/2690181902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc15deb0 0x7f54bc15e320 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f54bc04efc0 tx=0x7f54b402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc6ce83d7259e5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54ba7fc640 1 -- 172.21.15.172:0/2690181902 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4036070 con 0x7f54bc15deb0 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54ba7fc640 1 -- 172.21.15.172:0/2690181902 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b4031600 con 0x7f54bc15deb0 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54ba7fc640 1 -- 172.21.15.172:0/2690181902 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40319d0 con 0x7f54bc15deb0 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54c1f22640 1 -- 172.21.15.172:0/2690181902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc15deb0 msgr2=0x7f54bc15e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54c1f22640 1 --2- 172.21.15.172:0/2690181902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc15deb0 0x7f54bc15e320 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f54bc04efc0 tx=0x7f54b402a5d0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54c1f22640 1 -- 172.21.15.172:0/2690181902 shutdown_connections 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54c1f22640 1 --2- 172.21.15.172:0/2690181902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc15deb0 0x7f54bc15e320 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54c1f22640 1 --2- 172.21.15.172:0/2690181902 >> v2:172.21.15.186:3300/0 conn(0x7f54bc06ccd0 0x7f54bc0b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54c1f22640 1 -- 172.21.15.172:0/2690181902 >> 172.21.15.172:0/2690181902 conn(0x7f54bc0b3530 msgr2=0x7f54bc0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54c1f22640 1 -- 172.21.15.172:0/2690181902 shutdown_connections 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.524+0000 7f54c1f22640 1 -- 172.21.15.172:0/2690181902 wait complete. 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.526+0000 7f54c1f22640 1 Processor -- start 2024-04-25T08:49:25.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.526+0000 7f54c1f22640 1 -- start start 2024-04-25T08:49:25.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.526+0000 7f54c1f22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc06ccd0 0x7f54bc1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.526+0000 7f54c1f22640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54bc070dc0 0x7f54bc160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.526+0000 7f54c1f22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54bc15deb0 0x7f54bc06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.526+0000 7f54c1f22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc161f40 con 0x7f54bc06ccd0 2024-04-25T08:49:25.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.526+0000 7f54c1f22640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc161c60 con 0x7f54bc070dc0 2024-04-25T08:49:25.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.526+0000 7f54c1f22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0b5840 con 0x7f54bc15deb0 2024-04-25T08:49:25.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc06ccd0 0x7f54bc1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc06ccd0 0x7f54bc1515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54980/0 (socket says 172.21.15.172:54980) 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bb7fe640 1 -- 172.21.15.172:0/3343935560 learned_addr learned my addr 172.21.15.172:0/3343935560 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54baffd640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54bc070dc0 0x7f54bc160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bbfff640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54bc15deb0 0x7f54bc06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bb7fe640 1 -- 172.21.15.172:0/3343935560 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54bc15deb0 msgr2=0x7f54bc06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bb7fe640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54bc15deb0 0x7f54bc06ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bb7fe640 1 -- 172.21.15.172:0/3343935560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54bc070dc0 msgr2=0x7f54bc160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bb7fe640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54bc070dc0 0x7f54bc160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bb7fe640 1 -- 172.21.15.172:0/3343935560 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0cabb0 con 0x7f54bc06ccd0 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bbfff640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54bc15deb0 0x7f54bc06ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54bb7fe640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc06ccd0 0x7f54bc1515f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00c430 tx=0x7f54ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54a3fff640 1 -- 172.21.15.172:0/3343935560 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac011790 con 0x7f54bc06ccd0 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54a3fff640 1 -- 172.21.15.172:0/3343935560 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac017070 con 0x7f54bc06ccd0 2024-04-25T08:49:25.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54c1f22640 1 -- 172.21.15.172:0/3343935560 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc0cae90 con 0x7f54bc06ccd0 2024-04-25T08:49:25.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54a3fff640 1 -- 172.21.15.172:0/3343935560 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac011bb0 con 0x7f54bc06ccd0 2024-04-25T08:49:25.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.527+0000 7f54c1f22640 1 -- 172.21.15.172:0/3343935560 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc0cb730 con 0x7f54bc06ccd0 2024-04-25T08:49:25.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.528+0000 7f54c1f22640 1 -- 172.21.15.172:0/3343935560 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc073a00 con 0x7f54bc06ccd0 2024-04-25T08:49:25.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.529+0000 7f54a3fff640 1 -- 172.21.15.172:0/3343935560 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f54ac01c460 con 0x7f54bc06ccd0 2024-04-25T08:49:25.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.529+0000 7f54a3fff640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f54a806b4d0 0x7f54a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.529+0000 7f54baffd640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f54a806b4d0 0x7f54a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.529+0000 7f54a3fff640 1 -- 172.21.15.172:0/3343935560 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f54ac08a130 con 0x7f54bc06ccd0 2024-04-25T08:49:25.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.530+0000 7f54baffd640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f54a806b4d0 0x7f54a806d990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0b17f0 tx=0x7f54b0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:25.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.533+0000 7f54a3fff640 1 -- 172.21.15.172:0/3343935560 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54ac058eb0 con 0x7f54bc06ccd0 2024-04-25T08:49:25.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.774+0000 7f54c1f22640 1 -- 172.21.15.172:0/3343935560 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f54bc0713f0 con 0x7f54bc06ccd0 2024-04-25T08:49:25.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.775+0000 7f54a3fff640 1 -- 172.21.15.172:0/3343935560 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f54ac0587b0 con 0x7f54bc06ccd0 2024-04-25T08:49:25.766 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T08:49:25.766 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:49:25.767 INFO:teuthology.orchestra.run.smithi172.stdout: caps mds = "allow" 2024-04-25T08:49:25.767 INFO:teuthology.orchestra.run.smithi172.stdout: caps mon = "allow r" 2024-04-25T08:49:25.767 INFO:teuthology.orchestra.run.smithi172.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:49:25.767 INFO:teuthology.orchestra.run.smithi172.stderr:updated caps for client.0 2024-04-25T08:49:25.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 -- 172.21.15.172:0/3343935560 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f54a806b4d0 msgr2=0x7f54a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f54a806b4d0 0x7f54a806d990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0b17f0 tx=0x7f54b0008040 comp rx=0 tx=0).stop 2024-04-25T08:49:25.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 -- 172.21.15.172:0/3343935560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc06ccd0 msgr2=0x7f54bc1515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc06ccd0 0x7f54bc1515f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00c430 tx=0x7f54ac00c8f0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 -- 172.21.15.172:0/3343935560 shutdown_connections 2024-04-25T08:49:25.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f54a806b4d0 0x7f54a806d990 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54bc070dc0 0x7f54bc160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54bc15deb0 0x7f54bc06ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 --2- 172.21.15.172:0/3343935560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc06ccd0 0x7f54bc1515f0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 -- 172.21.15.172:0/3343935560 >> 172.21.15.172:0/3343935560 conn(0x7f54bc0b3530 msgr2=0x7f54bc074060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:25.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 -- 172.21.15.172:0/3343935560 shutdown_connections 2024-04-25T08:49:25.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.778+0000 7f54c1f22640 1 -- 172.21.15.172:0/3343935560 wait complete. 2024-04-25T08:49:25.780 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:25.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.886+0000 7f902f55c640 1 Processor -- start 2024-04-25T08:49:25.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.886+0000 7f902f55c640 1 -- start start 2024-04-25T08:49:25.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902f55c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f902815dc90 0x7f90281625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902f55c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90280cc8e0 0x7f902815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902f55c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902815f390 con 0x7f90280d1810 2024-04-25T08:49:25.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902f55c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90280cce50 con 0x7f902815dc90 2024-04-25T08:49:25.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902f55c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9028161af0 con 0x7f90280cc8e0 2024-04-25T08:49:25.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902d2f8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f902815dc90 0x7f90281625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902daf9640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f90280d1810 0x7f90280cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40844/0 (socket says 172.21.15.172:40844) 2024-04-25T08:49:25.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902daf9640 1 -- 172.21.15.172:0/104459595 learned_addr learned my addr 172.21.15.172:0/104459595 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:25.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902d2f8640 1 -- 172.21.15.172:0/104459595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90280cc8e0 msgr2=0x7f902815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:25.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902d2f8640 1 --2- 172.21.15.172:0/104459595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90280cc8e0 0x7f902815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902d2f8640 1 -- 172.21.15.172:0/104459595 >> v1:172.21.15.172:6789/0 conn(0x7f90280d1810 legacy=0x7f90280cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f901ffff640 1 -- 172.21.15.172:0/104459595 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119706417 0 0) 0x7f9020001490 con 0x7f90280d1810 2024-04-25T08:49:25.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.887+0000 7f902d2f8640 1 -- 172.21.15.172:0/104459595 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9028161dd0 con 0x7f902815dc90 2024-04-25T08:49:25.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.888+0000 7f902d2f8640 1 --2- 172.21.15.172:0/104459595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f902815dc90 0x7f90281625d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f90240097a0 tx=0x7f902402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e8c723d533c11d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.888+0000 7f901ffff640 1 -- 172.21.15.172:0/104459595 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024037070 con 0x7f902815dc90 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.888+0000 7f901ffff640 1 -- 172.21.15.172:0/104459595 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902402ae50 con 0x7f902815dc90 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.888+0000 7f901ffff640 1 -- 172.21.15.172:0/104459595 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024032660 con 0x7f902815dc90 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.889+0000 7f902f55c640 1 -- 172.21.15.172:0/104459595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f902815dc90 msgr2=0x7f90281625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.889+0000 7f902f55c640 1 --2- 172.21.15.172:0/104459595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f902815dc90 0x7f90281625d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f90240097a0 tx=0x7f902402a100 comp rx=0 tx=0).stop 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.889+0000 7f902f55c640 1 -- 172.21.15.172:0/104459595 shutdown_connections 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.889+0000 7f902f55c640 1 --2- 172.21.15.172:0/104459595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90280cc8e0 0x7f902815ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.889+0000 7f902f55c640 1 --2- 172.21.15.172:0/104459595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f902815dc90 0x7f90281625d0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.889+0000 7f902f55c640 1 -- 172.21.15.172:0/104459595 >> 172.21.15.172:0/104459595 conn(0x7f902806f590 msgr2=0x7f902806f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.889+0000 7f902f55c640 1 -- 172.21.15.172:0/104459595 shutdown_connections 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.889+0000 7f902f55c640 1 -- 172.21.15.172:0/104459595 wait complete. 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.890+0000 7f902f55c640 1 Processor -- start 2024-04-25T08:49:25.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.890+0000 7f902f55c640 1 -- start start 2024-04-25T08:49:25.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902f55c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90280cc8e0 0x7f902815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902f55c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280d1810 0x7f90280b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902f55c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f902815dc90 0x7f90281e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902f55c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902815e070 con 0x7f90280d1810 2024-04-25T08:49:25.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902f55c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90280cd130 con 0x7f90280cc8e0 2024-04-25T08:49:25.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902f55c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902815e1f0 con 0x7f902815dc90 2024-04-25T08:49:25.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902caf7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280d1810 0x7f90280b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902caf7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280d1810 0x7f90280b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55004/0 (socket says 172.21.15.172:55004) 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902caf7640 1 -- 172.21.15.172:0/2264390326 learned_addr learned my addr 172.21.15.172:0/2264390326 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902d2f8640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90280cc8e0 0x7f902815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902daf9640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f902815dc90 0x7f90281e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902caf7640 1 -- 172.21.15.172:0/2264390326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f902815dc90 msgr2=0x7f90281e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902caf7640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f902815dc90 0x7f90281e72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902caf7640 1 -- 172.21.15.172:0/2264390326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90280cc8e0 msgr2=0x7f902815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902caf7640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90280cc8e0 0x7f902815afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902caf7640 1 -- 172.21.15.172:0/2264390326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90281f3d40 con 0x7f90280d1810 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902d2f8640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90280cc8e0 0x7f902815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902caf7640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280d1810 0x7f90280b6f90 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f901800b440 tx=0x7f901800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f901dffb640 1 -- 172.21.15.172:0/2264390326 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018015020 con 0x7f90280d1810 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f901dffb640 1 -- 172.21.15.172:0/2264390326 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9018011890 con 0x7f90280d1810 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f902f55c640 1 -- 172.21.15.172:0/2264390326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90281f3fb0 con 0x7f90280d1810 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.891+0000 7f901dffb640 1 -- 172.21.15.172:0/2264390326 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018011c80 con 0x7f90280d1810 2024-04-25T08:49:25.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.892+0000 7f902f55c640 1 -- 172.21.15.172:0/2264390326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90281f4570 con 0x7f90280d1810 2024-04-25T08:49:25.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.893+0000 7f902f55c640 1 -- 172.21.15.172:0/2264390326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90281f4d50 con 0x7f90280d1810 2024-04-25T08:49:25.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.893+0000 7f901dffb640 1 -- 172.21.15.172:0/2264390326 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9018018020 con 0x7f90280d1810 2024-04-25T08:49:25.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.893+0000 7f901dffb640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f900c06b4d0 0x7f900c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:25.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.893+0000 7f901dffb640 1 -- 172.21.15.172:0/2264390326 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f901808a470 con 0x7f90280d1810 2024-04-25T08:49:25.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.893+0000 7f902d2f8640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f900c06b4d0 0x7f900c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:25.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.894+0000 7f902d2f8640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f900c06b4d0 0x7f900c06d990 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9024034000 tx=0x7f902402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:25.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:25.898+0000 7f901dffb640 1 -- 172.21.15.172:0/2264390326 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f901801f020 con 0x7f90280d1810 2024-04-25T08:49:26.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.102+0000 7f902f55c640 1 -- 172.21.15.172:0/2264390326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90280cf6b0 con 0x7f90280d1810 2024-04-25T08:49:26.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.102+0000 7f901dffb640 1 -- 172.21.15.172:0/2264390326 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f901800d040 con 0x7f90280d1810 2024-04-25T08:49:26.093 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:26.093 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:26.093 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:26.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 -- 172.21.15.172:0/2264390326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f900c06b4d0 msgr2=0x7f900c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f900c06b4d0 0x7f900c06d990 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9024034000 tx=0x7f902402e000 comp rx=0 tx=0).stop 2024-04-25T08:49:26.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 -- 172.21.15.172:0/2264390326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280d1810 msgr2=0x7f90280b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280d1810 0x7f90280b6f90 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f901800b440 tx=0x7f901800b900 comp rx=0 tx=0).stop 2024-04-25T08:49:26.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 -- 172.21.15.172:0/2264390326 shutdown_connections 2024-04-25T08:49:26.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f900c06b4d0 0x7f900c06d990 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f902815dc90 0x7f90281e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280d1810 0x7f90280b6f90 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 --2- 172.21.15.172:0/2264390326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90280cc8e0 0x7f902815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 -- 172.21.15.172:0/2264390326 >> 172.21.15.172:0/2264390326 conn(0x7f902806f590 msgr2=0x7f90280cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:26.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 -- 172.21.15.172:0/2264390326 shutdown_connections 2024-04-25T08:49:26.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.104+0000 7f902f55c640 1 -- 172.21.15.172:0/2264390326 wait complete. 2024-04-25T08:49:26.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:49:17.044496+0000', 'modified': '2024-04-25T08:49:19.066995+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8124}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8124': {'gid': 8124, 'name': 'd', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6835/3937459499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6833', 'nonce': 3937459499}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 3937459499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:49:26.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:49:26.509 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T08:49:26.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.618+0000 7f07e086f640 1 Processor -- start 2024-04-25T08:49:26.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.618+0000 7f07e086f640 1 -- start start 2024-04-25T08:49:26.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07e086f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f07dc0cd4c0 0x7f07dc0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07e086f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc150b90 0x7f07dc151020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07e086f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc15e6e0 con 0x7f07dc15b1c0 2024-04-25T08:49:26.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07e086f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc151560 con 0x7f07dc0cd4c0 2024-04-25T08:49:26.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07e086f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc15e9c0 con 0x7f07dc150b90 2024-04-25T08:49:26.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07d9d9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f07dc15b1c0 0x7f07dc15dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40850/0 (socket says 172.21.15.172:40850) 2024-04-25T08:49:26.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07d9d9b640 1 -- 172.21.15.172:0/3433312437 learned_addr learned my addr 172.21.15.172:0/3433312437 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:26.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07da59c640 1 --2- 172.21.15.172:0/3433312437 >> v2:172.21.15.186:3300/0 conn(0x7f07dc0cd4c0 0x7f07dc0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07dad9d640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc150b90 0x7f07dc151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636997348 0 0) 0x7f07dc15e6e0 con 0x7f07dc15b1c0 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.619+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c4003520 con 0x7f07dc15b1c0 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2582142639 0 0) 0x7f07c4003520 con 0x7f07dc15b1c0 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc150b90 msgr2=0x7f07dc151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc150b90 0x7f07dc151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 >> v2:172.21.15.186:3300/0 conn(0x7f07dc0cd4c0 msgr2=0x7f07dc0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 --2- 172.21.15.172:0/3433312437 >> v2:172.21.15.186:3300/0 conn(0x7f07dc0cd4c0 0x7f07dc0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc15a9c0 con 0x7f07dc15b1c0 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f07d0001670 con 0x7f07dc15b1c0 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07da59c640 1 --2- 172.21.15.172:0/3433312437 >> v2:172.21.15.186:3300/0 conn(0x7f07dc0cd4c0 0x7f07dc0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 >> v1:172.21.15.172:6789/0 conn(0x7f07dc15b1c0 legacy=0x7f07dc15dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40039b0 0x7f07c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc150b90 0x7f07c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c4004d40 0x7f07c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc151560 con 0x7f07c4004d40 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc15e9c0 con 0x7f07c40039b0 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c400cad0 con 0x7f07dc150b90 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07dad9d640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c4004d40 0x7f07c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07da59c640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40039b0 0x7f07c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc150b90 0x7f07c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07dad9d640 1 -- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc150b90 msgr2=0x7f07c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07dad9d640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc150b90 0x7f07c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07dad9d640 1 -- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40039b0 msgr2=0x7f07c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07dad9d640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c40039b0 0x7f07c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.620+0000 7f07dad9d640 1 -- 172.21.15.172:0/3433312437 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c4003520 con 0x7f07c4004d40 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.621+0000 7f07dad9d640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c4004d40 0x7f07c40051c0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009ac0 tx=0x7f07c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd97425f54b3717b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.621+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4036070 con 0x7f07c4004d40 2024-04-25T08:49:26.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.621+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4031400 con 0x7f07c4004d40 2024-04-25T08:49:26.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.621+0000 7f07d959a640 1 -- 172.21.15.172:0/3433312437 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4009690 con 0x7f07c4004d40 2024-04-25T08:49:26.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.621+0000 7f07e086f640 1 -- 172.21.15.172:0/3433312437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c4004d40 msgr2=0x7f07c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.621+0000 7f07e086f640 1 --2- 172.21.15.172:0/3433312437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07c4004d40 0x7f07c40051c0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009ac0 tx=0x7f07c4005830 comp rx=0 tx=0).stop 2024-04-25T08:49:26.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.621+0000 7f07dad9d640 1 -- 172.21.15.172:0/3433312437 reap_dead start 2024-04-25T08:49:26.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.622+0000 7f07e086f640 1 -- 172.21.15.172:0/3433312437 shutdown_connections 2024-04-25T08:49:26.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.622+0000 7f07e086f640 1 -- 172.21.15.172:0/3433312437 >> 172.21.15.172:0/3433312437 conn(0x7f07dc06abe0 msgr2=0x7f07dc06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:26.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.622+0000 7f07e086f640 1 -- 172.21.15.172:0/3433312437 shutdown_connections 2024-04-25T08:49:26.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.622+0000 7f07e086f640 1 -- 172.21.15.172:0/3433312437 wait complete. 2024-04-25T08:49:26.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.623+0000 7f07e086f640 1 Processor -- start 2024-04-25T08:49:26.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.623+0000 7f07e086f640 1 -- start start 2024-04-25T08:49:26.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07e086f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c4004d40 0x7f07dc15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07e086f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc147d70 0x7f07dc15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07e086f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07dc1590b0 0x7f07dc159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07e086f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc15e370 con 0x7f07dc1590b0 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07e086f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc15a670 con 0x7f07c4004d40 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07e086f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc06eca0 con 0x7f07dc147d70 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07dad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07dc1590b0 0x7f07dc159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07dad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07dc1590b0 0x7f07dc159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55018/0 (socket says 172.21.15.172:55018) 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07dad9d640 1 -- 172.21.15.172:0/1764200526 learned_addr learned my addr 172.21.15.172:0/1764200526 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07da59c640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c4004d40 0x7f07dc15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc147d70 0x7f07dc15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07dad9d640 1 -- 172.21.15.172:0/1764200526 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc147d70 msgr2=0x7f07dc15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07dad9d640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc147d70 0x7f07dc15cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07dad9d640 1 -- 172.21.15.172:0/1764200526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c4004d40 msgr2=0x7f07dc15c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07dad9d640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c4004d40 0x7f07dc15c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07dad9d640 1 -- 172.21.15.172:0/1764200526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc1484c0 con 0x7f07dc1590b0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07da59c640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c4004d40 0x7f07dc15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc147d70 0x7f07dc15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07dad9d640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07dc1590b0 0x7f07dc159530 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009ac0 tx=0x7f07d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07caffd640 1 -- 172.21.15.172:0/1764200526 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4036040 con 0x7f07dc1590b0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07caffd640 1 -- 172.21.15.172:0/1764200526 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4041070 con 0x7f07dc1590b0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07e086f640 1 -- 172.21.15.172:0/1764200526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc1487a0 con 0x7f07dc1590b0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.624+0000 7f07caffd640 1 -- 172.21.15.172:0/1764200526 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4009690 con 0x7f07dc1590b0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.625+0000 7f07e086f640 1 -- 172.21.15.172:0/1764200526 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc15bec0 con 0x7f07dc1590b0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.626+0000 7f07caffd640 1 -- 172.21.15.172:0/1764200526 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f07d4039070 con 0x7f07dc1590b0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.627+0000 7f07caffd640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07bc06b4d0 0x7f07bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.627+0000 7f07caffd640 1 -- 172.21.15.172:0/1764200526 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f07d40a9bd0 con 0x7f07dc1590b0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.627+0000 7f07da59c640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07bc06b4d0 0x7f07bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.627+0000 7f07da59c640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07bc06b4d0 0x7f07bc06d990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f07cc007560 tx=0x7f07cc00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:26.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.627+0000 7f07e357b740 1 Processor -- start 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.628+0000 7f07e357b740 1 -- start start 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.628+0000 7f07e357b740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012458230 0x559012458610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.628+0000 7f07e357b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012475ad0 0x559012476020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.628+0000 7f07e357b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55901242df10 0x559012474190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.628+0000 7f07e357b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559012390a10 con 0x559012475ad0 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.628+0000 7f07e357b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559012339b30 con 0x55901242df10 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.628+0000 7f07e357b740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55901238cc50 con 0x559012458230 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.628+0000 7f07d9d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012475ad0 0x559012476020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07d9d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012475ad0 0x559012476020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55020/0 (socket says 172.21.15.172:55020) 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07d9d9b640 1 -- 172.21.15.172:0/1908515548 learned_addr learned my addr 172.21.15.172:0/1908515548 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07da59c640 1 --2- 172.21.15.172:0/1908515548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012458230 0x559012458610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07dad9d640 1 --2- 172.21.15.172:0/1908515548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55901242df10 0x559012474190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07d9d9b640 1 -- 172.21.15.172:0/1908515548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012458230 msgr2=0x559012458610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/1908515548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012458230 0x559012458610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07d9d9b640 1 -- 172.21.15.172:0/1908515548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55901242df10 msgr2=0x559012474190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/1908515548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55901242df10 0x559012474190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07d9d9b640 1 -- 172.21.15.172:0/1908515548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55901234ee10 con 0x559012475ad0 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/1908515548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012475ad0 0x559012476020 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f07d0007c80 tx=0x7f07d00078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d0edcace15afd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07bbfff640 1 -- 172.21.15.172:0/1908515548 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0007640 con 0x559012475ad0 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07bbfff640 1 -- 172.21.15.172:0/1908515548 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0019070 con 0x559012475ad0 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.629+0000 7f07bbfff640 1 -- 172.21.15.172:0/1908515548 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0014400 con 0x559012475ad0 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 -- 172.21.15.172:0/1908515548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012475ad0 msgr2=0x559012476020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 --2- 172.21.15.172:0/1908515548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012475ad0 0x559012476020 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f07d0007c80 tx=0x7f07d00078f0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 -- 172.21.15.172:0/1908515548 shutdown_connections 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 --2- 172.21.15.172:0/1908515548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55901242df10 0x559012474190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 --2- 172.21.15.172:0/1908515548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012475ad0 0x559012476020 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 --2- 172.21.15.172:0/1908515548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012458230 0x559012458610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 -- 172.21.15.172:0/1908515548 >> 172.21.15.172:0/1908515548 conn(0x55901242a840 msgr2=0x559012473040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:26.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 -- 172.21.15.172:0/1908515548 shutdown_connections 2024-04-25T08:49:26.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 -- 172.21.15.172:0/1908515548 wait complete. 2024-04-25T08:49:26.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 -- start start 2024-04-25T08:49:26.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.630+0000 7f07e357b740 1 Processor -- start 2024-04-25T08:49:26.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.631+0000 7f07e357b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012458230 0x559012458ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.631+0000 7f07e357b740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x55901245b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.631+0000 7f07e357b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012454c90 0x55901245bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.631+0000 7f07e357b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901242ecb0 con 0x559012458230 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.631+0000 7f07e357b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901234d0c0 con 0x559012454c90 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.631+0000 7f07e357b740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x559012428770 con 0x559012475ad0 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.631+0000 7f07e357b740 10 client.0 _ll_register_callbacks cb 0x559012340ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.631+0000 7f07da59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012458230 0x559012458ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.631+0000 7f07da59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012458230 0x559012458ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55030/0 (socket says 172.21.15.172:55030) 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.631+0000 7f07da59c640 1 -- 172.21.15.172:0/2730596646 learned_addr learned my addr 172.21.15.172:0/2730596646 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x55901245b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07dad9d640 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012454c90 0x55901245bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07da59c640 1 -- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 msgr2=0x55901245b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07da59c640 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x55901245b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07da59c640 1 -- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012454c90 msgr2=0x55901245bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07da59c640 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012454c90 0x55901245bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07da59c640 1 -- 172.21.15.172:0/2730596646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590120a52d0 con 0x559012458230 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07da59c640 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012458230 0x559012458ef0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f07cc016470 tx=0x7f07cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb39c69d4f625cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07b97fa640 1 -- 172.21.15.172:0/2730596646 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc028070 con 0x559012458230 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07e357b740 1 -- 172.21.15.172:0/2730596646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07d0019070 con 0x559012458230 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07b97fa640 1 -- 172.21.15.172:0/2730596646 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f07cc003b90 con 0x559012458230 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07b97fa640 1 -- 172.21.15.172:0/2730596646 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07cc032050 con 0x559012458230 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07e357b740 10 client.8298 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07e357b740 1 -- 172.21.15.172:0/2730596646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x55901216f6b0 con 0x559012458230 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07b97fa640 1 -- 172.21.15.172:0/2730596646 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0019070 con 0x559012458230 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07b97fa640 1 -- 172.21.15.172:0/2730596646 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f07cc035020 con 0x559012458230 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07e357b740 10 client.8298 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07e357b740 10 client.8298 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.632+0000 7f07e357b740 20 client.8298 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:26.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.633+0000 7f07e357b740 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x559012484c30 0x559012491ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.633+0000 7f07e357b740 4 client.8298 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.633+0000 7f07e357b740 1 -- 172.21.15.172:0/2730596646 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590123ef920 con 0x559012484c30 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.633+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x559012484c30 0x559012491ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.633+0000 7f07b97fa640 10 client.8298 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.633+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x559012484c30 0x559012491ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65a405c0d05cdba5 server_cookie=6fc8934c735c7485 in_seq=0 out_seq=0 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07b97fa640 1 -- 172.21.15.172:0/2730596646 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5590123ef920 con 0x559012484c30 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07b97fa640 10 client.8298 handle_command_reply: tid=0 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 client.8298 shutdown 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 -- 172.21.15.172:0/2730596646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012458230 msgr2=0x559012458ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012458230 0x559012458ef0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f07cc016470 tx=0x7f07cc004ab0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 -- 172.21.15.172:0/2730596646 shutdown_connections 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x559012484c30 0x559012491ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012454c90 0x55901245bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x55901245b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 --2- 172.21.15.172:0/2730596646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012458230 0x559012458ef0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07b97fa640 0 client.8298 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:26.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 -- 172.21.15.172:0/2730596646 >> 172.21.15.172:0/2730596646 conn(0x55901242df10 msgr2=0x559012476e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:26.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 -- 172.21.15.172:0/2730596646 shutdown_connections 2024-04-25T08:49:26.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 1 -- 172.21.15.172:0/2730596646 wait complete. 2024-04-25T08:49:26.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.634+0000 7f07e357b740 20 client.8298 trim_cache size 0 max 16384 2024-04-25T08:49:26.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.650+0000 7f07e357b740 1 Processor -- start 2024-04-25T08:49:26.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.650+0000 7f07e357b740 1 -- start start 2024-04-25T08:49:26.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.650+0000 7f07e357b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x55901242e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.650+0000 7f07e357b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 0x55901242bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.650+0000 7f07e357b740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x55901242c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.650+0000 7f07e357b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc200a60 con 0x559012454c90 2024-04-25T08:49:26.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.650+0000 7f07e357b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1ffc00 con 0x559012458230 2024-04-25T08:49:26.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.650+0000 7f07e357b740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1ff030 con 0x559012475ad0 2024-04-25T08:49:26.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07da59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x55901242e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07da59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x55901242e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55034/0 (socket says 172.21.15.172:55034) 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07da59c640 1 -- 172.21.15.172:0/4191619987 learned_addr learned my addr 172.21.15.172:0/4191619987 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07da59c640 1 -- 172.21.15.172:0/4191619987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 msgr2=0x55901242c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07dad9d640 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x55901242c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 0x55901242bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07da59c640 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x55901242c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07da59c640 1 -- 172.21.15.172:0/4191619987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 msgr2=0x55901242bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07da59c640 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 0x55901242bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07da59c640 1 -- 172.21.15.172:0/4191619987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559012459260 con 0x559012454c90 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07dad9d640 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x55901242c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 0x55901242bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07da59c640 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x55901242e4e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0099f0 tx=0x7f07cc024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c49f0e523de2e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07bb7fe640 1 -- 172.21.15.172:0/4191619987 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc028040 con 0x559012454c90 2024-04-25T08:49:26.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07bb7fe640 1 -- 172.21.15.172:0/4191619987 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc03a030 con 0x559012454c90 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.651+0000 7f07bb7fe640 1 -- 172.21.15.172:0/4191619987 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc01e040 con 0x559012454c90 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 -- 172.21.15.172:0/4191619987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 msgr2=0x55901242e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x55901242e4e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0099f0 tx=0x7f07cc024000 comp rx=0 tx=0).stop 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 -- 172.21.15.172:0/4191619987 shutdown_connections 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 0x55901242bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x55901242c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 --2- 172.21.15.172:0/4191619987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x55901242e4e0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 -- 172.21.15.172:0/4191619987 >> 172.21.15.172:0/4191619987 conn(0x55901242df10 msgr2=0x559012475360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 -- 172.21.15.172:0/4191619987 shutdown_connections 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 -- 172.21.15.172:0/4191619987 wait complete. 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 -- start start 2024-04-25T08:49:26.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.652+0000 7f07e357b740 1 Processor -- start 2024-04-25T08:49:26.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07e357b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x5590124531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07e357b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 0x5590124e1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07e357b740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x559012427a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07e357b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559012459c90 con 0x559012454c90 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07e357b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1ff600 con 0x559012458230 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07e357b740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55901245a2a0 con 0x559012475ad0 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07e357b740 10 client.0 _ll_register_callbacks cb 0x559012428c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07da59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x5590124531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07da59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x5590124531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55036/0 (socket says 172.21.15.172:55036) 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07da59c640 1 -- 172.21.15.172:0/4069874612 learned_addr learned my addr 172.21.15.172:0/4069874612 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 0x5590124e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.653+0000 7f07dad9d640 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x559012427a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07da59c640 1 -- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 msgr2=0x559012427a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07da59c640 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x559012427a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07da59c640 1 -- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 msgr2=0x5590124e1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07da59c640 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 0x5590124e1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07da59c640 1 -- 172.21.15.172:0/4069874612 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559012459520 con 0x559012454c90 2024-04-25T08:49:26.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07da59c640 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x5590124531c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00b010 tx=0x7f07cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480f40ad22828985 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07b97fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07b97fa640 1 -- 172.21.15.172:0/4069874612 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc01e070 con 0x559012454c90 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07b97fa640 1 -- 172.21.15.172:0/4069874612 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f07cc008070 con 0x559012454c90 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07e357b740 1 -- 172.21.15.172:0/4069874612 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07cc03a030 con 0x559012454c90 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07b97fa640 1 -- 172.21.15.172:0/4069874612 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07cc04f050 con 0x559012454c90 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07e357b740 10 client.8304 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07e357b740 1 -- 172.21.15.172:0/4069874612 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x559012450cd0 con 0x559012454c90 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07b97fa640 1 -- 172.21.15.172:0/4069874612 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc03a030 con 0x559012454c90 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07b97fa640 1 -- 172.21.15.172:0/4069874612 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f07cc052020 con 0x559012454c90 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07e357b740 10 client.8304 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07e357b740 10 client.8304 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07e357b740 20 client.8304 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:26.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07e357b740 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x559012427ff0 0x5590124689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07e357b740 4 client.8304 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.654+0000 7f07e357b740 1 -- 172.21.15.172:0/4069874612 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55901246d730 con 0x559012427ff0 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x559012427ff0 0x5590124689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07b97fa640 10 client.8304 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07d9d9b640 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x559012427ff0 0x5590124689d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb60a5b4bebea4c7 server_cookie=45edc82664289b4f in_seq=0 out_seq=0 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07b97fa640 1 -- 172.21.15.172:0/4069874612 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55901246d730 con 0x559012427ff0 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07b97fa640 10 client.8304 handle_command_reply: tid=0 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 client.8304 shutdown 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 -- 172.21.15.172:0/4069874612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 msgr2=0x5590124531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x5590124531c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f07cc00b010 tx=0x7f07cc017000 comp rx=0 tx=0).stop 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 -- 172.21.15.172:0/4069874612 shutdown_connections 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x559012427ff0 0x5590124689d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559012458230 0x5590124e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559012475ad0 0x559012427a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 --2- 172.21.15.172:0/4069874612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559012454c90 0x5590124531c0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07b97fa640 0 client.8304 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 -- 172.21.15.172:0/4069874612 >> 172.21.15.172:0/4069874612 conn(0x55901242df10 msgr2=0x55901242e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 -- 172.21.15.172:0/4069874612 shutdown_connections 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 1 -- 172.21.15.172:0/4069874612 wait complete. 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.655+0000 7f07e357b740 20 client.8304 trim_cache size 0 max 16384 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 8124, 2024-04-25T08:49:26.653 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:49:26.654 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:49:26.654 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:49:26.654 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 8.9381748440000006, 2024-04-25T08:49:26.654 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 62, 2024-04-25T08:49:26.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 107, 2024-04-25T08:49:26.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 107, 2024-04-25T08:49:26.654 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 14.003396776000001 2024-04-25T08:49:26.654 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:49:26.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 -- 172.21.15.172:0/1764200526 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07bc06b4d0 msgr2=0x7f07bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07bc06b4d0 0x7f07bc06d990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f07cc007560 tx=0x7f07cc00b040 comp rx=0 tx=0).stop 2024-04-25T08:49:26.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 -- 172.21.15.172:0/1764200526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07dc1590b0 msgr2=0x7f07dc159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07dc1590b0 0x7f07dc159530 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009ac0 tx=0x7f07d4004730 comp rx=0 tx=0).stop 2024-04-25T08:49:26.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 -- 172.21.15.172:0/1764200526 shutdown_connections 2024-04-25T08:49:26.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07bc06b4d0 0x7f07bc06d990 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07dc1590b0 0x7f07dc159530 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f07dc147d70 0x7f07dc15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 --2- 172.21.15.172:0/1764200526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f07c4004d40 0x7f07dc15c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 -- 172.21.15.172:0/1764200526 >> 172.21.15.172:0/1764200526 conn(0x7f07dc06abe0 msgr2=0x7f07dc0cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:26.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 -- 172.21.15.172:0/1764200526 shutdown_connections 2024-04-25T08:49:26.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.656+0000 7f07e086f640 1 -- 172.21.15.172:0/1764200526 wait complete. 2024-04-25T08:49:26.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:49:26.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.765+0000 7fda61ba9640 1 Processor -- start 2024-04-25T08:49:26.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.765+0000 7fda61ba9640 1 -- start start 2024-04-25T08:49:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.766+0000 7fda61ba9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda5c1602e0 0x7fda5c0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.766+0000 7fda61ba9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fda5c15f5f0 0x7fda5c15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.766+0000 7fda61ba9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c0cd710 con 0x7fda5c15ba00 2024-04-25T08:49:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.766+0000 7fda61ba9640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c099b70 con 0x7fda5c15f5f0 2024-04-25T08:49:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.766+0000 7fda61ba9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c099e50 con 0x7fda5c1602e0 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.766+0000 7fda5b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fda5c15ba00 0x7fda5c09a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40864/0 (socket says 172.21.15.172:40864) 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.766+0000 7fda5b7fe640 1 -- 172.21.15.172:0/3485686011 learned_addr learned my addr 172.21.15.172:0/3485686011 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.766+0000 7fda5affd640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda5c1602e0 0x7fda5c0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.766+0000 7fda5bfff640 1 --2- 172.21.15.172:0/3485686011 >> v2:172.21.15.186:3300/0 conn(0x7fda5c15f5f0 0x7fda5c15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174489321 0 0) 0x7fda4c001110 con 0x7fda5c15ba00 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda44003520 con 0x7fda5c15ba00 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2071809699 0 0) 0x7fda44003520 con 0x7fda5c15ba00 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda5c1602e0 msgr2=0x7fda5c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda5c1602e0 0x7fda5c0ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 >> v2:172.21.15.186:3300/0 conn(0x7fda5c15f5f0 msgr2=0x7fda5c15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 --2- 172.21.15.172:0/3485686011 >> v2:172.21.15.186:3300/0 conn(0x7fda5c15f5f0 0x7fda5c15faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c09a130 con 0x7fda5c15ba00 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fda4c001840 con 0x7fda5c15ba00 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 >> v1:172.21.15.172:6789/0 conn(0x7fda5c15ba00 legacy=0x7fda5c09a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda440039b0 0x7fda44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda5c1602e0 0x7fda44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda44004d40 0x7fda440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c099b70 con 0x7fda440039b0 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c099e50 con 0x7fda44004d40 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4400ba40 con 0x7fda5c1602e0 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5b7fe640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda440039b0 0x7fda44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5bfff640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda44004d40 0x7fda440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5affd640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda5c1602e0 0x7fda44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5b7fe640 1 -- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda5c1602e0 msgr2=0x7fda44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5b7fe640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda5c1602e0 0x7fda44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5b7fe640 1 -- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda44004d40 msgr2=0x7fda440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5b7fe640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda44004d40 0x7fda440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5b7fe640 1 -- 172.21.15.172:0/3485686011 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44003520 con 0x7fda440039b0 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5bfff640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda44004d40 0x7fda440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.767+0000 7fda5affd640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda5c1602e0 0x7fda44004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.768+0000 7fda5b7fe640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda440039b0 0x7fda44003dd0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00c3b0 tx=0x7fda44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225b5343aa02428d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.768+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00c0e0 con 0x7fda440039b0 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.768+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c034070 con 0x7fda440039b0 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.768+0000 7fda5a7fc640 1 -- 172.21.15.172:0/3485686011 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c005d10 con 0x7fda440039b0 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.769+0000 7fda61ba9640 1 -- 172.21.15.172:0/3485686011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda440039b0 msgr2=0x7fda44003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.769+0000 7fda61ba9640 1 --2- 172.21.15.172:0/3485686011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda440039b0 0x7fda44003dd0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00c3b0 tx=0x7fda44005830 comp rx=0 tx=0).stop 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.769+0000 7fda5bfff640 1 -- 172.21.15.172:0/3485686011 reap_dead start 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.769+0000 7fda61ba9640 1 -- 172.21.15.172:0/3485686011 shutdown_connections 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.769+0000 7fda61ba9640 1 -- 172.21.15.172:0/3485686011 >> 172.21.15.172:0/3485686011 conn(0x7fda5c0b3270 msgr2=0x7fda5c0b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.769+0000 7fda61ba9640 1 -- 172.21.15.172:0/3485686011 shutdown_connections 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.769+0000 7fda61ba9640 1 -- 172.21.15.172:0/3485686011 wait complete. 2024-04-25T08:49:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.770+0000 7fda61ba9640 1 Processor -- start 2024-04-25T08:49:26.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.770+0000 7fda61ba9640 1 -- start start 2024-04-25T08:49:26.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda61ba9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda440039b0 0x7fda5c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda61ba9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda5c0cb490 0x7fda5c0b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda61ba9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda5c0b6c20 0x7fda5c1e6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda61ba9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0ccf20 con 0x7fda5c0cb490 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda61ba9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0ccda0 con 0x7fda5c0b6c20 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda61ba9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0cd0a0 con 0x7fda440039b0 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda5c0cb490 0x7fda5c0b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda5c0cb490 0x7fda5c0b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55058/0 (socket says 172.21.15.172:55058) 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5affd640 1 -- 172.21.15.172:0/264436581 learned_addr learned my addr 172.21.15.172:0/264436581 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5b7fe640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda440039b0 0x7fda5c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5bfff640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda5c0b6c20 0x7fda5c1e6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5affd640 1 -- 172.21.15.172:0/264436581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda440039b0 msgr2=0x7fda5c0b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5affd640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda440039b0 0x7fda5c0b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5affd640 1 -- 172.21.15.172:0/264436581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda5c0b6c20 msgr2=0x7fda5c1e6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5affd640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda5c0b6c20 0x7fda5c1e6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5affd640 1 -- 172.21.15.172:0/264436581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c1e78c0 con 0x7fda5c0cb490 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda5affd640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda5c0cb490 0x7fda5c0b66e0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fda500116d0 tx=0x7fda50011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda43fff640 1 -- 172.21.15.172:0/264436581 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5000f9c0 con 0x7fda5c0cb490 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda43fff640 1 -- 172.21.15.172:0/264436581 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5000fb60 con 0x7fda5c0cb490 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda61ba9640 1 -- 172.21.15.172:0/264436581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c1e7ba0 con 0x7fda5c0cb490 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda43fff640 1 -- 172.21.15.172:0/264436581 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50015460 con 0x7fda5c0cb490 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.771+0000 7fda61ba9640 1 -- 172.21.15.172:0/264436581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c0b70a0 con 0x7fda5c0cb490 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.772+0000 7fda61ba9640 1 -- 172.21.15.172:0/264436581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c0c7790 con 0x7fda5c0cb490 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.773+0000 7fda43fff640 1 -- 172.21.15.172:0/264436581 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda50015600 con 0x7fda5c0cb490 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.773+0000 7fda43fff640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4806b4d0 0x7fda4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.773+0000 7fda43fff640 1 -- 172.21.15.172:0/264436581 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fda5008abe0 con 0x7fda5c0cb490 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.773+0000 7fda5b7fe640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4806b4d0 0x7fda4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:26.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.774+0000 7fda5b7fe640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4806b4d0 0x7fda4806d990 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fda4c033000 tx=0x7fda4c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:26.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.778+0000 7fda43fff640 1 -- 172.21.15.172:0/264436581 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda5c0c7790 con 0x7fda5c0cb490 2024-04-25T08:49:26.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.985+0000 7fda61ba9640 1 -- 172.21.15.172:0/264436581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fda5c073990 con 0x7fda5c0cb490 2024-04-25T08:49:26.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.986+0000 7fda43fff640 1 -- 172.21.15.172:0/264436581 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7fda50019030 con 0x7fda5c0cb490 2024-04-25T08:49:26.977 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.987+0000 7fda61ba9640 1 -- 172.21.15.172:0/264436581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4806b4d0 msgr2=0x7fda4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.987+0000 7fda61ba9640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4806b4d0 0x7fda4806d990 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fda4c033000 tx=0x7fda4c03d040 comp rx=0 tx=0).stop 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.987+0000 7fda61ba9640 1 -- 172.21.15.172:0/264436581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda5c0cb490 msgr2=0x7fda5c0b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.987+0000 7fda61ba9640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda5c0cb490 0x7fda5c0b66e0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fda500116d0 tx=0x7fda50011b90 comp rx=0 tx=0).stop 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.988+0000 7fda61ba9640 1 -- 172.21.15.172:0/264436581 shutdown_connections 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.988+0000 7fda61ba9640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4806b4d0 0x7fda4806d990 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.988+0000 7fda61ba9640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda5c0b6c20 0x7fda5c1e6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.988+0000 7fda61ba9640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda5c0cb490 0x7fda5c0b66e0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.988+0000 7fda61ba9640 1 --2- 172.21.15.172:0/264436581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda440039b0 0x7fda5c0b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.988+0000 7fda61ba9640 1 -- 172.21.15.172:0/264436581 >> 172.21.15.172:0/264436581 conn(0x7fda5c0b3270 msgr2=0x7fda5c070660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:26.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.988+0000 7fda61ba9640 1 -- 172.21.15.172:0/264436581 shutdown_connections 2024-04-25T08:49:26.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:26.988+0000 7fda61ba9640 1 -- 172.21.15.172:0/264436581 wait complete. 2024-04-25T08:49:26.990 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:49:26.990 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:49:26.990 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:49:26.990 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:49:26.990 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:49:26.990 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:49:26.990 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:49:26.990 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:49:26.990 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:49:26.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:26.990 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:49:27.005 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:49:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:49:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:49:27.005 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:49:27.006 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42352sec preferred_lft 42352sec 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:49:27.007 INFO:teuthology.orchestra.run.smithi172.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:49:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether de:e6:d5:6e:7d:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:49:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::dce6:d5ff:fe6e:7d91/64 scope link 2024-04-25T08:49:27.008 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:49:27.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:27.008 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:49:27.067 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:49:27.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:27.069 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:49:27.125 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:49:27.125 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:49:27.125 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:49:27.125 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:49:27.125 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:49:27.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:27.125 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:49:27.126 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:27.126 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:49:27.126 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:49:27.126 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:49:27.126 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:27.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:27.210 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:49:27.225 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:49:27.225 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:49:27.225 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:49:27.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:27.225 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:49:27.290 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:49:27.290 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:49:27.346 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:49:27.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:49:27.346 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:49:27.401 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:49:27.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:27.401 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:49:27.483 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:49:27.483 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:49:27.483 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:49:27.491 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:49:27.491 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:49:27.491 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:49:27.491 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:49:27.491 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:49:27.496 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:49:27.496 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:49:27.496 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:49:27.496 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:49:27.497 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:49:27.497 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:49:27.497 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:49:27.497 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:49:27.497 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:49:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:49:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:49:27.497 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:49:27.498 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:49:27.498 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:49:27.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:27.499 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:49:27.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:27.564 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:49:27.626 INFO:teuthology.orchestra.run.smithi172.stdout:client6416 2024-04-25T08:49:27.627 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:27.627 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:27.682 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-04-25T08:49:27.682 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-04-25T08:49:27.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:27.683 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:27.683 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:27.683 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T08:49:27.683 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:27.683 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:27.683 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:27.683 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:27.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.754 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950176 s, 110 MB/s 2024-04-25T08:49:27.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.763 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826413 s, 127 MB/s 2024-04-25T08:49:27.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.771 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751434 s, 140 MB/s 2024-04-25T08:49:27.779 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.779 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.779 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704586 s, 149 MB/s 2024-04-25T08:49:27.787 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.788 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786818 s, 133 MB/s 2024-04-25T08:49:27.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.795 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635113 s, 165 MB/s 2024-04-25T08:49:27.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.802 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675642 s, 155 MB/s 2024-04-25T08:49:27.811 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.811 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.811 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786407 s, 133 MB/s 2024-04-25T08:49:27.819 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.819 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.819 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706668 s, 148 MB/s 2024-04-25T08:49:27.827 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.827 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.827 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659624 s, 159 MB/s 2024-04-25T08:49:27.834 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.834 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.834 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648014 s, 162 MB/s 2024-04-25T08:49:27.841 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.841 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.841 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592654 s, 177 MB/s 2024-04-25T08:49:27.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.849 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071435 s, 147 MB/s 2024-04-25T08:49:27.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.857 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727034 s, 144 MB/s 2024-04-25T08:49:27.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.864 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659849 s, 159 MB/s 2024-04-25T08:49:27.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.872 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600139 s, 175 MB/s 2024-04-25T08:49:27.879 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.879 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.880 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071277 s, 147 MB/s 2024-04-25T08:49:27.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.887 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669087 s, 157 MB/s 2024-04-25T08:49:27.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.894 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.894 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583698 s, 180 MB/s 2024-04-25T08:49:27.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.901 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661047 s, 159 MB/s 2024-04-25T08:49:27.907 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.908 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.908 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559871 s, 187 MB/s 2024-04-25T08:49:27.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.917 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.917 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00813049 s, 129 MB/s 2024-04-25T08:49:27.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.925 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721389 s, 145 MB/s 2024-04-25T08:49:27.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.933 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719797 s, 146 MB/s 2024-04-25T08:49:27.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.940 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641619 s, 163 MB/s 2024-04-25T08:49:27.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.948 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637961 s, 164 MB/s 2024-04-25T08:49:27.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.955 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623953 s, 168 MB/s 2024-04-25T08:49:27.962 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.962 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.962 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677289 s, 155 MB/s 2024-04-25T08:49:27.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.970 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007115 s, 147 MB/s 2024-04-25T08:49:27.978 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733715 s, 143 MB/s 2024-04-25T08:49:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642605 s, 163 MB/s 2024-04-25T08:49:27.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:27.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:27.992 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575109 s, 182 MB/s 2024-04-25T08:49:27.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:27.994 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:27.994 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:27.994 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T08:49:27.994 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:27.994 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:27.994 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:27.994 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:28.058 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.059 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707572 s, 148 MB/s 2024-04-25T08:49:28.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.065 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549572 s, 191 MB/s 2024-04-25T08:49:28.071 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.071 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.072 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578284 s, 181 MB/s 2024-04-25T08:49:28.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.079 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680309 s, 154 MB/s 2024-04-25T08:49:28.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.086 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556417 s, 188 MB/s 2024-04-25T08:49:28.093 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.093 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.093 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628707 s, 167 MB/s 2024-04-25T08:49:28.101 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.101 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.101 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726609 s, 144 MB/s 2024-04-25T08:49:28.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.108 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565408 s, 185 MB/s 2024-04-25T08:49:28.114 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.114 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.114 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058727 s, 179 MB/s 2024-04-25T08:49:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.122 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663321 s, 158 MB/s 2024-04-25T08:49:28.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.129 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639717 s, 164 MB/s 2024-04-25T08:49:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.136 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624668 s, 168 MB/s 2024-04-25T08:49:28.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.143 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064157 s, 163 MB/s 2024-04-25T08:49:28.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.152 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703712 s, 149 MB/s 2024-04-25T08:49:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.159 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654424 s, 160 MB/s 2024-04-25T08:49:28.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.166 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637997 s, 164 MB/s 2024-04-25T08:49:28.174 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.174 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.174 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007293 s, 144 MB/s 2024-04-25T08:49:28.181 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.181 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.181 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646545 s, 162 MB/s 2024-04-25T08:49:28.188 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.188 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.189 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642309 s, 163 MB/s 2024-04-25T08:49:28.195 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.195 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.195 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00552305 s, 190 MB/s 2024-04-25T08:49:28.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.201 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005602 s, 187 MB/s 2024-04-25T08:49:28.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.209 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632097 s, 166 MB/s 2024-04-25T08:49:28.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.216 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612863 s, 171 MB/s 2024-04-25T08:49:28.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.223 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660469 s, 159 MB/s 2024-04-25T08:49:28.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.231 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699097 s, 150 MB/s 2024-04-25T08:49:28.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.238 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628452 s, 167 MB/s 2024-04-25T08:49:28.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.245 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622577 s, 168 MB/s 2024-04-25T08:49:28.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.252 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624477 s, 168 MB/s 2024-04-25T08:49:28.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.259 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606558 s, 173 MB/s 2024-04-25T08:49:28.266 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.266 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.266 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642366 s, 163 MB/s 2024-04-25T08:49:28.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.274 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724393 s, 145 MB/s 2024-04-25T08:49:28.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.281 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063598 s, 165 MB/s 2024-04-25T08:49:28.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:28.283 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:28.283 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:28.283 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T08:49:28.283 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:28.283 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:28.283 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:28.283 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:28.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.347 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572078 s, 183 MB/s 2024-04-25T08:49:28.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.354 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620682 s, 169 MB/s 2024-04-25T08:49:28.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.361 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666296 s, 157 MB/s 2024-04-25T08:49:28.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.368 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631099 s, 166 MB/s 2024-04-25T08:49:28.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.375 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616359 s, 170 MB/s 2024-04-25T08:49:28.382 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.382 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.382 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632879 s, 166 MB/s 2024-04-25T08:49:28.389 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.390 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636535 s, 165 MB/s 2024-04-25T08:49:28.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.397 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638799 s, 164 MB/s 2024-04-25T08:49:28.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.405 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711717 s, 147 MB/s 2024-04-25T08:49:28.411 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.411 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.411 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005682 s, 185 MB/s 2024-04-25T08:49:28.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.418 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616319 s, 170 MB/s 2024-04-25T08:49:28.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634159 s, 165 MB/s 2024-04-25T08:49:28.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.434 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711571 s, 147 MB/s 2024-04-25T08:49:28.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.441 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623662 s, 168 MB/s 2024-04-25T08:49:28.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.448 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621706 s, 169 MB/s 2024-04-25T08:49:28.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.456 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703117 s, 149 MB/s 2024-04-25T08:49:28.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.463 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637462 s, 164 MB/s 2024-04-25T08:49:28.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.471 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713379 s, 147 MB/s 2024-04-25T08:49:28.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.478 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.478 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566449 s, 185 MB/s 2024-04-25T08:49:28.485 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.485 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.485 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630022 s, 166 MB/s 2024-04-25T08:49:28.492 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.492 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.492 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623986 s, 168 MB/s 2024-04-25T08:49:28.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.500 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694585 s, 151 MB/s 2024-04-25T08:49:28.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.506 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569902 s, 184 MB/s 2024-04-25T08:49:28.514 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.514 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.515 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720408 s, 146 MB/s 2024-04-25T08:49:28.521 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.521 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.521 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573855 s, 183 MB/s 2024-04-25T08:49:28.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.529 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685321 s, 153 MB/s 2024-04-25T08:49:28.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.535 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055487 s, 189 MB/s 2024-04-25T08:49:28.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.544 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746007 s, 141 MB/s 2024-04-25T08:49:28.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.552 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740941 s, 142 MB/s 2024-04-25T08:49:28.559 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.559 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.559 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633127 s, 166 MB/s 2024-04-25T08:49:28.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.567 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691818 s, 152 MB/s 2024-04-25T08:49:28.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.574 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006427 s, 163 MB/s 2024-04-25T08:49:28.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:28.575 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:28.575 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:28.576 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T08:49:28.576 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:28.576 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:28.576 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:28.576 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:28.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.641 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741763 s, 141 MB/s 2024-04-25T08:49:28.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.648 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618489 s, 170 MB/s 2024-04-25T08:49:28.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.655 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634925 s, 165 MB/s 2024-04-25T08:49:28.663 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.663 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.663 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072421 s, 145 MB/s 2024-04-25T08:49:28.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.671 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628821 s, 167 MB/s 2024-04-25T08:49:28.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.677 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626846 s, 167 MB/s 2024-04-25T08:49:28.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.685 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643993 s, 163 MB/s 2024-04-25T08:49:28.691 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.691 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.691 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568689 s, 184 MB/s 2024-04-25T08:49:28.699 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.699 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.699 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704162 s, 149 MB/s 2024-04-25T08:49:28.706 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.706 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.706 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567348 s, 185 MB/s 2024-04-25T08:49:28.713 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.713 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.713 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631806 s, 166 MB/s 2024-04-25T08:49:28.721 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.721 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.721 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068966 s, 152 MB/s 2024-04-25T08:49:28.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.727 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568529 s, 184 MB/s 2024-04-25T08:49:28.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.735 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650735 s, 161 MB/s 2024-04-25T08:49:28.743 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.743 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.743 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703355 s, 149 MB/s 2024-04-25T08:49:28.751 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.751 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.751 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727467 s, 144 MB/s 2024-04-25T08:49:28.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.759 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700462 s, 150 MB/s 2024-04-25T08:49:28.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.766 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596279 s, 176 MB/s 2024-04-25T08:49:28.772 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.772 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.772 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584553 s, 179 MB/s 2024-04-25T08:49:28.780 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.781 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719451 s, 146 MB/s 2024-04-25T08:49:28.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.788 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647805 s, 162 MB/s 2024-04-25T08:49:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654358 s, 160 MB/s 2024-04-25T08:49:28.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.803 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617157 s, 170 MB/s 2024-04-25T08:49:28.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.810 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658305 s, 159 MB/s 2024-04-25T08:49:28.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.817 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587955 s, 178 MB/s 2024-04-25T08:49:28.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.824 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603144 s, 174 MB/s 2024-04-25T08:49:28.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.832 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.832 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069819 s, 150 MB/s 2024-04-25T08:49:28.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.840 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727618 s, 144 MB/s 2024-04-25T08:49:28.846 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.846 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.846 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567664 s, 185 MB/s 2024-04-25T08:49:28.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.853 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573792 s, 183 MB/s 2024-04-25T08:49:28.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.860 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646369 s, 162 MB/s 2024-04-25T08:49:28.868 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.868 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.868 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661066 s, 159 MB/s 2024-04-25T08:49:28.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:28.869 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:28.869 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:28.869 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T08:49:28.869 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:28.869 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:28.869 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:28.869 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:28.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.934 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689757 s, 152 MB/s 2024-04-25T08:49:28.942 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.942 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.942 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069728 s, 150 MB/s 2024-04-25T08:49:28.950 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.950 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.950 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681538 s, 154 MB/s 2024-04-25T08:49:28.957 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.958 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.958 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676428 s, 155 MB/s 2024-04-25T08:49:28.965 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.965 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.965 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724213 s, 145 MB/s 2024-04-25T08:49:28.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.973 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673551 s, 156 MB/s 2024-04-25T08:49:28.979 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.979 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.979 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587347 s, 179 MB/s 2024-04-25T08:49:28.986 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.986 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.987 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606733 s, 173 MB/s 2024-04-25T08:49:28.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:28.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:28.995 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736097 s, 142 MB/s 2024-04-25T08:49:29.002 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.002 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.003 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659272 s, 159 MB/s 2024-04-25T08:49:29.009 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.009 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.010 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620467 s, 169 MB/s 2024-04-25T08:49:29.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.018 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718389 s, 146 MB/s 2024-04-25T08:49:29.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.025 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652558 s, 161 MB/s 2024-04-25T08:49:29.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.032 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662109 s, 158 MB/s 2024-04-25T08:49:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621515 s, 169 MB/s 2024-04-25T08:49:29.047 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.047 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.047 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666994 s, 157 MB/s 2024-04-25T08:49:29.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.054 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642582 s, 163 MB/s 2024-04-25T08:49:29.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.061 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613346 s, 171 MB/s 2024-04-25T08:49:29.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.069 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.069 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651511 s, 161 MB/s 2024-04-25T08:49:29.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.075 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579991 s, 181 MB/s 2024-04-25T08:49:29.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.083 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695924 s, 151 MB/s 2024-04-25T08:49:29.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.091 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687438 s, 153 MB/s 2024-04-25T08:49:29.098 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.098 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.098 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616429 s, 170 MB/s 2024-04-25T08:49:29.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.106 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712635 s, 147 MB/s 2024-04-25T08:49:29.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.113 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649231 s, 162 MB/s 2024-04-25T08:49:29.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.120 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604971 s, 173 MB/s 2024-04-25T08:49:29.128 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.129 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747736 s, 140 MB/s 2024-04-25T08:49:29.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.137 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697938 s, 150 MB/s 2024-04-25T08:49:29.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635358 s, 165 MB/s 2024-04-25T08:49:29.152 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.152 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.152 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728445 s, 144 MB/s 2024-04-25T08:49:29.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.160 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.160 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653006 s, 161 MB/s 2024-04-25T08:49:29.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.166 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060063 s, 175 MB/s 2024-04-25T08:49:29.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:29.168 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:29.168 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:29.168 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T08:49:29.168 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:29.168 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:29.168 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:29.168 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:29.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.233 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726333 s, 144 MB/s 2024-04-25T08:49:29.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.240 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631128 s, 166 MB/s 2024-04-25T08:49:29.247 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.247 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.247 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633863 s, 165 MB/s 2024-04-25T08:49:29.255 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.255 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.255 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642117 s, 163 MB/s 2024-04-25T08:49:29.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.262 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058686 s, 179 MB/s 2024-04-25T08:49:29.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.269 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650699 s, 161 MB/s 2024-04-25T08:49:29.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.276 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598096 s, 175 MB/s 2024-04-25T08:49:29.284 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.284 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.284 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691777 s, 152 MB/s 2024-04-25T08:49:29.290 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.290 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.291 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570379 s, 184 MB/s 2024-04-25T08:49:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.297 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058614 s, 179 MB/s 2024-04-25T08:49:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.304 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637972 s, 164 MB/s 2024-04-25T08:49:29.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.312 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650653 s, 161 MB/s 2024-04-25T08:49:29.320 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.320 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.320 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696113 s, 151 MB/s 2024-04-25T08:49:29.327 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.327 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.327 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629956 s, 166 MB/s 2024-04-25T08:49:29.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.334 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562175 s, 187 MB/s 2024-04-25T08:49:29.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.341 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624362 s, 168 MB/s 2024-04-25T08:49:29.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.348 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644029 s, 163 MB/s 2024-04-25T08:49:29.355 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.355 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.355 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630219 s, 166 MB/s 2024-04-25T08:49:29.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.362 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618869 s, 169 MB/s 2024-04-25T08:49:29.370 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.370 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.370 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706419 s, 148 MB/s 2024-04-25T08:49:29.377 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.377 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.377 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636927 s, 165 MB/s 2024-04-25T08:49:29.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.385 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.385 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636142 s, 165 MB/s 2024-04-25T08:49:29.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.391 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579492 s, 181 MB/s 2024-04-25T08:49:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.398 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573778 s, 183 MB/s 2024-04-25T08:49:29.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.405 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631329 s, 166 MB/s 2024-04-25T08:49:29.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069468 s, 151 MB/s 2024-04-25T08:49:29.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.420 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638983 s, 164 MB/s 2024-04-25T08:49:29.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.427 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617822 s, 170 MB/s 2024-04-25T08:49:29.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.434 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615092 s, 170 MB/s 2024-04-25T08:49:29.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.442 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593533 s, 177 MB/s 2024-04-25T08:49:29.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.448 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586069 s, 179 MB/s 2024-04-25T08:49:29.455 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.455 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.455 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587849 s, 178 MB/s 2024-04-25T08:49:29.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:29.456 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:29.456 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:29.456 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T08:49:29.456 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:29.457 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:29.457 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:29.457 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:29.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.520 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574953 s, 182 MB/s 2024-04-25T08:49:29.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.529 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766157 s, 137 MB/s 2024-04-25T08:49:29.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.535 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598641 s, 175 MB/s 2024-04-25T08:49:29.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.543 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643309 s, 163 MB/s 2024-04-25T08:49:29.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720814 s, 145 MB/s 2024-04-25T08:49:29.557 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.557 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558899 s, 188 MB/s 2024-04-25T08:49:29.564 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.565 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630394 s, 166 MB/s 2024-04-25T08:49:29.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.572 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645704 s, 162 MB/s 2024-04-25T08:49:29.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.579 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593567 s, 177 MB/s 2024-04-25T08:49:29.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.586 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637809 s, 164 MB/s 2024-04-25T08:49:29.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.593 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593014 s, 177 MB/s 2024-04-25T08:49:29.600 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.600 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.600 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603481 s, 174 MB/s 2024-04-25T08:49:29.609 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.609 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.610 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637809 s, 164 MB/s 2024-04-25T08:49:29.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.615 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686118 s, 153 MB/s 2024-04-25T08:49:29.623 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.623 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.623 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724896 s, 145 MB/s 2024-04-25T08:49:29.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712926 s, 147 MB/s 2024-04-25T08:49:29.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.638 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647423 s, 162 MB/s 2024-04-25T08:49:29.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.646 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062748 s, 167 MB/s 2024-04-25T08:49:29.653 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.653 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.653 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710764 s, 148 MB/s 2024-04-25T08:49:29.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.662 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739742 s, 142 MB/s 2024-04-25T08:49:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733713 s, 143 MB/s 2024-04-25T08:49:29.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.677 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622845 s, 168 MB/s 2024-04-25T08:49:29.684 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.684 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.684 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059501 s, 176 MB/s 2024-04-25T08:49:29.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.690 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563778 s, 186 MB/s 2024-04-25T08:49:29.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.697 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.697 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00540557 s, 194 MB/s 2024-04-25T08:49:29.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.704 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652722 s, 161 MB/s 2024-04-25T08:49:29.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.711 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580679 s, 181 MB/s 2024-04-25T08:49:29.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.718 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592118 s, 177 MB/s 2024-04-25T08:49:29.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.725 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653527 s, 160 MB/s 2024-04-25T08:49:29.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.732 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565703 s, 185 MB/s 2024-04-25T08:49:29.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.740 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709761 s, 148 MB/s 2024-04-25T08:49:29.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.747 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618043 s, 170 MB/s 2024-04-25T08:49:29.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:29.748 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:29.748 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:29.748 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T08:49:29.748 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:29.748 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:29.748 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:29.748 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:29.813 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.813 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.813 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654212 s, 160 MB/s 2024-04-25T08:49:29.820 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.820 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.820 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649229 s, 162 MB/s 2024-04-25T08:49:29.828 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.828 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.828 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662179 s, 158 MB/s 2024-04-25T08:49:29.835 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.835 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.835 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633184 s, 166 MB/s 2024-04-25T08:49:29.842 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.842 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.842 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611227 s, 172 MB/s 2024-04-25T08:49:29.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.849 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655243 s, 160 MB/s 2024-04-25T08:49:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.856 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596313 s, 176 MB/s 2024-04-25T08:49:29.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.864 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716459 s, 146 MB/s 2024-04-25T08:49:29.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.871 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630692 s, 166 MB/s 2024-04-25T08:49:29.879 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.879 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.879 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717056 s, 146 MB/s 2024-04-25T08:49:29.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.886 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592293 s, 177 MB/s 2024-04-25T08:49:29.894 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.894 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.894 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698152 s, 150 MB/s 2024-04-25T08:49:29.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.901 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608235 s, 172 MB/s 2024-04-25T08:49:29.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.909 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708224 s, 148 MB/s 2024-04-25T08:49:29.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.916 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063437 s, 165 MB/s 2024-04-25T08:49:29.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.923 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619168 s, 169 MB/s 2024-04-25T08:49:29.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.931 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648102 s, 162 MB/s 2024-04-25T08:49:29.937 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.937 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.937 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578038 s, 181 MB/s 2024-04-25T08:49:29.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.944 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569647 s, 184 MB/s 2024-04-25T08:49:29.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.952 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742975 s, 141 MB/s 2024-04-25T08:49:29.960 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.960 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.960 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665169 s, 158 MB/s 2024-04-25T08:49:29.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.968 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702124 s, 149 MB/s 2024-04-25T08:49:29.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.974 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561601 s, 187 MB/s 2024-04-25T08:49:29.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.981 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626484 s, 167 MB/s 2024-04-25T08:49:29.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698043 s, 150 MB/s 2024-04-25T08:49:29.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:29.997 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:29.997 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661669 s, 158 MB/s 2024-04-25T08:49:30.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.004 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660499 s, 159 MB/s 2024-04-25T08:49:30.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.011 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565151 s, 186 MB/s 2024-04-25T08:49:30.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.018 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690374 s, 152 MB/s 2024-04-25T08:49:30.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.026 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676774 s, 155 MB/s 2024-04-25T08:49:30.033 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.033 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.033 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623978 s, 168 MB/s 2024-04-25T08:49:30.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.041 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730134 s, 144 MB/s 2024-04-25T08:49:30.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:30.042 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:30.042 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:30.043 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T08:49:30.043 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:30.043 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:30.043 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:30.043 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:30.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.108 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653407 s, 160 MB/s 2024-04-25T08:49:30.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.115 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623694 s, 168 MB/s 2024-04-25T08:49:30.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.122 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618627 s, 170 MB/s 2024-04-25T08:49:30.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.129 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616379 s, 170 MB/s 2024-04-25T08:49:30.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.136 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617222 s, 170 MB/s 2024-04-25T08:49:30.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669446 s, 157 MB/s 2024-04-25T08:49:30.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.151 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630094 s, 166 MB/s 2024-04-25T08:49:30.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.158 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679449 s, 154 MB/s 2024-04-25T08:49:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644286 s, 163 MB/s 2024-04-25T08:49:30.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.173 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663542 s, 158 MB/s 2024-04-25T08:49:30.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.180 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620222 s, 169 MB/s 2024-04-25T08:49:30.187 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.187 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.187 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581207 s, 180 MB/s 2024-04-25T08:49:30.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.193 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570187 s, 184 MB/s 2024-04-25T08:49:30.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.200 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00544249 s, 193 MB/s 2024-04-25T08:49:30.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.208 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708067 s, 148 MB/s 2024-04-25T08:49:30.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.216 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702107 s, 149 MB/s 2024-04-25T08:49:30.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.222 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567318 s, 185 MB/s 2024-04-25T08:49:30.229 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.229 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.229 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565093 s, 186 MB/s 2024-04-25T08:49:30.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.237 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702078 s, 149 MB/s 2024-04-25T08:49:30.244 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.244 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.244 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676498 s, 155 MB/s 2024-04-25T08:49:30.251 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.252 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643034 s, 163 MB/s 2024-04-25T08:49:30.260 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.260 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.260 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726978 s, 144 MB/s 2024-04-25T08:49:30.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636063 s, 165 MB/s 2024-04-25T08:49:30.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.274 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657025 s, 160 MB/s 2024-04-25T08:49:30.282 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.282 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.282 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631588 s, 166 MB/s 2024-04-25T08:49:30.290 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.290 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.290 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651015 s, 161 MB/s 2024-04-25T08:49:30.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.296 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621606 s, 169 MB/s 2024-04-25T08:49:30.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.303 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063443 s, 165 MB/s 2024-04-25T08:49:30.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058164 s, 180 MB/s 2024-04-25T08:49:30.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.318 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642286 s, 163 MB/s 2024-04-25T08:49:30.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.324 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610807 s, 172 MB/s 2024-04-25T08:49:30.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.331 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635023 s, 165 MB/s 2024-04-25T08:49:30.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:30.332 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:30.332 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:30.332 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T08:49:30.333 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:30.333 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:30.333 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:30.333 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:30.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.398 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065085 s, 161 MB/s 2024-04-25T08:49:30.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.406 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644629 s, 163 MB/s 2024-04-25T08:49:30.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.412 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061768 s, 170 MB/s 2024-04-25T08:49:30.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.418 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0053884 s, 195 MB/s 2024-04-25T08:49:30.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720582 s, 146 MB/s 2024-04-25T08:49:30.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.433 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572702 s, 183 MB/s 2024-04-25T08:49:30.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.440 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642582 s, 163 MB/s 2024-04-25T08:49:30.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.447 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599021 s, 175 MB/s 2024-04-25T08:49:30.454 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.454 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.454 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627849 s, 167 MB/s 2024-04-25T08:49:30.461 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.461 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.462 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642949 s, 163 MB/s 2024-04-25T08:49:30.468 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.469 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635056 s, 165 MB/s 2024-04-25T08:49:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.476 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647344 s, 162 MB/s 2024-04-25T08:49:30.482 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.482 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.482 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561562 s, 187 MB/s 2024-04-25T08:49:30.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.490 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704502 s, 149 MB/s 2024-04-25T08:49:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633248 s, 166 MB/s 2024-04-25T08:49:30.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.506 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744221 s, 141 MB/s 2024-04-25T08:49:30.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.513 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.513 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561406 s, 187 MB/s 2024-04-25T08:49:30.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.519 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597012 s, 176 MB/s 2024-04-25T08:49:30.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560788 s, 187 MB/s 2024-04-25T08:49:30.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.533 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622485 s, 168 MB/s 2024-04-25T08:49:30.541 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.541 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.541 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727226 s, 144 MB/s 2024-04-25T08:49:30.549 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.549 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.550 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073786 s, 142 MB/s 2024-04-25T08:49:30.556 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.556 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.556 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599585 s, 175 MB/s 2024-04-25T08:49:30.563 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.564 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.564 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604212 s, 174 MB/s 2024-04-25T08:49:30.571 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.571 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.571 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652349 s, 161 MB/s 2024-04-25T08:49:30.577 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.578 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.578 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593198 s, 177 MB/s 2024-04-25T08:49:30.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.585 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624124 s, 168 MB/s 2024-04-25T08:49:30.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.593 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740494 s, 142 MB/s 2024-04-25T08:49:30.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553055 s, 190 MB/s 2024-04-25T08:49:30.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.606 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575406 s, 182 MB/s 2024-04-25T08:49:30.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.613 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059068 s, 178 MB/s 2024-04-25T08:49:30.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.620 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632426 s, 166 MB/s 2024-04-25T08:49:30.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:30.622 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:30.622 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:30.622 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T08:49:30.622 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:30.622 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:30.622 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:30.622 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:30.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.686 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583778 s, 180 MB/s 2024-04-25T08:49:30.693 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.693 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.693 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666031 s, 157 MB/s 2024-04-25T08:49:30.700 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.700 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.700 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626824 s, 167 MB/s 2024-04-25T08:49:30.706 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572733 s, 183 MB/s 2024-04-25T08:49:30.714 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.714 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.714 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622096 s, 169 MB/s 2024-04-25T08:49:30.721 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.721 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.721 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634496 s, 165 MB/s 2024-04-25T08:49:30.728 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.728 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.728 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615133 s, 170 MB/s 2024-04-25T08:49:30.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.735 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632375 s, 166 MB/s 2024-04-25T08:49:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692688 s, 151 MB/s 2024-04-25T08:49:30.751 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.751 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.751 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703868 s, 149 MB/s 2024-04-25T08:49:30.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.759 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741718 s, 141 MB/s 2024-04-25T08:49:30.767 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.767 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.767 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711193 s, 147 MB/s 2024-04-25T08:49:30.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.776 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770981 s, 136 MB/s 2024-04-25T08:49:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.783 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617295 s, 170 MB/s 2024-04-25T08:49:30.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.790 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590576 s, 178 MB/s 2024-04-25T08:49:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632594 s, 166 MB/s 2024-04-25T08:49:30.805 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:49:30.805 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.806 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.806 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719602 s, 146 MB/s 2024-04-25T08:49:30.807 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:49:30.813 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.813 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.813 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698843 s, 150 MB/s 2024-04-25T08:49:30.820 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.820 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.820 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606562 s, 173 MB/s 2024-04-25T08:49:30.826 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.826 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.827 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587135 s, 179 MB/s 2024-04-25T08:49:30.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.833 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595846 s, 176 MB/s 2024-04-25T08:49:30.841 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.841 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.841 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700704 s, 150 MB/s 2024-04-25T08:49:30.848 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.848 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.848 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575561 s, 182 MB/s 2024-04-25T08:49:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745991 s, 141 MB/s 2024-04-25T08:49:30.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.864 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694825 s, 151 MB/s 2024-04-25T08:49:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643908 s, 163 MB/s 2024-04-25T08:49:30.879 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.879 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.879 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632848 s, 166 MB/s 2024-04-25T08:49:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580014 s, 181 MB/s 2024-04-25T08:49:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629179 s, 167 MB/s 2024-04-25T08:49:30.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.900 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624655 s, 168 MB/s 2024-04-25T08:49:30.907 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.907 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.907 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618368 s, 170 MB/s 2024-04-25T08:49:30.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.914 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661778 s, 158 MB/s 2024-04-25T08:49:30.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:30.915 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:30.916 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:30.916 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T08:49:30.916 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:30.916 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:30.916 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:30.916 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:30.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.981 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670106 s, 156 MB/s 2024-04-25T08:49:30.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701695 s, 149 MB/s 2024-04-25T08:49:30.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:30.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:30.996 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659729 s, 159 MB/s 2024-04-25T08:49:31.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.003 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591281 s, 177 MB/s 2024-04-25T08:49:31.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681308 s, 154 MB/s 2024-04-25T08:49:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612605 s, 171 MB/s 2024-04-25T08:49:31.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.025 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627479 s, 167 MB/s 2024-04-25T08:49:31.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.032 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623125 s, 168 MB/s 2024-04-25T08:49:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618947 s, 169 MB/s 2024-04-25T08:49:31.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.046 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654569 s, 160 MB/s 2024-04-25T08:49:31.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.053 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619826 s, 169 MB/s 2024-04-25T08:49:31.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.061 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633019 s, 166 MB/s 2024-04-25T08:49:31.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.067 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613485 s, 171 MB/s 2024-04-25T08:49:31.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.075 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659606 s, 159 MB/s 2024-04-25T08:49:31.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.082 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640951 s, 164 MB/s 2024-04-25T08:49:31.089 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.089 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.089 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608114 s, 172 MB/s 2024-04-25T08:49:31.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.096 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057442 s, 183 MB/s 2024-04-25T08:49:31.102 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.102 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.103 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057187 s, 183 MB/s 2024-04-25T08:49:31.109 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.110 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.110 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615605 s, 170 MB/s 2024-04-25T08:49:31.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.118 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672726 s, 156 MB/s 2024-04-25T08:49:31.125 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.125 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.125 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648161 s, 162 MB/s 2024-04-25T08:49:31.132 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.132 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.132 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635518 s, 165 MB/s 2024-04-25T08:49:31.140 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.140 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.140 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740891 s, 142 MB/s 2024-04-25T08:49:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610026 s, 172 MB/s 2024-04-25T08:49:31.154 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.155 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626477 s, 167 MB/s 2024-04-25T08:49:31.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.162 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693351 s, 151 MB/s 2024-04-25T08:49:31.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.169 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664806 s, 158 MB/s 2024-04-25T08:49:31.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.178 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717048 s, 146 MB/s 2024-04-25T08:49:31.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.185 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641257 s, 164 MB/s 2024-04-25T08:49:31.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.192 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589175 s, 178 MB/s 2024-04-25T08:49:31.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.199 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657462 s, 159 MB/s 2024-04-25T08:49:31.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.207 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714748 s, 147 MB/s 2024-04-25T08:49:31.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:31.208 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:31.208 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:31.208 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T08:49:31.208 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:31.208 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:31.208 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:31.208 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:31.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.274 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714079 s, 147 MB/s 2024-04-25T08:49:31.282 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.282 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.282 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718423 s, 146 MB/s 2024-04-25T08:49:31.290 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.290 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.290 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738471 s, 142 MB/s 2024-04-25T08:49:31.297 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.297 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.297 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639857 s, 164 MB/s 2024-04-25T08:49:31.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.304 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572012 s, 183 MB/s 2024-04-25T08:49:31.311 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.311 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.311 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608847 s, 172 MB/s 2024-04-25T08:49:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.319 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070957 s, 148 MB/s 2024-04-25T08:49:31.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.326 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.326 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586206 s, 179 MB/s 2024-04-25T08:49:31.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.333 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592366 s, 177 MB/s 2024-04-25T08:49:31.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00547301 s, 192 MB/s 2024-04-25T08:49:31.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.346 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643828 s, 163 MB/s 2024-04-25T08:49:31.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.354 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639058 s, 164 MB/s 2024-04-25T08:49:31.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.360 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627235 s, 167 MB/s 2024-04-25T08:49:31.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.368 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638157 s, 164 MB/s 2024-04-25T08:49:31.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.376 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721131 s, 145 MB/s 2024-04-25T08:49:31.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.383 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658206 s, 159 MB/s 2024-04-25T08:49:31.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.392 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.392 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744157 s, 141 MB/s 2024-04-25T08:49:31.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.399 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639041 s, 164 MB/s 2024-04-25T08:49:31.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.406 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633566 s, 166 MB/s 2024-04-25T08:49:31.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.412 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564592 s, 186 MB/s 2024-04-25T08:49:31.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.420 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655583 s, 160 MB/s 2024-04-25T08:49:31.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.427 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621064 s, 169 MB/s 2024-04-25T08:49:31.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.434 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595495 s, 176 MB/s 2024-04-25T08:49:31.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.441 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670634 s, 156 MB/s 2024-04-25T08:49:31.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.449 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679146 s, 154 MB/s 2024-04-25T08:49:31.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.457 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728216 s, 144 MB/s 2024-04-25T08:49:31.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.465 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642286 s, 163 MB/s 2024-04-25T08:49:31.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.473 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725319 s, 145 MB/s 2024-04-25T08:49:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620537 s, 169 MB/s 2024-04-25T08:49:31.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.487 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.487 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598256 s, 175 MB/s 2024-04-25T08:49:31.494 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.494 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.494 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654653 s, 160 MB/s 2024-04-25T08:49:31.502 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.502 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.502 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732562 s, 143 MB/s 2024-04-25T08:49:31.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:31.503 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:31.503 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:31.503 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T08:49:31.503 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:31.504 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:31.504 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:31.504 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:31.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.567 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624255 s, 168 MB/s 2024-04-25T08:49:31.575 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.575 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.575 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673206 s, 156 MB/s 2024-04-25T08:49:31.583 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.583 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.583 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706238 s, 148 MB/s 2024-04-25T08:49:31.591 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.591 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.591 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723416 s, 145 MB/s 2024-04-25T08:49:31.598 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.598 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673865 s, 156 MB/s 2024-04-25T08:49:31.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.606 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615015 s, 170 MB/s 2024-04-25T08:49:31.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.613 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640289 s, 164 MB/s 2024-04-25T08:49:31.619 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.619 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.620 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057838 s, 181 MB/s 2024-04-25T08:49:31.626 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.626 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.626 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564833 s, 186 MB/s 2024-04-25T08:49:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.633 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606293 s, 173 MB/s 2024-04-25T08:49:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.639 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554793 s, 189 MB/s 2024-04-25T08:49:31.647 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.647 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.647 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650287 s, 161 MB/s 2024-04-25T08:49:31.654 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.654 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.654 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582128 s, 180 MB/s 2024-04-25T08:49:31.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.662 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007061 s, 149 MB/s 2024-04-25T08:49:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.670 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722865 s, 145 MB/s 2024-04-25T08:49:31.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.678 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706261 s, 148 MB/s 2024-04-25T08:49:31.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.685 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622969 s, 168 MB/s 2024-04-25T08:49:31.693 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.693 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.693 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732295 s, 143 MB/s 2024-04-25T08:49:31.700 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.700 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.701 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651154 s, 161 MB/s 2024-04-25T08:49:31.708 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.708 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.708 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653054 s, 161 MB/s 2024-04-25T08:49:31.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.715 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651115 s, 161 MB/s 2024-04-25T08:49:31.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.722 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619791 s, 169 MB/s 2024-04-25T08:49:31.730 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.730 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.730 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736586 s, 142 MB/s 2024-04-25T08:49:31.737 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.737 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.737 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600859 s, 175 MB/s 2024-04-25T08:49:31.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.745 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636365 s, 165 MB/s 2024-04-25T08:49:31.752 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.752 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.752 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668798 s, 157 MB/s 2024-04-25T08:49:31.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.759 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630279 s, 166 MB/s 2024-04-25T08:49:31.768 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.768 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.768 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073918 s, 142 MB/s 2024-04-25T08:49:31.774 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.775 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.775 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600719 s, 175 MB/s 2024-04-25T08:49:31.783 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.783 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.783 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723002 s, 145 MB/s 2024-04-25T08:49:31.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.790 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639418 s, 164 MB/s 2024-04-25T08:49:31.797 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.797 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.797 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619437 s, 169 MB/s 2024-04-25T08:49:31.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:31.798 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:31.799 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:31.799 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T08:49:31.799 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:31.799 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:31.799 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:31.799 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:31.863 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.863 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.863 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651705 s, 161 MB/s 2024-04-25T08:49:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135885 s, 77.2 MB/s 2024-04-25T08:49:31.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.886 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747341 s, 140 MB/s 2024-04-25T08:49:31.894 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.894 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.894 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708986 s, 148 MB/s 2024-04-25T08:49:31.902 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.902 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.902 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706805 s, 148 MB/s 2024-04-25T08:49:31.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.909 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629947 s, 166 MB/s 2024-04-25T08:49:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.916 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661231 s, 159 MB/s 2024-04-25T08:49:31.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.923 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591612 s, 177 MB/s 2024-04-25T08:49:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756704 s, 139 MB/s 2024-04-25T08:49:31.939 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.939 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.939 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664121 s, 158 MB/s 2024-04-25T08:49:31.946 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.946 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.947 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630666 s, 166 MB/s 2024-04-25T08:49:31.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.955 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724454 s, 145 MB/s 2024-04-25T08:49:31.962 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.963 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702861 s, 149 MB/s 2024-04-25T08:49:31.969 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.969 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.969 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592461 s, 177 MB/s 2024-04-25T08:49:31.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.978 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.978 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730544 s, 144 MB/s 2024-04-25T08:49:31.985 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.985 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.985 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674163 s, 156 MB/s 2024-04-25T08:49:31.993 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:31.993 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:31.993 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724886 s, 145 MB/s 2024-04-25T08:49:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667315 s, 157 MB/s 2024-04-25T08:49:32.008 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.008 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.008 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613411 s, 171 MB/s 2024-04-25T08:49:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633258 s, 166 MB/s 2024-04-25T08:49:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599219 s, 175 MB/s 2024-04-25T08:49:32.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.029 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611357 s, 172 MB/s 2024-04-25T08:49:32.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.036 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642663 s, 163 MB/s 2024-04-25T08:49:32.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.044 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666593 s, 157 MB/s 2024-04-25T08:49:32.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.051 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655746 s, 160 MB/s 2024-04-25T08:49:32.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.059 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708815 s, 148 MB/s 2024-04-25T08:49:32.066 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.066 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.066 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589618 s, 178 MB/s 2024-04-25T08:49:32.073 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.073 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.073 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623687 s, 168 MB/s 2024-04-25T08:49:32.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.080 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597371 s, 176 MB/s 2024-04-25T08:49:32.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.087 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.087 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558997 s, 188 MB/s 2024-04-25T08:49:32.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.094 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629793 s, 166 MB/s 2024-04-25T08:49:32.101 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.101 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.102 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662942 s, 158 MB/s 2024-04-25T08:49:32.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:32.103 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:32.103 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:32.103 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T08:49:32.103 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:32.103 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:32.103 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:32.103 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:32.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.168 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739071 s, 142 MB/s 2024-04-25T08:49:32.176 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.176 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.176 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728691 s, 144 MB/s 2024-04-25T08:49:32.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.183 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660152 s, 159 MB/s 2024-04-25T08:49:32.190 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.190 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.191 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629942 s, 166 MB/s 2024-04-25T08:49:32.197 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.197 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.197 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608246 s, 172 MB/s 2024-04-25T08:49:32.204 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.204 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.204 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573051 s, 183 MB/s 2024-04-25T08:49:32.211 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.211 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.211 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628607 s, 167 MB/s 2024-04-25T08:49:32.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.219 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732191 s, 143 MB/s 2024-04-25T08:49:32.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.226 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634533 s, 165 MB/s 2024-04-25T08:49:32.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.233 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057672 s, 182 MB/s 2024-04-25T08:49:32.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.240 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631761 s, 166 MB/s 2024-04-25T08:49:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715367 s, 147 MB/s 2024-04-25T08:49:32.256 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.256 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.257 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745597 s, 141 MB/s 2024-04-25T08:49:32.264 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.264 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.265 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707917 s, 148 MB/s 2024-04-25T08:49:32.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.272 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636101 s, 165 MB/s 2024-04-25T08:49:32.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.279 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648187 s, 162 MB/s 2024-04-25T08:49:32.287 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.287 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.287 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732955 s, 143 MB/s 2024-04-25T08:49:32.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.295 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641994 s, 163 MB/s 2024-04-25T08:49:32.301 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.302 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.302 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623834 s, 168 MB/s 2024-04-25T08:49:32.308 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.308 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.308 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588463 s, 178 MB/s 2024-04-25T08:49:32.316 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.316 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.316 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648975 s, 162 MB/s 2024-04-25T08:49:32.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.323 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604965 s, 173 MB/s 2024-04-25T08:49:32.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.331 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720104 s, 146 MB/s 2024-04-25T08:49:32.337 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.338 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057849 s, 181 MB/s 2024-04-25T08:49:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.345 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641452 s, 163 MB/s 2024-04-25T08:49:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.351 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.352 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577477 s, 182 MB/s 2024-04-25T08:49:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058315 s, 180 MB/s 2024-04-25T08:49:32.366 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.366 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.367 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730591 s, 144 MB/s 2024-04-25T08:49:32.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.373 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584127 s, 180 MB/s 2024-04-25T08:49:32.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.380 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627201 s, 167 MB/s 2024-04-25T08:49:32.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.388 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634317 s, 165 MB/s 2024-04-25T08:49:32.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.395 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604078 s, 174 MB/s 2024-04-25T08:49:32.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:32.396 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:32.396 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:32.396 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T08:49:32.396 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:32.396 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:32.397 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:32.397 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:32.460 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.461 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.461 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735014 s, 143 MB/s 2024-04-25T08:49:32.468 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.468 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.468 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669087 s, 157 MB/s 2024-04-25T08:49:32.475 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.475 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.475 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580354 s, 181 MB/s 2024-04-25T08:49:32.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.483 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722338 s, 145 MB/s 2024-04-25T08:49:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.490 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636688 s, 165 MB/s 2024-04-25T08:49:32.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.497 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573104 s, 183 MB/s 2024-04-25T08:49:32.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.504 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641749 s, 163 MB/s 2024-04-25T08:49:32.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.511 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630988 s, 166 MB/s 2024-04-25T08:49:32.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.518 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635038 s, 165 MB/s 2024-04-25T08:49:32.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652678 s, 161 MB/s 2024-04-25T08:49:32.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.533 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652849 s, 161 MB/s 2024-04-25T08:49:32.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.540 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588057 s, 178 MB/s 2024-04-25T08:49:32.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.547 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569348 s, 184 MB/s 2024-04-25T08:49:32.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.553 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585166 s, 179 MB/s 2024-04-25T08:49:32.560 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.560 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.561 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638247 s, 164 MB/s 2024-04-25T08:49:32.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.567 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570908 s, 184 MB/s 2024-04-25T08:49:32.575 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.575 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.575 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670093 s, 156 MB/s 2024-04-25T08:49:32.582 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.582 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.582 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625485 s, 168 MB/s 2024-04-25T08:49:32.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.589 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636115 s, 165 MB/s 2024-04-25T08:49:32.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.596 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575985 s, 182 MB/s 2024-04-25T08:49:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.603 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063631 s, 165 MB/s 2024-04-25T08:49:32.610 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.610 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.610 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590841 s, 177 MB/s 2024-04-25T08:49:32.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.617 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659151 s, 159 MB/s 2024-04-25T08:49:32.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.624 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616135 s, 170 MB/s 2024-04-25T08:49:32.632 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.632 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.632 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668289 s, 157 MB/s 2024-04-25T08:49:32.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.639 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631856 s, 166 MB/s 2024-04-25T08:49:32.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.648 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782622 s, 134 MB/s 2024-04-25T08:49:32.656 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.656 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.656 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733875 s, 143 MB/s 2024-04-25T08:49:32.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.664 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736747 s, 142 MB/s 2024-04-25T08:49:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.671 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559982 s, 187 MB/s 2024-04-25T08:49:32.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.678 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608568 s, 172 MB/s 2024-04-25T08:49:32.684 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.684 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.685 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056614 s, 185 MB/s 2024-04-25T08:49:32.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:32.686 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:32.686 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:32.686 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T08:49:32.686 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:32.686 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:32.686 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:32.686 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:32.750 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.751 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.751 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674096 s, 156 MB/s 2024-04-25T08:49:32.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.759 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783173 s, 134 MB/s 2024-04-25T08:49:32.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.767 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663105 s, 158 MB/s 2024-04-25T08:49:32.773 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.773 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.774 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636957 s, 165 MB/s 2024-04-25T08:49:32.780 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.780 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.780 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581771 s, 180 MB/s 2024-04-25T08:49:32.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.788 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646915 s, 162 MB/s 2024-04-25T08:49:32.796 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.796 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.796 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714684 s, 147 MB/s 2024-04-25T08:49:32.803 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.803 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.804 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680587 s, 154 MB/s 2024-04-25T08:49:32.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.811 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617866 s, 170 MB/s 2024-04-25T08:49:32.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.817 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584766 s, 179 MB/s 2024-04-25T08:49:32.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.825 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656573 s, 160 MB/s 2024-04-25T08:49:32.832 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.832 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.832 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629531 s, 167 MB/s 2024-04-25T08:49:32.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.839 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065633 s, 160 MB/s 2024-04-25T08:49:32.846 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.846 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.846 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636359 s, 165 MB/s 2024-04-25T08:49:32.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.854 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062236 s, 168 MB/s 2024-04-25T08:49:32.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.860 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566498 s, 185 MB/s 2024-04-25T08:49:32.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.867 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638857 s, 164 MB/s 2024-04-25T08:49:32.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.874 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595682 s, 176 MB/s 2024-04-25T08:49:32.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.881 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587337 s, 179 MB/s 2024-04-25T08:49:32.888 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.888 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.888 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644417 s, 163 MB/s 2024-04-25T08:49:32.896 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.896 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.896 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632999 s, 166 MB/s 2024-04-25T08:49:32.902 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.902 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.902 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585842 s, 179 MB/s 2024-04-25T08:49:32.910 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.910 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.910 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661802 s, 158 MB/s 2024-04-25T08:49:32.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.917 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.917 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615216 s, 170 MB/s 2024-04-25T08:49:32.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.924 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618269 s, 170 MB/s 2024-04-25T08:49:32.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.931 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676441 s, 155 MB/s 2024-04-25T08:49:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.938 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572461 s, 183 MB/s 2024-04-25T08:49:32.945 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.945 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.945 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640463 s, 164 MB/s 2024-04-25T08:49:32.953 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.953 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.953 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656226 s, 160 MB/s 2024-04-25T08:49:32.960 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.960 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.960 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580319 s, 181 MB/s 2024-04-25T08:49:32.966 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.966 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.966 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586118 s, 179 MB/s 2024-04-25T08:49:32.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:32.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:32.974 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064534 s, 162 MB/s 2024-04-25T08:49:32.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:32.975 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:32.975 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:32.975 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T08:49:32.975 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:32.975 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:32.975 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:32.975 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:33.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.039 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676767 s, 155 MB/s 2024-04-25T08:49:33.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.046 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639008 s, 164 MB/s 2024-04-25T08:49:33.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.054 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731686 s, 143 MB/s 2024-04-25T08:49:33.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.062 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669338 s, 157 MB/s 2024-04-25T08:49:33.070 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.070 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.070 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712943 s, 147 MB/s 2024-04-25T08:49:33.077 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.077 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.077 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631907 s, 166 MB/s 2024-04-25T08:49:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.084 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566028 s, 185 MB/s 2024-04-25T08:49:33.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.091 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006542 s, 160 MB/s 2024-04-25T08:49:33.098 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.098 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.098 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624968 s, 168 MB/s 2024-04-25T08:49:33.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.106 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649903 s, 161 MB/s 2024-04-25T08:49:33.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.113 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617847 s, 170 MB/s 2024-04-25T08:49:33.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.120 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063814 s, 164 MB/s 2024-04-25T08:49:33.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.127 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624515 s, 168 MB/s 2024-04-25T08:49:33.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.134 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570152 s, 184 MB/s 2024-04-25T08:49:33.141 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.141 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.141 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617858 s, 170 MB/s 2024-04-25T08:49:33.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.149 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703928 s, 149 MB/s 2024-04-25T08:49:33.156 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.156 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.156 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702616 s, 149 MB/s 2024-04-25T08:49:33.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.164 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063854 s, 164 MB/s 2024-04-25T08:49:33.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.172 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071856 s, 146 MB/s 2024-04-25T08:49:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.179 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581673 s, 180 MB/s 2024-04-25T08:49:33.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.186 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633248 s, 166 MB/s 2024-04-25T08:49:33.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.193 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627637 s, 167 MB/s 2024-04-25T08:49:33.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.200 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629249 s, 167 MB/s 2024-04-25T08:49:33.206 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.207 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565463 s, 185 MB/s 2024-04-25T08:49:33.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.214 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652962 s, 161 MB/s 2024-04-25T08:49:33.220 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.220 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.221 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559143 s, 188 MB/s 2024-04-25T08:49:33.227 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.228 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.228 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062435 s, 168 MB/s 2024-04-25T08:49:33.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.236 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.236 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646 s, 162 MB/s 2024-04-25T08:49:33.243 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.243 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.243 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006903 s, 152 MB/s 2024-04-25T08:49:33.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.250 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063344 s, 166 MB/s 2024-04-25T08:49:33.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.257 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646057 s, 162 MB/s 2024-04-25T08:49:33.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.265 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700617 s, 150 MB/s 2024-04-25T08:49:33.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:33.266 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:33.267 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:33.267 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T08:49:33.267 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:33.267 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:33.267 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:33.267 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:33.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.332 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664473 s, 158 MB/s 2024-04-25T08:49:33.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.338 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582358 s, 180 MB/s 2024-04-25T08:49:33.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.345 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629422 s, 167 MB/s 2024-04-25T08:49:33.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.352 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634357 s, 165 MB/s 2024-04-25T08:49:33.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.360 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699181 s, 150 MB/s 2024-04-25T08:49:33.367 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.367 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.367 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619691 s, 169 MB/s 2024-04-25T08:49:33.374 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.375 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630073 s, 166 MB/s 2024-04-25T08:49:33.382 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.382 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.382 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659891 s, 159 MB/s 2024-04-25T08:49:33.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.390 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722815 s, 145 MB/s 2024-04-25T08:49:33.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.397 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628005 s, 167 MB/s 2024-04-25T08:49:33.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.405 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069502 s, 151 MB/s 2024-04-25T08:49:33.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722642 s, 145 MB/s 2024-04-25T08:49:33.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.421 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634593 s, 165 MB/s 2024-04-25T08:49:33.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.428 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610822 s, 172 MB/s 2024-04-25T08:49:33.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.434 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572165 s, 183 MB/s 2024-04-25T08:49:33.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.442 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690839 s, 152 MB/s 2024-04-25T08:49:33.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.449 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581305 s, 180 MB/s 2024-04-25T08:49:33.455 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.455 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.456 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597024 s, 176 MB/s 2024-04-25T08:49:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670491 s, 156 MB/s 2024-04-25T08:49:33.470 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.470 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.471 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651603 s, 161 MB/s 2024-04-25T08:49:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.477 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058595 s, 179 MB/s 2024-04-25T08:49:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.484 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555673 s, 189 MB/s 2024-04-25T08:49:33.491 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.491 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.491 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662802 s, 158 MB/s 2024-04-25T08:49:33.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.500 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750703 s, 140 MB/s 2024-04-25T08:49:33.507 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.507 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.507 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633363 s, 166 MB/s 2024-04-25T08:49:33.515 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.515 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.515 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727418 s, 144 MB/s 2024-04-25T08:49:33.522 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.523 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646202 s, 162 MB/s 2024-04-25T08:49:33.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.530 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615952 s, 170 MB/s 2024-04-25T08:49:33.536 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.537 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.537 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618771 s, 169 MB/s 2024-04-25T08:49:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638342 s, 164 MB/s 2024-04-25T08:49:33.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651609 s, 161 MB/s 2024-04-25T08:49:33.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600032 s, 175 MB/s 2024-04-25T08:49:33.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:33.559 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:33.560 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:33.560 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T08:49:33.560 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:33.560 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:33.560 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:33.560 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:33.625 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.625 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.625 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702302 s, 149 MB/s 2024-04-25T08:49:33.632 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.632 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.632 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643523 s, 163 MB/s 2024-04-25T08:49:33.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.640 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648917 s, 162 MB/s 2024-04-25T08:49:33.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.648 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072158 s, 145 MB/s 2024-04-25T08:49:33.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.655 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624665 s, 168 MB/s 2024-04-25T08:49:33.661 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.662 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059853 s, 175 MB/s 2024-04-25T08:49:33.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.669 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060597 s, 173 MB/s 2024-04-25T08:49:33.676 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.676 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.676 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629899 s, 166 MB/s 2024-04-25T08:49:33.683 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.683 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.683 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648829 s, 162 MB/s 2024-04-25T08:49:33.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.691 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.691 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639839 s, 164 MB/s 2024-04-25T08:49:33.698 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.699 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.699 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734082 s, 143 MB/s 2024-04-25T08:49:33.706 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.706 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.706 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618781 s, 169 MB/s 2024-04-25T08:49:33.713 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.713 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.713 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653469 s, 160 MB/s 2024-04-25T08:49:33.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.722 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627442 s, 167 MB/s 2024-04-25T08:49:33.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.727 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613365 s, 171 MB/s 2024-04-25T08:49:33.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.735 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656923 s, 160 MB/s 2024-04-25T08:49:33.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.742 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630291 s, 166 MB/s 2024-04-25T08:49:33.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.749 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617311 s, 170 MB/s 2024-04-25T08:49:33.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569953 s, 184 MB/s 2024-04-25T08:49:33.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.763 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654852 s, 160 MB/s 2024-04-25T08:49:33.772 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.772 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.772 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744413 s, 141 MB/s 2024-04-25T08:49:33.783 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.783 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.783 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106428 s, 98.5 MB/s 2024-04-25T08:49:33.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.791 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.791 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634359 s, 165 MB/s 2024-04-25T08:49:33.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.799 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718552 s, 146 MB/s 2024-04-25T08:49:33.806 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.807 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711659 s, 147 MB/s 2024-04-25T08:49:33.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.814 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069999 s, 150 MB/s 2024-04-25T08:49:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.822 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672051 s, 156 MB/s 2024-04-25T08:49:33.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.830 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064859 s, 162 MB/s 2024-04-25T08:49:33.836 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.836 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.836 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589458 s, 178 MB/s 2024-04-25T08:49:33.843 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.843 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.843 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568588 s, 184 MB/s 2024-04-25T08:49:33.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.850 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668765 s, 157 MB/s 2024-04-25T08:49:33.858 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.858 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.858 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642544 s, 163 MB/s 2024-04-25T08:49:33.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:33.859 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:33.859 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:33.859 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T08:49:33.859 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:33.859 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:33.859 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:33.860 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:33.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.924 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663798 s, 158 MB/s 2024-04-25T08:49:33.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.930 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586625 s, 179 MB/s 2024-04-25T08:49:33.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.939 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.939 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751012 s, 140 MB/s 2024-04-25T08:49:33.946 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.946 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.946 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618753 s, 169 MB/s 2024-04-25T08:49:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.953 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628803 s, 167 MB/s 2024-04-25T08:49:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.960 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573944 s, 183 MB/s 2024-04-25T08:49:33.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.968 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729671 s, 144 MB/s 2024-04-25T08:49:33.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.975 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618344 s, 170 MB/s 2024-04-25T08:49:33.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.982 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598276 s, 175 MB/s 2024-04-25T08:49:33.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592201 s, 177 MB/s 2024-04-25T08:49:33.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:33.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:33.996 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061293 s, 171 MB/s 2024-04-25T08:49:34.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.004 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714298 s, 147 MB/s 2024-04-25T08:49:34.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.011 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640884 s, 164 MB/s 2024-04-25T08:49:34.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.018 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064528 s, 162 MB/s 2024-04-25T08:49:34.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.026 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730225 s, 144 MB/s 2024-04-25T08:49:34.034 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.034 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.034 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718272 s, 146 MB/s 2024-04-25T08:49:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.041 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063857 s, 164 MB/s 2024-04-25T08:49:34.049 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.049 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.049 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625718 s, 168 MB/s 2024-04-25T08:49:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715686 s, 147 MB/s 2024-04-25T08:49:34.063 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.064 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.064 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596687 s, 176 MB/s 2024-04-25T08:49:34.071 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.071 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.071 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659976 s, 159 MB/s 2024-04-25T08:49:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.078 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.079 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650655 s, 161 MB/s 2024-04-25T08:49:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.086 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064825 s, 162 MB/s 2024-04-25T08:49:34.092 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.092 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.092 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578091 s, 181 MB/s 2024-04-25T08:49:34.099 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.100 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.100 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620402 s, 169 MB/s 2024-04-25T08:49:34.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.108 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761561 s, 138 MB/s 2024-04-25T08:49:34.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.115 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584946 s, 179 MB/s 2024-04-25T08:49:34.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.123 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762538 s, 138 MB/s 2024-04-25T08:49:34.130 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.130 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.131 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627984 s, 167 MB/s 2024-04-25T08:49:34.139 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.139 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.139 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752909 s, 139 MB/s 2024-04-25T08:49:34.146 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.146 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.146 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622287 s, 169 MB/s 2024-04-25T08:49:34.154 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.154 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.154 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700041 s, 150 MB/s 2024-04-25T08:49:34.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:34.155 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:34.155 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:34.155 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T08:49:34.155 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:34.155 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:34.155 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:34.156 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:34.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.220 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.220 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614667 s, 171 MB/s 2024-04-25T08:49:34.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.226 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611853 s, 171 MB/s 2024-04-25T08:49:34.234 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.235 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730113 s, 144 MB/s 2024-04-25T08:49:34.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.242 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692361 s, 151 MB/s 2024-04-25T08:49:34.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.250 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642513 s, 163 MB/s 2024-04-25T08:49:34.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.258 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719173 s, 146 MB/s 2024-04-25T08:49:34.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.265 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635167 s, 165 MB/s 2024-04-25T08:49:34.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.272 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615473 s, 170 MB/s 2024-04-25T08:49:34.280 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.280 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.280 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709553 s, 148 MB/s 2024-04-25T08:49:34.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.286 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580906 s, 181 MB/s 2024-04-25T08:49:34.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.294 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709601 s, 148 MB/s 2024-04-25T08:49:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717231 s, 146 MB/s 2024-04-25T08:49:34.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633315 s, 166 MB/s 2024-04-25T08:49:34.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607063 s, 173 MB/s 2024-04-25T08:49:34.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.324 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600612 s, 175 MB/s 2024-04-25T08:49:34.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.331 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634889 s, 165 MB/s 2024-04-25T08:49:34.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719089 s, 146 MB/s 2024-04-25T08:49:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.346 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631108 s, 166 MB/s 2024-04-25T08:49:34.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.355 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073859 s, 142 MB/s 2024-04-25T08:49:34.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.361 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573514 s, 183 MB/s 2024-04-25T08:49:34.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.368 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632053 s, 166 MB/s 2024-04-25T08:49:34.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.375 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564822 s, 186 MB/s 2024-04-25T08:49:34.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.383 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070562 s, 149 MB/s 2024-04-25T08:49:34.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.391 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716078 s, 146 MB/s 2024-04-25T08:49:34.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.399 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713193 s, 147 MB/s 2024-04-25T08:49:34.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.407 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.407 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690241 s, 152 MB/s 2024-04-25T08:49:34.414 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.415 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.415 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717107 s, 146 MB/s 2024-04-25T08:49:34.423 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.423 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.423 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725893 s, 144 MB/s 2024-04-25T08:49:34.430 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.430 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.431 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696615 s, 151 MB/s 2024-04-25T08:49:34.438 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.438 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.438 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622355 s, 168 MB/s 2024-04-25T08:49:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.445 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623406 s, 168 MB/s 2024-04-25T08:49:34.452 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.452 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.452 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642245 s, 163 MB/s 2024-04-25T08:49:34.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:34.453 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:34.453 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:34.453 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T08:49:34.454 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:34.454 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:34.454 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:34.454 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:34.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.518 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642596 s, 163 MB/s 2024-04-25T08:49:34.525 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.525 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.525 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584184 s, 179 MB/s 2024-04-25T08:49:34.531 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.531 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.531 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564657 s, 186 MB/s 2024-04-25T08:49:34.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.539 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657203 s, 160 MB/s 2024-04-25T08:49:34.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.547 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.547 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664308 s, 158 MB/s 2024-04-25T08:49:34.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.553 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610459 s, 172 MB/s 2024-04-25T08:49:34.561 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.561 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.561 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690282 s, 152 MB/s 2024-04-25T08:49:34.568 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.568 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.568 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587915 s, 178 MB/s 2024-04-25T08:49:34.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.576 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711685 s, 147 MB/s 2024-04-25T08:49:34.583 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.583 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.583 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619223 s, 169 MB/s 2024-04-25T08:49:34.590 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.590 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.590 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625025 s, 168 MB/s 2024-04-25T08:49:34.598 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.598 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.598 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660064 s, 159 MB/s 2024-04-25T08:49:34.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.605 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691773 s, 152 MB/s 2024-04-25T08:49:34.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.613 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664977 s, 158 MB/s 2024-04-25T08:49:34.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.620 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063044 s, 166 MB/s 2024-04-25T08:49:34.627 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.627 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.627 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060163 s, 174 MB/s 2024-04-25T08:49:34.634 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.635 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065605 s, 160 MB/s 2024-04-25T08:49:34.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.641 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557364 s, 188 MB/s 2024-04-25T08:49:34.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.648 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062849 s, 167 MB/s 2024-04-25T08:49:34.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.656 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647471 s, 162 MB/s 2024-04-25T08:49:34.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.662 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575408 s, 182 MB/s 2024-04-25T08:49:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.670 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696777 s, 150 MB/s 2024-04-25T08:49:34.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.678 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723739 s, 145 MB/s 2024-04-25T08:49:34.686 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.686 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.686 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686377 s, 153 MB/s 2024-04-25T08:49:34.693 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.693 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.693 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630191 s, 166 MB/s 2024-04-25T08:49:34.702 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.703 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705717 s, 149 MB/s 2024-04-25T08:49:34.707 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.707 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.708 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572829 s, 183 MB/s 2024-04-25T08:49:34.714 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.714 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.714 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568228 s, 185 MB/s 2024-04-25T08:49:34.721 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.721 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.721 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588947 s, 178 MB/s 2024-04-25T08:49:34.728 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.728 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.728 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650378 s, 161 MB/s 2024-04-25T08:49:34.736 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.736 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.736 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651786 s, 161 MB/s 2024-04-25T08:49:34.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.743 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583931 s, 180 MB/s 2024-04-25T08:49:34.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:34.744 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:34.744 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:34.744 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T08:49:34.744 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:34.744 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:34.744 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:34.744 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.809 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.810 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677878 s, 155 MB/s 2024-04-25T08:49:34.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.817 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674192 s, 156 MB/s 2024-04-25T08:49:34.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.825 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695044 s, 151 MB/s 2024-04-25T08:49:34.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.831 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565931 s, 185 MB/s 2024-04-25T08:49:34.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.839 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700608 s, 150 MB/s 2024-04-25T08:49:34.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.847 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689395 s, 152 MB/s 2024-04-25T08:49:34.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.854 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642049 s, 163 MB/s 2024-04-25T08:49:34.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.862 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685212 s, 153 MB/s 2024-04-25T08:49:34.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.870 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075384 s, 139 MB/s 2024-04-25T08:49:34.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.877 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587149 s, 179 MB/s 2024-04-25T08:49:34.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.884 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063314 s, 166 MB/s 2024-04-25T08:49:34.892 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.892 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.892 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661595 s, 158 MB/s 2024-04-25T08:49:34.899 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.899 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.899 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626645 s, 167 MB/s 2024-04-25T08:49:34.907 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.907 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.907 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700536 s, 150 MB/s 2024-04-25T08:49:34.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.914 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641892 s, 163 MB/s 2024-04-25T08:49:34.922 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.922 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.922 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690475 s, 152 MB/s 2024-04-25T08:49:34.929 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.929 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.929 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644581 s, 163 MB/s 2024-04-25T08:49:34.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.936 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595303 s, 176 MB/s 2024-04-25T08:49:34.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.944 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707088 s, 148 MB/s 2024-04-25T08:49:34.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.952 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071338 s, 147 MB/s 2024-04-25T08:49:34.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.959 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580145 s, 181 MB/s 2024-04-25T08:49:34.966 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.967 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695486 s, 151 MB/s 2024-04-25T08:49:34.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.974 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670493 s, 156 MB/s 2024-04-25T08:49:34.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.982 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677105 s, 155 MB/s 2024-04-25T08:49:34.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630993 s, 166 MB/s 2024-04-25T08:49:34.997 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:34.997 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:34.997 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707949 s, 148 MB/s 2024-04-25T08:49:35.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.005 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.005 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662281 s, 158 MB/s 2024-04-25T08:49:35.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.012 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650779 s, 161 MB/s 2024-04-25T08:49:35.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.020 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642515 s, 163 MB/s 2024-04-25T08:49:35.027 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.028 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747637 s, 140 MB/s 2024-04-25T08:49:35.035 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.035 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.035 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622876 s, 168 MB/s 2024-04-25T08:49:35.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.043 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739968 s, 142 MB/s 2024-04-25T08:49:35.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:35.044 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:35.044 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:35.044 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T08:49:35.044 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:35.045 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:35.045 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:35.045 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:35.110 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.110 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.110 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659885 s, 159 MB/s 2024-04-25T08:49:35.116 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.117 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598713 s, 175 MB/s 2024-04-25T08:49:35.124 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.124 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.124 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633976 s, 165 MB/s 2024-04-25T08:49:35.131 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.131 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.131 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632427 s, 166 MB/s 2024-04-25T08:49:35.138 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.138 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.138 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608584 s, 172 MB/s 2024-04-25T08:49:35.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.145 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633855 s, 165 MB/s 2024-04-25T08:49:35.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.155 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650327 s, 161 MB/s 2024-04-25T08:49:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.161 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738318 s, 142 MB/s 2024-04-25T08:49:35.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.168 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676616 s, 155 MB/s 2024-04-25T08:49:35.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.175 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584681 s, 179 MB/s 2024-04-25T08:49:35.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.183 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065406 s, 160 MB/s 2024-04-25T08:49:35.190 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.190 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.191 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681677 s, 154 MB/s 2024-04-25T08:49:35.197 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.197 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.197 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573603 s, 183 MB/s 2024-04-25T08:49:35.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.207 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919736 s, 114 MB/s 2024-04-25T08:49:35.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.215 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728952 s, 144 MB/s 2024-04-25T08:49:35.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.223 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651202 s, 161 MB/s 2024-04-25T08:49:35.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.230 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062794 s, 167 MB/s 2024-04-25T08:49:35.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.237 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639644 s, 164 MB/s 2024-04-25T08:49:35.244 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.244 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.244 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630868 s, 166 MB/s 2024-04-25T08:49:35.251 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.251 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.252 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066101 s, 159 MB/s 2024-04-25T08:49:35.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.259 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681534 s, 154 MB/s 2024-04-25T08:49:35.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.268 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712687 s, 147 MB/s 2024-04-25T08:49:35.275 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.275 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.275 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711249 s, 147 MB/s 2024-04-25T08:49:35.282 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.282 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.282 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587112 s, 179 MB/s 2024-04-25T08:49:35.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.289 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625714 s, 168 MB/s 2024-04-25T08:49:35.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.297 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.297 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675625 s, 155 MB/s 2024-04-25T08:49:35.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.304 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618163 s, 170 MB/s 2024-04-25T08:49:35.311 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.312 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703185 s, 149 MB/s 2024-04-25T08:49:35.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.318 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600458 s, 175 MB/s 2024-04-25T08:49:35.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.326 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609267 s, 172 MB/s 2024-04-25T08:49:35.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.333 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633102 s, 166 MB/s 2024-04-25T08:49:35.340 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.340 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.341 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686544 s, 153 MB/s 2024-04-25T08:49:35.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:35.342 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:35.342 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:35.342 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T08:49:35.342 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:35.342 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:35.342 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:35.342 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:35.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.406 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646268 s, 162 MB/s 2024-04-25T08:49:35.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652705 s, 161 MB/s 2024-04-25T08:49:35.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.421 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629484 s, 167 MB/s 2024-04-25T08:49:35.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.427 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574519 s, 183 MB/s 2024-04-25T08:49:35.437 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.437 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.437 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00897853 s, 117 MB/s 2024-04-25T08:49:35.444 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.444 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.444 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650624 s, 161 MB/s 2024-04-25T08:49:35.452 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.452 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.452 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680557 s, 154 MB/s 2024-04-25T08:49:35.460 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.460 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.460 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745885 s, 141 MB/s 2024-04-25T08:49:35.467 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.467 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.467 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062348 s, 168 MB/s 2024-04-25T08:49:35.475 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.475 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.475 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652541 s, 161 MB/s 2024-04-25T08:49:35.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.483 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733404 s, 143 MB/s 2024-04-25T08:49:35.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.490 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576819 s, 182 MB/s 2024-04-25T08:49:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.497 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678129 s, 155 MB/s 2024-04-25T08:49:35.505 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.505 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.505 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690489 s, 152 MB/s 2024-04-25T08:49:35.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.512 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583557 s, 180 MB/s 2024-04-25T08:49:35.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.519 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599519 s, 175 MB/s 2024-04-25T08:49:35.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.527 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723601 s, 145 MB/s 2024-04-25T08:49:35.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.535 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650863 s, 161 MB/s 2024-04-25T08:49:35.541 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.542 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640225 s, 164 MB/s 2024-04-25T08:49:35.549 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.549 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.549 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631839 s, 166 MB/s 2024-04-25T08:49:35.556 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.556 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.556 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650973 s, 161 MB/s 2024-04-25T08:49:35.564 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.564 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.564 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749791 s, 140 MB/s 2024-04-25T08:49:35.571 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.571 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.571 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624581 s, 168 MB/s 2024-04-25T08:49:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.580 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702927 s, 149 MB/s 2024-04-25T08:49:35.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.587 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061471 s, 171 MB/s 2024-04-25T08:49:35.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.597 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909134 s, 115 MB/s 2024-04-25T08:49:35.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.603 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599681 s, 175 MB/s 2024-04-25T08:49:35.610 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.610 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.610 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564293 s, 186 MB/s 2024-04-25T08:49:35.618 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.618 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.618 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691227 s, 152 MB/s 2024-04-25T08:49:35.626 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.626 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.626 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724934 s, 145 MB/s 2024-04-25T08:49:35.634 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.634 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.634 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716391 s, 146 MB/s 2024-04-25T08:49:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.642 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661071 s, 159 MB/s 2024-04-25T08:49:35.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:35.643 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:35.643 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:35.643 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T08:49:35.643 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:35.643 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:35.643 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:35.643 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:35.707 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.708 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.708 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712198 s, 147 MB/s 2024-04-25T08:49:35.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.715 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670446 s, 156 MB/s 2024-04-25T08:49:35.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.725 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917113 s, 114 MB/s 2024-04-25T08:49:35.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.733 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728634 s, 144 MB/s 2024-04-25T08:49:35.741 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.741 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.741 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720968 s, 145 MB/s 2024-04-25T08:49:35.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.750 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072195 s, 145 MB/s 2024-04-25T08:49:35.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642976 s, 163 MB/s 2024-04-25T08:49:35.764 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.764 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.764 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612995 s, 171 MB/s 2024-04-25T08:49:35.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.771 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618892 s, 169 MB/s 2024-04-25T08:49:35.778 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.778 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.778 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063825 s, 164 MB/s 2024-04-25T08:49:35.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.788 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881184 s, 119 MB/s 2024-04-25T08:49:35.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.795 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646058 s, 162 MB/s 2024-04-25T08:49:35.803 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.803 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.803 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736569 s, 142 MB/s 2024-04-25T08:49:35.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.811 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.811 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061753 s, 170 MB/s 2024-04-25T08:49:35.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.818 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.818 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627595 s, 167 MB/s 2024-04-25T08:49:35.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.825 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603809 s, 174 MB/s 2024-04-25T08:49:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.834 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.835 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912202 s, 115 MB/s 2024-04-25T08:49:35.843 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.843 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.843 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750549 s, 140 MB/s 2024-04-25T08:49:35.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.851 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.851 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069181 s, 152 MB/s 2024-04-25T08:49:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.860 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842736 s, 124 MB/s 2024-04-25T08:49:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642392 s, 163 MB/s 2024-04-25T08:49:35.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.874 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638141 s, 164 MB/s 2024-04-25T08:49:35.882 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.883 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.883 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731371 s, 143 MB/s 2024-04-25T08:49:35.891 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.891 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.891 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731945 s, 143 MB/s 2024-04-25T08:49:35.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.897 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570578 s, 184 MB/s 2024-04-25T08:49:35.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.905 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691371 s, 152 MB/s 2024-04-25T08:49:35.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.912 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637795 s, 164 MB/s 2024-04-25T08:49:35.920 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.920 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.920 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628636 s, 167 MB/s 2024-04-25T08:49:35.927 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.927 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.927 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700836 s, 150 MB/s 2024-04-25T08:49:35.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.934 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579403 s, 181 MB/s 2024-04-25T08:49:35.942 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.942 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.942 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069545 s, 151 MB/s 2024-04-25T08:49:35.951 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:35.951 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:35.951 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007227 s, 145 MB/s 2024-04-25T08:49:35.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:35.951 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:35.952 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:35.952 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T08:49:35.952 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:35.952 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:35.952 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:35.952 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:36.016 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.016 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.017 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067612 s, 155 MB/s 2024-04-25T08:49:36.024 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.024 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.024 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720658 s, 146 MB/s 2024-04-25T08:49:36.031 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.031 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.031 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618897 s, 169 MB/s 2024-04-25T08:49:36.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.038 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573665 s, 183 MB/s 2024-04-25T08:49:36.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.046 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653556 s, 160 MB/s 2024-04-25T08:49:36.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.054 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732469 s, 143 MB/s 2024-04-25T08:49:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.062 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759918 s, 138 MB/s 2024-04-25T08:49:36.070 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.070 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.070 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695533 s, 151 MB/s 2024-04-25T08:49:36.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.077 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570592 s, 184 MB/s 2024-04-25T08:49:36.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.084 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647907 s, 162 MB/s 2024-04-25T08:49:36.092 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.092 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.092 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719318 s, 146 MB/s 2024-04-25T08:49:36.099 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.099 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.099 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608123 s, 172 MB/s 2024-04-25T08:49:36.107 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.107 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.107 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702438 s, 149 MB/s 2024-04-25T08:49:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836622 s, 125 MB/s 2024-04-25T08:49:36.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.123 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648372 s, 162 MB/s 2024-04-25T08:49:36.131 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.131 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.131 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652149 s, 161 MB/s 2024-04-25T08:49:36.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.138 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583664 s, 180 MB/s 2024-04-25T08:49:36.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.145 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062394 s, 168 MB/s 2024-04-25T08:49:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.153 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715249 s, 147 MB/s 2024-04-25T08:49:36.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.161 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717343 s, 146 MB/s 2024-04-25T08:49:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.174 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921379 s, 114 MB/s 2024-04-25T08:49:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.179 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726358 s, 144 MB/s 2024-04-25T08:49:36.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.186 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569198 s, 184 MB/s 2024-04-25T08:49:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684723 s, 153 MB/s 2024-04-25T08:49:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573786 s, 183 MB/s 2024-04-25T08:49:36.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.208 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691186 s, 152 MB/s 2024-04-25T08:49:36.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.216 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007265 s, 144 MB/s 2024-04-25T08:49:36.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.223 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556458 s, 188 MB/s 2024-04-25T08:49:36.229 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.229 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.229 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612676 s, 171 MB/s 2024-04-25T08:49:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.237 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712974 s, 147 MB/s 2024-04-25T08:49:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.245 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636239 s, 165 MB/s 2024-04-25T08:49:36.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.252 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643007 s, 163 MB/s 2024-04-25T08:49:36.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:36.253 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:36.253 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:36.253 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T08:49:36.253 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:36.253 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:36.254 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:36.254 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:36.321 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.321 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.321 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913075 s, 115 MB/s 2024-04-25T08:49:36.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.330 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00834993 s, 126 MB/s 2024-04-25T08:49:36.336 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.336 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.336 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579262 s, 181 MB/s 2024-04-25T08:49:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.345 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738148 s, 142 MB/s 2024-04-25T08:49:36.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.352 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666489 s, 157 MB/s 2024-04-25T08:49:36.359 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.360 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653225 s, 161 MB/s 2024-04-25T08:49:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.367 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616948 s, 170 MB/s 2024-04-25T08:49:36.374 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.374 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.374 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601795 s, 174 MB/s 2024-04-25T08:49:36.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.381 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059637 s, 176 MB/s 2024-04-25T08:49:36.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.387 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557646 s, 188 MB/s 2024-04-25T08:49:36.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.394 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624719 s, 168 MB/s 2024-04-25T08:49:36.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.402 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722261 s, 145 MB/s 2024-04-25T08:49:36.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.410 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626651 s, 167 MB/s 2024-04-25T08:49:36.417 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.418 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720848 s, 145 MB/s 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883253 s, 119 MB/s 2024-04-25T08:49:36.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.435 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064352 s, 163 MB/s 2024-04-25T08:49:36.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.442 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614142 s, 171 MB/s 2024-04-25T08:49:36.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.449 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670307 s, 156 MB/s 2024-04-25T08:49:36.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.458 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751318 s, 140 MB/s 2024-04-25T08:49:36.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.465 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648171 s, 162 MB/s 2024-04-25T08:49:36.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.473 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735516 s, 143 MB/s 2024-04-25T08:49:36.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.480 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616533 s, 170 MB/s 2024-04-25T08:49:36.488 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.489 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.489 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767249 s, 137 MB/s 2024-04-25T08:49:36.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.496 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672822 s, 156 MB/s 2024-04-25T08:49:36.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.504 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640538 s, 164 MB/s 2024-04-25T08:49:36.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.512 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730405 s, 144 MB/s 2024-04-25T08:49:36.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.519 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670718 s, 156 MB/s 2024-04-25T08:49:36.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595949 s, 176 MB/s 2024-04-25T08:49:36.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.533 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573565 s, 183 MB/s 2024-04-25T08:49:36.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.540 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640462 s, 164 MB/s 2024-04-25T08:49:36.547 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.547 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.547 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578361 s, 181 MB/s 2024-04-25T08:49:36.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.554 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635558 s, 165 MB/s 2024-04-25T08:49:36.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:36.555 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:36.556 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:36.556 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T08:49:36.556 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:36.556 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:36.556 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:36.556 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:36.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.620 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633948 s, 165 MB/s 2024-04-25T08:49:36.626 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.626 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.627 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591772 s, 177 MB/s 2024-04-25T08:49:36.634 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.635 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709683 s, 148 MB/s 2024-04-25T08:49:36.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.643 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743063 s, 141 MB/s 2024-04-25T08:49:36.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.651 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.651 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704486 s, 149 MB/s 2024-04-25T08:49:36.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.658 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625454 s, 168 MB/s 2024-04-25T08:49:36.665 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.665 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.665 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062061 s, 169 MB/s 2024-04-25T08:49:36.674 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.674 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.674 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827362 s, 127 MB/s 2024-04-25T08:49:36.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.681 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637336 s, 165 MB/s 2024-04-25T08:49:36.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.689 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065553 s, 160 MB/s 2024-04-25T08:49:36.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.697 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708745 s, 148 MB/s 2024-04-25T08:49:36.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.704 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673246 s, 156 MB/s 2024-04-25T08:49:36.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.711 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622776 s, 168 MB/s 2024-04-25T08:49:36.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.718 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643879 s, 163 MB/s 2024-04-25T08:49:36.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.726 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686317 s, 153 MB/s 2024-04-25T08:49:36.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.733 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608389 s, 172 MB/s 2024-04-25T08:49:36.741 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.741 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.741 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732629 s, 143 MB/s 2024-04-25T08:49:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.749 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706849 s, 148 MB/s 2024-04-25T08:49:36.757 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.757 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.757 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681495 s, 154 MB/s 2024-04-25T08:49:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648898 s, 162 MB/s 2024-04-25T08:49:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.772 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065655 s, 160 MB/s 2024-04-25T08:49:36.780 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.780 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.780 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740741 s, 142 MB/s 2024-04-25T08:49:36.787 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.787 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.787 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615619 s, 170 MB/s 2024-04-25T08:49:36.797 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.797 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.797 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949608 s, 110 MB/s 2024-04-25T08:49:36.805 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.805 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.805 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693863 s, 151 MB/s 2024-04-25T08:49:36.812 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.812 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.813 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626469 s, 167 MB/s 2024-04-25T08:49:36.821 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.821 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.821 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692912 s, 151 MB/s 2024-04-25T08:49:36.827 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.827 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.828 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640179 s, 164 MB/s 2024-04-25T08:49:36.835 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.835 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.835 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063264 s, 166 MB/s 2024-04-25T08:49:36.842 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.842 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.842 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653043 s, 161 MB/s 2024-04-25T08:49:36.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.849 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634124 s, 165 MB/s 2024-04-25T08:49:36.858 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.858 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.858 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763027 s, 137 MB/s 2024-04-25T08:49:36.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:36.859 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:49:36.859 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:49:36.859 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T08:49:36.859 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:49:36.860 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:49:36.860 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:49:36.860 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:49:36.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.925 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718717 s, 146 MB/s 2024-04-25T08:49:36.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.933 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741426 s, 141 MB/s 2024-04-25T08:49:36.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.940 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585793 s, 179 MB/s 2024-04-25T08:49:36.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.948 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724204 s, 145 MB/s 2024-04-25T08:49:36.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.955 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684155 s, 153 MB/s 2024-04-25T08:49:36.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.963 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644711 s, 163 MB/s 2024-04-25T08:49:36.969 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.969 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.969 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00545713 s, 192 MB/s 2024-04-25T08:49:36.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.978 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.978 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740473 s, 142 MB/s 2024-04-25T08:49:36.985 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.986 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.986 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718111 s, 146 MB/s 2024-04-25T08:49:36.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:36.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:36.992 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577558 s, 182 MB/s 2024-04-25T08:49:37.000 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.000 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.000 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669292 s, 157 MB/s 2024-04-25T08:49:37.007 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.007 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.007 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593938 s, 177 MB/s 2024-04-25T08:49:37.016 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.016 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.016 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849781 s, 123 MB/s 2024-04-25T08:49:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.024 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639072 s, 164 MB/s 2024-04-25T08:49:37.030 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.030 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.031 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621234 s, 169 MB/s 2024-04-25T08:49:37.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.039 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703068 s, 149 MB/s 2024-04-25T08:49:37.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.047 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.047 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733557 s, 143 MB/s 2024-04-25T08:49:37.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.054 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063438 s, 165 MB/s 2024-04-25T08:49:37.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.062 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755155 s, 139 MB/s 2024-04-25T08:49:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914579 s, 115 MB/s 2024-04-25T08:49:37.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.080 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661451 s, 159 MB/s 2024-04-25T08:49:37.087 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.087 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.088 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681128 s, 154 MB/s 2024-04-25T08:49:37.095 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.095 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.095 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648428 s, 162 MB/s 2024-04-25T08:49:37.102 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.102 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.102 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632055 s, 166 MB/s 2024-04-25T08:49:37.110 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.110 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.110 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715536 s, 147 MB/s 2024-04-25T08:49:37.119 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.119 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.119 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836278 s, 125 MB/s 2024-04-25T08:49:37.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.126 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643935 s, 163 MB/s 2024-04-25T08:49:37.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.134 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693302 s, 151 MB/s 2024-04-25T08:49:37.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.142 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682482 s, 154 MB/s 2024-04-25T08:49:37.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.149 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062875 s, 167 MB/s 2024-04-25T08:49:37.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.157 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728604 s, 144 MB/s 2024-04-25T08:49:37.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:49:37.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:49:37.164 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624506 s, 168 MB/s 2024-04-25T08:49:37.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:37.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start /scrub_control_test_path recursive 2024-04-25T08:49:37.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.315+0000 7f17f841c640 1 Processor -- start 2024-04-25T08:49:37.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.315+0000 7f17f841c640 1 -- start start 2024-04-25T08:49:37.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f841c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f17f015dd80 0x7f17f00b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f841c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f17f00ad570 0x7f17f006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f841c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f00b3930 con 0x7f17f006abe0 2024-04-25T08:49:37.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f841c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f006e410 con 0x7f17f00ad570 2024-04-25T08:49:37.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f841c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f00b3c10 con 0x7f17f015dd80 2024-04-25T08:49:37.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f69b9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f17f00ad570 0x7f17f006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f69b9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f17f00ad570 0x7f17f006ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58742/0 (socket says 172.21.15.172:58742) 2024-04-25T08:49:37.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f69b9640 1 -- 172.21.15.172:0/1370816921 learned_addr learned my addr 172.21.15.172:0/1370816921 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f59b7640 1 --2- 172.21.15.172:0/1370816921 >> v2:172.21.15.186:3300/0 conn(0x7f17f015dd80 0x7f17f00b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f69b9640 1 -- 172.21.15.172:0/1370816921 >> v2:172.21.15.186:3300/0 conn(0x7f17f015dd80 msgr2=0x7f17f00b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f69b9640 1 --2- 172.21.15.172:0/1370816921 >> v2:172.21.15.186:3300/0 conn(0x7f17f015dd80 0x7f17f00b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f69b9640 1 -- 172.21.15.172:0/1370816921 >> v1:172.21.15.186:6789/0 conn(0x7f17f006abe0 legacy=0x7f17f006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f69b9640 1 -- 172.21.15.172:0/1370816921 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f006e660 con 0x7f17f00ad570 2024-04-25T08:49:37.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f69b9640 1 --2- 172.21.15.172:0/1370816921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f00ad570 0x7f17f006ee60 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f17f0071360 tx=0x7f17e802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730862de8b062e0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f51b6640 1 -- 172.21.15.172:0/1370816921 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8036070 con 0x7f17f00ad570 2024-04-25T08:49:37.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f51b6640 1 -- 172.21.15.172:0/1370816921 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8031600 con 0x7f17f00ad570 2024-04-25T08:49:37.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.317+0000 7f17f51b6640 1 -- 172.21.15.172:0/1370816921 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80319d0 con 0x7f17f00ad570 2024-04-25T08:49:37.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.318+0000 7f17f841c640 1 -- 172.21.15.172:0/1370816921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f00ad570 msgr2=0x7f17f006ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.318+0000 7f17f841c640 1 --2- 172.21.15.172:0/1370816921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f00ad570 0x7f17f006ee60 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f17f0071360 tx=0x7f17e802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.318+0000 7f17f841c640 1 -- 172.21.15.172:0/1370816921 shutdown_connections 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.318+0000 7f17f841c640 1 --2- 172.21.15.172:0/1370816921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f00ad570 0x7f17f006ee60 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.318+0000 7f17f841c640 1 --2- 172.21.15.172:0/1370816921 >> v2:172.21.15.186:3300/0 conn(0x7f17f015dd80 0x7f17f00b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.318+0000 7f17f841c640 1 -- 172.21.15.172:0/1370816921 >> 172.21.15.172:0/1370816921 conn(0x7f17f00b5af0 msgr2=0x7f17f00b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.318+0000 7f17f841c640 1 -- 172.21.15.172:0/1370816921 shutdown_connections 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.318+0000 7f17f841c640 1 -- 172.21.15.172:0/1370816921 wait complete. 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.319+0000 7f17f841c640 1 Processor -- start 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.319+0000 7f17f841c640 1 -- start start 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f841c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17f006abe0 0x7f17f015d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f841c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17f00ad570 0x7f17f014d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f841c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f015dd80 0x7f17f01593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f841c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0070280 con 0x7f17f015dd80 2024-04-25T08:49:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f841c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00b57d0 con 0x7f17f006abe0 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f841c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0070400 con 0x7f17f00ad570 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f69b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f015dd80 0x7f17f01593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f69b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f015dd80 0x7f17f01593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58746/0 (socket says 172.21.15.172:58746) 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f69b9640 1 -- 172.21.15.172:0/3870672624 learned_addr learned my addr 172.21.15.172:0/3870672624 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f61b8640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17f006abe0 0x7f17f015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f59b7640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17f00ad570 0x7f17f014d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f69b9640 1 -- 172.21.15.172:0/3870672624 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17f00ad570 msgr2=0x7f17f014d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f69b9640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17f00ad570 0x7f17f014d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f69b9640 1 -- 172.21.15.172:0/3870672624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17f006abe0 msgr2=0x7f17f015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f69b9640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17f006abe0 0x7f17f015d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f69b9640 1 -- 172.21.15.172:0/3870672624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f01f6df0 con 0x7f17f015dd80 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f69b9640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f015dd80 0x7f17f01593e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009f40 tx=0x7f17e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17e6ffd640 1 -- 172.21.15.172:0/3870672624 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8036050 con 0x7f17f015dd80 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17e6ffd640 1 -- 172.21.15.172:0/3870672624 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8042070 con 0x7f17f015dd80 2024-04-25T08:49:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17e6ffd640 1 -- 172.21.15.172:0/3870672624 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8009510 con 0x7f17f015dd80 2024-04-25T08:49:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f841c640 1 -- 172.21.15.172:0/3870672624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f01f70d0 con 0x7f17f015dd80 2024-04-25T08:49:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.320+0000 7f17f841c640 1 -- 172.21.15.172:0/3870672624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f01f7690 con 0x7f17f015dd80 2024-04-25T08:49:37.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.322+0000 7f17e6ffd640 1 -- 172.21.15.172:0/3870672624 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f17e8007c30 con 0x7f17f015dd80 2024-04-25T08:49:37.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.322+0000 7f17e6ffd640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f17d406b4d0 0x7f17d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.323+0000 7f17f61b8640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f17d406b4d0 0x7f17d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.323+0000 7f17e6ffd640 1 -- 172.21.15.172:0/3870672624 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f17e80ab0b0 con 0x7f17f015dd80 2024-04-25T08:49:37.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.323+0000 7f17f61b8640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f17d406b4d0 0x7f17d406d990 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f17ec004f60 tx=0x7f17ec007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.324+0000 7f17fb1f7740 1 Processor -- start 2024-04-25T08:49:37.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.324+0000 7f17fb1f7740 1 -- start start 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.324+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146d5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x5623146d35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623146fe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562314637000 con 0x5623146fdcc0 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623145dff20 con 0x56231470f8d0 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623146330a0 con 0x5623146d3200 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f69b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623146fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f69b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623146fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58754/0 (socket says 172.21.15.172:58754) 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f69b9640 1 -- 172.21.15.172:0/902296580 learned_addr learned my addr 172.21.15.172:0/902296580 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f61b8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146d5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f59b7640 1 --2- 172.21.15.172:0/902296580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x5623146d35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f69b9640 1 -- 172.21.15.172:0/902296580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 msgr2=0x5623146d5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f69b9640 1 --2- 172.21.15.172:0/902296580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146d5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f69b9640 1 -- 172.21.15.172:0/902296580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 msgr2=0x5623146d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f69b9640 1 --2- 172.21.15.172:0/902296580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x5623146d35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f69b9640 1 -- 172.21.15.172:0/902296580 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562314417ba0 con 0x5623146fdcc0 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f61b8640 1 --2- 172.21.15.172:0/902296580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146d5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f59b7640 1 --2- 172.21.15.172:0/902296580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x5623146d35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17f69b9640 1 --2- 172.21.15.172:0/902296580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623146fe140 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f17e8079770 tx=0x7f17e8079320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4423d20386d3cc01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17d3fff640 1 -- 172.21.15.172:0/902296580 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80797e0 con 0x5623146fdcc0 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17d3fff640 1 -- 172.21.15.172:0/902296580 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8037040 con 0x5623146fdcc0 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.325+0000 7f17d3fff640 1 -- 172.21.15.172:0/902296580 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e807d880 con 0x5623146fdcc0 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.326+0000 7f17fb1f7740 1 -- 172.21.15.172:0/902296580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 msgr2=0x5623146fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.326+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/902296580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623146fe140 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f17e8079770 tx=0x7f17e8079320 comp rx=0 tx=0).stop 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.326+0000 7f17fb1f7740 1 -- 172.21.15.172:0/902296580 shutdown_connections 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.326+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/902296580 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x5623146d35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.326+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/902296580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623146fe140 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.326+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/902296580 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146d5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.326+0000 7f17fb1f7740 1 -- 172.21.15.172:0/902296580 >> 172.21.15.172:0/902296580 conn(0x56231469b050 msgr2=0x562314718cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.326+0000 7f17fb1f7740 1 -- 172.21.15.172:0/902296580 shutdown_connections 2024-04-25T08:49:37.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.326+0000 7f17fb1f7740 1 -- 172.21.15.172:0/902296580 wait complete. 2024-04-25T08:49:37.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.327+0000 7f17fb1f7740 1 -- start start 2024-04-25T08:49:37.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.327+0000 7f17fb1f7740 1 Processor -- start 2024-04-25T08:49:37.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146fb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147164c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x562314716a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562314637000 con 0x5623146fdcc0 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623145d5610 con 0x56231470f8d0 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x562314714d40 con 0x5623146d3200 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17fb1f7740 10 client.0 _ll_register_callbacks cb 0x5623145edf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f59b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147164c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f59b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147164c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58758/0 (socket says 172.21.15.172:58758) 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f59b7640 1 -- 172.21.15.172:0/1674093663 learned_addr learned my addr 172.21.15.172:0/1674093663 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f69b9640 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x562314716a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f61b8640 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146fb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f59b7640 1 -- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 msgr2=0x5623146fb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f59b7640 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146fb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f59b7640 1 -- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 msgr2=0x562314716a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f59b7640 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x562314716a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f59b7640 1 -- 172.21.15.172:0/1674093663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56231430b490 con 0x5623146fdcc0 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f69b9640 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x562314716a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17f59b7640 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147164c0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f17e0012550 tx=0x7f17e0012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b50f56fb325420 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17d17fa640 1 -- 172.21.15.172:0/1674093663 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0019070 con 0x5623146fdcc0 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17d17fa640 1 -- 172.21.15.172:0/1674093663 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f17e0004300 con 0x5623146fdcc0 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1674093663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17e8037040 con 0x5623146fdcc0 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17d17fa640 1 -- 172.21.15.172:0/1674093663 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17e0024050 con 0x5623146fdcc0 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17fb1f7740 10 client.8322 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.328+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1674093663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x562314478330 con 0x5623146fdcc0 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17d17fa640 1 -- 172.21.15.172:0/1674093663 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8037040 con 0x5623146fdcc0 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17d17fa640 1 -- 172.21.15.172:0/1674093663 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f17e0027020 con 0x5623146fdcc0 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17fb1f7740 10 client.8322 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17fb1f7740 10 client.8322 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T08:49:37.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17fb1f7740 20 client.8322 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56231472c300 0x56231472c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17fb1f7740 4 client.8322 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1674093663 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562314644540 con 0x56231472c300 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17f61b8640 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56231472c300 0x56231472c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17d17fa640 10 client.8322 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.329+0000 7f17f61b8640 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56231472c300 0x56231472c6e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f6a96509fbc4ee3 server_cookie=96886df453b64c21 in_seq=0 out_seq=0 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17d17fa640 1 -- 172.21.15.172:0/1674093663 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562314644540 con 0x56231472c300 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17d17fa640 10 client.8322 handle_command_reply: tid=0 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 client.8322 shutdown 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1674093663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 msgr2=0x5623147164c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147164c0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f17e0012550 tx=0x7f17e0012950 comp rx=0 tx=0).stop 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1674093663 shutdown_connections 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56231472c300 0x56231472c6e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x562314716a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147164c0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1674093663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146fb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17d17fa640 0 client.8322 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1674093663 >> 172.21.15.172:0/1674093663 conn(0x56231469b050 msgr2=0x562314711d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1674093663 shutdown_connections 2024-04-25T08:49:37.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1674093663 wait complete. 2024-04-25T08:49:37.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.330+0000 7f17fb1f7740 20 client.8322 trim_cache size 0 max 16384 2024-04-25T08:49:37.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17fb1f7740 1 Processor -- start 2024-04-25T08:49:37.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17fb1f7740 1 -- start start 2024-04-25T08:49:37.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x562314715a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x562314714200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f02005a0 con 0x5623146fdcc0 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01ff7d0 con 0x56231470f8d0 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f015f100 con 0x5623146d3200 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f59b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f59b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58770/0 (socket says 172.21.15.172:58770) 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f59b7640 1 -- 172.21.15.172:0/701241721 learned_addr learned my addr 172.21.15.172:0/701241721 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f69b9640 1 --2- 172.21.15.172:0/701241721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x562314714200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f61b8640 1 --2- 172.21.15.172:0/701241721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x562314715a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f59b7640 1 -- 172.21.15.172:0/701241721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 msgr2=0x562314715a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f59b7640 1 --2- 172.21.15.172:0/701241721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x562314715a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f59b7640 1 -- 172.21.15.172:0/701241721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 msgr2=0x562314714200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f59b7640 1 --2- 172.21.15.172:0/701241721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x562314714200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f59b7640 1 -- 172.21.15.172:0/701241721 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623142e4610 con 0x5623146fdcc0 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.346+0000 7f17f69b9640 1 --2- 172.21.15.172:0/701241721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x562314714200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17f59b7640 1 --2- 172.21.15.172:0/701241721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147120e0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f17e0006e50 tx=0x7f17e000b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de556adc7a632dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17d37fe640 1 -- 172.21.15.172:0/701241721 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0019020 con 0x5623146fdcc0 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17d37fe640 1 -- 172.21.15.172:0/701241721 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e0003610 con 0x5623146fdcc0 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17d37fe640 1 -- 172.21.15.172:0/701241721 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0003ab0 con 0x5623146fdcc0 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17fb1f7740 1 -- 172.21.15.172:0/701241721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 msgr2=0x5623147120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/701241721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147120e0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f17e0006e50 tx=0x7f17e000b000 comp rx=0 tx=0).stop 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17fb1f7740 1 -- 172.21.15.172:0/701241721 shutdown_connections 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/701241721 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56231470f8d0 0x562314714200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/701241721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623146fdcc0 0x5623147120e0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/701241721 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x562314715a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17fb1f7740 1 -- 172.21.15.172:0/701241721 >> 172.21.15.172:0/701241721 conn(0x56231469b050 msgr2=0x5623146d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17fb1f7740 1 -- 172.21.15.172:0/701241721 shutdown_connections 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.347+0000 7f17fb1f7740 1 -- 172.21.15.172:0/701241721 wait complete. 2024-04-25T08:49:37.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.348+0000 7f17fb1f7740 1 -- start start 2024-04-25T08:49:37.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.348+0000 7f17fb1f7740 1 Processor -- start 2024-04-25T08:49:37.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146fa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5623146fdcc0 0x56231471a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17fb1f7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56231470f8d0 0x56231471ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562314717520 con 0x56231470f8d0 2024-04-25T08:49:37.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f01ff1d0 con 0x5623146fdcc0 2024-04-25T08:49:37.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17fb1f7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56231463c280 con 0x5623146d3200 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17fb1f7740 10 client.0 _ll_register_callbacks cb 0x7f17e8007f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f69b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56231470f8d0 0x56231471ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f61b8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f69b9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56231470f8d0 0x56231471ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58778/0 (socket says 172.21.15.172:58778) 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f69b9640 1 -- 172.21.15.172:0/1620873389 learned_addr learned my addr 172.21.15.172:0/1620873389 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f59b7640 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5623146fdcc0 0x56231471a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f69b9640 1 -- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 msgr2=0x5623146fa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f69b9640 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146fa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f69b9640 1 -- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5623146fdcc0 msgr2=0x56231471a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f69b9640 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5623146fdcc0 0x56231471a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f69b9640 1 -- 172.21.15.172:0/1620873389 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562314715970 con 0x56231470f8d0 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17f69b9640 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56231470f8d0 0x56231471ae90 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f17e80a9530 tx=0x7f17e8009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c4df173d11edbd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:37.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17d17fa640 1 -- 172.21.15.172:0/1620873389 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e8098060 con 0x56231470f8d0 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17d17fa640 1 -- 172.21.15.172:0/1620873389 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f17e8098200 con 0x56231470f8d0 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1620873389 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17e0003610 con 0x56231470f8d0 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17d17fa640 1 -- 172.21.15.172:0/1620873389 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17e80a9070 con 0x56231470f8d0 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17fb1f7740 10 client.8328 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1620873389 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x56231478cad0 con 0x56231470f8d0 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.349+0000 7f17d17fa640 1 -- 172.21.15.172:0/1620873389 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e0003610 con 0x56231470f8d0 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.350+0000 7f17d17fa640 1 -- 172.21.15.172:0/1620873389 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f17e8078c30 con 0x56231470f8d0 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.350+0000 7f17fb1f7740 10 client.8328 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.350+0000 7f17fb1f7740 10 client.8328 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.350+0000 7f17fb1f7740 20 client.8328 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.350+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x562314789400 0x56231478bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.350+0000 7f17fb1f7740 4 client.8328 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.350+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1620873389 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x562314717ee0 con 0x562314789400 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.350+0000 7f17f61b8640 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x562314789400 0x56231478bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.350+0000 7f17f61b8640 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x562314789400 0x56231478bc80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe1e8bc8165fd842 server_cookie=918e2c01d3a01f6d in_seq=0 out_seq=0 2024-04-25T08:49:37.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.350+0000 7f17d17fa640 10 client.8328 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17d17fa640 1 -- 172.21.15.172:0/1620873389 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562314717ee0 con 0x562314789400 2024-04-25T08:49:37.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17d17fa640 10 client.8328 handle_command_reply: tid=0 2024-04-25T08:49:37.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 client.8328 shutdown 2024-04-25T08:49:37.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1620873389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56231470f8d0 msgr2=0x56231471ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56231470f8d0 0x56231471ae90 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f17e80a9530 tx=0x7f17e8009810 comp rx=0 tx=0).stop 2024-04-25T08:49:37.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1620873389 shutdown_connections 2024-04-25T08:49:37.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x562314789400 0x56231478bc80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5623146fdcc0 0x56231471a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56231470f8d0 0x56231471ae90 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 --2- 172.21.15.172:0/1620873389 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5623146d3200 0x5623146fa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17d17fa640 0 client.8328 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1620873389 >> 172.21.15.172:0/1620873389 conn(0x56231469b050 msgr2=0x562314712cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1620873389 shutdown_connections 2024-04-25T08:49:37.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 1 -- 172.21.15.172:0/1620873389 wait complete. 2024-04-25T08:49:37.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.354+0000 7f17fb1f7740 20 client.8328 trim_cache size 0 max 16384 2024-04-25T08:49:37.349 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:49:37.349 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:49:37.349 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "5df5eb62-ea77-4fe4-823f-2722e5a5f9f1", 2024-04-25T08:49:37.349 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:49:37.349 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:49:37.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 -- 172.21.15.172:0/3870672624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f17d406b4d0 msgr2=0x7f17d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f17d406b4d0 0x7f17d406d990 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f17ec004f60 tx=0x7f17ec007e30 comp rx=0 tx=0).stop 2024-04-25T08:49:37.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 -- 172.21.15.172:0/3870672624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f015dd80 msgr2=0x7f17f01593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f015dd80 0x7f17f01593e0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009f40 tx=0x7f17e8004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:37.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 -- 172.21.15.172:0/3870672624 shutdown_connections 2024-04-25T08:49:37.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f17d406b4d0 0x7f17d406d990 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17f015dd80 0x7f17f01593e0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17f00ad570 0x7f17f014d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 --2- 172.21.15.172:0/3870672624 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17f006abe0 0x7f17f015d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 -- 172.21.15.172:0/3870672624 >> 172.21.15.172:0/3870672624 conn(0x7f17f00b5af0 msgr2=0x7f17f006ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 -- 172.21.15.172:0/3870672624 shutdown_connections 2024-04-25T08:49:37.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.355+0000 7f17f841c640 1 -- 172.21.15.172:0/3870672624 wait complete. 2024-04-25T08:49:37.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:37.358 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub pause 2024-04-25T08:49:37.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.473+0000 7f0812422640 1 Processor -- start 2024-04-25T08:49:37.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.474+0000 7f0812422640 1 -- start start 2024-04-25T08:49:37.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.474+0000 7f0812422640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f080c1610f0 0x7f080c06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.474+0000 7f0812422640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f080c1616f0 0x7f080c161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.474+0000 7f0812422640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f080c0ce0a0 0x7f080c0ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.474+0000 7f0812422640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080c1614d0 con 0x7f080c0ce0a0 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.474+0000 7f0812422640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080c0c6960 con 0x7f080c1610f0 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.474+0000 7f0812422640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c162260 con 0x7f080c1616f0 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.474+0000 7f08109bf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f080c0ce0a0 0x7f080c0ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.474+0000 7f08109bf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f080c0ce0a0 0x7f080c0ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56286/0 (socket says 172.21.15.172:56286) 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.474+0000 7f08109bf640 1 -- 172.21.15.172:0/16600263 learned_addr learned my addr 172.21.15.172:0/16600263 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.475+0000 7f080bfff640 1 --2- 172.21.15.172:0/16600263 >> v2:172.21.15.186:3300/0 conn(0x7f080c1610f0 0x7f080c06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.475+0000 7f080b7fe640 1 --2- 172.21.15.172:0/16600263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f080c1616f0 0x7f080c161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.475+0000 7f08109bf640 1 -- 172.21.15.172:0/16600263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f080c1616f0 msgr2=0x7f080c161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.475+0000 7f08109bf640 1 --2- 172.21.15.172:0/16600263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f080c1616f0 0x7f080c161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.475+0000 7f08109bf640 1 -- 172.21.15.172:0/16600263 >> v2:172.21.15.186:3300/0 conn(0x7f080c1610f0 msgr2=0x7f080c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.475+0000 7f08109bf640 1 --2- 172.21.15.172:0/16600263 >> v2:172.21.15.186:3300/0 conn(0x7f080c1610f0 0x7f080c06c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.475+0000 7f08109bf640 1 -- 172.21.15.172:0/16600263 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c162540 con 0x7f080c0ce0a0 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.475+0000 7f080bfff640 1 --2- 172.21.15.172:0/16600263 >> v2:172.21.15.186:3300/0 conn(0x7f080c1610f0 0x7f080c06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.475+0000 7f08109bf640 1 --2- 172.21.15.172:0/16600263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c0ce0a0 0x7f080c0ce530 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f080c071fb0 tx=0x7f080402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9221b34b7c7fd7c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f080affd640 1 -- 172.21.15.172:0/16600263 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804036070 con 0x7f080c0ce0a0 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f080affd640 1 -- 172.21.15.172:0/16600263 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0804031600 con 0x7f080c0ce0a0 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f080affd640 1 -- 172.21.15.172:0/16600263 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08040319d0 con 0x7f080c0ce0a0 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f0812422640 1 -- 172.21.15.172:0/16600263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c0ce0a0 msgr2=0x7f080c0ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f0812422640 1 --2- 172.21.15.172:0/16600263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c0ce0a0 0x7f080c0ce530 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f080c071fb0 tx=0x7f080402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f0812422640 1 -- 172.21.15.172:0/16600263 shutdown_connections 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f0812422640 1 --2- 172.21.15.172:0/16600263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c0ce0a0 0x7f080c0ce530 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f0812422640 1 --2- 172.21.15.172:0/16600263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f080c1616f0 0x7f080c161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f0812422640 1 --2- 172.21.15.172:0/16600263 >> v2:172.21.15.186:3300/0 conn(0x7f080c1610f0 0x7f080c06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f0812422640 1 -- 172.21.15.172:0/16600263 >> 172.21.15.172:0/16600263 conn(0x7f080c06f500 msgr2=0x7f080c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f0812422640 1 -- 172.21.15.172:0/16600263 shutdown_connections 2024-04-25T08:49:37.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.476+0000 7f0812422640 1 -- 172.21.15.172:0/16600263 wait complete. 2024-04-25T08:49:37.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.477+0000 7f0812422640 1 Processor -- start 2024-04-25T08:49:37.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.478+0000 7f0812422640 1 -- start start 2024-04-25T08:49:37.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.478+0000 7f0812422640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f080c0ce0a0 0x7f080c14af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.478+0000 7f0812422640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c1610f0 0x7f080c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.478+0000 7f0812422640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f080c1616f0 0x7f080c15fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.478+0000 7f0812422640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0cf690 con 0x7f080c1610f0 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.478+0000 7f0812422640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0cfce0 con 0x7f080c1616f0 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.478+0000 7f0812422640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c06c700 con 0x7f080c0ce0a0 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.478+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c1610f0 0x7f080c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.478+0000 7f080b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c1610f0 0x7f080c15a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56288/0 (socket says 172.21.15.172:56288) 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.478+0000 7f080b7fe640 1 -- 172.21.15.172:0/632671620 learned_addr learned my addr 172.21.15.172:0/632671620 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f080bfff640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f080c0ce0a0 0x7f080c14af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f08109bf640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f080c1616f0 0x7f080c15fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f080b7fe640 1 -- 172.21.15.172:0/632671620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f080c0ce0a0 msgr2=0x7f080c14af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f080b7fe640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f080c0ce0a0 0x7f080c14af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f080b7fe640 1 -- 172.21.15.172:0/632671620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f080c1616f0 msgr2=0x7f080c15fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f080b7fe640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f080c1616f0 0x7f080c15fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f080b7fe640 1 -- 172.21.15.172:0/632671620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c15ed40 con 0x7f080c1610f0 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f08109bf640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f080c1616f0 0x7f080c15fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f080b7fe640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c1610f0 0x7f080c15a810 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f080000d5f0 tx=0x7f080000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f0808ff9640 1 -- 172.21.15.172:0/632671620 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000125f0 con 0x7f080c1610f0 2024-04-25T08:49:37.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f0808ff9640 1 -- 172.21.15.172:0/632671620 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0800019070 con 0x7f080c1610f0 2024-04-25T08:49:37.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f0812422640 1 -- 172.21.15.172:0/632671620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c15f020 con 0x7f080c1610f0 2024-04-25T08:49:37.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f0808ff9640 1 -- 172.21.15.172:0/632671620 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000129d0 con 0x7f080c1610f0 2024-04-25T08:49:37.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.479+0000 7f0812422640 1 -- 172.21.15.172:0/632671620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c15f5e0 con 0x7f080c1610f0 2024-04-25T08:49:37.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.481+0000 7f0808ff9640 1 -- 172.21.15.172:0/632671620 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0800012b70 con 0x7f080c1610f0 2024-04-25T08:49:37.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.481+0000 7f0808ff9640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07f806b4d0 0x7f07f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.481+0000 7f0808ff9640 1 -- 172.21.15.172:0/632671620 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f080008a700 con 0x7f080c1610f0 2024-04-25T08:49:37.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.481+0000 7f080bfff640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07f806b4d0 0x7f07f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.482+0000 7f080bfff640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07f806b4d0 0x7f07f806d990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009950 tx=0x7f07fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.482+0000 7f08151fd740 1 Processor -- start 2024-04-25T08:49:37.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.482+0000 7f08151fd740 1 -- start start 2024-04-25T08:49:37.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f08151fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49ede00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f08151fd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a28370 0x5586a49ec080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f08151fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a16be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f08151fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a494eb90 con 0x5586a49ebca0 2024-04-25T08:49:37.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f08151fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a48f7e40 con 0x5586a4a16760 2024-04-25T08:49:37.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f08151fd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586a494ac30 con 0x5586a4a28370 2024-04-25T08:49:37.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f080bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49ede00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f080bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49ede00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56296/0 (socket says 172.21.15.172:56296) 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f080bfff640 1 -- 172.21.15.172:0/3775838538 learned_addr learned my addr 172.21.15.172:0/3775838538 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f080bfff640 1 -- 172.21.15.172:0/3775838538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a28370 msgr2=0x5586a49ec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f080bfff640 1 --2- 172.21.15.172:0/3775838538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a28370 0x5586a49ec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f080bfff640 1 -- 172.21.15.172:0/3775838538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 msgr2=0x5586a4a16be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f080bfff640 1 --2- 172.21.15.172:0/3775838538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a16be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f080bfff640 1 -- 172.21.15.172:0/3775838538 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586a472d7d0 con 0x5586a49ebca0 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f080bfff640 1 --2- 172.21.15.172:0/3775838538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49ede00 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f07fc011a40 tx=0x7f07fc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac19c422eef4af3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f07f1ffb640 1 -- 172.21.15.172:0/3775838538 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc026070 con 0x5586a49ebca0 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f07f1ffb640 1 -- 172.21.15.172:0/3775838538 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc01a030 con 0x5586a49ebca0 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.483+0000 7f07f1ffb640 1 -- 172.21.15.172:0/3775838538 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc00f040 con 0x5586a49ebca0 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.484+0000 7f08151fd740 1 -- 172.21.15.172:0/3775838538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 msgr2=0x5586a49ede00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.484+0000 7f08151fd740 1 --2- 172.21.15.172:0/3775838538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49ede00 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f07fc011a40 tx=0x7f07fc014000 comp rx=0 tx=0).stop 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.484+0000 7f08151fd740 1 -- 172.21.15.172:0/3775838538 shutdown_connections 2024-04-25T08:49:37.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.484+0000 7f08151fd740 1 --2- 172.21.15.172:0/3775838538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a16be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.484+0000 7f08151fd740 1 --2- 172.21.15.172:0/3775838538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a28370 0x5586a49ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.484+0000 7f08151fd740 1 --2- 172.21.15.172:0/3775838538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49ede00 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.484+0000 7f08151fd740 1 -- 172.21.15.172:0/3775838538 >> 172.21.15.172:0/3775838538 conn(0x5586a49b3870 msgr2=0x5586a4a31760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.484+0000 7f08151fd740 1 -- 172.21.15.172:0/3775838538 shutdown_connections 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.484+0000 7f08151fd740 1 -- 172.21.15.172:0/3775838538 wait complete. 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.485+0000 7f08151fd740 1 -- start start 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.485+0000 7f08151fd740 1 Processor -- start 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.485+0000 7f08151fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a4a2d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08151fd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a16760 0x5586a4a414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08151fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a28370 0x5586a4a419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08151fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a490b3e0 con 0x5586a49ebca0 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08151fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a4a142b0 con 0x5586a4a28370 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08151fd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586a4a13dd0 con 0x5586a4a16760 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08151fd740 10 client.0 _ll_register_callbacks cb 0x5586a490adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:37.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f080bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a4a2d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f080bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a4a2d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56298/0 (socket says 172.21.15.172:56298) 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f080bfff640 1 -- 172.21.15.172:0/2232291908 learned_addr learned my addr 172.21.15.172:0/2232291908 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08109bf640 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a28370 0x5586a4a419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f080b7fe640 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a16760 0x5586a4a414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f080bfff640 1 -- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a16760 msgr2=0x5586a4a414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f080bfff640 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a16760 0x5586a4a414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f080bfff640 1 -- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a28370 msgr2=0x5586a4a419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f080bfff640 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a28370 0x5586a4a419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f080bfff640 1 -- 172.21.15.172:0/2232291908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586a46230f0 con 0x5586a49ebca0 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08109bf640 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a28370 0x5586a4a419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f080bfff640 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a4a2d330 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f07fc015810 tx=0x7f07fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28580db83879cbde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f07eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f07eaffd640 1 -- 172.21.15.172:0/2232291908 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc030060 con 0x5586a49ebca0 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f07eaffd640 1 -- 172.21.15.172:0/2232291908 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f07fc004030 con 0x5586a49ebca0 2024-04-25T08:49:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08151fd740 1 -- 172.21.15.172:0/2232291908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07fc01a030 con 0x5586a49ebca0 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f07eaffd640 1 -- 172.21.15.172:0/2232291908 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07fc036050 con 0x5586a49ebca0 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08151fd740 10 client.8340 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f08151fd740 1 -- 172.21.15.172:0/2232291908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x5586a478df60 con 0x5586a49ebca0 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.486+0000 7f07eaffd640 1 -- 172.21.15.172:0/2232291908 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc01a030 con 0x5586a49ebca0 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.487+0000 7f07eaffd640 1 -- 172.21.15.172:0/2232291908 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f07fc039020 con 0x5586a49ebca0 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.487+0000 7f08151fd740 10 client.8340 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.487+0000 7f08151fd740 10 client.8340 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.487+0000 7f08151fd740 20 client.8340 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.487+0000 7f08151fd740 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x5586a4a2eb50 0x5586a4a17810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.487+0000 7f08151fd740 4 client.8340 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.487+0000 7f08151fd740 1 -- 172.21.15.172:0/2232291908 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586a495c0d0 con 0x5586a4a2eb50 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.487+0000 7f080b7fe640 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x5586a4a2eb50 0x5586a4a17810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.487+0000 7f07eaffd640 10 client.8340 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.487+0000 7f080b7fe640 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x5586a4a2eb50 0x5586a4a17810 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d836f1df9daab760 server_cookie=fc43d9c0a40e89b0 in_seq=0 out_seq=0 2024-04-25T08:49:37.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f07eaffd640 1 -- 172.21.15.172:0/2232291908 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5586a495c0d0 con 0x5586a4a2eb50 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f07eaffd640 10 client.8340 handle_command_reply: tid=0 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 client.8340 shutdown 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 -- 172.21.15.172:0/2232291908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 msgr2=0x5586a4a2d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a4a2d330 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f07fc015810 tx=0x7f07fc004730 comp rx=0 tx=0).stop 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 -- 172.21.15.172:0/2232291908 shutdown_connections 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x5586a4a2eb50 0x5586a4a17810 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a28370 0x5586a4a419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a16760 0x5586a4a414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f07eaffd640 0 client.8340 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 --2- 172.21.15.172:0/2232291908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a4a2d330 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 -- 172.21.15.172:0/2232291908 >> 172.21.15.172:0/2232291908 conn(0x5586a49b3870 msgr2=0x5586a4a14490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 -- 172.21.15.172:0/2232291908 shutdown_connections 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 1 -- 172.21.15.172:0/2232291908 wait complete. 2024-04-25T08:49:37.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.488+0000 7f08151fd740 20 client.8340 trim_cache size 0 max 16384 2024-04-25T08:49:37.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.502+0000 7f08151fd740 1 Processor -- start 2024-04-25T08:49:37.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f08151fd740 1 -- start start 2024-04-25T08:49:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f08151fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49e5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f08151fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f08151fd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a28370 0x5586a4a14150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f08151fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c200460 con 0x5586a49ebca0 2024-04-25T08:49:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f08151fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c1f8320 con 0x5586a4a16760 2024-04-25T08:49:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f08151fd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c1f7720 con 0x5586a4a28370 2024-04-25T08:49:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f080bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49e5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f080bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49e5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56300/0 (socket says 172.21.15.172:56300) 2024-04-25T08:49:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f080bfff640 1 -- 172.21.15.172:0/2844124127 learned_addr learned my addr 172.21.15.172:0/2844124127 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f080b7fe640 1 --2- 172.21.15.172:0/2844124127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.503+0000 7f08109bf640 1 --2- 172.21.15.172:0/2844124127 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a28370 0x5586a4a14150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f080bfff640 1 -- 172.21.15.172:0/2844124127 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a28370 msgr2=0x5586a4a14150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f080bfff640 1 --2- 172.21.15.172:0/2844124127 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a28370 0x5586a4a14150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f080bfff640 1 -- 172.21.15.172:0/2844124127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 msgr2=0x5586a4a544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f080bfff640 1 --2- 172.21.15.172:0/2844124127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f080bfff640 1 -- 172.21.15.172:0/2844124127 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586a45fc1b0 con 0x5586a49ebca0 2024-04-25T08:49:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f080b7fe640 1 --2- 172.21.15.172:0/2844124127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f080bfff640 1 --2- 172.21.15.172:0/2844124127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49e5ae0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f07fc015e60 tx=0x7f07fc029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ec93927de7565b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f07f17fa640 1 -- 172.21.15.172:0/2844124127 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc026030 con 0x5586a49ebca0 2024-04-25T08:49:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f07f17fa640 1 -- 172.21.15.172:0/2844124127 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc01a070 con 0x5586a49ebca0 2024-04-25T08:49:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f07f17fa640 1 -- 172.21.15.172:0/2844124127 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc00f040 con 0x5586a49ebca0 2024-04-25T08:49:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f08151fd740 1 -- 172.21.15.172:0/2844124127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 msgr2=0x5586a49e5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f08151fd740 1 --2- 172.21.15.172:0/2844124127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49e5ae0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f07fc015e60 tx=0x7f07fc029000 comp rx=0 tx=0).stop 2024-04-25T08:49:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f08151fd740 1 -- 172.21.15.172:0/2844124127 shutdown_connections 2024-04-25T08:49:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f08151fd740 1 --2- 172.21.15.172:0/2844124127 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f08151fd740 1 --2- 172.21.15.172:0/2844124127 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a4a28370 0x5586a4a14150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f08151fd740 1 --2- 172.21.15.172:0/2844124127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a49ebca0 0x5586a49e5ae0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f08151fd740 1 -- 172.21.15.172:0/2844124127 >> 172.21.15.172:0/2844124127 conn(0x5586a49b3870 msgr2=0x5586a4a198f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f08151fd740 1 -- 172.21.15.172:0/2844124127 shutdown_connections 2024-04-25T08:49:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.504+0000 7f08151fd740 1 -- 172.21.15.172:0/2844124127 wait complete. 2024-04-25T08:49:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.505+0000 7f08151fd740 1 -- start start 2024-04-25T08:49:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.505+0000 7f08151fd740 1 Processor -- start 2024-04-25T08:49:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08151fd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a49ebca0 0x5586a4a19cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08151fd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a2ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08151fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a4a28370 0x5586a4a2d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08151fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a490ee90 con 0x5586a4a28370 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08151fd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c1f7d20 con 0x5586a4a16760 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08151fd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586a4a2e490 con 0x5586a49ebca0 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08151fd740 10 client.0 _ll_register_callbacks cb 0x7f07fc015cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08109bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a4a28370 0x5586a4a2d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08109bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a4a28370 0x5586a4a2d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56316/0 (socket says 172.21.15.172:56316) 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08109bf640 1 -- 172.21.15.172:0/118681439 learned_addr learned my addr 172.21.15.172:0/118681439 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f080b7fe640 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a2ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f080bfff640 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a49ebca0 0x5586a4a19cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08109bf640 1 -- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a49ebca0 msgr2=0x5586a4a19cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08109bf640 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a49ebca0 0x5586a4a19cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08109bf640 1 -- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 msgr2=0x5586a4a2ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08109bf640 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a2ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.506+0000 7f08109bf640 1 -- 172.21.15.172:0/118681439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586a4a8f790 con 0x5586a4a28370 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f08109bf640 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a4a28370 0x5586a4a2d230 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0804034040 tx=0x7f0804004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4de8e44eb25d9c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f07eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f07eaffd640 1 -- 172.21.15.172:0/118681439 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804036040 con 0x5586a4a28370 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f07eaffd640 1 -- 172.21.15.172:0/118681439 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0804031da0 con 0x5586a4a28370 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f08151fd740 1 -- 172.21.15.172:0/118681439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07fc01a070 con 0x5586a4a28370 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f07eaffd640 1 -- 172.21.15.172:0/118681439 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f080404f050 con 0x5586a4a28370 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f08151fd740 10 client.8346 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f08151fd740 1 -- 172.21.15.172:0/118681439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x5586a4a92fe0 con 0x5586a4a28370 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f07eaffd640 1 -- 172.21.15.172:0/118681439 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc01a070 con 0x5586a4a28370 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f07eaffd640 1 -- 172.21.15.172:0/118681439 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0804052020 con 0x5586a4a28370 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f08151fd740 10 client.8346 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f08151fd740 10 client.8346 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f08151fd740 20 client.8346 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f08151fd740 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x5586a4a2b1b0 0x5586a4a8fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f08151fd740 4 client.8346 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f08151fd740 1 -- 172.21.15.172:0/118681439 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x5586a4956420 con 0x5586a4a2b1b0 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.507+0000 7f080bfff640 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x5586a4a2b1b0 0x5586a4a8fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f080bfff640 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x5586a4a2b1b0 0x5586a4a8fa70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbc0641f58dc7118 server_cookie=c757583ad168cd5f in_seq=0 out_seq=0 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f07eaffd640 10 client.8346 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f07eaffd640 1 -- 172.21.15.172:0/118681439 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x5586a4956420 con 0x5586a4a2b1b0 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f07eaffd640 10 client.8346 handle_command_reply: tid=0 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 client.8346 shutdown 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 -- 172.21.15.172:0/118681439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a4a28370 msgr2=0x5586a4a2d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a4a28370 0x5586a4a2d230 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f0804034040 tx=0x7f0804004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 -- 172.21.15.172:0/118681439 shutdown_connections 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x5586a4a2b1b0 0x5586a4a8fa70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5586a4a16760 0x5586a4a2ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5586a4a28370 0x5586a4a2d230 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f07eaffd640 0 client.8346 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 --2- 172.21.15.172:0/118681439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5586a49ebca0 0x5586a4a19cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 -- 172.21.15.172:0/118681439 >> 172.21.15.172:0/118681439 conn(0x5586a49b3870 msgr2=0x5586a4a10ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 -- 172.21.15.172:0/118681439 shutdown_connections 2024-04-25T08:49:37.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 1 -- 172.21.15.172:0/118681439 wait complete. 2024-04-25T08:49:37.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.508+0000 7f08151fd740 20 client.8346 trim_cache size 0 max 16384 2024-04-25T08:49:37.507 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:49:37.507 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0 2024-04-25T08:49:37.507 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:49:37.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 -- 172.21.15.172:0/632671620 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07f806b4d0 msgr2=0x7f07f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07f806b4d0 0x7f07f806d990 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009950 tx=0x7f07fc008040 comp rx=0 tx=0).stop 2024-04-25T08:49:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 -- 172.21.15.172:0/632671620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c1610f0 msgr2=0x7f080c15a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c1610f0 0x7f080c15a810 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f080000d5f0 tx=0x7f080000dab0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 -- 172.21.15.172:0/632671620 shutdown_connections 2024-04-25T08:49:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f07f806b4d0 0x7f07f806d990 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f080c1616f0 0x7f080c15fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f080c1610f0 0x7f080c15a810 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 --2- 172.21.15.172:0/632671620 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f080c0ce0a0 0x7f080c14af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 -- 172.21.15.172:0/632671620 >> 172.21.15.172:0/632671620 conn(0x7f080c06f500 msgr2=0x7f080c0d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 -- 172.21.15.172:0/632671620 shutdown_connections 2024-04-25T08:49:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.509+0000 7f0812422640 1 -- 172.21.15.172:0/632671620 wait complete. 2024-04-25T08:49:37.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:37.512 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T08:49:37.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.622+0000 7ffb45d16640 1 Processor -- start 2024-04-25T08:49:37.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.622+0000 7ffb45d16640 1 -- start start 2024-04-25T08:49:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.622+0000 7ffb45d16640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb4015dc20 0x7ffb400ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.622+0000 7ffb45d16640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffb400d32f0 0x7ffb400cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.622+0000 7ffb45d16640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4015e000 con 0x7ffb40161710 2024-04-25T08:49:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.622+0000 7ffb45d16640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb400d1de0 con 0x7ffb4015dc20 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.622+0000 7ffb45d16640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb40161c60 con 0x7ffb400d32f0 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.623+0000 7ffb3f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb4015dc20 0x7ffb400ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.623+0000 7ffb37fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ffb40161710 0x7ffb4006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51232/0 (socket says 172.21.15.172:51232) 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.623+0000 7ffb37fff640 1 -- 172.21.15.172:0/52465156 learned_addr learned my addr 172.21.15.172:0/52465156 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.623+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/52465156 >> v2:172.21.15.186:3300/0 conn(0x7ffb400d32f0 0x7ffb400cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.623+0000 7ffb3f7fe640 1 -- 172.21.15.172:0/52465156 >> v2:172.21.15.186:3300/0 conn(0x7ffb400d32f0 msgr2=0x7ffb400cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.623+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/52465156 >> v2:172.21.15.186:3300/0 conn(0x7ffb400d32f0 0x7ffb400cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.623+0000 7ffb3f7fe640 1 -- 172.21.15.172:0/52465156 >> v1:172.21.15.172:6789/0 conn(0x7ffb40161710 legacy=0x7ffb4006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.623+0000 7ffb3f7fe640 1 -- 172.21.15.172:0/52465156 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb40161f40 con 0x7ffb4015dc20 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.623+0000 7ffb3effd640 1 -- 172.21.15.172:0/52465156 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206069305 0 0) 0x7ffb4015e000 con 0x7ffb40161710 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/52465156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 0x7ffb400ce670 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ffb400b6910 tx=0x7ffb3002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88945b8765f517e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb3effd640 1 -- 172.21.15.172:0/52465156 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30037070 con 0x7ffb4015dc20 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb3effd640 1 -- 172.21.15.172:0/52465156 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb30032440 con 0x7ffb4015dc20 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb3effd640 1 -- 172.21.15.172:0/52465156 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30032810 con 0x7ffb4015dc20 2024-04-25T08:49:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb45d16640 1 -- 172.21.15.172:0/52465156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 msgr2=0x7ffb400ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb45d16640 1 --2- 172.21.15.172:0/52465156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 0x7ffb400ce670 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ffb400b6910 tx=0x7ffb3002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb45d16640 1 -- 172.21.15.172:0/52465156 shutdown_connections 2024-04-25T08:49:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb45d16640 1 --2- 172.21.15.172:0/52465156 >> v2:172.21.15.186:3300/0 conn(0x7ffb400d32f0 0x7ffb400cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb45d16640 1 --2- 172.21.15.172:0/52465156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 0x7ffb400ce670 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb45d16640 1 -- 172.21.15.172:0/52465156 >> 172.21.15.172:0/52465156 conn(0x7ffb400d0420 msgr2=0x7ffb400d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb45d16640 1 -- 172.21.15.172:0/52465156 shutdown_connections 2024-04-25T08:49:37.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.624+0000 7ffb45d16640 1 -- 172.21.15.172:0/52465156 wait complete. 2024-04-25T08:49:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb45d16640 1 Processor -- start 2024-04-25T08:49:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb45d16640 1 -- start start 2024-04-25T08:49:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb45d16640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb400d32f0 0x7ffb4015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb45d16640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 0x7ffb4015f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb45d16640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb40161710 0x7ffb401f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb45d16640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400b5e50 con 0x7ffb4015dc20 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb45d16640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb40162500 con 0x7ffb40161710 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb45d16640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400b5fd0 con 0x7ffb400d32f0 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 0x7ffb4015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 0x7ffb4015f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56346/0 (socket says 172.21.15.172:56346) 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.626+0000 7ffb37fff640 1 -- 172.21.15.172:0/746867672 learned_addr learned my addr 172.21.15.172:0/746867672 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb40161710 0x7ffb401f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb400d32f0 0x7ffb4015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb37fff640 1 -- 172.21.15.172:0/746867672 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb400d32f0 msgr2=0x7ffb4015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb37fff640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb400d32f0 0x7ffb4015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb37fff640 1 -- 172.21.15.172:0/746867672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb40161710 msgr2=0x7ffb401f4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb37fff640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb40161710 0x7ffb401f4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb37fff640 1 -- 172.21.15.172:0/746867672 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb40160130 con 0x7ffb4015dc20 2024-04-25T08:49:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb40161710 0x7ffb401f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb37fff640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 0x7ffb4015f200 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800c460 tx=0x7ffb2800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb3cff9640 1 -- 172.21.15.172:0/746867672 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28018070 con 0x7ffb4015dc20 2024-04-25T08:49:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb3cff9640 1 -- 172.21.15.172:0/746867672 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb28007500 con 0x7ffb4015dc20 2024-04-25T08:49:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb45d16640 1 -- 172.21.15.172:0/746867672 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4015fb70 con 0x7ffb4015dc20 2024-04-25T08:49:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb3cff9640 1 -- 172.21.15.172:0/746867672 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28004a20 con 0x7ffb4015dc20 2024-04-25T08:49:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.627+0000 7ffb45d16640 1 -- 172.21.15.172:0/746867672 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb400aa8f0 con 0x7ffb4015dc20 2024-04-25T08:49:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.629+0000 7ffb3cff9640 1 -- 172.21.15.172:0/746867672 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb2801b070 con 0x7ffb4015dc20 2024-04-25T08:49:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.629+0000 7ffb3cff9640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b500 0x7ffb2006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.629+0000 7ffb3cff9640 1 -- 172.21.15.172:0/746867672 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffb280894f0 con 0x7ffb4015dc20 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.629+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b500 0x7ffb2006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.630+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b500 0x7ffb2006d9c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ffb30034000 tx=0x7ffb3002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.630+0000 7ffb48a16740 1 Processor -- start 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.630+0000 7ffb48a16740 1 -- start start 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d329b10 0x56000d32c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d32c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d2fc770 0x56000d2fff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb48a16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d265da0 con 0x56000d329b10 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb48a16740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d20eb80 con 0x56000d2fc770 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb48a16740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56000d261e40 con 0x56000d329ef0 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d329b10 0x56000d32c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d329b10 0x56000d32c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56348/0 (socket says 172.21.15.172:56348) 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3f7fe640 1 -- 172.21.15.172:0/3679236864 learned_addr learned my addr 172.21.15.172:0/3679236864 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d2fc770 0x56000d2fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb37fff640 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d32c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3f7fe640 1 -- 172.21.15.172:0/3679236864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 msgr2=0x56000d32c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d32c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3f7fe640 1 -- 172.21.15.172:0/3679236864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d2fc770 msgr2=0x56000d2fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d2fc770 0x56000d2fff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3f7fe640 1 -- 172.21.15.172:0/3679236864 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56000d218f10 con 0x56000d329b10 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d2fc770 0x56000d2fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb37fff640 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d32c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.631+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d329b10 0x56000d32c320 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ffb3002a1e0 tx=0x7ffb3002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e00c395304e7a8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb357fa640 1 -- 172.21.15.172:0/3679236864 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3004d070 con 0x56000d329b10 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb357fa640 1 -- 172.21.15.172:0/3679236864 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb30032d40 con 0x56000d329b10 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb357fa640 1 -- 172.21.15.172:0/3679236864 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30037040 con 0x56000d329b10 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb48a16740 1 -- 172.21.15.172:0/3679236864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d329b10 msgr2=0x56000d32c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d329b10 0x56000d32c320 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ffb3002a1e0 tx=0x7ffb3002c000 comp rx=0 tx=0).stop 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb48a16740 1 -- 172.21.15.172:0/3679236864 shutdown_connections 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d2fc770 0x56000d2fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d32c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3679236864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d329b10 0x56000d32c320 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb48a16740 1 -- 172.21.15.172:0/3679236864 >> 172.21.15.172:0/3679236864 conn(0x56000d2fe9e0 msgr2=0x56000d347320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb48a16740 1 -- 172.21.15.172:0/3679236864 shutdown_connections 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.632+0000 7ffb48a16740 1 -- 172.21.15.172:0/3679236864 wait complete. 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.633+0000 7ffb48a16740 1 -- start start 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.633+0000 7ffb48a16740 1 Processor -- start 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 0x56000d311a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d3202c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d320800 0x56000d32b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb48a16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d301b90 con 0x56000d320800 2024-04-25T08:49:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb48a16740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d2044b0 con 0x56000d329b10 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb48a16740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56000d301e70 con 0x56000d329ef0 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb48a16740 10 client.0 _ll_register_callbacks cb 0x56000d244180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d320800 0x56000d32b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3f7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 0x56000d311a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d320800 0x56000d32b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56360/0 (socket says 172.21.15.172:56360) 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3f7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 0x56000d311a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:59806/0 (socket says 172.21.15.172:59806) 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3ffff640 1 -- 172.21.15.172:0/1547227211 learned_addr learned my addr 172.21.15.172:0/1547227211 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb37fff640 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d3202c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3ffff640 1 -- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 msgr2=0x56000d3202c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d3202c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3ffff640 1 -- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 msgr2=0x56000d311a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 0x56000d311a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3ffff640 1 -- 172.21.15.172:0/1547227211 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56000d0447d0 con 0x56000d320800 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 0x56000d311a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:37.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d320800 0x56000d32b350 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7ffb38007da0 tx=0x7ffb38010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0b473880b84417 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/1547227211 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3801a020 con 0x56000d320800 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/1547227211 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffb38010e20 con 0x56000d320800 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.634+0000 7ffb48a16740 1 -- 172.21.15.172:0/1547227211 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb30032d40 con 0x56000d320800 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/1547227211 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb38024050 con 0x56000d320800 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb48a16740 10 client.8361 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb48a16740 1 -- 172.21.15.172:0/1547227211 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x56000cf7a3f0 con 0x56000d320800 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/1547227211 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb30032d40 con 0x56000d320800 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/1547227211 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ffb38027020 con 0x56000d320800 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb48a16740 10 client.8361 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb48a16740 10 client.8361 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb48a16740 20 client.8361 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:37.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb48a16740 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56000d348920 0x56000d348d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb48a16740 4 client.8361 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb48a16740 1 -- 172.21.15.172:0/1547227211 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56000d2732e0 con 0x56000d348920 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56000d348920 0x56000d348d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56000d348920 0x56000d348d30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ebd2aa22f7fdba8 server_cookie=24588612ce32e16d in_seq=0 out_seq=0 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.635+0000 7ffb1e7fc640 10 client.8361 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/1547227211 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56000d2732e0 con 0x56000d348920 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb1e7fc640 10 client.8361 handle_command_reply: tid=0 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 client.8361 shutdown 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 -- 172.21.15.172:0/1547227211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d320800 msgr2=0x56000d32b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d320800 0x56000d32b350 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7ffb38007da0 tx=0x7ffb38010590 comp rx=0 tx=0).stop 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 -- 172.21.15.172:0/1547227211 shutdown_connections 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56000d348920 0x56000d348d30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d320800 0x56000d32b350 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d3202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 --2- 172.21.15.172:0/1547227211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 0x56000d311a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb1e7fc640 0 client.8361 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 -- 172.21.15.172:0/1547227211 >> 172.21.15.172:0/1547227211 conn(0x56000d2fc770 msgr2=0x56000d3013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 -- 172.21.15.172:0/1547227211 shutdown_connections 2024-04-25T08:49:37.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 1 -- 172.21.15.172:0/1547227211 wait complete. 2024-04-25T08:49:37.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.636+0000 7ffb48a16740 20 client.8361 trim_cache size 0 max 16384 2024-04-25T08:49:37.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.651+0000 7ffb48a16740 1 Processor -- start 2024-04-25T08:49:37.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.651+0000 7ffb48a16740 1 -- start start 2024-04-25T08:49:37.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329b10 0x56000d2f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329ef0 0x56000d32ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d330460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb48a16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb402002d0 con 0x56000d32f6e0 2024-04-25T08:49:37.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb48a16740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb401ff4b0 con 0x56000d329ef0 2024-04-25T08:49:37.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb48a16740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb401f4110 con 0x56000d329b10 2024-04-25T08:49:37.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb3ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d330460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb3ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d330460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56372/0 (socket says 172.21.15.172:56372) 2024-04-25T08:49:37.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb3ffff640 1 -- 172.21.15.172:0/3791096805 learned_addr learned my addr 172.21.15.172:0/3791096805 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb37fff640 1 --2- 172.21.15.172:0/3791096805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329ef0 0x56000d32ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/3791096805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329b10 0x56000d2f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb3ffff640 1 -- 172.21.15.172:0/3791096805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329b10 msgr2=0x56000d2f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/3791096805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329b10 0x56000d2f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb3ffff640 1 -- 172.21.15.172:0/3791096805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329ef0 msgr2=0x56000d32ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/3791096805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329ef0 0x56000d32ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb3ffff640 1 -- 172.21.15.172:0/3791096805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56000cf3a0f0 con 0x56000d32f6e0 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.652+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/3791096805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d330460 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7ffb38015810 tx=0x7ffb38016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9d8ffff23c4f03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb34ff9640 1 -- 172.21.15.172:0/3791096805 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38010b60 con 0x56000d32f6e0 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb34ff9640 1 -- 172.21.15.172:0/3791096805 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb38010d20 con 0x56000d32f6e0 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb34ff9640 1 -- 172.21.15.172:0/3791096805 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38015ad0 con 0x56000d32f6e0 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb48a16740 1 -- 172.21.15.172:0/3791096805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 msgr2=0x56000d330460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3791096805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d330460 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7ffb38015810 tx=0x7ffb38016000 comp rx=0 tx=0).stop 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb48a16740 1 -- 172.21.15.172:0/3791096805 shutdown_connections 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3791096805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329ef0 0x56000d32ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3791096805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d330460 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3791096805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329b10 0x56000d2f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb48a16740 1 -- 172.21.15.172:0/3791096805 >> 172.21.15.172:0/3791096805 conn(0x56000d2fc770 msgr2=0x56000d311890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb48a16740 1 -- 172.21.15.172:0/3791096805 shutdown_connections 2024-04-25T08:49:37.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.653+0000 7ffb48a16740 1 -- 172.21.15.172:0/3791096805 wait complete. 2024-04-25T08:49:37.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.654+0000 7ffb48a16740 1 -- start start 2024-04-25T08:49:37.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.654+0000 7ffb48a16740 1 Processor -- start 2024-04-25T08:49:37.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.654+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 0x56000d33d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.654+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d343fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.654+0000 7ffb48a16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d344520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.654+0000 7ffb48a16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000d34f740 con 0x56000d32f6e0 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.654+0000 7ffb48a16740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb401fefd0 con 0x56000d329b10 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.654+0000 7ffb48a16740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x56000d329780 con 0x56000d329ef0 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb48a16740 10 client.0 _ll_register_callbacks cb 0x7ffb30035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb3ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d344520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb3ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d344520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56378/0 (socket says 172.21.15.172:56378) 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb3ffff640 1 -- 172.21.15.172:0/3752345837 learned_addr learned my addr 172.21.15.172:0/3752345837 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 0x56000d33d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb37fff640 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d343fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb3ffff640 1 -- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 msgr2=0x56000d343fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d343fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb3ffff640 1 -- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 msgr2=0x56000d33d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 0x56000d33d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb3ffff640 1 -- 172.21.15.172:0/3752345837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56000d330660 con 0x56000d32f6e0 2024-04-25T08:49:37.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb3ffff640 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d344520 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7ffb38007d40 tx=0x7ffb38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd141a7a71602ca4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb1e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/3752345837 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38036070 con 0x56000d32f6e0 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/3752345837 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffb3803bc50 con 0x56000d32f6e0 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb48a16740 1 -- 172.21.15.172:0/3752345837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb38010d20 con 0x56000d32f6e0 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/3752345837 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb38010b60 con 0x56000d32f6e0 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb48a16740 10 client.8367 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb48a16740 1 -- 172.21.15.172:0/3752345837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x56000d3b5500 con 0x56000d32f6e0 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.655+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/3752345837 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb38010d20 con 0x56000d32f6e0 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.656+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/3752345837 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ffb38042050 con 0x56000d32f6e0 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.656+0000 7ffb48a16740 10 client.8367 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.656+0000 7ffb48a16740 10 client.8367 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.656+0000 7ffb48a16740 20 client.8367 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:37.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.656+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56000d3a7e10 0x56000d3b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.656+0000 7ffb48a16740 4 client.8367 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.656+0000 7ffb48a16740 1 -- 172.21.15.172:0/3752345837 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56000d26d630 con 0x56000d3a7e10 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.656+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56000d3a7e10 0x56000d3b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb3f7fe640 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56000d3a7e10 0x56000d3b4790 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4a5240e39329e2e server_cookie=4c85ccb81670aa47 in_seq=0 out_seq=0 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb1e7fc640 10 client.8367 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb1e7fc640 1 -- 172.21.15.172:0/3752345837 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+69 (crc 0 0 0) 0x56000d26d630 con 0x56000d3a7e10 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb1e7fc640 10 client.8367 handle_command_reply: tid=0 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 client.8367 shutdown 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 -- 172.21.15.172:0/3752345837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 msgr2=0x56000d344520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d344520 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7ffb38007d40 tx=0x7ffb38004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 -- 172.21.15.172:0/3752345837 shutdown_connections 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x56000d3a7e10 0x56000d3b4790 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56000d32f6e0 0x56000d344520 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb1e7fc640 0 client.8367 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:37.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x56000d329ef0 0x56000d343fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 --2- 172.21.15.172:0/3752345837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56000d329b10 0x56000d33d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 -- 172.21.15.172:0/3752345837 >> 172.21.15.172:0/3752345837 conn(0x56000d2fc770 msgr2=0x56000d32d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 -- 172.21.15.172:0/3752345837 shutdown_connections 2024-04-25T08:49:37.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 1 -- 172.21.15.172:0/3752345837 wait complete. 2024-04-25T08:49:37.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.657+0000 7ffb48a16740 20 client.8367 trim_cache size 0 max 16384 2024-04-25T08:49:37.654 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:49:37.655 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T08:49:37.655 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": {} 2024-04-25T08:49:37.655 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:49:37.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 -- 172.21.15.172:0/746867672 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b500 msgr2=0x7ffb2006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b500 0x7ffb2006d9c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ffb30034000 tx=0x7ffb3002e000 comp rx=0 tx=0).stop 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 -- 172.21.15.172:0/746867672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 msgr2=0x7ffb4015f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 0x7ffb4015f200 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800c460 tx=0x7ffb2800c920 comp rx=0 tx=0).stop 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 -- 172.21.15.172:0/746867672 shutdown_connections 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffb2006b500 0x7ffb2006d9c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb40161710 0x7ffb401f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb4015dc20 0x7ffb4015f200 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 --2- 172.21.15.172:0/746867672 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb400d32f0 0x7ffb4015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 -- 172.21.15.172:0/746867672 >> 172.21.15.172:0/746867672 conn(0x7ffb400d0420 msgr2=0x7ffb400d41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 -- 172.21.15.172:0/746867672 shutdown_connections 2024-04-25T08:49:37.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.658+0000 7ffb45d16640 1 -- 172.21.15.172:0/746867672 wait complete. 2024-04-25T08:49:37.660 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:37.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.776+0000 7fbbf1e1b640 1 Processor -- start 2024-04-25T08:49:37.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.776+0000 7fbbf1e1b640 1 -- start start 2024-04-25T08:49:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbf1e1b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbbec15b320 0x7fbbec164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbf1e1b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec071ed0 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbf1e1b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec15a840 con 0x7fbbec13d190 2024-04-25T08:49:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbf1e1b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec13d570 con 0x7fbbec15b320 2024-04-25T08:49:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbeaffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbbec0cc6c0 0x7fbbec071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51244/0 (socket says 172.21.15.172:51244) 2024-04-25T08:49:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbeaffd640 1 -- 172.21.15.172:0/1547639874 learned_addr learned my addr 172.21.15.172:0/1547639874 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbebfff640 1 --2- 172.21.15.172:0/1547639874 >> v2:172.21.15.186:3300/0 conn(0x7fbbec15b320 0x7fbbec164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbea7fc640 1 -- 172.21.15.172:0/1547639874 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845634416 0 0) 0x7fbbec071ed0 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbea7fc640 1 -- 172.21.15.172:0/1547639874 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd4003520 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbebfff640 1 -- 172.21.15.172:0/1547639874 >> v1:172.21.15.186:6789/0 conn(0x7fbbec13d190 legacy=0x7fbbec0cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbea7fc640 1 -- 172.21.15.172:0/1547639874 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2393949870 0 0) 0x7fbbd4003520 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbebfff640 1 -- 172.21.15.172:0/1547639874 >> v1:172.21.15.172:6789/0 conn(0x7fbbec0cc6c0 legacy=0x7fbbec071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.777+0000 7fbbebfff640 1 -- 172.21.15.172:0/1547639874 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec15ab20 con 0x7fbbec15b320 2024-04-25T08:49:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.778+0000 7fbbebfff640 1 --2- 172.21.15.172:0/1547639874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbec15b320 0x7fbbec164fb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbbec13d6f0 tx=0x7fbbe402b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2c86295b86205f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.778+0000 7fbbea7fc640 1 -- 172.21.15.172:0/1547639874 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0001670 con 0x7fbbec15b320 2024-04-25T08:49:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.778+0000 7fbbea7fc640 1 -- 172.21.15.172:0/1547639874 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4008440 con 0x7fbbec15b320 2024-04-25T08:49:37.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.778+0000 7fbbea7fc640 1 -- 172.21.15.172:0/1547639874 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40087f0 con 0x7fbbec15b320 2024-04-25T08:49:37.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.779+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/1547639874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbec15b320 msgr2=0x7fbbec164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.779+0000 7fbbf1e1b640 1 --2- 172.21.15.172:0/1547639874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbec15b320 0x7fbbec164fb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbbec13d6f0 tx=0x7fbbe402b610 comp rx=0 tx=0).stop 2024-04-25T08:49:37.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.779+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/1547639874 shutdown_connections 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.779+0000 7fbbf1e1b640 1 --2- 172.21.15.172:0/1547639874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbec15b320 0x7fbbec164fb0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.779+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/1547639874 >> 172.21.15.172:0/1547639874 conn(0x7fbbec06abe0 msgr2=0x7fbbec06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.779+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/1547639874 shutdown_connections 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.779+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/1547639874 wait complete. 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.780+0000 7fbbf1e1b640 1 Processor -- start 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.780+0000 7fbbf1e1b640 1 -- start start 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbf1e1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec0cc6c0 0x7fbbec139950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbf1e1b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbec13d190 0x7fbbec0adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbf1e1b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbec15b320 0x7fbbec13b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbf1e1b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec071ac0 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbf1e1b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec071940 con 0x7fbbec15b320 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbf1e1b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec071c40 con 0x7fbbec13d190 2024-04-25T08:49:37.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbeb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec0cc6c0 0x7fbbec139950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbeb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec0cc6c0 0x7fbbec139950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56390/0 (socket says 172.21.15.172:56390) 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbeb7fe640 1 -- 172.21.15.172:0/2270268424 learned_addr learned my addr 172.21.15.172:0/2270268424 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbebfff640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbec15b320 0x7fbbec13b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbeaffd640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbec13d190 0x7fbbec0adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbeb7fe640 1 -- 172.21.15.172:0/2270268424 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbec13d190 msgr2=0x7fbbec0adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbeb7fe640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbec13d190 0x7fbbec0adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbeb7fe640 1 -- 172.21.15.172:0/2270268424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbec15b320 msgr2=0x7fbbec13b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbeb7fe640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbec15b320 0x7fbbec13b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbeb7fe640 1 -- 172.21.15.172:0/2270268424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec0ae600 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbebfff640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbec15b320 0x7fbbec13b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.781+0000 7fbbeb7fe640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec0cc6c0 0x7fbbec139950 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00c570 tx=0x7fbbdc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.782+0000 7fbbd3fff640 1 -- 172.21.15.172:0/2270268424 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc005480 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.782+0000 7fbbd3fff640 1 -- 172.21.15.172:0/2270268424 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc0035f0 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.782+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/2270268424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec0acc30 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.782+0000 7fbbd3fff640 1 -- 172.21.15.172:0/2270268424 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0039c0 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.782+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/2270268424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec0ad1f0 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.783+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/2270268424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec073990 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.783+0000 7fbbd3fff640 1 -- 172.21.15.172:0/2270268424 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbbdc003b60 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.784+0000 7fbbd3fff640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbd806b670 0x7fbbd806db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:37.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.784+0000 7fbbd3fff640 1 -- 172.21.15.172:0/2270268424 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbbdc08a100 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.784+0000 7fbbeaffd640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbd806b670 0x7fbbd806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:37.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.784+0000 7fbbeaffd640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbd806b670 0x7fbbd806db30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbbec151120 tx=0x7fbbe0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:37.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.788+0000 7fbbd3fff640 1 -- 172.21.15.172:0/2270268424 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbbdc00a2e0 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.996+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/2270268424 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbec0cfeb0 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.997+0000 7fbbd3fff640 1 -- 172.21.15.172:0/2270268424 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fbbdc058e80 con 0x7fbbec0cc6c0 2024-04-25T08:49:37.988 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:37.988 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:37.988 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/2270268424 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbd806b670 msgr2=0x7fbbd806db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbd806b670 0x7fbbd806db30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbbec151120 tx=0x7fbbe0009040 comp rx=0 tx=0).stop 2024-04-25T08:49:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/2270268424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec0cc6c0 msgr2=0x7fbbec139950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec0cc6c0 0x7fbbec139950 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00c570 tx=0x7fbbdc00ca30 comp rx=0 tx=0).stop 2024-04-25T08:49:37.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/2270268424 shutdown_connections 2024-04-25T08:49:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbbd806b670 0x7fbbd806db30 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbec15b320 0x7fbbec13b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbec13d190 0x7fbbec0adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 --2- 172.21.15.172:0/2270268424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec0cc6c0 0x7fbbec139950 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/2270268424 >> 172.21.15.172:0/2270268424 conn(0x7fbbec06abe0 msgr2=0x7fbbec0cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/2270268424 shutdown_connections 2024-04-25T08:49:37.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:37.999+0000 7fbbf1e1b640 1 -- 172.21.15.172:0/2270268424 wait complete. 2024-04-25T08:49:38.001 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T08:49:38.001 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:49:38.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.106+0000 7f86089f9640 1 Processor -- start 2024-04-25T08:49:38.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.106+0000 7f86089f9640 1 -- start start 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.107+0000 7f86089f9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040b0b90 0x7f86040cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.107+0000 7f86089f9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86040cc3c0 con 0x7f860415f020 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.107+0000 7f86089f9640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860415f400 con 0x7f8604099a40 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.107+0000 7f86089f9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86040cccb0 con 0x7f86040b0b90 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.107+0000 7f860259c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f860415f020 0x7f86040b10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51246/0 (socket says 172.21.15.172:51246) 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.107+0000 7f860259c640 1 -- 172.21.15.172:0/3631695446 learned_addr learned my addr 172.21.15.172:0/3631695446 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150041184 0 0) 0x7f86040cc3c0 con 0x7f860415f020 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f8601d9b640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040b0b90 0x7f86040cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85ec003520 con 0x7f860415f020 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1745852364 0 0) 0x7f85ec003520 con 0x7f860415f020 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040b0b90 msgr2=0x7f86040cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040b0b90 0x7f86040cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 >> v1:172.21.15.186:6789/0 conn(0x7f8604099a40 legacy=0x7f86040cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:38.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86040d0550 con 0x7f860415f020 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f85f40019f0 con 0x7f860415f020 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 >> v1:172.21.15.172:6789/0 conn(0x7f860415f020 legacy=0x7f86040b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040b0b90 0x7f85ec0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85ec003f60 0x7f85ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85ec004d40 0x7f85ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86040cccb0 con 0x7f85ec004d40 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec00baa0 con 0x7f85ec003f60 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec00bca0 con 0x7f86040b0b90 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860259c640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040b0b90 0x7f85ec0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f8602d9d640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85ec004d40 0x7f85ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f8601d9b640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85ec003f60 0x7f85ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860259c640 1 -- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85ec003f60 msgr2=0x7f85ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860259c640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f85ec003f60 0x7f85ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860259c640 1 -- 172.21.15.172:0/3631695446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85ec004d40 msgr2=0x7f85ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:38.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860259c640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85ec004d40 0x7f85ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f860259c640 1 -- 172.21.15.172:0/3631695446 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec003520 con 0x7f86040b0b90 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.108+0000 7f8602d9d640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85ec004d40 0x7f85ec0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.109+0000 7f860259c640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040b0b90 0x7f85ec0039e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85f400a850 tx=0x7f85ec005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd33b22aa52115b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.109+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400a4a0 con 0x7f86040b0b90 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.109+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f402f070 con 0x7f86040b0b90 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.109+0000 7f860159a640 1 -- 172.21.15.172:0/3631695446 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f402bd20 con 0x7f86040b0b90 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.110+0000 7f86089f9640 1 -- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040b0b90 msgr2=0x7f85ec0039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.110+0000 7f86089f9640 1 --2- 172.21.15.172:0/3631695446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040b0b90 0x7f85ec0039e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85f400a850 tx=0x7f85ec005830 comp rx=0 tx=0).stop 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.110+0000 7f8602d9d640 1 -- 172.21.15.172:0/3631695446 reap_dead start 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.110+0000 7f86089f9640 1 -- 172.21.15.172:0/3631695446 shutdown_connections 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.110+0000 7f86089f9640 1 -- 172.21.15.172:0/3631695446 >> 172.21.15.172:0/3631695446 conn(0x7f86040b3310 msgr2=0x7f86040b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.110+0000 7f86089f9640 1 -- 172.21.15.172:0/3631695446 shutdown_connections 2024-04-25T08:49:38.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.110+0000 7f86089f9640 1 -- 172.21.15.172:0/3631695446 wait complete. 2024-04-25T08:49:38.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.111+0000 7f86089f9640 1 Processor -- start 2024-04-25T08:49:38.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.111+0000 7f86089f9640 1 -- start start 2024-04-25T08:49:38.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f86089f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86040b0b90 0x7f86040cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:38.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f86089f9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040c4550 0x7f860406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:38.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f86089f9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86040c9920 0x7f86040c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:38.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f86089f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86040cc940 con 0x7f86040b0b90 2024-04-25T08:49:38.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f86089f9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86040cc660 con 0x7f86040c9920 2024-04-25T08:49:38.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f86089f9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8604099ed0 con 0x7f86040c4550 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f860259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86040b0b90 0x7f86040cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f860259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86040b0b90 0x7f86040cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56402/0 (socket says 172.21.15.172:56402) 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f860259c640 1 -- 172.21.15.172:0/2695059901 learned_addr learned my addr 172.21.15.172:0/2695059901 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f8602d9d640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86040c9920 0x7f86040c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f8601d9b640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040c4550 0x7f860406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f860259c640 1 -- 172.21.15.172:0/2695059901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040c4550 msgr2=0x7f860406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f860259c640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040c4550 0x7f860406d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f860259c640 1 -- 172.21.15.172:0/2695059901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86040c9920 msgr2=0x7f86040c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f860259c640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86040c9920 0x7f86040c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f860259c640 1 -- 172.21.15.172:0/2695059901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86040ca290 con 0x7f86040b0b90 2024-04-25T08:49:38.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.112+0000 7f860259c640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86040b0b90 0x7f86040cb330 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f85f40012e0 tx=0x7f85f4001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.113+0000 7f85f2ffd640 1 -- 172.21.15.172:0/2695059901 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4044070 con 0x7f86040b0b90 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.113+0000 7f85f2ffd640 1 -- 172.21.15.172:0/2695059901 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f402bc90 con 0x7f86040b0b90 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.113+0000 7f86089f9640 1 -- 172.21.15.172:0/2695059901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86040ca570 con 0x7f86040b0b90 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.113+0000 7f85f2ffd640 1 -- 172.21.15.172:0/2695059901 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4034670 con 0x7f86040b0b90 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.113+0000 7f86089f9640 1 -- 172.21.15.172:0/2695059901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86040cab30 con 0x7f86040b0b90 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.114+0000 7f86089f9640 1 -- 172.21.15.172:0/2695059901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8604073990 con 0x7f86040b0b90 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.114+0000 7f85f2ffd640 1 -- 172.21.15.172:0/2695059901 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f85f4047070 con 0x7f86040b0b90 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.114+0000 7f85f2ffd640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f85e406b4d0 0x7f85e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.115+0000 7f85f2ffd640 1 -- 172.21.15.172:0/2695059901 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f85f40aa5c0 con 0x7f86040b0b90 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.115+0000 7f8601d9b640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f85e406b4d0 0x7f85e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:38.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.115+0000 7f8601d9b640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f85e406b4d0 0x7f85e406d990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f86041f70d0 tx=0x7f85f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:38.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.119+0000 7f85f2ffd640 1 -- 172.21.15.172:0/2695059901 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f85f40792b0 con 0x7f86040b0b90 2024-04-25T08:49:38.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.356+0000 7f86089f9640 1 -- 172.21.15.172:0/2695059901 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f86040b77a0 con 0x7f86040b0b90 2024-04-25T08:49:38.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.357+0000 7f85f2ffd640 1 -- 172.21.15.172:0/2695059901 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1025 (secure 0 0 0) 0x7f85f4078bb0 con 0x7f86040b0b90 2024-04-25T08:49:38.348 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:38.348 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":453,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":911,"data_bytes":931850591,"bytes_used":2139021312,"bytes_avail":770955091968,"bytes_total":773094113280,"write_bytes_sec":77597261,"read_op_per_sec":0,"write_op_per_sec":75},"fsmap":{"epoch":62,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":8124}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-04-25T08:48:28.587854+0000","services":{}},"progress_events":{}} 2024-04-25T08:49:38.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 -- 172.21.15.172:0/2695059901 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f85e406b4d0 msgr2=0x7f85e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:38.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f85e406b4d0 0x7f85e406d990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f86041f70d0 tx=0x7f85f8008040 comp rx=0 tx=0).stop 2024-04-25T08:49:38.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 -- 172.21.15.172:0/2695059901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86040b0b90 msgr2=0x7f86040cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:38.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86040b0b90 0x7f86040cb330 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f85f40012e0 tx=0x7f85f4001dc0 comp rx=0 tx=0).stop 2024-04-25T08:49:38.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 -- 172.21.15.172:0/2695059901 shutdown_connections 2024-04-25T08:49:38.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f85e406b4d0 0x7f85e406d990 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:38.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86040c9920 0x7f86040c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:38.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86040c4550 0x7f860406d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:38.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 --2- 172.21.15.172:0/2695059901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86040b0b90 0x7f86040cb330 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:38.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 -- 172.21.15.172:0/2695059901 >> 172.21.15.172:0/2695059901 conn(0x7f86040b3310 msgr2=0x7f86040ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:38.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 -- 172.21.15.172:0/2695059901 shutdown_connections 2024-04-25T08:49:38.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:38.359+0000 7f86089f9640 1 -- 172.21.15.172:0/2695059901 wait complete. 2024-04-25T08:49:39.361 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:39.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.479+0000 7f6ad4c5a640 1 Processor -- start 2024-04-25T08:49:39.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.479+0000 7f6ad4c5a640 1 -- start start 2024-04-25T08:49:39.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.480+0000 7f6ad4c5a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6ad00b3f00 0x7f6ad006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.480+0000 7f6ad4c5a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad00ace70 con 0x7f6ad00720f0 2024-04-25T08:49:39.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6ad4c5a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad00b4390 con 0x7f6ad00b3410 2024-04-25T08:49:39.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6ad4c5a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad006df30 con 0x7f6ad00b3f00 2024-04-25T08:49:39.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acdd9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6ad00720f0 0x7f6ad006e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51248/0 (socket says 172.21.15.172:51248) 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acdd9b640 1 -- 172.21.15.172:0/3215542946 learned_addr learned my addr 172.21.15.172:0/3215542946 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6aced9d640 1 --2- 172.21.15.172:0/3215542946 >> v2:172.21.15.186:3300/0 conn(0x7f6ad00b3f00 0x7f6ad006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207397265 0 0) 0x7f6ac0001110 con 0x7f6ad00720f0 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab8003520 con 0x7f6ad00720f0 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3161799295 0 0) 0x7f6ab8003520 con 0x7f6ad00720f0 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 >> v2:172.21.15.186:3300/0 conn(0x7f6ad00b3f00 msgr2=0x7f6ad006ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 --2- 172.21.15.172:0/3215542946 >> v2:172.21.15.186:3300/0 conn(0x7f6ad00b3f00 0x7f6ad006ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 >> v1:172.21.15.186:6789/0 conn(0x7f6ad00b3410 legacy=0x7f6ad00b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad00726d0 con 0x7f6ad00720f0 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f6ac0001840 con 0x7f6ad00720f0 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 >> v1:172.21.15.172:6789/0 conn(0x7f6ad00720f0 legacy=0x7f6ad006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ab80039b0 0x7f6ab8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ab8004800 0x7f6ab8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ab80051c0 0x7f6ab800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad006df30 con 0x7f6ab8004800 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab800c160 con 0x7f6ab80039b0 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab800c360 con 0x7f6ab80051c0 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.481+0000 7f6acdd9b640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ab8004800 0x7f6ab8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.482+0000 7f6ace59c640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ab80039b0 0x7f6ab8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.482+0000 7f6aced9d640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ab80051c0 0x7f6ab800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.482+0000 7f6acdd9b640 1 -- 172.21.15.172:0/3215542946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ab80051c0 msgr2=0x7f6ab800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.482+0000 7f6acdd9b640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ab80051c0 0x7f6ab800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.482+0000 7f6acdd9b640 1 -- 172.21.15.172:0/3215542946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ab80039b0 msgr2=0x7f6ab8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.482+0000 7f6acdd9b640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ab80039b0 0x7f6ab8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.482+0000 7f6aced9d640 1 -- 172.21.15.172:0/3215542946 reap_dead start 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.482+0000 7f6acdd9b640 1 -- 172.21.15.172:0/3215542946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8003520 con 0x7f6ab8004800 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.482+0000 7f6acdd9b640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ab8004800 0x7f6ab8004c80 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000c4c0 tx=0x7f6ab8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4008d3d006f1f268 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.483+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac000c0e0 con 0x7f6ab8004800 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.483+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac0034070 con 0x7f6ab8004800 2024-04-25T08:49:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.483+0000 7f6acd59a640 1 -- 172.21.15.172:0/3215542946 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0005d70 con 0x7f6ab8004800 2024-04-25T08:49:39.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.483+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/3215542946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ab8004800 msgr2=0x7f6ab8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.483+0000 7f6ad4c5a640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ab8004800 0x7f6ab8004c80 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000c4c0 tx=0x7f6ab8005830 comp rx=0 tx=0).stop 2024-04-25T08:49:39.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.483+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/3215542946 shutdown_connections 2024-04-25T08:49:39.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.483+0000 7f6ad4c5a640 1 --2- 172.21.15.172:0/3215542946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ab8004800 0x7f6ab8004c80 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.483+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/3215542946 >> 172.21.15.172:0/3215542946 conn(0x7f6ad00cfae0 msgr2=0x7f6ad00cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:39.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.483+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/3215542946 shutdown_connections 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.483+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/3215542946 wait complete. 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.485+0000 7f6ad4c5a640 1 Processor -- start 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.485+0000 7f6ad4c5a640 1 -- start start 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.485+0000 7f6ad4c5a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ab8004800 0x7f6ad01f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.485+0000 7f6ad4c5a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad00c4b00 0x7f6ad01f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.485+0000 7f6ad4c5a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad00c6e10 0x7f6ad00c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.485+0000 7f6ad4c5a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad0147890 con 0x7f6ad00c4b00 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.485+0000 7f6ad4c5a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad006dbc0 con 0x7f6ab8004800 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.485+0000 7f6ad4c5a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad0147230 con 0x7f6ad00c6e10 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6acdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad00c4b00 0x7f6ad01f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6acdd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad00c4b00 0x7f6ad01f0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56416/0 (socket says 172.21.15.172:56416) 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6acdd9b640 1 -- 172.21.15.172:0/1502065505 learned_addr learned my addr 172.21.15.172:0/1502065505 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6ace59c640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ab8004800 0x7f6ad01f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6aced9d640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad00c6e10 0x7f6ad00c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6acdd9b640 1 -- 172.21.15.172:0/1502065505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad00c6e10 msgr2=0x7f6ad00c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6acdd9b640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad00c6e10 0x7f6ad00c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6acdd9b640 1 -- 172.21.15.172:0/1502065505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ab8004800 msgr2=0x7f6ad01f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6acdd9b640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ab8004800 0x7f6ad01f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6acdd9b640 1 -- 172.21.15.172:0/1502065505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad006f010 con 0x7f6ad00c4b00 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6acdd9b640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad00c4b00 0x7f6ad01f0dc0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000c4c0 tx=0x7f6ac0001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6abeffd640 1 -- 172.21.15.172:0/1502065505 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0004c70 con 0x7f6ad00c4b00 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6abeffd640 1 -- 172.21.15.172:0/1502065505 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac003f030 con 0x7f6ad00c4b00 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/1502065505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad00c5190 con 0x7f6ad00c4b00 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6abeffd640 1 -- 172.21.15.172:0/1502065505 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0007270 con 0x7f6ad00c4b00 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.486+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/1502065505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad00c5750 con 0x7f6ad00c4b00 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.487+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/1502065505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad0073990 con 0x7f6ad00c4b00 2024-04-25T08:49:39.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.488+0000 7f6abeffd640 1 -- 172.21.15.172:0/1502065505 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6ac0007410 con 0x7f6ad00c4b00 2024-04-25T08:49:39.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.488+0000 7f6abeffd640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ab006b500 0x7f6ab006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.488+0000 7f6abeffd640 1 -- 172.21.15.172:0/1502065505 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6ac00aa8c0 con 0x7f6ad00c4b00 2024-04-25T08:49:39.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.488+0000 7f6ace59c640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ab006b500 0x7f6ab006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.488+0000 7f6ace59c640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ab006b500 0x7f6ab006d9c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4000c00 tx=0x7f6ac4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:39.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.492+0000 7f6abeffd640 1 -- 172.21.15.172:0/1502065505 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6ac0049030 con 0x7f6ad00c4b00 2024-04-25T08:49:39.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.698+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/1502065505 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ad00d0800 con 0x7f6ad00c4b00 2024-04-25T08:49:39.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.699+0000 7f6abeffd640 1 -- 172.21.15.172:0/1502065505 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f6ad00ace70 con 0x7f6ad00c4b00 2024-04-25T08:49:39.690 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:39.690 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:39.690 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:39.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/1502065505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ab006b500 msgr2=0x7f6ab006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ab006b500 0x7f6ab006d9c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4000c00 tx=0x7f6ac4009040 comp rx=0 tx=0).stop 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/1502065505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad00c4b00 msgr2=0x7f6ad01f0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad00c4b00 0x7f6ad01f0dc0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000c4c0 tx=0x7f6ac0001c10 comp rx=0 tx=0).stop 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/1502065505 shutdown_connections 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6ab006b500 0x7f6ab006d9c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad00c6e10 0x7f6ad00c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad00c4b00 0x7f6ad01f0dc0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 --2- 172.21.15.172:0/1502065505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ab8004800 0x7f6ad01f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/1502065505 >> 172.21.15.172:0/1502065505 conn(0x7f6ad00cfae0 msgr2=0x7f6ad00ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/1502065505 shutdown_connections 2024-04-25T08:49:39.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.701+0000 7f6ad4c5a640 1 -- 172.21.15.172:0/1502065505 wait complete. 2024-04-25T08:49:39.702 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T08:49:39.703 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:49:39.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.810+0000 7fe886fc8640 1 Processor -- start 2024-04-25T08:49:39.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.810+0000 7fe886fc8640 1 -- start start 2024-04-25T08:49:39.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.810+0000 7fe886fc8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 0x7fe88013d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.810+0000 7fe886fc8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe8800cfaa0 0x7fe880071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.810+0000 7fe886fc8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe880071ed0 con 0x7fe8800cf620 2024-04-25T08:49:39.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.810+0000 7fe886fc8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88015a840 con 0x7fe8800cfaa0 2024-04-25T08:49:39.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.810+0000 7fe886fc8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88015ab20 con 0x7fe88015b320 2024-04-25T08:49:39.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe885565640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe8800cfaa0 0x7fe880071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe884d64640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 0x7fe88013d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe87ffff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fe8800cf620 0x7fe8800cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:58030/0 (socket says 172.21.15.172:58030) 2024-04-25T08:49:39.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe87ffff640 1 -- 172.21.15.172:0/3864156466 learned_addr learned my addr 172.21.15.172:0/3864156466 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:39.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe87f7fe640 1 -- 172.21.15.172:0/3864156466 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808433772 0 0) 0x7fe880071ed0 con 0x7fe8800cf620 2024-04-25T08:49:39.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe87f7fe640 1 -- 172.21.15.172:0/3864156466 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe86c003520 con 0x7fe8800cf620 2024-04-25T08:49:39.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe885565640 1 -- 172.21.15.172:0/3864156466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 msgr2=0x7fe88013d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:39.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe885565640 1 --2- 172.21.15.172:0/3864156466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 0x7fe88013d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe885565640 1 -- 172.21.15.172:0/3864156466 >> v1:172.21.15.186:6789/0 conn(0x7fe8800cf620 legacy=0x7fe8800cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe885565640 1 -- 172.21.15.172:0/3864156466 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88015ae00 con 0x7fe8800cfaa0 2024-04-25T08:49:39.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.811+0000 7fe884d64640 1 --2- 172.21.15.172:0/3864156466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 0x7fe88013d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:39.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.812+0000 7fe885565640 1 --2- 172.21.15.172:0/3864156466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8800cfaa0 0x7fe880071230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe8700097a0 tx=0x7fe87002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0fa515a80003a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:39.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.812+0000 7fe87f7fe640 1 -- 172.21.15.172:0/3864156466 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870037070 con 0x7fe8800cfaa0 2024-04-25T08:49:39.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.812+0000 7fe87f7fe640 1 -- 172.21.15.172:0/3864156466 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87002ae50 con 0x7fe8800cfaa0 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.812+0000 7fe87f7fe640 1 -- 172.21.15.172:0/3864156466 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870032660 con 0x7fe8800cfaa0 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.812+0000 7fe886fc8640 1 -- 172.21.15.172:0/3864156466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8800cfaa0 msgr2=0x7fe880071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.812+0000 7fe886fc8640 1 --2- 172.21.15.172:0/3864156466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8800cfaa0 0x7fe880071230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe8700097a0 tx=0x7fe87002a100 comp rx=0 tx=0).stop 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.813+0000 7fe886fc8640 1 -- 172.21.15.172:0/3864156466 shutdown_connections 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.813+0000 7fe886fc8640 1 --2- 172.21.15.172:0/3864156466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8800cfaa0 0x7fe880071230 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.813+0000 7fe886fc8640 1 --2- 172.21.15.172:0/3864156466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 0x7fe88013d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.813+0000 7fe886fc8640 1 -- 172.21.15.172:0/3864156466 >> 172.21.15.172:0/3864156466 conn(0x7fe88006abe0 msgr2=0x7fe88006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.813+0000 7fe886fc8640 1 -- 172.21.15.172:0/3864156466 shutdown_connections 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.813+0000 7fe886fc8640 1 -- 172.21.15.172:0/3864156466 wait complete. 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.814+0000 7fe886fc8640 1 Processor -- start 2024-04-25T08:49:39.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.814+0000 7fe886fc8640 1 -- start start 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe886fc8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8800cf620 0x7fe880156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe886fc8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8800cfaa0 0x7fe8800af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe886fc8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 0x7fe8800ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe886fc8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe880071770 con 0x7fe8800cf620 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe886fc8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800cc910 con 0x7fe8800cfaa0 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe886fc8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800718f0 con 0x7fe88015b320 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe884d64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8800cf620 0x7fe880156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe884d64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8800cf620 0x7fe880156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56432/0 (socket says 172.21.15.172:56432) 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe884d64640 1 -- 172.21.15.172:0/3181560752 learned_addr learned my addr 172.21.15.172:0/3181560752 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe87ffff640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8800cfaa0 0x7fe8800af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe885565640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 0x7fe8800ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe884d64640 1 -- 172.21.15.172:0/3181560752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 msgr2=0x7fe8800ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe884d64640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 0x7fe8800ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe884d64640 1 -- 172.21.15.172:0/3181560752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8800cfaa0 msgr2=0x7fe8800af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe884d64640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8800cfaa0 0x7fe8800af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe884d64640 1 -- 172.21.15.172:0/3181560752 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800ac8b0 con 0x7fe8800cf620 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe884d64640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8800cf620 0x7fe880156070 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fe87800efc0 tx=0x7fe87800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe87d7fa640 1 -- 172.21.15.172:0/3181560752 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878018020 con 0x7fe8800cf620 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe87d7fa640 1 -- 172.21.15.172:0/3181560752 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe878014680 con 0x7fe8800cf620 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe87d7fa640 1 -- 172.21.15.172:0/3181560752 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878014a50 con 0x7fe8800cf620 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe886fc8640 1 -- 172.21.15.172:0/3181560752 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8800acb90 con 0x7fe8800cf620 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.815+0000 7fe886fc8640 1 -- 172.21.15.172:0/3181560752 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8800ad430 con 0x7fe8800cf620 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.816+0000 7fe886fc8640 1 -- 172.21.15.172:0/3181560752 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe880073990 con 0x7fe8800cf620 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.817+0000 7fe87d7fa640 1 -- 172.21.15.172:0/3181560752 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe878005d10 con 0x7fe8800cf620 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.817+0000 7fe87d7fa640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe86006b4d0 0x7fe86006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.817+0000 7fe87d7fa640 1 -- 172.21.15.172:0/3181560752 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe87808b1a0 con 0x7fe8800cf620 2024-04-25T08:49:39.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.817+0000 7fe87ffff640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe86006b4d0 0x7fe86006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:39.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.818+0000 7fe87ffff640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe86006b4d0 0x7fe86006d990 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe880159590 tx=0x7fe868009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:39.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:39.821+0000 7fe87d7fa640 1 -- 172.21.15.172:0/3181560752 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe878022030 con 0x7fe8800cf620 2024-04-25T08:49:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.060+0000 7fe886fc8640 1 -- 172.21.15.172:0/3181560752 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe8800cfeb0 con 0x7fe8800cf620 2024-04-25T08:49:40.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.061+0000 7fe87d7fa640 1 -- 172.21.15.172:0/3181560752 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1596 (secure 0 0 0) 0x7fe878010040 con 0x7fe8800cf620 2024-04-25T08:49:40.052 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:40.052 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":455,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":911,"data_bytes":931850591,"bytes_used":2139021312,"bytes_avail":770955091968,"bytes_total":773094113280,"write_bytes_sec":77596322,"read_op_per_sec":0,"write_op_per_sec":75},"fsmap":{"epoch":62,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":8124}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-04-25T08:49:38.601434+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T08:49:40.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 -- 172.21.15.172:0/3181560752 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe86006b4d0 msgr2=0x7fe86006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe86006b4d0 0x7fe86006d990 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe880159590 tx=0x7fe868009040 comp rx=0 tx=0).stop 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 -- 172.21.15.172:0/3181560752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8800cf620 msgr2=0x7fe880156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8800cf620 0x7fe880156070 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fe87800efc0 tx=0x7fe87800c490 comp rx=0 tx=0).stop 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 -- 172.21.15.172:0/3181560752 shutdown_connections 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe86006b4d0 0x7fe86006d990 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8800cfaa0 0x7fe8800af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88015b320 0x7fe8800ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 --2- 172.21.15.172:0/3181560752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8800cf620 0x7fe880156070 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 -- 172.21.15.172:0/3181560752 >> 172.21.15.172:0/3181560752 conn(0x7fe88006abe0 msgr2=0x7fe88013b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 -- 172.21.15.172:0/3181560752 shutdown_connections 2024-04-25T08:49:40.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.063+0000 7fe886fc8640 1 -- 172.21.15.172:0/3181560752 wait complete. 2024-04-25T08:49:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T08:49:40.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:40.065 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub resume 2024-04-25T08:49:40.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.173+0000 7efd73a2a640 1 Processor -- start 2024-04-25T08:49:40.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.173+0000 7efd73a2a640 1 -- start start 2024-04-25T08:49:40.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd73a2a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd6c144d20 0x7efd6c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd73a2a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efd6c1454b0 0x7efd6c070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd73a2a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c0ceba0 con 0x7efd6c071300 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd73a2a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c071750 con 0x7efd6c1454b0 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd73a2a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0b4830 con 0x7efd6c144d20 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd70fc5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efd6c1454b0 0x7efd6c070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd70fc5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efd6c1454b0 0x7efd6c070dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56446/0 (socket says 172.21.15.172:56446) 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd70fc5640 1 -- 172.21.15.172:0/3942941730 learned_addr learned my addr 172.21.15.172:0/3942941730 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd717c6640 1 --2- 172.21.15.172:0/3942941730 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd6c144d20 0x7efd6c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd70fc5640 1 -- 172.21.15.172:0/3942941730 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd6c144d20 msgr2=0x7efd6c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd70fc5640 1 --2- 172.21.15.172:0/3942941730 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd6c144d20 0x7efd6c0ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd70fc5640 1 -- 172.21.15.172:0/3942941730 >> v1:172.21.15.186:6789/0 conn(0x7efd6c071300 legacy=0x7efd6c15f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.174+0000 7efd70fc5640 1 -- 172.21.15.172:0/3942941730 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0cee80 con 0x7efd6c1454b0 2024-04-25T08:49:40.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.175+0000 7efd70fc5640 1 --2- 172.21.15.172:0/3942941730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 0x7efd6c070dc0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009870 tx=0x7efd5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea5a73c2077b4ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.175+0000 7efd63fff640 1 -- 172.21.15.172:0/3942941730 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c037070 con 0x7efd6c1454b0 2024-04-25T08:49:40.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.175+0000 7efd63fff640 1 -- 172.21.15.172:0/3942941730 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c032440 con 0x7efd6c1454b0 2024-04-25T08:49:40.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.175+0000 7efd63fff640 1 -- 172.21.15.172:0/3942941730 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c032810 con 0x7efd6c1454b0 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.175+0000 7efd73a2a640 1 -- 172.21.15.172:0/3942941730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 msgr2=0x7efd6c070dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.175+0000 7efd73a2a640 1 --2- 172.21.15.172:0/3942941730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 0x7efd6c070dc0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009870 tx=0x7efd5c02a270 comp rx=0 tx=0).stop 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.175+0000 7efd73a2a640 1 -- 172.21.15.172:0/3942941730 shutdown_connections 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.175+0000 7efd73a2a640 1 --2- 172.21.15.172:0/3942941730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 0x7efd6c070dc0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.175+0000 7efd73a2a640 1 --2- 172.21.15.172:0/3942941730 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd6c144d20 0x7efd6c0ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.175+0000 7efd73a2a640 1 -- 172.21.15.172:0/3942941730 >> 172.21.15.172:0/3942941730 conn(0x7efd6c0b3530 msgr2=0x7efd6c0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.176+0000 7efd73a2a640 1 -- 172.21.15.172:0/3942941730 shutdown_connections 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.176+0000 7efd73a2a640 1 -- 172.21.15.172:0/3942941730 wait complete. 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.177+0000 7efd73a2a640 1 Processor -- start 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.177+0000 7efd73a2a640 1 -- start start 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.177+0000 7efd73a2a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c071300 0x7efd6c15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.177+0000 7efd73a2a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd6c144d20 0x7efd6c0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.177+0000 7efd73a2a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 0x7efd6c0c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.177+0000 7efd73a2a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0ce890 con 0x7efd6c1454b0 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.177+0000 7efd73a2a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0cf440 con 0x7efd6c071300 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.177+0000 7efd73a2a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c145100 con 0x7efd6c144d20 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.177+0000 7efd71fc7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 0x7efd6c0c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd71fc7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 0x7efd6c0c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56456/0 (socket says 172.21.15.172:56456) 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd71fc7640 1 -- 172.21.15.172:0/2059032841 learned_addr learned my addr 172.21.15.172:0/2059032841 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd717c6640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c071300 0x7efd6c15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd70fc5640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd6c144d20 0x7efd6c0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd71fc7640 1 -- 172.21.15.172:0/2059032841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd6c144d20 msgr2=0x7efd6c0cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd71fc7640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd6c144d20 0x7efd6c0cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd71fc7640 1 -- 172.21.15.172:0/2059032841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c071300 msgr2=0x7efd6c15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd71fc7640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c071300 0x7efd6c15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd71fc7640 1 -- 172.21.15.172:0/2059032841 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0cca80 con 0x7efd6c1454b0 2024-04-25T08:49:40.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd71fc7640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 0x7efd6c0c9f40 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7efd6400c7d0 tx=0x7efd6400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd61ffb640 1 -- 172.21.15.172:0/2059032841 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64003b70 con 0x7efd6c1454b0 2024-04-25T08:49:40.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd61ffb640 1 -- 172.21.15.172:0/2059032841 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64003d30 con 0x7efd6c1454b0 2024-04-25T08:49:40.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd73a2a640 1 -- 172.21.15.172:0/2059032841 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c0ccd60 con 0x7efd6c1454b0 2024-04-25T08:49:40.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd61ffb640 1 -- 172.21.15.172:0/2059032841 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6400aa90 con 0x7efd6c1454b0 2024-04-25T08:49:40.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.178+0000 7efd73a2a640 1 -- 172.21.15.172:0/2059032841 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c0cd320 con 0x7efd6c1454b0 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.180+0000 7efd61ffb640 1 -- 172.21.15.172:0/2059032841 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efd6400ac30 con 0x7efd6c1454b0 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.180+0000 7efd61ffb640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd5006b4d0 0x7efd5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.180+0000 7efd61ffb640 1 -- 172.21.15.172:0/2059032841 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efd6408a2c0 con 0x7efd6c1454b0 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.180+0000 7efd717c6640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd5006b4d0 0x7efd5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.180+0000 7efd717c6640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd5006b4d0 0x7efd5006d990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efd68006fd0 tx=0x7efd68008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.181+0000 7efd76807740 1 Processor -- start 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.181+0000 7efd76807740 1 -- start start 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd76807740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a71e510 0x555c4a71e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd76807740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a6ee770 0x555c4a6f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd76807740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a73a470 0x555c4a73a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd76807740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c4a657da0 con 0x555c4a73a470 2024-04-25T08:49:40.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd76807740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c4a600b80 con 0x555c4a6ee770 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd76807740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c4a653e40 con 0x555c4a71e510 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd71fc7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a73a470 0x555c4a73a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd71fc7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a73a470 0x555c4a73a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56458/0 (socket says 172.21.15.172:56458) 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd71fc7640 1 -- 172.21.15.172:0/3877885273 learned_addr learned my addr 172.21.15.172:0/3877885273 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd71fc7640 1 -- 172.21.15.172:0/3877885273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a71e510 msgr2=0x555c4a71e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd71fc7640 1 --2- 172.21.15.172:0/3877885273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a71e510 0x555c4a71e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd70fc5640 1 --2- 172.21.15.172:0/3877885273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a6ee770 0x555c4a6f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd71fc7640 1 -- 172.21.15.172:0/3877885273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a6ee770 msgr2=0x555c4a6f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd71fc7640 1 --2- 172.21.15.172:0/3877885273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a6ee770 0x555c4a6f47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd71fc7640 1 -- 172.21.15.172:0/3877885273 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c4a60af10 con 0x555c4a73a470 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.182+0000 7efd71fc7640 1 --2- 172.21.15.172:0/3877885273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a73a470 0x555c4a73a8f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7efd64088600 tx=0x7efd64011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92852f3a81ea83e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd56ffd640 1 -- 172.21.15.172:0/3877885273 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6405ca00 con 0x555c4a73a470 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd56ffd640 1 -- 172.21.15.172:0/3877885273 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64060fc0 con 0x555c4a73a470 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd56ffd640 1 -- 172.21.15.172:0/3877885273 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6408a0d0 con 0x555c4a73a470 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd76807740 1 -- 172.21.15.172:0/3877885273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a73a470 msgr2=0x555c4a73a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd76807740 1 --2- 172.21.15.172:0/3877885273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a73a470 0x555c4a73a8f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7efd64088600 tx=0x7efd64011000 comp rx=0 tx=0).stop 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd76807740 1 -- 172.21.15.172:0/3877885273 shutdown_connections 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd76807740 1 --2- 172.21.15.172:0/3877885273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a6ee770 0x555c4a6f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd76807740 1 --2- 172.21.15.172:0/3877885273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a73a470 0x555c4a73a8f0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd76807740 1 --2- 172.21.15.172:0/3877885273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a71e510 0x555c4a71e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd76807740 1 -- 172.21.15.172:0/3877885273 >> 172.21.15.172:0/3877885273 conn(0x555c4a6f09e0 msgr2=0x555c4a739320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd76807740 1 -- 172.21.15.172:0/3877885273 shutdown_connections 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.183+0000 7efd76807740 1 -- 172.21.15.172:0/3877885273 wait complete. 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.184+0000 7efd76807740 1 -- start start 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.184+0000 7efd76807740 1 Processor -- start 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd76807740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a71e510 0x555c4a73cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd76807740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a73a470 0x555c4a73d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd76807740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a7076c0 0x555c4a707b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd76807740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c4a6f4ce0 con 0x555c4a71e510 2024-04-25T08:49:40.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd76807740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c4a5f64b0 con 0x555c4a7076c0 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd76807740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c4a6f4310 con 0x555c4a73a470 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd76807740 10 client.0 _ll_register_callbacks cb 0x555c4a636180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd717c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a71e510 0x555c4a73cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd717c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a71e510 0x555c4a73cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56468/0 (socket says 172.21.15.172:56468) 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd717c6640 1 -- 172.21.15.172:0/157357980 learned_addr learned my addr 172.21.15.172:0/157357980 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd71fc7640 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a7076c0 0x555c4a707b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd70fc5640 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a73a470 0x555c4a73d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd717c6640 1 -- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a73a470 msgr2=0x555c4a73d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd717c6640 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a73a470 0x555c4a73d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd717c6640 1 -- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a7076c0 msgr2=0x555c4a707b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd717c6640 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a7076c0 0x555c4a707b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd717c6640 1 -- 172.21.15.172:0/157357980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c4a4367d0 con 0x555c4a71e510 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd71fc7640 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a7076c0 0x555c4a707b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:40.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd717c6640 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a71e510 0x555c4a73cc30 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7efd68010000 tx=0x7efd68014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c0737d4ebe6a05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd4bfff640 1 -- 172.21.15.172:0/157357980 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68025060 con 0x555c4a71e510 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd4bfff640 1 -- 172.21.15.172:0/157357980 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efd68015820 con 0x555c4a71e510 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.185+0000 7efd76807740 1 -- 172.21.15.172:0/157357980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd64060fc0 con 0x555c4a71e510 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd4bfff640 1 -- 172.21.15.172:0/157357980 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd6802b050 con 0x555c4a71e510 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd76807740 10 client.8400 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd76807740 1 -- 172.21.15.172:0/157357980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x555c4a36c3f0 con 0x555c4a71e510 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd4bfff640 1 -- 172.21.15.172:0/157357980 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64060fc0 con 0x555c4a71e510 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd4bfff640 1 -- 172.21.15.172:0/157357980 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efd6802e020 con 0x555c4a71e510 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd76807740 10 client.8400 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd76807740 10 client.8400 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd76807740 20 client.8400 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd76807740 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x555c4a721440 0x555c4a721850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd76807740 4 client.8400 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd76807740 1 -- 172.21.15.172:0/157357980 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c4a6652e0 con 0x555c4a721440 2024-04-25T08:49:40.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.186+0000 7efd70fc5640 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x555c4a721440 0x555c4a721850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd4bfff640 10 client.8400 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd70fc5640 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x555c4a721440 0x555c4a721850 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bfa50098d525a5f server_cookie=d5bfa9cf5d4fb039 in_seq=0 out_seq=0 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd4bfff640 1 -- 172.21.15.172:0/157357980 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555c4a6652e0 con 0x555c4a721440 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd4bfff640 10 client.8400 handle_command_reply: tid=0 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 client.8400 shutdown 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 -- 172.21.15.172:0/157357980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a71e510 msgr2=0x555c4a73cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a71e510 0x555c4a73cc30 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7efd68010000 tx=0x7efd68014830 comp rx=0 tx=0).stop 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 -- 172.21.15.172:0/157357980 shutdown_connections 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x555c4a721440 0x555c4a721850 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a7076c0 0x555c4a707b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a73a470 0x555c4a73d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd4bfff640 0 client.8400 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 --2- 172.21.15.172:0/157357980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a71e510 0x555c4a73cc30 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 -- 172.21.15.172:0/157357980 >> 172.21.15.172:0/157357980 conn(0x555c4a6ee770 msgr2=0x555c4a6f2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 -- 172.21.15.172:0/157357980 shutdown_connections 2024-04-25T08:49:40.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.187+0000 7efd76807740 1 -- 172.21.15.172:0/157357980 wait complete. 2024-04-25T08:49:40.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.188+0000 7efd76807740 20 client.8400 trim_cache size 0 max 16384 2024-04-25T08:49:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.202+0000 7efd76807740 1 Processor -- start 2024-04-25T08:49:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.202+0000 7efd76807740 1 -- start start 2024-04-25T08:49:40.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd76807740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a7076c0 0x555c4a7224c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd76807740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 0x555c4a73d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd76807740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a739290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd76807740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c06dd00 con 0x555c4a721440 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd76807740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c06cf00 con 0x555c4a71e510 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd76807740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0c83e0 con 0x555c4a7076c0 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd71fc7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a739290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd71fc7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a739290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56470/0 (socket says 172.21.15.172:56470) 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd71fc7640 1 -- 172.21.15.172:0/3054267798 learned_addr learned my addr 172.21.15.172:0/3054267798 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd70fc5640 1 --2- 172.21.15.172:0/3054267798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 0x555c4a73d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd717c6640 1 --2- 172.21.15.172:0/3054267798 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a7076c0 0x555c4a7224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd71fc7640 1 -- 172.21.15.172:0/3054267798 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a7076c0 msgr2=0x555c4a7224c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd71fc7640 1 --2- 172.21.15.172:0/3054267798 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a7076c0 0x555c4a7224c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd71fc7640 1 -- 172.21.15.172:0/3054267798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 msgr2=0x555c4a73d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd71fc7640 1 --2- 172.21.15.172:0/3054267798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 0x555c4a73d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd71fc7640 1 -- 172.21.15.172:0/3054267798 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c4a707eb0 con 0x555c4a721440 2024-04-25T08:49:40.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd70fc5640 1 --2- 172.21.15.172:0/3054267798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 0x555c4a73d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.203+0000 7efd71fc7640 1 --2- 172.21.15.172:0/3054267798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a739290 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7efd640886b0 tx=0x7efd64005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309073d375076ac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd567fc640 1 -- 172.21.15.172:0/3054267798 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6405ca00 con 0x555c4a721440 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd567fc640 1 -- 172.21.15.172:0/3054267798 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64056bb0 con 0x555c4a721440 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd567fc640 1 -- 172.21.15.172:0/3054267798 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64054f20 con 0x555c4a721440 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd76807740 1 -- 172.21.15.172:0/3054267798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 msgr2=0x555c4a739290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd76807740 1 --2- 172.21.15.172:0/3054267798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a739290 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7efd640886b0 tx=0x7efd64005050 comp rx=0 tx=0).stop 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd76807740 1 -- 172.21.15.172:0/3054267798 shutdown_connections 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd76807740 1 --2- 172.21.15.172:0/3054267798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 0x555c4a73d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd76807740 1 --2- 172.21.15.172:0/3054267798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a739290 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd76807740 1 --2- 172.21.15.172:0/3054267798 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a7076c0 0x555c4a7224c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd76807740 1 -- 172.21.15.172:0/3054267798 >> 172.21.15.172:0/3054267798 conn(0x555c4a6ee770 msgr2=0x555c4a721820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd76807740 1 -- 172.21.15.172:0/3054267798 shutdown_connections 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.204+0000 7efd76807740 1 -- 172.21.15.172:0/3054267798 wait complete. 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.205+0000 7efd76807740 1 -- start start 2024-04-25T08:49:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.205+0000 7efd76807740 1 Processor -- start 2024-04-25T08:49:40.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd76807740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a7076c0 0x555c4a6f2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd76807740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 0x555c4a6f2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd76807740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a7a7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd76807740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c4a73ea90 con 0x555c4a721440 2024-04-25T08:49:40.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd76807740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c13e830 con 0x555c4a71e510 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd76807740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c4a757940 con 0x555c4a7076c0 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd76807740 10 client.0 _ll_register_callbacks cb 0x7efd64001830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd71fc7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a7a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd71fc7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a7a7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56482/0 (socket says 172.21.15.172:56482) 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd71fc7640 1 -- 172.21.15.172:0/2342702678 learned_addr learned my addr 172.21.15.172:0/2342702678 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd70fc5640 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 0x555c4a6f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd717c6640 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a7076c0 0x555c4a6f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd71fc7640 1 -- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a7076c0 msgr2=0x555c4a6f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd71fc7640 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a7076c0 0x555c4a6f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd71fc7640 1 -- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 msgr2=0x555c4a6f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd71fc7640 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 0x555c4a6f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd71fc7640 1 -- 172.21.15.172:0/2342702678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c4a32c0f0 con 0x555c4a721440 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd70fc5640 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 0x555c4a6f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:40.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd71fc7640 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a7a7770 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7efd6400a430 tx=0x7efd64001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31aa61c68b75ea5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd4bfff640 1 -- 172.21.15.172:0/2342702678 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6405ca00 con 0x555c4a721440 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd4bfff640 1 -- 172.21.15.172:0/2342702678 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efd64088320 con 0x555c4a721440 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd76807740 1 -- 172.21.15.172:0/2342702678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd64056bb0 con 0x555c4a721440 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd4bfff640 1 -- 172.21.15.172:0/2342702678 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd64054f20 con 0x555c4a721440 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd76807740 10 client.8406 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.206+0000 7efd76807740 1 -- 172.21.15.172:0/2342702678 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x555c4a73b510 con 0x555c4a721440 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd4bfff640 1 -- 172.21.15.172:0/2342702678 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64056bb0 con 0x555c4a721440 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd4bfff640 1 -- 172.21.15.172:0/2342702678 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efd64077250 con 0x555c4a721440 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd76807740 10 client.8406 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd76807740 10 client.8406 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd76807740 20 client.8406 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd76807740 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x555c4a73a470 0x555c4a7a7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd76807740 4 client.8406 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-04-25T08:49:40.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd76807740 1 -- 172.21.15.172:0/2342702678 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x555c4a65f630 con 0x555c4a73a470 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd717c6640 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x555c4a73a470 0x555c4a7a7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd4bfff640 10 client.8406 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.207+0000 7efd717c6640 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x555c4a73a470 0x555c4a7a7cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23d55907883b3ab9 server_cookie=2dfbb328977035ac in_seq=0 out_seq=0 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd4bfff640 1 -- 172.21.15.172:0/2342702678 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x555c4a65f630 con 0x555c4a73a470 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd4bfff640 10 client.8406 handle_command_reply: tid=0 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 client.8406 shutdown 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 -- 172.21.15.172:0/2342702678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 msgr2=0x555c4a7a7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a7a7770 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7efd6400a430 tx=0x7efd64001250 comp rx=0 tx=0).stop 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 -- 172.21.15.172:0/2342702678 shutdown_connections 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x555c4a73a470 0x555c4a7a7cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x555c4a71e510 0x555c4a6f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555c4a721440 0x555c4a7a7770 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 --2- 172.21.15.172:0/2342702678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x555c4a7076c0 0x555c4a6f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd4bfff640 0 client.8406 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:40.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 -- 172.21.15.172:0/2342702678 >> 172.21.15.172:0/2342702678 conn(0x555c4a6ee770 msgr2=0x555c4a6e9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 -- 172.21.15.172:0/2342702678 shutdown_connections 2024-04-25T08:49:40.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 1 -- 172.21.15.172:0/2342702678 wait complete. 2024-04-25T08:49:40.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd76807740 20 client.8406 trim_cache size 0 max 16384 2024-04-25T08:49:40.205 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:49:40.205 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0 2024-04-25T08:49:40.205 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:49:40.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd73a2a640 1 -- 172.21.15.172:0/2059032841 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd5006b4d0 msgr2=0x7efd5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd73a2a640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd5006b4d0 0x7efd5006d990 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7efd68006fd0 tx=0x7efd68008040 comp rx=0 tx=0).stop 2024-04-25T08:49:40.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd73a2a640 1 -- 172.21.15.172:0/2059032841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 msgr2=0x7efd6c0c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd73a2a640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 0x7efd6c0c9f40 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7efd6400c7d0 tx=0x7efd6400cc90 comp rx=0 tx=0).stop 2024-04-25T08:49:40.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd73a2a640 1 -- 172.21.15.172:0/2059032841 shutdown_connections 2024-04-25T08:49:40.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd73a2a640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd5006b4d0 0x7efd5006d990 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd73a2a640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd6c1454b0 0x7efd6c0c9f40 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd73a2a640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd6c144d20 0x7efd6c0cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd73a2a640 1 --2- 172.21.15.172:0/2059032841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c071300 0x7efd6c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.208+0000 7efd73a2a640 1 -- 172.21.15.172:0/2059032841 >> 172.21.15.172:0/2059032841 conn(0x7efd6c0b3530 msgr2=0x7efd6c1e0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.209+0000 7efd73a2a640 1 -- 172.21.15.172:0/2059032841 shutdown_connections 2024-04-25T08:49:40.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.209+0000 7efd73a2a640 1 -- 172.21.15.172:0/2059032841 wait complete. 2024-04-25T08:49:40.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:40.210 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T08:49:40.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.318+0000 7f41ccf02640 1 Processor -- start 2024-04-25T08:49:40.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.318+0000 7f41ccf02640 1 -- start start 2024-04-25T08:49:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.319+0000 7f41ccf02640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c8070dc0 0x7f41c806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.319+0000 7f41ccf02640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c80d1770 con 0x7f41c815deb0 2024-04-25T08:49:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.319+0000 7f41ccf02640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c8162740 con 0x7f41c80711a0 2024-04-25T08:49:40.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.319+0000 7f41ccf02640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c80b0eb0 con 0x7f41c8070dc0 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c6d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f41c815deb0 0x7f41c815e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51264/0 (socket says 172.21.15.172:51264) 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c6d9d640 1 -- 172.21.15.172:0/2690787293 learned_addr learned my addr 172.21.15.172:0/2690787293 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c659c640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c8070dc0 0x7f41c806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801826821 0 0) 0x7f41c80d1770 con 0x7f41c815deb0 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41b0003520 con 0x7f41c815deb0 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 358099510 0 0) 0x7f41b0003520 con 0x7f41c815deb0 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c8070dc0 msgr2=0x7f41c806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c8070dc0 0x7f41c806ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 >> v1:172.21.15.186:6789/0 conn(0x7f41c80711a0 legacy=0x7f41c80b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8161980 con 0x7f41c815deb0 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f41b8001670 con 0x7f41c815deb0 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 >> v1:172.21.15.172:6789/0 conn(0x7f41c815deb0 legacy=0x7f41c815e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 0x7f41b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41b0004800 0x7f41b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c8070dc0 0x7f41b0005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c80b0eb0 con 0x7f41b00039e0 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b000bb80 con 0x7f41b0004800 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b000bd80 con 0x7f41c8070dc0 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c659c640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 0x7f41b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41b0004800 0x7f41b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.320+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c8070dc0 0x7f41b0005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.321+0000 7f41c659c640 1 -- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c8070dc0 msgr2=0x7f41b0005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.321+0000 7f41c659c640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c8070dc0 0x7f41b0005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.321+0000 7f41c659c640 1 -- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41b0004800 msgr2=0x7f41b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.321+0000 7f41c659c640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41b0004800 0x7f41b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.321+0000 7f41c659c640 1 -- 172.21.15.172:0/2690787293 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0003520 con 0x7f41b00039e0 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.321+0000 7f41c659c640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 0x7f41b0003e00 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009ac0 tx=0x7f41b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659876d3e2e24417 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.321+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0036070 con 0x7f41b00039e0 2024-04-25T08:49:40.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.321+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c0031400 con 0x7f41b00039e0 2024-04-25T08:49:40.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.321+0000 7f41c559a640 1 -- 172.21.15.172:0/2690787293 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0009690 con 0x7f41b00039e0 2024-04-25T08:49:40.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.322+0000 7f41ccf02640 1 -- 172.21.15.172:0/2690787293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 msgr2=0x7f41b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.322+0000 7f41ccf02640 1 --2- 172.21.15.172:0/2690787293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 0x7f41b0003e00 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009ac0 tx=0x7f41b0005830 comp rx=0 tx=0).stop 2024-04-25T08:49:40.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.322+0000 7f41c6d9d640 1 -- 172.21.15.172:0/2690787293 reap_dead start 2024-04-25T08:49:40.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.322+0000 7f41ccf02640 1 -- 172.21.15.172:0/2690787293 shutdown_connections 2024-04-25T08:49:40.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.322+0000 7f41ccf02640 1 -- 172.21.15.172:0/2690787293 >> 172.21.15.172:0/2690787293 conn(0x7f41c80b3530 msgr2=0x7f41c80b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.322+0000 7f41ccf02640 1 -- 172.21.15.172:0/2690787293 shutdown_connections 2024-04-25T08:49:40.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.322+0000 7f41ccf02640 1 -- 172.21.15.172:0/2690787293 wait complete. 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.323+0000 7f41ccf02640 1 Processor -- start 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.323+0000 7f41ccf02640 1 -- start start 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41ccf02640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 0x7f41c81560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41ccf02640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41c81554f0 0x7f41c80cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41ccf02640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c80cb0f0 0x7f41c8157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41ccf02640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c80b10f0 con 0x7f41b00039e0 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41ccf02640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81622b0 con 0x7f41c81554f0 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41ccf02640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c8161f40 con 0x7f41c80cb0f0 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41c659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 0x7f41c81560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41c659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 0x7f41c81560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56498/0 (socket says 172.21.15.172:56498) 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41c659c640 1 -- 172.21.15.172:0/4143597740 learned_addr learned my addr 172.21.15.172:0/4143597740 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41c81554f0 0x7f41c80cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c80cb0f0 0x7f41c8157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41c659c640 1 -- 172.21.15.172:0/4143597740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c80cb0f0 msgr2=0x7f41c8157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41c659c640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c80cb0f0 0x7f41c8157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41c659c640 1 -- 172.21.15.172:0/4143597740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41c81554f0 msgr2=0x7f41c80cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.324+0000 7f41c659c640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41c81554f0 0x7f41c80cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.325+0000 7f41c659c640 1 -- 172.21.15.172:0/4143597740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8156630 con 0x7f41b00039e0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.325+0000 7f41c659c640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 0x7f41c81560f0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009be0 tx=0x7f41c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.325+0000 7f41b6ffd640 1 -- 172.21.15.172:0/4143597740 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0040020 con 0x7f41b00039e0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.325+0000 7f41b6ffd640 1 -- 172.21.15.172:0/4143597740 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c0003bc0 con 0x7f41b00039e0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.325+0000 7f41ccf02640 1 -- 172.21.15.172:0/4143597740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c81568d0 con 0x7f41b00039e0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.325+0000 7f41b6ffd640 1 -- 172.21.15.172:0/4143597740 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0036040 con 0x7f41b00039e0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.325+0000 7f41ccf02640 1 -- 172.21.15.172:0/4143597740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c8156e90 con 0x7f41b00039e0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.326+0000 7f41b6ffd640 1 -- 172.21.15.172:0/4143597740 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f41c0043020 con 0x7f41b00039e0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.327+0000 7f41b6ffd640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41a806b4d0 0x7f41a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.327+0000 7f41b6ffd640 1 -- 172.21.15.172:0/4143597740 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f41c00aa400 con 0x7f41b00039e0 2024-04-25T08:49:40.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.327+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41a806b4d0 0x7f41a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.327+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41a806b4d0 0x7f41a806d990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f41c80cdcb0 tx=0x7f41bc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.328+0000 7f41cfbfd740 1 Processor -- start 2024-04-25T08:49:40.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.328+0000 7f41cfbfd740 1 -- start start 2024-04-25T08:49:40.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c67435320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67435860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67405770 0x563c67408f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c6736eda0 con 0x563c67405770 2024-04-25T08:49:40.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c67317b80 con 0x563c67432b10 2024-04-25T08:49:40.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c6736ae40 con 0x563c67432ef0 2024-04-25T08:49:40.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67405770 0x563c67408f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67405770 0x563c67408f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56512/0 (socket says 172.21.15.172:56512) 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c6d9d640 1 -- 172.21.15.172:0/3876714470 learned_addr learned my addr 172.21.15.172:0/3876714470 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/3876714470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67435860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c659c640 1 --2- 172.21.15.172:0/3876714470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c67435320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c6d9d640 1 -- 172.21.15.172:0/3876714470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 msgr2=0x563c67435860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/3876714470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67435860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c6d9d640 1 -- 172.21.15.172:0/3876714470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 msgr2=0x563c67435320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/3876714470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c67435320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c6d9d640 1 -- 172.21.15.172:0/3876714470 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c67321f10 con 0x563c67405770 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/3876714470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67405770 0x563c67408f80 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f41c8070570 tx=0x7f41b80078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ac9c98180763d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.329+0000 7f41a7fff640 1 -- 172.21.15.172:0/3876714470 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b801b070 con 0x563c67405770 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41a7fff640 1 -- 172.21.15.172:0/3876714470 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8007390 con 0x563c67405770 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41a7fff640 1 -- 172.21.15.172:0/3876714470 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8007740 con 0x563c67405770 2024-04-25T08:49:40.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3876714470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67405770 msgr2=0x563c67408f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/3876714470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67405770 0x563c67408f80 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f41c8070570 tx=0x7f41b80078f0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3876714470 shutdown_connections 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/3876714470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67405770 0x563c67408f80 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/3876714470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67435860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/3876714470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c67435320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3876714470 >> 172.21.15.172:0/3876714470 conn(0x563c674079e0 msgr2=0x563c67450320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3876714470 shutdown_connections 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.330+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3876714470 wait complete. 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.331+0000 7f41cfbfd740 1 -- start start 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.331+0000 7f41cfbfd740 1 Processor -- start 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c67449d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67406420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67406960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c6740ab90 con 0x563c6744c350 2024-04-25T08:49:40.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c6730d4b0 con 0x563c67432b10 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c6740ae70 con 0x563c67432ef0 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41cfbfd740 10 client.0 _ll_register_callbacks cb 0x563c6734d180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67406960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67406960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56522/0 (socket says 172.21.15.172:56522) 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c6d9d640 1 -- 172.21.15.172:0/252661980 learned_addr learned my addr 172.21.15.172:0/252661980 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67406420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c659c640 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c67449d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c6d9d640 1 -- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 msgr2=0x563c67406420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67406420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c6d9d640 1 -- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 msgr2=0x563c67449d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c67449d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c6d9d640 1 -- 172.21.15.172:0/252661980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c6714d7d0 con 0x563c6744c350 2024-04-25T08:49:40.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67406420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67406960 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f41b80017e0 tx=0x7f41c8162220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bb570f7deea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.332+0000 7f41a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41a57fa640 1 -- 172.21.15.172:0/252661980 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b801b040 con 0x563c6744c350 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41a57fa640 1 -- 172.21.15.172:0/252661980 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f41b8017820 con 0x563c6744c350 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41cfbfd740 1 -- 172.21.15.172:0/252661980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f41b8007390 con 0x563c6744c350 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41a57fa640 1 -- 172.21.15.172:0/252661980 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41b802d050 con 0x563c6744c350 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41cfbfd740 10 client.8418 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41cfbfd740 1 -- 172.21.15.172:0/252661980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x563c670833f0 con 0x563c6744c350 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41a57fa640 1 -- 172.21.15.172:0/252661980 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8007390 con 0x563c6744c350 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41a57fa640 1 -- 172.21.15.172:0/252661980 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f41b8030020 con 0x563c6744c350 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41cfbfd740 10 client.8418 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41cfbfd740 10 client.8418 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41cfbfd740 20 client.8418 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:40.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x563c6744ae20 0x563c6744b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41cfbfd740 4 client.8418 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41cfbfd740 1 -- 172.21.15.172:0/252661980 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c6737c2e0 con 0x563c6744ae20 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.333+0000 7f41c659c640 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x563c6744ae20 0x563c6744b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41a57fa640 10 client.8418 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41c659c640 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x563c6744ae20 0x563c6744b200 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec6febd91e0dfc63 server_cookie=3054b906d32cc5e6 in_seq=0 out_seq=0 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41a57fa640 1 -- 172.21.15.172:0/252661980 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563c6737c2e0 con 0x563c6744ae20 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41a57fa640 10 client.8418 handle_command_reply: tid=0 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41cfbfd740 1 client.8418 shutdown 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41cfbfd740 1 -- 172.21.15.172:0/252661980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 msgr2=0x563c67406960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67406960 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f41b80017e0 tx=0x7f41c8162220 comp rx=0 tx=0).stop 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41cfbfd740 1 -- 172.21.15.172:0/252661980 shutdown_connections 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x563c6744ae20 0x563c6744b200 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67406960 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67406420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41a57fa640 0 client.8418 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:40.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/252661980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c67449d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.334+0000 7f41cfbfd740 1 -- 172.21.15.172:0/252661980 >> 172.21.15.172:0/252661980 conn(0x563c67405770 msgr2=0x563c67431dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.335+0000 7f41cfbfd740 1 -- 172.21.15.172:0/252661980 shutdown_connections 2024-04-25T08:49:40.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.335+0000 7f41cfbfd740 1 -- 172.21.15.172:0/252661980 wait complete. 2024-04-25T08:49:40.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.335+0000 7f41cfbfd740 20 client.8418 trim_cache size 0 max 16384 2024-04-25T08:49:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41cfbfd740 1 Processor -- start 2024-04-25T08:49:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41cfbfd740 1 -- start start 2024-04-25T08:49:40.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c674b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67449580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67449ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c8200c40 con 0x563c6744c350 2024-04-25T08:49:40.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81ffe50 con 0x563c67432b10 2024-04-25T08:49:40.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81ff250 con 0x563c67432ef0 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41c6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67449ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41c6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67449ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56534/0 (socket says 172.21.15.172:56534) 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.350+0000 7f41c6d9d640 1 -- 172.21.15.172:0/477745414 learned_addr learned my addr 172.21.15.172:0/477745414 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/477745414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67449580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41c659c640 1 --2- 172.21.15.172:0/477745414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c674b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41c6d9d640 1 -- 172.21.15.172:0/477745414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 msgr2=0x563c67449580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/477745414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67449580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41c6d9d640 1 -- 172.21.15.172:0/477745414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 msgr2=0x563c674b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/477745414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c674b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41c6d9d640 1 -- 172.21.15.172:0/477745414 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c670430f0 con 0x563c6744c350 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/477745414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67449580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/477745414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67449ac0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f41b80078d0 tx=0x7f41b801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39dcb8b2ac8c334 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41a77fe640 1 -- 172.21.15.172:0/477745414 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b801b070 con 0x563c6744c350 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41a77fe640 1 -- 172.21.15.172:0/477745414 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8025070 con 0x563c6744c350 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.351+0000 7f41a77fe640 1 -- 172.21.15.172:0/477745414 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8017c90 con 0x563c6744c350 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 -- 172.21.15.172:0/477745414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 msgr2=0x563c67449ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/477745414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67449ac0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f41b80078d0 tx=0x7f41b801f000 comp rx=0 tx=0).stop 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 -- 172.21.15.172:0/477745414 shutdown_connections 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/477745414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6744c350 0x563c67449ac0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/477745414 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432ef0 0x563c67449580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/477745414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c67432b10 0x563c674b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 -- 172.21.15.172:0/477745414 >> 172.21.15.172:0/477745414 conn(0x563c67405770 msgr2=0x563c67438f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 -- 172.21.15.172:0/477745414 shutdown_connections 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 -- 172.21.15.172:0/477745414 wait complete. 2024-04-25T08:49:40.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 -- start start 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.352+0000 7f41cfbfd740 1 Processor -- start 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432b10 0x563c674727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67432ef0 0x563c674b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41cfbfd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c6744c350 0x563c67409650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c67435820 con 0x563c67432ef0 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81ff850 con 0x563c6744c350 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41cfbfd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c67439620 con 0x563c67432b10 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41cfbfd740 10 client.0 _ll_register_callbacks cb 0x7f41b8001100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41c5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67432ef0 0x563c674b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41c5d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67432ef0 0x563c674b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56542/0 (socket says 172.21.15.172:56542) 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41c5d9b640 1 -- 172.21.15.172:0/3639217989 learned_addr learned my addr 172.21.15.172:0/3639217989 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41c659c640 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432b10 0x563c674727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41c6d9d640 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c6744c350 0x563c67409650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41c5d9b640 1 -- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432b10 msgr2=0x563c674727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432b10 0x563c674727a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41c5d9b640 1 -- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c6744c350 msgr2=0x563c67409650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c6744c350 0x563c67409650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.353+0000 7f41c5d9b640 1 -- 172.21.15.172:0/3639217989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c67449ec0 con 0x563c67432ef0 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41c5d9b640 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67432ef0 0x563c674b4830 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f41bc002190 tx=0x7f41bc0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05ad376747a8c6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41a57fa640 1 -- 172.21.15.172:0/3639217989 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc02b060 con 0x563c67432ef0 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41a57fa640 1 -- 172.21.15.172:0/3639217989 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f41bc010040 con 0x563c67432ef0 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3639217989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f41b8025070 con 0x563c67432ef0 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41a57fa640 1 -- 172.21.15.172:0/3639217989 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41bc0148e0 con 0x563c67432ef0 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41cfbfd740 10 client.8424 fetch_fsmap learned FSMap version 62 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3639217989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x563c67408f80 con 0x563c67432ef0 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41a57fa640 1 -- 172.21.15.172:0/3639217989 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8025070 con 0x563c67432ef0 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41a57fa640 1 -- 172.21.15.172:0/3639217989 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 62) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f41bc014a80 con 0x563c67432ef0 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41cfbfd740 10 client.8424 fetch_fsmap finished waiting for FSMap version 62 2024-04-25T08:49:40.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41cfbfd740 10 client.8424 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41cfbfd740 20 client.8424 populate_metadata read hostname 'smithi172' 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x563c67409b90 0x563c67453460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41cfbfd740 4 client.8424 mds_command: new command op to 8124 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3639217989 --> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563c67376630 con 0x563c67409b90 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.354+0000 7f41c659c640 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x563c67409b90 0x563c67453460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41a57fa640 10 client.8424 ms_handle_connect on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41c659c640 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x563c67409b90 0x563c67453460 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1687af73f22f536 server_cookie=8d5f1cee094e835a in_seq=0 out_seq=0 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41a57fa640 1 -- 172.21.15.172:0/3639217989 <== mds.0 v2:172.21.15.186:6833/3937459499 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563c67376630 con 0x563c67409b90 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41a57fa640 10 client.8424 handle_command_reply: tid=0 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 client.8424 shutdown 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3639217989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67432ef0 msgr2=0x563c674b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67432ef0 0x563c674b4830 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f41bc002190 tx=0x7f41bc0014a0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3639217989 shutdown_connections 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:6833/3937459499,v1:172.21.15.186:6835/3937459499] conn(0x563c67409b90 0x563c67453460 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563c6744c350 0x563c67409650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41a57fa640 0 client.8424 ms_handle_reset on v2:172.21.15.186:6833/3937459499 2024-04-25T08:49:40.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c67432ef0 0x563c674b4830 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 --2- 172.21.15.172:0/3639217989 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x563c67432b10 0x563c674727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3639217989 >> 172.21.15.172:0/3639217989 conn(0x563c67405770 msgr2=0x563c67400b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3639217989 shutdown_connections 2024-04-25T08:49:40.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 1 -- 172.21.15.172:0/3639217989 wait complete. 2024-04-25T08:49:40.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.355+0000 7f41cfbfd740 20 client.8424 trim_cache size 0 max 16384 2024-04-25T08:49:40.354 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:49:40.354 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "no active scrubs running", 2024-04-25T08:49:40.354 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": {} 2024-04-25T08:49:40.354 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:49:40.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 -- 172.21.15.172:0/4143597740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41a806b4d0 msgr2=0x7f41a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41a806b4d0 0x7f41a806d990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f41c80cdcb0 tx=0x7f41bc009040 comp rx=0 tx=0).stop 2024-04-25T08:49:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 -- 172.21.15.172:0/4143597740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 msgr2=0x7f41c81560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 0x7f41c81560f0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009be0 tx=0x7f41c0004730 comp rx=0 tx=0).stop 2024-04-25T08:49:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 -- 172.21.15.172:0/4143597740 shutdown_connections 2024-04-25T08:49:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41a806b4d0 0x7f41a806d990 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41c81554f0 0x7f41c80cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41c80cb0f0 0x7f41c8157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 --2- 172.21.15.172:0/4143597740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41b00039e0 0x7f41c81560f0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 -- 172.21.15.172:0/4143597740 >> 172.21.15.172:0/4143597740 conn(0x7f41c80b3530 msgr2=0x7f41c815d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 -- 172.21.15.172:0/4143597740 shutdown_connections 2024-04-25T08:49:40.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.356+0000 7f41ccf02640 1 -- 172.21.15.172:0/4143597740 wait complete. 2024-04-25T08:49:40.357 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:40.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.464+0000 7f131e0b3640 1 Processor -- start 2024-04-25T08:49:40.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.464+0000 7f131e0b3640 1 -- start start 2024-04-25T08:49:40.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f131e0b3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1318144750 0x7f131806e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f131e0b3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f13180cf030 0x7f131806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f131e0b3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1318144b30 con 0x7f131806eb10 2024-04-25T08:49:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f131e0b3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180712d0 con 0x7f1318144750 2024-04-25T08:49:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f131e0b3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13180715b0 con 0x7f13180cf030 2024-04-25T08:49:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f13177fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1318144750 0x7f131806e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f1316ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f131806eb10 0x7f13180ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51276/0 (socket says 172.21.15.172:51276) 2024-04-25T08:49:40.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f13177fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1318144750 0x7f131806e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56546/0 (socket says 172.21.15.172:56546) 2024-04-25T08:49:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f1316ffd640 1 -- 172.21.15.172:0/1837732739 learned_addr learned my addr 172.21.15.172:0/1837732739 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f1317fff640 1 --2- 172.21.15.172:0/1837732739 >> v2:172.21.15.186:3300/0 conn(0x7f13180cf030 0x7f131806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f13177fe640 1 -- 172.21.15.172:0/1837732739 >> v2:172.21.15.186:3300/0 conn(0x7f13180cf030 msgr2=0x7f131806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f13177fe640 1 --2- 172.21.15.172:0/1837732739 >> v2:172.21.15.186:3300/0 conn(0x7f13180cf030 0x7f131806d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f13177fe640 1 -- 172.21.15.172:0/1837732739 >> v1:172.21.15.172:6789/0 conn(0x7f131806eb10 legacy=0x7f13180ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f13177fe640 1 -- 172.21.15.172:0/1837732739 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1318071890 con 0x7f1318144750 2024-04-25T08:49:40.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.465+0000 7f13167fc640 1 -- 172.21.15.172:0/1837732739 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556269691 0 0) 0x7f1318144b30 con 0x7f131806eb10 2024-04-25T08:49:40.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.466+0000 7f13177fe640 1 --2- 172.21.15.172:0/1837732739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1318144750 0x7f131806e5d0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f131806f720 tx=0x7f130c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b576c5623b6f8cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.466+0000 7f13167fc640 1 -- 172.21.15.172:0/1837732739 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c037070 con 0x7f1318144750 2024-04-25T08:49:40.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.466+0000 7f13167fc640 1 -- 172.21.15.172:0/1837732739 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c032440 con 0x7f1318144750 2024-04-25T08:49:40.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.466+0000 7f13167fc640 1 -- 172.21.15.172:0/1837732739 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c032810 con 0x7f1318144750 2024-04-25T08:49:40.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.467+0000 7f131e0b3640 1 -- 172.21.15.172:0/1837732739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1318144750 msgr2=0x7f131806e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.467+0000 7f131e0b3640 1 --2- 172.21.15.172:0/1837732739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1318144750 0x7f131806e5d0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f131806f720 tx=0x7f130c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.467+0000 7f131e0b3640 1 -- 172.21.15.172:0/1837732739 shutdown_connections 2024-04-25T08:49:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.467+0000 7f131e0b3640 1 --2- 172.21.15.172:0/1837732739 >> v2:172.21.15.186:3300/0 conn(0x7f13180cf030 0x7f131806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.467+0000 7f131e0b3640 1 --2- 172.21.15.172:0/1837732739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1318144750 0x7f131806e5d0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.467+0000 7f131e0b3640 1 -- 172.21.15.172:0/1837732739 >> 172.21.15.172:0/1837732739 conn(0x7f131806abe0 msgr2=0x7f131806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.467+0000 7f131e0b3640 1 -- 172.21.15.172:0/1837732739 shutdown_connections 2024-04-25T08:49:40.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.467+0000 7f131e0b3640 1 -- 172.21.15.172:0/1837732739 wait complete. 2024-04-25T08:49:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.468+0000 7f131e0b3640 1 Processor -- start 2024-04-25T08:49:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.468+0000 7f131e0b3640 1 -- start start 2024-04-25T08:49:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f131e0b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f131806eb10 0x7f131815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f131e0b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13180cf030 0x7f13181f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f131e0b3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1318144750 0x7f13180adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f131e0b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13181455d0 con 0x7f13180cf030 2024-04-25T08:49:40.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f131e0b3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1318145450 con 0x7f1318144750 2024-04-25T08:49:40.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f131e0b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131815c000 con 0x7f131806eb10 2024-04-25T08:49:40.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f1316ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13180cf030 0x7f13181f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f1316ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13180cf030 0x7f13181f5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56550/0 (socket says 172.21.15.172:56550) 2024-04-25T08:49:40.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f1316ffd640 1 -- 172.21.15.172:0/647523864 learned_addr learned my addr 172.21.15.172:0/647523864 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f1317fff640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1318144750 0x7f13180adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f13177fe640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f131806eb10 0x7f131815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f1316ffd640 1 -- 172.21.15.172:0/647523864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f131806eb10 msgr2=0x7f131815e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f1316ffd640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f131806eb10 0x7f131815e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f1316ffd640 1 -- 172.21.15.172:0/647523864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1318144750 msgr2=0x7f13180adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f1316ffd640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1318144750 0x7f13180adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f1316ffd640 1 -- 172.21.15.172:0/647523864 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131815d850 con 0x7f13180cf030 2024-04-25T08:49:40.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f1316ffd640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13180cf030 0x7f13181f5650 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f130800c430 tx=0x7f130800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f12fffff640 1 -- 172.21.15.172:0/647523864 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080074e0 con 0x7f13180cf030 2024-04-25T08:49:40.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f12fffff640 1 -- 172.21.15.172:0/647523864 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13080047e0 con 0x7f13180cf030 2024-04-25T08:49:40.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f12fffff640 1 -- 172.21.15.172:0/647523864 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1308004bd0 con 0x7f13180cf030 2024-04-25T08:49:40.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f131e0b3640 1 -- 172.21.15.172:0/647523864 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131815db30 con 0x7f13180cf030 2024-04-25T08:49:40.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.469+0000 7f131e0b3640 1 -- 172.21.15.172:0/647523864 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131815e0f0 con 0x7f13180cf030 2024-04-25T08:49:40.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.470+0000 7f131e0b3640 1 -- 172.21.15.172:0/647523864 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1318073990 con 0x7f13180cf030 2024-04-25T08:49:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.471+0000 7f12fffff640 1 -- 172.21.15.172:0/647523864 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1308011070 con 0x7f13180cf030 2024-04-25T08:49:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.471+0000 7f12fffff640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 0x7f130406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.471+0000 7f13177fe640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 0x7f130406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.471+0000 7f12fffff640 1 -- 172.21.15.172:0/647523864 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1308089eb0 con 0x7f13180cf030 2024-04-25T08:49:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.472+0000 7f13177fe640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 0x7f130406d990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f130c034000 tx=0x7f130c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.476+0000 7f12fffff640 1 -- 172.21.15.172:0/647523864 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1308058c30 con 0x7f13180cf030 2024-04-25T08:49:40.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.685+0000 7f131e0b3640 1 -- 172.21.15.172:0/647523864 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f131815ee30 con 0x7f13180cf030 2024-04-25T08:49:40.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.685+0000 7f12fffff640 1 -- 172.21.15.172:0/647523864 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f1308058530 con 0x7f13180cf030 2024-04-25T08:49:40.677 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:40.677 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:40.679 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:40.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 -- 172.21.15.172:0/647523864 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 msgr2=0x7f130406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 0x7f130406d990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f130c034000 tx=0x7f130c02e000 comp rx=0 tx=0).stop 2024-04-25T08:49:40.679 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 -- 172.21.15.172:0/647523864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13180cf030 msgr2=0x7f13181f5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13180cf030 0x7f13181f5650 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f130800c430 tx=0x7f130800c8f0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 -- 172.21.15.172:0/647523864 shutdown_connections 2024-04-25T08:49:40.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 0x7f130406d990 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1318144750 0x7f13180adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13180cf030 0x7f13181f5650 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 --2- 172.21.15.172:0/647523864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f131806eb10 0x7f131815e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 -- 172.21.15.172:0/647523864 >> 172.21.15.172:0/647523864 conn(0x7f131806abe0 msgr2=0x7f13180b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 -- 172.21.15.172:0/647523864 shutdown_connections 2024-04-25T08:49:40.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.687+0000 7f131e0b3640 1 -- 172.21.15.172:0/647523864 wait complete. 2024-04-25T08:49:40.689 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T08:49:40.690 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:49:40.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.796+0000 7f1c7e99e640 1 Processor -- start 2024-04-25T08:49:40.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.796+0000 7f1c7e99e640 1 -- start start 2024-04-25T08:49:40.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c7e99e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1c7815dd30 0x7f1c780b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c7e99e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c780d1df0 con 0x7f1c780d0ad0 2024-04-25T08:49:40.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c7e99e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c780d20d0 con 0x7f1c780b9770 2024-04-25T08:49:40.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c7e99e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c780d23b0 con 0x7f1c7815dd30 2024-04-25T08:49:40.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c7cf3b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1c780d0ad0 0x7f1c780b6a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51278/0 (socket says 172.21.15.172:51278) 2024-04-25T08:49:40.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c7cf3b640 1 -- 172.21.15.172:0/1202538860 learned_addr learned my addr 172.21.15.172:0/1202538860 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:40.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c77fff640 1 --2- 172.21.15.172:0/1202538860 >> v2:172.21.15.186:3300/0 conn(0x7f1c7815dd30 0x7f1c780b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155368748 0 0) 0x7f1c780d1df0 con 0x7f1c780d0ad0 2024-04-25T08:49:40.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c60003520 con 0x7f1c780d0ad0 2024-04-25T08:49:40.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 312484613 0 0) 0x7f1c60003520 con 0x7f1c780d0ad0 2024-04-25T08:49:40.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 >> v2:172.21.15.186:3300/0 conn(0x7f1c7815dd30 msgr2=0x7f1c780b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 --2- 172.21.15.172:0/1202538860 >> v2:172.21.15.186:3300/0 conn(0x7f1c7815dd30 0x7f1c780b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 >> v1:172.21.15.186:6789/0 conn(0x7f1c780b9770 legacy=0x7f1c780d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780d2690 con 0x7f1c780d0ad0 2024-04-25T08:49:40.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f1c700019f0 con 0x7f1c780d0ad0 2024-04-25T08:49:40.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 >> v1:172.21.15.172:6789/0 conn(0x7f1c780d0ad0 legacy=0x7f1c780b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c600039b0 0x7f1c60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c60004800 0x7f1c60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c600052e0 0x7f1c6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780d23b0 con 0x7f1c60004800 2024-04-25T08:49:40.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6000c1b0 con 0x7f1c600052e0 2024-04-25T08:49:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6000c3b0 con 0x7f1c600039b0 2024-04-25T08:49:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.797+0000 7f1c777fe640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c60004800 0x7f1c60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.798+0000 7f1c77fff640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c600039b0 0x7f1c60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.798+0000 7f1c7cf3b640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c600052e0 0x7f1c6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.798+0000 7f1c777fe640 1 -- 172.21.15.172:0/1202538860 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c600039b0 msgr2=0x7f1c60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.798+0000 7f1c777fe640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c600039b0 0x7f1c60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.798+0000 7f1c777fe640 1 -- 172.21.15.172:0/1202538860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c600052e0 msgr2=0x7f1c6000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.798+0000 7f1c777fe640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c600052e0 0x7f1c6000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.798+0000 7f1c777fe640 1 -- 172.21.15.172:0/1202538860 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c60003520 con 0x7f1c60004800 2024-04-25T08:49:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.798+0000 7f1c7cf3b640 1 -- 172.21.15.172:0/1202538860 reap_dead start 2024-04-25T08:49:40.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.798+0000 7f1c777fe640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c60004800 0x7f1c60004c80 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f1c68007fd0 tx=0x7f1c60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63b134047f2157 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.798+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680013c0 con 0x7f1c60004800 2024-04-25T08:49:40.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.799+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c680052d0 con 0x7f1c60004800 2024-04-25T08:49:40.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.799+0000 7f1c76ffd640 1 -- 172.21.15.172:0/1202538860 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6802a870 con 0x7f1c60004800 2024-04-25T08:49:40.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.799+0000 7f1c7e99e640 1 -- 172.21.15.172:0/1202538860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c60004800 msgr2=0x7f1c60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.799+0000 7f1c7e99e640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c60004800 0x7f1c60004c80 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f1c68007fd0 tx=0x7f1c60005830 comp rx=0 tx=0).stop 2024-04-25T08:49:40.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.799+0000 7f1c7e99e640 1 -- 172.21.15.172:0/1202538860 shutdown_connections 2024-04-25T08:49:40.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.799+0000 7f1c7e99e640 1 --2- 172.21.15.172:0/1202538860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c60004800 0x7f1c60004c80 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.799+0000 7f1c7e99e640 1 -- 172.21.15.172:0/1202538860 >> 172.21.15.172:0/1202538860 conn(0x7f1c78061c30 msgr2=0x7f1c7806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:40.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.799+0000 7f1c7e99e640 1 -- 172.21.15.172:0/1202538860 shutdown_connections 2024-04-25T08:49:40.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.799+0000 7f1c7e99e640 1 -- 172.21.15.172:0/1202538860 wait complete. 2024-04-25T08:49:40.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.800+0000 7f1c7e99e640 1 Processor -- start 2024-04-25T08:49:40.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.800+0000 7f1c7e99e640 1 -- start start 2024-04-25T08:49:40.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c7e99e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c60004800 0x7f1c780cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c7e99e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c78149eb0 0x7f1c780cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c7e99e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c78155710 0x7f1c78155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c7e99e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780d1b90 con 0x7f1c78149eb0 2024-04-25T08:49:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c7e99e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780d1a10 con 0x7f1c78155710 2024-04-25T08:49:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c7e99e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780d2e90 con 0x7f1c60004800 2024-04-25T08:49:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c777fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c78149eb0 0x7f1c780cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c777fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c78149eb0 0x7f1c780cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56576/0 (socket says 172.21.15.172:56576) 2024-04-25T08:49:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c777fe640 1 -- 172.21.15.172:0/539313281 learned_addr learned my addr 172.21.15.172:0/539313281 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:40.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c77fff640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c60004800 0x7f1c780cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c7cf3b640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c78155710 0x7f1c78155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.801+0000 7f1c777fe640 1 -- 172.21.15.172:0/539313281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c60004800 msgr2=0x7f1c780cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c777fe640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c60004800 0x7f1c780cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c777fe640 1 -- 172.21.15.172:0/539313281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c78155710 msgr2=0x7f1c78155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c777fe640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c78155710 0x7f1c78155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:40.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c777fe640 1 -- 172.21.15.172:0/539313281 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780cd8a0 con 0x7f1c78149eb0 2024-04-25T08:49:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c77fff640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c60004800 0x7f1c780cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c7cf3b640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c78155710 0x7f1c78155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c777fe640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c78149eb0 0x7f1c780cd360 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f1c68001860 tx=0x7f1c68001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c74ff9640 1 -- 172.21.15.172:0/539313281 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68037040 con 0x7f1c78149eb0 2024-04-25T08:49:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c74ff9640 1 -- 172.21.15.172:0/539313281 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68006820 con 0x7f1c78149eb0 2024-04-25T08:49:40.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c7e99e640 1 -- 172.21.15.172:0/539313281 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c780cba70 con 0x7f1c78149eb0 2024-04-25T08:49:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c74ff9640 1 -- 172.21.15.172:0/539313281 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68006bf0 con 0x7f1c78149eb0 2024-04-25T08:49:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.802+0000 7f1c7e99e640 1 -- 172.21.15.172:0/539313281 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c780cc030 con 0x7f1c78149eb0 2024-04-25T08:49:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.803+0000 7f1c7e99e640 1 -- 172.21.15.172:0/539313281 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c78073990 con 0x7f1c78149eb0 2024-04-25T08:49:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.804+0000 7f1c74ff9640 1 -- 172.21.15.172:0/539313281 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c68007040 con 0x7f1c78149eb0 2024-04-25T08:49:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.804+0000 7f1c74ff9640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6406b4d0 0x7f1c6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:40.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.804+0000 7f1c74ff9640 1 -- 172.21.15.172:0/539313281 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1c680aa310 con 0x7f1c78149eb0 2024-04-25T08:49:40.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.804+0000 7f1c77fff640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6406b4d0 0x7f1c6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:40.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.805+0000 7f1c77fff640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6406b4d0 0x7f1c6406d990 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009bc0 tx=0x7f1c6c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:40.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:40.809+0000 7f1c74ff9640 1 -- 172.21.15.172:0/539313281 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c68079090 con 0x7f1c78149eb0 2024-04-25T08:49:41.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.046+0000 7f1c7e99e640 1 -- 172.21.15.172:0/539313281 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1c780b8500 con 0x7f1c78149eb0 2024-04-25T08:49:41.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.046+0000 7f1c74ff9640 1 -- 172.21.15.172:0/539313281 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1596 (secure 0 0 0) 0x7f1c68078990 con 0x7f1c78149eb0 2024-04-25T08:49:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:41.037 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":456,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":946,"data_bytes":968550751,"bytes_used":2286870528,"bytes_avail":770807242752,"bytes_total":773094113280,"write_bytes_sec":80655193,"read_op_per_sec":0,"write_op_per_sec":78},"fsmap":{"epoch":62,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":8124}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-04-25T08:49:38.601434+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T08:49:41.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 -- 172.21.15.172:0/539313281 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6406b4d0 msgr2=0x7f1c6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:41.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6406b4d0 0x7f1c6406d990 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009bc0 tx=0x7f1c6c008040 comp rx=0 tx=0).stop 2024-04-25T08:49:41.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 -- 172.21.15.172:0/539313281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c78149eb0 msgr2=0x7f1c780cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:41.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c78149eb0 0x7f1c780cd360 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f1c68001860 tx=0x7f1c68001170 comp rx=0 tx=0).stop 2024-04-25T08:49:41.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 -- 172.21.15.172:0/539313281 shutdown_connections 2024-04-25T08:49:41.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6406b4d0 0x7f1c6406d990 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:41.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c78155710 0x7f1c78155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:41.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c78149eb0 0x7f1c780cd360 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:41.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 --2- 172.21.15.172:0/539313281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c60004800 0x7f1c780cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:41.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 -- 172.21.15.172:0/539313281 >> 172.21.15.172:0/539313281 conn(0x7f1c78061c30 msgr2=0x7f1c78160680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:41.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 -- 172.21.15.172:0/539313281 shutdown_connections 2024-04-25T08:49:41.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:41.048+0000 7f1c7e99e640 1 -- 172.21.15.172:0/539313281 wait complete. 2024-04-25T08:49:41.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T08:49:42.051 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:42.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.169+0000 7fad7ddce640 1 Processor -- start 2024-04-25T08:49:42.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.169+0000 7fad7ddce640 1 -- start start 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.170+0000 7fad7ddce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 0x7fad780b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.170+0000 7fad7ddce640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fad780b9770 0x7fad780d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.170+0000 7fad7ddce640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad780d1df0 con 0x7fad780d2e90 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.170+0000 7fad7ddce640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad780b7a50 con 0x7fad780b9770 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.170+0000 7fad7ddce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad780d20d0 con 0x7fad7815dd30 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.170+0000 7fad77fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fad780d2e90 0x7fad780b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51280/0 (socket says 172.21.15.172:51280) 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.170+0000 7fad77fff640 1 -- 172.21.15.172:0/1613580836 learned_addr learned my addr 172.21.15.172:0/1613580836 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.170+0000 7fad777fe640 1 --2- 172.21.15.172:0/1613580836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 0x7fad780b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.170+0000 7fad76ffd640 1 --2- 172.21.15.172:0/1613580836 >> v2:172.21.15.186:3300/0 conn(0x7fad780b9770 0x7fad780d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.171+0000 7fad767fc640 1 -- 172.21.15.172:0/1613580836 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75444924 0 0) 0x7fad780d1df0 con 0x7fad780d2e90 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.171+0000 7fad767fc640 1 -- 172.21.15.172:0/1613580836 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad60003520 con 0x7fad780d2e90 2024-04-25T08:49:42.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.171+0000 7fad76ffd640 1 -- 172.21.15.172:0/1613580836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 msgr2=0x7fad780b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.171+0000 7fad76ffd640 1 --2- 172.21.15.172:0/1613580836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 0x7fad780b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.171+0000 7fad76ffd640 1 -- 172.21.15.172:0/1613580836 >> v1:172.21.15.172:6789/0 conn(0x7fad780d2e90 legacy=0x7fad780b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.171+0000 7fad76ffd640 1 -- 172.21.15.172:0/1613580836 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780d23b0 con 0x7fad780b9770 2024-04-25T08:49:42.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.171+0000 7fad777fe640 1 --2- 172.21.15.172:0/1613580836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 0x7fad780b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:42.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad76ffd640 1 --2- 172.21.15.172:0/1613580836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad780b9770 0x7fad780d03c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009790 tx=0x7fad6c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cc589162640e5a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:42.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad767fc640 1 -- 172.21.15.172:0/1613580836 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c037070 con 0x7fad780b9770 2024-04-25T08:49:42.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad767fc640 1 -- 172.21.15.172:0/1613580836 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c02ae50 con 0x7fad780b9770 2024-04-25T08:49:42.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad767fc640 1 -- 172.21.15.172:0/1613580836 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c032640 con 0x7fad780b9770 2024-04-25T08:49:42.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad7ddce640 1 -- 172.21.15.172:0/1613580836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad780b9770 msgr2=0x7fad780d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad7ddce640 1 --2- 172.21.15.172:0/1613580836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad780b9770 0x7fad780d03c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009790 tx=0x7fad6c02a100 comp rx=0 tx=0).stop 2024-04-25T08:49:42.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad7ddce640 1 -- 172.21.15.172:0/1613580836 shutdown_connections 2024-04-25T08:49:42.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad7ddce640 1 --2- 172.21.15.172:0/1613580836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad780b9770 0x7fad780d03c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad7ddce640 1 --2- 172.21.15.172:0/1613580836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 0x7fad780b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad7ddce640 1 -- 172.21.15.172:0/1613580836 >> 172.21.15.172:0/1613580836 conn(0x7fad78061c30 msgr2=0x7fad7806c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:42.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad7ddce640 1 -- 172.21.15.172:0/1613580836 shutdown_connections 2024-04-25T08:49:42.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.172+0000 7fad7ddce640 1 -- 172.21.15.172:0/1613580836 wait complete. 2024-04-25T08:49:42.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.174+0000 7fad7ddce640 1 Processor -- start 2024-04-25T08:49:42.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.174+0000 7fad7ddce640 1 -- start start 2024-04-25T08:49:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.174+0000 7fad7ddce640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad780b9770 0x7fad780b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad7ddce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad780d2e90 0x7fad781f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad7ddce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 0x7fad780c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad7ddce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780d1a10 con 0x7fad780d2e90 2024-04-25T08:49:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad7ddce640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780d2970 con 0x7fad780b9770 2024-04-25T08:49:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad7ddce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad780d1b90 con 0x7fad7815dd30 2024-04-25T08:49:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad76ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad780d2e90 0x7fad781f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad76ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad780d2e90 0x7fad781f6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56592/0 (socket says 172.21.15.172:56592) 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad76ffd640 1 -- 172.21.15.172:0/1023273553 learned_addr learned my addr 172.21.15.172:0/1023273553 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad77fff640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 0x7fad780c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad777fe640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad780b9770 0x7fad780b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad76ffd640 1 -- 172.21.15.172:0/1023273553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 msgr2=0x7fad780c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad76ffd640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 0x7fad780c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad76ffd640 1 -- 172.21.15.172:0/1023273553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad780b9770 msgr2=0x7fad780b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad76ffd640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad780b9770 0x7fad780b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad76ffd640 1 -- 172.21.15.172:0/1023273553 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad781f7420 con 0x7fad780d2e90 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad77fff640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 0x7fad780c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad777fe640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad780b9770 0x7fad780b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad76ffd640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad780d2e90 0x7fad781f6ab0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fad6c035040 tx=0x7fad6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad5ffff640 1 -- 172.21.15.172:0/1023273553 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c041020 con 0x7fad780d2e90 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad7ddce640 1 -- 172.21.15.172:0/1023273553 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad781f7700 con 0x7fad780d2e90 2024-04-25T08:49:42.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad5ffff640 1 -- 172.21.15.172:0/1023273553 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c03c670 con 0x7fad780d2e90 2024-04-25T08:49:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad5ffff640 1 -- 172.21.15.172:0/1023273553 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c037040 con 0x7fad780d2e90 2024-04-25T08:49:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.175+0000 7fad7ddce640 1 -- 172.21.15.172:0/1023273553 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad781f6ff0 con 0x7fad780d2e90 2024-04-25T08:49:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.176+0000 7fad7ddce640 1 -- 172.21.15.172:0/1023273553 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad78073990 con 0x7fad780d2e90 2024-04-25T08:49:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.177+0000 7fad5ffff640 1 -- 172.21.15.172:0/1023273553 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fad6c044020 con 0x7fad780d2e90 2024-04-25T08:49:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.177+0000 7fad5ffff640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad6406b500 0x7fad6406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.177+0000 7fad777fe640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad6406b500 0x7fad6406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.177+0000 7fad5ffff640 1 -- 172.21.15.172:0/1023273553 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fad6c0aaa10 con 0x7fad780d2e90 2024-04-25T08:49:42.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.178+0000 7fad777fe640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad6406b500 0x7fad6406d9c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fad780b6920 tx=0x7fad68008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:42.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.181+0000 7fad5ffff640 1 -- 172.21.15.172:0/1023273553 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad6c04b030 con 0x7fad780d2e90 2024-04-25T08:49:42.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.387+0000 7fad7ddce640 1 -- 172.21.15.172:0/1023273553 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad780d3c20 con 0x7fad780d2e90 2024-04-25T08:49:42.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.387+0000 7fad5ffff640 1 -- 172.21.15.172:0/1023273553 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fad6c079830 con 0x7fad780d2e90 2024-04-25T08:49:42.378 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:42.378 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:42.379 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:42.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 -- 172.21.15.172:0/1023273553 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad6406b500 msgr2=0x7fad6406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad6406b500 0x7fad6406d9c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fad780b6920 tx=0x7fad68008040 comp rx=0 tx=0).stop 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 -- 172.21.15.172:0/1023273553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad780d2e90 msgr2=0x7fad781f6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad780d2e90 0x7fad781f6ab0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fad6c035040 tx=0x7fad6c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 -- 172.21.15.172:0/1023273553 shutdown_connections 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad6406b500 0x7fad6406d9c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad7815dd30 0x7fad780c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad780d2e90 0x7fad781f6ab0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 --2- 172.21.15.172:0/1023273553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad780b9770 0x7fad780b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 -- 172.21.15.172:0/1023273553 >> 172.21.15.172:0/1023273553 conn(0x7fad78061c30 msgr2=0x7fad780b7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 -- 172.21.15.172:0/1023273553 shutdown_connections 2024-04-25T08:49:42.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.389+0000 7fad7ddce640 1 -- 172.21.15.172:0/1023273553 wait complete. 2024-04-25T08:49:42.391 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T08:49:42.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:49:42.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.497+0000 7fd7a4bce640 1 Processor -- start 2024-04-25T08:49:42.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.497+0000 7fd7a4bce640 1 -- start start 2024-04-25T08:49:42.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd7a4bce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7a00b3410 0x7fd7a00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd7a4bce640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd7a00b37f0 0x7fd7a00b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd7a4bce640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a00ace70 con 0x7fd7a00b41b0 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd7a4bce640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a006df30 con 0x7fd7a00b37f0 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd7a4bce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00726d0 con 0x7fd7a00b3410 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd797fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd7a00b37f0 0x7fd7a00b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd797fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd7a00b37f0 0x7fd7a00b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56598/0 (socket says 172.21.15.172:56598) 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd797fff640 1 -- 172.21.15.172:0/1440745751 learned_addr learned my addr 172.21.15.172:0/1440745751 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd79e59c640 1 --2- 172.21.15.172:0/1440745751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7a00b3410 0x7fd7a00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd797fff640 1 -- 172.21.15.172:0/1440745751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7a00b3410 msgr2=0x7fd7a00720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd797fff640 1 --2- 172.21.15.172:0/1440745751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7a00b3410 0x7fd7a00720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd797fff640 1 -- 172.21.15.172:0/1440745751 >> v1:172.21.15.186:6789/0 conn(0x7fd7a00b41b0 legacy=0x7fd7a0161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.498+0000 7fd797fff640 1 -- 172.21.15.172:0/1440745751 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a006d8e0 con 0x7fd7a00b37f0 2024-04-25T08:49:42.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.499+0000 7fd797fff640 1 --2- 172.21.15.172:0/1440745751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 0x7fd7a00b3c70 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd788009870 tx=0x7fd78802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e581fa4ddacc11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.499+0000 7fd79dd9b640 1 -- 172.21.15.172:0/1440745751 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788037070 con 0x7fd7a00b37f0 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.499+0000 7fd79dd9b640 1 -- 172.21.15.172:0/1440745751 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd788032440 con 0x7fd7a00b37f0 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.499+0000 7fd79dd9b640 1 -- 172.21.15.172:0/1440745751 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788032810 con 0x7fd7a00b37f0 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.500+0000 7fd7a4bce640 1 -- 172.21.15.172:0/1440745751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 msgr2=0x7fd7a00b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.500+0000 7fd7a4bce640 1 --2- 172.21.15.172:0/1440745751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 0x7fd7a00b3c70 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd788009870 tx=0x7fd78802a210 comp rx=0 tx=0).stop 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.500+0000 7fd7a4bce640 1 -- 172.21.15.172:0/1440745751 shutdown_connections 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.500+0000 7fd7a4bce640 1 --2- 172.21.15.172:0/1440745751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 0x7fd7a00b3c70 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.500+0000 7fd7a4bce640 1 --2- 172.21.15.172:0/1440745751 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7a00b3410 0x7fd7a00720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.500+0000 7fd7a4bce640 1 -- 172.21.15.172:0/1440745751 >> 172.21.15.172:0/1440745751 conn(0x7fd7a00cfae0 msgr2=0x7fd7a00cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.500+0000 7fd7a4bce640 1 -- 172.21.15.172:0/1440745751 shutdown_connections 2024-04-25T08:49:42.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.500+0000 7fd7a4bce640 1 -- 172.21.15.172:0/1440745751 wait complete. 2024-04-25T08:49:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.501+0000 7fd7a4bce640 1 Processor -- start 2024-04-25T08:49:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.501+0000 7fd7a4bce640 1 -- start start 2024-04-25T08:49:42.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd7a4bce640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7a00b3410 0x7fd7a013b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd7a4bce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 0x7fd7a013e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd7a4bce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7a00b41b0 0x7fd7a0144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd7a4bce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a006f3d0 con 0x7fd7a00b37f0 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd7a4bce640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a0147890 con 0x7fd7a00b3410 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd7a4bce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a006f550 con 0x7fd7a00b41b0 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd797fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 0x7fd7a013e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd797fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 0x7fd7a013e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56602/0 (socket says 172.21.15.172:56602) 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd797fff640 1 -- 172.21.15.172:0/3976813704 learned_addr learned my addr 172.21.15.172:0/3976813704 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd79e59c640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7a00b3410 0x7fd7a013b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd79ed9d640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7a00b41b0 0x7fd7a0144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd797fff640 1 -- 172.21.15.172:0/3976813704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7a00b41b0 msgr2=0x7fd7a0144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd797fff640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7a00b41b0 0x7fd7a0144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd797fff640 1 -- 172.21.15.172:0/3976813704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7a00b3410 msgr2=0x7fd7a013b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd797fff640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7a00b3410 0x7fd7a013b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd797fff640 1 -- 172.21.15.172:0/3976813704 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a0143a30 con 0x7fd7a00b37f0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd79e59c640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7a00b3410 0x7fd7a013b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd797fff640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 0x7fd7a013e830 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fd788009870 tx=0x7fd7880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd796ffd640 1 -- 172.21.15.172:0/3976813704 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788041070 con 0x7fd7a00b37f0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd796ffd640 1 -- 172.21.15.172:0/3976813704 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78803c870 con 0x7fd7a00b37f0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd796ffd640 1 -- 172.21.15.172:0/3976813704 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788037040 con 0x7fd7a00b37f0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd7a4bce640 1 -- 172.21.15.172:0/3976813704 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a0143d10 con 0x7fd7a00b37f0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.502+0000 7fd7a4bce640 1 -- 172.21.15.172:0/3976813704 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a01442d0 con 0x7fd7a00b37f0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.503+0000 7fd7a4bce640 1 -- 172.21.15.172:0/3976813704 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a0147230 con 0x7fd7a00b37f0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.504+0000 7fd796ffd640 1 -- 172.21.15.172:0/3976813704 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd788044070 con 0x7fd7a00b37f0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.504+0000 7fd796ffd640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd78006b4d0 0x7fd78006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.504+0000 7fd796ffd640 1 -- 172.21.15.172:0/3976813704 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd7880ab0c0 con 0x7fd7a00b37f0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.504+0000 7fd79e59c640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd78006b4d0 0x7fd78006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:42.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.505+0000 7fd79e59c640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd78006b4d0 0x7fd78006d990 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd790006fd0 tx=0x7fd790008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:42.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.508+0000 7fd796ffd640 1 -- 172.21.15.172:0/3976813704 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd7a0147230 con 0x7fd7a00b37f0 2024-04-25T08:49:42.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.745+0000 7fd7a4bce640 1 -- 172.21.15.172:0/3976813704 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd7a0073990 con 0x7fd7a00b37f0 2024-04-25T08:49:42.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.745+0000 7fd796ffd640 1 -- 172.21.15.172:0/3976813704 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1596 (secure 0 0 0) 0x7fd7a00ace70 con 0x7fd7a00b37f0 2024-04-25T08:49:42.736 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:42.736 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":458,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":946,"data_bytes":968550751,"bytes_used":2286870528,"bytes_avail":770807242752,"bytes_total":773094113280,"write_bytes_sec":80655193,"read_op_per_sec":0,"write_op_per_sec":78},"fsmap":{"epoch":62,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":8124}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-04-25T08:49:38.601434+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T08:49:42.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 -- 172.21.15.172:0/3976813704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd78006b4d0 msgr2=0x7fd78006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd78006b4d0 0x7fd78006d990 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd790006fd0 tx=0x7fd790008040 comp rx=0 tx=0).stop 2024-04-25T08:49:42.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 -- 172.21.15.172:0/3976813704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 msgr2=0x7fd7a013e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:42.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 0x7fd7a013e830 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fd788009870 tx=0x7fd7880046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 -- 172.21.15.172:0/3976813704 shutdown_connections 2024-04-25T08:49:42.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd78006b4d0 0x7fd78006d990 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7a00b41b0 0x7fd7a0144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7a00b37f0 0x7fd7a013e830 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 --2- 172.21.15.172:0/3976813704 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7a00b3410 0x7fd7a013b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:42.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 -- 172.21.15.172:0/3976813704 >> 172.21.15.172:0/3976813704 conn(0x7fd7a00cfae0 msgr2=0x7fd7a006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:42.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 -- 172.21.15.172:0/3976813704 shutdown_connections 2024-04-25T08:49:42.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:42.747+0000 7fd7a4bce640 1 -- 172.21.15.172:0/3976813704 wait complete. 2024-04-25T08:49:42.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T08:49:43.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:43.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.870+0000 7fad9b77e640 1 Processor -- start 2024-04-25T08:49:43.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.870+0000 7fad9b77e640 1 -- start start 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad9b77e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fad9415dc90 0x7fad941625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad9b77e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fad940cc8e0 0x7fad9415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad9b77e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9415f390 con 0x7fad940d1810 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad9b77e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad940cce50 con 0x7fad940cc8e0 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad9b77e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad94161af0 con 0x7fad9415dc90 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad98d19640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fad940cc8e0 0x7fad9415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad98d19640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fad940cc8e0 0x7fad9415ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56618/0 (socket says 172.21.15.172:56618) 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad98d19640 1 -- 172.21.15.172:0/2075236116 learned_addr learned my addr 172.21.15.172:0/2075236116 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad99d1b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fad940d1810 0x7fad940cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51292/0 (socket says 172.21.15.172:51292) 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad9951a640 1 --2- 172.21.15.172:0/2075236116 >> v2:172.21.15.186:3300/0 conn(0x7fad9415dc90 0x7fad941625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad98d19640 1 -- 172.21.15.172:0/2075236116 >> v2:172.21.15.186:3300/0 conn(0x7fad9415dc90 msgr2=0x7fad941625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:43.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad98d19640 1 --2- 172.21.15.172:0/2075236116 >> v2:172.21.15.186:3300/0 conn(0x7fad9415dc90 0x7fad941625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad98d19640 1 -- 172.21.15.172:0/2075236116 >> v1:172.21.15.172:6789/0 conn(0x7fad940d1810 legacy=0x7fad940cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad93fff640 1 -- 172.21.15.172:0/2075236116 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618763878 0 0) 0x7fad84001490 con 0x7fad940d1810 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.871+0000 7fad98d19640 1 -- 172.21.15.172:0/2075236116 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad94161dd0 con 0x7fad940cc8e0 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.872+0000 7fad9951a640 1 --2- 172.21.15.172:0/2075236116 >> v2:172.21.15.186:3300/0 conn(0x7fad9415dc90 0x7fad941625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.872+0000 7fad98d19640 1 --2- 172.21.15.172:0/2075236116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad940cc8e0 0x7fad9415ee50 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fad9406b820 tx=0x7fad8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992524f3c6a7f32a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.872+0000 7fad93fff640 1 -- 172.21.15.172:0/2075236116 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88037070 con 0x7fad940cc8e0 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.872+0000 7fad93fff640 1 -- 172.21.15.172:0/2075236116 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88032440 con 0x7fad940cc8e0 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.872+0000 7fad93fff640 1 -- 172.21.15.172:0/2075236116 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88032810 con 0x7fad940cc8e0 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.873+0000 7fad9b77e640 1 -- 172.21.15.172:0/2075236116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad940cc8e0 msgr2=0x7fad9415ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.873+0000 7fad9b77e640 1 --2- 172.21.15.172:0/2075236116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad940cc8e0 0x7fad9415ee50 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fad9406b820 tx=0x7fad8802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:49:43.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.873+0000 7fad9b77e640 1 -- 172.21.15.172:0/2075236116 shutdown_connections 2024-04-25T08:49:43.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.873+0000 7fad9b77e640 1 --2- 172.21.15.172:0/2075236116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad940cc8e0 0x7fad9415ee50 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:43.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.873+0000 7fad9b77e640 1 --2- 172.21.15.172:0/2075236116 >> v2:172.21.15.186:3300/0 conn(0x7fad9415dc90 0x7fad941625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:43.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.873+0000 7fad9b77e640 1 -- 172.21.15.172:0/2075236116 >> 172.21.15.172:0/2075236116 conn(0x7fad9406f590 msgr2=0x7fad9406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:43.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.873+0000 7fad9b77e640 1 -- 172.21.15.172:0/2075236116 shutdown_connections 2024-04-25T08:49:43.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.873+0000 7fad9b77e640 1 -- 172.21.15.172:0/2075236116 wait complete. 2024-04-25T08:49:43.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.874+0000 7fad9b77e640 1 Processor -- start 2024-04-25T08:49:43.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.874+0000 7fad9b77e640 1 -- start start 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad9b77e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad940cc8e0 0x7fad9415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad9b77e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad940d1810 0x7fad940ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad9b77e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad9415dc90 0x7fad9415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad9b77e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9415e070 con 0x7fad9415dc90 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad9b77e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940cd130 con 0x7fad940cc8e0 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad9b77e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9415e1f0 con 0x7fad940d1810 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad99d1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad9415dc90 0x7fad9415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad99d1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad9415dc90 0x7fad9415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56622/0 (socket says 172.21.15.172:56622) 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad99d1b640 1 -- 172.21.15.172:0/1609089756 learned_addr learned my addr 172.21.15.172:0/1609089756 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad99d1b640 1 -- 172.21.15.172:0/1609089756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad940d1810 msgr2=0x7fad940ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad99d1b640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad940d1810 0x7fad940ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad99d1b640 1 -- 172.21.15.172:0/1609089756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad940cc8e0 msgr2=0x7fad9415bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad99d1b640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad940cc8e0 0x7fad9415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.875+0000 7fad99d1b640 1 -- 172.21.15.172:0/1609089756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad941f75c0 con 0x7fad9415dc90 2024-04-25T08:49:43.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.876+0000 7fad99d1b640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad9415dc90 0x7fad9415a9a0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fad8400c710 tx=0x7fad8400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.876+0000 7fad91ffb640 1 -- 172.21.15.172:0/1609089756 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84018070 con 0x7fad9415dc90 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.876+0000 7fad91ffb640 1 -- 172.21.15.172:0/1609089756 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8400ce20 con 0x7fad9415dc90 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.876+0000 7fad9b77e640 1 -- 172.21.15.172:0/1609089756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad940caab0 con 0x7fad9415dc90 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.876+0000 7fad91ffb640 1 -- 172.21.15.172:0/1609089756 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8400a880 con 0x7fad9415dc90 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.876+0000 7fad9b77e640 1 -- 172.21.15.172:0/1609089756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad941f7e40 con 0x7fad9415dc90 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.877+0000 7fad9b77e640 1 -- 172.21.15.172:0/1609089756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad94073990 con 0x7fad9415dc90 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.877+0000 7fad91ffb640 1 -- 172.21.15.172:0/1609089756 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fad8401b070 con 0x7fad9415dc90 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.878+0000 7fad91ffb640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad8006b4d0 0x7fad8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.878+0000 7fad91ffb640 1 -- 172.21.15.172:0/1609089756 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fad84089830 con 0x7fad9415dc90 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.878+0000 7fad9951a640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad8006b4d0 0x7fad8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:43.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.878+0000 7fad9951a640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad8006b4d0 0x7fad8006d990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006fd0 tx=0x7fad8c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:43.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:43.882+0000 7fad91ffb640 1 -- 172.21.15.172:0/1609089756 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad9415f390 con 0x7fad9415dc90 2024-04-25T08:49:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.086+0000 7fad9b77e640 1 -- 172.21.15.172:0/1609089756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad940cf6b0 con 0x7fad9415dc90 2024-04-25T08:49:44.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.087+0000 7fad91ffb640 1 -- 172.21.15.172:0/1609089756 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fad840585b0 con 0x7fad9415dc90 2024-04-25T08:49:44.078 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:44.078 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:44.078 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 -- 172.21.15.172:0/1609089756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad8006b4d0 msgr2=0x7fad8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad8006b4d0 0x7fad8006d990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fad8c006fd0 tx=0x7fad8c008040 comp rx=0 tx=0).stop 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 -- 172.21.15.172:0/1609089756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad9415dc90 msgr2=0x7fad9415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad9415dc90 0x7fad9415a9a0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fad8400c710 tx=0x7fad8400cbd0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 -- 172.21.15.172:0/1609089756 shutdown_connections 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fad8006b4d0 0x7fad8006d990 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad9415dc90 0x7fad9415a9a0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fad940d1810 0x7fad940ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 --2- 172.21.15.172:0/1609089756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad940cc8e0 0x7fad9415bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 -- 172.21.15.172:0/1609089756 >> 172.21.15.172:0/1609089756 conn(0x7fad9406f590 msgr2=0x7fad9406d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:44.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 -- 172.21.15.172:0/1609089756 shutdown_connections 2024-04-25T08:49:44.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.089+0000 7fad9b77e640 1 -- 172.21.15.172:0/1609089756 wait complete. 2024-04-25T08:49:44.090 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T08:49:44.091 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:49:44.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.196+0000 7f0225fed640 1 Processor -- start 2024-04-25T08:49:44.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.197+0000 7f0225fed640 1 -- start start 2024-04-25T08:49:44.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.197+0000 7f0225fed640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f022015dd30 0x7f02200b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:44.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.197+0000 7f0225fed640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200d0ad0 0x7f02200b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:44.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.197+0000 7f0225fed640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02200d1df0 con 0x7f02200b9770 2024-04-25T08:49:44.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.197+0000 7f0225fed640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02200d20d0 con 0x7f022015dd30 2024-04-25T08:49:44.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.197+0000 7f0225fed640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02200d23b0 con 0x7f02200d0ad0 2024-04-25T08:49:44.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.198+0000 7f021f7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f022015dd30 0x7f02200b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:44.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.198+0000 7f021ffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200d0ad0 0x7f02200b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:44.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.198+0000 7f0217fff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f02200b9770 0x7f02200d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:58054/0 (socket says 172.21.15.172:58054) 2024-04-25T08:49:44.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.198+0000 7f021f7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f022015dd30 0x7f02200b9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:60122/0 (socket says 172.21.15.172:60122) 2024-04-25T08:49:44.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.198+0000 7f0217fff640 1 -- 172.21.15.172:0/3495770416 learned_addr learned my addr 172.21.15.172:0/3495770416 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:44.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.198+0000 7f021ffff640 1 -- 172.21.15.172:0/3495770416 >> v2:172.21.15.186:3300/0 conn(0x7f022015dd30 msgr2=0x7f02200b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:44.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.198+0000 7f021ffff640 1 --2- 172.21.15.172:0/3495770416 >> v2:172.21.15.186:3300/0 conn(0x7f022015dd30 0x7f02200b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.198+0000 7f021ffff640 1 -- 172.21.15.172:0/3495770416 >> v1:172.21.15.186:6789/0 conn(0x7f02200b9770 legacy=0x7f02200d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:44.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.198+0000 7f021ffff640 1 -- 172.21.15.172:0/3495770416 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02200d2690 con 0x7f02200d0ad0 2024-04-25T08:49:44.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.198+0000 7f021f7fe640 1 --2- 172.21.15.172:0/3495770416 >> v2:172.21.15.186:3300/0 conn(0x7f022015dd30 0x7f02200b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:44.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.199+0000 7f021ffff640 1 --2- 172.21.15.172:0/3495770416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200d0ad0 0x7f02200b6a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0218009d90 tx=0x7f021802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41039d7624a02f65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:44.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.199+0000 7f021effd640 1 -- 172.21.15.172:0/3495770416 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218031600 con 0x7f02200d0ad0 2024-04-25T08:49:44.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.199+0000 7f021effd640 1 -- 172.21.15.172:0/3495770416 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02180317a0 con 0x7f02200d0ad0 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.199+0000 7f021effd640 1 -- 172.21.15.172:0/3495770416 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218031b70 con 0x7f02200d0ad0 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.199+0000 7f0225fed640 1 -- 172.21.15.172:0/3495770416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200d0ad0 msgr2=0x7f02200b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.199+0000 7f0225fed640 1 --2- 172.21.15.172:0/3495770416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200d0ad0 0x7f02200b6a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0218009d90 tx=0x7f021802a5d0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.200+0000 7f0225fed640 1 -- 172.21.15.172:0/3495770416 shutdown_connections 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.200+0000 7f0225fed640 1 --2- 172.21.15.172:0/3495770416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200d0ad0 0x7f02200b6a40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.200+0000 7f0225fed640 1 --2- 172.21.15.172:0/3495770416 >> v2:172.21.15.186:3300/0 conn(0x7f022015dd30 0x7f02200b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.200+0000 7f0225fed640 1 -- 172.21.15.172:0/3495770416 >> 172.21.15.172:0/3495770416 conn(0x7f0220061c30 msgr2=0x7f022006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.200+0000 7f0225fed640 1 -- 172.21.15.172:0/3495770416 shutdown_connections 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.200+0000 7f0225fed640 1 -- 172.21.15.172:0/3495770416 wait complete. 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.201+0000 7f0225fed640 1 Processor -- start 2024-04-25T08:49:44.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.201+0000 7f0225fed640 1 -- start start 2024-04-25T08:49:44.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.201+0000 7f0225fed640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200b9770 0x7f02200b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:44.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.201+0000 7f0225fed640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02200d0ad0 0x7f022014bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:44.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.201+0000 7f0225fed640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015dd30 0x7f02201f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:44.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f0225fed640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200d1b90 con 0x7f022015dd30 2024-04-25T08:49:44.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f0225fed640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200d1a10 con 0x7f02200d0ad0 2024-04-25T08:49:44.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f0225fed640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02200d2e90 con 0x7f02200b9770 2024-04-25T08:49:44.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015dd30 0x7f02201f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:44.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015dd30 0x7f02201f3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56638/0 (socket says 172.21.15.172:56638) 2024-04-25T08:49:44.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021ffff640 1 -- 172.21.15.172:0/3080096016 learned_addr learned my addr 172.21.15.172:0/3080096016 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f0217fff640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02200d0ad0 0x7f022014bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021f7fe640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200b9770 0x7f02200b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021ffff640 1 -- 172.21.15.172:0/3080096016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200b9770 msgr2=0x7f02200b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021ffff640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200b9770 0x7f02200b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021ffff640 1 -- 172.21.15.172:0/3080096016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02200d0ad0 msgr2=0x7f022014bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021ffff640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02200d0ad0 0x7f022014bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021ffff640 1 -- 172.21.15.172:0/3080096016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02200b4240 con 0x7f022015dd30 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021ffff640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015dd30 0x7f02201f3bc0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f0218009eb0 tx=0x7f0218004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021cff9640 1 -- 172.21.15.172:0/3080096016 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218040070 con 0x7f022015dd30 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021cff9640 1 -- 172.21.15.172:0/3080096016 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0218030b60 con 0x7f022015dd30 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f0225fed640 1 -- 172.21.15.172:0/3080096016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02200b44e0 con 0x7f022015dd30 2024-04-25T08:49:44.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f021cff9640 1 -- 172.21.15.172:0/3080096016 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218009450 con 0x7f022015dd30 2024-04-25T08:49:44.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.202+0000 7f0225fed640 1 -- 172.21.15.172:0/3080096016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02200b4aa0 con 0x7f022015dd30 2024-04-25T08:49:44.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.203+0000 7f0225fed640 1 -- 172.21.15.172:0/3080096016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0220073990 con 0x7f022015dd30 2024-04-25T08:49:44.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.204+0000 7f021cff9640 1 -- 172.21.15.172:0/3080096016 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0218039040 con 0x7f022015dd30 2024-04-25T08:49:44.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.204+0000 7f021cff9640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f020006b500 0x7f020006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:44.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.204+0000 7f021cff9640 1 -- 172.21.15.172:0/3080096016 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f02180ab840 con 0x7f022015dd30 2024-04-25T08:49:44.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.204+0000 7f021f7fe640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f020006b500 0x7f020006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:44.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.205+0000 7f021f7fe640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f020006b500 0x7f020006d9c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0210009560 tx=0x7f0210009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:44.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.208+0000 7f021cff9640 1 -- 172.21.15.172:0/3080096016 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0218079ee0 con 0x7f022015dd30 2024-04-25T08:49:44.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.444+0000 7f0225fed640 1 -- 172.21.15.172:0/3080096016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0220160c60 con 0x7f022015dd30 2024-04-25T08:49:44.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.445+0000 7f021cff9640 1 -- 172.21.15.172:0/3080096016 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7f021807df80 con 0x7f022015dd30 2024-04-25T08:49:44.436 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:44.436 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":460,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2534342656,"bytes_avail":770559770624,"bytes_total":773094113280,"write_bytes_sec":85027646,"read_op_per_sec":0,"write_op_per_sec":83},"fsmap":{"epoch":62,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":8124}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-04-25T08:49:38.601434+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-04-25T08:49:44.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 -- 172.21.15.172:0/3080096016 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f020006b500 msgr2=0x7f020006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:44.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f020006b500 0x7f020006d9c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0210009560 tx=0x7f0210009190 comp rx=0 tx=0).stop 2024-04-25T08:49:44.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 -- 172.21.15.172:0/3080096016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015dd30 msgr2=0x7f02201f3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:44.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015dd30 0x7f02201f3bc0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f0218009eb0 tx=0x7f0218004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:44.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 -- 172.21.15.172:0/3080096016 shutdown_connections 2024-04-25T08:49:44.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f020006b500 0x7f020006d9c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02200d0ad0 0x7f022014bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015dd30 0x7f02201f3bc0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 --2- 172.21.15.172:0/3080096016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02200b9770 0x7f02200b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:44.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 -- 172.21.15.172:0/3080096016 >> 172.21.15.172:0/3080096016 conn(0x7f0220061c30 msgr2=0x7f02200c85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:44.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 -- 172.21.15.172:0/3080096016 shutdown_connections 2024-04-25T08:49:44.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:44.447+0000 7f0225fed640 1 -- 172.21.15.172:0/3080096016 wait complete. 2024-04-25T08:49:44.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'paused'} 2024-04-25T08:49:45.449 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:45.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.568+0000 7f67d00bc640 1 Processor -- start 2024-04-25T08:49:45.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.568+0000 7f67d00bc640 1 -- start start 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67d00bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67c815b320 0x7f67c813d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67d00bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67c80cf620 0x7f67c80cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67d00bc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c8071ed0 con 0x7f67c80cfaa0 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67d00bc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c815a840 con 0x7f67c80cf620 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67d00bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c815ab20 con 0x7f67c815b320 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67cd657640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67c80cf620 0x7f67c80cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67ce659640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f67c80cfaa0 0x7f67c8071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51306/0 (socket says 172.21.15.172:51306) 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67ce659640 1 -- 172.21.15.172:0/1552909915 learned_addr learned my addr 172.21.15.172:0/1552909915 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67cd657640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67c80cf620 0x7f67c80cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56654/0 (socket says 172.21.15.172:56654) 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67cde58640 1 --2- 172.21.15.172:0/1552909915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67c815b320 0x7f67c813d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:45.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67cd657640 1 -- 172.21.15.172:0/1552909915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67c815b320 msgr2=0x7f67c813d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:45.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67cd657640 1 --2- 172.21.15.172:0/1552909915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67c815b320 0x7f67c813d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67cd657640 1 -- 172.21.15.172:0/1552909915 >> v1:172.21.15.172:6789/0 conn(0x7f67c80cfaa0 legacy=0x7f67c8071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:45.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67cd657640 1 -- 172.21.15.172:0/1552909915 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c815ae00 con 0x7f67c80cf620 2024-04-25T08:49:45.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.569+0000 7f67cce56640 1 -- 172.21.15.172:0/1552909915 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120846949 0 0) 0x7f67c8071ed0 con 0x7f67c80cfaa0 2024-04-25T08:49:45.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.570+0000 7f67cd657640 1 --2- 172.21.15.172:0/1552909915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c80cf620 0x7f67c80cbfb0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f67b80097a0 tx=0x7f67b802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a48fe2af33c8e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:45.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.570+0000 7f67cce56640 1 -- 172.21.15.172:0/1552909915 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8037070 con 0x7f67c80cf620 2024-04-25T08:49:45.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.570+0000 7f67cce56640 1 -- 172.21.15.172:0/1552909915 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b802ae50 con 0x7f67c80cf620 2024-04-25T08:49:45.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.570+0000 7f67cce56640 1 -- 172.21.15.172:0/1552909915 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8032660 con 0x7f67c80cf620 2024-04-25T08:49:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.571+0000 7f67d00bc640 1 -- 172.21.15.172:0/1552909915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c80cf620 msgr2=0x7f67c80cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.571+0000 7f67d00bc640 1 --2- 172.21.15.172:0/1552909915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c80cf620 0x7f67c80cbfb0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f67b80097a0 tx=0x7f67b802a100 comp rx=0 tx=0).stop 2024-04-25T08:49:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.571+0000 7f67d00bc640 1 -- 172.21.15.172:0/1552909915 shutdown_connections 2024-04-25T08:49:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.571+0000 7f67d00bc640 1 --2- 172.21.15.172:0/1552909915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c80cf620 0x7f67c80cbfb0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.571+0000 7f67d00bc640 1 --2- 172.21.15.172:0/1552909915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67c815b320 0x7f67c813d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.571+0000 7f67d00bc640 1 -- 172.21.15.172:0/1552909915 >> 172.21.15.172:0/1552909915 conn(0x7f67c806abe0 msgr2=0x7f67c806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.571+0000 7f67d00bc640 1 -- 172.21.15.172:0/1552909915 shutdown_connections 2024-04-25T08:49:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.571+0000 7f67d00bc640 1 -- 172.21.15.172:0/1552909915 wait complete. 2024-04-25T08:49:45.565 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.572+0000 7f67d00bc640 1 Processor -- start 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.572+0000 7f67d00bc640 1 -- start start 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67d00bc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c80cf620 0x7f67c81f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67d00bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67c80cfaa0 0x7f67c8139f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67d00bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c815b320 0x7f67c80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67d00bc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c80cc4f0 con 0x7f67c815b320 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67d00bc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c8071b90 con 0x7f67c80cf620 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67d00bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c80cc670 con 0x7f67c80cfaa0 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67ce659640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c815b320 0x7f67c80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67ce659640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c815b320 0x7f67c80cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56660/0 (socket says 172.21.15.172:56660) 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67ce659640 1 -- 172.21.15.172:0/278753543 learned_addr learned my addr 172.21.15.172:0/278753543 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67cde58640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c80cf620 0x7f67c81f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67cd657640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67c80cfaa0 0x7f67c8139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:45.566 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67ce659640 1 -- 172.21.15.172:0/278753543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67c80cfaa0 msgr2=0x7f67c8139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67ce659640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67c80cfaa0 0x7f67c8139f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67ce659640 1 -- 172.21.15.172:0/278753543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c80cf620 msgr2=0x7f67c81f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67ce659640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c80cf620 0x7f67c81f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67ce659640 1 -- 172.21.15.172:0/278753543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c80b4b30 con 0x7f67c815b320 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67cde58640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c80cf620 0x7f67c81f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.573+0000 7f67ce659640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c815b320 0x7f67c80cd500 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f67c000c780 tx=0x7f67c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.574+0000 7f67be7fc640 1 -- 172.21.15.172:0/278753543 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0018070 con 0x7f67c815b320 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.574+0000 7f67be7fc640 1 -- 172.21.15.172:0/278753543 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c000a640 con 0x7f67c815b320 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.574+0000 7f67d00bc640 1 -- 172.21.15.172:0/278753543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c81456f0 con 0x7f67c815b320 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.574+0000 7f67be7fc640 1 -- 172.21.15.172:0/278753543 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c000aab0 con 0x7f67c815b320 2024-04-25T08:49:45.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.574+0000 7f67d00bc640 1 -- 172.21.15.172:0/278753543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c8144c10 con 0x7f67c815b320 2024-04-25T08:49:45.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.575+0000 7f67d00bc640 1 -- 172.21.15.172:0/278753543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c8073990 con 0x7f67c815b320 2024-04-25T08:49:45.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.575+0000 7f67be7fc640 1 -- 172.21.15.172:0/278753543 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f67c001b070 con 0x7f67c815b320 2024-04-25T08:49:45.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.576+0000 7f67be7fc640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67ac06b4d0 0x7f67ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.576+0000 7f67cde58640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67ac06b4d0 0x7f67ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:45.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.576+0000 7f67be7fc640 1 -- 172.21.15.172:0/278753543 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f67c0089920 con 0x7f67c815b320 2024-04-25T08:49:45.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.576+0000 7f67cde58640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67ac06b4d0 0x7f67ac06d990 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f67c4006fd0 tx=0x7f67c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:45.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.580+0000 7f67be7fc640 1 -- 172.21.15.172:0/278753543 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67c80b4b30 con 0x7f67c815b320 2024-04-25T08:49:45.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.791+0000 7f67d00bc640 1 -- 172.21.15.172:0/278753543 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67c8071440 con 0x7f67c815b320 2024-04-25T08:49:45.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.792+0000 7f67be7fc640 1 -- 172.21.15.172:0/278753543 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f67c00586a0 con 0x7f67c815b320 2024-04-25T08:49:45.783 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:45.783 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:45.783 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:45.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 -- 172.21.15.172:0/278753543 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67ac06b4d0 msgr2=0x7f67ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:45.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67ac06b4d0 0x7f67ac06d990 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f67c4006fd0 tx=0x7f67c4008040 comp rx=0 tx=0).stop 2024-04-25T08:49:45.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 -- 172.21.15.172:0/278753543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c815b320 msgr2=0x7f67c80cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:45.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c815b320 0x7f67c80cd500 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f67c000c780 tx=0x7f67c000cc40 comp rx=0 tx=0).stop 2024-04-25T08:49:45.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 -- 172.21.15.172:0/278753543 shutdown_connections 2024-04-25T08:49:45.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f67ac06b4d0 0x7f67ac06d990 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67c815b320 0x7f67c80cd500 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67c80cfaa0 0x7f67c8139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 --2- 172.21.15.172:0/278753543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c80cf620 0x7f67c81f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 -- 172.21.15.172:0/278753543 >> 172.21.15.172:0/278753543 conn(0x7f67c806abe0 msgr2=0x7f67c8158250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:45.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 -- 172.21.15.172:0/278753543 shutdown_connections 2024-04-25T08:49:45.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.794+0000 7f67d00bc640 1 -- 172.21.15.172:0/278753543 wait complete. 2024-04-25T08:49:45.795 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-04-25T08:49:45.796 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:49:45.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.902+0000 7fca4f24d640 1 Processor -- start 2024-04-25T08:49:45.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.902+0000 7fca4f24d640 1 -- start start 2024-04-25T08:49:45.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca4f24d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca480cfec0 0x7fca480cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca4f24d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca48071480 con 0x7fca480ce3c0 2024-04-25T08:49:45.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca4f24d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca48071760 con 0x7fca48154ee0 2024-04-25T08:49:45.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca4f24d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca480ce830 con 0x7fca480cfec0 2024-04-25T08:49:45.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca47fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca480cfec0 0x7fca480cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:45.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca4d7ea640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fca480ce3c0 0x7fca4806d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51314/0 (socket says 172.21.15.172:51314) 2024-04-25T08:49:45.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca4d7ea640 1 -- 172.21.15.172:0/491654321 learned_addr learned my addr 172.21.15.172:0/491654321 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:45.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca47fff640 1 -- 172.21.15.172:0/491654321 >> v1:172.21.15.186:6789/0 conn(0x7fca48154ee0 legacy=0x7fca480cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:45.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca47fff640 1 -- 172.21.15.172:0/491654321 >> v1:172.21.15.172:6789/0 conn(0x7fca480ce3c0 legacy=0x7fca4806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:45.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca477fe640 1 -- 172.21.15.172:0/491654321 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453596301 0 0) 0x7fca48071480 con 0x7fca480ce3c0 2024-04-25T08:49:45.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.903+0000 7fca47fff640 1 -- 172.21.15.172:0/491654321 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca48071a40 con 0x7fca480cfec0 2024-04-25T08:49:45.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.904+0000 7fca47fff640 1 --2- 172.21.15.172:0/491654321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca480cfec0 0x7fca480cde80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fca340097a0 tx=0x7fca3402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceea31f6a746f97c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:45.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.904+0000 7fca477fe640 1 -- 172.21.15.172:0/491654321 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34037070 con 0x7fca480cfec0 2024-04-25T08:49:45.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.904+0000 7fca477fe640 1 -- 172.21.15.172:0/491654321 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca34032440 con 0x7fca480cfec0 2024-04-25T08:49:45.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.904+0000 7fca477fe640 1 -- 172.21.15.172:0/491654321 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34032810 con 0x7fca480cfec0 2024-04-25T08:49:45.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.905+0000 7fca4f24d640 1 -- 172.21.15.172:0/491654321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca480cfec0 msgr2=0x7fca480cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:45.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.905+0000 7fca4f24d640 1 --2- 172.21.15.172:0/491654321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca480cfec0 0x7fca480cde80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fca340097a0 tx=0x7fca3402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.905+0000 7fca4f24d640 1 -- 172.21.15.172:0/491654321 shutdown_connections 2024-04-25T08:49:45.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.905+0000 7fca4f24d640 1 --2- 172.21.15.172:0/491654321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca480cfec0 0x7fca480cde80 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.905+0000 7fca4f24d640 1 -- 172.21.15.172:0/491654321 >> 172.21.15.172:0/491654321 conn(0x7fca4806abe0 msgr2=0x7fca4806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:45.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.905+0000 7fca4f24d640 1 -- 172.21.15.172:0/491654321 shutdown_connections 2024-04-25T08:49:45.897 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.905+0000 7fca4f24d640 1 -- 172.21.15.172:0/491654321 wait complete. 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.906+0000 7fca4f24d640 1 Processor -- start 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.906+0000 7fca4f24d640 1 -- start start 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4f24d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480ce3c0 0x7fca48156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4f24d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca480cfec0 0x7fca481555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4f24d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca48154ee0 0x7fca481e3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4f24d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca48071230 con 0x7fca48154ee0 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4f24d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca481552c0 con 0x7fca480cfec0 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4f24d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca48155440 con 0x7fca480ce3c0 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4d7ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca48154ee0 0x7fca481e3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4d7ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca48154ee0 0x7fca481e3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56678/0 (socket says 172.21.15.172:56678) 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4d7ea640 1 -- 172.21.15.172:0/2397825805 learned_addr learned my addr 172.21.15.172:0/2397825805 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4d7ea640 1 -- 172.21.15.172:0/2397825805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480ce3c0 msgr2=0x7fca48156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:45.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4d7ea640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480ce3c0 0x7fca48156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4d7ea640 1 -- 172.21.15.172:0/2397825805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca480cfec0 msgr2=0x7fca481555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:45.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4d7ea640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca480cfec0 0x7fca481555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:45.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4d7ea640 1 -- 172.21.15.172:0/2397825805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca48155cd0 con 0x7fca48154ee0 2024-04-25T08:49:45.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4d7ea640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca48154ee0 0x7fca481e3180 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c810 tx=0x7fca4000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:45.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca457fa640 1 -- 172.21.15.172:0/2397825805 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40018070 con 0x7fca48154ee0 2024-04-25T08:49:45.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca457fa640 1 -- 172.21.15.172:0/2397825805 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4000a640 con 0x7fca48154ee0 2024-04-25T08:49:45.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4f24d640 1 -- 172.21.15.172:0/2397825805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca48155fb0 con 0x7fca48154ee0 2024-04-25T08:49:45.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca457fa640 1 -- 172.21.15.172:0/2397825805 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000aa30 con 0x7fca48154ee0 2024-04-25T08:49:45.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.907+0000 7fca4f24d640 1 -- 172.21.15.172:0/2397825805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca48156570 con 0x7fca48154ee0 2024-04-25T08:49:45.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.908+0000 7fca4f24d640 1 -- 172.21.15.172:0/2397825805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca48073990 con 0x7fca48154ee0 2024-04-25T08:49:45.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.909+0000 7fca457fa640 1 -- 172.21.15.172:0/2397825805 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca4001b070 con 0x7fca48154ee0 2024-04-25T08:49:45.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.909+0000 7fca457fa640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca2c06b4d0 0x7fca2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:45.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.909+0000 7fca457fa640 1 -- 172.21.15.172:0/2397825805 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fca40089990 con 0x7fca48154ee0 2024-04-25T08:49:45.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.909+0000 7fca4cfe9640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca2c06b4d0 0x7fca2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:45.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.910+0000 7fca4cfe9640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca2c06b4d0 0x7fca2c06d990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fca3c006fd0 tx=0x7fca3c006bc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:45.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:45.913+0000 7fca457fa640 1 -- 172.21.15.172:0/2397825805 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca40058710 con 0x7fca48154ee0 2024-04-25T08:49:46.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.146+0000 7fca4f24d640 1 -- 172.21.15.172:0/2397825805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fca480ae600 con 0x7fca48154ee0 2024-04-25T08:49:46.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.147+0000 7fca457fa640 1 -- 172.21.15.172:0/2397825805 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1575 (secure 0 0 0) 0x7fca40058010 con 0x7fca48154ee0 2024-04-25T08:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":461,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2534342656,"bytes_avail":770559770624,"bytes_total":773094113280,"write_bytes_sec":60127045,"read_op_per_sec":0,"write_op_per_sec":59},"fsmap":{"epoch":62,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":8124}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-04-25T08:49:44.602498+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 -- 172.21.15.172:0/2397825805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca2c06b4d0 msgr2=0x7fca2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca2c06b4d0 0x7fca2c06d990 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fca3c006fd0 tx=0x7fca3c006bc0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 -- 172.21.15.172:0/2397825805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca48154ee0 msgr2=0x7fca481e3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca48154ee0 0x7fca481e3180 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c810 tx=0x7fca4000ccd0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 -- 172.21.15.172:0/2397825805 shutdown_connections 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fca2c06b4d0 0x7fca2c06d990 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca480cfec0 0x7fca481555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca48154ee0 0x7fca481e3180 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 --2- 172.21.15.172:0/2397825805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480ce3c0 0x7fca48156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 -- 172.21.15.172:0/2397825805 >> 172.21.15.172:0/2397825805 conn(0x7fca4806abe0 msgr2=0x7fca480b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 -- 172.21.15.172:0/2397825805 shutdown_connections 2024-04-25T08:49:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.149+0000 7fca4f24d640 1 -- 172.21.15.172:0/2397825805 wait complete. 2024-04-25T08:49:46.151 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T08:49:46.151 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:49:46.151 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:49:46.194 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:49:46.235 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:49:46.235 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:46.235 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:46.250 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:46.251 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:46.306 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:46.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.452+0000 7f05a314f640 1 Processor -- start 2024-04-25T08:49:46.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.452+0000 7f05a314f640 1 -- start start 2024-04-25T08:49:46.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.452+0000 7f05a314f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f059c0b2cb0 0x7f059c0d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.452+0000 7f05a314f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c0b97a0 con 0x7f059c15dbe0 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.452+0000 7f05a314f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c0d1c50 con 0x7f059c0d1020 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.452+0000 7f05a314f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c15dfc0 con 0x7f059c0b2cb0 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f05a0eeb640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f059c15dbe0 0x7f059c0d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51330/0 (socket says 172.21.15.172:51330) 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f05a0eeb640 1 -- 172.21.15.172:0/117429800 learned_addr learned my addr 172.21.15.172:0/117429800 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059bfff640 1 --2- 172.21.15.172:0/117429800 >> v2:172.21.15.186:3300/0 conn(0x7f059c0b2cb0 0x7f059c0d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046803875 0 0) 0x7f059c0b97a0 con 0x7f059c15dbe0 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f058c003520 con 0x7f059c15dbe0 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2500480564 0 0) 0x7f058c003520 con 0x7f059c15dbe0 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 >> v2:172.21.15.186:3300/0 conn(0x7f059c0b2cb0 msgr2=0x7f059c0d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 --2- 172.21.15.172:0/117429800 >> v2:172.21.15.186:3300/0 conn(0x7f059c0b2cb0 0x7f059c0d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 >> v1:172.21.15.186:6789/0 conn(0x7f059c0d1020 legacy=0x7f059c0d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0d1f30 con 0x7f059c15dbe0 2024-04-25T08:49:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f0590001670 con 0x7f059c15dbe0 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 >> v1:172.21.15.172:6789/0 conn(0x7f059c15dbe0 legacy=0x7f059c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f058c0039b0 0x7f058c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f058c004800 0x7f058c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f058c0051c0 0x7f058c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c00c030 con 0x7f058c0039b0 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c00c1e0 con 0x7f058c004800 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c00c3e0 con 0x7f058c0051c0 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059bfff640 1 --2- 172.21.15.172:0/117429800 >> v2:172.21.15.186:3300/0 conn(0x7f059c0b2cb0 0x7f059c0d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f05a0eeb640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f058c0039b0 0x7f058c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f05a16ec640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f058c0051c0 0x7f058c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.453+0000 7f059bfff640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f058c004800 0x7f058c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.454+0000 7f05a0eeb640 1 -- 172.21.15.172:0/117429800 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f058c0051c0 msgr2=0x7f058c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.454+0000 7f05a0eeb640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f058c0051c0 0x7f058c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.454+0000 7f05a0eeb640 1 -- 172.21.15.172:0/117429800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f058c004800 msgr2=0x7f058c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.454+0000 7f05a0eeb640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f058c004800 0x7f058c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.454+0000 7f05a0eeb640 1 -- 172.21.15.172:0/117429800 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c003520 con 0x7f058c0039b0 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.454+0000 7f05a16ec640 1 -- 172.21.15.172:0/117429800 reap_dead start 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.454+0000 7f05a0eeb640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f058c0039b0 0x7f058c003dd0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f059000c240 tx=0x7f058c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e508378568cfaab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.454+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590007d10 con 0x7f058c0039b0 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.454+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0590005ad0 con 0x7f058c0039b0 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.454+0000 7f059b7fe640 1 -- 172.21.15.172:0/117429800 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590007070 con 0x7f058c0039b0 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.455+0000 7f05a314f640 1 -- 172.21.15.172:0/117429800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f058c0039b0 msgr2=0x7f058c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.455+0000 7f05a314f640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f058c0039b0 0x7f058c003dd0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f059000c240 tx=0x7f058c005830 comp rx=0 tx=0).stop 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.455+0000 7f05a314f640 1 -- 172.21.15.172:0/117429800 shutdown_connections 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.455+0000 7f05a314f640 1 --2- 172.21.15.172:0/117429800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f058c0039b0 0x7f058c003dd0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.455+0000 7f05a314f640 1 -- 172.21.15.172:0/117429800 >> 172.21.15.172:0/117429800 conn(0x7f059c061a20 msgr2=0x7f059c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:46.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.455+0000 7f05a314f640 1 -- 172.21.15.172:0/117429800 shutdown_connections 2024-04-25T08:49:46.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.455+0000 7f05a314f640 1 -- 172.21.15.172:0/117429800 wait complete. 2024-04-25T08:49:46.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.456+0000 7f05a314f640 1 Processor -- start 2024-04-25T08:49:46.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.456+0000 7f05a314f640 1 -- start start 2024-04-25T08:49:46.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f05a314f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f058c0039b0 0x7f059c14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f05a314f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0cbe70 0x7f059c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f05a314f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15f550 0x7f059c15f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f05a314f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b92a0 con 0x7f059c0cbe70 2024-04-25T08:49:46.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f05a314f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0d1a00 con 0x7f058c0039b0 2024-04-25T08:49:46.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f05a314f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b9420 con 0x7f059c15f550 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f059bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0cbe70 0x7f059c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f059bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0cbe70 0x7f059c0b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56704/0 (socket says 172.21.15.172:56704) 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f059bfff640 1 -- 172.21.15.172:0/2809434950 learned_addr learned my addr 172.21.15.172:0/2809434950 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f05a16ec640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15f550 0x7f059c15f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f05a0eeb640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f058c0039b0 0x7f059c14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f059bfff640 1 -- 172.21.15.172:0/2809434950 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15f550 msgr2=0x7f059c15f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f059bfff640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15f550 0x7f059c15f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f059bfff640 1 -- 172.21.15.172:0/2809434950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f058c0039b0 msgr2=0x7f059c14c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f059bfff640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f058c0039b0 0x7f059c14c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f059bfff640 1 -- 172.21.15.172:0/2809434950 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c14c700 con 0x7f059c0cbe70 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f05a0eeb640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f058c0039b0 0x7f059c14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f05a16ec640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15f550 0x7f059c15f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.457+0000 7f059bfff640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0cbe70 0x7f059c0b32e0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f0588011830 tx=0x7f0588011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:46.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.458+0000 7f05997fa640 1 -- 172.21.15.172:0/2809434950 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058800fbd0 con 0x7f059c0cbe70 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.458+0000 7f05997fa640 1 -- 172.21.15.172:0/2809434950 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058800fd70 con 0x7f059c0cbe70 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.458+0000 7f05997fa640 1 -- 172.21.15.172:0/2809434950 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588015660 con 0x7f059c0cbe70 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.458+0000 7f05a314f640 1 -- 172.21.15.172:0/2809434950 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c0b3be0 con 0x7f059c0cbe70 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.458+0000 7f05a314f640 1 -- 172.21.15.172:0/2809434950 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c0b4710 con 0x7f059c0cbe70 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.459+0000 7f05a314f640 1 -- 172.21.15.172:0/2809434950 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c073990 con 0x7f059c0cbe70 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.459+0000 7f05997fa640 1 -- 172.21.15.172:0/2809434950 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0588015800 con 0x7f059c0cbe70 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.459+0000 7f05997fa640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f058006b4d0 0x7f058006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.460+0000 7f05997fa640 1 -- 172.21.15.172:0/2809434950 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f058808acc0 con 0x7f059c0cbe70 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.460+0000 7f05a0eeb640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f058006b4d0 0x7f058006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.460+0000 7f05a0eeb640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f058006b4d0 0x7f058006d990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0590033000 tx=0x7f059002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:46.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.464+0000 7f05997fa640 1 -- 172.21.15.172:0/2809434950 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0588019030 con 0x7f059c0cbe70 2024-04-25T08:49:46.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.638+0000 7f05a314f640 1 -- 172.21.15.172:0/2809434950 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f059c0d0ab0 con 0x7f059c0cbe70 2024-04-25T08:49:46.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.639+0000 7f05997fa640 1 -- 172.21.15.172:0/2809434950 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16944 (secure 0 0 0) 0x7f05880599b0 con 0x7f059c0cbe70 2024-04-25T08:49:46.630 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:46.630 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":107,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:18.717539+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:49:15.250034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T08:49:16.013750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:46.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.641+0000 7f05a314f640 1 -- 172.21.15.172:0/2809434950 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f058006b4d0 msgr2=0x7f058006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.641+0000 7f05a314f640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f058006b4d0 0x7f058006d990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0590033000 tx=0x7f059002e000 comp rx=0 tx=0).stop 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.641+0000 7f05a314f640 1 -- 172.21.15.172:0/2809434950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0cbe70 msgr2=0x7f059c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.641+0000 7f05a314f640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0cbe70 0x7f059c0b32e0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f0588011830 tx=0x7f0588011cf0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.641+0000 7f05a314f640 1 -- 172.21.15.172:0/2809434950 shutdown_connections 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.641+0000 7f05a314f640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f058006b4d0 0x7f058006d990 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.641+0000 7f05a314f640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f059c15f550 0x7f059c15f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.641+0000 7f05a314f640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f059c0cbe70 0x7f059c0b32e0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.641+0000 7f05a314f640 1 --2- 172.21.15.172:0/2809434950 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f058c0039b0 0x7f059c14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.641+0000 7f05a314f640 1 -- 172.21.15.172:0/2809434950 >> 172.21.15.172:0/2809434950 conn(0x7f059c061a20 msgr2=0x7f059c0d3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.642+0000 7f05a314f640 1 -- 172.21.15.172:0/2809434950 shutdown_connections 2024-04-25T08:49:46.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.642+0000 7f05a314f640 1 -- 172.21.15.172:0/2809434950 wait complete. 2024-04-25T08:49:46.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:49:15.250034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:49:16.013750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:49:46.644 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:49:46.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.754+0000 7f4c666e1640 1 Processor -- start 2024-04-25T08:49:46.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.754+0000 7f4c666e1640 1 -- start start 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.754+0000 7f4c666e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c6015dc20 0x7f4c600ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c666e1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4c600d32f0 0x7f4c600cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c666e1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6015e000 con 0x7f4c60161710 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c666e1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600d1de0 con 0x7f4c600d32f0 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c666e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60161c60 con 0x7f4c6015dc20 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c5f7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4c60161710 0x7f4c6006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51332/0 (socket says 172.21.15.172:51332) 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c5f7fe640 1 -- 172.21.15.172:0/2240119178 learned_addr learned my addr 172.21.15.172:0/2240119178 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c64c7e640 1 --2- 172.21.15.172:0/2240119178 >> v2:172.21.15.186:3300/0 conn(0x7f4c600d32f0 0x7f4c600cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c5ffff640 1 --2- 172.21.15.172:0/2240119178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c6015dc20 0x7f4c600ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c5effd640 1 -- 172.21.15.172:0/2240119178 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163722864 0 0) 0x7f4c6015e000 con 0x7f4c60161710 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c5effd640 1 -- 172.21.15.172:0/2240119178 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c48003520 con 0x7f4c60161710 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c64c7e640 1 -- 172.21.15.172:0/2240119178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c6015dc20 msgr2=0x7f4c600ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c64c7e640 1 --2- 172.21.15.172:0/2240119178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c6015dc20 0x7f4c600ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c64c7e640 1 -- 172.21.15.172:0/2240119178 >> v1:172.21.15.172:6789/0 conn(0x7f4c60161710 legacy=0x7f4c6006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c5effd640 1 -- 172.21.15.172:0/2240119178 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2979111280 0 0) 0x7f4c48003520 con 0x7f4c60161710 2024-04-25T08:49:46.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c64c7e640 1 -- 172.21.15.172:0/2240119178 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60161f40 con 0x7f4c600d32f0 2024-04-25T08:49:46.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.755+0000 7f4c5ffff640 1 --2- 172.21.15.172:0/2240119178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c6015dc20 0x7f4c600ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:46.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.756+0000 7f4c64c7e640 1 --2- 172.21.15.172:0/2240119178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c600d32f0 0x7f4c600cebb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009d90 tx=0x7f4c5802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2963c9a60708e9bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:46.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.756+0000 7f4c5effd640 1 -- 172.21.15.172:0/2240119178 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c54001670 con 0x7f4c600d32f0 2024-04-25T08:49:46.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.756+0000 7f4c5effd640 1 -- 172.21.15.172:0/2240119178 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c58007540 con 0x7f4c600d32f0 2024-04-25T08:49:46.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.756+0000 7f4c5effd640 1 -- 172.21.15.172:0/2240119178 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58007910 con 0x7f4c600d32f0 2024-04-25T08:49:46.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.757+0000 7f4c666e1640 1 -- 172.21.15.172:0/2240119178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c600d32f0 msgr2=0x7f4c600cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.757+0000 7f4c666e1640 1 --2- 172.21.15.172:0/2240119178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c600d32f0 0x7f4c600cebb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009d90 tx=0x7f4c5802a5f0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.757+0000 7f4c666e1640 1 -- 172.21.15.172:0/2240119178 shutdown_connections 2024-04-25T08:49:46.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.757+0000 7f4c666e1640 1 --2- 172.21.15.172:0/2240119178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c600d32f0 0x7f4c600cebb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.757+0000 7f4c666e1640 1 --2- 172.21.15.172:0/2240119178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c6015dc20 0x7f4c600ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.757+0000 7f4c666e1640 1 -- 172.21.15.172:0/2240119178 >> 172.21.15.172:0/2240119178 conn(0x7f4c600d0420 msgr2=0x7f4c600d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:46.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.757+0000 7f4c666e1640 1 -- 172.21.15.172:0/2240119178 shutdown_connections 2024-04-25T08:49:46.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.757+0000 7f4c666e1640 1 -- 172.21.15.172:0/2240119178 wait complete. 2024-04-25T08:49:46.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.758+0000 7f4c666e1640 1 Processor -- start 2024-04-25T08:49:46.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.758+0000 7f4c666e1640 1 -- start start 2024-04-25T08:49:46.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c666e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c600d32f0 0x7f4c6015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c666e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c6015dc20 0x7f4c600cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c666e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c60161710 0x7f4c600ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c666e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600b5e50 con 0x7f4c60161710 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c666e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60162500 con 0x7f4c6015dc20 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c666e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600b5fd0 con 0x7f4c600d32f0 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c64c7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c60161710 0x7f4c600ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c64c7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c60161710 0x7f4c600ac480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56718/0 (socket says 172.21.15.172:56718) 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c64c7e640 1 -- 172.21.15.172:0/4110032783 learned_addr learned my addr 172.21.15.172:0/4110032783 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c5f7fe640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c6015dc20 0x7f4c600cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c5ffff640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c600d32f0 0x7f4c6015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c64c7e640 1 -- 172.21.15.172:0/4110032783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c600d32f0 msgr2=0x7f4c6015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c64c7e640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c600d32f0 0x7f4c6015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c64c7e640 1 -- 172.21.15.172:0/4110032783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c6015dc20 msgr2=0x7f4c600cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c64c7e640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c6015dc20 0x7f4c600cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c64c7e640 1 -- 172.21.15.172:0/4110032783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600cc230 con 0x7f4c60161710 2024-04-25T08:49:46.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c5f7fe640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c6015dc20 0x7f4c600cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:46.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c64c7e640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c60161710 0x7f4c600ac480 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009eb0 tx=0x7f4c58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:46.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c5cff9640 1 -- 172.21.15.172:0/4110032783 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c58040070 con 0x7f4c60161710 2024-04-25T08:49:46.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c5cff9640 1 -- 172.21.15.172:0/4110032783 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5803c830 con 0x7f4c60161710 2024-04-25T08:49:46.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c666e1640 1 -- 172.21.15.172:0/4110032783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c600cc510 con 0x7f4c60161710 2024-04-25T08:49:46.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.759+0000 7f4c5cff9640 1 -- 172.21.15.172:0/4110032783 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5803cbe0 con 0x7f4c60161710 2024-04-25T08:49:46.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.760+0000 7f4c666e1640 1 -- 172.21.15.172:0/4110032783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c600ccad0 con 0x7f4c60161710 2024-04-25T08:49:46.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.760+0000 7f4c666e1640 1 -- 172.21.15.172:0/4110032783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c60073a00 con 0x7f4c60161710 2024-04-25T08:49:46.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.761+0000 7f4c5cff9640 1 -- 172.21.15.172:0/4110032783 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c58039040 con 0x7f4c60161710 2024-04-25T08:49:46.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.761+0000 7f4c5cff9640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c4c06b4d0 0x7f4c4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:46.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.762+0000 7f4c5ffff640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c4c06b4d0 0x7f4c4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:46.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.762+0000 7f4c5cff9640 1 -- 172.21.15.172:0/4110032783 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4c580abac0 con 0x7f4c60161710 2024-04-25T08:49:46.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.762+0000 7f4c5ffff640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c4c06b4d0 0x7f4c4c06d990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009a30 tx=0x7f4c50008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:46.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.766+0000 7f4c5cff9640 1 -- 172.21.15.172:0/4110032783 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c5807a8d0 con 0x7f4c60161710 2024-04-25T08:49:46.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.937+0000 7f4c666e1640 1 -- 172.21.15.172:0/4110032783 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c600d16b0 con 0x7f4c60161710 2024-04-25T08:49:46.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.938+0000 7f4c5cff9640 1 -- 172.21.15.172:0/4110032783 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c5807a1d0 con 0x7f4c60161710 2024-04-25T08:49:46.929 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:49:46.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 -- 172.21.15.172:0/4110032783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c4c06b4d0 msgr2=0x7f4c4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c4c06b4d0 0x7f4c4c06d990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009a30 tx=0x7f4c50008040 comp rx=0 tx=0).stop 2024-04-25T08:49:46.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 -- 172.21.15.172:0/4110032783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c60161710 msgr2=0x7f4c600ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:46.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c60161710 0x7f4c600ac480 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009eb0 tx=0x7f4c58004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:46.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 -- 172.21.15.172:0/4110032783 shutdown_connections 2024-04-25T08:49:46.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c4c06b4d0 0x7f4c4c06d990 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c6015dc20 0x7f4c600cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c60161710 0x7f4c600ac480 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 --2- 172.21.15.172:0/4110032783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c600d32f0 0x7f4c6015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:46.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 -- 172.21.15.172:0/4110032783 >> 172.21.15.172:0/4110032783 conn(0x7f4c600d0420 msgr2=0x7f4c600b8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:46.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 -- 172.21.15.172:0/4110032783 shutdown_connections 2024-04-25T08:49:46.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:46.940+0000 7f4c666e1640 1 -- 172.21.15.172:0/4110032783 wait complete. 2024-04-25T08:49:46.941 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:49:47.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.051+0000 7fcca739e640 1 Processor -- start 2024-04-25T08:49:47.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.051+0000 7fcca739e640 1 -- start start 2024-04-25T08:49:47.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcca739e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcca00aee60 0x7fcca015c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcca739e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca00af2d0 con 0x7fcca01454a0 2024-04-25T08:49:47.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcca739e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca00af540 con 0x7fcca006b2f0 2024-04-25T08:49:47.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcca739e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00af820 con 0x7fcca00aee60 2024-04-25T08:49:47.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcca513a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcca01454a0 0x7fcca006abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:51344/0 (socket says 172.21.15.172:51344) 2024-04-25T08:49:47.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcca513a640 1 -- 172.21.15.172:0/3679839426 learned_addr learned my addr 172.21.15.172:0/3679839426 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:47.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcca593b640 1 --2- 172.21.15.172:0/3679839426 >> v2:172.21.15.186:3300/0 conn(0x7fcca00aee60 0x7fcca015c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157875873 0 0) 0x7fcca00af2d0 con 0x7fcca01454a0 2024-04-25T08:49:47.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc8c003520 con 0x7fcca01454a0 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1701618466 0 0) 0x7fcc8c003520 con 0x7fcca01454a0 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 >> v2:172.21.15.186:3300/0 conn(0x7fcca00aee60 msgr2=0x7fcca015c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 --2- 172.21.15.172:0/3679839426 >> v2:172.21.15.186:3300/0 conn(0x7fcca00aee60 0x7fcca015c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 >> v1:172.21.15.186:6789/0 conn(0x7fcca006b2f0 legacy=0x7fcca015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca00afb00 con 0x7fcca01454a0 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fcc9c001670 con 0x7fcca01454a0 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 >> v1:172.21.15.172:6789/0 conn(0x7fcca01454a0 legacy=0x7fcca006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc8c0039b0 0x7fcc8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc8c004800 0x7fcc8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8c0051c0 0x7fcc8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00af820 con 0x7fcc8c0051c0 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c00c060 con 0x7fcc8c0039b0 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c00c260 con 0x7fcc8c004800 2024-04-25T08:49:47.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.052+0000 7fcca593b640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8c0051c0 0x7fcc8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca4939640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc8c004800 0x7fcc8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca513a640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc8c0039b0 0x7fcc8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca593b640 1 -- 172.21.15.172:0/3679839426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc8c004800 msgr2=0x7fcc8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca593b640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc8c004800 0x7fcc8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca593b640 1 -- 172.21.15.172:0/3679839426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc8c0039b0 msgr2=0x7fcc8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca593b640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc8c0039b0 0x7fcc8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca593b640 1 -- 172.21.15.172:0/3679839426 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c003520 con 0x7fcc8c0051c0 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca4939640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc8c004800 0x7fcc8c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca513a640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc8c0039b0 0x7fcc8c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca593b640 1 -- 172.21.15.172:0/3679839426 reap_dead start 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcca593b640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8c0051c0 0x7fcc8c00b9c0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009fc0 tx=0x7fcc8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68111e0a57537fe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.053+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98035020 con 0x7fcc8c0051c0 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.054+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc98003bd0 con 0x7fcc8c0051c0 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.054+0000 7fcc97fff640 1 -- 172.21.15.172:0/3679839426 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98009c10 con 0x7fcc8c0051c0 2024-04-25T08:49:47.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.054+0000 7fcca739e640 1 -- 172.21.15.172:0/3679839426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8c0051c0 msgr2=0x7fcc8c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.054+0000 7fcca739e640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8c0051c0 0x7fcc8c00b9c0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009fc0 tx=0x7fcc8c005830 comp rx=0 tx=0).stop 2024-04-25T08:49:47.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.054+0000 7fcca739e640 1 -- 172.21.15.172:0/3679839426 shutdown_connections 2024-04-25T08:49:47.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.054+0000 7fcca739e640 1 --2- 172.21.15.172:0/3679839426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc8c0051c0 0x7fcc8c00b9c0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.054+0000 7fcca739e640 1 -- 172.21.15.172:0/3679839426 >> 172.21.15.172:0/3679839426 conn(0x7fcca00b5af0 msgr2=0x7fcca00b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:47.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.054+0000 7fcca739e640 1 -- 172.21.15.172:0/3679839426 shutdown_connections 2024-04-25T08:49:47.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.054+0000 7fcca739e640 1 -- 172.21.15.172:0/3679839426 wait complete. 2024-04-25T08:49:47.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.055+0000 7fcca739e640 1 Processor -- start 2024-04-25T08:49:47.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.055+0000 7fcca739e640 1 -- start start 2024-04-25T08:49:47.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca739e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc8c0051c0 0x7fcca013b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca739e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcca01f17a0 0x7fcca01432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca739e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca0143820 0x7fcca013d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca739e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015caf0 con 0x7fcca01f17a0 2024-04-25T08:49:47.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca739e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015c970 con 0x7fcca0143820 2024-04-25T08:49:47.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca739e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca015cc70 con 0x7fcc8c0051c0 2024-04-25T08:49:47.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca4939640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcca01f17a0 0x7fcca01432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca4939640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcca01f17a0 0x7fcca01432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56736/0 (socket says 172.21.15.172:56736) 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca4939640 1 -- 172.21.15.172:0/323728842 learned_addr learned my addr 172.21.15.172:0/323728842 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca593b640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca0143820 0x7fcca013d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca513a640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc8c0051c0 0x7fcca013b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca4939640 1 -- 172.21.15.172:0/323728842 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc8c0051c0 msgr2=0x7fcca013b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca4939640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc8c0051c0 0x7fcca013b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca4939640 1 -- 172.21.15.172:0/323728842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca0143820 msgr2=0x7fcca013d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca4939640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca0143820 0x7fcca013d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.056+0000 7fcca4939640 1 -- 172.21.15.172:0/323728842 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca009bbc0 con 0x7fcca01f17a0 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.057+0000 7fcca4939640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcca01f17a0 0x7fcca01432e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000e460 tx=0x7fcc9000e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.057+0000 7fcc95ffb640 1 -- 172.21.15.172:0/323728842 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc900052e0 con 0x7fcca01f17a0 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.057+0000 7fcc95ffb640 1 -- 172.21.15.172:0/323728842 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90018070 con 0x7fcca01f17a0 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.057+0000 7fcca739e640 1 -- 172.21.15.172:0/323728842 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca015b440 con 0x7fcca01f17a0 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.057+0000 7fcc95ffb640 1 -- 172.21.15.172:0/323728842 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90003830 con 0x7fcca01f17a0 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.057+0000 7fcca739e640 1 -- 172.21.15.172:0/323728842 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca009be30 con 0x7fcca01f17a0 2024-04-25T08:49:47.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.058+0000 7fcca739e640 1 -- 172.21.15.172:0/323728842 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca009a730 con 0x7fcca01f17a0 2024-04-25T08:49:47.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.058+0000 7fcc95ffb640 1 -- 172.21.15.172:0/323728842 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc900039d0 con 0x7fcca01f17a0 2024-04-25T08:49:47.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.059+0000 7fcc95ffb640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcc8406b500 0x7fcc8406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.059+0000 7fcca513a640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcc8406b500 0x7fcc8406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.059+0000 7fcc95ffb640 1 -- 172.21.15.172:0/323728842 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcc90089f60 con 0x7fcca01f17a0 2024-04-25T08:49:47.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.059+0000 7fcca513a640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcc8406b500 0x7fcc8406d9c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c005990 tx=0x7fcc9c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:47.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.063+0000 7fcc95ffb640 1 -- 172.21.15.172:0/323728842 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcca015b440 con 0x7fcca01f17a0 2024-04-25T08:49:47.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.233+0000 7fcca739e640 1 -- 172.21.15.172:0/323728842 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcca006cc80 con 0x7fcca01f17a0 2024-04-25T08:49:47.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.233+0000 7fcc95ffb640 1 -- 172.21.15.172:0/323728842 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc90058c50 con 0x7fcca01f17a0 2024-04-25T08:49:47.224 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:49:47.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 -- 172.21.15.172:0/323728842 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcc8406b500 msgr2=0x7fcc8406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcc8406b500 0x7fcc8406d9c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c005990 tx=0x7fcc9c009040 comp rx=0 tx=0).stop 2024-04-25T08:49:47.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 -- 172.21.15.172:0/323728842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcca01f17a0 msgr2=0x7fcca01432e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcca01f17a0 0x7fcca01432e0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000e460 tx=0x7fcc9000e920 comp rx=0 tx=0).stop 2024-04-25T08:49:47.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 -- 172.21.15.172:0/323728842 shutdown_connections 2024-04-25T08:49:47.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcc8406b500 0x7fcc8406d9c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcca0143820 0x7fcca013d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcca01f17a0 0x7fcca01432e0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 --2- 172.21.15.172:0/323728842 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc8c0051c0 0x7fcca013b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 -- 172.21.15.172:0/323728842 >> 172.21.15.172:0/323728842 conn(0x7fcca00b5af0 msgr2=0x7fcca00b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:47.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 -- 172.21.15.172:0/323728842 shutdown_connections 2024-04-25T08:49:47.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.235+0000 7fcca739e640 1 -- 172.21.15.172:0/323728842 wait complete. 2024-04-25T08:49:47.237 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:49:47.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.345+0000 7f9150134640 1 Processor -- start 2024-04-25T08:49:47.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.346+0000 7f9150134640 1 -- start start 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.346+0000 7f9150134640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91480cc4f0 0x7f91480cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.346+0000 7f9150134640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91480cdb20 0x7f91480cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.346+0000 7f9150134640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9148072280 con 0x7f914815b270 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.346+0000 7f9150134640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91480ce4c0 con 0x7f91480cc4f0 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.346+0000 7f9150134640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9148071270 con 0x7f91480cdb20 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.347+0000 7f914ded0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91480cc4f0 0x7f91480cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.347+0000 7f914ded0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91480cc4f0 0x7f91480cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56752/0 (socket says 172.21.15.172:56752) 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.347+0000 7f914ded0640 1 -- 172.21.15.172:0/4005605743 learned_addr learned my addr 172.21.15.172:0/4005605743 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.347+0000 7f914ded0640 1 -- 172.21.15.172:0/4005605743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91480cdb20 msgr2=0x7f91480cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.347+0000 7f914ded0640 1 --2- 172.21.15.172:0/4005605743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91480cdb20 0x7f91480cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.347+0000 7f914ded0640 1 -- 172.21.15.172:0/4005605743 >> v1:172.21.15.186:6789/0 conn(0x7f914815b270 legacy=0x7f914815b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:47.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.347+0000 7f914ded0640 1 -- 172.21.15.172:0/4005605743 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91480714c0 con 0x7f91480cc4f0 2024-04-25T08:49:47.339 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.347+0000 7f914ded0640 1 --2- 172.21.15.172:0/4005605743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cc4f0 0x7f91480cc8d0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f9140009e50 tx=0x7f914002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fee6cb55ca9ba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f914cece640 1 -- 172.21.15.172:0/4005605743 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9140036070 con 0x7f91480cc4f0 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f914cece640 1 -- 172.21.15.172:0/4005605743 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9140031600 con 0x7f91480cc4f0 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f914cece640 1 -- 172.21.15.172:0/4005605743 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91400319d0 con 0x7f91480cc4f0 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f9150134640 1 -- 172.21.15.172:0/4005605743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cc4f0 msgr2=0x7f91480cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f9150134640 1 --2- 172.21.15.172:0/4005605743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cc4f0 0x7f91480cc8d0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f9140009e50 tx=0x7f914002a6c0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f9150134640 1 -- 172.21.15.172:0/4005605743 shutdown_connections 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f9150134640 1 --2- 172.21.15.172:0/4005605743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91480cdb20 0x7f91480cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f9150134640 1 --2- 172.21.15.172:0/4005605743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cc4f0 0x7f91480cc8d0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f9150134640 1 -- 172.21.15.172:0/4005605743 >> 172.21.15.172:0/4005605743 conn(0x7f914806abe0 msgr2=0x7f914806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f9150134640 1 -- 172.21.15.172:0/4005605743 shutdown_connections 2024-04-25T08:49:47.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.348+0000 7f9150134640 1 -- 172.21.15.172:0/4005605743 wait complete. 2024-04-25T08:49:47.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.349+0000 7f9150134640 1 Processor -- start 2024-04-25T08:49:47.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.349+0000 7f9150134640 1 -- start start 2024-04-25T08:49:47.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f9150134640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91480cc4f0 0x7f9148150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f9150134640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cdb20 0x7f91481535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f9150134640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f914815b270 0x7f91481f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f9150134640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9148071a80 con 0x7f91480cdb20 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f9150134640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914815bd90 con 0x7f91480cc4f0 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f9150134640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9148071d60 con 0x7f914815b270 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f914d6cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cdb20 0x7f91481535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f914d6cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cdb20 0x7f91481535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56768/0 (socket says 172.21.15.172:56768) 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f914d6cf640 1 -- 172.21.15.172:0/3729219618 learned_addr learned my addr 172.21.15.172:0/3729219618 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f914ded0640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91480cc4f0 0x7f9148150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.350+0000 7f914e6d1640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f914815b270 0x7f91481f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f914d6cf640 1 -- 172.21.15.172:0/3729219618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f914815b270 msgr2=0x7f91481f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f914d6cf640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f914815b270 0x7f91481f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f914d6cf640 1 -- 172.21.15.172:0/3729219618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91480cc4f0 msgr2=0x7f9148150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f914d6cf640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91480cc4f0 0x7f9148150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f914d6cf640 1 -- 172.21.15.172:0/3729219618 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9148153e00 con 0x7f91480cdb20 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f914ded0640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91480cc4f0 0x7f9148150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:47.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f914e6d1640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f914815b270 0x7f91481f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f914d6cf640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cdb20 0x7f91481535b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f913800b4a0 tx=0x7f913800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f913e7fc640 1 -- 172.21.15.172:0/3729219618 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138014070 con 0x7f91480cdb20 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f913e7fc640 1 -- 172.21.15.172:0/3729219618 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9138010610 con 0x7f91480cdb20 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f913e7fc640 1 -- 172.21.15.172:0/3729219618 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138010a00 con 0x7f91480cdb20 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f9150134640 1 -- 172.21.15.172:0/3729219618 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91481540e0 con 0x7f91480cdb20 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.351+0000 7f9150134640 1 -- 172.21.15.172:0/3729219618 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9148154980 con 0x7f91480cdb20 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.352+0000 7f9150134640 1 -- 172.21.15.172:0/3729219618 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91481542b0 con 0x7f91480cdb20 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.352+0000 7f913e7fc640 1 -- 172.21.15.172:0/3729219618 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9138017070 con 0x7f91480cdb20 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.353+0000 7f913e7fc640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f912c06b4d0 0x7f912c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.353+0000 7f913e7fc640 1 -- 172.21.15.172:0/3729219618 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9138089d40 con 0x7f91480cdb20 2024-04-25T08:49:47.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.353+0000 7f914ded0640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f912c06b4d0 0x7f912c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.353+0000 7f914ded0640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f912c06b4d0 0x7f912c06d990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9140033000 tx=0x7f9140009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:47.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.357+0000 7f913e7fc640 1 -- 172.21.15.172:0/3729219618 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9138058ac0 con 0x7f91480cdb20 2024-04-25T08:49:47.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.528+0000 7f9150134640 1 -- 172.21.15.172:0/3729219618 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9148073a00 con 0x7f91480cdb20 2024-04-25T08:49:47.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.529+0000 7f913e7fc640 1 -- 172.21.15.172:0/3729219618 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91380583c0 con 0x7f91480cdb20 2024-04-25T08:49:47.520 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:49:47.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 -- 172.21.15.172:0/3729219618 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f912c06b4d0 msgr2=0x7f912c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f912c06b4d0 0x7f912c06d990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9140033000 tx=0x7f9140009000 comp rx=0 tx=0).stop 2024-04-25T08:49:47.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 -- 172.21.15.172:0/3729219618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cdb20 msgr2=0x7f91481535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cdb20 0x7f91481535b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f913800b4a0 tx=0x7f913800b960 comp rx=0 tx=0).stop 2024-04-25T08:49:47.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 -- 172.21.15.172:0/3729219618 shutdown_connections 2024-04-25T08:49:47.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f912c06b4d0 0x7f912c06d990 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f914815b270 0x7f91481f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91480cdb20 0x7f91481535b0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 --2- 172.21.15.172:0/3729219618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91480cc4f0 0x7f9148150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 -- 172.21.15.172:0/3729219618 >> 172.21.15.172:0/3729219618 conn(0x7f914806abe0 msgr2=0x7f914806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:47.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 -- 172.21.15.172:0/3729219618 shutdown_connections 2024-04-25T08:49:47.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.531+0000 7f9150134640 1 -- 172.21.15.172:0/3729219618 wait complete. 2024-04-25T08:49:47.533 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:49:47.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.641+0000 7fafa997e640 1 Processor -- start 2024-04-25T08:49:47.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.641+0000 7fafa997e640 1 -- start start 2024-04-25T08:49:47.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa997e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fafa415dc20 0x7fafa40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa997e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 0x7fafa40cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa997e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa415e000 con 0x7fafa4161710 2024-04-25T08:49:47.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa997e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa40d1de0 con 0x7fafa415dc20 2024-04-25T08:49:47.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa997e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4161c60 con 0x7fafa40d32f0 2024-04-25T08:49:47.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa27fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fafa4161710 0x7fafa406bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39806/0 (socket says 172.21.15.172:39806) 2024-04-25T08:49:47.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa27fc640 1 -- 172.21.15.172:0/908595131 learned_addr learned my addr 172.21.15.172:0/908595131 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:47.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa2ffd640 1 --2- 172.21.15.172:0/908595131 >> v2:172.21.15.186:3300/0 conn(0x7fafa415dc20 0x7fafa40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa37fe640 1 --2- 172.21.15.172:0/908595131 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 0x7fafa40cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa1ffb640 1 -- 172.21.15.172:0/908595131 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601000694 0 0) 0x7fafa415e000 con 0x7fafa4161710 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa1ffb640 1 -- 172.21.15.172:0/908595131 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf90003520 con 0x7fafa4161710 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa1ffb640 1 -- 172.21.15.172:0/908595131 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3884116016 0 0) 0x7faf90003520 con 0x7fafa4161710 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa37fe640 1 -- 172.21.15.172:0/908595131 >> v2:172.21.15.186:3300/0 conn(0x7fafa415dc20 msgr2=0x7fafa40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa37fe640 1 --2- 172.21.15.172:0/908595131 >> v2:172.21.15.186:3300/0 conn(0x7fafa415dc20 0x7fafa40ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa37fe640 1 -- 172.21.15.172:0/908595131 >> v1:172.21.15.172:6789/0 conn(0x7fafa4161710 legacy=0x7fafa406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.642+0000 7fafa37fe640 1 -- 172.21.15.172:0/908595131 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4161f40 con 0x7fafa40d32f0 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.643+0000 7fafa37fe640 1 --2- 172.21.15.172:0/908595131 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 0x7fafa40cebb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf940097a0 tx=0x7faf9402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c8b9de2b2272b8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.643+0000 7fafa1ffb640 1 -- 172.21.15.172:0/908595131 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94037070 con 0x7fafa40d32f0 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.643+0000 7fafa1ffb640 1 -- 172.21.15.172:0/908595131 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9402aba0 con 0x7fafa40d32f0 2024-04-25T08:49:47.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.643+0000 7fafa1ffb640 1 -- 172.21.15.172:0/908595131 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c001670 con 0x7fafa40d32f0 2024-04-25T08:49:47.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.644+0000 7fafa997e640 1 -- 172.21.15.172:0/908595131 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 msgr2=0x7fafa40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.644+0000 7fafa997e640 1 --2- 172.21.15.172:0/908595131 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 0x7fafa40cebb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faf940097a0 tx=0x7faf9402a110 comp rx=0 tx=0).stop 2024-04-25T08:49:47.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.644+0000 7fafa997e640 1 -- 172.21.15.172:0/908595131 shutdown_connections 2024-04-25T08:49:47.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.644+0000 7fafa997e640 1 --2- 172.21.15.172:0/908595131 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 0x7fafa40cebb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.644+0000 7fafa997e640 1 --2- 172.21.15.172:0/908595131 >> v2:172.21.15.186:3300/0 conn(0x7fafa415dc20 0x7fafa40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.644+0000 7fafa997e640 1 -- 172.21.15.172:0/908595131 >> 172.21.15.172:0/908595131 conn(0x7fafa40d0420 msgr2=0x7fafa40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:47.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.644+0000 7fafa997e640 1 -- 172.21.15.172:0/908595131 shutdown_connections 2024-04-25T08:49:47.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.644+0000 7fafa997e640 1 -- 172.21.15.172:0/908595131 wait complete. 2024-04-25T08:49:47.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.645+0000 7fafa997e640 1 Processor -- start 2024-04-25T08:49:47.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.645+0000 7fafa997e640 1 -- start start 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa997e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 0x7fafa415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa997e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa415dc20 0x7fafa4154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa997e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa4161710 0x7fafa40b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa997e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b5e50 con 0x7fafa415dc20 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa997e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4162500 con 0x7fafa4161710 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa997e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b5fd0 con 0x7fafa40d32f0 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa27fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa415dc20 0x7fafa4154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa27fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa415dc20 0x7fafa4154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58454/0 (socket says 172.21.15.172:58454) 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa27fc640 1 -- 172.21.15.172:0/2465397563 learned_addr learned my addr 172.21.15.172:0/2465397563 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa2ffd640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 0x7fafa415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa37fe640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa4161710 0x7fafa40b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa27fc640 1 -- 172.21.15.172:0/2465397563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 msgr2=0x7fafa415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa27fc640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 0x7fafa415ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa27fc640 1 -- 172.21.15.172:0/2465397563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa4161710 msgr2=0x7fafa40b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa27fc640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa4161710 0x7fafa40b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa27fc640 1 -- 172.21.15.172:0/2465397563 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4160430 con 0x7fafa415dc20 2024-04-25T08:49:47.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.646+0000 7fafa2ffd640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 0x7fafa415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:47.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.647+0000 7fafa27fc640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa415dc20 0x7fafa4154ee0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00c700 tx=0x7faf8c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:47.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.647+0000 7faf9bfff640 1 -- 172.21.15.172:0/2465397563 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c017070 con 0x7fafa415dc20 2024-04-25T08:49:47.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.647+0000 7faf9bfff640 1 -- 172.21.15.172:0/2465397563 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c005ad0 con 0x7fafa415dc20 2024-04-25T08:49:47.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.647+0000 7fafa997e640 1 -- 172.21.15.172:0/2465397563 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa415f120 con 0x7fafa415dc20 2024-04-25T08:49:47.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.647+0000 7faf9bfff640 1 -- 172.21.15.172:0/2465397563 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c007070 con 0x7fafa415dc20 2024-04-25T08:49:47.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.647+0000 7fafa997e640 1 -- 172.21.15.172:0/2465397563 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa40caba0 con 0x7fafa415dc20 2024-04-25T08:49:47.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.648+0000 7fafa997e640 1 -- 172.21.15.172:0/2465397563 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa4073a00 con 0x7fafa415dc20 2024-04-25T08:49:47.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.648+0000 7faf9bfff640 1 -- 172.21.15.172:0/2465397563 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf8c01a070 con 0x7fafa415dc20 2024-04-25T08:49:47.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.648+0000 7faf9bfff640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf8406b4d0 0x7faf8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:47.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.649+0000 7faf9bfff640 1 -- 172.21.15.172:0/2465397563 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faf8c089640 con 0x7fafa415dc20 2024-04-25T08:49:47.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.649+0000 7fafa2ffd640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf8406b4d0 0x7faf8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:47.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.649+0000 7fafa2ffd640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf8406b4d0 0x7faf8406d990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fafa415cec0 tx=0x7faf9c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:47.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.653+0000 7faf9bfff640 1 -- 172.21.15.172:0/2465397563 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf8c057d70 con 0x7fafa415dc20 2024-04-25T08:49:47.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.838+0000 7fafa997e640 1 -- 172.21.15.172:0/2465397563 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fafa415d260 con 0x7fafa415dc20 2024-04-25T08:49:47.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.838+0000 7faf9bfff640 1 -- 172.21.15.172:0/2465397563 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v107) v1 ==== 80+0+0 (secure 0 0 0) 0x7faf8c05e0c0 con 0x7fafa415dc20 2024-04-25T08:49:47.829 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:49:47.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.840+0000 7fafa997e640 1 -- 172.21.15.172:0/2465397563 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf8406b4d0 msgr2=0x7faf8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.840+0000 7fafa997e640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf8406b4d0 0x7faf8406d990 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fafa415cec0 tx=0x7faf9c00b040 comp rx=0 tx=0).stop 2024-04-25T08:49:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.840+0000 7fafa997e640 1 -- 172.21.15.172:0/2465397563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa415dc20 msgr2=0x7fafa4154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.840+0000 7fafa997e640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa415dc20 0x7fafa4154ee0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00c700 tx=0x7faf8c00cbc0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.840+0000 7fafa997e640 1 -- 172.21.15.172:0/2465397563 shutdown_connections 2024-04-25T08:49:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.840+0000 7fafa997e640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf8406b4d0 0x7faf8406d990 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.840+0000 7fafa997e640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa4161710 0x7fafa40b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.840+0000 7fafa997e640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa415dc20 0x7fafa4154ee0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.840+0000 7fafa997e640 1 --2- 172.21.15.172:0/2465397563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa40d32f0 0x7fafa415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.840+0000 7fafa997e640 1 -- 172.21.15.172:0/2465397563 >> 172.21.15.172:0/2465397563 conn(0x7fafa40d0420 msgr2=0x7fafa415b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.841+0000 7fafa997e640 1 -- 172.21.15.172:0/2465397563 shutdown_connections 2024-04-25T08:49:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:47.841+0000 7fafa997e640 1 -- 172.21.15.172:0/2465397563 wait complete. 2024-04-25T08:49:47.842 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:49:47.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:47.842 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:49:48.465 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:49:48.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:49:48.465 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:49:48.484 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:49:48.484 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:48.499 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:49:48.499 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:48.499 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:48.539 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:49:48.540 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:49:48.540 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:48.555 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:49:48.555 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:48.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.687+0000 7fe1518d8640 1 Processor -- start 2024-04-25T08:49:48.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.687+0000 7fe1518d8640 1 -- start start 2024-04-25T08:49:48.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe1518d8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe14c15dbe0 0x7fe14c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe1518d8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe14c0b2cb0 0x7fe14c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe1518d8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c0b97a0 con 0x7fe14c0b92a0 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe1518d8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c15dfc0 con 0x7fe14c15dbe0 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe1518d8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c0d1a00 con 0x7fe14c0b2cb0 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe14affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe14c15dbe0 0x7fe14c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe14b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe14c0b92a0 0x7fe14c0b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39812/0 (socket says 172.21.15.172:39812) 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe14b7fe640 1 -- 172.21.15.172:0/2608477002 learned_addr learned my addr 172.21.15.172:0/2608477002 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe14a7fc640 1 --2- 172.21.15.172:0/2608477002 >> v2:172.21.15.186:3300/0 conn(0x7fe14c0b2cb0 0x7fe14c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe14affd640 1 -- 172.21.15.172:0/2608477002 >> v2:172.21.15.186:3300/0 conn(0x7fe14c0b2cb0 msgr2=0x7fe14c0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe14affd640 1 --2- 172.21.15.172:0/2608477002 >> v2:172.21.15.186:3300/0 conn(0x7fe14c0b2cb0 0x7fe14c0d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe14affd640 1 -- 172.21.15.172:0/2608477002 >> v1:172.21.15.172:6789/0 conn(0x7fe14c0b92a0 legacy=0x7fe14c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe14affd640 1 -- 172.21.15.172:0/2608477002 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0d1c50 con 0x7fe14c15dbe0 2024-04-25T08:49:48.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe149ffb640 1 -- 172.21.15.172:0/2608477002 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579915032 0 0) 0x7fe14c0b97a0 con 0x7fe14c0b92a0 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.688+0000 7fe14a7fc640 1 --2- 172.21.15.172:0/2608477002 >> v2:172.21.15.186:3300/0 conn(0x7fe14c0b2cb0 0x7fe14c0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.689+0000 7fe14affd640 1 --2- 172.21.15.172:0/2608477002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 0x7fe14c0d0910 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fe14c06cff0 tx=0x7fe13c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91cdc6f47289865 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.689+0000 7fe149ffb640 1 -- 172.21.15.172:0/2608477002 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c037070 con 0x7fe14c15dbe0 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.689+0000 7fe149ffb640 1 -- 172.21.15.172:0/2608477002 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c032440 con 0x7fe14c15dbe0 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.689+0000 7fe149ffb640 1 -- 172.21.15.172:0/2608477002 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c02ae60 con 0x7fe14c15dbe0 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.690+0000 7fe1518d8640 1 -- 172.21.15.172:0/2608477002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 msgr2=0x7fe14c0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.690+0000 7fe1518d8640 1 --2- 172.21.15.172:0/2608477002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 0x7fe14c0d0910 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fe14c06cff0 tx=0x7fe13c02a110 comp rx=0 tx=0).stop 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.690+0000 7fe1518d8640 1 -- 172.21.15.172:0/2608477002 shutdown_connections 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.690+0000 7fe1518d8640 1 --2- 172.21.15.172:0/2608477002 >> v2:172.21.15.186:3300/0 conn(0x7fe14c0b2cb0 0x7fe14c0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.690+0000 7fe1518d8640 1 --2- 172.21.15.172:0/2608477002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 0x7fe14c0d0910 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.690+0000 7fe1518d8640 1 -- 172.21.15.172:0/2608477002 >> 172.21.15.172:0/2608477002 conn(0x7fe14c061a20 msgr2=0x7fe14c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.690+0000 7fe1518d8640 1 -- 172.21.15.172:0/2608477002 shutdown_connections 2024-04-25T08:49:48.682 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.690+0000 7fe1518d8640 1 -- 172.21.15.172:0/2608477002 wait complete. 2024-04-25T08:49:48.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.691+0000 7fe1518d8640 1 Processor -- start 2024-04-25T08:49:48.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.691+0000 7fe1518d8640 1 -- start start 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe1518d8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe14c0b2cb0 0x7fe14c0b8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe1518d8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe14c0b92a0 0x7fe14c0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe1518d8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 0x7fe14c0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe1518d8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b6ab0 con 0x7fe14c15dbe0 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe1518d8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0d2210 con 0x7fe14c0b2cb0 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe1518d8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b6c30 con 0x7fe14c0b92a0 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 0x7fe14c0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 0x7fe14c0cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58470/0 (socket says 172.21.15.172:58470) 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14b7fe640 1 -- 172.21.15.172:0/2101293663 learned_addr learned my addr 172.21.15.172:0/2101293663 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14affd640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe14c0b2cb0 0x7fe14c0b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14a7fc640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe14c0b92a0 0x7fe14c0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14b7fe640 1 -- 172.21.15.172:0/2101293663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe14c0b92a0 msgr2=0x7fe14c0cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14b7fe640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe14c0b92a0 0x7fe14c0cd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:48.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14b7fe640 1 -- 172.21.15.172:0/2101293663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe14c0b2cb0 msgr2=0x7fe14c0b8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14b7fe640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe14c0b2cb0 0x7fe14c0b8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14b7fe640 1 -- 172.21.15.172:0/2101293663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0cb600 con 0x7fe14c15dbe0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.692+0000 7fe14b7fe640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 0x7fe14c0cd750 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c780 tx=0x7fe14400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.693+0000 7fe133fff640 1 -- 172.21.15.172:0/2101293663 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144018070 con 0x7fe14c15dbe0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.693+0000 7fe133fff640 1 -- 172.21.15.172:0/2101293663 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14400a640 con 0x7fe14c15dbe0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.693+0000 7fe1518d8640 1 -- 172.21.15.172:0/2101293663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c0cb8e0 con 0x7fe14c15dbe0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.693+0000 7fe133fff640 1 -- 172.21.15.172:0/2101293663 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400aab0 con 0x7fe14c15dbe0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.693+0000 7fe1518d8640 1 -- 172.21.15.172:0/2101293663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c0cbea0 con 0x7fe14c15dbe0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.694+0000 7fe1518d8640 1 -- 172.21.15.172:0/2101293663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c073990 con 0x7fe14c15dbe0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.694+0000 7fe133fff640 1 -- 172.21.15.172:0/2101293663 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe14401b070 con 0x7fe14c15dbe0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.695+0000 7fe133fff640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe13806b4d0 0x7fe13806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.695+0000 7fe133fff640 1 -- 172.21.15.172:0/2101293663 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe144089940 con 0x7fe14c15dbe0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.695+0000 7fe14affd640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe13806b4d0 0x7fe13806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:48.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.695+0000 7fe14affd640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe13806b4d0 0x7fe13806d990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe13c034000 tx=0x7fe13c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:48.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.699+0000 7fe133fff640 1 -- 172.21.15.172:0/2101293663 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe144058630 con 0x7fe14c15dbe0 2024-04-25T08:49:48.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.911+0000 7fe1518d8640 1 -- 172.21.15.172:0/2101293663 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe14c160a80 con 0x7fe14c15dbe0 2024-04-25T08:49:48.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.911+0000 7fe133fff640 1 -- 172.21.15.172:0/2101293663 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fe144057f30 con 0x7fe14c15dbe0 2024-04-25T08:49:48.902 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:48.903 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:48.903 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 -- 172.21.15.172:0/2101293663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe13806b4d0 msgr2=0x7fe13806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe13806b4d0 0x7fe13806d990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe13c034000 tx=0x7fe13c02e000 comp rx=0 tx=0).stop 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 -- 172.21.15.172:0/2101293663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 msgr2=0x7fe14c0cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 0x7fe14c0cd750 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c780 tx=0x7fe14400cc40 comp rx=0 tx=0).stop 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 -- 172.21.15.172:0/2101293663 shutdown_connections 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe13806b4d0 0x7fe13806d990 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe14c15dbe0 0x7fe14c0cd750 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe14c0b92a0 0x7fe14c0cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 --2- 172.21.15.172:0/2101293663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe14c0b2cb0 0x7fe14c0b8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 -- 172.21.15.172:0/2101293663 >> 172.21.15.172:0/2101293663 conn(0x7fe14c061a20 msgr2=0x7fe14c0d2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 -- 172.21.15.172:0/2101293663 shutdown_connections 2024-04-25T08:49:48.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:48.914+0000 7fe1518d8640 1 -- 172.21.15.172:0/2101293663 wait complete. 2024-04-25T08:49:48.916 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:49.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.023+0000 7fc350789640 1 Processor -- start 2024-04-25T08:49:49.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.023+0000 7fc350789640 1 -- start start 2024-04-25T08:49:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc350789640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc3480b3410 0x7fc3480720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc350789640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3480ace70 con 0x7fc3480b37f0 2024-04-25T08:49:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc350789640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3480b43b0 con 0x7fc34806e3c0 2024-04-25T08:49:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc350789640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34806df30 con 0x7fc3480b3410 2024-04-25T08:49:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc34dd24640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc3480b37f0 0x7fc3480b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39818/0 (socket says 172.21.15.172:39818) 2024-04-25T08:49:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc34dd24640 1 -- 172.21.15.172:0/1355197035 learned_addr learned my addr 172.21.15.172:0/1355197035 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc34e525640 1 --2- 172.21.15.172:0/1355197035 >> v2:172.21.15.186:3300/0 conn(0x7fc3480b3410 0x7fc3480720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc34d523640 1 -- 172.21.15.172:0/1355197035 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974721269 0 0) 0x7fc338001110 con 0x7fc3480b37f0 2024-04-25T08:49:49.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc34d523640 1 -- 172.21.15.172:0/1355197035 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc334003520 con 0x7fc3480b37f0 2024-04-25T08:49:49.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc34e525640 1 -- 172.21.15.172:0/1355197035 >> v1:172.21.15.186:6789/0 conn(0x7fc34806e3c0 legacy=0x7fc34806e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc34e525640 1 -- 172.21.15.172:0/1355197035 >> v1:172.21.15.172:6789/0 conn(0x7fc3480b37f0 legacy=0x7fc3480b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.024+0000 7fc34e525640 1 -- 172.21.15.172:0/1355197035 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480726d0 con 0x7fc3480b3410 2024-04-25T08:49:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.025+0000 7fc34e525640 1 --2- 172.21.15.172:0/1355197035 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3480b3410 0x7fc3480720f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc3440097a0 tx=0x7fc34402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0b51f2d435314b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.025+0000 7fc34d523640 1 -- 172.21.15.172:0/1355197035 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344037070 con 0x7fc3480b3410 2024-04-25T08:49:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.025+0000 7fc34d523640 1 -- 172.21.15.172:0/1355197035 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc344032440 con 0x7fc3480b3410 2024-04-25T08:49:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.025+0000 7fc34d523640 1 -- 172.21.15.172:0/1355197035 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344032810 con 0x7fc3480b3410 2024-04-25T08:49:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.026+0000 7fc350789640 1 -- 172.21.15.172:0/1355197035 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3480b3410 msgr2=0x7fc3480720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.026+0000 7fc350789640 1 --2- 172.21.15.172:0/1355197035 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3480b3410 0x7fc3480720f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc3440097a0 tx=0x7fc34402a230 comp rx=0 tx=0).stop 2024-04-25T08:49:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.026+0000 7fc350789640 1 -- 172.21.15.172:0/1355197035 shutdown_connections 2024-04-25T08:49:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.026+0000 7fc350789640 1 --2- 172.21.15.172:0/1355197035 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3480b3410 0x7fc3480720f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.026+0000 7fc350789640 1 -- 172.21.15.172:0/1355197035 >> 172.21.15.172:0/1355197035 conn(0x7fc3480cfae0 msgr2=0x7fc3480cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:49.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.026+0000 7fc350789640 1 -- 172.21.15.172:0/1355197035 shutdown_connections 2024-04-25T08:49:49.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.026+0000 7fc350789640 1 -- 172.21.15.172:0/1355197035 wait complete. 2024-04-25T08:49:49.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.027+0000 7fc350789640 1 Processor -- start 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.027+0000 7fc350789640 1 -- start start 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.027+0000 7fc350789640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34806e3c0 0x7fc3481f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc350789640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3480b3410 0x7fc348144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc350789640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3480b37f0 0x7fc34813c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc350789640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc348147890 con 0x7fc34806e3c0 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc350789640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34806dbc0 con 0x7fc3480b3410 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc350789640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc348147230 con 0x7fc3480b37f0 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34e525640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34806e3c0 0x7fc3481f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34e525640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34806e3c0 0x7fc3481f42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58482/0 (socket says 172.21.15.172:58482) 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34e525640 1 -- 172.21.15.172:0/340248231 learned_addr learned my addr 172.21.15.172:0/340248231 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34ed26640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3480b37f0 0x7fc34813c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34dd24640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3480b3410 0x7fc348144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34e525640 1 -- 172.21.15.172:0/340248231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3480b37f0 msgr2=0x7fc34813c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34e525640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3480b37f0 0x7fc34813c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34e525640 1 -- 172.21.15.172:0/340248231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3480b3410 msgr2=0x7fc348144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34e525640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3480b3410 0x7fc348144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34e525640 1 -- 172.21.15.172:0/340248231 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348145290 con 0x7fc34806e3c0 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34ed26640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3480b37f0 0x7fc34813c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34dd24640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3480b3410 0x7fc348144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc34e525640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34806e3c0 0x7fc3481f42c0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc3440098c0 tx=0x7fc3440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc33effd640 1 -- 172.21.15.172:0/340248231 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344037040 con 0x7fc34806e3c0 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc33effd640 1 -- 172.21.15.172:0/340248231 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc344030500 con 0x7fc34806e3c0 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc350789640 1 -- 172.21.15.172:0/340248231 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc348145570 con 0x7fc34806e3c0 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc33effd640 1 -- 172.21.15.172:0/340248231 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440308d0 con 0x7fc34806e3c0 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.028+0000 7fc350789640 1 -- 172.21.15.172:0/340248231 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34814cf30 con 0x7fc34806e3c0 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.029+0000 7fc350789640 1 -- 172.21.15.172:0/340248231 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc348145a90 con 0x7fc34806e3c0 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.030+0000 7fc33effd640 1 -- 172.21.15.172:0/340248231 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc344044020 con 0x7fc34806e3c0 2024-04-25T08:49:49.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.030+0000 7fc33effd640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc32c06b4d0 0x7fc32c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.030+0000 7fc33effd640 1 -- 172.21.15.172:0/340248231 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc3440aa690 con 0x7fc34806e3c0 2024-04-25T08:49:49.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.030+0000 7fc34dd24640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc32c06b4d0 0x7fc32c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.030+0000 7fc34dd24640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc32c06b4d0 0x7fc32c06d990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc338007fd0 tx=0x7fc338009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.034+0000 7fc33effd640 1 -- 172.21.15.172:0/340248231 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc348145a90 con 0x7fc34806e3c0 2024-04-25T08:49:49.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.205+0000 7fc350789640 1 -- 172.21.15.172:0/340248231 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc348073990 con 0x7fc34806e3c0 2024-04-25T08:49:49.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.207+0000 7fc33effd640 1 -- 172.21.15.172:0/340248231 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16944 (secure 0 0 0) 0x7fc344079380 con 0x7fc34806e3c0 2024-04-25T08:49:49.198 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:49.198 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":107,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:18.717539+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:49:15.250034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T08:49:16.013750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:49.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 -- 172.21.15.172:0/340248231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc32c06b4d0 msgr2=0x7fc32c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc32c06b4d0 0x7fc32c06d990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc338007fd0 tx=0x7fc338009040 comp rx=0 tx=0).stop 2024-04-25T08:49:49.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 -- 172.21.15.172:0/340248231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34806e3c0 msgr2=0x7fc3481f42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34806e3c0 0x7fc3481f42c0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc3440098c0 tx=0x7fc3440046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 -- 172.21.15.172:0/340248231 shutdown_connections 2024-04-25T08:49:49.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc32c06b4d0 0x7fc32c06d990 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3480b3410 0x7fc348144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3480b37f0 0x7fc34813c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 --2- 172.21.15.172:0/340248231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34806e3c0 0x7fc3481f42c0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 -- 172.21.15.172:0/340248231 >> 172.21.15.172:0/340248231 conn(0x7fc3480cfae0 msgr2=0x7fc3480716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:49.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 -- 172.21.15.172:0/340248231 shutdown_connections 2024-04-25T08:49:49.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.209+0000 7fc350789640 1 -- 172.21.15.172:0/340248231 wait complete. 2024-04-25T08:49:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:49:15.250034+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:49:16.013750+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:49:49.211 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:49:49.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.322+0000 7f636e6bc640 1 Processor -- start 2024-04-25T08:49:49.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.322+0000 7f636e6bc640 1 -- start start 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.322+0000 7f636e6bc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f636815dd80 0x7f63680b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.322+0000 7f636e6bc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63680b3930 con 0x7f636806abe0 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.322+0000 7f636e6bc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63680b3c10 con 0x7f63680ad570 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.322+0000 7f636e6bc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636806e410 con 0x7f636815dd80 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.323+0000 7f6367fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f636806abe0 0x7f636806afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39826/0 (socket says 172.21.15.172:39826) 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.323+0000 7f6367fff640 1 -- 172.21.15.172:0/1020016826 learned_addr learned my addr 172.21.15.172:0/1020016826 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.323+0000 7f63677fe640 1 --2- 172.21.15.172:0/1020016826 >> v2:172.21.15.186:3300/0 conn(0x7f636815dd80 0x7f63680b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.323+0000 7f6366ffd640 1 -- 172.21.15.172:0/1020016826 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419554495 0 0) 0x7f63680b3930 con 0x7f636806abe0 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.323+0000 7f6366ffd640 1 -- 172.21.15.172:0/1020016826 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6350003520 con 0x7f636806abe0 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.323+0000 7f63677fe640 1 -- 172.21.15.172:0/1020016826 >> v1:172.21.15.186:6789/0 conn(0x7f63680ad570 legacy=0x7f636806ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.323+0000 7f6366ffd640 1 -- 172.21.15.172:0/1020016826 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873888290 0 0) 0x7f63680b3c10 con 0x7f63680ad570 2024-04-25T08:49:49.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.323+0000 7f63677fe640 1 -- 172.21.15.172:0/1020016826 >> v1:172.21.15.172:6789/0 conn(0x7f636806abe0 legacy=0x7f636806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.323+0000 7f63677fe640 1 -- 172.21.15.172:0/1020016826 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636806e660 con 0x7f636815dd80 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.324+0000 7f63677fe640 1 --2- 172.21.15.172:0/1020016826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f636815dd80 0x7f63680b5290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f635c0097a0 tx=0x7f635c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5590013aec42ea6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.324+0000 7f6366ffd640 1 -- 172.21.15.172:0/1020016826 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c037070 con 0x7f636815dd80 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.324+0000 7f6366ffd640 1 -- 172.21.15.172:0/1020016826 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c032440 con 0x7f636815dd80 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.324+0000 7f6366ffd640 1 -- 172.21.15.172:0/1020016826 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0327f0 con 0x7f636815dd80 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.324+0000 7f636e6bc640 1 -- 172.21.15.172:0/1020016826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f636815dd80 msgr2=0x7f63680b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.324+0000 7f636e6bc640 1 --2- 172.21.15.172:0/1020016826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f636815dd80 0x7f63680b5290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f635c0097a0 tx=0x7f635c02a230 comp rx=0 tx=0).stop 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.325+0000 7f636e6bc640 1 -- 172.21.15.172:0/1020016826 shutdown_connections 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.325+0000 7f636e6bc640 1 --2- 172.21.15.172:0/1020016826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f636815dd80 0x7f63680b5290 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.325+0000 7f636e6bc640 1 -- 172.21.15.172:0/1020016826 >> 172.21.15.172:0/1020016826 conn(0x7f63680b5af0 msgr2=0x7f63680b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.325+0000 7f636e6bc640 1 -- 172.21.15.172:0/1020016826 shutdown_connections 2024-04-25T08:49:49.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.325+0000 7f636e6bc640 1 -- 172.21.15.172:0/1020016826 wait complete. 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.326+0000 7f636e6bc640 1 Processor -- start 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.326+0000 7f636e6bc640 1 -- start start 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f636e6bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636806abe0 0x7f63681f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f636e6bc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63680ad570 0x7f63681f0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f636e6bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f636815dd80 0x7f636815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f636e6bc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6368070280 con 0x7f636806abe0 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f636e6bc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680b57d0 con 0x7f63680ad570 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f636e6bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6368070400 con 0x7f636815dd80 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6367fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636806abe0 0x7f63681f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6367fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636806abe0 0x7f63681f31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58494/0 (socket says 172.21.15.172:58494) 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6367fff640 1 -- 172.21.15.172:0/2024807586 learned_addr learned my addr 172.21.15.172:0/2024807586 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:49.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f63677fe640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63680ad570 0x7f63681f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f636cc59640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f636815dd80 0x7f636815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6367fff640 1 -- 172.21.15.172:0/2024807586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f636815dd80 msgr2=0x7f636815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6367fff640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f636815dd80 0x7f636815c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6367fff640 1 -- 172.21.15.172:0/2024807586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63680ad570 msgr2=0x7f63681f0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6367fff640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63680ad570 0x7f63681f0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6367fff640 1 -- 172.21.15.172:0/2024807586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63681f3a30 con 0x7f636806abe0 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f636cc59640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f636815dd80 0x7f636815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6367fff640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636806abe0 0x7f63681f31e0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f635800c430 tx=0x7f635800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6364ff9640 1 -- 172.21.15.172:0/2024807586 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358017070 con 0x7f636806abe0 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6364ff9640 1 -- 172.21.15.172:0/2024807586 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6358005ce0 con 0x7f636806abe0 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f6364ff9640 1 -- 172.21.15.172:0/2024807586 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63580072f0 con 0x7f636806abe0 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f636e6bc640 1 -- 172.21.15.172:0/2024807586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63681f3d10 con 0x7f636806abe0 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.327+0000 7f636e6bc640 1 -- 172.21.15.172:0/2024807586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63681f3720 con 0x7f636806abe0 2024-04-25T08:49:49.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.328+0000 7f636e6bc640 1 -- 172.21.15.172:0/2024807586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63681f43a0 con 0x7f636806abe0 2024-04-25T08:49:49.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.329+0000 7f6364ff9640 1 -- 172.21.15.172:0/2024807586 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f635801a070 con 0x7f636806abe0 2024-04-25T08:49:49.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.329+0000 7f6364ff9640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635406b4d0 0x7f635406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.329+0000 7f6364ff9640 1 -- 172.21.15.172:0/2024807586 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f63580897c0 con 0x7f636806abe0 2024-04-25T08:49:49.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.329+0000 7f63677fe640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635406b4d0 0x7f635406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.330+0000 7f63677fe640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635406b4d0 0x7f635406d990 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f635c034000 tx=0x7f635c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.334+0000 7f6364ff9640 1 -- 172.21.15.172:0/2024807586 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6358057e60 con 0x7f636806abe0 2024-04-25T08:49:49.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.504+0000 7f636e6bc640 1 -- 172.21.15.172:0/2024807586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6368073a00 con 0x7f636806abe0 2024-04-25T08:49:49.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.505+0000 7f6364ff9640 1 -- 172.21.15.172:0/2024807586 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f635805ce20 con 0x7f636806abe0 2024-04-25T08:49:49.496 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:49:49.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 -- 172.21.15.172:0/2024807586 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635406b4d0 msgr2=0x7f635406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635406b4d0 0x7f635406d990 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f635c034000 tx=0x7f635c02e000 comp rx=0 tx=0).stop 2024-04-25T08:49:49.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 -- 172.21.15.172:0/2024807586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636806abe0 msgr2=0x7f63681f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636806abe0 0x7f63681f31e0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f635800c430 tx=0x7f635800c8f0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 -- 172.21.15.172:0/2024807586 shutdown_connections 2024-04-25T08:49:49.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f635406b4d0 0x7f635406d990 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63680ad570 0x7f63681f0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f636815dd80 0x7f636815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 --2- 172.21.15.172:0/2024807586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f636806abe0 0x7f63681f31e0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 -- 172.21.15.172:0/2024807586 >> 172.21.15.172:0/2024807586 conn(0x7f63680b5af0 msgr2=0x7f636806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:49.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 -- 172.21.15.172:0/2024807586 shutdown_connections 2024-04-25T08:49:49.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.507+0000 7f636e6bc640 1 -- 172.21.15.172:0/2024807586 wait complete. 2024-04-25T08:49:49.509 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:49:49.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.619+0000 7fdd49d17640 1 Processor -- start 2024-04-25T08:49:49.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.619+0000 7fdd49d17640 1 -- start start 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.620+0000 7fdd49d17640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdd44161890 0x7fdd440b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.620+0000 7fdd49d17640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440b54a0 0x7fdd440b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.620+0000 7fdd49d17640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd440cf1d0 con 0x7fdd44161240 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.620+0000 7fdd49d17640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd440b7120 con 0x7fdd44161890 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.620+0000 7fdd49d17640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd44161620 con 0x7fdd440b54a0 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.620+0000 7fdd437fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fdd44161240 0x7fdd440ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39836/0 (socket says 172.21.15.172:39836) 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.620+0000 7fdd437fe640 1 -- 172.21.15.172:0/592425192 learned_addr learned my addr 172.21.15.172:0/592425192 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd42ffd640 1 --2- 172.21.15.172:0/592425192 >> v2:172.21.15.186:3300/0 conn(0x7fdd44161890 0x7fdd440b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305788166 0 0) 0x7fdd440cf1d0 con 0x7fdd44161240 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd43fff640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440b54a0 0x7fdd440b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd2c003520 con 0x7fdd44161240 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 997726767 0 0) 0x7fdd2c003520 con 0x7fdd44161240 2024-04-25T08:49:49.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440b54a0 msgr2=0x7fdd440b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:49.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440b54a0 0x7fdd440b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 >> v2:172.21.15.186:3300/0 conn(0x7fdd44161890 msgr2=0x7fdd440b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:49.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 --2- 172.21.15.172:0/592425192 >> v2:172.21.15.186:3300/0 conn(0x7fdd44161890 0x7fdd440b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44161e00 con 0x7fdd44161240 2024-04-25T08:49:49.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fdd34001670 con 0x7fdd44161240 2024-04-25T08:49:49.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 >> v1:172.21.15.172:6789/0 conn(0x7fdd44161240 legacy=0x7fdd440ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd2c0039b0 0x7fdd2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440b54a0 0x7fdd2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd44161620 con 0x7fdd2c0039b0 2024-04-25T08:49:49.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c00b9c0 con 0x7fdd2c004d40 2024-04-25T08:49:49.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c00bb40 con 0x7fdd440b54a0 2024-04-25T08:49:49.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd437fe640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd2c0039b0 0x7fdd2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd42ffd640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440b54a0 0x7fdd2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd43fff640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd437fe640 1 -- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440b54a0 msgr2=0x7fdd2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd437fe640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440b54a0 0x7fdd2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd437fe640 1 -- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c004d40 msgr2=0x7fdd2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd437fe640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.621+0000 7fdd437fe640 1 -- 172.21.15.172:0/592425192 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c003520 con 0x7fdd2c0039b0 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.622+0000 7fdd437fe640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd2c0039b0 0x7fdd2c003dd0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fdd34001050 tx=0x7fdd2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1f2554c71ebad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.622+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3402e070 con 0x7fdd2c0039b0 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.622+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34005af0 con 0x7fdd2c0039b0 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.622+0000 7fdd427fc640 1 -- 172.21.15.172:0/592425192 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34007d70 con 0x7fdd2c0039b0 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.623+0000 7fdd49d17640 1 -- 172.21.15.172:0/592425192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd2c0039b0 msgr2=0x7fdd2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.623+0000 7fdd49d17640 1 --2- 172.21.15.172:0/592425192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd2c0039b0 0x7fdd2c003dd0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fdd34001050 tx=0x7fdd2c005830 comp rx=0 tx=0).stop 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.623+0000 7fdd43fff640 1 -- 172.21.15.172:0/592425192 reap_dead start 2024-04-25T08:49:49.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.623+0000 7fdd49d17640 1 -- 172.21.15.172:0/592425192 shutdown_connections 2024-04-25T08:49:49.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.623+0000 7fdd49d17640 1 -- 172.21.15.172:0/592425192 >> 172.21.15.172:0/592425192 conn(0x7fdd440d04a0 msgr2=0x7fdd440d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:49.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.623+0000 7fdd49d17640 1 -- 172.21.15.172:0/592425192 shutdown_connections 2024-04-25T08:49:49.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.623+0000 7fdd49d17640 1 -- 172.21.15.172:0/592425192 wait complete. 2024-04-25T08:49:49.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.624+0000 7fdd49d17640 1 Processor -- start 2024-04-25T08:49:49.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.624+0000 7fdd49d17640 1 -- start start 2024-04-25T08:49:49.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd49d17640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c0039b0 0x7fdd440b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd49d17640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440cbb90 0x7fdd440b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd49d17640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd44151f10 0x7fdd440c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd49d17640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd441626a0 con 0x7fdd44151f10 2024-04-25T08:49:49.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd49d17640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd441623c0 con 0x7fdd2c0039b0 2024-04-25T08:49:49.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd49d17640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440d15f0 con 0x7fdd440cbb90 2024-04-25T08:49:49.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd44151f10 0x7fdd440c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd43fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd44151f10 0x7fdd440c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58506/0 (socket says 172.21.15.172:58506) 2024-04-25T08:49:49.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd43fff640 1 -- 172.21.15.172:0/1071894805 learned_addr learned my addr 172.21.15.172:0/1071894805 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:49.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd437fe640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c0039b0 0x7fdd440b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd42ffd640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440cbb90 0x7fdd440b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd43fff640 1 -- 172.21.15.172:0/1071894805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440cbb90 msgr2=0x7fdd440b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd43fff640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440cbb90 0x7fdd440b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd43fff640 1 -- 172.21.15.172:0/1071894805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c0039b0 msgr2=0x7fdd440b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd43fff640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c0039b0 0x7fdd440b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd43fff640 1 -- 172.21.15.172:0/1071894805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440caaf0 con 0x7fdd44151f10 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd43fff640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd44151f10 0x7fdd440c8ae0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fdd440d00d0 tx=0x7fdd3c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd2bfff640 1 -- 172.21.15.172:0/1071894805 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c00fe10 con 0x7fdd44151f10 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd2bfff640 1 -- 172.21.15.172:0/1071894805 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c015430 con 0x7fdd44151f10 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd49d17640 1 -- 172.21.15.172:0/1071894805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd440cadd0 con 0x7fdd44151f10 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.625+0000 7fdd2bfff640 1 -- 172.21.15.172:0/1071894805 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c015820 con 0x7fdd44151f10 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.626+0000 7fdd49d17640 1 -- 172.21.15.172:0/1071894805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd440cb390 con 0x7fdd44151f10 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.626+0000 7fdd49d17640 1 -- 172.21.15.172:0/1071894805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd440c70d0 con 0x7fdd44151f10 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.627+0000 7fdd2bfff640 1 -- 172.21.15.172:0/1071894805 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdd3c0159c0 con 0x7fdd44151f10 2024-04-25T08:49:49.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.627+0000 7fdd2bfff640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd3006b4d0 0x7fdd3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.628+0000 7fdd437fe640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd3006b4d0 0x7fdd3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.628+0000 7fdd2bfff640 1 -- 172.21.15.172:0/1071894805 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdd3c08b170 con 0x7fdd44151f10 2024-04-25T08:49:49.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.628+0000 7fdd437fe640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd3006b4d0 0x7fdd3006d990 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdd34033000 tx=0x7fdd34009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.632+0000 7fdd2bfff640 1 -- 172.21.15.172:0/1071894805 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdd440c70d0 con 0x7fdd44151f10 2024-04-25T08:49:49.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.804+0000 7fdd49d17640 1 -- 172.21.15.172:0/1071894805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd440c65b0 con 0x7fdd44151f10 2024-04-25T08:49:49.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.804+0000 7fdd2bfff640 1 -- 172.21.15.172:0/1071894805 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd3c019030 con 0x7fdd44151f10 2024-04-25T08:49:49.795 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 -- 172.21.15.172:0/1071894805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd3006b4d0 msgr2=0x7fdd3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd3006b4d0 0x7fdd3006d990 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdd34033000 tx=0x7fdd34009030 comp rx=0 tx=0).stop 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 -- 172.21.15.172:0/1071894805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd44151f10 msgr2=0x7fdd440c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd44151f10 0x7fdd440c8ae0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fdd440d00d0 tx=0x7fdd3c00f580 comp rx=0 tx=0).stop 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 -- 172.21.15.172:0/1071894805 shutdown_connections 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdd3006b4d0 0x7fdd3006d990 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd44151f10 0x7fdd440c8ae0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd440cbb90 0x7fdd440b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 --2- 172.21.15.172:0/1071894805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd2c0039b0 0x7fdd440b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 -- 172.21.15.172:0/1071894805 >> 172.21.15.172:0/1071894805 conn(0x7fdd440d04a0 msgr2=0x7fdd440ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:49.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 -- 172.21.15.172:0/1071894805 shutdown_connections 2024-04-25T08:49:49.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.806+0000 7fdd49d17640 1 -- 172.21.15.172:0/1071894805 wait complete. 2024-04-25T08:49:49.808 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:49:49.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.918+0000 7f237c8e4640 1 Processor -- start 2024-04-25T08:49:49.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.918+0000 7f237c8e4640 1 -- start start 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f237c8e4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f23780b38d0 0x7f23780b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f237c8e4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237815e020 con 0x7f237806e360 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f237c8e4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237806ac80 con 0x7f237806bd20 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f237c8e4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237806b890 con 0x7f23780b38d0 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f237659c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f237806e360 0x7f237806e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39842/0 (socket says 172.21.15.172:39842) 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f237659c640 1 -- 172.21.15.172:0/975133237 learned_addr learned my addr 172.21.15.172:0/975133237 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834469971 0 0) 0x7f237815e020 con 0x7f237806e360 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2364003520 con 0x7f237806e360 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f236ffff640 1 --2- 172.21.15.172:0/975133237 >> v2:172.21.15.186:3300/0 conn(0x7f23780b38d0 0x7f23780b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 107254453 0 0) 0x7f2364003520 con 0x7f237806e360 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 >> v2:172.21.15.186:3300/0 conn(0x7f23780b38d0 msgr2=0x7f23780b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f2375d9b640 1 --2- 172.21.15.172:0/975133237 >> v2:172.21.15.186:3300/0 conn(0x7f23780b38d0 0x7f23780b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 >> v1:172.21.15.186:6789/0 conn(0x7f237806bd20 legacy=0x7f23780acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237806af60 con 0x7f237806e360 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f2368001670 con 0x7f237806e360 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.919+0000 7f236ffff640 1 --2- 172.21.15.172:0/975133237 >> v2:172.21.15.186:3300/0 conn(0x7f23780b38d0 0x7f23780b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 >> v1:172.21.15.172:6789/0 conn(0x7f237806e360 legacy=0x7f237806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2375d9b640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23640039b0 0x7f2364003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2375d9b640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2364004800 0x7f2364004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2375d9b640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23640051c0 0x7f236400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237806b890 con 0x7f23640051c0 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236400c0f0 con 0x7f2364004800 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236400c2f0 con 0x7f23640039b0 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2376d9d640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23640051c0 0x7f236400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f236ffff640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2364004800 0x7f2364004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f237659c640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23640039b0 0x7f2364003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2376d9d640 1 -- 172.21.15.172:0/975133237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23640039b0 msgr2=0x7f2364003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:49.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2376d9d640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23640039b0 0x7f2364003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2376d9d640 1 -- 172.21.15.172:0/975133237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2364004800 msgr2=0x7f2364004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2376d9d640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2364004800 0x7f2364004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f2376d9d640 1 -- 172.21.15.172:0/975133237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364003520 con 0x7f23640051c0 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.920+0000 7f237659c640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23640039b0 0x7f2364003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f2376d9d640 1 -- 172.21.15.172:0/975133237 reap_dead start 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f2376d9d640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23640051c0 0x7f236400b9c0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f2370001e50 tx=0x7f2364005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393e8204089a5f2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370001a70 con 0x7f23640051c0 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370003970 con 0x7f23640051c0 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f2375d9b640 1 -- 172.21.15.172:0/975133237 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370003d60 con 0x7f23640051c0 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f237c8e4640 1 -- 172.21.15.172:0/975133237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23640051c0 msgr2=0x7f236400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f237c8e4640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23640051c0 0x7f236400b9c0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f2370001e50 tx=0x7f2364005830 comp rx=0 tx=0).stop 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f237c8e4640 1 -- 172.21.15.172:0/975133237 shutdown_connections 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f237c8e4640 1 --2- 172.21.15.172:0/975133237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23640051c0 0x7f236400b9c0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f237c8e4640 1 -- 172.21.15.172:0/975133237 >> 172.21.15.172:0/975133237 conn(0x7f23780cfec0 msgr2=0x7f23780d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:49.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f237c8e4640 1 -- 172.21.15.172:0/975133237 shutdown_connections 2024-04-25T08:49:49.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.921+0000 7f237c8e4640 1 -- 172.21.15.172:0/975133237 wait complete. 2024-04-25T08:49:49.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.923+0000 7f237c8e4640 1 Processor -- start 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.923+0000 7f237c8e4640 1 -- start start 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.923+0000 7f237c8e4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23640051c0 0x7f2378153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.923+0000 7f237c8e4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23781e65f0 0x7f23781e8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.923+0000 7f237c8e4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23781e6a70 0x7f23781e9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.923+0000 7f237c8e4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780b2fd0 con 0x7f23781e65f0 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.923+0000 7f237c8e4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237806b520 con 0x7f23640051c0 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.923+0000 7f237c8e4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23780b3150 con 0x7f23781e6a70 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23781e65f0 0x7f23781e8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23781e65f0 0x7f23781e8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58534/0 (socket says 172.21.15.172:58534) 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236ffff640 1 -- 172.21.15.172:0/2561601740 learned_addr learned my addr 172.21.15.172:0/2561601740 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f237659c640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23640051c0 0x7f2378153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f2376d9d640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23781e6a70 0x7f23781e9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236ffff640 1 -- 172.21.15.172:0/2561601740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23781e6a70 msgr2=0x7f23781e9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236ffff640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23781e6a70 0x7f23781e9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236ffff640 1 -- 172.21.15.172:0/2561601740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23640051c0 msgr2=0x7f2378153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236ffff640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23640051c0 0x7f2378153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236ffff640 1 -- 172.21.15.172:0/2561601740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23781538d0 con 0x7f23781e65f0 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236ffff640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23781e65f0 0x7f23781e8d30 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2360011590 tx=0x7f2360011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236effd640 1 -- 172.21.15.172:0/2561601740 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360019070 con 0x7f23781e65f0 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236effd640 1 -- 172.21.15.172:0/2561601740 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2360004220 con 0x7f23781e65f0 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f237c8e4640 1 -- 172.21.15.172:0/2561601740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2378155d50 con 0x7f23781e65f0 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f236effd640 1 -- 172.21.15.172:0/2561601740 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236000f040 con 0x7f23781e65f0 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.924+0000 7f237c8e4640 1 -- 172.21.15.172:0/2561601740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2378156310 con 0x7f23781e65f0 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.925+0000 7f237c8e4640 1 -- 172.21.15.172:0/2561601740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2378073a00 con 0x7f23781e65f0 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.926+0000 7f236effd640 1 -- 172.21.15.172:0/2561601740 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2360015670 con 0x7f23781e65f0 2024-04-25T08:49:49.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.926+0000 7f236effd640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f235806b500 0x7f235806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:49.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.926+0000 7f236effd640 1 -- 172.21.15.172:0/2561601740 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f236008a530 con 0x7f23781e65f0 2024-04-25T08:49:49.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.926+0000 7f237659c640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f235806b500 0x7f235806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:49.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.927+0000 7f237659c640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f235806b500 0x7f235806d9c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f237815cfe0 tx=0x7f2368009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:49.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:49.930+0000 7f236effd640 1 -- 172.21.15.172:0/2561601740 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2360059220 con 0x7f23781e65f0 2024-04-25T08:49:50.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.101+0000 7f237c8e4640 1 -- 172.21.15.172:0/2561601740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2378159cb0 con 0x7f23781e65f0 2024-04-25T08:49:50.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.101+0000 7f236effd640 1 -- 172.21.15.172:0/2561601740 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2360058b20 con 0x7f23781e65f0 2024-04-25T08:49:50.092 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:49:50.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 -- 172.21.15.172:0/2561601740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f235806b500 msgr2=0x7f235806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f235806b500 0x7f235806d9c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f237815cfe0 tx=0x7f2368009040 comp rx=0 tx=0).stop 2024-04-25T08:49:50.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 -- 172.21.15.172:0/2561601740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23781e65f0 msgr2=0x7f23781e8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23781e65f0 0x7f23781e8d30 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f2360011590 tx=0x7f2360011a50 comp rx=0 tx=0).stop 2024-04-25T08:49:50.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 -- 172.21.15.172:0/2561601740 shutdown_connections 2024-04-25T08:49:50.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f235806b500 0x7f235806d9c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f23781e6a70 0x7f23781e9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23781e65f0 0x7f23781e8d30 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 --2- 172.21.15.172:0/2561601740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23640051c0 0x7f2378153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 -- 172.21.15.172:0/2561601740 >> 172.21.15.172:0/2561601740 conn(0x7f23780cfec0 msgr2=0x7f237806e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:50.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 -- 172.21.15.172:0/2561601740 shutdown_connections 2024-04-25T08:49:50.095 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.103+0000 7f237c8e4640 1 -- 172.21.15.172:0/2561601740 wait complete. 2024-04-25T08:49:50.105 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:50.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.212+0000 7fda68d9e640 1 Processor -- start 2024-04-25T08:49:50.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.212+0000 7fda68d9e640 1 -- start start 2024-04-25T08:49:50.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda68d9e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fda640cfec0 0x7fda640cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda68d9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda640ce3c0 0x7fda6406d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda68d9e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda64071480 con 0x7fda64154ee0 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda68d9e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda640ce830 con 0x7fda640cfec0 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda68d9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda64072090 con 0x7fda640ce3c0 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda6259c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fda64154ee0 0x7fda640cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39858/0 (socket says 172.21.15.172:39858) 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda6259c640 1 -- 172.21.15.172:0/1797978733 learned_addr learned my addr 172.21.15.172:0/1797978733 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda61d9b640 1 --2- 172.21.15.172:0/1797978733 >> v2:172.21.15.186:3300/0 conn(0x7fda640cfec0 0x7fda640cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda62d9d640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda640ce3c0 0x7fda6406d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734031804 0 0) 0x7fda64071480 con 0x7fda64154ee0 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.213+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda4c003520 con 0x7fda64154ee0 2024-04-25T08:49:50.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2492141470 0 0) 0x7fda4c003520 con 0x7fda64154ee0 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda640ce3c0 msgr2=0x7fda6406d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda640ce3c0 0x7fda6406d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 >> v2:172.21.15.186:3300/0 conn(0x7fda640cfec0 msgr2=0x7fda640cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 --2- 172.21.15.172:0/1797978733 >> v2:172.21.15.186:3300/0 conn(0x7fda640cfec0 0x7fda640cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda64071760 con 0x7fda64154ee0 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fda540019f0 con 0x7fda64154ee0 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 >> v1:172.21.15.172:6789/0 conn(0x7fda64154ee0 legacy=0x7fda640cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda4c0039b0 0x7fda4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 0x7fda4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda640ce3c0 0x7fda4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640ce830 con 0x7fda4c004800 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c00b9c0 con 0x7fda4c0039b0 2024-04-25T08:49:50.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c00bb40 con 0x7fda640ce3c0 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda61d9b640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 0x7fda4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda6259c640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda4c0039b0 0x7fda4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda62d9d640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda640ce3c0 0x7fda4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda61d9b640 1 -- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda640ce3c0 msgr2=0x7fda4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda61d9b640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda640ce3c0 0x7fda4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda61d9b640 1 -- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda4c0039b0 msgr2=0x7fda4c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda61d9b640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda4c0039b0 0x7fda4c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.214+0000 7fda61d9b640 1 -- 172.21.15.172:0/1797978733 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c003520 con 0x7fda4c004800 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.215+0000 7fda61d9b640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 0x7fda4c004c80 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fda58009ac0 tx=0x7fda4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cf9c6b21104bb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.215+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58036070 con 0x7fda4c004800 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.215+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58031400 con 0x7fda4c004800 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.215+0000 7fda6159a640 1 -- 172.21.15.172:0/1797978733 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58009690 con 0x7fda4c004800 2024-04-25T08:49:50.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.215+0000 7fda68d9e640 1 -- 172.21.15.172:0/1797978733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 msgr2=0x7fda4c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.215+0000 7fda68d9e640 1 --2- 172.21.15.172:0/1797978733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 0x7fda4c004c80 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fda58009ac0 tx=0x7fda4c005830 comp rx=0 tx=0).stop 2024-04-25T08:49:50.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.215+0000 7fda62d9d640 1 -- 172.21.15.172:0/1797978733 reap_dead start 2024-04-25T08:49:50.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.216+0000 7fda68d9e640 1 -- 172.21.15.172:0/1797978733 shutdown_connections 2024-04-25T08:49:50.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.216+0000 7fda68d9e640 1 -- 172.21.15.172:0/1797978733 >> 172.21.15.172:0/1797978733 conn(0x7fda6406abe0 msgr2=0x7fda6406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:50.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.216+0000 7fda68d9e640 1 -- 172.21.15.172:0/1797978733 shutdown_connections 2024-04-25T08:49:50.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.216+0000 7fda68d9e640 1 -- 172.21.15.172:0/1797978733 wait complete. 2024-04-25T08:49:50.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.217+0000 7fda68d9e640 1 Processor -- start 2024-04-25T08:49:50.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.217+0000 7fda68d9e640 1 -- start start 2024-04-25T08:49:50.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda68d9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 0x7fda64152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda68d9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda640a8eb0 0x7fda640a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda68d9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda64157070 0x7fda641574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda68d9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda64071d20 con 0x7fda4c004800 2024-04-25T08:49:50.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda68d9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda64071230 con 0x7fda640a8eb0 2024-04-25T08:49:50.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda68d9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda641552c0 con 0x7fda64157070 2024-04-25T08:49:50.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda6259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 0x7fda64152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda6259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 0x7fda64152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58554/0 (socket says 172.21.15.172:58554) 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda6259c640 1 -- 172.21.15.172:0/4162472380 learned_addr learned my addr 172.21.15.172:0/4162472380 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda62d9d640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda64157070 0x7fda641574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda61d9b640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda640a8eb0 0x7fda640a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda6259c640 1 -- 172.21.15.172:0/4162472380 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda64157070 msgr2=0x7fda641574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda6259c640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda64157070 0x7fda641574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda6259c640 1 -- 172.21.15.172:0/4162472380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda640a8eb0 msgr2=0x7fda640a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda6259c640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda640a8eb0 0x7fda640a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda6259c640 1 -- 172.21.15.172:0/4162472380 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda64157c50 con 0x7fda4c004800 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda6259c640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 0x7fda64152150 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fda54007a50 tx=0x7fda5400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda52ffd640 1 -- 172.21.15.172:0/4162472380 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54013420 con 0x7fda4c004800 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda52ffd640 1 -- 172.21.15.172:0/4162472380 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda54018070 con 0x7fda4c004800 2024-04-25T08:49:50.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda52ffd640 1 -- 172.21.15.172:0/4162472380 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54013820 con 0x7fda4c004800 2024-04-25T08:49:50.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda68d9e640 1 -- 172.21.15.172:0/4162472380 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda64157f30 con 0x7fda4c004800 2024-04-25T08:49:50.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.218+0000 7fda68d9e640 1 -- 172.21.15.172:0/4162472380 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda64152690 con 0x7fda4c004800 2024-04-25T08:49:50.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.219+0000 7fda68d9e640 1 -- 172.21.15.172:0/4162472380 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda64073990 con 0x7fda4c004800 2024-04-25T08:49:50.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.220+0000 7fda52ffd640 1 -- 172.21.15.172:0/4162472380 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda540139c0 con 0x7fda4c004800 2024-04-25T08:49:50.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.220+0000 7fda52ffd640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4406b440 0x7fda4406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.220+0000 7fda52ffd640 1 -- 172.21.15.172:0/4162472380 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fda5408ab90 con 0x7fda4c004800 2024-04-25T08:49:50.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.220+0000 7fda61d9b640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4406b440 0x7fda4406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.221+0000 7fda61d9b640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4406b440 0x7fda4406d900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fda58033000 tx=0x7fda58008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:50.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.224+0000 7fda52ffd640 1 -- 172.21.15.172:0/4162472380 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda54059880 con 0x7fda4c004800 2024-04-25T08:49:50.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.428+0000 7fda68d9e640 1 -- 172.21.15.172:0/4162472380 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda6406d360 con 0x7fda4c004800 2024-04-25T08:49:50.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.428+0000 7fda52ffd640 1 -- 172.21.15.172:0/4162472380 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fda54059180 con 0x7fda4c004800 2024-04-25T08:49:50.419 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:50.419 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.430+0000 7fda68d9e640 1 -- 172.21.15.172:0/4162472380 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4406b440 msgr2=0x7fda4406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.430+0000 7fda68d9e640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4406b440 0x7fda4406d900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fda58033000 tx=0x7fda58008030 comp rx=0 tx=0).stop 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.430+0000 7fda68d9e640 1 -- 172.21.15.172:0/4162472380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 msgr2=0x7fda64152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.430+0000 7fda68d9e640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 0x7fda64152150 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fda54007a50 tx=0x7fda5400e530 comp rx=0 tx=0).stop 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.430+0000 7fda68d9e640 1 -- 172.21.15.172:0/4162472380 shutdown_connections 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.430+0000 7fda68d9e640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda4406b440 0x7fda4406d900 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.430+0000 7fda68d9e640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda640a8eb0 0x7fda640a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.430+0000 7fda68d9e640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda64157070 0x7fda641574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.430+0000 7fda68d9e640 1 --2- 172.21.15.172:0/4162472380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda4c004800 0x7fda64152150 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.430+0000 7fda68d9e640 1 -- 172.21.15.172:0/4162472380 >> 172.21.15.172:0/4162472380 conn(0x7fda6406abe0 msgr2=0x7fda64152c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.431+0000 7fda68d9e640 1 -- 172.21.15.172:0/4162472380 shutdown_connections 2024-04-25T08:49:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.431+0000 7fda68d9e640 1 -- 172.21.15.172:0/4162472380 wait complete. 2024-04-25T08:49:50.433 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:50.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.539+0000 7fc9af46a640 1 Processor -- start 2024-04-25T08:49:50.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.539+0000 7fc9af46a640 1 -- start start 2024-04-25T08:49:50.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc9af46a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a815dc90 0x7fc9a81625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc9af46a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc9a80cc8e0 0x7fc9a815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc9af46a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a815f390 con 0x7fc9a80d1810 2024-04-25T08:49:50.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc9af46a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a80cce50 con 0x7fc9a80cc8e0 2024-04-25T08:49:50.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc9af46a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8161af0 con 0x7fc9a815dc90 2024-04-25T08:49:50.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc9ada07640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc9a80d1810 0x7fc9a80cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39874/0 (socket says 172.21.15.172:39874) 2024-04-25T08:49:50.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc9ada07640 1 -- 172.21.15.172:0/3207294720 learned_addr learned my addr 172.21.15.172:0/3207294720 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:50.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc9aca05640 1 --2- 172.21.15.172:0/3207294720 >> v2:172.21.15.186:3300/0 conn(0x7fc9a80cc8e0 0x7fc9a815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc9ad206640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a815dc90 0x7fc9a81625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291426755 0 0) 0x7fc9a0001490 con 0x7fc9a80d1810 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.540+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc994003520 con 0x7fc9a80d1810 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847204467 0 0) 0x7fc994003520 con 0x7fc9a80d1810 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a815dc90 msgr2=0x7fc9a81625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a815dc90 0x7fc9a81625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 >> v2:172.21.15.186:3300/0 conn(0x7fc9a80cc8e0 msgr2=0x7fc9a815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 --2- 172.21.15.172:0/3207294720 >> v2:172.21.15.186:3300/0 conn(0x7fc9a80cc8e0 0x7fc9a815ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a8161dd0 con 0x7fc9a80d1810 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fc9a0001bc0 con 0x7fc9a80d1810 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 >> v1:172.21.15.172:6789/0 conn(0x7fc9a80d1810 legacy=0x7fc9a80cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 0x7fc994003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a815dc90 0x7fc994004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc994004d40 0x7fc9940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80cce50 con 0x7fc9940039b0 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a8161af0 con 0x7fc994004d40 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99400b9c0 con 0x7fc9a815dc90 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc9ad206640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 0x7fc994003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc9ada07640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc994004d40 0x7fc9940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc9aca05640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a815dc90 0x7fc994004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc9ad206640 1 -- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a815dc90 msgr2=0x7fc994004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc9ad206640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a815dc90 0x7fc994004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc9ad206640 1 -- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc994004d40 msgr2=0x7fc9940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:50.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc9ad206640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc994004d40 0x7fc9940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.541+0000 7fc9ad206640 1 -- 172.21.15.172:0/3207294720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994003520 con 0x7fc9940039b0 2024-04-25T08:49:50.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.542+0000 7fc9ad206640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 0x7fc994003dd0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009ac0 tx=0x7fc994005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385b69ff91ab1f76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:50.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.542+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4036070 con 0x7fc9940039b0 2024-04-25T08:49:50.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.542+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4031400 con 0x7fc9940039b0 2024-04-25T08:49:50.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.542+0000 7fc99ffff640 1 -- 172.21.15.172:0/3207294720 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4009690 con 0x7fc9940039b0 2024-04-25T08:49:50.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.543+0000 7fc9af46a640 1 -- 172.21.15.172:0/3207294720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 msgr2=0x7fc994003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.543+0000 7fc9af46a640 1 --2- 172.21.15.172:0/3207294720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 0x7fc994003dd0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009ac0 tx=0x7fc994005830 comp rx=0 tx=0).stop 2024-04-25T08:49:50.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.543+0000 7fc9ada07640 1 -- 172.21.15.172:0/3207294720 reap_dead start 2024-04-25T08:49:50.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.543+0000 7fc9af46a640 1 -- 172.21.15.172:0/3207294720 shutdown_connections 2024-04-25T08:49:50.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.543+0000 7fc9af46a640 1 -- 172.21.15.172:0/3207294720 >> 172.21.15.172:0/3207294720 conn(0x7fc9a806f590 msgr2=0x7fc9a806f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:50.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.543+0000 7fc9af46a640 1 -- 172.21.15.172:0/3207294720 shutdown_connections 2024-04-25T08:49:50.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.543+0000 7fc9af46a640 1 -- 172.21.15.172:0/3207294720 wait complete. 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.544+0000 7fc9af46a640 1 Processor -- start 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.544+0000 7fc9af46a640 1 -- start start 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9af46a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 0x7fc9a80b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9af46a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a81598d0 0x7fc9a81f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9af46a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a80b74e0 0x7fc9a80d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9af46a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a815e070 con 0x7fc9940039b0 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9af46a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a80cd130 con 0x7fc9a81598d0 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9af46a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a815e1f0 con 0x7fc9a80b74e0 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ad206640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 0x7fc9a80b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ad206640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 0x7fc9a80b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58570/0 (socket says 172.21.15.172:58570) 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ad206640 1 -- 172.21.15.172:0/4275192474 learned_addr learned my addr 172.21.15.172:0/4275192474 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9aca05640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a81598d0 0x7fc9a81f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ada07640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a80b74e0 0x7fc9a80d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ad206640 1 -- 172.21.15.172:0/4275192474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a80b74e0 msgr2=0x7fc9a80d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ad206640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a80b74e0 0x7fc9a80d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ad206640 1 -- 172.21.15.172:0/4275192474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a81598d0 msgr2=0x7fc9a81f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ad206640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a81598d0 0x7fc9a81f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ad206640 1 -- 172.21.15.172:0/4275192474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80b4ff0 con 0x7fc9940039b0 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ada07640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a80b74e0 0x7fc9a80d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9aca05640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a81598d0 0x7fc9a81f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9ad206640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 0x7fc9a80b44e0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4034040 tx=0x7fc9a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc99dffb640 1 -- 172.21.15.172:0/4275192474 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4040020 con 0x7fc9940039b0 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc99dffb640 1 -- 172.21.15.172:0/4275192474 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4003940 con 0x7fc9940039b0 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc9af46a640 1 -- 172.21.15.172:0/4275192474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a80b52d0 con 0x7fc9940039b0 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.545+0000 7fc99dffb640 1 -- 172.21.15.172:0/4275192474 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4036040 con 0x7fc9940039b0 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.546+0000 7fc9af46a640 1 -- 172.21.15.172:0/4275192474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a81f4160 con 0x7fc9940039b0 2024-04-25T08:49:50.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.546+0000 7fc9af46a640 1 -- 172.21.15.172:0/4275192474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a8073990 con 0x7fc9940039b0 2024-04-25T08:49:50.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.547+0000 7fc99dffb640 1 -- 172.21.15.172:0/4275192474 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc9a4043020 con 0x7fc9940039b0 2024-04-25T08:49:50.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.547+0000 7fc99dffb640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc98c06b500 0x7fc98c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.547+0000 7fc99dffb640 1 -- 172.21.15.172:0/4275192474 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc9a40aa5b0 con 0x7fc9940039b0 2024-04-25T08:49:50.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.547+0000 7fc9aca05640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc98c06b500 0x7fc98c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.548+0000 7fc9aca05640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc98c06b500 0x7fc98c06d9c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8159140 tx=0x7fc998008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:50.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.551+0000 7fc99dffb640 1 -- 172.21.15.172:0/4275192474 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc9a404a070 con 0x7fc9940039b0 2024-04-25T08:49:50.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.724+0000 7fc9af46a640 1 -- 172.21.15.172:0/4275192474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a80cf6b0 con 0x7fc9940039b0 2024-04-25T08:49:50.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.726+0000 7fc99dffb640 1 -- 172.21.15.172:0/4275192474 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16944 (secure 0 0 0) 0x7fc9a40792a0 con 0x7fc9940039b0 2024-04-25T08:49:50.717 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:50.717 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":107,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:18.717539+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:49:15.250034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T08:49:16.013750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 -- 172.21.15.172:0/4275192474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc98c06b500 msgr2=0x7fc98c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc98c06b500 0x7fc98c06d9c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8159140 tx=0x7fc998008040 comp rx=0 tx=0).stop 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 -- 172.21.15.172:0/4275192474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 msgr2=0x7fc9a80b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 0x7fc9a80b44e0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4034040 tx=0x7fc9a4004730 comp rx=0 tx=0).stop 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 -- 172.21.15.172:0/4275192474 shutdown_connections 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc98c06b500 0x7fc98c06d9c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9a81598d0 0x7fc9a81f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9a80b74e0 0x7fc9a80d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 --2- 172.21.15.172:0/4275192474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9940039b0 0x7fc9a80b44e0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 -- 172.21.15.172:0/4275192474 >> 172.21.15.172:0/4275192474 conn(0x7fc9a806f590 msgr2=0x7fc9a80cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 -- 172.21.15.172:0/4275192474 shutdown_connections 2024-04-25T08:49:50.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.728+0000 7fc9af46a640 1 -- 172.21.15.172:0/4275192474 wait complete. 2024-04-25T08:49:50.730 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:49:50.730 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.836+0000 7fdabb5c1640 1 Processor -- start 2024-04-25T08:49:50.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.836+0000 7fdabb5c1640 1 -- start start 2024-04-25T08:49:50.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.837+0000 7fdabb5c1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab40cc6c0 0x7fdab4071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.837+0000 7fdabb5c1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdab415b320 0x7fdab4071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.837+0000 7fdabb5c1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab4071ed0 con 0x7fdab413d190 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.837+0000 7fdabb5c1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab4071cb0 con 0x7fdab415b320 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.837+0000 7fdabb5c1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab413d570 con 0x7fdab40cc6c0 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.837+0000 7fdab9b5e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdab415b320 0x7fdab4071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.837+0000 7fdab9b5e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdab415b320 0x7fdab4071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58580/0 (socket says 172.21.15.172:58580) 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.837+0000 7fdab9b5e640 1 -- 172.21.15.172:0/1529469299 learned_addr learned my addr 172.21.15.172:0/1529469299 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.838+0000 7fdab8b5c640 1 --2- 172.21.15.172:0/1529469299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab40cc6c0 0x7fdab4071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.838+0000 7fdab9b5e640 1 -- 172.21.15.172:0/1529469299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab40cc6c0 msgr2=0x7fdab4071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.838+0000 7fdab9b5e640 1 --2- 172.21.15.172:0/1529469299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab40cc6c0 0x7fdab4071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.838+0000 7fdab9b5e640 1 -- 172.21.15.172:0/1529469299 >> v1:172.21.15.186:6789/0 conn(0x7fdab413d190 legacy=0x7fdab40cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.838+0000 7fdab9b5e640 1 -- 172.21.15.172:0/1529469299 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab415a840 con 0x7fdab415b320 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.838+0000 7fdab9b5e640 1 --2- 172.21.15.172:0/1529469299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab415b320 0x7fdab4071770 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00d150 tx=0x7fdaac02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76e1aacbd7cb44b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.839+0000 7fdaabfff640 1 -- 172.21.15.172:0/1529469299 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac033500 con 0x7fdab415b320 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.839+0000 7fdaabfff640 1 -- 172.21.15.172:0/1529469299 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac0336a0 con 0x7fdab415b320 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.839+0000 7fdaabfff640 1 -- 172.21.15.172:0/1529469299 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac033a70 con 0x7fdab415b320 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.840+0000 7fdabb5c1640 1 -- 172.21.15.172:0/1529469299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab415b320 msgr2=0x7fdab4071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.840+0000 7fdabb5c1640 1 --2- 172.21.15.172:0/1529469299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab415b320 0x7fdab4071770 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00d150 tx=0x7fdaac02c890 comp rx=0 tx=0).stop 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.840+0000 7fdabb5c1640 1 -- 172.21.15.172:0/1529469299 shutdown_connections 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.840+0000 7fdabb5c1640 1 --2- 172.21.15.172:0/1529469299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab415b320 0x7fdab4071770 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.840+0000 7fdabb5c1640 1 --2- 172.21.15.172:0/1529469299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab40cc6c0 0x7fdab4071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.840+0000 7fdabb5c1640 1 -- 172.21.15.172:0/1529469299 >> 172.21.15.172:0/1529469299 conn(0x7fdab406abe0 msgr2=0x7fdab406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.840+0000 7fdabb5c1640 1 -- 172.21.15.172:0/1529469299 shutdown_connections 2024-04-25T08:49:50.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.840+0000 7fdabb5c1640 1 -- 172.21.15.172:0/1529469299 wait complete. 2024-04-25T08:49:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.841+0000 7fdabb5c1640 1 Processor -- start 2024-04-25T08:49:50.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.841+0000 7fdabb5c1640 1 -- start start 2024-04-25T08:49:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdabb5c1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab40cc6c0 0x7fdab4154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdabb5c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab413d190 0x7fdab406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdabb5c1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab415b320 0x7fdab40af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdabb5c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40cf620 con 0x7fdab413d190 2024-04-25T08:49:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdabb5c1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab415ae00 con 0x7fdab40cc6c0 2024-04-25T08:49:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdabb5c1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40cf7a0 con 0x7fdab415b320 2024-04-25T08:49:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab8b5c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab413d190 0x7fdab406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab8b5c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab413d190 0x7fdab406eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58592/0 (socket says 172.21.15.172:58592) 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab8b5c640 1 -- 172.21.15.172:0/314924327 learned_addr learned my addr 172.21.15.172:0/314924327 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab9b5e640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab415b320 0x7fdab40af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab935d640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab40cc6c0 0x7fdab4154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab8b5c640 1 -- 172.21.15.172:0/314924327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab415b320 msgr2=0x7fdab40af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab8b5c640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab415b320 0x7fdab40af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab8b5c640 1 -- 172.21.15.172:0/314924327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab40cc6c0 msgr2=0x7fdab4154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab8b5c640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab40cc6c0 0x7fdab4154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab8b5c640 1 -- 172.21.15.172:0/314924327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab41efa60 con 0x7fdab413d190 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab935d640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab40cc6c0 0x7fdab4154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.842+0000 7fdab8b5c640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab413d190 0x7fdab406eaa0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400e9b0 tx=0x7fdaa400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.843+0000 7fdaa9ffb640 1 -- 172.21.15.172:0/314924327 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4017070 con 0x7fdab413d190 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.843+0000 7fdaa9ffb640 1 -- 172.21.15.172:0/314924327 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa400c9a0 con 0x7fdab413d190 2024-04-25T08:49:50.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.843+0000 7fdabb5c1640 1 -- 172.21.15.172:0/314924327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab41efd40 con 0x7fdab413d190 2024-04-25T08:49:50.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.843+0000 7fdaa9ffb640 1 -- 172.21.15.172:0/314924327 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400cd90 con 0x7fdab413d190 2024-04-25T08:49:50.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.843+0000 7fdabb5c1640 1 -- 172.21.15.172:0/314924327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab41f0300 con 0x7fdab413d190 2024-04-25T08:49:50.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.844+0000 7fdabb5c1640 1 -- 172.21.15.172:0/314924327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab4073990 con 0x7fdab413d190 2024-04-25T08:49:50.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.844+0000 7fdaa9ffb640 1 -- 172.21.15.172:0/314924327 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdaa401a070 con 0x7fdab413d190 2024-04-25T08:49:50.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.845+0000 7fdaa9ffb640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 0x7fda9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:50.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.845+0000 7fdaa9ffb640 1 -- 172.21.15.172:0/314924327 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdaa408a6c0 con 0x7fdab413d190 2024-04-25T08:49:50.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.845+0000 7fdab935d640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 0x7fda9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:50.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.845+0000 7fdab935d640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 0x7fda9806d990 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fdab4159410 tx=0x7fdab0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:50.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:50.849+0000 7fdaa9ffb640 1 -- 172.21.15.172:0/314924327 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdaa4058d60 con 0x7fdab413d190 2024-04-25T08:49:51.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.055+0000 7fdabb5c1640 1 -- 172.21.15.172:0/314924327 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdab40cfeb0 con 0x7fdab413d190 2024-04-25T08:49:51.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.055+0000 7fdaa9ffb640 1 -- 172.21.15.172:0/314924327 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fdaa405ce00 con 0x7fdab413d190 2024-04-25T08:49:51.046 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:51.047 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:51.047 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:51.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 -- 172.21.15.172:0/314924327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 msgr2=0x7fda9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 0x7fda9806d990 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fdab4159410 tx=0x7fdab0009040 comp rx=0 tx=0).stop 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 -- 172.21.15.172:0/314924327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab413d190 msgr2=0x7fdab406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab413d190 0x7fdab406eaa0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400e9b0 tx=0x7fdaa400ee70 comp rx=0 tx=0).stop 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 -- 172.21.15.172:0/314924327 shutdown_connections 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda9806b4d0 0x7fda9806d990 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdab415b320 0x7fdab40af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab413d190 0x7fdab406eaa0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 --2- 172.21.15.172:0/314924327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdab40cc6c0 0x7fdab4154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 -- 172.21.15.172:0/314924327 >> 172.21.15.172:0/314924327 conn(0x7fdab406abe0 msgr2=0x7fdab41566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 -- 172.21.15.172:0/314924327 shutdown_connections 2024-04-25T08:49:51.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.057+0000 7fdabb5c1640 1 -- 172.21.15.172:0/314924327 wait complete. 2024-04-25T08:49:51.060 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:51.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.166+0000 7f6bf4be2640 1 Processor -- start 2024-04-25T08:49:51.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.166+0000 7f6bf4be2640 1 -- start start 2024-04-25T08:49:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.167+0000 7f6bf4be2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6bf00ce330 0x7f6bf006fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.167+0000 7f6bf4be2640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6bf00700a0 0x7f6bf015d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.167+0000 7f6bf4be2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf01626e0 con 0x7f6bf006abe0 2024-04-25T08:49:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.167+0000 7f6bf4be2640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00cd270 con 0x7f6bf00700a0 2024-04-25T08:49:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.167+0000 7f6bf4be2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00cd550 con 0x7f6bf00ce330 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.167+0000 7f6beed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6bf00700a0 0x7f6bf015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.167+0000 7f6beed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6bf00700a0 0x7f6bf015d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58598/0 (socket says 172.21.15.172:58598) 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.167+0000 7f6beed9d640 1 -- 172.21.15.172:0/3319429899 learned_addr learned my addr 172.21.15.172:0/3319429899 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.167+0000 7f6bedd9b640 1 --2- 172.21.15.172:0/3319429899 >> v2:172.21.15.186:3300/0 conn(0x7f6bf00ce330 0x7f6bf006fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.168+0000 7f6beed9d640 1 -- 172.21.15.172:0/3319429899 >> v2:172.21.15.186:3300/0 conn(0x7f6bf00ce330 msgr2=0x7f6bf006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.168+0000 7f6beed9d640 1 --2- 172.21.15.172:0/3319429899 >> v2:172.21.15.186:3300/0 conn(0x7f6bf00ce330 0x7f6bf006fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.168+0000 7f6beed9d640 1 -- 172.21.15.172:0/3319429899 >> v1:172.21.15.186:6789/0 conn(0x7f6bf006abe0 legacy=0x7f6bf006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.168+0000 7f6beed9d640 1 -- 172.21.15.172:0/3319429899 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00cd830 con 0x7f6bf00700a0 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.168+0000 7f6beed9d640 1 --2- 172.21.15.172:0/3319429899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf00700a0 0x7f6bf015d370 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0068860 tx=0x7f6be802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d07c3071d0bf892 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.168+0000 7f6bed59a640 1 -- 172.21.15.172:0/3319429899 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8037070 con 0x7f6bf00700a0 2024-04-25T08:49:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.168+0000 7f6bed59a640 1 -- 172.21.15.172:0/3319429899 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be8032440 con 0x7f6bf00700a0 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.168+0000 7f6bed59a640 1 -- 172.21.15.172:0/3319429899 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8032810 con 0x7f6bf00700a0 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.169+0000 7f6bf4be2640 1 -- 172.21.15.172:0/3319429899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf00700a0 msgr2=0x7f6bf015d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.169+0000 7f6bf4be2640 1 --2- 172.21.15.172:0/3319429899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf00700a0 0x7f6bf015d370 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0068860 tx=0x7f6be802a1a0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.169+0000 7f6bf4be2640 1 -- 172.21.15.172:0/3319429899 shutdown_connections 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.169+0000 7f6bf4be2640 1 --2- 172.21.15.172:0/3319429899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf00700a0 0x7f6bf015d370 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.169+0000 7f6bf4be2640 1 --2- 172.21.15.172:0/3319429899 >> v2:172.21.15.186:3300/0 conn(0x7f6bf00ce330 0x7f6bf006fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.169+0000 7f6bf4be2640 1 -- 172.21.15.172:0/3319429899 >> 172.21.15.172:0/3319429899 conn(0x7f6bf00b2220 msgr2=0x7f6bf00b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.169+0000 7f6bf4be2640 1 -- 172.21.15.172:0/3319429899 shutdown_connections 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.169+0000 7f6bf4be2640 1 -- 172.21.15.172:0/3319429899 wait complete. 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.170+0000 7f6bf4be2640 1 Processor -- start 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.170+0000 7f6bf4be2640 1 -- start start 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6bf4be2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf006abe0 0x7f6bf01607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6bf4be2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bf00700a0 0x7f6bf00b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6bf4be2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6bf00ce330 0x7f6bf0158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6bf4be2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf015d8b0 con 0x7f6bf006abe0 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6bf4be2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0161780 con 0x7f6bf00700a0 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6bf4be2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf015da30 con 0x7f6bf00ce330 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6bee59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf006abe0 0x7f6bf01607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6bee59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf006abe0 0x7f6bf01607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58602/0 (socket says 172.21.15.172:58602) 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6bee59c640 1 -- 172.21.15.172:0/1179634460 learned_addr learned my addr 172.21.15.172:0/1179634460 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6bedd9b640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bf00700a0 0x7f6bf00b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.171+0000 7f6beed9d640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6bf00ce330 0x7f6bf0158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bee59c640 1 -- 172.21.15.172:0/1179634460 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6bf00ce330 msgr2=0x7f6bf0158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bee59c640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6bf00ce330 0x7f6bf0158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bee59c640 1 -- 172.21.15.172:0/1179634460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bf00700a0 msgr2=0x7f6bf00b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bee59c640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bf00700a0 0x7f6bf00b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bee59c640 1 -- 172.21.15.172:0/1179634460 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00b3890 con 0x7f6bf006abe0 2024-04-25T08:49:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bedd9b640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bf00700a0 0x7f6bf00b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bee59c640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf006abe0 0x7f6bf01607c0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f6be000c7c0 tx=0x7f6be000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bdeffd640 1 -- 172.21.15.172:0/1179634460 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0016020 con 0x7f6bf006abe0 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bdeffd640 1 -- 172.21.15.172:0/1179634460 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be000aa50 con 0x7f6bf006abe0 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bf4be2640 1 -- 172.21.15.172:0/1179634460 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf00b3b70 con 0x7f6bf006abe0 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bdeffd640 1 -- 172.21.15.172:0/1179634460 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0012420 con 0x7f6bf006abe0 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.172+0000 7f6bf4be2640 1 -- 172.21.15.172:0/1179634460 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf00b4130 con 0x7f6bf006abe0 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.173+0000 7f6bf4be2640 1 -- 172.21.15.172:0/1179634460 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf01610e0 con 0x7f6bf006abe0 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.173+0000 7f6bdeffd640 1 -- 172.21.15.172:0/1179634460 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6be0019020 con 0x7f6bf006abe0 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.174+0000 7f6bdeffd640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6bd006b4d0 0x7f6bd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.174+0000 7f6bdeffd640 1 -- 172.21.15.172:0/1179634460 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6be0089fb0 con 0x7f6bf006abe0 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.174+0000 7f6bedd9b640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6bd006b4d0 0x7f6bd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.174+0000 7f6bedd9b640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6bd006b4d0 0x7f6bd006d990 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6be4006fd0 tx=0x7f6be4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.178+0000 7f6bdeffd640 1 -- 172.21.15.172:0/1179634460 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6bf01610e0 con 0x7f6bf006abe0 2024-04-25T08:49:51.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.383+0000 7f6bf4be2640 1 -- 172.21.15.172:0/1179634460 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bf00afe50 con 0x7f6bf006abe0 2024-04-25T08:49:51.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.384+0000 7f6bdeffd640 1 -- 172.21.15.172:0/1179634460 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f6be0020070 con 0x7f6bf006abe0 2024-04-25T08:49:51.375 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:51.375 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":62,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:49:17.044496+0000","modified":"2024-04-25T08:49:19.066995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8124},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8124":{"gid":8124,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6835/3937459499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3937459499},{"type":"v1","addr":"172.21.15.186:6835","nonce":3937459499}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T08:49:51.375 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 62 2024-04-25T08:49:51.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 -- 172.21.15.172:0/1179634460 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6bd006b4d0 msgr2=0x7f6bd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6bd006b4d0 0x7f6bd006d990 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6be4006fd0 tx=0x7f6be4008040 comp rx=0 tx=0).stop 2024-04-25T08:49:51.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 -- 172.21.15.172:0/1179634460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf006abe0 msgr2=0x7f6bf01607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf006abe0 0x7f6bf01607c0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f6be000c7c0 tx=0x7f6be000cc80 comp rx=0 tx=0).stop 2024-04-25T08:49:51.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 -- 172.21.15.172:0/1179634460 shutdown_connections 2024-04-25T08:49:51.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6bd006b4d0 0x7f6bd006d990 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6bf00700a0 0x7f6bf00b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6bf00ce330 0x7f6bf0158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 --2- 172.21.15.172:0/1179634460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bf006abe0 0x7f6bf01607c0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 -- 172.21.15.172:0/1179634460 >> 172.21.15.172:0/1179634460 conn(0x7f6bf00b2220 msgr2=0x7f6bf015d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:51.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 -- 172.21.15.172:0/1179634460 shutdown_connections 2024-04-25T08:49:51.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.386+0000 7f6bf4be2640 1 -- 172.21.15.172:0/1179634460 wait complete. 2024-04-25T08:49:51.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:51.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.495+0000 7f4cae4f5640 1 Processor -- start 2024-04-25T08:49:51.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.495+0000 7f4cae4f5640 1 -- start start 2024-04-25T08:49:51.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.495+0000 7f4cae4f5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4ca8154ed0 0x7f4ca80aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.495+0000 7f4cae4f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8071ac0 0x7f4ca80ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.495+0000 7f4cae4f5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4ca806c1d0 0x7f4ca80ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.495+0000 7f4cae4f5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca815ec60 con 0x7f4ca8154ed0 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.495+0000 7f4cae4f5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca815ef40 con 0x7f4ca806c1d0 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.495+0000 7f4cae4f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca806db90 con 0x7f4ca8071ac0 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4ca7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4ca8154ed0 0x7f4ca80aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4ca7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4ca8154ed0 0x7f4ca80aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58608/0 (socket says 172.21.15.172:58608) 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4ca7fff640 1 -- 172.21.15.172:0/2792218330 learned_addr learned my addr 172.21.15.172:0/2792218330 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4caca92640 1 --2- 172.21.15.172:0/2792218330 >> v2:172.21.15.186:3300/0 conn(0x7f4ca806c1d0 0x7f4ca80ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4ca77fe640 1 --2- 172.21.15.172:0/2792218330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8071ac0 0x7f4ca80ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4ca7fff640 1 -- 172.21.15.172:0/2792218330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8071ac0 msgr2=0x7f4ca80ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4ca7fff640 1 --2- 172.21.15.172:0/2792218330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8071ac0 0x7f4ca80ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4ca7fff640 1 -- 172.21.15.172:0/2792218330 >> v2:172.21.15.186:3300/0 conn(0x7f4ca806c1d0 msgr2=0x7f4ca80ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4ca7fff640 1 --2- 172.21.15.172:0/2792218330 >> v2:172.21.15.186:3300/0 conn(0x7f4ca806c1d0 0x7f4ca80ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4ca7fff640 1 -- 172.21.15.172:0/2792218330 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca806de70 con 0x7f4ca8154ed0 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4caca92640 1 --2- 172.21.15.172:0/2792218330 >> v2:172.21.15.186:3300/0 conn(0x7f4ca806c1d0 0x7f4ca80ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:51.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.496+0000 7f4ca77fe640 1 --2- 172.21.15.172:0/2792218330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8071ac0 0x7f4ca80ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:51.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4ca7fff640 1 --2- 172.21.15.172:0/2792218330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8154ed0 0x7f4ca80aced0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8162890 tx=0x7f4c9c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d0aaf5a1cdb380 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:51.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4ca6ffd640 1 -- 172.21.15.172:0/2792218330 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c037070 con 0x7f4ca8154ed0 2024-04-25T08:49:51.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4ca6ffd640 1 -- 172.21.15.172:0/2792218330 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c032440 con 0x7f4ca8154ed0 2024-04-25T08:49:51.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4ca6ffd640 1 -- 172.21.15.172:0/2792218330 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c032810 con 0x7f4ca8154ed0 2024-04-25T08:49:51.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4cae4f5640 1 -- 172.21.15.172:0/2792218330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8154ed0 msgr2=0x7f4ca80aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4cae4f5640 1 --2- 172.21.15.172:0/2792218330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8154ed0 0x7f4ca80aced0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8162890 tx=0x7f4c9c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4cae4f5640 1 -- 172.21.15.172:0/2792218330 shutdown_connections 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4cae4f5640 1 --2- 172.21.15.172:0/2792218330 >> v2:172.21.15.186:3300/0 conn(0x7f4ca806c1d0 0x7f4ca80ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4cae4f5640 1 --2- 172.21.15.172:0/2792218330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8071ac0 0x7f4ca80ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4cae4f5640 1 --2- 172.21.15.172:0/2792218330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8154ed0 0x7f4ca80aced0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4cae4f5640 1 -- 172.21.15.172:0/2792218330 >> 172.21.15.172:0/2792218330 conn(0x7f4ca80af670 msgr2=0x7f4ca80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4cae4f5640 1 -- 172.21.15.172:0/2792218330 shutdown_connections 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.497+0000 7f4cae4f5640 1 -- 172.21.15.172:0/2792218330 wait complete. 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.498+0000 7f4cae4f5640 1 Processor -- start 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.499+0000 7f4cae4f5640 1 -- start start 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.499+0000 7f4cae4f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8071ac0 0x7f4ca80ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.499+0000 7f4cae4f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8154ed0 0x7f4ca8143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.499+0000 7f4cae4f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ca80cd450 0x7f4ca81510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.499+0000 7f4cae4f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8161ba0 con 0x7f4ca8071ac0 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.499+0000 7f4cae4f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8161a20 con 0x7f4ca80cd450 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.499+0000 7f4cae4f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8161d20 con 0x7f4ca8154ed0 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.499+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8071ac0 0x7f4ca80ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.499+0000 7f4ca7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8071ac0 0x7f4ca80ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58610/0 (socket says 172.21.15.172:58610) 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.499+0000 7f4ca7fff640 1 -- 172.21.15.172:0/1284298931 learned_addr learned my addr 172.21.15.172:0/1284298931 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4caca92640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ca80cd450 0x7f4ca81510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4ca77fe640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8154ed0 0x7f4ca8143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4ca7fff640 1 -- 172.21.15.172:0/1284298931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8154ed0 msgr2=0x7f4ca8143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4ca7fff640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8154ed0 0x7f4ca8143740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4ca7fff640 1 -- 172.21.15.172:0/1284298931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ca80cd450 msgr2=0x7f4ca81510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4ca7fff640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ca80cd450 0x7f4ca81510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4ca7fff640 1 -- 172.21.15.172:0/1284298931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8150e90 con 0x7f4ca8071ac0 2024-04-25T08:49:51.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4caca92640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ca80cd450 0x7f4ca81510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:51.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4ca7fff640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8071ac0 0x7f4ca80ce370 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c000c00 tx=0x7f4c9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:51.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4ca4ff9640 1 -- 172.21.15.172:0/1284298931 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c041020 con 0x7f4ca8071ac0 2024-04-25T08:49:51.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4ca4ff9640 1 -- 172.21.15.172:0/1284298931 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c0306c0 con 0x7f4ca8071ac0 2024-04-25T08:49:51.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4cae4f5640 1 -- 172.21.15.172:0/1284298931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca80ce950 con 0x7f4ca8071ac0 2024-04-25T08:49:51.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4ca4ff9640 1 -- 172.21.15.172:0/1284298931 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c037040 con 0x7f4ca8071ac0 2024-04-25T08:49:51.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.500+0000 7f4cae4f5640 1 -- 172.21.15.172:0/1284298931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca81560c0 con 0x7f4ca8071ac0 2024-04-25T08:49:51.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.501+0000 7f4cae4f5640 1 -- 172.21.15.172:0/1284298931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca80b2b10 con 0x7f4ca8071ac0 2024-04-25T08:49:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.502+0000 7f4ca4ff9640 1 -- 172.21.15.172:0/1284298931 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c9c044020 con 0x7f4ca8071ac0 2024-04-25T08:49:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.502+0000 7f4ca4ff9640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c9406b4d0 0x7f4c9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.502+0000 7f4ca4ff9640 1 -- 172.21.15.172:0/1284298931 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4c9c0aac20 con 0x7f4ca8071ac0 2024-04-25T08:49:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.502+0000 7f4ca77fe640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c9406b4d0 0x7f4c9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.502+0000 7f4ca77fe640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c9406b4d0 0x7f4c9406d990 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4ca81f7460 tx=0x7f4c98008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:51.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.506+0000 7f4ca4ff9640 1 -- 172.21.15.172:0/1284298931 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c9c04b030 con 0x7f4ca8071ac0 2024-04-25T08:49:51.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.677+0000 7f4cae4f5640 1 -- 172.21.15.172:0/1284298931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca8155eb0 con 0x7f4ca8071ac0 2024-04-25T08:49:51.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.678+0000 7f4ca4ff9640 1 -- 172.21.15.172:0/1284298931 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16944 (secure 0 0 0) 0x7f4c9c079880 con 0x7f4ca8071ac0 2024-04-25T08:49:51.669 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:51.670 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":107,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:18.717539+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:49:15.250034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T08:49:16.013750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:51.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.680+0000 7f4cae4f5640 1 -- 172.21.15.172:0/1284298931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c9406b4d0 msgr2=0x7f4c9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.680+0000 7f4cae4f5640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c9406b4d0 0x7f4c9406d990 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4ca81f7460 tx=0x7f4c98008040 comp rx=0 tx=0).stop 2024-04-25T08:49:51.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.680+0000 7f4cae4f5640 1 -- 172.21.15.172:0/1284298931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8071ac0 msgr2=0x7f4ca80ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.680+0000 7f4cae4f5640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8071ac0 0x7f4ca80ce370 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c000c00 tx=0x7f4c9c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.680+0000 7f4cae4f5640 1 -- 172.21.15.172:0/1284298931 shutdown_connections 2024-04-25T08:49:51.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.680+0000 7f4cae4f5640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c9406b4d0 0x7f4c9406d990 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.680+0000 7f4cae4f5640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ca80cd450 0x7f4ca81510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.680+0000 7f4cae4f5640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ca8154ed0 0x7f4ca8143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.680+0000 7f4cae4f5640 1 --2- 172.21.15.172:0/1284298931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ca8071ac0 0x7f4ca80ce370 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.680+0000 7f4cae4f5640 1 -- 172.21.15.172:0/1284298931 >> 172.21.15.172:0/1284298931 conn(0x7f4ca806c1d0 msgr2=0x7f4ca80d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:51.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.681+0000 7f4cae4f5640 1 -- 172.21.15.172:0/1284298931 shutdown_connections 2024-04-25T08:49:51.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.681+0000 7f4cae4f5640 1 -- 172.21.15.172:0/1284298931 wait complete. 2024-04-25T08:49:51.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:49:51.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.790+0000 7fb9f5d7e640 1 Processor -- start 2024-04-25T08:49:51.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.790+0000 7fb9f5d7e640 1 -- start start 2024-04-25T08:49:51.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.791+0000 7fb9f5d7e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f00b38d0 0x7fb9f00b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.791+0000 7fb9f5d7e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f015e020 con 0x7fb9f006e360 2024-04-25T08:49:51.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.791+0000 7fb9f5d7e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f006ac80 con 0x7fb9f006bd20 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.791+0000 7fb9f5d7e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f006b890 con 0x7fb9f00b38d0 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.791+0000 7fb9ef7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb9f006e360 0x7fb9f006e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39886/0 (socket says 172.21.15.172:39886) 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.791+0000 7fb9ef7fe640 1 -- 172.21.15.172:0/1634126661 learned_addr learned my addr 172.21.15.172:0/1634126661 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.791+0000 7fb9eeffd640 1 --2- 172.21.15.172:0/1634126661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f00b38d0 0x7fb9f00b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.792+0000 7fb9ee7fc640 1 -- 172.21.15.172:0/1634126661 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924228496 0 0) 0x7fb9f015e020 con 0x7fb9f006e360 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.792+0000 7fb9ee7fc640 1 -- 172.21.15.172:0/1634126661 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d8003520 con 0x7fb9f006e360 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.792+0000 7fb9ee7fc640 1 -- 172.21.15.172:0/1634126661 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343799348 0 0) 0x7fb9f006ac80 con 0x7fb9f006bd20 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.792+0000 7fb9ee7fc640 1 -- 172.21.15.172:0/1634126661 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9f015e020 con 0x7fb9f006bd20 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.792+0000 7fb9ee7fc640 1 -- 172.21.15.172:0/1634126661 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 986654123 0 0) 0x7fb9d8003520 con 0x7fb9f006e360 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.792+0000 7fb9eeffd640 1 -- 172.21.15.172:0/1634126661 >> v1:172.21.15.186:6789/0 conn(0x7fb9f006bd20 legacy=0x7fb9f00acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.792+0000 7fb9eeffd640 1 -- 172.21.15.172:0/1634126661 >> v1:172.21.15.172:6789/0 conn(0x7fb9f006e360 legacy=0x7fb9f006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.792+0000 7fb9eeffd640 1 -- 172.21.15.172:0/1634126661 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f006af60 con 0x7fb9f00b38d0 2024-04-25T08:49:51.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.793+0000 7fb9eeffd640 1 --2- 172.21.15.172:0/1634126661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f00b38d0 0x7fb9f00b3d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40097d0 tx=0x7fb9e402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d8715732906add4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:51.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.793+0000 7fb9ee7fc640 1 -- 172.21.15.172:0/1634126661 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4037070 con 0x7fb9f00b38d0 2024-04-25T08:49:51.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.793+0000 7fb9ee7fc640 1 -- 172.21.15.172:0/1634126661 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e402acc0 con 0x7fb9f00b38d0 2024-04-25T08:49:51.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.793+0000 7fb9ee7fc640 1 -- 172.21.15.172:0/1634126661 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00019f0 con 0x7fb9f00b38d0 2024-04-25T08:49:51.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.793+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/1634126661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f00b38d0 msgr2=0x7fb9f00b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.793+0000 7fb9f5d7e640 1 --2- 172.21.15.172:0/1634126661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f00b38d0 0x7fb9f00b3d10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40097d0 tx=0x7fb9e402a230 comp rx=0 tx=0).stop 2024-04-25T08:49:51.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.793+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/1634126661 shutdown_connections 2024-04-25T08:49:51.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.793+0000 7fb9f5d7e640 1 --2- 172.21.15.172:0/1634126661 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f00b38d0 0x7fb9f00b3d10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.793+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/1634126661 >> 172.21.15.172:0/1634126661 conn(0x7fb9f00cfec0 msgr2=0x7fb9f00d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:51.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.793+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/1634126661 shutdown_connections 2024-04-25T08:49:51.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.794+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/1634126661 wait complete. 2024-04-25T08:49:51.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.795+0000 7fb9f5d7e640 1 Processor -- start 2024-04-25T08:49:51.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.795+0000 7fb9f5d7e640 1 -- start start 2024-04-25T08:49:51.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.795+0000 7fb9f5d7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f006bd20 0x7fb9f01482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.795+0000 7fb9f5d7e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f006e360 0x7fb9f0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9f5d7e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9f00b38d0 0x7fb9f0156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9f5d7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f006ee50 con 0x7fb9f006bd20 2024-04-25T08:49:51.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9f5d7e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f006b520 con 0x7fb9f00b38d0 2024-04-25T08:49:51.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9f5d7e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f00b2fd0 con 0x7fb9f006e360 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9ef7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f006bd20 0x7fb9f01482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9ef7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f006bd20 0x7fb9f01482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58624/0 (socket says 172.21.15.172:58624) 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9ef7fe640 1 -- 172.21.15.172:0/3990709686 learned_addr learned my addr 172.21.15.172:0/3990709686 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9eeffd640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f006e360 0x7fb9f0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9effff640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9f00b38d0 0x7fb9f0156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9ef7fe640 1 -- 172.21.15.172:0/3990709686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f006e360 msgr2=0x7fb9f0156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9ef7fe640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f006e360 0x7fb9f0156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9ef7fe640 1 -- 172.21.15.172:0/3990709686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9f00b38d0 msgr2=0x7fb9f0156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9ef7fe640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9f00b38d0 0x7fb9f0156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9ef7fe640 1 -- 172.21.15.172:0/3990709686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f00afa60 con 0x7fb9f006bd20 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9ef7fe640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f006bd20 0x7fb9f01482c0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0001f50 tx=0x7fb9e000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:51.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9d7fff640 1 -- 172.21.15.172:0/3990709686 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0017070 con 0x7fb9f006bd20 2024-04-25T08:49:51.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9d7fff640 1 -- 172.21.15.172:0/3990709686 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0012400 con 0x7fb9f006bd20 2024-04-25T08:49:51.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/3990709686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f00afd40 con 0x7fb9f006bd20 2024-04-25T08:49:51.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9d7fff640 1 -- 172.21.15.172:0/3990709686 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00127f0 con 0x7fb9f006bd20 2024-04-25T08:49:51.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.796+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/3990709686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f00b0300 con 0x7fb9f006bd20 2024-04-25T08:49:51.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.797+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/3990709686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f0073a00 con 0x7fb9f006bd20 2024-04-25T08:49:51.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.798+0000 7fb9d7fff640 1 -- 172.21.15.172:0/3990709686 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9e001a070 con 0x7fb9f006bd20 2024-04-25T08:49:51.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.798+0000 7fb9d7fff640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 0x7fb9dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:51.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.798+0000 7fb9eeffd640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 0x7fb9dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:51.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.798+0000 7fb9d7fff640 1 -- 172.21.15.172:0/3990709686 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb9e008a2a0 con 0x7fb9f006bd20 2024-04-25T08:49:51.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.799+0000 7fb9eeffd640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 0x7fb9dc06d990 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4034000 tx=0x7fb9e402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:51.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:51.803+0000 7fb9d7fff640 1 -- 172.21.15.172:0/3990709686 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9e00589d0 con 0x7fb9f006bd20 2024-04-25T08:49:51.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.008+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/3990709686 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb9f00b18f0 con 0x7fb9f006bd20 2024-04-25T08:49:51.999 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:49:52.009+0000 7f9412b2f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:49:52.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.010+0000 7fb9d7fff640 1 -- 172.21.15.172:0/3990709686 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb9e005ca70 con 0x7fb9f006bd20 2024-04-25T08:49:52.001 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:49:52.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.012+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/3990709686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 msgr2=0x7fb9dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:52.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.012+0000 7fb9f5d7e640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 0x7fb9dc06d990 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4034000 tx=0x7fb9e402e000 comp rx=0 tx=0).stop 2024-04-25T08:49:52.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.012+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/3990709686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f006bd20 msgr2=0x7fb9f01482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:52.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.012+0000 7fb9f5d7e640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f006bd20 0x7fb9f01482c0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0001f50 tx=0x7fb9e000a430 comp rx=0 tx=0).stop 2024-04-25T08:49:52.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.012+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/3990709686 shutdown_connections 2024-04-25T08:49:52.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.013+0000 7fb9f5d7e640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 0x7fb9dc06d990 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.013+0000 7fb9f5d7e640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9f00b38d0 0x7fb9f0156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.013+0000 7fb9f5d7e640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f006e360 0x7fb9f0156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.013+0000 7fb9f5d7e640 1 --2- 172.21.15.172:0/3990709686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f006bd20 0x7fb9f01482c0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.013+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/3990709686 >> 172.21.15.172:0/3990709686 conn(0x7fb9f00cfec0 msgr2=0x7fb9f015a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:52.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.013+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/3990709686 shutdown_connections 2024-04-25T08:49:52.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.013+0000 7fb9f5d7e640 1 -- 172.21.15.172:0/3990709686 wait complete. 2024-04-25T08:49:52.015 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:49:52.044 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:49:52.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.125+0000 7f420fe07640 1 Processor -- start 2024-04-25T08:49:52.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.125+0000 7f420fe07640 1 -- start start 2024-04-25T08:49:52.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420fe07640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f42080b4f10 0x7f42080b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:52.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420fe07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080af5e0 0x7f420806c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:52.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420fe07640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f420815f630 0x7f420815fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420fe07640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420815ffc0 con 0x7f420815f630 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420fe07640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420806bc40 con 0x7f42080b4f10 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420fe07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42080b52f0 con 0x7f42080af5e0 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420e3a4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f420815f630 0x7f420815fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420e3a4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f420815f630 0x7f420815fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58634/0 (socket says 172.21.15.172:58634) 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420e3a4640 1 -- 172.21.15.172:0/3336038711 learned_addr learned my addr 172.21.15.172:0/3336038711 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420dba3640 1 --2- 172.21.15.172:0/3336038711 >> v2:172.21.15.186:3300/0 conn(0x7f42080b4f10 0x7f42080b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.126+0000 7f420d3a2640 1 --2- 172.21.15.172:0/3336038711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080af5e0 0x7f420806c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.127+0000 7f420e3a4640 1 -- 172.21.15.172:0/3336038711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080af5e0 msgr2=0x7f420806c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.127+0000 7f420e3a4640 1 --2- 172.21.15.172:0/3336038711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080af5e0 0x7f420806c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.127+0000 7f420e3a4640 1 -- 172.21.15.172:0/3336038711 >> v2:172.21.15.186:3300/0 conn(0x7f42080b4f10 msgr2=0x7f42080b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:52.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.127+0000 7f420e3a4640 1 --2- 172.21.15.172:0/3336038711 >> v2:172.21.15.186:3300/0 conn(0x7f42080b4f10 0x7f42080b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.127+0000 7f420e3a4640 1 -- 172.21.15.172:0/3336038711 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42080adaa0 con 0x7f420815f630 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.127+0000 7f420e3a4640 1 --2- 172.21.15.172:0/3336038711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 0x7f420815fa80 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f4208072e50 tx=0x7f420002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26152befd79ec4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.127+0000 7f420cba1640 1 -- 172.21.15.172:0/3336038711 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200036070 con 0x7f420815f630 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.127+0000 7f420cba1640 1 -- 172.21.15.172:0/3336038711 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4200031600 con 0x7f420815f630 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.128+0000 7f420cba1640 1 -- 172.21.15.172:0/3336038711 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000319d0 con 0x7f420815f630 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.128+0000 7f420fe07640 1 -- 172.21.15.172:0/3336038711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 msgr2=0x7f420815fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.128+0000 7f420fe07640 1 --2- 172.21.15.172:0/3336038711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 0x7f420815fa80 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f4208072e50 tx=0x7f420002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.128+0000 7f420fe07640 1 -- 172.21.15.172:0/3336038711 shutdown_connections 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.128+0000 7f420fe07640 1 --2- 172.21.15.172:0/3336038711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 0x7f420815fa80 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.128+0000 7f420fe07640 1 --2- 172.21.15.172:0/3336038711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080af5e0 0x7f420806c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.128+0000 7f420fe07640 1 --2- 172.21.15.172:0/3336038711 >> v2:172.21.15.186:3300/0 conn(0x7f42080b4f10 0x7f42080b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.128+0000 7f420fe07640 1 -- 172.21.15.172:0/3336038711 >> 172.21.15.172:0/3336038711 conn(0x7f42080cfec0 msgr2=0x7f42080d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.128+0000 7f420fe07640 1 -- 172.21.15.172:0/3336038711 shutdown_connections 2024-04-25T08:49:52.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.128+0000 7f420fe07640 1 -- 172.21.15.172:0/3336038711 wait complete. 2024-04-25T08:49:52.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.129+0000 7f420fe07640 1 Processor -- start 2024-04-25T08:49:52.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.129+0000 7f420fe07640 1 -- start start 2024-04-25T08:49:52.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420fe07640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42080af5e0 0x7f4208099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:52.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420fe07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080b4f10 0x7f420809d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:52.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420fe07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 0x7f4208156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:52.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420fe07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420806b8d0 con 0x7f420815f630 2024-04-25T08:49:52.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420fe07640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420806b5f0 con 0x7f42080af5e0 2024-04-25T08:49:52.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420fe07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42080ad730 con 0x7f42080b4f10 2024-04-25T08:49:52.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420e3a4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 0x7f4208156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:52.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420e3a4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 0x7f4208156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58648/0 (socket says 172.21.15.172:58648) 2024-04-25T08:49:52.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420e3a4640 1 -- 172.21.15.172:0/3798039147 learned_addr learned my addr 172.21.15.172:0/3798039147 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:52.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420d3a2640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080b4f10 0x7f420809d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:52.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420dba3640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42080af5e0 0x7f4208099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:52.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420e3a4640 1 -- 172.21.15.172:0/3798039147 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080b4f10 msgr2=0x7f420809d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:52.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420e3a4640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080b4f10 0x7f420809d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420e3a4640 1 -- 172.21.15.172:0/3798039147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42080af5e0 msgr2=0x7f4208099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:52.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420e3a4640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42080af5e0 0x7f4208099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:52.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420e3a4640 1 -- 172.21.15.172:0/3798039147 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208157280 con 0x7f420815f630 2024-04-25T08:49:52.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420d3a2640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080b4f10 0x7f420809d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:52.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.130+0000 7f420dba3640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42080af5e0 0x7f4208099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:52.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.131+0000 7f420e3a4640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 0x7f4208156d40 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f420002ac90 tx=0x7f4200004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:52.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.131+0000 7f42067fc640 1 -- 172.21.15.172:0/3798039147 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420003f020 con 0x7f420815f630 2024-04-25T08:49:52.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.131+0000 7f42067fc640 1 -- 172.21.15.172:0/3798039147 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4200037040 con 0x7f420815f630 2024-04-25T08:49:52.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.131+0000 7f420fe07640 1 -- 172.21.15.172:0/3798039147 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420809d8a0 con 0x7f420815f630 2024-04-25T08:49:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.131+0000 7f42067fc640 1 -- 172.21.15.172:0/3798039147 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200036070 con 0x7f420815f630 2024-04-25T08:49:52.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.131+0000 7f420fe07640 1 -- 172.21.15.172:0/3798039147 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420806ded0 con 0x7f420815f630 2024-04-25T08:49:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.132+0000 7f420fe07640 1 -- 172.21.15.172:0/3798039147 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4208073a00 con 0x7f420815f630 2024-04-25T08:49:52.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.132+0000 7f42067fc640 1 -- 172.21.15.172:0/3798039147 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4200042020 con 0x7f420815f630 2024-04-25T08:49:52.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.132+0000 7f42067fc640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41f406b4d0 0x7f41f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:52.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.133+0000 7f42067fc640 1 -- 172.21.15.172:0/3798039147 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f42000aa9e0 con 0x7f420815f630 2024-04-25T08:49:52.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.133+0000 7f420dba3640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41f406b4d0 0x7f41f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:52.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.133+0000 7f420dba3640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41f406b4d0 0x7f41f406d990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009ac0 tx=0x7f41f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:52.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.137+0000 7f42067fc640 1 -- 172.21.15.172:0/3798039147 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4200049020 con 0x7f420815f630 2024-04-25T08:49:52.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:52.342+0000 7f420fe07640 1 -- 172.21.15.172:0/3798039147 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f42080d0620 con 0x7f420815f630 2024-04-25T08:49:53.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.017+0000 7f42067fc640 1 -- 172.21.15.172:0/3798039147 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4200079710 con 0x7f420815f630 2024-04-25T08:49:53.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 -- 172.21.15.172:0/3798039147 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41f406b4d0 msgr2=0x7f41f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:53.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41f406b4d0 0x7f41f406d990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009ac0 tx=0x7f41f8008040 comp rx=0 tx=0).stop 2024-04-25T08:49:53.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 -- 172.21.15.172:0/3798039147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 msgr2=0x7f4208156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:53.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 0x7f4208156d40 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f420002ac90 tx=0x7f4200004a40 comp rx=0 tx=0).stop 2024-04-25T08:49:53.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 -- 172.21.15.172:0/3798039147 shutdown_connections 2024-04-25T08:49:53.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f41f406b4d0 0x7f41f406d990 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420815f630 0x7f4208156d40 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f42080b4f10 0x7f420809d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 --2- 172.21.15.172:0/3798039147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f42080af5e0 0x7f4208099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 -- 172.21.15.172:0/3798039147 >> 172.21.15.172:0/3798039147 conn(0x7f42080cfec0 msgr2=0x7f420815c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:53.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 -- 172.21.15.172:0/3798039147 shutdown_connections 2024-04-25T08:49:53.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.020+0000 7f420fe07640 1 -- 172.21.15.172:0/3798039147 wait complete. 2024-04-25T08:49:53.026 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:49:53.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.140+0000 7f48e5322640 1 Processor -- start 2024-04-25T08:49:53.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.140+0000 7f48e5322640 1 -- start start 2024-04-25T08:49:53.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.141+0000 7f48e5322640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f48e01610f0 0x7f48e006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:53.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.141+0000 7f48e5322640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f48e01616f0 0x7f48e0161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:53.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.141+0000 7f48e5322640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e00ce0a0 0x7f48e00ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:53.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.141+0000 7f48e5322640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e01614d0 con 0x7f48e01610f0 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.141+0000 7f48e5322640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e00c6960 con 0x7f48e01616f0 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.141+0000 7f48e5322640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0162260 con 0x7f48e00ce0a0 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.141+0000 7f48deffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f48e01610f0 0x7f48e006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.141+0000 7f48deffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f48e01610f0 0x7f48e006c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58654/0 (socket says 172.21.15.172:58654) 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.141+0000 7f48deffd640 1 -- 172.21.15.172:0/4012723975 learned_addr learned my addr 172.21.15.172:0/4012723975 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.141+0000 7f48de7fc640 1 --2- 172.21.15.172:0/4012723975 >> v2:172.21.15.186:3300/0 conn(0x7f48e01616f0 0x7f48e0161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48df7fe640 1 --2- 172.21.15.172:0/4012723975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e00ce0a0 0x7f48e00ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48deffd640 1 -- 172.21.15.172:0/4012723975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e00ce0a0 msgr2=0x7f48e00ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48deffd640 1 --2- 172.21.15.172:0/4012723975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e00ce0a0 0x7f48e00ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48deffd640 1 -- 172.21.15.172:0/4012723975 >> v2:172.21.15.186:3300/0 conn(0x7f48e01616f0 msgr2=0x7f48e0161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48deffd640 1 --2- 172.21.15.172:0/4012723975 >> v2:172.21.15.186:3300/0 conn(0x7f48e01616f0 0x7f48e0161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48deffd640 1 -- 172.21.15.172:0/4012723975 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0162540 con 0x7f48e01610f0 2024-04-25T08:49:53.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48de7fc640 1 --2- 172.21.15.172:0/4012723975 >> v2:172.21.15.186:3300/0 conn(0x7f48e01616f0 0x7f48e0161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48deffd640 1 --2- 172.21.15.172:0/4012723975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01610f0 0x7f48e006c1c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f48e006f220 tx=0x7f48d002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b23e7ef38130469 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48ddffb640 1 -- 172.21.15.172:0/4012723975 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0036070 con 0x7f48e01610f0 2024-04-25T08:49:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48ddffb640 1 -- 172.21.15.172:0/4012723975 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0031600 con 0x7f48e01610f0 2024-04-25T08:49:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.142+0000 7f48ddffb640 1 -- 172.21.15.172:0/4012723975 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d00319d0 con 0x7f48e01610f0 2024-04-25T08:49:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.143+0000 7f48e5322640 1 -- 172.21.15.172:0/4012723975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01610f0 msgr2=0x7f48e006c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.143+0000 7f48e5322640 1 --2- 172.21.15.172:0/4012723975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01610f0 0x7f48e006c1c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f48e006f220 tx=0x7f48d002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.143+0000 7f48e5322640 1 -- 172.21.15.172:0/4012723975 shutdown_connections 2024-04-25T08:49:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.143+0000 7f48e5322640 1 --2- 172.21.15.172:0/4012723975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e00ce0a0 0x7f48e00ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.143+0000 7f48e5322640 1 --2- 172.21.15.172:0/4012723975 >> v2:172.21.15.186:3300/0 conn(0x7f48e01616f0 0x7f48e0161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.143+0000 7f48e5322640 1 --2- 172.21.15.172:0/4012723975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01610f0 0x7f48e006c1c0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.143+0000 7f48e5322640 1 -- 172.21.15.172:0/4012723975 >> 172.21.15.172:0/4012723975 conn(0x7f48e006f500 msgr2=0x7f48e006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.143+0000 7f48e5322640 1 -- 172.21.15.172:0/4012723975 shutdown_connections 2024-04-25T08:49:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.143+0000 7f48e5322640 1 -- 172.21.15.172:0/4012723975 wait complete. 2024-04-25T08:49:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.144+0000 7f48e5322640 1 Processor -- start 2024-04-25T08:49:53.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.144+0000 7f48e5322640 1 -- start start 2024-04-25T08:49:53.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48e5322640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48e00ce0a0 0x7f48e00ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48e5322640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e01610f0 0x7f48e0145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48e5322640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01616f0 0x7f48e00af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48e5322640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00cf690 con 0x7f48e01616f0 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48e5322640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00cfce0 con 0x7f48e00ce0a0 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48e5322640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e006c700 con 0x7f48e01610f0 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01616f0 0x7f48e00af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01616f0 0x7f48e00af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58656/0 (socket says 172.21.15.172:58656) 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48df7fe640 1 -- 172.21.15.172:0/3742620536 learned_addr learned my addr 172.21.15.172:0/3742620536 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48deffd640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48e00ce0a0 0x7f48e00ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48de7fc640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e01610f0 0x7f48e0145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:53.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48df7fe640 1 -- 172.21.15.172:0/3742620536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e01610f0 msgr2=0x7f48e0145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48df7fe640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e01610f0 0x7f48e0145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48df7fe640 1 -- 172.21.15.172:0/3742620536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48e00ce0a0 msgr2=0x7f48e00ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.145+0000 7f48df7fe640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48e00ce0a0 0x7f48e00ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.146+0000 7f48df7fe640 1 -- 172.21.15.172:0/3742620536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0146380 con 0x7f48e01616f0 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.146+0000 7f48de7fc640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e01610f0 0x7f48e0145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.146+0000 7f48df7fe640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01616f0 0x7f48e00af930 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c570 tx=0x7f48d800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.146+0000 7f48c77fe640 1 -- 172.21.15.172:0/3742620536 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8015070 con 0x7f48e01616f0 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.146+0000 7f48c77fe640 1 -- 172.21.15.172:0/3742620536 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8004220 con 0x7f48e01616f0 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.146+0000 7f48e5322640 1 -- 172.21.15.172:0/3742620536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e0146660 con 0x7f48e01616f0 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.146+0000 7f48c77fe640 1 -- 172.21.15.172:0/3742620536 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8003610 con 0x7f48e01616f0 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.146+0000 7f48e5322640 1 -- 172.21.15.172:0/3742620536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e0146c20 con 0x7f48e01616f0 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.147+0000 7f48e5322640 1 -- 172.21.15.172:0/3742620536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e0073a00 con 0x7f48e01616f0 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.147+0000 7f48c77fe640 1 -- 172.21.15.172:0/3742620536 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f48d80037b0 con 0x7f48e01616f0 2024-04-25T08:49:53.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.148+0000 7f48c77fe640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f48cc06b4d0 0x7f48cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.148+0000 7f48c77fe640 1 -- 172.21.15.172:0/3742620536 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f48d808a210 con 0x7f48e01616f0 2024-04-25T08:49:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.148+0000 7f48deffd640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f48cc06b4d0 0x7f48cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.148+0000 7f48deffd640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f48cc06b4d0 0x7f48cc06d990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f48d0033000 tx=0x7f48d0009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:53.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.152+0000 7f48c77fe640 1 -- 172.21.15.172:0/3742620536 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f48e0146380 con 0x7f48e01616f0 2024-04-25T08:49:53.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:53.324+0000 7f48e5322640 1 -- 172.21.15.172:0/3742620536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f48e00719a0 con 0x7f48e01616f0 2024-04-25T08:49:54.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.019+0000 7f48c77fe640 1 -- 172.21.15.172:0/3742620536 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) v1 ==== 181+0+0 (secure 0 0 0) 0x7f48d8058e30 con 0x7f48e01616f0 2024-04-25T08:49:54.010 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.022+0000 7f48e5322640 1 -- 172.21.15.172:0/3742620536 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f48cc06b4d0 msgr2=0x7f48cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.022+0000 7f48e5322640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f48cc06b4d0 0x7f48cc06d990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f48d0033000 tx=0x7f48d0009000 comp rx=0 tx=0).stop 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.022+0000 7f48e5322640 1 -- 172.21.15.172:0/3742620536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01616f0 msgr2=0x7f48e00af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.022+0000 7f48e5322640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01616f0 0x7f48e00af930 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c570 tx=0x7f48d800ca30 comp rx=0 tx=0).stop 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.023+0000 7f48e5322640 1 -- 172.21.15.172:0/3742620536 shutdown_connections 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.023+0000 7f48e5322640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f48cc06b4d0 0x7f48cc06d990 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.023+0000 7f48e5322640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48e01616f0 0x7f48e00af930 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.023+0000 7f48e5322640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f48e01610f0 0x7f48e0145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.023+0000 7f48e5322640 1 --2- 172.21.15.172:0/3742620536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48e00ce0a0 0x7f48e00ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.023+0000 7f48e5322640 1 -- 172.21.15.172:0/3742620536 >> 172.21.15.172:0/3742620536 conn(0x7f48e006f500 msgr2=0x7f48e00b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.023+0000 7f48e5322640 1 -- 172.21.15.172:0/3742620536 shutdown_connections 2024-04-25T08:49:54.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.023+0000 7f48e5322640 1 -- 172.21.15.172:0/3742620536 wait complete. 2024-04-25T08:49:54.028 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:49:54.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.143+0000 7f82938fc640 1 Processor -- start 2024-04-25T08:49:54.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.143+0000 7f82938fc640 1 -- start start 2024-04-25T08:49:54.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f82938fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c15eec0 0x7f828c1689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:54.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f82938fc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c0d1770 con 0x7f828c070dc0 2024-04-25T08:49:54.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f82938fc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c162740 con 0x7f828c06ccd0 2024-04-25T08:49:54.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f82938fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0b0eb0 con 0x7f828c15eec0 2024-04-25T08:49:54.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8291698640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f828c070dc0 0x7f828c0711a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39900/0 (socket says 172.21.15.172:39900) 2024-04-25T08:49:54.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8291698640 1 -- 172.21.15.172:0/102073411 learned_addr learned my addr 172.21.15.172:0/102073411 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:54.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8291e99640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c15eec0 0x7f828c1689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916532971 0 0) 0x7f828c0d1770 con 0x7f828c070dc0 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8278003520 con 0x7f828c070dc0 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1421035035 0 0) 0x7f8278003520 con 0x7f828c070dc0 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c15eec0 msgr2=0x7f828c1689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c15eec0 0x7f828c1689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 >> v1:172.21.15.186:6789/0 conn(0x7f828c06ccd0 legacy=0x7f828c0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c161980 con 0x7f828c070dc0 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f8288001670 con 0x7f828c070dc0 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 >> v1:172.21.15.172:6789/0 conn(0x7f828c070dc0 legacy=0x7f828c0711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82780039e0 0x7f8278003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8278004800 0x7f8278004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c15eec0 0x7f8278005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:54.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0b0eb0 con 0x7f8278004800 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827800baf0 con 0x7f82780039e0 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.144+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827800bcf0 con 0x7f828c15eec0 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.145+0000 7f8290e97640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8278004800 0x7f8278004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.145+0000 7f8291698640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82780039e0 0x7f8278003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.145+0000 7f8291e99640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c15eec0 0x7f8278005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.145+0000 7f8290e97640 1 -- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c15eec0 msgr2=0x7f8278005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.145+0000 7f8290e97640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c15eec0 0x7f8278005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.145+0000 7f8290e97640 1 -- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82780039e0 msgr2=0x7f8278003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.145+0000 7f8290e97640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82780039e0 0x7f8278003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.145+0000 7f8290e97640 1 -- 172.21.15.172:0/102073411 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278003520 con 0x7f8278004800 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.145+0000 7f8291e99640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c15eec0 0x7f8278005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.145+0000 7f8290e97640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8278004800 0x7f8278004c80 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f827c001860 tx=0x7f8278005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b0c4a731be06e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.146+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c037070 con 0x7f8278004800 2024-04-25T08:49:54.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.146+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c02abf0 con 0x7f8278004800 2024-04-25T08:49:54.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.146+0000 7f8283fff640 1 -- 172.21.15.172:0/102073411 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c001430 con 0x7f8278004800 2024-04-25T08:49:54.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.146+0000 7f82938fc640 1 -- 172.21.15.172:0/102073411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8278004800 msgr2=0x7f8278004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:54.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.146+0000 7f82938fc640 1 --2- 172.21.15.172:0/102073411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8278004800 0x7f8278004c80 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f827c001860 tx=0x7f8278005830 comp rx=0 tx=0).stop 2024-04-25T08:49:54.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.146+0000 7f8291e99640 1 -- 172.21.15.172:0/102073411 reap_dead start 2024-04-25T08:49:54.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.146+0000 7f82938fc640 1 -- 172.21.15.172:0/102073411 shutdown_connections 2024-04-25T08:49:54.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.146+0000 7f82938fc640 1 -- 172.21.15.172:0/102073411 >> 172.21.15.172:0/102073411 conn(0x7f828c0b3530 msgr2=0x7f828c0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:54.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.146+0000 7f82938fc640 1 -- 172.21.15.172:0/102073411 shutdown_connections 2024-04-25T08:49:54.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.146+0000 7f82938fc640 1 -- 172.21.15.172:0/102073411 wait complete. 2024-04-25T08:49:54.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.147+0000 7f82938fc640 1 Processor -- start 2024-04-25T08:49:54.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.147+0000 7f82938fc640 1 -- start start 2024-04-25T08:49:54.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f82938fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8278004800 0x7f828c14b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:54.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f82938fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f828c155ff0 0x7f828c158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:54.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f82938fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c06ba90 0x7f828c06bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:54.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f82938fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0b10f0 con 0x7f828c155ff0 2024-04-25T08:49:54.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f82938fc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1622b0 con 0x7f8278004800 2024-04-25T08:49:54.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f82938fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c161f40 con 0x7f828c06ba90 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f8290e97640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f828c155ff0 0x7f828c158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f8290e97640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f828c155ff0 0x7f828c158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58664/0 (socket says 172.21.15.172:58664) 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f8290e97640 1 -- 172.21.15.172:0/59542300 learned_addr learned my addr 172.21.15.172:0/59542300 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f8291698640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8278004800 0x7f828c14b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f8291e99640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c06ba90 0x7f828c06bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f8290e97640 1 -- 172.21.15.172:0/59542300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c06ba90 msgr2=0x7f828c06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f8290e97640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c06ba90 0x7f828c06bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f8290e97640 1 -- 172.21.15.172:0/59542300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8278004800 msgr2=0x7f828c14b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.148+0000 7f8290e97640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8278004800 0x7f828c14b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.149+0000 7f8290e97640 1 -- 172.21.15.172:0/59542300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c1588a0 con 0x7f828c155ff0 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.149+0000 7f8291698640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8278004800 0x7f828c14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.149+0000 7f8290e97640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f828c155ff0 0x7f828c158360 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f827c02a6c0 tx=0x7f827c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.149+0000 7f8281ffb640 1 -- 172.21.15.172:0/59542300 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c03f020 con 0x7f828c155ff0 2024-04-25T08:49:54.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.149+0000 7f8281ffb640 1 -- 172.21.15.172:0/59542300 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c005270 con 0x7f828c155ff0 2024-04-25T08:49:54.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.149+0000 7f82938fc640 1 -- 172.21.15.172:0/59542300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c156560 con 0x7f828c155ff0 2024-04-25T08:49:54.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.149+0000 7f8281ffb640 1 -- 172.21.15.172:0/59542300 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c037040 con 0x7f828c155ff0 2024-04-25T08:49:54.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.149+0000 7f82938fc640 1 -- 172.21.15.172:0/59542300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c156b20 con 0x7f828c155ff0 2024-04-25T08:49:54.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.150+0000 7f82938fc640 1 -- 172.21.15.172:0/59542300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c06c450 con 0x7f828c155ff0 2024-04-25T08:49:54.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.151+0000 7f8281ffb640 1 -- 172.21.15.172:0/59542300 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f827c042020 con 0x7f828c155ff0 2024-04-25T08:49:54.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.151+0000 7f8281ffb640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827006b500 0x7f827006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:54.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.151+0000 7f8281ffb640 1 -- 172.21.15.172:0/59542300 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5749+0+0 (secure 0 0 0) 0x7f827c0a9e60 con 0x7f828c155ff0 2024-04-25T08:49:54.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.151+0000 7f8291698640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827006b500 0x7f827006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:54.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.152+0000 7f8291698640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827006b500 0x7f827006d9c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8288007cb0 tx=0x7f8288009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:54.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.155+0000 7f8281ffb640 1 -- 172.21.15.172:0/59542300 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f827c049030 con 0x7f828c155ff0 2024-04-25T08:49:54.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:54.326+0000 7f82938fc640 1 -- 172.21.15.172:0/59542300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f828c0cb910 con 0x7f828c155ff0 2024-04-25T08:49:55.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.024+0000 7f8281ffb640 1 -- 172.21.15.172:0/59542300 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) v1 ==== 169+0+0 (secure 0 0 0) 0x7f828c0cb910 con 0x7f828c155ff0 2024-04-25T08:49:55.015 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2024-04-25T08:49:55.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.028+0000 7f82938fc640 1 -- 172.21.15.172:0/59542300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827006b500 msgr2=0x7f827006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.028+0000 7f82938fc640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827006b500 0x7f827006d9c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8288007cb0 tx=0x7f8288009040 comp rx=0 tx=0).stop 2024-04-25T08:49:55.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.028+0000 7f82938fc640 1 -- 172.21.15.172:0/59542300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f828c155ff0 msgr2=0x7f828c158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.028+0000 7f82938fc640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f828c155ff0 0x7f828c158360 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f827c02a6c0 tx=0x7f827c001230 comp rx=0 tx=0).stop 2024-04-25T08:49:55.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.029+0000 7f82938fc640 1 -- 172.21.15.172:0/59542300 shutdown_connections 2024-04-25T08:49:55.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.029+0000 7f82938fc640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f827006b500 0x7f827006d9c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.029+0000 7f82938fc640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f828c06ba90 0x7f828c06bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.029+0000 7f82938fc640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f828c155ff0 0x7f828c158360 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.029+0000 7f82938fc640 1 --2- 172.21.15.172:0/59542300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8278004800 0x7f828c14b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.029+0000 7f82938fc640 1 -- 172.21.15.172:0/59542300 >> 172.21.15.172:0/59542300 conn(0x7f828c0b3530 msgr2=0x7f828c160b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:55.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.029+0000 7f82938fc640 1 -- 172.21.15.172:0/59542300 shutdown_connections 2024-04-25T08:49:55.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.030+0000 7f82938fc640 1 -- 172.21.15.172:0/59542300 wait complete. 2024-04-25T08:49:55.038 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:49:55.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.157+0000 7f1774cfc640 1 Processor -- start 2024-04-25T08:49:55.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.157+0000 7f1774cfc640 1 -- start start 2024-04-25T08:49:55.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.158+0000 7f1774cfc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f177006b8c0 0x7f17700b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.158+0000 7f1774cfc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f17700b49f0 0x7f177006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.158+0000 7f1774cfc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17700b3450 con 0x7f177015dcd0 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.158+0000 7f1774cfc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17700b36f0 con 0x7f17700b49f0 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.158+0000 7f1774cfc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17700b39d0 con 0x7f177006b8c0 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.158+0000 7f176ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f17700b49f0 0x7f177006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.158+0000 7f176e59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f177015dcd0 0x7f177006d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39912/0 (socket says 172.21.15.172:39912) 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.158+0000 7f176e59c640 1 -- 172.21.15.172:0/419235706 learned_addr learned my addr 172.21.15.172:0/419235706 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.159+0000 7f176dd9b640 1 --2- 172.21.15.172:0/419235706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f177006b8c0 0x7f17700b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.159+0000 7f176ed9d640 1 -- 172.21.15.172:0/419235706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f177006b8c0 msgr2=0x7f17700b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.159+0000 7f176ed9d640 1 --2- 172.21.15.172:0/419235706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f177006b8c0 0x7f17700b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.159+0000 7f176ed9d640 1 -- 172.21.15.172:0/419235706 >> v1:172.21.15.172:6789/0 conn(0x7f177015dcd0 legacy=0x7f177006d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.159+0000 7f176d59a640 1 -- 172.21.15.172:0/419235706 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809720045 0 0) 0x7f17700b3450 con 0x7f177015dcd0 2024-04-25T08:49:55.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.159+0000 7f176ed9d640 1 -- 172.21.15.172:0/419235706 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17700b3cb0 con 0x7f17700b49f0 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.159+0000 7f176ed9d640 1 --2- 172.21.15.172:0/419235706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17700b49f0 0x7f177006e2f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f17680097a0 tx=0x7f176802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915698a5532730f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.159+0000 7f176d59a640 1 -- 172.21.15.172:0/419235706 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768037070 con 0x7f17700b49f0 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.159+0000 7f176d59a640 1 -- 172.21.15.172:0/419235706 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1768032440 con 0x7f17700b49f0 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.160+0000 7f176d59a640 1 -- 172.21.15.172:0/419235706 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768032810 con 0x7f17700b49f0 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.160+0000 7f1774cfc640 1 -- 172.21.15.172:0/419235706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17700b49f0 msgr2=0x7f177006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.160+0000 7f1774cfc640 1 --2- 172.21.15.172:0/419235706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17700b49f0 0x7f177006e2f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f17680097a0 tx=0x7f176802a180 comp rx=0 tx=0).stop 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.160+0000 7f1774cfc640 1 -- 172.21.15.172:0/419235706 shutdown_connections 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.160+0000 7f1774cfc640 1 --2- 172.21.15.172:0/419235706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f177006b8c0 0x7f17700b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.160+0000 7f1774cfc640 1 --2- 172.21.15.172:0/419235706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17700b49f0 0x7f177006e2f0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.160+0000 7f1774cfc640 1 -- 172.21.15.172:0/419235706 >> 172.21.15.172:0/419235706 conn(0x7f177006abe0 msgr2=0x7f177006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:55.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.160+0000 7f1774cfc640 1 -- 172.21.15.172:0/419235706 shutdown_connections 2024-04-25T08:49:55.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.160+0000 7f1774cfc640 1 -- 172.21.15.172:0/419235706 wait complete. 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.162+0000 7f1774cfc640 1 Processor -- start 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.162+0000 7f1774cfc640 1 -- start start 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f1774cfc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177006b8c0 0x7f1770155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f1774cfc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17700b49f0 0x7f177014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f1774cfc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f177015dcd0 0x7f177015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f1774cfc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177006e9b0 con 0x7f177006b8c0 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f1774cfc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177006e830 con 0x7f17700b49f0 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f1774cfc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177006eb30 con 0x7f177015dcd0 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177006b8c0 0x7f1770155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177006b8c0 0x7f1770155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58682/0 (socket says 172.21.15.172:58682) 2024-04-25T08:49:55.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176e59c640 1 -- 172.21.15.172:0/374006383 learned_addr learned my addr 172.21.15.172:0/374006383 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176dd9b640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17700b49f0 0x7f177014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176ed9d640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f177015dcd0 0x7f177015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176e59c640 1 -- 172.21.15.172:0/374006383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f177015dcd0 msgr2=0x7f177015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176e59c640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f177015dcd0 0x7f177015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176e59c640 1 -- 172.21.15.172:0/374006383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17700b49f0 msgr2=0x7f177014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176e59c640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17700b49f0 0x7f177014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176e59c640 1 -- 172.21.15.172:0/374006383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1770153810 con 0x7f177006b8c0 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f176e59c640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177006b8c0 0x7f1770155d00 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f176000c7c0 tx=0x7f176000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f175effd640 1 -- 172.21.15.172:0/374006383 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760018070 con 0x7f177006b8c0 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f175effd640 1 -- 172.21.15.172:0/374006383 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176000a640 con 0x7f177006b8c0 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f1774cfc640 1 -- 172.21.15.172:0/374006383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1770153af0 con 0x7f177006b8c0 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f175effd640 1 -- 172.21.15.172:0/374006383 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000aa30 con 0x7f177006b8c0 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.163+0000 7f1774cfc640 1 -- 172.21.15.172:0/374006383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17701540b0 con 0x7f177006b8c0 2024-04-25T08:49:55.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.164+0000 7f1774cfc640 1 -- 172.21.15.172:0/374006383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1770073a00 con 0x7f177006b8c0 2024-04-25T08:49:55.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.165+0000 7f175effd640 1 -- 172.21.15.172:0/374006383 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f176001b070 con 0x7f177006b8c0 2024-04-25T08:49:55.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.165+0000 7f175effd640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f175006b4d0 0x7f175006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.165+0000 7f175effd640 1 -- 172.21.15.172:0/374006383 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f1760089610 con 0x7f177006b8c0 2024-04-25T08:49:55.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.165+0000 7f176dd9b640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f175006b4d0 0x7f175006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.166+0000 7f176dd9b640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f175006b4d0 0x7f175006d990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1770155a10 tx=0x7f1764008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:55.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.169+0000 7f175effd640 1 -- 172.21.15.172:0/374006383 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1760057fb0 con 0x7f177006b8c0 2024-04-25T08:49:55.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.339+0000 7f1774cfc640 1 -- 172.21.15.172:0/374006383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f17700685d0 con 0x7f177006b8c0 2024-04-25T08:49:55.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.343+0000 7f175effd640 1 -- 172.21.15.172:0/374006383 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f176005c050 con 0x7f177006b8c0 2024-04-25T08:49:55.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 -- 172.21.15.172:0/374006383 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f175006b4d0 msgr2=0x7f175006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f175006b4d0 0x7f175006d990 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1770155a10 tx=0x7f1764008040 comp rx=0 tx=0).stop 2024-04-25T08:49:55.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 -- 172.21.15.172:0/374006383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177006b8c0 msgr2=0x7f1770155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177006b8c0 0x7f1770155d00 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f176000c7c0 tx=0x7f176000cc80 comp rx=0 tx=0).stop 2024-04-25T08:49:55.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 -- 172.21.15.172:0/374006383 shutdown_connections 2024-04-25T08:49:55.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f175006b4d0 0x7f175006d990 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17700b49f0 0x7f177014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f177015dcd0 0x7f177015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 --2- 172.21.15.172:0/374006383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177006b8c0 0x7f1770155d00 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 -- 172.21.15.172:0/374006383 >> 172.21.15.172:0/374006383 conn(0x7f177006abe0 msgr2=0x7f17700afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:55.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 -- 172.21.15.172:0/374006383 shutdown_connections 2024-04-25T08:49:55.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.345+0000 7f1774cfc640 1 -- 172.21.15.172:0/374006383 wait complete. 2024-04-25T08:49:55.347 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-04-25T08:49:55.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.463+0000 7f770ae1f640 1 Processor -- start 2024-04-25T08:49:55.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.463+0000 7f770ae1f640 1 -- start start 2024-04-25T08:49:55.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.464+0000 7f770ae1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040d1020 0x7f77040d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.464+0000 7f770ae1f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77040b97a0 con 0x7f77040b2cb0 2024-04-25T08:49:55.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.464+0000 7f770ae1f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77040d1c50 con 0x7f770415dbe0 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.464+0000 7f770ae1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770415dfc0 con 0x7f77040d1020 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.464+0000 7f7703fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f77040b2cb0 0x7f77040d2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39914/0 (socket says 172.21.15.172:39914) 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.464+0000 7f7703fff640 1 -- 172.21.15.172:0/1199685769 learned_addr learned my addr 172.21.15.172:0/1199685769 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.465+0000 7f77093bc640 1 --2- 172.21.15.172:0/1199685769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040d1020 0x7f77040d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.465+0000 7f77037fe640 1 -- 172.21.15.172:0/1199685769 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991143505 0 0) 0x7f77040b97a0 con 0x7f77040b2cb0 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.465+0000 7f77037fe640 1 -- 172.21.15.172:0/1199685769 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76f0003520 con 0x7f77040b2cb0 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.465+0000 7f77037fe640 1 -- 172.21.15.172:0/1199685769 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451169026 0 0) 0x7f77040d1c50 con 0x7f770415dbe0 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.465+0000 7f77037fe640 1 -- 172.21.15.172:0/1199685769 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77040b97a0 con 0x7f770415dbe0 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.465+0000 7f77037fe640 1 -- 172.21.15.172:0/1199685769 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3439542602 0 0) 0x7f76f0003520 con 0x7f77040b2cb0 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.465+0000 7f77093bc640 1 -- 172.21.15.172:0/1199685769 >> v1:172.21.15.186:6789/0 conn(0x7f770415dbe0 legacy=0x7f77040d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.465+0000 7f77093bc640 1 -- 172.21.15.172:0/1199685769 >> v1:172.21.15.172:6789/0 conn(0x7f77040b2cb0 legacy=0x7f77040d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.465+0000 7f77093bc640 1 -- 172.21.15.172:0/1199685769 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040d1f30 con 0x7f77040d1020 2024-04-25T08:49:55.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.466+0000 7f77093bc640 1 --2- 172.21.15.172:0/1199685769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040d1020 0x7f77040d2e40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0097d0 tx=0x7f76ec02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4deaa6fc9948d102 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:55.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.466+0000 7f77037fe640 1 -- 172.21.15.172:0/1199685769 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec037070 con 0x7f77040d1020 2024-04-25T08:49:55.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.466+0000 7f77037fe640 1 -- 172.21.15.172:0/1199685769 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec02ac30 con 0x7f77040d1020 2024-04-25T08:49:55.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.466+0000 7f77037fe640 1 -- 172.21.15.172:0/1199685769 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4001670 con 0x7f77040d1020 2024-04-25T08:49:55.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.466+0000 7f770ae1f640 1 -- 172.21.15.172:0/1199685769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040d1020 msgr2=0x7f77040d2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.466+0000 7f770ae1f640 1 --2- 172.21.15.172:0/1199685769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040d1020 0x7f77040d2e40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0097d0 tx=0x7f76ec02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.467+0000 7f770ae1f640 1 -- 172.21.15.172:0/1199685769 shutdown_connections 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.467+0000 7f770ae1f640 1 --2- 172.21.15.172:0/1199685769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040d1020 0x7f77040d2e40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.467+0000 7f770ae1f640 1 -- 172.21.15.172:0/1199685769 >> 172.21.15.172:0/1199685769 conn(0x7f7704061a20 msgr2=0x7f7704061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.467+0000 7f770ae1f640 1 -- 172.21.15.172:0/1199685769 shutdown_connections 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.467+0000 7f770ae1f640 1 -- 172.21.15.172:0/1199685769 wait complete. 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.468+0000 7f770ae1f640 1 Processor -- start 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.468+0000 7f770ae1f640 1 -- start start 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f770ae1f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040b2cb0 0x7f770414bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f770ae1f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77040d1020 0x7f77040ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f770ae1f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f770415dbe0 0x7f77041556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f770ae1f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77040b9420 con 0x7f77040d1020 2024-04-25T08:49:55.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f770ae1f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77040b92a0 con 0x7f770415dbe0 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f770ae1f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77040b6ab0 con 0x7f77040b2cb0 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f7703fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77040d1020 0x7f77040ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f7703fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77040d1020 0x7f77040ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58686/0 (socket says 172.21.15.172:58686) 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f7703fff640 1 -- 172.21.15.172:0/4125993062 learned_addr learned my addr 172.21.15.172:0/4125993062 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f77093bc640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f770415dbe0 0x7f77041556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f7708bbb640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040b2cb0 0x7f770414bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f7703fff640 1 -- 172.21.15.172:0/4125993062 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040b2cb0 msgr2=0x7f770414bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f7703fff640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040b2cb0 0x7f770414bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f7703fff640 1 -- 172.21.15.172:0/4125993062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f770415dbe0 msgr2=0x7f77041556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f7703fff640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f770415dbe0 0x7f77041556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f7703fff640 1 -- 172.21.15.172:0/4125993062 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77041f6e70 con 0x7f77040d1020 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f7703fff640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77040d1020 0x7f77040ccab0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c750 tx=0x7f76f400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f77017fa640 1 -- 172.21.15.172:0/4125993062 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4017070 con 0x7f77040d1020 2024-04-25T08:49:55.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f77017fa640 1 -- 172.21.15.172:0/4125993062 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f4005ad0 con 0x7f77040d1020 2024-04-25T08:49:55.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f770ae1f640 1 -- 172.21.15.172:0/4125993062 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77041f3e60 con 0x7f77040d1020 2024-04-25T08:49:55.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f77017fa640 1 -- 172.21.15.172:0/4125993062 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4007070 con 0x7f77040d1020 2024-04-25T08:49:55.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.469+0000 7f770ae1f640 1 -- 172.21.15.172:0/4125993062 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77041f4420 con 0x7f77040d1020 2024-04-25T08:49:55.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.470+0000 7f770ae1f640 1 -- 172.21.15.172:0/4125993062 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7704073990 con 0x7f77040d1020 2024-04-25T08:49:55.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.471+0000 7f77017fa640 1 -- 172.21.15.172:0/4125993062 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f76f401a070 con 0x7f77040d1020 2024-04-25T08:49:55.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.471+0000 7f77017fa640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f76e406b4d0 0x7f76e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:55.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.471+0000 7f77017fa640 1 -- 172.21.15.172:0/4125993062 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f76f40894d0 con 0x7f77040d1020 2024-04-25T08:49:55.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.471+0000 7f7708bbb640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f76e406b4d0 0x7f76e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:55.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.472+0000 7f7708bbb640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f76e406b4d0 0x7f76e406d990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f76fc001460 tx=0x7f76fc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:55.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.475+0000 7f77017fa640 1 -- 172.21.15.172:0/4125993062 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f76f4057e70 con 0x7f77040d1020 2024-04-25T08:49:55.704 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:55.714+0000 7f770ae1f640 1 -- 172.21.15.172:0/4125993062 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7f77040b5f30 con 0x7f77040d1020 2024-04-25T08:49:56.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.026+0000 7f77017fa640 1 -- 172.21.15.172:0/4125993062 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v371) v1 ==== 155+0+0 (secure 0 0 0) 0x7f76f405bf10 con 0x7f77040d1020 2024-04-25T08:49:56.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 -- 172.21.15.172:0/4125993062 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f76e406b4d0 msgr2=0x7f76e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f76e406b4d0 0x7f76e406d990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f76fc001460 tx=0x7f76fc009040 comp rx=0 tx=0).stop 2024-04-25T08:49:56.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 -- 172.21.15.172:0/4125993062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77040d1020 msgr2=0x7f77040ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77040d1020 0x7f77040ccab0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c750 tx=0x7f76f400cc10 comp rx=0 tx=0).stop 2024-04-25T08:49:56.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 -- 172.21.15.172:0/4125993062 shutdown_connections 2024-04-25T08:49:56.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f76e406b4d0 0x7f76e406d990 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f770415dbe0 0x7f77041556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77040d1020 0x7f77040ccab0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 --2- 172.21.15.172:0/4125993062 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77040b2cb0 0x7f770414bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 -- 172.21.15.172:0/4125993062 >> 172.21.15.172:0/4125993062 conn(0x7f7704061a20 msgr2=0x7f77040b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:56.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 -- 172.21.15.172:0/4125993062 shutdown_connections 2024-04-25T08:49:56.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.028+0000 7f770ae1f640 1 -- 172.21.15.172:0/4125993062 wait complete. 2024-04-25T08:49:56.032 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T08:49:56.032 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T08:49:56.033 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.164+0000 7f244cd22640 1 Processor -- start 2024-04-25T08:49:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.164+0000 7f244cd22640 1 -- start start 2024-04-25T08:49:56.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.165+0000 7f244cd22640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2448154ee0 0x7f24480cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.165+0000 7f244cd22640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f24480cfcf0 0x7f24480cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.165+0000 7f244cd22640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2448071480 con 0x7f24480ce3c0 2024-04-25T08:49:56.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.165+0000 7f244cd22640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24480ce830 con 0x7f2448154ee0 2024-04-25T08:49:56.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.165+0000 7f244cd22640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2448072090 con 0x7f24480cfcf0 2024-04-25T08:49:56.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.165+0000 7f244659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2448154ee0 0x7f24480cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.165+0000 7f244659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2448154ee0 0x7f24480cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58688/0 (socket says 172.21.15.172:58688) 2024-04-25T08:49:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.165+0000 7f2446d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f24480ce3c0 0x7f244815e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39922/0 (socket says 172.21.15.172:39922) 2024-04-25T08:49:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.165+0000 7f244659c640 1 -- 172.21.15.172:0/580256115 learned_addr learned my addr 172.21.15.172:0/580256115 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.166+0000 7f2445d9b640 1 --2- 172.21.15.172:0/580256115 >> v2:172.21.15.186:3300/0 conn(0x7f24480cfcf0 0x7f24480cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.166+0000 7f244659c640 1 -- 172.21.15.172:0/580256115 >> v2:172.21.15.186:3300/0 conn(0x7f24480cfcf0 msgr2=0x7f24480cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.166+0000 7f244659c640 1 --2- 172.21.15.172:0/580256115 >> v2:172.21.15.186:3300/0 conn(0x7f24480cfcf0 0x7f24480cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.166+0000 7f244659c640 1 -- 172.21.15.172:0/580256115 >> v1:172.21.15.172:6789/0 conn(0x7f24480ce3c0 legacy=0x7f244815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.166+0000 7f244659c640 1 -- 172.21.15.172:0/580256115 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448071760 con 0x7f2448154ee0 2024-04-25T08:49:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.166+0000 7f244559a640 1 -- 172.21.15.172:0/580256115 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039335549 0 0) 0x7f2448071480 con 0x7f24480ce3c0 2024-04-25T08:49:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.166+0000 7f244659c640 1 --2- 172.21.15.172:0/580256115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2448154ee0 0x7f24480cf7b0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f24480cf560 tx=0x7f244002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9f30a5c5eacb16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244559a640 1 -- 172.21.15.172:0/580256115 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440036020 con 0x7f2448154ee0 2024-04-25T08:49:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244559a640 1 -- 172.21.15.172:0/580256115 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2440032640 con 0x7f2448154ee0 2024-04-25T08:49:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244559a640 1 -- 172.21.15.172:0/580256115 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440032a10 con 0x7f2448154ee0 2024-04-25T08:49:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244cd22640 1 -- 172.21.15.172:0/580256115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2448154ee0 msgr2=0x7f24480cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244cd22640 1 --2- 172.21.15.172:0/580256115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2448154ee0 0x7f24480cf7b0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f24480cf560 tx=0x7f244002c940 comp rx=0 tx=0).stop 2024-04-25T08:49:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244cd22640 1 -- 172.21.15.172:0/580256115 shutdown_connections 2024-04-25T08:49:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244cd22640 1 --2- 172.21.15.172:0/580256115 >> v2:172.21.15.186:3300/0 conn(0x7f24480cfcf0 0x7f24480cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244cd22640 1 --2- 172.21.15.172:0/580256115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2448154ee0 0x7f24480cf7b0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244cd22640 1 -- 172.21.15.172:0/580256115 >> 172.21.15.172:0/580256115 conn(0x7f244806abe0 msgr2=0x7f244806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244cd22640 1 -- 172.21.15.172:0/580256115 shutdown_connections 2024-04-25T08:49:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.167+0000 7f244cd22640 1 -- 172.21.15.172:0/580256115 wait complete. 2024-04-25T08:49:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.168+0000 7f244cd22640 1 Processor -- start 2024-04-25T08:49:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f244cd22640 1 -- start start 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f244cd22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24480ce3c0 0x7f2448147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f244cd22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24480cfcf0 0x7f24481f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f244cd22640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2448154ee0 0x7f2448159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f244cd22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448071d20 con 0x7f24480ce3c0 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f244cd22640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2448071230 con 0x7f2448154ee0 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f244cd22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24481552c0 con 0x7f24480cfcf0 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f244659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24480ce3c0 0x7f2448147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f244659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24480ce3c0 0x7f2448147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58700/0 (socket says 172.21.15.172:58700) 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f244659c640 1 -- 172.21.15.172:0/1948506542 learned_addr learned my addr 172.21.15.172:0/1948506542 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f2446d9d640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2448154ee0 0x7f2448159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.169+0000 7f2445d9b640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24480cfcf0 0x7f24481f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f244659c640 1 -- 172.21.15.172:0/1948506542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24480cfcf0 msgr2=0x7f24481f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f244659c640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24480cfcf0 0x7f24481f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f244659c640 1 -- 172.21.15.172:0/1948506542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2448154ee0 msgr2=0x7f2448159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f244659c640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2448154ee0 0x7f2448159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f244659c640 1 -- 172.21.15.172:0/1948506542 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448150a10 con 0x7f24480ce3c0 2024-04-25T08:49:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f244659c640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24480ce3c0 0x7f2448147230 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f2440000c00 tx=0x7f2440004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f2436ffd640 1 -- 172.21.15.172:0/1948506542 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440036040 con 0x7f24480ce3c0 2024-04-25T08:49:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f2436ffd640 1 -- 172.21.15.172:0/1948506542 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2440031bd0 con 0x7f24480ce3c0 2024-04-25T08:49:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f244cd22640 1 -- 172.21.15.172:0/1948506542 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244814def0 con 0x7f24480ce3c0 2024-04-25T08:49:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f2436ffd640 1 -- 172.21.15.172:0/1948506542 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244003b420 con 0x7f24480ce3c0 2024-04-25T08:49:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.170+0000 7f244cd22640 1 -- 172.21.15.172:0/1948506542 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24481504e0 con 0x7f24480ce3c0 2024-04-25T08:49:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.171+0000 7f244cd22640 1 -- 172.21.15.172:0/1948506542 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2448150770 con 0x7f24480ce3c0 2024-04-25T08:49:56.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.171+0000 7f2436ffd640 1 -- 172.21.15.172:0/1948506542 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2440039020 con 0x7f24480ce3c0 2024-04-25T08:49:56.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.172+0000 7f2436ffd640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f242806b4d0 0x7f242806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.172+0000 7f2436ffd640 1 -- 172.21.15.172:0/1948506542 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f24400aaf40 con 0x7f24480ce3c0 2024-04-25T08:49:56.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.172+0000 7f2445d9b640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f242806b4d0 0x7f242806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.172+0000 7f2445d9b640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f242806b4d0 0x7f242806d990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f24480d06d0 tx=0x7f243c003990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:56.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.176+0000 7f2436ffd640 1 -- 172.21.15.172:0/1948506542 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2440079f30 con 0x7f24480ce3c0 2024-04-25T08:49:56.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.347+0000 7f244cd22640 1 -- 172.21.15.172:0/1948506542 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2448073990 con 0x7f24480ce3c0 2024-04-25T08:49:56.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.347+0000 7f2436ffd640 1 -- 172.21.15.172:0/1948506542 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+13365 (secure 0 0 0) 0x7f2440079830 con 0x7f24480ce3c0 2024-04-25T08:49:56.338 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:56.338 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":110,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:55.020462+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:6835/3937459499":"2024-04-26T08:49:52.009730+0000","172.21.15.186:6833/3937459499":"2024-04-26T08:49:52.009730+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:56.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 -- 172.21.15.172:0/1948506542 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f242806b4d0 msgr2=0x7f242806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f242806b4d0 0x7f242806d990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f24480d06d0 tx=0x7f243c003990 comp rx=0 tx=0).stop 2024-04-25T08:49:56.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 -- 172.21.15.172:0/1948506542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24480ce3c0 msgr2=0x7f2448147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24480ce3c0 0x7f2448147230 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f2440000c00 tx=0x7f2440004730 comp rx=0 tx=0).stop 2024-04-25T08:49:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 -- 172.21.15.172:0/1948506542 shutdown_connections 2024-04-25T08:49:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f242806b4d0 0x7f242806d990 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2448154ee0 0x7f2448159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24480cfcf0 0x7f24481f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 --2- 172.21.15.172:0/1948506542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24480ce3c0 0x7f2448147230 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 -- 172.21.15.172:0/1948506542 >> 172.21.15.172:0/1948506542 conn(0x7f244806abe0 msgr2=0x7f244815afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 -- 172.21.15.172:0/1948506542 shutdown_connections 2024-04-25T08:49:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.349+0000 7f244cd22640 1 -- 172.21.15.172:0/1948506542 wait complete. 2024-04-25T08:49:56.351 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:49:56.352 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:49:56.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.461+0000 7f5f51676640 1 Processor -- start 2024-04-25T08:49:56.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.461+0000 7f5f51676640 1 -- start start 2024-04-25T08:49:56.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f51676640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5f4c15dc20 0x7f5f4c0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f51676640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c06cda0 con 0x7f5f4c161710 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f51676640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c15e000 con 0x7f5f4c0d32f0 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f51676640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c0d1de0 con 0x7f5f4c15dc20 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f4affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5f4c15dc20 0x7f5f4c0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f43fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5f4c161710 0x7f5f4c06bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39936/0 (socket says 172.21.15.172:39936) 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f43fff640 1 -- 172.21.15.172:0/1607644836 learned_addr learned my addr 172.21.15.172:0/1607644836 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f4affd640 1 -- 172.21.15.172:0/1607644836 >> v1:172.21.15.186:6789/0 conn(0x7f5f4c0d32f0 legacy=0x7f5f4c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f4affd640 1 -- 172.21.15.172:0/1607644836 >> v1:172.21.15.172:6789/0 conn(0x7f5f4c161710 legacy=0x7f5f4c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f4a7fc640 1 -- 172.21.15.172:0/1607644836 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651165557 0 0) 0x7f5f4c06cda0 con 0x7f5f4c161710 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.462+0000 7f5f4affd640 1 -- 172.21.15.172:0/1607644836 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c161c60 con 0x7f5f4c15dc20 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.463+0000 7f5f4affd640 1 --2- 172.21.15.172:0/1607644836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c15dc20 0x7f5f4c0ce670 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0097a0 tx=0x7f5f3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183f9cb48f940433 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:56.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.463+0000 7f5f4a7fc640 1 -- 172.21.15.172:0/1607644836 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c037070 con 0x7f5f4c15dc20 2024-04-25T08:49:56.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.463+0000 7f5f4a7fc640 1 -- 172.21.15.172:0/1607644836 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3c032440 con 0x7f5f4c15dc20 2024-04-25T08:49:56.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.463+0000 7f5f4a7fc640 1 -- 172.21.15.172:0/1607644836 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c032810 con 0x7f5f4c15dc20 2024-04-25T08:49:56.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.464+0000 7f5f51676640 1 -- 172.21.15.172:0/1607644836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c15dc20 msgr2=0x7f5f4c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.464+0000 7f5f51676640 1 --2- 172.21.15.172:0/1607644836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c15dc20 0x7f5f4c0ce670 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0097a0 tx=0x7f5f3c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.464+0000 7f5f51676640 1 -- 172.21.15.172:0/1607644836 shutdown_connections 2024-04-25T08:49:56.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.464+0000 7f5f51676640 1 --2- 172.21.15.172:0/1607644836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c15dc20 0x7f5f4c0ce670 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.464+0000 7f5f51676640 1 -- 172.21.15.172:0/1607644836 >> 172.21.15.172:0/1607644836 conn(0x7f5f4c0d0420 msgr2=0x7f5f4c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:56.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.464+0000 7f5f51676640 1 -- 172.21.15.172:0/1607644836 shutdown_connections 2024-04-25T08:49:56.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.464+0000 7f5f51676640 1 -- 172.21.15.172:0/1607644836 wait complete. 2024-04-25T08:49:56.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.465+0000 7f5f51676640 1 Processor -- start 2024-04-25T08:49:56.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.465+0000 7f5f51676640 1 -- start start 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f51676640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f4c0d32f0 0x7f5f4c0c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f51676640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4c15dc20 0x7f5f4c14b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f51676640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c161710 0x7f5f4c14bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f51676640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c162500 con 0x7f5f4c161710 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f51676640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c162220 con 0x7f5f4c15dc20 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f51676640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0b5e50 con 0x7f5f4c0d32f0 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f4b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c161710 0x7f5f4c14bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f4b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c161710 0x7f5f4c14bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58716/0 (socket says 172.21.15.172:58716) 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f4b7fe640 1 -- 172.21.15.172:0/2129711287 learned_addr learned my addr 172.21.15.172:0/2129711287 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f43fff640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4c15dc20 0x7f5f4c14b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f4b7fe640 1 -- 172.21.15.172:0/2129711287 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f4c0d32f0 msgr2=0x7f5f4c0c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f4affd640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f4c0d32f0 0x7f5f4c0c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f4b7fe640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f4c0d32f0 0x7f5f4c0c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f4b7fe640 1 -- 172.21.15.172:0/2129711287 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4c15dc20 msgr2=0x7f5f4c14b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f4b7fe640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4c15dc20 0x7f5f4c14b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f4b7fe640 1 -- 172.21.15.172:0/2129711287 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c1e9ed0 con 0x7f5f4c161710 2024-04-25T08:49:56.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f43fff640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4c15dc20 0x7f5f4c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:56.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f4b7fe640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c161710 0x7f5f4c14bdb0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400ba10 tx=0x7f5f4400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:56.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f437fe640 1 -- 172.21.15.172:0/2129711287 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44003b70 con 0x7f5f4c161710 2024-04-25T08:49:56.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f437fe640 1 -- 172.21.15.172:0/2129711287 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f44003d10 con 0x7f5f4c161710 2024-04-25T08:49:56.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f51676640 1 -- 172.21.15.172:0/2129711287 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c1e9910 con 0x7f5f4c161710 2024-04-25T08:49:56.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f437fe640 1 -- 172.21.15.172:0/2129711287 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4400cae0 con 0x7f5f4c161710 2024-04-25T08:49:56.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.466+0000 7f5f51676640 1 -- 172.21.15.172:0/2129711287 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c1498f0 con 0x7f5f4c161710 2024-04-25T08:49:56.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.467+0000 7f5f51676640 1 -- 172.21.15.172:0/2129711287 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c073a00 con 0x7f5f4c161710 2024-04-25T08:49:56.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.468+0000 7f5f437fe640 1 -- 172.21.15.172:0/2129711287 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5f4400cc80 con 0x7f5f4c161710 2024-04-25T08:49:56.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.468+0000 7f5f437fe640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f2c06b4d0 0x7f5f2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.468+0000 7f5f4affd640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f2c06b4d0 0x7f5f2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.468+0000 7f5f437fe640 1 -- 172.21.15.172:0/2129711287 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f5f44089d90 con 0x7f5f4c161710 2024-04-25T08:49:56.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.469+0000 7f5f4affd640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f2c06b4d0 0x7f5f2c06d990 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c034000 tx=0x7f5f3c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:56.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.473+0000 7f5f437fe640 1 -- 172.21.15.172:0/2129711287 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f44058e10 con 0x7f5f4c161710 2024-04-25T08:49:56.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.643+0000 7f5f51676640 1 -- 172.21.15.172:0/2129711287 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f4c06b010 con 0x7f5f4c161710 2024-04-25T08:49:56.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.644+0000 7f5f437fe640 1 -- 172.21.15.172:0/2129711287 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f44058710 con 0x7f5f4c161710 2024-04-25T08:49:56.635 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.645+0000 7f5f51676640 1 -- 172.21.15.172:0/2129711287 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f2c06b4d0 msgr2=0x7f5f2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.645+0000 7f5f51676640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f2c06b4d0 0x7f5f2c06d990 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c034000 tx=0x7f5f3c02e000 comp rx=0 tx=0).stop 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.645+0000 7f5f51676640 1 -- 172.21.15.172:0/2129711287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c161710 msgr2=0x7f5f4c14bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.645+0000 7f5f51676640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c161710 0x7f5f4c14bdb0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400ba10 tx=0x7f5f4400bed0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.645+0000 7f5f51676640 1 -- 172.21.15.172:0/2129711287 shutdown_connections 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.645+0000 7f5f51676640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5f2c06b4d0 0x7f5f2c06d990 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.645+0000 7f5f51676640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f4c15dc20 0x7f5f4c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.645+0000 7f5f51676640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f4c161710 0x7f5f4c14bdb0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.645+0000 7f5f51676640 1 --2- 172.21.15.172:0/2129711287 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5f4c0d32f0 0x7f5f4c0c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.645+0000 7f5f51676640 1 -- 172.21.15.172:0/2129711287 >> 172.21.15.172:0/2129711287 conn(0x7f5f4c0d0420 msgr2=0x7f5f4c0c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.646+0000 7f5f51676640 1 -- 172.21.15.172:0/2129711287 shutdown_connections 2024-04-25T08:49:56.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.646+0000 7f5f51676640 1 -- 172.21.15.172:0/2129711287 wait complete. 2024-04-25T08:49:56.648 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-04-25T08:49:56.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.755+0000 7f39c60e1640 1 Processor -- start 2024-04-25T08:49:56.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.755+0000 7f39c60e1640 1 -- start start 2024-04-25T08:49:56.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.755+0000 7f39c60e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c015a790 0x7f39c00d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.755+0000 7f39c60e1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39c006fea0 0x7f39c00d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.755+0000 7f39c60e1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f39c00af9c0 0x7f39c0072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.755+0000 7f39c60e1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c00b3710 con 0x7f39c006fea0 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.755+0000 7f39c60e1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c00cf0e0 con 0x7f39c00af9c0 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.755+0000 7f39c60e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00cf3c0 con 0x7f39c015a790 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39beffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39c006fea0 0x7f39c00d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39beffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39c006fea0 0x7f39c00d08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58730/0 (socket says 172.21.15.172:58730) 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39beffd640 1 -- 172.21.15.172:0/2383655522 learned_addr learned my addr 172.21.15.172:0/2383655522 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39bf7fe640 1 --2- 172.21.15.172:0/2383655522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c015a790 0x7f39c00d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39bffff640 1 --2- 172.21.15.172:0/2383655522 >> v2:172.21.15.186:3300/0 conn(0x7f39c00af9c0 0x7f39c0072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39beffd640 1 -- 172.21.15.172:0/2383655522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c015a790 msgr2=0x7f39c00d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39beffd640 1 --2- 172.21.15.172:0/2383655522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c015a790 0x7f39c00d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39beffd640 1 -- 172.21.15.172:0/2383655522 >> v2:172.21.15.186:3300/0 conn(0x7f39c00af9c0 msgr2=0x7f39c0072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39beffd640 1 --2- 172.21.15.172:0/2383655522 >> v2:172.21.15.186:3300/0 conn(0x7f39c00af9c0 0x7f39c0072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39beffd640 1 -- 172.21.15.172:0/2383655522 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c00cf6a0 con 0x7f39c006fea0 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.756+0000 7f39beffd640 1 --2- 172.21.15.172:0/2383655522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c006fea0 0x7f39c00d08d0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f39c00b2300 tx=0x7f39a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4296066e04a970b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:56.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39be7fc640 1 -- 172.21.15.172:0/2383655522 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8037070 con 0x7f39c006fea0 2024-04-25T08:49:56.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39be7fc640 1 -- 172.21.15.172:0/2383655522 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8032440 con 0x7f39c006fea0 2024-04-25T08:49:56.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39be7fc640 1 -- 172.21.15.172:0/2383655522 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8032810 con 0x7f39c006fea0 2024-04-25T08:49:56.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39c60e1640 1 -- 172.21.15.172:0/2383655522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c006fea0 msgr2=0x7f39c00d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39c60e1640 1 --2- 172.21.15.172:0/2383655522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c006fea0 0x7f39c00d08d0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f39c00b2300 tx=0x7f39a802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39c60e1640 1 -- 172.21.15.172:0/2383655522 shutdown_connections 2024-04-25T08:49:56.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39c60e1640 1 --2- 172.21.15.172:0/2383655522 >> v2:172.21.15.186:3300/0 conn(0x7f39c00af9c0 0x7f39c0072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39c60e1640 1 --2- 172.21.15.172:0/2383655522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c006fea0 0x7f39c00d08d0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39c60e1640 1 --2- 172.21.15.172:0/2383655522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c015a790 0x7f39c00d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39c60e1640 1 -- 172.21.15.172:0/2383655522 >> 172.21.15.172:0/2383655522 conn(0x7f39c00b2370 msgr2=0x7f39c00b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39c60e1640 1 -- 172.21.15.172:0/2383655522 shutdown_connections 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.757+0000 7f39c60e1640 1 -- 172.21.15.172:0/2383655522 wait complete. 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.758+0000 7f39c60e1640 1 Processor -- start 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.759+0000 7f39c60e1640 1 -- start start 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.759+0000 7f39c60e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c006fea0 0x7f39c014b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.759+0000 7f39c60e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c00af9c0 0x7f39c015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.759+0000 7f39c60e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c015a790 0x7f39c015d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.759+0000 7f39c60e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c015ab70 con 0x7f39c00af9c0 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.759+0000 7f39c60e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00cf980 con 0x7f39c006fea0 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.759+0000 7f39c60e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c015acf0 con 0x7f39c015a790 2024-04-25T08:49:56.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.759+0000 7f39beffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c00af9c0 0x7f39c015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.759+0000 7f39beffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c00af9c0 0x7f39c015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58732/0 (socket says 172.21.15.172:58732) 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39beffd640 1 -- 172.21.15.172:0/936225885 learned_addr learned my addr 172.21.15.172:0/936225885 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39bf7fe640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c006fea0 0x7f39c014b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39bffff640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c015a790 0x7f39c015d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39beffd640 1 -- 172.21.15.172:0/936225885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c015a790 msgr2=0x7f39c015d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39beffd640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c015a790 0x7f39c015d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39beffd640 1 -- 172.21.15.172:0/936225885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c006fea0 msgr2=0x7f39c014b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39beffd640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c006fea0 0x7f39c014b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39beffd640 1 -- 172.21.15.172:0/936225885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c01f1a00 con 0x7f39c00af9c0 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39beffd640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c00af9c0 0x7f39c015d040 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f39a802a220 tx=0x7f39a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39b7fff640 1 -- 172.21.15.172:0/936225885 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8041020 con 0x7f39c00af9c0 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39b7fff640 1 -- 172.21.15.172:0/936225885 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a803d620 con 0x7f39c00af9c0 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39b7fff640 1 -- 172.21.15.172:0/936225885 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8037040 con 0x7f39c00af9c0 2024-04-25T08:49:56.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39c60e1640 1 -- 172.21.15.172:0/936225885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c01556a0 con 0x7f39c00af9c0 2024-04-25T08:49:56.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.760+0000 7f39c60e1640 1 -- 172.21.15.172:0/936225885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c01f1fa0 con 0x7f39c00af9c0 2024-04-25T08:49:56.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.761+0000 7f39c60e1640 1 -- 172.21.15.172:0/936225885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c0067be0 con 0x7f39c00af9c0 2024-04-25T08:49:56.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.762+0000 7f39b7fff640 1 -- 172.21.15.172:0/936225885 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f39a8044020 con 0x7f39c00af9c0 2024-04-25T08:49:56.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.762+0000 7f39b7fff640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a006b4d0 0x7f39a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:56.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.762+0000 7f39b7fff640 1 -- 172.21.15.172:0/936225885 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f39a80aa550 con 0x7f39c00af9c0 2024-04-25T08:49:56.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.762+0000 7f39bf7fe640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a006b4d0 0x7f39a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:56.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.762+0000 7f39bf7fe640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a006b4d0 0x7f39a006d990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f39c015dc90 tx=0x7f39b0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:56.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:56.766+0000 7f39b7fff640 1 -- 172.21.15.172:0/936225885 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39c0067be0 con 0x7f39c00af9c0 2024-04-25T08:49:56.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.006+0000 7f39c60e1640 1 -- 172.21.15.172:0/936225885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7f39c0073990 con 0x7f39c00af9c0 2024-04-25T08:49:57.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.032+0000 7f39b7fff640 1 -- 172.21.15.172:0/936225885 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v372) v1 ==== 169+0+0 (secure 0 0 0) 0x7f39a804b030 con 0x7f39c00af9c0 2024-04-25T08:49:57.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 -- 172.21.15.172:0/936225885 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a006b4d0 msgr2=0x7f39a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a006b4d0 0x7f39a006d990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f39c015dc90 tx=0x7f39b0009190 comp rx=0 tx=0).stop 2024-04-25T08:49:57.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 -- 172.21.15.172:0/936225885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c00af9c0 msgr2=0x7f39c015d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c00af9c0 0x7f39c015d040 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f39a802a220 tx=0x7f39a80046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 -- 172.21.15.172:0/936225885 shutdown_connections 2024-04-25T08:49:57.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f39a006b4d0 0x7f39a006d990 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39c015a790 0x7f39c015d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39c00af9c0 0x7f39c015d040 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 --2- 172.21.15.172:0/936225885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39c006fea0 0x7f39c014b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 -- 172.21.15.172:0/936225885 >> 172.21.15.172:0/936225885 conn(0x7f39c00b2370 msgr2=0x7f39c006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:57.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 -- 172.21.15.172:0/936225885 shutdown_connections 2024-04-25T08:49:57.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.034+0000 7f39c60e1640 1 -- 172.21.15.172:0/936225885 wait complete. 2024-04-25T08:49:57.036 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:49:57.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.146+0000 7fe124809640 1 Processor -- start 2024-04-25T08:49:57.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.146+0000 7fe124809640 1 -- start start 2024-04-25T08:49:57.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe124809640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1200cc4f0 0x7fe1200cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe124809640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe120072280 con 0x7fe12015b980 2024-04-25T08:49:57.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe124809640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1200714c0 con 0x7fe1200cdb20 2024-04-25T08:49:57.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe124809640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe120071270 con 0x7fe1200cc4f0 2024-04-25T08:49:57.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11ed9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe12015b980 0x7fe1200ae500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:39944/0 (socket says 172.21.15.172:39944) 2024-04-25T08:49:57.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11ed9d640 1 -- 172.21.15.172:0/3243381899 learned_addr learned my addr 172.21.15.172:0/3243381899 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11e59c640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1200cc4f0 0x7fe1200cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125016503 0 0) 0x7fe120072280 con 0x7fe12015b980 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe108003520 con 0x7fe12015b980 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1894130339 0 0) 0x7fe108003520 con 0x7fe12015b980 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1200cc4f0 msgr2=0x7fe1200cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11d59a640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1200cc4f0 0x7fe1200cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 >> v1:172.21.15.186:6789/0 conn(0x7fe1200cdb20 legacy=0x7fe12015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1200717a0 con 0x7fe12015b980 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fe1180019f0 con 0x7fe12015b980 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.147+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 >> v1:172.21.15.172:6789/0 conn(0x7fe12015b980 legacy=0x7fe1200ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11d59a640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1080039e0 0x7fe108003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11d59a640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1200cc4f0 0x7fe108004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11d59a640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe108004d40 0x7fe1080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.142 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe120071270 con 0x7fe108004d40 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10800dbd0 con 0x7fe1080039e0 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10800ddd0 con 0x7fe1200cc4f0 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11ed9d640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe108004d40 0x7fe1080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11e59c640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1080039e0 0x7fe108003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11dd9b640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1200cc4f0 0x7fe108004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11ed9d640 1 -- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1200cc4f0 msgr2=0x7fe108004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11ed9d640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe1200cc4f0 0x7fe108004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11ed9d640 1 -- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1080039e0 msgr2=0x7fe108003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11ed9d640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1080039e0 0x7fe108003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.148+0000 7fe11ed9d640 1 -- 172.21.15.172:0/3243381899 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108003520 con 0x7fe108004d40 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe11ed9d640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe108004d40 0x7fe1080051c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fe11800a800 tx=0x7fe108005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9211c1e94f60755 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11800a450 con 0x7fe108004d40 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11802f070 con 0x7fe108004d40 2024-04-25T08:49:57.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe11d59a640 1 -- 172.21.15.172:0/3243381899 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11802bc50 con 0x7fe108004d40 2024-04-25T08:49:57.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe124809640 1 -- 172.21.15.172:0/3243381899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe108004d40 msgr2=0x7fe1080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe124809640 1 --2- 172.21.15.172:0/3243381899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe108004d40 0x7fe1080051c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fe11800a800 tx=0x7fe108005830 comp rx=0 tx=0).stop 2024-04-25T08:49:57.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe11ed9d640 1 -- 172.21.15.172:0/3243381899 reap_dead start 2024-04-25T08:49:57.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe124809640 1 -- 172.21.15.172:0/3243381899 shutdown_connections 2024-04-25T08:49:57.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe124809640 1 -- 172.21.15.172:0/3243381899 >> 172.21.15.172:0/3243381899 conn(0x7fe12006abe0 msgr2=0x7fe12006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:57.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe124809640 1 -- 172.21.15.172:0/3243381899 shutdown_connections 2024-04-25T08:49:57.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.149+0000 7fe124809640 1 -- 172.21.15.172:0/3243381899 wait complete. 2024-04-25T08:49:57.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.151+0000 7fe124809640 1 Processor -- start 2024-04-25T08:49:57.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.151+0000 7fe124809640 1 -- start start 2024-04-25T08:49:57.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.151+0000 7fe124809640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe108004d40 0x7fe1200caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.151+0000 7fe124809640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201585f0 0x7fe120158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.151+0000 7fe124809640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe120153a20 0x7fe120153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.151+0000 7fe124809640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe120071d60 con 0x7fe1201585f0 2024-04-25T08:49:57.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.151+0000 7fe124809640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12015bd90 con 0x7fe108004d40 2024-04-25T08:49:57.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.151+0000 7fe124809640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12006e8a0 con 0x7fe120153a20 2024-04-25T08:49:57.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11dd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201585f0 0x7fe120158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11dd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201585f0 0x7fe120158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:58752/0 (socket says 172.21.15.172:58752) 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11dd9b640 1 -- 172.21.15.172:0/3886211839 learned_addr learned my addr 172.21.15.172:0/3886211839 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11ed9d640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe120153a20 0x7fe120153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11e59c640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe108004d40 0x7fe1200caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11dd9b640 1 -- 172.21.15.172:0/3886211839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe120153a20 msgr2=0x7fe120153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11dd9b640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe120153a20 0x7fe120153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11dd9b640 1 -- 172.21.15.172:0/3886211839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe108004d40 msgr2=0x7fe1200caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11dd9b640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe108004d40 0x7fe1200caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11dd9b640 1 -- 172.21.15.172:0/3886211839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120154980 con 0x7fe1201585f0 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe11dd9b640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201585f0 0x7fe120158a70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fe11400f8a0 tx=0x7fe11400fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe10effd640 1 -- 172.21.15.172:0/3886211839 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11401a070 con 0x7fe1201585f0 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe10effd640 1 -- 172.21.15.172:0/3886211839 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11400fe90 con 0x7fe1201585f0 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe124809640 1 -- 172.21.15.172:0/3886211839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe120154410 con 0x7fe1201585f0 2024-04-25T08:49:57.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe10effd640 1 -- 172.21.15.172:0/3886211839 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114007050 con 0x7fe1201585f0 2024-04-25T08:49:57.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.152+0000 7fe124809640 1 -- 172.21.15.172:0/3886211839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1201546a0 con 0x7fe1201585f0 2024-04-25T08:49:57.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.153+0000 7fe124809640 1 -- 172.21.15.172:0/3886211839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe120073a00 con 0x7fe1201585f0 2024-04-25T08:49:57.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.154+0000 7fe10effd640 1 -- 172.21.15.172:0/3886211839 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe11401d070 con 0x7fe1201585f0 2024-04-25T08:49:57.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.154+0000 7fe10effd640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe10006b500 0x7fe10006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.154+0000 7fe10effd640 1 -- 172.21.15.172:0/3886211839 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe114089600 con 0x7fe1201585f0 2024-04-25T08:49:57.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.154+0000 7fe11e59c640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe10006b500 0x7fe10006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.155+0000 7fe11e59c640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe10006b500 0x7fe10006d9c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe110009bc0 tx=0x7fe110009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:57.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.158+0000 7fe10effd640 1 -- 172.21.15.172:0/3886211839 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe114058030 con 0x7fe1201585f0 2024-04-25T08:49:57.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.326+0000 7fe124809640 1 -- 172.21.15.172:0/3886211839 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe12006d3a0 con 0x7fe1201585f0 2024-04-25T08:49:57.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.330+0000 7fe10effd640 1 -- 172.21.15.172:0/3886211839 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe11405c0d0 con 0x7fe1201585f0 2024-04-25T08:49:57.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 -- 172.21.15.172:0/3886211839 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe10006b500 msgr2=0x7fe10006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe10006b500 0x7fe10006d9c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe110009bc0 tx=0x7fe110009190 comp rx=0 tx=0).stop 2024-04-25T08:49:57.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 -- 172.21.15.172:0/3886211839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201585f0 msgr2=0x7fe120158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201585f0 0x7fe120158a70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fe11400f8a0 tx=0x7fe11400fca0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 -- 172.21.15.172:0/3886211839 shutdown_connections 2024-04-25T08:49:57.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe10006b500 0x7fe10006d9c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe120153a20 0x7fe120153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1201585f0 0x7fe120158a70 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 --2- 172.21.15.172:0/3886211839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe108004d40 0x7fe1200caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 -- 172.21.15.172:0/3886211839 >> 172.21.15.172:0/3886211839 conn(0x7fe12006abe0 msgr2=0x7fe1200b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:57.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 -- 172.21.15.172:0/3886211839 shutdown_connections 2024-04-25T08:49:57.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.332+0000 7fe124809640 1 -- 172.21.15.172:0/3886211839 wait complete. 2024-04-25T08:49:57.334 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:49:57.334 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:49:57.375 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:49:57.417 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:49:57.417 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:57.418 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:57.433 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:49:57.433 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:49:57.433 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:57.475 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 none /run/credentials/systemd-tmpfiles-clean.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 2024-04-25T08:49:57.475 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:49:57.475 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:57.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:49:57.490 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:49:57.491 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:49:57.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 none /run/credentials/systemd-tmpfiles-clean.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 2024-04-25T08:49:57.532 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:49:57.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:49:57.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.639+0000 7f5e39134640 1 Processor -- start 2024-04-25T08:49:57.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.639+0000 7f5e39134640 1 -- start start 2024-04-25T08:49:57.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.640+0000 7f5e39134640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e3415f020 0x7f5e340cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.640+0000 7f5e39134640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5e340b0b90 0x7f5e340b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.640+0000 7f5e39134640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e340b1620 con 0x7f5e34099a40 2024-04-25T08:49:57.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.640+0000 7f5e39134640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e340cccb0 con 0x7f5e340b0b90 2024-04-25T08:49:57.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.640+0000 7f5e39134640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340cc3c0 con 0x7f5e3415f020 2024-04-25T08:49:57.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.640+0000 7f5e3259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5e340b0b90 0x7f5e340b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.640+0000 7f5e3259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5e340b0b90 0x7f5e340b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46906/0 (socket says 172.21.15.172:46906) 2024-04-25T08:49:57.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.640+0000 7f5e3259c640 1 -- 172.21.15.172:0/622474710 learned_addr learned my addr 172.21.15.172:0/622474710 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.641+0000 7f5e3259c640 1 -- 172.21.15.172:0/622474710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e3415f020 msgr2=0x7f5e340cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.641+0000 7f5e3259c640 1 --2- 172.21.15.172:0/622474710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e3415f020 0x7f5e340cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.641+0000 7f5e3259c640 1 -- 172.21.15.172:0/622474710 >> v1:172.21.15.186:6789/0 conn(0x7f5e34099a40 legacy=0x7f5e340cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.641+0000 7f5e3259c640 1 -- 172.21.15.172:0/622474710 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3415f400 con 0x7f5e340b0b90 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.641+0000 7f5e3259c640 1 --2- 172.21.15.172:0/622474710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340b0b90 0x7f5e340b10e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009870 tx=0x7f5e2802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff1f28e8b12c08a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.641+0000 7f5e31d9b640 1 -- 172.21.15.172:0/622474710 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28037070 con 0x7f5e340b0b90 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.641+0000 7f5e31d9b640 1 -- 172.21.15.172:0/622474710 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e28032440 con 0x7f5e340b0b90 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.641+0000 7f5e31d9b640 1 -- 172.21.15.172:0/622474710 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28032810 con 0x7f5e340b0b90 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.642+0000 7f5e39134640 1 -- 172.21.15.172:0/622474710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340b0b90 msgr2=0x7f5e340b10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.642+0000 7f5e39134640 1 --2- 172.21.15.172:0/622474710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340b0b90 0x7f5e340b10e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009870 tx=0x7f5e2802a210 comp rx=0 tx=0).stop 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.642+0000 7f5e39134640 1 -- 172.21.15.172:0/622474710 shutdown_connections 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.642+0000 7f5e39134640 1 --2- 172.21.15.172:0/622474710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340b0b90 0x7f5e340b10e0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.642+0000 7f5e39134640 1 --2- 172.21.15.172:0/622474710 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e3415f020 0x7f5e340cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.642+0000 7f5e39134640 1 -- 172.21.15.172:0/622474710 >> 172.21.15.172:0/622474710 conn(0x7f5e340b3310 msgr2=0x7f5e340b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:57.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.642+0000 7f5e39134640 1 -- 172.21.15.172:0/622474710 shutdown_connections 2024-04-25T08:49:57.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.642+0000 7f5e39134640 1 -- 172.21.15.172:0/622474710 wait complete. 2024-04-25T08:49:57.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.643+0000 7f5e39134640 1 Processor -- start 2024-04-25T08:49:57.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.644+0000 7f5e39134640 1 -- start start 2024-04-25T08:49:57.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.644+0000 7f5e39134640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34099a40 0x7f5e341e5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.644+0000 7f5e39134640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e340b0b90 0x7f5e341e59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.644+0000 7f5e39134640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e3415f020 0x7f5e340c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.644+0000 7f5e39134640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340cc660 con 0x7f5e34099a40 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.644+0000 7f5e39134640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340d0830 con 0x7f5e340b0b90 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.644+0000 7f5e39134640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340cc940 con 0x7f5e3415f020 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.644+0000 7f5e32d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34099a40 0x7f5e341e5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.644+0000 7f5e32d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34099a40 0x7f5e341e5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46914/0 (socket says 172.21.15.172:46914) 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.644+0000 7f5e32d9d640 1 -- 172.21.15.172:0/2115144013 learned_addr learned my addr 172.21.15.172:0/2115144013 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e3359e640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e3415f020 0x7f5e340c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e3259c640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e340b0b90 0x7f5e341e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e32d9d640 1 -- 172.21.15.172:0/2115144013 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e3415f020 msgr2=0x7f5e340c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e32d9d640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e3415f020 0x7f5e340c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e32d9d640 1 -- 172.21.15.172:0/2115144013 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e340b0b90 msgr2=0x7f5e341e59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e32d9d640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e340b0b90 0x7f5e341e59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e32d9d640 1 -- 172.21.15.172:0/2115144013 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e340aef30 con 0x7f5e34099a40 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e32d9d640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34099a40 0x7f5e341e5490 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400ba80 tx=0x7f5e2400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e1b7fe640 1 -- 172.21.15.172:0/2115144013 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24019070 con 0x7f5e34099a40 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e1b7fe640 1 -- 172.21.15.172:0/2115144013 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2400cc20 con 0x7f5e34099a40 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e39134640 1 -- 172.21.15.172:0/2115144013 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e340af210 con 0x7f5e34099a40 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e1b7fe640 1 -- 172.21.15.172:0/2115144013 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24014440 con 0x7f5e34099a40 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.645+0000 7f5e39134640 1 -- 172.21.15.172:0/2115144013 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e340af7d0 con 0x7f5e34099a40 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.646+0000 7f5e39134640 1 -- 172.21.15.172:0/2115144013 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e34073990 con 0x7f5e34099a40 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.646+0000 7f5e1b7fe640 1 -- 172.21.15.172:0/2115144013 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e2401c070 con 0x7f5e34099a40 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.647+0000 7f5e1b7fe640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e2006b4d0 0x7f5e2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.647+0000 7f5e3259c640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e2006b4d0 0x7f5e2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:57.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.647+0000 7f5e1b7fe640 1 -- 172.21.15.172:0/2115144013 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f5e24089d40 con 0x7f5e34099a40 2024-04-25T08:49:57.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.647+0000 7f5e3259c640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e2006b4d0 0x7f5e2006d990 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5e28034000 tx=0x7f5e2802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:57.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.651+0000 7f5e1b7fe640 1 -- 172.21.15.172:0/2115144013 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e240586e0 con 0x7f5e34099a40 2024-04-25T08:49:57.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.859+0000 7f5e39134640 1 -- 172.21.15.172:0/2115144013 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e340b77a0 con 0x7f5e34099a40 2024-04-25T08:49:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.859+0000 7f5e1b7fe640 1 -- 172.21.15.172:0/2115144013 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f5e2405c780 con 0x7f5e34099a40 2024-04-25T08:49:57.850 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:57.850 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/29369931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":29369931},{"type":"v1","addr":"172.21.15.186:6834","nonce":29369931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":6584,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3700531139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3700531139},{"type":"v1","addr":"172.21.15.186:6835","nonce":3700531139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":64},{"gid":8115,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/3522225607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3522225607},{"type":"v1","addr":"172.21.15.172:6836","nonce":3522225607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8118,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4264688679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4264688679},{"type":"v1","addr":"172.21.15.172:6837","nonce":4264688679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[]} 2024-04-25T08:49:57.850 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 64 2024-04-25T08:49:57.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 -- 172.21.15.172:0/2115144013 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e2006b4d0 msgr2=0x7f5e2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e2006b4d0 0x7f5e2006d990 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5e28034000 tx=0x7f5e2802e000 comp rx=0 tx=0).stop 2024-04-25T08:49:57.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 -- 172.21.15.172:0/2115144013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34099a40 msgr2=0x7f5e341e5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:57.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34099a40 0x7f5e341e5490 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400ba80 tx=0x7f5e2400bf40 comp rx=0 tx=0).stop 2024-04-25T08:49:57.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 -- 172.21.15.172:0/2115144013 shutdown_connections 2024-04-25T08:49:57.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e2006b4d0 0x7f5e2006d990 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e340b0b90 0x7f5e341e59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e3415f020 0x7f5e340c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 --2- 172.21.15.172:0/2115144013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34099a40 0x7f5e341e5490 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:57.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 -- 172.21.15.172:0/2115144013 >> 172.21.15.172:0/2115144013 conn(0x7f5e340b3310 msgr2=0x7f5e3415f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:57.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 -- 172.21.15.172:0/2115144013 shutdown_connections 2024-04-25T08:49:57.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:57.861+0000 7f5e39134640 1 -- 172.21.15.172:0/2115144013 wait complete. 2024-04-25T08:49:57.864 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:49:57.864 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:49:57.864 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:49:57.864 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:49:57.864 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:49:57.864 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:49:57.864 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:49:57.865 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:49:57.865 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:49:57.865 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:49:57.865 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:49:57.865 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:49:57.865 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:49:57.865 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:49:57.866 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:49:57.866 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:49:57.875 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:49:57.875 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:49:57.876 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:49:57.876 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:49:57.877 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:49:57.877 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:49:57.878 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:49:57.878 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:49:57.918 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:49:57.918 DEBUG:teuthology.parallel:result is None 2024-04-25T08:49:57.919 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:49:57.919 DEBUG:teuthology.parallel:result is None 2024-04-25T08:49:57.920 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:49:57.920 DEBUG:teuthology.parallel:result is None 2024-04-25T08:49:57.921 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:49:57.921 DEBUG:teuthology.parallel:result is None 2024-04-25T08:49:57.921 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:49:57.992 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:49:57.992 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:49:58.002 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:49:58.002 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:49:58.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.033+0000 7f7910709640 1 Processor -- start 2024-04-25T08:49:58.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.034+0000 7f7910709640 1 -- start start 2024-04-25T08:49:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f7910709640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79080cf600 0x7f79080cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f7910709640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f79080cbf20 0x7f79080cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f7910709640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79080c75e0 con 0x7f790815bb50 2024-04-25T08:49:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f7910709640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79080c8680 con 0x7f79080cf600 2024-04-25T08:49:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f7910709640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79080cff80 con 0x7f79080cbf20 2024-04-25T08:49:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f790dca4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79080cf600 0x7f79080cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f790dca4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79080cf600 0x7f79080cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46944/0 (socket says 172.21.15.172:46944) 2024-04-25T08:49:58.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f790dca4640 1 -- 172.21.15.172:0/486736356 learned_addr learned my addr 172.21.15.172:0/486736356 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:58.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f790eca6640 1 --2- 172.21.15.172:0/486736356 >> v2:172.21.15.186:3300/0 conn(0x7f79080cbf20 0x7f79080cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:58.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f790dca4640 1 -- 172.21.15.172:0/486736356 >> v2:172.21.15.186:3300/0 conn(0x7f79080cbf20 msgr2=0x7f79080cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:58.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f790dca4640 1 --2- 172.21.15.172:0/486736356 >> v2:172.21.15.186:3300/0 conn(0x7f79080cbf20 0x7f79080cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:58.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f790dca4640 1 -- 172.21.15.172:0/486736356 >> v1:172.21.15.186:6789/0 conn(0x7f790815bb50 legacy=0x7f79080c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:58.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.035+0000 7f790dca4640 1 -- 172.21.15.172:0/486736356 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79080c78c0 con 0x7f79080cf600 2024-04-25T08:49:58.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.036+0000 7f790dca4640 1 --2- 172.21.15.172:0/486736356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79080cf600 0x7f79080cfa40 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f790806f370 tx=0x7f78f802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f031749ebd860e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:58.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.036+0000 7f790d4a3640 1 -- 172.21.15.172:0/486736356 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8037070 con 0x7f79080cf600 2024-04-25T08:49:58.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.036+0000 7f790d4a3640 1 -- 172.21.15.172:0/486736356 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f802ae50 con 0x7f79080cf600 2024-04-25T08:49:58.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.036+0000 7f790d4a3640 1 -- 172.21.15.172:0/486736356 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8032860 con 0x7f79080cf600 2024-04-25T08:49:58.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.037+0000 7f7910709640 1 -- 172.21.15.172:0/486736356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79080cf600 msgr2=0x7f79080cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:58.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.037+0000 7f7910709640 1 --2- 172.21.15.172:0/486736356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79080cf600 0x7f79080cfa40 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f790806f370 tx=0x7f78f802a300 comp rx=0 tx=0).stop 2024-04-25T08:49:58.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.037+0000 7f7910709640 1 -- 172.21.15.172:0/486736356 shutdown_connections 2024-04-25T08:49:58.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.037+0000 7f7910709640 1 --2- 172.21.15.172:0/486736356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79080cf600 0x7f79080cfa40 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.037+0000 7f7910709640 1 --2- 172.21.15.172:0/486736356 >> v2:172.21.15.186:3300/0 conn(0x7f79080cbf20 0x7f79080cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.037+0000 7f7910709640 1 -- 172.21.15.172:0/486736356 >> 172.21.15.172:0/486736356 conn(0x7f790806f500 msgr2=0x7f790806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.037+0000 7f7910709640 1 -- 172.21.15.172:0/486736356 shutdown_connections 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.037+0000 7f7910709640 1 -- 172.21.15.172:0/486736356 wait complete. 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.038+0000 7f7910709640 1 Processor -- start 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.038+0000 7f7910709640 1 -- start start 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f7910709640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79080cbf20 0x7f7908142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f7910709640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79080cf600 0x7f79081f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f7910709640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f790815bb50 0x7f79080b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f7910709640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79080c8160 con 0x7f790815bb50 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f7910709640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79080c7e80 con 0x7f79080cf600 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f7910709640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79080c72a0 con 0x7f79080cbf20 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f790eca6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f790815bb50 0x7f79080b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f790dca4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79080cf600 0x7f79081f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:58.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f790eca6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f790815bb50 0x7f79080b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46956/0 (socket says 172.21.15.172:46956) 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f790eca6640 1 -- 172.21.15.172:0/1526130871 learned_addr learned my addr 172.21.15.172:0/1526130871 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.039+0000 7f790e4a5640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79080cbf20 0x7f7908142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f790eca6640 1 -- 172.21.15.172:0/1526130871 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79080cbf20 msgr2=0x7f7908142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f790eca6640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79080cbf20 0x7f7908142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f790eca6640 1 -- 172.21.15.172:0/1526130871 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79080cf600 msgr2=0x7f79081f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f790eca6640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79080cf600 0x7f79081f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f790eca6640 1 -- 172.21.15.172:0/1526130871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790813edf0 con 0x7f790815bb50 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f790eca6640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f790815bb50 0x7f79080b6d50 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f7900009dd0 tx=0x7f790000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f78feffd640 1 -- 172.21.15.172:0/1526130871 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900018020 con 0x7f790815bb50 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f78feffd640 1 -- 172.21.15.172:0/1526130871 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900014480 con 0x7f790815bb50 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f78feffd640 1 -- 172.21.15.172:0/1526130871 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900014870 con 0x7f790815bb50 2024-04-25T08:49:58.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f7910709640 1 -- 172.21.15.172:0/1526130871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79081f5a40 con 0x7f790815bb50 2024-04-25T08:49:58.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.040+0000 7f7910709640 1 -- 172.21.15.172:0/1526130871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79081f6000 con 0x7f790815bb50 2024-04-25T08:49:58.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.041+0000 7f7910709640 1 -- 172.21.15.172:0/1526130871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79080cf150 con 0x7f790815bb50 2024-04-25T08:49:58.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.042+0000 7f78feffd640 1 -- 172.21.15.172:0/1526130871 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7900005d10 con 0x7f790815bb50 2024-04-25T08:49:58.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.042+0000 7f78feffd640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f78ec06b4d0 0x7f78ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:58.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.042+0000 7f78feffd640 1 -- 172.21.15.172:0/1526130871 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f790008aa60 con 0x7f790815bb50 2024-04-25T08:49:58.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.042+0000 7f790e4a5640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f78ec06b4d0 0x7f78ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:58.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.043+0000 7f790e4a5640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f78ec06b4d0 0x7f78ec06d990 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f79040016e0 tx=0x7f7904009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:58.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.048+0000 7f78feffd640 1 -- 172.21.15.172:0/1526130871 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7900022070 con 0x7f790815bb50 2024-04-25T08:49:58.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:58.233+0000 7f7910709640 1 -- 172.21.15.172:0/1526130871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f79080b0a80 con 0x7f790815bb50 2024-04-25T08:49:59.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.050+0000 7f78feffd640 1 -- 172.21.15.172:0/1526130871 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v115) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7900010040 con 0x7f790815bb50 2024-04-25T08:49:59.041 INFO:teuthology.orchestra.run.smithi172.stderr: removed all blocklist entries 2024-04-25T08:49:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 -- 172.21.15.172:0/1526130871 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f78ec06b4d0 msgr2=0x7f78ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f78ec06b4d0 0x7f78ec06d990 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f79040016e0 tx=0x7f7904009040 comp rx=0 tx=0).stop 2024-04-25T08:49:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 -- 172.21.15.172:0/1526130871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f790815bb50 msgr2=0x7f79080b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f790815bb50 0x7f79080b6d50 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f7900009dd0 tx=0x7f790000c490 comp rx=0 tx=0).stop 2024-04-25T08:49:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 -- 172.21.15.172:0/1526130871 shutdown_connections 2024-04-25T08:49:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f78ec06b4d0 0x7f78ec06d990 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79080cf600 0x7f79081f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f790815bb50 0x7f79080b6d50 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 --2- 172.21.15.172:0/1526130871 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79080cbf20 0x7f7908142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 -- 172.21.15.172:0/1526130871 >> 172.21.15.172:0/1526130871 conn(0x7f790806f500 msgr2=0x7f7908159700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:59.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 -- 172.21.15.172:0/1526130871 shutdown_connections 2024-04-25T08:49:59.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.053+0000 7f7910709640 1 -- 172.21.15.172:0/1526130871 wait complete. 2024-04-25T08:49:59.057 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:49:59.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.171+0000 7f966bbce640 1 Processor -- start 2024-04-25T08:49:59.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.171+0000 7f966bbce640 1 -- start start 2024-04-25T08:49:59.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.172+0000 7f966bbce640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f966415bd30 0x7f96640cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.172+0000 7f966bbce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.172+0000 7f966bbce640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96640b5a40 con 0x7f96640d1930 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.172+0000 7f966bbce640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96640d0350 con 0x7f966415bd30 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.172+0000 7f966bbce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96640d0630 con 0x7f96640cfe40 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.172+0000 7f9669169640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.172+0000 7f966996a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f966415bd30 0x7f96640cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.172+0000 7f9669169640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:52606/0 (socket says 172.21.15.172:52606) 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.172+0000 7f966a16b640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f96640d1930 0x7f96640ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41512/0 (socket says 172.21.15.172:41512) 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.172+0000 7f9669169640 1 -- 172.21.15.172:0/2603236205 learned_addr learned my addr 172.21.15.172:0/2603236205 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.173+0000 7f9669169640 1 -- 172.21.15.172:0/2603236205 >> v2:172.21.15.186:3300/0 conn(0x7f966415bd30 msgr2=0x7f96640cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.173+0000 7f9669169640 1 --2- 172.21.15.172:0/2603236205 >> v2:172.21.15.186:3300/0 conn(0x7f966415bd30 0x7f96640cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.173+0000 7f9669169640 1 -- 172.21.15.172:0/2603236205 >> v1:172.21.15.186:6789/0 conn(0x7f96640d1930 legacy=0x7f96640ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.173+0000 7f9668968640 1 -- 172.21.15.172:0/2603236205 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135819470 0 0) 0x7f96640b5a40 con 0x7f96640d1930 2024-04-25T08:49:59.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.173+0000 7f9669169640 1 -- 172.21.15.172:0/2603236205 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96640d0910 con 0x7f96640cfe40 2024-04-25T08:49:59.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f9669169640 1 --2- 172.21.15.172:0/2603236205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640d13f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9654009870 tx=0x7f965402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fb129a631875453 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:59.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f9668968640 1 -- 172.21.15.172:0/2603236205 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654037070 con 0x7f96640cfe40 2024-04-25T08:49:59.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f9668968640 1 -- 172.21.15.172:0/2603236205 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965402ae50 con 0x7f96640cfe40 2024-04-25T08:49:59.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f9668968640 1 -- 172.21.15.172:0/2603236205 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654032860 con 0x7f96640cfe40 2024-04-25T08:49:59.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f966bbce640 1 -- 172.21.15.172:0/2603236205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 msgr2=0x7f96640d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f966bbce640 1 --2- 172.21.15.172:0/2603236205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640d13f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9654009870 tx=0x7f965402a300 comp rx=0 tx=0).stop 2024-04-25T08:49:59.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f966bbce640 1 -- 172.21.15.172:0/2603236205 shutdown_connections 2024-04-25T08:49:59.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f966bbce640 1 --2- 172.21.15.172:0/2603236205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640d13f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f966bbce640 1 --2- 172.21.15.172:0/2603236205 >> v2:172.21.15.186:3300/0 conn(0x7f966415bd30 0x7f96640cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f966bbce640 1 -- 172.21.15.172:0/2603236205 >> 172.21.15.172:0/2603236205 conn(0x7f966406f590 msgr2=0x7f966406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:59.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f966bbce640 1 -- 172.21.15.172:0/2603236205 shutdown_connections 2024-04-25T08:49:59.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.174+0000 7f966bbce640 1 -- 172.21.15.172:0/2603236205 wait complete. 2024-04-25T08:49:59.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.175+0000 7f966bbce640 1 Processor -- start 2024-04-25T08:49:59.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.175+0000 7f966bbce640 1 -- start start 2024-04-25T08:49:59.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f966bbce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f966bbce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96640d1930 0x7f9664153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f966bbce640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966415bd30 0x7f9664153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f966bbce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966415c110 con 0x7f96640d1930 2024-04-25T08:49:59.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f966bbce640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96640d0ed0 con 0x7f966415bd30 2024-04-25T08:49:59.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f966bbce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96640b73b0 con 0x7f96640cfe40 2024-04-25T08:49:59.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f9669169640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96640d1930 0x7f9664153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f9669169640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96640d1930 0x7f9664153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46970/0 (socket says 172.21.15.172:46970) 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f9669169640 1 -- 172.21.15.172:0/299709939 learned_addr learned my addr 172.21.15.172:0/299709939 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f966a16b640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966415bd30 0x7f9664153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.176+0000 7f966996a640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f9669169640 1 -- 172.21.15.172:0/299709939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 msgr2=0x7f96640ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f9669169640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f9669169640 1 -- 172.21.15.172:0/299709939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966415bd30 msgr2=0x7f9664153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f9669169640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966415bd30 0x7f9664153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f9669169640 1 -- 172.21.15.172:0/299709939 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96641544a0 con 0x7f96640d1930 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f966996a640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f9669169640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96640d1930 0x7f9664153950 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f9654035040 tx=0x7f96540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f965a7fc640 1 -- 172.21.15.172:0/299709939 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654037040 con 0x7f96640d1930 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f965a7fc640 1 -- 172.21.15.172:0/299709939 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9654004230 con 0x7f96640d1930 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f965a7fc640 1 -- 172.21.15.172:0/299709939 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654003610 con 0x7f96640d1930 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f966bbce640 1 -- 172.21.15.172:0/299709939 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9664154780 con 0x7f96640d1930 2024-04-25T08:49:59.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.177+0000 7f966bbce640 1 -- 172.21.15.172:0/299709939 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96640cb380 con 0x7f96640d1930 2024-04-25T08:49:59.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.178+0000 7f966bbce640 1 -- 172.21.15.172:0/299709939 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9664073990 con 0x7f96640d1930 2024-04-25T08:49:59.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.178+0000 7f965a7fc640 1 -- 172.21.15.172:0/299709939 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f965403a070 con 0x7f96640d1930 2024-04-25T08:49:59.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.179+0000 7f965a7fc640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f964806b4d0 0x7f964806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.179+0000 7f966996a640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f964806b4d0 0x7f964806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.179+0000 7f965a7fc640 1 -- 172.21.15.172:0/299709939 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f96540aa4d0 con 0x7f96640d1930 2024-04-25T08:49:59.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.179+0000 7f966996a640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f964806b4d0 0x7f964806d990 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9660009af0 tx=0x7f9660008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:59.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.183+0000 7f965a7fc640 1 -- 172.21.15.172:0/299709939 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9654041020 con 0x7f96640d1930 2024-04-25T08:49:59.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.418+0000 7f966bbce640 1 -- 172.21.15.172:0/299709939 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9664154ca0 con 0x7f96640d1930 2024-04-25T08:49:59.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.418+0000 7f965a7fc640 1 -- 172.21.15.172:0/299709939 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9654078ec0 con 0x7f96640d1930 2024-04-25T08:49:59.409 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:59.409 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:49:59.409 INFO:teuthology.orchestra.run.smithi172.stdout: "auth_dump": [ 2024-04-25T08:49:59.409 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.409 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.a", 2024-04-25T08:49:59.409 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q==", 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.b", 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg==", 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.c", 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA==", 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.d", 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg==", 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.0", 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ==", 2024-04-25T08:49:59.412 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.1", 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g==", 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.413 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.2", 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g==", 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.3", 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg==", 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:59.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.4", 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw==", 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.5", 2024-04-25T08:49:59.415 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow==", 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.6", 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg==", 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.416 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.7", 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q==", 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.0", 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q==", 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow r", 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.1", 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g==", 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.2", 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw==", 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.418 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.3", 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w==", 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.admin", 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmFmQsIBAAkuAmqIptAT1ivH6T7/1T8A==", 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.x", 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw==", 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:49:59.420 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.y", 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg==", 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-25T08:49:59.421 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:49:59.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 -- 172.21.15.172:0/299709939 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f964806b4d0 msgr2=0x7f964806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f964806b4d0 0x7f964806d990 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9660009af0 tx=0x7f9660008040 comp rx=0 tx=0).stop 2024-04-25T08:49:59.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 -- 172.21.15.172:0/299709939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96640d1930 msgr2=0x7f9664153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96640d1930 0x7f9664153950 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f9654035040 tx=0x7f96540046c0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 -- 172.21.15.172:0/299709939 shutdown_connections 2024-04-25T08:49:59.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f964806b4d0 0x7f964806d990 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f966415bd30 0x7f9664153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96640d1930 0x7f9664153950 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 --2- 172.21.15.172:0/299709939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f96640cfe40 0x7f96640ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 -- 172.21.15.172:0/299709939 >> 172.21.15.172:0/299709939 conn(0x7f966406f590 msgr2=0x7f96640b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:59.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 -- 172.21.15.172:0/299709939 shutdown_connections 2024-04-25T08:49:59.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.420+0000 7f966bbce640 1 -- 172.21.15.172:0/299709939 wait complete. 2024-04-25T08:49:59.424 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:49:59.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.531+0000 7f09884b3640 1 Processor -- start 2024-04-25T08:49:59.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.531+0000 7f09884b3640 1 -- start start 2024-04-25T08:49:59.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f09884b3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f09800d0aa0 0x7f09800b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f09884b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f098006fea0 0x7f09800b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f09884b3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09800b3710 con 0x7f098015a790 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f09884b3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09800cf0e0 con 0x7f09800d0aa0 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f09884b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09800cf3c0 con 0x7f098006fea0 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f0985a4e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f09800d0aa0 0x7f09800b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f0986a50640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f098006fea0 0x7f09800b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f098624f640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f098015a790 0x7f09800d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41526/0 (socket says 172.21.15.172:41526) 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f0986a50640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f098006fea0 0x7f09800b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:52618/0 (socket says 172.21.15.172:52618) 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f0985a4e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f09800d0aa0 0x7f09800b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:41712/0 (socket says 172.21.15.172:41712) 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.532+0000 7f098624f640 1 -- 172.21.15.172:0/4085158756 learned_addr learned my addr 172.21.15.172:0/4085158756 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.533+0000 7f0986a50640 1 -- 172.21.15.172:0/4085158756 >> v2:172.21.15.186:3300/0 conn(0x7f09800d0aa0 msgr2=0x7f09800b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.533+0000 7f0986a50640 1 --2- 172.21.15.172:0/4085158756 >> v2:172.21.15.186:3300/0 conn(0x7f09800d0aa0 0x7f09800b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.533+0000 7f0986a50640 1 -- 172.21.15.172:0/4085158756 >> v1:172.21.15.186:6789/0 conn(0x7f098015a790 legacy=0x7f09800d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.533+0000 7f0986a50640 1 -- 172.21.15.172:0/4085158756 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800cf6a0 con 0x7f098006fea0 2024-04-25T08:49:59.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.533+0000 7f098524d640 1 -- 172.21.15.172:0/4085158756 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979784772 0 0) 0x7f09800b3710 con 0x7f098015a790 2024-04-25T08:49:59.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.533+0000 7f0985a4e640 1 --2- 172.21.15.172:0/4085158756 >> v2:172.21.15.186:3300/0 conn(0x7f09800d0aa0 0x7f09800b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:49:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.533+0000 7f0986a50640 1 --2- 172.21.15.172:0/4085158756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f098006fea0 0x7f09800b43e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09780097a0 tx=0x7f097802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb94a9f8cbf65a94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f098524d640 1 -- 172.21.15.172:0/4085158756 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978037070 con 0x7f098006fea0 2024-04-25T08:49:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f098524d640 1 -- 172.21.15.172:0/4085158756 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978032440 con 0x7f098006fea0 2024-04-25T08:49:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f098524d640 1 -- 172.21.15.172:0/4085158756 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978032810 con 0x7f098006fea0 2024-04-25T08:49:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f09884b3640 1 -- 172.21.15.172:0/4085158756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f098006fea0 msgr2=0x7f09800b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f09884b3640 1 --2- 172.21.15.172:0/4085158756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f098006fea0 0x7f09800b43e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f09780097a0 tx=0x7f097802a180 comp rx=0 tx=0).stop 2024-04-25T08:49:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f09884b3640 1 -- 172.21.15.172:0/4085158756 shutdown_connections 2024-04-25T08:49:59.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f09884b3640 1 --2- 172.21.15.172:0/4085158756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f098006fea0 0x7f09800b43e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f09884b3640 1 --2- 172.21.15.172:0/4085158756 >> v2:172.21.15.186:3300/0 conn(0x7f09800d0aa0 0x7f09800b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f09884b3640 1 -- 172.21.15.172:0/4085158756 >> 172.21.15.172:0/4085158756 conn(0x7f09800b2370 msgr2=0x7f09800b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f09884b3640 1 -- 172.21.15.172:0/4085158756 shutdown_connections 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.534+0000 7f09884b3640 1 -- 172.21.15.172:0/4085158756 wait complete. 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.535+0000 7f09884b3640 1 Processor -- start 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.535+0000 7f09884b3640 1 -- start start 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f09884b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098006fea0 0x7f098014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f09884b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09800d0aa0 0x7f09800b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f09884b3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f098015a790 0x7f09800aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f09884b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098015ab70 con 0x7f098006fea0 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f09884b3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800cf980 con 0x7f098015a790 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f09884b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098015acf0 con 0x7f09800d0aa0 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f098624f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098006fea0 0x7f098014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f098624f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098006fea0 0x7f098014c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46986/0 (socket says 172.21.15.172:46986) 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f098624f640 1 -- 172.21.15.172:0/4199524476 learned_addr learned my addr 172.21.15.172:0/4199524476 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f0985a4e640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09800d0aa0 0x7f09800b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.536+0000 7f0986a50640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f098015a790 0x7f09800aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f098624f640 1 -- 172.21.15.172:0/4199524476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09800d0aa0 msgr2=0x7f09800b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f098624f640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09800d0aa0 0x7f09800b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f098624f640 1 -- 172.21.15.172:0/4199524476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f098015a790 msgr2=0x7f09800aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f098624f640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f098015a790 0x7f09800aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f098624f640 1 -- 172.21.15.172:0/4199524476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800b0410 con 0x7f098006fea0 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f098624f640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098006fea0 0x7f098014c0d0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c7c0 tx=0x7f097c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f0976ffd640 1 -- 172.21.15.172:0/4199524476 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c018070 con 0x7f098006fea0 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f0976ffd640 1 -- 172.21.15.172:0/4199524476 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c00a640 con 0x7f098006fea0 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f0976ffd640 1 -- 172.21.15.172:0/4199524476 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c00aa30 con 0x7f098006fea0 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f09884b3640 1 -- 172.21.15.172:0/4199524476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09800b06f0 con 0x7f098006fea0 2024-04-25T08:49:59.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.537+0000 7f09884b3640 1 -- 172.21.15.172:0/4199524476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09800b0cb0 con 0x7f098006fea0 2024-04-25T08:49:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.538+0000 7f09884b3640 1 -- 172.21.15.172:0/4199524476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0980073990 con 0x7f098006fea0 2024-04-25T08:49:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.539+0000 7f0976ffd640 1 -- 172.21.15.172:0/4199524476 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f097c00abd0 con 0x7f098006fea0 2024-04-25T08:49:59.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.539+0000 7f0976ffd640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f096406b4d0 0x7f096406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.539+0000 7f0985a4e640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f096406b4d0 0x7f096406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.539+0000 7f0976ffd640 1 -- 172.21.15.172:0/4199524476 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f097c089610 con 0x7f098006fea0 2024-04-25T08:49:59.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.539+0000 7f0985a4e640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f096406b4d0 0x7f096406d990 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0970009560 tx=0x7f0970009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:59.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.543+0000 7f0976ffd640 1 -- 172.21.15.172:0/4199524476 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f097c058010 con 0x7f098006fea0 2024-04-25T08:49:59.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.712+0000 7f09884b3640 1 -- 172.21.15.172:0/4199524476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0980158530 con 0x7f098006fea0 2024-04-25T08:49:59.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.713+0000 7f0976ffd640 1 -- 172.21.15.172:0/4199524476 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+13234 (secure 0 0 0) 0x7f097c05c0b0 con 0x7f098006fea0 2024-04-25T08:49:59.703 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:49:59.704 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":115,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:49:59.049305+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 -- 172.21.15.172:0/4199524476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f096406b4d0 msgr2=0x7f096406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f096406b4d0 0x7f096406d990 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0970009560 tx=0x7f0970009190 comp rx=0 tx=0).stop 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 -- 172.21.15.172:0/4199524476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098006fea0 msgr2=0x7f098014c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098006fea0 0x7f098014c0d0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c7c0 tx=0x7f097c00cc80 comp rx=0 tx=0).stop 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 -- 172.21.15.172:0/4199524476 shutdown_connections 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f096406b4d0 0x7f096406d990 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f098015a790 0x7f09800aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09800d0aa0 0x7f09800b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 --2- 172.21.15.172:0/4199524476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098006fea0 0x7f098014c0d0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 -- 172.21.15.172:0/4199524476 >> 172.21.15.172:0/4199524476 conn(0x7f09800b2370 msgr2=0x7f0980157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 -- 172.21.15.172:0/4199524476 shutdown_connections 2024-04-25T08:49:59.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.715+0000 7f09884b3640 1 -- 172.21.15.172:0/4199524476 wait complete. 2024-04-25T08:49:59.717 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:49:59.717 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:49:59.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.827+0000 7f40dd66f640 1 Processor -- start 2024-04-25T08:49:59.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.827+0000 7f40dd66f640 1 -- start start 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40dd66f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f40d815dc20 0x7f40d80ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40dd66f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f40d8161710 0x7f40d80cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40dd66f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40d80b9330 0x7f40d806bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40dd66f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d815e000 con 0x7f40d8161710 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40dd66f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d80d1de0 con 0x7f40d815dc20 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40dd66f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8161c60 con 0x7f40d80b9330 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d67fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f40d8161710 0x7f40d80cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d67fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f40d8161710 0x7f40d80cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46998/0 (socket says 172.21.15.172:46998) 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d67fc640 1 -- 172.21.15.172:0/2865160325 learned_addr learned my addr 172.21.15.172:0/2865160325 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d6ffd640 1 --2- 172.21.15.172:0/2865160325 >> v2:172.21.15.186:3300/0 conn(0x7f40d815dc20 0x7f40d80ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d77fe640 1 --2- 172.21.15.172:0/2865160325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40d80b9330 0x7f40d806bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d67fc640 1 -- 172.21.15.172:0/2865160325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40d80b9330 msgr2=0x7f40d806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d67fc640 1 --2- 172.21.15.172:0/2865160325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40d80b9330 0x7f40d806bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d67fc640 1 -- 172.21.15.172:0/2865160325 >> v2:172.21.15.186:3300/0 conn(0x7f40d815dc20 msgr2=0x7f40d80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d67fc640 1 --2- 172.21.15.172:0/2865160325 >> v2:172.21.15.186:3300/0 conn(0x7f40d815dc20 0x7f40d80ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d67fc640 1 -- 172.21.15.172:0/2865160325 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8161f40 con 0x7f40d8161710 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.828+0000 7f40d6ffd640 1 --2- 172.21.15.172:0/2865160325 >> v2:172.21.15.186:3300/0 conn(0x7f40d815dc20 0x7f40d80ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.829+0000 7f40d67fc640 1 --2- 172.21.15.172:0/2865160325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d8161710 0x7f40d80cebb0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f40d80d1520 tx=0x7f40cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a243d9bda2400a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.829+0000 7f40d5ffb640 1 -- 172.21.15.172:0/2865160325 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc037070 con 0x7f40d8161710 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.829+0000 7f40d5ffb640 1 -- 172.21.15.172:0/2865160325 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc032440 con 0x7f40d8161710 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.829+0000 7f40d5ffb640 1 -- 172.21.15.172:0/2865160325 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc032810 con 0x7f40d8161710 2024-04-25T08:49:59.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.830+0000 7f40dd66f640 1 -- 172.21.15.172:0/2865160325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d8161710 msgr2=0x7f40d80cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.830+0000 7f40dd66f640 1 --2- 172.21.15.172:0/2865160325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d8161710 0x7f40d80cebb0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f40d80d1520 tx=0x7f40cc02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.830+0000 7f40dd66f640 1 -- 172.21.15.172:0/2865160325 shutdown_connections 2024-04-25T08:49:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.830+0000 7f40dd66f640 1 --2- 172.21.15.172:0/2865160325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40d80b9330 0x7f40d806bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.830+0000 7f40dd66f640 1 --2- 172.21.15.172:0/2865160325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d8161710 0x7f40d80cebb0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.830+0000 7f40dd66f640 1 --2- 172.21.15.172:0/2865160325 >> v2:172.21.15.186:3300/0 conn(0x7f40d815dc20 0x7f40d80ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.830+0000 7f40dd66f640 1 -- 172.21.15.172:0/2865160325 >> 172.21.15.172:0/2865160325 conn(0x7f40d80d0420 msgr2=0x7f40d80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:49:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.830+0000 7f40dd66f640 1 -- 172.21.15.172:0/2865160325 shutdown_connections 2024-04-25T08:49:59.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.830+0000 7f40dd66f640 1 -- 172.21.15.172:0/2865160325 wait complete. 2024-04-25T08:49:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.831+0000 7f40dd66f640 1 Processor -- start 2024-04-25T08:49:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.831+0000 7f40dd66f640 1 -- start start 2024-04-25T08:49:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40dd66f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d80b9330 0x7f40d81e9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40dd66f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40d815dc20 0x7f40d80c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40dd66f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40d8161710 0x7f40d81475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40dd66f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80b5e50 con 0x7f40d80b9330 2024-04-25T08:49:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40dd66f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d8162500 con 0x7f40d8161710 2024-04-25T08:49:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40dd66f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d80b5fd0 con 0x7f40d815dc20 2024-04-25T08:49:59.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d80b9330 0x7f40d81e9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d80b9330 0x7f40d81e9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47014/0 (socket says 172.21.15.172:47014) 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d6ffd640 1 -- 172.21.15.172:0/1051472046 learned_addr learned my addr 172.21.15.172:0/1051472046 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d77fe640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40d8161710 0x7f40d81475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d6ffd640 1 -- 172.21.15.172:0/1051472046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40d815dc20 msgr2=0x7f40d80c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d67fc640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40d815dc20 0x7f40d80c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d6ffd640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40d815dc20 0x7f40d80c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d6ffd640 1 -- 172.21.15.172:0/1051472046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40d8161710 msgr2=0x7f40d81475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d6ffd640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40d8161710 0x7f40d81475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d6ffd640 1 -- 172.21.15.172:0/1051472046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d80caec0 con 0x7f40d80b9330 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d77fe640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40d8161710 0x7f40d81475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40d6ffd640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d80b9330 0x7f40d81e9af0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f40c800d7d0 tx=0x7f40c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40bf7fe640 1 -- 172.21.15.172:0/1051472046 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8004030 con 0x7f40d80b9330 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40bf7fe640 1 -- 172.21.15.172:0/1051472046 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c80041d0 con 0x7f40d80b9330 2024-04-25T08:49:59.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40dd66f640 1 -- 172.21.15.172:0/1051472046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d80cb1a0 con 0x7f40d80b9330 2024-04-25T08:49:59.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.832+0000 7f40bf7fe640 1 -- 172.21.15.172:0/1051472046 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80096a0 con 0x7f40d80b9330 2024-04-25T08:49:59.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.833+0000 7f40dd66f640 1 -- 172.21.15.172:0/1051472046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d81e92f0 con 0x7f40d80b9330 2024-04-25T08:49:59.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.834+0000 7f40dd66f640 1 -- 172.21.15.172:0/1051472046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d8073a00 con 0x7f40d80b9330 2024-04-25T08:49:59.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.834+0000 7f40bf7fe640 1 -- 172.21.15.172:0/1051472046 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f40c8009840 con 0x7f40d80b9330 2024-04-25T08:49:59.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.834+0000 7f40bf7fe640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40c406b4d0 0x7f40c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:49:59.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.834+0000 7f40d67fc640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40c406b4d0 0x7f40c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:49:59.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.834+0000 7f40bf7fe640 1 -- 172.21.15.172:0/1051472046 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f40c808a330 con 0x7f40d80b9330 2024-04-25T08:49:59.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.835+0000 7f40d67fc640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40c406b4d0 0x7f40c406d990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f40cc034000 tx=0x7f40cc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:49:59.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:49:59.839+0000 7f40bf7fe640 1 -- 172.21.15.172:0/1051472046 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f40c8059370 con 0x7f40d80b9330 2024-04-25T08:50:00.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.011+0000 7f40dd66f640 1 -- 172.21.15.172:0/1051472046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40d80d16b0 con 0x7f40d80b9330 2024-04-25T08:50:00.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.012+0000 7f40bf7fe640 1 -- 172.21.15.172:0/1051472046 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40c8058c70 con 0x7f40d80b9330 2024-04-25T08:50:00.003 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:50:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 -- 172.21.15.172:0/1051472046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40c406b4d0 msgr2=0x7f40c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40c406b4d0 0x7f40c406d990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f40cc034000 tx=0x7f40cc02e000 comp rx=0 tx=0).stop 2024-04-25T08:50:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 -- 172.21.15.172:0/1051472046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d80b9330 msgr2=0x7f40d81e9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d80b9330 0x7f40d81e9af0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f40c800d7d0 tx=0x7f40c800dc90 comp rx=0 tx=0).stop 2024-04-25T08:50:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 -- 172.21.15.172:0/1051472046 shutdown_connections 2024-04-25T08:50:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40c406b4d0 0x7f40c406d990 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40d8161710 0x7f40d81475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40d815dc20 0x7f40d80c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 --2- 172.21.15.172:0/1051472046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40d80b9330 0x7f40d81e9af0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 -- 172.21.15.172:0/1051472046 >> 172.21.15.172:0/1051472046 conn(0x7f40d80d0420 msgr2=0x7f40d815ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 -- 172.21.15.172:0/1051472046 shutdown_connections 2024-04-25T08:50:00.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.014+0000 7f40dd66f640 1 -- 172.21.15.172:0/1051472046 wait complete. 2024-04-25T08:50:00.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:50:00.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.125+0000 7f71caf30640 1 Processor -- start 2024-04-25T08:50:00.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.125+0000 7f71caf30640 1 -- start start 2024-04-25T08:50:00.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71caf30640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f71c40721d0 0x7f71c406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71caf30640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c406de40 con 0x7f71c415c9e0 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71caf30640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40ad0e0 con 0x7f71c4155fe0 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71caf30640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c415ce70 con 0x7f71c40721d0 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71c94cd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f71c40721d0 0x7f71c406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71c94cd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f71c40721d0 0x7f71c406abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47018/0 (socket says 172.21.15.172:47018) 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71c94cd640 1 -- 172.21.15.172:0/2734422588 learned_addr learned my addr 172.21.15.172:0/2734422588 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71c3fff640 1 --1- 172.21.15.172:0/2734422588 >> v1:172.21.15.172:6789/0 conn(0x7f71c415c9e0 0x7f71c4071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50542/0 (socket says 172.21.15.172:50542) 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71c94cd640 1 -- 172.21.15.172:0/2734422588 >> v1:172.21.15.186:6789/0 conn(0x7f71c4155fe0 legacy=0x7f71c40adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71c94cd640 1 -- 172.21.15.172:0/2734422588 >> v1:172.21.15.172:6789/0 conn(0x7f71c415c9e0 legacy=0x7f71c4071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71c37fe640 1 -- 172.21.15.172:0/2734422588 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274574825 0 0) 0x7f71c406de40 con 0x7f71c415c9e0 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.126+0000 7f71c94cd640 1 -- 172.21.15.172:0/2734422588 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40ad3c0 con 0x7f71c40721d0 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.127+0000 7f71c94cd640 1 --2- 172.21.15.172:0/2734422588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c40721d0 0x7f71c406abe0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009e50 tx=0x7f71bc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc2a2a0877c2a3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:00.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.127+0000 7f71c37fe640 1 -- 172.21.15.172:0/2734422588 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc036070 con 0x7f71c40721d0 2024-04-25T08:50:00.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.127+0000 7f71c37fe640 1 -- 172.21.15.172:0/2734422588 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc031600 con 0x7f71c40721d0 2024-04-25T08:50:00.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.127+0000 7f71c37fe640 1 -- 172.21.15.172:0/2734422588 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0319d0 con 0x7f71c40721d0 2024-04-25T08:50:00.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.127+0000 7f71caf30640 1 -- 172.21.15.172:0/2734422588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c40721d0 msgr2=0x7f71c406abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.127+0000 7f71caf30640 1 --2- 172.21.15.172:0/2734422588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c40721d0 0x7f71c406abe0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f71bc009e50 tx=0x7f71bc02a730 comp rx=0 tx=0).stop 2024-04-25T08:50:00.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.128+0000 7f71caf30640 1 -- 172.21.15.172:0/2734422588 shutdown_connections 2024-04-25T08:50:00.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.128+0000 7f71caf30640 1 --2- 172.21.15.172:0/2734422588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c40721d0 0x7f71c406abe0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.128+0000 7f71caf30640 1 -- 172.21.15.172:0/2734422588 >> 172.21.15.172:0/2734422588 conn(0x7f71c40af670 msgr2=0x7f71c40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:00.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.128+0000 7f71caf30640 1 -- 172.21.15.172:0/2734422588 shutdown_connections 2024-04-25T08:50:00.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.128+0000 7f71caf30640 1 -- 172.21.15.172:0/2734422588 wait complete. 2024-04-25T08:50:00.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.129+0000 7f71caf30640 1 Processor -- start 2024-04-25T08:50:00.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.129+0000 7f71caf30640 1 -- start start 2024-04-25T08:50:00.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.129+0000 7f71caf30640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71c4155fe0 0x7f71c4140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71caf30640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c415c9e0 0x7f71c40b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71caf30640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c41414a0 0x7f71c40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71caf30640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c406f880 con 0x7f71c415c9e0 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71caf30640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c41563c0 con 0x7f71c4155fe0 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71caf30640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c406fa00 con 0x7f71c41414a0 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c415c9e0 0x7f71c40b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c415c9e0 0x7f71c40b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47034/0 (socket says 172.21.15.172:47034) 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c3fff640 1 -- 172.21.15.172:0/240316210 learned_addr learned my addr 172.21.15.172:0/240316210 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c8ccc640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71c4155fe0 0x7f71c4140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c94cd640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c41414a0 0x7f71c40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c3fff640 1 -- 172.21.15.172:0/240316210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c41414a0 msgr2=0x7f71c40b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c3fff640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c41414a0 0x7f71c40b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c3fff640 1 -- 172.21.15.172:0/240316210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71c4155fe0 msgr2=0x7f71c4140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c3fff640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71c4155fe0 0x7f71c4140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c3fff640 1 -- 172.21.15.172:0/240316210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c409a670 con 0x7f71c415c9e0 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c8ccc640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71c4155fe0 0x7f71c4140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c3fff640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c415c9e0 0x7f71c40b1600 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f71b000c420 tx=0x7f71b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c17fa640 1 -- 172.21.15.172:0/240316210 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00074e0 con 0x7f71c415c9e0 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c17fa640 1 -- 172.21.15.172:0/240316210 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00047e0 con 0x7f71c415c9e0 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71caf30640 1 -- 172.21.15.172:0/240316210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c409a950 con 0x7f71c415c9e0 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71c17fa640 1 -- 172.21.15.172:0/240316210 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0004c10 con 0x7f71c415c9e0 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.130+0000 7f71caf30640 1 -- 172.21.15.172:0/240316210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c4099a40 con 0x7f71c415c9e0 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.131+0000 7f71caf30640 1 -- 172.21.15.172:0/240316210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c4073990 con 0x7f71c415c9e0 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.132+0000 7f71c17fa640 1 -- 172.21.15.172:0/240316210 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71b0011070 con 0x7f71c415c9e0 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.132+0000 7f71c17fa640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71a806b4d0 0x7f71a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.132+0000 7f71c17fa640 1 -- 172.21.15.172:0/240316210 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f71b0089bd0 con 0x7f71c415c9e0 2024-04-25T08:50:00.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.132+0000 7f71c8ccc640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71a806b4d0 0x7f71a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.132+0000 7f71c8ccc640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71a806b4d0 0x7f71a806d990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f71b8007fd0 tx=0x7f71b8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:00.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.136+0000 7f71c17fa640 1 -- 172.21.15.172:0/240316210 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71b000e280 con 0x7f71c415c9e0 2024-04-25T08:50:00.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.310+0000 7f71caf30640 1 -- 172.21.15.172:0/240316210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f71c4141990 con 0x7f71c415c9e0 2024-04-25T08:50:00.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.311+0000 7f71c17fa640 1 -- 172.21.15.172:0/240316210 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v115) v1 ==== 84+0+65 (secure 0 0 0) 0x7f71b0058ca0 con 0x7f71c415c9e0 2024-04-25T08:50:00.302 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:00.302 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:50:00.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:00.302 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2024-04-25T08:50:00.302 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2024-04-25T08:50:00.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:00.302 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 -- 172.21.15.172:0/240316210 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71a806b4d0 msgr2=0x7f71a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71a806b4d0 0x7f71a806d990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f71b8007fd0 tx=0x7f71b8009040 comp rx=0 tx=0).stop 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 -- 172.21.15.172:0/240316210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c415c9e0 msgr2=0x7f71c40b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c415c9e0 0x7f71c40b1600 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f71b000c420 tx=0x7f71b000c8e0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 -- 172.21.15.172:0/240316210 shutdown_connections 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f71a806b4d0 0x7f71a806d990 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c41414a0 0x7f71c40b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c415c9e0 0x7f71c40b1600 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 --2- 172.21.15.172:0/240316210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71c4155fe0 0x7f71c4140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 -- 172.21.15.172:0/240316210 >> 172.21.15.172:0/240316210 conn(0x7f71c40721d0 msgr2=0x7f71c40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:00.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 -- 172.21.15.172:0/240316210 shutdown_connections 2024-04-25T08:50:00.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.313+0000 7f71caf30640 1 -- 172.21.15.172:0/240316210 wait complete. 2024-04-25T08:50:00.315 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:50:00.315 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:50:00.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.426+0000 7f37795e7640 1 Processor -- start 2024-04-25T08:50:00.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.426+0000 7f37795e7640 1 -- start start 2024-04-25T08:50:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f37795e7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f377415dc20 0x7f37740ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f37795e7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377406cda0 con 0x7f37740d32f0 2024-04-25T08:50:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f37795e7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377415e000 con 0x7f3774161710 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f37795e7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37740d1de0 con 0x7f377415dc20 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f37737fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f37740d32f0 0x7f377406c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50554/0 (socket says 172.21.15.172:50554) 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f37737fe640 1 -- 172.21.15.172:0/897327015 learned_addr learned my addr 172.21.15.172:0/897327015 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859460158 0 0) 0x7f377406cda0 con 0x7f37740d32f0 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f375c003520 con 0x7f37740d32f0 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f3772ffd640 1 --2- 172.21.15.172:0/897327015 >> v2:172.21.15.186:3300/0 conn(0x7f377415dc20 0x7f37740ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 521450172 0 0) 0x7f375c003520 con 0x7f37740d32f0 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 >> v2:172.21.15.186:3300/0 conn(0x7f377415dc20 msgr2=0x7f37740ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f3771ffb640 1 --2- 172.21.15.172:0/897327015 >> v2:172.21.15.186:3300/0 conn(0x7f377415dc20 0x7f37740ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 >> v1:172.21.15.186:6789/0 conn(0x7f3774161710 legacy=0x7f377406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.427+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3774161c60 con 0x7f37740d32f0 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f376c0019f0 con 0x7f37740d32f0 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 >> v1:172.21.15.172:6789/0 conn(0x7f37740d32f0 legacy=0x7f377406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f3771ffb640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f375c0039b0 0x7f375c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f3771ffb640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f375c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f3771ffb640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f375c0051c0 0x7f375c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740d1de0 con 0x7f375c004800 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c00c110 con 0x7f375c0039b0 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c00c310 con 0x7f375c0051c0 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f37727fc640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f375c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f3772ffd640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f375c0039b0 0x7f375c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f37737fe640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f375c0051c0 0x7f375c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f37727fc640 1 -- 172.21.15.172:0/897327015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f375c0051c0 msgr2=0x7f375c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f37727fc640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f375c0051c0 0x7f375c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f37727fc640 1 -- 172.21.15.172:0/897327015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f375c0039b0 msgr2=0x7f375c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f37727fc640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f375c0039b0 0x7f375c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f37727fc640 1 -- 172.21.15.172:0/897327015 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c003520 con 0x7f375c004800 2024-04-25T08:50:00.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.428+0000 7f37737fe640 1 -- 172.21.15.172:0/897327015 reap_dead start 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f37727fc640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f375c004c80 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f3768001750 tx=0x7f375c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37accf0385e35deb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768001370 con 0x7f375c004800 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37680052d0 con 0x7f375c004800 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f3771ffb640 1 -- 172.21.15.172:0/897327015 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376802abe0 con 0x7f375c004800 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f37795e7640 1 -- 172.21.15.172:0/897327015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 msgr2=0x7f375c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f37795e7640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f375c004c80 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f3768001750 tx=0x7f375c005830 comp rx=0 tx=0).stop 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f37795e7640 1 -- 172.21.15.172:0/897327015 shutdown_connections 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f37795e7640 1 --2- 172.21.15.172:0/897327015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f375c004c80 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f37795e7640 1 -- 172.21.15.172:0/897327015 >> 172.21.15.172:0/897327015 conn(0x7f37740d0420 msgr2=0x7f37740d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f37795e7640 1 -- 172.21.15.172:0/897327015 shutdown_connections 2024-04-25T08:50:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.429+0000 7f37795e7640 1 -- 172.21.15.172:0/897327015 wait complete. 2024-04-25T08:50:00.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.431+0000 7f37795e7640 1 Processor -- start 2024-04-25T08:50:00.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.431+0000 7f37795e7640 1 -- start start 2024-04-25T08:50:00.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.431+0000 7f37795e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f3774154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.431+0000 7f37795e7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37740c7290 0x7f377415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.431+0000 7f37795e7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f377415a590 0x7f377415e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.431+0000 7f37795e7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3774162500 con 0x7f375c004800 2024-04-25T08:50:00.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.431+0000 7f37795e7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3774162220 con 0x7f377415a590 2024-04-25T08:50:00.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.431+0000 7f37795e7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37740b5e50 con 0x7f37740c7290 2024-04-25T08:50:00.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f3774154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f3772ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f3774154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47060/0 (socket says 172.21.15.172:47060) 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f3772ffd640 1 -- 172.21.15.172:0/988944634 learned_addr learned my addr 172.21.15.172:0/988944634 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f37737fe640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f377415a590 0x7f377415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f37727fc640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37740c7290 0x7f377415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f3772ffd640 1 -- 172.21.15.172:0/988944634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37740c7290 msgr2=0x7f377415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f3772ffd640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37740c7290 0x7f377415a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f3772ffd640 1 -- 172.21.15.172:0/988944634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f377415a590 msgr2=0x7f377415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f3772ffd640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f377415a590 0x7f377415e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f3772ffd640 1 -- 172.21.15.172:0/988944634 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37741552b0 con 0x7f375c004800 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f3772ffd640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f3774154970 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f376400b720 tx=0x7f376400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f375b7fe640 1 -- 172.21.15.172:0/988944634 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764018070 con 0x7f375c004800 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f375b7fe640 1 -- 172.21.15.172:0/988944634 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764010830 con 0x7f375c004800 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f37795e7640 1 -- 172.21.15.172:0/988944634 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377415fd40 con 0x7f375c004800 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f375b7fe640 1 -- 172.21.15.172:0/988944634 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764010c20 con 0x7f375c004800 2024-04-25T08:50:00.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.432+0000 7f37795e7640 1 -- 172.21.15.172:0/988944634 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37740c8100 con 0x7f375c004800 2024-04-25T08:50:00.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.433+0000 7f37795e7640 1 -- 172.21.15.172:0/988944634 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3774073a00 con 0x7f375c004800 2024-04-25T08:50:00.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.434+0000 7f375b7fe640 1 -- 172.21.15.172:0/988944634 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f376401b070 con 0x7f375c004800 2024-04-25T08:50:00.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.434+0000 7f375b7fe640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f376006b4d0 0x7f376006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:00.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.434+0000 7f375b7fe640 1 -- 172.21.15.172:0/988944634 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f376408a2e0 con 0x7f375c004800 2024-04-25T08:50:00.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.434+0000 7f37727fc640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f376006b4d0 0x7f376006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:00.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.435+0000 7f37727fc640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f376006b4d0 0x7f376006d990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3768032000 tx=0x7f376802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:00.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.438+0000 7f375b7fe640 1 -- 172.21.15.172:0/988944634 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3764058cd0 con 0x7f375c004800 2024-04-25T08:50:00.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:00.610+0000 7f37795e7640 1 -- 172.21.15.172:0/988944634 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f377415a970 con 0x7f375c004800 2024-04-25T08:50:01.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.058+0000 7f375b7fe640 1 -- 172.21.15.172:0/988944634 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v116) v1 ==== 138+0+0 (secure 0 0 0) 0x7f376405cd70 con 0x7f375c004800 2024-04-25T08:50:01.049 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 -- 172.21.15.172:0/988944634 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f376006b4d0 msgr2=0x7f376006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f376006b4d0 0x7f376006d990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3768032000 tx=0x7f376802e000 comp rx=0 tx=0).stop 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 -- 172.21.15.172:0/988944634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 msgr2=0x7f3774154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f3774154970 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f376400b720 tx=0x7f376400bbe0 comp rx=0 tx=0).stop 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 -- 172.21.15.172:0/988944634 shutdown_connections 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f376006b4d0 0x7f376006d990 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f377415a590 0x7f377415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37740c7290 0x7f377415a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 --2- 172.21.15.172:0/988944634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f375c004800 0x7f3774154970 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 -- 172.21.15.172:0/988944634 >> 172.21.15.172:0/988944634 conn(0x7f37740d0420 msgr2=0x7f37740b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 -- 172.21.15.172:0/988944634 shutdown_connections 2024-04-25T08:50:01.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.061+0000 7f37795e7640 1 -- 172.21.15.172:0/988944634 wait complete. 2024-04-25T08:50:01.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:50:01.120 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:50:01.122 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:50:01.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.186+0000 7efffdf22640 1 Processor -- start 2024-04-25T08:50:01.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.187+0000 7efffdf22640 1 -- start start 2024-04-25T08:50:01.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.187+0000 7efffdf22640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7efff80cfd30 0x7efff815ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:01.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.187+0000 7efffdf22640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff80cc5e0 con 0x7efff809a090 2024-04-25T08:50:01.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.187+0000 7efffdf22640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff80b2ee0 con 0x7efff8099cb0 2024-04-25T08:50:01.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.187+0000 7efffdf22640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff80cc3b0 con 0x7efff80cfd30 2024-04-25T08:50:01.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.187+0000 7efff7fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efff809a090 0x7efff80ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50564/0 (socket says 172.21.15.172:50564) 2024-04-25T08:50:01.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.187+0000 7efff7fff640 1 -- 172.21.15.172:0/431528605 learned_addr learned my addr 172.21.15.172:0/431528605 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:01.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.188+0000 7effeffff640 1 --2- 172.21.15.172:0/431528605 >> v2:172.21.15.186:3300/0 conn(0x7efff80cfd30 0x7efff815ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:01.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.188+0000 7efff6ffd640 1 -- 172.21.15.172:0/431528605 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315896430 0 0) 0x7efff80cc5e0 con 0x7efff809a090 2024-04-25T08:50:01.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.188+0000 7efff6ffd640 1 -- 172.21.15.172:0/431528605 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe4003520 con 0x7efff809a090 2024-04-25T08:50:01.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.188+0000 7efff6ffd640 1 -- 172.21.15.172:0/431528605 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032947275 0 0) 0x7effe4003520 con 0x7efff809a090 2024-04-25T08:50:01.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.188+0000 7effeffff640 1 -- 172.21.15.172:0/431528605 >> v1:172.21.15.186:6789/0 conn(0x7efff8099cb0 legacy=0x7efff80b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:01.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.188+0000 7effeffff640 1 -- 172.21.15.172:0/431528605 >> v1:172.21.15.172:6789/0 conn(0x7efff809a090 legacy=0x7efff80ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:01.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.188+0000 7effeffff640 1 -- 172.21.15.172:0/431528605 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff80d0210 con 0x7efff80cfd30 2024-04-25T08:50:01.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.189+0000 7effeffff640 1 --2- 172.21.15.172:0/431528605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff80cfd30 0x7efff815ecc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7effe00097a0 tx=0x7effe002a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60be6354e3de9f67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:01.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.189+0000 7efff6ffd640 1 -- 172.21.15.172:0/431528605 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0037070 con 0x7efff80cfd30 2024-04-25T08:50:01.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.189+0000 7efff6ffd640 1 -- 172.21.15.172:0/431528605 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe002ab60 con 0x7efff80cfd30 2024-04-25T08:50:01.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.189+0000 7efff6ffd640 1 -- 172.21.15.172:0/431528605 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0001a10 con 0x7efff80cfd30 2024-04-25T08:50:01.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.190+0000 7efffdf22640 1 -- 172.21.15.172:0/431528605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff80cfd30 msgr2=0x7efff815ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:01.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.190+0000 7efffdf22640 1 --2- 172.21.15.172:0/431528605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff80cfd30 0x7efff815ecc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7effe00097a0 tx=0x7effe002a0d0 comp rx=0 tx=0).stop 2024-04-25T08:50:01.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.190+0000 7efffdf22640 1 -- 172.21.15.172:0/431528605 shutdown_connections 2024-04-25T08:50:01.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.190+0000 7efffdf22640 1 --2- 172.21.15.172:0/431528605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff80cfd30 0x7efff815ecc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:01.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.190+0000 7efffdf22640 1 -- 172.21.15.172:0/431528605 >> 172.21.15.172:0/431528605 conn(0x7efff80b3290 msgr2=0x7efff80b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:01.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.190+0000 7efffdf22640 1 -- 172.21.15.172:0/431528605 shutdown_connections 2024-04-25T08:50:01.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.190+0000 7efffdf22640 1 -- 172.21.15.172:0/431528605 wait complete. 2024-04-25T08:50:01.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.191+0000 7efffdf22640 1 Processor -- start 2024-04-25T08:50:01.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.191+0000 7efffdf22640 1 -- start start 2024-04-25T08:50:01.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.191+0000 7efffdf22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff8099cb0 0x7efff81f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:01.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.191+0000 7efffdf22640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff809a090 0x7efff80b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.191+0000 7efffdf22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff80cfd30 0x7efff815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efffdf22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff80d07d0 con 0x7efff8099cb0 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efffdf22640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff80cc880 con 0x7efff809a090 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efffdf22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff80c52f0 con 0x7efff80cfd30 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff8099cb0 0x7efff81f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff8099cb0 0x7efff81f79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47074/0 (socket says 172.21.15.172:47074) 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff77fe640 1 -- 172.21.15.172:0/466884340 learned_addr learned my addr 172.21.15.172:0/466884340 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7effeffff640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff809a090 0x7efff80b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff7fff640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff80cfd30 0x7efff815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff77fe640 1 -- 172.21.15.172:0/466884340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff80cfd30 msgr2=0x7efff815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff77fe640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff80cfd30 0x7efff815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff77fe640 1 -- 172.21.15.172:0/466884340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff809a090 msgr2=0x7efff80b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff77fe640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff809a090 0x7efff80b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:01.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff77fe640 1 -- 172.21.15.172:0/466884340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff80c8aa0 con 0x7efff8099cb0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff77fe640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff8099cb0 0x7efff81f79d0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7effe800c550 tx=0x7effe800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff4ff9640 1 -- 172.21.15.172:0/466884340 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8017070 con 0x7efff8099cb0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff4ff9640 1 -- 172.21.15.172:0/466884340 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe80035f0 con 0x7efff8099cb0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efffdf22640 1 -- 172.21.15.172:0/466884340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff8158ed0 con 0x7efff8099cb0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efff4ff9640 1 -- 172.21.15.172:0/466884340 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe80039e0 con 0x7efff8099cb0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.192+0000 7efffdf22640 1 -- 172.21.15.172:0/466884340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff8159490 con 0x7efff8099cb0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.193+0000 7efffdf22640 1 -- 172.21.15.172:0/466884340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff8073a00 con 0x7efff8099cb0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.194+0000 7efff4ff9640 1 -- 172.21.15.172:0/466884340 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effe801a070 con 0x7efff8099cb0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.194+0000 7efff4ff9640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd806b4d0 0x7effd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.194+0000 7efff4ff9640 1 -- 172.21.15.172:0/466884340 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5619+0+0 (secure 0 0 0) 0x7effe8089510 con 0x7efff8099cb0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.194+0000 7effeffff640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd806b4d0 0x7effd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:01.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.195+0000 7effeffff640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd806b4d0 0x7effd806d990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7effe0034000 tx=0x7effe002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:01.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.199+0000 7efff4ff9640 1 -- 172.21.15.172:0/466884340 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7effe8057e20 con 0x7efff8099cb0 2024-04-25T08:50:01.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:01.372+0000 7efffdf22640 1 -- 172.21.15.172:0/466884340 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efff80b4180 con 0x7efff8099cb0 2024-04-25T08:50:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.060+0000 7efff4ff9640 1 -- 172.21.15.172:0/466884340 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v117) v1 ==== 170+0+0 (secure 0 0 0) 0x7effe805e170 con 0x7efff8099cb0 2024-04-25T08:50:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2024-04-25T08:50:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 -- 172.21.15.172:0/466884340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd806b4d0 msgr2=0x7effd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd806b4d0 0x7effd806d990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7effe0034000 tx=0x7effe002e000 comp rx=0 tx=0).stop 2024-04-25T08:50:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 -- 172.21.15.172:0/466884340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff8099cb0 msgr2=0x7efff81f79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff8099cb0 0x7efff81f79d0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7effe800c550 tx=0x7effe800ca10 comp rx=0 tx=0).stop 2024-04-25T08:50:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 -- 172.21.15.172:0/466884340 shutdown_connections 2024-04-25T08:50:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7effd806b4d0 0x7effd806d990 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efff809a090 0x7efff80b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efff80cfd30 0x7efff815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 --2- 172.21.15.172:0/466884340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff8099cb0 0x7efff81f79d0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 -- 172.21.15.172:0/466884340 >> 172.21.15.172:0/466884340 conn(0x7efff80b3290 msgr2=0x7efff815dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 -- 172.21.15.172:0/466884340 shutdown_connections 2024-04-25T08:50:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.063+0000 7efffdf22640 1 -- 172.21.15.172:0/466884340 wait complete. 2024-04-25T08:50:02.077 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:50:02.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.230+0000 7fe9351d5640 1 Processor -- start 2024-04-25T08:50:02.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.230+0000 7fe9351d5640 1 -- start start 2024-04-25T08:50:02.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.230+0000 7fe9351d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9301446d0 0x7fe9300b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:02.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.230+0000 7fe9351d5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300cccc0 con 0x7fe930144d50 2024-04-25T08:50:02.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.230+0000 7fe9351d5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9300d0460 con 0x7fe93006e8a0 2024-04-25T08:50:02.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.230+0000 7fe9351d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300b2b20 con 0x7fe9301446d0 2024-04-25T08:50:02.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.230+0000 7fe92e59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe930144d50 0x7fe9300cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50574/0 (socket says 172.21.15.172:50574) 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.230+0000 7fe92e59c640 1 -- 172.21.15.172:0/4193321885 learned_addr learned my addr 172.21.15.172:0/4193321885 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92ed9d640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9301446d0 0x7fe9300b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79315853 0 0) 0x7fe9300cccc0 con 0x7fe930144d50 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe918003520 con 0x7fe930144d50 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382980719 0 0) 0x7fe9300d0460 con 0x7fe93006e8a0 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9300cccc0 con 0x7fe93006e8a0 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3028160916 0 0) 0x7fe918003520 con 0x7fe930144d50 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9301446d0 msgr2=0x7fe9300b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9301446d0 0x7fe9300b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 >> v1:172.21.15.186:6789/0 conn(0x7fe93006e8a0 legacy=0x7fe9300cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300cc140 con 0x7fe930144d50 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fe924001670 con 0x7fe930144d50 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 >> v1:172.21.15.172:6789/0 conn(0x7fe930144d50 legacy=0x7fe9300cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:02.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe918003b70 0x7fe918003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9301446d0 0x7fe918004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe918004d40 0x7fe9180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300b2b20 con 0x7fe918003b70 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91800ba70 con 0x7fe918004d40 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91800bc20 con 0x7fe9301446d0 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92ed9d640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe918003b70 0x7fe918003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92e59c640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9301446d0 0x7fe918004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92f59e640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe918004d40 0x7fe9180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92ed9d640 1 -- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9301446d0 msgr2=0x7fe918004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92ed9d640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9301446d0 0x7fe918004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92ed9d640 1 -- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe918004d40 msgr2=0x7fe9180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.231+0000 7fe92ed9d640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe918004d40 0x7fe9180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.232+0000 7fe92ed9d640 1 -- 172.21.15.172:0/4193321885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918003520 con 0x7fe918003b70 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.232+0000 7fe92ed9d640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe918003b70 0x7fe918003f70 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fe928009ac0 tx=0x7fe918005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde4fb6410d7e887 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.232+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928036070 con 0x7fe918003b70 2024-04-25T08:50:02.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.232+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe928031400 con 0x7fe918003b70 2024-04-25T08:50:02.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.232+0000 7fe92dd9b640 1 -- 172.21.15.172:0/4193321885 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928009690 con 0x7fe918003b70 2024-04-25T08:50:02.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.233+0000 7fe9351d5640 1 -- 172.21.15.172:0/4193321885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe918003b70 msgr2=0x7fe918003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:02.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.233+0000 7fe9351d5640 1 --2- 172.21.15.172:0/4193321885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe918003b70 0x7fe918003f70 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fe928009ac0 tx=0x7fe918005830 comp rx=0 tx=0).stop 2024-04-25T08:50:02.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.233+0000 7fe92f59e640 1 -- 172.21.15.172:0/4193321885 reap_dead start 2024-04-25T08:50:02.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.233+0000 7fe9351d5640 1 -- 172.21.15.172:0/4193321885 shutdown_connections 2024-04-25T08:50:02.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.233+0000 7fe9351d5640 1 -- 172.21.15.172:0/4193321885 >> 172.21.15.172:0/4193321885 conn(0x7fe93006abe0 msgr2=0x7fe93006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:02.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.233+0000 7fe9351d5640 1 -- 172.21.15.172:0/4193321885 shutdown_connections 2024-04-25T08:50:02.227 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.233+0000 7fe9351d5640 1 -- 172.21.15.172:0/4193321885 wait complete. 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.235+0000 7fe9351d5640 1 Processor -- start 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.235+0000 7fe9351d5640 1 -- start start 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.235+0000 7fe9351d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe918003b70 0x7fe93015af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.235+0000 7fe9351d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300aac00 0x7fe9301f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.235+0000 7fe9351d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9300ab060 0x7fe9301f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.235+0000 7fe9351d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300cc700 con 0x7fe9300aac00 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.235+0000 7fe9351d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93006d400 con 0x7fe9300ab060 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.235+0000 7fe9351d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300cc9e0 con 0x7fe918003b70 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300aac00 0x7fe9301f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300aac00 0x7fe9301f4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47086/0 (socket says 172.21.15.172:47086) 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92e59c640 1 -- 172.21.15.172:0/1537798236 learned_addr learned my addr 172.21.15.172:0/1537798236 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:02.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92ed9d640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe918003b70 0x7fe93015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92f59e640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9300ab060 0x7fe9301f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92e59c640 1 -- 172.21.15.172:0/1537798236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe918003b70 msgr2=0x7fe93015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92e59c640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe918003b70 0x7fe93015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92e59c640 1 -- 172.21.15.172:0/1537798236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9300ab060 msgr2=0x7fe9301f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92e59c640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9300ab060 0x7fe9301f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92e59c640 1 -- 172.21.15.172:0/1537798236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300a8880 con 0x7fe9300aac00 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe92e59c640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300aac00 0x7fe9301f4f70 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fe92400e7f0 tx=0x7fe92400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe9177fe640 1 -- 172.21.15.172:0/1537798236 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400c870 con 0x7fe9300aac00 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe9177fe640 1 -- 172.21.15.172:0/1537798236 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe924018070 con 0x7fe9300aac00 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe9351d5640 1 -- 172.21.15.172:0/1537798236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9300a8b60 con 0x7fe9300aac00 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe9177fe640 1 -- 172.21.15.172:0/1537798236 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92400cc50 con 0x7fe9300aac00 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.236+0000 7fe9351d5640 1 -- 172.21.15.172:0/1537798236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9300a9120 con 0x7fe9300aac00 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.237+0000 7fe9351d5640 1 -- 172.21.15.172:0/1537798236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe930073a00 con 0x7fe9300aac00 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.238+0000 7fe9177fe640 1 -- 172.21.15.172:0/1537798236 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe92401d460 con 0x7fe9300aac00 2024-04-25T08:50:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.238+0000 7fe9177fe640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe91c06b4d0 0x7fe91c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:02.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.239+0000 7fe92ed9d640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe91c06b4d0 0x7fe91c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:02.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.239+0000 7fe9177fe640 1 -- 172.21.15.172:0/1537798236 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fe92408a050 con 0x7fe9300aac00 2024-04-25T08:50:02.232 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.239+0000 7fe92ed9d640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe91c06b4d0 0x7fe91c06d990 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe928033000 tx=0x7fe928008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:02.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.243+0000 7fe9177fe640 1 -- 172.21.15.172:0/1537798236 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe924058760 con 0x7fe9300aac00 2024-04-25T08:50:02.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:02.457+0000 7fe9351d5640 1 -- 172.21.15.172:0/1537798236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe9301431d0 con 0x7fe9300aac00 2024-04-25T08:50:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.074+0000 7fe9177fe640 1 -- 172.21.15.172:0/1537798236 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe92405c800 con 0x7fe9300aac00 2024-04-25T08:50:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 17 and data pool 18 2024-04-25T08:50:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.079+0000 7fe9351d5640 1 -- 172.21.15.172:0/1537798236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe91c06b4d0 msgr2=0x7fe91c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.079+0000 7fe9351d5640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe91c06b4d0 0x7fe91c06d990 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe928033000 tx=0x7fe928008030 comp rx=0 tx=0).stop 2024-04-25T08:50:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.079+0000 7fe9351d5640 1 -- 172.21.15.172:0/1537798236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300aac00 msgr2=0x7fe9301f4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.079+0000 7fe9351d5640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300aac00 0x7fe9301f4f70 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fe92400e7f0 tx=0x7fe92400ecb0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.080+0000 7fe9351d5640 1 -- 172.21.15.172:0/1537798236 shutdown_connections 2024-04-25T08:50:03.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.080+0000 7fe9351d5640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe91c06b4d0 0x7fe91c06d990 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.080+0000 7fe9351d5640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9300ab060 0x7fe9301f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.080+0000 7fe9351d5640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300aac00 0x7fe9301f4f70 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.080+0000 7fe9351d5640 1 --2- 172.21.15.172:0/1537798236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe918003b70 0x7fe93015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.081+0000 7fe9351d5640 1 -- 172.21.15.172:0/1537798236 >> 172.21.15.172:0/1537798236 conn(0x7fe93006abe0 msgr2=0x7fe93006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:03.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.082+0000 7fe9351d5640 1 -- 172.21.15.172:0/1537798236 shutdown_connections 2024-04-25T08:50:03.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.084+0000 7fe9351d5640 1 -- 172.21.15.172:0/1537798236 wait complete. 2024-04-25T08:50:03.100 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:03.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.208+0000 7f7665641640 1 Processor -- start 2024-04-25T08:50:03.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.208+0000 7f7665641640 1 -- start start 2024-04-25T08:50:03.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.208+0000 7f7665641640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f76600b2cb0 0x7f76600d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.208+0000 7f7665641640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 0x7f76600d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.208+0000 7f7665641640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76600b97a0 con 0x7f766015dbe0 2024-04-25T08:50:03.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.208+0000 7f7665641640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766015dfc0 con 0x7f76600b2cb0 2024-04-25T08:50:03.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.208+0000 7f7665641640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600d1a00 con 0x7f76600d1020 2024-04-25T08:50:03.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.208+0000 7f765e7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f76600b2cb0 0x7f76600d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.209+0000 7f765e7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f76600b2cb0 0x7f76600d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47096/0 (socket says 172.21.15.172:47096) 2024-04-25T08:50:03.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.209+0000 7f765e7fc640 1 -- 172.21.15.172:0/2920413601 learned_addr learned my addr 172.21.15.172:0/2920413601 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:03.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.209+0000 7f765e7fc640 1 -- 172.21.15.172:0/2920413601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 msgr2=0x7f76600d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:03.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.209+0000 7f765f7fe640 1 --2- 172.21.15.172:0/2920413601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 0x7f76600d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.209+0000 7f765e7fc640 1 --2- 172.21.15.172:0/2920413601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 0x7f76600d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.209+0000 7f765e7fc640 1 -- 172.21.15.172:0/2920413601 >> v1:172.21.15.186:6789/0 conn(0x7f766015dbe0 legacy=0x7f76600d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.209+0000 7f765e7fc640 1 -- 172.21.15.172:0/2920413601 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600d1c50 con 0x7f76600b2cb0 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.209+0000 7f765f7fe640 1 --2- 172.21.15.172:0/2920413601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 0x7f76600d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.209+0000 7f765e7fc640 1 --2- 172.21.15.172:0/2920413601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76600b2cb0 0x7f76600d2730 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f7654009870 tx=0x7f765402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7e04d38ee96354 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f765dffb640 1 -- 172.21.15.172:0/2920413601 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7654037070 con 0x7f76600b2cb0 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f765dffb640 1 -- 172.21.15.172:0/2920413601 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7654032440 con 0x7f76600b2cb0 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f765dffb640 1 -- 172.21.15.172:0/2920413601 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7654032810 con 0x7f76600b2cb0 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f7665641640 1 -- 172.21.15.172:0/2920413601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76600b2cb0 msgr2=0x7f76600d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f7665641640 1 --2- 172.21.15.172:0/2920413601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76600b2cb0 0x7f76600d2730 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f7654009870 tx=0x7f765402a270 comp rx=0 tx=0).stop 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f7665641640 1 -- 172.21.15.172:0/2920413601 shutdown_connections 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f7665641640 1 --2- 172.21.15.172:0/2920413601 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 0x7f76600d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f7665641640 1 --2- 172.21.15.172:0/2920413601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76600b2cb0 0x7f76600d2730 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f7665641640 1 -- 172.21.15.172:0/2920413601 >> 172.21.15.172:0/2920413601 conn(0x7f7660061a20 msgr2=0x7f7660061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:03.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f7665641640 1 -- 172.21.15.172:0/2920413601 shutdown_connections 2024-04-25T08:50:03.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.210+0000 7f7665641640 1 -- 172.21.15.172:0/2920413601 wait complete. 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f7665641640 1 Processor -- start 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f7665641640 1 -- start start 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f7665641640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76600b2cb0 0x7f7660153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f7665641640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 0x7f7660160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f7665641640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f766015dbe0 0x7f76600cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f7665641640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600b92a0 con 0x7f766015dbe0 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f7665641640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600d2210 con 0x7f76600b2cb0 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f7665641640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600b9420 con 0x7f76600d1020 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f765f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f766015dbe0 0x7f76600cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f765f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f766015dbe0 0x7f76600cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47106/0 (socket says 172.21.15.172:47106) 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f765f7fe640 1 -- 172.21.15.172:0/3944233951 learned_addr learned my addr 172.21.15.172:0/3944233951 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f765effd640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76600b2cb0 0x7f7660153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.212+0000 7f765e7fc640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 0x7f7660160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f765f7fe640 1 -- 172.21.15.172:0/3944233951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 msgr2=0x7f7660160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f765f7fe640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 0x7f7660160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f765f7fe640 1 -- 172.21.15.172:0/3944233951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76600b2cb0 msgr2=0x7f7660153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f765f7fe640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76600b2cb0 0x7f7660153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f765f7fe640 1 -- 172.21.15.172:0/3944233951 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600cd560 con 0x7f766015dbe0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f765f7fe640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f766015dbe0 0x7f76600cb460 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f765800c7f0 tx=0x7f765800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f76477fe640 1 -- 172.21.15.172:0/3944233951 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658015070 con 0x7f766015dbe0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f76477fe640 1 -- 172.21.15.172:0/3944233951 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7658007820 con 0x7f766015dbe0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f7665641640 1 -- 172.21.15.172:0/3944233951 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76600cd840 con 0x7f766015dbe0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f76477fe640 1 -- 172.21.15.172:0/3944233951 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658007c50 con 0x7f766015dbe0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.213+0000 7f7665641640 1 -- 172.21.15.172:0/3944233951 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76600cad30 con 0x7f766015dbe0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.214+0000 7f7665641640 1 -- 172.21.15.172:0/3944233951 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7660073990 con 0x7f766015dbe0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.215+0000 7f76477fe640 1 -- 172.21.15.172:0/3944233951 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7658018070 con 0x7f766015dbe0 2024-04-25T08:50:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.215+0000 7f76477fe640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f764c06b500 0x7f764c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.215+0000 7f76477fe640 1 -- 172.21.15.172:0/3944233951 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f765808a400 con 0x7f766015dbe0 2024-04-25T08:50:03.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.215+0000 7f765effd640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f764c06b500 0x7f764c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.215+0000 7f765effd640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f764c06b500 0x7f764c06d9c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7650001e70 tx=0x7f7650009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.219+0000 7f76477fe640 1 -- 172.21.15.172:0/3944233951 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7658058aa0 con 0x7f766015dbe0 2024-04-25T08:50:03.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.395+0000 7f7665641640 1 -- 172.21.15.172:0/3944233951 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f766006cf00 con 0x7f766015dbe0 2024-04-25T08:50:03.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.396+0000 7f76477fe640 1 -- 172.21.15.172:0/3944233951 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+17025 (secure 0 0 0) 0x7f765805cb40 con 0x7f766015dbe0 2024-04-25T08:50:03.386 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:03.387 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":118,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:02.459143+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:00.630478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:01.391083+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:03.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 -- 172.21.15.172:0/3944233951 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f764c06b500 msgr2=0x7f764c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f764c06b500 0x7f764c06d9c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7650001e70 tx=0x7f7650009040 comp rx=0 tx=0).stop 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 -- 172.21.15.172:0/3944233951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f766015dbe0 msgr2=0x7f76600cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f766015dbe0 0x7f76600cb460 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f765800c7f0 tx=0x7f765800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 -- 172.21.15.172:0/3944233951 shutdown_connections 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f764c06b500 0x7f764c06d9c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f766015dbe0 0x7f76600cb460 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76600d1020 0x7f7660160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 --2- 172.21.15.172:0/3944233951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76600b2cb0 0x7f7660153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 -- 172.21.15.172:0/3944233951 >> 172.21.15.172:0/3944233951 conn(0x7f7660061a20 msgr2=0x7f76600d2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 -- 172.21.15.172:0/3944233951 shutdown_connections 2024-04-25T08:50:03.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.398+0000 7f7665641640 1 -- 172.21.15.172:0/3944233951 wait complete. 2024-04-25T08:50:03.400 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:03.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.507+0000 7f51aa26f640 1 Processor -- start 2024-04-25T08:50:03.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.507+0000 7f51aa26f640 1 -- start start 2024-04-25T08:50:03.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51aa26f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a4154ed0 0x7f51a40aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51aa26f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f51a4071ac0 0x7f51a40ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51aa26f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51a406c1d0 0x7f51a40ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51aa26f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a415ec60 con 0x7f51a406c1d0 2024-04-25T08:50:03.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51aa26f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a415ef40 con 0x7f51a4071ac0 2024-04-25T08:50:03.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51aa26f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a406db90 con 0x7f51a4154ed0 2024-04-25T08:50:03.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51a880c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51a406c1d0 0x7f51a40ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51a880c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51a406c1d0 0x7f51a40ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47118/0 (socket says 172.21.15.172:47118) 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51a880c640 1 -- 172.21.15.172:0/3652578176 learned_addr learned my addr 172.21.15.172:0/3652578176 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51a37fe640 1 --2- 172.21.15.172:0/3652578176 >> v2:172.21.15.186:3300/0 conn(0x7f51a4071ac0 0x7f51a40ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.508+0000 7f51a3fff640 1 --2- 172.21.15.172:0/3652578176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a4154ed0 0x7f51a40aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.509+0000 7f51a880c640 1 -- 172.21.15.172:0/3652578176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a4154ed0 msgr2=0x7f51a40aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.509+0000 7f51a880c640 1 --2- 172.21.15.172:0/3652578176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a4154ed0 0x7f51a40aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.509+0000 7f51a880c640 1 -- 172.21.15.172:0/3652578176 >> v2:172.21.15.186:3300/0 conn(0x7f51a4071ac0 msgr2=0x7f51a40ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.509+0000 7f51a880c640 1 --2- 172.21.15.172:0/3652578176 >> v2:172.21.15.186:3300/0 conn(0x7f51a4071ac0 0x7f51a40ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.509+0000 7f51a880c640 1 -- 172.21.15.172:0/3652578176 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a406de70 con 0x7f51a406c1d0 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.509+0000 7f51a37fe640 1 --2- 172.21.15.172:0/3652578176 >> v2:172.21.15.186:3300/0 conn(0x7f51a4071ac0 0x7f51a40ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.509+0000 7f51a880c640 1 --2- 172.21.15.172:0/3652578176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a406c1d0 0x7f51a40ad950 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f51a409e220 tx=0x7f519c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d460517cad8dadd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.509+0000 7f51a2ffd640 1 -- 172.21.15.172:0/3652578176 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c036070 con 0x7f51a406c1d0 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.509+0000 7f51a2ffd640 1 -- 172.21.15.172:0/3652578176 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c031600 con 0x7f51a406c1d0 2024-04-25T08:50:03.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.509+0000 7f51a2ffd640 1 -- 172.21.15.172:0/3652578176 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c0319d0 con 0x7f51a406c1d0 2024-04-25T08:50:03.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.510+0000 7f51aa26f640 1 -- 172.21.15.172:0/3652578176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a406c1d0 msgr2=0x7f51a40ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.510+0000 7f51aa26f640 1 --2- 172.21.15.172:0/3652578176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a406c1d0 0x7f51a40ad950 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f51a409e220 tx=0x7f519c02a6a0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.510+0000 7f51aa26f640 1 -- 172.21.15.172:0/3652578176 shutdown_connections 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.510+0000 7f51aa26f640 1 --2- 172.21.15.172:0/3652578176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a406c1d0 0x7f51a40ad950 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.510+0000 7f51aa26f640 1 --2- 172.21.15.172:0/3652578176 >> v2:172.21.15.186:3300/0 conn(0x7f51a4071ac0 0x7f51a40ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.510+0000 7f51aa26f640 1 --2- 172.21.15.172:0/3652578176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a4154ed0 0x7f51a40aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.510+0000 7f51aa26f640 1 -- 172.21.15.172:0/3652578176 >> 172.21.15.172:0/3652578176 conn(0x7f51a40af670 msgr2=0x7f51a40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.510+0000 7f51aa26f640 1 -- 172.21.15.172:0/3652578176 shutdown_connections 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.510+0000 7f51aa26f640 1 -- 172.21.15.172:0/3652578176 wait complete. 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.511+0000 7f51aa26f640 1 Processor -- start 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.511+0000 7f51aa26f640 1 -- start start 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51aa26f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a4071ac0 0x7f51a40b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51aa26f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4154ed0 0x7f51a41e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51aa26f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a413f7c0 0x7f51a414e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51aa26f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4161ba0 con 0x7f51a4071ac0 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51aa26f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4161a20 con 0x7f51a4154ed0 2024-04-25T08:50:03.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51aa26f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a4161d20 con 0x7f51a413f7c0 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a4071ac0 0x7f51a40b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a4071ac0 0x7f51a40b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47122/0 (socket says 172.21.15.172:47122) 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a3fff640 1 -- 172.21.15.172:0/445319908 learned_addr learned my addr 172.21.15.172:0/445319908 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a37fe640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4154ed0 0x7f51a41e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a880c640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a413f7c0 0x7f51a414e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a3fff640 1 -- 172.21.15.172:0/445319908 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a413f7c0 msgr2=0x7f51a414e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a3fff640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a413f7c0 0x7f51a414e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a3fff640 1 -- 172.21.15.172:0/445319908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4154ed0 msgr2=0x7f51a41e75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a3fff640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4154ed0 0x7f51a41e75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a3fff640 1 -- 172.21.15.172:0/445319908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a41e7d00 con 0x7f51a4071ac0 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a37fe640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4154ed0 0x7f51a41e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.512+0000 7f51a3fff640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a4071ac0 0x7f51a40b4750 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f519400d5f0 tx=0x7f519400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.513+0000 7f51a0ff9640 1 -- 172.21.15.172:0/445319908 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51940125f0 con 0x7f51a4071ac0 2024-04-25T08:50:03.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.513+0000 7f51a0ff9640 1 -- 172.21.15.172:0/445319908 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5194019070 con 0x7f51a4071ac0 2024-04-25T08:50:03.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.513+0000 7f51a0ff9640 1 -- 172.21.15.172:0/445319908 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51940129d0 con 0x7f51a4071ac0 2024-04-25T08:50:03.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.513+0000 7f51aa26f640 1 -- 172.21.15.172:0/445319908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a41e7fe0 con 0x7f51a4071ac0 2024-04-25T08:50:03.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.513+0000 7f51aa26f640 1 -- 172.21.15.172:0/445319908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a41e85a0 con 0x7f51a4071ac0 2024-04-25T08:50:03.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.514+0000 7f51aa26f640 1 -- 172.21.15.172:0/445319908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a4073990 con 0x7f51a4071ac0 2024-04-25T08:50:03.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.514+0000 7f51a0ff9640 1 -- 172.21.15.172:0/445319908 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5194012b70 con 0x7f51a4071ac0 2024-04-25T08:50:03.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.514+0000 7f51a0ff9640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f519006b4d0 0x7f519006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.514+0000 7f51a0ff9640 1 -- 172.21.15.172:0/445319908 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f519408a780 con 0x7f51a4071ac0 2024-04-25T08:50:03.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.515+0000 7f51a37fe640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f519006b4d0 0x7f519006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.515+0000 7f51a37fe640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f519006b4d0 0x7f519006d990 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f51a41f71a0 tx=0x7f5198008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:03.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.519+0000 7f51a0ff9640 1 -- 172.21.15.172:0/445319908 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5194059470 con 0x7f51a4071ac0 2024-04-25T08:50:03.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.692+0000 7f51aa26f640 1 -- 172.21.15.172:0/445319908 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51a4150180 con 0x7f51a4071ac0 2024-04-25T08:50:03.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.694+0000 7f51a0ff9640 1 -- 172.21.15.172:0/445319908 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+17025 (secure 0 0 0) 0x7f5194058d70 con 0x7f51a4071ac0 2024-04-25T08:50:03.684 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:03.685 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":118,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:02.459143+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:00.630478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:01.391083+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 -- 172.21.15.172:0/445319908 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f519006b4d0 msgr2=0x7f519006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f519006b4d0 0x7f519006d990 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f51a41f71a0 tx=0x7f5198008040 comp rx=0 tx=0).stop 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 -- 172.21.15.172:0/445319908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a4071ac0 msgr2=0x7f51a40b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a4071ac0 0x7f51a40b4750 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f519400d5f0 tx=0x7f519400dab0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 -- 172.21.15.172:0/445319908 shutdown_connections 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f519006b4d0 0x7f519006d990 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4154ed0 0x7f51a41e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a413f7c0 0x7f51a414e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 --2- 172.21.15.172:0/445319908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51a4071ac0 0x7f51a40b4750 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 -- 172.21.15.172:0/445319908 >> 172.21.15.172:0/445319908 conn(0x7f51a406c1d0 msgr2=0x7f51a4160070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 -- 172.21.15.172:0/445319908 shutdown_connections 2024-04-25T08:50:03.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.696+0000 7f51aa26f640 1 -- 172.21.15.172:0/445319908 wait complete. 2024-04-25T08:50:03.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:50:03.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.807+0000 7f6f1e170640 1 Processor -- start 2024-04-25T08:50:03.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.807+0000 7f6f1e170640 1 -- start start 2024-04-25T08:50:03.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.808+0000 7f6f1e170640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180b4f10 0x7f6f180b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.808+0000 7f6f1e170640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6f180af5e0 0x7f6f1806c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.808+0000 7f6f1e170640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f180b52f0 con 0x7f6f1815f630 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.808+0000 7f6f1e170640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1806bc40 con 0x7f6f180af5e0 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.808+0000 7f6f1e170640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180adaa0 con 0x7f6f180b4f10 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.808+0000 7f6f177fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180b4f10 0x7f6f180b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.809+0000 7f6f16ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6f180af5e0 0x7f6f1806c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.809+0000 7f6f16ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6f180af5e0 0x7f6f1806c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:41828/0 (socket says 172.21.15.172:41828) 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.809+0000 7f6f17fff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f6f1815f630 0x7f6f180b3910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41598/0 (socket says 172.21.15.172:41598) 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.809+0000 7f6f177fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180b4f10 0x7f6f180b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:52756/0 (socket says 172.21.15.172:52756) 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.809+0000 7f6f16ffd640 1 -- 172.21.15.172:0/2632131083 learned_addr learned my addr 172.21.15.172:0/2632131083 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.809+0000 7f6f16ffd640 1 -- 172.21.15.172:0/2632131083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180b4f10 msgr2=0x7f6f180b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.809+0000 7f6f16ffd640 1 --2- 172.21.15.172:0/2632131083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180b4f10 0x7f6f180b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.809+0000 7f6f16ffd640 1 -- 172.21.15.172:0/2632131083 >> v1:172.21.15.186:6789/0 conn(0x7f6f1815f630 legacy=0x7f6f180b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.809+0000 7f6f16ffd640 1 -- 172.21.15.172:0/2632131083 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180add80 con 0x7f6f180af5e0 2024-04-25T08:50:03.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f16ffd640 1 --2- 172.21.15.172:0/2632131083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f180af5e0 0x7f6f1806c0d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009870 tx=0x7f6f0c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb3990243369775a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:03.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f167fc640 1 -- 172.21.15.172:0/2632131083 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c037070 con 0x7f6f180af5e0 2024-04-25T08:50:03.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f167fc640 1 -- 172.21.15.172:0/2632131083 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c032440 con 0x7f6f180af5e0 2024-04-25T08:50:03.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f167fc640 1 -- 172.21.15.172:0/2632131083 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c032810 con 0x7f6f180af5e0 2024-04-25T08:50:03.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f1e170640 1 -- 172.21.15.172:0/2632131083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f180af5e0 msgr2=0x7f6f1806c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f1e170640 1 --2- 172.21.15.172:0/2632131083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f180af5e0 0x7f6f1806c0d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009870 tx=0x7f6f0c02a270 comp rx=0 tx=0).stop 2024-04-25T08:50:03.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f1e170640 1 -- 172.21.15.172:0/2632131083 shutdown_connections 2024-04-25T08:50:03.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f1e170640 1 --2- 172.21.15.172:0/2632131083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f180af5e0 0x7f6f1806c0d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f1e170640 1 --2- 172.21.15.172:0/2632131083 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180b4f10 0x7f6f180b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f1e170640 1 -- 172.21.15.172:0/2632131083 >> 172.21.15.172:0/2632131083 conn(0x7f6f180cfec0 msgr2=0x7f6f180d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:03.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f1e170640 1 -- 172.21.15.172:0/2632131083 shutdown_connections 2024-04-25T08:50:03.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.810+0000 7f6f1e170640 1 -- 172.21.15.172:0/2632131083 wait complete. 2024-04-25T08:50:03.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.811+0000 7f6f1e170640 1 Processor -- start 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.812+0000 7f6f1e170640 1 -- start start 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.812+0000 7f6f1e170640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180af5e0 0x7f6f18154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.812+0000 7f6f1e170640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f180b4f10 0x7f6f18158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.812+0000 7f6f1e170640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1815f630 0x7f6f1809caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.812+0000 7f6f1e170640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180ad730 con 0x7f6f1815f630 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.812+0000 7f6f1e170640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1806b8d0 con 0x7f6f180b4f10 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.812+0000 7f6f1e170640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1815fa80 con 0x7f6f180af5e0 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.812+0000 7f6f17fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1815f630 0x7f6f1809caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f16ffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f180b4f10 0x7f6f18158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f177fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180af5e0 0x7f6f18154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f17fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1815f630 0x7f6f1809caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47136/0 (socket says 172.21.15.172:47136) 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f17fff640 1 -- 172.21.15.172:0/1590296458 learned_addr learned my addr 172.21.15.172:0/1590296458 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f17fff640 1 -- 172.21.15.172:0/1590296458 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180af5e0 msgr2=0x7f6f18154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f17fff640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180af5e0 0x7f6f18154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f17fff640 1 -- 172.21.15.172:0/1590296458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f180b4f10 msgr2=0x7f6f18158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f17fff640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f180b4f10 0x7f6f18158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f17fff640 1 -- 172.21.15.172:0/1590296458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f181f1a80 con 0x7f6f1815f630 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f16ffd640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f180b4f10 0x7f6f18158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f17fff640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1815f630 0x7f6f1809caa0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c730 tx=0x7f6f1000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6efffff640 1 -- 172.21.15.172:0/1590296458 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10017070 con 0x7f6f1815f630 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6efffff640 1 -- 172.21.15.172:0/1590296458 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1000ce40 con 0x7f6f1815f630 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f1e170640 1 -- 172.21.15.172:0/1590296458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f18158870 con 0x7f6f1815f630 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6efffff640 1 -- 172.21.15.172:0/1590296458 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000a840 con 0x7f6f1815f630 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.813+0000 7f6f1e170640 1 -- 172.21.15.172:0/1590296458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f181f1fd0 con 0x7f6f1815f630 2024-04-25T08:50:03.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.814+0000 7f6f1e170640 1 -- 172.21.15.172:0/1590296458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f18073a00 con 0x7f6f1815f630 2024-04-25T08:50:03.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.815+0000 7f6efffff640 1 -- 172.21.15.172:0/1590296458 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6f1001a070 con 0x7f6f1815f630 2024-04-25T08:50:03.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.815+0000 7f6efffff640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6f0406b4d0 0x7f6f0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:03.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.815+0000 7f6efffff640 1 -- 172.21.15.172:0/1590296458 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6f10089870 con 0x7f6f1815f630 2024-04-25T08:50:03.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.815+0000 7f6f177fe640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6f0406b4d0 0x7f6f0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:03.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.816+0000 7f6f177fe640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6f0406b4d0 0x7f6f0406d990 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009b40 tx=0x7f6f08009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:03.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:03.819+0000 7f6efffff640 1 -- 172.21.15.172:0/1590296458 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6f10057e90 con 0x7f6f1815f630 2024-04-25T08:50:04.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.027+0000 7f6f1e170640 1 -- 172.21.15.172:0/1590296458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6f180af9c0 con 0x7f6f1815f630 2024-04-25T08:50:04.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.088+0000 7f6efffff640 1 -- 172.21.15.172:0/1590296458 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6f1005bf30 con 0x7f6f1815f630 2024-04-25T08:50:04.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.090+0000 7f6f1e170640 1 -- 172.21.15.172:0/1590296458 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6f0406b4d0 msgr2=0x7f6f0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.090+0000 7f6f1e170640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6f0406b4d0 0x7f6f0406d990 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009b40 tx=0x7f6f08009190 comp rx=0 tx=0).stop 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.090+0000 7f6f1e170640 1 -- 172.21.15.172:0/1590296458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1815f630 msgr2=0x7f6f1809caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.090+0000 7f6f1e170640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1815f630 0x7f6f1809caa0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c730 tx=0x7f6f1000cbf0 comp rx=0 tx=0).stop 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.090+0000 7f6f1e170640 1 -- 172.21.15.172:0/1590296458 shutdown_connections 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.090+0000 7f6f1e170640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6f0406b4d0 0x7f6f0406d990 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.090+0000 7f6f1e170640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f180b4f10 0x7f6f18158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.090+0000 7f6f1e170640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1815f630 0x7f6f1809caa0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.090+0000 7f6f1e170640 1 --2- 172.21.15.172:0/1590296458 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f180af5e0 0x7f6f18154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.091+0000 7f6f1e170640 1 -- 172.21.15.172:0/1590296458 >> 172.21.15.172:0/1590296458 conn(0x7f6f180cfec0 msgr2=0x7f6f1806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.091+0000 7f6f1e170640 1 -- 172.21.15.172:0/1590296458 shutdown_connections 2024-04-25T08:50:04.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.091+0000 7f6f1e170640 1 -- 172.21.15.172:0/1590296458 wait complete. 2024-04-25T08:50:04.093 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:50:04.093 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:50:04.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.204+0000 7f8a31693640 1 Processor -- start 2024-04-25T08:50:04.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.204+0000 7f8a31693640 1 -- start start 2024-04-25T08:50:04.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.205+0000 7f8a31693640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8a2c0cfa40 0x7f8a2c0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:04.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.205+0000 7f8a31693640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c0c75e0 con 0x7f8a2c0cf600 2024-04-25T08:50:04.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.205+0000 7f8a31693640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c0c78c0 con 0x7f8a2c15bb50 2024-04-25T08:50:04.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.205+0000 7f8a31693640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0c8680 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.205+0000 7f8a2b7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8a2c0cfa40 0x7f8a2c0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:04.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.205+0000 7f8a227fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8a2c0cf600 0x7f8a2c0cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50584/0 (socket says 172.21.15.172:50584) 2024-04-25T08:50:04.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.205+0000 7f8a227fc640 1 -- 172.21.15.172:0/2504755514 learned_addr learned my addr 172.21.15.172:0/2504755514 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:04.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.206+0000 7f8a2b7fe640 1 -- 172.21.15.172:0/2504755514 >> v1:172.21.15.186:6789/0 conn(0x7f8a2c15bb50 legacy=0x7f8a2c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:04.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.206+0000 7f8a2b7fe640 1 -- 172.21.15.172:0/2504755514 >> v1:172.21.15.172:6789/0 conn(0x7f8a2c0cf600 legacy=0x7f8a2c0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:04.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.206+0000 7f8a2b7fe640 1 -- 172.21.15.172:0/2504755514 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0c7ba0 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.206+0000 7f8a2a7fc640 1 -- 172.21.15.172:0/2504755514 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172155902 0 0) 0x7f8a2c0c75e0 con 0x7f8a2c0cf600 2024-04-25T08:50:04.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.206+0000 7f8a2b7fe640 1 --2- 172.21.15.172:0/2504755514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 0x7f8a2c0cc630 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009d90 tx=0x7f8a2402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3515f08794d3c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:04.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.206+0000 7f8a2a7fc640 1 -- 172.21.15.172:0/2504755514 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24037070 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.206+0000 7f8a2a7fc640 1 -- 172.21.15.172:0/2504755514 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a24007740 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.206+0000 7f8a2a7fc640 1 -- 172.21.15.172:0/2504755514 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24007b10 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.207+0000 7f8a31693640 1 -- 172.21.15.172:0/2504755514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 msgr2=0x7f8a2c0cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:04.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.207+0000 7f8a31693640 1 --2- 172.21.15.172:0/2504755514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 0x7f8a2c0cc630 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009d90 tx=0x7f8a2402a780 comp rx=0 tx=0).stop 2024-04-25T08:50:04.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.207+0000 7f8a31693640 1 -- 172.21.15.172:0/2504755514 shutdown_connections 2024-04-25T08:50:04.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.207+0000 7f8a31693640 1 --2- 172.21.15.172:0/2504755514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 0x7f8a2c0cc630 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:04.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.207+0000 7f8a31693640 1 -- 172.21.15.172:0/2504755514 >> 172.21.15.172:0/2504755514 conn(0x7f8a2c06f500 msgr2=0x7f8a2c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:04.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.207+0000 7f8a31693640 1 -- 172.21.15.172:0/2504755514 shutdown_connections 2024-04-25T08:50:04.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.207+0000 7f8a31693640 1 -- 172.21.15.172:0/2504755514 wait complete. 2024-04-25T08:50:04.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.208+0000 7f8a31693640 1 Processor -- start 2024-04-25T08:50:04.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.208+0000 7f8a31693640 1 -- start start 2024-04-25T08:50:04.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a31693640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8a2c0cf600 0x7f8a2c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:04.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a31693640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 0x7f8a2c06d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:04.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a31693640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a2c15bb50 0x7f8a2c0cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:04.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a31693640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0c72a0 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a31693640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0c8160 con 0x7f8a2c15bb50 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a31693640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0cfe90 con 0x7f8a2c0cf600 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a227fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 0x7f8a2c06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a227fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 0x7f8a2c06d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47146/0 (socket says 172.21.15.172:47146) 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a227fc640 1 -- 172.21.15.172:0/2476767561 learned_addr learned my addr 172.21.15.172:0/2476767561 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a2b7fe640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a2c15bb50 0x7f8a2c0cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a2affd640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8a2c0cf600 0x7f8a2c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a227fc640 1 -- 172.21.15.172:0/2476767561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8a2c0cf600 msgr2=0x7f8a2c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a227fc640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8a2c0cf600 0x7f8a2c14f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a227fc640 1 -- 172.21.15.172:0/2476767561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a2c15bb50 msgr2=0x7f8a2c0cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a227fc640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a2c15bb50 0x7f8a2c0cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a227fc640 1 -- 172.21.15.172:0/2476767561 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c06da90 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.209+0000 7f8a2b7fe640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a2c15bb50 0x7f8a2c0cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.210+0000 7f8a227fc640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 0x7f8a2c06d240 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c4a0 tx=0x7f8a1400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.210+0000 7f8a23fff640 1 -- 172.21.15.172:0/2476767561 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14018070 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.210+0000 7f8a23fff640 1 -- 172.21.15.172:0/2476767561 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a140074e0 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.210+0000 7f8a31693640 1 -- 172.21.15.172:0/2476767561 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c0cbcd0 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.210+0000 7f8a23fff640 1 -- 172.21.15.172:0/2476767561 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14004a20 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.210+0000 7f8a31693640 1 -- 172.21.15.172:0/2476767561 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c0cc290 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.211+0000 7f8a31693640 1 -- 172.21.15.172:0/2476767561 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c073a00 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.211+0000 7f8a23fff640 1 -- 172.21.15.172:0/2476767561 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a1401b070 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.211+0000 7f8a23fff640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a0c06b4d0 0x7f8a0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:04.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.212+0000 7f8a23fff640 1 -- 172.21.15.172:0/2476767561 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8a14089700 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.212+0000 7f8a2affd640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a0c06b4d0 0x7f8a0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:04.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.212+0000 7f8a2affd640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a0c06b4d0 0x7f8a0c06d990 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c155340 tx=0x7f8a1c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:04.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.216+0000 7f8a23fff640 1 -- 172.21.15.172:0/2476767561 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8a140583f0 con 0x7f8a2c0cfa40 2024-04-25T08:50:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:04.422+0000 7f8a31693640 1 -- 172.21.15.172:0/2476767561 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8a2c0cf150 con 0x7f8a2c0cfa40 2024-04-25T08:50:05.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.098+0000 7f8a23fff640 1 -- 172.21.15.172:0/2476767561 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8a14057cf0 con 0x7f8a2c0cfa40 2024-04-25T08:50:05.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 -- 172.21.15.172:0/2476767561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a0c06b4d0 msgr2=0x7f8a0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a0c06b4d0 0x7f8a0c06d990 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c155340 tx=0x7f8a1c009040 comp rx=0 tx=0).stop 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 -- 172.21.15.172:0/2476767561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 msgr2=0x7f8a2c06d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 0x7f8a2c06d240 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c4a0 tx=0x7f8a1400c960 comp rx=0 tx=0).stop 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 -- 172.21.15.172:0/2476767561 shutdown_connections 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8a0c06b4d0 0x7f8a0c06d990 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a2c15bb50 0x7f8a2c0cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a2c0cfa40 0x7f8a2c06d240 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 --2- 172.21.15.172:0/2476767561 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8a2c0cf600 0x7f8a2c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 -- 172.21.15.172:0/2476767561 >> 172.21.15.172:0/2476767561 conn(0x7f8a2c06f500 msgr2=0x7f8a2c0b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 -- 172.21.15.172:0/2476767561 shutdown_connections 2024-04-25T08:50:05.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.101+0000 7f8a31693640 1 -- 172.21.15.172:0/2476767561 wait complete. 2024-04-25T08:50:05.104 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:50:05.105 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:05.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.216+0000 7f8259d4c640 1 Processor -- start 2024-04-25T08:50:05.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.216+0000 7f8259d4c640 1 -- start start 2024-04-25T08:50:05.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f8259d4c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f825415dbe0 0x7f82540d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f8259d4c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f82540b92a0 0x7f82540d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f8259d4c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82540b97a0 con 0x7f82540b2cb0 2024-04-25T08:50:05.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f8259d4c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825415dfc0 con 0x7f82540b92a0 2024-04-25T08:50:05.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f8259d4c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82540d1a00 con 0x7f825415dbe0 2024-04-25T08:50:05.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f82537fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f825415dbe0 0x7f82540d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.208 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f8253fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f82540b92a0 0x7f82540d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f82537fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f825415dbe0 0x7f82540d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:52798/0 (socket says 172.21.15.172:52798) 2024-04-25T08:50:05.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f82537fe640 1 -- 172.21.15.172:0/3171011707 learned_addr learned my addr 172.21.15.172:0/3171011707 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:05.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f82537fe640 1 -- 172.21.15.172:0/3171011707 >> v2:172.21.15.186:3300/0 conn(0x7f82540b92a0 msgr2=0x7f82540d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:05.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f82537fe640 1 --2- 172.21.15.172:0/3171011707 >> v2:172.21.15.186:3300/0 conn(0x7f82540b92a0 0x7f82540d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f82537fe640 1 -- 172.21.15.172:0/3171011707 >> v1:172.21.15.186:6789/0 conn(0x7f82540b2cb0 legacy=0x7f82540b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f82537fe640 1 -- 172.21.15.172:0/3171011707 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82540d1c50 con 0x7f825415dbe0 2024-04-25T08:50:05.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.217+0000 7f8253fff640 1 --2- 172.21.15.172:0/3171011707 >> v2:172.21.15.186:3300/0 conn(0x7f82540b92a0 0x7f82540d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:05.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.218+0000 7f82537fe640 1 --2- 172.21.15.172:0/3171011707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f825415dbe0 0x7f82540d0910 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8244009870 tx=0x7f824402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afb11eec6c08b745 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.218+0000 7f8252ffd640 1 -- 172.21.15.172:0/3171011707 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244037070 con 0x7f825415dbe0 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.218+0000 7f8252ffd640 1 -- 172.21.15.172:0/3171011707 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244032440 con 0x7f825415dbe0 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.218+0000 7f8252ffd640 1 -- 172.21.15.172:0/3171011707 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244032810 con 0x7f825415dbe0 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.219+0000 7f8259d4c640 1 -- 172.21.15.172:0/3171011707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f825415dbe0 msgr2=0x7f82540d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.219+0000 7f8259d4c640 1 --2- 172.21.15.172:0/3171011707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f825415dbe0 0x7f82540d0910 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8244009870 tx=0x7f824402a270 comp rx=0 tx=0).stop 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.219+0000 7f8259d4c640 1 -- 172.21.15.172:0/3171011707 shutdown_connections 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.219+0000 7f8259d4c640 1 --2- 172.21.15.172:0/3171011707 >> v2:172.21.15.186:3300/0 conn(0x7f82540b92a0 0x7f82540d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.219+0000 7f8259d4c640 1 --2- 172.21.15.172:0/3171011707 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f825415dbe0 0x7f82540d0910 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.219+0000 7f8259d4c640 1 -- 172.21.15.172:0/3171011707 >> 172.21.15.172:0/3171011707 conn(0x7f8254061a20 msgr2=0x7f8254061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.219+0000 7f8259d4c640 1 -- 172.21.15.172:0/3171011707 shutdown_connections 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.219+0000 7f8259d4c640 1 -- 172.21.15.172:0/3171011707 wait complete. 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.220+0000 7f8259d4c640 1 Processor -- start 2024-04-25T08:50:05.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.220+0000 7f8259d4c640 1 -- start start 2024-04-25T08:50:05.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f8259d4c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82540b2cb0 0x7f8254154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f8259d4c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82540b92a0 0x7f82541f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f8259d4c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f825415dbe0 0x7f82540cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f8259d4c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82540b6ab0 con 0x7f82540b2cb0 2024-04-25T08:50:05.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f8259d4c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82540d2210 con 0x7f825415dbe0 2024-04-25T08:50:05.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f8259d4c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82540b6c30 con 0x7f82540b92a0 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f82537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82540b2cb0 0x7f8254154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f82537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82540b2cb0 0x7f8254154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47156/0 (socket says 172.21.15.172:47156) 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f82537fe640 1 -- 172.21.15.172:0/612336362 learned_addr learned my addr 172.21.15.172:0/612336362 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f824bfff640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82540b92a0 0x7f82541f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f8253fff640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f825415dbe0 0x7f82540cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f82537fe640 1 -- 172.21.15.172:0/612336362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82540b92a0 msgr2=0x7f82541f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f82537fe640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82540b92a0 0x7f82541f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f82537fe640 1 -- 172.21.15.172:0/612336362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f825415dbe0 msgr2=0x7f82540cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f82537fe640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f825415dbe0 0x7f82540cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f82537fe640 1 -- 172.21.15.172:0/612336362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82540b47c0 con 0x7f82540b2cb0 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f8253fff640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f825415dbe0 0x7f82540cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.221+0000 7f82537fe640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82540b2cb0 0x7f8254154600 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f8244000c00 tx=0x7f82440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.222+0000 7f8250ff9640 1 -- 172.21.15.172:0/612336362 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244037040 con 0x7f82540b2cb0 2024-04-25T08:50:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.222+0000 7f8250ff9640 1 -- 172.21.15.172:0/612336362 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244042070 con 0x7f82540b2cb0 2024-04-25T08:50:05.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.222+0000 7f8250ff9640 1 -- 172.21.15.172:0/612336362 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244030880 con 0x7f82540b2cb0 2024-04-25T08:50:05.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.222+0000 7f8259d4c640 1 -- 172.21.15.172:0/612336362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82540b4a80 con 0x7f82540b2cb0 2024-04-25T08:50:05.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.222+0000 7f8259d4c640 1 -- 172.21.15.172:0/612336362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82540b5040 con 0x7f82540b2cb0 2024-04-25T08:50:05.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.223+0000 7f8259d4c640 1 -- 172.21.15.172:0/612336362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825406d0a0 con 0x7f82540b2cb0 2024-04-25T08:50:05.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.223+0000 7f8250ff9640 1 -- 172.21.15.172:0/612336362 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8244030a20 con 0x7f82540b2cb0 2024-04-25T08:50:05.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.223+0000 7f8250ff9640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f823406b4d0 0x7f823406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.224+0000 7f8250ff9640 1 -- 172.21.15.172:0/612336362 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f82440aabc0 con 0x7f82540b2cb0 2024-04-25T08:50:05.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.224+0000 7f824bfff640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f823406b4d0 0x7f823406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.224+0000 7f824bfff640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f823406b4d0 0x7f823406d990 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f82540cda20 tx=0x7f823c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:05.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.228+0000 7f8250ff9640 1 -- 172.21.15.172:0/612336362 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8244079940 con 0x7f82540b2cb0 2024-04-25T08:50:05.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.435+0000 7f8259d4c640 1 -- 172.21.15.172:0/612336362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8254073990 con 0x7f82540b2cb0 2024-04-25T08:50:05.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.436+0000 7f8250ff9640 1 -- 172.21.15.172:0/612336362 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f8244079240 con 0x7f82540b2cb0 2024-04-25T08:50:05.427 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:05.427 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:05.427 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 -- 172.21.15.172:0/612336362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f823406b4d0 msgr2=0x7f823406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f823406b4d0 0x7f823406d990 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f82540cda20 tx=0x7f823c009040 comp rx=0 tx=0).stop 2024-04-25T08:50:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 -- 172.21.15.172:0/612336362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82540b2cb0 msgr2=0x7f8254154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82540b2cb0 0x7f8254154600 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f8244000c00 tx=0x7f82440046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 -- 172.21.15.172:0/612336362 shutdown_connections 2024-04-25T08:50:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f823406b4d0 0x7f823406d990 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f825415dbe0 0x7f82540cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82540b92a0 0x7f82541f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 --2- 172.21.15.172:0/612336362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82540b2cb0 0x7f8254154600 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 -- 172.21.15.172:0/612336362 >> 172.21.15.172:0/612336362 conn(0x7f8254061a20 msgr2=0x7f825415c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:05.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 -- 172.21.15.172:0/612336362 shutdown_connections 2024-04-25T08:50:05.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.438+0000 7f8259d4c640 1 -- 172.21.15.172:0/612336362 wait complete. 2024-04-25T08:50:05.440 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:05.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.546+0000 7f25f8d3b640 1 Processor -- start 2024-04-25T08:50:05.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.546+0000 7f25f8d3b640 1 -- start start 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.547+0000 7f25f8d3b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f25f406b1a0 0x7f25f406f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.547+0000 7f25f8d3b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25f406b580 0x7f25f40cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.547+0000 7f25f8d3b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f4161960 con 0x7f25f40cffa0 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.547+0000 7f25f8d3b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f40d0430 con 0x7f25f406b1a0 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.547+0000 7f25f8d3b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40cbd50 con 0x7f25f406b580 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.548+0000 7f25f2d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f25f40cffa0 0x7f25f406e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50596/0 (socket says 172.21.15.172:50596) 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.548+0000 7f25f2d9d640 1 -- 172.21.15.172:0/2778234387 learned_addr learned my addr 172.21.15.172:0/2778234387 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.548+0000 7f25f259c640 1 --2- 172.21.15.172:0/2778234387 >> v2:172.21.15.186:3300/0 conn(0x7f25f406b1a0 0x7f25f406f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.548+0000 7f25f1d9b640 1 --2- 172.21.15.172:0/2778234387 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25f406b580 0x7f25f40cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.548+0000 7f25f159a640 1 -- 172.21.15.172:0/2778234387 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089854512 0 0) 0x7f25f4161960 con 0x7f25f40cffa0 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.548+0000 7f25f159a640 1 -- 172.21.15.172:0/2778234387 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e0003520 con 0x7f25f40cffa0 2024-04-25T08:50:05.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.548+0000 7f25f259c640 1 -- 172.21.15.172:0/2778234387 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25f406b580 msgr2=0x7f25f40cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:05.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.548+0000 7f25f259c640 1 --2- 172.21.15.172:0/2778234387 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25f406b580 0x7f25f40cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.548+0000 7f25f259c640 1 -- 172.21.15.172:0/2778234387 >> v1:172.21.15.172:6789/0 conn(0x7f25f40cffa0 legacy=0x7f25f406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.548+0000 7f25f259c640 1 -- 172.21.15.172:0/2778234387 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4161c40 con 0x7f25f406b1a0 2024-04-25T08:50:05.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.549+0000 7f25f259c640 1 --2- 172.21.15.172:0/2778234387 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25f406b1a0 0x7f25f406f9c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0097a0 tx=0x7f25ec02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=479a655d348133ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:05.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.549+0000 7f25f159a640 1 -- 172.21.15.172:0/2778234387 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec037070 con 0x7f25f406b1a0 2024-04-25T08:50:05.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.549+0000 7f25f159a640 1 -- 172.21.15.172:0/2778234387 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec02ae50 con 0x7f25f406b1a0 2024-04-25T08:50:05.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.549+0000 7f25f159a640 1 -- 172.21.15.172:0/2778234387 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec032660 con 0x7f25f406b1a0 2024-04-25T08:50:05.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.549+0000 7f25f8d3b640 1 -- 172.21.15.172:0/2778234387 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25f406b1a0 msgr2=0x7f25f406f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.549+0000 7f25f8d3b640 1 --2- 172.21.15.172:0/2778234387 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25f406b1a0 0x7f25f406f9c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0097a0 tx=0x7f25ec02a100 comp rx=0 tx=0).stop 2024-04-25T08:50:05.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.549+0000 7f25f8d3b640 1 -- 172.21.15.172:0/2778234387 shutdown_connections 2024-04-25T08:50:05.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.549+0000 7f25f8d3b640 1 --2- 172.21.15.172:0/2778234387 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25f406b580 0x7f25f40cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.549+0000 7f25f8d3b640 1 --2- 172.21.15.172:0/2778234387 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25f406b1a0 0x7f25f406f9c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.549+0000 7f25f8d3b640 1 -- 172.21.15.172:0/2778234387 >> 172.21.15.172:0/2778234387 conn(0x7f25f40b2220 msgr2=0x7f25f40b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:05.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.550+0000 7f25f8d3b640 1 -- 172.21.15.172:0/2778234387 shutdown_connections 2024-04-25T08:50:05.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.550+0000 7f25f8d3b640 1 -- 172.21.15.172:0/2778234387 wait complete. 2024-04-25T08:50:05.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.551+0000 7f25f8d3b640 1 Processor -- start 2024-04-25T08:50:05.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.551+0000 7f25f8d3b640 1 -- start start 2024-04-25T08:50:05.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f8d3b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25f406b1a0 0x7f25f40b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f8d3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f406b580 0x7f25f40b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f8d3b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25f40cffa0 0x7f25f40b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f8d3b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4162720 con 0x7f25f406b580 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f8d3b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4162200 con 0x7f25f406b1a0 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f8d3b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4070330 con 0x7f25f40cffa0 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f1d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f406b580 0x7f25f40b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f1d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f406b580 0x7f25f40b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47172/0 (socket says 172.21.15.172:47172) 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f1d9b640 1 -- 172.21.15.172:0/166672775 learned_addr learned my addr 172.21.15.172:0/166672775 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f259c640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25f406b1a0 0x7f25f40b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f1d9b640 1 -- 172.21.15.172:0/166672775 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25f40cffa0 msgr2=0x7f25f40b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f1d9b640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25f40cffa0 0x7f25f40b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f1d9b640 1 -- 172.21.15.172:0/166672775 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25f406b1a0 msgr2=0x7f25f40b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f1d9b640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25f406b1a0 0x7f25f40b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f1d9b640 1 -- 172.21.15.172:0/166672775 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40b5480 con 0x7f25f406b580 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f1d9b640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f406b580 0x7f25f40b5890 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00e9b0 tx=0x7f25dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25eaffd640 1 -- 172.21.15.172:0/166672775 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc017070 con 0x7f25f406b580 2024-04-25T08:50:05.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25eaffd640 1 -- 172.21.15.172:0/166672775 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc00c9a0 con 0x7f25f406b580 2024-04-25T08:50:05.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f8d3b640 1 -- 172.21.15.172:0/166672775 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f41f3c50 con 0x7f25f406b580 2024-04-25T08:50:05.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25eaffd640 1 -- 172.21.15.172:0/166672775 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00cd90 con 0x7f25f406b580 2024-04-25T08:50:05.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.552+0000 7f25f8d3b640 1 -- 172.21.15.172:0/166672775 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f41f44f0 con 0x7f25f406b580 2024-04-25T08:50:05.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.553+0000 7f25f8d3b640 1 -- 172.21.15.172:0/166672775 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4073990 con 0x7f25f406b580 2024-04-25T08:50:05.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.554+0000 7f25eaffd640 1 -- 172.21.15.172:0/166672775 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f25dc01a070 con 0x7f25f406b580 2024-04-25T08:50:05.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.554+0000 7f25eaffd640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25d406b4d0 0x7f25d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.554+0000 7f25eaffd640 1 -- 172.21.15.172:0/166672775 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f25dc08a340 con 0x7f25f406b580 2024-04-25T08:50:05.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.554+0000 7f25f259c640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25d406b4d0 0x7f25d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.555+0000 7f25f259c640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25d406b4d0 0x7f25d406d990 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f25ec034000 tx=0x7f25ec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:05.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.559+0000 7f25eaffd640 1 -- 172.21.15.172:0/166672775 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f25dc0590c0 con 0x7f25f406b580 2024-04-25T08:50:05.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.732+0000 7f25f8d3b640 1 -- 172.21.15.172:0/166672775 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25f406d370 con 0x7f25f406b580 2024-04-25T08:50:05.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.733+0000 7f25eaffd640 1 -- 172.21.15.172:0/166672775 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17012 (secure 0 0 0) 0x7f25dc0589c0 con 0x7f25f406b580 2024-04-25T08:50:05.724 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:05.724 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":119,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:04.075355+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:00.630478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:01.391083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 -- 172.21.15.172:0/166672775 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25d406b4d0 msgr2=0x7f25d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25d406b4d0 0x7f25d406d990 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f25ec034000 tx=0x7f25ec02e000 comp rx=0 tx=0).stop 2024-04-25T08:50:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 -- 172.21.15.172:0/166672775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f406b580 msgr2=0x7f25f40b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f406b580 0x7f25f40b5890 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00e9b0 tx=0x7f25dc00ee70 comp rx=0 tx=0).stop 2024-04-25T08:50:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 -- 172.21.15.172:0/166672775 shutdown_connections 2024-04-25T08:50:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f25d406b4d0 0x7f25d406d990 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25f40cffa0 0x7f25f40b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25f406b580 0x7f25f40b5890 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 --2- 172.21.15.172:0/166672775 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25f406b1a0 0x7f25f40b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 -- 172.21.15.172:0/166672775 >> 172.21.15.172:0/166672775 conn(0x7f25f40b2220 msgr2=0x7f25f40ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:05.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 -- 172.21.15.172:0/166672775 shutdown_connections 2024-04-25T08:50:05.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.735+0000 7f25f8d3b640 1 -- 172.21.15.172:0/166672775 wait complete. 2024-04-25T08:50:05.736 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:50:05.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:50:05.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.844+0000 7fe45899e640 1 Processor -- start 2024-04-25T08:50:05.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.844+0000 7fe45899e640 1 -- start start 2024-04-25T08:50:05.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45899e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4540ce590 0x7fe454165900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45899e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe454071480 con 0x7fe454154ee0 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45899e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe454071760 con 0x7fe4540cfec0 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45899e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe454072090 con 0x7fe4540ce590 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45259c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe454154ee0 0x7fe4540cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50610/0 (socket says 172.21.15.172:50610) 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45259c640 1 -- 172.21.15.172:0/2597043244 learned_addr learned my addr 172.21.15.172:0/2597043244 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe452d9d640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4540ce590 0x7fe454165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448818002 0 0) 0x7fe454071480 con 0x7fe454154ee0 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe43c003520 con 0x7fe454154ee0 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133560109 0 0) 0x7fe454071760 con 0x7fe4540cfec0 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe454071480 con 0x7fe4540cfec0 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2741160620 0 0) 0x7fe43c003520 con 0x7fe454154ee0 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4540ce590 msgr2=0x7fe454165900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4540ce590 0x7fe454165900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 >> v1:172.21.15.186:6789/0 conn(0x7fe4540cfec0 legacy=0x7fe4540cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe454071a40 con 0x7fe454154ee0 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fe444001670 con 0x7fe454154ee0 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe452d9d640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4540ce590 0x7fe454165900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 >> v1:172.21.15.172:6789/0 conn(0x7fe454154ee0 legacy=0x7fe4540cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe43c003b70 0x7fe43c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe43c004800 0x7fe43c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.845+0000 7fe45159a640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4540ce590 0x7fe43c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c00b9f0 con 0x7fe43c004800 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c00bba0 con 0x7fe43c003b70 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c00bda0 con 0x7fe4540ce590 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe451d9b640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe43c004800 0x7fe43c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe45259c640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe43c003b70 0x7fe43c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe452d9d640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4540ce590 0x7fe43c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe451d9b640 1 -- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4540ce590 msgr2=0x7fe43c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe451d9b640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4540ce590 0x7fe43c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe451d9b640 1 -- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe43c003b70 msgr2=0x7fe43c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe451d9b640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe43c003b70 0x7fe43c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe451d9b640 1 -- 172.21.15.172:0/2597043244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c003520 con 0x7fe43c004800 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe45259c640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe43c003b70 0x7fe43c003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.846+0000 7fe451d9b640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe43c004800 0x7fe43c004c80 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fe4480018a0 tx=0x7fe43c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad56dbc98dae3d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.847+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480014f0 con 0x7fe43c004800 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.847+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4480052d0 con 0x7fe43c004800 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.847+0000 7fe45159a640 1 -- 172.21.15.172:0/2597043244 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44802ac40 con 0x7fe43c004800 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.847+0000 7fe45899e640 1 -- 172.21.15.172:0/2597043244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe43c004800 msgr2=0x7fe43c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.847+0000 7fe45899e640 1 --2- 172.21.15.172:0/2597043244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe43c004800 0x7fe43c004c80 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fe4480018a0 tx=0x7fe43c005830 comp rx=0 tx=0).stop 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.847+0000 7fe452d9d640 1 -- 172.21.15.172:0/2597043244 reap_dead start 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.847+0000 7fe45899e640 1 -- 172.21.15.172:0/2597043244 shutdown_connections 2024-04-25T08:50:05.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.847+0000 7fe45899e640 1 -- 172.21.15.172:0/2597043244 >> 172.21.15.172:0/2597043244 conn(0x7fe45406abe0 msgr2=0x7fe45406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:05.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.847+0000 7fe45899e640 1 -- 172.21.15.172:0/2597043244 shutdown_connections 2024-04-25T08:50:05.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.847+0000 7fe45899e640 1 -- 172.21.15.172:0/2597043244 wait complete. 2024-04-25T08:50:05.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe45899e640 1 Processor -- start 2024-04-25T08:50:05.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe45899e640 1 -- start start 2024-04-25T08:50:05.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe45899e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe43c004800 0x7fe4540a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe45899e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe45414a7d0 0x7fe454159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe45899e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe45414ac50 0x7fe454157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe45899e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4541552c0 con 0x7fe45414ac50 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe45899e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe454071230 con 0x7fe43c004800 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe45899e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe454155440 con 0x7fe45414a7d0 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe452d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe45414ac50 0x7fe454157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe452d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe45414ac50 0x7fe454157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47186/0 (socket says 172.21.15.172:47186) 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.849+0000 7fe452d9d640 1 -- 172.21.15.172:0/4016306226 learned_addr learned my addr 172.21.15.172:0/4016306226 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe451d9b640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe45414a7d0 0x7fe454159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe45259c640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe43c004800 0x7fe4540a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe452d9d640 1 -- 172.21.15.172:0/4016306226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe45414a7d0 msgr2=0x7fe454159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe452d9d640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe45414a7d0 0x7fe454159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe452d9d640 1 -- 172.21.15.172:0/4016306226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe43c004800 msgr2=0x7fe4540a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe452d9d640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe43c004800 0x7fe4540a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe452d9d640 1 -- 172.21.15.172:0/4016306226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4541566b0 con 0x7fe45414ac50 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe452d9d640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe45414ac50 0x7fe454157710 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe4540d0700 tx=0x7fe44c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:05.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe442ffd640 1 -- 172.21.15.172:0/4016306226 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c011e30 con 0x7fe45414ac50 2024-04-25T08:50:05.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe442ffd640 1 -- 172.21.15.172:0/4016306226 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c01b070 con 0x7fe45414ac50 2024-04-25T08:50:05.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe45899e640 1 -- 172.21.15.172:0/4016306226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe454156950 con 0x7fe45414ac50 2024-04-25T08:50:05.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe442ffd640 1 -- 172.21.15.172:0/4016306226 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c003990 con 0x7fe45414ac50 2024-04-25T08:50:05.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.850+0000 7fe45899e640 1 -- 172.21.15.172:0/4016306226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe454156f10 con 0x7fe45414ac50 2024-04-25T08:50:05.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.851+0000 7fe45899e640 1 -- 172.21.15.172:0/4016306226 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe454073990 con 0x7fe45414ac50 2024-04-25T08:50:05.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.852+0000 7fe442ffd640 1 -- 172.21.15.172:0/4016306226 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe44c005d10 con 0x7fe45414ac50 2024-04-25T08:50:05.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.852+0000 7fe442ffd640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe43406b4d0 0x7fe43406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:05.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.852+0000 7fe442ffd640 1 -- 172.21.15.172:0/4016306226 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe44c08a710 con 0x7fe45414ac50 2024-04-25T08:50:05.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.852+0000 7fe45259c640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe43406b4d0 0x7fe43406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:05.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.852+0000 7fe45259c640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe43406b4d0 0x7fe43406d990 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe454067e10 tx=0x7fe444007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:05.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:05.856+0000 7fe442ffd640 1 -- 172.21.15.172:0/4016306226 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe44c025020 con 0x7fe45414ac50 2024-04-25T08:50:06.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.023+0000 7fe45899e640 1 -- 172.21.15.172:0/4016306226 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4540b3da0 con 0x7fe43406b4d0 2024-04-25T08:50:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.028+0000 7fe442ffd640 1 -- 172.21.15.172:0/4016306226 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+238095 (secure 0 0 0) 0x7fe4540b3da0 con 0x7fe43406b4d0 2024-04-25T08:50:06.021 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:06.022 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:50:06.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 -- 172.21.15.172:0/4016306226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe43406b4d0 msgr2=0x7fe43406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe43406b4d0 0x7fe43406d990 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe454067e10 tx=0x7fe444007040 comp rx=0 tx=0).stop 2024-04-25T08:50:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 -- 172.21.15.172:0/4016306226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe45414ac50 msgr2=0x7fe454157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe45414ac50 0x7fe454157710 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe4540d0700 tx=0x7fe44c009f90 comp rx=0 tx=0).stop 2024-04-25T08:50:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 -- 172.21.15.172:0/4016306226 shutdown_connections 2024-04-25T08:50:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe43406b4d0 0x7fe43406d990 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe45414ac50 0x7fe454157710 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe45414a7d0 0x7fe454159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 --2- 172.21.15.172:0/4016306226 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe43c004800 0x7fe4540a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 -- 172.21.15.172:0/4016306226 >> 172.21.15.172:0/4016306226 conn(0x7fe45406abe0 msgr2=0x7fe454154110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 -- 172.21.15.172:0/4016306226 shutdown_connections 2024-04-25T08:50:06.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.031+0000 7fe45899e640 1 -- 172.21.15.172:0/4016306226 wait complete. 2024-04-25T08:50:06.033 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-04-25T08:50:04.605786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":22,"acting":22,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":382560,"kb_used_data":12312,"kb_used_omap":12,"kb_used_meta":370099,"kb_avail":754592160,"statfs":{"total":773094113280,"available":772702371840,"internally_reserved":0,"allocated":12607488,"data_stored":6465768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":378981936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000608"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.071874+0000","last_change":"2024-04-25T08:50:01.071874+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.071874+0000","last_undegraded":"2024-04-25T08:50:01.071874+0000","last_fullsized":"2024-04-25T08:50:01.071874+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.068948+0000","last_change":"2024-04-25T08:50:01.068948+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.068948+0000","last_undegraded":"2024-04-25T08:50:01.068948+0000","last_fullsized":"2024-04-25T08:50:01.068948+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.071077+0000","last_change":"2024-04-25T08:50:01.071077+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.071077+0000","last_undegraded":"2024-04-25T08:50:01.071077+0000","last_fullsized":"2024-04-25T08:50:01.071077+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.068405+0000","last_change":"2024-04-25T08:50:01.068405+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.068405+0000","last_undegraded":"2024-04-25T08:50:01.068405+0000","last_fullsized":"2024-04-25T08:50:01.068405+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.068554+0000","last_change":"2024-04-25T08:50:01.068554+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.068554+0000","last_undegraded":"2024-04-25T08:50:01.068554+0000","last_fullsized":"2024-04-25T08:50:01.068554+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.068251+0000","last_change":"2024-04-25T08:50:01.068251+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.068251+0000","last_undegraded":"2024-04-25T08:50:01.068251+0000","last_fullsized":"2024-04-25T08:50:01.068251+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.069343+0000","last_change":"2024-04-25T08:50:01.069343+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.069343+0000","last_undegraded":"2024-04-25T08:50:01.069343+0000","last_fullsized":"2024-04-25T08:50:01.069343+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.071352+0000","last_change":"2024-04-25T08:50:01.071352+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.071352+0000","last_undegraded":"2024-04-25T08:50:01.071352+0000","last_fullsized":"2024-04-25T08:50:01.071352+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.071600+0000","last_change":"2024-04-25T08:50:01.071600+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.071600+0000","last_undegraded":"2024-04-25T08:50:01.071600+0000","last_fullsized":"2024-04-25T08:50:01.071600+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.068483+0000","last_change":"2024-04-25T08:50:01.068483+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.068483+0000","last_undegraded":"2024-04-25T08:50:01.068483+0000","last_fullsized":"2024-04-25T08:50:01.068483+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":345,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T08:50:01.069968+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:50:01.069968+0000","last_peered":"2024-04-25T08:50:01.069968+0000","last_clean":"2024-04-25T08:50:01.069968+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:50:01.069968+0000","last_undegraded":"2024-04-25T08:50:01.069968+0000","last_fullsized":"2024-04-25T08:50:01.069968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41496,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":2039808,"data_stored":1259801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46484,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325356,"statfs":{"total":96636764160,"available":96589164544,"internally_reserved":0,"allocated":1445888,"data_stored":669433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45076,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326764,"statfs":{"total":96636764160,"available":96590606336,"internally_reserved":0,"allocated":1433600,"data_stored":663224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50644,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321196,"statfs":{"total":96636764160,"available":96584904704,"internally_reserved":0,"allocated":1433600,"data_stored":663224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50628,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321212,"statfs":{"total":96636764160,"available":96584921088,"internally_reserved":0,"allocated":1433600,"data_stored":663224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50628,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321212,"statfs":{"total":96636764160,"available":96584921088,"internally_reserved":0,"allocated":1433600,"data_stored":663224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46456,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325384,"statfs":{"total":96636764160,"available":96589193216,"internally_reserved":0,"allocated":1421312,"data_stored":657705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51148,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320692,"statfs":{"total":96636764160,"available":96584388608,"internally_reserved":0,"allocated":1966080,"data_stored":1225933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:50:06.038 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:50:06.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.180+0000 7fa100638640 1 Processor -- start 2024-04-25T08:50:06.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.180+0000 7fa100638640 1 -- start start 2024-04-25T08:50:06.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa100638640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa0f80cfec0 0x7fa0f80cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa100638640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa0f80ce3c0 0x7fa0f806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa100638640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f8071480 con 0x7fa0f8154ee0 2024-04-25T08:50:06.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa100638640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f80ce830 con 0x7fa0f80cfec0 2024-04-25T08:50:06.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa100638640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f8072090 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa0fdbd3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa0f80cfec0 0x7fa0f80cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa0fdbd3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa0f80cfec0 0x7fa0f80cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47188/0 (socket says 172.21.15.172:47188) 2024-04-25T08:50:06.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa0fdbd3640 1 -- 172.21.15.172:0/1171602508 learned_addr learned my addr 172.21.15.172:0/1171602508 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:06.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa0fdbd3640 1 -- 172.21.15.172:0/1171602508 >> v2:172.21.15.186:3300/0 conn(0x7fa0f80ce3c0 msgr2=0x7fa0f806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:06.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa0fdbd3640 1 --2- 172.21.15.172:0/1171602508 >> v2:172.21.15.186:3300/0 conn(0x7fa0f80ce3c0 0x7fa0f806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa0fdbd3640 1 -- 172.21.15.172:0/1171602508 >> v1:172.21.15.186:6789/0 conn(0x7fa0f8154ee0 legacy=0x7fa0f80cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:06.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.181+0000 7fa0fdbd3640 1 -- 172.21.15.172:0/1171602508 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f8071760 con 0x7fa0f80cfec0 2024-04-25T08:50:06.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.182+0000 7fa0fdbd3640 1 --2- 172.21.15.172:0/1171602508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80cfec0 0x7fa0f80cde80 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fa0f806f240 tx=0x7fa0e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72131212bbfc558 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:06.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.182+0000 7fa0fd3d2640 1 -- 172.21.15.172:0/1171602508 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8037070 con 0x7fa0f80cfec0 2024-04-25T08:50:06.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.182+0000 7fa0fd3d2640 1 -- 172.21.15.172:0/1171602508 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e8032440 con 0x7fa0f80cfec0 2024-04-25T08:50:06.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.182+0000 7fa0fd3d2640 1 -- 172.21.15.172:0/1171602508 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8032810 con 0x7fa0f80cfec0 2024-04-25T08:50:06.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.183+0000 7fa100638640 1 -- 172.21.15.172:0/1171602508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80cfec0 msgr2=0x7fa0f80cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.183+0000 7fa100638640 1 --2- 172.21.15.172:0/1171602508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80cfec0 0x7fa0f80cde80 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fa0f806f240 tx=0x7fa0e802a230 comp rx=0 tx=0).stop 2024-04-25T08:50:06.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.183+0000 7fa100638640 1 -- 172.21.15.172:0/1171602508 shutdown_connections 2024-04-25T08:50:06.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.183+0000 7fa100638640 1 --2- 172.21.15.172:0/1171602508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80cfec0 0x7fa0f80cde80 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.183+0000 7fa100638640 1 --2- 172.21.15.172:0/1171602508 >> v2:172.21.15.186:3300/0 conn(0x7fa0f80ce3c0 0x7fa0f806d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.183+0000 7fa100638640 1 -- 172.21.15.172:0/1171602508 >> 172.21.15.172:0/1171602508 conn(0x7fa0f806abe0 msgr2=0x7fa0f806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:06.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.183+0000 7fa100638640 1 -- 172.21.15.172:0/1171602508 shutdown_connections 2024-04-25T08:50:06.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.183+0000 7fa100638640 1 -- 172.21.15.172:0/1171602508 wait complete. 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.184+0000 7fa100638640 1 Processor -- start 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.184+0000 7fa100638640 1 -- start start 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa100638640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80ce3c0 0x7fa0f8157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa100638640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0f80cfec0 0x7fa0f81f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa100638640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0f8154ee0 0x7fa0f8158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa100638640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8071d20 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa100638640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f8071230 con 0x7fa0f8154ee0 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa100638640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f81552c0 con 0x7fa0f80cfec0 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0fe3d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80ce3c0 0x7fa0f8157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0fe3d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80ce3c0 0x7fa0f8157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47204/0 (socket says 172.21.15.172:47204) 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0fe3d4640 1 -- 172.21.15.172:0/2116980314 learned_addr learned my addr 172.21.15.172:0/2116980314 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0febd5640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0f8154ee0 0x7fa0f8158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0fdbd3640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0f80cfec0 0x7fa0f81f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0fe3d4640 1 -- 172.21.15.172:0/2116980314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0f80cfec0 msgr2=0x7fa0f81f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0fe3d4640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0f80cfec0 0x7fa0f81f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0fe3d4640 1 -- 172.21.15.172:0/2116980314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0f8154ee0 msgr2=0x7fa0f8158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0fe3d4640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0f8154ee0 0x7fa0f8158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0fe3d4640 1 -- 172.21.15.172:0/2116980314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f81f5a20 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0fe3d4640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80ce3c0 0x7fa0f8157090 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400b410 tx=0x7fa0f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0eeffd640 1 -- 172.21.15.172:0/2116980314 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4015020 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0eeffd640 1 -- 172.21.15.172:0/2116980314 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f4011830 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa100638640 1 -- 172.21.15.172:0/2116980314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f81f5d00 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa0eeffd640 1 -- 172.21.15.172:0/2116980314 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4011c20 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.185+0000 7fa100638640 1 -- 172.21.15.172:0/2116980314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f81f1eb0 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.186+0000 7fa100638640 1 -- 172.21.15.172:0/2116980314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f80685e0 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.187+0000 7fa0eeffd640 1 -- 172.21.15.172:0/2116980314 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0f4018020 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.187+0000 7fa0eeffd640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa0dc06b4d0 0x7fa0dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.187+0000 7fa0eeffd640 1 -- 172.21.15.172:0/2116980314 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa0f408a300 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.187+0000 7fa0fdbd3640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa0dc06b4d0 0x7fa0dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.188+0000 7fa0fdbd3640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa0dc06b4d0 0x7fa0dc06d990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8034000 tx=0x7fa0e802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:06.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.191+0000 7fa0eeffd640 1 -- 172.21.15.172:0/2116980314 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0f80685e0 con 0x7fa0f80ce3c0 2024-04-25T08:50:06.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.359+0000 7fa100638640 1 -- 172.21.15.172:0/2116980314 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0f8073990 con 0x7fa0dc06b4d0 2024-04-25T08:50:06.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.364+0000 7fa0eeffd640 1 -- 172.21.15.172:0/2116980314 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+238095 (secure 0 0 0) 0x7fa0f8073990 con 0x7fa0dc06b4d0 2024-04-25T08:50:06.357 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:06.358 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:50:06.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 -- 172.21.15.172:0/2116980314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa0dc06b4d0 msgr2=0x7fa0dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa0dc06b4d0 0x7fa0dc06d990 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8034000 tx=0x7fa0e802e000 comp rx=0 tx=0).stop 2024-04-25T08:50:06.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 -- 172.21.15.172:0/2116980314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80ce3c0 msgr2=0x7fa0f8157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80ce3c0 0x7fa0f8157090 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400b410 tx=0x7fa0f400b8d0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 -- 172.21.15.172:0/2116980314 shutdown_connections 2024-04-25T08:50:06.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa0dc06b4d0 0x7fa0dc06d990 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0f8154ee0 0x7fa0f8158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa0f80cfec0 0x7fa0f81f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 --2- 172.21.15.172:0/2116980314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0f80ce3c0 0x7fa0f8157090 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 -- 172.21.15.172:0/2116980314 >> 172.21.15.172:0/2116980314 conn(0x7fa0f806abe0 msgr2=0x7fa0f806e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:06.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 -- 172.21.15.172:0/2116980314 shutdown_connections 2024-04-25T08:50:06.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.367+0000 7fa100638640 1 -- 172.21.15.172:0/2116980314 wait complete. 2024-04-25T08:50:06.369 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-04-25T08:50:04.605786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":22,"acting":22,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":382560,"kb_used_data":12312,"kb_used_omap":12,"kb_used_meta":370099,"kb_avail":754592160,"statfs":{"total":773094113280,"available":772702371840,"internally_reserved":0,"allocated":12607488,"data_stored":6465768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":378981936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000608"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.071874+0000","last_change":"2024-04-25T08:50:01.071874+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.071874+0000","last_undegraded":"2024-04-25T08:50:01.071874+0000","last_fullsized":"2024-04-25T08:50:01.071874+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.068948+0000","last_change":"2024-04-25T08:50:01.068948+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.068948+0000","last_undegraded":"2024-04-25T08:50:01.068948+0000","last_fullsized":"2024-04-25T08:50:01.068948+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.071077+0000","last_change":"2024-04-25T08:50:01.071077+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.071077+0000","last_undegraded":"2024-04-25T08:50:01.071077+0000","last_fullsized":"2024-04-25T08:50:01.071077+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.068405+0000","last_change":"2024-04-25T08:50:01.068405+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.068405+0000","last_undegraded":"2024-04-25T08:50:01.068405+0000","last_fullsized":"2024-04-25T08:50:01.068405+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.068554+0000","last_change":"2024-04-25T08:50:01.068554+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.068554+0000","last_undegraded":"2024-04-25T08:50:01.068554+0000","last_fullsized":"2024-04-25T08:50:01.068554+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.068251+0000","last_change":"2024-04-25T08:50:01.068251+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.068251+0000","last_undegraded":"2024-04-25T08:50:01.068251+0000","last_fullsized":"2024-04-25T08:50:01.068251+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.069343+0000","last_change":"2024-04-25T08:50:01.069343+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.069343+0000","last_undegraded":"2024-04-25T08:50:01.069343+0000","last_fullsized":"2024-04-25T08:50:01.069343+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.071352+0000","last_change":"2024-04-25T08:50:01.071352+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.071352+0000","last_undegraded":"2024-04-25T08:50:01.071352+0000","last_fullsized":"2024-04-25T08:50:01.071352+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.071600+0000","last_change":"2024-04-25T08:50:01.071600+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.071600+0000","last_undegraded":"2024-04-25T08:50:01.071600+0000","last_fullsized":"2024-04-25T08:50:01.071600+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":116,"state":"creating+peering","last_fresh":"2024-04-25T08:50:01.068483+0000","last_change":"2024-04-25T08:50:01.068483+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.068483+0000","last_undegraded":"2024-04-25T08:50:01.068483+0000","last_fullsized":"2024-04-25T08:50:01.068483+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:02.059665+0000","last_change":"2024-04-25T08:50:02.059665+0000","last_active":"2024-04-25T08:50:02.059665+0000","last_peered":"2024-04-25T08:50:02.059665+0000","last_clean":"2024-04-25T08:50:02.059665+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:02.059665+0000","last_undegraded":"2024-04-25T08:50:02.059665+0000","last_fullsized":"2024-04-25T08:50:02.059665+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:01.052421+0000","last_change":"2024-04-25T08:50:01.052421+0000","last_active":"2024-04-25T08:50:01.052421+0000","last_peered":"2024-04-25T08:50:01.052421+0000","last_clean":"2024-04-25T08:50:01.052421+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:01.052421+0000","last_undegraded":"2024-04-25T08:50:01.052421+0000","last_fullsized":"2024-04-25T08:50:01.052421+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":345,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T08:50:01.069968+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:50:01.069968+0000","last_peered":"2024-04-25T08:50:01.069968+0000","last_clean":"2024-04-25T08:50:01.069968+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:50:01.069968+0000","last_undegraded":"2024-04-25T08:50:01.069968+0000","last_fullsized":"2024-04-25T08:50:01.069968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41496,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330344,"statfs":{"total":96636764160,"available":96594272256,"internally_reserved":0,"allocated":2039808,"data_stored":1259801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46484,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325356,"statfs":{"total":96636764160,"available":96589164544,"internally_reserved":0,"allocated":1445888,"data_stored":669433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45076,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326764,"statfs":{"total":96636764160,"available":96590606336,"internally_reserved":0,"allocated":1433600,"data_stored":663224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50644,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321196,"statfs":{"total":96636764160,"available":96584904704,"internally_reserved":0,"allocated":1433600,"data_stored":663224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50628,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321212,"statfs":{"total":96636764160,"available":96584921088,"internally_reserved":0,"allocated":1433600,"data_stored":663224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50628,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321212,"statfs":{"total":96636764160,"available":96584921088,"internally_reserved":0,"allocated":1433600,"data_stored":663224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46456,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325384,"statfs":{"total":96636764160,"available":96589193216,"internally_reserved":0,"allocated":1421312,"data_stored":657705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51148,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320692,"statfs":{"total":96636764160,"available":96584388608,"internally_reserved":0,"allocated":1966080,"data_stored":1225933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:50:06.373 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:50:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.515+0000 7fb9f746b640 1 Processor -- start 2024-04-25T08:50:06.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.516+0000 7fb9f746b640 1 -- start start 2024-04-25T08:50:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.516+0000 7fb9f746b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb9f015dd80 0x7fb9f015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.516+0000 7fb9f746b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb9f0161800 0x7fb9f006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.516+0000 7fb9f746b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f006cd30 con 0x7fb9f006c920 2024-04-25T08:50:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.516+0000 7fb9f746b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f015e6a0 con 0x7fb9f0161800 2024-04-25T08:50:06.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.516+0000 7fb9f746b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f00cfaf0 con 0x7fb9f015dd80 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.517+0000 7fb9f4a06640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb9f0161800 0x7fb9f006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.517+0000 7fb9f4a06640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb9f0161800 0x7fb9f006c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47210/0 (socket says 172.21.15.172:47210) 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.517+0000 7fb9f4a06640 1 -- 172.21.15.172:0/3821255236 learned_addr learned my addr 172.21.15.172:0/3821255236 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.517+0000 7fb9f5207640 1 --2- 172.21.15.172:0/3821255236 >> v2:172.21.15.186:3300/0 conn(0x7fb9f015dd80 0x7fb9f015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.517+0000 7fb9f4a06640 1 -- 172.21.15.172:0/3821255236 >> v2:172.21.15.186:3300/0 conn(0x7fb9f015dd80 msgr2=0x7fb9f015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.517+0000 7fb9f4a06640 1 --2- 172.21.15.172:0/3821255236 >> v2:172.21.15.186:3300/0 conn(0x7fb9f015dd80 0x7fb9f015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.517+0000 7fb9f4a06640 1 -- 172.21.15.172:0/3821255236 >> v1:172.21.15.186:6789/0 conn(0x7fb9f006c920 legacy=0x7fb9f0099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.517+0000 7fb9f4a06640 1 -- 172.21.15.172:0/3821255236 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f015e8e0 con 0x7fb9f0161800 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9f4a06640 1 --2- 172.21.15.172:0/3821255236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 0x7fb9f006c3e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0072ae0 tx=0x7fb9e402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe0adeeaff70a38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9effff640 1 -- 172.21.15.172:0/3821255236 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4037070 con 0x7fb9f0161800 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9effff640 1 -- 172.21.15.172:0/3821255236 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e4032440 con 0x7fb9f0161800 2024-04-25T08:50:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9effff640 1 -- 172.21.15.172:0/3821255236 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4032810 con 0x7fb9f0161800 2024-04-25T08:50:06.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9f746b640 1 -- 172.21.15.172:0/3821255236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 msgr2=0x7fb9f006c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9f746b640 1 --2- 172.21.15.172:0/3821255236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 0x7fb9f006c3e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0072ae0 tx=0x7fb9e402a230 comp rx=0 tx=0).stop 2024-04-25T08:50:06.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9f746b640 1 -- 172.21.15.172:0/3821255236 shutdown_connections 2024-04-25T08:50:06.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9f746b640 1 --2- 172.21.15.172:0/3821255236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 0x7fb9f006c3e0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9f746b640 1 --2- 172.21.15.172:0/3821255236 >> v2:172.21.15.186:3300/0 conn(0x7fb9f015dd80 0x7fb9f015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9f746b640 1 -- 172.21.15.172:0/3821255236 >> 172.21.15.172:0/3821255236 conn(0x7fb9f00b3310 msgr2=0x7fb9f00b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:06.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9f746b640 1 -- 172.21.15.172:0/3821255236 shutdown_connections 2024-04-25T08:50:06.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.518+0000 7fb9f746b640 1 -- 172.21.15.172:0/3821255236 wait complete. 2024-04-25T08:50:06.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.519+0000 7fb9f746b640 1 Processor -- start 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f746b640 1 -- start start 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f746b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9f006c920 0x7fb9f015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f746b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f015dd80 0x7fb9f00c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f746b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 0x7fb9f0155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f746b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f015f180 con 0x7fb9f0161800 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f746b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f015eea0 con 0x7fb9f006c920 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f746b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f006c0c0 con 0x7fb9f015dd80 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f5a08640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 0x7fb9f0155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f5a08640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 0x7fb9f0155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47220/0 (socket says 172.21.15.172:47220) 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f5a08640 1 -- 172.21.15.172:0/3120632830 learned_addr learned my addr 172.21.15.172:0/3120632830 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f5207640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9f006c920 0x7fb9f015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.520+0000 7fb9f4a06640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f015dd80 0x7fb9f00c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9f5a08640 1 -- 172.21.15.172:0/3120632830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f015dd80 msgr2=0x7fb9f00c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9f5a08640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f015dd80 0x7fb9f00c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9f5a08640 1 -- 172.21.15.172:0/3120632830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9f006c920 msgr2=0x7fb9f015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9f5a08640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9f006c920 0x7fb9f015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9f5a08640 1 -- 172.21.15.172:0/3120632830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f00c5ef0 con 0x7fb9f0161800 2024-04-25T08:50:06.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9f5a08640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 0x7fb9f0155b40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800b410 tx=0x7fb9e800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:06.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9edffb640 1 -- 172.21.15.172:0/3120632830 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8015030 con 0x7fb9f0161800 2024-04-25T08:50:06.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9edffb640 1 -- 172.21.15.172:0/3120632830 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8004020 con 0x7fb9f0161800 2024-04-25T08:50:06.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9f746b640 1 -- 172.21.15.172:0/3120632830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f00c8200 con 0x7fb9f0161800 2024-04-25T08:50:06.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9edffb640 1 -- 172.21.15.172:0/3120632830 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8004410 con 0x7fb9f0161800 2024-04-25T08:50:06.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.521+0000 7fb9f746b640 1 -- 172.21.15.172:0/3120632830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f015afe0 con 0x7fb9f0161800 2024-04-25T08:50:06.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.522+0000 7fb9f746b640 1 -- 172.21.15.172:0/3120632830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f0073990 con 0x7fb9f0161800 2024-04-25T08:50:06.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.523+0000 7fb9edffb640 1 -- 172.21.15.172:0/3120632830 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9e8018070 con 0x7fb9f0161800 2024-04-25T08:50:06.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.523+0000 7fb9edffb640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 0x7fb9dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.523+0000 7fb9edffb640 1 -- 172.21.15.172:0/3120632830 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb9e8089cc0 con 0x7fb9f0161800 2024-04-25T08:50:06.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.523+0000 7fb9f5207640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 0x7fb9dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.523+0000 7fb9f5207640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 0x7fb9dc06d990 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb9f01f5120 tx=0x7fb9e0009830 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:06.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.527+0000 7fb9edffb640 1 -- 172.21.15.172:0/3120632830 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9e8058360 con 0x7fb9f0161800 2024-04-25T08:50:06.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.697+0000 7fb9f746b640 1 -- 172.21.15.172:0/3120632830 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9f00b77a0 con 0x7fb9dc06b4d0 2024-04-25T08:50:06.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.703+0000 7fb9edffb640 1 -- 172.21.15.172:0/3120632830 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252487 (secure 0 0 0) 0x7fb9f00b77a0 con 0x7fb9dc06b4d0 2024-04-25T08:50:06.696 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:06.698 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:50:06.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 -- 172.21.15.172:0/3120632830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 msgr2=0x7fb9dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 0x7fb9dc06d990 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb9f01f5120 tx=0x7fb9e0009830 comp rx=0 tx=0).stop 2024-04-25T08:50:06.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 -- 172.21.15.172:0/3120632830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 msgr2=0x7fb9f0155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 0x7fb9f0155b40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800b410 tx=0x7fb9e800b8d0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 -- 172.21.15.172:0/3120632830 shutdown_connections 2024-04-25T08:50:06.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb9dc06b4d0 0x7fb9dc06d990 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9f0161800 0x7fb9f0155b40 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9f015dd80 0x7fb9f00c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 --2- 172.21.15.172:0/3120632830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9f006c920 0x7fb9f015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 -- 172.21.15.172:0/3120632830 >> 172.21.15.172:0/3120632830 conn(0x7fb9f00b3310 msgr2=0x7fb9f00cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:06.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 -- 172.21.15.172:0/3120632830 shutdown_connections 2024-04-25T08:50:06.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.706+0000 7fb9f746b640 1 -- 172.21.15.172:0/3120632830 wait complete. 2024-04-25T08:50:06.708 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-04-25T08:50:06.606095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":383052,"kb_used_data":12808,"kb_used_omap":12,"kb_used_meta":370099,"kb_avail":754591668,"statfs":{"total":773094113280,"available":772701868032,"internally_reserved":0,"allocated":13115392,"data_stored":6705228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":378981936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.543682"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.665073+0000","last_change":"2024-04-25T08:50:03.083394+0000","last_active":"2024-04-25T08:50:04.665073+0000","last_peered":"2024-04-25T08:50:04.665073+0000","last_clean":"2024-04-25T08:50:04.665073+0000","last_became_active":"2024-04-25T08:50:03.082959+0000","last_became_peered":"2024-04-25T08:50:03.082959+0000","last_unstale":"2024-04-25T08:50:04.665073+0000","last_undegraded":"2024-04-25T08:50:04.665073+0000","last_fullsized":"2024-04-25T08:50:04.665073+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:58.831107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663832+0000","last_change":"2024-04-25T08:50:03.091178+0000","last_active":"2024-04-25T08:50:04.663832+0000","last_peered":"2024-04-25T08:50:04.663832+0000","last_clean":"2024-04-25T08:50:04.663832+0000","last_became_active":"2024-04-25T08:50:03.090753+0000","last_became_peered":"2024-04-25T08:50:03.090753+0000","last_unstale":"2024-04-25T08:50:04.663832+0000","last_undegraded":"2024-04-25T08:50:04.663832+0000","last_fullsized":"2024-04-25T08:50:04.663832+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:31.567873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663788+0000","last_change":"2024-04-25T08:50:03.104539+0000","last_active":"2024-04-25T08:50:04.663788+0000","last_peered":"2024-04-25T08:50:04.663788+0000","last_clean":"2024-04-25T08:50:04.663788+0000","last_became_active":"2024-04-25T08:50:03.103082+0000","last_became_peered":"2024-04-25T08:50:03.103082+0000","last_unstale":"2024-04-25T08:50:04.663788+0000","last_undegraded":"2024-04-25T08:50:04.663788+0000","last_fullsized":"2024-04-25T08:50:04.663788+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:52.046203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664542+0000","last_change":"2024-04-25T08:50:03.096493+0000","last_active":"2024-04-25T08:50:04.664542+0000","last_peered":"2024-04-25T08:50:04.664542+0000","last_clean":"2024-04-25T08:50:04.664542+0000","last_became_active":"2024-04-25T08:50:03.096228+0000","last_became_peered":"2024-04-25T08:50:03.096228+0000","last_unstale":"2024-04-25T08:50:04.664542+0000","last_undegraded":"2024-04-25T08:50:04.664542+0000","last_fullsized":"2024-04-25T08:50:04.664542+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:51.195877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664214+0000","last_change":"2024-04-25T08:50:03.093743+0000","last_active":"2024-04-25T08:50:04.664214+0000","last_peered":"2024-04-25T08:50:04.664214+0000","last_clean":"2024-04-25T08:50:04.664214+0000","last_became_active":"2024-04-25T08:50:03.093465+0000","last_became_peered":"2024-04-25T08:50:03.093465+0000","last_unstale":"2024-04-25T08:50:04.664214+0000","last_undegraded":"2024-04-25T08:50:04.664214+0000","last_fullsized":"2024-04-25T08:50:04.664214+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.610170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663949+0000","last_change":"2024-04-25T08:50:03.094410+0000","last_active":"2024-04-25T08:50:04.663949+0000","last_peered":"2024-04-25T08:50:04.663949+0000","last_clean":"2024-04-25T08:50:04.663949+0000","last_became_active":"2024-04-25T08:50:03.094167+0000","last_became_peered":"2024-04-25T08:50:03.094167+0000","last_unstale":"2024-04-25T08:50:04.663949+0000","last_undegraded":"2024-04-25T08:50:04.663949+0000","last_fullsized":"2024-04-25T08:50:04.663949+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.993765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663485+0000","last_change":"2024-04-25T08:50:03.092324+0000","last_active":"2024-04-25T08:50:04.663485+0000","last_peered":"2024-04-25T08:50:04.663485+0000","last_clean":"2024-04-25T08:50:04.663485+0000","last_became_active":"2024-04-25T08:50:03.092067+0000","last_became_peered":"2024-04-25T08:50:03.092067+0000","last_unstale":"2024-04-25T08:50:04.663485+0000","last_undegraded":"2024-04-25T08:50:04.663485+0000","last_fullsized":"2024-04-25T08:50:04.663485+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:10.493062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663308+0000","last_change":"2024-04-25T08:50:03.093041+0000","last_active":"2024-04-25T08:50:04.663308+0000","last_peered":"2024-04-25T08:50:04.663308+0000","last_clean":"2024-04-25T08:50:04.663308+0000","last_became_active":"2024-04-25T08:50:03.092794+0000","last_became_peered":"2024-04-25T08:50:03.092794+0000","last_unstale":"2024-04-25T08:50:04.663308+0000","last_undegraded":"2024-04-25T08:50:04.663308+0000","last_fullsized":"2024-04-25T08:50:04.663308+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:59.462552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664749+0000","last_change":"2024-04-25T08:50:03.102503+0000","last_active":"2024-04-25T08:50:04.664749+0000","last_peered":"2024-04-25T08:50:04.664749+0000","last_clean":"2024-04-25T08:50:04.664749+0000","last_became_active":"2024-04-25T08:50:03.102212+0000","last_became_peered":"2024-04-25T08:50:03.102212+0000","last_unstale":"2024-04-25T08:50:04.664749+0000","last_undegraded":"2024-04-25T08:50:04.664749+0000","last_fullsized":"2024-04-25T08:50:04.664749+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:05.072692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162995+0000","last_change":"2024-04-25T08:50:03.091219+0000","last_active":"2024-04-25T08:50:04.162995+0000","last_peered":"2024-04-25T08:50:04.162995+0000","last_clean":"2024-04-25T08:50:04.162995+0000","last_became_active":"2024-04-25T08:50:03.090968+0000","last_became_peered":"2024-04-25T08:50:03.090968+0000","last_unstale":"2024-04-25T08:50:04.162995+0000","last_undegraded":"2024-04-25T08:50:04.162995+0000","last_fullsized":"2024-04-25T08:50:04.162995+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:10.545318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664906+0000","last_change":"2024-04-25T08:50:03.089015+0000","last_active":"2024-04-25T08:50:04.664906+0000","last_peered":"2024-04-25T08:50:04.664906+0000","last_clean":"2024-04-25T08:50:04.664906+0000","last_became_active":"2024-04-25T08:50:03.088752+0000","last_became_peered":"2024-04-25T08:50:03.088752+0000","last_unstale":"2024-04-25T08:50:04.664906+0000","last_undegraded":"2024-04-25T08:50:04.664906+0000","last_fullsized":"2024-04-25T08:50:04.664906+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:34.320207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663699+0000","last_change":"2024-04-25T08:50:03.093214+0000","last_active":"2024-04-25T08:50:04.663699+0000","last_peered":"2024-04-25T08:50:04.663699+0000","last_clean":"2024-04-25T08:50:04.663699+0000","last_became_active":"2024-04-25T08:50:03.092604+0000","last_became_peered":"2024-04-25T08:50:03.092604+0000","last_unstale":"2024-04-25T08:50:04.663699+0000","last_undegraded":"2024-04-25T08:50:04.663699+0000","last_fullsized":"2024-04-25T08:50:04.663699+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:51.099025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162992+0000","last_change":"2024-04-25T08:50:03.084703+0000","last_active":"2024-04-25T08:50:04.162992+0000","last_peered":"2024-04-25T08:50:04.162992+0000","last_clean":"2024-04-25T08:50:04.162992+0000","last_became_active":"2024-04-25T08:50:03.084443+0000","last_became_peered":"2024-04-25T08:50:03.084443+0000","last_unstale":"2024-04-25T08:50:04.162992+0000","last_undegraded":"2024-04-25T08:50:04.162992+0000","last_fullsized":"2024-04-25T08:50:04.162992+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.610170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663787+0000","last_change":"2024-04-25T08:50:03.104218+0000","last_active":"2024-04-25T08:50:04.663787+0000","last_peered":"2024-04-25T08:50:04.663787+0000","last_clean":"2024-04-25T08:50:04.663787+0000","last_became_active":"2024-04-25T08:50:03.103862+0000","last_became_peered":"2024-04-25T08:50:03.103862+0000","last_unstale":"2024-04-25T08:50:04.663787+0000","last_undegraded":"2024-04-25T08:50:04.663787+0000","last_fullsized":"2024-04-25T08:50:04.663787+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:23.630924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664512+0000","last_change":"2024-04-25T08:50:03.085655+0000","last_active":"2024-04-25T08:50:04.664512+0000","last_peered":"2024-04-25T08:50:04.664512+0000","last_clean":"2024-04-25T08:50:04.664512+0000","last_became_active":"2024-04-25T08:50:03.085389+0000","last_became_peered":"2024-04-25T08:50:03.085389+0000","last_unstale":"2024-04-25T08:50:04.664512+0000","last_undegraded":"2024-04-25T08:50:04.664512+0000","last_fullsized":"2024-04-25T08:50:04.664512+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:20.612457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664247+0000","last_change":"2024-04-25T08:50:03.097964+0000","last_active":"2024-04-25T08:50:04.664247+0000","last_peered":"2024-04-25T08:50:04.664247+0000","last_clean":"2024-04-25T08:50:04.664247+0000","last_became_active":"2024-04-25T08:50:03.097718+0000","last_became_peered":"2024-04-25T08:50:03.097718+0000","last_unstale":"2024-04-25T08:50:04.664247+0000","last_undegraded":"2024-04-25T08:50:04.664247+0000","last_fullsized":"2024-04-25T08:50:04.664247+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:22.583129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162994+0000","last_change":"2024-04-25T08:50:03.084017+0000","last_active":"2024-04-25T08:50:04.162994+0000","last_peered":"2024-04-25T08:50:04.162994+0000","last_clean":"2024-04-25T08:50:04.162994+0000","last_became_active":"2024-04-25T08:50:03.083722+0000","last_became_peered":"2024-04-25T08:50:03.083722+0000","last_unstale":"2024-04-25T08:50:04.162994+0000","last_undegraded":"2024-04-25T08:50:04.162994+0000","last_fullsized":"2024-04-25T08:50:04.162994+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:34.320207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663975+0000","last_change":"2024-04-25T08:50:03.090979+0000","last_active":"2024-04-25T08:50:04.663975+0000","last_peered":"2024-04-25T08:50:04.663975+0000","last_clean":"2024-04-25T08:50:04.663975+0000","last_became_active":"2024-04-25T08:50:03.090444+0000","last_became_peered":"2024-04-25T08:50:03.090444+0000","last_unstale":"2024-04-25T08:50:04.663975+0000","last_undegraded":"2024-04-25T08:50:04.663975+0000","last_fullsized":"2024-04-25T08:50:04.663975+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:39.167233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080182+0000","last_change":"2024-04-25T08:50:03.098905+0000","last_active":"2024-04-25T08:50:04.080182+0000","last_peered":"2024-04-25T08:50:04.080182+0000","last_clean":"2024-04-25T08:50:04.080182+0000","last_became_active":"2024-04-25T08:50:03.097870+0000","last_became_peered":"2024-04-25T08:50:03.097870+0000","last_unstale":"2024-04-25T08:50:04.080182+0000","last_undegraded":"2024-04-25T08:50:04.080182+0000","last_fullsized":"2024-04-25T08:50:04.080182+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.610170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078264+0000","last_change":"2024-04-25T08:50:03.091722+0000","last_active":"2024-04-25T08:50:04.078264+0000","last_peered":"2024-04-25T08:50:04.078264+0000","last_clean":"2024-04-25T08:50:04.078264+0000","last_became_active":"2024-04-25T08:50:03.091429+0000","last_became_peered":"2024-04-25T08:50:03.091429+0000","last_unstale":"2024-04-25T08:50:04.078264+0000","last_undegraded":"2024-04-25T08:50:04.078264+0000","last_fullsized":"2024-04-25T08:50:04.078264+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:22.146869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664797+0000","last_change":"2024-04-25T08:50:03.094022+0000","last_active":"2024-04-25T08:50:04.664797+0000","last_peered":"2024-04-25T08:50:04.664797+0000","last_clean":"2024-04-25T08:50:04.664797+0000","last_became_active":"2024-04-25T08:50:03.093658+0000","last_became_peered":"2024-04-25T08:50:03.093658+0000","last_unstale":"2024-04-25T08:50:04.664797+0000","last_undegraded":"2024-04-25T08:50:04.664797+0000","last_fullsized":"2024-04-25T08:50:04.664797+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.471582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664456+0000","last_change":"2024-04-25T08:50:03.093892+0000","last_active":"2024-04-25T08:50:04.664456+0000","last_peered":"2024-04-25T08:50:04.664456+0000","last_clean":"2024-04-25T08:50:04.664456+0000","last_became_active":"2024-04-25T08:50:03.093593+0000","last_became_peered":"2024-04-25T08:50:03.093593+0000","last_unstale":"2024-04-25T08:50:04.664456+0000","last_undegraded":"2024-04-25T08:50:04.664456+0000","last_fullsized":"2024-04-25T08:50:04.664456+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:10.545318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664515+0000","last_change":"2024-04-25T08:50:03.095532+0000","last_active":"2024-04-25T08:50:04.664515+0000","last_peered":"2024-04-25T08:50:04.664515+0000","last_clean":"2024-04-25T08:50:04.664515+0000","last_became_active":"2024-04-25T08:50:03.095270+0000","last_became_peered":"2024-04-25T08:50:03.095270+0000","last_unstale":"2024-04-25T08:50:04.664515+0000","last_undegraded":"2024-04-25T08:50:04.664515+0000","last_fullsized":"2024-04-25T08:50:04.664515+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:03.882075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079493+0000","last_change":"2024-04-25T08:50:03.097656+0000","last_active":"2024-04-25T08:50:04.079493+0000","last_peered":"2024-04-25T08:50:04.079493+0000","last_clean":"2024-04-25T08:50:04.079493+0000","last_became_active":"2024-04-25T08:50:03.097370+0000","last_became_peered":"2024-04-25T08:50:03.097370+0000","last_unstale":"2024-04-25T08:50:04.079493+0000","last_undegraded":"2024-04-25T08:50:04.079493+0000","last_fullsized":"2024-04-25T08:50:04.079493+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:51.195877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080279+0000","last_change":"2024-04-25T08:50:03.085479+0000","last_active":"2024-04-25T08:50:04.080279+0000","last_peered":"2024-04-25T08:50:04.080279+0000","last_clean":"2024-04-25T08:50:04.080279+0000","last_became_active":"2024-04-25T08:50:03.084775+0000","last_became_peered":"2024-04-25T08:50:03.084775+0000","last_unstale":"2024-04-25T08:50:04.080279+0000","last_undegraded":"2024-04-25T08:50:04.080279+0000","last_fullsized":"2024-04-25T08:50:04.080279+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:45.686350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078284+0000","last_change":"2024-04-25T08:50:03.086479+0000","last_active":"2024-04-25T08:50:04.078284+0000","last_peered":"2024-04-25T08:50:04.078284+0000","last_clean":"2024-04-25T08:50:04.078284+0000","last_became_active":"2024-04-25T08:50:03.086139+0000","last_became_peered":"2024-04-25T08:50:03.086139+0000","last_unstale":"2024-04-25T08:50:04.078284+0000","last_undegraded":"2024-04-25T08:50:04.078284+0000","last_fullsized":"2024-04-25T08:50:04.078284+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.085411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080397+0000","last_change":"2024-04-25T08:50:03.097450+0000","last_active":"2024-04-25T08:50:04.080397+0000","last_peered":"2024-04-25T08:50:04.080397+0000","last_clean":"2024-04-25T08:50:04.080397+0000","last_became_active":"2024-04-25T08:50:03.096608+0000","last_became_peered":"2024-04-25T08:50:03.096608+0000","last_unstale":"2024-04-25T08:50:04.080397+0000","last_undegraded":"2024-04-25T08:50:04.080397+0000","last_fullsized":"2024-04-25T08:50:04.080397+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:10.545318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663832+0000","last_change":"2024-04-25T08:50:03.097012+0000","last_active":"2024-04-25T08:50:04.663832+0000","last_peered":"2024-04-25T08:50:04.663832+0000","last_clean":"2024-04-25T08:50:04.663832+0000","last_became_active":"2024-04-25T08:50:03.096769+0000","last_became_peered":"2024-04-25T08:50:03.096769+0000","last_unstale":"2024-04-25T08:50:04.663832+0000","last_undegraded":"2024-04-25T08:50:04.663832+0000","last_fullsized":"2024-04-25T08:50:04.663832+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:19.681019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078434+0000","last_change":"2024-04-25T08:50:03.088413+0000","last_active":"2024-04-25T08:50:04.078434+0000","last_peered":"2024-04-25T08:50:04.078434+0000","last_clean":"2024-04-25T08:50:04.078434+0000","last_became_active":"2024-04-25T08:50:03.087922+0000","last_became_peered":"2024-04-25T08:50:03.087922+0000","last_unstale":"2024-04-25T08:50:04.078434+0000","last_undegraded":"2024-04-25T08:50:04.078434+0000","last_fullsized":"2024-04-25T08:50:04.078434+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:41.935890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664001+0000","last_change":"2024-04-25T08:50:03.093647+0000","last_active":"2024-04-25T08:50:04.664001+0000","last_peered":"2024-04-25T08:50:04.664001+0000","last_clean":"2024-04-25T08:50:04.664001+0000","last_became_active":"2024-04-25T08:50:03.093390+0000","last_became_peered":"2024-04-25T08:50:03.093390+0000","last_unstale":"2024-04-25T08:50:04.664001+0000","last_undegraded":"2024-04-25T08:50:04.664001+0000","last_fullsized":"2024-04-25T08:50:04.664001+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:10.599016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080688+0000","last_change":"2024-04-25T08:50:03.084656+0000","last_active":"2024-04-25T08:50:04.080688+0000","last_peered":"2024-04-25T08:50:04.080688+0000","last_clean":"2024-04-25T08:50:04.080688+0000","last_became_active":"2024-04-25T08:50:03.084238+0000","last_became_peered":"2024-04-25T08:50:03.084238+0000","last_unstale":"2024-04-25T08:50:04.080688+0000","last_undegraded":"2024-04-25T08:50:04.080688+0000","last_fullsized":"2024-04-25T08:50:04.080688+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:34.456782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079656+0000","last_change":"2024-04-25T08:50:03.094209+0000","last_active":"2024-04-25T08:50:04.079656+0000","last_peered":"2024-04-25T08:50:04.079656+0000","last_clean":"2024-04-25T08:50:04.079656+0000","last_became_active":"2024-04-25T08:50:03.093083+0000","last_became_peered":"2024-04-25T08:50:03.093083+0000","last_unstale":"2024-04-25T08:50:04.079656+0000","last_undegraded":"2024-04-25T08:50:04.079656+0000","last_fullsized":"2024-04-25T08:50:04.079656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:34.032156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162886+0000","last_change":"2024-04-25T08:50:03.091412+0000","last_active":"2024-04-25T08:50:04.162886+0000","last_peered":"2024-04-25T08:50:04.162886+0000","last_clean":"2024-04-25T08:50:04.162886+0000","last_became_active":"2024-04-25T08:50:03.091180+0000","last_became_peered":"2024-04-25T08:50:03.091180+0000","last_unstale":"2024-04-25T08:50:04.162886+0000","last_undegraded":"2024-04-25T08:50:04.162886+0000","last_fullsized":"2024-04-25T08:50:04.162886+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.595974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"118'4","reported_seq":18,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079772+0000","last_change":"2024-04-25T08:50:02.081818+0000","last_active":"2024-04-25T08:50:04.079772+0000","last_peered":"2024-04-25T08:50:04.079772+0000","last_clean":"2024-04-25T08:50:04.079772+0000","last_became_active":"2024-04-25T08:50:02.081524+0000","last_became_peered":"2024-04-25T08:50:02.081524+0000","last_unstale":"2024-04-25T08:50:04.079772+0000","last_undegraded":"2024-04-25T08:50:04.079772+0000","last_fullsized":"2024-04-25T08:50:04.079772+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:28.415330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663849+0000","last_change":"2024-04-25T08:50:03.095481+0000","last_active":"2024-04-25T08:50:04.663849+0000","last_peered":"2024-04-25T08:50:04.663849+0000","last_clean":"2024-04-25T08:50:04.663849+0000","last_became_active":"2024-04-25T08:50:03.095086+0000","last_became_peered":"2024-04-25T08:50:03.095086+0000","last_unstale":"2024-04-25T08:50:04.663849+0000","last_undegraded":"2024-04-25T08:50:04.663849+0000","last_fullsized":"2024-04-25T08:50:04.663849+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:35.929862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163087+0000","last_change":"2024-04-25T08:50:02.077068+0000","last_active":"2024-04-25T08:50:04.163087+0000","last_peered":"2024-04-25T08:50:04.163087+0000","last_clean":"2024-04-25T08:50:04.163087+0000","last_became_active":"2024-04-25T08:50:02.076808+0000","last_became_peered":"2024-04-25T08:50:02.076808+0000","last_unstale":"2024-04-25T08:50:04.163087+0000","last_undegraded":"2024-04-25T08:50:04.163087+0000","last_fullsized":"2024-04-25T08:50:04.163087+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:02.243038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080290+0000","last_change":"2024-04-25T08:50:03.092884+0000","last_active":"2024-04-25T08:50:04.080290+0000","last_peered":"2024-04-25T08:50:04.080290+0000","last_clean":"2024-04-25T08:50:04.080290+0000","last_became_active":"2024-04-25T08:50:03.091122+0000","last_became_peered":"2024-04-25T08:50:03.091122+0000","last_unstale":"2024-04-25T08:50:04.080290+0000","last_undegraded":"2024-04-25T08:50:04.080290+0000","last_fullsized":"2024-04-25T08:50:04.080290+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.471582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664255+0000","last_change":"2024-04-25T08:50:02.083632+0000","last_active":"2024-04-25T08:50:04.664255+0000","last_peered":"2024-04-25T08:50:04.664255+0000","last_clean":"2024-04-25T08:50:04.664255+0000","last_became_active":"2024-04-25T08:50:02.083104+0000","last_became_peered":"2024-04-25T08:50:02.083104+0000","last_unstale":"2024-04-25T08:50:04.664255+0000","last_undegraded":"2024-04-25T08:50:04.664255+0000","last_fullsized":"2024-04-25T08:50:04.664255+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:09.538074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664842+0000","last_change":"2024-04-25T08:50:03.092131+0000","last_active":"2024-04-25T08:50:04.664842+0000","last_peered":"2024-04-25T08:50:04.664842+0000","last_clean":"2024-04-25T08:50:04.664842+0000","last_became_active":"2024-04-25T08:50:03.091833+0000","last_became_peered":"2024-04-25T08:50:03.091833+0000","last_unstale":"2024-04-25T08:50:04.664842+0000","last_undegraded":"2024-04-25T08:50:04.664842+0000","last_fullsized":"2024-04-25T08:50:04.664842+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:45.686350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162852+0000","last_change":"2024-04-25T08:50:02.082033+0000","last_active":"2024-04-25T08:50:04.162852+0000","last_peered":"2024-04-25T08:50:04.162852+0000","last_clean":"2024-04-25T08:50:04.162852+0000","last_became_active":"2024-04-25T08:50:02.081774+0000","last_became_peered":"2024-04-25T08:50:02.081774+0000","last_unstale":"2024-04-25T08:50:04.162852+0000","last_undegraded":"2024-04-25T08:50:04.162852+0000","last_fullsized":"2024-04-25T08:50:04.162852+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:58.356108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162747+0000","last_change":"2024-04-25T08:50:03.092711+0000","last_active":"2024-04-25T08:50:04.162747+0000","last_peered":"2024-04-25T08:50:04.162747+0000","last_clean":"2024-04-25T08:50:04.162747+0000","last_became_active":"2024-04-25T08:50:03.092474+0000","last_became_peered":"2024-04-25T08:50:03.092474+0000","last_unstale":"2024-04-25T08:50:04.162747+0000","last_undegraded":"2024-04-25T08:50:04.162747+0000","last_fullsized":"2024-04-25T08:50:04.162747+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:54.643336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664650+0000","last_change":"2024-04-25T08:50:02.074475+0000","last_active":"2024-04-25T08:50:04.664650+0000","last_peered":"2024-04-25T08:50:04.664650+0000","last_clean":"2024-04-25T08:50:04.664650+0000","last_became_active":"2024-04-25T08:50:02.074173+0000","last_became_peered":"2024-04-25T08:50:02.074173+0000","last_unstale":"2024-04-25T08:50:04.664650+0000","last_undegraded":"2024-04-25T08:50:04.664650+0000","last_fullsized":"2024-04-25T08:50:04.664650+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:28.415330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663991+0000","last_change":"2024-04-25T08:50:03.091258+0000","last_active":"2024-04-25T08:50:04.663991+0000","last_peered":"2024-04-25T08:50:04.663991+0000","last_clean":"2024-04-25T08:50:04.663991+0000","last_became_active":"2024-04-25T08:50:03.090867+0000","last_became_peered":"2024-04-25T08:50:03.090867+0000","last_unstale":"2024-04-25T08:50:04.663991+0000","last_undegraded":"2024-04-25T08:50:04.663991+0000","last_fullsized":"2024-04-25T08:50:04.663991+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.595974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663816+0000","last_change":"2024-04-25T08:50:02.085704+0000","last_active":"2024-04-25T08:50:04.663816+0000","last_peered":"2024-04-25T08:50:04.663816+0000","last_clean":"2024-04-25T08:50:04.663816+0000","last_became_active":"2024-04-25T08:50:02.085375+0000","last_became_peered":"2024-04-25T08:50:02.085375+0000","last_unstale":"2024-04-25T08:50:04.663816+0000","last_undegraded":"2024-04-25T08:50:04.663816+0000","last_fullsized":"2024-04-25T08:50:04.663816+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:25.593368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664128+0000","last_change":"2024-04-25T08:50:03.090480+0000","last_active":"2024-04-25T08:50:04.664128+0000","last_peered":"2024-04-25T08:50:04.664128+0000","last_clean":"2024-04-25T08:50:04.664128+0000","last_became_active":"2024-04-25T08:50:03.090217+0000","last_became_peered":"2024-04-25T08:50:03.090217+0000","last_unstale":"2024-04-25T08:50:04.664128+0000","last_undegraded":"2024-04-25T08:50:04.664128+0000","last_fullsized":"2024-04-25T08:50:04.664128+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:47.652886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080649+0000","last_change":"2024-04-25T08:50:02.073246+0000","last_active":"2024-04-25T08:50:04.080649+0000","last_peered":"2024-04-25T08:50:04.080649+0000","last_clean":"2024-04-25T08:50:04.080649+0000","last_became_active":"2024-04-25T08:50:02.072888+0000","last_became_peered":"2024-04-25T08:50:02.072888+0000","last_unstale":"2024-04-25T08:50:04.080649+0000","last_undegraded":"2024-04-25T08:50:04.080649+0000","last_fullsized":"2024-04-25T08:50:04.080649+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:09.538074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163159+0000","last_change":"2024-04-25T08:50:03.087901+0000","last_active":"2024-04-25T08:50:04.163159+0000","last_peered":"2024-04-25T08:50:04.163159+0000","last_clean":"2024-04-25T08:50:04.163159+0000","last_became_active":"2024-04-25T08:50:03.087647+0000","last_became_peered":"2024-04-25T08:50:03.087647+0000","last_unstale":"2024-04-25T08:50:04.163159+0000","last_undegraded":"2024-04-25T08:50:04.163159+0000","last_fullsized":"2024-04-25T08:50:04.163159+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:58.831107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663781+0000","last_change":"2024-04-25T08:50:02.082940+0000","last_active":"2024-04-25T08:50:04.663781+0000","last_peered":"2024-04-25T08:50:04.663781+0000","last_clean":"2024-04-25T08:50:04.663781+0000","last_became_active":"2024-04-25T08:50:02.082621+0000","last_became_peered":"2024-04-25T08:50:02.082621+0000","last_unstale":"2024-04-25T08:50:04.663781+0000","last_undegraded":"2024-04-25T08:50:04.663781+0000","last_fullsized":"2024-04-25T08:50:04.663781+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:42.849146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079668+0000","last_change":"2024-04-25T08:50:03.092892+0000","last_active":"2024-04-25T08:50:04.079668+0000","last_peered":"2024-04-25T08:50:04.079668+0000","last_clean":"2024-04-25T08:50:04.079668+0000","last_became_active":"2024-04-25T08:50:03.092437+0000","last_became_peered":"2024-04-25T08:50:03.092437+0000","last_unstale":"2024-04-25T08:50:04.079668+0000","last_undegraded":"2024-04-25T08:50:04.079668+0000","last_fullsized":"2024-04-25T08:50:04.079668+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.595974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079832+0000","last_change":"2024-04-25T08:50:02.077511+0000","last_active":"2024-04-25T08:50:04.079832+0000","last_peered":"2024-04-25T08:50:04.079832+0000","last_clean":"2024-04-25T08:50:04.079832+0000","last_became_active":"2024-04-25T08:50:02.077219+0000","last_became_peered":"2024-04-25T08:50:02.077219+0000","last_unstale":"2024-04-25T08:50:04.079832+0000","last_undegraded":"2024-04-25T08:50:04.079832+0000","last_fullsized":"2024-04-25T08:50:04.079832+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:21.732361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080718+0000","last_change":"2024-04-25T08:50:03.085507+0000","last_active":"2024-04-25T08:50:04.080718+0000","last_peered":"2024-04-25T08:50:04.080718+0000","last_clean":"2024-04-25T08:50:04.080718+0000","last_became_active":"2024-04-25T08:50:03.085189+0000","last_became_peered":"2024-04-25T08:50:03.085189+0000","last_unstale":"2024-04-25T08:50:04.080718+0000","last_undegraded":"2024-04-25T08:50:04.080718+0000","last_fullsized":"2024-04-25T08:50:04.080718+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:06.366290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080366+0000","last_change":"2024-04-25T08:50:02.076416+0000","last_active":"2024-04-25T08:50:04.080366+0000","last_peered":"2024-04-25T08:50:04.080366+0000","last_clean":"2024-04-25T08:50:04.080366+0000","last_became_active":"2024-04-25T08:50:02.076119+0000","last_became_peered":"2024-04-25T08:50:02.076119+0000","last_unstale":"2024-04-25T08:50:04.080366+0000","last_undegraded":"2024-04-25T08:50:04.080366+0000","last_fullsized":"2024-04-25T08:50:04.080366+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:32.281430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664055+0000","last_change":"2024-04-25T08:50:03.103615+0000","last_active":"2024-04-25T08:50:04.664055+0000","last_peered":"2024-04-25T08:50:04.664055+0000","last_clean":"2024-04-25T08:50:04.664055+0000","last_became_active":"2024-04-25T08:50:03.103306+0000","last_became_peered":"2024-04-25T08:50:03.103306+0000","last_unstale":"2024-04-25T08:50:04.664055+0000","last_undegraded":"2024-04-25T08:50:04.664055+0000","last_fullsized":"2024-04-25T08:50:04.664055+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:11.118378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"118'3","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080682+0000","last_change":"2024-04-25T08:50:02.076560+0000","last_active":"2024-04-25T08:50:04.080682+0000","last_peered":"2024-04-25T08:50:04.080682+0000","last_clean":"2024-04-25T08:50:04.080682+0000","last_became_active":"2024-04-25T08:50:02.076223+0000","last_became_peered":"2024-04-25T08:50:02.076223+0000","last_unstale":"2024-04-25T08:50:04.080682+0000","last_undegraded":"2024-04-25T08:50:04.080682+0000","last_fullsized":"2024-04-25T08:50:04.080682+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:33.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080520+0000","last_change":"2024-04-25T08:50:03.085192+0000","last_active":"2024-04-25T08:50:04.080520+0000","last_peered":"2024-04-25T08:50:04.080520+0000","last_clean":"2024-04-25T08:50:04.080520+0000","last_became_active":"2024-04-25T08:50:03.084418+0000","last_became_peered":"2024-04-25T08:50:03.084418+0000","last_unstale":"2024-04-25T08:50:04.080520+0000","last_undegraded":"2024-04-25T08:50:04.080520+0000","last_fullsized":"2024-04-25T08:50:04.080520+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:25.834512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"118'6","reported_seq":20,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663670+0000","last_change":"2024-04-25T08:50:02.078543+0000","last_active":"2024-04-25T08:50:04.663670+0000","last_peered":"2024-04-25T08:50:04.663670+0000","last_clean":"2024-04-25T08:50:04.663670+0000","last_became_active":"2024-04-25T08:50:02.078253+0000","last_became_peered":"2024-04-25T08:50:02.078253+0000","last_unstale":"2024-04-25T08:50:04.663670+0000","last_undegraded":"2024-04-25T08:50:04.663670+0000","last_fullsized":"2024-04-25T08:50:04.663670+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:05.277315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079923+0000","last_change":"2024-04-25T08:50:03.103835+0000","last_active":"2024-04-25T08:50:04.079923+0000","last_peered":"2024-04-25T08:50:04.079923+0000","last_clean":"2024-04-25T08:50:04.079923+0000","last_became_active":"2024-04-25T08:50:03.103532+0000","last_became_peered":"2024-04-25T08:50:03.103532+0000","last_unstale":"2024-04-25T08:50:04.079923+0000","last_undegraded":"2024-04-25T08:50:04.079923+0000","last_fullsized":"2024-04-25T08:50:04.079923+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:20.612457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664231+0000","last_change":"2024-04-25T08:50:02.083574+0000","last_active":"2024-04-25T08:50:04.664231+0000","last_peered":"2024-04-25T08:50:04.664231+0000","last_clean":"2024-04-25T08:50:04.664231+0000","last_became_active":"2024-04-25T08:50:02.083326+0000","last_became_peered":"2024-04-25T08:50:02.083326+0000","last_unstale":"2024-04-25T08:50:04.664231+0000","last_undegraded":"2024-04-25T08:50:04.664231+0000","last_fullsized":"2024-04-25T08:50:04.664231+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:59.293720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162827+0000","last_change":"2024-04-25T08:50:03.090014+0000","last_active":"2024-04-25T08:50:04.162827+0000","last_peered":"2024-04-25T08:50:04.162827+0000","last_clean":"2024-04-25T08:50:04.162827+0000","last_became_active":"2024-04-25T08:50:03.089739+0000","last_became_peered":"2024-04-25T08:50:03.089739+0000","last_unstale":"2024-04-25T08:50:04.162827+0000","last_undegraded":"2024-04-25T08:50:04.162827+0000","last_fullsized":"2024-04-25T08:50:04.162827+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:13.606209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664307+0000","last_change":"2024-04-25T08:50:02.079080+0000","last_active":"2024-04-25T08:50:04.664307+0000","last_peered":"2024-04-25T08:50:04.664307+0000","last_clean":"2024-04-25T08:50:04.664307+0000","last_became_active":"2024-04-25T08:50:02.078832+0000","last_became_peered":"2024-04-25T08:50:02.078832+0000","last_unstale":"2024-04-25T08:50:04.664307+0000","last_undegraded":"2024-04-25T08:50:04.664307+0000","last_fullsized":"2024-04-25T08:50:04.664307+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.721245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078247+0000","last_change":"2024-04-25T08:50:03.096069+0000","last_active":"2024-04-25T08:50:04.078247+0000","last_peered":"2024-04-25T08:50:04.078247+0000","last_clean":"2024-04-25T08:50:04.078247+0000","last_became_active":"2024-04-25T08:50:03.095806+0000","last_became_peered":"2024-04-25T08:50:03.095806+0000","last_unstale":"2024-04-25T08:50:04.078247+0000","last_undegraded":"2024-04-25T08:50:04.078247+0000","last_fullsized":"2024-04-25T08:50:04.078247+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:00.333557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663456+0000","last_change":"2024-04-25T08:50:02.072977+0000","last_active":"2024-04-25T08:50:04.663456+0000","last_peered":"2024-04-25T08:50:04.663456+0000","last_clean":"2024-04-25T08:50:04.663456+0000","last_became_active":"2024-04-25T08:50:02.072719+0000","last_became_peered":"2024-04-25T08:50:02.072719+0000","last_unstale":"2024-04-25T08:50:04.663456+0000","last_undegraded":"2024-04-25T08:50:04.663456+0000","last_fullsized":"2024-04-25T08:50:04.663456+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:08.461773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080145+0000","last_change":"2024-04-25T08:50:03.094607+0000","last_active":"2024-04-25T08:50:04.080145+0000","last_peered":"2024-04-25T08:50:04.080145+0000","last_clean":"2024-04-25T08:50:04.080145+0000","last_became_active":"2024-04-25T08:50:03.092900+0000","last_became_peered":"2024-04-25T08:50:03.092900+0000","last_unstale":"2024-04-25T08:50:04.080145+0000","last_undegraded":"2024-04-25T08:50:04.080145+0000","last_fullsized":"2024-04-25T08:50:04.080145+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:05.072692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163025+0000","last_change":"2024-04-25T08:50:02.079266+0000","last_active":"2024-04-25T08:50:04.163025+0000","last_peered":"2024-04-25T08:50:04.163025+0000","last_clean":"2024-04-25T08:50:04.163025+0000","last_became_active":"2024-04-25T08:50:02.078977+0000","last_became_peered":"2024-04-25T08:50:02.078977+0000","last_unstale":"2024-04-25T08:50:04.163025+0000","last_undegraded":"2024-04-25T08:50:04.163025+0000","last_fullsized":"2024-04-25T08:50:04.163025+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:14.855134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.665015+0000","last_change":"2024-04-25T08:50:03.084180+0000","last_active":"2024-04-25T08:50:04.665015+0000","last_peered":"2024-04-25T08:50:04.665015+0000","last_clean":"2024-04-25T08:50:04.665015+0000","last_became_active":"2024-04-25T08:50:03.083891+0000","last_became_peered":"2024-04-25T08:50:03.083891+0000","last_unstale":"2024-04-25T08:50:04.665015+0000","last_undegraded":"2024-04-25T08:50:04.665015+0000","last_fullsized":"2024-04-25T08:50:04.665015+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:33.288673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078385+0000","last_change":"2024-04-25T08:50:02.082798+0000","last_active":"2024-04-25T08:50:04.078385+0000","last_peered":"2024-04-25T08:50:04.078385+0000","last_clean":"2024-04-25T08:50:04.078385+0000","last_became_active":"2024-04-25T08:50:02.082560+0000","last_became_peered":"2024-04-25T08:50:02.082560+0000","last_unstale":"2024-04-25T08:50:04.078385+0000","last_undegraded":"2024-04-25T08:50:04.078385+0000","last_fullsized":"2024-04-25T08:50:04.078385+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:52.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663780+0000","last_change":"2024-04-25T08:50:03.100304+0000","last_active":"2024-04-25T08:50:04.663780+0000","last_peered":"2024-04-25T08:50:04.663780+0000","last_clean":"2024-04-25T08:50:04.663780+0000","last_became_active":"2024-04-25T08:50:03.100055+0000","last_became_peered":"2024-04-25T08:50:03.100055+0000","last_unstale":"2024-04-25T08:50:04.663780+0000","last_undegraded":"2024-04-25T08:50:04.663780+0000","last_fullsized":"2024-04-25T08:50:04.663780+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664314+0000","last_change":"2024-04-25T08:50:02.081703+0000","last_active":"2024-04-25T08:50:04.664314+0000","last_peered":"2024-04-25T08:50:04.664314+0000","last_clean":"2024-04-25T08:50:04.664314+0000","last_became_active":"2024-04-25T08:50:02.081328+0000","last_became_peered":"2024-04-25T08:50:02.081328+0000","last_unstale":"2024-04-25T08:50:04.664314+0000","last_undegraded":"2024-04-25T08:50:04.664314+0000","last_fullsized":"2024-04-25T08:50:04.664314+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:33.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080457+0000","last_change":"2024-04-25T08:50:03.088415+0000","last_active":"2024-04-25T08:50:04.080457+0000","last_peered":"2024-04-25T08:50:04.080457+0000","last_clean":"2024-04-25T08:50:04.080457+0000","last_became_active":"2024-04-25T08:50:03.087949+0000","last_became_peered":"2024-04-25T08:50:03.087949+0000","last_unstale":"2024-04-25T08:50:04.080457+0000","last_undegraded":"2024-04-25T08:50:04.080457+0000","last_fullsized":"2024-04-25T08:50:04.080457+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:04.537221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664248+0000","last_change":"2024-04-25T08:50:02.086426+0000","last_active":"2024-04-25T08:50:04.664248+0000","last_peered":"2024-04-25T08:50:04.664248+0000","last_clean":"2024-04-25T08:50:04.664248+0000","last_became_active":"2024-04-25T08:50:02.086059+0000","last_became_peered":"2024-04-25T08:50:02.086059+0000","last_unstale":"2024-04-25T08:50:04.664248+0000","last_undegraded":"2024-04-25T08:50:04.664248+0000","last_fullsized":"2024-04-25T08:50:04.664248+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:16.588730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663524+0000","last_change":"2024-04-25T08:50:03.096304+0000","last_active":"2024-04-25T08:50:04.663524+0000","last_peered":"2024-04-25T08:50:04.663524+0000","last_clean":"2024-04-25T08:50:04.663524+0000","last_became_active":"2024-04-25T08:50:03.096043+0000","last_became_peered":"2024-04-25T08:50:03.096043+0000","last_unstale":"2024-04-25T08:50:04.663524+0000","last_undegraded":"2024-04-25T08:50:04.663524+0000","last_fullsized":"2024-04-25T08:50:04.663524+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:46.407666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663336+0000","last_change":"2024-04-25T08:50:02.085212+0000","last_active":"2024-04-25T08:50:04.663336+0000","last_peered":"2024-04-25T08:50:04.663336+0000","last_clean":"2024-04-25T08:50:04.663336+0000","last_became_active":"2024-04-25T08:50:02.084943+0000","last_became_peered":"2024-04-25T08:50:02.084943+0000","last_unstale":"2024-04-25T08:50:04.663336+0000","last_undegraded":"2024-04-25T08:50:04.663336+0000","last_fullsized":"2024-04-25T08:50:04.663336+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:49.954755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663336+0000","last_change":"2024-04-25T08:50:03.085752+0000","last_active":"2024-04-25T08:50:04.663336+0000","last_peered":"2024-04-25T08:50:04.663336+0000","last_clean":"2024-04-25T08:50:04.663336+0000","last_became_active":"2024-04-25T08:50:03.085408+0000","last_became_peered":"2024-04-25T08:50:03.085408+0000","last_unstale":"2024-04-25T08:50:04.663336+0000","last_undegraded":"2024-04-25T08:50:04.663336+0000","last_fullsized":"2024-04-25T08:50:04.663336+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:20.021349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663953+0000","last_change":"2024-04-25T08:50:02.081268+0000","last_active":"2024-04-25T08:50:04.663953+0000","last_peered":"2024-04-25T08:50:04.663953+0000","last_clean":"2024-04-25T08:50:04.663953+0000","last_became_active":"2024-04-25T08:50:02.080964+0000","last_became_peered":"2024-04-25T08:50:02.080964+0000","last_unstale":"2024-04-25T08:50:04.663953+0000","last_undegraded":"2024-04-25T08:50:04.663953+0000","last_fullsized":"2024-04-25T08:50:04.663953+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:12.598965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664312+0000","last_change":"2024-04-25T08:50:03.100463+0000","last_active":"2024-04-25T08:50:04.664312+0000","last_peered":"2024-04-25T08:50:04.664312+0000","last_clean":"2024-04-25T08:50:04.664312+0000","last_became_active":"2024-04-25T08:50:03.100200+0000","last_became_peered":"2024-04-25T08:50:03.100200+0000","last_unstale":"2024-04-25T08:50:04.664312+0000","last_undegraded":"2024-04-25T08:50:04.664312+0000","last_fullsized":"2024-04-25T08:50:04.664312+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:42.859558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663537+0000","last_change":"2024-04-25T08:50:02.086635+0000","last_active":"2024-04-25T08:50:04.663537+0000","last_peered":"2024-04-25T08:50:04.663537+0000","last_clean":"2024-04-25T08:50:04.663537+0000","last_became_active":"2024-04-25T08:50:02.086331+0000","last_became_peered":"2024-04-25T08:50:02.086331+0000","last_unstale":"2024-04-25T08:50:04.663537+0000","last_undegraded":"2024-04-25T08:50:04.663537+0000","last_fullsized":"2024-04-25T08:50:04.663537+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:33.443820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080787+0000","last_change":"2024-04-25T08:50:03.087103+0000","last_active":"2024-04-25T08:50:04.080787+0000","last_peered":"2024-04-25T08:50:04.080787+0000","last_clean":"2024-04-25T08:50:04.080787+0000","last_became_active":"2024-04-25T08:50:03.086628+0000","last_became_peered":"2024-04-25T08:50:03.086628+0000","last_unstale":"2024-04-25T08:50:04.080787+0000","last_undegraded":"2024-04-25T08:50:04.080787+0000","last_fullsized":"2024-04-25T08:50:04.080787+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:33.073626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663796+0000","last_change":"2024-04-25T08:50:02.082717+0000","last_active":"2024-04-25T08:50:04.663796+0000","last_peered":"2024-04-25T08:50:04.663796+0000","last_clean":"2024-04-25T08:50:04.663796+0000","last_became_active":"2024-04-25T08:50:02.082396+0000","last_became_peered":"2024-04-25T08:50:02.082396+0000","last_unstale":"2024-04-25T08:50:04.663796+0000","last_undegraded":"2024-04-25T08:50:04.663796+0000","last_fullsized":"2024-04-25T08:50:04.663796+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:40.602926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664010+0000","last_change":"2024-04-25T08:50:03.089650+0000","last_active":"2024-04-25T08:50:04.664010+0000","last_peered":"2024-04-25T08:50:04.664010+0000","last_clean":"2024-04-25T08:50:04.664010+0000","last_became_active":"2024-04-25T08:50:03.089299+0000","last_became_peered":"2024-04-25T08:50:03.089299+0000","last_unstale":"2024-04-25T08:50:04.664010+0000","last_undegraded":"2024-04-25T08:50:04.664010+0000","last_fullsized":"2024-04-25T08:50:04.664010+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:48.677552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664170+0000","last_change":"2024-04-25T08:50:02.080295+0000","last_active":"2024-04-25T08:50:04.664170+0000","last_peered":"2024-04-25T08:50:04.664170+0000","last_clean":"2024-04-25T08:50:04.664170+0000","last_became_active":"2024-04-25T08:50:02.080040+0000","last_became_peered":"2024-04-25T08:50:02.080040+0000","last_unstale":"2024-04-25T08:50:04.664170+0000","last_undegraded":"2024-04-25T08:50:04.664170+0000","last_fullsized":"2024-04-25T08:50:04.664170+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:11.835185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162913+0000","last_change":"2024-04-25T08:50:03.098535+0000","last_active":"2024-04-25T08:50:04.162913+0000","last_peered":"2024-04-25T08:50:04.162913+0000","last_clean":"2024-04-25T08:50:04.162913+0000","last_became_active":"2024-04-25T08:50:03.098281+0000","last_became_peered":"2024-04-25T08:50:03.098281+0000","last_unstale":"2024-04-25T08:50:04.162913+0000","last_undegraded":"2024-04-25T08:50:04.162913+0000","last_fullsized":"2024-04-25T08:50:04.162913+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:20.612457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"119'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079815+0000","last_change":"2024-04-25T08:50:02.083438+0000","last_active":"2024-04-25T08:50:04.079815+0000","last_peered":"2024-04-25T08:50:04.079815+0000","last_clean":"2024-04-25T08:50:04.079815+0000","last_became_active":"2024-04-25T08:50:02.082990+0000","last_became_peered":"2024-04-25T08:50:02.082990+0000","last_unstale":"2024-04-25T08:50:04.079815+0000","last_undegraded":"2024-04-25T08:50:04.079815+0000","last_fullsized":"2024-04-25T08:50:04.079815+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:30.972003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664567+0000","last_change":"2024-04-25T08:50:03.096565+0000","last_active":"2024-04-25T08:50:04.664567+0000","last_peered":"2024-04-25T08:50:04.664567+0000","last_clean":"2024-04-25T08:50:04.664567+0000","last_became_active":"2024-04-25T08:50:03.096260+0000","last_became_peered":"2024-04-25T08:50:03.096260+0000","last_unstale":"2024-04-25T08:50:04.664567+0000","last_undegraded":"2024-04-25T08:50:04.664567+0000","last_fullsized":"2024-04-25T08:50:04.664567+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:34.032156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080243+0000","last_change":"2024-04-25T08:50:02.086504+0000","last_active":"2024-04-25T08:50:04.080243+0000","last_peered":"2024-04-25T08:50:04.080243+0000","last_clean":"2024-04-25T08:50:04.080243+0000","last_became_active":"2024-04-25T08:50:02.086170+0000","last_became_peered":"2024-04-25T08:50:02.086170+0000","last_unstale":"2024-04-25T08:50:04.080243+0000","last_undegraded":"2024-04-25T08:50:04.080243+0000","last_fullsized":"2024-04-25T08:50:04.080243+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:08.291556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078398+0000","last_change":"2024-04-25T08:50:03.086537+0000","last_active":"2024-04-25T08:50:04.078398+0000","last_peered":"2024-04-25T08:50:04.078398+0000","last_clean":"2024-04-25T08:50:04.078398+0000","last_became_active":"2024-04-25T08:50:03.086277+0000","last_became_peered":"2024-04-25T08:50:03.086277+0000","last_unstale":"2024-04-25T08:50:04.078398+0000","last_undegraded":"2024-04-25T08:50:04.078398+0000","last_fullsized":"2024-04-25T08:50:04.078398+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:32.514738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664092+0000","last_change":"2024-04-25T08:50:02.077343+0000","last_active":"2024-04-25T08:50:04.664092+0000","last_peered":"2024-04-25T08:50:04.664092+0000","last_clean":"2024-04-25T08:50:04.664092+0000","last_became_active":"2024-04-25T08:50:02.077099+0000","last_became_peered":"2024-04-25T08:50:02.077099+0000","last_unstale":"2024-04-25T08:50:04.664092+0000","last_undegraded":"2024-04-25T08:50:04.664092+0000","last_fullsized":"2024-04-25T08:50:04.664092+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:47.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663683+0000","last_change":"2024-04-25T08:50:03.095799+0000","last_active":"2024-04-25T08:50:04.663683+0000","last_peered":"2024-04-25T08:50:04.663683+0000","last_clean":"2024-04-25T08:50:04.663683+0000","last_became_active":"2024-04-25T08:50:03.095324+0000","last_became_peered":"2024-04-25T08:50:03.095324+0000","last_unstale":"2024-04-25T08:50:04.663683+0000","last_undegraded":"2024-04-25T08:50:04.663683+0000","last_fullsized":"2024-04-25T08:50:04.663683+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:25.353270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664473+0000","last_change":"2024-04-25T08:50:02.075038+0000","last_active":"2024-04-25T08:50:04.664473+0000","last_peered":"2024-04-25T08:50:04.664473+0000","last_clean":"2024-04-25T08:50:04.664473+0000","last_became_active":"2024-04-25T08:50:02.074730+0000","last_became_peered":"2024-04-25T08:50:02.074730+0000","last_unstale":"2024-04-25T08:50:04.664473+0000","last_undegraded":"2024-04-25T08:50:04.664473+0000","last_fullsized":"2024-04-25T08:50:04.664473+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:21.732361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664337+0000","last_change":"2024-04-25T08:50:03.093751+0000","last_active":"2024-04-25T08:50:04.664337+0000","last_peered":"2024-04-25T08:50:04.664337+0000","last_clean":"2024-04-25T08:50:04.664337+0000","last_became_active":"2024-04-25T08:50:03.093486+0000","last_became_peered":"2024-04-25T08:50:03.093486+0000","last_unstale":"2024-04-25T08:50:04.664337+0000","last_undegraded":"2024-04-25T08:50:04.664337+0000","last_fullsized":"2024-04-25T08:50:04.664337+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:42.347387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664583+0000","last_change":"2024-04-25T08:50:02.072807+0000","last_active":"2024-04-25T08:50:04.664583+0000","last_peered":"2024-04-25T08:50:04.664583+0000","last_clean":"2024-04-25T08:50:04.664583+0000","last_became_active":"2024-04-25T08:50:02.072510+0000","last_became_peered":"2024-04-25T08:50:02.072510+0000","last_unstale":"2024-04-25T08:50:04.664583+0000","last_undegraded":"2024-04-25T08:50:04.664583+0000","last_fullsized":"2024-04-25T08:50:04.664583+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:00.516930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664119+0000","last_change":"2024-04-25T08:50:03.095038+0000","last_active":"2024-04-25T08:50:04.664119+0000","last_peered":"2024-04-25T08:50:04.664119+0000","last_clean":"2024-04-25T08:50:04.664119+0000","last_became_active":"2024-04-25T08:50:03.094758+0000","last_became_peered":"2024-04-25T08:50:03.094758+0000","last_unstale":"2024-04-25T08:50:04.664119+0000","last_undegraded":"2024-04-25T08:50:04.664119+0000","last_fullsized":"2024-04-25T08:50:04.664119+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:36.728489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663468+0000","last_change":"2024-04-25T08:50:02.083029+0000","last_active":"2024-04-25T08:50:04.663468+0000","last_peered":"2024-04-25T08:50:04.663468+0000","last_clean":"2024-04-25T08:50:04.663468+0000","last_became_active":"2024-04-25T08:50:02.082742+0000","last_became_peered":"2024-04-25T08:50:02.082742+0000","last_unstale":"2024-04-25T08:50:04.663468+0000","last_undegraded":"2024-04-25T08:50:04.663468+0000","last_fullsized":"2024-04-25T08:50:04.663468+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:53.196270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163130+0000","last_change":"2024-04-25T08:50:03.092066+0000","last_active":"2024-04-25T08:50:04.163130+0000","last_peered":"2024-04-25T08:50:04.163130+0000","last_clean":"2024-04-25T08:50:04.163130+0000","last_became_active":"2024-04-25T08:50:03.091824+0000","last_became_peered":"2024-04-25T08:50:03.091824+0000","last_unstale":"2024-04-25T08:50:04.163130+0000","last_undegraded":"2024-04-25T08:50:04.163130+0000","last_fullsized":"2024-04-25T08:50:04.163130+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:33.288673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664172+0000","last_change":"2024-04-25T08:50:02.083384+0000","last_active":"2024-04-25T08:50:04.664172+0000","last_peered":"2024-04-25T08:50:04.664172+0000","last_clean":"2024-04-25T08:50:04.664172+0000","last_became_active":"2024-04-25T08:50:02.083099+0000","last_became_peered":"2024-04-25T08:50:02.083099+0000","last_unstale":"2024-04-25T08:50:04.664172+0000","last_undegraded":"2024-04-25T08:50:04.664172+0000","last_fullsized":"2024-04-25T08:50:04.664172+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:19.605213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664872+0000","last_change":"2024-04-25T08:50:03.094055+0000","last_active":"2024-04-25T08:50:04.664872+0000","last_peered":"2024-04-25T08:50:04.664872+0000","last_clean":"2024-04-25T08:50:04.664872+0000","last_became_active":"2024-04-25T08:50:03.093696+0000","last_became_peered":"2024-04-25T08:50:03.093696+0000","last_unstale":"2024-04-25T08:50:04.664872+0000","last_undegraded":"2024-04-25T08:50:04.664872+0000","last_fullsized":"2024-04-25T08:50:04.664872+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:04.537221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"118'8","reported_seq":22,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663322+0000","last_change":"2024-04-25T08:50:02.079489+0000","last_active":"2024-04-25T08:50:04.663322+0000","last_peered":"2024-04-25T08:50:04.663322+0000","last_clean":"2024-04-25T08:50:04.663322+0000","last_became_active":"2024-04-25T08:50:02.079226+0000","last_became_peered":"2024-04-25T08:50:02.079226+0000","last_unstale":"2024-04-25T08:50:04.663322+0000","last_undegraded":"2024-04-25T08:50:04.663322+0000","last_fullsized":"2024-04-25T08:50:04.663322+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:42.701070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":351,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664429+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:50:04.664429+0000","last_peered":"2024-04-25T08:50:04.664429+0000","last_clean":"2024-04-25T08:50:04.664429+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:50:04.664429+0000","last_undegraded":"2024-04-25T08:50:04.664429+0000","last_fullsized":"2024-04-25T08:50:04.664429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41552,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330288,"statfs":{"total":96636764160,"available":96594214912,"internally_reserved":0,"allocated":2093056,"data_stored":1281103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46524,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325316,"statfs":{"total":96636764160,"available":96589123584,"internally_reserved":0,"allocated":1486848,"data_stored":690541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45116,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326724,"statfs":{"total":96636764160,"available":96590565376,"internally_reserved":0,"allocated":1490944,"data_stored":690119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50692,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321148,"statfs":{"total":96636764160,"available":96584855552,"internally_reserved":0,"allocated":1495040,"data_stored":691571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50696,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321144,"statfs":{"total":96636764160,"available":96584851456,"internally_reserved":0,"allocated":1499136,"data_stored":691605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50684,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321156,"statfs":{"total":96636764160,"available":96584863744,"internally_reserved":0,"allocated":1482752,"data_stored":689959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46528,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325312,"statfs":{"total":96636764160,"available":96589119488,"internally_reserved":0,"allocated":1486848,"data_stored":689981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51260,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320580,"statfs":{"total":96636764160,"available":96584273920,"internally_reserved":0,"allocated":2080768,"data_stored":1280349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:50:06.712 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:06.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.854+0000 7fc3a883f640 1 Processor -- start 2024-04-25T08:50:06.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.854+0000 7fc3a883f640 1 -- start start 2024-04-25T08:50:06.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc3a883f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3a415c9e0 0x7fc3a4071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc3a883f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3a4072000 0x7fc3a406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc3a883f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a406de40 con 0x7fc3a4155fe0 2024-04-25T08:50:06.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc3a883f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a415ce70 con 0x7fc3a415c9e0 2024-04-25T08:50:06.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc3a883f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4072450 con 0x7fc3a4072000 2024-04-25T08:50:06.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc39bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3a415c9e0 0x7fc3a4071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc39bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3a415c9e0 0x7fc3a4071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47236/0 (socket says 172.21.15.172:47236) 2024-04-25T08:50:06.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc39bfff640 1 -- 172.21.15.172:0/112762934 learned_addr learned my addr 172.21.15.172:0/112762934 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:06.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc39bfff640 1 -- 172.21.15.172:0/112762934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3a4072000 msgr2=0x7fc3a406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:06.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc39bfff640 1 --2- 172.21.15.172:0/112762934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3a4072000 0x7fc3a406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc39bfff640 1 -- 172.21.15.172:0/112762934 >> v1:172.21.15.186:6789/0 conn(0x7fc3a4155fe0 legacy=0x7fc3a40adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:06.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.855+0000 7fc39bfff640 1 -- 172.21.15.172:0/112762934 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40ad0e0 con 0x7fc3a415c9e0 2024-04-25T08:50:06.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.856+0000 7fc39bfff640 1 --2- 172.21.15.172:0/112762934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 0x7fc3a4071ac0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4072ec0 tx=0x7fc38c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71b13d448fc41f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:06.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.856+0000 7fc3a1d9b640 1 -- 172.21.15.172:0/112762934 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c037070 con 0x7fc3a415c9e0 2024-04-25T08:50:06.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.856+0000 7fc3a1d9b640 1 -- 172.21.15.172:0/112762934 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c02ae50 con 0x7fc3a415c9e0 2024-04-25T08:50:06.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.856+0000 7fc3a1d9b640 1 -- 172.21.15.172:0/112762934 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c032660 con 0x7fc3a415c9e0 2024-04-25T08:50:06.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.857+0000 7fc3a883f640 1 -- 172.21.15.172:0/112762934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 msgr2=0x7fc3a4071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.857+0000 7fc3a883f640 1 --2- 172.21.15.172:0/112762934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 0x7fc3a4071ac0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4072ec0 tx=0x7fc38c02a140 comp rx=0 tx=0).stop 2024-04-25T08:50:06.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.857+0000 7fc3a883f640 1 -- 172.21.15.172:0/112762934 shutdown_connections 2024-04-25T08:50:06.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.857+0000 7fc3a883f640 1 --2- 172.21.15.172:0/112762934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3a4072000 0x7fc3a406abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.857+0000 7fc3a883f640 1 --2- 172.21.15.172:0/112762934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 0x7fc3a4071ac0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.857+0000 7fc3a883f640 1 -- 172.21.15.172:0/112762934 >> 172.21.15.172:0/112762934 conn(0x7fc3a40af670 msgr2=0x7fc3a40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:06.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.857+0000 7fc3a883f640 1 -- 172.21.15.172:0/112762934 shutdown_connections 2024-04-25T08:50:06.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.857+0000 7fc3a883f640 1 -- 172.21.15.172:0/112762934 wait complete. 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.858+0000 7fc3a883f640 1 Processor -- start 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.858+0000 7fc3a883f640 1 -- start start 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc3a883f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3a4155fe0 0x7fc3a414c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc3a883f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 0x7fc3a40b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc3a883f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3a40c5870 0x7fc3a409caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc3a883f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41563c0 con 0x7fc3a415c9e0 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc3a883f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40ad6a0 con 0x7fc3a40c5870 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc3a883f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a406f880 con 0x7fc3a4155fe0 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 0x7fc3a40b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 0x7fc3a40b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47252/0 (socket says 172.21.15.172:47252) 2024-04-25T08:50:06.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39bfff640 1 -- 172.21.15.172:0/1940673858 learned_addr learned my addr 172.21.15.172:0/1940673858 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc3a259c640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3a4155fe0 0x7fc3a414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39bfff640 1 -- 172.21.15.172:0/1940673858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3a4155fe0 msgr2=0x7fc3a414c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39bfff640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3a4155fe0 0x7fc3a414c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39bfff640 1 -- 172.21.15.172:0/1940673858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3a40c5870 msgr2=0x7fc3a409caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39bfff640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3a40c5870 0x7fc3a409caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39bfff640 1 -- 172.21.15.172:0/1940673858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40b3190 con 0x7fc3a415c9e0 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39bfff640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 0x7fc3a40b4230 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fc38c02a180 tx=0x7fc38c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39affd640 1 -- 172.21.15.172:0/1940673858 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c042070 con 0x7fc3a415c9e0 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39affd640 1 -- 172.21.15.172:0/1940673858 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c03e670 con 0x7fc3a415c9e0 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc3a883f640 1 -- 172.21.15.172:0/1940673858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a40b3470 con 0x7fc3a415c9e0 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.859+0000 7fc39affd640 1 -- 172.21.15.172:0/1940673858 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c037040 con 0x7fc3a415c9e0 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.860+0000 7fc3a883f640 1 -- 172.21.15.172:0/1940673858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a40b3a30 con 0x7fc3a415c9e0 2024-04-25T08:50:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.860+0000 7fc3a883f640 1 -- 172.21.15.172:0/1940673858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a4073990 con 0x7fc3a415c9e0 2024-04-25T08:50:06.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.861+0000 7fc39affd640 1 -- 172.21.15.172:0/1940673858 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc38c045070 con 0x7fc3a415c9e0 2024-04-25T08:50:06.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.861+0000 7fc39affd640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc38406b4d0 0x7fc38406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:06.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.861+0000 7fc39affd640 1 -- 172.21.15.172:0/1940673858 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc38c0aad80 con 0x7fc3a415c9e0 2024-04-25T08:50:06.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.861+0000 7fc3a259c640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc38406b4d0 0x7fc38406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:06.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.862+0000 7fc3a259c640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc38406b4d0 0x7fc38406d990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc394003d90 tx=0x7fc394009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:06.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:06.865+0000 7fc39affd640 1 -- 172.21.15.172:0/1940673858 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc38c079b90 con 0x7fc3a415c9e0 2024-04-25T08:50:07.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.107+0000 7fc3a883f640 1 -- 172.21.15.172:0/1940673858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc3a4067df0 con 0x7fc3a415c9e0 2024-04-25T08:50:07.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.108+0000 7fc39affd640 1 -- 172.21.15.172:0/1940673858 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1434 (secure 0 0 0) 0x7fc38c079490 con 0x7fc3a415c9e0 2024-04-25T08:50:07.099 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:07.099 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":482,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":392245248,"bytes_avail":772701868032,"bytes_total":773094113280,"write_bytes_sec":2586,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":68,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-04-25T08:49:52.603883+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:07.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.109+0000 7fc3a883f640 1 -- 172.21.15.172:0/1940673858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc38406b4d0 msgr2=0x7fc38406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:07.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.109+0000 7fc3a883f640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc38406b4d0 0x7fc38406d990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc394003d90 tx=0x7fc394009040 comp rx=0 tx=0).stop 2024-04-25T08:50:07.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.109+0000 7fc3a883f640 1 -- 172.21.15.172:0/1940673858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 msgr2=0x7fc3a40b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:07.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.109+0000 7fc3a883f640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 0x7fc3a40b4230 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fc38c02a180 tx=0x7fc38c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.110+0000 7fc3a883f640 1 -- 172.21.15.172:0/1940673858 shutdown_connections 2024-04-25T08:50:07.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.110+0000 7fc3a883f640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc38406b4d0 0x7fc38406d990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.110+0000 7fc3a883f640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc3a40c5870 0x7fc3a409caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.110+0000 7fc3a883f640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a415c9e0 0x7fc3a40b4230 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.110+0000 7fc3a883f640 1 --2- 172.21.15.172:0/1940673858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc3a4155fe0 0x7fc3a414c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.110+0000 7fc3a883f640 1 -- 172.21.15.172:0/1940673858 >> 172.21.15.172:0/1940673858 conn(0x7fc3a4072000 msgr2=0x7fc3a40adbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:07.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.110+0000 7fc3a883f640 1 -- 172.21.15.172:0/1940673858 shutdown_connections 2024-04-25T08:50:07.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.110+0000 7fc3a883f640 1 -- 172.21.15.172:0/1940673858 wait complete. 2024-04-25T08:50:07.111 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:50:07.111 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:50:07.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.218+0000 7fc1fe26b640 1 Processor -- start 2024-04-25T08:50:07.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.218+0000 7fc1fe26b640 1 -- start start 2024-04-25T08:50:07.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.219+0000 7fc1fe26b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc1f80d1020 0x7fc1f80d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.219+0000 7fc1fe26b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f80b97a0 con 0x7fc1f80b2cb0 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.219+0000 7fc1fe26b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f80d1c50 con 0x7fc1f815dbe0 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.219+0000 7fc1fe26b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f815dfc0 con 0x7fc1f80d1020 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.219+0000 7fc1f77fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc1f80b2cb0 0x7fc1f80d2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:50626/0 (socket says 172.21.15.172:50626) 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.219+0000 7fc1f77fe640 1 -- 172.21.15.172:0/489015853 learned_addr learned my addr 172.21.15.172:0/489015853 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.219+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228559647 0 0) 0x7fc1f80b97a0 con 0x7fc1f80b2cb0 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.219+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e0003520 con 0x7fc1f80b2cb0 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1fc808640 1 --2- 172.21.15.172:0/489015853 >> v2:172.21.15.186:3300/0 conn(0x7fc1f80d1020 0x7fc1f80d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279033644 0 0) 0x7fc1e0003520 con 0x7fc1f80b2cb0 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 >> v2:172.21.15.186:3300/0 conn(0x7fc1f80d1020 msgr2=0x7fc1f80d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 --2- 172.21.15.172:0/489015853 >> v2:172.21.15.186:3300/0 conn(0x7fc1f80d1020 0x7fc1f80d2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 >> v1:172.21.15.186:6789/0 conn(0x7fc1f815dbe0 legacy=0x7fc1f80d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:07.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f80d1f30 con 0x7fc1f80b2cb0 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fc1ec001670 con 0x7fc1f80b2cb0 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 >> v1:172.21.15.172:6789/0 conn(0x7fc1f80b2cb0 legacy=0x7fc1f80d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e00039b0 0x7fc1e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1e0004800 0x7fc1e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1e00051c0 0x7fc1e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e000c0e0 con 0x7fc1e00039b0 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e000c290 con 0x7fc1e00051c0 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e000c490 con 0x7fc1e0004800 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f7fff640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e00039b0 0x7fc1e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1fc808640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1e00051c0 0x7fc1e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f77fe640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1e0004800 0x7fc1e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f7fff640 1 -- 172.21.15.172:0/489015853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1e0004800 msgr2=0x7fc1e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f7fff640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1e0004800 0x7fc1e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f7fff640 1 -- 172.21.15.172:0/489015853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1e00051c0 msgr2=0x7fc1e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f7fff640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1e00051c0 0x7fc1e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1fc808640 1 -- 172.21.15.172:0/489015853 reap_dead start 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.220+0000 7fc1f7fff640 1 -- 172.21.15.172:0/489015853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e0003520 con 0x7fc1e00039b0 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.221+0000 7fc1f7fff640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e00039b0 0x7fc1e0003dd0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8001750 tx=0x7fc1e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330c920b305e8fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.221+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8001370 con 0x7fc1e00039b0 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.221+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e80052d0 con 0x7fc1e00039b0 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.221+0000 7fc1f6ffd640 1 -- 172.21.15.172:0/489015853 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e802abc0 con 0x7fc1e00039b0 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.221+0000 7fc1fe26b640 1 -- 172.21.15.172:0/489015853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e00039b0 msgr2=0x7fc1e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.221+0000 7fc1fe26b640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e00039b0 0x7fc1e0003dd0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8001750 tx=0x7fc1e0005830 comp rx=0 tx=0).stop 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.222+0000 7fc1fe26b640 1 -- 172.21.15.172:0/489015853 shutdown_connections 2024-04-25T08:50:07.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.222+0000 7fc1fe26b640 1 --2- 172.21.15.172:0/489015853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e00039b0 0x7fc1e0003dd0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.222+0000 7fc1fe26b640 1 -- 172.21.15.172:0/489015853 >> 172.21.15.172:0/489015853 conn(0x7fc1f8061a20 msgr2=0x7fc1f8061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:07.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.222+0000 7fc1fe26b640 1 -- 172.21.15.172:0/489015853 shutdown_connections 2024-04-25T08:50:07.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.222+0000 7fc1fe26b640 1 -- 172.21.15.172:0/489015853 wait complete. 2024-04-25T08:50:07.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.223+0000 7fc1fe26b640 1 Processor -- start 2024-04-25T08:50:07.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.223+0000 7fc1fe26b640 1 -- start start 2024-04-25T08:50:07.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1fe26b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1e00039b0 0x7fc1f81f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:07.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1fe26b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f8154bc0 0x7fc1f81539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:07.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1fe26b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f81553a0 0x7fc1f8155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:07.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1fe26b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80b92a0 con 0x7fc1f8154bc0 2024-04-25T08:50:07.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1fe26b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80d1a00 con 0x7fc1f81553a0 2024-04-25T08:50:07.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1fe26b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80b9420 con 0x7fc1e00039b0 2024-04-25T08:50:07.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f8154bc0 0x7fc1f81539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:07.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f8154bc0 0x7fc1f81539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:47274/0 (socket says 172.21.15.172:47274) 2024-04-25T08:50:07.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f77fe640 1 -- 172.21.15.172:0/3930891890 learned_addr learned my addr 172.21.15.172:0/3930891890 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:07.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f7fff640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1e00039b0 0x7fc1f81f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:07.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1fc808640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f81553a0 0x7fc1f8155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:07.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f77fe640 1 -- 172.21.15.172:0/3930891890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1e00039b0 msgr2=0x7fc1f81f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:07.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f77fe640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1e00039b0 0x7fc1f81f3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f77fe640 1 -- 172.21.15.172:0/3930891890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f81553a0 msgr2=0x7fc1f8155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f77fe640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f81553a0 0x7fc1f8155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f77fe640 1 -- 172.21.15.172:0/3930891890 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f8155d50 con 0x7fc1f8154bc0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f77fe640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f8154bc0 0x7fc1f81539d0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00e700 tx=0x7fc1ec00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f4ff9640 1 -- 172.21.15.172:0/3930891890 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00c6c0 con 0x7fc1f8154bc0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f4ff9640 1 -- 172.21.15.172:0/3930891890 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec018070 con 0x7fc1f8154bc0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1fe26b640 1 -- 172.21.15.172:0/3930891890 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f81f3b90 con 0x7fc1f8154bc0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1f4ff9640 1 -- 172.21.15.172:0/3930891890 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00caa0 con 0x7fc1f8154bc0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.224+0000 7fc1fe26b640 1 -- 172.21.15.172:0/3930891890 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f81f4150 con 0x7fc1f8154bc0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.226+0000 7fc1fe26b640 1 -- 172.21.15.172:0/3930891890 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f81f4490 con 0x7fc1f8154bc0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.226+0000 7fc1f4ff9640 1 -- 172.21.15.172:0/3930891890 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc1ec00cc40 con 0x7fc1f8154bc0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.226+0000 7fc1f4ff9640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1e406b4d0 0x7fc1e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.226+0000 7fc1f4ff9640 1 -- 172.21.15.172:0/3930891890 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc1ec08a0e0 con 0x7fc1f8154bc0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.226+0000 7fc1f7fff640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1e406b4d0 0x7fc1e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:07.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.227+0000 7fc1f7fff640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1e406b4d0 0x7fc1e406d990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8032000 tx=0x7fc1e802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:07.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.230+0000 7fc1f4ff9640 1 -- 172.21.15.172:0/3930891890 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1f81f4490 con 0x7fc1f8154bc0 2024-04-25T08:50:07.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.400+0000 7fc1fe26b640 1 -- 172.21.15.172:0/3930891890 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1f815af70 con 0x7fc1e406b4d0 2024-04-25T08:50:07.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.406+0000 7fc1f4ff9640 1 -- 172.21.15.172:0/3930891890 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252487 (secure 0 0 0) 0x7fc1f815af70 con 0x7fc1e406b4d0 2024-04-25T08:50:07.399 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:07.400 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:50:07.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 -- 172.21.15.172:0/3930891890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1e406b4d0 msgr2=0x7fc1e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:07.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1e406b4d0 0x7fc1e406d990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8032000 tx=0x7fc1e802e000 comp rx=0 tx=0).stop 2024-04-25T08:50:07.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 -- 172.21.15.172:0/3930891890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f8154bc0 msgr2=0x7fc1f81539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:07.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f8154bc0 0x7fc1f81539d0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00e700 tx=0x7fc1ec00ebc0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 -- 172.21.15.172:0/3930891890 shutdown_connections 2024-04-25T08:50:07.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1e406b4d0 0x7fc1e406d990 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1f81553a0 0x7fc1f8155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1f8154bc0 0x7fc1f81539d0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 --2- 172.21.15.172:0/3930891890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1e00039b0 0x7fc1f81f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:07.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 -- 172.21.15.172:0/3930891890 >> 172.21.15.172:0/3930891890 conn(0x7fc1f8061a20 msgr2=0x7fc1f80b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:07.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 -- 172.21.15.172:0/3930891890 shutdown_connections 2024-04-25T08:50:07.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:07.409+0000 7fc1fe26b640 1 -- 172.21.15.172:0/3930891890 wait complete. 2024-04-25T08:50:07.410 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-04-25T08:50:06.606095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":383052,"kb_used_data":12808,"kb_used_omap":12,"kb_used_meta":370099,"kb_avail":754591668,"statfs":{"total":773094113280,"available":772701868032,"internally_reserved":0,"allocated":13115392,"data_stored":6705228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":378981936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.543682"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.665073+0000","last_change":"2024-04-25T08:50:03.083394+0000","last_active":"2024-04-25T08:50:04.665073+0000","last_peered":"2024-04-25T08:50:04.665073+0000","last_clean":"2024-04-25T08:50:04.665073+0000","last_became_active":"2024-04-25T08:50:03.082959+0000","last_became_peered":"2024-04-25T08:50:03.082959+0000","last_unstale":"2024-04-25T08:50:04.665073+0000","last_undegraded":"2024-04-25T08:50:04.665073+0000","last_fullsized":"2024-04-25T08:50:04.665073+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:58.831107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663832+0000","last_change":"2024-04-25T08:50:03.091178+0000","last_active":"2024-04-25T08:50:04.663832+0000","last_peered":"2024-04-25T08:50:04.663832+0000","last_clean":"2024-04-25T08:50:04.663832+0000","last_became_active":"2024-04-25T08:50:03.090753+0000","last_became_peered":"2024-04-25T08:50:03.090753+0000","last_unstale":"2024-04-25T08:50:04.663832+0000","last_undegraded":"2024-04-25T08:50:04.663832+0000","last_fullsized":"2024-04-25T08:50:04.663832+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:31.567873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663788+0000","last_change":"2024-04-25T08:50:03.104539+0000","last_active":"2024-04-25T08:50:04.663788+0000","last_peered":"2024-04-25T08:50:04.663788+0000","last_clean":"2024-04-25T08:50:04.663788+0000","last_became_active":"2024-04-25T08:50:03.103082+0000","last_became_peered":"2024-04-25T08:50:03.103082+0000","last_unstale":"2024-04-25T08:50:04.663788+0000","last_undegraded":"2024-04-25T08:50:04.663788+0000","last_fullsized":"2024-04-25T08:50:04.663788+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:52.046203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664542+0000","last_change":"2024-04-25T08:50:03.096493+0000","last_active":"2024-04-25T08:50:04.664542+0000","last_peered":"2024-04-25T08:50:04.664542+0000","last_clean":"2024-04-25T08:50:04.664542+0000","last_became_active":"2024-04-25T08:50:03.096228+0000","last_became_peered":"2024-04-25T08:50:03.096228+0000","last_unstale":"2024-04-25T08:50:04.664542+0000","last_undegraded":"2024-04-25T08:50:04.664542+0000","last_fullsized":"2024-04-25T08:50:04.664542+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:51.195877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664214+0000","last_change":"2024-04-25T08:50:03.093743+0000","last_active":"2024-04-25T08:50:04.664214+0000","last_peered":"2024-04-25T08:50:04.664214+0000","last_clean":"2024-04-25T08:50:04.664214+0000","last_became_active":"2024-04-25T08:50:03.093465+0000","last_became_peered":"2024-04-25T08:50:03.093465+0000","last_unstale":"2024-04-25T08:50:04.664214+0000","last_undegraded":"2024-04-25T08:50:04.664214+0000","last_fullsized":"2024-04-25T08:50:04.664214+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.610170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663949+0000","last_change":"2024-04-25T08:50:03.094410+0000","last_active":"2024-04-25T08:50:04.663949+0000","last_peered":"2024-04-25T08:50:04.663949+0000","last_clean":"2024-04-25T08:50:04.663949+0000","last_became_active":"2024-04-25T08:50:03.094167+0000","last_became_peered":"2024-04-25T08:50:03.094167+0000","last_unstale":"2024-04-25T08:50:04.663949+0000","last_undegraded":"2024-04-25T08:50:04.663949+0000","last_fullsized":"2024-04-25T08:50:04.663949+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.993765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663485+0000","last_change":"2024-04-25T08:50:03.092324+0000","last_active":"2024-04-25T08:50:04.663485+0000","last_peered":"2024-04-25T08:50:04.663485+0000","last_clean":"2024-04-25T08:50:04.663485+0000","last_became_active":"2024-04-25T08:50:03.092067+0000","last_became_peered":"2024-04-25T08:50:03.092067+0000","last_unstale":"2024-04-25T08:50:04.663485+0000","last_undegraded":"2024-04-25T08:50:04.663485+0000","last_fullsized":"2024-04-25T08:50:04.663485+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:10.493062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663308+0000","last_change":"2024-04-25T08:50:03.093041+0000","last_active":"2024-04-25T08:50:04.663308+0000","last_peered":"2024-04-25T08:50:04.663308+0000","last_clean":"2024-04-25T08:50:04.663308+0000","last_became_active":"2024-04-25T08:50:03.092794+0000","last_became_peered":"2024-04-25T08:50:03.092794+0000","last_unstale":"2024-04-25T08:50:04.663308+0000","last_undegraded":"2024-04-25T08:50:04.663308+0000","last_fullsized":"2024-04-25T08:50:04.663308+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:59.462552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664749+0000","last_change":"2024-04-25T08:50:03.102503+0000","last_active":"2024-04-25T08:50:04.664749+0000","last_peered":"2024-04-25T08:50:04.664749+0000","last_clean":"2024-04-25T08:50:04.664749+0000","last_became_active":"2024-04-25T08:50:03.102212+0000","last_became_peered":"2024-04-25T08:50:03.102212+0000","last_unstale":"2024-04-25T08:50:04.664749+0000","last_undegraded":"2024-04-25T08:50:04.664749+0000","last_fullsized":"2024-04-25T08:50:04.664749+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:05.072692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162995+0000","last_change":"2024-04-25T08:50:03.091219+0000","last_active":"2024-04-25T08:50:04.162995+0000","last_peered":"2024-04-25T08:50:04.162995+0000","last_clean":"2024-04-25T08:50:04.162995+0000","last_became_active":"2024-04-25T08:50:03.090968+0000","last_became_peered":"2024-04-25T08:50:03.090968+0000","last_unstale":"2024-04-25T08:50:04.162995+0000","last_undegraded":"2024-04-25T08:50:04.162995+0000","last_fullsized":"2024-04-25T08:50:04.162995+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:10.545318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664906+0000","last_change":"2024-04-25T08:50:03.089015+0000","last_active":"2024-04-25T08:50:04.664906+0000","last_peered":"2024-04-25T08:50:04.664906+0000","last_clean":"2024-04-25T08:50:04.664906+0000","last_became_active":"2024-04-25T08:50:03.088752+0000","last_became_peered":"2024-04-25T08:50:03.088752+0000","last_unstale":"2024-04-25T08:50:04.664906+0000","last_undegraded":"2024-04-25T08:50:04.664906+0000","last_fullsized":"2024-04-25T08:50:04.664906+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:34.320207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663699+0000","last_change":"2024-04-25T08:50:03.093214+0000","last_active":"2024-04-25T08:50:04.663699+0000","last_peered":"2024-04-25T08:50:04.663699+0000","last_clean":"2024-04-25T08:50:04.663699+0000","last_became_active":"2024-04-25T08:50:03.092604+0000","last_became_peered":"2024-04-25T08:50:03.092604+0000","last_unstale":"2024-04-25T08:50:04.663699+0000","last_undegraded":"2024-04-25T08:50:04.663699+0000","last_fullsized":"2024-04-25T08:50:04.663699+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:51.099025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162992+0000","last_change":"2024-04-25T08:50:03.084703+0000","last_active":"2024-04-25T08:50:04.162992+0000","last_peered":"2024-04-25T08:50:04.162992+0000","last_clean":"2024-04-25T08:50:04.162992+0000","last_became_active":"2024-04-25T08:50:03.084443+0000","last_became_peered":"2024-04-25T08:50:03.084443+0000","last_unstale":"2024-04-25T08:50:04.162992+0000","last_undegraded":"2024-04-25T08:50:04.162992+0000","last_fullsized":"2024-04-25T08:50:04.162992+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.610170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663787+0000","last_change":"2024-04-25T08:50:03.104218+0000","last_active":"2024-04-25T08:50:04.663787+0000","last_peered":"2024-04-25T08:50:04.663787+0000","last_clean":"2024-04-25T08:50:04.663787+0000","last_became_active":"2024-04-25T08:50:03.103862+0000","last_became_peered":"2024-04-25T08:50:03.103862+0000","last_unstale":"2024-04-25T08:50:04.663787+0000","last_undegraded":"2024-04-25T08:50:04.663787+0000","last_fullsized":"2024-04-25T08:50:04.663787+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:23.630924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664512+0000","last_change":"2024-04-25T08:50:03.085655+0000","last_active":"2024-04-25T08:50:04.664512+0000","last_peered":"2024-04-25T08:50:04.664512+0000","last_clean":"2024-04-25T08:50:04.664512+0000","last_became_active":"2024-04-25T08:50:03.085389+0000","last_became_peered":"2024-04-25T08:50:03.085389+0000","last_unstale":"2024-04-25T08:50:04.664512+0000","last_undegraded":"2024-04-25T08:50:04.664512+0000","last_fullsized":"2024-04-25T08:50:04.664512+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:20.612457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664247+0000","last_change":"2024-04-25T08:50:03.097964+0000","last_active":"2024-04-25T08:50:04.664247+0000","last_peered":"2024-04-25T08:50:04.664247+0000","last_clean":"2024-04-25T08:50:04.664247+0000","last_became_active":"2024-04-25T08:50:03.097718+0000","last_became_peered":"2024-04-25T08:50:03.097718+0000","last_unstale":"2024-04-25T08:50:04.664247+0000","last_undegraded":"2024-04-25T08:50:04.664247+0000","last_fullsized":"2024-04-25T08:50:04.664247+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:22.583129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162994+0000","last_change":"2024-04-25T08:50:03.084017+0000","last_active":"2024-04-25T08:50:04.162994+0000","last_peered":"2024-04-25T08:50:04.162994+0000","last_clean":"2024-04-25T08:50:04.162994+0000","last_became_active":"2024-04-25T08:50:03.083722+0000","last_became_peered":"2024-04-25T08:50:03.083722+0000","last_unstale":"2024-04-25T08:50:04.162994+0000","last_undegraded":"2024-04-25T08:50:04.162994+0000","last_fullsized":"2024-04-25T08:50:04.162994+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:34.320207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663975+0000","last_change":"2024-04-25T08:50:03.090979+0000","last_active":"2024-04-25T08:50:04.663975+0000","last_peered":"2024-04-25T08:50:04.663975+0000","last_clean":"2024-04-25T08:50:04.663975+0000","last_became_active":"2024-04-25T08:50:03.090444+0000","last_became_peered":"2024-04-25T08:50:03.090444+0000","last_unstale":"2024-04-25T08:50:04.663975+0000","last_undegraded":"2024-04-25T08:50:04.663975+0000","last_fullsized":"2024-04-25T08:50:04.663975+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:39.167233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080182+0000","last_change":"2024-04-25T08:50:03.098905+0000","last_active":"2024-04-25T08:50:04.080182+0000","last_peered":"2024-04-25T08:50:04.080182+0000","last_clean":"2024-04-25T08:50:04.080182+0000","last_became_active":"2024-04-25T08:50:03.097870+0000","last_became_peered":"2024-04-25T08:50:03.097870+0000","last_unstale":"2024-04-25T08:50:04.080182+0000","last_undegraded":"2024-04-25T08:50:04.080182+0000","last_fullsized":"2024-04-25T08:50:04.080182+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.610170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078264+0000","last_change":"2024-04-25T08:50:03.091722+0000","last_active":"2024-04-25T08:50:04.078264+0000","last_peered":"2024-04-25T08:50:04.078264+0000","last_clean":"2024-04-25T08:50:04.078264+0000","last_became_active":"2024-04-25T08:50:03.091429+0000","last_became_peered":"2024-04-25T08:50:03.091429+0000","last_unstale":"2024-04-25T08:50:04.078264+0000","last_undegraded":"2024-04-25T08:50:04.078264+0000","last_fullsized":"2024-04-25T08:50:04.078264+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:22.146869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664797+0000","last_change":"2024-04-25T08:50:03.094022+0000","last_active":"2024-04-25T08:50:04.664797+0000","last_peered":"2024-04-25T08:50:04.664797+0000","last_clean":"2024-04-25T08:50:04.664797+0000","last_became_active":"2024-04-25T08:50:03.093658+0000","last_became_peered":"2024-04-25T08:50:03.093658+0000","last_unstale":"2024-04-25T08:50:04.664797+0000","last_undegraded":"2024-04-25T08:50:04.664797+0000","last_fullsized":"2024-04-25T08:50:04.664797+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.471582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664456+0000","last_change":"2024-04-25T08:50:03.093892+0000","last_active":"2024-04-25T08:50:04.664456+0000","last_peered":"2024-04-25T08:50:04.664456+0000","last_clean":"2024-04-25T08:50:04.664456+0000","last_became_active":"2024-04-25T08:50:03.093593+0000","last_became_peered":"2024-04-25T08:50:03.093593+0000","last_unstale":"2024-04-25T08:50:04.664456+0000","last_undegraded":"2024-04-25T08:50:04.664456+0000","last_fullsized":"2024-04-25T08:50:04.664456+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:10.545318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664515+0000","last_change":"2024-04-25T08:50:03.095532+0000","last_active":"2024-04-25T08:50:04.664515+0000","last_peered":"2024-04-25T08:50:04.664515+0000","last_clean":"2024-04-25T08:50:04.664515+0000","last_became_active":"2024-04-25T08:50:03.095270+0000","last_became_peered":"2024-04-25T08:50:03.095270+0000","last_unstale":"2024-04-25T08:50:04.664515+0000","last_undegraded":"2024-04-25T08:50:04.664515+0000","last_fullsized":"2024-04-25T08:50:04.664515+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:03.882075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079493+0000","last_change":"2024-04-25T08:50:03.097656+0000","last_active":"2024-04-25T08:50:04.079493+0000","last_peered":"2024-04-25T08:50:04.079493+0000","last_clean":"2024-04-25T08:50:04.079493+0000","last_became_active":"2024-04-25T08:50:03.097370+0000","last_became_peered":"2024-04-25T08:50:03.097370+0000","last_unstale":"2024-04-25T08:50:04.079493+0000","last_undegraded":"2024-04-25T08:50:04.079493+0000","last_fullsized":"2024-04-25T08:50:04.079493+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:51.195877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080279+0000","last_change":"2024-04-25T08:50:03.085479+0000","last_active":"2024-04-25T08:50:04.080279+0000","last_peered":"2024-04-25T08:50:04.080279+0000","last_clean":"2024-04-25T08:50:04.080279+0000","last_became_active":"2024-04-25T08:50:03.084775+0000","last_became_peered":"2024-04-25T08:50:03.084775+0000","last_unstale":"2024-04-25T08:50:04.080279+0000","last_undegraded":"2024-04-25T08:50:04.080279+0000","last_fullsized":"2024-04-25T08:50:04.080279+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:45.686350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078284+0000","last_change":"2024-04-25T08:50:03.086479+0000","last_active":"2024-04-25T08:50:04.078284+0000","last_peered":"2024-04-25T08:50:04.078284+0000","last_clean":"2024-04-25T08:50:04.078284+0000","last_became_active":"2024-04-25T08:50:03.086139+0000","last_became_peered":"2024-04-25T08:50:03.086139+0000","last_unstale":"2024-04-25T08:50:04.078284+0000","last_undegraded":"2024-04-25T08:50:04.078284+0000","last_fullsized":"2024-04-25T08:50:04.078284+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.085411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080397+0000","last_change":"2024-04-25T08:50:03.097450+0000","last_active":"2024-04-25T08:50:04.080397+0000","last_peered":"2024-04-25T08:50:04.080397+0000","last_clean":"2024-04-25T08:50:04.080397+0000","last_became_active":"2024-04-25T08:50:03.096608+0000","last_became_peered":"2024-04-25T08:50:03.096608+0000","last_unstale":"2024-04-25T08:50:04.080397+0000","last_undegraded":"2024-04-25T08:50:04.080397+0000","last_fullsized":"2024-04-25T08:50:04.080397+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:10.545318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663832+0000","last_change":"2024-04-25T08:50:03.097012+0000","last_active":"2024-04-25T08:50:04.663832+0000","last_peered":"2024-04-25T08:50:04.663832+0000","last_clean":"2024-04-25T08:50:04.663832+0000","last_became_active":"2024-04-25T08:50:03.096769+0000","last_became_peered":"2024-04-25T08:50:03.096769+0000","last_unstale":"2024-04-25T08:50:04.663832+0000","last_undegraded":"2024-04-25T08:50:04.663832+0000","last_fullsized":"2024-04-25T08:50:04.663832+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:19.681019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078434+0000","last_change":"2024-04-25T08:50:03.088413+0000","last_active":"2024-04-25T08:50:04.078434+0000","last_peered":"2024-04-25T08:50:04.078434+0000","last_clean":"2024-04-25T08:50:04.078434+0000","last_became_active":"2024-04-25T08:50:03.087922+0000","last_became_peered":"2024-04-25T08:50:03.087922+0000","last_unstale":"2024-04-25T08:50:04.078434+0000","last_undegraded":"2024-04-25T08:50:04.078434+0000","last_fullsized":"2024-04-25T08:50:04.078434+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:41.935890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664001+0000","last_change":"2024-04-25T08:50:03.093647+0000","last_active":"2024-04-25T08:50:04.664001+0000","last_peered":"2024-04-25T08:50:04.664001+0000","last_clean":"2024-04-25T08:50:04.664001+0000","last_became_active":"2024-04-25T08:50:03.093390+0000","last_became_peered":"2024-04-25T08:50:03.093390+0000","last_unstale":"2024-04-25T08:50:04.664001+0000","last_undegraded":"2024-04-25T08:50:04.664001+0000","last_fullsized":"2024-04-25T08:50:04.664001+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:10.599016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080688+0000","last_change":"2024-04-25T08:50:03.084656+0000","last_active":"2024-04-25T08:50:04.080688+0000","last_peered":"2024-04-25T08:50:04.080688+0000","last_clean":"2024-04-25T08:50:04.080688+0000","last_became_active":"2024-04-25T08:50:03.084238+0000","last_became_peered":"2024-04-25T08:50:03.084238+0000","last_unstale":"2024-04-25T08:50:04.080688+0000","last_undegraded":"2024-04-25T08:50:04.080688+0000","last_fullsized":"2024-04-25T08:50:04.080688+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:34.456782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079656+0000","last_change":"2024-04-25T08:50:03.094209+0000","last_active":"2024-04-25T08:50:04.079656+0000","last_peered":"2024-04-25T08:50:04.079656+0000","last_clean":"2024-04-25T08:50:04.079656+0000","last_became_active":"2024-04-25T08:50:03.093083+0000","last_became_peered":"2024-04-25T08:50:03.093083+0000","last_unstale":"2024-04-25T08:50:04.079656+0000","last_undegraded":"2024-04-25T08:50:04.079656+0000","last_fullsized":"2024-04-25T08:50:04.079656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:34.032156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162886+0000","last_change":"2024-04-25T08:50:03.091412+0000","last_active":"2024-04-25T08:50:04.162886+0000","last_peered":"2024-04-25T08:50:04.162886+0000","last_clean":"2024-04-25T08:50:04.162886+0000","last_became_active":"2024-04-25T08:50:03.091180+0000","last_became_peered":"2024-04-25T08:50:03.091180+0000","last_unstale":"2024-04-25T08:50:04.162886+0000","last_undegraded":"2024-04-25T08:50:04.162886+0000","last_fullsized":"2024-04-25T08:50:04.162886+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.595974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"118'4","reported_seq":18,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079772+0000","last_change":"2024-04-25T08:50:02.081818+0000","last_active":"2024-04-25T08:50:04.079772+0000","last_peered":"2024-04-25T08:50:04.079772+0000","last_clean":"2024-04-25T08:50:04.079772+0000","last_became_active":"2024-04-25T08:50:02.081524+0000","last_became_peered":"2024-04-25T08:50:02.081524+0000","last_unstale":"2024-04-25T08:50:04.079772+0000","last_undegraded":"2024-04-25T08:50:04.079772+0000","last_fullsized":"2024-04-25T08:50:04.079772+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:28.415330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663849+0000","last_change":"2024-04-25T08:50:03.095481+0000","last_active":"2024-04-25T08:50:04.663849+0000","last_peered":"2024-04-25T08:50:04.663849+0000","last_clean":"2024-04-25T08:50:04.663849+0000","last_became_active":"2024-04-25T08:50:03.095086+0000","last_became_peered":"2024-04-25T08:50:03.095086+0000","last_unstale":"2024-04-25T08:50:04.663849+0000","last_undegraded":"2024-04-25T08:50:04.663849+0000","last_fullsized":"2024-04-25T08:50:04.663849+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:35.929862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163087+0000","last_change":"2024-04-25T08:50:02.077068+0000","last_active":"2024-04-25T08:50:04.163087+0000","last_peered":"2024-04-25T08:50:04.163087+0000","last_clean":"2024-04-25T08:50:04.163087+0000","last_became_active":"2024-04-25T08:50:02.076808+0000","last_became_peered":"2024-04-25T08:50:02.076808+0000","last_unstale":"2024-04-25T08:50:04.163087+0000","last_undegraded":"2024-04-25T08:50:04.163087+0000","last_fullsized":"2024-04-25T08:50:04.163087+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:02.243038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080290+0000","last_change":"2024-04-25T08:50:03.092884+0000","last_active":"2024-04-25T08:50:04.080290+0000","last_peered":"2024-04-25T08:50:04.080290+0000","last_clean":"2024-04-25T08:50:04.080290+0000","last_became_active":"2024-04-25T08:50:03.091122+0000","last_became_peered":"2024-04-25T08:50:03.091122+0000","last_unstale":"2024-04-25T08:50:04.080290+0000","last_undegraded":"2024-04-25T08:50:04.080290+0000","last_fullsized":"2024-04-25T08:50:04.080290+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.471582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664255+0000","last_change":"2024-04-25T08:50:02.083632+0000","last_active":"2024-04-25T08:50:04.664255+0000","last_peered":"2024-04-25T08:50:04.664255+0000","last_clean":"2024-04-25T08:50:04.664255+0000","last_became_active":"2024-04-25T08:50:02.083104+0000","last_became_peered":"2024-04-25T08:50:02.083104+0000","last_unstale":"2024-04-25T08:50:04.664255+0000","last_undegraded":"2024-04-25T08:50:04.664255+0000","last_fullsized":"2024-04-25T08:50:04.664255+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:09.538074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664842+0000","last_change":"2024-04-25T08:50:03.092131+0000","last_active":"2024-04-25T08:50:04.664842+0000","last_peered":"2024-04-25T08:50:04.664842+0000","last_clean":"2024-04-25T08:50:04.664842+0000","last_became_active":"2024-04-25T08:50:03.091833+0000","last_became_peered":"2024-04-25T08:50:03.091833+0000","last_unstale":"2024-04-25T08:50:04.664842+0000","last_undegraded":"2024-04-25T08:50:04.664842+0000","last_fullsized":"2024-04-25T08:50:04.664842+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:45.686350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162852+0000","last_change":"2024-04-25T08:50:02.082033+0000","last_active":"2024-04-25T08:50:04.162852+0000","last_peered":"2024-04-25T08:50:04.162852+0000","last_clean":"2024-04-25T08:50:04.162852+0000","last_became_active":"2024-04-25T08:50:02.081774+0000","last_became_peered":"2024-04-25T08:50:02.081774+0000","last_unstale":"2024-04-25T08:50:04.162852+0000","last_undegraded":"2024-04-25T08:50:04.162852+0000","last_fullsized":"2024-04-25T08:50:04.162852+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:58.356108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162747+0000","last_change":"2024-04-25T08:50:03.092711+0000","last_active":"2024-04-25T08:50:04.162747+0000","last_peered":"2024-04-25T08:50:04.162747+0000","last_clean":"2024-04-25T08:50:04.162747+0000","last_became_active":"2024-04-25T08:50:03.092474+0000","last_became_peered":"2024-04-25T08:50:03.092474+0000","last_unstale":"2024-04-25T08:50:04.162747+0000","last_undegraded":"2024-04-25T08:50:04.162747+0000","last_fullsized":"2024-04-25T08:50:04.162747+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:54.643336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664650+0000","last_change":"2024-04-25T08:50:02.074475+0000","last_active":"2024-04-25T08:50:04.664650+0000","last_peered":"2024-04-25T08:50:04.664650+0000","last_clean":"2024-04-25T08:50:04.664650+0000","last_became_active":"2024-04-25T08:50:02.074173+0000","last_became_peered":"2024-04-25T08:50:02.074173+0000","last_unstale":"2024-04-25T08:50:04.664650+0000","last_undegraded":"2024-04-25T08:50:04.664650+0000","last_fullsized":"2024-04-25T08:50:04.664650+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:28.415330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663991+0000","last_change":"2024-04-25T08:50:03.091258+0000","last_active":"2024-04-25T08:50:04.663991+0000","last_peered":"2024-04-25T08:50:04.663991+0000","last_clean":"2024-04-25T08:50:04.663991+0000","last_became_active":"2024-04-25T08:50:03.090867+0000","last_became_peered":"2024-04-25T08:50:03.090867+0000","last_unstale":"2024-04-25T08:50:04.663991+0000","last_undegraded":"2024-04-25T08:50:04.663991+0000","last_fullsized":"2024-04-25T08:50:04.663991+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.595974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663816+0000","last_change":"2024-04-25T08:50:02.085704+0000","last_active":"2024-04-25T08:50:04.663816+0000","last_peered":"2024-04-25T08:50:04.663816+0000","last_clean":"2024-04-25T08:50:04.663816+0000","last_became_active":"2024-04-25T08:50:02.085375+0000","last_became_peered":"2024-04-25T08:50:02.085375+0000","last_unstale":"2024-04-25T08:50:04.663816+0000","last_undegraded":"2024-04-25T08:50:04.663816+0000","last_fullsized":"2024-04-25T08:50:04.663816+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:25.593368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664128+0000","last_change":"2024-04-25T08:50:03.090480+0000","last_active":"2024-04-25T08:50:04.664128+0000","last_peered":"2024-04-25T08:50:04.664128+0000","last_clean":"2024-04-25T08:50:04.664128+0000","last_became_active":"2024-04-25T08:50:03.090217+0000","last_became_peered":"2024-04-25T08:50:03.090217+0000","last_unstale":"2024-04-25T08:50:04.664128+0000","last_undegraded":"2024-04-25T08:50:04.664128+0000","last_fullsized":"2024-04-25T08:50:04.664128+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:47.652886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080649+0000","last_change":"2024-04-25T08:50:02.073246+0000","last_active":"2024-04-25T08:50:04.080649+0000","last_peered":"2024-04-25T08:50:04.080649+0000","last_clean":"2024-04-25T08:50:04.080649+0000","last_became_active":"2024-04-25T08:50:02.072888+0000","last_became_peered":"2024-04-25T08:50:02.072888+0000","last_unstale":"2024-04-25T08:50:04.080649+0000","last_undegraded":"2024-04-25T08:50:04.080649+0000","last_fullsized":"2024-04-25T08:50:04.080649+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:09.538074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163159+0000","last_change":"2024-04-25T08:50:03.087901+0000","last_active":"2024-04-25T08:50:04.163159+0000","last_peered":"2024-04-25T08:50:04.163159+0000","last_clean":"2024-04-25T08:50:04.163159+0000","last_became_active":"2024-04-25T08:50:03.087647+0000","last_became_peered":"2024-04-25T08:50:03.087647+0000","last_unstale":"2024-04-25T08:50:04.163159+0000","last_undegraded":"2024-04-25T08:50:04.163159+0000","last_fullsized":"2024-04-25T08:50:04.163159+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:58.831107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663781+0000","last_change":"2024-04-25T08:50:02.082940+0000","last_active":"2024-04-25T08:50:04.663781+0000","last_peered":"2024-04-25T08:50:04.663781+0000","last_clean":"2024-04-25T08:50:04.663781+0000","last_became_active":"2024-04-25T08:50:02.082621+0000","last_became_peered":"2024-04-25T08:50:02.082621+0000","last_unstale":"2024-04-25T08:50:04.663781+0000","last_undegraded":"2024-04-25T08:50:04.663781+0000","last_fullsized":"2024-04-25T08:50:04.663781+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:42.849146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079668+0000","last_change":"2024-04-25T08:50:03.092892+0000","last_active":"2024-04-25T08:50:04.079668+0000","last_peered":"2024-04-25T08:50:04.079668+0000","last_clean":"2024-04-25T08:50:04.079668+0000","last_became_active":"2024-04-25T08:50:03.092437+0000","last_became_peered":"2024-04-25T08:50:03.092437+0000","last_unstale":"2024-04-25T08:50:04.079668+0000","last_undegraded":"2024-04-25T08:50:04.079668+0000","last_fullsized":"2024-04-25T08:50:04.079668+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.595974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079832+0000","last_change":"2024-04-25T08:50:02.077511+0000","last_active":"2024-04-25T08:50:04.079832+0000","last_peered":"2024-04-25T08:50:04.079832+0000","last_clean":"2024-04-25T08:50:04.079832+0000","last_became_active":"2024-04-25T08:50:02.077219+0000","last_became_peered":"2024-04-25T08:50:02.077219+0000","last_unstale":"2024-04-25T08:50:04.079832+0000","last_undegraded":"2024-04-25T08:50:04.079832+0000","last_fullsized":"2024-04-25T08:50:04.079832+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:21.732361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080718+0000","last_change":"2024-04-25T08:50:03.085507+0000","last_active":"2024-04-25T08:50:04.080718+0000","last_peered":"2024-04-25T08:50:04.080718+0000","last_clean":"2024-04-25T08:50:04.080718+0000","last_became_active":"2024-04-25T08:50:03.085189+0000","last_became_peered":"2024-04-25T08:50:03.085189+0000","last_unstale":"2024-04-25T08:50:04.080718+0000","last_undegraded":"2024-04-25T08:50:04.080718+0000","last_fullsized":"2024-04-25T08:50:04.080718+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:06.366290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080366+0000","last_change":"2024-04-25T08:50:02.076416+0000","last_active":"2024-04-25T08:50:04.080366+0000","last_peered":"2024-04-25T08:50:04.080366+0000","last_clean":"2024-04-25T08:50:04.080366+0000","last_became_active":"2024-04-25T08:50:02.076119+0000","last_became_peered":"2024-04-25T08:50:02.076119+0000","last_unstale":"2024-04-25T08:50:04.080366+0000","last_undegraded":"2024-04-25T08:50:04.080366+0000","last_fullsized":"2024-04-25T08:50:04.080366+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:32.281430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664055+0000","last_change":"2024-04-25T08:50:03.103615+0000","last_active":"2024-04-25T08:50:04.664055+0000","last_peered":"2024-04-25T08:50:04.664055+0000","last_clean":"2024-04-25T08:50:04.664055+0000","last_became_active":"2024-04-25T08:50:03.103306+0000","last_became_peered":"2024-04-25T08:50:03.103306+0000","last_unstale":"2024-04-25T08:50:04.664055+0000","last_undegraded":"2024-04-25T08:50:04.664055+0000","last_fullsized":"2024-04-25T08:50:04.664055+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:11.118378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"118'3","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080682+0000","last_change":"2024-04-25T08:50:02.076560+0000","last_active":"2024-04-25T08:50:04.080682+0000","last_peered":"2024-04-25T08:50:04.080682+0000","last_clean":"2024-04-25T08:50:04.080682+0000","last_became_active":"2024-04-25T08:50:02.076223+0000","last_became_peered":"2024-04-25T08:50:02.076223+0000","last_unstale":"2024-04-25T08:50:04.080682+0000","last_undegraded":"2024-04-25T08:50:04.080682+0000","last_fullsized":"2024-04-25T08:50:04.080682+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:33.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080520+0000","last_change":"2024-04-25T08:50:03.085192+0000","last_active":"2024-04-25T08:50:04.080520+0000","last_peered":"2024-04-25T08:50:04.080520+0000","last_clean":"2024-04-25T08:50:04.080520+0000","last_became_active":"2024-04-25T08:50:03.084418+0000","last_became_peered":"2024-04-25T08:50:03.084418+0000","last_unstale":"2024-04-25T08:50:04.080520+0000","last_undegraded":"2024-04-25T08:50:04.080520+0000","last_fullsized":"2024-04-25T08:50:04.080520+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:25.834512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"118'6","reported_seq":20,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663670+0000","last_change":"2024-04-25T08:50:02.078543+0000","last_active":"2024-04-25T08:50:04.663670+0000","last_peered":"2024-04-25T08:50:04.663670+0000","last_clean":"2024-04-25T08:50:04.663670+0000","last_became_active":"2024-04-25T08:50:02.078253+0000","last_became_peered":"2024-04-25T08:50:02.078253+0000","last_unstale":"2024-04-25T08:50:04.663670+0000","last_undegraded":"2024-04-25T08:50:04.663670+0000","last_fullsized":"2024-04-25T08:50:04.663670+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:05.277315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079923+0000","last_change":"2024-04-25T08:50:03.103835+0000","last_active":"2024-04-25T08:50:04.079923+0000","last_peered":"2024-04-25T08:50:04.079923+0000","last_clean":"2024-04-25T08:50:04.079923+0000","last_became_active":"2024-04-25T08:50:03.103532+0000","last_became_peered":"2024-04-25T08:50:03.103532+0000","last_unstale":"2024-04-25T08:50:04.079923+0000","last_undegraded":"2024-04-25T08:50:04.079923+0000","last_fullsized":"2024-04-25T08:50:04.079923+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:20.612457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664231+0000","last_change":"2024-04-25T08:50:02.083574+0000","last_active":"2024-04-25T08:50:04.664231+0000","last_peered":"2024-04-25T08:50:04.664231+0000","last_clean":"2024-04-25T08:50:04.664231+0000","last_became_active":"2024-04-25T08:50:02.083326+0000","last_became_peered":"2024-04-25T08:50:02.083326+0000","last_unstale":"2024-04-25T08:50:04.664231+0000","last_undegraded":"2024-04-25T08:50:04.664231+0000","last_fullsized":"2024-04-25T08:50:04.664231+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:59.293720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162827+0000","last_change":"2024-04-25T08:50:03.090014+0000","last_active":"2024-04-25T08:50:04.162827+0000","last_peered":"2024-04-25T08:50:04.162827+0000","last_clean":"2024-04-25T08:50:04.162827+0000","last_became_active":"2024-04-25T08:50:03.089739+0000","last_became_peered":"2024-04-25T08:50:03.089739+0000","last_unstale":"2024-04-25T08:50:04.162827+0000","last_undegraded":"2024-04-25T08:50:04.162827+0000","last_fullsized":"2024-04-25T08:50:04.162827+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:13.606209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664307+0000","last_change":"2024-04-25T08:50:02.079080+0000","last_active":"2024-04-25T08:50:04.664307+0000","last_peered":"2024-04-25T08:50:04.664307+0000","last_clean":"2024-04-25T08:50:04.664307+0000","last_became_active":"2024-04-25T08:50:02.078832+0000","last_became_peered":"2024-04-25T08:50:02.078832+0000","last_unstale":"2024-04-25T08:50:04.664307+0000","last_undegraded":"2024-04-25T08:50:04.664307+0000","last_fullsized":"2024-04-25T08:50:04.664307+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.721245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078247+0000","last_change":"2024-04-25T08:50:03.096069+0000","last_active":"2024-04-25T08:50:04.078247+0000","last_peered":"2024-04-25T08:50:04.078247+0000","last_clean":"2024-04-25T08:50:04.078247+0000","last_became_active":"2024-04-25T08:50:03.095806+0000","last_became_peered":"2024-04-25T08:50:03.095806+0000","last_unstale":"2024-04-25T08:50:04.078247+0000","last_undegraded":"2024-04-25T08:50:04.078247+0000","last_fullsized":"2024-04-25T08:50:04.078247+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:00.333557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663456+0000","last_change":"2024-04-25T08:50:02.072977+0000","last_active":"2024-04-25T08:50:04.663456+0000","last_peered":"2024-04-25T08:50:04.663456+0000","last_clean":"2024-04-25T08:50:04.663456+0000","last_became_active":"2024-04-25T08:50:02.072719+0000","last_became_peered":"2024-04-25T08:50:02.072719+0000","last_unstale":"2024-04-25T08:50:04.663456+0000","last_undegraded":"2024-04-25T08:50:04.663456+0000","last_fullsized":"2024-04-25T08:50:04.663456+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:08.461773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080145+0000","last_change":"2024-04-25T08:50:03.094607+0000","last_active":"2024-04-25T08:50:04.080145+0000","last_peered":"2024-04-25T08:50:04.080145+0000","last_clean":"2024-04-25T08:50:04.080145+0000","last_became_active":"2024-04-25T08:50:03.092900+0000","last_became_peered":"2024-04-25T08:50:03.092900+0000","last_unstale":"2024-04-25T08:50:04.080145+0000","last_undegraded":"2024-04-25T08:50:04.080145+0000","last_fullsized":"2024-04-25T08:50:04.080145+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:05.072692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163025+0000","last_change":"2024-04-25T08:50:02.079266+0000","last_active":"2024-04-25T08:50:04.163025+0000","last_peered":"2024-04-25T08:50:04.163025+0000","last_clean":"2024-04-25T08:50:04.163025+0000","last_became_active":"2024-04-25T08:50:02.078977+0000","last_became_peered":"2024-04-25T08:50:02.078977+0000","last_unstale":"2024-04-25T08:50:04.163025+0000","last_undegraded":"2024-04-25T08:50:04.163025+0000","last_fullsized":"2024-04-25T08:50:04.163025+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:14.855134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.665015+0000","last_change":"2024-04-25T08:50:03.084180+0000","last_active":"2024-04-25T08:50:04.665015+0000","last_peered":"2024-04-25T08:50:04.665015+0000","last_clean":"2024-04-25T08:50:04.665015+0000","last_became_active":"2024-04-25T08:50:03.083891+0000","last_became_peered":"2024-04-25T08:50:03.083891+0000","last_unstale":"2024-04-25T08:50:04.665015+0000","last_undegraded":"2024-04-25T08:50:04.665015+0000","last_fullsized":"2024-04-25T08:50:04.665015+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:33.288673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078385+0000","last_change":"2024-04-25T08:50:02.082798+0000","last_active":"2024-04-25T08:50:04.078385+0000","last_peered":"2024-04-25T08:50:04.078385+0000","last_clean":"2024-04-25T08:50:04.078385+0000","last_became_active":"2024-04-25T08:50:02.082560+0000","last_became_peered":"2024-04-25T08:50:02.082560+0000","last_unstale":"2024-04-25T08:50:04.078385+0000","last_undegraded":"2024-04-25T08:50:04.078385+0000","last_fullsized":"2024-04-25T08:50:04.078385+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:52.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663780+0000","last_change":"2024-04-25T08:50:03.100304+0000","last_active":"2024-04-25T08:50:04.663780+0000","last_peered":"2024-04-25T08:50:04.663780+0000","last_clean":"2024-04-25T08:50:04.663780+0000","last_became_active":"2024-04-25T08:50:03.100055+0000","last_became_peered":"2024-04-25T08:50:03.100055+0000","last_unstale":"2024-04-25T08:50:04.663780+0000","last_undegraded":"2024-04-25T08:50:04.663780+0000","last_fullsized":"2024-04-25T08:50:04.663780+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664314+0000","last_change":"2024-04-25T08:50:02.081703+0000","last_active":"2024-04-25T08:50:04.664314+0000","last_peered":"2024-04-25T08:50:04.664314+0000","last_clean":"2024-04-25T08:50:04.664314+0000","last_became_active":"2024-04-25T08:50:02.081328+0000","last_became_peered":"2024-04-25T08:50:02.081328+0000","last_unstale":"2024-04-25T08:50:04.664314+0000","last_undegraded":"2024-04-25T08:50:04.664314+0000","last_fullsized":"2024-04-25T08:50:04.664314+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:33.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080457+0000","last_change":"2024-04-25T08:50:03.088415+0000","last_active":"2024-04-25T08:50:04.080457+0000","last_peered":"2024-04-25T08:50:04.080457+0000","last_clean":"2024-04-25T08:50:04.080457+0000","last_became_active":"2024-04-25T08:50:03.087949+0000","last_became_peered":"2024-04-25T08:50:03.087949+0000","last_unstale":"2024-04-25T08:50:04.080457+0000","last_undegraded":"2024-04-25T08:50:04.080457+0000","last_fullsized":"2024-04-25T08:50:04.080457+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:04.537221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664248+0000","last_change":"2024-04-25T08:50:02.086426+0000","last_active":"2024-04-25T08:50:04.664248+0000","last_peered":"2024-04-25T08:50:04.664248+0000","last_clean":"2024-04-25T08:50:04.664248+0000","last_became_active":"2024-04-25T08:50:02.086059+0000","last_became_peered":"2024-04-25T08:50:02.086059+0000","last_unstale":"2024-04-25T08:50:04.664248+0000","last_undegraded":"2024-04-25T08:50:04.664248+0000","last_fullsized":"2024-04-25T08:50:04.664248+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:16.588730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663524+0000","last_change":"2024-04-25T08:50:03.096304+0000","last_active":"2024-04-25T08:50:04.663524+0000","last_peered":"2024-04-25T08:50:04.663524+0000","last_clean":"2024-04-25T08:50:04.663524+0000","last_became_active":"2024-04-25T08:50:03.096043+0000","last_became_peered":"2024-04-25T08:50:03.096043+0000","last_unstale":"2024-04-25T08:50:04.663524+0000","last_undegraded":"2024-04-25T08:50:04.663524+0000","last_fullsized":"2024-04-25T08:50:04.663524+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:46.407666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663336+0000","last_change":"2024-04-25T08:50:02.085212+0000","last_active":"2024-04-25T08:50:04.663336+0000","last_peered":"2024-04-25T08:50:04.663336+0000","last_clean":"2024-04-25T08:50:04.663336+0000","last_became_active":"2024-04-25T08:50:02.084943+0000","last_became_peered":"2024-04-25T08:50:02.084943+0000","last_unstale":"2024-04-25T08:50:04.663336+0000","last_undegraded":"2024-04-25T08:50:04.663336+0000","last_fullsized":"2024-04-25T08:50:04.663336+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:49.954755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663336+0000","last_change":"2024-04-25T08:50:03.085752+0000","last_active":"2024-04-25T08:50:04.663336+0000","last_peered":"2024-04-25T08:50:04.663336+0000","last_clean":"2024-04-25T08:50:04.663336+0000","last_became_active":"2024-04-25T08:50:03.085408+0000","last_became_peered":"2024-04-25T08:50:03.085408+0000","last_unstale":"2024-04-25T08:50:04.663336+0000","last_undegraded":"2024-04-25T08:50:04.663336+0000","last_fullsized":"2024-04-25T08:50:04.663336+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:20.021349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663953+0000","last_change":"2024-04-25T08:50:02.081268+0000","last_active":"2024-04-25T08:50:04.663953+0000","last_peered":"2024-04-25T08:50:04.663953+0000","last_clean":"2024-04-25T08:50:04.663953+0000","last_became_active":"2024-04-25T08:50:02.080964+0000","last_became_peered":"2024-04-25T08:50:02.080964+0000","last_unstale":"2024-04-25T08:50:04.663953+0000","last_undegraded":"2024-04-25T08:50:04.663953+0000","last_fullsized":"2024-04-25T08:50:04.663953+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:12.598965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664312+0000","last_change":"2024-04-25T08:50:03.100463+0000","last_active":"2024-04-25T08:50:04.664312+0000","last_peered":"2024-04-25T08:50:04.664312+0000","last_clean":"2024-04-25T08:50:04.664312+0000","last_became_active":"2024-04-25T08:50:03.100200+0000","last_became_peered":"2024-04-25T08:50:03.100200+0000","last_unstale":"2024-04-25T08:50:04.664312+0000","last_undegraded":"2024-04-25T08:50:04.664312+0000","last_fullsized":"2024-04-25T08:50:04.664312+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:42.859558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663537+0000","last_change":"2024-04-25T08:50:02.086635+0000","last_active":"2024-04-25T08:50:04.663537+0000","last_peered":"2024-04-25T08:50:04.663537+0000","last_clean":"2024-04-25T08:50:04.663537+0000","last_became_active":"2024-04-25T08:50:02.086331+0000","last_became_peered":"2024-04-25T08:50:02.086331+0000","last_unstale":"2024-04-25T08:50:04.663537+0000","last_undegraded":"2024-04-25T08:50:04.663537+0000","last_fullsized":"2024-04-25T08:50:04.663537+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:33.443820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080787+0000","last_change":"2024-04-25T08:50:03.087103+0000","last_active":"2024-04-25T08:50:04.080787+0000","last_peered":"2024-04-25T08:50:04.080787+0000","last_clean":"2024-04-25T08:50:04.080787+0000","last_became_active":"2024-04-25T08:50:03.086628+0000","last_became_peered":"2024-04-25T08:50:03.086628+0000","last_unstale":"2024-04-25T08:50:04.080787+0000","last_undegraded":"2024-04-25T08:50:04.080787+0000","last_fullsized":"2024-04-25T08:50:04.080787+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:33.073626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663796+0000","last_change":"2024-04-25T08:50:02.082717+0000","last_active":"2024-04-25T08:50:04.663796+0000","last_peered":"2024-04-25T08:50:04.663796+0000","last_clean":"2024-04-25T08:50:04.663796+0000","last_became_active":"2024-04-25T08:50:02.082396+0000","last_became_peered":"2024-04-25T08:50:02.082396+0000","last_unstale":"2024-04-25T08:50:04.663796+0000","last_undegraded":"2024-04-25T08:50:04.663796+0000","last_fullsized":"2024-04-25T08:50:04.663796+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:40.602926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664010+0000","last_change":"2024-04-25T08:50:03.089650+0000","last_active":"2024-04-25T08:50:04.664010+0000","last_peered":"2024-04-25T08:50:04.664010+0000","last_clean":"2024-04-25T08:50:04.664010+0000","last_became_active":"2024-04-25T08:50:03.089299+0000","last_became_peered":"2024-04-25T08:50:03.089299+0000","last_unstale":"2024-04-25T08:50:04.664010+0000","last_undegraded":"2024-04-25T08:50:04.664010+0000","last_fullsized":"2024-04-25T08:50:04.664010+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:48.677552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664170+0000","last_change":"2024-04-25T08:50:02.080295+0000","last_active":"2024-04-25T08:50:04.664170+0000","last_peered":"2024-04-25T08:50:04.664170+0000","last_clean":"2024-04-25T08:50:04.664170+0000","last_became_active":"2024-04-25T08:50:02.080040+0000","last_became_peered":"2024-04-25T08:50:02.080040+0000","last_unstale":"2024-04-25T08:50:04.664170+0000","last_undegraded":"2024-04-25T08:50:04.664170+0000","last_fullsized":"2024-04-25T08:50:04.664170+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:11.835185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162913+0000","last_change":"2024-04-25T08:50:03.098535+0000","last_active":"2024-04-25T08:50:04.162913+0000","last_peered":"2024-04-25T08:50:04.162913+0000","last_clean":"2024-04-25T08:50:04.162913+0000","last_became_active":"2024-04-25T08:50:03.098281+0000","last_became_peered":"2024-04-25T08:50:03.098281+0000","last_unstale":"2024-04-25T08:50:04.162913+0000","last_undegraded":"2024-04-25T08:50:04.162913+0000","last_fullsized":"2024-04-25T08:50:04.162913+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:20.612457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"119'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079815+0000","last_change":"2024-04-25T08:50:02.083438+0000","last_active":"2024-04-25T08:50:04.079815+0000","last_peered":"2024-04-25T08:50:04.079815+0000","last_clean":"2024-04-25T08:50:04.079815+0000","last_became_active":"2024-04-25T08:50:02.082990+0000","last_became_peered":"2024-04-25T08:50:02.082990+0000","last_unstale":"2024-04-25T08:50:04.079815+0000","last_undegraded":"2024-04-25T08:50:04.079815+0000","last_fullsized":"2024-04-25T08:50:04.079815+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:30.972003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664567+0000","last_change":"2024-04-25T08:50:03.096565+0000","last_active":"2024-04-25T08:50:04.664567+0000","last_peered":"2024-04-25T08:50:04.664567+0000","last_clean":"2024-04-25T08:50:04.664567+0000","last_became_active":"2024-04-25T08:50:03.096260+0000","last_became_peered":"2024-04-25T08:50:03.096260+0000","last_unstale":"2024-04-25T08:50:04.664567+0000","last_undegraded":"2024-04-25T08:50:04.664567+0000","last_fullsized":"2024-04-25T08:50:04.664567+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:34.032156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080243+0000","last_change":"2024-04-25T08:50:02.086504+0000","last_active":"2024-04-25T08:50:04.080243+0000","last_peered":"2024-04-25T08:50:04.080243+0000","last_clean":"2024-04-25T08:50:04.080243+0000","last_became_active":"2024-04-25T08:50:02.086170+0000","last_became_peered":"2024-04-25T08:50:02.086170+0000","last_unstale":"2024-04-25T08:50:04.080243+0000","last_undegraded":"2024-04-25T08:50:04.080243+0000","last_fullsized":"2024-04-25T08:50:04.080243+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:08.291556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078398+0000","last_change":"2024-04-25T08:50:03.086537+0000","last_active":"2024-04-25T08:50:04.078398+0000","last_peered":"2024-04-25T08:50:04.078398+0000","last_clean":"2024-04-25T08:50:04.078398+0000","last_became_active":"2024-04-25T08:50:03.086277+0000","last_became_peered":"2024-04-25T08:50:03.086277+0000","last_unstale":"2024-04-25T08:50:04.078398+0000","last_undegraded":"2024-04-25T08:50:04.078398+0000","last_fullsized":"2024-04-25T08:50:04.078398+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:32.514738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664092+0000","last_change":"2024-04-25T08:50:02.077343+0000","last_active":"2024-04-25T08:50:04.664092+0000","last_peered":"2024-04-25T08:50:04.664092+0000","last_clean":"2024-04-25T08:50:04.664092+0000","last_became_active":"2024-04-25T08:50:02.077099+0000","last_became_peered":"2024-04-25T08:50:02.077099+0000","last_unstale":"2024-04-25T08:50:04.664092+0000","last_undegraded":"2024-04-25T08:50:04.664092+0000","last_fullsized":"2024-04-25T08:50:04.664092+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:47.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663683+0000","last_change":"2024-04-25T08:50:03.095799+0000","last_active":"2024-04-25T08:50:04.663683+0000","last_peered":"2024-04-25T08:50:04.663683+0000","last_clean":"2024-04-25T08:50:04.663683+0000","last_became_active":"2024-04-25T08:50:03.095324+0000","last_became_peered":"2024-04-25T08:50:03.095324+0000","last_unstale":"2024-04-25T08:50:04.663683+0000","last_undegraded":"2024-04-25T08:50:04.663683+0000","last_fullsized":"2024-04-25T08:50:04.663683+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:25.353270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664473+0000","last_change":"2024-04-25T08:50:02.075038+0000","last_active":"2024-04-25T08:50:04.664473+0000","last_peered":"2024-04-25T08:50:04.664473+0000","last_clean":"2024-04-25T08:50:04.664473+0000","last_became_active":"2024-04-25T08:50:02.074730+0000","last_became_peered":"2024-04-25T08:50:02.074730+0000","last_unstale":"2024-04-25T08:50:04.664473+0000","last_undegraded":"2024-04-25T08:50:04.664473+0000","last_fullsized":"2024-04-25T08:50:04.664473+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:21.732361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664337+0000","last_change":"2024-04-25T08:50:03.093751+0000","last_active":"2024-04-25T08:50:04.664337+0000","last_peered":"2024-04-25T08:50:04.664337+0000","last_clean":"2024-04-25T08:50:04.664337+0000","last_became_active":"2024-04-25T08:50:03.093486+0000","last_became_peered":"2024-04-25T08:50:03.093486+0000","last_unstale":"2024-04-25T08:50:04.664337+0000","last_undegraded":"2024-04-25T08:50:04.664337+0000","last_fullsized":"2024-04-25T08:50:04.664337+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:42.347387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664583+0000","last_change":"2024-04-25T08:50:02.072807+0000","last_active":"2024-04-25T08:50:04.664583+0000","last_peered":"2024-04-25T08:50:04.664583+0000","last_clean":"2024-04-25T08:50:04.664583+0000","last_became_active":"2024-04-25T08:50:02.072510+0000","last_became_peered":"2024-04-25T08:50:02.072510+0000","last_unstale":"2024-04-25T08:50:04.664583+0000","last_undegraded":"2024-04-25T08:50:04.664583+0000","last_fullsized":"2024-04-25T08:50:04.664583+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:00.516930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664119+0000","last_change":"2024-04-25T08:50:03.095038+0000","last_active":"2024-04-25T08:50:04.664119+0000","last_peered":"2024-04-25T08:50:04.664119+0000","last_clean":"2024-04-25T08:50:04.664119+0000","last_became_active":"2024-04-25T08:50:03.094758+0000","last_became_peered":"2024-04-25T08:50:03.094758+0000","last_unstale":"2024-04-25T08:50:04.664119+0000","last_undegraded":"2024-04-25T08:50:04.664119+0000","last_fullsized":"2024-04-25T08:50:04.664119+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:36.728489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663468+0000","last_change":"2024-04-25T08:50:02.083029+0000","last_active":"2024-04-25T08:50:04.663468+0000","last_peered":"2024-04-25T08:50:04.663468+0000","last_clean":"2024-04-25T08:50:04.663468+0000","last_became_active":"2024-04-25T08:50:02.082742+0000","last_became_peered":"2024-04-25T08:50:02.082742+0000","last_unstale":"2024-04-25T08:50:04.663468+0000","last_undegraded":"2024-04-25T08:50:04.663468+0000","last_fullsized":"2024-04-25T08:50:04.663468+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:53.196270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163130+0000","last_change":"2024-04-25T08:50:03.092066+0000","last_active":"2024-04-25T08:50:04.163130+0000","last_peered":"2024-04-25T08:50:04.163130+0000","last_clean":"2024-04-25T08:50:04.163130+0000","last_became_active":"2024-04-25T08:50:03.091824+0000","last_became_peered":"2024-04-25T08:50:03.091824+0000","last_unstale":"2024-04-25T08:50:04.163130+0000","last_undegraded":"2024-04-25T08:50:04.163130+0000","last_fullsized":"2024-04-25T08:50:04.163130+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:33.288673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664172+0000","last_change":"2024-04-25T08:50:02.083384+0000","last_active":"2024-04-25T08:50:04.664172+0000","last_peered":"2024-04-25T08:50:04.664172+0000","last_clean":"2024-04-25T08:50:04.664172+0000","last_became_active":"2024-04-25T08:50:02.083099+0000","last_became_peered":"2024-04-25T08:50:02.083099+0000","last_unstale":"2024-04-25T08:50:04.664172+0000","last_undegraded":"2024-04-25T08:50:04.664172+0000","last_fullsized":"2024-04-25T08:50:04.664172+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:19.605213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664872+0000","last_change":"2024-04-25T08:50:03.094055+0000","last_active":"2024-04-25T08:50:04.664872+0000","last_peered":"2024-04-25T08:50:04.664872+0000","last_clean":"2024-04-25T08:50:04.664872+0000","last_became_active":"2024-04-25T08:50:03.093696+0000","last_became_peered":"2024-04-25T08:50:03.093696+0000","last_unstale":"2024-04-25T08:50:04.664872+0000","last_undegraded":"2024-04-25T08:50:04.664872+0000","last_fullsized":"2024-04-25T08:50:04.664872+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:04.537221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"118'8","reported_seq":22,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663322+0000","last_change":"2024-04-25T08:50:02.079489+0000","last_active":"2024-04-25T08:50:04.663322+0000","last_peered":"2024-04-25T08:50:04.663322+0000","last_clean":"2024-04-25T08:50:04.663322+0000","last_became_active":"2024-04-25T08:50:02.079226+0000","last_became_peered":"2024-04-25T08:50:02.079226+0000","last_unstale":"2024-04-25T08:50:04.663322+0000","last_undegraded":"2024-04-25T08:50:04.663322+0000","last_fullsized":"2024-04-25T08:50:04.663322+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:42.701070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":351,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664429+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:50:04.664429+0000","last_peered":"2024-04-25T08:50:04.664429+0000","last_clean":"2024-04-25T08:50:04.664429+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:50:04.664429+0000","last_undegraded":"2024-04-25T08:50:04.664429+0000","last_fullsized":"2024-04-25T08:50:04.664429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41552,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330288,"statfs":{"total":96636764160,"available":96594214912,"internally_reserved":0,"allocated":2093056,"data_stored":1281103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46524,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325316,"statfs":{"total":96636764160,"available":96589123584,"internally_reserved":0,"allocated":1486848,"data_stored":690541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45116,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326724,"statfs":{"total":96636764160,"available":96590565376,"internally_reserved":0,"allocated":1490944,"data_stored":690119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50692,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321148,"statfs":{"total":96636764160,"available":96584855552,"internally_reserved":0,"allocated":1495040,"data_stored":691571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50696,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321144,"statfs":{"total":96636764160,"available":96584851456,"internally_reserved":0,"allocated":1499136,"data_stored":691605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50684,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321156,"statfs":{"total":96636764160,"available":96584863744,"internally_reserved":0,"allocated":1482752,"data_stored":689959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46528,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325312,"statfs":{"total":96636764160,"available":96589119488,"internally_reserved":0,"allocated":1486848,"data_stored":689981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51260,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320580,"statfs":{"total":96636764160,"available":96584273920,"internally_reserved":0,"allocated":2080768,"data_stored":1280349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:50:08.327 INFO:tasks.ceph.mds.c.smithi172.stderr:2024-04-25T08:50:08.336+0000 7f0d9c9b4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:50:10.414 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:50:10.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.534+0000 7f77b655c640 1 Processor -- start 2024-04-25T08:50:10.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.534+0000 7f77b655c640 1 -- start start 2024-04-25T08:50:10.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77b655c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b0144750 0x7f77b006e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77b655c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f77b00cf030 0x7f77b006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77b655c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b0144b30 con 0x7f77b006eb10 2024-04-25T08:50:10.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77b655c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b00712d0 con 0x7f77b00cf030 2024-04-25T08:50:10.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77b655c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00715b0 con 0x7f77b0144750 2024-04-25T08:50:10.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77af7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f77b006eb10 0x7f77b00ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41494/0 (socket says 172.21.15.172:41494) 2024-04-25T08:50:10.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77af7fe640 1 -- 172.21.15.172:0/4154805368 learned_addr learned my addr 172.21.15.172:0/4154805368 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:10.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769761145 0 0) 0x7f77b0144b30 con 0x7f77b006eb10 2024-04-25T08:50:10.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77b4af9640 1 --2- 172.21.15.172:0/4154805368 >> v2:172.21.15.186:3300/0 conn(0x7f77b00cf030 0x7f77b006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77affff640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b0144750 0x7f77b006e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7798003520 con 0x7f77b006eb10 2024-04-25T08:50:10.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3438514934 0 0) 0x7f7798003520 con 0x7f77b006eb10 2024-04-25T08:50:10.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b0144750 msgr2=0x7f77b006e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:10.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b0144750 0x7f77b006e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 >> v2:172.21.15.186:3300/0 conn(0x7f77b00cf030 msgr2=0x7f77b006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:10.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 --2- 172.21.15.172:0/4154805368 >> v2:172.21.15.186:3300/0 conn(0x7f77b00cf030 0x7f77b006d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0071890 con 0x7f77b006eb10 2024-04-25T08:50:10.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f77a4001670 con 0x7f77b006eb10 2024-04-25T08:50:10.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 >> v1:172.21.15.172:6789/0 conn(0x7f77b006eb10 legacy=0x7f77b00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77980039b0 0x7f7798003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7798004800 0x7f7798004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b0144750 0x7f77980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00712d0 con 0x7f77980039b0 2024-04-25T08:50:10.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00715b0 con 0x7f7798004800 2024-04-25T08:50:10.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.535+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779800b9c0 con 0x7f77b0144750 2024-04-25T08:50:10.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.536+0000 7f77affff640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77980039b0 0x7f7798003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.536+0000 7f77af7fe640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7798004800 0x7f7798004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.536+0000 7f77b4af9640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b0144750 0x7f77980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.536+0000 7f77affff640 1 -- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b0144750 msgr2=0x7f77980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:10.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.536+0000 7f77affff640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b0144750 0x7f77980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.536+0000 7f77affff640 1 -- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7798004800 msgr2=0x7f7798004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:10.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.536+0000 7f77affff640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7798004800 0x7f7798004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.536+0000 7f77affff640 1 -- 172.21.15.172:0/4154805368 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798003520 con 0x7f77980039b0 2024-04-25T08:50:10.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77affff640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77980039b0 0x7f7798003dd0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009af0 tx=0x7f7798005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de06282bd45994f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:10.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0036070 con 0x7f77980039b0 2024-04-25T08:50:10.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a0031400 con 0x7f77980039b0 2024-04-25T08:50:10.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77aeffd640 1 -- 172.21.15.172:0/4154805368 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0009690 con 0x7f77980039b0 2024-04-25T08:50:10.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77b655c640 1 -- 172.21.15.172:0/4154805368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77980039b0 msgr2=0x7f7798003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77b655c640 1 --2- 172.21.15.172:0/4154805368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77980039b0 0x7f7798003dd0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009af0 tx=0x7f7798005830 comp rx=0 tx=0).stop 2024-04-25T08:50:10.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77b4af9640 1 -- 172.21.15.172:0/4154805368 reap_dead start 2024-04-25T08:50:10.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77b655c640 1 -- 172.21.15.172:0/4154805368 shutdown_connections 2024-04-25T08:50:10.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77b655c640 1 -- 172.21.15.172:0/4154805368 >> 172.21.15.172:0/4154805368 conn(0x7f77b006abe0 msgr2=0x7f77b006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:10.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77b655c640 1 -- 172.21.15.172:0/4154805368 shutdown_connections 2024-04-25T08:50:10.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.537+0000 7f77b655c640 1 -- 172.21.15.172:0/4154805368 wait complete. 2024-04-25T08:50:10.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.538+0000 7f77b655c640 1 Processor -- start 2024-04-25T08:50:10.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.539+0000 7f77b655c640 1 -- start start 2024-04-25T08:50:10.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.539+0000 7f77b655c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77980039b0 0x7f77b0158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.539+0000 7f77b655c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77b00ad280 0x7f77b00ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.539+0000 7f77b655c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b013d0b0 0x7f77b013d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.539+0000 7f77b655c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b01455d0 con 0x7f77b00ad280 2024-04-25T08:50:10.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.539+0000 7f77b655c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0145450 con 0x7f77980039b0 2024-04-25T08:50:10.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.539+0000 7f77b655c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b015c000 con 0x7f77b013d0b0 2024-04-25T08:50:10.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.539+0000 7f77af7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77b00ad280 0x7f77b00ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77af7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77b00ad280 0x7f77b00ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49902/0 (socket says 172.21.15.172:49902) 2024-04-25T08:50:10.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77af7fe640 1 -- 172.21.15.172:0/1407908406 learned_addr learned my addr 172.21.15.172:0/1407908406 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:10.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77affff640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77980039b0 0x7f77b0158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77b4af9640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b013d0b0 0x7f77b013d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77af7fe640 1 -- 172.21.15.172:0/1407908406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b013d0b0 msgr2=0x7f77b013d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77af7fe640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b013d0b0 0x7f77b013d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77af7fe640 1 -- 172.21.15.172:0/1407908406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77980039b0 msgr2=0x7f77b0158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77af7fe640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77980039b0 0x7f77b0158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77af7fe640 1 -- 172.21.15.172:0/1407908406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b013da70 con 0x7f77b00ad280 2024-04-25T08:50:10.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77affff640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77980039b0 0x7f77b0158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:10.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77b4af9640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b013d0b0 0x7f77b013d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:10.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77af7fe640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77b00ad280 0x7f77b00ad700 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f77a4007370 tx=0x7f77a4007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:10.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77acff9640 1 -- 172.21.15.172:0/1407908406 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a400f9c0 con 0x7f77b00ad280 2024-04-25T08:50:10.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77acff9640 1 -- 172.21.15.172:0/1407908406 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4018070 con 0x7f77b00ad280 2024-04-25T08:50:10.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77acff9640 1 -- 172.21.15.172:0/1407908406 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a400fde0 con 0x7f77b00ad280 2024-04-25T08:50:10.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77b655c640 1 -- 172.21.15.172:0/1407908406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b00adea0 con 0x7f77b00ad280 2024-04-25T08:50:10.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.540+0000 7f77b655c640 1 -- 172.21.15.172:0/1407908406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b00b2980 con 0x7f77b00ad280 2024-04-25T08:50:10.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.541+0000 7f77b655c640 1 -- 172.21.15.172:0/1407908406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b0073990 con 0x7f77b00ad280 2024-04-25T08:50:10.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.542+0000 7f77acff9640 1 -- 172.21.15.172:0/1407908406 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f77a401d460 con 0x7f77b00ad280 2024-04-25T08:50:10.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.542+0000 7f77acff9640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f779c06b500 0x7f779c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.542+0000 7f77acff9640 1 -- 172.21.15.172:0/1407908406 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f77a408a3c0 con 0x7f77b00ad280 2024-04-25T08:50:10.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.542+0000 7f77affff640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f779c06b500 0x7f779c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.543+0000 7f77affff640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f779c06b500 0x7f779c06d9c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f77a0033000 tx=0x7f77a0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:10.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.546+0000 7f77acff9640 1 -- 172.21.15.172:0/1407908406 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f77b013da70 con 0x7f77b00ad280 2024-04-25T08:50:10.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.715+0000 7f77b655c640 1 -- 172.21.15.172:0/1407908406 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77b00adc40 con 0x7f779c06b500 2024-04-25T08:50:10.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.720+0000 7f77acff9640 1 -- 172.21.15.172:0/1407908406 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252463 (secure 0 0 0) 0x7f77a0031400 con 0x7f779c06b500 2024-04-25T08:50:10.714 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:10.715 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:50:10.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 -- 172.21.15.172:0/1407908406 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f779c06b500 msgr2=0x7f779c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f779c06b500 0x7f779c06d9c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f77a0033000 tx=0x7f77a0008030 comp rx=0 tx=0).stop 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 -- 172.21.15.172:0/1407908406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77b00ad280 msgr2=0x7f77b00ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77b00ad280 0x7f77b00ad700 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f77a4007370 tx=0x7f77a4007830 comp rx=0 tx=0).stop 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 -- 172.21.15.172:0/1407908406 shutdown_connections 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f779c06b500 0x7f779c06d9c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77b013d0b0 0x7f77b013d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77b00ad280 0x7f77b00ad700 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 --2- 172.21.15.172:0/1407908406 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77980039b0 0x7f77b0158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 -- 172.21.15.172:0/1407908406 >> 172.21.15.172:0/1407908406 conn(0x7f77b006abe0 msgr2=0x7f77b0140470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 -- 172.21.15.172:0/1407908406 shutdown_connections 2024-04-25T08:50:10.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.724+0000 7f77b655c640 1 -- 172.21.15.172:0/1407908406 wait complete. 2024-04-25T08:50:10.725 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-04-25T08:50:10.606921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":383052,"kb_used_data":12808,"kb_used_omap":12,"kb_used_meta":370099,"kb_avail":754591668,"statfs":{"total":773094113280,"available":772701868032,"internally_reserved":0,"allocated":13115392,"data_stored":6705228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":378981936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001504"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.665073+0000","last_change":"2024-04-25T08:50:03.083394+0000","last_active":"2024-04-25T08:50:04.665073+0000","last_peered":"2024-04-25T08:50:04.665073+0000","last_clean":"2024-04-25T08:50:04.665073+0000","last_became_active":"2024-04-25T08:50:03.082959+0000","last_became_peered":"2024-04-25T08:50:03.082959+0000","last_unstale":"2024-04-25T08:50:04.665073+0000","last_undegraded":"2024-04-25T08:50:04.665073+0000","last_fullsized":"2024-04-25T08:50:04.665073+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:58.831107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663832+0000","last_change":"2024-04-25T08:50:03.091178+0000","last_active":"2024-04-25T08:50:04.663832+0000","last_peered":"2024-04-25T08:50:04.663832+0000","last_clean":"2024-04-25T08:50:04.663832+0000","last_became_active":"2024-04-25T08:50:03.090753+0000","last_became_peered":"2024-04-25T08:50:03.090753+0000","last_unstale":"2024-04-25T08:50:04.663832+0000","last_undegraded":"2024-04-25T08:50:04.663832+0000","last_fullsized":"2024-04-25T08:50:04.663832+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:31.567873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663788+0000","last_change":"2024-04-25T08:50:03.104539+0000","last_active":"2024-04-25T08:50:04.663788+0000","last_peered":"2024-04-25T08:50:04.663788+0000","last_clean":"2024-04-25T08:50:04.663788+0000","last_became_active":"2024-04-25T08:50:03.103082+0000","last_became_peered":"2024-04-25T08:50:03.103082+0000","last_unstale":"2024-04-25T08:50:04.663788+0000","last_undegraded":"2024-04-25T08:50:04.663788+0000","last_fullsized":"2024-04-25T08:50:04.663788+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:52.046203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664542+0000","last_change":"2024-04-25T08:50:03.096493+0000","last_active":"2024-04-25T08:50:04.664542+0000","last_peered":"2024-04-25T08:50:04.664542+0000","last_clean":"2024-04-25T08:50:04.664542+0000","last_became_active":"2024-04-25T08:50:03.096228+0000","last_became_peered":"2024-04-25T08:50:03.096228+0000","last_unstale":"2024-04-25T08:50:04.664542+0000","last_undegraded":"2024-04-25T08:50:04.664542+0000","last_fullsized":"2024-04-25T08:50:04.664542+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:51.195877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664214+0000","last_change":"2024-04-25T08:50:03.093743+0000","last_active":"2024-04-25T08:50:04.664214+0000","last_peered":"2024-04-25T08:50:04.664214+0000","last_clean":"2024-04-25T08:50:04.664214+0000","last_became_active":"2024-04-25T08:50:03.093465+0000","last_became_peered":"2024-04-25T08:50:03.093465+0000","last_unstale":"2024-04-25T08:50:04.664214+0000","last_undegraded":"2024-04-25T08:50:04.664214+0000","last_fullsized":"2024-04-25T08:50:04.664214+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.610170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663949+0000","last_change":"2024-04-25T08:50:03.094410+0000","last_active":"2024-04-25T08:50:04.663949+0000","last_peered":"2024-04-25T08:50:04.663949+0000","last_clean":"2024-04-25T08:50:04.663949+0000","last_became_active":"2024-04-25T08:50:03.094167+0000","last_became_peered":"2024-04-25T08:50:03.094167+0000","last_unstale":"2024-04-25T08:50:04.663949+0000","last_undegraded":"2024-04-25T08:50:04.663949+0000","last_fullsized":"2024-04-25T08:50:04.663949+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:13.993765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663485+0000","last_change":"2024-04-25T08:50:03.092324+0000","last_active":"2024-04-25T08:50:04.663485+0000","last_peered":"2024-04-25T08:50:04.663485+0000","last_clean":"2024-04-25T08:50:04.663485+0000","last_became_active":"2024-04-25T08:50:03.092067+0000","last_became_peered":"2024-04-25T08:50:03.092067+0000","last_unstale":"2024-04-25T08:50:04.663485+0000","last_undegraded":"2024-04-25T08:50:04.663485+0000","last_fullsized":"2024-04-25T08:50:04.663485+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:10.493062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663308+0000","last_change":"2024-04-25T08:50:03.093041+0000","last_active":"2024-04-25T08:50:04.663308+0000","last_peered":"2024-04-25T08:50:04.663308+0000","last_clean":"2024-04-25T08:50:04.663308+0000","last_became_active":"2024-04-25T08:50:03.092794+0000","last_became_peered":"2024-04-25T08:50:03.092794+0000","last_unstale":"2024-04-25T08:50:04.663308+0000","last_undegraded":"2024-04-25T08:50:04.663308+0000","last_fullsized":"2024-04-25T08:50:04.663308+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:59.462552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664749+0000","last_change":"2024-04-25T08:50:03.102503+0000","last_active":"2024-04-25T08:50:04.664749+0000","last_peered":"2024-04-25T08:50:04.664749+0000","last_clean":"2024-04-25T08:50:04.664749+0000","last_became_active":"2024-04-25T08:50:03.102212+0000","last_became_peered":"2024-04-25T08:50:03.102212+0000","last_unstale":"2024-04-25T08:50:04.664749+0000","last_undegraded":"2024-04-25T08:50:04.664749+0000","last_fullsized":"2024-04-25T08:50:04.664749+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:05.072692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162995+0000","last_change":"2024-04-25T08:50:03.091219+0000","last_active":"2024-04-25T08:50:04.162995+0000","last_peered":"2024-04-25T08:50:04.162995+0000","last_clean":"2024-04-25T08:50:04.162995+0000","last_became_active":"2024-04-25T08:50:03.090968+0000","last_became_peered":"2024-04-25T08:50:03.090968+0000","last_unstale":"2024-04-25T08:50:04.162995+0000","last_undegraded":"2024-04-25T08:50:04.162995+0000","last_fullsized":"2024-04-25T08:50:04.162995+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:10.545318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664906+0000","last_change":"2024-04-25T08:50:03.089015+0000","last_active":"2024-04-25T08:50:04.664906+0000","last_peered":"2024-04-25T08:50:04.664906+0000","last_clean":"2024-04-25T08:50:04.664906+0000","last_became_active":"2024-04-25T08:50:03.088752+0000","last_became_peered":"2024-04-25T08:50:03.088752+0000","last_unstale":"2024-04-25T08:50:04.664906+0000","last_undegraded":"2024-04-25T08:50:04.664906+0000","last_fullsized":"2024-04-25T08:50:04.664906+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:34.320207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663699+0000","last_change":"2024-04-25T08:50:03.093214+0000","last_active":"2024-04-25T08:50:04.663699+0000","last_peered":"2024-04-25T08:50:04.663699+0000","last_clean":"2024-04-25T08:50:04.663699+0000","last_became_active":"2024-04-25T08:50:03.092604+0000","last_became_peered":"2024-04-25T08:50:03.092604+0000","last_unstale":"2024-04-25T08:50:04.663699+0000","last_undegraded":"2024-04-25T08:50:04.663699+0000","last_fullsized":"2024-04-25T08:50:04.663699+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:51.099025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162992+0000","last_change":"2024-04-25T08:50:03.084703+0000","last_active":"2024-04-25T08:50:04.162992+0000","last_peered":"2024-04-25T08:50:04.162992+0000","last_clean":"2024-04-25T08:50:04.162992+0000","last_became_active":"2024-04-25T08:50:03.084443+0000","last_became_peered":"2024-04-25T08:50:03.084443+0000","last_unstale":"2024-04-25T08:50:04.162992+0000","last_undegraded":"2024-04-25T08:50:04.162992+0000","last_fullsized":"2024-04-25T08:50:04.162992+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.610170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663787+0000","last_change":"2024-04-25T08:50:03.104218+0000","last_active":"2024-04-25T08:50:04.663787+0000","last_peered":"2024-04-25T08:50:04.663787+0000","last_clean":"2024-04-25T08:50:04.663787+0000","last_became_active":"2024-04-25T08:50:03.103862+0000","last_became_peered":"2024-04-25T08:50:03.103862+0000","last_unstale":"2024-04-25T08:50:04.663787+0000","last_undegraded":"2024-04-25T08:50:04.663787+0000","last_fullsized":"2024-04-25T08:50:04.663787+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:23.630924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664512+0000","last_change":"2024-04-25T08:50:03.085655+0000","last_active":"2024-04-25T08:50:04.664512+0000","last_peered":"2024-04-25T08:50:04.664512+0000","last_clean":"2024-04-25T08:50:04.664512+0000","last_became_active":"2024-04-25T08:50:03.085389+0000","last_became_peered":"2024-04-25T08:50:03.085389+0000","last_unstale":"2024-04-25T08:50:04.664512+0000","last_undegraded":"2024-04-25T08:50:04.664512+0000","last_fullsized":"2024-04-25T08:50:04.664512+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:20.612457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664247+0000","last_change":"2024-04-25T08:50:03.097964+0000","last_active":"2024-04-25T08:50:04.664247+0000","last_peered":"2024-04-25T08:50:04.664247+0000","last_clean":"2024-04-25T08:50:04.664247+0000","last_became_active":"2024-04-25T08:50:03.097718+0000","last_became_peered":"2024-04-25T08:50:03.097718+0000","last_unstale":"2024-04-25T08:50:04.664247+0000","last_undegraded":"2024-04-25T08:50:04.664247+0000","last_fullsized":"2024-04-25T08:50:04.664247+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:22.583129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162994+0000","last_change":"2024-04-25T08:50:03.084017+0000","last_active":"2024-04-25T08:50:04.162994+0000","last_peered":"2024-04-25T08:50:04.162994+0000","last_clean":"2024-04-25T08:50:04.162994+0000","last_became_active":"2024-04-25T08:50:03.083722+0000","last_became_peered":"2024-04-25T08:50:03.083722+0000","last_unstale":"2024-04-25T08:50:04.162994+0000","last_undegraded":"2024-04-25T08:50:04.162994+0000","last_fullsized":"2024-04-25T08:50:04.162994+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:34.320207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663975+0000","last_change":"2024-04-25T08:50:03.090979+0000","last_active":"2024-04-25T08:50:04.663975+0000","last_peered":"2024-04-25T08:50:04.663975+0000","last_clean":"2024-04-25T08:50:04.663975+0000","last_became_active":"2024-04-25T08:50:03.090444+0000","last_became_peered":"2024-04-25T08:50:03.090444+0000","last_unstale":"2024-04-25T08:50:04.663975+0000","last_undegraded":"2024-04-25T08:50:04.663975+0000","last_fullsized":"2024-04-25T08:50:04.663975+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:39.167233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080182+0000","last_change":"2024-04-25T08:50:03.098905+0000","last_active":"2024-04-25T08:50:04.080182+0000","last_peered":"2024-04-25T08:50:04.080182+0000","last_clean":"2024-04-25T08:50:04.080182+0000","last_became_active":"2024-04-25T08:50:03.097870+0000","last_became_peered":"2024-04-25T08:50:03.097870+0000","last_unstale":"2024-04-25T08:50:04.080182+0000","last_undegraded":"2024-04-25T08:50:04.080182+0000","last_fullsized":"2024-04-25T08:50:04.080182+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:41.610170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078264+0000","last_change":"2024-04-25T08:50:03.091722+0000","last_active":"2024-04-25T08:50:04.078264+0000","last_peered":"2024-04-25T08:50:04.078264+0000","last_clean":"2024-04-25T08:50:04.078264+0000","last_became_active":"2024-04-25T08:50:03.091429+0000","last_became_peered":"2024-04-25T08:50:03.091429+0000","last_unstale":"2024-04-25T08:50:04.078264+0000","last_undegraded":"2024-04-25T08:50:04.078264+0000","last_fullsized":"2024-04-25T08:50:04.078264+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:22.146869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664797+0000","last_change":"2024-04-25T08:50:03.094022+0000","last_active":"2024-04-25T08:50:04.664797+0000","last_peered":"2024-04-25T08:50:04.664797+0000","last_clean":"2024-04-25T08:50:04.664797+0000","last_became_active":"2024-04-25T08:50:03.093658+0000","last_became_peered":"2024-04-25T08:50:03.093658+0000","last_unstale":"2024-04-25T08:50:04.664797+0000","last_undegraded":"2024-04-25T08:50:04.664797+0000","last_fullsized":"2024-04-25T08:50:04.664797+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.471582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664456+0000","last_change":"2024-04-25T08:50:03.093892+0000","last_active":"2024-04-25T08:50:04.664456+0000","last_peered":"2024-04-25T08:50:04.664456+0000","last_clean":"2024-04-25T08:50:04.664456+0000","last_became_active":"2024-04-25T08:50:03.093593+0000","last_became_peered":"2024-04-25T08:50:03.093593+0000","last_unstale":"2024-04-25T08:50:04.664456+0000","last_undegraded":"2024-04-25T08:50:04.664456+0000","last_fullsized":"2024-04-25T08:50:04.664456+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:10.545318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664515+0000","last_change":"2024-04-25T08:50:03.095532+0000","last_active":"2024-04-25T08:50:04.664515+0000","last_peered":"2024-04-25T08:50:04.664515+0000","last_clean":"2024-04-25T08:50:04.664515+0000","last_became_active":"2024-04-25T08:50:03.095270+0000","last_became_peered":"2024-04-25T08:50:03.095270+0000","last_unstale":"2024-04-25T08:50:04.664515+0000","last_undegraded":"2024-04-25T08:50:04.664515+0000","last_fullsized":"2024-04-25T08:50:04.664515+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:03.882075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079493+0000","last_change":"2024-04-25T08:50:03.097656+0000","last_active":"2024-04-25T08:50:04.079493+0000","last_peered":"2024-04-25T08:50:04.079493+0000","last_clean":"2024-04-25T08:50:04.079493+0000","last_became_active":"2024-04-25T08:50:03.097370+0000","last_became_peered":"2024-04-25T08:50:03.097370+0000","last_unstale":"2024-04-25T08:50:04.079493+0000","last_undegraded":"2024-04-25T08:50:04.079493+0000","last_fullsized":"2024-04-25T08:50:04.079493+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:51.195877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080279+0000","last_change":"2024-04-25T08:50:03.085479+0000","last_active":"2024-04-25T08:50:04.080279+0000","last_peered":"2024-04-25T08:50:04.080279+0000","last_clean":"2024-04-25T08:50:04.080279+0000","last_became_active":"2024-04-25T08:50:03.084775+0000","last_became_peered":"2024-04-25T08:50:03.084775+0000","last_unstale":"2024-04-25T08:50:04.080279+0000","last_undegraded":"2024-04-25T08:50:04.080279+0000","last_fullsized":"2024-04-25T08:50:04.080279+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:45.686350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078284+0000","last_change":"2024-04-25T08:50:03.086479+0000","last_active":"2024-04-25T08:50:04.078284+0000","last_peered":"2024-04-25T08:50:04.078284+0000","last_clean":"2024-04-25T08:50:04.078284+0000","last_became_active":"2024-04-25T08:50:03.086139+0000","last_became_peered":"2024-04-25T08:50:03.086139+0000","last_unstale":"2024-04-25T08:50:04.078284+0000","last_undegraded":"2024-04-25T08:50:04.078284+0000","last_fullsized":"2024-04-25T08:50:04.078284+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:11.085411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080397+0000","last_change":"2024-04-25T08:50:03.097450+0000","last_active":"2024-04-25T08:50:04.080397+0000","last_peered":"2024-04-25T08:50:04.080397+0000","last_clean":"2024-04-25T08:50:04.080397+0000","last_became_active":"2024-04-25T08:50:03.096608+0000","last_became_peered":"2024-04-25T08:50:03.096608+0000","last_unstale":"2024-04-25T08:50:04.080397+0000","last_undegraded":"2024-04-25T08:50:04.080397+0000","last_fullsized":"2024-04-25T08:50:04.080397+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:10.545318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663832+0000","last_change":"2024-04-25T08:50:03.097012+0000","last_active":"2024-04-25T08:50:04.663832+0000","last_peered":"2024-04-25T08:50:04.663832+0000","last_clean":"2024-04-25T08:50:04.663832+0000","last_became_active":"2024-04-25T08:50:03.096769+0000","last_became_peered":"2024-04-25T08:50:03.096769+0000","last_unstale":"2024-04-25T08:50:04.663832+0000","last_undegraded":"2024-04-25T08:50:04.663832+0000","last_fullsized":"2024-04-25T08:50:04.663832+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:19.681019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078434+0000","last_change":"2024-04-25T08:50:03.088413+0000","last_active":"2024-04-25T08:50:04.078434+0000","last_peered":"2024-04-25T08:50:04.078434+0000","last_clean":"2024-04-25T08:50:04.078434+0000","last_became_active":"2024-04-25T08:50:03.087922+0000","last_became_peered":"2024-04-25T08:50:03.087922+0000","last_unstale":"2024-04-25T08:50:04.078434+0000","last_undegraded":"2024-04-25T08:50:04.078434+0000","last_fullsized":"2024-04-25T08:50:04.078434+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:41.935890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664001+0000","last_change":"2024-04-25T08:50:03.093647+0000","last_active":"2024-04-25T08:50:04.664001+0000","last_peered":"2024-04-25T08:50:04.664001+0000","last_clean":"2024-04-25T08:50:04.664001+0000","last_became_active":"2024-04-25T08:50:03.093390+0000","last_became_peered":"2024-04-25T08:50:03.093390+0000","last_unstale":"2024-04-25T08:50:04.664001+0000","last_undegraded":"2024-04-25T08:50:04.664001+0000","last_fullsized":"2024-04-25T08:50:04.664001+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:10.599016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080688+0000","last_change":"2024-04-25T08:50:03.084656+0000","last_active":"2024-04-25T08:50:04.080688+0000","last_peered":"2024-04-25T08:50:04.080688+0000","last_clean":"2024-04-25T08:50:04.080688+0000","last_became_active":"2024-04-25T08:50:03.084238+0000","last_became_peered":"2024-04-25T08:50:03.084238+0000","last_unstale":"2024-04-25T08:50:04.080688+0000","last_undegraded":"2024-04-25T08:50:04.080688+0000","last_fullsized":"2024-04-25T08:50:04.080688+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:34.456782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079656+0000","last_change":"2024-04-25T08:50:03.094209+0000","last_active":"2024-04-25T08:50:04.079656+0000","last_peered":"2024-04-25T08:50:04.079656+0000","last_clean":"2024-04-25T08:50:04.079656+0000","last_became_active":"2024-04-25T08:50:03.093083+0000","last_became_peered":"2024-04-25T08:50:03.093083+0000","last_unstale":"2024-04-25T08:50:04.079656+0000","last_undegraded":"2024-04-25T08:50:04.079656+0000","last_fullsized":"2024-04-25T08:50:04.079656+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:34.032156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162886+0000","last_change":"2024-04-25T08:50:03.091412+0000","last_active":"2024-04-25T08:50:04.162886+0000","last_peered":"2024-04-25T08:50:04.162886+0000","last_clean":"2024-04-25T08:50:04.162886+0000","last_became_active":"2024-04-25T08:50:03.091180+0000","last_became_peered":"2024-04-25T08:50:03.091180+0000","last_unstale":"2024-04-25T08:50:04.162886+0000","last_undegraded":"2024-04-25T08:50:04.162886+0000","last_fullsized":"2024-04-25T08:50:04.162886+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.595974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"118'4","reported_seq":18,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079772+0000","last_change":"2024-04-25T08:50:02.081818+0000","last_active":"2024-04-25T08:50:04.079772+0000","last_peered":"2024-04-25T08:50:04.079772+0000","last_clean":"2024-04-25T08:50:04.079772+0000","last_became_active":"2024-04-25T08:50:02.081524+0000","last_became_peered":"2024-04-25T08:50:02.081524+0000","last_unstale":"2024-04-25T08:50:04.079772+0000","last_undegraded":"2024-04-25T08:50:04.079772+0000","last_fullsized":"2024-04-25T08:50:04.079772+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:28.415330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663849+0000","last_change":"2024-04-25T08:50:03.095481+0000","last_active":"2024-04-25T08:50:04.663849+0000","last_peered":"2024-04-25T08:50:04.663849+0000","last_clean":"2024-04-25T08:50:04.663849+0000","last_became_active":"2024-04-25T08:50:03.095086+0000","last_became_peered":"2024-04-25T08:50:03.095086+0000","last_unstale":"2024-04-25T08:50:04.663849+0000","last_undegraded":"2024-04-25T08:50:04.663849+0000","last_fullsized":"2024-04-25T08:50:04.663849+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:35.929862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163087+0000","last_change":"2024-04-25T08:50:02.077068+0000","last_active":"2024-04-25T08:50:04.163087+0000","last_peered":"2024-04-25T08:50:04.163087+0000","last_clean":"2024-04-25T08:50:04.163087+0000","last_became_active":"2024-04-25T08:50:02.076808+0000","last_became_peered":"2024-04-25T08:50:02.076808+0000","last_unstale":"2024-04-25T08:50:04.163087+0000","last_undegraded":"2024-04-25T08:50:04.163087+0000","last_fullsized":"2024-04-25T08:50:04.163087+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:02.243038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080290+0000","last_change":"2024-04-25T08:50:03.092884+0000","last_active":"2024-04-25T08:50:04.080290+0000","last_peered":"2024-04-25T08:50:04.080290+0000","last_clean":"2024-04-25T08:50:04.080290+0000","last_became_active":"2024-04-25T08:50:03.091122+0000","last_became_peered":"2024-04-25T08:50:03.091122+0000","last_unstale":"2024-04-25T08:50:04.080290+0000","last_undegraded":"2024-04-25T08:50:04.080290+0000","last_fullsized":"2024-04-25T08:50:04.080290+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:58.471582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664255+0000","last_change":"2024-04-25T08:50:02.083632+0000","last_active":"2024-04-25T08:50:04.664255+0000","last_peered":"2024-04-25T08:50:04.664255+0000","last_clean":"2024-04-25T08:50:04.664255+0000","last_became_active":"2024-04-25T08:50:02.083104+0000","last_became_peered":"2024-04-25T08:50:02.083104+0000","last_unstale":"2024-04-25T08:50:04.664255+0000","last_undegraded":"2024-04-25T08:50:04.664255+0000","last_fullsized":"2024-04-25T08:50:04.664255+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:09.538074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664842+0000","last_change":"2024-04-25T08:50:03.092131+0000","last_active":"2024-04-25T08:50:04.664842+0000","last_peered":"2024-04-25T08:50:04.664842+0000","last_clean":"2024-04-25T08:50:04.664842+0000","last_became_active":"2024-04-25T08:50:03.091833+0000","last_became_peered":"2024-04-25T08:50:03.091833+0000","last_unstale":"2024-04-25T08:50:04.664842+0000","last_undegraded":"2024-04-25T08:50:04.664842+0000","last_fullsized":"2024-04-25T08:50:04.664842+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:45.686350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162852+0000","last_change":"2024-04-25T08:50:02.082033+0000","last_active":"2024-04-25T08:50:04.162852+0000","last_peered":"2024-04-25T08:50:04.162852+0000","last_clean":"2024-04-25T08:50:04.162852+0000","last_became_active":"2024-04-25T08:50:02.081774+0000","last_became_peered":"2024-04-25T08:50:02.081774+0000","last_unstale":"2024-04-25T08:50:04.162852+0000","last_undegraded":"2024-04-25T08:50:04.162852+0000","last_fullsized":"2024-04-25T08:50:04.162852+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:58.356108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162747+0000","last_change":"2024-04-25T08:50:03.092711+0000","last_active":"2024-04-25T08:50:04.162747+0000","last_peered":"2024-04-25T08:50:04.162747+0000","last_clean":"2024-04-25T08:50:04.162747+0000","last_became_active":"2024-04-25T08:50:03.092474+0000","last_became_peered":"2024-04-25T08:50:03.092474+0000","last_unstale":"2024-04-25T08:50:04.162747+0000","last_undegraded":"2024-04-25T08:50:04.162747+0000","last_fullsized":"2024-04-25T08:50:04.162747+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:54.643336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664650+0000","last_change":"2024-04-25T08:50:02.074475+0000","last_active":"2024-04-25T08:50:04.664650+0000","last_peered":"2024-04-25T08:50:04.664650+0000","last_clean":"2024-04-25T08:50:04.664650+0000","last_became_active":"2024-04-25T08:50:02.074173+0000","last_became_peered":"2024-04-25T08:50:02.074173+0000","last_unstale":"2024-04-25T08:50:04.664650+0000","last_undegraded":"2024-04-25T08:50:04.664650+0000","last_fullsized":"2024-04-25T08:50:04.664650+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:28.415330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663991+0000","last_change":"2024-04-25T08:50:03.091258+0000","last_active":"2024-04-25T08:50:04.663991+0000","last_peered":"2024-04-25T08:50:04.663991+0000","last_clean":"2024-04-25T08:50:04.663991+0000","last_became_active":"2024-04-25T08:50:03.090867+0000","last_became_peered":"2024-04-25T08:50:03.090867+0000","last_unstale":"2024-04-25T08:50:04.663991+0000","last_undegraded":"2024-04-25T08:50:04.663991+0000","last_fullsized":"2024-04-25T08:50:04.663991+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.595974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663816+0000","last_change":"2024-04-25T08:50:02.085704+0000","last_active":"2024-04-25T08:50:04.663816+0000","last_peered":"2024-04-25T08:50:04.663816+0000","last_clean":"2024-04-25T08:50:04.663816+0000","last_became_active":"2024-04-25T08:50:02.085375+0000","last_became_peered":"2024-04-25T08:50:02.085375+0000","last_unstale":"2024-04-25T08:50:04.663816+0000","last_undegraded":"2024-04-25T08:50:04.663816+0000","last_fullsized":"2024-04-25T08:50:04.663816+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:25.593368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664128+0000","last_change":"2024-04-25T08:50:03.090480+0000","last_active":"2024-04-25T08:50:04.664128+0000","last_peered":"2024-04-25T08:50:04.664128+0000","last_clean":"2024-04-25T08:50:04.664128+0000","last_became_active":"2024-04-25T08:50:03.090217+0000","last_became_peered":"2024-04-25T08:50:03.090217+0000","last_unstale":"2024-04-25T08:50:04.664128+0000","last_undegraded":"2024-04-25T08:50:04.664128+0000","last_fullsized":"2024-04-25T08:50:04.664128+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:47.652886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080649+0000","last_change":"2024-04-25T08:50:02.073246+0000","last_active":"2024-04-25T08:50:04.080649+0000","last_peered":"2024-04-25T08:50:04.080649+0000","last_clean":"2024-04-25T08:50:04.080649+0000","last_became_active":"2024-04-25T08:50:02.072888+0000","last_became_peered":"2024-04-25T08:50:02.072888+0000","last_unstale":"2024-04-25T08:50:04.080649+0000","last_undegraded":"2024-04-25T08:50:04.080649+0000","last_fullsized":"2024-04-25T08:50:04.080649+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:09.538074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163159+0000","last_change":"2024-04-25T08:50:03.087901+0000","last_active":"2024-04-25T08:50:04.163159+0000","last_peered":"2024-04-25T08:50:04.163159+0000","last_clean":"2024-04-25T08:50:04.163159+0000","last_became_active":"2024-04-25T08:50:03.087647+0000","last_became_peered":"2024-04-25T08:50:03.087647+0000","last_unstale":"2024-04-25T08:50:04.163159+0000","last_undegraded":"2024-04-25T08:50:04.163159+0000","last_fullsized":"2024-04-25T08:50:04.163159+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:58.831107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663781+0000","last_change":"2024-04-25T08:50:02.082940+0000","last_active":"2024-04-25T08:50:04.663781+0000","last_peered":"2024-04-25T08:50:04.663781+0000","last_clean":"2024-04-25T08:50:04.663781+0000","last_became_active":"2024-04-25T08:50:02.082621+0000","last_became_peered":"2024-04-25T08:50:02.082621+0000","last_unstale":"2024-04-25T08:50:04.663781+0000","last_undegraded":"2024-04-25T08:50:04.663781+0000","last_fullsized":"2024-04-25T08:50:04.663781+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:42.849146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079668+0000","last_change":"2024-04-25T08:50:03.092892+0000","last_active":"2024-04-25T08:50:04.079668+0000","last_peered":"2024-04-25T08:50:04.079668+0000","last_clean":"2024-04-25T08:50:04.079668+0000","last_became_active":"2024-04-25T08:50:03.092437+0000","last_became_peered":"2024-04-25T08:50:03.092437+0000","last_unstale":"2024-04-25T08:50:04.079668+0000","last_undegraded":"2024-04-25T08:50:04.079668+0000","last_fullsized":"2024-04-25T08:50:04.079668+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.595974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079832+0000","last_change":"2024-04-25T08:50:02.077511+0000","last_active":"2024-04-25T08:50:04.079832+0000","last_peered":"2024-04-25T08:50:04.079832+0000","last_clean":"2024-04-25T08:50:04.079832+0000","last_became_active":"2024-04-25T08:50:02.077219+0000","last_became_peered":"2024-04-25T08:50:02.077219+0000","last_unstale":"2024-04-25T08:50:04.079832+0000","last_undegraded":"2024-04-25T08:50:04.079832+0000","last_fullsized":"2024-04-25T08:50:04.079832+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:21.732361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080718+0000","last_change":"2024-04-25T08:50:03.085507+0000","last_active":"2024-04-25T08:50:04.080718+0000","last_peered":"2024-04-25T08:50:04.080718+0000","last_clean":"2024-04-25T08:50:04.080718+0000","last_became_active":"2024-04-25T08:50:03.085189+0000","last_became_peered":"2024-04-25T08:50:03.085189+0000","last_unstale":"2024-04-25T08:50:04.080718+0000","last_undegraded":"2024-04-25T08:50:04.080718+0000","last_fullsized":"2024-04-25T08:50:04.080718+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:06.366290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080366+0000","last_change":"2024-04-25T08:50:02.076416+0000","last_active":"2024-04-25T08:50:04.080366+0000","last_peered":"2024-04-25T08:50:04.080366+0000","last_clean":"2024-04-25T08:50:04.080366+0000","last_became_active":"2024-04-25T08:50:02.076119+0000","last_became_peered":"2024-04-25T08:50:02.076119+0000","last_unstale":"2024-04-25T08:50:04.080366+0000","last_undegraded":"2024-04-25T08:50:04.080366+0000","last_fullsized":"2024-04-25T08:50:04.080366+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:32.281430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664055+0000","last_change":"2024-04-25T08:50:03.103615+0000","last_active":"2024-04-25T08:50:04.664055+0000","last_peered":"2024-04-25T08:50:04.664055+0000","last_clean":"2024-04-25T08:50:04.664055+0000","last_became_active":"2024-04-25T08:50:03.103306+0000","last_became_peered":"2024-04-25T08:50:03.103306+0000","last_unstale":"2024-04-25T08:50:04.664055+0000","last_undegraded":"2024-04-25T08:50:04.664055+0000","last_fullsized":"2024-04-25T08:50:04.664055+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:11.118378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"118'3","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080682+0000","last_change":"2024-04-25T08:50:02.076560+0000","last_active":"2024-04-25T08:50:04.080682+0000","last_peered":"2024-04-25T08:50:04.080682+0000","last_clean":"2024-04-25T08:50:04.080682+0000","last_became_active":"2024-04-25T08:50:02.076223+0000","last_became_peered":"2024-04-25T08:50:02.076223+0000","last_unstale":"2024-04-25T08:50:04.080682+0000","last_undegraded":"2024-04-25T08:50:04.080682+0000","last_fullsized":"2024-04-25T08:50:04.080682+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:33.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080520+0000","last_change":"2024-04-25T08:50:03.085192+0000","last_active":"2024-04-25T08:50:04.080520+0000","last_peered":"2024-04-25T08:50:04.080520+0000","last_clean":"2024-04-25T08:50:04.080520+0000","last_became_active":"2024-04-25T08:50:03.084418+0000","last_became_peered":"2024-04-25T08:50:03.084418+0000","last_unstale":"2024-04-25T08:50:04.080520+0000","last_undegraded":"2024-04-25T08:50:04.080520+0000","last_fullsized":"2024-04-25T08:50:04.080520+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:25.834512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"118'6","reported_seq":20,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663670+0000","last_change":"2024-04-25T08:50:02.078543+0000","last_active":"2024-04-25T08:50:04.663670+0000","last_peered":"2024-04-25T08:50:04.663670+0000","last_clean":"2024-04-25T08:50:04.663670+0000","last_became_active":"2024-04-25T08:50:02.078253+0000","last_became_peered":"2024-04-25T08:50:02.078253+0000","last_unstale":"2024-04-25T08:50:04.663670+0000","last_undegraded":"2024-04-25T08:50:04.663670+0000","last_fullsized":"2024-04-25T08:50:04.663670+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:05.277315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079923+0000","last_change":"2024-04-25T08:50:03.103835+0000","last_active":"2024-04-25T08:50:04.079923+0000","last_peered":"2024-04-25T08:50:04.079923+0000","last_clean":"2024-04-25T08:50:04.079923+0000","last_became_active":"2024-04-25T08:50:03.103532+0000","last_became_peered":"2024-04-25T08:50:03.103532+0000","last_unstale":"2024-04-25T08:50:04.079923+0000","last_undegraded":"2024-04-25T08:50:04.079923+0000","last_fullsized":"2024-04-25T08:50:04.079923+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:20.612457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664231+0000","last_change":"2024-04-25T08:50:02.083574+0000","last_active":"2024-04-25T08:50:04.664231+0000","last_peered":"2024-04-25T08:50:04.664231+0000","last_clean":"2024-04-25T08:50:04.664231+0000","last_became_active":"2024-04-25T08:50:02.083326+0000","last_became_peered":"2024-04-25T08:50:02.083326+0000","last_unstale":"2024-04-25T08:50:04.664231+0000","last_undegraded":"2024-04-25T08:50:04.664231+0000","last_fullsized":"2024-04-25T08:50:04.664231+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:59.293720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162827+0000","last_change":"2024-04-25T08:50:03.090014+0000","last_active":"2024-04-25T08:50:04.162827+0000","last_peered":"2024-04-25T08:50:04.162827+0000","last_clean":"2024-04-25T08:50:04.162827+0000","last_became_active":"2024-04-25T08:50:03.089739+0000","last_became_peered":"2024-04-25T08:50:03.089739+0000","last_unstale":"2024-04-25T08:50:04.162827+0000","last_undegraded":"2024-04-25T08:50:04.162827+0000","last_fullsized":"2024-04-25T08:50:04.162827+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:13.606209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664307+0000","last_change":"2024-04-25T08:50:02.079080+0000","last_active":"2024-04-25T08:50:04.664307+0000","last_peered":"2024-04-25T08:50:04.664307+0000","last_clean":"2024-04-25T08:50:04.664307+0000","last_became_active":"2024-04-25T08:50:02.078832+0000","last_became_peered":"2024-04-25T08:50:02.078832+0000","last_unstale":"2024-04-25T08:50:04.664307+0000","last_undegraded":"2024-04-25T08:50:04.664307+0000","last_fullsized":"2024-04-25T08:50:04.664307+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.721245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078247+0000","last_change":"2024-04-25T08:50:03.096069+0000","last_active":"2024-04-25T08:50:04.078247+0000","last_peered":"2024-04-25T08:50:04.078247+0000","last_clean":"2024-04-25T08:50:04.078247+0000","last_became_active":"2024-04-25T08:50:03.095806+0000","last_became_peered":"2024-04-25T08:50:03.095806+0000","last_unstale":"2024-04-25T08:50:04.078247+0000","last_undegraded":"2024-04-25T08:50:04.078247+0000","last_fullsized":"2024-04-25T08:50:04.078247+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:00.333557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663456+0000","last_change":"2024-04-25T08:50:02.072977+0000","last_active":"2024-04-25T08:50:04.663456+0000","last_peered":"2024-04-25T08:50:04.663456+0000","last_clean":"2024-04-25T08:50:04.663456+0000","last_became_active":"2024-04-25T08:50:02.072719+0000","last_became_peered":"2024-04-25T08:50:02.072719+0000","last_unstale":"2024-04-25T08:50:04.663456+0000","last_undegraded":"2024-04-25T08:50:04.663456+0000","last_fullsized":"2024-04-25T08:50:04.663456+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:08.461773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080145+0000","last_change":"2024-04-25T08:50:03.094607+0000","last_active":"2024-04-25T08:50:04.080145+0000","last_peered":"2024-04-25T08:50:04.080145+0000","last_clean":"2024-04-25T08:50:04.080145+0000","last_became_active":"2024-04-25T08:50:03.092900+0000","last_became_peered":"2024-04-25T08:50:03.092900+0000","last_unstale":"2024-04-25T08:50:04.080145+0000","last_undegraded":"2024-04-25T08:50:04.080145+0000","last_fullsized":"2024-04-25T08:50:04.080145+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:05.072692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163025+0000","last_change":"2024-04-25T08:50:02.079266+0000","last_active":"2024-04-25T08:50:04.163025+0000","last_peered":"2024-04-25T08:50:04.163025+0000","last_clean":"2024-04-25T08:50:04.163025+0000","last_became_active":"2024-04-25T08:50:02.078977+0000","last_became_peered":"2024-04-25T08:50:02.078977+0000","last_unstale":"2024-04-25T08:50:04.163025+0000","last_undegraded":"2024-04-25T08:50:04.163025+0000","last_fullsized":"2024-04-25T08:50:04.163025+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:14.855134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.665015+0000","last_change":"2024-04-25T08:50:03.084180+0000","last_active":"2024-04-25T08:50:04.665015+0000","last_peered":"2024-04-25T08:50:04.665015+0000","last_clean":"2024-04-25T08:50:04.665015+0000","last_became_active":"2024-04-25T08:50:03.083891+0000","last_became_peered":"2024-04-25T08:50:03.083891+0000","last_unstale":"2024-04-25T08:50:04.665015+0000","last_undegraded":"2024-04-25T08:50:04.665015+0000","last_fullsized":"2024-04-25T08:50:04.665015+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:33.288673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078385+0000","last_change":"2024-04-25T08:50:02.082798+0000","last_active":"2024-04-25T08:50:04.078385+0000","last_peered":"2024-04-25T08:50:04.078385+0000","last_clean":"2024-04-25T08:50:04.078385+0000","last_became_active":"2024-04-25T08:50:02.082560+0000","last_became_peered":"2024-04-25T08:50:02.082560+0000","last_unstale":"2024-04-25T08:50:04.078385+0000","last_undegraded":"2024-04-25T08:50:04.078385+0000","last_fullsized":"2024-04-25T08:50:04.078385+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:52.666382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663780+0000","last_change":"2024-04-25T08:50:03.100304+0000","last_active":"2024-04-25T08:50:04.663780+0000","last_peered":"2024-04-25T08:50:04.663780+0000","last_clean":"2024-04-25T08:50:04.663780+0000","last_became_active":"2024-04-25T08:50:03.100055+0000","last_became_peered":"2024-04-25T08:50:03.100055+0000","last_unstale":"2024-04-25T08:50:04.663780+0000","last_undegraded":"2024-04-25T08:50:04.663780+0000","last_fullsized":"2024-04-25T08:50:04.663780+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:30:12.533977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"118'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664314+0000","last_change":"2024-04-25T08:50:02.081703+0000","last_active":"2024-04-25T08:50:04.664314+0000","last_peered":"2024-04-25T08:50:04.664314+0000","last_clean":"2024-04-25T08:50:04.664314+0000","last_became_active":"2024-04-25T08:50:02.081328+0000","last_became_peered":"2024-04-25T08:50:02.081328+0000","last_unstale":"2024-04-25T08:50:04.664314+0000","last_undegraded":"2024-04-25T08:50:04.664314+0000","last_fullsized":"2024-04-25T08:50:04.664314+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:33.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080457+0000","last_change":"2024-04-25T08:50:03.088415+0000","last_active":"2024-04-25T08:50:04.080457+0000","last_peered":"2024-04-25T08:50:04.080457+0000","last_clean":"2024-04-25T08:50:04.080457+0000","last_became_active":"2024-04-25T08:50:03.087949+0000","last_became_peered":"2024-04-25T08:50:03.087949+0000","last_unstale":"2024-04-25T08:50:04.080457+0000","last_undegraded":"2024-04-25T08:50:04.080457+0000","last_fullsized":"2024-04-25T08:50:04.080457+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:04.537221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664248+0000","last_change":"2024-04-25T08:50:02.086426+0000","last_active":"2024-04-25T08:50:04.664248+0000","last_peered":"2024-04-25T08:50:04.664248+0000","last_clean":"2024-04-25T08:50:04.664248+0000","last_became_active":"2024-04-25T08:50:02.086059+0000","last_became_peered":"2024-04-25T08:50:02.086059+0000","last_unstale":"2024-04-25T08:50:04.664248+0000","last_undegraded":"2024-04-25T08:50:04.664248+0000","last_fullsized":"2024-04-25T08:50:04.664248+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:16.588730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663524+0000","last_change":"2024-04-25T08:50:03.096304+0000","last_active":"2024-04-25T08:50:04.663524+0000","last_peered":"2024-04-25T08:50:04.663524+0000","last_clean":"2024-04-25T08:50:04.663524+0000","last_became_active":"2024-04-25T08:50:03.096043+0000","last_became_peered":"2024-04-25T08:50:03.096043+0000","last_unstale":"2024-04-25T08:50:04.663524+0000","last_undegraded":"2024-04-25T08:50:04.663524+0000","last_fullsized":"2024-04-25T08:50:04.663524+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:46.407666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663336+0000","last_change":"2024-04-25T08:50:02.085212+0000","last_active":"2024-04-25T08:50:04.663336+0000","last_peered":"2024-04-25T08:50:04.663336+0000","last_clean":"2024-04-25T08:50:04.663336+0000","last_became_active":"2024-04-25T08:50:02.084943+0000","last_became_peered":"2024-04-25T08:50:02.084943+0000","last_unstale":"2024-04-25T08:50:04.663336+0000","last_undegraded":"2024-04-25T08:50:04.663336+0000","last_fullsized":"2024-04-25T08:50:04.663336+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:49.954755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663336+0000","last_change":"2024-04-25T08:50:03.085752+0000","last_active":"2024-04-25T08:50:04.663336+0000","last_peered":"2024-04-25T08:50:04.663336+0000","last_clean":"2024-04-25T08:50:04.663336+0000","last_became_active":"2024-04-25T08:50:03.085408+0000","last_became_peered":"2024-04-25T08:50:03.085408+0000","last_unstale":"2024-04-25T08:50:04.663336+0000","last_undegraded":"2024-04-25T08:50:04.663336+0000","last_fullsized":"2024-04-25T08:50:04.663336+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:20.021349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663953+0000","last_change":"2024-04-25T08:50:02.081268+0000","last_active":"2024-04-25T08:50:04.663953+0000","last_peered":"2024-04-25T08:50:04.663953+0000","last_clean":"2024-04-25T08:50:04.663953+0000","last_became_active":"2024-04-25T08:50:02.080964+0000","last_became_peered":"2024-04-25T08:50:02.080964+0000","last_unstale":"2024-04-25T08:50:04.663953+0000","last_undegraded":"2024-04-25T08:50:04.663953+0000","last_fullsized":"2024-04-25T08:50:04.663953+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:12.598965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664312+0000","last_change":"2024-04-25T08:50:03.100463+0000","last_active":"2024-04-25T08:50:04.664312+0000","last_peered":"2024-04-25T08:50:04.664312+0000","last_clean":"2024-04-25T08:50:04.664312+0000","last_became_active":"2024-04-25T08:50:03.100200+0000","last_became_peered":"2024-04-25T08:50:03.100200+0000","last_unstale":"2024-04-25T08:50:04.664312+0000","last_undegraded":"2024-04-25T08:50:04.664312+0000","last_fullsized":"2024-04-25T08:50:04.664312+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:42.859558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663537+0000","last_change":"2024-04-25T08:50:02.086635+0000","last_active":"2024-04-25T08:50:04.663537+0000","last_peered":"2024-04-25T08:50:04.663537+0000","last_clean":"2024-04-25T08:50:04.663537+0000","last_became_active":"2024-04-25T08:50:02.086331+0000","last_became_peered":"2024-04-25T08:50:02.086331+0000","last_unstale":"2024-04-25T08:50:04.663537+0000","last_undegraded":"2024-04-25T08:50:04.663537+0000","last_fullsized":"2024-04-25T08:50:04.663537+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:33.443820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080787+0000","last_change":"2024-04-25T08:50:03.087103+0000","last_active":"2024-04-25T08:50:04.080787+0000","last_peered":"2024-04-25T08:50:04.080787+0000","last_clean":"2024-04-25T08:50:04.080787+0000","last_became_active":"2024-04-25T08:50:03.086628+0000","last_became_peered":"2024-04-25T08:50:03.086628+0000","last_unstale":"2024-04-25T08:50:04.080787+0000","last_undegraded":"2024-04-25T08:50:04.080787+0000","last_fullsized":"2024-04-25T08:50:04.080787+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:33.073626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663796+0000","last_change":"2024-04-25T08:50:02.082717+0000","last_active":"2024-04-25T08:50:04.663796+0000","last_peered":"2024-04-25T08:50:04.663796+0000","last_clean":"2024-04-25T08:50:04.663796+0000","last_became_active":"2024-04-25T08:50:02.082396+0000","last_became_peered":"2024-04-25T08:50:02.082396+0000","last_unstale":"2024-04-25T08:50:04.663796+0000","last_undegraded":"2024-04-25T08:50:04.663796+0000","last_fullsized":"2024-04-25T08:50:04.663796+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:40.602926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664010+0000","last_change":"2024-04-25T08:50:03.089650+0000","last_active":"2024-04-25T08:50:04.664010+0000","last_peered":"2024-04-25T08:50:04.664010+0000","last_clean":"2024-04-25T08:50:04.664010+0000","last_became_active":"2024-04-25T08:50:03.089299+0000","last_became_peered":"2024-04-25T08:50:03.089299+0000","last_unstale":"2024-04-25T08:50:04.664010+0000","last_undegraded":"2024-04-25T08:50:04.664010+0000","last_fullsized":"2024-04-25T08:50:04.664010+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:48.677552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"118'2","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664170+0000","last_change":"2024-04-25T08:50:02.080295+0000","last_active":"2024-04-25T08:50:04.664170+0000","last_peered":"2024-04-25T08:50:04.664170+0000","last_clean":"2024-04-25T08:50:04.664170+0000","last_became_active":"2024-04-25T08:50:02.080040+0000","last_became_peered":"2024-04-25T08:50:02.080040+0000","last_unstale":"2024-04-25T08:50:04.664170+0000","last_undegraded":"2024-04-25T08:50:04.664170+0000","last_fullsized":"2024-04-25T08:50:04.664170+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:11.835185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.162913+0000","last_change":"2024-04-25T08:50:03.098535+0000","last_active":"2024-04-25T08:50:04.162913+0000","last_peered":"2024-04-25T08:50:04.162913+0000","last_clean":"2024-04-25T08:50:04.162913+0000","last_became_active":"2024-04-25T08:50:03.098281+0000","last_became_peered":"2024-04-25T08:50:03.098281+0000","last_unstale":"2024-04-25T08:50:04.162913+0000","last_undegraded":"2024-04-25T08:50:04.162913+0000","last_fullsized":"2024-04-25T08:50:04.162913+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:20.612457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"119'1","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.079815+0000","last_change":"2024-04-25T08:50:02.083438+0000","last_active":"2024-04-25T08:50:04.079815+0000","last_peered":"2024-04-25T08:50:04.079815+0000","last_clean":"2024-04-25T08:50:04.079815+0000","last_became_active":"2024-04-25T08:50:02.082990+0000","last_became_peered":"2024-04-25T08:50:02.082990+0000","last_unstale":"2024-04-25T08:50:04.079815+0000","last_undegraded":"2024-04-25T08:50:04.079815+0000","last_fullsized":"2024-04-25T08:50:04.079815+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:30.972003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664567+0000","last_change":"2024-04-25T08:50:03.096565+0000","last_active":"2024-04-25T08:50:04.664567+0000","last_peered":"2024-04-25T08:50:04.664567+0000","last_clean":"2024-04-25T08:50:04.664567+0000","last_became_active":"2024-04-25T08:50:03.096260+0000","last_became_peered":"2024-04-25T08:50:03.096260+0000","last_unstale":"2024-04-25T08:50:04.664567+0000","last_undegraded":"2024-04-25T08:50:04.664567+0000","last_fullsized":"2024-04-25T08:50:04.664567+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:34.032156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.080243+0000","last_change":"2024-04-25T08:50:02.086504+0000","last_active":"2024-04-25T08:50:04.080243+0000","last_peered":"2024-04-25T08:50:04.080243+0000","last_clean":"2024-04-25T08:50:04.080243+0000","last_became_active":"2024-04-25T08:50:02.086170+0000","last_became_peered":"2024-04-25T08:50:02.086170+0000","last_unstale":"2024-04-25T08:50:04.080243+0000","last_undegraded":"2024-04-25T08:50:04.080243+0000","last_fullsized":"2024-04-25T08:50:04.080243+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:08.291556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.078398+0000","last_change":"2024-04-25T08:50:03.086537+0000","last_active":"2024-04-25T08:50:04.078398+0000","last_peered":"2024-04-25T08:50:04.078398+0000","last_clean":"2024-04-25T08:50:04.078398+0000","last_became_active":"2024-04-25T08:50:03.086277+0000","last_became_peered":"2024-04-25T08:50:03.086277+0000","last_unstale":"2024-04-25T08:50:04.078398+0000","last_undegraded":"2024-04-25T08:50:04.078398+0000","last_fullsized":"2024-04-25T08:50:04.078398+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:32.514738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664092+0000","last_change":"2024-04-25T08:50:02.077343+0000","last_active":"2024-04-25T08:50:04.664092+0000","last_peered":"2024-04-25T08:50:04.664092+0000","last_clean":"2024-04-25T08:50:04.664092+0000","last_became_active":"2024-04-25T08:50:02.077099+0000","last_became_peered":"2024-04-25T08:50:02.077099+0000","last_unstale":"2024-04-25T08:50:04.664092+0000","last_undegraded":"2024-04-25T08:50:04.664092+0000","last_fullsized":"2024-04-25T08:50:04.664092+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:47.357662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663683+0000","last_change":"2024-04-25T08:50:03.095799+0000","last_active":"2024-04-25T08:50:04.663683+0000","last_peered":"2024-04-25T08:50:04.663683+0000","last_clean":"2024-04-25T08:50:04.663683+0000","last_became_active":"2024-04-25T08:50:03.095324+0000","last_became_peered":"2024-04-25T08:50:03.095324+0000","last_unstale":"2024-04-25T08:50:04.663683+0000","last_undegraded":"2024-04-25T08:50:04.663683+0000","last_fullsized":"2024-04-25T08:50:04.663683+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:04:25.353270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664473+0000","last_change":"2024-04-25T08:50:02.075038+0000","last_active":"2024-04-25T08:50:04.664473+0000","last_peered":"2024-04-25T08:50:04.664473+0000","last_clean":"2024-04-25T08:50:04.664473+0000","last_became_active":"2024-04-25T08:50:02.074730+0000","last_became_peered":"2024-04-25T08:50:02.074730+0000","last_unstale":"2024-04-25T08:50:04.664473+0000","last_undegraded":"2024-04-25T08:50:04.664473+0000","last_fullsized":"2024-04-25T08:50:04.664473+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:21.732361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664337+0000","last_change":"2024-04-25T08:50:03.093751+0000","last_active":"2024-04-25T08:50:04.664337+0000","last_peered":"2024-04-25T08:50:04.664337+0000","last_clean":"2024-04-25T08:50:04.664337+0000","last_became_active":"2024-04-25T08:50:03.093486+0000","last_became_peered":"2024-04-25T08:50:03.093486+0000","last_unstale":"2024-04-25T08:50:04.664337+0000","last_undegraded":"2024-04-25T08:50:04.664337+0000","last_fullsized":"2024-04-25T08:50:04.664337+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:42.347387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664583+0000","last_change":"2024-04-25T08:50:02.072807+0000","last_active":"2024-04-25T08:50:04.664583+0000","last_peered":"2024-04-25T08:50:04.664583+0000","last_clean":"2024-04-25T08:50:04.664583+0000","last_became_active":"2024-04-25T08:50:02.072510+0000","last_became_peered":"2024-04-25T08:50:02.072510+0000","last_unstale":"2024-04-25T08:50:04.664583+0000","last_undegraded":"2024-04-25T08:50:04.664583+0000","last_fullsized":"2024-04-25T08:50:04.664583+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:00.516930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664119+0000","last_change":"2024-04-25T08:50:03.095038+0000","last_active":"2024-04-25T08:50:04.664119+0000","last_peered":"2024-04-25T08:50:04.664119+0000","last_clean":"2024-04-25T08:50:04.664119+0000","last_became_active":"2024-04-25T08:50:03.094758+0000","last_became_peered":"2024-04-25T08:50:03.094758+0000","last_unstale":"2024-04-25T08:50:04.664119+0000","last_undegraded":"2024-04-25T08:50:04.664119+0000","last_fullsized":"2024-04-25T08:50:04.664119+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:36.728489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663468+0000","last_change":"2024-04-25T08:50:02.083029+0000","last_active":"2024-04-25T08:50:04.663468+0000","last_peered":"2024-04-25T08:50:04.663468+0000","last_clean":"2024-04-25T08:50:04.663468+0000","last_became_active":"2024-04-25T08:50:02.082742+0000","last_became_peered":"2024-04-25T08:50:02.082742+0000","last_unstale":"2024-04-25T08:50:04.663468+0000","last_undegraded":"2024-04-25T08:50:04.663468+0000","last_fullsized":"2024-04-25T08:50:04.663468+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:53.196270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.163130+0000","last_change":"2024-04-25T08:50:03.092066+0000","last_active":"2024-04-25T08:50:04.163130+0000","last_peered":"2024-04-25T08:50:04.163130+0000","last_clean":"2024-04-25T08:50:04.163130+0000","last_became_active":"2024-04-25T08:50:03.091824+0000","last_became_peered":"2024-04-25T08:50:03.091824+0000","last_unstale":"2024-04-25T08:50:04.163130+0000","last_undegraded":"2024-04-25T08:50:04.163130+0000","last_fullsized":"2024-04-25T08:50:04.163130+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:33.288673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664172+0000","last_change":"2024-04-25T08:50:02.083384+0000","last_active":"2024-04-25T08:50:04.664172+0000","last_peered":"2024-04-25T08:50:04.664172+0000","last_clean":"2024-04-25T08:50:04.664172+0000","last_became_active":"2024-04-25T08:50:02.083099+0000","last_became_peered":"2024-04-25T08:50:02.083099+0000","last_unstale":"2024-04-25T08:50:04.664172+0000","last_undegraded":"2024-04-25T08:50:04.664172+0000","last_fullsized":"2024-04-25T08:50:04.664172+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:19.605213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664872+0000","last_change":"2024-04-25T08:50:03.094055+0000","last_active":"2024-04-25T08:50:04.664872+0000","last_peered":"2024-04-25T08:50:04.664872+0000","last_clean":"2024-04-25T08:50:04.664872+0000","last_became_active":"2024-04-25T08:50:03.093696+0000","last_became_peered":"2024-04-25T08:50:03.093696+0000","last_unstale":"2024-04-25T08:50:04.664872+0000","last_undegraded":"2024-04-25T08:50:04.664872+0000","last_fullsized":"2024-04-25T08:50:04.664872+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:02.059665+0000","last_clean_scrub_stamp":"2024-04-25T08:50:02.059665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:04.537221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"118'8","reported_seq":22,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.663322+0000","last_change":"2024-04-25T08:50:02.079489+0000","last_active":"2024-04-25T08:50:04.663322+0000","last_peered":"2024-04-25T08:50:04.663322+0000","last_clean":"2024-04-25T08:50:04.663322+0000","last_became_active":"2024-04-25T08:50:02.079226+0000","last_became_peered":"2024-04-25T08:50:02.079226+0000","last_unstale":"2024-04-25T08:50:04.663322+0000","last_undegraded":"2024-04-25T08:50:04.663322+0000","last_fullsized":"2024-04-25T08:50:04.663322+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:01.052421+0000","last_clean_scrub_stamp":"2024-04-25T08:50:01.052421+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:42.701070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":351,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-25T08:50:04.664429+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:50:04.664429+0000","last_peered":"2024-04-25T08:50:04.664429+0000","last_clean":"2024-04-25T08:50:04.664429+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:50:04.664429+0000","last_undegraded":"2024-04-25T08:50:04.664429+0000","last_fullsized":"2024-04-25T08:50:04.664429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41552,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330288,"statfs":{"total":96636764160,"available":96594214912,"internally_reserved":0,"allocated":2093056,"data_stored":1281103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46524,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325316,"statfs":{"total":96636764160,"available":96589123584,"internally_reserved":0,"allocated":1486848,"data_stored":690541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45116,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326724,"statfs":{"total":96636764160,"available":96590565376,"internally_reserved":0,"allocated":1490944,"data_stored":690119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50692,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321148,"statfs":{"total":96636764160,"available":96584855552,"internally_reserved":0,"allocated":1495040,"data_stored":691571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50696,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321144,"statfs":{"total":96636764160,"available":96584851456,"internally_reserved":0,"allocated":1499136,"data_stored":691605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50684,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321156,"statfs":{"total":96636764160,"available":96584863744,"internally_reserved":0,"allocated":1482752,"data_stored":689959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46528,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325312,"statfs":{"total":96636764160,"available":96589119488,"internally_reserved":0,"allocated":1486848,"data_stored":689981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51260,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320580,"statfs":{"total":96636764160,"available":96584273920,"internally_reserved":0,"allocated":2080768,"data_stored":1280349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:50:10.734 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:50:10.734 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:50:10.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.880+0000 7fee399fe640 1 Processor -- start 2024-04-25T08:50:10.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.880+0000 7fee399fe640 1 -- start start 2024-04-25T08:50:10.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.881+0000 7fee399fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fee34158230 0x7fee340d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.881+0000 7fee399fe640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee340d2020 con 0x7fee340d1b80 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.881+0000 7fee399fe640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee340d2300 con 0x7fee340b4e60 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.881+0000 7fee399fe640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee34158610 con 0x7fee34158230 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.881+0000 7fee327fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fee340d1b80 0x7fee3406c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41502/0 (socket says 172.21.15.172:41502) 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.881+0000 7fee327fc640 1 -- 172.21.15.172:0/2669191636 learned_addr learned my addr 172.21.15.172:0/2669191636 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.881+0000 7fee32ffd640 1 --2- 172.21.15.172:0/2669191636 >> v2:172.21.15.186:3300/0 conn(0x7fee34158230 0x7fee340d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.881+0000 7fee31ffb640 1 -- 172.21.15.172:0/2669191636 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886210709 0 0) 0x7fee340d2020 con 0x7fee340d1b80 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.881+0000 7fee31ffb640 1 -- 172.21.15.172:0/2669191636 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee1c003520 con 0x7fee340d1b80 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.882+0000 7fee31ffb640 1 -- 172.21.15.172:0/2669191636 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 804922329 0 0) 0x7fee1c003520 con 0x7fee340d1b80 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.882+0000 7fee32ffd640 1 -- 172.21.15.172:0/2669191636 >> v1:172.21.15.186:6789/0 conn(0x7fee340b4e60 legacy=0x7fee3406f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.882+0000 7fee32ffd640 1 -- 172.21.15.172:0/2669191636 >> v1:172.21.15.172:6789/0 conn(0x7fee340d1b80 legacy=0x7fee3406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.882+0000 7fee32ffd640 1 -- 172.21.15.172:0/2669191636 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3406bb30 con 0x7fee34158230 2024-04-25T08:50:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.882+0000 7fee32ffd640 1 --2- 172.21.15.172:0/2669191636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee34158230 0x7fee340d1640 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fee24009d90 tx=0x7fee2402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16593ab19ed42462 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.883+0000 7fee31ffb640 1 -- 172.21.15.172:0/2669191636 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee280017f0 con 0x7fee34158230 2024-04-25T08:50:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.883+0000 7fee31ffb640 1 -- 172.21.15.172:0/2669191636 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee24007540 con 0x7fee34158230 2024-04-25T08:50:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.883+0000 7fee31ffb640 1 -- 172.21.15.172:0/2669191636 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24007910 con 0x7fee34158230 2024-04-25T08:50:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.883+0000 7fee399fe640 1 -- 172.21.15.172:0/2669191636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee34158230 msgr2=0x7fee340d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.883+0000 7fee399fe640 1 --2- 172.21.15.172:0/2669191636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee34158230 0x7fee340d1640 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fee24009d90 tx=0x7fee2402a680 comp rx=0 tx=0).stop 2024-04-25T08:50:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.883+0000 7fee399fe640 1 -- 172.21.15.172:0/2669191636 shutdown_connections 2024-04-25T08:50:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.883+0000 7fee399fe640 1 --2- 172.21.15.172:0/2669191636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee34158230 0x7fee340d1640 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.883+0000 7fee399fe640 1 -- 172.21.15.172:0/2669191636 >> 172.21.15.172:0/2669191636 conn(0x7fee34061600 msgr2=0x7fee340619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.883+0000 7fee399fe640 1 -- 172.21.15.172:0/2669191636 shutdown_connections 2024-04-25T08:50:10.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.883+0000 7fee399fe640 1 -- 172.21.15.172:0/2669191636 wait complete. 2024-04-25T08:50:10.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.884+0000 7fee399fe640 1 Processor -- start 2024-04-25T08:50:10.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.884+0000 7fee399fe640 1 -- start start 2024-04-25T08:50:10.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee399fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee340b4e60 0x7fee340b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee399fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee340d1b80 0x7fee3415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee399fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee34158230 0x7fee3415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee399fe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3406ca40 con 0x7fee340d1b80 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee399fe640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3406bea0 con 0x7fee340b4e60 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee399fe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3415e320 con 0x7fee34158230 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee327fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee340d1b80 0x7fee3415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee327fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee340d1b80 0x7fee3415a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49906/0 (socket says 172.21.15.172:49906) 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee327fc640 1 -- 172.21.15.172:0/3931678779 learned_addr learned my addr 172.21.15.172:0/3931678779 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee32ffd640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee340b4e60 0x7fee340b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.885+0000 7fee337fe640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee34158230 0x7fee3415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee327fc640 1 -- 172.21.15.172:0/3931678779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee34158230 msgr2=0x7fee3415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee327fc640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee34158230 0x7fee3415a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee327fc640 1 -- 172.21.15.172:0/3931678779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee340b4e60 msgr2=0x7fee340b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee327fc640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee340b4e60 0x7fee340b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee327fc640 1 -- 172.21.15.172:0/3931678779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee340cafb0 con 0x7fee340d1b80 2024-04-25T08:50:10.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee32ffd640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee340b4e60 0x7fee340b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:10.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee337fe640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee34158230 0x7fee3415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:10.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee327fc640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee340d1b80 0x7fee3415a280 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fee2800c550 tx=0x7fee2800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:10.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee1bfff640 1 -- 172.21.15.172:0/3931678779 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28017070 con 0x7fee340d1b80 2024-04-25T08:50:10.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee1bfff640 1 -- 172.21.15.172:0/3931678779 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28007500 con 0x7fee340d1b80 2024-04-25T08:50:10.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee399fe640 1 -- 172.21.15.172:0/3931678779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee340cb290 con 0x7fee340d1b80 2024-04-25T08:50:10.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee1bfff640 1 -- 172.21.15.172:0/3931678779 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee280059c0 con 0x7fee340d1b80 2024-04-25T08:50:10.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.886+0000 7fee399fe640 1 -- 172.21.15.172:0/3931678779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee340cb850 con 0x7fee340d1b80 2024-04-25T08:50:10.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.887+0000 7fee399fe640 1 -- 172.21.15.172:0/3931678779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3406de50 con 0x7fee340d1b80 2024-04-25T08:50:10.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.887+0000 7fee1bfff640 1 -- 172.21.15.172:0/3931678779 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fee2801a070 con 0x7fee340d1b80 2024-04-25T08:50:10.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.888+0000 7fee1bfff640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fee2006b4d0 0x7fee2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:10.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.888+0000 7fee1bfff640 1 -- 172.21.15.172:0/3931678779 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fee28089680 con 0x7fee340d1b80 2024-04-25T08:50:10.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.888+0000 7fee32ffd640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fee2006b4d0 0x7fee2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:10.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.888+0000 7fee32ffd640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fee2006b4d0 0x7fee2006d990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fee24034000 tx=0x7fee2402f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:10.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:10.892+0000 7fee1bfff640 1 -- 172.21.15.172:0/3931678779 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee28057d30 con 0x7fee340d1b80 2024-04-25T08:50:11.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.130+0000 7fee399fe640 1 -- 172.21.15.172:0/3931678779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fee340cdb30 con 0x7fee340d1b80 2024-04-25T08:50:11.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.132+0000 7fee1bfff640 1 -- 172.21.15.172:0/3931678779 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7fee2805bdd0 con 0x7fee340d1b80 2024-04-25T08:50:11.123 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T08:50:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:50:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: caps mds = "allow" 2024-04-25T08:50:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: caps mon = "allow r" 2024-04-25T08:50:11.123 INFO:teuthology.orchestra.run.smithi172.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:50:11.123 INFO:teuthology.orchestra.run.smithi172.stderr:updated caps for client.0 2024-04-25T08:50:11.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 -- 172.21.15.172:0/3931678779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fee2006b4d0 msgr2=0x7fee2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fee2006b4d0 0x7fee2006d990 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fee24034000 tx=0x7fee2402f000 comp rx=0 tx=0).stop 2024-04-25T08:50:11.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 -- 172.21.15.172:0/3931678779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee340d1b80 msgr2=0x7fee3415a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee340d1b80 0x7fee3415a280 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fee2800c550 tx=0x7fee2800ca10 comp rx=0 tx=0).stop 2024-04-25T08:50:11.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 -- 172.21.15.172:0/3931678779 shutdown_connections 2024-04-25T08:50:11.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fee2006b4d0 0x7fee2006d990 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee34158230 0x7fee3415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee340d1b80 0x7fee3415a280 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 --2- 172.21.15.172:0/3931678779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee340b4e60 0x7fee340b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 -- 172.21.15.172:0/3931678779 >> 172.21.15.172:0/3931678779 conn(0x7fee34061600 msgr2=0x7fee3415d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:11.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 -- 172.21.15.172:0/3931678779 shutdown_connections 2024-04-25T08:50:11.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.134+0000 7fee399fe640 1 -- 172.21.15.172:0/3931678779 wait complete. 2024-04-25T08:50:11.138 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:11.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.245+0000 7f698c55c640 1 Processor -- start 2024-04-25T08:50:11.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.245+0000 7f698c55c640 1 -- start start 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f698c55c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69840d1e70 0x7f69840c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f698c55c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69840c7970 con 0x7f698415ef00 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f698c55c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69840c7c50 con 0x7f69840c7140 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f698c55c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698415f2e0 con 0x7f69840d1e70 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f698a2f8640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f698415ef00 0x7f69840d1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41504/0 (socket says 172.21.15.172:41504) 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f698a2f8640 1 -- 172.21.15.172:0/2946814827 learned_addr learned my addr 172.21.15.172:0/2946814827 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f6989af7640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69840d1e70 0x7f69840c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066266642 0 0) 0x7f69840c7970 con 0x7f698415ef00 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6970003520 con 0x7f698415ef00 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3713665508 0 0) 0x7f6970003520 con 0x7f698415ef00 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69840d1e70 msgr2=0x7f69840c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f69892f6640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69840d1e70 0x7f69840c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 >> v1:172.21.15.186:6789/0 conn(0x7f69840c7140 legacy=0x7f69840cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840c7f30 con 0x7f698415ef00 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.246+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f6980001670 con 0x7f698415ef00 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 >> v1:172.21.15.172:6789/0 conn(0x7f698415ef00 legacy=0x7f69840d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f69892f6640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700039e0 0x7f6970003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f69892f6640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 0x7f6970004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f69892f6640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69840d1e70 0x7f69700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698415f2e0 con 0x7f6970004800 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697000bb30 con 0x7f69700039e0 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697000bd30 con 0x7f69840d1e70 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f6989af7640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 0x7f6970004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f698a2f8640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700039e0 0x7f6970003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f698aaf9640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69840d1e70 0x7f69700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f6989af7640 1 -- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69840d1e70 msgr2=0x7f69700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f6989af7640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69840d1e70 0x7f69700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f6989af7640 1 -- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700039e0 msgr2=0x7f6970003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f6989af7640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700039e0 0x7f6970003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f6989af7640 1 -- 172.21.15.172:0/2946814827 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970003520 con 0x7f6970004800 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.247+0000 7f698aaf9640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69840d1e70 0x7f69700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f6989af7640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 0x7f6970004c80 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f6974009a90 tx=0x7f6970005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fe7ed77e7ab62c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974036070 con 0x7f6970004800 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6974031400 con 0x7f6970004800 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f69892f6640 1 -- 172.21.15.172:0/2946814827 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6974009690 con 0x7f6970004800 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f698c55c640 1 -- 172.21.15.172:0/2946814827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 msgr2=0x7f6970004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f698c55c640 1 --2- 172.21.15.172:0/2946814827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 0x7f6970004c80 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f6974009a90 tx=0x7f6970005830 comp rx=0 tx=0).stop 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f698aaf9640 1 -- 172.21.15.172:0/2946814827 reap_dead start 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f698c55c640 1 -- 172.21.15.172:0/2946814827 shutdown_connections 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f698c55c640 1 -- 172.21.15.172:0/2946814827 >> 172.21.15.172:0/2946814827 conn(0x7f698406f5d0 msgr2=0x7f698406f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f698c55c640 1 -- 172.21.15.172:0/2946814827 shutdown_connections 2024-04-25T08:50:11.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.248+0000 7f698c55c640 1 -- 172.21.15.172:0/2946814827 wait complete. 2024-04-25T08:50:11.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698c55c640 1 Processor -- start 2024-04-25T08:50:11.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698c55c640 1 -- start start 2024-04-25T08:50:11.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698c55c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 0x7f698414ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698c55c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69840b1f10 0x7f69840b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698c55c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69841f2370 0x7f69840c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698c55c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c7560 con 0x7f6970004800 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698c55c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c84f0 con 0x7f69840b1f10 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698c55c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c76e0 con 0x7f69841f2370 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698a2f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 0x7f698414ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698a2f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 0x7f698414ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49912/0 (socket says 172.21.15.172:49912) 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698a2f8640 1 -- 172.21.15.172:0/3826847669 learned_addr learned my addr 172.21.15.172:0/3826847669 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.250+0000 7f698aaf9640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69841f2370 0x7f69840c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f6989af7640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69840b1f10 0x7f69840b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f698a2f8640 1 -- 172.21.15.172:0/3826847669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69841f2370 msgr2=0x7f69840c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f698a2f8640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69841f2370 0x7f69840c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f698a2f8640 1 -- 172.21.15.172:0/3826847669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69840b1f10 msgr2=0x7f69840b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f698a2f8640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69840b1f10 0x7f69840b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f698a2f8640 1 -- 172.21.15.172:0/3826847669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840b2460 con 0x7f6970004800 2024-04-25T08:50:11.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f698a2f8640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 0x7f698414ae70 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f6980000f60 tx=0x7f6980007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f697affd640 1 -- 172.21.15.172:0/3826847669 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698000f960 con 0x7f6970004800 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f697affd640 1 -- 172.21.15.172:0/3826847669 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6980018070 con 0x7f6970004800 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f697affd640 1 -- 172.21.15.172:0/3826847669 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698000fd20 con 0x7f6970004800 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f698c55c640 1 -- 172.21.15.172:0/3826847669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69840b2740 con 0x7f6970004800 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.251+0000 7f698c55c640 1 -- 172.21.15.172:0/3826847669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69841f1e50 con 0x7f6970004800 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.252+0000 7f698c55c640 1 -- 172.21.15.172:0/3826847669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698414b410 con 0x7f6970004800 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.253+0000 7f697affd640 1 -- 172.21.15.172:0/3826847669 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f698001d460 con 0x7f6970004800 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.253+0000 7f697affd640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f696806b4d0 0x7f696806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.253+0000 7f697affd640 1 -- 172.21.15.172:0/3826847669 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f698008a320 con 0x7f6970004800 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.253+0000 7f6989af7640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f696806b4d0 0x7f696806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.253+0000 7f6989af7640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f696806b4d0 0x7f696806d990 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6974033000 tx=0x7f6974008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:11.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.257+0000 7f697affd640 1 -- 172.21.15.172:0/3826847669 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6980059010 con 0x7f6970004800 2024-04-25T08:50:11.452 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.462+0000 7f698c55c640 1 -- 172.21.15.172:0/3826847669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6984073990 con 0x7f6970004800 2024-04-25T08:50:11.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.462+0000 7f697affd640 1 -- 172.21.15.172:0/3826847669 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f6984073990 con 0x7f6970004800 2024-04-25T08:50:11.453 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:11.453 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:11.454 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:11.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.464+0000 7f698c55c640 1 -- 172.21.15.172:0/3826847669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f696806b4d0 msgr2=0x7f696806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.464+0000 7f698c55c640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f696806b4d0 0x7f696806d990 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6974033000 tx=0x7f6974008030 comp rx=0 tx=0).stop 2024-04-25T08:50:11.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.464+0000 7f698c55c640 1 -- 172.21.15.172:0/3826847669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 msgr2=0x7f698414ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.464+0000 7f698c55c640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 0x7f698414ae70 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f6980000f60 tx=0x7f6980007660 comp rx=0 tx=0).stop 2024-04-25T08:50:11.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.464+0000 7f698c55c640 1 -- 172.21.15.172:0/3826847669 shutdown_connections 2024-04-25T08:50:11.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.464+0000 7f698c55c640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f696806b4d0 0x7f696806d990 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.464+0000 7f698c55c640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69840b1f10 0x7f69840b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.464+0000 7f698c55c640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69841f2370 0x7f69840c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.464+0000 7f698c55c640 1 --2- 172.21.15.172:0/3826847669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6970004800 0x7f698414ae70 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.464+0000 7f698c55c640 1 -- 172.21.15.172:0/3826847669 >> 172.21.15.172:0/3826847669 conn(0x7f698406f5d0 msgr2=0x7f69840ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:11.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.465+0000 7f698c55c640 1 -- 172.21.15.172:0/3826847669 shutdown_connections 2024-04-25T08:50:11.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.465+0000 7f698c55c640 1 -- 172.21.15.172:0/3826847669 wait complete. 2024-04-25T08:50:11.868 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:50:02.459450+0000', 'modified': '2024-04-25T08:50:04.423512+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8670}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8670': {'gid': 8670, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6837/3573637584', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3573637584}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3573637584}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:50:11.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:50:11.869 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T08:50:11.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.980+0000 7feb2a841640 1 Processor -- start 2024-04-25T08:50:11.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.980+0000 7feb2a841640 1 -- start start 2024-04-25T08:50:11.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.981+0000 7feb2a841640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feb2415bb50 0x7feb240c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.981+0000 7feb2a841640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb240c75e0 con 0x7feb240cfd10 2024-04-25T08:50:11.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.981+0000 7feb2a841640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb240c78c0 con 0x7feb240c70d0 2024-04-25T08:50:11.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.981+0000 7feb2a841640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb240c8680 con 0x7feb2415bb50 2024-04-25T08:50:11.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.981+0000 7feb23fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feb2415bb50 0x7feb240c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.981+0000 7feb23fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feb2415bb50 0x7feb240c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49920/0 (socket says 172.21.15.172:49920) 2024-04-25T08:50:11.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.981+0000 7feb23fff640 1 -- 172.21.15.172:0/1711958032 learned_addr learned my addr 172.21.15.172:0/1711958032 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:11.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.981+0000 7feb28dde640 1 --1- 172.21.15.172:0/1711958032 >> v1:172.21.15.172:6789/0 conn(0x7feb240cfd10 0x7feb240cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41514/0 (socket says 172.21.15.172:41514) 2024-04-25T08:50:11.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.982+0000 7feb23fff640 1 -- 172.21.15.172:0/1711958032 >> v1:172.21.15.186:6789/0 conn(0x7feb240c70d0 legacy=0x7feb240cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.982+0000 7feb23fff640 1 -- 172.21.15.172:0/1711958032 >> v1:172.21.15.172:6789/0 conn(0x7feb240cfd10 legacy=0x7feb240cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.982+0000 7feb23fff640 1 -- 172.21.15.172:0/1711958032 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240c7ba0 con 0x7feb2415bb50 2024-04-25T08:50:11.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.982+0000 7feb22ffd640 1 -- 172.21.15.172:0/1711958032 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200754349 0 0) 0x7feb240c75e0 con 0x7feb240cfd10 2024-04-25T08:50:11.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.982+0000 7feb23fff640 1 --2- 172.21.15.172:0/1711958032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 0x7feb240c6b90 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7feb14009870 tx=0x7feb1402a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffacddb2dd6e8723 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:11.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.982+0000 7feb22ffd640 1 -- 172.21.15.172:0/1711958032 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14037070 con 0x7feb2415bb50 2024-04-25T08:50:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.983+0000 7feb22ffd640 1 -- 172.21.15.172:0/1711958032 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14032640 con 0x7feb2415bb50 2024-04-25T08:50:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.983+0000 7feb22ffd640 1 -- 172.21.15.172:0/1711958032 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14032a10 con 0x7feb2415bb50 2024-04-25T08:50:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.983+0000 7feb2a841640 1 -- 172.21.15.172:0/1711958032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 msgr2=0x7feb240c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.983+0000 7feb2a841640 1 --2- 172.21.15.172:0/1711958032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 0x7feb240c6b90 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7feb14009870 tx=0x7feb1402a3c0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.983+0000 7feb2a841640 1 -- 172.21.15.172:0/1711958032 shutdown_connections 2024-04-25T08:50:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.983+0000 7feb2a841640 1 --2- 172.21.15.172:0/1711958032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 0x7feb240c6b90 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.983+0000 7feb2a841640 1 -- 172.21.15.172:0/1711958032 >> 172.21.15.172:0/1711958032 conn(0x7feb2406f500 msgr2=0x7feb2406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.983+0000 7feb2a841640 1 -- 172.21.15.172:0/1711958032 shutdown_connections 2024-04-25T08:50:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.983+0000 7feb2a841640 1 -- 172.21.15.172:0/1711958032 wait complete. 2024-04-25T08:50:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.984+0000 7feb2a841640 1 Processor -- start 2024-04-25T08:50:11.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.984+0000 7feb2a841640 1 -- start start 2024-04-25T08:50:11.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb2a841640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb240c70d0 0x7feb240cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb2a841640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb240cfd10 0x7feb240cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb2a841640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 0x7feb24150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb2a841640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2415f6d0 con 0x7feb2415bb50 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb2a841640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240c8160 con 0x7feb240c70d0 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb2a841640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2415f850 con 0x7feb240cfd10 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb28dde640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 0x7feb24150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb28dde640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 0x7feb24150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49934/0 (socket says 172.21.15.172:49934) 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb28dde640 1 -- 172.21.15.172:0/3956790938 learned_addr learned my addr 172.21.15.172:0/3956790938 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb23fff640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb240c70d0 0x7feb240cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb237fe640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb240cfd10 0x7feb240cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb28dde640 1 -- 172.21.15.172:0/3956790938 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb240cfd10 msgr2=0x7feb240cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb28dde640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb240cfd10 0x7feb240cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb28dde640 1 -- 172.21.15.172:0/3956790938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb240c70d0 msgr2=0x7feb240cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.985+0000 7feb28dde640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb240c70d0 0x7feb240cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.986+0000 7feb28dde640 1 -- 172.21.15.172:0/3956790938 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240cc570 con 0x7feb2415bb50 2024-04-25T08:50:11.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.986+0000 7feb28dde640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 0x7feb24150810 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00c730 tx=0x7feb1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:11.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.986+0000 7feb20ff9640 1 -- 172.21.15.172:0/3956790938 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c018070 con 0x7feb2415bb50 2024-04-25T08:50:11.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.986+0000 7feb20ff9640 1 -- 172.21.15.172:0/3956790938 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c00ce40 con 0x7feb2415bb50 2024-04-25T08:50:11.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.986+0000 7feb2a841640 1 -- 172.21.15.172:0/3956790938 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb240cc850 con 0x7feb2415bb50 2024-04-25T08:50:11.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.986+0000 7feb20ff9640 1 -- 172.21.15.172:0/3956790938 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00a880 con 0x7feb2415bb50 2024-04-25T08:50:11.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.986+0000 7feb2a841640 1 -- 172.21.15.172:0/3956790938 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb240cce10 con 0x7feb2415bb50 2024-04-25T08:50:11.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.987+0000 7feb20ff9640 1 -- 172.21.15.172:0/3956790938 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7feb1c01b070 con 0x7feb2415bb50 2024-04-25T08:50:11.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.988+0000 7feb20ff9640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feb1006b4d0 0x7feb1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.988+0000 7feb20ff9640 1 -- 172.21.15.172:0/3956790938 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7feb1c0898a0 con 0x7feb2415bb50 2024-04-25T08:50:11.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.988+0000 7feb23fff640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feb1006b4d0 0x7feb1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.988+0000 7feb23fff640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feb1006b4d0 0x7feb1006d990 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7feb14034000 tx=0x7feb1402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.989+0000 7feb2d616740 1 Processor -- start 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.989+0000 7feb2d616740 1 -- start start 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.989+0000 7feb2d616740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbd2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.989+0000 7feb2d616740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbf0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.989+0000 7feb2d616740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adba7f10 0x5577adbee190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.989+0000 7feb2d616740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577adb0aa10 con 0x5577adbd2230 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.989+0000 7feb2d616740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577adab3b30 con 0x5577adba7f10 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.989+0000 7feb2d616740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577adb06c50 con 0x5577adbefad0 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb23fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbd2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb23fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbd2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49944/0 (socket says 172.21.15.172:49944) 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb23fff640 1 -- 172.21.15.172:0/776683564 learned_addr learned my addr 172.21.15.172:0/776683564 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb28dde640 1 --2- 172.21.15.172:0/776683564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adba7f10 0x5577adbee190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb237fe640 1 --2- 172.21.15.172:0/776683564 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbf0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb23fff640 1 -- 172.21.15.172:0/776683564 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 msgr2=0x5577adbf0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb23fff640 1 --2- 172.21.15.172:0/776683564 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbf0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb23fff640 1 -- 172.21.15.172:0/776683564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adba7f10 msgr2=0x5577adbee190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb23fff640 1 --2- 172.21.15.172:0/776683564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adba7f10 0x5577adbee190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb23fff640 1 -- 172.21.15.172:0/776683564 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577adac8e10 con 0x5577adbd2230 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb28dde640 1 --2- 172.21.15.172:0/776683564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adba7f10 0x5577adbee190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb23fff640 1 --2- 172.21.15.172:0/776683564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbd2610 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7feb140090b0 tx=0x7feb1402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b180ecfc4a4966 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb09ffb640 1 -- 172.21.15.172:0/776683564 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14037040 con 0x5577adbd2230 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb09ffb640 1 -- 172.21.15.172:0/776683564 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14032da0 con 0x5577adbd2230 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.990+0000 7feb09ffb640 1 -- 172.21.15.172:0/776683564 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14047630 con 0x5577adbd2230 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.991+0000 7feb2d616740 1 -- 172.21.15.172:0/776683564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 msgr2=0x5577adbd2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.991+0000 7feb2d616740 1 --2- 172.21.15.172:0/776683564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbd2610 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7feb140090b0 tx=0x7feb1402c000 comp rx=0 tx=0).stop 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.991+0000 7feb2d616740 1 -- 172.21.15.172:0/776683564 shutdown_connections 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.991+0000 7feb2d616740 1 --2- 172.21.15.172:0/776683564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adba7f10 0x5577adbee190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.991+0000 7feb2d616740 1 --2- 172.21.15.172:0/776683564 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbf0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.991+0000 7feb2d616740 1 --2- 172.21.15.172:0/776683564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbd2610 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.991+0000 7feb2d616740 1 -- 172.21.15.172:0/776683564 >> 172.21.15.172:0/776683564 conn(0x5577adba4840 msgr2=0x5577adbed040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:11.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.991+0000 7feb2d616740 1 -- 172.21.15.172:0/776683564 shutdown_connections 2024-04-25T08:50:11.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.991+0000 7feb2d616740 1 -- 172.21.15.172:0/776683564 wait complete. 2024-04-25T08:50:11.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.991+0000 7feb2d616740 1 -- start start 2024-04-25T08:50:11.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.992+0000 7feb2d616740 1 Processor -- start 2024-04-25T08:50:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.992+0000 7feb2d616740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 0x5577adc010b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.992+0000 7feb2d616740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbd5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.992+0000 7feb2d616740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbbcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.992+0000 7feb2d616740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577adba8cb0 con 0x5577adbbc8d0 2024-04-25T08:50:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.992+0000 7feb2d616740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577adac70c0 con 0x5577adbd2230 2024-04-25T08:50:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.992+0000 7feb2d616740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577adba2770 con 0x5577adbefad0 2024-04-25T08:50:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.992+0000 7feb2d616740 10 client.0 _ll_register_callbacks cb 0x5577adabaec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb28dde640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbbcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb28dde640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbbcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49952/0 (socket says 172.21.15.172:49952) 2024-04-25T08:50:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb28dde640 1 -- 172.21.15.172:0/2332542577 learned_addr learned my addr 172.21.15.172:0/2332542577 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb23fff640 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 0x5577adc010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb237fe640 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbd5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb28dde640 1 -- 172.21.15.172:0/2332542577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 msgr2=0x5577adbd5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb28dde640 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbd5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb28dde640 1 -- 172.21.15.172:0/2332542577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 msgr2=0x5577adc010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb28dde640 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 0x5577adc010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb28dde640 1 -- 172.21.15.172:0/2332542577 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5577ad81f2d0 con 0x5577adbbc8d0 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb28dde640 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbbcd50 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00a430 tx=0x7feb1c057f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d455089ee404591 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb02ffd640 1 -- 172.21.15.172:0/2332542577 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c086060 con 0x5577adbbc8d0 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb02ffd640 1 -- 172.21.15.172:0/2332542577 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7feb1c060110 con 0x5577adbbc8d0 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb2d616740 1 -- 172.21.15.172:0/2332542577 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb14032da0 con 0x5577adbbc8d0 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb02ffd640 1 -- 172.21.15.172:0/2332542577 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb1c074050 con 0x5577adbbc8d0 2024-04-25T08:50:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb2d616740 10 client.8820 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb2d616740 1 -- 172.21.15.172:0/2332542577 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x5577ad8e96b0 con 0x5577adbbc8d0 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb02ffd640 1 -- 172.21.15.172:0/2332542577 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14032da0 con 0x5577adbbc8d0 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb02ffd640 1 -- 172.21.15.172:0/2332542577 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7feb1c057390 con 0x5577adbbc8d0 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb2d616740 10 client.8820 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.993+0000 7feb2d616740 10 client.8820 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.994+0000 7feb2d616740 20 client.8820 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.994+0000 7feb2d616740 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5577adbfdb60 0x5577adbfdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.994+0000 7feb2d616740 4 client.8820 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.994+0000 7feb2d616740 1 -- 172.21.15.172:0/2332542577 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5577adb69920 con 0x5577adbfdb60 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.994+0000 7feb23fff640 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5577adbfdb60 0x5577adbfdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.994+0000 7feb02ffd640 10 client.8820 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.994+0000 7feb23fff640 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5577adbfdb60 0x5577adbfdf40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2c05641f7bf6936 server_cookie=f825906f73c89f67 in_seq=0 out_seq=0 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb02ffd640 1 -- 172.21.15.172:0/2332542577 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5577adb69920 con 0x5577adbfdb60 2024-04-25T08:50:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb02ffd640 10 client.8820 handle_command_reply: tid=0 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 client.8820 shutdown 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 -- 172.21.15.172:0/2332542577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 msgr2=0x5577adbbcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbbcd50 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00a430 tx=0x7feb1c057f40 comp rx=0 tx=0).stop 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 -- 172.21.15.172:0/2332542577 shutdown_connections 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5577adbfdb60 0x5577adbfdf40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbbcd50 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbd5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb02ffd640 0 client.8820 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 --2- 172.21.15.172:0/2332542577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 0x5577adc010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 -- 172.21.15.172:0/2332542577 >> 172.21.15.172:0/2332542577 conn(0x5577adba7f10 msgr2=0x5577adbf0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 -- 172.21.15.172:0/2332542577 shutdown_connections 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 1 -- 172.21.15.172:0/2332542577 wait complete. 2024-04-25T08:50:11.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:11.995+0000 7feb2d616740 20 client.8820 trim_cache size 0 max 16384 2024-04-25T08:50:12.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.010+0000 7feb2d616740 1 Processor -- start 2024-04-25T08:50:12.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.010+0000 7feb2d616740 1 -- start start 2024-04-25T08:50:12.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb2d616740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbbc8d0 0x5577adba1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb2d616740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbcd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb2d616740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbeb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb2d616740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb241fb2b0 con 0x5577adbd2230 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb2d616740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240b4e80 con 0x5577adbbc8d0 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb2d616740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb241fad80 con 0x5577adbefad0 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb237fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbcd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb237fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbcd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49966/0 (socket says 172.21.15.172:49966) 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb237fe640 1 -- 172.21.15.172:0/4067519086 learned_addr learned my addr 172.21.15.172:0/4067519086 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb237fe640 1 -- 172.21.15.172:0/4067519086 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 msgr2=0x5577adbeb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb237fe640 1 --2- 172.21.15.172:0/4067519086 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbeb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb237fe640 1 -- 172.21.15.172:0/4067519086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbbc8d0 msgr2=0x5577adba1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb237fe640 1 --2- 172.21.15.172:0/4067519086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbbc8d0 0x5577adba1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.011+0000 7feb237fe640 1 -- 172.21.15.172:0/4067519086 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577adbbc4b0 con 0x5577adbd2230 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb237fe640 1 --2- 172.21.15.172:0/4067519086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbcd670 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7feb18000f60 tx=0x7feb18007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcdab3170104045 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb097fa640 1 -- 172.21.15.172:0/4067519086 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18007030 con 0x5577adbd2230 2024-04-25T08:50:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb097fa640 1 -- 172.21.15.172:0/4067519086 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb180071d0 con 0x5577adbd2230 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb097fa640 1 -- 172.21.15.172:0/4067519086 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18007580 con 0x5577adbd2230 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb2d616740 1 -- 172.21.15.172:0/4067519086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 msgr2=0x5577adbcd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb2d616740 1 --2- 172.21.15.172:0/4067519086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbcd670 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7feb18000f60 tx=0x7feb18007e30 comp rx=0 tx=0).stop 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb2d616740 1 -- 172.21.15.172:0/4067519086 shutdown_connections 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb2d616740 1 --2- 172.21.15.172:0/4067519086 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbeb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb2d616740 1 --2- 172.21.15.172:0/4067519086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbd2230 0x5577adbcd670 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb2d616740 1 --2- 172.21.15.172:0/4067519086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbbc8d0 0x5577adba1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb2d616740 1 -- 172.21.15.172:0/4067519086 >> 172.21.15.172:0/4067519086 conn(0x5577adba7f10 msgr2=0x5577adc00ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb2d616740 1 -- 172.21.15.172:0/4067519086 shutdown_connections 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.012+0000 7feb2d616740 1 -- 172.21.15.172:0/4067519086 wait complete. 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.013+0000 7feb2d616740 1 -- start start 2024-04-25T08:50:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.013+0000 7feb2d616740 1 Processor -- start 2024-04-25T08:50:12.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb2d616740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbcd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb2d616740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 0x5577adc590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb2d616740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbd06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb2d616740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577adbd2ef0 con 0x5577adbbc8d0 2024-04-25T08:50:12.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb2d616740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577adc015f0 con 0x5577adbd2230 2024-04-25T08:50:12.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb2d616740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577adbd3190 con 0x5577adbefad0 2024-04-25T08:50:12.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb2d616740 10 client.0 _ll_register_callbacks cb 0x5577adba2c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb23fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbcd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb23fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbcd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49976/0 (socket says 172.21.15.172:49976) 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb23fff640 1 -- 172.21.15.172:0/905791244 learned_addr learned my addr 172.21.15.172:0/905791244 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb237fe640 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 0x5577adc590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb28dde640 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbd06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb23fff640 1 -- 172.21.15.172:0/905791244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 msgr2=0x5577adbd06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb23fff640 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbd06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb23fff640 1 -- 172.21.15.172:0/905791244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 msgr2=0x5577adc590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb23fff640 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 0x5577adc590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb23fff640 1 -- 172.21.15.172:0/905791244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5577adbe9370 con 0x5577adbbc8d0 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb237fe640 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 0x5577adc590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb28dde640 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbd06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb23fff640 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbcd8e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7feb14009870 tx=0x7feb14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4101ccbf364c357d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:12.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.014+0000 7feb02ffd640 1 -- 172.21.15.172:0/905791244 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14040040 con 0x5577adbbc8d0 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb02ffd640 1 -- 172.21.15.172:0/905791244 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7feb14004120 con 0x5577adbbc8d0 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb2d616740 1 -- 172.21.15.172:0/905791244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb180071d0 con 0x5577adbbc8d0 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb02ffd640 1 -- 172.21.15.172:0/905791244 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb14064050 con 0x5577adbbc8d0 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb2d616740 10 client.8826 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb2d616740 1 -- 172.21.15.172:0/905791244 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x5577adbef520 con 0x5577adbbc8d0 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb02ffd640 1 -- 172.21.15.172:0/905791244 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb180071d0 con 0x5577adbbc8d0 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb02ffd640 1 -- 172.21.15.172:0/905791244 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7feb14067020 con 0x5577adbbc8d0 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb2d616740 10 client.8826 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb2d616740 10 client.8826 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb2d616740 20 client.8826 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb2d616740 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5577adbd0d80 0x5577adbede50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb2d616740 4 client.8826 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb2d616740 1 -- 172.21.15.172:0/905791244 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5577adbe7110 con 0x5577adbd0d80 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb237fe640 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5577adbd0d80 0x5577adbede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb02ffd640 10 client.8826 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb237fe640 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5577adbd0d80 0x5577adbede50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20004c2ae71067e8 server_cookie=7409504e4ecb2176 in_seq=0 out_seq=0 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb02ffd640 1 -- 172.21.15.172:0/905791244 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5577adbe7110 con 0x5577adbd0d80 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb02ffd640 10 client.8826 handle_command_reply: tid=0 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.015+0000 7feb2d616740 1 client.8826 shutdown 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 1 -- 172.21.15.172:0/905791244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 msgr2=0x5577adbcd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbcd8e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7feb14009870 tx=0x7feb14004730 comp rx=0 tx=0).stop 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 1 -- 172.21.15.172:0/905791244 shutdown_connections 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5577adbd0d80 0x5577adbede50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5577adbd2230 0x5577adc590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5577adbefad0 0x5577adbd06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb02ffd640 0 client.8826 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 1 --2- 172.21.15.172:0/905791244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577adbbc8d0 0x5577adbcd8e0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 1 -- 172.21.15.172:0/905791244 >> 172.21.15.172:0/905791244 conn(0x5577adba7f10 msgr2=0x5577adba1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:12.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 1 -- 172.21.15.172:0/905791244 shutdown_connections 2024-04-25T08:50:12.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 1 -- 172.21.15.172:0/905791244 wait complete. 2024-04-25T08:50:12.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2d616740 20 client.8826 trim_cache size 0 max 16384 2024-04-25T08:50:12.013 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:50:12.013 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:50:12.013 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:50:12.013 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 8670, 2024-04-25T08:50:12.013 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:50:12.013 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:50:12.014 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:50:12.014 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 8.9410130769999991, 2024-04-25T08:50:12.014 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 68, 2024-04-25T08:50:12.014 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 119, 2024-04-25T08:50:12.014 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 119, 2024-04-25T08:50:12.014 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 14.012346202 2024-04-25T08:50:12.014 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:50:12.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2a841640 1 -- 172.21.15.172:0/3956790938 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feb1006b4d0 msgr2=0x7feb1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:12.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2a841640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feb1006b4d0 0x7feb1006d990 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7feb14034000 tx=0x7feb1402e000 comp rx=0 tx=0).stop 2024-04-25T08:50:12.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2a841640 1 -- 172.21.15.172:0/3956790938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 msgr2=0x7feb24150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:12.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2a841640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 0x7feb24150810 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00c730 tx=0x7feb1c00cbf0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2a841640 1 -- 172.21.15.172:0/3956790938 shutdown_connections 2024-04-25T08:50:12.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2a841640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7feb1006b4d0 0x7feb1006d990 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2a841640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb2415bb50 0x7feb24150810 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2a841640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb240cfd10 0x7feb240cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2a841640 1 --2- 172.21.15.172:0/3956790938 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb240c70d0 0x7feb240cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.016+0000 7feb2a841640 1 -- 172.21.15.172:0/3956790938 >> 172.21.15.172:0/3956790938 conn(0x7feb2406f500 msgr2=0x7feb24070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:12.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.017+0000 7feb2a841640 1 -- 172.21.15.172:0/3956790938 shutdown_connections 2024-04-25T08:50:12.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.017+0000 7feb2a841640 1 -- 172.21.15.172:0/3956790938 wait complete. 2024-04-25T08:50:12.018 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:50:12.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.125+0000 7f6c8e0fc640 1 Processor -- start 2024-04-25T08:50:12.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.125+0000 7f6c8e0fc640 1 -- start start 2024-04-25T08:50:12.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.126+0000 7f6c8e0fc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6c8815dbe0 0x7f6c880d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.126+0000 7f6c8e0fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c880b2cb0 0x7f6c880d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.126+0000 7f6c8e0fc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c880b97a0 con 0x7f6c880b92a0 2024-04-25T08:50:12.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.126+0000 7f6c8e0fc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8815dfc0 con 0x7f6c8815dbe0 2024-04-25T08:50:12.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.126+0000 7f6c8e0fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880d1a00 con 0x7f6c880b2cb0 2024-04-25T08:50:12.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.126+0000 7f6c87fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6c880b92a0 0x7f6c880b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41520/0 (socket says 172.21.15.172:41520) 2024-04-25T08:50:12.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.126+0000 7f6c87fff640 1 -- 172.21.15.172:0/1196823812 learned_addr learned my addr 172.21.15.172:0/1196823812 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:12.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.126+0000 7f6c86ffd640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c880b2cb0 0x7f6c880d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.126+0000 7f6c877fe640 1 --2- 172.21.15.172:0/1196823812 >> v2:172.21.15.186:3300/0 conn(0x7f6c8815dbe0 0x7f6c880d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712157113 0 0) 0x7f6c880b97a0 con 0x7f6c880b92a0 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c70003520 con 0x7f6c880b92a0 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2059171589 0 0) 0x7f6c70003520 con 0x7f6c880b92a0 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c880b2cb0 msgr2=0x7f6c880d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c880b2cb0 0x7f6c880d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 >> v2:172.21.15.186:3300/0 conn(0x7f6c8815dbe0 msgr2=0x7f6c880d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 --2- 172.21.15.172:0/1196823812 >> v2:172.21.15.186:3300/0 conn(0x7f6c8815dbe0 0x7f6c880d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c880d1c50 con 0x7f6c880b92a0 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f6c800019f0 con 0x7f6c880b92a0 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c877fe640 1 --2- 172.21.15.172:0/1196823812 >> v2:172.21.15.186:3300/0 conn(0x7f6c8815dbe0 0x7f6c880d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 >> v1:172.21.15.172:6789/0 conn(0x7f6c880b92a0 legacy=0x7f6c880b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c880b2cb0 0x7f6c700039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c70003f30 0x7f6c70004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 0x7f6c700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880d1a00 con 0x7f6c70004d40 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7000b9c0 con 0x7f6c70003f30 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7000bb40 con 0x7f6c880b2cb0 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c87fff640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 0x7f6c700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c877fe640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c880b2cb0 0x7f6c700039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c86ffd640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c70003f30 0x7f6c70004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c87fff640 1 -- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c880b2cb0 msgr2=0x7f6c700039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c87fff640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c880b2cb0 0x7f6c700039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c87fff640 1 -- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c70003f30 msgr2=0x7f6c70004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c87fff640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c70003f30 0x7f6c70004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.127+0000 7f6c87fff640 1 -- 172.21.15.172:0/1196823812 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c70003520 con 0x7f6c70004d40 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.128+0000 7f6c87fff640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 0x7f6c700051c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6c880b25c0 tx=0x7f6c70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ccd8fd0840eeb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:12.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.128+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000a4c0 con 0x7f6c70004d40 2024-04-25T08:50:12.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.128+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8002f070 con 0x7f6c70004d40 2024-04-25T08:50:12.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.128+0000 7f6c867fc640 1 -- 172.21.15.172:0/1196823812 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8002bce0 con 0x7f6c70004d40 2024-04-25T08:50:12.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.129+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/1196823812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 msgr2=0x7f6c700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:12.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.129+0000 7f6c8e0fc640 1 --2- 172.21.15.172:0/1196823812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 0x7f6c700051c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6c880b25c0 tx=0x7f6c70005830 comp rx=0 tx=0).stop 2024-04-25T08:50:12.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.129+0000 7f6c87fff640 1 -- 172.21.15.172:0/1196823812 reap_dead start 2024-04-25T08:50:12.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.129+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/1196823812 shutdown_connections 2024-04-25T08:50:12.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.129+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/1196823812 >> 172.21.15.172:0/1196823812 conn(0x7f6c88061a20 msgr2=0x7f6c88061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:12.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.129+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/1196823812 shutdown_connections 2024-04-25T08:50:12.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.129+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/1196823812 wait complete. 2024-04-25T08:50:12.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.130+0000 7f6c8e0fc640 1 Processor -- start 2024-04-25T08:50:12.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.130+0000 7f6c8e0fc640 1 -- start start 2024-04-25T08:50:12.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c8e0fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 0x7f6c881509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c8e0fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88156e40 0x7f6c880b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c8e0fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c881572a0 0x7f6c880b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c8e0fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880b6ab0 con 0x7f6c70004d40 2024-04-25T08:50:12.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c8e0fc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880d2210 con 0x7f6c88156e40 2024-04-25T08:50:12.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c8e0fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880b6c30 con 0x7f6c881572a0 2024-04-25T08:50:12.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c877fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 0x7f6c881509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c877fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 0x7f6c881509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49998/0 (socket says 172.21.15.172:49998) 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c877fe640 1 -- 172.21.15.172:0/4023061548 learned_addr learned my addr 172.21.15.172:0/4023061548 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c86ffd640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88156e40 0x7f6c880b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c87fff640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c881572a0 0x7f6c880b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c877fe640 1 -- 172.21.15.172:0/4023061548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c881572a0 msgr2=0x7f6c880b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c877fe640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c881572a0 0x7f6c880b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c877fe640 1 -- 172.21.15.172:0/4023061548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88156e40 msgr2=0x7f6c880b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c877fe640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88156e40 0x7f6c880b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c877fe640 1 -- 172.21.15.172:0/4023061548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88151380 con 0x7f6c70004d40 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c86ffd640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88156e40 0x7f6c880b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c877fe640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 0x7f6c881509a0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f6c78011d00 tx=0x7f6c7800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c6ffff640 1 -- 172.21.15.172:0/4023061548 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800fcc0 con 0x7f6c70004d40 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c6ffff640 1 -- 172.21.15.172:0/4023061548 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7800fe80 con 0x7f6c70004d40 2024-04-25T08:50:12.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/4023061548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c88155da0 con 0x7f6c70004d40 2024-04-25T08:50:12.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c6ffff640 1 -- 172.21.15.172:0/4023061548 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c78004260 con 0x7f6c70004d40 2024-04-25T08:50:12.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.131+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/4023061548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c88156360 con 0x7f6c70004d40 2024-04-25T08:50:12.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.132+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/4023061548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88073990 con 0x7f6c70004d40 2024-04-25T08:50:12.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.133+0000 7f6c6ffff640 1 -- 172.21.15.172:0/4023061548 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c78012040 con 0x7f6c70004d40 2024-04-25T08:50:12.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.133+0000 7f6c6ffff640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6c7406b4d0 0x7f6c7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:12.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.133+0000 7f6c86ffd640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6c7406b4d0 0x7f6c7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:12.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.134+0000 7f6c6ffff640 1 -- 172.21.15.172:0/4023061548 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6c7808a900 con 0x7f6c70004d40 2024-04-25T08:50:12.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.134+0000 7f6c86ffd640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6c7406b4d0 0x7f6c7406d990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6c88154ad0 tx=0x7f6c7c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:12.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.138+0000 7f6c6ffff640 1 -- 172.21.15.172:0/4023061548 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c88151380 con 0x7f6c70004d40 2024-04-25T08:50:12.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.366+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/4023061548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6c88062160 con 0x7f6c70004d40 2024-04-25T08:50:12.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.366+0000 7f6c6ffff640 1 -- 172.21.15.172:0/4023061548 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6c78019030 con 0x7f6c70004d40 2024-04-25T08:50:12.357 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.368+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/4023061548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6c7406b4d0 msgr2=0x7f6c7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.368+0000 7f6c8e0fc640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6c7406b4d0 0x7f6c7406d990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6c88154ad0 tx=0x7f6c7c008040 comp rx=0 tx=0).stop 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.368+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/4023061548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 msgr2=0x7f6c881509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.368+0000 7f6c8e0fc640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 0x7f6c881509a0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f6c78011d00 tx=0x7f6c7800f610 comp rx=0 tx=0).stop 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.368+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/4023061548 shutdown_connections 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.368+0000 7f6c8e0fc640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f6c7406b4d0 0x7f6c7406d990 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.368+0000 7f6c8e0fc640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c88156e40 0x7f6c880b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.368+0000 7f6c8e0fc640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6c881572a0 0x7f6c880b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.368+0000 7f6c8e0fc640 1 --2- 172.21.15.172:0/4023061548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c70004d40 0x7f6c881509a0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.368+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/4023061548 >> 172.21.15.172:0/4023061548 conn(0x7f6c88061a20 msgr2=0x7f6c880b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.369+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/4023061548 shutdown_connections 2024-04-25T08:50:12.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:12.369+0000 7f6c8e0fc640 1 -- 172.21.15.172:0/4023061548 wait complete. 2024-04-25T08:50:12.370 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:50:12.370 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:50:12.370 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:50:12.370 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:50:12.370 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:50:12.370 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:50:12.371 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:50:12.371 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:50:12.371 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:50:12.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:12.371 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:50:12.386 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:50:12.386 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:50:12.387 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42306sec preferred_lft 42306sec 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:50:12.388 INFO:teuthology.orchestra.run.smithi172.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:50:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether de:e6:d5:6e:7d:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:50:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::dce6:d5ff:fe6e:7d91/64 scope link 2024-04-25T08:50:12.389 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:50:12.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:12.389 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:50:12.449 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:50:12.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:12.450 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:50:12.506 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:50:12.507 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:50:12.507 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:50:12.507 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:50:12.507 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:50:12.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:12.508 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:50:12.508 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:12.508 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:50:12.508 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:50:12.508 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:50:12.508 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:12.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:12.591 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:50:12.646 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:50:12.647 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:50:12.647 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:50:12.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:12.647 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:50:12.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:50:12.712 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:50:12.767 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:50:12.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:50:12.767 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:50:12.822 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:50:12.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:12.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:50:12.903 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:50:12.904 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:50:12.904 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:50:12.912 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:50:12.912 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:50:12.912 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:50:12.912 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:50:12.912 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:50:12.917 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:50:12.918 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:50:12.918 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:50:12.918 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:50:12.918 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:50:12.918 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:50:12.918 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:50:12.918 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:50:12.919 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:50:12.919 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:50:12.919 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:50:12.919 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:50:12.919 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:50:12.921 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:50:12.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:12.921 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:50:12.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:12.986 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:50:13.043 INFO:teuthology.orchestra.run.smithi172.stdout:client7570 2024-04-25T08:50:13.043 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:50:13.043 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:50:13.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:13.099 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:13.099 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:13.100 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T08:50:13.100 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:13.100 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:13.100 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:13.100 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:13.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.168 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853515 s, 123 MB/s 2024-04-25T08:50:13.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.177 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00811864 s, 129 MB/s 2024-04-25T08:50:13.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.186 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732041 s, 143 MB/s 2024-04-25T08:50:13.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.193 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725203 s, 145 MB/s 2024-04-25T08:50:13.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.202 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078977 s, 133 MB/s 2024-04-25T08:50:13.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.209 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646838 s, 162 MB/s 2024-04-25T08:50:13.218 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.219 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827748 s, 127 MB/s 2024-04-25T08:50:13.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.226 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671066 s, 156 MB/s 2024-04-25T08:50:13.234 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.234 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.234 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650833 s, 161 MB/s 2024-04-25T08:50:13.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.242 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749017 s, 140 MB/s 2024-04-25T08:50:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.249 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642861 s, 163 MB/s 2024-04-25T08:50:13.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.258 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809359 s, 130 MB/s 2024-04-25T08:50:13.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738066 s, 142 MB/s 2024-04-25T08:50:13.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.274 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647187 s, 162 MB/s 2024-04-25T08:50:13.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.283 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078699 s, 133 MB/s 2024-04-25T08:50:13.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.291 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765102 s, 137 MB/s 2024-04-25T08:50:13.300 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.300 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.300 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784333 s, 134 MB/s 2024-04-25T08:50:13.307 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.307 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.307 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063889 s, 164 MB/s 2024-04-25T08:50:13.316 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.316 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.316 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753158 s, 139 MB/s 2024-04-25T08:50:13.322 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.322 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.323 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584227 s, 179 MB/s 2024-04-25T08:50:13.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.330 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658578 s, 159 MB/s 2024-04-25T08:50:13.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.338 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729867 s, 144 MB/s 2024-04-25T08:50:13.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.345 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581268 s, 180 MB/s 2024-04-25T08:50:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715842 s, 146 MB/s 2024-04-25T08:50:13.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.360 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648077 s, 162 MB/s 2024-04-25T08:50:13.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.368 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067027 s, 156 MB/s 2024-04-25T08:50:13.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.375 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064557 s, 162 MB/s 2024-04-25T08:50:13.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.383 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688176 s, 152 MB/s 2024-04-25T08:50:13.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.390 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630636 s, 166 MB/s 2024-04-25T08:50:13.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.397 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587419 s, 179 MB/s 2024-04-25T08:50:13.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.404 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620172 s, 169 MB/s 2024-04-25T08:50:13.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.412 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722088 s, 145 MB/s 2024-04-25T08:50:13.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:13.413 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:13.414 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:13.414 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T08:50:13.414 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:13.414 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:13.414 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:13.414 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:13.478 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.478 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.478 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667106 s, 157 MB/s 2024-04-25T08:50:13.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.486 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731428 s, 143 MB/s 2024-04-25T08:50:13.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.494 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.494 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068594 s, 153 MB/s 2024-04-25T08:50:13.501 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.501 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.501 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643346 s, 163 MB/s 2024-04-25T08:50:13.508 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.509 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.509 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065601 s, 160 MB/s 2024-04-25T08:50:13.515 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.516 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.516 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627682 s, 167 MB/s 2024-04-25T08:50:13.524 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.524 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.524 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746637 s, 140 MB/s 2024-04-25T08:50:13.531 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.531 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.531 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581979 s, 180 MB/s 2024-04-25T08:50:13.538 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.538 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.538 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644185 s, 163 MB/s 2024-04-25T08:50:13.545 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.546 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668781 s, 157 MB/s 2024-04-25T08:50:13.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.553 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600506 s, 175 MB/s 2024-04-25T08:50:13.560 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.560 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.560 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685088 s, 153 MB/s 2024-04-25T08:50:13.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.567 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570512 s, 184 MB/s 2024-04-25T08:50:13.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.574 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628198 s, 167 MB/s 2024-04-25T08:50:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.581 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571291 s, 184 MB/s 2024-04-25T08:50:13.588 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.588 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.588 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651939 s, 161 MB/s 2024-04-25T08:50:13.595 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.595 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.595 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568485 s, 184 MB/s 2024-04-25T08:50:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070549 s, 149 MB/s 2024-04-25T08:50:13.610 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.610 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.610 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649825 s, 161 MB/s 2024-04-25T08:50:13.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.617 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631465 s, 166 MB/s 2024-04-25T08:50:13.625 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.625 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.625 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656564 s, 160 MB/s 2024-04-25T08:50:13.633 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.633 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.633 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712818 s, 147 MB/s 2024-04-25T08:50:13.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.640 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667671 s, 157 MB/s 2024-04-25T08:50:13.647 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.647 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.647 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590642 s, 178 MB/s 2024-04-25T08:50:13.654 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.654 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.654 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627023 s, 167 MB/s 2024-04-25T08:50:13.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.662 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654094 s, 160 MB/s 2024-04-25T08:50:13.669 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.669 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.669 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670697 s, 156 MB/s 2024-04-25T08:50:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.677 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653616 s, 160 MB/s 2024-04-25T08:50:13.684 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.684 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.684 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647915 s, 162 MB/s 2024-04-25T08:50:13.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.690 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554634 s, 189 MB/s 2024-04-25T08:50:13.698 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.698 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.698 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668884 s, 157 MB/s 2024-04-25T08:50:13.705 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.705 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.705 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006049 s, 173 MB/s 2024-04-25T08:50:13.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:13.706 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:13.706 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:13.706 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T08:50:13.706 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:13.706 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:13.706 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:13.707 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:13.772 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.772 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.772 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758556 s, 138 MB/s 2024-04-25T08:50:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070376 s, 149 MB/s 2024-04-25T08:50:13.787 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.787 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.787 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626893 s, 167 MB/s 2024-04-25T08:50:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654532 s, 160 MB/s 2024-04-25T08:50:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560914 s, 187 MB/s 2024-04-25T08:50:13.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.808 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572541 s, 183 MB/s 2024-04-25T08:50:13.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.814 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585855 s, 179 MB/s 2024-04-25T08:50:13.822 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.822 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.822 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640835 s, 164 MB/s 2024-04-25T08:50:13.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.829 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634004 s, 165 MB/s 2024-04-25T08:50:13.836 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.836 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.836 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647871 s, 162 MB/s 2024-04-25T08:50:13.844 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.844 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.844 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064203 s, 163 MB/s 2024-04-25T08:50:13.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.852 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746818 s, 140 MB/s 2024-04-25T08:50:13.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.860 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701493 s, 149 MB/s 2024-04-25T08:50:13.866 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.867 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583718 s, 180 MB/s 2024-04-25T08:50:13.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.875 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.875 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717905 s, 146 MB/s 2024-04-25T08:50:13.882 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.883 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.883 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069837 s, 150 MB/s 2024-04-25T08:50:13.890 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.890 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.890 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655587 s, 160 MB/s 2024-04-25T08:50:13.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.897 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647392 s, 162 MB/s 2024-04-25T08:50:13.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.905 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707805 s, 148 MB/s 2024-04-25T08:50:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615479 s, 170 MB/s 2024-04-25T08:50:13.919 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.920 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.920 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630601 s, 166 MB/s 2024-04-25T08:50:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617795 s, 170 MB/s 2024-04-25T08:50:13.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.934 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622913 s, 168 MB/s 2024-04-25T08:50:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631394 s, 166 MB/s 2024-04-25T08:50:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.949 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.949 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684724 s, 153 MB/s 2024-04-25T08:50:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.956 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666384 s, 157 MB/s 2024-04-25T08:50:13.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.963 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063095 s, 166 MB/s 2024-04-25T08:50:13.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.971 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644787 s, 163 MB/s 2024-04-25T08:50:13.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.977 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549983 s, 191 MB/s 2024-04-25T08:50:13.984 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.984 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.984 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643231 s, 163 MB/s 2024-04-25T08:50:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.992 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070218 s, 149 MB/s 2024-04-25T08:50:13.999 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:13.999 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:13.999 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590684 s, 178 MB/s 2024-04-25T08:50:14.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:14.000 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:14.000 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:14.000 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T08:50:14.001 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:14.001 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:14.001 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:14.001 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:14.064 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.065 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701467 s, 149 MB/s 2024-04-25T08:50:14.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.072 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644869 s, 163 MB/s 2024-04-25T08:50:14.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.079 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662294 s, 158 MB/s 2024-04-25T08:50:14.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.086 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561351 s, 187 MB/s 2024-04-25T08:50:14.093 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.093 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.093 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606601 s, 173 MB/s 2024-04-25T08:50:14.100 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.100 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.100 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637321 s, 165 MB/s 2024-04-25T08:50:14.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.108 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649149 s, 162 MB/s 2024-04-25T08:50:14.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.115 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654816 s, 160 MB/s 2024-04-25T08:50:14.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.123 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713644 s, 147 MB/s 2024-04-25T08:50:14.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.130 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553021 s, 190 MB/s 2024-04-25T08:50:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.137 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063902 s, 164 MB/s 2024-04-25T08:50:14.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.145 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710856 s, 148 MB/s 2024-04-25T08:50:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606207 s, 173 MB/s 2024-04-25T08:50:14.160 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.160 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.160 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702386 s, 149 MB/s 2024-04-25T08:50:14.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.168 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739126 s, 142 MB/s 2024-04-25T08:50:14.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.175 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620375 s, 169 MB/s 2024-04-25T08:50:14.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.183 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711311 s, 147 MB/s 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579728 s, 181 MB/s 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723854 s, 145 MB/s 2024-04-25T08:50:14.205 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.205 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.205 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627286 s, 167 MB/s 2024-04-25T08:50:14.212 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.212 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.212 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639291 s, 164 MB/s 2024-04-25T08:50:14.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.220 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.220 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630705 s, 166 MB/s 2024-04-25T08:50:14.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.226 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572671 s, 183 MB/s 2024-04-25T08:50:14.234 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.235 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707996 s, 148 MB/s 2024-04-25T08:50:14.241 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.241 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.241 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586085 s, 179 MB/s 2024-04-25T08:50:14.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.248 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623116 s, 168 MB/s 2024-04-25T08:50:14.256 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.256 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.256 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663109 s, 158 MB/s 2024-04-25T08:50:14.264 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.264 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.264 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741349 s, 141 MB/s 2024-04-25T08:50:14.271 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.272 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640354 s, 164 MB/s 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578101 s, 181 MB/s 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693736 s, 151 MB/s 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654529 s, 160 MB/s 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:14.296 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:14.296 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:14.296 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T08:50:14.296 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:14.296 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:14.296 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:14.296 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:14.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.360 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658383 s, 159 MB/s 2024-04-25T08:50:14.367 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.367 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.367 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590404 s, 178 MB/s 2024-04-25T08:50:14.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.373 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564413 s, 186 MB/s 2024-04-25T08:50:14.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.381 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652081 s, 161 MB/s 2024-04-25T08:50:14.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.388 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621796 s, 169 MB/s 2024-04-25T08:50:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556897 s, 188 MB/s 2024-04-25T08:50:14.401 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.401 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.401 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574013 s, 183 MB/s 2024-04-25T08:50:14.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.409 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752543 s, 139 MB/s 2024-04-25T08:50:14.416 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.416 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.416 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621415 s, 169 MB/s 2024-04-25T08:50:14.424 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.424 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.424 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647479 s, 162 MB/s 2024-04-25T08:50:14.431 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.431 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.431 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638647 s, 164 MB/s 2024-04-25T08:50:14.438 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.438 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.438 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620808 s, 169 MB/s 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745301 s, 141 MB/s 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065355 s, 160 MB/s 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633117 s, 166 MB/s 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561137 s, 187 MB/s 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580501 s, 181 MB/s 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067867 s, 155 MB/s 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569998 s, 184 MB/s 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636914 s, 165 MB/s 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720573 s, 146 MB/s 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692178 s, 151 MB/s 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707863 s, 148 MB/s 2024-04-25T08:50:14.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.527 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626485 s, 167 MB/s 2024-04-25T08:50:14.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.534 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675395 s, 155 MB/s 2024-04-25T08:50:14.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.543 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727497 s, 144 MB/s 2024-04-25T08:50:14.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.550 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062823 s, 167 MB/s 2024-04-25T08:50:14.557 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.557 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.557 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622972 s, 168 MB/s 2024-04-25T08:50:14.564 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.564 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.564 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061611 s, 170 MB/s 2024-04-25T08:50:14.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.572 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724496 s, 145 MB/s 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569021 s, 184 MB/s 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557169 s, 188 MB/s 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:14.587 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:14.587 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:14.587 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T08:50:14.587 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:14.587 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:14.587 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:14.587 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:14.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.651 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.651 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647869 s, 162 MB/s 2024-04-25T08:50:14.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.657 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623476 s, 168 MB/s 2024-04-25T08:50:14.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.665 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.665 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640887 s, 164 MB/s 2024-04-25T08:50:14.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.673 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717951 s, 146 MB/s 2024-04-25T08:50:14.679 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.680 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.680 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601004 s, 174 MB/s 2024-04-25T08:50:14.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.688 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742996 s, 141 MB/s 2024-04-25T08:50:14.695 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.754 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620503 s, 169 MB/s 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705296 s, 149 MB/s 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577896 s, 181 MB/s 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652801 s, 161 MB/s 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.755 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648017 s, 162 MB/s 2024-04-25T08:50:14.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927315 s, 113 MB/s 2024-04-25T08:50:14.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639119 s, 164 MB/s 2024-04-25T08:50:14.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689682 s, 152 MB/s 2024-04-25T08:50:14.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.757 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.757 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636279 s, 165 MB/s 2024-04-25T08:50:14.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.763 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569049 s, 184 MB/s 2024-04-25T08:50:14.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.771 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654084 s, 160 MB/s 2024-04-25T08:50:14.778 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.779 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.779 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714552 s, 147 MB/s 2024-04-25T08:50:14.786 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.786 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.786 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625283 s, 168 MB/s 2024-04-25T08:50:14.793 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.793 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.794 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683418 s, 153 MB/s 2024-04-25T08:50:14.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.801 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639446 s, 164 MB/s 2024-04-25T08:50:14.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.808 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655895 s, 160 MB/s 2024-04-25T08:50:14.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.817 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613948 s, 171 MB/s 2024-04-25T08:50:14.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.823 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717117 s, 146 MB/s 2024-04-25T08:50:14.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.832 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732008 s, 143 MB/s 2024-04-25T08:50:14.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.840 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717575 s, 146 MB/s 2024-04-25T08:50:14.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.847 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696331 s, 151 MB/s 2024-04-25T08:50:14.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.854 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060709 s, 173 MB/s 2024-04-25T08:50:14.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.863 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.863 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072364 s, 145 MB/s 2024-04-25T08:50:14.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.870 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666402 s, 157 MB/s 2024-04-25T08:50:14.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.877 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059771 s, 175 MB/s 2024-04-25T08:50:14.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.884 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580801 s, 181 MB/s 2024-04-25T08:50:14.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:14.885 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:14.885 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:14.885 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T08:50:14.885 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:14.885 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:14.885 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:14.885 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:14.950 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.950 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.950 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659412 s, 159 MB/s 2024-04-25T08:50:14.958 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.958 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.958 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728097 s, 144 MB/s 2024-04-25T08:50:14.965 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.965 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.965 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676603 s, 155 MB/s 2024-04-25T08:50:14.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.973 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645217 s, 163 MB/s 2024-04-25T08:50:14.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.981 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712145 s, 147 MB/s 2024-04-25T08:50:14.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.988 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064973 s, 161 MB/s 2024-04-25T08:50:14.994 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:14.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:14.995 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056461 s, 186 MB/s 2024-04-25T08:50:15.002 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.003 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707142 s, 148 MB/s 2024-04-25T08:50:15.009 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.009 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.009 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585113 s, 179 MB/s 2024-04-25T08:50:15.017 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.017 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.017 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669679 s, 157 MB/s 2024-04-25T08:50:15.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.025 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071416 s, 147 MB/s 2024-04-25T08:50:15.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.032 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560484 s, 187 MB/s 2024-04-25T08:50:15.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.039 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693458 s, 151 MB/s 2024-04-25T08:50:15.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.047 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635609 s, 165 MB/s 2024-04-25T08:50:15.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.055 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.055 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716265 s, 146 MB/s 2024-04-25T08:50:15.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.061 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592298 s, 177 MB/s 2024-04-25T08:50:15.069 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.069 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.069 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620066 s, 169 MB/s 2024-04-25T08:50:15.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.076 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649323 s, 161 MB/s 2024-04-25T08:50:15.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.083 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626526 s, 167 MB/s 2024-04-25T08:50:15.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.091 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686079 s, 153 MB/s 2024-04-25T08:50:15.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.098 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572741 s, 183 MB/s 2024-04-25T08:50:15.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.105 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642024 s, 163 MB/s 2024-04-25T08:50:15.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.112 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642106 s, 163 MB/s 2024-04-25T08:50:15.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.120 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730229 s, 144 MB/s 2024-04-25T08:50:15.128 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.128 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.128 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069032 s, 152 MB/s 2024-04-25T08:50:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.137 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766126 s, 137 MB/s 2024-04-25T08:50:15.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591633 s, 177 MB/s 2024-04-25T08:50:15.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.151 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650958 s, 161 MB/s 2024-04-25T08:50:15.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.159 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713993 s, 147 MB/s 2024-04-25T08:50:15.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.167 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755272 s, 139 MB/s 2024-04-25T08:50:15.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.175 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694742 s, 151 MB/s 2024-04-25T08:50:15.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.184 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728863 s, 144 MB/s 2024-04-25T08:50:15.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:15.185 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:15.185 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:15.185 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T08:50:15.185 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:15.185 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:15.185 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:15.185 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:15.249 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.249 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.249 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627381 s, 167 MB/s 2024-04-25T08:50:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.257 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696114 s, 151 MB/s 2024-04-25T08:50:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.263 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056995 s, 184 MB/s 2024-04-25T08:50:15.271 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.271 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.271 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672856 s, 156 MB/s 2024-04-25T08:50:15.278 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.278 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.278 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654384 s, 160 MB/s 2024-04-25T08:50:15.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.286 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630888 s, 166 MB/s 2024-04-25T08:50:15.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.294 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712737 s, 147 MB/s 2024-04-25T08:50:15.301 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.301 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.301 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637728 s, 164 MB/s 2024-04-25T08:50:15.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.309 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729851 s, 144 MB/s 2024-04-25T08:50:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669374 s, 157 MB/s 2024-04-25T08:50:15.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.324 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604628 s, 173 MB/s 2024-04-25T08:50:15.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.331 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672284 s, 156 MB/s 2024-04-25T08:50:15.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610557 s, 172 MB/s 2024-04-25T08:50:15.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.345 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057672 s, 182 MB/s 2024-04-25T08:50:15.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.352 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578001 s, 181 MB/s 2024-04-25T08:50:15.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.360 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730883 s, 143 MB/s 2024-04-25T08:50:15.367 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.367 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.367 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063236 s, 166 MB/s 2024-04-25T08:50:15.374 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.374 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.374 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589981 s, 178 MB/s 2024-04-25T08:50:15.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.381 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596767 s, 176 MB/s 2024-04-25T08:50:15.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.388 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568353 s, 184 MB/s 2024-04-25T08:50:15.396 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.396 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.396 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709376 s, 148 MB/s 2024-04-25T08:50:15.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.404 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711931 s, 147 MB/s 2024-04-25T08:50:15.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.412 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747986 s, 140 MB/s 2024-04-25T08:50:15.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.419 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641993 s, 163 MB/s 2024-04-25T08:50:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.428 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773448 s, 136 MB/s 2024-04-25T08:50:15.436 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.436 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.436 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691732 s, 152 MB/s 2024-04-25T08:50:15.443 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.444 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.444 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686697 s, 153 MB/s 2024-04-25T08:50:15.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.451 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700799 s, 150 MB/s 2024-04-25T08:50:15.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.459 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.459 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645749 s, 162 MB/s 2024-04-25T08:50:15.466 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.466 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.467 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704635 s, 149 MB/s 2024-04-25T08:50:15.474 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.474 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.474 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666082 s, 157 MB/s 2024-04-25T08:50:15.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.483 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675034 s, 155 MB/s 2024-04-25T08:50:15.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:15.484 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:15.484 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:15.484 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T08:50:15.484 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:15.484 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:15.484 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:15.484 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:15.547 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.548 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.548 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636277 s, 165 MB/s 2024-04-25T08:50:15.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.555 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.555 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633257 s, 166 MB/s 2024-04-25T08:50:15.561 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.562 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.562 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593288 s, 177 MB/s 2024-04-25T08:50:15.569 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.569 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.569 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628096 s, 167 MB/s 2024-04-25T08:50:15.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.576 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634192 s, 165 MB/s 2024-04-25T08:50:15.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.584 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730741 s, 143 MB/s 2024-04-25T08:50:15.591 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.591 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.591 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626359 s, 167 MB/s 2024-04-25T08:50:15.598 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649876 s, 161 MB/s 2024-04-25T08:50:15.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.607 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699566 s, 150 MB/s 2024-04-25T08:50:15.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.615 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721384 s, 145 MB/s 2024-04-25T08:50:15.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.621 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580885 s, 181 MB/s 2024-04-25T08:50:15.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.630 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732271 s, 143 MB/s 2024-04-25T08:50:15.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.637 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658135 s, 159 MB/s 2024-04-25T08:50:15.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.645 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709272 s, 148 MB/s 2024-04-25T08:50:15.651 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.651 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.651 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555324 s, 189 MB/s 2024-04-25T08:50:15.659 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.660 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.660 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712177 s, 147 MB/s 2024-04-25T08:50:15.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.667 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.667 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626705 s, 167 MB/s 2024-04-25T08:50:15.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.675 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729941 s, 144 MB/s 2024-04-25T08:50:15.683 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.683 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.683 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713204 s, 147 MB/s 2024-04-25T08:50:15.689 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.690 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570695 s, 184 MB/s 2024-04-25T08:50:15.697 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.698 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.698 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720204 s, 146 MB/s 2024-04-25T08:50:15.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.704 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576265 s, 182 MB/s 2024-04-25T08:50:15.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.711 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056828 s, 185 MB/s 2024-04-25T08:50:15.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.718 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626299 s, 167 MB/s 2024-04-25T08:50:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613174 s, 171 MB/s 2024-04-25T08:50:15.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.733 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070705 s, 148 MB/s 2024-04-25T08:50:15.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.740 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616077 s, 170 MB/s 2024-04-25T08:50:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713573 s, 147 MB/s 2024-04-25T08:50:15.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698192 s, 150 MB/s 2024-04-25T08:50:15.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.763 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575033 s, 182 MB/s 2024-04-25T08:50:15.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.770 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671231 s, 156 MB/s 2024-04-25T08:50:15.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.777 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628411 s, 167 MB/s 2024-04-25T08:50:15.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:15.779 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:15.779 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:15.779 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T08:50:15.779 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:15.779 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:15.779 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:15.779 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:15.842 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.843 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.843 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605566 s, 173 MB/s 2024-04-25T08:50:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.850 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071403 s, 147 MB/s 2024-04-25T08:50:15.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.857 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638031 s, 164 MB/s 2024-04-25T08:50:15.865 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.865 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.865 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730402 s, 144 MB/s 2024-04-25T08:50:15.872 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.872 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.872 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610412 s, 172 MB/s 2024-04-25T08:50:15.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.881 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771597 s, 136 MB/s 2024-04-25T08:50:15.889 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.889 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.889 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724257 s, 145 MB/s 2024-04-25T08:50:15.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.898 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.898 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764525 s, 137 MB/s 2024-04-25T08:50:15.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.905 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634802 s, 165 MB/s 2024-04-25T08:50:15.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.913 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711223 s, 147 MB/s 2024-04-25T08:50:15.919 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.919 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.920 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589402 s, 178 MB/s 2024-04-25T08:50:15.927 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.927 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.927 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659355 s, 159 MB/s 2024-04-25T08:50:15.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.935 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065232 s, 161 MB/s 2024-04-25T08:50:15.941 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.941 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.942 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622236 s, 169 MB/s 2024-04-25T08:50:15.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.949 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061823 s, 170 MB/s 2024-04-25T08:50:15.957 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.957 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.957 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727796 s, 144 MB/s 2024-04-25T08:50:15.964 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.964 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.964 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668146 s, 157 MB/s 2024-04-25T08:50:15.972 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.972 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.972 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650135 s, 161 MB/s 2024-04-25T08:50:15.979 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.979 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.979 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676685 s, 155 MB/s 2024-04-25T08:50:15.987 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.987 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.987 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660839 s, 159 MB/s 2024-04-25T08:50:15.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:15.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:15.995 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722432 s, 145 MB/s 2024-04-25T08:50:16.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.003 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712147 s, 147 MB/s 2024-04-25T08:50:16.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.010 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588861 s, 178 MB/s 2024-04-25T08:50:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.019 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867311 s, 121 MB/s 2024-04-25T08:50:16.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.027 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.027 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649231 s, 162 MB/s 2024-04-25T08:50:16.034 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.034 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.034 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629603 s, 167 MB/s 2024-04-25T08:50:16.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.042 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.042 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638425 s, 164 MB/s 2024-04-25T08:50:16.050 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.050 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.050 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757878 s, 138 MB/s 2024-04-25T08:50:16.058 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.058 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.058 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075047 s, 140 MB/s 2024-04-25T08:50:16.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.065 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629265 s, 167 MB/s 2024-04-25T08:50:16.073 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.073 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.073 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723223 s, 145 MB/s 2024-04-25T08:50:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637323 s, 165 MB/s 2024-04-25T08:50:16.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:16.082 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:16.082 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:16.082 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T08:50:16.083 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:16.083 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:16.083 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:16.083 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:16.147 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.147 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.147 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658002 s, 159 MB/s 2024-04-25T08:50:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640026 s, 164 MB/s 2024-04-25T08:50:16.160 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.160 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.160 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580904 s, 181 MB/s 2024-04-25T08:50:16.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.167 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574744 s, 182 MB/s 2024-04-25T08:50:16.174 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.174 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.174 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568499 s, 184 MB/s 2024-04-25T08:50:16.184 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.184 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.184 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905174 s, 116 MB/s 2024-04-25T08:50:16.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.194 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904111 s, 116 MB/s 2024-04-25T08:50:16.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.202 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714358 s, 147 MB/s 2024-04-25T08:50:16.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.209 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664949 s, 158 MB/s 2024-04-25T08:50:16.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.217 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716148 s, 146 MB/s 2024-04-25T08:50:16.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.224 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574003 s, 183 MB/s 2024-04-25T08:50:16.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.231 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649971 s, 161 MB/s 2024-04-25T08:50:16.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.238 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614701 s, 171 MB/s 2024-04-25T08:50:16.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.245 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593402 s, 177 MB/s 2024-04-25T08:50:16.253 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.253 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.253 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699722 s, 150 MB/s 2024-04-25T08:50:16.260 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.260 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.260 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595995 s, 176 MB/s 2024-04-25T08:50:16.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661829 s, 158 MB/s 2024-04-25T08:50:16.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.275 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.275 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065201 s, 161 MB/s 2024-04-25T08:50:16.282 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.283 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720676 s, 145 MB/s 2024-04-25T08:50:16.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.291 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754249 s, 139 MB/s 2024-04-25T08:50:16.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.299 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752382 s, 139 MB/s 2024-04-25T08:50:16.307 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.308 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.308 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718687 s, 146 MB/s 2024-04-25T08:50:16.315 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.316 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.316 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705098 s, 149 MB/s 2024-04-25T08:50:16.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.324 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732449 s, 143 MB/s 2024-04-25T08:50:16.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.331 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643276 s, 163 MB/s 2024-04-25T08:50:16.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654564 s, 160 MB/s 2024-04-25T08:50:16.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.347 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727587 s, 144 MB/s 2024-04-25T08:50:16.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.354 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656361 s, 160 MB/s 2024-04-25T08:50:16.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.362 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066467 s, 158 MB/s 2024-04-25T08:50:16.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.369 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640931 s, 164 MB/s 2024-04-25T08:50:16.377 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.377 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.377 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730996 s, 143 MB/s 2024-04-25T08:50:16.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.385 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006368 s, 165 MB/s 2024-04-25T08:50:16.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:16.386 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:16.386 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:16.386 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T08:50:16.387 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:16.387 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:16.387 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:16.387 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:16.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.450 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581934 s, 180 MB/s 2024-04-25T08:50:16.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.457 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626332 s, 167 MB/s 2024-04-25T08:50:16.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.464 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659554 s, 159 MB/s 2024-04-25T08:50:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.471 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575956 s, 182 MB/s 2024-04-25T08:50:16.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.479 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707609 s, 148 MB/s 2024-04-25T08:50:16.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.486 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649504 s, 161 MB/s 2024-04-25T08:50:16.494 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.494 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.494 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730625 s, 144 MB/s 2024-04-25T08:50:16.501 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.501 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.501 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631763 s, 166 MB/s 2024-04-25T08:50:16.508 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.509 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.509 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636658 s, 165 MB/s 2024-04-25T08:50:16.516 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.516 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.516 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639731 s, 164 MB/s 2024-04-25T08:50:16.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.523 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635703 s, 165 MB/s 2024-04-25T08:50:16.530 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.530 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.530 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582284 s, 180 MB/s 2024-04-25T08:50:16.537 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.537 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.537 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063788 s, 164 MB/s 2024-04-25T08:50:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.544 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570426 s, 184 MB/s 2024-04-25T08:50:16.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645594 s, 162 MB/s 2024-04-25T08:50:16.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.559 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646812 s, 162 MB/s 2024-04-25T08:50:16.566 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.566 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.567 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708341 s, 148 MB/s 2024-04-25T08:50:16.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.574 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064859 s, 162 MB/s 2024-04-25T08:50:16.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.581 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630175 s, 166 MB/s 2024-04-25T08:50:16.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.589 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688522 s, 152 MB/s 2024-04-25T08:50:16.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.596 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654448 s, 160 MB/s 2024-04-25T08:50:16.604 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.604 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.604 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728126 s, 144 MB/s 2024-04-25T08:50:16.611 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.611 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.611 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586077 s, 179 MB/s 2024-04-25T08:50:16.619 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.619 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.619 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748292 s, 140 MB/s 2024-04-25T08:50:16.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.628 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756294 s, 139 MB/s 2024-04-25T08:50:16.636 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.636 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.636 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070589 s, 149 MB/s 2024-04-25T08:50:16.642 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.642 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.642 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567955 s, 185 MB/s 2024-04-25T08:50:16.649 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.649 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.649 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573707 s, 183 MB/s 2024-04-25T08:50:16.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.657 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635724 s, 165 MB/s 2024-04-25T08:50:16.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.665 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.665 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726175 s, 144 MB/s 2024-04-25T08:50:16.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.671 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603308 s, 174 MB/s 2024-04-25T08:50:16.679 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.679 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.680 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708362 s, 148 MB/s 2024-04-25T08:50:16.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:16.681 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:16.681 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:16.681 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T08:50:16.681 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:16.681 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:16.681 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:16.681 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:16.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.747 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871769 s, 120 MB/s 2024-04-25T08:50:16.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.755 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722687 s, 145 MB/s 2024-04-25T08:50:16.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.762 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633679 s, 165 MB/s 2024-04-25T08:50:16.768 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579854 s, 181 MB/s 2024-04-25T08:50:16.775 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.776 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604612 s, 173 MB/s 2024-04-25T08:50:16.786 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.786 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.786 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990141 s, 106 MB/s 2024-04-25T08:50:16.794 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.794 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.794 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671423 s, 156 MB/s 2024-04-25T08:50:16.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.802 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634774 s, 165 MB/s 2024-04-25T08:50:16.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.810 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714178 s, 147 MB/s 2024-04-25T08:50:16.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.817 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066061 s, 159 MB/s 2024-04-25T08:50:16.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.825 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685106 s, 153 MB/s 2024-04-25T08:50:16.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.833 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657676 s, 159 MB/s 2024-04-25T08:50:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.840 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657432 s, 159 MB/s 2024-04-25T08:50:16.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.847 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622249 s, 169 MB/s 2024-04-25T08:50:16.855 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.855 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.855 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750505 s, 140 MB/s 2024-04-25T08:50:16.863 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.863 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.863 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718666 s, 146 MB/s 2024-04-25T08:50:16.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.871 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632826 s, 166 MB/s 2024-04-25T08:50:16.878 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.878 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.878 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630398 s, 166 MB/s 2024-04-25T08:50:16.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.884 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553386 s, 189 MB/s 2024-04-25T08:50:16.892 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.892 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.892 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665117 s, 158 MB/s 2024-04-25T08:50:16.899 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.900 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676695 s, 155 MB/s 2024-04-25T08:50:16.907 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.907 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.907 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641013 s, 164 MB/s 2024-04-25T08:50:16.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.914 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662571 s, 158 MB/s 2024-04-25T08:50:16.922 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.922 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.922 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669433 s, 157 MB/s 2024-04-25T08:50:16.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.930 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702079 s, 149 MB/s 2024-04-25T08:50:16.937 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.938 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705657 s, 149 MB/s 2024-04-25T08:50:16.945 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.945 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.945 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643386 s, 163 MB/s 2024-04-25T08:50:16.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.952 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637314 s, 165 MB/s 2024-04-25T08:50:16.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.960 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.960 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640873 s, 164 MB/s 2024-04-25T08:50:16.966 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.966 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.966 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589234 s, 178 MB/s 2024-04-25T08:50:16.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.973 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005942 s, 176 MB/s 2024-04-25T08:50:16.980 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:16.980 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:16.980 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584285 s, 179 MB/s 2024-04-25T08:50:16.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:16.981 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:16.981 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:16.981 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T08:50:16.981 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:16.981 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:16.981 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:16.981 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:17.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.046 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704929 s, 149 MB/s 2024-04-25T08:50:17.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.054 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751446 s, 140 MB/s 2024-04-25T08:50:17.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.062 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658246 s, 159 MB/s 2024-04-25T08:50:17.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.068 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00552061 s, 190 MB/s 2024-04-25T08:50:17.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.077 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673791 s, 156 MB/s 2024-04-25T08:50:17.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.084 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665686 s, 158 MB/s 2024-04-25T08:50:17.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.092 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.092 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748239 s, 140 MB/s 2024-04-25T08:50:17.099 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.099 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.099 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638198 s, 164 MB/s 2024-04-25T08:50:17.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.106 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578467 s, 181 MB/s 2024-04-25T08:50:17.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.113 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657215 s, 160 MB/s 2024-04-25T08:50:17.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.120 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628506 s, 167 MB/s 2024-04-25T08:50:17.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.128 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652863 s, 161 MB/s 2024-04-25T08:50:17.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.134 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059015 s, 178 MB/s 2024-04-25T08:50:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.143 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703345 s, 149 MB/s 2024-04-25T08:50:17.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.150 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007019 s, 149 MB/s 2024-04-25T08:50:17.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.158 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726712 s, 144 MB/s 2024-04-25T08:50:17.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.166 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068745 s, 153 MB/s 2024-04-25T08:50:17.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.173 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628358 s, 167 MB/s 2024-04-25T08:50:17.181 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.181 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.181 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072787 s, 144 MB/s 2024-04-25T08:50:17.189 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.190 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.190 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723489 s, 145 MB/s 2024-04-25T08:50:17.196 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.196 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.196 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584279 s, 179 MB/s 2024-04-25T08:50:17.204 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.204 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.205 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007211 s, 145 MB/s 2024-04-25T08:50:17.211 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.211 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.212 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619222 s, 169 MB/s 2024-04-25T08:50:17.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.219 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666805 s, 157 MB/s 2024-04-25T08:50:17.227 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.227 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.227 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739238 s, 142 MB/s 2024-04-25T08:50:17.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.235 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659895 s, 159 MB/s 2024-04-25T08:50:17.243 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.243 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.243 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735834 s, 143 MB/s 2024-04-25T08:50:17.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.250 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654299 s, 160 MB/s 2024-04-25T08:50:17.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.257 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589335 s, 178 MB/s 2024-04-25T08:50:17.264 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.264 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.264 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615543 s, 170 MB/s 2024-04-25T08:50:17.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.272 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717214 s, 146 MB/s 2024-04-25T08:50:17.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.281 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681375 s, 154 MB/s 2024-04-25T08:50:17.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:17.281 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:17.282 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:17.282 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T08:50:17.282 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:17.282 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:17.282 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:17.282 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:17.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.346 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639184 s, 164 MB/s 2024-04-25T08:50:17.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.353 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006642 s, 158 MB/s 2024-04-25T08:50:17.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.361 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643024 s, 163 MB/s 2024-04-25T08:50:17.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.368 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623454 s, 168 MB/s 2024-04-25T08:50:17.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.376 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738695 s, 142 MB/s 2024-04-25T08:50:17.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.384 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671488 s, 156 MB/s 2024-04-25T08:50:17.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.391 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574781 s, 182 MB/s 2024-04-25T08:50:17.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.397 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553177 s, 190 MB/s 2024-04-25T08:50:17.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.404 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661783 s, 158 MB/s 2024-04-25T08:50:17.411 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.411 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.411 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622309 s, 168 MB/s 2024-04-25T08:50:17.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.419 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065474 s, 160 MB/s 2024-04-25T08:50:17.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674198 s, 156 MB/s 2024-04-25T08:50:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.433 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618688 s, 169 MB/s 2024-04-25T08:50:17.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.441 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065827 s, 159 MB/s 2024-04-25T08:50:17.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.448 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633241 s, 166 MB/s 2024-04-25T08:50:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710741 s, 148 MB/s 2024-04-25T08:50:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063086 s, 166 MB/s 2024-04-25T08:50:17.470 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.470 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.470 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632394 s, 166 MB/s 2024-04-25T08:50:17.478 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.478 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.478 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691665 s, 152 MB/s 2024-04-25T08:50:17.485 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.485 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.485 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635974 s, 165 MB/s 2024-04-25T08:50:17.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.493 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059364 s, 177 MB/s 2024-04-25T08:50:17.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.500 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668571 s, 157 MB/s 2024-04-25T08:50:17.507 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.507 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.507 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613948 s, 171 MB/s 2024-04-25T08:50:17.514 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.514 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.514 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617967 s, 170 MB/s 2024-04-25T08:50:17.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.520 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569892 s, 184 MB/s 2024-04-25T08:50:17.528 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.529 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715006 s, 147 MB/s 2024-04-25T08:50:17.536 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.536 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.536 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652691 s, 161 MB/s 2024-04-25T08:50:17.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.543 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642737 s, 163 MB/s 2024-04-25T08:50:17.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660935 s, 159 MB/s 2024-04-25T08:50:17.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645946 s, 162 MB/s 2024-04-25T08:50:17.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.565 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636994 s, 165 MB/s 2024-04-25T08:50:17.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.573 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609223 s, 172 MB/s 2024-04-25T08:50:17.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:17.574 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:17.574 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:17.574 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T08:50:17.574 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:17.574 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:17.574 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:17.574 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:17.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.639 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007305 s, 144 MB/s 2024-04-25T08:50:17.646 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.646 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.646 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625286 s, 168 MB/s 2024-04-25T08:50:17.653 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.653 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.653 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666703 s, 157 MB/s 2024-04-25T08:50:17.661 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.661 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.661 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648514 s, 162 MB/s 2024-04-25T08:50:17.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.668 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581325 s, 180 MB/s 2024-04-25T08:50:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607303 s, 173 MB/s 2024-04-25T08:50:17.682 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.682 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.682 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640022 s, 164 MB/s 2024-04-25T08:50:17.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.690 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712307 s, 147 MB/s 2024-04-25T08:50:17.698 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.698 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.698 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726921 s, 144 MB/s 2024-04-25T08:50:17.705 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.705 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.705 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618167 s, 170 MB/s 2024-04-25T08:50:17.713 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.713 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.713 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675525 s, 155 MB/s 2024-04-25T08:50:17.720 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.720 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.720 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644489 s, 163 MB/s 2024-04-25T08:50:17.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.728 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.728 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661629 s, 158 MB/s 2024-04-25T08:50:17.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.735 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684207 s, 153 MB/s 2024-04-25T08:50:17.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.742 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581553 s, 180 MB/s 2024-04-25T08:50:17.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.749 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627704 s, 167 MB/s 2024-04-25T08:50:17.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569114 s, 184 MB/s 2024-04-25T08:50:17.764 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.764 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.764 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731599 s, 143 MB/s 2024-04-25T08:50:17.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.771 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583494 s, 180 MB/s 2024-04-25T08:50:17.778 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.778 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.778 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616417 s, 170 MB/s 2024-04-25T08:50:17.785 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.785 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.785 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655502 s, 160 MB/s 2024-04-25T08:50:17.792 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.792 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.792 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578078 s, 181 MB/s 2024-04-25T08:50:17.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.799 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057288 s, 183 MB/s 2024-04-25T08:50:17.805 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.805 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.806 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581675 s, 180 MB/s 2024-04-25T08:50:17.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.816 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915682 s, 115 MB/s 2024-04-25T08:50:17.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.823 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622546 s, 168 MB/s 2024-04-25T08:50:17.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.830 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653598 s, 160 MB/s 2024-04-25T08:50:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.837 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591314 s, 177 MB/s 2024-04-25T08:50:17.844 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.844 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.844 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615158 s, 170 MB/s 2024-04-25T08:50:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.852 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721253 s, 145 MB/s 2024-04-25T08:50:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091175 s, 115 MB/s 2024-04-25T08:50:17.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.870 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709302 s, 148 MB/s 2024-04-25T08:50:17.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:17.871 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:17.871 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:17.871 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T08:50:17.872 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:17.872 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:17.872 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:17.872 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:17.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.936 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702939 s, 149 MB/s 2024-04-25T08:50:17.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.943 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612535 s, 171 MB/s 2024-04-25T08:50:17.950 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.951 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.951 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659281 s, 159 MB/s 2024-04-25T08:50:17.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.959 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724679 s, 145 MB/s 2024-04-25T08:50:17.966 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.967 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711481 s, 147 MB/s 2024-04-25T08:50:17.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.974 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067175 s, 156 MB/s 2024-04-25T08:50:17.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.981 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638555 s, 164 MB/s 2024-04-25T08:50:17.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608172 s, 172 MB/s 2024-04-25T08:50:17.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:17.997 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:17.997 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730895 s, 143 MB/s 2024-04-25T08:50:18.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.005 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.005 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691357 s, 152 MB/s 2024-04-25T08:50:18.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.013 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782105 s, 134 MB/s 2024-04-25T08:50:18.022 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.022 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.022 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757081 s, 139 MB/s 2024-04-25T08:50:18.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.029 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652411 s, 161 MB/s 2024-04-25T08:50:18.037 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.037 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.038 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740195 s, 142 MB/s 2024-04-25T08:50:18.045 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.045 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.045 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707336 s, 148 MB/s 2024-04-25T08:50:18.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.053 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652853 s, 161 MB/s 2024-04-25T08:50:18.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.061 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732051 s, 143 MB/s 2024-04-25T08:50:18.070 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.070 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.070 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00791264 s, 133 MB/s 2024-04-25T08:50:18.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.079 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837541 s, 125 MB/s 2024-04-25T08:50:18.088 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.088 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.088 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781357 s, 134 MB/s 2024-04-25T08:50:18.095 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.095 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.096 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666727 s, 157 MB/s 2024-04-25T08:50:18.103 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.103 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.104 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713607 s, 147 MB/s 2024-04-25T08:50:18.111 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.111 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.111 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666508 s, 157 MB/s 2024-04-25T08:50:18.118 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.118 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.118 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650752 s, 161 MB/s 2024-04-25T08:50:18.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.126 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650957 s, 161 MB/s 2024-04-25T08:50:18.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.134 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699219 s, 150 MB/s 2024-04-25T08:50:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.141 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644365 s, 163 MB/s 2024-04-25T08:50:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.148 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595202 s, 176 MB/s 2024-04-25T08:50:18.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.155 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618439 s, 170 MB/s 2024-04-25T08:50:18.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.162 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641091 s, 164 MB/s 2024-04-25T08:50:18.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.169 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591676 s, 177 MB/s 2024-04-25T08:50:18.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.179 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064696 s, 162 MB/s 2024-04-25T08:50:18.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:18.179 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:18.179 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:18.180 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T08:50:18.180 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:18.180 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:18.180 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:18.180 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:18.243 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.243 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.243 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648874 s, 162 MB/s 2024-04-25T08:50:18.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.250 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655399 s, 160 MB/s 2024-04-25T08:50:18.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.258 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584726 s, 179 MB/s 2024-04-25T08:50:18.264 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.264 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.264 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661653 s, 158 MB/s 2024-04-25T08:50:18.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.273 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.273 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744149 s, 141 MB/s 2024-04-25T08:50:18.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.279 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584973 s, 179 MB/s 2024-04-25T08:50:18.285 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.286 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553046 s, 190 MB/s 2024-04-25T08:50:18.293 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.293 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.293 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614538 s, 171 MB/s 2024-04-25T08:50:18.300 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.300 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.301 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674467 s, 155 MB/s 2024-04-25T08:50:18.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.309 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773097 s, 136 MB/s 2024-04-25T08:50:18.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706654 s, 148 MB/s 2024-04-25T08:50:18.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.324 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607695 s, 173 MB/s 2024-04-25T08:50:18.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.332 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736822 s, 142 MB/s 2024-04-25T08:50:18.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626608 s, 167 MB/s 2024-04-25T08:50:18.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.347 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653852 s, 160 MB/s 2024-04-25T08:50:18.358 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.358 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.358 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01012 s, 104 MB/s 2024-04-25T08:50:18.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.365 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621882 s, 169 MB/s 2024-04-25T08:50:18.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.373 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767797 s, 137 MB/s 2024-04-25T08:50:18.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.381 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661097 s, 159 MB/s 2024-04-25T08:50:18.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.388 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063202 s, 166 MB/s 2024-04-25T08:50:18.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.395 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621629 s, 169 MB/s 2024-04-25T08:50:18.403 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.403 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.403 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645661 s, 162 MB/s 2024-04-25T08:50:18.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.410 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625208 s, 168 MB/s 2024-04-25T08:50:18.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.418 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715002 s, 147 MB/s 2024-04-25T08:50:18.425 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713822 s, 147 MB/s 2024-04-25T08:50:18.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.433 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604032 s, 174 MB/s 2024-04-25T08:50:18.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.440 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623491 s, 168 MB/s 2024-04-25T08:50:18.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.448 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703822 s, 149 MB/s 2024-04-25T08:50:18.455 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.455 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.455 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635084 s, 165 MB/s 2024-04-25T08:50:18.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.464 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759325 s, 138 MB/s 2024-04-25T08:50:18.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.471 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622261 s, 169 MB/s 2024-04-25T08:50:18.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.477 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592593 s, 177 MB/s 2024-04-25T08:50:18.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:18.479 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:18.479 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:18.479 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T08:50:18.479 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:18.479 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:18.479 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:18.479 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:18.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.543 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670998 s, 156 MB/s 2024-04-25T08:50:18.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731705 s, 143 MB/s 2024-04-25T08:50:18.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643513 s, 163 MB/s 2024-04-25T08:50:18.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.566 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625058 s, 168 MB/s 2024-04-25T08:50:18.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.572 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564013 s, 186 MB/s 2024-04-25T08:50:18.580 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.581 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752492 s, 139 MB/s 2024-04-25T08:50:18.587 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.587 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.587 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582493 s, 180 MB/s 2024-04-25T08:50:18.595 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.595 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.595 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713826 s, 147 MB/s 2024-04-25T08:50:18.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.603 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672186 s, 156 MB/s 2024-04-25T08:50:18.610 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.610 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.610 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063533 s, 165 MB/s 2024-04-25T08:50:18.618 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.618 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.618 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714024 s, 147 MB/s 2024-04-25T08:50:18.625 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.625 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.625 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637442 s, 164 MB/s 2024-04-25T08:50:18.632 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.633 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.633 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660225 s, 159 MB/s 2024-04-25T08:50:18.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.640 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063598 s, 165 MB/s 2024-04-25T08:50:18.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.648 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708463 s, 148 MB/s 2024-04-25T08:50:18.656 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.656 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.656 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696467 s, 151 MB/s 2024-04-25T08:50:18.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.662 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568694 s, 184 MB/s 2024-04-25T08:50:18.669 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.670 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063362 s, 165 MB/s 2024-04-25T08:50:18.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.677 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065125 s, 161 MB/s 2024-04-25T08:50:18.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.686 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765222 s, 137 MB/s 2024-04-25T08:50:18.693 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.693 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.693 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653636 s, 160 MB/s 2024-04-25T08:50:18.700 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.700 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.700 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572475 s, 183 MB/s 2024-04-25T08:50:18.708 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.708 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.708 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725334 s, 145 MB/s 2024-04-25T08:50:18.716 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.716 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.716 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718991 s, 146 MB/s 2024-04-25T08:50:18.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.723 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.723 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593683 s, 177 MB/s 2024-04-25T08:50:18.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.731 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716159 s, 146 MB/s 2024-04-25T08:50:18.739 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.739 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.739 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717969 s, 146 MB/s 2024-04-25T08:50:18.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.746 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633936 s, 165 MB/s 2024-04-25T08:50:18.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.753 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635494 s, 165 MB/s 2024-04-25T08:50:18.761 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.761 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.761 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664569 s, 158 MB/s 2024-04-25T08:50:18.767 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.767 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.768 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583359 s, 180 MB/s 2024-04-25T08:50:18.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.776 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704087 s, 149 MB/s 2024-04-25T08:50:18.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:18.777 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:18.777 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:18.777 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T08:50:18.777 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:18.777 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:18.777 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:18.777 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:18.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.841 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.841 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634379 s, 165 MB/s 2024-04-25T08:50:18.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.847 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608097 s, 172 MB/s 2024-04-25T08:50:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.855 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661292 s, 159 MB/s 2024-04-25T08:50:18.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.862 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649373 s, 161 MB/s 2024-04-25T08:50:18.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.870 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704778 s, 149 MB/s 2024-04-25T08:50:18.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.878 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630362 s, 166 MB/s 2024-04-25T08:50:18.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.884 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605084 s, 173 MB/s 2024-04-25T08:50:18.891 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.891 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.891 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606965 s, 173 MB/s 2024-04-25T08:50:18.899 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.899 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.899 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707378 s, 148 MB/s 2024-04-25T08:50:18.906 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.906 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.907 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631376 s, 166 MB/s 2024-04-25T08:50:18.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.914 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647369 s, 162 MB/s 2024-04-25T08:50:18.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.921 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640211 s, 164 MB/s 2024-04-25T08:50:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614677 s, 171 MB/s 2024-04-25T08:50:18.935 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.935 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.935 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613402 s, 171 MB/s 2024-04-25T08:50:18.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.944 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726113 s, 144 MB/s 2024-04-25T08:50:18.950 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.951 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.951 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616019 s, 170 MB/s 2024-04-25T08:50:18.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.959 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736805 s, 142 MB/s 2024-04-25T08:50:18.966 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.966 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.966 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585472 s, 179 MB/s 2024-04-25T08:50:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.973 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670098 s, 156 MB/s 2024-04-25T08:50:18.980 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.980 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.980 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575931 s, 182 MB/s 2024-04-25T08:50:18.987 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:18.987 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:18.987 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621027 s, 169 MB/s 2024-04-25T08:50:19.000 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.001 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.001 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125602 s, 83.5 MB/s 2024-04-25T08:50:19.007 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.007 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.007 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577549 s, 182 MB/s 2024-04-25T08:50:19.015 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.015 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.015 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685128 s, 153 MB/s 2024-04-25T08:50:19.022 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.022 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.022 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640293 s, 164 MB/s 2024-04-25T08:50:19.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.029 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621282 s, 169 MB/s 2024-04-25T08:50:19.037 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.037 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.037 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662823 s, 158 MB/s 2024-04-25T08:50:19.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.045 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664369 s, 158 MB/s 2024-04-25T08:50:19.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.052 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640335 s, 164 MB/s 2024-04-25T08:50:19.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.059 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655349 s, 160 MB/s 2024-04-25T08:50:19.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.068 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770297 s, 136 MB/s 2024-04-25T08:50:19.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.075 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678082 s, 155 MB/s 2024-04-25T08:50:19.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:19.077 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:19.077 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:19.077 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T08:50:19.077 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:19.077 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:19.077 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:19.077 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:19.140 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.140 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.140 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633322 s, 166 MB/s 2024-04-25T08:50:19.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.148 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662152 s, 158 MB/s 2024-04-25T08:50:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738629 s, 142 MB/s 2024-04-25T08:50:19.163 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.163 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.163 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649048 s, 162 MB/s 2024-04-25T08:50:19.171 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.171 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.171 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067203 s, 156 MB/s 2024-04-25T08:50:19.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.178 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639188 s, 164 MB/s 2024-04-25T08:50:19.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.185 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634014 s, 165 MB/s 2024-04-25T08:50:19.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.192 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564088 s, 186 MB/s 2024-04-25T08:50:19.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.199 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602791 s, 174 MB/s 2024-04-25T08:50:19.206 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.207 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705774 s, 149 MB/s 2024-04-25T08:50:19.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.214 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642355 s, 163 MB/s 2024-04-25T08:50:19.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.221 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659406 s, 159 MB/s 2024-04-25T08:50:19.228 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.228 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.228 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601564 s, 174 MB/s 2024-04-25T08:50:19.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.236 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589091 s, 178 MB/s 2024-04-25T08:50:19.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.242 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601028 s, 174 MB/s 2024-04-25T08:50:19.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.250 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728639 s, 144 MB/s 2024-04-25T08:50:19.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.258 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663042 s, 158 MB/s 2024-04-25T08:50:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.265 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608381 s, 172 MB/s 2024-04-25T08:50:19.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.272 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646991 s, 162 MB/s 2024-04-25T08:50:19.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.280 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.280 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646857 s, 162 MB/s 2024-04-25T08:50:19.287 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.287 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.287 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634036 s, 165 MB/s 2024-04-25T08:50:19.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.295 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.295 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674698 s, 155 MB/s 2024-04-25T08:50:19.301 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.302 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.302 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602437 s, 174 MB/s 2024-04-25T08:50:19.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.309 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617633 s, 170 MB/s 2024-04-25T08:50:19.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753982 s, 139 MB/s 2024-04-25T08:50:19.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.325 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748938 s, 140 MB/s 2024-04-25T08:50:19.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.333 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697003 s, 150 MB/s 2024-04-25T08:50:19.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.342 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671035 s, 156 MB/s 2024-04-25T08:50:19.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.348 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.348 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586265 s, 179 MB/s 2024-04-25T08:50:19.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.355 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.355 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582733 s, 180 MB/s 2024-04-25T08:50:19.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.362 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637256 s, 165 MB/s 2024-04-25T08:50:19.371 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.371 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.372 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751609 s, 140 MB/s 2024-04-25T08:50:19.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:19.372 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:19.372 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:19.373 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T08:50:19.373 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:19.373 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:19.373 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:19.373 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:19.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.436 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.436 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620494 s, 169 MB/s 2024-04-25T08:50:19.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.443 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629532 s, 167 MB/s 2024-04-25T08:50:19.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.451 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737283 s, 142 MB/s 2024-04-25T08:50:19.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.458 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679125 s, 154 MB/s 2024-04-25T08:50:19.466 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.466 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.466 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692984 s, 151 MB/s 2024-04-25T08:50:19.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.473 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571835 s, 183 MB/s 2024-04-25T08:50:19.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.481 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.481 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678134 s, 155 MB/s 2024-04-25T08:50:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660843 s, 159 MB/s 2024-04-25T08:50:19.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.496 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735231 s, 143 MB/s 2024-04-25T08:50:19.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.504 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637807 s, 164 MB/s 2024-04-25T08:50:19.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.511 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649297 s, 161 MB/s 2024-04-25T08:50:19.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.518 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630034 s, 166 MB/s 2024-04-25T08:50:19.525 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654205 s, 160 MB/s 2024-04-25T08:50:19.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.533 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600665 s, 175 MB/s 2024-04-25T08:50:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.540 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649071 s, 162 MB/s 2024-04-25T08:50:19.548 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.548 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.548 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651609 s, 161 MB/s 2024-04-25T08:50:19.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.555 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621923 s, 169 MB/s 2024-04-25T08:50:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.562 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618885 s, 169 MB/s 2024-04-25T08:50:19.569 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.569 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.569 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633271 s, 166 MB/s 2024-04-25T08:50:19.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.576 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651267 s, 161 MB/s 2024-04-25T08:50:19.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.585 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762657 s, 137 MB/s 2024-04-25T08:50:19.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.592 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635062 s, 165 MB/s 2024-04-25T08:50:19.600 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.600 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.600 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755593 s, 139 MB/s 2024-04-25T08:50:19.609 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.609 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.609 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752175 s, 139 MB/s 2024-04-25T08:50:19.616 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.616 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.616 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637948 s, 164 MB/s 2024-04-25T08:50:19.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.624 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720525 s, 146 MB/s 2024-04-25T08:50:19.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659095 s, 159 MB/s 2024-04-25T08:50:19.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.638 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570486 s, 184 MB/s 2024-04-25T08:50:19.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.645 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636007 s, 165 MB/s 2024-04-25T08:50:19.652 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.653 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.653 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639241 s, 164 MB/s 2024-04-25T08:50:19.660 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.660 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.660 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628339 s, 167 MB/s 2024-04-25T08:50:19.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.668 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749889 s, 140 MB/s 2024-04-25T08:50:19.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:19.670 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:19.670 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:19.670 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T08:50:19.670 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:19.670 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:19.670 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:19.670 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:19.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075626 s, 139 MB/s 2024-04-25T08:50:19.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.742 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612104 s, 171 MB/s 2024-04-25T08:50:19.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.749 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653631 s, 160 MB/s 2024-04-25T08:50:19.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.757 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611055 s, 172 MB/s 2024-04-25T08:50:19.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.763 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614387 s, 171 MB/s 2024-04-25T08:50:19.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.771 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629217 s, 167 MB/s 2024-04-25T08:50:19.778 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.778 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.778 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630699 s, 166 MB/s 2024-04-25T08:50:19.785 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.785 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.785 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609568 s, 172 MB/s 2024-04-25T08:50:19.793 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.793 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.793 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770854 s, 136 MB/s 2024-04-25T08:50:19.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.802 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735302 s, 143 MB/s 2024-04-25T08:50:19.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.810 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758424 s, 138 MB/s 2024-04-25T08:50:19.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.818 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.818 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651633 s, 161 MB/s 2024-04-25T08:50:19.826 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.826 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.826 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753617 s, 139 MB/s 2024-04-25T08:50:19.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.833 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622682 s, 168 MB/s 2024-04-25T08:50:19.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.840 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608991 s, 172 MB/s 2024-04-25T08:50:19.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.847 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633945 s, 165 MB/s 2024-04-25T08:50:19.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.855 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.855 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617561 s, 170 MB/s 2024-04-25T08:50:19.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.862 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634306 s, 165 MB/s 2024-04-25T08:50:19.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.870 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753783 s, 139 MB/s 2024-04-25T08:50:19.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.877 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636899 s, 165 MB/s 2024-04-25T08:50:19.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.885 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.885 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649163 s, 162 MB/s 2024-04-25T08:50:19.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.893 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736261 s, 142 MB/s 2024-04-25T08:50:19.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.901 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713074 s, 147 MB/s 2024-04-25T08:50:19.908 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.908 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.908 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605848 s, 173 MB/s 2024-04-25T08:50:19.915 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.915 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.915 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630079 s, 166 MB/s 2024-04-25T08:50:19.922 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.922 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.923 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065403 s, 160 MB/s 2024-04-25T08:50:19.929 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.929 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.929 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608041 s, 172 MB/s 2024-04-25T08:50:19.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.936 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608934 s, 172 MB/s 2024-04-25T08:50:19.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.944 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626041 s, 167 MB/s 2024-04-25T08:50:19.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.952 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720059 s, 146 MB/s 2024-04-25T08:50:19.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.959 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648011 s, 162 MB/s 2024-04-25T08:50:19.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:19.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:19.967 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655633 s, 160 MB/s 2024-04-25T08:50:19.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:19.968 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:19.968 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:19.968 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T08:50:19.968 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:19.968 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:19.968 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:19.969 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:20.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.033 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637038 s, 165 MB/s 2024-04-25T08:50:20.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.041 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746431 s, 140 MB/s 2024-04-25T08:50:20.048 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.048 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.048 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655482 s, 160 MB/s 2024-04-25T08:50:20.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.056 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752735 s, 139 MB/s 2024-04-25T08:50:20.063 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.064 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.064 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634461 s, 165 MB/s 2024-04-25T08:50:20.071 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.071 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.071 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666521 s, 157 MB/s 2024-04-25T08:50:20.078 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.078 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.079 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623632 s, 168 MB/s 2024-04-25T08:50:20.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.087 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.087 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721313 s, 145 MB/s 2024-04-25T08:50:20.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.094 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638251 s, 164 MB/s 2024-04-25T08:50:20.100 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.101 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.101 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603251 s, 174 MB/s 2024-04-25T08:50:20.107 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.107 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.108 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596553 s, 176 MB/s 2024-04-25T08:50:20.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.115 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630604 s, 166 MB/s 2024-04-25T08:50:20.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.122 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665328 s, 158 MB/s 2024-04-25T08:50:20.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.129 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063261 s, 166 MB/s 2024-04-25T08:50:20.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.137 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674995 s, 155 MB/s 2024-04-25T08:50:20.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.145 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713689 s, 147 MB/s 2024-04-25T08:50:20.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.153 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694632 s, 151 MB/s 2024-04-25T08:50:20.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.161 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074719 s, 140 MB/s 2024-04-25T08:50:20.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.169 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659465 s, 159 MB/s 2024-04-25T08:50:20.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.175 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588436 s, 178 MB/s 2024-04-25T08:50:20.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.183 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.183 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716198 s, 146 MB/s 2024-04-25T08:50:20.191 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.191 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.191 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660423 s, 159 MB/s 2024-04-25T08:50:20.197 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.198 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575862 s, 182 MB/s 2024-04-25T08:50:20.205 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.206 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.206 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703014 s, 149 MB/s 2024-04-25T08:50:20.213 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.214 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654999 s, 160 MB/s 2024-04-25T08:50:20.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.222 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762243 s, 138 MB/s 2024-04-25T08:50:20.229 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.229 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.229 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647864 s, 162 MB/s 2024-04-25T08:50:20.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.238 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703596 s, 149 MB/s 2024-04-25T08:50:20.244 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.244 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.244 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647533 s, 162 MB/s 2024-04-25T08:50:20.251 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.252 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649934 s, 161 MB/s 2024-04-25T08:50:20.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.259 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651409 s, 161 MB/s 2024-04-25T08:50:20.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715521 s, 147 MB/s 2024-04-25T08:50:20.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:20.268 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:20.268 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:20.268 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T08:50:20.268 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:20.268 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:20.269 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:20.269 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:20.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.334 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761428 s, 138 MB/s 2024-04-25T08:50:20.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.341 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572419 s, 183 MB/s 2024-04-25T08:50:20.350 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.350 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.351 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730444 s, 144 MB/s 2024-04-25T08:50:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.356 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.357 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665841 s, 157 MB/s 2024-04-25T08:50:20.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.365 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728959 s, 144 MB/s 2024-04-25T08:50:20.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.372 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626771 s, 167 MB/s 2024-04-25T08:50:20.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.380 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738516 s, 142 MB/s 2024-04-25T08:50:20.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.387 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060191 s, 174 MB/s 2024-04-25T08:50:20.393 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.394 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583551 s, 180 MB/s 2024-04-25T08:50:20.401 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.401 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.401 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646973 s, 162 MB/s 2024-04-25T08:50:20.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.409 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066174 s, 158 MB/s 2024-04-25T08:50:20.416 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.416 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.416 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665214 s, 158 MB/s 2024-04-25T08:50:20.423 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.423 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.423 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627315 s, 167 MB/s 2024-04-25T08:50:20.431 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.431 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.431 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743152 s, 141 MB/s 2024-04-25T08:50:20.439 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.439 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.439 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711679 s, 147 MB/s 2024-04-25T08:50:20.446 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.446 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.446 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626315 s, 167 MB/s 2024-04-25T08:50:20.453 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.454 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.454 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648149 s, 162 MB/s 2024-04-25T08:50:20.461 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.461 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.461 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616587 s, 170 MB/s 2024-04-25T08:50:20.468 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.468 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.468 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640702 s, 164 MB/s 2024-04-25T08:50:20.475 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.475 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.475 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613214 s, 171 MB/s 2024-04-25T08:50:20.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.483 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.483 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071129 s, 147 MB/s 2024-04-25T08:50:20.491 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.491 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.491 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709375 s, 148 MB/s 2024-04-25T08:50:20.498 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.498 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.498 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642477 s, 163 MB/s 2024-04-25T08:50:20.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.506 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661866 s, 158 MB/s 2024-04-25T08:50:20.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.513 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.513 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609966 s, 172 MB/s 2024-04-25T08:50:20.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.520 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650811 s, 161 MB/s 2024-04-25T08:50:20.528 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.528 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.528 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716443 s, 146 MB/s 2024-04-25T08:50:20.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.535 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059437 s, 176 MB/s 2024-04-25T08:50:20.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.543 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709147 s, 148 MB/s 2024-04-25T08:50:20.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.550 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580286 s, 181 MB/s 2024-04-25T08:50:20.557 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.557 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.557 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640429 s, 164 MB/s 2024-04-25T08:50:20.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.566 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753471 s, 139 MB/s 2024-04-25T08:50:20.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:20.567 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:20.567 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:20.567 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T08:50:20.567 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:20.567 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:20.567 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:20.567 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:20.632 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.632 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.632 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714416 s, 147 MB/s 2024-04-25T08:50:20.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.640 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695897 s, 151 MB/s 2024-04-25T08:50:20.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.648 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735201 s, 143 MB/s 2024-04-25T08:50:20.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.656 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.656 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655397 s, 160 MB/s 2024-04-25T08:50:20.663 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.663 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.663 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617855 s, 170 MB/s 2024-04-25T08:50:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.671 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734829 s, 143 MB/s 2024-04-25T08:50:20.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.678 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663612 s, 158 MB/s 2024-04-25T08:50:20.686 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.686 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.687 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723795 s, 145 MB/s 2024-04-25T08:50:20.694 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.694 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.694 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699035 s, 150 MB/s 2024-04-25T08:50:20.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.703 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740478 s, 142 MB/s 2024-04-25T08:50:20.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.710 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063577 s, 165 MB/s 2024-04-25T08:50:20.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.717 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641773 s, 163 MB/s 2024-04-25T08:50:20.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.726 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744201 s, 141 MB/s 2024-04-25T08:50:20.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.733 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644265 s, 163 MB/s 2024-04-25T08:50:20.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.740 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587018 s, 179 MB/s 2024-04-25T08:50:20.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.747 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661853 s, 158 MB/s 2024-04-25T08:50:20.757 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.758 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627559 s, 167 MB/s 2024-04-25T08:50:20.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.762 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647502 s, 162 MB/s 2024-04-25T08:50:20.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062748 s, 167 MB/s 2024-04-25T08:50:20.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.776 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619353 s, 169 MB/s 2024-04-25T08:50:20.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.784 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671773 s, 156 MB/s 2024-04-25T08:50:20.791 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.791 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.791 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637256 s, 165 MB/s 2024-04-25T08:50:20.798 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.798 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.798 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614887 s, 171 MB/s 2024-04-25T08:50:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.806 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708208 s, 148 MB/s 2024-04-25T08:50:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.813 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586846 s, 179 MB/s 2024-04-25T08:50:20.820 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.820 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.820 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622306 s, 168 MB/s 2024-04-25T08:50:20.828 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.828 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.828 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695317 s, 151 MB/s 2024-04-25T08:50:20.835 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.835 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.835 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614229 s, 171 MB/s 2024-04-25T08:50:20.842 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.842 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.842 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570982 s, 184 MB/s 2024-04-25T08:50:20.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.850 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719699 s, 146 MB/s 2024-04-25T08:50:20.858 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.858 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.858 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070351 s, 149 MB/s 2024-04-25T08:50:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671327 s, 156 MB/s 2024-04-25T08:50:20.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:20.870 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:20.870 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:20.870 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T08:50:20.870 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:20.870 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:20.871 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:20.871 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:20.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.931 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680795 s, 154 MB/s 2024-04-25T08:50:20.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.938 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006155 s, 170 MB/s 2024-04-25T08:50:20.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.945 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588902 s, 178 MB/s 2024-04-25T08:50:20.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.952 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631868 s, 166 MB/s 2024-04-25T08:50:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.959 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632551 s, 166 MB/s 2024-04-25T08:50:20.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.968 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731482 s, 143 MB/s 2024-04-25T08:50:20.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.975 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640885 s, 164 MB/s 2024-04-25T08:50:20.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.982 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627771 s, 167 MB/s 2024-04-25T08:50:20.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595244 s, 176 MB/s 2024-04-25T08:50:20.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:20.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:20.996 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636177 s, 165 MB/s 2024-04-25T08:50:21.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.004 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761704 s, 138 MB/s 2024-04-25T08:50:21.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.012 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653806 s, 160 MB/s 2024-04-25T08:50:21.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.019 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640537 s, 164 MB/s 2024-04-25T08:50:21.027 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.027 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.027 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711876 s, 147 MB/s 2024-04-25T08:50:21.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.036 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759124 s, 138 MB/s 2024-04-25T08:50:21.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.043 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655181 s, 160 MB/s 2024-04-25T08:50:21.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.052 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765101 s, 137 MB/s 2024-04-25T08:50:21.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.059 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063666 s, 165 MB/s 2024-04-25T08:50:21.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.067 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708847 s, 148 MB/s 2024-04-25T08:50:21.074 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.074 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.074 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658756 s, 159 MB/s 2024-04-25T08:50:21.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.082 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670315 s, 156 MB/s 2024-04-25T08:50:21.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.090 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705632 s, 149 MB/s 2024-04-25T08:50:21.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.098 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666591 s, 157 MB/s 2024-04-25T08:50:21.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.106 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747914 s, 140 MB/s 2024-04-25T08:50:21.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.113 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651523 s, 161 MB/s 2024-04-25T08:50:21.121 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.121 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.121 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066063 s, 159 MB/s 2024-04-25T08:50:21.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.127 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592745 s, 177 MB/s 2024-04-25T08:50:21.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.136 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676967 s, 155 MB/s 2024-04-25T08:50:21.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.143 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733318 s, 143 MB/s 2024-04-25T08:50:21.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.151 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632701 s, 166 MB/s 2024-04-25T08:50:21.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.158 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643589 s, 163 MB/s 2024-04-25T08:50:21.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.165 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628756 s, 167 MB/s 2024-04-25T08:50:21.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:21.166 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:21.166 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:21.167 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T08:50:21.167 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:21.167 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:21.167 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:21.167 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:21.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.230 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626701 s, 167 MB/s 2024-04-25T08:50:21.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.237 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642219 s, 163 MB/s 2024-04-25T08:50:21.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.245 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641078 s, 164 MB/s 2024-04-25T08:50:21.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.252 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688275 s, 152 MB/s 2024-04-25T08:50:21.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.259 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592078 s, 177 MB/s 2024-04-25T08:50:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704364 s, 149 MB/s 2024-04-25T08:50:21.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.274 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571783 s, 183 MB/s 2024-04-25T08:50:21.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.281 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006709 s, 156 MB/s 2024-04-25T08:50:21.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.289 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644131 s, 163 MB/s 2024-04-25T08:50:21.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.296 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670836 s, 156 MB/s 2024-04-25T08:50:21.305 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.305 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.305 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075581 s, 139 MB/s 2024-04-25T08:50:21.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.312 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637315 s, 165 MB/s 2024-04-25T08:50:21.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.319 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637404 s, 165 MB/s 2024-04-25T08:50:21.327 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.327 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.327 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681812 s, 154 MB/s 2024-04-25T08:50:21.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.334 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642298 s, 163 MB/s 2024-04-25T08:50:21.342 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.342 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.342 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638826 s, 164 MB/s 2024-04-25T08:50:21.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.349 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641379 s, 163 MB/s 2024-04-25T08:50:21.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.357 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068452 s, 153 MB/s 2024-04-25T08:50:21.364 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.364 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.364 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630871 s, 166 MB/s 2024-04-25T08:50:21.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.372 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707322 s, 148 MB/s 2024-04-25T08:50:21.379 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.379 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.379 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065271 s, 161 MB/s 2024-04-25T08:50:21.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.387 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720041 s, 146 MB/s 2024-04-25T08:50:21.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.395 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711539 s, 147 MB/s 2024-04-25T08:50:21.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.402 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571128 s, 184 MB/s 2024-04-25T08:50:21.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.410 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739439 s, 142 MB/s 2024-04-25T08:50:21.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.419 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728143 s, 144 MB/s 2024-04-25T08:50:21.425 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632583 s, 166 MB/s 2024-04-25T08:50:21.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.433 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631781 s, 166 MB/s 2024-04-25T08:50:21.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.440 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623347 s, 168 MB/s 2024-04-25T08:50:21.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.448 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707642 s, 148 MB/s 2024-04-25T08:50:21.455 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.455 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.455 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596047 s, 176 MB/s 2024-04-25T08:50:21.462 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.463 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688095 s, 152 MB/s 2024-04-25T08:50:21.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:21.464 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:21.528 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.528 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.528 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718749 s, 146 MB/s 2024-04-25T08:50:21.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.535 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641937 s, 163 MB/s 2024-04-25T08:50:21.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.543 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682479 s, 154 MB/s 2024-04-25T08:50:21.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.550 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057836 s, 181 MB/s 2024-04-25T08:50:21.556 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.557 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.557 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594632 s, 176 MB/s 2024-04-25T08:50:21.564 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.564 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.564 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631531 s, 166 MB/s 2024-04-25T08:50:21.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.574 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770461 s, 136 MB/s 2024-04-25T08:50:21.580 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.580 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.581 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072484 s, 145 MB/s 2024-04-25T08:50:21.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.589 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727135 s, 144 MB/s 2024-04-25T08:50:21.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938564 s, 112 MB/s 2024-04-25T08:50:21.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.606 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651449 s, 161 MB/s 2024-04-25T08:50:21.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.614 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638544 s, 164 MB/s 2024-04-25T08:50:21.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.620 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573983 s, 183 MB/s 2024-04-25T08:50:21.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.628 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651523 s, 161 MB/s 2024-04-25T08:50:21.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.635 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635126 s, 165 MB/s 2024-04-25T08:50:21.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.643 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720558 s, 146 MB/s 2024-04-25T08:50:21.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.650 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653615 s, 160 MB/s 2024-04-25T08:50:21.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.657 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571953 s, 183 MB/s 2024-04-25T08:50:21.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.665 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665057 s, 158 MB/s 2024-04-25T08:50:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068133 s, 154 MB/s 2024-04-25T08:50:21.682 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.682 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.682 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858674 s, 122 MB/s 2024-04-25T08:50:21.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.689 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.689 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608387 s, 172 MB/s 2024-04-25T08:50:21.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.696 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634582 s, 165 MB/s 2024-04-25T08:50:21.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.703 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662502 s, 158 MB/s 2024-04-25T08:50:21.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.710 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569668 s, 184 MB/s 2024-04-25T08:50:21.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.718 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665009 s, 158 MB/s 2024-04-25T08:50:21.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.725 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677794 s, 155 MB/s 2024-04-25T08:50:21.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.733 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684149 s, 153 MB/s 2024-04-25T08:50:21.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.740 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059294 s, 177 MB/s 2024-04-25T08:50:21.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.749 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870039 s, 121 MB/s 2024-04-25T08:50:21.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060349 s, 174 MB/s 2024-04-25T08:50:21.765 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.765 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.765 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673865 s, 156 MB/s 2024-04-25T08:50:21.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:21.765 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:21.765 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:21.766 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T08:50:21.766 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:21.766 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:21.766 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:21.766 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:21.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.829 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639553 s, 164 MB/s 2024-04-25T08:50:21.837 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.837 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.837 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679307 s, 154 MB/s 2024-04-25T08:50:21.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.845 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756287 s, 139 MB/s 2024-04-25T08:50:21.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.853 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656368 s, 160 MB/s 2024-04-25T08:50:21.866 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.866 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.866 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118615 s, 88.4 MB/s 2024-04-25T08:50:21.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.873 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665729 s, 158 MB/s 2024-04-25T08:50:21.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.880 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601391 s, 174 MB/s 2024-04-25T08:50:21.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.887 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647072 s, 162 MB/s 2024-04-25T08:50:21.894 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.894 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.894 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609373 s, 172 MB/s 2024-04-25T08:50:21.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.902 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006257 s, 168 MB/s 2024-04-25T08:50:21.911 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.911 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.911 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871926 s, 120 MB/s 2024-04-25T08:50:21.918 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.918 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.918 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643 s, 163 MB/s 2024-04-25T08:50:21.926 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.926 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.926 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671889 s, 156 MB/s 2024-04-25T08:50:21.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.934 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.934 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746166 s, 141 MB/s 2024-04-25T08:50:21.942 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.942 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.942 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693992 s, 151 MB/s 2024-04-25T08:50:21.949 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.949 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.949 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628966 s, 167 MB/s 2024-04-25T08:50:21.957 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.957 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.958 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714979 s, 147 MB/s 2024-04-25T08:50:21.964 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.964 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.964 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060096 s, 174 MB/s 2024-04-25T08:50:21.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.977 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119727 s, 87.6 MB/s 2024-04-25T08:50:21.987 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.987 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.987 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847371 s, 124 MB/s 2024-04-25T08:50:21.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:21.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:21.996 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878168 s, 119 MB/s 2024-04-25T08:50:22.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.004 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672845 s, 156 MB/s 2024-04-25T08:50:22.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.011 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064429 s, 163 MB/s 2024-04-25T08:50:22.018 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.019 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638079 s, 164 MB/s 2024-04-25T08:50:22.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.025 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589373 s, 178 MB/s 2024-04-25T08:50:22.033 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.033 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.034 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713856 s, 147 MB/s 2024-04-25T08:50:22.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.046 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117844 s, 89.0 MB/s 2024-04-25T08:50:22.055 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.055 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.055 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751956 s, 139 MB/s 2024-04-25T08:50:22.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.062 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650778 s, 161 MB/s 2024-04-25T08:50:22.070 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.070 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.070 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714047 s, 147 MB/s 2024-04-25T08:50:22.077 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.077 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.077 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581741 s, 180 MB/s 2024-04-25T08:50:22.085 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.085 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.085 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690435 s, 152 MB/s 2024-04-25T08:50:22.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:22.086 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:22.086 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:22.086 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T08:50:22.086 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:22.086 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:22.086 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:22.086 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:22.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.151 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641095 s, 164 MB/s 2024-04-25T08:50:22.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.158 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614839 s, 171 MB/s 2024-04-25T08:50:22.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.167 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091652 s, 114 MB/s 2024-04-25T08:50:22.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.175 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653852 s, 160 MB/s 2024-04-25T08:50:22.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.186 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754698 s, 139 MB/s 2024-04-25T08:50:22.191 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.191 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.191 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666467 s, 157 MB/s 2024-04-25T08:50:22.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.198 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607644 s, 173 MB/s 2024-04-25T08:50:22.205 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.206 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.206 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677769 s, 155 MB/s 2024-04-25T08:50:22.213 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.213 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.213 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645908 s, 162 MB/s 2024-04-25T08:50:22.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.222 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867568 s, 121 MB/s 2024-04-25T08:50:22.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.231 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744675 s, 141 MB/s 2024-04-25T08:50:22.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.238 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646747 s, 162 MB/s 2024-04-25T08:50:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071234 s, 147 MB/s 2024-04-25T08:50:22.255 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.255 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.256 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864091 s, 121 MB/s 2024-04-25T08:50:22.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.265 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863928 s, 121 MB/s 2024-04-25T08:50:22.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.272 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644985 s, 163 MB/s 2024-04-25T08:50:22.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.279 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617239 s, 170 MB/s 2024-04-25T08:50:22.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.286 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587942 s, 178 MB/s 2024-04-25T08:50:22.293 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.293 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.293 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611522 s, 171 MB/s 2024-04-25T08:50:22.300 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.300 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.300 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637986 s, 164 MB/s 2024-04-25T08:50:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882083 s, 119 MB/s 2024-04-25T08:50:22.320 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.320 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.320 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899026 s, 117 MB/s 2024-04-25T08:50:22.328 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.328 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.328 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072567 s, 144 MB/s 2024-04-25T08:50:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.337 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753488 s, 139 MB/s 2024-04-25T08:50:22.343 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.343 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.343 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568746 s, 184 MB/s 2024-04-25T08:50:22.350 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.350 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.350 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005836 s, 180 MB/s 2024-04-25T08:50:22.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.357 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635569 s, 165 MB/s 2024-04-25T08:50:22.366 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.366 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.366 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722855 s, 145 MB/s 2024-04-25T08:50:22.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.373 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624058 s, 168 MB/s 2024-04-25T08:50:22.379 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.379 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.379 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574078 s, 183 MB/s 2024-04-25T08:50:22.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.391 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723151 s, 145 MB/s 2024-04-25T08:50:22.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.394 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575433 s, 182 MB/s 2024-04-25T08:50:22.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:22.395 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:50:22.395 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:50:22.396 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T08:50:22.396 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:50:22.396 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:50:22.396 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:50:22.396 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:50:22.460 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.460 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.460 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592755 s, 177 MB/s 2024-04-25T08:50:22.470 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.470 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.470 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093014 s, 113 MB/s 2024-04-25T08:50:22.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.478 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665425 s, 158 MB/s 2024-04-25T08:50:22.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.486 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709934 s, 148 MB/s 2024-04-25T08:50:22.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.493 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656655 s, 160 MB/s 2024-04-25T08:50:22.501 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.502 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.502 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719078 s, 146 MB/s 2024-04-25T08:50:22.509 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.509 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.509 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712247 s, 147 MB/s 2024-04-25T08:50:22.517 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.517 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.517 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742316 s, 141 MB/s 2024-04-25T08:50:22.524 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.524 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.524 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006326 s, 166 MB/s 2024-04-25T08:50:22.532 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.532 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.532 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638209 s, 164 MB/s 2024-04-25T08:50:22.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.539 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640699 s, 164 MB/s 2024-04-25T08:50:22.545 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.546 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575671 s, 182 MB/s 2024-04-25T08:50:22.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.553 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.553 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661123 s, 159 MB/s 2024-04-25T08:50:22.561 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.561 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.561 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071444 s, 147 MB/s 2024-04-25T08:50:22.569 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.569 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.570 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727579 s, 144 MB/s 2024-04-25T08:50:22.577 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.577 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.577 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639708 s, 164 MB/s 2024-04-25T08:50:22.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.584 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665474 s, 158 MB/s 2024-04-25T08:50:22.594 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.594 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.594 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585417 s, 179 MB/s 2024-04-25T08:50:22.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.598 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570435 s, 184 MB/s 2024-04-25T08:50:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841236 s, 125 MB/s 2024-04-25T08:50:22.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.614 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637956 s, 164 MB/s 2024-04-25T08:50:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718619 s, 146 MB/s 2024-04-25T08:50:22.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.630 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068917 s, 152 MB/s 2024-04-25T08:50:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596469 s, 176 MB/s 2024-04-25T08:50:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936884 s, 112 MB/s 2024-04-25T08:50:22.654 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.655 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650438 s, 161 MB/s 2024-04-25T08:50:22.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.662 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622669 s, 168 MB/s 2024-04-25T08:50:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.670 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658922 s, 159 MB/s 2024-04-25T08:50:22.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.677 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723545 s, 145 MB/s 2024-04-25T08:50:22.686 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.686 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.686 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764584 s, 137 MB/s 2024-04-25T08:50:22.692 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.692 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.692 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563416 s, 186 MB/s 2024-04-25T08:50:22.702 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:50:22.702 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:50:22.702 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878875 s, 119 MB/s 2024-04-25T08:50:22.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:22.703 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-04-25T08:50:22.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.855+0000 7efe176ac640 1 Processor -- start 2024-04-25T08:50:22.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.855+0000 7efe176ac640 1 -- start start 2024-04-25T08:50:22.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe176ac640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe1006abe0 0x7efe1006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe176ac640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1006b500 con 0x7efe100ad570 2024-04-25T08:50:22.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe176ac640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe100b3930 con 0x7efe1015dd80 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe176ac640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1006e410 con 0x7efe1006abe0 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe15448640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe1006abe0 0x7efe1006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe15c49640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efe100ad570 0x7efe1006ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59180/0 (socket says 172.21.15.172:59180) 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe15c49640 1 -- 172.21.15.172:0/2607409101 learned_addr learned my addr 172.21.15.172:0/2607409101 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe15448640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe1006abe0 0x7efe1006afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53834/0 (socket says 172.21.15.172:53834) 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe15448640 1 -- 172.21.15.172:0/2607409101 >> v1:172.21.15.186:6789/0 conn(0x7efe1015dd80 legacy=0x7efe100b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe15448640 1 -- 172.21.15.172:0/2607409101 >> v1:172.21.15.172:6789/0 conn(0x7efe100ad570 legacy=0x7efe1006ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe07fff640 1 -- 172.21.15.172:0/2607409101 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674480332 0 0) 0x7efe1006b500 con 0x7efe100ad570 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.856+0000 7efe15448640 1 -- 172.21.15.172:0/2607409101 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100b3c10 con 0x7efe1006abe0 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.857+0000 7efe15448640 1 --2- 172.21.15.172:0/2607409101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe1006abe0 0x7efe1006afc0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0097a0 tx=0x7efe0c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b414d0f4b6499d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.857+0000 7efe07fff640 1 -- 172.21.15.172:0/2607409101 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c037070 con 0x7efe1006abe0 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.857+0000 7efe07fff640 1 -- 172.21.15.172:0/2607409101 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c032440 con 0x7efe1006abe0 2024-04-25T08:50:22.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.857+0000 7efe07fff640 1 -- 172.21.15.172:0/2607409101 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c032810 con 0x7efe1006abe0 2024-04-25T08:50:22.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.857+0000 7efe176ac640 1 -- 172.21.15.172:0/2607409101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe1006abe0 msgr2=0x7efe1006afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.857+0000 7efe176ac640 1 --2- 172.21.15.172:0/2607409101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe1006abe0 0x7efe1006afc0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0097a0 tx=0x7efe0c02a230 comp rx=0 tx=0).stop 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.857+0000 7efe176ac640 1 -- 172.21.15.172:0/2607409101 shutdown_connections 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.858+0000 7efe176ac640 1 --2- 172.21.15.172:0/2607409101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe1006abe0 0x7efe1006afc0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.858+0000 7efe176ac640 1 -- 172.21.15.172:0/2607409101 >> 172.21.15.172:0/2607409101 conn(0x7efe100b5af0 msgr2=0x7efe100b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.858+0000 7efe176ac640 1 -- 172.21.15.172:0/2607409101 shutdown_connections 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.858+0000 7efe176ac640 1 -- 172.21.15.172:0/2607409101 wait complete. 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.859+0000 7efe176ac640 1 Processor -- start 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.859+0000 7efe176ac640 1 -- start start 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.859+0000 7efe176ac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe1006abe0 0x7efe101453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.859+0000 7efe176ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe100ad570 0x7efe101550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.859+0000 7efe176ac640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe1015dd80 0x7efe1015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.859+0000 7efe176ac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10070280 con 0x7efe100ad570 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe176ac640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1006e940 con 0x7efe1015dd80 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe176ac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe10070400 con 0x7efe1006abe0 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe14c47640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe100ad570 0x7efe101550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe14c47640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe100ad570 0x7efe101550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53842/0 (socket says 172.21.15.172:53842) 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe14c47640 1 -- 172.21.15.172:0/1119455537 learned_addr learned my addr 172.21.15.172:0/1119455537 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe15c49640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe1015dd80 0x7efe1015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe15448640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe1006abe0 0x7efe101453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe14c47640 1 -- 172.21.15.172:0/1119455537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe1006abe0 msgr2=0x7efe101453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe14c47640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe1006abe0 0x7efe101453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe14c47640 1 -- 172.21.15.172:0/1119455537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe1015dd80 msgr2=0x7efe1015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe14c47640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe1015dd80 0x7efe1015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe14c47640 1 -- 172.21.15.172:0/1119455537 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1015adb0 con 0x7efe100ad570 2024-04-25T08:50:22.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe15c49640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe1015dd80 0x7efe1015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:22.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe15448640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe1006abe0 0x7efe101453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:22.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe14c47640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe100ad570 0x7efe101550e0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7efe0000c3c0 tx=0x7efe0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:22.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe05ffb640 1 -- 172.21.15.172:0/1119455537 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00017070 con 0x7efe100ad570 2024-04-25T08:50:22.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe05ffb640 1 -- 172.21.15.172:0/1119455537 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe000052f0 con 0x7efe100ad570 2024-04-25T08:50:22.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe176ac640 1 -- 172.21.15.172:0/1119455537 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1015b090 con 0x7efe100ad570 2024-04-25T08:50:22.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe05ffb640 1 -- 172.21.15.172:0/1119455537 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00003830 con 0x7efe100ad570 2024-04-25T08:50:22.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.860+0000 7efe176ac640 1 -- 172.21.15.172:0/1119455537 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1015b650 con 0x7efe100ad570 2024-04-25T08:50:22.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.862+0000 7efe05ffb640 1 -- 172.21.15.172:0/1119455537 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe0001a070 con 0x7efe100ad570 2024-04-25T08:50:22.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.862+0000 7efe05ffb640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efdf406b4d0 0x7efdf406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.862+0000 7efe05ffb640 1 -- 172.21.15.172:0/1119455537 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efe00089690 con 0x7efe100ad570 2024-04-25T08:50:22.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.862+0000 7efe15448640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efdf406b4d0 0x7efdf406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.863+0000 7efe15448640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efdf406b4d0 0x7efdf406d990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7efe0c034000 tx=0x7efe0c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:22.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.863+0000 7efe1a3ad740 1 Processor -- start 2024-04-25T08:50:22.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.863+0000 7efe1a3ad740 1 -- start start 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e1928d0 0x55975e1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 0x55975e181140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55975e0ba000 con 0x55975e156200 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55975e062f20 con 0x55975e180cc0 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55975e0b60a0 con 0x55975e1928d0 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe15448640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe15448640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53856/0 (socket says 172.21.15.172:53856) 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe15448640 1 -- 172.21.15.172:0/1885882684 learned_addr learned my addr 172.21.15.172:0/1885882684 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe15448640 1 -- 172.21.15.172:0/1885882684 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e1928d0 msgr2=0x55975e1565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe15448640 1 --2- 172.21.15.172:0/1885882684 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e1928d0 0x55975e1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe15448640 1 -- 172.21.15.172:0/1885882684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 msgr2=0x55975e181140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe15c49640 1 --2- 172.21.15.172:0/1885882684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 0x55975e181140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe15448640 1 --2- 172.21.15.172:0/1885882684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 0x55975e181140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe15448640 1 -- 172.21.15.172:0/1885882684 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55975de9aba0 con 0x55975e156200 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.864+0000 7efe15c49640 1 --2- 172.21.15.172:0/1885882684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 0x55975e181140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efe15448640 1 --2- 172.21.15.172:0/1885882684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e158360 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009890 tx=0x7efe0c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8149cea4255957 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efdfaffd640 1 -- 172.21.15.172:0/1885882684 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c04d070 con 0x55975e156200 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efdfaffd640 1 -- 172.21.15.172:0/1885882684 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c048470 con 0x55975e156200 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efdfaffd640 1 -- 172.21.15.172:0/1885882684 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c037040 con 0x55975e156200 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1885882684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 msgr2=0x55975e158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/1885882684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e158360 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009890 tx=0x7efe0c02c000 comp rx=0 tx=0).stop 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1885882684 shutdown_connections 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/1885882684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 0x55975e181140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/1885882684 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e1928d0 0x55975e1565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/1885882684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e158360 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1885882684 >> 172.21.15.172:0/1885882684 conn(0x55975e11e050 msgr2=0x55975e19bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1885882684 shutdown_connections 2024-04-25T08:50:22.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.865+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1885882684 wait complete. 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.866+0000 7efe1a3ad740 1 -- start start 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.866+0000 7efe1a3ad740 1 Processor -- start 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e182200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 0x55975e1af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e1928d0 0x55975e17cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55975e058610 con 0x55975e156200 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55975e17e810 con 0x55975e1928d0 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55975e182bd0 con 0x55975e180cc0 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe1a3ad740 10 client.0 _ll_register_callbacks cb 0x55975e070f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15448640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e182200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15448640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e182200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53862/0 (socket says 172.21.15.172:53862) 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15448640 1 -- 172.21.15.172:0/1667771843 learned_addr learned my addr 172.21.15.172:0/1667771843 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15c49640 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e1928d0 0x55975e17cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe14c47640 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 0x55975e1af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15448640 1 -- 172.21.15.172:0/1667771843 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 msgr2=0x55975e1af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15448640 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 0x55975e1af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15448640 1 -- 172.21.15.172:0/1667771843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e1928d0 msgr2=0x55975e17cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15448640 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e1928d0 0x55975e17cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15448640 1 -- 172.21.15.172:0/1667771843 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55975dd8e490 con 0x55975e156200 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe14c47640 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 0x55975e1af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15c49640 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e1928d0 0x55975e17cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efe15448640 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e182200 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7efe0c04b040 tx=0x7efe0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65b3274e1313d10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.867+0000 7efdeffff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efdeffff640 1 -- 172.21.15.172:0/1667771843 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c04d070 con 0x55975e156200 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efdeffff640 1 -- 172.21.15.172:0/1667771843 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efe0c0488f0 con 0x55975e156200 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1667771843 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe0c048470 con 0x55975e156200 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efdeffff640 1 -- 172.21.15.172:0/1667771843 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe0c037040 con 0x55975e156200 2024-04-25T08:50:22.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efe1a3ad740 10 client.8847 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1667771843 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55975defb330 con 0x55975e156200 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efdeffff640 1 -- 172.21.15.172:0/1667771843 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c048470 con 0x55975e156200 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efdeffff640 1 -- 172.21.15.172:0/1667771843 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efe0c048af0 con 0x55975e156200 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efe1a3ad740 10 client.8847 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efe1a3ad740 10 client.8847 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efe1a3ad740 20 client.8847 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55975e19f8d0 0x55975e17d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efe1a3ad740 4 client.8847 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1667771843 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55975e0c7540 con 0x55975e19f8d0 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.868+0000 7efe14c47640 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55975e19f8d0 0x55975e17d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efdeffff640 10 client.8847 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe14c47640 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55975e19f8d0 0x55975e17d480 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2898c001e69d009 server_cookie=f7b77995fe44b797 in_seq=0 out_seq=0 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efdeffff640 1 -- 172.21.15.172:0/1667771843 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55975e0c7540 con 0x55975e19f8d0 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efdeffff640 10 client.8847 handle_command_reply: tid=0 2024-04-25T08:50:22.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 client.8847 shutdown 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1667771843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 msgr2=0x55975e182200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e182200 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7efe0c04b040 tx=0x7efe0c004730 comp rx=0 tx=0).stop 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1667771843 shutdown_connections 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55975e19f8d0 0x55975e17d480 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e1928d0 0x55975e17cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 0x55975e1af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efdeffff640 0 client.8847 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/1667771843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e182200 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1667771843 >> 172.21.15.172:0/1667771843 conn(0x55975e11e050 msgr2=0x55975e17e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1667771843 shutdown_connections 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.869+0000 7efe1a3ad740 1 -- 172.21.15.172:0/1667771843 wait complete. 2024-04-25T08:50:22.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.870+0000 7efe1a3ad740 20 client.8847 trim_cache size 0 max 16384 2024-04-25T08:50:22.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.884+0000 7efe1a3ad740 1 Processor -- start 2024-04-25T08:50:22.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.884+0000 7efe1a3ad740 1 -- start start 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e11e050 0x55975e1bdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e156200 0x55975e182f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 0x55975e150070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe102004f0 con 0x55975e11e050 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe101ff700 con 0x55975e156200 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe100b14c0 con 0x55975e180cc0 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe15448640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e11e050 0x55975e1bdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe15448640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e11e050 0x55975e1bdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53866/0 (socket says 172.21.15.172:53866) 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe15448640 1 -- 172.21.15.172:0/3148556401 learned_addr learned my addr 172.21.15.172:0/3148556401 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe14c47640 1 --2- 172.21.15.172:0/3148556401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e156200 0x55975e182f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe15c49640 1 --2- 172.21.15.172:0/3148556401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 0x55975e150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe15448640 1 -- 172.21.15.172:0/3148556401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 msgr2=0x55975e150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe15448640 1 --2- 172.21.15.172:0/3148556401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 0x55975e150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe15448640 1 -- 172.21.15.172:0/3148556401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e156200 msgr2=0x55975e182f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.885+0000 7efe15448640 1 --2- 172.21.15.172:0/3148556401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e156200 0x55975e182f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe15448640 1 -- 172.21.15.172:0/3148556401 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55975dd67610 con 0x55975e11e050 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe15448640 1 --2- 172.21.15.172:0/3148556401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e11e050 0x55975e1bdfe0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0325d0 tx=0x7efe0c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4ae859588eacac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efdfa7fc640 1 -- 172.21.15.172:0/3148556401 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0044e0 con 0x55975e11e050 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efdfa7fc640 1 -- 172.21.15.172:0/3148556401 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c048470 con 0x55975e11e050 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efdfa7fc640 1 -- 172.21.15.172:0/3148556401 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c048b30 con 0x55975e11e050 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3148556401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e11e050 msgr2=0x55975e1bdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/3148556401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e11e050 0x55975e1bdfe0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0325d0 tx=0x7efe0c041000 comp rx=0 tx=0).stop 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3148556401 shutdown_connections 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/3148556401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e156200 0x55975e182f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/3148556401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e180cc0 0x55975e150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/3148556401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e11e050 0x55975e1bdfe0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3148556401 >> 172.21.15.172:0/3148556401 conn(0x55975e151080 msgr2=0x55975e19e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3148556401 shutdown_connections 2024-04-25T08:50:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.886+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3148556401 wait complete. 2024-04-25T08:50:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.887+0000 7efe1a3ad740 1 -- start start 2024-04-25T08:50:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.887+0000 7efe1a3ad740 1 Processor -- start 2024-04-25T08:50:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e11e050 0x55975e1ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e19deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe1a3ad740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 0x55975e17b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe101ff1d0 con 0x55975e156200 2024-04-25T08:50:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55975e1529f0 con 0x55975e180cc0 2024-04-25T08:50:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe1a3ad740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55975e1ab110 con 0x55975e11e050 2024-04-25T08:50:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe1a3ad740 10 client.0 _ll_register_callbacks cb 0x7efe0c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe14c47640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e19deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe14c47640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e19deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53868/0 (socket says 172.21.15.172:53868) 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe14c47640 1 -- 172.21.15.172:0/3289166705 learned_addr learned my addr 172.21.15.172:0/3289166705 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe15448640 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e11e050 0x55975e1ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe15c49640 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 0x55975e17b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe14c47640 1 -- 172.21.15.172:0/3289166705 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e11e050 msgr2=0x55975e1ffab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe14c47640 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e11e050 0x55975e1ffab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe14c47640 1 -- 172.21.15.172:0/3289166705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 msgr2=0x55975e17b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe14c47640 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 0x55975e17b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe14c47640 1 -- 172.21.15.172:0/3289166705 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55975e192700 con 0x55975e156200 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efe14c47640 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e19deb0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7efe0000cd80 tx=0x7efe0005e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b68277938510093 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.888+0000 7efdeffff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efdeffff640 1 -- 172.21.15.172:0/3289166705 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe000570d0 con 0x55975e156200 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efdeffff640 1 -- 172.21.15.172:0/3289166705 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efe00057270 con 0x55975e156200 2024-04-25T08:50:22.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3289166705 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe0c048470 con 0x55975e156200 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efdeffff640 1 -- 172.21.15.172:0/3289166705 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe000539d0 con 0x55975e156200 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe1a3ad740 10 client.8853 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3289166705 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55975e2001c0 con 0x55975e156200 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efdeffff640 1 -- 172.21.15.172:0/3289166705 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c048470 con 0x55975e156200 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efdeffff640 1 -- 172.21.15.172:0/3289166705 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efe00053b70 con 0x55975e156200 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe1a3ad740 10 client.8853 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe1a3ad740 10 client.8853 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe1a3ad740 20 client.8853 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55975e1928d0 0x55975e17be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe1a3ad740 4 client.8853 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3289166705 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x55975e17e1f0 con 0x55975e1928d0 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe15448640 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55975e1928d0 0x55975e17be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efdeffff640 10 client.8853 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:22.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.889+0000 7efe15448640 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55975e1928d0 0x55975e17be60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f60a0192bdb67c01 server_cookie=399020d66477ffd9 in_seq=0 out_seq=0 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efdeffff640 1 -- 172.21.15.172:0/3289166705 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55975e17e1f0 con 0x55975e1928d0 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efdeffff640 10 client.8853 handle_command_reply: tid=0 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 client.8853 shutdown 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3289166705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 msgr2=0x55975e19deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e19deb0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7efe0000cd80 tx=0x7efe0005e040 comp rx=0 tx=0).stop 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3289166705 shutdown_connections 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55975e1928d0 0x55975e17be60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55975e180cc0 0x55975e17b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efdeffff640 0 client.8853 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55975e156200 0x55975e19deb0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 --2- 172.21.15.172:0/3289166705 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55975e11e050 0x55975e1ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3289166705 >> 172.21.15.172:0/3289166705 conn(0x55975e151080 msgr2=0x55975e150070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:22.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3289166705 shutdown_connections 2024-04-25T08:50:22.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 1 -- 172.21.15.172:0/3289166705 wait complete. 2024-04-25T08:50:22.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.893+0000 7efe1a3ad740 20 client.8853 trim_cache size 0 max 16384 2024-04-25T08:50:22.888 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:50:22.888 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:50:22.888 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "a6f726d9-f202-4e54-a491-eabd747ce1b8", 2024-04-25T08:50:22.888 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:50:22.888 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:50:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 -- 172.21.15.172:0/1119455537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efdf406b4d0 msgr2=0x7efdf406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efdf406b4d0 0x7efdf406d990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7efe0c034000 tx=0x7efe0c02e000 comp rx=0 tx=0).stop 2024-04-25T08:50:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 -- 172.21.15.172:0/1119455537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe100ad570 msgr2=0x7efe101550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe100ad570 0x7efe101550e0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7efe0000c3c0 tx=0x7efe0000c880 comp rx=0 tx=0).stop 2024-04-25T08:50:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 -- 172.21.15.172:0/1119455537 shutdown_connections 2024-04-25T08:50:22.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efdf406b4d0 0x7efdf406d990 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe1015dd80 0x7efe1015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe100ad570 0x7efe101550e0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 --2- 172.21.15.172:0/1119455537 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efe1006abe0 0x7efe101453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 -- 172.21.15.172:0/1119455537 >> 172.21.15.172:0/1119455537 conn(0x7efe100b5af0 msgr2=0x7efe100ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 -- 172.21.15.172:0/1119455537 shutdown_connections 2024-04-25T08:50:22.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:22.894+0000 7efe176ac640 1 -- 172.21.15.172:0/1119455537 wait complete. 2024-04-25T08:50:22.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:22.896 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub pause 2024-04-25T08:50:23.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.022+0000 7f814069e640 1 Processor -- start 2024-04-25T08:50:23.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.022+0000 7f814069e640 1 -- start start 2024-04-25T08:50:23.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f814069e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 0x7f81380ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f814069e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8138161710 0x7f81380cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f814069e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813815e000 con 0x7f81380b9330 2024-04-25T08:50:23.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f814069e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81380d1de0 con 0x7f8138161710 2024-04-25T08:50:23.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f814069e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8138161c60 con 0x7f813815dc20 2024-04-25T08:50:23.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f813dc39640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8138161710 0x7f81380cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f813e43a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 0x7f81380ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f813ec3b640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f81380b9330 0x7f813806bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:45028/0 (socket says 172.21.15.172:45028) 2024-04-25T08:50:23.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f813ec3b640 1 -- 172.21.15.172:0/1384985264 learned_addr learned my addr 172.21.15.172:0/1384985264 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:23.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f813dc39640 1 -- 172.21.15.172:0/1384985264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 msgr2=0x7f81380ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f813dc39640 1 --2- 172.21.15.172:0/1384985264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 0x7f81380ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f813dc39640 1 -- 172.21.15.172:0/1384985264 >> v1:172.21.15.186:6789/0 conn(0x7f81380b9330 legacy=0x7f813806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f813dc39640 1 -- 172.21.15.172:0/1384985264 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8138161f40 con 0x7f8138161710 2024-04-25T08:50:23.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.024+0000 7f813e43a640 1 --2- 172.21.15.172:0/1384985264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 0x7f81380ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:23.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.025+0000 7f813dc39640 1 --2- 172.21.15.172:0/1384985264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8138161710 0x7f81380cebb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f81280097a0 tx=0x7f812802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abbaf028ccf0e28c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.025+0000 7f813d438640 1 -- 172.21.15.172:0/1384985264 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128037070 con 0x7f8138161710 2024-04-25T08:50:23.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.025+0000 7f813d438640 1 -- 172.21.15.172:0/1384985264 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128032440 con 0x7f8138161710 2024-04-25T08:50:23.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.025+0000 7f813d438640 1 -- 172.21.15.172:0/1384985264 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128032810 con 0x7f8138161710 2024-04-25T08:50:23.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.026+0000 7f814069e640 1 -- 172.21.15.172:0/1384985264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8138161710 msgr2=0x7f81380cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.026+0000 7f814069e640 1 --2- 172.21.15.172:0/1384985264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8138161710 0x7f81380cebb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f81280097a0 tx=0x7f812802a180 comp rx=0 tx=0).stop 2024-04-25T08:50:23.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.026+0000 7f814069e640 1 -- 172.21.15.172:0/1384985264 shutdown_connections 2024-04-25T08:50:23.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.026+0000 7f814069e640 1 --2- 172.21.15.172:0/1384985264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8138161710 0x7f81380cebb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.026+0000 7f814069e640 1 --2- 172.21.15.172:0/1384985264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 0x7f81380ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.026+0000 7f814069e640 1 -- 172.21.15.172:0/1384985264 >> 172.21.15.172:0/1384985264 conn(0x7f81380d0420 msgr2=0x7f81380d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.026+0000 7f814069e640 1 -- 172.21.15.172:0/1384985264 shutdown_connections 2024-04-25T08:50:23.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.026+0000 7f814069e640 1 -- 172.21.15.172:0/1384985264 wait complete. 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.027+0000 7f814069e640 1 Processor -- start 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.027+0000 7f814069e640 1 -- start start 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f814069e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81380b9330 0x7f81380aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f814069e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 0x7f81380acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f814069e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8138161710 0x7f813814eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f814069e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81380b5e50 con 0x7f8138161710 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f814069e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8138162500 con 0x7f81380b9330 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f814069e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81380b5fd0 con 0x7f813815dc20 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f813ec3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8138161710 0x7f813814eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f813ec3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8138161710 0x7f813814eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53880/0 (socket says 172.21.15.172:53880) 2024-04-25T08:50:23.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f813ec3b640 1 -- 172.21.15.172:0/209174055 learned_addr learned my addr 172.21.15.172:0/209174055 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f813e43a640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81380b9330 0x7f81380aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.028+0000 7f813dc39640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 0x7f81380acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f813ec3b640 1 -- 172.21.15.172:0/209174055 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 msgr2=0x7f81380acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f813ec3b640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 0x7f81380acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f813ec3b640 1 -- 172.21.15.172:0/209174055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81380b9330 msgr2=0x7f81380aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f813ec3b640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81380b9330 0x7f81380aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f813ec3b640 1 -- 172.21.15.172:0/209174055 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81380ccf90 con 0x7f8138161710 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f813e43a640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81380b9330 0x7f81380aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f813dc39640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 0x7f81380acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f813ec3b640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8138161710 0x7f813814eae0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f813000caa0 tx=0x7f813000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f812effd640 1 -- 172.21.15.172:0/209174055 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130017070 con 0x7f8138161710 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f812effd640 1 -- 172.21.15.172:0/209174055 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813000aae0 con 0x7f8138161710 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f814069e640 1 -- 172.21.15.172:0/209174055 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81380cd270 con 0x7f8138161710 2024-04-25T08:50:23.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f812effd640 1 -- 172.21.15.172:0/209174055 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130012400 con 0x7f8138161710 2024-04-25T08:50:23.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.029+0000 7f814069e640 1 -- 172.21.15.172:0/209174055 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813815d220 con 0x7f8138161710 2024-04-25T08:50:23.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.031+0000 7f812effd640 1 -- 172.21.15.172:0/209174055 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f813001a070 con 0x7f8138161710 2024-04-25T08:50:23.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.032+0000 7f812effd640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f811c06b4d0 0x7f811c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.032+0000 7f812effd640 1 -- 172.21.15.172:0/209174055 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8130089f60 con 0x7f8138161710 2024-04-25T08:50:23.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.032+0000 7f813e43a640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f811c06b4d0 0x7f811c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.032+0000 7f81433a7740 1 Processor -- start 2024-04-25T08:50:23.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.032+0000 7f81433a7740 1 -- start start 2024-04-25T08:50:23.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.032+0000 7f813e43a640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f811c06b4d0 0x7f811c06d990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8134009560 tx=0x7f8134009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f81433a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d608e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f81433a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d607080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f81433a7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d631760 0x55802d631be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f81433a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802d569b90 con 0x55802d643370 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f81433a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802d512e40 con 0x55802d606ca0 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f81433a7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55802d565c30 con 0x55802d631760 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f813dc39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d607080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f813dc39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d607080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53884/0 (socket says 172.21.15.172:53884) 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f813dc39640 1 -- 172.21.15.172:0/394709879 learned_addr learned my addr 172.21.15.172:0/394709879 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f813e43a640 1 --2- 172.21.15.172:0/394709879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d608e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.033+0000 7f813ec3b640 1 --2- 172.21.15.172:0/394709879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d631760 0x55802d631be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.034+0000 7f813dc39640 1 -- 172.21.15.172:0/394709879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d631760 msgr2=0x55802d631be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.034+0000 7f813dc39640 1 --2- 172.21.15.172:0/394709879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d631760 0x55802d631be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.034+0000 7f813dc39640 1 -- 172.21.15.172:0/394709879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 msgr2=0x55802d608e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.034+0000 7f813dc39640 1 --2- 172.21.15.172:0/394709879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d608e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.034+0000 7f813dc39640 1 -- 172.21.15.172:0/394709879 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55802d3487d0 con 0x55802d643370 2024-04-25T08:50:23.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.034+0000 7f813dc39640 1 --2- 172.21.15.172:0/394709879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d607080 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f8128000c00 tx=0x7f812802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c289db98c753b4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.034+0000 7f811bfff640 1 -- 172.21.15.172:0/394709879 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128037040 con 0x55802d643370 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.034+0000 7f811bfff640 1 -- 172.21.15.172:0/394709879 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128032ba0 con 0x55802d643370 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.034+0000 7f811bfff640 1 -- 172.21.15.172:0/394709879 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812803c440 con 0x55802d643370 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.035+0000 7f81433a7740 1 -- 172.21.15.172:0/394709879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 msgr2=0x55802d607080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.035+0000 7f81433a7740 1 --2- 172.21.15.172:0/394709879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d607080 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f8128000c00 tx=0x7f812802c000 comp rx=0 tx=0).stop 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.035+0000 7f81433a7740 1 -- 172.21.15.172:0/394709879 shutdown_connections 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.035+0000 7f81433a7740 1 --2- 172.21.15.172:0/394709879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d631760 0x55802d631be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.035+0000 7f81433a7740 1 --2- 172.21.15.172:0/394709879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d607080 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.035+0000 7f81433a7740 1 --2- 172.21.15.172:0/394709879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d608e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.035+0000 7f81433a7740 1 -- 172.21.15.172:0/394709879 >> 172.21.15.172:0/394709879 conn(0x55802d5ce870 msgr2=0x55802d64c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.035+0000 7f81433a7740 1 -- 172.21.15.172:0/394709879 shutdown_connections 2024-04-25T08:50:23.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.035+0000 7f81433a7740 1 -- 172.21.15.172:0/394709879 wait complete. 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.036+0000 7f81433a7740 1 -- start start 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.036+0000 7f81433a7740 1 Processor -- start 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.037+0000 7f81433a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d606ca0 0x55802d6230b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f81433a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d631760 0x55802d632120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f81433a7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d643370 0x55802d632660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f81433a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802d5263e0 con 0x55802d606ca0 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f81433a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802d62f2b0 con 0x55802d631760 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f81433a7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55802d65d6e0 con 0x55802d643370 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813e43a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d606ca0 0x55802d6230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813e43a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d606ca0 0x55802d6230b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53898/0 (socket says 172.21.15.172:53898) 2024-04-25T08:50:23.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813e43a640 1 -- 172.21.15.172:0/1062810458 learned_addr learned my addr 172.21.15.172:0/1062810458 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f81433a7740 10 client.0 _ll_register_callbacks cb 0x55802d525db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813dc39640 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d631760 0x55802d632120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813ec3b640 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d643370 0x55802d632660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813e43a640 1 -- 172.21.15.172:0/1062810458 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d643370 msgr2=0x55802d632660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813e43a640 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d643370 0x55802d632660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813e43a640 1 -- 172.21.15.172:0/1062810458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d631760 msgr2=0x55802d632120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813e43a640 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d631760 0x55802d632120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813e43a640 1 -- 172.21.15.172:0/1062810458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55802d23e0f0 con 0x55802d606ca0 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813dc39640 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d631760 0x55802d632120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f813e43a640 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d606ca0 0x55802d6230b0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8134003bc0 tx=0x7f81340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5cd69940aa15c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f81197fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f81197fa640 1 -- 172.21.15.172:0/1062810458 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134027070 con 0x55802d606ca0 2024-04-25T08:50:23.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f81197fa640 1 -- 172.21.15.172:0/1062810458 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f81340149c0 con 0x55802d606ca0 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.038+0000 7f81433a7740 1 -- 172.21.15.172:0/1062810458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8128032ba0 con 0x55802d606ca0 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81197fa640 1 -- 172.21.15.172:0/1062810458 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8134014bc0 con 0x55802d606ca0 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81433a7740 10 client.8862 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81433a7740 1 -- 172.21.15.172:0/1062810458 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55802d3a8f60 con 0x55802d606ca0 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81197fa640 1 -- 172.21.15.172:0/1062810458 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128032ba0 con 0x55802d606ca0 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81197fa640 1 -- 172.21.15.172:0/1062810458 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8134035080 con 0x55802d606ca0 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81433a7740 10 client.8862 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81433a7740 10 client.8862 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81433a7740 20 client.8862 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81433a7740 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55802d645670 0x55802d65c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81433a7740 4 client.8862 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81433a7740 1 -- 172.21.15.172:0/1062810458 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55802d5770d0 con 0x55802d645670 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f813dc39640 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55802d645670 0x55802d65c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.039+0000 7f81197fa640 10 client.8862 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:23.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.040+0000 7f813dc39640 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55802d645670 0x55802d65c950 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb85aec2bd156cf9 server_cookie=16c7d316d6c822ab in_seq=0 out_seq=0 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.040+0000 7f81197fa640 1 -- 172.21.15.172:0/1062810458 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55802d5770d0 con 0x55802d645670 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.040+0000 7f81197fa640 10 client.8862 handle_command_reply: tid=0 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.040+0000 7f81433a7740 1 client.8862 shutdown 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.040+0000 7f81433a7740 1 -- 172.21.15.172:0/1062810458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d606ca0 msgr2=0x55802d6230b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.040+0000 7f81433a7740 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d606ca0 0x55802d6230b0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8134003bc0 tx=0x7f81340046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.041+0000 7f81433a7740 1 -- 172.21.15.172:0/1062810458 shutdown_connections 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.041+0000 7f81433a7740 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55802d645670 0x55802d65c950 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.041+0000 7f81433a7740 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d631760 0x55802d632120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.041+0000 7f81433a7740 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d643370 0x55802d632660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.041+0000 7f81197fa640 0 client.8862 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.041+0000 7f81433a7740 1 --2- 172.21.15.172:0/1062810458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d606ca0 0x55802d6230b0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.041+0000 7f81433a7740 1 -- 172.21.15.172:0/1062810458 >> 172.21.15.172:0/1062810458 conn(0x55802d5ce870 msgr2=0x55802d62f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.041+0000 7f81433a7740 1 -- 172.21.15.172:0/1062810458 shutdown_connections 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.041+0000 7f81433a7740 1 -- 172.21.15.172:0/1062810458 wait complete. 2024-04-25T08:50:23.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.041+0000 7f81433a7740 20 client.8862 trim_cache size 0 max 16384 2024-04-25T08:50:23.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.055+0000 7f81433a7740 1 Processor -- start 2024-04-25T08:50:23.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.055+0000 7f81433a7740 1 -- start start 2024-04-25T08:50:23.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f81433a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d5fd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f81433a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d631760 0x55802d643940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f81433a7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d643370 0x55802d6658b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f81433a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8138200670 con 0x55802d631760 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f81433a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81381ff800 con 0x55802d606ca0 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f81433a7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813814e480 con 0x55802d643370 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f813dc39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d631760 0x55802d643940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f813dc39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d631760 0x55802d643940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53900/0 (socket says 172.21.15.172:53900) 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f813dc39640 1 -- 172.21.15.172:0/2084919553 learned_addr learned my addr 172.21.15.172:0/2084919553 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f813e43a640 1 --2- 172.21.15.172:0/2084919553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d5fd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.056+0000 7f813ec3b640 1 --2- 172.21.15.172:0/2084919553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d643370 0x55802d6658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.057+0000 7f813dc39640 1 -- 172.21.15.172:0/2084919553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d643370 msgr2=0x55802d6658b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.057+0000 7f813dc39640 1 --2- 172.21.15.172:0/2084919553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d643370 0x55802d6658b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.057+0000 7f813dc39640 1 -- 172.21.15.172:0/2084919553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 msgr2=0x55802d5fd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.057+0000 7f813dc39640 1 --2- 172.21.15.172:0/2084919553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d5fd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.057+0000 7f813dc39640 1 -- 172.21.15.172:0/2084919553 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55802d2171b0 con 0x55802d631760 2024-04-25T08:50:23.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.057+0000 7f813dc39640 1 --2- 172.21.15.172:0/2084919553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d631760 0x55802d643940 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f812802a1c0 tx=0x7f8128008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e839338465f2ad8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.057+0000 7f811b7fe640 1 -- 172.21.15.172:0/2084919553 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128037040 con 0x55802d631760 2024-04-25T08:50:23.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.057+0000 7f811b7fe640 1 -- 172.21.15.172:0/2084919553 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812804dd00 con 0x55802d631760 2024-04-25T08:50:23.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.057+0000 7f811b7fe640 1 -- 172.21.15.172:0/2084919553 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81280042c0 con 0x55802d631760 2024-04-25T08:50:23.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.058+0000 7f81433a7740 1 -- 172.21.15.172:0/2084919553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d631760 msgr2=0x55802d643940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.058+0000 7f81433a7740 1 --2- 172.21.15.172:0/2084919553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d631760 0x55802d643940 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f812802a1c0 tx=0x7f8128008030 comp rx=0 tx=0).stop 2024-04-25T08:50:23.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.058+0000 7f81433a7740 1 -- 172.21.15.172:0/2084919553 shutdown_connections 2024-04-25T08:50:23.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.058+0000 7f81433a7740 1 --2- 172.21.15.172:0/2084919553 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d643370 0x55802d6658b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.058+0000 7f81433a7740 1 --2- 172.21.15.172:0/2084919553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d631760 0x55802d643940 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.058+0000 7f81433a7740 1 --2- 172.21.15.172:0/2084919553 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d5fd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.058+0000 7f81433a7740 1 -- 172.21.15.172:0/2084919553 >> 172.21.15.172:0/2084919553 conn(0x55802d5ce870 msgr2=0x55802d66df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.058+0000 7f81433a7740 1 -- 172.21.15.172:0/2084919553 shutdown_connections 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.058+0000 7f81433a7740 1 -- 172.21.15.172:0/2084919553 wait complete. 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.059+0000 7f81433a7740 1 -- start start 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.059+0000 7f81433a7740 1 Processor -- start 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f81433a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d6215f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f81433a7740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d631760 0x55802d621b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f81433a7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d62e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f81433a7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802d56c0a0 con 0x55802d643370 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f81433a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81381ff200 con 0x55802d606ca0 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f81433a7740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55802d646cc0 con 0x55802d631760 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f81433a7740 10 client.0 _ll_register_callbacks cb 0x7f8134011eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f813ec3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d62e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f813e43a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d6215f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f813ec3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d62e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53904/0 (socket says 172.21.15.172:53904) 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.060+0000 7f813ec3b640 1 -- 172.21.15.172:0/84259607 learned_addr learned my addr 172.21.15.172:0/84259607 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f813dc39640 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d631760 0x55802d621b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f813ec3b640 1 -- 172.21.15.172:0/84259607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d631760 msgr2=0x55802d621b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f813ec3b640 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d631760 0x55802d621b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f813ec3b640 1 -- 172.21.15.172:0/84259607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 msgr2=0x55802d6215f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f813ec3b640 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d6215f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f813ec3b640 1 -- 172.21.15.172:0/84259607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55802d65acf0 con 0x55802d643370 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f813ec3b640 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d62e830 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f81300549d0 tx=0x7f81300586d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f098e363caec2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f81197fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f81197fa640 1 -- 172.21.15.172:0/84259607 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300609d0 con 0x55802d643370 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f81197fa640 1 -- 172.21.15.172:0/84259607 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f81300579c0 con 0x55802d643370 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f81433a7740 1 -- 172.21.15.172:0/84259607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f812804dd00 con 0x55802d643370 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f81197fa640 1 -- 172.21.15.172:0/84259607 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81300770d0 con 0x55802d643370 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f81433a7740 10 client.8868 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f81433a7740 1 -- 172.21.15.172:0/84259607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55802d62dff0 con 0x55802d643370 2024-04-25T08:50:23.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.061+0000 7f81197fa640 1 -- 172.21.15.172:0/84259607 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812804dd00 con 0x55802d643370 2024-04-25T08:50:23.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.062+0000 7f81197fa640 1 -- 172.21.15.172:0/84259607 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f813005c0c0 con 0x55802d643370 2024-04-25T08:50:23.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.062+0000 7f81433a7740 10 client.8868 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:23.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.062+0000 7f81433a7740 10 client.8868 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:23.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.062+0000 7f81433a7740 20 client.8868 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:23.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.062+0000 7f81433a7740 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55802d631290 0x55802d62ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.062+0000 7f81433a7740 4 client.8868 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-04-25T08:50:23.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.062+0000 7f81433a7740 1 -- 172.21.15.172:0/84259607 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x55802d571420 con 0x55802d631290 2024-04-25T08:50:23.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.062+0000 7f813e43a640 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55802d631290 0x55802d62ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.062+0000 7f81197fa640 10 client.8868 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:23.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.062+0000 7f813e43a640 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55802d631290 0x55802d62ed70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b85a67f20d55ac3e server_cookie=d838c7a98e98e1c6 in_seq=0 out_seq=0 2024-04-25T08:50:23.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81197fa640 1 -- 172.21.15.172:0/84259607 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55802d571420 con 0x55802d631290 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81197fa640 10 client.8868 handle_command_reply: tid=0 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 client.8868 shutdown 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 -- 172.21.15.172:0/84259607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 msgr2=0x55802d62e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d62e830 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f81300549d0 tx=0x7f81300586d0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 -- 172.21.15.172:0/84259607 shutdown_connections 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55802d631290 0x55802d62ed70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802d643370 0x55802d62e830 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81197fa640 0 client.8868 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55802d631760 0x55802d621b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 --2- 172.21.15.172:0/84259607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55802d606ca0 0x55802d6215f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 -- 172.21.15.172:0/84259607 >> 172.21.15.172:0/84259607 conn(0x55802d5ce870 msgr2=0x55802d643940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 -- 172.21.15.172:0/84259607 shutdown_connections 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 1 -- 172.21.15.172:0/84259607 wait complete. 2024-04-25T08:50:23.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.116+0000 7f81433a7740 20 client.8868 trim_cache size 0 max 16384 2024-04-25T08:50:23.109 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:50:23.109 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0 2024-04-25T08:50:23.109 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:50:23.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 -- 172.21.15.172:0/209174055 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f811c06b4d0 msgr2=0x7f811c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f811c06b4d0 0x7f811c06d990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8134009560 tx=0x7f8134009190 comp rx=0 tx=0).stop 2024-04-25T08:50:23.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 -- 172.21.15.172:0/209174055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8138161710 msgr2=0x7f813814eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8138161710 0x7f813814eae0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f813000caa0 tx=0x7f813000cf60 comp rx=0 tx=0).stop 2024-04-25T08:50:23.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 -- 172.21.15.172:0/209174055 shutdown_connections 2024-04-25T08:50:23.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f811c06b4d0 0x7f811c06d990 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8138161710 0x7f813814eae0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f813815dc20 0x7f81380acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 --2- 172.21.15.172:0/209174055 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f81380b9330 0x7f81380aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 -- 172.21.15.172:0/209174055 >> 172.21.15.172:0/209174055 conn(0x7f81380d0420 msgr2=0x7f81380d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 -- 172.21.15.172:0/209174055 shutdown_connections 2024-04-25T08:50:23.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.117+0000 7f814069e640 1 -- 172.21.15.172:0/209174055 wait complete. 2024-04-25T08:50:23.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:23.119 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub status 2024-04-25T08:50:23.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.227+0000 7f83d24ee640 1 Processor -- start 2024-04-25T08:50:23.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.227+0000 7f83d24ee640 1 -- start start 2024-04-25T08:50:23.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d24ee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83cc0cc4f0 0x7f83cc0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d24ee640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f83cc0cdb20 0x7f83cc0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d24ee640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83cc15b270 0x7f83cc15b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d24ee640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc0ce4c0 con 0x7f83cc15b270 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d24ee640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc071270 con 0x7f83cc0cdb20 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d24ee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc072280 con 0x7f83cc0cc4f0 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d0a8b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83cc15b270 0x7f83cc15b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d0a8b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83cc15b270 0x7f83cc15b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53908/0 (socket says 172.21.15.172:53908) 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d0a8b640 1 -- 172.21.15.172:0/2500916092 learned_addr learned my addr 172.21.15.172:0/2500916092 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83cbfff640 1 --2- 172.21.15.172:0/2500916092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83cc0cc4f0 0x7f83cc0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83cb7fe640 1 --2- 172.21.15.172:0/2500916092 >> v2:172.21.15.186:3300/0 conn(0x7f83cc0cdb20 0x7f83cc0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d0a8b640 1 -- 172.21.15.172:0/2500916092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83cc0cc4f0 msgr2=0x7f83cc0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/2500916092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83cc0cc4f0 0x7f83cc0cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d0a8b640 1 -- 172.21.15.172:0/2500916092 >> v2:172.21.15.186:3300/0 conn(0x7f83cc0cdb20 msgr2=0x7f83cc0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/2500916092 >> v2:172.21.15.186:3300/0 conn(0x7f83cc0cdb20 0x7f83cc0cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.228+0000 7f83d0a8b640 1 -- 172.21.15.172:0/2500916092 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc0714c0 con 0x7f83cc15b270 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.229+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/2500916092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 0x7f83cc15b680 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f83cc06b960 tx=0x7f83c402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78be08b42565292 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.229+0000 7f83caffd640 1 -- 172.21.15.172:0/2500916092 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4036070 con 0x7f83cc15b270 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.229+0000 7f83caffd640 1 -- 172.21.15.172:0/2500916092 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4031600 con 0x7f83cc15b270 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.229+0000 7f83caffd640 1 -- 172.21.15.172:0/2500916092 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c40319d0 con 0x7f83cc15b270 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.230+0000 7f83d24ee640 1 -- 172.21.15.172:0/2500916092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 msgr2=0x7f83cc15b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.230+0000 7f83d24ee640 1 --2- 172.21.15.172:0/2500916092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 0x7f83cc15b680 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f83cc06b960 tx=0x7f83c402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.230+0000 7f83d24ee640 1 -- 172.21.15.172:0/2500916092 shutdown_connections 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.230+0000 7f83d24ee640 1 --2- 172.21.15.172:0/2500916092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 0x7f83cc15b680 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.230+0000 7f83d24ee640 1 --2- 172.21.15.172:0/2500916092 >> v2:172.21.15.186:3300/0 conn(0x7f83cc0cdb20 0x7f83cc0cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.230+0000 7f83d24ee640 1 --2- 172.21.15.172:0/2500916092 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83cc0cc4f0 0x7f83cc0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.230+0000 7f83d24ee640 1 -- 172.21.15.172:0/2500916092 >> 172.21.15.172:0/2500916092 conn(0x7f83cc06abe0 msgr2=0x7f83cc06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.230+0000 7f83d24ee640 1 -- 172.21.15.172:0/2500916092 shutdown_connections 2024-04-25T08:50:23.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.230+0000 7f83d24ee640 1 -- 172.21.15.172:0/2500916092 wait complete. 2024-04-25T08:50:23.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.231+0000 7f83d24ee640 1 Processor -- start 2024-04-25T08:50:23.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.231+0000 7f83d24ee640 1 -- start start 2024-04-25T08:50:23.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d24ee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83cc0cc4f0 0x7f83cc1f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d24ee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83cc0cdb20 0x7f83cc13e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d24ee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 0x7f83cc13eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d24ee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc071d60 con 0x7f83cc15b270 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d24ee640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc071a80 con 0x7f83cc0cc4f0 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d24ee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc15bbc0 con 0x7f83cc0cdb20 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d0a8b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 0x7f83cc13eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d0a8b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 0x7f83cc13eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53922/0 (socket says 172.21.15.172:53922) 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d0a8b640 1 -- 172.21.15.172:0/358081771 learned_addr learned my addr 172.21.15.172:0/358081771 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83cbfff640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83cc0cc4f0 0x7f83cc1f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83cb7fe640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83cc0cdb20 0x7f83cc13e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d0a8b640 1 -- 172.21.15.172:0/358081771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83cc0cdb20 msgr2=0x7f83cc13e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83cc0cdb20 0x7f83cc13e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d0a8b640 1 -- 172.21.15.172:0/358081771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83cc0cc4f0 msgr2=0x7f83cc1f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83cc0cc4f0 0x7f83cc1f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d0a8b640 1 -- 172.21.15.172:0/358081771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc154d80 con 0x7f83cc15b270 2024-04-25T08:50:23.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.232+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 0x7f83cc13eef0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009f40 tx=0x7f83c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.233+0000 7f83c8ff9640 1 -- 172.21.15.172:0/358081771 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4036050 con 0x7f83cc15b270 2024-04-25T08:50:23.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.233+0000 7f83c8ff9640 1 -- 172.21.15.172:0/358081771 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4042070 con 0x7f83cc15b270 2024-04-25T08:50:23.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.233+0000 7f83d24ee640 1 -- 172.21.15.172:0/358081771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83cc13c920 con 0x7f83cc15b270 2024-04-25T08:50:23.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.233+0000 7f83c8ff9640 1 -- 172.21.15.172:0/358081771 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4009510 con 0x7f83cc15b270 2024-04-25T08:50:23.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.233+0000 7f83d24ee640 1 -- 172.21.15.172:0/358081771 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc13cee0 con 0x7f83cc15b270 2024-04-25T08:50:23.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.235+0000 7f83c8ff9640 1 -- 172.21.15.172:0/358081771 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f83c4007c70 con 0x7f83cc15b270 2024-04-25T08:50:23.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.235+0000 7f83c8ff9640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f83b806b4d0 0x7f83b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.235+0000 7f83c8ff9640 1 -- 172.21.15.172:0/358081771 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f83c40aafe0 con 0x7f83cc15b270 2024-04-25T08:50:23.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.235+0000 7f83cbfff640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f83b806b4d0 0x7f83b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.235+0000 7f83cbfff640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f83b806b4d0 0x7f83b806d990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009a20 tx=0x7f83bc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83d51ef740 1 Processor -- start 2024-04-25T08:50:23.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83d51ef740 1 -- start start 2024-04-25T08:50:23.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 0x55d8aa3ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.233 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3be770 0x55d8aa3c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 0x55d8aa40a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83d51ef740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8aa327da0 con 0x55d8aa3be770 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83d51ef740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8aa2d0b80 con 0x55d8aa40a470 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83d51ef740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8aa323e40 con 0x55d8aa3ee510 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83cb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3be770 0x55d8aa3c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83cb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3be770 0x55d8aa3c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53926/0 (socket says 172.21.15.172:53926) 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.236+0000 7f83cb7fe640 1 -- 172.21.15.172:0/3723832484 learned_addr learned my addr 172.21.15.172:0/3723832484 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/3723832484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 0x55d8aa40a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83cbfff640 1 --2- 172.21.15.172:0/3723832484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 0x55d8aa3ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83cb7fe640 1 -- 172.21.15.172:0/3723832484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 msgr2=0x55d8aa3ee8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83cb7fe640 1 --2- 172.21.15.172:0/3723832484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 0x55d8aa3ee8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83cb7fe640 1 -- 172.21.15.172:0/3723832484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 msgr2=0x55d8aa40a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83cb7fe640 1 --2- 172.21.15.172:0/3723832484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 0x55d8aa40a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83cb7fe640 1 -- 172.21.15.172:0/3723832484 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8aa2daf10 con 0x55d8aa3be770 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83cb7fe640 1 --2- 172.21.15.172:0/3723832484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3be770 0x55d8aa3c47a0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009b90 tx=0x7f83c0011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e3d9ef4462e1bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83b1ffb640 1 -- 172.21.15.172:0/3723832484 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0019070 con 0x55d8aa3be770 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83b1ffb640 1 -- 172.21.15.172:0/3723832484 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0004030 con 0x55d8aa3be770 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.237+0000 7f83b1ffb640 1 -- 172.21.15.172:0/3723832484 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c00043e0 con 0x55d8aa3be770 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 -- 172.21.15.172:0/3723832484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3be770 msgr2=0x55d8aa3c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 --2- 172.21.15.172:0/3723832484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3be770 0x55d8aa3c47a0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009b90 tx=0x7f83c0011690 comp rx=0 tx=0).stop 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 -- 172.21.15.172:0/3723832484 shutdown_connections 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 --2- 172.21.15.172:0/3723832484 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 0x55d8aa40a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 --2- 172.21.15.172:0/3723832484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3be770 0x55d8aa3c47a0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 --2- 172.21.15.172:0/3723832484 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 0x55d8aa3ee8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 -- 172.21.15.172:0/3723832484 >> 172.21.15.172:0/3723832484 conn(0x55d8aa3c09e0 msgr2=0x55d8aa409320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 -- 172.21.15.172:0/3723832484 shutdown_connections 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 -- 172.21.15.172:0/3723832484 wait complete. 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 -- start start 2024-04-25T08:50:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.238+0000 7f83d51ef740 1 Processor -- start 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3ee510 0x55d8aa40b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa40a470 0x55d8aa40d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40b840 0x55d8aa40df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83d51ef740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8aa3c4ce0 con 0x55d8aa3ee510 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83d51ef740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8aa2c64b0 con 0x55d8aa40b840 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83d51ef740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8aa3c4310 con 0x55d8aa40a470 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83d51ef740 10 client.0 _ll_register_callbacks cb 0x55d8aa306180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83cbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3ee510 0x55d8aa40b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83cbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3ee510 0x55d8aa40b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53928/0 (socket says 172.21.15.172:53928) 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83cbfff640 1 -- 172.21.15.172:0/3449578040 learned_addr learned my addr 172.21.15.172:0/3449578040 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40b840 0x55d8aa40df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.239+0000 7f83cb7fe640 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa40a470 0x55d8aa40d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83cbfff640 1 -- 172.21.15.172:0/3449578040 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa40a470 msgr2=0x55d8aa40d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83cbfff640 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa40a470 0x55d8aa40d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83cbfff640 1 -- 172.21.15.172:0/3449578040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40b840 msgr2=0x55d8aa40df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83cbfff640 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40b840 0x55d8aa40df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83cbfff640 1 -- 172.21.15.172:0/3449578040 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8aa1067d0 con 0x55d8aa3ee510 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83cbfff640 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3ee510 0x55d8aa40b300 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f83bc004630 tx=0x7f83bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8653d74a3b696eb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83aaffd640 1 -- 172.21.15.172:0/3449578040 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc027070 con 0x55d8aa3ee510 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83aaffd640 1 -- 172.21.15.172:0/3449578040 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f83bc014440 con 0x55d8aa3ee510 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83d51ef740 1 -- 172.21.15.172:0/3449578040 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f83c0004030 con 0x55d8aa3ee510 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83aaffd640 1 -- 172.21.15.172:0/3449578040 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83bc014680 con 0x55d8aa3ee510 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83d51ef740 10 client.8880 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83d51ef740 1 -- 172.21.15.172:0/3449578040 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55d8aa03c3f0 con 0x55d8aa3ee510 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83aaffd640 1 -- 172.21.15.172:0/3449578040 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0004030 con 0x55d8aa3ee510 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83aaffd640 1 -- 172.21.15.172:0/3449578040 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f83bc035080 con 0x55d8aa3ee510 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83d51ef740 10 client.8880 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83d51ef740 10 client.8880 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83d51ef740 20 client.8880 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83d51ef740 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d8aa3e7430 0x55d8aa3e7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83d51ef740 4 client.8880 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83d51ef740 1 -- 172.21.15.172:0/3449578040 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8aa3352e0 con 0x55d8aa3e7430 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.240+0000 7f83cb7fe640 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d8aa3e7430 0x55d8aa3e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83aaffd640 10 client.8880 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83cb7fe640 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d8aa3e7430 0x55d8aa3e7810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a290c59192f54480 server_cookie=bf68dbd17cce9096 in_seq=0 out_seq=0 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83aaffd640 1 -- 172.21.15.172:0/3449578040 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d8aa3352e0 con 0x55d8aa3e7430 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83aaffd640 10 client.8880 handle_command_reply: tid=0 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83d51ef740 1 client.8880 shutdown 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83d51ef740 1 -- 172.21.15.172:0/3449578040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3ee510 msgr2=0x55d8aa40b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83d51ef740 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3ee510 0x55d8aa40b300 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f83bc004630 tx=0x7f83bc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83d51ef740 1 -- 172.21.15.172:0/3449578040 shutdown_connections 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83d51ef740 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d8aa3e7430 0x55d8aa3e7810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83d51ef740 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40b840 0x55d8aa40df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83d51ef740 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa40a470 0x55d8aa40d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83d51ef740 1 --2- 172.21.15.172:0/3449578040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa3ee510 0x55d8aa40b300 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83d51ef740 1 -- 172.21.15.172:0/3449578040 >> 172.21.15.172:0/3449578040 conn(0x55d8aa3be770 msgr2=0x55d8aa3bde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83aaffd640 0 client.8880 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:23.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.241+0000 7f83d51ef740 1 -- 172.21.15.172:0/3449578040 shutdown_connections 2024-04-25T08:50:23.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.242+0000 7f83d51ef740 1 -- 172.21.15.172:0/3449578040 wait complete. 2024-04-25T08:50:23.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.242+0000 7f83d51ef740 20 client.8880 trim_cache size 0 max 16384 2024-04-25T08:50:23.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.256+0000 7f83d51ef740 1 Processor -- start 2024-04-25T08:50:23.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.256+0000 7f83d51ef740 1 -- start start 2024-04-25T08:50:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 0x55d8aa3e69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 0x55d8aa40d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d51ef740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc1fc1f0 con 0x55d8aa40b840 2024-04-25T08:50:23.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d51ef740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc156da0 con 0x55d8aa40a470 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d51ef740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc13e1e0 con 0x55d8aa3ee510 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d0a8b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d0a8b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53930/0 (socket says 172.21.15.172:53930) 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d0a8b640 1 -- 172.21.15.172:0/2280356975 learned_addr learned my addr 172.21.15.172:0/2280356975 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d0a8b640 1 -- 172.21.15.172:0/2280356975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 msgr2=0x55d8aa3e69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/2280356975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 0x55d8aa3e69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d0a8b640 1 -- 172.21.15.172:0/2280356975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 msgr2=0x55d8aa40d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/2280356975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 0x55d8aa40d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.257+0000 7f83d0a8b640 1 -- 172.21.15.172:0/2280356975 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8a9ffc0f0 con 0x55d8aa40b840 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/2280356975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e9b90 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f83c40073c0 tx=0x7f83c4049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d6cb916e43ff51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83b17fa640 1 -- 172.21.15.172:0/2280356975 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4078fe0 con 0x55d8aa40b840 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83b17fa640 1 -- 172.21.15.172:0/2280356975 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4037040 con 0x55d8aa40b840 2024-04-25T08:50:23.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83b17fa640 1 -- 172.21.15.172:0/2280356975 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4031600 con 0x55d8aa40b840 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83d51ef740 1 -- 172.21.15.172:0/2280356975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 msgr2=0x55d8aa3e9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83d51ef740 1 --2- 172.21.15.172:0/2280356975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e9b90 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f83c40073c0 tx=0x7f83c4049040 comp rx=0 tx=0).stop 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83d51ef740 1 -- 172.21.15.172:0/2280356975 shutdown_connections 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83d51ef740 1 --2- 172.21.15.172:0/2280356975 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 0x55d8aa40d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83d51ef740 1 --2- 172.21.15.172:0/2280356975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e9b90 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83d51ef740 1 --2- 172.21.15.172:0/2280356975 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 0x55d8aa3e69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83d51ef740 1 -- 172.21.15.172:0/2280356975 >> 172.21.15.172:0/2280356975 conn(0x55d8aa3be770 msgr2=0x55d8aa415820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83d51ef740 1 -- 172.21.15.172:0/2280356975 shutdown_connections 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.258+0000 7f83d51ef740 1 -- 172.21.15.172:0/2280356975 wait complete. 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.259+0000 7f83d51ef740 1 -- start start 2024-04-25T08:50:23.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.259+0000 7f83d51ef740 1 Processor -- start 2024-04-25T08:50:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 0x55d8aa477380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 0x55d8aa41ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d51ef740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d51ef740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8aa3bf200 con 0x55d8aa40b840 2024-04-25T08:50:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d51ef740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc1567a0 con 0x55d8aa40a470 2024-04-25T08:50:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d51ef740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8aa3ea0d0 con 0x55d8aa3ee510 2024-04-25T08:50:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d51ef740 10 client.0 _ll_register_callbacks cb 0x7f83c0009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d0a8b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d0a8b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53934/0 (socket says 172.21.15.172:53934) 2024-04-25T08:50:23.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d0a8b640 1 -- 172.21.15.172:0/603302028 learned_addr learned my addr 172.21.15.172:0/603302028 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d0a8b640 1 -- 172.21.15.172:0/603302028 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 msgr2=0x55d8aa477380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 0x55d8aa477380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d0a8b640 1 -- 172.21.15.172:0/603302028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 msgr2=0x55d8aa41ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 0x55d8aa41ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d0a8b640 1 -- 172.21.15.172:0/603302028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8aa3f0f30 con 0x55d8aa40b840 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d0a8b640 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e74a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f83c402ac90 tx=0x7f83c40a9250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155f9fb59c5e628a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83aaffd640 1 -- 172.21.15.172:0/603302028 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4097060 con 0x55d8aa40b840 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83aaffd640 1 -- 172.21.15.172:0/603302028 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f83c4078ad0 con 0x55d8aa40b840 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83d51ef740 1 -- 172.21.15.172:0/603302028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f83c4037040 con 0x55d8aa40b840 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.260+0000 7f83aaffd640 1 -- 172.21.15.172:0/603302028 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83c4031600 con 0x55d8aa40b840 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83d51ef740 10 client.8886 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83d51ef740 1 -- 172.21.15.172:0/603302028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55d8aa4273a0 con 0x55d8aa40b840 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83aaffd640 1 -- 172.21.15.172:0/603302028 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4037040 con 0x55d8aa40b840 2024-04-25T08:50:23.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83aaffd640 1 -- 172.21.15.172:0/603302028 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f83c4099ce0 con 0x55d8aa40b840 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83d51ef740 10 client.8886 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83d51ef740 10 client.8886 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83d51ef740 20 client.8886 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83d51ef740 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d8aa3effe0 0x55d8aa3e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83d51ef740 4 client.8886 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83d51ef740 1 -- 172.21.15.172:0/603302028 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d8aa3bfb10 con 0x55d8aa3effe0 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83cbfff640 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d8aa3effe0 0x55d8aa3e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83aaffd640 10 client.8886 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83cbfff640 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d8aa3effe0 0x55d8aa3e79e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f9fb56c3e020d7d server_cookie=f9d599370529414d in_seq=0 out_seq=0 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83aaffd640 1 -- 172.21.15.172:0/603302028 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+69 (crc 0 0 0) 0x55d8aa3bfb10 con 0x55d8aa3effe0 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83aaffd640 10 client.8886 handle_command_reply: tid=0 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.261+0000 7f83d51ef740 1 client.8886 shutdown 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 1 -- 172.21.15.172:0/603302028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 msgr2=0x55d8aa3e74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e74a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f83c402ac90 tx=0x7f83c40a9250 comp rx=0 tx=0).stop 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 1 -- 172.21.15.172:0/603302028 shutdown_connections 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d8aa3effe0 0x55d8aa3e79e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8aa40a470 0x55d8aa41ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83aaffd640 0 client.8886 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8aa40b840 0x55d8aa3e74a0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 1 --2- 172.21.15.172:0/603302028 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8aa3ee510 0x55d8aa477380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 1 -- 172.21.15.172:0/603302028 >> 172.21.15.172:0/603302028 conn(0x55d8aa3be770 msgr2=0x55d8aa3c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 1 -- 172.21.15.172:0/603302028 shutdown_connections 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 1 -- 172.21.15.172:0/603302028 wait complete. 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d51ef740 20 client.8886 trim_cache size 0 max 16384 2024-04-25T08:50:23.258 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:50:23.259 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T08:50:23.259 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": {} 2024-04-25T08:50:23.259 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:50:23.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 -- 172.21.15.172:0/358081771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f83b806b4d0 msgr2=0x7f83b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f83b806b4d0 0x7f83b806d990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009a20 tx=0x7f83bc009190 comp rx=0 tx=0).stop 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 -- 172.21.15.172:0/358081771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 msgr2=0x7f83cc13eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 0x7f83cc13eef0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009f40 tx=0x7f83c4004a40 comp rx=0 tx=0).stop 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 -- 172.21.15.172:0/358081771 shutdown_connections 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f83b806b4d0 0x7f83b806d990 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83cc15b270 0x7f83cc13eef0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83cc0cdb20 0x7f83cc13e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 --2- 172.21.15.172:0/358081771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83cc0cc4f0 0x7f83cc1f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 -- 172.21.15.172:0/358081771 >> 172.21.15.172:0/358081771 conn(0x7f83cc06abe0 msgr2=0x7f83cc06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 -- 172.21.15.172:0/358081771 shutdown_connections 2024-04-25T08:50:23.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.262+0000 7f83d24ee640 1 -- 172.21.15.172:0/358081771 wait complete. 2024-04-25T08:50:23.264 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.370+0000 7f35bf241640 1 Processor -- start 2024-04-25T08:50:23.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.370+0000 7f35bf241640 1 -- start start 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35bf241640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f35b815dbe0 0x7f35b80d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35bf241640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35b80b2cb0 0x7f35b80d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35bf241640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b92a0 0x7f35b80b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35bf241640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b815dfc0 con 0x7f35b80b2cb0 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35bf241640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b80d1a00 con 0x7f35b815dbe0 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35bf241640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80b97a0 con 0x7f35b80b92a0 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35b7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35b80b2cb0 0x7f35b80d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35b7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35b80b2cb0 0x7f35b80d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53944/0 (socket says 172.21.15.172:53944) 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35b7fff640 1 -- 172.21.15.172:0/1928149914 learned_addr learned my addr 172.21.15.172:0/1928149914 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35bcfdd640 1 --2- 172.21.15.172:0/1928149914 >> v2:172.21.15.186:3300/0 conn(0x7f35b815dbe0 0x7f35b80d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.371+0000 7f35bd7de640 1 --2- 172.21.15.172:0/1928149914 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b92a0 0x7f35b80b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.372+0000 7f35b7fff640 1 -- 172.21.15.172:0/1928149914 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b92a0 msgr2=0x7f35b80b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.372+0000 7f35b7fff640 1 --2- 172.21.15.172:0/1928149914 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b92a0 0x7f35b80b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.372+0000 7f35b7fff640 1 -- 172.21.15.172:0/1928149914 >> v2:172.21.15.186:3300/0 conn(0x7f35b815dbe0 msgr2=0x7f35b80d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.372+0000 7f35b7fff640 1 --2- 172.21.15.172:0/1928149914 >> v2:172.21.15.186:3300/0 conn(0x7f35b815dbe0 0x7f35b80d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.372+0000 7f35b7fff640 1 -- 172.21.15.172:0/1928149914 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b80d1c50 con 0x7f35b80b2cb0 2024-04-25T08:50:23.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.372+0000 7f35b7fff640 1 --2- 172.21.15.172:0/1928149914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b80b2cb0 0x7f35b80d0e50 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f35b806c140 tx=0x7f35a002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3431723c6702e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.372+0000 7f35b77fe640 1 -- 172.21.15.172:0/1928149914 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0037070 con 0x7f35b80b2cb0 2024-04-25T08:50:23.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.372+0000 7f35b77fe640 1 -- 172.21.15.172:0/1928149914 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a0032440 con 0x7f35b80b2cb0 2024-04-25T08:50:23.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.372+0000 7f35b77fe640 1 -- 172.21.15.172:0/1928149914 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0032810 con 0x7f35b80b2cb0 2024-04-25T08:50:23.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.373+0000 7f35bf241640 1 -- 172.21.15.172:0/1928149914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b80b2cb0 msgr2=0x7f35b80d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.373+0000 7f35bf241640 1 --2- 172.21.15.172:0/1928149914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b80b2cb0 0x7f35b80d0e50 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f35b806c140 tx=0x7f35a002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.373+0000 7f35bf241640 1 -- 172.21.15.172:0/1928149914 shutdown_connections 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.373+0000 7f35bf241640 1 --2- 172.21.15.172:0/1928149914 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b92a0 0x7f35b80b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.373+0000 7f35bf241640 1 --2- 172.21.15.172:0/1928149914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b80b2cb0 0x7f35b80d0e50 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.373+0000 7f35bf241640 1 --2- 172.21.15.172:0/1928149914 >> v2:172.21.15.186:3300/0 conn(0x7f35b815dbe0 0x7f35b80d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.373+0000 7f35bf241640 1 -- 172.21.15.172:0/1928149914 >> 172.21.15.172:0/1928149914 conn(0x7f35b8061a20 msgr2=0x7f35b8061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.373+0000 7f35bf241640 1 -- 172.21.15.172:0/1928149914 shutdown_connections 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.373+0000 7f35bf241640 1 -- 172.21.15.172:0/1928149914 wait complete. 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.374+0000 7f35bf241640 1 Processor -- start 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.374+0000 7f35bf241640 1 -- start start 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bf241640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b2cb0 0x7f35b80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bf241640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35b80b92a0 0x7f35b815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bf241640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b815dbe0 0x7f35b815f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bf241640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80b6ab0 con 0x7f35b815dbe0 2024-04-25T08:50:23.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bf241640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80d2210 con 0x7f35b80b92a0 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bf241640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80b6c30 con 0x7f35b80b2cb0 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bd7de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b815dbe0 0x7f35b815f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bd7de640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b815dbe0 0x7f35b815f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53950/0 (socket says 172.21.15.172:53950) 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bd7de640 1 -- 172.21.15.172:0/3118666779 learned_addr learned my addr 172.21.15.172:0/3118666779 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bd7de640 1 -- 172.21.15.172:0/3118666779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b2cb0 msgr2=0x7f35b80b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35bcfdd640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b2cb0 0x7f35b80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.375+0000 7f35b7fff640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35b80b92a0 0x7f35b815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35bd7de640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b2cb0 0x7f35b80b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35bd7de640 1 -- 172.21.15.172:0/3118666779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35b80b92a0 msgr2=0x7f35b815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35bd7de640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35b80b92a0 0x7f35b815f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35bd7de640 1 -- 172.21.15.172:0/3118666779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b80ccb60 con 0x7f35b815dbe0 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35b7fff640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35b80b92a0 0x7f35b815f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35bcfdd640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b2cb0 0x7f35b80b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:23.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35bd7de640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b815dbe0 0x7f35b815f710 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009e30 tx=0x7f35b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35b57fa640 1 -- 172.21.15.172:0/3118666779 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0018020 con 0x7f35b815dbe0 2024-04-25T08:50:23.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35b57fa640 1 -- 172.21.15.172:0/3118666779 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0014480 con 0x7f35b815dbe0 2024-04-25T08:50:23.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35b57fa640 1 -- 172.21.15.172:0/3118666779 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0014870 con 0x7f35b815dbe0 2024-04-25T08:50:23.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35bf241640 1 -- 172.21.15.172:0/3118666779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b80cce40 con 0x7f35b815dbe0 2024-04-25T08:50:23.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.376+0000 7f35bf241640 1 -- 172.21.15.172:0/3118666779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b80cd400 con 0x7f35b815dbe0 2024-04-25T08:50:23.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.377+0000 7f35bf241640 1 -- 172.21.15.172:0/3118666779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b8073990 con 0x7f35b815dbe0 2024-04-25T08:50:23.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.377+0000 7f35b57fa640 1 -- 172.21.15.172:0/3118666779 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f35b0005d10 con 0x7f35b815dbe0 2024-04-25T08:50:23.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.378+0000 7f35b57fa640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f359806b4d0 0x7f359806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.378+0000 7f35b57fa640 1 -- 172.21.15.172:0/3118666779 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f35b008b360 con 0x7f35b815dbe0 2024-04-25T08:50:23.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.378+0000 7f35bcfdd640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f359806b4d0 0x7f359806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.371 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.378+0000 7f35bcfdd640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f359806b4d0 0x7f359806d990 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f35a80099a0 tx=0x7f35a8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.382+0000 7f35b57fa640 1 -- 172.21.15.172:0/3118666779 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f35b0022030 con 0x7f35b815dbe0 2024-04-25T08:50:23.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.588+0000 7f35bf241640 1 -- 172.21.15.172:0/3118666779 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35b815c9d0 con 0x7f35b815dbe0 2024-04-25T08:50:23.579 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.589+0000 7f35b57fa640 1 -- 172.21.15.172:0/3118666779 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f35b0010040 con 0x7f35b815dbe0 2024-04-25T08:50:23.580 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:23.580 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:23.580 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:23.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 -- 172.21.15.172:0/3118666779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f359806b4d0 msgr2=0x7f359806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f359806b4d0 0x7f359806d990 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f35a80099a0 tx=0x7f35a8008040 comp rx=0 tx=0).stop 2024-04-25T08:50:23.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 -- 172.21.15.172:0/3118666779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b815dbe0 msgr2=0x7f35b815f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b815dbe0 0x7f35b815f710 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009e30 tx=0x7f35b000c490 comp rx=0 tx=0).stop 2024-04-25T08:50:23.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 -- 172.21.15.172:0/3118666779 shutdown_connections 2024-04-25T08:50:23.582 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f359806b4d0 0x7f359806d990 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35b80b92a0 0x7f35b815f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35b815dbe0 0x7f35b815f710 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 --2- 172.21.15.172:0/3118666779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35b80b2cb0 0x7f35b80b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 -- 172.21.15.172:0/3118666779 >> 172.21.15.172:0/3118666779 conn(0x7f35b8061a20 msgr2=0x7f35b815b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 -- 172.21.15.172:0/3118666779 shutdown_connections 2024-04-25T08:50:23.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.591+0000 7f35bf241640 1 -- 172.21.15.172:0/3118666779 wait complete. 2024-04-25T08:50:23.592 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:50:23.592 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:23.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.699+0000 7ff97c68f640 1 Processor -- start 2024-04-25T08:50:23.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.699+0000 7ff97c68f640 1 -- start start 2024-04-25T08:50:23.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff97c68f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff974144750 0x7ff97406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff97c68f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff974144b30 con 0x7ff97406eb10 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff97c68f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9740712d0 con 0x7ff9740cf030 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff97c68f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9740715b0 con 0x7ff974144750 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff97a42b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff974144750 0x7ff97406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff979c2a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff97406eb10 0x7ff9740ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59188/0 (socket says 172.21.15.172:59188) 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff979c2a640 1 -- 172.21.15.172:0/1021240795 learned_addr learned my addr 172.21.15.172:0/1021240795 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff97a42b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff974144750 0x7ff97406e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53962/0 (socket says 172.21.15.172:53962) 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff97a42b640 1 -- 172.21.15.172:0/1021240795 >> v1:172.21.15.186:6789/0 conn(0x7ff9740cf030 legacy=0x7ff97406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff97a42b640 1 -- 172.21.15.172:0/1021240795 >> v1:172.21.15.172:6789/0 conn(0x7ff97406eb10 legacy=0x7ff9740ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff979429640 1 -- 172.21.15.172:0/1021240795 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348385569 0 0) 0x7ff974144b30 con 0x7ff97406eb10 2024-04-25T08:50:23.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.700+0000 7ff97a42b640 1 -- 172.21.15.172:0/1021240795 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974071890 con 0x7ff974144750 2024-04-25T08:50:23.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.701+0000 7ff97a42b640 1 --2- 172.21.15.172:0/1021240795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 0x7ff97406e5d0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7ff9680097a0 tx=0x7ff96802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e582f833dce1d6f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.701+0000 7ff979429640 1 -- 172.21.15.172:0/1021240795 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968037070 con 0x7ff974144750 2024-04-25T08:50:23.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.701+0000 7ff979429640 1 -- 172.21.15.172:0/1021240795 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff968032440 con 0x7ff974144750 2024-04-25T08:50:23.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.701+0000 7ff979429640 1 -- 172.21.15.172:0/1021240795 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968032810 con 0x7ff974144750 2024-04-25T08:50:23.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.701+0000 7ff97c68f640 1 -- 172.21.15.172:0/1021240795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 msgr2=0x7ff97406e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.701+0000 7ff97c68f640 1 --2- 172.21.15.172:0/1021240795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 0x7ff97406e5d0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7ff9680097a0 tx=0x7ff96802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.702+0000 7ff97c68f640 1 -- 172.21.15.172:0/1021240795 shutdown_connections 2024-04-25T08:50:23.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.702+0000 7ff97c68f640 1 --2- 172.21.15.172:0/1021240795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 0x7ff97406e5d0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.702+0000 7ff97c68f640 1 -- 172.21.15.172:0/1021240795 >> 172.21.15.172:0/1021240795 conn(0x7ff97406abe0 msgr2=0x7ff97406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.702+0000 7ff97c68f640 1 -- 172.21.15.172:0/1021240795 shutdown_connections 2024-04-25T08:50:23.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.702+0000 7ff97c68f640 1 -- 172.21.15.172:0/1021240795 wait complete. 2024-04-25T08:50:23.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.703+0000 7ff97c68f640 1 Processor -- start 2024-04-25T08:50:23.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.703+0000 7ff97c68f640 1 -- start start 2024-04-25T08:50:23.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.703+0000 7ff97c68f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97406eb10 0x7ff97415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.703+0000 7ff97c68f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9740cf030 0x7ff974141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.703+0000 7ff97c68f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 0x7ff974142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.703+0000 7ff97c68f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9741455d0 con 0x7ff974144750 2024-04-25T08:50:23.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.703+0000 7ff97c68f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff974145450 con 0x7ff97406eb10 2024-04-25T08:50:23.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.703+0000 7ff97c68f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97415c000 con 0x7ff9740cf030 2024-04-25T08:50:23.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97ac2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 0x7ff974142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97ac2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 0x7ff974142040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53976/0 (socket says 172.21.15.172:53976) 2024-04-25T08:50:23.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97ac2c640 1 -- 172.21.15.172:0/622453090 learned_addr learned my addr 172.21.15.172:0/622453090 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff979c2a640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9740cf030 0x7ff974141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97a42b640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97406eb10 0x7ff97415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97ac2c640 1 -- 172.21.15.172:0/622453090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9740cf030 msgr2=0x7ff974141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97ac2c640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9740cf030 0x7ff974141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97ac2c640 1 -- 172.21.15.172:0/622453090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97406eb10 msgr2=0x7ff97415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97ac2c640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97406eb10 0x7ff97415e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97ac2c640 1 -- 172.21.15.172:0/622453090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9740b4790 con 0x7ff974144750 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97ac2c640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 0x7ff974142040 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c7b0 tx=0x7ff96c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff966ffd640 1 -- 172.21.15.172:0/622453090 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c004b60 con 0x7ff974144750 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff966ffd640 1 -- 172.21.15.172:0/622453090 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c004d00 con 0x7ff974144750 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97c68f640 1 -- 172.21.15.172:0/622453090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97415e6f0 con 0x7ff974144750 2024-04-25T08:50:23.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff966ffd640 1 -- 172.21.15.172:0/622453090 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c00aa90 con 0x7ff974144750 2024-04-25T08:50:23.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.704+0000 7ff97c68f640 1 -- 172.21.15.172:0/622453090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9740ad7f0 con 0x7ff974144750 2024-04-25T08:50:23.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.705+0000 7ff97c68f640 1 -- 172.21.15.172:0/622453090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff974073990 con 0x7ff974144750 2024-04-25T08:50:23.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.706+0000 7ff966ffd640 1 -- 172.21.15.172:0/622453090 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff96c00ac30 con 0x7ff974144750 2024-04-25T08:50:23.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.706+0000 7ff966ffd640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff95806b4d0 0x7ff95806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:23.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.706+0000 7ff966ffd640 1 -- 172.21.15.172:0/622453090 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff96c08a610 con 0x7ff974144750 2024-04-25T08:50:23.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.706+0000 7ff97a42b640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff95806b4d0 0x7ff95806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:23.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.707+0000 7ff97a42b640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff95806b4d0 0x7ff95806d990 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff968034000 tx=0x7ff96802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:23.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.710+0000 7ff966ffd640 1 -- 172.21.15.172:0/622453090 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff96c020070 con 0x7ff974144750 2024-04-25T08:50:23.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.945+0000 7ff97c68f640 1 -- 172.21.15.172:0/622453090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff9740d0510 con 0x7ff974144750 2024-04-25T08:50:23.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.946+0000 7ff966ffd640 1 -- 172.21.15.172:0/622453090 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1444 (secure 0 0 0) 0x7ff96c059300 con 0x7ff974144750 2024-04-25T08:50:23.937 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:23.937 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":499,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":842,"data_bytes":859461282,"bytes_used":1993973760,"bytes_avail":771100139520,"bytes_total":773094113280,"write_bytes_sec":71565084,"read_op_per_sec":0,"write_op_per_sec":69},"fsmap":{"epoch":68,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-04-25T08:49:52.603883+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:23.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.947+0000 7ff97c68f640 1 -- 172.21.15.172:0/622453090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff95806b4d0 msgr2=0x7ff95806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.947+0000 7ff97c68f640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff95806b4d0 0x7ff95806d990 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff968034000 tx=0x7ff96802e000 comp rx=0 tx=0).stop 2024-04-25T08:50:23.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.947+0000 7ff97c68f640 1 -- 172.21.15.172:0/622453090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 msgr2=0x7ff974142040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:23.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.947+0000 7ff97c68f640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 0x7ff974142040 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c7b0 tx=0x7ff96c00cc70 comp rx=0 tx=0).stop 2024-04-25T08:50:23.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.948+0000 7ff97c68f640 1 -- 172.21.15.172:0/622453090 shutdown_connections 2024-04-25T08:50:23.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.948+0000 7ff97c68f640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff95806b4d0 0x7ff95806d990 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.948+0000 7ff97c68f640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff974144750 0x7ff974142040 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.948+0000 7ff97c68f640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9740cf030 0x7ff974141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.948+0000 7ff97c68f640 1 --2- 172.21.15.172:0/622453090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff97406eb10 0x7ff97415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:23.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.948+0000 7ff97c68f640 1 -- 172.21.15.172:0/622453090 >> 172.21.15.172:0/622453090 conn(0x7ff97406abe0 msgr2=0x7ff9740cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:23.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.948+0000 7ff97c68f640 1 -- 172.21.15.172:0/622453090 shutdown_connections 2024-04-25T08:50:23.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:23.948+0000 7ff97c68f640 1 -- 172.21.15.172:0/622453090 wait complete. 2024-04-25T08:50:23.949 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T08:50:24.950 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:25.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.070+0000 7fcad7190640 1 Processor -- start 2024-04-25T08:50:25.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.070+0000 7fcad7190640 1 -- start start 2024-04-25T08:50:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.070+0000 7fcad7190640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcad0154ee0 0x7fcad00cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.070+0000 7fcad7190640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcad00ce590 0x7fcad006d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.070+0000 7fcad7190640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad0071480 con 0x7fcad00cfcf0 2024-04-25T08:50:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.070+0000 7fcad7190640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad0072090 con 0x7fcad00ce590 2024-04-25T08:50:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.071+0000 7fcad7190640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00d0150 con 0x7fcad0154ee0 2024-04-25T08:50:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.071+0000 7fcad572d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcad00ce590 0x7fcad006d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.071+0000 7fcacffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcad00cfcf0 0x7fcad00cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59202/0 (socket says 172.21.15.172:59202) 2024-04-25T08:50:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.071+0000 7fcacffff640 1 -- 172.21.15.172:0/2157247075 learned_addr learned my addr 172.21.15.172:0/2157247075 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.071+0000 7fcad4f2c640 1 --2- 172.21.15.172:0/2157247075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcad0154ee0 0x7fcad00cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.071+0000 7fcad572d640 1 -- 172.21.15.172:0/2157247075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcad0154ee0 msgr2=0x7fcad00cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.071+0000 7fcad572d640 1 --2- 172.21.15.172:0/2157247075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcad0154ee0 0x7fcad00cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.071+0000 7fcad572d640 1 -- 172.21.15.172:0/2157247075 >> v1:172.21.15.172:6789/0 conn(0x7fcad00cfcf0 legacy=0x7fcad00cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.071+0000 7fcad572d640 1 -- 172.21.15.172:0/2157247075 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0071760 con 0x7fcad00ce590 2024-04-25T08:50:25.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.071+0000 7fcacf7fe640 1 -- 172.21.15.172:0/2157247075 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482500987 0 0) 0x7fcad0071480 con 0x7fcad00cfcf0 2024-04-25T08:50:25.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.072+0000 7fcad572d640 1 --2- 172.21.15.172:0/2157247075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 0x7fcad006d6f0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009d90 tx=0x7fcac802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb81aeac6fe28712 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:25.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.072+0000 7fcacf7fe640 1 -- 172.21.15.172:0/2157247075 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8007740 con 0x7fcad00ce590 2024-04-25T08:50:25.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.072+0000 7fcacf7fe640 1 -- 172.21.15.172:0/2157247075 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac80078e0 con 0x7fcad00ce590 2024-04-25T08:50:25.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.072+0000 7fcacf7fe640 1 -- 172.21.15.172:0/2157247075 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8007cb0 con 0x7fcad00ce590 2024-04-25T08:50:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.072+0000 7fcad7190640 1 -- 172.21.15.172:0/2157247075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 msgr2=0x7fcad006d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.072+0000 7fcad7190640 1 --2- 172.21.15.172:0/2157247075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 0x7fcad006d6f0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009d90 tx=0x7fcac802a660 comp rx=0 tx=0).stop 2024-04-25T08:50:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.072+0000 7fcad7190640 1 -- 172.21.15.172:0/2157247075 shutdown_connections 2024-04-25T08:50:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.072+0000 7fcad7190640 1 --2- 172.21.15.172:0/2157247075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 0x7fcad006d6f0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.072+0000 7fcad7190640 1 --2- 172.21.15.172:0/2157247075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcad0154ee0 0x7fcad00cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.072+0000 7fcad7190640 1 -- 172.21.15.172:0/2157247075 >> 172.21.15.172:0/2157247075 conn(0x7fcad006abe0 msgr2=0x7fcad006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.073+0000 7fcad7190640 1 -- 172.21.15.172:0/2157247075 shutdown_connections 2024-04-25T08:50:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.073+0000 7fcad7190640 1 -- 172.21.15.172:0/2157247075 wait complete. 2024-04-25T08:50:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.074+0000 7fcad7190640 1 Processor -- start 2024-04-25T08:50:25.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.074+0000 7fcad7190640 1 -- start start 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad7190640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 0x7fcad0159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad7190640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcad00cfcf0 0x7fcad00aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad7190640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcad0154ee0 0x7fcad00a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad7190640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0071d20 con 0x7fcad00ce590 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad7190640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0071230 con 0x7fcad0154ee0 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad7190640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad01552c0 con 0x7fcad00cfcf0 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad4f2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 0x7fcad0159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad4f2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 0x7fcad0159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53982/0 (socket says 172.21.15.172:53982) 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad4f2c640 1 -- 172.21.15.172:0/1392551592 learned_addr learned my addr 172.21.15.172:0/1392551592 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcacffff640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcad00cfcf0 0x7fcad00aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad4f2c640 1 -- 172.21.15.172:0/1392551592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcad00cfcf0 msgr2=0x7fcad00aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad572d640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcad0154ee0 0x7fcad00a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad4f2c640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcad00cfcf0 0x7fcad00aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad4f2c640 1 -- 172.21.15.172:0/1392551592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcad0154ee0 msgr2=0x7fcad00a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad4f2c640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcad0154ee0 0x7fcad00a8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad4f2c640 1 -- 172.21.15.172:0/1392551592 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0158db0 con 0x7fcad00ce590 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad4f2c640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 0x7fcad0159e50 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fcac400d5d0 tx=0x7fcac400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcacd7fa640 1 -- 172.21.15.172:0/1392551592 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40125f0 con 0x7fcad00ce590 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcacd7fa640 1 -- 172.21.15.172:0/1392551592 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4019070 con 0x7fcad00ce590 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcad7190640 1 -- 172.21.15.172:0/1392551592 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad0159090 con 0x7fcad00ce590 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.075+0000 7fcacd7fa640 1 -- 172.21.15.172:0/1392551592 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40129f0 con 0x7fcad00ce590 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.076+0000 7fcad7190640 1 -- 172.21.15.172:0/1392551592 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad0159650 con 0x7fcad00ce590 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.076+0000 7fcad7190640 1 -- 172.21.15.172:0/1392551592 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad0073990 con 0x7fcad00ce590 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.077+0000 7fcacd7fa640 1 -- 172.21.15.172:0/1392551592 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcac4012b90 con 0x7fcad00ce590 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.077+0000 7fcacd7fa640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcab406b4d0 0x7fcab406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.077+0000 7fcacd7fa640 1 -- 172.21.15.172:0/1392551592 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcac408a7f0 con 0x7fcad00ce590 2024-04-25T08:50:25.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.077+0000 7fcacffff640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcab406b4d0 0x7fcab406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.078+0000 7fcacffff640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcab406b4d0 0x7fcab406d990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcabc007fd0 tx=0x7fcabc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:25.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.082+0000 7fcacd7fa640 1 -- 172.21.15.172:0/1392551592 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcac40594e0 con 0x7fcad00ce590 2024-04-25T08:50:25.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.291+0000 7fcad7190640 1 -- 172.21.15.172:0/1392551592 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcad0153f60 con 0x7fcad00ce590 2024-04-25T08:50:25.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.292+0000 7fcacd7fa640 1 -- 172.21.15.172:0/1392551592 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fcac4058de0 con 0x7fcad00ce590 2024-04-25T08:50:25.283 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:25.283 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:25.283 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:25.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 -- 172.21.15.172:0/1392551592 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcab406b4d0 msgr2=0x7fcab406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcab406b4d0 0x7fcab406d990 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcabc007fd0 tx=0x7fcabc009040 comp rx=0 tx=0).stop 2024-04-25T08:50:25.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 -- 172.21.15.172:0/1392551592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 msgr2=0x7fcad0159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 0x7fcad0159e50 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fcac400d5d0 tx=0x7fcac400da90 comp rx=0 tx=0).stop 2024-04-25T08:50:25.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 -- 172.21.15.172:0/1392551592 shutdown_connections 2024-04-25T08:50:25.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcab406b4d0 0x7fcab406d990 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcad0154ee0 0x7fcad00a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcad00cfcf0 0x7fcad00aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.285 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 --2- 172.21.15.172:0/1392551592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad00ce590 0x7fcad0159e50 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 -- 172.21.15.172:0/1392551592 >> 172.21.15.172:0/1392551592 conn(0x7fcad006abe0 msgr2=0x7fcad00b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:25.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 -- 172.21.15.172:0/1392551592 shutdown_connections 2024-04-25T08:50:25.286 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.294+0000 7fcad7190640 1 -- 172.21.15.172:0/1392551592 wait complete. 2024-04-25T08:50:25.296 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:50:25.296 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.402+0000 7f7998b70640 1 Processor -- start 2024-04-25T08:50:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.402+0000 7f7998b70640 1 -- start start 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f7998b70640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7994154ed0 0x7f79940aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f7998b70640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7994071ac0 0x7f79940ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f7998b70640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799415ec60 con 0x7f799406c1d0 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f7998b70640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799415ef40 con 0x7f7994154ed0 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f7998b70640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799406db90 con 0x7f7994071ac0 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f799259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7994154ed0 0x7f79940aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f799259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7994154ed0 0x7f79940aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53996/0 (socket says 172.21.15.172:53996) 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f799259c640 1 -- 172.21.15.172:0/4163649237 learned_addr learned my addr 172.21.15.172:0/4163649237 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f798bfff640 1 --2- 172.21.15.172:0/4163649237 >> v2:172.21.15.186:3300/0 conn(0x7f7994071ac0 0x7f79940ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f799259c640 1 -- 172.21.15.172:0/4163649237 >> v2:172.21.15.186:3300/0 conn(0x7f7994071ac0 msgr2=0x7f79940ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f799259c640 1 --2- 172.21.15.172:0/4163649237 >> v2:172.21.15.186:3300/0 conn(0x7f7994071ac0 0x7f79940ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f799259c640 1 -- 172.21.15.172:0/4163649237 >> v1:172.21.15.186:6789/0 conn(0x7f799406c1d0 legacy=0x7f79941617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:25.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f799259c640 1 -- 172.21.15.172:0/4163649237 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799406de70 con 0x7f7994154ed0 2024-04-25T08:50:25.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.403+0000 7f798bfff640 1 --2- 172.21.15.172:0/4163649237 >> v2:172.21.15.186:3300/0 conn(0x7f7994071ac0 0x7f79940ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:25.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.404+0000 7f799259c640 1 --2- 172.21.15.172:0/4163649237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7994154ed0 0x7f79940aced0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f7994061790 tx=0x7f798402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb10cc944bae8f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:25.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.404+0000 7f7991d9b640 1 -- 172.21.15.172:0/4163649237 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984037070 con 0x7f7994154ed0 2024-04-25T08:50:25.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.404+0000 7f7991d9b640 1 -- 172.21.15.172:0/4163649237 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7984032440 con 0x7f7994154ed0 2024-04-25T08:50:25.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.404+0000 7f7991d9b640 1 -- 172.21.15.172:0/4163649237 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984032810 con 0x7f7994154ed0 2024-04-25T08:50:25.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.405+0000 7f7998b70640 1 -- 172.21.15.172:0/4163649237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7994154ed0 msgr2=0x7f79940aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.405+0000 7f7998b70640 1 --2- 172.21.15.172:0/4163649237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7994154ed0 0x7f79940aced0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f7994061790 tx=0x7f798402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.405+0000 7f7998b70640 1 -- 172.21.15.172:0/4163649237 shutdown_connections 2024-04-25T08:50:25.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.405+0000 7f7998b70640 1 --2- 172.21.15.172:0/4163649237 >> v2:172.21.15.186:3300/0 conn(0x7f7994071ac0 0x7f79940ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.405+0000 7f7998b70640 1 --2- 172.21.15.172:0/4163649237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7994154ed0 0x7f79940aced0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.405+0000 7f7998b70640 1 -- 172.21.15.172:0/4163649237 >> 172.21.15.172:0/4163649237 conn(0x7f79940af670 msgr2=0x7f79940b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:25.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.405+0000 7f7998b70640 1 -- 172.21.15.172:0/4163649237 shutdown_connections 2024-04-25T08:50:25.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.405+0000 7f7998b70640 1 -- 172.21.15.172:0/4163649237 wait complete. 2024-04-25T08:50:25.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.406+0000 7f7998b70640 1 Processor -- start 2024-04-25T08:50:25.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.406+0000 7f7998b70640 1 -- start start 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7998b70640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7994071ac0 0x7f79940cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7998b70640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7994154ed0 0x7f79941509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7998b70640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79940cefc0 0x7f7994153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7998b70640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79940add20 con 0x7f79940cefc0 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7998b70640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79940adba0 con 0x7f7994071ac0 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7998b70640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7994161ee0 con 0x7f7994154ed0 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7992d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79940cefc0 0x7f7994153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7992d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79940cefc0 0x7f7994153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54008/0 (socket says 172.21.15.172:54008) 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7992d9d640 1 -- 172.21.15.172:0/2449858178 learned_addr learned my addr 172.21.15.172:0/2449858178 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f798bfff640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7994154ed0 0x7f79941509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f799259c640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7994071ac0 0x7f79940cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7992d9d640 1 -- 172.21.15.172:0/2449858178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7994154ed0 msgr2=0x7f79941509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7992d9d640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7994154ed0 0x7f79941509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7992d9d640 1 -- 172.21.15.172:0/2449858178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7994071ac0 msgr2=0x7f79940cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7992d9d640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7994071ac0 0x7f79940cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f7992d9d640 1 -- 172.21.15.172:0/2449858178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7994150ef0 con 0x7f79940cefc0 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.407+0000 7f799259c640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7994071ac0 0x7f79940cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.408+0000 7f7992d9d640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79940cefc0 0x7f7994153400 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f798c00c7b0 tx=0x7f798c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.408+0000 7f798affd640 1 -- 172.21.15.172:0/2449858178 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00ce60 con 0x7f79940cefc0 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.408+0000 7f798affd640 1 -- 172.21.15.172:0/2449858178 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c004b10 con 0x7f79940cefc0 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.408+0000 7f798affd640 1 -- 172.21.15.172:0/2449858178 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00a850 con 0x7f79940cefc0 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.408+0000 7f7998b70640 1 -- 172.21.15.172:0/2449858178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79940cddd0 con 0x7f79940cefc0 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.408+0000 7f7998b70640 1 -- 172.21.15.172:0/2449858178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79940cd810 con 0x7f79940cefc0 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.409+0000 7f7998b70640 1 -- 172.21.15.172:0/2449858178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79940b2b10 con 0x7f79940cefc0 2024-04-25T08:50:25.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.409+0000 7f798affd640 1 -- 172.21.15.172:0/2449858178 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f798c00a9f0 con 0x7f79940cefc0 2024-04-25T08:50:25.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.410+0000 7f798affd640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f797406b500 0x7f797406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:25.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.410+0000 7f798affd640 1 -- 172.21.15.172:0/2449858178 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f798c08a510 con 0x7f79940cefc0 2024-04-25T08:50:25.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.410+0000 7f799259c640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f797406b500 0x7f797406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:25.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.410+0000 7f799259c640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f797406b500 0x7f797406d9c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7984034000 tx=0x7f798402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:25.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.414+0000 7f798affd640 1 -- 172.21.15.172:0/2449858178 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f798c020070 con 0x7f79940cefc0 2024-04-25T08:50:25.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.649+0000 7f7998b70640 1 -- 172.21.15.172:0/2449858178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7994073990 con 0x7f79940cefc0 2024-04-25T08:50:25.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.650+0000 7f798affd640 1 -- 172.21.15.172:0/2449858178 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1444 (secure 0 0 0) 0x7f7994150ef0 con 0x7f79940cefc0 2024-04-25T08:50:25.641 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:25.641 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":501,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":842,"data_bytes":859461282,"bytes_used":1993973760,"bytes_avail":771100139520,"bytes_total":773094113280,"write_bytes_sec":71564499,"read_op_per_sec":0,"write_op_per_sec":69},"fsmap":{"epoch":68,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-04-25T08:49:52.603883+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:25.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 -- 172.21.15.172:0/2449858178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f797406b500 msgr2=0x7f797406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f797406b500 0x7f797406d9c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7984034000 tx=0x7f798402e000 comp rx=0 tx=0).stop 2024-04-25T08:50:25.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 -- 172.21.15.172:0/2449858178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79940cefc0 msgr2=0x7f7994153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:25.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79940cefc0 0x7f7994153400 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f798c00c7b0 tx=0x7f798c00cc70 comp rx=0 tx=0).stop 2024-04-25T08:50:25.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 -- 172.21.15.172:0/2449858178 shutdown_connections 2024-04-25T08:50:25.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f797406b500 0x7f797406d9c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79940cefc0 0x7f7994153400 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7994154ed0 0x7f79941509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 --2- 172.21.15.172:0/2449858178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7994071ac0 0x7f79940cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:25.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 -- 172.21.15.172:0/2449858178 >> 172.21.15.172:0/2449858178 conn(0x7f799406c1d0 msgr2=0x7f799406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:25.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 -- 172.21.15.172:0/2449858178 shutdown_connections 2024-04-25T08:50:25.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:25.652+0000 7f7998b70640 1 -- 172.21.15.172:0/2449858178 wait complete. 2024-04-25T08:50:25.653 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T08:50:26.655 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:26.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.764+0000 7f5a4d74f640 1 Processor -- start 2024-04-25T08:50:26.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.764+0000 7f5a4d74f640 1 -- start start 2024-04-25T08:50:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.765+0000 7f5a4d74f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5a480af720 0x7f5a480afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.765+0000 7f5a4d74f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5a480d02f0 0x7f5a480d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.765+0000 7f5a4d74f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4806fe00 con 0x7f5a48158220 2024-04-25T08:50:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.765+0000 7f5a4d74f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a480b3670 con 0x7f5a480af720 2024-04-25T08:50:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.765+0000 7f5a4d74f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a48070a10 con 0x7f5a480d02f0 2024-04-25T08:50:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.765+0000 7f5a467fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5a480af720 0x7f5a480afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.765+0000 7f5a467fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5a480af720 0x7f5a480afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54024/0 (socket says 172.21.15.172:54024) 2024-04-25T08:50:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.765+0000 7f5a467fc640 1 -- 172.21.15.172:0/3228534350 learned_addr learned my addr 172.21.15.172:0/3228534350 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.766+0000 7f5a477fe640 1 --2- 172.21.15.172:0/3228534350 >> v2:172.21.15.186:3300/0 conn(0x7f5a480d02f0 0x7f5a480d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:26.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.766+0000 7f5a467fc640 1 -- 172.21.15.172:0/3228534350 >> v2:172.21.15.186:3300/0 conn(0x7f5a480d02f0 msgr2=0x7f5a480d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.766+0000 7f5a467fc640 1 --2- 172.21.15.172:0/3228534350 >> v2:172.21.15.186:3300/0 conn(0x7f5a480d02f0 0x7f5a480d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.766+0000 7f5a467fc640 1 -- 172.21.15.172:0/3228534350 >> v1:172.21.15.186:6789/0 conn(0x7f5a48158220 legacy=0x7f5a4815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.766+0000 7f5a467fc640 1 -- 172.21.15.172:0/3228534350 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480700e0 con 0x7f5a480af720 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.766+0000 7f5a477fe640 1 --2- 172.21.15.172:0/3228534350 >> v2:172.21.15.186:3300/0 conn(0x7f5a480d02f0 0x7f5a480d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.766+0000 7f5a467fc640 1 --2- 172.21.15.172:0/3228534350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480af720 0x7f5a480afba0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5a480726d0 tx=0x7f5a3c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177b3d8ada5a06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.766+0000 7f5a45ffb640 1 -- 172.21.15.172:0/3228534350 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c037070 con 0x7f5a480af720 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.766+0000 7f5a45ffb640 1 -- 172.21.15.172:0/3228534350 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c032440 con 0x7f5a480af720 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.766+0000 7f5a45ffb640 1 -- 172.21.15.172:0/3228534350 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c032810 con 0x7f5a480af720 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.767+0000 7f5a4d74f640 1 -- 172.21.15.172:0/3228534350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480af720 msgr2=0x7f5a480afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.767+0000 7f5a4d74f640 1 --2- 172.21.15.172:0/3228534350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480af720 0x7f5a480afba0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5a480726d0 tx=0x7f5a3c02a230 comp rx=0 tx=0).stop 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.767+0000 7f5a4d74f640 1 -- 172.21.15.172:0/3228534350 shutdown_connections 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.767+0000 7f5a4d74f640 1 --2- 172.21.15.172:0/3228534350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480af720 0x7f5a480afba0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.767+0000 7f5a4d74f640 1 --2- 172.21.15.172:0/3228534350 >> v2:172.21.15.186:3300/0 conn(0x7f5a480d02f0 0x7f5a480d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.767+0000 7f5a4d74f640 1 -- 172.21.15.172:0/3228534350 >> 172.21.15.172:0/3228534350 conn(0x7f5a480b2370 msgr2=0x7f5a480b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:26.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.767+0000 7f5a4d74f640 1 -- 172.21.15.172:0/3228534350 shutdown_connections 2024-04-25T08:50:26.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.767+0000 7f5a4d74f640 1 -- 172.21.15.172:0/3228534350 wait complete. 2024-04-25T08:50:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.768+0000 7f5a4d74f640 1 Processor -- start 2024-04-25T08:50:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.768+0000 7f5a4d74f640 1 -- start start 2024-04-25T08:50:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a4d74f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a480af720 0x7f5a480c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a4d74f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480d02f0 0x7f5a48154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a4d74f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a48158220 0x7f5a4815fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a4d74f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48158600 con 0x7f5a480d02f0 2024-04-25T08:50:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a4d74f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480706a0 con 0x7f5a480af720 2024-04-25T08:50:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a4d74f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48072960 con 0x7f5a48158220 2024-04-25T08:50:26.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a467fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480d02f0 0x7f5a48154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a467fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480d02f0 0x7f5a48154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54040/0 (socket says 172.21.15.172:54040) 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a467fc640 1 -- 172.21.15.172:0/596260739 learned_addr learned my addr 172.21.15.172:0/596260739 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a467fc640 1 -- 172.21.15.172:0/596260739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a48158220 msgr2=0x7f5a4815fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a467fc640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a48158220 0x7f5a4815fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a467fc640 1 -- 172.21.15.172:0/596260739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a480af720 msgr2=0x7f5a480c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a467fc640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a480af720 0x7f5a480c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.769+0000 7f5a467fc640 1 -- 172.21.15.172:0/596260739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a48160ff0 con 0x7f5a480d02f0 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.770+0000 7f5a467fc640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480d02f0 0x7f5a48154710 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c02a270 tx=0x7f5a3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.770+0000 7f5a2f7fe640 1 -- 172.21.15.172:0/596260739 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c037040 con 0x7f5a480d02f0 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.770+0000 7f5a2f7fe640 1 -- 172.21.15.172:0/596260739 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c042070 con 0x7f5a480d02f0 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.770+0000 7f5a4d74f640 1 -- 172.21.15.172:0/596260739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a48160a30 con 0x7f5a480d02f0 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.770+0000 7f5a2f7fe640 1 -- 172.21.15.172:0/596260739 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c030bb0 con 0x7f5a480d02f0 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.770+0000 7f5a4d74f640 1 -- 172.21.15.172:0/596260739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a48158890 con 0x7f5a480d02f0 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.771+0000 7f5a4d74f640 1 -- 172.21.15.172:0/596260739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a48073990 con 0x7f5a480d02f0 2024-04-25T08:50:26.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.771+0000 7f5a2f7fe640 1 -- 172.21.15.172:0/596260739 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5a3c047460 con 0x7f5a480d02f0 2024-04-25T08:50:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.772+0000 7f5a2f7fe640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a3406b4d0 0x7f5a3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.772+0000 7f5a46ffd640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a3406b4d0 0x7f5a3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.772+0000 7f5a2f7fe640 1 -- 172.21.15.172:0/596260739 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5a3c0ab0a0 con 0x7f5a480d02f0 2024-04-25T08:50:26.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.772+0000 7f5a46ffd640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a3406b4d0 0x7f5a3406d990 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5a400043c0 tx=0x7f5a40007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:26.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.776+0000 7f5a2f7fe640 1 -- 172.21.15.172:0/596260739 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a3c045360 con 0x7f5a480d02f0 2024-04-25T08:50:26.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.983+0000 7f5a4d74f640 1 -- 172.21.15.172:0/596260739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a481564a0 con 0x7f5a480d02f0 2024-04-25T08:50:26.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.983+0000 7f5a2f7fe640 1 -- 172.21.15.172:0/596260739 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f5a3c079d00 con 0x7f5a480d02f0 2024-04-25T08:50:26.974 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:26.974 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:26.974 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:26.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 -- 172.21.15.172:0/596260739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a3406b4d0 msgr2=0x7f5a3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:26.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a3406b4d0 0x7f5a3406d990 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5a400043c0 tx=0x7f5a40007d30 comp rx=0 tx=0).stop 2024-04-25T08:50:26.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 -- 172.21.15.172:0/596260739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480d02f0 msgr2=0x7f5a48154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:26.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480d02f0 0x7f5a48154710 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c02a270 tx=0x7f5a3c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:26.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 -- 172.21.15.172:0/596260739 shutdown_connections 2024-04-25T08:50:26.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5a3406b4d0 0x7f5a3406d990 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:26.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a48158220 0x7f5a4815fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:26.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a480d02f0 0x7f5a48154710 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:26.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 --2- 172.21.15.172:0/596260739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a480af720 0x7f5a480c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:26.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 -- 172.21.15.172:0/596260739 >> 172.21.15.172:0/596260739 conn(0x7f5a480b2370 msgr2=0x7f5a480cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:26.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 -- 172.21.15.172:0/596260739 shutdown_connections 2024-04-25T08:50:26.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:26.985+0000 7f5a4d74f640 1 -- 172.21.15.172:0/596260739 wait complete. 2024-04-25T08:50:26.987 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:50:26.987 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:27.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.093+0000 7fa73799e640 1 Processor -- start 2024-04-25T08:50:27.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.093+0000 7fa73799e640 1 -- start start 2024-04-25T08:50:27.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.094+0000 7fa73799e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa73006ce10 0x7fa7300d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:27.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.094+0000 7fa73799e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73009a860 con 0x7fa73015dbb0 2024-04-25T08:50:27.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.094+0000 7fa73799e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7300d0130 con 0x7fa73009a450 2024-04-25T08:50:27.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.094+0000 7fa73799e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7300d0d40 con 0x7fa73006ce10 2024-04-25T08:50:27.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.094+0000 7fa73573a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa73015dbb0 0x7fa73006c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:59210/0 (socket says 172.21.15.172:59210) 2024-04-25T08:50:27.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.094+0000 7fa73573a640 1 -- 172.21.15.172:0/1038356799 learned_addr learned my addr 172.21.15.172:0/1038356799 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:27.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.094+0000 7fa734f39640 1 --2- 172.21.15.172:0/1038356799 >> v2:172.21.15.186:3300/0 conn(0x7fa73006ce10 0x7fa7300d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:27.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.094+0000 7fa727fff640 1 -- 172.21.15.172:0/1038356799 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450789887 0 0) 0x7fa73009a860 con 0x7fa73015dbb0 2024-04-25T08:50:27.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.094+0000 7fa727fff640 1 -- 172.21.15.172:0/1038356799 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa71c003520 con 0x7fa73015dbb0 2024-04-25T08:50:27.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.095+0000 7fa727fff640 1 -- 172.21.15.172:0/1038356799 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3661517077 0 0) 0x7fa71c003520 con 0x7fa73015dbb0 2024-04-25T08:50:27.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.095+0000 7fa734f39640 1 -- 172.21.15.172:0/1038356799 >> v1:172.21.15.186:6789/0 conn(0x7fa73009a450 legacy=0x7fa7300cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:27.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.095+0000 7fa734f39640 1 -- 172.21.15.172:0/1038356799 >> v1:172.21.15.172:6789/0 conn(0x7fa73015dbb0 legacy=0x7fa73006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:27.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.095+0000 7fa734f39640 1 -- 172.21.15.172:0/1038356799 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300d0410 con 0x7fa73006ce10 2024-04-25T08:50:27.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.095+0000 7fa734f39640 1 --2- 172.21.15.172:0/1038356799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa73006ce10 0x7fa7300d11d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa7200097a0 tx=0x7fa72002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbfa53288eed24ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:27.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.096+0000 7fa727fff640 1 -- 172.21.15.172:0/1038356799 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa720037070 con 0x7fa73006ce10 2024-04-25T08:50:27.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.096+0000 7fa727fff640 1 -- 172.21.15.172:0/1038356799 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72002ac50 con 0x7fa73006ce10 2024-04-25T08:50:27.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.096+0000 7fa727fff640 1 -- 172.21.15.172:0/1038356799 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c001670 con 0x7fa73006ce10 2024-04-25T08:50:27.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.096+0000 7fa73799e640 1 -- 172.21.15.172:0/1038356799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa73006ce10 msgr2=0x7fa7300d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:27.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.096+0000 7fa73799e640 1 --2- 172.21.15.172:0/1038356799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa73006ce10 0x7fa7300d11d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa7200097a0 tx=0x7fa72002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:50:27.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.096+0000 7fa73799e640 1 -- 172.21.15.172:0/1038356799 shutdown_connections 2024-04-25T08:50:27.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.096+0000 7fa73799e640 1 --2- 172.21.15.172:0/1038356799 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa73006ce10 0x7fa7300d11d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:27.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.096+0000 7fa73799e640 1 -- 172.21.15.172:0/1038356799 >> 172.21.15.172:0/1038356799 conn(0x7fa7300b3270 msgr2=0x7fa7300b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:27.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.096+0000 7fa73799e640 1 -- 172.21.15.172:0/1038356799 shutdown_connections 2024-04-25T08:50:27.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.096+0000 7fa73799e640 1 -- 172.21.15.172:0/1038356799 wait complete. 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73799e640 1 Processor -- start 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73799e640 1 -- start start 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73799e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa73006ce10 0x7fa730153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73799e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa73009a450 0x7fa7300b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73799e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa73015dbb0 0x7fa7300b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73799e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73015df90 con 0x7fa73006ce10 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73799e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7300d09d0 con 0x7fa73015dbb0 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73799e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73015e110 con 0x7fa73009a450 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73573a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa73006ce10 0x7fa730153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73573a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa73006ce10 0x7fa730153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54042/0 (socket says 172.21.15.172:54042) 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.098+0000 7fa73573a640 1 -- 172.21.15.172:0/178936607 learned_addr learned my addr 172.21.15.172:0/178936607 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:27.091 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa735f3b640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa73015dbb0 0x7fa7300b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa734f39640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa73009a450 0x7fa7300b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa73573a640 1 -- 172.21.15.172:0/178936607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa73009a450 msgr2=0x7fa7300b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa73573a640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa73009a450 0x7fa7300b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa73573a640 1 -- 172.21.15.172:0/178936607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa73015dbb0 msgr2=0x7fa7300b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa73573a640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa73015dbb0 0x7fa7300b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa73573a640 1 -- 172.21.15.172:0/178936607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300ae7d0 con 0x7fa73006ce10 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa73573a640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa73006ce10 0x7fa730153b10 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00c580 tx=0x7fa72c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa725ffb640 1 -- 172.21.15.172:0/178936607 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c017070 con 0x7fa73006ce10 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa725ffb640 1 -- 172.21.15.172:0/178936607 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c005ce0 con 0x7fa73006ce10 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa73799e640 1 -- 172.21.15.172:0/178936607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7300aea70 con 0x7fa73006ce10 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa725ffb640 1 -- 172.21.15.172:0/178936607 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c007330 con 0x7fa73006ce10 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.099+0000 7fa73799e640 1 -- 172.21.15.172:0/178936607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7300af030 con 0x7fa73006ce10 2024-04-25T08:50:27.092 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.100+0000 7fa73799e640 1 -- 172.21.15.172:0/178936607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa730073990 con 0x7fa73006ce10 2024-04-25T08:50:27.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.101+0000 7fa725ffb640 1 -- 172.21.15.172:0/178936607 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa72c01a070 con 0x7fa73006ce10 2024-04-25T08:50:27.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.101+0000 7fa725ffb640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71406b500 0x7fa71406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:27.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.101+0000 7fa725ffb640 1 -- 172.21.15.172:0/178936607 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa72c0897e0 con 0x7fa73006ce10 2024-04-25T08:50:27.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.101+0000 7fa734f39640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71406b500 0x7fa71406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:27.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.102+0000 7fa734f39640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71406b500 0x7fa71406d9c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa720034000 tx=0x7fa72002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:27.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.106+0000 7fa725ffb640 1 -- 172.21.15.172:0/178936607 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa72c057e90 con 0x7fa73006ce10 2024-04-25T08:50:27.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.343+0000 7fa73799e640 1 -- 172.21.15.172:0/178936607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa73009a170 con 0x7fa73006ce10 2024-04-25T08:50:27.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.343+0000 7fa725ffb640 1 -- 172.21.15.172:0/178936607 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1446 (secure 0 0 0) 0x7fa72c05bf30 con 0x7fa73006ce10 2024-04-25T08:50:27.335 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:27.335 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":502,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2541289472,"bytes_avail":770552823808,"bytes_total":773094113280,"write_bytes_sec":89655885,"read_op_per_sec":0,"write_op_per_sec":87},"fsmap":{"epoch":68,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-04-25T08:49:52.603883+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:27.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.345+0000 7fa73799e640 1 -- 172.21.15.172:0/178936607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71406b500 msgr2=0x7fa71406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.345+0000 7fa73799e640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71406b500 0x7fa71406d9c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa720034000 tx=0x7fa72002e000 comp rx=0 tx=0).stop 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.346+0000 7fa73799e640 1 -- 172.21.15.172:0/178936607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa73006ce10 msgr2=0x7fa730153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.346+0000 7fa73799e640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa73006ce10 0x7fa730153b10 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00c580 tx=0x7fa72c00ca40 comp rx=0 tx=0).stop 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.346+0000 7fa73799e640 1 -- 172.21.15.172:0/178936607 shutdown_connections 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.346+0000 7fa73799e640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa71406b500 0x7fa71406d9c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.346+0000 7fa73799e640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa73015dbb0 0x7fa7300b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.346+0000 7fa73799e640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa73009a450 0x7fa7300b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.346+0000 7fa73799e640 1 --2- 172.21.15.172:0/178936607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa73006ce10 0x7fa730153b10 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.346+0000 7fa73799e640 1 -- 172.21.15.172:0/178936607 >> 172.21.15.172:0/178936607 conn(0x7fa7300b3270 msgr2=0x7fa73006f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.346+0000 7fa73799e640 1 -- 172.21.15.172:0/178936607 shutdown_connections 2024-04-25T08:50:27.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:27.346+0000 7fa73799e640 1 -- 172.21.15.172:0/178936607 wait complete. 2024-04-25T08:50:27.347 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T08:50:28.348 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:28.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.466+0000 7ff90248f640 1 Processor -- start 2024-04-25T08:50:28.457 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.466+0000 7ff90248f640 1 -- start start 2024-04-25T08:50:28.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.467+0000 7ff90248f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8fc15dbe0 0x7ff8fc0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.467+0000 7ff90248f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff8fc0b2cb0 0x7ff8fc0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.467+0000 7ff90248f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff8fc0b92a0 0x7ff8fc0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.467+0000 7ff90248f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc15dfc0 con 0x7ff8fc0b92a0 2024-04-25T08:50:28.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.467+0000 7ff90248f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc0d1a00 con 0x7ff8fc0b2cb0 2024-04-25T08:50:28.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.467+0000 7ff90248f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0b97a0 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.467+0000 7ff900a2c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff8fc0b92a0 0x7ff8fc0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.467+0000 7ff900a2c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff8fc0b92a0 0x7ff8fc0b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33424/0 (socket says 172.21.15.172:33424) 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.468+0000 7ff900a2c640 1 -- 172.21.15.172:0/2074208410 learned_addr learned my addr 172.21.15.172:0/2074208410 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.468+0000 7ff8fbfff640 1 --2- 172.21.15.172:0/2074208410 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8fc15dbe0 0x7ff8fc0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.468+0000 7ff8fb7fe640 1 --2- 172.21.15.172:0/2074208410 >> v2:172.21.15.186:3300/0 conn(0x7ff8fc0b2cb0 0x7ff8fc0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.468+0000 7ff900a2c640 1 -- 172.21.15.172:0/2074208410 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8fc15dbe0 msgr2=0x7ff8fc0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.468+0000 7ff900a2c640 1 --2- 172.21.15.172:0/2074208410 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8fc15dbe0 0x7ff8fc0d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.468+0000 7ff900a2c640 1 -- 172.21.15.172:0/2074208410 >> v2:172.21.15.186:3300/0 conn(0x7ff8fc0b2cb0 msgr2=0x7ff8fc0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.468+0000 7ff900a2c640 1 --2- 172.21.15.172:0/2074208410 >> v2:172.21.15.186:3300/0 conn(0x7ff8fc0b2cb0 0x7ff8fc0d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.468+0000 7ff900a2c640 1 -- 172.21.15.172:0/2074208410 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc0d1c50 con 0x7ff8fc0b92a0 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.468+0000 7ff900a2c640 1 --2- 172.21.15.172:0/2074208410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc0b92a0 0x7ff8fc0b5400 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0b64d0 tx=0x7ff8f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec2ff6cad150ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff8faffd640 1 -- 172.21.15.172:0/2074208410 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4036070 con 0x7ff8fc0b92a0 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff8faffd640 1 -- 172.21.15.172:0/2074208410 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f4031600 con 0x7ff8fc0b92a0 2024-04-25T08:50:28.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff8faffd640 1 -- 172.21.15.172:0/2074208410 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f40319d0 con 0x7ff8fc0b92a0 2024-04-25T08:50:28.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff90248f640 1 -- 172.21.15.172:0/2074208410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc0b92a0 msgr2=0x7ff8fc0b5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:28.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff90248f640 1 --2- 172.21.15.172:0/2074208410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc0b92a0 0x7ff8fc0b5400 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0b64d0 tx=0x7ff8f402a6a0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff90248f640 1 -- 172.21.15.172:0/2074208410 shutdown_connections 2024-04-25T08:50:28.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff90248f640 1 --2- 172.21.15.172:0/2074208410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc0b92a0 0x7ff8fc0b5400 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff90248f640 1 --2- 172.21.15.172:0/2074208410 >> v2:172.21.15.186:3300/0 conn(0x7ff8fc0b2cb0 0x7ff8fc0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff90248f640 1 --2- 172.21.15.172:0/2074208410 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8fc15dbe0 0x7ff8fc0d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff90248f640 1 -- 172.21.15.172:0/2074208410 >> 172.21.15.172:0/2074208410 conn(0x7ff8fc061a20 msgr2=0x7ff8fc061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:28.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff90248f640 1 -- 172.21.15.172:0/2074208410 shutdown_connections 2024-04-25T08:50:28.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.469+0000 7ff90248f640 1 -- 172.21.15.172:0/2074208410 wait complete. 2024-04-25T08:50:28.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.471+0000 7ff90248f640 1 Processor -- start 2024-04-25T08:50:28.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.471+0000 7ff90248f640 1 -- start start 2024-04-25T08:50:28.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.471+0000 7ff90248f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8fc0b2cb0 0x7ff8fc0b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.471+0000 7ff90248f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8fc0b92a0 0x7ff8fc15fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.471+0000 7ff90248f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc15dbe0 0x7ff8fc15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.471+0000 7ff90248f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0b6ab0 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.471+0000 7ff90248f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0d2210 con 0x7ff8fc0b92a0 2024-04-25T08:50:28.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.471+0000 7ff90248f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc0b6c30 con 0x7ff8fc0b2cb0 2024-04-25T08:50:28.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff900a2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc15dbe0 0x7ff8fc15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff900a2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc15dbe0 0x7ff8fc15c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33440/0 (socket says 172.21.15.172:33440) 2024-04-25T08:50:28.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff900a2c640 1 -- 172.21.15.172:0/2918909318 learned_addr learned my addr 172.21.15.172:0/2918909318 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:28.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff8fbfff640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8fc0b2cb0 0x7ff8fc0b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff8fb7fe640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8fc0b92a0 0x7ff8fc15fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff900a2c640 1 -- 172.21.15.172:0/2918909318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8fc0b2cb0 msgr2=0x7ff8fc0b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:28.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff900a2c640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8fc0b2cb0 0x7ff8fc0b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff900a2c640 1 -- 172.21.15.172:0/2918909318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8fc0b92a0 msgr2=0x7ff8fc15fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:28.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff900a2c640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8fc0b92a0 0x7ff8fc15fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff900a2c640 1 -- 172.21.15.172:0/2918909318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc1600c0 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff8fb7fe640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8fc0b92a0 0x7ff8fc15fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:28.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff900a2c640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc15dbe0 0x7ff8fc15c1d0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7ff8f402ac90 tx=0x7ff8f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:28.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff8f8ff9640 1 -- 172.21.15.172:0/2918909318 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f403f020 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff8f8ff9640 1 -- 172.21.15.172:0/2918909318 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f4037040 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff90248f640 1 -- 172.21.15.172:0/2918909318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc0cc990 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff8f8ff9640 1 -- 172.21.15.172:0/2918909318 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4036070 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.472+0000 7ff90248f640 1 -- 172.21.15.172:0/2918909318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc0ccf50 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.474+0000 7ff90248f640 1 -- 172.21.15.172:0/2918909318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc073990 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.474+0000 7ff8f8ff9640 1 -- 172.21.15.172:0/2918909318 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff8f4042020 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.474+0000 7ff8f8ff9640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8e806b4d0 0x7ff8e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.475+0000 7ff8f8ff9640 1 -- 172.21.15.172:0/2918909318 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff8f40aaba0 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.475+0000 7ff8fbfff640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8e806b4d0 0x7ff8e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.475+0000 7ff8fbfff640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8e806b4d0 0x7ff8e806d990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec006fd0 tx=0x7ff8ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:28.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.479+0000 7ff8f8ff9640 1 -- 172.21.15.172:0/2918909318 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff8f4049020 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.686+0000 7ff90248f640 1 -- 172.21.15.172:0/2918909318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8fc159ca0 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.677 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.687+0000 7ff8f8ff9640 1 -- 172.21.15.172:0/2918909318 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7ff8f4079890 con 0x7ff8fc15dbe0 2024-04-25T08:50:28.678 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:28.678 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:28.678 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:28.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 -- 172.21.15.172:0/2918909318 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8e806b4d0 msgr2=0x7ff8e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:28.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8e806b4d0 0x7ff8e806d990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec006fd0 tx=0x7ff8ec008040 comp rx=0 tx=0).stop 2024-04-25T08:50:28.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 -- 172.21.15.172:0/2918909318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc15dbe0 msgr2=0x7ff8fc15c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:28.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc15dbe0 0x7ff8fc15c1d0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7ff8f402ac90 tx=0x7ff8f4004a40 comp rx=0 tx=0).stop 2024-04-25T08:50:28.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 -- 172.21.15.172:0/2918909318 shutdown_connections 2024-04-25T08:50:28.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8e806b4d0 0x7ff8e806d990 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8fc0b92a0 0x7ff8fc15fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc15dbe0 0x7ff8fc15c1d0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 --2- 172.21.15.172:0/2918909318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8fc0b2cb0 0x7ff8fc0b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.680 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 -- 172.21.15.172:0/2918909318 >> 172.21.15.172:0/2918909318 conn(0x7ff8fc061a20 msgr2=0x7ff8fc0b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:28.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 -- 172.21.15.172:0/2918909318 shutdown_connections 2024-04-25T08:50:28.681 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.689+0000 7ff90248f640 1 -- 172.21.15.172:0/2918909318 wait complete. 2024-04-25T08:50:28.691 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:50:28.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:28.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.797+0000 7f7d84abd640 1 Processor -- start 2024-04-25T08:50:28.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.797+0000 7f7d84abd640 1 -- start start 2024-04-25T08:50:28.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d84abd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7d800d0170 0x7f7d800ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d84abd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d800ce700 0x7f7d8006c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d84abd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d800c8030 con 0x7f7d8015da70 2024-04-25T08:50:28.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d84abd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d800ceb30 con 0x7f7d800ce700 2024-04-25T08:50:28.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d84abd640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d800c8310 con 0x7f7d800d0170 2024-04-25T08:50:28.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d7ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d800ce700 0x7f7d8006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d7ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d800ce700 0x7f7d8006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33456/0 (socket says 172.21.15.172:33456) 2024-04-25T08:50:28.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d7ed9d640 1 -- 172.21.15.172:0/1970203517 learned_addr learned my addr 172.21.15.172:0/1970203517 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:28.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d7ed9d640 1 -- 172.21.15.172:0/1970203517 >> v2:172.21.15.186:3300/0 conn(0x7f7d800d0170 msgr2=0x7f7d800ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:28.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d7ed9d640 1 --2- 172.21.15.172:0/1970203517 >> v2:172.21.15.186:3300/0 conn(0x7f7d800d0170 0x7f7d800ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d7ed9d640 1 -- 172.21.15.172:0/1970203517 >> v1:172.21.15.186:6789/0 conn(0x7f7d8015da70 legacy=0x7f7d800c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:28.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.798+0000 7f7d7ed9d640 1 -- 172.21.15.172:0/1970203517 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d800c85f0 con 0x7f7d800ce700 2024-04-25T08:50:28.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.799+0000 7f7d7ed9d640 1 --2- 172.21.15.172:0/1970203517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d800ce700 0x7f7d8006c330 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f7d800b1040 tx=0x7f7d7802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8dc94a4cfd63182 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:28.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.799+0000 7f7d7d59a640 1 -- 172.21.15.172:0/1970203517 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78036070 con 0x7f7d800ce700 2024-04-25T08:50:28.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.799+0000 7f7d7d59a640 1 -- 172.21.15.172:0/1970203517 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78031600 con 0x7f7d800ce700 2024-04-25T08:50:28.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.799+0000 7f7d7d59a640 1 -- 172.21.15.172:0/1970203517 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d780319d0 con 0x7f7d800ce700 2024-04-25T08:50:28.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.800+0000 7f7d84abd640 1 -- 172.21.15.172:0/1970203517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d800ce700 msgr2=0x7f7d8006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:28.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.800+0000 7f7d84abd640 1 --2- 172.21.15.172:0/1970203517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d800ce700 0x7f7d8006c330 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f7d800b1040 tx=0x7f7d7802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.800+0000 7f7d84abd640 1 -- 172.21.15.172:0/1970203517 shutdown_connections 2024-04-25T08:50:28.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.800+0000 7f7d84abd640 1 --2- 172.21.15.172:0/1970203517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d800ce700 0x7f7d8006c330 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.800+0000 7f7d84abd640 1 --2- 172.21.15.172:0/1970203517 >> v2:172.21.15.186:3300/0 conn(0x7f7d800d0170 0x7f7d800ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.800+0000 7f7d84abd640 1 -- 172.21.15.172:0/1970203517 >> 172.21.15.172:0/1970203517 conn(0x7f7d800b33e0 msgr2=0x7f7d800b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:28.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.800+0000 7f7d84abd640 1 -- 172.21.15.172:0/1970203517 shutdown_connections 2024-04-25T08:50:28.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.800+0000 7f7d84abd640 1 -- 172.21.15.172:0/1970203517 wait complete. 2024-04-25T08:50:28.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.801+0000 7f7d84abd640 1 Processor -- start 2024-04-25T08:50:28.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.801+0000 7f7d84abd640 1 -- start start 2024-04-25T08:50:28.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d84abd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d800ce700 0x7f7d800c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d84abd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d800d0170 0x7f7d800ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d84abd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8015da70 0x7f7d80152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d84abd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8015de50 con 0x7f7d8015da70 2024-04-25T08:50:28.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d84abd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8006be10 con 0x7f7d800d0170 2024-04-25T08:50:28.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d84abd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8006c870 con 0x7f7d800ce700 2024-04-25T08:50:28.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8015da70 0x7f7d80152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8015da70 0x7f7d80152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33472/0 (socket says 172.21.15.172:33472) 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7ed9d640 1 -- 172.21.15.172:0/1592062734 learned_addr learned my addr 172.21.15.172:0/1592062734 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7dd9b640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d800d0170 0x7f7d800ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7e59c640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d800ce700 0x7f7d800c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7ed9d640 1 -- 172.21.15.172:0/1592062734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d800ce700 msgr2=0x7f7d800c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7ed9d640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d800ce700 0x7f7d800c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7ed9d640 1 -- 172.21.15.172:0/1592062734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d800d0170 msgr2=0x7f7d800ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7ed9d640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d800d0170 0x7f7d800ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7ed9d640 1 -- 172.21.15.172:0/1592062734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d800cd8a0 con 0x7f7d8015da70 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7dd9b640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d800d0170 0x7f7d800ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7e59c640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d800ce700 0x7f7d800c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.802+0000 7f7d7ed9d640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8015da70 0x7f7d80152c10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009f40 tx=0x7f7d78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.803+0000 7f7d6effd640 1 -- 172.21.15.172:0/1592062734 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78041020 con 0x7f7d8015da70 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.803+0000 7f7d6effd640 1 -- 172.21.15.172:0/1592062734 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78007780 con 0x7f7d8015da70 2024-04-25T08:50:28.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.803+0000 7f7d84abd640 1 -- 172.21.15.172:0/1592062734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8015eab0 con 0x7f7d8015da70 2024-04-25T08:50:28.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.803+0000 7f7d6effd640 1 -- 172.21.15.172:0/1592062734 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78036040 con 0x7f7d8015da70 2024-04-25T08:50:28.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.803+0000 7f7d84abd640 1 -- 172.21.15.172:0/1592062734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8015e7a0 con 0x7f7d8015da70 2024-04-25T08:50:28.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.804+0000 7f7d84abd640 1 -- 172.21.15.172:0/1592062734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d80073990 con 0x7f7d8015da70 2024-04-25T08:50:28.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.804+0000 7f7d6effd640 1 -- 172.21.15.172:0/1592062734 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d78044020 con 0x7f7d8015da70 2024-04-25T08:50:28.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.804+0000 7f7d6effd640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d6006b4d0 0x7f7d6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:28.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.805+0000 7f7d6effd640 1 -- 172.21.15.172:0/1592062734 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7d780ab0e0 con 0x7f7d8015da70 2024-04-25T08:50:28.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.805+0000 7f7d7e59c640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d6006b4d0 0x7f7d6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:28.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.805+0000 7f7d7e59c640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d6006b4d0 0x7f7d6006d990 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000a810 tx=0x7f7d70008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:28.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:28.809+0000 7f7d6effd640 1 -- 172.21.15.172:0/1592062734 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7d7804b030 con 0x7f7d8015da70 2024-04-25T08:50:29.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.047+0000 7f7d84abd640 1 -- 172.21.15.172:0/1592062734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7d8015f230 con 0x7f7d8015da70 2024-04-25T08:50:29.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.048+0000 7f7d6effd640 1 -- 172.21.15.172:0/1592062734 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1446 (secure 0 0 0) 0x7f7d78079f20 con 0x7f7d8015da70 2024-04-25T08:50:29.038 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:29.039 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":504,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2541289472,"bytes_avail":770552823808,"bytes_total":773094113280,"write_bytes_sec":89655885,"read_op_per_sec":0,"write_op_per_sec":87},"fsmap":{"epoch":68,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-04-25T08:49:52.603883+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:29.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 -- 172.21.15.172:0/1592062734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d6006b4d0 msgr2=0x7f7d6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:29.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d6006b4d0 0x7f7d6006d990 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000a810 tx=0x7f7d70008040 comp rx=0 tx=0).stop 2024-04-25T08:50:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 -- 172.21.15.172:0/1592062734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8015da70 msgr2=0x7f7d80152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8015da70 0x7f7d80152c10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009f40 tx=0x7f7d78004a40 comp rx=0 tx=0).stop 2024-04-25T08:50:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 -- 172.21.15.172:0/1592062734 shutdown_connections 2024-04-25T08:50:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d6006b4d0 0x7f7d6006d990 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d800d0170 0x7f7d800ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8015da70 0x7f7d80152c10 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 --2- 172.21.15.172:0/1592062734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d800ce700 0x7f7d800c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 -- 172.21.15.172:0/1592062734 >> 172.21.15.172:0/1592062734 conn(0x7f7d800b33e0 msgr2=0x7f7d800c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 -- 172.21.15.172:0/1592062734 shutdown_connections 2024-04-25T08:50:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:29.050+0000 7f7d84abd640 1 -- 172.21.15.172:0/1592062734 wait complete. 2024-04-25T08:50:29.051 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T08:50:30.052 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:30.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.171+0000 7f081a389640 1 Processor -- start 2024-04-25T08:50:30.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.171+0000 7f081a389640 1 -- start start 2024-04-25T08:50:30.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f081a389640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f081406abe0 0x7f081406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f081a389640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08140ce330 0x7f081406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f081a389640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08141626e0 con 0x7f08140700a0 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f081a389640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081406b500 con 0x7f08140ce330 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f081a389640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08140cd270 con 0x7f081406abe0 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f08137fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08140ce330 0x7f081406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f08137fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08140ce330 0x7f081406fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33484/0 (socket says 172.21.15.172:33484) 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f0818926640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f08140700a0 0x7f081406e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37778/0 (socket says 172.21.15.172:37778) 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f08137fe640 1 -- 172.21.15.172:0/1817853855 learned_addr learned my addr 172.21.15.172:0/1817853855 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f0813fff640 1 --2- 172.21.15.172:0/1817853855 >> v2:172.21.15.186:3300/0 conn(0x7f081406abe0 0x7f081406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f08137fe640 1 -- 172.21.15.172:0/1817853855 >> v2:172.21.15.186:3300/0 conn(0x7f081406abe0 msgr2=0x7f081406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f08137fe640 1 --2- 172.21.15.172:0/1817853855 >> v2:172.21.15.186:3300/0 conn(0x7f081406abe0 0x7f081406afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f0812ffd640 1 -- 172.21.15.172:0/1817853855 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692666545 0 0) 0x7f08141626e0 con 0x7f08140700a0 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f08137fe640 1 -- 172.21.15.172:0/1817853855 >> v1:172.21.15.172:6789/0 conn(0x7f08140700a0 legacy=0x7f081406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f08137fe640 1 -- 172.21.15.172:0/1817853855 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08140cd550 con 0x7f08140ce330 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.172+0000 7f0813fff640 1 --2- 172.21.15.172:0/1817853855 >> v2:172.21.15.186:3300/0 conn(0x7f081406abe0 0x7f081406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.173+0000 7f08137fe640 1 --2- 172.21.15.172:0/1817853855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08140ce330 0x7f081406fb60 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f081406e200 tx=0x7f080802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d6dfa2ce90dd73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.173+0000 7f0812ffd640 1 -- 172.21.15.172:0/1817853855 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808037070 con 0x7f08140ce330 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.173+0000 7f0812ffd640 1 -- 172.21.15.172:0/1817853855 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808032440 con 0x7f08140ce330 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.173+0000 7f0812ffd640 1 -- 172.21.15.172:0/1817853855 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0808032810 con 0x7f08140ce330 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.174+0000 7f081a389640 1 -- 172.21.15.172:0/1817853855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08140ce330 msgr2=0x7f081406fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.174+0000 7f081a389640 1 --2- 172.21.15.172:0/1817853855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08140ce330 0x7f081406fb60 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f081406e200 tx=0x7f080802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.174+0000 7f081a389640 1 -- 172.21.15.172:0/1817853855 shutdown_connections 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.174+0000 7f081a389640 1 --2- 172.21.15.172:0/1817853855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08140ce330 0x7f081406fb60 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.174+0000 7f081a389640 1 --2- 172.21.15.172:0/1817853855 >> v2:172.21.15.186:3300/0 conn(0x7f081406abe0 0x7f081406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.174+0000 7f081a389640 1 -- 172.21.15.172:0/1817853855 >> 172.21.15.172:0/1817853855 conn(0x7f08140b2220 msgr2=0x7f08140b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.174+0000 7f081a389640 1 -- 172.21.15.172:0/1817853855 shutdown_connections 2024-04-25T08:50:30.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.174+0000 7f081a389640 1 -- 172.21.15.172:0/1817853855 wait complete. 2024-04-25T08:50:30.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.175+0000 7f081a389640 1 Processor -- start 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.175+0000 7f081a389640 1 -- start start 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f081a389640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f081406abe0 0x7f081415bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f081a389640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08140700a0 0x7f081415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f081a389640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08140ce330 0x7f0814159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f081a389640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0814161780 con 0x7f081406abe0 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f081a389640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08140cdb10 con 0x7f08140700a0 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f081a389640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081406eb00 con 0x7f08140ce330 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0813fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f081406abe0 0x7f081415bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0813fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f081406abe0 0x7f081415bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33488/0 (socket says 172.21.15.172:33488) 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0813fff640 1 -- 172.21.15.172:0/2694458463 learned_addr learned my addr 172.21.15.172:0/2694458463 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f08137fe640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08140700a0 0x7f081415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0818926640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08140ce330 0x7f0814159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0813fff640 1 -- 172.21.15.172:0/2694458463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08140ce330 msgr2=0x7f0814159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0813fff640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08140ce330 0x7f0814159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0813fff640 1 -- 172.21.15.172:0/2694458463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08140700a0 msgr2=0x7f081415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0813fff640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08140700a0 0x7f081415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0813fff640 1 -- 172.21.15.172:0/2694458463 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814156b40 con 0x7f081406abe0 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f08137fe640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08140700a0 0x7f081415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0818926640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08140ce330 0x7f0814159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.176+0000 7f0813fff640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f081406abe0 0x7f081415bb90 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f080400c820 tx=0x7f080400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.177+0000 7f0810ff9640 1 -- 172.21.15.172:0/2694458463 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804015070 con 0x7f081406abe0 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.177+0000 7f0810ff9640 1 -- 172.21.15.172:0/2694458463 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0804007a30 con 0x7f081406abe0 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.177+0000 7f0810ff9640 1 -- 172.21.15.172:0/2694458463 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804007e00 con 0x7f081406abe0 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.177+0000 7f081a389640 1 -- 172.21.15.172:0/2694458463 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081415c270 con 0x7f081406abe0 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.177+0000 7f081a389640 1 -- 172.21.15.172:0/2694458463 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081415c830 con 0x7f081406abe0 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.178+0000 7f081a389640 1 -- 172.21.15.172:0/2694458463 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0814073990 con 0x7f081406abe0 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.178+0000 7f0810ff9640 1 -- 172.21.15.172:0/2694458463 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0804018070 con 0x7f081406abe0 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.179+0000 7f0810ff9640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f080006b500 0x7f080006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.179+0000 7f0810ff9640 1 -- 172.21.15.172:0/2694458463 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f080408a320 con 0x7f081406abe0 2024-04-25T08:50:30.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.179+0000 7f08137fe640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f080006b500 0x7f080006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.179+0000 7f08137fe640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f080006b500 0x7f080006d9c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0808034000 tx=0x7f080802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.183+0000 7f0810ff9640 1 -- 172.21.15.172:0/2694458463 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0804059010 con 0x7f081406abe0 2024-04-25T08:50:30.379 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.389+0000 7f081a389640 1 -- 172.21.15.172:0/2694458463 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08140b2ff0 con 0x7f081406abe0 2024-04-25T08:50:30.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.389+0000 7f0810ff9640 1 -- 172.21.15.172:0/2694458463 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f0804058910 con 0x7f081406abe0 2024-04-25T08:50:30.380 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:30.380 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:30.381 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:30.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.391+0000 7f081a389640 1 -- 172.21.15.172:0/2694458463 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f080006b500 msgr2=0x7f080006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.391+0000 7f081a389640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f080006b500 0x7f080006d9c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0808034000 tx=0x7f080802e000 comp rx=0 tx=0).stop 2024-04-25T08:50:30.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.391+0000 7f081a389640 1 -- 172.21.15.172:0/2694458463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f081406abe0 msgr2=0x7f081415bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.391+0000 7f081a389640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f081406abe0 0x7f081415bb90 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f080400c820 tx=0x7f080400cc20 comp rx=0 tx=0).stop 2024-04-25T08:50:30.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.391+0000 7f081a389640 1 -- 172.21.15.172:0/2694458463 shutdown_connections 2024-04-25T08:50:30.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.391+0000 7f081a389640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f080006b500 0x7f080006d9c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.391+0000 7f081a389640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08140700a0 0x7f081415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.391+0000 7f081a389640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08140ce330 0x7f0814159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.391+0000 7f081a389640 1 --2- 172.21.15.172:0/2694458463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f081406abe0 0x7f081415bb90 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.392+0000 7f081a389640 1 -- 172.21.15.172:0/2694458463 >> 172.21.15.172:0/2694458463 conn(0x7f08140b2220 msgr2=0x7f08140aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:30.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.392+0000 7f081a389640 1 -- 172.21.15.172:0/2694458463 shutdown_connections 2024-04-25T08:50:30.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.392+0000 7f081a389640 1 -- 172.21.15.172:0/2694458463 wait complete. 2024-04-25T08:50:30.393 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:50:30.393 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:30.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.499+0000 7ffa122bc640 1 Processor -- start 2024-04-25T08:50:30.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.499+0000 7ffa122bc640 1 -- start start 2024-04-25T08:50:30.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.499+0000 7ffa122bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0c15dc90 0x7ffa0c1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.499+0000 7ffa122bc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffa0c0cc8e0 0x7ffa0c15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.499+0000 7ffa122bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffa0c0d1810 0x7ffa0c0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.499+0000 7ffa122bc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c0d2180 con 0x7ffa0c0d1810 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.499+0000 7ffa122bc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c15f390 con 0x7ffa0c0cc8e0 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.499+0000 7ffa122bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0cce50 con 0x7ffa0c15dc90 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.500+0000 7ffa10859640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffa0c0d1810 0x7ffa0c0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.500+0000 7ffa10859640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffa0c0d1810 0x7ffa0c0d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33502/0 (socket says 172.21.15.172:33502) 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.500+0000 7ffa10859640 1 -- 172.21.15.172:0/4256203803 learned_addr learned my addr 172.21.15.172:0/4256203803 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.500+0000 7ffa0b7fe640 1 --2- 172.21.15.172:0/4256203803 >> v2:172.21.15.186:3300/0 conn(0x7ffa0c0cc8e0 0x7ffa0c15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.500+0000 7ffa0bfff640 1 --2- 172.21.15.172:0/4256203803 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0c15dc90 0x7ffa0c1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.500+0000 7ffa10859640 1 -- 172.21.15.172:0/4256203803 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0c15dc90 msgr2=0x7ffa0c1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.500+0000 7ffa10859640 1 --2- 172.21.15.172:0/4256203803 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0c15dc90 0x7ffa0c1625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.500+0000 7ffa10859640 1 -- 172.21.15.172:0/4256203803 >> v2:172.21.15.186:3300/0 conn(0x7ffa0c0cc8e0 msgr2=0x7ffa0c15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.500+0000 7ffa10859640 1 --2- 172.21.15.172:0/4256203803 >> v2:172.21.15.186:3300/0 conn(0x7ffa0c0cc8e0 0x7ffa0c15ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.500+0000 7ffa10859640 1 -- 172.21.15.172:0/4256203803 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c161af0 con 0x7ffa0c0d1810 2024-04-25T08:50:30.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa10859640 1 --2- 172.21.15.172:0/4256203803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c0d1810 0x7ffa0c0d1c40 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0cf390 tx=0x7ffa0402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b765f6a830e85f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa0affd640 1 -- 172.21.15.172:0/4256203803 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04036070 con 0x7ffa0c0d1810 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa0affd640 1 -- 172.21.15.172:0/4256203803 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04031600 con 0x7ffa0c0d1810 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa0affd640 1 -- 172.21.15.172:0/4256203803 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa040319d0 con 0x7ffa0c0d1810 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa122bc640 1 -- 172.21.15.172:0/4256203803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c0d1810 msgr2=0x7ffa0c0d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa122bc640 1 --2- 172.21.15.172:0/4256203803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c0d1810 0x7ffa0c0d1c40 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0cf390 tx=0x7ffa0402a610 comp rx=0 tx=0).stop 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa122bc640 1 -- 172.21.15.172:0/4256203803 shutdown_connections 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa122bc640 1 --2- 172.21.15.172:0/4256203803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c0d1810 0x7ffa0c0d1c40 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa122bc640 1 --2- 172.21.15.172:0/4256203803 >> v2:172.21.15.186:3300/0 conn(0x7ffa0c0cc8e0 0x7ffa0c15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa122bc640 1 --2- 172.21.15.172:0/4256203803 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0c15dc90 0x7ffa0c1625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa122bc640 1 -- 172.21.15.172:0/4256203803 >> 172.21.15.172:0/4256203803 conn(0x7ffa0c06f590 msgr2=0x7ffa0c06f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa122bc640 1 -- 172.21.15.172:0/4256203803 shutdown_connections 2024-04-25T08:50:30.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.501+0000 7ffa122bc640 1 -- 172.21.15.172:0/4256203803 wait complete. 2024-04-25T08:50:30.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.502+0000 7ffa122bc640 1 Processor -- start 2024-04-25T08:50:30.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.503+0000 7ffa122bc640 1 -- start start 2024-04-25T08:50:30.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.503+0000 7ffa122bc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa0c0cc8e0 0x7ffa0c1f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.503+0000 7ffa122bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0c0d1810 0x7ffa0c14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.503+0000 7ffa122bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c15dc90 0x7ffa0c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.503+0000 7ffa122bc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0cd130 con 0x7ffa0c15dc90 2024-04-25T08:50:30.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.503+0000 7ffa122bc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1620b0 con 0x7ffa0c0cc8e0 2024-04-25T08:50:30.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.503+0000 7ffa122bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c15e070 con 0x7ffa0c0d1810 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.503+0000 7ffa10859640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c15dc90 0x7ffa0c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.503+0000 7ffa10859640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c15dc90 0x7ffa0c0b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33512/0 (socket says 172.21.15.172:33512) 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.503+0000 7ffa10859640 1 -- 172.21.15.172:0/3445215482 learned_addr learned my addr 172.21.15.172:0/3445215482 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa0bfff640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa0c0cc8e0 0x7ffa0c1f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa0b7fe640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0c0d1810 0x7ffa0c14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa10859640 1 -- 172.21.15.172:0/3445215482 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0c0d1810 msgr2=0x7ffa0c14edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa10859640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0c0d1810 0x7ffa0c14edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa10859640 1 -- 172.21.15.172:0/3445215482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa0c0cc8e0 msgr2=0x7ffa0c1f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa10859640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa0c0cc8e0 0x7ffa0c1f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa10859640 1 -- 172.21.15.172:0/3445215482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0cc020 con 0x7ffa0c15dc90 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa10859640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c15dc90 0x7ffa0c0b6670 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ffa0402ac00 tx=0x7ffa04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa08ff9640 1 -- 172.21.15.172:0/3445215482 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0403f020 con 0x7ffa0c15dc90 2024-04-25T08:50:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa08ff9640 1 -- 172.21.15.172:0/3445215482 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04037040 con 0x7ffa0c15dc90 2024-04-25T08:50:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa08ff9640 1 -- 172.21.15.172:0/3445215482 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04036070 con 0x7ffa0c15dc90 2024-04-25T08:50:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa122bc640 1 -- 172.21.15.172:0/3445215482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c1f4f60 con 0x7ffa0c15dc90 2024-04-25T08:50:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.504+0000 7ffa122bc640 1 -- 172.21.15.172:0/3445215482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c1f5520 con 0x7ffa0c15dc90 2024-04-25T08:50:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.505+0000 7ffa122bc640 1 -- 172.21.15.172:0/3445215482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c073990 con 0x7ffa0c15dc90 2024-04-25T08:50:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.506+0000 7ffa08ff9640 1 -- 172.21.15.172:0/3445215482 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa04042020 con 0x7ffa0c15dc90 2024-04-25T08:50:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.506+0000 7ffa08ff9640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f806b4d0 0x7ff9f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.506+0000 7ffa08ff9640 1 -- 172.21.15.172:0/3445215482 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffa040aa660 con 0x7ffa0c15dc90 2024-04-25T08:50:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.506+0000 7ffa0bfff640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f806b4d0 0x7ff9f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.506+0000 7ffa0bfff640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f806b4d0 0x7ff9f806d990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0079a0 tx=0x7ff9fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.510+0000 7ffa08ff9640 1 -- 172.21.15.172:0/3445215482 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffa04049030 con 0x7ffa0c15dc90 2024-04-25T08:50:30.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.750+0000 7ffa122bc640 1 -- 172.21.15.172:0/3445215482 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ffa0c0b1890 con 0x7ffa0c15dc90 2024-04-25T08:50:30.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.750+0000 7ffa08ff9640 1 -- 172.21.15.172:0/3445215482 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7ffa040a8e20 con 0x7ffa0c15dc90 2024-04-25T08:50:30.741 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:30.741 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":506,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2541289472,"bytes_avail":770552823808,"bytes_total":773094113280,"write_bytes_sec":64841306,"read_op_per_sec":0,"write_op_per_sec":63},"fsmap":{"epoch":68,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-04-25T08:50:28.611018+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 -- 172.21.15.172:0/3445215482 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f806b4d0 msgr2=0x7ff9f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f806b4d0 0x7ff9f806d990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0079a0 tx=0x7ff9fc008040 comp rx=0 tx=0).stop 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 -- 172.21.15.172:0/3445215482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c15dc90 msgr2=0x7ffa0c0b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c15dc90 0x7ffa0c0b6670 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ffa0402ac00 tx=0x7ffa04004a40 comp rx=0 tx=0).stop 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 -- 172.21.15.172:0/3445215482 shutdown_connections 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9f806b4d0 0x7ff9f806d990 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa0c15dc90 0x7ffa0c0b6670 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa0c0d1810 0x7ffa0c14edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 --2- 172.21.15.172:0/3445215482 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa0c0cc8e0 0x7ffa0c1f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 -- 172.21.15.172:0/3445215482 >> 172.21.15.172:0/3445215482 conn(0x7ffa0c06f590 msgr2=0x7ffa0c06d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:30.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 -- 172.21.15.172:0/3445215482 shutdown_connections 2024-04-25T08:50:30.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.752+0000 7ffa122bc640 1 -- 172.21.15.172:0/3445215482 wait complete. 2024-04-25T08:50:30.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T08:50:30.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:30.754 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-04-25T08:50:30.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.863+0000 7fac59f90640 1 Processor -- start 2024-04-25T08:50:30.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.863+0000 7fac59f90640 1 -- start start 2024-04-25T08:50:30.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.863+0000 7fac59f90640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fac540cc4f0 0x7fac540cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac59f90640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac5415b980 0x7fac540cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac59f90640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac54072280 con 0x7fac540cdb20 2024-04-25T08:50:30.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac59f90640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac54071270 con 0x7fac5415b980 2024-04-25T08:50:30.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac59f90640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5415bd80 con 0x7fac540cc4f0 2024-04-25T08:50:30.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac53fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac5415b980 0x7fac540cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac53fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac5415b980 0x7fac540cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33524/0 (socket says 172.21.15.172:33524) 2024-04-25T08:50:30.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac53fff640 1 -- 172.21.15.172:0/1011970998 learned_addr learned my addr 172.21.15.172:0/1011970998 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:30.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac52ffd640 1 --1- 172.21.15.172:0/1011970998 >> v1:172.21.15.172:6789/0 conn(0x7fac540cdb20 0x7fac5415b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37790/0 (socket says 172.21.15.172:37790) 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac537fe640 1 --2- 172.21.15.172:0/1011970998 >> v2:172.21.15.186:3300/0 conn(0x7fac540cc4f0 0x7fac540cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac53fff640 1 -- 172.21.15.172:0/1011970998 >> v2:172.21.15.186:3300/0 conn(0x7fac540cc4f0 msgr2=0x7fac540cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac53fff640 1 --2- 172.21.15.172:0/1011970998 >> v2:172.21.15.186:3300/0 conn(0x7fac540cc4f0 0x7fac540cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac53fff640 1 -- 172.21.15.172:0/1011970998 >> v1:172.21.15.172:6789/0 conn(0x7fac540cdb20 legacy=0x7fac5415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac527fc640 1 -- 172.21.15.172:0/1011970998 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886851719 0 0) 0x7fac54072280 con 0x7fac540cdb20 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac53fff640 1 -- 172.21.15.172:0/1011970998 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac540714c0 con 0x7fac5415b980 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.864+0000 7fac537fe640 1 --2- 172.21.15.172:0/1011970998 >> v2:172.21.15.186:3300/0 conn(0x7fac540cc4f0 0x7fac540cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.865+0000 7fac53fff640 1 --2- 172.21.15.172:0/1011970998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac5415b980 0x7fac540cdfb0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fac540cd290 tx=0x7fac4c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9ec01db83340a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.865+0000 7fac527fc640 1 -- 172.21.15.172:0/1011970998 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c036070 con 0x7fac5415b980 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.865+0000 7fac527fc640 1 -- 172.21.15.172:0/1011970998 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c031600 con 0x7fac5415b980 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.865+0000 7fac527fc640 1 -- 172.21.15.172:0/1011970998 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0319d0 con 0x7fac5415b980 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.865+0000 7fac59f90640 1 -- 172.21.15.172:0/1011970998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac5415b980 msgr2=0x7fac540cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.865+0000 7fac59f90640 1 --2- 172.21.15.172:0/1011970998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac5415b980 0x7fac540cdfb0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fac540cd290 tx=0x7fac4c02a730 comp rx=0 tx=0).stop 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.865+0000 7fac59f90640 1 -- 172.21.15.172:0/1011970998 shutdown_connections 2024-04-25T08:50:30.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.865+0000 7fac59f90640 1 --2- 172.21.15.172:0/1011970998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac5415b980 0x7fac540cdfb0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.865+0000 7fac59f90640 1 --2- 172.21.15.172:0/1011970998 >> v2:172.21.15.186:3300/0 conn(0x7fac540cc4f0 0x7fac540cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.865+0000 7fac59f90640 1 -- 172.21.15.172:0/1011970998 >> 172.21.15.172:0/1011970998 conn(0x7fac5406abe0 msgr2=0x7fac5406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:30.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.866+0000 7fac59f90640 1 -- 172.21.15.172:0/1011970998 shutdown_connections 2024-04-25T08:50:30.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.866+0000 7fac59f90640 1 -- 172.21.15.172:0/1011970998 wait complete. 2024-04-25T08:50:30.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.867+0000 7fac59f90640 1 Processor -- start 2024-04-25T08:50:30.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.867+0000 7fac59f90640 1 -- start start 2024-04-25T08:50:30.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.867+0000 7fac59f90640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac540cc4f0 0x7fac54157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac59f90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac540cdb20 0x7fac54146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac59f90640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5415b980 0x7fac54146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac59f90640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac54071d60 con 0x7fac540cdb20 2024-04-25T08:50:30.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac59f90640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac54071a80 con 0x7fac5415b980 2024-04-25T08:50:30.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac59f90640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac540ae500 con 0x7fac540cc4f0 2024-04-25T08:50:30.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac52ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac540cdb20 0x7fac54146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac52ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac540cdb20 0x7fac54146ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33528/0 (socket says 172.21.15.172:33528) 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac52ffd640 1 -- 172.21.15.172:0/515855658 learned_addr learned my addr 172.21.15.172:0/515855658 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac53fff640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5415b980 0x7fac54146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac52ffd640 1 -- 172.21.15.172:0/515855658 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac540cc4f0 msgr2=0x7fac54157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac52ffd640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac540cc4f0 0x7fac54157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac52ffd640 1 -- 172.21.15.172:0/515855658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5415b980 msgr2=0x7fac54146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac52ffd640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5415b980 0x7fac54146070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac52ffd640 1 -- 172.21.15.172:0/515855658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac54147320 con 0x7fac540cdb20 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac52ffd640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac540cdb20 0x7fac54146ad0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fac4800c4d0 tx=0x7fac4800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac3bfff640 1 -- 172.21.15.172:0/515855658 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48018070 con 0x7fac540cdb20 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac3bfff640 1 -- 172.21.15.172:0/515855658 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac48007500 con 0x7fac540cdb20 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac59f90640 1 -- 172.21.15.172:0/515855658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac54147600 con 0x7fac540cdb20 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac3bfff640 1 -- 172.21.15.172:0/515855658 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48004a20 con 0x7fac540cdb20 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.868+0000 7fac59f90640 1 -- 172.21.15.172:0/515855658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac54147bc0 con 0x7fac540cdb20 2024-04-25T08:50:30.861 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.870+0000 7fac3bfff640 1 -- 172.21.15.172:0/515855658 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fac4801b070 con 0x7fac540cdb20 2024-04-25T08:50:30.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.870+0000 7fac3bfff640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac4006b4d0 0x7fac4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.870+0000 7fac3bfff640 1 -- 172.21.15.172:0/515855658 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fac48089640 con 0x7fac540cdb20 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.870+0000 7fac537fe640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac4006b4d0 0x7fac4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.870+0000 7fac537fe640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac4006b4d0 0x7fac4006d990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fac44006fd0 tx=0x7fac44008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.871+0000 7fac5cd72740 1 Processor -- start 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.871+0000 7fac5cd72740 1 -- start start 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffd8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffbdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffe3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac5cd72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91fef5b90 con 0x55d91ffbe270 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac5cd72740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91fe9ee40 con 0x55d91ff93990 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac5cd72740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d91fef1c30 con 0x55d91ffbd950 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac53fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffe3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac53fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffe3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33542/0 (socket says 172.21.15.172:33542) 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac53fff640 1 -- 172.21.15.172:0/1847578187 learned_addr learned my addr 172.21.15.172:0/1847578187 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:30.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac537fe640 1 --2- 172.21.15.172:0/1847578187 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffd8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac53fff640 1 -- 172.21.15.172:0/1847578187 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 msgr2=0x55d91ffd8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac52ffd640 1 --2- 172.21.15.172:0/1847578187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffbdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac53fff640 1 --2- 172.21.15.172:0/1847578187 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffd8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac53fff640 1 -- 172.21.15.172:0/1847578187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 msgr2=0x55d91ffbdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac53fff640 1 --2- 172.21.15.172:0/1847578187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffbdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac53fff640 1 -- 172.21.15.172:0/1847578187 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d91fcd47d0 con 0x55d91ffbe270 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.872+0000 7fac53fff640 1 --2- 172.21.15.172:0/1847578187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffe3360 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fac4c02ad20 tx=0x7fac4c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694c45fff7dff041 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac397fa640 1 -- 172.21.15.172:0/1847578187 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c036040 con 0x55d91ffbe270 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac397fa640 1 -- 172.21.15.172:0/1847578187 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c041070 con 0x55d91ffbe270 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac397fa640 1 -- 172.21.15.172:0/1847578187 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c003e30 con 0x55d91ffbe270 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac5cd72740 1 -- 172.21.15.172:0/1847578187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 msgr2=0x55d91ffe3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac5cd72740 1 --2- 172.21.15.172:0/1847578187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffe3360 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fac4c02ad20 tx=0x7fac4c02e000 comp rx=0 tx=0).stop 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac5cd72740 1 -- 172.21.15.172:0/1847578187 shutdown_connections 2024-04-25T08:50:30.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac5cd72740 1 --2- 172.21.15.172:0/1847578187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffbdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac5cd72740 1 --2- 172.21.15.172:0/1847578187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffe3360 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac5cd72740 1 --2- 172.21.15.172:0/1847578187 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffd8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac5cd72740 1 -- 172.21.15.172:0/1847578187 >> 172.21.15.172:0/1847578187 conn(0x55d91ff5a870 msgr2=0x55d91ffd8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:30.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac5cd72740 1 -- 172.21.15.172:0/1847578187 shutdown_connections 2024-04-25T08:50:30.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.873+0000 7fac5cd72740 1 -- 172.21.15.172:0/1847578187 wait complete. 2024-04-25T08:50:30.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.874+0000 7fac5cd72740 1 -- start start 2024-04-25T08:50:30.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.874+0000 7fac5cd72740 1 Processor -- start 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffb4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffd0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffd1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac5cd72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91ff94e00 con 0x55d91ffbe270 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac5cd72740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91feb23e0 con 0x55d91ff93990 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac5cd72740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d91ff8f190 con 0x55d91ffbd950 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac5cd72740 10 client.0 _ll_register_callbacks cb 0x55d91feb1db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac53fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffd1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac53fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffd1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33544/0 (socket says 172.21.15.172:33544) 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac53fff640 1 -- 172.21.15.172:0/3677774342 learned_addr learned my addr 172.21.15.172:0/3677774342 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac537fe640 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffb4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac52ffd640 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffd0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac53fff640 1 -- 172.21.15.172:0/3677774342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 msgr2=0x55d91ffd0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac53fff640 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffd0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac53fff640 1 -- 172.21.15.172:0/3677774342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 msgr2=0x55d91ffb4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac53fff640 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffb4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac53fff640 1 -- 172.21.15.172:0/3677774342 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d91fbca0f0 con 0x55d91ffbe270 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac52ffd640 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffd0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac53fff640 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffd1c10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fac4c02a770 tx=0x7fac4c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385225d0d1199e7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac327fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac327fc640 1 -- 172.21.15.172:0/3677774342 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c036040 con 0x55d91ffbe270 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac327fc640 1 -- 172.21.15.172:0/3677774342 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fac4c031400 con 0x55d91ffbe270 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.875+0000 7fac5cd72740 1 -- 172.21.15.172:0/3677774342 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fac4c041070 con 0x55d91ffbe270 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac327fc640 1 -- 172.21.15.172:0/3677774342 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac4c055050 con 0x55d91ffbe270 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac5cd72740 10 client.8970 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac5cd72740 1 -- 172.21.15.172:0/3677774342 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55d91fd34f60 con 0x55d91ffbe270 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac327fc640 1 -- 172.21.15.172:0/3677774342 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c041070 con 0x55d91ffbe270 2024-04-25T08:50:30.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac327fc640 1 -- 172.21.15.172:0/3677774342 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fac4c058020 con 0x55d91ffbe270 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac5cd72740 10 client.8970 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac5cd72740 10 client.8970 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac5cd72740 20 client.8970 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac5cd72740 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d91ffd21f0 0x55d91ffec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac5cd72740 4 client.8970 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac5cd72740 1 -- 172.21.15.172:0/3677774342 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d91ff030d0 con 0x55d91ffd21f0 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac537fe640 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d91ffd21f0 0x55d91ffec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac537fe640 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d91ffd21f0 0x55d91ffec9a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4e55edea9dd1527 server_cookie=4009bdf4ff064e75 in_seq=0 out_seq=0 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.876+0000 7fac327fc640 10 client.8970 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac327fc640 1 -- 172.21.15.172:0/3677774342 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d91ff030d0 con 0x55d91ffd21f0 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac327fc640 10 client.8970 handle_command_reply: tid=0 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 client.8970 shutdown 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 -- 172.21.15.172:0/3677774342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 msgr2=0x55d91ffd1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffd1c10 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fac4c02a770 tx=0x7fac4c004ab0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 -- 172.21.15.172:0/3677774342 shutdown_connections 2024-04-25T08:50:30.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d91ffd21f0 0x55d91ffec9a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91ffd1c10 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffd0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 --2- 172.21.15.172:0/3677774342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffb4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac327fc640 0 client.8970 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:30.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 -- 172.21.15.172:0/3677774342 >> 172.21.15.172:0/3677774342 conn(0x55d91ff5a870 msgr2=0x55d91ffdbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:30.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 -- 172.21.15.172:0/3677774342 shutdown_connections 2024-04-25T08:50:30.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 1 -- 172.21.15.172:0/3677774342 wait complete. 2024-04-25T08:50:30.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.877+0000 7fac5cd72740 20 client.8970 trim_cache size 0 max 16384 2024-04-25T08:50:30.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.892+0000 7fac5cd72740 1 Processor -- start 2024-04-25T08:50:30.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.892+0000 7fac5cd72740 1 -- start start 2024-04-25T08:50:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffeac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffeb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91fff3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac5cd72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac541fbc40 con 0x55d91ffbe270 2024-04-25T08:50:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac5cd72740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac541faea0 con 0x55d91ff93990 2024-04-25T08:50:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac5cd72740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac540d0020 con 0x55d91ffbd950 2024-04-25T08:50:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac53fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91fff3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac53fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91fff3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33548/0 (socket says 172.21.15.172:33548) 2024-04-25T08:50:30.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac53fff640 1 -- 172.21.15.172:0/45504916 learned_addr learned my addr 172.21.15.172:0/45504916 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac537fe640 1 --2- 172.21.15.172:0/45504916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffeac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac53fff640 1 -- 172.21.15.172:0/45504916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 msgr2=0x55d91ffeb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac53fff640 1 --2- 172.21.15.172:0/45504916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffeb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac53fff640 1 -- 172.21.15.172:0/45504916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 msgr2=0x55d91ffeac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac53fff640 1 --2- 172.21.15.172:0/45504916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffeac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac53fff640 1 -- 172.21.15.172:0/45504916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d91fba31b0 con 0x55d91ffbe270 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac537fe640 1 --2- 172.21.15.172:0/45504916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffeac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac53fff640 1 --2- 172.21.15.172:0/45504916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91fff3c10 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009c90 tx=0x7fac4c047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebe1222663c7b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac38ff9640 1 -- 172.21.15.172:0/45504916 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c036040 con 0x55d91ffbe270 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac38ff9640 1 -- 172.21.15.172:0/45504916 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c041070 con 0x55d91ffbe270 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.893+0000 7fac38ff9640 1 -- 172.21.15.172:0/45504916 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c031400 con 0x55d91ffbe270 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.894+0000 7fac5cd72740 1 -- 172.21.15.172:0/45504916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 msgr2=0x55d91fff3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.894+0000 7fac5cd72740 1 --2- 172.21.15.172:0/45504916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91fff3c10 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009c90 tx=0x7fac4c047000 comp rx=0 tx=0).stop 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.894+0000 7fac5cd72740 1 -- 172.21.15.172:0/45504916 shutdown_connections 2024-04-25T08:50:30.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.894+0000 7fac5cd72740 1 --2- 172.21.15.172:0/45504916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ffbe270 0x55d91fff3c10 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.894+0000 7fac5cd72740 1 --2- 172.21.15.172:0/45504916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbd950 0x55d91ffeb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.894+0000 7fac5cd72740 1 --2- 172.21.15.172:0/45504916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ff93990 0x55d91ffeac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.894+0000 7fac5cd72740 1 -- 172.21.15.172:0/45504916 >> 172.21.15.172:0/45504916 conn(0x55d91ff5a870 msgr2=0x55d91ffd58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:30.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.894+0000 7fac5cd72740 1 -- 172.21.15.172:0/45504916 shutdown_connections 2024-04-25T08:50:30.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.894+0000 7fac5cd72740 1 -- 172.21.15.172:0/45504916 wait complete. 2024-04-25T08:50:30.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac5cd72740 1 -- start start 2024-04-25T08:50:30.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac5cd72740 1 Processor -- start 2024-04-25T08:50:30.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ff93990 0x55d920043d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ffbd950 0x55d91ffeb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac5cd72740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbe270 0x55d91ffb9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac5cd72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac540d0620 con 0x55d91ff93990 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac5cd72740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91ffb8680 con 0x55d91ffbd950 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac5cd72740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d920045000 con 0x55d91ffbe270 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac5cd72740 10 client.0 _ll_register_callbacks cb 0x7fac4c02af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ff93990 0x55d920043d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac537fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ff93990 0x55d920043d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33564/0 (socket says 172.21.15.172:33564) 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.895+0000 7fac537fe640 1 -- 172.21.15.172:0/2586487890 learned_addr learned my addr 172.21.15.172:0/2586487890 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac52ffd640 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ffbd950 0x55d91ffeb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac53fff640 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbe270 0x55d91ffb9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac537fe640 1 -- 172.21.15.172:0/2586487890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbe270 msgr2=0x55d91ffb9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac537fe640 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbe270 0x55d91ffb9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac537fe640 1 -- 172.21.15.172:0/2586487890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ffbd950 msgr2=0x55d91ffeb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac537fe640 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ffbd950 0x55d91ffeb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac537fe640 1 -- 172.21.15.172:0/2586487890 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d91ffb41d0 con 0x55d91ff93990 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac52ffd640 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ffbd950 0x55d91ffeb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac537fe640 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ff93990 0x55d920043d60 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fac4400cae0 tx=0x7fac44006bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1e7b6ed9fc38d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac327fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac327fc640 1 -- 172.21.15.172:0/2586487890 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44005990 con 0x55d91ff93990 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac327fc640 1 -- 172.21.15.172:0/2586487890 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fac44005b30 con 0x55d91ff93990 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac5cd72740 1 -- 172.21.15.172:0/2586487890 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fac4c041070 con 0x55d91ff93990 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac327fc640 1 -- 172.21.15.172:0/2586487890 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac44033050 con 0x55d91ff93990 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac5cd72740 10 client.8976 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac5cd72740 1 -- 172.21.15.172:0/2586487890 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55d91ffb9b70 con 0x55d91ff93990 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac327fc640 1 -- 172.21.15.172:0/2586487890 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c041070 con 0x55d91ff93990 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac327fc640 1 -- 172.21.15.172:0/2586487890 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fac44036020 con 0x55d91ff93990 2024-04-25T08:50:30.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac5cd72740 10 client.8976 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac5cd72740 10 client.8976 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.896+0000 7fac5cd72740 20 client.8976 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d91ff8cae0 0x55d91ff8cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 4 client.8976 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 -- 172.21.15.172:0/2586487890 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x55d91fefd420 con 0x55d91ff8cae0 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac52ffd640 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d91ff8cae0 0x55d91ff8cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac327fc640 10 client.8976 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac52ffd640 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d91ff8cae0 0x55d91ff8cef0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a931dec16df0c5 server_cookie=2f6abfba54f88f59 in_seq=0 out_seq=0 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac327fc640 1 -- 172.21.15.172:0/2586487890 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55d91fefd420 con 0x55d91ff8cae0 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac327fc640 10 client.8976 handle_command_reply: tid=0 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 client.8976 shutdown 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 -- 172.21.15.172:0/2586487890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ff93990 msgr2=0x55d920043d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ff93990 0x55d920043d60 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fac4400cae0 tx=0x7fac44006bd0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 -- 172.21.15.172:0/2586487890 shutdown_connections 2024-04-25T08:50:30.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55d91ff8cae0 0x55d91ff8cef0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d91ffbd950 0x55d91ffeb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac327fc640 0 client.8976 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:30.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d91ffbe270 0x55d91ffb9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 --2- 172.21.15.172:0/2586487890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d91ff93990 0x55d920043d60 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 -- 172.21.15.172:0/2586487890 >> 172.21.15.172:0/2586487890 conn(0x55d91ff5a870 msgr2=0x55d91ffec5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:30.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 -- 172.21.15.172:0/2586487890 shutdown_connections 2024-04-25T08:50:30.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 1 -- 172.21.15.172:0/2586487890 wait complete. 2024-04-25T08:50:30.894 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.897+0000 7fac5cd72740 20 client.8976 trim_cache size 0 max 16384 2024-04-25T08:50:30.894 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:50:30.894 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0 2024-04-25T08:50:30.895 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:50:30.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 -- 172.21.15.172:0/515855658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac4006b4d0 msgr2=0x7fac4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac4006b4d0 0x7fac4006d990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fac44006fd0 tx=0x7fac44008040 comp rx=0 tx=0).stop 2024-04-25T08:50:30.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 -- 172.21.15.172:0/515855658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac540cdb20 msgr2=0x7fac54146ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:30.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac540cdb20 0x7fac54146ad0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fac4800c4d0 tx=0x7fac4800c990 comp rx=0 tx=0).stop 2024-04-25T08:50:30.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 -- 172.21.15.172:0/515855658 shutdown_connections 2024-04-25T08:50:30.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fac4006b4d0 0x7fac4006d990 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5415b980 0x7fac54146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac540cdb20 0x7fac54146ad0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 --2- 172.21.15.172:0/515855658 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac540cc4f0 0x7fac54157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:30.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 -- 172.21.15.172:0/515855658 >> 172.21.15.172:0/515855658 conn(0x7fac5406abe0 msgr2=0x7fac5415da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:30.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 -- 172.21.15.172:0/515855658 shutdown_connections 2024-04-25T08:50:30.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:30.898+0000 7fac59f90640 1 -- 172.21.15.172:0/515855658 wait complete. 2024-04-25T08:50:30.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:30.899 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub status 2024-04-25T08:50:30.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.008+0000 7fa9a2b9e640 1 Processor -- start 2024-04-25T08:50:30.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.009+0000 7fa9a2b9e640 1 -- start start 2024-04-25T08:50:31.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.009+0000 7fa9a2b9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa99c15a750 0x7fa99c0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.009+0000 7fa9a2b9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa99c0b27d0 0x7fa99c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.009+0000 7fa9a2b9e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c0b5930 con 0x7fa99c0b5240 2024-04-25T08:50:31.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.009+0000 7fa9a2b9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c15bd40 con 0x7fa99c15a750 2024-04-25T08:50:31.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.009+0000 7fa9a2b9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0b2c30 con 0x7fa99c0b27d0 2024-04-25T08:50:31.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.009+0000 7fa9a1b9c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa99c15a750 0x7fa99c0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.010+0000 7fa9a1b9c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa99c15a750 0x7fa99c0b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33572/0 (socket says 172.21.15.172:33572) 2024-04-25T08:50:31.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.010+0000 7fa9a1b9c640 1 -- 172.21.15.172:0/766724662 learned_addr learned my addr 172.21.15.172:0/766724662 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.010+0000 7fa9a1b9c640 1 -- 172.21.15.172:0/766724662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa99c0b27d0 msgr2=0x7fa99c0b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.010+0000 7fa9a1b9c640 1 --2- 172.21.15.172:0/766724662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa99c0b27d0 0x7fa99c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.010+0000 7fa9a1b9c640 1 -- 172.21.15.172:0/766724662 >> v1:172.21.15.186:6789/0 conn(0x7fa99c0b5240 legacy=0x7fa99c0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.010+0000 7fa9a1b9c640 1 -- 172.21.15.172:0/766724662 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c0b5660 con 0x7fa99c15a750 2024-04-25T08:50:31.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.010+0000 7fa9a1b9c640 1 --2- 172.21.15.172:0/766724662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c15a750 0x7fa99c0b2290 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fa99400bb10 tx=0x7fa99402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6102128c1cd0e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a0b9a640 1 -- 172.21.15.172:0/766724662 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994032790 con 0x7fa99c15a750 2024-04-25T08:50:31.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a0b9a640 1 -- 172.21.15.172:0/766724662 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa994038070 con 0x7fa99c15a750 2024-04-25T08:50:31.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a0b9a640 1 -- 172.21.15.172:0/766724662 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994032b50 con 0x7fa99c15a750 2024-04-25T08:50:31.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/766724662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c15a750 msgr2=0x7fa99c0b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a2b9e640 1 --2- 172.21.15.172:0/766724662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c15a750 0x7fa99c0b2290 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fa99400bb10 tx=0x7fa99402c8d0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/766724662 shutdown_connections 2024-04-25T08:50:31.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a2b9e640 1 --2- 172.21.15.172:0/766724662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa99c0b27d0 0x7fa99c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a2b9e640 1 --2- 172.21.15.172:0/766724662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c15a750 0x7fa99c0b2290 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/766724662 >> 172.21.15.172:0/766724662 conn(0x7fa99c0b5d00 msgr2=0x7fa99c0b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/766724662 shutdown_connections 2024-04-25T08:50:31.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.011+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/766724662 wait complete. 2024-04-25T08:50:31.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a2b9e640 1 Processor -- start 2024-04-25T08:50:31.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a2b9e640 1 -- start start 2024-04-25T08:50:31.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a2b9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c0b27d0 0x7fa99c148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a2b9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c0b5240 0x7fa99c0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a2b9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa99c15a750 0x7fa99c0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a2b9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c15b540 con 0x7fa99c0b27d0 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a2b9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c15b260 con 0x7fa99c0b5240 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a2b9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c15b820 con 0x7fa99c15a750 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a1b9c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c0b27d0 0x7fa99c148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a1b9c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c0b27d0 0x7fa99c148890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33578/0 (socket says 172.21.15.172:33578) 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.013+0000 7fa9a1b9c640 1 -- 172.21.15.172:0/1999968957 learned_addr learned my addr 172.21.15.172:0/1999968957 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a139b640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c0b5240 0x7fa99c0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a239d640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa99c15a750 0x7fa99c0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a1b9c640 1 -- 172.21.15.172:0/1999968957 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa99c15a750 msgr2=0x7fa99c0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a1b9c640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa99c15a750 0x7fa99c0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a1b9c640 1 -- 172.21.15.172:0/1999968957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c0b5240 msgr2=0x7fa99c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a1b9c640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c0b5240 0x7fa99c0b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a1b9c640 1 -- 172.21.15.172:0/1999968957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c1ef330 con 0x7fa99c0b27d0 2024-04-25T08:50:31.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a139b640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c0b5240 0x7fa99c0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:31.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a1b9c640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c0b27d0 0x7fa99c148890 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fa99400bb10 tx=0x7fa9940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa99a7fc640 1 -- 172.21.15.172:0/1999968957 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994033620 con 0x7fa99c0b27d0 2024-04-25T08:50:31.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa99a7fc640 1 -- 172.21.15.172:0/1999968957 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9940337e0 con 0x7fa99c0b27d0 2024-04-25T08:50:31.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa99a7fc640 1 -- 172.21.15.172:0/1999968957 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994033bd0 con 0x7fa99c0b27d0 2024-04-25T08:50:31.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/1999968957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c1ef5f0 con 0x7fa99c0b27d0 2024-04-25T08:50:31.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.014+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/1999968957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c1efbb0 con 0x7fa99c0b27d0 2024-04-25T08:50:31.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.016+0000 7fa99a7fc640 1 -- 172.21.15.172:0/1999968957 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa99404d060 con 0x7fa99c0b27d0 2024-04-25T08:50:31.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.016+0000 7fa99a7fc640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98806b4d0 0x7fa98806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.016+0000 7fa99a7fc640 1 -- 172.21.15.172:0/1999968957 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa9940acca0 con 0x7fa99c0b27d0 2024-04-25T08:50:31.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.016+0000 7fa9a139b640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98806b4d0 0x7fa98806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.017+0000 7fa9a139b640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98806b4d0 0x7fa98806d990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0d1480 tx=0x7fa990009570 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.017+0000 7fa9a6bdd740 1 Processor -- start 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.017+0000 7fa9a6bdd740 1 -- start start 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b618e720 0x5615b618eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b615e980 0x5615b61649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b61aa680 0x5615b61aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b60c7da0 con 0x5615b615e980 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b6070b80 con 0x5615b61aa680 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5615b60c3e40 con 0x5615b618e720 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a139b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b615e980 0x5615b61649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a139b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b615e980 0x5615b61649b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33586/0 (socket says 172.21.15.172:33586) 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a139b640 1 -- 172.21.15.172:0/787510284 learned_addr learned my addr 172.21.15.172:0/787510284 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a139b640 1 -- 172.21.15.172:0/787510284 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b618e720 msgr2=0x5615b618eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a139b640 1 --2- 172.21.15.172:0/787510284 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b618e720 0x5615b618eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a139b640 1 -- 172.21.15.172:0/787510284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b61aa680 msgr2=0x5615b61aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a139b640 1 --2- 172.21.15.172:0/787510284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b61aa680 0x5615b61aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a139b640 1 -- 172.21.15.172:0/787510284 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615b607af10 con 0x5615b615e980 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.018+0000 7fa9a139b640 1 --2- 172.21.15.172:0/787510284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b615e980 0x5615b61649b0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fa9900187d0 tx=0x7fa990011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d29a8a3df79fba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9837fe640 1 -- 172.21.15.172:0/787510284 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990026070 con 0x5615b615e980 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9837fe640 1 -- 172.21.15.172:0/787510284 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9900213f0 con 0x5615b615e980 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9837fe640 1 -- 172.21.15.172:0/787510284 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9900215c0 con 0x5615b615e980 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/787510284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b615e980 msgr2=0x5615b61649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/787510284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b615e980 0x5615b61649b0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fa9900187d0 tx=0x7fa990011000 comp rx=0 tx=0).stop 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/787510284 shutdown_connections 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/787510284 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b61aa680 0x5615b61aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/787510284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b615e980 0x5615b61649b0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/787510284 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b618e720 0x5615b618eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/787510284 >> 172.21.15.172:0/787510284 conn(0x5615b6160bf0 msgr2=0x5615b61a9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/787510284 shutdown_connections 2024-04-25T08:50:31.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.019+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/787510284 wait complete. 2024-04-25T08:50:31.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.020+0000 7fa9a6bdd740 1 -- start start 2024-04-25T08:50:31.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.020+0000 7fa9a6bdd740 1 Processor -- start 2024-04-25T08:50:31.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b618e720 0x5615b6189ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b61aa680 0x5615b618a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b617b230 0x5615b618ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b6164ef0 con 0x5615b617b230 2024-04-25T08:50:31.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b60664b0 con 0x5615b61aa680 2024-04-25T08:50:31.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5615b6164520 con 0x5615b618e720 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a6bdd740 10 client.0 _ll_register_callbacks cb 0x5615b60a6180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a239d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b617b230 0x5615b618ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a239d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b617b230 0x5615b618ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33596/0 (socket says 172.21.15.172:33596) 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a239d640 1 -- 172.21.15.172:0/3354505996 learned_addr learned my addr 172.21.15.172:0/3354505996 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a239d640 1 -- 172.21.15.172:0/3354505996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b618e720 msgr2=0x5615b6189ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a239d640 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b618e720 0x5615b6189ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a139b640 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b61aa680 0x5615b618a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a239d640 1 -- 172.21.15.172:0/3354505996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b61aa680 msgr2=0x5615b618a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a239d640 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b61aa680 0x5615b618a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a239d640 1 -- 172.21.15.172:0/3354505996 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5615b5ea67d0 con 0x5615b617b230 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa9a239d640 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b617b230 0x5615b618ac60 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fa98c001d60 tx=0x7fa98c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3377d2db348e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.021+0000 7fa980ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa980ff9640 1 -- 172.21.15.172:0/3354505996 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c019060 con 0x5615b617b230 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa980ff9640 1 -- 172.21.15.172:0/3354505996 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa98c0050d0 con 0x5615b617b230 2024-04-25T08:50:31.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3354505996 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa9900213f0 con 0x5615b617b230 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa980ff9640 1 -- 172.21.15.172:0/3354505996 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa98c01f050 con 0x5615b617b230 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a6bdd740 10 client.8988 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3354505996 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x5615b5ddc3f0 con 0x5615b617b230 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa980ff9640 1 -- 172.21.15.172:0/3354505996 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9900213f0 con 0x5615b617b230 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa980ff9640 1 -- 172.21.15.172:0/3354505996 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa98c022020 con 0x5615b617b230 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a6bdd740 10 client.8988 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a6bdd740 10 client.8988 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a6bdd740 20 client.8988 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5615b6190490 0x5615b61908a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a6bdd740 4 client.8988 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3354505996 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5615b60d52e0 con 0x5615b6190490 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a1b9c640 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5615b6190490 0x5615b61908a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa9a1b9c640 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5615b6190490 0x5615b61908a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8046599e94345270 server_cookie=6d2b1a5f1cf5f4af in_seq=0 out_seq=0 2024-04-25T08:50:31.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.022+0000 7fa980ff9640 10 client.8988 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa980ff9640 1 -- 172.21.15.172:0/3354505996 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5615b60d52e0 con 0x5615b6190490 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa980ff9640 10 client.8988 handle_command_reply: tid=0 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 client.8988 shutdown 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3354505996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b617b230 msgr2=0x5615b618ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b617b230 0x5615b618ac60 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fa98c001d60 tx=0x7fa98c00e530 comp rx=0 tx=0).stop 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3354505996 shutdown_connections 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5615b6190490 0x5615b61908a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b61aa680 0x5615b618a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b617b230 0x5615b618ac60 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa980ff9640 0 client.8988 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3354505996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b618e720 0x5615b6189ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3354505996 >> 172.21.15.172:0/3354505996 conn(0x5615b615e980 msgr2=0x5615b6162a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3354505996 shutdown_connections 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3354505996 wait complete. 2024-04-25T08:50:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.023+0000 7fa9a6bdd740 20 client.8988 trim_cache size 0 max 16384 2024-04-25T08:50:31.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.038+0000 7fa9a6bdd740 1 Processor -- start 2024-04-25T08:50:31.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.038+0000 7fa9a6bdd740 1 -- start start 2024-04-25T08:50:31.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b617b230 0x5615b618a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b618ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b61aa680 0x5615b618d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c1fbed0 con 0x5615b618e720 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c1fb040 con 0x5615b617b230 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c149ec0 con 0x5615b61aa680 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a139b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b618ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a139b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b618ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33602/0 (socket says 172.21.15.172:33602) 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a139b640 1 -- 172.21.15.172:0/1290835885 learned_addr learned my addr 172.21.15.172:0/1290835885 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a139b640 1 -- 172.21.15.172:0/1290835885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b61aa680 msgr2=0x5615b618d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a139b640 1 --2- 172.21.15.172:0/1290835885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b61aa680 0x5615b618d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a139b640 1 -- 172.21.15.172:0/1290835885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b617b230 msgr2=0x5615b618a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a139b640 1 --2- 172.21.15.172:0/1290835885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b617b230 0x5615b618a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.039+0000 7fa9a139b640 1 -- 172.21.15.172:0/1290835885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615b5d9c0f0 con 0x5615b618e720 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa9a139b640 1 --2- 172.21.15.172:0/1290835885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b618ac60 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fa990021000 tx=0x7fa990013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17e9104d2cee1d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa982ffd640 1 -- 172.21.15.172:0/1290835885 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990026070 con 0x5615b618e720 2024-04-25T08:50:31.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa982ffd640 1 -- 172.21.15.172:0/1290835885 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99002c410 con 0x5615b618e720 2024-04-25T08:50:31.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa982ffd640 1 -- 172.21.15.172:0/1290835885 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99002c800 con 0x5615b618e720 2024-04-25T08:50:31.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/1290835885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 msgr2=0x5615b618ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/1290835885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b618ac60 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fa990021000 tx=0x7fa990013000 comp rx=0 tx=0).stop 2024-04-25T08:50:31.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/1290835885 shutdown_connections 2024-04-25T08:50:31.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/1290835885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b61aa680 0x5615b618d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/1290835885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b618ac60 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/1290835885 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b617b230 0x5615b618a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/1290835885 >> 172.21.15.172:0/1290835885 conn(0x5615b615e980 msgr2=0x5615b6165840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/1290835885 shutdown_connections 2024-04-25T08:50:31.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.040+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/1290835885 wait complete. 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.041+0000 7fa9a6bdd740 1 -- start start 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.041+0000 7fa9a6bdd740 1 Processor -- start 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b617b230 0x5615b621baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b621f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a6bdd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b61aa680 0x5615b615e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c1fab70 con 0x5615b618e720 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b61630c0 con 0x5615b617b230 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a6bdd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5615b62201b0 con 0x5615b61aa680 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a6bdd740 10 client.0 _ll_register_callbacks cb 0x7fa990009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a139b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b621f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a139b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b621f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33610/0 (socket says 172.21.15.172:33610) 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a139b640 1 -- 172.21.15.172:0/3372598316 learned_addr learned my addr 172.21.15.172:0/3372598316 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a139b640 1 -- 172.21.15.172:0/3372598316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b61aa680 msgr2=0x5615b615e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a139b640 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b61aa680 0x5615b615e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a139b640 1 -- 172.21.15.172:0/3372598316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b617b230 msgr2=0x5615b621baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a139b640 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b617b230 0x5615b621baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a139b640 1 -- 172.21.15.172:0/3372598316 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5615b61608f0 con 0x5615b618e720 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa9a139b640 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b621f6c0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa99002e040 tx=0x7fa990004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d7282673bf10c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.042+0000 7fa980ff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa980ff9640 1 -- 172.21.15.172:0/3372598316 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99003a020 con 0x5615b618e720 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa980ff9640 1 -- 172.21.15.172:0/3372598316 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa99001a880 con 0x5615b618e720 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3372598316 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa99002c410 con 0x5615b618e720 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa980ff9640 1 -- 172.21.15.172:0/3372598316 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa99002ce20 con 0x5615b618e720 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a6bdd740 10 client.8994 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3372598316 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x5615b621fef0 con 0x5615b618e720 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa980ff9640 1 -- 172.21.15.172:0/3372598316 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99002c410 con 0x5615b618e720 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa980ff9640 1 -- 172.21.15.172:0/3372598316 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa990020070 con 0x5615b618e720 2024-04-25T08:50:31.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a6bdd740 10 client.8994 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a6bdd740 10 client.8994 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a6bdd740 20 client.8994 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5615b61885a0 0x5615b61bf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a6bdd740 4 client.8994 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3372598316 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5615b618fb30 con 0x5615b61885a0 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a1b9c640 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5615b61885a0 0x5615b61bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa980ff9640 10 client.8994 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.043+0000 7fa9a1b9c640 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5615b61885a0 0x5615b61bf700 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7395a754fde49c60 server_cookie=ac91e5048a603f01 in_seq=0 out_seq=0 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa980ff9640 1 -- 172.21.15.172:0/3372598316 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+69 (crc 0 0 0) 0x5615b618fb30 con 0x5615b61885a0 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa980ff9640 10 client.8994 handle_command_reply: tid=0 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 client.8994 shutdown 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3372598316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 msgr2=0x5615b621f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b621f6c0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fa99002e040 tx=0x7fa990004a40 comp rx=0 tx=0).stop 2024-04-25T08:50:31.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3372598316 shutdown_connections 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x5615b61885a0 0x5615b61bf700 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5615b61aa680 0x5615b615e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615b618e720 0x5615b621f6c0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa980ff9640 0 client.8994 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 --2- 172.21.15.172:0/3372598316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615b617b230 0x5615b621baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3372598316 >> 172.21.15.172:0/3372598316 conn(0x5615b615e980 msgr2=0x5615b6165840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3372598316 shutdown_connections 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 1 -- 172.21.15.172:0/3372598316 wait complete. 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a6bdd740 20 client.8994 trim_cache size 0 max 16384 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T08:50:31.040 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": {} 2024-04-25T08:50:31.041 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:50:31.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/1999968957 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98806b4d0 msgr2=0x7fa98806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a2b9e640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98806b4d0 0x7fa98806d990 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0d1480 tx=0x7fa990009570 comp rx=0 tx=0).stop 2024-04-25T08:50:31.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/1999968957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c0b27d0 msgr2=0x7fa99c148890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.044+0000 7fa9a2b9e640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c0b27d0 0x7fa99c148890 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fa99400bb10 tx=0x7fa9940046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.045+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/1999968957 shutdown_connections 2024-04-25T08:50:31.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.045+0000 7fa9a2b9e640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa98806b4d0 0x7fa98806d990 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.045+0000 7fa9a2b9e640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa99c0b5240 0x7fa99c0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.045+0000 7fa9a2b9e640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa99c15a750 0x7fa99c0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.045+0000 7fa9a2b9e640 1 --2- 172.21.15.172:0/1999968957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c0b27d0 0x7fa99c148890 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.045+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/1999968957 >> 172.21.15.172:0/1999968957 conn(0x7fa99c0b5d00 msgr2=0x7fa99c15cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.045+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/1999968957 shutdown_connections 2024-04-25T08:50:31.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.045+0000 7fa9a2b9e640 1 -- 172.21.15.172:0/1999968957 wait complete. 2024-04-25T08:50:31.046 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:31.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.152+0000 7fadfe237640 1 Processor -- start 2024-04-25T08:50:31.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.152+0000 7fadfe237640 1 -- start start 2024-04-25T08:50:31.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadfe237640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fadf8071ac0 0x7fadf80ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadfe237640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fadf806c1d0 0x7fadf806afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadfe237640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf815ec60 con 0x7fadf8154ed0 2024-04-25T08:50:31.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadfe237640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf815ef40 con 0x7fadf8071ac0 2024-04-25T08:50:31.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadfe237640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf806db90 con 0x7fadf806c1d0 2024-04-25T08:50:31.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadf6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fadf8071ac0 0x7fadf80ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadf77fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fadf8154ed0 0x7fadf80aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37800/0 (socket says 172.21.15.172:37800) 2024-04-25T08:50:31.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadf77fe640 1 -- 172.21.15.172:0/1527904021 learned_addr learned my addr 172.21.15.172:0/1527904021 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:31.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadf6ffd640 1 -- 172.21.15.172:0/1527904021 >> v2:172.21.15.186:3300/0 conn(0x7fadf806c1d0 msgr2=0x7fadf806afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadf6ffd640 1 --2- 172.21.15.172:0/1527904021 >> v2:172.21.15.186:3300/0 conn(0x7fadf806c1d0 0x7fadf806afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadf6ffd640 1 -- 172.21.15.172:0/1527904021 >> v1:172.21.15.172:6789/0 conn(0x7fadf8154ed0 legacy=0x7fadf80aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadf6ffd640 1 -- 172.21.15.172:0/1527904021 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf806de70 con 0x7fadf8071ac0 2024-04-25T08:50:31.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.153+0000 7fadf67fc640 1 -- 172.21.15.172:0/1527904021 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204105384 0 0) 0x7fadf815ec60 con 0x7fadf8154ed0 2024-04-25T08:50:31.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.154+0000 7fadf6ffd640 1 --2- 172.21.15.172:0/1527904021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf8071ac0 0x7fadf80ad5e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fadf80cc3d0 tx=0x7fadec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb584b3c7609160f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.154+0000 7fadf67fc640 1 -- 172.21.15.172:0/1527904021 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec037070 con 0x7fadf8071ac0 2024-04-25T08:50:31.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.154+0000 7fadf67fc640 1 -- 172.21.15.172:0/1527904021 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec032440 con 0x7fadf8071ac0 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.154+0000 7fadf67fc640 1 -- 172.21.15.172:0/1527904021 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec02ae60 con 0x7fadf8071ac0 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.155+0000 7fadfe237640 1 -- 172.21.15.172:0/1527904021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf8071ac0 msgr2=0x7fadf80ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.155+0000 7fadfe237640 1 --2- 172.21.15.172:0/1527904021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf8071ac0 0x7fadf80ad5e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fadf80cc3d0 tx=0x7fadec02a110 comp rx=0 tx=0).stop 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.155+0000 7fadfe237640 1 -- 172.21.15.172:0/1527904021 shutdown_connections 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.155+0000 7fadfe237640 1 --2- 172.21.15.172:0/1527904021 >> v2:172.21.15.186:3300/0 conn(0x7fadf806c1d0 0x7fadf806afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.155+0000 7fadfe237640 1 --2- 172.21.15.172:0/1527904021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf8071ac0 0x7fadf80ad5e0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.155+0000 7fadfe237640 1 -- 172.21.15.172:0/1527904021 >> 172.21.15.172:0/1527904021 conn(0x7fadf80af670 msgr2=0x7fadf80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.155+0000 7fadfe237640 1 -- 172.21.15.172:0/1527904021 shutdown_connections 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.155+0000 7fadfe237640 1 -- 172.21.15.172:0/1527904021 wait complete. 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.156+0000 7fadfe237640 1 Processor -- start 2024-04-25T08:50:31.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.156+0000 7fadfe237640 1 -- start start 2024-04-25T08:50:31.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadfe237640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadf8071ac0 0x7fadf80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadfe237640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadf8154ed0 0x7fadf80b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadfe237640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf814e630 0x7fadf814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadfe237640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf806b660 con 0x7fadf814e630 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadfe237640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf806b4e0 con 0x7fadf8071ac0 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadfe237640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf806b7e0 con 0x7fadf8154ed0 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf814e630 0x7fadf814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf814e630 0x7fadf814c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33628/0 (socket says 172.21.15.172:33628) 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf7fff640 1 -- 172.21.15.172:0/3349175069 learned_addr learned my addr 172.21.15.172:0/3349175069 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf77fe640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadf8071ac0 0x7fadf80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf6ffd640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadf8154ed0 0x7fadf80b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf7fff640 1 -- 172.21.15.172:0/3349175069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadf8154ed0 msgr2=0x7fadf80b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf7fff640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadf8154ed0 0x7fadf80b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf7fff640 1 -- 172.21.15.172:0/3349175069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadf8071ac0 msgr2=0x7fadf80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf7fff640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadf8071ac0 0x7fadf80cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf7fff640 1 -- 172.21.15.172:0/3349175069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf80cd850 con 0x7fadf814e630 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf77fe640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadf8071ac0 0x7fadf80cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:31.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadf7fff640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf814e630 0x7fadf814c240 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fadf000b9e0 tx=0x7fadf000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7faddffff640 1 -- 172.21.15.172:0/3349175069 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0019070 con 0x7fadf814e630 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7faddffff640 1 -- 172.21.15.172:0/3349175069 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000cac0 con 0x7fadf814e630 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7faddffff640 1 -- 172.21.15.172:0/3349175069 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0014440 con 0x7fadf814e630 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadfe237640 1 -- 172.21.15.172:0/3349175069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf814fbf0 con 0x7fadf814e630 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.157+0000 7fadfe237640 1 -- 172.21.15.172:0/3349175069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf814f0b0 con 0x7fadf814e630 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.158+0000 7fadfe237640 1 -- 172.21.15.172:0/3349175069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf8073990 con 0x7fadf814e630 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.159+0000 7faddffff640 1 -- 172.21.15.172:0/3349175069 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fadf001c070 con 0x7fadf814e630 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.160+0000 7faddffff640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fade406b4d0 0x7fade406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.160+0000 7faddffff640 1 -- 172.21.15.172:0/3349175069 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fadf0089fc0 con 0x7fadf814e630 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.160+0000 7fadf77fe640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fade406b4d0 0x7fade406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.160+0000 7fadf77fe640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fade406b4d0 0x7fade406d990 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fade8000f60 tx=0x7fade8007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.164+0000 7faddffff640 1 -- 172.21.15.172:0/3349175069 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fadf80cd850 con 0x7fadf814e630 2024-04-25T08:50:31.185 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:50:31.187 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:50:31.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.375+0000 7fadfe237640 1 -- 172.21.15.172:0/3349175069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadf8161d90 con 0x7fadf814e630 2024-04-25T08:50:31.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.376+0000 7faddffff640 1 -- 172.21.15.172:0/3349175069 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fadf0058d40 con 0x7fadf814e630 2024-04-25T08:50:31.367 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:31.367 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:31.367 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:31.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 -- 172.21.15.172:0/3349175069 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fade406b4d0 msgr2=0x7fade406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fade406b4d0 0x7fade406d990 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fade8000f60 tx=0x7fade8007ca0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 -- 172.21.15.172:0/3349175069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf814e630 msgr2=0x7fadf814c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf814e630 0x7fadf814c240 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fadf000b9e0 tx=0x7fadf000bea0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 -- 172.21.15.172:0/3349175069 shutdown_connections 2024-04-25T08:50:31.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fade406b4d0 0x7fade406d990 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fadf814e630 0x7fadf814c240 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fadf8154ed0 0x7fadf80b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 --2- 172.21.15.172:0/3349175069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fadf8071ac0 0x7fadf80cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 -- 172.21.15.172:0/3349175069 >> 172.21.15.172:0/3349175069 conn(0x7fadf806c1d0 msgr2=0x7fadf80aced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 -- 172.21.15.172:0/3349175069 shutdown_connections 2024-04-25T08:50:31.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.378+0000 7fadfe237640 1 -- 172.21.15.172:0/3349175069 wait complete. 2024-04-25T08:50:31.380 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:50:31.380 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:31.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.486+0000 7f160b922640 1 Processor -- start 2024-04-25T08:50:31.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.486+0000 7f160b922640 1 -- start start 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f160b922640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f160415e380 0x7f160415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f160b922640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16041626e0 con 0x7f16040ce330 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f160b922640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1604070270 con 0x7f160406abe0 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f160b922640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040cd270 con 0x7f160415e380 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f1609ebf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f160415e380 0x7f160415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f1609ebf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f160415e380 0x7f160415e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33642/0 (socket says 172.21.15.172:33642) 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f1608ebd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f16040ce330 0x7f160406fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37806/0 (socket says 172.21.15.172:37806) 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f1609ebf640 1 -- 172.21.15.172:0/2775298616 learned_addr learned my addr 172.21.15.172:0/2775298616 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f1609ebf640 1 -- 172.21.15.172:0/2775298616 >> v1:172.21.15.186:6789/0 conn(0x7f160406abe0 legacy=0x7f160406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f1609ebf640 1 -- 172.21.15.172:0/2775298616 >> v1:172.21.15.172:6789/0 conn(0x7f16040ce330 legacy=0x7f160406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f1609ebf640 1 -- 172.21.15.172:0/2775298616 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16040cd550 con 0x7f160415e380 2024-04-25T08:50:31.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.487+0000 7f15fbfff640 1 -- 172.21.15.172:0/2775298616 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113684487 0 0) 0x7f16041626e0 con 0x7f16040ce330 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.488+0000 7f1609ebf640 1 --2- 172.21.15.172:0/2775298616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 0x7f160415e7b0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009e50 tx=0x7f15fc02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8285ccf235536d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.488+0000 7f15fbfff640 1 -- 172.21.15.172:0/2775298616 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc036070 con 0x7f160415e380 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.488+0000 7f15fbfff640 1 -- 172.21.15.172:0/2775298616 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc031600 con 0x7f160415e380 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.488+0000 7f15fbfff640 1 -- 172.21.15.172:0/2775298616 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0319d0 con 0x7f160415e380 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.488+0000 7f160b922640 1 -- 172.21.15.172:0/2775298616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 msgr2=0x7f160415e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.488+0000 7f160b922640 1 --2- 172.21.15.172:0/2775298616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 0x7f160415e7b0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009e50 tx=0x7f15fc02a6d0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.489+0000 7f160b922640 1 -- 172.21.15.172:0/2775298616 shutdown_connections 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.489+0000 7f160b922640 1 --2- 172.21.15.172:0/2775298616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 0x7f160415e7b0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.489+0000 7f160b922640 1 -- 172.21.15.172:0/2775298616 >> 172.21.15.172:0/2775298616 conn(0x7f16040b2220 msgr2=0x7f16040b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.489+0000 7f160b922640 1 -- 172.21.15.172:0/2775298616 shutdown_connections 2024-04-25T08:50:31.480 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.489+0000 7f160b922640 1 -- 172.21.15.172:0/2775298616 wait complete. 2024-04-25T08:50:31.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.490+0000 7f160b922640 1 Processor -- start 2024-04-25T08:50:31.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.490+0000 7f160b922640 1 -- start start 2024-04-25T08:50:31.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.490+0000 7f160b922640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f160406abe0 0x7f160414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f160b922640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16040ce330 0x7f16040cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f160b922640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 0x7f16040b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f160b922640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1604161780 con 0x7f160415e380 2024-04-25T08:50:31.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f160b922640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040cdb10 con 0x7f16040ce330 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f160b922640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160415ecf0 con 0x7f160406abe0 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f1609ebf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 0x7f16040b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f1609ebf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 0x7f16040b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33644/0 (socket says 172.21.15.172:33644) 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f1609ebf640 1 -- 172.21.15.172:0/1376263314 learned_addr learned my addr 172.21.15.172:0/1376263314 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f1608ebd640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16040ce330 0x7f16040cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f16096be640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f160406abe0 0x7f160414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f1609ebf640 1 -- 172.21.15.172:0/1376263314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f160406abe0 msgr2=0x7f160414cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f1609ebf640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f160406abe0 0x7f160414cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f1609ebf640 1 -- 172.21.15.172:0/1376263314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16040ce330 msgr2=0x7f16040cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f1609ebf640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16040ce330 0x7f16040cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f1609ebf640 1 -- 172.21.15.172:0/1376263314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160414d090 con 0x7f160415e380 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f1609ebf640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 0x7f16040b3b40 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f15fc034040 tx=0x7f15fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f15f9ffb640 1 -- 172.21.15.172:0/1376263314 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc041020 con 0x7f160415e380 2024-04-25T08:50:31.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f15f9ffb640 1 -- 172.21.15.172:0/1376263314 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc0077a0 con 0x7f160415e380 2024-04-25T08:50:31.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f160b922640 1 -- 172.21.15.172:0/1376263314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160415a910 con 0x7f160415e380 2024-04-25T08:50:31.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.491+0000 7f15f9ffb640 1 -- 172.21.15.172:0/1376263314 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc036040 con 0x7f160415e380 2024-04-25T08:50:31.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.492+0000 7f160b922640 1 -- 172.21.15.172:0/1376263314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160415ae90 con 0x7f160415e380 2024-04-25T08:50:31.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.493+0000 7f160b922640 1 -- 172.21.15.172:0/1376263314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1604073990 con 0x7f160415e380 2024-04-25T08:50:31.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.493+0000 7f15f9ffb640 1 -- 172.21.15.172:0/1376263314 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f15fc044020 con 0x7f160415e380 2024-04-25T08:50:31.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.493+0000 7f15f9ffb640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15e806b500 0x7f15e806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.493+0000 7f15f9ffb640 1 -- 172.21.15.172:0/1376263314 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f15fc0ab140 con 0x7f160415e380 2024-04-25T08:50:31.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.493+0000 7f16096be640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15e806b500 0x7f15e806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.494+0000 7f16096be640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15e806b500 0x7f15e806d9c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1600004ea0 tx=0x7f1600009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.497+0000 7f15f9ffb640 1 -- 172.21.15.172:0/1376263314 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f15fc04b030 con 0x7f160415e380 2024-04-25T08:50:31.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.733+0000 7f160b922640 1 -- 172.21.15.172:0/1376263314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f16040afe50 con 0x7f160415e380 2024-04-25T08:50:31.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.734+0000 7f15f9ffb640 1 -- 172.21.15.172:0/1376263314 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7f160414d090 con 0x7f160415e380 2024-04-25T08:50:31.725 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:31.725 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":507,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2541289472,"bytes_avail":770552823808,"bytes_total":773094113280,"write_bytes_sec":64841701,"read_op_per_sec":0,"write_op_per_sec":63},"fsmap":{"epoch":68,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-04-25T08:50:28.611018+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:31.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 -- 172.21.15.172:0/1376263314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15e806b500 msgr2=0x7f15e806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15e806b500 0x7f15e806d9c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1600004ea0 tx=0x7f1600009040 comp rx=0 tx=0).stop 2024-04-25T08:50:31.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 -- 172.21.15.172:0/1376263314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 msgr2=0x7f16040b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 0x7f16040b3b40 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f15fc034040 tx=0x7f15fc004a40 comp rx=0 tx=0).stop 2024-04-25T08:50:31.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 -- 172.21.15.172:0/1376263314 shutdown_connections 2024-04-25T08:50:31.727 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f15e806b500 0x7f15e806d9c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16040ce330 0x7f16040cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f160415e380 0x7f16040b3b40 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 --2- 172.21.15.172:0/1376263314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f160406abe0 0x7f160414cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 -- 172.21.15.172:0/1376263314 >> 172.21.15.172:0/1376263314 conn(0x7f16040b2220 msgr2=0x7f16040b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 -- 172.21.15.172:0/1376263314 shutdown_connections 2024-04-25T08:50:31.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.736+0000 7f160b922640 1 -- 172.21.15.172:0/1376263314 wait complete. 2024-04-25T08:50:31.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T08:50:31.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:31.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub resume 2024-04-25T08:50:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.846+0000 7ff5cac5d640 1 Processor -- start 2024-04-25T08:50:31.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.846+0000 7ff5cac5d640 1 -- start start 2024-04-25T08:50:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.847+0000 7ff5cac5d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff5c40ced80 0x7ff5c40d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.847+0000 7ff5cac5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c4161710 0x7ff5c40d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.847+0000 7ff5cac5d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c415e000 con 0x7ff5c415dc20 2024-04-25T08:50:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.847+0000 7ff5cac5d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c40d1de0 con 0x7ff5c40ced80 2024-04-25T08:50:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.847+0000 7ff5cac5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4161c60 con 0x7ff5c4161710 2024-04-25T08:50:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c89f9640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7ff5c415dc20 0x7ff5c40ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:49938/0 (socket says 172.21.15.172:49938) 2024-04-25T08:50:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c89f9640 1 -- 172.21.15.172:0/2728508398 learned_addr learned my addr 172.21.15.172:0/2728508398 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c3fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff5c40ced80 0x7ff5c40d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c91fa640 1 --2- 172.21.15.172:0/2728508398 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c4161710 0x7ff5c40d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c37fe640 1 -- 172.21.15.172:0/2728508398 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312684079 0 0) 0x7ff5c415e000 con 0x7ff5c415dc20 2024-04-25T08:50:31.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c37fe640 1 -- 172.21.15.172:0/2728508398 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5ac003520 con 0x7ff5c415dc20 2024-04-25T08:50:31.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c91fa640 1 -- 172.21.15.172:0/2728508398 >> v2:172.21.15.186:3300/0 conn(0x7ff5c40ced80 msgr2=0x7ff5c40d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c91fa640 1 --2- 172.21.15.172:0/2728508398 >> v2:172.21.15.186:3300/0 conn(0x7ff5c40ced80 0x7ff5c40d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c91fa640 1 -- 172.21.15.172:0/2728508398 >> v1:172.21.15.186:6789/0 conn(0x7ff5c415dc20 legacy=0x7ff5c40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c91fa640 1 -- 172.21.15.172:0/2728508398 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c4161f40 con 0x7ff5c4161710 2024-04-25T08:50:31.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.848+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/2728508398 >> v2:172.21.15.186:3300/0 conn(0x7ff5c40ced80 0x7ff5c40d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:31.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.849+0000 7ff5c91fa640 1 --2- 172.21.15.172:0/2728508398 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c4161710 0x7ff5c40d2820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009d90 tx=0x7ff5bc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e080ae90be8a1fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.849+0000 7ff5c37fe640 1 -- 172.21.15.172:0/2728508398 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc007740 con 0x7ff5c4161710 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.849+0000 7ff5c37fe640 1 -- 172.21.15.172:0/2728508398 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc0078e0 con 0x7ff5c4161710 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.849+0000 7ff5c37fe640 1 -- 172.21.15.172:0/2728508398 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc007c90 con 0x7ff5c4161710 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.850+0000 7ff5cac5d640 1 -- 172.21.15.172:0/2728508398 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c4161710 msgr2=0x7ff5c40d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.850+0000 7ff5cac5d640 1 --2- 172.21.15.172:0/2728508398 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c4161710 0x7ff5c40d2820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009d90 tx=0x7ff5bc02a660 comp rx=0 tx=0).stop 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.850+0000 7ff5cac5d640 1 -- 172.21.15.172:0/2728508398 shutdown_connections 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.850+0000 7ff5cac5d640 1 --2- 172.21.15.172:0/2728508398 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c4161710 0x7ff5c40d2820 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.850+0000 7ff5cac5d640 1 --2- 172.21.15.172:0/2728508398 >> v2:172.21.15.186:3300/0 conn(0x7ff5c40ced80 0x7ff5c40d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.850+0000 7ff5cac5d640 1 -- 172.21.15.172:0/2728508398 >> 172.21.15.172:0/2728508398 conn(0x7ff5c40d0420 msgr2=0x7ff5c40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.850+0000 7ff5cac5d640 1 -- 172.21.15.172:0/2728508398 shutdown_connections 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.850+0000 7ff5cac5d640 1 -- 172.21.15.172:0/2728508398 wait complete. 2024-04-25T08:50:31.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.851+0000 7ff5cac5d640 1 Processor -- start 2024-04-25T08:50:31.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.851+0000 7ff5cac5d640 1 -- start start 2024-04-25T08:50:31.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5cac5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c40ced80 0x7ff5c415f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5cac5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5c415dc20 0x7ff5c414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5cac5d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5c4161710 0x7ff5c40b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5cac5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40b5e50 con 0x7ff5c415dc20 2024-04-25T08:50:31.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5cac5d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4162500 con 0x7ff5c4161710 2024-04-25T08:50:31.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5cac5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40b5fd0 con 0x7ff5c40ced80 2024-04-25T08:50:31.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5c415dc20 0x7ff5c414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5c415dc20 0x7ff5c414ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33648/0 (socket says 172.21.15.172:33648) 2024-04-25T08:50:31.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c3fff640 1 -- 172.21.15.172:0/3493077006 learned_addr learned my addr 172.21.15.172:0/3493077006 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c91fa640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5c4161710 0x7ff5c40b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c40ced80 0x7ff5c415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c3fff640 1 -- 172.21.15.172:0/3493077006 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c40ced80 msgr2=0x7ff5c415f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c40ced80 0x7ff5c415f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c3fff640 1 -- 172.21.15.172:0/3493077006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5c4161710 msgr2=0x7ff5c40b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5c4161710 0x7ff5c40b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c3fff640 1 -- 172.21.15.172:0/3493077006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c415faa0 con 0x7ff5c415dc20 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.852+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5c415dc20 0x7ff5c414ac80 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800e960 tx=0x7ff5b800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.853+0000 7ff5c17fa640 1 -- 172.21.15.172:0/3493077006 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8017070 con 0x7ff5c415dc20 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.853+0000 7ff5c17fa640 1 -- 172.21.15.172:0/3493077006 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b800ca00 con 0x7ff5c415dc20 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.853+0000 7ff5cac5d640 1 -- 172.21.15.172:0/3493077006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c415fd40 con 0x7ff5c415dc20 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.853+0000 7ff5c17fa640 1 -- 172.21.15.172:0/3493077006 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800cdd0 con 0x7ff5c415dc20 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.853+0000 7ff5cac5d640 1 -- 172.21.15.172:0/3493077006 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c4160300 con 0x7ff5c415dc20 2024-04-25T08:50:31.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.854+0000 7ff5c17fa640 1 -- 172.21.15.172:0/3493077006 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff5b801a070 con 0x7ff5c415dc20 2024-04-25T08:50:31.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.854+0000 7ff5c17fa640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff5b006b4d0 0x7ff5b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.855+0000 7ff5c17fa640 1 -- 172.21.15.172:0/3493077006 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff5b808a270 con 0x7ff5c415dc20 2024-04-25T08:50:31.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.855+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff5b006b4d0 0x7ff5b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.855+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff5b006b4d0 0x7ff5b006d990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4000f60 tx=0x7ff5b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5cd965740 1 Processor -- start 2024-04-25T08:50:31.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5cd965740 1 -- start start 2024-04-25T08:50:31.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccb10 0x55ad46ccf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccef0 0x55ad46ccf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46c9f770 0x55ad46ca2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5cd965740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad46c08da0 con 0x55ad46cccef0 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5cd965740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad46bb1b80 con 0x55ad46c9f770 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5cd965740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ad46c04e40 con 0x55ad46cccb10 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5c3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccef0 0x55ad46ccf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5c3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccef0 0x55ad46ccf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33664/0 (socket says 172.21.15.172:33664) 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.856+0000 7ff5c3fff640 1 -- 172.21.15.172:0/1615283522 learned_addr learned my addr 172.21.15.172:0/1615283522 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/1615283522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccb10 0x55ad46ccf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5c91fa640 1 --2- 172.21.15.172:0/1615283522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46c9f770 0x55ad46ca2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5c3fff640 1 -- 172.21.15.172:0/1615283522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccb10 msgr2=0x55ad46ccf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/1615283522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccb10 0x55ad46ccf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5c3fff640 1 -- 172.21.15.172:0/1615283522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46c9f770 msgr2=0x55ad46ca2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.854 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/1615283522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46c9f770 0x55ad46ca2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5c3fff640 1 -- 172.21.15.172:0/1615283522 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad46bbbf10 con 0x55ad46cccef0 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/1615283522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccef0 0x55ad46ccf860 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8060a40 tx=0x7ff5b80589a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9612cf25019e0f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5aa7fc640 1 -- 172.21.15.172:0/1615283522 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8021040 con 0x55ad46cccef0 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5aa7fc640 1 -- 172.21.15.172:0/1615283522 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b80093e0 con 0x55ad46cccef0 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.857+0000 7ff5aa7fc640 1 -- 172.21.15.172:0/1615283522 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8056b60 con 0x55ad46cccef0 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 -- 172.21.15.172:0/1615283522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccef0 msgr2=0x55ad46ccf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 --2- 172.21.15.172:0/1615283522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccef0 0x55ad46ccf860 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8060a40 tx=0x7ff5b80589a0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 -- 172.21.15.172:0/1615283522 shutdown_connections 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 --2- 172.21.15.172:0/1615283522 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46c9f770 0x55ad46ca2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 --2- 172.21.15.172:0/1615283522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccef0 0x55ad46ccf860 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 --2- 172.21.15.172:0/1615283522 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccb10 0x55ad46ccf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 -- 172.21.15.172:0/1615283522 >> 172.21.15.172:0/1615283522 conn(0x55ad46ca19e0 msgr2=0x55ad46cea320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 -- 172.21.15.172:0/1615283522 shutdown_connections 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 -- 172.21.15.172:0/1615283522 wait complete. 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 -- start start 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.858+0000 7ff5cd965740 1 Processor -- start 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cccef0 0x55ad46cedd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cee240 0x55ad46cd1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5cd965740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad46ca4b90 con 0x55ad46cccb10 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5cd965740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad46ba74b0 con 0x55ad46cccef0 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5cd965740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ad46ca4e70 con 0x55ad46cee240 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5cd965740 10 client.0 _ll_register_callbacks cb 0x55ad46be7180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:31.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5c89f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5c89f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33666/0 (socket says 172.21.15.172:33666) 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5c89f9640 1 -- 172.21.15.172:0/3839487714 learned_addr learned my addr 172.21.15.172:0/3839487714 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5c91fa640 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cee240 0x55ad46cd1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.859+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cccef0 0x55ad46cedd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5c89f9640 1 -- 172.21.15.172:0/3839487714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cee240 msgr2=0x55ad46cd1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cee240 0x55ad46cd1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5c89f9640 1 -- 172.21.15.172:0/3839487714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cccef0 msgr2=0x55ad46cedd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cccef0 0x55ad46cedd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5c89f9640 1 -- 172.21.15.172:0/3839487714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad469e77d0 con 0x55ad46cccb10 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cca9c0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4007680 tx=0x7ff5b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6801e95a8af87697 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3839487714 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4014e40 con 0x55ad46cccb10 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3839487714 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff5b4020c10 con 0x55ad46cccb10 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5cd965740 1 -- 172.21.15.172:0/3839487714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5b80093e0 con 0x55ad46cccb10 2024-04-25T08:50:31.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3839487714 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5b4020e10 con 0x55ad46cccb10 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5cd965740 10 client.9021 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5cd965740 1 -- 172.21.15.172:0/3839487714 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55ad4691d3f0 con 0x55ad46cccb10 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3839487714 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b80093e0 con 0x55ad46cccb10 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3839487714 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff5b4020420 con 0x55ad46cccb10 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5cd965740 10 client.9021 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5cd965740 10 client.9021 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5cd965740 20 client.9021 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55ad46cfdb00 0x55ad46cfdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5cd965740 4 client.9021 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5cd965740 1 -- 172.21.15.172:0/3839487714 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad46c162e0 con 0x55ad46cfdb00 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.860+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55ad46cfdb00 0x55ad46cfdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55ad46cfdb00 0x55ad46cfdee0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=409338d100a2a840 server_cookie=790567963f93b963 in_seq=0 out_seq=0 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5a37fe640 10 client.9021 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3839487714 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ad46c162e0 con 0x55ad46cfdb00 2024-04-25T08:50:31.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5a37fe640 10 client.9021 handle_command_reply: tid=0 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 client.9021 shutdown 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 -- 172.21.15.172:0/3839487714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 msgr2=0x55ad46cca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cca9c0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4007680 tx=0x7ff5b4000bc0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 -- 172.21.15.172:0/3839487714 shutdown_connections 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55ad46cfdb00 0x55ad46cfdee0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cccef0 0x55ad46cedd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cee240 0x55ad46cd1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5a37fe640 0 client.9021 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3839487714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cca9c0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 -- 172.21.15.172:0/3839487714 >> 172.21.15.172:0/3839487714 conn(0x55ad46c9f770 msgr2=0x55ad46ccf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 -- 172.21.15.172:0/3839487714 shutdown_connections 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.861+0000 7ff5cd965740 1 -- 172.21.15.172:0/3839487714 wait complete. 2024-04-25T08:50:31.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.862+0000 7ff5cd965740 20 client.9021 trim_cache size 0 max 16384 2024-04-25T08:50:31.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.876+0000 7ff5cd965740 1 Processor -- start 2024-04-25T08:50:31.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.876+0000 7ff5cd965740 1 -- start start 2024-04-25T08:50:31.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cccb10 0x55ad46cd1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccef0 0x55ad46c9fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cee240 0x55ad46d0cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5cd965740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4200490 con 0x55ad46cee240 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5cd965740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c41ff690 con 0x55ad46cccb10 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5cd965740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40cb360 con 0x55ad46cccef0 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c91fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cee240 0x55ad46d0cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c91fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cee240 0x55ad46d0cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33670/0 (socket says 172.21.15.172:33670) 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c91fa640 1 -- 172.21.15.172:0/286855985 learned_addr learned my addr 172.21.15.172:0/286855985 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/286855985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccef0 0x55ad46c9fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/286855985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cccb10 0x55ad46cd1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c91fa640 1 -- 172.21.15.172:0/286855985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccef0 msgr2=0x55ad46c9fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c91fa640 1 --2- 172.21.15.172:0/286855985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccef0 0x55ad46c9fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c91fa640 1 -- 172.21.15.172:0/286855985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cccb10 msgr2=0x55ad46cd1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c91fa640 1 --2- 172.21.15.172:0/286855985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cccb10 0x55ad46cd1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c91fa640 1 -- 172.21.15.172:0/286855985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad468dd0f0 con 0x55ad46cee240 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5c91fa640 1 --2- 172.21.15.172:0/286855985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cee240 0x55ad46d0cac0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009eb0 tx=0x7ff5bc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10d9da1459c4a0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5a9ffb640 1 -- 172.21.15.172:0/286855985 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc009450 con 0x55ad46cee240 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5a9ffb640 1 -- 172.21.15.172:0/286855985 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc007540 con 0x55ad46cee240 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.877+0000 7ff5a9ffb640 1 -- 172.21.15.172:0/286855985 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc007910 con 0x55ad46cee240 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.878+0000 7ff5cd965740 1 -- 172.21.15.172:0/286855985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cee240 msgr2=0x55ad46d0cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.878+0000 7ff5cd965740 1 --2- 172.21.15.172:0/286855985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cee240 0x55ad46d0cac0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009eb0 tx=0x7ff5bc02e000 comp rx=0 tx=0).stop 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.878+0000 7ff5cd965740 1 -- 172.21.15.172:0/286855985 shutdown_connections 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.878+0000 7ff5cd965740 1 --2- 172.21.15.172:0/286855985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cee240 0x55ad46d0cac0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.878+0000 7ff5cd965740 1 --2- 172.21.15.172:0/286855985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccef0 0x55ad46c9fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.878+0000 7ff5cd965740 1 --2- 172.21.15.172:0/286855985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cccb10 0x55ad46cd1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.878+0000 7ff5cd965740 1 -- 172.21.15.172:0/286855985 >> 172.21.15.172:0/286855985 conn(0x55ad46c9f770 msgr2=0x55ad46ccaa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.878+0000 7ff5cd965740 1 -- 172.21.15.172:0/286855985 shutdown_connections 2024-04-25T08:50:31.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.878+0000 7ff5cd965740 1 -- 172.21.15.172:0/286855985 wait complete. 2024-04-25T08:50:31.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.878+0000 7ff5cd965740 1 -- start start 2024-04-25T08:50:31.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.879+0000 7ff5cd965740 1 Processor -- start 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.879+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cec4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.879+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccef0 0x55ad46d549b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.879+0000 7ff5cd965740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cee240 0x55ad46cf1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.879+0000 7ff5cd965740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad46cd0f80 con 0x55ad46cccb10 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.879+0000 7ff5cd965740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40cb960 con 0x55ad46cee240 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.879+0000 7ff5cd965740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ad46d045d0 con 0x55ad46cccef0 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.879+0000 7ff5cd965740 10 client.0 _ll_register_callbacks cb 0x7ff5b8054b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c89f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c89f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cec4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33682/0 (socket says 172.21.15.172:33682) 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c89f9640 1 -- 172.21.15.172:0/3731516062 learned_addr learned my addr 172.21.15.172:0/3731516062 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccef0 0x55ad46d549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c91fa640 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cee240 0x55ad46cf1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c89f9640 1 -- 172.21.15.172:0/3731516062 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccef0 msgr2=0x55ad46d549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccef0 0x55ad46d549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c89f9640 1 -- 172.21.15.172:0/3731516062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cee240 msgr2=0x55ad46cf1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cee240 0x55ad46cf1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c89f9640 1 -- 172.21.15.172:0/3731516062 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad46cf2700 con 0x55ad46cccb10 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5c89f9640 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cec4b0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009010 tx=0x7ff5b4007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2b7f9030da30d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3731516062 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4038060 con 0x55ad46cccb10 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3731516062 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff5b4020920 con 0x55ad46cccb10 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5cd965740 1 -- 172.21.15.172:0/3731516062 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5bc007540 con 0x55ad46cccb10 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3731516062 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5b403e050 con 0x55ad46cccb10 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5cd965740 10 client.9027 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5cd965740 1 -- 172.21.15.172:0/3731516062 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55ad46cf21e0 con 0x55ad46cccb10 2024-04-25T08:50:31.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.880+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3731516062 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc007540 con 0x55ad46cccb10 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3731516062 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff5b4041020 con 0x55ad46cccb10 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 10 client.9027 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 10 client.9027 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 20 client.9027 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55ad46cca860 0x55ad46ccac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 4 client.9027 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 -- 172.21.15.172:0/3731516062 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x55ad46ceefb0 con 0x55ad46cca860 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55ad46cca860 0x55ad46ccac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5a37fe640 10 client.9027 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5c3fff640 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55ad46cca860 0x55ad46ccac70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9699032354d878c8 server_cookie=81005386f4d8483e in_seq=0 out_seq=0 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5a37fe640 1 -- 172.21.15.172:0/3731516062 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55ad46ceefb0 con 0x55ad46cca860 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5a37fe640 10 client.9027 handle_command_reply: tid=0 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 client.9027 shutdown 2024-04-25T08:50:31.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 -- 172.21.15.172:0/3731516062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 msgr2=0x55ad46cec4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cec4b0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009010 tx=0x7ff5b4007000 comp rx=0 tx=0).stop 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 -- 172.21.15.172:0/3731516062 shutdown_connections 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55ad46cca860 0x55ad46ccac70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ad46cee240 0x55ad46cf1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5a37fe640 0 client.9027 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ad46cccef0 0x55ad46d549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 --2- 172.21.15.172:0/3731516062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad46cccb10 0x55ad46cec4b0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.881+0000 7ff5cd965740 1 -- 172.21.15.172:0/3731516062 >> 172.21.15.172:0/3731516062 conn(0x55ad46c9f770 msgr2=0x55ad46cd1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cd965740 1 -- 172.21.15.172:0/3731516062 shutdown_connections 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cd965740 1 -- 172.21.15.172:0/3731516062 wait complete. 2024-04-25T08:50:31.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cd965740 20 client.9027 trim_cache size 0 max 16384 2024-04-25T08:50:31.880 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:50:31.880 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0 2024-04-25T08:50:31.880 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 -- 172.21.15.172:0/3493077006 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff5b006b4d0 msgr2=0x7ff5b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff5b006b4d0 0x7ff5b006d990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4000f60 tx=0x7ff5b4009040 comp rx=0 tx=0).stop 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 -- 172.21.15.172:0/3493077006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5c415dc20 msgr2=0x7ff5c414ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5c415dc20 0x7ff5c414ac80 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800e960 tx=0x7ff5b800ee20 comp rx=0 tx=0).stop 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 -- 172.21.15.172:0/3493077006 shutdown_connections 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff5b006b4d0 0x7ff5b006d990 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5c4161710 0x7ff5c40b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5c415dc20 0x7ff5c414ac80 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 --2- 172.21.15.172:0/3493077006 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5c40ced80 0x7ff5c415f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 -- 172.21.15.172:0/3493077006 >> 172.21.15.172:0/3493077006 conn(0x7ff5c40d0420 msgr2=0x7ff5c40d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 -- 172.21.15.172:0/3493077006 shutdown_connections 2024-04-25T08:50:31.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.882+0000 7ff5cac5d640 1 -- 172.21.15.172:0/3493077006 wait complete. 2024-04-25T08:50:31.884 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-25T08:50:31.884 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-04-25T08:50:31.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.993+0000 7f9fad73b640 1 Processor -- start 2024-04-25T08:50:31.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.993+0000 7f9fad73b640 1 -- start start 2024-04-25T08:50:31.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fad73b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9fa815dc20 0x7f9fa80ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fad73b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa806cda0 con 0x7f9fa80d32f0 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fad73b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa815e000 con 0x7f9fa8161710 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fad73b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80d1de0 con 0x7f9fa815dc20 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fa6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9fa815dc20 0x7f9fa80ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fa77fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9fa80d32f0 0x7f9fa806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37816/0 (socket says 172.21.15.172:37816) 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fa77fe640 1 -- 172.21.15.172:0/4176068604 learned_addr learned my addr 172.21.15.172:0/4176068604 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fa6ffd640 1 -- 172.21.15.172:0/4176068604 >> v1:172.21.15.186:6789/0 conn(0x7f9fa8161710 legacy=0x7f9fa806bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fa6ffd640 1 -- 172.21.15.172:0/4176068604 >> v1:172.21.15.172:6789/0 conn(0x7f9fa80d32f0 legacy=0x7f9fa806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fa67fc640 1 -- 172.21.15.172:0/4176068604 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260683058 0 0) 0x7f9fa806cda0 con 0x7f9fa80d32f0 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.994+0000 7f9fa6ffd640 1 -- 172.21.15.172:0/4176068604 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8161c60 con 0x7f9fa815dc20 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.995+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/4176068604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 0x7f9fa80ce670 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f9f980097a0 tx=0x7f9f9802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1380263436983e55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.995+0000 7f9fa67fc640 1 -- 172.21.15.172:0/4176068604 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f98037070 con 0x7f9fa815dc20 2024-04-25T08:50:31.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.995+0000 7f9fa67fc640 1 -- 172.21.15.172:0/4176068604 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f98032440 con 0x7f9fa815dc20 2024-04-25T08:50:31.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.995+0000 7f9fa67fc640 1 -- 172.21.15.172:0/4176068604 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f98032810 con 0x7f9fa815dc20 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.996+0000 7f9fad73b640 1 -- 172.21.15.172:0/4176068604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 msgr2=0x7f9fa80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.996+0000 7f9fad73b640 1 --2- 172.21.15.172:0/4176068604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 0x7f9fa80ce670 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f9f980097a0 tx=0x7f9f9802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.996+0000 7f9fad73b640 1 -- 172.21.15.172:0/4176068604 shutdown_connections 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.996+0000 7f9fad73b640 1 --2- 172.21.15.172:0/4176068604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 0x7f9fa80ce670 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.996+0000 7f9fad73b640 1 -- 172.21.15.172:0/4176068604 >> 172.21.15.172:0/4176068604 conn(0x7f9fa80d0420 msgr2=0x7f9fa80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.996+0000 7f9fad73b640 1 -- 172.21.15.172:0/4176068604 shutdown_connections 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.996+0000 7f9fad73b640 1 -- 172.21.15.172:0/4176068604 wait complete. 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.997+0000 7f9fad73b640 1 Processor -- start 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.997+0000 7f9fad73b640 1 -- start start 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.997+0000 7f9fad73b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fa80d32f0 0x7f9fa81f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.997+0000 7f9fad73b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 0x7f9fa815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.997+0000 7f9fad73b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fa8161710 0x7f9fa80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9fad73b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8162500 con 0x7f9fa815dc20 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9fad73b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8162220 con 0x7f9fa8161710 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9fad73b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80b5e50 con 0x7f9fa80d32f0 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 0x7f9fa815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 0x7f9fa815cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33706/0 (socket says 172.21.15.172:33706) 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9ffff640 1 -- 172.21.15.172:0/1599328509 learned_addr learned my addr 172.21.15.172:0/1599328509 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9fa77fe640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fa8161710 0x7f9fa80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fa80d32f0 0x7f9fa81f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9ffff640 1 -- 172.21.15.172:0/1599328509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fa80d32f0 msgr2=0x7f9fa81f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fa80d32f0 0x7f9fa81f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9ffff640 1 -- 172.21.15.172:0/1599328509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fa8161710 msgr2=0x7f9fa80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fa8161710 0x7f9fa80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9ffff640 1 -- 172.21.15.172:0/1599328509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80cbf50 con 0x7f9fa815dc20 2024-04-25T08:50:31.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9fa77fe640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fa8161710 0x7f9fa80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fa80d32f0 0x7f9fa81f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 0x7f9fa815cfb0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c410 tx=0x7f9f9000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9f7fe640 1 -- 172.21.15.172:0/1599328509 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90017070 con 0x7f9fa815dc20 2024-04-25T08:50:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9f7fe640 1 -- 172.21.15.172:0/1599328509 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f900035f0 con 0x7f9fa815dc20 2024-04-25T08:50:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9fad73b640 1 -- 172.21.15.172:0/1599328509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa80cc230 con 0x7f9fa815dc20 2024-04-25T08:50:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9f9f7fe640 1 -- 172.21.15.172:0/1599328509 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90003a20 con 0x7f9fa815dc20 2024-04-25T08:50:31.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:31.998+0000 7f9fad73b640 1 -- 172.21.15.172:0/1599328509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa80cc7f0 con 0x7f9fa815dc20 2024-04-25T08:50:31.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.000+0000 7f9f9f7fe640 1 -- 172.21.15.172:0/1599328509 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9f9001a070 con 0x7f9fa815dc20 2024-04-25T08:50:31.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.000+0000 7f9f9f7fe640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f8806b4d0 0x7f9f8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:31.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.000+0000 7f9f9f7fe640 1 -- 172.21.15.172:0/1599328509 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9f900898a0 con 0x7f9fa815dc20 2024-04-25T08:50:31.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.000+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f8806b4d0 0x7f9f8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:31.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.000+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f8806b4d0 0x7f9f8806d990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9f98034000 tx=0x7f9f9802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:31.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.001+0000 7f9fb0443740 1 Processor -- start 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.001+0000 7f9fb0443740 1 -- start start 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09b10 0x55c4f6a0c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 0x55c4f6a0c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f69dc770 0x55c4f69dff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fb0443740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f6945da0 con 0x55c4f69dc770 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fb0443740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f68eeb80 con 0x55c4f6a09b10 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fb0443740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4f6941e40 con 0x55c4f6a09ef0 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f69dc770 0x55c4f69dff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f69dc770 0x55c4f69dff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33720/0 (socket says 172.21.15.172:33720) 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fa77fe640 1 -- 172.21.15.172:0/3718579684 learned_addr learned my addr 172.21.15.172:0/3718579684 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/3718579684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09b10 0x55c4f6a0c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/3718579684 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 0x55c4f6a0c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fa77fe640 1 -- 172.21.15.172:0/3718579684 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 msgr2=0x55c4f6a0c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fa77fe640 1 --2- 172.21.15.172:0/3718579684 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 0x55c4f6a0c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fa77fe640 1 -- 172.21.15.172:0/3718579684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09b10 msgr2=0x55c4f6a0c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fa77fe640 1 --2- 172.21.15.172:0/3718579684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09b10 0x55c4f6a0c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.002+0000 7f9fa77fe640 1 -- 172.21.15.172:0/3718579684 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f68f8f10 con 0x55c4f69dc770 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9fa77fe640 1 --2- 172.21.15.172:0/3718579684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f69dc770 0x55c4f69dff80 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00073b0 tx=0x7f9fa0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a997ca3e3260eb12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9f9cff9640 1 -- 172.21.15.172:0/3718579684 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0001d00 con 0x55c4f69dc770 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9f9cff9640 1 -- 172.21.15.172:0/3718579684 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa0001ea0 con 0x55c4f69dc770 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9f9cff9640 1 -- 172.21.15.172:0/3718579684 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0014430 con 0x55c4f69dc770 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9fb0443740 1 -- 172.21.15.172:0/3718579684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f69dc770 msgr2=0x55c4f69dff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3718579684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f69dc770 0x55c4f69dff80 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00073b0 tx=0x7f9fa0007870 comp rx=0 tx=0).stop 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9fb0443740 1 -- 172.21.15.172:0/3718579684 shutdown_connections 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3718579684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f69dc770 0x55c4f69dff80 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3718579684 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 0x55c4f6a0c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3718579684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09b10 0x55c4f6a0c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9fb0443740 1 -- 172.21.15.172:0/3718579684 >> 172.21.15.172:0/3718579684 conn(0x55c4f69de9e0 msgr2=0x55c4f6a27320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9fb0443740 1 -- 172.21.15.172:0/3718579684 shutdown_connections 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.003+0000 7f9fb0443740 1 -- 172.21.15.172:0/3718579684 wait complete. 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.004+0000 7f9fb0443740 1 -- start start 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.004+0000 7f9fb0443740 1 Processor -- start 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09b10 0x55c4f69ff840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09ef0 0x55c4f69ff130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a00da0 0x55c4f6a25f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fb0443740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f69e1b90 con 0x55c4f6a00da0 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fb0443740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f68e44b0 con 0x55c4f6a09ef0 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fb0443740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4f69e1e70 con 0x55c4f6a09b10 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fb0443740 10 client.0 _ll_register_callbacks cb 0x55c4f6924180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a00da0 0x55c4f6a25f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a00da0 0x55c4f6a25f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33722/0 (socket says 172.21.15.172:33722) 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa77fe640 1 -- 172.21.15.172:0/3657364191 learned_addr learned my addr 172.21.15.172:0/3657364191 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09ef0 0x55c4f69ff130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09b10 0x55c4f69ff840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa77fe640 1 -- 172.21.15.172:0/3657364191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09b10 msgr2=0x55c4f69ff840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa77fe640 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09b10 0x55c4f69ff840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa77fe640 1 -- 172.21.15.172:0/3657364191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09ef0 msgr2=0x55c4f69ff130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa77fe640 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09ef0 0x55c4f69ff130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa77fe640 1 -- 172.21.15.172:0/3657364191 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4f67247d0 con 0x55c4f6a00da0 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09b10 0x55c4f69ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fa77fe640 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a00da0 0x55c4f6a25f20 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0016040 tx=0x7f9fa0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e2722b1de2b335 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9f85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9f85ffb640 1 -- 172.21.15.172:0/3657364191 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa001e660 con 0x55c4f6a00da0 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9f85ffb640 1 -- 172.21.15.172:0/3657364191 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9fa001e800 con 0x55c4f6a00da0 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.005+0000 7f9fb0443740 1 -- 172.21.15.172:0/3657364191 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9fa0001ea0 con 0x55c4f6a00da0 2024-04-25T08:50:32.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9f85ffb640 1 -- 172.21.15.172:0/3657364191 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fa002b050 con 0x55c4f6a00da0 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9fb0443740 10 client.9042 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9fb0443740 1 -- 172.21.15.172:0/3657364191 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55c4f665a3f0 con 0x55c4f6a00da0 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9f85ffb640 1 -- 172.21.15.172:0/3657364191 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa0001ea0 con 0x55c4f6a00da0 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9f85ffb640 1 -- 172.21.15.172:0/3657364191 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9fa002e020 con 0x55c4f6a00da0 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9fb0443740 10 client.9042 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9fb0443740 10 client.9042 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9fb0443740 20 client.9042 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55c4f6a28920 0x55c4f6a28d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9fb0443740 4 client.9042 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9fb0443740 1 -- 172.21.15.172:0/3657364191 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4f69532e0 con 0x55c4f6a28920 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55c4f6a28920 0x55c4f6a28d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9f85ffb640 10 client.9042 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.006+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55c4f6a28920 0x55c4f6a28d50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d22a0f1345e2be34 server_cookie=2a86e34bd14e053e in_seq=0 out_seq=0 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9f85ffb640 1 -- 172.21.15.172:0/3657364191 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c4f69532e0 con 0x55c4f6a28920 2024-04-25T08:50:32.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9f85ffb640 10 client.9042 handle_command_reply: tid=0 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 client.9042 shutdown 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 -- 172.21.15.172:0/3657364191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a00da0 msgr2=0x55c4f6a25f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a00da0 0x55c4f6a25f20 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0016040 tx=0x7f9fa0011000 comp rx=0 tx=0).stop 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 -- 172.21.15.172:0/3657364191 shutdown_connections 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55c4f6a28920 0x55c4f6a28d50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09ef0 0x55c4f69ff130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a00da0 0x55c4f6a25f20 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9f85ffb640 0 client.9042 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3657364191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09b10 0x55c4f69ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 -- 172.21.15.172:0/3657364191 >> 172.21.15.172:0/3657364191 conn(0x55c4f69dc770 msgr2=0x55c4f69dd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 -- 172.21.15.172:0/3657364191 shutdown_connections 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 1 -- 172.21.15.172:0/3657364191 wait complete. 2024-04-25T08:50:32.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.007+0000 7f9fb0443740 20 client.9042 trim_cache size 0 max 16384 2024-04-25T08:50:32.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.022+0000 7f9fb0443740 1 Processor -- start 2024-04-25T08:50:32.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.022+0000 7f9fb0443740 1 -- start start 2024-04-25T08:50:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a00da0 0x55c4f6a0fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a103b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09ef0 0x55c4f6a272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9fb0443740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8200210 con 0x55c4f6a09b10 2024-04-25T08:50:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9fb0443740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81ff420 con 0x55c4f6a09ef0 2024-04-25T08:50:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9fb0443740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80acd70 con 0x55c4f6a00da0 2024-04-25T08:50:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f9ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a103b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f9ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a103b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33728/0 (socket says 172.21.15.172:33728) 2024-04-25T08:50:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f9ffff640 1 -- 172.21.15.172:0/3416758611 learned_addr learned my addr 172.21.15.172:0/3416758611 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:32.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f9ffff640 1 -- 172.21.15.172:0/3416758611 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a00da0 msgr2=0x55c4f6a0fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/3416758611 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a00da0 0x55c4f6a0fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f9ffff640 1 -- 172.21.15.172:0/3416758611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09ef0 msgr2=0x55c4f6a272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/3416758611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09ef0 0x55c4f6a272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f9ffff640 1 -- 172.21.15.172:0/3416758611 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f661a0f0 con 0x55c4f6a09b10 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/3416758611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a103b0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f9f90057b90 tx=0x7f9f90009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40245830a3a397e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f87fff640 1 -- 172.21.15.172:0/3416758611 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90086070 con 0x55c4f6a09b10 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f87fff640 1 -- 172.21.15.172:0/3416758611 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9006f070 con 0x55c4f6a09b10 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.023+0000 7f9f87fff640 1 -- 172.21.15.172:0/3416758611 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90056190 con 0x55c4f6a09b10 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 -- 172.21.15.172:0/3416758611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 msgr2=0x55c4f6a103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3416758611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a103b0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f9f90057b90 tx=0x7f9f90009040 comp rx=0 tx=0).stop 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 -- 172.21.15.172:0/3416758611 shutdown_connections 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3416758611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a09ef0 0x55c4f6a272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3416758611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a103b0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 --2- 172.21.15.172:0/3416758611 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a00da0 0x55c4f6a0fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 -- 172.21.15.172:0/3416758611 >> 172.21.15.172:0/3416758611 conn(0x55c4f69dc770 msgr2=0x55c4f69fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:32.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 -- 172.21.15.172:0/3416758611 shutdown_connections 2024-04-25T08:50:32.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 -- 172.21.15.172:0/3416758611 wait complete. 2024-04-25T08:50:32.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 -- start start 2024-04-25T08:50:32.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.024+0000 7f9fb0443740 1 Processor -- start 2024-04-25T08:50:32.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a00da0 0x55c4f69fd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a24c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9fb0443740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 0x55c4f6a272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9fb0443740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f69e1670 con 0x55c4f6a09b10 2024-04-25T08:50:32.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9fb0443740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81f7b10 con 0x55c4f6a00da0 2024-04-25T08:50:32.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9fb0443740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4f69e3ed0 con 0x55c4f6a09ef0 2024-04-25T08:50:32.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9fb0443740 10 client.0 _ll_register_callbacks cb 0x7f9fa8062560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:50:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9f9ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a24c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9f9ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a24c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33730/0 (socket says 172.21.15.172:33730) 2024-04-25T08:50:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9f9ffff640 1 -- 172.21.15.172:0/2324579386 learned_addr learned my addr 172.21.15.172:0/2324579386 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a00da0 0x55c4f69fd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.025+0000 7f9fa77fe640 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 0x55c4f6a272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f9ffff640 1 -- 172.21.15.172:0/2324579386 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 msgr2=0x55c4f6a272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 0x55c4f6a272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f9ffff640 1 -- 172.21.15.172:0/2324579386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a00da0 msgr2=0x55c4f69fd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a00da0 0x55c4f69fd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f9ffff640 1 -- 172.21.15.172:0/2324579386 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4f6a1d760 con 0x55c4f6a09b10 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fa77fe640 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 0x55c4f6a272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f9ffff640 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a24c80 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000cdd0 tx=0x7f9f9006d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e0f9dd54e85dcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f85ffb640 1 -- 172.21.15.172:0/2324579386 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90075070 con 0x55c4f6a09b10 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f85ffb640 1 -- 172.21.15.172:0/2324579386 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9f90003bc0 con 0x55c4f6a09b10 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fb0443740 1 -- 172.21.15.172:0/2324579386 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f9006f070 con 0x55c4f6a09b10 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f85ffb640 1 -- 172.21.15.172:0/2324579386 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f90086070 con 0x55c4f6a09b10 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fb0443740 10 client.9048 fetch_fsmap learned FSMap version 68 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fb0443740 1 -- 172.21.15.172:0/2324579386 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x55c4f69e12d0 con 0x55c4f6a09b10 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f85ffb640 1 -- 172.21.15.172:0/2324579386 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9006f070 con 0x55c4f6a09b10 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9f85ffb640 1 -- 172.21.15.172:0/2324579386 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 68) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9f900572e0 con 0x55c4f6a09b10 2024-04-25T08:50:32.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fb0443740 10 client.9048 fetch_fsmap finished waiting for FSMap version 68 2024-04-25T08:50:32.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fb0443740 10 client.9048 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T08:50:32.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fb0443740 20 client.9048 populate_metadata read hostname 'smithi172' 2024-04-25T08:50:32.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fb0443740 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55c4f69d7b80 0x55c4f6a27800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fb0443740 4 client.9048 mds_command: new command op to 8670 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:50:32.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fb0443740 1 -- 172.21.15.172:0/2324579386 --> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c4f6a0fa00 con 0x55c4f69d7b80 2024-04-25T08:50:32.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.026+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55c4f69d7b80 0x55c4f6a27800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9f85ffb640 10 client.9048 ms_handle_connect on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:32.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fa6ffd640 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55c4f69d7b80 0x55c4f6a27800 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b84e1c9cbf3b66a0 server_cookie=f8dfc290f1424255 in_seq=0 out_seq=0 2024-04-25T08:50:32.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9f85ffb640 1 -- 172.21.15.172:0/2324579386 <== mds.0 v2:172.21.15.172:6836/3573637584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c4f6a0fa00 con 0x55c4f69d7b80 2024-04-25T08:50:32.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9f85ffb640 10 client.9048 handle_command_reply: tid=0 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 client.9048 shutdown 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 -- 172.21.15.172:0/2324579386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 msgr2=0x55c4f6a24c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a24c80 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000cdd0 tx=0x7f9f9006d070 comp rx=0 tx=0).stop 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 -- 172.21.15.172:0/2324579386 shutdown_connections 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.172:6836/3573637584,v1:172.21.15.172:6837/3573637584] conn(0x55c4f69d7b80 0x55c4f6a27800 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55c4f6a09ef0 0x55c4f6a272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9f85ffb640 0 client.9048 ms_handle_reset on v2:172.21.15.172:6836/3573637584 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c4f6a09b10 0x55c4f6a24c80 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 --2- 172.21.15.172:0/2324579386 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c4f6a00da0 0x55c4f69fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 -- 172.21.15.172:0/2324579386 >> 172.21.15.172:0/2324579386 conn(0x55c4f69dc770 msgr2=0x55c4f6a0c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 -- 172.21.15.172:0/2324579386 shutdown_connections 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 1 -- 172.21.15.172:0/2324579386 wait complete. 2024-04-25T08:50:32.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fb0443740 20 client.9048 trim_cache size 0 max 16384 2024-04-25T08:50:32.026 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:50:32.026 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "no active scrubs running", 2024-04-25T08:50:32.026 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": {} 2024-04-25T08:50:32.026 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:50:32.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fad73b640 1 -- 172.21.15.172:0/1599328509 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f8806b4d0 msgr2=0x7f9f8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fad73b640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f8806b4d0 0x7f9f8806d990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9f98034000 tx=0x7f9f9802e000 comp rx=0 tx=0).stop 2024-04-25T08:50:32.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fad73b640 1 -- 172.21.15.172:0/1599328509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 msgr2=0x7f9fa815cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.027+0000 7f9fad73b640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 0x7f9fa815cfb0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c410 tx=0x7f9f9000c8d0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.028+0000 7f9fad73b640 1 -- 172.21.15.172:0/1599328509 shutdown_connections 2024-04-25T08:50:32.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.028+0000 7f9fad73b640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9f8806b4d0 0x7f9f8806d990 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.028+0000 7f9fad73b640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9fa8161710 0x7f9fa80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.028+0000 7f9fad73b640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fa815dc20 0x7f9fa815cfb0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.028+0000 7f9fad73b640 1 --2- 172.21.15.172:0/1599328509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9fa80d32f0 0x7f9fa81f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.028+0000 7f9fad73b640 1 -- 172.21.15.172:0/1599328509 >> 172.21.15.172:0/1599328509 conn(0x7f9fa80d0420 msgr2=0x7f9fa80c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:32.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.028+0000 7f9fad73b640 1 -- 172.21.15.172:0/1599328509 shutdown_connections 2024-04-25T08:50:32.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.028+0000 7f9fad73b640 1 -- 172.21.15.172:0/1599328509 wait complete. 2024-04-25T08:50:32.031 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T08:50:32.031 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:32.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.137+0000 7fb5f0e8f640 1 Processor -- start 2024-04-25T08:50:32.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.137+0000 7fb5f0e8f640 1 -- start start 2024-04-25T08:50:32.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.138+0000 7fb5f0e8f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb5ec15dbe0 0x7fb5ec0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.138+0000 7fb5f0e8f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb5ec0b92a0 0x7fb5ec0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.138+0000 7fb5f0e8f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec0b97a0 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.138+0000 7fb5f0e8f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec15dfc0 con 0x7fb5ec15dbe0 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.138+0000 7fb5f0e8f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec0d1a00 con 0x7fb5ec0b92a0 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.139+0000 7fb5ea59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb5ec15dbe0 0x7fb5ec0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.139+0000 7fb5ea59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb5ec15dbe0 0x7fb5ec0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33734/0 (socket says 172.21.15.172:33734) 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.139+0000 7fb5e9d9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb5ec0b2cb0 0x7fb5ec0b5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37822/0 (socket says 172.21.15.172:37822) 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.139+0000 7fb5ea59c640 1 -- 172.21.15.172:0/515504703 learned_addr learned my addr 172.21.15.172:0/515504703 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.139+0000 7fb5ea59c640 1 -- 172.21.15.172:0/515504703 >> v2:172.21.15.186:3300/0 conn(0x7fb5ec0b92a0 msgr2=0x7fb5ec0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.139+0000 7fb5ea59c640 1 --2- 172.21.15.172:0/515504703 >> v2:172.21.15.186:3300/0 conn(0x7fb5ec0b92a0 0x7fb5ec0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.139+0000 7fb5ea59c640 1 -- 172.21.15.172:0/515504703 >> v1:172.21.15.172:6789/0 conn(0x7fb5ec0b2cb0 legacy=0x7fb5ec0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.139+0000 7fb5e959a640 1 -- 172.21.15.172:0/515504703 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280035078 0 0) 0x7fb5ec0b97a0 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.139+0000 7fb5ea59c640 1 -- 172.21.15.172:0/515504703 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec0d1c50 con 0x7fb5ec15dbe0 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5ea59c640 1 --2- 172.21.15.172:0/515504703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec15dbe0 0x7fb5ec0d0910 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0cfb90 tx=0x7fb5e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5439e97cfb39d220 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5e959a640 1 -- 172.21.15.172:0/515504703 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0037070 con 0x7fb5ec15dbe0 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5e959a640 1 -- 172.21.15.172:0/515504703 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e0032440 con 0x7fb5ec15dbe0 2024-04-25T08:50:32.131 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5e959a640 1 -- 172.21.15.172:0/515504703 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0032810 con 0x7fb5ec15dbe0 2024-04-25T08:50:32.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/515504703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec15dbe0 msgr2=0x7fb5ec0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5f0e8f640 1 --2- 172.21.15.172:0/515504703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec15dbe0 0x7fb5ec0d0910 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0cfb90 tx=0x7fb5e002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/515504703 shutdown_connections 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5f0e8f640 1 --2- 172.21.15.172:0/515504703 >> v2:172.21.15.186:3300/0 conn(0x7fb5ec0b92a0 0x7fb5ec0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5f0e8f640 1 --2- 172.21.15.172:0/515504703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec15dbe0 0x7fb5ec0d0910 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/515504703 >> 172.21.15.172:0/515504703 conn(0x7fb5ec061a20 msgr2=0x7fb5ec061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/515504703 shutdown_connections 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.140+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/515504703 wait complete. 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.142+0000 7fb5f0e8f640 1 Processor -- start 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.142+0000 7fb5f0e8f640 1 -- start start 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.142+0000 7fb5f0e8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0b2cb0 0x7fb5ec0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.142+0000 7fb5f0e8f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ec0b92a0 0x7fb5ec0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.142+0000 7fb5f0e8f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5ec15dbe0 0x7fb5ec0b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.142+0000 7fb5f0e8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0b6ab0 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.142+0000 7fb5f0e8f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0d2210 con 0x7fb5ec0b92a0 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.142+0000 7fb5f0e8f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0b6c30 con 0x7fb5ec15dbe0 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0b2cb0 0x7fb5ec0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ea59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0b2cb0 0x7fb5ec0c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33742/0 (socket says 172.21.15.172:33742) 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ea59c640 1 -- 172.21.15.172:0/4158717944 learned_addr learned my addr 172.21.15.172:0/4158717944 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5e9d9b640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ec0b92a0 0x7fb5ec0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ead9d640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5ec15dbe0 0x7fb5ec0b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ea59c640 1 -- 172.21.15.172:0/4158717944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5ec15dbe0 msgr2=0x7fb5ec0b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ea59c640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5ec15dbe0 0x7fb5ec0b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ea59c640 1 -- 172.21.15.172:0/4158717944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ec0b92a0 msgr2=0x7fb5ec0caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ea59c640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ec0b92a0 0x7fb5ec0caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ea59c640 1 -- 172.21.15.172:0/4158717944 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec0b4af0 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5e9d9b640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ec0b92a0 0x7fb5ec0caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ead9d640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5ec15dbe0 0x7fb5ec0b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5ea59c640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0b2cb0 0x7fb5ec0c9660 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0000c00 tx=0x7fb5e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:32.136 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5daffd640 1 -- 172.21.15.172:0/4158717944 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0041070 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5daffd640 1 -- 172.21.15.172:0/4158717944 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e003c870 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/4158717944 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec0b4dd0 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5daffd640 1 -- 172.21.15.172:0/4158717944 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0037040 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.143+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/4158717944 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec0b5390 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.144+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/4158717944 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec073990 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.145+0000 7fb5daffd640 1 -- 172.21.15.172:0/4158717944 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb5e0044070 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.145+0000 7fb5daffd640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5cc06b4d0 0x7fb5cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.145+0000 7fb5e9d9b640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5cc06b4d0 0x7fb5cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.145+0000 7fb5daffd640 1 -- 172.21.15.172:0/4158717944 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb5e00aaea0 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.146+0000 7fb5e9d9b640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5cc06b4d0 0x7fb5cc06d990 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec152760 tx=0x7fb5dc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:32.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.149+0000 7fb5daffd640 1 -- 172.21.15.172:0/4158717944 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb5e0079d40 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.364+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/4158717944 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5ec15b000 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.364+0000 7fb5daffd640 1 -- 172.21.15.172:0/4158717944 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fb5e0079640 con 0x7fb5ec0b2cb0 2024-04-25T08:50:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:32.355 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:32.356 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:32.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/4158717944 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5cc06b4d0 msgr2=0x7fb5cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5cc06b4d0 0x7fb5cc06d990 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec152760 tx=0x7fb5dc009040 comp rx=0 tx=0).stop 2024-04-25T08:50:32.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/4158717944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0b2cb0 msgr2=0x7fb5ec0c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0b2cb0 0x7fb5ec0c9660 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0000c00 tx=0x7fb5e00046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/4158717944 shutdown_connections 2024-04-25T08:50:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb5cc06b4d0 0x7fb5cc06d990 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ec0b92a0 0x7fb5ec0caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5ec15dbe0 0x7fb5ec0b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 --2- 172.21.15.172:0/4158717944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0b2cb0 0x7fb5ec0c9660 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/4158717944 >> 172.21.15.172:0/4158717944 conn(0x7fb5ec061a20 msgr2=0x7fb5ec15b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/4158717944 shutdown_connections 2024-04-25T08:50:32.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.366+0000 7fb5f0e8f640 1 -- 172.21.15.172:0/4158717944 wait complete. 2024-04-25T08:50:32.368 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:50:32.368 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:32.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.474+0000 7f2a322ac640 1 Processor -- start 2024-04-25T08:50:32.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.474+0000 7f2a322ac640 1 -- start start 2024-04-25T08:50:32.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a322ac640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2a2c154ee0 0x7f2a2c0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a322ac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a2c0cfcf0 0x7f2a2c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a322ac640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a2c0ce3c0 0x7f2a2c15e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a322ac640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0ce830 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a322ac640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c072090 con 0x7f2a2c154ee0 2024-04-25T08:50:32.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a322ac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0d0150 con 0x7f2a2c0cfcf0 2024-04-25T08:50:32.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a30849640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a2c0ce3c0 0x7f2a2c15e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a30849640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a2c0ce3c0 0x7f2a2c15e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33752/0 (socket says 172.21.15.172:33752) 2024-04-25T08:50:32.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a30849640 1 -- 172.21.15.172:0/4213542841 learned_addr learned my addr 172.21.15.172:0/4213542841 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:32.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a30849640 1 -- 172.21.15.172:0/4213542841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a2c0cfcf0 msgr2=0x7f2a2c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a30849640 1 --2- 172.21.15.172:0/4213542841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a2c0cfcf0 0x7f2a2c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a30849640 1 -- 172.21.15.172:0/4213542841 >> v2:172.21.15.186:3300/0 conn(0x7f2a2c154ee0 msgr2=0x7f2a2c0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:32.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a2bfff640 1 --2- 172.21.15.172:0/4213542841 >> v2:172.21.15.186:3300/0 conn(0x7f2a2c154ee0 0x7f2a2c0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a30849640 1 --2- 172.21.15.172:0/4213542841 >> v2:172.21.15.186:3300/0 conn(0x7f2a2c154ee0 0x7f2a2c0cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a30849640 1 -- 172.21.15.172:0/4213542841 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c071480 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.467 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.475+0000 7f2a2bfff640 1 --2- 172.21.15.172:0/4213542841 >> v2:172.21.15.186:3300/0 conn(0x7f2a2c154ee0 0x7f2a2c0cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:32.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a30849640 1 --2- 172.21.15.172:0/4213542841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 0x7f2a2c15e570 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0d02e0 tx=0x7f2a2402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc146856cf51136 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:32.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a2affd640 1 -- 172.21.15.172:0/4213542841 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24036070 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a2affd640 1 -- 172.21.15.172:0/4213542841 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a24031600 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a2affd640 1 -- 172.21.15.172:0/4213542841 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a240319d0 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a322ac640 1 -- 172.21.15.172:0/4213542841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 msgr2=0x7f2a2c15e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a322ac640 1 --2- 172.21.15.172:0/4213542841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 0x7f2a2c15e570 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0d02e0 tx=0x7f2a2402a6c0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a322ac640 1 -- 172.21.15.172:0/4213542841 shutdown_connections 2024-04-25T08:50:32.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a322ac640 1 --2- 172.21.15.172:0/4213542841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 0x7f2a2c15e570 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a322ac640 1 --2- 172.21.15.172:0/4213542841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a2c0cfcf0 0x7f2a2c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a322ac640 1 --2- 172.21.15.172:0/4213542841 >> v2:172.21.15.186:3300/0 conn(0x7f2a2c154ee0 0x7f2a2c0cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a322ac640 1 -- 172.21.15.172:0/4213542841 >> 172.21.15.172:0/4213542841 conn(0x7f2a2c06abe0 msgr2=0x7f2a2c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.476+0000 7f2a322ac640 1 -- 172.21.15.172:0/4213542841 shutdown_connections 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.477+0000 7f2a322ac640 1 -- 172.21.15.172:0/4213542841 wait complete. 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.478+0000 7f2a322ac640 1 Processor -- start 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.478+0000 7f2a322ac640 1 -- start start 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.478+0000 7f2a322ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 0x7f2a2c0ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.478+0000 7f2a322ac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a2c0cfcf0 0x7f2a2c158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.478+0000 7f2a322ac640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a2c154ee0 0x7f2a2c159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.478+0000 7f2a322ac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c071a40 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.478+0000 7f2a322ac640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c071230 con 0x7f2a2c154ee0 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a322ac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c071d20 con 0x7f2a2c0cfcf0 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 0x7f2a2c0ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 0x7f2a2c0ab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33760/0 (socket says 172.21.15.172:33760) 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2bfff640 1 -- 172.21.15.172:0/2699286830 learned_addr learned my addr 172.21.15.172:0/2699286830 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2b7fe640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a2c0cfcf0 0x7f2a2c158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a30849640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a2c154ee0 0x7f2a2c159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2bfff640 1 -- 172.21.15.172:0/2699286830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a2c0cfcf0 msgr2=0x7f2a2c158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2bfff640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a2c0cfcf0 0x7f2a2c158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2bfff640 1 -- 172.21.15.172:0/2699286830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a2c154ee0 msgr2=0x7f2a2c159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2bfff640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a2c154ee0 0x7f2a2c159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2bfff640 1 -- 172.21.15.172:0/2699286830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c159780 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2b7fe640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a2c0cfcf0 0x7f2a2c158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a30849640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a2c154ee0 0x7f2a2c159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a2bfff640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 0x7f2a2c0ab080 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c820 tx=0x7f2a2000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a28ff9640 1 -- 172.21.15.172:0/2699286830 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20015070 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a28ff9640 1 -- 172.21.15.172:0/2699286830 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a20007a30 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a28ff9640 1 -- 172.21.15.172:0/2699286830 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20007de0 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a322ac640 1 -- 172.21.15.172:0/2699286830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c159a40 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.479+0000 7f2a322ac640 1 -- 172.21.15.172:0/2699286830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c0ad280 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.480+0000 7f2a322ac640 1 -- 172.21.15.172:0/2699286830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c073990 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.481+0000 7f2a28ff9640 1 -- 172.21.15.172:0/2699286830 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2a20018070 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.481+0000 7f2a28ff9640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a1806b4d0 0x7f2a1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:32.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.481+0000 7f2a28ff9640 1 -- 172.21.15.172:0/2699286830 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2a2008a2c0 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.481+0000 7f2a2b7fe640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a1806b4d0 0x7f2a1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:32.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.482+0000 7f2a2b7fe640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a1806b4d0 0x7f2a1806d990 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c06eb90 tx=0x7f2a1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:32.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.485+0000 7f2a28ff9640 1 -- 172.21.15.172:0/2699286830 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2a20058fb0 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.723+0000 7f2a322ac640 1 -- 172.21.15.172:0/2699286830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2a2c06d360 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.723+0000 7f2a28ff9640 1 -- 172.21.15.172:0/2699286830 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7f2a200588b0 con 0x7f2a2c0ce3c0 2024-04-25T08:50:32.715 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:32.715 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":508,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2541289472,"bytes_avail":770552823808,"bytes_total":773094113280,"write_bytes_sec":64841701,"read_op_per_sec":0,"write_op_per_sec":63},"fsmap":{"epoch":68,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-04-25T08:50:28.611018+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:32.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 -- 172.21.15.172:0/2699286830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a1806b4d0 msgr2=0x7f2a1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a1806b4d0 0x7f2a1806d990 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c06eb90 tx=0x7f2a1c008040 comp rx=0 tx=0).stop 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 -- 172.21.15.172:0/2699286830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 msgr2=0x7f2a2c0ab080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 0x7f2a2c0ab080 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c820 tx=0x7f2a2000cce0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 -- 172.21.15.172:0/2699286830 shutdown_connections 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2a1806b4d0 0x7f2a1806d990 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2a2c154ee0 0x7f2a2c159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2a2c0cfcf0 0x7f2a2c158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 --2- 172.21.15.172:0/2699286830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a2c0ce3c0 0x7f2a2c0ab080 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 -- 172.21.15.172:0/2699286830 >> 172.21.15.172:0/2699286830 conn(0x7f2a2c06abe0 msgr2=0x7f2a2c0af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 -- 172.21.15.172:0/2699286830 shutdown_connections 2024-04-25T08:50:32.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:32.725+0000 7f2a322ac640 1 -- 172.21.15.172:0/2699286830 wait complete. 2024-04-25T08:50:32.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T08:50:33.728 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:33.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.847+0000 7f09f785d640 1 Processor -- start 2024-04-25T08:50:33.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.847+0000 7f09f785d640 1 -- start start 2024-04-25T08:50:33.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f785d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09f015b980 0x7f09f00cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:33.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f785d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f09f006b5f0 0x7f09f00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:33.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f785d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f015f710 con 0x7f09f00b2d40 2024-04-25T08:50:33.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f785d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f015f9b0 con 0x7f09f006b5f0 2024-04-25T08:50:33.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f785d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015fc90 con 0x7f09f015b980 2024-04-25T08:50:33.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f4df8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f09f006b5f0 0x7f09f00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:33.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f4df8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f09f006b5f0 0x7f09f00cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33768/0 (socket says 172.21.15.172:33768) 2024-04-25T08:50:33.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f4df8640 1 -- 172.21.15.172:0/495426403 learned_addr learned my addr 172.21.15.172:0/495426403 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:33.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f55f9640 1 --2- 172.21.15.172:0/495426403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09f015b980 0x7f09f00cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:33.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f4df8640 1 -- 172.21.15.172:0/495426403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09f015b980 msgr2=0x7f09f00cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:33.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f4df8640 1 --2- 172.21.15.172:0/495426403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09f015b980 0x7f09f00cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:33.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.848+0000 7f09f4df8640 1 -- 172.21.15.172:0/495426403 >> v1:172.21.15.186:6789/0 conn(0x7f09f00b2d40 legacy=0x7f09f00ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:33.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.849+0000 7f09f4df8640 1 -- 172.21.15.172:0/495426403 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f015ff70 con 0x7f09f006b5f0 2024-04-25T08:50:33.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.849+0000 7f09f4df8640 1 --2- 172.21.15.172:0/495426403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f006b5f0 0x7f09f00cf8a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009870 tx=0x7f09e002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1986998344450e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:33.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.849+0000 7f09e7fff640 1 -- 172.21.15.172:0/495426403 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0037070 con 0x7f09f006b5f0 2024-04-25T08:50:33.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.849+0000 7f09e7fff640 1 -- 172.21.15.172:0/495426403 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e0032440 con 0x7f09f006b5f0 2024-04-25T08:50:33.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.849+0000 7f09e7fff640 1 -- 172.21.15.172:0/495426403 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0032810 con 0x7f09f006b5f0 2024-04-25T08:50:33.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.850+0000 7f09f785d640 1 -- 172.21.15.172:0/495426403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f006b5f0 msgr2=0x7f09f00cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:33.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.850+0000 7f09f785d640 1 --2- 172.21.15.172:0/495426403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f006b5f0 0x7f09f00cf8a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009870 tx=0x7f09e002a210 comp rx=0 tx=0).stop 2024-04-25T08:50:33.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.850+0000 7f09f785d640 1 -- 172.21.15.172:0/495426403 shutdown_connections 2024-04-25T08:50:33.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.850+0000 7f09f785d640 1 --2- 172.21.15.172:0/495426403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f006b5f0 0x7f09f00cf8a0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:33.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.850+0000 7f09f785d640 1 --2- 172.21.15.172:0/495426403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09f015b980 0x7f09f00cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:33.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.850+0000 7f09f785d640 1 -- 172.21.15.172:0/495426403 >> 172.21.15.172:0/495426403 conn(0x7f09f00b2220 msgr2=0x7f09f00b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:33.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.850+0000 7f09f785d640 1 -- 172.21.15.172:0/495426403 shutdown_connections 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.850+0000 7f09f785d640 1 -- 172.21.15.172:0/495426403 wait complete. 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.851+0000 7f09f785d640 1 Processor -- start 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.851+0000 7f09f785d640 1 -- start start 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f785d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09f006b5f0 0x7f09f00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f785d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f00b2d40 0x7f09f00c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f785d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09f015b980 0x7f09f0151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f785d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00cf550 con 0x7f09f00b2d40 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f785d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015bd60 con 0x7f09f015b980 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f785d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00cfde0 con 0x7f09f006b5f0 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f4df8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f00b2d40 0x7f09f00c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f4df8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f00b2d40 0x7f09f00c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33770/0 (socket says 172.21.15.172:33770) 2024-04-25T08:50:33.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f4df8640 1 -- 172.21.15.172:0/2329407228 learned_addr learned my addr 172.21.15.172:0/2329407228 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f55f9640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09f006b5f0 0x7f09f00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f5dfa640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09f015b980 0x7f09f0151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f4df8640 1 -- 172.21.15.172:0/2329407228 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09f006b5f0 msgr2=0x7f09f00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f4df8640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09f006b5f0 0x7f09f00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f4df8640 1 -- 172.21.15.172:0/2329407228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09f015b980 msgr2=0x7f09f0151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f4df8640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09f015b980 0x7f09f0151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f4df8640 1 -- 172.21.15.172:0/2329407228 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00c8d60 con 0x7f09f00b2d40 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.852+0000 7f09f5dfa640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09f015b980 0x7f09f0151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.853+0000 7f09f4df8640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f00b2d40 0x7f09f00c9990 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f09e0000c00 tx=0x7f09e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.853+0000 7f09e5ffb640 1 -- 172.21.15.172:0/2329407228 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0041020 con 0x7f09f00b2d40 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.853+0000 7f09e5ffb640 1 -- 172.21.15.172:0/2329407228 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e00306c0 con 0x7f09f00b2d40 2024-04-25T08:50:33.846 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.853+0000 7f09f785d640 1 -- 172.21.15.172:0/2329407228 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f00ca020 con 0x7f09f00b2d40 2024-04-25T08:50:33.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.853+0000 7f09e5ffb640 1 -- 172.21.15.172:0/2329407228 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0037040 con 0x7f09f00b2d40 2024-04-25T08:50:33.847 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.853+0000 7f09f785d640 1 -- 172.21.15.172:0/2329407228 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f00b3790 con 0x7f09f00b2d40 2024-04-25T08:50:33.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.854+0000 7f09f785d640 1 -- 172.21.15.172:0/2329407228 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f0073990 con 0x7f09f00b2d40 2024-04-25T08:50:33.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.855+0000 7f09e5ffb640 1 -- 172.21.15.172:0/2329407228 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f09e0044020 con 0x7f09f00b2d40 2024-04-25T08:50:33.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.855+0000 7f09e5ffb640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f09d406b4d0 0x7f09d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:33.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.855+0000 7f09e5ffb640 1 -- 172.21.15.172:0/2329407228 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f09e00aab20 con 0x7f09f00b2d40 2024-04-25T08:50:33.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.855+0000 7f09f55f9640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f09d406b4d0 0x7f09d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:33.848 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.855+0000 7f09f55f9640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f09d406b4d0 0x7f09d406d990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f09ec006fd0 tx=0x7f09ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:33.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:33.859+0000 7f09e5ffb640 1 -- 172.21.15.172:0/2329407228 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09e004b030 con 0x7f09f00b2d40 2024-04-25T08:50:34.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.064+0000 7f09f785d640 1 -- 172.21.15.172:0/2329407228 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09f00b6670 con 0x7f09f00b2d40 2024-04-25T08:50:34.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.065+0000 7f09e5ffb640 1 -- 172.21.15.172:0/2329407228 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f09e00798a0 con 0x7f09f00b2d40 2024-04-25T08:50:34.055 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:34.056 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:34.056 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:34.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.066+0000 7f09f785d640 1 -- 172.21.15.172:0/2329407228 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f09d406b4d0 msgr2=0x7f09d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f09d406b4d0 0x7f09d406d990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f09ec006fd0 tx=0x7f09ec008040 comp rx=0 tx=0).stop 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 -- 172.21.15.172:0/2329407228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f00b2d40 msgr2=0x7f09f00c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f00b2d40 0x7f09f00c9990 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f09e0000c00 tx=0x7f09e00046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 -- 172.21.15.172:0/2329407228 shutdown_connections 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f09d406b4d0 0x7f09d406d990 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09f015b980 0x7f09f0151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09f00b2d40 0x7f09f00c9990 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 --2- 172.21.15.172:0/2329407228 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09f006b5f0 0x7f09f00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 -- 172.21.15.172:0/2329407228 >> 172.21.15.172:0/2329407228 conn(0x7f09f00b2220 msgr2=0x7f09f00b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 -- 172.21.15.172:0/2329407228 shutdown_connections 2024-04-25T08:50:34.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.067+0000 7f09f785d640 1 -- 172.21.15.172:0/2329407228 wait complete. 2024-04-25T08:50:34.068 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:50:34.069 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:34.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.174+0000 7fc7182fc640 1 Processor -- start 2024-04-25T08:50:34.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.174+0000 7fc7182fc640 1 -- start start 2024-04-25T08:50:34.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc7182fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 0x7fc7100cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc7182fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc7100cfe40 0x7fc7100d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc7182fc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc7100d1930 0x7fc7100d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc7182fc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7100d0350 con 0x7fc7100cfe40 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc7182fc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7100d0630 con 0x7fc7100d1930 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc7182fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100d0910 con 0x7fc71015bd30 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc715897640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc7100cfe40 0x7fc7100d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc715897640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc7100cfe40 0x7fc7100d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33772/0 (socket says 172.21.15.172:33772) 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc715897640 1 -- 172.21.15.172:0/803520024 learned_addr learned my addr 172.21.15.172:0/803520024 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc716098640 1 --2- 172.21.15.172:0/803520024 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 0x7fc7100cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc716899640 1 --2- 172.21.15.172:0/803520024 >> v2:172.21.15.186:3300/0 conn(0x7fc7100d1930 0x7fc7100d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc715897640 1 -- 172.21.15.172:0/803520024 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 msgr2=0x7fc7100cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc715897640 1 --2- 172.21.15.172:0/803520024 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 0x7fc7100cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc715897640 1 -- 172.21.15.172:0/803520024 >> v2:172.21.15.186:3300/0 conn(0x7fc7100d1930 msgr2=0x7fc7100d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc715897640 1 --2- 172.21.15.172:0/803520024 >> v2:172.21.15.186:3300/0 conn(0x7fc7100d1930 0x7fc7100d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc715897640 1 -- 172.21.15.172:0/803520024 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7100d0bf0 con 0x7fc7100cfe40 2024-04-25T08:50:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc716098640 1 --2- 172.21.15.172:0/803520024 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 0x7fc7100cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.175+0000 7fc716899640 1 --2- 172.21.15.172:0/803520024 >> v2:172.21.15.186:3300/0 conn(0x7fc7100d1930 0x7fc7100d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.176+0000 7fc715897640 1 --2- 172.21.15.172:0/803520024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 0x7fc7100d13f0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc71015f7f0 tx=0x7fc70002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd42db8a8baeb892 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.176+0000 7fc715096640 1 -- 172.21.15.172:0/803520024 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700037070 con 0x7fc7100cfe40 2024-04-25T08:50:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.176+0000 7fc715096640 1 -- 172.21.15.172:0/803520024 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700032440 con 0x7fc7100cfe40 2024-04-25T08:50:34.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.176+0000 7fc715096640 1 -- 172.21.15.172:0/803520024 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700032810 con 0x7fc7100cfe40 2024-04-25T08:50:34.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.177+0000 7fc7182fc640 1 -- 172.21.15.172:0/803520024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 msgr2=0x7fc7100d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:34.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.177+0000 7fc7182fc640 1 --2- 172.21.15.172:0/803520024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 0x7fc7100d13f0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fc71015f7f0 tx=0x7fc70002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.177+0000 7fc7182fc640 1 -- 172.21.15.172:0/803520024 shutdown_connections 2024-04-25T08:50:34.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.177+0000 7fc7182fc640 1 --2- 172.21.15.172:0/803520024 >> v2:172.21.15.186:3300/0 conn(0x7fc7100d1930 0x7fc7100d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.177+0000 7fc7182fc640 1 --2- 172.21.15.172:0/803520024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 0x7fc7100d13f0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.177+0000 7fc7182fc640 1 --2- 172.21.15.172:0/803520024 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 0x7fc7100cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.177+0000 7fc7182fc640 1 -- 172.21.15.172:0/803520024 >> 172.21.15.172:0/803520024 conn(0x7fc71006f590 msgr2=0x7fc71006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:34.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.177+0000 7fc7182fc640 1 -- 172.21.15.172:0/803520024 shutdown_connections 2024-04-25T08:50:34.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.177+0000 7fc7182fc640 1 -- 172.21.15.172:0/803520024 wait complete. 2024-04-25T08:50:34.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.178+0000 7fc7182fc640 1 Processor -- start 2024-04-25T08:50:34.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.178+0000 7fc7182fc640 1 -- start start 2024-04-25T08:50:34.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc7182fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 0x7fc710144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:34.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc7182fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7100d1930 0x7fc71015e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:34.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc7182fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 0x7fc71015ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:34.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc7182fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100b73b0 con 0x7fc7100cfe40 2024-04-25T08:50:34.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc7182fc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71015c110 con 0x7fc7100d1930 2024-04-25T08:50:34.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc7182fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100b7530 con 0x7fc71015bd30 2024-04-25T08:50:34.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716098640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 0x7fc710144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:34.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716098640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 0x7fc710144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33776/0 (socket says 172.21.15.172:33776) 2024-04-25T08:50:34.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716098640 1 -- 172.21.15.172:0/1866325450 learned_addr learned my addr 172.21.15.172:0/1866325450 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:34.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716899640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 0x7fc71015ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:34.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716098640 1 -- 172.21.15.172:0/1866325450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 msgr2=0x7fc71015ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:34.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc715897640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7100d1930 0x7fc71015e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:34.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716098640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 0x7fc71015ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716098640 1 -- 172.21.15.172:0/1866325450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7100d1930 msgr2=0x7fc71015e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:34.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716098640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7100d1930 0x7fc71015e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716098640 1 -- 172.21.15.172:0/1866325450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc710144a60 con 0x7fc7100cfe40 2024-04-25T08:50:34.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716899640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 0x7fc71015ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:34.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc715897640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7100d1930 0x7fc71015e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:34.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc716098640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 0x7fc710144520 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00e810 tx=0x7fc70c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:34.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc706ffd640 1 -- 172.21.15.172:0/1866325450 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c00f040 con 0x7fc7100cfe40 2024-04-25T08:50:34.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc706ffd640 1 -- 172.21.15.172:0/1866325450 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70c004030 con 0x7fc7100cfe40 2024-04-25T08:50:34.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc7182fc640 1 -- 172.21.15.172:0/1866325450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc710151ff0 con 0x7fc7100cfe40 2024-04-25T08:50:34.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.179+0000 7fc706ffd640 1 -- 172.21.15.172:0/1866325450 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c004400 con 0x7fc7100cfe40 2024-04-25T08:50:34.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.180+0000 7fc7182fc640 1 -- 172.21.15.172:0/1866325450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7100c91b0 con 0x7fc7100cfe40 2024-04-25T08:50:34.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.180+0000 7fc7182fc640 1 -- 172.21.15.172:0/1866325450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc710073990 con 0x7fc7100cfe40 2024-04-25T08:50:34.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.181+0000 7fc706ffd640 1 -- 172.21.15.172:0/1866325450 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc70c00c6d0 con 0x7fc7100cfe40 2024-04-25T08:50:34.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.181+0000 7fc706ffd640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6f406b4d0 0x7fc6f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:34.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.181+0000 7fc706ffd640 1 -- 172.21.15.172:0/1866325450 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc70c08a170 con 0x7fc7100cfe40 2024-04-25T08:50:34.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.181+0000 7fc715897640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6f406b4d0 0x7fc6f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:34.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.182+0000 7fc715897640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6f406b4d0 0x7fc6f406d990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc700034000 tx=0x7fc70002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:34.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.185+0000 7fc706ffd640 1 -- 172.21.15.172:0/1866325450 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc70c017020 con 0x7fc7100cfe40 2024-04-25T08:50:34.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.423+0000 7fc7182fc640 1 -- 172.21.15.172:0/1866325450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc7100b4eb0 con 0x7fc7100cfe40 2024-04-25T08:50:34.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.423+0000 7fc706ffd640 1 -- 172.21.15.172:0/1866325450 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1598 (secure 0 0 0) 0x7fc70c058e60 con 0x7fc7100cfe40 2024-04-25T08:50:34.414 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:34.414 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":509,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2541289472,"bytes_avail":770552823808,"bytes_total":773094113280,"write_bytes_sec":48673114,"read_op_per_sec":0,"write_op_per_sec":48},"fsmap":{"epoch":68,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-04-25T08:50:28.611018+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:34.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 -- 172.21.15.172:0/1866325450 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6f406b4d0 msgr2=0x7fc6f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:34.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6f406b4d0 0x7fc6f406d990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc700034000 tx=0x7fc70002e000 comp rx=0 tx=0).stop 2024-04-25T08:50:34.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 -- 172.21.15.172:0/1866325450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 msgr2=0x7fc710144520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:34.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 0x7fc710144520 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00e810 tx=0x7fc70c00ecd0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 -- 172.21.15.172:0/1866325450 shutdown_connections 2024-04-25T08:50:34.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc6f406b4d0 0x7fc6f406d990 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc7100d1930 0x7fc71015e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc71015bd30 0x7fc71015ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 --2- 172.21.15.172:0/1866325450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7100cfe40 0x7fc710144520 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:34.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 -- 172.21.15.172:0/1866325450 >> 172.21.15.172:0/1866325450 conn(0x7fc71006f590 msgr2=0x7fc7100b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:34.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 -- 172.21.15.172:0/1866325450 shutdown_connections 2024-04-25T08:50:34.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:34.425+0000 7fc7182fc640 1 -- 172.21.15.172:0/1866325450 wait complete. 2024-04-25T08:50:34.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2024-04-25T08:50:35.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:35.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.543+0000 7f58bf4e1640 1 Processor -- start 2024-04-25T08:50:35.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.543+0000 7f58bf4e1640 1 -- start start 2024-04-25T08:50:35.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58bf4e1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f58b815dc90 0x7f58b81625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58bf4e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b80cc8e0 0x7f58b815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58bf4e1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b815f390 con 0x7f58b80d1810 2024-04-25T08:50:35.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58bf4e1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b80cce50 con 0x7f58b815dc90 2024-04-25T08:50:35.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58bf4e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8161af0 con 0x7f58b80cc8e0 2024-04-25T08:50:35.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58bda7e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f58b80d1810 0x7f58b80cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37832/0 (socket says 172.21.15.172:37832) 2024-04-25T08:50:35.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58bda7e640 1 -- 172.21.15.172:0/657331104 learned_addr learned my addr 172.21.15.172:0/657331104 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374199299 0 0) 0x7f58a8001490 con 0x7f58b80d1810 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58bd27d640 1 --2- 172.21.15.172:0/657331104 >> v2:172.21.15.186:3300/0 conn(0x7f58b815dc90 0x7f58b81625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58bca7c640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b80cc8e0 0x7f58b815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58a0003520 con 0x7f58b80d1810 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1199030141 0 0) 0x7f58a0003520 con 0x7f58b80d1810 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b80cc8e0 msgr2=0x7f58b815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b80cc8e0 0x7f58b815ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 >> v2:172.21.15.186:3300/0 conn(0x7f58b815dc90 msgr2=0x7f58b81625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 --2- 172.21.15.172:0/657331104 >> v2:172.21.15.186:3300/0 conn(0x7f58b815dc90 0x7f58b81625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8161dd0 con 0x7f58b80d1810 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f58a8001bc0 con 0x7f58b80d1810 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 >> v1:172.21.15.172:6789/0 conn(0x7f58b80d1810 legacy=0x7f58b80cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a00039b0 0x7f58a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b80cc8e0 0x7f58a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58a0004d40 0x7f58a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80cce50 con 0x7f58a00039b0 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8161af0 con 0x7f58a0004d40 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.544+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a000b9f0 con 0x7f58b80cc8e0 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bd27d640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a00039b0 0x7f58a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bca7c640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b80cc8e0 0x7f58a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bda7e640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58a0004d40 0x7f58a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bd27d640 1 -- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b80cc8e0 msgr2=0x7f58a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bd27d640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b80cc8e0 0x7f58a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bd27d640 1 -- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58a0004d40 msgr2=0x7f58a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bd27d640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58a0004d40 0x7f58a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bd27d640 1 -- 172.21.15.172:0/657331104 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a0003520 con 0x7f58a00039b0 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bca7c640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b80cc8e0 0x7f58a0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bda7e640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58a0004d40 0x7f58a00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:35.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.545+0000 7f58bd27d640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a00039b0 0x7f58a0003dd0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f58b0009ac0 tx=0x7f58a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5035649a81ed48a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.546+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0036070 con 0x7f58a00039b0 2024-04-25T08:50:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.546+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b0031400 con 0x7f58a00039b0 2024-04-25T08:50:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.546+0000 7f58b7fff640 1 -- 172.21.15.172:0/657331104 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0009690 con 0x7f58a00039b0 2024-04-25T08:50:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.546+0000 7f58bf4e1640 1 -- 172.21.15.172:0/657331104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a00039b0 msgr2=0x7f58a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.546+0000 7f58bf4e1640 1 --2- 172.21.15.172:0/657331104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58a00039b0 0x7f58a0003dd0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f58b0009ac0 tx=0x7f58a0005830 comp rx=0 tx=0).stop 2024-04-25T08:50:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.546+0000 7f58bda7e640 1 -- 172.21.15.172:0/657331104 reap_dead start 2024-04-25T08:50:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.546+0000 7f58bf4e1640 1 -- 172.21.15.172:0/657331104 shutdown_connections 2024-04-25T08:50:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.546+0000 7f58bf4e1640 1 -- 172.21.15.172:0/657331104 >> 172.21.15.172:0/657331104 conn(0x7f58b806f590 msgr2=0x7f58b806f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.546+0000 7f58bf4e1640 1 -- 172.21.15.172:0/657331104 shutdown_connections 2024-04-25T08:50:35.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.546+0000 7f58bf4e1640 1 -- 172.21.15.172:0/657331104 wait complete. 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.547+0000 7f58bf4e1640 1 Processor -- start 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.548+0000 7f58bf4e1640 1 -- start start 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.548+0000 7f58bf4e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58b81470a0 0x7f58b81f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.548+0000 7f58bf4e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58b814b3a0 0x7f58b81f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.548+0000 7f58bf4e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b81f4030 0x7f58b815f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.548+0000 7f58bf4e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b815e070 con 0x7f58b81470a0 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.548+0000 7f58bf4e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80cd130 con 0x7f58b814b3a0 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.548+0000 7f58bf4e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b815e1f0 con 0x7f58b81f4030 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.548+0000 7f58bd27d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58b81470a0 0x7f58b81f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.548+0000 7f58bd27d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58b81470a0 0x7f58b81f35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33788/0 (socket says 172.21.15.172:33788) 2024-04-25T08:50:35.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.548+0000 7f58bd27d640 1 -- 172.21.15.172:0/2251126333 learned_addr learned my addr 172.21.15.172:0/2251126333 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58bd27d640 1 -- 172.21.15.172:0/2251126333 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b81f4030 msgr2=0x7f58b815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58bd27d640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b81f4030 0x7f58b815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58bd27d640 1 -- 172.21.15.172:0/2251126333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58b814b3a0 msgr2=0x7f58b81f3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58bd27d640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58b814b3a0 0x7f58b81f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58bd27d640 1 -- 172.21.15.172:0/2251126333 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8158120 con 0x7f58b81470a0 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58bd27d640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58b81470a0 0x7f58b81f35b0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f58b0009ac0 tx=0x7f58b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58b5ffb640 1 -- 172.21.15.172:0/2251126333 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0036050 con 0x7f58b81470a0 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58b5ffb640 1 -- 172.21.15.172:0/2251126333 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b0042070 con 0x7f58b81470a0 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58bf4e1640 1 -- 172.21.15.172:0/2251126333 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b80cb350 con 0x7f58b81470a0 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58b5ffb640 1 -- 172.21.15.172:0/2251126333 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0009690 con 0x7f58b81470a0 2024-04-25T08:50:35.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.549+0000 7f58bf4e1640 1 -- 172.21.15.172:0/2251126333 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b8158390 con 0x7f58b81470a0 2024-04-25T08:50:35.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.550+0000 7f58bf4e1640 1 -- 172.21.15.172:0/2251126333 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b8073990 con 0x7f58b81470a0 2024-04-25T08:50:35.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.551+0000 7f58b5ffb640 1 -- 172.21.15.172:0/2251126333 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f58b0047460 con 0x7f58b81470a0 2024-04-25T08:50:35.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.551+0000 7f58b5ffb640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f58a406b4d0 0x7f58a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.551+0000 7f58b5ffb640 1 -- 172.21.15.172:0/2251126333 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f58b00aabd0 con 0x7f58b81470a0 2024-04-25T08:50:35.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.551+0000 7f58bca7c640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f58a406b4d0 0x7f58a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.545 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.552+0000 7f58bca7c640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f58a406b4d0 0x7f58a406d990 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f58b8067ea0 tx=0x7f58ac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:35.546 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.555+0000 7f58b5ffb640 1 -- 172.21.15.172:0/2251126333 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f58b00798c0 con 0x7f58b81470a0 2024-04-25T08:50:35.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.761+0000 7f58bf4e1640 1 -- 172.21.15.172:0/2251126333 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58b80cf6b0 con 0x7f58b81470a0 2024-04-25T08:50:35.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.762+0000 7f58b5ffb640 1 -- 172.21.15.172:0/2251126333 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f58b00791c0 con 0x7f58b81470a0 2024-04-25T08:50:35.753 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:35.753 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:35.753 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 -- 172.21.15.172:0/2251126333 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f58a406b4d0 msgr2=0x7f58a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f58a406b4d0 0x7f58a406d990 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f58b8067ea0 tx=0x7f58ac008040 comp rx=0 tx=0).stop 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 -- 172.21.15.172:0/2251126333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58b81470a0 msgr2=0x7f58b81f35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58b81470a0 0x7f58b81f35b0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f58b0009ac0 tx=0x7f58b0004730 comp rx=0 tx=0).stop 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 -- 172.21.15.172:0/2251126333 shutdown_connections 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f58a406b4d0 0x7f58a406d990 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58b814b3a0 0x7f58b81f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58b81f4030 0x7f58b815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 --2- 172.21.15.172:0/2251126333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58b81470a0 0x7f58b81f35b0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 -- 172.21.15.172:0/2251126333 >> 172.21.15.172:0/2251126333 conn(0x7f58b806f590 msgr2=0x7f58b80b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 -- 172.21.15.172:0/2251126333 shutdown_connections 2024-04-25T08:50:35.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.764+0000 7f58bf4e1640 1 -- 172.21.15.172:0/2251126333 wait complete. 2024-04-25T08:50:35.765 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:50:35.766 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.873+0000 7fd3b225d640 1 Processor -- start 2024-04-25T08:50:35.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.873+0000 7fd3b225d640 1 -- start start 2024-04-25T08:50:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3b225d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd3ac15dbe0 0x7fd3ac0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3b225d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3ac0b2cb0 0x7fd3ac0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3b225d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac0b97a0 con 0x7fd3ac0b92a0 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3b225d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac15dfc0 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3b225d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac0d1a00 con 0x7fd3ac15dbe0 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3aaffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3ac0b2cb0 0x7fd3ac0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3aaffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3ac0b2cb0 0x7fd3ac0d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33804/0 (socket says 172.21.15.172:33804) 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3aaffd640 1 -- 172.21.15.172:0/151718267 learned_addr learned my addr 172.21.15.172:0/151718267 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3aaffd640 1 -- 172.21.15.172:0/151718267 >> v2:172.21.15.186:3300/0 conn(0x7fd3ac15dbe0 msgr2=0x7fd3ac0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3ab7fe640 1 --2- 172.21.15.172:0/151718267 >> v2:172.21.15.186:3300/0 conn(0x7fd3ac15dbe0 0x7fd3ac0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3aaffd640 1 --2- 172.21.15.172:0/151718267 >> v2:172.21.15.186:3300/0 conn(0x7fd3ac15dbe0 0x7fd3ac0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3aaffd640 1 -- 172.21.15.172:0/151718267 >> v1:172.21.15.186:6789/0 conn(0x7fd3ac0b92a0 legacy=0x7fd3ac0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.874+0000 7fd3aaffd640 1 -- 172.21.15.172:0/151718267 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac0d1c50 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.875+0000 7fd3aaffd640 1 --2- 172.21.15.172:0/151718267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 0x7fd3ac0d0e50 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac06c140 tx=0x7fd3a002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71962693ab265de4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:35.867 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.875+0000 7fd3aa7fc640 1 -- 172.21.15.172:0/151718267 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0037070 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.875+0000 7fd3aa7fc640 1 -- 172.21.15.172:0/151718267 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a0032440 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.875+0000 7fd3aa7fc640 1 -- 172.21.15.172:0/151718267 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0032810 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.876+0000 7fd3b225d640 1 -- 172.21.15.172:0/151718267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 msgr2=0x7fd3ac0d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.876+0000 7fd3b225d640 1 --2- 172.21.15.172:0/151718267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 0x7fd3ac0d0e50 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac06c140 tx=0x7fd3a002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.876+0000 7fd3b225d640 1 -- 172.21.15.172:0/151718267 shutdown_connections 2024-04-25T08:50:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.876+0000 7fd3b225d640 1 --2- 172.21.15.172:0/151718267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 0x7fd3ac0d0e50 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.876+0000 7fd3b225d640 1 --2- 172.21.15.172:0/151718267 >> v2:172.21.15.186:3300/0 conn(0x7fd3ac15dbe0 0x7fd3ac0d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.876+0000 7fd3b225d640 1 -- 172.21.15.172:0/151718267 >> 172.21.15.172:0/151718267 conn(0x7fd3ac061a20 msgr2=0x7fd3ac061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.876+0000 7fd3b225d640 1 -- 172.21.15.172:0/151718267 shutdown_connections 2024-04-25T08:50:35.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.876+0000 7fd3b225d640 1 -- 172.21.15.172:0/151718267 wait complete. 2024-04-25T08:50:35.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.877+0000 7fd3b225d640 1 Processor -- start 2024-04-25T08:50:35.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.877+0000 7fd3b225d640 1 -- start start 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3b225d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 0x7fd3ac0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3b225d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3ac0b92a0 0x7fd3ac160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3b225d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ac15dbe0 0x7fd3ac0b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3b225d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0b6ab0 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3b225d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0d2210 con 0x7fd3ac0b92a0 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3b225d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0b6c30 con 0x7fd3ac15dbe0 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3ab7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 0x7fd3ac0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3ab7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 0x7fd3ac0b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33818/0 (socket says 172.21.15.172:33818) 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3ab7fe640 1 -- 172.21.15.172:0/3238827178 learned_addr learned my addr 172.21.15.172:0/3238827178 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3ab7fe640 1 -- 172.21.15.172:0/3238827178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ac15dbe0 msgr2=0x7fd3ac0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3ab7fe640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ac15dbe0 0x7fd3ac0b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3ab7fe640 1 -- 172.21.15.172:0/3238827178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3ac0b92a0 msgr2=0x7fd3ac160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:35.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3ab7fe640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3ac0b92a0 0x7fd3ac160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3ab7fe640 1 -- 172.21.15.172:0/3238827178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac1553c0 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.878+0000 7fd3ab7fe640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 0x7fd3ac0b4a20 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00c7f0 tx=0x7fd39c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.879+0000 7fd393fff640 1 -- 172.21.15.172:0/3238827178 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c015070 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.879+0000 7fd393fff640 1 -- 172.21.15.172:0/3238827178 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c004220 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.879+0000 7fd3b225d640 1 -- 172.21.15.172:0/3238827178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac1556a0 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.879+0000 7fd393fff640 1 -- 172.21.15.172:0/3238827178 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c007620 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.879+0000 7fd3b225d640 1 -- 172.21.15.172:0/3238827178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac0b4220 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.880+0000 7fd3b225d640 1 -- 172.21.15.172:0/3238827178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac073990 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.880+0000 7fd393fff640 1 -- 172.21.15.172:0/3238827178 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd39c0079d0 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.880+0000 7fd393fff640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd39806b500 0x7fd39806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.880+0000 7fd393fff640 1 -- 172.21.15.172:0/3238827178 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd39c08a380 con 0x7fd3ac0b2cb0 2024-04-25T08:50:35.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.881+0000 7fd3aaffd640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd39806b500 0x7fd39806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:35.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.881+0000 7fd3aaffd640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd39806b500 0x7fd39806d9c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0034000 tx=0x7fd3a002c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:35.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:35.885+0000 7fd393fff640 1 -- 172.21.15.172:0/3238827178 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd39c059070 con 0x7fd3ac0b2cb0 2024-04-25T08:50:36.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.122+0000 7fd3b225d640 1 -- 172.21.15.172:0/3238827178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd3ac0b4640 con 0x7fd3ac0b2cb0 2024-04-25T08:50:36.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.122+0000 7fd393fff640 1 -- 172.21.15.172:0/3238827178 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1575 (secure 0 0 0) 0x7fd39c058970 con 0x7fd3ac0b2cb0 2024-04-25T08:50:36.113 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:36.113 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":511,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":119,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076559729,"bytes_used":2541289472,"bytes_avail":770552823808,"bytes_total":773094113280,"write_bytes_sec":18091193,"read_op_per_sec":0,"write_op_per_sec":18},"fsmap":{"epoch":68,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8670}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-04-25T08:50:34.612203+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:36.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 -- 172.21.15.172:0/3238827178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd39806b500 msgr2=0x7fd39806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd39806b500 0x7fd39806d9c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0034000 tx=0x7fd3a002c000 comp rx=0 tx=0).stop 2024-04-25T08:50:36.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 -- 172.21.15.172:0/3238827178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 msgr2=0x7fd3ac0b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 0x7fd3ac0b4a20 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00c7f0 tx=0x7fd39c00ccb0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 -- 172.21.15.172:0/3238827178 shutdown_connections 2024-04-25T08:50:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd39806b500 0x7fd39806d9c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3ac0b92a0 0x7fd3ac160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ac15dbe0 0x7fd3ac0b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 --2- 172.21.15.172:0/3238827178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0b2cb0 0x7fd3ac0b4a20 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 -- 172.21.15.172:0/3238827178 >> 172.21.15.172:0/3238827178 conn(0x7fd3ac061a20 msgr2=0x7fd3ac15c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 -- 172.21.15.172:0/3238827178 shutdown_connections 2024-04-25T08:50:36.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.124+0000 7fd3b225d640 1 -- 172.21.15.172:0/3238827178 wait complete. 2024-04-25T08:50:36.126 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T08:50:36.126 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:50:36.126 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:50:36.165 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:50:36.216 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:50:36.216 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:50:36.216 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:50:36.231 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:50:36.232 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:50:36.287 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:36.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.434+0000 7f0edc25d640 1 Processor -- start 2024-04-25T08:50:36.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.434+0000 7f0edc25d640 1 -- start start 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0edc25d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0ed415bd30 0x7f0ed40cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0edc25d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ed40cfe40 0x7f0ed40d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0edc25d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ed40d1930 0x7f0ed40d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0edc25d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed40d0350 con 0x7f0ed40d1930 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0edc25d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed40d0630 con 0x7f0ed415bd30 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0edc25d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40d0910 con 0x7f0ed40cfe40 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0eda7fa640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ed40d1930 0x7f0ed40d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0eda7fa640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ed40d1930 0x7f0ed40d1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33826/0 (socket says 172.21.15.172:33826) 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0eda7fa640 1 -- 172.21.15.172:0/3534260722 learned_addr learned my addr 172.21.15.172:0/3534260722 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0ed9ff9640 1 --2- 172.21.15.172:0/3534260722 >> v2:172.21.15.186:3300/0 conn(0x7f0ed415bd30 0x7f0ed40cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0ed97f8640 1 --2- 172.21.15.172:0/3534260722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ed40cfe40 0x7f0ed40d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0eda7fa640 1 -- 172.21.15.172:0/3534260722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ed40cfe40 msgr2=0x7f0ed40d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0eda7fa640 1 --2- 172.21.15.172:0/3534260722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ed40cfe40 0x7f0ed40d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0eda7fa640 1 -- 172.21.15.172:0/3534260722 >> v2:172.21.15.186:3300/0 conn(0x7f0ed415bd30 msgr2=0x7f0ed40cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0eda7fa640 1 --2- 172.21.15.172:0/3534260722 >> v2:172.21.15.186:3300/0 conn(0x7f0ed415bd30 0x7f0ed40cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0eda7fa640 1 -- 172.21.15.172:0/3534260722 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed40d0bf0 con 0x7f0ed40d1930 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.435+0000 7f0ed9ff9640 1 --2- 172.21.15.172:0/3534260722 >> v2:172.21.15.186:3300/0 conn(0x7f0ed415bd30 0x7f0ed40cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.436+0000 7f0eda7fa640 1 --2- 172.21.15.172:0/3534260722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 0x7f0ed40d1d40 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40702b0 tx=0x7f0ecc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699a8f3a9dfa0afa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.436+0000 7f0ed8ff7640 1 -- 172.21.15.172:0/3534260722 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc036070 con 0x7f0ed40d1930 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.436+0000 7f0ed8ff7640 1 -- 172.21.15.172:0/3534260722 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc031600 con 0x7f0ed40d1930 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.436+0000 7f0ed8ff7640 1 -- 172.21.15.172:0/3534260722 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0319d0 con 0x7f0ed40d1930 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.437+0000 7f0edc25d640 1 -- 172.21.15.172:0/3534260722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 msgr2=0x7f0ed40d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.437+0000 7f0edc25d640 1 --2- 172.21.15.172:0/3534260722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 0x7f0ed40d1d40 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40702b0 tx=0x7f0ecc02a6a0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.437+0000 7f0edc25d640 1 -- 172.21.15.172:0/3534260722 shutdown_connections 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.437+0000 7f0edc25d640 1 --2- 172.21.15.172:0/3534260722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 0x7f0ed40d1d40 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.437+0000 7f0edc25d640 1 --2- 172.21.15.172:0/3534260722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ed40cfe40 0x7f0ed40d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.437+0000 7f0edc25d640 1 --2- 172.21.15.172:0/3534260722 >> v2:172.21.15.186:3300/0 conn(0x7f0ed415bd30 0x7f0ed40cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.437+0000 7f0edc25d640 1 -- 172.21.15.172:0/3534260722 >> 172.21.15.172:0/3534260722 conn(0x7f0ed406f590 msgr2=0x7f0ed406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:36.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.437+0000 7f0edc25d640 1 -- 172.21.15.172:0/3534260722 shutdown_connections 2024-04-25T08:50:36.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.437+0000 7f0edc25d640 1 -- 172.21.15.172:0/3534260722 wait complete. 2024-04-25T08:50:36.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.438+0000 7f0edc25d640 1 Processor -- start 2024-04-25T08:50:36.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.438+0000 7f0edc25d640 1 -- start start 2024-04-25T08:50:36.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0edc25d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ed40cfe40 0x7f0ed414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0edc25d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 0x7f0ed40a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0edc25d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ed415bd30 0x7f0ed40ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0edc25d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40b73b0 con 0x7f0ed40d1930 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0edc25d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed415c110 con 0x7f0ed40cfe40 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0edc25d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40b7530 con 0x7f0ed415bd30 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0ed97f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 0x7f0ed40a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0ed97f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 0x7f0ed40a8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33830/0 (socket says 172.21.15.172:33830) 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0ed97f8640 1 -- 172.21.15.172:0/4164207728 learned_addr learned my addr 172.21.15.172:0/4164207728 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0ed97f8640 1 -- 172.21.15.172:0/4164207728 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ed415bd30 msgr2=0x7f0ed40ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0ed97f8640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ed415bd30 0x7f0ed40ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0ed97f8640 1 -- 172.21.15.172:0/4164207728 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ed40cfe40 msgr2=0x7f0ed414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0ed97f8640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ed40cfe40 0x7f0ed414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0ed97f8640 1 -- 172.21.15.172:0/4164207728 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed41f1b20 con 0x7f0ed40d1930 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0ed97f8640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 0x7f0ed40a8c50 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400c540 tx=0x7f0ec400ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0eca7fc640 1 -- 172.21.15.172:0/4164207728 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4015070 con 0x7f0ed40d1930 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0eca7fc640 1 -- 172.21.15.172:0/4164207728 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec4011800 con 0x7f0ed40d1930 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0edc25d640 1 -- 172.21.15.172:0/4164207728 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed41f1e00 con 0x7f0ed40d1930 2024-04-25T08:50:36.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0eca7fc640 1 -- 172.21.15.172:0/4164207728 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4011bb0 con 0x7f0ed40d1930 2024-04-25T08:50:36.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.439+0000 7f0edc25d640 1 -- 172.21.15.172:0/4164207728 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed41f23c0 con 0x7f0ed40d1930 2024-04-25T08:50:36.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.440+0000 7f0edc25d640 1 -- 172.21.15.172:0/4164207728 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed4073990 con 0x7f0ed40d1930 2024-04-25T08:50:36.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.441+0000 7f0eca7fc640 1 -- 172.21.15.172:0/4164207728 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0ec4018070 con 0x7f0ed40d1930 2024-04-25T08:50:36.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.441+0000 7f0eca7fc640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0eb806b4d0 0x7f0eb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.441+0000 7f0eca7fc640 1 -- 172.21.15.172:0/4164207728 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0ec408a100 con 0x7f0ed40d1930 2024-04-25T08:50:36.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.441+0000 7f0ed9ff9640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0eb806b4d0 0x7f0eb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.442+0000 7f0ed9ff9640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0eb806b4d0 0x7f0eb806d990 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0006fd0 tx=0x7f0ed0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:36.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.445+0000 7f0eca7fc640 1 -- 172.21.15.172:0/4164207728 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ec4058df0 con 0x7f0ed40d1930 2024-04-25T08:50:36.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.616+0000 7f0edc25d640 1 -- 172.21.15.172:0/4164207728 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ed415a8f0 con 0x7f0ed40d1930 2024-04-25T08:50:36.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.617+0000 7f0eca7fc640 1 -- 172.21.15.172:0/4164207728 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17012 (secure 0 0 0) 0x7f0ec40586f0 con 0x7f0ed40d1930 2024-04-25T08:50:36.607 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:36.608 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":119,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:04.075355+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:00.630478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:01.391083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:36.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 -- 172.21.15.172:0/4164207728 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0eb806b4d0 msgr2=0x7f0eb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0eb806b4d0 0x7f0eb806d990 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0006fd0 tx=0x7f0ed0008040 comp rx=0 tx=0).stop 2024-04-25T08:50:36.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 -- 172.21.15.172:0/4164207728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 msgr2=0x7f0ed40a8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 0x7f0ed40a8c50 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400c540 tx=0x7f0ec400ca00 comp rx=0 tx=0).stop 2024-04-25T08:50:36.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 -- 172.21.15.172:0/4164207728 shutdown_connections 2024-04-25T08:50:36.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0eb806b4d0 0x7f0eb806d990 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ed415bd30 0x7f0ed40ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed40d1930 0x7f0ed40a8c50 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 --2- 172.21.15.172:0/4164207728 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ed40cfe40 0x7f0ed414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 -- 172.21.15.172:0/4164207728 >> 172.21.15.172:0/4164207728 conn(0x7f0ed406f590 msgr2=0x7f0ed40b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:36.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 -- 172.21.15.172:0/4164207728 shutdown_connections 2024-04-25T08:50:36.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.619+0000 7f0edc25d640 1 -- 172.21.15.172:0/4164207728 wait complete. 2024-04-25T08:50:36.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:50:00.630478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:50:01.391083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:50:36.621 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:50:36.721 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.731+0000 7efd54807640 1 Processor -- start 2024-04-25T08:50:36.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.731+0000 7efd54807640 1 -- start start 2024-04-25T08:50:36.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.731+0000 7efd54807640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cc4f0 0x7efd500cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd54807640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efd5015b980 0x7efd500cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd54807640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd50072280 con 0x7efd500cdb20 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd54807640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd500ce4c0 con 0x7efd5015b980 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd54807640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd50071270 con 0x7efd500cc4f0 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd4ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efd5015b980 0x7efd500cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd4ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efd5015b980 0x7efd500cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33846/0 (socket says 172.21.15.172:33846) 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd47fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efd500cdb20 0x7efd5015b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37844/0 (socket says 172.21.15.172:37844) 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd4ed9d640 1 -- 172.21.15.172:0/3110669161 learned_addr learned my addr 172.21.15.172:0/3110669161 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd4e59c640 1 --2- 172.21.15.172:0/3110669161 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cc4f0 0x7efd500cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd4ed9d640 1 -- 172.21.15.172:0/3110669161 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cc4f0 msgr2=0x7efd500cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd4ed9d640 1 --2- 172.21.15.172:0/3110669161 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cc4f0 0x7efd500cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd4ed9d640 1 -- 172.21.15.172:0/3110669161 >> v1:172.21.15.172:6789/0 conn(0x7efd500cdb20 legacy=0x7efd5015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd4ed9d640 1 -- 172.21.15.172:0/3110669161 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd500714c0 con 0x7efd5015b980 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd4dd9b640 1 -- 172.21.15.172:0/3110669161 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116408885 0 0) 0x7efd50072280 con 0x7efd500cdb20 2024-04-25T08:50:36.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.732+0000 7efd4e59c640 1 --2- 172.21.15.172:0/3110669161 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cc4f0 0x7efd500cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:36.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd4ed9d640 1 --2- 172.21.15.172:0/3110669161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 0x7efd500cdf80 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7efd4800d150 tx=0x7efd4802c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a663b8e520833f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:36.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd4dd9b640 1 -- 172.21.15.172:0/3110669161 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48009600 con 0x7efd5015b980 2024-04-25T08:50:36.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd4dd9b640 1 -- 172.21.15.172:0/3110669161 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd48037070 con 0x7efd5015b980 2024-04-25T08:50:36.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd4dd9b640 1 -- 172.21.15.172:0/3110669161 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480099c0 con 0x7efd5015b980 2024-04-25T08:50:36.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd54807640 1 -- 172.21.15.172:0/3110669161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 msgr2=0x7efd500cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd54807640 1 --2- 172.21.15.172:0/3110669161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 0x7efd500cdf80 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7efd4800d150 tx=0x7efd4802c930 comp rx=0 tx=0).stop 2024-04-25T08:50:36.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd54807640 1 -- 172.21.15.172:0/3110669161 shutdown_connections 2024-04-25T08:50:36.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd54807640 1 --2- 172.21.15.172:0/3110669161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 0x7efd500cdf80 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd54807640 1 --2- 172.21.15.172:0/3110669161 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cc4f0 0x7efd500cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd54807640 1 -- 172.21.15.172:0/3110669161 >> 172.21.15.172:0/3110669161 conn(0x7efd5006abe0 msgr2=0x7efd5006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:36.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd54807640 1 -- 172.21.15.172:0/3110669161 shutdown_connections 2024-04-25T08:50:36.728 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.733+0000 7efd54807640 1 -- 172.21.15.172:0/3110669161 wait complete. 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.735+0000 7efd54807640 1 Processor -- start 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.735+0000 7efd54807640 1 -- start start 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.735+0000 7efd54807640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd500cc4f0 0x7efd500caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.735+0000 7efd54807640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cdb20 0x7efd50153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.735+0000 7efd54807640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 0x7efd50153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.735+0000 7efd54807640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50071a80 con 0x7efd5015b980 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.735+0000 7efd54807640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5015bd90 con 0x7efd500cc4f0 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.735+0000 7efd54807640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd50071d60 con 0x7efd500cdb20 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 0x7efd50153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 0x7efd50153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33854/0 (socket says 172.21.15.172:33854) 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4ed9d640 1 -- 172.21.15.172:0/704160205 learned_addr learned my addr 172.21.15.172:0/704160205 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4e59c640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd500cc4f0 0x7efd500caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd47fff640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cdb20 0x7efd50153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4ed9d640 1 -- 172.21.15.172:0/704160205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cdb20 msgr2=0x7efd50153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4ed9d640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cdb20 0x7efd50153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4ed9d640 1 -- 172.21.15.172:0/704160205 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd500cc4f0 msgr2=0x7efd500caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4ed9d640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd500cc4f0 0x7efd500caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4ed9d640 1 -- 172.21.15.172:0/704160205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd501effd0 con 0x7efd5015b980 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4e59c640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd500cc4f0 0x7efd500caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd4ed9d640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 0x7efd50153550 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7efd4800d150 tx=0x7efd48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd46ffd640 1 -- 172.21.15.172:0/704160205 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48046430 con 0x7efd5015b980 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd46ffd640 1 -- 172.21.15.172:0/704160205 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd480465d0 con 0x7efd5015b980 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd54807640 1 -- 172.21.15.172:0/704160205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd501f05e0 con 0x7efd5015b980 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd46ffd640 1 -- 172.21.15.172:0/704160205 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480469c0 con 0x7efd5015b980 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.736+0000 7efd54807640 1 -- 172.21.15.172:0/704160205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd501f0ba0 con 0x7efd5015b980 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.737+0000 7efd54807640 1 -- 172.21.15.172:0/704160205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd50073a00 con 0x7efd5015b980 2024-04-25T08:50:36.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.738+0000 7efd46ffd640 1 -- 172.21.15.172:0/704160205 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efd48046b60 con 0x7efd5015b980 2024-04-25T08:50:36.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.738+0000 7efd46ffd640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd3006b4d0 0x7efd3006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:36.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.738+0000 7efd46ffd640 1 -- 172.21.15.172:0/704160205 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efd480ad3c0 con 0x7efd5015b980 2024-04-25T08:50:36.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.738+0000 7efd4e59c640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd3006b4d0 0x7efd3006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:36.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.738+0000 7efd4e59c640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd3006b4d0 0x7efd3006d990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7efd500cba30 tx=0x7efd40008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:36.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.742+0000 7efd46ffd640 1 -- 172.21.15.172:0/704160205 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efd4807c0b0 con 0x7efd5015b980 2024-04-25T08:50:36.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.912+0000 7efd54807640 1 -- 172.21.15.172:0/704160205 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd5006d3a0 con 0x7efd5015b980 2024-04-25T08:50:36.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.912+0000 7efd46ffd640 1 -- 172.21.15.172:0/704160205 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd4807b9b0 con 0x7efd5015b980 2024-04-25T08:50:36.903 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:50:36.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 -- 172.21.15.172:0/704160205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd3006b4d0 msgr2=0x7efd3006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd3006b4d0 0x7efd3006d990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7efd500cba30 tx=0x7efd40008040 comp rx=0 tx=0).stop 2024-04-25T08:50:36.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 -- 172.21.15.172:0/704160205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 msgr2=0x7efd50153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:36.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 0x7efd50153550 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7efd4800d150 tx=0x7efd48004a40 comp rx=0 tx=0).stop 2024-04-25T08:50:36.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 -- 172.21.15.172:0/704160205 shutdown_connections 2024-04-25T08:50:36.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efd3006b4d0 0x7efd3006d990 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5015b980 0x7efd50153550 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd500cdb20 0x7efd50153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 --2- 172.21.15.172:0/704160205 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd500cc4f0 0x7efd500caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:36.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 -- 172.21.15.172:0/704160205 >> 172.21.15.172:0/704160205 conn(0x7efd5006abe0 msgr2=0x7efd5015d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:36.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 -- 172.21.15.172:0/704160205 shutdown_connections 2024-04-25T08:50:36.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:36.914+0000 7efd54807640 1 -- 172.21.15.172:0/704160205 wait complete. 2024-04-25T08:50:36.916 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:50:37.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.026+0000 7f1feb9e2640 1 Processor -- start 2024-04-25T08:50:37.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.027+0000 7f1feb9e2640 1 -- start start 2024-04-25T08:50:37.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.027+0000 7f1feb9e2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe415dc20 0x7f1fe40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.027+0000 7f1feb9e2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1fe4161710 0x7f1fe40cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.027+0000 7f1feb9e2640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1fe40b9330 0x7f1fe406bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.027+0000 7f1feb9e2640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe415e000 con 0x7f1fe40b9330 2024-04-25T08:50:37.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.027+0000 7f1feb9e2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40d1de0 con 0x7f1fe4161710 2024-04-25T08:50:37.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.027+0000 7f1feb9e2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4161c60 con 0x7f1fe415dc20 2024-04-25T08:50:37.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.027+0000 7f1fe9f7f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1fe40b9330 0x7f1fe406bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.027+0000 7f1fe9f7f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1fe40b9330 0x7f1fe406bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33864/0 (socket says 172.21.15.172:33864) 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.027+0000 7f1fe9f7f640 1 -- 172.21.15.172:0/1556902671 learned_addr learned my addr 172.21.15.172:0/1556902671 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.028+0000 7f1fe9f7f640 1 -- 172.21.15.172:0/1556902671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe415dc20 msgr2=0x7f1fe40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.028+0000 7f1fe9f7f640 1 --2- 172.21.15.172:0/1556902671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe415dc20 0x7f1fe40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.028+0000 7f1fe9f7f640 1 -- 172.21.15.172:0/1556902671 >> v2:172.21.15.186:3300/0 conn(0x7f1fe4161710 msgr2=0x7f1fe40cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.028+0000 7f1fe8f7d640 1 --2- 172.21.15.172:0/1556902671 >> v2:172.21.15.186:3300/0 conn(0x7f1fe4161710 0x7f1fe40cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.028+0000 7f1fe9f7f640 1 --2- 172.21.15.172:0/1556902671 >> v2:172.21.15.186:3300/0 conn(0x7f1fe4161710 0x7f1fe40cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.028+0000 7f1fe9f7f640 1 -- 172.21.15.172:0/1556902671 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4161f40 con 0x7f1fe40b9330 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.028+0000 7f1fe9f7f640 1 --2- 172.21.15.172:0/1556902671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe40b9330 0x7f1fe406bf80 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f1fe406d9a0 tx=0x7f1fdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f401c2926f170246 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1fdbfff640 1 -- 172.21.15.172:0/1556902671 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc037070 con 0x7f1fe40b9330 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1fdbfff640 1 -- 172.21.15.172:0/1556902671 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc032440 con 0x7f1fe40b9330 2024-04-25T08:50:37.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1fdbfff640 1 -- 172.21.15.172:0/1556902671 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc032810 con 0x7f1fe40b9330 2024-04-25T08:50:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1feb9e2640 1 -- 172.21.15.172:0/1556902671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe40b9330 msgr2=0x7f1fe406bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1feb9e2640 1 --2- 172.21.15.172:0/1556902671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe40b9330 0x7f1fe406bf80 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f1fe406d9a0 tx=0x7f1fdc02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1feb9e2640 1 -- 172.21.15.172:0/1556902671 shutdown_connections 2024-04-25T08:50:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1feb9e2640 1 --2- 172.21.15.172:0/1556902671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe40b9330 0x7f1fe406bf80 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1feb9e2640 1 --2- 172.21.15.172:0/1556902671 >> v2:172.21.15.186:3300/0 conn(0x7f1fe4161710 0x7f1fe40cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1feb9e2640 1 --2- 172.21.15.172:0/1556902671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe415dc20 0x7f1fe40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1feb9e2640 1 -- 172.21.15.172:0/1556902671 >> 172.21.15.172:0/1556902671 conn(0x7f1fe40d0420 msgr2=0x7f1fe40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1feb9e2640 1 -- 172.21.15.172:0/1556902671 shutdown_connections 2024-04-25T08:50:37.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.029+0000 7f1feb9e2640 1 -- 172.21.15.172:0/1556902671 wait complete. 2024-04-25T08:50:37.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.030+0000 7f1feb9e2640 1 Processor -- start 2024-04-25T08:50:37.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1feb9e2640 1 -- start start 2024-04-25T08:50:37.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1feb9e2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe40b9330 0x7f1fe41e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1feb9e2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe415dc20 0x7f1fe41e9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1feb9e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe4161710 0x7f1fe414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1feb9e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40b5e50 con 0x7f1fe4161710 2024-04-25T08:50:37.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1feb9e2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4162500 con 0x7f1fe40b9330 2024-04-25T08:50:37.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1feb9e2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40b5fd0 con 0x7f1fe415dc20 2024-04-25T08:50:37.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1fe9f7f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe4161710 0x7f1fe414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1fe9f7f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe4161710 0x7f1fe414e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33880/0 (socket says 172.21.15.172:33880) 2024-04-25T08:50:37.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1fe9f7f640 1 -- 172.21.15.172:0/3798443964 learned_addr learned my addr 172.21.15.172:0/3798443964 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:37.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1fe8f7d640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe415dc20 0x7f1fe41e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.031+0000 7f1fe977e640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe40b9330 0x7f1fe41e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fe9f7f640 1 -- 172.21.15.172:0/3798443964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe415dc20 msgr2=0x7f1fe41e9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fe9f7f640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe415dc20 0x7f1fe41e9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fe9f7f640 1 -- 172.21.15.172:0/3798443964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe40b9330 msgr2=0x7f1fe41e74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fe9f7f640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe40b9330 0x7f1fe41e74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fe9f7f640 1 -- 172.21.15.172:0/3798443964 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe41e7bd0 con 0x7f1fe4161710 2024-04-25T08:50:37.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fe8f7d640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe415dc20 0x7f1fe41e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:37.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fe977e640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe40b9330 0x7f1fe41e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:37.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fe9f7f640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe4161710 0x7f1fe414e7a0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc02a220 tx=0x7f1fdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:37.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fd9ffb640 1 -- 172.21.15.172:0/3798443964 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc041070 con 0x7f1fe4161710 2024-04-25T08:50:37.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fd9ffb640 1 -- 172.21.15.172:0/3798443964 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc03c890 con 0x7f1fe4161710 2024-04-25T08:50:37.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1fd9ffb640 1 -- 172.21.15.172:0/3798443964 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc037040 con 0x7f1fe4161710 2024-04-25T08:50:37.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1feb9e2640 1 -- 172.21.15.172:0/3798443964 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe41e7eb0 con 0x7f1fe4161710 2024-04-25T08:50:37.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.032+0000 7f1feb9e2640 1 -- 172.21.15.172:0/3798443964 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe41e8470 con 0x7f1fe4161710 2024-04-25T08:50:37.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.033+0000 7f1feb9e2640 1 -- 172.21.15.172:0/3798443964 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe4073a00 con 0x7f1fe4161710 2024-04-25T08:50:37.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.033+0000 7f1fd9ffb640 1 -- 172.21.15.172:0/3798443964 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1fdc044070 con 0x7f1fe4161710 2024-04-25T08:50:37.031 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.034+0000 7f1fd9ffb640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1fc806b4d0 0x7f1fc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.034+0000 7f1fd9ffb640 1 -- 172.21.15.172:0/3798443964 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1fdc0aaff0 con 0x7f1fe4161710 2024-04-25T08:50:37.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.034+0000 7f1fe977e640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1fc806b4d0 0x7f1fc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.034+0000 7f1fe977e640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1fc806b4d0 0x7f1fc806d990 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0007eb0 tx=0x7f1fe00073c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:37.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.038+0000 7f1fd9ffb640 1 -- 172.21.15.172:0/3798443964 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1fdc079e90 con 0x7f1fe4161710 2024-04-25T08:50:37.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.207+0000 7f1feb9e2640 1 -- 172.21.15.172:0/3798443964 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fe41e8ea0 con 0x7f1fe4161710 2024-04-25T08:50:37.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.208+0000 7f1fd9ffb640 1 -- 172.21.15.172:0/3798443964 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1fdc079790 con 0x7f1fe4161710 2024-04-25T08:50:37.198 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:50:37.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 -- 172.21.15.172:0/3798443964 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1fc806b4d0 msgr2=0x7f1fc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1fc806b4d0 0x7f1fc806d990 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0007eb0 tx=0x7f1fe00073c0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 -- 172.21.15.172:0/3798443964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe4161710 msgr2=0x7f1fe414e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe4161710 0x7f1fe414e7a0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc02a220 tx=0x7f1fdc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 -- 172.21.15.172:0/3798443964 shutdown_connections 2024-04-25T08:50:37.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1fc806b4d0 0x7f1fc806d990 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fe4161710 0x7f1fe414e7a0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1fe415dc20 0x7f1fe41e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 --2- 172.21.15.172:0/3798443964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1fe40b9330 0x7f1fe41e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 -- 172.21.15.172:0/3798443964 >> 172.21.15.172:0/3798443964 conn(0x7f1fe40d0420 msgr2=0x7f1fe40b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:37.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 -- 172.21.15.172:0/3798443964 shutdown_connections 2024-04-25T08:50:37.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.210+0000 7f1feb9e2640 1 -- 172.21.15.172:0/3798443964 wait complete. 2024-04-25T08:50:37.211 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:50:37.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.321+0000 7fd434a4a640 1 Processor -- start 2024-04-25T08:50:37.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.321+0000 7fd434a4a640 1 -- start start 2024-04-25T08:50:37.312 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.321+0000 7fd434a4a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd43006b6d0 0x7fd43006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.321+0000 7fd434a4a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4300ad350 con 0x7fd4300acec0 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.322+0000 7fd434a4a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43006db40 con 0x7fd43006abe0 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.322+0000 7fd434a4a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43006de20 con 0x7fd43006b6d0 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.322+0000 7fd42ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd43006b6d0 0x7fd43006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.322+0000 7fd42ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd43006b6d0 0x7fd43006ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33888/0 (socket says 172.21.15.172:33888) 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.322+0000 7fd42ed9d640 1 -- 172.21.15.172:0/272273095 learned_addr learned my addr 172.21.15.172:0/272273095 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.322+0000 7fd427fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd4300acec0 0x7fd43006afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:37856/0 (socket says 172.21.15.172:37856) 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.322+0000 7fd42ed9d640 1 -- 172.21.15.172:0/272273095 >> v1:172.21.15.186:6789/0 conn(0x7fd43006abe0 legacy=0x7fd4300b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.322+0000 7fd42ed9d640 1 -- 172.21.15.172:0/272273095 >> v1:172.21.15.172:6789/0 conn(0x7fd4300acec0 legacy=0x7fd43006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.322+0000 7fd42ed9d640 1 -- 172.21.15.172:0/272273095 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43006e100 con 0x7fd43006b6d0 2024-04-25T08:50:37.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.322+0000 7fd42dd9b640 1 -- 172.21.15.172:0/272273095 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040734430 0 0) 0x7fd4300ad350 con 0x7fd4300acec0 2024-04-25T08:50:37.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd42ed9d640 1 --2- 172.21.15.172:0/272273095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 0x7fd43006ebe0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fd428009e50 tx=0x7fd42802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ddbd4133f4b6bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd42dd9b640 1 -- 172.21.15.172:0/272273095 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428036070 con 0x7fd43006b6d0 2024-04-25T08:50:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd42dd9b640 1 -- 172.21.15.172:0/272273095 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd428031600 con 0x7fd43006b6d0 2024-04-25T08:50:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd42dd9b640 1 -- 172.21.15.172:0/272273095 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4280319d0 con 0x7fd43006b6d0 2024-04-25T08:50:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd434a4a640 1 -- 172.21.15.172:0/272273095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 msgr2=0x7fd43006ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd434a4a640 1 --2- 172.21.15.172:0/272273095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 0x7fd43006ebe0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fd428009e50 tx=0x7fd42802a6d0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd434a4a640 1 -- 172.21.15.172:0/272273095 shutdown_connections 2024-04-25T08:50:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd434a4a640 1 --2- 172.21.15.172:0/272273095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 0x7fd43006ebe0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd434a4a640 1 -- 172.21.15.172:0/272273095 >> 172.21.15.172:0/272273095 conn(0x7fd4300cfec0 msgr2=0x7fd4300d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd434a4a640 1 -- 172.21.15.172:0/272273095 shutdown_connections 2024-04-25T08:50:37.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.323+0000 7fd434a4a640 1 -- 172.21.15.172:0/272273095 wait complete. 2024-04-25T08:50:37.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd434a4a640 1 Processor -- start 2024-04-25T08:50:37.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd434a4a640 1 -- start start 2024-04-25T08:50:37.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd434a4a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd43006abe0 0x7fd430159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd434a4a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 0x7fd4300c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd434a4a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300acec0 0x7fd4300c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd434a4a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300b4030 con 0x7fd43006b6d0 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd434a4a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300b30d0 con 0x7fd43006abe0 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd434a4a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43006f120 con 0x7fd4300acec0 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd427fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 0x7fd4300c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd427fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 0x7fd4300c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33894/0 (socket says 172.21.15.172:33894) 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.325+0000 7fd427fff640 1 -- 172.21.15.172:0/1920896814 learned_addr learned my addr 172.21.15.172:0/1920896814 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd43006abe0 0x7fd430159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd42ed9d640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300acec0 0x7fd4300c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd427fff640 1 -- 172.21.15.172:0/1920896814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300acec0 msgr2=0x7fd4300c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd427fff640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300acec0 0x7fd4300c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd427fff640 1 -- 172.21.15.172:0/1920896814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd43006abe0 msgr2=0x7fd430159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd427fff640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd43006abe0 0x7fd430159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd427fff640 1 -- 172.21.15.172:0/1920896814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43015ab10 con 0x7fd43006b6d0 2024-04-25T08:50:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd427fff640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 0x7fd4300c57d0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c4d0 tx=0x7fd41800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd426ffd640 1 -- 172.21.15.172:0/1920896814 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418018070 con 0x7fd43006b6d0 2024-04-25T08:50:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd426ffd640 1 -- 172.21.15.172:0/1920896814 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd418007500 con 0x7fd43006b6d0 2024-04-25T08:50:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd434a4a640 1 -- 172.21.15.172:0/1920896814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43015adf0 con 0x7fd43006b6d0 2024-04-25T08:50:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd426ffd640 1 -- 172.21.15.172:0/1920896814 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418004a20 con 0x7fd43006b6d0 2024-04-25T08:50:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.326+0000 7fd434a4a640 1 -- 172.21.15.172:0/1920896814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4300c5d10 con 0x7fd43006b6d0 2024-04-25T08:50:37.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.327+0000 7fd434a4a640 1 -- 172.21.15.172:0/1920896814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd430073a00 con 0x7fd43006b6d0 2024-04-25T08:50:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.328+0000 7fd426ffd640 1 -- 172.21.15.172:0/1920896814 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd41801b070 con 0x7fd43006b6d0 2024-04-25T08:50:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.328+0000 7fd426ffd640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b500 0x7fd41006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.328+0000 7fd426ffd640 1 -- 172.21.15.172:0/1920896814 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd4180895e0 con 0x7fd43006b6d0 2024-04-25T08:50:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.328+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b500 0x7fd41006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.328+0000 7fd42e59c640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b500 0x7fd41006d9c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd420006fd0 tx=0x7fd420008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:37.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.332+0000 7fd426ffd640 1 -- 172.21.15.172:0/1920896814 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd418058360 con 0x7fd43006b6d0 2024-04-25T08:50:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.505+0000 7fd434a4a640 1 -- 172.21.15.172:0/1920896814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4300b00b0 con 0x7fd43006b6d0 2024-04-25T08:50:37.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.505+0000 7fd426ffd640 1 -- 172.21.15.172:0/1920896814 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd418057c60 con 0x7fd43006b6d0 2024-04-25T08:50:37.496 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:50:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 -- 172.21.15.172:0/1920896814 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b500 msgr2=0x7fd41006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b500 0x7fd41006d9c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd420006fd0 tx=0x7fd420008040 comp rx=0 tx=0).stop 2024-04-25T08:50:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 -- 172.21.15.172:0/1920896814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 msgr2=0x7fd4300c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 0x7fd4300c57d0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c4d0 tx=0x7fd41800c990 comp rx=0 tx=0).stop 2024-04-25T08:50:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 -- 172.21.15.172:0/1920896814 shutdown_connections 2024-04-25T08:50:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd41006b500 0x7fd41006d9c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4300acec0 0x7fd4300c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd43006b6d0 0x7fd4300c57d0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 --2- 172.21.15.172:0/1920896814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd43006abe0 0x7fd430159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 -- 172.21.15.172:0/1920896814 >> 172.21.15.172:0/1920896814 conn(0x7fd4300cfec0 msgr2=0x7fd43006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 -- 172.21.15.172:0/1920896814 shutdown_connections 2024-04-25T08:50:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.507+0000 7fd434a4a640 1 -- 172.21.15.172:0/1920896814 wait complete. 2024-04-25T08:50:37.509 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:50:37.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.616+0000 7fc410b77640 1 Processor -- start 2024-04-25T08:50:37.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.616+0000 7fc410b77640 1 -- start start 2024-04-25T08:50:37.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.617+0000 7fc410b77640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc40c070dc0 0x7fc40c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.617+0000 7fc410b77640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc40c0711a0 0x7fc40c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.617+0000 7fc410b77640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40c0d1770 con 0x7fc40c0b4830 2024-04-25T08:50:37.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.617+0000 7fc410b77640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c1622b0 con 0x7fc40c070dc0 2024-04-25T08:50:37.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.617+0000 7fc410b77640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c0b10f0 con 0x7fc40c0711a0 2024-04-25T08:50:37.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.617+0000 7fc40a59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc40c070dc0 0x7fc40c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.617+0000 7fc40ad9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc40c0b4830 0x7fc40c0b4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33320/0 (socket says 172.21.15.172:33320) 2024-04-25T08:50:37.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.617+0000 7fc40ad9d640 1 -- 172.21.15.172:0/3032342745 learned_addr learned my addr 172.21.15.172:0/3032342745 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:37.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.617+0000 7fc409d9b640 1 --2- 172.21.15.172:0/3032342745 >> v2:172.21.15.186:3300/0 conn(0x7fc40c0711a0 0x7fc40c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.618+0000 7fc40a59c640 1 -- 172.21.15.172:0/3032342745 >> v2:172.21.15.186:3300/0 conn(0x7fc40c0711a0 msgr2=0x7fc40c0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:37.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.618+0000 7fc40a59c640 1 --2- 172.21.15.172:0/3032342745 >> v2:172.21.15.186:3300/0 conn(0x7fc40c0711a0 0x7fc40c0b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.618+0000 7fc40a59c640 1 -- 172.21.15.172:0/3032342745 >> v1:172.21.15.172:6789/0 conn(0x7fc40c0b4830 legacy=0x7fc40c0b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.618+0000 7fc40959a640 1 -- 172.21.15.172:0/3032342745 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716830262 0 0) 0x7fc40c0d1770 con 0x7fc40c0b4830 2024-04-25T08:50:37.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.618+0000 7fc40a59c640 1 -- 172.21.15.172:0/3032342745 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c162740 con 0x7fc40c070dc0 2024-04-25T08:50:37.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.618+0000 7fc40a59c640 1 --2- 172.21.15.172:0/3032342745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 0x7fc40c06ccd0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fc40c04efc0 tx=0x7fc3fc02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4de2afa9839f656 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:37.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc40959a640 1 -- 172.21.15.172:0/3032342745 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc007740 con 0x7fc40c070dc0 2024-04-25T08:50:37.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc40959a640 1 -- 172.21.15.172:0/3032342745 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc0078e0 con 0x7fc40c070dc0 2024-04-25T08:50:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc40959a640 1 -- 172.21.15.172:0/3032342745 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc007cb0 con 0x7fc40c070dc0 2024-04-25T08:50:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc410b77640 1 -- 172.21.15.172:0/3032342745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 msgr2=0x7fc40c06ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc410b77640 1 --2- 172.21.15.172:0/3032342745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 0x7fc40c06ccd0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fc40c04efc0 tx=0x7fc3fc02a560 comp rx=0 tx=0).stop 2024-04-25T08:50:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc410b77640 1 -- 172.21.15.172:0/3032342745 shutdown_connections 2024-04-25T08:50:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc410b77640 1 --2- 172.21.15.172:0/3032342745 >> v2:172.21.15.186:3300/0 conn(0x7fc40c0711a0 0x7fc40c0b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc410b77640 1 --2- 172.21.15.172:0/3032342745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 0x7fc40c06ccd0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc410b77640 1 -- 172.21.15.172:0/3032342745 >> 172.21.15.172:0/3032342745 conn(0x7fc40c0b3530 msgr2=0x7fc40c0b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc410b77640 1 -- 172.21.15.172:0/3032342745 shutdown_connections 2024-04-25T08:50:37.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.619+0000 7fc410b77640 1 -- 172.21.15.172:0/3032342745 wait complete. 2024-04-25T08:50:37.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc410b77640 1 Processor -- start 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc410b77640 1 -- start start 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc410b77640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 0x7fc40c0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc410b77640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc40c0711a0 0x7fc40c157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc410b77640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40c0b4830 0x7fc40c1f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc410b77640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c161f40 con 0x7fc40c070dc0 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc410b77640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c161c60 con 0x7fc40c0b4830 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc410b77640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c071630 con 0x7fc40c0711a0 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc40a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 0x7fc40c0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc40a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 0x7fc40c0cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59074/0 (socket says 172.21.15.172:59074) 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.621+0000 7fc40a59c640 1 -- 172.21.15.172:0/1089668961 learned_addr learned my addr 172.21.15.172:0/1089668961 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc40ad9d640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40c0b4830 0x7fc40c1f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc409d9b640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc40c0711a0 0x7fc40c157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc40a59c640 1 -- 172.21.15.172:0/1089668961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc40c0711a0 msgr2=0x7fc40c157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc40a59c640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc40c0711a0 0x7fc40c157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc40a59c640 1 -- 172.21.15.172:0/1089668961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40c0b4830 msgr2=0x7fc40c1f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc40a59c640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40c0b4830 0x7fc40c1f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc40a59c640 1 -- 172.21.15.172:0/1089668961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c1f1320 con 0x7fc40c070dc0 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc40ad9d640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40c0b4830 0x7fc40c1f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc409d9b640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc40c0711a0 0x7fc40c157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc40a59c640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 0x7fc40c0cd610 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009e80 tx=0x7fc3fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc3faffd640 1 -- 172.21.15.172:0/1089668961 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc040070 con 0x7fc40c070dc0 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc3faffd640 1 -- 172.21.15.172:0/1089668961 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc031c40 con 0x7fc40c070dc0 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc410b77640 1 -- 172.21.15.172:0/1089668961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c1580c0 con 0x7fc40c070dc0 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc3faffd640 1 -- 172.21.15.172:0/1089668961 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc009450 con 0x7fc40c070dc0 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.622+0000 7fc410b77640 1 -- 172.21.15.172:0/1089668961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c158680 con 0x7fc40c070dc0 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.623+0000 7fc410b77640 1 -- 172.21.15.172:0/1089668961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c073a00 con 0x7fc40c070dc0 2024-04-25T08:50:37.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.623+0000 7fc3faffd640 1 -- 172.21.15.172:0/1089668961 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3fc039040 con 0x7fc40c070dc0 2024-04-25T08:50:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.624+0000 7fc3faffd640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ec06b4d0 0x7fc3ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.624+0000 7fc3faffd640 1 -- 172.21.15.172:0/1089668961 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc3fc0ab8a0 con 0x7fc40c070dc0 2024-04-25T08:50:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.624+0000 7fc409d9b640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ec06b4d0 0x7fc3ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:37.616 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.624+0000 7fc409d9b640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ec06b4d0 0x7fc3ec06d990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc40c159010 tx=0x7fc400008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:37.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.628+0000 7fc3faffd640 1 -- 172.21.15.172:0/1089668961 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3fc079ec0 con 0x7fc40c070dc0 2024-04-25T08:50:37.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.811+0000 7fc410b77640 1 -- 172.21.15.172:0/1089668961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc40c0d2510 con 0x7fc40c070dc0 2024-04-25T08:50:37.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.811+0000 7fc3faffd640 1 -- 172.21.15.172:0/1089668961 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc3fc07df60 con 0x7fc40c070dc0 2024-04-25T08:50:37.802 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:50:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 -- 172.21.15.172:0/1089668961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ec06b4d0 msgr2=0x7fc3ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ec06b4d0 0x7fc3ec06d990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fc40c159010 tx=0x7fc400008040 comp rx=0 tx=0).stop 2024-04-25T08:50:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 -- 172.21.15.172:0/1089668961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 msgr2=0x7fc40c0cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 0x7fc40c0cd610 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009e80 tx=0x7fc3fc004a40 comp rx=0 tx=0).stop 2024-04-25T08:50:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 -- 172.21.15.172:0/1089668961 shutdown_connections 2024-04-25T08:50:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc3ec06b4d0 0x7fc3ec06d990 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc40c0b4830 0x7fc40c1f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc40c0711a0 0x7fc40c157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 --2- 172.21.15.172:0/1089668961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c070dc0 0x7fc40c0cd610 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 -- 172.21.15.172:0/1089668961 >> 172.21.15.172:0/1089668961 conn(0x7fc40c0b3530 msgr2=0x7fc40c0ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 -- 172.21.15.172:0/1089668961 shutdown_connections 2024-04-25T08:50:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:37.814+0000 7fc410b77640 1 -- 172.21.15.172:0/1089668961 wait complete. 2024-04-25T08:50:37.815 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:50:37.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:37.815 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:50:38.449 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:50:38.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:50:38.450 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:50:38.471 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:50:38.471 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:50:38.488 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:50:38.488 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:50:38.488 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:50:38.526 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:50:38.527 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:50:38.527 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:50:38.544 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:50:38.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:38.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.674+0000 7f419605d640 1 Processor -- start 2024-04-25T08:50:38.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.674+0000 7f419605d640 1 -- start start 2024-04-25T08:50:38.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.675+0000 7f419605d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4190154fe0 0x7f419006e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:38.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.675+0000 7f419605d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41900b4d30 0x7f41900b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:38.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.675+0000 7f419605d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419015af60 con 0x7f419015f190 2024-04-25T08:50:38.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.675+0000 7f419605d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419015b870 con 0x7f4190154fe0 2024-04-25T08:50:38.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.675+0000 7f419605d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41900cdba0 con 0x7f41900b4d30 2024-04-25T08:50:38.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.675+0000 7f418ffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41900b4d30 0x7f41900b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:38.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.675+0000 7f418f7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4190154fe0 0x7f419006e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:38.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.675+0000 7f418effd640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f419015f190 0x7f41900b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:35458/0 (socket says 172.21.15.172:35458) 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.675+0000 7f418f7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4190154fe0 0x7f419006e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:41882/0 (socket says 172.21.15.172:41882) 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.675+0000 7f418effd640 1 -- 172.21.15.172:0/2797378932 learned_addr learned my addr 172.21.15.172:0/2797378932 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.676+0000 7f418ffff640 1 -- 172.21.15.172:0/2797378932 >> v2:172.21.15.186:3300/0 conn(0x7f4190154fe0 msgr2=0x7f419006e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.676+0000 7f418ffff640 1 --2- 172.21.15.172:0/2797378932 >> v2:172.21.15.186:3300/0 conn(0x7f4190154fe0 0x7f419006e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.676+0000 7f418ffff640 1 -- 172.21.15.172:0/2797378932 >> v1:172.21.15.186:6789/0 conn(0x7f419015f190 legacy=0x7f41900b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.676+0000 7f418ffff640 1 -- 172.21.15.172:0/2797378932 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419006f1c0 con 0x7f41900b4d30 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.676+0000 7f418ffff640 1 --2- 172.21.15.172:0/2797378932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41900b4d30 0x7f41900b2b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f419015b9f0 tx=0x7f418802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c60ac9494421e5bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f418e7fc640 1 -- 172.21.15.172:0/2797378932 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418802ae60 con 0x7f41900b4d30 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f418e7fc640 1 -- 172.21.15.172:0/2797378932 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4188007740 con 0x7f41900b4d30 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f418e7fc640 1 -- 172.21.15.172:0/2797378932 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188007b10 con 0x7f41900b4d30 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f419605d640 1 -- 172.21.15.172:0/2797378932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41900b4d30 msgr2=0x7f41900b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f419605d640 1 --2- 172.21.15.172:0/2797378932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41900b4d30 0x7f41900b2b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f419015b9f0 tx=0x7f418802a640 comp rx=0 tx=0).stop 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f419605d640 1 -- 172.21.15.172:0/2797378932 shutdown_connections 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f419605d640 1 --2- 172.21.15.172:0/2797378932 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41900b4d30 0x7f41900b2b90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f419605d640 1 --2- 172.21.15.172:0/2797378932 >> v2:172.21.15.186:3300/0 conn(0x7f4190154fe0 0x7f419006e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:38.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f419605d640 1 -- 172.21.15.172:0/2797378932 >> 172.21.15.172:0/2797378932 conn(0x7f41900cfae0 msgr2=0x7f41900cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:38.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f419605d640 1 -- 172.21.15.172:0/2797378932 shutdown_connections 2024-04-25T08:50:38.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.677+0000 7f419605d640 1 -- 172.21.15.172:0/2797378932 wait complete. 2024-04-25T08:50:38.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.678+0000 7f419605d640 1 Processor -- start 2024-04-25T08:50:38.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.678+0000 7f419605d640 1 -- start start 2024-04-25T08:50:38.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f419605d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900b4d30 0x7f4190159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:38.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f419605d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4190154fe0 0x7f41901525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f419605d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f419015f190 0x7f419006d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f419605d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41901553c0 con 0x7f41900b4d30 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f419605d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419015b500 con 0x7f419015f190 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f419605d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419015bd00 con 0x7f4190154fe0 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f418f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900b4d30 0x7f4190159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f418f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900b4d30 0x7f4190159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59086/0 (socket says 172.21.15.172:59086) 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f418f7fe640 1 -- 172.21.15.172:0/1940894447 learned_addr learned my addr 172.21.15.172:0/1940894447 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f418ffff640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f419015f190 0x7f419006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.679+0000 7f418effd640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4190154fe0 0x7f41901525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f418f7fe640 1 -- 172.21.15.172:0/1940894447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4190154fe0 msgr2=0x7f41901525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f418f7fe640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4190154fe0 0x7f41901525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f418f7fe640 1 -- 172.21.15.172:0/1940894447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f419015f190 msgr2=0x7f419006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f418f7fe640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f419015f190 0x7f419006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f418f7fe640 1 -- 172.21.15.172:0/1940894447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419006e640 con 0x7f41900b4d30 2024-04-25T08:50:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f418f7fe640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900b4d30 0x7f4190159700 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f418000e9e0 tx=0x7f418000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f4177fff640 1 -- 172.21.15.172:0/1940894447 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180017070 con 0x7f41900b4d30 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f4177fff640 1 -- 172.21.15.172:0/1940894447 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000c9d0 con 0x7f41900b4d30 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f4177fff640 1 -- 172.21.15.172:0/1940894447 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000cdc0 con 0x7f41900b4d30 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f419605d640 1 -- 172.21.15.172:0/1940894447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4190159d70 con 0x7f41900b4d30 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.680+0000 7f419605d640 1 -- 172.21.15.172:0/1940894447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419015a330 con 0x7f41900b4d30 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.681+0000 7f419605d640 1 -- 172.21.15.172:0/1940894447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4190072700 con 0x7f41900b4d30 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.681+0000 7f4177fff640 1 -- 172.21.15.172:0/1940894447 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f418001a070 con 0x7f41900b4d30 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.682+0000 7f4177fff640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f417c06b4d0 0x7f417c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.682+0000 7f4177fff640 1 -- 172.21.15.172:0/1940894447 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f418008a290 con 0x7f41900b4d30 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.682+0000 7f418effd640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f417c06b4d0 0x7f417c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.682+0000 7f418effd640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f417c06b4d0 0x7f417c06d990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f41900affb0 tx=0x7f4184007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:38.676 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.686+0000 7f4177fff640 1 -- 172.21.15.172:0/1940894447 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4190072700 con 0x7f41900b4d30 2024-04-25T08:50:38.885 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.895+0000 7f419605d640 1 -- 172.21.15.172:0/1940894447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4190073990 con 0x7f41900b4d30 2024-04-25T08:50:38.886 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.895+0000 7f4177fff640 1 -- 172.21.15.172:0/1940894447 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f41800589c0 con 0x7f41900b4d30 2024-04-25T08:50:38.886 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:38.886 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:38.886 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:38.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 -- 172.21.15.172:0/1940894447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f417c06b4d0 msgr2=0x7f417c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:38.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f417c06b4d0 0x7f417c06d990 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f41900affb0 tx=0x7f4184007e80 comp rx=0 tx=0).stop 2024-04-25T08:50:38.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 -- 172.21.15.172:0/1940894447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900b4d30 msgr2=0x7f4190159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:38.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900b4d30 0x7f4190159700 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f418000e9e0 tx=0x7f418000eea0 comp rx=0 tx=0).stop 2024-04-25T08:50:38.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 -- 172.21.15.172:0/1940894447 shutdown_connections 2024-04-25T08:50:38.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f417c06b4d0 0x7f417c06d990 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:38.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f419015f190 0x7f419006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:38.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4190154fe0 0x7f41901525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:38.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 --2- 172.21.15.172:0/1940894447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900b4d30 0x7f4190159700 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:38.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 -- 172.21.15.172:0/1940894447 >> 172.21.15.172:0/1940894447 conn(0x7f41900cfae0 msgr2=0x7f41900b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:38.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.897+0000 7f419605d640 1 -- 172.21.15.172:0/1940894447 shutdown_connections 2024-04-25T08:50:38.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:38.898+0000 7f419605d640 1 -- 172.21.15.172:0/1940894447 wait complete. 2024-04-25T08:50:38.900 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:38.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.006+0000 7fd8fbd13640 1 Processor -- start 2024-04-25T08:50:38.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.006+0000 7fd8fbd13640 1 -- start start 2024-04-25T08:50:39.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.007+0000 7fd8fbd13640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8f415dc00 0x7fd8f40c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.007+0000 7fd8fbd13640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f415dfe0 con 0x7fd8f40ceb20 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.007+0000 7fd8fbd13640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40d00c0 con 0x7fd8f40d1dd0 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.007+0000 7fd8fbd13640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40d03a0 con 0x7fd8f415dc00 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.007+0000 7fd8f92ae640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd8f40ceb20 0x7fd8f40d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33326/0 (socket says 172.21.15.172:33326) 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.007+0000 7fd8f92ae640 1 -- 172.21.15.172:0/1680031507 learned_addr learned my addr 172.21.15.172:0/1680031507 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.007+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300383380 0 0) 0x7fd8e4001110 con 0x7fd8f40ceb20 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.007+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e0003520 con 0x7fd8f40ceb20 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.007+0000 7fd8f9aaf640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8f415dc00 0x7fd8f40c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1149159299 0 0) 0x7fd8e0003520 con 0x7fd8f40ceb20 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8f415dc00 msgr2=0x7fd8f40c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8f415dc00 0x7fd8f40c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 >> v1:172.21.15.186:6789/0 conn(0x7fd8f40d1dd0 legacy=0x7fd8f40ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40cc440 con 0x7fd8f40ceb20 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fd8e4001840 con 0x7fd8f40ceb20 2024-04-25T08:50:39.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 >> v1:172.21.15.172:6789/0 conn(0x7fd8f40ceb20 legacy=0x7fd8f40d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8f415dc00 0x7fd8e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e0003f60 0x7fd8e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8e0004d40 0x7fd8e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40d03a0 con 0x7fd8e0003f60 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e000baa0 con 0x7fd8e0004d40 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e000bca0 con 0x7fd8f415dc00 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f92ae640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e0003f60 0x7fd8e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f9aaf640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8f415dc00 0x7fd8e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8fa2b0640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8e0004d40 0x7fd8e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f92ae640 1 -- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8f415dc00 msgr2=0x7fd8e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f92ae640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8f415dc00 0x7fd8e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f92ae640 1 -- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8e0004d40 msgr2=0x7fd8e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f92ae640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8e0004d40 0x7fd8e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8f92ae640 1 -- 172.21.15.172:0/1680031507 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e0003520 con 0x7fd8e0003f60 2024-04-25T08:50:39.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.008+0000 7fd8fa2b0640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8e0004d40 0x7fd8e00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.009+0000 7fd8f92ae640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e0003f60 0x7fd8e0004800 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400c4c0 tx=0x7fd8e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbfedacbc1ca650 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.009+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e400c0e0 con 0x7fd8e0003f60 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.009+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4034070 con 0x7fd8e0003f60 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.009+0000 7fd8f8aad640 1 -- 172.21.15.172:0/1680031507 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4005d70 con 0x7fd8e0003f60 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.009+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1680031507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e0003f60 msgr2=0x7fd8e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.009+0000 7fd8fbd13640 1 --2- 172.21.15.172:0/1680031507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8e0003f60 0x7fd8e0004800 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400c4c0 tx=0x7fd8e0005830 comp rx=0 tx=0).stop 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.009+0000 7fd8fa2b0640 1 -- 172.21.15.172:0/1680031507 reap_dead start 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.010+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1680031507 shutdown_connections 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.010+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1680031507 >> 172.21.15.172:0/1680031507 conn(0x7fd8f406f5d0 msgr2=0x7fd8f406f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.010+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1680031507 shutdown_connections 2024-04-25T08:50:39.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.010+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1680031507 wait complete. 2024-04-25T08:50:39.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.011+0000 7fd8fbd13640 1 Processor -- start 2024-04-25T08:50:39.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.011+0000 7fd8fbd13640 1 -- start start 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.011+0000 7fd8fbd13640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8e0003f60 0x7fd8f41f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.011+0000 7fd8fbd13640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8f4159490 0x7fd8f415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.011+0000 7fd8fbd13640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f415b790 0x7fd8f41470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.011+0000 7fd8fbd13640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40cfd90 con 0x7fd8f4159490 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.011+0000 7fd8fbd13640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40cc130 con 0x7fd8f415b790 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.011+0000 7fd8fbd13640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40cdd70 con 0x7fd8e0003f60 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f92ae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8f4159490 0x7fd8f415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f92ae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8f4159490 0x7fd8f415b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59098/0 (socket says 172.21.15.172:59098) 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f92ae640 1 -- 172.21.15.172:0/1740454739 learned_addr learned my addr 172.21.15.172:0/1740454739 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f9aaf640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8e0003f60 0x7fd8f41f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f92ae640 1 -- 172.21.15.172:0/1740454739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8e0003f60 msgr2=0x7fd8f41f3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f92ae640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8e0003f60 0x7fd8f41f3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8fa2b0640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f415b790 0x7fd8f41470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f92ae640 1 -- 172.21.15.172:0/1740454739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f415b790 msgr2=0x7fd8f41470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f92ae640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f415b790 0x7fd8f41470e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f92ae640 1 -- 172.21.15.172:0/1740454739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f4145d60 con 0x7fd8f4159490 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f9aaf640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8e0003f60 0x7fd8f41f3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8f92ae640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8f4159490 0x7fd8f415b250 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400c4c0 tx=0x7fd8e4001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8ea7fc640 1 -- 172.21.15.172:0/1740454739 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4007270 con 0x7fd8f4159490 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8ea7fc640 1 -- 172.21.15.172:0/1740454739 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4005e50 con 0x7fd8f4159490 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1740454739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f4146040 con 0x7fd8f4159490 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8ea7fc640 1 -- 172.21.15.172:0/1740454739 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4007610 con 0x7fd8f4159490 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.012+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1740454739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f4146600 con 0x7fd8f4159490 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.013+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1740454739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f4073990 con 0x7fd8f4159490 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.014+0000 7fd8ea7fc640 1 -- 172.21.15.172:0/1740454739 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd8e4039480 con 0x7fd8f4159490 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.014+0000 7fd8ea7fc640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd8d806b500 0x7fd8d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.014+0000 7fd8ea7fc640 1 -- 172.21.15.172:0/1740454739 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd8e40ab450 con 0x7fd8f4159490 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.014+0000 7fd8f9aaf640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd8d806b500 0x7fd8d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.014+0000 7fd8f9aaf640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd8d806b500 0x7fd8d806d9c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0007440 tx=0x7fd8f000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.018+0000 7fd8ea7fc640 1 -- 172.21.15.172:0/1740454739 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd8f415dfe0 con 0x7fd8f4159490 2024-04-25T08:50:39.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.190+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1740454739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8f40ce500 con 0x7fd8f4159490 2024-04-25T08:50:39.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.191+0000 7fd8ea7fc640 1 -- 172.21.15.172:0/1740454739 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17012 (secure 0 0 0) 0x7fd8e407a0b0 con 0x7fd8f4159490 2024-04-25T08:50:39.182 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:39.182 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":119,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:04.075355+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:00.630478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:01.391083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1740454739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd8d806b500 msgr2=0x7fd8d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd8d806b500 0x7fd8d806d9c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0007440 tx=0x7fd8f000b040 comp rx=0 tx=0).stop 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1740454739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8f4159490 msgr2=0x7fd8f415b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8f4159490 0x7fd8f415b250 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400c4c0 tx=0x7fd8e4001c10 comp rx=0 tx=0).stop 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1740454739 shutdown_connections 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd8d806b500 0x7fd8d806d9c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8f415b790 0x7fd8f41470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8f4159490 0x7fd8f415b250 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 --2- 172.21.15.172:0/1740454739 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd8e0003f60 0x7fd8f41f3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1740454739 >> 172.21.15.172:0/1740454739 conn(0x7fd8f406f5d0 msgr2=0x7fd8f40b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:39.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1740454739 shutdown_connections 2024-04-25T08:50:39.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.193+0000 7fd8fbd13640 1 -- 172.21.15.172:0/1740454739 wait complete. 2024-04-25T08:50:39.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:50:00.630478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '118', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:50:01.391083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:50:39.196 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:50:39.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.306+0000 7f25305cf640 1 Processor -- start 2024-04-25T08:50:39.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.306+0000 7f25305cf640 1 -- start start 2024-04-25T08:50:39.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f25305cf640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25281454a0 0x7f25280aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f25305cf640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f252815c970 0x7f252806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f25305cf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25280af540 con 0x7f252806b120 2024-04-25T08:50:39.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f25305cf640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25280af820 con 0x7f252815c970 2024-04-25T08:50:39.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f25305cf640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25280afb00 con 0x7f25281454a0 2024-04-25T08:50:39.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252eb6c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f252806b120 0x7f252815f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33338/0 (socket says 172.21.15.172:33338) 2024-04-25T08:50:39.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252eb6c640 1 -- 172.21.15.172:0/38062896 learned_addr learned my addr 172.21.15.172:0/38062896 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:39.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252db6a640 1 --2- 172.21.15.172:0/38062896 >> v2:172.21.15.186:3300/0 conn(0x7f252815c970 0x7f252806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252e36b640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25281454a0 0x7f25280aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762221285 0 0) 0x7f25280af540 con 0x7f252806b120 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2514003520 con 0x7f252806b120 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2760831549 0 0) 0x7f2514003520 con 0x7f252806b120 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25281454a0 msgr2=0x7f25280aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252d369640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25281454a0 0x7f25280aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 >> v2:172.21.15.186:3300/0 conn(0x7f252815c970 msgr2=0x7f252806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252d369640 1 --2- 172.21.15.172:0/38062896 >> v2:172.21.15.186:3300/0 conn(0x7f252815c970 0x7f252806abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25280afde0 con 0x7f252806b120 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.307+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f25200019f0 con 0x7f252806b120 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 >> v1:172.21.15.172:6789/0 conn(0x7f252806b120 legacy=0x7f252815f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252d369640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140039b0 0x7f2514003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252d369640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2514004800 0x7f2514004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252d369640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25281454a0 0x7f25140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25280af820 con 0x7f25140039b0 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25280afb00 con 0x7f2514004800 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251400b9c0 con 0x7f25281454a0 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252e36b640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140039b0 0x7f2514003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252db6a640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2514004800 0x7f2514004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252eb6c640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25281454a0 0x7f25140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252e36b640 1 -- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25281454a0 msgr2=0x7f25140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252e36b640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25281454a0 0x7f25140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252e36b640 1 -- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2514004800 msgr2=0x7f2514004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252e36b640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2514004800 0x7f2514004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252e36b640 1 -- 172.21.15.172:0/38062896 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2514003520 con 0x7f25140039b0 2024-04-25T08:50:39.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.308+0000 7f252eb6c640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25281454a0 0x7f25140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f252e36b640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140039b0 0x7f2514003dd0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f2524009ac0 tx=0x7f2514005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f1c938dbddb542 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524036070 con 0x7f25140039b0 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524031400 con 0x7f25140039b0 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f252d369640 1 -- 172.21.15.172:0/38062896 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524009690 con 0x7f25140039b0 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f25305cf640 1 -- 172.21.15.172:0/38062896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140039b0 msgr2=0x7f2514003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f25305cf640 1 --2- 172.21.15.172:0/38062896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140039b0 0x7f2514003dd0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f2524009ac0 tx=0x7f2514005830 comp rx=0 tx=0).stop 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f252eb6c640 1 -- 172.21.15.172:0/38062896 reap_dead start 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f25305cf640 1 -- 172.21.15.172:0/38062896 shutdown_connections 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f25305cf640 1 -- 172.21.15.172:0/38062896 >> 172.21.15.172:0/38062896 conn(0x7f25280b5af0 msgr2=0x7f25280b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f25305cf640 1 -- 172.21.15.172:0/38062896 shutdown_connections 2024-04-25T08:50:39.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.309+0000 7f25305cf640 1 -- 172.21.15.172:0/38062896 wait complete. 2024-04-25T08:50:39.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f25305cf640 1 Processor -- start 2024-04-25T08:50:39.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f25305cf640 1 -- start start 2024-04-25T08:50:39.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f25305cf640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25140039b0 0x7f252815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f25305cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25281366a0 0x7f252809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f25305cf640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f252809d440 0x7f252815f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f25305cf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252815e620 con 0x7f25281366a0 2024-04-25T08:50:39.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f25305cf640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252815e4a0 con 0x7f25140039b0 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f25305cf640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252815e7a0 con 0x7f252809d440 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f252db6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25281366a0 0x7f252809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f252db6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25281366a0 0x7f252809cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59124/0 (socket says 172.21.15.172:59124) 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f252db6a640 1 -- 172.21.15.172:0/4284891608 learned_addr learned my addr 172.21.15.172:0/4284891608 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.311+0000 7f252e36b640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25140039b0 0x7f252815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f252eb6c640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f252809d440 0x7f252815f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f252db6a640 1 -- 172.21.15.172:0/4284891608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f252809d440 msgr2=0x7f252815f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f252db6a640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f252809d440 0x7f252815f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f252db6a640 1 -- 172.21.15.172:0/4284891608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25140039b0 msgr2=0x7f252815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f252db6a640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25140039b0 0x7f252815b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f252db6a640 1 -- 172.21.15.172:0/4284891608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252809d900 con 0x7f25281366a0 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f252db6a640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25281366a0 0x7f252809cf00 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f2518011a70 tx=0x7f2518011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f251effd640 1 -- 172.21.15.172:0/4284891608 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251800fa90 con 0x7f25281366a0 2024-04-25T08:50:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f251effd640 1 -- 172.21.15.172:0/4284891608 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251800fc30 con 0x7f25281366a0 2024-04-25T08:50:39.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f251effd640 1 -- 172.21.15.172:0/4284891608 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518014440 con 0x7f25281366a0 2024-04-25T08:50:39.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f25305cf640 1 -- 172.21.15.172:0/4284891608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252809dbe0 con 0x7f25281366a0 2024-04-25T08:50:39.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.312+0000 7f25305cf640 1 -- 172.21.15.172:0/4284891608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252809e480 con 0x7f25281366a0 2024-04-25T08:50:39.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.313+0000 7f25305cf640 1 -- 172.21.15.172:0/4284891608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252809dfd0 con 0x7f25281366a0 2024-04-25T08:50:39.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.313+0000 7f251effd640 1 -- 172.21.15.172:0/4284891608 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2518012040 con 0x7f25281366a0 2024-04-25T08:50:39.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.314+0000 7f251effd640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f250c06b4d0 0x7f250c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.314+0000 7f251effd640 1 -- 172.21.15.172:0/4284891608 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f251808a810 con 0x7f25281366a0 2024-04-25T08:50:39.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.314+0000 7f252e36b640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f250c06b4d0 0x7f250c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.314+0000 7f252e36b640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f250c06b4d0 0x7f250c06d990 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2524033000 tx=0x7f2524008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.318+0000 7f251effd640 1 -- 172.21.15.172:0/4284891608 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2518019030 con 0x7f25281366a0 2024-04-25T08:50:39.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.491+0000 7f25305cf640 1 -- 172.21.15.172:0/4284891608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f252806cc80 con 0x7f25281366a0 2024-04-25T08:50:39.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.492+0000 7f251effd640 1 -- 172.21.15.172:0/4284891608 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2518059590 con 0x7f25281366a0 2024-04-25T08:50:39.482 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:50:39.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.493+0000 7f25305cf640 1 -- 172.21.15.172:0/4284891608 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f250c06b4d0 msgr2=0x7f250c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.493+0000 7f25305cf640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f250c06b4d0 0x7f250c06d990 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2524033000 tx=0x7f2524008030 comp rx=0 tx=0).stop 2024-04-25T08:50:39.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.493+0000 7f25305cf640 1 -- 172.21.15.172:0/4284891608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25281366a0 msgr2=0x7f252809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.493+0000 7f25305cf640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25281366a0 0x7f252809cf00 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f2518011a70 tx=0x7f2518011e70 comp rx=0 tx=0).stop 2024-04-25T08:50:39.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.494+0000 7f25305cf640 1 -- 172.21.15.172:0/4284891608 shutdown_connections 2024-04-25T08:50:39.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.494+0000 7f25305cf640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f250c06b4d0 0x7f250c06d990 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.494+0000 7f25305cf640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f252809d440 0x7f252815f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.494+0000 7f25305cf640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25281366a0 0x7f252809cf00 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.494+0000 7f25305cf640 1 --2- 172.21.15.172:0/4284891608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25140039b0 0x7f252815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.494+0000 7f25305cf640 1 -- 172.21.15.172:0/4284891608 >> 172.21.15.172:0/4284891608 conn(0x7f25280b5af0 msgr2=0x7f25280b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:39.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.494+0000 7f25305cf640 1 -- 172.21.15.172:0/4284891608 shutdown_connections 2024-04-25T08:50:39.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.494+0000 7f25305cf640 1 -- 172.21.15.172:0/4284891608 wait complete. 2024-04-25T08:50:39.495 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:50:39.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.605+0000 7f9b35883640 1 Processor -- start 2024-04-25T08:50:39.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.605+0000 7f9b35883640 1 -- start start 2024-04-25T08:50:39.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b35883640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3015dac0 0x7f9b300d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b35883640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9b300d1f30 0x7f9b300d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b35883640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9b300d34c0 0x7f9b300d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b35883640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b300d3030 con 0x7f9b300d1f30 2024-04-25T08:50:39.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b35883640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b300d2420 con 0x7f9b300d34c0 2024-04-25T08:50:39.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b35883640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300d2700 con 0x7f9b3015dac0 2024-04-25T08:50:39.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2e7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9b300d1f30 0x7f9b300d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2e7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9b300d1f30 0x7f9b300d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59132/0 (socket says 172.21.15.172:59132) 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2e7fc640 1 -- 172.21.15.172:0/2095441415 learned_addr learned my addr 172.21.15.172:0/2095441415 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2f7fe640 1 --2- 172.21.15.172:0/2095441415 >> v2:172.21.15.186:3300/0 conn(0x7f9b300d34c0 0x7f9b300d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2effd640 1 --2- 172.21.15.172:0/2095441415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3015dac0 0x7f9b300d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2e7fc640 1 -- 172.21.15.172:0/2095441415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3015dac0 msgr2=0x7f9b300d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2e7fc640 1 --2- 172.21.15.172:0/2095441415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3015dac0 0x7f9b300d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2e7fc640 1 -- 172.21.15.172:0/2095441415 >> v2:172.21.15.186:3300/0 conn(0x7f9b300d34c0 msgr2=0x7f9b300d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2e7fc640 1 --2- 172.21.15.172:0/2095441415 >> v2:172.21.15.186:3300/0 conn(0x7f9b300d34c0 0x7f9b300d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2e7fc640 1 -- 172.21.15.172:0/2095441415 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300d29e0 con 0x7f9b300d1f30 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.606+0000 7f9b2f7fe640 1 --2- 172.21.15.172:0/2095441415 >> v2:172.21.15.186:3300/0 conn(0x7f9b300d34c0 0x7f9b300d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.607+0000 7f9b2e7fc640 1 --2- 172.21.15.172:0/2095441415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d1f30 0x7f9b300d03a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f9b3006cc00 tx=0x7f9b2402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c26e3c34a03cb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.607+0000 7f9b2dffb640 1 -- 172.21.15.172:0/2095441415 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24004030 con 0x7f9b300d1f30 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.607+0000 7f9b2dffb640 1 -- 172.21.15.172:0/2095441415 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b240041d0 con 0x7f9b300d1f30 2024-04-25T08:50:39.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.607+0000 7f9b2dffb640 1 -- 172.21.15.172:0/2095441415 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24003610 con 0x7f9b300d1f30 2024-04-25T08:50:39.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.608+0000 7f9b35883640 1 -- 172.21.15.172:0/2095441415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d1f30 msgr2=0x7f9b300d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.608+0000 7f9b35883640 1 --2- 172.21.15.172:0/2095441415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d1f30 0x7f9b300d03a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f9b3006cc00 tx=0x7f9b2402a250 comp rx=0 tx=0).stop 2024-04-25T08:50:39.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.608+0000 7f9b35883640 1 -- 172.21.15.172:0/2095441415 shutdown_connections 2024-04-25T08:50:39.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.608+0000 7f9b35883640 1 --2- 172.21.15.172:0/2095441415 >> v2:172.21.15.186:3300/0 conn(0x7f9b300d34c0 0x7f9b300d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.608+0000 7f9b35883640 1 --2- 172.21.15.172:0/2095441415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d1f30 0x7f9b300d03a0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.608+0000 7f9b35883640 1 --2- 172.21.15.172:0/2095441415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3015dac0 0x7f9b300d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.608+0000 7f9b35883640 1 -- 172.21.15.172:0/2095441415 >> 172.21.15.172:0/2095441415 conn(0x7f9b30061c30 msgr2=0x7f9b3006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:39.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.608+0000 7f9b35883640 1 -- 172.21.15.172:0/2095441415 shutdown_connections 2024-04-25T08:50:39.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.608+0000 7f9b35883640 1 -- 172.21.15.172:0/2095441415 wait complete. 2024-04-25T08:50:39.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.609+0000 7f9b35883640 1 Processor -- start 2024-04-25T08:50:39.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.609+0000 7f9b35883640 1 -- start start 2024-04-25T08:50:39.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b35883640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b300d1f30 0x7f9b300b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b35883640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d34c0 0x7f9b301f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b35883640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3015dac0 0x7f9b301f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b35883640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300b97d0 con 0x7f9b300d34c0 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b35883640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3015dea0 con 0x7f9b300d1f30 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b35883640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300b9950 con 0x7f9b3015dac0 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d34c0 0x7f9b301f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d34c0 0x7f9b301f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59138/0 (socket says 172.21.15.172:59138) 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2e7fc640 1 -- 172.21.15.172:0/2695253837 learned_addr learned my addr 172.21.15.172:0/2695253837 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2effd640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b300d1f30 0x7f9b300b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2f7fe640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3015dac0 0x7f9b301f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2e7fc640 1 -- 172.21.15.172:0/2695253837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3015dac0 msgr2=0x7f9b301f4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2e7fc640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3015dac0 0x7f9b301f4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2e7fc640 1 -- 172.21.15.172:0/2695253837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b300d1f30 msgr2=0x7f9b300b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2e7fc640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b300d1f30 0x7f9b300b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2e7fc640 1 -- 172.21.15.172:0/2695253837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300b53c0 con 0x7f9b300d34c0 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b2e7fc640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d34c0 0x7f9b301f3c50 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f9b24000c00 tx=0x7f9b240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b17fff640 1 -- 172.21.15.172:0/2695253837 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24041020 con 0x7f9b300d34c0 2024-04-25T08:50:39.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b17fff640 1 -- 172.21.15.172:0/2695253837 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b24003c50 con 0x7f9b300d34c0 2024-04-25T08:50:39.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b35883640 1 -- 172.21.15.172:0/2695253837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b300b56a0 con 0x7f9b300d34c0 2024-04-25T08:50:39.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.610+0000 7f9b17fff640 1 -- 172.21.15.172:0/2695253837 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24004030 con 0x7f9b300d34c0 2024-04-25T08:50:39.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.611+0000 7f9b35883640 1 -- 172.21.15.172:0/2695253837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b300b5c60 con 0x7f9b300d34c0 2024-04-25T08:50:39.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.612+0000 7f9b35883640 1 -- 172.21.15.172:0/2695253837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3008ba50 con 0x7f9b300d34c0 2024-04-25T08:50:39.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.612+0000 7f9b17fff640 1 -- 172.21.15.172:0/2695253837 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b24044020 con 0x7f9b300d34c0 2024-04-25T08:50:39.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.612+0000 7f9b17fff640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b1c06b500 0x7f9b1c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.612+0000 7f9b17fff640 1 -- 172.21.15.172:0/2695253837 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9b240aafd0 con 0x7f9b300d34c0 2024-04-25T08:50:39.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.612+0000 7f9b2effd640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b1c06b500 0x7f9b1c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.613+0000 7f9b2effd640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b1c06b500 0x7f9b1c06d9c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9b20006fd0 tx=0x7f9b20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.616+0000 7f9b17fff640 1 -- 172.21.15.172:0/2695253837 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b3008ba50 con 0x7f9b300d34c0 2024-04-25T08:50:39.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.788+0000 7f9b35883640 1 -- 172.21.15.172:0/2695253837 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b30073a00 con 0x7f9b300d34c0 2024-04-25T08:50:39.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.788+0000 7f9b17fff640 1 -- 172.21.15.172:0/2695253837 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b2404b030 con 0x7f9b300d34c0 2024-04-25T08:50:39.779 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:50:39.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 -- 172.21.15.172:0/2695253837 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b1c06b500 msgr2=0x7f9b1c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b1c06b500 0x7f9b1c06d9c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9b20006fd0 tx=0x7f9b20008040 comp rx=0 tx=0).stop 2024-04-25T08:50:39.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 -- 172.21.15.172:0/2695253837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d34c0 msgr2=0x7f9b301f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d34c0 0x7f9b301f3c50 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f9b24000c00 tx=0x7f9b240046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 -- 172.21.15.172:0/2695253837 shutdown_connections 2024-04-25T08:50:39.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9b1c06b500 0x7f9b1c06d9c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3015dac0 0x7f9b301f4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300d34c0 0x7f9b301f3c50 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 --2- 172.21.15.172:0/2695253837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b300d1f30 0x7f9b300b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 -- 172.21.15.172:0/2695253837 >> 172.21.15.172:0/2695253837 conn(0x7f9b30061c30 msgr2=0x7f9b300b85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:39.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 -- 172.21.15.172:0/2695253837 shutdown_connections 2024-04-25T08:50:39.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.790+0000 7f9b35883640 1 -- 172.21.15.172:0/2695253837 wait complete. 2024-04-25T08:50:39.792 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:50:39.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.902+0000 7f1c85c5d640 1 Processor -- start 2024-04-25T08:50:39.893 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.902+0000 7f1c85c5d640 1 -- start start 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c85c5d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1c8015b710 0x7f1c800cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c85c5d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c8006ec50 0x7f1c8015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c85c5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 0x7f1c800ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c85c5d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8015e490 con 0x7f1c8006ec50 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c85c5d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8006f0e0 con 0x7f1c8015b710 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c85c5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c800cfd80 con 0x7f1c8015ee60 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c7effd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c8006ec50 0x7f1c8015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c7effd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c8006ec50 0x7f1c8015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59140/0 (socket says 172.21.15.172:59140) 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c7effd640 1 -- 172.21.15.172:0/4290585718 learned_addr learned my addr 172.21.15.172:0/4290585718 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c7ffff640 1 --2- 172.21.15.172:0/4290585718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 0x7f1c800ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c7f7fe640 1 --2- 172.21.15.172:0/4290585718 >> v2:172.21.15.186:3300/0 conn(0x7f1c8015b710 0x7f1c800cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c7effd640 1 -- 172.21.15.172:0/4290585718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 msgr2=0x7f1c800ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.895 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c7effd640 1 --2- 172.21.15.172:0/4290585718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 0x7f1c800ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c7effd640 1 -- 172.21.15.172:0/4290585718 >> v2:172.21.15.186:3300/0 conn(0x7f1c8015b710 msgr2=0x7f1c800cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:39.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c7effd640 1 --2- 172.21.15.172:0/4290585718 >> v2:172.21.15.186:3300/0 conn(0x7f1c8015b710 0x7f1c800cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.903+0000 7f1c7effd640 1 -- 172.21.15.172:0/4290585718 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800d0060 con 0x7f1c8006ec50 2024-04-25T08:50:39.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.904+0000 7f1c7effd640 1 --2- 172.21.15.172:0/4290585718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8006ec50 0x7f1c8015e920 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f1c8006b950 tx=0x7f1c7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99c8ce6635e0d6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.904+0000 7f1c7e7fc640 1 -- 172.21.15.172:0/4290585718 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74037070 con 0x7f1c8006ec50 2024-04-25T08:50:39.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.904+0000 7f1c7e7fc640 1 -- 172.21.15.172:0/4290585718 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74032440 con 0x7f1c8006ec50 2024-04-25T08:50:39.896 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.904+0000 7f1c7e7fc640 1 -- 172.21.15.172:0/4290585718 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74032810 con 0x7f1c8006ec50 2024-04-25T08:50:39.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.905+0000 7f1c85c5d640 1 -- 172.21.15.172:0/4290585718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8006ec50 msgr2=0x7f1c8015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.905+0000 7f1c85c5d640 1 --2- 172.21.15.172:0/4290585718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8006ec50 0x7f1c8015e920 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f1c8006b950 tx=0x7f1c7402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.905+0000 7f1c85c5d640 1 -- 172.21.15.172:0/4290585718 shutdown_connections 2024-04-25T08:50:39.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.905+0000 7f1c85c5d640 1 --2- 172.21.15.172:0/4290585718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 0x7f1c800ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.905+0000 7f1c85c5d640 1 --2- 172.21.15.172:0/4290585718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8006ec50 0x7f1c8015e920 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.905+0000 7f1c85c5d640 1 --2- 172.21.15.172:0/4290585718 >> v2:172.21.15.186:3300/0 conn(0x7f1c8015b710 0x7f1c800cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.905+0000 7f1c85c5d640 1 -- 172.21.15.172:0/4290585718 >> 172.21.15.172:0/4290585718 conn(0x7f1c8006abe0 msgr2=0x7f1c8006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:39.899 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.905+0000 7f1c85c5d640 1 -- 172.21.15.172:0/4290585718 shutdown_connections 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.905+0000 7f1c85c5d640 1 -- 172.21.15.172:0/4290585718 wait complete. 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.906+0000 7f1c85c5d640 1 Processor -- start 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.906+0000 7f1c85c5d640 1 -- start start 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c85c5d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c8006ec50 0x7f1c800b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c85c5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8015b710 0x7f1c801522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c85c5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 0x7f1c8006d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c85c5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8015bc70 con 0x7f1c8015b710 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c85c5d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8015baf0 con 0x7f1c8006ec50 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c85c5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c800acdf0 con 0x7f1c8015ee60 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8015b710 0x7f1c801522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8015b710 0x7f1c801522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59146/0 (socket says 172.21.15.172:59146) 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7effd640 1 -- 172.21.15.172:0/3838700273 learned_addr learned my addr 172.21.15.172:0/3838700273 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7f7fe640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c8006ec50 0x7f1c800b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7ffff640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 0x7f1c8006d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.900 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7effd640 1 -- 172.21.15.172:0/3838700273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 msgr2=0x7f1c8006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7effd640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 0x7f1c8006d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7effd640 1 -- 172.21.15.172:0/3838700273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c8006ec50 msgr2=0x7f1c800b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7effd640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c8006ec50 0x7f1c800b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7effd640 1 -- 172.21.15.172:0/3838700273 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c80152c40 con 0x7f1c8015b710 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7ffff640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 0x7f1c8006d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c7effd640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8015b710 0x7f1c801522d0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f1c7402a220 tx=0x7f1c740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c67fff640 1 -- 172.21.15.172:0/3838700273 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74041020 con 0x7f1c8015b710 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c67fff640 1 -- 172.21.15.172:0/3838700273 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7403d620 con 0x7f1c8015b710 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.907+0000 7f1c85c5d640 1 -- 172.21.15.172:0/3838700273 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c80152f20 con 0x7f1c8015b710 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.908+0000 7f1c67fff640 1 -- 172.21.15.172:0/3838700273 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74037040 con 0x7f1c8015b710 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.908+0000 7f1c85c5d640 1 -- 172.21.15.172:0/3838700273 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c801534e0 con 0x7f1c8015b710 2024-04-25T08:50:39.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.909+0000 7f1c85c5d640 1 -- 172.21.15.172:0/3838700273 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c80073a00 con 0x7f1c8015b710 2024-04-25T08:50:39.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.909+0000 7f1c67fff640 1 -- 172.21.15.172:0/3838700273 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c74044020 con 0x7f1c8015b710 2024-04-25T08:50:39.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.909+0000 7f1c67fff640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6c06b500 0x7f1c6c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:39.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.910+0000 7f1c67fff640 1 -- 172.21.15.172:0/3838700273 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1c740aa9f0 con 0x7f1c8015b710 2024-04-25T08:50:39.902 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.910+0000 7f1c7f7fe640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6c06b500 0x7f1c6c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:39.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.910+0000 7f1c7f7fe640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6c06b500 0x7f1c6c06d9c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009a50 tx=0x7f1c70008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:39.904 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:39.914+0000 7f1c67fff640 1 -- 172.21.15.172:0/3838700273 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c7404b030 con 0x7f1c8015b710 2024-04-25T08:50:40.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.083+0000 7f1c85c5d640 1 -- 172.21.15.172:0/3838700273 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c800ae420 con 0x7f1c8015b710 2024-04-25T08:50:40.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.084+0000 7f1c67fff640 1 -- 172.21.15.172:0/3838700273 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c740aa070 con 0x7f1c8015b710 2024-04-25T08:50:40.075 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:50:40.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 -- 172.21.15.172:0/3838700273 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6c06b500 msgr2=0x7f1c6c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6c06b500 0x7f1c6c06d9c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009a50 tx=0x7f1c70008040 comp rx=0 tx=0).stop 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 -- 172.21.15.172:0/3838700273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8015b710 msgr2=0x7f1c801522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8015b710 0x7f1c801522d0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f1c7402a220 tx=0x7f1c740046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 -- 172.21.15.172:0/3838700273 shutdown_connections 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1c6c06b500 0x7f1c6c06d9c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1c8015ee60 0x7f1c8006d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c8015b710 0x7f1c801522d0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 --2- 172.21.15.172:0/3838700273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1c8006ec50 0x7f1c800b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 -- 172.21.15.172:0/3838700273 >> 172.21.15.172:0/3838700273 conn(0x7f1c8006abe0 msgr2=0x7f1c8006df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 -- 172.21.15.172:0/3838700273 shutdown_connections 2024-04-25T08:50:40.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.086+0000 7f1c85c5d640 1 -- 172.21.15.172:0/3838700273 wait complete. 2024-04-25T08:50:40.088 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:40.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.195+0000 7f5324e12640 1 Processor -- start 2024-04-25T08:50:40.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.195+0000 7f5324e12640 1 -- start start 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f5324e12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53200cc6c0 0x7f5320071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f5324e12640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f532015b320 0x7f5320071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f5324e12640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5320071ed0 con 0x7f532013d190 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f5324e12640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5320071cb0 con 0x7f532015b320 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f5324e12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532013d570 con 0x7f53200cc6c0 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f531ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f532015b320 0x7f5320071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f531e59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f532013d190 0x7f53200cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33350/0 (socket says 172.21.15.172:33350) 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f531e59c640 1 -- 172.21.15.172:0/1047951931 learned_addr learned my addr 172.21.15.172:0/1047951931 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f531dd9b640 1 --2- 172.21.15.172:0/1047951931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53200cc6c0 0x7f5320071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f531ed9d640 1 -- 172.21.15.172:0/1047951931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53200cc6c0 msgr2=0x7f5320071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f531ed9d640 1 --2- 172.21.15.172:0/1047951931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53200cc6c0 0x7f5320071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f531ed9d640 1 -- 172.21.15.172:0/1047951931 >> v1:172.21.15.172:6789/0 conn(0x7f532013d190 legacy=0x7f53200cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f531ed9d640 1 -- 172.21.15.172:0/1047951931 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532015a840 con 0x7f532015b320 2024-04-25T08:50:40.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f531d59a640 1 -- 172.21.15.172:0/1047951931 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329342962 0 0) 0x7f5320071ed0 con 0x7f532013d190 2024-04-25T08:50:40.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.196+0000 7f531dd9b640 1 --2- 172.21.15.172:0/1047951931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53200cc6c0 0x7f5320071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:40.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.197+0000 7f531ed9d640 1 --2- 172.21.15.172:0/1047951931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f532015b320 0x7f5320071770 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f531800aea0 tx=0x7f531802b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98af643de3011c15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:40.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.197+0000 7f531d59a640 1 -- 172.21.15.172:0/1047951931 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318037070 con 0x7f532015b320 2024-04-25T08:50:40.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.197+0000 7f531d59a640 1 -- 172.21.15.172:0/1047951931 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5318008640 con 0x7f532015b320 2024-04-25T08:50:40.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.197+0000 7f531d59a640 1 -- 172.21.15.172:0/1047951931 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318008a10 con 0x7f532015b320 2024-04-25T08:50:40.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.197+0000 7f5324e12640 1 -- 172.21.15.172:0/1047951931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f532015b320 msgr2=0x7f5320071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.197+0000 7f5324e12640 1 --2- 172.21.15.172:0/1047951931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f532015b320 0x7f5320071770 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f531800aea0 tx=0x7f531802b720 comp rx=0 tx=0).stop 2024-04-25T08:50:40.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.198+0000 7f5324e12640 1 -- 172.21.15.172:0/1047951931 shutdown_connections 2024-04-25T08:50:40.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.198+0000 7f5324e12640 1 --2- 172.21.15.172:0/1047951931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53200cc6c0 0x7f5320071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.198+0000 7f5324e12640 1 --2- 172.21.15.172:0/1047951931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f532015b320 0x7f5320071770 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.198+0000 7f5324e12640 1 -- 172.21.15.172:0/1047951931 >> 172.21.15.172:0/1047951931 conn(0x7f532006abe0 msgr2=0x7f532006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:40.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.198+0000 7f5324e12640 1 -- 172.21.15.172:0/1047951931 shutdown_connections 2024-04-25T08:50:40.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.198+0000 7f5324e12640 1 -- 172.21.15.172:0/1047951931 wait complete. 2024-04-25T08:50:40.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.199+0000 7f5324e12640 1 Processor -- start 2024-04-25T08:50:40.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.199+0000 7f5324e12640 1 -- start start 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f5324e12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200cc6c0 0x7f532014e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f5324e12640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f532013d190 0x7f5320137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f5324e12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f532015b320 0x7f5320134b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f5324e12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53200cf620 con 0x7f53200cc6c0 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f5324e12640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532015ae00 con 0x7f532013d190 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f5324e12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53200cf7a0 con 0x7f532015b320 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f531e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200cc6c0 0x7f532014e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f531e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200cc6c0 0x7f532014e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59164/0 (socket says 172.21.15.172:59164) 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f531e59c640 1 -- 172.21.15.172:0/2531722104 learned_addr learned my addr 172.21.15.172:0/2531722104 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f531e59c640 1 -- 172.21.15.172:0/2531722104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f532015b320 msgr2=0x7f5320134b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f531e59c640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f532015b320 0x7f5320134b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f531e59c640 1 -- 172.21.15.172:0/2531722104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f532013d190 msgr2=0x7f5320137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f531e59c640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f532013d190 0x7f5320137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f531e59c640 1 -- 172.21.15.172:0/2531722104 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5320138150 con 0x7f53200cc6c0 2024-04-25T08:50:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f531e59c640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200cc6c0 0x7f532014e880 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f531400c500 tx=0x7f531400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f530effd640 1 -- 172.21.15.172:0/2531722104 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314018070 con 0x7f53200cc6c0 2024-04-25T08:50:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f530effd640 1 -- 172.21.15.172:0/2531722104 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5314007580 con 0x7f53200cc6c0 2024-04-25T08:50:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f530effd640 1 -- 172.21.15.172:0/2531722104 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314004a20 con 0x7f53200cc6c0 2024-04-25T08:50:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f5324e12640 1 -- 172.21.15.172:0/2531722104 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5320151f90 con 0x7f53200cc6c0 2024-04-25T08:50:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.200+0000 7f5324e12640 1 -- 172.21.15.172:0/2531722104 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5320135660 con 0x7f53200cc6c0 2024-04-25T08:50:40.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.201+0000 7f5324e12640 1 -- 172.21.15.172:0/2531722104 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5320073990 con 0x7f53200cc6c0 2024-04-25T08:50:40.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.202+0000 7f530effd640 1 -- 172.21.15.172:0/2531722104 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f531401b070 con 0x7f53200cc6c0 2024-04-25T08:50:40.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.202+0000 7f530effd640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f530006b4d0 0x7f530006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.202+0000 7f530effd640 1 -- 172.21.15.172:0/2531722104 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f53140895e0 con 0x7f53200cc6c0 2024-04-25T08:50:40.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.202+0000 7f531dd9b640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f530006b4d0 0x7f530006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.203+0000 7f531dd9b640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f530006b4d0 0x7f530006d990 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5310006e80 tx=0x7f5310008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:40.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.206+0000 7f530effd640 1 -- 172.21.15.172:0/2531722104 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5320151f90 con 0x7f53200cc6c0 2024-04-25T08:50:40.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.413+0000 7f5324e12640 1 -- 172.21.15.172:0/2531722104 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5320153940 con 0x7f53200cc6c0 2024-04-25T08:50:40.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.413+0000 7f530effd640 1 -- 172.21.15.172:0/2531722104 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f5314058360 con 0x7f53200cc6c0 2024-04-25T08:50:40.404 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:40.404 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:40.404 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:40.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.415+0000 7f5324e12640 1 -- 172.21.15.172:0/2531722104 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f530006b4d0 msgr2=0x7f530006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.415+0000 7f5324e12640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f530006b4d0 0x7f530006d990 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5310006e80 tx=0x7f5310008040 comp rx=0 tx=0).stop 2024-04-25T08:50:40.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.415+0000 7f5324e12640 1 -- 172.21.15.172:0/2531722104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200cc6c0 msgr2=0x7f532014e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.415+0000 7f5324e12640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200cc6c0 0x7f532014e880 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f531400c500 tx=0x7f531400c9c0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.416+0000 7f5324e12640 1 -- 172.21.15.172:0/2531722104 shutdown_connections 2024-04-25T08:50:40.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.416+0000 7f5324e12640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f530006b4d0 0x7f530006d990 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.416+0000 7f5324e12640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f532013d190 0x7f5320137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.416+0000 7f5324e12640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f532015b320 0x7f5320134b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.416+0000 7f5324e12640 1 --2- 172.21.15.172:0/2531722104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53200cc6c0 0x7f532014e880 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.416+0000 7f5324e12640 1 -- 172.21.15.172:0/2531722104 >> 172.21.15.172:0/2531722104 conn(0x7f532006abe0 msgr2=0x7f53200cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:40.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.416+0000 7f5324e12640 1 -- 172.21.15.172:0/2531722104 shutdown_connections 2024-04-25T08:50:40.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.416+0000 7f5324e12640 1 -- 172.21.15.172:0/2531722104 wait complete. 2024-04-25T08:50:40.418 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:40.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.526+0000 7fa9664e1640 1 Processor -- start 2024-04-25T08:50:40.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.526+0000 7fa9664e1640 1 -- start start 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa9664e1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa960071ac0 0x7fa9600ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa9664e1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96015ec60 con 0x7fa96006c1d0 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa9664e1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96015ef40 con 0x7fa960154ed0 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa9664e1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96006db90 con 0x7fa960071ac0 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa95f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa960071ac0 0x7fa9600ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa964a7e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa96006c1d0 0x7fa96006afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33366/0 (socket says 172.21.15.172:33366) 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa964a7e640 1 -- 172.21.15.172:0/42548602 learned_addr learned my addr 172.21.15.172:0/42548602 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa95f7fe640 1 -- 172.21.15.172:0/42548602 >> v1:172.21.15.186:6789/0 conn(0x7fa960154ed0 legacy=0x7fa9600aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa95f7fe640 1 -- 172.21.15.172:0/42548602 >> v1:172.21.15.172:6789/0 conn(0x7fa96006c1d0 legacy=0x7fa96006afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa95effd640 1 -- 172.21.15.172:0/42548602 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421243338 0 0) 0x7fa96015ec60 con 0x7fa96006c1d0 2024-04-25T08:50:40.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.527+0000 7fa95f7fe640 1 -- 172.21.15.172:0/42548602 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96006de70 con 0x7fa960071ac0 2024-04-25T08:50:40.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.528+0000 7fa95f7fe640 1 --2- 172.21.15.172:0/42548602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960071ac0 0x7fa9600ad5e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fa9540097a0 tx=0x7fa95402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4aa9e21684741c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:40.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.528+0000 7fa95effd640 1 -- 172.21.15.172:0/42548602 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954037070 con 0x7fa960071ac0 2024-04-25T08:50:40.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.528+0000 7fa95effd640 1 -- 172.21.15.172:0/42548602 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95402ae50 con 0x7fa960071ac0 2024-04-25T08:50:40.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.528+0000 7fa95effd640 1 -- 172.21.15.172:0/42548602 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954032660 con 0x7fa960071ac0 2024-04-25T08:50:40.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.528+0000 7fa9664e1640 1 -- 172.21.15.172:0/42548602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960071ac0 msgr2=0x7fa9600ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.528+0000 7fa9664e1640 1 --2- 172.21.15.172:0/42548602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960071ac0 0x7fa9600ad5e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fa9540097a0 tx=0x7fa95402a140 comp rx=0 tx=0).stop 2024-04-25T08:50:40.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.529+0000 7fa9664e1640 1 -- 172.21.15.172:0/42548602 shutdown_connections 2024-04-25T08:50:40.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.529+0000 7fa9664e1640 1 --2- 172.21.15.172:0/42548602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960071ac0 0x7fa9600ad5e0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.529+0000 7fa9664e1640 1 -- 172.21.15.172:0/42548602 >> 172.21.15.172:0/42548602 conn(0x7fa9600af670 msgr2=0x7fa9600b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:40.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.529+0000 7fa9664e1640 1 -- 172.21.15.172:0/42548602 shutdown_connections 2024-04-25T08:50:40.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.529+0000 7fa9664e1640 1 -- 172.21.15.172:0/42548602 wait complete. 2024-04-25T08:50:40.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.530+0000 7fa9664e1640 1 Processor -- start 2024-04-25T08:50:40.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.530+0000 7fa9664e1640 1 -- start start 2024-04-25T08:50:40.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa9664e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa960071ac0 0x7fa96015d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa9664e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960154ed0 0x7fa9601f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa9664e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa960150df0 0x7fa9601f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa9664e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96006b830 con 0x7fa960154ed0 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa9664e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96006b6b0 con 0x7fa960071ac0 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa9664e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96006b9b0 con 0x7fa960150df0 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960154ed0 0x7fa9601f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960154ed0 0x7fa9601f70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59186/0 (socket says 172.21.15.172:59186) 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95f7fe640 1 -- 172.21.15.172:0/3413481748 learned_addr learned my addr 172.21.15.172:0/3413481748 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95f7fe640 1 -- 172.21.15.172:0/3413481748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa960150df0 msgr2=0x7fa9601f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95f7fe640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa960150df0 0x7fa9601f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95f7fe640 1 -- 172.21.15.172:0/3413481748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa960071ac0 msgr2=0x7fa96015d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95f7fe640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa960071ac0 0x7fa96015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95f7fe640 1 -- 172.21.15.172:0/3413481748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9601f7f20 con 0x7fa960154ed0 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95f7fe640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960154ed0 0x7fa9601f70a0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fa9540097a0 tx=0x7fa9540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:40.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95cff9640 1 -- 172.21.15.172:0/3413481748 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954037040 con 0x7fa960154ed0 2024-04-25T08:50:40.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95cff9640 1 -- 172.21.15.172:0/3413481748 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa954004030 con 0x7fa960154ed0 2024-04-25T08:50:40.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa9664e1640 1 -- 172.21.15.172:0/3413481748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa960151370 con 0x7fa960154ed0 2024-04-25T08:50:40.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa95cff9640 1 -- 172.21.15.172:0/3413481748 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954006e10 con 0x7fa960154ed0 2024-04-25T08:50:40.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.531+0000 7fa9664e1640 1 -- 172.21.15.172:0/3413481748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa960151930 con 0x7fa960154ed0 2024-04-25T08:50:40.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.532+0000 7fa9664e1640 1 -- 172.21.15.172:0/3413481748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9600b2b10 con 0x7fa960154ed0 2024-04-25T08:50:40.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.533+0000 7fa95cff9640 1 -- 172.21.15.172:0/3413481748 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa95403d650 con 0x7fa960154ed0 2024-04-25T08:50:40.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.533+0000 7fa95cff9640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa94c06b4d0 0x7fa94c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.533+0000 7fa95cff9640 1 -- 172.21.15.172:0/3413481748 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa9540aab70 con 0x7fa960154ed0 2024-04-25T08:50:40.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.533+0000 7fa95ffff640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa94c06b4d0 0x7fa94c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.525 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.534+0000 7fa95ffff640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa94c06b4d0 0x7fa94c06d990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa950009650 tx=0x7fa950006ba0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:40.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.537+0000 7fa95cff9640 1 -- 172.21.15.172:0/3413481748 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa954042020 con 0x7fa960154ed0 2024-04-25T08:50:40.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.712+0000 7fa9664e1640 1 -- 172.21.15.172:0/3413481748 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa960073990 con 0x7fa960154ed0 2024-04-25T08:50:40.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.713+0000 7fa95cff9640 1 -- 172.21.15.172:0/3413481748 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17012 (secure 0 0 0) 0x7fa9540798f0 con 0x7fa960154ed0 2024-04-25T08:50:40.704 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:40.704 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":119,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:04.075355+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:00.630478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:01.391083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 -- 172.21.15.172:0/3413481748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa94c06b4d0 msgr2=0x7fa94c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa94c06b4d0 0x7fa94c06d990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa950009650 tx=0x7fa950006ba0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 -- 172.21.15.172:0/3413481748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960154ed0 msgr2=0x7fa9601f70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960154ed0 0x7fa9601f70a0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fa9540097a0 tx=0x7fa9540046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 -- 172.21.15.172:0/3413481748 shutdown_connections 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa94c06b4d0 0x7fa94c06d990 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa960150df0 0x7fa9601f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960154ed0 0x7fa9601f70a0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 --2- 172.21.15.172:0/3413481748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa960071ac0 0x7fa96015d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 -- 172.21.15.172:0/3413481748 >> 172.21.15.172:0/3413481748 conn(0x7fa96006c1d0 msgr2=0x7fa9600b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:40.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 -- 172.21.15.172:0/3413481748 shutdown_connections 2024-04-25T08:50:40.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.715+0000 7fa9664e1640 1 -- 172.21.15.172:0/3413481748 wait complete. 2024-04-25T08:50:40.717 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:50:40.717 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:40.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.824+0000 7faf60e9e640 1 Processor -- start 2024-04-25T08:50:40.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.824+0000 7faf60e9e640 1 -- start start 2024-04-25T08:50:40.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.825+0000 7faf60e9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faf5c15dc90 0x7faf5c1625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.825+0000 7faf60e9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0cc8e0 0x7faf5c15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.825+0000 7faf60e9e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c15f390 con 0x7faf5c0d1810 2024-04-25T08:50:40.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.825+0000 7faf60e9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c0cce50 con 0x7faf5c15dc90 2024-04-25T08:50:40.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.825+0000 7faf60e9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c161af0 con 0x7faf5c0cc8e0 2024-04-25T08:50:40.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.825+0000 7faf5a59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faf5c15dc90 0x7faf5c1625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.825+0000 7faf5ad9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7faf5c0d1810 0x7faf5c0cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33374/0 (socket says 172.21.15.172:33374) 2024-04-25T08:50:40.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.825+0000 7faf5a59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faf5c15dc90 0x7faf5c1625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59202/0 (socket says 172.21.15.172:59202) 2024-04-25T08:50:40.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.825+0000 7faf5ad9d640 1 -- 172.21.15.172:0/1643665222 learned_addr learned my addr 172.21.15.172:0/1643665222 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:40.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.825+0000 7faf59d9b640 1 --2- 172.21.15.172:0/1643665222 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0cc8e0 0x7faf5c15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.826+0000 7faf5a59c640 1 -- 172.21.15.172:0/1643665222 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0cc8e0 msgr2=0x7faf5c15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:40.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.826+0000 7faf5a59c640 1 --2- 172.21.15.172:0/1643665222 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0cc8e0 0x7faf5c15ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.826+0000 7faf5a59c640 1 -- 172.21.15.172:0/1643665222 >> v1:172.21.15.172:6789/0 conn(0x7faf5c0d1810 legacy=0x7faf5c0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.826+0000 7faf5a59c640 1 -- 172.21.15.172:0/1643665222 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c161dd0 con 0x7faf5c15dc90 2024-04-25T08:50:40.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.826+0000 7faf5959a640 1 -- 172.21.15.172:0/1643665222 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322132022 0 0) 0x7faf54001490 con 0x7faf5c0d1810 2024-04-25T08:50:40.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.826+0000 7faf5a59c640 1 --2- 172.21.15.172:0/1643665222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 0x7faf5c1625d0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0097a0 tx=0x7faf4c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6835ce552824d6b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.826+0000 7faf5959a640 1 -- 172.21.15.172:0/1643665222 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c037070 con 0x7faf5c15dc90 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.826+0000 7faf5959a640 1 -- 172.21.15.172:0/1643665222 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c02ae50 con 0x7faf5c15dc90 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.826+0000 7faf5959a640 1 -- 172.21.15.172:0/1643665222 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c032660 con 0x7faf5c15dc90 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.827+0000 7faf60e9e640 1 -- 172.21.15.172:0/1643665222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 msgr2=0x7faf5c1625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.827+0000 7faf60e9e640 1 --2- 172.21.15.172:0/1643665222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 0x7faf5c1625d0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0097a0 tx=0x7faf4c02a100 comp rx=0 tx=0).stop 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.827+0000 7faf60e9e640 1 -- 172.21.15.172:0/1643665222 shutdown_connections 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.827+0000 7faf60e9e640 1 --2- 172.21.15.172:0/1643665222 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0cc8e0 0x7faf5c15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.827+0000 7faf60e9e640 1 --2- 172.21.15.172:0/1643665222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 0x7faf5c1625d0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.827+0000 7faf60e9e640 1 -- 172.21.15.172:0/1643665222 >> 172.21.15.172:0/1643665222 conn(0x7faf5c06f590 msgr2=0x7faf5c06f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.827+0000 7faf60e9e640 1 -- 172.21.15.172:0/1643665222 shutdown_connections 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.827+0000 7faf60e9e640 1 -- 172.21.15.172:0/1643665222 wait complete. 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.828+0000 7faf60e9e640 1 Processor -- start 2024-04-25T08:50:40.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.828+0000 7faf60e9e640 1 -- start start 2024-04-25T08:50:40.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf60e9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf5c0cc8e0 0x7faf5c1f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf60e9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0d1810 0x7faf5c1f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf60e9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 0x7faf5c0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf60e9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c15e070 con 0x7faf5c15dc90 2024-04-25T08:50:40.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf60e9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0cd130 con 0x7faf5c0cc8e0 2024-04-25T08:50:40.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf60e9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c15e1f0 con 0x7faf5c0d1810 2024-04-25T08:50:40.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf5ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 0x7faf5c0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf5ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 0x7faf5c0cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59216/0 (socket says 172.21.15.172:59216) 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf5ad9d640 1 -- 172.21.15.172:0/774905653 learned_addr learned my addr 172.21.15.172:0/774905653 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf59d9b640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0d1810 0x7faf5c1f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf5a59c640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf5c0cc8e0 0x7faf5c1f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf5ad9d640 1 -- 172.21.15.172:0/774905653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0d1810 msgr2=0x7faf5c1f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf5ad9d640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0d1810 0x7faf5c1f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf5ad9d640 1 -- 172.21.15.172:0/774905653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf5c0cc8e0 msgr2=0x7faf5c1f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf5ad9d640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf5c0cc8e0 0x7faf5c1f5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf5ad9d640 1 -- 172.21.15.172:0/774905653 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0c8af0 con 0x7faf5c15dc90 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf59d9b640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0d1810 0x7faf5c1f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.829+0000 7faf5a59c640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf5c0cc8e0 0x7faf5c1f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.830+0000 7faf5ad9d640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 0x7faf5c0cad60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c6e0 tx=0x7faf5400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.830+0000 7faf4affd640 1 -- 172.21.15.172:0/774905653 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54018070 con 0x7faf5c15dc90 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.830+0000 7faf4affd640 1 -- 172.21.15.172:0/774905653 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf54004d80 con 0x7faf5c15dc90 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.830+0000 7faf60e9e640 1 -- 172.21.15.172:0/774905653 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c0c8dd0 con 0x7faf5c15dc90 2024-04-25T08:50:40.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.830+0000 7faf4affd640 1 -- 172.21.15.172:0/774905653 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5400a880 con 0x7faf5c15dc90 2024-04-25T08:50:40.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.830+0000 7faf60e9e640 1 -- 172.21.15.172:0/774905653 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c1f5740 con 0x7faf5c15dc90 2024-04-25T08:50:40.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.831+0000 7faf60e9e640 1 -- 172.21.15.172:0/774905653 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c073990 con 0x7faf5c15dc90 2024-04-25T08:50:40.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.831+0000 7faf4affd640 1 -- 172.21.15.172:0/774905653 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf5401b070 con 0x7faf5c15dc90 2024-04-25T08:50:40.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.832+0000 7faf4affd640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf3c06b4d0 0x7faf3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:40.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.832+0000 7faf4affd640 1 -- 172.21.15.172:0/774905653 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faf54089860 con 0x7faf5c15dc90 2024-04-25T08:50:40.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.832+0000 7faf5a59c640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf3c06b4d0 0x7faf3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:40.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.832+0000 7faf5a59c640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf3c06b4d0 0x7faf3c06d990 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7faf4c034000 tx=0x7faf4c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:40.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:40.836+0000 7faf4affd640 1 -- 172.21.15.172:0/774905653 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf5c15f390 con 0x7faf5c15dc90 2024-04-25T08:50:41.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.043+0000 7faf60e9e640 1 -- 172.21.15.172:0/774905653 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf5c0cf6b0 con 0x7faf5c15dc90 2024-04-25T08:50:41.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.043+0000 7faf4affd640 1 -- 172.21.15.172:0/774905653 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7faf540585e0 con 0x7faf5c15dc90 2024-04-25T08:50:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:41.034 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:41.034 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:41.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 -- 172.21.15.172:0/774905653 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf3c06b4d0 msgr2=0x7faf3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf3c06b4d0 0x7faf3c06d990 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7faf4c034000 tx=0x7faf4c02e000 comp rx=0 tx=0).stop 2024-04-25T08:50:41.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 -- 172.21.15.172:0/774905653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 msgr2=0x7faf5c0cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 0x7faf5c0cad60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c6e0 tx=0x7faf5400cba0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 -- 172.21.15.172:0/774905653 shutdown_connections 2024-04-25T08:50:41.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faf3c06b4d0 0x7faf3c06d990 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf5c15dc90 0x7faf5c0cad60 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf5c0d1810 0x7faf5c1f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 --2- 172.21.15.172:0/774905653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf5c0cc8e0 0x7faf5c1f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 -- 172.21.15.172:0/774905653 >> 172.21.15.172:0/774905653 conn(0x7faf5c06f590 msgr2=0x7faf5c15ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:41.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 -- 172.21.15.172:0/774905653 shutdown_connections 2024-04-25T08:50:41.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.045+0000 7faf60e9e640 1 -- 172.21.15.172:0/774905653 wait complete. 2024-04-25T08:50:41.047 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:41.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.154+0000 7fa58a390640 1 Processor -- start 2024-04-25T08:50:41.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.154+0000 7fa58a390640 1 -- start start 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.154+0000 7fa58a390640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa58406abe0 0x7fa58406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.154+0000 7fa58a390640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5840ce330 0x7fa58406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.154+0000 7fa58a390640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5841626e0 con 0x7fa5840700a0 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.154+0000 7fa58a390640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58406b500 con 0x7fa5840ce330 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.154+0000 7fa58a390640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5840cd270 con 0x7fa58406abe0 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.155+0000 7fa5837fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5840ce330 0x7fa58406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.155+0000 7fa5837fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5840ce330 0x7fa58406fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59232/0 (socket says 172.21.15.172:59232) 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.155+0000 7fa5837fe640 1 -- 172.21.15.172:0/2544108871 learned_addr learned my addr 172.21.15.172:0/2544108871 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.155+0000 7fa583fff640 1 --2- 172.21.15.172:0/2544108871 >> v2:172.21.15.186:3300/0 conn(0x7fa58406abe0 0x7fa58406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.155+0000 7fa5837fe640 1 -- 172.21.15.172:0/2544108871 >> v2:172.21.15.186:3300/0 conn(0x7fa58406abe0 msgr2=0x7fa58406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:41.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.155+0000 7fa5837fe640 1 --2- 172.21.15.172:0/2544108871 >> v2:172.21.15.186:3300/0 conn(0x7fa58406abe0 0x7fa58406afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.155+0000 7fa5837fe640 1 -- 172.21.15.172:0/2544108871 >> v1:172.21.15.186:6789/0 conn(0x7fa5840700a0 legacy=0x7fa58406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.155+0000 7fa5837fe640 1 -- 172.21.15.172:0/2544108871 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5840cd550 con 0x7fa5840ce330 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.155+0000 7fa583fff640 1 --2- 172.21.15.172:0/2544108871 >> v2:172.21.15.186:3300/0 conn(0x7fa58406abe0 0x7fa58406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa5837fe640 1 --2- 172.21.15.172:0/2544108871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5840ce330 0x7fa58406fb60 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fa58406e200 tx=0x7fa57802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcdd8926757393 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa582ffd640 1 -- 172.21.15.172:0/2544108871 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578037070 con 0x7fa5840ce330 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa582ffd640 1 -- 172.21.15.172:0/2544108871 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa578032440 con 0x7fa5840ce330 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa582ffd640 1 -- 172.21.15.172:0/2544108871 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578032810 con 0x7fa5840ce330 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa58a390640 1 -- 172.21.15.172:0/2544108871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5840ce330 msgr2=0x7fa58406fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa58a390640 1 --2- 172.21.15.172:0/2544108871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5840ce330 0x7fa58406fb60 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fa58406e200 tx=0x7fa57802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa58a390640 1 -- 172.21.15.172:0/2544108871 shutdown_connections 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa58a390640 1 --2- 172.21.15.172:0/2544108871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5840ce330 0x7fa58406fb60 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa58a390640 1 --2- 172.21.15.172:0/2544108871 >> v2:172.21.15.186:3300/0 conn(0x7fa58406abe0 0x7fa58406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa58a390640 1 -- 172.21.15.172:0/2544108871 >> 172.21.15.172:0/2544108871 conn(0x7fa5840b2220 msgr2=0x7fa5840b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:41.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa58a390640 1 -- 172.21.15.172:0/2544108871 shutdown_connections 2024-04-25T08:50:41.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.156+0000 7fa58a390640 1 -- 172.21.15.172:0/2544108871 wait complete. 2024-04-25T08:50:41.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.157+0000 7fa58a390640 1 Processor -- start 2024-04-25T08:50:41.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.158+0000 7fa58a390640 1 -- start start 2024-04-25T08:50:41.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.158+0000 7fa58a390640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa58406abe0 0x7fa58415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.158+0000 7fa58a390640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5840700a0 0x7fa5840b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.158+0000 7fa58a390640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5840ce330 0x7fa584158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.158+0000 7fa58a390640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584161780 con 0x7fa58406abe0 2024-04-25T08:50:41.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.158+0000 7fa58a390640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840cdb10 con 0x7fa5840700a0 2024-04-25T08:50:41.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.158+0000 7fa58a390640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58406eb00 con 0x7fa5840ce330 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.158+0000 7fa583fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa58406abe0 0x7fa58415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.158+0000 7fa583fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa58406abe0 0x7fa58415ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59242/0 (socket says 172.21.15.172:59242) 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.158+0000 7fa583fff640 1 -- 172.21.15.172:0/1182813438 learned_addr learned my addr 172.21.15.172:0/1182813438 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa5837fe640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5840700a0 0x7fa5840b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa58892d640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5840ce330 0x7fa584158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa583fff640 1 -- 172.21.15.172:0/1182813438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5840ce330 msgr2=0x7fa584158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa583fff640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5840ce330 0x7fa584158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa583fff640 1 -- 172.21.15.172:0/1182813438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5840700a0 msgr2=0x7fa5840b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa583fff640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5840700a0 0x7fa5840b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa583fff640 1 -- 172.21.15.172:0/1182813438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58415d380 con 0x7fa58406abe0 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa58892d640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5840ce330 0x7fa584158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa5837fe640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5840700a0 0x7fa5840b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa583fff640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa58406abe0 0x7fa58415ce40 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fa57400e810 tx=0x7fa57400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa580ff9640 1 -- 172.21.15.172:0/1182813438 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400f040 con 0x7fa58406abe0 2024-04-25T08:50:41.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa580ff9640 1 -- 172.21.15.172:0/1182813438 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574004030 con 0x7fa58406abe0 2024-04-25T08:50:41.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa58a390640 1 -- 172.21.15.172:0/1182813438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58415a7b0 con 0x7fa58406abe0 2024-04-25T08:50:41.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa580ff9640 1 -- 172.21.15.172:0/1182813438 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574004400 con 0x7fa58406abe0 2024-04-25T08:50:41.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.159+0000 7fa58a390640 1 -- 172.21.15.172:0/1182813438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58415ad70 con 0x7fa58406abe0 2024-04-25T08:50:41.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.160+0000 7fa58a390640 1 -- 172.21.15.172:0/1182813438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa584073990 con 0x7fa58406abe0 2024-04-25T08:50:41.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.161+0000 7fa580ff9640 1 -- 172.21.15.172:0/1182813438 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa57400c6d0 con 0x7fa58406abe0 2024-04-25T08:50:41.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.161+0000 7fa580ff9640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa57006b4d0 0x7fa57006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.161+0000 7fa580ff9640 1 -- 172.21.15.172:0/1182813438 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa57408a0b0 con 0x7fa58406abe0 2024-04-25T08:50:41.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.161+0000 7fa5837fe640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa57006b4d0 0x7fa57006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.162+0000 7fa5837fe640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa57006b4d0 0x7fa57006d990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa578034000 tx=0x7fa57802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:41.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.165+0000 7fa580ff9640 1 -- 172.21.15.172:0/1182813438 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa574017020 con 0x7fa58406abe0 2024-04-25T08:50:41.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.373+0000 7fa58a390640 1 -- 172.21.15.172:0/1182813438 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa584072580 con 0x7fa58406abe0 2024-04-25T08:50:41.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.373+0000 7fa580ff9640 1 -- 172.21.15.172:0/1182813438 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fa574058e30 con 0x7fa58406abe0 2024-04-25T08:50:41.364 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:41.364 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:02.459450+0000","modified":"2024-04-25T08:50:04.423512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8670},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8670":{"gid":8670,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3573637584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3573637584},{"type":"v1","addr":"172.21.15.172:6837","nonce":3573637584}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T08:50:41.364 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 68 2024-04-25T08:50:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 -- 172.21.15.172:0/1182813438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa57006b4d0 msgr2=0x7fa57006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa57006b4d0 0x7fa57006d990 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa578034000 tx=0x7fa57802e000 comp rx=0 tx=0).stop 2024-04-25T08:50:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 -- 172.21.15.172:0/1182813438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa58406abe0 msgr2=0x7fa58415ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa58406abe0 0x7fa58415ce40 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fa57400e810 tx=0x7fa57400ecd0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 -- 172.21.15.172:0/1182813438 shutdown_connections 2024-04-25T08:50:41.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa57006b4d0 0x7fa57006d990 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5840700a0 0x7fa5840b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5840ce330 0x7fa584158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 --2- 172.21.15.172:0/1182813438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa58406abe0 0x7fa58415ce40 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 -- 172.21.15.172:0/1182813438 >> 172.21.15.172:0/1182813438 conn(0x7fa5840b2220 msgr2=0x7fa58415ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:41.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.375+0000 7fa58a390640 1 -- 172.21.15.172:0/1182813438 shutdown_connections 2024-04-25T08:50:41.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.376+0000 7fa58a390640 1 -- 172.21.15.172:0/1182813438 wait complete. 2024-04-25T08:50:41.377 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:41.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.484+0000 7fab4e6fc640 1 Processor -- start 2024-04-25T08:50:41.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.484+0000 7fab4e6fc640 1 -- start start 2024-04-25T08:50:41.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab4e6fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fab48155fe0 0x7fab4815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab4e6fc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4806de40 con 0x7fab480adbc0 2024-04-25T08:50:41.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab4e6fc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab480ad0e0 con 0x7fab480721d0 2024-04-25T08:50:41.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab4e6fc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab480ad3c0 con 0x7fab48155fe0 2024-04-25T08:50:41.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab47fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fab48155fe0 0x7fab4815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab477fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fab480adbc0 0x7fab48071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33382/0 (socket says 172.21.15.172:33382) 2024-04-25T08:50:41.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab47fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fab48155fe0 0x7fab4815c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59254/0 (socket says 172.21.15.172:59254) 2024-04-25T08:50:41.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab477fe640 1 -- 172.21.15.172:0/2622799129 learned_addr learned my addr 172.21.15.172:0/2622799129 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:41.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab47fff640 1 -- 172.21.15.172:0/2622799129 >> v1:172.21.15.186:6789/0 conn(0x7fab480721d0 legacy=0x7fab4806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:41.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab47fff640 1 -- 172.21.15.172:0/2622799129 >> v1:172.21.15.172:6789/0 conn(0x7fab480adbc0 legacy=0x7fab48071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab46ffd640 1 -- 172.21.15.172:0/2622799129 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667810507 0 0) 0x7fab4806de40 con 0x7fab480adbc0 2024-04-25T08:50:41.477 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.485+0000 7fab47fff640 1 -- 172.21.15.172:0/2622799129 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab480ad6a0 con 0x7fab48155fe0 2024-04-25T08:50:41.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.486+0000 7fab47fff640 1 --2- 172.21.15.172:0/2622799129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48155fe0 0x7fab4815c9e0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fab380097a0 tx=0x7fab3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9588c01eb3d9cae4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:41.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.486+0000 7fab46ffd640 1 -- 172.21.15.172:0/2622799129 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38037070 con 0x7fab48155fe0 2024-04-25T08:50:41.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.486+0000 7fab46ffd640 1 -- 172.21.15.172:0/2622799129 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab38032440 con 0x7fab48155fe0 2024-04-25T08:50:41.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.486+0000 7fab46ffd640 1 -- 172.21.15.172:0/2622799129 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38032810 con 0x7fab48155fe0 2024-04-25T08:50:41.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.487+0000 7fab4e6fc640 1 -- 172.21.15.172:0/2622799129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48155fe0 msgr2=0x7fab4815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.487+0000 7fab4e6fc640 1 --2- 172.21.15.172:0/2622799129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48155fe0 0x7fab4815c9e0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fab380097a0 tx=0x7fab3802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.478 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.487+0000 7fab4e6fc640 1 -- 172.21.15.172:0/2622799129 shutdown_connections 2024-04-25T08:50:41.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.487+0000 7fab4e6fc640 1 --2- 172.21.15.172:0/2622799129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48155fe0 0x7fab4815c9e0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.487+0000 7fab4e6fc640 1 -- 172.21.15.172:0/2622799129 >> 172.21.15.172:0/2622799129 conn(0x7fab480af670 msgr2=0x7fab480b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:41.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.487+0000 7fab4e6fc640 1 -- 172.21.15.172:0/2622799129 shutdown_connections 2024-04-25T08:50:41.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.487+0000 7fab4e6fc640 1 -- 172.21.15.172:0/2622799129 wait complete. 2024-04-25T08:50:41.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.488+0000 7fab4e6fc640 1 Processor -- start 2024-04-25T08:50:41.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.488+0000 7fab4e6fc640 1 -- start start 2024-04-25T08:50:41.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4e6fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab480adbc0 0x7fab481565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.481 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4e6fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab48155fe0 0x7fab48156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4e6fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48157050 0x7fab48159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4e6fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4806fa00 con 0x7fab48157050 2024-04-25T08:50:41.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4e6fc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4806f880 con 0x7fab480adbc0 2024-04-25T08:50:41.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4e6fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab480ae050 con 0x7fab48155fe0 2024-04-25T08:50:41.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4cc99640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48157050 0x7fab48159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4cc99640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48157050 0x7fab48159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59264/0 (socket says 172.21.15.172:59264) 2024-04-25T08:50:41.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4cc99640 1 -- 172.21.15.172:0/1404629445 learned_addr learned my addr 172.21.15.172:0/1404629445 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:41.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab47fff640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab480adbc0 0x7fab481565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.482 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab477fe640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab48155fe0 0x7fab48156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4cc99640 1 -- 172.21.15.172:0/1404629445 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab48155fe0 msgr2=0x7fab48156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4cc99640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab48155fe0 0x7fab48156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4cc99640 1 -- 172.21.15.172:0/1404629445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab480adbc0 msgr2=0x7fab481565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4cc99640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab480adbc0 0x7fab481565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4cc99640 1 -- 172.21.15.172:0/1404629445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4809a600 con 0x7fab48157050 2024-04-25T08:50:41.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab47fff640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab480adbc0 0x7fab481565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:41.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab477fe640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab48155fe0 0x7fab48156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:41.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.489+0000 7fab4cc99640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48157050 0x7fab48159b90 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fab4000c780 tx=0x7fab4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:41.483 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.490+0000 7fab44ff9640 1 -- 172.21.15.172:0/1404629445 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40004b10 con 0x7fab48157050 2024-04-25T08:50:41.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.490+0000 7fab44ff9640 1 -- 172.21.15.172:0/1404629445 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40004cb0 con 0x7fab48157050 2024-04-25T08:50:41.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.490+0000 7fab4e6fc640 1 -- 172.21.15.172:0/1404629445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4809a8e0 con 0x7fab48157050 2024-04-25T08:50:41.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.490+0000 7fab44ff9640 1 -- 172.21.15.172:0/1404629445 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000aa90 con 0x7fab48157050 2024-04-25T08:50:41.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.490+0000 7fab4e6fc640 1 -- 172.21.15.172:0/1404629445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4814f000 con 0x7fab48157050 2024-04-25T08:50:41.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.491+0000 7fab4e6fc640 1 -- 172.21.15.172:0/1404629445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4806d9f0 con 0x7fab48157050 2024-04-25T08:50:41.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.491+0000 7fab44ff9640 1 -- 172.21.15.172:0/1404629445 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab4000ac30 con 0x7fab48157050 2024-04-25T08:50:41.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.491+0000 7fab44ff9640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab3406b4d0 0x7fab3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.492+0000 7fab44ff9640 1 -- 172.21.15.172:0/1404629445 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fab4008a610 con 0x7fab48157050 2024-04-25T08:50:41.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.492+0000 7fab47fff640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab3406b4d0 0x7fab3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.492+0000 7fab47fff640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab3406b4d0 0x7fab3406d990 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fab38034000 tx=0x7fab3802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:41.486 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.496+0000 7fab44ff9640 1 -- 172.21.15.172:0/1404629445 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab4806d9f0 con 0x7fab48157050 2024-04-25T08:50:41.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.668+0000 7fab4e6fc640 1 -- 172.21.15.172:0/1404629445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab48073990 con 0x7fab48157050 2024-04-25T08:50:41.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.669+0000 7fab44ff9640 1 -- 172.21.15.172:0/1404629445 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+17012 (secure 0 0 0) 0x7fab40020070 con 0x7fab48157050 2024-04-25T08:50:41.659 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:41.660 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":119,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:04.075355+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:00.630478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:01.391083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:41.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 -- 172.21.15.172:0/1404629445 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab3406b4d0 msgr2=0x7fab3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab3406b4d0 0x7fab3406d990 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fab38034000 tx=0x7fab3802e000 comp rx=0 tx=0).stop 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 -- 172.21.15.172:0/1404629445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48157050 msgr2=0x7fab48159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48157050 0x7fab48159b90 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fab4000c780 tx=0x7fab4000cc40 comp rx=0 tx=0).stop 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 -- 172.21.15.172:0/1404629445 shutdown_connections 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab3406b4d0 0x7fab3406d990 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab48157050 0x7fab48159b90 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab48155fe0 0x7fab48156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 --2- 172.21.15.172:0/1404629445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab480adbc0 0x7fab481565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 -- 172.21.15.172:0/1404629445 >> 172.21.15.172:0/1404629445 conn(0x7fab480721d0 msgr2=0x7fab480b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 -- 172.21.15.172:0/1404629445 shutdown_connections 2024-04-25T08:50:41.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.671+0000 7fab4e6fc640 1 -- 172.21.15.172:0/1404629445 wait complete. 2024-04-25T08:50:41.673 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:50:41.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.782+0000 7f43663e7640 1 Processor -- start 2024-04-25T08:50:41.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.782+0000 7f43663e7640 1 -- start start 2024-04-25T08:50:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.783+0000 7f43663e7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4360161710 0x7f43600d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.783+0000 7f43663e7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436015e000 con 0x7f436015dc20 2024-04-25T08:50:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.783+0000 7f43663e7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43600d1de0 con 0x7f43600ced80 2024-04-25T08:50:41.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.783+0000 7f43663e7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4360161c60 con 0x7f4360161710 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.783+0000 7f435ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f436015dc20 0x7f43600ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33392/0 (socket says 172.21.15.172:33392) 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.783+0000 7f435ffff640 1 -- 172.21.15.172:0/3372224617 learned_addr learned my addr 172.21.15.172:0/3372224617 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.783+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182709465 0 0) 0x7f436015e000 con 0x7f436015dc20 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.783+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4348003520 con 0x7f436015dc20 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.783+0000 7f4364984640 1 --2- 172.21.15.172:0/3372224617 >> v2:172.21.15.186:3300/0 conn(0x7f4360161710 0x7f43600d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.783+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1843827481 0 0) 0x7f4348003520 con 0x7f436015dc20 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 >> v2:172.21.15.186:3300/0 conn(0x7f4360161710 msgr2=0x7f43600d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 --2- 172.21.15.172:0/3372224617 >> v2:172.21.15.186:3300/0 conn(0x7f4360161710 0x7f43600d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 >> v1:172.21.15.186:6789/0 conn(0x7f43600ced80 legacy=0x7f43600d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4360161f40 con 0x7f436015dc20 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f4354001670 con 0x7f436015dc20 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 >> v1:172.21.15.172:6789/0 conn(0x7f436015dc20 legacy=0x7f43600ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43480039b0 0x7f4348003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4348004800 0x7f4348004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43480051c0 0x7f434800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4360161c60 con 0x7f43480051c0 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434800c060 con 0x7f43480039b0 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434800c260 con 0x7f4348004800 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f4364984640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43480051c0 0x7f434800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435ffff640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43480039b0 0x7f4348003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f435f7fe640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4348004800 0x7f4348004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f4364984640 1 -- 172.21.15.172:0/3372224617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4348004800 msgr2=0x7f4348004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f4364984640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4348004800 0x7f4348004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f4364984640 1 -- 172.21.15.172:0/3372224617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43480039b0 msgr2=0x7f4348003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f4364984640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43480039b0 0x7f4348003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.784+0000 7f4364984640 1 -- 172.21.15.172:0/3372224617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4348003520 con 0x7f43480051c0 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f4364984640 1 -- 172.21.15.172:0/3372224617 reap_dead start 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f4364984640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43480051c0 0x7f434800b9c0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f4358009fc0 tx=0x7f4348005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd1a217d08e94e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358035020 con 0x7f43480051c0 2024-04-25T08:50:41.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4358003b90 con 0x7f43480051c0 2024-04-25T08:50:41.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f435effd640 1 -- 172.21.15.172:0/3372224617 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358009c10 con 0x7f43480051c0 2024-04-25T08:50:41.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f43663e7640 1 -- 172.21.15.172:0/3372224617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43480051c0 msgr2=0x7f434800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f43663e7640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43480051c0 0x7f434800b9c0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f4358009fc0 tx=0x7f4348005830 comp rx=0 tx=0).stop 2024-04-25T08:50:41.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f43663e7640 1 -- 172.21.15.172:0/3372224617 shutdown_connections 2024-04-25T08:50:41.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f43663e7640 1 --2- 172.21.15.172:0/3372224617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43480051c0 0x7f434800b9c0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f43663e7640 1 -- 172.21.15.172:0/3372224617 >> 172.21.15.172:0/3372224617 conn(0x7f43600d0420 msgr2=0x7f43600d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:41.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f43663e7640 1 -- 172.21.15.172:0/3372224617 shutdown_connections 2024-04-25T08:50:41.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.785+0000 7f43663e7640 1 -- 172.21.15.172:0/3372224617 wait complete. 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.787+0000 7f43663e7640 1 Processor -- start 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.787+0000 7f43663e7640 1 -- start start 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.787+0000 7f43663e7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43480051c0 0x7f43601f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.787+0000 7f43663e7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4360155600 0x7f43601f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.787+0000 7f43663e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4360156e90 0x7f43600b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.787+0000 7f43663e7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43600b5e50 con 0x7f4360156e90 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.787+0000 7f43663e7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4360162500 con 0x7f43480051c0 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.787+0000 7f43663e7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43600b5fd0 con 0x7f4360155600 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f4364984640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4360156e90 0x7f43600b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f4364984640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4360156e90 0x7f43600b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59282/0 (socket says 172.21.15.172:59282) 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f4364984640 1 -- 172.21.15.172:0/3573054191 learned_addr learned my addr 172.21.15.172:0/3573054191 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f435ffff640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43480051c0 0x7f43601f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f435f7fe640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4360155600 0x7f43601f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f4364984640 1 -- 172.21.15.172:0/3573054191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4360155600 msgr2=0x7f43601f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f4364984640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4360155600 0x7f43601f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f4364984640 1 -- 172.21.15.172:0/3573054191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43480051c0 msgr2=0x7f43601f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f4364984640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43480051c0 0x7f43601f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f4364984640 1 -- 172.21.15.172:0/3573054191 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4360155bc0 con 0x7f4360156e90 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f4364984640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4360156e90 0x7f43600b6bd0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f435802af10 tx=0x7f4358009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f435cff9640 1 -- 172.21.15.172:0/3573054191 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435803f030 con 0x7f4360156e90 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f435cff9640 1 -- 172.21.15.172:0/3573054191 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4358003990 con 0x7f4360156e90 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f43663e7640 1 -- 172.21.15.172:0/3573054191 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4360155ea0 con 0x7f4360156e90 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f435cff9640 1 -- 172.21.15.172:0/3573054191 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358035070 con 0x7f4360156e90 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.788+0000 7f43663e7640 1 -- 172.21.15.172:0/3573054191 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436015f300 con 0x7f4360156e90 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.789+0000 7f43663e7640 1 -- 172.21.15.172:0/3573054191 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4360073a00 con 0x7f4360156e90 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.790+0000 7f435cff9640 1 -- 172.21.15.172:0/3573054191 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4358042030 con 0x7f4360156e90 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.790+0000 7f435cff9640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f434c06b500 0x7f434c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:41.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.790+0000 7f435cff9640 1 -- 172.21.15.172:0/3573054191 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f43580aab30 con 0x7f4360156e90 2024-04-25T08:50:41.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.790+0000 7f435ffff640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f434c06b500 0x7f434c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:41.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.791+0000 7f435ffff640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f434c06b500 0x7f434c06d9c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4354001050 tx=0x7f4354009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:41.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:41.794+0000 7f435cff9640 1 -- 172.21.15.172:0/3573054191 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4358079260 con 0x7f4360156e90 2024-04-25T08:50:41.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.002+0000 7f43663e7640 1 -- 172.21.15.172:0/3573054191 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f436015f4d0 con 0x7f4360156e90 2024-04-25T08:50:41.993 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:50:42.003+0000 7f9412b2f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:50:41.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.004+0000 7f435cff9640 1 -- 172.21.15.172:0/3573054191 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7f435807d300 con 0x7f4360156e90 2024-04-25T08:50:41.994 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:50:41.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 -- 172.21.15.172:0/3573054191 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f434c06b500 msgr2=0x7f434c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f434c06b500 0x7f434c06d9c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4354001050 tx=0x7f4354009040 comp rx=0 tx=0).stop 2024-04-25T08:50:41.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 -- 172.21.15.172:0/3573054191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4360156e90 msgr2=0x7f43600b6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:41.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4360156e90 0x7f43600b6bd0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f435802af10 tx=0x7f4358009750 comp rx=0 tx=0).stop 2024-04-25T08:50:41.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 -- 172.21.15.172:0/3573054191 shutdown_connections 2024-04-25T08:50:41.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f434c06b500 0x7f434c06d9c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4360156e90 0x7f43600b6bd0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4360155600 0x7f43601f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 --2- 172.21.15.172:0/3573054191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f43480051c0 0x7f43601f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:41.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 -- 172.21.15.172:0/3573054191 >> 172.21.15.172:0/3573054191 conn(0x7f43600d0420 msgr2=0x7f436006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:41.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 -- 172.21.15.172:0/3573054191 shutdown_connections 2024-04-25T08:50:41.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.007+0000 7f43663e7640 1 -- 172.21.15.172:0/3573054191 wait complete. 2024-04-25T08:50:42.010 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:50:42.035 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:50:42.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.121+0000 7f40ab007640 1 Processor -- start 2024-04-25T08:50:42.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.122+0000 7f40ab007640 1 -- start start 2024-04-25T08:50:42.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.122+0000 7f40ab007640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a415dc20 0x7f40a40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:42.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.122+0000 7f40ab007640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f40a40d32f0 0x7f40a40cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:42.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.122+0000 7f40ab007640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a415e000 con 0x7f40a4161710 2024-04-25T08:50:42.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.122+0000 7f40ab007640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a40d1de0 con 0x7f40a40d32f0 2024-04-25T08:50:42.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.122+0000 7f40ab007640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a4161c60 con 0x7f40a415dc20 2024-04-25T08:50:42.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.122+0000 7f40a95a4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f40a40d32f0 0x7f40a40cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:42.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.122+0000 7f40a3fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f40a4161710 0x7f40a406bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33402/0 (socket says 172.21.15.172:33402) 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.122+0000 7f40a95a4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f40a40d32f0 0x7f40a40cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59298/0 (socket says 172.21.15.172:59298) 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.122+0000 7f40a3fff640 1 -- 172.21.15.172:0/2927997196 learned_addr learned my addr 172.21.15.172:0/2927997196 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.123+0000 7f40a8da3640 1 --2- 172.21.15.172:0/2927997196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a415dc20 0x7f40a40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.123+0000 7f40a95a4640 1 -- 172.21.15.172:0/2927997196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a415dc20 msgr2=0x7f40a40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.123+0000 7f40a95a4640 1 --2- 172.21.15.172:0/2927997196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a415dc20 0x7f40a40ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.123+0000 7f40a95a4640 1 -- 172.21.15.172:0/2927997196 >> v1:172.21.15.172:6789/0 conn(0x7f40a4161710 legacy=0x7f40a406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.123+0000 7f40a95a4640 1 -- 172.21.15.172:0/2927997196 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a4161f40 con 0x7f40a40d32f0 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.123+0000 7f40a37fe640 1 -- 172.21.15.172:0/2927997196 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060710478 0 0) 0x7f40a415e000 con 0x7f40a4161710 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.123+0000 7f40a95a4640 1 --2- 172.21.15.172:0/2927997196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 0x7f40a40cebb0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f409c009d90 tx=0x7f409c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89042d54be9aec9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40a37fe640 1 -- 172.21.15.172:0/2927997196 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c007740 con 0x7f40a40d32f0 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40a37fe640 1 -- 172.21.15.172:0/2927997196 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c0078e0 con 0x7f40a40d32f0 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40a37fe640 1 -- 172.21.15.172:0/2927997196 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c007cb0 con 0x7f40a40d32f0 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40ab007640 1 -- 172.21.15.172:0/2927997196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 msgr2=0x7f40a40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:42.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40ab007640 1 --2- 172.21.15.172:0/2927997196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 0x7f40a40cebb0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f409c009d90 tx=0x7f409c02a660 comp rx=0 tx=0).stop 2024-04-25T08:50:42.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40ab007640 1 -- 172.21.15.172:0/2927997196 shutdown_connections 2024-04-25T08:50:42.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40ab007640 1 --2- 172.21.15.172:0/2927997196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 0x7f40a40cebb0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:42.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40ab007640 1 --2- 172.21.15.172:0/2927997196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a415dc20 0x7f40a40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:42.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40ab007640 1 -- 172.21.15.172:0/2927997196 >> 172.21.15.172:0/2927997196 conn(0x7f40a40d0420 msgr2=0x7f40a40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:42.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40ab007640 1 -- 172.21.15.172:0/2927997196 shutdown_connections 2024-04-25T08:50:42.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.124+0000 7f40ab007640 1 -- 172.21.15.172:0/2927997196 wait complete. 2024-04-25T08:50:42.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.125+0000 7f40ab007640 1 Processor -- start 2024-04-25T08:50:42.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.125+0000 7f40ab007640 1 -- start start 2024-04-25T08:50:42.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.126+0000 7f40ab007640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 0x7f40a4156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:42.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.126+0000 7f40ab007640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40a415dc20 0x7f40a40cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:42.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.126+0000 7f40ab007640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a4161710 0x7f40a40ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:42.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.126+0000 7f40ab007640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40b5e50 con 0x7f40a40d32f0 2024-04-25T08:50:42.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.126+0000 7f40ab007640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a4162500 con 0x7f40a415dc20 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.126+0000 7f40ab007640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40b5fd0 con 0x7f40a4161710 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.126+0000 7f40a8da3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 0x7f40a4156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.126+0000 7f40a8da3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 0x7f40a4156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59302/0 (socket says 172.21.15.172:59302) 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.126+0000 7f40a8da3640 1 -- 172.21.15.172:0/2439760299 learned_addr learned my addr 172.21.15.172:0/2439760299 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a8da3640 1 -- 172.21.15.172:0/2439760299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a4161710 msgr2=0x7f40a40ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a95a4640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a4161710 0x7f40a40ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a3fff640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40a415dc20 0x7f40a40cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a8da3640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a4161710 0x7f40a40ac340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a8da3640 1 -- 172.21.15.172:0/2439760299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40a415dc20 msgr2=0x7f40a40cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a8da3640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40a415dc20 0x7f40a40cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a8da3640 1 -- 172.21.15.172:0/2439760299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a4156750 con 0x7f40a40d32f0 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a95a4640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a4161710 0x7f40a40ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:42.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a3fff640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40a415dc20 0x7f40a40cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a8da3640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 0x7f40a4156210 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f409400d5f0 tx=0x7f409400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a17fa640 1 -- 172.21.15.172:0/2439760299 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940125f0 con 0x7f40a40d32f0 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a17fa640 1 -- 172.21.15.172:0/2439760299 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4094019070 con 0x7f40a40d32f0 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40ab007640 1 -- 172.21.15.172:0/2439760299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a4160070 con 0x7f40a40d32f0 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40a17fa640 1 -- 172.21.15.172:0/2439760299 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940129d0 con 0x7f40a40d32f0 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.127+0000 7f40ab007640 1 -- 172.21.15.172:0/2439760299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a4160630 con 0x7f40a40d32f0 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.128+0000 7f40ab007640 1 -- 172.21.15.172:0/2439760299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a4073a00 con 0x7f40a40d32f0 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.128+0000 7f40a17fa640 1 -- 172.21.15.172:0/2439760299 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4094012b70 con 0x7f40a40d32f0 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.129+0000 7f40a17fa640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 0x7f408406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.129+0000 7f40a17fa640 1 -- 172.21.15.172:0/2439760299 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f409408a7f0 con 0x7f40a40d32f0 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.129+0000 7f40a3fff640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 0x7f408406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:42.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.129+0000 7f40a3fff640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 0x7f408406d990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f408c000f60 tx=0x7f408c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:42.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.133+0000 7f40a17fa640 1 -- 172.21.15.172:0/2439760299 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f40a4156750 con 0x7f40a40d32f0 2024-04-25T08:50:42.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:42.343+0000 7f40ab007640 1 -- 172.21.15.172:0/2439760299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f40a40d16b0 con 0x7f40a40d32f0 2024-04-25T08:50:42.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.005+0000 7f40a17fa640 1 -- 172.21.15.172:0/2439760299 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4094059490 con 0x7f40a40d32f0 2024-04-25T08:50:42.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.007+0000 7f40ab007640 1 -- 172.21.15.172:0/2439760299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 msgr2=0x7f408406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:42.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.007+0000 7f40ab007640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 0x7f408406d990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f408c000f60 tx=0x7f408c009040 comp rx=0 tx=0).stop 2024-04-25T08:50:42.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.007+0000 7f40ab007640 1 -- 172.21.15.172:0/2439760299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 msgr2=0x7f40a4156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:42.998 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.007+0000 7f40ab007640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 0x7f40a4156210 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f409400d5f0 tx=0x7f409400dab0 comp rx=0 tx=0).stop 2024-04-25T08:50:42.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.007+0000 7f40ab007640 1 -- 172.21.15.172:0/2439760299 shutdown_connections 2024-04-25T08:50:42.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.007+0000 7f40ab007640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 0x7f408406d990 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:42.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.007+0000 7f40ab007640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40a415dc20 0x7f40a40cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:42.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.007+0000 7f40ab007640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40a4161710 0x7f40a40ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:42.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.007+0000 7f40ab007640 1 --2- 172.21.15.172:0/2439760299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40a40d32f0 0x7f40a4156210 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:42.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.008+0000 7f40ab007640 1 -- 172.21.15.172:0/2439760299 >> 172.21.15.172:0/2439760299 conn(0x7f40a40d0420 msgr2=0x7f40a40b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:42.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.008+0000 7f40ab007640 1 -- 172.21.15.172:0/2439760299 shutdown_connections 2024-04-25T08:50:42.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.008+0000 7f40ab007640 1 -- 172.21.15.172:0/2439760299 wait complete. 2024-04-25T08:50:43.011 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:50:43.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.166+0000 7f2e88b69640 1 Processor -- start 2024-04-25T08:50:43.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.166+0000 7f2e88b69640 1 -- start start 2024-04-25T08:50:43.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.167+0000 7f2e88b69640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e8415a9f0 0x7f2e840c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:43.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.167+0000 7f2e88b69640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2e840cdbf0 0x7f2e840ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:43.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.167+0000 7f2e88b69640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e840c6940 con 0x7f2e840cd520 2024-04-25T08:50:43.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.167+0000 7f2e88b69640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e840b0020 con 0x7f2e840cdbf0 2024-04-25T08:50:43.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.167+0000 7f2e88b69640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840cb5a0 con 0x7f2e8415a9f0 2024-04-25T08:50:43.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.168+0000 7f2e81d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2e840cdbf0 0x7f2e840ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:43.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.168+0000 7f2e82d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2e840cd520 0x7f2e840ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33418/0 (socket says 172.21.15.172:33418) 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.168+0000 7f2e82d9d640 1 -- 172.21.15.172:0/2013290258 learned_addr learned my addr 172.21.15.172:0/2013290258 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.168+0000 7f2e8259c640 1 --2- 172.21.15.172:0/2013290258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e8415a9f0 0x7f2e840c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.168+0000 7f2e81d9b640 1 -- 172.21.15.172:0/2013290258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e8415a9f0 msgr2=0x7f2e840c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.168+0000 7f2e81d9b640 1 --2- 172.21.15.172:0/2013290258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e8415a9f0 0x7f2e840c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.168+0000 7f2e81d9b640 1 -- 172.21.15.172:0/2013290258 >> v1:172.21.15.172:6789/0 conn(0x7f2e840cd520 legacy=0x7f2e840ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.168+0000 7f2e8159a640 1 -- 172.21.15.172:0/2013290258 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866950300 0 0) 0x7f2e7c001110 con 0x7f2e840cd520 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.168+0000 7f2e81d9b640 1 -- 172.21.15.172:0/2013290258 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8415add0 con 0x7f2e840cdbf0 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.168+0000 7f2e8259c640 1 --2- 172.21.15.172:0/2013290258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e8415a9f0 0x7f2e840c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e81d9b640 1 --2- 172.21.15.172:0/2013290258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cdbf0 0x7f2e840ccfe0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800ba40 tx=0x7f2e7802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8193d1a81905e305 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e8159a640 1 -- 172.21.15.172:0/2013290258 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e78032750 con 0x7f2e840cdbf0 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e8159a640 1 -- 172.21.15.172:0/2013290258 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e78030050 con 0x7f2e840cdbf0 2024-04-25T08:50:43.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e8159a640 1 -- 172.21.15.172:0/2013290258 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e78032b10 con 0x7f2e840cdbf0 2024-04-25T08:50:43.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e88b69640 1 -- 172.21.15.172:0/2013290258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cdbf0 msgr2=0x7f2e840ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:43.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e88b69640 1 --2- 172.21.15.172:0/2013290258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cdbf0 0x7f2e840ccfe0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800ba40 tx=0x7f2e7802c850 comp rx=0 tx=0).stop 2024-04-25T08:50:43.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e88b69640 1 -- 172.21.15.172:0/2013290258 shutdown_connections 2024-04-25T08:50:43.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e88b69640 1 --2- 172.21.15.172:0/2013290258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cdbf0 0x7f2e840ccfe0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:43.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e88b69640 1 --2- 172.21.15.172:0/2013290258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e8415a9f0 0x7f2e840c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:43.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e88b69640 1 -- 172.21.15.172:0/2013290258 >> 172.21.15.172:0/2013290258 conn(0x7f2e840b2390 msgr2=0x7f2e840b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:43.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e88b69640 1 -- 172.21.15.172:0/2013290258 shutdown_connections 2024-04-25T08:50:43.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.169+0000 7f2e88b69640 1 -- 172.21.15.172:0/2013290258 wait complete. 2024-04-25T08:50:43.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.171+0000 7f2e88b69640 1 Processor -- start 2024-04-25T08:50:43.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.171+0000 7f2e88b69640 1 -- start start 2024-04-25T08:50:43.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.171+0000 7f2e88b69640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cd520 0x7f2e84153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.171+0000 7f2e88b69640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e840cdbf0 0x7f2e840ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.171+0000 7f2e88b69640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e8415a9f0 0x7f2e84158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.171+0000 7f2e88b69640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840cb230 con 0x7f2e840cd520 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.171+0000 7f2e88b69640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840caf50 con 0x7f2e8415a9f0 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.171+0000 7f2e88b69640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840ce070 con 0x7f2e840cdbf0 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e8259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cd520 0x7f2e84153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e8259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cd520 0x7f2e84153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59322/0 (socket says 172.21.15.172:59322) 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e8259c640 1 -- 172.21.15.172:0/3247335344 learned_addr learned my addr 172.21.15.172:0/3247335344 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e81d9b640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e840cdbf0 0x7f2e840ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e82d9d640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e8415a9f0 0x7f2e84158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e8259c640 1 -- 172.21.15.172:0/3247335344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e840cdbf0 msgr2=0x7f2e840ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e8259c640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e840cdbf0 0x7f2e840ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e8259c640 1 -- 172.21.15.172:0/3247335344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e8415a9f0 msgr2=0x7f2e84158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:43.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e8259c640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e8415a9f0 0x7f2e84158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e8259c640 1 -- 172.21.15.172:0/3247335344 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e840aed70 con 0x7f2e840cd520 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e8259c640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cd520 0x7f2e84153170 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400ce00 tx=0x7f2e7400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e72ffd640 1 -- 172.21.15.172:0/3247335344 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400f890 con 0x7f2e840cd520 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e72ffd640 1 -- 172.21.15.172:0/3247335344 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7400fa30 con 0x7f2e840cd520 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e88b69640 1 -- 172.21.15.172:0/3247335344 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e840af050 con 0x7f2e840cd520 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e72ffd640 1 -- 172.21.15.172:0/3247335344 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400fe40 con 0x7f2e840cd520 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.172+0000 7f2e88b69640 1 -- 172.21.15.172:0/3247335344 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e840af610 con 0x7f2e840cd520 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.173+0000 7f2e88b69640 1 -- 172.21.15.172:0/3247335344 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8406cc80 con 0x7f2e840cd520 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.174+0000 7f2e72ffd640 1 -- 172.21.15.172:0/3247335344 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2e74018400 con 0x7f2e840cd520 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.174+0000 7f2e72ffd640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e6406b4d0 0x7f2e6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.174+0000 7f2e72ffd640 1 -- 172.21.15.172:0/3247335344 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2e7408b090 con 0x7f2e840cd520 2024-04-25T08:50:43.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.174+0000 7f2e81d9b640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e6406b4d0 0x7f2e6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:43.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.175+0000 7f2e81d9b640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e6406b4d0 0x7f2e6406d990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2e78037000 tx=0x7f2e78032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:43.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.178+0000 7f2e72ffd640 1 -- 172.21.15.172:0/3247335344 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e74014030 con 0x7f2e840cd520 2024-04-25T08:50:43.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:43.350+0000 7f2e88b69640 1 -- 172.21.15.172:0/3247335344 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2e84073a00 con 0x7f2e840cd520 2024-04-25T08:50:43.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.006+0000 7f2e72ffd640 1 -- 172.21.15.172:0/3247335344 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v121) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2e7400ae20 con 0x7f2e840cd520 2024-04-25T08:50:43.997 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.009+0000 7f2e88b69640 1 -- 172.21.15.172:0/3247335344 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e6406b4d0 msgr2=0x7f2e6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.009+0000 7f2e88b69640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e6406b4d0 0x7f2e6406d990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2e78037000 tx=0x7f2e78032000 comp rx=0 tx=0).stop 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.010+0000 7f2e88b69640 1 -- 172.21.15.172:0/3247335344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cd520 msgr2=0x7f2e84153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.010+0000 7f2e88b69640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cd520 0x7f2e84153170 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400ce00 tx=0x7f2e7400a650 comp rx=0 tx=0).stop 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.010+0000 7f2e88b69640 1 -- 172.21.15.172:0/3247335344 shutdown_connections 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.010+0000 7f2e88b69640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2e6406b4d0 0x7f2e6406d990 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.010+0000 7f2e88b69640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2e8415a9f0 0x7f2e84158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.010+0000 7f2e88b69640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2e840cdbf0 0x7f2e840ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.010+0000 7f2e88b69640 1 --2- 172.21.15.172:0/3247335344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e840cd520 0x7f2e84153170 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.010+0000 7f2e88b69640 1 -- 172.21.15.172:0/3247335344 >> 172.21.15.172:0/3247335344 conn(0x7f2e840b2390 msgr2=0x7f2e840ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.010+0000 7f2e88b69640 1 -- 172.21.15.172:0/3247335344 shutdown_connections 2024-04-25T08:50:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.010+0000 7f2e88b69640 1 -- 172.21.15.172:0/3247335344 wait complete. 2024-04-25T08:50:44.014 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:50:44.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.125+0000 7f5b176f5640 1 Processor -- start 2024-04-25T08:50:44.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.126+0000 7f5b176f5640 1 -- start start 2024-04-25T08:50:44.117 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.126+0000 7f5b176f5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5b101454a0 0x7f5b100aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:44.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.127+0000 7f5b176f5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100af540 con 0x7f5b1015c970 2024-04-25T08:50:44.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.127+0000 7f5b176f5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100af820 con 0x7f5b1006b2f0 2024-04-25T08:50:44.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.127+0000 7f5b176f5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b100afb00 con 0x7f5b101454a0 2024-04-25T08:50:44.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.127+0000 7f5b15491640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5b101454a0 0x7f5b100aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:44.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.127+0000 7f5b15491640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5b101454a0 0x7f5b100aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59332/0 (socket says 172.21.15.172:59332) 2024-04-25T08:50:44.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.127+0000 7f5b15491640 1 -- 172.21.15.172:0/3590930470 learned_addr learned my addr 172.21.15.172:0/3590930470 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:44.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.127+0000 7f5b15491640 1 -- 172.21.15.172:0/3590930470 >> v1:172.21.15.186:6789/0 conn(0x7f5b1006b2f0 legacy=0x7f5b1015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:44.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.127+0000 7f5b15491640 1 -- 172.21.15.172:0/3590930470 >> v1:172.21.15.172:6789/0 conn(0x7f5b1015c970 legacy=0x7f5b1006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:44.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.127+0000 7f5b15491640 1 -- 172.21.15.172:0/3590930470 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100afde0 con 0x7f5b101454a0 2024-04-25T08:50:44.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b15491640 1 --2- 172.21.15.172:0/3590930470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b101454a0 0x7f5b100aee60 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009e50 tx=0x7f5b0c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbf5857b984f094 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:44.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b07fff640 1 -- 172.21.15.172:0/3590930470 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c036070 con 0x7f5b101454a0 2024-04-25T08:50:44.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b07fff640 1 -- 172.21.15.172:0/3590930470 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c031600 con 0x7f5b101454a0 2024-04-25T08:50:44.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b07fff640 1 -- 172.21.15.172:0/3590930470 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0319d0 con 0x7f5b101454a0 2024-04-25T08:50:44.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b176f5640 1 -- 172.21.15.172:0/3590930470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b101454a0 msgr2=0x7f5b100aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:44.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b176f5640 1 --2- 172.21.15.172:0/3590930470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b101454a0 0x7f5b100aee60 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009e50 tx=0x7f5b0c02a760 comp rx=0 tx=0).stop 2024-04-25T08:50:44.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b176f5640 1 -- 172.21.15.172:0/3590930470 shutdown_connections 2024-04-25T08:50:44.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b176f5640 1 --2- 172.21.15.172:0/3590930470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b101454a0 0x7f5b100aee60 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:44.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b176f5640 1 -- 172.21.15.172:0/3590930470 >> 172.21.15.172:0/3590930470 conn(0x7f5b100b5af0 msgr2=0x7f5b100b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:44.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b176f5640 1 -- 172.21.15.172:0/3590930470 shutdown_connections 2024-04-25T08:50:44.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.128+0000 7f5b176f5640 1 -- 172.21.15.172:0/3590930470 wait complete. 2024-04-25T08:50:44.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.130+0000 7f5b176f5640 1 Processor -- start 2024-04-25T08:50:44.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.130+0000 7f5b176f5640 1 -- start start 2024-04-25T08:50:44.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.130+0000 7f5b176f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b1006b2f0 0x7f5b1013e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:44.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.130+0000 7f5b176f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b101454a0 0x7f5b101f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:44.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.130+0000 7f5b176f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b1015c970 0x7f5b101f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:44.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.130+0000 7f5b176f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1015dd20 con 0x7f5b1015c970 2024-04-25T08:50:44.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.130+0000 7f5b176f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1015dba0 con 0x7f5b1006b2f0 2024-04-25T08:50:44.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.130+0000 7f5b176f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1015dea0 con 0x7f5b101454a0 2024-04-25T08:50:44.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.130+0000 7f5b15c92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b1015c970 0x7f5b101f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.130+0000 7f5b15c92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b1015c970 0x7f5b101f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59346/0 (socket says 172.21.15.172:59346) 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b15c92640 1 -- 172.21.15.172:0/3686814116 learned_addr learned my addr 172.21.15.172:0/3686814116 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b15491640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b1006b2f0 0x7f5b1013e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b15c92640 1 -- 172.21.15.172:0/3686814116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b101454a0 msgr2=0x7f5b101f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b14c90640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b101454a0 0x7f5b101f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b15c92640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b101454a0 0x7f5b101f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b15c92640 1 -- 172.21.15.172:0/3686814116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b1006b2f0 msgr2=0x7f5b1013e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b15c92640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b1006b2f0 0x7f5b1013e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b15c92640 1 -- 172.21.15.172:0/3686814116 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10141bf0 con 0x7f5b1015c970 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b15491640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b1006b2f0 0x7f5b1013e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b14c90640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b101454a0 0x7f5b101f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b15c92640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b1015c970 0x7f5b101f5360 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c410 tx=0x7f5b0800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b05ffb640 1 -- 172.21.15.172:0/3686814116 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08011790 con 0x7f5b1015c970 2024-04-25T08:50:44.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b05ffb640 1 -- 172.21.15.172:0/3686814116 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b08017070 con 0x7f5b1015c970 2024-04-25T08:50:44.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b176f5640 1 -- 172.21.15.172:0/3686814116 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1013e7f0 con 0x7f5b1015c970 2024-04-25T08:50:44.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b05ffb640 1 -- 172.21.15.172:0/3686814116 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08011bb0 con 0x7f5b1015c970 2024-04-25T08:50:44.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.131+0000 7f5b176f5640 1 -- 172.21.15.172:0/3686814116 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b100cdcc0 con 0x7f5b1015c970 2024-04-25T08:50:44.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.132+0000 7f5b176f5640 1 -- 172.21.15.172:0/3686814116 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1006cc80 con 0x7f5b1015c970 2024-04-25T08:50:44.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.133+0000 7f5b05ffb640 1 -- 172.21.15.172:0/3686814116 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b0801c460 con 0x7f5b1015c970 2024-04-25T08:50:44.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.133+0000 7f5b05ffb640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5af406b4d0 0x7f5af406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:44.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.133+0000 7f5b05ffb640 1 -- 172.21.15.172:0/3686814116 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5749+0+0 (secure 0 0 0) 0x7f5b08089f50 con 0x7f5b1015c970 2024-04-25T08:50:44.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.133+0000 7f5b15491640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5af406b4d0 0x7f5af406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:44.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.134+0000 7f5b15491640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5af406b4d0 0x7f5af406d990 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c033000 tx=0x7f5b0c009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:44.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.137+0000 7f5b05ffb640 1 -- 172.21.15.172:0/3686814116 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b08058ef0 con 0x7f5b1015c970 2024-04-25T08:50:44.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:44.310+0000 7f5b176f5640 1 -- 172.21.15.172:0/3686814116 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5b10073a00 con 0x7f5b1015c970 2024-04-25T08:50:44.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.008+0000 7f5b05ffb640 1 -- 172.21.15.172:0/3686814116 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v122) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5b080587f0 con 0x7f5b1015c970 2024-04-25T08:50:44.999 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 -- 172.21.15.172:0/3686814116 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5af406b4d0 msgr2=0x7f5af406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5af406b4d0 0x7f5af406d990 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c033000 tx=0x7f5b0c009000 comp rx=0 tx=0).stop 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 -- 172.21.15.172:0/3686814116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b1015c970 msgr2=0x7f5b101f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b1015c970 0x7f5b101f5360 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c410 tx=0x7f5b0800c810 comp rx=0 tx=0).stop 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 -- 172.21.15.172:0/3686814116 shutdown_connections 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5af406b4d0 0x7f5af406d990 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b1015c970 0x7f5b101f5360 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b101454a0 0x7f5b101f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 --2- 172.21.15.172:0/3686814116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b1006b2f0 0x7f5b1013e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 -- 172.21.15.172:0/3686814116 >> 172.21.15.172:0/3686814116 conn(0x7f5b100b5af0 msgr2=0x7f5b1015e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:45.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 -- 172.21.15.172:0/3686814116 shutdown_connections 2024-04-25T08:50:45.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.012+0000 7f5b176f5640 1 -- 172.21.15.172:0/3686814116 wait complete. 2024-04-25T08:50:45.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:50:45.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.167+0000 7fe6be6fc640 1 Processor -- start 2024-04-25T08:50:45.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.167+0000 7fe6be6fc640 1 -- start start 2024-04-25T08:50:45.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.168+0000 7fe6be6fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe6b8161710 0x7fe6b80d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.168+0000 7fe6be6fc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b815e000 con 0x7fe6b815dc20 2024-04-25T08:50:45.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.168+0000 7fe6be6fc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b80d1de0 con 0x7fe6b80ced80 2024-04-25T08:50:45.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.168+0000 7fe6be6fc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b8161c60 con 0x7fe6b8161710 2024-04-25T08:50:45.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.168+0000 7fe6bcc99640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe6b8161710 0x7fe6b80d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.168+0000 7fe6bcc99640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe6b8161710 0x7fe6b80d29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59356/0 (socket says 172.21.15.172:59356) 2024-04-25T08:50:45.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.168+0000 7fe6bcc99640 1 -- 172.21.15.172:0/1632552056 learned_addr learned my addr 172.21.15.172:0/1632552056 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:45.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.168+0000 7fe6bcc99640 1 -- 172.21.15.172:0/1632552056 >> v1:172.21.15.186:6789/0 conn(0x7fe6b80ced80 legacy=0x7fe6b80d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:45.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.168+0000 7fe6bcc99640 1 -- 172.21.15.172:0/1632552056 >> v1:172.21.15.172:6789/0 conn(0x7fe6b815dc20 legacy=0x7fe6b80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.168+0000 7fe6bcc99640 1 -- 172.21.15.172:0/1632552056 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8161f40 con 0x7fe6b8161710 2024-04-25T08:50:45.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.169+0000 7fe6bcc99640 1 --2- 172.21.15.172:0/1632552056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b8161710 0x7fe6b80d29f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009e50 tx=0x7fe6b002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b27e9ae861ed9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:45.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.169+0000 7fe6b6ffd640 1 -- 172.21.15.172:0/1632552056 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0036070 con 0x7fe6b8161710 2024-04-25T08:50:45.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.169+0000 7fe6b6ffd640 1 -- 172.21.15.172:0/1632552056 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b0031600 con 0x7fe6b8161710 2024-04-25T08:50:45.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.169+0000 7fe6b6ffd640 1 -- 172.21.15.172:0/1632552056 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00319d0 con 0x7fe6b8161710 2024-04-25T08:50:45.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.170+0000 7fe6be6fc640 1 -- 172.21.15.172:0/1632552056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b8161710 msgr2=0x7fe6b80d29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.170+0000 7fe6be6fc640 1 --2- 172.21.15.172:0/1632552056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b8161710 0x7fe6b80d29f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009e50 tx=0x7fe6b002a760 comp rx=0 tx=0).stop 2024-04-25T08:50:45.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.170+0000 7fe6be6fc640 1 -- 172.21.15.172:0/1632552056 shutdown_connections 2024-04-25T08:50:45.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.170+0000 7fe6be6fc640 1 --2- 172.21.15.172:0/1632552056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b8161710 0x7fe6b80d29f0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.170+0000 7fe6be6fc640 1 -- 172.21.15.172:0/1632552056 >> 172.21.15.172:0/1632552056 conn(0x7fe6b80d0420 msgr2=0x7fe6b80d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:45.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.170+0000 7fe6be6fc640 1 -- 172.21.15.172:0/1632552056 shutdown_connections 2024-04-25T08:50:45.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.170+0000 7fe6be6fc640 1 -- 172.21.15.172:0/1632552056 wait complete. 2024-04-25T08:50:45.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.172+0000 7fe6be6fc640 1 Processor -- start 2024-04-25T08:50:45.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.172+0000 7fe6be6fc640 1 -- start start 2024-04-25T08:50:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6be6fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6b80ced80 0x7fe6b8149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6be6fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b815dc20 0x7fe6b81e96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6be6fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6b8161710 0x7fe6b81e9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6be6fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80b5e50 con 0x7fe6b815dc20 2024-04-25T08:50:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6be6fc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b8162500 con 0x7fe6b80ced80 2024-04-25T08:50:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6be6fc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b80b5fd0 con 0x7fe6b8161710 2024-04-25T08:50:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6b77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b815dc20 0x7fe6b81e96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6b77fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b815dc20 0x7fe6b81e96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59366/0 (socket says 172.21.15.172:59366) 2024-04-25T08:50:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6b77fe640 1 -- 172.21.15.172:0/4262339876 learned_addr learned my addr 172.21.15.172:0/4262339876 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:45.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6b7fff640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6b80ced80 0x7fe6b8149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.173+0000 7fe6bcc99640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6b8161710 0x7fe6b81e9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6b77fe640 1 -- 172.21.15.172:0/4262339876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6b8161710 msgr2=0x7fe6b81e9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6b77fe640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6b8161710 0x7fe6b81e9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6b77fe640 1 -- 172.21.15.172:0/4262339876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6b80ced80 msgr2=0x7fe6b8149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6b77fe640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6b80ced80 0x7fe6b8149ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6b77fe640 1 -- 172.21.15.172:0/4262339876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b80cc8e0 con 0x7fe6b815dc20 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6b77fe640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b815dc20 0x7fe6b81e96e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00b3f0 tx=0x7fe6ac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6b4ff9640 1 -- 172.21.15.172:0/4262339876 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac015020 con 0x7fe6b815dc20 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6b4ff9640 1 -- 172.21.15.172:0/4262339876 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac011830 con 0x7fe6b815dc20 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6be6fc640 1 -- 172.21.15.172:0/4262339876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b814caa0 con 0x7fe6b815dc20 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6b4ff9640 1 -- 172.21.15.172:0/4262339876 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac011c20 con 0x7fe6b815dc20 2024-04-25T08:50:45.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.174+0000 7fe6be6fc640 1 -- 172.21.15.172:0/4262339876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b80cce40 con 0x7fe6b815dc20 2024-04-25T08:50:45.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.175+0000 7fe6be6fc640 1 -- 172.21.15.172:0/4262339876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b8073a00 con 0x7fe6b815dc20 2024-04-25T08:50:45.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.176+0000 7fe6b4ff9640 1 -- 172.21.15.172:0/4262339876 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe6ac018020 con 0x7fe6b815dc20 2024-04-25T08:50:45.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.176+0000 7fe6b4ff9640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe6a406b4d0 0x7fe6a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.176+0000 7fe6b7fff640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe6a406b4d0 0x7fe6a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.176+0000 7fe6b4ff9640 1 -- 172.21.15.172:0/4262339876 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe6ac089ae0 con 0x7fe6b815dc20 2024-04-25T08:50:45.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.177+0000 7fe6b7fff640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe6a406b4d0 0x7fe6a406d990 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe6b81f71e0 tx=0x7fe6a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:45.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.181+0000 7fe6b4ff9640 1 -- 172.21.15.172:0/4262339876 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe6ac01f030 con 0x7fe6b815dc20 2024-04-25T08:50:45.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.350+0000 7fe6be6fc640 1 -- 172.21.15.172:0/4262339876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe6b80d16b0 con 0x7fe6b815dc20 2024-04-25T08:50:45.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.353+0000 7fe6b4ff9640 1 -- 172.21.15.172:0/4262339876 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe6b80cc8e0 con 0x7fe6b815dc20 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 -- 172.21.15.172:0/4262339876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe6a406b4d0 msgr2=0x7fe6a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe6a406b4d0 0x7fe6a406d990 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe6b81f71e0 tx=0x7fe6a8009040 comp rx=0 tx=0).stop 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 -- 172.21.15.172:0/4262339876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b815dc20 msgr2=0x7fe6b81e96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b815dc20 0x7fe6b81e96e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00b3f0 tx=0x7fe6ac00b8b0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 -- 172.21.15.172:0/4262339876 shutdown_connections 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe6a406b4d0 0x7fe6a406d990 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6b8161710 0x7fe6b81e9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b815dc20 0x7fe6b81e96e0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 --2- 172.21.15.172:0/4262339876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6b80ced80 0x7fe6b8149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 -- 172.21.15.172:0/4262339876 >> 172.21.15.172:0/4262339876 conn(0x7fe6b80d0420 msgr2=0x7fe6b80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:45.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 -- 172.21.15.172:0/4262339876 shutdown_connections 2024-04-25T08:50:45.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.355+0000 7fe6be6fc640 1 -- 172.21.15.172:0/4262339876 wait complete. 2024-04-25T08:50:45.357 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-04-25T08:50:45.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.465+0000 7f1329a5d640 1 Processor -- start 2024-04-25T08:50:45.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.465+0000 7f1329a5d640 1 -- start start 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.465+0000 7f1329a5d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f132415dbe0 0x7f13240d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.465+0000 7f1329a5d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f13240b2cb0 0x7f13240d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.465+0000 7f1329a5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b92a0 0x7f13240b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.465+0000 7f1329a5d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132415dfc0 con 0x7f13240b2cb0 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.465+0000 7f1329a5d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240d1a00 con 0x7f132415dbe0 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.465+0000 7f1329a5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13240b97a0 con 0x7f13240b92a0 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13227fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f13240b2cb0 0x7f13240d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13227fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f13240b2cb0 0x7f13240d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59368/0 (socket says 172.21.15.172:59368) 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13227fc640 1 -- 172.21.15.172:0/642979555 learned_addr learned my addr 172.21.15.172:0/642979555 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f1322ffd640 1 --2- 172.21.15.172:0/642979555 >> v2:172.21.15.186:3300/0 conn(0x7f132415dbe0 0x7f13240d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.458 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13237fe640 1 --2- 172.21.15.172:0/642979555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b92a0 0x7f13240b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13227fc640 1 -- 172.21.15.172:0/642979555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b92a0 msgr2=0x7f13240b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13227fc640 1 --2- 172.21.15.172:0/642979555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b92a0 0x7f13240b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13227fc640 1 -- 172.21.15.172:0/642979555 >> v2:172.21.15.186:3300/0 conn(0x7f132415dbe0 msgr2=0x7f13240d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13227fc640 1 --2- 172.21.15.172:0/642979555 >> v2:172.21.15.186:3300/0 conn(0x7f132415dbe0 0x7f13240d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13227fc640 1 -- 172.21.15.172:0/642979555 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240d1c50 con 0x7f13240b2cb0 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13237fe640 1 --2- 172.21.15.172:0/642979555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b92a0 0x7f13240b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.466+0000 7f13227fc640 1 --2- 172.21.15.172:0/642979555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b2cb0 0x7f13240d0e50 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f132406c140 tx=0x7f130c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474dc68a69159346 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1321ffb640 1 -- 172.21.15.172:0/642979555 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c037070 con 0x7f13240b2cb0 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1321ffb640 1 -- 172.21.15.172:0/642979555 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c032440 con 0x7f13240b2cb0 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1321ffb640 1 -- 172.21.15.172:0/642979555 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c032810 con 0x7f13240b2cb0 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1329a5d640 1 -- 172.21.15.172:0/642979555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b2cb0 msgr2=0x7f13240d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1329a5d640 1 --2- 172.21.15.172:0/642979555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b2cb0 0x7f13240d0e50 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f132406c140 tx=0x7f130c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1329a5d640 1 -- 172.21.15.172:0/642979555 shutdown_connections 2024-04-25T08:50:45.459 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1329a5d640 1 --2- 172.21.15.172:0/642979555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b92a0 0x7f13240b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1329a5d640 1 --2- 172.21.15.172:0/642979555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b2cb0 0x7f13240d0e50 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1329a5d640 1 --2- 172.21.15.172:0/642979555 >> v2:172.21.15.186:3300/0 conn(0x7f132415dbe0 0x7f13240d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1329a5d640 1 -- 172.21.15.172:0/642979555 >> 172.21.15.172:0/642979555 conn(0x7f1324061a20 msgr2=0x7f1324061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:45.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1329a5d640 1 -- 172.21.15.172:0/642979555 shutdown_connections 2024-04-25T08:50:45.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.467+0000 7f1329a5d640 1 -- 172.21.15.172:0/642979555 wait complete. 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.468+0000 7f1329a5d640 1 Processor -- start 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f1329a5d640 1 -- start start 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f1329a5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b2cb0 0x7f1324160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f1329a5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b92a0 0x7f13240c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f1329a5d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f132415dbe0 0x7f13240b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f1329a5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13240b6ab0 con 0x7f13240b92a0 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f1329a5d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13240d2210 con 0x7f132415dbe0 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f1329a5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13240b6c30 con 0x7f13240b2cb0 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f13227fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b92a0 0x7f13240c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f13227fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b92a0 0x7f13240c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59370/0 (socket says 172.21.15.172:59370) 2024-04-25T08:50:45.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f13227fc640 1 -- 172.21.15.172:0/2800064915 learned_addr learned my addr 172.21.15.172:0/2800064915 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f13237fe640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f132415dbe0 0x7f13240b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.469+0000 7f1322ffd640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b2cb0 0x7f1324160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f13227fc640 1 -- 172.21.15.172:0/2800064915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b2cb0 msgr2=0x7f1324160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f13227fc640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b2cb0 0x7f1324160560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f13227fc640 1 -- 172.21.15.172:0/2800064915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f132415dbe0 msgr2=0x7f13240b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f13227fc640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f132415dbe0 0x7f13240b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f13227fc640 1 -- 172.21.15.172:0/2800064915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1324160aa0 con 0x7f13240b92a0 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f13227fc640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b92a0 0x7f13240c9430 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f130c02a220 tx=0x7f130c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f131bfff640 1 -- 172.21.15.172:0/2800064915 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c037040 con 0x7f13240b92a0 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f131bfff640 1 -- 172.21.15.172:0/2800064915 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c042070 con 0x7f13240b92a0 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f1329a5d640 1 -- 172.21.15.172:0/2800064915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132415ed90 con 0x7f13240b92a0 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f131bfff640 1 -- 172.21.15.172:0/2800064915 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c030880 con 0x7f13240b92a0 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.470+0000 7f1329a5d640 1 -- 172.21.15.172:0/2800064915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132415f350 con 0x7f13240b92a0 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.471+0000 7f1329a5d640 1 -- 172.21.15.172:0/2800064915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1324073990 con 0x7f13240b92a0 2024-04-25T08:50:45.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.471+0000 7f131bfff640 1 -- 172.21.15.172:0/2800064915 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f130c030a20 con 0x7f13240b92a0 2024-04-25T08:50:45.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.472+0000 7f131bfff640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 0x7f130406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:45.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.472+0000 7f131bfff640 1 -- 172.21.15.172:0/2800064915 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f130c0aa790 con 0x7f13240b92a0 2024-04-25T08:50:45.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.472+0000 7f1322ffd640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 0x7f130406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:45.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.472+0000 7f1322ffd640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 0x7f130406d990 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1314009a20 tx=0x7f1314009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:45.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.476+0000 7f131bfff640 1 -- 172.21.15.172:0/2800064915 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f130c0791c0 con 0x7f13240b92a0 2024-04-25T08:50:45.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:45.713+0000 7f1329a5d640 1 -- 172.21.15.172:0/2800064915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7f13240d0dd0 con 0x7f13240b92a0 2024-04-25T08:50:46.000 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.009+0000 7f131bfff640 1 -- 172.21.15.172:0/2800064915 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v415) v1 ==== 166+0+0 (secure 0 0 0) 0x7f130c07d260 con 0x7f13240b92a0 2024-04-25T08:50:46.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.011+0000 7f1329a5d640 1 -- 172.21.15.172:0/2800064915 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 msgr2=0x7f130406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.011+0000 7f1329a5d640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 0x7f130406d990 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1314009a20 tx=0x7f1314009190 comp rx=0 tx=0).stop 2024-04-25T08:50:46.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.011+0000 7f1329a5d640 1 -- 172.21.15.172:0/2800064915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b92a0 msgr2=0x7f13240c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.011+0000 7f1329a5d640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b92a0 0x7f13240c9430 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f130c02a220 tx=0x7f130c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.011+0000 7f1329a5d640 1 -- 172.21.15.172:0/2800064915 shutdown_connections 2024-04-25T08:50:46.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.011+0000 7f1329a5d640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f130406b4d0 0x7f130406d990 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.011+0000 7f1329a5d640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f132415dbe0 0x7f13240b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.011+0000 7f1329a5d640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13240b92a0 0x7f13240c9430 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.011+0000 7f1329a5d640 1 --2- 172.21.15.172:0/2800064915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13240b2cb0 0x7f1324160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.011+0000 7f1329a5d640 1 -- 172.21.15.172:0/2800064915 >> 172.21.15.172:0/2800064915 conn(0x7f1324061a20 msgr2=0x7f13240b73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:46.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.012+0000 7f1329a5d640 1 -- 172.21.15.172:0/2800064915 shutdown_connections 2024-04-25T08:50:46.003 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.012+0000 7f1329a5d640 1 -- 172.21.15.172:0/2800064915 wait complete. 2024-04-25T08:50:46.014 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T08:50:46.014 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T08:50:46.015 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:46.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.122+0000 7fa3bef5c640 1 Processor -- start 2024-04-25T08:50:46.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.122+0000 7fa3bef5c640 1 -- start start 2024-04-25T08:50:46.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.122+0000 7fa3bef5c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa3b8154ed0 0x7fa3b80aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.122+0000 7fa3bef5c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 0x7fa3b80ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.122+0000 7fa3bef5c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa3b806c1d0 0x7fa3b80ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.122+0000 7fa3bef5c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b815ec60 con 0x7fa3b806c1d0 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.122+0000 7fa3bef5c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b815ef40 con 0x7fa3b8154ed0 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.122+0000 7fa3bef5c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b806db90 con 0x7fa3b8071ac0 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3bd4f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa3b806c1d0 0x7fa3b80ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3bd4f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa3b806c1d0 0x7fa3b80ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59384/0 (socket says 172.21.15.172:59384) 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3bd4f9640 1 -- 172.21.15.172:0/1564443404 learned_addr learned my addr 172.21.15.172:0/1564443404 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3bccf8640 1 --2- 172.21.15.172:0/1564443404 >> v2:172.21.15.186:3300/0 conn(0x7fa3b8154ed0 0x7fa3b80aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3bd4f9640 1 -- 172.21.15.172:0/1564443404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 msgr2=0x7fa3b80ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3b7fff640 1 --2- 172.21.15.172:0/1564443404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 0x7fa3b80ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3bd4f9640 1 --2- 172.21.15.172:0/1564443404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 0x7fa3b80ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3bd4f9640 1 -- 172.21.15.172:0/1564443404 >> v2:172.21.15.186:3300/0 conn(0x7fa3b8154ed0 msgr2=0x7fa3b80aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3bd4f9640 1 --2- 172.21.15.172:0/1564443404 >> v2:172.21.15.186:3300/0 conn(0x7fa3b8154ed0 0x7fa3b80aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3bd4f9640 1 -- 172.21.15.172:0/1564443404 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b806de70 con 0x7fa3b806c1d0 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3bccf8640 1 --2- 172.21.15.172:0/1564443404 >> v2:172.21.15.186:3300/0 conn(0x7fa3b8154ed0 0x7fa3b80aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.123+0000 7fa3b7fff640 1 --2- 172.21.15.172:0/1564443404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 0x7fa3b80ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:46.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3bd4f9640 1 --2- 172.21.15.172:0/1564443404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b806c1d0 0x7fa3b80ad950 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80d0ec0 tx=0x7fa3a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d30227611ca01b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:46.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3b77fe640 1 -- 172.21.15.172:0/1564443404 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8037070 con 0x7fa3b806c1d0 2024-04-25T08:50:46.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3b77fe640 1 -- 172.21.15.172:0/1564443404 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8032440 con 0x7fa3b806c1d0 2024-04-25T08:50:46.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3b77fe640 1 -- 172.21.15.172:0/1564443404 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8032810 con 0x7fa3b806c1d0 2024-04-25T08:50:46.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1564443404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b806c1d0 msgr2=0x7fa3b80ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3bef5c640 1 --2- 172.21.15.172:0/1564443404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b806c1d0 0x7fa3b80ad950 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80d0ec0 tx=0x7fa3a802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1564443404 shutdown_connections 2024-04-25T08:50:46.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3bef5c640 1 --2- 172.21.15.172:0/1564443404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b806c1d0 0x7fa3b80ad950 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3bef5c640 1 --2- 172.21.15.172:0/1564443404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 0x7fa3b80ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3bef5c640 1 --2- 172.21.15.172:0/1564443404 >> v2:172.21.15.186:3300/0 conn(0x7fa3b8154ed0 0x7fa3b80aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1564443404 >> 172.21.15.172:0/1564443404 conn(0x7fa3b80af670 msgr2=0x7fa3b80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:46.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1564443404 shutdown_connections 2024-04-25T08:50:46.120 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.124+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1564443404 wait complete. 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.126+0000 7fa3bef5c640 1 Processor -- start 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.126+0000 7fa3bef5c640 1 -- start start 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.126+0000 7fa3bef5c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 0x7fa3b814c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.126+0000 7fa3bef5c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b8154ed0 0x7fa3b80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.126+0000 7fa3bef5c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3b80b3c30 0x7fa3b813e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.126+0000 7fa3bef5c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8161ba0 con 0x7fa3b8154ed0 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.126+0000 7fa3bef5c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8161a20 con 0x7fa3b80b3c30 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.126+0000 7fa3bef5c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8161d20 con 0x7fa3b8071ac0 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b8154ed0 0x7fa3b80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b8154ed0 0x7fa3b80b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59398/0 (socket says 172.21.15.172:59398) 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b7fff640 1 -- 172.21.15.172:0/1196766711 learned_addr learned my addr 172.21.15.172:0/1196766711 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3bd4f9640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3b80b3c30 0x7fa3b813e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3bccf8640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 0x7fa3b814c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b7fff640 1 -- 172.21.15.172:0/1196766711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 msgr2=0x7fa3b814c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b7fff640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 0x7fa3b814c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b7fff640 1 -- 172.21.15.172:0/1196766711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3b80b3c30 msgr2=0x7fa3b813e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b7fff640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3b80b3c30 0x7fa3b813e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b7fff640 1 -- 172.21.15.172:0/1196766711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b814ca40 con 0x7fa3b8154ed0 2024-04-25T08:50:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3bd4f9640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3b80b3c30 0x7fa3b813e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b7fff640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b8154ed0 0x7fa3b80b36f0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c7c0 tx=0x7fa3a000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b57fa640 1 -- 172.21.15.172:0/1196766711 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0015070 con 0x7fa3b8154ed0 2024-04-25T08:50:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b57fa640 1 -- 172.21.15.172:0/1196766711 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a0007820 con 0x7fa3b8154ed0 2024-04-25T08:50:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1196766711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b813f500 con 0x7fa3b8154ed0 2024-04-25T08:50:46.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3b57fa640 1 -- 172.21.15.172:0/1196766711 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0007bf0 con 0x7fa3b8154ed0 2024-04-25T08:50:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.127+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1196766711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b80b4540 con 0x7fa3b8154ed0 2024-04-25T08:50:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.128+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1196766711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b80b2b10 con 0x7fa3b8154ed0 2024-04-25T08:50:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.129+0000 7fa3b57fa640 1 -- 172.21.15.172:0/1196766711 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa3a0018070 con 0x7fa3b8154ed0 2024-04-25T08:50:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.129+0000 7fa3b57fa640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa39806b4d0 0x7fa39806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.129+0000 7fa3b57fa640 1 -- 172.21.15.172:0/1196766711 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa3a0089f60 con 0x7fa3b8154ed0 2024-04-25T08:50:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.129+0000 7fa3bccf8640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa39806b4d0 0x7fa39806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.130+0000 7fa3bccf8640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa39806b4d0 0x7fa39806d990 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0008ee0 tx=0x7fa3b0008430 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:46.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.133+0000 7fa3b57fa640 1 -- 172.21.15.172:0/1196766711 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3a0058f50 con 0x7fa3b8154ed0 2024-04-25T08:50:46.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.305+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1196766711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3b8073990 con 0x7fa3b8154ed0 2024-04-25T08:50:46.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.306+0000 7fa3b57fa640 1 -- 172.21.15.172:0/1196766711 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+13365 (secure 0 0 0) 0x7fa3a0058850 con 0x7fa3b8154ed0 2024-04-25T08:50:46.296 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:46.296 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":122,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:45.007572+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6837/3573637584":"2024-04-26T08:50:42.003782+0000","172.21.15.172:6836/3573637584":"2024-04-26T08:50:42.003782+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.307+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1196766711 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa39806b4d0 msgr2=0x7fa39806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.307+0000 7fa3bef5c640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa39806b4d0 0x7fa39806d990 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0008ee0 tx=0x7fa3b0008430 comp rx=0 tx=0).stop 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.307+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1196766711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b8154ed0 msgr2=0x7fa3b80b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.308+0000 7fa3bef5c640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b8154ed0 0x7fa3b80b36f0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c7c0 tx=0x7fa3a000cc80 comp rx=0 tx=0).stop 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.308+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1196766711 shutdown_connections 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.308+0000 7fa3bef5c640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa39806b4d0 0x7fa39806d990 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.308+0000 7fa3bef5c640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3b80b3c30 0x7fa3b813e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.308+0000 7fa3bef5c640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b8154ed0 0x7fa3b80b36f0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.308+0000 7fa3bef5c640 1 --2- 172.21.15.172:0/1196766711 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3b8071ac0 0x7fa3b814c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.308+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1196766711 >> 172.21.15.172:0/1196766711 conn(0x7fa3b806c1d0 msgr2=0x7fa3b80d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.308+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1196766711 shutdown_connections 2024-04-25T08:50:46.299 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.308+0000 7fa3bef5c640 1 -- 172.21.15.172:0/1196766711 wait complete. 2024-04-25T08:50:46.310 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:50:46.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:50:46.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.419+0000 7fe878730640 1 Processor -- start 2024-04-25T08:50:46.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.419+0000 7fe878730640 1 -- start start 2024-04-25T08:50:46.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe878730640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe87015dc70 0x7fe8700af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe878730640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe87006f190 0x7fe87006abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe878730640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8700b56e0 con 0x7fe87006f5f0 2024-04-25T08:50:46.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe878730640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8700b3590 con 0x7fe87006f190 2024-04-25T08:50:46.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe878730640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8700b37e0 con 0x7fe87015dc70 2024-04-25T08:50:46.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe875ccb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe87006f190 0x7fe87006abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe875ccb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe87006f190 0x7fe87006abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59412/0 (socket says 172.21.15.172:59412) 2024-04-25T08:50:46.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe875ccb640 1 -- 172.21.15.172:0/1016749566 learned_addr learned my addr 172.21.15.172:0/1016749566 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:46.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe875ccb640 1 -- 172.21.15.172:0/1016749566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe87015dc70 msgr2=0x7fe8700af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:46.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe8764cc640 1 --2- 172.21.15.172:0/1016749566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe87015dc70 0x7fe8700af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe875ccb640 1 --2- 172.21.15.172:0/1016749566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe87015dc70 0x7fe8700af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.420+0000 7fe875ccb640 1 -- 172.21.15.172:0/1016749566 >> v1:172.21.15.186:6789/0 conn(0x7fe87006f5f0 legacy=0x7fe8700ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.421+0000 7fe875ccb640 1 -- 172.21.15.172:0/1016749566 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8700b3ac0 con 0x7fe87006f190 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.421+0000 7fe875ccb640 1 --2- 172.21.15.172:0/1016749566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 0x7fe87006abe0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fe860009870 tx=0x7fe86002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bc5a8882c658cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.421+0000 7fe8754ca640 1 -- 172.21.15.172:0/1016749566 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860037070 con 0x7fe87006f190 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.421+0000 7fe8754ca640 1 -- 172.21.15.172:0/1016749566 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86002ae10 con 0x7fe87006f190 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.421+0000 7fe8754ca640 1 -- 172.21.15.172:0/1016749566 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860032660 con 0x7fe87006f190 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.422+0000 7fe878730640 1 -- 172.21.15.172:0/1016749566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 msgr2=0x7fe87006abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.422+0000 7fe878730640 1 --2- 172.21.15.172:0/1016749566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 0x7fe87006abe0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fe860009870 tx=0x7fe86002a100 comp rx=0 tx=0).stop 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.422+0000 7fe878730640 1 -- 172.21.15.172:0/1016749566 shutdown_connections 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.422+0000 7fe878730640 1 --2- 172.21.15.172:0/1016749566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 0x7fe87006abe0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.422+0000 7fe878730640 1 --2- 172.21.15.172:0/1016749566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe87015dc70 0x7fe8700af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.422+0000 7fe878730640 1 -- 172.21.15.172:0/1016749566 >> 172.21.15.172:0/1016749566 conn(0x7fe8700b5af0 msgr2=0x7fe8700b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.422+0000 7fe878730640 1 -- 172.21.15.172:0/1016749566 shutdown_connections 2024-04-25T08:50:46.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.422+0000 7fe878730640 1 -- 172.21.15.172:0/1016749566 wait complete. 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.423+0000 7fe878730640 1 Processor -- start 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.423+0000 7fe878730640 1 -- start start 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe878730640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 0x7fe870148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe878730640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe87006f5f0 0x7fe87015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe878730640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe87015dc70 0x7fe87009c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe878730640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8700701d0 con 0x7fe87006f190 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe878730640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87015e050 con 0x7fe87006f5f0 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe878730640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe870070350 con 0x7fe87015dc70 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe8764cc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 0x7fe870148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe8764cc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 0x7fe870148240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59418/0 (socket says 172.21.15.172:59418) 2024-04-25T08:50:46.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe8764cc640 1 -- 172.21.15.172:0/1783733619 learned_addr learned my addr 172.21.15.172:0/1783733619 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe8764cc640 1 -- 172.21.15.172:0/1783733619 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe87015dc70 msgr2=0x7fe87009c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe8764cc640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe87015dc70 0x7fe87009c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe8764cc640 1 -- 172.21.15.172:0/1783733619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe87006f5f0 msgr2=0x7fe87015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe875ccb640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe87006f5f0 0x7fe87015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe8764cc640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe87006f5f0 0x7fe87015cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe8764cc640 1 -- 172.21.15.172:0/1783733619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87015d420 con 0x7fe87006f190 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.424+0000 7fe8764cc640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 0x7fe870148240 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00c7f0 tx=0x7fe86c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.425+0000 7fe866ffd640 1 -- 172.21.15.172:0/1783733619 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c015070 con 0x7fe87006f190 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.425+0000 7fe866ffd640 1 -- 172.21.15.172:0/1783733619 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c004220 con 0x7fe87006f190 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.425+0000 7fe878730640 1 -- 172.21.15.172:0/1783733619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87015b550 con 0x7fe87006f190 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.425+0000 7fe866ffd640 1 -- 172.21.15.172:0/1783733619 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c007620 con 0x7fe87006f190 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.425+0000 7fe878730640 1 -- 172.21.15.172:0/1783733619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87015bb10 con 0x7fe87006f190 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.426+0000 7fe878730640 1 -- 172.21.15.172:0/1783733619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87006cc80 con 0x7fe87006f190 2024-04-25T08:50:46.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.426+0000 7fe866ffd640 1 -- 172.21.15.172:0/1783733619 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe86c0079d0 con 0x7fe87006f190 2024-04-25T08:50:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.427+0000 7fe866ffd640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe85406b4d0 0x7fe85406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.427+0000 7fe866ffd640 1 -- 172.21.15.172:0/1783733619 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe86c08a040 con 0x7fe87006f190 2024-04-25T08:50:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.427+0000 7fe875ccb640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe85406b4d0 0x7fe85406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.427+0000 7fe875ccb640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe85406b4d0 0x7fe85406d990 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe860034000 tx=0x7fe86002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:46.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.431+0000 7fe866ffd640 1 -- 172.21.15.172:0/1783733619 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe87015d420 con 0x7fe87006f190 2024-04-25T08:50:46.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.600+0000 7fe878730640 1 -- 172.21.15.172:0/1783733619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe870073a00 con 0x7fe87006f190 2024-04-25T08:50:46.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.601+0000 7fe866ffd640 1 -- 172.21.15.172:0/1783733619 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe86c059030 con 0x7fe87006f190 2024-04-25T08:50:46.592 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:50:46.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.602+0000 7fe878730640 1 -- 172.21.15.172:0/1783733619 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe85406b4d0 msgr2=0x7fe85406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.602+0000 7fe878730640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe85406b4d0 0x7fe85406d990 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe860034000 tx=0x7fe86002e000 comp rx=0 tx=0).stop 2024-04-25T08:50:46.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.602+0000 7fe878730640 1 -- 172.21.15.172:0/1783733619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 msgr2=0x7fe870148240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.602+0000 7fe878730640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 0x7fe870148240 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00c7f0 tx=0x7fe86c00ccb0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.603+0000 7fe878730640 1 -- 172.21.15.172:0/1783733619 shutdown_connections 2024-04-25T08:50:46.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.603+0000 7fe878730640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe85406b4d0 0x7fe85406d990 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.603+0000 7fe878730640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe87006f5f0 0x7fe87015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.603+0000 7fe878730640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe87015dc70 0x7fe87009c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.603+0000 7fe878730640 1 --2- 172.21.15.172:0/1783733619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87006f190 0x7fe870148240 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.603+0000 7fe878730640 1 -- 172.21.15.172:0/1783733619 >> 172.21.15.172:0/1783733619 conn(0x7fe8700b5af0 msgr2=0x7fe8700b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:46.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.603+0000 7fe878730640 1 -- 172.21.15.172:0/1783733619 shutdown_connections 2024-04-25T08:50:46.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.603+0000 7fe878730640 1 -- 172.21.15.172:0/1783733619 wait complete. 2024-04-25T08:50:46.605 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.712+0000 7fc635838640 1 Processor -- start 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.712+0000 7fc635838640 1 -- start start 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc635838640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc6300cedf0 0x7fc6301616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc635838640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6300b93a0 0x7fc6300d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc635838640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63015e000 con 0x7fc63015dc20 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc635838640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300b6bb0 con 0x7fc6300cedf0 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc635838640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300b6030 con 0x7fc6300b93a0 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc62effd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc63015dc20 0x7fc6300ce6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33432/0 (socket says 172.21.15.172:33432) 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc62effd640 1 -- 172.21.15.172:0/3850189378 learned_addr learned my addr 172.21.15.172:0/3850189378 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc62e7fc640 1 --2- 172.21.15.172:0/3850189378 >> v2:172.21.15.186:3300/0 conn(0x7fc6300cedf0 0x7fc6301616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc62f7fe640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6300b93a0 0x7fc6300d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542189018 0 0) 0x7fc620001490 con 0x7fc63015dc20 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.713+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc618003520 con 0x7fc63015dc20 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785703139 0 0) 0x7fc618003520 con 0x7fc63015dc20 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6300b93a0 msgr2=0x7fc6300d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6300b93a0 0x7fc6300d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 >> v2:172.21.15.186:3300/0 conn(0x7fc6300cedf0 msgr2=0x7fc6301616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 --2- 172.21.15.172:0/3850189378 >> v2:172.21.15.186:3300/0 conn(0x7fc6300cedf0 0x7fc6301616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc630161de0 con 0x7fc63015dc20 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fc620001bc0 con 0x7fc63015dc20 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62f7fe640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6300b93a0 0x7fc6300d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 >> v1:172.21.15.172:6789/0 conn(0x7fc63015dc20 legacy=0x7fc6300ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6180039b0 0x7fc618003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6300b93a0 0x7fc618004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc618004d40 0x7fc6180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300b6bb0 con 0x7fc618004d40 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300b6030 con 0x7fc6180039b0 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61800b9c0 con 0x7fc6300b93a0 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62f7fe640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc618004d40 0x7fc6180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62effd640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6180039b0 0x7fc618003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62e7fc640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6300b93a0 0x7fc618004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62f7fe640 1 -- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6300b93a0 msgr2=0x7fc618004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62f7fe640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6300b93a0 0x7fc618004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62f7fe640 1 -- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6180039b0 msgr2=0x7fc618003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62f7fe640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6180039b0 0x7fc618003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.714+0000 7fc62f7fe640 1 -- 172.21.15.172:0/3850189378 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc618003520 con 0x7fc618004d40 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.715+0000 7fc62f7fe640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc618004d40 0x7fc6180051c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fc6280098a0 tx=0x7fc618005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0efbfaa54657010 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.715+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800f040 con 0x7fc618004d40 2024-04-25T08:50:46.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.715+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62802ace0 con 0x7fc618004d40 2024-04-25T08:50:46.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.715+0000 7fc62dffb640 1 -- 172.21.15.172:0/3850189378 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628004250 con 0x7fc618004d40 2024-04-25T08:50:46.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.716+0000 7fc635838640 1 -- 172.21.15.172:0/3850189378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc618004d40 msgr2=0x7fc6180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.716+0000 7fc635838640 1 --2- 172.21.15.172:0/3850189378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc618004d40 0x7fc6180051c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fc6280098a0 tx=0x7fc618005830 comp rx=0 tx=0).stop 2024-04-25T08:50:46.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.716+0000 7fc62f7fe640 1 -- 172.21.15.172:0/3850189378 reap_dead start 2024-04-25T08:50:46.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.716+0000 7fc635838640 1 -- 172.21.15.172:0/3850189378 shutdown_connections 2024-04-25T08:50:46.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.716+0000 7fc635838640 1 -- 172.21.15.172:0/3850189378 >> 172.21.15.172:0/3850189378 conn(0x7fc6300d0490 msgr2=0x7fc6300d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:46.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.716+0000 7fc635838640 1 -- 172.21.15.172:0/3850189378 shutdown_connections 2024-04-25T08:50:46.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.716+0000 7fc635838640 1 -- 172.21.15.172:0/3850189378 wait complete. 2024-04-25T08:50:46.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.717+0000 7fc635838640 1 Processor -- start 2024-04-25T08:50:46.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.717+0000 7fc635838640 1 -- start start 2024-04-25T08:50:46.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc635838640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6301565f0 0x7fc630160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc635838640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6301569d0 0x7fc6301e95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc635838640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6301613a0 0x7fc6301e9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc635838640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300d2510 con 0x7fc6301565f0 2024-04-25T08:50:46.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc635838640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6301623a0 con 0x7fc6301569d0 2024-04-25T08:50:46.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc635838640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300d2690 con 0x7fc6301613a0 2024-04-25T08:50:46.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6301565f0 0x7fc630160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6301565f0 0x7fc630160e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59446/0 (socket says 172.21.15.172:59446) 2024-04-25T08:50:46.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62effd640 1 -- 172.21.15.172:0/3024345700 learned_addr learned my addr 172.21.15.172:0/3024345700 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:46.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62effd640 1 -- 172.21.15.172:0/3024345700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6301613a0 msgr2=0x7fc6301e9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62e7fc640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6301569d0 0x7fc6301e95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62f7fe640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6301613a0 0x7fc6301e9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.714 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62effd640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6301613a0 0x7fc6301e9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62effd640 1 -- 172.21.15.172:0/3024345700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6301569d0 msgr2=0x7fc6301e95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62effd640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6301569d0 0x7fc6301e95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62effd640 1 -- 172.21.15.172:0/3024345700 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc630160110 con 0x7fc6301565f0 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62e7fc640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6301569d0 0x7fc6301e95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc62effd640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6301565f0 0x7fc630160e60 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fc620004bc0 tx=0x7fc6200074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc617fff640 1 -- 172.21.15.172:0/3024345700 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620017020 con 0x7fc6301565f0 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc617fff640 1 -- 172.21.15.172:0/3024345700 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620013600 con 0x7fc6301565f0 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc635838640 1 -- 172.21.15.172:0/3024345700 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6301603f0 con 0x7fc6301565f0 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc617fff640 1 -- 172.21.15.172:0/3024345700 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200139f0 con 0x7fc6301565f0 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.718+0000 7fc635838640 1 -- 172.21.15.172:0/3024345700 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6300caae0 con 0x7fc6301565f0 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.719+0000 7fc635838640 1 -- 172.21.15.172:0/3024345700 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc630073990 con 0x7fc6301565f0 2024-04-25T08:50:46.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.720+0000 7fc617fff640 1 -- 172.21.15.172:0/3024345700 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc62001a020 con 0x7fc6301565f0 2024-04-25T08:50:46.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.720+0000 7fc617fff640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61c06b500 0x7fc61c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:46.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.720+0000 7fc62e7fc640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61c06b500 0x7fc61c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:46.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.720+0000 7fc617fff640 1 -- 172.21.15.172:0/3024345700 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc62008afa0 con 0x7fc6301565f0 2024-04-25T08:50:46.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.721+0000 7fc62e7fc640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61c06b500 0x7fc61c06d9c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc63015ef00 tx=0x7fc624008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:46.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.725+0000 7fc617fff640 1 -- 172.21.15.172:0/3024345700 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc620021020 con 0x7fc6301565f0 2024-04-25T08:50:46.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:46.969+0000 7fc635838640 1 -- 172.21.15.172:0/3024345700 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7fc6300d1720 con 0x7fc6301565f0 2024-04-25T08:50:47.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.013+0000 7fc617fff640 1 -- 172.21.15.172:0/3024345700 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v416) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc63015e000 con 0x7fc6301565f0 2024-04-25T08:50:47.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.015+0000 7fc635838640 1 -- 172.21.15.172:0/3024345700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61c06b500 msgr2=0x7fc61c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.015+0000 7fc635838640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61c06b500 0x7fc61c06d9c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc63015ef00 tx=0x7fc624008040 comp rx=0 tx=0).stop 2024-04-25T08:50:47.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.015+0000 7fc635838640 1 -- 172.21.15.172:0/3024345700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6301565f0 msgr2=0x7fc630160e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.015+0000 7fc635838640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6301565f0 0x7fc630160e60 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fc620004bc0 tx=0x7fc6200074f0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.016+0000 7fc635838640 1 -- 172.21.15.172:0/3024345700 shutdown_connections 2024-04-25T08:50:47.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.016+0000 7fc635838640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61c06b500 0x7fc61c06d9c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.016+0000 7fc635838640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6301569d0 0x7fc6301e95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.016+0000 7fc635838640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6301613a0 0x7fc6301e9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.016+0000 7fc635838640 1 --2- 172.21.15.172:0/3024345700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6301565f0 0x7fc630160e60 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.016+0000 7fc635838640 1 -- 172.21.15.172:0/3024345700 >> 172.21.15.172:0/3024345700 conn(0x7fc6300d0490 msgr2=0x7fc6300b81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:47.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.016+0000 7fc635838640 1 -- 172.21.15.172:0/3024345700 shutdown_connections 2024-04-25T08:50:47.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.016+0000 7fc635838640 1 -- 172.21.15.172:0/3024345700 wait complete. 2024-04-25T08:50:47.018 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:50:47.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.128+0000 7fc7929c8640 1 Processor -- start 2024-04-25T08:50:47.119 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.128+0000 7fc7929c8640 1 -- start start 2024-04-25T08:50:47.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc7929c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc78c15dd80 0x7fc78c0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc7929c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc78c0ad570 0x7fc78c06ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc7929c8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0b3930 con 0x7fc78c06abe0 2024-04-25T08:50:47.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc7929c8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c06e410 con 0x7fc78c0ad570 2024-04-25T08:50:47.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc7929c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0b3c10 con 0x7fc78c15dd80 2024-04-25T08:50:47.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc790f65640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc78c0ad570 0x7fc78c06ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc790f65640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc78c0ad570 0x7fc78c06ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59460/0 (socket says 172.21.15.172:59460) 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc790f65640 1 -- 172.21.15.172:0/1175284826 learned_addr learned my addr 172.21.15.172:0/1175284826 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc78b7fe640 1 --2- 172.21.15.172:0/1175284826 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc78c15dd80 0x7fc78c0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc790f65640 1 -- 172.21.15.172:0/1175284826 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc78c15dd80 msgr2=0x7fc78c0b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc790f65640 1 --2- 172.21.15.172:0/1175284826 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc78c15dd80 0x7fc78c0b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc790f65640 1 -- 172.21.15.172:0/1175284826 >> v1:172.21.15.186:6789/0 conn(0x7fc78c06abe0 legacy=0x7fc78c06afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.129+0000 7fc790f65640 1 -- 172.21.15.172:0/1175284826 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c06e660 con 0x7fc78c0ad570 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.130+0000 7fc790f65640 1 --2- 172.21.15.172:0/1175284826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c0ad570 0x7fc78c06ee60 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fc784009e50 tx=0x7fc78402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbabd5412dcffdb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.130+0000 7fc78affd640 1 -- 172.21.15.172:0/1175284826 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784036070 con 0x7fc78c0ad570 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.130+0000 7fc78affd640 1 -- 172.21.15.172:0/1175284826 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc784031600 con 0x7fc78c0ad570 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.130+0000 7fc78affd640 1 -- 172.21.15.172:0/1175284826 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840319d0 con 0x7fc78c0ad570 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.131+0000 7fc7929c8640 1 -- 172.21.15.172:0/1175284826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c0ad570 msgr2=0x7fc78c06ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.131+0000 7fc7929c8640 1 --2- 172.21.15.172:0/1175284826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c0ad570 0x7fc78c06ee60 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fc784009e50 tx=0x7fc78402a710 comp rx=0 tx=0).stop 2024-04-25T08:50:47.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.131+0000 7fc7929c8640 1 -- 172.21.15.172:0/1175284826 shutdown_connections 2024-04-25T08:50:47.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.131+0000 7fc7929c8640 1 --2- 172.21.15.172:0/1175284826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c0ad570 0x7fc78c06ee60 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.131+0000 7fc7929c8640 1 --2- 172.21.15.172:0/1175284826 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc78c15dd80 0x7fc78c0b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.131+0000 7fc7929c8640 1 -- 172.21.15.172:0/1175284826 >> 172.21.15.172:0/1175284826 conn(0x7fc78c0b5af0 msgr2=0x7fc78c0b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:47.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.131+0000 7fc7929c8640 1 -- 172.21.15.172:0/1175284826 shutdown_connections 2024-04-25T08:50:47.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.131+0000 7fc7929c8640 1 -- 172.21.15.172:0/1175284826 wait complete. 2024-04-25T08:50:47.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.132+0000 7fc7929c8640 1 Processor -- start 2024-04-25T08:50:47.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.132+0000 7fc7929c8640 1 -- start start 2024-04-25T08:50:47.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc7929c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc78c06abe0 0x7fc78c156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc7929c8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc78c0ad570 0x7fc78c158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc7929c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c15dd80 0x7fc78c1f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc7929c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c070280 con 0x7fc78c15dd80 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc7929c8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0b57d0 con 0x7fc78c0ad570 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc7929c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c070400 con 0x7fc78c06abe0 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc790f65640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c15dd80 0x7fc78c1f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc790f65640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c15dd80 0x7fc78c1f7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59472/0 (socket says 172.21.15.172:59472) 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc790f65640 1 -- 172.21.15.172:0/2382532018 learned_addr learned my addr 172.21.15.172:0/2382532018 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc78bfff640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc78c06abe0 0x7fc78c156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc78b7fe640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc78c0ad570 0x7fc78c158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc790f65640 1 -- 172.21.15.172:0/2382532018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc78c06abe0 msgr2=0x7fc78c156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc790f65640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc78c06abe0 0x7fc78c156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc790f65640 1 -- 172.21.15.172:0/2382532018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc78c0ad570 msgr2=0x7fc78c158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc790f65640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc78c0ad570 0x7fc78c158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc790f65640 1 -- 172.21.15.172:0/2382532018 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c1e9eb0 con 0x7fc78c15dd80 2024-04-25T08:50:47.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc790f65640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c15dd80 0x7fc78c1f7030 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fc784009e50 tx=0x7fc784004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:47.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc788ff9640 1 -- 172.21.15.172:0/2382532018 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784036050 con 0x7fc78c15dd80 2024-04-25T08:50:47.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc788ff9640 1 -- 172.21.15.172:0/2382532018 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc784042070 con 0x7fc78c15dd80 2024-04-25T08:50:47.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc7929c8640 1 -- 172.21.15.172:0/2382532018 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c1e6b70 con 0x7fc78c15dd80 2024-04-25T08:50:47.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.133+0000 7fc788ff9640 1 -- 172.21.15.172:0/2382532018 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784009510 con 0x7fc78c15dd80 2024-04-25T08:50:47.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.134+0000 7fc7929c8640 1 -- 172.21.15.172:0/2382532018 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c1e7130 con 0x7fc78c15dd80 2024-04-25T08:50:47.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.134+0000 7fc7929c8640 1 -- 172.21.15.172:0/2382532018 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c073a00 con 0x7fc78c15dd80 2024-04-25T08:50:47.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.135+0000 7fc788ff9640 1 -- 172.21.15.172:0/2382532018 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc784007bd0 con 0x7fc78c15dd80 2024-04-25T08:50:47.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.135+0000 7fc788ff9640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc77806b4d0 0x7fc77806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.135+0000 7fc788ff9640 1 -- 172.21.15.172:0/2382532018 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc7840aae00 con 0x7fc78c15dd80 2024-04-25T08:50:47.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.135+0000 7fc78bfff640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc77806b4d0 0x7fc77806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.136+0000 7fc78bfff640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc77806b4d0 0x7fc77806d990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc77c001780 tx=0x7fc77c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:47.130 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.140+0000 7fc788ff9640 1 -- 172.21.15.172:0/2382532018 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc784079790 con 0x7fc78c15dd80 2024-04-25T08:50:47.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.309+0000 7fc7929c8640 1 -- 172.21.15.172:0/2382532018 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc78c0ae3e0 con 0x7fc78c15dd80 2024-04-25T08:50:47.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.313+0000 7fc788ff9640 1 -- 172.21.15.172:0/2382532018 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc78407d830 con 0x7fc78c15dd80 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 -- 172.21.15.172:0/2382532018 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc77806b4d0 msgr2=0x7fc77806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc77806b4d0 0x7fc77806d990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc77c001780 tx=0x7fc77c009040 comp rx=0 tx=0).stop 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 -- 172.21.15.172:0/2382532018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c15dd80 msgr2=0x7fc78c1f7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c15dd80 0x7fc78c1f7030 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fc784009e50 tx=0x7fc784004a40 comp rx=0 tx=0).stop 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 -- 172.21.15.172:0/2382532018 shutdown_connections 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc77806b4d0 0x7fc77806d990 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc78c0ad570 0x7fc78c158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc78c15dd80 0x7fc78c1f7030 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 --2- 172.21.15.172:0/2382532018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc78c06abe0 0x7fc78c156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 -- 172.21.15.172:0/2382532018 >> 172.21.15.172:0/2382532018 conn(0x7fc78c0b5af0 msgr2=0x7fc78c0af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 -- 172.21.15.172:0/2382532018 shutdown_connections 2024-04-25T08:50:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.315+0000 7fc7929c8640 1 -- 172.21.15.172:0/2382532018 wait complete. 2024-04-25T08:50:47.317 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:50:47.317 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:50:47.358 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:50:47.400 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:50:47.400 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:50:47.400 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:50:47.416 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:50:47.416 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:50:47.416 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:50:47.458 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:50:47.458 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:50:47.458 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:50:47.473 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:50:47.473 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:50:47.474 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:50:47.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:50:47.516 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:50:47.516 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:47.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.623+0000 7fb8f970a640 1 Processor -- start 2024-04-25T08:50:47.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.623+0000 7fb8f970a640 1 -- start start 2024-04-25T08:50:47.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f970a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f41602e0 0x7fb8f40ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f970a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb8f415f5f0 0x7fb8f415faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f970a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f40cd710 con 0x7fb8f415ba00 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f970a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f4099b70 con 0x7fb8f415f5f0 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f970a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4099e50 con 0x7fb8f41602e0 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f2ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb8f415ba00 0x7fb8f409a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42984/0 (socket says 172.21.15.172:42984) 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f2ffd640 1 -- 172.21.15.172:0/180882243 learned_addr learned my addr 172.21.15.172:0/180882243 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f27fc640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f41602e0 0x7fb8f40ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f37fe640 1 --2- 172.21.15.172:0/180882243 >> v2:172.21.15.186:3300/0 conn(0x7fb8f415f5f0 0x7fb8f415faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777629708 0 0) 0x7fb8e4001490 con 0x7fb8f415ba00 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.624+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8dc003520 con 0x7fb8f415ba00 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3316802211 0 0) 0x7fb8dc003520 con 0x7fb8f415ba00 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f41602e0 msgr2=0x7fb8f40ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f41602e0 0x7fb8f40ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 >> v2:172.21.15.186:3300/0 conn(0x7fb8f415f5f0 msgr2=0x7fb8f415faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 --2- 172.21.15.172:0/180882243 >> v2:172.21.15.186:3300/0 conn(0x7fb8f415f5f0 0x7fb8f415faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f409a130 con 0x7fb8f415ba00 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fb8e4001bc0 con 0x7fb8f415ba00 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 >> v1:172.21.15.172:6789/0 conn(0x7fb8f415ba00 legacy=0x7fb8f409a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8dc0039b0 0x7fb8dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8dc004800 0x7fb8dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f41602e0 0x7fb8dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4099b70 con 0x7fb8dc0039b0 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4099e50 con 0x7fb8dc004800 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc00ba40 con 0x7fb8f41602e0 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f2ffd640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8dc0039b0 0x7fb8dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f27fc640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8dc004800 0x7fb8dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f37fe640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f41602e0 0x7fb8dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f2ffd640 1 -- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f41602e0 msgr2=0x7fb8dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f2ffd640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f41602e0 0x7fb8dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f2ffd640 1 -- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8dc004800 msgr2=0x7fb8dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f2ffd640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8dc004800 0x7fb8dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.625+0000 7fb8f2ffd640 1 -- 172.21.15.172:0/180882243 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc003520 con 0x7fb8dc0039b0 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.626+0000 7fb8f2ffd640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8dc0039b0 0x7fb8dc003dd0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400aa40 tx=0x7fb8dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3186eaecdb37e59c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.626+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400a690 con 0x7fb8dc0039b0 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.626+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e402f070 con 0x7fb8dc0039b0 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.626+0000 7fb8f1ffb640 1 -- 172.21.15.172:0/180882243 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4034470 con 0x7fb8dc0039b0 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.626+0000 7fb8f970a640 1 -- 172.21.15.172:0/180882243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8dc0039b0 msgr2=0x7fb8dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.626+0000 7fb8f970a640 1 --2- 172.21.15.172:0/180882243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8dc0039b0 0x7fb8dc003dd0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400aa40 tx=0x7fb8dc005830 comp rx=0 tx=0).stop 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.626+0000 7fb8f37fe640 1 -- 172.21.15.172:0/180882243 reap_dead start 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.627+0000 7fb8f970a640 1 -- 172.21.15.172:0/180882243 shutdown_connections 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.627+0000 7fb8f970a640 1 -- 172.21.15.172:0/180882243 >> 172.21.15.172:0/180882243 conn(0x7fb8f40b3270 msgr2=0x7fb8f40b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.627+0000 7fb8f970a640 1 -- 172.21.15.172:0/180882243 shutdown_connections 2024-04-25T08:50:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.627+0000 7fb8f970a640 1 -- 172.21.15.172:0/180882243 wait complete. 2024-04-25T08:50:47.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.628+0000 7fb8f970a640 1 Processor -- start 2024-04-25T08:50:47.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.628+0000 7fb8f970a640 1 -- start start 2024-04-25T08:50:47.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f970a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8dc0039b0 0x7fb8f40b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f970a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f40cb490 0x7fb8f40b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f970a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f40b6c20 0x7fb8f41e6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f970a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40ccf20 con 0x7fb8f40cb490 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f970a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40ccda0 con 0x7fb8dc0039b0 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f970a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40cd0a0 con 0x7fb8f40b6c20 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f27fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f40cb490 0x7fb8f40b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f27fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f40cb490 0x7fb8f40b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38842/0 (socket says 172.21.15.172:38842) 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f27fc640 1 -- 172.21.15.172:0/1505230117 learned_addr learned my addr 172.21.15.172:0/1505230117 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f2ffd640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8dc0039b0 0x7fb8f40b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f27fc640 1 -- 172.21.15.172:0/1505230117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f40b6c20 msgr2=0x7fb8f41e6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f27fc640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f40b6c20 0x7fb8f41e6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f27fc640 1 -- 172.21.15.172:0/1505230117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8dc0039b0 msgr2=0x7fb8f40b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f27fc640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8dc0039b0 0x7fb8f40b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f27fc640 1 -- 172.21.15.172:0/1505230117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f41e78c0 con 0x7fb8f40cb490 2024-04-25T08:50:47.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f27fc640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f40cb490 0x7fb8f40b66e0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80118e0 tx=0x7fb8e8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8db7fe640 1 -- 172.21.15.172:0/1505230117 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800fa70 con 0x7fb8f40cb490 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8db7fe640 1 -- 172.21.15.172:0/1505230117 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e800fc10 con 0x7fb8f40cb490 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f970a640 1 -- 172.21.15.172:0/1505230117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f41e7ba0 con 0x7fb8f40cb490 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8db7fe640 1 -- 172.21.15.172:0/1505230117 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8014440 con 0x7fb8f40cb490 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.629+0000 7fb8f970a640 1 -- 172.21.15.172:0/1505230117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f40b70a0 con 0x7fb8f40cb490 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.630+0000 7fb8f970a640 1 -- 172.21.15.172:0/1505230117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f40c7790 con 0x7fb8f40cb490 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.631+0000 7fb8db7fe640 1 -- 172.21.15.172:0/1505230117 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb8e8012040 con 0x7fb8f40cb490 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.631+0000 7fb8db7fe640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8e006b4d0 0x7fb8e006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.631+0000 7fb8db7fe640 1 -- 172.21.15.172:0/1505230117 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb8e808a6c0 con 0x7fb8f40cb490 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.631+0000 7fb8f2ffd640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8e006b4d0 0x7fb8e006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:47.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.632+0000 7fb8f2ffd640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8e006b4d0 0x7fb8e006d990 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4033000 tx=0x7fb8e402d000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:47.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.635+0000 7fb8db7fe640 1 -- 172.21.15.172:0/1505230117 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8f40c7790 con 0x7fb8f40cb490 2024-04-25T08:50:47.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.842+0000 7fb8f970a640 1 -- 172.21.15.172:0/1505230117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8f4073990 con 0x7fb8f40cb490 2024-04-25T08:50:47.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.842+0000 7fb8db7fe640 1 -- 172.21.15.172:0/1505230117 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fb8e8019030 con 0x7fb8f40cb490 2024-04-25T08:50:47.833 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:47.833 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2440917415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2440917415},{"type":"v1","addr":"172.21.15.186:6834","nonce":2440917415}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":7423,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/3658954581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":3658954581},{"type":"v1","addr":"172.21.15.186:6835","nonce":3658954581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":8667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/202046960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":202046960},{"type":"v1","addr":"172.21.15.172:6835","nonce":202046960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65},{"gid":9207,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/715608842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":715608842},{"type":"v1","addr":"172.21.15.172:6837","nonce":715608842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":70}],"filesystems":[]} 2024-04-25T08:50:47.834 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 70 2024-04-25T08:50:47.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 -- 172.21.15.172:0/1505230117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8e006b4d0 msgr2=0x7fb8e006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8e006b4d0 0x7fb8e006d990 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4033000 tx=0x7fb8e402d000 comp rx=0 tx=0).stop 2024-04-25T08:50:47.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 -- 172.21.15.172:0/1505230117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f40cb490 msgr2=0x7fb8f40b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:47.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f40cb490 0x7fb8f40b66e0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80118e0 tx=0x7fb8e8011da0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 -- 172.21.15.172:0/1505230117 shutdown_connections 2024-04-25T08:50:47.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb8e006b4d0 0x7fb8e006d990 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f40b6c20 0x7fb8f41e6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f40cb490 0x7fb8f40b66e0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 --2- 172.21.15.172:0/1505230117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8dc0039b0 0x7fb8f40b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:47.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 -- 172.21.15.172:0/1505230117 >> 172.21.15.172:0/1505230117 conn(0x7fb8f40b3270 msgr2=0x7fb8f4070660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:47.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.844+0000 7fb8f970a640 1 -- 172.21.15.172:0/1505230117 shutdown_connections 2024-04-25T08:50:47.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:47.845+0000 7fb8f970a640 1 -- 172.21.15.172:0/1505230117 wait complete. 2024-04-25T08:50:47.847 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:50:47.847 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:50:47.847 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:50:47.848 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:50:47.848 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:50:47.848 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T08:50:47.848 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:50:47.848 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:50:47.848 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:50:47.848 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:50:47.849 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:50:47.849 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:50:47.849 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:50:47.849 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:50:47.849 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:50:47.849 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:50:47.857 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:50:47.857 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:50:47.858 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:50:47.858 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:50:47.861 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:50:47.861 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:50:47.862 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:50:47.862 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:50:47.900 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:50:47.900 DEBUG:teuthology.parallel:result is None 2024-04-25T08:50:47.901 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:50:47.901 DEBUG:teuthology.parallel:result is None 2024-04-25T08:50:47.903 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:50:47.904 DEBUG:teuthology.parallel:result is None 2024-04-25T08:50:47.904 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:50:47.904 DEBUG:teuthology.parallel:result is None 2024-04-25T08:50:47.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:50:47.972 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:50:47.973 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:50:47.985 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:50:47.985 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:50:47.985 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T08:50:47.995+0000 7f5bc3fd6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-25T08:50:48.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.019+0000 7f9dbb532640 1 Processor -- start 2024-04-25T08:50:48.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.019+0000 7f9dbb532640 1 -- start start 2024-04-25T08:50:48.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.020+0000 7f9dbb532640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9db40c6830 0x7f9db406bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:48.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.020+0000 7f9dbb532640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db40704f0 con 0x7f9db406fc50 2024-04-25T08:50:48.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.020+0000 7f9db8acd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9db406fc50 0x7f9db40cbee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42992/0 (socket says 172.21.15.172:42992) 2024-04-25T08:50:48.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.020+0000 7f9dbb532640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db40ca540 con 0x7f9db415de60 2024-04-25T08:50:48.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.020+0000 7f9db8acd640 1 -- 172.21.15.172:0/4237533187 learned_addr learned my addr 172.21.15.172:0/4237533187 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:48.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.020+0000 7f9dbb532640 1 -- 172.21.15.172:0/4237533187 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db40c6ca0 con 0x7f9db40c6830 2024-04-25T08:50:48.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.020+0000 7f9db9acf640 1 --2- 172.21.15.172:0/4237533187 >> v2:172.21.15.186:3300/0 conn(0x7f9db40c6830 0x7f9db406bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:48.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.021+0000 7f9db9acf640 1 -- 172.21.15.172:0/4237533187 >> v1:172.21.15.186:6789/0 conn(0x7f9db415de60 legacy=0x7f9db415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:48.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.021+0000 7f9db9acf640 1 -- 172.21.15.172:0/4237533187 >> v1:172.21.15.172:6789/0 conn(0x7f9db406fc50 legacy=0x7f9db40cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:48.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.021+0000 7f9db9acf640 1 -- 172.21.15.172:0/4237533187 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db40ca820 con 0x7f9db40c6830 2024-04-25T08:50:48.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.021+0000 7f9db9acf640 1 --2- 172.21.15.172:0/4237533187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9db40c6830 0x7f9db406bbf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009d90 tx=0x7f9dac02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71b7ba83638ef167 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:48.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.027+0000 7f9dabfff640 1 -- 172.21.15.172:0/4237533187 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac007740 con 0x7f9db40c6830 2024-04-25T08:50:48.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.027+0000 7f9dabfff640 1 -- 172.21.15.172:0/4237533187 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac0078e0 con 0x7f9db40c6830 2024-04-25T08:50:48.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.027+0000 7f9dabfff640 1 -- 172.21.15.172:0/4237533187 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac007cb0 con 0x7f9db40c6830 2024-04-25T08:50:48.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.028+0000 7f9dbb532640 1 -- 172.21.15.172:0/4237533187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9db40c6830 msgr2=0x7f9db406bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:48.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.028+0000 7f9dbb532640 1 --2- 172.21.15.172:0/4237533187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9db40c6830 0x7f9db406bbf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009d90 tx=0x7f9dac02a6f0 comp rx=0 tx=0).stop 2024-04-25T08:50:48.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.028+0000 7f9dbb532640 1 -- 172.21.15.172:0/4237533187 shutdown_connections 2024-04-25T08:50:48.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.028+0000 7f9dbb532640 1 --2- 172.21.15.172:0/4237533187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9db40c6830 0x7f9db406bbf0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:48.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.028+0000 7f9dbb532640 1 -- 172.21.15.172:0/4237533187 >> 172.21.15.172:0/4237533187 conn(0x7f9db4071af0 msgr2=0x7f9db4071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:48.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.028+0000 7f9dbb532640 1 -- 172.21.15.172:0/4237533187 shutdown_connections 2024-04-25T08:50:48.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.028+0000 7f9dbb532640 1 -- 172.21.15.172:0/4237533187 wait complete. 2024-04-25T08:50:48.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.030+0000 7f9dbb532640 1 Processor -- start 2024-04-25T08:50:48.020 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.030+0000 7f9dbb532640 1 -- start start 2024-04-25T08:50:48.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9dbb532640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db406fc50 0x7f9db4141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:48.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9dbb532640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9db40c6830 0x7f9db40c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:48.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9dbb532640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9db415de60 0x7f9db40b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:48.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9dbb532640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40cc5f0 con 0x7f9db406fc50 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9dbb532640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40cf1d0 con 0x7f9db40c6830 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9dbb532640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40cfa30 con 0x7f9db415de60 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db92ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db406fc50 0x7f9db4141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db92ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db406fc50 0x7f9db4141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38868/0 (socket says 172.21.15.172:38868) 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db92ce640 1 -- 172.21.15.172:0/3739201015 learned_addr learned my addr 172.21.15.172:0/3739201015 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db8acd640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9db40c6830 0x7f9db40c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db9acf640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9db415de60 0x7f9db40b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db92ce640 1 -- 172.21.15.172:0/3739201015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9db415de60 msgr2=0x7f9db40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db92ce640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9db415de60 0x7f9db40b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db92ce640 1 -- 172.21.15.172:0/3739201015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9db40c6830 msgr2=0x7f9db40c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db92ce640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9db40c6830 0x7f9db40c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db92ce640 1 -- 172.21.15.172:0/3739201015 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db40c8da0 con 0x7f9db406fc50 2024-04-25T08:50:48.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9db92ce640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db406fc50 0x7f9db4141980 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f9db000c430 tx=0x7f9db000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:48.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9da9ffb640 1 -- 172.21.15.172:0/3739201015 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0017070 con 0x7f9db406fc50 2024-04-25T08:50:48.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9da9ffb640 1 -- 172.21.15.172:0/3739201015 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db00052d0 con 0x7f9db406fc50 2024-04-25T08:50:48.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9dbb532640 1 -- 172.21.15.172:0/3739201015 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db40c9080 con 0x7f9db406fc50 2024-04-25T08:50:48.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.031+0000 7f9da9ffb640 1 -- 172.21.15.172:0/3739201015 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0003830 con 0x7f9db406fc50 2024-04-25T08:50:48.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.032+0000 7f9dbb532640 1 -- 172.21.15.172:0/3739201015 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db40c9640 con 0x7f9db406fc50 2024-04-25T08:50:48.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.032+0000 7f9dbb532640 1 -- 172.21.15.172:0/3739201015 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db4073a00 con 0x7f9db406fc50 2024-04-25T08:50:48.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.033+0000 7f9da9ffb640 1 -- 172.21.15.172:0/3739201015 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9db001a070 con 0x7f9db406fc50 2024-04-25T08:50:48.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.033+0000 7f9da9ffb640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d9806b4d0 0x7f9d9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:48.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.033+0000 7f9da9ffb640 1 -- 172.21.15.172:0/3739201015 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f9db0089400 con 0x7f9db406fc50 2024-04-25T08:50:48.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.033+0000 7f9db8acd640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d9806b4d0 0x7f9d9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:48.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.034+0000 7f9db8acd640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d9806b4d0 0x7f9d9806d990 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9db40cedc0 tx=0x7f9da4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:48.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.038+0000 7f9da9ffb640 1 -- 172.21.15.172:0/3739201015 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9db0057d00 con 0x7f9db406fc50 2024-04-25T08:50:48.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:48.225+0000 7f9dbb532640 1 -- 172.21.15.172:0/3739201015 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9db406b720 con 0x7f9db406fc50 2024-04-25T08:50:49.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.040+0000 7f9da9ffb640 1 -- 172.21.15.172:0/3739201015 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v127) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9db0087e20 con 0x7f9db406fc50 2024-04-25T08:50:49.033 INFO:teuthology.orchestra.run.smithi172.stderr: removed all blocklist entries 2024-04-25T08:50:49.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.042+0000 7f9dbb532640 1 -- 172.21.15.172:0/3739201015 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d9806b4d0 msgr2=0x7f9d9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.042+0000 7f9dbb532640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d9806b4d0 0x7f9d9806d990 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9db40cedc0 tx=0x7f9da4009040 comp rx=0 tx=0).stop 2024-04-25T08:50:49.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.042+0000 7f9dbb532640 1 -- 172.21.15.172:0/3739201015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db406fc50 msgr2=0x7f9db4141980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.034 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.042+0000 7f9dbb532640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db406fc50 0x7f9db4141980 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f9db000c430 tx=0x7f9db000c8f0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.042+0000 7f9dbb532640 1 -- 172.21.15.172:0/3739201015 shutdown_connections 2024-04-25T08:50:49.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.042+0000 7f9dbb532640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9d9806b4d0 0x7f9d9806d990 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.042+0000 7f9dbb532640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9db40c6830 0x7f9db40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.042+0000 7f9dbb532640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9db415de60 0x7f9db40b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.043+0000 7f9dbb532640 1 --2- 172.21.15.172:0/3739201015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db406fc50 0x7f9db4141980 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.043+0000 7f9dbb532640 1 -- 172.21.15.172:0/3739201015 >> 172.21.15.172:0/3739201015 conn(0x7f9db4071af0 msgr2=0x7f9db406bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:49.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.043+0000 7f9dbb532640 1 -- 172.21.15.172:0/3739201015 shutdown_connections 2024-04-25T08:50:49.035 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.043+0000 7f9dbb532640 1 -- 172.21.15.172:0/3739201015 wait complete. 2024-04-25T08:50:49.046 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:50:49.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.155+0000 7f1ad9142640 1 Processor -- start 2024-04-25T08:50:49.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.155+0000 7f1ad9142640 1 -- start start 2024-04-25T08:50:49.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad9142640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1ad406b1a0 0x7f1ad406f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.148 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad9142640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1ad40d0170 0x7f1ad415d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad9142640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad4161960 con 0x7f1ad406b580 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad9142640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40cbd50 con 0x7f1ad40d0170 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad9142640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad4161c40 con 0x7f1ad406b1a0 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad359e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1ad40d0170 0x7f1ad415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad359e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1ad40d0170 0x7f1ad415d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38878/0 (socket says 172.21.15.172:38878) 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad359e640 1 -- 172.21.15.172:0/987395461 learned_addr learned my addr 172.21.15.172:0/987395461 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad2d9d640 1 --2- 172.21.15.172:0/987395461 >> v2:172.21.15.186:3300/0 conn(0x7f1ad406b1a0 0x7f1ad406f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad359e640 1 -- 172.21.15.172:0/987395461 >> v2:172.21.15.186:3300/0 conn(0x7f1ad406b1a0 msgr2=0x7f1ad406f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad359e640 1 --2- 172.21.15.172:0/987395461 >> v2:172.21.15.186:3300/0 conn(0x7f1ad406b1a0 0x7f1ad406f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad359e640 1 -- 172.21.15.172:0/987395461 >> v1:172.21.15.186:6789/0 conn(0x7f1ad406b580 legacy=0x7f1ad40cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.156+0000 7f1ad359e640 1 -- 172.21.15.172:0/987395461 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4161f20 con 0x7f1ad40d0170 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.157+0000 7f1ad359e640 1 --2- 172.21.15.172:0/987395461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad40d0170 0x7f1ad415d370 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40d17d0 tx=0x7f1acc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb22ddd6efc683f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.157+0000 7f1ad1d9b640 1 -- 172.21.15.172:0/987395461 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc036070 con 0x7f1ad40d0170 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.157+0000 7f1ad1d9b640 1 -- 172.21.15.172:0/987395461 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc031600 con 0x7f1ad40d0170 2024-04-25T08:50:49.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.157+0000 7f1ad1d9b640 1 -- 172.21.15.172:0/987395461 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc0319d0 con 0x7f1ad40d0170 2024-04-25T08:50:49.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.158+0000 7f1ad9142640 1 -- 172.21.15.172:0/987395461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad40d0170 msgr2=0x7f1ad415d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.158+0000 7f1ad9142640 1 --2- 172.21.15.172:0/987395461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad40d0170 0x7f1ad415d370 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40d17d0 tx=0x7f1acc02a6a0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.158+0000 7f1ad9142640 1 -- 172.21.15.172:0/987395461 shutdown_connections 2024-04-25T08:50:49.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.158+0000 7f1ad9142640 1 --2- 172.21.15.172:0/987395461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad40d0170 0x7f1ad415d370 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.158+0000 7f1ad9142640 1 --2- 172.21.15.172:0/987395461 >> v2:172.21.15.186:3300/0 conn(0x7f1ad406b1a0 0x7f1ad406f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.158+0000 7f1ad9142640 1 -- 172.21.15.172:0/987395461 >> 172.21.15.172:0/987395461 conn(0x7f1ad40b2220 msgr2=0x7f1ad40b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:49.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.158+0000 7f1ad9142640 1 -- 172.21.15.172:0/987395461 shutdown_connections 2024-04-25T08:50:49.150 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.158+0000 7f1ad9142640 1 -- 172.21.15.172:0/987395461 wait complete. 2024-04-25T08:50:49.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.159+0000 7f1ad9142640 1 Processor -- start 2024-04-25T08:50:49.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.159+0000 7f1ad9142640 1 -- start start 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad9142640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad406b1a0 0x7f1ad4150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad9142640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ad406b580 0x7f1ad40b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad9142640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ad40d0170 0x7f1ad40b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad9142640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4070330 con 0x7f1ad406b1a0 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad9142640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4162720 con 0x7f1ad406b580 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad9142640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad406ff00 con 0x7f1ad40d0170 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad406b1a0 0x7f1ad4150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad406b1a0 0x7f1ad4150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38890/0 (socket says 172.21.15.172:38890) 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad2d9d640 1 -- 172.21.15.172:0/1856164295 learned_addr learned my addr 172.21.15.172:0/1856164295 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad259c640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ad406b580 0x7f1ad40b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad359e640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ad40d0170 0x7f1ad40b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad2d9d640 1 -- 172.21.15.172:0/1856164295 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ad40d0170 msgr2=0x7f1ad40b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad2d9d640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ad40d0170 0x7f1ad40b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad2d9d640 1 -- 172.21.15.172:0/1856164295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ad406b580 msgr2=0x7f1ad40b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad2d9d640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ad406b580 0x7f1ad40b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad2d9d640 1 -- 172.21.15.172:0/1856164295 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad40b4590 con 0x7f1ad406b1a0 2024-04-25T08:50:49.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad259c640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ad406b580 0x7f1ad40b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:49.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.160+0000 7f1ad2d9d640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad406b1a0 0x7f1ad4150c20 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400d800 tx=0x7f1ac400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:49.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.161+0000 7f1abb7fe640 1 -- 172.21.15.172:0/1856164295 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400b6c0 con 0x7f1ad406b1a0 2024-04-25T08:50:49.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.161+0000 7f1abb7fe640 1 -- 172.21.15.172:0/1856164295 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac4019070 con 0x7f1ad406b1a0 2024-04-25T08:50:49.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.161+0000 7f1ad9142640 1 -- 172.21.15.172:0/1856164295 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad41e7650 con 0x7f1ad406b1a0 2024-04-25T08:50:49.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.161+0000 7f1abb7fe640 1 -- 172.21.15.172:0/1856164295 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac400ba80 con 0x7f1ad406b1a0 2024-04-25T08:50:49.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.161+0000 7f1ad9142640 1 -- 172.21.15.172:0/1856164295 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad41e7c10 con 0x7f1ad406b1a0 2024-04-25T08:50:49.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.162+0000 7f1ad9142640 1 -- 172.21.15.172:0/1856164295 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad40cecc0 con 0x7f1ad406b1a0 2024-04-25T08:50:49.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.162+0000 7f1abb7fe640 1 -- 172.21.15.172:0/1856164295 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ac400bc20 con 0x7f1ad406b1a0 2024-04-25T08:50:49.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.162+0000 7f1abb7fe640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ac006b500 0x7f1ac006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.163+0000 7f1abb7fe640 1 -- 172.21.15.172:0/1856164295 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1ac408a4a0 con 0x7f1ad406b1a0 2024-04-25T08:50:49.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.163+0000 7f1ad259c640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ac006b500 0x7f1ac006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.163+0000 7f1ad259c640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ac006b500 0x7f1ac006d9c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40c9c00 tx=0x7f1ac8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:49.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.167+0000 7f1abb7fe640 1 -- 172.21.15.172:0/1856164295 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ad40cecc0 con 0x7f1ad406b1a0 2024-04-25T08:50:49.410 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.420+0000 7f1ad9142640 1 -- 172.21.15.172:0/1856164295 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1ad40cd020 con 0x7f1ad406b1a0 2024-04-25T08:50:49.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.420+0000 7f1abb7fe640 1 -- 172.21.15.172:0/1856164295 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1ac401c360 con 0x7f1ad406b1a0 2024-04-25T08:50:49.411 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:49.411 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:50:49.411 INFO:teuthology.orchestra.run.smithi172.stdout: "auth_dump": [ 2024-04-25T08:50:49.411 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.411 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.a", 2024-04-25T08:50:49.411 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q==", 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.b", 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg==", 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:50:49.412 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.c", 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA==", 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.d", 2024-04-25T08:50:49.413 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg==", 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.0", 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ==", 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:50:49.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.1", 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g==", 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.2", 2024-04-25T08:50:49.415 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g==", 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.3", 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg==", 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.4", 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw==", 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.5", 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow==", 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:50:49.417 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.6", 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg==", 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.418 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.7", 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q==", 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.0", 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q==", 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow r", 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:50:49.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.1", 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g==", 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.2", 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw==", 2024-04-25T08:50:49.420 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.3", 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w==", 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:50:49.421 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.admin", 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmFmQsIBAAkuAmqIptAT1ivH6T7/1T8A==", 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.x", 2024-04-25T08:50:49.422 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw==", 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.y", 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg==", 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:50:49.423 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.424 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:49.424 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-25T08:50:49.424 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:50:49.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.422+0000 7f1ad9142640 1 -- 172.21.15.172:0/1856164295 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ac006b500 msgr2=0x7f1ac006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.422+0000 7f1ad9142640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ac006b500 0x7f1ac006d9c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40c9c00 tx=0x7f1ac8009040 comp rx=0 tx=0).stop 2024-04-25T08:50:49.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.422+0000 7f1ad9142640 1 -- 172.21.15.172:0/1856164295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad406b1a0 msgr2=0x7f1ad4150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.422+0000 7f1ad9142640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad406b1a0 0x7f1ad4150c20 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400d800 tx=0x7f1ac400dcc0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.423+0000 7f1ad9142640 1 -- 172.21.15.172:0/1856164295 shutdown_connections 2024-04-25T08:50:49.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.423+0000 7f1ad9142640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ac006b500 0x7f1ac006d9c0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.423+0000 7f1ad9142640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ad406b580 0x7f1ad40b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.423+0000 7f1ad9142640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ad40d0170 0x7f1ad40b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.423+0000 7f1ad9142640 1 --2- 172.21.15.172:0/1856164295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ad406b1a0 0x7f1ad4150c20 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.423+0000 7f1ad9142640 1 -- 172.21.15.172:0/1856164295 >> 172.21.15.172:0/1856164295 conn(0x7f1ad40b2220 msgr2=0x7f1ad40b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:49.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.423+0000 7f1ad9142640 1 -- 172.21.15.172:0/1856164295 shutdown_connections 2024-04-25T08:50:49.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.423+0000 7f1ad9142640 1 -- 172.21.15.172:0/1856164295 wait complete. 2024-04-25T08:50:49.426 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:49.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.534+0000 7f1228590640 1 Processor -- start 2024-04-25T08:50:49.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.534+0000 7f1228590640 1 -- start start 2024-04-25T08:50:49.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1228590640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f122006b1a0 0x7f122006f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1228590640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f122006b580 0x7f12200cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1228590640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1220161960 con 0x7f12200cffa0 2024-04-25T08:50:49.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1228590640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12200d0430 con 0x7f122006b580 2024-04-25T08:50:49.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1228590640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12200cbd50 con 0x7f122006b1a0 2024-04-25T08:50:49.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1225b2b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f122006b580 0x7f12200cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1226b2d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f12200cffa0 0x7f122006e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42998/0 (socket says 172.21.15.172:42998) 2024-04-25T08:50:49.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1226b2d640 1 -- 172.21.15.172:0/2979931790 learned_addr learned my addr 172.21.15.172:0/2979931790 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f122632c640 1 --2- 172.21.15.172:0/2979931790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f122006b1a0 0x7f122006f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1225b2b640 1 -- 172.21.15.172:0/2979931790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f122006b1a0 msgr2=0x7f122006f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1225b2b640 1 --2- 172.21.15.172:0/2979931790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f122006b1a0 0x7f122006f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1225b2b640 1 -- 172.21.15.172:0/2979931790 >> v1:172.21.15.172:6789/0 conn(0x7f12200cffa0 legacy=0x7f122006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f122532a640 1 -- 172.21.15.172:0/2979931790 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653557357 0 0) 0x7f1220161960 con 0x7f12200cffa0 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.535+0000 7f1225b2b640 1 -- 172.21.15.172:0/2979931790 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220161c40 con 0x7f122006b580 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.536+0000 7f1225b2b640 1 --2- 172.21.15.172:0/2979931790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 0x7f12200cfa60 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f12100097a0 tx=0x7f121002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb8739c8e7b2493 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.536+0000 7f122532a640 1 -- 172.21.15.172:0/2979931790 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210037070 con 0x7f122006b580 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.536+0000 7f122532a640 1 -- 172.21.15.172:0/2979931790 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121002ae50 con 0x7f122006b580 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.536+0000 7f122532a640 1 -- 172.21.15.172:0/2979931790 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210032660 con 0x7f122006b580 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.536+0000 7f1228590640 1 -- 172.21.15.172:0/2979931790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 msgr2=0x7f12200cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.536+0000 7f1228590640 1 --2- 172.21.15.172:0/2979931790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 0x7f12200cfa60 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f12100097a0 tx=0x7f121002a100 comp rx=0 tx=0).stop 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.536+0000 7f1228590640 1 -- 172.21.15.172:0/2979931790 shutdown_connections 2024-04-25T08:50:49.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.536+0000 7f1228590640 1 --2- 172.21.15.172:0/2979931790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 0x7f12200cfa60 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.536+0000 7f1228590640 1 --2- 172.21.15.172:0/2979931790 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f122006b1a0 0x7f122006f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.536+0000 7f1228590640 1 -- 172.21.15.172:0/2979931790 >> 172.21.15.172:0/2979931790 conn(0x7f12200b2220 msgr2=0x7f12200b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:49.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.537+0000 7f1228590640 1 -- 172.21.15.172:0/2979931790 shutdown_connections 2024-04-25T08:50:49.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.537+0000 7f1228590640 1 -- 172.21.15.172:0/2979931790 wait complete. 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1228590640 1 Processor -- start 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1228590640 1 -- start start 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1228590640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f122006b1a0 0x7f12200c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1228590640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 0x7f12200b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1228590640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12200cffa0 0x7f122015ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1228590640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1220162720 con 0x7f122006b580 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1228590640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1220162200 con 0x7f12200cffa0 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1228590640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1220070330 con 0x7f122006b1a0 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1225b2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 0x7f12200b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1225b2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 0x7f12200b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38906/0 (socket says 172.21.15.172:38906) 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.538+0000 7f1225b2b640 1 -- 172.21.15.172:0/2223410362 learned_addr learned my addr 172.21.15.172:0/2223410362 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:49.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f122632c640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f122006b1a0 0x7f12200c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1226b2d640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12200cffa0 0x7f122015ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1225b2b640 1 -- 172.21.15.172:0/2223410362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f122006b1a0 msgr2=0x7f12200c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1225b2b640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f122006b1a0 0x7f12200c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1225b2b640 1 -- 172.21.15.172:0/2223410362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12200cffa0 msgr2=0x7f122015ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1225b2b640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12200cffa0 0x7f122015ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1225b2b640 1 -- 172.21.15.172:0/2223410362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12201f6ed0 con 0x7f122006b580 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1225b2b640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 0x7f12200b1580 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f1210035040 tx=0x7f12100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1216ffd640 1 -- 172.21.15.172:0/2223410362 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210037040 con 0x7f122006b580 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1216ffd640 1 -- 172.21.15.172:0/2223410362 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1210004030 con 0x7f122006b580 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1228590640 1 -- 172.21.15.172:0/2223410362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12201f71b0 con 0x7f122006b580 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1216ffd640 1 -- 172.21.15.172:0/2223410362 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210004420 con 0x7f122006b580 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.539+0000 7f1228590640 1 -- 172.21.15.172:0/2223410362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12201f7770 con 0x7f122006b580 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.540+0000 7f1228590640 1 -- 172.21.15.172:0/2223410362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12200008d0 con 0x7f122006b580 2024-04-25T08:50:49.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.540+0000 7f1216ffd640 1 -- 172.21.15.172:0/2223410362 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1210003610 con 0x7f122006b580 2024-04-25T08:50:49.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.541+0000 7f1216ffd640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f120406b4d0 0x7f120406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.541+0000 7f122632c640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f120406b4d0 0x7f120406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.541+0000 7f1216ffd640 1 -- 172.21.15.172:0/2223410362 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f12100aac80 con 0x7f122006b580 2024-04-25T08:50:49.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.541+0000 7f122632c640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f120406b4d0 0x7f120406d990 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f12200d0860 tx=0x7f121c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:49.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.545+0000 7f1216ffd640 1 -- 172.21.15.172:0/2223410362 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1210079820 con 0x7f122006b580 2024-04-25T08:50:49.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.718+0000 7f1228590640 1 -- 172.21.15.172:0/2223410362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12200c6870 con 0x7f122006b580 2024-04-25T08:50:49.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.718+0000 7f1216ffd640 1 -- 172.21.15.172:0/2223410362 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+13234 (secure 0 0 0) 0x7f121007d8c0 con 0x7f122006b580 2024-04-25T08:50:49.709 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:49.709 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":127,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:49.039447+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:49.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.720+0000 7f1228590640 1 -- 172.21.15.172:0/2223410362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f120406b4d0 msgr2=0x7f120406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.720+0000 7f1228590640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f120406b4d0 0x7f120406d990 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f12200d0860 tx=0x7f121c008040 comp rx=0 tx=0).stop 2024-04-25T08:50:49.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.720+0000 7f1228590640 1 -- 172.21.15.172:0/2223410362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 msgr2=0x7f12200b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.720+0000 7f1228590640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 0x7f12200b1580 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f1210035040 tx=0x7f12100046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.721+0000 7f1228590640 1 -- 172.21.15.172:0/2223410362 shutdown_connections 2024-04-25T08:50:49.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.721+0000 7f1228590640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f120406b4d0 0x7f120406d990 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.721+0000 7f1228590640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12200cffa0 0x7f122015ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.721+0000 7f1228590640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f122006b580 0x7f12200b1580 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.721+0000 7f1228590640 1 --2- 172.21.15.172:0/2223410362 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f122006b1a0 0x7f12200c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.721+0000 7f1228590640 1 -- 172.21.15.172:0/2223410362 >> 172.21.15.172:0/2223410362 conn(0x7f12200b2220 msgr2=0x7f12200b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:49.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.721+0000 7f1228590640 1 -- 172.21.15.172:0/2223410362 shutdown_connections 2024-04-25T08:50:49.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.721+0000 7f1228590640 1 -- 172.21.15.172:0/2223410362 wait complete. 2024-04-25T08:50:49.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:50:49.723 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:50:49.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.832+0000 7f8950d5c640 1 Processor -- start 2024-04-25T08:50:49.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.832+0000 7f8950d5c640 1 -- start start 2024-04-25T08:50:49.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.833+0000 7f8950d5c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894c0ced80 0x7f894c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.833+0000 7f8950d5c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c15e000 con 0x7f894c161710 2024-04-25T08:50:49.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.833+0000 7f8950d5c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c0d1de0 con 0x7f894c15dc20 2024-04-25T08:50:49.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.833+0000 7f8950d5c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c161c60 con 0x7f894c0ced80 2024-04-25T08:50:49.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.833+0000 7f894ad9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f894c161710 0x7f894c0d2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43008/0 (socket says 172.21.15.172:43008) 2024-04-25T08:50:49.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.833+0000 7f894ad9d640 1 -- 172.21.15.172:0/1216945903 learned_addr learned my addr 172.21.15.172:0/1216945903 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:49.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f8949d9b640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894c0ced80 0x7f894c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377452123 0 0) 0x7f894c15e000 con 0x7f894c161710 2024-04-25T08:50:49.827 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8934003520 con 0x7f894c161710 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192779124 0 0) 0x7f8934003520 con 0x7f894c161710 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894c0ced80 msgr2=0x7f894c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894c0ced80 0x7f894c0d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 >> v1:172.21.15.186:6789/0 conn(0x7f894c15dc20 legacy=0x7f894c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c161f40 con 0x7f894c161710 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f8944001670 con 0x7f894c161710 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 >> v1:172.21.15.172:6789/0 conn(0x7f894c161710 legacy=0x7f894c0d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89340039e0 0x7f8934003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8934004800 0x7f8934004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894c0ced80 0x7f89340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c161c60 con 0x7f8934004800 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893400ba70 con 0x7f89340039e0 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893400bc70 con 0x7f894c0ced80 2024-04-25T08:50:49.828 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f8949d9b640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8934004800 0x7f8934004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894a59c640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89340039e0 0x7f8934003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f894ad9d640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894c0ced80 0x7f89340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f8949d9b640 1 -- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894c0ced80 msgr2=0x7f89340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f8949d9b640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894c0ced80 0x7f89340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f8949d9b640 1 -- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89340039e0 msgr2=0x7f8934003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f8949d9b640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89340039e0 0x7f8934003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.834+0000 7f8949d9b640 1 -- 172.21.15.172:0/1216945903 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8934003520 con 0x7f8934004800 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.835+0000 7f8949d9b640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8934004800 0x7f8934004c80 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f8940009a90 tx=0x7f8934005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2689b8c61d5d6610 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.835+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8940036070 con 0x7f8934004800 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.835+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8940031400 con 0x7f8934004800 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.835+0000 7f894959a640 1 -- 172.21.15.172:0/1216945903 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8940009690 con 0x7f8934004800 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.836+0000 7f8950d5c640 1 -- 172.21.15.172:0/1216945903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8934004800 msgr2=0x7f8934004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.836+0000 7f8950d5c640 1 --2- 172.21.15.172:0/1216945903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8934004800 0x7f8934004c80 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f8940009a90 tx=0x7f8934005830 comp rx=0 tx=0).stop 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.836+0000 7f894ad9d640 1 -- 172.21.15.172:0/1216945903 reap_dead start 2024-04-25T08:50:49.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.836+0000 7f8950d5c640 1 -- 172.21.15.172:0/1216945903 shutdown_connections 2024-04-25T08:50:49.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.836+0000 7f8950d5c640 1 -- 172.21.15.172:0/1216945903 >> 172.21.15.172:0/1216945903 conn(0x7f894c0d0420 msgr2=0x7f894c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:49.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.836+0000 7f8950d5c640 1 -- 172.21.15.172:0/1216945903 shutdown_connections 2024-04-25T08:50:49.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.836+0000 7f8950d5c640 1 -- 172.21.15.172:0/1216945903 wait complete. 2024-04-25T08:50:49.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.837+0000 7f8950d5c640 1 Processor -- start 2024-04-25T08:50:49.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.837+0000 7f8950d5c640 1 -- start start 2024-04-25T08:50:49.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f8950d5c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8934004800 0x7f894c14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f8950d5c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894c0cd0f0 0x7f894c0aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f8950d5c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f894c0abca0 0x7f894c0ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f8950d5c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c0b5e50 con 0x7f894c0abca0 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f8950d5c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c162500 con 0x7f894c0cd0f0 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f8950d5c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c0b5fd0 con 0x7f8934004800 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f894ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f894c0abca0 0x7f894c0ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f894ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f894c0abca0 0x7f894c0ac130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38916/0 (socket says 172.21.15.172:38916) 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f894ad9d640 1 -- 172.21.15.172:0/1281207474 learned_addr learned my addr 172.21.15.172:0/1281207474 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f894a59c640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8934004800 0x7f894c14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f8949d9b640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894c0cd0f0 0x7f894c0aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f894ad9d640 1 -- 172.21.15.172:0/1281207474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8934004800 msgr2=0x7f894c14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f894ad9d640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8934004800 0x7f894c14ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f894ad9d640 1 -- 172.21.15.172:0/1281207474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894c0cd0f0 msgr2=0x7f894c0aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f894ad9d640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894c0cd0f0 0x7f894c0aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f894ad9d640 1 -- 172.21.15.172:0/1281207474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c0aacf0 con 0x7f894c0abca0 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f8949d9b640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894c0cd0f0 0x7f894c0aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:49.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.838+0000 7f894ad9d640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f894c0abca0 0x7f894c0ac130 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f8944000c00 tx=0x7f8944007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.839+0000 7f893affd640 1 -- 172.21.15.172:0/1281207474 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894400f680 con 0x7f894c0abca0 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.839+0000 7f893affd640 1 -- 172.21.15.172:0/1281207474 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944018070 con 0x7f894c0abca0 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.839+0000 7f893affd640 1 -- 172.21.15.172:0/1281207474 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894400fa80 con 0x7f894c0abca0 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.839+0000 7f8950d5c640 1 -- 172.21.15.172:0/1281207474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c0aafd0 con 0x7f894c0abca0 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.839+0000 7f8950d5c640 1 -- 172.21.15.172:0/1281207474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c0ab590 con 0x7f894c0abca0 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.840+0000 7f8950d5c640 1 -- 172.21.15.172:0/1281207474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c0cf380 con 0x7f894c0abca0 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.840+0000 7f893affd640 1 -- 172.21.15.172:0/1281207474 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f894400fc20 con 0x7f894c0abca0 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.841+0000 7f893affd640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892c06b4d0 0x7f892c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.841+0000 7f893affd640 1 -- 172.21.15.172:0/1281207474 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8944089e80 con 0x7f894c0abca0 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.841+0000 7f894a59c640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892c06b4d0 0x7f892c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:49.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.841+0000 7f894a59c640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892c06b4d0 0x7f892c06d990 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f893c003e90 tx=0x7f893c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:49.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:49.845+0000 7f893affd640 1 -- 172.21.15.172:0/1281207474 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f894c0cf380 con 0x7f894c0abca0 2024-04-25T08:50:50.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.016+0000 7f8950d5c640 1 -- 172.21.15.172:0/1281207474 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f894c073a00 con 0x7f894c0abca0 2024-04-25T08:50:50.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.016+0000 7f893affd640 1 -- 172.21.15.172:0/1281207474 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v127) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8944058ec0 con 0x7f894c0abca0 2024-04-25T08:50:50.007 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:50:50.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 -- 172.21.15.172:0/1281207474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892c06b4d0 msgr2=0x7f892c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892c06b4d0 0x7f892c06d990 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f893c003e90 tx=0x7f893c009040 comp rx=0 tx=0).stop 2024-04-25T08:50:50.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 -- 172.21.15.172:0/1281207474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f894c0abca0 msgr2=0x7f894c0ac130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f894c0abca0 0x7f894c0ac130 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f8944000c00 tx=0x7f8944007430 comp rx=0 tx=0).stop 2024-04-25T08:50:50.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 -- 172.21.15.172:0/1281207474 shutdown_connections 2024-04-25T08:50:50.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892c06b4d0 0x7f892c06d990 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894c0cd0f0 0x7f894c0aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f894c0abca0 0x7f894c0ac130 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 --2- 172.21.15.172:0/1281207474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8934004800 0x7f894c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 -- 172.21.15.172:0/1281207474 >> 172.21.15.172:0/1281207474 conn(0x7f894c0d0420 msgr2=0x7f894c0b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:50.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 -- 172.21.15.172:0/1281207474 shutdown_connections 2024-04-25T08:50:50.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.018+0000 7f8950d5c640 1 -- 172.21.15.172:0/1281207474 wait complete. 2024-04-25T08:50:50.020 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:50:50.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.127+0000 7f7942a88640 1 Processor -- start 2024-04-25T08:50:50.118 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.127+0000 7f7942a88640 1 -- start start 2024-04-25T08:50:50.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.128+0000 7f7942a88640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f793c15ef00 0x7f793c0d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.128+0000 7f7942a88640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793c0c7970 con 0x7f793c0c7310 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.128+0000 7f7942a88640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f793c0c7c50 con 0x7f793c0d1ca0 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.128+0000 7f7942a88640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793c0d2110 con 0x7f793c15ef00 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.128+0000 7f7941025640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f793c0c7310 0x7f793c0cc270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43010/0 (socket says 172.21.15.172:43010) 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.128+0000 7f7941025640 1 -- 172.21.15.172:0/2953538139 learned_addr learned my addr 172.21.15.172:0/2953538139 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.128+0000 7f7940824640 1 --2- 172.21.15.172:0/2953538139 >> v2:172.21.15.186:3300/0 conn(0x7f793c15ef00 0x7f793c0d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.128+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845454549 0 0) 0x7f793c0c7970 con 0x7f793c0c7310 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.128+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f792c003520 con 0x7f793c0c7310 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1940632796 0 0) 0x7f792c003520 con 0x7f793c0c7310 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 >> v2:172.21.15.186:3300/0 conn(0x7f793c15ef00 msgr2=0x7f793c0d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 --2- 172.21.15.172:0/2953538139 >> v2:172.21.15.186:3300/0 conn(0x7f793c15ef00 0x7f793c0d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 >> v1:172.21.15.186:6789/0 conn(0x7f793c0d1ca0 legacy=0x7f793c0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c0c7f30 con 0x7f793c0c7310 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f79340019f0 con 0x7f793c0c7310 2024-04-25T08:50:50.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 >> v1:172.21.15.172:6789/0 conn(0x7f793c0c7310 legacy=0x7f793c0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f792c0039b0 0x7f792c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f792c004800 0x7f792c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f792c0051c0 0x7f792c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c0d2110 con 0x7f792c0039b0 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c00c070 con 0x7f792c0051c0 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c00c270 con 0x7f792c004800 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f7940824640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f792c0039b0 0x7f792c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f7941025640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f792c0051c0 0x7f792c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793bfff640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f792c004800 0x7f792c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f7940824640 1 -- 172.21.15.172:0/2953538139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f792c004800 msgr2=0x7f792c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f7940824640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f792c004800 0x7f792c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f7940824640 1 -- 172.21.15.172:0/2953538139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f792c0051c0 msgr2=0x7f792c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:50.123 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f7940824640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f792c0051c0 0x7f792c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f7940824640 1 -- 172.21.15.172:0/2953538139 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c003520 con 0x7f792c0039b0 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f7941025640 1 -- 172.21.15.172:0/2953538139 reap_dead start 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.129+0000 7f793bfff640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f792c004800 0x7f792c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.130+0000 7f7940824640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f792c0039b0 0x7f792c003dd0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f7930009ac0 tx=0x7f792c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c294a90453dd1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.130+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930036070 con 0x7f792c0039b0 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.130+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7930031400 con 0x7f792c0039b0 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.130+0000 7f793b7fe640 1 -- 172.21.15.172:0/2953538139 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930009690 con 0x7f792c0039b0 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.130+0000 7f7942a88640 1 -- 172.21.15.172:0/2953538139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f792c0039b0 msgr2=0x7f792c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.130+0000 7f7942a88640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f792c0039b0 0x7f792c003dd0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f7930009ac0 tx=0x7f792c005830 comp rx=0 tx=0).stop 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.130+0000 7f7942a88640 1 -- 172.21.15.172:0/2953538139 shutdown_connections 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.130+0000 7f7942a88640 1 --2- 172.21.15.172:0/2953538139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f792c0039b0 0x7f792c003dd0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.130+0000 7f7942a88640 1 -- 172.21.15.172:0/2953538139 >> 172.21.15.172:0/2953538139 conn(0x7f793c06f5d0 msgr2=0x7f793c06f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.131+0000 7f7942a88640 1 -- 172.21.15.172:0/2953538139 shutdown_connections 2024-04-25T08:50:50.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.131+0000 7f7942a88640 1 -- 172.21.15.172:0/2953538139 wait complete. 2024-04-25T08:50:50.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.132+0000 7f7942a88640 1 Processor -- start 2024-04-25T08:50:50.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.132+0000 7f7942a88640 1 -- start start 2024-04-25T08:50:50.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f7942a88640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f792c0039b0 0x7f793c1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f7942a88640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c145e60 0x7f793c1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f7942a88640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f793c1f5120 0x7f793c1f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f7942a88640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c0c84f0 con 0x7f793c145e60 2024-04-25T08:50:50.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f7942a88640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c15f2e0 con 0x7f793c1f5120 2024-04-25T08:50:50.127 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f7942a88640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c0d1760 con 0x7f792c0039b0 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f793bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c145e60 0x7f793c1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f793bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c145e60 0x7f793c1462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38932/0 (socket says 172.21.15.172:38932) 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f793bfff640 1 -- 172.21.15.172:0/661871099 learned_addr learned my addr 172.21.15.172:0/661871099 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f793bfff640 1 -- 172.21.15.172:0/661871099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f792c0039b0 msgr2=0x7f793c1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f7941025640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f793c1f5120 0x7f793c1f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f793bfff640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f792c0039b0 0x7f793c1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f793bfff640 1 -- 172.21.15.172:0/661871099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f793c1f5120 msgr2=0x7f793c1f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f793bfff640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f793c1f5120 0x7f793c1f55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f793bfff640 1 -- 172.21.15.172:0/661871099 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c1547f0 con 0x7f793c145e60 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f793bfff640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c145e60 0x7f793c1462e0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f792800e480 tx=0x7f792800e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f79397fa640 1 -- 172.21.15.172:0/661871099 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79280052e0 con 0x7f793c145e60 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f79397fa640 1 -- 172.21.15.172:0/661871099 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7928018070 con 0x7f793c145e60 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f7942a88640 1 -- 172.21.15.172:0/661871099 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793c156f00 con 0x7f793c145e60 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f79397fa640 1 -- 172.21.15.172:0/661871099 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928003810 con 0x7f793c145e60 2024-04-25T08:50:50.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.133+0000 7f7942a88640 1 -- 172.21.15.172:0/661871099 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c1574c0 con 0x7f793c145e60 2024-04-25T08:50:50.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.134+0000 7f7942a88640 1 -- 172.21.15.172:0/661871099 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793c073990 con 0x7f793c145e60 2024-04-25T08:50:50.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.135+0000 7f79397fa640 1 -- 172.21.15.172:0/661871099 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f79280039b0 con 0x7f793c145e60 2024-04-25T08:50:50.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.135+0000 7f79397fa640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f792006b500 0x7f792006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.135+0000 7f79397fa640 1 -- 172.21.15.172:0/661871099 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7928089c70 con 0x7f793c145e60 2024-04-25T08:50:50.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.135+0000 7f7940824640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f792006b500 0x7f792006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.136+0000 7f7940824640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f792006b500 0x7f792006d9c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7930033000 tx=0x7f793002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:50.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.139+0000 7f79397fa640 1 -- 172.21.15.172:0/661871099 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7928058d40 con 0x7f793c145e60 2024-04-25T08:50:50.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.311+0000 7f7942a88640 1 -- 172.21.15.172:0/661871099 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f793c15e3a0 con 0x7f793c145e60 2024-04-25T08:50:50.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.311+0000 7f79397fa640 1 -- 172.21.15.172:0/661871099 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v127) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7928058640 con 0x7f793c145e60 2024-04-25T08:50:50.302 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:50.302 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:50:50.302 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:50:50.302 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2024-04-25T08:50:50.302 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2024-04-25T08:50:50.302 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:50:50.302 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 -- 172.21.15.172:0/661871099 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f792006b500 msgr2=0x7f792006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f792006b500 0x7f792006d9c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7930033000 tx=0x7f793002e000 comp rx=0 tx=0).stop 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 -- 172.21.15.172:0/661871099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c145e60 msgr2=0x7f793c1462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c145e60 0x7f793c1462e0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f792800e480 tx=0x7f792800e940 comp rx=0 tx=0).stop 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 -- 172.21.15.172:0/661871099 shutdown_connections 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f792006b500 0x7f792006d9c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f793c1f5120 0x7f793c1f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c145e60 0x7f793c1462e0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 --2- 172.21.15.172:0/661871099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f792c0039b0 0x7f793c1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 -- 172.21.15.172:0/661871099 >> 172.21.15.172:0/661871099 conn(0x7f793c06f5d0 msgr2=0x7f793c0ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 -- 172.21.15.172:0/661871099 shutdown_connections 2024-04-25T08:50:50.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.313+0000 7f7942a88640 1 -- 172.21.15.172:0/661871099 wait complete. 2024-04-25T08:50:50.315 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:50:50.315 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:50:50.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.425+0000 7fb83a7e2640 1 Processor -- start 2024-04-25T08:50:50.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.425+0000 7fb83a7e2640 1 -- start start 2024-04-25T08:50:50.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb83a7e2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb834070dc0 0x7fb83406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb83a7e2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb8340711a0 0x7fb8340b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb83a7e2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340d1770 con 0x7fb8340b4830 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb83a7e2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8341622b0 con 0x7fb8340711a0 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb83a7e2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340b10f0 con 0x7fb834070dc0 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb838d7f640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb8340b4830 0x7fb8340b4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43026/0 (socket says 172.21.15.172:43026) 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb838d7f640 1 -- 172.21.15.172:0/3907706437 learned_addr learned my addr 172.21.15.172:0/3907706437 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb8337fe640 1 --2- 172.21.15.172:0/3907706437 >> v2:172.21.15.186:3300/0 conn(0x7fb8340711a0 0x7fb8340b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb833fff640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb834070dc0 0x7fb83406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308733317 0 0) 0x7fb8340d1770 con 0x7fb8340b4830 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.426+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb81c003520 con 0x7fb8340b4830 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3001742800 0 0) 0x7fb81c003520 con 0x7fb8340b4830 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb834070dc0 msgr2=0x7fb83406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:50.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb834070dc0 0x7fb83406ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 >> v2:172.21.15.186:3300/0 conn(0x7fb8340711a0 msgr2=0x7fb8340b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 --2- 172.21.15.172:0/3907706437 >> v2:172.21.15.186:3300/0 conn(0x7fb8340711a0 0x7fb8340b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb834162740 con 0x7fb8340b4830 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb8337fe640 1 --2- 172.21.15.172:0/3907706437 >> v2:172.21.15.186:3300/0 conn(0x7fb8340711a0 0x7fb8340b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fb82c0019f0 con 0x7fb8340b4830 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 >> v1:172.21.15.172:6789/0 conn(0x7fb8340b4830 legacy=0x7fb8340b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb834070dc0 0x7fb81c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb81c003f30 0x7fb81c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81c004d40 0x7fb81c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341622b0 con 0x7fb81c004d40 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340b10f0 con 0x7fb81c003f30 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c00baa0 con 0x7fb834070dc0 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb838d7f640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81c004d40 0x7fb81c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb8337fe640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb81c003f30 0x7fb81c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb833fff640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb834070dc0 0x7fb81c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb838d7f640 1 -- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb834070dc0 msgr2=0x7fb81c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb838d7f640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb834070dc0 0x7fb81c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb838d7f640 1 -- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb81c003f30 msgr2=0x7fb81c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb838d7f640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb81c003f30 0x7fb81c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb838d7f640 1 -- 172.21.15.172:0/3907706437 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c003520 con 0x7fb81c004d40 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.427+0000 7fb833fff640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb834070dc0 0x7fb81c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.428+0000 7fb838d7f640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81c004d40 0x7fb81c0051c0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fb82c00a920 tx=0x7fb81c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73d6bd0c5f09b19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.428+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c00a4c0 con 0x7fb81c004d40 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.428+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c02f070 con 0x7fb81c004d40 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.428+0000 7fb832ffd640 1 -- 172.21.15.172:0/3907706437 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c02bd40 con 0x7fb81c004d40 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.429+0000 7fb83a7e2640 1 -- 172.21.15.172:0/3907706437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81c004d40 msgr2=0x7fb81c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.429+0000 7fb83a7e2640 1 --2- 172.21.15.172:0/3907706437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81c004d40 0x7fb81c0051c0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fb82c00a920 tx=0x7fb81c005830 comp rx=0 tx=0).stop 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.429+0000 7fb838d7f640 1 -- 172.21.15.172:0/3907706437 reap_dead start 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.429+0000 7fb83a7e2640 1 -- 172.21.15.172:0/3907706437 shutdown_connections 2024-04-25T08:50:50.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.429+0000 7fb83a7e2640 1 -- 172.21.15.172:0/3907706437 >> 172.21.15.172:0/3907706437 conn(0x7fb8340b3530 msgr2=0x7fb8340b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:50.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.429+0000 7fb83a7e2640 1 -- 172.21.15.172:0/3907706437 shutdown_connections 2024-04-25T08:50:50.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.429+0000 7fb83a7e2640 1 -- 172.21.15.172:0/3907706437 wait complete. 2024-04-25T08:50:50.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.430+0000 7fb83a7e2640 1 Processor -- start 2024-04-25T08:50:50.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.430+0000 7fb83a7e2640 1 -- start start 2024-04-25T08:50:50.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb83a7e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb83414ed80 0x7fb834150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb83a7e2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb834151620 0x7fb834154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb83a7e2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb83415a630 0x7fb83415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb83a7e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb834161f40 con 0x7fb83414ed80 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb83a7e2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb834161c60 con 0x7fb834151620 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb83a7e2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb834071600 con 0x7fb83415a630 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb833fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb83414ed80 0x7fb834150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb833fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb83414ed80 0x7fb834150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38954/0 (socket says 172.21.15.172:38954) 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb833fff640 1 -- 172.21.15.172:0/179858323 learned_addr learned my addr 172.21.15.172:0/179858323 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb833fff640 1 -- 172.21.15.172:0/179858323 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb83415a630 msgr2=0x7fb83415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb833fff640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb83415a630 0x7fb83415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb833fff640 1 -- 172.21.15.172:0/179858323 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb834151620 msgr2=0x7fb834154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb833fff640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb834151620 0x7fb834154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb833fff640 1 -- 172.21.15.172:0/179858323 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb834153e80 con 0x7fb83414ed80 2024-04-25T08:50:50.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb833fff640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb83414ed80 0x7fb834150790 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fb824011580 tx=0x7fb824011a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb830ff9640 1 -- 172.21.15.172:0/179858323 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824015870 con 0x7fb83414ed80 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb830ff9640 1 -- 172.21.15.172:0/179858323 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb824015a10 con 0x7fb83414ed80 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb83a7e2640 1 -- 172.21.15.172:0/179858323 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb834154160 con 0x7fb83414ed80 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb830ff9640 1 -- 172.21.15.172:0/179858323 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824015de0 con 0x7fb83414ed80 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.431+0000 7fb83a7e2640 1 -- 172.21.15.172:0/179858323 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb834155180 con 0x7fb83414ed80 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.432+0000 7fb83a7e2640 1 -- 172.21.15.172:0/179858323 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb834073a00 con 0x7fb83414ed80 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.433+0000 7fb830ff9640 1 -- 172.21.15.172:0/179858323 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb82401d400 con 0x7fb83414ed80 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.433+0000 7fb830ff9640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb82006b4d0 0x7fb82006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.433+0000 7fb830ff9640 1 -- 172.21.15.172:0/179858323 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb82408a8e0 con 0x7fb83414ed80 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.433+0000 7fb8337fe640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb82006b4d0 0x7fb82006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:50.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.434+0000 7fb8337fe640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb82006b4d0 0x7fb82006d990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb8340cd7f0 tx=0x7fb828009760 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:50.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.437+0000 7fb830ff9640 1 -- 172.21.15.172:0/179858323 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb824019030 con 0x7fb83414ed80 2024-04-25T08:50:50.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:50.608+0000 7fb83a7e2640 1 -- 172.21.15.172:0/179858323 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb8340d0b50 con 0x7fb83414ed80 2024-04-25T08:50:51.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.049+0000 7fb830ff9640 1 -- 172.21.15.172:0/179858323 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v128) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb824059930 con 0x7fb83414ed80 2024-04-25T08:50:51.039 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2024-04-25T08:50:51.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.050+0000 7fb83a7e2640 1 -- 172.21.15.172:0/179858323 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb82006b4d0 msgr2=0x7fb82006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:51.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.050+0000 7fb83a7e2640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb82006b4d0 0x7fb82006d990 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb8340cd7f0 tx=0x7fb828009760 comp rx=0 tx=0).stop 2024-04-25T08:50:51.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.050+0000 7fb83a7e2640 1 -- 172.21.15.172:0/179858323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb83414ed80 msgr2=0x7fb834150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:51.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.050+0000 7fb83a7e2640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb83414ed80 0x7fb834150790 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fb824011580 tx=0x7fb824011a40 comp rx=0 tx=0).stop 2024-04-25T08:50:51.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.050+0000 7fb83a7e2640 1 -- 172.21.15.172:0/179858323 shutdown_connections 2024-04-25T08:50:51.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.050+0000 7fb83a7e2640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb82006b4d0 0x7fb82006d990 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:51.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.050+0000 7fb83a7e2640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb834151620 0x7fb834154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:51.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.050+0000 7fb83a7e2640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb83415a630 0x7fb83415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:51.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.050+0000 7fb83a7e2640 1 --2- 172.21.15.172:0/179858323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb83414ed80 0x7fb834150790 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:51.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.050+0000 7fb83a7e2640 1 -- 172.21.15.172:0/179858323 >> 172.21.15.172:0/179858323 conn(0x7fb8340b3530 msgr2=0x7fb8340cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:51.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.051+0000 7fb83a7e2640 1 -- 172.21.15.172:0/179858323 shutdown_connections 2024-04-25T08:50:51.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.051+0000 7fb83a7e2640 1 -- 172.21.15.172:0/179858323 wait complete. 2024-04-25T08:50:51.056 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:50:51.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.171+0000 7fe66601b640 1 Processor -- start 2024-04-25T08:50:51.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.171+0000 7fe66601b640 1 -- start start 2024-04-25T08:50:51.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.171+0000 7fe66601b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe66015bb20 0x7fe6600cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.171+0000 7fe66601b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6600cb190 con 0x7fe6600d00e0 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.171+0000 7fe66601b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6600cb470 con 0x7fe6600ccdd0 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.171+0000 7fe66601b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6600cb750 con 0x7fe66015bb20 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.172+0000 7fe65f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe66015bb20 0x7fe6600cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.172+0000 7fe65ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe6600d00e0 0x7fe6600ad600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43040/0 (socket says 172.21.15.172:43040) 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.172+0000 7fe65f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe66015bb20 0x7fe6600cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38964/0 (socket says 172.21.15.172:38964) 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.172+0000 7fe65ffff640 1 -- 172.21.15.172:0/1873474929 learned_addr learned my addr 172.21.15.172:0/1873474929 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.172+0000 7fe65f7fe640 1 -- 172.21.15.172:0/1873474929 >> v1:172.21.15.186:6789/0 conn(0x7fe6600ccdd0 legacy=0x7fe6600cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.172+0000 7fe65f7fe640 1 -- 172.21.15.172:0/1873474929 >> v1:172.21.15.172:6789/0 conn(0x7fe6600d00e0 legacy=0x7fe6600ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.172+0000 7fe65effd640 1 -- 172.21.15.172:0/1873474929 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149938031 0 0) 0x7fe6600cb190 con 0x7fe6600d00e0 2024-04-25T08:50:51.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.172+0000 7fe65f7fe640 1 -- 172.21.15.172:0/1873474929 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600cba30 con 0x7fe66015bb20 2024-04-25T08:50:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe65f7fe640 1 --2- 172.21.15.172:0/1873474929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 0x7fe6600cc230 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fe6500097a0 tx=0x7fe65002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55f9978f92fa99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe65effd640 1 -- 172.21.15.172:0/1873474929 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650037070 con 0x7fe66015bb20 2024-04-25T08:50:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe65effd640 1 -- 172.21.15.172:0/1873474929 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65002ae50 con 0x7fe66015bb20 2024-04-25T08:50:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe65effd640 1 -- 172.21.15.172:0/1873474929 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650032660 con 0x7fe66015bb20 2024-04-25T08:50:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe66601b640 1 -- 172.21.15.172:0/1873474929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 msgr2=0x7fe6600cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe66601b640 1 --2- 172.21.15.172:0/1873474929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 0x7fe6600cc230 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fe6500097a0 tx=0x7fe65002a140 comp rx=0 tx=0).stop 2024-04-25T08:50:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe66601b640 1 -- 172.21.15.172:0/1873474929 shutdown_connections 2024-04-25T08:50:51.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe66601b640 1 --2- 172.21.15.172:0/1873474929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 0x7fe6600cc230 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe66601b640 1 -- 172.21.15.172:0/1873474929 >> 172.21.15.172:0/1873474929 conn(0x7fe6600b2390 msgr2=0x7fe6600b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe66601b640 1 -- 172.21.15.172:0/1873474929 shutdown_connections 2024-04-25T08:50:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.173+0000 7fe66601b640 1 -- 172.21.15.172:0/1873474929 wait complete. 2024-04-25T08:50:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe66601b640 1 Processor -- start 2024-04-25T08:50:51.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe66601b640 1 -- start start 2024-04-25T08:50:51.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe66601b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6600ccdd0 0x7fe6600ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe66601b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6600d00e0 0x7fe660156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe66601b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 0x7fe660157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe66601b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66015bf00 con 0x7fe66015bb20 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe66601b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600cc770 con 0x7fe6600ccdd0 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe66601b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66015c080 con 0x7fe6600d00e0 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe65ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 0x7fe660157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe65ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 0x7fe660157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38974/0 (socket says 172.21.15.172:38974) 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.175+0000 7fe65ffff640 1 -- 172.21.15.172:0/3903545596 learned_addr learned my addr 172.21.15.172:0/3903545596 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe65f7fe640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6600ccdd0 0x7fe6600ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe657fff640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6600d00e0 0x7fe660156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe65ffff640 1 -- 172.21.15.172:0/3903545596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6600d00e0 msgr2=0x7fe660156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe65ffff640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6600d00e0 0x7fe660156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe65ffff640 1 -- 172.21.15.172:0/3903545596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6600ccdd0 msgr2=0x7fe6600ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:51.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe65ffff640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6600ccdd0 0x7fe6600ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe65ffff640 1 -- 172.21.15.172:0/3903545596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600c96a0 con 0x7fe66015bb20 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe65ffff640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 0x7fe660157280 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fe65800c7a0 tx=0x7fe65800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe65cff9640 1 -- 172.21.15.172:0/3903545596 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658018070 con 0x7fe66015bb20 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe65cff9640 1 -- 172.21.15.172:0/3903545596 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65800a640 con 0x7fe66015bb20 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe66601b640 1 -- 172.21.15.172:0/3903545596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6600c8e00 con 0x7fe66015bb20 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe65cff9640 1 -- 172.21.15.172:0/3903545596 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800aab0 con 0x7fe66015bb20 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.176+0000 7fe66601b640 1 -- 172.21.15.172:0/3903545596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6600c93c0 con 0x7fe66015bb20 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.177+0000 7fe66601b640 1 -- 172.21.15.172:0/3903545596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe660073a00 con 0x7fe66015bb20 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.178+0000 7fe65cff9640 1 -- 172.21.15.172:0/3903545596 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe65801b070 con 0x7fe66015bb20 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.178+0000 7fe65cff9640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe64006b4d0 0x7fe64006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.178+0000 7fe65cff9640 1 -- 172.21.15.172:0/3903545596 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fe658089720 con 0x7fe66015bb20 2024-04-25T08:50:51.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.178+0000 7fe65f7fe640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe64006b4d0 0x7fe64006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:51.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.179+0000 7fe65f7fe640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe64006b4d0 0x7fe64006d990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe650034000 tx=0x7fe65002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:51.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.183+0000 7fe65cff9640 1 -- 172.21.15.172:0/3903545596 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe658057fa0 con 0x7fe66015bb20 2024-04-25T08:50:51.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:51.354+0000 7fe66601b640 1 -- 172.21.15.172:0/3903545596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe660070240 con 0x7fe66015bb20 2024-04-25T08:50:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.050+0000 7fe65cff9640 1 -- 172.21.15.172:0/3903545596 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v129) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe65805c040 con 0x7fe66015bb20 2024-04-25T08:50:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2024-04-25T08:50:52.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 -- 172.21.15.172:0/3903545596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe64006b4d0 msgr2=0x7fe64006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:52.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe64006b4d0 0x7fe64006d990 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe650034000 tx=0x7fe65002e000 comp rx=0 tx=0).stop 2024-04-25T08:50:52.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 -- 172.21.15.172:0/3903545596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 msgr2=0x7fe660157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:52.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 0x7fe660157280 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fe65800c7a0 tx=0x7fe65800cc60 comp rx=0 tx=0).stop 2024-04-25T08:50:52.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 -- 172.21.15.172:0/3903545596 shutdown_connections 2024-04-25T08:50:52.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe64006b4d0 0x7fe64006d990 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:52.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe66015bb20 0x7fe660157280 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:52.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6600d00e0 0x7fe660156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:52.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 --2- 172.21.15.172:0/3903545596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe6600ccdd0 0x7fe6600ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:52.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 -- 172.21.15.172:0/3903545596 >> 172.21.15.172:0/3903545596 conn(0x7fe6600b2390 msgr2=0x7fe66006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:52.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 -- 172.21.15.172:0/3903545596 shutdown_connections 2024-04-25T08:50:52.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.053+0000 7fe66601b640 1 -- 172.21.15.172:0/3903545596 wait complete. 2024-04-25T08:50:52.064 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:50:52.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.174+0000 7fbc5836a640 1 Processor -- start 2024-04-25T08:50:52.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.174+0000 7fbc5836a640 1 -- start start 2024-04-25T08:50:52.166 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.175+0000 7fbc5836a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006e360 0x7fbc5006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.175+0000 7fbc5836a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbc5006ec80 0x7fbc500b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.175+0000 7fbc5836a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc5015e020 con 0x7fbc500b3e10 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.175+0000 7fbc5836a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5006b890 con 0x7fbc5006ec80 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.175+0000 7fbc5836a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5006ac80 con 0x7fbc5006e360 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.176+0000 7fbc55905640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbc5006ec80 0x7fbc500b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.176+0000 7fbc55905640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbc5006ec80 0x7fbc500b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38978/0 (socket says 172.21.15.172:38978) 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.176+0000 7fbc55905640 1 -- 172.21.15.172:0/452340080 learned_addr learned my addr 172.21.15.172:0/452340080 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.176+0000 7fbc56106640 1 --2- 172.21.15.172:0/452340080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006e360 0x7fbc5006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.176+0000 7fbc55905640 1 -- 172.21.15.172:0/452340080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006e360 msgr2=0x7fbc5006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.176+0000 7fbc55905640 1 --2- 172.21.15.172:0/452340080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006e360 0x7fbc5006e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.176+0000 7fbc55905640 1 -- 172.21.15.172:0/452340080 >> v1:172.21.15.186:6789/0 conn(0x7fbc500b3e10 legacy=0x7fbc5006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:52.167 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.176+0000 7fbc55905640 1 -- 172.21.15.172:0/452340080 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5006af60 con 0x7fbc5006ec80 2024-04-25T08:50:52.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc55905640 1 --2- 172.21.15.172:0/452340080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 0x7fbc500b38d0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009870 tx=0x7fbc4c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956e8cfc441c5b50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:52.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc55104640 1 -- 172.21.15.172:0/452340080 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c037070 con 0x7fbc5006ec80 2024-04-25T08:50:52.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc55104640 1 -- 172.21.15.172:0/452340080 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c02ae50 con 0x7fbc5006ec80 2024-04-25T08:50:52.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc55104640 1 -- 172.21.15.172:0/452340080 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c032860 con 0x7fbc5006ec80 2024-04-25T08:50:52.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc5836a640 1 -- 172.21.15.172:0/452340080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 msgr2=0x7fbc500b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc5836a640 1 --2- 172.21.15.172:0/452340080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 0x7fbc500b38d0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009870 tx=0x7fbc4c02a300 comp rx=0 tx=0).stop 2024-04-25T08:50:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc5836a640 1 -- 172.21.15.172:0/452340080 shutdown_connections 2024-04-25T08:50:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc5836a640 1 --2- 172.21.15.172:0/452340080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 0x7fbc500b38d0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc5836a640 1 --2- 172.21.15.172:0/452340080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006e360 0x7fbc5006e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc5836a640 1 -- 172.21.15.172:0/452340080 >> 172.21.15.172:0/452340080 conn(0x7fbc500cfec0 msgr2=0x7fbc500d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc5836a640 1 -- 172.21.15.172:0/452340080 shutdown_connections 2024-04-25T08:50:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.177+0000 7fbc5836a640 1 -- 172.21.15.172:0/452340080 wait complete. 2024-04-25T08:50:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.178+0000 7fbc5836a640 1 Processor -- start 2024-04-25T08:50:52.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.178+0000 7fbc5836a640 1 -- start start 2024-04-25T08:50:52.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc5836a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006e360 0x7fbc501f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc5836a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 0x7fbc501e6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc5836a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc500b3e10 0x7fbc500ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc5836a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500b2fd0 con 0x7fbc5006ec80 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc5836a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5006b520 con 0x7fbc500b3e10 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc5836a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500b3150 con 0x7fbc5006e360 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc55905640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 0x7fbc501e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc55905640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 0x7fbc501e6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:38988/0 (socket says 172.21.15.172:38988) 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc55905640 1 -- 172.21.15.172:0/2142103090 learned_addr learned my addr 172.21.15.172:0/2142103090 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc56106640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006e360 0x7fbc501f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.179+0000 7fbc56907640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc500b3e10 0x7fbc500ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc55905640 1 -- 172.21.15.172:0/2142103090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006e360 msgr2=0x7fbc501f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc55905640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006e360 0x7fbc501f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc55905640 1 -- 172.21.15.172:0/2142103090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc500b3e10 msgr2=0x7fbc500ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:52.173 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc55905640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc500b3e10 0x7fbc500ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc55905640 1 -- 172.21.15.172:0/2142103090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc501e6d60 con 0x7fbc5006ec80 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc56907640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc500b3e10 0x7fbc500ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc55905640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 0x7fbc501e6460 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000c00 tx=0x7fbc4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc46ffd640 1 -- 172.21.15.172:0/2142103090 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c041070 con 0x7fbc5006ec80 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc46ffd640 1 -- 172.21.15.172:0/2142103090 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c03c670 con 0x7fbc5006ec80 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc5836a640 1 -- 172.21.15.172:0/2142103090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc501e7040 con 0x7fbc5006ec80 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc46ffd640 1 -- 172.21.15.172:0/2142103090 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c037040 con 0x7fbc5006ec80 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.180+0000 7fbc5836a640 1 -- 172.21.15.172:0/2142103090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc501e7600 con 0x7fbc5006ec80 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.181+0000 7fbc5836a640 1 -- 172.21.15.172:0/2142103090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc50073a00 con 0x7fbc5006ec80 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.182+0000 7fbc46ffd640 1 -- 172.21.15.172:0/2142103090 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbc4c044070 con 0x7fbc5006ec80 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.182+0000 7fbc46ffd640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc3406b4d0 0x7fbc3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.182+0000 7fbc46ffd640 1 -- 172.21.15.172:0/2142103090 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fbc4c0ab090 con 0x7fbc5006ec80 2024-04-25T08:50:52.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.182+0000 7fbc56106640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc3406b4d0 0x7fbc3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:52.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.182+0000 7fbc56106640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc3406b4d0 0x7fbc3406d990 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbc40006fd0 tx=0x7fbc40008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:52.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.186+0000 7fbc46ffd640 1 -- 172.21.15.172:0/2142103090 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc4c079990 con 0x7fbc5006ec80 2024-04-25T08:50:52.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:52.391+0000 7fbc5836a640 1 -- 172.21.15.172:0/2142103090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbc5006f4e0 con 0x7fbc5006ec80 2024-04-25T08:50:53.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.078+0000 7fbc46ffd640 1 -- 172.21.15.172:0/2142103090 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v72) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbc4c07da30 con 0x7fbc5006ec80 2024-04-25T08:50:53.069 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 19 and data pool 20 2024-04-25T08:50:53.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.085+0000 7fbc5836a640 1 -- 172.21.15.172:0/2142103090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc3406b4d0 msgr2=0x7fbc3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.085+0000 7fbc5836a640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc3406b4d0 0x7fbc3406d990 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbc40006fd0 tx=0x7fbc40008040 comp rx=0 tx=0).stop 2024-04-25T08:50:53.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.085+0000 7fbc5836a640 1 -- 172.21.15.172:0/2142103090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 msgr2=0x7fbc501e6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.085+0000 7fbc5836a640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 0x7fbc501e6460 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000c00 tx=0x7fbc4c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.087+0000 7fbc5836a640 1 -- 172.21.15.172:0/2142103090 shutdown_connections 2024-04-25T08:50:53.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.087+0000 7fbc5836a640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbc3406b4d0 0x7fbc3406d990 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.087+0000 7fbc5836a640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc500b3e10 0x7fbc500ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.087+0000 7fbc5836a640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc5006ec80 0x7fbc501e6460 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.087+0000 7fbc5836a640 1 --2- 172.21.15.172:0/2142103090 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006e360 0x7fbc501f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.087+0000 7fbc5836a640 1 -- 172.21.15.172:0/2142103090 >> 172.21.15.172:0/2142103090 conn(0x7fbc500cfec0 msgr2=0x7fbc5015fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:53.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.087+0000 7fbc5836a640 1 -- 172.21.15.172:0/2142103090 shutdown_connections 2024-04-25T08:50:53.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.087+0000 7fbc5836a640 1 -- 172.21.15.172:0/2142103090 wait complete. 2024-04-25T08:50:53.095 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:53.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.203+0000 7f3fe7702640 1 Processor -- start 2024-04-25T08:50:53.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.203+0000 7f3fe7702640 1 -- start start 2024-04-25T08:50:53.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.204+0000 7f3fe7702640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3fe00cfec0 0x7f3fe00cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.204+0000 7f3fe7702640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe0071480 con 0x7f3fe00ce3c0 2024-04-25T08:50:53.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.204+0000 7f3fe7702640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe0071760 con 0x7f3fe0154ee0 2024-04-25T08:50:53.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.204+0000 7f3fe7702640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe00ce830 con 0x7f3fe00cfec0 2024-04-25T08:50:53.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.204+0000 7f3fe4c9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3fe00cfec0 0x7f3fe00cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.204+0000 7f3fe4c9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3fe00cfec0 0x7f3fe00cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39000/0 (socket says 172.21.15.172:39000) 2024-04-25T08:50:53.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.204+0000 7f3fe4c9d640 1 -- 172.21.15.172:0/1847451084 learned_addr learned my addr 172.21.15.172:0/1847451084 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:53.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.204+0000 7f3fe5c9f640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3fe00ce3c0 0x7f3fe006d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43052/0 (socket says 172.21.15.172:43052) 2024-04-25T08:50:53.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.205+0000 7f3fe4c9d640 1 -- 172.21.15.172:0/1847451084 >> v1:172.21.15.186:6789/0 conn(0x7f3fe0154ee0 legacy=0x7f3fe00cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.205+0000 7f3fe4c9d640 1 -- 172.21.15.172:0/1847451084 >> v1:172.21.15.172:6789/0 conn(0x7f3fe00ce3c0 legacy=0x7f3fe006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.205+0000 7f3fe4c9d640 1 -- 172.21.15.172:0/1847451084 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0071a40 con 0x7f3fe00cfec0 2024-04-25T08:50:53.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.205+0000 7f3fd7fff640 1 -- 172.21.15.172:0/1847451084 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173189378 0 0) 0x7f3fe0071480 con 0x7f3fe00ce3c0 2024-04-25T08:50:53.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.205+0000 7f3fe4c9d640 1 --2- 172.21.15.172:0/1847451084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe00cfec0 0x7f3fe00cde80 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009870 tx=0x7f3fd002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fd58d34bb0f254 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:53.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.205+0000 7f3fd7fff640 1 -- 172.21.15.172:0/1847451084 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0037070 con 0x7f3fe00cfec0 2024-04-25T08:50:53.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.205+0000 7f3fd7fff640 1 -- 172.21.15.172:0/1847451084 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd002ae50 con 0x7f3fe00cfec0 2024-04-25T08:50:53.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.205+0000 7f3fd7fff640 1 -- 172.21.15.172:0/1847451084 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0032860 con 0x7f3fe00cfec0 2024-04-25T08:50:53.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.206+0000 7f3fe7702640 1 -- 172.21.15.172:0/1847451084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe00cfec0 msgr2=0x7f3fe00cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.206+0000 7f3fe7702640 1 --2- 172.21.15.172:0/1847451084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe00cfec0 0x7f3fe00cde80 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009870 tx=0x7f3fd002a300 comp rx=0 tx=0).stop 2024-04-25T08:50:53.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.206+0000 7f3fe7702640 1 -- 172.21.15.172:0/1847451084 shutdown_connections 2024-04-25T08:50:53.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.206+0000 7f3fe7702640 1 --2- 172.21.15.172:0/1847451084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe00cfec0 0x7f3fe00cde80 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.206+0000 7f3fe7702640 1 -- 172.21.15.172:0/1847451084 >> 172.21.15.172:0/1847451084 conn(0x7f3fe006abe0 msgr2=0x7f3fe006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:53.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.206+0000 7f3fe7702640 1 -- 172.21.15.172:0/1847451084 shutdown_connections 2024-04-25T08:50:53.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.206+0000 7f3fe7702640 1 -- 172.21.15.172:0/1847451084 wait complete. 2024-04-25T08:50:53.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.207+0000 7f3fe7702640 1 Processor -- start 2024-04-25T08:50:53.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.207+0000 7f3fe7702640 1 -- start start 2024-04-25T08:50:53.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe7702640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe00ce3c0 0x7f3fe0153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe7702640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe00cfec0 0x7f3fe01566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe7702640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe0154ee0 0x7f3fe01e61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe7702640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0071230 con 0x7f3fe0154ee0 2024-04-25T08:50:53.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe7702640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe01552c0 con 0x7f3fe00ce3c0 2024-04-25T08:50:53.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe7702640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0155440 con 0x7f3fe00cfec0 2024-04-25T08:50:53.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe5c9f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe0154ee0 0x7f3fe01e61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe5c9f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe0154ee0 0x7f3fe01e61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39012/0 (socket says 172.21.15.172:39012) 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe5c9f640 1 -- 172.21.15.172:0/172215216 learned_addr learned my addr 172.21.15.172:0/172215216 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe549e640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe00ce3c0 0x7f3fe0153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe4c9d640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe00cfec0 0x7f3fe01566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe5c9f640 1 -- 172.21.15.172:0/172215216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe00cfec0 msgr2=0x7f3fe01566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe5c9f640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe00cfec0 0x7f3fe01566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe5c9f640 1 -- 172.21.15.172:0/172215216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe00ce3c0 msgr2=0x7f3fe0153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe5c9f640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe00ce3c0 0x7f3fe0153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe5c9f640 1 -- 172.21.15.172:0/172215216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe01570d0 con 0x7f3fe0154ee0 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe549e640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe00ce3c0 0x7f3fe0153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.208+0000 7f3fe5c9f640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe0154ee0 0x7f3fe01e61e0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c450 tx=0x7f3fd800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.209+0000 7f3fd5ffb640 1 -- 172.21.15.172:0/172215216 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8018070 con 0x7f3fe0154ee0 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.209+0000 7f3fd5ffb640 1 -- 172.21.15.172:0/172215216 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd8007500 con 0x7f3fe0154ee0 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.209+0000 7f3fe7702640 1 -- 172.21.15.172:0/172215216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe01573b0 con 0x7f3fe0154ee0 2024-04-25T08:50:53.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.209+0000 7f3fd5ffb640 1 -- 172.21.15.172:0/172215216 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8004a20 con 0x7f3fe0154ee0 2024-04-25T08:50:53.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.209+0000 7f3fe7702640 1 -- 172.21.15.172:0/172215216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe0157970 con 0x7f3fe0154ee0 2024-04-25T08:50:53.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.210+0000 7f3fe7702640 1 -- 172.21.15.172:0/172215216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe0073990 con 0x7f3fe0154ee0 2024-04-25T08:50:53.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.210+0000 7f3fd5ffb640 1 -- 172.21.15.172:0/172215216 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3fd801b070 con 0x7f3fe0154ee0 2024-04-25T08:50:53.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.211+0000 7f3fd5ffb640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 0x7f3fc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.211+0000 7f3fd5ffb640 1 -- 172.21.15.172:0/172215216 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3fd8089570 con 0x7f3fe0154ee0 2024-04-25T08:50:53.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.211+0000 7f3fe549e640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 0x7f3fc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.211+0000 7f3fe549e640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 0x7f3fc406d990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3fe01548d0 tx=0x7f3fdc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:53.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.215+0000 7f3fd5ffb640 1 -- 172.21.15.172:0/172215216 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3fd80582f0 con 0x7f3fe0154ee0 2024-04-25T08:50:53.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.386+0000 7f3fe7702640 1 -- 172.21.15.172:0/172215216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fe006d360 con 0x7f3fe0154ee0 2024-04-25T08:50:53.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.387+0000 7f3fd5ffb640 1 -- 172.21.15.172:0/172215216 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16973 (secure 0 0 0) 0x7f3fd8057bf0 con 0x7f3fe0154ee0 2024-04-25T08:50:53.378 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:53.378 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":130,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:52.392551+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:50.627461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:51.373323+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 -- 172.21.15.172:0/172215216 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 msgr2=0x7f3fc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 0x7f3fc406d990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3fe01548d0 tx=0x7f3fdc009040 comp rx=0 tx=0).stop 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 -- 172.21.15.172:0/172215216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe0154ee0 msgr2=0x7f3fe01e61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe0154ee0 0x7f3fe01e61e0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c450 tx=0x7f3fd800c910 comp rx=0 tx=0).stop 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 -- 172.21.15.172:0/172215216 shutdown_connections 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 0x7f3fc406d990 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe0154ee0 0x7f3fe01e61e0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe00cfec0 0x7f3fe01566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 --2- 172.21.15.172:0/172215216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe00ce3c0 0x7f3fe0153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 -- 172.21.15.172:0/172215216 >> 172.21.15.172:0/172215216 conn(0x7f3fe006abe0 msgr2=0x7f3fe00b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 -- 172.21.15.172:0/172215216 shutdown_connections 2024-04-25T08:50:53.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.389+0000 7f3fe7702640 1 -- 172.21.15.172:0/172215216 wait complete. 2024-04-25T08:50:53.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:53.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.498+0000 7f769144a640 1 Processor -- start 2024-04-25T08:50:53.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.498+0000 7f769144a640 1 -- start start 2024-04-25T08:50:53.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f769144a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f768c0b2cb0 0x7f768c0d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f769144a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f768c0d1020 0x7f768c0d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f769144a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c0b97a0 con 0x7f768c15dbe0 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f769144a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768c15dfc0 con 0x7f768c0b2cb0 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f769144a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0d1a00 con 0x7f768c0d1020 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f768a7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f768c0b2cb0 0x7f768c0d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f768a7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f768c0b2cb0 0x7f768c0d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39014/0 (socket says 172.21.15.172:39014) 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f768a7fc640 1 -- 172.21.15.172:0/3856292977 learned_addr learned my addr 172.21.15.172:0/3856292977 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f768b7fe640 1 --2- 172.21.15.172:0/3856292977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f768c0d1020 0x7f768c0d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f768a7fc640 1 -- 172.21.15.172:0/3856292977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f768c0d1020 msgr2=0x7f768c0d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f768a7fc640 1 --2- 172.21.15.172:0/3856292977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f768c0d1020 0x7f768c0d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f768a7fc640 1 -- 172.21.15.172:0/3856292977 >> v1:172.21.15.186:6789/0 conn(0x7f768c15dbe0 legacy=0x7f768c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.499+0000 7f768a7fc640 1 -- 172.21.15.172:0/3856292977 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0d1c50 con 0x7f768c0b2cb0 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.500+0000 7f768a7fc640 1 --2- 172.21.15.172:0/3856292977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 0x7f768c0d2730 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f7680009870 tx=0x7f768002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3fa7923d29da42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:53.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.500+0000 7f7689ffb640 1 -- 172.21.15.172:0/3856292977 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680037070 con 0x7f768c0b2cb0 2024-04-25T08:50:53.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.500+0000 7f7689ffb640 1 -- 172.21.15.172:0/3856292977 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680032440 con 0x7f768c0b2cb0 2024-04-25T08:50:53.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.500+0000 7f7689ffb640 1 -- 172.21.15.172:0/3856292977 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680032810 con 0x7f768c0b2cb0 2024-04-25T08:50:53.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.501+0000 7f769144a640 1 -- 172.21.15.172:0/3856292977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 msgr2=0x7f768c0d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.501+0000 7f769144a640 1 --2- 172.21.15.172:0/3856292977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 0x7f768c0d2730 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f7680009870 tx=0x7f768002a270 comp rx=0 tx=0).stop 2024-04-25T08:50:53.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.501+0000 7f769144a640 1 -- 172.21.15.172:0/3856292977 shutdown_connections 2024-04-25T08:50:53.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.501+0000 7f769144a640 1 --2- 172.21.15.172:0/3856292977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f768c0d1020 0x7f768c0d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.501+0000 7f769144a640 1 --2- 172.21.15.172:0/3856292977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 0x7f768c0d2730 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.501+0000 7f769144a640 1 -- 172.21.15.172:0/3856292977 >> 172.21.15.172:0/3856292977 conn(0x7f768c061a20 msgr2=0x7f768c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:53.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.501+0000 7f769144a640 1 -- 172.21.15.172:0/3856292977 shutdown_connections 2024-04-25T08:50:53.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.501+0000 7f769144a640 1 -- 172.21.15.172:0/3856292977 wait complete. 2024-04-25T08:50:53.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.502+0000 7f769144a640 1 Processor -- start 2024-04-25T08:50:53.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.502+0000 7f769144a640 1 -- start start 2024-04-25T08:50:53.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f769144a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 0x7f768c151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f769144a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f768c0d1020 0x7f768c0b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f769144a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f768c15dbe0 0x7f768c160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f769144a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0b92a0 con 0x7f768c0b2cb0 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f769144a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0d2210 con 0x7f768c0d1020 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f769144a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0b9420 con 0x7f768c15dbe0 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 0x7f768c151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 0x7f768c151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39016/0 (socket says 172.21.15.172:39016) 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768affd640 1 -- 172.21.15.172:0/2882154065 learned_addr learned my addr 172.21.15.172:0/2882154065 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768a7fc640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f768c0d1020 0x7f768c0b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768b7fe640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f768c15dbe0 0x7f768c160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768affd640 1 -- 172.21.15.172:0/2882154065 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f768c15dbe0 msgr2=0x7f768c160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768affd640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f768c15dbe0 0x7f768c160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768affd640 1 -- 172.21.15.172:0/2882154065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f768c0d1020 msgr2=0x7f768c0b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768affd640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f768c0d1020 0x7f768c0b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768affd640 1 -- 172.21.15.172:0/2882154065 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0cadc0 con 0x7f768c0b2cb0 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f768affd640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 0x7f768c151ad0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c730 tx=0x7f767c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f76737fe640 1 -- 172.21.15.172:0/2882154065 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c016020 con 0x7f768c0b2cb0 2024-04-25T08:50:53.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f76737fe640 1 -- 172.21.15.172:0/2882154065 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c006d50 con 0x7f768c0b2cb0 2024-04-25T08:50:53.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f769144a640 1 -- 172.21.15.172:0/2882154065 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c0cb0a0 con 0x7f768c0b2cb0 2024-04-25T08:50:53.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.503+0000 7f76737fe640 1 -- 172.21.15.172:0/2882154065 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c003bb0 con 0x7f768c0b2cb0 2024-04-25T08:50:53.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.504+0000 7f769144a640 1 -- 172.21.15.172:0/2882154065 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c0cb660 con 0x7f768c0b2cb0 2024-04-25T08:50:53.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.504+0000 7f769144a640 1 -- 172.21.15.172:0/2882154065 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768c073990 con 0x7f768c0b2cb0 2024-04-25T08:50:53.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.505+0000 7f76737fe640 1 -- 172.21.15.172:0/2882154065 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f767c00a850 con 0x7f768c0b2cb0 2024-04-25T08:50:53.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.505+0000 7f76737fe640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f767806b4d0 0x7f767806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.505+0000 7f76737fe640 1 -- 172.21.15.172:0/2882154065 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f767c089fb0 con 0x7f768c0b2cb0 2024-04-25T08:50:53.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.505+0000 7f768a7fc640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f767806b4d0 0x7f767806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.506+0000 7f768a7fc640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f767806b4d0 0x7f767806d990 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7680034000 tx=0x7f768002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:53.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.509+0000 7f76737fe640 1 -- 172.21.15.172:0/2882154065 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f767c020020 con 0x7f768c0b2cb0 2024-04-25T08:50:53.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.681+0000 7f769144a640 1 -- 172.21.15.172:0/2882154065 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f768c0ca200 con 0x7f768c0b2cb0 2024-04-25T08:50:53.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.682+0000 7f76737fe640 1 -- 172.21.15.172:0/2882154065 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16973 (secure 0 0 0) 0x7f767c019310 con 0x7f768c0b2cb0 2024-04-25T08:50:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:53.673 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":130,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:52.392551+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:50.627461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:51.373323+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:53.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 -- 172.21.15.172:0/2882154065 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f767806b4d0 msgr2=0x7f767806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f767806b4d0 0x7f767806d990 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7680034000 tx=0x7f768002e000 comp rx=0 tx=0).stop 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 -- 172.21.15.172:0/2882154065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 msgr2=0x7f768c151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 0x7f768c151ad0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c730 tx=0x7f767c00cbf0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 -- 172.21.15.172:0/2882154065 shutdown_connections 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f767806b4d0 0x7f767806d990 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f768c0d1020 0x7f768c0b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f768c15dbe0 0x7f768c160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 --2- 172.21.15.172:0/2882154065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f768c0b2cb0 0x7f768c151ad0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 -- 172.21.15.172:0/2882154065 >> 172.21.15.172:0/2882154065 conn(0x7f768c061a20 msgr2=0x7f768c0d2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 -- 172.21.15.172:0/2882154065 shutdown_connections 2024-04-25T08:50:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.684+0000 7f769144a640 1 -- 172.21.15.172:0/2882154065 wait complete. 2024-04-25T08:50:53.686 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:50:53.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.796+0000 7f69c0302640 1 Processor -- start 2024-04-25T08:50:53.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.796+0000 7f69c0302640 1 -- start start 2024-04-25T08:50:53.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69c0302640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69b8162140 0x7f69b80cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69c0302640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b80cd540 0x7f69b80caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69c0302640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b815e3a0 con 0x7f69b80d0a00 2024-04-25T08:50:53.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69c0302640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b81625c0 con 0x7f69b8162140 2024-04-25T08:50:53.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69c0302640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b80cd9d0 con 0x7f69b80cd540 2024-04-25T08:50:53.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69bd89d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69b8162140 0x7f69b80cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69bd89d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69b8162140 0x7f69b80cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39022/0 (socket says 172.21.15.172:39022) 2024-04-25T08:50:53.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69bd89d640 1 -- 172.21.15.172:0/1015743080 learned_addr learned my addr 172.21.15.172:0/1015743080 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:53.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69be09e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f69b80d0a00 0x7f69b80d0de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43060/0 (socket says 172.21.15.172:43060) 2024-04-25T08:50:53.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69be89f640 1 --2- 172.21.15.172:0/1015743080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b80cd540 0x7f69b80caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69bd89d640 1 -- 172.21.15.172:0/1015743080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b80cd540 msgr2=0x7f69b80caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:53.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69bd89d640 1 --2- 172.21.15.172:0/1015743080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b80cd540 0x7f69b80caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69bd09c640 1 -- 172.21.15.172:0/1015743080 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34571501 0 0) 0x7f69b815e3a0 con 0x7f69b80d0a00 2024-04-25T08:50:53.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69bd89d640 1 -- 172.21.15.172:0/1015743080 >> v1:172.21.15.172:6789/0 conn(0x7f69b80d0a00 legacy=0x7f69b80d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.797+0000 7f69bd89d640 1 -- 172.21.15.172:0/1015743080 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b80cdc70 con 0x7f69b8162140 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.798+0000 7f69bd89d640 1 --2- 172.21.15.172:0/1015743080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b8162140 0x7f69b80cd000 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f69a8009870 tx=0x7f69a802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbb26b672ebf6bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.798+0000 7f69bd09c640 1 -- 172.21.15.172:0/1015743080 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8037070 con 0x7f69b8162140 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.798+0000 7f69bd09c640 1 -- 172.21.15.172:0/1015743080 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a8032440 con 0x7f69b8162140 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.798+0000 7f69bd09c640 1 -- 172.21.15.172:0/1015743080 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8032810 con 0x7f69b8162140 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.799+0000 7f69c0302640 1 -- 172.21.15.172:0/1015743080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b8162140 msgr2=0x7f69b80cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.799+0000 7f69c0302640 1 --2- 172.21.15.172:0/1015743080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b8162140 0x7f69b80cd000 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f69a8009870 tx=0x7f69a802a1c0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.799+0000 7f69c0302640 1 -- 172.21.15.172:0/1015743080 shutdown_connections 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.799+0000 7f69c0302640 1 --2- 172.21.15.172:0/1015743080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b80cd540 0x7f69b80caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.799+0000 7f69c0302640 1 --2- 172.21.15.172:0/1015743080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b8162140 0x7f69b80cd000 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.799+0000 7f69c0302640 1 -- 172.21.15.172:0/1015743080 >> 172.21.15.172:0/1015743080 conn(0x7f69b80d17c0 msgr2=0x7f69b80d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.799+0000 7f69c0302640 1 -- 172.21.15.172:0/1015743080 shutdown_connections 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.799+0000 7f69c0302640 1 -- 172.21.15.172:0/1015743080 wait complete. 2024-04-25T08:50:53.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.800+0000 7f69c0302640 1 Processor -- start 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.800+0000 7f69c0302640 1 -- start start 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.800+0000 7f69c0302640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b80cd540 0x7f69b81e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69c0302640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b80d0a00 0x7f69b80b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69c0302640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b8162140 0x7f69b80b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69c0302640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b8161940 con 0x7f69b80d0a00 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69c0302640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b8161660 con 0x7f69b80cd540 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69c0302640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b8161c20 con 0x7f69b8162140 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69bd89d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b80d0a00 0x7f69b80b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69bd89d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b80d0a00 0x7f69b80b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39038/0 (socket says 172.21.15.172:39038) 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69bd89d640 1 -- 172.21.15.172:0/1448954881 learned_addr learned my addr 172.21.15.172:0/1448954881 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69be09e640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b80cd540 0x7f69b81e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69bd89d640 1 -- 172.21.15.172:0/1448954881 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b8162140 msgr2=0x7f69b80b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69be89f640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b8162140 0x7f69b80b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69bd89d640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b8162140 0x7f69b80b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69bd89d640 1 -- 172.21.15.172:0/1448954881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b80cd540 msgr2=0x7f69b81e7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69bd89d640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b80cd540 0x7f69b81e7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69bd89d640 1 -- 172.21.15.172:0/1448954881 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b80b11f0 con 0x7f69b80d0a00 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69be09e640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b80cd540 0x7f69b81e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69be89f640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b8162140 0x7f69b80b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69bd89d640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b80d0a00 0x7f69b80b2290 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f69a802a200 tx=0x7f69a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69aeffd640 1 -- 172.21.15.172:0/1448954881 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8037040 con 0x7f69b80d0a00 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69aeffd640 1 -- 172.21.15.172:0/1448954881 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a8042070 con 0x7f69b80d0a00 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69c0302640 1 -- 172.21.15.172:0/1448954881 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b80b14d0 con 0x7f69b80d0a00 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69aeffd640 1 -- 172.21.15.172:0/1448954881 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8030bb0 con 0x7f69b80d0a00 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.801+0000 7f69c0302640 1 -- 172.21.15.172:0/1448954881 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b80b1a90 con 0x7f69b80d0a00 2024-04-25T08:50:53.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.802+0000 7f69c0302640 1 -- 172.21.15.172:0/1448954881 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b8073a00 con 0x7f69b80d0a00 2024-04-25T08:50:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.803+0000 7f69aeffd640 1 -- 172.21.15.172:0/1448954881 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f69a802ad10 con 0x7f69b80d0a00 2024-04-25T08:50:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.803+0000 7f69aeffd640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f699c06b4d0 0x7f699c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.803+0000 7f69aeffd640 1 -- 172.21.15.172:0/1448954881 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f69a80aac50 con 0x7f69b80d0a00 2024-04-25T08:50:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.803+0000 7f69be09e640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f699c06b4d0 0x7f699c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:53.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.803+0000 7f69be09e640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f699c06b4d0 0x7f699c06d990 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f69b4000f60 tx=0x7f69b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:53.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:53.807+0000 7f69aeffd640 1 -- 172.21.15.172:0/1448954881 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69a80b0020 con 0x7f69b80d0a00 2024-04-25T08:50:54.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.017+0000 7f69c0302640 1 -- 172.21.15.172:0/1448954881 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f69b8071d60 con 0x7f69b80d0a00 2024-04-25T08:50:54.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.072+0000 7f69aeffd640 1 -- 172.21.15.172:0/1448954881 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7f69a8045360 con 0x7f69b80d0a00 2024-04-25T08:50:54.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 -- 172.21.15.172:0/1448954881 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f699c06b4d0 msgr2=0x7f699c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:54.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f699c06b4d0 0x7f699c06d990 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f69b4000f60 tx=0x7f69b4009040 comp rx=0 tx=0).stop 2024-04-25T08:50:54.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 -- 172.21.15.172:0/1448954881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b80d0a00 msgr2=0x7f69b80b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:54.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b80d0a00 0x7f69b80b2290 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f69a802a200 tx=0x7f69a80046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:54.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 -- 172.21.15.172:0/1448954881 shutdown_connections 2024-04-25T08:50:54.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f699c06b4d0 0x7f699c06d990 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:54.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69b8162140 0x7f69b80b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:54.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69b80d0a00 0x7f69b80b2290 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:54.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 --2- 172.21.15.172:0/1448954881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b80cd540 0x7f69b81e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:54.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 -- 172.21.15.172:0/1448954881 >> 172.21.15.172:0/1448954881 conn(0x7f69b80d17c0 msgr2=0x7f69b8070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:54.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 -- 172.21.15.172:0/1448954881 shutdown_connections 2024-04-25T08:50:54.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.074+0000 7f69c0302640 1 -- 172.21.15.172:0/1448954881 wait complete. 2024-04-25T08:50:54.076 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:50:54.076 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:50:54.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.186+0000 7f1309253640 1 Processor -- start 2024-04-25T08:50:54.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.186+0000 7f1309253640 1 -- start start 2024-04-25T08:50:54.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.187+0000 7f1309253640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 0x7f13040cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.187+0000 7f1309253640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f130415b1c0 0x7f130415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.187+0000 7f1309253640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130415e6e0 con 0x7f130415e1a0 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.187+0000 7f1309253640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130415b620 con 0x7f130415b1c0 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.187+0000 7f1309253640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130415e9c0 con 0x7f13040cd4c0 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.188+0000 7f1302d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 0x7f13040cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.188+0000 7f130259c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f130415b1c0 0x7f130415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.188+0000 7f1302d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 0x7f13040cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:45428/0 (socket says 172.21.15.172:45428) 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.188+0000 7f1302d9d640 1 -- 172.21.15.172:0/3360912568 learned_addr learned my addr 172.21.15.172:0/3360912568 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.188+0000 7f130259c640 1 -- 172.21.15.172:0/3360912568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 msgr2=0x7f13040cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.188+0000 7f130259c640 1 --2- 172.21.15.172:0/3360912568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 0x7f13040cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.188+0000 7f130259c640 1 -- 172.21.15.172:0/3360912568 >> v1:172.21.15.186:6789/0 conn(0x7f130415e1a0 legacy=0x7f1304150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.188+0000 7f130259c640 1 -- 172.21.15.172:0/3360912568 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130415a9c0 con 0x7f130415b1c0 2024-04-25T08:50:54.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.188+0000 7f1301d9b640 1 -- 172.21.15.172:0/3360912568 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952855256 0 0) 0x7f130415e6e0 con 0x7f130415e1a0 2024-04-25T08:50:54.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.188+0000 7f1302d9d640 1 --2- 172.21.15.172:0/3360912568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 0x7f13040cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:54.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f130259c640 1 --2- 172.21.15.172:0/3360912568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f130415b1c0 0x7f130415dc60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f12f80097a0 tx=0x7f12f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c80b6041258e7379 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:54.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1301d9b640 1 -- 172.21.15.172:0/3360912568 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8037070 con 0x7f130415b1c0 2024-04-25T08:50:54.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1301d9b640 1 -- 172.21.15.172:0/3360912568 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8032440 con 0x7f130415b1c0 2024-04-25T08:50:54.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1301d9b640 1 -- 172.21.15.172:0/3360912568 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8032810 con 0x7f130415b1c0 2024-04-25T08:50:54.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1309253640 1 -- 172.21.15.172:0/3360912568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f130415b1c0 msgr2=0x7f130415dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:54.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1309253640 1 --2- 172.21.15.172:0/3360912568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f130415b1c0 0x7f130415dc60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f12f80097a0 tx=0x7f12f802a180 comp rx=0 tx=0).stop 2024-04-25T08:50:54.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1309253640 1 -- 172.21.15.172:0/3360912568 shutdown_connections 2024-04-25T08:50:54.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1309253640 1 --2- 172.21.15.172:0/3360912568 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f130415b1c0 0x7f130415dc60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:54.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1309253640 1 --2- 172.21.15.172:0/3360912568 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 0x7f13040cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:54.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1309253640 1 -- 172.21.15.172:0/3360912568 >> 172.21.15.172:0/3360912568 conn(0x7f130406abe0 msgr2=0x7f130406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:54.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1309253640 1 -- 172.21.15.172:0/3360912568 shutdown_connections 2024-04-25T08:50:54.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.189+0000 7f1309253640 1 -- 172.21.15.172:0/3360912568 wait complete. 2024-04-25T08:50:54.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.191+0000 7f1309253640 1 Processor -- start 2024-04-25T08:50:54.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.191+0000 7f1309253640 1 -- start start 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f1309253640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 0x7f13040afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f1309253640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f130415b1c0 0x7f1304142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f1309253640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f130415e1a0 0x7f1304149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f1309253640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130406eca0 con 0x7f130415e1a0 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f1309253640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130415a670 con 0x7f130415b1c0 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f1309253640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130406ee20 con 0x7f13040cd4c0 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f130359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f130415e1a0 0x7f1304149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f130359e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f130415e1a0 0x7f1304149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39050/0 (socket says 172.21.15.172:39050) 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f130359e640 1 -- 172.21.15.172:0/1028422810 learned_addr learned my addr 172.21.15.172:0/1028422810 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f1302d9d640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 0x7f13040afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f130259c640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f130415b1c0 0x7f1304142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:54.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f130359e640 1 -- 172.21.15.172:0/1028422810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 msgr2=0x7f13040afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f130359e640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 0x7f13040afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f130359e640 1 -- 172.21.15.172:0/1028422810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f130415b1c0 msgr2=0x7f1304142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f130359e640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f130415b1c0 0x7f1304142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f130359e640 1 -- 172.21.15.172:0/1028422810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13040b1a50 con 0x7f130415e1a0 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f130359e640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f130415e1a0 0x7f1304149320 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00c440 tx=0x7f12fc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f12eb7fe640 1 -- 172.21.15.172:0/1028422810 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc017070 con 0x7f130415e1a0 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f12eb7fe640 1 -- 172.21.15.172:0/1028422810 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc0035f0 con 0x7f130415e1a0 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f1309253640 1 -- 172.21.15.172:0/1028422810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13040b2290 con 0x7f130415e1a0 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f12eb7fe640 1 -- 172.21.15.172:0/1028422810 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0039e0 con 0x7f130415e1a0 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.192+0000 7f1309253640 1 -- 172.21.15.172:0/1028422810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130413e4d0 con 0x7f130415e1a0 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.193+0000 7f1309253640 1 -- 172.21.15.172:0/1028422810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1304073a00 con 0x7f130415e1a0 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.194+0000 7f12eb7fe640 1 -- 172.21.15.172:0/1028422810 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f12fc01a070 con 0x7f130415e1a0 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.194+0000 7f12eb7fe640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f12f006b4d0 0x7f12f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:54.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.194+0000 7f12eb7fe640 1 -- 172.21.15.172:0/1028422810 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f12fc089640 con 0x7f130415e1a0 2024-04-25T08:50:54.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.194+0000 7f1302d9d640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f12f006b4d0 0x7f12f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:54.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.195+0000 7f1302d9d640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f12f006b4d0 0x7f12f006d990 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009240 tx=0x7f12f400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:54.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.199+0000 7f12eb7fe640 1 -- 172.21.15.172:0/1028422810 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f13040b1a50 con 0x7f130415e1a0 2024-04-25T08:50:54.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:54.403+0000 7f1309253640 1 -- 172.21.15.172:0/1028422810 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f13040ccb10 con 0x7f130415e1a0 2024-04-25T08:50:55.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.083+0000 7f12eb7fe640 1 -- 172.21.15.172:0/1028422810 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7f12fc058480 con 0x7f130415e1a0 2024-04-25T08:50:55.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 -- 172.21.15.172:0/1028422810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f12f006b4d0 msgr2=0x7f12f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f12f006b4d0 0x7f12f006d990 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009240 tx=0x7f12f400b040 comp rx=0 tx=0).stop 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 -- 172.21.15.172:0/1028422810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f130415e1a0 msgr2=0x7f1304149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f130415e1a0 0x7f1304149320 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00c440 tx=0x7f12fc00c900 comp rx=0 tx=0).stop 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 -- 172.21.15.172:0/1028422810 shutdown_connections 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f12f006b4d0 0x7f12f006d990 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f130415b1c0 0x7f1304142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f130415e1a0 0x7f1304149320 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 --2- 172.21.15.172:0/1028422810 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13040cd4c0 0x7f13040afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 -- 172.21.15.172:0/1028422810 >> 172.21.15.172:0/1028422810 conn(0x7f130406abe0 msgr2=0x7f130406d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 -- 172.21.15.172:0/1028422810 shutdown_connections 2024-04-25T08:50:55.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.085+0000 7f1309253640 1 -- 172.21.15.172:0/1028422810 wait complete. 2024-04-25T08:50:55.087 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:50:55.087 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:50:55.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.195+0000 7f2621a07640 1 Processor -- start 2024-04-25T08:50:55.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.195+0000 7f2621a07640 1 -- start start 2024-04-25T08:50:55.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.196+0000 7f2621a07640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f261c15a790 0x7f261c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.196+0000 7f2621a07640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f261c0b4eb0 0x7f261c0d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.196+0000 7f2621a07640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0b3710 con 0x7f261c06fea0 2024-04-25T08:50:55.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.196+0000 7f2621a07640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0cf0e0 con 0x7f261c0b4eb0 2024-04-25T08:50:55.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.196+0000 7f2621a07640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0cf3c0 con 0x7f261c15a790 2024-04-25T08:50:55.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.196+0000 7f261b7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f261c0b4eb0 0x7f261c0d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.196+0000 7f261a7fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f261c06fea0 0x7f261c072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43070/0 (socket says 172.21.15.172:43070) 2024-04-25T08:50:55.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.196+0000 7f261a7fc640 1 -- 172.21.15.172:0/127559476 learned_addr learned my addr 172.21.15.172:0/127559476 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:55.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.196+0000 7f261b7fe640 1 --2- 172.21.15.172:0/127559476 >> v2:172.21.15.172:3300/0 conn(0x7f261c0b4eb0 0x7f261c0d08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39052/0 (socket says 172.21.15.172:39052) 2024-04-25T08:50:55.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.196+0000 7f261affd640 1 --2- 172.21.15.172:0/127559476 >> v2:172.21.15.186:3300/0 conn(0x7f261c15a790 0x7f261c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.197+0000 7f261b7fe640 1 -- 172.21.15.172:0/127559476 >> v2:172.21.15.186:3300/0 conn(0x7f261c15a790 msgr2=0x7f261c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:55.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.197+0000 7f261b7fe640 1 --2- 172.21.15.172:0/127559476 >> v2:172.21.15.186:3300/0 conn(0x7f261c15a790 0x7f261c0d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.197+0000 7f261b7fe640 1 -- 172.21.15.172:0/127559476 >> v1:172.21.15.172:6789/0 conn(0x7f261c06fea0 legacy=0x7f261c072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.197+0000 7f261b7fe640 1 -- 172.21.15.172:0/127559476 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0cf6a0 con 0x7f261c0b4eb0 2024-04-25T08:50:55.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.197+0000 7f261b7fe640 1 --2- 172.21.15.172:0/127559476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c0b4eb0 0x7f261c0d08d0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f261c0b2e90 tx=0x7f261402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82214a56a6e1687 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:55.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.197+0000 7f2619ffb640 1 -- 172.21.15.172:0/127559476 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614037070 con 0x7f261c0b4eb0 2024-04-25T08:50:55.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.197+0000 7f2619ffb640 1 -- 172.21.15.172:0/127559476 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614032440 con 0x7f261c0b4eb0 2024-04-25T08:50:55.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.197+0000 7f2619ffb640 1 -- 172.21.15.172:0/127559476 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614032810 con 0x7f261c0b4eb0 2024-04-25T08:50:55.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.198+0000 7f2621a07640 1 -- 172.21.15.172:0/127559476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c0b4eb0 msgr2=0x7f261c0d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.198+0000 7f2621a07640 1 --2- 172.21.15.172:0/127559476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c0b4eb0 0x7f261c0d08d0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f261c0b2e90 tx=0x7f261402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.198+0000 7f2621a07640 1 -- 172.21.15.172:0/127559476 shutdown_connections 2024-04-25T08:50:55.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.198+0000 7f2621a07640 1 --2- 172.21.15.172:0/127559476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c0b4eb0 0x7f261c0d08d0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.198+0000 7f2621a07640 1 --2- 172.21.15.172:0/127559476 >> v2:172.21.15.186:3300/0 conn(0x7f261c15a790 0x7f261c0d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.198+0000 7f2621a07640 1 -- 172.21.15.172:0/127559476 >> 172.21.15.172:0/127559476 conn(0x7f261c0b2370 msgr2=0x7f261c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:55.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.198+0000 7f2621a07640 1 -- 172.21.15.172:0/127559476 shutdown_connections 2024-04-25T08:50:55.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.198+0000 7f2621a07640 1 -- 172.21.15.172:0/127559476 wait complete. 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.199+0000 7f2621a07640 1 Processor -- start 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.199+0000 7f2621a07640 1 -- start start 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f2621a07640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f261c06fea0 0x7f261c142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f2621a07640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f261c0b4eb0 0x7f261c1f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f2621a07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c15a790 0x7f261c0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f2621a07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c15ab70 con 0x7f261c15a790 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f2621a07640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0cf980 con 0x7f261c06fea0 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f2621a07640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c15acf0 con 0x7f261c0b4eb0 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f261b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c15a790 0x7f261c0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f261b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c15a790 0x7f261c0cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39054/0 (socket says 172.21.15.172:39054) 2024-04-25T08:50:55.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f261b7fe640 1 -- 172.21.15.172:0/3368820797 learned_addr learned my addr 172.21.15.172:0/3368820797 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f261affd640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f261c06fea0 0x7f261c142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.200+0000 7f261a7fc640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f261c0b4eb0 0x7f261c1f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f261b7fe640 1 -- 172.21.15.172:0/3368820797 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f261c0b4eb0 msgr2=0x7f261c1f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f261b7fe640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f261c0b4eb0 0x7f261c1f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f261b7fe640 1 -- 172.21.15.172:0/3368820797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f261c06fea0 msgr2=0x7f261c142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f261b7fe640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f261c06fea0 0x7f261c142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f261b7fe640 1 -- 172.21.15.172:0/3368820797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c142670 con 0x7f261c15a790 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f261affd640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f261c06fea0 0x7f261c142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f261a7fc640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f261c0b4eb0 0x7f261c1f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f261b7fe640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c15a790 0x7f261c0cffe0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f2614035040 tx=0x7f26140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f2603fff640 1 -- 172.21.15.172:0/3368820797 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614037040 con 0x7f261c15a790 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f2603fff640 1 -- 172.21.15.172:0/3368820797 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614042070 con 0x7f261c15a790 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f2621a07640 1 -- 172.21.15.172:0/3368820797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c1e2ce0 con 0x7f261c15a790 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f2603fff640 1 -- 172.21.15.172:0/3368820797 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614030b30 con 0x7f261c15a790 2024-04-25T08:50:55.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.201+0000 7f2621a07640 1 -- 172.21.15.172:0/3368820797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c1e32a0 con 0x7f261c15a790 2024-04-25T08:50:55.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.202+0000 7f2621a07640 1 -- 172.21.15.172:0/3368820797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c073990 con 0x7f261c15a790 2024-04-25T08:50:55.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.202+0000 7f2603fff640 1 -- 172.21.15.172:0/3368820797 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2614030cd0 con 0x7f261c15a790 2024-04-25T08:50:55.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.203+0000 7f2603fff640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f260806b4d0 0x7f260806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.203+0000 7f2603fff640 1 -- 172.21.15.172:0/3368820797 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f26140aaec0 con 0x7f261c15a790 2024-04-25T08:50:55.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.203+0000 7f261affd640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f260806b4d0 0x7f260806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.203+0000 7f261affd640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f260806b4d0 0x7f260806d990 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f260c009a80 tx=0x7f260c0039d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:55.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.207+0000 7f2603fff640 1 -- 172.21.15.172:0/3368820797 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2614032e20 con 0x7f261c15a790 2024-04-25T08:50:55.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.415+0000 7f2621a07640 1 -- 172.21.15.172:0/3368820797 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f261c157d60 con 0x7f261c15a790 2024-04-25T08:50:55.406 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.415+0000 7f2603fff640 1 -- 172.21.15.172:0/3368820797 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f2614045360 con 0x7f261c15a790 2024-04-25T08:50:55.406 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:55.406 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:50:55.407 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:50:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 -- 172.21.15.172:0/3368820797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f260806b4d0 msgr2=0x7f260806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f260806b4d0 0x7f260806d990 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f260c009a80 tx=0x7f260c0039d0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 -- 172.21.15.172:0/3368820797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c15a790 msgr2=0x7f261c0cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c15a790 0x7f261c0cffe0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f2614035040 tx=0x7f26140046c0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 -- 172.21.15.172:0/3368820797 shutdown_connections 2024-04-25T08:50:55.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f260806b4d0 0x7f260806d990 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f261c15a790 0x7f261c0cffe0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f261c0b4eb0 0x7f261c1f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 --2- 172.21.15.172:0/3368820797 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f261c06fea0 0x7f261c142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 -- 172.21.15.172:0/3368820797 >> 172.21.15.172:0/3368820797 conn(0x7f261c0b2370 msgr2=0x7f261c0cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:55.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 -- 172.21.15.172:0/3368820797 shutdown_connections 2024-04-25T08:50:55.409 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.417+0000 7f2621a07640 1 -- 172.21.15.172:0/3368820797 wait complete. 2024-04-25T08:50:55.419 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:50:55.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.526+0000 7fa26bd22640 1 Processor -- start 2024-04-25T08:50:55.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.527+0000 7fa26bd22640 1 -- start start 2024-04-25T08:50:55.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.527+0000 7fa26bd22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa26406b1a0 0x7fa26406f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.527+0000 7fa26bd22640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa2640d0170 0x7fa26415d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.527+0000 7fa26bd22640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa264161960 con 0x7fa26406b580 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.527+0000 7fa26bd22640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2640cbd50 con 0x7fa2640d0170 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.527+0000 7fa26bd22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa264161c40 con 0x7fa26406b1a0 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa2692bd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa26406b580 0x7fa2640cfa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43086/0 (socket says 172.21.15.172:43086) 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa2692bd640 1 -- 172.21.15.172:0/3467973524 learned_addr learned my addr 172.21.15.172:0/3467973524 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa26a2bf640 1 --2- 172.21.15.172:0/3467973524 >> v2:172.21.15.186:3300/0 conn(0x7fa2640d0170 0x7fa26415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa269abe640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa26406b1a0 0x7fa26406f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578372525 0 0) 0x7fa264161960 con 0x7fa26406b580 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa250003520 con 0x7fa26406b580 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1221086010 0 0) 0x7fa250003520 con 0x7fa26406b580 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa26406b1a0 msgr2=0x7fa26406f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:55.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa26406b1a0 0x7fa26406f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 >> v2:172.21.15.186:3300/0 conn(0x7fa2640d0170 msgr2=0x7fa26415d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 --2- 172.21.15.172:0/3467973524 >> v2:172.21.15.186:3300/0 conn(0x7fa2640d0170 0x7fa26415d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa264161f20 con 0x7fa26406b580 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fa260001670 con 0x7fa26406b580 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa269abe640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa26406b1a0 0x7fa26406f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa26a2bf640 1 --2- 172.21.15.172:0/3467973524 >> v2:172.21.15.186:3300/0 conn(0x7fa2640d0170 0x7fa26415d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 >> v1:172.21.15.172:6789/0 conn(0x7fa26406b580 legacy=0x7fa2640cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa26406b1a0 0x7fa2500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250003ef0 0x7fa250004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa250004d40 0x7fa2500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2640cbd50 con 0x7fa250003ef0 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa264161c40 con 0x7fa250004d40 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25000b9c0 con 0x7fa26406b1a0 2024-04-25T08:50:55.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa2692bd640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250003ef0 0x7fa250004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa269abe640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa26406b1a0 0x7fa2500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.528+0000 7fa26a2bf640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa250004d40 0x7fa2500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.529+0000 7fa2692bd640 1 -- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa26406b1a0 msgr2=0x7fa2500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.529+0000 7fa2692bd640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa26406b1a0 0x7fa2500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.529+0000 7fa2692bd640 1 -- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa250004d40 msgr2=0x7fa2500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.529+0000 7fa2692bd640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa250004d40 0x7fa2500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.529+0000 7fa2692bd640 1 -- 172.21.15.172:0/3467973524 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa250003520 con 0x7fa250003ef0 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.529+0000 7fa2692bd640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250003ef0 0x7fa250004800 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fa26000c290 tx=0x7fa250005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9189f5b9aadb498 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.529+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260007d50 con 0x7fa250003ef0 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.529+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa260005af0 con 0x7fa250003ef0 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.529+0000 7fa268abc640 1 -- 172.21.15.172:0/3467973524 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260007070 con 0x7fa250003ef0 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.530+0000 7fa26bd22640 1 -- 172.21.15.172:0/3467973524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250003ef0 msgr2=0x7fa250004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.530+0000 7fa26bd22640 1 --2- 172.21.15.172:0/3467973524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa250003ef0 0x7fa250004800 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fa26000c290 tx=0x7fa250005830 comp rx=0 tx=0).stop 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.530+0000 7fa26a2bf640 1 -- 172.21.15.172:0/3467973524 reap_dead start 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.530+0000 7fa26bd22640 1 -- 172.21.15.172:0/3467973524 shutdown_connections 2024-04-25T08:50:55.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.530+0000 7fa26bd22640 1 -- 172.21.15.172:0/3467973524 >> 172.21.15.172:0/3467973524 conn(0x7fa2640b2220 msgr2=0x7fa2640b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:55.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.530+0000 7fa26bd22640 1 -- 172.21.15.172:0/3467973524 shutdown_connections 2024-04-25T08:50:55.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.530+0000 7fa26bd22640 1 -- 172.21.15.172:0/3467973524 wait complete. 2024-04-25T08:50:55.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.531+0000 7fa26bd22640 1 Processor -- start 2024-04-25T08:50:55.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.531+0000 7fa26bd22640 1 -- start start 2024-04-25T08:50:55.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa26bd22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa250003ef0 0x7fa2640b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa26bd22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640c5430 0x7fa2640c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.526 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa26bd22640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26414fa50 0x7fa2640ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa26bd22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa264070330 con 0x7fa2640c5430 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa26bd22640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa264162720 con 0x7fa26414fa50 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa26bd22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26406f9c0 con 0x7fa250003ef0 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa2692bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640c5430 0x7fa2640c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa2692bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640c5430 0x7fa2640c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39076/0 (socket says 172.21.15.172:39076) 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa2692bd640 1 -- 172.21.15.172:0/4029065102 learned_addr learned my addr 172.21.15.172:0/4029065102 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa269abe640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa250003ef0 0x7fa2640b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa26a2bf640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26414fa50 0x7fa2640ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa2692bd640 1 -- 172.21.15.172:0/4029065102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa250003ef0 msgr2=0x7fa2640b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa2692bd640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa250003ef0 0x7fa2640b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa2692bd640 1 -- 172.21.15.172:0/4029065102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26414fa50 msgr2=0x7fa2640ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa2692bd640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26414fa50 0x7fa2640ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa2692bd640 1 -- 172.21.15.172:0/4029065102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640b60e0 con 0x7fa2640c5430 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa26a2bf640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26414fa50 0x7fa2640ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.532+0000 7fa2692bd640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640c5430 0x7fa2640c69d0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fa260001970 tx=0x7fa264072110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:55.527 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.533+0000 7fa25a7fc640 1 -- 172.21.15.172:0/4029065102 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260042070 con 0x7fa2640c5430 2024-04-25T08:50:55.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.533+0000 7fa25a7fc640 1 -- 172.21.15.172:0/4029065102 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa260007480 con 0x7fa2640c5430 2024-04-25T08:50:55.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.533+0000 7fa26bd22640 1 -- 172.21.15.172:0/4029065102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2640c5930 con 0x7fa2640c5430 2024-04-25T08:50:55.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.533+0000 7fa25a7fc640 1 -- 172.21.15.172:0/4029065102 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260001c80 con 0x7fa2640c5430 2024-04-25T08:50:55.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.533+0000 7fa26bd22640 1 -- 172.21.15.172:0/4029065102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2640c5ef0 con 0x7fa2640c5430 2024-04-25T08:50:55.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.534+0000 7fa26bd22640 1 -- 172.21.15.172:0/4029065102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2640caa90 con 0x7fa2640c5430 2024-04-25T08:50:55.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.534+0000 7fa25a7fc640 1 -- 172.21.15.172:0/4029065102 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa260045070 con 0x7fa2640c5430 2024-04-25T08:50:55.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.534+0000 7fa25a7fc640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa24806b500 0x7fa24806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.535+0000 7fa269abe640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa24806b500 0x7fa24806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.535+0000 7fa25a7fc640 1 -- 172.21.15.172:0/4029065102 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa2600ab040 con 0x7fa2640c5430 2024-04-25T08:50:55.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.535+0000 7fa269abe640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa24806b500 0x7fa24806d9c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa254009a50 tx=0x7fa254009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:55.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.539+0000 7fa25a7fc640 1 -- 172.21.15.172:0/4029065102 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa260005ac0 con 0x7fa2640c5430 2024-04-25T08:50:55.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.712+0000 7fa26bd22640 1 -- 172.21.15.172:0/4029065102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa26406d370 con 0x7fa2640c5430 2024-04-25T08:50:55.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.713+0000 7fa25a7fc640 1 -- 172.21.15.172:0/4029065102 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16960 (secure 0 0 0) 0x7fa260079650 con 0x7fa2640c5430 2024-04-25T08:50:55.703 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:55.704 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":131,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:50:54.063964+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:50.627461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:51.373323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:50:55.705 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 -- 172.21.15.172:0/4029065102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa24806b500 msgr2=0x7fa24806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa24806b500 0x7fa24806d9c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa254009a50 tx=0x7fa254009190 comp rx=0 tx=0).stop 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 -- 172.21.15.172:0/4029065102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640c5430 msgr2=0x7fa2640c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640c5430 0x7fa2640c69d0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fa260001970 tx=0x7fa264072110 comp rx=0 tx=0).stop 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 -- 172.21.15.172:0/4029065102 shutdown_connections 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa24806b500 0x7fa24806d9c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26414fa50 0x7fa2640ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640c5430 0x7fa2640c69d0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 --2- 172.21.15.172:0/4029065102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa250003ef0 0x7fa2640b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 -- 172.21.15.172:0/4029065102 >> 172.21.15.172:0/4029065102 conn(0x7fa2640b2220 msgr2=0x7fa26415fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 -- 172.21.15.172:0/4029065102 shutdown_connections 2024-04-25T08:50:55.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.715+0000 7fa26bd22640 1 -- 172.21.15.172:0/4029065102 wait complete. 2024-04-25T08:50:55.717 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:50:55.717 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:50:55.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.824+0000 7fa7a9c88640 1 Processor -- start 2024-04-25T08:50:55.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.824+0000 7fa7a9c88640 1 -- start start 2024-04-25T08:50:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.824+0000 7fa7a9c88640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a40d1f20 0x7fa7a41625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.824+0000 7fa7a9c88640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a40cce50 con 0x7fa7a415dc90 2024-04-25T08:50:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.824+0000 7fa7a9c88640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a4161af0 con 0x7fa7a40cc8e0 2024-04-25T08:50:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.824+0000 7fa7a9c88640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4161dd0 con 0x7fa7a40d1f20 2024-04-25T08:50:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a37fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa7a415dc90 0x7fa7a415ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43100/0 (socket says 172.21.15.172:43100) 2024-04-25T08:50:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a37fe640 1 -- 172.21.15.172:0/259220935 learned_addr learned my addr 172.21.15.172:0/259220935 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a3fff640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a40d1f20 0x7fa7a41625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994406163 0 0) 0x7fa7a40cce50 con 0x7fa7a415dc90 2024-04-25T08:50:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa78c003520 con 0x7fa7a415dc90 2024-04-25T08:50:55.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 380282247 0 0) 0x7fa78c003520 con 0x7fa7a415dc90 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a40d1f20 msgr2=0x7fa7a41625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a40d1f20 0x7fa7a41625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 >> v1:172.21.15.186:6789/0 conn(0x7fa7a40cc8e0 legacy=0x7fa7a40d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a41620b0 con 0x7fa7a415dc90 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fa794001670 con 0x7fa7a415dc90 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 >> v1:172.21.15.172:6789/0 conn(0x7fa7a415dc90 legacy=0x7fa7a415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78c0039e0 0x7fa78c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 0x7fa78c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a40d1f20 0x7fa78c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4161dd0 con 0x7fa78c004390 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c00baa0 con 0x7fa78c0039e0 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c00bca0 con 0x7fa7a40d1f20 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a2ffd640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 0x7fa78c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a37fe640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78c0039e0 0x7fa78c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.825+0000 7fa7a3fff640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a40d1f20 0x7fa78c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.826+0000 7fa7a2ffd640 1 -- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a40d1f20 msgr2=0x7fa78c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.826+0000 7fa7a2ffd640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a40d1f20 0x7fa78c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.826+0000 7fa7a2ffd640 1 -- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78c0039e0 msgr2=0x7fa78c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.826+0000 7fa7a2ffd640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa78c0039e0 0x7fa78c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.826+0000 7fa7a2ffd640 1 -- 172.21.15.172:0/259220935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c003520 con 0x7fa78c004390 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.826+0000 7fa7a3fff640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a40d1f20 0x7fa78c005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.826+0000 7fa7a2ffd640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 0x7fa78c004860 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fa798001860 tx=0x7fa78c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc320a2aa1b3746 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.826+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798037070 con 0x7fa78c004390 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.827+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79802abf0 con 0x7fa78c004390 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.827+0000 7fa7a27fc640 1 -- 172.21.15.172:0/259220935 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798001430 con 0x7fa78c004390 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.827+0000 7fa7a9c88640 1 -- 172.21.15.172:0/259220935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 msgr2=0x7fa78c004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.827+0000 7fa7a9c88640 1 --2- 172.21.15.172:0/259220935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 0x7fa78c004860 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fa798001860 tx=0x7fa78c005830 comp rx=0 tx=0).stop 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.827+0000 7fa7a3fff640 1 -- 172.21.15.172:0/259220935 reap_dead start 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.827+0000 7fa7a9c88640 1 -- 172.21.15.172:0/259220935 shutdown_connections 2024-04-25T08:50:55.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.827+0000 7fa7a9c88640 1 -- 172.21.15.172:0/259220935 >> 172.21.15.172:0/259220935 conn(0x7fa7a406f590 msgr2=0x7fa7a406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:55.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.827+0000 7fa7a9c88640 1 -- 172.21.15.172:0/259220935 shutdown_connections 2024-04-25T08:50:55.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.827+0000 7fa7a9c88640 1 -- 172.21.15.172:0/259220935 wait complete. 2024-04-25T08:50:55.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.828+0000 7fa7a9c88640 1 Processor -- start 2024-04-25T08:50:55.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.828+0000 7fa7a9c88640 1 -- start start 2024-04-25T08:50:55.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a9c88640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 0x7fa7a414dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a9c88640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a4160880 0x7fa7a4160d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a9c88640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7a40ca9f0 0x7fa7a40cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a9c88640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a415e1f0 con 0x7fa78c004390 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a9c88640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a415e070 con 0x7fa7a40ca9f0 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a9c88640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a41625d0 con 0x7fa7a4160880 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 0x7fa7a414dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 0x7fa7a414dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39098/0 (socket says 172.21.15.172:39098) 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a37fe640 1 -- 172.21.15.172:0/1340984034 learned_addr learned my addr 172.21.15.172:0/1340984034 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a2ffd640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a4160880 0x7fa7a4160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.829+0000 7fa7a3fff640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7a40ca9f0 0x7fa7a40cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa7a37fe640 1 -- 172.21.15.172:0/1340984034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a4160880 msgr2=0x7fa7a4160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa7a37fe640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a4160880 0x7fa7a4160d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa7a37fe640 1 -- 172.21.15.172:0/1340984034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7a40ca9f0 msgr2=0x7fa7a40cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa7a37fe640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7a40ca9f0 0x7fa7a40cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa7a37fe640 1 -- 172.21.15.172:0/1340984034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a40cb700 con 0x7fa78c004390 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa7a37fe640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 0x7fa7a414dc70 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fa7940011e0 tx=0x7fa794007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:55.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa78bfff640 1 -- 172.21.15.172:0/1340984034 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400f720 con 0x7fa78c004390 2024-04-25T08:50:55.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa78bfff640 1 -- 172.21.15.172:0/1340984034 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa794018070 con 0x7fa78c004390 2024-04-25T08:50:55.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa78bfff640 1 -- 172.21.15.172:0/1340984034 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400fb40 con 0x7fa78c004390 2024-04-25T08:50:55.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa7a9c88640 1 -- 172.21.15.172:0/1340984034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a41f75f0 con 0x7fa78c004390 2024-04-25T08:50:55.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.830+0000 7fa7a9c88640 1 -- 172.21.15.172:0/1340984034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a41f7bb0 con 0x7fa78c004390 2024-04-25T08:50:55.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.831+0000 7fa7a9c88640 1 -- 172.21.15.172:0/1340984034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a4073990 con 0x7fa78c004390 2024-04-25T08:50:55.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.831+0000 7fa78bfff640 1 -- 172.21.15.172:0/1340984034 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa79400fce0 con 0x7fa78c004390 2024-04-25T08:50:55.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.832+0000 7fa78bfff640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa79006b4d0 0x7fa79006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:55.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.832+0000 7fa7a2ffd640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa79006b4d0 0x7fa79006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:55.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.832+0000 7fa78bfff640 1 -- 172.21.15.172:0/1340984034 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa79408a0b0 con 0x7fa78c004390 2024-04-25T08:50:55.825 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.832+0000 7fa7a2ffd640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa79006b4d0 0x7fa79006d990 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa798034000 tx=0x7fa798009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:55.826 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:55.836+0000 7fa78bfff640 1 -- 172.21.15.172:0/1340984034 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa794058750 con 0x7fa78c004390 2024-04-25T08:50:55.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.003+0000 7fa7a9c88640 1 -- 172.21.15.172:0/1340984034 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7a40cf6b0 con 0x7fa79006b4d0 2024-04-25T08:50:55.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.008+0000 7fa78bfff640 1 -- 172.21.15.172:0/1340984034 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+238103 (secure 0 0 0) 0x7fa7a40cf6b0 con 0x7fa79006b4d0 2024-04-25T08:50:56.002 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:56.003 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:50:56.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 -- 172.21.15.172:0/1340984034 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa79006b4d0 msgr2=0x7fa79006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa79006b4d0 0x7fa79006d990 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa798034000 tx=0x7fa798009030 comp rx=0 tx=0).stop 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 -- 172.21.15.172:0/1340984034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 msgr2=0x7fa7a414dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 0x7fa7a414dc70 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fa7940011e0 tx=0x7fa794007430 comp rx=0 tx=0).stop 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 -- 172.21.15.172:0/1340984034 shutdown_connections 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa79006b4d0 0x7fa79006d990 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7a40ca9f0 0x7fa7a40cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa7a4160880 0x7fa7a4160d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 --2- 172.21.15.172:0/1340984034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c004390 0x7fa7a414dc70 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 -- 172.21.15.172:0/1340984034 >> 172.21.15.172:0/1340984034 conn(0x7fa7a406f590 msgr2=0x7fa7a415c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 -- 172.21.15.172:0/1340984034 shutdown_connections 2024-04-25T08:50:56.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.011+0000 7fa7a9c88640 1 -- 172.21.15.172:0/1340984034 wait complete. 2024-04-25T08:50:56.013 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2024-04-25T08:50:54.616047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":24,"acting":24,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":403296,"kb_used_data":13588,"kb_used_omap":12,"kb_used_meta":389555,"kb_avail":754571424,"statfs":{"total":773094113280,"available":772681138176,"internally_reserved":0,"allocated":13914112,"data_stored":7078489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":398904880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000862"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.055078+0000","last_change":"2024-04-25T08:50:51.055078+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.055078+0000","last_undegraded":"2024-04-25T08:50:51.055078+0000","last_fullsized":"2024-04-25T08:50:51.055078+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058984+0000","last_change":"2024-04-25T08:50:51.058984+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058984+0000","last_undegraded":"2024-04-25T08:50:51.058984+0000","last_fullsized":"2024-04-25T08:50:51.058984+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058911+0000","last_change":"2024-04-25T08:50:51.058911+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058911+0000","last_undegraded":"2024-04-25T08:50:51.058911+0000","last_fullsized":"2024-04-25T08:50:51.058911+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.055326+0000","last_change":"2024-04-25T08:50:51.055326+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.055326+0000","last_undegraded":"2024-04-25T08:50:51.055326+0000","last_fullsized":"2024-04-25T08:50:51.055326+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058203+0000","last_change":"2024-04-25T08:50:51.058203+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058203+0000","last_undegraded":"2024-04-25T08:50:51.058203+0000","last_fullsized":"2024-04-25T08:50:51.058203+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058384+0000","last_change":"2024-04-25T08:50:51.058384+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058384+0000","last_undegraded":"2024-04-25T08:50:51.058384+0000","last_fullsized":"2024-04-25T08:50:51.058384+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.054967+0000","last_change":"2024-04-25T08:50:51.054967+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.054967+0000","last_undegraded":"2024-04-25T08:50:51.054967+0000","last_fullsized":"2024-04-25T08:50:51.054967+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.055227+0000","last_change":"2024-04-25T08:50:51.055227+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.055227+0000","last_undegraded":"2024-04-25T08:50:51.055227+0000","last_fullsized":"2024-04-25T08:50:51.055227+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058168+0000","last_change":"2024-04-25T08:50:51.058168+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058168+0000","last_undegraded":"2024-04-25T08:50:51.058168+0000","last_fullsized":"2024-04-25T08:50:51.058168+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058813+0000","last_change":"2024-04-25T08:50:51.058813+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058813+0000","last_undegraded":"2024-04-25T08:50:51.058813+0000","last_fullsized":"2024-04-25T08:50:51.058813+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058224+0000","last_change":"2024-04-25T08:50:51.058224+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058224+0000","last_undegraded":"2024-04-25T08:50:51.058224+0000","last_fullsized":"2024-04-25T08:50:51.058224+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":367,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-25T08:50:51.059291+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:50:51.059291+0000","last_peered":"2024-04-25T08:50:51.059291+0000","last_clean":"2024-04-25T08:50:51.059291+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:50:51.059291+0000","last_undegraded":"2024-04-25T08:50:51.059291+0000","last_fullsized":"2024-04-25T08:50:51.059291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47212,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324628,"statfs":{"total":96636764160,"available":96588419072,"internally_reserved":0,"allocated":2195456,"data_stored":1333020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50780,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321060,"statfs":{"total":96636764160,"available":96584765440,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46636,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325204,"statfs":{"total":96636764160,"available":96589008896,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50784,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54948,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316892,"statfs":{"total":96636764160,"available":96580497408,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50784,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50792,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51360,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320480,"statfs":{"total":96636764160,"available":96584171520,"internally_reserved":0,"allocated":2183168,"data_stored":1326811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:50:56.018 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:50:56.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.160+0000 7f4dcb122640 1 Processor -- start 2024-04-25T08:50:56.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.161+0000 7f4dcb122640 1 -- start start 2024-04-25T08:50:56.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.161+0000 7f4dcb122640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4dc4155fe0 0x7f4dc415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.161+0000 7f4dcb122640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 0x7f4dc4071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.161+0000 7f4dcb122640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc406de40 con 0x7f4dc4072000 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.161+0000 7f4dcb122640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc4072470 con 0x7f4dc4155fe0 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.161+0000 7f4dcb122640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40ad0e0 con 0x7f4dc40adbc0 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.162+0000 7f4dc8ebe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4dc4155fe0 0x7f4dc415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.162+0000 7f4dc8ebe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4dc4155fe0 0x7f4dc415c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39106/0 (socket says 172.21.15.172:39106) 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.162+0000 7f4dc8ebe640 1 -- 172.21.15.172:0/73611210 learned_addr learned my addr 172.21.15.172:0/73611210 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.162+0000 7f4dc3fff640 1 --2- 172.21.15.172:0/73611210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 0x7f4dc4071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.162+0000 7f4dc8ebe640 1 -- 172.21.15.172:0/73611210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 msgr2=0x7f4dc4071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.162+0000 7f4dc8ebe640 1 --2- 172.21.15.172:0/73611210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 0x7f4dc4071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.162+0000 7f4dc8ebe640 1 -- 172.21.15.172:0/73611210 >> v1:172.21.15.186:6789/0 conn(0x7f4dc4072000 legacy=0x7f4dc406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.162+0000 7f4dc8ebe640 1 -- 172.21.15.172:0/73611210 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40ad3c0 con 0x7f4dc4155fe0 2024-04-25T08:50:56.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.162+0000 7f4dc3fff640 1 --2- 172.21.15.172:0/73611210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 0x7f4dc4071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dc8ebe640 1 --2- 172.21.15.172:0/73611210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc4155fe0 0x7f4dc415c9e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009e50 tx=0x7f4dbc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c74271389c0fef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dc37fe640 1 -- 172.21.15.172:0/73611210 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc036070 con 0x7f4dc4155fe0 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dc37fe640 1 -- 172.21.15.172:0/73611210 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc031600 con 0x7f4dc4155fe0 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dc37fe640 1 -- 172.21.15.172:0/73611210 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0319d0 con 0x7f4dc4155fe0 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dcb122640 1 -- 172.21.15.172:0/73611210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc4155fe0 msgr2=0x7f4dc415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dcb122640 1 --2- 172.21.15.172:0/73611210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc4155fe0 0x7f4dc415c9e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009e50 tx=0x7f4dbc02a730 comp rx=0 tx=0).stop 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dcb122640 1 -- 172.21.15.172:0/73611210 shutdown_connections 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dcb122640 1 --2- 172.21.15.172:0/73611210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 0x7f4dc4071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dcb122640 1 --2- 172.21.15.172:0/73611210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc4155fe0 0x7f4dc415c9e0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dcb122640 1 -- 172.21.15.172:0/73611210 >> 172.21.15.172:0/73611210 conn(0x7f4dc40af670 msgr2=0x7f4dc40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:56.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dcb122640 1 -- 172.21.15.172:0/73611210 shutdown_connections 2024-04-25T08:50:56.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.163+0000 7f4dcb122640 1 -- 172.21.15.172:0/73611210 wait complete. 2024-04-25T08:50:56.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.164+0000 7f4dcb122640 1 Processor -- start 2024-04-25T08:50:56.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.164+0000 7f4dcb122640 1 -- start start 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.165+0000 7f4dcb122640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 0x7f4dc409d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.165+0000 7f4dcb122640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4155fe0 0x7f4dc414f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.165+0000 7f4dcb122640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc414fe90 0x7f4dc4140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.165+0000 7f4dcb122640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc406f880 con 0x7f4dc414fe90 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.165+0000 7f4dcb122640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc41563c0 con 0x7f4dc4155fe0 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.165+0000 7f4dcb122640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc406fa00 con 0x7f4dc40adbc0 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.165+0000 7f4dc96bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc414fe90 0x7f4dc4140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.165+0000 7f4dc96bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc414fe90 0x7f4dc4140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39120/0 (socket says 172.21.15.172:39120) 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.165+0000 7f4dc96bf640 1 -- 172.21.15.172:0/1010910204 learned_addr learned my addr 172.21.15.172:0/1010910204 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc8ebe640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 0x7f4dc409d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc3fff640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4155fe0 0x7f4dc414f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc96bf640 1 -- 172.21.15.172:0/1010910204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 msgr2=0x7f4dc409d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc96bf640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 0x7f4dc409d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc96bf640 1 -- 172.21.15.172:0/1010910204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4155fe0 msgr2=0x7f4dc414f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc96bf640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4155fe0 0x7f4dc414f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc96bf640 1 -- 172.21.15.172:0/1010910204 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4141ac0 con 0x7f4dc414fe90 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc96bf640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc414fe90 0x7f4dc4140e60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c3c0 tx=0x7f4db400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc17fa640 1 -- 172.21.15.172:0/1010910204 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4017070 con 0x7f4dc414fe90 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc17fa640 1 -- 172.21.15.172:0/1010910204 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40052d0 con 0x7f4dc414fe90 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dcb122640 1 -- 172.21.15.172:0/1010910204 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc4141da0 con 0x7f4dc414fe90 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dc17fa640 1 -- 172.21.15.172:0/1010910204 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4003830 con 0x7f4dc414fe90 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.166+0000 7f4dcb122640 1 -- 172.21.15.172:0/1010910204 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc4142360 con 0x7f4dc414fe90 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.167+0000 7f4dcb122640 1 -- 172.21.15.172:0/1010910204 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc4073990 con 0x7f4dc414fe90 2024-04-25T08:50:56.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.167+0000 7f4dc17fa640 1 -- 172.21.15.172:0/1010910204 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4db401a070 con 0x7f4dc414fe90 2024-04-25T08:50:56.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.168+0000 7f4dc17fa640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4da406b4d0 0x7f4da406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.168+0000 7f4dc17fa640 1 -- 172.21.15.172:0/1010910204 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4db40895a0 con 0x7f4dc414fe90 2024-04-25T08:50:56.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.168+0000 7f4dc8ebe640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4da406b4d0 0x7f4da406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.160 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.168+0000 7f4dc8ebe640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4da406b4d0 0x7f4da406d990 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc033000 tx=0x7f4dbc009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:56.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.172+0000 7f4dc17fa640 1 -- 172.21.15.172:0/1010910204 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4db4058290 con 0x7f4dc414fe90 2024-04-25T08:50:56.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.340+0000 7f4dcb122640 1 -- 172.21.15.172:0/1010910204 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4dc415b720 con 0x7f4da406b4d0 2024-04-25T08:50:56.336 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.346+0000 7f4dc17fa640 1 -- 172.21.15.172:0/1010910204 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+238103 (secure 0 0 0) 0x7f4dc415b720 con 0x7f4da406b4d0 2024-04-25T08:50:56.338 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:56.340 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:50:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 -- 172.21.15.172:0/1010910204 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4da406b4d0 msgr2=0x7f4da406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4da406b4d0 0x7f4da406d990 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc033000 tx=0x7f4dbc009000 comp rx=0 tx=0).stop 2024-04-25T08:50:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 -- 172.21.15.172:0/1010910204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc414fe90 msgr2=0x7f4dc4140e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc414fe90 0x7f4dc4140e60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c3c0 tx=0x7f4db400c880 comp rx=0 tx=0).stop 2024-04-25T08:50:56.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 -- 172.21.15.172:0/1010910204 shutdown_connections 2024-04-25T08:50:56.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4da406b4d0 0x7f4da406d990 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4dc4155fe0 0x7f4dc414f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc414fe90 0x7f4dc4140e60 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 --2- 172.21.15.172:0/1010910204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4dc40adbc0 0x7f4dc409d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 -- 172.21.15.172:0/1010910204 >> 172.21.15.172:0/1010910204 conn(0x7f4dc4072000 msgr2=0x7f4dc4155300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:56.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 -- 172.21.15.172:0/1010910204 shutdown_connections 2024-04-25T08:50:56.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.349+0000 7f4dcb122640 1 -- 172.21.15.172:0/1010910204 wait complete. 2024-04-25T08:50:56.350 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2024-04-25T08:50:54.616047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":24,"acting":24,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":403296,"kb_used_data":13588,"kb_used_omap":12,"kb_used_meta":389555,"kb_avail":754571424,"statfs":{"total":773094113280,"available":772681138176,"internally_reserved":0,"allocated":13914112,"data_stored":7078489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":398904880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000862"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.055078+0000","last_change":"2024-04-25T08:50:51.055078+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.055078+0000","last_undegraded":"2024-04-25T08:50:51.055078+0000","last_fullsized":"2024-04-25T08:50:51.055078+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058984+0000","last_change":"2024-04-25T08:50:51.058984+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058984+0000","last_undegraded":"2024-04-25T08:50:51.058984+0000","last_fullsized":"2024-04-25T08:50:51.058984+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058911+0000","last_change":"2024-04-25T08:50:51.058911+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058911+0000","last_undegraded":"2024-04-25T08:50:51.058911+0000","last_fullsized":"2024-04-25T08:50:51.058911+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.055326+0000","last_change":"2024-04-25T08:50:51.055326+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.055326+0000","last_undegraded":"2024-04-25T08:50:51.055326+0000","last_fullsized":"2024-04-25T08:50:51.055326+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058203+0000","last_change":"2024-04-25T08:50:51.058203+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058203+0000","last_undegraded":"2024-04-25T08:50:51.058203+0000","last_fullsized":"2024-04-25T08:50:51.058203+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058384+0000","last_change":"2024-04-25T08:50:51.058384+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058384+0000","last_undegraded":"2024-04-25T08:50:51.058384+0000","last_fullsized":"2024-04-25T08:50:51.058384+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.054967+0000","last_change":"2024-04-25T08:50:51.054967+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.054967+0000","last_undegraded":"2024-04-25T08:50:51.054967+0000","last_fullsized":"2024-04-25T08:50:51.054967+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.055227+0000","last_change":"2024-04-25T08:50:51.055227+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.055227+0000","last_undegraded":"2024-04-25T08:50:51.055227+0000","last_fullsized":"2024-04-25T08:50:51.055227+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058168+0000","last_change":"2024-04-25T08:50:51.058168+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058168+0000","last_undegraded":"2024-04-25T08:50:51.058168+0000","last_fullsized":"2024-04-25T08:50:51.058168+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058813+0000","last_change":"2024-04-25T08:50:51.058813+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058813+0000","last_undegraded":"2024-04-25T08:50:51.058813+0000","last_fullsized":"2024-04-25T08:50:51.058813+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:51.042582+0000","last_change":"2024-04-25T08:50:51.042582+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.042582+0000","last_undegraded":"2024-04-25T08:50:51.042582+0000","last_fullsized":"2024-04-25T08:50:51.042582+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:50:52.049564+0000","last_change":"2024-04-25T08:50:52.049564+0000","last_active":"2024-04-25T08:50:52.049564+0000","last_peered":"2024-04-25T08:50:52.049564+0000","last_clean":"2024-04-25T08:50:52.049564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:52.049564+0000","last_undegraded":"2024-04-25T08:50:52.049564+0000","last_fullsized":"2024-04-25T08:50:52.049564+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-04-25T08:50:51.058224+0000","last_change":"2024-04-25T08:50:51.058224+0000","last_active":"2024-04-25T08:50:51.042582+0000","last_peered":"2024-04-25T08:50:51.042582+0000","last_clean":"2024-04-25T08:50:51.042582+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:50:51.058224+0000","last_undegraded":"2024-04-25T08:50:51.058224+0000","last_fullsized":"2024-04-25T08:50:51.058224+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":367,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-25T08:50:51.059291+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:50:51.059291+0000","last_peered":"2024-04-25T08:50:51.059291+0000","last_clean":"2024-04-25T08:50:51.059291+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:50:51.059291+0000","last_undegraded":"2024-04-25T08:50:51.059291+0000","last_fullsized":"2024-04-25T08:50:51.059291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47212,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324628,"statfs":{"total":96636764160,"available":96588419072,"internally_reserved":0,"allocated":2195456,"data_stored":1333020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50780,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321060,"statfs":{"total":96636764160,"available":96584765440,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46636,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325204,"statfs":{"total":96636764160,"available":96589008896,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50784,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54948,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316892,"statfs":{"total":96636764160,"available":96580497408,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50784,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50792,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321048,"statfs":{"total":96636764160,"available":96584753152,"internally_reserved":0,"allocated":1589248,"data_stored":736443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51360,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320480,"statfs":{"total":96636764160,"available":96584171520,"internally_reserved":0,"allocated":2183168,"data_stored":1326811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:50:56.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:50:56.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.499+0000 7f7d2559e640 1 Processor -- start 2024-04-25T08:50:56.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.499+0000 7f7d2559e640 1 -- start start 2024-04-25T08:50:56.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.499+0000 7f7d2559e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d20155fe0 0x7f7d2015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.499+0000 7f7d2559e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7d200721d0 0x7f7d2006abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.499+0000 7f7d2559e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2006de40 con 0x7f7d200adbc0 2024-04-25T08:50:56.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.499+0000 7f7d2559e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d200ad0e0 con 0x7f7d20155fe0 2024-04-25T08:50:56.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.499+0000 7f7d2559e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d200ad3c0 con 0x7f7d200721d0 2024-04-25T08:50:56.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.500+0000 7f7d1effd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d20155fe0 0x7f7d2015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.500+0000 7f7d1effd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7d20155fe0 0x7f7d2015c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39122/0 (socket says 172.21.15.172:39122) 2024-04-25T08:50:56.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.500+0000 7f7d1effd640 1 -- 172.21.15.172:0/2434098289 learned_addr learned my addr 172.21.15.172:0/2434098289 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:56.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.500+0000 7f7d1effd640 1 -- 172.21.15.172:0/2434098289 >> v2:172.21.15.186:3300/0 conn(0x7f7d200721d0 msgr2=0x7f7d2006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:56.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.500+0000 7f7d1effd640 1 --2- 172.21.15.172:0/2434098289 >> v2:172.21.15.186:3300/0 conn(0x7f7d200721d0 0x7f7d2006abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.500+0000 7f7d1effd640 1 -- 172.21.15.172:0/2434098289 >> v1:172.21.15.186:6789/0 conn(0x7f7d200adbc0 legacy=0x7f7d20071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:56.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.500+0000 7f7d1effd640 1 -- 172.21.15.172:0/2434098289 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d200ad6a0 con 0x7f7d20155fe0 2024-04-25T08:50:56.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d1effd640 1 --2- 172.21.15.172:0/2434098289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d20155fe0 0x7f7d2015c9e0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f7d20061950 tx=0x7f7d1002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1b0b0280774bfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:56.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d1dffb640 1 -- 172.21.15.172:0/2434098289 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10036070 con 0x7f7d20155fe0 2024-04-25T08:50:56.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d1dffb640 1 -- 172.21.15.172:0/2434098289 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10031600 con 0x7f7d20155fe0 2024-04-25T08:50:56.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d1dffb640 1 -- 172.21.15.172:0/2434098289 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100319d0 con 0x7f7d20155fe0 2024-04-25T08:50:56.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d2559e640 1 -- 172.21.15.172:0/2434098289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d20155fe0 msgr2=0x7f7d2015c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d2559e640 1 --2- 172.21.15.172:0/2434098289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d20155fe0 0x7f7d2015c9e0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f7d20061950 tx=0x7f7d1002a6f0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d2559e640 1 -- 172.21.15.172:0/2434098289 shutdown_connections 2024-04-25T08:50:56.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d2559e640 1 --2- 172.21.15.172:0/2434098289 >> v2:172.21.15.186:3300/0 conn(0x7f7d200721d0 0x7f7d2006abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d2559e640 1 --2- 172.21.15.172:0/2434098289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d20155fe0 0x7f7d2015c9e0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d2559e640 1 -- 172.21.15.172:0/2434098289 >> 172.21.15.172:0/2434098289 conn(0x7f7d200af670 msgr2=0x7f7d200b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:56.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d2559e640 1 -- 172.21.15.172:0/2434098289 shutdown_connections 2024-04-25T08:50:56.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.501+0000 7f7d2559e640 1 -- 172.21.15.172:0/2434098289 wait complete. 2024-04-25T08:50:56.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.503+0000 7f7d2559e640 1 Processor -- start 2024-04-25T08:50:56.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.503+0000 7f7d2559e640 1 -- start start 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.503+0000 7f7d2559e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d200adbc0 0x7f7d20141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.503+0000 7f7d2559e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d20155fe0 0x7f7d2009c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.503+0000 7f7d2559e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d2009cad0 0x7f7d201e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.503+0000 7f7d2559e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2006fa00 con 0x7f7d2009cad0 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.503+0000 7f7d2559e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2006f880 con 0x7f7d20155fe0 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.503+0000 7f7d2559e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d200ae050 con 0x7f7d200adbc0 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.503+0000 7f7d1f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d2009cad0 0x7f7d201e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.503+0000 7f7d1f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d2009cad0 0x7f7d201e3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39128/0 (socket says 172.21.15.172:39128) 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d1f7fe640 1 -- 172.21.15.172:0/1342149043 learned_addr learned my addr 172.21.15.172:0/1342149043 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d1e7fc640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d20155fe0 0x7f7d2009c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d1effd640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d200adbc0 0x7f7d20141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d1f7fe640 1 -- 172.21.15.172:0/1342149043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d200adbc0 msgr2=0x7f7d20141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d1f7fe640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d200adbc0 0x7f7d20141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d1f7fe640 1 -- 172.21.15.172:0/1342149043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d20155fe0 msgr2=0x7f7d2009c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d1f7fe640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d20155fe0 0x7f7d2009c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d1f7fe640 1 -- 172.21.15.172:0/1342149043 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2009d110 con 0x7f7d2009cad0 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d1effd640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d200adbc0 0x7f7d20141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d1f7fe640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d2009cad0 0x7f7d201e3f70 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800b410 tx=0x7f7d1800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d077fe640 1 -- 172.21.15.172:0/1342149043 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18015020 con 0x7f7d2009cad0 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d077fe640 1 -- 172.21.15.172:0/1342149043 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d18011850 con 0x7f7d2009cad0 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d2559e640 1 -- 172.21.15.172:0/1342149043 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2009d3f0 con 0x7f7d2009cad0 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d077fe640 1 -- 172.21.15.172:0/1342149043 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18011c40 con 0x7f7d2009cad0 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.504+0000 7f7d2559e640 1 -- 172.21.15.172:0/1342149043 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d20142020 con 0x7f7d2009cad0 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.505+0000 7f7d2559e640 1 -- 172.21.15.172:0/1342149043 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d20073990 con 0x7f7d2009cad0 2024-04-25T08:50:56.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.506+0000 7f7d077fe640 1 -- 172.21.15.172:0/1342149043 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7d18018020 con 0x7f7d2009cad0 2024-04-25T08:50:56.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.506+0000 7f7d077fe640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d0c06b4d0 0x7f7d0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.506+0000 7f7d077fe640 1 -- 172.21.15.172:0/1342149043 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7d1808a1c0 con 0x7f7d2009cad0 2024-04-25T08:50:56.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.506+0000 7f7d1effd640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d0c06b4d0 0x7f7d0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.507+0000 7f7d1effd640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d0c06b4d0 0x7f7d0c06d990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7d10033000 tx=0x7f7d10009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:56.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.510+0000 7f7d077fe640 1 -- 172.21.15.172:0/1342149043 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7d1801f020 con 0x7f7d2009cad0 2024-04-25T08:50:56.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.682+0000 7f7d2559e640 1 -- 172.21.15.172:0/1342149043 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d200b1050 con 0x7f7d0c06b4d0 2024-04-25T08:50:56.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.688+0000 7f7d077fe640 1 -- 172.21.15.172:0/1342149043 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252486 (secure 0 0 0) 0x7f7d200b1050 con 0x7f7d0c06b4d0 2024-04-25T08:50:56.681 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:56.682 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:50:56.683 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.690+0000 7f7d2559e640 1 -- 172.21.15.172:0/1342149043 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d0c06b4d0 msgr2=0x7f7d0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d0c06b4d0 0x7f7d0c06d990 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7d10033000 tx=0x7f7d10009000 comp rx=0 tx=0).stop 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 -- 172.21.15.172:0/1342149043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d2009cad0 msgr2=0x7f7d201e3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d2009cad0 0x7f7d201e3f70 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800b410 tx=0x7f7d1800b8d0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 -- 172.21.15.172:0/1342149043 shutdown_connections 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7d0c06b4d0 0x7f7d0c06d990 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d20155fe0 0x7f7d2009c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d2009cad0 0x7f7d201e3f70 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 --2- 172.21.15.172:0/1342149043 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d200adbc0 0x7f7d20141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 -- 172.21.15.172:0/1342149043 >> 172.21.15.172:0/1342149043 conn(0x7f7d200721d0 msgr2=0x7f7d20155250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 -- 172.21.15.172:0/1342149043 shutdown_connections 2024-04-25T08:50:56.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.691+0000 7f7d2559e640 1 -- 172.21.15.172:0/1342149043 wait complete. 2024-04-25T08:50:56.692 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-04-25T08:50:56.616356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403716,"kb_used_data":14024,"kb_used_omap":12,"kb_used_meta":389555,"kb_avail":754571004,"statfs":{"total":773094113280,"available":772680708096,"internally_reserved":0,"allocated":14360576,"data_stored":7290916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":398904880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.563934"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469575+0000","last_change":"2024-04-25T08:50:53.079918+0000","last_active":"2024-04-25T08:50:54.469575+0000","last_peered":"2024-04-25T08:50:54.469575+0000","last_clean":"2024-04-25T08:50:54.469575+0000","last_became_active":"2024-04-25T08:50:53.079605+0000","last_became_peered":"2024-04-25T08:50:53.079605+0000","last_unstale":"2024-04-25T08:50:54.469575+0000","last_undegraded":"2024-04-25T08:50:54.469575+0000","last_fullsized":"2024-04-25T08:50:54.469575+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:10.602356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068377+0000","last_change":"2024-04-25T08:50:53.072183+0000","last_active":"2024-04-25T08:50:54.068377+0000","last_peered":"2024-04-25T08:50:54.068377+0000","last_clean":"2024-04-25T08:50:54.068377+0000","last_became_active":"2024-04-25T08:50:53.071896+0000","last_became_peered":"2024-04-25T08:50:53.071896+0000","last_unstale":"2024-04-25T08:50:54.068377+0000","last_undegraded":"2024-04-25T08:50:54.068377+0000","last_fullsized":"2024-04-25T08:50:54.068377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:18.118317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470487+0000","last_change":"2024-04-25T08:50:53.087301+0000","last_active":"2024-04-25T08:50:54.470487+0000","last_peered":"2024-04-25T08:50:54.470487+0000","last_clean":"2024-04-25T08:50:54.470487+0000","last_became_active":"2024-04-25T08:50:53.085252+0000","last_became_peered":"2024-04-25T08:50:53.085252+0000","last_unstale":"2024-04-25T08:50:54.470487+0000","last_undegraded":"2024-04-25T08:50:54.470487+0000","last_fullsized":"2024-04-25T08:50:54.470487+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:53.509352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068093+0000","last_change":"2024-04-25T08:50:53.074561+0000","last_active":"2024-04-25T08:50:54.068093+0000","last_peered":"2024-04-25T08:50:54.068093+0000","last_clean":"2024-04-25T08:50:54.068093+0000","last_became_active":"2024-04-25T08:50:53.074314+0000","last_became_peered":"2024-04-25T08:50:53.074314+0000","last_unstale":"2024-04-25T08:50:54.068093+0000","last_undegraded":"2024-04-25T08:50:54.068093+0000","last_fullsized":"2024-04-25T08:50:54.068093+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:32.525096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066876+0000","last_change":"2024-04-25T08:50:53.084312+0000","last_active":"2024-04-25T08:50:54.066876+0000","last_peered":"2024-04-25T08:50:54.066876+0000","last_clean":"2024-04-25T08:50:54.066876+0000","last_became_active":"2024-04-25T08:50:53.083920+0000","last_became_peered":"2024-04-25T08:50:53.083920+0000","last_unstale":"2024-04-25T08:50:54.066876+0000","last_undegraded":"2024-04-25T08:50:54.066876+0000","last_fullsized":"2024-04-25T08:50:54.066876+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:00.482961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069261+0000","last_change":"2024-04-25T08:50:53.084844+0000","last_active":"2024-04-25T08:50:54.069261+0000","last_peered":"2024-04-25T08:50:54.069261+0000","last_clean":"2024-04-25T08:50:54.069261+0000","last_became_active":"2024-04-25T08:50:53.084571+0000","last_became_peered":"2024-04-25T08:50:53.084571+0000","last_unstale":"2024-04-25T08:50:54.069261+0000","last_undegraded":"2024-04-25T08:50:54.069261+0000","last_fullsized":"2024-04-25T08:50:54.069261+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:53.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470363+0000","last_change":"2024-04-25T08:50:53.090173+0000","last_active":"2024-04-25T08:50:54.470363+0000","last_peered":"2024-04-25T08:50:54.470363+0000","last_clean":"2024-04-25T08:50:54.470363+0000","last_became_active":"2024-04-25T08:50:53.089652+0000","last_became_peered":"2024-04-25T08:50:53.089652+0000","last_unstale":"2024-04-25T08:50:54.470363+0000","last_undegraded":"2024-04-25T08:50:54.470363+0000","last_fullsized":"2024-04-25T08:50:54.470363+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:36.397565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067667+0000","last_change":"2024-04-25T08:50:53.079125+0000","last_active":"2024-04-25T08:50:54.067667+0000","last_peered":"2024-04-25T08:50:54.067667+0000","last_clean":"2024-04-25T08:50:54.067667+0000","last_became_active":"2024-04-25T08:50:53.078809+0000","last_became_peered":"2024-04-25T08:50:53.078809+0000","last_unstale":"2024-04-25T08:50:54.067667+0000","last_undegraded":"2024-04-25T08:50:54.067667+0000","last_fullsized":"2024-04-25T08:50:54.067667+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:32.337285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069570+0000","last_change":"2024-04-25T08:50:53.077944+0000","last_active":"2024-04-25T08:50:54.069570+0000","last_peered":"2024-04-25T08:50:54.069570+0000","last_clean":"2024-04-25T08:50:54.069570+0000","last_became_active":"2024-04-25T08:50:53.077675+0000","last_became_peered":"2024-04-25T08:50:53.077675+0000","last_unstale":"2024-04-25T08:50:54.069570+0000","last_undegraded":"2024-04-25T08:50:54.069570+0000","last_fullsized":"2024-04-25T08:50:54.069570+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:40.951897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469008+0000","last_change":"2024-04-25T08:50:53.070740+0000","last_active":"2024-04-25T08:50:54.469008+0000","last_peered":"2024-04-25T08:50:54.469008+0000","last_clean":"2024-04-25T08:50:54.469008+0000","last_became_active":"2024-04-25T08:50:53.070363+0000","last_became_peered":"2024-04-25T08:50:53.070363+0000","last_unstale":"2024-04-25T08:50:54.469008+0000","last_undegraded":"2024-04-25T08:50:54.469008+0000","last_fullsized":"2024-04-25T08:50:54.469008+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:30.541711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067990+0000","last_change":"2024-04-25T08:50:53.088059+0000","last_active":"2024-04-25T08:50:54.067990+0000","last_peered":"2024-04-25T08:50:54.067990+0000","last_clean":"2024-04-25T08:50:54.067990+0000","last_became_active":"2024-04-25T08:50:53.087739+0000","last_became_peered":"2024-04-25T08:50:53.087739+0000","last_unstale":"2024-04-25T08:50:54.067990+0000","last_undegraded":"2024-04-25T08:50:54.067990+0000","last_fullsized":"2024-04-25T08:50:54.067990+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:04.060403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469757+0000","last_change":"2024-04-25T08:50:53.085824+0000","last_active":"2024-04-25T08:50:54.469757+0000","last_peered":"2024-04-25T08:50:54.469757+0000","last_clean":"2024-04-25T08:50:54.469757+0000","last_became_active":"2024-04-25T08:50:53.085516+0000","last_became_peered":"2024-04-25T08:50:53.085516+0000","last_unstale":"2024-04-25T08:50:54.469757+0000","last_undegraded":"2024-04-25T08:50:54.469757+0000","last_fullsized":"2024-04-25T08:50:54.469757+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:31.600069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069420+0000","last_change":"2024-04-25T08:50:53.087461+0000","last_active":"2024-04-25T08:50:54.069420+0000","last_peered":"2024-04-25T08:50:54.069420+0000","last_clean":"2024-04-25T08:50:54.069420+0000","last_became_active":"2024-04-25T08:50:53.087120+0000","last_became_peered":"2024-04-25T08:50:53.087120+0000","last_unstale":"2024-04-25T08:50:54.069420+0000","last_undegraded":"2024-04-25T08:50:54.069420+0000","last_fullsized":"2024-04-25T08:50:54.069420+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:44.193413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469194+0000","last_change":"2024-04-25T08:50:53.086642+0000","last_active":"2024-04-25T08:50:54.469194+0000","last_peered":"2024-04-25T08:50:54.469194+0000","last_clean":"2024-04-25T08:50:54.469194+0000","last_became_active":"2024-04-25T08:50:53.086349+0000","last_became_peered":"2024-04-25T08:50:53.086349+0000","last_unstale":"2024-04-25T08:50:54.469194+0000","last_undegraded":"2024-04-25T08:50:54.469194+0000","last_fullsized":"2024-04-25T08:50:54.469194+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:03.596107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468809+0000","last_change":"2024-04-25T08:50:53.078706+0000","last_active":"2024-04-25T08:50:54.468809+0000","last_peered":"2024-04-25T08:50:54.468809+0000","last_clean":"2024-04-25T08:50:54.468809+0000","last_became_active":"2024-04-25T08:50:53.078450+0000","last_became_peered":"2024-04-25T08:50:53.078450+0000","last_unstale":"2024-04-25T08:50:54.468809+0000","last_undegraded":"2024-04-25T08:50:54.468809+0000","last_fullsized":"2024-04-25T08:50:54.468809+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:37.614131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069113+0000","last_change":"2024-04-25T08:50:53.086219+0000","last_active":"2024-04-25T08:50:54.069113+0000","last_peered":"2024-04-25T08:50:54.069113+0000","last_clean":"2024-04-25T08:50:54.069113+0000","last_became_active":"2024-04-25T08:50:53.085360+0000","last_became_peered":"2024-04-25T08:50:53.085360+0000","last_unstale":"2024-04-25T08:50:54.069113+0000","last_undegraded":"2024-04-25T08:50:54.069113+0000","last_fullsized":"2024-04-25T08:50:54.069113+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:38.702830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069655+0000","last_change":"2024-04-25T08:50:53.086008+0000","last_active":"2024-04-25T08:50:54.069655+0000","last_peered":"2024-04-25T08:50:54.069655+0000","last_clean":"2024-04-25T08:50:54.069655+0000","last_became_active":"2024-04-25T08:50:53.085716+0000","last_became_peered":"2024-04-25T08:50:53.085716+0000","last_unstale":"2024-04-25T08:50:54.069655+0000","last_undegraded":"2024-04-25T08:50:54.069655+0000","last_fullsized":"2024-04-25T08:50:54.069655+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:16.590510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067250+0000","last_change":"2024-04-25T08:50:53.084748+0000","last_active":"2024-04-25T08:50:54.067250+0000","last_peered":"2024-04-25T08:50:54.067250+0000","last_clean":"2024-04-25T08:50:54.067250+0000","last_became_active":"2024-04-25T08:50:53.084508+0000","last_became_peered":"2024-04-25T08:50:53.084508+0000","last_unstale":"2024-04-25T08:50:54.067250+0000","last_undegraded":"2024-04-25T08:50:54.067250+0000","last_fullsized":"2024-04-25T08:50:54.067250+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:09.670917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469872+0000","last_change":"2024-04-25T08:50:53.086747+0000","last_active":"2024-04-25T08:50:54.469872+0000","last_peered":"2024-04-25T08:50:54.469872+0000","last_clean":"2024-04-25T08:50:54.469872+0000","last_became_active":"2024-04-25T08:50:53.086345+0000","last_became_peered":"2024-04-25T08:50:53.086345+0000","last_unstale":"2024-04-25T08:50:54.469872+0000","last_undegraded":"2024-04-25T08:50:54.469872+0000","last_fullsized":"2024-04-25T08:50:54.469872+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:18.118317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066973+0000","last_change":"2024-04-25T08:50:53.084017+0000","last_active":"2024-04-25T08:50:54.066973+0000","last_peered":"2024-04-25T08:50:54.066973+0000","last_clean":"2024-04-25T08:50:54.066973+0000","last_became_active":"2024-04-25T08:50:53.083743+0000","last_became_peered":"2024-04-25T08:50:53.083743+0000","last_unstale":"2024-04-25T08:50:54.066973+0000","last_undegraded":"2024-04-25T08:50:54.066973+0000","last_fullsized":"2024-04-25T08:50:54.066973+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:15.343168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068205+0000","last_change":"2024-04-25T08:50:53.080696+0000","last_active":"2024-04-25T08:50:54.068205+0000","last_peered":"2024-04-25T08:50:54.068205+0000","last_clean":"2024-04-25T08:50:54.068205+0000","last_became_active":"2024-04-25T08:50:53.080401+0000","last_became_peered":"2024-04-25T08:50:53.080401+0000","last_unstale":"2024-04-25T08:50:54.068205+0000","last_undegraded":"2024-04-25T08:50:54.068205+0000","last_fullsized":"2024-04-25T08:50:54.068205+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:13.119096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469058+0000","last_change":"2024-04-25T08:50:53.080383+0000","last_active":"2024-04-25T08:50:54.469058+0000","last_peered":"2024-04-25T08:50:54.469058+0000","last_clean":"2024-04-25T08:50:54.469058+0000","last_became_active":"2024-04-25T08:50:53.080126+0000","last_became_peered":"2024-04-25T08:50:53.080126+0000","last_unstale":"2024-04-25T08:50:54.469058+0000","last_undegraded":"2024-04-25T08:50:54.469058+0000","last_fullsized":"2024-04-25T08:50:54.469058+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:44.633235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067733+0000","last_change":"2024-04-25T08:50:53.081657+0000","last_active":"2024-04-25T08:50:54.067733+0000","last_peered":"2024-04-25T08:50:54.067733+0000","last_clean":"2024-04-25T08:50:54.067733+0000","last_became_active":"2024-04-25T08:50:53.081333+0000","last_became_peered":"2024-04-25T08:50:53.081333+0000","last_unstale":"2024-04-25T08:50:54.067733+0000","last_undegraded":"2024-04-25T08:50:54.067733+0000","last_fullsized":"2024-04-25T08:50:54.067733+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:28.341343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069145+0000","last_change":"2024-04-25T08:50:53.078522+0000","last_active":"2024-04-25T08:50:54.069145+0000","last_peered":"2024-04-25T08:50:54.069145+0000","last_clean":"2024-04-25T08:50:54.069145+0000","last_became_active":"2024-04-25T08:50:53.078262+0000","last_became_peered":"2024-04-25T08:50:53.078262+0000","last_unstale":"2024-04-25T08:50:54.069145+0000","last_undegraded":"2024-04-25T08:50:54.069145+0000","last_fullsized":"2024-04-25T08:50:54.069145+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:42.645564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470410+0000","last_change":"2024-04-25T08:50:53.082712+0000","last_active":"2024-04-25T08:50:54.470410+0000","last_peered":"2024-04-25T08:50:54.470410+0000","last_clean":"2024-04-25T08:50:54.470410+0000","last_became_active":"2024-04-25T08:50:53.082440+0000","last_became_peered":"2024-04-25T08:50:53.082440+0000","last_unstale":"2024-04-25T08:50:54.470410+0000","last_undegraded":"2024-04-25T08:50:54.470410+0000","last_fullsized":"2024-04-25T08:50:54.470410+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:36.880421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470310+0000","last_change":"2024-04-25T08:50:53.088970+0000","last_active":"2024-04-25T08:50:54.470310+0000","last_peered":"2024-04-25T08:50:54.470310+0000","last_clean":"2024-04-25T08:50:54.470310+0000","last_became_active":"2024-04-25T08:50:53.088691+0000","last_became_peered":"2024-04-25T08:50:53.088691+0000","last_unstale":"2024-04-25T08:50:54.470310+0000","last_undegraded":"2024-04-25T08:50:54.470310+0000","last_fullsized":"2024-04-25T08:50:54.470310+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470005+0000","last_change":"2024-04-25T08:50:53.084874+0000","last_active":"2024-04-25T08:50:54.470005+0000","last_peered":"2024-04-25T08:50:54.470005+0000","last_clean":"2024-04-25T08:50:54.470005+0000","last_became_active":"2024-04-25T08:50:53.084611+0000","last_became_peered":"2024-04-25T08:50:53.084611+0000","last_unstale":"2024-04-25T08:50:54.470005+0000","last_undegraded":"2024-04-25T08:50:54.470005+0000","last_fullsized":"2024-04-25T08:50:54.470005+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:53.406838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469585+0000","last_change":"2024-04-25T08:50:53.071597+0000","last_active":"2024-04-25T08:50:54.469585+0000","last_peered":"2024-04-25T08:50:54.469585+0000","last_clean":"2024-04-25T08:50:54.469585+0000","last_became_active":"2024-04-25T08:50:53.070933+0000","last_became_peered":"2024-04-25T08:50:53.070933+0000","last_unstale":"2024-04-25T08:50:54.469585+0000","last_undegraded":"2024-04-25T08:50:54.469585+0000","last_fullsized":"2024-04-25T08:50:54.469585+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:16.779331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470052+0000","last_change":"2024-04-25T08:50:53.084317+0000","last_active":"2024-04-25T08:50:54.470052+0000","last_peered":"2024-04-25T08:50:54.470052+0000","last_clean":"2024-04-25T08:50:54.470052+0000","last_became_active":"2024-04-25T08:50:53.084030+0000","last_became_peered":"2024-04-25T08:50:53.084030+0000","last_unstale":"2024-04-25T08:50:54.470052+0000","last_undegraded":"2024-04-25T08:50:54.470052+0000","last_fullsized":"2024-04-25T08:50:54.470052+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:10.766542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470372+0000","last_change":"2024-04-25T08:50:53.084302+0000","last_active":"2024-04-25T08:50:54.470372+0000","last_peered":"2024-04-25T08:50:54.470372+0000","last_clean":"2024-04-25T08:50:54.470372+0000","last_became_active":"2024-04-25T08:50:53.083105+0000","last_became_peered":"2024-04-25T08:50:53.083105+0000","last_unstale":"2024-04-25T08:50:54.470372+0000","last_undegraded":"2024-04-25T08:50:54.470372+0000","last_fullsized":"2024-04-25T08:50:54.470372+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:46.377293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068018+0000","last_change":"2024-04-25T08:50:53.075476+0000","last_active":"2024-04-25T08:50:54.068018+0000","last_peered":"2024-04-25T08:50:54.068018+0000","last_clean":"2024-04-25T08:50:54.068018+0000","last_became_active":"2024-04-25T08:50:53.075196+0000","last_became_peered":"2024-04-25T08:50:53.075196+0000","last_unstale":"2024-04-25T08:50:54.068018+0000","last_undegraded":"2024-04-25T08:50:54.068018+0000","last_fullsized":"2024-04-25T08:50:54.068018+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:10.766542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468862+0000","last_change":"2024-04-25T08:50:53.079083+0000","last_active":"2024-04-25T08:50:54.468862+0000","last_peered":"2024-04-25T08:50:54.468862+0000","last_clean":"2024-04-25T08:50:54.468862+0000","last_became_active":"2024-04-25T08:50:53.078821+0000","last_became_peered":"2024-04-25T08:50:53.078821+0000","last_unstale":"2024-04-25T08:50:54.468862+0000","last_undegraded":"2024-04-25T08:50:54.468862+0000","last_fullsized":"2024-04-25T08:50:54.468862+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:52.512655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067814+0000","last_change":"2024-04-25T08:50:53.079742+0000","last_active":"2024-04-25T08:50:54.067814+0000","last_peered":"2024-04-25T08:50:54.067814+0000","last_clean":"2024-04-25T08:50:54.067814+0000","last_became_active":"2024-04-25T08:50:53.079456+0000","last_became_peered":"2024-04-25T08:50:53.079456+0000","last_unstale":"2024-04-25T08:50:54.067814+0000","last_undegraded":"2024-04-25T08:50:54.067814+0000","last_fullsized":"2024-04-25T08:50:54.067814+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:34.414227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"130'4","reported_seq":18,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470374+0000","last_change":"2024-04-25T08:50:52.073377+0000","last_active":"2024-04-25T08:50:54.470374+0000","last_peered":"2024-04-25T08:50:54.470374+0000","last_clean":"2024-04-25T08:50:54.470374+0000","last_became_active":"2024-04-25T08:50:52.073069+0000","last_became_peered":"2024-04-25T08:50:52.073069+0000","last_unstale":"2024-04-25T08:50:54.470374+0000","last_undegraded":"2024-04-25T08:50:54.470374+0000","last_fullsized":"2024-04-25T08:50:54.470374+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:14.817429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468866+0000","last_change":"2024-04-25T08:50:53.080474+0000","last_active":"2024-04-25T08:50:54.468866+0000","last_peered":"2024-04-25T08:50:54.468866+0000","last_clean":"2024-04-25T08:50:54.468866+0000","last_became_active":"2024-04-25T08:50:53.080207+0000","last_became_peered":"2024-04-25T08:50:53.080207+0000","last_unstale":"2024-04-25T08:50:54.468866+0000","last_undegraded":"2024-04-25T08:50:54.468866+0000","last_fullsized":"2024-04-25T08:50:54.468866+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:42.606841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067371+0000","last_change":"2024-04-25T08:50:52.064916+0000","last_active":"2024-04-25T08:50:54.067371+0000","last_peered":"2024-04-25T08:50:54.067371+0000","last_clean":"2024-04-25T08:50:54.067371+0000","last_became_active":"2024-04-25T08:50:52.064537+0000","last_became_peered":"2024-04-25T08:50:52.064537+0000","last_unstale":"2024-04-25T08:50:54.067371+0000","last_undegraded":"2024-04-25T08:50:54.067371+0000","last_fullsized":"2024-04-25T08:50:54.067371+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:54.410546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068148+0000","last_change":"2024-04-25T08:50:53.076011+0000","last_active":"2024-04-25T08:50:54.068148+0000","last_peered":"2024-04-25T08:50:54.068148+0000","last_clean":"2024-04-25T08:50:54.068148+0000","last_became_active":"2024-04-25T08:50:53.075150+0000","last_became_peered":"2024-04-25T08:50:53.075150+0000","last_unstale":"2024-04-25T08:50:54.068148+0000","last_undegraded":"2024-04-25T08:50:54.068148+0000","last_fullsized":"2024-04-25T08:50:54.068148+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:36.880693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469941+0000","last_change":"2024-04-25T08:50:52.069970+0000","last_active":"2024-04-25T08:50:54.469941+0000","last_peered":"2024-04-25T08:50:54.469941+0000","last_clean":"2024-04-25T08:50:54.469941+0000","last_became_active":"2024-04-25T08:50:52.069701+0000","last_became_peered":"2024-04-25T08:50:52.069701+0000","last_unstale":"2024-04-25T08:50:54.469941+0000","last_undegraded":"2024-04-25T08:50:54.469941+0000","last_fullsized":"2024-04-25T08:50:54.469941+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:01.825346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469838+0000","last_change":"2024-04-25T08:50:53.081000+0000","last_active":"2024-04-25T08:50:54.469838+0000","last_peered":"2024-04-25T08:50:54.469838+0000","last_clean":"2024-04-25T08:50:54.469838+0000","last_became_active":"2024-04-25T08:50:53.080742+0000","last_became_peered":"2024-04-25T08:50:53.080742+0000","last_unstale":"2024-04-25T08:50:54.469838+0000","last_undegraded":"2024-04-25T08:50:54.469838+0000","last_fullsized":"2024-04-25T08:50:54.469838+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:00.535216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469878+0000","last_change":"2024-04-25T08:50:52.070258+0000","last_active":"2024-04-25T08:50:54.469878+0000","last_peered":"2024-04-25T08:50:54.469878+0000","last_clean":"2024-04-25T08:50:54.469878+0000","last_became_active":"2024-04-25T08:50:52.069955+0000","last_became_peered":"2024-04-25T08:50:52.069955+0000","last_unstale":"2024-04-25T08:50:54.469878+0000","last_undegraded":"2024-04-25T08:50:54.469878+0000","last_fullsized":"2024-04-25T08:50:54.469878+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:40.708876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069116+0000","last_change":"2024-04-25T08:50:53.081636+0000","last_active":"2024-04-25T08:50:54.069116+0000","last_peered":"2024-04-25T08:50:54.069116+0000","last_clean":"2024-04-25T08:50:54.069116+0000","last_became_active":"2024-04-25T08:50:53.081335+0000","last_became_peered":"2024-04-25T08:50:53.081335+0000","last_unstale":"2024-04-25T08:50:54.069116+0000","last_undegraded":"2024-04-25T08:50:54.069116+0000","last_fullsized":"2024-04-25T08:50:54.069116+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:13.985914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068868+0000","last_change":"2024-04-25T08:50:52.069178+0000","last_active":"2024-04-25T08:50:54.068868+0000","last_peered":"2024-04-25T08:50:54.068868+0000","last_clean":"2024-04-25T08:50:54.068868+0000","last_became_active":"2024-04-25T08:50:52.068838+0000","last_became_peered":"2024-04-25T08:50:52.068838+0000","last_unstale":"2024-04-25T08:50:54.068868+0000","last_undegraded":"2024-04-25T08:50:54.068868+0000","last_fullsized":"2024-04-25T08:50:54.068868+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:48.445469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069301+0000","last_change":"2024-04-25T08:50:53.070680+0000","last_active":"2024-04-25T08:50:54.069301+0000","last_peered":"2024-04-25T08:50:54.069301+0000","last_clean":"2024-04-25T08:50:54.069301+0000","last_became_active":"2024-04-25T08:50:53.070359+0000","last_became_peered":"2024-04-25T08:50:53.070359+0000","last_unstale":"2024-04-25T08:50:54.069301+0000","last_undegraded":"2024-04-25T08:50:54.069301+0000","last_fullsized":"2024-04-25T08:50:54.069301+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066726+0000","last_change":"2024-04-25T08:50:52.063253+0000","last_active":"2024-04-25T08:50:54.066726+0000","last_peered":"2024-04-25T08:50:54.066726+0000","last_clean":"2024-04-25T08:50:54.066726+0000","last_became_active":"2024-04-25T08:50:52.062924+0000","last_became_peered":"2024-04-25T08:50:52.062924+0000","last_unstale":"2024-04-25T08:50:54.066726+0000","last_undegraded":"2024-04-25T08:50:54.066726+0000","last_fullsized":"2024-04-25T08:50:54.066726+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:33.545213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067275+0000","last_change":"2024-04-25T08:50:53.095475+0000","last_active":"2024-04-25T08:50:54.067275+0000","last_peered":"2024-04-25T08:50:54.067275+0000","last_clean":"2024-04-25T08:50:54.067275+0000","last_became_active":"2024-04-25T08:50:53.095194+0000","last_became_peered":"2024-04-25T08:50:53.095194+0000","last_unstale":"2024-04-25T08:50:54.067275+0000","last_undegraded":"2024-04-25T08:50:54.067275+0000","last_fullsized":"2024-04-25T08:50:54.067275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:25.919760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069116+0000","last_change":"2024-04-25T08:50:52.059513+0000","last_active":"2024-04-25T08:50:54.069116+0000","last_peered":"2024-04-25T08:50:54.069116+0000","last_clean":"2024-04-25T08:50:54.069116+0000","last_became_active":"2024-04-25T08:50:52.059249+0000","last_became_peered":"2024-04-25T08:50:52.059249+0000","last_unstale":"2024-04-25T08:50:54.069116+0000","last_undegraded":"2024-04-25T08:50:54.069116+0000","last_fullsized":"2024-04-25T08:50:54.069116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:41.029120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470128+0000","last_change":"2024-04-25T08:50:53.080901+0000","last_active":"2024-04-25T08:50:54.470128+0000","last_peered":"2024-04-25T08:50:54.470128+0000","last_clean":"2024-04-25T08:50:54.470128+0000","last_became_active":"2024-04-25T08:50:53.080631+0000","last_became_peered":"2024-04-25T08:50:53.080631+0000","last_unstale":"2024-04-25T08:50:54.470128+0000","last_undegraded":"2024-04-25T08:50:54.470128+0000","last_fullsized":"2024-04-25T08:50:54.470128+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:00.482961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469723+0000","last_change":"2024-04-25T08:50:52.068577+0000","last_active":"2024-04-25T08:50:54.469723+0000","last_peered":"2024-04-25T08:50:54.469723+0000","last_clean":"2024-04-25T08:50:54.469723+0000","last_became_active":"2024-04-25T08:50:52.068271+0000","last_became_peered":"2024-04-25T08:50:52.068271+0000","last_unstale":"2024-04-25T08:50:54.469723+0000","last_undegraded":"2024-04-25T08:50:54.469723+0000","last_fullsized":"2024-04-25T08:50:54.469723+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:23.439699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468801+0000","last_change":"2024-04-25T08:50:53.084115+0000","last_active":"2024-04-25T08:50:54.468801+0000","last_peered":"2024-04-25T08:50:54.468801+0000","last_clean":"2024-04-25T08:50:54.468801+0000","last_became_active":"2024-04-25T08:50:53.083827+0000","last_became_peered":"2024-04-25T08:50:53.083827+0000","last_unstale":"2024-04-25T08:50:54.468801+0000","last_undegraded":"2024-04-25T08:50:54.468801+0000","last_fullsized":"2024-04-25T08:50:54.468801+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:45.145846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068695+0000","last_change":"2024-04-25T08:50:52.067710+0000","last_active":"2024-04-25T08:50:54.068695+0000","last_peered":"2024-04-25T08:50:54.068695+0000","last_clean":"2024-04-25T08:50:54.068695+0000","last_became_active":"2024-04-25T08:50:52.067279+0000","last_became_peered":"2024-04-25T08:50:52.067279+0000","last_unstale":"2024-04-25T08:50:54.068695+0000","last_undegraded":"2024-04-25T08:50:54.068695+0000","last_fullsized":"2024-04-25T08:50:54.068695+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:35.638311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069275+0000","last_change":"2024-04-25T08:50:53.075292+0000","last_active":"2024-04-25T08:50:54.069275+0000","last_peered":"2024-04-25T08:50:54.069275+0000","last_clean":"2024-04-25T08:50:54.069275+0000","last_became_active":"2024-04-25T08:50:53.075034+0000","last_became_peered":"2024-04-25T08:50:53.075034+0000","last_unstale":"2024-04-25T08:50:54.069275+0000","last_undegraded":"2024-04-25T08:50:54.069275+0000","last_fullsized":"2024-04-25T08:50:54.069275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:41.715857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469432+0000","last_change":"2024-04-25T08:50:52.068258+0000","last_active":"2024-04-25T08:50:54.469432+0000","last_peered":"2024-04-25T08:50:54.469432+0000","last_clean":"2024-04-25T08:50:54.469432+0000","last_became_active":"2024-04-25T08:50:52.067978+0000","last_became_peered":"2024-04-25T08:50:52.067978+0000","last_unstale":"2024-04-25T08:50:54.469432+0000","last_undegraded":"2024-04-25T08:50:54.469432+0000","last_fullsized":"2024-04-25T08:50:54.469432+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:18.966728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470325+0000","last_change":"2024-04-25T08:50:53.084303+0000","last_active":"2024-04-25T08:50:54.470325+0000","last_peered":"2024-04-25T08:50:54.470325+0000","last_clean":"2024-04-25T08:50:54.470325+0000","last_became_active":"2024-04-25T08:50:53.082570+0000","last_became_peered":"2024-04-25T08:50:53.082570+0000","last_unstale":"2024-04-25T08:50:54.470325+0000","last_undegraded":"2024-04-25T08:50:54.470325+0000","last_fullsized":"2024-04-25T08:50:54.470325+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:18.175894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"130'3","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470070+0000","last_change":"2024-04-25T08:50:52.072224+0000","last_active":"2024-04-25T08:50:54.470070+0000","last_peered":"2024-04-25T08:50:54.470070+0000","last_clean":"2024-04-25T08:50:54.470070+0000","last_became_active":"2024-04-25T08:50:52.071933+0000","last_became_peered":"2024-04-25T08:50:52.071933+0000","last_unstale":"2024-04-25T08:50:54.470070+0000","last_undegraded":"2024-04-25T08:50:54.470070+0000","last_fullsized":"2024-04-25T08:50:54.470070+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:39.944916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470212+0000","last_change":"2024-04-25T08:50:53.086992+0000","last_active":"2024-04-25T08:50:54.470212+0000","last_peered":"2024-04-25T08:50:54.470212+0000","last_clean":"2024-04-25T08:50:54.470212+0000","last_became_active":"2024-04-25T08:50:53.086578+0000","last_became_peered":"2024-04-25T08:50:53.086578+0000","last_unstale":"2024-04-25T08:50:54.470212+0000","last_undegraded":"2024-04-25T08:50:54.470212+0000","last_fullsized":"2024-04-25T08:50:54.470212+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:13.985914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"130'6","reported_seq":20,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469997+0000","last_change":"2024-04-25T08:50:52.070677+0000","last_active":"2024-04-25T08:50:54.469997+0000","last_peered":"2024-04-25T08:50:54.469997+0000","last_clean":"2024-04-25T08:50:54.469997+0000","last_became_active":"2024-04-25T08:50:52.070263+0000","last_became_peered":"2024-04-25T08:50:52.070263+0000","last_unstale":"2024-04-25T08:50:54.469997+0000","last_undegraded":"2024-04-25T08:50:54.469997+0000","last_fullsized":"2024-04-25T08:50:54.469997+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:38.050519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469453+0000","last_change":"2024-04-25T08:50:53.073091+0000","last_active":"2024-04-25T08:50:54.469453+0000","last_peered":"2024-04-25T08:50:54.469453+0000","last_clean":"2024-04-25T08:50:54.469453+0000","last_became_active":"2024-04-25T08:50:53.072792+0000","last_became_peered":"2024-04-25T08:50:53.072792+0000","last_unstale":"2024-04-25T08:50:54.469453+0000","last_undegraded":"2024-04-25T08:50:54.469453+0000","last_fullsized":"2024-04-25T08:50:54.469453+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:41.016023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469786+0000","last_change":"2024-04-25T08:50:52.071574+0000","last_active":"2024-04-25T08:50:54.469786+0000","last_peered":"2024-04-25T08:50:54.469786+0000","last_clean":"2024-04-25T08:50:54.469786+0000","last_became_active":"2024-04-25T08:50:52.071219+0000","last_became_peered":"2024-04-25T08:50:52.071219+0000","last_unstale":"2024-04-25T08:50:54.469786+0000","last_undegraded":"2024-04-25T08:50:54.469786+0000","last_fullsized":"2024-04-25T08:50:54.469786+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:48.640118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470402+0000","last_change":"2024-04-25T08:50:53.083074+0000","last_active":"2024-04-25T08:50:54.470402+0000","last_peered":"2024-04-25T08:50:54.470402+0000","last_clean":"2024-04-25T08:50:54.470402+0000","last_became_active":"2024-04-25T08:50:53.082667+0000","last_became_peered":"2024-04-25T08:50:53.082667+0000","last_unstale":"2024-04-25T08:50:54.470402+0000","last_undegraded":"2024-04-25T08:50:54.470402+0000","last_fullsized":"2024-04-25T08:50:54.470402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:15.343168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469982+0000","last_change":"2024-04-25T08:50:52.067674+0000","last_active":"2024-04-25T08:50:54.469982+0000","last_peered":"2024-04-25T08:50:54.469982+0000","last_clean":"2024-04-25T08:50:54.469982+0000","last_became_active":"2024-04-25T08:50:52.067413+0000","last_became_peered":"2024-04-25T08:50:52.067413+0000","last_unstale":"2024-04-25T08:50:54.469982+0000","last_undegraded":"2024-04-25T08:50:54.469982+0000","last_fullsized":"2024-04-25T08:50:54.469982+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:53.520138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066953+0000","last_change":"2024-04-25T08:50:53.083385+0000","last_active":"2024-04-25T08:50:54.066953+0000","last_peered":"2024-04-25T08:50:54.066953+0000","last_clean":"2024-04-25T08:50:54.066953+0000","last_became_active":"2024-04-25T08:50:53.083042+0000","last_became_peered":"2024-04-25T08:50:53.083042+0000","last_unstale":"2024-04-25T08:50:54.066953+0000","last_undegraded":"2024-04-25T08:50:54.066953+0000","last_fullsized":"2024-04-25T08:50:54.066953+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:36.397565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"130'8","reported_seq":22,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069343+0000","last_change":"2024-04-25T08:50:52.073052+0000","last_active":"2024-04-25T08:50:54.069343+0000","last_peered":"2024-04-25T08:50:54.069343+0000","last_clean":"2024-04-25T08:50:54.069343+0000","last_became_active":"2024-04-25T08:50:52.072717+0000","last_became_peered":"2024-04-25T08:50:52.072717+0000","last_unstale":"2024-04-25T08:50:54.069343+0000","last_undegraded":"2024-04-25T08:50:54.069343+0000","last_fullsized":"2024-04-25T08:50:54.069343+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:59.581933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469585+0000","last_change":"2024-04-25T08:50:53.085726+0000","last_active":"2024-04-25T08:50:54.469585+0000","last_peered":"2024-04-25T08:50:54.469585+0000","last_clean":"2024-04-25T08:50:54.469585+0000","last_became_active":"2024-04-25T08:50:53.085483+0000","last_became_peered":"2024-04-25T08:50:53.085483+0000","last_unstale":"2024-04-25T08:50:54.469585+0000","last_undegraded":"2024-04-25T08:50:54.469585+0000","last_fullsized":"2024-04-25T08:50:54.469585+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:32.337285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068757+0000","last_change":"2024-04-25T08:50:52.068588+0000","last_active":"2024-04-25T08:50:54.068757+0000","last_peered":"2024-04-25T08:50:54.068757+0000","last_clean":"2024-04-25T08:50:54.068757+0000","last_became_active":"2024-04-25T08:50:52.067825+0000","last_became_peered":"2024-04-25T08:50:52.067825+0000","last_unstale":"2024-04-25T08:50:54.068757+0000","last_undegraded":"2024-04-25T08:50:54.068757+0000","last_fullsized":"2024-04-25T08:50:54.068757+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.186431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470517+0000","last_change":"2024-04-25T08:50:53.086450+0000","last_active":"2024-04-25T08:50:54.470517+0000","last_peered":"2024-04-25T08:50:54.470517+0000","last_clean":"2024-04-25T08:50:54.470517+0000","last_became_active":"2024-04-25T08:50:53.086075+0000","last_became_peered":"2024-04-25T08:50:53.086075+0000","last_unstale":"2024-04-25T08:50:54.470517+0000","last_undegraded":"2024-04-25T08:50:54.470517+0000","last_fullsized":"2024-04-25T08:50:54.470517+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:41.088924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470374+0000","last_change":"2024-04-25T08:50:52.071957+0000","last_active":"2024-04-25T08:50:54.470374+0000","last_peered":"2024-04-25T08:50:54.470374+0000","last_clean":"2024-04-25T08:50:54.470374+0000","last_became_active":"2024-04-25T08:50:52.071671+0000","last_became_peered":"2024-04-25T08:50:52.071671+0000","last_unstale":"2024-04-25T08:50:54.470374+0000","last_undegraded":"2024-04-25T08:50:54.470374+0000","last_fullsized":"2024-04-25T08:50:54.470374+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:55.349207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470836+0000","last_change":"2024-04-25T08:50:53.084689+0000","last_active":"2024-04-25T08:50:54.470836+0000","last_peered":"2024-04-25T08:50:54.470836+0000","last_clean":"2024-04-25T08:50:54.470836+0000","last_became_active":"2024-04-25T08:50:53.084401+0000","last_became_peered":"2024-04-25T08:50:53.084401+0000","last_unstale":"2024-04-25T08:50:54.470836+0000","last_undegraded":"2024-04-25T08:50:54.470836+0000","last_fullsized":"2024-04-25T08:50:54.470836+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:02.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069477+0000","last_change":"2024-04-25T08:50:52.066249+0000","last_active":"2024-04-25T08:50:54.069477+0000","last_peered":"2024-04-25T08:50:54.069477+0000","last_clean":"2024-04-25T08:50:54.069477+0000","last_became_active":"2024-04-25T08:50:52.066030+0000","last_became_peered":"2024-04-25T08:50:52.066030+0000","last_unstale":"2024-04-25T08:50:54.069477+0000","last_undegraded":"2024-04-25T08:50:54.069477+0000","last_fullsized":"2024-04-25T08:50:54.069477+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:28.150151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469149+0000","last_change":"2024-04-25T08:50:53.087224+0000","last_active":"2024-04-25T08:50:54.469149+0000","last_peered":"2024-04-25T08:50:54.469149+0000","last_clean":"2024-04-25T08:50:54.469149+0000","last_became_active":"2024-04-25T08:50:53.086843+0000","last_became_peered":"2024-04-25T08:50:53.086843+0000","last_unstale":"2024-04-25T08:50:54.469149+0000","last_undegraded":"2024-04-25T08:50:54.469149+0000","last_fullsized":"2024-04-25T08:50:54.469149+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:59.157977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067170+0000","last_change":"2024-04-25T08:50:52.070019+0000","last_active":"2024-04-25T08:50:54.067170+0000","last_peered":"2024-04-25T08:50:54.067170+0000","last_clean":"2024-04-25T08:50:54.067170+0000","last_became_active":"2024-04-25T08:50:52.069758+0000","last_became_peered":"2024-04-25T08:50:52.069758+0000","last_unstale":"2024-04-25T08:50:54.067170+0000","last_undegraded":"2024-04-25T08:50:54.067170+0000","last_fullsized":"2024-04-25T08:50:54.067170+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:37.347823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067096+0000","last_change":"2024-04-25T08:50:53.082565+0000","last_active":"2024-04-25T08:50:54.067096+0000","last_peered":"2024-04-25T08:50:54.067096+0000","last_clean":"2024-04-25T08:50:54.067096+0000","last_became_active":"2024-04-25T08:50:53.082119+0000","last_became_peered":"2024-04-25T08:50:53.082119+0000","last_unstale":"2024-04-25T08:50:54.067096+0000","last_undegraded":"2024-04-25T08:50:54.067096+0000","last_fullsized":"2024-04-25T08:50:54.067096+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:41.088924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068991+0000","last_change":"2024-04-25T08:50:52.070483+0000","last_active":"2024-04-25T08:50:54.068991+0000","last_peered":"2024-04-25T08:50:54.068991+0000","last_clean":"2024-04-25T08:50:54.068991+0000","last_became_active":"2024-04-25T08:50:52.070167+0000","last_became_peered":"2024-04-25T08:50:52.070167+0000","last_unstale":"2024-04-25T08:50:54.068991+0000","last_undegraded":"2024-04-25T08:50:54.068991+0000","last_fullsized":"2024-04-25T08:50:54.068991+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.004266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469459+0000","last_change":"2024-04-25T08:50:53.078082+0000","last_active":"2024-04-25T08:50:54.469459+0000","last_peered":"2024-04-25T08:50:54.469459+0000","last_clean":"2024-04-25T08:50:54.469459+0000","last_became_active":"2024-04-25T08:50:53.077808+0000","last_became_peered":"2024-04-25T08:50:53.077808+0000","last_unstale":"2024-04-25T08:50:54.469459+0000","last_undegraded":"2024-04-25T08:50:54.469459+0000","last_fullsized":"2024-04-25T08:50:54.469459+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:07.585873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469285+0000","last_change":"2024-04-25T08:50:52.066994+0000","last_active":"2024-04-25T08:50:54.469285+0000","last_peered":"2024-04-25T08:50:54.469285+0000","last_clean":"2024-04-25T08:50:54.469285+0000","last_became_active":"2024-04-25T08:50:52.066721+0000","last_became_peered":"2024-04-25T08:50:52.066721+0000","last_unstale":"2024-04-25T08:50:54.469285+0000","last_undegraded":"2024-04-25T08:50:54.469285+0000","last_fullsized":"2024-04-25T08:50:54.469285+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:57.026177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067328+0000","last_change":"2024-04-25T08:50:53.083181+0000","last_active":"2024-04-25T08:50:54.067328+0000","last_peered":"2024-04-25T08:50:54.067328+0000","last_clean":"2024-04-25T08:50:54.067328+0000","last_became_active":"2024-04-25T08:50:53.082822+0000","last_became_peered":"2024-04-25T08:50:53.082822+0000","last_unstale":"2024-04-25T08:50:54.067328+0000","last_undegraded":"2024-04-25T08:50:54.067328+0000","last_fullsized":"2024-04-25T08:50:54.067328+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:03.983664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470604+0000","last_change":"2024-04-25T08:50:52.073836+0000","last_active":"2024-04-25T08:50:54.470604+0000","last_peered":"2024-04-25T08:50:54.470604+0000","last_clean":"2024-04-25T08:50:54.470604+0000","last_became_active":"2024-04-25T08:50:52.073524+0000","last_became_peered":"2024-04-25T08:50:52.073524+0000","last_unstale":"2024-04-25T08:50:54.470604+0000","last_undegraded":"2024-04-25T08:50:54.470604+0000","last_fullsized":"2024-04-25T08:50:54.470604+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:15.583529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068582+0000","last_change":"2024-04-25T08:50:53.083213+0000","last_active":"2024-04-25T08:50:54.068582+0000","last_peered":"2024-04-25T08:50:54.068582+0000","last_clean":"2024-04-25T08:50:54.068582+0000","last_became_active":"2024-04-25T08:50:53.082937+0000","last_became_peered":"2024-04-25T08:50:53.082937+0000","last_unstale":"2024-04-25T08:50:54.068582+0000","last_undegraded":"2024-04-25T08:50:54.068582+0000","last_fullsized":"2024-04-25T08:50:54.068582+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:17.680586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069440+0000","last_change":"2024-04-25T08:50:52.069176+0000","last_active":"2024-04-25T08:50:54.069440+0000","last_peered":"2024-04-25T08:50:54.069440+0000","last_clean":"2024-04-25T08:50:54.069440+0000","last_became_active":"2024-04-25T08:50:52.068893+0000","last_became_peered":"2024-04-25T08:50:52.068893+0000","last_unstale":"2024-04-25T08:50:54.069440+0000","last_undegraded":"2024-04-25T08:50:54.069440+0000","last_fullsized":"2024-04-25T08:50:54.069440+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:00.101295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067125+0000","last_change":"2024-04-25T08:50:53.084130+0000","last_active":"2024-04-25T08:50:54.067125+0000","last_peered":"2024-04-25T08:50:54.067125+0000","last_clean":"2024-04-25T08:50:54.067125+0000","last_became_active":"2024-04-25T08:50:53.083736+0000","last_became_peered":"2024-04-25T08:50:53.083736+0000","last_unstale":"2024-04-25T08:50:54.067125+0000","last_undegraded":"2024-04-25T08:50:54.067125+0000","last_fullsized":"2024-04-25T08:50:54.067125+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:02.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469626+0000","last_change":"2024-04-25T08:50:52.072213+0000","last_active":"2024-04-25T08:50:54.469626+0000","last_peered":"2024-04-25T08:50:54.469626+0000","last_clean":"2024-04-25T08:50:54.469626+0000","last_became_active":"2024-04-25T08:50:52.071944+0000","last_became_peered":"2024-04-25T08:50:52.071944+0000","last_unstale":"2024-04-25T08:50:54.469626+0000","last_undegraded":"2024-04-25T08:50:54.469626+0000","last_fullsized":"2024-04-25T08:50:54.469626+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:53.320007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469925+0000","last_change":"2024-04-25T08:50:53.085506+0000","last_active":"2024-04-25T08:50:54.469925+0000","last_peered":"2024-04-25T08:50:54.469925+0000","last_clean":"2024-04-25T08:50:54.469925+0000","last_became_active":"2024-04-25T08:50:53.085228+0000","last_became_peered":"2024-04-25T08:50:53.085228+0000","last_unstale":"2024-04-25T08:50:54.469925+0000","last_undegraded":"2024-04-25T08:50:54.469925+0000","last_fullsized":"2024-04-25T08:50:54.469925+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:34.414227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"131'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.080438+0000","last_change":"2024-04-25T08:50:52.062777+0000","last_active":"2024-04-25T08:50:54.080438+0000","last_peered":"2024-04-25T08:50:54.080438+0000","last_clean":"2024-04-25T08:50:54.080438+0000","last_became_active":"2024-04-25T08:50:52.062483+0000","last_became_peered":"2024-04-25T08:50:52.062483+0000","last_unstale":"2024-04-25T08:50:54.080438+0000","last_undegraded":"2024-04-25T08:50:54.080438+0000","last_fullsized":"2024-04-25T08:50:54.080438+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:12.613841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470836+0000","last_change":"2024-04-25T08:50:53.089220+0000","last_active":"2024-04-25T08:50:54.470836+0000","last_peered":"2024-04-25T08:50:54.470836+0000","last_clean":"2024-04-25T08:50:54.470836+0000","last_became_active":"2024-04-25T08:50:53.088519+0000","last_became_peered":"2024-04-25T08:50:53.088519+0000","last_unstale":"2024-04-25T08:50:54.470836+0000","last_undegraded":"2024-04-25T08:50:54.470836+0000","last_fullsized":"2024-04-25T08:50:54.470836+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:09.670917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069304+0000","last_change":"2024-04-25T08:50:52.067571+0000","last_active":"2024-04-25T08:50:54.069304+0000","last_peered":"2024-04-25T08:50:54.069304+0000","last_clean":"2024-04-25T08:50:54.069304+0000","last_became_active":"2024-04-25T08:50:52.067282+0000","last_became_peered":"2024-04-25T08:50:52.067282+0000","last_unstale":"2024-04-25T08:50:54.069304+0000","last_undegraded":"2024-04-25T08:50:54.069304+0000","last_fullsized":"2024-04-25T08:50:54.069304+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:41.029120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469221+0000","last_change":"2024-04-25T08:50:53.069681+0000","last_active":"2024-04-25T08:50:54.469221+0000","last_peered":"2024-04-25T08:50:54.469221+0000","last_clean":"2024-04-25T08:50:54.469221+0000","last_became_active":"2024-04-25T08:50:53.069408+0000","last_became_peered":"2024-04-25T08:50:53.069408+0000","last_unstale":"2024-04-25T08:50:54.469221+0000","last_undegraded":"2024-04-25T08:50:54.469221+0000","last_fullsized":"2024-04-25T08:50:54.469221+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:41.552036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069304+0000","last_change":"2024-04-25T08:50:52.065214+0000","last_active":"2024-04-25T08:50:54.069304+0000","last_peered":"2024-04-25T08:50:54.069304+0000","last_clean":"2024-04-25T08:50:54.069304+0000","last_became_active":"2024-04-25T08:50:52.064823+0000","last_became_peered":"2024-04-25T08:50:52.064823+0000","last_unstale":"2024-04-25T08:50:54.069304+0000","last_undegraded":"2024-04-25T08:50:54.069304+0000","last_fullsized":"2024-04-25T08:50:54.069304+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:36.635803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069292+0000","last_change":"2024-04-25T08:50:53.079935+0000","last_active":"2024-04-25T08:50:54.069292+0000","last_peered":"2024-04-25T08:50:54.069292+0000","last_clean":"2024-04-25T08:50:54.069292+0000","last_became_active":"2024-04-25T08:50:53.079628+0000","last_became_peered":"2024-04-25T08:50:53.079628+0000","last_unstale":"2024-04-25T08:50:54.069292+0000","last_undegraded":"2024-04-25T08:50:54.069292+0000","last_fullsized":"2024-04-25T08:50:54.069292+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:39.057501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068313+0000","last_change":"2024-04-25T08:50:52.071833+0000","last_active":"2024-04-25T08:50:54.068313+0000","last_peered":"2024-04-25T08:50:54.068313+0000","last_clean":"2024-04-25T08:50:54.068313+0000","last_became_active":"2024-04-25T08:50:52.071549+0000","last_became_peered":"2024-04-25T08:50:52.071549+0000","last_unstale":"2024-04-25T08:50:54.068313+0000","last_undegraded":"2024-04-25T08:50:54.068313+0000","last_fullsized":"2024-04-25T08:50:54.068313+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:38.050519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069515+0000","last_change":"2024-04-25T08:50:53.077940+0000","last_active":"2024-04-25T08:50:54.069515+0000","last_peered":"2024-04-25T08:50:54.069515+0000","last_clean":"2024-04-25T08:50:54.069515+0000","last_became_active":"2024-04-25T08:50:53.077654+0000","last_became_peered":"2024-04-25T08:50:53.077654+0000","last_unstale":"2024-04-25T08:50:54.069515+0000","last_undegraded":"2024-04-25T08:50:54.069515+0000","last_fullsized":"2024-04-25T08:50:54.069515+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:02.832327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470912+0000","last_change":"2024-04-25T08:50:52.068759+0000","last_active":"2024-04-25T08:50:54.470912+0000","last_peered":"2024-04-25T08:50:54.470912+0000","last_clean":"2024-04-25T08:50:54.470912+0000","last_became_active":"2024-04-25T08:50:52.068490+0000","last_became_peered":"2024-04-25T08:50:52.068490+0000","last_unstale":"2024-04-25T08:50:54.470912+0000","last_undegraded":"2024-04-25T08:50:54.470912+0000","last_fullsized":"2024-04-25T08:50:54.470912+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:35.638311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069405+0000","last_change":"2024-04-25T08:50:53.088958+0000","last_active":"2024-04-25T08:50:54.069405+0000","last_peered":"2024-04-25T08:50:54.069405+0000","last_clean":"2024-04-25T08:50:54.069405+0000","last_became_active":"2024-04-25T08:50:53.088700+0000","last_became_peered":"2024-04-25T08:50:53.088700+0000","last_unstale":"2024-04-25T08:50:54.069405+0000","last_undegraded":"2024-04-25T08:50:54.069405+0000","last_fullsized":"2024-04-25T08:50:54.069405+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:36.645292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069237+0000","last_change":"2024-04-25T08:50:52.065556+0000","last_active":"2024-04-25T08:50:54.069237+0000","last_peered":"2024-04-25T08:50:54.069237+0000","last_clean":"2024-04-25T08:50:54.069237+0000","last_became_active":"2024-04-25T08:50:52.065311+0000","last_became_peered":"2024-04-25T08:50:52.065311+0000","last_unstale":"2024-04-25T08:50:54.069237+0000","last_undegraded":"2024-04-25T08:50:54.069237+0000","last_fullsized":"2024-04-25T08:50:54.069237+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:20.550790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469911+0000","last_change":"2024-04-25T08:50:53.088627+0000","last_active":"2024-04-25T08:50:54.469911+0000","last_peered":"2024-04-25T08:50:54.469911+0000","last_clean":"2024-04-25T08:50:54.469911+0000","last_became_active":"2024-04-25T08:50:53.088193+0000","last_became_peered":"2024-04-25T08:50:53.088193+0000","last_unstale":"2024-04-25T08:50:54.469911+0000","last_undegraded":"2024-04-25T08:50:54.469911+0000","last_fullsized":"2024-04-25T08:50:54.469911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:17.680586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066809+0000","last_change":"2024-04-25T08:50:52.073018+0000","last_active":"2024-04-25T08:50:54.066809+0000","last_peered":"2024-04-25T08:50:54.066809+0000","last_clean":"2024-04-25T08:50:54.066809+0000","last_became_active":"2024-04-25T08:50:52.072665+0000","last_became_peered":"2024-04-25T08:50:52.072665+0000","last_unstale":"2024-04-25T08:50:54.066809+0000","last_undegraded":"2024-04-25T08:50:54.066809+0000","last_fullsized":"2024-04-25T08:50:54.066809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:32.839307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470526+0000","last_change":"2024-04-25T08:50:53.087170+0000","last_active":"2024-04-25T08:50:54.470526+0000","last_peered":"2024-04-25T08:50:54.470526+0000","last_clean":"2024-04-25T08:50:54.470526+0000","last_became_active":"2024-04-25T08:50:53.084856+0000","last_became_peered":"2024-04-25T08:50:53.084856+0000","last_unstale":"2024-04-25T08:50:54.470526+0000","last_undegraded":"2024-04-25T08:50:54.470526+0000","last_fullsized":"2024-04-25T08:50:54.470526+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:21.046097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470994+0000","last_change":"2024-04-25T08:50:52.072949+0000","last_active":"2024-04-25T08:50:54.470994+0000","last_peered":"2024-04-25T08:50:54.470994+0000","last_clean":"2024-04-25T08:50:54.470994+0000","last_became_active":"2024-04-25T08:50:52.072675+0000","last_became_peered":"2024-04-25T08:50:52.072675+0000","last_unstale":"2024-04-25T08:50:54.470994+0000","last_undegraded":"2024-04-25T08:50:54.470994+0000","last_fullsized":"2024-04-25T08:50:54.470994+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.186431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":373,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469578+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:50:54.469578+0000","last_peered":"2024-04-25T08:50:54.469578+0000","last_clean":"2024-04-25T08:50:54.469578+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:50:54.469578+0000","last_undegraded":"2024-04-25T08:50:54.469578+0000","last_fullsized":"2024-04-25T08:50:54.469578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574955,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47264,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324576,"statfs":{"total":96636764160,"available":96588365824,"internally_reserved":0,"allocated":2248704,"data_stored":1355240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50836,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321004,"statfs":{"total":96636764160,"available":96584708096,"internally_reserved":0,"allocated":1646592,"data_stored":763842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46676,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325164,"statfs":{"total":96636764160,"available":96588967936,"internally_reserved":0,"allocated":1642496,"data_stored":763192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50836,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321004,"statfs":{"total":96636764160,"available":96584708096,"internally_reserved":0,"allocated":1638400,"data_stored":763170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55004,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316836,"statfs":{"total":96636764160,"available":96580440064,"internally_reserved":0,"allocated":1654784,"data_stored":764852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50840,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321000,"statfs":{"total":96636764160,"available":96584704000,"internally_reserved":0,"allocated":1646592,"data_stored":763786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50836,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321004,"statfs":{"total":96636764160,"available":96584708096,"internally_reserved":0,"allocated":1642496,"data_stored":763240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51424,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320416,"statfs":{"total":96636764160,"available":96584105984,"internally_reserved":0,"allocated":2240512,"data_stored":1353594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:50:56.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:50:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.838+0000 7f8edc590640 1 Processor -- start 2024-04-25T08:50:56.829 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.838+0000 7f8edc590640 1 -- start start 2024-04-25T08:50:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.839+0000 7f8edc590640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8ed40cc6c0 0x7f8ed4071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.830 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.839+0000 7f8edc590640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed4071ed0 con 0x7f8ed413d190 2024-04-25T08:50:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.839+0000 7f8edc590640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed415a840 con 0x7f8ed415b320 2024-04-25T08:50:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.839+0000 7f8edc590640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed413d570 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.840+0000 7f8ed9b2b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8ed40cc6c0 0x7f8ed4071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.840+0000 7f8eda32c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8ed413d190 0x7f8ed40cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43116/0 (socket says 172.21.15.172:43116) 2024-04-25T08:50:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.840+0000 7f8ed9b2b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8ed40cc6c0 0x7f8ed4071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39134/0 (socket says 172.21.15.172:39134) 2024-04-25T08:50:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.840+0000 7f8eda32c640 1 -- 172.21.15.172:0/3866994706 learned_addr learned my addr 172.21.15.172:0/3866994706 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.840+0000 7f8ed9b2b640 1 -- 172.21.15.172:0/3866994706 >> v1:172.21.15.186:6789/0 conn(0x7f8ed415b320 legacy=0x7f8ed415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.840+0000 7f8ed9b2b640 1 -- 172.21.15.172:0/3866994706 >> v1:172.21.15.172:6789/0 conn(0x7f8ed413d190 legacy=0x7f8ed40cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.840+0000 7f8ed9b2b640 1 -- 172.21.15.172:0/3866994706 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed415ab20 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.831 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.840+0000 7f8ed932a640 1 -- 172.21.15.172:0/3866994706 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662145414 0 0) 0x7f8ed4071ed0 con 0x7f8ed413d190 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8ed9b2b640 1 --2- 172.21.15.172:0/3866994706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 0x7f8ed4071230 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f8ed413d6f0 tx=0x7f8ed002b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aceb6f0ff5e60930 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8ed932a640 1 -- 172.21.15.172:0/3866994706 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000b040 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8ed932a640 1 -- 172.21.15.172:0/3866994706 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed0030710 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8ed932a640 1 -- 172.21.15.172:0/3866994706 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0030ae0 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8edc590640 1 -- 172.21.15.172:0/3866994706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 msgr2=0x7f8ed4071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8edc590640 1 --2- 172.21.15.172:0/3866994706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 0x7f8ed4071230 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f8ed413d6f0 tx=0x7f8ed002b550 comp rx=0 tx=0).stop 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8edc590640 1 -- 172.21.15.172:0/3866994706 shutdown_connections 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8edc590640 1 --2- 172.21.15.172:0/3866994706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 0x7f8ed4071230 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8edc590640 1 -- 172.21.15.172:0/3866994706 >> 172.21.15.172:0/3866994706 conn(0x7f8ed406abe0 msgr2=0x7f8ed406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8edc590640 1 -- 172.21.15.172:0/3866994706 shutdown_connections 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.841+0000 7f8edc590640 1 -- 172.21.15.172:0/3866994706 wait complete. 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8edc590640 1 Processor -- start 2024-04-25T08:50:56.833 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8edc590640 1 -- start start 2024-04-25T08:50:56.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8edc590640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 0x7f8ed4165fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8edc590640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed413d190 0x7f8ed4159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8edc590640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ed415b320 0x7f8ed4151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8edc590640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed40718f0 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8edc590640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4071770 con 0x7f8ed413d190 2024-04-25T08:50:56.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8edc590640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4071a70 con 0x7f8ed415b320 2024-04-25T08:50:56.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8eda32c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 0x7f8ed4165fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.836 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8eda32c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 0x7f8ed4165fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39140/0 (socket says 172.21.15.172:39140) 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8eda32c640 1 -- 172.21.15.172:0/3048434550 learned_addr learned my addr 172.21.15.172:0/3048434550 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.843+0000 7f8ed9b2b640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed413d190 0x7f8ed4159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8edab2d640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ed415b320 0x7f8ed4151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8eda32c640 1 -- 172.21.15.172:0/3048434550 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ed415b320 msgr2=0x7f8ed4151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8eda32c640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ed415b320 0x7f8ed4151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8eda32c640 1 -- 172.21.15.172:0/3048434550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed413d190 msgr2=0x7f8ed4159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8eda32c640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed413d190 0x7f8ed4159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8eda32c640 1 -- 172.21.15.172:0/3048434550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed406e570 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8edab2d640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ed415b320 0x7f8ed4151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8eda32c640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 0x7f8ed4165fc0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400c4a0 tx=0x7f8ec400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8ecaffd640 1 -- 172.21.15.172:0/3048434550 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4018070 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8ecaffd640 1 -- 172.21.15.172:0/3048434550 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec40074e0 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8edc590640 1 -- 172.21.15.172:0/3048434550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed4167ec0 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8ecaffd640 1 -- 172.21.15.172:0/3048434550 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4004a20 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.837 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.844+0000 7f8edc590640 1 -- 172.21.15.172:0/3048434550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed406da90 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.845+0000 7f8edc590640 1 -- 172.21.15.172:0/3048434550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed4073990 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.845+0000 7f8ecaffd640 1 -- 172.21.15.172:0/3048434550 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ec401b070 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.846+0000 7f8ecaffd640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8eb806b4d0 0x7f8eb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:56.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.846+0000 7f8ecaffd640 1 -- 172.21.15.172:0/3048434550 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8ec40895c0 con 0x7f8ed40cc6c0 2024-04-25T08:50:56.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.846+0000 7f8ed9b2b640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8eb806b4d0 0x7f8eb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:56.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.846+0000 7f8ed9b2b640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8eb806b4d0 0x7f8eb806d990 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0035000 tx=0x7f8ed000c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:56.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:56.850+0000 7f8ecaffd640 1 -- 172.21.15.172:0/3048434550 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ec4057cf0 con 0x7f8ed40cc6c0 2024-04-25T08:50:57.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.086+0000 7f8edc590640 1 -- 172.21.15.172:0/3048434550 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8ed40cbca0 con 0x7f8ed40cc6c0 2024-04-25T08:50:57.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.087+0000 7f8ecaffd640 1 -- 172.21.15.172:0/3048434550 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1434 (secure 0 0 0) 0x7f8ec405bd90 con 0x7f8ed40cc6c0 2024-04-25T08:50:57.078 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:57.078 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":532,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":413405184,"bytes_avail":772680708096,"bytes_total":773094113280,"write_bytes_sec":2576,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":74,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9294}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-04-25T08:50:42.613771+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:50:57.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.089+0000 7f8edc590640 1 -- 172.21.15.172:0/3048434550 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8eb806b4d0 msgr2=0x7f8eb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:57.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.089+0000 7f8edc590640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8eb806b4d0 0x7f8eb806d990 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0035000 tx=0x7f8ed000c040 comp rx=0 tx=0).stop 2024-04-25T08:50:57.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.089+0000 7f8edc590640 1 -- 172.21.15.172:0/3048434550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 msgr2=0x7f8ed4165fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:57.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.089+0000 7f8edc590640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 0x7f8ed4165fc0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400c4a0 tx=0x7f8ec400c960 comp rx=0 tx=0).stop 2024-04-25T08:50:57.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.090+0000 7f8edc590640 1 -- 172.21.15.172:0/3048434550 shutdown_connections 2024-04-25T08:50:57.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.090+0000 7f8edc590640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8eb806b4d0 0x7f8eb806d990 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.090+0000 7f8edc590640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ed413d190 0x7f8ed4159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.090+0000 7f8edc590640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ed415b320 0x7f8ed4151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.090+0000 7f8edc590640 1 --2- 172.21.15.172:0/3048434550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ed40cc6c0 0x7f8ed4165fc0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.090+0000 7f8edc590640 1 -- 172.21.15.172:0/3048434550 >> 172.21.15.172:0/3048434550 conn(0x7f8ed406abe0 msgr2=0x7f8ed406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:57.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.090+0000 7f8edc590640 1 -- 172.21.15.172:0/3048434550 shutdown_connections 2024-04-25T08:50:57.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.090+0000 7f8edc590640 1 -- 172.21.15.172:0/3048434550 wait complete. 2024-04-25T08:50:57.091 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:50:57.092 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:50:57.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.198+0000 7fe401d32640 1 Processor -- start 2024-04-25T08:50:57.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.199+0000 7fe401d32640 1 -- start start 2024-04-25T08:50:57.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.199+0000 7fe401d32640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ba00 0x7fe3fc09a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:57.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.199+0000 7fe401d32640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe3fc1602e0 0x7fe3fc0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.199+0000 7fe401d32640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0cd710 con 0x7fe3fc15f5f0 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.199+0000 7fe401d32640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc099b70 con 0x7fe3fc1602e0 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.199+0000 7fe401d32640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc099e50 con 0x7fe3fc15ba00 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.199+0000 7fe3fbfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe3fc15f5f0 0x7fe3fc0c52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43118/0 (socket says 172.21.15.172:43118) 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3fbfff640 1 -- 172.21.15.172:0/2598461507 learned_addr learned my addr 172.21.15.172:0/2598461507 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3f2ffd640 1 --2- 172.21.15.172:0/2598461507 >> v2:172.21.15.186:3300/0 conn(0x7fe3fc1602e0 0x7fe3fc0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3fb7fe640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ba00 0x7fe3fc09a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350033738 0 0) 0x7fe3f4001490 con 0x7fe3fc15f5f0 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e8003520 con 0x7fe3fc15f5f0 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4011962381 0 0) 0x7fe3e8003520 con 0x7fe3fc15f5f0 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ba00 msgr2=0x7fe3fc09a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ba00 0x7fe3fc09a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 >> v2:172.21.15.186:3300/0 conn(0x7fe3fc1602e0 msgr2=0x7fe3fc0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:57.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 --2- 172.21.15.172:0/2598461507 >> v2:172.21.15.186:3300/0 conn(0x7fe3fc1602e0 0x7fe3fc0ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc09a130 con 0x7fe3fc15f5f0 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fe3f4001bc0 con 0x7fe3fc15f5f0 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 >> v1:172.21.15.172:6789/0 conn(0x7fe3fc15f5f0 legacy=0x7fe3fc0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3e80039b0 0x7fe3e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ba00 0x7fe3e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e8004d40 0x7fe3e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc099b70 con 0x7fe3e8004d40 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc099e50 con 0x7fe3e80039b0 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e800ba40 con 0x7fe3fc15ba00 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3fbfff640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e8004d40 0x7fe3e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3fb7fe640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3e80039b0 0x7fe3e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3f2ffd640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ba00 0x7fe3e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3fbfff640 1 -- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ba00 msgr2=0x7fe3e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:57.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3fbfff640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ba00 0x7fe3e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3fbfff640 1 -- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3e80039b0 msgr2=0x7fe3e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3fbfff640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3e80039b0 0x7fe3e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3fbfff640 1 -- 172.21.15.172:0/2598461507 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8003520 con 0x7fe3e8004d40 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.200+0000 7fe3fb7fe640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3e80039b0 0x7fe3e8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.201+0000 7fe3fbfff640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e8004d40 0x7fe3e80051c0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400aa70 tx=0x7fe3e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9edcac91581ac50e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.201+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400a690 con 0x7fe3e8004d40 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.201+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f402f070 con 0x7fe3e8004d40 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.201+0000 7fe3faffd640 1 -- 172.21.15.172:0/2598461507 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4034470 con 0x7fe3e8004d40 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.202+0000 7fe401d32640 1 -- 172.21.15.172:0/2598461507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e8004d40 msgr2=0x7fe3e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.202+0000 7fe401d32640 1 --2- 172.21.15.172:0/2598461507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3e8004d40 0x7fe3e80051c0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400aa70 tx=0x7fe3e8005830 comp rx=0 tx=0).stop 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.202+0000 7fe3fbfff640 1 -- 172.21.15.172:0/2598461507 reap_dead start 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.202+0000 7fe401d32640 1 -- 172.21.15.172:0/2598461507 shutdown_connections 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.202+0000 7fe401d32640 1 -- 172.21.15.172:0/2598461507 >> 172.21.15.172:0/2598461507 conn(0x7fe3fc0b3270 msgr2=0x7fe3fc0b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:57.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.202+0000 7fe401d32640 1 -- 172.21.15.172:0/2598461507 shutdown_connections 2024-04-25T08:50:57.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.202+0000 7fe401d32640 1 -- 172.21.15.172:0/2598461507 wait complete. 2024-04-25T08:50:57.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.203+0000 7fe401d32640 1 Processor -- start 2024-04-25T08:50:57.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.203+0000 7fe401d32640 1 -- start start 2024-04-25T08:50:57.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe401d32640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3e8004d40 0x7fe3fc154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:57.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe401d32640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ea70 0x7fe3fc0b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe401d32640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3fc0b5ea0 0x7fe3fc15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe401d32640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cd460 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe401d32640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cd2e0 con 0x7fe3e8004d40 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe401d32640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c59e0 con 0x7fe3fc15ea70 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe3fbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3fc0b5ea0 0x7fe3fc15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe3fbfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3fc0b5ea0 0x7fe3fc15cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39160/0 (socket says 172.21.15.172:39160) 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe3fbfff640 1 -- 172.21.15.172:0/4072634112 learned_addr learned my addr 172.21.15.172:0/4072634112 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe3fb7fe640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3e8004d40 0x7fe3fc154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe3f2ffd640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ea70 0x7fe3fc0b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe3fbfff640 1 -- 172.21.15.172:0/4072634112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ea70 msgr2=0x7fe3fc0b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe3fbfff640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ea70 0x7fe3fc0b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe3fbfff640 1 -- 172.21.15.172:0/4072634112 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3e8004d40 msgr2=0x7fe3fc154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe3fbfff640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3e8004d40 0x7fe3fc154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.204+0000 7fe3fbfff640 1 -- 172.21.15.172:0/4072634112 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc15d9d0 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.205+0000 7fe3fbfff640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3fc0b5ea0 0x7fe3fc15cca0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400aa70 tx=0x7fe3fc09a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.205+0000 7fe3f8ff9640 1 -- 172.21.15.172:0/4072634112 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4039070 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.205+0000 7fe3f8ff9640 1 -- 172.21.15.172:0/4072634112 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f4034470 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.205+0000 7fe401d32640 1 -- 172.21.15.172:0/4072634112 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc15dcb0 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.205+0000 7fe3f8ff9640 1 -- 172.21.15.172:0/4072634112 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400a690 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.205+0000 7fe401d32640 1 -- 172.21.15.172:0/4072634112 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc15e270 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.206+0000 7fe401d32640 1 -- 172.21.15.172:0/4072634112 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc073990 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.206+0000 7fe3f8ff9640 1 -- 172.21.15.172:0/4072634112 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe3f4044060 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.206+0000 7fe3f8ff9640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3dc06b500 0x7fe3dc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.207+0000 7fe3f8ff9640 1 -- 172.21.15.172:0/4072634112 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe3f40a9f80 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.207+0000 7fe3fb7fe640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3dc06b500 0x7fe3dc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:50:57.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.207+0000 7fe3fb7fe640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3dc06b500 0x7fe3dc06d9c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009990 tx=0x7fe3ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:50:57.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.211+0000 7fe3f8ff9640 1 -- 172.21.15.172:0/4072634112 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe3fc0cd710 con 0x7fe3fc0b5ea0 2024-04-25T08:50:57.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.378+0000 7fe401d32640 1 -- 172.21.15.172:0/4072634112 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3fc0b6320 con 0x7fe3dc06b500 2024-04-25T08:50:57.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.384+0000 7fe3f8ff9640 1 -- 172.21.15.172:0/4072634112 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252486 (secure 0 0 0) 0x7fe3ec004030 con 0x7fe3dc06b500 2024-04-25T08:50:57.377 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:50:57.378 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.387+0000 7fe401d32640 1 -- 172.21.15.172:0/4072634112 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3dc06b500 msgr2=0x7fe3dc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.387+0000 7fe401d32640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3dc06b500 0x7fe3dc06d9c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009990 tx=0x7fe3ec008040 comp rx=0 tx=0).stop 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.387+0000 7fe401d32640 1 -- 172.21.15.172:0/4072634112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3fc0b5ea0 msgr2=0x7fe3fc15cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.387+0000 7fe401d32640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3fc0b5ea0 0x7fe3fc15cca0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400aa70 tx=0x7fe3fc09a300 comp rx=0 tx=0).stop 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.387+0000 7fe401d32640 1 -- 172.21.15.172:0/4072634112 shutdown_connections 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.387+0000 7fe401d32640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe3dc06b500 0x7fe3dc06d9c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.387+0000 7fe401d32640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3fc0b5ea0 0x7fe3fc15cca0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.387+0000 7fe401d32640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3fc15ea70 0x7fe3fc0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.387+0000 7fe401d32640 1 --2- 172.21.15.172:0/4072634112 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3e8004d40 0x7fe3fc154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.387+0000 7fe401d32640 1 -- 172.21.15.172:0/4072634112 >> 172.21.15.172:0/4072634112 conn(0x7fe3fc0b3270 msgr2=0x7fe3fc0c78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.388+0000 7fe401d32640 1 -- 172.21.15.172:0/4072634112 shutdown_connections 2024-04-25T08:50:57.380 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:50:57.388+0000 7fe401d32640 1 -- 172.21.15.172:0/4072634112 wait complete. 2024-04-25T08:50:57.389 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-04-25T08:50:56.616356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403716,"kb_used_data":14024,"kb_used_omap":12,"kb_used_meta":389555,"kb_avail":754571004,"statfs":{"total":773094113280,"available":772680708096,"internally_reserved":0,"allocated":14360576,"data_stored":7290916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":398904880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.563934"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469575+0000","last_change":"2024-04-25T08:50:53.079918+0000","last_active":"2024-04-25T08:50:54.469575+0000","last_peered":"2024-04-25T08:50:54.469575+0000","last_clean":"2024-04-25T08:50:54.469575+0000","last_became_active":"2024-04-25T08:50:53.079605+0000","last_became_peered":"2024-04-25T08:50:53.079605+0000","last_unstale":"2024-04-25T08:50:54.469575+0000","last_undegraded":"2024-04-25T08:50:54.469575+0000","last_fullsized":"2024-04-25T08:50:54.469575+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:10.602356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068377+0000","last_change":"2024-04-25T08:50:53.072183+0000","last_active":"2024-04-25T08:50:54.068377+0000","last_peered":"2024-04-25T08:50:54.068377+0000","last_clean":"2024-04-25T08:50:54.068377+0000","last_became_active":"2024-04-25T08:50:53.071896+0000","last_became_peered":"2024-04-25T08:50:53.071896+0000","last_unstale":"2024-04-25T08:50:54.068377+0000","last_undegraded":"2024-04-25T08:50:54.068377+0000","last_fullsized":"2024-04-25T08:50:54.068377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:18.118317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470487+0000","last_change":"2024-04-25T08:50:53.087301+0000","last_active":"2024-04-25T08:50:54.470487+0000","last_peered":"2024-04-25T08:50:54.470487+0000","last_clean":"2024-04-25T08:50:54.470487+0000","last_became_active":"2024-04-25T08:50:53.085252+0000","last_became_peered":"2024-04-25T08:50:53.085252+0000","last_unstale":"2024-04-25T08:50:54.470487+0000","last_undegraded":"2024-04-25T08:50:54.470487+0000","last_fullsized":"2024-04-25T08:50:54.470487+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:53.509352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068093+0000","last_change":"2024-04-25T08:50:53.074561+0000","last_active":"2024-04-25T08:50:54.068093+0000","last_peered":"2024-04-25T08:50:54.068093+0000","last_clean":"2024-04-25T08:50:54.068093+0000","last_became_active":"2024-04-25T08:50:53.074314+0000","last_became_peered":"2024-04-25T08:50:53.074314+0000","last_unstale":"2024-04-25T08:50:54.068093+0000","last_undegraded":"2024-04-25T08:50:54.068093+0000","last_fullsized":"2024-04-25T08:50:54.068093+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:32.525096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066876+0000","last_change":"2024-04-25T08:50:53.084312+0000","last_active":"2024-04-25T08:50:54.066876+0000","last_peered":"2024-04-25T08:50:54.066876+0000","last_clean":"2024-04-25T08:50:54.066876+0000","last_became_active":"2024-04-25T08:50:53.083920+0000","last_became_peered":"2024-04-25T08:50:53.083920+0000","last_unstale":"2024-04-25T08:50:54.066876+0000","last_undegraded":"2024-04-25T08:50:54.066876+0000","last_fullsized":"2024-04-25T08:50:54.066876+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:00.482961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069261+0000","last_change":"2024-04-25T08:50:53.084844+0000","last_active":"2024-04-25T08:50:54.069261+0000","last_peered":"2024-04-25T08:50:54.069261+0000","last_clean":"2024-04-25T08:50:54.069261+0000","last_became_active":"2024-04-25T08:50:53.084571+0000","last_became_peered":"2024-04-25T08:50:53.084571+0000","last_unstale":"2024-04-25T08:50:54.069261+0000","last_undegraded":"2024-04-25T08:50:54.069261+0000","last_fullsized":"2024-04-25T08:50:54.069261+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:53.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470363+0000","last_change":"2024-04-25T08:50:53.090173+0000","last_active":"2024-04-25T08:50:54.470363+0000","last_peered":"2024-04-25T08:50:54.470363+0000","last_clean":"2024-04-25T08:50:54.470363+0000","last_became_active":"2024-04-25T08:50:53.089652+0000","last_became_peered":"2024-04-25T08:50:53.089652+0000","last_unstale":"2024-04-25T08:50:54.470363+0000","last_undegraded":"2024-04-25T08:50:54.470363+0000","last_fullsized":"2024-04-25T08:50:54.470363+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:36.397565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067667+0000","last_change":"2024-04-25T08:50:53.079125+0000","last_active":"2024-04-25T08:50:54.067667+0000","last_peered":"2024-04-25T08:50:54.067667+0000","last_clean":"2024-04-25T08:50:54.067667+0000","last_became_active":"2024-04-25T08:50:53.078809+0000","last_became_peered":"2024-04-25T08:50:53.078809+0000","last_unstale":"2024-04-25T08:50:54.067667+0000","last_undegraded":"2024-04-25T08:50:54.067667+0000","last_fullsized":"2024-04-25T08:50:54.067667+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:32.337285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069570+0000","last_change":"2024-04-25T08:50:53.077944+0000","last_active":"2024-04-25T08:50:54.069570+0000","last_peered":"2024-04-25T08:50:54.069570+0000","last_clean":"2024-04-25T08:50:54.069570+0000","last_became_active":"2024-04-25T08:50:53.077675+0000","last_became_peered":"2024-04-25T08:50:53.077675+0000","last_unstale":"2024-04-25T08:50:54.069570+0000","last_undegraded":"2024-04-25T08:50:54.069570+0000","last_fullsized":"2024-04-25T08:50:54.069570+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:40.951897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469008+0000","last_change":"2024-04-25T08:50:53.070740+0000","last_active":"2024-04-25T08:50:54.469008+0000","last_peered":"2024-04-25T08:50:54.469008+0000","last_clean":"2024-04-25T08:50:54.469008+0000","last_became_active":"2024-04-25T08:50:53.070363+0000","last_became_peered":"2024-04-25T08:50:53.070363+0000","last_unstale":"2024-04-25T08:50:54.469008+0000","last_undegraded":"2024-04-25T08:50:54.469008+0000","last_fullsized":"2024-04-25T08:50:54.469008+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:30.541711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067990+0000","last_change":"2024-04-25T08:50:53.088059+0000","last_active":"2024-04-25T08:50:54.067990+0000","last_peered":"2024-04-25T08:50:54.067990+0000","last_clean":"2024-04-25T08:50:54.067990+0000","last_became_active":"2024-04-25T08:50:53.087739+0000","last_became_peered":"2024-04-25T08:50:53.087739+0000","last_unstale":"2024-04-25T08:50:54.067990+0000","last_undegraded":"2024-04-25T08:50:54.067990+0000","last_fullsized":"2024-04-25T08:50:54.067990+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:04.060403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469757+0000","last_change":"2024-04-25T08:50:53.085824+0000","last_active":"2024-04-25T08:50:54.469757+0000","last_peered":"2024-04-25T08:50:54.469757+0000","last_clean":"2024-04-25T08:50:54.469757+0000","last_became_active":"2024-04-25T08:50:53.085516+0000","last_became_peered":"2024-04-25T08:50:53.085516+0000","last_unstale":"2024-04-25T08:50:54.469757+0000","last_undegraded":"2024-04-25T08:50:54.469757+0000","last_fullsized":"2024-04-25T08:50:54.469757+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:31.600069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069420+0000","last_change":"2024-04-25T08:50:53.087461+0000","last_active":"2024-04-25T08:50:54.069420+0000","last_peered":"2024-04-25T08:50:54.069420+0000","last_clean":"2024-04-25T08:50:54.069420+0000","last_became_active":"2024-04-25T08:50:53.087120+0000","last_became_peered":"2024-04-25T08:50:53.087120+0000","last_unstale":"2024-04-25T08:50:54.069420+0000","last_undegraded":"2024-04-25T08:50:54.069420+0000","last_fullsized":"2024-04-25T08:50:54.069420+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:44.193413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469194+0000","last_change":"2024-04-25T08:50:53.086642+0000","last_active":"2024-04-25T08:50:54.469194+0000","last_peered":"2024-04-25T08:50:54.469194+0000","last_clean":"2024-04-25T08:50:54.469194+0000","last_became_active":"2024-04-25T08:50:53.086349+0000","last_became_peered":"2024-04-25T08:50:53.086349+0000","last_unstale":"2024-04-25T08:50:54.469194+0000","last_undegraded":"2024-04-25T08:50:54.469194+0000","last_fullsized":"2024-04-25T08:50:54.469194+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:03.596107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468809+0000","last_change":"2024-04-25T08:50:53.078706+0000","last_active":"2024-04-25T08:50:54.468809+0000","last_peered":"2024-04-25T08:50:54.468809+0000","last_clean":"2024-04-25T08:50:54.468809+0000","last_became_active":"2024-04-25T08:50:53.078450+0000","last_became_peered":"2024-04-25T08:50:53.078450+0000","last_unstale":"2024-04-25T08:50:54.468809+0000","last_undegraded":"2024-04-25T08:50:54.468809+0000","last_fullsized":"2024-04-25T08:50:54.468809+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:37.614131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069113+0000","last_change":"2024-04-25T08:50:53.086219+0000","last_active":"2024-04-25T08:50:54.069113+0000","last_peered":"2024-04-25T08:50:54.069113+0000","last_clean":"2024-04-25T08:50:54.069113+0000","last_became_active":"2024-04-25T08:50:53.085360+0000","last_became_peered":"2024-04-25T08:50:53.085360+0000","last_unstale":"2024-04-25T08:50:54.069113+0000","last_undegraded":"2024-04-25T08:50:54.069113+0000","last_fullsized":"2024-04-25T08:50:54.069113+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:38.702830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069655+0000","last_change":"2024-04-25T08:50:53.086008+0000","last_active":"2024-04-25T08:50:54.069655+0000","last_peered":"2024-04-25T08:50:54.069655+0000","last_clean":"2024-04-25T08:50:54.069655+0000","last_became_active":"2024-04-25T08:50:53.085716+0000","last_became_peered":"2024-04-25T08:50:53.085716+0000","last_unstale":"2024-04-25T08:50:54.069655+0000","last_undegraded":"2024-04-25T08:50:54.069655+0000","last_fullsized":"2024-04-25T08:50:54.069655+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:16.590510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067250+0000","last_change":"2024-04-25T08:50:53.084748+0000","last_active":"2024-04-25T08:50:54.067250+0000","last_peered":"2024-04-25T08:50:54.067250+0000","last_clean":"2024-04-25T08:50:54.067250+0000","last_became_active":"2024-04-25T08:50:53.084508+0000","last_became_peered":"2024-04-25T08:50:53.084508+0000","last_unstale":"2024-04-25T08:50:54.067250+0000","last_undegraded":"2024-04-25T08:50:54.067250+0000","last_fullsized":"2024-04-25T08:50:54.067250+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:09.670917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469872+0000","last_change":"2024-04-25T08:50:53.086747+0000","last_active":"2024-04-25T08:50:54.469872+0000","last_peered":"2024-04-25T08:50:54.469872+0000","last_clean":"2024-04-25T08:50:54.469872+0000","last_became_active":"2024-04-25T08:50:53.086345+0000","last_became_peered":"2024-04-25T08:50:53.086345+0000","last_unstale":"2024-04-25T08:50:54.469872+0000","last_undegraded":"2024-04-25T08:50:54.469872+0000","last_fullsized":"2024-04-25T08:50:54.469872+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:18.118317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066973+0000","last_change":"2024-04-25T08:50:53.084017+0000","last_active":"2024-04-25T08:50:54.066973+0000","last_peered":"2024-04-25T08:50:54.066973+0000","last_clean":"2024-04-25T08:50:54.066973+0000","last_became_active":"2024-04-25T08:50:53.083743+0000","last_became_peered":"2024-04-25T08:50:53.083743+0000","last_unstale":"2024-04-25T08:50:54.066973+0000","last_undegraded":"2024-04-25T08:50:54.066973+0000","last_fullsized":"2024-04-25T08:50:54.066973+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:15.343168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068205+0000","last_change":"2024-04-25T08:50:53.080696+0000","last_active":"2024-04-25T08:50:54.068205+0000","last_peered":"2024-04-25T08:50:54.068205+0000","last_clean":"2024-04-25T08:50:54.068205+0000","last_became_active":"2024-04-25T08:50:53.080401+0000","last_became_peered":"2024-04-25T08:50:53.080401+0000","last_unstale":"2024-04-25T08:50:54.068205+0000","last_undegraded":"2024-04-25T08:50:54.068205+0000","last_fullsized":"2024-04-25T08:50:54.068205+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:13.119096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469058+0000","last_change":"2024-04-25T08:50:53.080383+0000","last_active":"2024-04-25T08:50:54.469058+0000","last_peered":"2024-04-25T08:50:54.469058+0000","last_clean":"2024-04-25T08:50:54.469058+0000","last_became_active":"2024-04-25T08:50:53.080126+0000","last_became_peered":"2024-04-25T08:50:53.080126+0000","last_unstale":"2024-04-25T08:50:54.469058+0000","last_undegraded":"2024-04-25T08:50:54.469058+0000","last_fullsized":"2024-04-25T08:50:54.469058+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:44.633235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067733+0000","last_change":"2024-04-25T08:50:53.081657+0000","last_active":"2024-04-25T08:50:54.067733+0000","last_peered":"2024-04-25T08:50:54.067733+0000","last_clean":"2024-04-25T08:50:54.067733+0000","last_became_active":"2024-04-25T08:50:53.081333+0000","last_became_peered":"2024-04-25T08:50:53.081333+0000","last_unstale":"2024-04-25T08:50:54.067733+0000","last_undegraded":"2024-04-25T08:50:54.067733+0000","last_fullsized":"2024-04-25T08:50:54.067733+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:28.341343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069145+0000","last_change":"2024-04-25T08:50:53.078522+0000","last_active":"2024-04-25T08:50:54.069145+0000","last_peered":"2024-04-25T08:50:54.069145+0000","last_clean":"2024-04-25T08:50:54.069145+0000","last_became_active":"2024-04-25T08:50:53.078262+0000","last_became_peered":"2024-04-25T08:50:53.078262+0000","last_unstale":"2024-04-25T08:50:54.069145+0000","last_undegraded":"2024-04-25T08:50:54.069145+0000","last_fullsized":"2024-04-25T08:50:54.069145+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:42.645564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470410+0000","last_change":"2024-04-25T08:50:53.082712+0000","last_active":"2024-04-25T08:50:54.470410+0000","last_peered":"2024-04-25T08:50:54.470410+0000","last_clean":"2024-04-25T08:50:54.470410+0000","last_became_active":"2024-04-25T08:50:53.082440+0000","last_became_peered":"2024-04-25T08:50:53.082440+0000","last_unstale":"2024-04-25T08:50:54.470410+0000","last_undegraded":"2024-04-25T08:50:54.470410+0000","last_fullsized":"2024-04-25T08:50:54.470410+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:36.880421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470310+0000","last_change":"2024-04-25T08:50:53.088970+0000","last_active":"2024-04-25T08:50:54.470310+0000","last_peered":"2024-04-25T08:50:54.470310+0000","last_clean":"2024-04-25T08:50:54.470310+0000","last_became_active":"2024-04-25T08:50:53.088691+0000","last_became_peered":"2024-04-25T08:50:53.088691+0000","last_unstale":"2024-04-25T08:50:54.470310+0000","last_undegraded":"2024-04-25T08:50:54.470310+0000","last_fullsized":"2024-04-25T08:50:54.470310+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470005+0000","last_change":"2024-04-25T08:50:53.084874+0000","last_active":"2024-04-25T08:50:54.470005+0000","last_peered":"2024-04-25T08:50:54.470005+0000","last_clean":"2024-04-25T08:50:54.470005+0000","last_became_active":"2024-04-25T08:50:53.084611+0000","last_became_peered":"2024-04-25T08:50:53.084611+0000","last_unstale":"2024-04-25T08:50:54.470005+0000","last_undegraded":"2024-04-25T08:50:54.470005+0000","last_fullsized":"2024-04-25T08:50:54.470005+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:53.406838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469585+0000","last_change":"2024-04-25T08:50:53.071597+0000","last_active":"2024-04-25T08:50:54.469585+0000","last_peered":"2024-04-25T08:50:54.469585+0000","last_clean":"2024-04-25T08:50:54.469585+0000","last_became_active":"2024-04-25T08:50:53.070933+0000","last_became_peered":"2024-04-25T08:50:53.070933+0000","last_unstale":"2024-04-25T08:50:54.469585+0000","last_undegraded":"2024-04-25T08:50:54.469585+0000","last_fullsized":"2024-04-25T08:50:54.469585+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:16.779331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470052+0000","last_change":"2024-04-25T08:50:53.084317+0000","last_active":"2024-04-25T08:50:54.470052+0000","last_peered":"2024-04-25T08:50:54.470052+0000","last_clean":"2024-04-25T08:50:54.470052+0000","last_became_active":"2024-04-25T08:50:53.084030+0000","last_became_peered":"2024-04-25T08:50:53.084030+0000","last_unstale":"2024-04-25T08:50:54.470052+0000","last_undegraded":"2024-04-25T08:50:54.470052+0000","last_fullsized":"2024-04-25T08:50:54.470052+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:10.766542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470372+0000","last_change":"2024-04-25T08:50:53.084302+0000","last_active":"2024-04-25T08:50:54.470372+0000","last_peered":"2024-04-25T08:50:54.470372+0000","last_clean":"2024-04-25T08:50:54.470372+0000","last_became_active":"2024-04-25T08:50:53.083105+0000","last_became_peered":"2024-04-25T08:50:53.083105+0000","last_unstale":"2024-04-25T08:50:54.470372+0000","last_undegraded":"2024-04-25T08:50:54.470372+0000","last_fullsized":"2024-04-25T08:50:54.470372+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:46.377293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068018+0000","last_change":"2024-04-25T08:50:53.075476+0000","last_active":"2024-04-25T08:50:54.068018+0000","last_peered":"2024-04-25T08:50:54.068018+0000","last_clean":"2024-04-25T08:50:54.068018+0000","last_became_active":"2024-04-25T08:50:53.075196+0000","last_became_peered":"2024-04-25T08:50:53.075196+0000","last_unstale":"2024-04-25T08:50:54.068018+0000","last_undegraded":"2024-04-25T08:50:54.068018+0000","last_fullsized":"2024-04-25T08:50:54.068018+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:10.766542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468862+0000","last_change":"2024-04-25T08:50:53.079083+0000","last_active":"2024-04-25T08:50:54.468862+0000","last_peered":"2024-04-25T08:50:54.468862+0000","last_clean":"2024-04-25T08:50:54.468862+0000","last_became_active":"2024-04-25T08:50:53.078821+0000","last_became_peered":"2024-04-25T08:50:53.078821+0000","last_unstale":"2024-04-25T08:50:54.468862+0000","last_undegraded":"2024-04-25T08:50:54.468862+0000","last_fullsized":"2024-04-25T08:50:54.468862+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:52.512655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067814+0000","last_change":"2024-04-25T08:50:53.079742+0000","last_active":"2024-04-25T08:50:54.067814+0000","last_peered":"2024-04-25T08:50:54.067814+0000","last_clean":"2024-04-25T08:50:54.067814+0000","last_became_active":"2024-04-25T08:50:53.079456+0000","last_became_peered":"2024-04-25T08:50:53.079456+0000","last_unstale":"2024-04-25T08:50:54.067814+0000","last_undegraded":"2024-04-25T08:50:54.067814+0000","last_fullsized":"2024-04-25T08:50:54.067814+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:34.414227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"130'4","reported_seq":18,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470374+0000","last_change":"2024-04-25T08:50:52.073377+0000","last_active":"2024-04-25T08:50:54.470374+0000","last_peered":"2024-04-25T08:50:54.470374+0000","last_clean":"2024-04-25T08:50:54.470374+0000","last_became_active":"2024-04-25T08:50:52.073069+0000","last_became_peered":"2024-04-25T08:50:52.073069+0000","last_unstale":"2024-04-25T08:50:54.470374+0000","last_undegraded":"2024-04-25T08:50:54.470374+0000","last_fullsized":"2024-04-25T08:50:54.470374+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:14.817429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468866+0000","last_change":"2024-04-25T08:50:53.080474+0000","last_active":"2024-04-25T08:50:54.468866+0000","last_peered":"2024-04-25T08:50:54.468866+0000","last_clean":"2024-04-25T08:50:54.468866+0000","last_became_active":"2024-04-25T08:50:53.080207+0000","last_became_peered":"2024-04-25T08:50:53.080207+0000","last_unstale":"2024-04-25T08:50:54.468866+0000","last_undegraded":"2024-04-25T08:50:54.468866+0000","last_fullsized":"2024-04-25T08:50:54.468866+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:42.606841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067371+0000","last_change":"2024-04-25T08:50:52.064916+0000","last_active":"2024-04-25T08:50:54.067371+0000","last_peered":"2024-04-25T08:50:54.067371+0000","last_clean":"2024-04-25T08:50:54.067371+0000","last_became_active":"2024-04-25T08:50:52.064537+0000","last_became_peered":"2024-04-25T08:50:52.064537+0000","last_unstale":"2024-04-25T08:50:54.067371+0000","last_undegraded":"2024-04-25T08:50:54.067371+0000","last_fullsized":"2024-04-25T08:50:54.067371+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:54.410546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068148+0000","last_change":"2024-04-25T08:50:53.076011+0000","last_active":"2024-04-25T08:50:54.068148+0000","last_peered":"2024-04-25T08:50:54.068148+0000","last_clean":"2024-04-25T08:50:54.068148+0000","last_became_active":"2024-04-25T08:50:53.075150+0000","last_became_peered":"2024-04-25T08:50:53.075150+0000","last_unstale":"2024-04-25T08:50:54.068148+0000","last_undegraded":"2024-04-25T08:50:54.068148+0000","last_fullsized":"2024-04-25T08:50:54.068148+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:36.880693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469941+0000","last_change":"2024-04-25T08:50:52.069970+0000","last_active":"2024-04-25T08:50:54.469941+0000","last_peered":"2024-04-25T08:50:54.469941+0000","last_clean":"2024-04-25T08:50:54.469941+0000","last_became_active":"2024-04-25T08:50:52.069701+0000","last_became_peered":"2024-04-25T08:50:52.069701+0000","last_unstale":"2024-04-25T08:50:54.469941+0000","last_undegraded":"2024-04-25T08:50:54.469941+0000","last_fullsized":"2024-04-25T08:50:54.469941+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:01.825346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469838+0000","last_change":"2024-04-25T08:50:53.081000+0000","last_active":"2024-04-25T08:50:54.469838+0000","last_peered":"2024-04-25T08:50:54.469838+0000","last_clean":"2024-04-25T08:50:54.469838+0000","last_became_active":"2024-04-25T08:50:53.080742+0000","last_became_peered":"2024-04-25T08:50:53.080742+0000","last_unstale":"2024-04-25T08:50:54.469838+0000","last_undegraded":"2024-04-25T08:50:54.469838+0000","last_fullsized":"2024-04-25T08:50:54.469838+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:00.535216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469878+0000","last_change":"2024-04-25T08:50:52.070258+0000","last_active":"2024-04-25T08:50:54.469878+0000","last_peered":"2024-04-25T08:50:54.469878+0000","last_clean":"2024-04-25T08:50:54.469878+0000","last_became_active":"2024-04-25T08:50:52.069955+0000","last_became_peered":"2024-04-25T08:50:52.069955+0000","last_unstale":"2024-04-25T08:50:54.469878+0000","last_undegraded":"2024-04-25T08:50:54.469878+0000","last_fullsized":"2024-04-25T08:50:54.469878+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:40.708876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069116+0000","last_change":"2024-04-25T08:50:53.081636+0000","last_active":"2024-04-25T08:50:54.069116+0000","last_peered":"2024-04-25T08:50:54.069116+0000","last_clean":"2024-04-25T08:50:54.069116+0000","last_became_active":"2024-04-25T08:50:53.081335+0000","last_became_peered":"2024-04-25T08:50:53.081335+0000","last_unstale":"2024-04-25T08:50:54.069116+0000","last_undegraded":"2024-04-25T08:50:54.069116+0000","last_fullsized":"2024-04-25T08:50:54.069116+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:13.985914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068868+0000","last_change":"2024-04-25T08:50:52.069178+0000","last_active":"2024-04-25T08:50:54.068868+0000","last_peered":"2024-04-25T08:50:54.068868+0000","last_clean":"2024-04-25T08:50:54.068868+0000","last_became_active":"2024-04-25T08:50:52.068838+0000","last_became_peered":"2024-04-25T08:50:52.068838+0000","last_unstale":"2024-04-25T08:50:54.068868+0000","last_undegraded":"2024-04-25T08:50:54.068868+0000","last_fullsized":"2024-04-25T08:50:54.068868+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:48.445469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069301+0000","last_change":"2024-04-25T08:50:53.070680+0000","last_active":"2024-04-25T08:50:54.069301+0000","last_peered":"2024-04-25T08:50:54.069301+0000","last_clean":"2024-04-25T08:50:54.069301+0000","last_became_active":"2024-04-25T08:50:53.070359+0000","last_became_peered":"2024-04-25T08:50:53.070359+0000","last_unstale":"2024-04-25T08:50:54.069301+0000","last_undegraded":"2024-04-25T08:50:54.069301+0000","last_fullsized":"2024-04-25T08:50:54.069301+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066726+0000","last_change":"2024-04-25T08:50:52.063253+0000","last_active":"2024-04-25T08:50:54.066726+0000","last_peered":"2024-04-25T08:50:54.066726+0000","last_clean":"2024-04-25T08:50:54.066726+0000","last_became_active":"2024-04-25T08:50:52.062924+0000","last_became_peered":"2024-04-25T08:50:52.062924+0000","last_unstale":"2024-04-25T08:50:54.066726+0000","last_undegraded":"2024-04-25T08:50:54.066726+0000","last_fullsized":"2024-04-25T08:50:54.066726+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:33.545213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067275+0000","last_change":"2024-04-25T08:50:53.095475+0000","last_active":"2024-04-25T08:50:54.067275+0000","last_peered":"2024-04-25T08:50:54.067275+0000","last_clean":"2024-04-25T08:50:54.067275+0000","last_became_active":"2024-04-25T08:50:53.095194+0000","last_became_peered":"2024-04-25T08:50:53.095194+0000","last_unstale":"2024-04-25T08:50:54.067275+0000","last_undegraded":"2024-04-25T08:50:54.067275+0000","last_fullsized":"2024-04-25T08:50:54.067275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:25.919760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069116+0000","last_change":"2024-04-25T08:50:52.059513+0000","last_active":"2024-04-25T08:50:54.069116+0000","last_peered":"2024-04-25T08:50:54.069116+0000","last_clean":"2024-04-25T08:50:54.069116+0000","last_became_active":"2024-04-25T08:50:52.059249+0000","last_became_peered":"2024-04-25T08:50:52.059249+0000","last_unstale":"2024-04-25T08:50:54.069116+0000","last_undegraded":"2024-04-25T08:50:54.069116+0000","last_fullsized":"2024-04-25T08:50:54.069116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:41.029120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470128+0000","last_change":"2024-04-25T08:50:53.080901+0000","last_active":"2024-04-25T08:50:54.470128+0000","last_peered":"2024-04-25T08:50:54.470128+0000","last_clean":"2024-04-25T08:50:54.470128+0000","last_became_active":"2024-04-25T08:50:53.080631+0000","last_became_peered":"2024-04-25T08:50:53.080631+0000","last_unstale":"2024-04-25T08:50:54.470128+0000","last_undegraded":"2024-04-25T08:50:54.470128+0000","last_fullsized":"2024-04-25T08:50:54.470128+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:00.482961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469723+0000","last_change":"2024-04-25T08:50:52.068577+0000","last_active":"2024-04-25T08:50:54.469723+0000","last_peered":"2024-04-25T08:50:54.469723+0000","last_clean":"2024-04-25T08:50:54.469723+0000","last_became_active":"2024-04-25T08:50:52.068271+0000","last_became_peered":"2024-04-25T08:50:52.068271+0000","last_unstale":"2024-04-25T08:50:54.469723+0000","last_undegraded":"2024-04-25T08:50:54.469723+0000","last_fullsized":"2024-04-25T08:50:54.469723+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:23.439699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468801+0000","last_change":"2024-04-25T08:50:53.084115+0000","last_active":"2024-04-25T08:50:54.468801+0000","last_peered":"2024-04-25T08:50:54.468801+0000","last_clean":"2024-04-25T08:50:54.468801+0000","last_became_active":"2024-04-25T08:50:53.083827+0000","last_became_peered":"2024-04-25T08:50:53.083827+0000","last_unstale":"2024-04-25T08:50:54.468801+0000","last_undegraded":"2024-04-25T08:50:54.468801+0000","last_fullsized":"2024-04-25T08:50:54.468801+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:45.145846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068695+0000","last_change":"2024-04-25T08:50:52.067710+0000","last_active":"2024-04-25T08:50:54.068695+0000","last_peered":"2024-04-25T08:50:54.068695+0000","last_clean":"2024-04-25T08:50:54.068695+0000","last_became_active":"2024-04-25T08:50:52.067279+0000","last_became_peered":"2024-04-25T08:50:52.067279+0000","last_unstale":"2024-04-25T08:50:54.068695+0000","last_undegraded":"2024-04-25T08:50:54.068695+0000","last_fullsized":"2024-04-25T08:50:54.068695+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:35.638311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069275+0000","last_change":"2024-04-25T08:50:53.075292+0000","last_active":"2024-04-25T08:50:54.069275+0000","last_peered":"2024-04-25T08:50:54.069275+0000","last_clean":"2024-04-25T08:50:54.069275+0000","last_became_active":"2024-04-25T08:50:53.075034+0000","last_became_peered":"2024-04-25T08:50:53.075034+0000","last_unstale":"2024-04-25T08:50:54.069275+0000","last_undegraded":"2024-04-25T08:50:54.069275+0000","last_fullsized":"2024-04-25T08:50:54.069275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:41.715857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469432+0000","last_change":"2024-04-25T08:50:52.068258+0000","last_active":"2024-04-25T08:50:54.469432+0000","last_peered":"2024-04-25T08:50:54.469432+0000","last_clean":"2024-04-25T08:50:54.469432+0000","last_became_active":"2024-04-25T08:50:52.067978+0000","last_became_peered":"2024-04-25T08:50:52.067978+0000","last_unstale":"2024-04-25T08:50:54.469432+0000","last_undegraded":"2024-04-25T08:50:54.469432+0000","last_fullsized":"2024-04-25T08:50:54.469432+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:18.966728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470325+0000","last_change":"2024-04-25T08:50:53.084303+0000","last_active":"2024-04-25T08:50:54.470325+0000","last_peered":"2024-04-25T08:50:54.470325+0000","last_clean":"2024-04-25T08:50:54.470325+0000","last_became_active":"2024-04-25T08:50:53.082570+0000","last_became_peered":"2024-04-25T08:50:53.082570+0000","last_unstale":"2024-04-25T08:50:54.470325+0000","last_undegraded":"2024-04-25T08:50:54.470325+0000","last_fullsized":"2024-04-25T08:50:54.470325+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:18.175894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"130'3","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470070+0000","last_change":"2024-04-25T08:50:52.072224+0000","last_active":"2024-04-25T08:50:54.470070+0000","last_peered":"2024-04-25T08:50:54.470070+0000","last_clean":"2024-04-25T08:50:54.470070+0000","last_became_active":"2024-04-25T08:50:52.071933+0000","last_became_peered":"2024-04-25T08:50:52.071933+0000","last_unstale":"2024-04-25T08:50:54.470070+0000","last_undegraded":"2024-04-25T08:50:54.470070+0000","last_fullsized":"2024-04-25T08:50:54.470070+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:39.944916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470212+0000","last_change":"2024-04-25T08:50:53.086992+0000","last_active":"2024-04-25T08:50:54.470212+0000","last_peered":"2024-04-25T08:50:54.470212+0000","last_clean":"2024-04-25T08:50:54.470212+0000","last_became_active":"2024-04-25T08:50:53.086578+0000","last_became_peered":"2024-04-25T08:50:53.086578+0000","last_unstale":"2024-04-25T08:50:54.470212+0000","last_undegraded":"2024-04-25T08:50:54.470212+0000","last_fullsized":"2024-04-25T08:50:54.470212+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:13.985914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"130'6","reported_seq":20,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469997+0000","last_change":"2024-04-25T08:50:52.070677+0000","last_active":"2024-04-25T08:50:54.469997+0000","last_peered":"2024-04-25T08:50:54.469997+0000","last_clean":"2024-04-25T08:50:54.469997+0000","last_became_active":"2024-04-25T08:50:52.070263+0000","last_became_peered":"2024-04-25T08:50:52.070263+0000","last_unstale":"2024-04-25T08:50:54.469997+0000","last_undegraded":"2024-04-25T08:50:54.469997+0000","last_fullsized":"2024-04-25T08:50:54.469997+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:38.050519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469453+0000","last_change":"2024-04-25T08:50:53.073091+0000","last_active":"2024-04-25T08:50:54.469453+0000","last_peered":"2024-04-25T08:50:54.469453+0000","last_clean":"2024-04-25T08:50:54.469453+0000","last_became_active":"2024-04-25T08:50:53.072792+0000","last_became_peered":"2024-04-25T08:50:53.072792+0000","last_unstale":"2024-04-25T08:50:54.469453+0000","last_undegraded":"2024-04-25T08:50:54.469453+0000","last_fullsized":"2024-04-25T08:50:54.469453+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:41.016023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469786+0000","last_change":"2024-04-25T08:50:52.071574+0000","last_active":"2024-04-25T08:50:54.469786+0000","last_peered":"2024-04-25T08:50:54.469786+0000","last_clean":"2024-04-25T08:50:54.469786+0000","last_became_active":"2024-04-25T08:50:52.071219+0000","last_became_peered":"2024-04-25T08:50:52.071219+0000","last_unstale":"2024-04-25T08:50:54.469786+0000","last_undegraded":"2024-04-25T08:50:54.469786+0000","last_fullsized":"2024-04-25T08:50:54.469786+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:48.640118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470402+0000","last_change":"2024-04-25T08:50:53.083074+0000","last_active":"2024-04-25T08:50:54.470402+0000","last_peered":"2024-04-25T08:50:54.470402+0000","last_clean":"2024-04-25T08:50:54.470402+0000","last_became_active":"2024-04-25T08:50:53.082667+0000","last_became_peered":"2024-04-25T08:50:53.082667+0000","last_unstale":"2024-04-25T08:50:54.470402+0000","last_undegraded":"2024-04-25T08:50:54.470402+0000","last_fullsized":"2024-04-25T08:50:54.470402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:15.343168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469982+0000","last_change":"2024-04-25T08:50:52.067674+0000","last_active":"2024-04-25T08:50:54.469982+0000","last_peered":"2024-04-25T08:50:54.469982+0000","last_clean":"2024-04-25T08:50:54.469982+0000","last_became_active":"2024-04-25T08:50:52.067413+0000","last_became_peered":"2024-04-25T08:50:52.067413+0000","last_unstale":"2024-04-25T08:50:54.469982+0000","last_undegraded":"2024-04-25T08:50:54.469982+0000","last_fullsized":"2024-04-25T08:50:54.469982+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:53.520138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066953+0000","last_change":"2024-04-25T08:50:53.083385+0000","last_active":"2024-04-25T08:50:54.066953+0000","last_peered":"2024-04-25T08:50:54.066953+0000","last_clean":"2024-04-25T08:50:54.066953+0000","last_became_active":"2024-04-25T08:50:53.083042+0000","last_became_peered":"2024-04-25T08:50:53.083042+0000","last_unstale":"2024-04-25T08:50:54.066953+0000","last_undegraded":"2024-04-25T08:50:54.066953+0000","last_fullsized":"2024-04-25T08:50:54.066953+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:36.397565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"130'8","reported_seq":22,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069343+0000","last_change":"2024-04-25T08:50:52.073052+0000","last_active":"2024-04-25T08:50:54.069343+0000","last_peered":"2024-04-25T08:50:54.069343+0000","last_clean":"2024-04-25T08:50:54.069343+0000","last_became_active":"2024-04-25T08:50:52.072717+0000","last_became_peered":"2024-04-25T08:50:52.072717+0000","last_unstale":"2024-04-25T08:50:54.069343+0000","last_undegraded":"2024-04-25T08:50:54.069343+0000","last_fullsized":"2024-04-25T08:50:54.069343+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:59.581933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469585+0000","last_change":"2024-04-25T08:50:53.085726+0000","last_active":"2024-04-25T08:50:54.469585+0000","last_peered":"2024-04-25T08:50:54.469585+0000","last_clean":"2024-04-25T08:50:54.469585+0000","last_became_active":"2024-04-25T08:50:53.085483+0000","last_became_peered":"2024-04-25T08:50:53.085483+0000","last_unstale":"2024-04-25T08:50:54.469585+0000","last_undegraded":"2024-04-25T08:50:54.469585+0000","last_fullsized":"2024-04-25T08:50:54.469585+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:32.337285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068757+0000","last_change":"2024-04-25T08:50:52.068588+0000","last_active":"2024-04-25T08:50:54.068757+0000","last_peered":"2024-04-25T08:50:54.068757+0000","last_clean":"2024-04-25T08:50:54.068757+0000","last_became_active":"2024-04-25T08:50:52.067825+0000","last_became_peered":"2024-04-25T08:50:52.067825+0000","last_unstale":"2024-04-25T08:50:54.068757+0000","last_undegraded":"2024-04-25T08:50:54.068757+0000","last_fullsized":"2024-04-25T08:50:54.068757+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.186431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470517+0000","last_change":"2024-04-25T08:50:53.086450+0000","last_active":"2024-04-25T08:50:54.470517+0000","last_peered":"2024-04-25T08:50:54.470517+0000","last_clean":"2024-04-25T08:50:54.470517+0000","last_became_active":"2024-04-25T08:50:53.086075+0000","last_became_peered":"2024-04-25T08:50:53.086075+0000","last_unstale":"2024-04-25T08:50:54.470517+0000","last_undegraded":"2024-04-25T08:50:54.470517+0000","last_fullsized":"2024-04-25T08:50:54.470517+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:41.088924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470374+0000","last_change":"2024-04-25T08:50:52.071957+0000","last_active":"2024-04-25T08:50:54.470374+0000","last_peered":"2024-04-25T08:50:54.470374+0000","last_clean":"2024-04-25T08:50:54.470374+0000","last_became_active":"2024-04-25T08:50:52.071671+0000","last_became_peered":"2024-04-25T08:50:52.071671+0000","last_unstale":"2024-04-25T08:50:54.470374+0000","last_undegraded":"2024-04-25T08:50:54.470374+0000","last_fullsized":"2024-04-25T08:50:54.470374+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:55.349207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470836+0000","last_change":"2024-04-25T08:50:53.084689+0000","last_active":"2024-04-25T08:50:54.470836+0000","last_peered":"2024-04-25T08:50:54.470836+0000","last_clean":"2024-04-25T08:50:54.470836+0000","last_became_active":"2024-04-25T08:50:53.084401+0000","last_became_peered":"2024-04-25T08:50:53.084401+0000","last_unstale":"2024-04-25T08:50:54.470836+0000","last_undegraded":"2024-04-25T08:50:54.470836+0000","last_fullsized":"2024-04-25T08:50:54.470836+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:02.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069477+0000","last_change":"2024-04-25T08:50:52.066249+0000","last_active":"2024-04-25T08:50:54.069477+0000","last_peered":"2024-04-25T08:50:54.069477+0000","last_clean":"2024-04-25T08:50:54.069477+0000","last_became_active":"2024-04-25T08:50:52.066030+0000","last_became_peered":"2024-04-25T08:50:52.066030+0000","last_unstale":"2024-04-25T08:50:54.069477+0000","last_undegraded":"2024-04-25T08:50:54.069477+0000","last_fullsized":"2024-04-25T08:50:54.069477+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:28.150151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469149+0000","last_change":"2024-04-25T08:50:53.087224+0000","last_active":"2024-04-25T08:50:54.469149+0000","last_peered":"2024-04-25T08:50:54.469149+0000","last_clean":"2024-04-25T08:50:54.469149+0000","last_became_active":"2024-04-25T08:50:53.086843+0000","last_became_peered":"2024-04-25T08:50:53.086843+0000","last_unstale":"2024-04-25T08:50:54.469149+0000","last_undegraded":"2024-04-25T08:50:54.469149+0000","last_fullsized":"2024-04-25T08:50:54.469149+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:59.157977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067170+0000","last_change":"2024-04-25T08:50:52.070019+0000","last_active":"2024-04-25T08:50:54.067170+0000","last_peered":"2024-04-25T08:50:54.067170+0000","last_clean":"2024-04-25T08:50:54.067170+0000","last_became_active":"2024-04-25T08:50:52.069758+0000","last_became_peered":"2024-04-25T08:50:52.069758+0000","last_unstale":"2024-04-25T08:50:54.067170+0000","last_undegraded":"2024-04-25T08:50:54.067170+0000","last_fullsized":"2024-04-25T08:50:54.067170+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:37.347823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067096+0000","last_change":"2024-04-25T08:50:53.082565+0000","last_active":"2024-04-25T08:50:54.067096+0000","last_peered":"2024-04-25T08:50:54.067096+0000","last_clean":"2024-04-25T08:50:54.067096+0000","last_became_active":"2024-04-25T08:50:53.082119+0000","last_became_peered":"2024-04-25T08:50:53.082119+0000","last_unstale":"2024-04-25T08:50:54.067096+0000","last_undegraded":"2024-04-25T08:50:54.067096+0000","last_fullsized":"2024-04-25T08:50:54.067096+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:41.088924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068991+0000","last_change":"2024-04-25T08:50:52.070483+0000","last_active":"2024-04-25T08:50:54.068991+0000","last_peered":"2024-04-25T08:50:54.068991+0000","last_clean":"2024-04-25T08:50:54.068991+0000","last_became_active":"2024-04-25T08:50:52.070167+0000","last_became_peered":"2024-04-25T08:50:52.070167+0000","last_unstale":"2024-04-25T08:50:54.068991+0000","last_undegraded":"2024-04-25T08:50:54.068991+0000","last_fullsized":"2024-04-25T08:50:54.068991+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.004266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469459+0000","last_change":"2024-04-25T08:50:53.078082+0000","last_active":"2024-04-25T08:50:54.469459+0000","last_peered":"2024-04-25T08:50:54.469459+0000","last_clean":"2024-04-25T08:50:54.469459+0000","last_became_active":"2024-04-25T08:50:53.077808+0000","last_became_peered":"2024-04-25T08:50:53.077808+0000","last_unstale":"2024-04-25T08:50:54.469459+0000","last_undegraded":"2024-04-25T08:50:54.469459+0000","last_fullsized":"2024-04-25T08:50:54.469459+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:07.585873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469285+0000","last_change":"2024-04-25T08:50:52.066994+0000","last_active":"2024-04-25T08:50:54.469285+0000","last_peered":"2024-04-25T08:50:54.469285+0000","last_clean":"2024-04-25T08:50:54.469285+0000","last_became_active":"2024-04-25T08:50:52.066721+0000","last_became_peered":"2024-04-25T08:50:52.066721+0000","last_unstale":"2024-04-25T08:50:54.469285+0000","last_undegraded":"2024-04-25T08:50:54.469285+0000","last_fullsized":"2024-04-25T08:50:54.469285+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:57.026177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067328+0000","last_change":"2024-04-25T08:50:53.083181+0000","last_active":"2024-04-25T08:50:54.067328+0000","last_peered":"2024-04-25T08:50:54.067328+0000","last_clean":"2024-04-25T08:50:54.067328+0000","last_became_active":"2024-04-25T08:50:53.082822+0000","last_became_peered":"2024-04-25T08:50:53.082822+0000","last_unstale":"2024-04-25T08:50:54.067328+0000","last_undegraded":"2024-04-25T08:50:54.067328+0000","last_fullsized":"2024-04-25T08:50:54.067328+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:03.983664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470604+0000","last_change":"2024-04-25T08:50:52.073836+0000","last_active":"2024-04-25T08:50:54.470604+0000","last_peered":"2024-04-25T08:50:54.470604+0000","last_clean":"2024-04-25T08:50:54.470604+0000","last_became_active":"2024-04-25T08:50:52.073524+0000","last_became_peered":"2024-04-25T08:50:52.073524+0000","last_unstale":"2024-04-25T08:50:54.470604+0000","last_undegraded":"2024-04-25T08:50:54.470604+0000","last_fullsized":"2024-04-25T08:50:54.470604+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:15.583529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068582+0000","last_change":"2024-04-25T08:50:53.083213+0000","last_active":"2024-04-25T08:50:54.068582+0000","last_peered":"2024-04-25T08:50:54.068582+0000","last_clean":"2024-04-25T08:50:54.068582+0000","last_became_active":"2024-04-25T08:50:53.082937+0000","last_became_peered":"2024-04-25T08:50:53.082937+0000","last_unstale":"2024-04-25T08:50:54.068582+0000","last_undegraded":"2024-04-25T08:50:54.068582+0000","last_fullsized":"2024-04-25T08:50:54.068582+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:17.680586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069440+0000","last_change":"2024-04-25T08:50:52.069176+0000","last_active":"2024-04-25T08:50:54.069440+0000","last_peered":"2024-04-25T08:50:54.069440+0000","last_clean":"2024-04-25T08:50:54.069440+0000","last_became_active":"2024-04-25T08:50:52.068893+0000","last_became_peered":"2024-04-25T08:50:52.068893+0000","last_unstale":"2024-04-25T08:50:54.069440+0000","last_undegraded":"2024-04-25T08:50:54.069440+0000","last_fullsized":"2024-04-25T08:50:54.069440+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:00.101295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067125+0000","last_change":"2024-04-25T08:50:53.084130+0000","last_active":"2024-04-25T08:50:54.067125+0000","last_peered":"2024-04-25T08:50:54.067125+0000","last_clean":"2024-04-25T08:50:54.067125+0000","last_became_active":"2024-04-25T08:50:53.083736+0000","last_became_peered":"2024-04-25T08:50:53.083736+0000","last_unstale":"2024-04-25T08:50:54.067125+0000","last_undegraded":"2024-04-25T08:50:54.067125+0000","last_fullsized":"2024-04-25T08:50:54.067125+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:02.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469626+0000","last_change":"2024-04-25T08:50:52.072213+0000","last_active":"2024-04-25T08:50:54.469626+0000","last_peered":"2024-04-25T08:50:54.469626+0000","last_clean":"2024-04-25T08:50:54.469626+0000","last_became_active":"2024-04-25T08:50:52.071944+0000","last_became_peered":"2024-04-25T08:50:52.071944+0000","last_unstale":"2024-04-25T08:50:54.469626+0000","last_undegraded":"2024-04-25T08:50:54.469626+0000","last_fullsized":"2024-04-25T08:50:54.469626+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:53.320007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469925+0000","last_change":"2024-04-25T08:50:53.085506+0000","last_active":"2024-04-25T08:50:54.469925+0000","last_peered":"2024-04-25T08:50:54.469925+0000","last_clean":"2024-04-25T08:50:54.469925+0000","last_became_active":"2024-04-25T08:50:53.085228+0000","last_became_peered":"2024-04-25T08:50:53.085228+0000","last_unstale":"2024-04-25T08:50:54.469925+0000","last_undegraded":"2024-04-25T08:50:54.469925+0000","last_fullsized":"2024-04-25T08:50:54.469925+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:34.414227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"131'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.080438+0000","last_change":"2024-04-25T08:50:52.062777+0000","last_active":"2024-04-25T08:50:54.080438+0000","last_peered":"2024-04-25T08:50:54.080438+0000","last_clean":"2024-04-25T08:50:54.080438+0000","last_became_active":"2024-04-25T08:50:52.062483+0000","last_became_peered":"2024-04-25T08:50:52.062483+0000","last_unstale":"2024-04-25T08:50:54.080438+0000","last_undegraded":"2024-04-25T08:50:54.080438+0000","last_fullsized":"2024-04-25T08:50:54.080438+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:12.613841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470836+0000","last_change":"2024-04-25T08:50:53.089220+0000","last_active":"2024-04-25T08:50:54.470836+0000","last_peered":"2024-04-25T08:50:54.470836+0000","last_clean":"2024-04-25T08:50:54.470836+0000","last_became_active":"2024-04-25T08:50:53.088519+0000","last_became_peered":"2024-04-25T08:50:53.088519+0000","last_unstale":"2024-04-25T08:50:54.470836+0000","last_undegraded":"2024-04-25T08:50:54.470836+0000","last_fullsized":"2024-04-25T08:50:54.470836+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:09.670917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069304+0000","last_change":"2024-04-25T08:50:52.067571+0000","last_active":"2024-04-25T08:50:54.069304+0000","last_peered":"2024-04-25T08:50:54.069304+0000","last_clean":"2024-04-25T08:50:54.069304+0000","last_became_active":"2024-04-25T08:50:52.067282+0000","last_became_peered":"2024-04-25T08:50:52.067282+0000","last_unstale":"2024-04-25T08:50:54.069304+0000","last_undegraded":"2024-04-25T08:50:54.069304+0000","last_fullsized":"2024-04-25T08:50:54.069304+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:41.029120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469221+0000","last_change":"2024-04-25T08:50:53.069681+0000","last_active":"2024-04-25T08:50:54.469221+0000","last_peered":"2024-04-25T08:50:54.469221+0000","last_clean":"2024-04-25T08:50:54.469221+0000","last_became_active":"2024-04-25T08:50:53.069408+0000","last_became_peered":"2024-04-25T08:50:53.069408+0000","last_unstale":"2024-04-25T08:50:54.469221+0000","last_undegraded":"2024-04-25T08:50:54.469221+0000","last_fullsized":"2024-04-25T08:50:54.469221+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:41.552036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069304+0000","last_change":"2024-04-25T08:50:52.065214+0000","last_active":"2024-04-25T08:50:54.069304+0000","last_peered":"2024-04-25T08:50:54.069304+0000","last_clean":"2024-04-25T08:50:54.069304+0000","last_became_active":"2024-04-25T08:50:52.064823+0000","last_became_peered":"2024-04-25T08:50:52.064823+0000","last_unstale":"2024-04-25T08:50:54.069304+0000","last_undegraded":"2024-04-25T08:50:54.069304+0000","last_fullsized":"2024-04-25T08:50:54.069304+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:36.635803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069292+0000","last_change":"2024-04-25T08:50:53.079935+0000","last_active":"2024-04-25T08:50:54.069292+0000","last_peered":"2024-04-25T08:50:54.069292+0000","last_clean":"2024-04-25T08:50:54.069292+0000","last_became_active":"2024-04-25T08:50:53.079628+0000","last_became_peered":"2024-04-25T08:50:53.079628+0000","last_unstale":"2024-04-25T08:50:54.069292+0000","last_undegraded":"2024-04-25T08:50:54.069292+0000","last_fullsized":"2024-04-25T08:50:54.069292+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:39.057501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068313+0000","last_change":"2024-04-25T08:50:52.071833+0000","last_active":"2024-04-25T08:50:54.068313+0000","last_peered":"2024-04-25T08:50:54.068313+0000","last_clean":"2024-04-25T08:50:54.068313+0000","last_became_active":"2024-04-25T08:50:52.071549+0000","last_became_peered":"2024-04-25T08:50:52.071549+0000","last_unstale":"2024-04-25T08:50:54.068313+0000","last_undegraded":"2024-04-25T08:50:54.068313+0000","last_fullsized":"2024-04-25T08:50:54.068313+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:38.050519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069515+0000","last_change":"2024-04-25T08:50:53.077940+0000","last_active":"2024-04-25T08:50:54.069515+0000","last_peered":"2024-04-25T08:50:54.069515+0000","last_clean":"2024-04-25T08:50:54.069515+0000","last_became_active":"2024-04-25T08:50:53.077654+0000","last_became_peered":"2024-04-25T08:50:53.077654+0000","last_unstale":"2024-04-25T08:50:54.069515+0000","last_undegraded":"2024-04-25T08:50:54.069515+0000","last_fullsized":"2024-04-25T08:50:54.069515+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:02.832327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470912+0000","last_change":"2024-04-25T08:50:52.068759+0000","last_active":"2024-04-25T08:50:54.470912+0000","last_peered":"2024-04-25T08:50:54.470912+0000","last_clean":"2024-04-25T08:50:54.470912+0000","last_became_active":"2024-04-25T08:50:52.068490+0000","last_became_peered":"2024-04-25T08:50:52.068490+0000","last_unstale":"2024-04-25T08:50:54.470912+0000","last_undegraded":"2024-04-25T08:50:54.470912+0000","last_fullsized":"2024-04-25T08:50:54.470912+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:35.638311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069405+0000","last_change":"2024-04-25T08:50:53.088958+0000","last_active":"2024-04-25T08:50:54.069405+0000","last_peered":"2024-04-25T08:50:54.069405+0000","last_clean":"2024-04-25T08:50:54.069405+0000","last_became_active":"2024-04-25T08:50:53.088700+0000","last_became_peered":"2024-04-25T08:50:53.088700+0000","last_unstale":"2024-04-25T08:50:54.069405+0000","last_undegraded":"2024-04-25T08:50:54.069405+0000","last_fullsized":"2024-04-25T08:50:54.069405+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:36.645292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069237+0000","last_change":"2024-04-25T08:50:52.065556+0000","last_active":"2024-04-25T08:50:54.069237+0000","last_peered":"2024-04-25T08:50:54.069237+0000","last_clean":"2024-04-25T08:50:54.069237+0000","last_became_active":"2024-04-25T08:50:52.065311+0000","last_became_peered":"2024-04-25T08:50:52.065311+0000","last_unstale":"2024-04-25T08:50:54.069237+0000","last_undegraded":"2024-04-25T08:50:54.069237+0000","last_fullsized":"2024-04-25T08:50:54.069237+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:20.550790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469911+0000","last_change":"2024-04-25T08:50:53.088627+0000","last_active":"2024-04-25T08:50:54.469911+0000","last_peered":"2024-04-25T08:50:54.469911+0000","last_clean":"2024-04-25T08:50:54.469911+0000","last_became_active":"2024-04-25T08:50:53.088193+0000","last_became_peered":"2024-04-25T08:50:53.088193+0000","last_unstale":"2024-04-25T08:50:54.469911+0000","last_undegraded":"2024-04-25T08:50:54.469911+0000","last_fullsized":"2024-04-25T08:50:54.469911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:17.680586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066809+0000","last_change":"2024-04-25T08:50:52.073018+0000","last_active":"2024-04-25T08:50:54.066809+0000","last_peered":"2024-04-25T08:50:54.066809+0000","last_clean":"2024-04-25T08:50:54.066809+0000","last_became_active":"2024-04-25T08:50:52.072665+0000","last_became_peered":"2024-04-25T08:50:52.072665+0000","last_unstale":"2024-04-25T08:50:54.066809+0000","last_undegraded":"2024-04-25T08:50:54.066809+0000","last_fullsized":"2024-04-25T08:50:54.066809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:32.839307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470526+0000","last_change":"2024-04-25T08:50:53.087170+0000","last_active":"2024-04-25T08:50:54.470526+0000","last_peered":"2024-04-25T08:50:54.470526+0000","last_clean":"2024-04-25T08:50:54.470526+0000","last_became_active":"2024-04-25T08:50:53.084856+0000","last_became_peered":"2024-04-25T08:50:53.084856+0000","last_unstale":"2024-04-25T08:50:54.470526+0000","last_undegraded":"2024-04-25T08:50:54.470526+0000","last_fullsized":"2024-04-25T08:50:54.470526+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:21.046097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470994+0000","last_change":"2024-04-25T08:50:52.072949+0000","last_active":"2024-04-25T08:50:54.470994+0000","last_peered":"2024-04-25T08:50:54.470994+0000","last_clean":"2024-04-25T08:50:54.470994+0000","last_became_active":"2024-04-25T08:50:52.072675+0000","last_became_peered":"2024-04-25T08:50:52.072675+0000","last_unstale":"2024-04-25T08:50:54.470994+0000","last_undegraded":"2024-04-25T08:50:54.470994+0000","last_fullsized":"2024-04-25T08:50:54.470994+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.186431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":373,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469578+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:50:54.469578+0000","last_peered":"2024-04-25T08:50:54.469578+0000","last_clean":"2024-04-25T08:50:54.469578+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:50:54.469578+0000","last_undegraded":"2024-04-25T08:50:54.469578+0000","last_fullsized":"2024-04-25T08:50:54.469578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574955,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47264,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324576,"statfs":{"total":96636764160,"available":96588365824,"internally_reserved":0,"allocated":2248704,"data_stored":1355240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50836,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321004,"statfs":{"total":96636764160,"available":96584708096,"internally_reserved":0,"allocated":1646592,"data_stored":763842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46676,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325164,"statfs":{"total":96636764160,"available":96588967936,"internally_reserved":0,"allocated":1642496,"data_stored":763192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50836,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321004,"statfs":{"total":96636764160,"available":96584708096,"internally_reserved":0,"allocated":1638400,"data_stored":763170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55004,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316836,"statfs":{"total":96636764160,"available":96580440064,"internally_reserved":0,"allocated":1654784,"data_stored":764852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50840,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321000,"statfs":{"total":96636764160,"available":96584704000,"internally_reserved":0,"allocated":1646592,"data_stored":763786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50836,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321004,"statfs":{"total":96636764160,"available":96584708096,"internally_reserved":0,"allocated":1642496,"data_stored":763240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51424,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320416,"statfs":{"total":96636764160,"available":96584105984,"internally_reserved":0,"allocated":2240512,"data_stored":1353594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:50:58.309 INFO:tasks.ceph.mds.c.smithi172.stderr:2024-04-25T08:50:58.319+0000 7faf1c99e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:51:00.394 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:51:00.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.512+0000 7f9a44cbd640 1 Processor -- start 2024-04-25T08:51:00.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.512+0000 7f9a44cbd640 1 -- start start 2024-04-25T08:51:00.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.513+0000 7f9a44cbd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a4006b580 0x7f9a400cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.513+0000 7f9a44cbd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9a400cffa0 0x7f9a4015d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.513+0000 7f9a44cbd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a40161960 con 0x7f9a4006b1a0 2024-04-25T08:51:00.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.513+0000 7f9a44cbd640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a400d0430 con 0x7f9a400cffa0 2024-04-25T08:51:00.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.513+0000 7f9a44cbd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400cbd50 con 0x7f9a4006b580 2024-04-25T08:51:00.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.513+0000 7f9a3dd9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a4006b580 0x7f9a400cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.513+0000 7f9a3ed9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9a400cffa0 0x7f9a4015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.513+0000 7f9a3dd9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a4006b580 0x7f9a400cfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:40816/0 (socket says 172.21.15.172:40816) 2024-04-25T08:51:00.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.513+0000 7f9a3dd9b640 1 -- 172.21.15.172:0/1854474983 learned_addr learned my addr 172.21.15.172:0/1854474983 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:00.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.514+0000 7f9a3ed9d640 1 -- 172.21.15.172:0/1854474983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a4006b580 msgr2=0x7f9a400cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:00.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.514+0000 7f9a3ed9d640 1 --2- 172.21.15.172:0/1854474983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a4006b580 0x7f9a400cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.514+0000 7f9a3ed9d640 1 -- 172.21.15.172:0/1854474983 >> v1:172.21.15.186:6789/0 conn(0x7f9a4006b1a0 legacy=0x7f9a4006f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:00.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.514+0000 7f9a3ed9d640 1 -- 172.21.15.172:0/1854474983 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40161c40 con 0x7f9a400cffa0 2024-04-25T08:51:00.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.514+0000 7f9a3dd9b640 1 --2- 172.21.15.172:0/1854474983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a4006b580 0x7f9a400cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:00.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a3ed9d640 1 --2- 172.21.15.172:0/1854474983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a400cffa0 0x7f9a4015d370 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009d90 tx=0x7f9a3802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a8792ef8b6371c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:00.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a3d59a640 1 -- 172.21.15.172:0/1854474983 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38031600 con 0x7f9a400cffa0 2024-04-25T08:51:00.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a3d59a640 1 -- 172.21.15.172:0/1854474983 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a380317a0 con 0x7f9a400cffa0 2024-04-25T08:51:00.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a3d59a640 1 -- 172.21.15.172:0/1854474983 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38031b70 con 0x7f9a400cffa0 2024-04-25T08:51:00.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a44cbd640 1 -- 172.21.15.172:0/1854474983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a400cffa0 msgr2=0x7f9a4015d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:00.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a44cbd640 1 --2- 172.21.15.172:0/1854474983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a400cffa0 0x7f9a4015d370 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009d90 tx=0x7f9a3802a5d0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a44cbd640 1 -- 172.21.15.172:0/1854474983 shutdown_connections 2024-04-25T08:51:00.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a44cbd640 1 --2- 172.21.15.172:0/1854474983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a4006b580 0x7f9a400cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a44cbd640 1 --2- 172.21.15.172:0/1854474983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a400cffa0 0x7f9a4015d370 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a44cbd640 1 -- 172.21.15.172:0/1854474983 >> 172.21.15.172:0/1854474983 conn(0x7f9a400b2220 msgr2=0x7f9a400b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:00.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a44cbd640 1 -- 172.21.15.172:0/1854474983 shutdown_connections 2024-04-25T08:51:00.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.515+0000 7f9a44cbd640 1 -- 172.21.15.172:0/1854474983 wait complete. 2024-04-25T08:51:00.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.517+0000 7f9a44cbd640 1 Processor -- start 2024-04-25T08:51:00.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.517+0000 7f9a44cbd640 1 -- start start 2024-04-25T08:51:00.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a44cbd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a4006b1a0 0x7f9a4015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a44cbd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a4006b580 0x7f9a401e76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a44cbd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a400cffa0 0x7f9a400c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a44cbd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40162200 con 0x7f9a4006b580 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a44cbd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400700d0 con 0x7f9a4006b1a0 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a44cbd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40162720 con 0x7f9a400cffa0 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3dd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a4006b580 0x7f9a401e76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3dd9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a4006b580 0x7f9a401e76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60106/0 (socket says 172.21.15.172:60106) 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3dd9b640 1 -- 172.21.15.172:0/3122160466 learned_addr learned my addr 172.21.15.172:0/3122160466 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3e59c640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a4006b1a0 0x7f9a4015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3ed9d640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a400cffa0 0x7f9a400c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3dd9b640 1 -- 172.21.15.172:0/3122160466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a400cffa0 msgr2=0x7f9a400c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3dd9b640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a400cffa0 0x7f9a400c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3dd9b640 1 -- 172.21.15.172:0/3122160466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a4006b1a0 msgr2=0x7f9a4015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3dd9b640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a4006b1a0 0x7f9a4015f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3dd9b640 1 -- 172.21.15.172:0/3122160466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a401e80f0 con 0x7f9a4006b580 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3e59c640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a4006b1a0 0x7f9a4015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a3dd9b640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a4006b580 0x7f9a401e76e0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400e9d0 tx=0x7f9a3400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:00.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a2effd640 1 -- 172.21.15.172:0/3122160466 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a34017070 con 0x7f9a4006b580 2024-04-25T08:51:00.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a2effd640 1 -- 172.21.15.172:0/3122160466 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3400ca60 con 0x7f9a4006b580 2024-04-25T08:51:00.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a44cbd640 1 -- 172.21.15.172:0/3122160466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a401e83d0 con 0x7f9a4006b580 2024-04-25T08:51:00.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.518+0000 7f9a2effd640 1 -- 172.21.15.172:0/3122160466 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400ce10 con 0x7f9a4006b580 2024-04-25T08:51:00.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.519+0000 7f9a44cbd640 1 -- 172.21.15.172:0/3122160466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a400b50d0 con 0x7f9a4006b580 2024-04-25T08:51:00.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.520+0000 7f9a44cbd640 1 -- 172.21.15.172:0/3122160466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a40073990 con 0x7f9a4006b580 2024-04-25T08:51:00.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.520+0000 7f9a2effd640 1 -- 172.21.15.172:0/3122160466 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9a3401a070 con 0x7f9a4006b580 2024-04-25T08:51:00.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.521+0000 7f9a2effd640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a2006b4d0 0x7f9a2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.521+0000 7f9a3e59c640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a2006b4d0 0x7f9a2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.521+0000 7f9a2effd640 1 -- 172.21.15.172:0/3122160466 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9a3408a630 con 0x7f9a4006b580 2024-04-25T08:51:00.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.521+0000 7f9a3e59c640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a2006b4d0 0x7f9a2006d990 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9a30001ad0 tx=0x7f9a30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:00.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.525+0000 7f9a2effd640 1 -- 172.21.15.172:0/3122160466 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9a34058c40 con 0x7f9a4006b580 2024-04-25T08:51:00.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.694+0000 7f9a44cbd640 1 -- 172.21.15.172:0/3122160466 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a400cc1b0 con 0x7f9a2006b4d0 2024-04-25T08:51:00.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.700+0000 7f9a2effd640 1 -- 172.21.15.172:0/3122160466 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252462 (secure 0 0 0) 0x7f9a400cc1b0 con 0x7f9a2006b4d0 2024-04-25T08:51:00.693 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:00.694 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:51:00.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 -- 172.21.15.172:0/3122160466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a2006b4d0 msgr2=0x7f9a2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a2006b4d0 0x7f9a2006d990 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9a30001ad0 tx=0x7f9a30009040 comp rx=0 tx=0).stop 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 -- 172.21.15.172:0/3122160466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a4006b580 msgr2=0x7f9a401e76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a4006b580 0x7f9a401e76e0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400e9d0 tx=0x7f9a3400ee90 comp rx=0 tx=0).stop 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 -- 172.21.15.172:0/3122160466 shutdown_connections 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9a2006b4d0 0x7f9a2006d990 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9a400cffa0 0x7f9a400c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a4006b580 0x7f9a401e76e0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 --2- 172.21.15.172:0/3122160466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9a4006b1a0 0x7f9a4015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 -- 172.21.15.172:0/3122160466 >> 172.21.15.172:0/3122160466 conn(0x7f9a400b2220 msgr2=0x7f9a400d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 -- 172.21.15.172:0/3122160466 shutdown_connections 2024-04-25T08:51:00.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.703+0000 7f9a44cbd640 1 -- 172.21.15.172:0/3122160466 wait complete. 2024-04-25T08:51:00.705 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":386,"stamp":"2024-04-25T08:51:00.617250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":403716,"kb_used_data":14024,"kb_used_omap":12,"kb_used_meta":389555,"kb_avail":754571004,"statfs":{"total":773094113280,"available":772680708096,"internally_reserved":0,"allocated":14360576,"data_stored":7290916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":398904880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001744"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469575+0000","last_change":"2024-04-25T08:50:53.079918+0000","last_active":"2024-04-25T08:50:54.469575+0000","last_peered":"2024-04-25T08:50:54.469575+0000","last_clean":"2024-04-25T08:50:54.469575+0000","last_became_active":"2024-04-25T08:50:53.079605+0000","last_became_peered":"2024-04-25T08:50:53.079605+0000","last_unstale":"2024-04-25T08:50:54.469575+0000","last_undegraded":"2024-04-25T08:50:54.469575+0000","last_fullsized":"2024-04-25T08:50:54.469575+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:10.602356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068377+0000","last_change":"2024-04-25T08:50:53.072183+0000","last_active":"2024-04-25T08:50:54.068377+0000","last_peered":"2024-04-25T08:50:54.068377+0000","last_clean":"2024-04-25T08:50:54.068377+0000","last_became_active":"2024-04-25T08:50:53.071896+0000","last_became_peered":"2024-04-25T08:50:53.071896+0000","last_unstale":"2024-04-25T08:50:54.068377+0000","last_undegraded":"2024-04-25T08:50:54.068377+0000","last_fullsized":"2024-04-25T08:50:54.068377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:18.118317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470487+0000","last_change":"2024-04-25T08:50:53.087301+0000","last_active":"2024-04-25T08:50:54.470487+0000","last_peered":"2024-04-25T08:50:54.470487+0000","last_clean":"2024-04-25T08:50:54.470487+0000","last_became_active":"2024-04-25T08:50:53.085252+0000","last_became_peered":"2024-04-25T08:50:53.085252+0000","last_unstale":"2024-04-25T08:50:54.470487+0000","last_undegraded":"2024-04-25T08:50:54.470487+0000","last_fullsized":"2024-04-25T08:50:54.470487+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:53.509352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068093+0000","last_change":"2024-04-25T08:50:53.074561+0000","last_active":"2024-04-25T08:50:54.068093+0000","last_peered":"2024-04-25T08:50:54.068093+0000","last_clean":"2024-04-25T08:50:54.068093+0000","last_became_active":"2024-04-25T08:50:53.074314+0000","last_became_peered":"2024-04-25T08:50:53.074314+0000","last_unstale":"2024-04-25T08:50:54.068093+0000","last_undegraded":"2024-04-25T08:50:54.068093+0000","last_fullsized":"2024-04-25T08:50:54.068093+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:32.525096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066876+0000","last_change":"2024-04-25T08:50:53.084312+0000","last_active":"2024-04-25T08:50:54.066876+0000","last_peered":"2024-04-25T08:50:54.066876+0000","last_clean":"2024-04-25T08:50:54.066876+0000","last_became_active":"2024-04-25T08:50:53.083920+0000","last_became_peered":"2024-04-25T08:50:53.083920+0000","last_unstale":"2024-04-25T08:50:54.066876+0000","last_undegraded":"2024-04-25T08:50:54.066876+0000","last_fullsized":"2024-04-25T08:50:54.066876+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:00.482961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069261+0000","last_change":"2024-04-25T08:50:53.084844+0000","last_active":"2024-04-25T08:50:54.069261+0000","last_peered":"2024-04-25T08:50:54.069261+0000","last_clean":"2024-04-25T08:50:54.069261+0000","last_became_active":"2024-04-25T08:50:53.084571+0000","last_became_peered":"2024-04-25T08:50:53.084571+0000","last_unstale":"2024-04-25T08:50:54.069261+0000","last_undegraded":"2024-04-25T08:50:54.069261+0000","last_fullsized":"2024-04-25T08:50:54.069261+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:53.018608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470363+0000","last_change":"2024-04-25T08:50:53.090173+0000","last_active":"2024-04-25T08:50:54.470363+0000","last_peered":"2024-04-25T08:50:54.470363+0000","last_clean":"2024-04-25T08:50:54.470363+0000","last_became_active":"2024-04-25T08:50:53.089652+0000","last_became_peered":"2024-04-25T08:50:53.089652+0000","last_unstale":"2024-04-25T08:50:54.470363+0000","last_undegraded":"2024-04-25T08:50:54.470363+0000","last_fullsized":"2024-04-25T08:50:54.470363+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:36.397565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067667+0000","last_change":"2024-04-25T08:50:53.079125+0000","last_active":"2024-04-25T08:50:54.067667+0000","last_peered":"2024-04-25T08:50:54.067667+0000","last_clean":"2024-04-25T08:50:54.067667+0000","last_became_active":"2024-04-25T08:50:53.078809+0000","last_became_peered":"2024-04-25T08:50:53.078809+0000","last_unstale":"2024-04-25T08:50:54.067667+0000","last_undegraded":"2024-04-25T08:50:54.067667+0000","last_fullsized":"2024-04-25T08:50:54.067667+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:32.337285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069570+0000","last_change":"2024-04-25T08:50:53.077944+0000","last_active":"2024-04-25T08:50:54.069570+0000","last_peered":"2024-04-25T08:50:54.069570+0000","last_clean":"2024-04-25T08:50:54.069570+0000","last_became_active":"2024-04-25T08:50:53.077675+0000","last_became_peered":"2024-04-25T08:50:53.077675+0000","last_unstale":"2024-04-25T08:50:54.069570+0000","last_undegraded":"2024-04-25T08:50:54.069570+0000","last_fullsized":"2024-04-25T08:50:54.069570+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:40.951897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469008+0000","last_change":"2024-04-25T08:50:53.070740+0000","last_active":"2024-04-25T08:50:54.469008+0000","last_peered":"2024-04-25T08:50:54.469008+0000","last_clean":"2024-04-25T08:50:54.469008+0000","last_became_active":"2024-04-25T08:50:53.070363+0000","last_became_peered":"2024-04-25T08:50:53.070363+0000","last_unstale":"2024-04-25T08:50:54.469008+0000","last_undegraded":"2024-04-25T08:50:54.469008+0000","last_fullsized":"2024-04-25T08:50:54.469008+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:30.541711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067990+0000","last_change":"2024-04-25T08:50:53.088059+0000","last_active":"2024-04-25T08:50:54.067990+0000","last_peered":"2024-04-25T08:50:54.067990+0000","last_clean":"2024-04-25T08:50:54.067990+0000","last_became_active":"2024-04-25T08:50:53.087739+0000","last_became_peered":"2024-04-25T08:50:53.087739+0000","last_unstale":"2024-04-25T08:50:54.067990+0000","last_undegraded":"2024-04-25T08:50:54.067990+0000","last_fullsized":"2024-04-25T08:50:54.067990+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:04.060403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469757+0000","last_change":"2024-04-25T08:50:53.085824+0000","last_active":"2024-04-25T08:50:54.469757+0000","last_peered":"2024-04-25T08:50:54.469757+0000","last_clean":"2024-04-25T08:50:54.469757+0000","last_became_active":"2024-04-25T08:50:53.085516+0000","last_became_peered":"2024-04-25T08:50:53.085516+0000","last_unstale":"2024-04-25T08:50:54.469757+0000","last_undegraded":"2024-04-25T08:50:54.469757+0000","last_fullsized":"2024-04-25T08:50:54.469757+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:31.600069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069420+0000","last_change":"2024-04-25T08:50:53.087461+0000","last_active":"2024-04-25T08:50:54.069420+0000","last_peered":"2024-04-25T08:50:54.069420+0000","last_clean":"2024-04-25T08:50:54.069420+0000","last_became_active":"2024-04-25T08:50:53.087120+0000","last_became_peered":"2024-04-25T08:50:53.087120+0000","last_unstale":"2024-04-25T08:50:54.069420+0000","last_undegraded":"2024-04-25T08:50:54.069420+0000","last_fullsized":"2024-04-25T08:50:54.069420+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:44.193413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469194+0000","last_change":"2024-04-25T08:50:53.086642+0000","last_active":"2024-04-25T08:50:54.469194+0000","last_peered":"2024-04-25T08:50:54.469194+0000","last_clean":"2024-04-25T08:50:54.469194+0000","last_became_active":"2024-04-25T08:50:53.086349+0000","last_became_peered":"2024-04-25T08:50:53.086349+0000","last_unstale":"2024-04-25T08:50:54.469194+0000","last_undegraded":"2024-04-25T08:50:54.469194+0000","last_fullsized":"2024-04-25T08:50:54.469194+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:03.596107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468809+0000","last_change":"2024-04-25T08:50:53.078706+0000","last_active":"2024-04-25T08:50:54.468809+0000","last_peered":"2024-04-25T08:50:54.468809+0000","last_clean":"2024-04-25T08:50:54.468809+0000","last_became_active":"2024-04-25T08:50:53.078450+0000","last_became_peered":"2024-04-25T08:50:53.078450+0000","last_unstale":"2024-04-25T08:50:54.468809+0000","last_undegraded":"2024-04-25T08:50:54.468809+0000","last_fullsized":"2024-04-25T08:50:54.468809+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:37.614131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069113+0000","last_change":"2024-04-25T08:50:53.086219+0000","last_active":"2024-04-25T08:50:54.069113+0000","last_peered":"2024-04-25T08:50:54.069113+0000","last_clean":"2024-04-25T08:50:54.069113+0000","last_became_active":"2024-04-25T08:50:53.085360+0000","last_became_peered":"2024-04-25T08:50:53.085360+0000","last_unstale":"2024-04-25T08:50:54.069113+0000","last_undegraded":"2024-04-25T08:50:54.069113+0000","last_fullsized":"2024-04-25T08:50:54.069113+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:38.702830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069655+0000","last_change":"2024-04-25T08:50:53.086008+0000","last_active":"2024-04-25T08:50:54.069655+0000","last_peered":"2024-04-25T08:50:54.069655+0000","last_clean":"2024-04-25T08:50:54.069655+0000","last_became_active":"2024-04-25T08:50:53.085716+0000","last_became_peered":"2024-04-25T08:50:53.085716+0000","last_unstale":"2024-04-25T08:50:54.069655+0000","last_undegraded":"2024-04-25T08:50:54.069655+0000","last_fullsized":"2024-04-25T08:50:54.069655+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:16.590510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067250+0000","last_change":"2024-04-25T08:50:53.084748+0000","last_active":"2024-04-25T08:50:54.067250+0000","last_peered":"2024-04-25T08:50:54.067250+0000","last_clean":"2024-04-25T08:50:54.067250+0000","last_became_active":"2024-04-25T08:50:53.084508+0000","last_became_peered":"2024-04-25T08:50:53.084508+0000","last_unstale":"2024-04-25T08:50:54.067250+0000","last_undegraded":"2024-04-25T08:50:54.067250+0000","last_fullsized":"2024-04-25T08:50:54.067250+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:09.670917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469872+0000","last_change":"2024-04-25T08:50:53.086747+0000","last_active":"2024-04-25T08:50:54.469872+0000","last_peered":"2024-04-25T08:50:54.469872+0000","last_clean":"2024-04-25T08:50:54.469872+0000","last_became_active":"2024-04-25T08:50:53.086345+0000","last_became_peered":"2024-04-25T08:50:53.086345+0000","last_unstale":"2024-04-25T08:50:54.469872+0000","last_undegraded":"2024-04-25T08:50:54.469872+0000","last_fullsized":"2024-04-25T08:50:54.469872+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:18.118317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066973+0000","last_change":"2024-04-25T08:50:53.084017+0000","last_active":"2024-04-25T08:50:54.066973+0000","last_peered":"2024-04-25T08:50:54.066973+0000","last_clean":"2024-04-25T08:50:54.066973+0000","last_became_active":"2024-04-25T08:50:53.083743+0000","last_became_peered":"2024-04-25T08:50:53.083743+0000","last_unstale":"2024-04-25T08:50:54.066973+0000","last_undegraded":"2024-04-25T08:50:54.066973+0000","last_fullsized":"2024-04-25T08:50:54.066973+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:15.343168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068205+0000","last_change":"2024-04-25T08:50:53.080696+0000","last_active":"2024-04-25T08:50:54.068205+0000","last_peered":"2024-04-25T08:50:54.068205+0000","last_clean":"2024-04-25T08:50:54.068205+0000","last_became_active":"2024-04-25T08:50:53.080401+0000","last_became_peered":"2024-04-25T08:50:53.080401+0000","last_unstale":"2024-04-25T08:50:54.068205+0000","last_undegraded":"2024-04-25T08:50:54.068205+0000","last_fullsized":"2024-04-25T08:50:54.068205+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:13.119096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469058+0000","last_change":"2024-04-25T08:50:53.080383+0000","last_active":"2024-04-25T08:50:54.469058+0000","last_peered":"2024-04-25T08:50:54.469058+0000","last_clean":"2024-04-25T08:50:54.469058+0000","last_became_active":"2024-04-25T08:50:53.080126+0000","last_became_peered":"2024-04-25T08:50:53.080126+0000","last_unstale":"2024-04-25T08:50:54.469058+0000","last_undegraded":"2024-04-25T08:50:54.469058+0000","last_fullsized":"2024-04-25T08:50:54.469058+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:44.633235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067733+0000","last_change":"2024-04-25T08:50:53.081657+0000","last_active":"2024-04-25T08:50:54.067733+0000","last_peered":"2024-04-25T08:50:54.067733+0000","last_clean":"2024-04-25T08:50:54.067733+0000","last_became_active":"2024-04-25T08:50:53.081333+0000","last_became_peered":"2024-04-25T08:50:53.081333+0000","last_unstale":"2024-04-25T08:50:54.067733+0000","last_undegraded":"2024-04-25T08:50:54.067733+0000","last_fullsized":"2024-04-25T08:50:54.067733+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:55:28.341343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069145+0000","last_change":"2024-04-25T08:50:53.078522+0000","last_active":"2024-04-25T08:50:54.069145+0000","last_peered":"2024-04-25T08:50:54.069145+0000","last_clean":"2024-04-25T08:50:54.069145+0000","last_became_active":"2024-04-25T08:50:53.078262+0000","last_became_peered":"2024-04-25T08:50:53.078262+0000","last_unstale":"2024-04-25T08:50:54.069145+0000","last_undegraded":"2024-04-25T08:50:54.069145+0000","last_fullsized":"2024-04-25T08:50:54.069145+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:42.645564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470410+0000","last_change":"2024-04-25T08:50:53.082712+0000","last_active":"2024-04-25T08:50:54.470410+0000","last_peered":"2024-04-25T08:50:54.470410+0000","last_clean":"2024-04-25T08:50:54.470410+0000","last_became_active":"2024-04-25T08:50:53.082440+0000","last_became_peered":"2024-04-25T08:50:53.082440+0000","last_unstale":"2024-04-25T08:50:54.470410+0000","last_undegraded":"2024-04-25T08:50:54.470410+0000","last_fullsized":"2024-04-25T08:50:54.470410+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:36.880421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470310+0000","last_change":"2024-04-25T08:50:53.088970+0000","last_active":"2024-04-25T08:50:54.470310+0000","last_peered":"2024-04-25T08:50:54.470310+0000","last_clean":"2024-04-25T08:50:54.470310+0000","last_became_active":"2024-04-25T08:50:53.088691+0000","last_became_peered":"2024-04-25T08:50:53.088691+0000","last_unstale":"2024-04-25T08:50:54.470310+0000","last_undegraded":"2024-04-25T08:50:54.470310+0000","last_fullsized":"2024-04-25T08:50:54.470310+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470005+0000","last_change":"2024-04-25T08:50:53.084874+0000","last_active":"2024-04-25T08:50:54.470005+0000","last_peered":"2024-04-25T08:50:54.470005+0000","last_clean":"2024-04-25T08:50:54.470005+0000","last_became_active":"2024-04-25T08:50:53.084611+0000","last_became_peered":"2024-04-25T08:50:53.084611+0000","last_unstale":"2024-04-25T08:50:54.470005+0000","last_undegraded":"2024-04-25T08:50:54.470005+0000","last_fullsized":"2024-04-25T08:50:54.470005+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:53.406838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469585+0000","last_change":"2024-04-25T08:50:53.071597+0000","last_active":"2024-04-25T08:50:54.469585+0000","last_peered":"2024-04-25T08:50:54.469585+0000","last_clean":"2024-04-25T08:50:54.469585+0000","last_became_active":"2024-04-25T08:50:53.070933+0000","last_became_peered":"2024-04-25T08:50:53.070933+0000","last_unstale":"2024-04-25T08:50:54.469585+0000","last_undegraded":"2024-04-25T08:50:54.469585+0000","last_fullsized":"2024-04-25T08:50:54.469585+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:16.779331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470052+0000","last_change":"2024-04-25T08:50:53.084317+0000","last_active":"2024-04-25T08:50:54.470052+0000","last_peered":"2024-04-25T08:50:54.470052+0000","last_clean":"2024-04-25T08:50:54.470052+0000","last_became_active":"2024-04-25T08:50:53.084030+0000","last_became_peered":"2024-04-25T08:50:53.084030+0000","last_unstale":"2024-04-25T08:50:54.470052+0000","last_undegraded":"2024-04-25T08:50:54.470052+0000","last_fullsized":"2024-04-25T08:50:54.470052+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:10.766542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470372+0000","last_change":"2024-04-25T08:50:53.084302+0000","last_active":"2024-04-25T08:50:54.470372+0000","last_peered":"2024-04-25T08:50:54.470372+0000","last_clean":"2024-04-25T08:50:54.470372+0000","last_became_active":"2024-04-25T08:50:53.083105+0000","last_became_peered":"2024-04-25T08:50:53.083105+0000","last_unstale":"2024-04-25T08:50:54.470372+0000","last_undegraded":"2024-04-25T08:50:54.470372+0000","last_fullsized":"2024-04-25T08:50:54.470372+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:46.377293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068018+0000","last_change":"2024-04-25T08:50:53.075476+0000","last_active":"2024-04-25T08:50:54.068018+0000","last_peered":"2024-04-25T08:50:54.068018+0000","last_clean":"2024-04-25T08:50:54.068018+0000","last_became_active":"2024-04-25T08:50:53.075196+0000","last_became_peered":"2024-04-25T08:50:53.075196+0000","last_unstale":"2024-04-25T08:50:54.068018+0000","last_undegraded":"2024-04-25T08:50:54.068018+0000","last_fullsized":"2024-04-25T08:50:54.068018+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:10.766542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468862+0000","last_change":"2024-04-25T08:50:53.079083+0000","last_active":"2024-04-25T08:50:54.468862+0000","last_peered":"2024-04-25T08:50:54.468862+0000","last_clean":"2024-04-25T08:50:54.468862+0000","last_became_active":"2024-04-25T08:50:53.078821+0000","last_became_peered":"2024-04-25T08:50:53.078821+0000","last_unstale":"2024-04-25T08:50:54.468862+0000","last_undegraded":"2024-04-25T08:50:54.468862+0000","last_fullsized":"2024-04-25T08:50:54.468862+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:52.512655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067814+0000","last_change":"2024-04-25T08:50:53.079742+0000","last_active":"2024-04-25T08:50:54.067814+0000","last_peered":"2024-04-25T08:50:54.067814+0000","last_clean":"2024-04-25T08:50:54.067814+0000","last_became_active":"2024-04-25T08:50:53.079456+0000","last_became_peered":"2024-04-25T08:50:53.079456+0000","last_unstale":"2024-04-25T08:50:54.067814+0000","last_undegraded":"2024-04-25T08:50:54.067814+0000","last_fullsized":"2024-04-25T08:50:54.067814+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:34.414227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"130'4","reported_seq":18,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470374+0000","last_change":"2024-04-25T08:50:52.073377+0000","last_active":"2024-04-25T08:50:54.470374+0000","last_peered":"2024-04-25T08:50:54.470374+0000","last_clean":"2024-04-25T08:50:54.470374+0000","last_became_active":"2024-04-25T08:50:52.073069+0000","last_became_peered":"2024-04-25T08:50:52.073069+0000","last_unstale":"2024-04-25T08:50:54.470374+0000","last_undegraded":"2024-04-25T08:50:54.470374+0000","last_fullsized":"2024-04-25T08:50:54.470374+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:14.817429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468866+0000","last_change":"2024-04-25T08:50:53.080474+0000","last_active":"2024-04-25T08:50:54.468866+0000","last_peered":"2024-04-25T08:50:54.468866+0000","last_clean":"2024-04-25T08:50:54.468866+0000","last_became_active":"2024-04-25T08:50:53.080207+0000","last_became_peered":"2024-04-25T08:50:53.080207+0000","last_unstale":"2024-04-25T08:50:54.468866+0000","last_undegraded":"2024-04-25T08:50:54.468866+0000","last_fullsized":"2024-04-25T08:50:54.468866+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:42.606841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067371+0000","last_change":"2024-04-25T08:50:52.064916+0000","last_active":"2024-04-25T08:50:54.067371+0000","last_peered":"2024-04-25T08:50:54.067371+0000","last_clean":"2024-04-25T08:50:54.067371+0000","last_became_active":"2024-04-25T08:50:52.064537+0000","last_became_peered":"2024-04-25T08:50:52.064537+0000","last_unstale":"2024-04-25T08:50:54.067371+0000","last_undegraded":"2024-04-25T08:50:54.067371+0000","last_fullsized":"2024-04-25T08:50:54.067371+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:54.410546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068148+0000","last_change":"2024-04-25T08:50:53.076011+0000","last_active":"2024-04-25T08:50:54.068148+0000","last_peered":"2024-04-25T08:50:54.068148+0000","last_clean":"2024-04-25T08:50:54.068148+0000","last_became_active":"2024-04-25T08:50:53.075150+0000","last_became_peered":"2024-04-25T08:50:53.075150+0000","last_unstale":"2024-04-25T08:50:54.068148+0000","last_undegraded":"2024-04-25T08:50:54.068148+0000","last_fullsized":"2024-04-25T08:50:54.068148+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:36.880693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469941+0000","last_change":"2024-04-25T08:50:52.069970+0000","last_active":"2024-04-25T08:50:54.469941+0000","last_peered":"2024-04-25T08:50:54.469941+0000","last_clean":"2024-04-25T08:50:54.469941+0000","last_became_active":"2024-04-25T08:50:52.069701+0000","last_became_peered":"2024-04-25T08:50:52.069701+0000","last_unstale":"2024-04-25T08:50:54.469941+0000","last_undegraded":"2024-04-25T08:50:54.469941+0000","last_fullsized":"2024-04-25T08:50:54.469941+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:01.825346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469838+0000","last_change":"2024-04-25T08:50:53.081000+0000","last_active":"2024-04-25T08:50:54.469838+0000","last_peered":"2024-04-25T08:50:54.469838+0000","last_clean":"2024-04-25T08:50:54.469838+0000","last_became_active":"2024-04-25T08:50:53.080742+0000","last_became_peered":"2024-04-25T08:50:53.080742+0000","last_unstale":"2024-04-25T08:50:54.469838+0000","last_undegraded":"2024-04-25T08:50:54.469838+0000","last_fullsized":"2024-04-25T08:50:54.469838+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:00.535216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469878+0000","last_change":"2024-04-25T08:50:52.070258+0000","last_active":"2024-04-25T08:50:54.469878+0000","last_peered":"2024-04-25T08:50:54.469878+0000","last_clean":"2024-04-25T08:50:54.469878+0000","last_became_active":"2024-04-25T08:50:52.069955+0000","last_became_peered":"2024-04-25T08:50:52.069955+0000","last_unstale":"2024-04-25T08:50:54.469878+0000","last_undegraded":"2024-04-25T08:50:54.469878+0000","last_fullsized":"2024-04-25T08:50:54.469878+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:40.708876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069116+0000","last_change":"2024-04-25T08:50:53.081636+0000","last_active":"2024-04-25T08:50:54.069116+0000","last_peered":"2024-04-25T08:50:54.069116+0000","last_clean":"2024-04-25T08:50:54.069116+0000","last_became_active":"2024-04-25T08:50:53.081335+0000","last_became_peered":"2024-04-25T08:50:53.081335+0000","last_unstale":"2024-04-25T08:50:54.069116+0000","last_undegraded":"2024-04-25T08:50:54.069116+0000","last_fullsized":"2024-04-25T08:50:54.069116+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:13.985914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068868+0000","last_change":"2024-04-25T08:50:52.069178+0000","last_active":"2024-04-25T08:50:54.068868+0000","last_peered":"2024-04-25T08:50:54.068868+0000","last_clean":"2024-04-25T08:50:54.068868+0000","last_became_active":"2024-04-25T08:50:52.068838+0000","last_became_peered":"2024-04-25T08:50:52.068838+0000","last_unstale":"2024-04-25T08:50:54.068868+0000","last_undegraded":"2024-04-25T08:50:54.068868+0000","last_fullsized":"2024-04-25T08:50:54.068868+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:48.445469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069301+0000","last_change":"2024-04-25T08:50:53.070680+0000","last_active":"2024-04-25T08:50:54.069301+0000","last_peered":"2024-04-25T08:50:54.069301+0000","last_clean":"2024-04-25T08:50:54.069301+0000","last_became_active":"2024-04-25T08:50:53.070359+0000","last_became_peered":"2024-04-25T08:50:53.070359+0000","last_unstale":"2024-04-25T08:50:54.069301+0000","last_undegraded":"2024-04-25T08:50:54.069301+0000","last_fullsized":"2024-04-25T08:50:54.069301+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:32.655527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066726+0000","last_change":"2024-04-25T08:50:52.063253+0000","last_active":"2024-04-25T08:50:54.066726+0000","last_peered":"2024-04-25T08:50:54.066726+0000","last_clean":"2024-04-25T08:50:54.066726+0000","last_became_active":"2024-04-25T08:50:52.062924+0000","last_became_peered":"2024-04-25T08:50:52.062924+0000","last_unstale":"2024-04-25T08:50:54.066726+0000","last_undegraded":"2024-04-25T08:50:54.066726+0000","last_fullsized":"2024-04-25T08:50:54.066726+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:09:33.545213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067275+0000","last_change":"2024-04-25T08:50:53.095475+0000","last_active":"2024-04-25T08:50:54.067275+0000","last_peered":"2024-04-25T08:50:54.067275+0000","last_clean":"2024-04-25T08:50:54.067275+0000","last_became_active":"2024-04-25T08:50:53.095194+0000","last_became_peered":"2024-04-25T08:50:53.095194+0000","last_unstale":"2024-04-25T08:50:54.067275+0000","last_undegraded":"2024-04-25T08:50:54.067275+0000","last_fullsized":"2024-04-25T08:50:54.067275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:25.919760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069116+0000","last_change":"2024-04-25T08:50:52.059513+0000","last_active":"2024-04-25T08:50:54.069116+0000","last_peered":"2024-04-25T08:50:54.069116+0000","last_clean":"2024-04-25T08:50:54.069116+0000","last_became_active":"2024-04-25T08:50:52.059249+0000","last_became_peered":"2024-04-25T08:50:52.059249+0000","last_unstale":"2024-04-25T08:50:54.069116+0000","last_undegraded":"2024-04-25T08:50:54.069116+0000","last_fullsized":"2024-04-25T08:50:54.069116+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:41.029120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470128+0000","last_change":"2024-04-25T08:50:53.080901+0000","last_active":"2024-04-25T08:50:54.470128+0000","last_peered":"2024-04-25T08:50:54.470128+0000","last_clean":"2024-04-25T08:50:54.470128+0000","last_became_active":"2024-04-25T08:50:53.080631+0000","last_became_peered":"2024-04-25T08:50:53.080631+0000","last_unstale":"2024-04-25T08:50:54.470128+0000","last_undegraded":"2024-04-25T08:50:54.470128+0000","last_fullsized":"2024-04-25T08:50:54.470128+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:00.482961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469723+0000","last_change":"2024-04-25T08:50:52.068577+0000","last_active":"2024-04-25T08:50:54.469723+0000","last_peered":"2024-04-25T08:50:54.469723+0000","last_clean":"2024-04-25T08:50:54.469723+0000","last_became_active":"2024-04-25T08:50:52.068271+0000","last_became_peered":"2024-04-25T08:50:52.068271+0000","last_unstale":"2024-04-25T08:50:54.469723+0000","last_undegraded":"2024-04-25T08:50:54.469723+0000","last_fullsized":"2024-04-25T08:50:54.469723+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:23.439699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.468801+0000","last_change":"2024-04-25T08:50:53.084115+0000","last_active":"2024-04-25T08:50:54.468801+0000","last_peered":"2024-04-25T08:50:54.468801+0000","last_clean":"2024-04-25T08:50:54.468801+0000","last_became_active":"2024-04-25T08:50:53.083827+0000","last_became_peered":"2024-04-25T08:50:53.083827+0000","last_unstale":"2024-04-25T08:50:54.468801+0000","last_undegraded":"2024-04-25T08:50:54.468801+0000","last_fullsized":"2024-04-25T08:50:54.468801+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:45.145846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068695+0000","last_change":"2024-04-25T08:50:52.067710+0000","last_active":"2024-04-25T08:50:54.068695+0000","last_peered":"2024-04-25T08:50:54.068695+0000","last_clean":"2024-04-25T08:50:54.068695+0000","last_became_active":"2024-04-25T08:50:52.067279+0000","last_became_peered":"2024-04-25T08:50:52.067279+0000","last_unstale":"2024-04-25T08:50:54.068695+0000","last_undegraded":"2024-04-25T08:50:54.068695+0000","last_fullsized":"2024-04-25T08:50:54.068695+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:35.638311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069275+0000","last_change":"2024-04-25T08:50:53.075292+0000","last_active":"2024-04-25T08:50:54.069275+0000","last_peered":"2024-04-25T08:50:54.069275+0000","last_clean":"2024-04-25T08:50:54.069275+0000","last_became_active":"2024-04-25T08:50:53.075034+0000","last_became_peered":"2024-04-25T08:50:53.075034+0000","last_unstale":"2024-04-25T08:50:54.069275+0000","last_undegraded":"2024-04-25T08:50:54.069275+0000","last_fullsized":"2024-04-25T08:50:54.069275+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:41.715857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469432+0000","last_change":"2024-04-25T08:50:52.068258+0000","last_active":"2024-04-25T08:50:54.469432+0000","last_peered":"2024-04-25T08:50:54.469432+0000","last_clean":"2024-04-25T08:50:54.469432+0000","last_became_active":"2024-04-25T08:50:52.067978+0000","last_became_peered":"2024-04-25T08:50:52.067978+0000","last_unstale":"2024-04-25T08:50:54.469432+0000","last_undegraded":"2024-04-25T08:50:54.469432+0000","last_fullsized":"2024-04-25T08:50:54.469432+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:18.966728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470325+0000","last_change":"2024-04-25T08:50:53.084303+0000","last_active":"2024-04-25T08:50:54.470325+0000","last_peered":"2024-04-25T08:50:54.470325+0000","last_clean":"2024-04-25T08:50:54.470325+0000","last_became_active":"2024-04-25T08:50:53.082570+0000","last_became_peered":"2024-04-25T08:50:53.082570+0000","last_unstale":"2024-04-25T08:50:54.470325+0000","last_undegraded":"2024-04-25T08:50:54.470325+0000","last_fullsized":"2024-04-25T08:50:54.470325+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:18.175894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"130'3","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470070+0000","last_change":"2024-04-25T08:50:52.072224+0000","last_active":"2024-04-25T08:50:54.470070+0000","last_peered":"2024-04-25T08:50:54.470070+0000","last_clean":"2024-04-25T08:50:54.470070+0000","last_became_active":"2024-04-25T08:50:52.071933+0000","last_became_peered":"2024-04-25T08:50:52.071933+0000","last_unstale":"2024-04-25T08:50:54.470070+0000","last_undegraded":"2024-04-25T08:50:54.470070+0000","last_fullsized":"2024-04-25T08:50:54.470070+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:39.944916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470212+0000","last_change":"2024-04-25T08:50:53.086992+0000","last_active":"2024-04-25T08:50:54.470212+0000","last_peered":"2024-04-25T08:50:54.470212+0000","last_clean":"2024-04-25T08:50:54.470212+0000","last_became_active":"2024-04-25T08:50:53.086578+0000","last_became_peered":"2024-04-25T08:50:53.086578+0000","last_unstale":"2024-04-25T08:50:54.470212+0000","last_undegraded":"2024-04-25T08:50:54.470212+0000","last_fullsized":"2024-04-25T08:50:54.470212+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:13.985914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"130'6","reported_seq":20,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469997+0000","last_change":"2024-04-25T08:50:52.070677+0000","last_active":"2024-04-25T08:50:54.469997+0000","last_peered":"2024-04-25T08:50:54.469997+0000","last_clean":"2024-04-25T08:50:54.469997+0000","last_became_active":"2024-04-25T08:50:52.070263+0000","last_became_peered":"2024-04-25T08:50:52.070263+0000","last_unstale":"2024-04-25T08:50:54.469997+0000","last_undegraded":"2024-04-25T08:50:54.469997+0000","last_fullsized":"2024-04-25T08:50:54.469997+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:38.050519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469453+0000","last_change":"2024-04-25T08:50:53.073091+0000","last_active":"2024-04-25T08:50:54.469453+0000","last_peered":"2024-04-25T08:50:54.469453+0000","last_clean":"2024-04-25T08:50:54.469453+0000","last_became_active":"2024-04-25T08:50:53.072792+0000","last_became_peered":"2024-04-25T08:50:53.072792+0000","last_unstale":"2024-04-25T08:50:54.469453+0000","last_undegraded":"2024-04-25T08:50:54.469453+0000","last_fullsized":"2024-04-25T08:50:54.469453+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:41.016023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469786+0000","last_change":"2024-04-25T08:50:52.071574+0000","last_active":"2024-04-25T08:50:54.469786+0000","last_peered":"2024-04-25T08:50:54.469786+0000","last_clean":"2024-04-25T08:50:54.469786+0000","last_became_active":"2024-04-25T08:50:52.071219+0000","last_became_peered":"2024-04-25T08:50:52.071219+0000","last_unstale":"2024-04-25T08:50:54.469786+0000","last_undegraded":"2024-04-25T08:50:54.469786+0000","last_fullsized":"2024-04-25T08:50:54.469786+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:48.640118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470402+0000","last_change":"2024-04-25T08:50:53.083074+0000","last_active":"2024-04-25T08:50:54.470402+0000","last_peered":"2024-04-25T08:50:54.470402+0000","last_clean":"2024-04-25T08:50:54.470402+0000","last_became_active":"2024-04-25T08:50:53.082667+0000","last_became_peered":"2024-04-25T08:50:53.082667+0000","last_unstale":"2024-04-25T08:50:54.470402+0000","last_undegraded":"2024-04-25T08:50:54.470402+0000","last_fullsized":"2024-04-25T08:50:54.470402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:15.343168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469982+0000","last_change":"2024-04-25T08:50:52.067674+0000","last_active":"2024-04-25T08:50:54.469982+0000","last_peered":"2024-04-25T08:50:54.469982+0000","last_clean":"2024-04-25T08:50:54.469982+0000","last_became_active":"2024-04-25T08:50:52.067413+0000","last_became_peered":"2024-04-25T08:50:52.067413+0000","last_unstale":"2024-04-25T08:50:54.469982+0000","last_undegraded":"2024-04-25T08:50:54.469982+0000","last_fullsized":"2024-04-25T08:50:54.469982+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:53.520138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066953+0000","last_change":"2024-04-25T08:50:53.083385+0000","last_active":"2024-04-25T08:50:54.066953+0000","last_peered":"2024-04-25T08:50:54.066953+0000","last_clean":"2024-04-25T08:50:54.066953+0000","last_became_active":"2024-04-25T08:50:53.083042+0000","last_became_peered":"2024-04-25T08:50:53.083042+0000","last_unstale":"2024-04-25T08:50:54.066953+0000","last_undegraded":"2024-04-25T08:50:54.066953+0000","last_fullsized":"2024-04-25T08:50:54.066953+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:36.397565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"130'8","reported_seq":22,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069343+0000","last_change":"2024-04-25T08:50:52.073052+0000","last_active":"2024-04-25T08:50:54.069343+0000","last_peered":"2024-04-25T08:50:54.069343+0000","last_clean":"2024-04-25T08:50:54.069343+0000","last_became_active":"2024-04-25T08:50:52.072717+0000","last_became_peered":"2024-04-25T08:50:52.072717+0000","last_unstale":"2024-04-25T08:50:54.069343+0000","last_undegraded":"2024-04-25T08:50:54.069343+0000","last_fullsized":"2024-04-25T08:50:54.069343+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:32:59.581933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469585+0000","last_change":"2024-04-25T08:50:53.085726+0000","last_active":"2024-04-25T08:50:54.469585+0000","last_peered":"2024-04-25T08:50:54.469585+0000","last_clean":"2024-04-25T08:50:54.469585+0000","last_became_active":"2024-04-25T08:50:53.085483+0000","last_became_peered":"2024-04-25T08:50:53.085483+0000","last_unstale":"2024-04-25T08:50:54.469585+0000","last_undegraded":"2024-04-25T08:50:54.469585+0000","last_fullsized":"2024-04-25T08:50:54.469585+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:32.337285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068757+0000","last_change":"2024-04-25T08:50:52.068588+0000","last_active":"2024-04-25T08:50:54.068757+0000","last_peered":"2024-04-25T08:50:54.068757+0000","last_clean":"2024-04-25T08:50:54.068757+0000","last_became_active":"2024-04-25T08:50:52.067825+0000","last_became_peered":"2024-04-25T08:50:52.067825+0000","last_unstale":"2024-04-25T08:50:54.068757+0000","last_undegraded":"2024-04-25T08:50:54.068757+0000","last_fullsized":"2024-04-25T08:50:54.068757+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.186431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470517+0000","last_change":"2024-04-25T08:50:53.086450+0000","last_active":"2024-04-25T08:50:54.470517+0000","last_peered":"2024-04-25T08:50:54.470517+0000","last_clean":"2024-04-25T08:50:54.470517+0000","last_became_active":"2024-04-25T08:50:53.086075+0000","last_became_peered":"2024-04-25T08:50:53.086075+0000","last_unstale":"2024-04-25T08:50:54.470517+0000","last_undegraded":"2024-04-25T08:50:54.470517+0000","last_fullsized":"2024-04-25T08:50:54.470517+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:41.088924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470374+0000","last_change":"2024-04-25T08:50:52.071957+0000","last_active":"2024-04-25T08:50:54.470374+0000","last_peered":"2024-04-25T08:50:54.470374+0000","last_clean":"2024-04-25T08:50:54.470374+0000","last_became_active":"2024-04-25T08:50:52.071671+0000","last_became_peered":"2024-04-25T08:50:52.071671+0000","last_unstale":"2024-04-25T08:50:54.470374+0000","last_undegraded":"2024-04-25T08:50:54.470374+0000","last_fullsized":"2024-04-25T08:50:54.470374+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:55.349207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470836+0000","last_change":"2024-04-25T08:50:53.084689+0000","last_active":"2024-04-25T08:50:54.470836+0000","last_peered":"2024-04-25T08:50:54.470836+0000","last_clean":"2024-04-25T08:50:54.470836+0000","last_became_active":"2024-04-25T08:50:53.084401+0000","last_became_peered":"2024-04-25T08:50:53.084401+0000","last_unstale":"2024-04-25T08:50:54.470836+0000","last_undegraded":"2024-04-25T08:50:54.470836+0000","last_fullsized":"2024-04-25T08:50:54.470836+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:02.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069477+0000","last_change":"2024-04-25T08:50:52.066249+0000","last_active":"2024-04-25T08:50:54.069477+0000","last_peered":"2024-04-25T08:50:54.069477+0000","last_clean":"2024-04-25T08:50:54.069477+0000","last_became_active":"2024-04-25T08:50:52.066030+0000","last_became_peered":"2024-04-25T08:50:52.066030+0000","last_unstale":"2024-04-25T08:50:54.069477+0000","last_undegraded":"2024-04-25T08:50:54.069477+0000","last_fullsized":"2024-04-25T08:50:54.069477+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:28.150151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469149+0000","last_change":"2024-04-25T08:50:53.087224+0000","last_active":"2024-04-25T08:50:54.469149+0000","last_peered":"2024-04-25T08:50:54.469149+0000","last_clean":"2024-04-25T08:50:54.469149+0000","last_became_active":"2024-04-25T08:50:53.086843+0000","last_became_peered":"2024-04-25T08:50:53.086843+0000","last_unstale":"2024-04-25T08:50:54.469149+0000","last_undegraded":"2024-04-25T08:50:54.469149+0000","last_fullsized":"2024-04-25T08:50:54.469149+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:59.157977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067170+0000","last_change":"2024-04-25T08:50:52.070019+0000","last_active":"2024-04-25T08:50:54.067170+0000","last_peered":"2024-04-25T08:50:54.067170+0000","last_clean":"2024-04-25T08:50:54.067170+0000","last_became_active":"2024-04-25T08:50:52.069758+0000","last_became_peered":"2024-04-25T08:50:52.069758+0000","last_unstale":"2024-04-25T08:50:54.067170+0000","last_undegraded":"2024-04-25T08:50:54.067170+0000","last_fullsized":"2024-04-25T08:50:54.067170+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:37.347823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067096+0000","last_change":"2024-04-25T08:50:53.082565+0000","last_active":"2024-04-25T08:50:54.067096+0000","last_peered":"2024-04-25T08:50:54.067096+0000","last_clean":"2024-04-25T08:50:54.067096+0000","last_became_active":"2024-04-25T08:50:53.082119+0000","last_became_peered":"2024-04-25T08:50:53.082119+0000","last_unstale":"2024-04-25T08:50:54.067096+0000","last_undegraded":"2024-04-25T08:50:54.067096+0000","last_fullsized":"2024-04-25T08:50:54.067096+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:41.088924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068991+0000","last_change":"2024-04-25T08:50:52.070483+0000","last_active":"2024-04-25T08:50:54.068991+0000","last_peered":"2024-04-25T08:50:54.068991+0000","last_clean":"2024-04-25T08:50:54.068991+0000","last_became_active":"2024-04-25T08:50:52.070167+0000","last_became_peered":"2024-04-25T08:50:52.070167+0000","last_unstale":"2024-04-25T08:50:54.068991+0000","last_undegraded":"2024-04-25T08:50:54.068991+0000","last_fullsized":"2024-04-25T08:50:54.068991+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.004266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469459+0000","last_change":"2024-04-25T08:50:53.078082+0000","last_active":"2024-04-25T08:50:54.469459+0000","last_peered":"2024-04-25T08:50:54.469459+0000","last_clean":"2024-04-25T08:50:54.469459+0000","last_became_active":"2024-04-25T08:50:53.077808+0000","last_became_peered":"2024-04-25T08:50:53.077808+0000","last_unstale":"2024-04-25T08:50:54.469459+0000","last_undegraded":"2024-04-25T08:50:54.469459+0000","last_fullsized":"2024-04-25T08:50:54.469459+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:07.585873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469285+0000","last_change":"2024-04-25T08:50:52.066994+0000","last_active":"2024-04-25T08:50:54.469285+0000","last_peered":"2024-04-25T08:50:54.469285+0000","last_clean":"2024-04-25T08:50:54.469285+0000","last_became_active":"2024-04-25T08:50:52.066721+0000","last_became_peered":"2024-04-25T08:50:52.066721+0000","last_unstale":"2024-04-25T08:50:54.469285+0000","last_undegraded":"2024-04-25T08:50:54.469285+0000","last_fullsized":"2024-04-25T08:50:54.469285+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:57.026177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067328+0000","last_change":"2024-04-25T08:50:53.083181+0000","last_active":"2024-04-25T08:50:54.067328+0000","last_peered":"2024-04-25T08:50:54.067328+0000","last_clean":"2024-04-25T08:50:54.067328+0000","last_became_active":"2024-04-25T08:50:53.082822+0000","last_became_peered":"2024-04-25T08:50:53.082822+0000","last_unstale":"2024-04-25T08:50:54.067328+0000","last_undegraded":"2024-04-25T08:50:54.067328+0000","last_fullsized":"2024-04-25T08:50:54.067328+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:03.983664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470604+0000","last_change":"2024-04-25T08:50:52.073836+0000","last_active":"2024-04-25T08:50:54.470604+0000","last_peered":"2024-04-25T08:50:54.470604+0000","last_clean":"2024-04-25T08:50:54.470604+0000","last_became_active":"2024-04-25T08:50:52.073524+0000","last_became_peered":"2024-04-25T08:50:52.073524+0000","last_unstale":"2024-04-25T08:50:54.470604+0000","last_undegraded":"2024-04-25T08:50:54.470604+0000","last_fullsized":"2024-04-25T08:50:54.470604+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:15.583529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068582+0000","last_change":"2024-04-25T08:50:53.083213+0000","last_active":"2024-04-25T08:50:54.068582+0000","last_peered":"2024-04-25T08:50:54.068582+0000","last_clean":"2024-04-25T08:50:54.068582+0000","last_became_active":"2024-04-25T08:50:53.082937+0000","last_became_peered":"2024-04-25T08:50:53.082937+0000","last_unstale":"2024-04-25T08:50:54.068582+0000","last_undegraded":"2024-04-25T08:50:54.068582+0000","last_fullsized":"2024-04-25T08:50:54.068582+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:17.680586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069440+0000","last_change":"2024-04-25T08:50:52.069176+0000","last_active":"2024-04-25T08:50:54.069440+0000","last_peered":"2024-04-25T08:50:54.069440+0000","last_clean":"2024-04-25T08:50:54.069440+0000","last_became_active":"2024-04-25T08:50:52.068893+0000","last_became_peered":"2024-04-25T08:50:52.068893+0000","last_unstale":"2024-04-25T08:50:54.069440+0000","last_undegraded":"2024-04-25T08:50:54.069440+0000","last_fullsized":"2024-04-25T08:50:54.069440+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:00.101295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.067125+0000","last_change":"2024-04-25T08:50:53.084130+0000","last_active":"2024-04-25T08:50:54.067125+0000","last_peered":"2024-04-25T08:50:54.067125+0000","last_clean":"2024-04-25T08:50:54.067125+0000","last_became_active":"2024-04-25T08:50:53.083736+0000","last_became_peered":"2024-04-25T08:50:53.083736+0000","last_unstale":"2024-04-25T08:50:54.067125+0000","last_undegraded":"2024-04-25T08:50:54.067125+0000","last_fullsized":"2024-04-25T08:50:54.067125+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:02.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469626+0000","last_change":"2024-04-25T08:50:52.072213+0000","last_active":"2024-04-25T08:50:54.469626+0000","last_peered":"2024-04-25T08:50:54.469626+0000","last_clean":"2024-04-25T08:50:54.469626+0000","last_became_active":"2024-04-25T08:50:52.071944+0000","last_became_peered":"2024-04-25T08:50:52.071944+0000","last_unstale":"2024-04-25T08:50:54.469626+0000","last_undegraded":"2024-04-25T08:50:54.469626+0000","last_fullsized":"2024-04-25T08:50:54.469626+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:53.320007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469925+0000","last_change":"2024-04-25T08:50:53.085506+0000","last_active":"2024-04-25T08:50:54.469925+0000","last_peered":"2024-04-25T08:50:54.469925+0000","last_clean":"2024-04-25T08:50:54.469925+0000","last_became_active":"2024-04-25T08:50:53.085228+0000","last_became_peered":"2024-04-25T08:50:53.085228+0000","last_unstale":"2024-04-25T08:50:54.469925+0000","last_undegraded":"2024-04-25T08:50:54.469925+0000","last_fullsized":"2024-04-25T08:50:54.469925+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:34.414227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"131'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.080438+0000","last_change":"2024-04-25T08:50:52.062777+0000","last_active":"2024-04-25T08:50:54.080438+0000","last_peered":"2024-04-25T08:50:54.080438+0000","last_clean":"2024-04-25T08:50:54.080438+0000","last_became_active":"2024-04-25T08:50:52.062483+0000","last_became_peered":"2024-04-25T08:50:52.062483+0000","last_unstale":"2024-04-25T08:50:54.080438+0000","last_undegraded":"2024-04-25T08:50:54.080438+0000","last_fullsized":"2024-04-25T08:50:54.080438+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:12.613841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470836+0000","last_change":"2024-04-25T08:50:53.089220+0000","last_active":"2024-04-25T08:50:54.470836+0000","last_peered":"2024-04-25T08:50:54.470836+0000","last_clean":"2024-04-25T08:50:54.470836+0000","last_became_active":"2024-04-25T08:50:53.088519+0000","last_became_peered":"2024-04-25T08:50:53.088519+0000","last_unstale":"2024-04-25T08:50:54.470836+0000","last_undegraded":"2024-04-25T08:50:54.470836+0000","last_fullsized":"2024-04-25T08:50:54.470836+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:09.670917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069304+0000","last_change":"2024-04-25T08:50:52.067571+0000","last_active":"2024-04-25T08:50:54.069304+0000","last_peered":"2024-04-25T08:50:54.069304+0000","last_clean":"2024-04-25T08:50:54.069304+0000","last_became_active":"2024-04-25T08:50:52.067282+0000","last_became_peered":"2024-04-25T08:50:52.067282+0000","last_unstale":"2024-04-25T08:50:54.069304+0000","last_undegraded":"2024-04-25T08:50:54.069304+0000","last_fullsized":"2024-04-25T08:50:54.069304+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:41.029120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469221+0000","last_change":"2024-04-25T08:50:53.069681+0000","last_active":"2024-04-25T08:50:54.469221+0000","last_peered":"2024-04-25T08:50:54.469221+0000","last_clean":"2024-04-25T08:50:54.469221+0000","last_became_active":"2024-04-25T08:50:53.069408+0000","last_became_peered":"2024-04-25T08:50:53.069408+0000","last_unstale":"2024-04-25T08:50:54.469221+0000","last_undegraded":"2024-04-25T08:50:54.469221+0000","last_fullsized":"2024-04-25T08:50:54.469221+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:41.552036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069304+0000","last_change":"2024-04-25T08:50:52.065214+0000","last_active":"2024-04-25T08:50:54.069304+0000","last_peered":"2024-04-25T08:50:54.069304+0000","last_clean":"2024-04-25T08:50:54.069304+0000","last_became_active":"2024-04-25T08:50:52.064823+0000","last_became_peered":"2024-04-25T08:50:52.064823+0000","last_unstale":"2024-04-25T08:50:54.069304+0000","last_undegraded":"2024-04-25T08:50:54.069304+0000","last_fullsized":"2024-04-25T08:50:54.069304+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:36.635803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069292+0000","last_change":"2024-04-25T08:50:53.079935+0000","last_active":"2024-04-25T08:50:54.069292+0000","last_peered":"2024-04-25T08:50:54.069292+0000","last_clean":"2024-04-25T08:50:54.069292+0000","last_became_active":"2024-04-25T08:50:53.079628+0000","last_became_peered":"2024-04-25T08:50:53.079628+0000","last_unstale":"2024-04-25T08:50:54.069292+0000","last_undegraded":"2024-04-25T08:50:54.069292+0000","last_fullsized":"2024-04-25T08:50:54.069292+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:39.057501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.068313+0000","last_change":"2024-04-25T08:50:52.071833+0000","last_active":"2024-04-25T08:50:54.068313+0000","last_peered":"2024-04-25T08:50:54.068313+0000","last_clean":"2024-04-25T08:50:54.068313+0000","last_became_active":"2024-04-25T08:50:52.071549+0000","last_became_peered":"2024-04-25T08:50:52.071549+0000","last_unstale":"2024-04-25T08:50:54.068313+0000","last_undegraded":"2024-04-25T08:50:54.068313+0000","last_fullsized":"2024-04-25T08:50:54.068313+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:38.050519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069515+0000","last_change":"2024-04-25T08:50:53.077940+0000","last_active":"2024-04-25T08:50:54.069515+0000","last_peered":"2024-04-25T08:50:54.069515+0000","last_clean":"2024-04-25T08:50:54.069515+0000","last_became_active":"2024-04-25T08:50:53.077654+0000","last_became_peered":"2024-04-25T08:50:53.077654+0000","last_unstale":"2024-04-25T08:50:54.069515+0000","last_undegraded":"2024-04-25T08:50:54.069515+0000","last_fullsized":"2024-04-25T08:50:54.069515+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:02.832327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470912+0000","last_change":"2024-04-25T08:50:52.068759+0000","last_active":"2024-04-25T08:50:54.470912+0000","last_peered":"2024-04-25T08:50:54.470912+0000","last_clean":"2024-04-25T08:50:54.470912+0000","last_became_active":"2024-04-25T08:50:52.068490+0000","last_became_peered":"2024-04-25T08:50:52.068490+0000","last_unstale":"2024-04-25T08:50:54.470912+0000","last_undegraded":"2024-04-25T08:50:54.470912+0000","last_fullsized":"2024-04-25T08:50:54.470912+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:35.638311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069405+0000","last_change":"2024-04-25T08:50:53.088958+0000","last_active":"2024-04-25T08:50:54.069405+0000","last_peered":"2024-04-25T08:50:54.069405+0000","last_clean":"2024-04-25T08:50:54.069405+0000","last_became_active":"2024-04-25T08:50:53.088700+0000","last_became_peered":"2024-04-25T08:50:53.088700+0000","last_unstale":"2024-04-25T08:50:54.069405+0000","last_undegraded":"2024-04-25T08:50:54.069405+0000","last_fullsized":"2024-04-25T08:50:54.069405+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:36.645292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.069237+0000","last_change":"2024-04-25T08:50:52.065556+0000","last_active":"2024-04-25T08:50:54.069237+0000","last_peered":"2024-04-25T08:50:54.069237+0000","last_clean":"2024-04-25T08:50:54.069237+0000","last_became_active":"2024-04-25T08:50:52.065311+0000","last_became_peered":"2024-04-25T08:50:52.065311+0000","last_unstale":"2024-04-25T08:50:54.069237+0000","last_undegraded":"2024-04-25T08:50:54.069237+0000","last_fullsized":"2024-04-25T08:50:54.069237+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:20.550790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469911+0000","last_change":"2024-04-25T08:50:53.088627+0000","last_active":"2024-04-25T08:50:54.469911+0000","last_peered":"2024-04-25T08:50:54.469911+0000","last_clean":"2024-04-25T08:50:54.469911+0000","last_became_active":"2024-04-25T08:50:53.088193+0000","last_became_peered":"2024-04-25T08:50:53.088193+0000","last_unstale":"2024-04-25T08:50:54.469911+0000","last_undegraded":"2024-04-25T08:50:54.469911+0000","last_fullsized":"2024-04-25T08:50:54.469911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:17.680586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.066809+0000","last_change":"2024-04-25T08:50:52.073018+0000","last_active":"2024-04-25T08:50:54.066809+0000","last_peered":"2024-04-25T08:50:54.066809+0000","last_clean":"2024-04-25T08:50:54.066809+0000","last_became_active":"2024-04-25T08:50:52.072665+0000","last_became_peered":"2024-04-25T08:50:52.072665+0000","last_unstale":"2024-04-25T08:50:54.066809+0000","last_undegraded":"2024-04-25T08:50:54.066809+0000","last_fullsized":"2024-04-25T08:50:54.066809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:32.839307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470526+0000","last_change":"2024-04-25T08:50:53.087170+0000","last_active":"2024-04-25T08:50:54.470526+0000","last_peered":"2024-04-25T08:50:54.470526+0000","last_clean":"2024-04-25T08:50:54.470526+0000","last_became_active":"2024-04-25T08:50:53.084856+0000","last_became_peered":"2024-04-25T08:50:53.084856+0000","last_unstale":"2024-04-25T08:50:54.470526+0000","last_undegraded":"2024-04-25T08:50:54.470526+0000","last_fullsized":"2024-04-25T08:50:54.470526+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:52.049564+0000","last_clean_scrub_stamp":"2024-04-25T08:50:52.049564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:21.046097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.470994+0000","last_change":"2024-04-25T08:50:52.072949+0000","last_active":"2024-04-25T08:50:54.470994+0000","last_peered":"2024-04-25T08:50:54.470994+0000","last_clean":"2024-04-25T08:50:54.470994+0000","last_became_active":"2024-04-25T08:50:52.072675+0000","last_became_peered":"2024-04-25T08:50:52.072675+0000","last_unstale":"2024-04-25T08:50:54.470994+0000","last_undegraded":"2024-04-25T08:50:54.470994+0000","last_fullsized":"2024-04-25T08:50:54.470994+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:50:51.042582+0000","last_clean_scrub_stamp":"2024-04-25T08:50:51.042582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:43.186431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":373,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-04-25T08:50:54.469578+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:50:54.469578+0000","last_peered":"2024-04-25T08:50:54.469578+0000","last_clean":"2024-04-25T08:50:54.469578+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:50:54.469578+0000","last_undegraded":"2024-04-25T08:50:54.469578+0000","last_fullsized":"2024-04-25T08:50:54.469578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574955,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47264,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324576,"statfs":{"total":96636764160,"available":96588365824,"internally_reserved":0,"allocated":2248704,"data_stored":1355240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50836,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321004,"statfs":{"total":96636764160,"available":96584708096,"internally_reserved":0,"allocated":1646592,"data_stored":763842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574956,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46676,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325164,"statfs":{"total":96636764160,"available":96588967936,"internally_reserved":0,"allocated":1642496,"data_stored":763192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50836,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321004,"statfs":{"total":96636764160,"available":96584708096,"internally_reserved":0,"allocated":1638400,"data_stored":763170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55004,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316836,"statfs":{"total":96636764160,"available":96580440064,"internally_reserved":0,"allocated":1654784,"data_stored":764852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50840,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321000,"statfs":{"total":96636764160,"available":96584704000,"internally_reserved":0,"allocated":1646592,"data_stored":763786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50836,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321004,"statfs":{"total":96636764160,"available":96584708096,"internally_reserved":0,"allocated":1642496,"data_stored":763240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51424,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320416,"statfs":{"total":96636764160,"available":96584105984,"internally_reserved":0,"allocated":2240512,"data_stored":1353594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:51:00.709 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:51:00.710 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:51:00.849 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.859+0000 7f398b41f640 1 Processor -- start 2024-04-25T08:51:00.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.859+0000 7f398b41f640 1 -- start start 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f398b41f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f398415b7d0 0x7f39840cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f398b41f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39840b5620 0x7f39840b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f398b41f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398406cf50 con 0x7f398406c2d0 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f398b41f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840b5fc0 con 0x7f398415b7d0 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f398b41f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39840ce530 con 0x7f39840b5620 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f39889ba640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39840b5620 0x7f39840b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f39891bb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f398415b7d0 0x7f39840cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f39899bc640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f398406c2d0 0x7f398406c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:56310/0 (socket says 172.21.15.172:56310) 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f39889ba640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39840b5620 0x7f39840b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:40822/0 (socket says 172.21.15.172:40822) 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f39899bc640 1 -- 172.21.15.172:0/2935923519 learned_addr learned my addr 172.21.15.172:0/2935923519 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:00.851 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f39889ba640 1 -- 172.21.15.172:0/2935923519 >> v2:172.21.15.186:3300/0 conn(0x7f398415b7d0 msgr2=0x7f39840cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:00.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f39889ba640 1 --2- 172.21.15.172:0/2935923519 >> v2:172.21.15.186:3300/0 conn(0x7f398415b7d0 0x7f39840cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f39889ba640 1 -- 172.21.15.172:0/2935923519 >> v1:172.21.15.186:6789/0 conn(0x7f398406c2d0 legacy=0x7f398406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:00.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f39889ba640 1 -- 172.21.15.172:0/2935923519 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840ce810 con 0x7f39840b5620 2024-04-25T08:51:00.852 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.860+0000 7f39891bb640 1 --2- 172.21.15.172:0/2935923519 >> v2:172.21.15.186:3300/0 conn(0x7f398415b7d0 0x7f39840cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.861+0000 7f39889ba640 1 --2- 172.21.15.172:0/2935923519 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39840b5620 0x7f39840b5a80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39740097a0 tx=0x7f397402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a20530f9fd92c9a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.861+0000 7f397bfff640 1 -- 172.21.15.172:0/2935923519 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974037070 con 0x7f39840b5620 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.861+0000 7f397bfff640 1 -- 172.21.15.172:0/2935923519 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974032440 con 0x7f39840b5620 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.861+0000 7f397bfff640 1 -- 172.21.15.172:0/2935923519 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974032810 con 0x7f39840b5620 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.862+0000 7f398b41f640 1 -- 172.21.15.172:0/2935923519 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39840b5620 msgr2=0x7f39840b5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.862+0000 7f398b41f640 1 --2- 172.21.15.172:0/2935923519 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39840b5620 0x7f39840b5a80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39740097a0 tx=0x7f397402a180 comp rx=0 tx=0).stop 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.862+0000 7f398b41f640 1 -- 172.21.15.172:0/2935923519 shutdown_connections 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.862+0000 7f398b41f640 1 --2- 172.21.15.172:0/2935923519 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39840b5620 0x7f39840b5a80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.862+0000 7f398b41f640 1 --2- 172.21.15.172:0/2935923519 >> v2:172.21.15.186:3300/0 conn(0x7f398415b7d0 0x7f39840cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.862+0000 7f398b41f640 1 -- 172.21.15.172:0/2935923519 >> 172.21.15.172:0/2935923519 conn(0x7f39840d0800 msgr2=0x7f39840d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.862+0000 7f398b41f640 1 -- 172.21.15.172:0/2935923519 shutdown_connections 2024-04-25T08:51:00.853 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.862+0000 7f398b41f640 1 -- 172.21.15.172:0/2935923519 wait complete. 2024-04-25T08:51:00.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.863+0000 7f398b41f640 1 Processor -- start 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.863+0000 7f398b41f640 1 -- start start 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f398b41f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f398406c2d0 0x7f39840cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f398b41f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39840b5620 0x7f39841f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f398b41f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f398415b7d0 0x7f39840cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f398b41f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840cf550 con 0x7f398415b7d0 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f398b41f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398406d230 con 0x7f39840b5620 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f398b41f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39840cf6d0 con 0x7f398406c2d0 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f39899bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f398415b7d0 0x7f39840cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f39899bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f398415b7d0 0x7f39840cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60108/0 (socket says 172.21.15.172:60108) 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f39899bc640 1 -- 172.21.15.172:0/2153410954 learned_addr learned my addr 172.21.15.172:0/2153410954 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f39889ba640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39840b5620 0x7f39841f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f39891bb640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f398406c2d0 0x7f39840cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f39899bc640 1 -- 172.21.15.172:0/2153410954 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f398406c2d0 msgr2=0x7f39840cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f39899bc640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f398406c2d0 0x7f39840cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f39899bc640 1 -- 172.21.15.172:0/2153410954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39840b5620 msgr2=0x7f39841f6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:00.856 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f39899bc640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39840b5620 0x7f39841f6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.864+0000 7f39899bc640 1 -- 172.21.15.172:0/2153410954 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840cdea0 con 0x7f398415b7d0 2024-04-25T08:51:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.865+0000 7f39899bc640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f398415b7d0 0x7f39840cd960 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f397c00ca70 tx=0x7f397c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.865+0000 7f3979ffb640 1 -- 172.21.15.172:0/2153410954 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c017070 con 0x7f398415b7d0 2024-04-25T08:51:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.865+0000 7f3979ffb640 1 -- 172.21.15.172:0/2153410954 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c00ab70 con 0x7f398415b7d0 2024-04-25T08:51:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.865+0000 7f398b41f640 1 -- 172.21.15.172:0/2153410954 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39840cbea0 con 0x7f398415b7d0 2024-04-25T08:51:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.865+0000 7f3979ffb640 1 -- 172.21.15.172:0/2153410954 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c012400 con 0x7f398415b7d0 2024-04-25T08:51:00.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.865+0000 7f398b41f640 1 -- 172.21.15.172:0/2153410954 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39840cc460 con 0x7f398415b7d0 2024-04-25T08:51:00.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.866+0000 7f398b41f640 1 -- 172.21.15.172:0/2153410954 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3984073a00 con 0x7f398415b7d0 2024-04-25T08:51:00.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.866+0000 7f3979ffb640 1 -- 172.21.15.172:0/2153410954 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f397c01a070 con 0x7f398415b7d0 2024-04-25T08:51:00.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.867+0000 7f3979ffb640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f396806b500 0x7f396806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:00.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.867+0000 7f3979ffb640 1 -- 172.21.15.172:0/2153410954 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f397c089e00 con 0x7f398415b7d0 2024-04-25T08:51:00.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.867+0000 7f39891bb640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f396806b500 0x7f396806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:00.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.867+0000 7f39891bb640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f396806b500 0x7f396806d9c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3980009560 tx=0x7f3980009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:00.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:00.871+0000 7f3979ffb640 1 -- 172.21.15.172:0/2153410954 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f397c058530 con 0x7f398415b7d0 2024-04-25T08:51:01.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.108+0000 7f398b41f640 1 -- 172.21.15.172:0/2153410954 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f398406ca40 con 0x7f398415b7d0 2024-04-25T08:51:01.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.112+0000 7f3979ffb640 1 -- 172.21.15.172:0/2153410954 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f397c05c5d0 con 0x7f398415b7d0 2024-04-25T08:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T08:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: caps mds = "allow" 2024-04-25T08:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: caps mon = "allow r" 2024-04-25T08:51:01.103 INFO:teuthology.orchestra.run.smithi172.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:51:01.103 INFO:teuthology.orchestra.run.smithi172.stderr:updated caps for client.0 2024-04-25T08:51:01.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 -- 172.21.15.172:0/2153410954 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f396806b500 msgr2=0x7f396806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f396806b500 0x7f396806d9c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3980009560 tx=0x7f3980009190 comp rx=0 tx=0).stop 2024-04-25T08:51:01.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 -- 172.21.15.172:0/2153410954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f398415b7d0 msgr2=0x7f39840cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f398415b7d0 0x7f39840cd960 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f397c00ca70 tx=0x7f397c00cf30 comp rx=0 tx=0).stop 2024-04-25T08:51:01.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 -- 172.21.15.172:0/2153410954 shutdown_connections 2024-04-25T08:51:01.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f396806b500 0x7f396806d9c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39840b5620 0x7f39841f6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f398415b7d0 0x7f39840cd960 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 --2- 172.21.15.172:0/2153410954 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f398406c2d0 0x7f39840cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 -- 172.21.15.172:0/2153410954 >> 172.21.15.172:0/2153410954 conn(0x7f39840d0800 msgr2=0x7f39840d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:01.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 -- 172.21.15.172:0/2153410954 shutdown_connections 2024-04-25T08:51:01.106 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.115+0000 7f398b41f640 1 -- 172.21.15.172:0/2153410954 wait complete. 2024-04-25T08:51:01.116 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:01.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.223+0000 7f86ba9c8640 1 Processor -- start 2024-04-25T08:51:01.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.223+0000 7f86ba9c8640 1 -- start start 2024-04-25T08:51:01.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.223+0000 7f86ba9c8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f86b40cc6c0 0x7f86b4071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.223+0000 7f86ba9c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f86b415b320 0x7f86b4071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.223+0000 7f86ba9c8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b4071ed0 con 0x7f86b413d190 2024-04-25T08:51:01.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.223+0000 7f86ba9c8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b4071cb0 con 0x7f86b415b320 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.224+0000 7f86ba9c8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b413d570 con 0x7f86b40cc6c0 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.224+0000 7f86b8f65640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f86b415b320 0x7f86b4071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.224+0000 7f86b8f65640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f86b415b320 0x7f86b4071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60114/0 (socket says 172.21.15.172:60114) 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.224+0000 7f86b8f65640 1 -- 172.21.15.172:0/1678961972 learned_addr learned my addr 172.21.15.172:0/1678961972 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.224+0000 7f86b37fe640 1 --2- 172.21.15.172:0/1678961972 >> v2:172.21.15.186:3300/0 conn(0x7f86b40cc6c0 0x7f86b4071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.224+0000 7f86b8f65640 1 -- 172.21.15.172:0/1678961972 >> v2:172.21.15.186:3300/0 conn(0x7f86b40cc6c0 msgr2=0x7f86b4071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.224+0000 7f86b8f65640 1 --2- 172.21.15.172:0/1678961972 >> v2:172.21.15.186:3300/0 conn(0x7f86b40cc6c0 0x7f86b4071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.224+0000 7f86b8f65640 1 -- 172.21.15.172:0/1678961972 >> v1:172.21.15.186:6789/0 conn(0x7f86b413d190 legacy=0x7f86b40cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.224+0000 7f86b8f65640 1 -- 172.21.15.172:0/1678961972 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b415a840 con 0x7f86b415b320 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86b8f65640 1 --2- 172.21.15.172:0/1678961972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b415b320 0x7f86b4071770 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f86b406f6f0 tx=0x7f86ac02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fe5d3f0340ebbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86b2ffd640 1 -- 172.21.15.172:0/1678961972 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac036070 con 0x7f86b415b320 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86b2ffd640 1 -- 172.21.15.172:0/1678961972 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac031600 con 0x7f86b415b320 2024-04-25T08:51:01.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86b2ffd640 1 -- 172.21.15.172:0/1678961972 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0319d0 con 0x7f86b415b320 2024-04-25T08:51:01.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86ba9c8640 1 -- 172.21.15.172:0/1678961972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b415b320 msgr2=0x7f86b4071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86ba9c8640 1 --2- 172.21.15.172:0/1678961972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b415b320 0x7f86b4071770 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f86b406f6f0 tx=0x7f86ac02a6a0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86ba9c8640 1 -- 172.21.15.172:0/1678961972 shutdown_connections 2024-04-25T08:51:01.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86ba9c8640 1 --2- 172.21.15.172:0/1678961972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b415b320 0x7f86b4071770 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86ba9c8640 1 --2- 172.21.15.172:0/1678961972 >> v2:172.21.15.186:3300/0 conn(0x7f86b40cc6c0 0x7f86b4071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86ba9c8640 1 -- 172.21.15.172:0/1678961972 >> 172.21.15.172:0/1678961972 conn(0x7f86b406abe0 msgr2=0x7f86b406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:01.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86ba9c8640 1 -- 172.21.15.172:0/1678961972 shutdown_connections 2024-04-25T08:51:01.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.225+0000 7f86ba9c8640 1 -- 172.21.15.172:0/1678961972 wait complete. 2024-04-25T08:51:01.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.226+0000 7f86ba9c8640 1 Processor -- start 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.227+0000 7f86ba9c8640 1 -- start start 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.227+0000 7f86ba9c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b40cc6c0 0x7f86b40b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.227+0000 7f86ba9c8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b413d190 0x7f86b406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.227+0000 7f86ba9c8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86b415b320 0x7f86b4139ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.227+0000 7f86ba9c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40cf620 con 0x7f86b40cc6c0 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.227+0000 7f86ba9c8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b415ae00 con 0x7f86b415b320 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.227+0000 7f86ba9c8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40cf7a0 con 0x7f86b413d190 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.227+0000 7f86b3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b40cc6c0 0x7f86b40b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b40cc6c0 0x7f86b40b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60122/0 (socket says 172.21.15.172:60122) 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b3fff640 1 -- 172.21.15.172:0/108798037 learned_addr learned my addr 172.21.15.172:0/108798037 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b8f65640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86b415b320 0x7f86b4139ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b37fe640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b413d190 0x7f86b406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b3fff640 1 -- 172.21.15.172:0/108798037 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b413d190 msgr2=0x7f86b406e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b3fff640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b413d190 0x7f86b406e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b3fff640 1 -- 172.21.15.172:0/108798037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86b415b320 msgr2=0x7f86b4139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b3fff640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86b415b320 0x7f86b4139ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b3fff640 1 -- 172.21.15.172:0/108798037 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b4157d70 con 0x7f86b40cc6c0 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b8f65640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86b415b320 0x7f86b4139ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b37fe640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b413d190 0x7f86b406e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b3fff640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b40cc6c0 0x7f86b40b0330 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f86a400c430 tx=0x7f86a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b0ff9640 1 -- 172.21.15.172:0/108798037 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a40052d0 con 0x7f86b40cc6c0 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b0ff9640 1 -- 172.21.15.172:0/108798037 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a4005490 con 0x7f86b40cc6c0 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86ba9c8640 1 -- 172.21.15.172:0/108798037 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b4156cd0 con 0x7f86b40cc6c0 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86b0ff9640 1 -- 172.21.15.172:0/108798037 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4007260 con 0x7f86b40cc6c0 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.228+0000 7f86ba9c8640 1 -- 172.21.15.172:0/108798037 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b4157290 con 0x7f86b40cc6c0 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.229+0000 7f86ba9c8640 1 -- 172.21.15.172:0/108798037 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b4073990 con 0x7f86b40cc6c0 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.229+0000 7f86b0ff9640 1 -- 172.21.15.172:0/108798037 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f86a4007400 con 0x7f86b40cc6c0 2024-04-25T08:51:01.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.230+0000 7f86b0ff9640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86a006b4d0 0x7f86a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.230+0000 7f86b0ff9640 1 -- 172.21.15.172:0/108798037 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f86a4089850 con 0x7f86b40cc6c0 2024-04-25T08:51:01.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.230+0000 7f86b37fe640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86a006b4d0 0x7f86a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.230+0000 7f86b37fe640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86a006b4d0 0x7f86a006d990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f86b414b200 tx=0x7f86a8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:01.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.234+0000 7f86b0ff9640 1 -- 172.21.15.172:0/108798037 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f86a4058570 con 0x7f86b40cc6c0 2024-04-25T08:51:01.281 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:51:01.283 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:51:01.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.442+0000 7f86ba9c8640 1 -- 172.21.15.172:0/108798037 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86b4072170 con 0x7f86b40cc6c0 2024-04-25T08:51:01.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.443+0000 7f86b0ff9640 1 -- 172.21.15.172:0/108798037 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f86a4057e70 con 0x7f86b40cc6c0 2024-04-25T08:51:01.434 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:01.434 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:01.434 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:51:01.435 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 -- 172.21.15.172:0/108798037 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86a006b4d0 msgr2=0x7f86a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86a006b4d0 0x7f86a006d990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f86b414b200 tx=0x7f86a8008040 comp rx=0 tx=0).stop 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 -- 172.21.15.172:0/108798037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b40cc6c0 msgr2=0x7f86b40b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b40cc6c0 0x7f86b40b0330 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f86a400c430 tx=0x7f86a400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 -- 172.21.15.172:0/108798037 shutdown_connections 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f86a006b4d0 0x7f86a006d990 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86b415b320 0x7f86b4139ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86b413d190 0x7f86b406e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 --2- 172.21.15.172:0/108798037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86b40cc6c0 0x7f86b40b0330 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 -- 172.21.15.172:0/108798037 >> 172.21.15.172:0/108798037 conn(0x7f86b406abe0 msgr2=0x7f86b415cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 -- 172.21.15.172:0/108798037 shutdown_connections 2024-04-25T08:51:01.436 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.445+0000 7f86ba9c8640 1 -- 172.21.15.172:0/108798037 wait complete. 2024-04-25T08:51:01.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:50:52.392874+0000', 'modified': '2024-04-25T08:50:54.404792+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9294': {'gid': 9294, 'name': 'c', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6837/3347790695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3347790695}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3347790695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:51:01.851 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:51:01.851 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T08:51:01.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.961+0000 7f1a40c4a640 1 Processor -- start 2024-04-25T08:51:01.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.961+0000 7f1a40c4a640 1 -- start start 2024-04-25T08:51:01.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a40c4a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c06fbd0 0x7f1a3c0ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a40c4a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3c0b4d80 con 0x7f1a3c155f80 2024-04-25T08:51:01.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a40c4a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3c0cef70 con 0x7f1a3c0ce730 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a40c4a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c0b5390 con 0x7f1a3c06fbd0 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a3a59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1a3c155f80 0x7f1a3c06f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48454/0 (socket says 172.21.15.172:48454) 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a3a59c640 1 -- 172.21.15.172:0/3527627951 learned_addr learned my addr 172.21.15.172:0/3527627951 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a33fff640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c06fbd0 0x7f1a3c0ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747861309 0 0) 0x7f1a3c0b4d80 con 0x7f1a3c155f80 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a28003520 con 0x7f1a3c155f80 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3529256172 0 0) 0x7f1a28003520 con 0x7f1a3c155f80 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c06fbd0 msgr2=0x7f1a3c0ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a39d9b640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c06fbd0 0x7f1a3c0ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 >> v1:172.21.15.186:6789/0 conn(0x7f1a3c0ce730 legacy=0x7f1a3c0b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c0b5020 con 0x7f1a3c155f80 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f1a2c001670 con 0x7f1a3c155f80 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.962+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 >> v1:172.21.15.172:6789/0 conn(0x7f1a3c155f80 legacy=0x7f1a3c06f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a39d9b640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 0x7f1a28003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a39d9b640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c06fbd0 0x7f1a28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a39d9b640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a28004d40 0x7f1a280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c0b5390 con 0x7f1a280039e0 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2800b9c0 con 0x7f1a28004d40 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2800bbc0 con 0x7f1a3c06fbd0 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 0x7f1a28003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a33fff640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c06fbd0 0x7f1a28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a3ad9d640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a28004d40 0x7f1a280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a3a59c640 1 -- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c06fbd0 msgr2=0x7f1a28004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c06fbd0 0x7f1a28004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a3a59c640 1 -- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a28004d40 msgr2=0x7f1a280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a28004d40 0x7f1a280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a3a59c640 1 -- 172.21.15.172:0/3527627951 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a28003520 con 0x7f1a280039e0 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.963+0000 7f1a3ad9d640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a28004d40 0x7f1a280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:01.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 0x7f1a28003dc0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00c240 tx=0x7f1a28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e656932e625ad3b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:01.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c007d10 con 0x7f1a280039e0 2024-04-25T08:51:01.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c005ad0 con 0x7f1a280039e0 2024-04-25T08:51:01.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a39d9b640 1 -- 172.21.15.172:0/3527627951 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c007070 con 0x7f1a280039e0 2024-04-25T08:51:01.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a40c4a640 1 -- 172.21.15.172:0/3527627951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 msgr2=0x7f1a28003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a40c4a640 1 --2- 172.21.15.172:0/3527627951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 0x7f1a28003dc0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00c240 tx=0x7f1a28005830 comp rx=0 tx=0).stop 2024-04-25T08:51:01.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a3ad9d640 1 -- 172.21.15.172:0/3527627951 reap_dead start 2024-04-25T08:51:01.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a40c4a640 1 -- 172.21.15.172:0/3527627951 shutdown_connections 2024-04-25T08:51:01.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a40c4a640 1 -- 172.21.15.172:0/3527627951 >> 172.21.15.172:0/3527627951 conn(0x7f1a3c061600 msgr2=0x7f1a3c0619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:01.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a40c4a640 1 -- 172.21.15.172:0/3527627951 shutdown_connections 2024-04-25T08:51:01.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.964+0000 7f1a40c4a640 1 -- 172.21.15.172:0/3527627951 wait complete. 2024-04-25T08:51:01.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.966+0000 7f1a40c4a640 1 Processor -- start 2024-04-25T08:51:01.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.966+0000 7f1a40c4a640 1 -- start start 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.966+0000 7f1a40c4a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 0x7f1a3c149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.966+0000 7f1a40c4a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c14eea0 0x7f1a3c14f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.966+0000 7f1a40c4a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c150b60 0x7f1a3c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.966+0000 7f1a40c4a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c0cf250 con 0x7f1a280039e0 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.966+0000 7f1a40c4a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c0d07f0 con 0x7f1a3c14eea0 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.966+0000 7f1a40c4a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c0cf3d0 con 0x7f1a3c150b60 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.966+0000 7f1a3a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 0x7f1a3c149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a3a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 0x7f1a3c149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60136/0 (socket says 172.21.15.172:60136) 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a3a59c640 1 -- 172.21.15.172:0/173328756 learned_addr learned my addr 172.21.15.172:0/173328756 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a3ad9d640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c150b60 0x7f1a3c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a33fff640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c14eea0 0x7f1a3c14f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a3a59c640 1 -- 172.21.15.172:0/173328756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c150b60 msgr2=0x7f1a3c150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c150b60 0x7f1a3c150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a3a59c640 1 -- 172.21.15.172:0/173328756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c14eea0 msgr2=0x7f1a3c14f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c14eea0 0x7f1a3c14f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a3a59c640 1 -- 172.21.15.172:0/173328756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c14b120 con 0x7f1a280039e0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 0x7f1a3c149e30 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c001200 tx=0x7f1a3c0cf140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a32ffd640 1 -- 172.21.15.172:0/173328756 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c001630 con 0x7f1a280039e0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a32ffd640 1 -- 172.21.15.172:0/173328756 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c038040 con 0x7f1a280039e0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a40c4a640 1 -- 172.21.15.172:0/173328756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3c14a950 con 0x7f1a280039e0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a32ffd640 1 -- 172.21.15.172:0/173328756 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c007290 con 0x7f1a280039e0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.967+0000 7f1a40c4a640 1 -- 172.21.15.172:0/173328756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c0b26e0 con 0x7f1a280039e0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.969+0000 7f1a32ffd640 1 -- 172.21.15.172:0/173328756 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1a2c007430 con 0x7f1a280039e0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.969+0000 7f1a32ffd640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a1c06b4d0 0x7f1a1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.969+0000 7f1a33fff640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a1c06b4d0 0x7f1a1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.969+0000 7f1a32ffd640 1 -- 172.21.15.172:0/173328756 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1a2c0aa570 con 0x7f1a280039e0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.969+0000 7f1a33fff640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a1c06b4d0 0x7f1a1c06d990 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0b3340 tx=0x7f1a24009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.970+0000 7f1a43a29740 1 Processor -- start 2024-04-25T08:51:01.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.970+0000 7f1a43a29740 1 -- start start 2024-04-25T08:51:01.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5ad9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5af6ad0 0x562dd5af7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5aaef10 0x562dd5af5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a43a29740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dd5a11a10 con 0x562dd5ad9230 2024-04-25T08:51:01.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a43a29740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dd59bab30 con 0x562dd5af6ad0 2024-04-25T08:51:01.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a43a29740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dd5a0dc50 con 0x562dd5aaef10 2024-04-25T08:51:01.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a3a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5ad9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a3a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5ad9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60138/0 (socket says 172.21.15.172:60138) 2024-04-25T08:51:01.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a3a59c640 1 -- 172.21.15.172:0/2849414859 learned_addr learned my addr 172.21.15.172:0/2849414859 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:01.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a3a59c640 1 -- 172.21.15.172:0/2849414859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5aaef10 msgr2=0x562dd5af5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/2849414859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5aaef10 0x562dd5af5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a3a59c640 1 -- 172.21.15.172:0/2849414859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5af6ad0 msgr2=0x562dd5af7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/2849414859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5af6ad0 0x562dd5af7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a3a59c640 1 -- 172.21.15.172:0/2849414859 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dd59cfe10 con 0x562dd5ad9230 2024-04-25T08:51:01.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/2849414859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5ad9610 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00c2a0 tx=0x7f1a2c0787a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1094343aa1c62eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:01.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a1bfff640 1 -- 172.21.15.172:0/2849414859 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c078b60 con 0x562dd5ad9230 2024-04-25T08:51:01.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a1bfff640 1 -- 172.21.15.172:0/2849414859 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c07ccb0 con 0x562dd5ad9230 2024-04-25T08:51:01.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.971+0000 7f1a1bfff640 1 -- 172.21.15.172:0/2849414859 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c081270 con 0x562dd5ad9230 2024-04-25T08:51:01.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.972+0000 7f1a43a29740 1 -- 172.21.15.172:0/2849414859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 msgr2=0x562dd5ad9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.972+0000 7f1a43a29740 1 --2- 172.21.15.172:0/2849414859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5ad9610 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00c2a0 tx=0x7f1a2c0787a0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.972+0000 7f1a43a29740 1 -- 172.21.15.172:0/2849414859 shutdown_connections 2024-04-25T08:51:01.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.972+0000 7f1a43a29740 1 --2- 172.21.15.172:0/2849414859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5af6ad0 0x562dd5af7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.972+0000 7f1a43a29740 1 --2- 172.21.15.172:0/2849414859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5aaef10 0x562dd5af5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.972+0000 7f1a43a29740 1 --2- 172.21.15.172:0/2849414859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5ad9610 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.972+0000 7f1a43a29740 1 -- 172.21.15.172:0/2849414859 >> 172.21.15.172:0/2849414859 conn(0x562dd5aab840 msgr2=0x562dd5af4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:01.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.972+0000 7f1a43a29740 1 -- 172.21.15.172:0/2849414859 shutdown_connections 2024-04-25T08:51:01.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.972+0000 7f1a43a29740 1 -- 172.21.15.172:0/2849414859 wait complete. 2024-04-25T08:51:01.969 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.973+0000 7f1a43a29740 1 -- start start 2024-04-25T08:51:01.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.973+0000 7f1a43a29740 1 Processor -- start 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5ad9230 0x562dd5ac8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5af6ad0 0x562dd5b07500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5b04c00 0x562dd5b07a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a43a29740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dd59bab30 con 0x562dd5af6ad0 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a43a29740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dd59ce0c0 con 0x562dd5ad9230 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a43a29740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dd5a11a10 con 0x562dd5b04c00 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a43a29740 10 client.0 _ll_register_callbacks cb 0x562dd59c1ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a33fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5af6ad0 0x562dd5b07500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a33fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5af6ad0 0x562dd5b07500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60146/0 (socket says 172.21.15.172:60146) 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a33fff640 1 -- 172.21.15.172:0/4209107294 learned_addr learned my addr 172.21.15.172:0/4209107294 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5ad9230 0x562dd5ac8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a3ad9d640 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5b04c00 0x562dd5b07a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a33fff640 1 -- 172.21.15.172:0/4209107294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5b04c00 msgr2=0x562dd5b07a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a33fff640 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5b04c00 0x562dd5b07a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a33fff640 1 -- 172.21.15.172:0/4209107294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5ad9230 msgr2=0x562dd5ac8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a33fff640 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5ad9230 0x562dd5ac8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a33fff640 1 -- 172.21.15.172:0/4209107294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562dd57262d0 con 0x562dd5af6ad0 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a3ad9d640 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5b04c00 0x562dd5b07a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a33fff640 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5af6ad0 0x562dd5b07500 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f1a240090c0 tx=0x7f1a24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d585232ed989df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a197fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a197fa640 1 -- 172.21.15.172:0/4209107294 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2401b070 con 0x562dd5af6ad0 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a197fa640 1 -- 172.21.15.172:0/4209107294 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1a24022700 con 0x562dd5af6ad0 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a43a29740 1 -- 172.21.15.172:0/4209107294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a2c07ccb0 con 0x562dd5af6ad0 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.974+0000 7f1a197fa640 1 -- 172.21.15.172:0/4209107294 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a24032050 con 0x562dd5af6ad0 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a43a29740 10 client.9459 fetch_fsmap learned FSMap version 74 2024-04-25T08:51:01.975 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a43a29740 1 -- 172.21.15.172:0/4209107294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x562dd57f06b0 con 0x562dd5af6ad0 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a197fa640 1 -- 172.21.15.172:0/4209107294 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c07ccb0 con 0x562dd5af6ad0 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a197fa640 1 -- 172.21.15.172:0/4209107294 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 74) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1a24035020 con 0x562dd5af6ad0 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a43a29740 10 client.9459 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a43a29740 10 client.9459 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a43a29740 20 client.9459 populate_metadata read hostname 'smithi172' 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a43a29740 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562dd5adc4b0 0x562dd5adc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a43a29740 4 client.9459 mds_command: new command op to 9294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a43a29740 1 -- 172.21.15.172:0/4209107294 --> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562dd5a70920 con 0x562dd5adc4b0 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562dd5adc4b0 0x562dd5adc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a197fa640 10 client.9459 ms_handle_connect on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.975+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562dd5adc4b0 0x562dd5adc890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10d52670704900f0 server_cookie=366246dd82ac8f9c in_seq=0 out_seq=0 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a197fa640 1 -- 172.21.15.172:0/4209107294 <== mds.0 v2:172.21.15.172:6836/3347790695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562dd5a70920 con 0x562dd5adc4b0 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a197fa640 10 client.9459 handle_command_reply: tid=0 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 client.9459 shutdown 2024-04-25T08:51:01.976 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 -- 172.21.15.172:0/4209107294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5af6ad0 msgr2=0x562dd5b07500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5af6ad0 0x562dd5b07500 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f1a240090c0 tx=0x7f1a24004730 comp rx=0 tx=0).stop 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 -- 172.21.15.172:0/4209107294 shutdown_connections 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562dd5adc4b0 0x562dd5adc890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5b04c00 0x562dd5b07a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5af6ad0 0x562dd5b07500 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a197fa640 0 client.9459 ms_handle_reset on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 --2- 172.21.15.172:0/4209107294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5ad9230 0x562dd5ac8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 -- 172.21.15.172:0/4209107294 >> 172.21.15.172:0/4209107294 conn(0x562dd5aaef10 msgr2=0x562dd5af36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 -- 172.21.15.172:0/4209107294 shutdown_connections 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 1 -- 172.21.15.172:0/4209107294 wait complete. 2024-04-25T08:51:01.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.976+0000 7f1a43a29740 20 client.9459 trim_cache size 0 max 16384 2024-04-25T08:51:01.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a43a29740 1 Processor -- start 2024-04-25T08:51:01.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a43a29740 1 -- start start 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5ad9230 0x562dd5b16bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5af6ad0 0x562dd5aecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5b04c00 0x562dd5b07350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a43a29740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1feaf0 con 0x562dd5b04c00 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a43a29740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1fdce0 con 0x562dd5af6ad0 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a43a29740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1fd140 con 0x562dd5ad9230 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a3ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5b04c00 0x562dd5b07350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a3ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5b04c00 0x562dd5b07350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60148/0 (socket says 172.21.15.172:60148) 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.992+0000 7f1a3ad9d640 1 -- 172.21.15.172:0/29878285 learned_addr learned my addr 172.21.15.172:0/29878285 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5ad9230 0x562dd5b16bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a33fff640 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5af6ad0 0x562dd5aecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a3ad9d640 1 -- 172.21.15.172:0/29878285 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5ad9230 msgr2=0x562dd5b16bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a3ad9d640 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5ad9230 0x562dd5b16bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a3ad9d640 1 -- 172.21.15.172:0/29878285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5af6ad0 msgr2=0x562dd5aecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a3ad9d640 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5af6ad0 0x562dd5aecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a3ad9d640 1 -- 172.21.15.172:0/29878285 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dd5aafd40 con 0x562dd5b04c00 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5ad9230 0x562dd5b16bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a33fff640 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5af6ad0 0x562dd5aecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a3ad9d640 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5b04c00 0x562dd5b07350 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0703c0 tx=0x7f1a34001db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0f7eda6a66d5df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a1b7fe640 1 -- 172.21.15.172:0/29878285 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3401c070 con 0x562dd5b04c00 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a1b7fe640 1 -- 172.21.15.172:0/29878285 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a34001ee0 con 0x562dd5b04c00 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a1b7fe640 1 -- 172.21.15.172:0/29878285 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34005720 con 0x562dd5b04c00 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a43a29740 1 -- 172.21.15.172:0/29878285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5b04c00 msgr2=0x562dd5b07350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.993+0000 7f1a43a29740 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5b04c00 0x562dd5b07350 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0703c0 tx=0x7f1a34001db0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.994+0000 7f1a43a29740 1 -- 172.21.15.172:0/29878285 shutdown_connections 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.994+0000 7f1a43a29740 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5af6ad0 0x562dd5aecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.994+0000 7f1a43a29740 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5b04c00 0x562dd5b07350 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.994+0000 7f1a43a29740 1 --2- 172.21.15.172:0/29878285 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5ad9230 0x562dd5b16bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.994+0000 7f1a43a29740 1 -- 172.21.15.172:0/29878285 >> 172.21.15.172:0/29878285 conn(0x562dd5aaef10 msgr2=0x562dd5ac88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:01.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.994+0000 7f1a43a29740 1 -- 172.21.15.172:0/29878285 shutdown_connections 2024-04-25T08:51:01.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.994+0000 7f1a43a29740 1 -- 172.21.15.172:0/29878285 wait complete. 2024-04-25T08:51:01.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.994+0000 7f1a43a29740 1 -- start start 2024-04-25T08:51:01.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.994+0000 7f1a43a29740 1 Processor -- start 2024-04-25T08:51:01.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5aad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5af6ad0 0x562dd5b62250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a43a29740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5b04c00 0x562dd5b07120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a43a29740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dd5b044a0 con 0x562dd5ad9230 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a43a29740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1fd6e0 con 0x562dd5b04c00 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a43a29740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x562dd5b057e0 con 0x562dd5af6ad0 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a43a29740 10 client.0 _ll_register_callbacks cb 0x562dd5aa9c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a3a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5aad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a3a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5aad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60154/0 (socket says 172.21.15.172:60154) 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a3a59c640 1 -- 172.21.15.172:0/2976484108 learned_addr learned my addr 172.21.15.172:0/2976484108 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a33fff640 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5af6ad0 0x562dd5b62250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a3ad9d640 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5b04c00 0x562dd5b07120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a3a59c640 1 -- 172.21.15.172:0/2976484108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5af6ad0 msgr2=0x562dd5b62250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5af6ad0 0x562dd5b62250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a3a59c640 1 -- 172.21.15.172:0/2976484108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5b04c00 msgr2=0x562dd5b07120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:01.991 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5b04c00 0x562dd5b07120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.995+0000 7f1a3a59c640 1 -- 172.21.15.172:0/2976484108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562dd5b03db0 con 0x562dd5ad9230 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a3ad9d640 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5b04c00 0x562dd5b07120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a3a59c640 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5aad110 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c001050 tx=0x7f1a2c07a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f97c9706df686bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a197fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a197fa640 1 -- 172.21.15.172:0/2976484108 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c095030 con 0x562dd5ad9230 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a197fa640 1 -- 172.21.15.172:0/2976484108 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1a2c007720 con 0x562dd5ad9230 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a43a29740 1 -- 172.21.15.172:0/2976484108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a34001ee0 con 0x562dd5ad9230 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a197fa640 1 -- 172.21.15.172:0/2976484108 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a2c07ccb0 con 0x562dd5ad9230 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a43a29740 10 client.9465 fetch_fsmap learned FSMap version 74 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a43a29740 1 -- 172.21.15.172:0/2976484108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x562dd5b627f0 con 0x562dd5ad9230 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a197fa640 1 -- 172.21.15.172:0/2976484108 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a34001ee0 con 0x562dd5ad9230 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a197fa640 1 -- 172.21.15.172:0/2976484108 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 74) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1a2c0751d0 con 0x562dd5ad9230 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a43a29740 10 client.9465 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a43a29740 10 client.9465 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T08:51:01.992 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a43a29740 20 client.9465 populate_metadata read hostname 'smithi172' 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a43a29740 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562dd5b665a0 0x562dd5ad74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a43a29740 4 client.9465 mds_command: new command op to 9294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a43a29740 1 -- 172.21.15.172:0/2976484108 --> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562dd5a1ef50 con 0x562dd5b665a0 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.996+0000 7f1a33fff640 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562dd5b665a0 0x562dd5ad74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a197fa640 10 client.9465 ms_handle_connect on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a33fff640 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562dd5b665a0 0x562dd5ad74a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62ae7f9d51bfe7d9 server_cookie=a310cfae3d24c6c0 in_seq=0 out_seq=0 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a197fa640 1 -- 172.21.15.172:0/2976484108 <== mds.0 v2:172.21.15.172:6836/3347790695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562dd5a1ef50 con 0x562dd5b665a0 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a197fa640 10 client.9465 handle_command_reply: tid=0 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 client.9465 shutdown 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 -- 172.21.15.172:0/2976484108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 msgr2=0x562dd5aad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5aad110 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c001050 tx=0x7f1a2c07a000 comp rx=0 tx=0).stop 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 -- 172.21.15.172:0/2976484108 shutdown_connections 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562dd5b665a0 0x562dd5ad74a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562dd5b04c00 0x562dd5b07120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562dd5af6ad0 0x562dd5b62250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 --2- 172.21.15.172:0/2976484108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562dd5ad9230 0x562dd5aad110 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a197fa640 0 client.9465 ms_handle_reset on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:01.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 -- 172.21.15.172:0/2976484108 >> 172.21.15.172:0/2976484108 conn(0x562dd5aaef10 msgr2=0x562dd5b16bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:01.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 -- 172.21.15.172:0/2976484108 shutdown_connections 2024-04-25T08:51:01.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 1 -- 172.21.15.172:0/2976484108 wait complete. 2024-04-25T08:51:01.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.997+0000 7f1a43a29740 20 client.9465 trim_cache size 0 max 16384 2024-04-25T08:51:01.994 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:51:01.994 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:51:01.994 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:51:01.994 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 9294, 2024-04-25T08:51:01.995 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:51:01.995 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:51:01.995 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:51:01.995 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 8.9250872809999997, 2024-04-25T08:51:01.995 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 74, 2024-04-25T08:51:01.995 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 131, 2024-04-25T08:51:01.995 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 131, 2024-04-25T08:51:01.995 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 14.011939728 2024-04-25T08:51:01.995 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:51:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 -- 172.21.15.172:0/173328756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a1c06b4d0 msgr2=0x7f1a1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a1c06b4d0 0x7f1a1c06d990 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0b3340 tx=0x7f1a24009110 comp rx=0 tx=0).stop 2024-04-25T08:51:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 -- 172.21.15.172:0/173328756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 msgr2=0x7f1a3c149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 0x7f1a3c149e30 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c001200 tx=0x7f1a3c0cf140 comp rx=0 tx=0).stop 2024-04-25T08:51:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 -- 172.21.15.172:0/173328756 shutdown_connections 2024-04-25T08:51:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1a1c06b4d0 0x7f1a1c06d990 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c14eea0 0x7f1a3c14f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1a3c150b60 0x7f1a3c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 --2- 172.21.15.172:0/173328756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280039e0 0x7f1a3c149e30 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 -- 172.21.15.172:0/173328756 >> 172.21.15.172:0/173328756 conn(0x7f1a3c061600 msgr2=0x7f1a3c15f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:01.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 -- 172.21.15.172:0/173328756 shutdown_connections 2024-04-25T08:51:01.997 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:01.998+0000 7f1a40c4a640 1 -- 172.21.15.172:0/173328756 wait complete. 2024-04-25T08:51:01.999 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:51:02.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.106+0000 7f9484e8f640 1 Processor -- start 2024-04-25T08:51:02.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.106+0000 7f9484e8f640 1 -- start start 2024-04-25T08:51:02.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f9484e8f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94800b6cb0 0x7f94800b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:02.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f9484e8f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94800ceee0 con 0x7f94800b5a60 2024-04-25T08:51:02.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f9484e8f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94800d1d10 con 0x7f948015db70 2024-04-25T08:51:02.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f9484e8f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94800d1ff0 con 0x7f94800b6cb0 2024-04-25T08:51:02.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947ed9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f94800b5a60 0x7f94800d27f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:48462/0 (socket says 172.21.15.172:48462) 2024-04-25T08:51:02.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947ed9d640 1 -- 172.21.15.172:0/1409693066 learned_addr learned my addr 172.21.15.172:0/1409693066 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:02.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f9477fff640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94800b6cb0 0x7f94800b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:02.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494177568 0 0) 0x7f94800ceee0 con 0x7f94800b5a60 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f946c003520 con 0x7f94800b5a60 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3036774209 0 0) 0x7f946c003520 con 0x7f94800b5a60 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94800b6cb0 msgr2=0x7f94800b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94800b6cb0 0x7f94800b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 >> v1:172.21.15.186:6789/0 conn(0x7f948015db70 legacy=0x7f9480162150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94800d22d0 con 0x7f94800b5a60 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f94780019f0 con 0x7f94800b5a60 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 >> v1:172.21.15.172:6789/0 conn(0x7f94800b5a60 legacy=0x7f94800d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94800b6cb0 0x7f946c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f946c003f20 0x7f946c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f946c004d40 0x7f946c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94800d1ff0 con 0x7f946c003f20 2024-04-25T08:51:02.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c00ba20 con 0x7f946c004d40 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.107+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c00bc20 con 0x7f94800b6cb0 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.108+0000 7f9477fff640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f946c003f20 0x7f946c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.108+0000 7f947e59c640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94800b6cb0 0x7f946c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.108+0000 7f947ed9d640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f946c004d40 0x7f946c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.108+0000 7f9477fff640 1 -- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94800b6cb0 msgr2=0x7f946c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.108+0000 7f9477fff640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94800b6cb0 0x7f946c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.108+0000 7f9477fff640 1 -- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f946c004d40 msgr2=0x7f946c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.108+0000 7f9477fff640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f946c004d40 0x7f946c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.108+0000 7f9477fff640 1 -- 172.21.15.172:0/1409693066 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c003520 con 0x7f946c003f20 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f9477fff640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f946c003f20 0x7f946c004800 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f9468009a90 tx=0x7f946c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580095c23ccf3297 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468036070 con 0x7f946c003f20 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9468031400 con 0x7f946c003f20 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f947dd9b640 1 -- 172.21.15.172:0/1409693066 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468009690 con 0x7f946c003f20 2024-04-25T08:51:02.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f9484e8f640 1 -- 172.21.15.172:0/1409693066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f946c003f20 msgr2=0x7f946c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f9484e8f640 1 --2- 172.21.15.172:0/1409693066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f946c003f20 0x7f946c004800 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f9468009a90 tx=0x7f946c005830 comp rx=0 tx=0).stop 2024-04-25T08:51:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f947ed9d640 1 -- 172.21.15.172:0/1409693066 reap_dead start 2024-04-25T08:51:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f9484e8f640 1 -- 172.21.15.172:0/1409693066 shutdown_connections 2024-04-25T08:51:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f9484e8f640 1 -- 172.21.15.172:0/1409693066 >> 172.21.15.172:0/1409693066 conn(0x7f94800d0520 msgr2=0x7f94800d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f9484e8f640 1 -- 172.21.15.172:0/1409693066 shutdown_connections 2024-04-25T08:51:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.109+0000 7f9484e8f640 1 -- 172.21.15.172:0/1409693066 wait complete. 2024-04-25T08:51:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9484e8f640 1 Processor -- start 2024-04-25T08:51:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9484e8f640 1 -- start start 2024-04-25T08:51:02.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9484e8f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f946c003f20 0x7f94800cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:02.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9484e8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94800cc650 0x7f94801f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:02.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9484e8f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f948015b9d0 0x7f948015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:02.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9484e8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94800cf1c0 con 0x7f94800cc650 2024-04-25T08:51:02.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9484e8f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94800ce530 con 0x7f948015b9d0 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9484e8f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94800cf340 con 0x7f946c003f20 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9477fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94800cc650 0x7f94801f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9477fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94800cc650 0x7f94801f2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60172/0 (socket says 172.21.15.172:60172) 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.111+0000 7f9477fff640 1 -- 172.21.15.172:0/1760557768 learned_addr learned my addr 172.21.15.172:0/1760557768 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f947ed9d640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f948015b9d0 0x7f948015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f947e59c640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f946c003f20 0x7f94800cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9477fff640 1 -- 172.21.15.172:0/1760557768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f946c003f20 msgr2=0x7f94800cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9477fff640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f946c003f20 0x7f94800cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9477fff640 1 -- 172.21.15.172:0/1760557768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f948015b9d0 msgr2=0x7f948015be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9477fff640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f948015b9d0 0x7f948015be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9477fff640 1 -- 172.21.15.172:0/1760557768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94800cce10 con 0x7f94800cc650 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9477fff640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94800cc650 0x7f94801f2bf0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f9468000c00 tx=0x7f9468004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9476ffd640 1 -- 172.21.15.172:0/1760557768 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468040020 con 0x7f94800cc650 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9476ffd640 1 -- 172.21.15.172:0/1760557768 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9468003c60 con 0x7f94800cc650 2024-04-25T08:51:02.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9484e8f640 1 -- 172.21.15.172:0/1760557768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94800cd0f0 con 0x7f94800cc650 2024-04-25T08:51:02.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9476ffd640 1 -- 172.21.15.172:0/1760557768 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468036040 con 0x7f94800cc650 2024-04-25T08:51:02.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.112+0000 7f9484e8f640 1 -- 172.21.15.172:0/1760557768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94800cd6b0 con 0x7f94800cc650 2024-04-25T08:51:02.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.113+0000 7f9484e8f640 1 -- 172.21.15.172:0/1760557768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9480073990 con 0x7f94800cc650 2024-04-25T08:51:02.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.113+0000 7f9476ffd640 1 -- 172.21.15.172:0/1760557768 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9468043020 con 0x7f94800cc650 2024-04-25T08:51:02.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.114+0000 7f9476ffd640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f946006b4d0 0x7f946006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:02.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.114+0000 7f9476ffd640 1 -- 172.21.15.172:0/1760557768 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f94680aa420 con 0x7f94800cc650 2024-04-25T08:51:02.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.114+0000 7f947e59c640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f946006b4d0 0x7f946006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:02.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.114+0000 7f947e59c640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f946006b4d0 0x7f946006d990 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f94700019c0 tx=0x7f9470009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:02.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.118+0000 7f9476ffd640 1 -- 172.21.15.172:0/1760557768 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f946804a070 con 0x7f94800cc650 2024-04-25T08:51:02.316 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.326+0000 7f9484e8f640 1 -- 172.21.15.172:0/1760557768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94800d1820 con 0x7f94800cc650 2024-04-25T08:51:02.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.326+0000 7f9476ffd640 1 -- 172.21.15.172:0/1760557768 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7f94680044e0 con 0x7f94800cc650 2024-04-25T08:51:02.317 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 -- 172.21.15.172:0/1760557768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f946006b4d0 msgr2=0x7f946006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f946006b4d0 0x7f946006d990 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f94700019c0 tx=0x7f9470009040 comp rx=0 tx=0).stop 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 -- 172.21.15.172:0/1760557768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94800cc650 msgr2=0x7f94801f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94800cc650 0x7f94801f2bf0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f9468000c00 tx=0x7f9468004730 comp rx=0 tx=0).stop 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 -- 172.21.15.172:0/1760557768 shutdown_connections 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f946006b4d0 0x7f946006d990 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f948015b9d0 0x7f948015be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94800cc650 0x7f94801f2bf0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 --2- 172.21.15.172:0/1760557768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f946c003f20 0x7f94800cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 -- 172.21.15.172:0/1760557768 >> 172.21.15.172:0/1760557768 conn(0x7f94800d0520 msgr2=0x7f94800d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 -- 172.21.15.172:0/1760557768 shutdown_connections 2024-04-25T08:51:02.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:02.328+0000 7f9484e8f640 1 -- 172.21.15.172:0/1760557768 wait complete. 2024-04-25T08:51:02.330 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:51:02.330 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:51:02.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:51:02.330 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:51:02.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:51:02.330 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:51:02.330 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:51:02.330 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:51:02.330 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:51:02.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:02.331 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:51:02.346 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:51:02.346 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:51:02.346 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:51:02.346 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:51:02.346 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:51:02.346 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:51:02.346 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:51:02.346 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:51:02.346 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42256sec preferred_lft 42256sec 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:51:02.347 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether de:e6:d5:6e:7d:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::dce6:d5ff:fe6e:7d91/64 scope link 2024-04-25T08:51:02.348 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:51:02.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:02.349 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:51:02.408 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:51:02.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:02.410 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:51:02.466 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:51:02.466 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:51:02.466 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:51:02.466 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:51:02.466 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:51:02.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:02.466 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:51:02.467 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:02.467 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:51:02.467 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:51:02.467 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:51:02.467 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:02.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:02.550 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:51:02.605 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:51:02.605 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:51:02.606 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:51:02.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:02.606 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:51:02.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:51:02.669 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:51:02.724 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:51:02.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:51:02.724 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:51:02.779 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:51:02.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:02.779 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:51:02.860 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:51:02.860 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:51:02.860 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:51:02.868 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:51:02.868 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:51:02.869 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:51:02.869 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:51:02.869 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:51:02.884 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:51:02.884 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:51:02.884 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:51:02.884 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:51:02.884 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:51:02.884 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:51:02.884 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:51:02.885 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:51:02.885 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:51:02.885 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:51:02.885 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:51:02.885 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:51:02.885 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:51:02.886 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:51:02.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:02.886 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:51:02.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:02.951 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:51:03.008 INFO:teuthology.orchestra.run.smithi172.stdout:client7049 2024-04-25T08:51:03.008 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:51:03.008 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:51:03.064 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.211+0000 7f938bbc8640 1 Processor -- start 2024-04-25T08:51:03.202 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.212+0000 7f938bbc8640 1 -- start start 2024-04-25T08:51:03.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.212+0000 7f938bbc8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f938415dd80 0x7f938415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.212+0000 7f938bbc8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f938406caf0 0x7f93840cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.212+0000 7f938bbc8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93840cfaf0 con 0x7f9384161800 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.212+0000 7f938bbc8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938415e6a0 con 0x7f938415dd80 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.212+0000 7f938bbc8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938415e8e0 con 0x7f938406caf0 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.213+0000 7f9389964640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f938415dd80 0x7f938415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.213+0000 7f9389964640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f938415dd80 0x7f938415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60182/0 (socket says 172.21.15.172:60182) 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.213+0000 7f9389964640 1 -- 172.21.15.172:0/4286893858 learned_addr learned my addr 172.21.15.172:0/4286893858 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.213+0000 7f938a165640 1 --2- 172.21.15.172:0/4286893858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f938406caf0 0x7f93840cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.213+0000 7f9389964640 1 -- 172.21.15.172:0/4286893858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f938406caf0 msgr2=0x7f93840cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.213+0000 7f9389964640 1 --2- 172.21.15.172:0/4286893858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f938406caf0 0x7f93840cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.213+0000 7f9389964640 1 -- 172.21.15.172:0/4286893858 >> v1:172.21.15.186:6789/0 conn(0x7f9384161800 legacy=0x7f938406c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:03.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.213+0000 7f9389964640 1 -- 172.21.15.172:0/4286893858 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938415ebc0 con 0x7f938415dd80 2024-04-25T08:51:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f9389964640 1 --2- 172.21.15.172:0/4286893858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938415dd80 0x7f938415e160 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f937c009870 tx=0x7f937c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2179a796eded1aa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f9388962640 1 -- 172.21.15.172:0/4286893858 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c037070 con 0x7f938415dd80 2024-04-25T08:51:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f9388962640 1 -- 172.21.15.172:0/4286893858 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c032440 con 0x7f938415dd80 2024-04-25T08:51:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f9388962640 1 -- 172.21.15.172:0/4286893858 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c032810 con 0x7f938415dd80 2024-04-25T08:51:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f938bbc8640 1 -- 172.21.15.172:0/4286893858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938415dd80 msgr2=0x7f938415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f938bbc8640 1 --2- 172.21.15.172:0/4286893858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938415dd80 0x7f938415e160 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f937c009870 tx=0x7f937c02a270 comp rx=0 tx=0).stop 2024-04-25T08:51:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f938bbc8640 1 -- 172.21.15.172:0/4286893858 shutdown_connections 2024-04-25T08:51:03.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f938bbc8640 1 --2- 172.21.15.172:0/4286893858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f938406caf0 0x7f93840cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f938bbc8640 1 --2- 172.21.15.172:0/4286893858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938415dd80 0x7f938415e160 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f938bbc8640 1 -- 172.21.15.172:0/4286893858 >> 172.21.15.172:0/4286893858 conn(0x7f93840b3310 msgr2=0x7f93840b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.214+0000 7f938bbc8640 1 -- 172.21.15.172:0/4286893858 shutdown_connections 2024-04-25T08:51:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.215+0000 7f938bbc8640 1 -- 172.21.15.172:0/4286893858 wait complete. 2024-04-25T08:51:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f938bbc8640 1 Processor -- start 2024-04-25T08:51:03.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f938bbc8640 1 -- start start 2024-04-25T08:51:03.209 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f938bbc8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938406caf0 0x7f9384158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f938bbc8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f938415dd80 0x7f93840c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f938bbc8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9384161800 0x7f938409a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f938bbc8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938406c0c0 con 0x7f938406caf0 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f938bbc8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938415f180 con 0x7f938415dd80 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f938bbc8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93840d0510 con 0x7f9384161800 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f9389964640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938406caf0 0x7f9384158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f9389964640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938406caf0 0x7f9384158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60190/0 (socket says 172.21.15.172:60190) 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.216+0000 7f9389964640 1 -- 172.21.15.172:0/1648360628 learned_addr learned my addr 172.21.15.172:0/1648360628 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f938a165640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9384161800 0x7f938409a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f9389163640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f938415dd80 0x7f93840c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f9389964640 1 -- 172.21.15.172:0/1648360628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9384161800 msgr2=0x7f938409a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f9389964640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9384161800 0x7f938409a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.210 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f9389964640 1 -- 172.21.15.172:0/1648360628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f938415dd80 msgr2=0x7f93840c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f9389964640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f938415dd80 0x7f93840c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f9389964640 1 -- 172.21.15.172:0/1648360628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93841572f0 con 0x7f938406caf0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f9389964640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938406caf0 0x7f9384158390 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f937c000c00 tx=0x7f937c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f93827fc640 1 -- 172.21.15.172:0/1648360628 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c041020 con 0x7f938406caf0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f93827fc640 1 -- 172.21.15.172:0/1648360628 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c0306c0 con 0x7f938406caf0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f938bbc8640 1 -- 172.21.15.172:0/1648360628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93841575d0 con 0x7f938406caf0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f93827fc640 1 -- 172.21.15.172:0/1648360628 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c037040 con 0x7f938406caf0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.217+0000 7f938bbc8640 1 -- 172.21.15.172:0/1648360628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9384157b90 con 0x7f938406caf0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.218+0000 7f938bbc8640 1 -- 172.21.15.172:0/1648360628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9384073990 con 0x7f938406caf0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.218+0000 7f93827fc640 1 -- 172.21.15.172:0/1648360628 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f937c044020 con 0x7f938406caf0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.219+0000 7f93827fc640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f937006b4d0 0x7f937006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.219+0000 7f93827fc640 1 -- 172.21.15.172:0/1648360628 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f937c0aab40 con 0x7f938406caf0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.219+0000 7f9389163640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f937006b4d0 0x7f937006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.219+0000 7f9389163640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f937006b4d0 0x7f937006d990 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9378007fd0 tx=0x7f9378009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:03.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.223+0000 7f93827fc640 1 -- 172.21.15.172:0/1648360628 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f937c04b030 con 0x7f938406caf0 2024-04-25T08:51:03.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.431+0000 7f938bbc8640 1 -- 172.21.15.172:0/1648360628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93840b77a0 con 0x7f938406caf0 2024-04-25T08:51:03.422 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.432+0000 7f93827fc640 1 -- 172.21.15.172:0/1648360628 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f937c079830 con 0x7f938406caf0 2024-04-25T08:51:03.422 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:03.422 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:51:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 -- 172.21.15.172:0/1648360628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f937006b4d0 msgr2=0x7f937006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f937006b4d0 0x7f937006d990 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9378007fd0 tx=0x7f9378009040 comp rx=0 tx=0).stop 2024-04-25T08:51:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 -- 172.21.15.172:0/1648360628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938406caf0 msgr2=0x7f9384158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938406caf0 0x7f9384158390 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f937c000c00 tx=0x7f937c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 -- 172.21.15.172:0/1648360628 shutdown_connections 2024-04-25T08:51:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f937006b4d0 0x7f937006d990 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f938415dd80 0x7f93840c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9384161800 0x7f938409a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 --2- 172.21.15.172:0/1648360628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f938406caf0 0x7f9384158390 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 -- 172.21.15.172:0/1648360628 >> 172.21.15.172:0/1648360628 conn(0x7f93840b3310 msgr2=0x7f938406d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 -- 172.21.15.172:0/1648360628 shutdown_connections 2024-04-25T08:51:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.434+0000 7f938bbc8640 1 -- 172.21.15.172:0/1648360628 wait complete. 2024-04-25T08:51:03.435 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:03.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.542+0000 7f499bc6f640 1 Processor -- start 2024-04-25T08:51:03.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.542+0000 7f499bc6f640 1 -- start start 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.543+0000 7f499bc6f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499415a790 0x7f49940d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.543+0000 7f499bc6f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f499406fea0 0x7f49940d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.543+0000 7f499bc6f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f49940af9c0 0x7f4994072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.543+0000 7f499bc6f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49940b3710 con 0x7f49940af9c0 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.543+0000 7f499bc6f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49940cf0e0 con 0x7f499406fea0 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.543+0000 7f499bc6f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49940cf3c0 con 0x7f499415a790 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.543+0000 7f499a20c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f49940af9c0 0x7f4994072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.543+0000 7f499a20c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f49940af9c0 0x7f4994072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60202/0 (socket says 172.21.15.172:60202) 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.543+0000 7f499a20c640 1 -- 172.21.15.172:0/1855398219 learned_addr learned my addr 172.21.15.172:0/1855398219 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f4999a0b640 1 --2- 172.21.15.172:0/1855398219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499415a790 0x7f49940d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.535 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f499920a640 1 --2- 172.21.15.172:0/1855398219 >> v2:172.21.15.186:3300/0 conn(0x7f499406fea0 0x7f49940d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f499a20c640 1 -- 172.21.15.172:0/1855398219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499415a790 msgr2=0x7f49940d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f499a20c640 1 --2- 172.21.15.172:0/1855398219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499415a790 0x7f49940d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f499a20c640 1 -- 172.21.15.172:0/1855398219 >> v2:172.21.15.186:3300/0 conn(0x7f499406fea0 msgr2=0x7f49940d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f499a20c640 1 --2- 172.21.15.172:0/1855398219 >> v2:172.21.15.186:3300/0 conn(0x7f499406fea0 0x7f49940d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f499a20c640 1 -- 172.21.15.172:0/1855398219 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940cf6a0 con 0x7f49940af9c0 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f499920a640 1 --2- 172.21.15.172:0/1855398219 >> v2:172.21.15.186:3300/0 conn(0x7f499406fea0 0x7f49940d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f4999a0b640 1 --2- 172.21.15.172:0/1855398219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499415a790 0x7f49940d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f499a20c640 1 --2- 172.21.15.172:0/1855398219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 0x7f4994072300 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f49940b2f80 tx=0x7f498c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c377996d3418797f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.544+0000 7f4998a09640 1 -- 172.21.15.172:0/1855398219 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c037070 con 0x7f49940af9c0 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f4998a09640 1 -- 172.21.15.172:0/1855398219 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c032440 con 0x7f49940af9c0 2024-04-25T08:51:03.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f4998a09640 1 -- 172.21.15.172:0/1855398219 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c032810 con 0x7f49940af9c0 2024-04-25T08:51:03.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f499bc6f640 1 -- 172.21.15.172:0/1855398219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 msgr2=0x7f4994072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f499bc6f640 1 --2- 172.21.15.172:0/1855398219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 0x7f4994072300 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f49940b2f80 tx=0x7f498c02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f499bc6f640 1 -- 172.21.15.172:0/1855398219 shutdown_connections 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f499bc6f640 1 --2- 172.21.15.172:0/1855398219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 0x7f4994072300 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f499bc6f640 1 --2- 172.21.15.172:0/1855398219 >> v2:172.21.15.186:3300/0 conn(0x7f499406fea0 0x7f49940d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f499bc6f640 1 --2- 172.21.15.172:0/1855398219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499415a790 0x7f49940d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f499bc6f640 1 -- 172.21.15.172:0/1855398219 >> 172.21.15.172:0/1855398219 conn(0x7f49940b2370 msgr2=0x7f49940b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f499bc6f640 1 -- 172.21.15.172:0/1855398219 shutdown_connections 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.545+0000 7f499bc6f640 1 -- 172.21.15.172:0/1855398219 wait complete. 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.546+0000 7f499bc6f640 1 Processor -- start 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.546+0000 7f499bc6f640 1 -- start start 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499bc6f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499406fea0 0x7f4994143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499bc6f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 0x7f499415c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499bc6f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f499415a790 0x7f499415d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499bc6f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499415ab70 con 0x7f49940af9c0 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499bc6f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49940cf980 con 0x7f499415a790 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499bc6f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499415acf0 con 0x7f499406fea0 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499920a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 0x7f499415c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499920a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 0x7f499415c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60218/0 (socket says 172.21.15.172:60218) 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499920a640 1 -- 172.21.15.172:0/3197842200 learned_addr learned my addr 172.21.15.172:0/3197842200 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f4999a0b640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499406fea0 0x7f4994143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499a20c640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f499415a790 0x7f499415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499920a640 1 -- 172.21.15.172:0/3197842200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499406fea0 msgr2=0x7f4994143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499920a640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499406fea0 0x7f4994143fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499920a640 1 -- 172.21.15.172:0/3197842200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f499415a790 msgr2=0x7f499415d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499920a640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f499415a790 0x7f499415d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.547+0000 7f499920a640 1 -- 172.21.15.172:0/3197842200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49941503c0 con 0x7f49940af9c0 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.548+0000 7f499920a640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 0x7f499415c8e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f498400c820 tx=0x7f498400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.548+0000 7f498a7fc640 1 -- 172.21.15.172:0/3197842200 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984015070 con 0x7f49940af9c0 2024-04-25T08:51:03.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.548+0000 7f498a7fc640 1 -- 172.21.15.172:0/3197842200 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4984004020 con 0x7f49940af9c0 2024-04-25T08:51:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.548+0000 7f499bc6f640 1 -- 172.21.15.172:0/3197842200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49941506a0 con 0x7f49940af9c0 2024-04-25T08:51:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.548+0000 7f498a7fc640 1 -- 172.21.15.172:0/3197842200 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984004410 con 0x7f49940af9c0 2024-04-25T08:51:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.548+0000 7f499bc6f640 1 -- 172.21.15.172:0/3197842200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4994150c60 con 0x7f49940af9c0 2024-04-25T08:51:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.549+0000 7f499bc6f640 1 -- 172.21.15.172:0/3197842200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4994073990 con 0x7f49940af9c0 2024-04-25T08:51:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.549+0000 7f498a7fc640 1 -- 172.21.15.172:0/3197842200 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4984007830 con 0x7f49940af9c0 2024-04-25T08:51:03.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.550+0000 7f498a7fc640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f497806b500 0x7f497806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:03.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.550+0000 7f498a7fc640 1 -- 172.21.15.172:0/3197842200 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f498408a140 con 0x7f49940af9c0 2024-04-25T08:51:03.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.550+0000 7f4999a0b640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f497806b500 0x7f497806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:03.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.550+0000 7f4999a0b640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f497806b500 0x7f497806d9c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f499414bf80 tx=0x7f4990007770 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:03.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.554+0000 7f498a7fc640 1 -- 172.21.15.172:0/3197842200 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4984058750 con 0x7f49940af9c0 2024-04-25T08:51:03.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.758+0000 7f499bc6f640 1 -- 172.21.15.172:0/3197842200 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49941444f0 con 0x7f49940af9c0 2024-04-25T08:51:03.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.759+0000 7f498a7fc640 1 -- 172.21.15.172:0/3197842200 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f498405c7f0 con 0x7f49940af9c0 2024-04-25T08:51:03.749 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:03.750 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:03.750 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 -- 172.21.15.172:0/3197842200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f497806b500 msgr2=0x7f497806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f497806b500 0x7f497806d9c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f499414bf80 tx=0x7f4990007770 comp rx=0 tx=0).stop 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 -- 172.21.15.172:0/3197842200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 msgr2=0x7f499415c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 0x7f499415c8e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f498400c820 tx=0x7f498400cce0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 -- 172.21.15.172:0/3197842200 shutdown_connections 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f497806b500 0x7f497806d9c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f499415a790 0x7f499415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49940af9c0 0x7f499415c8e0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 --2- 172.21.15.172:0/3197842200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f499406fea0 0x7f4994143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 -- 172.21.15.172:0/3197842200 >> 172.21.15.172:0/3197842200 conn(0x7f49940b2370 msgr2=0x7f4994072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 -- 172.21.15.172:0/3197842200 shutdown_connections 2024-04-25T08:51:03.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:03.761+0000 7f499bc6f640 1 -- 172.21.15.172:0/3197842200 wait complete. 2024-04-25T08:51:03.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:03.764 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:03.764 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:03.764 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T08:51:03.764 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:03.764 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:03.764 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:03.764 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:03.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.795 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968594 s, 108 MB/s 2024-04-25T08:51:03.804 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.804 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.804 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00809693 s, 130 MB/s 2024-04-25T08:51:03.812 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.812 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.812 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667661 s, 157 MB/s 2024-04-25T08:51:03.820 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.821 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.821 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798891 s, 131 MB/s 2024-04-25T08:51:03.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.829 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075807 s, 138 MB/s 2024-04-25T08:51:03.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.838 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832771 s, 126 MB/s 2024-04-25T08:51:03.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.847 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077019 s, 136 MB/s 2024-04-25T08:51:03.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.853 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056499 s, 186 MB/s 2024-04-25T08:51:03.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.862 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747808 s, 140 MB/s 2024-04-25T08:51:03.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.870 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758239 s, 138 MB/s 2024-04-25T08:51:03.878 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.878 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.878 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684288 s, 153 MB/s 2024-04-25T08:51:03.885 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.885 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.885 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063833 s, 164 MB/s 2024-04-25T08:51:03.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.893 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703646 s, 149 MB/s 2024-04-25T08:51:03.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.901 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.901 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722251 s, 145 MB/s 2024-04-25T08:51:03.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.909 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695009 s, 151 MB/s 2024-04-25T08:51:03.917 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.917 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.918 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075245 s, 139 MB/s 2024-04-25T08:51:03.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.925 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658358 s, 159 MB/s 2024-04-25T08:51:03.932 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.932 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.932 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665795 s, 157 MB/s 2024-04-25T08:51:03.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.940 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665403 s, 158 MB/s 2024-04-25T08:51:03.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.948 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.948 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075587 s, 139 MB/s 2024-04-25T08:51:03.957 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.957 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.957 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746052 s, 141 MB/s 2024-04-25T08:51:03.964 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.964 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.965 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682631 s, 154 MB/s 2024-04-25T08:51:03.972 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.972 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.972 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670836 s, 156 MB/s 2024-04-25T08:51:03.980 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.980 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.980 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745871 s, 141 MB/s 2024-04-25T08:51:03.987 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.987 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.987 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058937 s, 178 MB/s 2024-04-25T08:51:03.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:03.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:03.995 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735054 s, 143 MB/s 2024-04-25T08:51:04.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.003 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680766 s, 154 MB/s 2024-04-25T08:51:04.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.011 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718463 s, 146 MB/s 2024-04-25T08:51:04.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.019 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693213 s, 151 MB/s 2024-04-25T08:51:04.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.027 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.027 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664804 s, 158 MB/s 2024-04-25T08:51:04.034 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.034 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.034 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647528 s, 162 MB/s 2024-04-25T08:51:04.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.041 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.041 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668326 s, 157 MB/s 2024-04-25T08:51:04.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:04.043 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:04.043 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:04.043 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T08:51:04.043 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:04.043 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:04.043 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:04.043 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:04.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.108 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674152 s, 156 MB/s 2024-04-25T08:51:04.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.115 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649653 s, 161 MB/s 2024-04-25T08:51:04.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.122 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061948 s, 169 MB/s 2024-04-25T08:51:04.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.129 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058549 s, 179 MB/s 2024-04-25T08:51:04.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.136 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587964 s, 178 MB/s 2024-04-25T08:51:04.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735973 s, 142 MB/s 2024-04-25T08:51:04.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.153 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683919 s, 153 MB/s 2024-04-25T08:51:04.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.161 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767656 s, 137 MB/s 2024-04-25T08:51:04.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.168 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684411 s, 153 MB/s 2024-04-25T08:51:04.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.177 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077575 s, 135 MB/s 2024-04-25T08:51:04.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.185 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069244 s, 151 MB/s 2024-04-25T08:51:04.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.193 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733039 s, 143 MB/s 2024-04-25T08:51:04.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.201 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067267 s, 156 MB/s 2024-04-25T08:51:04.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.209 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706337 s, 148 MB/s 2024-04-25T08:51:04.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.217 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740004 s, 142 MB/s 2024-04-25T08:51:04.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.224 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661118 s, 159 MB/s 2024-04-25T08:51:04.232 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.232 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.232 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650402 s, 161 MB/s 2024-04-25T08:51:04.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.239 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615521 s, 170 MB/s 2024-04-25T08:51:04.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.246 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621448 s, 169 MB/s 2024-04-25T08:51:04.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.254 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071793 s, 146 MB/s 2024-04-25T08:51:04.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.262 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729326 s, 144 MB/s 2024-04-25T08:51:04.270 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.270 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.270 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734048 s, 143 MB/s 2024-04-25T08:51:04.278 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.278 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.278 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671751 s, 156 MB/s 2024-04-25T08:51:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651818 s, 161 MB/s 2024-04-25T08:51:04.293 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.293 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.293 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644399 s, 163 MB/s 2024-04-25T08:51:04.301 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.301 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.301 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007262 s, 144 MB/s 2024-04-25T08:51:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745776 s, 141 MB/s 2024-04-25T08:51:04.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696457 s, 151 MB/s 2024-04-25T08:51:04.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.324 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662395 s, 158 MB/s 2024-04-25T08:51:04.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.332 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668341 s, 157 MB/s 2024-04-25T08:51:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629514 s, 167 MB/s 2024-04-25T08:51:04.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.347 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723901 s, 145 MB/s 2024-04-25T08:51:04.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:04.348 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:04.348 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:04.348 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T08:51:04.348 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:04.349 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:04.349 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:04.349 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:04.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608148 s, 172 MB/s 2024-04-25T08:51:04.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.421 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717519 s, 146 MB/s 2024-04-25T08:51:04.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.428 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666826 s, 157 MB/s 2024-04-25T08:51:04.436 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.436 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.436 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692333 s, 151 MB/s 2024-04-25T08:51:04.443 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.443 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.443 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660304 s, 159 MB/s 2024-04-25T08:51:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.451 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661691 s, 158 MB/s 2024-04-25T08:51:04.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.459 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680683 s, 154 MB/s 2024-04-25T08:51:04.466 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.466 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.467 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718068 s, 146 MB/s 2024-04-25T08:51:04.474 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.474 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.474 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654473 s, 160 MB/s 2024-04-25T08:51:04.481 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.481 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.481 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662194 s, 158 MB/s 2024-04-25T08:51:04.488 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.488 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.488 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579361 s, 181 MB/s 2024-04-25T08:51:04.495 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.495 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.495 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643802 s, 163 MB/s 2024-04-25T08:51:04.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.503 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717321 s, 146 MB/s 2024-04-25T08:51:04.510 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.511 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617775 s, 170 MB/s 2024-04-25T08:51:04.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.518 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664885 s, 158 MB/s 2024-04-25T08:51:04.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730964 s, 143 MB/s 2024-04-25T08:51:04.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.534 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703235 s, 149 MB/s 2024-04-25T08:51:04.541 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.541 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.541 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633939 s, 165 MB/s 2024-04-25T08:51:04.549 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.549 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.549 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657828 s, 159 MB/s 2024-04-25T08:51:04.556 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.556 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.557 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665182 s, 158 MB/s 2024-04-25T08:51:04.564 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.564 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.564 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657815 s, 159 MB/s 2024-04-25T08:51:04.571 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.571 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.571 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627738 s, 167 MB/s 2024-04-25T08:51:04.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.579 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668889 s, 157 MB/s 2024-04-25T08:51:04.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.586 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654824 s, 160 MB/s 2024-04-25T08:51:04.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.593 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562958 s, 186 MB/s 2024-04-25T08:51:04.600 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.600 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.600 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634566 s, 165 MB/s 2024-04-25T08:51:04.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.607 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646122 s, 162 MB/s 2024-04-25T08:51:04.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.615 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661741 s, 158 MB/s 2024-04-25T08:51:04.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.621 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583106 s, 180 MB/s 2024-04-25T08:51:04.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.629 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658311 s, 159 MB/s 2024-04-25T08:51:04.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.637 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712996 s, 147 MB/s 2024-04-25T08:51:04.644 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.645 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673016 s, 156 MB/s 2024-04-25T08:51:04.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:04.646 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:04.646 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:04.646 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T08:51:04.647 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:04.647 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:04.647 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:04.647 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:04.709 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.709 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.709 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582952 s, 180 MB/s 2024-04-25T08:51:04.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.717 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630083 s, 166 MB/s 2024-04-25T08:51:04.724 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.724 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.724 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663137 s, 158 MB/s 2024-04-25T08:51:04.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.731 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584267 s, 179 MB/s 2024-04-25T08:51:04.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.739 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665643 s, 158 MB/s 2024-04-25T08:51:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.745 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595579 s, 176 MB/s 2024-04-25T08:51:04.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.753 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659162 s, 159 MB/s 2024-04-25T08:51:04.760 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.761 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.761 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717995 s, 146 MB/s 2024-04-25T08:51:04.768 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.768 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.768 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674758 s, 155 MB/s 2024-04-25T08:51:04.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.776 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718173 s, 146 MB/s 2024-04-25T08:51:04.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.784 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637018 s, 165 MB/s 2024-04-25T08:51:04.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.790 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.790 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579066 s, 181 MB/s 2024-04-25T08:51:04.798 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.798 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.799 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725137 s, 145 MB/s 2024-04-25T08:51:04.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.807 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730079 s, 144 MB/s 2024-04-25T08:51:04.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.814 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643055 s, 163 MB/s 2024-04-25T08:51:04.820 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.821 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.821 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562135 s, 187 MB/s 2024-04-25T08:51:04.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.829 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.829 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708929 s, 148 MB/s 2024-04-25T08:51:04.837 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.837 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.837 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725482 s, 145 MB/s 2024-04-25T08:51:04.844 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.845 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665549 s, 158 MB/s 2024-04-25T08:51:04.851 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.852 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626908 s, 167 MB/s 2024-04-25T08:51:04.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.859 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658449 s, 159 MB/s 2024-04-25T08:51:04.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.867 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674192 s, 156 MB/s 2024-04-25T08:51:04.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.873 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579851 s, 181 MB/s 2024-04-25T08:51:04.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.881 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007211 s, 145 MB/s 2024-04-25T08:51:04.889 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.890 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.890 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727123 s, 144 MB/s 2024-04-25T08:51:04.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.898 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701456 s, 149 MB/s 2024-04-25T08:51:04.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.905 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644624 s, 163 MB/s 2024-04-25T08:51:04.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.912 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.912 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663057 s, 158 MB/s 2024-04-25T08:51:04.920 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.920 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.920 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711041 s, 147 MB/s 2024-04-25T08:51:04.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.929 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732658 s, 143 MB/s 2024-04-25T08:51:04.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.936 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650379 s, 161 MB/s 2024-04-25T08:51:04.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:04.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:04.944 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694839 s, 151 MB/s 2024-04-25T08:51:04.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:04.945 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:04.945 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:04.945 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T08:51:04.945 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:04.945 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:04.945 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:04.945 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:05.009 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.009 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.009 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630568 s, 166 MB/s 2024-04-25T08:51:05.016 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.016 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.017 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642724 s, 163 MB/s 2024-04-25T08:51:05.023 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.023 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.023 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556415 s, 188 MB/s 2024-04-25T08:51:05.030 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.030 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.030 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631159 s, 166 MB/s 2024-04-25T08:51:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.038 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677936 s, 155 MB/s 2024-04-25T08:51:05.045 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.045 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.045 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629442 s, 167 MB/s 2024-04-25T08:51:05.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.051 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571672 s, 183 MB/s 2024-04-25T08:51:05.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.059 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666673 s, 157 MB/s 2024-04-25T08:51:05.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.067 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654009 s, 160 MB/s 2024-04-25T08:51:05.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.075 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731886 s, 143 MB/s 2024-04-25T08:51:05.081 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.081 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.081 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057175 s, 183 MB/s 2024-04-25T08:51:05.088 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.088 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.088 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564252 s, 186 MB/s 2024-04-25T08:51:05.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.096 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684681 s, 153 MB/s 2024-04-25T08:51:05.103 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.104 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.104 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698645 s, 150 MB/s 2024-04-25T08:51:05.111 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.112 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714489 s, 147 MB/s 2024-04-25T08:51:05.119 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.119 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.119 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652519 s, 161 MB/s 2024-04-25T08:51:05.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.127 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651794 s, 161 MB/s 2024-04-25T08:51:05.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.134 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640089 s, 164 MB/s 2024-04-25T08:51:05.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.142 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744375 s, 141 MB/s 2024-04-25T08:51:05.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.149 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590657 s, 178 MB/s 2024-04-25T08:51:05.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.155 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555827 s, 189 MB/s 2024-04-25T08:51:05.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.162 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056718 s, 185 MB/s 2024-04-25T08:51:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.170 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707415 s, 148 MB/s 2024-04-25T08:51:05.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.178 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695137 s, 151 MB/s 2024-04-25T08:51:05.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.185 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709519 s, 148 MB/s 2024-04-25T08:51:05.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.192 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574035 s, 183 MB/s 2024-04-25T08:51:05.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.199 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061931 s, 169 MB/s 2024-04-25T08:51:05.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.207 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664933 s, 158 MB/s 2024-04-25T08:51:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.214 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640516 s, 164 MB/s 2024-04-25T08:51:05.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.222 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063224 s, 166 MB/s 2024-04-25T08:51:05.228 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.229 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.229 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632745 s, 166 MB/s 2024-04-25T08:51:05.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.236 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059476 s, 176 MB/s 2024-04-25T08:51:05.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:05.237 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:05.237 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:05.237 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T08:51:05.237 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:05.237 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:05.237 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:05.237 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:05.301 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.302 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.302 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629522 s, 167 MB/s 2024-04-25T08:51:05.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067601 s, 155 MB/s 2024-04-25T08:51:05.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687676 s, 152 MB/s 2024-04-25T08:51:05.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.325 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750271 s, 140 MB/s 2024-04-25T08:51:05.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.332 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556536 s, 188 MB/s 2024-04-25T08:51:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628869 s, 167 MB/s 2024-04-25T08:51:05.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.346 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568239 s, 185 MB/s 2024-04-25T08:51:05.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.352 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577959 s, 181 MB/s 2024-04-25T08:51:05.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.361 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745115 s, 141 MB/s 2024-04-25T08:51:05.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.369 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708541 s, 148 MB/s 2024-04-25T08:51:05.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.376 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681541 s, 154 MB/s 2024-04-25T08:51:05.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.384 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648138 s, 162 MB/s 2024-04-25T08:51:05.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.391 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644187 s, 163 MB/s 2024-04-25T08:51:05.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.398 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062784 s, 167 MB/s 2024-04-25T08:51:05.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.405 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620918 s, 169 MB/s 2024-04-25T08:51:05.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636099 s, 165 MB/s 2024-04-25T08:51:05.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.421 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007168 s, 146 MB/s 2024-04-25T08:51:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.429 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073664 s, 142 MB/s 2024-04-25T08:51:05.437 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.437 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.437 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734623 s, 143 MB/s 2024-04-25T08:51:05.444 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.444 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.444 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062974 s, 167 MB/s 2024-04-25T08:51:05.452 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.452 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.452 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070965 s, 148 MB/s 2024-04-25T08:51:05.459 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.459 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.459 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576401 s, 182 MB/s 2024-04-25T08:51:05.467 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.467 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.467 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721572 s, 145 MB/s 2024-04-25T08:51:05.474 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.474 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.474 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587708 s, 178 MB/s 2024-04-25T08:51:05.481 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.482 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.482 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689222 s, 152 MB/s 2024-04-25T08:51:05.489 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.490 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711906 s, 147 MB/s 2024-04-25T08:51:05.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.497 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704443 s, 149 MB/s 2024-04-25T08:51:05.505 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.506 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707965 s, 148 MB/s 2024-04-25T08:51:05.513 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.513 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.513 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641556 s, 163 MB/s 2024-04-25T08:51:05.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.520 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619223 s, 169 MB/s 2024-04-25T08:51:05.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563085 s, 186 MB/s 2024-04-25T08:51:05.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.535 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747752 s, 140 MB/s 2024-04-25T08:51:05.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:05.536 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:05.536 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:05.537 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T08:51:05.537 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:05.537 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:05.537 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:05.537 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:05.600 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.600 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.600 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627702 s, 167 MB/s 2024-04-25T08:51:05.608 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.608 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.608 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680722 s, 154 MB/s 2024-04-25T08:51:05.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.615 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654702 s, 160 MB/s 2024-04-25T08:51:05.622 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.622 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.622 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558168 s, 188 MB/s 2024-04-25T08:51:05.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.629 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659971 s, 159 MB/s 2024-04-25T08:51:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.637 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676315 s, 155 MB/s 2024-04-25T08:51:05.644 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.644 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.644 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643053 s, 163 MB/s 2024-04-25T08:51:05.652 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.652 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.653 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727748 s, 144 MB/s 2024-04-25T08:51:05.661 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.661 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.661 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759316 s, 138 MB/s 2024-04-25T08:51:05.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.668 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650415 s, 161 MB/s 2024-04-25T08:51:05.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.675 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579742 s, 181 MB/s 2024-04-25T08:51:05.682 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.682 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.682 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634824 s, 165 MB/s 2024-04-25T08:51:05.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.690 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690475 s, 152 MB/s 2024-04-25T08:51:05.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.696 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570374 s, 184 MB/s 2024-04-25T08:51:05.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.704 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651019 s, 161 MB/s 2024-04-25T08:51:05.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.711 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630728 s, 166 MB/s 2024-04-25T08:51:05.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.719 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629966 s, 166 MB/s 2024-04-25T08:51:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.726 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667688 s, 157 MB/s 2024-04-25T08:51:05.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.733 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585536 s, 179 MB/s 2024-04-25T08:51:05.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.740 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631601 s, 166 MB/s 2024-04-25T08:51:05.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.747 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653936 s, 160 MB/s 2024-04-25T08:51:05.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.754 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575276 s, 182 MB/s 2024-04-25T08:51:05.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.762 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729182 s, 144 MB/s 2024-04-25T08:51:05.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567218 s, 185 MB/s 2024-04-25T08:51:05.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.776 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653295 s, 161 MB/s 2024-04-25T08:51:05.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.784 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644124 s, 163 MB/s 2024-04-25T08:51:05.793 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.793 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.793 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741378 s, 141 MB/s 2024-04-25T08:51:05.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.799 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643846 s, 163 MB/s 2024-04-25T08:51:05.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.807 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661802 s, 158 MB/s 2024-04-25T08:51:05.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.814 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645728 s, 162 MB/s 2024-04-25T08:51:05.822 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.822 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.823 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734644 s, 143 MB/s 2024-04-25T08:51:05.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.830 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705555 s, 149 MB/s 2024-04-25T08:51:05.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:05.832 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:05.832 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:05.832 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T08:51:05.832 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:05.832 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:05.832 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:05.832 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:05.894 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.895 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.895 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554721 s, 189 MB/s 2024-04-25T08:51:05.902 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.903 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723447 s, 145 MB/s 2024-04-25T08:51:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.910 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641454 s, 163 MB/s 2024-04-25T08:51:05.917 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.917 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.917 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653571 s, 160 MB/s 2024-04-25T08:51:05.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.924 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580732 s, 181 MB/s 2024-04-25T08:51:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664682 s, 158 MB/s 2024-04-25T08:51:05.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.938 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059225 s, 177 MB/s 2024-04-25T08:51:05.945 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.946 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.946 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639071 s, 164 MB/s 2024-04-25T08:51:05.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.954 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735056 s, 143 MB/s 2024-04-25T08:51:05.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.961 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644709 s, 163 MB/s 2024-04-25T08:51:05.969 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.969 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.969 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735052 s, 143 MB/s 2024-04-25T08:51:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.977 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673946 s, 156 MB/s 2024-04-25T08:51:05.984 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.984 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.984 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656421 s, 160 MB/s 2024-04-25T08:51:05.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.992 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.992 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675147 s, 155 MB/s 2024-04-25T08:51:05.998 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:05.999 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:05.999 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578357 s, 181 MB/s 2024-04-25T08:51:06.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.006 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627321 s, 167 MB/s 2024-04-25T08:51:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.012 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563053 s, 186 MB/s 2024-04-25T08:51:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.019 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574523 s, 183 MB/s 2024-04-25T08:51:06.027 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.027 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.027 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709653 s, 148 MB/s 2024-04-25T08:51:06.034 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.034 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.034 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585982 s, 179 MB/s 2024-04-25T08:51:06.042 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.042 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.042 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725015 s, 145 MB/s 2024-04-25T08:51:06.049 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.050 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.050 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675336 s, 155 MB/s 2024-04-25T08:51:06.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.056 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576571 s, 182 MB/s 2024-04-25T08:51:06.063 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.064 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.064 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633609 s, 165 MB/s 2024-04-25T08:51:06.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.072 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752498 s, 139 MB/s 2024-04-25T08:51:06.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.080 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732533 s, 143 MB/s 2024-04-25T08:51:06.088 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.088 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.088 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722184 s, 145 MB/s 2024-04-25T08:51:06.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.096 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681541 s, 154 MB/s 2024-04-25T08:51:06.103 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.103 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.103 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627856 s, 167 MB/s 2024-04-25T08:51:06.111 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.111 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.112 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731235 s, 143 MB/s 2024-04-25T08:51:06.119 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.119 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.119 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064194 s, 163 MB/s 2024-04-25T08:51:06.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.126 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642153 s, 163 MB/s 2024-04-25T08:51:06.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:06.127 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:06.127 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:06.127 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T08:51:06.127 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:06.127 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:06.127 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:06.128 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:06.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.193 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683649 s, 153 MB/s 2024-04-25T08:51:06.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.201 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066752 s, 157 MB/s 2024-04-25T08:51:06.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.208 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629066 s, 167 MB/s 2024-04-25T08:51:06.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.215 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655879 s, 160 MB/s 2024-04-25T08:51:06.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.223 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716805 s, 146 MB/s 2024-04-25T08:51:06.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.231 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730128 s, 144 MB/s 2024-04-25T08:51:06.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.239 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688202 s, 152 MB/s 2024-04-25T08:51:06.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.246 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626153 s, 167 MB/s 2024-04-25T08:51:06.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.254 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725849 s, 144 MB/s 2024-04-25T08:51:06.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.262 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642292 s, 163 MB/s 2024-04-25T08:51:06.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.269 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062358 s, 168 MB/s 2024-04-25T08:51:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.276 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665663 s, 158 MB/s 2024-04-25T08:51:06.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.283 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583325 s, 180 MB/s 2024-04-25T08:51:06.290 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.290 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.290 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598117 s, 175 MB/s 2024-04-25T08:51:06.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.297 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.297 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593763 s, 177 MB/s 2024-04-25T08:51:06.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.304 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624016 s, 168 MB/s 2024-04-25T08:51:06.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.311 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577831 s, 181 MB/s 2024-04-25T08:51:06.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577854 s, 181 MB/s 2024-04-25T08:51:06.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.325 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066718 s, 157 MB/s 2024-04-25T08:51:06.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.332 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659795 s, 159 MB/s 2024-04-25T08:51:06.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.340 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627594 s, 167 MB/s 2024-04-25T08:51:06.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.346 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569986 s, 184 MB/s 2024-04-25T08:51:06.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.354 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655569 s, 160 MB/s 2024-04-25T08:51:06.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.361 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637405 s, 165 MB/s 2024-04-25T08:51:06.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.368 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645407 s, 162 MB/s 2024-04-25T08:51:06.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.376 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717388 s, 146 MB/s 2024-04-25T08:51:06.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.383 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624966 s, 168 MB/s 2024-04-25T08:51:06.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.390 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623665 s, 168 MB/s 2024-04-25T08:51:06.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.397 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588788 s, 178 MB/s 2024-04-25T08:51:06.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.406 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726038 s, 144 MB/s 2024-04-25T08:51:06.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712893 s, 147 MB/s 2024-04-25T08:51:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654437 s, 160 MB/s 2024-04-25T08:51:06.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:06.422 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:06.422 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:06.422 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T08:51:06.422 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:06.422 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:06.422 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:06.423 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:06.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.487 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.487 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643547 s, 163 MB/s 2024-04-25T08:51:06.494 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.494 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.494 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640188 s, 164 MB/s 2024-04-25T08:51:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.501 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621898 s, 169 MB/s 2024-04-25T08:51:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.509 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701597 s, 149 MB/s 2024-04-25T08:51:06.516 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.516 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.516 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635343 s, 165 MB/s 2024-04-25T08:51:06.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.523 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641836 s, 163 MB/s 2024-04-25T08:51:06.531 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.532 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.532 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756125 s, 139 MB/s 2024-04-25T08:51:06.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.540 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710823 s, 148 MB/s 2024-04-25T08:51:06.547 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.547 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.547 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648405 s, 162 MB/s 2024-04-25T08:51:06.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.554 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635198 s, 165 MB/s 2024-04-25T08:51:06.561 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.561 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.561 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636488 s, 165 MB/s 2024-04-25T08:51:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.569 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672297 s, 156 MB/s 2024-04-25T08:51:06.575 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.576 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.576 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578773 s, 181 MB/s 2024-04-25T08:51:06.583 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.583 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.583 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584351 s, 179 MB/s 2024-04-25T08:51:06.590 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.590 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.590 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640972 s, 164 MB/s 2024-04-25T08:51:06.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.597 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661587 s, 158 MB/s 2024-04-25T08:51:06.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.606 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730871 s, 143 MB/s 2024-04-25T08:51:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.614 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074146 s, 141 MB/s 2024-04-25T08:51:06.622 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.622 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.622 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071527 s, 147 MB/s 2024-04-25T08:51:06.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.629 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618087 s, 170 MB/s 2024-04-25T08:51:06.636 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.636 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.636 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680559 s, 154 MB/s 2024-04-25T08:51:06.644 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.644 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.644 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635039 s, 165 MB/s 2024-04-25T08:51:06.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.650 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583893 s, 180 MB/s 2024-04-25T08:51:06.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.659 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.659 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711123 s, 147 MB/s 2024-04-25T08:51:06.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.666 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669966 s, 157 MB/s 2024-04-25T08:51:06.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.674 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.674 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065775 s, 159 MB/s 2024-04-25T08:51:06.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.681 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693697 s, 151 MB/s 2024-04-25T08:51:06.689 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.689 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.689 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666571 s, 157 MB/s 2024-04-25T08:51:06.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.696 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592936 s, 177 MB/s 2024-04-25T08:51:06.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.704 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691645 s, 152 MB/s 2024-04-25T08:51:06.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.711 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632898 s, 166 MB/s 2024-04-25T08:51:06.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.719 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.719 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068194 s, 154 MB/s 2024-04-25T08:51:06.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:06.720 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:06.720 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:06.720 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T08:51:06.720 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:06.720 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:06.720 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:06.720 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:06.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.784 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578774 s, 181 MB/s 2024-04-25T08:51:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.792 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712759 s, 147 MB/s 2024-04-25T08:51:06.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.799 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675599 s, 155 MB/s 2024-04-25T08:51:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.808 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745781 s, 141 MB/s 2024-04-25T08:51:06.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.815 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641668 s, 163 MB/s 2024-04-25T08:51:06.822 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.822 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.822 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065371 s, 160 MB/s 2024-04-25T08:51:06.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.830 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640283 s, 164 MB/s 2024-04-25T08:51:06.837 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.838 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710957 s, 147 MB/s 2024-04-25T08:51:06.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.845 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622863 s, 168 MB/s 2024-04-25T08:51:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.852 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638796 s, 164 MB/s 2024-04-25T08:51:06.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.859 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629297 s, 167 MB/s 2024-04-25T08:51:06.866 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.866 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.866 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616274 s, 170 MB/s 2024-04-25T08:51:06.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.873 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629306 s, 167 MB/s 2024-04-25T08:51:06.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.881 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657076 s, 160 MB/s 2024-04-25T08:51:06.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.887 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571669 s, 183 MB/s 2024-04-25T08:51:06.895 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.895 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.895 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682443 s, 154 MB/s 2024-04-25T08:51:06.902 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.902 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.903 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636173 s, 165 MB/s 2024-04-25T08:51:06.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.909 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608596 s, 172 MB/s 2024-04-25T08:51:06.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.916 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571386 s, 184 MB/s 2024-04-25T08:51:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588962 s, 178 MB/s 2024-04-25T08:51:06.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.930 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062858 s, 167 MB/s 2024-04-25T08:51:06.937 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.937 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.937 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602955 s, 174 MB/s 2024-04-25T08:51:06.945 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.945 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.945 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701351 s, 150 MB/s 2024-04-25T08:51:06.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.952 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640564 s, 164 MB/s 2024-04-25T08:51:06.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.959 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578218 s, 181 MB/s 2024-04-25T08:51:06.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.967 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683884 s, 153 MB/s 2024-04-25T08:51:06.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.974 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638505 s, 164 MB/s 2024-04-25T08:51:06.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.982 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071061 s, 148 MB/s 2024-04-25T08:51:06.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559664 s, 187 MB/s 2024-04-25T08:51:06.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:06.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:06.996 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622883 s, 168 MB/s 2024-04-25T08:51:07.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.003 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066722 s, 157 MB/s 2024-04-25T08:51:07.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.011 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072962 s, 144 MB/s 2024-04-25T08:51:07.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:07.013 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:07.013 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:07.013 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T08:51:07.013 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:07.013 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:07.013 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:07.013 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:07.077 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.077 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.077 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705536 s, 149 MB/s 2024-04-25T08:51:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581618 s, 180 MB/s 2024-04-25T08:51:07.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.092 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675232 s, 155 MB/s 2024-04-25T08:51:07.098 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.098 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.098 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580231 s, 181 MB/s 2024-04-25T08:51:07.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.106 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.106 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720344 s, 146 MB/s 2024-04-25T08:51:07.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.114 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628347 s, 167 MB/s 2024-04-25T08:51:07.121 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.121 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.121 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636892 s, 165 MB/s 2024-04-25T08:51:07.128 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.129 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708945 s, 148 MB/s 2024-04-25T08:51:07.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.136 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641559 s, 163 MB/s 2024-04-25T08:51:07.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.143 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673687 s, 156 MB/s 2024-04-25T08:51:07.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.151 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642217 s, 163 MB/s 2024-04-25T08:51:07.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.159 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674073 s, 156 MB/s 2024-04-25T08:51:07.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.166 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070347 s, 149 MB/s 2024-04-25T08:51:07.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.174 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.174 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646962 s, 162 MB/s 2024-04-25T08:51:07.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.180 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562988 s, 186 MB/s 2024-04-25T08:51:07.187 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.187 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.187 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571151 s, 184 MB/s 2024-04-25T08:51:07.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.194 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660743 s, 159 MB/s 2024-04-25T08:51:07.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.202 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678555 s, 155 MB/s 2024-04-25T08:51:07.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.209 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651561 s, 161 MB/s 2024-04-25T08:51:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.217 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655172 s, 160 MB/s 2024-04-25T08:51:07.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.224 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630315 s, 166 MB/s 2024-04-25T08:51:07.232 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.232 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.232 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072673 s, 144 MB/s 2024-04-25T08:51:07.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.239 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633458 s, 166 MB/s 2024-04-25T08:51:07.247 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.247 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.247 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634674 s, 165 MB/s 2024-04-25T08:51:07.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.255 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691608 s, 152 MB/s 2024-04-25T08:51:07.263 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.263 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.263 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073735 s, 142 MB/s 2024-04-25T08:51:07.270 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.270 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.270 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639314 s, 164 MB/s 2024-04-25T08:51:07.277 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.277 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.277 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638465 s, 164 MB/s 2024-04-25T08:51:07.284 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.284 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.284 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581728 s, 180 MB/s 2024-04-25T08:51:07.293 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.293 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.293 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832183 s, 126 MB/s 2024-04-25T08:51:07.302 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.302 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.302 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649922 s, 161 MB/s 2024-04-25T08:51:07.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780339 s, 134 MB/s 2024-04-25T08:51:07.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:07.311 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:07.311 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:07.311 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T08:51:07.311 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:07.311 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:07.311 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:07.311 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:07.374 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.375 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058497 s, 179 MB/s 2024-04-25T08:51:07.382 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.382 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.383 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721542 s, 145 MB/s 2024-04-25T08:51:07.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.390 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.390 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652698 s, 161 MB/s 2024-04-25T08:51:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.399 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783039 s, 134 MB/s 2024-04-25T08:51:07.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.410 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097949 s, 107 MB/s 2024-04-25T08:51:07.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.418 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771672 s, 136 MB/s 2024-04-25T08:51:07.425 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.425 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646282 s, 162 MB/s 2024-04-25T08:51:07.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.434 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727477 s, 144 MB/s 2024-04-25T08:51:07.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.442 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730215 s, 144 MB/s 2024-04-25T08:51:07.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.449 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641129 s, 164 MB/s 2024-04-25T08:51:07.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.456 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064349 s, 163 MB/s 2024-04-25T08:51:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681863 s, 154 MB/s 2024-04-25T08:51:07.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.472 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707374 s, 148 MB/s 2024-04-25T08:51:07.481 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.481 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.481 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816287 s, 128 MB/s 2024-04-25T08:51:07.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.490 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761575 s, 138 MB/s 2024-04-25T08:51:07.498 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.498 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.499 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770258 s, 136 MB/s 2024-04-25T08:51:07.505 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.505 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.505 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645428 s, 162 MB/s 2024-04-25T08:51:07.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.513 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.513 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624719 s, 168 MB/s 2024-04-25T08:51:07.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.520 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063945 s, 164 MB/s 2024-04-25T08:51:07.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.527 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649479 s, 161 MB/s 2024-04-25T08:51:07.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.535 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073681 s, 142 MB/s 2024-04-25T08:51:07.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.543 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622915 s, 168 MB/s 2024-04-25T08:51:07.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777672 s, 135 MB/s 2024-04-25T08:51:07.562 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.562 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.562 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966932 s, 108 MB/s 2024-04-25T08:51:07.570 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.570 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.571 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731031 s, 143 MB/s 2024-04-25T08:51:07.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.579 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781757 s, 134 MB/s 2024-04-25T08:51:07.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.586 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607201 s, 173 MB/s 2024-04-25T08:51:07.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.593 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620679 s, 169 MB/s 2024-04-25T08:51:07.600 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.600 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.600 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666924 s, 157 MB/s 2024-04-25T08:51:07.608 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.609 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.609 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720451 s, 146 MB/s 2024-04-25T08:51:07.616 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.617 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711264 s, 147 MB/s 2024-04-25T08:51:07.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.624 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637454 s, 164 MB/s 2024-04-25T08:51:07.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:07.625 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:07.625 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:07.625 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T08:51:07.625 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:07.625 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:07.625 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:07.625 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:07.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.691 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.691 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007381 s, 142 MB/s 2024-04-25T08:51:07.698 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.698 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.698 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645706 s, 162 MB/s 2024-04-25T08:51:07.705 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.705 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.705 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626191 s, 167 MB/s 2024-04-25T08:51:07.712 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.712 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.712 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605876 s, 173 MB/s 2024-04-25T08:51:07.719 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.719 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.719 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643356 s, 163 MB/s 2024-04-25T08:51:07.728 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.728 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.728 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779489 s, 135 MB/s 2024-04-25T08:51:07.736 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.736 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.736 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712884 s, 147 MB/s 2024-04-25T08:51:07.744 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.744 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.744 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669236 s, 157 MB/s 2024-04-25T08:51:07.752 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.752 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.752 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072007 s, 146 MB/s 2024-04-25T08:51:07.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.758 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583346 s, 180 MB/s 2024-04-25T08:51:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.766 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653045 s, 161 MB/s 2024-04-25T08:51:07.774 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.774 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.774 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709401 s, 148 MB/s 2024-04-25T08:51:07.782 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.782 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.782 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712571 s, 147 MB/s 2024-04-25T08:51:07.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.788 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577693 s, 182 MB/s 2024-04-25T08:51:07.796 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.796 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.796 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650151 s, 161 MB/s 2024-04-25T08:51:07.803 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.803 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.803 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614751 s, 171 MB/s 2024-04-25T08:51:07.811 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.811 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.811 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072996 s, 144 MB/s 2024-04-25T08:51:07.819 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.819 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.819 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663225 s, 158 MB/s 2024-04-25T08:51:07.826 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.826 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.826 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065433 s, 160 MB/s 2024-04-25T08:51:07.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.833 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633104 s, 166 MB/s 2024-04-25T08:51:07.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.841 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645783 s, 162 MB/s 2024-04-25T08:51:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.849 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724098 s, 145 MB/s 2024-04-25T08:51:07.856 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.856 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.856 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625782 s, 168 MB/s 2024-04-25T08:51:07.863 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.863 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.863 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065344 s, 160 MB/s 2024-04-25T08:51:07.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.871 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073254 s, 143 MB/s 2024-04-25T08:51:07.879 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.879 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.879 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627879 s, 167 MB/s 2024-04-25T08:51:07.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.886 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066817 s, 157 MB/s 2024-04-25T08:51:07.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.894 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.894 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664557 s, 158 MB/s 2024-04-25T08:51:07.902 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.902 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.902 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743461 s, 141 MB/s 2024-04-25T08:51:07.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.909 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627752 s, 167 MB/s 2024-04-25T08:51:07.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.917 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.917 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626774 s, 167 MB/s 2024-04-25T08:51:07.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.924 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692568 s, 151 MB/s 2024-04-25T08:51:07.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:07.926 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:07.926 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:07.926 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T08:51:07.926 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:07.926 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:07.926 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:07.926 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:07.990 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.990 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.990 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071727 s, 146 MB/s 2024-04-25T08:51:07.998 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:07.998 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:07.998 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767088 s, 137 MB/s 2024-04-25T08:51:08.005 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.006 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062806 s, 167 MB/s 2024-04-25T08:51:08.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.013 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661295 s, 159 MB/s 2024-04-25T08:51:08.021 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.021 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.021 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675679 s, 155 MB/s 2024-04-25T08:51:08.030 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.031 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.031 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873324 s, 120 MB/s 2024-04-25T08:51:08.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.038 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662378 s, 158 MB/s 2024-04-25T08:51:08.048 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.048 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.048 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085813 s, 122 MB/s 2024-04-25T08:51:08.057 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.058 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.058 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00813036 s, 129 MB/s 2024-04-25T08:51:08.066 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.066 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.067 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845269 s, 124 MB/s 2024-04-25T08:51:08.077 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.078 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.078 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996262 s, 105 MB/s 2024-04-25T08:51:08.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.085 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639909 s, 164 MB/s 2024-04-25T08:51:08.092 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.092 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.092 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623309 s, 168 MB/s 2024-04-25T08:51:08.100 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.100 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.100 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770631 s, 136 MB/s 2024-04-25T08:51:08.108 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.109 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.109 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668395 s, 157 MB/s 2024-04-25T08:51:08.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.117 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083721 s, 125 MB/s 2024-04-25T08:51:08.125 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.125 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.125 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064891 s, 162 MB/s 2024-04-25T08:51:08.132 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.132 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.132 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625869 s, 168 MB/s 2024-04-25T08:51:08.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010237 s, 102 MB/s 2024-04-25T08:51:08.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.150 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549443 s, 191 MB/s 2024-04-25T08:51:08.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.158 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.158 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773923 s, 135 MB/s 2024-04-25T08:51:08.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.166 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694123 s, 151 MB/s 2024-04-25T08:51:08.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.176 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.176 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882828 s, 119 MB/s 2024-04-25T08:51:08.184 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.184 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.184 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755137 s, 139 MB/s 2024-04-25T08:51:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665998 s, 157 MB/s 2024-04-25T08:51:08.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.200 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783556 s, 134 MB/s 2024-04-25T08:51:08.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.207 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573197 s, 183 MB/s 2024-04-25T08:51:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632463 s, 166 MB/s 2024-04-25T08:51:08.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.222 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718762 s, 146 MB/s 2024-04-25T08:51:08.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.231 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749641 s, 140 MB/s 2024-04-25T08:51:08.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.240 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866768 s, 121 MB/s 2024-04-25T08:51:08.247 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.247 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.247 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605125 s, 173 MB/s 2024-04-25T08:51:08.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:08.250 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:08.250 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:08.250 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T08:51:08.250 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:08.250 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:08.250 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:08.250 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:08.316 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.316 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.316 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069172 s, 152 MB/s 2024-04-25T08:51:08.322 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588993 s, 178 MB/s 2024-04-25T08:51:08.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.330 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652718 s, 161 MB/s 2024-04-25T08:51:08.340 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.340 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.340 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883823 s, 119 MB/s 2024-04-25T08:51:08.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.349 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083457 s, 126 MB/s 2024-04-25T08:51:08.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.358 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.358 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738517 s, 142 MB/s 2024-04-25T08:51:08.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.365 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645375 s, 162 MB/s 2024-04-25T08:51:08.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.372 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629395 s, 167 MB/s 2024-04-25T08:51:08.379 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.379 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.379 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652685 s, 161 MB/s 2024-04-25T08:51:08.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.387 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725043 s, 145 MB/s 2024-04-25T08:51:08.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.395 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639218 s, 164 MB/s 2024-04-25T08:51:08.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.402 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602354 s, 174 MB/s 2024-04-25T08:51:08.408 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.408 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.408 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566687 s, 185 MB/s 2024-04-25T08:51:08.416 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.416 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.416 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658261 s, 159 MB/s 2024-04-25T08:51:08.423 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.423 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.423 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642307 s, 163 MB/s 2024-04-25T08:51:08.431 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.431 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.431 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719095 s, 146 MB/s 2024-04-25T08:51:08.438 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.438 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.439 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641117 s, 164 MB/s 2024-04-25T08:51:08.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.447 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714559 s, 147 MB/s 2024-04-25T08:51:08.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.457 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915019 s, 115 MB/s 2024-04-25T08:51:08.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.463 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563563 s, 186 MB/s 2024-04-25T08:51:08.470 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.470 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.470 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634767 s, 165 MB/s 2024-04-25T08:51:08.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.479 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746609 s, 140 MB/s 2024-04-25T08:51:08.487 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.487 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.488 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771602 s, 136 MB/s 2024-04-25T08:51:08.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.496 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752916 s, 139 MB/s 2024-04-25T08:51:08.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.504 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648293 s, 162 MB/s 2024-04-25T08:51:08.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.512 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750415 s, 140 MB/s 2024-04-25T08:51:08.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.518 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571816 s, 183 MB/s 2024-04-25T08:51:08.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.527 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789154 s, 133 MB/s 2024-04-25T08:51:08.537 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.537 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.537 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00890242 s, 118 MB/s 2024-04-25T08:51:08.545 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.545 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.545 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721249 s, 145 MB/s 2024-04-25T08:51:08.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.552 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639841 s, 164 MB/s 2024-04-25T08:51:08.560 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.560 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.560 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065789 s, 159 MB/s 2024-04-25T08:51:08.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:08.561 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:08.561 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:08.561 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T08:51:08.561 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:08.561 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:08.561 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:08.561 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:08.626 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.626 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.626 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612789 s, 171 MB/s 2024-04-25T08:51:08.633 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.633 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.634 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071586 s, 146 MB/s 2024-04-25T08:51:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.640 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573762 s, 183 MB/s 2024-04-25T08:51:08.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.648 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.648 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674176 s, 156 MB/s 2024-04-25T08:51:08.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.655 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617043 s, 170 MB/s 2024-04-25T08:51:08.665 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.665 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.665 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941838 s, 111 MB/s 2024-04-25T08:51:08.672 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.672 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.672 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640573 s, 164 MB/s 2024-04-25T08:51:08.680 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.680 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.680 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675803 s, 155 MB/s 2024-04-25T08:51:08.687 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.687 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.687 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621473 s, 169 MB/s 2024-04-25T08:51:08.694 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.694 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.694 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603447 s, 174 MB/s 2024-04-25T08:51:08.702 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.702 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.702 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675659 s, 155 MB/s 2024-04-25T08:51:08.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.710 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707761 s, 148 MB/s 2024-04-25T08:51:08.716 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.716 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.716 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577606 s, 182 MB/s 2024-04-25T08:51:08.724 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.724 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.724 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664258 s, 158 MB/s 2024-04-25T08:51:08.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.731 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618835 s, 169 MB/s 2024-04-25T08:51:08.737 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.738 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558582 s, 188 MB/s 2024-04-25T08:51:08.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.746 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701228 s, 150 MB/s 2024-04-25T08:51:08.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.753 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633445 s, 166 MB/s 2024-04-25T08:51:08.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.762 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.762 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824129 s, 127 MB/s 2024-04-25T08:51:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.768 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570143 s, 184 MB/s 2024-04-25T08:51:08.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.776 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645741 s, 162 MB/s 2024-04-25T08:51:08.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.784 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687804 s, 152 MB/s 2024-04-25T08:51:08.791 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.791 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.791 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646894 s, 162 MB/s 2024-04-25T08:51:08.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.799 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.799 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708526 s, 148 MB/s 2024-04-25T08:51:08.806 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.806 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.806 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624959 s, 168 MB/s 2024-04-25T08:51:08.813 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.813 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.813 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646087 s, 162 MB/s 2024-04-25T08:51:08.820 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.820 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.821 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619484 s, 169 MB/s 2024-04-25T08:51:08.827 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.827 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.827 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558245 s, 188 MB/s 2024-04-25T08:51:08.834 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.834 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.834 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605335 s, 173 MB/s 2024-04-25T08:51:08.842 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.842 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.842 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699802 s, 150 MB/s 2024-04-25T08:51:08.848 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.848 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.848 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056424 s, 186 MB/s 2024-04-25T08:51:08.855 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.855 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.855 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587226 s, 179 MB/s 2024-04-25T08:51:08.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:08.856 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:08.856 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:08.857 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T08:51:08.857 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:08.857 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:08.857 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:08.857 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:08.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.924 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888505 s, 118 MB/s 2024-04-25T08:51:08.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.931 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664207 s, 158 MB/s 2024-04-25T08:51:08.939 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.939 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.939 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749868 s, 140 MB/s 2024-04-25T08:51:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.947 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725664 s, 144 MB/s 2024-04-25T08:51:08.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.955 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067009 s, 156 MB/s 2024-04-25T08:51:08.972 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.972 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.972 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160804 s, 65.2 MB/s 2024-04-25T08:51:08.978 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.979 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608339 s, 172 MB/s 2024-04-25T08:51:08.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.988 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.988 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00813309 s, 129 MB/s 2024-04-25T08:51:08.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:08.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:08.995 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063637 s, 165 MB/s 2024-04-25T08:51:09.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.003 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695681 s, 151 MB/s 2024-04-25T08:51:09.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.012 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812096 s, 129 MB/s 2024-04-25T08:51:09.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.019 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633523 s, 166 MB/s 2024-04-25T08:51:09.027 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.028 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747618 s, 140 MB/s 2024-04-25T08:51:09.035 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.035 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.035 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650605 s, 161 MB/s 2024-04-25T08:51:09.042 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.043 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067804 s, 155 MB/s 2024-04-25T08:51:09.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.054 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010039 s, 104 MB/s 2024-04-25T08:51:09.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.061 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062639 s, 167 MB/s 2024-04-25T08:51:09.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.068 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580722 s, 181 MB/s 2024-04-25T08:51:09.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.075 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666278 s, 157 MB/s 2024-04-25T08:51:09.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.082 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628103 s, 167 MB/s 2024-04-25T08:51:09.089 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.089 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.090 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063193 s, 166 MB/s 2024-04-25T08:51:09.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.097 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626504 s, 167 MB/s 2024-04-25T08:51:09.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.105 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772445 s, 136 MB/s 2024-04-25T08:51:09.114 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.114 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.114 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763388 s, 137 MB/s 2024-04-25T08:51:09.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.122 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072772 s, 144 MB/s 2024-04-25T08:51:09.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.129 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643508 s, 163 MB/s 2024-04-25T08:51:09.139 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.139 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.139 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852277 s, 123 MB/s 2024-04-25T08:51:09.147 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.147 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.147 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710592 s, 148 MB/s 2024-04-25T08:51:09.154 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.154 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.154 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664193 s, 158 MB/s 2024-04-25T08:51:09.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.162 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064559 s, 162 MB/s 2024-04-25T08:51:09.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.170 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.170 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712405 s, 147 MB/s 2024-04-25T08:51:09.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.177 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639683 s, 164 MB/s 2024-04-25T08:51:09.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:09.178 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:09.178 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:09.178 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T08:51:09.178 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:09.178 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:09.178 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:09.178 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:09.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.243 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.243 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646193 s, 162 MB/s 2024-04-25T08:51:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.250 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711205 s, 147 MB/s 2024-04-25T08:51:09.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.258 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643557 s, 163 MB/s 2024-04-25T08:51:09.266 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.266 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.266 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714297 s, 147 MB/s 2024-04-25T08:51:09.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.272 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576347 s, 182 MB/s 2024-04-25T08:51:09.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.280 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.280 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628435 s, 167 MB/s 2024-04-25T08:51:09.288 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.288 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.288 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744685 s, 141 MB/s 2024-04-25T08:51:09.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.296 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678417 s, 155 MB/s 2024-04-25T08:51:09.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.303 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651015 s, 161 MB/s 2024-04-25T08:51:09.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.311 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647911 s, 162 MB/s 2024-04-25T08:51:09.320 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.320 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.320 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865649 s, 121 MB/s 2024-04-25T08:51:09.327 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.327 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.327 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611131 s, 172 MB/s 2024-04-25T08:51:09.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.334 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651759 s, 161 MB/s 2024-04-25T08:51:09.342 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.342 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.342 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072728 s, 144 MB/s 2024-04-25T08:51:09.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.352 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904523 s, 116 MB/s 2024-04-25T08:51:09.359 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.360 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.360 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654525 s, 160 MB/s 2024-04-25T08:51:09.366 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.366 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.366 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059228 s, 177 MB/s 2024-04-25T08:51:09.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.374 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.374 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644712 s, 163 MB/s 2024-04-25T08:51:09.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.382 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.382 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669535 s, 157 MB/s 2024-04-25T08:51:09.389 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.389 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.389 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057532 s, 182 MB/s 2024-04-25T08:51:09.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.394 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558777 s, 188 MB/s 2024-04-25T08:51:09.401 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.402 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061743 s, 170 MB/s 2024-04-25T08:51:09.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.409 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680258 s, 154 MB/s 2024-04-25T08:51:09.417 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.417 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.417 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680096 s, 154 MB/s 2024-04-25T08:51:09.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.427 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090001 s, 117 MB/s 2024-04-25T08:51:09.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.434 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639337 s, 164 MB/s 2024-04-25T08:51:09.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.442 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738679 s, 142 MB/s 2024-04-25T08:51:09.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.450 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657222 s, 160 MB/s 2024-04-25T08:51:09.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.457 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590434 s, 178 MB/s 2024-04-25T08:51:09.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.464 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637108 s, 165 MB/s 2024-04-25T08:51:09.474 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.474 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.474 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00893967 s, 117 MB/s 2024-04-25T08:51:09.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.480 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588031 s, 178 MB/s 2024-04-25T08:51:09.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:09.482 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:09.482 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:09.482 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T08:51:09.482 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:09.482 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:09.482 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:09.482 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:09.545 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.545 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.546 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560686 s, 187 MB/s 2024-04-25T08:51:09.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.552 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582141 s, 180 MB/s 2024-04-25T08:51:09.559 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.559 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.560 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634275 s, 165 MB/s 2024-04-25T08:51:09.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.568 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067329 s, 156 MB/s 2024-04-25T08:51:09.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.574 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587306 s, 179 MB/s 2024-04-25T08:51:09.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.581 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637441 s, 164 MB/s 2024-04-25T08:51:09.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.589 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676737 s, 155 MB/s 2024-04-25T08:51:09.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.596 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638123 s, 164 MB/s 2024-04-25T08:51:09.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.603 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062949 s, 167 MB/s 2024-04-25T08:51:09.611 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.611 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.611 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638939 s, 164 MB/s 2024-04-25T08:51:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.618 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581878 s, 180 MB/s 2024-04-25T08:51:09.625 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.625 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.625 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655229 s, 160 MB/s 2024-04-25T08:51:09.634 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.634 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.634 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864951 s, 121 MB/s 2024-04-25T08:51:09.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.642 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614823 s, 171 MB/s 2024-04-25T08:51:09.649 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.649 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.649 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678674 s, 155 MB/s 2024-04-25T08:51:09.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.657 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665379 s, 158 MB/s 2024-04-25T08:51:09.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.664 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655362 s, 160 MB/s 2024-04-25T08:51:09.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.671 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582583 s, 180 MB/s 2024-04-25T08:51:09.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.678 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642047 s, 163 MB/s 2024-04-25T08:51:09.686 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.686 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.686 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678623 s, 155 MB/s 2024-04-25T08:51:09.694 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.694 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.694 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710207 s, 148 MB/s 2024-04-25T08:51:09.701 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.701 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.701 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621723 s, 169 MB/s 2024-04-25T08:51:09.709 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.709 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.709 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071846 s, 146 MB/s 2024-04-25T08:51:09.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.717 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664357 s, 158 MB/s 2024-04-25T08:51:09.724 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.724 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.724 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624164 s, 168 MB/s 2024-04-25T08:51:09.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.731 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636349 s, 165 MB/s 2024-04-25T08:51:09.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.738 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631414 s, 166 MB/s 2024-04-25T08:51:09.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.746 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705544 s, 149 MB/s 2024-04-25T08:51:09.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.754 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641664 s, 163 MB/s 2024-04-25T08:51:09.761 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.761 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.761 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615768 s, 170 MB/s 2024-04-25T08:51:09.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007206 s, 146 MB/s 2024-04-25T08:51:09.775 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.775 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.775 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565004 s, 186 MB/s 2024-04-25T08:51:09.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:09.776 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:09.776 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:09.777 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T08:51:09.777 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:09.777 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:09.777 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:09.777 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:09.843 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.843 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.843 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862298 s, 122 MB/s 2024-04-25T08:51:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.850 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618026 s, 170 MB/s 2024-04-25T08:51:09.858 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.858 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.858 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667921 s, 157 MB/s 2024-04-25T08:51:09.865 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.865 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.865 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645684 s, 162 MB/s 2024-04-25T08:51:09.872 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.872 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.872 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060687 s, 173 MB/s 2024-04-25T08:51:09.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.881 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058284 s, 180 MB/s 2024-04-25T08:51:09.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.887 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739613 s, 142 MB/s 2024-04-25T08:51:09.895 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.895 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.896 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715423 s, 147 MB/s 2024-04-25T08:51:09.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.903 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693936 s, 151 MB/s 2024-04-25T08:51:09.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.913 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927924 s, 113 MB/s 2024-04-25T08:51:09.920 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.920 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.920 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604296 s, 174 MB/s 2024-04-25T08:51:09.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.928 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654302 s, 160 MB/s 2024-04-25T08:51:09.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.936 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697428 s, 150 MB/s 2024-04-25T08:51:09.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.943 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642114 s, 163 MB/s 2024-04-25T08:51:09.951 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.952 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748916 s, 140 MB/s 2024-04-25T08:51:09.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.959 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648627 s, 162 MB/s 2024-04-25T08:51:09.966 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.966 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.966 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637274 s, 165 MB/s 2024-04-25T08:51:09.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.975 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828637 s, 127 MB/s 2024-04-25T08:51:09.983 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.983 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.983 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660734 s, 159 MB/s 2024-04-25T08:51:09.991 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.991 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.991 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713578 s, 147 MB/s 2024-04-25T08:51:09.998 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:09.998 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:09.998 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622497 s, 168 MB/s 2024-04-25T08:51:10.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.005 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.005 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590135 s, 178 MB/s 2024-04-25T08:51:10.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.012 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677765 s, 155 MB/s 2024-04-25T08:51:10.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.020 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640545 s, 164 MB/s 2024-04-25T08:51:10.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.028 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745525 s, 141 MB/s 2024-04-25T08:51:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.036 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070542 s, 149 MB/s 2024-04-25T08:51:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.044 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750468 s, 140 MB/s 2024-04-25T08:51:10.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.052 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067881 s, 154 MB/s 2024-04-25T08:51:10.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.060 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720302 s, 146 MB/s 2024-04-25T08:51:10.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.069 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743084 s, 141 MB/s 2024-04-25T08:51:10.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.076 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665555 s, 158 MB/s 2024-04-25T08:51:10.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.084 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722055 s, 145 MB/s 2024-04-25T08:51:10.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:10.085 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:10.085 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:10.086 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T08:51:10.086 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:10.086 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:10.086 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:10.086 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:10.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.149 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607078 s, 173 MB/s 2024-04-25T08:51:10.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.157 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742768 s, 141 MB/s 2024-04-25T08:51:10.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.164 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622666 s, 168 MB/s 2024-04-25T08:51:10.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.172 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690114 s, 152 MB/s 2024-04-25T08:51:10.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.179 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566926 s, 185 MB/s 2024-04-25T08:51:10.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.186 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.186 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607724 s, 173 MB/s 2024-04-25T08:51:10.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.194 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680072 s, 154 MB/s 2024-04-25T08:51:10.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.202 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764543 s, 137 MB/s 2024-04-25T08:51:10.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.209 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569062 s, 184 MB/s 2024-04-25T08:51:10.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.219 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911436 s, 115 MB/s 2024-04-25T08:51:10.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.226 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064282 s, 163 MB/s 2024-04-25T08:51:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.233 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610356 s, 172 MB/s 2024-04-25T08:51:10.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.240 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610648 s, 172 MB/s 2024-04-25T08:51:10.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.248 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714698 s, 147 MB/s 2024-04-25T08:51:10.255 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.256 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.256 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682178 s, 154 MB/s 2024-04-25T08:51:10.263 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.263 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.263 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665782 s, 157 MB/s 2024-04-25T08:51:10.270 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.270 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.270 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589289 s, 178 MB/s 2024-04-25T08:51:10.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.279 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837207 s, 125 MB/s 2024-04-25T08:51:10.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.286 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622559 s, 168 MB/s 2024-04-25T08:51:10.297 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.297 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.297 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709112 s, 148 MB/s 2024-04-25T08:51:10.302 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.303 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723203 s, 145 MB/s 2024-04-25T08:51:10.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667744 s, 157 MB/s 2024-04-25T08:51:10.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.318 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719471 s, 146 MB/s 2024-04-25T08:51:10.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.325 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582566 s, 180 MB/s 2024-04-25T08:51:10.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.332 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646833 s, 162 MB/s 2024-04-25T08:51:10.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.340 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.340 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065001 s, 161 MB/s 2024-04-25T08:51:10.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.346 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556099 s, 189 MB/s 2024-04-25T08:51:10.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.354 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064831 s, 162 MB/s 2024-04-25T08:51:10.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.362 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708756 s, 148 MB/s 2024-04-25T08:51:10.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.368 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587083 s, 179 MB/s 2024-04-25T08:51:10.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.376 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679229 s, 154 MB/s 2024-04-25T08:51:10.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.383 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641761 s, 163 MB/s 2024-04-25T08:51:10.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:10.385 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:10.385 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:10.385 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T08:51:10.385 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:10.385 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:10.385 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:10.385 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:10.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.450 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732123 s, 143 MB/s 2024-04-25T08:51:10.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.457 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635943 s, 165 MB/s 2024-04-25T08:51:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.464 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597312 s, 176 MB/s 2024-04-25T08:51:10.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.472 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692465 s, 151 MB/s 2024-04-25T08:51:10.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.479 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596207 s, 176 MB/s 2024-04-25T08:51:10.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.486 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625465 s, 168 MB/s 2024-04-25T08:51:10.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.493 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641862 s, 163 MB/s 2024-04-25T08:51:10.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.500 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599111 s, 175 MB/s 2024-04-25T08:51:10.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.506 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553074 s, 190 MB/s 2024-04-25T08:51:10.513 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.513 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.514 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624152 s, 168 MB/s 2024-04-25T08:51:10.521 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.521 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.521 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064441 s, 163 MB/s 2024-04-25T08:51:10.528 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.528 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.528 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630137 s, 166 MB/s 2024-04-25T08:51:10.536 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.536 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.536 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728181 s, 144 MB/s 2024-04-25T08:51:10.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.544 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073276 s, 143 MB/s 2024-04-25T08:51:10.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00544054 s, 193 MB/s 2024-04-25T08:51:10.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.559 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.559 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685233 s, 153 MB/s 2024-04-25T08:51:10.566 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.566 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.566 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664178 s, 158 MB/s 2024-04-25T08:51:10.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.573 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561139 s, 187 MB/s 2024-04-25T08:51:10.582 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.582 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.582 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868434 s, 121 MB/s 2024-04-25T08:51:10.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.592 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879699 s, 119 MB/s 2024-04-25T08:51:10.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617813 s, 170 MB/s 2024-04-25T08:51:10.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.607 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677829 s, 155 MB/s 2024-04-25T08:51:10.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.613 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00544453 s, 193 MB/s 2024-04-25T08:51:10.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.620 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632563 s, 166 MB/s 2024-04-25T08:51:10.626 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.626 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.627 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00539939 s, 194 MB/s 2024-04-25T08:51:10.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.635 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734431 s, 143 MB/s 2024-04-25T08:51:10.642 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.642 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.642 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666592 s, 157 MB/s 2024-04-25T08:51:10.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.650 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066852 s, 157 MB/s 2024-04-25T08:51:10.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.657 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625082 s, 168 MB/s 2024-04-25T08:51:10.665 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.665 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.665 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703524 s, 149 MB/s 2024-04-25T08:51:10.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.675 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086332 s, 121 MB/s 2024-04-25T08:51:10.682 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.682 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.682 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632641 s, 166 MB/s 2024-04-25T08:51:10.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:10.683 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:10.683 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:10.683 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T08:51:10.683 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:10.683 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:10.683 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:10.683 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:10.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.747 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663659 s, 158 MB/s 2024-04-25T08:51:10.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.754 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005913 s, 177 MB/s 2024-04-25T08:51:10.760 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.761 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.761 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577741 s, 181 MB/s 2024-04-25T08:51:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073961 s, 142 MB/s 2024-04-25T08:51:10.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.777 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066925 s, 157 MB/s 2024-04-25T08:51:10.786 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.786 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.786 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090187 s, 116 MB/s 2024-04-25T08:51:10.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.802 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142449 s, 73.6 MB/s 2024-04-25T08:51:10.809 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.809 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.809 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630423 s, 166 MB/s 2024-04-25T08:51:10.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.817 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733624 s, 143 MB/s 2024-04-25T08:51:10.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.826 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.826 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764223 s, 137 MB/s 2024-04-25T08:51:10.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.833 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668556 s, 157 MB/s 2024-04-25T08:51:10.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.840 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627263 s, 167 MB/s 2024-04-25T08:51:10.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.847 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.847 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572459 s, 183 MB/s 2024-04-25T08:51:10.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.853 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00548091 s, 191 MB/s 2024-04-25T08:51:10.861 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.861 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.861 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067659 s, 155 MB/s 2024-04-25T08:51:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.868 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580405 s, 181 MB/s 2024-04-25T08:51:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.875 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635299 s, 165 MB/s 2024-04-25T08:51:10.882 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.882 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.882 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678606 s, 155 MB/s 2024-04-25T08:51:10.890 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.890 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.890 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070698 s, 148 MB/s 2024-04-25T08:51:10.898 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.898 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.898 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673992 s, 156 MB/s 2024-04-25T08:51:10.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.909 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824242 s, 127 MB/s 2024-04-25T08:51:10.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.915 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645145 s, 163 MB/s 2024-04-25T08:51:10.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.924 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00893957 s, 117 MB/s 2024-04-25T08:51:10.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.931 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600491 s, 175 MB/s 2024-04-25T08:51:10.939 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.939 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.939 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694177 s, 151 MB/s 2024-04-25T08:51:10.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.947 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711683 s, 147 MB/s 2024-04-25T08:51:10.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.955 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695405 s, 151 MB/s 2024-04-25T08:51:10.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.963 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066299 s, 158 MB/s 2024-04-25T08:51:10.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.970 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624223 s, 168 MB/s 2024-04-25T08:51:10.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.977 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.977 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645736 s, 162 MB/s 2024-04-25T08:51:10.984 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.985 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.985 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629307 s, 167 MB/s 2024-04-25T08:51:10.991 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:10.991 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:10.991 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588476 s, 178 MB/s 2024-04-25T08:51:10.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:10.992 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:10.992 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:10.992 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T08:51:10.992 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:10.993 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:10.993 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:10.993 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:11.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.056 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625602 s, 168 MB/s 2024-04-25T08:51:11.064 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.064 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.064 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687897 s, 152 MB/s 2024-04-25T08:51:11.073 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.074 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.074 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852001 s, 123 MB/s 2024-04-25T08:51:11.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.080 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617835 s, 170 MB/s 2024-04-25T08:51:11.088 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.088 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.089 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729026 s, 144 MB/s 2024-04-25T08:51:11.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.096 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629235 s, 167 MB/s 2024-04-25T08:51:11.103 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.104 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.104 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071804 s, 146 MB/s 2024-04-25T08:51:11.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.114 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.114 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674703 s, 155 MB/s 2024-04-25T08:51:11.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.122 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.122 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094521 s, 111 MB/s 2024-04-25T08:51:11.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.129 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.129 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676014 s, 155 MB/s 2024-04-25T08:51:11.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.137 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.137 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657772 s, 159 MB/s 2024-04-25T08:51:11.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668665 s, 157 MB/s 2024-04-25T08:51:11.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.151 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617163 s, 170 MB/s 2024-04-25T08:51:11.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.160 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734617 s, 143 MB/s 2024-04-25T08:51:11.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.170 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907244 s, 116 MB/s 2024-04-25T08:51:11.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.178 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069858 s, 150 MB/s 2024-04-25T08:51:11.184 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.184 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.184 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568204 s, 185 MB/s 2024-04-25T08:51:11.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.192 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.192 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690765 s, 152 MB/s 2024-04-25T08:51:11.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.199 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644015 s, 163 MB/s 2024-04-25T08:51:11.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.207 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.207 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701681 s, 149 MB/s 2024-04-25T08:51:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.214 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575387 s, 182 MB/s 2024-04-25T08:51:11.220 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.221 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563178 s, 186 MB/s 2024-04-25T08:51:11.227 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.228 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.228 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063634 s, 165 MB/s 2024-04-25T08:51:11.234 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.234 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.234 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584029 s, 180 MB/s 2024-04-25T08:51:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.242 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646956 s, 162 MB/s 2024-04-25T08:51:11.249 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.249 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.249 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670492 s, 156 MB/s 2024-04-25T08:51:11.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.257 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.257 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698571 s, 150 MB/s 2024-04-25T08:51:11.266 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.266 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.266 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741574 s, 141 MB/s 2024-04-25T08:51:11.273 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.274 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716088 s, 146 MB/s 2024-04-25T08:51:11.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.281 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670333 s, 156 MB/s 2024-04-25T08:51:11.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.291 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888255 s, 118 MB/s 2024-04-25T08:51:11.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.299 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746662 s, 140 MB/s 2024-04-25T08:51:11.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:11.300 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:11.301 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:11.301 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T08:51:11.301 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:11.301 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:11.301 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:11.301 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:11.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.366 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719649 s, 146 MB/s 2024-04-25T08:51:11.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.373 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721312 s, 145 MB/s 2024-04-25T08:51:11.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.381 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714967 s, 147 MB/s 2024-04-25T08:51:11.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.388 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559474 s, 187 MB/s 2024-04-25T08:51:11.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.395 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573187 s, 183 MB/s 2024-04-25T08:51:11.403 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.403 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.403 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725576 s, 145 MB/s 2024-04-25T08:51:11.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.410 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.410 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656768 s, 160 MB/s 2024-04-25T08:51:11.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.420 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943193 s, 111 MB/s 2024-04-25T08:51:11.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.428 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637987 s, 164 MB/s 2024-04-25T08:51:11.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.436 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.436 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070451 s, 149 MB/s 2024-04-25T08:51:11.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.443 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.443 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612603 s, 171 MB/s 2024-04-25T08:51:11.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.450 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657197 s, 160 MB/s 2024-04-25T08:51:11.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.457 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627045 s, 167 MB/s 2024-04-25T08:51:11.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.465 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657693 s, 159 MB/s 2024-04-25T08:51:11.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.472 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648293 s, 162 MB/s 2024-04-25T08:51:11.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.480 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721021 s, 145 MB/s 2024-04-25T08:51:11.487 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.487 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.487 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625534 s, 168 MB/s 2024-04-25T08:51:11.495 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.495 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.495 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653198 s, 161 MB/s 2024-04-25T08:51:11.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.504 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895254 s, 117 MB/s 2024-04-25T08:51:11.514 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.514 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.514 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854953 s, 123 MB/s 2024-04-25T08:51:11.521 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.522 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.522 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630741 s, 166 MB/s 2024-04-25T08:51:11.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.529 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710807 s, 148 MB/s 2024-04-25T08:51:11.536 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.536 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.536 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611067 s, 172 MB/s 2024-04-25T08:51:11.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.545 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075219 s, 139 MB/s 2024-04-25T08:51:11.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.552 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686546 s, 153 MB/s 2024-04-25T08:51:11.559 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.559 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.559 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636321 s, 165 MB/s 2024-04-25T08:51:11.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.567 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.567 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661266 s, 159 MB/s 2024-04-25T08:51:11.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.574 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648384 s, 162 MB/s 2024-04-25T08:51:11.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.581 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006045 s, 173 MB/s 2024-04-25T08:51:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.588 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598891 s, 175 MB/s 2024-04-25T08:51:11.595 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.595 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.595 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063792 s, 164 MB/s 2024-04-25T08:51:11.602 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.602 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.602 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578931 s, 181 MB/s 2024-04-25T08:51:11.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:11.603 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:11.603 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:11.603 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T08:51:11.603 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:11.603 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:11.604 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:11.604 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:11.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.668 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.668 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723445 s, 145 MB/s 2024-04-25T08:51:11.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.675 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.676 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066534 s, 158 MB/s 2024-04-25T08:51:11.683 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.683 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.683 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630889 s, 166 MB/s 2024-04-25T08:51:11.692 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.692 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.692 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827467 s, 127 MB/s 2024-04-25T08:51:11.699 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.699 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.699 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641257 s, 164 MB/s 2024-04-25T08:51:11.707 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.707 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.707 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732626 s, 143 MB/s 2024-04-25T08:51:11.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.715 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704302 s, 149 MB/s 2024-04-25T08:51:11.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.722 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005761 s, 182 MB/s 2024-04-25T08:51:11.729 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.729 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.729 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648652 s, 162 MB/s 2024-04-25T08:51:11.737 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.737 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.737 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673522 s, 156 MB/s 2024-04-25T08:51:11.744 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.744 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.744 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642243 s, 163 MB/s 2024-04-25T08:51:11.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.754 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832797 s, 126 MB/s 2024-04-25T08:51:11.760 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.761 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.761 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625652 s, 168 MB/s 2024-04-25T08:51:11.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726193 s, 144 MB/s 2024-04-25T08:51:11.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.776 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.776 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655036 s, 160 MB/s 2024-04-25T08:51:11.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.784 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678131 s, 155 MB/s 2024-04-25T08:51:11.794 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.794 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.794 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915669 s, 115 MB/s 2024-04-25T08:51:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.801 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638387 s, 164 MB/s 2024-04-25T08:51:11.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.808 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642732 s, 163 MB/s 2024-04-25T08:51:11.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.817 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711846 s, 147 MB/s 2024-04-25T08:51:11.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.824 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638479 s, 164 MB/s 2024-04-25T08:51:11.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.831 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627007 s, 167 MB/s 2024-04-25T08:51:11.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.839 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713437 s, 147 MB/s 2024-04-25T08:51:11.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.845 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565701 s, 185 MB/s 2024-04-25T08:51:11.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.853 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708764 s, 148 MB/s 2024-04-25T08:51:11.861 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.861 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.861 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634728 s, 165 MB/s 2024-04-25T08:51:11.869 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.869 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.869 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074057 s, 142 MB/s 2024-04-25T08:51:11.876 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.876 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.876 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632967 s, 166 MB/s 2024-04-25T08:51:11.883 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.883 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.883 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591241 s, 177 MB/s 2024-04-25T08:51:11.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.893 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895133 s, 117 MB/s 2024-04-25T08:51:11.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.900 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657071 s, 160 MB/s 2024-04-25T08:51:11.910 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.910 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.910 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089101 s, 118 MB/s 2024-04-25T08:51:11.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:11.911 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:11.911 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:11.911 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T08:51:11.912 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:11.912 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:11.912 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:11.912 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.976 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654373 s, 160 MB/s 2024-04-25T08:51:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720585 s, 146 MB/s 2024-04-25T08:51:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601072 s, 174 MB/s 2024-04-25T08:51:11.998 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:11.998 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:11.998 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660637 s, 159 MB/s 2024-04-25T08:51:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.004 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.005 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059044 s, 178 MB/s 2024-04-25T08:51:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.012 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636976 s, 165 MB/s 2024-04-25T08:51:12.020 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.020 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.020 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758103 s, 138 MB/s 2024-04-25T08:51:12.030 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.030 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.030 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884622 s, 119 MB/s 2024-04-25T08:51:12.037 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.037 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.038 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652478 s, 161 MB/s 2024-04-25T08:51:12.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.044 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580308 s, 181 MB/s 2024-04-25T08:51:12.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.053 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826192 s, 127 MB/s 2024-04-25T08:51:12.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.061 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070926 s, 148 MB/s 2024-04-25T08:51:12.069 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.069 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.069 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644795 s, 163 MB/s 2024-04-25T08:51:12.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.076 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661804 s, 158 MB/s 2024-04-25T08:51:12.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.084 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.084 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071651 s, 146 MB/s 2024-04-25T08:51:12.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.094 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908602 s, 115 MB/s 2024-04-25T08:51:12.101 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.102 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.102 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063575 s, 165 MB/s 2024-04-25T08:51:12.109 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.109 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.109 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661089 s, 159 MB/s 2024-04-25T08:51:12.116 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.117 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668599 s, 157 MB/s 2024-04-25T08:51:12.125 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.125 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.125 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072161 s, 145 MB/s 2024-04-25T08:51:12.133 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.133 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.134 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707197 s, 148 MB/s 2024-04-25T08:51:12.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.142 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873584 s, 120 MB/s 2024-04-25T08:51:12.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.150 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672893 s, 156 MB/s 2024-04-25T08:51:12.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.160 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854059 s, 123 MB/s 2024-04-25T08:51:12.166 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.167 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628263 s, 167 MB/s 2024-04-25T08:51:12.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.173 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566992 s, 185 MB/s 2024-04-25T08:51:12.181 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.181 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.181 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654384 s, 160 MB/s 2024-04-25T08:51:12.188 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.188 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.189 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007013 s, 150 MB/s 2024-04-25T08:51:12.196 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.196 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.196 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671413 s, 156 MB/s 2024-04-25T08:51:12.203 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.203 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.204 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650374 s, 161 MB/s 2024-04-25T08:51:12.210 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.210 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.210 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572074 s, 183 MB/s 2024-04-25T08:51:12.220 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.221 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935404 s, 112 MB/s 2024-04-25T08:51:12.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:12.222 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:12.222 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:12.222 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T08:51:12.222 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:12.222 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:12.222 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:12.222 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:12.287 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.287 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.287 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714564 s, 147 MB/s 2024-04-25T08:51:12.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.295 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.295 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689898 s, 152 MB/s 2024-04-25T08:51:12.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.303 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771847 s, 136 MB/s 2024-04-25T08:51:12.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.312 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726625 s, 144 MB/s 2024-04-25T08:51:12.321 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.321 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.321 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877005 s, 120 MB/s 2024-04-25T08:51:12.327 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.327 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.327 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00551649 s, 190 MB/s 2024-04-25T08:51:12.335 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.335 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.335 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679237 s, 154 MB/s 2024-04-25T08:51:12.342 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.342 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.343 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006526 s, 161 MB/s 2024-04-25T08:51:12.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.349 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058148 s, 180 MB/s 2024-04-25T08:51:12.356 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.356 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.357 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646512 s, 162 MB/s 2024-04-25T08:51:12.363 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.364 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.364 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634587 s, 165 MB/s 2024-04-25T08:51:12.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.373 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00834352 s, 126 MB/s 2024-04-25T08:51:12.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.381 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066558 s, 158 MB/s 2024-04-25T08:51:12.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.388 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651297 s, 161 MB/s 2024-04-25T08:51:12.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.396 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.396 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687606 s, 152 MB/s 2024-04-25T08:51:12.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.403 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062065 s, 169 MB/s 2024-04-25T08:51:12.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907175 s, 116 MB/s 2024-04-25T08:51:12.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.420 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065432 s, 160 MB/s 2024-04-25T08:51:12.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.428 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067301 s, 156 MB/s 2024-04-25T08:51:12.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.435 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636082 s, 165 MB/s 2024-04-25T08:51:12.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.442 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666543 s, 157 MB/s 2024-04-25T08:51:12.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.450 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006449 s, 163 MB/s 2024-04-25T08:51:12.459 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.459 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.459 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00821207 s, 128 MB/s 2024-04-25T08:51:12.467 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.467 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.467 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074556 s, 141 MB/s 2024-04-25T08:51:12.475 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.475 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.475 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704538 s, 149 MB/s 2024-04-25T08:51:12.482 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.482 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.482 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060014 s, 175 MB/s 2024-04-25T08:51:12.489 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.489 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.489 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625581 s, 168 MB/s 2024-04-25T08:51:12.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.497 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654355 s, 160 MB/s 2024-04-25T08:51:12.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.504 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006392 s, 164 MB/s 2024-04-25T08:51:12.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.512 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661632 s, 158 MB/s 2024-04-25T08:51:12.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.519 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723622 s, 145 MB/s 2024-04-25T08:51:12.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.527 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668677 s, 157 MB/s 2024-04-25T08:51:12.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:12.528 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:12.528 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:12.528 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T08:51:12.528 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:12.529 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:12.529 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:12.529 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:12.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.592 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586004 s, 179 MB/s 2024-04-25T08:51:12.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636524 s, 165 MB/s 2024-04-25T08:51:12.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.607 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725641 s, 145 MB/s 2024-04-25T08:51:12.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.614 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.614 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588772 s, 178 MB/s 2024-04-25T08:51:12.622 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.622 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.622 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708826 s, 148 MB/s 2024-04-25T08:51:12.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.629 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588842 s, 178 MB/s 2024-04-25T08:51:12.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.637 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.637 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716935 s, 146 MB/s 2024-04-25T08:51:12.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.645 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.645 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735843 s, 142 MB/s 2024-04-25T08:51:12.652 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.652 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.652 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564151 s, 186 MB/s 2024-04-25T08:51:12.659 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.659 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.659 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634657 s, 165 MB/s 2024-04-25T08:51:12.667 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.667 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.667 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717263 s, 146 MB/s 2024-04-25T08:51:12.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.677 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.677 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00890065 s, 118 MB/s 2024-04-25T08:51:12.683 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.684 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.684 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553309 s, 190 MB/s 2024-04-25T08:51:12.691 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.691 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.691 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685937 s, 153 MB/s 2024-04-25T08:51:12.698 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.698 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.698 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629891 s, 166 MB/s 2024-04-25T08:51:12.707 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.707 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.707 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737768 s, 142 MB/s 2024-04-25T08:51:12.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.715 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719302 s, 146 MB/s 2024-04-25T08:51:12.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.725 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946257 s, 111 MB/s 2024-04-25T08:51:12.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.732 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616958 s, 170 MB/s 2024-04-25T08:51:12.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.741 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720982 s, 145 MB/s 2024-04-25T08:51:12.750 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.750 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.750 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610574 s, 172 MB/s 2024-04-25T08:51:12.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.755 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648973 s, 162 MB/s 2024-04-25T08:51:12.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.763 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720476 s, 146 MB/s 2024-04-25T08:51:12.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.770 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670706 s, 156 MB/s 2024-04-25T08:51:12.780 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.780 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.780 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864031 s, 121 MB/s 2024-04-25T08:51:12.787 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.787 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.787 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649631 s, 161 MB/s 2024-04-25T08:51:12.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.795 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685267 s, 153 MB/s 2024-04-25T08:51:12.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.802 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589269 s, 178 MB/s 2024-04-25T08:51:12.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.810 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714585 s, 147 MB/s 2024-04-25T08:51:12.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.817 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.817 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622543 s, 168 MB/s 2024-04-25T08:51:12.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.825 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732629 s, 143 MB/s 2024-04-25T08:51:12.832 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.833 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651685 s, 161 MB/s 2024-04-25T08:51:12.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:12.834 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:12.834 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:12.834 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T08:51:12.834 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:12.834 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:12.834 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:12.834 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:12.898 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.898 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.898 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630388 s, 166 MB/s 2024-04-25T08:51:12.906 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.906 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.906 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748969 s, 140 MB/s 2024-04-25T08:51:12.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.914 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686735 s, 153 MB/s 2024-04-25T08:51:12.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.922 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661891 s, 158 MB/s 2024-04-25T08:51:12.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.930 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.930 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754929 s, 139 MB/s 2024-04-25T08:51:12.937 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.937 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.937 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063407 s, 165 MB/s 2024-04-25T08:51:12.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.945 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653468 s, 160 MB/s 2024-04-25T08:51:12.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.954 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622882 s, 168 MB/s 2024-04-25T08:51:12.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.959 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067765 s, 155 MB/s 2024-04-25T08:51:12.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.967 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720567 s, 146 MB/s 2024-04-25T08:51:12.976 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.976 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.976 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774169 s, 135 MB/s 2024-04-25T08:51:12.985 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.985 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.985 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789741 s, 133 MB/s 2024-04-25T08:51:12.993 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:12.993 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:12.993 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761444 s, 138 MB/s 2024-04-25T08:51:13.001 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.001 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.001 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694835 s, 151 MB/s 2024-04-25T08:51:13.009 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.009 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.009 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728839 s, 144 MB/s 2024-04-25T08:51:13.017 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.017 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.017 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662664 s, 158 MB/s 2024-04-25T08:51:13.024 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.025 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664077 s, 158 MB/s 2024-04-25T08:51:13.031 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.032 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615398 s, 170 MB/s 2024-04-25T08:51:13.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.040 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.040 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717772 s, 146 MB/s 2024-04-25T08:51:13.047 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.047 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.047 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663914 s, 158 MB/s 2024-04-25T08:51:13.055 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.055 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.055 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709001 s, 148 MB/s 2024-04-25T08:51:13.063 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.063 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.063 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663493 s, 158 MB/s 2024-04-25T08:51:13.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.072 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792783 s, 132 MB/s 2024-04-25T08:51:13.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.079 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646182 s, 162 MB/s 2024-04-25T08:51:13.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.086 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656729 s, 160 MB/s 2024-04-25T08:51:13.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.095 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.095 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739721 s, 142 MB/s 2024-04-25T08:51:13.102 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.102 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.102 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645807 s, 162 MB/s 2024-04-25T08:51:13.109 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.110 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.110 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673392 s, 156 MB/s 2024-04-25T08:51:13.116 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.117 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615337 s, 170 MB/s 2024-04-25T08:51:13.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.126 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.126 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770199 s, 136 MB/s 2024-04-25T08:51:13.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.134 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776494 s, 135 MB/s 2024-04-25T08:51:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.141 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.142 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065894 s, 159 MB/s 2024-04-25T08:51:13.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:13.143 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:51:13.143 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:51:13.143 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T08:51:13.143 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:51:13.143 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:51:13.143 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:51:13.143 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:51:13.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.208 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703455 s, 149 MB/s 2024-04-25T08:51:13.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.215 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630089 s, 166 MB/s 2024-04-25T08:51:13.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.222 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.222 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672984 s, 156 MB/s 2024-04-25T08:51:13.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.230 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639711 s, 164 MB/s 2024-04-25T08:51:13.236 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.236 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.236 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594077 s, 177 MB/s 2024-04-25T08:51:13.244 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.245 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725072 s, 145 MB/s 2024-04-25T08:51:13.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.252 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.252 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640302 s, 164 MB/s 2024-04-25T08:51:13.260 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.260 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.260 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761909 s, 138 MB/s 2024-04-25T08:51:13.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582415 s, 180 MB/s 2024-04-25T08:51:13.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.274 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591506 s, 177 MB/s 2024-04-25T08:51:13.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.281 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.281 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644946 s, 163 MB/s 2024-04-25T08:51:13.288 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.289 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064907 s, 162 MB/s 2024-04-25T08:51:13.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.296 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632899 s, 166 MB/s 2024-04-25T08:51:13.302 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.303 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583413 s, 180 MB/s 2024-04-25T08:51:13.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.309 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.309 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566622 s, 185 MB/s 2024-04-25T08:51:13.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.318 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762891 s, 137 MB/s 2024-04-25T08:51:13.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.325 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592209 s, 177 MB/s 2024-04-25T08:51:13.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.333 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732493 s, 143 MB/s 2024-04-25T08:51:13.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572278 s, 183 MB/s 2024-04-25T08:51:13.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.346 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578123 s, 181 MB/s 2024-04-25T08:51:13.353 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640818 s, 164 MB/s 2024-04-25T08:51:13.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.361 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661228 s, 159 MB/s 2024-04-25T08:51:13.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.368 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.368 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582451 s, 180 MB/s 2024-04-25T08:51:13.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.376 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698566 s, 150 MB/s 2024-04-25T08:51:13.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.383 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.383 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660703 s, 159 MB/s 2024-04-25T08:51:13.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.391 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716756 s, 146 MB/s 2024-04-25T08:51:13.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.399 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646497 s, 162 MB/s 2024-04-25T08:51:13.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.406 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626894 s, 167 MB/s 2024-04-25T08:51:13.414 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.414 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.414 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007125 s, 147 MB/s 2024-04-25T08:51:13.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.421 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668221 s, 157 MB/s 2024-04-25T08:51:13.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.428 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.428 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061898 s, 169 MB/s 2024-04-25T08:51:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:51:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:51:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062304 s, 168 MB/s 2024-04-25T08:51:13.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:13.437 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-04-25T08:51:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.589+0000 7fda2ca83640 1 Processor -- start 2024-04-25T08:51:13.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.590+0000 7fda2ca83640 1 -- start start 2024-04-25T08:51:13.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.590+0000 7fda2ca83640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fda2806e360 0x7fda2806e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.590+0000 7fda2ca83640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda2806ec80 0x7fda280b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.590+0000 7fda2ca83640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fda280b3e10 0x7fda2806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.590+0000 7fda2ca83640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2806b890 con 0x7fda280b3e10 2024-04-25T08:51:13.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.590+0000 7fda2ca83640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2815e020 con 0x7fda2806e360 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.590+0000 7fda2ca83640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2806ac80 con 0x7fda2806ec80 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.591+0000 7fda26d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fda280b3e10 0x7fda2806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.591+0000 7fda26d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fda280b3e10 0x7fda2806bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50784/0 (socket says 172.21.15.172:50784) 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.591+0000 7fda26d9d640 1 -- 172.21.15.172:0/4191879928 learned_addr learned my addr 172.21.15.172:0/4191879928 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.591+0000 7fda2659c640 1 --2- 172.21.15.172:0/4191879928 >> v2:172.21.15.186:3300/0 conn(0x7fda2806e360 0x7fda2806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.591+0000 7fda25d9b640 1 --2- 172.21.15.172:0/4191879928 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda2806ec80 0x7fda280b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.591+0000 7fda26d9d640 1 -- 172.21.15.172:0/4191879928 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda2806ec80 msgr2=0x7fda280b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.591+0000 7fda26d9d640 1 --2- 172.21.15.172:0/4191879928 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda2806ec80 0x7fda280b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.591+0000 7fda26d9d640 1 -- 172.21.15.172:0/4191879928 >> v2:172.21.15.186:3300/0 conn(0x7fda2806e360 msgr2=0x7fda2806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.591+0000 7fda26d9d640 1 --2- 172.21.15.172:0/4191879928 >> v2:172.21.15.186:3300/0 conn(0x7fda2806e360 0x7fda2806e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.591+0000 7fda26d9d640 1 -- 172.21.15.172:0/4191879928 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2806af60 con 0x7fda280b3e10 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda26d9d640 1 --2- 172.21.15.172:0/4191879928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda280b3e10 0x7fda2806bd20 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fda28072e90 tx=0x7fda2002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d1300c3a1162de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.584 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda2559a640 1 -- 172.21.15.172:0/4191879928 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda20036070 con 0x7fda280b3e10 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda2559a640 1 -- 172.21.15.172:0/4191879928 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda20031600 con 0x7fda280b3e10 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda2559a640 1 -- 172.21.15.172:0/4191879928 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda200319d0 con 0x7fda280b3e10 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda2ca83640 1 -- 172.21.15.172:0/4191879928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda280b3e10 msgr2=0x7fda2806bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda2ca83640 1 --2- 172.21.15.172:0/4191879928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda280b3e10 0x7fda2806bd20 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fda28072e90 tx=0x7fda2002a730 comp rx=0 tx=0).stop 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda2ca83640 1 -- 172.21.15.172:0/4191879928 shutdown_connections 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda2ca83640 1 --2- 172.21.15.172:0/4191879928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda280b3e10 0x7fda2806bd20 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda2ca83640 1 --2- 172.21.15.172:0/4191879928 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda2806ec80 0x7fda280b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda2ca83640 1 --2- 172.21.15.172:0/4191879928 >> v2:172.21.15.186:3300/0 conn(0x7fda2806e360 0x7fda2806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.592+0000 7fda2ca83640 1 -- 172.21.15.172:0/4191879928 >> 172.21.15.172:0/4191879928 conn(0x7fda280cfec0 msgr2=0x7fda280d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.593+0000 7fda2ca83640 1 -- 172.21.15.172:0/4191879928 shutdown_connections 2024-04-25T08:51:13.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.593+0000 7fda2ca83640 1 -- 172.21.15.172:0/4191879928 wait complete. 2024-04-25T08:51:13.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.594+0000 7fda2ca83640 1 Processor -- start 2024-04-25T08:51:13.588 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.594+0000 7fda2ca83640 1 -- start start 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.594+0000 7fda2ca83640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda2806e360 0x7fda281492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.594+0000 7fda2ca83640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2806ec80 0x7fda281f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2ca83640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda280b3e10 0x7fda280c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2ca83640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280b2fd0 con 0x7fda2806e360 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2ca83640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2806b520 con 0x7fda2806ec80 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2ca83640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda280b3150 con 0x7fda280b3e10 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda2806e360 0x7fda281492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda2806e360 0x7fda281492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50794/0 (socket says 172.21.15.172:50794) 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2659c640 1 -- 172.21.15.172:0/519238512 learned_addr learned my addr 172.21.15.172:0/519238512 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda26d9d640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda280b3e10 0x7fda280c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda25d9b640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2806ec80 0x7fda281f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.589 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2659c640 1 -- 172.21.15.172:0/519238512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda280b3e10 msgr2=0x7fda280c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2659c640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda280b3e10 0x7fda280c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2659c640 1 -- 172.21.15.172:0/519238512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2806ec80 msgr2=0x7fda281f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2659c640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2806ec80 0x7fda281f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2659c640 1 -- 172.21.15.172:0/519238512 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda281f4580 con 0x7fda2806e360 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda26d9d640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda280b3e10 0x7fda280c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda25d9b640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2806ec80 0x7fda281f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2659c640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda2806e360 0x7fda281492b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fda1800e890 tx=0x7fda1800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda16ffd640 1 -- 172.21.15.172:0/519238512 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18017070 con 0x7fda2806e360 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda16ffd640 1 -- 172.21.15.172:0/519238512 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1800c8e0 con 0x7fda2806e360 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2ca83640 1 -- 172.21.15.172:0/519238512 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda281f3fc0 con 0x7fda2806e360 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda16ffd640 1 -- 172.21.15.172:0/519238512 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800ccb0 con 0x7fda2806e360 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.595+0000 7fda2ca83640 1 -- 172.21.15.172:0/519238512 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda280af160 con 0x7fda2806e360 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.597+0000 7fda16ffd640 1 -- 172.21.15.172:0/519238512 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda1801a070 con 0x7fda2806e360 2024-04-25T08:51:13.590 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.597+0000 7fda16ffd640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 0x7fda0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.597+0000 7fda16ffd640 1 -- 172.21.15.172:0/519238512 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fda1808a2d0 con 0x7fda2806e360 2024-04-25T08:51:13.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.597+0000 7fda25d9b640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 0x7fda0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.597+0000 7fda25d9b640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 0x7fda0806d990 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fda280c9f50 tx=0x7fda1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.598+0000 7fda2f781740 1 Processor -- start 2024-04-25T08:51:13.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.598+0000 7fda2f781740 1 -- start start 2024-04-25T08:51:13.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda2f781740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d11200 0x5595e7d13360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda2f781740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d4d8d0 0x5595e7d115e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda2f781740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d3bcc0 0x5595e7d3c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda2f781740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e7c75000 con 0x5595e7d4d8d0 2024-04-25T08:51:13.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda2f781740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e7c1df20 con 0x5595e7d3bcc0 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda2f781740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595e7c710a0 con 0x5595e7d11200 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda25d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d4d8d0 0x5595e7d115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda25d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d4d8d0 0x5595e7d115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50806/0 (socket says 172.21.15.172:50806) 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda25d9b640 1 -- 172.21.15.172:0/1967819446 learned_addr learned my addr 172.21.15.172:0/1967819446 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda2659c640 1 --2- 172.21.15.172:0/1967819446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d11200 0x5595e7d13360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda26d9d640 1 --2- 172.21.15.172:0/1967819446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d3bcc0 0x5595e7d3c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda25d9b640 1 -- 172.21.15.172:0/1967819446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d11200 msgr2=0x5595e7d13360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda25d9b640 1 --2- 172.21.15.172:0/1967819446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d11200 0x5595e7d13360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda25d9b640 1 -- 172.21.15.172:0/1967819446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d3bcc0 msgr2=0x5595e7d3c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda25d9b640 1 --2- 172.21.15.172:0/1967819446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d3bcc0 0x5595e7d3c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda25d9b640 1 -- 172.21.15.172:0/1967819446 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595e7a55ba0 con 0x5595e7d4d8d0 2024-04-25T08:51:13.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.599+0000 7fda25d9b640 1 --2- 172.21.15.172:0/1967819446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d4d8d0 0x5595e7d115e0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fda1c011e60 tx=0x7fda1c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8a87024f220d92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda07fff640 1 -- 172.21.15.172:0/1967819446 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c015e50 con 0x5595e7d4d8d0 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda07fff640 1 -- 172.21.15.172:0/1967819446 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c026070 con 0x5595e7d4d8d0 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda07fff640 1 -- 172.21.15.172:0/1967819446 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c021640 con 0x5595e7d4d8d0 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda2f781740 1 -- 172.21.15.172:0/1967819446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d4d8d0 msgr2=0x5595e7d115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda2f781740 1 --2- 172.21.15.172:0/1967819446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d4d8d0 0x5595e7d115e0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fda1c011e60 tx=0x7fda1c014000 comp rx=0 tx=0).stop 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda2f781740 1 -- 172.21.15.172:0/1967819446 shutdown_connections 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda2f781740 1 --2- 172.21.15.172:0/1967819446 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d3bcc0 0x5595e7d3c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda2f781740 1 --2- 172.21.15.172:0/1967819446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d4d8d0 0x5595e7d115e0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda2f781740 1 --2- 172.21.15.172:0/1967819446 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d11200 0x5595e7d13360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda2f781740 1 -- 172.21.15.172:0/1967819446 >> 172.21.15.172:0/1967819446 conn(0x5595e7cd9050 msgr2=0x5595e7d56cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda2f781740 1 -- 172.21.15.172:0/1967819446 shutdown_connections 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.600+0000 7fda2f781740 1 -- 172.21.15.172:0/1967819446 wait complete. 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.601+0000 7fda2f781740 1 -- start start 2024-04-25T08:51:13.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.601+0000 7fda2f781740 1 Processor -- start 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda2f781740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d11200 0x5595e7d2c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda2f781740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d3bcc0 0x5595e7d519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda2f781740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d4d8d0 0x5595e7d51f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda2f781740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e7c13610 con 0x5595e7d3bcc0 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda2f781740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e7d39810 con 0x5595e7d11200 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda2f781740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595e7d52860 con 0x5595e7d4d8d0 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda2f781740 10 client.0 _ll_register_callbacks cb 0x5595e7c2bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda25d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d3bcc0 0x5595e7d519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda25d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d3bcc0 0x5595e7d519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50810/0 (socket says 172.21.15.172:50810) 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda25d9b640 1 -- 172.21.15.172:0/2158803358 learned_addr learned my addr 172.21.15.172:0/2158803358 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda2659c640 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d11200 0x5595e7d2c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda26d9d640 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d4d8d0 0x5595e7d51f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda25d9b640 1 -- 172.21.15.172:0/2158803358 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d4d8d0 msgr2=0x5595e7d51f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda25d9b640 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d4d8d0 0x5595e7d51f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda25d9b640 1 -- 172.21.15.172:0/2158803358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d11200 msgr2=0x5595e7d2c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda25d9b640 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d11200 0x5595e7d2c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.602+0000 7fda25d9b640 1 -- 172.21.15.172:0/2158803358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595e7949490 con 0x5595e7d3bcc0 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda25d9b640 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d3bcc0 0x5595e7d519e0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fda1c012010 tx=0x7fda1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c18e5ce3ccd32cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda057fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda057fa640 1 -- 172.21.15.172:0/2158803358 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c021b50 con 0x5595e7d3bcc0 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda057fa640 1 -- 172.21.15.172:0/2158803358 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fda1c021cf0 con 0x5595e7d3bcc0 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda2f781740 1 -- 172.21.15.172:0/2158803358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda1c026070 con 0x5595e7d3bcc0 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda057fa640 1 -- 172.21.15.172:0/2158803358 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda1c02a400 con 0x5595e7d3bcc0 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda2f781740 10 client.9495 fetch_fsmap learned FSMap version 74 2024-04-25T08:51:13.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda2f781740 1 -- 172.21.15.172:0/2158803358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5595e7ab6330 con 0x5595e7d3bcc0 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda057fa640 1 -- 172.21.15.172:0/2158803358 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c026070 con 0x5595e7d3bcc0 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda057fa640 1 -- 172.21.15.172:0/2158803358 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 74) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fda1c02a5a0 con 0x5595e7d3bcc0 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda2f781740 10 client.9495 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda2f781740 10 client.9495 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda2f781740 20 client.9495 populate_metadata read hostname 'smithi172' 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda2f781740 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5595e7d3d620 0x5595e7d3f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda2f781740 4 client.9495 mds_command: new command op to 9294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda2f781740 1 -- 172.21.15.172:0/2158803358 --> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595e7c82540 con 0x5595e7d3d620 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.603+0000 7fda2659c640 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5595e7d3d620 0x5595e7d3f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda057fa640 10 client.9495 ms_handle_connect on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2659c640 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5595e7d3d620 0x5595e7d3f5c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca58fa8a85f0ab95 server_cookie=69acb3beebe866da in_seq=0 out_seq=0 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda057fa640 1 -- 172.21.15.172:0/2158803358 <== mds.0 v2:172.21.15.172:6836/3347790695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5595e7c82540 con 0x5595e7d3d620 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda057fa640 10 client.9495 handle_command_reply: tid=0 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 client.9495 shutdown 2024-04-25T08:51:13.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 -- 172.21.15.172:0/2158803358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d3bcc0 msgr2=0x5595e7d519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d3bcc0 0x5595e7d519e0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fda1c012010 tx=0x7fda1c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 -- 172.21.15.172:0/2158803358 shutdown_connections 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5595e7d3d620 0x5595e7d3f5c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d4d8d0 0x5595e7d51f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d3bcc0 0x5595e7d519e0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 --2- 172.21.15.172:0/2158803358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d11200 0x5595e7d2c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda057fa640 0 client.9495 ms_handle_reset on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 -- 172.21.15.172:0/2158803358 >> 172.21.15.172:0/2158803358 conn(0x5595e7cd9050 msgr2=0x5595e7d5a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 -- 172.21.15.172:0/2158803358 shutdown_connections 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 1 -- 172.21.15.172:0/2158803358 wait complete. 2024-04-25T08:51:13.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.604+0000 7fda2f781740 20 client.9495 trim_cache size 0 max 16384 2024-04-25T08:51:13.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.619+0000 7fda2f781740 1 Processor -- start 2024-04-25T08:51:13.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.619+0000 7fda2f781740 1 -- start start 2024-04-25T08:51:13.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2f781740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2f781740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d3bcc0 0x5595e7d3a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2f781740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d4d8d0 0x5595e7d3a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2f781740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda282003c0 con 0x5595e7d11200 2024-04-25T08:51:13.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2f781740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281ff5c0 con 0x5595e7d4d8d0 2024-04-25T08:51:13.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2f781740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda280b0830 con 0x5595e7d3bcc0 2024-04-25T08:51:13.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50812/0 (socket says 172.21.15.172:50812) 2024-04-25T08:51:13.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2659c640 1 -- 172.21.15.172:0/2789227257 learned_addr learned my addr 172.21.15.172:0/2789227257 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2659c640 1 -- 172.21.15.172:0/2789227257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d3bcc0 msgr2=0x5595e7d3a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2659c640 1 --2- 172.21.15.172:0/2789227257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d3bcc0 0x5595e7d3a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2659c640 1 -- 172.21.15.172:0/2789227257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d4d8d0 msgr2=0x5595e7d3a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2659c640 1 --2- 172.21.15.172:0/2789227257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d4d8d0 0x5595e7d3a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.620+0000 7fda2659c640 1 -- 172.21.15.172:0/2789227257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595e7d3f930 con 0x5595e7d11200 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda2659c640 1 --2- 172.21.15.172:0/2789227257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db3930 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fda18058650 tx=0x7fda180885d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988d3fee608dee77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda077fe640 1 -- 172.21.15.172:0/2789227257 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18021040 con 0x5595e7d11200 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda077fe640 1 -- 172.21.15.172:0/2789227257 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1808a0b0 con 0x5595e7d11200 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda077fe640 1 -- 172.21.15.172:0/2789227257 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18056c50 con 0x5595e7d11200 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda2f781740 1 -- 172.21.15.172:0/2789227257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 msgr2=0x5595e7db3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda2f781740 1 --2- 172.21.15.172:0/2789227257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db3930 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fda18058650 tx=0x7fda180885d0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda2f781740 1 -- 172.21.15.172:0/2789227257 shutdown_connections 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda2f781740 1 --2- 172.21.15.172:0/2789227257 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d4d8d0 0x5595e7d3a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda2f781740 1 --2- 172.21.15.172:0/2789227257 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d3bcc0 0x5595e7d3a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda2f781740 1 --2- 172.21.15.172:0/2789227257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db3930 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda2f781740 1 -- 172.21.15.172:0/2789227257 >> 172.21.15.172:0/2789227257 conn(0x5595e7cd9050 msgr2=0x5595e7d131e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda2f781740 1 -- 172.21.15.172:0/2789227257 shutdown_connections 2024-04-25T08:51:13.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.621+0000 7fda2f781740 1 -- 172.21.15.172:0/2789227257 wait complete. 2024-04-25T08:51:13.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.622+0000 7fda2f781740 1 -- start start 2024-04-25T08:51:13.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.622+0000 7fda2f781740 1 Processor -- start 2024-04-25T08:51:13.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2f781740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2f781740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d3bcc0 0x5595e7d382b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2f781740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d4d8d0 0x5595e7db2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2f781740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281fefc0 con 0x5595e7d11200 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2f781740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595e7db7d90 con 0x5595e7d4d8d0 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2f781740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595e7d5aa10 con 0x5595e7d3bcc0 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2f781740 10 client.0 _ll_register_callbacks cb 0x7fda1c009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50822/0 (socket says 172.21.15.172:50822) 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2659c640 1 -- 172.21.15.172:0/1384269093 learned_addr learned my addr 172.21.15.172:0/1384269093 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda26d9d640 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d4d8d0 0x5595e7db2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda25d9b640 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d3bcc0 0x5595e7d382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2659c640 1 -- 172.21.15.172:0/1384269093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d3bcc0 msgr2=0x5595e7d382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2659c640 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d3bcc0 0x5595e7d382b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2659c640 1 -- 172.21.15.172:0/1384269093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d4d8d0 msgr2=0x5595e7db2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2659c640 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d4d8d0 0x5595e7db2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2659c640 1 -- 172.21.15.172:0/1384269093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595e7922610 con 0x5595e7d11200 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda26d9d640 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d4d8d0 0x5595e7db2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2659c640 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db4340 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fda18058650 tx=0x7fda1808a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe11a6a4796743a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda057fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda057fa640 1 -- 172.21.15.172:0/1384269093 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18021030 con 0x5595e7d11200 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda057fa640 1 -- 172.21.15.172:0/1384269093 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fda18054fc0 con 0x5595e7d11200 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.623+0000 7fda2f781740 1 -- 172.21.15.172:0/1384269093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda1808a0b0 con 0x5595e7d11200 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda057fa640 1 -- 172.21.15.172:0/1384269093 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda18077350 con 0x5595e7d11200 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda2f781740 10 client.9501 fetch_fsmap learned FSMap version 74 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda2f781740 1 -- 172.21.15.172:0/1384269093 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5595e7db7b90 con 0x5595e7d11200 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda057fa640 1 -- 172.21.15.172:0/1384269093 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1808a0b0 con 0x5595e7d11200 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda057fa640 1 -- 172.21.15.172:0/1384269093 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 74) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fda18024060 con 0x5595e7d11200 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda2f781740 10 client.9501 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda2f781740 10 client.9501 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda2f781740 20 client.9501 populate_metadata read hostname 'smithi172' 2024-04-25T08:51:13.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda2f781740 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5595e7db6f90 0x5595e7db7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda2f781740 4 client.9501 mds_command: new command op to 9294 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda2f781740 1 -- 172.21.15.172:0/1384269093 --> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x5595e7c7c890 con 0x5595e7db6f90 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda25d9b640 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5595e7db6f90 0x5595e7db7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda057fa640 10 client.9501 ms_handle_connect on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.624+0000 7fda25d9b640 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5595e7db6f90 0x5595e7db7370 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e21c5b73df1d72b server_cookie=3b560b71aebb651e in_seq=0 out_seq=0 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda057fa640 1 -- 172.21.15.172:0/1384269093 <== mds.0 v2:172.21.15.172:6836/3347790695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5595e7c7c890 con 0x5595e7db6f90 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda057fa640 10 client.9501 handle_command_reply: tid=0 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 client.9501 shutdown 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 -- 172.21.15.172:0/1384269093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 msgr2=0x5595e7db4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db4340 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fda18058650 tx=0x7fda1808a040 comp rx=0 tx=0).stop 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 -- 172.21.15.172:0/1384269093 shutdown_connections 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5595e7db6f90 0x5595e7db7370 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5595e7d4d8d0 0x5595e7db2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x5595e7d3bcc0 0x5595e7d382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 --2- 172.21.15.172:0/1384269093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595e7d11200 0x5595e7db4340 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda057fa640 0 client.9501 ms_handle_reset on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 -- 172.21.15.172:0/1384269093 >> 172.21.15.172:0/1384269093 conn(0x5595e7cd9050 msgr2=0x5595e7d131e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 -- 172.21.15.172:0/1384269093 shutdown_connections 2024-04-25T08:51:13.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 1 -- 172.21.15.172:0/1384269093 wait complete. 2024-04-25T08:51:13.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.627+0000 7fda2f781740 20 client.9501 trim_cache size 0 max 16384 2024-04-25T08:51:13.621 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:51:13.621 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0, 2024-04-25T08:51:13.621 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_tag": "6d39b950-dbe7-4c1e-9e2a-f505297c143b", 2024-04-25T08:51:13.621 INFO:teuthology.orchestra.run.smithi172.stdout: "mode": "asynchronous" 2024-04-25T08:51:13.621 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:51:13.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 -- 172.21.15.172:0/519238512 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 msgr2=0x7fda0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 0x7fda0806d990 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fda280c9f50 tx=0x7fda1c008040 comp rx=0 tx=0).stop 2024-04-25T08:51:13.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 -- 172.21.15.172:0/519238512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda2806e360 msgr2=0x7fda281492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda2806e360 0x7fda281492b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fda1800e890 tx=0x7fda1800ed50 comp rx=0 tx=0).stop 2024-04-25T08:51:13.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 -- 172.21.15.172:0/519238512 shutdown_connections 2024-04-25T08:51:13.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 0x7fda0806d990 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2806ec80 0x7fda281f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda280b3e10 0x7fda280c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 --2- 172.21.15.172:0/519238512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda2806e360 0x7fda281492b0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 -- 172.21.15.172:0/519238512 >> 172.21.15.172:0/519238512 conn(0x7fda280cfec0 msgr2=0x7fda2806f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 -- 172.21.15.172:0/519238512 shutdown_connections 2024-04-25T08:51:13.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.628+0000 7fda2ca83640 1 -- 172.21.15.172:0/519238512 wait complete. 2024-04-25T08:51:13.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:13.630 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-04-25T08:51:13.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.771+0000 7f611205a640 1 Processor -- start 2024-04-25T08:51:13.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.771+0000 7f611205a640 1 -- start start 2024-04-25T08:51:13.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.772+0000 7f611205a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f610c0ced80 0x7f610c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.772+0000 7f611205a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f610c161710 0x7f610c0d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.772+0000 7f611205a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c15e000 con 0x7f610c15dc20 2024-04-25T08:51:13.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.772+0000 7f611205a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c0d1de0 con 0x7f610c161710 2024-04-25T08:51:13.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.772+0000 7f611205a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c161c60 con 0x7f610c0ced80 2024-04-25T08:51:13.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.772+0000 7f610bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f610c161710 0x7f610c0d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.772+0000 7f610b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f610c15dc20 0x7f610c0ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38242/0 (socket says 172.21.15.172:38242) 2024-04-25T08:51:13.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.772+0000 7f610b7fe640 1 -- 172.21.15.172:0/1884674899 learned_addr learned my addr 172.21.15.172:0/1884674899 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:13.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.772+0000 7f6103fff640 1 --2- 172.21.15.172:0/1884674899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f610c0ced80 0x7f610c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.773+0000 7f610bfff640 1 -- 172.21.15.172:0/1884674899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f610c0ced80 msgr2=0x7f610c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.773+0000 7f610bfff640 1 --2- 172.21.15.172:0/1884674899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f610c0ced80 0x7f610c0d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.773+0000 7f610bfff640 1 -- 172.21.15.172:0/1884674899 >> v1:172.21.15.172:6789/0 conn(0x7f610c15dc20 legacy=0x7f610c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.773+0000 7f610bfff640 1 -- 172.21.15.172:0/1884674899 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c161f40 con 0x7f610c161710 2024-04-25T08:51:13.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.773+0000 7f610bfff640 1 --2- 172.21.15.172:0/1884674899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c161710 0x7f610c0d2820 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f6104009d90 tx=0x7f610402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72d769b16d95912 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.773+0000 7f610affd640 1 -- 172.21.15.172:0/1884674899 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104007740 con 0x7f610c161710 2024-04-25T08:51:13.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.774+0000 7f610affd640 1 -- 172.21.15.172:0/1884674899 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61040078e0 con 0x7f610c161710 2024-04-25T08:51:13.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.774+0000 7f610affd640 1 -- 172.21.15.172:0/1884674899 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104007cb0 con 0x7f610c161710 2024-04-25T08:51:13.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.774+0000 7f611205a640 1 -- 172.21.15.172:0/1884674899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c161710 msgr2=0x7f610c0d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.774+0000 7f611205a640 1 --2- 172.21.15.172:0/1884674899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c161710 0x7f610c0d2820 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f6104009d90 tx=0x7f610402a660 comp rx=0 tx=0).stop 2024-04-25T08:51:13.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.774+0000 7f611205a640 1 -- 172.21.15.172:0/1884674899 shutdown_connections 2024-04-25T08:51:13.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.774+0000 7f611205a640 1 --2- 172.21.15.172:0/1884674899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f610c0ced80 0x7f610c0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.774+0000 7f611205a640 1 --2- 172.21.15.172:0/1884674899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c161710 0x7f610c0d2820 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.774+0000 7f611205a640 1 -- 172.21.15.172:0/1884674899 >> 172.21.15.172:0/1884674899 conn(0x7f610c0d0420 msgr2=0x7f610c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.774+0000 7f611205a640 1 -- 172.21.15.172:0/1884674899 shutdown_connections 2024-04-25T08:51:13.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.774+0000 7f611205a640 1 -- 172.21.15.172:0/1884674899 wait complete. 2024-04-25T08:51:13.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.775+0000 7f611205a640 1 Processor -- start 2024-04-25T08:51:13.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.775+0000 7f611205a640 1 -- start start 2024-04-25T08:51:13.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f611205a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c0ced80 0x7f610c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f611205a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f610c15dc20 0x7f610c0b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f611205a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f610c161710 0x7f610c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f611205a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0b5e50 con 0x7f610c0ced80 2024-04-25T08:51:13.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f611205a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c162500 con 0x7f610c15dc20 2024-04-25T08:51:13.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f611205a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0b5fd0 con 0x7f610c161710 2024-04-25T08:51:13.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c0ced80 0x7f610c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c0ced80 0x7f610c14fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50852/0 (socket says 172.21.15.172:50852) 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f610b7fe640 1 -- 172.21.15.172:0/5474912 learned_addr learned my addr 172.21.15.172:0/5474912 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f610b7fe640 1 -- 172.21.15.172:0/5474912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f610c161710 msgr2=0x7f610c0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f610b7fe640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f610c161710 0x7f610c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f610b7fe640 1 -- 172.21.15.172:0/5474912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f610c15dc20 msgr2=0x7f610c0b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.776+0000 7f6103fff640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f610c15dc20 0x7f610c0b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.777+0000 7f610b7fe640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f610c15dc20 0x7f610c0b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.777+0000 7f610b7fe640 1 -- 172.21.15.172:0/5474912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c1e8f10 con 0x7f610c0ced80 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.777+0000 7f6103fff640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f610c15dc20 0x7f610c0b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.777+0000 7f610b7fe640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c0ced80 0x7f610c14fd70 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00c3c0 tx=0x7f60fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.777+0000 7f6108ff9640 1 -- 172.21.15.172:0/5474912 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc017070 con 0x7f610c0ced80 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.777+0000 7f6108ff9640 1 -- 172.21.15.172:0/5474912 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc005ce0 con 0x7f610c0ced80 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.777+0000 7f611205a640 1 -- 172.21.15.172:0/5474912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c1e91f0 con 0x7f610c0ced80 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.777+0000 7f6108ff9640 1 -- 172.21.15.172:0/5474912 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc0072f0 con 0x7f610c0ced80 2024-04-25T08:51:13.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.777+0000 7f611205a640 1 -- 172.21.15.172:0/5474912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c1e97b0 con 0x7f610c0ced80 2024-04-25T08:51:13.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.778+0000 7f6108ff9640 1 -- 172.21.15.172:0/5474912 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f60fc01a070 con 0x7f610c0ced80 2024-04-25T08:51:13.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.779+0000 7f6108ff9640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f60ec06b4d0 0x7f60ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.779+0000 7f6103fff640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f60ec06b4d0 0x7f60ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.779+0000 7f6108ff9640 1 -- 172.21.15.172:0/5474912 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f60fc089770 con 0x7f610c0ced80 2024-04-25T08:51:13.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.779+0000 7f6103fff640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f60ec06b4d0 0x7f60ec06d990 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f610c0b5400 tx=0x7f60f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.780+0000 7f6114e35740 1 Processor -- start 2024-04-25T08:51:13.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.780+0000 7f6114e35740 1 -- start start 2024-04-25T08:51:13.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6114e35740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55853494aca0 0x55853494ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6114e35740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534987370 0x55853494b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6114e35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534975760 0x558534975be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6114e35740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585348adb90 con 0x558534987370 2024-04-25T08:51:13.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6114e35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558534856e40 con 0x558534975760 2024-04-25T08:51:13.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6114e35740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585348a9c30 con 0x55853494aca0 2024-04-25T08:51:13.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6103fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534987370 0x55853494b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6103fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534987370 0x55853494b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50864/0 (socket says 172.21.15.172:50864) 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6103fff640 1 -- 172.21.15.172:0/1444942898 learned_addr learned my addr 172.21.15.172:0/1444942898 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f610b7fe640 1 --2- 172.21.15.172:0/1444942898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55853494aca0 0x55853494ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f610bfff640 1 --2- 172.21.15.172:0/1444942898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534975760 0x558534975be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6103fff640 1 -- 172.21.15.172:0/1444942898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55853494aca0 msgr2=0x55853494ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6103fff640 1 --2- 172.21.15.172:0/1444942898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55853494aca0 0x55853494ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6103fff640 1 -- 172.21.15.172:0/1444942898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534975760 msgr2=0x558534975be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6103fff640 1 --2- 172.21.15.172:0/1444942898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534975760 0x558534975be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6103fff640 1 -- 172.21.15.172:0/1444942898 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55853468c7d0 con 0x558534987370 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f6103fff640 1 --2- 172.21.15.172:0/1444942898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534987370 0x55853494b080 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f60f4004200 tx=0x7f60f4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed57a91176de9926 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f61017fa640 1 -- 172.21.15.172:0/1444942898 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4027070 con 0x558534987370 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f61017fa640 1 -- 172.21.15.172:0/1444942898 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f4003a20 con 0x558534987370 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.781+0000 7f61017fa640 1 -- 172.21.15.172:0/1444942898 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f400f040 con 0x558534987370 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.782+0000 7f6114e35740 1 -- 172.21.15.172:0/1444942898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534987370 msgr2=0x55853494b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.782+0000 7f6114e35740 1 --2- 172.21.15.172:0/1444942898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534987370 0x55853494b080 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f60f4004200 tx=0x7f60f4013000 comp rx=0 tx=0).stop 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.782+0000 7f6114e35740 1 -- 172.21.15.172:0/1444942898 shutdown_connections 2024-04-25T08:51:13.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.782+0000 7f6114e35740 1 --2- 172.21.15.172:0/1444942898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534975760 0x558534975be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.782+0000 7f6114e35740 1 --2- 172.21.15.172:0/1444942898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534987370 0x55853494b080 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.782+0000 7f6114e35740 1 --2- 172.21.15.172:0/1444942898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55853494aca0 0x55853494ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.782+0000 7f6114e35740 1 -- 172.21.15.172:0/1444942898 >> 172.21.15.172:0/1444942898 conn(0x558534912870 msgr2=0x558534990760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.782+0000 7f6114e35740 1 -- 172.21.15.172:0/1444942898 shutdown_connections 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.782+0000 7f6114e35740 1 -- 172.21.15.172:0/1444942898 wait complete. 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6114e35740 1 -- start start 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6114e35740 1 Processor -- start 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6114e35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55853494aca0 0x558534972820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6114e35740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534977a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6114e35740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 0x55853498da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6114e35740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55853486a3e0 con 0x558534975760 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6114e35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585349732b0 con 0x55853494aca0 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6114e35740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55853498b810 con 0x558534987370 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6114e35740 10 client.0 _ll_register_callbacks cb 0x558534869db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:51:13.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6103fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534977a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6103fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534977a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50868/0 (socket says 172.21.15.172:50868) 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.783+0000 7f6103fff640 1 -- 172.21.15.172:0/4282694980 learned_addr learned my addr 172.21.15.172:0/4282694980 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f610b7fe640 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55853494aca0 0x558534972820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f610bfff640 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 0x55853498da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6103fff640 1 -- 172.21.15.172:0/4282694980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 msgr2=0x55853498da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6103fff640 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 0x55853498da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6103fff640 1 -- 172.21.15.172:0/4282694980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55853494aca0 msgr2=0x558534972820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6103fff640 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55853494aca0 0x558534972820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6103fff640 1 -- 172.21.15.172:0/4282694980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585345820f0 con 0x558534975760 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f610bfff640 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 0x55853498da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f610b7fe640 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55853494aca0 0x558534972820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6103fff640 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534977a20 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f60f4025040 tx=0x7f60f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6395d766f68ba72b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f60ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:51:13.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f60ea7fc640 1 -- 172.21.15.172:0/4282694980 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4031020 con 0x558534975760 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f60ea7fc640 1 -- 172.21.15.172:0/4282694980 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f60f40167d0 con 0x558534975760 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6114e35740 1 -- 172.21.15.172:0/4282694980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60f4003a20 con 0x558534975760 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f60ea7fc640 1 -- 172.21.15.172:0/4282694980 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60f403b050 con 0x558534975760 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6114e35740 10 client.9516 fetch_fsmap learned FSMap version 74 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6114e35740 1 -- 172.21.15.172:0/4282694980 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5585346ecf60 con 0x558534975760 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f60ea7fc640 1 -- 172.21.15.172:0/4282694980 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f4003a20 con 0x558534975760 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f60ea7fc640 1 -- 172.21.15.172:0/4282694980 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 74) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f60f403e020 con 0x558534975760 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6114e35740 10 client.9516 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.784+0000 7f6114e35740 10 client.9516 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f6114e35740 20 client.9516 populate_metadata read hostname 'smithi172' 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f6114e35740 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x55853498b140 0x5585349a0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f6114e35740 4 client.9516 mds_command: new command op to 9294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f6114e35740 1 -- 172.21.15.172:0/4282694980 --> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585348bb0d0 con 0x55853498b140 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f610b7fe640 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x55853498b140 0x5585349a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f610b7fe640 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x55853498b140 0x5585349a0340 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32481ac8ee8d4ffa server_cookie=45ef16970fad1afb in_seq=0 out_seq=0 2024-04-25T08:51:13.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f60ea7fc640 10 client.9516 ms_handle_connect on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f60ea7fc640 1 -- 172.21.15.172:0/4282694980 <== mds.0 v2:172.21.15.172:6836/3347790695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5585348bb0d0 con 0x55853498b140 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f60ea7fc640 10 client.9516 handle_command_reply: tid=0 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f6114e35740 1 client.9516 shutdown 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f6114e35740 1 -- 172.21.15.172:0/4282694980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 msgr2=0x558534977a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.785+0000 7f6114e35740 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534977a20 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f60f4025040 tx=0x7f60f40046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.786+0000 7f6114e35740 1 -- 172.21.15.172:0/4282694980 shutdown_connections 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.786+0000 7f6114e35740 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x55853498b140 0x5585349a0340 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.786+0000 7f6114e35740 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 0x55853498da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.786+0000 7f6114e35740 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534977a20 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.786+0000 7f60ea7fc640 0 client.9516 ms_handle_reset on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.786+0000 7f6114e35740 1 --2- 172.21.15.172:0/4282694980 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55853494aca0 0x558534972820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.786+0000 7f6114e35740 1 -- 172.21.15.172:0/4282694980 >> 172.21.15.172:0/4282694980 conn(0x558534912870 msgr2=0x558534973490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.786+0000 7f6114e35740 1 -- 172.21.15.172:0/4282694980 shutdown_connections 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.786+0000 7f6114e35740 1 -- 172.21.15.172:0/4282694980 wait complete. 2024-04-25T08:51:13.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.786+0000 7f6114e35740 20 client.9516 trim_cache size 0 max 16384 2024-04-25T08:51:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.800+0000 7f6114e35740 1 Processor -- start 2024-04-25T08:51:13.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.801+0000 7f6114e35740 1 -- start start 2024-04-25T08:51:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.801+0000 7f6114e35740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55853494aca0 0x558534978a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.801+0000 7f6114e35740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534975d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.801+0000 7f6114e35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534987370 0x5585349a3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.801+0000 7f6114e35740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c200630 con 0x558534975760 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.801+0000 7f6114e35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c1ff820 con 0x558534987370 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.801+0000 7f6114e35740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c1f46c0 con 0x55853494aca0 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6103fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534975d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6103fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534975d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50882/0 (socket says 172.21.15.172:50882) 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6103fff640 1 -- 172.21.15.172:0/340778861 learned_addr learned my addr 172.21.15.172:0/340778861 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f610bfff640 1 --2- 172.21.15.172:0/340778861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534987370 0x5585349a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f610b7fe640 1 --2- 172.21.15.172:0/340778861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55853494aca0 0x558534978a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6103fff640 1 -- 172.21.15.172:0/340778861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55853494aca0 msgr2=0x558534978a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6103fff640 1 --2- 172.21.15.172:0/340778861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55853494aca0 0x558534978a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6103fff640 1 -- 172.21.15.172:0/340778861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534987370 msgr2=0x5585349a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6103fff640 1 --2- 172.21.15.172:0/340778861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534987370 0x5585349a3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6103fff640 1 -- 172.21.15.172:0/340778861 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55853455b1b0 con 0x558534975760 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6103fff640 1 --2- 172.21.15.172:0/340778861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534975d30 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006eb0 tx=0x7f60f402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c73dc36235471d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6100ff9640 1 -- 172.21.15.172:0/340778861 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4031070 con 0x558534975760 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6100ff9640 1 -- 172.21.15.172:0/340778861 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f4003a20 con 0x558534975760 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.802+0000 7f6100ff9640 1 -- 172.21.15.172:0/340778861 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4027040 con 0x558534975760 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 -- 172.21.15.172:0/340778861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 msgr2=0x558534975d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 --2- 172.21.15.172:0/340778861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534975d30 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006eb0 tx=0x7f60f402d000 comp rx=0 tx=0).stop 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 -- 172.21.15.172:0/340778861 shutdown_connections 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 --2- 172.21.15.172:0/340778861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534987370 0x5585349a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 --2- 172.21.15.172:0/340778861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558534975760 0x558534975d30 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 --2- 172.21.15.172:0/340778861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55853494aca0 0x558534978a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 -- 172.21.15.172:0/340778861 >> 172.21.15.172:0/340778861 conn(0x558534912870 msgr2=0x558534940f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 -- 172.21.15.172:0/340778861 shutdown_connections 2024-04-25T08:51:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 -- 172.21.15.172:0/340778861 wait complete. 2024-04-25T08:51:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 -- start start 2024-04-25T08:51:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.803+0000 7f6114e35740 1 Processor -- start 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f6114e35740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55853494aca0 0x558534975d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f6114e35740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534975760 0x558534976270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f6114e35740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 0x5585349492d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f6114e35740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55853498c340 con 0x55853494aca0 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f6114e35740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c1f4cc0 con 0x558534975760 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f6114e35740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55853498bfc0 con 0x558534987370 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f6114e35740 10 client.0 _ll_register_callbacks cb 0x7f60f4025070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55853494aca0 0x558534975d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55853494aca0 0x558534975d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50896/0 (socket says 172.21.15.172:50896) 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f610b7fe640 1 -- 172.21.15.172:0/3188340915 learned_addr learned my addr 172.21.15.172:0/3188340915 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f6103fff640 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534975760 0x558534976270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f610bfff640 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 0x5585349492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f610b7fe640 1 -- 172.21.15.172:0/3188340915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 msgr2=0x5585349492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f610b7fe640 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 0x5585349492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f610b7fe640 1 -- 172.21.15.172:0/3188340915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534975760 msgr2=0x558534976270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f610b7fe640 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534975760 0x558534976270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.804+0000 7f610b7fe640 1 -- 172.21.15.172:0/3188340915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55853494a300 con 0x55853494aca0 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f610b7fe640 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55853494aca0 0x558534975d30 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f60fc057cf0 tx=0x7f60fc01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15019519e1fbf4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f60ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f60ea7fc640 1 -- 172.21.15.172:0/3188340915 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc060470 con 0x55853494aca0 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f60ea7fc640 1 -- 172.21.15.172:0/3188340915 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f60fc05e0b0 con 0x55853494aca0 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f6114e35740 1 -- 172.21.15.172:0/3188340915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60f4003a20 con 0x55853494aca0 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f60ea7fc640 1 -- 172.21.15.172:0/3188340915 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60fc0543d0 con 0x55853494aca0 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f6114e35740 10 client.9522 fetch_fsmap learned FSMap version 74 2024-04-25T08:51:13.801 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f6114e35740 1 -- 172.21.15.172:0/3188340915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55853494a710 con 0x55853494aca0 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f60ea7fc640 1 -- 172.21.15.172:0/3188340915 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f4003a20 con 0x55853494aca0 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f60ea7fc640 1 -- 172.21.15.172:0/3188340915 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 74) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f60fc007490 con 0x55853494aca0 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f6114e35740 10 client.9522 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f6114e35740 10 client.9522 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f6114e35740 20 client.9522 populate_metadata read hostname 'smithi172' 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f6114e35740 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5585349b2d80 0x558534949810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f6114e35740 4 client.9522 mds_command: new command op to 9294 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f6114e35740 1 -- 172.21.15.172:0/3188340915 --> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x55853498f250 con 0x5585349b2d80 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.805+0000 7f6103fff640 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5585349b2d80 0x558534949810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f60ea7fc640 10 client.9522 ms_handle_connect on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6103fff640 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5585349b2d80 0x558534949810 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2382cbdd3221ac9b server_cookie=c91c0676796be088 in_seq=0 out_seq=0 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f60ea7fc640 1 -- 172.21.15.172:0/3188340915 <== mds.0 v2:172.21.15.172:6836/3347790695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55853498f250 con 0x5585349b2d80 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f60ea7fc640 10 client.9522 handle_command_reply: tid=0 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 client.9522 shutdown 2024-04-25T08:51:13.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 -- 172.21.15.172:0/3188340915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55853494aca0 msgr2=0x558534975d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55853494aca0 0x558534975d30 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f60fc057cf0 tx=0x7f60fc01e040 comp rx=0 tx=0).stop 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 -- 172.21.15.172:0/3188340915 shutdown_connections 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x5585349b2d80 0x558534949810 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558534975760 0x558534976270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x558534987370 0x5585349492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f60ea7fc640 0 client.9522 ms_handle_reset on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 --2- 172.21.15.172:0/3188340915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55853494aca0 0x558534975d30 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 -- 172.21.15.172:0/3188340915 >> 172.21.15.172:0/3188340915 conn(0x558534912870 msgr2=0x55853494bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 -- 172.21.15.172:0/3188340915 shutdown_connections 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 1 -- 172.21.15.172:0/3188340915 wait complete. 2024-04-25T08:51:13.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f6114e35740 20 client.9522 trim_cache size 0 max 16384 2024-04-25T08:51:13.804 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:51:13.804 INFO:teuthology.orchestra.run.smithi172.stdout: "return_code": 0 2024-04-25T08:51:13.804 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f611205a640 1 -- 172.21.15.172:0/5474912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f60ec06b4d0 msgr2=0x7f60ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f611205a640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f60ec06b4d0 0x7f60ec06d990 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f610c0b5400 tx=0x7f60f4008040 comp rx=0 tx=0).stop 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f611205a640 1 -- 172.21.15.172:0/5474912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c0ced80 msgr2=0x7f610c14fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f611205a640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c0ced80 0x7f610c14fd70 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00c3c0 tx=0x7f60fc00c880 comp rx=0 tx=0).stop 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f611205a640 1 -- 172.21.15.172:0/5474912 shutdown_connections 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f611205a640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f60ec06b4d0 0x7f60ec06d990 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f611205a640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f610c15dc20 0x7f610c0b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f611205a640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f610c161710 0x7f610c0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.806+0000 7f611205a640 1 --2- 172.21.15.172:0/5474912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610c0ced80 0x7f610c14fd70 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.807+0000 7f611205a640 1 -- 172.21.15.172:0/5474912 >> 172.21.15.172:0/5474912 conn(0x7f610c0d0420 msgr2=0x7f610c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.807+0000 7f611205a640 1 -- 172.21.15.172:0/5474912 shutdown_connections 2024-04-25T08:51:13.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.807+0000 7f611205a640 1 -- 172.21.15.172:0/5474912 wait complete. 2024-04-25T08:51:13.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:13.808 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-04-25T08:51:13.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.917+0000 7f8e87212640 1 Processor -- start 2024-04-25T08:51:13.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.917+0000 7f8e87212640 1 -- start start 2024-04-25T08:51:13.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e87212640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e800ad570 0x7f8e8006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e87212640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e800b3930 con 0x7f8e8015dd80 2024-04-25T08:51:13.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e87212640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e800b3c10 con 0x7f8e8006abe0 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e87212640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8006e410 con 0x7f8e800ad570 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e7ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8e8015dd80 0x7f8e800b5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:38256/0 (socket says 172.21.15.172:38256) 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e7ffff640 1 -- 172.21.15.172:0/2505960654 learned_addr learned my addr 172.21.15.172:0/2505960654 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e857af640 1 --2- 172.21.15.172:0/2505960654 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e800ad570 0x7f8e8006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e7f7fe640 1 -- 172.21.15.172:0/2505960654 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238514897 0 0) 0x7f8e800b3930 con 0x7f8e8015dd80 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e7f7fe640 1 -- 172.21.15.172:0/2505960654 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e70003520 con 0x7f8e8015dd80 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e7f7fe640 1 -- 172.21.15.172:0/2505960654 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408635750 0 0) 0x7f8e800b3c10 con 0x7f8e8006abe0 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e7f7fe640 1 -- 172.21.15.172:0/2505960654 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e800b3930 con 0x7f8e8006abe0 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e857af640 1 -- 172.21.15.172:0/2505960654 >> v1:172.21.15.186:6789/0 conn(0x7f8e8006abe0 legacy=0x7f8e8006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e857af640 1 -- 172.21.15.172:0/2505960654 >> v1:172.21.15.172:6789/0 conn(0x7f8e8015dd80 legacy=0x7f8e800b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.918+0000 7f8e857af640 1 -- 172.21.15.172:0/2505960654 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8006e660 con 0x7f8e800ad570 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.919+0000 7f8e857af640 1 --2- 172.21.15.172:0/2505960654 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e800ad570 0x7f8e8006ee60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009dc0 tx=0x7f8e7802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4186a699d82dfeae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.919+0000 7f8e7f7fe640 1 -- 172.21.15.172:0/2505960654 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e78007740 con 0x7f8e800ad570 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.919+0000 7f8e7f7fe640 1 -- 172.21.15.172:0/2505960654 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e780078e0 con 0x7f8e800ad570 2024-04-25T08:51:13.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.919+0000 7f8e7f7fe640 1 -- 172.21.15.172:0/2505960654 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e78007cb0 con 0x7f8e800ad570 2024-04-25T08:51:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.920+0000 7f8e87212640 1 -- 172.21.15.172:0/2505960654 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e800ad570 msgr2=0x7f8e8006ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.920+0000 7f8e87212640 1 --2- 172.21.15.172:0/2505960654 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e800ad570 0x7f8e8006ee60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009dc0 tx=0x7f8e7802a6d0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.920+0000 7f8e87212640 1 -- 172.21.15.172:0/2505960654 shutdown_connections 2024-04-25T08:51:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.920+0000 7f8e87212640 1 --2- 172.21.15.172:0/2505960654 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e800ad570 0x7f8e8006ee60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.920+0000 7f8e87212640 1 -- 172.21.15.172:0/2505960654 >> 172.21.15.172:0/2505960654 conn(0x7f8e800b5af0 msgr2=0x7f8e800b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.920+0000 7f8e87212640 1 -- 172.21.15.172:0/2505960654 shutdown_connections 2024-04-25T08:51:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.920+0000 7f8e87212640 1 -- 172.21.15.172:0/2505960654 wait complete. 2024-04-25T08:51:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.921+0000 7f8e87212640 1 Processor -- start 2024-04-25T08:51:13.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.921+0000 7f8e87212640 1 -- start start 2024-04-25T08:51:13.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e87212640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e8006abe0 0x7f8e80158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e87212640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e800ad570 0x7f8e8009b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e87212640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e8015dd80 0x7f8e801f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e87212640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80070400 con 0x7f8e8006abe0 2024-04-25T08:51:13.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e87212640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80070280 con 0x7f8e800ad570 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e87212640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800b3590 con 0x7f8e8015dd80 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e84fae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e8006abe0 0x7f8e80158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e84fae640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e8006abe0 0x7f8e80158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50910/0 (socket says 172.21.15.172:50910) 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e84fae640 1 -- 172.21.15.172:0/229630897 learned_addr learned my addr 172.21.15.172:0/229630897 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e7ffff640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e800ad570 0x7f8e8009b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e857af640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e8015dd80 0x7f8e801f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e84fae640 1 -- 172.21.15.172:0/229630897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e8015dd80 msgr2=0x7f8e801f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e84fae640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e8015dd80 0x7f8e801f34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e84fae640 1 -- 172.21.15.172:0/229630897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e800ad570 msgr2=0x7f8e8009b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e84fae640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e800ad570 0x7f8e8009b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e84fae640 1 -- 172.21.15.172:0/229630897 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e801f3ff0 con 0x7f8e8006abe0 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.922+0000 7f8e84fae640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e8006abe0 0x7f8e80158970 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c530 tx=0x7f8e7400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.923+0000 7f8e7d7fa640 1 -- 172.21.15.172:0/229630897 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e740052d0 con 0x7f8e8006abe0 2024-04-25T08:51:13.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.923+0000 7f8e7d7fa640 1 -- 172.21.15.172:0/229630897 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e74005490 con 0x7f8e8006abe0 2024-04-25T08:51:13.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.923+0000 7f8e7d7fa640 1 -- 172.21.15.172:0/229630897 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74012870 con 0x7f8e8006abe0 2024-04-25T08:51:13.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.923+0000 7f8e87212640 1 -- 172.21.15.172:0/229630897 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e80157e90 con 0x7f8e8006abe0 2024-04-25T08:51:13.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.923+0000 7f8e87212640 1 -- 172.21.15.172:0/229630897 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8009a8a0 con 0x7f8e8006abe0 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.924+0000 7f8e7d7fa640 1 -- 172.21.15.172:0/229630897 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8e74012a10 con 0x7f8e8006abe0 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.925+0000 7f8e7d7fa640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8e6406b4d0 0x7f8e6406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.925+0000 7f8e7d7fa640 1 -- 172.21.15.172:0/229630897 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8e7408a070 con 0x7f8e8006abe0 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.925+0000 7f8e7ffff640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8e6406b4d0 0x7f8e6406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.925+0000 7f8e7ffff640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8e6406b4d0 0x7f8e6406d990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8e80160300 tx=0x7f8e6c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e89fee740 1 Processor -- start 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e89fee740 1 -- start start 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 0x562c531d8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531d5ef0 0x562c531d8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531a8770 0x562c531abf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e89fee740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c53111da0 con 0x562c531d5ef0 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e89fee740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c530bab80 con 0x562c531d5b10 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e89fee740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c5310de40 con 0x562c531a8770 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e7ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531d5ef0 0x562c531d8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e7ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531d5ef0 0x562c531d8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50912/0 (socket says 172.21.15.172:50912) 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e84fae640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 0x562c531d8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e7ffff640 1 -- 172.21.15.172:0/823456943 learned_addr learned my addr 172.21.15.172:0/823456943 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.926+0000 7f8e857af640 1 --2- 172.21.15.172:0/823456943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531a8770 0x562c531abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.927+0000 7f8e7ffff640 1 -- 172.21.15.172:0/823456943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531a8770 msgr2=0x562c531abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.927+0000 7f8e7ffff640 1 --2- 172.21.15.172:0/823456943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531a8770 0x562c531abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.927+0000 7f8e7ffff640 1 -- 172.21.15.172:0/823456943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 msgr2=0x562c531d8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.927+0000 7f8e7ffff640 1 --2- 172.21.15.172:0/823456943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 0x562c531d8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.927+0000 7f8e7ffff640 1 -- 172.21.15.172:0/823456943 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c530c4f10 con 0x562c531d5ef0 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.927+0000 7f8e84fae640 1 --2- 172.21.15.172:0/823456943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 0x562c531d8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.927+0000 7f8e7ffff640 1 --2- 172.21.15.172:0/823456943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531d5ef0 0x562c531d8860 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c001e10 tx=0x7f8e6c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2204fe5263961fe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.927+0000 7f8e6a7fc640 1 -- 172.21.15.172:0/823456943 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c007710 con 0x562c531d5ef0 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.927+0000 7f8e6a7fc640 1 -- 172.21.15.172:0/823456943 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00e7b0 con 0x562c531d5ef0 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.927+0000 7f8e6a7fc640 1 -- 172.21.15.172:0/823456943 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00eb60 con 0x562c531d5ef0 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 -- 172.21.15.172:0/823456943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531d5ef0 msgr2=0x562c531d8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 --2- 172.21.15.172:0/823456943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531d5ef0 0x562c531d8860 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c001e10 tx=0x7f8e6c011000 comp rx=0 tx=0).stop 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 -- 172.21.15.172:0/823456943 shutdown_connections 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 --2- 172.21.15.172:0/823456943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531a8770 0x562c531abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 --2- 172.21.15.172:0/823456943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531d5ef0 0x562c531d8860 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 --2- 172.21.15.172:0/823456943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 0x562c531d8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 -- 172.21.15.172:0/823456943 >> 172.21.15.172:0/823456943 conn(0x562c531aa9e0 msgr2=0x562c531f3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 -- 172.21.15.172:0/823456943 shutdown_connections 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 -- 172.21.15.172:0/823456943 wait complete. 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 -- start start 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.928+0000 7f8e89fee740 1 Processor -- start 2024-04-25T08:51:13.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 0x562c531cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5ef0 0x562c531e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e89fee740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c531adb90 con 0x562c531f0590 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e89fee740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c530b04b0 con 0x562c531d5ef0 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e89fee740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c531ade70 con 0x562c531d5b10 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e89fee740 10 client.0 _ll_register_callbacks cb 0x562c530f0180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e857af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e857af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50928/0 (socket says 172.21.15.172:50928) 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e857af640 1 -- 172.21.15.172:0/2615724137 learned_addr learned my addr 172.21.15.172:0/2615724137 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e7ffff640 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5ef0 0x562c531e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e84fae640 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 0x562c531cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e857af640 1 -- 172.21.15.172:0/2615724137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 msgr2=0x562c531cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e857af640 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 0x562c531cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e857af640 1 -- 172.21.15.172:0/2615724137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5ef0 msgr2=0x562c531e9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.929+0000 7f8e857af640 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5ef0 0x562c531e9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e857af640 1 -- 172.21.15.172:0/2615724137 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c52ef07d0 con 0x562c531f0590 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e857af640 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eba10 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f8e7802acc0 tx=0x7f8e78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2838919712db0734 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/2615724137 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e78009450 con 0x562c531f0590 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e89fee740 1 -- 172.21.15.172:0/2615724137 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e6c00e7b0 con 0x562c531f0590 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/2615724137 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8e7803d430 con 0x562c531f0590 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/2615724137 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e78050050 con 0x562c531f0590 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e89fee740 10 client.9534 fetch_fsmap learned FSMap version 74 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e89fee740 1 -- 172.21.15.172:0/2615724137 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x562c52e263f0 con 0x562c531f0590 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/2615724137 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00e7b0 con 0x562c531f0590 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/2615724137 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 74) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8e78053020 con 0x562c531f0590 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e89fee740 10 client.9534 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e89fee740 10 client.9534 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e89fee740 20 client.9534 populate_metadata read hostname 'smithi172' 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e89fee740 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562c531f2990 0x562c531ed950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e89fee740 4 client.9534 mds_command: new command op to 9294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e89fee740 1 -- 172.21.15.172:0/2615724137 --> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562c5311f2e0 con 0x562c531f2990 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.930+0000 7f8e84fae640 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562c531f2990 0x562c531ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e5f7fe640 10 client.9534 ms_handle_connect on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e84fae640 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562c531f2990 0x562c531ed950 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e6528c82d1ddb4b server_cookie=d75a932a9980b72c in_seq=0 out_seq=0 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/2615724137 <== mds.0 v2:172.21.15.172:6836/3347790695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562c5311f2e0 con 0x562c531f2990 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e5f7fe640 10 client.9534 handle_command_reply: tid=0 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 client.9534 shutdown 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 -- 172.21.15.172:0/2615724137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 msgr2=0x562c531eba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eba10 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f8e7802acc0 tx=0x7f8e78004ab0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 -- 172.21.15.172:0/2615724137 shutdown_connections 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562c531f2990 0x562c531ed950 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5ef0 0x562c531e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eba10 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e5f7fe640 0 client.9534 ms_handle_reset on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 --2- 172.21.15.172:0/2615724137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 0x562c531cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 -- 172.21.15.172:0/2615724137 >> 172.21.15.172:0/2615724137 conn(0x562c531a8770 msgr2=0x562c531a9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 -- 172.21.15.172:0/2615724137 shutdown_connections 2024-04-25T08:51:13.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.931+0000 7f8e89fee740 1 -- 172.21.15.172:0/2615724137 wait complete. 2024-04-25T08:51:13.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.932+0000 7f8e89fee740 20 client.9534 trim_cache size 0 max 16384 2024-04-25T08:51:13.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.946+0000 7f8e89fee740 1 Processor -- start 2024-04-25T08:51:13.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.946+0000 7f8e89fee740 1 -- start start 2024-04-25T08:51:13.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 0x562c531a9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5ef0 0x562c531eb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e89fee740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80200380 con 0x562c531f0590 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e89fee740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e801ff580 con 0x562c531d5b10 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e89fee740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e801f7680 con 0x562c531d5ef0 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e857af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e857af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531ebd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50944/0 (socket says 172.21.15.172:50944) 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e857af640 1 -- 172.21.15.172:0/1669836691 learned_addr learned my addr 172.21.15.172:0/1669836691 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e7ffff640 1 --2- 172.21.15.172:0/1669836691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5ef0 0x562c531eb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e84fae640 1 --2- 172.21.15.172:0/1669836691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 0x562c531a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e857af640 1 -- 172.21.15.172:0/1669836691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5ef0 msgr2=0x562c531eb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e857af640 1 --2- 172.21.15.172:0/1669836691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5ef0 0x562c531eb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e857af640 1 -- 172.21.15.172:0/1669836691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 msgr2=0x562c531a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e857af640 1 --2- 172.21.15.172:0/1669836691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 0x562c531a9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.947+0000 7f8e857af640 1 -- 172.21.15.172:0/1669836691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c531ea320 con 0x562c531f0590 2024-04-25T08:51:13.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e857af640 1 --2- 172.21.15.172:0/1669836691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531ebd10 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f8e7802ac90 tx=0x7f8e78042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8bb5f84a844468 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e69ffb640 1 -- 172.21.15.172:0/1669836691 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e78007e90 con 0x562c531f0590 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e69ffb640 1 -- 172.21.15.172:0/1669836691 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7803d430 con 0x562c531f0590 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e69ffb640 1 -- 172.21.15.172:0/1669836691 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7802ad50 con 0x562c531f0590 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e89fee740 1 -- 172.21.15.172:0/1669836691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 msgr2=0x562c531ebd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e89fee740 1 --2- 172.21.15.172:0/1669836691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531ebd10 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f8e7802ac90 tx=0x7f8e78042000 comp rx=0 tx=0).stop 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e89fee740 1 -- 172.21.15.172:0/1669836691 shutdown_connections 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e89fee740 1 --2- 172.21.15.172:0/1669836691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531ebd10 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e89fee740 1 --2- 172.21.15.172:0/1669836691 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5ef0 0x562c531eb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e89fee740 1 --2- 172.21.15.172:0/1669836691 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5b10 0x562c531a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e89fee740 1 -- 172.21.15.172:0/1669836691 >> 172.21.15.172:0/1669836691 conn(0x562c531a8770 msgr2=0x562c531a3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e89fee740 1 -- 172.21.15.172:0/1669836691 shutdown_connections 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.948+0000 7f8e89fee740 1 -- 172.21.15.172:0/1669836691 wait complete. 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.949+0000 7f8e89fee740 1 -- start start 2024-04-25T08:51:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.949+0000 7f8e89fee740 1 Processor -- start 2024-04-25T08:51:13.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 0x562c531ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5ef0 0x562c531dbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e89fee740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e89fee740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c530b2010 con 0x562c531f0590 2024-04-25T08:51:13.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e89fee740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e801fef80 con 0x562c531d5ef0 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e89fee740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x562c531a4620 con 0x562c531d5b10 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e89fee740 10 client.0 _ll_register_callbacks cb 0x7f8e6c001370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e857af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e857af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50946/0 (socket says 172.21.15.172:50946) 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e857af640 1 -- 172.21.15.172:0/821436564 learned_addr learned my addr 172.21.15.172:0/821436564 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e84fae640 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 0x562c531ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e7ffff640 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5ef0 0x562c531dbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e857af640 1 -- 172.21.15.172:0/821436564 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 msgr2=0x562c531ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e857af640 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 0x562c531ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e857af640 1 -- 172.21.15.172:0/821436564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5ef0 msgr2=0x562c531dbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e857af640 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5ef0 0x562c531dbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e857af640 1 -- 172.21.15.172:0/821436564 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c52de60f0 con 0x562c531f0590 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e84fae640 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 0x562c531ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:13.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e857af640 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eb700 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f8e78048040 tx=0x7f8e78009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76c2c47bff01c17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/821436564 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7802ad50 con 0x562c531f0590 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.950+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/821436564 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8e78002030 con 0x562c531f0590 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e89fee740 1 -- 172.21.15.172:0/821436564 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e7803d430 con 0x562c531f0590 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/821436564 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e78067050 con 0x562c531f0590 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e89fee740 10 client.9540 fetch_fsmap learned FSMap version 74 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e89fee740 1 -- 172.21.15.172:0/821436564 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x562c531f38a0 con 0x562c531f0590 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/821436564 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7803d430 con 0x562c531f0590 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/821436564 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 74) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8e78053040 con 0x562c531f0590 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e89fee740 10 client.9540 fetch_fsmap finished waiting for FSMap version 74 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e89fee740 10 client.9540 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e89fee740 20 client.9540 populate_metadata read hostname 'smithi172' 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e89fee740 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562c531ebc90 0x562c531abf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e89fee740 4 client.9540 mds_command: new command op to 9294 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e89fee740 1 -- 172.21.15.172:0/821436564 --> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562c53119630 con 0x562c531ebc90 2024-04-25T08:51:13.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e84fae640 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562c531ebc90 0x562c531abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e5f7fe640 10 client.9540 ms_handle_connect on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.951+0000 7f8e84fae640 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562c531ebc90 0x562c531abf80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=812c0eb26243a57e server_cookie=905821f0d2da8245 in_seq=0 out_seq=0 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e5f7fe640 1 -- 172.21.15.172:0/821436564 <== mds.0 v2:172.21.15.172:6836/3347790695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x562c53119630 con 0x562c531ebc90 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e5f7fe640 10 client.9540 handle_command_reply: tid=0 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 client.9540 shutdown 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 -- 172.21.15.172:0/821436564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 msgr2=0x562c531eb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eb700 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f8e78048040 tx=0x7f8e78009750 comp rx=0 tx=0).stop 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 -- 172.21.15.172:0/821436564 shutdown_connections 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.172:6836/3347790695,v1:172.21.15.172:6837/3347790695] conn(0x562c531ebc90 0x562c531abf80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562c531d5ef0 0x562c531dbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c531f0590 0x562c531eb700 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e5f7fe640 0 client.9540 ms_handle_reset on v2:172.21.15.172:6836/3347790695 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 --2- 172.21.15.172:0/821436564 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x562c531d5b10 0x562c531ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 -- 172.21.15.172:0/821436564 >> 172.21.15.172:0/821436564 conn(0x562c531a8770 msgr2=0x562c531a9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 -- 172.21.15.172:0/821436564 shutdown_connections 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 1 -- 172.21.15.172:0/821436564 wait complete. 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e89fee740 20 client.9540 trim_cache size 0 max 16384 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stdout: "scrubs": { 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stdout: "6d39b950-dbe7-4c1e-9e2a-f505297c143b": { 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stdout: "path": "/scrub_control_test_path", 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stdout: "tag": "6d39b950-dbe7-4c1e-9e2a-f505297c143b", 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stdout: "options": "recursive" 2024-04-25T08:51:13.949 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:13.950 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:13.950 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:51:13.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e87212640 1 -- 172.21.15.172:0/229630897 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8e6406b4d0 msgr2=0x7f8e6406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e87212640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8e6406b4d0 0x7f8e6406d990 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8e80160300 tx=0x7f8e6c009040 comp rx=0 tx=0).stop 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e87212640 1 -- 172.21.15.172:0/229630897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e8006abe0 msgr2=0x7f8e80158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e87212640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e8006abe0 0x7f8e80158970 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c530 tx=0x7f8e7400c9f0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e87212640 1 -- 172.21.15.172:0/229630897 shutdown_connections 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e87212640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f8e6406b4d0 0x7f8e6406d990 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e87212640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e800ad570 0x7f8e8009b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e87212640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e8015dd80 0x7f8e801f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e87212640 1 --2- 172.21.15.172:0/229630897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e8006abe0 0x7f8e80158970 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.952+0000 7f8e87212640 1 -- 172.21.15.172:0/229630897 >> 172.21.15.172:0/229630897 conn(0x7f8e800b5af0 msgr2=0x7f8e800ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.953+0000 7f8e87212640 1 -- 172.21.15.172:0/229630897 shutdown_connections 2024-04-25T08:51:13.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:13.953+0000 7f8e87212640 1 -- 172.21.15.172:0/229630897 wait complete. 2024-04-25T08:51:13.953 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:14.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.060+0000 7f0716a4a640 1 Processor -- start 2024-04-25T08:51:14.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.060+0000 7f0716a4a640 1 -- start start 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.061+0000 7f0716a4a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f071015c9e0 0x7f0710071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.061+0000 7f0716a4a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0710072000 0x7f071006abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.061+0000 7f0716a4a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0710072400 con 0x7f0710155fe0 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.061+0000 7f0716a4a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071015ce70 con 0x7f071015c9e0 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.061+0000 7f0716a4a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071006de40 con 0x7f0710072000 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.061+0000 7f070f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f071015c9e0 0x7f0710071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.061+0000 7f070f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f071015c9e0 0x7f0710071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50950/0 (socket says 172.21.15.172:50950) 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.061+0000 7f070f7fe640 1 -- 172.21.15.172:0/1480601706 learned_addr learned my addr 172.21.15.172:0/1480601706 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.061+0000 7f0714fe7640 1 --2- 172.21.15.172:0/1480601706 >> v2:172.21.15.186:3300/0 conn(0x7f0710072000 0x7f071006abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.062+0000 7f070f7fe640 1 -- 172.21.15.172:0/1480601706 >> v2:172.21.15.186:3300/0 conn(0x7f0710072000 msgr2=0x7f071006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.062+0000 7f070f7fe640 1 --2- 172.21.15.172:0/1480601706 >> v2:172.21.15.186:3300/0 conn(0x7f0710072000 0x7f071006abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.062+0000 7f070f7fe640 1 -- 172.21.15.172:0/1480601706 >> v1:172.21.15.186:6789/0 conn(0x7f0710155fe0 legacy=0x7f07100adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.062+0000 7f070f7fe640 1 -- 172.21.15.172:0/1480601706 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100ad0e0 con 0x7f071015c9e0 2024-04-25T08:51:14.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.062+0000 7f070f7fe640 1 --2- 172.21.15.172:0/1480601706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071015c9e0 0x7f0710071ac0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f0710061950 tx=0x7f070402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3de44f13b9c3b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:14.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.062+0000 7f070effd640 1 -- 172.21.15.172:0/1480601706 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704037070 con 0x7f071015c9e0 2024-04-25T08:51:14.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.062+0000 7f070effd640 1 -- 172.21.15.172:0/1480601706 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704032440 con 0x7f071015c9e0 2024-04-25T08:51:14.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.062+0000 7f070effd640 1 -- 172.21.15.172:0/1480601706 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704032810 con 0x7f071015c9e0 2024-04-25T08:51:14.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.063+0000 7f0716a4a640 1 -- 172.21.15.172:0/1480601706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071015c9e0 msgr2=0x7f0710071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.063+0000 7f0716a4a640 1 --2- 172.21.15.172:0/1480601706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071015c9e0 0x7f0710071ac0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f0710061950 tx=0x7f070402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.063+0000 7f0716a4a640 1 -- 172.21.15.172:0/1480601706 shutdown_connections 2024-04-25T08:51:14.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.063+0000 7f0716a4a640 1 --2- 172.21.15.172:0/1480601706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071015c9e0 0x7f0710071ac0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.063+0000 7f0716a4a640 1 --2- 172.21.15.172:0/1480601706 >> v2:172.21.15.186:3300/0 conn(0x7f0710072000 0x7f071006abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.063+0000 7f0716a4a640 1 -- 172.21.15.172:0/1480601706 >> 172.21.15.172:0/1480601706 conn(0x7f07100af670 msgr2=0x7f07100b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:14.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.063+0000 7f0716a4a640 1 -- 172.21.15.172:0/1480601706 shutdown_connections 2024-04-25T08:51:14.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.063+0000 7f0716a4a640 1 -- 172.21.15.172:0/1480601706 wait complete. 2024-04-25T08:51:14.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.064+0000 7f0716a4a640 1 Processor -- start 2024-04-25T08:51:14.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.064+0000 7f0716a4a640 1 -- start start 2024-04-25T08:51:14.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f0716a4a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0710155fe0 0x7f07101f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f0716a4a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f071015c9e0 0x7f071009bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f0716a4a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071009a8e0 0x7f0710154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f0716a4a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07101563c0 con 0x7f071009a8e0 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f0716a4a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07100ad6a0 con 0x7f071015c9e0 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f0716a4a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071006f880 con 0x7f0710155fe0 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f0714fe7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071009a8e0 0x7f0710154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f0714fe7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071009a8e0 0x7f0710154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50966/0 (socket says 172.21.15.172:50966) 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f0714fe7640 1 -- 172.21.15.172:0/749558858 learned_addr learned my addr 172.21.15.172:0/749558858 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f070f7fe640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f071015c9e0 0x7f071009bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.065+0000 7f070ffff640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0710155fe0 0x7f07101f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f0714fe7640 1 -- 172.21.15.172:0/749558858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0710155fe0 msgr2=0x7f07101f1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f0714fe7640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0710155fe0 0x7f07101f1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f0714fe7640 1 -- 172.21.15.172:0/749558858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f071015c9e0 msgr2=0x7f071009bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f0714fe7640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f071015c9e0 0x7f071009bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f0714fe7640 1 -- 172.21.15.172:0/749558858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071009ade0 con 0x7f071009a8e0 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f070f7fe640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f071015c9e0 0x7f071009bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f0714fe7640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071009a8e0 0x7f0710154270 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f0708007cf0 tx=0x7f070800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f070cff9640 1 -- 172.21.15.172:0/749558858 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708014420 con 0x7f071009a8e0 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f070cff9640 1 -- 172.21.15.172:0/749558858 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0708019070 con 0x7f071009a8e0 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f070cff9640 1 -- 172.21.15.172:0/749558858 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708014820 con 0x7f071009a8e0 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f0716a4a640 1 -- 172.21.15.172:0/749558858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071009b0c0 con 0x7f071009a8e0 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.066+0000 7f0716a4a640 1 -- 172.21.15.172:0/749558858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0710143370 con 0x7f071009a8e0 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.067+0000 7f0716a4a640 1 -- 172.21.15.172:0/749558858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0710143190 con 0x7f071009a8e0 2024-04-25T08:51:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.067+0000 7f070cff9640 1 -- 172.21.15.172:0/749558858 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f07080149c0 con 0x7f071009a8e0 2024-04-25T08:51:14.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.068+0000 7f070cff9640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06fc06b4d0 0x7f06fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.068+0000 7f070cff9640 1 -- 172.21.15.172:0/749558858 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f070808abe0 con 0x7f071009a8e0 2024-04-25T08:51:14.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.068+0000 7f070ffff640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06fc06b4d0 0x7f06fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.068+0000 7f070ffff640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06fc06b4d0 0x7f06fc06d990 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f070000a750 tx=0x7f0700008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:14.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.072+0000 7f070cff9640 1 -- 172.21.15.172:0/749558858 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0710143190 con 0x7f071009a8e0 2024-04-25T08:51:14.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.283+0000 7f0716a4a640 1 -- 172.21.15.172:0/749558858 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0710073990 con 0x7f071009a8e0 2024-04-25T08:51:14.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.283+0000 7f070cff9640 1 -- 172.21.15.172:0/749558858 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f07080598d0 con 0x7f071009a8e0 2024-04-25T08:51:14.274 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:14.274 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:14.274 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:51:14.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 -- 172.21.15.172:0/749558858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06fc06b4d0 msgr2=0x7f06fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06fc06b4d0 0x7f06fc06d990 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f070000a750 tx=0x7f0700008040 comp rx=0 tx=0).stop 2024-04-25T08:51:14.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 -- 172.21.15.172:0/749558858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071009a8e0 msgr2=0x7f0710154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071009a8e0 0x7f0710154270 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f0708007cf0 tx=0x7f070800e4b0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 -- 172.21.15.172:0/749558858 shutdown_connections 2024-04-25T08:51:14.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06fc06b4d0 0x7f06fc06d990 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f071015c9e0 0x7f071009bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f071009a8e0 0x7f0710154270 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 --2- 172.21.15.172:0/749558858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0710155fe0 0x7f07101f1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 -- 172.21.15.172:0/749558858 >> 172.21.15.172:0/749558858 conn(0x7f0710072000 msgr2=0x7f07100afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:14.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 -- 172.21.15.172:0/749558858 shutdown_connections 2024-04-25T08:51:14.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.285+0000 7f0716a4a640 1 -- 172.21.15.172:0/749558858 wait complete. 2024-04-25T08:51:14.287 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:51:14.287 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:51:14.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.393+0000 7fae676f5640 1 Processor -- start 2024-04-25T08:51:14.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.394+0000 7fae676f5640 1 -- start start 2024-04-25T08:51:14.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.394+0000 7fae676f5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae600b2cb0 0x7fae600d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.394+0000 7fae676f5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fae600d1020 0x7fae600d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.394+0000 7fae676f5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae600b97a0 con 0x7fae6015dbe0 2024-04-25T08:51:14.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.394+0000 7fae676f5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6015dfc0 con 0x7fae600b2cb0 2024-04-25T08:51:14.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.394+0000 7fae676f5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae600d1a00 con 0x7fae600d1020 2024-04-25T08:51:14.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.394+0000 7fae64c90640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae600b2cb0 0x7fae600d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.395+0000 7fae64c90640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae600b2cb0 0x7fae600d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50974/0 (socket says 172.21.15.172:50974) 2024-04-25T08:51:14.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.395+0000 7fae64c90640 1 -- 172.21.15.172:0/895699586 learned_addr learned my addr 172.21.15.172:0/895699586 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:14.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.395+0000 7fae65c92640 1 --2- 172.21.15.172:0/895699586 >> v2:172.21.15.186:3300/0 conn(0x7fae600d1020 0x7fae600d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.395+0000 7fae64c90640 1 -- 172.21.15.172:0/895699586 >> v2:172.21.15.186:3300/0 conn(0x7fae600d1020 msgr2=0x7fae600d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:14.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.395+0000 7fae64c90640 1 --2- 172.21.15.172:0/895699586 >> v2:172.21.15.186:3300/0 conn(0x7fae600d1020 0x7fae600d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.395+0000 7fae64c90640 1 -- 172.21.15.172:0/895699586 >> v1:172.21.15.186:6789/0 conn(0x7fae6015dbe0 legacy=0x7fae600d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.395+0000 7fae64c90640 1 -- 172.21.15.172:0/895699586 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae600d1c50 con 0x7fae600b2cb0 2024-04-25T08:51:14.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.395+0000 7fae64c90640 1 --2- 172.21.15.172:0/895699586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae600b2cb0 0x7fae600d2730 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fae600cf570 tx=0x7fae5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda19b4b2331a818 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:14.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae57fff640 1 -- 172.21.15.172:0/895699586 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50037070 con 0x7fae600b2cb0 2024-04-25T08:51:14.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae57fff640 1 -- 172.21.15.172:0/895699586 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae50032440 con 0x7fae600b2cb0 2024-04-25T08:51:14.389 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae57fff640 1 -- 172.21.15.172:0/895699586 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50032810 con 0x7fae600b2cb0 2024-04-25T08:51:14.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae676f5640 1 -- 172.21.15.172:0/895699586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae600b2cb0 msgr2=0x7fae600d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae676f5640 1 --2- 172.21.15.172:0/895699586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae600b2cb0 0x7fae600d2730 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fae600cf570 tx=0x7fae5002a270 comp rx=0 tx=0).stop 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae676f5640 1 -- 172.21.15.172:0/895699586 shutdown_connections 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae676f5640 1 --2- 172.21.15.172:0/895699586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae600b2cb0 0x7fae600d2730 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae676f5640 1 --2- 172.21.15.172:0/895699586 >> v2:172.21.15.186:3300/0 conn(0x7fae600d1020 0x7fae600d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae676f5640 1 -- 172.21.15.172:0/895699586 >> 172.21.15.172:0/895699586 conn(0x7fae60061a20 msgr2=0x7fae60061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae676f5640 1 -- 172.21.15.172:0/895699586 shutdown_connections 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.396+0000 7fae676f5640 1 -- 172.21.15.172:0/895699586 wait complete. 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.397+0000 7fae676f5640 1 Processor -- start 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.397+0000 7fae676f5640 1 -- start start 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae676f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae600b2cb0 0x7fae600b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae676f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae600d1020 0x7fae600c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae676f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae6015dbe0 0x7fae600caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae676f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600b92a0 con 0x7fae6015dbe0 2024-04-25T08:51:14.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae676f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600d2210 con 0x7fae600d1020 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae676f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae600b9420 con 0x7fae600b2cb0 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae65c92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae6015dbe0 0x7fae600caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae65c92640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae6015dbe0 0x7fae600caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50982/0 (socket says 172.21.15.172:50982) 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae65c92640 1 -- 172.21.15.172:0/5737876 learned_addr learned my addr 172.21.15.172:0/5737876 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae64c90640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae600d1020 0x7fae600c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.398+0000 7fae65491640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae600b2cb0 0x7fae600b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae65c92640 1 -- 172.21.15.172:0/5737876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae600b2cb0 msgr2=0x7fae600b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae65c92640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae600b2cb0 0x7fae600b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae65c92640 1 -- 172.21.15.172:0/5737876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae600d1020 msgr2=0x7fae600c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae65c92640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae600d1020 0x7fae600c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae65c92640 1 -- 172.21.15.172:0/5737876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae600b4a20 con 0x7fae6015dbe0 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae65491640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae600b2cb0 0x7fae600b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:14.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae65c92640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae6015dbe0 0x7fae600caa50 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fae5800d830 tx=0x7fae5800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae55ffb640 1 -- 172.21.15.172:0/5737876 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800b6c0 con 0x7fae6015dbe0 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae55ffb640 1 -- 172.21.15.172:0/5737876 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae58019070 con 0x7fae6015dbe0 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae676f5640 1 -- 172.21.15.172:0/5737876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae600b35a0 con 0x7fae6015dbe0 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae55ffb640 1 -- 172.21.15.172:0/5737876 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800bac0 con 0x7fae6015dbe0 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.399+0000 7fae676f5640 1 -- 172.21.15.172:0/5737876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae600b3b60 con 0x7fae6015dbe0 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.400+0000 7fae676f5640 1 -- 172.21.15.172:0/5737876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae60073990 con 0x7fae6015dbe0 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.400+0000 7fae55ffb640 1 -- 172.21.15.172:0/5737876 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fae5801e460 con 0x7fae6015dbe0 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.401+0000 7fae55ffb640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae4406b4d0 0x7fae4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.401+0000 7fae55ffb640 1 -- 172.21.15.172:0/5737876 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fae5808a8e0 con 0x7fae6015dbe0 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.401+0000 7fae65491640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae4406b4d0 0x7fae4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:14.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.401+0000 7fae65491640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae4406b4d0 0x7fae4406d990 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fae5c001d60 tx=0x7fae5c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:14.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.405+0000 7fae55ffb640 1 -- 172.21.15.172:0/5737876 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae58059660 con 0x7fae6015dbe0 2024-04-25T08:51:14.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.642+0000 7fae676f5640 1 -- 172.21.15.172:0/5737876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fae600d4320 con 0x7fae6015dbe0 2024-04-25T08:51:14.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.642+0000 7fae55ffb640 1 -- 172.21.15.172:0/5737876 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1444 (secure 0 0 0) 0x7fae58058f60 con 0x7fae6015dbe0 2024-04-25T08:51:14.633 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:14.633 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":550,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":784,"data_bytes":798483764,"bytes_used":1892794368,"bytes_avail":771201318912,"bytes_total":773094113280,"write_bytes_sec":66484112,"read_op_per_sec":0,"write_op_per_sec":64},"fsmap":{"epoch":74,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9294}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-04-25T08:50:42.613771+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:51:14.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.644+0000 7fae676f5640 1 -- 172.21.15.172:0/5737876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae4406b4d0 msgr2=0x7fae4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae4406b4d0 0x7fae4406d990 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fae5c001d60 tx=0x7fae5c009040 comp rx=0 tx=0).stop 2024-04-25T08:51:14.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 -- 172.21.15.172:0/5737876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae6015dbe0 msgr2=0x7fae600caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:14.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae6015dbe0 0x7fae600caa50 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fae5800d830 tx=0x7fae5800dcf0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 -- 172.21.15.172:0/5737876 shutdown_connections 2024-04-25T08:51:14.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fae4406b4d0 0x7fae4406d990 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae600d1020 0x7fae600c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae6015dbe0 0x7fae600caa50 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 --2- 172.21.15.172:0/5737876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae600b2cb0 0x7fae600b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:14.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 -- 172.21.15.172:0/5737876 >> 172.21.15.172:0/5737876 conn(0x7fae60061a20 msgr2=0x7fae60158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:14.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 -- 172.21.15.172:0/5737876 shutdown_connections 2024-04-25T08:51:14.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:14.645+0000 7fae676f5640 1 -- 172.21.15.172:0/5737876 wait complete. 2024-04-25T08:51:14.646 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T08:51:15.647 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:15.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.755+0000 7f30464e1640 1 Processor -- start 2024-04-25T08:51:15.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.756+0000 7f30464e1640 1 -- start start 2024-04-25T08:51:15.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.756+0000 7f30464e1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f30400af720 0x7f30400afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:15.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.756+0000 7f30464e1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f30400d02f0 0x7f30400d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:15.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.756+0000 7f30464e1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304006fe00 con 0x7f3040158220 2024-04-25T08:51:15.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.756+0000 7f30464e1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30400b3670 con 0x7f30400af720 2024-04-25T08:51:15.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.756+0000 7f30464e1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3040070a10 con 0x7f30400d02f0 2024-04-25T08:51:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.756+0000 7f303f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f30400af720 0x7f30400afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.757+0000 7f303f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f30400af720 0x7f30400afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50984/0 (socket says 172.21.15.172:50984) 2024-04-25T08:51:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.757+0000 7f303f7fe640 1 -- 172.21.15.172:0/2208114608 learned_addr learned my addr 172.21.15.172:0/2208114608 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.757+0000 7f3044a7e640 1 --2- 172.21.15.172:0/2208114608 >> v2:172.21.15.186:3300/0 conn(0x7f30400d02f0 0x7f30400d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.757+0000 7f303f7fe640 1 -- 172.21.15.172:0/2208114608 >> v2:172.21.15.186:3300/0 conn(0x7f30400d02f0 msgr2=0x7f30400d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.757+0000 7f303f7fe640 1 --2- 172.21.15.172:0/2208114608 >> v2:172.21.15.186:3300/0 conn(0x7f30400d02f0 0x7f30400d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.757+0000 7f303f7fe640 1 -- 172.21.15.172:0/2208114608 >> v1:172.21.15.172:6789/0 conn(0x7f3040158220 legacy=0x7f304015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:15.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.757+0000 7f303f7fe640 1 -- 172.21.15.172:0/2208114608 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400700e0 con 0x7f30400af720 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.757+0000 7f303f7fe640 1 --2- 172.21.15.172:0/2208114608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 0x7f30400afba0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f30400726d0 tx=0x7f303402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd00df26947e45a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f303effd640 1 -- 172.21.15.172:0/2208114608 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034037070 con 0x7f30400af720 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f303effd640 1 -- 172.21.15.172:0/2208114608 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3034032440 con 0x7f30400af720 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f303effd640 1 -- 172.21.15.172:0/2208114608 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034032810 con 0x7f30400af720 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f30464e1640 1 -- 172.21.15.172:0/2208114608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 msgr2=0x7f30400afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f30464e1640 1 --2- 172.21.15.172:0/2208114608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 0x7f30400afba0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f30400726d0 tx=0x7f303402a270 comp rx=0 tx=0).stop 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f30464e1640 1 -- 172.21.15.172:0/2208114608 shutdown_connections 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f30464e1640 1 --2- 172.21.15.172:0/2208114608 >> v2:172.21.15.186:3300/0 conn(0x7f30400d02f0 0x7f30400d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f30464e1640 1 --2- 172.21.15.172:0/2208114608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 0x7f30400afba0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f30464e1640 1 -- 172.21.15.172:0/2208114608 >> 172.21.15.172:0/2208114608 conn(0x7f30400b2370 msgr2=0x7f30400b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f30464e1640 1 -- 172.21.15.172:0/2208114608 shutdown_connections 2024-04-25T08:51:15.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.758+0000 7f30464e1640 1 -- 172.21.15.172:0/2208114608 wait complete. 2024-04-25T08:51:15.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.759+0000 7f30464e1640 1 Processor -- start 2024-04-25T08:51:15.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.760+0000 7f30464e1640 1 -- start start 2024-04-25T08:51:15.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.760+0000 7f30464e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 0x7f30401597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:15.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.760+0000 7f30464e1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30400d02f0 0x7f30401f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:15.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.760+0000 7f30464e1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3040158220 0x7f30401f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:15.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.760+0000 7f30464e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3040158600 con 0x7f30400af720 2024-04-25T08:51:15.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.760+0000 7f30464e1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30400706a0 con 0x7f30400d02f0 2024-04-25T08:51:15.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.760+0000 7f30464e1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3040072960 con 0x7f3040158220 2024-04-25T08:51:15.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.760+0000 7f303ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 0x7f30401597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:15.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.760+0000 7f303ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 0x7f30401597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50992/0 (socket says 172.21.15.172:50992) 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.760+0000 7f303ffff640 1 -- 172.21.15.172:0/1046511008 learned_addr learned my addr 172.21.15.172:0/1046511008 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303f7fe640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30400d02f0 0x7f30401f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f3044a7e640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3040158220 0x7f30401f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303ffff640 1 -- 172.21.15.172:0/1046511008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3040158220 msgr2=0x7f30401f7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303ffff640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3040158220 0x7f30401f7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303ffff640 1 -- 172.21.15.172:0/1046511008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30400d02f0 msgr2=0x7f30401f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303ffff640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30400d02f0 0x7f30401f7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303ffff640 1 -- 172.21.15.172:0/1046511008 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304015a1b0 con 0x7f30400af720 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303f7fe640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30400d02f0 0x7f30401f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303ffff640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 0x7f30401597d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f303000c400 tx=0x7f303000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303cff9640 1 -- 172.21.15.172:0/1046511008 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30300052d0 con 0x7f30400af720 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303cff9640 1 -- 172.21.15.172:0/1046511008 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3030005490 con 0x7f30400af720 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f303cff9640 1 -- 172.21.15.172:0/1046511008 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030007260 con 0x7f30400af720 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f30464e1640 1 -- 172.21.15.172:0/1046511008 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304015a490 con 0x7f30400af720 2024-04-25T08:51:15.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.761+0000 7f30464e1640 1 -- 172.21.15.172:0/1046511008 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304015aa50 con 0x7f30400af720 2024-04-25T08:51:15.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.762+0000 7f30464e1640 1 -- 172.21.15.172:0/1046511008 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3040073990 con 0x7f30400af720 2024-04-25T08:51:15.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.762+0000 7f303cff9640 1 -- 172.21.15.172:0/1046511008 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3030007400 con 0x7f30400af720 2024-04-25T08:51:15.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.763+0000 7f303cff9640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f302c06b4d0 0x7f302c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:15.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.763+0000 7f303cff9640 1 -- 172.21.15.172:0/1046511008 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f30300898a0 con 0x7f30400af720 2024-04-25T08:51:15.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.763+0000 7f303f7fe640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f302c06b4d0 0x7f302c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:15.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.763+0000 7f303f7fe640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f302c06b4d0 0x7f302c06d990 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3034034000 tx=0x7f303402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:15.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.767+0000 7f303cff9640 1 -- 172.21.15.172:0/1046511008 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3030058590 con 0x7f30400af720 2024-04-25T08:51:15.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.972+0000 7f30464e1640 1 -- 172.21.15.172:0/1046511008 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30400ccd70 con 0x7f30400af720 2024-04-25T08:51:15.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.972+0000 7f303cff9640 1 -- 172.21.15.172:0/1046511008 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f3030057e90 con 0x7f30400af720 2024-04-25T08:51:15.963 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:15.963 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:15.964 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:51:15.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.974+0000 7f30464e1640 1 -- 172.21.15.172:0/1046511008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f302c06b4d0 msgr2=0x7f302c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:15.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.974+0000 7f30464e1640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f302c06b4d0 0x7f302c06d990 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3034034000 tx=0x7f303402e000 comp rx=0 tx=0).stop 2024-04-25T08:51:15.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.974+0000 7f30464e1640 1 -- 172.21.15.172:0/1046511008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 msgr2=0x7f30401597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:15.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.974+0000 7f30464e1640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 0x7f30401597d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f303000c400 tx=0x7f303000c8c0 comp rx=0 tx=0).stop 2024-04-25T08:51:15.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.974+0000 7f30464e1640 1 -- 172.21.15.172:0/1046511008 shutdown_connections 2024-04-25T08:51:15.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.974+0000 7f30464e1640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f302c06b4d0 0x7f302c06d990 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:15.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.974+0000 7f30464e1640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30400d02f0 0x7f30401f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:15.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.974+0000 7f30464e1640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3040158220 0x7f30401f7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:15.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.974+0000 7f30464e1640 1 --2- 172.21.15.172:0/1046511008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30400af720 0x7f30401597d0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:15.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.974+0000 7f30464e1640 1 -- 172.21.15.172:0/1046511008 >> 172.21.15.172:0/1046511008 conn(0x7f30400b2370 msgr2=0x7f304015d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:15.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.975+0000 7f30464e1640 1 -- 172.21.15.172:0/1046511008 shutdown_connections 2024-04-25T08:51:15.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:15.975+0000 7f30464e1640 1 -- 172.21.15.172:0/1046511008 wait complete. 2024-04-25T08:51:15.976 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:51:15.976 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:51:16.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.083+0000 7f796f3e0640 1 Processor -- start 2024-04-25T08:51:16.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.084+0000 7f796f3e0640 1 -- start start 2024-04-25T08:51:16.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.084+0000 7f796f3e0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f796815f020 0x7f79680cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:16.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.084+0000 7f796f3e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79680b0b90 0x7f79680b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:16.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.084+0000 7f796f3e0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7968099a40 0x7f7968099ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:16.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.084+0000 7f796f3e0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680cccb0 con 0x7f7968099a40 2024-04-25T08:51:16.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.084+0000 7f796f3e0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680b1620 con 0x7f796815f020 2024-04-25T08:51:16.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.084+0000 7f796f3e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680cc3c0 con 0x7f79680b0b90 2024-04-25T08:51:16.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.084+0000 7f796d97d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7968099a40 0x7f7968099ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:16.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.085+0000 7f796d97d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7968099a40 0x7f7968099ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50994/0 (socket says 172.21.15.172:50994) 2024-04-25T08:51:16.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.085+0000 7f796d97d640 1 -- 172.21.15.172:0/756289706 learned_addr learned my addr 172.21.15.172:0/756289706 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.085+0000 7f796d17c640 1 --2- 172.21.15.172:0/756289706 >> v2:172.21.15.186:3300/0 conn(0x7f796815f020 0x7f79680cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.085+0000 7f796c97b640 1 --2- 172.21.15.172:0/756289706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79680b0b90 0x7f79680b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.085+0000 7f796d97d640 1 -- 172.21.15.172:0/756289706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79680b0b90 msgr2=0x7f79680b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.085+0000 7f796d97d640 1 --2- 172.21.15.172:0/756289706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79680b0b90 0x7f79680b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.085+0000 7f796d97d640 1 -- 172.21.15.172:0/756289706 >> v2:172.21.15.186:3300/0 conn(0x7f796815f020 msgr2=0x7f79680cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.085+0000 7f796d97d640 1 --2- 172.21.15.172:0/756289706 >> v2:172.21.15.186:3300/0 conn(0x7f796815f020 0x7f79680cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.085+0000 7f796d97d640 1 -- 172.21.15.172:0/756289706 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796815f400 con 0x7f7968099a40 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.085+0000 7f796d97d640 1 --2- 172.21.15.172:0/756289706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7968099a40 0x7f7968099ed0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f79680727c0 tx=0x7f796002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65679fbad6b24bab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f795ffff640 1 -- 172.21.15.172:0/756289706 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960036070 con 0x7f7968099a40 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f795ffff640 1 -- 172.21.15.172:0/756289706 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7960031600 con 0x7f7968099a40 2024-04-25T08:51:16.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f795ffff640 1 -- 172.21.15.172:0/756289706 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79600319d0 con 0x7f7968099a40 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f796f3e0640 1 -- 172.21.15.172:0/756289706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7968099a40 msgr2=0x7f7968099ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f796f3e0640 1 --2- 172.21.15.172:0/756289706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7968099a40 0x7f7968099ed0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f79680727c0 tx=0x7f796002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f796f3e0640 1 -- 172.21.15.172:0/756289706 shutdown_connections 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f796f3e0640 1 --2- 172.21.15.172:0/756289706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7968099a40 0x7f7968099ed0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f796f3e0640 1 --2- 172.21.15.172:0/756289706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79680b0b90 0x7f79680b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f796f3e0640 1 --2- 172.21.15.172:0/756289706 >> v2:172.21.15.186:3300/0 conn(0x7f796815f020 0x7f79680cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f796f3e0640 1 -- 172.21.15.172:0/756289706 >> 172.21.15.172:0/756289706 conn(0x7f79680b3310 msgr2=0x7f79680b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f796f3e0640 1 -- 172.21.15.172:0/756289706 shutdown_connections 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.086+0000 7f796f3e0640 1 -- 172.21.15.172:0/756289706 wait complete. 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.087+0000 7f796f3e0640 1 Processor -- start 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.087+0000 7f796f3e0640 1 -- start start 2024-04-25T08:51:16.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796f3e0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7968099a40 0x7f7968152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796f3e0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79680b0b90 0x7f79680c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796f3e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796815f020 0x7f79680c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796f3e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680cc660 con 0x7f796815f020 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796f3e0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680d0830 con 0x7f79680b0b90 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796f3e0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680cc940 con 0x7f7968099a40 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796d97d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796815f020 0x7f79680c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796d97d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796815f020 0x7f79680c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51010/0 (socket says 172.21.15.172:51010) 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796d97d640 1 -- 172.21.15.172:0/470968153 learned_addr learned my addr 172.21.15.172:0/470968153 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796d17c640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7968099a40 0x7f7968152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.088+0000 7f796c97b640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79680b0b90 0x7f79680c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f796d97d640 1 -- 172.21.15.172:0/470968153 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7968099a40 msgr2=0x7f7968152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f796d97d640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7968099a40 0x7f7968152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f796d97d640 1 -- 172.21.15.172:0/470968153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79680b0b90 msgr2=0x7f79680c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f796d97d640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79680b0b90 0x7f79680c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f796d97d640 1 -- 172.21.15.172:0/470968153 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680c5ec0 con 0x7f796815f020 2024-04-25T08:51:16.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f796d97d640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796815f020 0x7f79680c5890 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f7960034040 tx=0x7f7960004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:16.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f795dffb640 1 -- 172.21.15.172:0/470968153 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960041020 con 0x7f796815f020 2024-04-25T08:51:16.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f795dffb640 1 -- 172.21.15.172:0/470968153 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79600077a0 con 0x7f796815f020 2024-04-25T08:51:16.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f795dffb640 1 -- 172.21.15.172:0/470968153 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960036040 con 0x7f796815f020 2024-04-25T08:51:16.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f796f3e0640 1 -- 172.21.15.172:0/470968153 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79680c61a0 con 0x7f796815f020 2024-04-25T08:51:16.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.089+0000 7f796f3e0640 1 -- 172.21.15.172:0/470968153 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79680c6760 con 0x7f796815f020 2024-04-25T08:51:16.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.090+0000 7f796f3e0640 1 -- 172.21.15.172:0/470968153 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7968073990 con 0x7f796815f020 2024-04-25T08:51:16.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.091+0000 7f795dffb640 1 -- 172.21.15.172:0/470968153 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7960044020 con 0x7f796815f020 2024-04-25T08:51:16.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.091+0000 7f795dffb640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794c06b500 0x7f794c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:16.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.091+0000 7f795dffb640 1 -- 172.21.15.172:0/470968153 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f79600aadb0 con 0x7f796815f020 2024-04-25T08:51:16.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.091+0000 7f796d17c640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794c06b500 0x7f794c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:16.083 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.092+0000 7f796d17c640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794c06b500 0x7f794c06d9c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7964009aa0 tx=0x7f7964009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:16.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.095+0000 7f795dffb640 1 -- 172.21.15.172:0/470968153 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f796004b030 con 0x7f796815f020 2024-04-25T08:51:16.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.335+0000 7f796f3e0640 1 -- 172.21.15.172:0/470968153 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f79680b77a0 con 0x7f796815f020 2024-04-25T08:51:16.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.335+0000 7f795dffb640 1 -- 172.21.15.172:0/470968153 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1444 (secure 0 0 0) 0x7f7960079450 con 0x7f796815f020 2024-04-25T08:51:16.326 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:16.326 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":551,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":784,"data_bytes":798483764,"bytes_used":1892794368,"bytes_avail":771201318912,"bytes_total":773094113280,"write_bytes_sec":66482997,"read_op_per_sec":0,"write_op_per_sec":64},"fsmap":{"epoch":74,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9294}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-04-25T08:50:42.613771+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:51:16.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.337+0000 7f796f3e0640 1 -- 172.21.15.172:0/470968153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794c06b500 msgr2=0x7f794c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:16.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.337+0000 7f796f3e0640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794c06b500 0x7f794c06d9c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7964009aa0 tx=0x7f7964009190 comp rx=0 tx=0).stop 2024-04-25T08:51:16.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.337+0000 7f796f3e0640 1 -- 172.21.15.172:0/470968153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796815f020 msgr2=0x7f79680c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:16.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.337+0000 7f796f3e0640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796815f020 0x7f79680c5890 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f7960034040 tx=0x7f7960004a40 comp rx=0 tx=0).stop 2024-04-25T08:51:16.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.337+0000 7f796f3e0640 1 -- 172.21.15.172:0/470968153 shutdown_connections 2024-04-25T08:51:16.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.337+0000 7f796f3e0640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f794c06b500 0x7f794c06d9c0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.337+0000 7f796f3e0640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79680b0b90 0x7f79680c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.337+0000 7f796f3e0640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f796815f020 0x7f79680c5890 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.337+0000 7f796f3e0640 1 --2- 172.21.15.172:0/470968153 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7968099a40 0x7f7968152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:16.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.337+0000 7f796f3e0640 1 -- 172.21.15.172:0/470968153 >> 172.21.15.172:0/470968153 conn(0x7f79680b3310 msgr2=0x7f796806f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:16.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.338+0000 7f796f3e0640 1 -- 172.21.15.172:0/470968153 shutdown_connections 2024-04-25T08:51:16.329 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:16.338+0000 7f796f3e0640 1 -- 172.21.15.172:0/470968153 wait complete. 2024-04-25T08:51:16.339 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T08:51:17.340 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:17.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.459+0000 7fc62ea6f640 1 Processor -- start 2024-04-25T08:51:17.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.459+0000 7fc62ea6f640 1 -- start start 2024-04-25T08:51:17.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.459+0000 7fc62ea6f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62815ba00 0x7fc62809a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.459+0000 7fc62ea6f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc62815f5f0 0x7fc62815faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.459+0000 7fc62ea6f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6280cd710 con 0x7fc6281602e0 2024-04-25T08:51:17.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.459+0000 7fc62ea6f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6280cd4b0 con 0x7fc62815f5f0 2024-04-25T08:51:17.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.459+0000 7fc62ea6f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc628099b70 con 0x7fc62815ba00 2024-04-25T08:51:17.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc627fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc6281602e0 0x7fc6280ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:32898/0 (socket says 172.21.15.172:32898) 2024-04-25T08:51:17.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc627fff640 1 -- 172.21.15.172:0/3721263493 learned_addr learned my addr 172.21.15.172:0/3721263493 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:17.453 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc62c80b640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62815ba00 0x7fc62809a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc62d00c640 1 --2- 172.21.15.172:0/3721263493 >> v2:172.21.15.186:3300/0 conn(0x7fc62815f5f0 0x7fc62815faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050292133 0 0) 0x7fc61c001110 con 0x7fc6281602e0 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc610003520 con 0x7fc6281602e0 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1128787304 0 0) 0x7fc610003520 con 0x7fc6281602e0 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62815ba00 msgr2=0x7fc62809a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62815ba00 0x7fc62809a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 >> v2:172.21.15.186:3300/0 conn(0x7fc62815f5f0 msgr2=0x7fc62815faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 --2- 172.21.15.172:0/3721263493 >> v2:172.21.15.186:3300/0 conn(0x7fc62815f5f0 0x7fc62815faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628099e50 con 0x7fc6281602e0 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fc61c001840 con 0x7fc6281602e0 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc62d00c640 1 --2- 172.21.15.172:0/3721263493 >> v2:172.21.15.186:3300/0 conn(0x7fc62815f5f0 0x7fc62815faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc62c80b640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62815ba00 0x7fc62809a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 >> v1:172.21.15.172:6789/0 conn(0x7fc6281602e0 legacy=0x7fc6280ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:17.454 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6100039b0 0x7fc610003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62815ba00 0x7fc610004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 0x7fc6100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6280cd4b0 con 0x7fc610004d40 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc628099b70 con 0x7fc6100039b0 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61000ba10 con 0x7fc62815ba00 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc62d00c640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 0x7fc6100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc62c80b640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6100039b0 0x7fc610003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.460+0000 7fc627fff640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62815ba00 0x7fc610004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.461+0000 7fc62d00c640 1 -- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62815ba00 msgr2=0x7fc610004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.461+0000 7fc62d00c640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62815ba00 0x7fc610004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.461+0000 7fc62d00c640 1 -- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6100039b0 msgr2=0x7fc610003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.461+0000 7fc62d00c640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6100039b0 0x7fc610003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.455 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.461+0000 7fc62d00c640 1 -- 172.21.15.172:0/3721263493 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610003520 con 0x7fc610004d40 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.461+0000 7fc62c80b640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6100039b0 0x7fc610003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.461+0000 7fc62d00c640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 0x7fc6100051c0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fc62000e380 tx=0x7fc610005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601fa96dfcdbacfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.461+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620009de0 con 0x7fc610004d40 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.462+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62002c620 con 0x7fc610004d40 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.462+0000 7fc6277fe640 1 -- 172.21.15.172:0/3721263493 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62002c9d0 con 0x7fc610004d40 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.462+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3721263493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 msgr2=0x7fc6100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.462+0000 7fc62ea6f640 1 --2- 172.21.15.172:0/3721263493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 0x7fc6100051c0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fc62000e380 tx=0x7fc610005830 comp rx=0 tx=0).stop 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.462+0000 7fc62d00c640 1 -- 172.21.15.172:0/3721263493 reap_dead start 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.462+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3721263493 shutdown_connections 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.462+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3721263493 >> 172.21.15.172:0/3721263493 conn(0x7fc6280b3270 msgr2=0x7fc6280b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.462+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3721263493 shutdown_connections 2024-04-25T08:51:17.456 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.462+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3721263493 wait complete. 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.463+0000 7fc62ea6f640 1 Processor -- start 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.463+0000 7fc62ea6f640 1 -- start start 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.464+0000 7fc62ea6f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 0x7fc62806fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.464+0000 7fc62ea6f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62814b470 0x7fc6280c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.464+0000 7fc62ea6f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6280c75d0 0x7fc6281f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.464+0000 7fc62ea6f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62815bde0 con 0x7fc610004d40 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.464+0000 7fc62ea6f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62809a930 con 0x7fc6280c75d0 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.464+0000 7fc62ea6f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62814a9b0 con 0x7fc62814b470 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.464+0000 7fc62c80b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 0x7fc62806fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.464+0000 7fc62c80b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 0x7fc62806fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56350/0 (socket says 172.21.15.172:56350) 2024-04-25T08:51:17.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.464+0000 7fc62c80b640 1 -- 172.21.15.172:0/3245265734 learned_addr learned my addr 172.21.15.172:0/3245265734 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.464+0000 7fc627fff640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62814b470 0x7fc6280c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc62d00c640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6280c75d0 0x7fc6281f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc62c80b640 1 -- 172.21.15.172:0/3245265734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62814b470 msgr2=0x7fc6280c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc62c80b640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62814b470 0x7fc6280c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc62c80b640 1 -- 172.21.15.172:0/3245265734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6280c75d0 msgr2=0x7fc6281f1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc62c80b640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6280c75d0 0x7fc6281f1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc62c80b640 1 -- 172.21.15.172:0/3245265734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6281f2230 con 0x7fc610004d40 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc62c80b640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 0x7fc62806fdf0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fc618011d00 tx=0x7fc61800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc6257fa640 1 -- 172.21.15.172:0/3245265734 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61800fd20 con 0x7fc610004d40 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc6257fa640 1 -- 172.21.15.172:0/3245265734 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc618004030 con 0x7fc610004d40 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3245265734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62814ac70 con 0x7fc610004d40 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc6257fa640 1 -- 172.21.15.172:0/3245265734 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6180043e0 con 0x7fc610004d40 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.465+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3245265734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6280c7a10 con 0x7fc610004d40 2024-04-25T08:51:17.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.466+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3245265734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc628073990 con 0x7fc610004d40 2024-04-25T08:51:17.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.467+0000 7fc6257fa640 1 -- 172.21.15.172:0/3245265734 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc618012040 con 0x7fc610004d40 2024-04-25T08:51:17.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.467+0000 7fc6257fa640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61406b500 0x7fc61406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.467+0000 7fc6257fa640 1 -- 172.21.15.172:0/3245265734 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc61808a740 con 0x7fc610004d40 2024-04-25T08:51:17.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.467+0000 7fc627fff640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61406b500 0x7fc61406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.468+0000 7fc627fff640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61406b500 0x7fc61406d9c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc62814b8d0 tx=0x7fc61c007ac0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:17.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.471+0000 7fc6257fa640 1 -- 172.21.15.172:0/3245265734 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc618019070 con 0x7fc610004d40 2024-04-25T08:51:17.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.681+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3245265734 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6280b40a0 con 0x7fc610004d40 2024-04-25T08:51:17.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.682+0000 7fc6257fa640 1 -- 172.21.15.172:0/3245265734 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fc618058de0 con 0x7fc610004d40 2024-04-25T08:51:17.673 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:17.673 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:17.673 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:51:17.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3245265734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61406b500 msgr2=0x7fc61406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61406b500 0x7fc61406d9c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc62814b8d0 tx=0x7fc61c007ac0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3245265734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 msgr2=0x7fc62806fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 0x7fc62806fdf0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fc618011d00 tx=0x7fc61800f610 comp rx=0 tx=0).stop 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3245265734 shutdown_connections 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc61406b500 0x7fc61406d9c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6280c75d0 0x7fc6281f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc62814b470 0x7fc6280c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 --2- 172.21.15.172:0/3245265734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc610004d40 0x7fc62806fdf0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3245265734 >> 172.21.15.172:0/3245265734 conn(0x7fc6280b3270 msgr2=0x7fc62815e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3245265734 shutdown_connections 2024-04-25T08:51:17.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.684+0000 7fc62ea6f640 1 -- 172.21.15.172:0/3245265734 wait complete. 2024-04-25T08:51:17.685 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:51:17.685 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:51:17.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.791+0000 7f0063b10640 1 Processor -- start 2024-04-25T08:51:17.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.791+0000 7f0063b10640 1 -- start start 2024-04-25T08:51:17.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f0063b10640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f005c154ee0 0x7f005c0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f0063b10640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f005c0cfcf0 0x7f005c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f0063b10640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005c071480 con 0x7f005c0ce3c0 2024-04-25T08:51:17.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f0063b10640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005c0ce830 con 0x7f005c0cfcf0 2024-04-25T08:51:17.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f0063b10640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c072090 con 0x7f005c154ee0 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f00610ab640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f005c0cfcf0 0x7f005c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f00610ab640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f005c0cfcf0 0x7f005c0cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56366/0 (socket says 172.21.15.172:56366) 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f00610ab640 1 -- 172.21.15.172:0/1275237473 learned_addr learned my addr 172.21.15.172:0/1275237473 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f00618ac640 1 --2- 172.21.15.172:0/1275237473 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f005c154ee0 0x7f005c0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f00610ab640 1 -- 172.21.15.172:0/1275237473 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f005c154ee0 msgr2=0x7f005c0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f00610ab640 1 --2- 172.21.15.172:0/1275237473 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f005c154ee0 0x7f005c0cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f00610ab640 1 -- 172.21.15.172:0/1275237473 >> v1:172.21.15.186:6789/0 conn(0x7f005c0ce3c0 legacy=0x7f005c15e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.792+0000 7f00610ab640 1 -- 172.21.15.172:0/1275237473 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c071760 con 0x7f005c0cfcf0 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.793+0000 7f00610ab640 1 --2- 172.21.15.172:0/1275237473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0cfcf0 0x7f005c0cde80 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f004c009870 tx=0x7f004c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2240605357e6f76c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.793+0000 7f00608aa640 1 -- 172.21.15.172:0/1275237473 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c037070 con 0x7f005c0cfcf0 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.793+0000 7f00608aa640 1 -- 172.21.15.172:0/1275237473 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c032440 con 0x7f005c0cfcf0 2024-04-25T08:51:17.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.793+0000 7f00608aa640 1 -- 172.21.15.172:0/1275237473 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c032810 con 0x7f005c0cfcf0 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.793+0000 7f0063b10640 1 -- 172.21.15.172:0/1275237473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0cfcf0 msgr2=0x7f005c0cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.793+0000 7f0063b10640 1 --2- 172.21.15.172:0/1275237473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0cfcf0 0x7f005c0cde80 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f004c009870 tx=0x7f004c02a210 comp rx=0 tx=0).stop 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.793+0000 7f0063b10640 1 -- 172.21.15.172:0/1275237473 shutdown_connections 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.793+0000 7f0063b10640 1 --2- 172.21.15.172:0/1275237473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0cfcf0 0x7f005c0cde80 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.793+0000 7f0063b10640 1 --2- 172.21.15.172:0/1275237473 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f005c154ee0 0x7f005c0cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.793+0000 7f0063b10640 1 -- 172.21.15.172:0/1275237473 >> 172.21.15.172:0/1275237473 conn(0x7f005c06abe0 msgr2=0x7f005c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.794+0000 7f0063b10640 1 -- 172.21.15.172:0/1275237473 shutdown_connections 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.794+0000 7f0063b10640 1 -- 172.21.15.172:0/1275237473 wait complete. 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f0063b10640 1 Processor -- start 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f0063b10640 1 -- start start 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f0063b10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0ce3c0 0x7f005c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f0063b10640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f005c0cfcf0 0x7f005c151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f0063b10640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f005c154ee0 0x7f005c158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f0063b10640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c071230 con 0x7f005c0ce3c0 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f0063b10640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c071d20 con 0x7f005c154ee0 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f0063b10640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c1552c0 con 0x7f005c0cfcf0 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f00618ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0ce3c0 0x7f005c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f00618ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0ce3c0 0x7f005c1567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56374/0 (socket says 172.21.15.172:56374) 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.795+0000 7f00618ac640 1 -- 172.21.15.172:0/2373595996 learned_addr learned my addr 172.21.15.172:0/2373595996 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00610ab640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f005c0cfcf0 0x7f005c151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00620ad640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f005c154ee0 0x7f005c158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00618ac640 1 -- 172.21.15.172:0/2373595996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f005c0cfcf0 msgr2=0x7f005c151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00618ac640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f005c0cfcf0 0x7f005c151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00618ac640 1 -- 172.21.15.172:0/2373595996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f005c154ee0 msgr2=0x7f005c158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00618ac640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f005c154ee0 0x7f005c158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:17.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00618ac640 1 -- 172.21.15.172:0/2373595996 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c154040 con 0x7f005c0ce3c0 2024-04-25T08:51:17.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00618ac640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0ce3c0 0x7f005c1567a0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f005800c7f0 tx=0x7f005800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:17.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00527fc640 1 -- 172.21.15.172:0/2373595996 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058015070 con 0x7f005c0ce3c0 2024-04-25T08:51:17.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00527fc640 1 -- 172.21.15.172:0/2373595996 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0058004220 con 0x7f005c0ce3c0 2024-04-25T08:51:17.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f00527fc640 1 -- 172.21.15.172:0/2373595996 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0058007620 con 0x7f005c0ce3c0 2024-04-25T08:51:17.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f0063b10640 1 -- 172.21.15.172:0/2373595996 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c156ce0 con 0x7f005c0ce3c0 2024-04-25T08:51:17.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.796+0000 7f0063b10640 1 -- 172.21.15.172:0/2373595996 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c158200 con 0x7f005c0ce3c0 2024-04-25T08:51:17.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.797+0000 7f0063b10640 1 -- 172.21.15.172:0/2373595996 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c073990 con 0x7f005c0ce3c0 2024-04-25T08:51:17.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.798+0000 7f00527fc640 1 -- 172.21.15.172:0/2373595996 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f00580079d0 con 0x7f005c0ce3c0 2024-04-25T08:51:17.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.798+0000 7f00527fc640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f004006b500 0x7f004006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:17.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.798+0000 7f00527fc640 1 -- 172.21.15.172:0/2373595996 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f005808a2b0 con 0x7f005c0ce3c0 2024-04-25T08:51:17.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.798+0000 7f00610ab640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f004006b500 0x7f004006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:17.791 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.798+0000 7f00610ab640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f004006b500 0x7f004006d9c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f004c034000 tx=0x7f004c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:17.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:17.802+0000 7f00527fc640 1 -- 172.21.15.172:0/2373595996 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0058058950 con 0x7f005c0ce3c0 2024-04-25T08:51:18.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.039+0000 7f0063b10640 1 -- 172.21.15.172:0/2373595996 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f005c156f10 con 0x7f005c0ce3c0 2024-04-25T08:51:18.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.040+0000 7f00527fc640 1 -- 172.21.15.172:0/2373595996 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1446 (secure 0 0 0) 0x7f005808a0d0 con 0x7f005c0ce3c0 2024-04-25T08:51:18.030 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:18.030 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":553,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076493182,"bytes_used":2569404416,"bytes_avail":770524708864,"bytes_total":773094113280,"write_bytes_sec":89651567,"read_op_per_sec":0,"write_op_per_sec":87},"fsmap":{"epoch":74,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9294}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-04-25T08:50:42.613771+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:51:18.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.041+0000 7f0063b10640 1 -- 172.21.15.172:0/2373595996 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f004006b500 msgr2=0x7f004006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:18.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.041+0000 7f0063b10640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f004006b500 0x7f004006d9c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f004c034000 tx=0x7f004c02e000 comp rx=0 tx=0).stop 2024-04-25T08:51:18.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.041+0000 7f0063b10640 1 -- 172.21.15.172:0/2373595996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0ce3c0 msgr2=0x7f005c1567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:18.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.041+0000 7f0063b10640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0ce3c0 0x7f005c1567a0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f005800c7f0 tx=0x7f005800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:51:18.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.042+0000 7f0063b10640 1 -- 172.21.15.172:0/2373595996 shutdown_connections 2024-04-25T08:51:18.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.042+0000 7f0063b10640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f004006b500 0x7f004006d9c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:18.032 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.042+0000 7f0063b10640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f005c154ee0 0x7f005c158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:18.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.042+0000 7f0063b10640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f005c0cfcf0 0x7f005c151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:18.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.042+0000 7f0063b10640 1 --2- 172.21.15.172:0/2373595996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f005c0ce3c0 0x7f005c1567a0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:18.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.042+0000 7f0063b10640 1 -- 172.21.15.172:0/2373595996 >> 172.21.15.172:0/2373595996 conn(0x7f005c06abe0 msgr2=0x7f005c0b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:18.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.042+0000 7f0063b10640 1 -- 172.21.15.172:0/2373595996 shutdown_connections 2024-04-25T08:51:18.033 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:18.042+0000 7f0063b10640 1 -- 172.21.15.172:0/2373595996 wait complete. 2024-04-25T08:51:18.043 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T08:51:19.044 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:19.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.163+0000 7fe7b1cbd640 1 Processor -- start 2024-04-25T08:51:19.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.163+0000 7fe7b1cbd640 1 -- start start 2024-04-25T08:51:19.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.164+0000 7fe7b1cbd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7ac0d2e90 0x7fe7ac0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.164+0000 7fe7b1cbd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7ac0d0900 0x7fe7ac0b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.164+0000 7fe7b1cbd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac0b9940 con 0x7fe7ac15dd30 2024-04-25T08:51:19.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.164+0000 7fe7b1cbd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac0d0d40 con 0x7fe7ac0d2e90 2024-04-25T08:51:19.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.164+0000 7fe7b1cbd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0d1df0 con 0x7fe7ac0d0900 2024-04-25T08:51:19.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.164+0000 7fe7aaffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7ac0d2e90 0x7fe7ac0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.164+0000 7fe7aaffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7ac0d2e90 0x7fe7ac0d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56378/0 (socket says 172.21.15.172:56378) 2024-04-25T08:51:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.164+0000 7fe7aaffd640 1 -- 172.21.15.172:0/1181265492 learned_addr learned my addr 172.21.15.172:0/1181265492 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.165+0000 7fe7abfff640 1 --2- 172.21.15.172:0/1181265492 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7ac0d0900 0x7fe7ac0b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.165+0000 7fe7aaffd640 1 -- 172.21.15.172:0/1181265492 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7ac0d0900 msgr2=0x7fe7ac0b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.165+0000 7fe7aaffd640 1 --2- 172.21.15.172:0/1181265492 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7ac0d0900 0x7fe7ac0b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.165+0000 7fe7aaffd640 1 -- 172.21.15.172:0/1181265492 >> v1:172.21.15.186:6789/0 conn(0x7fe7ac15dd30 legacy=0x7fe7ac0b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.165+0000 7fe7aaffd640 1 -- 172.21.15.172:0/1181265492 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac0d20d0 con 0x7fe7ac0d2e90 2024-04-25T08:51:19.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.165+0000 7fe7aaffd640 1 --2- 172.21.15.172:0/1181265492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac0d2e90 0x7fe7ac0d03c0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009850 tx=0x7fe7a002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d992bfc1fc8f23be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:19.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7aa7fc640 1 -- 172.21.15.172:0/1181265492 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0004030 con 0x7fe7ac0d2e90 2024-04-25T08:51:19.157 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7aa7fc640 1 -- 172.21.15.172:0/1181265492 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a00041d0 con 0x7fe7ac0d2e90 2024-04-25T08:51:19.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7aa7fc640 1 -- 172.21.15.172:0/1181265492 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0003610 con 0x7fe7ac0d2e90 2024-04-25T08:51:19.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/1181265492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac0d2e90 msgr2=0x7fe7ac0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7b1cbd640 1 --2- 172.21.15.172:0/1181265492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac0d2e90 0x7fe7ac0d03c0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009850 tx=0x7fe7a002a1a0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/1181265492 shutdown_connections 2024-04-25T08:51:19.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7b1cbd640 1 --2- 172.21.15.172:0/1181265492 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7ac0d0900 0x7fe7ac0b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7b1cbd640 1 --2- 172.21.15.172:0/1181265492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac0d2e90 0x7fe7ac0d03c0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/1181265492 >> 172.21.15.172:0/1181265492 conn(0x7fe7ac061c30 msgr2=0x7fe7ac06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:19.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/1181265492 shutdown_connections 2024-04-25T08:51:19.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.166+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/1181265492 wait complete. 2024-04-25T08:51:19.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.167+0000 7fe7b1cbd640 1 Processor -- start 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7b1cbd640 1 -- start start 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7b1cbd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7ac0d0900 0x7fe7ac0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7b1cbd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7ac0d2e90 0x7fe7ac1f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7b1cbd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac15dd30 0x7fe7ac1f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7b1cbd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0d2970 con 0x7fe7ac15dd30 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7b1cbd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0d2690 con 0x7fe7ac0d2e90 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7b1cbd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0d1a10 con 0x7fe7ac0d0900 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7abfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac15dd30 0x7fe7ac1f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7abfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac15dd30 0x7fe7ac1f7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56386/0 (socket says 172.21.15.172:56386) 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7abfff640 1 -- 172.21.15.172:0/2939638628 learned_addr learned my addr 172.21.15.172:0/2939638628 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:19.161 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.168+0000 7fe7ab7fe640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7ac0d0900 0x7fe7ac0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe7aaffd640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7ac0d2e90 0x7fe7ac1f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe7abfff640 1 -- 172.21.15.172:0/2939638628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7ac0d0900 msgr2=0x7fe7ac0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe7abfff640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7ac0d0900 0x7fe7ac0caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe7abfff640 1 -- 172.21.15.172:0/2939638628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7ac0d2e90 msgr2=0x7fe7ac1f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe7abfff640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7ac0d2e90 0x7fe7ac1f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe7abfff640 1 -- 172.21.15.172:0/2939638628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac0b4d30 con 0x7fe7ac15dd30 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe7abfff640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac15dd30 0x7fe7ac1f7580 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400efc0 tx=0x7fe7a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe793fff640 1 -- 172.21.15.172:0/2939638628 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4018020 con 0x7fe7ac15dd30 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe793fff640 1 -- 172.21.15.172:0/2939638628 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a4014480 con 0x7fe7ac15dd30 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/2939638628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac0b5010 con 0x7fe7ac15dd30 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe793fff640 1 -- 172.21.15.172:0/2939638628 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4014870 con 0x7fe7ac15dd30 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.169+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/2939638628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac0cafc0 con 0x7fe7ac15dd30 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.170+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/2939638628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac073990 con 0x7fe7ac15dd30 2024-04-25T08:51:19.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.171+0000 7fe793fff640 1 -- 172.21.15.172:0/2939638628 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe7a4005d10 con 0x7fe7ac15dd30 2024-04-25T08:51:19.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.171+0000 7fe793fff640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe79806b500 0x7fe79806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.171+0000 7fe793fff640 1 -- 172.21.15.172:0/2939638628 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe7a408ad30 con 0x7fe7ac15dd30 2024-04-25T08:51:19.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.171+0000 7fe7ab7fe640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe79806b500 0x7fe79806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.164 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.172+0000 7fe7ab7fe640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe79806b500 0x7fe79806d9c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0016e0 tx=0x7fe79c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:19.165 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.175+0000 7fe793fff640 1 -- 172.21.15.172:0/2939638628 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe7a4022070 con 0x7fe7ac15dd30 2024-04-25T08:51:19.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.383+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/2939638628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7ac0c79f0 con 0x7fe7ac15dd30 2024-04-25T08:51:19.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.384+0000 7fe793fff640 1 -- 172.21.15.172:0/2939638628 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fe7a4010040 con 0x7fe7ac15dd30 2024-04-25T08:51:19.375 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:19.375 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:19.375 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:51:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/2939638628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe79806b500 msgr2=0x7fe79806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe79806b500 0x7fe79806d9c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0016e0 tx=0x7fe79c009040 comp rx=0 tx=0).stop 2024-04-25T08:51:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/2939638628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac15dd30 msgr2=0x7fe7ac1f7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac15dd30 0x7fe7ac1f7580 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400efc0 tx=0x7fe7a400c490 comp rx=0 tx=0).stop 2024-04-25T08:51:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/2939638628 shutdown_connections 2024-04-25T08:51:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe79806b500 0x7fe79806d9c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7ac0d2e90 0x7fe7ac1f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac15dd30 0x7fe7ac1f7580 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 --2- 172.21.15.172:0/2939638628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7ac0d0900 0x7fe7ac0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/2939638628 >> 172.21.15.172:0/2939638628 conn(0x7fe7ac061c30 msgr2=0x7fe7ac06c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:19.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/2939638628 shutdown_connections 2024-04-25T08:51:19.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.386+0000 7fe7b1cbd640 1 -- 172.21.15.172:0/2939638628 wait complete. 2024-04-25T08:51:19.387 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-04-25T08:51:19.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:51:19.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.494+0000 7fbe515b0640 1 Processor -- start 2024-04-25T08:51:19.485 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.494+0000 7fbe515b0640 1 -- start start 2024-04-25T08:51:19.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe515b0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbe4c0d1020 0x7fbe4c0d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe515b0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c0b97a0 con 0x7fbe4c0b2cb0 2024-04-25T08:51:19.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe515b0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c0d1c50 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe515b0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c15dfc0 con 0x7fbe4c0d1020 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe4a7fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbe4c0b2cb0 0x7fbe4c0d2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:32908/0 (socket says 172.21.15.172:32908) 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe4a7fc640 1 -- 172.21.15.172:0/1050573195 learned_addr learned my addr 172.21.15.172:0/1050573195 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe4b7fe640 1 --2- 172.21.15.172:0/1050573195 >> v2:172.21.15.186:3300/0 conn(0x7fbe4c0d1020 0x7fbe4c0d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe49ffb640 1 -- 172.21.15.172:0/1050573195 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46007502 0 0) 0x7fbe4c0b97a0 con 0x7fbe4c0b2cb0 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe49ffb640 1 -- 172.21.15.172:0/1050573195 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe34003520 con 0x7fbe4c0b2cb0 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe4b7fe640 1 -- 172.21.15.172:0/1050573195 >> v1:172.21.15.186:6789/0 conn(0x7fbe4c15dbe0 legacy=0x7fbe4c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe49ffb640 1 -- 172.21.15.172:0/1050573195 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835976329 0 0) 0x7fbe34003520 con 0x7fbe4c0b2cb0 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe4b7fe640 1 -- 172.21.15.172:0/1050573195 >> v1:172.21.15.172:6789/0 conn(0x7fbe4c0b2cb0 legacy=0x7fbe4c0d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.495+0000 7fbe4b7fe640 1 -- 172.21.15.172:0/1050573195 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c0d1f30 con 0x7fbe4c0d1020 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.496+0000 7fbe4b7fe640 1 --2- 172.21.15.172:0/1050573195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c0d1020 0x7fbe4c0d2e40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097a0 tx=0x7fbe4402a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b25a44ca3f4e462c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.496+0000 7fbe49ffb640 1 -- 172.21.15.172:0/1050573195 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44037070 con 0x7fbe4c0d1020 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.496+0000 7fbe49ffb640 1 -- 172.21.15.172:0/1050573195 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4402ab60 con 0x7fbe4c0d1020 2024-04-25T08:51:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.496+0000 7fbe49ffb640 1 -- 172.21.15.172:0/1050573195 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40001670 con 0x7fbe4c0d1020 2024-04-25T08:51:19.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.497+0000 7fbe515b0640 1 -- 172.21.15.172:0/1050573195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c0d1020 msgr2=0x7fbe4c0d2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.497+0000 7fbe515b0640 1 --2- 172.21.15.172:0/1050573195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c0d1020 0x7fbe4c0d2e40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097a0 tx=0x7fbe4402a0d0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.497+0000 7fbe515b0640 1 -- 172.21.15.172:0/1050573195 shutdown_connections 2024-04-25T08:51:19.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.497+0000 7fbe515b0640 1 --2- 172.21.15.172:0/1050573195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c0d1020 0x7fbe4c0d2e40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.497+0000 7fbe515b0640 1 -- 172.21.15.172:0/1050573195 >> 172.21.15.172:0/1050573195 conn(0x7fbe4c061a20 msgr2=0x7fbe4c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:19.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.497+0000 7fbe515b0640 1 -- 172.21.15.172:0/1050573195 shutdown_connections 2024-04-25T08:51:19.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.497+0000 7fbe515b0640 1 -- 172.21.15.172:0/1050573195 wait complete. 2024-04-25T08:51:19.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.498+0000 7fbe515b0640 1 Processor -- start 2024-04-25T08:51:19.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.498+0000 7fbe515b0640 1 -- start start 2024-04-25T08:51:19.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe515b0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c0b2cb0 0x7fbe4c1f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe515b0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c0d1020 0x7fbe4c154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe515b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c15dbe0 0x7fbe4c1f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe515b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0b92a0 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe515b0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0d1a00 con 0x7fbe4c0d1020 2024-04-25T08:51:19.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe515b0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0b9420 con 0x7fbe4c0b2cb0 2024-04-25T08:51:19.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c15dbe0 0x7fbe4c1f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c15dbe0 0x7fbe4c1f4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56388/0 (socket says 172.21.15.172:56388) 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4b7fe640 1 -- 172.21.15.172:0/3596114448 learned_addr learned my addr 172.21.15.172:0/3596114448 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4a7fc640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c0d1020 0x7fbe4c154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4affd640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c0b2cb0 0x7fbe4c1f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4b7fe640 1 -- 172.21.15.172:0/3596114448 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c0b2cb0 msgr2=0x7fbe4c1f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4b7fe640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c0b2cb0 0x7fbe4c1f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4b7fe640 1 -- 172.21.15.172:0/3596114448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c0d1020 msgr2=0x7fbe4c154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4b7fe640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c0d1020 0x7fbe4c154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4b7fe640 1 -- 172.21.15.172:0/3596114448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c1f4260 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe4b7fe640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c15dbe0 0x7fbe4c1f4460 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097a0 tx=0x7fbe440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.499+0000 7fbe337fe640 1 -- 172.21.15.172:0/3596114448 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44037040 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.500+0000 7fbe337fe640 1 -- 172.21.15.172:0/3596114448 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44004030 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.500+0000 7fbe515b0640 1 -- 172.21.15.172:0/3596114448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c155c50 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.500+0000 7fbe337fe640 1 -- 172.21.15.172:0/3596114448 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44006e10 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.500+0000 7fbe515b0640 1 -- 172.21.15.172:0/3596114448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c1564f0 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.501+0000 7fbe515b0640 1 -- 172.21.15.172:0/3596114448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c156040 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.501+0000 7fbe337fe640 1 -- 172.21.15.172:0/3596114448 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbe4403a040 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.501+0000 7fbe337fe640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3806b4d0 0x7fbe3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:19.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.501+0000 7fbe337fe640 1 -- 172.21.15.172:0/3596114448 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe440aa770 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.501+0000 7fbe4affd640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3806b4d0 0x7fbe3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:19.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.502+0000 7fbe4affd640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3806b4d0 0x7fbe3806d990 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c007fd0 tx=0x7fbe3c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:19.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.506+0000 7fbe337fe640 1 -- 172.21.15.172:0/3596114448 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe4c1f4260 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.743+0000 7fbe515b0640 1 -- 172.21.15.172:0/3596114448 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbe4c0c9ea0 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.743+0000 7fbe337fe640 1 -- 172.21.15.172:0/3596114448 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1631 (secure 0 0 0) 0x7fbe44042020 con 0x7fbe4c15dbe0 2024-04-25T08:51:19.734 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:19.734 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":555,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":131,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076493182,"bytes_used":2569404416,"bytes_avail":770524708864,"bytes_total":773094113280,"write_bytes_sec":69992751,"read_op_per_sec":0,"write_op_per_sec":68},"fsmap":{"epoch":74,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9294}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-04-25T08:51:18.621038+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:51:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 -- 172.21.15.172:0/3596114448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3806b4d0 msgr2=0x7fbe3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3806b4d0 0x7fbe3806d990 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c007fd0 tx=0x7fbe3c009040 comp rx=0 tx=0).stop 2024-04-25T08:51:19.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 -- 172.21.15.172:0/3596114448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c15dbe0 msgr2=0x7fbe4c1f4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:19.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c15dbe0 0x7fbe4c1f4460 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097a0 tx=0x7fbe440046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 -- 172.21.15.172:0/3596114448 shutdown_connections 2024-04-25T08:51:19.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe3806b4d0 0x7fbe3806d990 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe4c0d1020 0x7fbe4c154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c15dbe0 0x7fbe4c1f4460 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 --2- 172.21.15.172:0/3596114448 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe4c0b2cb0 0x7fbe4c1f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:19.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 -- 172.21.15.172:0/3596114448 >> 172.21.15.172:0/3596114448 conn(0x7fbe4c061a20 msgr2=0x7fbe4c0b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:19.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 -- 172.21.15.172:0/3596114448 shutdown_connections 2024-04-25T08:51:19.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:19.745+0000 7fbe515b0640 1 -- 172.21.15.172:0/3596114448 wait complete. 2024-04-25T08:51:19.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused paths [/scrub_control_test_path]'} 2024-04-25T08:51:19.747 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:51:19.747 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:51:19.758 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:51:19.759 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'b', 'a', 'd'} 2024-04-25T08:51:19.759 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-04-25T08:51:19.903 INFO:teuthology.orchestra.run.smithi172.stdout:{"mds_beacon_grace":"15.000000"} 2024-04-25T08:51:19.903 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-04-25T08:51:19.904 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:20.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.011+0000 7fa4eb789640 1 Processor -- start 2024-04-25T08:51:20.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.011+0000 7fa4eb789640 1 -- start start 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4eb789640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4e406abe0 0x7fa4e406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4eb789640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4e415d370 0x7fa4e415d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4eb789640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e41626e0 con 0x7fa4e40ce330 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4eb789640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e406b500 con 0x7fa4e415d370 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4eb789640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e4070270 con 0x7fa4e406abe0 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4e9d26640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4e415d370 0x7fa4e415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4e9d26640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4e415d370 0x7fa4e415d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56394/0 (socket says 172.21.15.172:56394) 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4e9d26640 1 -- 172.21.15.172:0/1079917488 learned_addr learned my addr 172.21.15.172:0/1079917488 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4e9525640 1 --2- 172.21.15.172:0/1079917488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4e406abe0 0x7fa4e406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4e9d26640 1 -- 172.21.15.172:0/1079917488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4e406abe0 msgr2=0x7fa4e406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4e9d26640 1 --2- 172.21.15.172:0/1079917488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4e406abe0 0x7fa4e406afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.012+0000 7fa4e9d26640 1 -- 172.21.15.172:0/1079917488 >> v1:172.21.15.186:6789/0 conn(0x7fa4e40ce330 legacy=0x7fa4e406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:20.004 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.013+0000 7fa4e9d26640 1 -- 172.21.15.172:0/1079917488 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e40cd270 con 0x7fa4e415d370 2024-04-25T08:51:20.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.013+0000 7fa4e9d26640 1 --2- 172.21.15.172:0/1079917488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 0x7fa4e415d800 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009e50 tx=0x7fa4dc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76467cc5c23b24cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:20.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.013+0000 7fa4dbfff640 1 -- 172.21.15.172:0/1079917488 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc036070 con 0x7fa4e415d370 2024-04-25T08:51:20.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.013+0000 7fa4dbfff640 1 -- 172.21.15.172:0/1079917488 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc031600 con 0x7fa4e415d370 2024-04-25T08:51:20.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.013+0000 7fa4dbfff640 1 -- 172.21.15.172:0/1079917488 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0319d0 con 0x7fa4e415d370 2024-04-25T08:51:20.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.014+0000 7fa4eb789640 1 -- 172.21.15.172:0/1079917488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 msgr2=0x7fa4e415d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:20.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.014+0000 7fa4eb789640 1 --2- 172.21.15.172:0/1079917488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 0x7fa4e415d800 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009e50 tx=0x7fa4dc02a680 comp rx=0 tx=0).stop 2024-04-25T08:51:20.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.014+0000 7fa4eb789640 1 -- 172.21.15.172:0/1079917488 shutdown_connections 2024-04-25T08:51:20.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.014+0000 7fa4eb789640 1 --2- 172.21.15.172:0/1079917488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 0x7fa4e415d800 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:20.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.014+0000 7fa4eb789640 1 --2- 172.21.15.172:0/1079917488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4e406abe0 0x7fa4e406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:20.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.014+0000 7fa4eb789640 1 -- 172.21.15.172:0/1079917488 >> 172.21.15.172:0/1079917488 conn(0x7fa4e40b2220 msgr2=0x7fa4e40b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:20.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.014+0000 7fa4eb789640 1 -- 172.21.15.172:0/1079917488 shutdown_connections 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.014+0000 7fa4eb789640 1 -- 172.21.15.172:0/1079917488 wait complete. 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.015+0000 7fa4eb789640 1 Processor -- start 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.015+0000 7fa4eb789640 1 -- start start 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4eb789640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e406abe0 0x7fa4e40c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4eb789640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4e40ce330 0x7fa4e40ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4eb789640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 0x7fa4e40adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4eb789640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e40cdb10 con 0x7fa4e415d370 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4eb789640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e40cd830 con 0x7fa4e406abe0 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4eb789640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e4161780 con 0x7fa4e40ce330 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9d26640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 0x7fa4e40adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9d26640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 0x7fa4e40adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56396/0 (socket says 172.21.15.172:56396) 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9d26640 1 -- 172.21.15.172:0/1902276278 learned_addr learned my addr 172.21.15.172:0/1902276278 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:20.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9525640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e406abe0 0x7fa4e40c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e8d24640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4e40ce330 0x7fa4e40ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9d26640 1 -- 172.21.15.172:0/1902276278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4e40ce330 msgr2=0x7fa4e40ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9d26640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4e40ce330 0x7fa4e40ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9d26640 1 -- 172.21.15.172:0/1902276278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e406abe0 msgr2=0x7fa4e40c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9d26640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e406abe0 0x7fa4e40c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9d26640 1 -- 172.21.15.172:0/1902276278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e409e100 con 0x7fa4e415d370 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9525640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e406abe0 0x7fa4e40c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.016+0000 7fa4e9d26640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 0x7fa4e40adb00 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009e50 tx=0x7fa4dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.017+0000 7fa4d9ffb640 1 -- 172.21.15.172:0/1902276278 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc041020 con 0x7fa4e415d370 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.017+0000 7fa4d9ffb640 1 -- 172.21.15.172:0/1902276278 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc007780 con 0x7fa4e415d370 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.017+0000 7fa4eb789640 1 -- 172.21.15.172:0/1902276278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e409e3e0 con 0x7fa4e415d370 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.017+0000 7fa4d9ffb640 1 -- 172.21.15.172:0/1902276278 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc036040 con 0x7fa4e415d370 2024-04-25T08:51:20.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.017+0000 7fa4eb789640 1 -- 172.21.15.172:0/1902276278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e415f800 con 0x7fa4e415d370 2024-04-25T08:51:20.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.018+0000 7fa4eb789640 1 -- 172.21.15.172:0/1902276278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e4160fa0 con 0x7fa4e415d370 2024-04-25T08:51:20.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.018+0000 7fa4d9ffb640 1 -- 172.21.15.172:0/1902276278 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa4dc044020 con 0x7fa4e415d370 2024-04-25T08:51:20.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.019+0000 7fa4d9ffb640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4c806b4d0 0x7fa4c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:20.011 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.019+0000 7fa4d9ffb640 1 -- 172.21.15.172:0/1902276278 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa4dc0ab010 con 0x7fa4e415d370 2024-04-25T08:51:20.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.019+0000 7fa4e9525640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4c806b4d0 0x7fa4c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:20.012 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.019+0000 7fa4e9525640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4c806b4d0 0x7fa4c806d990 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0006fd0 tx=0x7fa4e0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:20.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.023+0000 7fa4d9ffb640 1 -- 172.21.15.172:0/1902276278 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa4dc04b030 con 0x7fa4e415d370 2024-04-25T08:51:20.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.235+0000 7fa4eb789640 1 -- 172.21.15.172:0/1902276278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4e40b2ff0 con 0x7fa4e415d370 2024-04-25T08:51:20.228 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.235+0000 7fa4d9ffb640 1 -- 172.21.15.172:0/1902276278 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fa4dc079e50 con 0x7fa4e415d370 2024-04-25T08:51:20.228 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:20.228 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:20.229 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:51:20.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.237+0000 7fa4eb789640 1 -- 172.21.15.172:0/1902276278 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4c806b4d0 msgr2=0x7fa4c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:20.229 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.237+0000 7fa4eb789640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4c806b4d0 0x7fa4c806d990 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0006fd0 tx=0x7fa4e0008040 comp rx=0 tx=0).stop 2024-04-25T08:51:20.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.237+0000 7fa4eb789640 1 -- 172.21.15.172:0/1902276278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 msgr2=0x7fa4e40adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:20.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.237+0000 7fa4eb789640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 0x7fa4e40adb00 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009e50 tx=0x7fa4dc004a40 comp rx=0 tx=0).stop 2024-04-25T08:51:20.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.238+0000 7fa4eb789640 1 -- 172.21.15.172:0/1902276278 shutdown_connections 2024-04-25T08:51:20.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.238+0000 7fa4eb789640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4c806b4d0 0x7fa4c806d990 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:20.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.238+0000 7fa4eb789640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4e415d370 0x7fa4e40adb00 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:20.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.238+0000 7fa4eb789640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4e40ce330 0x7fa4e40ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:20.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.238+0000 7fa4eb789640 1 --2- 172.21.15.172:0/1902276278 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4e406abe0 0x7fa4e40c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:20.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.238+0000 7fa4eb789640 1 -- 172.21.15.172:0/1902276278 >> 172.21.15.172:0/1902276278 conn(0x7fa4e40b2220 msgr2=0x7fa4e415b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:20.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.238+0000 7fa4eb789640 1 -- 172.21.15.172:0/1902276278 shutdown_connections 2024-04-25T08:51:20.230 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:20.238+0000 7fa4eb789640 1 -- 172.21.15.172:0/1902276278 wait complete. 2024-04-25T08:51:20.240 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T08:51:25.241 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:25.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.361+0000 7fafe6de2640 1 Processor -- start 2024-04-25T08:51:25.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.361+0000 7fafe6de2640 1 -- start start 2024-04-25T08:51:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafe6de2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fafe013d190 0x7fafe00cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafe6de2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe0071ed0 con 0x7fafe015b320 2024-04-25T08:51:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafe6de2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe015a840 con 0x7fafe0071940 2024-04-25T08:51:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafe6de2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe013d570 con 0x7fafe013d190 2024-04-25T08:51:25.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafdffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fafe015b320 0x7fafe0071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:32920/0 (socket says 172.21.15.172:32920) 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafdffff640 1 -- 172.21.15.172:0/3765820227 learned_addr learned my addr 172.21.15.172:0/3765820227 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156042046 0 0) 0x7fafe0071ed0 con 0x7fafe015b320 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd0003520 con 0x7fafe015b320 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafe4b7e640 1 --2- 172.21.15.172:0/3765820227 >> v2:172.21.15.186:3300/0 conn(0x7fafe013d190 0x7fafe00cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1869446265 0 0) 0x7fafd0003520 con 0x7fafe015b320 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 >> v2:172.21.15.186:3300/0 conn(0x7fafe013d190 msgr2=0x7fafe00cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafdf7fe640 1 --2- 172.21.15.172:0/3765820227 >> v2:172.21.15.186:3300/0 conn(0x7fafe013d190 0x7fafe00cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.362+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 >> v1:172.21.15.186:6789/0 conn(0x7fafe0071940 legacy=0x7fafe015dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe015ab20 con 0x7fafe015b320 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fafcc001670 con 0x7fafe015b320 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 >> v1:172.21.15.172:6789/0 conn(0x7fafe015b320 legacy=0x7fafe0071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafdf7fe640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafd00039b0 0x7fafd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafdf7fe640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd0004800 0x7fafd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafdf7fe640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd00051c0 0x7fafd000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:25.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe013d570 con 0x7fafd00051c0 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd000d270 con 0x7fafd0004800 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd000d470 con 0x7fafd00039b0 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafe537f640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd00051c0 0x7fafd000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafe4b7e640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafd00039b0 0x7fafd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafdffff640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd0004800 0x7fafd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafe537f640 1 -- 172.21.15.172:0/3765820227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafd00039b0 msgr2=0x7fafd0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafe537f640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafd00039b0 0x7fafd0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafe537f640 1 -- 172.21.15.172:0/3765820227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd0004800 msgr2=0x7fafd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafe537f640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd0004800 0x7fafd0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.363+0000 7fafe537f640 1 -- 172.21.15.172:0/3765820227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0003520 con 0x7fafd00051c0 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.364+0000 7fafe537f640 1 -- 172.21.15.172:0/3765820227 reap_dead start 2024-04-25T08:51:25.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.364+0000 7fafe537f640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd00051c0 0x7fafd000b9c0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fafd8001ee0 tx=0x7fafd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff68083a904c6a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:25.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.364+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8035070 con 0x7fafd00051c0 2024-04-25T08:51:25.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.364+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8003bb0 con 0x7fafd00051c0 2024-04-25T08:51:25.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.364+0000 7fafdf7fe640 1 -- 172.21.15.172:0/3765820227 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8001b00 con 0x7fafd00051c0 2024-04-25T08:51:25.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.364+0000 7fafe6de2640 1 -- 172.21.15.172:0/3765820227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd00051c0 msgr2=0x7fafd000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:25.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.364+0000 7fafe6de2640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd00051c0 0x7fafd000b9c0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fafd8001ee0 tx=0x7fafd0005830 comp rx=0 tx=0).stop 2024-04-25T08:51:25.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.364+0000 7fafe6de2640 1 -- 172.21.15.172:0/3765820227 shutdown_connections 2024-04-25T08:51:25.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.364+0000 7fafe6de2640 1 --2- 172.21.15.172:0/3765820227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafd00051c0 0x7fafd000b9c0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:25.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.364+0000 7fafe6de2640 1 -- 172.21.15.172:0/3765820227 >> 172.21.15.172:0/3765820227 conn(0x7fafe006abe0 msgr2=0x7fafe006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:25.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.365+0000 7fafe6de2640 1 -- 172.21.15.172:0/3765820227 shutdown_connections 2024-04-25T08:51:25.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.365+0000 7fafe6de2640 1 -- 172.21.15.172:0/3765820227 wait complete. 2024-04-25T08:51:25.361 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.366+0000 7fafe6de2640 1 Processor -- start 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.366+0000 7fafe6de2640 1 -- start start 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafe6de2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd00051c0 0x7fafe01f0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafe6de2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafe00b27a0 0x7fafe00b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafe6de2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafe01eefb0 0x7fafe015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafe6de2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe00713b0 con 0x7fafe00b27a0 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafe6de2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe0071230 con 0x7fafd00051c0 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafe6de2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe0071530 con 0x7fafe01eefb0 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafe00b27a0 0x7fafe00b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafe00b27a0 0x7fafe00b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56422/0 (socket says 172.21.15.172:56422) 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdffff640 1 -- 172.21.15.172:0/2296128990 learned_addr learned my addr 172.21.15.172:0/2296128990 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:25.362 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafe537f640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafe01eefb0 0x7fafe015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafe4b7e640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd00051c0 0x7fafe01f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdffff640 1 -- 172.21.15.172:0/2296128990 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafe01eefb0 msgr2=0x7fafe015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdffff640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafe01eefb0 0x7fafe015c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdffff640 1 -- 172.21.15.172:0/2296128990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd00051c0 msgr2=0x7fafe01f0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdffff640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd00051c0 0x7fafe01f0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdffff640 1 -- 172.21.15.172:0/2296128990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe00b3dd0 con 0x7fafe00b27a0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdffff640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafe00b27a0 0x7fafe00b0830 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fafcc007290 tx=0x7fafcc007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdd7fa640 1 -- 172.21.15.172:0/2296128990 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00f960 con 0x7fafe00b27a0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdd7fa640 1 -- 172.21.15.172:0/2296128990 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc018070 con 0x7fafe00b27a0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafdd7fa640 1 -- 172.21.15.172:0/2296128990 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00fd20 con 0x7fafe00b27a0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.367+0000 7fafe6de2640 1 -- 172.21.15.172:0/2296128990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe00b2c30 con 0x7fafe00b27a0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.368+0000 7fafe6de2640 1 -- 172.21.15.172:0/2296128990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe00b31f0 con 0x7fafe00b27a0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.368+0000 7fafe6de2640 1 -- 172.21.15.172:0/2296128990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe0073990 con 0x7fafe00b27a0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.369+0000 7fafdd7fa640 1 -- 172.21.15.172:0/2296128990 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fafcc01d460 con 0x7fafe00b27a0 2024-04-25T08:51:25.363 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.369+0000 7fafdd7fa640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafc406b500 0x7fafc406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:25.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.369+0000 7fafdd7fa640 1 -- 172.21.15.172:0/2296128990 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fafcc08a1c0 con 0x7fafe00b27a0 2024-04-25T08:51:25.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.370+0000 7fafe4b7e640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafc406b500 0x7fafc406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:25.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.370+0000 7fafe4b7e640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafc406b500 0x7fafc406d9c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fafe006f0e0 tx=0x7fafd4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:25.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.374+0000 7fafdd7fa640 1 -- 172.21.15.172:0/2296128990 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fafcc058f40 con 0x7fafe00b27a0 2024-04-25T08:51:25.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.579+0000 7fafe6de2640 1 -- 172.21.15.172:0/2296128990 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafe014dcb0 con 0x7fafe00b27a0 2024-04-25T08:51:25.570 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.580+0000 7fafdd7fa640 1 -- 172.21.15.172:0/2296128990 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fafcc058840 con 0x7fafe00b27a0 2024-04-25T08:51:25.571 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:25.571 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:25.571 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 -- 172.21.15.172:0/2296128990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafc406b500 msgr2=0x7fafc406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafc406b500 0x7fafc406d9c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fafe006f0e0 tx=0x7fafd4009190 comp rx=0 tx=0).stop 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 -- 172.21.15.172:0/2296128990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafe00b27a0 msgr2=0x7fafe00b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafe00b27a0 0x7fafe00b0830 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fafcc007290 tx=0x7fafcc007690 comp rx=0 tx=0).stop 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 -- 172.21.15.172:0/2296128990 shutdown_connections 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fafc406b500 0x7fafc406d9c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafe01eefb0 0x7fafe015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafe00b27a0 0x7fafe00b0830 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 --2- 172.21.15.172:0/2296128990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafd00051c0 0x7fafe01f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 -- 172.21.15.172:0/2296128990 >> 172.21.15.172:0/2296128990 conn(0x7fafe006abe0 msgr2=0x7fafe00ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 -- 172.21.15.172:0/2296128990 shutdown_connections 2024-04-25T08:51:25.573 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:25.582+0000 7fafe6de2640 1 -- 172.21.15.172:0/2296128990 wait complete. 2024-04-25T08:51:25.584 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T08:51:30.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:30.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.706+0000 7f9c6039e640 1 Processor -- start 2024-04-25T08:51:30.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.706+0000 7f9c6039e640 1 -- start start 2024-04-25T08:51:30.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c6039e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9c580cfec0 0x7f9c580cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:30.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c6039e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c58071480 con 0x7f9c580ce3c0 2024-04-25T08:51:30.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c6039e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c58071760 con 0x7f9c58154ee0 2024-04-25T08:51:30.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c6039e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c580ce830 con 0x7f9c580cfec0 2024-04-25T08:51:30.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5e93b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9c580ce3c0 0x7f9c5806d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41344/0 (socket says 172.21.15.172:41344) 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5e93b640 1 -- 172.21.15.172:0/217214025 learned_addr learned my addr 172.21.15.172:0/217214025 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5d939640 1 --2- 172.21.15.172:0/217214025 >> v2:172.21.15.186:3300/0 conn(0x7f9c580cfec0 0x7f9c580cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966591478 0 0) 0x7f9c58071480 con 0x7f9c580ce3c0 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c44003520 con 0x7f9c580ce3c0 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 5564832 0 0) 0x7f9c44003520 con 0x7f9c580ce3c0 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 >> v2:172.21.15.186:3300/0 conn(0x7f9c580cfec0 msgr2=0x7f9c580cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5d138640 1 --2- 172.21.15.172:0/217214025 >> v2:172.21.15.186:3300/0 conn(0x7f9c580cfec0 0x7f9c580cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 >> v1:172.21.15.186:6789/0 conn(0x7f9c58154ee0 legacy=0x7f9c580cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c58071a40 con 0x7f9c580ce3c0 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.707+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f9c500019f0 con 0x7f9c580ce3c0 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 >> v1:172.21.15.172:6789/0 conn(0x7f9c580ce3c0 legacy=0x7f9c5806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d138640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c440039b0 0x7f9c44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d138640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c44004800 0x7f9c44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:30.701 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d138640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c440051c0 0x7f9c4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580ce830 con 0x7f9c44004800 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4400c060 con 0x7f9c440039b0 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4400c260 con 0x7f9c440051c0 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d939640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c44004800 0x7f9c44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5e13a640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c440039b0 0x7f9c44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5e93b640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c440051c0 0x7f9c4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d939640 1 -- 172.21.15.172:0/217214025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c440051c0 msgr2=0x7f9c4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d939640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c440051c0 0x7f9c4400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d939640 1 -- 172.21.15.172:0/217214025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c440039b0 msgr2=0x7f9c44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d939640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c440039b0 0x7f9c44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5d939640 1 -- 172.21.15.172:0/217214025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44003520 con 0x7f9c44004800 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.708+0000 7f9c5e93b640 1 -- 172.21.15.172:0/217214025 reap_dead start 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.709+0000 7f9c5d939640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c44004800 0x7f9c44004c80 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009ac0 tx=0x7f9c44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14482675c889d691 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:30.702 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.709+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48036070 con 0x7f9c44004800 2024-04-25T08:51:30.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.709+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c48031400 con 0x7f9c44004800 2024-04-25T08:51:30.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.709+0000 7f9c5d138640 1 -- 172.21.15.172:0/217214025 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48009690 con 0x7f9c44004800 2024-04-25T08:51:30.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.709+0000 7f9c6039e640 1 -- 172.21.15.172:0/217214025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c44004800 msgr2=0x7f9c44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:30.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.709+0000 7f9c6039e640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c44004800 0x7f9c44004c80 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009ac0 tx=0x7f9c44005830 comp rx=0 tx=0).stop 2024-04-25T08:51:30.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.709+0000 7f9c6039e640 1 -- 172.21.15.172:0/217214025 shutdown_connections 2024-04-25T08:51:30.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.709+0000 7f9c6039e640 1 --2- 172.21.15.172:0/217214025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c44004800 0x7f9c44004c80 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:30.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.709+0000 7f9c6039e640 1 -- 172.21.15.172:0/217214025 >> 172.21.15.172:0/217214025 conn(0x7f9c5806abe0 msgr2=0x7f9c5806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:30.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.710+0000 7f9c6039e640 1 -- 172.21.15.172:0/217214025 shutdown_connections 2024-04-25T08:51:30.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.710+0000 7f9c6039e640 1 -- 172.21.15.172:0/217214025 wait complete. 2024-04-25T08:51:30.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.711+0000 7f9c6039e640 1 Processor -- start 2024-04-25T08:51:30.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.711+0000 7f9c6039e640 1 -- start start 2024-04-25T08:51:30.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.711+0000 7f9c6039e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c44004800 0x7f9c580aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:30.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.711+0000 7f9c6039e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5814f440 0x7f9c581f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:30.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.711+0000 7f9c6039e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c581f4540 0x7f9c581536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:30.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.711+0000 7f9c6039e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58071230 con 0x7f9c581f4540 2024-04-25T08:51:30.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.711+0000 7f9c6039e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c581552c0 con 0x7f9c5814f440 2024-04-25T08:51:30.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.711+0000 7f9c6039e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58155440 con 0x7f9c44004800 2024-04-25T08:51:30.706 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5e93b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c581f4540 0x7f9c581536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5e93b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c581f4540 0x7f9c581536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35770/0 (socket says 172.21.15.172:35770) 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5e93b640 1 -- 172.21.15.172:0/2491641747 learned_addr learned my addr 172.21.15.172:0/2491641747 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5e13a640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c44004800 0x7f9c580aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5d939640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5814f440 0x7f9c581f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5e93b640 1 -- 172.21.15.172:0/2491641747 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c44004800 msgr2=0x7f9c580aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5e93b640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c44004800 0x7f9c580aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5e93b640 1 -- 172.21.15.172:0/2491641747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5814f440 msgr2=0x7f9c581f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5e93b640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5814f440 0x7f9c581f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5e93b640 1 -- 172.21.15.172:0/2491641747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c581f4a80 con 0x7f9c581f4540 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c5e93b640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c581f4540 0x7f9c581536e0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f9c580cd2d0 tx=0x7f9c50007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c4effd640 1 -- 172.21.15.172:0/2491641747 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000abc0 con 0x7f9c581f4540 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c4effd640 1 -- 172.21.15.172:0/2491641747 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c50018070 con 0x7f9c581f4540 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c6039e640 1 -- 172.21.15.172:0/2491641747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c581f4d60 con 0x7f9c581f4540 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c4effd640 1 -- 172.21.15.172:0/2491641747 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c500133f0 con 0x7f9c581f4540 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.712+0000 7f9c6039e640 1 -- 172.21.15.172:0/2491641747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c580ab200 con 0x7f9c581f4540 2024-04-25T08:51:30.707 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.713+0000 7f9c6039e640 1 -- 172.21.15.172:0/2491641747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c58073990 con 0x7f9c581f4540 2024-04-25T08:51:30.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.714+0000 7f9c4effd640 1 -- 172.21.15.172:0/2491641747 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c50013590 con 0x7f9c581f4540 2024-04-25T08:51:30.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.714+0000 7f9c4effd640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c3c06b4d0 0x7f9c3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:30.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.714+0000 7f9c4effd640 1 -- 172.21.15.172:0/2491641747 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9c5008a720 con 0x7f9c581f4540 2024-04-25T08:51:30.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.714+0000 7f9c5e13a640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c3c06b4d0 0x7f9c3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:30.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.714+0000 7f9c5e13a640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c3c06b4d0 0x7f9c3c06d990 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9c54000c00 tx=0x7f9c54009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:30.708 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.718+0000 7f9c4effd640 1 -- 172.21.15.172:0/2491641747 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c50058e50 con 0x7f9c581f4540 2024-04-25T08:51:30.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.924+0000 7f9c6039e640 1 -- 172.21.15.172:0/2491641747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c5806d360 con 0x7f9c581f4540 2024-04-25T08:51:30.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.925+0000 7f9c4effd640 1 -- 172.21.15.172:0/2491641747 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f9c5005cef0 con 0x7f9c581f4540 2024-04-25T08:51:30.915 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:30.916 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:50:54.404792+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9294":{"gid":9294,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3347790695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3347790695},{"type":"v1","addr":"172.21.15.172:6837","nonce":3347790695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:30.916 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 74 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 -- 172.21.15.172:0/2491641747 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c3c06b4d0 msgr2=0x7f9c3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c3c06b4d0 0x7f9c3c06d990 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9c54000c00 tx=0x7f9c54009040 comp rx=0 tx=0).stop 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 -- 172.21.15.172:0/2491641747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c581f4540 msgr2=0x7f9c581536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c581f4540 0x7f9c581536e0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f9c580cd2d0 tx=0x7f9c50007b20 comp rx=0 tx=0).stop 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 -- 172.21.15.172:0/2491641747 shutdown_connections 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9c3c06b4d0 0x7f9c3c06d990 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c5814f440 0x7f9c581f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c581f4540 0x7f9c581536e0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 --2- 172.21.15.172:0/2491641747 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c44004800 0x7f9c580aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 -- 172.21.15.172:0/2491641747 >> 172.21.15.172:0/2491641747 conn(0x7f9c5806abe0 msgr2=0x7f9c580af380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:30.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 -- 172.21.15.172:0/2491641747 shutdown_connections 2024-04-25T08:51:30.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:30.927+0000 7f9c6039e640 1 -- 172.21.15.172:0/2491641747 wait complete. 2024-04-25T08:51:30.929 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T08:51:31.412 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:51:31.415 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:51:35.930 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:36.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.050+0000 7f9ccf058640 1 Processor -- start 2024-04-25T08:51:36.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.050+0000 7f9ccf058640 1 -- start start 2024-04-25T08:51:36.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9ccf058640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc80ce920 0x7f9cc80ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:36.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9ccf058640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc8144b30 con 0x7f9cc806d290 2024-04-25T08:51:36.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9ccf058640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc80712d0 con 0x7f9cc8144750 2024-04-25T08:51:36.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9ccf058640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80715b0 con 0x7f9cc80ce920 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9ccd5f5640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9cc806d290 0x7f9cc806d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41358/0 (socket says 172.21.15.172:41358) 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9ccd5f5640 1 -- 172.21.15.172:0/1838331958 learned_addr learned my addr 172.21.15.172:0/1838331958 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9cc7fff640 1 --2- 172.21.15.172:0/1838331958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc80ce920 0x7f9cc80ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9cc77fe640 1 -- 172.21.15.172:0/1838331958 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496629633 0 0) 0x7f9cc8144b30 con 0x7f9cc806d290 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9cc77fe640 1 -- 172.21.15.172:0/1838331958 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb8003520 con 0x7f9cc806d290 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9cc77fe640 1 -- 172.21.15.172:0/1838331958 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795801527 0 0) 0x7f9cc80712d0 con 0x7f9cc8144750 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9cc77fe640 1 -- 172.21.15.172:0/1838331958 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc8144b30 con 0x7f9cc8144750 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9cc7fff640 1 -- 172.21.15.172:0/1838331958 >> v1:172.21.15.186:6789/0 conn(0x7f9cc8144750 legacy=0x7f9cc806e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9cc7fff640 1 -- 172.21.15.172:0/1838331958 >> v1:172.21.15.172:6789/0 conn(0x7f9cc806d290 legacy=0x7f9cc806d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.051+0000 7f9cc77fe640 1 -- 172.21.15.172:0/1838331958 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651866392 0 0) 0x7f9cb8003520 con 0x7f9cc806d290 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.052+0000 7f9cc7fff640 1 -- 172.21.15.172:0/1838331958 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc8071890 con 0x7f9cc80ce920 2024-04-25T08:51:36.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.052+0000 7f9cc7fff640 1 --2- 172.21.15.172:0/1838331958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc80ce920 0x7f9cc80ced80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40097d0 tx=0x7f9cb402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=540c9c9cbfcaf932 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.052+0000 7f9cc77fe640 1 -- 172.21.15.172:0/1838331958 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4037070 con 0x7f9cc80ce920 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.053+0000 7f9cc77fe640 1 -- 172.21.15.172:0/1838331958 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb402ac30 con 0x7f9cc80ce920 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.053+0000 7f9cc77fe640 1 -- 172.21.15.172:0/1838331958 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00019f0 con 0x7f9cc80ce920 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.053+0000 7f9ccf058640 1 -- 172.21.15.172:0/1838331958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc80ce920 msgr2=0x7f9cc80ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.053+0000 7f9ccf058640 1 --2- 172.21.15.172:0/1838331958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc80ce920 0x7f9cc80ced80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40097d0 tx=0x7f9cb402a1a0 comp rx=0 tx=0).stop 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.053+0000 7f9ccf058640 1 -- 172.21.15.172:0/1838331958 shutdown_connections 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.053+0000 7f9ccf058640 1 --2- 172.21.15.172:0/1838331958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc80ce920 0x7f9cc80ced80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.053+0000 7f9ccf058640 1 -- 172.21.15.172:0/1838331958 >> 172.21.15.172:0/1838331958 conn(0x7f9cc806abe0 msgr2=0x7f9cc806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.053+0000 7f9ccf058640 1 -- 172.21.15.172:0/1838331958 shutdown_connections 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.053+0000 7f9ccf058640 1 -- 172.21.15.172:0/1838331958 wait complete. 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.054+0000 7f9ccf058640 1 Processor -- start 2024-04-25T08:51:36.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.054+0000 7f9ccf058640 1 -- start start 2024-04-25T08:51:36.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.055+0000 7f9ccf058640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc806d290 0x7f9cc81f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:36.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.055+0000 7f9ccf058640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc80ce920 0x7f9cc8156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:36.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.055+0000 7f9ccf058640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc8144750 0x7f9cc8156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.055+0000 7f9ccf058640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc806f020 con 0x7f9cc8144750 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.055+0000 7f9ccf058640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc806ece0 con 0x7f9cc80ce920 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.055+0000 7f9ccf058640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8145450 con 0x7f9cc806d290 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.055+0000 7f9ccd5f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc8144750 0x7f9cc8156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.055+0000 7f9ccd5f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc8144750 0x7f9cc8156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35778/0 (socket says 172.21.15.172:35778) 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.055+0000 7f9ccd5f5640 1 -- 172.21.15.172:0/2344915700 learned_addr learned my addr 172.21.15.172:0/2344915700 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9cccdf4640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc806d290 0x7f9cc81f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9cc7fff640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc80ce920 0x7f9cc8156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9ccd5f5640 1 -- 172.21.15.172:0/2344915700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc806d290 msgr2=0x7f9cc81f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9ccd5f5640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc806d290 0x7f9cc81f2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9ccd5f5640 1 -- 172.21.15.172:0/2344915700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc80ce920 msgr2=0x7f9cc8156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9ccd5f5640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc80ce920 0x7f9cc8156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9ccd5f5640 1 -- 172.21.15.172:0/2344915700 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc8134020 con 0x7f9cc8144750 2024-04-25T08:51:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9ccd5f5640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc8144750 0x7f9cc8156f40 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0001350 tx=0x7f9cc000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:36.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9cc57fa640 1 -- 172.21.15.172:0/2344915700 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0017070 con 0x7f9cc8144750 2024-04-25T08:51:36.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9cc57fa640 1 -- 172.21.15.172:0/2344915700 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc000ad50 con 0x7f9cc8144750 2024-04-25T08:51:36.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9cc57fa640 1 -- 172.21.15.172:0/2344915700 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0012640 con 0x7f9cc8144750 2024-04-25T08:51:36.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9ccf058640 1 -- 172.21.15.172:0/2344915700 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc80ae200 con 0x7f9cc8144750 2024-04-25T08:51:36.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.056+0000 7f9ccf058640 1 -- 172.21.15.172:0/2344915700 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc80ad960 con 0x7f9cc8144750 2024-04-25T08:51:36.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.057+0000 7f9ccf058640 1 -- 172.21.15.172:0/2344915700 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc8073990 con 0x7f9cc8144750 2024-04-25T08:51:36.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.058+0000 7f9cc57fa640 1 -- 172.21.15.172:0/2344915700 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9cc001a070 con 0x7f9cc8144750 2024-04-25T08:51:36.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.058+0000 7f9cc57fa640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9cac06b4d0 0x7f9cac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:36.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.058+0000 7f9cc57fa640 1 -- 172.21.15.172:0/2344915700 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9cc008a1a0 con 0x7f9cc8144750 2024-04-25T08:51:36.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.058+0000 7f9cccdf4640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9cac06b4d0 0x7f9cac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:36.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.058+0000 7f9cccdf4640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9cac06b4d0 0x7f9cac06d990 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0011e0 tx=0x7f9cbc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:36.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.062+0000 7f9cc57fa640 1 -- 172.21.15.172:0/2344915700 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9cc0058880 con 0x7f9cc8144750 2024-04-25T08:51:36.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.268+0000 7f9ccf058640 1 -- 172.21.15.172:0/2344915700 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cc80af350 con 0x7f9cc8144750 2024-04-25T08:51:36.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.268+0000 7f9cc57fa640 1 -- 172.21.15.172:0/2344915700 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4158 (secure 0 0 0) 0x7f9cc005c920 con 0x7f9cc8144750 2024-04-25T08:51:36.259 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:36.259 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:51:34.396291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9291":{"gid":9291,"name":"a","rank":0,"incarnation":75,"state":"up:reconnect","state_seq":13,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:36.259 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 76 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 -- 172.21.15.172:0/2344915700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9cac06b4d0 msgr2=0x7f9cac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9cac06b4d0 0x7f9cac06d990 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0011e0 tx=0x7f9cbc009040 comp rx=0 tx=0).stop 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 -- 172.21.15.172:0/2344915700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc8144750 msgr2=0x7f9cc8156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc8144750 0x7f9cc8156f40 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0001350 tx=0x7f9cc000a430 comp rx=0 tx=0).stop 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 -- 172.21.15.172:0/2344915700 shutdown_connections 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f9cac06b4d0 0x7f9cac06d990 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc80ce920 0x7f9cc8156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc8144750 0x7f9cc8156f40 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 --2- 172.21.15.172:0/2344915700 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9cc806d290 0x7f9cc81f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 -- 172.21.15.172:0/2344915700 >> 172.21.15.172:0/2344915700 conn(0x7f9cc806abe0 msgr2=0x7f9cc806e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:36.261 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 -- 172.21.15.172:0/2344915700 shutdown_connections 2024-04-25T08:51:36.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:36.270+0000 7f9ccf058640 1 -- 172.21.15.172:0/2344915700 wait complete. 2024-04-25T08:51:36.272 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-04-25T08:51:38.310 INFO:tasks.ceph.mds.a.smithi172.stderr:2024-04-25T08:51:38.320+0000 7f8b15f48640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:51:41.273 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:41.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.391+0000 7f4c8c722640 1 Processor -- start 2024-04-25T08:51:41.382 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.391+0000 7f4c8c722640 1 -- start start 2024-04-25T08:51:41.383 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.392+0000 7f4c8c722640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c84154ee0 0x7f4c840cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.392+0000 7f4c8c722640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c84071480 con 0x7f4c840cfcf0 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.392+0000 7f4c8c722640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c84071760 con 0x7f4c840ce590 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.392+0000 7f4c8c722640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c84072090 con 0x7f4c84154ee0 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.393+0000 7f4c89cbd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4c840cfcf0 0x7f4c840cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42088/0 (socket says 172.21.15.172:42088) 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.393+0000 7f4c89cbd640 1 -- 172.21.15.172:0/2285076815 learned_addr learned my addr 172.21.15.172:0/2285076815 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.393+0000 7f4c8a4be640 1 --2- 172.21.15.172:0/2285076815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c84154ee0 0x7f4c840cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.393+0000 7f4c894bc640 1 -- 172.21.15.172:0/2285076815 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963250602 0 0) 0x7f4c84071480 con 0x7f4c840cfcf0 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.393+0000 7f4c894bc640 1 -- 172.21.15.172:0/2285076815 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c70003520 con 0x7f4c840cfcf0 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.393+0000 7f4c894bc640 1 -- 172.21.15.172:0/2285076815 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143326834 0 0) 0x7f4c84071760 con 0x7f4c840ce590 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.393+0000 7f4c894bc640 1 -- 172.21.15.172:0/2285076815 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c84071480 con 0x7f4c840ce590 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.393+0000 7f4c8a4be640 1 -- 172.21.15.172:0/2285076815 >> v1:172.21.15.186:6789/0 conn(0x7f4c840ce590 legacy=0x7f4c8406d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.393+0000 7f4c8a4be640 1 -- 172.21.15.172:0/2285076815 >> v1:172.21.15.172:6789/0 conn(0x7f4c840cfcf0 legacy=0x7f4c840cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.393+0000 7f4c8a4be640 1 -- 172.21.15.172:0/2285076815 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c84071a40 con 0x7f4c84154ee0 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.394+0000 7f4c8a4be640 1 --2- 172.21.15.172:0/2285076815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c84154ee0 0x7f4c840cf7b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c800097d0 tx=0x7f4c8002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c7606c47fa1e4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.394+0000 7f4c894bc640 1 -- 172.21.15.172:0/2285076815 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80037070 con 0x7f4c84154ee0 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.394+0000 7f4c894bc640 1 -- 172.21.15.172:0/2285076815 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c80032440 con 0x7f4c84154ee0 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.394+0000 7f4c894bc640 1 -- 172.21.15.172:0/2285076815 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c800327f0 con 0x7f4c84154ee0 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.395+0000 7f4c8c722640 1 -- 172.21.15.172:0/2285076815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c84154ee0 msgr2=0x7f4c840cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.395+0000 7f4c8c722640 1 --2- 172.21.15.172:0/2285076815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c84154ee0 0x7f4c840cf7b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c800097d0 tx=0x7f4c8002a210 comp rx=0 tx=0).stop 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.395+0000 7f4c8c722640 1 -- 172.21.15.172:0/2285076815 shutdown_connections 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.395+0000 7f4c8c722640 1 --2- 172.21.15.172:0/2285076815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c84154ee0 0x7f4c840cf7b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.395+0000 7f4c8c722640 1 -- 172.21.15.172:0/2285076815 >> 172.21.15.172:0/2285076815 conn(0x7f4c8406abe0 msgr2=0x7f4c8406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.395+0000 7f4c8c722640 1 -- 172.21.15.172:0/2285076815 shutdown_connections 2024-04-25T08:51:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.395+0000 7f4c8c722640 1 -- 172.21.15.172:0/2285076815 wait complete. 2024-04-25T08:51:41.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.396+0000 7f4c8c722640 1 Processor -- start 2024-04-25T08:51:41.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.396+0000 7f4c8c722640 1 -- start start 2024-04-25T08:51:41.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8c722640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c840ce590 0x7f4c84156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8c722640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c840cfcf0 0x7f4c840cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8c722640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c84154ee0 0x7f4c84158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8c722640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c84071230 con 0x7f4c84154ee0 2024-04-25T08:51:41.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8c722640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c841552c0 con 0x7f4c840ce590 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8c722640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c84155440 con 0x7f4c840cfcf0 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8acbf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c84154ee0 0x7f4c84158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8acbf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c84154ee0 0x7f4c84158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40628/0 (socket says 172.21.15.172:40628) 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8acbf640 1 -- 172.21.15.172:0/1307692219 learned_addr learned my addr 172.21.15.172:0/1307692219 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c89cbd640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c840cfcf0 0x7f4c840cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8a4be640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c840ce590 0x7f4c84156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8acbf640 1 -- 172.21.15.172:0/1307692219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c840cfcf0 msgr2=0x7f4c840cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8acbf640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c840cfcf0 0x7f4c840cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8acbf640 1 -- 172.21.15.172:0/1307692219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c840ce590 msgr2=0x7f4c84156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8acbf640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c840ce590 0x7f4c84156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8acbf640 1 -- 172.21.15.172:0/1307692219 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c841576a0 con 0x7f4c84154ee0 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c8acbf640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c84154ee0 0x7f4c84158740 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00c6e0 tx=0x7f4c7c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.397+0000 7f4c76ffd640 1 -- 172.21.15.172:0/1307692219 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c003b70 con 0x7f4c84154ee0 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.398+0000 7f4c76ffd640 1 -- 172.21.15.172:0/1307692219 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c003d10 con 0x7f4c84154ee0 2024-04-25T08:51:41.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.398+0000 7f4c76ffd640 1 -- 172.21.15.172:0/1307692219 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0052d0 con 0x7f4c84154ee0 2024-04-25T08:51:41.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.398+0000 7f4c8c722640 1 -- 172.21.15.172:0/1307692219 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c84157980 con 0x7f4c84154ee0 2024-04-25T08:51:41.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.398+0000 7f4c8c722640 1 -- 172.21.15.172:0/1307692219 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c84157f40 con 0x7f4c84154ee0 2024-04-25T08:51:41.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.398+0000 7f4c8c722640 1 -- 172.21.15.172:0/1307692219 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c84073990 con 0x7f4c84154ee0 2024-04-25T08:51:41.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.399+0000 7f4c76ffd640 1 -- 172.21.15.172:0/1307692219 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4c7c005470 con 0x7f4c84154ee0 2024-04-25T08:51:41.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.399+0000 7f4c76ffd640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b500 0x7f4c6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.400+0000 7f4c8a4be640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b500 0x7f4c6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.400+0000 7f4c76ffd640 1 -- 172.21.15.172:0/1307692219 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4c7c08a180 con 0x7f4c84154ee0 2024-04-25T08:51:41.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.400+0000 7f4c8a4be640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b500 0x7f4c6806d9c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4c80034000 tx=0x7f4c8002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:41.394 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.404+0000 7f4c76ffd640 1 -- 172.21.15.172:0/1307692219 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c7c0587d0 con 0x7f4c84154ee0 2024-04-25T08:51:41.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.607+0000 7f4c8c722640 1 -- 172.21.15.172:0/1307692219 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c8406d360 con 0x7f4c84154ee0 2024-04-25T08:51:41.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.608+0000 7f4c76ffd640 1 -- 172.21.15.172:0/1307692219 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4155 (secure 0 0 0) 0x7f4c7c05c870 con 0x7f4c84154ee0 2024-04-25T08:51:41.599 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:41.599 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:51:36.323687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9291":{"gid":9291,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:41.599 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 78 2024-04-25T08:51:41.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 -- 172.21.15.172:0/1307692219 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b500 msgr2=0x7f4c6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b500 0x7f4c6806d9c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4c80034000 tx=0x7f4c8002e000 comp rx=0 tx=0).stop 2024-04-25T08:51:41.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 -- 172.21.15.172:0/1307692219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c84154ee0 msgr2=0x7f4c84158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c84154ee0 0x7f4c84158740 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00c6e0 tx=0x7f4c7c00cba0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 -- 172.21.15.172:0/1307692219 shutdown_connections 2024-04-25T08:51:41.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4c6806b500 0x7f4c6806d9c0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c84154ee0 0x7f4c84158740 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c840cfcf0 0x7f4c840cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 --2- 172.21.15.172:0/1307692219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c840ce590 0x7f4c84156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 -- 172.21.15.172:0/1307692219 >> 172.21.15.172:0/1307692219 conn(0x7f4c8406abe0 msgr2=0x7f4c8406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:41.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 -- 172.21.15.172:0/1307692219 shutdown_connections 2024-04-25T08:51:41.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.610+0000 7f4c8c722640 1 -- 172.21.15.172:0/1307692219 wait complete. 2024-04-25T08:51:41.611 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-04-25T08:51:41.611 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:41.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.718+0000 7f409d92b640 1 Processor -- start 2024-04-25T08:51:41.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.718+0000 7f409d92b640 1 -- start start 2024-04-25T08:51:41.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.719+0000 7f409d92b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f409815dc90 0x7f40981625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.719+0000 7f409d92b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f40980d1810 0x7f40980d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.719+0000 7f409d92b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40980cce50 con 0x7f40980cc8e0 2024-04-25T08:51:41.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.719+0000 7f409d92b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40980d21c0 con 0x7f40980d1810 2024-04-25T08:51:41.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.719+0000 7f409d92b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4098161af0 con 0x7f409815dc90 2024-04-25T08:51:41.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.719+0000 7f40977fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f40980d1810 0x7f40980d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.710 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.719+0000 7f40967fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f40980cc8e0 0x7f409815ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42098/0 (socket says 172.21.15.172:42098) 2024-04-25T08:51:41.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.719+0000 7f40967fc640 1 -- 172.21.15.172:0/1545733736 learned_addr learned my addr 172.21.15.172:0/1545733736 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:41.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.719+0000 7f4096ffd640 1 --2- 172.21.15.172:0/1545733736 >> v2:172.21.15.186:3300/0 conn(0x7f409815dc90 0x7f40981625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.720+0000 7f40977fe640 1 -- 172.21.15.172:0/1545733736 >> v2:172.21.15.186:3300/0 conn(0x7f409815dc90 msgr2=0x7f40981625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:41.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.720+0000 7f40977fe640 1 --2- 172.21.15.172:0/1545733736 >> v2:172.21.15.186:3300/0 conn(0x7f409815dc90 0x7f40981625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.720+0000 7f40977fe640 1 -- 172.21.15.172:0/1545733736 >> v1:172.21.15.172:6789/0 conn(0x7f40980cc8e0 legacy=0x7f409815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.720+0000 7f40977fe640 1 -- 172.21.15.172:0/1545733736 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4098161dd0 con 0x7f40980d1810 2024-04-25T08:51:41.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.720+0000 7f4095ffb640 1 -- 172.21.15.172:0/1545733736 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387334522 0 0) 0x7f40980cce50 con 0x7f40980cc8e0 2024-04-25T08:51:41.712 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.720+0000 7f40977fe640 1 --2- 172.21.15.172:0/1545733736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 0x7f40980d1c80 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f409806b820 tx=0x7f409002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c892beb992076c59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.720+0000 7f4095ffb640 1 -- 172.21.15.172:0/1545733736 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090007740 con 0x7f40980d1810 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.720+0000 7f4095ffb640 1 -- 172.21.15.172:0/1545733736 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40900078e0 con 0x7f40980d1810 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.720+0000 7f4095ffb640 1 -- 172.21.15.172:0/1545733736 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090007cb0 con 0x7f40980d1810 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.721+0000 7f409d92b640 1 -- 172.21.15.172:0/1545733736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 msgr2=0x7f40980d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.721+0000 7f409d92b640 1 --2- 172.21.15.172:0/1545733736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 0x7f40980d1c80 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f409806b820 tx=0x7f409002a5f0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.721+0000 7f409d92b640 1 -- 172.21.15.172:0/1545733736 shutdown_connections 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.721+0000 7f409d92b640 1 --2- 172.21.15.172:0/1545733736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 0x7f40980d1c80 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.721+0000 7f409d92b640 1 --2- 172.21.15.172:0/1545733736 >> v2:172.21.15.186:3300/0 conn(0x7f409815dc90 0x7f40981625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.721+0000 7f409d92b640 1 -- 172.21.15.172:0/1545733736 >> 172.21.15.172:0/1545733736 conn(0x7f409806f590 msgr2=0x7f409806f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.721+0000 7f409d92b640 1 -- 172.21.15.172:0/1545733736 shutdown_connections 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.721+0000 7f409d92b640 1 -- 172.21.15.172:0/1545733736 wait complete. 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.722+0000 7f409d92b640 1 Processor -- start 2024-04-25T08:51:41.713 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.722+0000 7f409d92b640 1 -- start start 2024-04-25T08:51:41.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f409d92b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40980cc8e0 0x7f40981f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.715 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f409d92b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 0x7f40980c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f409d92b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f409815dc90 0x7f40980cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f409d92b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409815e070 con 0x7f40980d1810 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f409d92b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40980cd130 con 0x7f409815dc90 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f409d92b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409815e1f0 con 0x7f40980cc8e0 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f40967fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 0x7f40980c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f40967fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 0x7f40980c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40646/0 (socket says 172.21.15.172:40646) 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f40967fc640 1 -- 172.21.15.172:0/3999488816 learned_addr learned my addr 172.21.15.172:0/3999488816 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f40967fc640 1 -- 172.21.15.172:0/3999488816 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40980cc8e0 msgr2=0x7f40981f3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f4096ffd640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40980cc8e0 0x7f40981f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f40977fe640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f409815dc90 0x7f40980cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f40967fc640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40980cc8e0 0x7f40981f3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f40967fc640 1 -- 172.21.15.172:0/3999488816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f409815dc90 msgr2=0x7f40980cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f40967fc640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f409815dc90 0x7f40980cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.723+0000 7f40967fc640 1 -- 172.21.15.172:0/3999488816 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980c73c0 con 0x7f40980d1810 2024-04-25T08:51:41.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.724+0000 7f40967fc640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 0x7f40980c5390 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f408c00c500 tx=0x7f408c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:41.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.724+0000 7f407ffff640 1 -- 172.21.15.172:0/3999488816 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c018070 con 0x7f40980d1810 2024-04-25T08:51:41.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.724+0000 7f407ffff640 1 -- 172.21.15.172:0/3999488816 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c007580 con 0x7f40980d1810 2024-04-25T08:51:41.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.724+0000 7f407ffff640 1 -- 172.21.15.172:0/3999488816 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c004a20 con 0x7f40980d1810 2024-04-25T08:51:41.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.724+0000 7f409d92b640 1 -- 172.21.15.172:0/3999488816 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40980c76a0 con 0x7f40980d1810 2024-04-25T08:51:41.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.724+0000 7f409d92b640 1 -- 172.21.15.172:0/3999488816 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40980c7c60 con 0x7f40980d1810 2024-04-25T08:51:41.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.725+0000 7f409d92b640 1 -- 172.21.15.172:0/3999488816 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4098073990 con 0x7f40980d1810 2024-04-25T08:51:41.717 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.725+0000 7f407ffff640 1 -- 172.21.15.172:0/3999488816 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f408c01b070 con 0x7f40980d1810 2024-04-25T08:51:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.726+0000 7f407ffff640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 0x7f408406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.726+0000 7f407ffff640 1 -- 172.21.15.172:0/3999488816 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f408c089680 con 0x7f40980d1810 2024-04-25T08:51:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.726+0000 7f4096ffd640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 0x7f408406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.726+0000 7f4096ffd640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 0x7f408406d990 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4088006fd0 tx=0x7f4088008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:41.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.730+0000 7f407ffff640 1 -- 172.21.15.172:0/3999488816 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f408c0583b0 con 0x7f40980d1810 2024-04-25T08:51:41.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.936+0000 7f409d92b640 1 -- 172.21.15.172:0/3999488816 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40980cf6b0 con 0x7f40980d1810 2024-04-25T08:51:41.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.937+0000 7f407ffff640 1 -- 172.21.15.172:0/3999488816 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4155 (secure 0 0 0) 0x7f408c057cb0 con 0x7f40980d1810 2024-04-25T08:51:41.928 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:41.928 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:51:36.323687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9291":{"gid":9291,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:41.928 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 78 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 -- 172.21.15.172:0/3999488816 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 msgr2=0x7f408406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 0x7f408406d990 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4088006fd0 tx=0x7f4088008040 comp rx=0 tx=0).stop 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 -- 172.21.15.172:0/3999488816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 msgr2=0x7f40980c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 0x7f40980c5390 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f408c00c500 tx=0x7f408c00c9c0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 -- 172.21.15.172:0/3999488816 shutdown_connections 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f408406b4d0 0x7f408406d990 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f409815dc90 0x7f40980cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40980d1810 0x7f40980c5390 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 --2- 172.21.15.172:0/3999488816 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f40980cc8e0 0x7f40981f3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 -- 172.21.15.172:0/3999488816 >> 172.21.15.172:0/3999488816 conn(0x7f409806f590 msgr2=0x7f409806f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 -- 172.21.15.172:0/3999488816 shutdown_connections 2024-04-25T08:51:41.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:41.939+0000 7f409d92b640 1 -- 172.21.15.172:0/3999488816 wait complete. 2024-04-25T08:51:41.941 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-04-25T08:51:41.941 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:51:42.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.046+0000 7f4111f63640 1 Processor -- start 2024-04-25T08:51:42.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.046+0000 7f4111f63640 1 -- start start 2024-04-25T08:51:42.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.047+0000 7f4111f63640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f410c0b0b90 0x7f410c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.047+0000 7f4111f63640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c099a40 0x7f410c099ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.047+0000 7f4111f63640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0cc3c0 con 0x7f410c15f020 2024-04-25T08:51:42.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.047+0000 7f4111f63640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410c0cccb0 con 0x7f410c0b0b90 2024-04-25T08:51:42.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.047+0000 7f4111f63640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c15f400 con 0x7f410c099a40 2024-04-25T08:51:42.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.047+0000 7f410b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f410c15f020 0x7f410c0b10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42112/0 (socket says 172.21.15.172:42112) 2024-04-25T08:51:42.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.047+0000 7f410b7fe640 1 -- 172.21.15.172:0/2432203762 learned_addr learned my addr 172.21.15.172:0/2432203762 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:42.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432762263 0 0) 0x7f410c0cc3c0 con 0x7f410c15f020 2024-04-25T08:51:42.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410affd640 1 --2- 172.21.15.172:0/2432203762 >> v2:172.21.15.186:3300/0 conn(0x7f410c0b0b90 0x7f410c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410bfff640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c099a40 0x7f410c099ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f4003520 con 0x7f410c15f020 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2603067524 0 0) 0x7f40f4003520 con 0x7f410c15f020 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c099a40 msgr2=0x7f410c099ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c099a40 0x7f410c099ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 >> v2:172.21.15.186:3300/0 conn(0x7f410c0b0b90 msgr2=0x7f410c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 --2- 172.21.15.172:0/2432203762 >> v2:172.21.15.186:3300/0 conn(0x7f410c0b0b90 0x7f410c0cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c0d0550 con 0x7f410c15f020 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f40fc001670 con 0x7f410c15f020 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 >> v1:172.21.15.172:6789/0 conn(0x7f410c15f020 legacy=0x7f410c0b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f40039b0 0x7f40f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c099a40 0x7f40f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40f4004d40 0x7f40f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0cccb0 con 0x7f40f40039b0 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c15f400 con 0x7f40f4004d40 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f400b9c0 con 0x7f410c099a40 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410b7fe640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f40039b0 0x7f40f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410affd640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c099a40 0x7f40f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410bfff640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40f4004d40 0x7f40f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410b7fe640 1 -- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c099a40 msgr2=0x7f40f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410b7fe640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c099a40 0x7f40f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410b7fe640 1 -- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40f4004d40 msgr2=0x7f40f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410b7fe640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40f4004d40 0x7f40f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410b7fe640 1 -- 172.21.15.172:0/2432203762 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f4003520 con 0x7f40f40039b0 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.048+0000 7f410affd640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c099a40 0x7f40f4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.049+0000 7f410b7fe640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f40039b0 0x7f40f4003dd0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00c210 tx=0x7f40f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb92fb1d0f0a10a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.049+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc007d50 con 0x7f40f40039b0 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.049+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc005ad0 con 0x7f40f40039b0 2024-04-25T08:51:42.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.049+0000 7f410a7fc640 1 -- 172.21.15.172:0/2432203762 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc007070 con 0x7f40f40039b0 2024-04-25T08:51:42.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.050+0000 7f4111f63640 1 -- 172.21.15.172:0/2432203762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f40039b0 msgr2=0x7f40f4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.050+0000 7f4111f63640 1 --2- 172.21.15.172:0/2432203762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f40039b0 0x7f40f4003dd0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00c210 tx=0x7f40f4005830 comp rx=0 tx=0).stop 2024-04-25T08:51:42.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.050+0000 7f410bfff640 1 -- 172.21.15.172:0/2432203762 reap_dead start 2024-04-25T08:51:42.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.050+0000 7f4111f63640 1 -- 172.21.15.172:0/2432203762 shutdown_connections 2024-04-25T08:51:42.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.050+0000 7f4111f63640 1 -- 172.21.15.172:0/2432203762 >> 172.21.15.172:0/2432203762 conn(0x7f410c0b3310 msgr2=0x7f410c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:42.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.050+0000 7f4111f63640 1 -- 172.21.15.172:0/2432203762 shutdown_connections 2024-04-25T08:51:42.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.050+0000 7f4111f63640 1 -- 172.21.15.172:0/2432203762 wait complete. 2024-04-25T08:51:42.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.051+0000 7f4111f63640 1 Processor -- start 2024-04-25T08:51:42.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.051+0000 7f4111f63640 1 -- start start 2024-04-25T08:51:42.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f4111f63640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40f40039b0 0x7f410c158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f4111f63640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f410c0c9370 0x7f410c0c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f4111f63640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c0c76f0 0x7f410c0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f4111f63640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0cc940 con 0x7f410c0c9370 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f4111f63640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0cc660 con 0x7f40f40039b0 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f4111f63640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c099ed0 con 0x7f410c0c76f0 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f410c0c9370 0x7f410c0c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f410c0c9370 0x7f410c0c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40662/0 (socket says 172.21.15.172:40662) 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410affd640 1 -- 172.21.15.172:0/2389540623 learned_addr learned my addr 172.21.15.172:0/2389540623 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410b7fe640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40f40039b0 0x7f410c158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410bfff640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c0c76f0 0x7f410c0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410affd640 1 -- 172.21.15.172:0/2389540623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c0c76f0 msgr2=0x7f410c0c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410affd640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c0c76f0 0x7f410c0c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410affd640 1 -- 172.21.15.172:0/2389540623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40f40039b0 msgr2=0x7f410c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410affd640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40f40039b0 0x7f410c158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410affd640 1 -- 172.21.15.172:0/2389540623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c0ca0a0 con 0x7f410c0c9370 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410b7fe640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40f40039b0 0x7f410c158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410bfff640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c0c76f0 0x7f410c0c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f410affd640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f410c0c9370 0x7f410c0c97f0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f41000115d0 tx=0x7f4100011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.052+0000 7f40f3fff640 1 -- 172.21.15.172:0/2389540623 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410000f8f0 con 0x7f410c0c9370 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.053+0000 7f40f3fff640 1 -- 172.21.15.172:0/2389540623 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410000fa90 con 0x7f410c0c9370 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.053+0000 7f4111f63640 1 -- 172.21.15.172:0/2389540623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c0ca380 con 0x7f410c0c9370 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.053+0000 7f40f3fff640 1 -- 172.21.15.172:0/2389540623 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410000fe60 con 0x7f410c0c9370 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.053+0000 7f4111f63640 1 -- 172.21.15.172:0/2389540623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c0c5ad0 con 0x7f410c0c9370 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.053+0000 7f4111f63640 1 -- 172.21.15.172:0/2389540623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c073990 con 0x7f410c0c9370 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.054+0000 7f40f3fff640 1 -- 172.21.15.172:0/2389540623 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4100015460 con 0x7f410c0c9370 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.054+0000 7f40f3fff640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40f806b500 0x7f40f806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.054+0000 7f40f3fff640 1 -- 172.21.15.172:0/2389540623 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f410008ac20 con 0x7f410c0c9370 2024-04-25T08:51:42.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.054+0000 7f410b7fe640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40f806b500 0x7f40f806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.055+0000 7f410b7fe640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40f806b500 0x7f40f806d9c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f40fc033000 tx=0x7f40fc009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:42.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.058+0000 7f40f3fff640 1 -- 172.21.15.172:0/2389540623 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4100019030 con 0x7f410c0c9370 2024-04-25T08:51:42.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.303+0000 7f4111f63640 1 -- 172.21.15.172:0/2389540623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f410c0b77a0 con 0x7f410c0c9370 2024-04-25T08:51:42.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.303+0000 7f40f3fff640 1 -- 172.21.15.172:0/2389540623 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1467 (secure 0 0 0) 0x7f41000598c0 con 0x7f410c0c9370 2024-04-25T08:51:42.294 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:42.294 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":577,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":132,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1049,"data_bytes":1077245845,"bytes_used":2576568320,"bytes_avail":770517544960,"bytes_total":773094113280,"read_bytes_sec":233315,"write_bytes_sec":75860,"read_op_per_sec":3,"write_op_per_sec":16},"fsmap":{"epoch":78,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":9291}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-04-25T08:51:34.624927+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T08:51:42.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 -- 172.21.15.172:0/2389540623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40f806b500 msgr2=0x7f40f806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40f806b500 0x7f40f806d9c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f40fc033000 tx=0x7f40fc009030 comp rx=0 tx=0).stop 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 -- 172.21.15.172:0/2389540623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f410c0c9370 msgr2=0x7f410c0c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f410c0c9370 0x7f410c0c97f0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f41000115d0 tx=0x7f4100011a90 comp rx=0 tx=0).stop 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 -- 172.21.15.172:0/2389540623 shutdown_connections 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f40f806b500 0x7f40f806d9c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f410c0c76f0 0x7f410c0c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f410c0c9370 0x7f410c0c97f0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 --2- 172.21.15.172:0/2389540623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f40f40039b0 0x7f410c158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 -- 172.21.15.172:0/2389540623 >> 172.21.15.172:0/2389540623 conn(0x7f410c0b3310 msgr2=0x7f410c070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 -- 172.21.15.172:0/2389540623 shutdown_connections 2024-04-25T08:51:42.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.306+0000 7f4111f63640 1 -- 172.21.15.172:0/2389540623 wait complete. 2024-04-25T08:51:42.307 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-04-25T08:51:42.308 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:51:42.308 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:51:42.352 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:51:42.395 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:51:42.395 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:51:42.395 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:51:42.410 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:51:42.410 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:51:42.465 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:51:42.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.611+0000 7ff8e70cb640 1 Processor -- start 2024-04-25T08:51:42.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.611+0000 7ff8e70cb640 1 -- start start 2024-04-25T08:51:42.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.612+0000 7ff8e70cb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015ba00 0x7ff8e009a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.612+0000 7ff8e70cb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff8e015f5f0 0x7ff8e015faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.612+0000 7ff8e70cb640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e00cd710 con 0x7ff8e01602e0 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.612+0000 7ff8e70cb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e00cd4b0 con 0x7ff8e015f5f0 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.612+0000 7ff8e70cb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e0099b70 con 0x7ff8e015ba00 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.613+0000 7ff8e4e67640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015ba00 0x7ff8e009a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.613+0000 7ff8e4e67640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015ba00 0x7ff8e009a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:39522/0 (socket says 172.21.15.172:39522) 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.613+0000 7ff8e4e67640 1 -- 172.21.15.172:0/956466513 learned_addr learned my addr 172.21.15.172:0/956466513 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.613+0000 7ff8e5668640 1 --2- 172.21.15.172:0/956466513 >> v2:172.21.15.186:3300/0 conn(0x7ff8e015f5f0 0x7ff8e015faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.613+0000 7ff8e4e67640 1 -- 172.21.15.172:0/956466513 >> v2:172.21.15.186:3300/0 conn(0x7ff8e015f5f0 msgr2=0x7ff8e015faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.613+0000 7ff8e4e67640 1 --2- 172.21.15.172:0/956466513 >> v2:172.21.15.186:3300/0 conn(0x7ff8e015f5f0 0x7ff8e015faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.613+0000 7ff8e4e67640 1 -- 172.21.15.172:0/956466513 >> v1:172.21.15.186:6789/0 conn(0x7ff8e01602e0 legacy=0x7ff8e00ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.613+0000 7ff8e4e67640 1 -- 172.21.15.172:0/956466513 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e0099e50 con 0x7ff8e015ba00 2024-04-25T08:51:42.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.613+0000 7ff8e5668640 1 --2- 172.21.15.172:0/956466513 >> v2:172.21.15.186:3300/0 conn(0x7ff8e015f5f0 0x7ff8e015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8e4e67640 1 --2- 172.21.15.172:0/956466513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015ba00 0x7ff8e009a930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009870 tx=0x7ff8d002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b46e291a86e91d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8df7fe640 1 -- 172.21.15.172:0/956466513 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0037070 con 0x7ff8e015ba00 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8df7fe640 1 -- 172.21.15.172:0/956466513 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d0032440 con 0x7ff8e015ba00 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8df7fe640 1 -- 172.21.15.172:0/956466513 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0032810 con 0x7ff8e015ba00 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8e70cb640 1 -- 172.21.15.172:0/956466513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015ba00 msgr2=0x7ff8e009a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8e70cb640 1 --2- 172.21.15.172:0/956466513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015ba00 0x7ff8e009a930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009870 tx=0x7ff8d002a130 comp rx=0 tx=0).stop 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8e70cb640 1 -- 172.21.15.172:0/956466513 shutdown_connections 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8e70cb640 1 --2- 172.21.15.172:0/956466513 >> v2:172.21.15.186:3300/0 conn(0x7ff8e015f5f0 0x7ff8e015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8e70cb640 1 --2- 172.21.15.172:0/956466513 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015ba00 0x7ff8e009a930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8e70cb640 1 -- 172.21.15.172:0/956466513 >> 172.21.15.172:0/956466513 conn(0x7ff8e00b3270 msgr2=0x7ff8e00b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8e70cb640 1 -- 172.21.15.172:0/956466513 shutdown_connections 2024-04-25T08:51:42.606 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.614+0000 7ff8e70cb640 1 -- 172.21.15.172:0/956466513 wait complete. 2024-04-25T08:51:42.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.616+0000 7ff8e70cb640 1 Processor -- start 2024-04-25T08:51:42.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.616+0000 7ff8e70cb640 1 -- start start 2024-04-25T08:51:42.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.616+0000 7ff8e70cb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8e015ba00 0x7ff8e01588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.616+0000 7ff8e70cb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015f5f0 0x7ff8e00b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e70cb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8e01602e0 0x7ff8e00ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e70cb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e015bde0 con 0x7ff8e015ba00 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e70cb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e009ae70 con 0x7ff8e01602e0 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e70cb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e01f2420 con 0x7ff8e015f5f0 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e4e67640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8e015ba00 0x7ff8e01588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e4e67640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8e015ba00 0x7ff8e01588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40678/0 (socket says 172.21.15.172:40678) 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e4e67640 1 -- 172.21.15.172:0/457229970 learned_addr learned my addr 172.21.15.172:0/457229970 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e5668640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8e01602e0 0x7ff8e00ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8dffff640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015f5f0 0x7ff8e00b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e4e67640 1 -- 172.21.15.172:0/457229970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015f5f0 msgr2=0x7ff8e00b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e4e67640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015f5f0 0x7ff8e00b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e4e67640 1 -- 172.21.15.172:0/457229970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8e01602e0 msgr2=0x7ff8e00ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e4e67640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8e01602e0 0x7ff8e00ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e4e67640 1 -- 172.21.15.172:0/457229970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e01f2700 con 0x7ff8e015ba00 2024-04-25T08:51:42.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e4e67640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8e015ba00 0x7ff8e01588d0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0000c00 tx=0x7ff8d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:42.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8dd7fa640 1 -- 172.21.15.172:0/457229970 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0037040 con 0x7ff8e015ba00 2024-04-25T08:51:42.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8dd7fa640 1 -- 172.21.15.172:0/457229970 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d0042070 con 0x7ff8e015ba00 2024-04-25T08:51:42.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e70cb640 1 -- 172.21.15.172:0/457229970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e01f29e0 con 0x7ff8e015ba00 2024-04-25T08:51:42.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8dd7fa640 1 -- 172.21.15.172:0/457229970 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0030880 con 0x7ff8e015ba00 2024-04-25T08:51:42.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.617+0000 7ff8e70cb640 1 -- 172.21.15.172:0/457229970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e01f2fa0 con 0x7ff8e015ba00 2024-04-25T08:51:42.610 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.618+0000 7ff8e70cb640 1 -- 172.21.15.172:0/457229970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e0158ed0 con 0x7ff8e015ba00 2024-04-25T08:51:42.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.619+0000 7ff8dd7fa640 1 -- 172.21.15.172:0/457229970 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff8d0030a20 con 0x7ff8e015ba00 2024-04-25T08:51:42.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.619+0000 7ff8dd7fa640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8cc06b4d0 0x7ff8cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.619+0000 7ff8dffff640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8cc06b4d0 0x7ff8cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.619+0000 7ff8dd7fa640 1 -- 172.21.15.172:0/457229970 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff8d00aaaf0 con 0x7ff8e015ba00 2024-04-25T08:51:42.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.620+0000 7ff8dffff640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8cc06b4d0 0x7ff8cc06d990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00cba50 tx=0x7ff8d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:42.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.624+0000 7ff8dd7fa640 1 -- 172.21.15.172:0/457229970 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff8d0079820 con 0x7ff8e015ba00 2024-04-25T08:51:42.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.799+0000 7ff8e70cb640 1 -- 172.21.15.172:0/457229970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8e0073990 con 0x7ff8e015ba00 2024-04-25T08:51:42.790 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.800+0000 7ff8dd7fa640 1 -- 172.21.15.172:0/457229970 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+17091 (secure 0 0 0) 0x7ff8d0079120 con 0x7ff8e015ba00 2024-04-25T08:51:42.790 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:42.790 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":132,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:51:34.301519+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:50.627461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:51.373323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6837/3347790695":"2024-04-26T08:51:34.301451+0000","172.21.15.172:6836/3347790695":"2024-04-26T08:51:34.301451+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:51:42.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 -- 172.21.15.172:0/457229970 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8cc06b4d0 msgr2=0x7ff8cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8cc06b4d0 0x7ff8cc06d990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00cba50 tx=0x7ff8d4009040 comp rx=0 tx=0).stop 2024-04-25T08:51:42.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 -- 172.21.15.172:0/457229970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8e015ba00 msgr2=0x7ff8e01588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8e015ba00 0x7ff8e01588d0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0000c00 tx=0x7ff8d00046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 -- 172.21.15.172:0/457229970 shutdown_connections 2024-04-25T08:51:42.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff8cc06b4d0 0x7ff8cc06d990 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8e01602e0 0x7ff8e00ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8e015f5f0 0x7ff8e00b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 --2- 172.21.15.172:0/457229970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8e015ba00 0x7ff8e01588d0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 -- 172.21.15.172:0/457229970 >> 172.21.15.172:0/457229970 conn(0x7ff8e00b3270 msgr2=0x7ff8e00cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:42.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 -- 172.21.15.172:0/457229970 shutdown_connections 2024-04-25T08:51:42.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.802+0000 7ff8e70cb640 1 -- 172.21.15.172:0/457229970 wait complete. 2024-04-25T08:51:42.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:50:50.627461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:50:51.373323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:51:42.804 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:51:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.913+0000 7f984484a640 1 Processor -- start 2024-04-25T08:51:42.903 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.913+0000 7f984484a640 1 -- start start 2024-04-25T08:51:42.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f984484a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f98400cc4f0 0x7f98400cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f984484a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f98400cdb20 0x7f98400cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f984484a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9840072280 con 0x7f984015b270 2024-04-25T08:51:42.905 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f984484a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9840071270 con 0x7f98400cc4f0 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f984484a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984015bd80 con 0x7f98400cdb20 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f983e59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f98400cc4f0 0x7f98400cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f983ed9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f984015b270 0x7f984015b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42120/0 (socket says 172.21.15.172:42120) 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f983ed9d640 1 -- 172.21.15.172:0/3629410767 learned_addr learned my addr 172.21.15.172:0/3629410767 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f983dd9b640 1 --2- 172.21.15.172:0/3629410767 >> v2:172.21.15.186:3300/0 conn(0x7f98400cdb20 0x7f98400cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f983e59c640 1 -- 172.21.15.172:0/3629410767 >> v2:172.21.15.186:3300/0 conn(0x7f98400cdb20 msgr2=0x7f98400cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f983e59c640 1 --2- 172.21.15.172:0/3629410767 >> v2:172.21.15.186:3300/0 conn(0x7f98400cdb20 0x7f98400cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f983e59c640 1 -- 172.21.15.172:0/3629410767 >> v1:172.21.15.172:6789/0 conn(0x7f984015b270 legacy=0x7f984015b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f983e59c640 1 -- 172.21.15.172:0/3629410767 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98400714c0 con 0x7f98400cc4f0 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f983d59a640 1 -- 172.21.15.172:0/3629410767 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511850905 0 0) 0x7f9840072280 con 0x7f984015b270 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.914+0000 7f983dd9b640 1 --2- 172.21.15.172:0/3629410767 >> v2:172.21.15.186:3300/0 conn(0x7f98400cdb20 0x7f98400cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.915+0000 7f983e59c640 1 --2- 172.21.15.172:0/3629410767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98400cc4f0 0x7f98400cc8d0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f9840158aa0 tx=0x7f983002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8341c2e69a8c97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:42.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.915+0000 7f983d59a640 1 -- 172.21.15.172:0/3629410767 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9830032790 con 0x7f98400cc4f0 2024-04-25T08:51:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.915+0000 7f983d59a640 1 -- 172.21.15.172:0/3629410767 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9830038070 con 0x7f98400cc4f0 2024-04-25T08:51:42.907 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.915+0000 7f983d59a640 1 -- 172.21.15.172:0/3629410767 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9830032b50 con 0x7f98400cc4f0 2024-04-25T08:51:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.916+0000 7f984484a640 1 -- 172.21.15.172:0/3629410767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98400cc4f0 msgr2=0x7f98400cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.916+0000 7f984484a640 1 --2- 172.21.15.172:0/3629410767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98400cc4f0 0x7f98400cc8d0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f9840158aa0 tx=0x7f983002c890 comp rx=0 tx=0).stop 2024-04-25T08:51:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.916+0000 7f984484a640 1 -- 172.21.15.172:0/3629410767 shutdown_connections 2024-04-25T08:51:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.916+0000 7f984484a640 1 --2- 172.21.15.172:0/3629410767 >> v2:172.21.15.186:3300/0 conn(0x7f98400cdb20 0x7f98400cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.916+0000 7f984484a640 1 --2- 172.21.15.172:0/3629410767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98400cc4f0 0x7f98400cc8d0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.916+0000 7f984484a640 1 -- 172.21.15.172:0/3629410767 >> 172.21.15.172:0/3629410767 conn(0x7f984006abe0 msgr2=0x7f984006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.916+0000 7f984484a640 1 -- 172.21.15.172:0/3629410767 shutdown_connections 2024-04-25T08:51:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.916+0000 7f984484a640 1 -- 172.21.15.172:0/3629410767 wait complete. 2024-04-25T08:51:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.917+0000 7f984484a640 1 Processor -- start 2024-04-25T08:51:42.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.917+0000 7f984484a640 1 -- start start 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f984484a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98400cc4f0 0x7f984014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f984484a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98400cdb20 0x7f984014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f984484a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f984015b270 0x7f9840150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f984484a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9840071d60 con 0x7f984015b270 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f984484a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9840071a80 con 0x7f98400cdb20 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f984484a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98400ae500 con 0x7f98400cc4f0 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f983ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f984015b270 0x7f9840150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f983ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f984015b270 0x7f9840150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40694/0 (socket says 172.21.15.172:40694) 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f983ed9d640 1 -- 172.21.15.172:0/1000613629 learned_addr learned my addr 172.21.15.172:0/1000613629 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f983e59c640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98400cc4f0 0x7f984014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f983dd9b640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98400cdb20 0x7f984014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f983ed9d640 1 -- 172.21.15.172:0/1000613629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98400cc4f0 msgr2=0x7f984014f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f983ed9d640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98400cc4f0 0x7f984014f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f983ed9d640 1 -- 172.21.15.172:0/1000613629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98400cdb20 msgr2=0x7f984014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f983ed9d640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98400cdb20 0x7f984014fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.918+0000 7f983ed9d640 1 -- 172.21.15.172:0/1000613629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98401f45f0 con 0x7f984015b270 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.919+0000 7f983ed9d640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f984015b270 0x7f9840150230 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f983800c450 tx=0x7f983800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.919+0000 7f982effd640 1 -- 172.21.15.172:0/1000613629 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838018070 con 0x7f984015b270 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.919+0000 7f982effd640 1 -- 172.21.15.172:0/1000613629 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9838007500 con 0x7f984015b270 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.919+0000 7f984484a640 1 -- 172.21.15.172:0/1000613629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98401f48b0 con 0x7f984015b270 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.919+0000 7f982effd640 1 -- 172.21.15.172:0/1000613629 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838004a20 con 0x7f984015b270 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.919+0000 7f984484a640 1 -- 172.21.15.172:0/1000613629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98401f4e70 con 0x7f984015b270 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.920+0000 7f984484a640 1 -- 172.21.15.172:0/1000613629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9840073a00 con 0x7f984015b270 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.920+0000 7f982effd640 1 -- 172.21.15.172:0/1000613629 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9838004bc0 con 0x7f984015b270 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.921+0000 7f982effd640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f982006b4d0 0x7f982006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:42.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.921+0000 7f982effd640 1 -- 172.21.15.172:0/1000613629 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9838089510 con 0x7f984015b270 2024-04-25T08:51:42.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.921+0000 7f983e59c640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f982006b4d0 0x7f982006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:42.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.921+0000 7f983e59c640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f982006b4d0 0x7f982006d990 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9830037000 tx=0x7f9830032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:42.915 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:42.925+0000 7f982effd640 1 -- 172.21.15.172:0/1000613629 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9838057b70 con 0x7f984015b270 2024-04-25T08:51:43.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.110+0000 7f984484a640 1 -- 172.21.15.172:0/1000613629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98400cbc20 con 0x7f984015b270 2024-04-25T08:51:43.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.111+0000 7f982effd640 1 -- 172.21.15.172:0/1000613629 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7f983805bc10 con 0x7f984015b270 2024-04-25T08:51:43.102 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:51:43.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 -- 172.21.15.172:0/1000613629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f982006b4d0 msgr2=0x7f982006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f982006b4d0 0x7f982006d990 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9830037000 tx=0x7f9830032000 comp rx=0 tx=0).stop 2024-04-25T08:51:43.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 -- 172.21.15.172:0/1000613629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f984015b270 msgr2=0x7f9840150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f984015b270 0x7f9840150230 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f983800c450 tx=0x7f983800c910 comp rx=0 tx=0).stop 2024-04-25T08:51:43.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 -- 172.21.15.172:0/1000613629 shutdown_connections 2024-04-25T08:51:43.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f982006b4d0 0x7f982006d990 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f98400cdb20 0x7f984014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f984015b270 0x7f9840150230 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 --2- 172.21.15.172:0/1000613629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f98400cc4f0 0x7f984014f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 -- 172.21.15.172:0/1000613629 >> 172.21.15.172:0/1000613629 conn(0x7f984006abe0 msgr2=0x7f9840151370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:43.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 -- 172.21.15.172:0/1000613629 shutdown_connections 2024-04-25T08:51:43.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.113+0000 7f984484a640 1 -- 172.21.15.172:0/1000613629 wait complete. 2024-04-25T08:51:43.114 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:51:43.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.223+0000 7f4b8cadd640 1 Processor -- start 2024-04-25T08:51:43.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.223+0000 7f4b8cadd640 1 -- start start 2024-04-25T08:51:43.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.223+0000 7f4b8cadd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4b8806e360 0x7f4b8806e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b8cadd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b8806ec80 0x7f4b880b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b8cadd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b880b3e10 0x7f4b8806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b8cadd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8806b890 con 0x7f4b8806ec80 2024-04-25T08:51:43.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b8cadd640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8815e020 con 0x7f4b8806e360 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b8cadd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8806ac80 con 0x7f4b880b3e10 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b7ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b8806ec80 0x7f4b880b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b7ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b8806ec80 0x7f4b880b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40710/0 (socket says 172.21.15.172:40710) 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b7ffff640 1 -- 172.21.15.172:0/2210608728 learned_addr learned my addr 172.21.15.172:0/2210608728 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b86d9d640 1 --2- 172.21.15.172:0/2210608728 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b880b3e10 0x7f4b8806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b8659c640 1 --2- 172.21.15.172:0/2210608728 >> v2:172.21.15.186:3300/0 conn(0x7f4b8806e360 0x7f4b8806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b7ffff640 1 -- 172.21.15.172:0/2210608728 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b880b3e10 msgr2=0x7f4b8806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b7ffff640 1 --2- 172.21.15.172:0/2210608728 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b880b3e10 0x7f4b8806bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b7ffff640 1 -- 172.21.15.172:0/2210608728 >> v2:172.21.15.186:3300/0 conn(0x7f4b8806e360 msgr2=0x7f4b8806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b7ffff640 1 --2- 172.21.15.172:0/2210608728 >> v2:172.21.15.186:3300/0 conn(0x7f4b8806e360 0x7f4b8806e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b7ffff640 1 -- 172.21.15.172:0/2210608728 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8806af60 con 0x7f4b8806ec80 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b86d9d640 1 --2- 172.21.15.172:0/2210608728 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b880b3e10 0x7f4b8806bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.224+0000 7f4b8659c640 1 --2- 172.21.15.172:0/2210608728 >> v2:172.21.15.186:3300/0 conn(0x7f4b8806e360 0x7f4b8806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:43.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b7ffff640 1 --2- 172.21.15.172:0/2210608728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8806ec80 0x7f4b880b38d0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f4b88072e90 tx=0x7f4b7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b228e74c6e31c58d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:43.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b85d9b640 1 -- 172.21.15.172:0/2210608728 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70037070 con 0x7f4b8806ec80 2024-04-25T08:51:43.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b85d9b640 1 -- 172.21.15.172:0/2210608728 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b70032440 con 0x7f4b8806ec80 2024-04-25T08:51:43.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b85d9b640 1 -- 172.21.15.172:0/2210608728 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70032810 con 0x7f4b8806ec80 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b8cadd640 1 -- 172.21.15.172:0/2210608728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8806ec80 msgr2=0x7f4b880b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b8cadd640 1 --2- 172.21.15.172:0/2210608728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8806ec80 0x7f4b880b38d0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f4b88072e90 tx=0x7f4b7002a270 comp rx=0 tx=0).stop 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b8cadd640 1 -- 172.21.15.172:0/2210608728 shutdown_connections 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b8cadd640 1 --2- 172.21.15.172:0/2210608728 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b880b3e10 0x7f4b8806bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b8cadd640 1 --2- 172.21.15.172:0/2210608728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8806ec80 0x7f4b880b38d0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b8cadd640 1 --2- 172.21.15.172:0/2210608728 >> v2:172.21.15.186:3300/0 conn(0x7f4b8806e360 0x7f4b8806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.225+0000 7f4b8cadd640 1 -- 172.21.15.172:0/2210608728 >> 172.21.15.172:0/2210608728 conn(0x7f4b880cfec0 msgr2=0x7f4b880d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.226+0000 7f4b8cadd640 1 -- 172.21.15.172:0/2210608728 shutdown_connections 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.226+0000 7f4b8cadd640 1 -- 172.21.15.172:0/2210608728 wait complete. 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.227+0000 7f4b8cadd640 1 Processor -- start 2024-04-25T08:51:43.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.227+0000 7f4b8cadd640 1 -- start start 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.227+0000 7f4b8cadd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8806e360 0x7f4b881452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b8cadd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b8806ec80 0x7f4b88158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b8cadd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b880b3e10 0x7f4b88158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b8cadd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880b2fd0 con 0x7f4b880b3e10 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b8cadd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8806b520 con 0x7f4b8806e360 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b8cadd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880b3150 con 0x7f4b8806ec80 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b86d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b880b3e10 0x7f4b88158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b86d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b880b3e10 0x7f4b88158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40724/0 (socket says 172.21.15.172:40724) 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b86d9d640 1 -- 172.21.15.172:0/3460754400 learned_addr learned my addr 172.21.15.172:0/3460754400 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b7ffff640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b8806ec80 0x7f4b88158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b8659c640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8806e360 0x7f4b881452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b86d9d640 1 -- 172.21.15.172:0/3460754400 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b8806ec80 msgr2=0x7f4b88158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b86d9d640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b8806ec80 0x7f4b88158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b86d9d640 1 -- 172.21.15.172:0/3460754400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8806e360 msgr2=0x7f4b881452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b86d9d640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8806e360 0x7f4b881452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b86d9d640 1 -- 172.21.15.172:0/3460754400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b881457f0 con 0x7f4b880b3e10 2024-04-25T08:51:43.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b86d9d640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b880b3e10 0x7f4b88158bd0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000cd50 tx=0x7f4b8000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:43.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b7effd640 1 -- 172.21.15.172:0/3460754400 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000f680 con 0x7f4b880b3e10 2024-04-25T08:51:43.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b7effd640 1 -- 172.21.15.172:0/3460754400 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8000f840 con 0x7f4b880b3e10 2024-04-25T08:51:43.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b8cadd640 1 -- 172.21.15.172:0/3460754400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b88152f10 con 0x7f4b880b3e10 2024-04-25T08:51:43.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b7effd640 1 -- 172.21.15.172:0/3460754400 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000fc30 con 0x7f4b880b3e10 2024-04-25T08:51:43.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.228+0000 7f4b8cadd640 1 -- 172.21.15.172:0/3460754400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b880af4c0 con 0x7f4b880b3e10 2024-04-25T08:51:43.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.229+0000 7f4b8cadd640 1 -- 172.21.15.172:0/3460754400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b880b6100 con 0x7f4b880b3e10 2024-04-25T08:51:43.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.230+0000 7f4b7effd640 1 -- 172.21.15.172:0/3460754400 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4b800213f0 con 0x7f4b880b3e10 2024-04-25T08:51:43.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.230+0000 7f4b7effd640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4b6806b4d0 0x7f4b6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.230+0000 7f4b7effd640 1 -- 172.21.15.172:0/3460754400 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4b8008b1b0 con 0x7f4b880b3e10 2024-04-25T08:51:43.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.230+0000 7f4b8659c640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4b6806b4d0 0x7f4b6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.231+0000 7f4b8659c640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4b6806b4d0 0x7f4b6806d990 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4b78006b10 tx=0x7f4b78008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:43.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.234+0000 7f4b7effd640 1 -- 172.21.15.172:0/3460754400 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4b880b6100 con 0x7f4b880b3e10 2024-04-25T08:51:43.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.405+0000 7f4b8cadd640 1 -- 172.21.15.172:0/3460754400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b88073a00 con 0x7f4b880b3e10 2024-04-25T08:51:43.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.405+0000 7f4b7effd640 1 -- 172.21.15.172:0/3460754400 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b80014030 con 0x7f4b880b3e10 2024-04-25T08:51:43.396 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:51:43.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.407+0000 7f4b8cadd640 1 -- 172.21.15.172:0/3460754400 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4b6806b4d0 msgr2=0x7f4b6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.407+0000 7f4b8cadd640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4b6806b4d0 0x7f4b6806d990 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4b78006b10 tx=0x7f4b78008040 comp rx=0 tx=0).stop 2024-04-25T08:51:43.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.407+0000 7f4b8cadd640 1 -- 172.21.15.172:0/3460754400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b880b3e10 msgr2=0x7f4b88158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.407+0000 7f4b8cadd640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b880b3e10 0x7f4b88158bd0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000cd50 tx=0x7f4b8000a650 comp rx=0 tx=0).stop 2024-04-25T08:51:43.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.407+0000 7f4b8cadd640 1 -- 172.21.15.172:0/3460754400 shutdown_connections 2024-04-25T08:51:43.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.407+0000 7f4b8cadd640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f4b6806b4d0 0x7f4b6806d990 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.407+0000 7f4b8cadd640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b880b3e10 0x7f4b88158bd0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.407+0000 7f4b8cadd640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b8806ec80 0x7f4b88158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.407+0000 7f4b8cadd640 1 --2- 172.21.15.172:0/3460754400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b8806e360 0x7f4b881452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.407+0000 7f4b8cadd640 1 -- 172.21.15.172:0/3460754400 >> 172.21.15.172:0/3460754400 conn(0x7f4b880cfec0 msgr2=0x7f4b880cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:43.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.408+0000 7f4b8cadd640 1 -- 172.21.15.172:0/3460754400 shutdown_connections 2024-04-25T08:51:43.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.408+0000 7f4b8cadd640 1 -- 172.21.15.172:0/3460754400 wait complete. 2024-04-25T08:51:43.409 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:51:43.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.518+0000 7f87ea54c640 1 Processor -- start 2024-04-25T08:51:43.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.518+0000 7f87ea54c640 1 -- start start 2024-04-25T08:51:43.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.519+0000 7f87ea54c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f87e415a9f0 0x7f87e40c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.519+0000 7f87ea54c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e40cd6f0 0x7f87e40cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.519+0000 7f87ea54c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e40c6940 con 0x7f87e40cdbf0 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.519+0000 7f87ea54c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e40b0020 con 0x7f87e415a9f0 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.519+0000 7f87ea54c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40cb5a0 con 0x7f87e40cd6f0 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.519+0000 7f87e8ae9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e40cd6f0 0x7f87e40cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.519+0000 7f87e3fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f87e415a9f0 0x7f87e40c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.519+0000 7f87e8ae9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e40cd6f0 0x7f87e40cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:39566/0 (socket says 172.21.15.172:39566) 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.519+0000 7f87e8ae9640 1 -- 172.21.15.172:0/3345067183 learned_addr learned my addr 172.21.15.172:0/3345067183 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.520+0000 7f87e2ffd640 1 -- 172.21.15.172:0/3345067183 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783232015 0 0) 0x7f87d8001110 con 0x7f87e40cdbf0 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.520+0000 7f87e2ffd640 1 -- 172.21.15.172:0/3345067183 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87cc003520 con 0x7f87e40cdbf0 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.520+0000 7f87e8ae9640 1 -- 172.21.15.172:0/3345067183 >> v2:172.21.15.186:3300/0 conn(0x7f87e415a9f0 msgr2=0x7f87e40c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.520+0000 7f87e8ae9640 1 --2- 172.21.15.172:0/3345067183 >> v2:172.21.15.186:3300/0 conn(0x7f87e415a9f0 0x7f87e40c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.520+0000 7f87e8ae9640 1 -- 172.21.15.172:0/3345067183 >> v1:172.21.15.186:6789/0 conn(0x7f87e40cdbf0 legacy=0x7f87e40ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.520+0000 7f87e8ae9640 1 -- 172.21.15.172:0/3345067183 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e415add0 con 0x7f87e40cd6f0 2024-04-25T08:51:43.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.520+0000 7f87e3fff640 1 --2- 172.21.15.172:0/3345067183 >> v2:172.21.15.186:3300/0 conn(0x7f87e415a9f0 0x7f87e40c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87e8ae9640 1 --2- 172.21.15.172:0/3345067183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e40cd6f0 0x7f87e40cba30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009e50 tx=0x7f87dc02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a81ca1a73f14e2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87e2ffd640 1 -- 172.21.15.172:0/3345067183 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc036070 con 0x7f87e40cd6f0 2024-04-25T08:51:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87e2ffd640 1 -- 172.21.15.172:0/3345067183 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc031600 con 0x7f87e40cd6f0 2024-04-25T08:51:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87e2ffd640 1 -- 172.21.15.172:0/3345067183 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0319b0 con 0x7f87e40cd6f0 2024-04-25T08:51:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87ea54c640 1 -- 172.21.15.172:0/3345067183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e40cd6f0 msgr2=0x7f87e40cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87ea54c640 1 --2- 172.21.15.172:0/3345067183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e40cd6f0 0x7f87e40cba30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009e50 tx=0x7f87dc02a710 comp rx=0 tx=0).stop 2024-04-25T08:51:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87ea54c640 1 -- 172.21.15.172:0/3345067183 shutdown_connections 2024-04-25T08:51:43.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87ea54c640 1 --2- 172.21.15.172:0/3345067183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e40cd6f0 0x7f87e40cba30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87ea54c640 1 --2- 172.21.15.172:0/3345067183 >> v2:172.21.15.186:3300/0 conn(0x7f87e415a9f0 0x7f87e40c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87ea54c640 1 -- 172.21.15.172:0/3345067183 >> 172.21.15.172:0/3345067183 conn(0x7f87e40b2390 msgr2=0x7f87e40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87ea54c640 1 -- 172.21.15.172:0/3345067183 shutdown_connections 2024-04-25T08:51:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.521+0000 7f87ea54c640 1 -- 172.21.15.172:0/3345067183 wait complete. 2024-04-25T08:51:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.522+0000 7f87ea54c640 1 Processor -- start 2024-04-25T08:51:43.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.523+0000 7f87ea54c640 1 -- start start 2024-04-25T08:51:43.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.523+0000 7f87ea54c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87e40cd6f0 0x7f87e4151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.523+0000 7f87ea54c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87e40cdbf0 0x7f87e40ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.523+0000 7f87ea54c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e415a9f0 0x7f87e41486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.523+0000 7f87ea54c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40cb230 con 0x7f87e40cd6f0 2024-04-25T08:51:43.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.523+0000 7f87ea54c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40caf50 con 0x7f87e40cdbf0 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.523+0000 7f87ea54c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40ce070 con 0x7f87e415a9f0 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87e40cd6f0 0x7f87e4151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87e40cd6f0 0x7f87e4151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40730/0 (socket says 172.21.15.172:40730) 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e3fff640 1 -- 172.21.15.172:0/661277234 learned_addr learned my addr 172.21.15.172:0/661277234 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e8ae9640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e415a9f0 0x7f87e41486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e37fe640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87e40cdbf0 0x7f87e40ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e3fff640 1 -- 172.21.15.172:0/661277234 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e415a9f0 msgr2=0x7f87e41486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e3fff640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e415a9f0 0x7f87e41486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e3fff640 1 -- 172.21.15.172:0/661277234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87e40cdbf0 msgr2=0x7f87e40ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e3fff640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87e40cdbf0 0x7f87e40ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e3fff640 1 -- 172.21.15.172:0/661277234 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e40c9010 con 0x7f87e40cd6f0 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e3fff640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87e40cd6f0 0x7f87e4151c30 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f87d400e960 tx=0x7f87d400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:43.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e0ff9640 1 -- 172.21.15.172:0/661277234 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4017070 con 0x7f87e40cd6f0 2024-04-25T08:51:43.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e0ff9640 1 -- 172.21.15.172:0/661277234 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400ca00 con 0x7f87e40cd6f0 2024-04-25T08:51:43.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87ea54c640 1 -- 172.21.15.172:0/661277234 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e40c92f0 con 0x7f87e40cd6f0 2024-04-25T08:51:43.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87e0ff9640 1 -- 172.21.15.172:0/661277234 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400cdd0 con 0x7f87e40cd6f0 2024-04-25T08:51:43.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.524+0000 7f87ea54c640 1 -- 172.21.15.172:0/661277234 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e40c98b0 con 0x7f87e40cd6f0 2024-04-25T08:51:43.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.525+0000 7f87ea54c640 1 -- 172.21.15.172:0/661277234 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e406cc80 con 0x7f87e40cd6f0 2024-04-25T08:51:43.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.526+0000 7f87e0ff9640 1 -- 172.21.15.172:0/661277234 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f87d401a070 con 0x7f87e40cd6f0 2024-04-25T08:51:43.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.526+0000 7f87e0ff9640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f87d006b4d0 0x7f87d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.526+0000 7f87e0ff9640 1 -- 172.21.15.172:0/661277234 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f87d408a640 con 0x7f87e40cd6f0 2024-04-25T08:51:43.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.526+0000 7f87e37fe640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f87d006b4d0 0x7f87d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.527+0000 7f87e37fe640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f87d006b4d0 0x7f87d006d990 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f87d80012b0 tx=0x7f87d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:43.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.530+0000 7f87e0ff9640 1 -- 172.21.15.172:0/661277234 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f87d40592e0 con 0x7f87e40cd6f0 2024-04-25T08:51:43.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.701+0000 7f87ea54c640 1 -- 172.21.15.172:0/661277234 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87e414ebd0 con 0x7f87e40cd6f0 2024-04-25T08:51:43.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.701+0000 7f87e0ff9640 1 -- 172.21.15.172:0/661277234 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87d4058be0 con 0x7f87e40cd6f0 2024-04-25T08:51:43.692 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:51:43.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 -- 172.21.15.172:0/661277234 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f87d006b4d0 msgr2=0x7f87d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f87d006b4d0 0x7f87d006d990 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f87d80012b0 tx=0x7f87d8009040 comp rx=0 tx=0).stop 2024-04-25T08:51:43.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 -- 172.21.15.172:0/661277234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87e40cd6f0 msgr2=0x7f87e4151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87e40cd6f0 0x7f87e4151c30 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f87d400e960 tx=0x7f87d400ee20 comp rx=0 tx=0).stop 2024-04-25T08:51:43.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 -- 172.21.15.172:0/661277234 shutdown_connections 2024-04-25T08:51:43.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f87d006b4d0 0x7f87d006d990 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87e40cdbf0 0x7f87e40ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e415a9f0 0x7f87e41486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 --2- 172.21.15.172:0/661277234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87e40cd6f0 0x7f87e4151c30 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 -- 172.21.15.172:0/661277234 >> 172.21.15.172:0/661277234 conn(0x7f87e40b2390 msgr2=0x7f87e406ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:43.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 -- 172.21.15.172:0/661277234 shutdown_connections 2024-04-25T08:51:43.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.703+0000 7f87ea54c640 1 -- 172.21.15.172:0/661277234 wait complete. 2024-04-25T08:51:43.705 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:51:43.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.812+0000 7f3672142640 1 Processor -- start 2024-04-25T08:51:43.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.813+0000 7f3672142640 1 -- start start 2024-04-25T08:51:43.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.813+0000 7f3672142640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f366c15bb20 0x7f366c0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.813+0000 7f3672142640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f366c0ccdd0 0x7f366c0cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.813+0000 7f3672142640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 0x7f366c0cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.813+0000 7f3672142640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0d0450 con 0x7f366c15bb20 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.813+0000 7f3672142640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0cb190 con 0x7f366c0ccdd0 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.813+0000 7f3672142640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0cb470 con 0x7f366c0cdcd0 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.813+0000 7f366b7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f366c15bb20 0x7f366c0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366b7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f366c15bb20 0x7f366c0cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40746/0 (socket says 172.21.15.172:40746) 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366b7fe640 1 -- 172.21.15.172:0/3587333750 learned_addr learned my addr 172.21.15.172:0/3587333750 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366affd640 1 --2- 172.21.15.172:0/3587333750 >> v2:172.21.15.186:3300/0 conn(0x7f366c0ccdd0 0x7f366c0cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366bfff640 1 --2- 172.21.15.172:0/3587333750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 0x7f366c0cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366b7fe640 1 -- 172.21.15.172:0/3587333750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 msgr2=0x7f366c0cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366b7fe640 1 --2- 172.21.15.172:0/3587333750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 0x7f366c0cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366b7fe640 1 -- 172.21.15.172:0/3587333750 >> v2:172.21.15.186:3300/0 conn(0x7f366c0ccdd0 msgr2=0x7f366c0cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366b7fe640 1 --2- 172.21.15.172:0/3587333750 >> v2:172.21.15.186:3300/0 conn(0x7f366c0ccdd0 0x7f366c0cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366b7fe640 1 -- 172.21.15.172:0/3587333750 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0cb750 con 0x7f366c15bb20 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366bfff640 1 --2- 172.21.15.172:0/3587333750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 0x7f366c0cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.814+0000 7f366b7fe640 1 --2- 172.21.15.172:0/3587333750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 0x7f366c0cc230 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f366c071680 tx=0x7f365c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60b73dbdb9c8e0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f366a7fc640 1 -- 172.21.15.172:0/3587333750 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c037070 con 0x7f366c15bb20 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f366a7fc640 1 -- 172.21.15.172:0/3587333750 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c032440 con 0x7f366c15bb20 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f366a7fc640 1 -- 172.21.15.172:0/3587333750 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c032810 con 0x7f366c15bb20 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f3672142640 1 -- 172.21.15.172:0/3587333750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 msgr2=0x7f366c0cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f3672142640 1 --2- 172.21.15.172:0/3587333750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 0x7f366c0cc230 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f366c071680 tx=0x7f365c02a140 comp rx=0 tx=0).stop 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f3672142640 1 -- 172.21.15.172:0/3587333750 shutdown_connections 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f3672142640 1 --2- 172.21.15.172:0/3587333750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 0x7f366c0cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f3672142640 1 --2- 172.21.15.172:0/3587333750 >> v2:172.21.15.186:3300/0 conn(0x7f366c0ccdd0 0x7f366c0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f3672142640 1 --2- 172.21.15.172:0/3587333750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 0x7f366c0cc230 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f3672142640 1 -- 172.21.15.172:0/3587333750 >> 172.21.15.172:0/3587333750 conn(0x7f366c0b2390 msgr2=0x7f366c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:43.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f3672142640 1 -- 172.21.15.172:0/3587333750 shutdown_connections 2024-04-25T08:51:43.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.815+0000 7f3672142640 1 -- 172.21.15.172:0/3587333750 wait complete. 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.816+0000 7f3672142640 1 Processor -- start 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.817+0000 7f3672142640 1 -- start start 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.817+0000 7f3672142640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f366c0ccdd0 0x7f366c14f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.817+0000 7f3672142640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 0x7f366c1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.817+0000 7f3672142640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 0x7f366c0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.817+0000 7f3672142640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0cc770 con 0x7f366c15bb20 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.817+0000 7f3672142640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0cbd10 con 0x7f366c0ccdd0 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.817+0000 7f3672142640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c15bf00 con 0x7f366c0cdcd0 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.817+0000 7f366bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 0x7f366c0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.817+0000 7f366bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 0x7f366c0c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40760/0 (socket says 172.21.15.172:40760) 2024-04-25T08:51:43.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.817+0000 7f366bfff640 1 -- 172.21.15.172:0/4128758316 learned_addr learned my addr 172.21.15.172:0/4128758316 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f366b7fe640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f366c0ccdd0 0x7f366c14f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f366affd640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 0x7f366c1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f366bfff640 1 -- 172.21.15.172:0/4128758316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 msgr2=0x7f366c1598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f366bfff640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 0x7f366c1598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f366bfff640 1 -- 172.21.15.172:0/4128758316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f366c0ccdd0 msgr2=0x7f366c14f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f366bfff640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f366c0ccdd0 0x7f366c14f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f366bfff640 1 -- 172.21.15.172:0/4128758316 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c15a330 con 0x7f366c15bb20 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f366bfff640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 0x7f366c0c9d70 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f366400cd50 tx=0x7f366400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f3653fff640 1 -- 172.21.15.172:0/4128758316 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366400f680 con 0x7f366c15bb20 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f3653fff640 1 -- 172.21.15.172:0/4128758316 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366400f840 con 0x7f366c15bb20 2024-04-25T08:51:43.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f3672142640 1 -- 172.21.15.172:0/4128758316 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c15a610 con 0x7f366c15bb20 2024-04-25T08:51:43.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f3653fff640 1 -- 172.21.15.172:0/4128758316 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366400fc30 con 0x7f366c15bb20 2024-04-25T08:51:43.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.818+0000 7f3672142640 1 -- 172.21.15.172:0/4128758316 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c1554b0 con 0x7f366c15bb20 2024-04-25T08:51:43.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.819+0000 7f3672142640 1 -- 172.21.15.172:0/4128758316 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c0b49c0 con 0x7f366c15bb20 2024-04-25T08:51:43.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.820+0000 7f3653fff640 1 -- 172.21.15.172:0/4128758316 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f36640213f0 con 0x7f366c15bb20 2024-04-25T08:51:43.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.820+0000 7f3653fff640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f365806b4d0 0x7f365806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:43.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.820+0000 7f3653fff640 1 -- 172.21.15.172:0/4128758316 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f366408b120 con 0x7f366c15bb20 2024-04-25T08:51:43.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.820+0000 7f366b7fe640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f365806b4d0 0x7f365806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:43.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.820+0000 7f366b7fe640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f365806b4d0 0x7f365806d990 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f365c034000 tx=0x7f365c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:43.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:43.824+0000 7f3653fff640 1 -- 172.21.15.172:0/4128758316 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3664014030 con 0x7f366c15bb20 2024-04-25T08:51:43.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.009+0000 7f3672142640 1 -- 172.21.15.172:0/4128758316 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f366c073a00 con 0x7f366c15bb20 2024-04-25T08:51:43.999 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.009+0000 7f3653fff640 1 -- 172.21.15.172:0/4128758316 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v132) v1 ==== 80+0+124 (secure 0 0 0) 0x7f3664059e50 con 0x7f366c15bb20 2024-04-25T08:51:44.000 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172:6837/3347790695 2024-04-26T08:51:34.301451+0000 2024-04-25T08:51:44.000 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172:6836/3347790695 2024-04-26T08:51:34.301451+0000 2024-04-25T08:51:44.000 INFO:teuthology.orchestra.run.smithi172.stderr:listed 2 entries 2024-04-25T08:51:44.001 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 -- 172.21.15.172:0/4128758316 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f365806b4d0 msgr2=0x7f365806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f365806b4d0 0x7f365806d990 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f365c034000 tx=0x7f365c02e000 comp rx=0 tx=0).stop 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 -- 172.21.15.172:0/4128758316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 msgr2=0x7f366c0c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 0x7f366c0c9d70 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f366400cd50 tx=0x7f366400a650 comp rx=0 tx=0).stop 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 -- 172.21.15.172:0/4128758316 shutdown_connections 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f365806b4d0 0x7f365806d990 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f366c15bb20 0x7f366c0c9d70 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f366c0cdcd0 0x7f366c1598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 --2- 172.21.15.172:0/4128758316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f366c0ccdd0 0x7f366c14f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 -- 172.21.15.172:0/4128758316 >> 172.21.15.172:0/4128758316 conn(0x7f366c0b2390 msgr2=0x7f366c0ad600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 -- 172.21.15.172:0/4128758316 shutdown_connections 2024-04-25T08:51:44.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.011+0000 7f3672142640 1 -- 172.21.15.172:0/4128758316 wait complete. 2024-04-25T08:51:44.012 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:51:44.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:44.013 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:51:44.040 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:51:44.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:51:44.040 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:51:44.095 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:51:44.095 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:51:44.115 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:51:44.115 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:51:44.115 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:51:44.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:51:44.150 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:51:44.150 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:51:44.173 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:51:44.174 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:44.287 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.297+0000 7fdaeb509640 1 Processor -- start 2024-04-25T08:51:44.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.297+0000 7fdaeb509640 1 -- start start 2024-04-25T08:51:44.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdaeb509640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdae4154ee0 0x7fdae40cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdaeb509640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdae40cfcf0 0x7fdae40cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdaeb509640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdae40ce3c0 0x7fdae415e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdaeb509640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae40ce830 con 0x7fdae4154ee0 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdaeb509640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae4072090 con 0x7fdae40ce3c0 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdaeb509640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40d0150 con 0x7fdae40cfcf0 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdae92a5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdae4154ee0 0x7fdae40cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdae92a5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdae4154ee0 0x7fdae40cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40766/0 (socket says 172.21.15.172:40766) 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdae92a5640 1 -- 172.21.15.172:0/914718572 learned_addr learned my addr 172.21.15.172:0/914718572 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdae92a5640 1 -- 172.21.15.172:0/914718572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdae40cfcf0 msgr2=0x7fdae40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdae92a5640 1 --2- 172.21.15.172:0/914718572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdae40cfcf0 0x7fdae40cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdae92a5640 1 -- 172.21.15.172:0/914718572 >> v2:172.21.15.186:3300/0 conn(0x7fdae40ce3c0 msgr2=0x7fdae415e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdae92a5640 1 --2- 172.21.15.172:0/914718572 >> v2:172.21.15.186:3300/0 conn(0x7fdae40ce3c0 0x7fdae415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.290 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.298+0000 7fdae92a5640 1 -- 172.21.15.172:0/914718572 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae4071480 con 0x7fdae4154ee0 2024-04-25T08:51:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.299+0000 7fdae92a5640 1 --2- 172.21.15.172:0/914718572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae4154ee0 0x7fdae40cf7b0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fdae406f6b0 tx=0x7fdae002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc98615dbdf7ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.299+0000 7fdadbfff640 1 -- 172.21.15.172:0/914718572 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0037070 con 0x7fdae4154ee0 2024-04-25T08:51:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.299+0000 7fdadbfff640 1 -- 172.21.15.172:0/914718572 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae0032440 con 0x7fdae4154ee0 2024-04-25T08:51:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.299+0000 7fdadbfff640 1 -- 172.21.15.172:0/914718572 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0032810 con 0x7fdae4154ee0 2024-04-25T08:51:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.300+0000 7fdaeb509640 1 -- 172.21.15.172:0/914718572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae4154ee0 msgr2=0x7fdae40cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.300+0000 7fdaeb509640 1 --2- 172.21.15.172:0/914718572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae4154ee0 0x7fdae40cf7b0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fdae406f6b0 tx=0x7fdae002a210 comp rx=0 tx=0).stop 2024-04-25T08:51:44.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.300+0000 7fdaeb509640 1 -- 172.21.15.172:0/914718572 shutdown_connections 2024-04-25T08:51:44.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.300+0000 7fdaeb509640 1 --2- 172.21.15.172:0/914718572 >> v2:172.21.15.186:3300/0 conn(0x7fdae40ce3c0 0x7fdae415e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.300+0000 7fdaeb509640 1 --2- 172.21.15.172:0/914718572 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdae40cfcf0 0x7fdae40cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.300+0000 7fdaeb509640 1 --2- 172.21.15.172:0/914718572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae4154ee0 0x7fdae40cf7b0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.300+0000 7fdaeb509640 1 -- 172.21.15.172:0/914718572 >> 172.21.15.172:0/914718572 conn(0x7fdae406abe0 msgr2=0x7fdae406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:44.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.300+0000 7fdaeb509640 1 -- 172.21.15.172:0/914718572 shutdown_connections 2024-04-25T08:51:44.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.300+0000 7fdaeb509640 1 -- 172.21.15.172:0/914718572 wait complete. 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.301+0000 7fdaeb509640 1 Processor -- start 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.301+0000 7fdaeb509640 1 -- start start 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdaeb509640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae40ce3c0 0x7fdae414b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdaeb509640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdae40cfcf0 0x7fdae4152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdaeb509640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae4154ee0 0x7fdae4152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdaeb509640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4071a40 con 0x7fdae40ce3c0 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdaeb509640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4071230 con 0x7fdae4154ee0 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdaeb509640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4071d20 con 0x7fdae40cfcf0 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae92a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae40ce3c0 0x7fdae414b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae92a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae40ce3c0 0x7fdae414b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40770/0 (socket says 172.21.15.172:40770) 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae92a5640 1 -- 172.21.15.172:0/1627336217 learned_addr learned my addr 172.21.15.172:0/1627336217 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae9aa6640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae4154ee0 0x7fdae4152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae8aa4640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdae40cfcf0 0x7fdae4152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae92a5640 1 -- 172.21.15.172:0/1627336217 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdae40cfcf0 msgr2=0x7fdae4152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae92a5640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdae40cfcf0 0x7fdae4152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae92a5640 1 -- 172.21.15.172:0/1627336217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae4154ee0 msgr2=0x7fdae4152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae92a5640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae4154ee0 0x7fdae4152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae92a5640 1 -- 172.21.15.172:0/1627336217 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae414b670 con 0x7fdae40ce3c0 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae9aa6640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae4154ee0 0x7fdae4152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdae92a5640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae40ce3c0 0x7fdae414b130 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009870 tx=0x7fdae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.302+0000 7fdad9ffb640 1 -- 172.21.15.172:0/1627336217 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0041070 con 0x7fdae40ce3c0 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.303+0000 7fdad9ffb640 1 -- 172.21.15.172:0/1627336217 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae003c870 con 0x7fdae40ce3c0 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.303+0000 7fdaeb509640 1 -- 172.21.15.172:0/1627336217 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae414eb30 con 0x7fdae40ce3c0 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.303+0000 7fdad9ffb640 1 -- 172.21.15.172:0/1627336217 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0037040 con 0x7fdae40ce3c0 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.303+0000 7fdaeb509640 1 -- 172.21.15.172:0/1627336217 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae414f0f0 con 0x7fdae40ce3c0 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.304+0000 7fdaeb509640 1 -- 172.21.15.172:0/1627336217 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae4073990 con 0x7fdae40ce3c0 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.304+0000 7fdad9ffb640 1 -- 172.21.15.172:0/1627336217 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdae0044070 con 0x7fdae40ce3c0 2024-04-25T08:51:44.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.304+0000 7fdad9ffb640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdac806b4d0 0x7fdac806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.305+0000 7fdad9ffb640 1 -- 172.21.15.172:0/1627336217 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fdae00ab070 con 0x7fdae40ce3c0 2024-04-25T08:51:44.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.305+0000 7fdae8aa4640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdac806b4d0 0x7fdac806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.305+0000 7fdae8aa4640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdac806b4d0 0x7fdac806d990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdae40d0610 tx=0x7fdad4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:44.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.309+0000 7fdad9ffb640 1 -- 172.21.15.172:0/1627336217 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdae0079ec0 con 0x7fdae40ce3c0 2024-04-25T08:51:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.516+0000 7fdaeb509640 1 -- 172.21.15.172:0/1627336217 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdae415c3f0 con 0x7fdae40ce3c0 2024-04-25T08:51:44.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.517+0000 7fdad9ffb640 1 -- 172.21.15.172:0/1627336217 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4155 (secure 0 0 0) 0x7fdae00797c0 con 0x7fdae40ce3c0 2024-04-25T08:51:44.507 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:44.508 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:51:36.323687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9291":{"gid":9291,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:44.508 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 78 2024-04-25T08:51:44.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 -- 172.21.15.172:0/1627336217 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdac806b4d0 msgr2=0x7fdac806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdac806b4d0 0x7fdac806d990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdae40d0610 tx=0x7fdad4008040 comp rx=0 tx=0).stop 2024-04-25T08:51:44.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 -- 172.21.15.172:0/1627336217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae40ce3c0 msgr2=0x7fdae414b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae40ce3c0 0x7fdae414b130 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009870 tx=0x7fdae00046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 -- 172.21.15.172:0/1627336217 shutdown_connections 2024-04-25T08:51:44.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdac806b4d0 0x7fdac806d990 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdae4154ee0 0x7fdae4152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdae40cfcf0 0x7fdae4152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 --2- 172.21.15.172:0/1627336217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdae40ce3c0 0x7fdae414b130 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 -- 172.21.15.172:0/1627336217 >> 172.21.15.172:0/1627336217 conn(0x7fdae406abe0 msgr2=0x7fdae40cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:44.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 -- 172.21.15.172:0/1627336217 shutdown_connections 2024-04-25T08:51:44.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.519+0000 7fdaeb509640 1 -- 172.21.15.172:0/1627336217 wait complete. 2024-04-25T08:51:44.522 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:51:44.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.630+0000 7f0c58aee640 1 Processor -- start 2024-04-25T08:51:44.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.630+0000 7f0c58aee640 1 -- start start 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c58aee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c5415dc90 0x7f0c541625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c58aee640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c540cce50 con 0x7f0c540cc8e0 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c58aee640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c54161af0 con 0x7f0c540d1810 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c58aee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54161dd0 con 0x7f0c5415dc90 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c49d9b640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0c540cc8e0 0x7f0c5415ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42128/0 (socket says 172.21.15.172:42128) 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c49d9b640 1 -- 172.21.15.172:0/2079281576 learned_addr learned my addr 172.21.15.172:0/2079281576 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c5259c640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c5415dc90 0x7f0c541625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457653572 0 0) 0x7f0c540cce50 con 0x7f0c540cc8e0 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c40003520 con 0x7f0c540cc8e0 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1114994959 0 0) 0x7f0c40003520 con 0x7f0c540cc8e0 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c5415dc90 msgr2=0x7f0c541625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c5415dc90 0x7f0c541625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 >> v1:172.21.15.186:6789/0 conn(0x7f0c540d1810 legacy=0x7f0c540cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c541620b0 con 0x7f0c540cc8e0 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f0c3c001670 con 0x7f0c540cc8e0 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 >> v1:172.21.15.172:6789/0 conn(0x7f0c540cc8e0 legacy=0x7f0c5415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c5415dc90 0x7f0c400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c40003f60 0x7f0c40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c40004d40 0x7f0c400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54161dd0 con 0x7f0c40003f60 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4000bb50 con 0x7f0c40004d40 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4000bd50 con 0x7f0c5415dc90 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c49d9b640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c40003f60 0x7f0c40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c5259c640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c5415dc90 0x7f0c400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.631+0000 7f0c52d9d640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c40004d40 0x7f0c400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.632+0000 7f0c49d9b640 1 -- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c5415dc90 msgr2=0x7f0c400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.632+0000 7f0c49d9b640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c5415dc90 0x7f0c400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.632+0000 7f0c49d9b640 1 -- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c40004d40 msgr2=0x7f0c400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.632+0000 7f0c49d9b640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c40004d40 0x7f0c400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.632+0000 7f0c49d9b640 1 -- 172.21.15.172:0/2079281576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40003520 con 0x7f0c40003f60 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.632+0000 7f0c52d9d640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c40004d40 0x7f0c400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.632+0000 7f0c49d9b640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c40003f60 0x7f0c40004800 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c240 tx=0x7f0c40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b73ccdb314ff4f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.632+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c007cf0 con 0x7f0c40003f60 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.632+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c0058d0 con 0x7f0c40003f60 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.632+0000 7f0c51d9b640 1 -- 172.21.15.172:0/2079281576 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c005ce0 con 0x7f0c40003f60 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.633+0000 7f0c58aee640 1 -- 172.21.15.172:0/2079281576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c40003f60 msgr2=0x7f0c40004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.633+0000 7f0c58aee640 1 --2- 172.21.15.172:0/2079281576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c40003f60 0x7f0c40004800 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c240 tx=0x7f0c40005830 comp rx=0 tx=0).stop 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.633+0000 7f0c52d9d640 1 -- 172.21.15.172:0/2079281576 reap_dead start 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.633+0000 7f0c58aee640 1 -- 172.21.15.172:0/2079281576 shutdown_connections 2024-04-25T08:51:44.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.633+0000 7f0c58aee640 1 -- 172.21.15.172:0/2079281576 >> 172.21.15.172:0/2079281576 conn(0x7f0c5406f590 msgr2=0x7f0c5406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.633+0000 7f0c58aee640 1 -- 172.21.15.172:0/2079281576 shutdown_connections 2024-04-25T08:51:44.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.633+0000 7f0c58aee640 1 -- 172.21.15.172:0/2079281576 wait complete. 2024-04-25T08:51:44.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.634+0000 7f0c58aee640 1 Processor -- start 2024-04-25T08:51:44.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.634+0000 7f0c58aee640 1 -- start start 2024-04-25T08:51:44.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c58aee640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c40003f60 0x7f0c541f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c58aee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c540c8b10 0x7f0c540c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c58aee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c541e8f80 0x7f0c541e9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c58aee640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415e1f0 con 0x7f0c541e8f80 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c58aee640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415e070 con 0x7f0c540c8b10 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c58aee640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c541625d0 con 0x7f0c40003f60 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c52d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c541e8f80 0x7f0c541e9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c52d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c541e8f80 0x7f0c541e9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40786/0 (socket says 172.21.15.172:40786) 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c52d9d640 1 -- 172.21.15.172:0/4082066853 learned_addr learned my addr 172.21.15.172:0/4082066853 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c49d9b640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c540c8b10 0x7f0c540c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.635+0000 7f0c5259c640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c40003f60 0x7f0c541f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c52d9d640 1 -- 172.21.15.172:0/4082066853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c40003f60 msgr2=0x7f0c541f3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c52d9d640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c40003f60 0x7f0c541f3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c52d9d640 1 -- 172.21.15.172:0/4082066853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c540c8b10 msgr2=0x7f0c540c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c52d9d640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c540c8b10 0x7f0c540c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c52d9d640 1 -- 172.21.15.172:0/4082066853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c541e9cd0 con 0x7f0c541e8f80 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c5259c640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c40003f60 0x7f0c541f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c52d9d640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c541e8f80 0x7f0c541e9400 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c000f80 tx=0x7f0c4c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c4b7fe640 1 -- 172.21.15.172:0/4082066853 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c006b50 con 0x7f0c541e8f80 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c4b7fe640 1 -- 172.21.15.172:0/4082066853 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c006cf0 con 0x7f0c541e8f80 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c58aee640 1 -- 172.21.15.172:0/4082066853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5415ef00 con 0x7f0c541e8f80 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c4b7fe640 1 -- 172.21.15.172:0/4082066853 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c003970 con 0x7f0c541e8f80 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.636+0000 7f0c58aee640 1 -- 172.21.15.172:0/4082066853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5415f4c0 con 0x7f0c541e8f80 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.637+0000 7f0c58aee640 1 -- 172.21.15.172:0/4082066853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c54068470 con 0x7f0c541e8f80 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.637+0000 7f0c4b7fe640 1 -- 172.21.15.172:0/4082066853 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0c4c01a020 con 0x7f0c541e8f80 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.638+0000 7f0c4b7fe640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0c3406b500 0x7f0c3406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.638+0000 7f0c4b7fe640 1 -- 172.21.15.172:0/4082066853 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0c4c0897e0 con 0x7f0c541e8f80 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.638+0000 7f0c5259c640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0c3406b500 0x7f0c3406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.638+0000 7f0c5259c640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0c3406b500 0x7f0c3406d9c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009bc0 tx=0x7f0c44008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:44.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.642+0000 7f0c4b7fe640 1 -- 172.21.15.172:0/4082066853 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0c54068470 con 0x7f0c541e8f80 2024-04-25T08:51:44.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.815+0000 7f0c58aee640 1 -- 172.21.15.172:0/4082066853 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c54073990 con 0x7f0c541e8f80 2024-04-25T08:51:44.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.816+0000 7f0c4b7fe640 1 -- 172.21.15.172:0/4082066853 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+17091 (secure 0 0 0) 0x7f0c4c058510 con 0x7f0c541e8f80 2024-04-25T08:51:44.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:44.807 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":132,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:51:34.301519+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:50.627461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:51.373323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6837/3347790695":"2024-04-26T08:51:34.301451+0000","172.21.15.172:6836/3347790695":"2024-04-26T08:51:34.301451+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:51:44.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 -- 172.21.15.172:0/4082066853 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0c3406b500 msgr2=0x7f0c3406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0c3406b500 0x7f0c3406d9c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009bc0 tx=0x7f0c44008040 comp rx=0 tx=0).stop 2024-04-25T08:51:44.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 -- 172.21.15.172:0/4082066853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c541e8f80 msgr2=0x7f0c541e9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c541e8f80 0x7f0c541e9400 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c000f80 tx=0x7f0c4c00eb90 comp rx=0 tx=0).stop 2024-04-25T08:51:44.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 -- 172.21.15.172:0/4082066853 shutdown_connections 2024-04-25T08:51:44.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0c3406b500 0x7f0c3406d9c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c540c8b10 0x7f0c540c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c541e8f80 0x7f0c541e9400 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 --2- 172.21.15.172:0/4082066853 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0c40003f60 0x7f0c541f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 -- 172.21.15.172:0/4082066853 >> 172.21.15.172:0/4082066853 conn(0x7f0c5406f590 msgr2=0x7f0c5415bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:44.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 -- 172.21.15.172:0/4082066853 shutdown_connections 2024-04-25T08:51:44.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.818+0000 7f0c58aee640 1 -- 172.21.15.172:0/4082066853 wait complete. 2024-04-25T08:51:44.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:50:50.627461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:50:51.373323+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:51:44.820 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:51:44.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.930+0000 7fcd4525d640 1 Processor -- start 2024-04-25T08:51:44.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.930+0000 7fcd4525d640 1 -- start start 2024-04-25T08:51:44.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.930+0000 7fcd4525d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcd4006c330 0x7fcd400b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.930+0000 7fcd4525d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd400d1d50 con 0x7fcd40158230 2024-04-25T08:51:44.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.930+0000 7fcd4525d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd400d2020 con 0x7fcd4006c7e0 2024-04-25T08:51:44.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.930+0000 7fcd4525d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd40158610 con 0x7fcd4006c330 2024-04-25T08:51:44.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.931+0000 7fcd3e59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcd4006c330 0x7fcd400b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.931+0000 7fcd3ed9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fcd40158230 0x7fcd400d1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42132/0 (socket says 172.21.15.172:42132) 2024-04-25T08:51:44.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.931+0000 7fcd3ed9d640 1 -- 172.21.15.172:0/1700612406 learned_addr learned my addr 172.21.15.172:0/1700612406 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:44.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.931+0000 7fcd3e59c640 1 -- 172.21.15.172:0/1700612406 >> v1:172.21.15.186:6789/0 conn(0x7fcd4006c7e0 legacy=0x7fcd4006f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:44.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.931+0000 7fcd3e59c640 1 -- 172.21.15.172:0/1700612406 >> v1:172.21.15.172:6789/0 conn(0x7fcd40158230 legacy=0x7fcd400d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.931+0000 7fcd3dd9b640 1 -- 172.21.15.172:0/1700612406 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339054660 0 0) 0x7fcd400d1d50 con 0x7fcd40158230 2024-04-25T08:51:44.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.931+0000 7fcd3e59c640 1 -- 172.21.15.172:0/1700612406 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400d2300 con 0x7fcd4006c330 2024-04-25T08:51:44.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd3e59c640 1 --2- 172.21.15.172:0/1700612406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd4006c330 0x7fcd400b4e60 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009790 tx=0x7fcd3402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea82b42aabfd9678 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:44.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd3dd9b640 1 -- 172.21.15.172:0/1700612406 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34037070 con 0x7fcd4006c330 2024-04-25T08:51:44.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd3dd9b640 1 -- 172.21.15.172:0/1700612406 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd34032440 con 0x7fcd4006c330 2024-04-25T08:51:44.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd3dd9b640 1 -- 172.21.15.172:0/1700612406 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34032810 con 0x7fcd4006c330 2024-04-25T08:51:44.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd4525d640 1 -- 172.21.15.172:0/1700612406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd4006c330 msgr2=0x7fcd400b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd4525d640 1 --2- 172.21.15.172:0/1700612406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd4006c330 0x7fcd400b4e60 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009790 tx=0x7fcd3402a1c0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd4525d640 1 -- 172.21.15.172:0/1700612406 shutdown_connections 2024-04-25T08:51:44.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd4525d640 1 --2- 172.21.15.172:0/1700612406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd4006c330 0x7fcd400b4e60 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd4525d640 1 -- 172.21.15.172:0/1700612406 >> 172.21.15.172:0/1700612406 conn(0x7fcd40061600 msgr2=0x7fcd400619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd4525d640 1 -- 172.21.15.172:0/1700612406 shutdown_connections 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.932+0000 7fcd4525d640 1 -- 172.21.15.172:0/1700612406 wait complete. 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.934+0000 7fcd4525d640 1 Processor -- start 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.934+0000 7fcd4525d640 1 -- start start 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.934+0000 7fcd4525d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd4006c330 0x7fcd400cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.934+0000 7fcd4525d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd4006c7e0 0x7fcd4014a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.934+0000 7fcd4525d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd40158230 0x7fcd401e6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.934+0000 7fcd4525d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400d25e0 con 0x7fcd40158230 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.934+0000 7fcd4525d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4006bea0 con 0x7fcd4006c7e0 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.934+0000 7fcd4525d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4015e320 con 0x7fcd4006c330 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.934+0000 7fcd3f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd40158230 0x7fcd401e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3f59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd40158230 0x7fcd401e6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40804/0 (socket says 172.21.15.172:40804) 2024-04-25T08:51:44.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3f59e640 1 -- 172.21.15.172:0/973432900 learned_addr learned my addr 172.21.15.172:0/973432900 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:44.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3e59c640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd4006c7e0 0x7fcd4014a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3ed9d640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd4006c330 0x7fcd400cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3f59e640 1 -- 172.21.15.172:0/973432900 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd4006c330 msgr2=0x7fcd400cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3f59e640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd4006c330 0x7fcd400cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3f59e640 1 -- 172.21.15.172:0/973432900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd4006c7e0 msgr2=0x7fcd4014a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:44.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3f59e640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd4006c7e0 0x7fcd4014a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:44.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3f59e640 1 -- 172.21.15.172:0/973432900 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400cdaf0 con 0x7fcd40158230 2024-04-25T08:51:44.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3e59c640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd4006c7e0 0x7fcd4014a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:44.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd3f59e640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd40158230 0x7fcd401e6170 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b970 tx=0x7fcd3800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:44.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd277fe640 1 -- 172.21.15.172:0/973432900 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38019070 con 0x7fcd40158230 2024-04-25T08:51:44.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd277fe640 1 -- 172.21.15.172:0/973432900 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3800cb40 con 0x7fcd40158230 2024-04-25T08:51:44.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd4525d640 1 -- 172.21.15.172:0/973432900 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd400cca50 con 0x7fcd40158230 2024-04-25T08:51:44.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd277fe640 1 -- 172.21.15.172:0/973432900 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38014440 con 0x7fcd40158230 2024-04-25T08:51:44.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.935+0000 7fcd4525d640 1 -- 172.21.15.172:0/973432900 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd400cd010 con 0x7fcd40158230 2024-04-25T08:51:44.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.936+0000 7fcd4525d640 1 -- 172.21.15.172:0/973432900 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd40073a00 con 0x7fcd40158230 2024-04-25T08:51:44.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.937+0000 7fcd277fe640 1 -- 172.21.15.172:0/973432900 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd3801c070 con 0x7fcd40158230 2024-04-25T08:51:44.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.937+0000 7fcd277fe640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd2c06b4d0 0x7fcd2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:44.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.937+0000 7fcd277fe640 1 -- 172.21.15.172:0/973432900 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fcd3808a0f0 con 0x7fcd40158230 2024-04-25T08:51:44.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.937+0000 7fcd3ed9d640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd2c06b4d0 0x7fcd2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:44.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.937+0000 7fcd3ed9d640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd2c06b4d0 0x7fcd2c06d990 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcd30000f60 tx=0x7fcd30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:44.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:44.941+0000 7fcd277fe640 1 -- 172.21.15.172:0/973432900 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd38058d90 con 0x7fcd40158230 2024-04-25T08:51:45.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.110+0000 7fcd4525d640 1 -- 172.21.15.172:0/973432900 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd4006cf40 con 0x7fcd40158230 2024-04-25T08:51:45.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.111+0000 7fcd277fe640 1 -- 172.21.15.172:0/973432900 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd38058690 con 0x7fcd40158230 2024-04-25T08:51:45.101 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:51:45.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 -- 172.21.15.172:0/973432900 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd2c06b4d0 msgr2=0x7fcd2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd2c06b4d0 0x7fcd2c06d990 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcd30000f60 tx=0x7fcd30009040 comp rx=0 tx=0).stop 2024-04-25T08:51:45.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 -- 172.21.15.172:0/973432900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd40158230 msgr2=0x7fcd401e6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd40158230 0x7fcd401e6170 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b970 tx=0x7fcd3800be30 comp rx=0 tx=0).stop 2024-04-25T08:51:45.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 -- 172.21.15.172:0/973432900 shutdown_connections 2024-04-25T08:51:45.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcd2c06b4d0 0x7fcd2c06d990 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd4006c7e0 0x7fcd4014a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd40158230 0x7fcd401e6170 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 --2- 172.21.15.172:0/973432900 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd4006c330 0x7fcd400cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 -- 172.21.15.172:0/973432900 >> 172.21.15.172:0/973432900 conn(0x7fcd40061600 msgr2=0x7fcd4015ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:45.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 -- 172.21.15.172:0/973432900 shutdown_connections 2024-04-25T08:51:45.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.113+0000 7fcd4525d640 1 -- 172.21.15.172:0/973432900 wait complete. 2024-04-25T08:51:45.114 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:51:45.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.224+0000 7fb9be330640 1 Processor -- start 2024-04-25T08:51:45.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.224+0000 7fb9be330640 1 -- start start 2024-04-25T08:51:45.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9be330640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b81454a0 0x7fb9b80aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9be330640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb9b815c970 0x7fb9b806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9be330640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b80af540 con 0x7fb9b806b120 2024-04-25T08:51:45.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9be330640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b80af820 con 0x7fb9b815c970 2024-04-25T08:51:45.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9be330640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b80afb00 con 0x7fb9b81454a0 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9bc8cd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb9b806b120 0x7fb9b815f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42144/0 (socket says 172.21.15.172:42144) 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9bc8cd640 1 -- 172.21.15.172:0/3428609818 learned_addr learned my addr 172.21.15.172:0/3428609818 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9b77fe640 1 --2- 172.21.15.172:0/3428609818 >> v2:172.21.15.186:3300/0 conn(0x7fb9b815c970 0x7fb9b806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9b7fff640 1 --2- 172.21.15.172:0/3428609818 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b81454a0 0x7fb9b80aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9b6ffd640 1 -- 172.21.15.172:0/3428609818 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094189428 0 0) 0x7fb9b80af540 con 0x7fb9b806b120 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9b6ffd640 1 -- 172.21.15.172:0/3428609818 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a4003520 con 0x7fb9b806b120 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9b6ffd640 1 -- 172.21.15.172:0/3428609818 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2393597825 0 0) 0x7fb9a4003520 con 0x7fb9b806b120 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9b77fe640 1 -- 172.21.15.172:0/3428609818 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b81454a0 msgr2=0x7fb9b80aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9b77fe640 1 --2- 172.21.15.172:0/3428609818 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b81454a0 0x7fb9b80aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9b77fe640 1 -- 172.21.15.172:0/3428609818 >> v1:172.21.15.172:6789/0 conn(0x7fb9b806b120 legacy=0x7fb9b815f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9b77fe640 1 -- 172.21.15.172:0/3428609818 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b80afde0 con 0x7fb9b815c970 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.225+0000 7fb9b7fff640 1 --2- 172.21.15.172:0/3428609818 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b81454a0 0x7fb9b80aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:45.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.226+0000 7fb9b77fe640 1 --2- 172.21.15.172:0/3428609818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b815c970 0x7fb9b806abe0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00097a0 tx=0x7fb9a002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16309b10c966de54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9b6ffd640 1 -- 172.21.15.172:0/3428609818 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0037070 con 0x7fb9b815c970 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9b6ffd640 1 -- 172.21.15.172:0/3428609818 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a002aba0 con 0x7fb9b815c970 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9b6ffd640 1 -- 172.21.15.172:0/3428609818 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b00019f0 con 0x7fb9b815c970 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9be330640 1 -- 172.21.15.172:0/3428609818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b815c970 msgr2=0x7fb9b806abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9be330640 1 --2- 172.21.15.172:0/3428609818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b815c970 0x7fb9b806abe0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00097a0 tx=0x7fb9a002a110 comp rx=0 tx=0).stop 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9be330640 1 -- 172.21.15.172:0/3428609818 shutdown_connections 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9be330640 1 --2- 172.21.15.172:0/3428609818 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b815c970 0x7fb9b806abe0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9be330640 1 --2- 172.21.15.172:0/3428609818 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b81454a0 0x7fb9b80aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9be330640 1 -- 172.21.15.172:0/3428609818 >> 172.21.15.172:0/3428609818 conn(0x7fb9b80b5af0 msgr2=0x7fb9b80b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9be330640 1 -- 172.21.15.172:0/3428609818 shutdown_connections 2024-04-25T08:51:45.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.227+0000 7fb9be330640 1 -- 172.21.15.172:0/3428609818 wait complete. 2024-04-25T08:51:45.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.228+0000 7fb9be330640 1 Processor -- start 2024-04-25T08:51:45.220 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.228+0000 7fb9be330640 1 -- start start 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9be330640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b806b120 0x7fb9b81f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9be330640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b81454a0 0x7fb9b80cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9be330640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b815c970 0x7fb9b80cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9be330640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b815e620 con 0x7fb9b815c970 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9be330640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b815e4a0 con 0x7fb9b81454a0 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9be330640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b815e7a0 con 0x7fb9b806b120 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9bc8cd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b815c970 0x7fb9b80cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9bc8cd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b815c970 0x7fb9b80cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40806/0 (socket says 172.21.15.172:40806) 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9bc8cd640 1 -- 172.21.15.172:0/4023034299 learned_addr learned my addr 172.21.15.172:0/4023034299 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9b7fff640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b806b120 0x7fb9b81f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.229+0000 7fb9b77fe640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b81454a0 0x7fb9b80cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9bc8cd640 1 -- 172.21.15.172:0/4023034299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b806b120 msgr2=0x7fb9b81f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9bc8cd640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b806b120 0x7fb9b81f22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9bc8cd640 1 -- 172.21.15.172:0/4023034299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b81454a0 msgr2=0x7fb9b80cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9bc8cd640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b81454a0 0x7fb9b80cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9bc8cd640 1 -- 172.21.15.172:0/4023034299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b80cfc80 con 0x7fb9b815c970 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9bc8cd640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b815c970 0x7fb9b80cd510 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000cc30 tx=0x7fb9b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9b4ff9640 1 -- 172.21.15.172:0/4023034299 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0017070 con 0x7fb9b815c970 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9b4ff9640 1 -- 172.21.15.172:0/4023034299 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b000ce40 con 0x7fb9b815c970 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9be330640 1 -- 172.21.15.172:0/4023034299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b80cff60 con 0x7fb9b815c970 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9b4ff9640 1 -- 172.21.15.172:0/4023034299 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0012600 con 0x7fb9b815c970 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.230+0000 7fb9be330640 1 -- 172.21.15.172:0/4023034299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b80d0520 con 0x7fb9b815c970 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.231+0000 7fb9be330640 1 -- 172.21.15.172:0/4023034299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b806cc80 con 0x7fb9b815c970 2024-04-25T08:51:45.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.232+0000 7fb9b4ff9640 1 -- 172.21.15.172:0/4023034299 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9b001a070 con 0x7fb9b815c970 2024-04-25T08:51:45.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.232+0000 7fb9b4ff9640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb99806b500 0x7fb99806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.232+0000 7fb9b4ff9640 1 -- 172.21.15.172:0/4023034299 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fb9b008a1a0 con 0x7fb9b815c970 2024-04-25T08:51:45.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.232+0000 7fb9b7fff640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb99806b500 0x7fb99806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.233+0000 7fb9b7fff640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb99806b500 0x7fb99806d9c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80b0c80 tx=0x7fb9a8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:45.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.236+0000 7fb9b4ff9640 1 -- 172.21.15.172:0/4023034299 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9b00587f0 con 0x7fb9b815c970 2024-04-25T08:51:45.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.407+0000 7fb9be330640 1 -- 172.21.15.172:0/4023034299 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9b8073a00 con 0x7fb9b815c970 2024-04-25T08:51:45.398 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.407+0000 7fb9b4ff9640 1 -- 172.21.15.172:0/4023034299 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9b005c890 con 0x7fb9b815c970 2024-04-25T08:51:45.398 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:51:45.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.409+0000 7fb9be330640 1 -- 172.21.15.172:0/4023034299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb99806b500 msgr2=0x7fb99806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.409+0000 7fb9be330640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb99806b500 0x7fb99806d9c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80b0c80 tx=0x7fb9a8009190 comp rx=0 tx=0).stop 2024-04-25T08:51:45.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.409+0000 7fb9be330640 1 -- 172.21.15.172:0/4023034299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b815c970 msgr2=0x7fb9b80cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.409+0000 7fb9be330640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b815c970 0x7fb9b80cd510 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000cc30 tx=0x7fb9b000a430 comp rx=0 tx=0).stop 2024-04-25T08:51:45.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.410+0000 7fb9be330640 1 -- 172.21.15.172:0/4023034299 shutdown_connections 2024-04-25T08:51:45.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.410+0000 7fb9be330640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb99806b500 0x7fb99806d9c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.410+0000 7fb9be330640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9b81454a0 0x7fb9b80cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.410+0000 7fb9be330640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b815c970 0x7fb9b80cd510 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.410+0000 7fb9be330640 1 --2- 172.21.15.172:0/4023034299 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9b806b120 0x7fb9b81f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.410+0000 7fb9be330640 1 -- 172.21.15.172:0/4023034299 >> 172.21.15.172:0/4023034299 conn(0x7fb9b80b5af0 msgr2=0x7fb9b80b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:45.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.410+0000 7fb9be330640 1 -- 172.21.15.172:0/4023034299 shutdown_connections 2024-04-25T08:51:45.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.410+0000 7fb9be330640 1 -- 172.21.15.172:0/4023034299 wait complete. 2024-04-25T08:51:45.411 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:51:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.521+0000 7febeb990640 1 Processor -- start 2024-04-25T08:51:45.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.521+0000 7febeb990640 1 -- start start 2024-04-25T08:51:45.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febeb990640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febe40b4f10 0x7febe40b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febeb990640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7febe415fd40 0x7febe406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febeb990640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40b52f0 con 0x7febe40af5e0 2024-04-25T08:51:45.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febeb990640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe406bc40 con 0x7febe40b4f10 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febeb990640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe40adaa0 con 0x7febe415fd40 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febe972c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febe40b4f10 0x7febe40b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febe972c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7febe40b4f10 0x7febe40b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40814/0 (socket says 172.21.15.172:40814) 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febe972c640 1 -- 172.21.15.172:0/3200933210 learned_addr learned my addr 172.21.15.172:0/3200933210 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febe9f2d640 1 --2- 172.21.15.172:0/3200933210 >> v2:172.21.15.186:3300/0 conn(0x7febe415fd40 0x7febe406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febe972c640 1 -- 172.21.15.172:0/3200933210 >> v2:172.21.15.186:3300/0 conn(0x7febe415fd40 msgr2=0x7febe406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febe972c640 1 --2- 172.21.15.172:0/3200933210 >> v2:172.21.15.186:3300/0 conn(0x7febe415fd40 0x7febe406c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febe972c640 1 -- 172.21.15.172:0/3200933210 >> v1:172.21.15.186:6789/0 conn(0x7febe40af5e0 legacy=0x7febe415f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.522+0000 7febe972c640 1 -- 172.21.15.172:0/3200933210 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40add80 con 0x7febe40b4f10 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.523+0000 7febe972c640 1 --2- 172.21.15.172:0/3200933210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40b4f10 0x7febe40b2e10 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7febe4061990 tx=0x7febe002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6dfda44a99f2ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.523+0000 7febdbfff640 1 -- 172.21.15.172:0/3200933210 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0037070 con 0x7febe40b4f10 2024-04-25T08:51:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.523+0000 7febdbfff640 1 -- 172.21.15.172:0/3200933210 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0032440 con 0x7febe40b4f10 2024-04-25T08:51:45.515 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.523+0000 7febdbfff640 1 -- 172.21.15.172:0/3200933210 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0032810 con 0x7febe40b4f10 2024-04-25T08:51:45.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.524+0000 7febeb990640 1 -- 172.21.15.172:0/3200933210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40b4f10 msgr2=0x7febe40b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.524+0000 7febeb990640 1 --2- 172.21.15.172:0/3200933210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40b4f10 0x7febe40b2e10 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7febe4061990 tx=0x7febe002a270 comp rx=0 tx=0).stop 2024-04-25T08:51:45.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.524+0000 7febeb990640 1 -- 172.21.15.172:0/3200933210 shutdown_connections 2024-04-25T08:51:45.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.524+0000 7febeb990640 1 --2- 172.21.15.172:0/3200933210 >> v2:172.21.15.186:3300/0 conn(0x7febe415fd40 0x7febe406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.524+0000 7febeb990640 1 --2- 172.21.15.172:0/3200933210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40b4f10 0x7febe40b2e10 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.524+0000 7febeb990640 1 -- 172.21.15.172:0/3200933210 >> 172.21.15.172:0/3200933210 conn(0x7febe40cfec0 msgr2=0x7febe40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:45.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.524+0000 7febeb990640 1 -- 172.21.15.172:0/3200933210 shutdown_connections 2024-04-25T08:51:45.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.524+0000 7febeb990640 1 -- 172.21.15.172:0/3200933210 wait complete. 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.525+0000 7febeb990640 1 Processor -- start 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.525+0000 7febeb990640 1 -- start start 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.525+0000 7febeb990640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40af5e0 0x7febe409b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.525+0000 7febeb990640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe40b4f10 0x7febe41538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.525+0000 7febeb990640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7febe415fd40 0x7febe41516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.525+0000 7febeb990640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe40ad730 con 0x7febe40af5e0 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.525+0000 7febeb990640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe406b8d0 con 0x7febe40b4f10 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.525+0000 7febeb990640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40b3910 con 0x7febe415fd40 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe972c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40af5e0 0x7febe409b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe972c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40af5e0 0x7febe409b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40830/0 (socket says 172.21.15.172:40830) 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe972c640 1 -- 172.21.15.172:0/2528865369 learned_addr learned my addr 172.21.15.172:0/2528865369 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe8f2b640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe40b4f10 0x7febe41538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe9f2d640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7febe415fd40 0x7febe41516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe972c640 1 -- 172.21.15.172:0/2528865369 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7febe415fd40 msgr2=0x7febe41516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe972c640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7febe415fd40 0x7febe41516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe972c640 1 -- 172.21.15.172:0/2528865369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe40b4f10 msgr2=0x7febe41538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe972c640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe40b4f10 0x7febe41538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe972c640 1 -- 172.21.15.172:0/2528865369 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe41590a0 con 0x7febe40af5e0 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe8f2b640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe40b4f10 0x7febe41538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febe972c640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40af5e0 0x7febe409b630 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7febe002a2b0 tx=0x7febe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febd9ffb640 1 -- 172.21.15.172:0/2528865369 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0041020 con 0x7febe40af5e0 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febd9ffb640 1 -- 172.21.15.172:0/2528865369 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe00306c0 con 0x7febe40af5e0 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febeb990640 1 -- 172.21.15.172:0/2528865369 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe4158000 con 0x7febe40af5e0 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febd9ffb640 1 -- 172.21.15.172:0/2528865369 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0037040 con 0x7febe40af5e0 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.526+0000 7febeb990640 1 -- 172.21.15.172:0/2528865369 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe41585c0 con 0x7febe40af5e0 2024-04-25T08:51:45.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.527+0000 7febeb990640 1 -- 172.21.15.172:0/2528865369 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe4073a00 con 0x7febe40af5e0 2024-04-25T08:51:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.528+0000 7febd9ffb640 1 -- 172.21.15.172:0/2528865369 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7febe0044020 con 0x7febe40af5e0 2024-04-25T08:51:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.528+0000 7febd9ffb640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febc806b500 0x7febc806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.528+0000 7febd9ffb640 1 -- 172.21.15.172:0/2528865369 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7febe00aab20 con 0x7febe40af5e0 2024-04-25T08:51:45.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.528+0000 7febe8f2b640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febc806b500 0x7febc806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.529+0000 7febe8f2b640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febc806b500 0x7febc806d9c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7febe41f5230 tx=0x7febd4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:45.522 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.532+0000 7febd9ffb640 1 -- 172.21.15.172:0/2528865369 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7febe004b030 con 0x7febe40af5e0 2024-04-25T08:51:45.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.704+0000 7febeb990640 1 -- 172.21.15.172:0/2528865369 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febe4158960 con 0x7febe40af5e0 2024-04-25T08:51:45.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.704+0000 7febd9ffb640 1 -- 172.21.15.172:0/2528865369 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7febe00797c0 con 0x7febe40af5e0 2024-04-25T08:51:45.695 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:51:45.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 -- 172.21.15.172:0/2528865369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febc806b500 msgr2=0x7febc806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febc806b500 0x7febc806d9c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7febe41f5230 tx=0x7febd4009040 comp rx=0 tx=0).stop 2024-04-25T08:51:45.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 -- 172.21.15.172:0/2528865369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40af5e0 msgr2=0x7febe409b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40af5e0 0x7febe409b630 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7febe002a2b0 tx=0x7febe00046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 -- 172.21.15.172:0/2528865369 shutdown_connections 2024-04-25T08:51:45.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7febc806b500 0x7febc806d9c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febe40b4f10 0x7febe41538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7febe415fd40 0x7febe41516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 --2- 172.21.15.172:0/2528865369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febe40af5e0 0x7febe409b630 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 -- 172.21.15.172:0/2528865369 >> 172.21.15.172:0/2528865369 conn(0x7febe40cfec0 msgr2=0x7febe40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:45.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 -- 172.21.15.172:0/2528865369 shutdown_connections 2024-04-25T08:51:45.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.706+0000 7febeb990640 1 -- 172.21.15.172:0/2528865369 wait complete. 2024-04-25T08:51:45.707 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:45.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.814+0000 7fcc1624d640 1 Processor -- start 2024-04-25T08:51:45.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.814+0000 7fcc1624d640 1 -- start start 2024-04-25T08:51:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc1624d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcc1015dc90 0x7fcc101625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc1624d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc100cc8e0 0x7fcc1015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc1624d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1015f390 con 0x7fcc100d1810 2024-04-25T08:51:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc1624d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc100cce50 con 0x7fcc1015dc90 2024-04-25T08:51:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc1624d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10161af0 con 0x7fcc100cc8e0 2024-04-25T08:51:45.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc0f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcc1015dc90 0x7fcc101625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc0f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcc1015dc90 0x7fcc101625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40842/0 (socket says 172.21.15.172:40842) 2024-04-25T08:51:45.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc0f7fe640 1 -- 172.21.15.172:0/861463882 learned_addr learned my addr 172.21.15.172:0/861463882 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:45.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc0effd640 1 --2- 172.21.15.172:0/861463882 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc100cc8e0 0x7fcc1015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc0f7fe640 1 -- 172.21.15.172:0/861463882 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc100cc8e0 msgr2=0x7fcc1015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:45.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc0f7fe640 1 --2- 172.21.15.172:0/861463882 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc100cc8e0 0x7fcc1015ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc0f7fe640 1 -- 172.21.15.172:0/861463882 >> v1:172.21.15.186:6789/0 conn(0x7fcc100d1810 legacy=0x7fcc100cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.815+0000 7fcc0f7fe640 1 -- 172.21.15.172:0/861463882 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10161dd0 con 0x7fcc1015dc90 2024-04-25T08:51:45.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.816+0000 7fcc0f7fe640 1 --2- 172.21.15.172:0/861463882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1015dc90 0x7fcc101625d0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009870 tx=0x7fcc0002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314b33be3b38266e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:45.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.816+0000 7fcc0e7fc640 1 -- 172.21.15.172:0/861463882 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00037070 con 0x7fcc1015dc90 2024-04-25T08:51:45.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.816+0000 7fcc0e7fc640 1 -- 172.21.15.172:0/861463882 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00032440 con 0x7fcc1015dc90 2024-04-25T08:51:45.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.816+0000 7fcc0e7fc640 1 -- 172.21.15.172:0/861463882 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00032810 con 0x7fcc1015dc90 2024-04-25T08:51:45.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.817+0000 7fcc1624d640 1 -- 172.21.15.172:0/861463882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1015dc90 msgr2=0x7fcc101625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.816 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.817+0000 7fcc1624d640 1 --2- 172.21.15.172:0/861463882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1015dc90 0x7fcc101625d0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009870 tx=0x7fcc0002a1c0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.817+0000 7fcc1624d640 1 -- 172.21.15.172:0/861463882 shutdown_connections 2024-04-25T08:51:45.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.817+0000 7fcc1624d640 1 --2- 172.21.15.172:0/861463882 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc100cc8e0 0x7fcc1015ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.817+0000 7fcc1624d640 1 --2- 172.21.15.172:0/861463882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc1015dc90 0x7fcc101625d0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.817+0000 7fcc1624d640 1 -- 172.21.15.172:0/861463882 >> 172.21.15.172:0/861463882 conn(0x7fcc1006f590 msgr2=0x7fcc1006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:45.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.817+0000 7fcc1624d640 1 -- 172.21.15.172:0/861463882 shutdown_connections 2024-04-25T08:51:45.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.817+0000 7fcc1624d640 1 -- 172.21.15.172:0/861463882 wait complete. 2024-04-25T08:51:45.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.818+0000 7fcc1624d640 1 Processor -- start 2024-04-25T08:51:45.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.818+0000 7fcc1624d640 1 -- start start 2024-04-25T08:51:45.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc1624d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc100cc8e0 0x7fcc101f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc1624d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc100d1810 0x7fcc100b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc1624d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc1015dc90 0x7fcc101526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc1624d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1015e070 con 0x7fcc100d1810 2024-04-25T08:51:45.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc1624d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100cd130 con 0x7fcc100cc8e0 2024-04-25T08:51:45.818 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc1624d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1015e1f0 con 0x7fcc1015dc90 2024-04-25T08:51:45.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc100d1810 0x7fcc100b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0effd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc100d1810 0x7fcc100b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40854/0 (socket says 172.21.15.172:40854) 2024-04-25T08:51:45.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0effd640 1 -- 172.21.15.172:0/463492596 learned_addr learned my addr 172.21.15.172:0/463492596 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:45.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0f7fe640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc100cc8e0 0x7fcc101f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0ffff640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc1015dc90 0x7fcc101526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0effd640 1 -- 172.21.15.172:0/463492596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc1015dc90 msgr2=0x7fcc101526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0effd640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc1015dc90 0x7fcc101526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0effd640 1 -- 172.21.15.172:0/463492596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc100cc8e0 msgr2=0x7fcc101f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:45.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0effd640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc100cc8e0 0x7fcc101f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:45.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0effd640 1 -- 172.21.15.172:0/463492596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10153170 con 0x7fcc100d1810 2024-04-25T08:51:45.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.819+0000 7fcc0effd640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc100d1810 0x7fcc100b5970 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400d800 tx=0x7fcc0400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:45.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.820+0000 7fcbf7fff640 1 -- 172.21.15.172:0/463492596 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400b6c0 con 0x7fcc100d1810 2024-04-25T08:51:45.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.820+0000 7fcbf7fff640 1 -- 172.21.15.172:0/463492596 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04019070 con 0x7fcc100d1810 2024-04-25T08:51:45.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.820+0000 7fcc1624d640 1 -- 172.21.15.172:0/463492596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc100af760 con 0x7fcc100d1810 2024-04-25T08:51:45.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.820+0000 7fcbf7fff640 1 -- 172.21.15.172:0/463492596 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400ba80 con 0x7fcc100d1810 2024-04-25T08:51:45.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.820+0000 7fcc1624d640 1 -- 172.21.15.172:0/463492596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc10152bf0 con 0x7fcc100d1810 2024-04-25T08:51:45.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.821+0000 7fcc1624d640 1 -- 172.21.15.172:0/463492596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc10073990 con 0x7fcc100d1810 2024-04-25T08:51:45.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.821+0000 7fcbf7fff640 1 -- 172.21.15.172:0/463492596 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc0400bc20 con 0x7fcc100d1810 2024-04-25T08:51:45.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.821+0000 7fcbf7fff640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbfc06b4d0 0x7fcbfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:45.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.822+0000 7fcbf7fff640 1 -- 172.21.15.172:0/463492596 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fcc0408a800 con 0x7fcc100d1810 2024-04-25T08:51:45.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.822+0000 7fcc0f7fe640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbfc06b4d0 0x7fcbfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:45.821 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.822+0000 7fcc0f7fe640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbfc06b4d0 0x7fcbfc06d990 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcc00034000 tx=0x7fcc0002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:45.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:45.826+0000 7fcbf7fff640 1 -- 172.21.15.172:0/463492596 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc10153170 con 0x7fcc100d1810 2024-04-25T08:51:46.023 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.033+0000 7fcc1624d640 1 -- 172.21.15.172:0/463492596 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc100cc070 con 0x7fcc100d1810 2024-04-25T08:51:46.024 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.033+0000 7fcbf7fff640 1 -- 172.21.15.172:0/463492596 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4155 (secure 0 0 0) 0x7fcc04059530 con 0x7fcc100d1810 2024-04-25T08:51:46.024 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:46.024 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:51:36.323687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9291":{"gid":9291,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:46.024 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 78 2024-04-25T08:51:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.035+0000 7fcc1624d640 1 -- 172.21.15.172:0/463492596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbfc06b4d0 msgr2=0x7fcbfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.035+0000 7fcc1624d640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbfc06b4d0 0x7fcbfc06d990 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcc00034000 tx=0x7fcc0002e000 comp rx=0 tx=0).stop 2024-04-25T08:51:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.035+0000 7fcc1624d640 1 -- 172.21.15.172:0/463492596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc100d1810 msgr2=0x7fcc100b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.035+0000 7fcc1624d640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc100d1810 0x7fcc100b5970 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400d800 tx=0x7fcc0400dcc0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.035+0000 7fcc1624d640 1 -- 172.21.15.172:0/463492596 shutdown_connections 2024-04-25T08:51:46.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.035+0000 7fcc1624d640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fcbfc06b4d0 0x7fcbfc06d990 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.035+0000 7fcc1624d640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcc1015dc90 0x7fcc101526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.035+0000 7fcc1624d640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc100d1810 0x7fcc100b5970 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.035+0000 7fcc1624d640 1 --2- 172.21.15.172:0/463492596 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcc100cc8e0 0x7fcc101f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.035+0000 7fcc1624d640 1 -- 172.21.15.172:0/463492596 >> 172.21.15.172:0/463492596 conn(0x7fcc1006f590 msgr2=0x7fcc1015ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.036+0000 7fcc1624d640 1 -- 172.21.15.172:0/463492596 shutdown_connections 2024-04-25T08:51:46.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.036+0000 7fcc1624d640 1 -- 172.21.15.172:0/463492596 wait complete. 2024-04-25T08:51:46.037 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:51:46.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.143+0000 7efdff5e2640 1 Processor -- start 2024-04-25T08:51:46.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.143+0000 7efdff5e2640 1 -- start start 2024-04-25T08:51:46.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.144+0000 7efdff5e2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdf806abe0 0x7efdf806afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.144+0000 7efdff5e2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7efdf815d370 0x7efdf815d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.144+0000 7efdff5e2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf81626e0 con 0x7efdf80ce330 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.144+0000 7efdff5e2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf806b500 con 0x7efdf815d370 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.144+0000 7efdff5e2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8070270 con 0x7efdf806abe0 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.144+0000 7efdfcb7d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efdf80ce330 0x7efdf806fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42146/0 (socket says 172.21.15.172:42146) 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.144+0000 7efdfcb7d640 1 -- 172.21.15.172:0/271961831 learned_addr learned my addr 172.21.15.172:0/271961831 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfdb7f640 1 --2- 172.21.15.172:0/271961831 >> v2:172.21.15.186:3300/0 conn(0x7efdf815d370 0x7efdf815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfd37e640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdf806abe0 0x7efdf806afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533523402 0 0) 0x7efdf81626e0 con 0x7efdf80ce330 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde4003520 con 0x7efdf80ce330 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2339215024 0 0) 0x7efde4003520 con 0x7efdf80ce330 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdf806abe0 msgr2=0x7efdf806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:46.138 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdf806abe0 0x7efdf806afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 >> v2:172.21.15.186:3300/0 conn(0x7efdf815d370 msgr2=0x7efdf815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 --2- 172.21.15.172:0/271961831 >> v2:172.21.15.186:3300/0 conn(0x7efdf815d370 0x7efdf815d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80cd270 con 0x7efdf80ce330 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7efde8001670 con 0x7efdf80ce330 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 >> v1:172.21.15.172:6789/0 conn(0x7efdf80ce330 legacy=0x7efdf806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efde40039b0 0x7efde4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efde40043a0 0x7efde4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 0x7efde400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf806b500 con 0x7efde4004f90 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8070270 con 0x7efde40043a0 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde400bf30 con 0x7efde40039b0 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfdb7f640 1 --2- 172.21.15.172:0/271961831 >> v2:172.21.15.186:3300/0 conn(0x7efdf815d370 0x7efdf815d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfd37e640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdf806abe0 0x7efdf806afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfdb7f640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 0x7efde400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.139 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfcb7d640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efde40043a0 0x7efde4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfd37e640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efde40039b0 0x7efde4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfdb7f640 1 -- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efde40039b0 msgr2=0x7efde4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfdb7f640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efde40039b0 0x7efde4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfdb7f640 1 -- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efde40043a0 msgr2=0x7efde4004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfdb7f640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efde40043a0 0x7efde4004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.145+0000 7efdfdb7f640 1 -- 172.21.15.172:0/271961831 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4003520 con 0x7efde4004f90 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.146+0000 7efdfdb7f640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 0x7efde400b9c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7efdf0009c70 tx=0x7efde4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1029c4340b79a543 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.146+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0009840 con 0x7efde4004f90 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.146+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf0004020 con 0x7efde4004f90 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.146+0000 7efdeffff640 1 -- 172.21.15.172:0/271961831 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf00043d0 con 0x7efde4004f90 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.147+0000 7efdff5e2640 1 -- 172.21.15.172:0/271961831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 msgr2=0x7efde400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.147+0000 7efdff5e2640 1 --2- 172.21.15.172:0/271961831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 0x7efde400b9c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7efdf0009c70 tx=0x7efde4005830 comp rx=0 tx=0).stop 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.147+0000 7efdfdb7f640 1 -- 172.21.15.172:0/271961831 reap_dead start 2024-04-25T08:51:46.140 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.147+0000 7efdff5e2640 1 -- 172.21.15.172:0/271961831 shutdown_connections 2024-04-25T08:51:46.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.147+0000 7efdff5e2640 1 -- 172.21.15.172:0/271961831 >> 172.21.15.172:0/271961831 conn(0x7efdf80b2220 msgr2=0x7efdf80b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:46.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.147+0000 7efdff5e2640 1 -- 172.21.15.172:0/271961831 shutdown_connections 2024-04-25T08:51:46.141 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.147+0000 7efdff5e2640 1 -- 172.21.15.172:0/271961831 wait complete. 2024-04-25T08:51:46.143 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.148+0000 7efdff5e2640 1 Processor -- start 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.148+0000 7efdff5e2640 1 -- start start 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdff5e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 0x7efdf80cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdff5e2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdf80b4440 0x7efdf80b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdff5e2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdf80c9f90 0x7efdf80ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdff5e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80cdb10 con 0x7efde4004f90 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdff5e2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80cd830 con 0x7efdf80b4440 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdff5e2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8161780 con 0x7efdf80c9f90 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfd37e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 0x7efdf80cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfd37e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 0x7efdf80cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40864/0 (socket says 172.21.15.172:40864) 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfd37e640 1 -- 172.21.15.172:0/342479768 learned_addr learned my addr 172.21.15.172:0/342479768 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfdb7f640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdf80c9f90 0x7efdf80ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfcb7d640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdf80b4440 0x7efdf80b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.144 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfd37e640 1 -- 172.21.15.172:0/342479768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdf80c9f90 msgr2=0x7efdf80ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfd37e640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdf80c9f90 0x7efdf80ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfd37e640 1 -- 172.21.15.172:0/342479768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdf80b4440 msgr2=0x7efdf80b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfd37e640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdf80b4440 0x7efdf80b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfd37e640 1 -- 172.21.15.172:0/342479768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80b4f00 con 0x7efde4004f90 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfcb7d640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdf80b4440 0x7efdf80b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdfd37e640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 0x7efdf80cfd00 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7efdf4007f20 tx=0x7efdf4011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdedffb640 1 -- 172.21.15.172:0/342479768 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf401a020 con 0x7efde4004f90 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdedffb640 1 -- 172.21.15.172:0/342479768 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4016470 con 0x7efde4004f90 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdff5e2640 1 -- 172.21.15.172:0/342479768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf80b51e0 con 0x7efde4004f90 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.149+0000 7efdedffb640 1 -- 172.21.15.172:0/342479768 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4016860 con 0x7efde4004f90 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.150+0000 7efdff5e2640 1 -- 172.21.15.172:0/342479768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf80b57a0 con 0x7efde4004f90 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.151+0000 7efdff5e2640 1 -- 172.21.15.172:0/342479768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf8073990 con 0x7efde4004f90 2024-04-25T08:51:46.145 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.151+0000 7efdedffb640 1 -- 172.21.15.172:0/342479768 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efdf4005d10 con 0x7efde4004f90 2024-04-25T08:51:46.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.151+0000 7efdedffb640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efddc06b4d0 0x7efddc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.151+0000 7efdedffb640 1 -- 172.21.15.172:0/342479768 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7efdf408b410 con 0x7efde4004f90 2024-04-25T08:51:46.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.151+0000 7efdfcb7d640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efddc06b4d0 0x7efddc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.152+0000 7efdfcb7d640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efddc06b4d0 0x7efddc06d990 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7efdf81f78f0 tx=0x7efde8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:46.146 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.156+0000 7efdedffb640 1 -- 172.21.15.172:0/342479768 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efdf4024030 con 0x7efde4004f90 2024-04-25T08:51:46.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.327+0000 7efdff5e2640 1 -- 172.21.15.172:0/342479768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdf80b6670 con 0x7efde4004f90 2024-04-25T08:51:46.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.328+0000 7efdedffb640 1 -- 172.21.15.172:0/342479768 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+17091 (secure 0 0 0) 0x7efdf405a0b0 con 0x7efde4004f90 2024-04-25T08:51:46.319 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:46.319 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":132,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:51:34.301519+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:50.627461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:51.373323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6837/3347790695":"2024-04-26T08:51:34.301451+0000","172.21.15.172:6836/3347790695":"2024-04-26T08:51:34.301451+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 -- 172.21.15.172:0/342479768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efddc06b4d0 msgr2=0x7efddc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efddc06b4d0 0x7efddc06d990 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7efdf81f78f0 tx=0x7efde8009040 comp rx=0 tx=0).stop 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 -- 172.21.15.172:0/342479768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 msgr2=0x7efdf80cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 0x7efdf80cfd00 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7efdf4007f20 tx=0x7efdf4011660 comp rx=0 tx=0).stop 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 -- 172.21.15.172:0/342479768 shutdown_connections 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7efddc06b4d0 0x7efddc06d990 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdf80b4440 0x7efdf80b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdf80c9f90 0x7efdf80ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 --2- 172.21.15.172:0/342479768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efde4004f90 0x7efdf80cfd00 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 -- 172.21.15.172:0/342479768 >> 172.21.15.172:0/342479768 conn(0x7efdf80b2220 msgr2=0x7efdf80cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:46.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 -- 172.21.15.172:0/342479768 shutdown_connections 2024-04-25T08:51:46.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.330+0000 7efdff5e2640 1 -- 172.21.15.172:0/342479768 wait complete. 2024-04-25T08:51:46.333 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:51:46.333 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:46.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.440+0000 7fa4d63d5640 1 Processor -- start 2024-04-25T08:51:46.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.441+0000 7fa4d63d5640 1 -- start start 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.441+0000 7fa4d63d5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa4d01602e0 0x7fa4d00ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.441+0000 7fa4d63d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4d015f5f0 0x7fa4d015fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.441+0000 7fa4d63d5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d00cd710 con 0x7fa4d015ba00 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.441+0000 7fa4d63d5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d015ff80 con 0x7fa4d015f5f0 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.441+0000 7fa4d63d5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d0099b70 con 0x7fa4d01602e0 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.441+0000 7fa4d4972640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4d015f5f0 0x7fa4d015fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.441+0000 7fa4cffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa4d015ba00 0x7fa4d009a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42162/0 (socket says 172.21.15.172:42162) 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.441+0000 7fa4d4972640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4d015f5f0 0x7fa4d015fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40874/0 (socket says 172.21.15.172:40874) 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.441+0000 7fa4cffff640 1 -- 172.21.15.172:0/1982471431 learned_addr learned my addr 172.21.15.172:0/1982471431 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.442+0000 7fa4cf7fe640 1 --2- 172.21.15.172:0/1982471431 >> v2:172.21.15.186:3300/0 conn(0x7fa4d01602e0 0x7fa4d00ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.442+0000 7fa4d4972640 1 -- 172.21.15.172:0/1982471431 >> v2:172.21.15.186:3300/0 conn(0x7fa4d01602e0 msgr2=0x7fa4d00ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:46.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.442+0000 7fa4d4972640 1 --2- 172.21.15.172:0/1982471431 >> v2:172.21.15.186:3300/0 conn(0x7fa4d01602e0 0x7fa4d00ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.442+0000 7fa4d4972640 1 -- 172.21.15.172:0/1982471431 >> v1:172.21.15.172:6789/0 conn(0x7fa4d015ba00 legacy=0x7fa4d009a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.442+0000 7fa4ceffd640 1 -- 172.21.15.172:0/1982471431 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908402546 0 0) 0x7fa4c0001110 con 0x7fa4d015ba00 2024-04-25T08:51:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.442+0000 7fa4d4972640 1 -- 172.21.15.172:0/1982471431 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0099e50 con 0x7fa4d015f5f0 2024-04-25T08:51:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.442+0000 7fa4d4972640 1 --2- 172.21.15.172:0/1982471431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 0x7fa4d015fa40 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00b7830 tx=0x7fa4c802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4a7f5560b3fd20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4ceffd640 1 -- 172.21.15.172:0/1982471431 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8007740 con 0x7fa4d015f5f0 2024-04-25T08:51:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4ceffd640 1 -- 172.21.15.172:0/1982471431 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c80078e0 con 0x7fa4d015f5f0 2024-04-25T08:51:46.434 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4ceffd640 1 -- 172.21.15.172:0/1982471431 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8007cb0 con 0x7fa4d015f5f0 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4d63d5640 1 -- 172.21.15.172:0/1982471431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 msgr2=0x7fa4d015fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4d63d5640 1 --2- 172.21.15.172:0/1982471431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 0x7fa4d015fa40 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00b7830 tx=0x7fa4c802a560 comp rx=0 tx=0).stop 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4d63d5640 1 -- 172.21.15.172:0/1982471431 shutdown_connections 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4d63d5640 1 --2- 172.21.15.172:0/1982471431 >> v2:172.21.15.186:3300/0 conn(0x7fa4d01602e0 0x7fa4d00ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4d63d5640 1 --2- 172.21.15.172:0/1982471431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 0x7fa4d015fa40 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4d63d5640 1 -- 172.21.15.172:0/1982471431 >> 172.21.15.172:0/1982471431 conn(0x7fa4d00b3270 msgr2=0x7fa4d00b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4d63d5640 1 -- 172.21.15.172:0/1982471431 shutdown_connections 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.443+0000 7fa4d63d5640 1 -- 172.21.15.172:0/1982471431 wait complete. 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.444+0000 7fa4d63d5640 1 Processor -- start 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.445+0000 7fa4d63d5640 1 -- start start 2024-04-25T08:51:46.437 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.445+0000 7fa4d63d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4d015ba00 0x7fa4d015e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.445+0000 7fa4d63d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 0x7fa4d00b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.445+0000 7fa4d63d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4d01602e0 0x7fa4d00c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.445+0000 7fa4d63d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d015bde0 con 0x7fa4d015f5f0 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.445+0000 7fa4d63d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00cd2e0 con 0x7fa4d01602e0 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.445+0000 7fa4d63d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00c8dc0 con 0x7fa4d015ba00 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.445+0000 7fa4cf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 0x7fa4d00b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.445+0000 7fa4cf7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 0x7fa4d00b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40886/0 (socket says 172.21.15.172:40886) 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.445+0000 7fa4cf7fe640 1 -- 172.21.15.172:0/2354474488 learned_addr learned my addr 172.21.15.172:0/2354474488 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4d4972640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4d01602e0 0x7fa4d00c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4cffff640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4d015ba00 0x7fa4d015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4cf7fe640 1 -- 172.21.15.172:0/2354474488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4d015ba00 msgr2=0x7fa4d015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4cf7fe640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4d015ba00 0x7fa4d015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4cf7fe640 1 -- 172.21.15.172:0/2354474488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4d01602e0 msgr2=0x7fa4d00c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4cf7fe640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4d01602e0 0x7fa4d00c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4cf7fe640 1 -- 172.21.15.172:0/2354474488 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00c90a0 con 0x7fa4d015f5f0 2024-04-25T08:51:46.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4cffff640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4d015ba00 0x7fa4d015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:46.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4cf7fe640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 0x7fa4d00b48f0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400e8a0 tx=0x7fa4c400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:46.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4ccff9640 1 -- 172.21.15.172:0/2354474488 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4017070 con 0x7fa4d015f5f0 2024-04-25T08:51:46.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4ccff9640 1 -- 172.21.15.172:0/2354474488 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c400c940 con 0x7fa4d015f5f0 2024-04-25T08:51:46.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4ccff9640 1 -- 172.21.15.172:0/2354474488 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c400cd30 con 0x7fa4d015f5f0 2024-04-25T08:51:46.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4d63d5640 1 -- 172.21.15.172:0/2354474488 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d00c9380 con 0x7fa4d015f5f0 2024-04-25T08:51:46.439 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.446+0000 7fa4d63d5640 1 -- 172.21.15.172:0/2354474488 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d00c9940 con 0x7fa4d015f5f0 2024-04-25T08:51:46.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.447+0000 7fa4d63d5640 1 -- 172.21.15.172:0/2354474488 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d0073990 con 0x7fa4d015f5f0 2024-04-25T08:51:46.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.448+0000 7fa4ccff9640 1 -- 172.21.15.172:0/2354474488 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa4c401a070 con 0x7fa4d015f5f0 2024-04-25T08:51:46.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.448+0000 7fa4ccff9640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4bc06b4d0 0x7fa4bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.448+0000 7fa4ccff9640 1 -- 172.21.15.172:0/2354474488 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa4c408a680 con 0x7fa4d015f5f0 2024-04-25T08:51:46.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.448+0000 7fa4cffff640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4bc06b4d0 0x7fa4bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.448+0000 7fa4cffff640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4bc06b4d0 0x7fa4bc06d990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00013b0 tx=0x7fa4c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:46.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.452+0000 7fa4ccff9640 1 -- 172.21.15.172:0/2354474488 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa4c4059320 con 0x7fa4d015f5f0 2024-04-25T08:51:46.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.659+0000 7fa4d63d5640 1 -- 172.21.15.172:0/2354474488 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4d00b2560 con 0x7fa4d015f5f0 2024-04-25T08:51:46.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.659+0000 7fa4ccff9640 1 -- 172.21.15.172:0/2354474488 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4155 (secure 0 0 0) 0x7fa4c4058c20 con 0x7fa4d015f5f0 2024-04-25T08:51:46.650 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:46.650 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:51:36.323687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9291":{"gid":9291,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:46.650 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 78 2024-04-25T08:51:46.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.661+0000 7fa4d63d5640 1 -- 172.21.15.172:0/2354474488 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4bc06b4d0 msgr2=0x7fa4bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.661+0000 7fa4d63d5640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4bc06b4d0 0x7fa4bc06d990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00013b0 tx=0x7fa4c0009040 comp rx=0 tx=0).stop 2024-04-25T08:51:46.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.661+0000 7fa4d63d5640 1 -- 172.21.15.172:0/2354474488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 msgr2=0x7fa4d00b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.661+0000 7fa4d63d5640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 0x7fa4d00b48f0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400e8a0 tx=0x7fa4c400eca0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.661+0000 7fa4d63d5640 1 -- 172.21.15.172:0/2354474488 shutdown_connections 2024-04-25T08:51:46.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.661+0000 7fa4d63d5640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4bc06b4d0 0x7fa4bc06d990 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.661+0000 7fa4d63d5640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4d01602e0 0x7fa4d00c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.661+0000 7fa4d63d5640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4d015f5f0 0x7fa4d00b48f0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.661+0000 7fa4d63d5640 1 --2- 172.21.15.172:0/2354474488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa4d015ba00 0x7fa4d015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.661+0000 7fa4d63d5640 1 -- 172.21.15.172:0/2354474488 >> 172.21.15.172:0/2354474488 conn(0x7fa4d00b3270 msgr2=0x7fa4d0070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:46.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.662+0000 7fa4d63d5640 1 -- 172.21.15.172:0/2354474488 shutdown_connections 2024-04-25T08:51:46.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.662+0000 7fa4d63d5640 1 -- 172.21.15.172:0/2354474488 wait complete. 2024-04-25T08:51:46.663 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:46.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.770+0000 7f77ac9d5640 1 Processor -- start 2024-04-25T08:51:46.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.770+0000 7f77ac9d5640 1 -- start start 2024-04-25T08:51:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.771+0000 7f77ac9d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77a80cfec0 0x7f77a80cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.771+0000 7f77ac9d5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f77a80ce3c0 0x7f77a806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.771+0000 7f77ac9d5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a8071480 con 0x7f77a8154ee0 2024-04-25T08:51:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.771+0000 7f77ac9d5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a80ce830 con 0x7f77a80cfec0 2024-04-25T08:51:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.771+0000 7f77ac9d5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a8072090 con 0x7f77a80ce3c0 2024-04-25T08:51:46.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.771+0000 7f77a5d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77a80cfec0 0x7f77a80cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.772+0000 7f77a5d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77a80cfec0 0x7f77a80cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40892/0 (socket says 172.21.15.172:40892) 2024-04-25T08:51:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.772+0000 7f77a5d9b640 1 -- 172.21.15.172:0/927212009 learned_addr learned my addr 172.21.15.172:0/927212009 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.772+0000 7f77a6d9d640 1 --2- 172.21.15.172:0/927212009 >> v2:172.21.15.186:3300/0 conn(0x7f77a80ce3c0 0x7f77a806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.772+0000 7f77a5d9b640 1 -- 172.21.15.172:0/927212009 >> v2:172.21.15.186:3300/0 conn(0x7f77a80ce3c0 msgr2=0x7f77a806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.772+0000 7f77a5d9b640 1 --2- 172.21.15.172:0/927212009 >> v2:172.21.15.186:3300/0 conn(0x7f77a80ce3c0 0x7f77a806d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.772+0000 7f77a5d9b640 1 -- 172.21.15.172:0/927212009 >> v1:172.21.15.186:6789/0 conn(0x7f77a8154ee0 legacy=0x7f77a80cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:46.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.772+0000 7f77a5d9b640 1 -- 172.21.15.172:0/927212009 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a8071760 con 0x7f77a80cfec0 2024-04-25T08:51:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.772+0000 7f77a5d9b640 1 --2- 172.21.15.172:0/927212009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a80cfec0 0x7f77a80cde80 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f77a806f240 tx=0x7f779c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9534ad6916326f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77a559a640 1 -- 172.21.15.172:0/927212009 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c037070 con 0x7f77a80cfec0 2024-04-25T08:51:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77a559a640 1 -- 172.21.15.172:0/927212009 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c032440 con 0x7f77a80cfec0 2024-04-25T08:51:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77a559a640 1 -- 172.21.15.172:0/927212009 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c032810 con 0x7f77a80cfec0 2024-04-25T08:51:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77ac9d5640 1 -- 172.21.15.172:0/927212009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a80cfec0 msgr2=0x7f77a80cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77ac9d5640 1 --2- 172.21.15.172:0/927212009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a80cfec0 0x7f77a80cde80 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f77a806f240 tx=0x7f779c02a230 comp rx=0 tx=0).stop 2024-04-25T08:51:46.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77ac9d5640 1 -- 172.21.15.172:0/927212009 shutdown_connections 2024-04-25T08:51:46.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77ac9d5640 1 --2- 172.21.15.172:0/927212009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a80cfec0 0x7f77a80cde80 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77ac9d5640 1 --2- 172.21.15.172:0/927212009 >> v2:172.21.15.186:3300/0 conn(0x7f77a80ce3c0 0x7f77a806d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77ac9d5640 1 -- 172.21.15.172:0/927212009 >> 172.21.15.172:0/927212009 conn(0x7f77a806abe0 msgr2=0x7f77a806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:46.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77ac9d5640 1 -- 172.21.15.172:0/927212009 shutdown_connections 2024-04-25T08:51:46.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.773+0000 7f77ac9d5640 1 -- 172.21.15.172:0/927212009 wait complete. 2024-04-25T08:51:46.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.775+0000 7f77ac9d5640 1 Processor -- start 2024-04-25T08:51:46.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.775+0000 7f77ac9d5640 1 -- start start 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.775+0000 7f77ac9d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77a80ce3c0 0x7f77a813aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.775+0000 7f77ac9d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77a80cfec0 0x7f77a814d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.775+0000 7f77ac9d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a8154ee0 0x7f77a814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.775+0000 7f77ac9d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8071d20 con 0x7f77a8154ee0 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.775+0000 7f77ac9d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8071230 con 0x7f77a80cfec0 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.775+0000 7f77ac9d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a81552c0 con 0x7f77a80ce3c0 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.775+0000 7f77a6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a8154ee0 0x7f77a814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a8154ee0 0x7f77a814d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40900/0 (socket says 172.21.15.172:40900) 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a6d9d640 1 -- 172.21.15.172:0/1008177464 learned_addr learned my addr 172.21.15.172:0/1008177464 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a5d9b640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77a80cfec0 0x7f77a814d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a659c640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77a80ce3c0 0x7f77a813aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a6d9d640 1 -- 172.21.15.172:0/1008177464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77a80ce3c0 msgr2=0x7f77a813aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a6d9d640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77a80ce3c0 0x7f77a813aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a6d9d640 1 -- 172.21.15.172:0/1008177464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77a80cfec0 msgr2=0x7f77a814d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a6d9d640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77a80cfec0 0x7f77a814d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a6d9d640 1 -- 172.21.15.172:0/1008177464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a814b990 con 0x7f77a8154ee0 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a5d9b640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77a80cfec0 0x7f77a814d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77a6d9d640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a8154ee0 0x7f77a814d870 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f77a000d830 tx=0x7f77a000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f7796ffd640 1 -- 172.21.15.172:0/1008177464 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a000b660 con 0x7f77a8154ee0 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f7796ffd640 1 -- 172.21.15.172:0/1008177464 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a0019070 con 0x7f77a8154ee0 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f7796ffd640 1 -- 172.21.15.172:0/1008177464 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a000ba60 con 0x7f77a8154ee0 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77ac9d5640 1 -- 172.21.15.172:0/1008177464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a813b420 con 0x7f77a8154ee0 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.776+0000 7f77ac9d5640 1 -- 172.21.15.172:0/1008177464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a814e180 con 0x7f77a8154ee0 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.777+0000 7f77ac9d5640 1 -- 172.21.15.172:0/1008177464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a8073990 con 0x7f77a8154ee0 2024-04-25T08:51:46.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.777+0000 7f7796ffd640 1 -- 172.21.15.172:0/1008177464 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f77a001e460 con 0x7f77a8154ee0 2024-04-25T08:51:46.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.778+0000 7f7796ffd640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f778806b4d0 0x7f778806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:46.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.778+0000 7f7796ffd640 1 -- 172.21.15.172:0/1008177464 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f77a008aaa0 con 0x7f77a8154ee0 2024-04-25T08:51:46.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.778+0000 7f77a659c640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f778806b4d0 0x7f778806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:46.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.778+0000 7f77a659c640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f778806b4d0 0x7f778806d990 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7798009f20 tx=0x7f77980094d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:46.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.782+0000 7f7796ffd640 1 -- 172.21.15.172:0/1008177464 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f77a00596b0 con 0x7f77a8154ee0 2024-04-25T08:51:46.980 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.990+0000 7f77ac9d5640 1 -- 172.21.15.172:0/1008177464 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77a80b48d0 con 0x7f77a8154ee0 2024-04-25T08:51:46.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.991+0000 7f7796ffd640 1 -- 172.21.15.172:0/1008177464 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4155 (secure 0 0 0) 0x7f77a0058fb0 con 0x7f77a8154ee0 2024-04-25T08:51:46.981 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:46.981 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:50:52.392874+0000","modified":"2024-04-25T08:51:36.323687+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":132,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9291":{"gid":9291,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":15,"addr":"172.21.15.172:6835/480561463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":480561463},{"type":"v1","addr":"172.21.15.172:6835","nonce":480561463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-04-25T08:51:46.981 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 78 2024-04-25T08:51:46.983 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 -- 172.21.15.172:0/1008177464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f778806b4d0 msgr2=0x7f778806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f778806b4d0 0x7f778806d990 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7798009f20 tx=0x7f77980094d0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 -- 172.21.15.172:0/1008177464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a8154ee0 msgr2=0x7f77a814d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a8154ee0 0x7f77a814d870 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f77a000d830 tx=0x7f77a000dcf0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 -- 172.21.15.172:0/1008177464 shutdown_connections 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f778806b4d0 0x7f778806d990 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77a80cfec0 0x7f77a814d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a8154ee0 0x7f77a814d870 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 --2- 172.21.15.172:0/1008177464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f77a80ce3c0 0x7f77a813aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 -- 172.21.15.172:0/1008177464 >> 172.21.15.172:0/1008177464 conn(0x7f77a806abe0 msgr2=0x7f77a815c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 -- 172.21.15.172:0/1008177464 shutdown_connections 2024-04-25T08:51:46.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:46.993+0000 7f77ac9d5640 1 -- 172.21.15.172:0/1008177464 wait complete. 2024-04-25T08:51:46.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:51:47.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.103+0000 7fa8b6ee4640 1 Processor -- start 2024-04-25T08:51:47.094 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.103+0000 7fa8b6ee4640 1 -- start start 2024-04-25T08:51:47.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b6ee4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa8b00d2e90 0x7fa8b00d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b6ee4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8b00d0900 0x7fa8b00b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b6ee4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00b9940 con 0x7fa8b015dd30 2024-04-25T08:51:47.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b6ee4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b00d0d40 con 0x7fa8b00d0900 2024-04-25T08:51:47.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b6ee4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b00d1df0 con 0x7fa8b00d2e90 2024-04-25T08:51:47.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b4c80640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa8b015dd30 0x7fa8b00b9230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:42170/0 (socket says 172.21.15.172:42170) 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b4c80640 1 -- 172.21.15.172:0/1222455679 learned_addr learned my addr 172.21.15.172:0/1222455679 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b5481640 1 --2- 172.21.15.172:0/1222455679 >> v2:172.21.15.172:3300/0 conn(0x7fa8b00d0900 0x7fa8b00b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8affff640 1 --2- 172.21.15.172:0/1222455679 >> v2:172.21.15.186:3300/0 conn(0x7fa8b00d2e90 0x7fa8b00d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8af7fe640 1 -- 172.21.15.172:0/1222455679 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565020634 0 0) 0x7fa8b00b9940 con 0x7fa8b015dd30 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8af7fe640 1 -- 172.21.15.172:0/1222455679 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a0003520 con 0x7fa8b015dd30 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b5481640 1 -- 172.21.15.172:0/1222455679 >> v2:172.21.15.186:3300/0 conn(0x7fa8b00d2e90 msgr2=0x7fa8b00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b5481640 1 --2- 172.21.15.172:0/1222455679 >> v2:172.21.15.186:3300/0 conn(0x7fa8b00d2e90 0x7fa8b00d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b5481640 1 -- 172.21.15.172:0/1222455679 >> v1:172.21.15.172:6789/0 conn(0x7fa8b015dd30 legacy=0x7fa8b00b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.104+0000 7fa8b5481640 1 -- 172.21.15.172:0/1222455679 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00d20d0 con 0x7fa8b00d0900 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.105+0000 7fa8b5481640 1 --2- 172.21.15.172:0/1222455679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b00d0900 0x7fa8b00b6a40 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00b6540 tx=0x7fa8a802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2008b719b8379e07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.105+0000 7fa8af7fe640 1 -- 172.21.15.172:0/1222455679 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8007740 con 0x7fa8b00d0900 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.105+0000 7fa8af7fe640 1 -- 172.21.15.172:0/1222455679 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a80078e0 con 0x7fa8b00d0900 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.105+0000 7fa8af7fe640 1 -- 172.21.15.172:0/1222455679 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8007cb0 con 0x7fa8b00d0900 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.106+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1222455679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b00d0900 msgr2=0x7fa8b00b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.106+0000 7fa8b6ee4640 1 --2- 172.21.15.172:0/1222455679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b00d0900 0x7fa8b00b6a40 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00b6540 tx=0x7fa8a802a560 comp rx=0 tx=0).stop 2024-04-25T08:51:47.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.106+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1222455679 shutdown_connections 2024-04-25T08:51:47.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.106+0000 7fa8b6ee4640 1 --2- 172.21.15.172:0/1222455679 >> v2:172.21.15.186:3300/0 conn(0x7fa8b00d2e90 0x7fa8b00d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.106+0000 7fa8b6ee4640 1 --2- 172.21.15.172:0/1222455679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b00d0900 0x7fa8b00b6a40 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.106+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1222455679 >> 172.21.15.172:0/1222455679 conn(0x7fa8b0061c30 msgr2=0x7fa8b006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:47.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.106+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1222455679 shutdown_connections 2024-04-25T08:51:47.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.106+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1222455679 wait complete. 2024-04-25T08:51:47.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.107+0000 7fa8b6ee4640 1 Processor -- start 2024-04-25T08:51:47.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.107+0000 7fa8b6ee4640 1 -- start start 2024-04-25T08:51:47.101 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b6ee4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8b00d0900 0x7fa8b014d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b6ee4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8b00d2e90 0x7fa8b00ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b6ee4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b015dd30 0x7fa8b00caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b6ee4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00d2970 con 0x7fa8b015dd30 2024-04-25T08:51:47.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b6ee4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00d2690 con 0x7fa8b00d2e90 2024-04-25T08:51:47.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b6ee4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00d1a10 con 0x7fa8b00d0900 2024-04-25T08:51:47.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b5481640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b015dd30 0x7fa8b00caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b5481640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b015dd30 0x7fa8b00caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40924/0 (socket says 172.21.15.172:40924) 2024-04-25T08:51:47.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b5481640 1 -- 172.21.15.172:0/1382743020 learned_addr learned my addr 172.21.15.172:0/1382743020 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:47.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8affff640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8b00d2e90 0x7fa8b00ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b4c80640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8b00d0900 0x7fa8b014d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b5481640 1 -- 172.21.15.172:0/1382743020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8b00d0900 msgr2=0x7fa8b014d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b5481640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8b00d0900 0x7fa8b014d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b5481640 1 -- 172.21.15.172:0/1382743020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8b00d2e90 msgr2=0x7fa8b00ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b5481640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8b00d2e90 0x7fa8b00ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b5481640 1 -- 172.21.15.172:0/1382743020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b014dcc0 con 0x7fa8b015dd30 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b4c80640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8b00d0900 0x7fa8b014d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8b5481640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b015dd30 0x7fa8b00caa80 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009e50 tx=0x7fa8a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.108+0000 7fa8ad7fa640 1 -- 172.21.15.172:0/1382743020 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8040070 con 0x7fa8b015dd30 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.109+0000 7fa8ad7fa640 1 -- 172.21.15.172:0/1382743020 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8031bf0 con 0x7fa8b015dd30 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.109+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1382743020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b00cd170 con 0x7fa8b015dd30 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.109+0000 7fa8ad7fa640 1 -- 172.21.15.172:0/1382743020 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8009450 con 0x7fa8b015dd30 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.109+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1382743020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b014b360 con 0x7fa8b015dd30 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.110+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1382743020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b0073990 con 0x7fa8b015dd30 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.110+0000 7fa8ad7fa640 1 -- 172.21.15.172:0/1382743020 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa8a8039040 con 0x7fa8b015dd30 2024-04-25T08:51:47.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.110+0000 7fa8ad7fa640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa89406b4d0 0x7fa89406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.110+0000 7fa8ad7fa640 1 -- 172.21.15.172:0/1382743020 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa8a80abb10 con 0x7fa8b015dd30 2024-04-25T08:51:47.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.110+0000 7fa8b4c80640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa89406b4d0 0x7fa89406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.111+0000 7fa8b4c80640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa89406b4d0 0x7fa89406d990 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4005880 tx=0x7fa8a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:47.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.114+0000 7fa8ad7fa640 1 -- 172.21.15.172:0/1382743020 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8b014dcc0 con 0x7fa8b015dd30 2024-04-25T08:51:47.277 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.287+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1382743020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8b00c9e60 con 0x7fa8b015dd30 2024-04-25T08:51:47.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.288+0000 7fa8ad7fa640 1 -- 172.21.15.172:0/1382743020 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+17091 (secure 0 0 0) 0x7fa8a8080030 con 0x7fa8b015dd30 2024-04-25T08:51:47.279 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:47.279 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":132,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:51:34.301519+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:50:50.627461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-04-25T08:50:51.373323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6837/3347790695":"2024-04-26T08:51:34.301451+0000","172.21.15.172:6836/3347790695":"2024-04-26T08:51:34.301451+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:51:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1382743020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa89406b4d0 msgr2=0x7fa89406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa89406b4d0 0x7fa89406d990 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4005880 tx=0x7fa8a4009040 comp rx=0 tx=0).stop 2024-04-25T08:51:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1382743020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b015dd30 msgr2=0x7fa8b00caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b015dd30 0x7fa8b00caa80 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009e50 tx=0x7fa8a8004a40 comp rx=0 tx=0).stop 2024-04-25T08:51:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1382743020 shutdown_connections 2024-04-25T08:51:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa89406b4d0 0x7fa89406d990 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8b00d2e90 0x7fa8b00ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.281 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b015dd30 0x7fa8b00caa80 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 --2- 172.21.15.172:0/1382743020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8b00d0900 0x7fa8b014d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1382743020 >> 172.21.15.172:0/1382743020 conn(0x7fa8b0061c30 msgr2=0x7fa8b00c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:47.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1382743020 shutdown_connections 2024-04-25T08:51:47.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.290+0000 7fa8b6ee4640 1 -- 172.21.15.172:0/1382743020 wait complete. 2024-04-25T08:51:47.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:51:47.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.400+0000 7f69ef714640 1 Processor -- start 2024-04-25T08:51:47.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.400+0000 7f69ef714640 1 -- start start 2024-04-25T08:51:47.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ef714640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69e806abe0 0x7f69e80acec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ef714640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69e80b3920 0x7f69e806afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ef714640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e806db40 con 0x7f69e80b3d80 2024-04-25T08:51:47.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ef714640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e806de20 con 0x7f69e806abe0 2024-04-25T08:51:47.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ef714640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e806e100 con 0x7f69e80b3920 2024-04-25T08:51:47.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ed4b0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69e806abe0 0x7f69e80acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ed4b0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69e806abe0 0x7f69e80acec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40928/0 (socket says 172.21.15.172:40928) 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ed4b0640 1 -- 172.21.15.172:0/1489182631 learned_addr learned my addr 172.21.15.172:0/1489182631 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69eccaf640 1 --2- 172.21.15.172:0/1489182631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69e80b3920 0x7f69e806afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ed4b0640 1 -- 172.21.15.172:0/1489182631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69e80b3920 msgr2=0x7f69e806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ed4b0640 1 --2- 172.21.15.172:0/1489182631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69e80b3920 0x7f69e806afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ed4b0640 1 -- 172.21.15.172:0/1489182631 >> v1:172.21.15.186:6789/0 conn(0x7f69e80b3d80 legacy=0x7f69e806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.401+0000 7f69ed4b0640 1 -- 172.21.15.172:0/1489182631 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e806e3e0 con 0x7f69e806abe0 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.402+0000 7f69ed4b0640 1 --2- 172.21.15.172:0/1489182631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e806abe0 0x7f69e80acec0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009870 tx=0x7f69e402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2a7aba37155757 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.402+0000 7f69dffff640 1 -- 172.21.15.172:0/1489182631 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4037070 con 0x7f69e806abe0 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.402+0000 7f69dffff640 1 -- 172.21.15.172:0/1489182631 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e4032440 con 0x7f69e806abe0 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.402+0000 7f69dffff640 1 -- 172.21.15.172:0/1489182631 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4032810 con 0x7f69e806abe0 2024-04-25T08:51:47.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.402+0000 7f69ef714640 1 -- 172.21.15.172:0/1489182631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e806abe0 msgr2=0x7f69e80acec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.402+0000 7f69ef714640 1 --2- 172.21.15.172:0/1489182631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e806abe0 0x7f69e80acec0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009870 tx=0x7f69e402a180 comp rx=0 tx=0).stop 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.402+0000 7f69ef714640 1 -- 172.21.15.172:0/1489182631 shutdown_connections 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.402+0000 7f69ef714640 1 --2- 172.21.15.172:0/1489182631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69e80b3920 0x7f69e806afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.402+0000 7f69ef714640 1 --2- 172.21.15.172:0/1489182631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e806abe0 0x7f69e80acec0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.402+0000 7f69ef714640 1 -- 172.21.15.172:0/1489182631 >> 172.21.15.172:0/1489182631 conn(0x7f69e80cfec0 msgr2=0x7f69e80d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.403+0000 7f69ef714640 1 -- 172.21.15.172:0/1489182631 shutdown_connections 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.403+0000 7f69ef714640 1 -- 172.21.15.172:0/1489182631 wait complete. 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69ef714640 1 Processor -- start 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69ef714640 1 -- start start 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69ef714640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69e806abe0 0x7f69e8159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69ef714640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e80b3920 0x7f69e81e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69ef714640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69e80b3d80 0x7f69e81e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69ef714640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e806b680 con 0x7f69e80b3920 2024-04-25T08:51:47.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69ef714640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e806b500 con 0x7f69e80b3d80 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69ef714640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e806b800 con 0x7f69e806abe0 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69eccaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e80b3920 0x7f69e81e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69eccaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e80b3920 0x7f69e81e3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40942/0 (socket says 172.21.15.172:40942) 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.404+0000 7f69eccaf640 1 -- 172.21.15.172:0/938850452 learned_addr learned my addr 172.21.15.172:0/938850452 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69ed4b0640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69e806abe0 0x7f69e8159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69edcb1640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69e80b3d80 0x7f69e81e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69eccaf640 1 -- 172.21.15.172:0/938850452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69e806abe0 msgr2=0x7f69e8159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69eccaf640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69e806abe0 0x7f69e8159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69eccaf640 1 -- 172.21.15.172:0/938850452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69e80b3d80 msgr2=0x7f69e81e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69eccaf640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69e80b3d80 0x7f69e81e4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69eccaf640 1 -- 172.21.15.172:0/938850452 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e814a240 con 0x7f69e80b3920 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69edcb1640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69e80b3d80 0x7f69e81e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69eccaf640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e80b3920 0x7f69e81e3ef0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f69d800c7f0 tx=0x7f69d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:47.403 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69ddffb640 1 -- 172.21.15.172:0/938850452 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8015070 con 0x7f69e80b3920 2024-04-25T08:51:47.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69ddffb640 1 -- 172.21.15.172:0/938850452 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d8004220 con 0x7f69e80b3920 2024-04-25T08:51:47.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69ddffb640 1 -- 172.21.15.172:0/938850452 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8007620 con 0x7f69e80b3920 2024-04-25T08:51:47.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69ef714640 1 -- 172.21.15.172:0/938850452 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e81e4ad0 con 0x7f69e80b3920 2024-04-25T08:51:47.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.405+0000 7f69ef714640 1 -- 172.21.15.172:0/938850452 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e81e5a50 con 0x7f69e80b3920 2024-04-25T08:51:47.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.406+0000 7f69ef714640 1 -- 172.21.15.172:0/938850452 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e8073a00 con 0x7f69e80b3920 2024-04-25T08:51:47.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.407+0000 7f69ddffb640 1 -- 172.21.15.172:0/938850452 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f69d80079d0 con 0x7f69e80b3920 2024-04-25T08:51:47.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.407+0000 7f69ddffb640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69cc06b4d0 0x7f69cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.407+0000 7f69ddffb640 1 -- 172.21.15.172:0/938850452 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f69d808a3c0 con 0x7f69e80b3920 2024-04-25T08:51:47.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.407+0000 7f69ed4b0640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69cc06b4d0 0x7f69cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.407+0000 7f69ed4b0640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69cc06b4d0 0x7f69cc06d990 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f69e4034000 tx=0x7f69e402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:47.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.411+0000 7f69ddffb640 1 -- 172.21.15.172:0/938850452 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69e814a240 con 0x7f69e80b3920 2024-04-25T08:51:47.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.623+0000 7f69ef714640 1 -- 172.21.15.172:0/938850452 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f69e80ae620 con 0x7f69e80b3920 2024-04-25T08:51:47.613 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:51:47.623+0000 7f9412b2f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:51:47.617 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.626+0000 7f69ddffb640 1 -- 172.21.15.172:0/938850452 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7f69d80590f0 con 0x7f69e80b3920 2024-04-25T08:51:47.617 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:51:47.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 -- 172.21.15.172:0/938850452 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69cc06b4d0 msgr2=0x7f69cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69cc06b4d0 0x7f69cc06d990 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f69e4034000 tx=0x7f69e402e000 comp rx=0 tx=0).stop 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 -- 172.21.15.172:0/938850452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e80b3920 msgr2=0x7f69e81e3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e80b3920 0x7f69e81e3ef0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f69d800c7f0 tx=0x7f69d800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 -- 172.21.15.172:0/938850452 shutdown_connections 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f69cc06b4d0 0x7f69cc06d990 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69e80b3d80 0x7f69e81e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69e80b3920 0x7f69e81e3ef0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 --2- 172.21.15.172:0/938850452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69e806abe0 0x7f69e8159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 -- 172.21.15.172:0/938850452 >> 172.21.15.172:0/938850452 conn(0x7f69e80cfec0 msgr2=0x7f69e806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 -- 172.21.15.172:0/938850452 shutdown_connections 2024-04-25T08:51:47.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.629+0000 7f69ef714640 1 -- 172.21.15.172:0/938850452 wait complete. 2024-04-25T08:51:47.632 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:51:47.657 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:51:47.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.742+0000 7f727b26f640 1 Processor -- start 2024-04-25T08:51:47.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.742+0000 7f727b26f640 1 -- start start 2024-04-25T08:51:47.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.743+0000 7f727b26f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f727415eec0 0x7f72741689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.743+0000 7f727b26f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740d1770 con 0x7f727406ccd0 2024-04-25T08:51:47.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.743+0000 7f727b26f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7274162740 con 0x7f7274070dc0 2024-04-25T08:51:47.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.743+0000 7f727b26f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740b0eb0 con 0x7f727415eec0 2024-04-25T08:51:47.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.743+0000 7f727980c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f727415eec0 0x7f72741689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.743+0000 7f727880a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f727406ccd0 0x7f72740b07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60018/0 (socket says 172.21.15.172:60018) 2024-04-25T08:51:47.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.743+0000 7f727880a640 1 -- 172.21.15.172:0/71167504 learned_addr learned my addr 172.21.15.172:0/71167504 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:47.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.744+0000 7f727980c640 1 -- 172.21.15.172:0/71167504 >> v1:172.21.15.186:6789/0 conn(0x7f7274070dc0 legacy=0x7f72740711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:47.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.744+0000 7f727980c640 1 -- 172.21.15.172:0/71167504 >> v1:172.21.15.172:6789/0 conn(0x7f727406ccd0 legacy=0x7f72740b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.744+0000 7f727980c640 1 -- 172.21.15.172:0/71167504 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7274161980 con 0x7f727415eec0 2024-04-25T08:51:47.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.744+0000 7f726bfff640 1 -- 172.21.15.172:0/71167504 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880796329 0 0) 0x7f72740d1770 con 0x7f727406ccd0 2024-04-25T08:51:47.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.744+0000 7f727980c640 1 --2- 172.21.15.172:0/71167504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727415eec0 0x7f72741689d0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f726c0097a0 tx=0x7f726c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b0b552afdf54fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.744+0000 7f726bfff640 1 -- 172.21.15.172:0/71167504 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c037070 con 0x7f727415eec0 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.744+0000 7f726bfff640 1 -- 172.21.15.172:0/71167504 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c02adc0 con 0x7f727415eec0 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.744+0000 7f726bfff640 1 -- 172.21.15.172:0/71167504 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c032660 con 0x7f727415eec0 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.745+0000 7f727b26f640 1 -- 172.21.15.172:0/71167504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727415eec0 msgr2=0x7f72741689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.745+0000 7f727b26f640 1 --2- 172.21.15.172:0/71167504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727415eec0 0x7f72741689d0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f726c0097a0 tx=0x7f726c02a0b0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.745+0000 7f727b26f640 1 -- 172.21.15.172:0/71167504 shutdown_connections 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.745+0000 7f727b26f640 1 --2- 172.21.15.172:0/71167504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727415eec0 0x7f72741689d0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.745+0000 7f727b26f640 1 -- 172.21.15.172:0/71167504 >> 172.21.15.172:0/71167504 conn(0x7f72740b3530 msgr2=0x7f72740b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.745+0000 7f727b26f640 1 -- 172.21.15.172:0/71167504 shutdown_connections 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.745+0000 7f727b26f640 1 -- 172.21.15.172:0/71167504 wait complete. 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.746+0000 7f727b26f640 1 Processor -- start 2024-04-25T08:51:47.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.746+0000 7f727b26f640 1 -- start start 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727b26f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f727406ccd0 0x7f72740cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727b26f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7274070dc0 0x7f72740cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727b26f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f727415eec0 0x7f727414aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727b26f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740b10f0 con 0x7f7274070dc0 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727b26f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72741622b0 con 0x7f727406ccd0 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727b26f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7274161f40 con 0x7f727415eec0 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727880a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7274070dc0 0x7f72740cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727880a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7274070dc0 0x7f72740cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50242/0 (socket says 172.21.15.172:50242) 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727880a640 1 -- 172.21.15.172:0/598129328 learned_addr learned my addr 172.21.15.172:0/598129328 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727880a640 1 -- 172.21.15.172:0/598129328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f727415eec0 msgr2=0x7f727414aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727880a640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f727415eec0 0x7f727414aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727880a640 1 -- 172.21.15.172:0/598129328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f727406ccd0 msgr2=0x7f72740cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727880a640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f727406ccd0 0x7f72740cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727880a640 1 -- 172.21.15.172:0/598129328 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727414b7e0 con 0x7f7274070dc0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.747+0000 7f727880a640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7274070dc0 0x7f72740cf300 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f726400c4a0 tx=0x7f726400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.748+0000 7f7269ffb640 1 -- 172.21.15.172:0/598129328 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264018070 con 0x7f7274070dc0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.748+0000 7f7269ffb640 1 -- 172.21.15.172:0/598129328 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72640074e0 con 0x7f7274070dc0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.748+0000 7f7269ffb640 1 -- 172.21.15.172:0/598129328 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264004a20 con 0x7f7274070dc0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.748+0000 7f727b26f640 1 -- 172.21.15.172:0/598129328 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727414bac0 con 0x7f7274070dc0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.748+0000 7f727b26f640 1 -- 172.21.15.172:0/598129328 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72740cf840 con 0x7f7274070dc0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.749+0000 7f727b26f640 1 -- 172.21.15.172:0/598129328 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7274073a00 con 0x7f7274070dc0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.749+0000 7f7269ffb640 1 -- 172.21.15.172:0/598129328 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7264004bc0 con 0x7f7274070dc0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.749+0000 7f7269ffb640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f725806b4d0 0x7f725806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.750+0000 7f7269ffb640 1 -- 172.21.15.172:0/598129328 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f7264089770 con 0x7f7274070dc0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.750+0000 7f727900b640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f725806b4d0 0x7f725806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:47.743 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.750+0000 7f727900b640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f725806b4d0 0x7f725806d990 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7274160ee0 tx=0x7f7270007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:47.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.754+0000 7f7269ffb640 1 -- 172.21.15.172:0/598129328 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7264058440 con 0x7f7274070dc0 2024-04-25T08:51:47.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:47.959+0000 7f727b26f640 1 -- 172.21.15.172:0/598129328 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f727414bc90 con 0x7f7274070dc0 2024-04-25T08:51:48.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.630+0000 7f7269ffb640 1 -- 172.21.15.172:0/598129328 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7264057d40 con 0x7f7274070dc0 2024-04-25T08:51:48.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.632+0000 7f727b26f640 1 -- 172.21.15.172:0/598129328 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f725806b4d0 msgr2=0x7f725806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:48.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.632+0000 7f727b26f640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f725806b4d0 0x7f725806d990 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7274160ee0 tx=0x7f7270007d30 comp rx=0 tx=0).stop 2024-04-25T08:51:48.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.632+0000 7f727b26f640 1 -- 172.21.15.172:0/598129328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7274070dc0 msgr2=0x7f72740cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:48.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.632+0000 7f727b26f640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7274070dc0 0x7f72740cf300 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f726400c4a0 tx=0x7f726400c960 comp rx=0 tx=0).stop 2024-04-25T08:51:48.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.632+0000 7f727b26f640 1 -- 172.21.15.172:0/598129328 shutdown_connections 2024-04-25T08:51:48.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.632+0000 7f727b26f640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f725806b4d0 0x7f725806d990 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:48.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.632+0000 7f727b26f640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f727415eec0 0x7f727414aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:48.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.632+0000 7f727b26f640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7274070dc0 0x7f72740cf300 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:48.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.632+0000 7f727b26f640 1 --2- 172.21.15.172:0/598129328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f727406ccd0 0x7f72740cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:48.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.632+0000 7f727b26f640 1 -- 172.21.15.172:0/598129328 >> 172.21.15.172:0/598129328 conn(0x7f72740b3530 msgr2=0x7f72740b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:48.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.633+0000 7f727b26f640 1 -- 172.21.15.172:0/598129328 shutdown_connections 2024-04-25T08:51:48.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.633+0000 7f727b26f640 1 -- 172.21.15.172:0/598129328 wait complete. 2024-04-25T08:51:48.637 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:51:48.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.792+0000 7f0a1ed1d640 1 Processor -- start 2024-04-25T08:51:48.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.792+0000 7f0a1ed1d640 1 -- start start 2024-04-25T08:51:48.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a1ed1d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b5c40 0x7f0a180ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:48.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a1ed1d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a180cf320 con 0x7f0a1815b980 2024-04-25T08:51:48.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a1ed1d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a180cf040 con 0x7f0a1815b5a0 2024-04-25T08:51:48.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a1ed1d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18161970 con 0x7f0a180b5c40 2024-04-25T08:51:48.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a1d2ba640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0a1815b980 0x7f0a180ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60020/0 (socket says 172.21.15.172:60020) 2024-04-25T08:51:48.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a1d2ba640 1 -- 172.21.15.172:0/3778349605 learned_addr learned my addr 172.21.15.172:0/3778349605 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:48.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a17fff640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b5c40 0x7f0a180ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969522140 0 0) 0x7f0a10001490 con 0x7f0a1815b980 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a00003520 con 0x7f0a1815b980 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1245115740 0 0) 0x7f0a00003520 con 0x7f0a1815b980 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b5c40 msgr2=0x7f0a180ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a177fe640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b5c40 0x7f0a180ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 >> v1:172.21.15.186:6789/0 conn(0x7f0a1815b5a0 legacy=0x7f0a180b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a18161c50 con 0x7f0a1815b980 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.793+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f0a10001bc0 con 0x7f0a1815b980 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 >> v1:172.21.15.172:6789/0 conn(0x7f0a1815b980 legacy=0x7f0a180ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a177fe640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a000039e0 0x7f0a00003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a177fe640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b5c40 0x7f0a00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:48.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a177fe640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a00004d40 0x7f0a000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18161970 con 0x7f0a00004d40 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0000baa0 con 0x7f0a000039e0 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0000bca0 con 0x7f0a180b5c40 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a1d2ba640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a00004d40 0x7f0a000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a1cab9640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a000039e0 0x7f0a00003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a17fff640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b5c40 0x7f0a00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a1d2ba640 1 -- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b5c40 msgr2=0x7f0a00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a1d2ba640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b5c40 0x7f0a00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a1d2ba640 1 -- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a000039e0 msgr2=0x7f0a00003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a1d2ba640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a000039e0 0x7f0a00003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.794+0000 7f0a1d2ba640 1 -- 172.21.15.172:0/3778349605 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00003520 con 0x7f0a00004d40 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a1d2ba640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a00004d40 0x7f0a000051c0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000aa30 tx=0x7f0a00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269c166a8897a530 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000a650 con 0x7f0a00004d40 2024-04-25T08:51:48.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1002f070 con 0x7f0a00004d40 2024-04-25T08:51:48.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a177fe640 1 -- 172.21.15.172:0/3778349605 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a10034470 con 0x7f0a00004d40 2024-04-25T08:51:48.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/3778349605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a00004d40 msgr2=0x7f0a000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:48.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a1ed1d640 1 --2- 172.21.15.172:0/3778349605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a00004d40 0x7f0a000051c0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000aa30 tx=0x7f0a00005830 comp rx=0 tx=0).stop 2024-04-25T08:51:48.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a1d2ba640 1 -- 172.21.15.172:0/3778349605 reap_dead start 2024-04-25T08:51:48.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/3778349605 shutdown_connections 2024-04-25T08:51:48.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/3778349605 >> 172.21.15.172:0/3778349605 conn(0x7f0a180d0530 msgr2=0x7f0a180d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:48.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/3778349605 shutdown_connections 2024-04-25T08:51:48.789 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.795+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/3778349605 wait complete. 2024-04-25T08:51:48.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.796+0000 7f0a1ed1d640 1 Processor -- start 2024-04-25T08:51:48.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.797+0000 7f0a1ed1d640 1 -- start start 2024-04-25T08:51:48.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.797+0000 7f0a1ed1d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b7a80 0x7f0a180cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:48.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.797+0000 7f0a1ed1d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a180b7e60 0x7f0a18159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:48.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.797+0000 7f0a1ed1d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a1814f620 0x7f0a1814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:48.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.797+0000 7f0a1ed1d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a181625d0 con 0x7f0a1814f620 2024-04-25T08:51:48.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.797+0000 7f0a1ed1d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18162450 con 0x7f0a180b7e60 2024-04-25T08:51:48.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.797+0000 7f0a1ed1d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18162750 con 0x7f0a180b7a80 2024-04-25T08:51:48.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.797+0000 7f0a1d2ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a1814f620 0x7f0a1814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:48.792 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1d2ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a1814f620 0x7f0a1814faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50268/0 (socket says 172.21.15.172:50268) 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1d2ba640 1 -- 172.21.15.172:0/371023308 learned_addr learned my addr 172.21.15.172:0/371023308 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1cab9640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b7a80 0x7f0a180cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a17fff640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a180b7e60 0x7f0a18159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1d2ba640 1 -- 172.21.15.172:0/371023308 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b7a80 msgr2=0x7f0a180cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1d2ba640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b7a80 0x7f0a180cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1d2ba640 1 -- 172.21.15.172:0/371023308 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a180b7e60 msgr2=0x7f0a18159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1d2ba640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a180b7e60 0x7f0a18159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1d2ba640 1 -- 172.21.15.172:0/371023308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a18157540 con 0x7f0a1814f620 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1d2ba640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a1814f620 0x7f0a1814faa0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000aa30 tx=0x7f0a180cf210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a157fa640 1 -- 172.21.15.172:0/371023308 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000a650 con 0x7f0a1814f620 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a157fa640 1 -- 172.21.15.172:0/371023308 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a10001bb0 con 0x7f0a1814f620 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a157fa640 1 -- 172.21.15.172:0/371023308 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100348b0 con 0x7f0a1814f620 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/371023308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1815a020 con 0x7f0a1814f620 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.798+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/371023308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a180c8b70 con 0x7f0a1814f620 2024-04-25T08:51:48.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.799+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/371023308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a18073a00 con 0x7f0a1814f620 2024-04-25T08:51:48.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.800+0000 7f0a157fa640 1 -- 172.21.15.172:0/371023308 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a10046060 con 0x7f0a1814f620 2024-04-25T08:51:48.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.800+0000 7f0a157fa640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a0406b500 0x7f0a0406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:48.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.800+0000 7f0a1cab9640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a0406b500 0x7f0a0406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:48.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.800+0000 7f0a157fa640 1 -- 172.21.15.172:0/371023308 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f0a100aa070 con 0x7f0a1814f620 2024-04-25T08:51:48.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.801+0000 7f0a1cab9640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a0406b500 0x7f0a0406d9c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0a080017e0 tx=0x7f0a08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:48.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.804+0000 7f0a157fa640 1 -- 172.21.15.172:0/371023308 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a180cf320 con 0x7f0a1814f620 2024-04-25T08:51:48.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:48.974+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/371023308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a180d17c0 con 0x7f0a1814f620 2024-04-25T08:51:49.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.633+0000 7f0a157fa640 1 -- 172.21.15.172:0/371023308 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v134) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0a10078ce0 con 0x7f0a1814f620 2024-04-25T08:51:49.624 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:51:49.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/371023308 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a0406b500 msgr2=0x7f0a0406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:49.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a0406b500 0x7f0a0406d9c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0a080017e0 tx=0x7f0a08009040 comp rx=0 tx=0).stop 2024-04-25T08:51:49.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/371023308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a1814f620 msgr2=0x7f0a1814faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:49.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a1814f620 0x7f0a1814faa0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000aa30 tx=0x7f0a180cf210 comp rx=0 tx=0).stop 2024-04-25T08:51:49.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/371023308 shutdown_connections 2024-04-25T08:51:49.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a0406b500 0x7f0a0406d9c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:49.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a180b7e60 0x7f0a18159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:49.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a1814f620 0x7f0a1814faa0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:49.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 --2- 172.21.15.172:0/371023308 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a180b7a80 0x7f0a180cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:49.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/371023308 >> 172.21.15.172:0/371023308 conn(0x7f0a180d0530 msgr2=0x7f0a1815cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:49.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/371023308 shutdown_connections 2024-04-25T08:51:49.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.636+0000 7f0a1ed1d640 1 -- 172.21.15.172:0/371023308 wait complete. 2024-04-25T08:51:49.642 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:51:49.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.755+0000 7ff6ac4e2640 1 Processor -- start 2024-04-25T08:51:49.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.755+0000 7ff6ac4e2640 1 -- start start 2024-04-25T08:51:49.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.755+0000 7ff6ac4e2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff6a415dd80 0x7ff6a40b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6ac4e2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a40b3930 con 0x7ff6a406abe0 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6ac4e2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a40b3c10 con 0x7ff6a40ad570 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6ac4e2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a406e410 con 0x7ff6a415dd80 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6aa27e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff6a406abe0 0x7ff6a406afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60024/0 (socket says 172.21.15.172:60024) 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6aa27e640 1 -- 172.21.15.172:0/2781245005 learned_addr learned my addr 172.21.15.172:0/2781245005 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872705458 0 0) 0x7ff6a40b3930 con 0x7ff6a406abe0 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff690003520 con 0x7ff6a406abe0 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a9a7d640 1 --2- 172.21.15.172:0/2781245005 >> v2:172.21.15.186:3300/0 conn(0x7ff6a415dd80 0x7ff6a40b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2910423030 0 0) 0x7ff690003520 con 0x7ff6a406abe0 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 >> v2:172.21.15.186:3300/0 conn(0x7ff6a415dd80 msgr2=0x7ff6a40b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 --2- 172.21.15.172:0/2781245005 >> v2:172.21.15.186:3300/0 conn(0x7ff6a415dd80 0x7ff6a40b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 >> v1:172.21.15.186:6789/0 conn(0x7ff6a40ad570 legacy=0x7ff6a406ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:49.750 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a406e660 con 0x7ff6a406abe0 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7ff694001670 con 0x7ff6a406abe0 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 >> v1:172.21.15.172:6789/0 conn(0x7ff6a406abe0 legacy=0x7ff6a406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6900039b0 0x7ff690003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff690004800 0x7ff690004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6900051c0 0x7ff69000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a406e410 con 0x7ff6900039b0 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69000c110 con 0x7ff6900051c0 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69000c310 con 0x7ff690004800 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6aa27e640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6900039b0 0x7ff690003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6aaa7f640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6900051c0 0x7ff69000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.756+0000 7ff6a9a7d640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff690004800 0x7ff690004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6aa27e640 1 -- 172.21.15.172:0/2781245005 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff690004800 msgr2=0x7ff690004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6aa27e640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff690004800 0x7ff690004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6aa27e640 1 -- 172.21.15.172:0/2781245005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6900051c0 msgr2=0x7ff69000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6aa27e640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6900051c0 0x7ff69000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:49.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6aa27e640 1 -- 172.21.15.172:0/2781245005 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff690003520 con 0x7ff6900039b0 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6aaa7f640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6900051c0 0x7ff69000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6aaa7f640 1 -- 172.21.15.172:0/2781245005 reap_dead start 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6aa27e640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6900039b0 0x7ff690003dd0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c240 tx=0x7ff690005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6fc7035727b4e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694007d10 con 0x7ff6900039b0 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694005ad0 con 0x7ff6900039b0 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.757+0000 7ff6a927c640 1 -- 172.21.15.172:0/2781245005 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694007070 con 0x7ff6900039b0 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.758+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/2781245005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6900039b0 msgr2=0x7ff690003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.758+0000 7ff6ac4e2640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6900039b0 0x7ff690003dd0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c240 tx=0x7ff690005830 comp rx=0 tx=0).stop 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.758+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/2781245005 shutdown_connections 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.758+0000 7ff6ac4e2640 1 --2- 172.21.15.172:0/2781245005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6900039b0 0x7ff690003dd0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.758+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/2781245005 >> 172.21.15.172:0/2781245005 conn(0x7ff6a40b5af0 msgr2=0x7ff6a40b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.758+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/2781245005 shutdown_connections 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.758+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/2781245005 wait complete. 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.759+0000 7ff6ac4e2640 1 Processor -- start 2024-04-25T08:51:49.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.759+0000 7ff6ac4e2640 1 -- start start 2024-04-25T08:51:49.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6ac4e2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6900039b0 0x7ff6a414fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:49.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6ac4e2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6a41551a0 0x7ff6a41513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:49.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6ac4e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a4155600 0x7ff6a41f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:49.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6ac4e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4070400 con 0x7ff6a4155600 2024-04-25T08:51:49.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6ac4e2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4070280 con 0x7ff6900039b0 2024-04-25T08:51:49.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6ac4e2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a40b3590 con 0x7ff6a41551a0 2024-04-25T08:51:49.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6aaa7f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a4155600 0x7ff6a41f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:49.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6aaa7f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a4155600 0x7ff6a41f3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50296/0 (socket says 172.21.15.172:50296) 2024-04-25T08:51:49.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6aaa7f640 1 -- 172.21.15.172:0/1186640189 learned_addr learned my addr 172.21.15.172:0/1186640189 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6aa27e640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6900039b0 0x7ff6a414fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6a9a7d640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6a41551a0 0x7ff6a41513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6aaa7f640 1 -- 172.21.15.172:0/1186640189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6a41551a0 msgr2=0x7ff6a41513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6aaa7f640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6a41551a0 0x7ff6a41513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6aaa7f640 1 -- 172.21.15.172:0/1186640189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6900039b0 msgr2=0x7ff6a414fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6aaa7f640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6900039b0 0x7ff6a414fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6aaa7f640 1 -- 172.21.15.172:0/1186640189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a41500f0 con 0x7ff6a4155600 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff6aaa7f640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a4155600 0x7ff6a41f3870 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4072fb0 tx=0x7ff69c00e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.760+0000 7ff69affd640 1 -- 172.21.15.172:0/1186640189 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c019070 con 0x7ff6a4155600 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.761+0000 7ff69affd640 1 -- 172.21.15.172:0/1186640189 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c003b80 con 0x7ff6a4155600 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.761+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/1186640189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a4151e40 con 0x7ff6a4155600 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.761+0000 7ff69affd640 1 -- 172.21.15.172:0/1186640189 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0050d0 con 0x7ff6a4155600 2024-04-25T08:51:49.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.761+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/1186640189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a41528c0 con 0x7ff6a4155600 2024-04-25T08:51:49.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.761+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/1186640189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a4073a00 con 0x7ff6a4155600 2024-04-25T08:51:49.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.762+0000 7ff69affd640 1 -- 172.21.15.172:0/1186640189 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff69c01c070 con 0x7ff6a4155600 2024-04-25T08:51:49.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.762+0000 7ff69affd640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff68806b4d0 0x7ff68806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:49.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.762+0000 7ff6aa27e640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff68806b4d0 0x7ff68806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:49.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.762+0000 7ff69affd640 1 -- 172.21.15.172:0/1186640189 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5835+0+0 (secure 0 0 0) 0x7ff69c089840 con 0x7ff6a4155600 2024-04-25T08:51:49.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.763+0000 7ff6aa27e640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff68806b4d0 0x7ff68806d990 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff694033000 tx=0x7ff69402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:49.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.767+0000 7ff69affd640 1 -- 172.21.15.172:0/1186640189 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff69c0586d0 con 0x7ff6a4155600 2024-04-25T08:51:49.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:49.940+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/1186640189 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff6a40aef20 con 0x7ff6a4155600 2024-04-25T08:51:50.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.635+0000 7ff69affd640 1 -- 172.21.15.172:0/1186640189 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v135) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff69c057fd0 con 0x7ff6a4155600 2024-04-25T08:51:50.625 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.639+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/1186640189 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff68806b4d0 msgr2=0x7ff68806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.639+0000 7ff6ac4e2640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff68806b4d0 0x7ff68806d990 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff694033000 tx=0x7ff69402e000 comp rx=0 tx=0).stop 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.639+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/1186640189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a4155600 msgr2=0x7ff6a41f3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.639+0000 7ff6ac4e2640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a4155600 0x7ff6a41f3870 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4072fb0 tx=0x7ff69c00e980 comp rx=0 tx=0).stop 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.640+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/1186640189 shutdown_connections 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.640+0000 7ff6ac4e2640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff68806b4d0 0x7ff68806d990 secure :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff694033000 tx=0x7ff69402e000 comp rx=0 tx=0).stop 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.640+0000 7ff6ac4e2640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a4155600 0x7ff6a41f3870 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.640+0000 7ff6ac4e2640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6a41551a0 0x7ff6a41513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.640+0000 7ff6ac4e2640 1 --2- 172.21.15.172:0/1186640189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6900039b0 0x7ff6a414fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.640+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/1186640189 >> 172.21.15.172:0/1186640189 conn(0x7ff6a40b5af0 msgr2=0x7ff6a40adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.640+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/1186640189 shutdown_connections 2024-04-25T08:51:50.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.640+0000 7ff6ac4e2640 1 -- 172.21.15.172:0/1186640189 wait complete. 2024-04-25T08:51:50.647 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:51:50.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.770+0000 7f05073ce640 1 Processor -- start 2024-04-25T08:51:50.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.771+0000 7f05073ce640 1 -- start start 2024-04-25T08:51:50.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f05073ce640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f05000ad570 0x7f050006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:50.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f05073ce640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05000b3930 con 0x7f050015dd80 2024-04-25T08:51:50.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f05073ce640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05000b3c10 con 0x7f050006abe0 2024-04-25T08:51:50.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f05073ce640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050006e410 con 0x7f05000ad570 2024-04-25T08:51:50.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f050596b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f05000ad570 0x7f050006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:50.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f0504969640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f050015dd80 0x7f05000b5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60030/0 (socket says 172.21.15.172:60030) 2024-04-25T08:51:50.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f0504969640 1 -- 172.21.15.172:0/133605319 learned_addr learned my addr 172.21.15.172:0/133605319 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:50.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f050596b640 1 -- 172.21.15.172:0/133605319 >> v1:172.21.15.186:6789/0 conn(0x7f050006abe0 legacy=0x7f050006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:50.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f050596b640 1 -- 172.21.15.172:0/133605319 >> v1:172.21.15.172:6789/0 conn(0x7f050015dd80 legacy=0x7f05000b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:50.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f050596b640 1 -- 172.21.15.172:0/133605319 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050006e660 con 0x7f05000ad570 2024-04-25T08:51:50.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.772+0000 7f04fffff640 1 -- 172.21.15.172:0/133605319 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249616535 0 0) 0x7f05000b3930 con 0x7f050015dd80 2024-04-25T08:51:50.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f050596b640 1 --2- 172.21.15.172:0/133605319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05000ad570 0x7f050006ee60 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f04f00097a0 tx=0x7f04f002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e361d6e34b4201fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:50.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f04fffff640 1 -- 172.21.15.172:0/133605319 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0037070 con 0x7f05000ad570 2024-04-25T08:51:50.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f04fffff640 1 -- 172.21.15.172:0/133605319 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0032440 con 0x7f05000ad570 2024-04-25T08:51:50.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f04fffff640 1 -- 172.21.15.172:0/133605319 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0032810 con 0x7f05000ad570 2024-04-25T08:51:50.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f05073ce640 1 -- 172.21.15.172:0/133605319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05000ad570 msgr2=0x7f050006ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:50.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f05073ce640 1 --2- 172.21.15.172:0/133605319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05000ad570 0x7f050006ee60 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f04f00097a0 tx=0x7f04f002a230 comp rx=0 tx=0).stop 2024-04-25T08:51:50.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f05073ce640 1 -- 172.21.15.172:0/133605319 shutdown_connections 2024-04-25T08:51:50.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f05073ce640 1 --2- 172.21.15.172:0/133605319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05000ad570 0x7f050006ee60 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:50.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f05073ce640 1 -- 172.21.15.172:0/133605319 >> 172.21.15.172:0/133605319 conn(0x7f05000b5af0 msgr2=0x7f05000b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:50.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f05073ce640 1 -- 172.21.15.172:0/133605319 shutdown_connections 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.773+0000 7f05073ce640 1 -- 172.21.15.172:0/133605319 wait complete. 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f05073ce640 1 Processor -- start 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f05073ce640 1 -- start start 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f05073ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f050006abe0 0x7f050015e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f05073ce640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05000ad570 0x7f0500156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f05073ce640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f050015dd80 0x7f05001e6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f05073ce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0500070400 con 0x7f050006abe0 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f05073ce640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0500070280 con 0x7f050015dd80 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f05073ce640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000b3590 con 0x7f05000ad570 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f050516a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f050006abe0 0x7f050015e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f050516a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f050006abe0 0x7f050015e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50318/0 (socket says 172.21.15.172:50318) 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.775+0000 7f050516a640 1 -- 172.21.15.172:0/1237666259 learned_addr learned my addr 172.21.15.172:0/1237666259 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:50.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f050596b640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f050015dd80 0x7f05001e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f0504969640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05000ad570 0x7f0500156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f050516a640 1 -- 172.21.15.172:0/1237666259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05000ad570 msgr2=0x7f0500156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f050516a640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05000ad570 0x7f0500156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f050516a640 1 -- 172.21.15.172:0/1237666259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f050015dd80 msgr2=0x7f05001e6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f050516a640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f050015dd80 0x7f05001e6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f050516a640 1 -- 172.21.15.172:0/1237666259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500157370 con 0x7f050006abe0 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f050516a640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f050006abe0 0x7f050015e1b0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c870 tx=0x7f04f800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f04fdffb640 1 -- 172.21.15.172:0/1237666259 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8003b70 con 0x7f050006abe0 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f04fdffb640 1 -- 172.21.15.172:0/1237666259 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8003d30 con 0x7f050006abe0 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f04fdffb640 1 -- 172.21.15.172:0/1237666259 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800aa90 con 0x7f050006abe0 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f05073ce640 1 -- 172.21.15.172:0/1237666259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050015e7b0 con 0x7f050006abe0 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.776+0000 7f05073ce640 1 -- 172.21.15.172:0/1237666259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050015f050 con 0x7f050006abe0 2024-04-25T08:51:50.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.777+0000 7f05073ce640 1 -- 172.21.15.172:0/1237666259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050015d930 con 0x7f050006abe0 2024-04-25T08:51:50.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.777+0000 7f04fdffb640 1 -- 172.21.15.172:0/1237666259 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f04f800ac30 con 0x7f050006abe0 2024-04-25T08:51:50.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.778+0000 7f04fdffb640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04ec06b4d0 0x7f04ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:50.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.778+0000 7f04fdffb640 1 -- 172.21.15.172:0/1237666259 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f04f8089f50 con 0x7f050006abe0 2024-04-25T08:51:50.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.778+0000 7f0504969640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04ec06b4d0 0x7f04ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:50.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.778+0000 7f0504969640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04ec06b4d0 0x7f04ec06d990 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f05000d1560 tx=0x7f04f4007d00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:50.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.782+0000 7f04fdffb640 1 -- 172.21.15.172:0/1237666259 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f050015d930 con 0x7f050006abe0 2024-04-25T08:51:50.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.953+0000 7f05073ce640 1 -- 172.21.15.172:0/1237666259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f050015eb40 con 0x7f050006abe0 2024-04-25T08:51:50.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.956+0000 7f04fdffb640 1 -- 172.21.15.172:0/1237666259 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0500157370 con 0x7f050006abe0 2024-04-25T08:51:50.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 -- 172.21.15.172:0/1237666259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04ec06b4d0 msgr2=0x7f04ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:50.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04ec06b4d0 0x7f04ec06d990 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f05000d1560 tx=0x7f04f4007d00 comp rx=0 tx=0).stop 2024-04-25T08:51:50.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 -- 172.21.15.172:0/1237666259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f050006abe0 msgr2=0x7f050015e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:50.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f050006abe0 0x7f050015e1b0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c870 tx=0x7f04f800cd30 comp rx=0 tx=0).stop 2024-04-25T08:51:50.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 -- 172.21.15.172:0/1237666259 shutdown_connections 2024-04-25T08:51:50.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f04ec06b4d0 0x7f04ec06d990 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:50.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f050015dd80 0x7f05001e6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:50.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05000ad570 0x7f0500156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:50.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 --2- 172.21.15.172:0/1237666259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f050006abe0 0x7f050015e1b0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 -- 172.21.15.172:0/1237666259 >> 172.21.15.172:0/1237666259 conn(0x7f05000b5af0 msgr2=0x7f050015a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 -- 172.21.15.172:0/1237666259 shutdown_connections 2024-04-25T08:51:50.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:50.958+0000 7f05073ce640 1 -- 172.21.15.172:0/1237666259 wait complete. 2024-04-25T08:51:50.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-04-25T08:51:51.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.066+0000 7f7f47fb7640 1 Processor -- start 2024-04-25T08:51:51.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.066+0000 7f7f47fb7640 1 -- start start 2024-04-25T08:51:51.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.067+0000 7f7f47fb7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7f400b2cb0 0x7f7f400d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.067+0000 7f7f47fb7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400d1020 0x7f7f400d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.067+0000 7f7f47fb7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f400b97a0 con 0x7f7f4015dbe0 2024-04-25T08:51:51.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.067+0000 7f7f47fb7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f4015dfc0 con 0x7f7f400b2cb0 2024-04-25T08:51:51.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.067+0000 7f7f47fb7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400d1a00 con 0x7f7f400d1020 2024-04-25T08:51:51.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.068+0000 7f7f46554640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400d1020 0x7f7f400d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.068+0000 7f7f45552640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7f400b2cb0 0x7f7f400d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.068+0000 7f7f45d53640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f7f4015dbe0 0x7f7f400d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:44714/0 (socket says 172.21.15.172:44714) 2024-04-25T08:51:51.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.068+0000 7f7f45d53640 1 -- 172.21.15.172:0/2742534720 learned_addr learned my addr 172.21.15.172:0/2742534720 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:51.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.068+0000 7f7f45552640 1 -- 172.21.15.172:0/2742534720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400d1020 msgr2=0x7f7f400d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:51.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.068+0000 7f7f45552640 1 --2- 172.21.15.172:0/2742534720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400d1020 0x7f7f400d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.068+0000 7f7f45552640 1 -- 172.21.15.172:0/2742534720 >> v1:172.21.15.186:6789/0 conn(0x7f7f4015dbe0 legacy=0x7f7f400d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.068+0000 7f7f44d51640 1 -- 172.21.15.172:0/2742534720 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419733947 0 0) 0x7f7f400b97a0 con 0x7f7f4015dbe0 2024-04-25T08:51:51.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.068+0000 7f7f45552640 1 -- 172.21.15.172:0/2742534720 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f400d1c50 con 0x7f7f400b2cb0 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.068+0000 7f7f46554640 1 --2- 172.21.15.172:0/2742534720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400d1020 0x7f7f400d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f45552640 1 --2- 172.21.15.172:0/2742534720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f400b2cb0 0x7f7f400d2730 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7f300097a0 tx=0x7f7f3002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a50758c67698ed1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f44d51640 1 -- 172.21.15.172:0/2742534720 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30037070 con 0x7f7f400b2cb0 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f44d51640 1 -- 172.21.15.172:0/2742534720 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f30032440 con 0x7f7f400b2cb0 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f44d51640 1 -- 172.21.15.172:0/2742534720 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30032810 con 0x7f7f400b2cb0 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f47fb7640 1 -- 172.21.15.172:0/2742534720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f400b2cb0 msgr2=0x7f7f400d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f47fb7640 1 --2- 172.21.15.172:0/2742534720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f400b2cb0 0x7f7f400d2730 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7f300097a0 tx=0x7f7f3002a180 comp rx=0 tx=0).stop 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f47fb7640 1 -- 172.21.15.172:0/2742534720 shutdown_connections 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f47fb7640 1 --2- 172.21.15.172:0/2742534720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400d1020 0x7f7f400d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f47fb7640 1 --2- 172.21.15.172:0/2742534720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f400b2cb0 0x7f7f400d2730 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f47fb7640 1 -- 172.21.15.172:0/2742534720 >> 172.21.15.172:0/2742534720 conn(0x7f7f40061a20 msgr2=0x7f7f40061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:51.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f47fb7640 1 -- 172.21.15.172:0/2742534720 shutdown_connections 2024-04-25T08:51:51.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.069+0000 7f7f47fb7640 1 -- 172.21.15.172:0/2742534720 wait complete. 2024-04-25T08:51:51.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f47fb7640 1 Processor -- start 2024-04-25T08:51:51.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f47fb7640 1 -- start start 2024-04-25T08:51:51.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f47fb7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400b2cb0 0x7f7f40146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f47fb7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f400d1020 0x7f7f401e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f47fb7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f4015dbe0 0x7f7f400b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f47fb7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400b92a0 con 0x7f7f400d1020 2024-04-25T08:51:51.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f47fb7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400d2210 con 0x7f7f4015dbe0 2024-04-25T08:51:51.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f47fb7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f400b9420 con 0x7f7f400b2cb0 2024-04-25T08:51:51.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f45552640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f400d1020 0x7f7f401e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f45d53640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400b2cb0 0x7f7f40146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.071+0000 7f7f45552640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f400d1020 0x7f7f401e60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50328/0 (socket says 172.21.15.172:50328) 2024-04-25T08:51:51.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f45552640 1 -- 172.21.15.172:0/3108327931 learned_addr learned my addr 172.21.15.172:0/3108327931 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:51.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f46554640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f4015dbe0 0x7f7f400b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f45552640 1 -- 172.21.15.172:0/3108327931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400b2cb0 msgr2=0x7f7f40146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f45552640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400b2cb0 0x7f7f40146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f45552640 1 -- 172.21.15.172:0/3108327931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f4015dbe0 msgr2=0x7f7f400b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f45552640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f4015dbe0 0x7f7f400b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f45552640 1 -- 172.21.15.172:0/3108327931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f400b4b30 con 0x7f7f400d1020 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f45552640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f400d1020 0x7f7f401e60a0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f7f30035040 tx=0x7f7f300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f367fc640 1 -- 172.21.15.172:0/3108327931 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30037050 con 0x7f7f400d1020 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f47fb7640 1 -- 172.21.15.172:0/3108327931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f400b4e10 con 0x7f7f400d1020 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f367fc640 1 -- 172.21.15.172:0/3108327931 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f30038040 con 0x7f7f400d1020 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f367fc640 1 -- 172.21.15.172:0/3108327931 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30004470 con 0x7f7f400d1020 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.072+0000 7f7f47fb7640 1 -- 172.21.15.172:0/3108327931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f400b53d0 con 0x7f7f400d1020 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.073+0000 7f7f47fb7640 1 -- 172.21.15.172:0/3108327931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f40073990 con 0x7f7f400d1020 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.074+0000 7f7f367fc640 1 -- 172.21.15.172:0/3108327931 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7f30003610 con 0x7f7f400d1020 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.074+0000 7f7f367fc640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7f2406b500 0x7f7f2406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.074+0000 7f7f367fc640 1 -- 172.21.15.172:0/3108327931 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f7f300aaa20 con 0x7f7f400d1020 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.074+0000 7f7f45d53640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7f2406b500 0x7f7f2406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.074+0000 7f7f45d53640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7f2406b500 0x7f7f2406d9c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0012e0 tx=0x7f7f3c001700 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:51.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.078+0000 7f7f367fc640 1 -- 172.21.15.172:0/3108327931 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7f30079af0 con 0x7f7f400d1020 2024-04-25T08:51:51.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.311+0000 7f7f47fb7640 1 -- 172.21.15.172:0/3108327931 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7f7f400ca2e0 con 0x7f7f400d1020 2024-04-25T08:51:51.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.636+0000 7f7f367fc640 1 -- 172.21.15.172:0/3108327931 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v465) v1 ==== 166+0+0 (secure 0 0 0) 0x7f7f300793f0 con 0x7f7f400d1020 2024-04-25T08:51:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 -- 172.21.15.172:0/3108327931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7f2406b500 msgr2=0x7f7f2406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7f2406b500 0x7f7f2406d9c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0012e0 tx=0x7f7f3c001700 comp rx=0 tx=0).stop 2024-04-25T08:51:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 -- 172.21.15.172:0/3108327931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f400d1020 msgr2=0x7f7f401e60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f400d1020 0x7f7f401e60a0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f7f30035040 tx=0x7f7f300046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 -- 172.21.15.172:0/3108327931 shutdown_connections 2024-04-25T08:51:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7f2406b500 0x7f7f2406d9c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f4015dbe0 0x7f7f400b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f400d1020 0x7f7f401e60a0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 --2- 172.21.15.172:0/3108327931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f400b2cb0 0x7f7f40146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 -- 172.21.15.172:0/3108327931 >> 172.21.15.172:0/3108327931 conn(0x7f7f40061a20 msgr2=0x7f7f400b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:51.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 -- 172.21.15.172:0/3108327931 shutdown_connections 2024-04-25T08:51:51.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.638+0000 7f7f47fb7640 1 -- 172.21.15.172:0/3108327931 wait complete. 2024-04-25T08:51:51.640 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-04-25T08:51:51.640 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T08:51:51.641 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:51:51.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.747+0000 7fa3fcdd5640 1 Processor -- start 2024-04-25T08:51:51.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.747+0000 7fa3fcdd5640 1 -- start start 2024-04-25T08:51:51.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.748+0000 7fa3fcdd5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa3f806b580 0x7fa3f80cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.748+0000 7fa3fcdd5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f8161960 con 0x7fa3f806b1a0 2024-04-25T08:51:51.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.748+0000 7fa3fcdd5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f8161c40 con 0x7fa3f80cffa0 2024-04-25T08:51:51.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.748+0000 7fa3fcdd5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80cbd50 con 0x7fa3f806b580 2024-04-25T08:51:51.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.748+0000 7fa3f5d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa3f806b580 0x7fa3f80cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.749+0000 7fa3f659c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa3f806b1a0 0x7fa3f806f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60036/0 (socket says 172.21.15.172:60036) 2024-04-25T08:51:51.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.749+0000 7fa3f659c640 1 -- 172.21.15.172:0/3399214965 learned_addr learned my addr 172.21.15.172:0/3399214965 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:51.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.749+0000 7fa3f5d9b640 1 -- 172.21.15.172:0/3399214965 >> v1:172.21.15.186:6789/0 conn(0x7fa3f80cffa0 legacy=0x7fa3f815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:51.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.749+0000 7fa3f5d9b640 1 -- 172.21.15.172:0/3399214965 >> v1:172.21.15.172:6789/0 conn(0x7fa3f806b1a0 legacy=0x7fa3f806f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.749+0000 7fa3f5d9b640 1 -- 172.21.15.172:0/3399214965 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f8161f20 con 0x7fa3f806b580 2024-04-25T08:51:51.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.749+0000 7fa3f559a640 1 -- 172.21.15.172:0/3399214965 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827689047 0 0) 0x7fa3f8161960 con 0x7fa3f806b1a0 2024-04-25T08:51:51.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.749+0000 7fa3f5d9b640 1 --2- 172.21.15.172:0/3399214965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f806b580 0x7fa3f80cfa60 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fa3e00097a0 tx=0x7fa3e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba36f4ddf33d705 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:51.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.750+0000 7fa3f559a640 1 -- 172.21.15.172:0/3399214965 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0037070 con 0x7fa3f806b580 2024-04-25T08:51:51.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.750+0000 7fa3f559a640 1 -- 172.21.15.172:0/3399214965 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e002ae50 con 0x7fa3f806b580 2024-04-25T08:51:51.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.750+0000 7fa3f559a640 1 -- 172.21.15.172:0/3399214965 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0032660 con 0x7fa3f806b580 2024-04-25T08:51:51.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.750+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/3399214965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f806b580 msgr2=0x7fa3f80cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.750+0000 7fa3fcdd5640 1 --2- 172.21.15.172:0/3399214965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f806b580 0x7fa3f80cfa60 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fa3e00097a0 tx=0x7fa3e002a140 comp rx=0 tx=0).stop 2024-04-25T08:51:51.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.750+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/3399214965 shutdown_connections 2024-04-25T08:51:51.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.750+0000 7fa3fcdd5640 1 --2- 172.21.15.172:0/3399214965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f806b580 0x7fa3f80cfa60 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.750+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/3399214965 >> 172.21.15.172:0/3399214965 conn(0x7fa3f80b2220 msgr2=0x7fa3f80b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:51.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.750+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/3399214965 shutdown_connections 2024-04-25T08:51:51.742 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.750+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/3399214965 wait complete. 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.752+0000 7fa3fcdd5640 1 Processor -- start 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.752+0000 7fa3fcdd5640 1 -- start start 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.752+0000 7fa3fcdd5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3f806b1a0 0x7fa3f80c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.752+0000 7fa3fcdd5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3f806b580 0x7fa3f8158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.752+0000 7fa3fcdd5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f80cffa0 0x7fa3f80d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.752+0000 7fa3fcdd5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80d03f0 con 0x7fa3f80cffa0 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.752+0000 7fa3fcdd5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80700d0 con 0x7fa3f806b1a0 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.752+0000 7fa3fcdd5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f8162720 con 0x7fa3f806b580 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.752+0000 7fa3f6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f80cffa0 0x7fa3f80d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3f6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f80cffa0 0x7fa3f80d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50356/0 (socket says 172.21.15.172:50356) 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3f6d9d640 1 -- 172.21.15.172:0/1132464877 learned_addr learned my addr 172.21.15.172:0/1132464877 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3f659c640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3f806b1a0 0x7fa3f80c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3f5d9b640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3f806b580 0x7fa3f8158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3f6d9d640 1 -- 172.21.15.172:0/1132464877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3f806b580 msgr2=0x7fa3f8158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3f6d9d640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3f806b580 0x7fa3f8158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3f6d9d640 1 -- 172.21.15.172:0/1132464877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3f806b1a0 msgr2=0x7fa3f80c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3f6d9d640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3f806b1a0 0x7fa3f80c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3f6d9d640 1 -- 172.21.15.172:0/1132464877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80c7d00 con 0x7fa3f80cffa0 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3f6d9d640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f80cffa0 0x7fa3f80d0570 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800b490 tx=0x7fa3e800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3eeffd640 1 -- 172.21.15.172:0/1132464877 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8015020 con 0x7fa3f80cffa0 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3eeffd640 1 -- 172.21.15.172:0/1132464877 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e8011850 con 0x7fa3f80cffa0 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/1132464877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f80c7f80 con 0x7fa3f80cffa0 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3eeffd640 1 -- 172.21.15.172:0/1132464877 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8011c40 con 0x7fa3f80cffa0 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.753+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/1132464877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f80c8540 con 0x7fa3f80cffa0 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.754+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/1132464877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f80cfb90 con 0x7fa3f80cffa0 2024-04-25T08:51:51.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.755+0000 7fa3eeffd640 1 -- 172.21.15.172:0/1132464877 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa3e8018020 con 0x7fa3f80cffa0 2024-04-25T08:51:51.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.755+0000 7fa3eeffd640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3d806b4d0 0x7fa3d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:51.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.755+0000 7fa3eeffd640 1 -- 172.21.15.172:0/1132464877 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fa3e8089e10 con 0x7fa3f80cffa0 2024-04-25T08:51:51.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.755+0000 7fa3f659c640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3d806b4d0 0x7fa3d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:51.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.755+0000 7fa3f659c640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3d806b4d0 0x7fa3d806d990 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00012e0 tx=0x7fa3f0001700 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:51.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.759+0000 7fa3eeffd640 1 -- 172.21.15.172:0/1132464877 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3e801f020 con 0x7fa3f80cffa0 2024-04-25T08:51:51.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.931+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/1132464877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3f806d370 con 0x7fa3f80cffa0 2024-04-25T08:51:51.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.931+0000 7fa3eeffd640 1 -- 172.21.15.172:0/1132464877 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+13495 (secure 0 0 0) 0x7fa3f80c7d00 con 0x7fa3f80cffa0 2024-04-25T08:51:51.922 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:51.922 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":135,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:51:50.634551+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/480561463":"2024-04-26T08:51:47.624255+0000","172.21.15.172:6834/480561463":"2024-04-26T08:51:47.624255+0000","172.21.15.172:6837/3347790695":"2024-04-26T08:51:34.301451+0000","172.21.15.172:6836/3347790695":"2024-04-26T08:51:34.301451+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:51:51.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.933+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/1132464877 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3d806b4d0 msgr2=0x7fa3d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.933+0000 7fa3fcdd5640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3d806b4d0 0x7fa3d806d990 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00012e0 tx=0x7fa3f0001700 comp rx=0 tx=0).stop 2024-04-25T08:51:51.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.933+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/1132464877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f80cffa0 msgr2=0x7fa3f80d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:51.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.933+0000 7fa3fcdd5640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f80cffa0 0x7fa3f80d0570 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800b490 tx=0x7fa3e800b950 comp rx=0 tx=0).stop 2024-04-25T08:51:51.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.933+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/1132464877 shutdown_connections 2024-04-25T08:51:51.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.933+0000 7fa3fcdd5640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3d806b4d0 0x7fa3d806d990 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.933+0000 7fa3fcdd5640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f80cffa0 0x7fa3f80d0570 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.933+0000 7fa3fcdd5640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3f806b580 0x7fa3f8158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.933+0000 7fa3fcdd5640 1 --2- 172.21.15.172:0/1132464877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3f806b1a0 0x7fa3f80c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:51.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.934+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/1132464877 >> 172.21.15.172:0/1132464877 conn(0x7fa3f80b2220 msgr2=0x7fa3f80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:51.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.934+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/1132464877 shutdown_connections 2024-04-25T08:51:51.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:51.934+0000 7fa3fcdd5640 1 -- 172.21.15.172:0/1132464877 wait complete. 2024-04-25T08:51:51.935 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:51:51.936 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:51:52.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.045+0000 7f7957dc4640 1 Processor -- start 2024-04-25T08:51:52.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.046+0000 7f7957dc4640 1 -- start start 2024-04-25T08:51:52.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.046+0000 7f7957dc4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f795015b980 0x7f79500cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.046+0000 7f7957dc4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7950072280 con 0x7f79500cc4f0 2024-04-25T08:51:52.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.046+0000 7f7957dc4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79500714c0 con 0x7f79500ce230 2024-04-25T08:51:52.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.046+0000 7f7957dc4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795015bdc0 con 0x7f795015b980 2024-04-25T08:51:52.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7955b60640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f79500cc4f0 0x7f79500cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60044/0 (socket says 172.21.15.172:60044) 2024-04-25T08:51:52.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7955b60640 1 -- 172.21.15.172:0/2863718258 learned_addr learned my addr 172.21.15.172:0/2863718258 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:52.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672726281 0 0) 0x7f7950072280 con 0x7f79500cc4f0 2024-04-25T08:51:52.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793c003520 con 0x7f79500cc4f0 2024-04-25T08:51:52.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7956361640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f795015b980 0x7f79500cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2059244442 0 0) 0x7f793c003520 con 0x7f79500cc4f0 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f795015b980 msgr2=0x7f79500cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f795015b980 0x7f79500cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 >> v1:172.21.15.186:6789/0 conn(0x7f79500ce230 legacy=0x7f795015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500717a0 con 0x7f79500cc4f0 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f794c001670 con 0x7f79500cc4f0 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 >> v1:172.21.15.172:6789/0 conn(0x7f79500cc4f0 legacy=0x7f79500cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f793c0039e0 0x7f793c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c004800 0x7f793c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f795015b980 0x7f793c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795015bdc0 con 0x7f793c004800 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c00ba70 con 0x7f793c0039e0 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c00de80 con 0x7f795015b980 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f795535f640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c004800 0x7f793c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7955b60640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f793c0039e0 0x7f793c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.047+0000 7f7956361640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f795015b980 0x7f793c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.048+0000 7f795535f640 1 -- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f795015b980 msgr2=0x7f793c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.048+0000 7f795535f640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f795015b980 0x7f793c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.048+0000 7f795535f640 1 -- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f793c0039e0 msgr2=0x7f793c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.048+0000 7f795535f640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f793c0039e0 0x7f793c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.048+0000 7f795535f640 1 -- 172.21.15.172:0/2863718258 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c003520 con 0x7f793c004800 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.048+0000 7f795535f640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c004800 0x7f793c004c80 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f79500cd3b0 tx=0x7f793c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13ca78b854837f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.048+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944001370 con 0x7f793c004800 2024-04-25T08:51:52.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.048+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79440052d0 con 0x7f793c004800 2024-04-25T08:51:52.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.048+0000 7f7954b5e640 1 -- 172.21.15.172:0/2863718258 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794402ab40 con 0x7f793c004800 2024-04-25T08:51:52.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.049+0000 7f7957dc4640 1 -- 172.21.15.172:0/2863718258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c004800 msgr2=0x7f793c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.049+0000 7f7957dc4640 1 --2- 172.21.15.172:0/2863718258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c004800 0x7f793c004c80 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f79500cd3b0 tx=0x7f793c005830 comp rx=0 tx=0).stop 2024-04-25T08:51:52.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.049+0000 7f7956361640 1 -- 172.21.15.172:0/2863718258 reap_dead start 2024-04-25T08:51:52.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.049+0000 7f7957dc4640 1 -- 172.21.15.172:0/2863718258 shutdown_connections 2024-04-25T08:51:52.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.049+0000 7f7957dc4640 1 -- 172.21.15.172:0/2863718258 >> 172.21.15.172:0/2863718258 conn(0x7f795006abe0 msgr2=0x7f795006afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:52.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.049+0000 7f7957dc4640 1 -- 172.21.15.172:0/2863718258 shutdown_connections 2024-04-25T08:51:52.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.049+0000 7f7957dc4640 1 -- 172.21.15.172:0/2863718258 wait complete. 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.050+0000 7f7957dc4640 1 Processor -- start 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.050+0000 7f7957dc4640 1 -- start start 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f7957dc4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f793c004800 0x7f79501495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f7957dc4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950147340 0x7f79501f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f7957dc4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7950149bc0 0x7f795014a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f7957dc4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7950071d60 con 0x7f7950147340 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f7957dc4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7950071270 con 0x7f7950149bc0 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f7957dc4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795006e8a0 con 0x7f793c004800 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f795535f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950147340 0x7f79501f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f795535f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950147340 0x7f79501f3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50374/0 (socket says 172.21.15.172:50374) 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f795535f640 1 -- 172.21.15.172:0/1551883432 learned_addr learned my addr 172.21.15.172:0/1551883432 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:52.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f7956361640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7950149bc0 0x7f795014a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f7955b60640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f793c004800 0x7f79501495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f795535f640 1 -- 172.21.15.172:0/1551883432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f793c004800 msgr2=0x7f79501495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f795535f640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f793c004800 0x7f79501495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f795535f640 1 -- 172.21.15.172:0/1551883432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7950149bc0 msgr2=0x7f795014a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f795535f640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7950149bc0 0x7f795014a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f795535f640 1 -- 172.21.15.172:0/1551883432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795014ddd0 con 0x7f7950147340 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.051+0000 7f7955b60640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f793c004800 0x7f79501495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.052+0000 7f795535f640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950147340 0x7f79501f3600 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f79440017e0 tx=0x7f7944001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.052+0000 7f79427fc640 1 -- 172.21.15.172:0/1551883432 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944040020 con 0x7f7950147340 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.052+0000 7f79427fc640 1 -- 172.21.15.172:0/1551883432 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79440050d0 con 0x7f7950147340 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.052+0000 7f79427fc640 1 -- 172.21.15.172:0/1551883432 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944007450 con 0x7f7950147340 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.052+0000 7f7957dc4640 1 -- 172.21.15.172:0/1551883432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795014e0b0 con 0x7f7950147340 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.052+0000 7f7957dc4640 1 -- 172.21.15.172:0/1551883432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795014e670 con 0x7f7950147340 2024-04-25T08:51:52.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.053+0000 7f7957dc4640 1 -- 172.21.15.172:0/1551883432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79500ce960 con 0x7f7950147340 2024-04-25T08:51:52.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.053+0000 7f79427fc640 1 -- 172.21.15.172:0/1551883432 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7944043020 con 0x7f7950147340 2024-04-25T08:51:52.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.054+0000 7f79427fc640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f793406b4d0 0x7f793406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.054+0000 7f79427fc640 1 -- 172.21.15.172:0/1551883432 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f79440a9fb0 con 0x7f7950147340 2024-04-25T08:51:52.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.054+0000 7f7955b60640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f793406b4d0 0x7f793406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.054+0000 7f7955b60640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f793406b4d0 0x7f793406d990 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f794c0017d0 tx=0x7f794c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:52.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.058+0000 7f79427fc640 1 -- 172.21.15.172:0/1551883432 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f79500ce960 con 0x7f7950147340 2024-04-25T08:51:52.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.264+0000 7f7957dc4640 1 -- 172.21.15.172:0/1551883432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7950158680 con 0x7f7950147340 2024-04-25T08:51:52.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.265+0000 7f79427fc640 1 -- 172.21.15.172:0/1551883432 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7950158680 con 0x7f7950147340 2024-04-25T08:51:52.255 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 -- 172.21.15.172:0/1551883432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f793406b4d0 msgr2=0x7f793406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f793406b4d0 0x7f793406d990 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f794c0017d0 tx=0x7f794c009040 comp rx=0 tx=0).stop 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 -- 172.21.15.172:0/1551883432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950147340 msgr2=0x7f79501f3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950147340 0x7f79501f3600 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f79440017e0 tx=0x7f7944001120 comp rx=0 tx=0).stop 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 -- 172.21.15.172:0/1551883432 shutdown_connections 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f793406b4d0 0x7f793406d990 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7950149bc0 0x7f795014a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950147340 0x7f79501f3600 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 --2- 172.21.15.172:0/1551883432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f793c004800 0x7f79501495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 -- 172.21.15.172:0/1551883432 >> 172.21.15.172:0/1551883432 conn(0x7f795006abe0 msgr2=0x7f79500b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 -- 172.21.15.172:0/1551883432 shutdown_connections 2024-04-25T08:51:52.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.267+0000 7f7957dc4640 1 -- 172.21.15.172:0/1551883432 wait complete. 2024-04-25T08:51:52.269 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-04-25T08:51:52.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.376+0000 7fe863ab3640 1 Processor -- start 2024-04-25T08:51:52.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.376+0000 7fe863ab3640 1 -- start start 2024-04-25T08:51:52.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.377+0000 7fe863ab3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe85c0b3f00 0x7fe85c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.377+0000 7fe863ab3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85c0ace70 con 0x7fe85c0720f0 2024-04-25T08:51:52.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.377+0000 7fe863ab3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85c0b4390 con 0x7fe85c0b3410 2024-04-25T08:51:52.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.377+0000 7fe863ab3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c06df30 con 0x7fe85c0b3f00 2024-04-25T08:51:52.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.377+0000 7fe862050640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe85c0b3f00 0x7fe85c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.377+0000 7fe86104e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe85c0720f0 0x7fe85c06e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60052/0 (socket says 172.21.15.172:60052) 2024-04-25T08:51:52.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.377+0000 7fe86104e640 1 -- 172.21.15.172:0/1656728763 learned_addr learned my addr 172.21.15.172:0/1656728763 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:52.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.377+0000 7fe862050640 1 -- 172.21.15.172:0/1656728763 >> v1:172.21.15.186:6789/0 conn(0x7fe85c0b3410 legacy=0x7fe85c0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.377+0000 7fe862050640 1 -- 172.21.15.172:0/1656728763 >> v1:172.21.15.172:6789/0 conn(0x7fe85c0720f0 legacy=0x7fe85c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.377+0000 7fe862050640 1 -- 172.21.15.172:0/1656728763 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c0726d0 con 0x7fe85c0b3f00 2024-04-25T08:51:52.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.378+0000 7fe862050640 1 --2- 172.21.15.172:0/1656728763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0b3f00 0x7fe85c06ead0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fe854009d90 tx=0x7fe85402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5f324e8a446d99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:52.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.378+0000 7fe86084d640 1 -- 172.21.15.172:0/1656728763 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854007740 con 0x7fe85c0b3f00 2024-04-25T08:51:52.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.378+0000 7fe86084d640 1 -- 172.21.15.172:0/1656728763 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8540078e0 con 0x7fe85c0b3f00 2024-04-25T08:51:52.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.378+0000 7fe86084d640 1 -- 172.21.15.172:0/1656728763 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854007cb0 con 0x7fe85c0b3f00 2024-04-25T08:51:52.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.379+0000 7fe863ab3640 1 -- 172.21.15.172:0/1656728763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0b3f00 msgr2=0x7fe85c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.379+0000 7fe863ab3640 1 --2- 172.21.15.172:0/1656728763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0b3f00 0x7fe85c06ead0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fe854009d90 tx=0x7fe85402a660 comp rx=0 tx=0).stop 2024-04-25T08:51:52.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.379+0000 7fe863ab3640 1 -- 172.21.15.172:0/1656728763 shutdown_connections 2024-04-25T08:51:52.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.379+0000 7fe863ab3640 1 --2- 172.21.15.172:0/1656728763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0b3f00 0x7fe85c06ead0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.379+0000 7fe863ab3640 1 -- 172.21.15.172:0/1656728763 >> 172.21.15.172:0/1656728763 conn(0x7fe85c0cfae0 msgr2=0x7fe85c0cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:52.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.379+0000 7fe863ab3640 1 -- 172.21.15.172:0/1656728763 shutdown_connections 2024-04-25T08:51:52.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.379+0000 7fe863ab3640 1 -- 172.21.15.172:0/1656728763 wait complete. 2024-04-25T08:51:52.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.380+0000 7fe863ab3640 1 Processor -- start 2024-04-25T08:51:52.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.380+0000 7fe863ab3640 1 -- start start 2024-04-25T08:51:52.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe863ab3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0720f0 0x7fe85c1465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe863ab3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe85c0b3410 0x7fe85c13efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe863ab3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe85c0b3f00 0x7fe85c13f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe863ab3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c147890 con 0x7fe85c0720f0 2024-04-25T08:51:52.372 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe863ab3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c06dbc0 con 0x7fe85c0b3f00 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe863ab3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c147230 con 0x7fe85c0b3410 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe86184f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0720f0 0x7fe85c1465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe86184f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0720f0 0x7fe85c1465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50386/0 (socket says 172.21.15.172:50386) 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe86184f640 1 -- 172.21.15.172:0/478377569 learned_addr learned my addr 172.21.15.172:0/478377569 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe862050640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe85c0b3f00 0x7fe85c13f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe86184f640 1 -- 172.21.15.172:0/478377569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe85c0b3410 msgr2=0x7fe85c13efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe86184f640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe85c0b3410 0x7fe85c13efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe86184f640 1 -- 172.21.15.172:0/478377569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe85c0b3f00 msgr2=0x7fe85c13f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe86184f640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe85c0b3f00 0x7fe85c13f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe86184f640 1 -- 172.21.15.172:0/478377569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c1ea200 con 0x7fe85c0720f0 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe862050640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe85c0b3f00 0x7fe85c13f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe86184f640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0720f0 0x7fe85c1465e0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c400 tx=0x7fe85800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe8527fc640 1 -- 172.21.15.172:0/478377569 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8580052d0 con 0x7fe85c0720f0 2024-04-25T08:51:52.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe8527fc640 1 -- 172.21.15.172:0/478377569 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe858005490 con 0x7fe85c0720f0 2024-04-25T08:51:52.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe863ab3640 1 -- 172.21.15.172:0/478377569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85c1ea480 con 0x7fe85c0720f0 2024-04-25T08:51:52.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe8527fc640 1 -- 172.21.15.172:0/478377569 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858007260 con 0x7fe85c0720f0 2024-04-25T08:51:52.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.381+0000 7fe863ab3640 1 -- 172.21.15.172:0/478377569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c1eaa40 con 0x7fe85c0720f0 2024-04-25T08:51:52.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.382+0000 7fe863ab3640 1 -- 172.21.15.172:0/478377569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85c071f10 con 0x7fe85c0720f0 2024-04-25T08:51:52.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.383+0000 7fe8527fc640 1 -- 172.21.15.172:0/478377569 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe858007400 con 0x7fe85c0720f0 2024-04-25T08:51:52.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.383+0000 7fe8527fc640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe84006b4d0 0x7fe84006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.383+0000 7fe8527fc640 1 -- 172.21.15.172:0/478377569 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fe858089630 con 0x7fe85c0720f0 2024-04-25T08:51:52.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.383+0000 7fe86104e640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe84006b4d0 0x7fe84006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.384+0000 7fe86104e640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe84006b4d0 0x7fe84006d990 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe85c144d80 tx=0x7fe84c007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:52.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.387+0000 7fe8527fc640 1 -- 172.21.15.172:0/478377569 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe85c071f10 con 0x7fe85c0720f0 2024-04-25T08:51:52.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.622+0000 7fe863ab3640 1 -- 172.21.15.172:0/478377569 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) v1 -- 0x7fe85c073990 con 0x7fe85c0720f0 2024-04-25T08:51:52.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.642+0000 7fe8527fc640 1 -- 172.21.15.172:0/478377569 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v466) v1 ==== 162+0+0 (secure 0 0 0) 0x7fe85c1ea200 con 0x7fe85c0720f0 2024-04-25T08:51:52.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 -- 172.21.15.172:0/478377569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe84006b4d0 msgr2=0x7fe84006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe84006b4d0 0x7fe84006d990 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe85c144d80 tx=0x7fe84c007a40 comp rx=0 tx=0).stop 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 -- 172.21.15.172:0/478377569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0720f0 msgr2=0x7fe85c1465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0720f0 0x7fe85c1465e0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c400 tx=0x7fe85800c8c0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 -- 172.21.15.172:0/478377569 shutdown_connections 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe84006b4d0 0x7fe84006d990 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe85c0b3f00 0x7fe85c13f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe85c0b3410 0x7fe85c13efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 --2- 172.21.15.172:0/478377569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe85c0720f0 0x7fe85c1465e0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 -- 172.21.15.172:0/478377569 >> 172.21.15.172:0/478377569 conn(0x7fe85c0cfae0 msgr2=0x7fe85c06e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 -- 172.21.15.172:0/478377569 shutdown_connections 2024-04-25T08:51:52.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.644+0000 7fe863ab3640 1 -- 172.21.15.172:0/478377569 wait complete. 2024-04-25T08:51:52.645 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T08:51:52.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.755+0000 7f29b0929640 1 Processor -- start 2024-04-25T08:51:52.746 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.755+0000 7f29b0929640 1 -- start start 2024-04-25T08:51:52.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29b0929640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f29ac06e360 0x7f29ac06e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29b0929640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac15e020 con 0x7f29ac06ec80 2024-04-25T08:51:52.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29b0929640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac06ac80 con 0x7f29ac06bd20 2024-04-25T08:51:52.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29b0929640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac06b890 con 0x7f29ac06e360 2024-04-25T08:51:52.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29aa59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f29ac06e360 0x7f29ac06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29a3fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f29ac06ec80 0x7f29ac0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60060/0 (socket says 172.21.15.172:60060) 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29a3fff640 1 -- 172.21.15.172:0/3352217656 learned_addr learned my addr 172.21.15.172:0/3352217656 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29aa59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f29ac06e360 0x7f29ac06e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50402/0 (socket says 172.21.15.172:50402) 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29aa59c640 1 -- 172.21.15.172:0/3352217656 >> v1:172.21.15.186:6789/0 conn(0x7f29ac06bd20 legacy=0x7f29ac0acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29aa59c640 1 -- 172.21.15.172:0/3352217656 >> v1:172.21.15.172:6789/0 conn(0x7f29ac06ec80 legacy=0x7f29ac0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29aa59c640 1 -- 172.21.15.172:0/3352217656 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac06af60 con 0x7f29ac06e360 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.756+0000 7f29a9d9b640 1 -- 172.21.15.172:0/3352217656 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577046115 0 0) 0x7f29ac15e020 con 0x7f29ac06ec80 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.757+0000 7f29aa59c640 1 --2- 172.21.15.172:0/3352217656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06e360 0x7f29ac06e740 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f299c0097a0 tx=0x7f299c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bafce5a576c507d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.757+0000 7f29a9d9b640 1 -- 172.21.15.172:0/3352217656 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c037070 con 0x7f29ac06e360 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.757+0000 7f29a9d9b640 1 -- 172.21.15.172:0/3352217656 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c032440 con 0x7f29ac06e360 2024-04-25T08:51:52.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.757+0000 7f29a9d9b640 1 -- 172.21.15.172:0/3352217656 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c032810 con 0x7f29ac06e360 2024-04-25T08:51:52.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.758+0000 7f29b0929640 1 -- 172.21.15.172:0/3352217656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06e360 msgr2=0x7f29ac06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.758+0000 7f29b0929640 1 --2- 172.21.15.172:0/3352217656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06e360 0x7f29ac06e740 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f299c0097a0 tx=0x7f299c02a270 comp rx=0 tx=0).stop 2024-04-25T08:51:52.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.758+0000 7f29b0929640 1 -- 172.21.15.172:0/3352217656 shutdown_connections 2024-04-25T08:51:52.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.758+0000 7f29b0929640 1 --2- 172.21.15.172:0/3352217656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06e360 0x7f29ac06e740 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.758+0000 7f29b0929640 1 -- 172.21.15.172:0/3352217656 >> 172.21.15.172:0/3352217656 conn(0x7f29ac0cfec0 msgr2=0x7f29ac0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:52.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.758+0000 7f29b0929640 1 -- 172.21.15.172:0/3352217656 shutdown_connections 2024-04-25T08:51:52.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.758+0000 7f29b0929640 1 -- 172.21.15.172:0/3352217656 wait complete. 2024-04-25T08:51:52.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.759+0000 7f29b0929640 1 Processor -- start 2024-04-25T08:51:52.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.759+0000 7f29b0929640 1 -- start start 2024-04-25T08:51:52.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29b0929640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06bd20 0x7f29ac1467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29b0929640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29ac06e360 0x7f29ac1e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29b0929640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ac06ec80 0x7f29ac15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29b0929640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0b2fd0 con 0x7f29ac06bd20 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29b0929640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac06b520 con 0x7f29ac06ec80 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29b0929640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0b3150 con 0x7f29ac06e360 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29aa59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06bd20 0x7f29ac1467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29aa59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06bd20 0x7f29ac1467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50416/0 (socket says 172.21.15.172:50416) 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29aa59c640 1 -- 172.21.15.172:0/1113574245 learned_addr learned my addr 172.21.15.172:0/1113574245 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29aa59c640 1 -- 172.21.15.172:0/1113574245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29ac06e360 msgr2=0x7f29ac1e7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29aa59c640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29ac06e360 0x7f29ac1e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29aa59c640 1 -- 172.21.15.172:0/1113574245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ac06ec80 msgr2=0x7f29ac15cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29aad9d640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ac06ec80 0x7f29ac15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29aa59c640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ac06ec80 0x7f29ac15cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29aa59c640 1 -- 172.21.15.172:0/1113574245 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac1e4cb0 con 0x7f29ac06bd20 2024-04-25T08:51:52.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29aa59c640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06bd20 0x7f29ac1467f0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f299c0097a0 tx=0x7f299c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:52.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29a2ffd640 1 -- 172.21.15.172:0/1113574245 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c041070 con 0x7f29ac06bd20 2024-04-25T08:51:52.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29a2ffd640 1 -- 172.21.15.172:0/1113574245 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c03c870 con 0x7f29ac06bd20 2024-04-25T08:51:52.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29b0929640 1 -- 172.21.15.172:0/1113574245 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac1e4f20 con 0x7f29ac06bd20 2024-04-25T08:51:52.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29a2ffd640 1 -- 172.21.15.172:0/1113574245 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c037040 con 0x7f29ac06bd20 2024-04-25T08:51:52.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.760+0000 7f29b0929640 1 -- 172.21.15.172:0/1113574245 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac1e54e0 con 0x7f29ac06bd20 2024-04-25T08:51:52.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.761+0000 7f29b0929640 1 -- 172.21.15.172:0/1113574245 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac073a00 con 0x7f29ac06bd20 2024-04-25T08:51:52.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.762+0000 7f29a2ffd640 1 -- 172.21.15.172:0/1113574245 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f299c044070 con 0x7f29ac06bd20 2024-04-25T08:51:52.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.762+0000 7f29a2ffd640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298c06b4d0 0x7f298c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:52.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.762+0000 7f29a2ffd640 1 -- 172.21.15.172:0/1113574245 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f299c0aac30 con 0x7f29ac06bd20 2024-04-25T08:51:52.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.762+0000 7f29a3fff640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298c06b4d0 0x7f298c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:52.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.763+0000 7f29a3fff640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298c06b4d0 0x7f298c06d990 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2994007fd0 tx=0x7f2994007960 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:52.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.767+0000 7f29a2ffd640 1 -- 172.21.15.172:0/1113574245 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f299c079bd0 con 0x7f29ac06bd20 2024-04-25T08:51:52.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.938+0000 7f29b0929640 1 -- 172.21.15.172:0/1113574245 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f29ac159590 con 0x7f29ac06bd20 2024-04-25T08:51:52.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.941+0000 7f29a2ffd640 1 -- 172.21.15.172:0/1113574245 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f299c0794d0 con 0x7f29ac06bd20 2024-04-25T08:51:52.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.943+0000 7f29b0929640 1 -- 172.21.15.172:0/1113574245 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298c06b4d0 msgr2=0x7f298c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.943+0000 7f29b0929640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298c06b4d0 0x7f298c06d990 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2994007fd0 tx=0x7f2994007960 comp rx=0 tx=0).stop 2024-04-25T08:51:52.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.943+0000 7f29b0929640 1 -- 172.21.15.172:0/1113574245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06bd20 msgr2=0x7f29ac1467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:52.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.943+0000 7f29b0929640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06bd20 0x7f29ac1467f0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f299c0097a0 tx=0x7f299c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.943+0000 7f29b0929640 1 -- 172.21.15.172:0/1113574245 shutdown_connections 2024-04-25T08:51:52.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.943+0000 7f29b0929640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f298c06b4d0 0x7f298c06d990 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.943+0000 7f29b0929640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29ac06ec80 0x7f29ac15cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.943+0000 7f29b0929640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29ac06e360 0x7f29ac1e7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.943+0000 7f29b0929640 1 --2- 172.21.15.172:0/1113574245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac06bd20 0x7f29ac1467f0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.943+0000 7f29b0929640 1 -- 172.21.15.172:0/1113574245 >> 172.21.15.172:0/1113574245 conn(0x7f29ac0cfec0 msgr2=0x7f29ac0acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.944+0000 7f29b0929640 1 -- 172.21.15.172:0/1113574245 shutdown_connections 2024-04-25T08:51:52.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:52.944+0000 7f29b0929640 1 -- 172.21.15.172:0/1113574245 wait complete. 2024-04-25T08:51:52.945 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:51:52.945 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:51:53.002 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:51:53.043 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:51:53.043 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:51:53.043 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:51:53.058 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:51:53.058 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:51:53.059 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:51:53.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:51:53.101 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:51:53.101 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:51:53.116 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:51:53.116 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:51:53.116 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:51:53.158 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:51:53.158 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T08:51:53.158 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:51:53.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.265+0000 7f2f94342640 1 Processor -- start 2024-04-25T08:51:53.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.265+0000 7f2f94342640 1 -- start start 2024-04-25T08:51:53.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.266+0000 7f2f94342640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f8c154ed0 0x7f2f8c0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.266+0000 7f2f94342640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c071ac0 0x7f2f8c0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.266+0000 7f2f94342640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2f8c06c1d0 0x7f2f8c0ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.266+0000 7f2f94342640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c15ec60 con 0x7f2f8c154ed0 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.266+0000 7f2f94342640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c15ef40 con 0x7f2f8c06c1d0 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.266+0000 7f2f94342640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c06db90 con 0x7f2f8c071ac0 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.266+0000 7f2f920de640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f8c154ed0 0x7f2f8c0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.266+0000 7f2f920de640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f8c154ed0 0x7f2f8c0aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50424/0 (socket says 172.21.15.172:50424) 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.266+0000 7f2f920de640 1 -- 172.21.15.172:0/798169342 learned_addr learned my addr 172.21.15.172:0/798169342 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.267+0000 7f2f928df640 1 --2- 172.21.15.172:0/798169342 >> v2:172.21.15.186:3300/0 conn(0x7f2f8c06c1d0 0x7f2f8c0ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.267+0000 7f2f920de640 1 -- 172.21.15.172:0/798169342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c071ac0 msgr2=0x7f2f8c0ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.267+0000 7f2f920de640 1 --2- 172.21.15.172:0/798169342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c071ac0 0x7f2f8c0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.267+0000 7f2f920de640 1 -- 172.21.15.172:0/798169342 >> v2:172.21.15.186:3300/0 conn(0x7f2f8c06c1d0 msgr2=0x7f2f8c0ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.267+0000 7f2f920de640 1 --2- 172.21.15.172:0/798169342 >> v2:172.21.15.186:3300/0 conn(0x7f2f8c06c1d0 0x7f2f8c0ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.258 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.267+0000 7f2f920de640 1 -- 172.21.15.172:0/798169342 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c06de70 con 0x7f2f8c154ed0 2024-04-25T08:51:53.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.267+0000 7f2f920de640 1 --2- 172.21.15.172:0/798169342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c154ed0 0x7f2f8c0aced0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c162890 tx=0x7f2f8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184626ccea2278cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:53.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.267+0000 7f2f910dc640 1 -- 172.21.15.172:0/798169342 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88037070 con 0x7f2f8c154ed0 2024-04-25T08:51:53.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.267+0000 7f2f910dc640 1 -- 172.21.15.172:0/798169342 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88032440 con 0x7f2f8c154ed0 2024-04-25T08:51:53.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.267+0000 7f2f910dc640 1 -- 172.21.15.172:0/798169342 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88032810 con 0x7f2f8c154ed0 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.268+0000 7f2f94342640 1 -- 172.21.15.172:0/798169342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c154ed0 msgr2=0x7f2f8c0aced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.268+0000 7f2f94342640 1 --2- 172.21.15.172:0/798169342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c154ed0 0x7f2f8c0aced0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c162890 tx=0x7f2f8802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.268+0000 7f2f94342640 1 -- 172.21.15.172:0/798169342 shutdown_connections 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.268+0000 7f2f94342640 1 --2- 172.21.15.172:0/798169342 >> v2:172.21.15.186:3300/0 conn(0x7f2f8c06c1d0 0x7f2f8c0ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.268+0000 7f2f94342640 1 --2- 172.21.15.172:0/798169342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c071ac0 0x7f2f8c0ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.268+0000 7f2f94342640 1 --2- 172.21.15.172:0/798169342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c154ed0 0x7f2f8c0aced0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.268+0000 7f2f94342640 1 -- 172.21.15.172:0/798169342 >> 172.21.15.172:0/798169342 conn(0x7f2f8c0af670 msgr2=0x7f2f8c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.268+0000 7f2f94342640 1 -- 172.21.15.172:0/798169342 shutdown_connections 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.268+0000 7f2f94342640 1 -- 172.21.15.172:0/798169342 wait complete. 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.269+0000 7f2f94342640 1 Processor -- start 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.269+0000 7f2f94342640 1 -- start start 2024-04-25T08:51:53.262 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f94342640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c071ac0 0x7f2f8c0cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f94342640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c154ed0 0x7f2f8c1e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f94342640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ce090 0x7f2f8c0ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f94342640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c161ba0 con 0x7f2f8c0ce090 2024-04-25T08:51:53.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f94342640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c161a20 con 0x7f2f8c154ed0 2024-04-25T08:51:53.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f94342640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c161d20 con 0x7f2f8c071ac0 2024-04-25T08:51:53.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f928df640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ce090 0x7f2f8c0ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f928df640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ce090 0x7f2f8c0ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50438/0 (socket says 172.21.15.172:50438) 2024-04-25T08:51:53.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f928df640 1 -- 172.21.15.172:0/2779865476 learned_addr learned my addr 172.21.15.172:0/2779865476 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:53.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f928df640 1 -- 172.21.15.172:0/2779865476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c071ac0 msgr2=0x7f2f8c0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:53.263 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f920de640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c071ac0 0x7f2f8c0cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f918dd640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c154ed0 0x7f2f8c1e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f928df640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c071ac0 0x7f2f8c0cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f928df640 1 -- 172.21.15.172:0/2779865476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c154ed0 msgr2=0x7f2f8c1e7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f928df640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c154ed0 0x7f2f8c1e7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f928df640 1 -- 172.21.15.172:0/2779865476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c1e8570 con 0x7f2f8c0ce090 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f918dd640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c154ed0 0x7f2f8c1e7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.270+0000 7f2f920de640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c071ac0 0x7f2f8c0cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.271+0000 7f2f928df640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ce090 0x7f2f8c0ce540 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400cce0 tx=0x7f2f8400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.271+0000 7f2f82ffd640 1 -- 172.21.15.172:0/2779865476 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84003b90 con 0x7f2f8c0ce090 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.271+0000 7f2f82ffd640 1 -- 172.21.15.172:0/2779865476 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f84003d50 con 0x7f2f8c0ce090 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.271+0000 7f2f82ffd640 1 -- 172.21.15.172:0/2779865476 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84004260 con 0x7f2f8c0ce090 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.271+0000 7f2f94342640 1 -- 172.21.15.172:0/2779865476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c1e8810 con 0x7f2f8c0ce090 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.271+0000 7f2f94342640 1 -- 172.21.15.172:0/2779865476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c1e8270 con 0x7f2f8c0ce090 2024-04-25T08:51:53.264 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.272+0000 7f2f94342640 1 -- 172.21.15.172:0/2779865476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c0b2b10 con 0x7f2f8c0ce090 2024-04-25T08:51:53.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.272+0000 7f2f82ffd640 1 -- 172.21.15.172:0/2779865476 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f84004400 con 0x7f2f8c0ce090 2024-04-25T08:51:53.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.272+0000 7f2f82ffd640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 0x7f2f7006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.273+0000 7f2f82ffd640 1 -- 172.21.15.172:0/2779865476 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f2f8408aab0 con 0x7f2f8c0ce090 2024-04-25T08:51:53.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.273+0000 7f2f920de640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 0x7f2f7006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.273+0000 7f2f920de640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 0x7f2f7006d9c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2f88034000 tx=0x7f2f8802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:53.267 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.277+0000 7f2f82ffd640 1 -- 172.21.15.172:0/2779865476 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f8401d340 con 0x7f2f8c0ce090 2024-04-25T08:51:53.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.480+0000 7f2f94342640 1 -- 172.21.15.172:0/2779865476 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f8c073990 con 0x7f2f8c0ce090 2024-04-25T08:51:53.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.481+0000 7f2f82ffd640 1 -- 172.21.15.172:0/2779865476 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2914 (secure 0 0 0) 0x7f2f840599c0 con 0x7f2f8c0ce090 2024-04-25T08:51:53.471 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:53.471 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6944,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/405485338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":405485338},{"type":"v1","addr":"172.21.15.186:6835","nonce":405485338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":6947,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/2963645309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2963645309},{"type":"v1","addr":"172.21.15.186:6834","nonce":2963645309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71},{"gid":9741,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3394918265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3394918265},{"type":"v1","addr":"172.21.15.172:6835","nonce":3394918265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[]} 2024-04-25T08:51:53.472 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 80 2024-04-25T08:51:53.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 -- 172.21.15.172:0/2779865476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 msgr2=0x7f2f7006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:53.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 0x7f2f7006d9c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2f88034000 tx=0x7f2f8802e000 comp rx=0 tx=0).stop 2024-04-25T08:51:53.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 -- 172.21.15.172:0/2779865476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ce090 msgr2=0x7f2f8c0ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:53.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ce090 0x7f2f8c0ce540 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400cce0 tx=0x7f2f8400a660 comp rx=0 tx=0).stop 2024-04-25T08:51:53.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 -- 172.21.15.172:0/2779865476 shutdown_connections 2024-04-25T08:51:53.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7006b500 0x7f2f7006d9c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c154ed0 0x7f2f8c1e7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0ce090 0x7f2f8c0ce540 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 --2- 172.21.15.172:0/2779865476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c071ac0 0x7f2f8c0cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 -- 172.21.15.172:0/2779865476 >> 172.21.15.172:0/2779865476 conn(0x7f2f8c06c1d0 msgr2=0x7f2f8c15e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:53.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 -- 172.21.15.172:0/2779865476 shutdown_connections 2024-04-25T08:51:53.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.483+0000 7f2f94342640 1 -- 172.21.15.172:0/2779865476 wait complete. 2024-04-25T08:51:53.484 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T08:51:53.484 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T08:51:53.485 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:51:53.485 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:51:53.485 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T08:51:53.485 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T08:51:53.486 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T08:51:53.486 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T08:51:53.486 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:51:53.486 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:51:53.486 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T08:51:53.486 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T08:51:53.486 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:51:53.487 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:51:53.488 INFO:tasks.ceph.mds.c:Started 2024-04-25T08:51:53.489 DEBUG:teuthology.parallel:result is None 2024-04-25T08:51:53.493 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:51:53.494 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T08:51:53.497 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:51:53.497 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T08:51:53.498 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:51:53.498 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T08:51:53.536 INFO:tasks.ceph.mds.a:Started 2024-04-25T08:51:53.536 DEBUG:teuthology.parallel:result is None 2024-04-25T08:51:53.540 INFO:tasks.ceph.mds.b:Started 2024-04-25T08:51:53.540 DEBUG:teuthology.parallel:result is None 2024-04-25T08:51:53.541 INFO:tasks.ceph.mds.d:Started 2024-04-25T08:51:53.541 DEBUG:teuthology.parallel:result is None 2024-04-25T08:51:53.541 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T08:51:53.560 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:51:53.609 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:51:53.619 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T08:51:53.619 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T08:51:53.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.653+0000 7f932d73b640 1 Processor -- start 2024-04-25T08:51:53.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.653+0000 7f932d73b640 1 -- start start 2024-04-25T08:51:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.654+0000 7f932d73b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f932815bb20 0x7f93280cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.654+0000 7f932d73b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f93280ccdd0 0x7f93280cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.654+0000 7f932d73b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 0x7f93280cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.654+0000 7f932d73b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93280d0450 con 0x7f93280ccdd0 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.654+0000 7f932d73b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93280cb190 con 0x7f932815bb20 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.654+0000 7f932d73b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280cb470 con 0x7f93280cdcd0 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.654+0000 7f93267fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f93280ccdd0 0x7f93280cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.654+0000 7f93267fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f93280ccdd0 0x7f93280cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50472/0 (socket says 172.21.15.172:50472) 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.654+0000 7f93267fc640 1 -- 172.21.15.172:0/953960673 learned_addr learned my addr 172.21.15.172:0/953960673 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.655+0000 7f93277fe640 1 --2- 172.21.15.172:0/953960673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 0x7f93280cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.655+0000 7f9326ffd640 1 --2- 172.21.15.172:0/953960673 >> v2:172.21.15.186:3300/0 conn(0x7f932815bb20 0x7f93280cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.655+0000 7f93267fc640 1 -- 172.21.15.172:0/953960673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 msgr2=0x7f93280cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.655+0000 7f93267fc640 1 --2- 172.21.15.172:0/953960673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 0x7f93280cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.655+0000 7f93267fc640 1 -- 172.21.15.172:0/953960673 >> v2:172.21.15.186:3300/0 conn(0x7f932815bb20 msgr2=0x7f93280cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.655+0000 7f93267fc640 1 --2- 172.21.15.172:0/953960673 >> v2:172.21.15.186:3300/0 conn(0x7f932815bb20 0x7f93280cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.655+0000 7f93267fc640 1 -- 172.21.15.172:0/953960673 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93280cb750 con 0x7f93280ccdd0 2024-04-25T08:51:53.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.655+0000 7f93267fc640 1 --2- 172.21.15.172:0/953960673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93280ccdd0 0x7f93280cf9d0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f93280d1800 tx=0x7f931802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca87d4640d4a92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:53.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f9325ffb640 1 -- 172.21.15.172:0/953960673 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318037070 con 0x7f93280ccdd0 2024-04-25T08:51:53.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f9325ffb640 1 -- 172.21.15.172:0/953960673 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318032440 con 0x7f93280ccdd0 2024-04-25T08:51:53.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f9325ffb640 1 -- 172.21.15.172:0/953960673 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318032810 con 0x7f93280ccdd0 2024-04-25T08:51:53.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f932d73b640 1 -- 172.21.15.172:0/953960673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93280ccdd0 msgr2=0x7f93280cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:53.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f932d73b640 1 --2- 172.21.15.172:0/953960673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93280ccdd0 0x7f93280cf9d0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f93280d1800 tx=0x7f931802a140 comp rx=0 tx=0).stop 2024-04-25T08:51:53.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f932d73b640 1 -- 172.21.15.172:0/953960673 shutdown_connections 2024-04-25T08:51:53.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f932d73b640 1 --2- 172.21.15.172:0/953960673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 0x7f93280cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f932d73b640 1 --2- 172.21.15.172:0/953960673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93280ccdd0 0x7f93280cf9d0 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f932d73b640 1 --2- 172.21.15.172:0/953960673 >> v2:172.21.15.186:3300/0 conn(0x7f932815bb20 0x7f93280cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f932d73b640 1 -- 172.21.15.172:0/953960673 >> 172.21.15.172:0/953960673 conn(0x7f93280b2390 msgr2=0x7f93280b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:53.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f932d73b640 1 -- 172.21.15.172:0/953960673 shutdown_connections 2024-04-25T08:51:53.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.656+0000 7f932d73b640 1 -- 172.21.15.172:0/953960673 wait complete. 2024-04-25T08:51:53.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.658+0000 7f932d73b640 1 Processor -- start 2024-04-25T08:51:53.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.658+0000 7f932d73b640 1 -- start start 2024-04-25T08:51:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.658+0000 7f932d73b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93280ccdd0 0x7f93280b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.658+0000 7f932d73b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 0x7f93280c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.658+0000 7f932d73b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f932815bb20 0x7f93280c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.658+0000 7f932d73b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280cc770 con 0x7f932815bb20 2024-04-25T08:51:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f932d73b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280cbd10 con 0x7f93280ccdd0 2024-04-25T08:51:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f932d73b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932815bf00 con 0x7f93280cdcd0 2024-04-25T08:51:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93277fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f932815bb20 0x7f93280c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93277fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f932815bb20 0x7f93280c7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50474/0 (socket says 172.21.15.172:50474) 2024-04-25T08:51:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93277fe640 1 -- 172.21.15.172:0/4140241987 learned_addr learned my addr 172.21.15.172:0/4140241987 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:53.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f9326ffd640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93280ccdd0 0x7f93280b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93267fc640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 0x7f93280c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93277fe640 1 -- 172.21.15.172:0/4140241987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 msgr2=0x7f93280c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93277fe640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 0x7f93280c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93277fe640 1 -- 172.21.15.172:0/4140241987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93280ccdd0 msgr2=0x7f93280b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93277fe640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93280ccdd0 0x7f93280b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93277fe640 1 -- 172.21.15.172:0/4140241987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93280c8440 con 0x7f932815bb20 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93267fc640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 0x7f93280c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f93277fe640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f932815bb20 0x7f93280c7d70 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f932000ef00 tx=0x7f932000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f930f7fe640 1 -- 172.21.15.172:0/4140241987 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320018020 con 0x7f932815bb20 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f930f7fe640 1 -- 172.21.15.172:0/4140241987 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932000bd20 con 0x7f932815bb20 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f932d73b640 1 -- 172.21.15.172:0/4140241987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93281f7280 con 0x7f932815bb20 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f930f7fe640 1 -- 172.21.15.172:0/4140241987 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320014640 con 0x7f932815bb20 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.659+0000 7f932d73b640 1 -- 172.21.15.172:0/4140241987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93280b1030 con 0x7f932815bb20 2024-04-25T08:51:53.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.660+0000 7f932d73b640 1 -- 172.21.15.172:0/4140241987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9328073a00 con 0x7f932815bb20 2024-04-25T08:51:53.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.661+0000 7f930f7fe640 1 -- 172.21.15.172:0/4140241987 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9320005d10 con 0x7f932815bb20 2024-04-25T08:51:53.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.661+0000 7f930f7fe640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 0x7f931406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:53.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.661+0000 7f930f7fe640 1 -- 172.21.15.172:0/4140241987 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f932008a610 con 0x7f932815bb20 2024-04-25T08:51:53.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.661+0000 7f9326ffd640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 0x7f931406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:53.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.661+0000 7f9326ffd640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 0x7f931406d990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f931c009b40 tx=0x7f931c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:53.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.665+0000 7f930f7fe640 1 -- 172.21.15.172:0/4140241987 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9320022070 con 0x7f932815bb20 2024-04-25T08:51:53.838 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:53.848+0000 7f932d73b640 1 -- 172.21.15.172:0/4140241987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f93280aeb90 con 0x7f932815bb20 2024-04-25T08:51:54.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.653+0000 7f930f7fe640 1 -- 172.21.15.172:0/4140241987 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v139) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9320059640 con 0x7f932815bb20 2024-04-25T08:51:54.644 INFO:teuthology.orchestra.run.smithi172.stderr: removed all blocklist entries 2024-04-25T08:51:54.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 -- 172.21.15.172:0/4140241987 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 msgr2=0x7f931406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:54.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 0x7f931406d990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f931c009b40 tx=0x7f931c009190 comp rx=0 tx=0).stop 2024-04-25T08:51:54.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 -- 172.21.15.172:0/4140241987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f932815bb20 msgr2=0x7f93280c7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:54.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f932815bb20 0x7f93280c7d70 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f932000ef00 tx=0x7f932000b480 comp rx=0 tx=0).stop 2024-04-25T08:51:54.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 -- 172.21.15.172:0/4140241987 shutdown_connections 2024-04-25T08:51:54.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f931406b4d0 0x7f931406d990 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:54.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f932815bb20 0x7f93280c7d70 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:54.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93280cdcd0 0x7f93280c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:54.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 --2- 172.21.15.172:0/4140241987 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93280ccdd0 0x7f93280b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:54.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 -- 172.21.15.172:0/4140241987 >> 172.21.15.172:0/4140241987 conn(0x7f93280b2390 msgr2=0x7f93280b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:54.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 -- 172.21.15.172:0/4140241987 shutdown_connections 2024-04-25T08:51:54.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.656+0000 7f932d73b640 1 -- 172.21.15.172:0/4140241987 wait complete. 2024-04-25T08:51:54.660 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T08:51:54.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.812+0000 7fd75f17e640 1 Processor -- start 2024-04-25T08:51:54.802 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.812+0000 7fd75f17e640 1 -- start start 2024-04-25T08:51:54.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75f17e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd75813d190 0x7fd7580cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:54.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75f17e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd758071940 0x7fd7580cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:54.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75f17e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd758071ed0 con 0x7fd75815b320 2024-04-25T08:51:54.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75f17e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75813d570 con 0x7fd75813d190 2024-04-25T08:51:54.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75f17e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75815a840 con 0x7fd758071940 2024-04-25T08:51:54.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75cf1a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd75813d190 0x7fd7580cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75cf1a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd75813d190 0x7fd7580cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50488/0 (socket says 172.21.15.172:50488) 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75cf1a640 1 -- 172.21.15.172:0/1115987463 learned_addr learned my addr 172.21.15.172:0/1115987463 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd757fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd75815b320 0x7fd758071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60062/0 (socket says 172.21.15.172:60062) 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75d71b640 1 --2- 172.21.15.172:0/1115987463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd758071940 0x7fd7580cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75cf1a640 1 -- 172.21.15.172:0/1115987463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd758071940 msgr2=0x7fd7580cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75cf1a640 1 --2- 172.21.15.172:0/1115987463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd758071940 0x7fd7580cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75cf1a640 1 -- 172.21.15.172:0/1115987463 >> v1:172.21.15.172:6789/0 conn(0x7fd75815b320 legacy=0x7fd758071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd75cf1a640 1 -- 172.21.15.172:0/1115987463 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75815ab20 con 0x7fd75813d190 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.813+0000 7fd7577fe640 1 -- 172.21.15.172:0/1115987463 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508307176 0 0) 0x7fd758071ed0 con 0x7fd75815b320 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd75cf1a640 1 --2- 172.21.15.172:0/1115987463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 0x7fd7580cbfb0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00bb10 tx=0x7fd74c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68588c637971328a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd7577fe640 1 -- 172.21.15.172:0/1115987463 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c032790 con 0x7fd75813d190 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd7577fe640 1 -- 172.21.15.172:0/1115987463 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c038070 con 0x7fd75813d190 2024-04-25T08:51:54.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd7577fe640 1 -- 172.21.15.172:0/1115987463 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c032b50 con 0x7fd75813d190 2024-04-25T08:51:54.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd75f17e640 1 -- 172.21.15.172:0/1115987463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 msgr2=0x7fd7580cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:54.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd75f17e640 1 --2- 172.21.15.172:0/1115987463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 0x7fd7580cbfb0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00bb10 tx=0x7fd74c02c890 comp rx=0 tx=0).stop 2024-04-25T08:51:54.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd75f17e640 1 -- 172.21.15.172:0/1115987463 shutdown_connections 2024-04-25T08:51:54.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd75f17e640 1 --2- 172.21.15.172:0/1115987463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd758071940 0x7fd7580cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:54.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd75f17e640 1 --2- 172.21.15.172:0/1115987463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 0x7fd7580cbfb0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:54.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd75f17e640 1 -- 172.21.15.172:0/1115987463 >> 172.21.15.172:0/1115987463 conn(0x7fd75806abe0 msgr2=0x7fd75806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:54.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.814+0000 7fd75f17e640 1 -- 172.21.15.172:0/1115987463 shutdown_connections 2024-04-25T08:51:54.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.815+0000 7fd75f17e640 1 -- 172.21.15.172:0/1115987463 wait complete. 2024-04-25T08:51:54.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.816+0000 7fd75f17e640 1 Processor -- start 2024-04-25T08:51:54.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.816+0000 7fd75f17e640 1 -- start start 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.816+0000 7fd75f17e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd758071940 0x7fd75815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.816+0000 7fd75f17e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 0x7fd75813c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd75f17e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd75815b320 0x7fd75813c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd75f17e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580cf7a0 con 0x7fd75813d190 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd75f17e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580cf620 con 0x7fd758071940 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd75f17e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580cf920 con 0x7fd75815b320 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd757fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 0x7fd75813c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd757fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 0x7fd75813c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50494/0 (socket says 172.21.15.172:50494) 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd757fff640 1 -- 172.21.15.172:0/3796119979 learned_addr learned my addr 172.21.15.172:0/3796119979 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd75d71b640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd75815b320 0x7fd75813c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd75cf1a640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd758071940 0x7fd75815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd757fff640 1 -- 172.21.15.172:0/3796119979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd75815b320 msgr2=0x7fd75813c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd757fff640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd75815b320 0x7fd75813c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:54.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd757fff640 1 -- 172.21.15.172:0/3796119979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd758071940 msgr2=0x7fd75815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:54.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd757fff640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd758071940 0x7fd75815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:54.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd757fff640 1 -- 172.21.15.172:0/3796119979 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75813ab50 con 0x7fd75813d190 2024-04-25T08:51:54.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd757fff640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 0x7fd75813c000 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fd74400c430 tx=0x7fd74400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:54.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd7557fa640 1 -- 172.21.15.172:0/3796119979 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440074e0 con 0x7fd75813d190 2024-04-25T08:51:54.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd7557fa640 1 -- 172.21.15.172:0/3796119979 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7440047e0 con 0x7fd75813d190 2024-04-25T08:51:54.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd75f17e640 1 -- 172.21.15.172:0/3796119979 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75813ae30 con 0x7fd75813d190 2024-04-25T08:51:54.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd7557fa640 1 -- 172.21.15.172:0/3796119979 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744004bd0 con 0x7fd75813d190 2024-04-25T08:51:54.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.817+0000 7fd75f17e640 1 -- 172.21.15.172:0/3796119979 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75813b3f0 con 0x7fd75813d190 2024-04-25T08:51:54.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.818+0000 7fd75f17e640 1 -- 172.21.15.172:0/3796119979 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75813b5f0 con 0x7fd75813d190 2024-04-25T08:51:54.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.819+0000 7fd7557fa640 1 -- 172.21.15.172:0/3796119979 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd744011070 con 0x7fd75813d190 2024-04-25T08:51:54.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.819+0000 7fd7557fa640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd73c06b4d0 0x7fd73c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:54.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.819+0000 7fd75cf1a640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd73c06b4d0 0x7fd73c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:54.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.819+0000 7fd7557fa640 1 -- 172.21.15.172:0/3796119979 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd744089d00 con 0x7fd75813d190 2024-04-25T08:51:54.811 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.819+0000 7fd75cf1a640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd73c06b4d0 0x7fd73c06d990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd74c037000 tx=0x7fd74c03e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:54.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:54.823+0000 7fd7557fa640 1 -- 172.21.15.172:0/3796119979 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd75813b5f0 con 0x7fd75813d190 2024-04-25T08:51:55.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.058+0000 7fd75f17e640 1 -- 172.21.15.172:0/3796119979 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd758073990 con 0x7fd75813d190 2024-04-25T08:51:55.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.059+0000 7fd7557fa640 1 -- 172.21.15.172:0/3796119979 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd744058d40 con 0x7fd75813d190 2024-04-25T08:51:55.049 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:55.049 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:51:55.049 INFO:teuthology.orchestra.run.smithi172.stdout: "auth_dump": [ 2024-04-25T08:51:55.049 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.a", 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmFpnUABAAZEJQO4SeLN70+tx9ff+p4Q==", 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.050 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.b", 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypm8nAADBAAnwVYmqqhsYCn7+oalRkKyg==", 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.c", 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7Fypmv7ucBxAA7+cJIqnk5c8wA15h9LvpWA==", 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:51:55.051 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mds.d", 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmqsfOEhAAVuvu9+/dSd3e2NdhivJXKg==", 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.052 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.0", 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA+Fypmzk9aLxAA8hVtnHJSByzWmBnMTn36VQ==", 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.1", 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBBFypmReYsLRAASHcQJXDV9Dr7Jp9thI434g==", 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.053 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.2", 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBEFypmMYYOKxAApoW5S5bAq+66Q6pxRTEQ6g==", 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.054 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.055 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.055 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.3", 2024-04-25T08:51:55.055 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBHFypmPTJ2KBAAu5PipaguwcIOYMQDm5w8qg==", 2024-04-25T08:51:55.055 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.055 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:51:55.055 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:51:55.055 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.056 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.056 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.4", 2024-04-25T08:51:55.056 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBNFypmgKKvLBAAQ4f1WFOqq9H5EfzSA+BXBw==", 2024-04-25T08:51:55.056 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.056 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:51:55.056 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:51:55.057 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.057 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.057 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.057 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.5", 2024-04-25T08:51:55.057 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBQFypmfgq1KhAAt7fhnuxVxNudbRJLGTFTow==", 2024-04-25T08:51:55.058 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.058 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:51:55.058 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:51:55.058 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.058 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.059 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.059 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.059 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.6", 2024-04-25T08:51:55.059 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBTFypmO7huKBAA8eLaFZi1uICO7614istWyg==", 2024-04-25T08:51:55.059 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.059 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "osd.7", 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQBWFypmOsHuKBAAmP/k0hdbK53gHbF9pHSV9Q==", 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow profile osd", 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile osd", 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.0", 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q==", 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow r", 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.1", 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmMUQ/HxAA+LCwmiaNeVRZjCncKP0M6g==", 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.061 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.2", 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmgFcwHBAAs2IHwmZpZbGzE4Re8N0UPw==", 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:51:55.062 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.3", 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA7FypmYMGnJBAAxFQzYT357EUpifvhIGN21w==", 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow", 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow r", 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow rw", 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow rwx" 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "client.admin", 2024-04-25T08:51:55.063 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmFmQsIBAAkuAmqIptAT1ivH6T7/1T8A==", 2024-04-25T08:51:55.064 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.064 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:51:55.064 INFO:teuthology.orchestra.run.smithi172.stdout: "mgr": "allow *", 2024-04-25T08:51:55.064 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow *", 2024-04-25T08:51:55.064 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.064 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.064 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.064 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.064 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.x", 2024-04-25T08:51:55.064 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6FypmjxRlORAArC3WtoJH2Mm7iLhvaMAEHw==", 2024-04-25T08:51:55.065 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.065 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:51:55.065 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:51:55.065 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.065 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.066 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-04-25T08:51:55.066 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.066 INFO:teuthology.orchestra.run.smithi172.stdout: "entity": "mgr.y", 2024-04-25T08:51:55.066 INFO:teuthology.orchestra.run.smithi172.stdout: "key": "AQA6Fypmop0vNBAA2Deu6kTHssdyCH2sqOvEJg==", 2024-04-25T08:51:55.066 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": { 2024-04-25T08:51:55.066 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": "allow *", 2024-04-25T08:51:55.067 INFO:teuthology.orchestra.run.smithi172.stdout: "mon": "allow profile mgr", 2024-04-25T08:51:55.067 INFO:teuthology.orchestra.run.smithi172.stdout: "osd": "allow *" 2024-04-25T08:51:55.067 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.067 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.067 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-04-25T08:51:55.067 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:51:55.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 -- 172.21.15.172:0/3796119979 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd73c06b4d0 msgr2=0x7fd73c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd73c06b4d0 0x7fd73c06d990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd74c037000 tx=0x7fd74c03e040 comp rx=0 tx=0).stop 2024-04-25T08:51:55.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 -- 172.21.15.172:0/3796119979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 msgr2=0x7fd75813c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 0x7fd75813c000 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fd74400c430 tx=0x7fd74400c8f0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 -- 172.21.15.172:0/3796119979 shutdown_connections 2024-04-25T08:51:55.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd73c06b4d0 0x7fd73c06d990 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd75815b320 0x7fd75813c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd75813d190 0x7fd75813c000 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 --2- 172.21.15.172:0/3796119979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd758071940 0x7fd75815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 -- 172.21.15.172:0/3796119979 >> 172.21.15.172:0/3796119979 conn(0x7fd75806abe0 msgr2=0x7fd758139ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:55.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 -- 172.21.15.172:0/3796119979 shutdown_connections 2024-04-25T08:51:55.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.061+0000 7fd75f17e640 1 -- 172.21.15.172:0/3796119979 wait complete. 2024-04-25T08:51:55.072 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:51:55.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.179+0000 7f5e022bc640 1 Processor -- start 2024-04-25T08:51:55.170 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.179+0000 7f5e022bc640 1 -- start start 2024-04-25T08:51:55.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5e022bc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5dfc15db70 0x7f5dfc0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5e022bc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5dfc15df50 0x7f5dfc0cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5e022bc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc071650 con 0x7f5dfc0cec70 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5e022bc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc0cbd80 con 0x7f5dfc15df50 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5e022bc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc161910 con 0x7f5dfc15db70 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5dfb7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5dfc15df50 0x7f5dfc0cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5dfb7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5dfc15df50 0x7f5dfc0cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50498/0 (socket says 172.21.15.172:50498) 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5dfb7fe640 1 -- 172.21.15.172:0/609764239 learned_addr learned my addr 172.21.15.172:0/609764239 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5dfb7fe640 1 -- 172.21.15.172:0/609764239 >> v2:172.21.15.186:3300/0 conn(0x7f5dfc15db70 msgr2=0x7f5dfc0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5dfb7fe640 1 --2- 172.21.15.172:0/609764239 >> v2:172.21.15.186:3300/0 conn(0x7f5dfc15db70 0x7f5dfc0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5dfb7fe640 1 -- 172.21.15.172:0/609764239 >> v1:172.21.15.186:6789/0 conn(0x7f5dfc0cec70 legacy=0x7f5dfc0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.180+0000 7f5dfb7fe640 1 -- 172.21.15.172:0/609764239 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc0cf230 con 0x7f5dfc15df50 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.181+0000 7f5dfb7fe640 1 --2- 172.21.15.172:0/609764239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15df50 0x7f5dfc0cf510 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0cd3d0 tx=0x7f5df002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462b751285799d6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.181+0000 7f5dfaffd640 1 -- 172.21.15.172:0/609764239 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0037070 con 0x7f5dfc15df50 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.181+0000 7f5dfaffd640 1 -- 172.21.15.172:0/609764239 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df0032440 con 0x7f5dfc15df50 2024-04-25T08:51:55.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.181+0000 7f5dfaffd640 1 -- 172.21.15.172:0/609764239 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0032810 con 0x7f5dfc15df50 2024-04-25T08:51:55.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.182+0000 7f5e022bc640 1 -- 172.21.15.172:0/609764239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15df50 msgr2=0x7f5dfc0cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.182+0000 7f5e022bc640 1 --2- 172.21.15.172:0/609764239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15df50 0x7f5dfc0cf510 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0cd3d0 tx=0x7f5df002a230 comp rx=0 tx=0).stop 2024-04-25T08:51:55.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.182+0000 7f5e022bc640 1 -- 172.21.15.172:0/609764239 shutdown_connections 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.182+0000 7f5e022bc640 1 --2- 172.21.15.172:0/609764239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15df50 0x7f5dfc0cf510 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.182+0000 7f5e022bc640 1 --2- 172.21.15.172:0/609764239 >> v2:172.21.15.186:3300/0 conn(0x7f5dfc15db70 0x7f5dfc0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.182+0000 7f5e022bc640 1 -- 172.21.15.172:0/609764239 >> 172.21.15.172:0/609764239 conn(0x7f5dfc06abe0 msgr2=0x7f5dfc06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.182+0000 7f5e022bc640 1 -- 172.21.15.172:0/609764239 shutdown_connections 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.182+0000 7f5e022bc640 1 -- 172.21.15.172:0/609764239 wait complete. 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.183+0000 7f5e022bc640 1 Processor -- start 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.183+0000 7f5e022bc640 1 -- start start 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5e022bc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dfc0cec70 0x7f5dfc151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5e022bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15db70 0x7f5dfc153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5e022bc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dfc15df50 0x7f5dfc154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5e022bc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc162120 con 0x7f5dfc15db70 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5e022bc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc161e40 con 0x7f5dfc0cec70 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5e022bc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc162640 con 0x7f5dfc15df50 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5dfb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15db70 0x7f5dfc153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5dfb7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15db70 0x7f5dfc153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50502/0 (socket says 172.21.15.172:50502) 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5dfb7fe640 1 -- 172.21.15.172:0/4259248188 learned_addr learned my addr 172.21.15.172:0/4259248188 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5dfb7fe640 1 -- 172.21.15.172:0/4259248188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dfc15df50 msgr2=0x7f5dfc154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5dfb7fe640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dfc15df50 0x7f5dfc154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5dfb7fe640 1 -- 172.21.15.172:0/4259248188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dfc0cec70 msgr2=0x7f5dfc151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5dfb7fe640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dfc0cec70 0x7f5dfc151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5dfb7fe640 1 -- 172.21.15.172:0/4259248188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc15f220 con 0x7f5dfc15db70 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5dfb7fe640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15db70 0x7f5dfc153cf0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000c00 tx=0x7f5df00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5df8ff9640 1 -- 172.21.15.172:0/4259248188 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0041070 con 0x7f5dfc15db70 2024-04-25T08:51:55.178 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5df8ff9640 1 -- 172.21.15.172:0/4259248188 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df003c870 con 0x7f5dfc15db70 2024-04-25T08:51:55.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5e022bc640 1 -- 172.21.15.172:0/4259248188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0ae860 con 0x7f5dfc15db70 2024-04-25T08:51:55.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.184+0000 7f5df8ff9640 1 -- 172.21.15.172:0/4259248188 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0037040 con 0x7f5dfc15db70 2024-04-25T08:51:55.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.185+0000 7f5e022bc640 1 -- 172.21.15.172:0/4259248188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc15f780 con 0x7f5dfc15db70 2024-04-25T08:51:55.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.185+0000 7f5e022bc640 1 -- 172.21.15.172:0/4259248188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc0cdd00 con 0x7f5dfc15db70 2024-04-25T08:51:55.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.186+0000 7f5df8ff9640 1 -- 172.21.15.172:0/4259248188 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5df0044070 con 0x7f5dfc15db70 2024-04-25T08:51:55.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.186+0000 7f5df8ff9640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5de806b4d0 0x7f5de806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.186+0000 7f5df8ff9640 1 -- 172.21.15.172:0/4259248188 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f5df00aab20 con 0x7f5dfc15db70 2024-04-25T08:51:55.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.186+0000 7f5dfbfff640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5de806b4d0 0x7f5de806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.187+0000 7f5dfbfff640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5de806b4d0 0x7f5de806d990 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009710 tx=0x7f5dec006c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:55.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.191+0000 7f5df8ff9640 1 -- 172.21.15.172:0/4259248188 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5dfc0cdd00 con 0x7f5dfc15db70 2024-04-25T08:51:55.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.363+0000 7f5e022bc640 1 -- 172.21.15.172:0/4259248188 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dfc15af00 con 0x7f5dfc15db70 2024-04-25T08:51:55.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.364+0000 7f5df8ff9640 1 -- 172.21.15.172:0/4259248188 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+13234 (secure 0 0 0) 0x7f5dfc15af00 con 0x7f5dfc15db70 2024-04-25T08:51:55.354 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:55.355 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":139,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:51:54.653088+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:51:55.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 -- 172.21.15.172:0/4259248188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5de806b4d0 msgr2=0x7f5de806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5de806b4d0 0x7f5de806d990 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009710 tx=0x7f5dec006c90 comp rx=0 tx=0).stop 2024-04-25T08:51:55.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 -- 172.21.15.172:0/4259248188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15db70 msgr2=0x7f5dfc153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15db70 0x7f5dfc153cf0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f5df0000c00 tx=0x7f5df00046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 -- 172.21.15.172:0/4259248188 shutdown_connections 2024-04-25T08:51:55.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5de806b4d0 0x7f5de806d990 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dfc15df50 0x7f5dfc154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5dfc15db70 0x7f5dfc153cf0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 --2- 172.21.15.172:0/4259248188 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dfc0cec70 0x7f5dfc151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 -- 172.21.15.172:0/4259248188 >> 172.21.15.172:0/4259248188 conn(0x7f5dfc06abe0 msgr2=0x7f5dfc0b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:55.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 -- 172.21.15.172:0/4259248188 shutdown_connections 2024-04-25T08:51:55.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.366+0000 7f5e022bc640 1 -- 172.21.15.172:0/4259248188 wait complete. 2024-04-25T08:51:55.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:51:55.368 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:51:55.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.477+0000 7faac7de0640 1 Processor -- start 2024-04-25T08:51:55.468 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.477+0000 7faac7de0640 1 -- start start 2024-04-25T08:51:55.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.478+0000 7faac7de0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faac00acec0 0x7faac006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.478+0000 7faac7de0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac00ad350 con 0x7faac006abe0 2024-04-25T08:51:55.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.478+0000 7faac7de0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac006db40 con 0x7faac006b500 2024-04-25T08:51:55.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.478+0000 7faac7de0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac006de20 con 0x7faac00acec0 2024-04-25T08:51:55.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.478+0000 7faac537b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faac00acec0 0x7faac006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.478+0000 7faac537b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faac00acec0 0x7faac006afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50510/0 (socket says 172.21.15.172:50510) 2024-04-25T08:51:55.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.478+0000 7faac537b640 1 -- 172.21.15.172:0/2104110051 learned_addr learned my addr 172.21.15.172:0/2104110051 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:55.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.478+0000 7faac5b7c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7faac006abe0 0x7faac00b3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60066/0 (socket says 172.21.15.172:60066) 2024-04-25T08:51:55.469 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.479+0000 7faac537b640 1 -- 172.21.15.172:0/2104110051 >> v1:172.21.15.186:6789/0 conn(0x7faac006b500 legacy=0x7faac006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.479+0000 7faac537b640 1 -- 172.21.15.172:0/2104110051 >> v1:172.21.15.172:6789/0 conn(0x7faac006abe0 legacy=0x7faac00b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.479+0000 7faac4b7a640 1 -- 172.21.15.172:0/2104110051 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500414238 0 0) 0x7faac00ad350 con 0x7faac006abe0 2024-04-25T08:51:55.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.479+0000 7faac537b640 1 -- 172.21.15.172:0/2104110051 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac006e100 con 0x7faac00acec0 2024-04-25T08:51:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.479+0000 7faac537b640 1 --2- 172.21.15.172:0/2104110051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 0x7faac006afc0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7faab0009870 tx=0x7faab002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d23121c3e68e5d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.479+0000 7faac4b7a640 1 -- 172.21.15.172:0/2104110051 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0037070 con 0x7faac00acec0 2024-04-25T08:51:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.479+0000 7faac4b7a640 1 -- 172.21.15.172:0/2104110051 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0032440 con 0x7faac00acec0 2024-04-25T08:51:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.480+0000 7faac4b7a640 1 -- 172.21.15.172:0/2104110051 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0032810 con 0x7faac00acec0 2024-04-25T08:51:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.480+0000 7faac7de0640 1 -- 172.21.15.172:0/2104110051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 msgr2=0x7faac006afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.480+0000 7faac7de0640 1 --2- 172.21.15.172:0/2104110051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 0x7faac006afc0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7faab0009870 tx=0x7faab002a270 comp rx=0 tx=0).stop 2024-04-25T08:51:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.480+0000 7faac7de0640 1 -- 172.21.15.172:0/2104110051 shutdown_connections 2024-04-25T08:51:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.480+0000 7faac7de0640 1 --2- 172.21.15.172:0/2104110051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 0x7faac006afc0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.480+0000 7faac7de0640 1 -- 172.21.15.172:0/2104110051 >> 172.21.15.172:0/2104110051 conn(0x7faac00cfec0 msgr2=0x7faac00d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:55.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.480+0000 7faac7de0640 1 -- 172.21.15.172:0/2104110051 shutdown_connections 2024-04-25T08:51:55.472 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.480+0000 7faac7de0640 1 -- 172.21.15.172:0/2104110051 wait complete. 2024-04-25T08:51:55.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.481+0000 7faac7de0640 1 Processor -- start 2024-04-25T08:51:55.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.481+0000 7faac7de0640 1 -- start start 2024-04-25T08:51:55.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac7de0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faac006abe0 0x7faac0152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac7de0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faac006b500 0x7faac01f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac7de0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 0x7faac015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac7de0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00b4030 con 0x7faac00acec0 2024-04-25T08:51:55.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac7de0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac00b30d0 con 0x7faac006b500 2024-04-25T08:51:55.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac7de0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac006b910 con 0x7faac006abe0 2024-04-25T08:51:55.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac637d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 0x7faac015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac637d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 0x7faac015c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50514/0 (socket says 172.21.15.172:50514) 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac637d640 1 -- 172.21.15.172:0/3619761860 learned_addr learned my addr 172.21.15.172:0/3619761860 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac537b640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faac006b500 0x7faac01f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac5b7c640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faac006abe0 0x7faac0152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac637d640 1 -- 172.21.15.172:0/3619761860 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faac006abe0 msgr2=0x7faac0152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac637d640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faac006abe0 0x7faac0152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac637d640 1 -- 172.21.15.172:0/3619761860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faac006b500 msgr2=0x7faac01f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac637d640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faac006b500 0x7faac01f4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.482+0000 7faac637d640 1 -- 172.21.15.172:0/3619761860 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac015f680 con 0x7faac00acec0 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.483+0000 7faac637d640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 0x7faac015c010 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7faab800c390 tx=0x7faab800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.483+0000 7faab67fc640 1 -- 172.21.15.172:0/3619761860 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8017070 con 0x7faac00acec0 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.483+0000 7faab67fc640 1 -- 172.21.15.172:0/3619761860 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab80052d0 con 0x7faac00acec0 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.483+0000 7faac7de0640 1 -- 172.21.15.172:0/3619761860 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac015f960 con 0x7faac00acec0 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.483+0000 7faab67fc640 1 -- 172.21.15.172:0/3619761860 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8003810 con 0x7faac00acec0 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.483+0000 7faac7de0640 1 -- 172.21.15.172:0/3619761860 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac015ff20 con 0x7faac00acec0 2024-04-25T08:51:55.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.484+0000 7faac7de0640 1 -- 172.21.15.172:0/3619761860 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac0073a00 con 0x7faac00acec0 2024-04-25T08:51:55.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.484+0000 7faab67fc640 1 -- 172.21.15.172:0/3619761860 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faab801a070 con 0x7faac00acec0 2024-04-25T08:51:55.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.485+0000 7faab67fc640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faaa406b4d0 0x7faaa406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.485+0000 7faac5b7c640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faaa406b4d0 0x7faaa406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.485+0000 7faab67fc640 1 -- 172.21.15.172:0/3619761860 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5249+0+0 (secure 0 0 0) 0x7faab8089240 con 0x7faac00acec0 2024-04-25T08:51:55.476 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.485+0000 7faac5b7c640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faaa406b4d0 0x7faaa406d990 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7faabc0012e0 tx=0x7faabc004d40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:55.479 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.489+0000 7faab67fc640 1 -- 172.21.15.172:0/3619761860 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faab8057cc0 con 0x7faac00acec0 2024-04-25T08:51:55.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.661+0000 7faac7de0640 1 -- 172.21.15.172:0/3619761860 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faac00ae620 con 0x7faac00acec0 2024-04-25T08:51:55.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.662+0000 7faab67fc640 1 -- 172.21.15.172:0/3619761860 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v139) v1 ==== 93+0+10 (secure 0 0 0) 0x7faab805bd60 con 0x7faac00acec0 2024-04-25T08:51:55.652 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 -- 172.21.15.172:0/3619761860 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faaa406b4d0 msgr2=0x7faaa406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faaa406b4d0 0x7faaa406d990 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7faabc0012e0 tx=0x7faabc004d40 comp rx=0 tx=0).stop 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 -- 172.21.15.172:0/3619761860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 msgr2=0x7faac015c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 0x7faac015c010 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7faab800c390 tx=0x7faab800c850 comp rx=0 tx=0).stop 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 -- 172.21.15.172:0/3619761860 shutdown_connections 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7faaa406b4d0 0x7faaa406d990 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faac006b500 0x7faac01f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faac00acec0 0x7faac015c010 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 --2- 172.21.15.172:0/3619761860 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faac006abe0 0x7faac0152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 -- 172.21.15.172:0/3619761860 >> 172.21.15.172:0/3619761860 conn(0x7faac00cfec0 msgr2=0x7faac0157af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 -- 172.21.15.172:0/3619761860 shutdown_connections 2024-04-25T08:51:55.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.664+0000 7faac7de0640 1 -- 172.21.15.172:0/3619761860 wait complete. 2024-04-25T08:51:55.666 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T08:51:55.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.773+0000 7ff9d35c4640 1 Processor -- start 2024-04-25T08:51:55.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.773+0000 7ff9d35c4640 1 -- start start 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d35c4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9cc155fe0 0x7ff9cc15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d35c4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9cc0adbc0 0x7ff9cc071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d35c4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff9cc072000 0x7ff9cc06abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d35c4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc072470 con 0x7ff9cc0adbc0 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d35c4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc06de40 con 0x7ff9cc072000 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d35c4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0ad0e0 con 0x7ff9cc155fe0 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d0b5f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9cc0adbc0 0x7ff9cc071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d0b5f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9cc0adbc0 0x7ff9cc071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50526/0 (socket says 172.21.15.172:50526) 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d0b5f640 1 -- 172.21.15.172:0/3098901454 learned_addr learned my addr 172.21.15.172:0/3098901454 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d1b61640 1 --2- 172.21.15.172:0/3098901454 >> v2:172.21.15.186:3300/0 conn(0x7ff9cc072000 0x7ff9cc06abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d1360640 1 --2- 172.21.15.172:0/3098901454 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9cc155fe0 0x7ff9cc15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d0b5f640 1 -- 172.21.15.172:0/3098901454 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9cc155fe0 msgr2=0x7ff9cc15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:55.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d0b5f640 1 --2- 172.21.15.172:0/3098901454 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9cc155fe0 0x7ff9cc15c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d0b5f640 1 -- 172.21.15.172:0/3098901454 >> v2:172.21.15.186:3300/0 conn(0x7ff9cc072000 msgr2=0x7ff9cc06abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:55.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d0b5f640 1 --2- 172.21.15.172:0/3098901454 >> v2:172.21.15.186:3300/0 conn(0x7ff9cc072000 0x7ff9cc06abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d0b5f640 1 -- 172.21.15.172:0/3098901454 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0ad3c0 con 0x7ff9cc0adbc0 2024-04-25T08:51:55.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.774+0000 7ff9d1b61640 1 --2- 172.21.15.172:0/3098901454 >> v2:172.21.15.186:3300/0 conn(0x7ff9cc072000 0x7ff9cc06abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:55.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.775+0000 7ff9d0b5f640 1 --2- 172.21.15.172:0/3098901454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc0adbc0 0x7ff9cc071ac0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc09df40 tx=0x7ff9bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfaf5e9e2642ec5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:55.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.775+0000 7ff9c3fff640 1 -- 172.21.15.172:0/3098901454 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc037070 con 0x7ff9cc0adbc0 2024-04-25T08:51:55.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.775+0000 7ff9c3fff640 1 -- 172.21.15.172:0/3098901454 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc032440 con 0x7ff9cc0adbc0 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.775+0000 7ff9c3fff640 1 -- 172.21.15.172:0/3098901454 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc032810 con 0x7ff9cc0adbc0 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.776+0000 7ff9d35c4640 1 -- 172.21.15.172:0/3098901454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc0adbc0 msgr2=0x7ff9cc071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.776+0000 7ff9d35c4640 1 --2- 172.21.15.172:0/3098901454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc0adbc0 0x7ff9cc071ac0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc09df40 tx=0x7ff9bc02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.776+0000 7ff9d35c4640 1 -- 172.21.15.172:0/3098901454 shutdown_connections 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.776+0000 7ff9d35c4640 1 --2- 172.21.15.172:0/3098901454 >> v2:172.21.15.186:3300/0 conn(0x7ff9cc072000 0x7ff9cc06abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.776+0000 7ff9d35c4640 1 --2- 172.21.15.172:0/3098901454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc0adbc0 0x7ff9cc071ac0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.776+0000 7ff9d35c4640 1 --2- 172.21.15.172:0/3098901454 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9cc155fe0 0x7ff9cc15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.776+0000 7ff9d35c4640 1 -- 172.21.15.172:0/3098901454 >> 172.21.15.172:0/3098901454 conn(0x7ff9cc0af670 msgr2=0x7ff9cc0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.776+0000 7ff9d35c4640 1 -- 172.21.15.172:0/3098901454 shutdown_connections 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.776+0000 7ff9d35c4640 1 -- 172.21.15.172:0/3098901454 wait complete. 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.777+0000 7ff9d35c4640 1 Processor -- start 2024-04-25T08:51:55.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.777+0000 7ff9d35c4640 1 -- start start 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d35c4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9cc0adbc0 0x7ff9cc14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d35c4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9cc155fe0 0x7ff9cc14ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d35c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc1431f0 0x7ff9cc1436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d35c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc06f880 con 0x7ff9cc1431f0 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d35c4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1563c0 con 0x7ff9cc155fe0 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d35c4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc06fa00 con 0x7ff9cc0adbc0 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d1b61640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc1431f0 0x7ff9cc1436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d1b61640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc1431f0 0x7ff9cc1436a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50536/0 (socket says 172.21.15.172:50536) 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d1b61640 1 -- 172.21.15.172:0/2290710097 learned_addr learned my addr 172.21.15.172:0/2290710097 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d1360640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9cc0adbc0 0x7ff9cc14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d0b5f640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9cc155fe0 0x7ff9cc14ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d1b61640 1 -- 172.21.15.172:0/2290710097 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9cc0adbc0 msgr2=0x7ff9cc14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d1b61640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9cc0adbc0 0x7ff9cc14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d1b61640 1 -- 172.21.15.172:0/2290710097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9cc155fe0 msgr2=0x7ff9cc14ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d1b61640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9cc155fe0 0x7ff9cc14ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d1b61640 1 -- 172.21.15.172:0/2290710097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc09d740 con 0x7ff9cc1431f0 2024-04-25T08:51:55.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d1b61640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc1431f0 0x7ff9cc1436a0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400cd10 tx=0x7ff9c400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:55.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9c1ffb640 1 -- 172.21.15.172:0/2290710097 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400f680 con 0x7ff9cc1431f0 2024-04-25T08:51:55.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9c1ffb640 1 -- 172.21.15.172:0/2290710097 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c400f840 con 0x7ff9cc1431f0 2024-04-25T08:51:55.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9d35c4640 1 -- 172.21.15.172:0/2290710097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc144860 con 0x7ff9cc1431f0 2024-04-25T08:51:55.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.778+0000 7ff9c1ffb640 1 -- 172.21.15.172:0/2290710097 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400fc30 con 0x7ff9cc1431f0 2024-04-25T08:51:55.772 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.779+0000 7ff9d35c4640 1 -- 172.21.15.172:0/2290710097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc144e20 con 0x7ff9cc1431f0 2024-04-25T08:51:55.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.780+0000 7ff9d35c4640 1 -- 172.21.15.172:0/2290710097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc073990 con 0x7ff9cc1431f0 2024-04-25T08:51:55.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.780+0000 7ff9c1ffb640 1 -- 172.21.15.172:0/2290710097 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9c40213f0 con 0x7ff9cc1431f0 2024-04-25T08:51:55.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.780+0000 7ff9c1ffb640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 0x7ff9b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:55.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.780+0000 7ff9c1ffb640 1 -- 172.21.15.172:0/2290710097 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ff9c408acd0 con 0x7ff9cc1431f0 2024-04-25T08:51:55.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.780+0000 7ff9d1360640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 0x7ff9b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:55.773 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.781+0000 7ff9d1360640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 0x7ff9b006d990 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800a970 tx=0x7ff9c8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:55.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.785+0000 7ff9c1ffb640 1 -- 172.21.15.172:0/2290710097 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9c4014030 con 0x7ff9cc1431f0 2024-04-25T08:51:55.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.957+0000 7ff9d35c4640 1 -- 172.21.15.172:0/2290710097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff9cc151fe0 con 0x7ff9cc1431f0 2024-04-25T08:51:55.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.958+0000 7ff9c1ffb640 1 -- 172.21.15.172:0/2290710097 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v139) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff9c4059d10 con 0x7ff9cc1431f0 2024-04-25T08:51:55.948 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:55.948 INFO:teuthology.orchestra.run.smithi172.stdout:[ 2024-04-25T08:51:55.948 INFO:teuthology.orchestra.run.smithi172.stdout: { 2024-04-25T08:51:55.948 INFO:teuthology.orchestra.run.smithi172.stdout: "poolnum": 1, 2024-04-25T08:51:55.948 INFO:teuthology.orchestra.run.smithi172.stdout: "poolname": ".mgr" 2024-04-25T08:51:55.948 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-04-25T08:51:55.949 INFO:teuthology.orchestra.run.smithi172.stdout:] 2024-04-25T08:51:55.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 -- 172.21.15.172:0/2290710097 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 msgr2=0x7ff9b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 0x7ff9b006d990 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800a970 tx=0x7ff9c8008040 comp rx=0 tx=0).stop 2024-04-25T08:51:55.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 -- 172.21.15.172:0/2290710097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc1431f0 msgr2=0x7ff9cc1436a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:55.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc1431f0 0x7ff9cc1436a0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400cd10 tx=0x7ff9c400a650 comp rx=0 tx=0).stop 2024-04-25T08:51:55.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 -- 172.21.15.172:0/2290710097 shutdown_connections 2024-04-25T08:51:55.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ff9b006b4d0 0x7ff9b006d990 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9cc155fe0 0x7ff9cc14ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9cc1431f0 0x7ff9cc1436a0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 --2- 172.21.15.172:0/2290710097 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff9cc0adbc0 0x7ff9cc14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:55.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 -- 172.21.15.172:0/2290710097 >> 172.21.15.172:0/2290710097 conn(0x7ff9cc072000 msgr2=0x7ff9cc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:55.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 -- 172.21.15.172:0/2290710097 shutdown_connections 2024-04-25T08:51:55.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:55.960+0000 7ff9d35c4640 1 -- 172.21.15.172:0/2290710097 wait complete. 2024-04-25T08:51:55.961 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T08:51:55.961 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T08:51:56.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.072+0000 7fe7a76e4640 1 Processor -- start 2024-04-25T08:51:56.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.073+0000 7fe7a76e4640 1 -- start start 2024-04-25T08:51:56.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.073+0000 7fe7a76e4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe7a015dc20 0x7fe7a00ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.073+0000 7fe7a76e4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7a0161710 0x7fe7a00cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.073+0000 7fe7a76e4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a015e000 con 0x7fe7a00b9330 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.073+0000 7fe7a76e4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a00d1de0 con 0x7fe7a0161710 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.073+0000 7fe7a76e4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a0161c60 con 0x7fe7a015dc20 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.074+0000 7fe7a4c7f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7a0161710 0x7fe7a00cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.074+0000 7fe7a4c7f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7a0161710 0x7fe7a00cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50552/0 (socket says 172.21.15.172:50552) 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.074+0000 7fe7a4c7f640 1 -- 172.21.15.172:0/1188846884 learned_addr learned my addr 172.21.15.172:0/1188846884 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.074+0000 7fe7a5480640 1 --2- 172.21.15.172:0/1188846884 >> v2:172.21.15.186:3300/0 conn(0x7fe7a015dc20 0x7fe7a00ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.074+0000 7fe7a4c7f640 1 -- 172.21.15.172:0/1188846884 >> v2:172.21.15.186:3300/0 conn(0x7fe7a015dc20 msgr2=0x7fe7a00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.074+0000 7fe7a4c7f640 1 --2- 172.21.15.172:0/1188846884 >> v2:172.21.15.186:3300/0 conn(0x7fe7a015dc20 0x7fe7a00ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.074+0000 7fe7a4c7f640 1 -- 172.21.15.172:0/1188846884 >> v1:172.21.15.186:6789/0 conn(0x7fe7a00b9330 legacy=0x7fe7a006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.074+0000 7fe7a4c7f640 1 -- 172.21.15.172:0/1188846884 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0161f40 con 0x7fe7a0161710 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.074+0000 7fe7a4c7f640 1 --2- 172.21.15.172:0/1188846884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a0161710 0x7fe7a00cebb0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00d1520 tx=0x7fe79402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18abb57aff80c183 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe793fff640 1 -- 172.21.15.172:0/1188846884 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794037070 con 0x7fe7a0161710 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe793fff640 1 -- 172.21.15.172:0/1188846884 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794032440 con 0x7fe7a0161710 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe793fff640 1 -- 172.21.15.172:0/1188846884 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794032810 con 0x7fe7a0161710 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe7a76e4640 1 -- 172.21.15.172:0/1188846884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a0161710 msgr2=0x7fe7a00cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe7a76e4640 1 --2- 172.21.15.172:0/1188846884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a0161710 0x7fe7a00cebb0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00d1520 tx=0x7fe79402a230 comp rx=0 tx=0).stop 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe7a76e4640 1 -- 172.21.15.172:0/1188846884 shutdown_connections 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe7a76e4640 1 --2- 172.21.15.172:0/1188846884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a0161710 0x7fe7a00cebb0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe7a76e4640 1 --2- 172.21.15.172:0/1188846884 >> v2:172.21.15.186:3300/0 conn(0x7fe7a015dc20 0x7fe7a00ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe7a76e4640 1 -- 172.21.15.172:0/1188846884 >> 172.21.15.172:0/1188846884 conn(0x7fe7a00d0420 msgr2=0x7fe7a00d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe7a76e4640 1 -- 172.21.15.172:0/1188846884 shutdown_connections 2024-04-25T08:51:56.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.075+0000 7fe7a76e4640 1 -- 172.21.15.172:0/1188846884 wait complete. 2024-04-25T08:51:56.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.076+0000 7fe7a76e4640 1 Processor -- start 2024-04-25T08:51:56.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a76e4640 1 -- start start 2024-04-25T08:51:56.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a76e4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a00b9330 0x7fe7a00aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a76e4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7a015dc20 0x7fe7a00c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a76e4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7a0161710 0x7fe7a01f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a76e4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00b5e50 con 0x7fe7a00b9330 2024-04-25T08:51:56.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a76e4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0162500 con 0x7fe7a015dc20 2024-04-25T08:51:56.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a76e4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00b5fd0 con 0x7fe7a0161710 2024-04-25T08:51:56.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a5480640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a00b9330 0x7fe7a00aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a5480640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a00b9330 0x7fe7a00aa380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50556/0 (socket says 172.21.15.172:50556) 2024-04-25T08:51:56.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a5480640 1 -- 172.21.15.172:0/2774010629 learned_addr learned my addr 172.21.15.172:0/2774010629 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:56.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a4c7f640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7a015dc20 0x7fe7a00c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.077+0000 7fe7a5c81640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7a0161710 0x7fe7a01f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe7a5480640 1 -- 172.21.15.172:0/2774010629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7a0161710 msgr2=0x7fe7a01f7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:56.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe7a5480640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7a0161710 0x7fe7a01f7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe7a5480640 1 -- 172.21.15.172:0/2774010629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7a015dc20 msgr2=0x7fe7a00c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:56.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe7a5480640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7a015dc20 0x7fe7a00c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe7a5480640 1 -- 172.21.15.172:0/2774010629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00ca2f0 con 0x7fe7a00b9330 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe7a5c81640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7a0161710 0x7fe7a01f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe7a5480640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a00b9330 0x7fe7a00aa380 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00d5f0 tx=0x7fe79c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe791ffb640 1 -- 172.21.15.172:0/2774010629 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0125f0 con 0x7fe7a00b9330 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe791ffb640 1 -- 172.21.15.172:0/2774010629 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c019070 con 0x7fe7a00b9330 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe791ffb640 1 -- 172.21.15.172:0/2774010629 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0129d0 con 0x7fe7a00b9330 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe7a76e4640 1 -- 172.21.15.172:0/2774010629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a00cdf20 con 0x7fe7a00b9330 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.078+0000 7fe7a76e4640 1 -- 172.21.15.172:0/2774010629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a01e94a0 con 0x7fe7a00b9330 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.079+0000 7fe7a76e4640 1 -- 172.21.15.172:0/2774010629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a0073a00 con 0x7fe7a00b9330 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.079+0000 7fe791ffb640 1 -- 172.21.15.172:0/2774010629 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe79c012b70 con 0x7fe7a00b9330 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.080+0000 7fe791ffb640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe78406b4d0 0x7fe78406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.080+0000 7fe791ffb640 1 -- 172.21.15.172:0/2774010629 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe79c08a3c0 con 0x7fe7a00b9330 2024-04-25T08:51:56.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.080+0000 7fe7a4c7f640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe78406b4d0 0x7fe78406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.080+0000 7fe7a4c7f640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe78406b4d0 0x7fe78406d990 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe794034000 tx=0x7fe79402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:56.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.084+0000 7fe791ffb640 1 -- 172.21.15.172:0/2774010629 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe79c059490 con 0x7fe7a00b9330 2024-04-25T08:51:56.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.256+0000 7fe7a76e4640 1 -- 172.21.15.172:0/2774010629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe7a00b8cf0 con 0x7fe7a00b9330 2024-04-25T08:51:56.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.659+0000 7fe791ffb640 1 -- 172.21.15.172:0/2774010629 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v140) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe79c058d90 con 0x7fe7a00b9330 2024-04-25T08:51:56.649 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' created 2024-04-25T08:51:56.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 -- 172.21.15.172:0/2774010629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe78406b4d0 msgr2=0x7fe78406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:56.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe78406b4d0 0x7fe78406d990 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe794034000 tx=0x7fe79402e000 comp rx=0 tx=0).stop 2024-04-25T08:51:56.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 -- 172.21.15.172:0/2774010629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a00b9330 msgr2=0x7fe7a00aa380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:56.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a00b9330 0x7fe7a00aa380 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00d5f0 tx=0x7fe79c00dab0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 -- 172.21.15.172:0/2774010629 shutdown_connections 2024-04-25T08:51:56.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe78406b4d0 0x7fe78406d990 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7a015dc20 0x7fe7a00c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7a0161710 0x7fe7a01f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 --2- 172.21.15.172:0/2774010629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7a00b9330 0x7fe7a00aa380 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 -- 172.21.15.172:0/2774010629 >> 172.21.15.172:0/2774010629 conn(0x7fe7a00d0420 msgr2=0x7fe7a01601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:56.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 -- 172.21.15.172:0/2774010629 shutdown_connections 2024-04-25T08:51:56.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.661+0000 7fe7a76e4640 1 -- 172.21.15.172:0/2774010629 wait complete. 2024-04-25T08:51:56.665 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T08:51:56.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.780+0000 7f3e9a8f5640 1 Processor -- start 2024-04-25T08:51:56.771 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.780+0000 7f3e9a8f5640 1 -- start start 2024-04-25T08:51:56.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e9a8f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e9415b980 0x7f3e940cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e9a8f5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e94072280 con 0x7f3e940ce230 2024-04-25T08:51:56.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e9a8f5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e940714c0 con 0x7f3e940cc4f0 2024-04-25T08:51:56.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e9a8f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9415bdc0 con 0x7f3e9415b980 2024-04-25T08:51:56.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e937fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3e940ce230 0x7f3e9415b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:60082/0 (socket says 172.21.15.172:60082) 2024-04-25T08:51:56.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e937fe640 1 -- 172.21.15.172:0/1186252824 learned_addr learned my addr 172.21.15.172:0/1186252824 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:56.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e98e92640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e9415b980 0x7f3e940cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049162225 0 0) 0x7f3e94072280 con 0x7f3e940ce230 2024-04-25T08:51:56.774 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e7c003520 con 0x7f3e940ce230 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3994894548 0 0) 0x7f3e7c003520 con 0x7f3e940ce230 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e9415b980 msgr2=0x7f3e940cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e92ffd640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e9415b980 0x7f3e940cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 >> v1:172.21.15.186:6789/0 conn(0x7f3e940cc4f0 legacy=0x7f3e940cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e940717a0 con 0x7f3e940ce230 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.781+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f3e88001670 con 0x7f3e940ce230 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 >> v1:172.21.15.172:6789/0 conn(0x7f3e940ce230 legacy=0x7f3e9415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e92ffd640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 0x7f3e7c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e92ffd640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e7c004800 0x7f3e7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e92ffd640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e9415b980 0x7f3e7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9415bdc0 con 0x7f3e7c0039e0 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c00ba70 con 0x7f3e7c004800 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c00bc70 con 0x7f3e9415b980 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e93fff640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 0x7f3e7c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.775 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e937fe640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e7c004800 0x7f3e7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e98e92640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e9415b980 0x7f3e7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e93fff640 1 -- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e9415b980 msgr2=0x7f3e7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e93fff640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e9415b980 0x7f3e7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e93fff640 1 -- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e7c004800 msgr2=0x7f3e7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e93fff640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e7c004800 0x7f3e7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.782+0000 7f3e93fff640 1 -- 172.21.15.172:0/1186252824 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c003520 con 0x7f3e7c0039e0 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e93fff640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 0x7f3e7c003e00 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f3e84001720 tx=0x7f3e7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3fd3c55dd209b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84001370 con 0x7f3e7c0039e0 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e840052d0 con 0x7f3e7c0039e0 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e92ffd640 1 -- 172.21.15.172:0/1186252824 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8402ab90 con 0x7f3e7c0039e0 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/1186252824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 msgr2=0x7f3e7c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e9a8f5640 1 --2- 172.21.15.172:0/1186252824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 0x7f3e7c003e00 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f3e84001720 tx=0x7f3e7c005830 comp rx=0 tx=0).stop 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e98e92640 1 -- 172.21.15.172:0/1186252824 reap_dead start 2024-04-25T08:51:56.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/1186252824 shutdown_connections 2024-04-25T08:51:56.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/1186252824 >> 172.21.15.172:0/1186252824 conn(0x7f3e9406abe0 msgr2=0x7f3e9406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:56.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/1186252824 shutdown_connections 2024-04-25T08:51:56.777 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.783+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/1186252824 wait complete. 2024-04-25T08:51:56.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.785+0000 7f3e9a8f5640 1 Processor -- start 2024-04-25T08:51:56.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.785+0000 7f3e9a8f5640 1 -- start start 2024-04-25T08:51:56.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.785+0000 7f3e9a8f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 0x7f3e941445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.785+0000 7f3e9a8f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e94156ae0 0x7f3e94145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.785+0000 7f3e9a8f5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e94158ad0 0x7f3e94158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.785+0000 7f3e9a8f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94071d60 con 0x7f3e7c0039e0 2024-04-25T08:51:56.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.785+0000 7f3e9a8f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94071270 con 0x7f3e94156ae0 2024-04-25T08:51:56.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.785+0000 7f3e9a8f5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9406e8a0 con 0x7f3e94158ad0 2024-04-25T08:51:56.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e93fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 0x7f3e941445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.780 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e93fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 0x7f3e941445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50574/0 (socket says 172.21.15.172:50574) 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e93fff640 1 -- 172.21.15.172:0/2134707825 learned_addr learned my addr 172.21.15.172:0/2134707825 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e937fe640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e94156ae0 0x7f3e94145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e98e92640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e94158ad0 0x7f3e94158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e93fff640 1 -- 172.21.15.172:0/2134707825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e94158ad0 msgr2=0x7f3e94158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e93fff640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e94158ad0 0x7f3e94158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e93fff640 1 -- 172.21.15.172:0/2134707825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e94156ae0 msgr2=0x7f3e94145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e93fff640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e94156ae0 0x7f3e94145330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e93fff640 1 -- 172.21.15.172:0/2134707825 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e94145ca0 con 0x7f3e7c0039e0 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e93fff640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 0x7f3e941445b0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f3e84008fd0 tx=0x7f3e84001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e90ff9640 1 -- 172.21.15.172:0/2134707825 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84040020 con 0x7f3e7c0039e0 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e90ff9640 1 -- 172.21.15.172:0/2134707825 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8402be40 con 0x7f3e7c0039e0 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/2134707825 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e94145f80 con 0x7f3e7c0039e0 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e90ff9640 1 -- 172.21.15.172:0/2134707825 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84001370 con 0x7f3e7c0039e0 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.786+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/2134707825 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e94146540 con 0x7f3e7c0039e0 2024-04-25T08:51:56.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.787+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/2134707825 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e94159490 con 0x7f3e7c0039e0 2024-04-25T08:51:56.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.788+0000 7f3e90ff9640 1 -- 172.21.15.172:0/2134707825 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e84043020 con 0x7f3e7c0039e0 2024-04-25T08:51:56.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.788+0000 7f3e90ff9640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e8006b4d0 0x7f3e8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:56.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.788+0000 7f3e90ff9640 1 -- 172.21.15.172:0/2134707825 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f3e840aa070 con 0x7f3e7c0039e0 2024-04-25T08:51:56.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.788+0000 7f3e937fe640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e8006b4d0 0x7f3e8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:56.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.789+0000 7f3e937fe640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e8006b4d0 0x7f3e8006d990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3e94168790 tx=0x7f3e88000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:56.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.793+0000 7f3e90ff9640 1 -- 172.21.15.172:0/2134707825 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e8404a030 con 0x7f3e7c0039e0 2024-04-25T08:51:56.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:56.964+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/2134707825 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3e94073a00 con 0x7f3e7c0039e0 2024-04-25T08:51:57.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.661+0000 7f3e90ff9640 1 -- 172.21.15.172:0/2134707825 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v141) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3e84078850 con 0x7f3e7c0039e0 2024-04-25T08:51:57.652 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' created 2024-04-25T08:51:57.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/2134707825 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e8006b4d0 msgr2=0x7f3e8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e8006b4d0 0x7f3e8006d990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3e94168790 tx=0x7f3e88000ed0 comp rx=0 tx=0).stop 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/2134707825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 msgr2=0x7f3e941445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 0x7f3e941445b0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f3e84008fd0 tx=0x7f3e84001120 comp rx=0 tx=0).stop 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/2134707825 shutdown_connections 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3e8006b4d0 0x7f3e8006d990 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3e94156ae0 0x7f3e94145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3e94158ad0 0x7f3e94158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 --2- 172.21.15.172:0/2134707825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e7c0039e0 0x7f3e941445b0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/2134707825 >> 172.21.15.172:0/2134707825 conn(0x7f3e9406abe0 msgr2=0x7f3e9406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/2134707825 shutdown_connections 2024-04-25T08:51:57.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.664+0000 7f3e9a8f5640 1 -- 172.21.15.172:0/2134707825 wait complete. 2024-04-25T08:51:57.675 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T08:51:57.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.785+0000 7f3bb144d640 1 Processor -- start 2024-04-25T08:51:57.776 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.785+0000 7f3bb144d640 1 -- start start 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.786+0000 7f3bb144d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac15bb50 0x7f3bac0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.786+0000 7f3bb144d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3bac0c70d0 0x7f3bac0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.786+0000 7f3bb144d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0c75e0 con 0x7f3bac0cfb40 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.786+0000 7f3bb144d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac0c8680 con 0x7f3bac0c70d0 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.786+0000 7f3bb144d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0c78c0 con 0x7f3bac15bb50 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.786+0000 7f3baaffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac15bb50 0x7f3bac0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.786+0000 7f3baa7fc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3bac0c70d0 0x7f3bac0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.786+0000 7f3bab7fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f3bac0cfb40 0x7f3bac070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41444/0 (socket says 172.21.15.172:41444) 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.786+0000 7f3bab7fe640 1 -- 172.21.15.172:0/124759186 learned_addr learned my addr 172.21.15.172:0/124759186 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.787+0000 7f3baa7fc640 1 -- 172.21.15.172:0/124759186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac15bb50 msgr2=0x7f3bac0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:57.778 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.787+0000 7f3baa7fc640 1 --2- 172.21.15.172:0/124759186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac15bb50 0x7f3bac0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:57.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.787+0000 7f3baa7fc640 1 -- 172.21.15.172:0/124759186 >> v1:172.21.15.186:6789/0 conn(0x7f3bac0cfb40 legacy=0x7f3bac070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:57.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.787+0000 7f3baa7fc640 1 -- 172.21.15.172:0/124759186 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0c7ba0 con 0x7f3bac0c70d0 2024-04-25T08:51:57.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.787+0000 7f3ba9ffb640 1 -- 172.21.15.172:0/124759186 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579443829 0 0) 0x7f3bac0c75e0 con 0x7f3bac0cfb40 2024-04-25T08:51:57.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.787+0000 7f3baaffd640 1 --2- 172.21.15.172:0/124759186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac15bb50 0x7f3bac0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:57.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.787+0000 7f3baa7fc640 1 --2- 172.21.15.172:0/124759186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bac0c70d0 0x7f3bac0cf600 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00097a0 tx=0x7f3ba002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=265cdb1b1af6d174 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:57.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3ba9ffb640 1 -- 172.21.15.172:0/124759186 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0037070 con 0x7f3bac0c70d0 2024-04-25T08:51:57.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3ba9ffb640 1 -- 172.21.15.172:0/124759186 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba0032440 con 0x7f3bac0c70d0 2024-04-25T08:51:57.779 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3ba9ffb640 1 -- 172.21.15.172:0/124759186 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0032810 con 0x7f3bac0c70d0 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3bb144d640 1 -- 172.21.15.172:0/124759186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bac0c70d0 msgr2=0x7f3bac0cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3bb144d640 1 --2- 172.21.15.172:0/124759186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bac0c70d0 0x7f3bac0cf600 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00097a0 tx=0x7f3ba002a210 comp rx=0 tx=0).stop 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3bb144d640 1 -- 172.21.15.172:0/124759186 shutdown_connections 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3bb144d640 1 --2- 172.21.15.172:0/124759186 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bac0c70d0 0x7f3bac0cf600 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3bb144d640 1 --2- 172.21.15.172:0/124759186 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac15bb50 0x7f3bac0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3bb144d640 1 -- 172.21.15.172:0/124759186 >> 172.21.15.172:0/124759186 conn(0x7f3bac06f500 msgr2=0x7f3bac06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3bb144d640 1 -- 172.21.15.172:0/124759186 shutdown_connections 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.788+0000 7f3bb144d640 1 -- 172.21.15.172:0/124759186 wait complete. 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.789+0000 7f3bb144d640 1 Processor -- start 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3bb144d640 1 -- start start 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3bb144d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac0c70d0 0x7f3bac0b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3bb144d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bac0cfb40 0x7f3bac0afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:57.782 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3bb144d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bac15bb50 0x7f3bac0b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:57.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3bb144d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac15f6d0 con 0x7f3bac15bb50 2024-04-25T08:51:57.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3bb144d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0c8160 con 0x7f3bac0cfb40 2024-04-25T08:51:57.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3bb144d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac15f850 con 0x7f3bac0c70d0 2024-04-25T08:51:57.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3bab7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bac15bb50 0x7f3bac0b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:57.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3bab7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bac15bb50 0x7f3bac0b5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36942/0 (socket says 172.21.15.172:36942) 2024-04-25T08:51:57.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3bab7fe640 1 -- 172.21.15.172:0/3007954898 learned_addr learned my addr 172.21.15.172:0/3007954898 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:57.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3baa7fc640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bac0cfb40 0x7f3bac0afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:57.783 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.790+0000 7f3baaffd640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac0c70d0 0x7f3bac0b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3baa7fc640 1 -- 172.21.15.172:0/3007954898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac0c70d0 msgr2=0x7f3bac0b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3baa7fc640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac0c70d0 0x7f3bac0b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3baa7fc640 1 -- 172.21.15.172:0/3007954898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bac15bb50 msgr2=0x7f3bac0b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3baa7fc640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bac15bb50 0x7f3bac0b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3baa7fc640 1 -- 172.21.15.172:0/3007954898 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac1f3eb0 con 0x7f3bac0cfb40 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3baa7fc640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bac0cfb40 0x7f3bac0afdd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3bac06ee50 tx=0x7f3ba00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3b937fe640 1 -- 172.21.15.172:0/3007954898 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0037040 con 0x7f3bac0cfb40 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3b937fe640 1 -- 172.21.15.172:0/3007954898 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba0004230 con 0x7f3bac0cfb40 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3b937fe640 1 -- 172.21.15.172:0/3007954898 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0003610 con 0x7f3bac0cfb40 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3bb144d640 1 -- 172.21.15.172:0/3007954898 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac1f4190 con 0x7f3bac0cfb40 2024-04-25T08:51:57.784 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.791+0000 7f3bb144d640 1 -- 172.21.15.172:0/3007954898 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac1f4750 con 0x7f3bac0cfb40 2024-04-25T08:51:57.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.792+0000 7f3bb144d640 1 -- 172.21.15.172:0/3007954898 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac073a00 con 0x7f3bac0cfb40 2024-04-25T08:51:57.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.793+0000 7f3b937fe640 1 -- 172.21.15.172:0/3007954898 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ba00037b0 con 0x7f3bac0cfb40 2024-04-25T08:51:57.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.793+0000 7f3b937fe640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b9806b4d0 0x7f3b9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:57.785 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.793+0000 7f3b937fe640 1 -- 172.21.15.172:0/3007954898 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f3ba00ab310 con 0x7f3bac0cfb40 2024-04-25T08:51:57.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.793+0000 7f3baaffd640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b9806b4d0 0x7f3b9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:57.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.793+0000 7f3baaffd640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b9806b4d0 0x7f3b9806d990 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009bd0 tx=0x7f3b9c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:57.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:57.798+0000 7f3b937fe640 1 -- 172.21.15.172:0/3007954898 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ba0079990 con 0x7f3bac0cfb40 2024-04-25T08:51:57.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.004+0000 7f3bb144d640 1 -- 172.21.15.172:0/3007954898 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3bac0b1840 con 0x7f3bac0cfb40 2024-04-25T08:51:58.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.684+0000 7f3b937fe640 1 -- 172.21.15.172:0/3007954898 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v82) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3ba007da30 con 0x7f3bac0cfb40 2024-04-25T08:51:58.677 INFO:teuthology.orchestra.run.smithi172.stderr:new fs with metadata pool 21 and data pool 22 2024-04-25T08:51:58.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.694+0000 7f3bb144d640 1 -- 172.21.15.172:0/3007954898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b9806b4d0 msgr2=0x7f3b9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:58.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.694+0000 7f3bb144d640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b9806b4d0 0x7f3b9806d990 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009bd0 tx=0x7f3b9c00b040 comp rx=0 tx=0).stop 2024-04-25T08:51:58.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.694+0000 7f3bb144d640 1 -- 172.21.15.172:0/3007954898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bac0cfb40 msgr2=0x7f3bac0afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:58.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.694+0000 7f3bb144d640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bac0cfb40 0x7f3bac0afdd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3bac06ee50 tx=0x7f3ba00046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.694+0000 7f3bb144d640 1 -- 172.21.15.172:0/3007954898 shutdown_connections 2024-04-25T08:51:58.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.694+0000 7f3bb144d640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3b9806b4d0 0x7f3b9806d990 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.694+0000 7f3bb144d640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bac0cfb40 0x7f3bac0afdd0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.694+0000 7f3bb144d640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bac15bb50 0x7f3bac0b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.694+0000 7f3bb144d640 1 --2- 172.21.15.172:0/3007954898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bac0c70d0 0x7f3bac0b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.694+0000 7f3bb144d640 1 -- 172.21.15.172:0/3007954898 >> 172.21.15.172:0/3007954898 conn(0x7f3bac06f500 msgr2=0x7f3bac0cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:58.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.696+0000 7f3bb144d640 1 -- 172.21.15.172:0/3007954898 shutdown_connections 2024-04-25T08:51:58.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.696+0000 7f3bb144d640 1 -- 172.21.15.172:0/3007954898 wait complete. 2024-04-25T08:51:58.704 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:51:58.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.815+0000 7fd176561640 1 Processor -- start 2024-04-25T08:51:58.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.815+0000 7fd176561640 1 -- start start 2024-04-25T08:51:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.816+0000 7fd176561640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd17015dd80 0x7fd17006c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.816+0000 7fd176561640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd170072d70 con 0x7fd17006f550 2024-04-25T08:51:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.816+0000 7fd176561640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17006db20 con 0x7fd1700721d0 2024-04-25T08:51:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.816+0000 7fd176561640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17006de00 con 0x7fd17015dd80 2024-04-25T08:51:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.816+0000 7fd16ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd17015dd80 0x7fd17006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.816+0000 7fd16ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd17015dd80 0x7fd17006c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36950/0 (socket says 172.21.15.172:36950) 2024-04-25T08:51:58.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.816+0000 7fd16f7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd17006f550 0x7fd170071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40432/0 (socket says 172.21.15.172:40432) 2024-04-25T08:51:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.816+0000 7fd16ffff640 1 -- 172.21.15.172:0/4086700716 learned_addr learned my addr 172.21.15.172:0/4086700716 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.817+0000 7fd16ffff640 1 -- 172.21.15.172:0/4086700716 >> v1:172.21.15.186:6789/0 conn(0x7fd1700721d0 legacy=0x7fd1700b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.817+0000 7fd16ffff640 1 -- 172.21.15.172:0/4086700716 >> v1:172.21.15.172:6789/0 conn(0x7fd17006f550 legacy=0x7fd170071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.817+0000 7fd16effd640 1 -- 172.21.15.172:0/4086700716 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331451316 0 0) 0x7fd170072d70 con 0x7fd17006f550 2024-04-25T08:51:58.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.817+0000 7fd16ffff640 1 -- 172.21.15.172:0/4086700716 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17006b790 con 0x7fd17015dd80 2024-04-25T08:51:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.817+0000 7fd16ffff640 1 --2- 172.21.15.172:0/4086700716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17015dd80 0x7fd17006c370 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fd160009870 tx=0x7fd16002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531149425b7d9087 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.817+0000 7fd16effd640 1 -- 172.21.15.172:0/4086700716 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160037070 con 0x7fd17015dd80 2024-04-25T08:51:58.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.817+0000 7fd16effd640 1 -- 172.21.15.172:0/4086700716 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160032440 con 0x7fd17015dd80 2024-04-25T08:51:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.817+0000 7fd16effd640 1 -- 172.21.15.172:0/4086700716 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160032810 con 0x7fd17015dd80 2024-04-25T08:51:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.818+0000 7fd176561640 1 -- 172.21.15.172:0/4086700716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17015dd80 msgr2=0x7fd17006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.818+0000 7fd176561640 1 --2- 172.21.15.172:0/4086700716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17015dd80 0x7fd17006c370 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fd160009870 tx=0x7fd16002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.818+0000 7fd176561640 1 -- 172.21.15.172:0/4086700716 shutdown_connections 2024-04-25T08:51:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.818+0000 7fd176561640 1 --2- 172.21.15.172:0/4086700716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17015dd80 0x7fd17006c370 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.818+0000 7fd176561640 1 -- 172.21.15.172:0/4086700716 >> 172.21.15.172:0/4086700716 conn(0x7fd1700af670 msgr2=0x7fd1700b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.818+0000 7fd176561640 1 -- 172.21.15.172:0/4086700716 shutdown_connections 2024-04-25T08:51:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.818+0000 7fd176561640 1 -- 172.21.15.172:0/4086700716 wait complete. 2024-04-25T08:51:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.819+0000 7fd176561640 1 Processor -- start 2024-04-25T08:51:58.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.819+0000 7fd176561640 1 -- start start 2024-04-25T08:51:58.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd176561640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1700721d0 0x7fd17014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:58.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd176561640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd17015dd80 0x7fd1701587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:58.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd176561640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd170158cf0 0x7fd17014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:58.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd176561640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700b3780 con 0x7fd1700721d0 2024-04-25T08:51:58.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd176561640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700b3600 con 0x7fd170158cf0 2024-04-25T08:51:58.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd176561640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1700b3900 con 0x7fd17015dd80 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd16ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1700721d0 0x7fd17014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd16ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1700721d0 0x7fd17014cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36956/0 (socket says 172.21.15.172:36956) 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd16ffff640 1 -- 172.21.15.172:0/2492346152 learned_addr learned my addr 172.21.15.172:0/2492346152 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd174afe640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd170158cf0 0x7fd17014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd16f7fe640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd17015dd80 0x7fd1701587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd16ffff640 1 -- 172.21.15.172:0/2492346152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd17015dd80 msgr2=0x7fd1701587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd16ffff640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd17015dd80 0x7fd1701587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd16ffff640 1 -- 172.21.15.172:0/2492346152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd170158cf0 msgr2=0x7fd17014a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd16ffff640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd170158cf0 0x7fd17014a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.820+0000 7fd16ffff640 1 -- 172.21.15.172:0/2492346152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd170159570 con 0x7fd1700721d0 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.821+0000 7fd16f7fe640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd17015dd80 0x7fd1701587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.821+0000 7fd16ffff640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1700721d0 0x7fd17014cca0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fd160009870 tx=0x7fd1600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:58.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.821+0000 7fd16cff9640 1 -- 172.21.15.172:0/2492346152 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160041020 con 0x7fd1700721d0 2024-04-25T08:51:58.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.821+0000 7fd16cff9640 1 -- 172.21.15.172:0/2492346152 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160030970 con 0x7fd1700721d0 2024-04-25T08:51:58.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.821+0000 7fd16cff9640 1 -- 172.21.15.172:0/2492346152 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160037040 con 0x7fd1700721d0 2024-04-25T08:51:58.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.821+0000 7fd176561640 1 -- 172.21.15.172:0/2492346152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd170159850 con 0x7fd1700721d0 2024-04-25T08:51:58.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.821+0000 7fd176561640 1 -- 172.21.15.172:0/2492346152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd170159e10 con 0x7fd1700721d0 2024-04-25T08:51:58.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.822+0000 7fd176561640 1 -- 172.21.15.172:0/2492346152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd170073990 con 0x7fd1700721d0 2024-04-25T08:51:58.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.822+0000 7fd16cff9640 1 -- 172.21.15.172:0/2492346152 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd160044020 con 0x7fd1700721d0 2024-04-25T08:51:58.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.823+0000 7fd16cff9640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd15c06b500 0x7fd15c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:58.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.823+0000 7fd16cff9640 1 -- 172.21.15.172:0/2492346152 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd1600aad40 con 0x7fd1700721d0 2024-04-25T08:51:58.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.823+0000 7fd16f7fe640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd15c06b500 0x7fd15c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:58.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.823+0000 7fd16f7fe640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd15c06b500 0x7fd15c06d9c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd170155480 tx=0x7fd164009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:58.817 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.827+0000 7fd16cff9640 1 -- 172.21.15.172:0/2492346152 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd16004b030 con 0x7fd1700721d0 2024-04-25T08:51:58.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:58.999+0000 7fd176561640 1 -- 172.21.15.172:0/2492346152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd17015cc60 con 0x7fd1700721d0 2024-04-25T08:51:58.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.000+0000 7fd16cff9640 1 -- 172.21.15.172:0/2492346152 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16965 (secure 0 0 0) 0x7fd160079a30 con 0x7fd1700721d0 2024-04-25T08:51:58.991 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:58.991 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":142,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:51:58.007145+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:51:56.275448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T08:51:56.984469+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:51:58.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.002+0000 7fd176561640 1 -- 172.21.15.172:0/2492346152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd15c06b500 msgr2=0x7fd15c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:58.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.002+0000 7fd176561640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd15c06b500 0x7fd15c06d9c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd170155480 tx=0x7fd164009040 comp rx=0 tx=0).stop 2024-04-25T08:51:58.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.002+0000 7fd176561640 1 -- 172.21.15.172:0/2492346152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1700721d0 msgr2=0x7fd17014cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:58.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.002+0000 7fd176561640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1700721d0 0x7fd17014cca0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fd160009870 tx=0x7fd1600046c0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.993 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.002+0000 7fd176561640 1 -- 172.21.15.172:0/2492346152 shutdown_connections 2024-04-25T08:51:58.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.002+0000 7fd176561640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd15c06b500 0x7fd15c06d9c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.002+0000 7fd176561640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd170158cf0 0x7fd17014a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.002+0000 7fd176561640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd17015dd80 0x7fd1701587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.994 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.002+0000 7fd176561640 1 --2- 172.21.15.172:0/2492346152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1700721d0 0x7fd17014cca0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:58.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.002+0000 7fd176561640 1 -- 172.21.15.172:0/2492346152 >> 172.21.15.172:0/2492346152 conn(0x7fd17006f550 msgr2=0x7fd17015c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:58.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.003+0000 7fd176561640 1 -- 172.21.15.172:0/2492346152 shutdown_connections 2024-04-25T08:51:58.995 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.003+0000 7fd176561640 1 -- 172.21.15.172:0/2492346152 wait complete. 2024-04-25T08:51:59.004 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:51:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.112+0000 7fda2cce1640 1 Processor -- start 2024-04-25T08:51:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.112+0000 7fda2cce1640 1 -- start start 2024-04-25T08:51:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.113+0000 7fda2cce1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fda2806abe0 0x7fda2806b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.113+0000 7fda2cce1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda28073150 con 0x7fda28072620 2024-04-25T08:51:59.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.113+0000 7fda2cce1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda280cfa60 con 0x7fda2815b9c0 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.113+0000 7fda2cce1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda280cfd40 con 0x7fda2806abe0 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.113+0000 7fda26d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fda28072620 0x7fda28072a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40436/0 (socket says 172.21.15.172:40436) 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.113+0000 7fda26d9d640 1 -- 172.21.15.172:0/331023981 learned_addr learned my addr 172.21.15.172:0/331023981 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.113+0000 7fda25d9b640 1 --2- 172.21.15.172:0/331023981 >> v2:172.21.15.186:3300/0 conn(0x7fda2806abe0 0x7fda2806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002569535 0 0) 0x7fda28073150 con 0x7fda28072620 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda10003520 con 0x7fda28072620 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278162716 0 0) 0x7fda280cfa60 con 0x7fda2815b9c0 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda28073150 con 0x7fda2815b9c0 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 328466275 0 0) 0x7fda10003520 con 0x7fda28072620 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 >> v2:172.21.15.186:3300/0 conn(0x7fda2806abe0 msgr2=0x7fda2806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 --2- 172.21.15.172:0/331023981 >> v2:172.21.15.186:3300/0 conn(0x7fda2806abe0 0x7fda2806b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 >> v1:172.21.15.186:6789/0 conn(0x7fda2815b9c0 legacy=0x7fda2815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda280d0020 con 0x7fda28072620 2024-04-25T08:51:59.108 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fda20001670 con 0x7fda28072620 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda25d9b640 1 --2- 172.21.15.172:0/331023981 >> v2:172.21.15.186:3300/0 conn(0x7fda2806abe0 0x7fda2806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 >> v1:172.21.15.172:6789/0 conn(0x7fda28072620 legacy=0x7fda28072a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10003b40 0x7fda10003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda10004800 0x7fda10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda100051c0 0x7fda1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280cfd40 con 0x7fda10003b40 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1000c040 con 0x7fda10004800 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1000c240 con 0x7fda100051c0 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2659c640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10003b40 0x7fda10003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda25d9b640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda10004800 0x7fda10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda26d9d640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda100051c0 0x7fda1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2659c640 1 -- 172.21.15.172:0/331023981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda100051c0 msgr2=0x7fda1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2659c640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda100051c0 0x7fda1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2659c640 1 -- 172.21.15.172:0/331023981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda10004800 msgr2=0x7fda10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2659c640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda10004800 0x7fda10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda2659c640 1 -- 172.21.15.172:0/331023981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda10003520 con 0x7fda10003b40 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.114+0000 7fda26d9d640 1 -- 172.21.15.172:0/331023981 reap_dead start 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.115+0000 7fda2659c640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10003b40 0x7fda10003f40 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fda18001fd0 tx=0x7fda10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22469ef70bc2fedb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.115+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18001bf0 con 0x7fda10003b40 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.115+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18003b70 con 0x7fda10003b40 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.115+0000 7fda2559a640 1 -- 172.21.15.172:0/331023981 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180050d0 con 0x7fda10003b40 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.115+0000 7fda2cce1640 1 -- 172.21.15.172:0/331023981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10003b40 msgr2=0x7fda10003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.115+0000 7fda2cce1640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10003b40 0x7fda10003f40 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fda18001fd0 tx=0x7fda10005830 comp rx=0 tx=0).stop 2024-04-25T08:51:59.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.116+0000 7fda2cce1640 1 -- 172.21.15.172:0/331023981 shutdown_connections 2024-04-25T08:51:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.116+0000 7fda2cce1640 1 --2- 172.21.15.172:0/331023981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda10003b40 0x7fda10003f40 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.116+0000 7fda2cce1640 1 -- 172.21.15.172:0/331023981 >> 172.21.15.172:0/331023981 conn(0x7fda280b2370 msgr2=0x7fda280b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.116+0000 7fda2cce1640 1 -- 172.21.15.172:0/331023981 shutdown_connections 2024-04-25T08:51:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.116+0000 7fda2cce1640 1 -- 172.21.15.172:0/331023981 wait complete. 2024-04-25T08:51:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.117+0000 7fda2cce1640 1 Processor -- start 2024-04-25T08:51:59.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.117+0000 7fda2cce1640 1 -- start start 2024-04-25T08:51:59.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda2cce1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda10003b40 0x7fda2813edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda2cce1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda28142070 0x7fda2815bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda2cce1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2815c2e0 0x7fda281f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda2cce1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2806b070 con 0x7fda28142070 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda2cce1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280cf710 con 0x7fda2815c2e0 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda2cce1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2806b1f0 con 0x7fda10003b40 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda25d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda28142070 0x7fda2815bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda25d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda28142070 0x7fda2815bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36960/0 (socket says 172.21.15.172:36960) 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda25d9b640 1 -- 172.21.15.172:0/1850419350 learned_addr learned my addr 172.21.15.172:0/1850419350 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda26d9d640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2815c2e0 0x7fda281f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda2659c640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda10003b40 0x7fda2813edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda25d9b640 1 -- 172.21.15.172:0/1850419350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda10003b40 msgr2=0x7fda2813edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda25d9b640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda10003b40 0x7fda2813edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda25d9b640 1 -- 172.21.15.172:0/1850419350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2815c2e0 msgr2=0x7fda281f19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda25d9b640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2815c2e0 0x7fda281f19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda25d9b640 1 -- 172.21.15.172:0/1850419350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2815dd00 con 0x7fda28142070 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda25d9b640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda28142070 0x7fda2815bda0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fda1c011d00 tx=0x7fda1c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda16ffd640 1 -- 172.21.15.172:0/1850419350 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00fd20 con 0x7fda28142070 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda16ffd640 1 -- 172.21.15.172:0/1850419350 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c004020 con 0x7fda28142070 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda16ffd640 1 -- 172.21.15.172:0/1850419350 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c004410 con 0x7fda28142070 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda2cce1640 1 -- 172.21.15.172:0/1850419350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2814e9e0 con 0x7fda28142070 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.118+0000 7fda2cce1640 1 -- 172.21.15.172:0/1850419350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda281f5380 con 0x7fda28142070 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.119+0000 7fda2cce1640 1 -- 172.21.15.172:0/1850419350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda28073990 con 0x7fda28142070 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.120+0000 7fda16ffd640 1 -- 172.21.15.172:0/1850419350 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda1c012040 con 0x7fda28142070 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.120+0000 7fda16ffd640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 0x7fda0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.120+0000 7fda16ffd640 1 -- 172.21.15.172:0/1850419350 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fda1c08a960 con 0x7fda28142070 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.120+0000 7fda2659c640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 0x7fda0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.121+0000 7fda2659c640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 0x7fda0806d990 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fda18032000 tx=0x7fda1802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:59.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.125+0000 7fda16ffd640 1 -- 172.21.15.172:0/1850419350 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda1c019030 con 0x7fda28142070 2024-04-25T08:51:59.288 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.298+0000 7fda2cce1640 1 -- 172.21.15.172:0/1850419350 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda28157ab0 con 0x7fda28142070 2024-04-25T08:51:59.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.299+0000 7fda16ffd640 1 -- 172.21.15.172:0/1850419350 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16965 (secure 0 0 0) 0x7fda1c059650 con 0x7fda28142070 2024-04-25T08:51:59.290 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:51:59.290 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":142,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:51:58.007145+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:51:56.275448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T08:51:56.984469+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:51:59.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 -- 172.21.15.172:0/1850419350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 msgr2=0x7fda0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 0x7fda0806d990 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fda18032000 tx=0x7fda1802f000 comp rx=0 tx=0).stop 2024-04-25T08:51:59.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 -- 172.21.15.172:0/1850419350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda28142070 msgr2=0x7fda2815bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda28142070 0x7fda2815bda0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fda1c011d00 tx=0x7fda1c00f610 comp rx=0 tx=0).stop 2024-04-25T08:51:59.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 -- 172.21.15.172:0/1850419350 shutdown_connections 2024-04-25T08:51:59.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fda0806b4d0 0x7fda0806d990 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda2815c2e0 0x7fda281f19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda28142070 0x7fda2815bda0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 --2- 172.21.15.172:0/1850419350 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda10003b40 0x7fda2813edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 -- 172.21.15.172:0/1850419350 >> 172.21.15.172:0/1850419350 conn(0x7fda280b2370 msgr2=0x7fda28074060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:59.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 -- 172.21.15.172:0/1850419350 shutdown_connections 2024-04-25T08:51:59.293 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.301+0000 7fda2cce1640 1 -- 172.21.15.172:0/1850419350 wait complete. 2024-04-25T08:51:59.304 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T08:51:59.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.415+0000 7fa3959f9640 1 Processor -- start 2024-04-25T08:51:59.405 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.415+0000 7fa3959f9640 1 -- start start 2024-04-25T08:51:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.415+0000 7fa3959f9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa39015dc20 0x7fa3900ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.415+0000 7fa3959f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa390161710 0x7fa3900cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.415+0000 7fa3959f9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39015e000 con 0x7fa3900b9330 2024-04-25T08:51:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.415+0000 7fa3959f9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3900d1de0 con 0x7fa390161710 2024-04-25T08:51:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.415+0000 7fa3959f9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa390161c60 con 0x7fa39015dc20 2024-04-25T08:51:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.416+0000 7fa38e7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa390161710 0x7fa3900cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.416+0000 7fa38f7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa3900b9330 0x7fa39006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40444/0 (socket says 172.21.15.172:40444) 2024-04-25T08:51:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.416+0000 7fa38f7fe640 1 -- 172.21.15.172:0/3271563886 learned_addr learned my addr 172.21.15.172:0/3271563886 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:51:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.416+0000 7fa38e7fc640 1 --2- 172.21.15.172:0/3271563886 >> v2:172.21.15.172:3300/0 conn(0x7fa390161710 0x7fa3900cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36974/0 (socket says 172.21.15.172:36974) 2024-04-25T08:51:59.407 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.416+0000 7fa38effd640 1 --2- 172.21.15.172:0/3271563886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa39015dc20 0x7fa3900ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.416+0000 7fa38e7fc640 1 -- 172.21.15.172:0/3271563886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa39015dc20 msgr2=0x7fa3900ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:51:59.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.416+0000 7fa38e7fc640 1 --2- 172.21.15.172:0/3271563886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa39015dc20 0x7fa3900ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.416+0000 7fa38e7fc640 1 -- 172.21.15.172:0/3271563886 >> v1:172.21.15.172:6789/0 conn(0x7fa3900b9330 legacy=0x7fa39006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.416+0000 7fa38e7fc640 1 -- 172.21.15.172:0/3271563886 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa390161f40 con 0x7fa390161710 2024-04-25T08:51:59.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.416+0000 7fa38dffb640 1 -- 172.21.15.172:0/3271563886 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351618826 0 0) 0x7fa39015e000 con 0x7fa3900b9330 2024-04-25T08:51:59.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa38e7fc640 1 --2- 172.21.15.172:0/3271563886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa390161710 0x7fa3900cebb0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fa3840097a0 tx=0x7fa38402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c4ef26915039cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:59.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa38dffb640 1 -- 172.21.15.172:0/3271563886 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384037070 con 0x7fa390161710 2024-04-25T08:51:59.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa38dffb640 1 -- 172.21.15.172:0/3271563886 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa384032440 con 0x7fa390161710 2024-04-25T08:51:59.408 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa38dffb640 1 -- 172.21.15.172:0/3271563886 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384032810 con 0x7fa390161710 2024-04-25T08:51:59.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa3959f9640 1 -- 172.21.15.172:0/3271563886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa390161710 msgr2=0x7fa3900cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa3959f9640 1 --2- 172.21.15.172:0/3271563886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa390161710 0x7fa3900cebb0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fa3840097a0 tx=0x7fa38402a180 comp rx=0 tx=0).stop 2024-04-25T08:51:59.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa3959f9640 1 -- 172.21.15.172:0/3271563886 shutdown_connections 2024-04-25T08:51:59.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa3959f9640 1 --2- 172.21.15.172:0/3271563886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa390161710 0x7fa3900cebb0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa3959f9640 1 --2- 172.21.15.172:0/3271563886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa39015dc20 0x7fa3900ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa3959f9640 1 -- 172.21.15.172:0/3271563886 >> 172.21.15.172:0/3271563886 conn(0x7fa3900d0420 msgr2=0x7fa3900d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:51:59.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa3959f9640 1 -- 172.21.15.172:0/3271563886 shutdown_connections 2024-04-25T08:51:59.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.417+0000 7fa3959f9640 1 -- 172.21.15.172:0/3271563886 wait complete. 2024-04-25T08:51:59.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.418+0000 7fa3959f9640 1 Processor -- start 2024-04-25T08:51:59.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.419+0000 7fa3959f9640 1 -- start start 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.419+0000 7fa3959f9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3900b9330 0x7fa39015fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.419+0000 7fa3959f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa39015dc20 0x7fa39015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.419+0000 7fa3959f9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa390161710 0x7fa39015e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.419+0000 7fa3959f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3900b5e50 con 0x7fa39015dc20 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.419+0000 7fa3959f9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa390162500 con 0x7fa390161710 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.419+0000 7fa3959f9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3900b5fd0 con 0x7fa3900b9330 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.419+0000 7fa38e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa39015dc20 0x7fa39015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa38e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa39015dc20 0x7fa39015bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36984/0 (socket says 172.21.15.172:36984) 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa38e7fc640 1 -- 172.21.15.172:0/3975006004 learned_addr learned my addr 172.21.15.172:0/3975006004 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa38effd640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3900b9330 0x7fa39015fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa38f7fe640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa390161710 0x7fa39015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa38e7fc640 1 -- 172.21.15.172:0/3975006004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3900b9330 msgr2=0x7fa39015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa38e7fc640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3900b9330 0x7fa39015fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.412 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa38e7fc640 1 -- 172.21.15.172:0/3975006004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa390161710 msgr2=0x7fa39015e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:51:59.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa38e7fc640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa390161710 0x7fa39015e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:51:59.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa38e7fc640 1 -- 172.21.15.172:0/3975006004 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3901e7810 con 0x7fa39015dc20 2024-04-25T08:51:59.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa38e7fc640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa39015dc20 0x7fa39015bae0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fa384035040 tx=0x7fa3840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:59.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa377fff640 1 -- 172.21.15.172:0/3975006004 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384037040 con 0x7fa39015dc20 2024-04-25T08:51:59.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa377fff640 1 -- 172.21.15.172:0/3975006004 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa384030500 con 0x7fa39015dc20 2024-04-25T08:51:59.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa377fff640 1 -- 172.21.15.172:0/3975006004 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384030910 con 0x7fa39015dc20 2024-04-25T08:51:59.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa3959f9640 1 -- 172.21.15.172:0/3975006004 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39015ecf0 con 0x7fa39015dc20 2024-04-25T08:51:59.413 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.420+0000 7fa3959f9640 1 -- 172.21.15.172:0/3975006004 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39015f590 con 0x7fa39015dc20 2024-04-25T08:51:59.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.421+0000 7fa3959f9640 1 -- 172.21.15.172:0/3975006004 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa390073a00 con 0x7fa39015dc20 2024-04-25T08:51:59.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.422+0000 7fa377fff640 1 -- 172.21.15.172:0/3975006004 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa384044020 con 0x7fa39015dc20 2024-04-25T08:51:59.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.422+0000 7fa377fff640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa37c06b4d0 0x7fa37c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:51:59.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.422+0000 7fa377fff640 1 -- 172.21.15.172:0/3975006004 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa3840aa470 con 0x7fa39015dc20 2024-04-25T08:51:59.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.422+0000 7fa38effd640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa37c06b4d0 0x7fa37c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:51:59.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.423+0000 7fa38effd640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa37c06b4d0 0x7fa37c06d990 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa380011340 tx=0x7fa38000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:51:59.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.426+0000 7fa377fff640 1 -- 172.21.15.172:0/3975006004 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa384078b10 con 0x7fa39015dc20 2024-04-25T08:51:59.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:51:59.636+0000 7fa3959f9640 1 -- 172.21.15.172:0/3975006004 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa3900d0b60 con 0x7fa39015dc20 2024-04-25T08:52:00.297 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.307+0000 7fa377fff640 1 -- 172.21.15.172:0/3975006004 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v84) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa38407cbb0 con 0x7fa39015dc20 2024-04-25T08:52:00.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 -- 172.21.15.172:0/3975006004 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa37c06b4d0 msgr2=0x7fa37c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa37c06b4d0 0x7fa37c06d990 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa380011340 tx=0x7fa38000b040 comp rx=0 tx=0).stop 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 -- 172.21.15.172:0/3975006004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa39015dc20 msgr2=0x7fa39015bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa39015dc20 0x7fa39015bae0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fa384035040 tx=0x7fa3840046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 -- 172.21.15.172:0/3975006004 shutdown_connections 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa37c06b4d0 0x7fa37c06d990 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa390161710 0x7fa39015e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa39015dc20 0x7fa39015bae0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 --2- 172.21.15.172:0/3975006004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3900b9330 0x7fa39015fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 -- 172.21.15.172:0/3975006004 >> 172.21.15.172:0/3975006004 conn(0x7fa3900d0420 msgr2=0x7fa39015cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 -- 172.21.15.172:0/3975006004 shutdown_connections 2024-04-25T08:52:00.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.309+0000 7fa3959f9640 1 -- 172.21.15.172:0/3975006004 wait complete. 2024-04-25T08:52:00.311 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T08:52:00.312 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T08:52:00.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.424+0000 7f5d57eb3640 1 Processor -- start 2024-04-25T08:52:00.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.424+0000 7f5d57eb3640 1 -- start start 2024-04-25T08:52:00.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.425+0000 7f5d57eb3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d501454a0 0x7f5d500aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:00.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.425+0000 7f5d57eb3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d5006b2f0 0x7f5d5015d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:00.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.425+0000 7f5d57eb3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d500af540 con 0x7f5d5015c970 2024-04-25T08:52:00.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.425+0000 7f5d57eb3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d500af820 con 0x7f5d5006b2f0 2024-04-25T08:52:00.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.425+0000 7f5d57eb3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500afb00 con 0x7f5d501454a0 2024-04-25T08:52:00.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.425+0000 7f5d56450640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d5006b2f0 0x7f5d5015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:00.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.425+0000 7f5d56450640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5d5006b2f0 0x7f5d5015d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36996/0 (socket says 172.21.15.172:36996) 2024-04-25T08:52:00.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.425+0000 7f5d56450640 1 -- 172.21.15.172:0/1324880533 learned_addr learned my addr 172.21.15.172:0/1324880533 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:00.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.425+0000 7f5d55c4f640 1 --2- 172.21.15.172:0/1324880533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d501454a0 0x7f5d500aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:00.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.426+0000 7f5d56450640 1 -- 172.21.15.172:0/1324880533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d501454a0 msgr2=0x7f5d500aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:00.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.426+0000 7f5d56450640 1 --2- 172.21.15.172:0/1324880533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d501454a0 0x7f5d500aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:00.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.426+0000 7f5d56450640 1 -- 172.21.15.172:0/1324880533 >> v1:172.21.15.186:6789/0 conn(0x7f5d5015c970 legacy=0x7f5d5006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:00.417 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.426+0000 7f5d56450640 1 -- 172.21.15.172:0/1324880533 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d500afde0 con 0x7f5d5006b2f0 2024-04-25T08:52:00.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.426+0000 7f5d56450640 1 --2- 172.21.15.172:0/1324880533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 0x7f5d5015d490 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009870 tx=0x7f5d4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f455f3689c81339 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:00.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.426+0000 7f5d54c4d640 1 -- 172.21.15.172:0/1324880533 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48037070 con 0x7f5d5006b2f0 2024-04-25T08:52:00.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.426+0000 7f5d54c4d640 1 -- 172.21.15.172:0/1324880533 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d48032440 con 0x7f5d5006b2f0 2024-04-25T08:52:00.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.426+0000 7f5d54c4d640 1 -- 172.21.15.172:0/1324880533 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48032810 con 0x7f5d5006b2f0 2024-04-25T08:52:00.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.427+0000 7f5d57eb3640 1 -- 172.21.15.172:0/1324880533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 msgr2=0x7f5d5015d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:00.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.427+0000 7f5d57eb3640 1 --2- 172.21.15.172:0/1324880533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 0x7f5d5015d490 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009870 tx=0x7f5d4802a270 comp rx=0 tx=0).stop 2024-04-25T08:52:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.427+0000 7f5d57eb3640 1 -- 172.21.15.172:0/1324880533 shutdown_connections 2024-04-25T08:52:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.427+0000 7f5d57eb3640 1 --2- 172.21.15.172:0/1324880533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 0x7f5d5015d490 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.427+0000 7f5d57eb3640 1 --2- 172.21.15.172:0/1324880533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d501454a0 0x7f5d500aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.427+0000 7f5d57eb3640 1 -- 172.21.15.172:0/1324880533 >> 172.21.15.172:0/1324880533 conn(0x7f5d500b5af0 msgr2=0x7f5d500b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.427+0000 7f5d57eb3640 1 -- 172.21.15.172:0/1324880533 shutdown_connections 2024-04-25T08:52:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.427+0000 7f5d57eb3640 1 -- 172.21.15.172:0/1324880533 wait complete. 2024-04-25T08:52:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.428+0000 7f5d57eb3640 1 Processor -- start 2024-04-25T08:52:00.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.428+0000 7f5d57eb3640 1 -- start start 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d57eb3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 0x7f5d5015b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d57eb3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d501454a0 0x7f5d50139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d57eb3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5015c970 0x7f5d5013b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d57eb3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5015db50 con 0x7f5d5006b2f0 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d57eb3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5015d9d0 con 0x7f5d501454a0 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d57eb3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5015dcd0 con 0x7f5d5015c970 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d55c4f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 0x7f5d5015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d55c4f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 0x7f5d5015b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37000/0 (socket says 172.21.15.172:37000) 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d55c4f640 1 -- 172.21.15.172:0/3689709985 learned_addr learned my addr 172.21.15.172:0/3689709985 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d56450640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5015c970 0x7f5d5013b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d5544e640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d501454a0 0x7f5d50139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:00.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d55c4f640 1 -- 172.21.15.172:0/3689709985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5015c970 msgr2=0x7f5d5013b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d55c4f640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5015c970 0x7f5d5013b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d55c4f640 1 -- 172.21.15.172:0/3689709985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d501454a0 msgr2=0x7f5d50139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d55c4f640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d501454a0 0x7f5d50139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d55c4f640 1 -- 172.21.15.172:0/3689709985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d501f4d30 con 0x7f5d5006b2f0 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d56450640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5015c970 0x7f5d5013b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d5544e640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d501454a0 0x7f5d50139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.429+0000 7f5d55c4f640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 0x7f5d5015b370 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c007ef0 tx=0x7f5d4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.430+0000 7f5d467fc640 1 -- 172.21.15.172:0/3689709985 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c014620 con 0x7f5d5006b2f0 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.430+0000 7f5d467fc640 1 -- 172.21.15.172:0/3689709985 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c019070 con 0x7f5d5006b2f0 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.430+0000 7f5d467fc640 1 -- 172.21.15.172:0/3689709985 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c014a00 con 0x7f5d5006b2f0 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.430+0000 7f5d57eb3640 1 -- 172.21.15.172:0/3689709985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d501f4fd0 con 0x7f5d5006b2f0 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.430+0000 7f5d57eb3640 1 -- 172.21.15.172:0/3689709985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d501f5590 con 0x7f5d5006b2f0 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.431+0000 7f5d57eb3640 1 -- 172.21.15.172:0/3689709985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5006cc80 con 0x7f5d5006b2f0 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.431+0000 7f5d467fc640 1 -- 172.21.15.172:0/3689709985 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d4c014ba0 con 0x7f5d5006b2f0 2024-04-25T08:52:00.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.431+0000 7f5d467fc640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 0x7f5d3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:00.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.431+0000 7f5d467fc640 1 -- 172.21.15.172:0/3689709985 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5d4c08ac40 con 0x7f5d5006b2f0 2024-04-25T08:52:00.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.432+0000 7f5d5544e640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 0x7f5d3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:00.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.432+0000 7f5d5544e640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 0x7f5d3406d990 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5d5013b690 tx=0x7f5d40009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:00.426 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.436+0000 7f5d467fc640 1 -- 172.21.15.172:0/3689709985 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d4c0599c0 con 0x7f5d5006b2f0 2024-04-25T08:52:00.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:00.643+0000 7f5d57eb3640 1 -- 172.21.15.172:0/3689709985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5d5015e250 con 0x7f5d5006b2f0 2024-04-25T08:52:01.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.312+0000 7f5d467fc640 1 -- 172.21.15.172:0/3689709985 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v85) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d4c0592c0 con 0x7f5d5006b2f0 2024-04-25T08:52:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.314+0000 7f5d57eb3640 1 -- 172.21.15.172:0/3689709985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 msgr2=0x7f5d3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.314+0000 7f5d57eb3640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 0x7f5d3406d990 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5d5013b690 tx=0x7f5d40009040 comp rx=0 tx=0).stop 2024-04-25T08:52:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.314+0000 7f5d57eb3640 1 -- 172.21.15.172:0/3689709985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 msgr2=0x7f5d5015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.314+0000 7f5d57eb3640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 0x7f5d5015b370 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c007ef0 tx=0x7f5d4c00e4b0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.314+0000 7f5d57eb3640 1 -- 172.21.15.172:0/3689709985 shutdown_connections 2024-04-25T08:52:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.314+0000 7f5d57eb3640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5d3406b4d0 0x7f5d3406d990 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.314+0000 7f5d57eb3640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5d501454a0 0x7f5d50139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.314+0000 7f5d57eb3640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5d5015c970 0x7f5d5013b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.314+0000 7f5d57eb3640 1 --2- 172.21.15.172:0/3689709985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d5006b2f0 0x7f5d5015b370 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.314+0000 7f5d57eb3640 1 -- 172.21.15.172:0/3689709985 >> 172.21.15.172:0/3689709985 conn(0x7f5d500b5af0 msgr2=0x7f5d500b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:01.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.315+0000 7f5d57eb3640 1 -- 172.21.15.172:0/3689709985 shutdown_connections 2024-04-25T08:52:01.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.315+0000 7f5d57eb3640 1 -- 172.21.15.172:0/3689709985 wait complete. 2024-04-25T08:52:01.317 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T08:52:01.317 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:52:01.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.426+0000 7f894befc640 1 Processor -- start 2024-04-25T08:52:01.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.426+0000 7f894befc640 1 -- start start 2024-04-25T08:52:01.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894befc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894415b980 0x7f89440cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894befc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f89440cffb0 0x7f894415c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894befc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894415f710 con 0x7f894406b5f0 2024-04-25T08:52:01.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894befc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894415f9b0 con 0x7f89440cffb0 2024-04-25T08:52:01.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894befc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894415fc90 con 0x7f894415b980 2024-04-25T08:52:01.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894a499640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f89440cffb0 0x7f894415c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f8949497640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f894406b5f0 0x7f89440cf8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40450/0 (socket says 172.21.15.172:40450) 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894a499640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f89440cffb0 0x7f894415c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37004/0 (socket says 172.21.15.172:37004) 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f8949497640 1 -- 172.21.15.172:0/777133846 learned_addr learned my addr 172.21.15.172:0/777133846 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f8949c98640 1 --2- 172.21.15.172:0/777133846 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894415b980 0x7f89440cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894a499640 1 -- 172.21.15.172:0/777133846 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894415b980 msgr2=0x7f89440cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894a499640 1 --2- 172.21.15.172:0/777133846 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894415b980 0x7f89440cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894a499640 1 -- 172.21.15.172:0/777133846 >> v1:172.21.15.172:6789/0 conn(0x7f894406b5f0 legacy=0x7f89440cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f8948c96640 1 -- 172.21.15.172:0/777133846 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436609028 0 0) 0x7f894415f710 con 0x7f894406b5f0 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.427+0000 7f894a499640 1 -- 172.21.15.172:0/777133846 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894415ff70 con 0x7f89440cffb0 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.428+0000 7f894a499640 1 --2- 172.21.15.172:0/777133846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 0x7f894415c0f0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f893c009d90 tx=0x7f893c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d99b49575d87ccb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.428+0000 7f8948c96640 1 -- 172.21.15.172:0/777133846 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c007740 con 0x7f89440cffb0 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.428+0000 7f8948c96640 1 -- 172.21.15.172:0/777133846 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c0078e0 con 0x7f89440cffb0 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.428+0000 7f8948c96640 1 -- 172.21.15.172:0/777133846 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c007cb0 con 0x7f89440cffb0 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.428+0000 7f894befc640 1 -- 172.21.15.172:0/777133846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 msgr2=0x7f894415c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.428+0000 7f894befc640 1 --2- 172.21.15.172:0/777133846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 0x7f894415c0f0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f893c009d90 tx=0x7f893c02a660 comp rx=0 tx=0).stop 2024-04-25T08:52:01.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.429+0000 7f894befc640 1 -- 172.21.15.172:0/777133846 shutdown_connections 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.429+0000 7f894befc640 1 --2- 172.21.15.172:0/777133846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 0x7f894415c0f0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.429+0000 7f894befc640 1 --2- 172.21.15.172:0/777133846 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894415b980 0x7f89440cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.429+0000 7f894befc640 1 -- 172.21.15.172:0/777133846 >> 172.21.15.172:0/777133846 conn(0x7f89440b2220 msgr2=0x7f89440b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.429+0000 7f894befc640 1 -- 172.21.15.172:0/777133846 shutdown_connections 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.429+0000 7f894befc640 1 -- 172.21.15.172:0/777133846 wait complete. 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.430+0000 7f894befc640 1 Processor -- start 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.430+0000 7f894befc640 1 -- start start 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.430+0000 7f894befc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894406b5f0 0x7f8944152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.430+0000 7f894befc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 0x7f89440b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.430+0000 7f894befc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894415b980 0x7f8944157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.430+0000 7f894befc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440cf550 con 0x7f89440cffb0 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.430+0000 7f894befc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894415bd60 con 0x7f894406b5f0 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.430+0000 7f894befc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440b2d40 con 0x7f894415b980 2024-04-25T08:52:01.430 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f8949497640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 0x7f89440b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f8949497640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 0x7f89440b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37010/0 (socket says 172.21.15.172:37010) 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f8949497640 1 -- 172.21.15.172:0/2506928785 learned_addr learned my addr 172.21.15.172:0/2506928785 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f8949c98640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894406b5f0 0x7f8944152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f894a499640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894415b980 0x7f8944157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f8949497640 1 -- 172.21.15.172:0/2506928785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894415b980 msgr2=0x7f8944157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f8949497640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894415b980 0x7f8944157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f8949497640 1 -- 172.21.15.172:0/2506928785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894406b5f0 msgr2=0x7f8944152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f8949497640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894406b5f0 0x7f8944152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f8949497640 1 -- 172.21.15.172:0/2506928785 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440b5860 con 0x7f89440cffb0 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f8949497640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 0x7f89440b4ef0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f893400c4e0 tx=0x7f893400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f893a7fc640 1 -- 172.21.15.172:0/2506928785 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934018070 con 0x7f89440cffb0 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f893a7fc640 1 -- 172.21.15.172:0/2506928785 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8934007500 con 0x7f89440cffb0 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f894befc640 1 -- 172.21.15.172:0/2506928785 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894415c220 con 0x7f89440cffb0 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f893a7fc640 1 -- 172.21.15.172:0/2506928785 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934004a20 con 0x7f89440cffb0 2024-04-25T08:52:01.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.431+0000 7f894befc640 1 -- 172.21.15.172:0/2506928785 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89440b5430 con 0x7f89440cffb0 2024-04-25T08:52:01.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.432+0000 7f894befc640 1 -- 172.21.15.172:0/2506928785 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89440cb640 con 0x7f89440cffb0 2024-04-25T08:52:01.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.433+0000 7f893a7fc640 1 -- 172.21.15.172:0/2506928785 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f893401b070 con 0x7f89440cffb0 2024-04-25T08:52:01.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.433+0000 7f893a7fc640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892806b500 0x7f892806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.433+0000 7f893a7fc640 1 -- 172.21.15.172:0/2506928785 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8934089690 con 0x7f89440cffb0 2024-04-25T08:52:01.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.433+0000 7f8949c98640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892806b500 0x7f892806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.433+0000 7f8949c98640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892806b500 0x7f892806d9c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8940006fd0 tx=0x7f8940008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:01.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.437+0000 7f893a7fc640 1 -- 172.21.15.172:0/2506928785 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89440cb640 con 0x7f89440cffb0 2024-04-25T08:52:01.543 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:52:01.546 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:52:01.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.649+0000 7f894befc640 1 -- 172.21.15.172:0/2506928785 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8944073990 con 0x7f89440cffb0 2024-04-25T08:52:01.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.649+0000 7f893a7fc640 1 -- 172.21.15.172:0/2506928785 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f8934058440 con 0x7f89440cffb0 2024-04-25T08:52:01.640 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:01.640 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3226910746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3226910746},{"type":"v1","addr":"172.21.15.186:6834","nonce":3226910746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/741856049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":741856049},{"type":"v1","addr":"172.21.15.186:6835","nonce":741856049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":9819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/406316339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":406316339},{"type":"v1","addr":"172.21.15.172:6835","nonce":406316339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:51:58.007519+0000","modified":"2024-04-25T08:52:00.645221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9825},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9825":{"gid":9825,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2096375996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2096375996},{"type":"v1","addr":"172.21.15.172:6837","nonce":2096375996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T08:52:01.640 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 85 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 -- 172.21.15.172:0/2506928785 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892806b500 msgr2=0x7f892806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892806b500 0x7f892806d9c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8940006fd0 tx=0x7f8940008040 comp rx=0 tx=0).stop 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 -- 172.21.15.172:0/2506928785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 msgr2=0x7f89440b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 0x7f89440b4ef0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f893400c4e0 tx=0x7f893400c9a0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 -- 172.21.15.172:0/2506928785 shutdown_connections 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f892806b500 0x7f892806d9c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f894415b980 0x7f8944157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89440cffb0 0x7f89440b4ef0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 --2- 172.21.15.172:0/2506928785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f894406b5f0 0x7f8944152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 -- 172.21.15.172:0/2506928785 >> 172.21.15.172:0/2506928785 conn(0x7f89440b2220 msgr2=0x7f89440cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 -- 172.21.15.172:0/2506928785 shutdown_connections 2024-04-25T08:52:01.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.651+0000 7f894befc640 1 -- 172.21.15.172:0/2506928785 wait complete. 2024-04-25T08:52:01.653 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:52:01.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.761+0000 7f3fa2e9e640 1 Processor -- start 2024-04-25T08:52:01.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.761+0000 7f3fa2e9e640 1 -- start start 2024-04-25T08:52:01.752 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3fa2e9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3f9c071ac0 0x7f3f9c0ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3fa2e9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f9c06c1d0 0x7f3f9c06afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3fa2e9e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c15ec60 con 0x7f3f9c154ed0 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3fa2e9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9c15ef40 con 0x7f3f9c071ac0 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3fa2e9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c06db90 con 0x7f3f9c06c1d0 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3f9bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3f9c071ac0 0x7f3f9c0ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3f9bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3f9c071ac0 0x7f3f9c0ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37014/0 (socket says 172.21.15.172:37014) 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3f9bfff640 1 -- 172.21.15.172:0/3813423885 learned_addr learned my addr 172.21.15.172:0/3813423885 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3fa143b640 1 --2- 172.21.15.172:0/3813423885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f9c06c1d0 0x7f3f9c06afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3f9bfff640 1 -- 172.21.15.172:0/3813423885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f9c06c1d0 msgr2=0x7f3f9c06afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3f9bfff640 1 --2- 172.21.15.172:0/3813423885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f9c06c1d0 0x7f3f9c06afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3f9bfff640 1 -- 172.21.15.172:0/3813423885 >> v1:172.21.15.186:6789/0 conn(0x7f3f9c154ed0 legacy=0x7f3f9c0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.753 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.762+0000 7f3f9bfff640 1 -- 172.21.15.172:0/3813423885 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c06de70 con 0x7f3f9c071ac0 2024-04-25T08:52:01.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.763+0000 7f3f9bfff640 1 --2- 172.21.15.172:0/3813423885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 0x7f3f9c0ad5e0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009870 tx=0x7f3f8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0ee42a1113357 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:01.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.763+0000 7f3f9b7fe640 1 -- 172.21.15.172:0/3813423885 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88037070 con 0x7f3f9c071ac0 2024-04-25T08:52:01.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.763+0000 7f3f9b7fe640 1 -- 172.21.15.172:0/3813423885 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88032440 con 0x7f3f9c071ac0 2024-04-25T08:52:01.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.763+0000 7f3f9b7fe640 1 -- 172.21.15.172:0/3813423885 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88032810 con 0x7f3f9c071ac0 2024-04-25T08:52:01.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.763+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/3813423885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 msgr2=0x7f3f9c0ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.763+0000 7f3fa2e9e640 1 --2- 172.21.15.172:0/3813423885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 0x7f3f9c0ad5e0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009870 tx=0x7f3f8802a270 comp rx=0 tx=0).stop 2024-04-25T08:52:01.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.763+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/3813423885 shutdown_connections 2024-04-25T08:52:01.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.763+0000 7f3fa2e9e640 1 --2- 172.21.15.172:0/3813423885 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f9c06c1d0 0x7f3f9c06afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.763+0000 7f3fa2e9e640 1 --2- 172.21.15.172:0/3813423885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 0x7f3f9c0ad5e0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.763+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/3813423885 >> 172.21.15.172:0/3813423885 conn(0x7f3f9c0af670 msgr2=0x7f3f9c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:01.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.764+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/3813423885 shutdown_connections 2024-04-25T08:52:01.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.764+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/3813423885 wait complete. 2024-04-25T08:52:01.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.765+0000 7f3fa2e9e640 1 Processor -- start 2024-04-25T08:52:01.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.765+0000 7f3fa2e9e640 1 -- start start 2024-04-25T08:52:01.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.765+0000 7f3fa2e9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 0x7f3f9c150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.765+0000 7f3fa2e9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c154ed0 0x7f3f9c142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.765+0000 7f3fa2e9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f9c1510f0 0x7f3f9c151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.765+0000 7f3fa2e9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c06b660 con 0x7f3f9c071ac0 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.765+0000 7f3fa2e9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c06b4e0 con 0x7f3f9c154ed0 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.765+0000 7f3fa2e9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c06b7e0 con 0x7f3f9c1510f0 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa0c3a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 0x7f3f9c150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa0c3a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 0x7f3f9c150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37018/0 (socket says 172.21.15.172:37018) 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa0c3a640 1 -- 172.21.15.172:0/433738413 learned_addr learned my addr 172.21.15.172:0/433738413 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3f9bfff640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c154ed0 0x7f3f9c142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa143b640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f9c1510f0 0x7f3f9c151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa0c3a640 1 -- 172.21.15.172:0/433738413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f9c1510f0 msgr2=0x7f3f9c151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa0c3a640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f9c1510f0 0x7f3f9c151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa0c3a640 1 -- 172.21.15.172:0/433738413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c154ed0 msgr2=0x7f3f9c142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa0c3a640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c154ed0 0x7f3f9c142f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa0c3a640 1 -- 172.21.15.172:0/433738413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c1534a0 con 0x7f3f9c071ac0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa0c3a640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 0x7f3f9c150330 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000c3c0 tx=0x7f3f9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3f997fa640 1 -- 172.21.15.172:0/433738413 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f900052d0 con 0x7f3f9c071ac0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3f997fa640 1 -- 172.21.15.172:0/433738413 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90005490 con 0x7f3f9c071ac0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3f997fa640 1 -- 172.21.15.172:0/433738413 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f90007260 con 0x7f3f9c071ac0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/433738413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c153780 con 0x7f3f9c071ac0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.766+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/433738413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c153d40 con 0x7f3f9c071ac0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.767+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/433738413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c0b2b10 con 0x7f3f9c071ac0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.768+0000 7f3f997fa640 1 -- 172.21.15.172:0/433738413 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3f90007400 con 0x7f3f9c071ac0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.768+0000 7f3f997fa640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006b4d0 0x7f3f8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.768+0000 7f3f9bfff640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006b4d0 0x7f3f8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.768+0000 7f3f997fa640 1 -- 172.21.15.172:0/433738413 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3f900898a0 con 0x7f3f9c071ac0 2024-04-25T08:52:01.760 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.768+0000 7f3f9bfff640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006b4d0 0x7f3f8006d990 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3f88034000 tx=0x7f3f8802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:01.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.772+0000 7f3f997fa640 1 -- 172.21.15.172:0/433738413 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3f90058590 con 0x7f3f9c071ac0 2024-04-25T08:52:01.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.944+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/433738413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f9c073990 con 0x7f3f9c071ac0 2024-04-25T08:52:01.935 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.945+0000 7f3f997fa640 1 -- 172.21.15.172:0/433738413 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16952 (secure 0 0 0) 0x7f3f90057e90 con 0x7f3f9c071ac0 2024-04-25T08:52:01.936 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:01.936 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":143,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:51:59.678876+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:51:56.275448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T08:51:56.984469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:52:01.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.947+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/433738413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006b4d0 msgr2=0x7f3f8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.947+0000 7f3fa2e9e640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006b4d0 0x7f3f8006d990 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3f88034000 tx=0x7f3f8802e000 comp rx=0 tx=0).stop 2024-04-25T08:52:01.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.947+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/433738413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 msgr2=0x7f3f9c150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:01.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.947+0000 7f3fa2e9e640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 0x7f3f9c150330 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000c3c0 tx=0x7f3f9000c880 comp rx=0 tx=0).stop 2024-04-25T08:52:01.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.948+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/433738413 shutdown_connections 2024-04-25T08:52:01.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.948+0000 7f3fa2e9e640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3f8006b4d0 0x7f3f8006d990 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.948+0000 7f3fa2e9e640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c154ed0 0x7f3f9c142f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.948+0000 7f3fa2e9e640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3f9c1510f0 0x7f3f9c151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.948+0000 7f3fa2e9e640 1 --2- 172.21.15.172:0/433738413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f9c071ac0 0x7f3f9c150330 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:01.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.948+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/433738413 >> 172.21.15.172:0/433738413 conn(0x7f3f9c06c1d0 msgr2=0x7f3f9c0b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:01.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.948+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/433738413 shutdown_connections 2024-04-25T08:52:01.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:01.948+0000 7f3fa2e9e640 1 -- 172.21.15.172:0/433738413 wait complete. 2024-04-25T08:52:01.949 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T08:52:01.949 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:52:02.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.056+0000 7fa29409e640 1 Processor -- start 2024-04-25T08:52:02.047 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.057+0000 7fa29409e640 1 -- start start 2024-04-25T08:52:02.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.057+0000 7fa29409e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa28c0b2cb0 0x7fa28c0d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.057+0000 7fa29409e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa28c0d1020 0x7fa28c0d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.057+0000 7fa29409e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c0b97a0 con 0x7fa28c15dbe0 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.057+0000 7fa29409e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28c15dfc0 con 0x7fa28c0d1020 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.057+0000 7fa29409e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0d1a00 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.058+0000 7fa29263b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa28c0d1020 0x7fa28c0d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.058+0000 7fa29263b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa28c0d1020 0x7fa28c0d2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37032/0 (socket says 172.21.15.172:37032) 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.058+0000 7fa29263b640 1 -- 172.21.15.172:0/1943658605 learned_addr learned my addr 172.21.15.172:0/1943658605 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.058+0000 7fa291639640 1 --2- 172.21.15.172:0/1943658605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa28c0b2cb0 0x7fa28c0d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.058+0000 7fa29263b640 1 -- 172.21.15.172:0/1943658605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa28c0b2cb0 msgr2=0x7fa28c0d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.058+0000 7fa29263b640 1 --2- 172.21.15.172:0/1943658605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa28c0b2cb0 0x7fa28c0d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.058+0000 7fa29263b640 1 -- 172.21.15.172:0/1943658605 >> v1:172.21.15.186:6789/0 conn(0x7fa28c15dbe0 legacy=0x7fa28c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.058+0000 7fa29263b640 1 -- 172.21.15.172:0/1943658605 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0d1c50 con 0x7fa28c0d1020 2024-04-25T08:52:02.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.058+0000 7fa29263b640 1 --2- 172.21.15.172:0/1943658605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0d1020 0x7fa28c0d2c70 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fa284009e50 tx=0x7fa28402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e252afa5bbf9d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa290e38640 1 -- 172.21.15.172:0/1943658605 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284036070 con 0x7fa28c0d1020 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa290e38640 1 -- 172.21.15.172:0/1943658605 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa284031600 con 0x7fa28c0d1020 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa290e38640 1 -- 172.21.15.172:0/1943658605 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2840319d0 con 0x7fa28c0d1020 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa29409e640 1 -- 172.21.15.172:0/1943658605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0d1020 msgr2=0x7fa28c0d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa29409e640 1 --2- 172.21.15.172:0/1943658605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0d1020 0x7fa28c0d2c70 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fa284009e50 tx=0x7fa28402a6c0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa29409e640 1 -- 172.21.15.172:0/1943658605 shutdown_connections 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa29409e640 1 --2- 172.21.15.172:0/1943658605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0d1020 0x7fa28c0d2c70 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa29409e640 1 --2- 172.21.15.172:0/1943658605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa28c0b2cb0 0x7fa28c0d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa29409e640 1 -- 172.21.15.172:0/1943658605 >> 172.21.15.172:0/1943658605 conn(0x7fa28c061a20 msgr2=0x7fa28c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa29409e640 1 -- 172.21.15.172:0/1943658605 shutdown_connections 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.059+0000 7fa29409e640 1 -- 172.21.15.172:0/1943658605 wait complete. 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.060+0000 7fa29409e640 1 Processor -- start 2024-04-25T08:52:02.051 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.060+0000 7fa29409e640 1 -- start start 2024-04-25T08:52:02.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.061+0000 7fa29409e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0b2cb0 0x7fa28c1f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.061+0000 7fa29409e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa28c0d1020 0x7fa28c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.061+0000 7fa29409e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28c15dbe0 0x7fa28c15f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.061+0000 7fa29409e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0b92a0 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.061+0000 7fa29409e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0d2210 con 0x7fa28c15dbe0 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.061+0000 7fa29409e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0b9420 con 0x7fa28c0d1020 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.061+0000 7fa291e3a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0b2cb0 0x7fa28c1f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.061+0000 7fa291e3a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0b2cb0 0x7fa28c1f3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37048/0 (socket says 172.21.15.172:37048) 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.061+0000 7fa291e3a640 1 -- 172.21.15.172:0/2055062786 learned_addr learned my addr 172.21.15.172:0/2055062786 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa29263b640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28c15dbe0 0x7fa28c15f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa291639640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa28c0d1020 0x7fa28c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa291e3a640 1 -- 172.21.15.172:0/2055062786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa28c0d1020 msgr2=0x7fa28c15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa291e3a640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa28c0d1020 0x7fa28c15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa291e3a640 1 -- 172.21.15.172:0/2055062786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28c15dbe0 msgr2=0x7fa28c15f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa291e3a640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28c15dbe0 0x7fa28c15f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa291e3a640 1 -- 172.21.15.172:0/2055062786 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0cad90 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa291e3a640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0b2cb0 0x7fa28c1f3710 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fa28800b3f0 tx=0x7fa28800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa2827fc640 1 -- 172.21.15.172:0/2055062786 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288015020 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa2827fc640 1 -- 172.21.15.172:0/2055062786 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa288011830 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa29409e640 1 -- 172.21.15.172:0/2055062786 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c0cb030 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa2827fc640 1 -- 172.21.15.172:0/2055062786 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288011c20 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.062+0000 7fa29409e640 1 -- 172.21.15.172:0/2055062786 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c0cb5f0 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.063+0000 7fa29409e640 1 -- 172.21.15.172:0/2055062786 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28c073990 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.063+0000 7fa2827fc640 1 -- 172.21.15.172:0/2055062786 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa288018020 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.064+0000 7fa2827fc640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa27006b4d0 0x7fa27006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.064+0000 7fa2827fc640 1 -- 172.21.15.172:0/2055062786 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa288089fb0 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.064+0000 7fa291639640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa27006b4d0 0x7fa27006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.064+0000 7fa291639640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa27006b4d0 0x7fa27006d990 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0cdb70 tx=0x7fa27c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:02.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.068+0000 7fa2827fc640 1 -- 172.21.15.172:0/2055062786 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa28801f030 con 0x7fa28c0b2cb0 2024-04-25T08:52:02.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.235+0000 7fa29409e640 1 -- 172.21.15.172:0/2055062786 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa28c159150 con 0x7fa27006b4d0 2024-04-25T08:52:02.231 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.241+0000 7fa2827fc640 1 -- 172.21.15.172:0/2055062786 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246181 (secure 0 0 0) 0x7fa28c159150 con 0x7fa27006b4d0 2024-04-25T08:52:02.234 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:02.236 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:52:02.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 -- 172.21.15.172:0/2055062786 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa27006b4d0 msgr2=0x7fa27006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa27006b4d0 0x7fa27006d990 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0cdb70 tx=0x7fa27c008040 comp rx=0 tx=0).stop 2024-04-25T08:52:02.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 -- 172.21.15.172:0/2055062786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0b2cb0 msgr2=0x7fa28c1f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0b2cb0 0x7fa28c1f3710 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fa28800b3f0 tx=0x7fa28800b8b0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 -- 172.21.15.172:0/2055062786 shutdown_connections 2024-04-25T08:52:02.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa27006b4d0 0x7fa27006d990 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa28c15dbe0 0x7fa28c15f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa28c0d1020 0x7fa28c15f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 --2- 172.21.15.172:0/2055062786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa28c0b2cb0 0x7fa28c1f3710 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 -- 172.21.15.172:0/2055062786 >> 172.21.15.172:0/2055062786 conn(0x7fa28c061a20 msgr2=0x7fa28c15cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:02.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 -- 172.21.15.172:0/2055062786 shutdown_connections 2024-04-25T08:52:02.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.244+0000 7fa29409e640 1 -- 172.21.15.172:0/2055062786 wait complete. 2024-04-25T08:52:02.245 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":428,"stamp":"2024-04-25T08:52:00.630467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":417144,"kb_used_data":14960,"kb_used_omap":12,"kb_used_meta":402035,"kb_avail":754557576,"statfs":{"total":773094113280,"available":772666957824,"internally_reserved":0,"allocated":15319040,"data_stored":7754836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":411684400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000983"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688285+0000","last_change":"2024-04-25T08:51:58.688022+0000","last_active":"2024-04-25T08:51:59.688285+0000","last_peered":"2024-04-25T08:51:59.688285+0000","last_clean":"2024-04-25T08:51:59.688285+0000","last_became_active":"2024-04-25T08:51:58.686734+0000","last_became_peered":"2024-04-25T08:51:58.686734+0000","last_unstale":"2024-04-25T08:51:59.688285+0000","last_undegraded":"2024-04-25T08:51:59.688285+0000","last_fullsized":"2024-04-25T08:51:59.688285+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695482+0000","last_change":"2024-04-25T08:51:58.694460+0000","last_active":"2024-04-25T08:51:58.695482+0000","last_peered":"2024-04-25T08:51:58.695482+0000","last_clean":"2024-04-25T08:51:58.695482+0000","last_became_active":"2024-04-25T08:51:58.694162+0000","last_became_peered":"2024-04-25T08:51:58.694162+0000","last_unstale":"2024-04-25T08:51:58.695482+0000","last_undegraded":"2024-04-25T08:51:58.695482+0000","last_fullsized":"2024-04-25T08:51:58.695482+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695518+0000","last_change":"2024-04-25T08:51:58.694784+0000","last_active":"2024-04-25T08:51:58.695518+0000","last_peered":"2024-04-25T08:51:58.695518+0000","last_clean":"2024-04-25T08:51:58.695518+0000","last_became_active":"2024-04-25T08:51:58.693953+0000","last_became_peered":"2024-04-25T08:51:58.693953+0000","last_unstale":"2024-04-25T08:51:58.695518+0000","last_undegraded":"2024-04-25T08:51:58.695518+0000","last_fullsized":"2024-04-25T08:51:58.695518+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:05.050389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683223+0000","last_change":"2024-04-25T08:51:58.680126+0000","last_active":"2024-04-25T08:51:58.683223+0000","last_peered":"2024-04-25T08:51:58.683223+0000","last_clean":"2024-04-25T08:51:58.683223+0000","last_became_active":"2024-04-25T08:51:58.679785+0000","last_became_peered":"2024-04-25T08:51:58.679785+0000","last_unstale":"2024-04-25T08:51:58.683223+0000","last_undegraded":"2024-04-25T08:51:58.683223+0000","last_fullsized":"2024-04-25T08:51:58.683223+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683103+0000","last_change":"2024-04-25T08:51:58.679533+0000","last_active":"2024-04-25T08:51:58.683103+0000","last_peered":"2024-04-25T08:51:58.683103+0000","last_clean":"2024-04-25T08:51:58.683103+0000","last_became_active":"2024-04-25T08:51:58.679241+0000","last_became_peered":"2024-04-25T08:51:58.679241+0000","last_unstale":"2024-04-25T08:51:58.683103+0000","last_undegraded":"2024-04-25T08:51:58.683103+0000","last_fullsized":"2024-04-25T08:51:58.683103+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.560714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687655+0000","last_change":"2024-04-25T08:51:58.679041+0000","last_active":"2024-04-25T08:51:59.687655+0000","last_peered":"2024-04-25T08:51:59.687655+0000","last_clean":"2024-04-25T08:51:59.687655+0000","last_became_active":"2024-04-25T08:51:58.678693+0000","last_became_peered":"2024-04-25T08:51:58.678693+0000","last_unstale":"2024-04-25T08:51:59.687655+0000","last_undegraded":"2024-04-25T08:51:59.687655+0000","last_fullsized":"2024-04-25T08:51:59.687655+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.560714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687566+0000","last_change":"2024-04-25T08:51:58.693136+0000","last_active":"2024-04-25T08:51:59.687566+0000","last_peered":"2024-04-25T08:51:59.687566+0000","last_clean":"2024-04-25T08:51:59.687566+0000","last_became_active":"2024-04-25T08:51:58.692738+0000","last_became_peered":"2024-04-25T08:51:58.692738+0000","last_unstale":"2024-04-25T08:51:59.687566+0000","last_undegraded":"2024-04-25T08:51:59.687566+0000","last_fullsized":"2024-04-25T08:51:59.687566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:00.190275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699456+0000","last_change":"2024-04-25T08:51:58.683484+0000","last_active":"2024-04-25T08:51:58.699456+0000","last_peered":"2024-04-25T08:51:58.699456+0000","last_clean":"2024-04-25T08:51:58.699456+0000","last_became_active":"2024-04-25T08:51:58.683162+0000","last_became_peered":"2024-04-25T08:51:58.683162+0000","last_unstale":"2024-04-25T08:51:58.699456+0000","last_undegraded":"2024-04-25T08:51:58.699456+0000","last_fullsized":"2024-04-25T08:51:58.699456+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699513+0000","last_change":"2024-04-25T08:51:58.694912+0000","last_active":"2024-04-25T08:51:58.699513+0000","last_peered":"2024-04-25T08:51:58.699513+0000","last_clean":"2024-04-25T08:51:58.699513+0000","last_became_active":"2024-04-25T08:51:58.694633+0000","last_became_peered":"2024-04-25T08:51:58.694633+0000","last_unstale":"2024-04-25T08:51:58.699513+0000","last_undegraded":"2024-04-25T08:51:58.699513+0000","last_fullsized":"2024-04-25T08:51:58.699513+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:20.954144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699718+0000","last_change":"2024-04-25T08:51:58.694404+0000","last_active":"2024-04-25T08:51:58.699718+0000","last_peered":"2024-04-25T08:51:58.699718+0000","last_clean":"2024-04-25T08:51:58.699718+0000","last_became_active":"2024-04-25T08:51:58.694118+0000","last_became_peered":"2024-04-25T08:51:58.694118+0000","last_unstale":"2024-04-25T08:51:58.699718+0000","last_undegraded":"2024-04-25T08:51:58.699718+0000","last_fullsized":"2024-04-25T08:51:58.699718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.862373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.700022+0000","last_change":"2024-04-25T08:51:58.697734+0000","last_active":"2024-04-25T08:51:58.700022+0000","last_peered":"2024-04-25T08:51:58.700022+0000","last_clean":"2024-04-25T08:51:58.700022+0000","last_became_active":"2024-04-25T08:51:58.697438+0000","last_became_peered":"2024-04-25T08:51:58.697438+0000","last_unstale":"2024-04-25T08:51:58.700022+0000","last_undegraded":"2024-04-25T08:51:58.700022+0000","last_fullsized":"2024-04-25T08:51:58.700022+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:43.145625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699508+0000","last_change":"2024-04-25T08:51:58.686864+0000","last_active":"2024-04-25T08:51:58.699508+0000","last_peered":"2024-04-25T08:51:58.699508+0000","last_clean":"2024-04-25T08:51:58.699508+0000","last_became_active":"2024-04-25T08:51:58.686600+0000","last_became_peered":"2024-04-25T08:51:58.686600+0000","last_unstale":"2024-04-25T08:51:58.699508+0000","last_undegraded":"2024-04-25T08:51:58.699508+0000","last_fullsized":"2024-04-25T08:51:58.699508+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683248+0000","last_change":"2024-04-25T08:51:58.680453+0000","last_active":"2024-04-25T08:51:58.683248+0000","last_peered":"2024-04-25T08:51:58.683248+0000","last_clean":"2024-04-25T08:51:58.683248+0000","last_became_active":"2024-04-25T08:51:58.680171+0000","last_became_peered":"2024-04-25T08:51:58.680171+0000","last_unstale":"2024-04-25T08:51:58.683248+0000","last_undegraded":"2024-04-25T08:51:58.683248+0000","last_fullsized":"2024-04-25T08:51:58.683248+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688623+0000","last_change":"2024-04-25T08:51:58.679406+0000","last_active":"2024-04-25T08:51:59.688623+0000","last_peered":"2024-04-25T08:51:59.688623+0000","last_clean":"2024-04-25T08:51:59.688623+0000","last_became_active":"2024-04-25T08:51:58.678753+0000","last_became_peered":"2024-04-25T08:51:58.678753+0000","last_unstale":"2024-04-25T08:51:59.688623+0000","last_undegraded":"2024-04-25T08:51:59.688623+0000","last_fullsized":"2024-04-25T08:51:59.688623+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687751+0000","last_change":"2024-04-25T08:51:58.690427+0000","last_active":"2024-04-25T08:51:59.687751+0000","last_peered":"2024-04-25T08:51:59.687751+0000","last_clean":"2024-04-25T08:51:59.687751+0000","last_became_active":"2024-04-25T08:51:58.690143+0000","last_became_peered":"2024-04-25T08:51:58.690143+0000","last_unstale":"2024-04-25T08:51:59.687751+0000","last_undegraded":"2024-04-25T08:51:59.687751+0000","last_fullsized":"2024-04-25T08:51:59.687751+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:07.849932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688390+0000","last_change":"2024-04-25T08:51:58.690909+0000","last_active":"2024-04-25T08:51:59.688390+0000","last_peered":"2024-04-25T08:51:59.688390+0000","last_clean":"2024-04-25T08:51:59.688390+0000","last_became_active":"2024-04-25T08:51:58.690625+0000","last_became_peered":"2024-04-25T08:51:58.690625+0000","last_unstale":"2024-04-25T08:51:59.688390+0000","last_undegraded":"2024-04-25T08:51:59.688390+0000","last_fullsized":"2024-04-25T08:51:59.688390+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688145+0000","last_change":"2024-04-25T08:51:58.691825+0000","last_active":"2024-04-25T08:51:59.688145+0000","last_peered":"2024-04-25T08:51:59.688145+0000","last_clean":"2024-04-25T08:51:59.688145+0000","last_became_active":"2024-04-25T08:51:58.688552+0000","last_became_peered":"2024-04-25T08:51:58.688552+0000","last_unstale":"2024-04-25T08:51:59.688145+0000","last_undegraded":"2024-04-25T08:51:59.688145+0000","last_fullsized":"2024-04-25T08:51:59.688145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:09.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699338+0000","last_change":"2024-04-25T08:51:58.686310+0000","last_active":"2024-04-25T08:51:58.699338+0000","last_peered":"2024-04-25T08:51:58.699338+0000","last_clean":"2024-04-25T08:51:58.699338+0000","last_became_active":"2024-04-25T08:51:58.685165+0000","last_became_peered":"2024-04-25T08:51:58.685165+0000","last_unstale":"2024-04-25T08:51:58.699338+0000","last_undegraded":"2024-04-25T08:51:58.699338+0000","last_fullsized":"2024-04-25T08:51:58.699338+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688664+0000","last_change":"2024-04-25T08:51:58.701180+0000","last_active":"2024-04-25T08:51:59.688664+0000","last_peered":"2024-04-25T08:51:59.688664+0000","last_clean":"2024-04-25T08:51:59.688664+0000","last_became_active":"2024-04-25T08:51:58.700888+0000","last_became_peered":"2024-04-25T08:51:58.700888+0000","last_unstale":"2024-04-25T08:51:59.688664+0000","last_undegraded":"2024-04-25T08:51:59.688664+0000","last_fullsized":"2024-04-25T08:51:59.688664+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699407+0000","last_change":"2024-04-25T08:51:58.687469+0000","last_active":"2024-04-25T08:51:58.699407+0000","last_peered":"2024-04-25T08:51:58.699407+0000","last_clean":"2024-04-25T08:51:58.699407+0000","last_became_active":"2024-04-25T08:51:58.687212+0000","last_became_peered":"2024-04-25T08:51:58.687212+0000","last_unstale":"2024-04-25T08:51:58.699407+0000","last_undegraded":"2024-04-25T08:51:58.699407+0000","last_fullsized":"2024-04-25T08:51:58.699407+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:54.079611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687732+0000","last_change":"2024-04-25T08:51:58.687508+0000","last_active":"2024-04-25T08:51:59.687732+0000","last_peered":"2024-04-25T08:51:59.687732+0000","last_clean":"2024-04-25T08:51:59.687732+0000","last_became_active":"2024-04-25T08:51:58.687248+0000","last_became_peered":"2024-04-25T08:51:58.687248+0000","last_unstale":"2024-04-25T08:51:59.687732+0000","last_undegraded":"2024-04-25T08:51:59.687732+0000","last_fullsized":"2024-04-25T08:51:59.687732+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:45.247106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.693011+0000","last_change":"2024-04-25T08:51:58.692141+0000","last_active":"2024-04-25T08:51:58.693011+0000","last_peered":"2024-04-25T08:51:58.693011+0000","last_clean":"2024-04-25T08:51:58.693011+0000","last_became_active":"2024-04-25T08:51:58.691300+0000","last_became_peered":"2024-04-25T08:51:58.691300+0000","last_unstale":"2024-04-25T08:51:58.693011+0000","last_undegraded":"2024-04-25T08:51:58.693011+0000","last_fullsized":"2024-04-25T08:51:58.693011+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"142'4","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.706805+0000","last_change":"2024-04-25T08:51:57.678935+0000","last_active":"2024-04-25T08:51:58.706805+0000","last_peered":"2024-04-25T08:51:58.706805+0000","last_clean":"2024-04-25T08:51:58.706805+0000","last_became_active":"2024-04-25T08:51:57.677554+0000","last_became_peered":"2024-04-25T08:51:57.677554+0000","last_unstale":"2024-04-25T08:51:58.706805+0000","last_undegraded":"2024-04-25T08:51:58.706805+0000","last_fullsized":"2024-04-25T08:51:58.706805+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:45.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695534+0000","last_change":"2024-04-25T08:51:58.694894+0000","last_active":"2024-04-25T08:51:58.695534+0000","last_peered":"2024-04-25T08:51:58.695534+0000","last_clean":"2024-04-25T08:51:58.695534+0000","last_became_active":"2024-04-25T08:51:58.694640+0000","last_became_peered":"2024-04-25T08:51:58.694640+0000","last_unstale":"2024-04-25T08:51:58.695534+0000","last_undegraded":"2024-04-25T08:51:58.695534+0000","last_fullsized":"2024-04-25T08:51:58.695534+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:07.037339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688298+0000","last_change":"2024-04-25T08:51:58.692557+0000","last_active":"2024-04-25T08:51:59.688298+0000","last_peered":"2024-04-25T08:51:59.688298+0000","last_clean":"2024-04-25T08:51:59.688298+0000","last_became_active":"2024-04-25T08:51:58.690870+0000","last_became_peered":"2024-04-25T08:51:58.690870+0000","last_unstale":"2024-04-25T08:51:59.688298+0000","last_undegraded":"2024-04-25T08:51:59.688298+0000","last_fullsized":"2024-04-25T08:51:59.688298+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.705507+0000","last_change":"2024-04-25T08:51:57.684784+0000","last_active":"2024-04-25T08:51:58.705507+0000","last_peered":"2024-04-25T08:51:58.705507+0000","last_clean":"2024-04-25T08:51:58.705507+0000","last_became_active":"2024-04-25T08:51:57.684270+0000","last_became_peered":"2024-04-25T08:51:57.684270+0000","last_unstale":"2024-04-25T08:51:58.705507+0000","last_undegraded":"2024-04-25T08:51:58.705507+0000","last_fullsized":"2024-04-25T08:51:58.705507+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:59.186072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688776+0000","last_change":"2024-04-25T08:51:57.681697+0000","last_active":"2024-04-25T08:51:59.688776+0000","last_peered":"2024-04-25T08:51:59.688776+0000","last_clean":"2024-04-25T08:51:59.688776+0000","last_became_active":"2024-04-25T08:51:57.681217+0000","last_became_peered":"2024-04-25T08:51:57.681217+0000","last_unstale":"2024-04-25T08:51:59.688776+0000","last_undegraded":"2024-04-25T08:51:59.688776+0000","last_fullsized":"2024-04-25T08:51:59.688776+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:22.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.705098+0000","last_change":"2024-04-25T08:51:57.679244+0000","last_active":"2024-04-25T08:51:58.705098+0000","last_peered":"2024-04-25T08:51:58.705098+0000","last_clean":"2024-04-25T08:51:58.705098+0000","last_became_active":"2024-04-25T08:51:57.677491+0000","last_became_peered":"2024-04-25T08:51:57.677491+0000","last_unstale":"2024-04-25T08:51:58.705098+0000","last_undegraded":"2024-04-25T08:51:58.705098+0000","last_fullsized":"2024-04-25T08:51:58.705098+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:46.158444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.691912+0000","last_change":"2024-04-25T08:51:58.688383+0000","last_active":"2024-04-25T08:51:58.691912+0000","last_peered":"2024-04-25T08:51:58.691912+0000","last_clean":"2024-04-25T08:51:58.691912+0000","last_became_active":"2024-04-25T08:51:58.688072+0000","last_became_peered":"2024-04-25T08:51:58.688072+0000","last_unstale":"2024-04-25T08:51:58.691912+0000","last_undegraded":"2024-04-25T08:51:58.691912+0000","last_fullsized":"2024-04-25T08:51:58.691912+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687761+0000","last_change":"2024-04-25T08:51:57.679918+0000","last_active":"2024-04-25T08:51:59.687761+0000","last_peered":"2024-04-25T08:51:59.687761+0000","last_clean":"2024-04-25T08:51:59.687761+0000","last_became_active":"2024-04-25T08:51:57.679656+0000","last_became_peered":"2024-04-25T08:51:57.679656+0000","last_unstale":"2024-04-25T08:51:59.687761+0000","last_undegraded":"2024-04-25T08:51:59.687761+0000","last_fullsized":"2024-04-25T08:51:59.687761+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:40.337985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687569+0000","last_change":"2024-04-25T08:51:58.691560+0000","last_active":"2024-04-25T08:51:59.687569+0000","last_peered":"2024-04-25T08:51:59.687569+0000","last_clean":"2024-04-25T08:51:59.687569+0000","last_became_active":"2024-04-25T08:51:58.688811+0000","last_became_peered":"2024-04-25T08:51:58.688811+0000","last_unstale":"2024-04-25T08:51:59.687569+0000","last_undegraded":"2024-04-25T08:51:59.687569+0000","last_fullsized":"2024-04-25T08:51:59.687569+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:21.032824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.675061+0000","last_change":"2024-04-25T08:51:57.675383+0000","last_active":"2024-04-25T08:51:58.675061+0000","last_peered":"2024-04-25T08:51:58.675061+0000","last_clean":"2024-04-25T08:51:58.675061+0000","last_became_active":"2024-04-25T08:51:57.675111+0000","last_became_peered":"2024-04-25T08:51:57.675111+0000","last_unstale":"2024-04-25T08:51:58.675061+0000","last_undegraded":"2024-04-25T08:51:58.675061+0000","last_fullsized":"2024-04-25T08:51:58.675061+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:03.764385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688370+0000","last_change":"2024-04-25T08:51:58.690638+0000","last_active":"2024-04-25T08:51:59.688370+0000","last_peered":"2024-04-25T08:51:59.688370+0000","last_clean":"2024-04-25T08:51:59.688370+0000","last_became_active":"2024-04-25T08:51:58.690364+0000","last_became_peered":"2024-04-25T08:51:58.690364+0000","last_unstale":"2024-04-25T08:51:59.688370+0000","last_undegraded":"2024-04-25T08:51:59.688370+0000","last_fullsized":"2024-04-25T08:51:59.688370+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688885+0000","last_change":"2024-04-25T08:51:57.679237+0000","last_active":"2024-04-25T08:51:59.688885+0000","last_peered":"2024-04-25T08:51:59.688885+0000","last_clean":"2024-04-25T08:51:59.688885+0000","last_became_active":"2024-04-25T08:51:57.678926+0000","last_became_peered":"2024-04-25T08:51:57.678926+0000","last_unstale":"2024-04-25T08:51:59.688885+0000","last_undegraded":"2024-04-25T08:51:59.688885+0000","last_fullsized":"2024-04-25T08:51:59.688885+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:25.169115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687906+0000","last_change":"2024-04-25T08:51:58.691366+0000","last_active":"2024-04-25T08:51:59.687906+0000","last_peered":"2024-04-25T08:51:59.687906+0000","last_clean":"2024-04-25T08:51:59.687906+0000","last_became_active":"2024-04-25T08:51:58.689980+0000","last_became_peered":"2024-04-25T08:51:58.689980+0000","last_unstale":"2024-04-25T08:51:59.687906+0000","last_undegraded":"2024-04-25T08:51:59.687906+0000","last_fullsized":"2024-04-25T08:51:59.687906+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.707119+0000","last_change":"2024-04-25T08:51:57.679370+0000","last_active":"2024-04-25T08:51:58.707119+0000","last_peered":"2024-04-25T08:51:58.707119+0000","last_clean":"2024-04-25T08:51:58.707119+0000","last_became_active":"2024-04-25T08:51:57.678638+0000","last_became_peered":"2024-04-25T08:51:57.678638+0000","last_unstale":"2024-04-25T08:51:58.707119+0000","last_undegraded":"2024-04-25T08:51:58.707119+0000","last_fullsized":"2024-04-25T08:51:58.707119+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:20.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.692782+0000","last_change":"2024-04-25T08:51:58.691999+0000","last_active":"2024-04-25T08:51:58.692782+0000","last_peered":"2024-04-25T08:51:58.692782+0000","last_clean":"2024-04-25T08:51:58.692782+0000","last_became_active":"2024-04-25T08:51:58.691704+0000","last_became_peered":"2024-04-25T08:51:58.691704+0000","last_unstale":"2024-04-25T08:51:58.692782+0000","last_undegraded":"2024-04-25T08:51:58.692782+0000","last_fullsized":"2024-04-25T08:51:58.692782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699329+0000","last_change":"2024-04-25T08:51:58.684758+0000","last_active":"2024-04-25T08:51:58.699329+0000","last_peered":"2024-04-25T08:51:58.699329+0000","last_clean":"2024-04-25T08:51:58.699329+0000","last_became_active":"2024-04-25T08:51:58.684486+0000","last_became_peered":"2024-04-25T08:51:58.684486+0000","last_unstale":"2024-04-25T08:51:58.699329+0000","last_undegraded":"2024-04-25T08:51:58.699329+0000","last_fullsized":"2024-04-25T08:51:58.699329+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.687914+0000","last_change":"2024-04-25T08:51:58.686307+0000","last_active":"2024-04-25T08:51:58.687914+0000","last_peered":"2024-04-25T08:51:58.687914+0000","last_clean":"2024-04-25T08:51:58.687914+0000","last_became_active":"2024-04-25T08:51:58.685998+0000","last_became_peered":"2024-04-25T08:51:58.685998+0000","last_unstale":"2024-04-25T08:51:58.687914+0000","last_undegraded":"2024-04-25T08:51:58.687914+0000","last_fullsized":"2024-04-25T08:51:58.687914+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"142'8","reported_seq":22,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687356+0000","last_change":"2024-04-25T08:51:57.674597+0000","last_active":"2024-04-25T08:51:59.687356+0000","last_peered":"2024-04-25T08:51:59.687356+0000","last_clean":"2024-04-25T08:51:59.687356+0000","last_became_active":"2024-04-25T08:51:57.674343+0000","last_became_peered":"2024-04-25T08:51:57.674343+0000","last_unstale":"2024-04-25T08:51:59.687356+0000","last_undegraded":"2024-04-25T08:51:59.687356+0000","last_fullsized":"2024-04-25T08:51:59.687356+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:42.141421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688764+0000","last_change":"2024-04-25T08:51:58.694109+0000","last_active":"2024-04-25T08:51:59.688764+0000","last_peered":"2024-04-25T08:51:59.688764+0000","last_clean":"2024-04-25T08:51:59.688764+0000","last_became_active":"2024-04-25T08:51:58.693751+0000","last_became_peered":"2024-04-25T08:51:58.693751+0000","last_unstale":"2024-04-25T08:51:59.688764+0000","last_undegraded":"2024-04-25T08:51:59.688764+0000","last_fullsized":"2024-04-25T08:51:59.688764+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.704800+0000","last_change":"2024-04-25T08:51:57.681447+0000","last_active":"2024-04-25T08:51:58.704800+0000","last_peered":"2024-04-25T08:51:58.704800+0000","last_clean":"2024-04-25T08:51:58.704800+0000","last_became_active":"2024-04-25T08:51:57.680908+0000","last_became_peered":"2024-04-25T08:51:57.680908+0000","last_unstale":"2024-04-25T08:51:58.704800+0000","last_undegraded":"2024-04-25T08:51:58.704800+0000","last_fullsized":"2024-04-25T08:51:58.704800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:44.242903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688440+0000","last_change":"2024-04-25T08:51:58.692191+0000","last_active":"2024-04-25T08:51:59.688440+0000","last_peered":"2024-04-25T08:51:59.688440+0000","last_clean":"2024-04-25T08:51:59.688440+0000","last_became_active":"2024-04-25T08:51:58.691907+0000","last_became_peered":"2024-04-25T08:51:58.691907+0000","last_unstale":"2024-04-25T08:51:59.688440+0000","last_undegraded":"2024-04-25T08:51:59.688440+0000","last_fullsized":"2024-04-25T08:51:59.688440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.691958+0000","last_change":"2024-04-25T08:51:58.690815+0000","last_active":"2024-04-25T08:51:58.691958+0000","last_peered":"2024-04-25T08:51:58.691958+0000","last_clean":"2024-04-25T08:51:58.691958+0000","last_became_active":"2024-04-25T08:51:58.689859+0000","last_became_peered":"2024-04-25T08:51:58.689859+0000","last_unstale":"2024-04-25T08:51:58.691958+0000","last_undegraded":"2024-04-25T08:51:58.691958+0000","last_fullsized":"2024-04-25T08:51:58.691958+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687554+0000","last_change":"2024-04-25T08:51:57.683172+0000","last_active":"2024-04-25T08:51:59.687554+0000","last_peered":"2024-04-25T08:51:59.687554+0000","last_clean":"2024-04-25T08:51:59.687554+0000","last_became_active":"2024-04-25T08:51:57.682905+0000","last_became_peered":"2024-04-25T08:51:57.682905+0000","last_unstale":"2024-04-25T08:51:59.687554+0000","last_undegraded":"2024-04-25T08:51:59.687554+0000","last_fullsized":"2024-04-25T08:51:59.687554+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.724725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699526+0000","last_change":"2024-04-25T08:51:58.698210+0000","last_active":"2024-04-25T08:51:58.699526+0000","last_peered":"2024-04-25T08:51:58.699526+0000","last_clean":"2024-04-25T08:51:58.699526+0000","last_became_active":"2024-04-25T08:51:58.697934+0000","last_became_peered":"2024-04-25T08:51:58.697934+0000","last_unstale":"2024-04-25T08:51:58.699526+0000","last_undegraded":"2024-04-25T08:51:58.699526+0000","last_fullsized":"2024-04-25T08:51:58.699526+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:41.342188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688698+0000","last_change":"2024-04-25T08:51:57.684696+0000","last_active":"2024-04-25T08:51:59.688698+0000","last_peered":"2024-04-25T08:51:59.688698+0000","last_clean":"2024-04-25T08:51:59.688698+0000","last_became_active":"2024-04-25T08:51:57.684380+0000","last_became_peered":"2024-04-25T08:51:57.684380+0000","last_unstale":"2024-04-25T08:51:59.688698+0000","last_undegraded":"2024-04-25T08:51:59.688698+0000","last_fullsized":"2024-04-25T08:51:59.688698+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:58.013246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683413+0000","last_change":"2024-04-25T08:51:58.679751+0000","last_active":"2024-04-25T08:51:58.683413+0000","last_peered":"2024-04-25T08:51:58.683413+0000","last_clean":"2024-04-25T08:51:58.683413+0000","last_became_active":"2024-04-25T08:51:58.679472+0000","last_became_peered":"2024-04-25T08:51:58.679472+0000","last_unstale":"2024-04-25T08:51:58.683413+0000","last_undegraded":"2024-04-25T08:51:58.683413+0000","last_fullsized":"2024-04-25T08:51:58.683413+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:09.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"143'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.701616+0000","last_change":"2024-04-25T08:51:57.683105+0000","last_active":"2024-04-25T08:51:59.701616+0000","last_peered":"2024-04-25T08:51:59.701616+0000","last_clean":"2024-04-25T08:51:59.701616+0000","last_became_active":"2024-04-25T08:51:57.682754+0000","last_became_peered":"2024-04-25T08:51:57.682754+0000","last_unstale":"2024-04-25T08:51:59.701616+0000","last_undegraded":"2024-04-25T08:51:59.701616+0000","last_fullsized":"2024-04-25T08:51:59.701616+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:39.113507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688828+0000","last_change":"2024-04-25T08:51:58.693432+0000","last_active":"2024-04-25T08:51:59.688828+0000","last_peered":"2024-04-25T08:51:59.688828+0000","last_clean":"2024-04-25T08:51:59.688828+0000","last_became_active":"2024-04-25T08:51:58.691780+0000","last_became_peered":"2024-04-25T08:51:58.691780+0000","last_unstale":"2024-04-25T08:51:59.688828+0000","last_undegraded":"2024-04-25T08:51:59.688828+0000","last_fullsized":"2024-04-25T08:51:59.688828+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.681577+0000","last_change":"2024-04-25T08:51:57.684558+0000","last_active":"2024-04-25T08:51:58.681577+0000","last_peered":"2024-04-25T08:51:58.681577+0000","last_clean":"2024-04-25T08:51:58.681577+0000","last_became_active":"2024-04-25T08:51:57.684293+0000","last_became_peered":"2024-04-25T08:51:57.684293+0000","last_unstale":"2024-04-25T08:51:58.681577+0000","last_undegraded":"2024-04-25T08:51:58.681577+0000","last_fullsized":"2024-04-25T08:51:58.681577+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:06.845729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699477+0000","last_change":"2024-04-25T08:51:58.693635+0000","last_active":"2024-04-25T08:51:58.699477+0000","last_peered":"2024-04-25T08:51:58.699477+0000","last_clean":"2024-04-25T08:51:58.699477+0000","last_became_active":"2024-04-25T08:51:58.693270+0000","last_became_peered":"2024-04-25T08:51:58.693270+0000","last_unstale":"2024-04-25T08:51:58.699477+0000","last_undegraded":"2024-04-25T08:51:58.699477+0000","last_fullsized":"2024-04-25T08:51:58.699477+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:50.949573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.676047+0000","last_change":"2024-04-25T08:51:57.681906+0000","last_active":"2024-04-25T08:51:58.676047+0000","last_peered":"2024-04-25T08:51:58.676047+0000","last_clean":"2024-04-25T08:51:58.676047+0000","last_became_active":"2024-04-25T08:51:57.681578+0000","last_became_peered":"2024-04-25T08:51:57.681578+0000","last_unstale":"2024-04-25T08:51:58.676047+0000","last_undegraded":"2024-04-25T08:51:58.676047+0000","last_fullsized":"2024-04-25T08:51:58.676047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:21.385739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688362+0000","last_change":"2024-04-25T08:51:58.691133+0000","last_active":"2024-04-25T08:51:59.688362+0000","last_peered":"2024-04-25T08:51:59.688362+0000","last_clean":"2024-04-25T08:51:59.688362+0000","last_became_active":"2024-04-25T08:51:58.690826+0000","last_became_peered":"2024-04-25T08:51:58.690826+0000","last_unstale":"2024-04-25T08:51:59.688362+0000","last_undegraded":"2024-04-25T08:51:59.688362+0000","last_fullsized":"2024-04-25T08:51:59.688362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687676+0000","last_change":"2024-04-25T08:51:57.673573+0000","last_active":"2024-04-25T08:51:59.687676+0000","last_peered":"2024-04-25T08:51:59.687676+0000","last_clean":"2024-04-25T08:51:59.687676+0000","last_became_active":"2024-04-25T08:51:57.673302+0000","last_became_peered":"2024-04-25T08:51:57.673302+0000","last_unstale":"2024-04-25T08:51:59.687676+0000","last_undegraded":"2024-04-25T08:51:59.687676+0000","last_fullsized":"2024-04-25T08:51:59.687676+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:22.616954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.688536+0000","last_change":"2024-04-25T08:51:58.686967+0000","last_active":"2024-04-25T08:51:58.688536+0000","last_peered":"2024-04-25T08:51:58.688536+0000","last_clean":"2024-04-25T08:51:58.688536+0000","last_became_active":"2024-04-25T08:51:58.686651+0000","last_became_peered":"2024-04-25T08:51:58.686651+0000","last_unstale":"2024-04-25T08:51:58.688536+0000","last_undegraded":"2024-04-25T08:51:58.688536+0000","last_fullsized":"2024-04-25T08:51:58.688536+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687877+0000","last_change":"2024-04-25T08:51:57.679212+0000","last_active":"2024-04-25T08:51:59.687877+0000","last_peered":"2024-04-25T08:51:59.687877+0000","last_clean":"2024-04-25T08:51:59.687877+0000","last_became_active":"2024-04-25T08:51:57.678913+0000","last_became_peered":"2024-04-25T08:51:57.678913+0000","last_unstale":"2024-04-25T08:51:59.687877+0000","last_undegraded":"2024-04-25T08:51:59.687877+0000","last_fullsized":"2024-04-25T08:51:59.687877+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:18.043975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688665+0000","last_change":"2024-04-25T08:51:58.702307+0000","last_active":"2024-04-25T08:51:59.688665+0000","last_peered":"2024-04-25T08:51:59.688665+0000","last_clean":"2024-04-25T08:51:59.688665+0000","last_became_active":"2024-04-25T08:51:58.702035+0000","last_became_peered":"2024-04-25T08:51:58.702035+0000","last_unstale":"2024-04-25T08:51:59.688665+0000","last_undegraded":"2024-04-25T08:51:59.688665+0000","last_fullsized":"2024-04-25T08:51:59.688665+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688096+0000","last_change":"2024-04-25T08:51:58.695857+0000","last_active":"2024-04-25T08:51:59.688096+0000","last_peered":"2024-04-25T08:51:59.688096+0000","last_clean":"2024-04-25T08:51:59.688096+0000","last_became_active":"2024-04-25T08:51:58.695470+0000","last_became_peered":"2024-04-25T08:51:58.695470+0000","last_unstale":"2024-04-25T08:51:59.688096+0000","last_undegraded":"2024-04-25T08:51:59.688096+0000","last_fullsized":"2024-04-25T08:51:59.688096+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":388,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-25T08:51:54.813522+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:51:54.813522+0000","last_peered":"2024-04-25T08:51:54.813522+0000","last_clean":"2024-04-25T08:51:54.813522+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:51:54.813522+0000","last_undegraded":"2024-04-25T08:51:54.813522+0000","last_fullsized":"2024-04-25T08:51:54.813522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":4},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":34,"acting":34,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51520,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320320,"statfs":{"total":96636764160,"available":96584007680,"internally_reserved":0,"allocated":2338816,"data_stored":1401546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50932,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320908,"statfs":{"total":96636764160,"available":96584609792,"internally_reserved":0,"allocated":1744896,"data_stored":811178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46824,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325016,"statfs":{"total":96636764160,"available":96588816384,"internally_reserved":0,"allocated":1794048,"data_stored":837913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1806336,"data_stored":839525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59304,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312536,"statfs":{"total":96636764160,"available":96576036864,"internally_reserved":0,"allocated":1789952,"data_stored":831837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50924,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320916,"statfs":{"total":96636764160,"available":96584617984,"internally_reserved":0,"allocated":1732608,"data_stored":805589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":831291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2326528,"data_stored":1395957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:52:02.251 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:52:02.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.393+0000 7f5e3c68f640 1 Processor -- start 2024-04-25T08:52:02.384 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.393+0000 7f5e3c68f640 1 -- start start 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.394+0000 7f5e3c68f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5e34154ee0 0x7f5e340cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.394+0000 7f5e3c68f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e340ce590 0x7f5e3406d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.394+0000 7f5e3c68f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e34071480 con 0x7f5e340cfcf0 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.394+0000 7f5e3c68f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e34072090 con 0x7f5e34154ee0 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.394+0000 7f5e3c68f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34071230 con 0x7f5e340ce590 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.394+0000 7f5e3a42b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5e34154ee0 0x7f5e340cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.394+0000 7f5e39c2a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5e340cfcf0 0x7f5e340cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40458/0 (socket says 172.21.15.172:40458) 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.394+0000 7f5e39c2a640 1 -- 172.21.15.172:0/3407330609 learned_addr learned my addr 172.21.15.172:0/3407330609 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.394+0000 7f5e3a42b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5e34154ee0 0x7f5e340cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37054/0 (socket says 172.21.15.172:37054) 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.395+0000 7f5e3a42b640 1 -- 172.21.15.172:0/3407330609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e340ce590 msgr2=0x7f5e3406d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.395+0000 7f5e3a42b640 1 --2- 172.21.15.172:0/3407330609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e340ce590 0x7f5e3406d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.395+0000 7f5e3a42b640 1 -- 172.21.15.172:0/3407330609 >> v1:172.21.15.172:6789/0 conn(0x7f5e340cfcf0 legacy=0x7f5e340cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.387 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.395+0000 7f5e39429640 1 -- 172.21.15.172:0/3407330609 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264615194 0 0) 0x7f5e34071480 con 0x7f5e340cfcf0 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.395+0000 7f5e3a42b640 1 -- 172.21.15.172:0/3407330609 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34071760 con 0x7f5e34154ee0 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.395+0000 7f5e3a42b640 1 --2- 172.21.15.172:0/3407330609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34154ee0 0x7f5e340cf7b0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009d90 tx=0x7f5e3002c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02089beefe9d03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.395+0000 7f5e39429640 1 -- 172.21.15.172:0/3407330609 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30032770 con 0x7f5e34154ee0 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.395+0000 7f5e39429640 1 -- 172.21.15.172:0/3407330609 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e30038070 con 0x7f5e34154ee0 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.395+0000 7f5e39429640 1 -- 172.21.15.172:0/3407330609 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30032b30 con 0x7f5e34154ee0 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.396+0000 7f5e3c68f640 1 -- 172.21.15.172:0/3407330609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34154ee0 msgr2=0x7f5e340cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.396+0000 7f5e3c68f640 1 --2- 172.21.15.172:0/3407330609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34154ee0 0x7f5e340cf7b0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009d90 tx=0x7f5e3002c870 comp rx=0 tx=0).stop 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.396+0000 7f5e3c68f640 1 -- 172.21.15.172:0/3407330609 shutdown_connections 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.396+0000 7f5e3c68f640 1 --2- 172.21.15.172:0/3407330609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e340ce590 0x7f5e3406d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.396+0000 7f5e3c68f640 1 --2- 172.21.15.172:0/3407330609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e34154ee0 0x7f5e340cf7b0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.396+0000 7f5e3c68f640 1 -- 172.21.15.172:0/3407330609 >> 172.21.15.172:0/3407330609 conn(0x7f5e3406abe0 msgr2=0x7f5e3406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.396+0000 7f5e3c68f640 1 -- 172.21.15.172:0/3407330609 shutdown_connections 2024-04-25T08:52:02.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.396+0000 7f5e3c68f640 1 -- 172.21.15.172:0/3407330609 wait complete. 2024-04-25T08:52:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.397+0000 7f5e3c68f640 1 Processor -- start 2024-04-25T08:52:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.397+0000 7f5e3c68f640 1 -- start start 2024-04-25T08:52:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3c68f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340ce590 0x7f5e34146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3c68f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e340cfcf0 0x7f5e3415c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.391 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3c68f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e34154ee0 0x7f5e3415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3c68f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e341552c0 con 0x7f5e340ce590 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3c68f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34071d20 con 0x7f5e34154ee0 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3c68f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34155440 con 0x7f5e340cfcf0 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3a42b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340ce590 0x7f5e34146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3a42b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340ce590 0x7f5e34146f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37066/0 (socket says 172.21.15.172:37066) 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3a42b640 1 -- 172.21.15.172:0/2849249611 learned_addr learned my addr 172.21.15.172:0/2849249611 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3a42b640 1 -- 172.21.15.172:0/2849249611 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e340cfcf0 msgr2=0x7f5e3415c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3a42b640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e340cfcf0 0x7f5e3415c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3a42b640 1 -- 172.21.15.172:0/2849249611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e34154ee0 msgr2=0x7f5e3415ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3a42b640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e34154ee0 0x7f5e3415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.398+0000 7f5e3a42b640 1 -- 172.21.15.172:0/2849249611 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e341f3600 con 0x7f5e340ce590 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.399+0000 7f5e3a42b640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340ce590 0x7f5e34146f70 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009d90 tx=0x7f5e30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.399+0000 7f5e2affd640 1 -- 172.21.15.172:0/2849249611 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30033810 con 0x7f5e340ce590 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.399+0000 7f5e2affd640 1 -- 172.21.15.172:0/2849249611 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e300339f0 con 0x7f5e340ce590 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.399+0000 7f5e3c68f640 1 -- 172.21.15.172:0/2849249611 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e341ef510 con 0x7f5e340ce590 2024-04-25T08:52:02.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.399+0000 7f5e2affd640 1 -- 172.21.15.172:0/2849249611 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30033de0 con 0x7f5e340ce590 2024-04-25T08:52:02.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.399+0000 7f5e3c68f640 1 -- 172.21.15.172:0/2849249611 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e341efad0 con 0x7f5e340ce590 2024-04-25T08:52:02.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.400+0000 7f5e3c68f640 1 -- 172.21.15.172:0/2849249611 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e34073990 con 0x7f5e340ce590 2024-04-25T08:52:02.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.400+0000 7f5e2affd640 1 -- 172.21.15.172:0/2849249611 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e30005d10 con 0x7f5e340ce590 2024-04-25T08:52:02.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.400+0000 7f5e2affd640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e1806b4d0 0x7f5e1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.401+0000 7f5e2affd640 1 -- 172.21.15.172:0/2849249611 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5e300ad020 con 0x7f5e340ce590 2024-04-25T08:52:02.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.401+0000 7f5e39c2a640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e1806b4d0 0x7f5e1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.401+0000 7f5e39c2a640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e1806b4d0 0x7f5e1806d990 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5e24007fd0 tx=0x7f5e24007900 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:02.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.405+0000 7f5e2affd640 1 -- 172.21.15.172:0/2849249611 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e30042070 con 0x7f5e340ce590 2024-04-25T08:52:02.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.573+0000 7f5e3c68f640 1 -- 172.21.15.172:0/2849249611 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e3406d360 con 0x7f5e1806b4d0 2024-04-25T08:52:02.568 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.578+0000 7f5e2affd640 1 -- 172.21.15.172:0/2849249611 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246181 (secure 0 0 0) 0x7f5e3406d360 con 0x7f5e1806b4d0 2024-04-25T08:52:02.571 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:02.573 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:52:02.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 -- 172.21.15.172:0/2849249611 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e1806b4d0 msgr2=0x7f5e1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.574 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e1806b4d0 0x7f5e1806d990 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5e24007fd0 tx=0x7f5e24007900 comp rx=0 tx=0).stop 2024-04-25T08:52:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 -- 172.21.15.172:0/2849249611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340ce590 msgr2=0x7f5e34146f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340ce590 0x7f5e34146f70 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009d90 tx=0x7f5e30004a40 comp rx=0 tx=0).stop 2024-04-25T08:52:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 -- 172.21.15.172:0/2849249611 shutdown_connections 2024-04-25T08:52:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5e1806b4d0 0x7f5e1806d990 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e34154ee0 0x7f5e3415ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5e340cfcf0 0x7f5e3415c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 --2- 172.21.15.172:0/2849249611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e340ce590 0x7f5e34146f70 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 -- 172.21.15.172:0/2849249611 >> 172.21.15.172:0/2849249611 conn(0x7f5e3406abe0 msgr2=0x7f5e3406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.581+0000 7f5e3c68f640 1 -- 172.21.15.172:0/2849249611 shutdown_connections 2024-04-25T08:52:02.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.582+0000 7f5e3c68f640 1 -- 172.21.15.172:0/2849249611 wait complete. 2024-04-25T08:52:02.583 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":428,"stamp":"2024-04-25T08:52:00.630467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":417144,"kb_used_data":14960,"kb_used_omap":12,"kb_used_meta":402035,"kb_avail":754557576,"statfs":{"total":773094113280,"available":772666957824,"internally_reserved":0,"allocated":15319040,"data_stored":7754836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":411684400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000983"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688285+0000","last_change":"2024-04-25T08:51:58.688022+0000","last_active":"2024-04-25T08:51:59.688285+0000","last_peered":"2024-04-25T08:51:59.688285+0000","last_clean":"2024-04-25T08:51:59.688285+0000","last_became_active":"2024-04-25T08:51:58.686734+0000","last_became_peered":"2024-04-25T08:51:58.686734+0000","last_unstale":"2024-04-25T08:51:59.688285+0000","last_undegraded":"2024-04-25T08:51:59.688285+0000","last_fullsized":"2024-04-25T08:51:59.688285+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695482+0000","last_change":"2024-04-25T08:51:58.694460+0000","last_active":"2024-04-25T08:51:58.695482+0000","last_peered":"2024-04-25T08:51:58.695482+0000","last_clean":"2024-04-25T08:51:58.695482+0000","last_became_active":"2024-04-25T08:51:58.694162+0000","last_became_peered":"2024-04-25T08:51:58.694162+0000","last_unstale":"2024-04-25T08:51:58.695482+0000","last_undegraded":"2024-04-25T08:51:58.695482+0000","last_fullsized":"2024-04-25T08:51:58.695482+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695518+0000","last_change":"2024-04-25T08:51:58.694784+0000","last_active":"2024-04-25T08:51:58.695518+0000","last_peered":"2024-04-25T08:51:58.695518+0000","last_clean":"2024-04-25T08:51:58.695518+0000","last_became_active":"2024-04-25T08:51:58.693953+0000","last_became_peered":"2024-04-25T08:51:58.693953+0000","last_unstale":"2024-04-25T08:51:58.695518+0000","last_undegraded":"2024-04-25T08:51:58.695518+0000","last_fullsized":"2024-04-25T08:51:58.695518+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:05.050389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683223+0000","last_change":"2024-04-25T08:51:58.680126+0000","last_active":"2024-04-25T08:51:58.683223+0000","last_peered":"2024-04-25T08:51:58.683223+0000","last_clean":"2024-04-25T08:51:58.683223+0000","last_became_active":"2024-04-25T08:51:58.679785+0000","last_became_peered":"2024-04-25T08:51:58.679785+0000","last_unstale":"2024-04-25T08:51:58.683223+0000","last_undegraded":"2024-04-25T08:51:58.683223+0000","last_fullsized":"2024-04-25T08:51:58.683223+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683103+0000","last_change":"2024-04-25T08:51:58.679533+0000","last_active":"2024-04-25T08:51:58.683103+0000","last_peered":"2024-04-25T08:51:58.683103+0000","last_clean":"2024-04-25T08:51:58.683103+0000","last_became_active":"2024-04-25T08:51:58.679241+0000","last_became_peered":"2024-04-25T08:51:58.679241+0000","last_unstale":"2024-04-25T08:51:58.683103+0000","last_undegraded":"2024-04-25T08:51:58.683103+0000","last_fullsized":"2024-04-25T08:51:58.683103+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.560714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687655+0000","last_change":"2024-04-25T08:51:58.679041+0000","last_active":"2024-04-25T08:51:59.687655+0000","last_peered":"2024-04-25T08:51:59.687655+0000","last_clean":"2024-04-25T08:51:59.687655+0000","last_became_active":"2024-04-25T08:51:58.678693+0000","last_became_peered":"2024-04-25T08:51:58.678693+0000","last_unstale":"2024-04-25T08:51:59.687655+0000","last_undegraded":"2024-04-25T08:51:59.687655+0000","last_fullsized":"2024-04-25T08:51:59.687655+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.560714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687566+0000","last_change":"2024-04-25T08:51:58.693136+0000","last_active":"2024-04-25T08:51:59.687566+0000","last_peered":"2024-04-25T08:51:59.687566+0000","last_clean":"2024-04-25T08:51:59.687566+0000","last_became_active":"2024-04-25T08:51:58.692738+0000","last_became_peered":"2024-04-25T08:51:58.692738+0000","last_unstale":"2024-04-25T08:51:59.687566+0000","last_undegraded":"2024-04-25T08:51:59.687566+0000","last_fullsized":"2024-04-25T08:51:59.687566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:00.190275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699456+0000","last_change":"2024-04-25T08:51:58.683484+0000","last_active":"2024-04-25T08:51:58.699456+0000","last_peered":"2024-04-25T08:51:58.699456+0000","last_clean":"2024-04-25T08:51:58.699456+0000","last_became_active":"2024-04-25T08:51:58.683162+0000","last_became_peered":"2024-04-25T08:51:58.683162+0000","last_unstale":"2024-04-25T08:51:58.699456+0000","last_undegraded":"2024-04-25T08:51:58.699456+0000","last_fullsized":"2024-04-25T08:51:58.699456+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699513+0000","last_change":"2024-04-25T08:51:58.694912+0000","last_active":"2024-04-25T08:51:58.699513+0000","last_peered":"2024-04-25T08:51:58.699513+0000","last_clean":"2024-04-25T08:51:58.699513+0000","last_became_active":"2024-04-25T08:51:58.694633+0000","last_became_peered":"2024-04-25T08:51:58.694633+0000","last_unstale":"2024-04-25T08:51:58.699513+0000","last_undegraded":"2024-04-25T08:51:58.699513+0000","last_fullsized":"2024-04-25T08:51:58.699513+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:20.954144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699718+0000","last_change":"2024-04-25T08:51:58.694404+0000","last_active":"2024-04-25T08:51:58.699718+0000","last_peered":"2024-04-25T08:51:58.699718+0000","last_clean":"2024-04-25T08:51:58.699718+0000","last_became_active":"2024-04-25T08:51:58.694118+0000","last_became_peered":"2024-04-25T08:51:58.694118+0000","last_unstale":"2024-04-25T08:51:58.699718+0000","last_undegraded":"2024-04-25T08:51:58.699718+0000","last_fullsized":"2024-04-25T08:51:58.699718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.862373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.700022+0000","last_change":"2024-04-25T08:51:58.697734+0000","last_active":"2024-04-25T08:51:58.700022+0000","last_peered":"2024-04-25T08:51:58.700022+0000","last_clean":"2024-04-25T08:51:58.700022+0000","last_became_active":"2024-04-25T08:51:58.697438+0000","last_became_peered":"2024-04-25T08:51:58.697438+0000","last_unstale":"2024-04-25T08:51:58.700022+0000","last_undegraded":"2024-04-25T08:51:58.700022+0000","last_fullsized":"2024-04-25T08:51:58.700022+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:43.145625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699508+0000","last_change":"2024-04-25T08:51:58.686864+0000","last_active":"2024-04-25T08:51:58.699508+0000","last_peered":"2024-04-25T08:51:58.699508+0000","last_clean":"2024-04-25T08:51:58.699508+0000","last_became_active":"2024-04-25T08:51:58.686600+0000","last_became_peered":"2024-04-25T08:51:58.686600+0000","last_unstale":"2024-04-25T08:51:58.699508+0000","last_undegraded":"2024-04-25T08:51:58.699508+0000","last_fullsized":"2024-04-25T08:51:58.699508+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683248+0000","last_change":"2024-04-25T08:51:58.680453+0000","last_active":"2024-04-25T08:51:58.683248+0000","last_peered":"2024-04-25T08:51:58.683248+0000","last_clean":"2024-04-25T08:51:58.683248+0000","last_became_active":"2024-04-25T08:51:58.680171+0000","last_became_peered":"2024-04-25T08:51:58.680171+0000","last_unstale":"2024-04-25T08:51:58.683248+0000","last_undegraded":"2024-04-25T08:51:58.683248+0000","last_fullsized":"2024-04-25T08:51:58.683248+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688623+0000","last_change":"2024-04-25T08:51:58.679406+0000","last_active":"2024-04-25T08:51:59.688623+0000","last_peered":"2024-04-25T08:51:59.688623+0000","last_clean":"2024-04-25T08:51:59.688623+0000","last_became_active":"2024-04-25T08:51:58.678753+0000","last_became_peered":"2024-04-25T08:51:58.678753+0000","last_unstale":"2024-04-25T08:51:59.688623+0000","last_undegraded":"2024-04-25T08:51:59.688623+0000","last_fullsized":"2024-04-25T08:51:59.688623+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687751+0000","last_change":"2024-04-25T08:51:58.690427+0000","last_active":"2024-04-25T08:51:59.687751+0000","last_peered":"2024-04-25T08:51:59.687751+0000","last_clean":"2024-04-25T08:51:59.687751+0000","last_became_active":"2024-04-25T08:51:58.690143+0000","last_became_peered":"2024-04-25T08:51:58.690143+0000","last_unstale":"2024-04-25T08:51:59.687751+0000","last_undegraded":"2024-04-25T08:51:59.687751+0000","last_fullsized":"2024-04-25T08:51:59.687751+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:07.849932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688390+0000","last_change":"2024-04-25T08:51:58.690909+0000","last_active":"2024-04-25T08:51:59.688390+0000","last_peered":"2024-04-25T08:51:59.688390+0000","last_clean":"2024-04-25T08:51:59.688390+0000","last_became_active":"2024-04-25T08:51:58.690625+0000","last_became_peered":"2024-04-25T08:51:58.690625+0000","last_unstale":"2024-04-25T08:51:59.688390+0000","last_undegraded":"2024-04-25T08:51:59.688390+0000","last_fullsized":"2024-04-25T08:51:59.688390+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688145+0000","last_change":"2024-04-25T08:51:58.691825+0000","last_active":"2024-04-25T08:51:59.688145+0000","last_peered":"2024-04-25T08:51:59.688145+0000","last_clean":"2024-04-25T08:51:59.688145+0000","last_became_active":"2024-04-25T08:51:58.688552+0000","last_became_peered":"2024-04-25T08:51:58.688552+0000","last_unstale":"2024-04-25T08:51:59.688145+0000","last_undegraded":"2024-04-25T08:51:59.688145+0000","last_fullsized":"2024-04-25T08:51:59.688145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:09.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699338+0000","last_change":"2024-04-25T08:51:58.686310+0000","last_active":"2024-04-25T08:51:58.699338+0000","last_peered":"2024-04-25T08:51:58.699338+0000","last_clean":"2024-04-25T08:51:58.699338+0000","last_became_active":"2024-04-25T08:51:58.685165+0000","last_became_peered":"2024-04-25T08:51:58.685165+0000","last_unstale":"2024-04-25T08:51:58.699338+0000","last_undegraded":"2024-04-25T08:51:58.699338+0000","last_fullsized":"2024-04-25T08:51:58.699338+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688664+0000","last_change":"2024-04-25T08:51:58.701180+0000","last_active":"2024-04-25T08:51:59.688664+0000","last_peered":"2024-04-25T08:51:59.688664+0000","last_clean":"2024-04-25T08:51:59.688664+0000","last_became_active":"2024-04-25T08:51:58.700888+0000","last_became_peered":"2024-04-25T08:51:58.700888+0000","last_unstale":"2024-04-25T08:51:59.688664+0000","last_undegraded":"2024-04-25T08:51:59.688664+0000","last_fullsized":"2024-04-25T08:51:59.688664+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699407+0000","last_change":"2024-04-25T08:51:58.687469+0000","last_active":"2024-04-25T08:51:58.699407+0000","last_peered":"2024-04-25T08:51:58.699407+0000","last_clean":"2024-04-25T08:51:58.699407+0000","last_became_active":"2024-04-25T08:51:58.687212+0000","last_became_peered":"2024-04-25T08:51:58.687212+0000","last_unstale":"2024-04-25T08:51:58.699407+0000","last_undegraded":"2024-04-25T08:51:58.699407+0000","last_fullsized":"2024-04-25T08:51:58.699407+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:54.079611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687732+0000","last_change":"2024-04-25T08:51:58.687508+0000","last_active":"2024-04-25T08:51:59.687732+0000","last_peered":"2024-04-25T08:51:59.687732+0000","last_clean":"2024-04-25T08:51:59.687732+0000","last_became_active":"2024-04-25T08:51:58.687248+0000","last_became_peered":"2024-04-25T08:51:58.687248+0000","last_unstale":"2024-04-25T08:51:59.687732+0000","last_undegraded":"2024-04-25T08:51:59.687732+0000","last_fullsized":"2024-04-25T08:51:59.687732+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:45.247106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.693011+0000","last_change":"2024-04-25T08:51:58.692141+0000","last_active":"2024-04-25T08:51:58.693011+0000","last_peered":"2024-04-25T08:51:58.693011+0000","last_clean":"2024-04-25T08:51:58.693011+0000","last_became_active":"2024-04-25T08:51:58.691300+0000","last_became_peered":"2024-04-25T08:51:58.691300+0000","last_unstale":"2024-04-25T08:51:58.693011+0000","last_undegraded":"2024-04-25T08:51:58.693011+0000","last_fullsized":"2024-04-25T08:51:58.693011+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"142'4","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.706805+0000","last_change":"2024-04-25T08:51:57.678935+0000","last_active":"2024-04-25T08:51:58.706805+0000","last_peered":"2024-04-25T08:51:58.706805+0000","last_clean":"2024-04-25T08:51:58.706805+0000","last_became_active":"2024-04-25T08:51:57.677554+0000","last_became_peered":"2024-04-25T08:51:57.677554+0000","last_unstale":"2024-04-25T08:51:58.706805+0000","last_undegraded":"2024-04-25T08:51:58.706805+0000","last_fullsized":"2024-04-25T08:51:58.706805+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:45.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695534+0000","last_change":"2024-04-25T08:51:58.694894+0000","last_active":"2024-04-25T08:51:58.695534+0000","last_peered":"2024-04-25T08:51:58.695534+0000","last_clean":"2024-04-25T08:51:58.695534+0000","last_became_active":"2024-04-25T08:51:58.694640+0000","last_became_peered":"2024-04-25T08:51:58.694640+0000","last_unstale":"2024-04-25T08:51:58.695534+0000","last_undegraded":"2024-04-25T08:51:58.695534+0000","last_fullsized":"2024-04-25T08:51:58.695534+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:07.037339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688298+0000","last_change":"2024-04-25T08:51:58.692557+0000","last_active":"2024-04-25T08:51:59.688298+0000","last_peered":"2024-04-25T08:51:59.688298+0000","last_clean":"2024-04-25T08:51:59.688298+0000","last_became_active":"2024-04-25T08:51:58.690870+0000","last_became_peered":"2024-04-25T08:51:58.690870+0000","last_unstale":"2024-04-25T08:51:59.688298+0000","last_undegraded":"2024-04-25T08:51:59.688298+0000","last_fullsized":"2024-04-25T08:51:59.688298+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.705507+0000","last_change":"2024-04-25T08:51:57.684784+0000","last_active":"2024-04-25T08:51:58.705507+0000","last_peered":"2024-04-25T08:51:58.705507+0000","last_clean":"2024-04-25T08:51:58.705507+0000","last_became_active":"2024-04-25T08:51:57.684270+0000","last_became_peered":"2024-04-25T08:51:57.684270+0000","last_unstale":"2024-04-25T08:51:58.705507+0000","last_undegraded":"2024-04-25T08:51:58.705507+0000","last_fullsized":"2024-04-25T08:51:58.705507+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:59.186072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688776+0000","last_change":"2024-04-25T08:51:57.681697+0000","last_active":"2024-04-25T08:51:59.688776+0000","last_peered":"2024-04-25T08:51:59.688776+0000","last_clean":"2024-04-25T08:51:59.688776+0000","last_became_active":"2024-04-25T08:51:57.681217+0000","last_became_peered":"2024-04-25T08:51:57.681217+0000","last_unstale":"2024-04-25T08:51:59.688776+0000","last_undegraded":"2024-04-25T08:51:59.688776+0000","last_fullsized":"2024-04-25T08:51:59.688776+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:22.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.705098+0000","last_change":"2024-04-25T08:51:57.679244+0000","last_active":"2024-04-25T08:51:58.705098+0000","last_peered":"2024-04-25T08:51:58.705098+0000","last_clean":"2024-04-25T08:51:58.705098+0000","last_became_active":"2024-04-25T08:51:57.677491+0000","last_became_peered":"2024-04-25T08:51:57.677491+0000","last_unstale":"2024-04-25T08:51:58.705098+0000","last_undegraded":"2024-04-25T08:51:58.705098+0000","last_fullsized":"2024-04-25T08:51:58.705098+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:46.158444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.691912+0000","last_change":"2024-04-25T08:51:58.688383+0000","last_active":"2024-04-25T08:51:58.691912+0000","last_peered":"2024-04-25T08:51:58.691912+0000","last_clean":"2024-04-25T08:51:58.691912+0000","last_became_active":"2024-04-25T08:51:58.688072+0000","last_became_peered":"2024-04-25T08:51:58.688072+0000","last_unstale":"2024-04-25T08:51:58.691912+0000","last_undegraded":"2024-04-25T08:51:58.691912+0000","last_fullsized":"2024-04-25T08:51:58.691912+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687761+0000","last_change":"2024-04-25T08:51:57.679918+0000","last_active":"2024-04-25T08:51:59.687761+0000","last_peered":"2024-04-25T08:51:59.687761+0000","last_clean":"2024-04-25T08:51:59.687761+0000","last_became_active":"2024-04-25T08:51:57.679656+0000","last_became_peered":"2024-04-25T08:51:57.679656+0000","last_unstale":"2024-04-25T08:51:59.687761+0000","last_undegraded":"2024-04-25T08:51:59.687761+0000","last_fullsized":"2024-04-25T08:51:59.687761+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:40.337985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687569+0000","last_change":"2024-04-25T08:51:58.691560+0000","last_active":"2024-04-25T08:51:59.687569+0000","last_peered":"2024-04-25T08:51:59.687569+0000","last_clean":"2024-04-25T08:51:59.687569+0000","last_became_active":"2024-04-25T08:51:58.688811+0000","last_became_peered":"2024-04-25T08:51:58.688811+0000","last_unstale":"2024-04-25T08:51:59.687569+0000","last_undegraded":"2024-04-25T08:51:59.687569+0000","last_fullsized":"2024-04-25T08:51:59.687569+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:21.032824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.675061+0000","last_change":"2024-04-25T08:51:57.675383+0000","last_active":"2024-04-25T08:51:58.675061+0000","last_peered":"2024-04-25T08:51:58.675061+0000","last_clean":"2024-04-25T08:51:58.675061+0000","last_became_active":"2024-04-25T08:51:57.675111+0000","last_became_peered":"2024-04-25T08:51:57.675111+0000","last_unstale":"2024-04-25T08:51:58.675061+0000","last_undegraded":"2024-04-25T08:51:58.675061+0000","last_fullsized":"2024-04-25T08:51:58.675061+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:03.764385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688370+0000","last_change":"2024-04-25T08:51:58.690638+0000","last_active":"2024-04-25T08:51:59.688370+0000","last_peered":"2024-04-25T08:51:59.688370+0000","last_clean":"2024-04-25T08:51:59.688370+0000","last_became_active":"2024-04-25T08:51:58.690364+0000","last_became_peered":"2024-04-25T08:51:58.690364+0000","last_unstale":"2024-04-25T08:51:59.688370+0000","last_undegraded":"2024-04-25T08:51:59.688370+0000","last_fullsized":"2024-04-25T08:51:59.688370+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688885+0000","last_change":"2024-04-25T08:51:57.679237+0000","last_active":"2024-04-25T08:51:59.688885+0000","last_peered":"2024-04-25T08:51:59.688885+0000","last_clean":"2024-04-25T08:51:59.688885+0000","last_became_active":"2024-04-25T08:51:57.678926+0000","last_became_peered":"2024-04-25T08:51:57.678926+0000","last_unstale":"2024-04-25T08:51:59.688885+0000","last_undegraded":"2024-04-25T08:51:59.688885+0000","last_fullsized":"2024-04-25T08:51:59.688885+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:25.169115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687906+0000","last_change":"2024-04-25T08:51:58.691366+0000","last_active":"2024-04-25T08:51:59.687906+0000","last_peered":"2024-04-25T08:51:59.687906+0000","last_clean":"2024-04-25T08:51:59.687906+0000","last_became_active":"2024-04-25T08:51:58.689980+0000","last_became_peered":"2024-04-25T08:51:58.689980+0000","last_unstale":"2024-04-25T08:51:59.687906+0000","last_undegraded":"2024-04-25T08:51:59.687906+0000","last_fullsized":"2024-04-25T08:51:59.687906+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.707119+0000","last_change":"2024-04-25T08:51:57.679370+0000","last_active":"2024-04-25T08:51:58.707119+0000","last_peered":"2024-04-25T08:51:58.707119+0000","last_clean":"2024-04-25T08:51:58.707119+0000","last_became_active":"2024-04-25T08:51:57.678638+0000","last_became_peered":"2024-04-25T08:51:57.678638+0000","last_unstale":"2024-04-25T08:51:58.707119+0000","last_undegraded":"2024-04-25T08:51:58.707119+0000","last_fullsized":"2024-04-25T08:51:58.707119+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:20.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.692782+0000","last_change":"2024-04-25T08:51:58.691999+0000","last_active":"2024-04-25T08:51:58.692782+0000","last_peered":"2024-04-25T08:51:58.692782+0000","last_clean":"2024-04-25T08:51:58.692782+0000","last_became_active":"2024-04-25T08:51:58.691704+0000","last_became_peered":"2024-04-25T08:51:58.691704+0000","last_unstale":"2024-04-25T08:51:58.692782+0000","last_undegraded":"2024-04-25T08:51:58.692782+0000","last_fullsized":"2024-04-25T08:51:58.692782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699329+0000","last_change":"2024-04-25T08:51:58.684758+0000","last_active":"2024-04-25T08:51:58.699329+0000","last_peered":"2024-04-25T08:51:58.699329+0000","last_clean":"2024-04-25T08:51:58.699329+0000","last_became_active":"2024-04-25T08:51:58.684486+0000","last_became_peered":"2024-04-25T08:51:58.684486+0000","last_unstale":"2024-04-25T08:51:58.699329+0000","last_undegraded":"2024-04-25T08:51:58.699329+0000","last_fullsized":"2024-04-25T08:51:58.699329+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.687914+0000","last_change":"2024-04-25T08:51:58.686307+0000","last_active":"2024-04-25T08:51:58.687914+0000","last_peered":"2024-04-25T08:51:58.687914+0000","last_clean":"2024-04-25T08:51:58.687914+0000","last_became_active":"2024-04-25T08:51:58.685998+0000","last_became_peered":"2024-04-25T08:51:58.685998+0000","last_unstale":"2024-04-25T08:51:58.687914+0000","last_undegraded":"2024-04-25T08:51:58.687914+0000","last_fullsized":"2024-04-25T08:51:58.687914+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"142'8","reported_seq":22,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687356+0000","last_change":"2024-04-25T08:51:57.674597+0000","last_active":"2024-04-25T08:51:59.687356+0000","last_peered":"2024-04-25T08:51:59.687356+0000","last_clean":"2024-04-25T08:51:59.687356+0000","last_became_active":"2024-04-25T08:51:57.674343+0000","last_became_peered":"2024-04-25T08:51:57.674343+0000","last_unstale":"2024-04-25T08:51:59.687356+0000","last_undegraded":"2024-04-25T08:51:59.687356+0000","last_fullsized":"2024-04-25T08:51:59.687356+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:42.141421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688764+0000","last_change":"2024-04-25T08:51:58.694109+0000","last_active":"2024-04-25T08:51:59.688764+0000","last_peered":"2024-04-25T08:51:59.688764+0000","last_clean":"2024-04-25T08:51:59.688764+0000","last_became_active":"2024-04-25T08:51:58.693751+0000","last_became_peered":"2024-04-25T08:51:58.693751+0000","last_unstale":"2024-04-25T08:51:59.688764+0000","last_undegraded":"2024-04-25T08:51:59.688764+0000","last_fullsized":"2024-04-25T08:51:59.688764+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.704800+0000","last_change":"2024-04-25T08:51:57.681447+0000","last_active":"2024-04-25T08:51:58.704800+0000","last_peered":"2024-04-25T08:51:58.704800+0000","last_clean":"2024-04-25T08:51:58.704800+0000","last_became_active":"2024-04-25T08:51:57.680908+0000","last_became_peered":"2024-04-25T08:51:57.680908+0000","last_unstale":"2024-04-25T08:51:58.704800+0000","last_undegraded":"2024-04-25T08:51:58.704800+0000","last_fullsized":"2024-04-25T08:51:58.704800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:44.242903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688440+0000","last_change":"2024-04-25T08:51:58.692191+0000","last_active":"2024-04-25T08:51:59.688440+0000","last_peered":"2024-04-25T08:51:59.688440+0000","last_clean":"2024-04-25T08:51:59.688440+0000","last_became_active":"2024-04-25T08:51:58.691907+0000","last_became_peered":"2024-04-25T08:51:58.691907+0000","last_unstale":"2024-04-25T08:51:59.688440+0000","last_undegraded":"2024-04-25T08:51:59.688440+0000","last_fullsized":"2024-04-25T08:51:59.688440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.691958+0000","last_change":"2024-04-25T08:51:58.690815+0000","last_active":"2024-04-25T08:51:58.691958+0000","last_peered":"2024-04-25T08:51:58.691958+0000","last_clean":"2024-04-25T08:51:58.691958+0000","last_became_active":"2024-04-25T08:51:58.689859+0000","last_became_peered":"2024-04-25T08:51:58.689859+0000","last_unstale":"2024-04-25T08:51:58.691958+0000","last_undegraded":"2024-04-25T08:51:58.691958+0000","last_fullsized":"2024-04-25T08:51:58.691958+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687554+0000","last_change":"2024-04-25T08:51:57.683172+0000","last_active":"2024-04-25T08:51:59.687554+0000","last_peered":"2024-04-25T08:51:59.687554+0000","last_clean":"2024-04-25T08:51:59.687554+0000","last_became_active":"2024-04-25T08:51:57.682905+0000","last_became_peered":"2024-04-25T08:51:57.682905+0000","last_unstale":"2024-04-25T08:51:59.687554+0000","last_undegraded":"2024-04-25T08:51:59.687554+0000","last_fullsized":"2024-04-25T08:51:59.687554+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.724725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699526+0000","last_change":"2024-04-25T08:51:58.698210+0000","last_active":"2024-04-25T08:51:58.699526+0000","last_peered":"2024-04-25T08:51:58.699526+0000","last_clean":"2024-04-25T08:51:58.699526+0000","last_became_active":"2024-04-25T08:51:58.697934+0000","last_became_peered":"2024-04-25T08:51:58.697934+0000","last_unstale":"2024-04-25T08:51:58.699526+0000","last_undegraded":"2024-04-25T08:51:58.699526+0000","last_fullsized":"2024-04-25T08:51:58.699526+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:41.342188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688698+0000","last_change":"2024-04-25T08:51:57.684696+0000","last_active":"2024-04-25T08:51:59.688698+0000","last_peered":"2024-04-25T08:51:59.688698+0000","last_clean":"2024-04-25T08:51:59.688698+0000","last_became_active":"2024-04-25T08:51:57.684380+0000","last_became_peered":"2024-04-25T08:51:57.684380+0000","last_unstale":"2024-04-25T08:51:59.688698+0000","last_undegraded":"2024-04-25T08:51:59.688698+0000","last_fullsized":"2024-04-25T08:51:59.688698+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:58.013246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683413+0000","last_change":"2024-04-25T08:51:58.679751+0000","last_active":"2024-04-25T08:51:58.683413+0000","last_peered":"2024-04-25T08:51:58.683413+0000","last_clean":"2024-04-25T08:51:58.683413+0000","last_became_active":"2024-04-25T08:51:58.679472+0000","last_became_peered":"2024-04-25T08:51:58.679472+0000","last_unstale":"2024-04-25T08:51:58.683413+0000","last_undegraded":"2024-04-25T08:51:58.683413+0000","last_fullsized":"2024-04-25T08:51:58.683413+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:09.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"143'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.701616+0000","last_change":"2024-04-25T08:51:57.683105+0000","last_active":"2024-04-25T08:51:59.701616+0000","last_peered":"2024-04-25T08:51:59.701616+0000","last_clean":"2024-04-25T08:51:59.701616+0000","last_became_active":"2024-04-25T08:51:57.682754+0000","last_became_peered":"2024-04-25T08:51:57.682754+0000","last_unstale":"2024-04-25T08:51:59.701616+0000","last_undegraded":"2024-04-25T08:51:59.701616+0000","last_fullsized":"2024-04-25T08:51:59.701616+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:39.113507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688828+0000","last_change":"2024-04-25T08:51:58.693432+0000","last_active":"2024-04-25T08:51:59.688828+0000","last_peered":"2024-04-25T08:51:59.688828+0000","last_clean":"2024-04-25T08:51:59.688828+0000","last_became_active":"2024-04-25T08:51:58.691780+0000","last_became_peered":"2024-04-25T08:51:58.691780+0000","last_unstale":"2024-04-25T08:51:59.688828+0000","last_undegraded":"2024-04-25T08:51:59.688828+0000","last_fullsized":"2024-04-25T08:51:59.688828+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.681577+0000","last_change":"2024-04-25T08:51:57.684558+0000","last_active":"2024-04-25T08:51:58.681577+0000","last_peered":"2024-04-25T08:51:58.681577+0000","last_clean":"2024-04-25T08:51:58.681577+0000","last_became_active":"2024-04-25T08:51:57.684293+0000","last_became_peered":"2024-04-25T08:51:57.684293+0000","last_unstale":"2024-04-25T08:51:58.681577+0000","last_undegraded":"2024-04-25T08:51:58.681577+0000","last_fullsized":"2024-04-25T08:51:58.681577+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:06.845729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699477+0000","last_change":"2024-04-25T08:51:58.693635+0000","last_active":"2024-04-25T08:51:58.699477+0000","last_peered":"2024-04-25T08:51:58.699477+0000","last_clean":"2024-04-25T08:51:58.699477+0000","last_became_active":"2024-04-25T08:51:58.693270+0000","last_became_peered":"2024-04-25T08:51:58.693270+0000","last_unstale":"2024-04-25T08:51:58.699477+0000","last_undegraded":"2024-04-25T08:51:58.699477+0000","last_fullsized":"2024-04-25T08:51:58.699477+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:50.949573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.676047+0000","last_change":"2024-04-25T08:51:57.681906+0000","last_active":"2024-04-25T08:51:58.676047+0000","last_peered":"2024-04-25T08:51:58.676047+0000","last_clean":"2024-04-25T08:51:58.676047+0000","last_became_active":"2024-04-25T08:51:57.681578+0000","last_became_peered":"2024-04-25T08:51:57.681578+0000","last_unstale":"2024-04-25T08:51:58.676047+0000","last_undegraded":"2024-04-25T08:51:58.676047+0000","last_fullsized":"2024-04-25T08:51:58.676047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:21.385739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688362+0000","last_change":"2024-04-25T08:51:58.691133+0000","last_active":"2024-04-25T08:51:59.688362+0000","last_peered":"2024-04-25T08:51:59.688362+0000","last_clean":"2024-04-25T08:51:59.688362+0000","last_became_active":"2024-04-25T08:51:58.690826+0000","last_became_peered":"2024-04-25T08:51:58.690826+0000","last_unstale":"2024-04-25T08:51:59.688362+0000","last_undegraded":"2024-04-25T08:51:59.688362+0000","last_fullsized":"2024-04-25T08:51:59.688362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687676+0000","last_change":"2024-04-25T08:51:57.673573+0000","last_active":"2024-04-25T08:51:59.687676+0000","last_peered":"2024-04-25T08:51:59.687676+0000","last_clean":"2024-04-25T08:51:59.687676+0000","last_became_active":"2024-04-25T08:51:57.673302+0000","last_became_peered":"2024-04-25T08:51:57.673302+0000","last_unstale":"2024-04-25T08:51:59.687676+0000","last_undegraded":"2024-04-25T08:51:59.687676+0000","last_fullsized":"2024-04-25T08:51:59.687676+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:22.616954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:57.660175+0000","last_change":"2024-04-25T08:51:57.660175+0000","last_active":"2024-04-25T08:51:57.660175+0000","last_peered":"2024-04-25T08:51:57.660175+0000","last_clean":"2024-04-25T08:51:57.660175+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:57.660175+0000","last_undegraded":"2024-04-25T08:51:57.660175+0000","last_fullsized":"2024-04-25T08:51:57.660175+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.688536+0000","last_change":"2024-04-25T08:51:58.686967+0000","last_active":"2024-04-25T08:51:58.688536+0000","last_peered":"2024-04-25T08:51:58.688536+0000","last_clean":"2024-04-25T08:51:58.688536+0000","last_became_active":"2024-04-25T08:51:58.686651+0000","last_became_peered":"2024-04-25T08:51:58.686651+0000","last_unstale":"2024-04-25T08:51:58.688536+0000","last_undegraded":"2024-04-25T08:51:58.688536+0000","last_fullsized":"2024-04-25T08:51:58.688536+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687877+0000","last_change":"2024-04-25T08:51:57.679212+0000","last_active":"2024-04-25T08:51:59.687877+0000","last_peered":"2024-04-25T08:51:59.687877+0000","last_clean":"2024-04-25T08:51:59.687877+0000","last_became_active":"2024-04-25T08:51:57.678913+0000","last_became_peered":"2024-04-25T08:51:57.678913+0000","last_unstale":"2024-04-25T08:51:59.687877+0000","last_undegraded":"2024-04-25T08:51:59.687877+0000","last_fullsized":"2024-04-25T08:51:59.687877+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:18.043975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688665+0000","last_change":"2024-04-25T08:51:58.702307+0000","last_active":"2024-04-25T08:51:59.688665+0000","last_peered":"2024-04-25T08:51:59.688665+0000","last_clean":"2024-04-25T08:51:59.688665+0000","last_became_active":"2024-04-25T08:51:58.702035+0000","last_became_peered":"2024-04-25T08:51:58.702035+0000","last_unstale":"2024-04-25T08:51:59.688665+0000","last_undegraded":"2024-04-25T08:51:59.688665+0000","last_fullsized":"2024-04-25T08:51:59.688665+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688096+0000","last_change":"2024-04-25T08:51:58.695857+0000","last_active":"2024-04-25T08:51:59.688096+0000","last_peered":"2024-04-25T08:51:59.688096+0000","last_clean":"2024-04-25T08:51:59.688096+0000","last_became_active":"2024-04-25T08:51:58.695470+0000","last_became_peered":"2024-04-25T08:51:58.695470+0000","last_unstale":"2024-04-25T08:51:59.688096+0000","last_undegraded":"2024-04-25T08:51:59.688096+0000","last_fullsized":"2024-04-25T08:51:59.688096+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T08:51:56.655972+0000","last_change":"2024-04-25T08:51:56.655972+0000","last_active":"2024-04-25T08:51:56.655972+0000","last_peered":"2024-04-25T08:51:56.655972+0000","last_clean":"2024-04-25T08:51:56.655972+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T08:51:56.655972+0000","last_undegraded":"2024-04-25T08:51:56.655972+0000","last_fullsized":"2024-04-25T08:51:56.655972+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":388,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-25T08:51:54.813522+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:51:54.813522+0000","last_peered":"2024-04-25T08:51:54.813522+0000","last_clean":"2024-04-25T08:51:54.813522+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:51:54.813522+0000","last_undegraded":"2024-04-25T08:51:54.813522+0000","last_fullsized":"2024-04-25T08:51:54.813522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":4},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":34,"acting":34,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51520,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320320,"statfs":{"total":96636764160,"available":96584007680,"internally_reserved":0,"allocated":2338816,"data_stored":1401546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50932,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320908,"statfs":{"total":96636764160,"available":96584609792,"internally_reserved":0,"allocated":1744896,"data_stored":811178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46824,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325016,"statfs":{"total":96636764160,"available":96588816384,"internally_reserved":0,"allocated":1794048,"data_stored":837913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1806336,"data_stored":839525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59304,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312536,"statfs":{"total":96636764160,"available":96576036864,"internally_reserved":0,"allocated":1789952,"data_stored":831837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50924,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320916,"statfs":{"total":96636764160,"available":96584617984,"internally_reserved":0,"allocated":1732608,"data_stored":805589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":831291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2326528,"data_stored":1395957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:52:02.587 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:52:02.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.732+0000 7fa2692c4640 1 Processor -- start 2024-04-25T08:52:02.722 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.732+0000 7fa2692c4640 1 -- start start 2024-04-25T08:52:02.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.732+0000 7fa2692c4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa2640b2cb0 0x7fa2640d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.724 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.732+0000 7fa2692c4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa2640d1020 0x7fa2640d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.732+0000 7fa2692c4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2640b97a0 con 0x7fa26415dbe0 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.732+0000 7fa2692c4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26415dfc0 con 0x7fa2640b2cb0 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.732+0000 7fa2692c4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2640d1a00 con 0x7fa2640d1020 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.733+0000 7fa2627fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa2640b2cb0 0x7fa2640d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.733+0000 7fa2627fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa2640b2cb0 0x7fa2640d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37068/0 (socket says 172.21.15.172:37068) 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.733+0000 7fa2627fc640 1 -- 172.21.15.172:0/2234341651 learned_addr learned my addr 172.21.15.172:0/2234341651 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.733+0000 7fa2637fe640 1 --2- 172.21.15.172:0/2234341651 >> v2:172.21.15.186:3300/0 conn(0x7fa2640d1020 0x7fa2640d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.733+0000 7fa2627fc640 1 -- 172.21.15.172:0/2234341651 >> v2:172.21.15.186:3300/0 conn(0x7fa2640d1020 msgr2=0x7fa2640d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.733+0000 7fa2627fc640 1 --2- 172.21.15.172:0/2234341651 >> v2:172.21.15.186:3300/0 conn(0x7fa2640d1020 0x7fa2640d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.733+0000 7fa2627fc640 1 -- 172.21.15.172:0/2234341651 >> v1:172.21.15.186:6789/0 conn(0x7fa26415dbe0 legacy=0x7fa2640d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.733+0000 7fa2627fc640 1 -- 172.21.15.172:0/2234341651 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640d1c50 con 0x7fa2640b2cb0 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.733+0000 7fa2627fc640 1 --2- 172.21.15.172:0/2234341651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 0x7fa2640d2730 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fa2640cf570 tx=0x7fa25802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f3a5021de07c4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:02.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa261ffb640 1 -- 172.21.15.172:0/2234341651 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258037070 con 0x7fa2640b2cb0 2024-04-25T08:52:02.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa261ffb640 1 -- 172.21.15.172:0/2234341651 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258032440 con 0x7fa2640b2cb0 2024-04-25T08:52:02.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa261ffb640 1 -- 172.21.15.172:0/2234341651 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258032810 con 0x7fa2640b2cb0 2024-04-25T08:52:02.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa2692c4640 1 -- 172.21.15.172:0/2234341651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 msgr2=0x7fa2640d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa2692c4640 1 --2- 172.21.15.172:0/2234341651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 0x7fa2640d2730 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fa2640cf570 tx=0x7fa25802a230 comp rx=0 tx=0).stop 2024-04-25T08:52:02.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa2692c4640 1 -- 172.21.15.172:0/2234341651 shutdown_connections 2024-04-25T08:52:02.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa2692c4640 1 --2- 172.21.15.172:0/2234341651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 0x7fa2640d2730 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa2692c4640 1 --2- 172.21.15.172:0/2234341651 >> v2:172.21.15.186:3300/0 conn(0x7fa2640d1020 0x7fa2640d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa2692c4640 1 -- 172.21.15.172:0/2234341651 >> 172.21.15.172:0/2234341651 conn(0x7fa264061a20 msgr2=0x7fa264061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:02.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa2692c4640 1 -- 172.21.15.172:0/2234341651 shutdown_connections 2024-04-25T08:52:02.726 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.734+0000 7fa2692c4640 1 -- 172.21.15.172:0/2234341651 wait complete. 2024-04-25T08:52:02.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.735+0000 7fa2692c4640 1 Processor -- start 2024-04-25T08:52:02.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa2692c4640 1 -- start start 2024-04-25T08:52:02.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa2692c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 0x7fa2641520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.729 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa2692c4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2640d1020 0x7fa264160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa2692c4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26415dbe0 0x7fa2640b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa2692c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2640b92a0 con 0x7fa2640b2cb0 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa2692c4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2640d2210 con 0x7fa26415dbe0 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa2692c4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2640b9420 con 0x7fa2640d1020 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa262ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 0x7fa2641520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa262ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 0x7fa2641520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37082/0 (socket says 172.21.15.172:37082) 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa262ffd640 1 -- 172.21.15.172:0/1259342056 learned_addr learned my addr 172.21.15.172:0/1259342056 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa2637fe640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26415dbe0 0x7fa2640b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.736+0000 7fa2627fc640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2640d1020 0x7fa264160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa262ffd640 1 -- 172.21.15.172:0/1259342056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2640d1020 msgr2=0x7fa264160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa262ffd640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2640d1020 0x7fa264160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa262ffd640 1 -- 172.21.15.172:0/1259342056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26415dbe0 msgr2=0x7fa2640b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.730 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa262ffd640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26415dbe0 0x7fa2640b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa262ffd640 1 -- 172.21.15.172:0/1259342056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640b36e0 con 0x7fa2640b2cb0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa2627fc640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2640d1020 0x7fa264160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa2637fe640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26415dbe0 0x7fa2640b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa262ffd640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 0x7fa2641520c0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7fa25400b3f0 tx=0x7fa25400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa24b7fe640 1 -- 172.21.15.172:0/1259342056 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254015020 con 0x7fa2640b2cb0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa24b7fe640 1 -- 172.21.15.172:0/1259342056 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254011830 con 0x7fa2640b2cb0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa2692c4640 1 -- 172.21.15.172:0/1259342056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2640b39c0 con 0x7fa2640b2cb0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa24b7fe640 1 -- 172.21.15.172:0/1259342056 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254011c20 con 0x7fa2640b2cb0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.737+0000 7fa2692c4640 1 -- 172.21.15.172:0/1259342056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2640b44a0 con 0x7fa2640b2cb0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.738+0000 7fa2692c4640 1 -- 172.21.15.172:0/1259342056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa264158c60 con 0x7fa2640b2cb0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.738+0000 7fa24b7fe640 1 -- 172.21.15.172:0/1259342056 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa254018020 con 0x7fa2640b2cb0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.739+0000 7fa24b7fe640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa25006b4d0 0x7fa25006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.739+0000 7fa24b7fe640 1 -- 172.21.15.172:0/1259342056 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa25408a020 con 0x7fa2640b2cb0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.739+0000 7fa2627fc640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa25006b4d0 0x7fa25006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:02.731 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.739+0000 7fa2627fc640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa25006b4d0 0x7fa25006d990 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa258034000 tx=0x7fa25802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:02.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.743+0000 7fa24b7fe640 1 -- 172.21.15.172:0/1259342056 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa264158c60 con 0x7fa2640b2cb0 2024-04-25T08:52:02.901 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.910+0000 7fa2692c4640 1 -- 172.21.15.172:0/1259342056 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2641493c0 con 0x7fa25006b4d0 2024-04-25T08:52:02.906 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.916+0000 7fa24b7fe640 1 -- 172.21.15.172:0/1259342056 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252457 (secure 0 0 0) 0x7fa25807fa40 con 0x7fa25006b4d0 2024-04-25T08:52:02.909 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:02.910 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:52:02.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 -- 172.21.15.172:0/1259342056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa25006b4d0 msgr2=0x7fa25006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa25006b4d0 0x7fa25006d990 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa258034000 tx=0x7fa25802e000 comp rx=0 tx=0).stop 2024-04-25T08:52:02.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 -- 172.21.15.172:0/1259342056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 msgr2=0x7fa2641520c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:02.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 0x7fa2641520c0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7fa25400b3f0 tx=0x7fa25400b8b0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 -- 172.21.15.172:0/1259342056 shutdown_connections 2024-04-25T08:52:02.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa25006b4d0 0x7fa25006d990 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa26415dbe0 0x7fa2640b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2640d1020 0x7fa264160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 --2- 172.21.15.172:0/1259342056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2640b2cb0 0x7fa2641520c0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:02.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 -- 172.21.15.172:0/1259342056 >> 172.21.15.172:0/1259342056 conn(0x7fa264061a20 msgr2=0x7fa26415c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:02.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 -- 172.21.15.172:0/1259342056 shutdown_connections 2024-04-25T08:52:02.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:02.919+0000 7fa2692c4640 1 -- 172.21.15.172:0/1259342056 wait complete. 2024-04-25T08:52:02.921 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2024-04-25T08:52:02.630892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417380,"kb_used_data":15204,"kb_used_omap":12,"kb_used_meta":402035,"kb_avail":754557340,"statfs":{"total":773094113280,"available":772666716160,"internally_reserved":0,"allocated":15568896,"data_stored":7868784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":411684400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.970315"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688285+0000","last_change":"2024-04-25T08:51:58.688022+0000","last_active":"2024-04-25T08:51:59.688285+0000","last_peered":"2024-04-25T08:51:59.688285+0000","last_clean":"2024-04-25T08:51:59.688285+0000","last_became_active":"2024-04-25T08:51:58.686734+0000","last_became_peered":"2024-04-25T08:51:58.686734+0000","last_unstale":"2024-04-25T08:51:59.688285+0000","last_undegraded":"2024-04-25T08:51:59.688285+0000","last_fullsized":"2024-04-25T08:51:59.688285+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695482+0000","last_change":"2024-04-25T08:51:58.694460+0000","last_active":"2024-04-25T08:51:58.695482+0000","last_peered":"2024-04-25T08:51:58.695482+0000","last_clean":"2024-04-25T08:51:58.695482+0000","last_became_active":"2024-04-25T08:51:58.694162+0000","last_became_peered":"2024-04-25T08:51:58.694162+0000","last_unstale":"2024-04-25T08:51:58.695482+0000","last_undegraded":"2024-04-25T08:51:58.695482+0000","last_fullsized":"2024-04-25T08:51:58.695482+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695518+0000","last_change":"2024-04-25T08:51:58.694784+0000","last_active":"2024-04-25T08:51:58.695518+0000","last_peered":"2024-04-25T08:51:58.695518+0000","last_clean":"2024-04-25T08:51:58.695518+0000","last_became_active":"2024-04-25T08:51:58.693953+0000","last_became_peered":"2024-04-25T08:51:58.693953+0000","last_unstale":"2024-04-25T08:51:58.695518+0000","last_undegraded":"2024-04-25T08:51:58.695518+0000","last_fullsized":"2024-04-25T08:51:58.695518+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:05.050389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001422+0000","last_change":"2024-04-25T08:51:58.692215+0000","last_active":"2024-04-25T08:52:01.001422+0000","last_peered":"2024-04-25T08:52:01.001422+0000","last_clean":"2024-04-25T08:52:01.001422+0000","last_became_active":"2024-04-25T08:51:58.691948+0000","last_became_peered":"2024-04-25T08:51:58.691948+0000","last_unstale":"2024-04-25T08:52:01.001422+0000","last_undegraded":"2024-04-25T08:52:01.001422+0000","last_fullsized":"2024-04-25T08:52:01.001422+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683223+0000","last_change":"2024-04-25T08:51:58.680126+0000","last_active":"2024-04-25T08:51:58.683223+0000","last_peered":"2024-04-25T08:51:58.683223+0000","last_clean":"2024-04-25T08:51:58.683223+0000","last_became_active":"2024-04-25T08:51:58.679785+0000","last_became_peered":"2024-04-25T08:51:58.679785+0000","last_unstale":"2024-04-25T08:51:58.683223+0000","last_undegraded":"2024-04-25T08:51:58.683223+0000","last_fullsized":"2024-04-25T08:51:58.683223+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683103+0000","last_change":"2024-04-25T08:51:58.679533+0000","last_active":"2024-04-25T08:51:58.683103+0000","last_peered":"2024-04-25T08:51:58.683103+0000","last_clean":"2024-04-25T08:51:58.683103+0000","last_became_active":"2024-04-25T08:51:58.679241+0000","last_became_peered":"2024-04-25T08:51:58.679241+0000","last_unstale":"2024-04-25T08:51:58.683103+0000","last_undegraded":"2024-04-25T08:51:58.683103+0000","last_fullsized":"2024-04-25T08:51:58.683103+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.560714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687655+0000","last_change":"2024-04-25T08:51:58.679041+0000","last_active":"2024-04-25T08:51:59.687655+0000","last_peered":"2024-04-25T08:51:59.687655+0000","last_clean":"2024-04-25T08:51:59.687655+0000","last_became_active":"2024-04-25T08:51:58.678693+0000","last_became_peered":"2024-04-25T08:51:58.678693+0000","last_unstale":"2024-04-25T08:51:59.687655+0000","last_undegraded":"2024-04-25T08:51:59.687655+0000","last_fullsized":"2024-04-25T08:51:59.687655+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.560714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687566+0000","last_change":"2024-04-25T08:51:58.693136+0000","last_active":"2024-04-25T08:51:59.687566+0000","last_peered":"2024-04-25T08:51:59.687566+0000","last_clean":"2024-04-25T08:51:59.687566+0000","last_became_active":"2024-04-25T08:51:58.692738+0000","last_became_peered":"2024-04-25T08:51:58.692738+0000","last_unstale":"2024-04-25T08:51:59.687566+0000","last_undegraded":"2024-04-25T08:51:59.687566+0000","last_fullsized":"2024-04-25T08:51:59.687566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:00.190275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699456+0000","last_change":"2024-04-25T08:51:58.683484+0000","last_active":"2024-04-25T08:51:58.699456+0000","last_peered":"2024-04-25T08:51:58.699456+0000","last_clean":"2024-04-25T08:51:58.699456+0000","last_became_active":"2024-04-25T08:51:58.683162+0000","last_became_peered":"2024-04-25T08:51:58.683162+0000","last_unstale":"2024-04-25T08:51:58.699456+0000","last_undegraded":"2024-04-25T08:51:58.699456+0000","last_fullsized":"2024-04-25T08:51:58.699456+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699513+0000","last_change":"2024-04-25T08:51:58.694912+0000","last_active":"2024-04-25T08:51:58.699513+0000","last_peered":"2024-04-25T08:51:58.699513+0000","last_clean":"2024-04-25T08:51:58.699513+0000","last_became_active":"2024-04-25T08:51:58.694633+0000","last_became_peered":"2024-04-25T08:51:58.694633+0000","last_unstale":"2024-04-25T08:51:58.699513+0000","last_undegraded":"2024-04-25T08:51:58.699513+0000","last_fullsized":"2024-04-25T08:51:58.699513+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:20.954144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372242+0000","last_change":"2024-04-25T08:51:58.688443+0000","last_active":"2024-04-25T08:52:00.372242+0000","last_peered":"2024-04-25T08:52:00.372242+0000","last_clean":"2024-04-25T08:52:00.372242+0000","last_became_active":"2024-04-25T08:51:58.688179+0000","last_became_peered":"2024-04-25T08:51:58.688179+0000","last_unstale":"2024-04-25T08:52:00.372242+0000","last_undegraded":"2024-04-25T08:52:00.372242+0000","last_fullsized":"2024-04-25T08:52:00.372242+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:16.377154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001559+0000","last_change":"2024-04-25T08:51:58.701100+0000","last_active":"2024-04-25T08:52:01.001559+0000","last_peered":"2024-04-25T08:52:01.001559+0000","last_clean":"2024-04-25T08:52:01.001559+0000","last_became_active":"2024-04-25T08:51:58.700826+0000","last_became_peered":"2024-04-25T08:51:58.700826+0000","last_unstale":"2024-04-25T08:52:01.001559+0000","last_undegraded":"2024-04-25T08:52:01.001559+0000","last_fullsized":"2024-04-25T08:52:01.001559+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699718+0000","last_change":"2024-04-25T08:51:58.694404+0000","last_active":"2024-04-25T08:51:58.699718+0000","last_peered":"2024-04-25T08:51:58.699718+0000","last_clean":"2024-04-25T08:51:58.699718+0000","last_became_active":"2024-04-25T08:51:58.694118+0000","last_became_peered":"2024-04-25T08:51:58.694118+0000","last_unstale":"2024-04-25T08:51:58.699718+0000","last_undegraded":"2024-04-25T08:51:58.699718+0000","last_fullsized":"2024-04-25T08:51:58.699718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.862373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001322+0000","last_change":"2024-04-25T08:51:58.701186+0000","last_active":"2024-04-25T08:52:01.001322+0000","last_peered":"2024-04-25T08:52:01.001322+0000","last_clean":"2024-04-25T08:52:01.001322+0000","last_became_active":"2024-04-25T08:51:58.700933+0000","last_became_peered":"2024-04-25T08:51:58.700933+0000","last_unstale":"2024-04-25T08:52:01.001322+0000","last_undegraded":"2024-04-25T08:52:01.001322+0000","last_fullsized":"2024-04-25T08:52:01.001322+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.700022+0000","last_change":"2024-04-25T08:51:58.697734+0000","last_active":"2024-04-25T08:51:58.700022+0000","last_peered":"2024-04-25T08:51:58.700022+0000","last_clean":"2024-04-25T08:51:58.700022+0000","last_became_active":"2024-04-25T08:51:58.697438+0000","last_became_peered":"2024-04-25T08:51:58.697438+0000","last_unstale":"2024-04-25T08:51:58.700022+0000","last_undegraded":"2024-04-25T08:51:58.700022+0000","last_fullsized":"2024-04-25T08:51:58.700022+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:43.145625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699508+0000","last_change":"2024-04-25T08:51:58.686864+0000","last_active":"2024-04-25T08:51:58.699508+0000","last_peered":"2024-04-25T08:51:58.699508+0000","last_clean":"2024-04-25T08:51:58.699508+0000","last_became_active":"2024-04-25T08:51:58.686600+0000","last_became_peered":"2024-04-25T08:51:58.686600+0000","last_unstale":"2024-04-25T08:51:58.699508+0000","last_undegraded":"2024-04-25T08:51:58.699508+0000","last_fullsized":"2024-04-25T08:51:58.699508+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001751+0000","last_change":"2024-04-25T08:51:58.693254+0000","last_active":"2024-04-25T08:52:01.001751+0000","last_peered":"2024-04-25T08:52:01.001751+0000","last_clean":"2024-04-25T08:52:01.001751+0000","last_became_active":"2024-04-25T08:51:58.692700+0000","last_became_peered":"2024-04-25T08:51:58.692700+0000","last_unstale":"2024-04-25T08:52:01.001751+0000","last_undegraded":"2024-04-25T08:52:01.001751+0000","last_fullsized":"2024-04-25T08:52:01.001751+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372369+0000","last_change":"2024-04-25T08:51:58.694474+0000","last_active":"2024-04-25T08:52:00.372369+0000","last_peered":"2024-04-25T08:52:00.372369+0000","last_clean":"2024-04-25T08:52:00.372369+0000","last_became_active":"2024-04-25T08:51:58.694160+0000","last_became_peered":"2024-04-25T08:51:58.694160+0000","last_unstale":"2024-04-25T08:52:00.372369+0000","last_undegraded":"2024-04-25T08:52:00.372369+0000","last_fullsized":"2024-04-25T08:52:00.372369+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:23.786506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702693+0000","last_change":"2024-04-25T08:51:58.688100+0000","last_active":"2024-04-25T08:51:59.702693+0000","last_peered":"2024-04-25T08:51:59.702693+0000","last_clean":"2024-04-25T08:51:59.702693+0000","last_became_active":"2024-04-25T08:51:58.687678+0000","last_became_peered":"2024-04-25T08:51:58.687678+0000","last_unstale":"2024-04-25T08:51:59.702693+0000","last_undegraded":"2024-04-25T08:51:59.702693+0000","last_fullsized":"2024-04-25T08:51:59.702693+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682613+0000","last_change":"2024-04-25T08:51:58.688356+0000","last_active":"2024-04-25T08:51:59.682613+0000","last_peered":"2024-04-25T08:51:59.682613+0000","last_clean":"2024-04-25T08:51:59.682613+0000","last_became_active":"2024-04-25T08:51:58.688099+0000","last_became_peered":"2024-04-25T08:51:58.688099+0000","last_unstale":"2024-04-25T08:51:59.682613+0000","last_undegraded":"2024-04-25T08:51:59.682613+0000","last_fullsized":"2024-04-25T08:51:59.682613+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:26.508708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683248+0000","last_change":"2024-04-25T08:51:58.680453+0000","last_active":"2024-04-25T08:51:58.683248+0000","last_peered":"2024-04-25T08:51:58.683248+0000","last_clean":"2024-04-25T08:51:58.683248+0000","last_became_active":"2024-04-25T08:51:58.680171+0000","last_became_peered":"2024-04-25T08:51:58.680171+0000","last_unstale":"2024-04-25T08:51:58.683248+0000","last_undegraded":"2024-04-25T08:51:58.683248+0000","last_fullsized":"2024-04-25T08:51:58.683248+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688623+0000","last_change":"2024-04-25T08:51:58.679406+0000","last_active":"2024-04-25T08:51:59.688623+0000","last_peered":"2024-04-25T08:51:59.688623+0000","last_clean":"2024-04-25T08:51:59.688623+0000","last_became_active":"2024-04-25T08:51:58.678753+0000","last_became_peered":"2024-04-25T08:51:58.678753+0000","last_unstale":"2024-04-25T08:51:59.688623+0000","last_undegraded":"2024-04-25T08:51:59.688623+0000","last_fullsized":"2024-04-25T08:51:59.688623+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687751+0000","last_change":"2024-04-25T08:51:58.690427+0000","last_active":"2024-04-25T08:51:59.687751+0000","last_peered":"2024-04-25T08:51:59.687751+0000","last_clean":"2024-04-25T08:51:59.687751+0000","last_became_active":"2024-04-25T08:51:58.690143+0000","last_became_peered":"2024-04-25T08:51:58.690143+0000","last_unstale":"2024-04-25T08:51:59.687751+0000","last_undegraded":"2024-04-25T08:51:59.687751+0000","last_fullsized":"2024-04-25T08:51:59.687751+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:07.849932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372272+0000","last_change":"2024-04-25T08:51:58.698476+0000","last_active":"2024-04-25T08:52:00.372272+0000","last_peered":"2024-04-25T08:52:00.372272+0000","last_clean":"2024-04-25T08:52:00.372272+0000","last_became_active":"2024-04-25T08:51:58.698215+0000","last_became_peered":"2024-04-25T08:51:58.698215+0000","last_unstale":"2024-04-25T08:52:00.372272+0000","last_undegraded":"2024-04-25T08:52:00.372272+0000","last_fullsized":"2024-04-25T08:52:00.372272+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:19.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688390+0000","last_change":"2024-04-25T08:51:58.690909+0000","last_active":"2024-04-25T08:51:59.688390+0000","last_peered":"2024-04-25T08:51:59.688390+0000","last_clean":"2024-04-25T08:51:59.688390+0000","last_became_active":"2024-04-25T08:51:58.690625+0000","last_became_peered":"2024-04-25T08:51:58.690625+0000","last_unstale":"2024-04-25T08:51:59.688390+0000","last_undegraded":"2024-04-25T08:51:59.688390+0000","last_fullsized":"2024-04-25T08:51:59.688390+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688145+0000","last_change":"2024-04-25T08:51:58.691825+0000","last_active":"2024-04-25T08:51:59.688145+0000","last_peered":"2024-04-25T08:51:59.688145+0000","last_clean":"2024-04-25T08:51:59.688145+0000","last_became_active":"2024-04-25T08:51:58.688552+0000","last_became_peered":"2024-04-25T08:51:58.688552+0000","last_unstale":"2024-04-25T08:51:59.688145+0000","last_undegraded":"2024-04-25T08:51:59.688145+0000","last_fullsized":"2024-04-25T08:51:59.688145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:09.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699338+0000","last_change":"2024-04-25T08:51:58.686310+0000","last_active":"2024-04-25T08:51:58.699338+0000","last_peered":"2024-04-25T08:51:58.699338+0000","last_clean":"2024-04-25T08:51:58.699338+0000","last_became_active":"2024-04-25T08:51:58.685165+0000","last_became_peered":"2024-04-25T08:51:58.685165+0000","last_unstale":"2024-04-25T08:51:58.699338+0000","last_undegraded":"2024-04-25T08:51:58.699338+0000","last_fullsized":"2024-04-25T08:51:58.699338+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372273+0000","last_change":"2024-04-25T08:51:58.690610+0000","last_active":"2024-04-25T08:52:00.372273+0000","last_peered":"2024-04-25T08:52:00.372273+0000","last_clean":"2024-04-25T08:52:00.372273+0000","last_became_active":"2024-04-25T08:51:58.690279+0000","last_became_peered":"2024-04-25T08:51:58.690279+0000","last_unstale":"2024-04-25T08:52:00.372273+0000","last_undegraded":"2024-04-25T08:52:00.372273+0000","last_fullsized":"2024-04-25T08:52:00.372273+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:38.266138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688664+0000","last_change":"2024-04-25T08:51:58.701180+0000","last_active":"2024-04-25T08:51:59.688664+0000","last_peered":"2024-04-25T08:51:59.688664+0000","last_clean":"2024-04-25T08:51:59.688664+0000","last_became_active":"2024-04-25T08:51:58.700888+0000","last_became_peered":"2024-04-25T08:51:58.700888+0000","last_unstale":"2024-04-25T08:51:59.688664+0000","last_undegraded":"2024-04-25T08:51:59.688664+0000","last_fullsized":"2024-04-25T08:51:59.688664+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372225+0000","last_change":"2024-04-25T08:51:58.690756+0000","last_active":"2024-04-25T08:52:00.372225+0000","last_peered":"2024-04-25T08:52:00.372225+0000","last_clean":"2024-04-25T08:52:00.372225+0000","last_became_active":"2024-04-25T08:51:58.690222+0000","last_became_peered":"2024-04-25T08:51:58.690222+0000","last_unstale":"2024-04-25T08:52:00.372225+0000","last_undegraded":"2024-04-25T08:52:00.372225+0000","last_fullsized":"2024-04-25T08:52:00.372225+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:40.024839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699407+0000","last_change":"2024-04-25T08:51:58.687469+0000","last_active":"2024-04-25T08:51:58.699407+0000","last_peered":"2024-04-25T08:51:58.699407+0000","last_clean":"2024-04-25T08:51:58.699407+0000","last_became_active":"2024-04-25T08:51:58.687212+0000","last_became_peered":"2024-04-25T08:51:58.687212+0000","last_unstale":"2024-04-25T08:51:58.699407+0000","last_undegraded":"2024-04-25T08:51:58.699407+0000","last_fullsized":"2024-04-25T08:51:58.699407+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:54.079611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687732+0000","last_change":"2024-04-25T08:51:58.687508+0000","last_active":"2024-04-25T08:51:59.687732+0000","last_peered":"2024-04-25T08:51:59.687732+0000","last_clean":"2024-04-25T08:51:59.687732+0000","last_became_active":"2024-04-25T08:51:58.687248+0000","last_became_peered":"2024-04-25T08:51:58.687248+0000","last_unstale":"2024-04-25T08:51:59.687732+0000","last_undegraded":"2024-04-25T08:51:59.687732+0000","last_fullsized":"2024-04-25T08:51:59.687732+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:45.247106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.693011+0000","last_change":"2024-04-25T08:51:58.692141+0000","last_active":"2024-04-25T08:51:58.693011+0000","last_peered":"2024-04-25T08:51:58.693011+0000","last_clean":"2024-04-25T08:51:58.693011+0000","last_became_active":"2024-04-25T08:51:58.691300+0000","last_became_peered":"2024-04-25T08:51:58.691300+0000","last_unstale":"2024-04-25T08:51:58.693011+0000","last_undegraded":"2024-04-25T08:51:58.693011+0000","last_fullsized":"2024-04-25T08:51:58.693011+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"142'4","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.706805+0000","last_change":"2024-04-25T08:51:57.678935+0000","last_active":"2024-04-25T08:51:58.706805+0000","last_peered":"2024-04-25T08:51:58.706805+0000","last_clean":"2024-04-25T08:51:58.706805+0000","last_became_active":"2024-04-25T08:51:57.677554+0000","last_became_peered":"2024-04-25T08:51:57.677554+0000","last_unstale":"2024-04-25T08:51:58.706805+0000","last_undegraded":"2024-04-25T08:51:58.706805+0000","last_fullsized":"2024-04-25T08:51:58.706805+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:45.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695534+0000","last_change":"2024-04-25T08:51:58.694894+0000","last_active":"2024-04-25T08:51:58.695534+0000","last_peered":"2024-04-25T08:51:58.695534+0000","last_clean":"2024-04-25T08:51:58.695534+0000","last_became_active":"2024-04-25T08:51:58.694640+0000","last_became_peered":"2024-04-25T08:51:58.694640+0000","last_unstale":"2024-04-25T08:51:58.695534+0000","last_undegraded":"2024-04-25T08:51:58.695534+0000","last_fullsized":"2024-04-25T08:51:58.695534+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:07.037339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702607+0000","last_change":"2024-04-25T08:51:57.680568+0000","last_active":"2024-04-25T08:51:59.702607+0000","last_peered":"2024-04-25T08:51:59.702607+0000","last_clean":"2024-04-25T08:51:59.702607+0000","last_became_active":"2024-04-25T08:51:57.680215+0000","last_became_peered":"2024-04-25T08:51:57.680215+0000","last_unstale":"2024-04-25T08:51:59.702607+0000","last_undegraded":"2024-04-25T08:51:59.702607+0000","last_fullsized":"2024-04-25T08:51:59.702607+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:57.119064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688298+0000","last_change":"2024-04-25T08:51:58.692557+0000","last_active":"2024-04-25T08:51:59.688298+0000","last_peered":"2024-04-25T08:51:59.688298+0000","last_clean":"2024-04-25T08:51:59.688298+0000","last_became_active":"2024-04-25T08:51:58.690870+0000","last_became_peered":"2024-04-25T08:51:58.690870+0000","last_unstale":"2024-04-25T08:51:59.688298+0000","last_undegraded":"2024-04-25T08:51:59.688298+0000","last_fullsized":"2024-04-25T08:51:59.688298+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702775+0000","last_change":"2024-04-25T08:51:57.680346+0000","last_active":"2024-04-25T08:51:59.702775+0000","last_peered":"2024-04-25T08:51:59.702775+0000","last_clean":"2024-04-25T08:51:59.702775+0000","last_became_active":"2024-04-25T08:51:57.679834+0000","last_became_peered":"2024-04-25T08:51:57.679834+0000","last_unstale":"2024-04-25T08:51:59.702775+0000","last_undegraded":"2024-04-25T08:51:59.702775+0000","last_fullsized":"2024-04-25T08:51:59.702775+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:03.764385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702725+0000","last_change":"2024-04-25T08:51:58.683999+0000","last_active":"2024-04-25T08:51:59.702725+0000","last_peered":"2024-04-25T08:51:59.702725+0000","last_clean":"2024-04-25T08:51:59.702725+0000","last_became_active":"2024-04-25T08:51:58.683686+0000","last_became_peered":"2024-04-25T08:51:58.683686+0000","last_unstale":"2024-04-25T08:51:59.702725+0000","last_undegraded":"2024-04-25T08:51:59.702725+0000","last_fullsized":"2024-04-25T08:51:59.702725+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.705507+0000","last_change":"2024-04-25T08:51:57.684784+0000","last_active":"2024-04-25T08:51:58.705507+0000","last_peered":"2024-04-25T08:51:58.705507+0000","last_clean":"2024-04-25T08:51:58.705507+0000","last_became_active":"2024-04-25T08:51:57.684270+0000","last_became_peered":"2024-04-25T08:51:57.684270+0000","last_unstale":"2024-04-25T08:51:58.705507+0000","last_undegraded":"2024-04-25T08:51:58.705507+0000","last_fullsized":"2024-04-25T08:51:58.705507+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:59.186072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682473+0000","last_change":"2024-04-25T08:51:58.696589+0000","last_active":"2024-04-25T08:51:59.682473+0000","last_peered":"2024-04-25T08:51:59.682473+0000","last_clean":"2024-04-25T08:51:59.682473+0000","last_became_active":"2024-04-25T08:51:58.696283+0000","last_became_peered":"2024-04-25T08:51:58.696283+0000","last_unstale":"2024-04-25T08:51:59.682473+0000","last_undegraded":"2024-04-25T08:51:59.682473+0000","last_fullsized":"2024-04-25T08:51:59.682473+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:25.100007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688776+0000","last_change":"2024-04-25T08:51:57.681697+0000","last_active":"2024-04-25T08:51:59.688776+0000","last_peered":"2024-04-25T08:51:59.688776+0000","last_clean":"2024-04-25T08:51:59.688776+0000","last_became_active":"2024-04-25T08:51:57.681217+0000","last_became_peered":"2024-04-25T08:51:57.681217+0000","last_unstale":"2024-04-25T08:51:59.688776+0000","last_undegraded":"2024-04-25T08:51:59.688776+0000","last_fullsized":"2024-04-25T08:51:59.688776+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:22.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001305+0000","last_change":"2024-04-25T08:51:58.698064+0000","last_active":"2024-04-25T08:52:01.001305+0000","last_peered":"2024-04-25T08:52:01.001305+0000","last_clean":"2024-04-25T08:52:01.001305+0000","last_became_active":"2024-04-25T08:51:58.697736+0000","last_became_peered":"2024-04-25T08:51:58.697736+0000","last_unstale":"2024-04-25T08:52:01.001305+0000","last_undegraded":"2024-04-25T08:52:01.001305+0000","last_fullsized":"2024-04-25T08:52:01.001305+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.705098+0000","last_change":"2024-04-25T08:51:57.679244+0000","last_active":"2024-04-25T08:51:58.705098+0000","last_peered":"2024-04-25T08:51:58.705098+0000","last_clean":"2024-04-25T08:51:58.705098+0000","last_became_active":"2024-04-25T08:51:57.677491+0000","last_became_peered":"2024-04-25T08:51:57.677491+0000","last_unstale":"2024-04-25T08:51:58.705098+0000","last_undegraded":"2024-04-25T08:51:58.705098+0000","last_fullsized":"2024-04-25T08:51:58.705098+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:46.158444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.691912+0000","last_change":"2024-04-25T08:51:58.688383+0000","last_active":"2024-04-25T08:51:58.691912+0000","last_peered":"2024-04-25T08:51:58.691912+0000","last_clean":"2024-04-25T08:51:58.691912+0000","last_became_active":"2024-04-25T08:51:58.688072+0000","last_became_peered":"2024-04-25T08:51:58.688072+0000","last_unstale":"2024-04-25T08:51:58.691912+0000","last_undegraded":"2024-04-25T08:51:58.691912+0000","last_fullsized":"2024-04-25T08:51:58.691912+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687761+0000","last_change":"2024-04-25T08:51:57.679918+0000","last_active":"2024-04-25T08:51:59.687761+0000","last_peered":"2024-04-25T08:51:59.687761+0000","last_clean":"2024-04-25T08:51:59.687761+0000","last_became_active":"2024-04-25T08:51:57.679656+0000","last_became_peered":"2024-04-25T08:51:57.679656+0000","last_unstale":"2024-04-25T08:51:59.687761+0000","last_undegraded":"2024-04-25T08:51:59.687761+0000","last_fullsized":"2024-04-25T08:51:59.687761+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:40.337985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687569+0000","last_change":"2024-04-25T08:51:58.691560+0000","last_active":"2024-04-25T08:51:59.687569+0000","last_peered":"2024-04-25T08:51:59.687569+0000","last_clean":"2024-04-25T08:51:59.687569+0000","last_became_active":"2024-04-25T08:51:58.688811+0000","last_became_peered":"2024-04-25T08:51:58.688811+0000","last_unstale":"2024-04-25T08:51:59.687569+0000","last_undegraded":"2024-04-25T08:51:59.687569+0000","last_fullsized":"2024-04-25T08:51:59.687569+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:21.032824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.675061+0000","last_change":"2024-04-25T08:51:57.675383+0000","last_active":"2024-04-25T08:51:58.675061+0000","last_peered":"2024-04-25T08:51:58.675061+0000","last_clean":"2024-04-25T08:51:58.675061+0000","last_became_active":"2024-04-25T08:51:57.675111+0000","last_became_peered":"2024-04-25T08:51:57.675111+0000","last_unstale":"2024-04-25T08:51:58.675061+0000","last_undegraded":"2024-04-25T08:51:58.675061+0000","last_fullsized":"2024-04-25T08:51:58.675061+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:03.764385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688370+0000","last_change":"2024-04-25T08:51:58.690638+0000","last_active":"2024-04-25T08:51:59.688370+0000","last_peered":"2024-04-25T08:51:59.688370+0000","last_clean":"2024-04-25T08:51:59.688370+0000","last_became_active":"2024-04-25T08:51:58.690364+0000","last_became_peered":"2024-04-25T08:51:58.690364+0000","last_unstale":"2024-04-25T08:51:59.688370+0000","last_undegraded":"2024-04-25T08:51:59.688370+0000","last_fullsized":"2024-04-25T08:51:59.688370+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702674+0000","last_change":"2024-04-25T08:51:57.677353+0000","last_active":"2024-04-25T08:51:59.702674+0000","last_peered":"2024-04-25T08:51:59.702674+0000","last_clean":"2024-04-25T08:51:59.702674+0000","last_became_active":"2024-04-25T08:51:57.676926+0000","last_became_peered":"2024-04-25T08:51:57.676926+0000","last_unstale":"2024-04-25T08:51:59.702674+0000","last_undegraded":"2024-04-25T08:51:59.702674+0000","last_fullsized":"2024-04-25T08:51:59.702674+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:50.800138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372377+0000","last_change":"2024-04-25T08:51:58.687775+0000","last_active":"2024-04-25T08:52:00.372377+0000","last_peered":"2024-04-25T08:52:00.372377+0000","last_clean":"2024-04-25T08:52:00.372377+0000","last_became_active":"2024-04-25T08:51:58.687473+0000","last_became_peered":"2024-04-25T08:51:58.687473+0000","last_unstale":"2024-04-25T08:52:00.372377+0000","last_undegraded":"2024-04-25T08:52:00.372377+0000","last_fullsized":"2024-04-25T08:52:00.372377+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:51.987904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688885+0000","last_change":"2024-04-25T08:51:57.679237+0000","last_active":"2024-04-25T08:51:59.688885+0000","last_peered":"2024-04-25T08:51:59.688885+0000","last_clean":"2024-04-25T08:51:59.688885+0000","last_became_active":"2024-04-25T08:51:57.678926+0000","last_became_peered":"2024-04-25T08:51:57.678926+0000","last_unstale":"2024-04-25T08:51:59.688885+0000","last_undegraded":"2024-04-25T08:51:59.688885+0000","last_fullsized":"2024-04-25T08:51:59.688885+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:25.169115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372383+0000","last_change":"2024-04-25T08:51:58.687200+0000","last_active":"2024-04-25T08:52:00.372383+0000","last_peered":"2024-04-25T08:52:00.372383+0000","last_clean":"2024-04-25T08:52:00.372383+0000","last_became_active":"2024-04-25T08:51:58.686933+0000","last_became_peered":"2024-04-25T08:51:58.686933+0000","last_unstale":"2024-04-25T08:52:00.372383+0000","last_undegraded":"2024-04-25T08:52:00.372383+0000","last_fullsized":"2024-04-25T08:52:00.372383+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:42.491032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"142'3","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372348+0000","last_change":"2024-04-25T08:51:57.676927+0000","last_active":"2024-04-25T08:52:00.372348+0000","last_peered":"2024-04-25T08:52:00.372348+0000","last_clean":"2024-04-25T08:52:00.372348+0000","last_became_active":"2024-04-25T08:51:57.676667+0000","last_became_peered":"2024-04-25T08:51:57.676667+0000","last_unstale":"2024-04-25T08:52:00.372348+0000","last_undegraded":"2024-04-25T08:52:00.372348+0000","last_fullsized":"2024-04-25T08:52:00.372348+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:54.058859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687906+0000","last_change":"2024-04-25T08:51:58.691366+0000","last_active":"2024-04-25T08:51:59.687906+0000","last_peered":"2024-04-25T08:51:59.687906+0000","last_clean":"2024-04-25T08:51:59.687906+0000","last_became_active":"2024-04-25T08:51:58.689980+0000","last_became_peered":"2024-04-25T08:51:58.689980+0000","last_unstale":"2024-04-25T08:51:59.687906+0000","last_undegraded":"2024-04-25T08:51:59.687906+0000","last_fullsized":"2024-04-25T08:51:59.687906+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.707119+0000","last_change":"2024-04-25T08:51:57.679370+0000","last_active":"2024-04-25T08:51:58.707119+0000","last_peered":"2024-04-25T08:51:58.707119+0000","last_clean":"2024-04-25T08:51:58.707119+0000","last_became_active":"2024-04-25T08:51:57.678638+0000","last_became_peered":"2024-04-25T08:51:57.678638+0000","last_unstale":"2024-04-25T08:51:58.707119+0000","last_undegraded":"2024-04-25T08:51:58.707119+0000","last_fullsized":"2024-04-25T08:51:58.707119+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:20.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.692782+0000","last_change":"2024-04-25T08:51:58.691999+0000","last_active":"2024-04-25T08:51:58.692782+0000","last_peered":"2024-04-25T08:51:58.692782+0000","last_clean":"2024-04-25T08:51:58.692782+0000","last_became_active":"2024-04-25T08:51:58.691704+0000","last_became_peered":"2024-04-25T08:51:58.691704+0000","last_unstale":"2024-04-25T08:51:58.692782+0000","last_undegraded":"2024-04-25T08:51:58.692782+0000","last_fullsized":"2024-04-25T08:51:58.692782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001461+0000","last_change":"2024-04-25T08:51:57.685351+0000","last_active":"2024-04-25T08:52:01.001461+0000","last_peered":"2024-04-25T08:52:01.001461+0000","last_clean":"2024-04-25T08:52:01.001461+0000","last_became_active":"2024-04-25T08:51:57.684940+0000","last_became_peered":"2024-04-25T08:51:57.684940+0000","last_unstale":"2024-04-25T08:52:01.001461+0000","last_undegraded":"2024-04-25T08:52:01.001461+0000","last_fullsized":"2024-04-25T08:52:01.001461+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:14.277326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699329+0000","last_change":"2024-04-25T08:51:58.684758+0000","last_active":"2024-04-25T08:51:58.699329+0000","last_peered":"2024-04-25T08:51:58.699329+0000","last_clean":"2024-04-25T08:51:58.699329+0000","last_became_active":"2024-04-25T08:51:58.684486+0000","last_became_peered":"2024-04-25T08:51:58.684486+0000","last_unstale":"2024-04-25T08:51:58.699329+0000","last_undegraded":"2024-04-25T08:51:58.699329+0000","last_fullsized":"2024-04-25T08:51:58.699329+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001466+0000","last_change":"2024-04-25T08:51:57.676880+0000","last_active":"2024-04-25T08:52:01.001466+0000","last_peered":"2024-04-25T08:52:01.001466+0000","last_clean":"2024-04-25T08:52:01.001466+0000","last_became_active":"2024-04-25T08:51:57.676575+0000","last_became_peered":"2024-04-25T08:51:57.676575+0000","last_unstale":"2024-04-25T08:52:01.001466+0000","last_undegraded":"2024-04-25T08:52:01.001466+0000","last_fullsized":"2024-04-25T08:52:01.001466+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:45.695332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.687914+0000","last_change":"2024-04-25T08:51:58.686307+0000","last_active":"2024-04-25T08:51:58.687914+0000","last_peered":"2024-04-25T08:51:58.687914+0000","last_clean":"2024-04-25T08:51:58.687914+0000","last_became_active":"2024-04-25T08:51:58.685998+0000","last_became_peered":"2024-04-25T08:51:58.685998+0000","last_unstale":"2024-04-25T08:51:58.687914+0000","last_undegraded":"2024-04-25T08:51:58.687914+0000","last_fullsized":"2024-04-25T08:51:58.687914+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"142'8","reported_seq":22,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687356+0000","last_change":"2024-04-25T08:51:57.674597+0000","last_active":"2024-04-25T08:51:59.687356+0000","last_peered":"2024-04-25T08:51:59.687356+0000","last_clean":"2024-04-25T08:51:59.687356+0000","last_became_active":"2024-04-25T08:51:57.674343+0000","last_became_peered":"2024-04-25T08:51:57.674343+0000","last_unstale":"2024-04-25T08:51:59.687356+0000","last_undegraded":"2024-04-25T08:51:59.687356+0000","last_fullsized":"2024-04-25T08:51:59.687356+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:42.141421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702458+0000","last_change":"2024-04-25T08:51:58.685128+0000","last_active":"2024-04-25T08:51:59.702458+0000","last_peered":"2024-04-25T08:51:59.702458+0000","last_clean":"2024-04-25T08:51:59.702458+0000","last_became_active":"2024-04-25T08:51:58.684819+0000","last_became_peered":"2024-04-25T08:51:58.684819+0000","last_unstale":"2024-04-25T08:51:59.702458+0000","last_undegraded":"2024-04-25T08:51:59.702458+0000","last_fullsized":"2024-04-25T08:51:59.702458+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372156+0000","last_change":"2024-04-25T08:51:57.673131+0000","last_active":"2024-04-25T08:52:00.372156+0000","last_peered":"2024-04-25T08:52:00.372156+0000","last_clean":"2024-04-25T08:52:00.372156+0000","last_became_active":"2024-04-25T08:51:57.672351+0000","last_became_peered":"2024-04-25T08:51:57.672351+0000","last_unstale":"2024-04-25T08:52:00.372156+0000","last_undegraded":"2024-04-25T08:52:00.372156+0000","last_fullsized":"2024-04-25T08:52:00.372156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:27.669933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702702+0000","last_change":"2024-04-25T08:51:58.687945+0000","last_active":"2024-04-25T08:51:59.702702+0000","last_peered":"2024-04-25T08:51:59.702702+0000","last_clean":"2024-04-25T08:51:59.702702+0000","last_became_active":"2024-04-25T08:51:58.687329+0000","last_became_peered":"2024-04-25T08:51:58.687329+0000","last_unstale":"2024-04-25T08:51:59.702702+0000","last_undegraded":"2024-04-25T08:51:59.702702+0000","last_fullsized":"2024-04-25T08:51:59.702702+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702620+0000","last_change":"2024-04-25T08:51:57.675051+0000","last_active":"2024-04-25T08:51:59.702620+0000","last_peered":"2024-04-25T08:51:59.702620+0000","last_clean":"2024-04-25T08:51:59.702620+0000","last_became_active":"2024-04-25T08:51:57.674775+0000","last_became_peered":"2024-04-25T08:51:57.674775+0000","last_unstale":"2024-04-25T08:51:59.702620+0000","last_undegraded":"2024-04-25T08:51:59.702620+0000","last_fullsized":"2024-04-25T08:51:59.702620+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:35.148119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688764+0000","last_change":"2024-04-25T08:51:58.694109+0000","last_active":"2024-04-25T08:51:59.688764+0000","last_peered":"2024-04-25T08:51:59.688764+0000","last_clean":"2024-04-25T08:51:59.688764+0000","last_became_active":"2024-04-25T08:51:58.693751+0000","last_became_peered":"2024-04-25T08:51:58.693751+0000","last_unstale":"2024-04-25T08:51:59.688764+0000","last_undegraded":"2024-04-25T08:51:59.688764+0000","last_fullsized":"2024-04-25T08:51:59.688764+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.704800+0000","last_change":"2024-04-25T08:51:57.681447+0000","last_active":"2024-04-25T08:51:58.704800+0000","last_peered":"2024-04-25T08:51:58.704800+0000","last_clean":"2024-04-25T08:51:58.704800+0000","last_became_active":"2024-04-25T08:51:57.680908+0000","last_became_peered":"2024-04-25T08:51:57.680908+0000","last_unstale":"2024-04-25T08:51:58.704800+0000","last_undegraded":"2024-04-25T08:51:58.704800+0000","last_fullsized":"2024-04-25T08:51:58.704800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:44.242903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688440+0000","last_change":"2024-04-25T08:51:58.692191+0000","last_active":"2024-04-25T08:51:59.688440+0000","last_peered":"2024-04-25T08:51:59.688440+0000","last_clean":"2024-04-25T08:51:59.688440+0000","last_became_active":"2024-04-25T08:51:58.691907+0000","last_became_peered":"2024-04-25T08:51:58.691907+0000","last_unstale":"2024-04-25T08:51:59.688440+0000","last_undegraded":"2024-04-25T08:51:59.688440+0000","last_fullsized":"2024-04-25T08:51:59.688440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001524+0000","last_change":"2024-04-25T08:51:57.683826+0000","last_active":"2024-04-25T08:52:01.001524+0000","last_peered":"2024-04-25T08:52:01.001524+0000","last_clean":"2024-04-25T08:52:01.001524+0000","last_became_active":"2024-04-25T08:51:57.683526+0000","last_became_peered":"2024-04-25T08:51:57.683526+0000","last_unstale":"2024-04-25T08:52:01.001524+0000","last_undegraded":"2024-04-25T08:52:01.001524+0000","last_fullsized":"2024-04-25T08:52:01.001524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:19.949576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702371+0000","last_change":"2024-04-25T08:51:58.687702+0000","last_active":"2024-04-25T08:51:59.702371+0000","last_peered":"2024-04-25T08:51:59.702371+0000","last_clean":"2024-04-25T08:51:59.702371+0000","last_became_active":"2024-04-25T08:51:58.687428+0000","last_became_peered":"2024-04-25T08:51:58.687428+0000","last_unstale":"2024-04-25T08:51:59.702371+0000","last_undegraded":"2024-04-25T08:51:59.702371+0000","last_fullsized":"2024-04-25T08:51:59.702371+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682529+0000","last_change":"2024-04-25T08:51:57.685728+0000","last_active":"2024-04-25T08:51:59.682529+0000","last_peered":"2024-04-25T08:51:59.682529+0000","last_clean":"2024-04-25T08:51:59.682529+0000","last_became_active":"2024-04-25T08:51:57.685418+0000","last_became_peered":"2024-04-25T08:51:57.685418+0000","last_unstale":"2024-04-25T08:51:59.682529+0000","last_undegraded":"2024-04-25T08:51:59.682529+0000","last_fullsized":"2024-04-25T08:51:59.682529+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:16.987390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.691958+0000","last_change":"2024-04-25T08:51:58.690815+0000","last_active":"2024-04-25T08:51:58.691958+0000","last_peered":"2024-04-25T08:51:58.691958+0000","last_clean":"2024-04-25T08:51:58.691958+0000","last_became_active":"2024-04-25T08:51:58.689859+0000","last_became_peered":"2024-04-25T08:51:58.689859+0000","last_unstale":"2024-04-25T08:51:58.691958+0000","last_undegraded":"2024-04-25T08:51:58.691958+0000","last_fullsized":"2024-04-25T08:51:58.691958+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687554+0000","last_change":"2024-04-25T08:51:57.683172+0000","last_active":"2024-04-25T08:51:59.687554+0000","last_peered":"2024-04-25T08:51:59.687554+0000","last_clean":"2024-04-25T08:51:59.687554+0000","last_became_active":"2024-04-25T08:51:57.682905+0000","last_became_peered":"2024-04-25T08:51:57.682905+0000","last_unstale":"2024-04-25T08:51:59.687554+0000","last_undegraded":"2024-04-25T08:51:59.687554+0000","last_fullsized":"2024-04-25T08:51:59.687554+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.724725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702362+0000","last_change":"2024-04-25T08:51:58.684054+0000","last_active":"2024-04-25T08:51:59.702362+0000","last_peered":"2024-04-25T08:51:59.702362+0000","last_clean":"2024-04-25T08:51:59.702362+0000","last_became_active":"2024-04-25T08:51:58.683726+0000","last_became_peered":"2024-04-25T08:51:58.683726+0000","last_unstale":"2024-04-25T08:51:59.702362+0000","last_undegraded":"2024-04-25T08:51:59.702362+0000","last_fullsized":"2024-04-25T08:51:59.702362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682403+0000","last_change":"2024-04-25T08:51:57.684720+0000","last_active":"2024-04-25T08:51:59.682403+0000","last_peered":"2024-04-25T08:51:59.682403+0000","last_clean":"2024-04-25T08:51:59.682403+0000","last_became_active":"2024-04-25T08:51:57.684468+0000","last_became_peered":"2024-04-25T08:51:57.684468+0000","last_unstale":"2024-04-25T08:51:59.682403+0000","last_undegraded":"2024-04-25T08:51:59.682403+0000","last_fullsized":"2024-04-25T08:51:59.682403+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:02.587687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699526+0000","last_change":"2024-04-25T08:51:58.698210+0000","last_active":"2024-04-25T08:51:58.699526+0000","last_peered":"2024-04-25T08:51:58.699526+0000","last_clean":"2024-04-25T08:51:58.699526+0000","last_became_active":"2024-04-25T08:51:58.697934+0000","last_became_peered":"2024-04-25T08:51:58.697934+0000","last_unstale":"2024-04-25T08:51:58.699526+0000","last_undegraded":"2024-04-25T08:51:58.699526+0000","last_fullsized":"2024-04-25T08:51:58.699526+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:41.342188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688698+0000","last_change":"2024-04-25T08:51:57.684696+0000","last_active":"2024-04-25T08:51:59.688698+0000","last_peered":"2024-04-25T08:51:59.688698+0000","last_clean":"2024-04-25T08:51:59.688698+0000","last_became_active":"2024-04-25T08:51:57.684380+0000","last_became_peered":"2024-04-25T08:51:57.684380+0000","last_unstale":"2024-04-25T08:51:59.688698+0000","last_undegraded":"2024-04-25T08:51:59.688698+0000","last_fullsized":"2024-04-25T08:51:59.688698+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:58.013246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683413+0000","last_change":"2024-04-25T08:51:58.679751+0000","last_active":"2024-04-25T08:51:58.683413+0000","last_peered":"2024-04-25T08:51:58.683413+0000","last_clean":"2024-04-25T08:51:58.683413+0000","last_became_active":"2024-04-25T08:51:58.679472+0000","last_became_peered":"2024-04-25T08:51:58.679472+0000","last_unstale":"2024-04-25T08:51:58.683413+0000","last_undegraded":"2024-04-25T08:51:58.683413+0000","last_fullsized":"2024-04-25T08:51:58.683413+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:09.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001740+0000","last_change":"2024-04-25T08:51:57.684094+0000","last_active":"2024-04-25T08:52:01.001740+0000","last_peered":"2024-04-25T08:52:01.001740+0000","last_clean":"2024-04-25T08:52:01.001740+0000","last_became_active":"2024-04-25T08:51:57.683629+0000","last_became_peered":"2024-04-25T08:51:57.683629+0000","last_unstale":"2024-04-25T08:52:01.001740+0000","last_undegraded":"2024-04-25T08:52:01.001740+0000","last_fullsized":"2024-04-25T08:52:01.001740+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:07.130284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001675+0000","last_change":"2024-04-25T08:51:58.700932+0000","last_active":"2024-04-25T08:52:01.001675+0000","last_peered":"2024-04-25T08:52:01.001675+0000","last_clean":"2024-04-25T08:52:01.001675+0000","last_became_active":"2024-04-25T08:51:58.700672+0000","last_became_peered":"2024-04-25T08:51:58.700672+0000","last_unstale":"2024-04-25T08:52:01.001675+0000","last_undegraded":"2024-04-25T08:52:01.001675+0000","last_fullsized":"2024-04-25T08:52:01.001675+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"143'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.701616+0000","last_change":"2024-04-25T08:51:57.683105+0000","last_active":"2024-04-25T08:51:59.701616+0000","last_peered":"2024-04-25T08:51:59.701616+0000","last_clean":"2024-04-25T08:51:59.701616+0000","last_became_active":"2024-04-25T08:51:57.682754+0000","last_became_peered":"2024-04-25T08:51:57.682754+0000","last_unstale":"2024-04-25T08:51:59.701616+0000","last_undegraded":"2024-04-25T08:51:59.701616+0000","last_fullsized":"2024-04-25T08:51:59.701616+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:39.113507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688828+0000","last_change":"2024-04-25T08:51:58.693432+0000","last_active":"2024-04-25T08:51:59.688828+0000","last_peered":"2024-04-25T08:51:59.688828+0000","last_clean":"2024-04-25T08:51:59.688828+0000","last_became_active":"2024-04-25T08:51:58.691780+0000","last_became_peered":"2024-04-25T08:51:58.691780+0000","last_unstale":"2024-04-25T08:51:59.688828+0000","last_undegraded":"2024-04-25T08:51:59.688828+0000","last_fullsized":"2024-04-25T08:51:59.688828+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.681577+0000","last_change":"2024-04-25T08:51:57.684558+0000","last_active":"2024-04-25T08:51:58.681577+0000","last_peered":"2024-04-25T08:51:58.681577+0000","last_clean":"2024-04-25T08:51:58.681577+0000","last_became_active":"2024-04-25T08:51:57.684293+0000","last_became_peered":"2024-04-25T08:51:57.684293+0000","last_unstale":"2024-04-25T08:51:58.681577+0000","last_undegraded":"2024-04-25T08:51:58.681577+0000","last_fullsized":"2024-04-25T08:51:58.681577+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:06.845729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699477+0000","last_change":"2024-04-25T08:51:58.693635+0000","last_active":"2024-04-25T08:51:58.699477+0000","last_peered":"2024-04-25T08:51:58.699477+0000","last_clean":"2024-04-25T08:51:58.699477+0000","last_became_active":"2024-04-25T08:51:58.693270+0000","last_became_peered":"2024-04-25T08:51:58.693270+0000","last_unstale":"2024-04-25T08:51:58.699477+0000","last_undegraded":"2024-04-25T08:51:58.699477+0000","last_fullsized":"2024-04-25T08:51:58.699477+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:50.949573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.676047+0000","last_change":"2024-04-25T08:51:57.681906+0000","last_active":"2024-04-25T08:51:58.676047+0000","last_peered":"2024-04-25T08:51:58.676047+0000","last_clean":"2024-04-25T08:51:58.676047+0000","last_became_active":"2024-04-25T08:51:57.681578+0000","last_became_peered":"2024-04-25T08:51:57.681578+0000","last_unstale":"2024-04-25T08:51:58.676047+0000","last_undegraded":"2024-04-25T08:51:58.676047+0000","last_fullsized":"2024-04-25T08:51:58.676047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:21.385739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688362+0000","last_change":"2024-04-25T08:51:58.691133+0000","last_active":"2024-04-25T08:51:59.688362+0000","last_peered":"2024-04-25T08:51:59.688362+0000","last_clean":"2024-04-25T08:51:59.688362+0000","last_became_active":"2024-04-25T08:51:58.690826+0000","last_became_peered":"2024-04-25T08:51:58.690826+0000","last_unstale":"2024-04-25T08:51:59.688362+0000","last_undegraded":"2024-04-25T08:51:59.688362+0000","last_fullsized":"2024-04-25T08:51:59.688362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687676+0000","last_change":"2024-04-25T08:51:57.673573+0000","last_active":"2024-04-25T08:51:59.687676+0000","last_peered":"2024-04-25T08:51:59.687676+0000","last_clean":"2024-04-25T08:51:59.687676+0000","last_became_active":"2024-04-25T08:51:57.673302+0000","last_became_peered":"2024-04-25T08:51:57.673302+0000","last_unstale":"2024-04-25T08:51:59.687676+0000","last_undegraded":"2024-04-25T08:51:59.687676+0000","last_fullsized":"2024-04-25T08:51:59.687676+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:22.616954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001327+0000","last_change":"2024-04-25T08:51:58.700123+0000","last_active":"2024-04-25T08:52:01.001327+0000","last_peered":"2024-04-25T08:52:01.001327+0000","last_clean":"2024-04-25T08:52:01.001327+0000","last_became_active":"2024-04-25T08:51:58.699870+0000","last_became_peered":"2024-04-25T08:51:58.699870+0000","last_unstale":"2024-04-25T08:52:01.001327+0000","last_undegraded":"2024-04-25T08:52:01.001327+0000","last_fullsized":"2024-04-25T08:52:01.001327+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372214+0000","last_change":"2024-04-25T08:51:57.683935+0000","last_active":"2024-04-25T08:52:00.372214+0000","last_peered":"2024-04-25T08:52:00.372214+0000","last_clean":"2024-04-25T08:52:00.372214+0000","last_became_active":"2024-04-25T08:51:57.683646+0000","last_became_peered":"2024-04-25T08:51:57.683646+0000","last_unstale":"2024-04-25T08:52:00.372214+0000","last_undegraded":"2024-04-25T08:52:00.372214+0000","last_fullsized":"2024-04-25T08:52:00.372214+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:14.617656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.688536+0000","last_change":"2024-04-25T08:51:58.686967+0000","last_active":"2024-04-25T08:51:58.688536+0000","last_peered":"2024-04-25T08:51:58.688536+0000","last_clean":"2024-04-25T08:51:58.688536+0000","last_became_active":"2024-04-25T08:51:58.686651+0000","last_became_peered":"2024-04-25T08:51:58.686651+0000","last_unstale":"2024-04-25T08:51:58.688536+0000","last_undegraded":"2024-04-25T08:51:58.688536+0000","last_fullsized":"2024-04-25T08:51:58.688536+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687877+0000","last_change":"2024-04-25T08:51:57.679212+0000","last_active":"2024-04-25T08:51:59.687877+0000","last_peered":"2024-04-25T08:51:59.687877+0000","last_clean":"2024-04-25T08:51:59.687877+0000","last_became_active":"2024-04-25T08:51:57.678913+0000","last_became_peered":"2024-04-25T08:51:57.678913+0000","last_unstale":"2024-04-25T08:51:59.687877+0000","last_undegraded":"2024-04-25T08:51:59.687877+0000","last_fullsized":"2024-04-25T08:51:59.687877+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:18.043975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688665+0000","last_change":"2024-04-25T08:51:58.702307+0000","last_active":"2024-04-25T08:51:59.688665+0000","last_peered":"2024-04-25T08:51:59.688665+0000","last_clean":"2024-04-25T08:51:59.688665+0000","last_became_active":"2024-04-25T08:51:58.702035+0000","last_became_peered":"2024-04-25T08:51:58.702035+0000","last_unstale":"2024-04-25T08:51:59.688665+0000","last_undegraded":"2024-04-25T08:51:59.688665+0000","last_fullsized":"2024-04-25T08:51:59.688665+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702275+0000","last_change":"2024-04-25T08:51:57.673963+0000","last_active":"2024-04-25T08:51:59.702275+0000","last_peered":"2024-04-25T08:51:59.702275+0000","last_clean":"2024-04-25T08:51:59.702275+0000","last_became_active":"2024-04-25T08:51:57.673682+0000","last_became_peered":"2024-04-25T08:51:57.673682+0000","last_unstale":"2024-04-25T08:51:59.702275+0000","last_undegraded":"2024-04-25T08:51:59.702275+0000","last_fullsized":"2024-04-25T08:51:59.702275+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:40.470761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688096+0000","last_change":"2024-04-25T08:51:58.695857+0000","last_active":"2024-04-25T08:51:59.688096+0000","last_peered":"2024-04-25T08:51:59.688096+0000","last_clean":"2024-04-25T08:51:59.688096+0000","last_became_active":"2024-04-25T08:51:58.695470+0000","last_became_peered":"2024-04-25T08:51:58.695470+0000","last_unstale":"2024-04-25T08:51:59.688096+0000","last_undegraded":"2024-04-25T08:51:59.688096+0000","last_fullsized":"2024-04-25T08:51:59.688096+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"142'6","reported_seq":20,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682707+0000","last_change":"2024-04-25T08:51:57.685128+0000","last_active":"2024-04-25T08:51:59.682707+0000","last_peered":"2024-04-25T08:51:59.682707+0000","last_clean":"2024-04-25T08:51:59.682707+0000","last_became_active":"2024-04-25T08:51:57.684874+0000","last_became_peered":"2024-04-25T08:51:57.684874+0000","last_unstale":"2024-04-25T08:51:59.682707+0000","last_undegraded":"2024-04-25T08:51:59.682707+0000","last_fullsized":"2024-04-25T08:51:59.682707+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:35.538961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":396,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702330+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:51:59.702330+0000","last_peered":"2024-04-25T08:51:59.702330+0000","last_clean":"2024-04-25T08:51:59.702330+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:51:59.702330+0000","last_undegraded":"2024-04-25T08:51:59.702330+0000","last_fullsized":"2024-04-25T08:51:59.702330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":2392064,"data_stored":1428303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":837983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46824,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325016,"statfs":{"total":96636764160,"available":96588816384,"internally_reserved":0,"allocated":1794048,"data_stored":837913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1806336,"data_stored":839525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59304,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312536,"statfs":{"total":96636764160,"available":96576036864,"internally_reserved":0,"allocated":1789952,"data_stored":831837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50984,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1789952,"data_stored":831333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":831291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51584,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320256,"statfs":{"total":96636764160,"available":96583942144,"internally_reserved":0,"allocated":2412544,"data_stored":1430599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:52:02.925 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T08:52:03.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.067+0000 7f1991a5d640 1 Processor -- start 2024-04-25T08:52:03.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.067+0000 7f1991a5d640 1 -- start start 2024-04-25T08:52:03.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.068+0000 7f1991a5d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f198c0ce7a0 0x7f198c0cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.068+0000 7f1991a5d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c0cd6e0 con 0x7f198c0cdb40 2024-04-25T08:52:03.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.068+0000 7f1991a5d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c0cc640 con 0x7f198c15b950 2024-04-25T08:52:03.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.068+0000 7f1991a5d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198c0cc3f0 con 0x7f198c0ce7a0 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.068+0000 7f198b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f198c0cdb40 0x7f198c0c6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40464/0 (socket says 172.21.15.172:40464) 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.068+0000 7f198b7fe640 1 -- 172.21.15.172:0/3825725098 learned_addr learned my addr 172.21.15.172:0/3825725098 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.068+0000 7f198a7fc640 1 --2- 172.21.15.172:0/3825725098 >> v2:172.21.15.186:3300/0 conn(0x7f198c0ce7a0 0x7f198c0cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.068+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116044300 0 0) 0x7f198c0cd6e0 con 0x7f198c0cdb40 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.068+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1974003520 con 0x7f198c0cdb40 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079922910 0 0) 0x7f198c0cc640 con 0x7f198c15b950 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f198c0cd6e0 con 0x7f198c15b950 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308108695 0 0) 0x7f1974003520 con 0x7f198c0cdb40 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 >> v2:172.21.15.186:3300/0 conn(0x7f198c0ce7a0 msgr2=0x7f198c0cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 --2- 172.21.15.172:0/3825725098 >> v2:172.21.15.186:3300/0 conn(0x7f198c0ce7a0 0x7f198c0cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 >> v1:172.21.15.186:6789/0 conn(0x7f198c15b950 legacy=0x7f198c0ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c0cc920 con 0x7f198c0cdb40 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f19840015f0 con 0x7f198c0cdb40 2024-04-25T08:52:03.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 >> v1:172.21.15.172:6789/0 conn(0x7f198c0cdb40 legacy=0x7f198c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1974003b90 0x7f1974003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1974004800 0x7f1974004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19740051c0 0x7f197400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0cc3f0 con 0x7f1974003b90 2024-04-25T08:52:03.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197400bfe0 con 0x7f19740051c0 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197400c1e0 con 0x7f1974004800 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f198affd640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1974003b90 0x7f1974003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f198b7fe640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19740051c0 0x7f197400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f198a7fc640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1974004800 0x7f1974004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f198affd640 1 -- 172.21.15.172:0/3825725098 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1974004800 msgr2=0x7f1974004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f198affd640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1974004800 0x7f1974004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f198affd640 1 -- 172.21.15.172:0/3825725098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19740051c0 msgr2=0x7f197400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f198affd640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f19740051c0 0x7f197400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f198b7fe640 1 -- 172.21.15.172:0/3825725098 reap_dead start 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.069+0000 7f198affd640 1 -- 172.21.15.172:0/3825725098 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974003520 con 0x7f1974003b90 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.070+0000 7f198affd640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1974003b90 0x7f1974003f90 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f197c001fd0 tx=0x7f1974005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e18db6f6b7ae3d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:03.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.070+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c001bf0 con 0x7f1974003b90 2024-04-25T08:52:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.070+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c003b70 con 0x7f1974003b90 2024-04-25T08:52:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.070+0000 7f1989ffb640 1 -- 172.21.15.172:0/3825725098 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0050d0 con 0x7f1974003b90 2024-04-25T08:52:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.071+0000 7f1991a5d640 1 -- 172.21.15.172:0/3825725098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1974003b90 msgr2=0x7f1974003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.071+0000 7f1991a5d640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1974003b90 0x7f1974003f90 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f197c001fd0 tx=0x7f1974005830 comp rx=0 tx=0).stop 2024-04-25T08:52:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.071+0000 7f1991a5d640 1 -- 172.21.15.172:0/3825725098 shutdown_connections 2024-04-25T08:52:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.071+0000 7f1991a5d640 1 --2- 172.21.15.172:0/3825725098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1974003b90 0x7f1974003f90 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.071+0000 7f1991a5d640 1 -- 172.21.15.172:0/3825725098 >> 172.21.15.172:0/3825725098 conn(0x7f198c0b33e0 msgr2=0x7f198c0b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.071+0000 7f1991a5d640 1 -- 172.21.15.172:0/3825725098 shutdown_connections 2024-04-25T08:52:03.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.071+0000 7f1991a5d640 1 -- 172.21.15.172:0/3825725098 wait complete. 2024-04-25T08:52:03.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.072+0000 7f1991a5d640 1 Processor -- start 2024-04-25T08:52:03.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.072+0000 7f1991a5d640 1 -- start start 2024-04-25T08:52:03.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1991a5d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1974003b90 0x7f198c0b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1991a5d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f198c14d860 0x7f198c0b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1991a5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c15d1e0 0x7f198c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1991a5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0cd1c0 con 0x7f198c15d1e0 2024-04-25T08:52:03.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1991a5d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0ccee0 con 0x7f198c14d860 2024-04-25T08:52:03.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1991a5d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0d02d0 con 0x7f1974003b90 2024-04-25T08:52:03.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c15d1e0 0x7f198c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c15d1e0 0x7f198c15d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37104/0 (socket says 172.21.15.172:37104) 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198b7fe640 1 -- 172.21.15.172:0/31520377 learned_addr learned my addr 172.21.15.172:0/31520377 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198a7fc640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f198c14d860 0x7f198c0b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198b7fe640 1 -- 172.21.15.172:0/31520377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1974003b90 msgr2=0x7f198c0b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198affd640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1974003b90 0x7f198c0b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198b7fe640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1974003b90 0x7f198c0b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198b7fe640 1 -- 172.21.15.172:0/31520377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f198c14d860 msgr2=0x7f198c0b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198b7fe640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f198c14d860 0x7f198c0b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198b7fe640 1 -- 172.21.15.172:0/31520377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c1f1350 con 0x7f198c15d1e0 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198a7fc640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f198c14d860 0x7f198c0b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f198b7fe640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c15d1e0 0x7f198c15d670 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f198c0d27e0 tx=0x7f1984007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1973fff640 1 -- 172.21.15.172:0/31520377 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400f620 con 0x7f198c15d1e0 2024-04-25T08:52:03.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1973fff640 1 -- 172.21.15.172:0/31520377 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1984018070 con 0x7f198c15d1e0 2024-04-25T08:52:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1991a5d640 1 -- 172.21.15.172:0/31520377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c0b4a10 con 0x7f198c15d1e0 2024-04-25T08:52:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1973fff640 1 -- 172.21.15.172:0/31520377 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400fa00 con 0x7f198c15d1e0 2024-04-25T08:52:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.073+0000 7f1991a5d640 1 -- 172.21.15.172:0/31520377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c1f1610 con 0x7f198c15d1e0 2024-04-25T08:52:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.074+0000 7f1991a5d640 1 -- 172.21.15.172:0/31520377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c073990 con 0x7f198c15d1e0 2024-04-25T08:52:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.075+0000 7f1973fff640 1 -- 172.21.15.172:0/31520377 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f198400fba0 con 0x7f198c15d1e0 2024-04-25T08:52:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.075+0000 7f1973fff640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197806b500 0x7f197806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.075+0000 7f198affd640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197806b500 0x7f197806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.076+0000 7f1973fff640 1 -- 172.21.15.172:0/31520377 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1984089f40 con 0x7f198c15d1e0 2024-04-25T08:52:03.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.076+0000 7f198affd640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197806b500 0x7f197806d9c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f197c032000 tx=0x7f197c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:03.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.080+0000 7f1973fff640 1 -- 172.21.15.172:0/31520377 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1984058670 con 0x7f198c15d1e0 2024-04-25T08:52:03.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.315+0000 7f1991a5d640 1 -- 172.21.15.172:0/31520377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f198c0745f0 con 0x7f198c15d1e0 2024-04-25T08:52:03.306 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.315+0000 7f1973fff640 1 -- 172.21.15.172:0/31520377 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1017 (secure 0 0 0) 0x7f198405c710 con 0x7f198c15d1e0 2024-04-25T08:52:03.306 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:03.306 INFO:teuthology.orchestra.run.smithi172.stdout:{"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":598,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1714034535,"num_in_osds":8,"osd_in_since":1714034526,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":427397120,"bytes_avail":772666716160,"bytes_total":773094113280,"write_bytes_sec":2401,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":85,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9825}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-04-25T08:51:48.627707+0000","services":{}},"progress_events":{}} 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 -- 172.21.15.172:0/31520377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197806b500 msgr2=0x7f197806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197806b500 0x7f197806d9c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f197c032000 tx=0x7f197c02f000 comp rx=0 tx=0).stop 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 -- 172.21.15.172:0/31520377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c15d1e0 msgr2=0x7f198c15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c15d1e0 0x7f198c15d670 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f198c0d27e0 tx=0x7f1984007430 comp rx=0 tx=0).stop 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 -- 172.21.15.172:0/31520377 shutdown_connections 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f197806b500 0x7f197806d9c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f198c14d860 0x7f198c0b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f198c15d1e0 0x7f198c15d670 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 --2- 172.21.15.172:0/31520377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1974003b90 0x7f198c0b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 -- 172.21.15.172:0/31520377 >> 172.21.15.172:0/31520377 conn(0x7f198c0b33e0 msgr2=0x7f198c0b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:03.308 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 -- 172.21.15.172:0/31520377 shutdown_connections 2024-04-25T08:52:03.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.317+0000 7f1991a5d640 1 -- 172.21.15.172:0/31520377 wait complete. 2024-04-25T08:52:03.319 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T08:52:03.319 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:52:03.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.426+0000 7f580f16a640 1 Processor -- start 2024-04-25T08:52:03.416 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.426+0000 7f580f16a640 1 -- start start 2024-04-25T08:52:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f580f16a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f58080d1dd0 0x7f58080ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f580f16a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580815dfe0 con 0x7f580815dc00 2024-04-25T08:52:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f580f16a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58080d00c0 con 0x7f58080c6df0 2024-04-25T08:52:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f580f16a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58080d03a0 con 0x7f58080d1dd0 2024-04-25T08:52:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f580d707640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f58080d1dd0 0x7f58080ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f580cf06640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f580815dc00 0x7f58080ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:40470/0 (socket says 172.21.15.172:40470) 2024-04-25T08:52:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f580cf06640 1 -- 172.21.15.172:0/1179169731 learned_addr learned my addr 172.21.15.172:0/1179169731 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f58077fe640 1 -- 172.21.15.172:0/1179169731 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206992256 0 0) 0x7f57fc001110 con 0x7f580815dc00 2024-04-25T08:52:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f58077fe640 1 -- 172.21.15.172:0/1179169731 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f8003520 con 0x7f580815dc00 2024-04-25T08:52:03.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f580d707640 1 -- 172.21.15.172:0/1179169731 >> v1:172.21.15.186:6789/0 conn(0x7f58080c6df0 legacy=0x7f58080d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f580d707640 1 -- 172.21.15.172:0/1179169731 >> v1:172.21.15.172:6789/0 conn(0x7f580815dc00 legacy=0x7f58080ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.427+0000 7f580d707640 1 -- 172.21.15.172:0/1179169731 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080cc440 con 0x7f58080d1dd0 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.428+0000 7f580d707640 1 --2- 172.21.15.172:0/1179169731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58080d1dd0 0x7f58080ccc40 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f5800009d90 tx=0x7f580002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeffe2c28703d46b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.428+0000 7f58077fe640 1 -- 172.21.15.172:0/1179169731 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800007740 con 0x7f58080d1dd0 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.428+0000 7f58077fe640 1 -- 172.21.15.172:0/1179169731 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58000078e0 con 0x7f58080d1dd0 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.428+0000 7f58077fe640 1 -- 172.21.15.172:0/1179169731 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800007cb0 con 0x7f58080d1dd0 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.428+0000 7f580f16a640 1 -- 172.21.15.172:0/1179169731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58080d1dd0 msgr2=0x7f58080ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.428+0000 7f580f16a640 1 --2- 172.21.15.172:0/1179169731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58080d1dd0 0x7f58080ccc40 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f5800009d90 tx=0x7f580002a6f0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.429+0000 7f580f16a640 1 -- 172.21.15.172:0/1179169731 shutdown_connections 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.429+0000 7f580f16a640 1 --2- 172.21.15.172:0/1179169731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58080d1dd0 0x7f58080ccc40 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.429+0000 7f580f16a640 1 -- 172.21.15.172:0/1179169731 >> 172.21.15.172:0/1179169731 conn(0x7f580806f5d0 msgr2=0x7f580806f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.429+0000 7f580f16a640 1 -- 172.21.15.172:0/1179169731 shutdown_connections 2024-04-25T08:52:03.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.429+0000 7f580f16a640 1 -- 172.21.15.172:0/1179169731 wait complete. 2024-04-25T08:52:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.430+0000 7f580f16a640 1 Processor -- start 2024-04-25T08:52:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.430+0000 7f580f16a640 1 -- start start 2024-04-25T08:52:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580f16a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58080c6df0 0x7f58080b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.423 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580f16a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58080d1dd0 0x7f5808159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580f16a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f580815dc00 0x7f580806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580f16a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080cfd90 con 0x7f580815dc00 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580f16a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080cc130 con 0x7f58080d1dd0 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580f16a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080cdd70 con 0x7f58080c6df0 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580d707640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f580815dc00 0x7f580806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580d707640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f580815dc00 0x7f580806ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37116/0 (socket says 172.21.15.172:37116) 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580d707640 1 -- 172.21.15.172:0/2155375693 learned_addr learned my addr 172.21.15.172:0/2155375693 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580cf06640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58080c6df0 0x7f58080b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f5807fff640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58080d1dd0 0x7f5808159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580d707640 1 -- 172.21.15.172:0/2155375693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58080c6df0 msgr2=0x7f58080b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580d707640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58080c6df0 0x7f58080b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580d707640 1 -- 172.21.15.172:0/2155375693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58080d1dd0 msgr2=0x7f5808159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580d707640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58080d1dd0 0x7f5808159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580d707640 1 -- 172.21.15.172:0/2155375693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58080b6490 con 0x7f580815dc00 2024-04-25T08:52:03.424 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580d707640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f580815dc00 0x7f580806ca40 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f5800009eb0 tx=0x7f5800004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f58057fa640 1 -- 172.21.15.172:0/2155375693 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800040070 con 0x7f580815dc00 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f58057fa640 1 -- 172.21.15.172:0/2155375693 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5800031bc0 con 0x7f580815dc00 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580f16a640 1 -- 172.21.15.172:0/2155375693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58081f4640 con 0x7f580815dc00 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f58057fa640 1 -- 172.21.15.172:0/2155375693 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800009450 con 0x7f580815dc00 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.431+0000 7f580f16a640 1 -- 172.21.15.172:0/2155375693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58080b6d10 con 0x7f580815dc00 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.432+0000 7f580f16a640 1 -- 172.21.15.172:0/2155375693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5808073990 con 0x7f580815dc00 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.433+0000 7f58057fa640 1 -- 172.21.15.172:0/2155375693 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5800039040 con 0x7f580815dc00 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.433+0000 7f58057fa640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ec06b4d0 0x7f57ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.433+0000 7f58057fa640 1 -- 172.21.15.172:0/2155375693 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f58000abbb0 con 0x7f580815dc00 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.433+0000 7f580cf06640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ec06b4d0 0x7f57ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:03.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.434+0000 7f580cf06640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ec06b4d0 0x7f57ec06d990 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f57fc007fd0 tx=0x7f57fc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:03.427 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.437+0000 7f58057fa640 1 -- 172.21.15.172:0/2155375693 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f58081f4640 con 0x7f580815dc00 2024-04-25T08:52:03.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.605+0000 7f580f16a640 1 -- 172.21.15.172:0/2155375693 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58080b6660 con 0x7f57ec06b4d0 2024-04-25T08:52:03.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.611+0000 7f58057fa640 1 -- 172.21.15.172:0/2155375693 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252457 (secure 0 0 0) 0x7f58080b6660 con 0x7f57ec06b4d0 2024-04-25T08:52:03.604 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:03.606 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:52:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 -- 172.21.15.172:0/2155375693 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ec06b4d0 msgr2=0x7f57ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ec06b4d0 0x7f57ec06d990 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f57fc007fd0 tx=0x7f57fc009040 comp rx=0 tx=0).stop 2024-04-25T08:52:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 -- 172.21.15.172:0/2155375693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f580815dc00 msgr2=0x7f580806ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f580815dc00 0x7f580806ca40 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f5800009eb0 tx=0x7f5800004a40 comp rx=0 tx=0).stop 2024-04-25T08:52:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 -- 172.21.15.172:0/2155375693 shutdown_connections 2024-04-25T08:52:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f57ec06b4d0 0x7f57ec06d990 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58080d1dd0 0x7f5808159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f580815dc00 0x7f580806ca40 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 --2- 172.21.15.172:0/2155375693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58080c6df0 0x7f58080b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:03.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 -- 172.21.15.172:0/2155375693 >> 172.21.15.172:0/2155375693 conn(0x7f580806f5d0 msgr2=0x7f58080d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:03.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 -- 172.21.15.172:0/2155375693 shutdown_connections 2024-04-25T08:52:03.609 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:03.614+0000 7f580f16a640 1 -- 172.21.15.172:0/2155375693 wait complete. 2024-04-25T08:52:03.616 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2024-04-25T08:52:02.630892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417380,"kb_used_data":15204,"kb_used_omap":12,"kb_used_meta":402035,"kb_avail":754557340,"statfs":{"total":773094113280,"available":772666716160,"internally_reserved":0,"allocated":15568896,"data_stored":7868784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":411684400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.970315"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688285+0000","last_change":"2024-04-25T08:51:58.688022+0000","last_active":"2024-04-25T08:51:59.688285+0000","last_peered":"2024-04-25T08:51:59.688285+0000","last_clean":"2024-04-25T08:51:59.688285+0000","last_became_active":"2024-04-25T08:51:58.686734+0000","last_became_peered":"2024-04-25T08:51:58.686734+0000","last_unstale":"2024-04-25T08:51:59.688285+0000","last_undegraded":"2024-04-25T08:51:59.688285+0000","last_fullsized":"2024-04-25T08:51:59.688285+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695482+0000","last_change":"2024-04-25T08:51:58.694460+0000","last_active":"2024-04-25T08:51:58.695482+0000","last_peered":"2024-04-25T08:51:58.695482+0000","last_clean":"2024-04-25T08:51:58.695482+0000","last_became_active":"2024-04-25T08:51:58.694162+0000","last_became_peered":"2024-04-25T08:51:58.694162+0000","last_unstale":"2024-04-25T08:51:58.695482+0000","last_undegraded":"2024-04-25T08:51:58.695482+0000","last_fullsized":"2024-04-25T08:51:58.695482+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695518+0000","last_change":"2024-04-25T08:51:58.694784+0000","last_active":"2024-04-25T08:51:58.695518+0000","last_peered":"2024-04-25T08:51:58.695518+0000","last_clean":"2024-04-25T08:51:58.695518+0000","last_became_active":"2024-04-25T08:51:58.693953+0000","last_became_peered":"2024-04-25T08:51:58.693953+0000","last_unstale":"2024-04-25T08:51:58.695518+0000","last_undegraded":"2024-04-25T08:51:58.695518+0000","last_fullsized":"2024-04-25T08:51:58.695518+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:14:05.050389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001422+0000","last_change":"2024-04-25T08:51:58.692215+0000","last_active":"2024-04-25T08:52:01.001422+0000","last_peered":"2024-04-25T08:52:01.001422+0000","last_clean":"2024-04-25T08:52:01.001422+0000","last_became_active":"2024-04-25T08:51:58.691948+0000","last_became_peered":"2024-04-25T08:51:58.691948+0000","last_unstale":"2024-04-25T08:52:01.001422+0000","last_undegraded":"2024-04-25T08:52:01.001422+0000","last_fullsized":"2024-04-25T08:52:01.001422+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683223+0000","last_change":"2024-04-25T08:51:58.680126+0000","last_active":"2024-04-25T08:51:58.683223+0000","last_peered":"2024-04-25T08:51:58.683223+0000","last_clean":"2024-04-25T08:51:58.683223+0000","last_became_active":"2024-04-25T08:51:58.679785+0000","last_became_peered":"2024-04-25T08:51:58.679785+0000","last_unstale":"2024-04-25T08:51:58.683223+0000","last_undegraded":"2024-04-25T08:51:58.683223+0000","last_fullsized":"2024-04-25T08:51:58.683223+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683103+0000","last_change":"2024-04-25T08:51:58.679533+0000","last_active":"2024-04-25T08:51:58.683103+0000","last_peered":"2024-04-25T08:51:58.683103+0000","last_clean":"2024-04-25T08:51:58.683103+0000","last_became_active":"2024-04-25T08:51:58.679241+0000","last_became_peered":"2024-04-25T08:51:58.679241+0000","last_unstale":"2024-04-25T08:51:58.683103+0000","last_undegraded":"2024-04-25T08:51:58.683103+0000","last_fullsized":"2024-04-25T08:51:58.683103+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.560714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687655+0000","last_change":"2024-04-25T08:51:58.679041+0000","last_active":"2024-04-25T08:51:59.687655+0000","last_peered":"2024-04-25T08:51:59.687655+0000","last_clean":"2024-04-25T08:51:59.687655+0000","last_became_active":"2024-04-25T08:51:58.678693+0000","last_became_peered":"2024-04-25T08:51:58.678693+0000","last_unstale":"2024-04-25T08:51:59.687655+0000","last_undegraded":"2024-04-25T08:51:59.687655+0000","last_fullsized":"2024-04-25T08:51:59.687655+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.560714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687566+0000","last_change":"2024-04-25T08:51:58.693136+0000","last_active":"2024-04-25T08:51:59.687566+0000","last_peered":"2024-04-25T08:51:59.687566+0000","last_clean":"2024-04-25T08:51:59.687566+0000","last_became_active":"2024-04-25T08:51:58.692738+0000","last_became_peered":"2024-04-25T08:51:58.692738+0000","last_unstale":"2024-04-25T08:51:59.687566+0000","last_undegraded":"2024-04-25T08:51:59.687566+0000","last_fullsized":"2024-04-25T08:51:59.687566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:00.190275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699456+0000","last_change":"2024-04-25T08:51:58.683484+0000","last_active":"2024-04-25T08:51:58.699456+0000","last_peered":"2024-04-25T08:51:58.699456+0000","last_clean":"2024-04-25T08:51:58.699456+0000","last_became_active":"2024-04-25T08:51:58.683162+0000","last_became_peered":"2024-04-25T08:51:58.683162+0000","last_unstale":"2024-04-25T08:51:58.699456+0000","last_undegraded":"2024-04-25T08:51:58.699456+0000","last_fullsized":"2024-04-25T08:51:58.699456+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699513+0000","last_change":"2024-04-25T08:51:58.694912+0000","last_active":"2024-04-25T08:51:58.699513+0000","last_peered":"2024-04-25T08:51:58.699513+0000","last_clean":"2024-04-25T08:51:58.699513+0000","last_became_active":"2024-04-25T08:51:58.694633+0000","last_became_peered":"2024-04-25T08:51:58.694633+0000","last_unstale":"2024-04-25T08:51:58.699513+0000","last_undegraded":"2024-04-25T08:51:58.699513+0000","last_fullsized":"2024-04-25T08:51:58.699513+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:57:20.954144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372242+0000","last_change":"2024-04-25T08:51:58.688443+0000","last_active":"2024-04-25T08:52:00.372242+0000","last_peered":"2024-04-25T08:52:00.372242+0000","last_clean":"2024-04-25T08:52:00.372242+0000","last_became_active":"2024-04-25T08:51:58.688179+0000","last_became_peered":"2024-04-25T08:51:58.688179+0000","last_unstale":"2024-04-25T08:52:00.372242+0000","last_undegraded":"2024-04-25T08:52:00.372242+0000","last_fullsized":"2024-04-25T08:52:00.372242+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:16.377154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001559+0000","last_change":"2024-04-25T08:51:58.701100+0000","last_active":"2024-04-25T08:52:01.001559+0000","last_peered":"2024-04-25T08:52:01.001559+0000","last_clean":"2024-04-25T08:52:01.001559+0000","last_became_active":"2024-04-25T08:51:58.700826+0000","last_became_peered":"2024-04-25T08:51:58.700826+0000","last_unstale":"2024-04-25T08:52:01.001559+0000","last_undegraded":"2024-04-25T08:52:01.001559+0000","last_fullsized":"2024-04-25T08:52:01.001559+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699718+0000","last_change":"2024-04-25T08:51:58.694404+0000","last_active":"2024-04-25T08:51:58.699718+0000","last_peered":"2024-04-25T08:51:58.699718+0000","last_clean":"2024-04-25T08:51:58.699718+0000","last_became_active":"2024-04-25T08:51:58.694118+0000","last_became_peered":"2024-04-25T08:51:58.694118+0000","last_unstale":"2024-04-25T08:51:58.699718+0000","last_undegraded":"2024-04-25T08:51:58.699718+0000","last_fullsized":"2024-04-25T08:51:58.699718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:49.862373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001322+0000","last_change":"2024-04-25T08:51:58.701186+0000","last_active":"2024-04-25T08:52:01.001322+0000","last_peered":"2024-04-25T08:52:01.001322+0000","last_clean":"2024-04-25T08:52:01.001322+0000","last_became_active":"2024-04-25T08:51:58.700933+0000","last_became_peered":"2024-04-25T08:51:58.700933+0000","last_unstale":"2024-04-25T08:52:01.001322+0000","last_undegraded":"2024-04-25T08:52:01.001322+0000","last_fullsized":"2024-04-25T08:52:01.001322+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.700022+0000","last_change":"2024-04-25T08:51:58.697734+0000","last_active":"2024-04-25T08:51:58.700022+0000","last_peered":"2024-04-25T08:51:58.700022+0000","last_clean":"2024-04-25T08:51:58.700022+0000","last_became_active":"2024-04-25T08:51:58.697438+0000","last_became_peered":"2024-04-25T08:51:58.697438+0000","last_unstale":"2024-04-25T08:51:58.700022+0000","last_undegraded":"2024-04-25T08:51:58.700022+0000","last_fullsized":"2024-04-25T08:51:58.700022+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:43.145625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699508+0000","last_change":"2024-04-25T08:51:58.686864+0000","last_active":"2024-04-25T08:51:58.699508+0000","last_peered":"2024-04-25T08:51:58.699508+0000","last_clean":"2024-04-25T08:51:58.699508+0000","last_became_active":"2024-04-25T08:51:58.686600+0000","last_became_peered":"2024-04-25T08:51:58.686600+0000","last_unstale":"2024-04-25T08:51:58.699508+0000","last_undegraded":"2024-04-25T08:51:58.699508+0000","last_fullsized":"2024-04-25T08:51:58.699508+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001751+0000","last_change":"2024-04-25T08:51:58.693254+0000","last_active":"2024-04-25T08:52:01.001751+0000","last_peered":"2024-04-25T08:52:01.001751+0000","last_clean":"2024-04-25T08:52:01.001751+0000","last_became_active":"2024-04-25T08:51:58.692700+0000","last_became_peered":"2024-04-25T08:51:58.692700+0000","last_unstale":"2024-04-25T08:52:01.001751+0000","last_undegraded":"2024-04-25T08:52:01.001751+0000","last_fullsized":"2024-04-25T08:52:01.001751+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372369+0000","last_change":"2024-04-25T08:51:58.694474+0000","last_active":"2024-04-25T08:52:00.372369+0000","last_peered":"2024-04-25T08:52:00.372369+0000","last_clean":"2024-04-25T08:52:00.372369+0000","last_became_active":"2024-04-25T08:51:58.694160+0000","last_became_peered":"2024-04-25T08:51:58.694160+0000","last_unstale":"2024-04-25T08:52:00.372369+0000","last_undegraded":"2024-04-25T08:52:00.372369+0000","last_fullsized":"2024-04-25T08:52:00.372369+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:23.786506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702693+0000","last_change":"2024-04-25T08:51:58.688100+0000","last_active":"2024-04-25T08:51:59.702693+0000","last_peered":"2024-04-25T08:51:59.702693+0000","last_clean":"2024-04-25T08:51:59.702693+0000","last_became_active":"2024-04-25T08:51:58.687678+0000","last_became_peered":"2024-04-25T08:51:58.687678+0000","last_unstale":"2024-04-25T08:51:59.702693+0000","last_undegraded":"2024-04-25T08:51:59.702693+0000","last_fullsized":"2024-04-25T08:51:59.702693+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682613+0000","last_change":"2024-04-25T08:51:58.688356+0000","last_active":"2024-04-25T08:51:59.682613+0000","last_peered":"2024-04-25T08:51:59.682613+0000","last_clean":"2024-04-25T08:51:59.682613+0000","last_became_active":"2024-04-25T08:51:58.688099+0000","last_became_peered":"2024-04-25T08:51:58.688099+0000","last_unstale":"2024-04-25T08:51:59.682613+0000","last_undegraded":"2024-04-25T08:51:59.682613+0000","last_fullsized":"2024-04-25T08:51:59.682613+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:26.508708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683248+0000","last_change":"2024-04-25T08:51:58.680453+0000","last_active":"2024-04-25T08:51:58.683248+0000","last_peered":"2024-04-25T08:51:58.683248+0000","last_clean":"2024-04-25T08:51:58.683248+0000","last_became_active":"2024-04-25T08:51:58.680171+0000","last_became_peered":"2024-04-25T08:51:58.680171+0000","last_unstale":"2024-04-25T08:51:58.683248+0000","last_undegraded":"2024-04-25T08:51:58.683248+0000","last_fullsized":"2024-04-25T08:51:58.683248+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688623+0000","last_change":"2024-04-25T08:51:58.679406+0000","last_active":"2024-04-25T08:51:59.688623+0000","last_peered":"2024-04-25T08:51:59.688623+0000","last_clean":"2024-04-25T08:51:59.688623+0000","last_became_active":"2024-04-25T08:51:58.678753+0000","last_became_peered":"2024-04-25T08:51:58.678753+0000","last_unstale":"2024-04-25T08:51:59.688623+0000","last_undegraded":"2024-04-25T08:51:59.688623+0000","last_fullsized":"2024-04-25T08:51:59.688623+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687751+0000","last_change":"2024-04-25T08:51:58.690427+0000","last_active":"2024-04-25T08:51:59.687751+0000","last_peered":"2024-04-25T08:51:59.687751+0000","last_clean":"2024-04-25T08:51:59.687751+0000","last_became_active":"2024-04-25T08:51:58.690143+0000","last_became_peered":"2024-04-25T08:51:58.690143+0000","last_unstale":"2024-04-25T08:51:59.687751+0000","last_undegraded":"2024-04-25T08:51:59.687751+0000","last_fullsized":"2024-04-25T08:51:59.687751+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:07.849932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372272+0000","last_change":"2024-04-25T08:51:58.698476+0000","last_active":"2024-04-25T08:52:00.372272+0000","last_peered":"2024-04-25T08:52:00.372272+0000","last_clean":"2024-04-25T08:52:00.372272+0000","last_became_active":"2024-04-25T08:51:58.698215+0000","last_became_peered":"2024-04-25T08:51:58.698215+0000","last_unstale":"2024-04-25T08:52:00.372272+0000","last_undegraded":"2024-04-25T08:52:00.372272+0000","last_fullsized":"2024-04-25T08:52:00.372272+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:19.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688390+0000","last_change":"2024-04-25T08:51:58.690909+0000","last_active":"2024-04-25T08:51:59.688390+0000","last_peered":"2024-04-25T08:51:59.688390+0000","last_clean":"2024-04-25T08:51:59.688390+0000","last_became_active":"2024-04-25T08:51:58.690625+0000","last_became_peered":"2024-04-25T08:51:58.690625+0000","last_unstale":"2024-04-25T08:51:59.688390+0000","last_undegraded":"2024-04-25T08:51:59.688390+0000","last_fullsized":"2024-04-25T08:51:59.688390+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688145+0000","last_change":"2024-04-25T08:51:58.691825+0000","last_active":"2024-04-25T08:51:59.688145+0000","last_peered":"2024-04-25T08:51:59.688145+0000","last_clean":"2024-04-25T08:51:59.688145+0000","last_became_active":"2024-04-25T08:51:58.688552+0000","last_became_peered":"2024-04-25T08:51:58.688552+0000","last_unstale":"2024-04-25T08:51:59.688145+0000","last_undegraded":"2024-04-25T08:51:59.688145+0000","last_fullsized":"2024-04-25T08:51:59.688145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:09.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699338+0000","last_change":"2024-04-25T08:51:58.686310+0000","last_active":"2024-04-25T08:51:58.699338+0000","last_peered":"2024-04-25T08:51:58.699338+0000","last_clean":"2024-04-25T08:51:58.699338+0000","last_became_active":"2024-04-25T08:51:58.685165+0000","last_became_peered":"2024-04-25T08:51:58.685165+0000","last_unstale":"2024-04-25T08:51:58.699338+0000","last_undegraded":"2024-04-25T08:51:58.699338+0000","last_fullsized":"2024-04-25T08:51:58.699338+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372273+0000","last_change":"2024-04-25T08:51:58.690610+0000","last_active":"2024-04-25T08:52:00.372273+0000","last_peered":"2024-04-25T08:52:00.372273+0000","last_clean":"2024-04-25T08:52:00.372273+0000","last_became_active":"2024-04-25T08:51:58.690279+0000","last_became_peered":"2024-04-25T08:51:58.690279+0000","last_unstale":"2024-04-25T08:52:00.372273+0000","last_undegraded":"2024-04-25T08:52:00.372273+0000","last_fullsized":"2024-04-25T08:52:00.372273+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:38.266138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688664+0000","last_change":"2024-04-25T08:51:58.701180+0000","last_active":"2024-04-25T08:51:59.688664+0000","last_peered":"2024-04-25T08:51:59.688664+0000","last_clean":"2024-04-25T08:51:59.688664+0000","last_became_active":"2024-04-25T08:51:58.700888+0000","last_became_peered":"2024-04-25T08:51:58.700888+0000","last_unstale":"2024-04-25T08:51:59.688664+0000","last_undegraded":"2024-04-25T08:51:59.688664+0000","last_fullsized":"2024-04-25T08:51:59.688664+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372225+0000","last_change":"2024-04-25T08:51:58.690756+0000","last_active":"2024-04-25T08:52:00.372225+0000","last_peered":"2024-04-25T08:52:00.372225+0000","last_clean":"2024-04-25T08:52:00.372225+0000","last_became_active":"2024-04-25T08:51:58.690222+0000","last_became_peered":"2024-04-25T08:51:58.690222+0000","last_unstale":"2024-04-25T08:52:00.372225+0000","last_undegraded":"2024-04-25T08:52:00.372225+0000","last_fullsized":"2024-04-25T08:52:00.372225+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:40.024839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699407+0000","last_change":"2024-04-25T08:51:58.687469+0000","last_active":"2024-04-25T08:51:58.699407+0000","last_peered":"2024-04-25T08:51:58.699407+0000","last_clean":"2024-04-25T08:51:58.699407+0000","last_became_active":"2024-04-25T08:51:58.687212+0000","last_became_peered":"2024-04-25T08:51:58.687212+0000","last_unstale":"2024-04-25T08:51:58.699407+0000","last_undegraded":"2024-04-25T08:51:58.699407+0000","last_fullsized":"2024-04-25T08:51:58.699407+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:54.079611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687732+0000","last_change":"2024-04-25T08:51:58.687508+0000","last_active":"2024-04-25T08:51:59.687732+0000","last_peered":"2024-04-25T08:51:59.687732+0000","last_clean":"2024-04-25T08:51:59.687732+0000","last_became_active":"2024-04-25T08:51:58.687248+0000","last_became_peered":"2024-04-25T08:51:58.687248+0000","last_unstale":"2024-04-25T08:51:59.687732+0000","last_undegraded":"2024-04-25T08:51:59.687732+0000","last_fullsized":"2024-04-25T08:51:59.687732+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:45.247106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.693011+0000","last_change":"2024-04-25T08:51:58.692141+0000","last_active":"2024-04-25T08:51:58.693011+0000","last_peered":"2024-04-25T08:51:58.693011+0000","last_clean":"2024-04-25T08:51:58.693011+0000","last_became_active":"2024-04-25T08:51:58.691300+0000","last_became_peered":"2024-04-25T08:51:58.691300+0000","last_unstale":"2024-04-25T08:51:58.693011+0000","last_undegraded":"2024-04-25T08:51:58.693011+0000","last_fullsized":"2024-04-25T08:51:58.693011+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"142'4","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.706805+0000","last_change":"2024-04-25T08:51:57.678935+0000","last_active":"2024-04-25T08:51:58.706805+0000","last_peered":"2024-04-25T08:51:58.706805+0000","last_clean":"2024-04-25T08:51:58.706805+0000","last_became_active":"2024-04-25T08:51:57.677554+0000","last_became_peered":"2024-04-25T08:51:57.677554+0000","last_unstale":"2024-04-25T08:51:58.706805+0000","last_undegraded":"2024-04-25T08:51:58.706805+0000","last_fullsized":"2024-04-25T08:51:58.706805+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:45.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.695534+0000","last_change":"2024-04-25T08:51:58.694894+0000","last_active":"2024-04-25T08:51:58.695534+0000","last_peered":"2024-04-25T08:51:58.695534+0000","last_clean":"2024-04-25T08:51:58.695534+0000","last_became_active":"2024-04-25T08:51:58.694640+0000","last_became_peered":"2024-04-25T08:51:58.694640+0000","last_unstale":"2024-04-25T08:51:58.695534+0000","last_undegraded":"2024-04-25T08:51:58.695534+0000","last_fullsized":"2024-04-25T08:51:58.695534+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:07.037339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702607+0000","last_change":"2024-04-25T08:51:57.680568+0000","last_active":"2024-04-25T08:51:59.702607+0000","last_peered":"2024-04-25T08:51:59.702607+0000","last_clean":"2024-04-25T08:51:59.702607+0000","last_became_active":"2024-04-25T08:51:57.680215+0000","last_became_peered":"2024-04-25T08:51:57.680215+0000","last_unstale":"2024-04-25T08:51:59.702607+0000","last_undegraded":"2024-04-25T08:51:59.702607+0000","last_fullsized":"2024-04-25T08:51:59.702607+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:57.119064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688298+0000","last_change":"2024-04-25T08:51:58.692557+0000","last_active":"2024-04-25T08:51:59.688298+0000","last_peered":"2024-04-25T08:51:59.688298+0000","last_clean":"2024-04-25T08:51:59.688298+0000","last_became_active":"2024-04-25T08:51:58.690870+0000","last_became_peered":"2024-04-25T08:51:58.690870+0000","last_unstale":"2024-04-25T08:51:59.688298+0000","last_undegraded":"2024-04-25T08:51:59.688298+0000","last_fullsized":"2024-04-25T08:51:59.688298+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702775+0000","last_change":"2024-04-25T08:51:57.680346+0000","last_active":"2024-04-25T08:51:59.702775+0000","last_peered":"2024-04-25T08:51:59.702775+0000","last_clean":"2024-04-25T08:51:59.702775+0000","last_became_active":"2024-04-25T08:51:57.679834+0000","last_became_peered":"2024-04-25T08:51:57.679834+0000","last_unstale":"2024-04-25T08:51:59.702775+0000","last_undegraded":"2024-04-25T08:51:59.702775+0000","last_fullsized":"2024-04-25T08:51:59.702775+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:03.764385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702725+0000","last_change":"2024-04-25T08:51:58.683999+0000","last_active":"2024-04-25T08:51:59.702725+0000","last_peered":"2024-04-25T08:51:59.702725+0000","last_clean":"2024-04-25T08:51:59.702725+0000","last_became_active":"2024-04-25T08:51:58.683686+0000","last_became_peered":"2024-04-25T08:51:58.683686+0000","last_unstale":"2024-04-25T08:51:59.702725+0000","last_undegraded":"2024-04-25T08:51:59.702725+0000","last_fullsized":"2024-04-25T08:51:59.702725+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.705507+0000","last_change":"2024-04-25T08:51:57.684784+0000","last_active":"2024-04-25T08:51:58.705507+0000","last_peered":"2024-04-25T08:51:58.705507+0000","last_clean":"2024-04-25T08:51:58.705507+0000","last_became_active":"2024-04-25T08:51:57.684270+0000","last_became_peered":"2024-04-25T08:51:57.684270+0000","last_unstale":"2024-04-25T08:51:58.705507+0000","last_undegraded":"2024-04-25T08:51:58.705507+0000","last_fullsized":"2024-04-25T08:51:58.705507+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:59.186072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682473+0000","last_change":"2024-04-25T08:51:58.696589+0000","last_active":"2024-04-25T08:51:59.682473+0000","last_peered":"2024-04-25T08:51:59.682473+0000","last_clean":"2024-04-25T08:51:59.682473+0000","last_became_active":"2024-04-25T08:51:58.696283+0000","last_became_peered":"2024-04-25T08:51:58.696283+0000","last_unstale":"2024-04-25T08:51:59.682473+0000","last_undegraded":"2024-04-25T08:51:59.682473+0000","last_fullsized":"2024-04-25T08:51:59.682473+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:25.100007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688776+0000","last_change":"2024-04-25T08:51:57.681697+0000","last_active":"2024-04-25T08:51:59.688776+0000","last_peered":"2024-04-25T08:51:59.688776+0000","last_clean":"2024-04-25T08:51:59.688776+0000","last_became_active":"2024-04-25T08:51:57.681217+0000","last_became_peered":"2024-04-25T08:51:57.681217+0000","last_unstale":"2024-04-25T08:51:59.688776+0000","last_undegraded":"2024-04-25T08:51:59.688776+0000","last_fullsized":"2024-04-25T08:51:59.688776+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:22.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001305+0000","last_change":"2024-04-25T08:51:58.698064+0000","last_active":"2024-04-25T08:52:01.001305+0000","last_peered":"2024-04-25T08:52:01.001305+0000","last_clean":"2024-04-25T08:52:01.001305+0000","last_became_active":"2024-04-25T08:51:58.697736+0000","last_became_peered":"2024-04-25T08:51:58.697736+0000","last_unstale":"2024-04-25T08:52:01.001305+0000","last_undegraded":"2024-04-25T08:52:01.001305+0000","last_fullsized":"2024-04-25T08:52:01.001305+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.705098+0000","last_change":"2024-04-25T08:51:57.679244+0000","last_active":"2024-04-25T08:51:58.705098+0000","last_peered":"2024-04-25T08:51:58.705098+0000","last_clean":"2024-04-25T08:51:58.705098+0000","last_became_active":"2024-04-25T08:51:57.677491+0000","last_became_peered":"2024-04-25T08:51:57.677491+0000","last_unstale":"2024-04-25T08:51:58.705098+0000","last_undegraded":"2024-04-25T08:51:58.705098+0000","last_fullsized":"2024-04-25T08:51:58.705098+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:46.158444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.691912+0000","last_change":"2024-04-25T08:51:58.688383+0000","last_active":"2024-04-25T08:51:58.691912+0000","last_peered":"2024-04-25T08:51:58.691912+0000","last_clean":"2024-04-25T08:51:58.691912+0000","last_became_active":"2024-04-25T08:51:58.688072+0000","last_became_peered":"2024-04-25T08:51:58.688072+0000","last_unstale":"2024-04-25T08:51:58.691912+0000","last_undegraded":"2024-04-25T08:51:58.691912+0000","last_fullsized":"2024-04-25T08:51:58.691912+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687761+0000","last_change":"2024-04-25T08:51:57.679918+0000","last_active":"2024-04-25T08:51:59.687761+0000","last_peered":"2024-04-25T08:51:59.687761+0000","last_clean":"2024-04-25T08:51:59.687761+0000","last_became_active":"2024-04-25T08:51:57.679656+0000","last_became_peered":"2024-04-25T08:51:57.679656+0000","last_unstale":"2024-04-25T08:51:59.687761+0000","last_undegraded":"2024-04-25T08:51:59.687761+0000","last_fullsized":"2024-04-25T08:51:59.687761+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:40.337985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687569+0000","last_change":"2024-04-25T08:51:58.691560+0000","last_active":"2024-04-25T08:51:59.687569+0000","last_peered":"2024-04-25T08:51:59.687569+0000","last_clean":"2024-04-25T08:51:59.687569+0000","last_became_active":"2024-04-25T08:51:58.688811+0000","last_became_peered":"2024-04-25T08:51:58.688811+0000","last_unstale":"2024-04-25T08:51:59.687569+0000","last_undegraded":"2024-04-25T08:51:59.687569+0000","last_fullsized":"2024-04-25T08:51:59.687569+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:21.032824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.675061+0000","last_change":"2024-04-25T08:51:57.675383+0000","last_active":"2024-04-25T08:51:58.675061+0000","last_peered":"2024-04-25T08:51:58.675061+0000","last_clean":"2024-04-25T08:51:58.675061+0000","last_became_active":"2024-04-25T08:51:57.675111+0000","last_became_peered":"2024-04-25T08:51:57.675111+0000","last_unstale":"2024-04-25T08:51:58.675061+0000","last_undegraded":"2024-04-25T08:51:58.675061+0000","last_fullsized":"2024-04-25T08:51:58.675061+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:03.764385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688370+0000","last_change":"2024-04-25T08:51:58.690638+0000","last_active":"2024-04-25T08:51:59.688370+0000","last_peered":"2024-04-25T08:51:59.688370+0000","last_clean":"2024-04-25T08:51:59.688370+0000","last_became_active":"2024-04-25T08:51:58.690364+0000","last_became_peered":"2024-04-25T08:51:58.690364+0000","last_unstale":"2024-04-25T08:51:59.688370+0000","last_undegraded":"2024-04-25T08:51:59.688370+0000","last_fullsized":"2024-04-25T08:51:59.688370+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702674+0000","last_change":"2024-04-25T08:51:57.677353+0000","last_active":"2024-04-25T08:51:59.702674+0000","last_peered":"2024-04-25T08:51:59.702674+0000","last_clean":"2024-04-25T08:51:59.702674+0000","last_became_active":"2024-04-25T08:51:57.676926+0000","last_became_peered":"2024-04-25T08:51:57.676926+0000","last_unstale":"2024-04-25T08:51:59.702674+0000","last_undegraded":"2024-04-25T08:51:59.702674+0000","last_fullsized":"2024-04-25T08:51:59.702674+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:50.800138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372377+0000","last_change":"2024-04-25T08:51:58.687775+0000","last_active":"2024-04-25T08:52:00.372377+0000","last_peered":"2024-04-25T08:52:00.372377+0000","last_clean":"2024-04-25T08:52:00.372377+0000","last_became_active":"2024-04-25T08:51:58.687473+0000","last_became_peered":"2024-04-25T08:51:58.687473+0000","last_unstale":"2024-04-25T08:52:00.372377+0000","last_undegraded":"2024-04-25T08:52:00.372377+0000","last_fullsized":"2024-04-25T08:52:00.372377+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:51.987904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688885+0000","last_change":"2024-04-25T08:51:57.679237+0000","last_active":"2024-04-25T08:51:59.688885+0000","last_peered":"2024-04-25T08:51:59.688885+0000","last_clean":"2024-04-25T08:51:59.688885+0000","last_became_active":"2024-04-25T08:51:57.678926+0000","last_became_peered":"2024-04-25T08:51:57.678926+0000","last_unstale":"2024-04-25T08:51:59.688885+0000","last_undegraded":"2024-04-25T08:51:59.688885+0000","last_fullsized":"2024-04-25T08:51:59.688885+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:25.169115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372383+0000","last_change":"2024-04-25T08:51:58.687200+0000","last_active":"2024-04-25T08:52:00.372383+0000","last_peered":"2024-04-25T08:52:00.372383+0000","last_clean":"2024-04-25T08:52:00.372383+0000","last_became_active":"2024-04-25T08:51:58.686933+0000","last_became_peered":"2024-04-25T08:51:58.686933+0000","last_unstale":"2024-04-25T08:52:00.372383+0000","last_undegraded":"2024-04-25T08:52:00.372383+0000","last_fullsized":"2024-04-25T08:52:00.372383+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:42.491032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"142'3","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372348+0000","last_change":"2024-04-25T08:51:57.676927+0000","last_active":"2024-04-25T08:52:00.372348+0000","last_peered":"2024-04-25T08:52:00.372348+0000","last_clean":"2024-04-25T08:52:00.372348+0000","last_became_active":"2024-04-25T08:51:57.676667+0000","last_became_peered":"2024-04-25T08:51:57.676667+0000","last_unstale":"2024-04-25T08:52:00.372348+0000","last_undegraded":"2024-04-25T08:52:00.372348+0000","last_fullsized":"2024-04-25T08:52:00.372348+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:54.058859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687906+0000","last_change":"2024-04-25T08:51:58.691366+0000","last_active":"2024-04-25T08:51:59.687906+0000","last_peered":"2024-04-25T08:51:59.687906+0000","last_clean":"2024-04-25T08:51:59.687906+0000","last_became_active":"2024-04-25T08:51:58.689980+0000","last_became_peered":"2024-04-25T08:51:58.689980+0000","last_unstale":"2024-04-25T08:51:59.687906+0000","last_undegraded":"2024-04-25T08:51:59.687906+0000","last_fullsized":"2024-04-25T08:51:59.687906+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"142'2","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.707119+0000","last_change":"2024-04-25T08:51:57.679370+0000","last_active":"2024-04-25T08:51:58.707119+0000","last_peered":"2024-04-25T08:51:58.707119+0000","last_clean":"2024-04-25T08:51:58.707119+0000","last_became_active":"2024-04-25T08:51:57.678638+0000","last_became_peered":"2024-04-25T08:51:57.678638+0000","last_unstale":"2024-04-25T08:51:58.707119+0000","last_undegraded":"2024-04-25T08:51:58.707119+0000","last_fullsized":"2024-04-25T08:51:58.707119+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:20.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.692782+0000","last_change":"2024-04-25T08:51:58.691999+0000","last_active":"2024-04-25T08:51:58.692782+0000","last_peered":"2024-04-25T08:51:58.692782+0000","last_clean":"2024-04-25T08:51:58.692782+0000","last_became_active":"2024-04-25T08:51:58.691704+0000","last_became_peered":"2024-04-25T08:51:58.691704+0000","last_unstale":"2024-04-25T08:51:58.692782+0000","last_undegraded":"2024-04-25T08:51:58.692782+0000","last_fullsized":"2024-04-25T08:51:58.692782+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001461+0000","last_change":"2024-04-25T08:51:57.685351+0000","last_active":"2024-04-25T08:52:01.001461+0000","last_peered":"2024-04-25T08:52:01.001461+0000","last_clean":"2024-04-25T08:52:01.001461+0000","last_became_active":"2024-04-25T08:51:57.684940+0000","last_became_peered":"2024-04-25T08:51:57.684940+0000","last_unstale":"2024-04-25T08:52:01.001461+0000","last_undegraded":"2024-04-25T08:52:01.001461+0000","last_fullsized":"2024-04-25T08:52:01.001461+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:14.277326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699329+0000","last_change":"2024-04-25T08:51:58.684758+0000","last_active":"2024-04-25T08:51:58.699329+0000","last_peered":"2024-04-25T08:51:58.699329+0000","last_clean":"2024-04-25T08:51:58.699329+0000","last_became_active":"2024-04-25T08:51:58.684486+0000","last_became_peered":"2024-04-25T08:51:58.684486+0000","last_unstale":"2024-04-25T08:51:58.699329+0000","last_undegraded":"2024-04-25T08:51:58.699329+0000","last_fullsized":"2024-04-25T08:51:58.699329+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001466+0000","last_change":"2024-04-25T08:51:57.676880+0000","last_active":"2024-04-25T08:52:01.001466+0000","last_peered":"2024-04-25T08:52:01.001466+0000","last_clean":"2024-04-25T08:52:01.001466+0000","last_became_active":"2024-04-25T08:51:57.676575+0000","last_became_peered":"2024-04-25T08:51:57.676575+0000","last_unstale":"2024-04-25T08:52:01.001466+0000","last_undegraded":"2024-04-25T08:52:01.001466+0000","last_fullsized":"2024-04-25T08:52:01.001466+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:45.695332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.687914+0000","last_change":"2024-04-25T08:51:58.686307+0000","last_active":"2024-04-25T08:51:58.687914+0000","last_peered":"2024-04-25T08:51:58.687914+0000","last_clean":"2024-04-25T08:51:58.687914+0000","last_became_active":"2024-04-25T08:51:58.685998+0000","last_became_peered":"2024-04-25T08:51:58.685998+0000","last_unstale":"2024-04-25T08:51:58.687914+0000","last_undegraded":"2024-04-25T08:51:58.687914+0000","last_fullsized":"2024-04-25T08:51:58.687914+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"142'8","reported_seq":22,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687356+0000","last_change":"2024-04-25T08:51:57.674597+0000","last_active":"2024-04-25T08:51:59.687356+0000","last_peered":"2024-04-25T08:51:59.687356+0000","last_clean":"2024-04-25T08:51:59.687356+0000","last_became_active":"2024-04-25T08:51:57.674343+0000","last_became_peered":"2024-04-25T08:51:57.674343+0000","last_unstale":"2024-04-25T08:51:59.687356+0000","last_undegraded":"2024-04-25T08:51:59.687356+0000","last_fullsized":"2024-04-25T08:51:59.687356+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:42.141421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702458+0000","last_change":"2024-04-25T08:51:58.685128+0000","last_active":"2024-04-25T08:51:59.702458+0000","last_peered":"2024-04-25T08:51:59.702458+0000","last_clean":"2024-04-25T08:51:59.702458+0000","last_became_active":"2024-04-25T08:51:58.684819+0000","last_became_peered":"2024-04-25T08:51:58.684819+0000","last_unstale":"2024-04-25T08:51:59.702458+0000","last_undegraded":"2024-04-25T08:51:59.702458+0000","last_fullsized":"2024-04-25T08:51:59.702458+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372156+0000","last_change":"2024-04-25T08:51:57.673131+0000","last_active":"2024-04-25T08:52:00.372156+0000","last_peered":"2024-04-25T08:52:00.372156+0000","last_clean":"2024-04-25T08:52:00.372156+0000","last_became_active":"2024-04-25T08:51:57.672351+0000","last_became_peered":"2024-04-25T08:51:57.672351+0000","last_unstale":"2024-04-25T08:52:00.372156+0000","last_undegraded":"2024-04-25T08:52:00.372156+0000","last_fullsized":"2024-04-25T08:52:00.372156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:27.669933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702702+0000","last_change":"2024-04-25T08:51:58.687945+0000","last_active":"2024-04-25T08:51:59.702702+0000","last_peered":"2024-04-25T08:51:59.702702+0000","last_clean":"2024-04-25T08:51:59.702702+0000","last_became_active":"2024-04-25T08:51:58.687329+0000","last_became_peered":"2024-04-25T08:51:58.687329+0000","last_unstale":"2024-04-25T08:51:59.702702+0000","last_undegraded":"2024-04-25T08:51:59.702702+0000","last_fullsized":"2024-04-25T08:51:59.702702+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702620+0000","last_change":"2024-04-25T08:51:57.675051+0000","last_active":"2024-04-25T08:51:59.702620+0000","last_peered":"2024-04-25T08:51:59.702620+0000","last_clean":"2024-04-25T08:51:59.702620+0000","last_became_active":"2024-04-25T08:51:57.674775+0000","last_became_peered":"2024-04-25T08:51:57.674775+0000","last_unstale":"2024-04-25T08:51:59.702620+0000","last_undegraded":"2024-04-25T08:51:59.702620+0000","last_fullsized":"2024-04-25T08:51:59.702620+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:35.148119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688764+0000","last_change":"2024-04-25T08:51:58.694109+0000","last_active":"2024-04-25T08:51:59.688764+0000","last_peered":"2024-04-25T08:51:59.688764+0000","last_clean":"2024-04-25T08:51:59.688764+0000","last_became_active":"2024-04-25T08:51:58.693751+0000","last_became_peered":"2024-04-25T08:51:58.693751+0000","last_unstale":"2024-04-25T08:51:59.688764+0000","last_undegraded":"2024-04-25T08:51:59.688764+0000","last_fullsized":"2024-04-25T08:51:59.688764+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"142'1","reported_seq":13,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.704800+0000","last_change":"2024-04-25T08:51:57.681447+0000","last_active":"2024-04-25T08:51:58.704800+0000","last_peered":"2024-04-25T08:51:58.704800+0000","last_clean":"2024-04-25T08:51:58.704800+0000","last_became_active":"2024-04-25T08:51:57.680908+0000","last_became_peered":"2024-04-25T08:51:57.680908+0000","last_unstale":"2024-04-25T08:51:58.704800+0000","last_undegraded":"2024-04-25T08:51:58.704800+0000","last_fullsized":"2024-04-25T08:51:58.704800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:44.242903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688440+0000","last_change":"2024-04-25T08:51:58.692191+0000","last_active":"2024-04-25T08:51:59.688440+0000","last_peered":"2024-04-25T08:51:59.688440+0000","last_clean":"2024-04-25T08:51:59.688440+0000","last_became_active":"2024-04-25T08:51:58.691907+0000","last_became_peered":"2024-04-25T08:51:58.691907+0000","last_unstale":"2024-04-25T08:51:59.688440+0000","last_undegraded":"2024-04-25T08:51:59.688440+0000","last_fullsized":"2024-04-25T08:51:59.688440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001524+0000","last_change":"2024-04-25T08:51:57.683826+0000","last_active":"2024-04-25T08:52:01.001524+0000","last_peered":"2024-04-25T08:52:01.001524+0000","last_clean":"2024-04-25T08:52:01.001524+0000","last_became_active":"2024-04-25T08:51:57.683526+0000","last_became_peered":"2024-04-25T08:51:57.683526+0000","last_unstale":"2024-04-25T08:52:01.001524+0000","last_undegraded":"2024-04-25T08:52:01.001524+0000","last_fullsized":"2024-04-25T08:52:01.001524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:19.949576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702371+0000","last_change":"2024-04-25T08:51:58.687702+0000","last_active":"2024-04-25T08:51:59.702371+0000","last_peered":"2024-04-25T08:51:59.702371+0000","last_clean":"2024-04-25T08:51:59.702371+0000","last_became_active":"2024-04-25T08:51:58.687428+0000","last_became_peered":"2024-04-25T08:51:58.687428+0000","last_unstale":"2024-04-25T08:51:59.702371+0000","last_undegraded":"2024-04-25T08:51:59.702371+0000","last_fullsized":"2024-04-25T08:51:59.702371+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682529+0000","last_change":"2024-04-25T08:51:57.685728+0000","last_active":"2024-04-25T08:51:59.682529+0000","last_peered":"2024-04-25T08:51:59.682529+0000","last_clean":"2024-04-25T08:51:59.682529+0000","last_became_active":"2024-04-25T08:51:57.685418+0000","last_became_peered":"2024-04-25T08:51:57.685418+0000","last_unstale":"2024-04-25T08:51:59.682529+0000","last_undegraded":"2024-04-25T08:51:59.682529+0000","last_fullsized":"2024-04-25T08:51:59.682529+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:16.987390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.691958+0000","last_change":"2024-04-25T08:51:58.690815+0000","last_active":"2024-04-25T08:51:58.691958+0000","last_peered":"2024-04-25T08:51:58.691958+0000","last_clean":"2024-04-25T08:51:58.691958+0000","last_became_active":"2024-04-25T08:51:58.689859+0000","last_became_peered":"2024-04-25T08:51:58.689859+0000","last_unstale":"2024-04-25T08:51:58.691958+0000","last_undegraded":"2024-04-25T08:51:58.691958+0000","last_fullsized":"2024-04-25T08:51:58.691958+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687554+0000","last_change":"2024-04-25T08:51:57.683172+0000","last_active":"2024-04-25T08:51:59.687554+0000","last_peered":"2024-04-25T08:51:59.687554+0000","last_clean":"2024-04-25T08:51:59.687554+0000","last_became_active":"2024-04-25T08:51:57.682905+0000","last_became_peered":"2024-04-25T08:51:57.682905+0000","last_unstale":"2024-04-25T08:51:59.687554+0000","last_undegraded":"2024-04-25T08:51:59.687554+0000","last_fullsized":"2024-04-25T08:51:59.687554+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.724725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702362+0000","last_change":"2024-04-25T08:51:58.684054+0000","last_active":"2024-04-25T08:51:59.702362+0000","last_peered":"2024-04-25T08:51:59.702362+0000","last_clean":"2024-04-25T08:51:59.702362+0000","last_became_active":"2024-04-25T08:51:58.683726+0000","last_became_peered":"2024-04-25T08:51:58.683726+0000","last_unstale":"2024-04-25T08:51:59.702362+0000","last_undegraded":"2024-04-25T08:51:59.702362+0000","last_fullsized":"2024-04-25T08:51:59.702362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682403+0000","last_change":"2024-04-25T08:51:57.684720+0000","last_active":"2024-04-25T08:51:59.682403+0000","last_peered":"2024-04-25T08:51:59.682403+0000","last_clean":"2024-04-25T08:51:59.682403+0000","last_became_active":"2024-04-25T08:51:57.684468+0000","last_became_peered":"2024-04-25T08:51:57.684468+0000","last_unstale":"2024-04-25T08:51:59.682403+0000","last_undegraded":"2024-04-25T08:51:59.682403+0000","last_fullsized":"2024-04-25T08:51:59.682403+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:02.587687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699526+0000","last_change":"2024-04-25T08:51:58.698210+0000","last_active":"2024-04-25T08:51:58.699526+0000","last_peered":"2024-04-25T08:51:58.699526+0000","last_clean":"2024-04-25T08:51:58.699526+0000","last_became_active":"2024-04-25T08:51:58.697934+0000","last_became_peered":"2024-04-25T08:51:58.697934+0000","last_unstale":"2024-04-25T08:51:58.699526+0000","last_undegraded":"2024-04-25T08:51:58.699526+0000","last_fullsized":"2024-04-25T08:51:58.699526+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:41.342188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688698+0000","last_change":"2024-04-25T08:51:57.684696+0000","last_active":"2024-04-25T08:51:59.688698+0000","last_peered":"2024-04-25T08:51:59.688698+0000","last_clean":"2024-04-25T08:51:59.688698+0000","last_became_active":"2024-04-25T08:51:57.684380+0000","last_became_peered":"2024-04-25T08:51:57.684380+0000","last_unstale":"2024-04-25T08:51:59.688698+0000","last_undegraded":"2024-04-25T08:51:59.688698+0000","last_fullsized":"2024-04-25T08:51:59.688698+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:58.013246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.683413+0000","last_change":"2024-04-25T08:51:58.679751+0000","last_active":"2024-04-25T08:51:58.683413+0000","last_peered":"2024-04-25T08:51:58.683413+0000","last_clean":"2024-04-25T08:51:58.683413+0000","last_became_active":"2024-04-25T08:51:58.679472+0000","last_became_peered":"2024-04-25T08:51:58.679472+0000","last_unstale":"2024-04-25T08:51:58.683413+0000","last_undegraded":"2024-04-25T08:51:58.683413+0000","last_fullsized":"2024-04-25T08:51:58.683413+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:09.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001740+0000","last_change":"2024-04-25T08:51:57.684094+0000","last_active":"2024-04-25T08:52:01.001740+0000","last_peered":"2024-04-25T08:52:01.001740+0000","last_clean":"2024-04-25T08:52:01.001740+0000","last_became_active":"2024-04-25T08:51:57.683629+0000","last_became_peered":"2024-04-25T08:51:57.683629+0000","last_unstale":"2024-04-25T08:52:01.001740+0000","last_undegraded":"2024-04-25T08:52:01.001740+0000","last_fullsized":"2024-04-25T08:52:01.001740+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:07.130284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001675+0000","last_change":"2024-04-25T08:51:58.700932+0000","last_active":"2024-04-25T08:52:01.001675+0000","last_peered":"2024-04-25T08:52:01.001675+0000","last_clean":"2024-04-25T08:52:01.001675+0000","last_became_active":"2024-04-25T08:51:58.700672+0000","last_became_peered":"2024-04-25T08:51:58.700672+0000","last_unstale":"2024-04-25T08:52:01.001675+0000","last_undegraded":"2024-04-25T08:52:01.001675+0000","last_fullsized":"2024-04-25T08:52:01.001675+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"143'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.701616+0000","last_change":"2024-04-25T08:51:57.683105+0000","last_active":"2024-04-25T08:51:59.701616+0000","last_peered":"2024-04-25T08:51:59.701616+0000","last_clean":"2024-04-25T08:51:59.701616+0000","last_became_active":"2024-04-25T08:51:57.682754+0000","last_became_peered":"2024-04-25T08:51:57.682754+0000","last_unstale":"2024-04-25T08:51:59.701616+0000","last_undegraded":"2024-04-25T08:51:59.701616+0000","last_fullsized":"2024-04-25T08:51:59.701616+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:39.113507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688828+0000","last_change":"2024-04-25T08:51:58.693432+0000","last_active":"2024-04-25T08:51:59.688828+0000","last_peered":"2024-04-25T08:51:59.688828+0000","last_clean":"2024-04-25T08:51:59.688828+0000","last_became_active":"2024-04-25T08:51:58.691780+0000","last_became_peered":"2024-04-25T08:51:58.691780+0000","last_unstale":"2024-04-25T08:51:59.688828+0000","last_undegraded":"2024-04-25T08:51:59.688828+0000","last_fullsized":"2024-04-25T08:51:59.688828+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.681577+0000","last_change":"2024-04-25T08:51:57.684558+0000","last_active":"2024-04-25T08:51:58.681577+0000","last_peered":"2024-04-25T08:51:58.681577+0000","last_clean":"2024-04-25T08:51:58.681577+0000","last_became_active":"2024-04-25T08:51:57.684293+0000","last_became_peered":"2024-04-25T08:51:57.684293+0000","last_unstale":"2024-04-25T08:51:58.681577+0000","last_undegraded":"2024-04-25T08:51:58.681577+0000","last_fullsized":"2024-04-25T08:51:58.681577+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:06.845729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.699477+0000","last_change":"2024-04-25T08:51:58.693635+0000","last_active":"2024-04-25T08:51:58.699477+0000","last_peered":"2024-04-25T08:51:58.699477+0000","last_clean":"2024-04-25T08:51:58.699477+0000","last_became_active":"2024-04-25T08:51:58.693270+0000","last_became_peered":"2024-04-25T08:51:58.693270+0000","last_unstale":"2024-04-25T08:51:58.699477+0000","last_undegraded":"2024-04-25T08:51:58.699477+0000","last_fullsized":"2024-04-25T08:51:58.699477+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:50.949573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.676047+0000","last_change":"2024-04-25T08:51:57.681906+0000","last_active":"2024-04-25T08:51:58.676047+0000","last_peered":"2024-04-25T08:51:58.676047+0000","last_clean":"2024-04-25T08:51:58.676047+0000","last_became_active":"2024-04-25T08:51:57.681578+0000","last_became_peered":"2024-04-25T08:51:57.681578+0000","last_unstale":"2024-04-25T08:51:58.676047+0000","last_undegraded":"2024-04-25T08:51:58.676047+0000","last_fullsized":"2024-04-25T08:51:58.676047+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:21.385739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688362+0000","last_change":"2024-04-25T08:51:58.691133+0000","last_active":"2024-04-25T08:51:59.688362+0000","last_peered":"2024-04-25T08:51:59.688362+0000","last_clean":"2024-04-25T08:51:59.688362+0000","last_became_active":"2024-04-25T08:51:58.690826+0000","last_became_peered":"2024-04-25T08:51:58.690826+0000","last_unstale":"2024-04-25T08:51:59.688362+0000","last_undegraded":"2024-04-25T08:51:59.688362+0000","last_fullsized":"2024-04-25T08:51:59.688362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687676+0000","last_change":"2024-04-25T08:51:57.673573+0000","last_active":"2024-04-25T08:51:59.687676+0000","last_peered":"2024-04-25T08:51:59.687676+0000","last_clean":"2024-04-25T08:51:59.687676+0000","last_became_active":"2024-04-25T08:51:57.673302+0000","last_became_peered":"2024-04-25T08:51:57.673302+0000","last_unstale":"2024-04-25T08:51:59.687676+0000","last_undegraded":"2024-04-25T08:51:59.687676+0000","last_fullsized":"2024-04-25T08:51:59.687676+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:22.616954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001327+0000","last_change":"2024-04-25T08:51:58.700123+0000","last_active":"2024-04-25T08:52:01.001327+0000","last_peered":"2024-04-25T08:52:01.001327+0000","last_clean":"2024-04-25T08:52:01.001327+0000","last_became_active":"2024-04-25T08:51:58.699870+0000","last_became_peered":"2024-04-25T08:51:58.699870+0000","last_unstale":"2024-04-25T08:52:01.001327+0000","last_undegraded":"2024-04-25T08:52:01.001327+0000","last_fullsized":"2024-04-25T08:52:01.001327+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372214+0000","last_change":"2024-04-25T08:51:57.683935+0000","last_active":"2024-04-25T08:52:00.372214+0000","last_peered":"2024-04-25T08:52:00.372214+0000","last_clean":"2024-04-25T08:52:00.372214+0000","last_became_active":"2024-04-25T08:51:57.683646+0000","last_became_peered":"2024-04-25T08:51:57.683646+0000","last_unstale":"2024-04-25T08:52:00.372214+0000","last_undegraded":"2024-04-25T08:52:00.372214+0000","last_fullsized":"2024-04-25T08:52:00.372214+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:14.617656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-04-25T08:51:58.688536+0000","last_change":"2024-04-25T08:51:58.686967+0000","last_active":"2024-04-25T08:51:58.688536+0000","last_peered":"2024-04-25T08:51:58.688536+0000","last_clean":"2024-04-25T08:51:58.688536+0000","last_became_active":"2024-04-25T08:51:58.686651+0000","last_became_peered":"2024-04-25T08:51:58.686651+0000","last_unstale":"2024-04-25T08:51:58.688536+0000","last_undegraded":"2024-04-25T08:51:58.688536+0000","last_fullsized":"2024-04-25T08:51:58.688536+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687877+0000","last_change":"2024-04-25T08:51:57.679212+0000","last_active":"2024-04-25T08:51:59.687877+0000","last_peered":"2024-04-25T08:51:59.687877+0000","last_clean":"2024-04-25T08:51:59.687877+0000","last_became_active":"2024-04-25T08:51:57.678913+0000","last_became_peered":"2024-04-25T08:51:57.678913+0000","last_unstale":"2024-04-25T08:51:59.687877+0000","last_undegraded":"2024-04-25T08:51:59.687877+0000","last_fullsized":"2024-04-25T08:51:59.687877+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:18.043975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688665+0000","last_change":"2024-04-25T08:51:58.702307+0000","last_active":"2024-04-25T08:51:59.688665+0000","last_peered":"2024-04-25T08:51:59.688665+0000","last_clean":"2024-04-25T08:51:59.688665+0000","last_became_active":"2024-04-25T08:51:58.702035+0000","last_became_peered":"2024-04-25T08:51:58.702035+0000","last_unstale":"2024-04-25T08:51:59.688665+0000","last_undegraded":"2024-04-25T08:51:59.688665+0000","last_fullsized":"2024-04-25T08:51:59.688665+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702275+0000","last_change":"2024-04-25T08:51:57.673963+0000","last_active":"2024-04-25T08:51:59.702275+0000","last_peered":"2024-04-25T08:51:59.702275+0000","last_clean":"2024-04-25T08:51:59.702275+0000","last_became_active":"2024-04-25T08:51:57.673682+0000","last_became_peered":"2024-04-25T08:51:57.673682+0000","last_unstale":"2024-04-25T08:51:59.702275+0000","last_undegraded":"2024-04-25T08:51:59.702275+0000","last_fullsized":"2024-04-25T08:51:59.702275+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:40.470761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688096+0000","last_change":"2024-04-25T08:51:58.695857+0000","last_active":"2024-04-25T08:51:59.688096+0000","last_peered":"2024-04-25T08:51:59.688096+0000","last_clean":"2024-04-25T08:51:59.688096+0000","last_became_active":"2024-04-25T08:51:58.695470+0000","last_became_peered":"2024-04-25T08:51:58.695470+0000","last_unstale":"2024-04-25T08:51:59.688096+0000","last_undegraded":"2024-04-25T08:51:59.688096+0000","last_fullsized":"2024-04-25T08:51:59.688096+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"142'6","reported_seq":20,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682707+0000","last_change":"2024-04-25T08:51:57.685128+0000","last_active":"2024-04-25T08:51:59.682707+0000","last_peered":"2024-04-25T08:51:59.682707+0000","last_clean":"2024-04-25T08:51:59.682707+0000","last_became_active":"2024-04-25T08:51:57.684874+0000","last_became_peered":"2024-04-25T08:51:57.684874+0000","last_unstale":"2024-04-25T08:51:59.682707+0000","last_undegraded":"2024-04-25T08:51:59.682707+0000","last_fullsized":"2024-04-25T08:51:59.682707+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:35.538961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":396,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702330+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:51:59.702330+0000","last_peered":"2024-04-25T08:51:59.702330+0000","last_clean":"2024-04-25T08:51:59.702330+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:51:59.702330+0000","last_undegraded":"2024-04-25T08:51:59.702330+0000","last_fullsized":"2024-04-25T08:51:59.702330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":2392064,"data_stored":1428303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":837983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46824,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325016,"statfs":{"total":96636764160,"available":96588816384,"internally_reserved":0,"allocated":1794048,"data_stored":837913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1806336,"data_stored":839525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59304,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312536,"statfs":{"total":96636764160,"available":96576036864,"internally_reserved":0,"allocated":1789952,"data_stored":831837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50984,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1789952,"data_stored":831333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":831291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51584,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320256,"statfs":{"total":96636764160,"available":96583942144,"internally_reserved":0,"allocated":2412544,"data_stored":1430599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:52:03.938 INFO:tasks.ceph.mds.a.smithi172.stderr:2024-04-25T08:52:03.948+0000 7f7c3505a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T08:52:06.620 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:52:06.732 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.742+0000 7f0da0283640 1 Processor -- start 2024-04-25T08:52:06.733 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.742+0000 7f0da0283640 1 -- start start 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.743+0000 7f0da0283640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0d980cc8e0 0x7f0d981625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.743+0000 7f0da0283640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0d980d1810 0x7f0d980d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.743+0000 7f0da0283640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d980cce50 con 0x7f0d9815dc90 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.743+0000 7f0da0283640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d980d21c0 con 0x7f0d980d1810 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.743+0000 7f0da0283640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d98161af0 con 0x7f0d980cc8e0 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.743+0000 7f0d9e820640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0d980d1810 0x7f0d980d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.743+0000 7f0d9e820640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0d980d1810 0x7f0d980d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37128/0 (socket says 172.21.15.172:37128) 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.743+0000 7f0d9e820640 1 -- 172.21.15.172:0/1250153246 learned_addr learned my addr 172.21.15.172:0/1250153246 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.744+0000 7f0d9e820640 1 -- 172.21.15.172:0/1250153246 >> v2:172.21.15.186:3300/0 conn(0x7f0d980cc8e0 msgr2=0x7f0d981625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.744+0000 7f0d9e820640 1 --2- 172.21.15.172:0/1250153246 >> v2:172.21.15.186:3300/0 conn(0x7f0d980cc8e0 0x7f0d981625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.734 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.744+0000 7f0d9e820640 1 -- 172.21.15.172:0/1250153246 >> v1:172.21.15.172:6789/0 conn(0x7f0d9815dc90 legacy=0x7f0d9815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:06.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.744+0000 7f0d9e820640 1 -- 172.21.15.172:0/1250153246 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d98161dd0 con 0x7f0d980d1810 2024-04-25T08:52:06.735 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.744+0000 7f0d9d01d640 1 -- 172.21.15.172:0/1250153246 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529207584 0 0) 0x7f0d980cce50 con 0x7f0d9815dc90 2024-04-25T08:52:06.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.744+0000 7f0d9e820640 1 --2- 172.21.15.172:0/1250153246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980d1810 0x7f0d980d1c80 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f0d980c88a0 tx=0x7f0d9002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3734d54801a688 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:06.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.744+0000 7f0d9d01d640 1 -- 172.21.15.172:0/1250153246 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90036070 con 0x7f0d980d1810 2024-04-25T08:52:06.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.744+0000 7f0d9d01d640 1 -- 172.21.15.172:0/1250153246 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d90031600 con 0x7f0d980d1810 2024-04-25T08:52:06.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.744+0000 7f0d9d01d640 1 -- 172.21.15.172:0/1250153246 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d900319d0 con 0x7f0d980d1810 2024-04-25T08:52:06.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.745+0000 7f0da0283640 1 -- 172.21.15.172:0/1250153246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980d1810 msgr2=0x7f0d980d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:06.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.745+0000 7f0da0283640 1 --2- 172.21.15.172:0/1250153246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980d1810 0x7f0d980d1c80 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f0d980c88a0 tx=0x7f0d9002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.745+0000 7f0da0283640 1 -- 172.21.15.172:0/1250153246 shutdown_connections 2024-04-25T08:52:06.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.745+0000 7f0da0283640 1 --2- 172.21.15.172:0/1250153246 >> v2:172.21.15.186:3300/0 conn(0x7f0d980cc8e0 0x7f0d981625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.736 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.745+0000 7f0da0283640 1 --2- 172.21.15.172:0/1250153246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980d1810 0x7f0d980d1c80 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.745+0000 7f0da0283640 1 -- 172.21.15.172:0/1250153246 >> 172.21.15.172:0/1250153246 conn(0x7f0d9806f590 msgr2=0x7f0d9806f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:06.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.745+0000 7f0da0283640 1 -- 172.21.15.172:0/1250153246 shutdown_connections 2024-04-25T08:52:06.737 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.745+0000 7f0da0283640 1 -- 172.21.15.172:0/1250153246 wait complete. 2024-04-25T08:52:06.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.746+0000 7f0da0283640 1 Processor -- start 2024-04-25T08:52:06.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.746+0000 7f0da0283640 1 -- start start 2024-04-25T08:52:06.738 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0da0283640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980cc8e0 0x7f0d981f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0da0283640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d980d1810 0x7f0d980c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0da0283640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d9815dc90 0x7f0d98160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0da0283640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9815e070 con 0x7f0d980cc8e0 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0da0283640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d980cd130 con 0x7f0d980d1810 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0da0283640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9815e1f0 con 0x7f0d9815dc90 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0d9e01f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980cc8e0 0x7f0d981f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0d9e01f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980cc8e0 0x7f0d981f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37132/0 (socket says 172.21.15.172:37132) 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0d9e01f640 1 -- 172.21.15.172:0/35804070 learned_addr learned my addr 172.21.15.172:0/35804070 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0d9e01f640 1 -- 172.21.15.172:0/35804070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d9815dc90 msgr2=0x7f0d98160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0d9e01f640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d9815dc90 0x7f0d98160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0d9e01f640 1 -- 172.21.15.172:0/35804070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d980d1810 msgr2=0x7f0d980c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0d9e01f640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d980d1810 0x7f0d980c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.747+0000 7f0d9e01f640 1 -- 172.21.15.172:0/35804070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d980c9fa0 con 0x7f0d980cc8e0 2024-04-25T08:52:06.739 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.748+0000 7f0d9e01f640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980cc8e0 0x7f0d981f4980 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c410 tx=0x7f0d9400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:06.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.748+0000 7f0d8effd640 1 -- 172.21.15.172:0/35804070 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94017070 con 0x7f0d980cc8e0 2024-04-25T08:52:06.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.748+0000 7f0d8effd640 1 -- 172.21.15.172:0/35804070 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d940035f0 con 0x7f0d980cc8e0 2024-04-25T08:52:06.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.748+0000 7f0d8effd640 1 -- 172.21.15.172:0/35804070 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d940039e0 con 0x7f0d980cc8e0 2024-04-25T08:52:06.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.748+0000 7f0da0283640 1 -- 172.21.15.172:0/35804070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d980c9cc0 con 0x7f0d980cc8e0 2024-04-25T08:52:06.740 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.748+0000 7f0da0283640 1 -- 172.21.15.172:0/35804070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d981f4180 con 0x7f0d980cc8e0 2024-04-25T08:52:06.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.749+0000 7f0da0283640 1 -- 172.21.15.172:0/35804070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d98073990 con 0x7f0d980cc8e0 2024-04-25T08:52:06.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.749+0000 7f0d8effd640 1 -- 172.21.15.172:0/35804070 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0d9401a070 con 0x7f0d980cc8e0 2024-04-25T08:52:06.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.750+0000 7f0d8effd640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d7c06b4d0 0x7f0d7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:06.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.750+0000 7f0d8effd640 1 -- 172.21.15.172:0/35804070 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0d94089800 con 0x7f0d980cc8e0 2024-04-25T08:52:06.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.750+0000 7f0d9d81e640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d7c06b4d0 0x7f0d7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:06.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.750+0000 7f0d9d81e640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d7c06b4d0 0x7f0d7c06d990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0d980c50a0 tx=0x7f0d88006c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:06.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.754+0000 7f0d8effd640 1 -- 172.21.15.172:0/35804070 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0d940584f0 con 0x7f0d980cc8e0 2024-04-25T08:52:06.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.921+0000 7f0da0283640 1 -- 172.21.15.172:0/35804070 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d980cf6b0 con 0x7f0d7c06b4d0 2024-04-25T08:52:06.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.927+0000 7f0d8effd640 1 -- 172.21.15.172:0/35804070 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252374 (secure 0 0 0) 0x7f0d980cf6b0 con 0x7f0d7c06b4d0 2024-04-25T08:52:06.920 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:06.921 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:52:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 -- 172.21.15.172:0/35804070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d7c06b4d0 msgr2=0x7f0d7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d7c06b4d0 0x7f0d7c06d990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0d980c50a0 tx=0x7f0d88006c90 comp rx=0 tx=0).stop 2024-04-25T08:52:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 -- 172.21.15.172:0/35804070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980cc8e0 msgr2=0x7f0d981f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980cc8e0 0x7f0d981f4980 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c410 tx=0x7f0d9400c8d0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 -- 172.21.15.172:0/35804070 shutdown_connections 2024-04-25T08:52:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0d7c06b4d0 0x7f0d7c06d990 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d980d1810 0x7f0d980c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d9815dc90 0x7f0d98160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 --2- 172.21.15.172:0/35804070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d980cc8e0 0x7f0d981f4980 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:06.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 -- 172.21.15.172:0/35804070 >> 172.21.15.172:0/35804070 conn(0x7f0d9806f590 msgr2=0x7f0d980b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:06.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 -- 172.21.15.172:0/35804070 shutdown_connections 2024-04-25T08:52:06.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:06.930+0000 7f0da0283640 1 -- 172.21.15.172:0/35804070 wait complete. 2024-04-25T08:52:06.932 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":431,"stamp":"2024-04-25T08:52:06.631788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":417392,"kb_used_data":15240,"kb_used_omap":12,"kb_used_meta":402035,"kb_avail":754557328,"statfs":{"total":773094113280,"available":772666703872,"internally_reserved":0,"allocated":15605760,"data_stored":7888860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":411684400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001851"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688285+0000","last_change":"2024-04-25T08:51:58.688022+0000","last_active":"2024-04-25T08:51:59.688285+0000","last_peered":"2024-04-25T08:51:59.688285+0000","last_clean":"2024-04-25T08:51:59.688285+0000","last_became_active":"2024-04-25T08:51:58.686734+0000","last_became_peered":"2024-04-25T08:51:58.686734+0000","last_unstale":"2024-04-25T08:51:59.688285+0000","last_undegraded":"2024-04-25T08:51:59.688285+0000","last_fullsized":"2024-04-25T08:51:59.688285+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000682+0000","last_change":"2024-04-25T08:51:58.694460+0000","last_active":"2024-04-25T08:52:01.000682+0000","last_peered":"2024-04-25T08:52:01.000682+0000","last_clean":"2024-04-25T08:52:01.000682+0000","last_became_active":"2024-04-25T08:51:58.694162+0000","last_became_peered":"2024-04-25T08:51:58.694162+0000","last_unstale":"2024-04-25T08:52:01.000682+0000","last_undegraded":"2024-04-25T08:52:01.000682+0000","last_fullsized":"2024-04-25T08:52:01.000682+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:41.474964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000695+0000","last_change":"2024-04-25T08:51:58.694784+0000","last_active":"2024-04-25T08:52:01.000695+0000","last_peered":"2024-04-25T08:52:01.000695+0000","last_clean":"2024-04-25T08:52:01.000695+0000","last_became_active":"2024-04-25T08:51:58.693953+0000","last_became_peered":"2024-04-25T08:51:58.693953+0000","last_unstale":"2024-04-25T08:52:01.000695+0000","last_undegraded":"2024-04-25T08:52:01.000695+0000","last_fullsized":"2024-04-25T08:52:01.000695+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:58.123267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001422+0000","last_change":"2024-04-25T08:51:58.692215+0000","last_active":"2024-04-25T08:52:01.001422+0000","last_peered":"2024-04-25T08:52:01.001422+0000","last_clean":"2024-04-25T08:52:01.001422+0000","last_became_active":"2024-04-25T08:51:58.691948+0000","last_became_peered":"2024-04-25T08:51:58.691948+0000","last_unstale":"2024-04-25T08:52:01.001422+0000","last_undegraded":"2024-04-25T08:52:01.001422+0000","last_fullsized":"2024-04-25T08:52:01.001422+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001102+0000","last_change":"2024-04-25T08:51:58.680126+0000","last_active":"2024-04-25T08:52:01.001102+0000","last_peered":"2024-04-25T08:52:01.001102+0000","last_clean":"2024-04-25T08:52:01.001102+0000","last_became_active":"2024-04-25T08:51:58.679785+0000","last_became_peered":"2024-04-25T08:51:58.679785+0000","last_unstale":"2024-04-25T08:52:01.001102+0000","last_undegraded":"2024-04-25T08:52:01.001102+0000","last_fullsized":"2024-04-25T08:52:01.001102+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:36.543165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000646+0000","last_change":"2024-04-25T08:51:58.679533+0000","last_active":"2024-04-25T08:52:01.000646+0000","last_peered":"2024-04-25T08:52:01.000646+0000","last_clean":"2024-04-25T08:52:01.000646+0000","last_became_active":"2024-04-25T08:51:58.679241+0000","last_became_peered":"2024-04-25T08:51:58.679241+0000","last_unstale":"2024-04-25T08:52:01.000646+0000","last_undegraded":"2024-04-25T08:52:01.000646+0000","last_fullsized":"2024-04-25T08:52:01.000646+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:18.552508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687655+0000","last_change":"2024-04-25T08:51:58.679041+0000","last_active":"2024-04-25T08:51:59.687655+0000","last_peered":"2024-04-25T08:51:59.687655+0000","last_clean":"2024-04-25T08:51:59.687655+0000","last_became_active":"2024-04-25T08:51:58.678693+0000","last_became_peered":"2024-04-25T08:51:58.678693+0000","last_unstale":"2024-04-25T08:51:59.687655+0000","last_undegraded":"2024-04-25T08:51:59.687655+0000","last_fullsized":"2024-04-25T08:51:59.687655+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:58.560714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687566+0000","last_change":"2024-04-25T08:51:58.693136+0000","last_active":"2024-04-25T08:51:59.687566+0000","last_peered":"2024-04-25T08:51:59.687566+0000","last_clean":"2024-04-25T08:51:59.687566+0000","last_became_active":"2024-04-25T08:51:58.692738+0000","last_became_peered":"2024-04-25T08:51:58.692738+0000","last_unstale":"2024-04-25T08:51:59.687566+0000","last_undegraded":"2024-04-25T08:51:59.687566+0000","last_fullsized":"2024-04-25T08:51:59.687566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:00.190275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000963+0000","last_change":"2024-04-25T08:51:58.683484+0000","last_active":"2024-04-25T08:52:01.000963+0000","last_peered":"2024-04-25T08:52:01.000963+0000","last_clean":"2024-04-25T08:52:01.000963+0000","last_became_active":"2024-04-25T08:51:58.683162+0000","last_became_peered":"2024-04-25T08:51:58.683162+0000","last_unstale":"2024-04-25T08:52:01.000963+0000","last_undegraded":"2024-04-25T08:52:01.000963+0000","last_fullsized":"2024-04-25T08:52:01.000963+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.513470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001026+0000","last_change":"2024-04-25T08:51:58.694912+0000","last_active":"2024-04-25T08:52:01.001026+0000","last_peered":"2024-04-25T08:52:01.001026+0000","last_clean":"2024-04-25T08:52:01.001026+0000","last_became_active":"2024-04-25T08:51:58.694633+0000","last_became_peered":"2024-04-25T08:51:58.694633+0000","last_unstale":"2024-04-25T08:52:01.001026+0000","last_undegraded":"2024-04-25T08:52:01.001026+0000","last_fullsized":"2024-04-25T08:52:01.001026+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:34.176825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372242+0000","last_change":"2024-04-25T08:51:58.688443+0000","last_active":"2024-04-25T08:52:00.372242+0000","last_peered":"2024-04-25T08:52:00.372242+0000","last_clean":"2024-04-25T08:52:00.372242+0000","last_became_active":"2024-04-25T08:51:58.688179+0000","last_became_peered":"2024-04-25T08:51:58.688179+0000","last_unstale":"2024-04-25T08:52:00.372242+0000","last_undegraded":"2024-04-25T08:52:00.372242+0000","last_fullsized":"2024-04-25T08:52:00.372242+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:16.377154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001559+0000","last_change":"2024-04-25T08:51:58.701100+0000","last_active":"2024-04-25T08:52:01.001559+0000","last_peered":"2024-04-25T08:52:01.001559+0000","last_clean":"2024-04-25T08:52:01.001559+0000","last_became_active":"2024-04-25T08:51:58.700826+0000","last_became_peered":"2024-04-25T08:51:58.700826+0000","last_unstale":"2024-04-25T08:52:01.001559+0000","last_undegraded":"2024-04-25T08:52:01.001559+0000","last_fullsized":"2024-04-25T08:52:01.001559+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000920+0000","last_change":"2024-04-25T08:51:58.694404+0000","last_active":"2024-04-25T08:52:01.000920+0000","last_peered":"2024-04-25T08:52:01.000920+0000","last_clean":"2024-04-25T08:52:01.000920+0000","last_became_active":"2024-04-25T08:51:58.694118+0000","last_became_peered":"2024-04-25T08:51:58.694118+0000","last_unstale":"2024-04-25T08:52:01.000920+0000","last_undegraded":"2024-04-25T08:52:01.000920+0000","last_fullsized":"2024-04-25T08:52:01.000920+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:51.719290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001322+0000","last_change":"2024-04-25T08:51:58.701186+0000","last_active":"2024-04-25T08:52:01.001322+0000","last_peered":"2024-04-25T08:52:01.001322+0000","last_clean":"2024-04-25T08:52:01.001322+0000","last_became_active":"2024-04-25T08:51:58.700933+0000","last_became_peered":"2024-04-25T08:51:58.700933+0000","last_unstale":"2024-04-25T08:52:01.001322+0000","last_undegraded":"2024-04-25T08:52:01.001322+0000","last_fullsized":"2024-04-25T08:52:01.001322+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000435+0000","last_change":"2024-04-25T08:51:58.697734+0000","last_active":"2024-04-25T08:52:01.000435+0000","last_peered":"2024-04-25T08:52:01.000435+0000","last_clean":"2024-04-25T08:52:01.000435+0000","last_became_active":"2024-04-25T08:51:58.697438+0000","last_became_peered":"2024-04-25T08:51:58.697438+0000","last_unstale":"2024-04-25T08:52:01.000435+0000","last_undegraded":"2024-04-25T08:52:01.000435+0000","last_fullsized":"2024-04-25T08:52:01.000435+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:19.048178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000432+0000","last_change":"2024-04-25T08:51:58.686864+0000","last_active":"2024-04-25T08:52:01.000432+0000","last_peered":"2024-04-25T08:52:01.000432+0000","last_clean":"2024-04-25T08:52:01.000432+0000","last_became_active":"2024-04-25T08:51:58.686600+0000","last_became_peered":"2024-04-25T08:51:58.686600+0000","last_unstale":"2024-04-25T08:52:01.000432+0000","last_undegraded":"2024-04-25T08:52:01.000432+0000","last_fullsized":"2024-04-25T08:52:01.000432+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:57.252587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001751+0000","last_change":"2024-04-25T08:51:58.693254+0000","last_active":"2024-04-25T08:52:01.001751+0000","last_peered":"2024-04-25T08:52:01.001751+0000","last_clean":"2024-04-25T08:52:01.001751+0000","last_became_active":"2024-04-25T08:51:58.692700+0000","last_became_peered":"2024-04-25T08:51:58.692700+0000","last_unstale":"2024-04-25T08:52:01.001751+0000","last_undegraded":"2024-04-25T08:52:01.001751+0000","last_fullsized":"2024-04-25T08:52:01.001751+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372369+0000","last_change":"2024-04-25T08:51:58.694474+0000","last_active":"2024-04-25T08:52:00.372369+0000","last_peered":"2024-04-25T08:52:00.372369+0000","last_clean":"2024-04-25T08:52:00.372369+0000","last_became_active":"2024-04-25T08:51:58.694160+0000","last_became_peered":"2024-04-25T08:51:58.694160+0000","last_unstale":"2024-04-25T08:52:00.372369+0000","last_undegraded":"2024-04-25T08:52:00.372369+0000","last_fullsized":"2024-04-25T08:52:00.372369+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:23.786506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702693+0000","last_change":"2024-04-25T08:51:58.688100+0000","last_active":"2024-04-25T08:51:59.702693+0000","last_peered":"2024-04-25T08:51:59.702693+0000","last_clean":"2024-04-25T08:51:59.702693+0000","last_became_active":"2024-04-25T08:51:58.687678+0000","last_became_peered":"2024-04-25T08:51:58.687678+0000","last_unstale":"2024-04-25T08:51:59.702693+0000","last_undegraded":"2024-04-25T08:51:59.702693+0000","last_fullsized":"2024-04-25T08:51:59.702693+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682613+0000","last_change":"2024-04-25T08:51:58.688356+0000","last_active":"2024-04-25T08:51:59.682613+0000","last_peered":"2024-04-25T08:51:59.682613+0000","last_clean":"2024-04-25T08:51:59.682613+0000","last_became_active":"2024-04-25T08:51:58.688099+0000","last_became_peered":"2024-04-25T08:51:58.688099+0000","last_unstale":"2024-04-25T08:51:59.682613+0000","last_undegraded":"2024-04-25T08:51:59.682613+0000","last_fullsized":"2024-04-25T08:51:59.682613+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:26.508708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000974+0000","last_change":"2024-04-25T08:51:58.680453+0000","last_active":"2024-04-25T08:52:01.000974+0000","last_peered":"2024-04-25T08:52:01.000974+0000","last_clean":"2024-04-25T08:52:01.000974+0000","last_became_active":"2024-04-25T08:51:58.680171+0000","last_became_peered":"2024-04-25T08:51:58.680171+0000","last_unstale":"2024-04-25T08:52:01.000974+0000","last_undegraded":"2024-04-25T08:52:01.000974+0000","last_fullsized":"2024-04-25T08:52:01.000974+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:09.447744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688623+0000","last_change":"2024-04-25T08:51:58.679406+0000","last_active":"2024-04-25T08:51:59.688623+0000","last_peered":"2024-04-25T08:51:59.688623+0000","last_clean":"2024-04-25T08:51:59.688623+0000","last_became_active":"2024-04-25T08:51:58.678753+0000","last_became_peered":"2024-04-25T08:51:58.678753+0000","last_unstale":"2024-04-25T08:51:59.688623+0000","last_undegraded":"2024-04-25T08:51:59.688623+0000","last_fullsized":"2024-04-25T08:51:59.688623+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687751+0000","last_change":"2024-04-25T08:51:58.690427+0000","last_active":"2024-04-25T08:51:59.687751+0000","last_peered":"2024-04-25T08:51:59.687751+0000","last_clean":"2024-04-25T08:51:59.687751+0000","last_became_active":"2024-04-25T08:51:58.690143+0000","last_became_peered":"2024-04-25T08:51:58.690143+0000","last_unstale":"2024-04-25T08:51:59.687751+0000","last_undegraded":"2024-04-25T08:51:59.687751+0000","last_fullsized":"2024-04-25T08:51:59.687751+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:07.849932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372272+0000","last_change":"2024-04-25T08:51:58.698476+0000","last_active":"2024-04-25T08:52:00.372272+0000","last_peered":"2024-04-25T08:52:00.372272+0000","last_clean":"2024-04-25T08:52:00.372272+0000","last_became_active":"2024-04-25T08:51:58.698215+0000","last_became_peered":"2024-04-25T08:51:58.698215+0000","last_unstale":"2024-04-25T08:52:00.372272+0000","last_undegraded":"2024-04-25T08:52:00.372272+0000","last_fullsized":"2024-04-25T08:52:00.372272+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:19.596526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688390+0000","last_change":"2024-04-25T08:51:58.690909+0000","last_active":"2024-04-25T08:51:59.688390+0000","last_peered":"2024-04-25T08:51:59.688390+0000","last_clean":"2024-04-25T08:51:59.688390+0000","last_became_active":"2024-04-25T08:51:58.690625+0000","last_became_peered":"2024-04-25T08:51:58.690625+0000","last_unstale":"2024-04-25T08:51:59.688390+0000","last_undegraded":"2024-04-25T08:51:59.688390+0000","last_fullsized":"2024-04-25T08:51:59.688390+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688145+0000","last_change":"2024-04-25T08:51:58.691825+0000","last_active":"2024-04-25T08:51:59.688145+0000","last_peered":"2024-04-25T08:51:59.688145+0000","last_clean":"2024-04-25T08:51:59.688145+0000","last_became_active":"2024-04-25T08:51:58.688552+0000","last_became_peered":"2024-04-25T08:51:58.688552+0000","last_unstale":"2024-04-25T08:51:59.688145+0000","last_undegraded":"2024-04-25T08:51:59.688145+0000","last_fullsized":"2024-04-25T08:51:59.688145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:09.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001190+0000","last_change":"2024-04-25T08:51:58.686310+0000","last_active":"2024-04-25T08:52:01.001190+0000","last_peered":"2024-04-25T08:52:01.001190+0000","last_clean":"2024-04-25T08:52:01.001190+0000","last_became_active":"2024-04-25T08:51:58.685165+0000","last_became_peered":"2024-04-25T08:51:58.685165+0000","last_unstale":"2024-04-25T08:52:01.001190+0000","last_undegraded":"2024-04-25T08:52:01.001190+0000","last_fullsized":"2024-04-25T08:52:01.001190+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:17.991594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372273+0000","last_change":"2024-04-25T08:51:58.690610+0000","last_active":"2024-04-25T08:52:00.372273+0000","last_peered":"2024-04-25T08:52:00.372273+0000","last_clean":"2024-04-25T08:52:00.372273+0000","last_became_active":"2024-04-25T08:51:58.690279+0000","last_became_peered":"2024-04-25T08:51:58.690279+0000","last_unstale":"2024-04-25T08:52:00.372273+0000","last_undegraded":"2024-04-25T08:52:00.372273+0000","last_fullsized":"2024-04-25T08:52:00.372273+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:38.266138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688664+0000","last_change":"2024-04-25T08:51:58.701180+0000","last_active":"2024-04-25T08:51:59.688664+0000","last_peered":"2024-04-25T08:51:59.688664+0000","last_clean":"2024-04-25T08:51:59.688664+0000","last_became_active":"2024-04-25T08:51:58.700888+0000","last_became_peered":"2024-04-25T08:51:58.700888+0000","last_unstale":"2024-04-25T08:51:59.688664+0000","last_undegraded":"2024-04-25T08:51:59.688664+0000","last_fullsized":"2024-04-25T08:51:59.688664+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.777661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372225+0000","last_change":"2024-04-25T08:51:58.690756+0000","last_active":"2024-04-25T08:52:00.372225+0000","last_peered":"2024-04-25T08:52:00.372225+0000","last_clean":"2024-04-25T08:52:00.372225+0000","last_became_active":"2024-04-25T08:51:58.690222+0000","last_became_peered":"2024-04-25T08:51:58.690222+0000","last_unstale":"2024-04-25T08:52:00.372225+0000","last_undegraded":"2024-04-25T08:52:00.372225+0000","last_fullsized":"2024-04-25T08:52:00.372225+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:40.024839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000538+0000","last_change":"2024-04-25T08:51:58.687469+0000","last_active":"2024-04-25T08:52:01.000538+0000","last_peered":"2024-04-25T08:52:01.000538+0000","last_clean":"2024-04-25T08:52:01.000538+0000","last_became_active":"2024-04-25T08:51:58.687212+0000","last_became_peered":"2024-04-25T08:51:58.687212+0000","last_unstale":"2024-04-25T08:52:01.000538+0000","last_undegraded":"2024-04-25T08:52:01.000538+0000","last_fullsized":"2024-04-25T08:52:01.000538+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:30.331287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687732+0000","last_change":"2024-04-25T08:51:58.687508+0000","last_active":"2024-04-25T08:51:59.687732+0000","last_peered":"2024-04-25T08:51:59.687732+0000","last_clean":"2024-04-25T08:51:59.687732+0000","last_became_active":"2024-04-25T08:51:58.687248+0000","last_became_peered":"2024-04-25T08:51:58.687248+0000","last_unstale":"2024-04-25T08:51:59.687732+0000","last_undegraded":"2024-04-25T08:51:59.687732+0000","last_fullsized":"2024-04-25T08:51:59.687732+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:45.247106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000938+0000","last_change":"2024-04-25T08:51:58.692141+0000","last_active":"2024-04-25T08:52:01.000938+0000","last_peered":"2024-04-25T08:52:01.000938+0000","last_clean":"2024-04-25T08:52:01.000938+0000","last_became_active":"2024-04-25T08:51:58.691300+0000","last_became_peered":"2024-04-25T08:51:58.691300+0000","last_unstale":"2024-04-25T08:52:01.000938+0000","last_undegraded":"2024-04-25T08:52:01.000938+0000","last_fullsized":"2024-04-25T08:52:01.000938+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:47.162647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"142'4","reported_seq":18,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001292+0000","last_change":"2024-04-25T08:51:57.678935+0000","last_active":"2024-04-25T08:52:01.001292+0000","last_peered":"2024-04-25T08:52:01.001292+0000","last_clean":"2024-04-25T08:52:01.001292+0000","last_became_active":"2024-04-25T08:51:57.677554+0000","last_became_peered":"2024-04-25T08:51:57.677554+0000","last_unstale":"2024-04-25T08:52:01.001292+0000","last_undegraded":"2024-04-25T08:52:01.001292+0000","last_fullsized":"2024-04-25T08:52:01.001292+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:45.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000822+0000","last_change":"2024-04-25T08:51:58.694894+0000","last_active":"2024-04-25T08:52:01.000822+0000","last_peered":"2024-04-25T08:52:01.000822+0000","last_clean":"2024-04-25T08:52:01.000822+0000","last_became_active":"2024-04-25T08:51:58.694640+0000","last_became_peered":"2024-04-25T08:51:58.694640+0000","last_unstale":"2024-04-25T08:52:01.000822+0000","last_undegraded":"2024-04-25T08:52:01.000822+0000","last_fullsized":"2024-04-25T08:52:01.000822+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:04.768589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702607+0000","last_change":"2024-04-25T08:51:57.680568+0000","last_active":"2024-04-25T08:51:59.702607+0000","last_peered":"2024-04-25T08:51:59.702607+0000","last_clean":"2024-04-25T08:51:59.702607+0000","last_became_active":"2024-04-25T08:51:57.680215+0000","last_became_peered":"2024-04-25T08:51:57.680215+0000","last_unstale":"2024-04-25T08:51:59.702607+0000","last_undegraded":"2024-04-25T08:51:59.702607+0000","last_fullsized":"2024-04-25T08:51:59.702607+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:57.119064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688298+0000","last_change":"2024-04-25T08:51:58.692557+0000","last_active":"2024-04-25T08:51:59.688298+0000","last_peered":"2024-04-25T08:51:59.688298+0000","last_clean":"2024-04-25T08:51:59.688298+0000","last_became_active":"2024-04-25T08:51:58.690870+0000","last_became_peered":"2024-04-25T08:51:58.690870+0000","last_unstale":"2024-04-25T08:51:59.688298+0000","last_undegraded":"2024-04-25T08:51:59.688298+0000","last_fullsized":"2024-04-25T08:51:59.688298+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:59.993761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702775+0000","last_change":"2024-04-25T08:51:57.680346+0000","last_active":"2024-04-25T08:51:59.702775+0000","last_peered":"2024-04-25T08:51:59.702775+0000","last_clean":"2024-04-25T08:51:59.702775+0000","last_became_active":"2024-04-25T08:51:57.679834+0000","last_became_peered":"2024-04-25T08:51:57.679834+0000","last_unstale":"2024-04-25T08:51:59.702775+0000","last_undegraded":"2024-04-25T08:51:59.702775+0000","last_fullsized":"2024-04-25T08:51:59.702775+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:03.764385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702725+0000","last_change":"2024-04-25T08:51:58.683999+0000","last_active":"2024-04-25T08:51:59.702725+0000","last_peered":"2024-04-25T08:51:59.702725+0000","last_clean":"2024-04-25T08:51:59.702725+0000","last_became_active":"2024-04-25T08:51:58.683686+0000","last_became_peered":"2024-04-25T08:51:58.683686+0000","last_unstale":"2024-04-25T08:51:59.702725+0000","last_undegraded":"2024-04-25T08:51:59.702725+0000","last_fullsized":"2024-04-25T08:51:59.702725+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000914+0000","last_change":"2024-04-25T08:51:57.684784+0000","last_active":"2024-04-25T08:52:01.000914+0000","last_peered":"2024-04-25T08:52:01.000914+0000","last_clean":"2024-04-25T08:52:01.000914+0000","last_became_active":"2024-04-25T08:51:57.684270+0000","last_became_peered":"2024-04-25T08:51:57.684270+0000","last_unstale":"2024-04-25T08:52:01.000914+0000","last_undegraded":"2024-04-25T08:52:01.000914+0000","last_fullsized":"2024-04-25T08:52:01.000914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:59.186072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682473+0000","last_change":"2024-04-25T08:51:58.696589+0000","last_active":"2024-04-25T08:51:59.682473+0000","last_peered":"2024-04-25T08:51:59.682473+0000","last_clean":"2024-04-25T08:51:59.682473+0000","last_became_active":"2024-04-25T08:51:58.696283+0000","last_became_peered":"2024-04-25T08:51:58.696283+0000","last_unstale":"2024-04-25T08:51:59.682473+0000","last_undegraded":"2024-04-25T08:51:59.682473+0000","last_fullsized":"2024-04-25T08:51:59.682473+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:25.100007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688776+0000","last_change":"2024-04-25T08:51:57.681697+0000","last_active":"2024-04-25T08:51:59.688776+0000","last_peered":"2024-04-25T08:51:59.688776+0000","last_clean":"2024-04-25T08:51:59.688776+0000","last_became_active":"2024-04-25T08:51:57.681217+0000","last_became_peered":"2024-04-25T08:51:57.681217+0000","last_unstale":"2024-04-25T08:51:59.688776+0000","last_undegraded":"2024-04-25T08:51:59.688776+0000","last_fullsized":"2024-04-25T08:51:59.688776+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:22.286995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001305+0000","last_change":"2024-04-25T08:51:58.698064+0000","last_active":"2024-04-25T08:52:01.001305+0000","last_peered":"2024-04-25T08:52:01.001305+0000","last_clean":"2024-04-25T08:52:01.001305+0000","last_became_active":"2024-04-25T08:51:58.697736+0000","last_became_peered":"2024-04-25T08:51:58.697736+0000","last_unstale":"2024-04-25T08:52:01.001305+0000","last_undegraded":"2024-04-25T08:52:01.001305+0000","last_fullsized":"2024-04-25T08:52:01.001305+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000737+0000","last_change":"2024-04-25T08:51:57.679244+0000","last_active":"2024-04-25T08:52:01.000737+0000","last_peered":"2024-04-25T08:52:01.000737+0000","last_clean":"2024-04-25T08:52:01.000737+0000","last_became_active":"2024-04-25T08:51:57.677491+0000","last_became_peered":"2024-04-25T08:51:57.677491+0000","last_unstale":"2024-04-25T08:52:01.000737+0000","last_undegraded":"2024-04-25T08:52:01.000737+0000","last_fullsized":"2024-04-25T08:52:01.000737+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:46.158444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000499+0000","last_change":"2024-04-25T08:51:58.688383+0000","last_active":"2024-04-25T08:52:01.000499+0000","last_peered":"2024-04-25T08:52:01.000499+0000","last_clean":"2024-04-25T08:52:01.000499+0000","last_became_active":"2024-04-25T08:51:58.688072+0000","last_became_peered":"2024-04-25T08:51:58.688072+0000","last_unstale":"2024-04-25T08:52:01.000499+0000","last_undegraded":"2024-04-25T08:52:01.000499+0000","last_fullsized":"2024-04-25T08:52:01.000499+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:26.173318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687761+0000","last_change":"2024-04-25T08:51:57.679918+0000","last_active":"2024-04-25T08:51:59.687761+0000","last_peered":"2024-04-25T08:51:59.687761+0000","last_clean":"2024-04-25T08:51:59.687761+0000","last_became_active":"2024-04-25T08:51:57.679656+0000","last_became_peered":"2024-04-25T08:51:57.679656+0000","last_unstale":"2024-04-25T08:51:59.687761+0000","last_undegraded":"2024-04-25T08:51:59.687761+0000","last_fullsized":"2024-04-25T08:51:59.687761+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:40.337985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687569+0000","last_change":"2024-04-25T08:51:58.691560+0000","last_active":"2024-04-25T08:51:59.687569+0000","last_peered":"2024-04-25T08:51:59.687569+0000","last_clean":"2024-04-25T08:51:59.687569+0000","last_became_active":"2024-04-25T08:51:58.688811+0000","last_became_peered":"2024-04-25T08:51:58.688811+0000","last_unstale":"2024-04-25T08:51:59.687569+0000","last_undegraded":"2024-04-25T08:51:59.687569+0000","last_fullsized":"2024-04-25T08:51:59.687569+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:21.032824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000423+0000","last_change":"2024-04-25T08:51:57.675383+0000","last_active":"2024-04-25T08:52:01.000423+0000","last_peered":"2024-04-25T08:52:01.000423+0000","last_clean":"2024-04-25T08:52:01.000423+0000","last_became_active":"2024-04-25T08:51:57.675111+0000","last_became_peered":"2024-04-25T08:51:57.675111+0000","last_unstale":"2024-04-25T08:52:01.000423+0000","last_undegraded":"2024-04-25T08:52:01.000423+0000","last_fullsized":"2024-04-25T08:52:01.000423+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:03.764385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688370+0000","last_change":"2024-04-25T08:51:58.690638+0000","last_active":"2024-04-25T08:51:59.688370+0000","last_peered":"2024-04-25T08:51:59.688370+0000","last_clean":"2024-04-25T08:51:59.688370+0000","last_became_active":"2024-04-25T08:51:58.690364+0000","last_became_peered":"2024-04-25T08:51:58.690364+0000","last_unstale":"2024-04-25T08:51:59.688370+0000","last_undegraded":"2024-04-25T08:51:59.688370+0000","last_fullsized":"2024-04-25T08:51:59.688370+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:31:18.745168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702674+0000","last_change":"2024-04-25T08:51:57.677353+0000","last_active":"2024-04-25T08:51:59.702674+0000","last_peered":"2024-04-25T08:51:59.702674+0000","last_clean":"2024-04-25T08:51:59.702674+0000","last_became_active":"2024-04-25T08:51:57.676926+0000","last_became_peered":"2024-04-25T08:51:57.676926+0000","last_unstale":"2024-04-25T08:51:59.702674+0000","last_undegraded":"2024-04-25T08:51:59.702674+0000","last_fullsized":"2024-04-25T08:51:59.702674+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:50.800138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372377+0000","last_change":"2024-04-25T08:51:58.687775+0000","last_active":"2024-04-25T08:52:00.372377+0000","last_peered":"2024-04-25T08:52:00.372377+0000","last_clean":"2024-04-25T08:52:00.372377+0000","last_became_active":"2024-04-25T08:51:58.687473+0000","last_became_peered":"2024-04-25T08:51:58.687473+0000","last_unstale":"2024-04-25T08:52:00.372377+0000","last_undegraded":"2024-04-25T08:52:00.372377+0000","last_fullsized":"2024-04-25T08:52:00.372377+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:51.987904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688885+0000","last_change":"2024-04-25T08:51:57.679237+0000","last_active":"2024-04-25T08:51:59.688885+0000","last_peered":"2024-04-25T08:51:59.688885+0000","last_clean":"2024-04-25T08:51:59.688885+0000","last_became_active":"2024-04-25T08:51:57.678926+0000","last_became_peered":"2024-04-25T08:51:57.678926+0000","last_unstale":"2024-04-25T08:51:59.688885+0000","last_undegraded":"2024-04-25T08:51:59.688885+0000","last_fullsized":"2024-04-25T08:51:59.688885+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:25.169115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372383+0000","last_change":"2024-04-25T08:51:58.687200+0000","last_active":"2024-04-25T08:52:00.372383+0000","last_peered":"2024-04-25T08:52:00.372383+0000","last_clean":"2024-04-25T08:52:00.372383+0000","last_became_active":"2024-04-25T08:51:58.686933+0000","last_became_peered":"2024-04-25T08:51:58.686933+0000","last_unstale":"2024-04-25T08:52:00.372383+0000","last_undegraded":"2024-04-25T08:52:00.372383+0000","last_fullsized":"2024-04-25T08:52:00.372383+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:42.491032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"142'3","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372348+0000","last_change":"2024-04-25T08:51:57.676927+0000","last_active":"2024-04-25T08:52:00.372348+0000","last_peered":"2024-04-25T08:52:00.372348+0000","last_clean":"2024-04-25T08:52:00.372348+0000","last_became_active":"2024-04-25T08:51:57.676667+0000","last_became_peered":"2024-04-25T08:51:57.676667+0000","last_unstale":"2024-04-25T08:52:00.372348+0000","last_undegraded":"2024-04-25T08:52:00.372348+0000","last_fullsized":"2024-04-25T08:52:00.372348+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:26:54.058859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687906+0000","last_change":"2024-04-25T08:51:58.691366+0000","last_active":"2024-04-25T08:51:59.687906+0000","last_peered":"2024-04-25T08:51:59.687906+0000","last_clean":"2024-04-25T08:51:59.687906+0000","last_became_active":"2024-04-25T08:51:58.689980+0000","last_became_peered":"2024-04-25T08:51:58.689980+0000","last_unstale":"2024-04-25T08:51:59.687906+0000","last_undegraded":"2024-04-25T08:51:59.687906+0000","last_fullsized":"2024-04-25T08:51:59.687906+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:47.198192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001073+0000","last_change":"2024-04-25T08:51:57.679370+0000","last_active":"2024-04-25T08:52:01.001073+0000","last_peered":"2024-04-25T08:52:01.001073+0000","last_clean":"2024-04-25T08:52:01.001073+0000","last_became_active":"2024-04-25T08:51:57.678638+0000","last_became_peered":"2024-04-25T08:51:57.678638+0000","last_unstale":"2024-04-25T08:52:01.001073+0000","last_undegraded":"2024-04-25T08:52:01.001073+0000","last_fullsized":"2024-04-25T08:52:01.001073+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:20.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000483+0000","last_change":"2024-04-25T08:51:58.691999+0000","last_active":"2024-04-25T08:52:01.000483+0000","last_peered":"2024-04-25T08:52:01.000483+0000","last_clean":"2024-04-25T08:52:01.000483+0000","last_became_active":"2024-04-25T08:51:58.691704+0000","last_became_peered":"2024-04-25T08:51:58.691704+0000","last_unstale":"2024-04-25T08:52:01.000483+0000","last_undegraded":"2024-04-25T08:52:01.000483+0000","last_fullsized":"2024-04-25T08:52:01.000483+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:23.621157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001461+0000","last_change":"2024-04-25T08:51:57.685351+0000","last_active":"2024-04-25T08:52:01.001461+0000","last_peered":"2024-04-25T08:52:01.001461+0000","last_clean":"2024-04-25T08:52:01.001461+0000","last_became_active":"2024-04-25T08:51:57.684940+0000","last_became_peered":"2024-04-25T08:51:57.684940+0000","last_unstale":"2024-04-25T08:52:01.001461+0000","last_undegraded":"2024-04-25T08:52:01.001461+0000","last_fullsized":"2024-04-25T08:52:01.001461+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:14.277326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000681+0000","last_change":"2024-04-25T08:51:58.684758+0000","last_active":"2024-04-25T08:52:01.000681+0000","last_peered":"2024-04-25T08:52:01.000681+0000","last_clean":"2024-04-25T08:52:01.000681+0000","last_became_active":"2024-04-25T08:51:58.684486+0000","last_became_peered":"2024-04-25T08:51:58.684486+0000","last_unstale":"2024-04-25T08:52:01.000681+0000","last_undegraded":"2024-04-25T08:52:01.000681+0000","last_fullsized":"2024-04-25T08:52:01.000681+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:40.934601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001466+0000","last_change":"2024-04-25T08:51:57.676880+0000","last_active":"2024-04-25T08:52:01.001466+0000","last_peered":"2024-04-25T08:52:01.001466+0000","last_clean":"2024-04-25T08:52:01.001466+0000","last_became_active":"2024-04-25T08:51:57.676575+0000","last_became_peered":"2024-04-25T08:51:57.676575+0000","last_unstale":"2024-04-25T08:52:01.001466+0000","last_undegraded":"2024-04-25T08:52:01.001466+0000","last_fullsized":"2024-04-25T08:52:01.001466+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:45.695332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000795+0000","last_change":"2024-04-25T08:51:58.686307+0000","last_active":"2024-04-25T08:52:01.000795+0000","last_peered":"2024-04-25T08:52:01.000795+0000","last_clean":"2024-04-25T08:52:01.000795+0000","last_became_active":"2024-04-25T08:51:58.685998+0000","last_became_peered":"2024-04-25T08:51:58.685998+0000","last_unstale":"2024-04-25T08:52:01.000795+0000","last_undegraded":"2024-04-25T08:52:01.000795+0000","last_fullsized":"2024-04-25T08:52:01.000795+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:36.152322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"142'8","reported_seq":22,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687356+0000","last_change":"2024-04-25T08:51:57.674597+0000","last_active":"2024-04-25T08:51:59.687356+0000","last_peered":"2024-04-25T08:51:59.687356+0000","last_clean":"2024-04-25T08:51:59.687356+0000","last_became_active":"2024-04-25T08:51:57.674343+0000","last_became_peered":"2024-04-25T08:51:57.674343+0000","last_unstale":"2024-04-25T08:51:59.687356+0000","last_undegraded":"2024-04-25T08:51:59.687356+0000","last_fullsized":"2024-04-25T08:51:59.687356+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:42.141421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702458+0000","last_change":"2024-04-25T08:51:58.685128+0000","last_active":"2024-04-25T08:51:59.702458+0000","last_peered":"2024-04-25T08:51:59.702458+0000","last_clean":"2024-04-25T08:51:59.702458+0000","last_became_active":"2024-04-25T08:51:58.684819+0000","last_became_peered":"2024-04-25T08:51:58.684819+0000","last_unstale":"2024-04-25T08:51:59.702458+0000","last_undegraded":"2024-04-25T08:51:59.702458+0000","last_fullsized":"2024-04-25T08:51:59.702458+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372156+0000","last_change":"2024-04-25T08:51:57.673131+0000","last_active":"2024-04-25T08:52:00.372156+0000","last_peered":"2024-04-25T08:52:00.372156+0000","last_clean":"2024-04-25T08:52:00.372156+0000","last_became_active":"2024-04-25T08:51:57.672351+0000","last_became_peered":"2024-04-25T08:51:57.672351+0000","last_unstale":"2024-04-25T08:52:00.372156+0000","last_undegraded":"2024-04-25T08:52:00.372156+0000","last_fullsized":"2024-04-25T08:52:00.372156+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:27.669933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702702+0000","last_change":"2024-04-25T08:51:58.687945+0000","last_active":"2024-04-25T08:51:59.702702+0000","last_peered":"2024-04-25T08:51:59.702702+0000","last_clean":"2024-04-25T08:51:59.702702+0000","last_became_active":"2024-04-25T08:51:58.687329+0000","last_became_peered":"2024-04-25T08:51:58.687329+0000","last_unstale":"2024-04-25T08:51:59.702702+0000","last_undegraded":"2024-04-25T08:51:59.702702+0000","last_fullsized":"2024-04-25T08:51:59.702702+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702620+0000","last_change":"2024-04-25T08:51:57.675051+0000","last_active":"2024-04-25T08:51:59.702620+0000","last_peered":"2024-04-25T08:51:59.702620+0000","last_clean":"2024-04-25T08:51:59.702620+0000","last_became_active":"2024-04-25T08:51:57.674775+0000","last_became_peered":"2024-04-25T08:51:57.674775+0000","last_unstale":"2024-04-25T08:51:59.702620+0000","last_undegraded":"2024-04-25T08:51:59.702620+0000","last_fullsized":"2024-04-25T08:51:59.702620+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:35.148119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688764+0000","last_change":"2024-04-25T08:51:58.694109+0000","last_active":"2024-04-25T08:51:59.688764+0000","last_peered":"2024-04-25T08:51:59.688764+0000","last_clean":"2024-04-25T08:51:59.688764+0000","last_became_active":"2024-04-25T08:51:58.693751+0000","last_became_peered":"2024-04-25T08:51:58.693751+0000","last_unstale":"2024-04-25T08:51:59.688764+0000","last_undegraded":"2024-04-25T08:51:59.688764+0000","last_fullsized":"2024-04-25T08:51:59.688764+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:50.628812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"142'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000806+0000","last_change":"2024-04-25T08:51:57.681447+0000","last_active":"2024-04-25T08:52:01.000806+0000","last_peered":"2024-04-25T08:52:01.000806+0000","last_clean":"2024-04-25T08:52:01.000806+0000","last_became_active":"2024-04-25T08:51:57.680908+0000","last_became_peered":"2024-04-25T08:51:57.680908+0000","last_unstale":"2024-04-25T08:52:01.000806+0000","last_undegraded":"2024-04-25T08:52:01.000806+0000","last_fullsized":"2024-04-25T08:52:01.000806+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:44.242903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688440+0000","last_change":"2024-04-25T08:51:58.692191+0000","last_active":"2024-04-25T08:51:59.688440+0000","last_peered":"2024-04-25T08:51:59.688440+0000","last_clean":"2024-04-25T08:51:59.688440+0000","last_became_active":"2024-04-25T08:51:58.691907+0000","last_became_peered":"2024-04-25T08:51:58.691907+0000","last_unstale":"2024-04-25T08:51:59.688440+0000","last_undegraded":"2024-04-25T08:51:59.688440+0000","last_fullsized":"2024-04-25T08:51:59.688440+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:56.594740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001524+0000","last_change":"2024-04-25T08:51:57.683826+0000","last_active":"2024-04-25T08:52:01.001524+0000","last_peered":"2024-04-25T08:52:01.001524+0000","last_clean":"2024-04-25T08:52:01.001524+0000","last_became_active":"2024-04-25T08:51:57.683526+0000","last_became_peered":"2024-04-25T08:51:57.683526+0000","last_unstale":"2024-04-25T08:52:01.001524+0000","last_undegraded":"2024-04-25T08:52:01.001524+0000","last_fullsized":"2024-04-25T08:52:01.001524+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:19.949576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702371+0000","last_change":"2024-04-25T08:51:58.687702+0000","last_active":"2024-04-25T08:51:59.702371+0000","last_peered":"2024-04-25T08:51:59.702371+0000","last_clean":"2024-04-25T08:51:59.702371+0000","last_became_active":"2024-04-25T08:51:58.687428+0000","last_became_peered":"2024-04-25T08:51:58.687428+0000","last_unstale":"2024-04-25T08:51:59.702371+0000","last_undegraded":"2024-04-25T08:51:59.702371+0000","last_fullsized":"2024-04-25T08:51:59.702371+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:41.556287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682529+0000","last_change":"2024-04-25T08:51:57.685728+0000","last_active":"2024-04-25T08:51:59.682529+0000","last_peered":"2024-04-25T08:51:59.682529+0000","last_clean":"2024-04-25T08:51:59.682529+0000","last_became_active":"2024-04-25T08:51:57.685418+0000","last_became_peered":"2024-04-25T08:51:57.685418+0000","last_unstale":"2024-04-25T08:51:59.682529+0000","last_undegraded":"2024-04-25T08:51:59.682529+0000","last_fullsized":"2024-04-25T08:51:59.682529+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:16.987390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000597+0000","last_change":"2024-04-25T08:51:58.690815+0000","last_active":"2024-04-25T08:52:01.000597+0000","last_peered":"2024-04-25T08:52:01.000597+0000","last_clean":"2024-04-25T08:52:01.000597+0000","last_became_active":"2024-04-25T08:51:58.689859+0000","last_became_peered":"2024-04-25T08:51:58.689859+0000","last_unstale":"2024-04-25T08:52:01.000597+0000","last_undegraded":"2024-04-25T08:52:01.000597+0000","last_fullsized":"2024-04-25T08:52:01.000597+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:49.689890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687554+0000","last_change":"2024-04-25T08:51:57.683172+0000","last_active":"2024-04-25T08:51:59.687554+0000","last_peered":"2024-04-25T08:51:59.687554+0000","last_clean":"2024-04-25T08:51:59.687554+0000","last_became_active":"2024-04-25T08:51:57.682905+0000","last_became_peered":"2024-04-25T08:51:57.682905+0000","last_unstale":"2024-04-25T08:51:59.687554+0000","last_undegraded":"2024-04-25T08:51:59.687554+0000","last_fullsized":"2024-04-25T08:51:59.687554+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.724725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702362+0000","last_change":"2024-04-25T08:51:58.684054+0000","last_active":"2024-04-25T08:51:59.702362+0000","last_peered":"2024-04-25T08:51:59.702362+0000","last_clean":"2024-04-25T08:51:59.702362+0000","last_became_active":"2024-04-25T08:51:58.683726+0000","last_became_peered":"2024-04-25T08:51:58.683726+0000","last_unstale":"2024-04-25T08:51:59.702362+0000","last_undegraded":"2024-04-25T08:51:59.702362+0000","last_fullsized":"2024-04-25T08:51:59.702362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:01.090794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682403+0000","last_change":"2024-04-25T08:51:57.684720+0000","last_active":"2024-04-25T08:51:59.682403+0000","last_peered":"2024-04-25T08:51:59.682403+0000","last_clean":"2024-04-25T08:51:59.682403+0000","last_became_active":"2024-04-25T08:51:57.684468+0000","last_became_peered":"2024-04-25T08:51:57.684468+0000","last_unstale":"2024-04-25T08:51:59.682403+0000","last_undegraded":"2024-04-25T08:51:59.682403+0000","last_fullsized":"2024-04-25T08:51:59.682403+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:02.587687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000685+0000","last_change":"2024-04-25T08:51:58.698210+0000","last_active":"2024-04-25T08:52:01.000685+0000","last_peered":"2024-04-25T08:52:01.000685+0000","last_clean":"2024-04-25T08:52:01.000685+0000","last_became_active":"2024-04-25T08:51:58.697934+0000","last_became_peered":"2024-04-25T08:51:58.697934+0000","last_unstale":"2024-04-25T08:52:01.000685+0000","last_undegraded":"2024-04-25T08:52:01.000685+0000","last_fullsized":"2024-04-25T08:52:01.000685+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:51.804341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688698+0000","last_change":"2024-04-25T08:51:57.684696+0000","last_active":"2024-04-25T08:51:59.688698+0000","last_peered":"2024-04-25T08:51:59.688698+0000","last_clean":"2024-04-25T08:51:59.688698+0000","last_became_active":"2024-04-25T08:51:57.684380+0000","last_became_peered":"2024-04-25T08:51:57.684380+0000","last_unstale":"2024-04-25T08:51:59.688698+0000","last_undegraded":"2024-04-25T08:51:59.688698+0000","last_fullsized":"2024-04-25T08:51:59.688698+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:58.013246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001206+0000","last_change":"2024-04-25T08:51:58.679751+0000","last_active":"2024-04-25T08:52:01.001206+0000","last_peered":"2024-04-25T08:52:01.001206+0000","last_clean":"2024-04-25T08:52:01.001206+0000","last_became_active":"2024-04-25T08:51:58.679472+0000","last_became_peered":"2024-04-25T08:51:58.679472+0000","last_unstale":"2024-04-25T08:52:01.001206+0000","last_undegraded":"2024-04-25T08:52:01.001206+0000","last_fullsized":"2024-04-25T08:52:01.001206+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:37.006256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"142'2","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001740+0000","last_change":"2024-04-25T08:51:57.684094+0000","last_active":"2024-04-25T08:52:01.001740+0000","last_peered":"2024-04-25T08:52:01.001740+0000","last_clean":"2024-04-25T08:52:01.001740+0000","last_became_active":"2024-04-25T08:51:57.683629+0000","last_became_peered":"2024-04-25T08:51:57.683629+0000","last_unstale":"2024-04-25T08:52:01.001740+0000","last_undegraded":"2024-04-25T08:52:01.001740+0000","last_fullsized":"2024-04-25T08:52:01.001740+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:07.130284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001675+0000","last_change":"2024-04-25T08:51:58.700932+0000","last_active":"2024-04-25T08:52:01.001675+0000","last_peered":"2024-04-25T08:52:01.001675+0000","last_clean":"2024-04-25T08:52:01.001675+0000","last_became_active":"2024-04-25T08:51:58.700672+0000","last_became_peered":"2024-04-25T08:51:58.700672+0000","last_unstale":"2024-04-25T08:52:01.001675+0000","last_undegraded":"2024-04-25T08:52:01.001675+0000","last_fullsized":"2024-04-25T08:52:01.001675+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"143'1","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.701616+0000","last_change":"2024-04-25T08:51:57.683105+0000","last_active":"2024-04-25T08:51:59.701616+0000","last_peered":"2024-04-25T08:51:59.701616+0000","last_clean":"2024-04-25T08:51:59.701616+0000","last_became_active":"2024-04-25T08:51:57.682754+0000","last_became_peered":"2024-04-25T08:51:57.682754+0000","last_unstale":"2024-04-25T08:51:59.701616+0000","last_undegraded":"2024-04-25T08:51:59.701616+0000","last_fullsized":"2024-04-25T08:51:59.701616+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:39.113507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688828+0000","last_change":"2024-04-25T08:51:58.693432+0000","last_active":"2024-04-25T08:51:59.688828+0000","last_peered":"2024-04-25T08:51:59.688828+0000","last_clean":"2024-04-25T08:51:59.688828+0000","last_became_active":"2024-04-25T08:51:58.691780+0000","last_became_peered":"2024-04-25T08:51:58.691780+0000","last_unstale":"2024-04-25T08:51:59.688828+0000","last_undegraded":"2024-04-25T08:51:59.688828+0000","last_fullsized":"2024-04-25T08:51:59.688828+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:28.777400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000907+0000","last_change":"2024-04-25T08:51:57.684558+0000","last_active":"2024-04-25T08:52:01.000907+0000","last_peered":"2024-04-25T08:52:01.000907+0000","last_clean":"2024-04-25T08:52:01.000907+0000","last_became_active":"2024-04-25T08:51:57.684293+0000","last_became_peered":"2024-04-25T08:51:57.684293+0000","last_unstale":"2024-04-25T08:52:01.000907+0000","last_undegraded":"2024-04-25T08:52:01.000907+0000","last_fullsized":"2024-04-25T08:52:01.000907+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:06.845729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001157+0000","last_change":"2024-04-25T08:51:58.693635+0000","last_active":"2024-04-25T08:52:01.001157+0000","last_peered":"2024-04-25T08:52:01.001157+0000","last_clean":"2024-04-25T08:52:01.001157+0000","last_became_active":"2024-04-25T08:51:58.693270+0000","last_became_peered":"2024-04-25T08:51:58.693270+0000","last_unstale":"2024-04-25T08:52:01.001157+0000","last_undegraded":"2024-04-25T08:52:01.001157+0000","last_fullsized":"2024-04-25T08:52:01.001157+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:03.591890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001218+0000","last_change":"2024-04-25T08:51:57.681906+0000","last_active":"2024-04-25T08:52:01.001218+0000","last_peered":"2024-04-25T08:52:01.001218+0000","last_clean":"2024-04-25T08:52:01.001218+0000","last_became_active":"2024-04-25T08:51:57.681578+0000","last_became_peered":"2024-04-25T08:51:57.681578+0000","last_unstale":"2024-04-25T08:52:01.001218+0000","last_undegraded":"2024-04-25T08:52:01.001218+0000","last_fullsized":"2024-04-25T08:52:01.001218+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:21.385739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688362+0000","last_change":"2024-04-25T08:51:58.691133+0000","last_active":"2024-04-25T08:51:59.688362+0000","last_peered":"2024-04-25T08:51:59.688362+0000","last_clean":"2024-04-25T08:51:59.688362+0000","last_became_active":"2024-04-25T08:51:58.690826+0000","last_became_peered":"2024-04-25T08:51:58.690826+0000","last_unstale":"2024-04-25T08:51:59.688362+0000","last_undegraded":"2024-04-25T08:51:59.688362+0000","last_fullsized":"2024-04-25T08:51:59.688362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:57.980936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687676+0000","last_change":"2024-04-25T08:51:57.673573+0000","last_active":"2024-04-25T08:51:59.687676+0000","last_peered":"2024-04-25T08:51:59.687676+0000","last_clean":"2024-04-25T08:51:59.687676+0000","last_became_active":"2024-04-25T08:51:57.673302+0000","last_became_peered":"2024-04-25T08:51:57.673302+0000","last_unstale":"2024-04-25T08:51:59.687676+0000","last_undegraded":"2024-04-25T08:51:59.687676+0000","last_fullsized":"2024-04-25T08:51:59.687676+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:22.616954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.001327+0000","last_change":"2024-04-25T08:51:58.700123+0000","last_active":"2024-04-25T08:52:01.001327+0000","last_peered":"2024-04-25T08:52:01.001327+0000","last_clean":"2024-04-25T08:52:01.001327+0000","last_became_active":"2024-04-25T08:51:58.699870+0000","last_became_peered":"2024-04-25T08:51:58.699870+0000","last_unstale":"2024-04-25T08:52:01.001327+0000","last_undegraded":"2024-04-25T08:52:01.001327+0000","last_fullsized":"2024-04-25T08:52:01.001327+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:00.372214+0000","last_change":"2024-04-25T08:51:57.683935+0000","last_active":"2024-04-25T08:52:00.372214+0000","last_peered":"2024-04-25T08:52:00.372214+0000","last_clean":"2024-04-25T08:52:00.372214+0000","last_became_active":"2024-04-25T08:51:57.683646+0000","last_became_peered":"2024-04-25T08:51:57.683646+0000","last_unstale":"2024-04-25T08:52:00.372214+0000","last_undegraded":"2024-04-25T08:52:00.372214+0000","last_fullsized":"2024-04-25T08:52:00.372214+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:14.617656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:52:01.000581+0000","last_change":"2024-04-25T08:51:58.686967+0000","last_active":"2024-04-25T08:52:01.000581+0000","last_peered":"2024-04-25T08:52:01.000581+0000","last_clean":"2024-04-25T08:52:01.000581+0000","last_became_active":"2024-04-25T08:51:58.686651+0000","last_became_peered":"2024-04-25T08:51:58.686651+0000","last_unstale":"2024-04-25T08:52:01.000581+0000","last_undegraded":"2024-04-25T08:52:01.000581+0000","last_fullsized":"2024-04-25T08:52:01.000581+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:40.117710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.687877+0000","last_change":"2024-04-25T08:51:57.679212+0000","last_active":"2024-04-25T08:51:59.687877+0000","last_peered":"2024-04-25T08:51:59.687877+0000","last_clean":"2024-04-25T08:51:59.687877+0000","last_became_active":"2024-04-25T08:51:57.678913+0000","last_became_peered":"2024-04-25T08:51:57.678913+0000","last_unstale":"2024-04-25T08:51:59.687877+0000","last_undegraded":"2024-04-25T08:51:59.687877+0000","last_fullsized":"2024-04-25T08:51:59.687877+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:18.043975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688665+0000","last_change":"2024-04-25T08:51:58.702307+0000","last_active":"2024-04-25T08:51:59.688665+0000","last_peered":"2024-04-25T08:51:59.688665+0000","last_clean":"2024-04-25T08:51:59.688665+0000","last_became_active":"2024-04-25T08:51:58.702035+0000","last_became_peered":"2024-04-25T08:51:58.702035+0000","last_unstale":"2024-04-25T08:51:59.688665+0000","last_undegraded":"2024-04-25T08:51:59.688665+0000","last_fullsized":"2024-04-25T08:51:59.688665+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:24.534708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702275+0000","last_change":"2024-04-25T08:51:57.673963+0000","last_active":"2024-04-25T08:51:59.702275+0000","last_peered":"2024-04-25T08:51:59.702275+0000","last_clean":"2024-04-25T08:51:59.702275+0000","last_became_active":"2024-04-25T08:51:57.673682+0000","last_became_peered":"2024-04-25T08:51:57.673682+0000","last_unstale":"2024-04-25T08:51:59.702275+0000","last_undegraded":"2024-04-25T08:51:59.702275+0000","last_fullsized":"2024-04-25T08:51:59.702275+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:40.470761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.688096+0000","last_change":"2024-04-25T08:51:58.695857+0000","last_active":"2024-04-25T08:51:59.688096+0000","last_peered":"2024-04-25T08:51:59.688096+0000","last_clean":"2024-04-25T08:51:59.688096+0000","last_became_active":"2024-04-25T08:51:58.695470+0000","last_became_peered":"2024-04-25T08:51:58.695470+0000","last_unstale":"2024-04-25T08:51:59.688096+0000","last_undegraded":"2024-04-25T08:51:59.688096+0000","last_fullsized":"2024-04-25T08:51:59.688096+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:57.660175+0000","last_clean_scrub_stamp":"2024-04-25T08:51:57.660175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:29.842835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"142'6","reported_seq":20,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.682707+0000","last_change":"2024-04-25T08:51:57.685128+0000","last_active":"2024-04-25T08:51:59.682707+0000","last_peered":"2024-04-25T08:51:59.682707+0000","last_clean":"2024-04-25T08:51:59.682707+0000","last_became_active":"2024-04-25T08:51:57.684874+0000","last_became_peered":"2024-04-25T08:51:57.684874+0000","last_unstale":"2024-04-25T08:51:59.682707+0000","last_undegraded":"2024-04-25T08:51:59.682707+0000","last_fullsized":"2024-04-25T08:51:59.682707+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:51:56.655972+0000","last_clean_scrub_stamp":"2024-04-25T08:51:56.655972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:35.538961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":396,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-04-25T08:51:59.702330+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:51:59.702330+0000","last_peered":"2024-04-25T08:51:59.702330+0000","last_clean":"2024-04-25T08:51:59.702330+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:51:59.702330+0000","last_undegraded":"2024-04-25T08:51:59.702330+0000","last_fullsized":"2024-04-25T08:51:59.702330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51564,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320276,"statfs":{"total":96636764160,"available":96583962624,"internally_reserved":0,"allocated":2392064,"data_stored":1428303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":837983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46824,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325016,"statfs":{"total":96636764160,"available":96588816384,"internally_reserved":0,"allocated":1794048,"data_stored":837913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574970,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55156,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316684,"statfs":{"total":96636764160,"available":96580284416,"internally_reserved":0,"allocated":1806336,"data_stored":839525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59308,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312532,"statfs":{"total":96636764160,"available":96576032768,"internally_reserved":0,"allocated":1802240,"data_stored":838529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50988,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320852,"statfs":{"total":96636764160,"available":96584552448,"internally_reserved":0,"allocated":1802240,"data_stored":838025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50984,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320856,"statfs":{"total":96636764160,"available":96584556544,"internally_reserved":0,"allocated":1798144,"data_stored":837983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51584,"kb_used_data":2356,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320256,"statfs":{"total":96636764160,"available":96583942144,"internally_reserved":0,"allocated":2412544,"data_stored":1430599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:52:06.936 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T08:52:06.936 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T08:52:07.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.086+0000 7f4395510640 1 Processor -- start 2024-04-25T08:52:07.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.086+0000 7f4395510640 1 -- start start 2024-04-25T08:52:07.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f4395510640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f439015dc20 0x7f43900d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f4395510640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f43900ced80 0x7f43900b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f4395510640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43900d2120 con 0x7f43900d1ce0 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f4395510640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43900d23a0 con 0x7f43900ced80 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f4395510640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43900d2680 con 0x7f439015dc20 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f438f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f43900ced80 0x7f43900b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f438f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f43900ced80 0x7f43900b9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37142/0 (socket says 172.21.15.172:37142) 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f438f7fe640 1 -- 172.21.15.172:0/2541491031 learned_addr learned my addr 172.21.15.172:0/2541491031 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f438f7fe640 1 -- 172.21.15.172:0/2541491031 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f439015dc20 msgr2=0x7f43900d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f438f7fe640 1 --2- 172.21.15.172:0/2541491031 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f439015dc20 0x7f43900d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f438f7fe640 1 -- 172.21.15.172:0/2541491031 >> v1:172.21.15.186:6789/0 conn(0x7f43900d1ce0 legacy=0x7f43900ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.087+0000 7f438f7fe640 1 -- 172.21.15.172:0/2541491031 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43900d2960 con 0x7f43900ced80 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.088+0000 7f438f7fe640 1 --2- 172.21.15.172:0/2541491031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900ced80 0x7f43900b9490 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f4388009e80 tx=0x7f438802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddd247eab9a5cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.088+0000 7f438dffb640 1 -- 172.21.15.172:0/2541491031 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388036070 con 0x7f43900ced80 2024-04-25T08:52:07.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.088+0000 7f438dffb640 1 -- 172.21.15.172:0/2541491031 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388031600 con 0x7f43900ced80 2024-04-25T08:52:07.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.088+0000 7f438dffb640 1 -- 172.21.15.172:0/2541491031 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43880319d0 con 0x7f43900ced80 2024-04-25T08:52:07.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.089+0000 7f4395510640 1 -- 172.21.15.172:0/2541491031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900ced80 msgr2=0x7f43900b9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.089+0000 7f4395510640 1 --2- 172.21.15.172:0/2541491031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900ced80 0x7f43900b9490 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f4388009e80 tx=0x7f438802a660 comp rx=0 tx=0).stop 2024-04-25T08:52:07.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.089+0000 7f4395510640 1 -- 172.21.15.172:0/2541491031 shutdown_connections 2024-04-25T08:52:07.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.089+0000 7f4395510640 1 --2- 172.21.15.172:0/2541491031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900ced80 0x7f43900b9490 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.089+0000 7f4395510640 1 --2- 172.21.15.172:0/2541491031 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f439015dc20 0x7f43900d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.089+0000 7f4395510640 1 -- 172.21.15.172:0/2541491031 >> 172.21.15.172:0/2541491031 conn(0x7f4390061a20 msgr2=0x7f4390061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:07.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.089+0000 7f4395510640 1 -- 172.21.15.172:0/2541491031 shutdown_connections 2024-04-25T08:52:07.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.089+0000 7f4395510640 1 -- 172.21.15.172:0/2541491031 wait complete. 2024-04-25T08:52:07.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.090+0000 7f4395510640 1 Processor -- start 2024-04-25T08:52:07.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.090+0000 7f4395510640 1 -- start start 2024-04-25T08:52:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f4395510640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43900ced80 0x7f439015e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f4395510640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900d1ce0 0x7f439015e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f4395510640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f439015dc20 0x7f439014a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f4395510640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43900b6a30 con 0x7f43900d1ce0 2024-04-25T08:52:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f4395510640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43900d2f20 con 0x7f439015dc20 2024-04-25T08:52:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f4395510640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43900b6bb0 con 0x7f43900ced80 2024-04-25T08:52:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900d1ce0 0x7f439015e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438e7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900d1ce0 0x7f439015e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:37154/0 (socket says 172.21.15.172:37154) 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438e7fc640 1 -- 172.21.15.172:0/2196625883 learned_addr learned my addr 172.21.15.172:0/2196625883 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438f7fe640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f439015dc20 0x7f439014a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438effd640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43900ced80 0x7f439015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438e7fc640 1 -- 172.21.15.172:0/2196625883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43900ced80 msgr2=0x7f439015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438e7fc640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43900ced80 0x7f439015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438e7fc640 1 -- 172.21.15.172:0/2196625883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f439015dc20 msgr2=0x7f439014a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438e7fc640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f439015dc20 0x7f439014a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438e7fc640 1 -- 172.21.15.172:0/2196625883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4390147f40 con 0x7f43900d1ce0 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.091+0000 7f438e7fc640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900d1ce0 0x7f439015e970 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f438400c460 tx=0x7f438400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.092+0000 7f43777fe640 1 -- 172.21.15.172:0/2196625883 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384016020 con 0x7f43900d1ce0 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.092+0000 7f43777fe640 1 -- 172.21.15.172:0/2196625883 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4384012870 con 0x7f43900d1ce0 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.092+0000 7f4395510640 1 -- 172.21.15.172:0/2196625883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439015f1a0 con 0x7f43900d1ce0 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.092+0000 7f43777fe640 1 -- 172.21.15.172:0/2196625883 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384012c60 con 0x7f43900d1ce0 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.092+0000 7f4395510640 1 -- 172.21.15.172:0/2196625883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439015f760 con 0x7f43900d1ce0 2024-04-25T08:52:07.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.093+0000 7f4395510640 1 -- 172.21.15.172:0/2196625883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43900d0ed0 con 0x7f43900d1ce0 2024-04-25T08:52:07.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.093+0000 7f43777fe640 1 -- 172.21.15.172:0/2196625883 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4384019020 con 0x7f43900d1ce0 2024-04-25T08:52:07.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.093+0000 7f43777fe640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f437c06b500 0x7f437c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.093+0000 7f43777fe640 1 -- 172.21.15.172:0/2196625883 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4384089d70 con 0x7f43900d1ce0 2024-04-25T08:52:07.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.093+0000 7f438effd640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f437c06b500 0x7f437c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.094+0000 7f438effd640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f437c06b500 0x7f437c06d9c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4390160e70 tx=0x7f4380008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:07.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.098+0000 7f43777fe640 1 -- 172.21.15.172:0/2196625883 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f43900d0ed0 con 0x7f43900d1ce0 2024-04-25T08:52:07.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.335+0000 7f4395510640 1 -- 172.21.15.172:0/2196625883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4390061fa0 con 0x7f43900d1ce0 2024-04-25T08:52:07.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.337+0000 7f43777fe640 1 -- 172.21.15.172:0/2196625883 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7f4384020070 con 0x7f43900d1ce0 2024-04-25T08:52:07.328 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T08:52:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA7FypmBlmyFhAAQ8lToMI0jk0wcs+OJ1VD0Q== 2024-04-25T08:52:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: caps mds = "allow" 2024-04-25T08:52:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: caps mon = "allow r" 2024-04-25T08:52:07.328 INFO:teuthology.orchestra.run.smithi172.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T08:52:07.328 INFO:teuthology.orchestra.run.smithi172.stderr:updated caps for client.0 2024-04-25T08:52:07.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.339+0000 7f4395510640 1 -- 172.21.15.172:0/2196625883 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f437c06b500 msgr2=0x7f437c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f437c06b500 0x7f437c06d9c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4390160e70 tx=0x7f4380008040 comp rx=0 tx=0).stop 2024-04-25T08:52:07.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 -- 172.21.15.172:0/2196625883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900d1ce0 msgr2=0x7f439015e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900d1ce0 0x7f439015e970 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f438400c460 tx=0x7f438400c920 comp rx=0 tx=0).stop 2024-04-25T08:52:07.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 -- 172.21.15.172:0/2196625883 shutdown_connections 2024-04-25T08:52:07.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f437c06b500 0x7f437c06d9c0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f439015dc20 0x7f439014a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43900d1ce0 0x7f439015e970 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 --2- 172.21.15.172:0/2196625883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43900ced80 0x7f439015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 -- 172.21.15.172:0/2196625883 >> 172.21.15.172:0/2196625883 conn(0x7f4390061a20 msgr2=0x7f43900b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:07.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 -- 172.21.15.172:0/2196625883 shutdown_connections 2024-04-25T08:52:07.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.340+0000 7f4395510640 1 -- 172.21.15.172:0/2196625883 wait complete. 2024-04-25T08:52:07.341 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:52:07.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.448+0000 7faba0d3b640 1 Processor -- start 2024-04-25T08:52:07.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.448+0000 7faba0d3b640 1 -- start start 2024-04-25T08:52:07.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7faba0d3b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fab9c0cfec0 0x7fab9c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7faba0d3b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7faba0d3b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9c071480 con 0x7fab9c154ee0 2024-04-25T08:52:07.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7faba0d3b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9c0ce830 con 0x7fab9c0cfec0 2024-04-25T08:52:07.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7faba0d3b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c072090 con 0x7fab9c0ce3c0 2024-04-25T08:52:07.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7fab9ad9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7fab93fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fab9c0cfec0 0x7fab9c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7fab9a59c640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fab9c154ee0 0x7fab9c0cf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:45724/0 (socket says 172.21.15.172:45724) 2024-04-25T08:52:07.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7fab9ad9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c06d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:52044/0 (socket says 172.21.15.172:52044) 2024-04-25T08:52:07.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7fab93fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fab9c0cfec0 0x7fab9c0cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:35792/0 (socket says 172.21.15.172:35792) 2024-04-25T08:52:07.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.449+0000 7fab9a59c640 1 -- 172.21.15.172:0/2308435026 learned_addr learned my addr 172.21.15.172:0/2308435026 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:07.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.450+0000 7fab9ad9d640 1 -- 172.21.15.172:0/2308435026 >> v2:172.21.15.186:3300/0 conn(0x7fab9c0cfec0 msgr2=0x7fab9c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:07.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.450+0000 7fab9ad9d640 1 --2- 172.21.15.172:0/2308435026 >> v2:172.21.15.186:3300/0 conn(0x7fab9c0cfec0 0x7fab9c0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.450+0000 7fab9ad9d640 1 -- 172.21.15.172:0/2308435026 >> v1:172.21.15.186:6789/0 conn(0x7fab9c154ee0 legacy=0x7fab9c0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.450+0000 7fab9ad9d640 1 -- 172.21.15.172:0/2308435026 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c071760 con 0x7fab9c0ce3c0 2024-04-25T08:52:07.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.450+0000 7fab99d9b640 1 -- 172.21.15.172:0/2308435026 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048372820 0 0) 0x7fab9c071480 con 0x7fab9c154ee0 2024-04-25T08:52:07.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.450+0000 7fab93fff640 1 --2- 172.21.15.172:0/2308435026 >> v2:172.21.15.186:3300/0 conn(0x7fab9c0cfec0 0x7fab9c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:52:07.442 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.450+0000 7fab9ad9d640 1 --2- 172.21.15.172:0/2308435026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c06d6f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fab9400bfa0 tx=0x7fab9402c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9063555111617c10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.450+0000 7fab99d9b640 1 -- 172.21.15.172:0/2308435026 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94039070 con 0x7fab9c0ce3c0 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.450+0000 7fab99d9b640 1 -- 172.21.15.172:0/2308435026 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab94009540 con 0x7fab9c0ce3c0 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.450+0000 7fab99d9b640 1 -- 172.21.15.172:0/2308435026 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94009910 con 0x7fab9c0ce3c0 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.451+0000 7faba0d3b640 1 -- 172.21.15.172:0/2308435026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 msgr2=0x7fab9c06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.451+0000 7faba0d3b640 1 --2- 172.21.15.172:0/2308435026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c06d6f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fab9400bfa0 tx=0x7fab9402c860 comp rx=0 tx=0).stop 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.451+0000 7faba0d3b640 1 -- 172.21.15.172:0/2308435026 shutdown_connections 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.451+0000 7faba0d3b640 1 --2- 172.21.15.172:0/2308435026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c06d6f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.451+0000 7faba0d3b640 1 --2- 172.21.15.172:0/2308435026 >> v2:172.21.15.186:3300/0 conn(0x7fab9c0cfec0 0x7fab9c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.451+0000 7faba0d3b640 1 -- 172.21.15.172:0/2308435026 >> 172.21.15.172:0/2308435026 conn(0x7fab9c06abe0 msgr2=0x7fab9c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.451+0000 7faba0d3b640 1 -- 172.21.15.172:0/2308435026 shutdown_connections 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.451+0000 7faba0d3b640 1 -- 172.21.15.172:0/2308435026 wait complete. 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.452+0000 7faba0d3b640 1 Processor -- start 2024-04-25T08:52:07.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.452+0000 7faba0d3b640 1 -- start start 2024-04-25T08:52:07.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7faba0d3b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c1f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7faba0d3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9c0cfec0 0x7fab9c14afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7faba0d3b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab9c154ee0 0x7fab9c153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7faba0d3b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c071d20 con 0x7fab9c0cfec0 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7faba0d3b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c071230 con 0x7fab9c154ee0 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7faba0d3b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c1552c0 con 0x7fab9c0ce3c0 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7fab93fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9c0cfec0 0x7fab9c14afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7fab93fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9c0cfec0 0x7fab9c14afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59598/0 (socket says 172.21.15.172:59598) 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7fab93fff640 1 -- 172.21.15.172:0/162820623 learned_addr learned my addr 172.21.15.172:0/162820623 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7fab9ad9d640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab9c154ee0 0x7fab9c153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.453+0000 7fab9a59c640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c1f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7fab93fff640 1 -- 172.21.15.172:0/162820623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 msgr2=0x7fab9c1f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7fab93fff640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c1f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7fab93fff640 1 -- 172.21.15.172:0/162820623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab9c154ee0 msgr2=0x7fab9c153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7fab93fff640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab9c154ee0 0x7fab9c153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7fab93fff640 1 -- 172.21.15.172:0/162820623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c0a9740 con 0x7fab9c0cfec0 2024-04-25T08:52:07.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7fab9a59c640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c1f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:07.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7fab93fff640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9c0cfec0 0x7fab9c14afb0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fab8400ec10 tx=0x7fab8400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:07.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7fab92ffd640 1 -- 172.21.15.172:0/162820623 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84017070 con 0x7fab9c0cfec0 2024-04-25T08:52:07.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7fab92ffd640 1 -- 172.21.15.172:0/162820623 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400cbd0 con 0x7fab9c0cfec0 2024-04-25T08:52:07.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7faba0d3b640 1 -- 172.21.15.172:0/162820623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9c0a9a20 con 0x7fab9c0cfec0 2024-04-25T08:52:07.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7fab92ffd640 1 -- 172.21.15.172:0/162820623 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84013470 con 0x7fab9c0cfec0 2024-04-25T08:52:07.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.454+0000 7faba0d3b640 1 -- 172.21.15.172:0/162820623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9c0a9fe0 con 0x7fab9c0cfec0 2024-04-25T08:52:07.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.455+0000 7faba0d3b640 1 -- 172.21.15.172:0/162820623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9c073990 con 0x7fab9c0cfec0 2024-04-25T08:52:07.447 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.455+0000 7fab92ffd640 1 -- 172.21.15.172:0/162820623 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab8401a070 con 0x7fab9c0cfec0 2024-04-25T08:52:07.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.456+0000 7fab92ffd640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab7c06b4d0 0x7fab7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:07.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.456+0000 7fab9a59c640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab7c06b4d0 0x7fab7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:07.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.456+0000 7fab92ffd640 1 -- 172.21.15.172:0/162820623 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fab8408a5b0 con 0x7fab9c0cfec0 2024-04-25T08:52:07.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.456+0000 7fab9a59c640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab7c06b4d0 0x7fab7c06d990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fab8c000f60 tx=0x7fab8c007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:07.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.460+0000 7fab92ffd640 1 -- 172.21.15.172:0/162820623 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab84058c50 con 0x7fab9c0cfec0 2024-04-25T08:52:07.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.665+0000 7faba0d3b640 1 -- 172.21.15.172:0/162820623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab9c06d360 con 0x7fab9c0cfec0 2024-04-25T08:52:07.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.666+0000 7fab92ffd640 1 -- 172.21.15.172:0/162820623 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fab8405ccf0 con 0x7fab9c0cfec0 2024-04-25T08:52:07.656 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:07.657 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":85,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3226910746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3226910746},{"type":"v1","addr":"172.21.15.186:6834","nonce":3226910746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/741856049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":741856049},{"type":"v1","addr":"172.21.15.186:6835","nonce":741856049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":9819,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/406316339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":406316339},{"type":"v1","addr":"172.21.15.172:6835","nonce":406316339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T08:51:58.007519+0000","modified":"2024-04-25T08:52:00.645221+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9825},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9825":{"gid":9825,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2096375996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2096375996},{"type":"v1","addr":"172.21.15.172:6837","nonce":2096375996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T08:52:07.657 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 85 2024-04-25T08:52:07.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 -- 172.21.15.172:0/162820623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab7c06b4d0 msgr2=0x7fab7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab7c06b4d0 0x7fab7c06d990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fab8c000f60 tx=0x7fab8c007ca0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.658 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 -- 172.21.15.172:0/162820623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9c0cfec0 msgr2=0x7fab9c14afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:07.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9c0cfec0 0x7fab9c14afb0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fab8400ec10 tx=0x7fab8400c520 comp rx=0 tx=0).stop 2024-04-25T08:52:07.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 -- 172.21.15.172:0/162820623 shutdown_connections 2024-04-25T08:52:07.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fab7c06b4d0 0x7fab7c06d990 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab9c154ee0 0x7fab9c153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9c0cfec0 0x7fab9c14afb0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 --2- 172.21.15.172:0/162820623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab9c0ce3c0 0x7fab9c1f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:07.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 -- 172.21.15.172:0/162820623 >> 172.21.15.172:0/162820623 conn(0x7fab9c06abe0 msgr2=0x7fab9c15cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:07.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 -- 172.21.15.172:0/162820623 shutdown_connections 2024-04-25T08:52:07.659 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:07.668+0000 7faba0d3b640 1 -- 172.21.15.172:0/162820623 wait complete. 2024-04-25T08:52:08.073 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T08:51:58.007519+0000', 'modified': '2024-04-25T08:52:00.645221+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9825}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9825': {'gid': 9825, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6837/2096375996', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2096375996}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2096375996}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:52:08.073 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:52:08.073 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T08:52:08.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.184+0000 7f21e56d1640 1 Processor -- start 2024-04-25T08:52:08.175 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.184+0000 7f21e56d1640 1 -- start start 2024-04-25T08:52:08.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.185+0000 7f21e56d1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21e01610f0 0x7f21e006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.185+0000 7f21e56d1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 0x7f21e0161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.185+0000 7f21e56d1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e00c6960 con 0x7f21e00ce0a0 2024-04-25T08:52:08.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.185+0000 7f21e56d1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e01614d0 con 0x7f21e01610f0 2024-04-25T08:52:08.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.185+0000 7f21e56d1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0162260 con 0x7f21e01616f0 2024-04-25T08:52:08.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.185+0000 7f21deffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21e01610f0 0x7f21e006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.185+0000 7f21deffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21e01610f0 0x7f21e006c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59608/0 (socket says 172.21.15.172:59608) 2024-04-25T08:52:08.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.185+0000 7f21df7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f21e00ce0a0 0x7f21e00d0200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:47822/0 (socket says 172.21.15.172:47822) 2024-04-25T08:52:08.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.185+0000 7f21deffd640 1 -- 172.21.15.172:0/1216933272 learned_addr learned my addr 172.21.15.172:0/1216933272 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:08.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21de7fc640 1 --2- 172.21.15.172:0/1216933272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 0x7f21e0161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21deffd640 1 -- 172.21.15.172:0/1216933272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 msgr2=0x7f21e0161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21deffd640 1 --2- 172.21.15.172:0/1216933272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 0x7f21e0161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21deffd640 1 -- 172.21.15.172:0/1216933272 >> v1:172.21.15.172:6789/0 conn(0x7f21e00ce0a0 legacy=0x7f21e00d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21deffd640 1 -- 172.21.15.172:0/1216933272 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e0162540 con 0x7f21e01610f0 2024-04-25T08:52:08.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21ddffb640 1 -- 172.21.15.172:0/1216933272 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982847767 0 0) 0x7f21e00c6960 con 0x7f21e00ce0a0 2024-04-25T08:52:08.177 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21de7fc640 1 --2- 172.21.15.172:0/1216933272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 0x7f21e0161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21deffd640 1 --2- 172.21.15.172:0/1216933272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e01610f0 0x7f21e006c1c0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009e50 tx=0x7f21d002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd9d56ead2fe169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21ddffb640 1 -- 172.21.15.172:0/1216933272 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0036070 con 0x7f21e01610f0 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21ddffb640 1 -- 172.21.15.172:0/1216933272 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0031600 con 0x7f21e01610f0 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.186+0000 7f21ddffb640 1 -- 172.21.15.172:0/1216933272 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d00319d0 con 0x7f21e01610f0 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.187+0000 7f21e56d1640 1 -- 172.21.15.172:0/1216933272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e01610f0 msgr2=0x7f21e006c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.187+0000 7f21e56d1640 1 --2- 172.21.15.172:0/1216933272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e01610f0 0x7f21e006c1c0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009e50 tx=0x7f21d002a730 comp rx=0 tx=0).stop 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.187+0000 7f21e56d1640 1 -- 172.21.15.172:0/1216933272 shutdown_connections 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.187+0000 7f21e56d1640 1 --2- 172.21.15.172:0/1216933272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 0x7f21e0161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.187+0000 7f21e56d1640 1 --2- 172.21.15.172:0/1216933272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e01610f0 0x7f21e006c1c0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.187+0000 7f21e56d1640 1 -- 172.21.15.172:0/1216933272 >> 172.21.15.172:0/1216933272 conn(0x7f21e006f500 msgr2=0x7f21e006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.187+0000 7f21e56d1640 1 -- 172.21.15.172:0/1216933272 shutdown_connections 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.187+0000 7f21e56d1640 1 -- 172.21.15.172:0/1216933272 wait complete. 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.188+0000 7f21e56d1640 1 Processor -- start 2024-04-25T08:52:08.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.188+0000 7f21e56d1640 1 -- start start 2024-04-25T08:52:08.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21e56d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e00ce0a0 0x7f21e014c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21e56d1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21e01610f0 0x7f21e00cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21e56d1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 0x7f21e00cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21e56d1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00cf690 con 0x7f21e00ce0a0 2024-04-25T08:52:08.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21e56d1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00cfce0 con 0x7f21e01610f0 2024-04-25T08:52:08.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21e56d1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e006c700 con 0x7f21e01616f0 2024-04-25T08:52:08.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e00ce0a0 0x7f21e014c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e00ce0a0 0x7f21e014c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59620/0 (socket says 172.21.15.172:59620) 2024-04-25T08:52:08.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21deffd640 1 -- 172.21.15.172:0/1075763673 learned_addr learned my addr 172.21.15.172:0/1075763673 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21de7fc640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21e01610f0 0x7f21e00cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21df7fe640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 0x7f21e00cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21deffd640 1 -- 172.21.15.172:0/1075763673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 msgr2=0x7f21e00cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21deffd640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 0x7f21e00cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21deffd640 1 -- 172.21.15.172:0/1075763673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21e01610f0 msgr2=0x7f21e00cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21deffd640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21e01610f0 0x7f21e00cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21deffd640 1 -- 172.21.15.172:0/1075763673 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e014c830 con 0x7f21e00ce0a0 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.189+0000 7f21de7fc640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21e01610f0 0x7f21e00cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.190+0000 7f21deffd640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e00ce0a0 0x7f21e014c2f0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009e50 tx=0x7f21d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.190+0000 7f21c77fe640 1 -- 172.21.15.172:0/1075763673 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0041020 con 0x7f21e00ce0a0 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.190+0000 7f21c77fe640 1 -- 172.21.15.172:0/1075763673 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0037040 con 0x7f21e00ce0a0 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.190+0000 7f21e56d1640 1 -- 172.21.15.172:0/1075763673 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e00ccca0 con 0x7f21e00ce0a0 2024-04-25T08:52:08.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.190+0000 7f21c77fe640 1 -- 172.21.15.172:0/1075763673 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0036050 con 0x7f21e00ce0a0 2024-04-25T08:52:08.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.190+0000 7f21e56d1640 1 -- 172.21.15.172:0/1075763673 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e00cd260 con 0x7f21e00ce0a0 2024-04-25T08:52:08.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.191+0000 7f21c77fe640 1 -- 172.21.15.172:0/1075763673 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f21d0007c70 con 0x7f21e00ce0a0 2024-04-25T08:52:08.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.192+0000 7f21c77fe640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21cc06b500 0x7f21cc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.192+0000 7f21c77fe640 1 -- 172.21.15.172:0/1075763673 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f21d00aac20 con 0x7f21e00ce0a0 2024-04-25T08:52:08.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.192+0000 7f21de7fc640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21cc06b500 0x7f21cc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.192+0000 7f21de7fc640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21cc06b500 0x7f21cc06d9c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f21d4006fd0 tx=0x7f21d4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:08.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.193+0000 7f21e83cd740 1 Processor -- start 2024-04-25T08:52:08.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.193+0000 7f21e83cd740 1 -- start start 2024-04-25T08:52:08.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.193+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8b7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.193+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8d4ad0 0x55871e8d5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.193+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e88cf10 0x55871e8d3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.193+0000 7f21e83cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55871e7efa10 con 0x55871e8b7230 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.193+0000 7f21e83cd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55871e798b30 con 0x55871e8d4ad0 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.193+0000 7f21e83cd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55871e7ebc50 con 0x55871e88cf10 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59622/0 (socket says 172.21.15.172:59622) 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21deffd640 1 -- 172.21.15.172:0/3253859163 learned_addr learned my addr 172.21.15.172:0/3253859163 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21deffd640 1 -- 172.21.15.172:0/3253859163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e88cf10 msgr2=0x55871e8d3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21deffd640 1 --2- 172.21.15.172:0/3253859163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e88cf10 0x55871e8d3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21de7fc640 1 --2- 172.21.15.172:0/3253859163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8d4ad0 0x55871e8d5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21deffd640 1 -- 172.21.15.172:0/3253859163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8d4ad0 msgr2=0x55871e8d5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21deffd640 1 --2- 172.21.15.172:0/3253859163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8d4ad0 0x55871e8d5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21deffd640 1 -- 172.21.15.172:0/3253859163 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55871e7ade10 con 0x55871e8b7230 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21deffd640 1 --2- 172.21.15.172:0/3253859163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8b7610 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f21d00a9050 tx=0x7f21d0078cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25047146f940bccb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:08.191 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21c4ff9640 1 -- 172.21.15.172:0/3253859163 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d00792a0 con 0x55871e8b7230 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21c4ff9640 1 -- 172.21.15.172:0/3253859163 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d00a7070 con 0x55871e8b7230 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.194+0000 7f21c4ff9640 1 -- 172.21.15.172:0/3253859163 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d007d3f0 con 0x55871e8b7230 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 -- 172.21.15.172:0/3253859163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 msgr2=0x55871e8b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 --2- 172.21.15.172:0/3253859163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8b7610 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f21d00a9050 tx=0x7f21d0078cc0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 -- 172.21.15.172:0/3253859163 shutdown_connections 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 --2- 172.21.15.172:0/3253859163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8d4ad0 0x55871e8d5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 --2- 172.21.15.172:0/3253859163 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e88cf10 0x55871e8d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 --2- 172.21.15.172:0/3253859163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8b7610 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 -- 172.21.15.172:0/3253859163 >> 172.21.15.172:0/3253859163 conn(0x55871e889840 msgr2=0x55871e8d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 -- 172.21.15.172:0/3253859163 shutdown_connections 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 -- 172.21.15.172:0/3253859163 wait complete. 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 -- start start 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.195+0000 7f21e83cd740 1 Processor -- start 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8d4ad0 0x55871e8e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8864a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21e83cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55871e7efa10 con 0x55871e8b7230 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21e83cd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55871e7ac0c0 con 0x55871e8b9fd0 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21e83cd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55871e88dcb0 con 0x55871e8d4ad0 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21e83cd740 10 client.0 _ll_register_callbacks cb 0x55871e79fec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21deffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59634/0 (socket says 172.21.15.172:59634) 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21deffd640 1 -- 172.21.15.172:0/1459908599 learned_addr learned my addr 172.21.15.172:0/1459908599 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21de7fc640 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8d4ad0 0x55871e8e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.196+0000 7f21df7fe640 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8864a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21deffd640 1 -- 172.21.15.172:0/1459908599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8d4ad0 msgr2=0x55871e8e62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21deffd640 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8d4ad0 0x55871e8e62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21deffd640 1 -- 172.21.15.172:0/1459908599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 msgr2=0x55871e8864a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21deffd640 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8864a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21deffd640 1 -- 172.21.15.172:0/1459908599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55871e5042d0 con 0x55871e8b7230 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21df7fe640 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8864a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21deffd640 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8a1c30 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f21d00a4040 tx=0x7f21d0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bac47e268b9916 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21bdffb640 1 -- 172.21.15.172:0/1459908599 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0099070 con 0x55871e8b7230 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21bdffb640 1 -- 172.21.15.172:0/1459908599 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f21d00775a0 con 0x55871e8b7230 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21e83cd740 1 -- 172.21.15.172:0/1459908599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21d00a7070 con 0x55871e8b7230 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21bdffb640 1 -- 172.21.15.172:0/1459908599 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21d00819b0 con 0x55871e8b7230 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21e83cd740 10 client.10002 fetch_fsmap learned FSMap version 85 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21e83cd740 1 -- 172.21.15.172:0/1459908599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x55871e5ce6b0 con 0x55871e8b7230 2024-04-25T08:52:08.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21bdffb640 1 -- 172.21.15.172:0/1459908599 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d00a7070 con 0x55871e8b7230 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21bdffb640 1 -- 172.21.15.172:0/1459908599 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 85) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f21d00786f0 con 0x55871e8b7230 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21e83cd740 10 client.10002 fetch_fsmap finished waiting for FSMap version 85 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21e83cd740 10 client.10002 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21e83cd740 20 client.10002 populate_metadata read hostname 'smithi172' 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21e83cd740 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x55871e8b5a40 0x55871e8b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21e83cd740 4 client.10002 mds_command: new command op to 9825 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21e83cd740 1 -- 172.21.15.172:0/1459908599 --> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55871e84e920 con 0x55871e8b5a40 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.197+0000 7f21de7fc640 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x55871e8b5a40 0x55871e8b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21de7fc640 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x55871e8b5a40 0x55871e8b5e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=322d005a8831206d server_cookie=38b0612824b48ca8 in_seq=0 out_seq=0 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21bdffb640 10 client.10002 ms_handle_connect on v2:172.21.15.172:6836/2096375996 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21bdffb640 1 -- 172.21.15.172:0/1459908599 <== mds.0 v2:172.21.15.172:6836/2096375996 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55871e84e920 con 0x55871e8b5a40 2024-04-25T08:52:08.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21bdffb640 10 client.10002 handle_command_reply: tid=0 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21e83cd740 1 client.10002 shutdown 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21e83cd740 1 -- 172.21.15.172:0/1459908599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 msgr2=0x55871e8a1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21e83cd740 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8a1c30 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f21d00a4040 tx=0x7f21d0009810 comp rx=0 tx=0).stop 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21e83cd740 1 -- 172.21.15.172:0/1459908599 shutdown_connections 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21e83cd740 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x55871e8b5a40 0x55871e8b5e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21e83cd740 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8864a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21e83cd740 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8d4ad0 0x55871e8e62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.198+0000 7f21e83cd740 1 --2- 172.21.15.172:0/1459908599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8b7230 0x55871e8a1c30 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.199+0000 7f21bdffb640 0 client.10002 ms_handle_reset on v2:172.21.15.172:6836/2096375996 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.199+0000 7f21e83cd740 1 -- 172.21.15.172:0/1459908599 >> 172.21.15.172:0/1459908599 conn(0x55871e88cf10 msgr2=0x55871e88c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.199+0000 7f21e83cd740 1 -- 172.21.15.172:0/1459908599 shutdown_connections 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.199+0000 7f21e83cd740 1 -- 172.21.15.172:0/1459908599 wait complete. 2024-04-25T08:52:08.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.199+0000 7f21e83cd740 20 client.10002 trim_cache size 0 max 16384 2024-04-25T08:52:08.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.214+0000 7f21e83cd740 1 Processor -- start 2024-04-25T08:52:08.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.214+0000 7f21e83cd740 1 -- start start 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8b7230 0x55871e8a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8e4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21e83cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e01ff520 con 0x55871e8d4ad0 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21e83cd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00adaf0 con 0x55871e8b9fd0 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21e83cd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00ae0f0 con 0x55871e8b7230 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8e4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8e4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59650/0 (socket says 172.21.15.172:59650) 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21df7fe640 1 -- 172.21.15.172:0/1217814878 learned_addr learned my addr 172.21.15.172:0/1217814878 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21de7fc640 1 --2- 172.21.15.172:0/1217814878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.211 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21deffd640 1 --2- 172.21.15.172:0/1217814878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8b7230 0x55871e8a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21df7fe640 1 -- 172.21.15.172:0/1217814878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8b7230 msgr2=0x55871e8a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21df7fe640 1 --2- 172.21.15.172:0/1217814878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8b7230 0x55871e8a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21df7fe640 1 -- 172.21.15.172:0/1217814878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 msgr2=0x55871e8b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21df7fe640 1 --2- 172.21.15.172:0/1217814878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.215+0000 7f21df7fe640 1 -- 172.21.15.172:0/1217814878 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55871e88cd30 con 0x55871e8d4ad0 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21df7fe640 1 --2- 172.21.15.172:0/1217814878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8e4570 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f21d8007480 tx=0x7f21d8005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d952da90b7ced053 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21bffff640 1 -- 172.21.15.172:0/1217814878 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8019070 con 0x55871e8d4ad0 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21bffff640 1 -- 172.21.15.172:0/1217814878 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d8001940 con 0x55871e8d4ad0 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21bffff640 1 -- 172.21.15.172:0/1217814878 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8001d10 con 0x55871e8d4ad0 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21e83cd740 1 -- 172.21.15.172:0/1217814878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 msgr2=0x55871e8e4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21e83cd740 1 --2- 172.21.15.172:0/1217814878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8e4570 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f21d8007480 tx=0x7f21d8005bc0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21e83cd740 1 -- 172.21.15.172:0/1217814878 shutdown_connections 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21e83cd740 1 --2- 172.21.15.172:0/1217814878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21e83cd740 1 --2- 172.21.15.172:0/1217814878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8e4570 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21e83cd740 1 --2- 172.21.15.172:0/1217814878 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8b7230 0x55871e8a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21e83cd740 1 -- 172.21.15.172:0/1217814878 >> 172.21.15.172:0/1217814878 conn(0x55871e88cf10 msgr2=0x55871e8b9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21e83cd740 1 -- 172.21.15.172:0/1217814878 shutdown_connections 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.216+0000 7f21e83cd740 1 -- 172.21.15.172:0/1217814878 wait complete. 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.217+0000 7f21e83cd740 1 -- start start 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.217+0000 7f21e83cd740 1 Processor -- start 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.217+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8b7230 0x55871e925960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.217+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.217+0000 7f21e83cd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8ec010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.217+0000 7f21e83cd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55871e7efa10 con 0x55871e8d4ad0 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.217+0000 7f21e83cd740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55871e88dcb0 con 0x55871e8b9fd0 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.217+0000 7f21e83cd740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x55871e7ac0c0 con 0x55871e8b7230 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21e83cd740 10 client.0 _ll_register_callbacks cb 0x55871e887c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8ec010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8ec010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59658/0 (socket says 172.21.15.172:59658) 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21df7fe640 1 -- 172.21.15.172:0/2222418958 learned_addr learned my addr 172.21.15.172:0/2222418958 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21deffd640 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8b7230 0x55871e925960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21de7fc640 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21df7fe640 1 -- 172.21.15.172:0/2222418958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8b7230 msgr2=0x55871e925960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21df7fe640 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8b7230 0x55871e925960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21df7fe640 1 -- 172.21.15.172:0/2222418958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 msgr2=0x55871e8ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21df7fe640 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21df7fe640 1 -- 172.21.15.172:0/2222418958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55871e8ca710 con 0x55871e8d4ad0 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21df7fe640 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8ec010 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f21d8001520 tx=0x7f21d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899ab0df6f3bd7cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21bdffb640 1 -- 172.21.15.172:0/2222418958 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8023020 con 0x55871e8d4ad0 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21bdffb640 1 -- 172.21.15.172:0/2222418958 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f21d801f620 con 0x55871e8d4ad0 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21e83cd740 1 -- 172.21.15.172:0/2222418958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21d8001940 con 0x55871e8d4ad0 2024-04-25T08:52:08.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21bdffb640 1 -- 172.21.15.172:0/2222418958 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21d802d050 con 0x55871e8d4ad0 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21e83cd740 10 client.10008 fetch_fsmap learned FSMap version 85 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.218+0000 7f21e83cd740 1 -- 172.21.15.172:0/2222418958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x55871e8864a0 con 0x55871e8d4ad0 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21bdffb640 1 -- 172.21.15.172:0/2222418958 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d8001940 con 0x55871e8d4ad0 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21bdffb640 1 -- 172.21.15.172:0/2222418958 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 85) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f21d801f820 con 0x55871e8d4ad0 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 10 client.10008 fetch_fsmap finished waiting for FSMap version 85 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 10 client.10008 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 20 client.10008 populate_metadata read hostname 'smithi172' 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x55871e8b6490 0x55871e88ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 4 client.10008 mds_command: new command op to 9825 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 -- 172.21.15.172:0/2222418958 --> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55871e7fcf50 con 0x55871e8b6490 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21deffd640 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x55871e8b6490 0x55871e88ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21bdffb640 10 client.10008 ms_handle_connect on v2:172.21.15.172:6836/2096375996 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21deffd640 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x55871e8b6490 0x55871e88ace0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d720b50aec1c6356 server_cookie=fe4a5fbd10817c41 in_seq=0 out_seq=0 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21bdffb640 1 -- 172.21.15.172:0/2222418958 <== mds.0 v2:172.21.15.172:6836/2096375996 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55871e7fcf50 con 0x55871e8b6490 2024-04-25T08:52:08.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21bdffb640 10 client.10008 handle_command_reply: tid=0 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 client.10008 shutdown 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 -- 172.21.15.172:0/2222418958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 msgr2=0x55871e8ec010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8ec010 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f21d8001520 tx=0x7f21d8000ed0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 -- 172.21.15.172:0/2222418958 shutdown_connections 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x55871e8b6490 0x55871e88ace0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55871e8b9fd0 0x55871e8ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55871e8d4ad0 0x55871e8ec010 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 --2- 172.21.15.172:0/2222418958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55871e8b7230 0x55871e925960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21bdffb640 0 client.10008 ms_handle_reset on v2:172.21.15.172:6836/2096375996 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 -- 172.21.15.172:0/2222418958 >> 172.21.15.172:0/2222418958 conn(0x55871e88cf10 msgr2=0x55871e8b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 -- 172.21.15.172:0/2222418958 shutdown_connections 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.219+0000 7f21e83cd740 1 -- 172.21.15.172:0/2222418958 wait complete. 2024-04-25T08:52:08.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e83cd740 20 client.10008 trim_cache size 0 max 16384 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 9825, 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 9.5383037959999992, 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 85, 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 143, 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 143, 2024-04-25T08:52:08.217 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 14.599062327 2024-04-25T08:52:08.218 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:52:08.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 -- 172.21.15.172:0/1075763673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21cc06b500 msgr2=0x7f21cc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21cc06b500 0x7f21cc06d9c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f21d4006fd0 tx=0x7f21d4008040 comp rx=0 tx=0).stop 2024-04-25T08:52:08.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 -- 172.21.15.172:0/1075763673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e00ce0a0 msgr2=0x7f21e014c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e00ce0a0 0x7f21e014c2f0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009e50 tx=0x7f21d0004a40 comp rx=0 tx=0).stop 2024-04-25T08:52:08.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 -- 172.21.15.172:0/1075763673 shutdown_connections 2024-04-25T08:52:08.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f21cc06b500 0x7f21cc06d9c0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21e01610f0 0x7f21e00cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21e01616f0 0x7f21e00cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 --2- 172.21.15.172:0/1075763673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e00ce0a0 0x7f21e014c2f0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 -- 172.21.15.172:0/1075763673 >> 172.21.15.172:0/1075763673 conn(0x7f21e006f500 msgr2=0x7f21e00b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:08.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 -- 172.21.15.172:0/1075763673 shutdown_connections 2024-04-25T08:52:08.219 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.220+0000 7f21e56d1640 1 -- 172.21.15.172:0/1075763673 wait complete. 2024-04-25T08:52:08.221 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T08:52:08.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.328+0000 7f10d0a12640 1 Processor -- start 2024-04-25T08:52:08.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.328+0000 7f10d0a12640 1 -- start start 2024-04-25T08:52:08.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.329+0000 7f10d0a12640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f10cc15dbe0 0x7f10cc0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.329+0000 7f10d0a12640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f10cc0b2cb0 0x7f10cc0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.329+0000 7f10d0a12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10cc0b92a0 0x7f10cc0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.329+0000 7f10d0a12640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc15dfc0 con 0x7f10cc15dbe0 2024-04-25T08:52:08.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.329+0000 7f10d0a12640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc0d1a00 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.329+0000 7f10d0a12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0b97a0 con 0x7f10cc0b92a0 2024-04-25T08:52:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.329+0000 7f10ca59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f10cc15dbe0 0x7f10cc0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.330+0000 7f10ca59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f10cc15dbe0 0x7f10cc0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59666/0 (socket says 172.21.15.172:59666) 2024-04-25T08:52:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.330+0000 7f10ca59c640 1 -- 172.21.15.172:0/753276589 learned_addr learned my addr 172.21.15.172:0/753276589 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.330+0000 7f10c9d9b640 1 --2- 172.21.15.172:0/753276589 >> v2:172.21.15.186:3300/0 conn(0x7f10cc0b2cb0 0x7f10cc0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.330+0000 7f10cad9d640 1 --2- 172.21.15.172:0/753276589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10cc0b92a0 0x7f10cc0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.330+0000 7f10ca59c640 1 -- 172.21.15.172:0/753276589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10cc0b92a0 msgr2=0x7f10cc0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.330+0000 7f10ca59c640 1 --2- 172.21.15.172:0/753276589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10cc0b92a0 0x7f10cc0b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.330+0000 7f10ca59c640 1 -- 172.21.15.172:0/753276589 >> v2:172.21.15.186:3300/0 conn(0x7f10cc0b2cb0 msgr2=0x7f10cc0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.330+0000 7f10ca59c640 1 --2- 172.21.15.172:0/753276589 >> v2:172.21.15.186:3300/0 conn(0x7f10cc0b2cb0 0x7f10cc0d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.330+0000 7f10ca59c640 1 -- 172.21.15.172:0/753276589 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0d1c50 con 0x7f10cc15dbe0 2024-04-25T08:52:08.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.330+0000 7f10ca59c640 1 --2- 172.21.15.172:0/753276589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc15dbe0 0x7f10cc0d0910 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f10cc06cff0 tx=0x7f10c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d109a20e5ab9aa9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:08.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10c959a640 1 -- 172.21.15.172:0/753276589 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4037070 con 0x7f10cc15dbe0 2024-04-25T08:52:08.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10c959a640 1 -- 172.21.15.172:0/753276589 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4032440 con 0x7f10cc15dbe0 2024-04-25T08:52:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10c959a640 1 -- 172.21.15.172:0/753276589 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4032810 con 0x7f10cc15dbe0 2024-04-25T08:52:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10d0a12640 1 -- 172.21.15.172:0/753276589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc15dbe0 msgr2=0x7f10cc0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10d0a12640 1 --2- 172.21.15.172:0/753276589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc15dbe0 0x7f10cc0d0910 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f10cc06cff0 tx=0x7f10c402a1e0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10d0a12640 1 -- 172.21.15.172:0/753276589 shutdown_connections 2024-04-25T08:52:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10d0a12640 1 --2- 172.21.15.172:0/753276589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10cc0b92a0 0x7f10cc0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10d0a12640 1 --2- 172.21.15.172:0/753276589 >> v2:172.21.15.186:3300/0 conn(0x7f10cc0b2cb0 0x7f10cc0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10d0a12640 1 --2- 172.21.15.172:0/753276589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc15dbe0 0x7f10cc0d0910 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10d0a12640 1 -- 172.21.15.172:0/753276589 >> 172.21.15.172:0/753276589 conn(0x7f10cc061a20 msgr2=0x7f10cc061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10d0a12640 1 -- 172.21.15.172:0/753276589 shutdown_connections 2024-04-25T08:52:08.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.331+0000 7f10d0a12640 1 -- 172.21.15.172:0/753276589 wait complete. 2024-04-25T08:52:08.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10d0a12640 1 Processor -- start 2024-04-25T08:52:08.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10d0a12640 1 -- start start 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10d0a12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc0b2cb0 0x7f10cc0cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10d0a12640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc0b92a0 0x7f10cc0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10d0a12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10cc15dbe0 0x7f10cc1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10d0a12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0b6ab0 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10d0a12640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0d2210 con 0x7f10cc0b92a0 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10d0a12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0b6c30 con 0x7f10cc15dbe0 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10ca59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc0b2cb0 0x7f10cc0cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10ca59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc0b2cb0 0x7f10cc0cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:59668/0 (socket says 172.21.15.172:59668) 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.333+0000 7f10ca59c640 1 -- 172.21.15.172:0/565341270 learned_addr learned my addr 172.21.15.172:0/565341270 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10c9d9b640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc0b92a0 0x7f10cc0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10cad9d640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10cc15dbe0 0x7f10cc1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10ca59c640 1 -- 172.21.15.172:0/565341270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10cc15dbe0 msgr2=0x7f10cc1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10ca59c640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10cc15dbe0 0x7f10cc1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10ca59c640 1 -- 172.21.15.172:0/565341270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc0b92a0 msgr2=0x7f10cc0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10ca59c640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc0b92a0 0x7f10cc0b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10ca59c640 1 -- 172.21.15.172:0/565341270 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0b59a0 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10c9d9b640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc0b92a0 0x7f10cc0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10ca59c640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc0b2cb0 0x7f10cc0cb460 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f10c402a220 tx=0x7f10c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10baffd640 1 -- 172.21.15.172:0/565341270 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4041020 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10baffd640 1 -- 172.21.15.172:0/565341270 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c40306c0 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10d0a12640 1 -- 172.21.15.172:0/565341270 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc151ef0 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10baffd640 1 -- 172.21.15.172:0/565341270 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4037040 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.334+0000 7f10d0a12640 1 -- 172.21.15.172:0/565341270 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc0cbdd0 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.335+0000 7f10d0a12640 1 -- 172.21.15.172:0/565341270 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc073990 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.335+0000 7f10baffd640 1 -- 172.21.15.172:0/565341270 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10c4044020 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.336+0000 7f10baffd640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10ac06b500 0x7f10ac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:08.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.336+0000 7f10baffd640 1 -- 172.21.15.172:0/565341270 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f10c40aabd0 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.336+0000 7f10c9d9b640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10ac06b500 0x7f10ac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:08.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.336+0000 7f10c9d9b640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10ac06b500 0x7f10ac06d9c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0b4dd0 tx=0x7f10c0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:08.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.340+0000 7f10baffd640 1 -- 172.21.15.172:0/565341270 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10c404b030 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.548+0000 7f10d0a12640 1 -- 172.21.15.172:0/565341270 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f10cc068070 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.548+0000 7f10baffd640 1 -- 172.21.15.172:0/565341270 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) v1 ==== 53+0+73 (secure 0 0 0) 0x7f10cc0b59a0 con 0x7f10cc0b2cb0 2024-04-25T08:52:08.538 INFO:teuthology.orchestra.run.smithi172.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T08:52:08.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 -- 172.21.15.172:0/565341270 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10ac06b500 msgr2=0x7f10ac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10ac06b500 0x7f10ac06d9c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0b4dd0 tx=0x7f10c0008040 comp rx=0 tx=0).stop 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 -- 172.21.15.172:0/565341270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc0b2cb0 msgr2=0x7f10cc0cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc0b2cb0 0x7f10cc0cb460 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f10c402a220 tx=0x7f10c40046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 -- 172.21.15.172:0/565341270 shutdown_connections 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10ac06b500 0x7f10ac06d9c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10cc0b92a0 0x7f10cc0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10cc15dbe0 0x7f10cc1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 --2- 172.21.15.172:0/565341270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10cc0b2cb0 0x7f10cc0cb460 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 -- 172.21.15.172:0/565341270 >> 172.21.15.172:0/565341270 conn(0x7f10cc061a20 msgr2=0x7f10cc0b86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 -- 172.21.15.172:0/565341270 shutdown_connections 2024-04-25T08:52:08.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:08.550+0000 7f10d0a12640 1 -- 172.21.15.172:0/565341270 wait complete. 2024-04-25T08:52:08.551 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T08:52:08.551 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T08:52:08.551 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-25T08:52:08.551 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T08:52:08.552 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T08:52:08.552 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T08:52:08.552 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T08:52:08.552 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T08:52:08.552 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:52:08.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:08.552 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:52:08.568 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42190sec preferred_lft 42190sec 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1f97:3b93:8f2d:bc59/64 scope link noprefixroute 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::1492:acff:fe19:84f6/64 scope link 2024-04-25T08:52:08.569 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:52:08.570 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:52:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 2e:8a:df:21:ea:14 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:52:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::2c8a:dfff:fe21:ea14/64 scope link 2024-04-25T08:52:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:52:08.570 INFO:teuthology.orchestra.run.smithi172.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T08:52:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether de:e6:d5:6e:7d:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:52:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::dce6:d5ff:fe6e:7d91/64 scope link 2024-04-25T08:52:08.570 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-25T08:52:08.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:08.570 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T08:52:08.630 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T08:52:08.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:08.634 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-25T08:52:08.690 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-25T08:52:08.690 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T08:52:08.690 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T08:52:08.690 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T08:52:08.690 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T08:52:08.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:08.691 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2024-04-25T08:52:08.691 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:08.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T08:52:08.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T08:52:08.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T08:52:08.691 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:08.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:08.775 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:52:08.830 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:52:08.830 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:52:08.830 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:52:08.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:08.831 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-25T08:52:08.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:52:08.894 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T08:52:08.949 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T08:52:08.949 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T08:52:08.949 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:52:09.003 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T08:52:09.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:09.003 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:52:09.084 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:52:09.084 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:52:09.084 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:52:09.092 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:52:09.092 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:52:09.092 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:52:09.093 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:52:09.093 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:52:09.098 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T08:52:09.098 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T08:52:09.099 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2024-04-25T08:52:09.099 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T08:52:09.099 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T08:52:09.099 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790" 2024-04-25T08:52:09.099 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.172:6789,172.21.15.186:6789,172.21.15.186:6790:/ 2024-04-25T08:52:09.099 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2" will pass to kernel 2024-04-25T08:52:09.099 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T08:52:09.099 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-25T08:52:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T08:52:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T08:52:09.100 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T08:52:09.101 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T08:52:09.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:09.101 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T08:52:09.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:09.166 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T08:52:09.226 INFO:teuthology.orchestra.run.smithi172.stdout:client7346 2024-04-25T08:52:09.226 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:52:09.226 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:52:09.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:09.281 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:09.281 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:09.282 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.0 2024-04-25T08:52:09.282 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:09.282 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:09.282 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:09.282 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:09.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.352 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746371 s, 140 MB/s 2024-04-25T08:52:09.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.361 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824741 s, 127 MB/s 2024-04-25T08:52:09.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.369 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070649 s, 148 MB/s 2024-04-25T08:52:09.378 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.378 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.378 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079091 s, 133 MB/s 2024-04-25T08:52:09.386 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.386 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.386 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704298 s, 149 MB/s 2024-04-25T08:52:09.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.394 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.394 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711566 s, 147 MB/s 2024-04-25T08:52:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.401 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00552315 s, 190 MB/s 2024-04-25T08:52:09.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.409 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746679 s, 140 MB/s 2024-04-25T08:52:09.417 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.417 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.417 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727574 s, 144 MB/s 2024-04-25T08:52:09.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858617 s, 122 MB/s 2024-04-25T08:52:09.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.434 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691668 s, 152 MB/s 2024-04-25T08:52:09.443 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.443 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.443 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779551 s, 135 MB/s 2024-04-25T08:52:09.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.451 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700945 s, 150 MB/s 2024-04-25T08:52:09.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.458 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591652 s, 177 MB/s 2024-04-25T08:52:09.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.465 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006905 s, 152 MB/s 2024-04-25T08:52:09.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.473 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656866 s, 160 MB/s 2024-04-25T08:52:09.481 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.481 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.481 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750367 s, 140 MB/s 2024-04-25T08:52:09.489 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.489 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.489 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678366 s, 155 MB/s 2024-04-25T08:52:09.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.497 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686706 s, 153 MB/s 2024-04-25T08:52:09.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.503 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590711 s, 178 MB/s 2024-04-25T08:52:09.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.512 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727505 s, 144 MB/s 2024-04-25T08:52:09.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.520 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693651 s, 151 MB/s 2024-04-25T08:52:09.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061096 s, 172 MB/s 2024-04-25T08:52:09.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.534 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657503 s, 159 MB/s 2024-04-25T08:52:09.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.542 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725292 s, 145 MB/s 2024-04-25T08:52:09.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.550 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705091 s, 149 MB/s 2024-04-25T08:52:09.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714826 s, 147 MB/s 2024-04-25T08:52:09.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.565 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608714 s, 172 MB/s 2024-04-25T08:52:09.573 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.573 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.573 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739848 s, 142 MB/s 2024-04-25T08:52:09.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.581 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665021 s, 158 MB/s 2024-04-25T08:52:09.588 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.588 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.589 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672701 s, 156 MB/s 2024-04-25T08:52:09.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.596 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.596 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686359 s, 153 MB/s 2024-04-25T08:52:09.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:09.597 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:09.597 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:09.598 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.1 2024-04-25T08:52:09.598 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:09.598 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:09.598 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:09.598 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:09.663 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.663 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.663 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764441 s, 137 MB/s 2024-04-25T08:52:09.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.671 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693404 s, 151 MB/s 2024-04-25T08:52:09.679 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.679 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.679 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738499 s, 142 MB/s 2024-04-25T08:52:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.688 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742957 s, 141 MB/s 2024-04-25T08:52:09.697 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.697 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.698 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679887 s, 154 MB/s 2024-04-25T08:52:09.702 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.702 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.703 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637532 s, 164 MB/s 2024-04-25T08:52:09.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.715 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117368 s, 89.3 MB/s 2024-04-25T08:52:09.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.726 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932214 s, 112 MB/s 2024-04-25T08:52:09.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.733 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.733 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647298 s, 162 MB/s 2024-04-25T08:52:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.741 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724999 s, 145 MB/s 2024-04-25T08:52:09.750 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.751 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.751 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864362 s, 121 MB/s 2024-04-25T08:52:09.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.758 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639059 s, 164 MB/s 2024-04-25T08:52:09.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:09.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:09.766 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752517 s, 139 MB/s 2024-04-25T08:52:10.737 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.737 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.737 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.96916 s, 1.1 MB/s 2024-04-25T08:52:10.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.747 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.747 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920947 s, 114 MB/s 2024-04-25T08:52:10.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075336 s, 139 MB/s 2024-04-25T08:52:10.765 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.765 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.765 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792678 s, 132 MB/s 2024-04-25T08:52:10.773 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.773 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.774 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780811 s, 134 MB/s 2024-04-25T08:52:10.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.782 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.782 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717348 s, 146 MB/s 2024-04-25T08:52:10.791 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.791 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.791 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00816744 s, 128 MB/s 2024-04-25T08:52:10.800 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.800 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.800 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785832 s, 133 MB/s 2024-04-25T08:52:10.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.808 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739868 s, 142 MB/s 2024-04-25T08:52:10.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.816 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718579 s, 146 MB/s 2024-04-25T08:52:10.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.825 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748901 s, 140 MB/s 2024-04-25T08:52:10.832 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.833 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706045 s, 149 MB/s 2024-04-25T08:52:10.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.840 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.840 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675172 s, 155 MB/s 2024-04-25T08:52:10.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.849 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792783 s, 132 MB/s 2024-04-25T08:52:10.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.857 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691919 s, 152 MB/s 2024-04-25T08:52:10.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.865 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068327 s, 153 MB/s 2024-04-25T08:52:10.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.871 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606638 s, 173 MB/s 2024-04-25T08:52:10.879 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.879 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.880 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714884 s, 147 MB/s 2024-04-25T08:52:10.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.887 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709126 s, 148 MB/s 2024-04-25T08:52:10.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:10.889 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:10.889 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:10.889 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.2 2024-04-25T08:52:10.889 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:10.889 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:10.889 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:10.889 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:10.953 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.953 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.953 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712616 s, 147 MB/s 2024-04-25T08:52:10.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.961 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681132 s, 154 MB/s 2024-04-25T08:52:10.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.968 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660203 s, 159 MB/s 2024-04-25T08:52:10.976 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.976 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.976 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689582 s, 152 MB/s 2024-04-25T08:52:10.983 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.983 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.983 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574199 s, 183 MB/s 2024-04-25T08:52:10.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568121 s, 185 MB/s 2024-04-25T08:52:10.997 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:10.998 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:10.998 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736678 s, 142 MB/s 2024-04-25T08:52:11.005 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.006 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070116 s, 150 MB/s 2024-04-25T08:52:11.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.012 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.012 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572013 s, 183 MB/s 2024-04-25T08:52:11.020 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.020 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.020 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669736 s, 157 MB/s 2024-04-25T08:52:11.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.028 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745093 s, 141 MB/s 2024-04-25T08:52:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.036 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660232 s, 159 MB/s 2024-04-25T08:52:11.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.044 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.044 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673408 s, 156 MB/s 2024-04-25T08:52:11.050 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.050 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.050 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569575 s, 184 MB/s 2024-04-25T08:52:11.058 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.058 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.058 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687439 s, 153 MB/s 2024-04-25T08:52:11.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.065 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623794 s, 168 MB/s 2024-04-25T08:52:11.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.072 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063911 s, 164 MB/s 2024-04-25T08:52:11.081 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.082 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851881 s, 123 MB/s 2024-04-25T08:52:11.089 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.089 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.089 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624951 s, 168 MB/s 2024-04-25T08:52:11.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.096 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647438 s, 162 MB/s 2024-04-25T08:52:11.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.105 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770447 s, 136 MB/s 2024-04-25T08:52:11.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.113 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764379 s, 137 MB/s 2024-04-25T08:52:11.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.120 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564653 s, 186 MB/s 2024-04-25T08:52:11.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.127 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635499 s, 165 MB/s 2024-04-25T08:52:11.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.134 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.134 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647936 s, 162 MB/s 2024-04-25T08:52:11.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.142 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663545 s, 158 MB/s 2024-04-25T08:52:11.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.149 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063253 s, 166 MB/s 2024-04-25T08:52:11.156 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.156 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.157 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634484 s, 165 MB/s 2024-04-25T08:52:11.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.164 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641472 s, 163 MB/s 2024-04-25T08:52:11.171 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.171 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.171 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064702 s, 162 MB/s 2024-04-25T08:52:11.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.178 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.178 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061374 s, 171 MB/s 2024-04-25T08:52:11.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.186 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005543 s, 189 MB/s 2024-04-25T08:52:11.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:11.186 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:11.186 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:11.186 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.3 2024-04-25T08:52:11.186 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:11.186 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:11.186 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:11.186 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:11.251 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.251 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.251 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739914 s, 142 MB/s 2024-04-25T08:52:11.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.259 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.259 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741956 s, 141 MB/s 2024-04-25T08:52:11.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.268 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.268 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076238 s, 138 MB/s 2024-04-25T08:52:11.275 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.275 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.275 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645073 s, 163 MB/s 2024-04-25T08:52:11.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.283 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.283 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697473 s, 150 MB/s 2024-04-25T08:52:11.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.291 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713915 s, 147 MB/s 2024-04-25T08:52:11.298 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.298 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.299 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681395 s, 154 MB/s 2024-04-25T08:52:11.306 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.306 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.306 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700507 s, 150 MB/s 2024-04-25T08:52:11.314 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.314 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.314 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646658 s, 162 MB/s 2024-04-25T08:52:11.321 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.321 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.321 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642894 s, 163 MB/s 2024-04-25T08:52:11.329 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.329 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.329 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697174 s, 150 MB/s 2024-04-25T08:52:11.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724268 s, 145 MB/s 2024-04-25T08:52:11.344 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.344 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.344 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644113 s, 163 MB/s 2024-04-25T08:52:11.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.352 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653656 s, 160 MB/s 2024-04-25T08:52:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.359 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609129 s, 172 MB/s 2024-04-25T08:52:11.366 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.366 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.366 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645323 s, 162 MB/s 2024-04-25T08:52:11.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.373 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.373 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621614 s, 169 MB/s 2024-04-25T08:52:11.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.381 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.381 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639275 s, 164 MB/s 2024-04-25T08:52:11.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.388 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687103 s, 153 MB/s 2024-04-25T08:52:11.396 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.396 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.396 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640816 s, 164 MB/s 2024-04-25T08:52:11.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.404 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707808 s, 148 MB/s 2024-04-25T08:52:11.411 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.411 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.411 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647802 s, 162 MB/s 2024-04-25T08:52:11.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.418 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.419 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651535 s, 161 MB/s 2024-04-25T08:52:11.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635337 s, 165 MB/s 2024-04-25T08:52:11.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.433 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.433 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623938 s, 168 MB/s 2024-04-25T08:52:11.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.441 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729134 s, 144 MB/s 2024-04-25T08:52:11.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.449 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698204 s, 150 MB/s 2024-04-25T08:52:11.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.457 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632224 s, 166 MB/s 2024-04-25T08:52:11.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.465 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724948 s, 145 MB/s 2024-04-25T08:52:11.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.472 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645912 s, 162 MB/s 2024-04-25T08:52:11.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.480 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666602 s, 157 MB/s 2024-04-25T08:52:11.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.486 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610988 s, 172 MB/s 2024-04-25T08:52:11.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:11.488 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:11.488 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:11.488 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.4 2024-04-25T08:52:11.488 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:11.488 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:11.488 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:11.488 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:11.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.552 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.552 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654192 s, 160 MB/s 2024-04-25T08:52:11.559 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.559 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.559 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608529 s, 172 MB/s 2024-04-25T08:52:11.566 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.566 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.566 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617466 s, 170 MB/s 2024-04-25T08:52:11.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.574 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.574 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701304 s, 150 MB/s 2024-04-25T08:52:11.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.581 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654432 s, 160 MB/s 2024-04-25T08:52:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.590 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729779 s, 144 MB/s 2024-04-25T08:52:11.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.597 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702073 s, 149 MB/s 2024-04-25T08:52:11.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.605 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647869 s, 162 MB/s 2024-04-25T08:52:11.612 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.612 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.612 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631462 s, 166 MB/s 2024-04-25T08:52:11.619 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.619 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.619 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616459 s, 170 MB/s 2024-04-25T08:52:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.627 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732763 s, 143 MB/s 2024-04-25T08:52:11.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.635 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711071 s, 147 MB/s 2024-04-25T08:52:11.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.643 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668343 s, 157 MB/s 2024-04-25T08:52:11.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.650 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631461 s, 166 MB/s 2024-04-25T08:52:11.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.658 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736552 s, 142 MB/s 2024-04-25T08:52:11.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.666 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694158 s, 151 MB/s 2024-04-25T08:52:11.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.673 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582805 s, 180 MB/s 2024-04-25T08:52:11.680 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.680 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.680 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623649 s, 168 MB/s 2024-04-25T08:52:11.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.688 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717029 s, 146 MB/s 2024-04-25T08:52:11.695 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.695 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.695 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649296 s, 161 MB/s 2024-04-25T08:52:11.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.703 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701716 s, 149 MB/s 2024-04-25T08:52:11.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.711 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689813 s, 152 MB/s 2024-04-25T08:52:11.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.718 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603472 s, 174 MB/s 2024-04-25T08:52:11.724 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.724 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.725 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564744 s, 186 MB/s 2024-04-25T08:52:11.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.732 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630864 s, 166 MB/s 2024-04-25T08:52:11.739 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.739 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.739 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656472 s, 160 MB/s 2024-04-25T08:52:11.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.747 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634976 s, 165 MB/s 2024-04-25T08:52:11.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.755 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.755 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708696 s, 148 MB/s 2024-04-25T08:52:11.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.763 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758861 s, 138 MB/s 2024-04-25T08:52:11.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.771 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659768 s, 159 MB/s 2024-04-25T08:52:11.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.777 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566052 s, 185 MB/s 2024-04-25T08:52:11.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.784 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579201 s, 181 MB/s 2024-04-25T08:52:11.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:11.785 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:11.785 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:11.786 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.5 2024-04-25T08:52:11.786 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:11.786 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:11.786 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:11.786 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:11.851 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.851 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.851 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696758 s, 150 MB/s 2024-04-25T08:52:11.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.859 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.859 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072697 s, 144 MB/s 2024-04-25T08:52:11.866 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.866 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.866 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587189 s, 179 MB/s 2024-04-25T08:52:11.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.873 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.873 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630097 s, 166 MB/s 2024-04-25T08:52:11.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.880 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663647 s, 158 MB/s 2024-04-25T08:52:11.887 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.888 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.888 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066059 s, 159 MB/s 2024-04-25T08:52:11.895 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.895 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.895 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631508 s, 166 MB/s 2024-04-25T08:52:11.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.903 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702578 s, 149 MB/s 2024-04-25T08:52:11.910 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.910 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.910 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627637 s, 167 MB/s 2024-04-25T08:52:11.918 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.918 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.918 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731033 s, 143 MB/s 2024-04-25T08:52:11.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.925 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643444 s, 163 MB/s 2024-04-25T08:52:11.932 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.932 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.932 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583224 s, 180 MB/s 2024-04-25T08:52:11.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.938 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.938 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055803 s, 188 MB/s 2024-04-25T08:52:11.946 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.946 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.946 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655424 s, 160 MB/s 2024-04-25T08:52:11.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.953 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.953 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579638 s, 181 MB/s 2024-04-25T08:52:11.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.961 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703807 s, 149 MB/s 2024-04-25T08:52:11.969 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.969 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.969 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713182 s, 147 MB/s 2024-04-25T08:52:11.976 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.976 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.976 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616264 s, 170 MB/s 2024-04-25T08:52:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.983 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638425 s, 164 MB/s 2024-04-25T08:52:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.991 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720096 s, 146 MB/s 2024-04-25T08:52:11.998 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:11.998 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:11.998 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061328 s, 171 MB/s 2024-04-25T08:52:12.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.007 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727224 s, 144 MB/s 2024-04-25T08:52:12.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.013 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637388 s, 165 MB/s 2024-04-25T08:52:12.021 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.021 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.021 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689286 s, 152 MB/s 2024-04-25T08:52:12.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.029 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676749 s, 155 MB/s 2024-04-25T08:52:12.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.036 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626329 s, 167 MB/s 2024-04-25T08:52:12.042 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.042 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.042 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568481 s, 184 MB/s 2024-04-25T08:52:12.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.051 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.051 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761978 s, 138 MB/s 2024-04-25T08:52:12.058 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.058 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.058 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635009 s, 165 MB/s 2024-04-25T08:52:12.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.065 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.065 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585123 s, 179 MB/s 2024-04-25T08:52:12.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.073 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.073 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673493 s, 156 MB/s 2024-04-25T08:52:12.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.080 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.080 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652719 s, 161 MB/s 2024-04-25T08:52:12.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:12.081 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:12.081 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:12.081 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.6 2024-04-25T08:52:12.081 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:12.081 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:12.081 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:12.082 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:12.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596919 s, 176 MB/s 2024-04-25T08:52:12.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.155 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.155 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666342 s, 157 MB/s 2024-04-25T08:52:12.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.159 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626016 s, 167 MB/s 2024-04-25T08:52:12.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.168 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766038 s, 137 MB/s 2024-04-25T08:52:12.174 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.175 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613674 s, 171 MB/s 2024-04-25T08:52:12.181 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.181 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.182 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582642 s, 180 MB/s 2024-04-25T08:52:12.188 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.188 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.188 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589318 s, 178 MB/s 2024-04-25T08:52:12.196 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.196 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.197 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705649 s, 149 MB/s 2024-04-25T08:52:12.203 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.203 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.203 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006212 s, 169 MB/s 2024-04-25T08:52:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.211 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658136 s, 159 MB/s 2024-04-25T08:52:12.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.219 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.219 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073385 s, 143 MB/s 2024-04-25T08:52:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.226 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592065 s, 177 MB/s 2024-04-25T08:52:12.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.233 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.233 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655848 s, 160 MB/s 2024-04-25T08:52:12.240 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.241 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.241 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637167 s, 165 MB/s 2024-04-25T08:52:12.247 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.248 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.248 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615584 s, 170 MB/s 2024-04-25T08:52:12.255 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.255 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.255 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641217 s, 164 MB/s 2024-04-25T08:52:12.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.262 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641232 s, 164 MB/s 2024-04-25T08:52:12.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.269 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568109 s, 185 MB/s 2024-04-25T08:52:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.276 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618739 s, 169 MB/s 2024-04-25T08:52:12.284 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.284 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.284 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701698 s, 149 MB/s 2024-04-25T08:52:12.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.291 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644272 s, 163 MB/s 2024-04-25T08:52:12.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.299 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739426 s, 142 MB/s 2024-04-25T08:52:12.307 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.307 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.307 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710061 s, 148 MB/s 2024-04-25T08:52:12.315 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.315 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.315 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691972 s, 152 MB/s 2024-04-25T08:52:12.322 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.322 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.322 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629977 s, 166 MB/s 2024-04-25T08:52:12.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.330 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636584 s, 165 MB/s 2024-04-25T08:52:12.337 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.337 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.337 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623904 s, 168 MB/s 2024-04-25T08:52:12.343 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.343 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.343 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556308 s, 188 MB/s 2024-04-25T08:52:12.351 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.351 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.351 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063815 s, 164 MB/s 2024-04-25T08:52:12.358 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.358 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.358 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639234 s, 164 MB/s 2024-04-25T08:52:12.364 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.365 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.365 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615844 s, 170 MB/s 2024-04-25T08:52:12.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.372 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637362 s, 165 MB/s 2024-04-25T08:52:12.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:12.373 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:12.373 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:12.373 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.7 2024-04-25T08:52:12.373 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:12.373 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:12.373 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:12.374 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:12.438 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.438 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.438 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072971 s, 144 MB/s 2024-04-25T08:52:12.445 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.445 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.445 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608372 s, 172 MB/s 2024-04-25T08:52:12.453 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.453 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.453 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720479 s, 146 MB/s 2024-04-25T08:52:12.460 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.461 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641164 s, 164 MB/s 2024-04-25T08:52:12.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.469 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729435 s, 144 MB/s 2024-04-25T08:52:12.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.477 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.477 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713048 s, 147 MB/s 2024-04-25T08:52:12.484 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.485 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.485 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694783 s, 151 MB/s 2024-04-25T08:52:12.491 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.491 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.491 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586612 s, 179 MB/s 2024-04-25T08:52:12.499 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.499 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.500 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702155 s, 149 MB/s 2024-04-25T08:52:12.507 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.507 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.507 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688726 s, 152 MB/s 2024-04-25T08:52:12.514 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.514 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.514 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632256 s, 166 MB/s 2024-04-25T08:52:12.521 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.521 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.522 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064103 s, 164 MB/s 2024-04-25T08:52:12.528 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.528 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.528 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602688 s, 174 MB/s 2024-04-25T08:52:12.536 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.536 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.536 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627182 s, 167 MB/s 2024-04-25T08:52:12.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.543 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624925 s, 168 MB/s 2024-04-25T08:52:12.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.550 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637999 s, 164 MB/s 2024-04-25T08:52:12.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718401 s, 146 MB/s 2024-04-25T08:52:12.568 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.568 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.568 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639781 s, 164 MB/s 2024-04-25T08:52:12.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.573 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632356 s, 166 MB/s 2024-04-25T08:52:12.580 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.580 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.580 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619801 s, 169 MB/s 2024-04-25T08:52:12.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.586 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565231 s, 186 MB/s 2024-04-25T08:52:12.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.594 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627053 s, 167 MB/s 2024-04-25T08:52:12.601 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.601 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.601 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064896 s, 162 MB/s 2024-04-25T08:52:12.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.607 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568348 s, 184 MB/s 2024-04-25T08:52:12.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.615 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652208 s, 161 MB/s 2024-04-25T08:52:12.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.622 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587098 s, 179 MB/s 2024-04-25T08:52:12.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.629 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616168 s, 170 MB/s 2024-04-25T08:52:12.636 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.636 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.636 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639233 s, 164 MB/s 2024-04-25T08:52:12.642 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.642 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.643 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577459 s, 182 MB/s 2024-04-25T08:52:12.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.650 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627841 s, 167 MB/s 2024-04-25T08:52:12.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.657 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.657 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637036 s, 165 MB/s 2024-04-25T08:52:12.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.664 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644292 s, 163 MB/s 2024-04-25T08:52:12.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:12.666 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:12.666 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:12.666 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.8 2024-04-25T08:52:12.666 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:12.666 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:12.666 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:12.666 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:12.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.731 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.731 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744571 s, 141 MB/s 2024-04-25T08:52:12.739 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.739 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.739 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734461 s, 143 MB/s 2024-04-25T08:52:12.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.746 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573105 s, 183 MB/s 2024-04-25T08:52:12.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.753 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.753 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064347 s, 163 MB/s 2024-04-25T08:52:12.760 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.760 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.760 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626967 s, 167 MB/s 2024-04-25T08:52:12.767 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.767 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.767 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588172 s, 178 MB/s 2024-04-25T08:52:12.774 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.774 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.774 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640637 s, 164 MB/s 2024-04-25T08:52:12.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.781 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632709 s, 166 MB/s 2024-04-25T08:52:12.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.788 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588941 s, 178 MB/s 2024-04-25T08:52:12.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.795 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630424 s, 166 MB/s 2024-04-25T08:52:12.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.802 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.802 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575673 s, 182 MB/s 2024-04-25T08:52:12.809 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.809 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.810 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063822 s, 164 MB/s 2024-04-25T08:52:12.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.817 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634961 s, 165 MB/s 2024-04-25T08:52:12.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.824 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630499 s, 166 MB/s 2024-04-25T08:52:12.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.831 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616797 s, 170 MB/s 2024-04-25T08:52:12.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.838 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623608 s, 168 MB/s 2024-04-25T08:52:12.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.845 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652157 s, 161 MB/s 2024-04-25T08:52:12.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.853 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.853 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654509 s, 160 MB/s 2024-04-25T08:52:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.860 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635974 s, 165 MB/s 2024-04-25T08:52:12.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.868 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.868 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700956 s, 150 MB/s 2024-04-25T08:52:12.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.875 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.875 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618588 s, 170 MB/s 2024-04-25T08:52:12.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.882 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.882 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062349 s, 168 MB/s 2024-04-25T08:52:12.889 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.890 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706456 s, 148 MB/s 2024-04-25T08:52:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.897 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675226 s, 155 MB/s 2024-04-25T08:52:12.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.905 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718312 s, 146 MB/s 2024-04-25T08:52:12.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.913 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668625 s, 157 MB/s 2024-04-25T08:52:12.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.921 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731748 s, 143 MB/s 2024-04-25T08:52:12.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.928 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625197 s, 168 MB/s 2024-04-25T08:52:12.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.936 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.936 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738493 s, 142 MB/s 2024-04-25T08:52:12.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.944 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689369 s, 152 MB/s 2024-04-25T08:52:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.951 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062385 s, 168 MB/s 2024-04-25T08:52:12.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:12.959 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:12.959 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693164 s, 151 MB/s 2024-04-25T08:52:12.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:12.960 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:12.960 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:12.960 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.9 2024-04-25T08:52:12.960 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:12.961 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:12.961 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:12.961 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:13.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.025 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705927 s, 149 MB/s 2024-04-25T08:52:13.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.032 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658255 s, 159 MB/s 2024-04-25T08:52:13.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.039 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624638 s, 168 MB/s 2024-04-25T08:52:13.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.047 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.047 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636371 s, 165 MB/s 2024-04-25T08:52:13.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.054 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.054 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629351 s, 167 MB/s 2024-04-25T08:52:13.061 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.062 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.062 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673834 s, 156 MB/s 2024-04-25T08:52:13.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.069 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614007 s, 171 MB/s 2024-04-25T08:52:13.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.075 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610895 s, 172 MB/s 2024-04-25T08:52:13.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.082 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616905 s, 170 MB/s 2024-04-25T08:52:13.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.090 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064791 s, 162 MB/s 2024-04-25T08:52:13.096 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.097 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600343 s, 175 MB/s 2024-04-25T08:52:13.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.105 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729012 s, 144 MB/s 2024-04-25T08:52:13.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.112 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628554 s, 167 MB/s 2024-04-25T08:52:13.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.120 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724819 s, 145 MB/s 2024-04-25T08:52:13.128 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.128 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.128 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709889 s, 148 MB/s 2024-04-25T08:52:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.136 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671761 s, 156 MB/s 2024-04-25T08:52:13.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696849 s, 150 MB/s 2024-04-25T08:52:13.152 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.152 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.152 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746669 s, 140 MB/s 2024-04-25T08:52:13.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.159 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.159 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652288 s, 161 MB/s 2024-04-25T08:52:13.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.167 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.167 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647602 s, 162 MB/s 2024-04-25T08:52:13.174 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.174 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.174 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617421 s, 170 MB/s 2024-04-25T08:52:13.182 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.182 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.182 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064828 s, 162 MB/s 2024-04-25T08:52:13.189 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.189 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.189 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697393 s, 150 MB/s 2024-04-25T08:52:13.196 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.196 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.196 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640292 s, 164 MB/s 2024-04-25T08:52:13.203 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.203 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.203 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060018 s, 175 MB/s 2024-04-25T08:52:13.210 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.210 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.210 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549774 s, 191 MB/s 2024-04-25T08:52:13.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.217 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062478 s, 168 MB/s 2024-04-25T08:52:13.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.224 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627017 s, 167 MB/s 2024-04-25T08:52:13.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.231 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651382 s, 161 MB/s 2024-04-25T08:52:13.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.238 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596444 s, 176 MB/s 2024-04-25T08:52:13.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.246 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716614 s, 146 MB/s 2024-04-25T08:52:13.253 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.254 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633114 s, 166 MB/s 2024-04-25T08:52:13.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:13.255 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:13.255 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:13.255 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.10 2024-04-25T08:52:13.255 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:13.255 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:13.255 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:13.255 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:13.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.319 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664073 s, 158 MB/s 2024-04-25T08:52:13.326 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.326 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.326 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615326 s, 170 MB/s 2024-04-25T08:52:13.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.333 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592348 s, 177 MB/s 2024-04-25T08:52:13.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.341 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676722 s, 155 MB/s 2024-04-25T08:52:13.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.347 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585739 s, 179 MB/s 2024-04-25T08:52:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.354 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577487 s, 182 MB/s 2024-04-25T08:52:13.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.361 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.361 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632985 s, 166 MB/s 2024-04-25T08:52:13.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.369 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063573 s, 165 MB/s 2024-04-25T08:52:13.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.376 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658507 s, 159 MB/s 2024-04-25T08:52:13.386 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.386 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.386 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652517 s, 161 MB/s 2024-04-25T08:52:13.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.391 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062602 s, 167 MB/s 2024-04-25T08:52:13.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.398 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656478 s, 160 MB/s 2024-04-25T08:52:13.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.406 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706654 s, 148 MB/s 2024-04-25T08:52:13.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573925 s, 183 MB/s 2024-04-25T08:52:13.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.420 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632918 s, 166 MB/s 2024-04-25T08:52:13.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.427 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599248 s, 175 MB/s 2024-04-25T08:52:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704737 s, 149 MB/s 2024-04-25T08:52:13.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.442 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690757 s, 152 MB/s 2024-04-25T08:52:13.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.451 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070162 s, 149 MB/s 2024-04-25T08:52:13.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.458 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.458 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644813 s, 163 MB/s 2024-04-25T08:52:13.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.465 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661368 s, 159 MB/s 2024-04-25T08:52:13.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.473 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716892 s, 146 MB/s 2024-04-25T08:52:13.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.480 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.480 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630155 s, 166 MB/s 2024-04-25T08:52:13.487 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.487 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.487 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061027 s, 172 MB/s 2024-04-25T08:52:13.495 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.495 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.496 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717828 s, 146 MB/s 2024-04-25T08:52:13.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.503 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648395 s, 162 MB/s 2024-04-25T08:52:13.510 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.511 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692087 s, 152 MB/s 2024-04-25T08:52:13.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.519 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735555 s, 143 MB/s 2024-04-25T08:52:13.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.527 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710529 s, 148 MB/s 2024-04-25T08:52:13.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.534 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.534 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659898 s, 159 MB/s 2024-04-25T08:52:13.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.542 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679798 s, 154 MB/s 2024-04-25T08:52:13.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.550 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076257 s, 138 MB/s 2024-04-25T08:52:13.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:13.552 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:13.552 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:13.552 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.11 2024-04-25T08:52:13.552 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:13.552 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:13.552 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:13.552 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:13.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.615 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610794 s, 172 MB/s 2024-04-25T08:52:13.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.624 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.624 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749423 s, 140 MB/s 2024-04-25T08:52:13.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645441 s, 162 MB/s 2024-04-25T08:52:13.638 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.639 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666773 s, 157 MB/s 2024-04-25T08:52:13.647 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.647 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.647 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756204 s, 139 MB/s 2024-04-25T08:52:13.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.655 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659155 s, 159 MB/s 2024-04-25T08:52:13.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.662 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.663 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702409 s, 149 MB/s 2024-04-25T08:52:13.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.671 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.671 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768885 s, 136 MB/s 2024-04-25T08:52:13.679 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.679 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.679 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070109 s, 150 MB/s 2024-04-25T08:52:13.687 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.687 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.687 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720991 s, 145 MB/s 2024-04-25T08:52:13.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.696 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764285 s, 137 MB/s 2024-04-25T08:52:13.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.704 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661294 s, 159 MB/s 2024-04-25T08:52:13.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.710 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631775 s, 166 MB/s 2024-04-25T08:52:13.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.719 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716542 s, 146 MB/s 2024-04-25T08:52:13.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.727 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726182 s, 144 MB/s 2024-04-25T08:52:13.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.735 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.735 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724925 s, 145 MB/s 2024-04-25T08:52:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652897 s, 161 MB/s 2024-04-25T08:52:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565577 s, 185 MB/s 2024-04-25T08:52:13.757 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.757 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.757 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708556 s, 148 MB/s 2024-04-25T08:52:13.764 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.764 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.764 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656713 s, 160 MB/s 2024-04-25T08:52:13.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.771 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.771 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600784 s, 175 MB/s 2024-04-25T08:52:13.778 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.778 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.778 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617991 s, 170 MB/s 2024-04-25T08:52:13.786 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.786 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.786 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643732 s, 163 MB/s 2024-04-25T08:52:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.792 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564932 s, 186 MB/s 2024-04-25T08:52:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.800 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067045 s, 156 MB/s 2024-04-25T08:52:13.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.807 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629941 s, 166 MB/s 2024-04-25T08:52:13.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.816 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.816 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714175 s, 147 MB/s 2024-04-25T08:52:13.822 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.822 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.823 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645766 s, 162 MB/s 2024-04-25T08:52:13.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.831 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729566 s, 144 MB/s 2024-04-25T08:52:13.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.839 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709202 s, 148 MB/s 2024-04-25T08:52:13.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.845 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.845 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564333 s, 186 MB/s 2024-04-25T08:52:13.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.854 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657027 s, 160 MB/s 2024-04-25T08:52:13.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:13.854 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:13.854 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:13.855 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.12 2024-04-25T08:52:13.855 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:13.855 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:13.855 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:13.855 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:13.919 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.919 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.919 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705688 s, 149 MB/s 2024-04-25T08:52:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.926 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645661 s, 162 MB/s 2024-04-25T08:52:13.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.934 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670516 s, 156 MB/s 2024-04-25T08:52:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.941 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708455 s, 148 MB/s 2024-04-25T08:52:13.949 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.949 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.949 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688872 s, 152 MB/s 2024-04-25T08:52:13.957 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.957 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.957 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723598 s, 145 MB/s 2024-04-25T08:52:13.965 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.965 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.965 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675451 s, 155 MB/s 2024-04-25T08:52:13.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.973 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.973 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702028 s, 149 MB/s 2024-04-25T08:52:13.980 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.980 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.980 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633897 s, 165 MB/s 2024-04-25T08:52:13.987 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.987 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.987 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599439 s, 175 MB/s 2024-04-25T08:52:13.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:13.995 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:13.995 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689612 s, 152 MB/s 2024-04-25T08:52:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.002 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634327 s, 165 MB/s 2024-04-25T08:52:14.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.010 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.010 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740968 s, 142 MB/s 2024-04-25T08:52:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.019 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695813 s, 151 MB/s 2024-04-25T08:52:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.025 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631992 s, 166 MB/s 2024-04-25T08:52:14.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.032 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.032 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608501 s, 172 MB/s 2024-04-25T08:52:14.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.039 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.040 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624295 s, 168 MB/s 2024-04-25T08:52:14.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.046 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.046 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602594 s, 174 MB/s 2024-04-25T08:52:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.053 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594035 s, 177 MB/s 2024-04-25T08:52:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.060 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564512 s, 186 MB/s 2024-04-25T08:52:14.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.067 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622871 s, 168 MB/s 2024-04-25T08:52:14.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.075 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707767 s, 148 MB/s 2024-04-25T08:52:14.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.083 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071022 s, 148 MB/s 2024-04-25T08:52:14.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.090 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627431 s, 167 MB/s 2024-04-25T08:52:14.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.097 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593063 s, 177 MB/s 2024-04-25T08:52:14.104 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.105 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659316 s, 159 MB/s 2024-04-25T08:52:14.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.112 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707357 s, 148 MB/s 2024-04-25T08:52:14.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.120 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697227 s, 150 MB/s 2024-04-25T08:52:14.128 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.128 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.129 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736967 s, 142 MB/s 2024-04-25T08:52:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.136 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661072 s, 159 MB/s 2024-04-25T08:52:14.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.144 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.144 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717588 s, 146 MB/s 2024-04-25T08:52:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006131 s, 171 MB/s 2024-04-25T08:52:14.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:14.152 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:14.152 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:14.152 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.13 2024-04-25T08:52:14.152 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:14.152 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:14.152 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:14.153 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:14.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.217 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653095 s, 161 MB/s 2024-04-25T08:52:14.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.225 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647631 s, 162 MB/s 2024-04-25T08:52:14.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.232 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.232 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605289 s, 173 MB/s 2024-04-25T08:52:14.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.239 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632784 s, 166 MB/s 2024-04-25T08:52:14.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.245 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056596 s, 185 MB/s 2024-04-25T08:52:14.253 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.253 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.253 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711471 s, 147 MB/s 2024-04-25T08:52:14.260 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.261 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.261 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597463 s, 176 MB/s 2024-04-25T08:52:14.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.267 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.267 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638716 s, 164 MB/s 2024-04-25T08:52:14.274 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.275 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.275 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629888 s, 166 MB/s 2024-04-25T08:52:14.282 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.282 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.283 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691727 s, 152 MB/s 2024-04-25T08:52:14.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.289 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.289 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060019 s, 175 MB/s 2024-04-25T08:52:14.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.296 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.296 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625512 s, 168 MB/s 2024-04-25T08:52:14.303 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.304 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620581 s, 169 MB/s 2024-04-25T08:52:14.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.312 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.312 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717859 s, 146 MB/s 2024-04-25T08:52:14.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.319 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620258 s, 169 MB/s 2024-04-25T08:52:14.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.326 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598318 s, 175 MB/s 2024-04-25T08:52:14.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.333 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612495 s, 171 MB/s 2024-04-25T08:52:14.340 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.340 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.340 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645803 s, 162 MB/s 2024-04-25T08:52:14.356 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.356 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.356 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151141 s, 69.4 MB/s 2024-04-25T08:52:14.363 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.363 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.363 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626223 s, 167 MB/s 2024-04-25T08:52:14.370 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.370 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.370 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579147 s, 181 MB/s 2024-04-25T08:52:14.376 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.377 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.377 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589109 s, 178 MB/s 2024-04-25T08:52:14.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.384 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006408 s, 164 MB/s 2024-04-25T08:52:14.391 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.392 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.392 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657734 s, 159 MB/s 2024-04-25T08:52:14.398 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.399 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595415 s, 176 MB/s 2024-04-25T08:52:14.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.406 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.406 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679755 s, 154 MB/s 2024-04-25T08:52:14.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640541 s, 164 MB/s 2024-04-25T08:52:14.421 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.422 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.422 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746114 s, 141 MB/s 2024-04-25T08:52:14.429 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.429 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.429 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631615 s, 166 MB/s 2024-04-25T08:52:14.436 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.436 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.436 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630589 s, 166 MB/s 2024-04-25T08:52:14.443 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.443 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.443 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635552 s, 165 MB/s 2024-04-25T08:52:14.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.451 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674133 s, 156 MB/s 2024-04-25T08:52:14.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:14.454 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:14.454 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:14.454 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.14 2024-04-25T08:52:14.454 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:14.454 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:14.454 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:14.454 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:14.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.519 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768718 s, 136 MB/s 2024-04-25T08:52:14.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.527 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710231 s, 148 MB/s 2024-04-25T08:52:14.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.535 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070453 s, 149 MB/s 2024-04-25T08:52:14.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.543 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.543 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711863 s, 147 MB/s 2024-04-25T08:52:14.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702978 s, 149 MB/s 2024-04-25T08:52:14.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.559 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.559 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683468 s, 153 MB/s 2024-04-25T08:52:14.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.566 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006103 s, 172 MB/s 2024-04-25T08:52:14.573 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.573 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.573 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664054 s, 158 MB/s 2024-04-25T08:52:14.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.581 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.581 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732225 s, 143 MB/s 2024-04-25T08:52:14.588 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.589 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641336 s, 163 MB/s 2024-04-25T08:52:14.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.597 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.597 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736606 s, 142 MB/s 2024-04-25T08:52:14.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.605 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700628 s, 150 MB/s 2024-04-25T08:52:14.612 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.612 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.612 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685527 s, 153 MB/s 2024-04-25T08:52:14.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.621 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723366 s, 145 MB/s 2024-04-25T08:52:14.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.629 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.629 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748236 s, 140 MB/s 2024-04-25T08:52:14.636 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.636 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.636 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653452 s, 160 MB/s 2024-04-25T08:52:14.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.643 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.643 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617718 s, 170 MB/s 2024-04-25T08:52:14.651 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.651 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.651 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655867 s, 160 MB/s 2024-04-25T08:52:14.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.658 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637627 s, 164 MB/s 2024-04-25T08:52:14.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.666 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727825 s, 144 MB/s 2024-04-25T08:52:14.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.673 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626464 s, 167 MB/s 2024-04-25T08:52:14.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.681 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679003 s, 154 MB/s 2024-04-25T08:52:14.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.689 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.689 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661454 s, 159 MB/s 2024-04-25T08:52:14.695 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.696 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.696 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607616 s, 173 MB/s 2024-04-25T08:52:14.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.704 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734625 s, 143 MB/s 2024-04-25T08:52:14.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.711 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637519 s, 164 MB/s 2024-04-25T08:52:14.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.718 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.718 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635282 s, 165 MB/s 2024-04-25T08:52:14.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.726 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.726 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711691 s, 147 MB/s 2024-04-25T08:52:14.734 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.734 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.734 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706116 s, 148 MB/s 2024-04-25T08:52:14.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.743 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.743 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738835 s, 142 MB/s 2024-04-25T08:52:14.750 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.750 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.750 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665996 s, 157 MB/s 2024-04-25T08:52:14.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.758 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.758 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641381 s, 163 MB/s 2024-04-25T08:52:14.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:14.759 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:14.759 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:14.759 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.15 2024-04-25T08:52:14.759 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:14.759 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:14.759 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:14.759 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:14.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.824 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.824 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636687 s, 165 MB/s 2024-04-25T08:52:14.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.832 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767537 s, 137 MB/s 2024-04-25T08:52:14.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.838 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.838 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571575 s, 183 MB/s 2024-04-25T08:52:14.846 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.846 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.846 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671589 s, 156 MB/s 2024-04-25T08:52:14.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.852 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.852 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567229 s, 185 MB/s 2024-04-25T08:52:14.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.860 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.860 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649966 s, 161 MB/s 2024-04-25T08:52:14.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.867 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.867 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638279 s, 164 MB/s 2024-04-25T08:52:14.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.874 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.874 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633103 s, 166 MB/s 2024-04-25T08:52:14.880 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.881 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.881 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566204 s, 185 MB/s 2024-04-25T08:52:14.889 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.889 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.889 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701132 s, 150 MB/s 2024-04-25T08:52:14.896 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.896 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.896 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634797 s, 165 MB/s 2024-04-25T08:52:14.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.903 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062379 s, 168 MB/s 2024-04-25T08:52:14.911 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.911 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.911 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751531 s, 140 MB/s 2024-04-25T08:52:14.919 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.919 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.919 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651551 s, 161 MB/s 2024-04-25T08:52:14.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.925 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558602 s, 188 MB/s 2024-04-25T08:52:14.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.934 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719066 s, 146 MB/s 2024-04-25T08:52:14.941 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.941 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.941 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651832 s, 161 MB/s 2024-04-25T08:52:14.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.947 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566345 s, 185 MB/s 2024-04-25T08:52:14.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.954 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058395 s, 180 MB/s 2024-04-25T08:52:14.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.961 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.962 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652316 s, 161 MB/s 2024-04-25T08:52:14.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.968 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.968 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582379 s, 180 MB/s 2024-04-25T08:52:14.975 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.976 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.976 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624817 s, 168 MB/s 2024-04-25T08:52:14.982 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.983 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.983 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626789 s, 167 MB/s 2024-04-25T08:52:14.990 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.990 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.990 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620174 s, 169 MB/s 2024-04-25T08:52:14.997 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:14.997 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:14.997 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668959 s, 157 MB/s 2024-04-25T08:52:15.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.006 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757074 s, 139 MB/s 2024-04-25T08:52:15.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.014 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.014 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683701 s, 153 MB/s 2024-04-25T08:52:15.021 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.021 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.021 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648723 s, 162 MB/s 2024-04-25T08:52:15.030 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.030 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.030 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755982 s, 139 MB/s 2024-04-25T08:52:15.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.036 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559538 s, 187 MB/s 2024-04-25T08:52:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.042 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.043 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578634 s, 181 MB/s 2024-04-25T08:52:15.050 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.050 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.050 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649844 s, 161 MB/s 2024-04-25T08:52:15.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:15.051 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:15.051 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:15.051 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.16 2024-04-25T08:52:15.051 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:15.051 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:15.051 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:15.051 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:15.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.115 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.116 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614626 s, 171 MB/s 2024-04-25T08:52:15.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.123 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.123 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719973 s, 146 MB/s 2024-04-25T08:52:15.130 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.130 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.130 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656405 s, 160 MB/s 2024-04-25T08:52:15.138 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.138 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.138 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688984 s, 152 MB/s 2024-04-25T08:52:15.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.145 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.145 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064708 s, 162 MB/s 2024-04-25T08:52:15.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.153 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.153 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685734 s, 153 MB/s 2024-04-25T08:52:15.161 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.162 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748453 s, 140 MB/s 2024-04-25T08:52:15.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.168 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.168 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575982 s, 182 MB/s 2024-04-25T08:52:15.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.175 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.176 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648032 s, 162 MB/s 2024-04-25T08:52:15.184 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.184 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.184 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730148 s, 144 MB/s 2024-04-25T08:52:15.191 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.191 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.191 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646004 s, 162 MB/s 2024-04-25T08:52:15.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.199 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.199 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654896 s, 160 MB/s 2024-04-25T08:52:15.206 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.206 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.206 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634977 s, 165 MB/s 2024-04-25T08:52:15.213 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.213 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.213 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642189 s, 163 MB/s 2024-04-25T08:52:15.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.221 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.221 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719471 s, 146 MB/s 2024-04-25T08:52:15.228 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.229 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.229 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659216 s, 159 MB/s 2024-04-25T08:52:15.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.235 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.235 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058805 s, 178 MB/s 2024-04-25T08:52:15.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.242 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.242 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616796 s, 170 MB/s 2024-04-25T08:52:15.249 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.250 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.250 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641393 s, 163 MB/s 2024-04-25T08:52:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.258 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733316 s, 143 MB/s 2024-04-25T08:52:15.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.265 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.265 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638657 s, 164 MB/s 2024-04-25T08:52:15.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.272 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.272 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612811 s, 171 MB/s 2024-04-25T08:52:15.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.279 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.279 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651615 s, 161 MB/s 2024-04-25T08:52:15.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.286 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.286 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630698 s, 166 MB/s 2024-04-25T08:52:15.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.294 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.294 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713631 s, 147 MB/s 2024-04-25T08:52:15.302 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.302 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.302 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698859 s, 150 MB/s 2024-04-25T08:52:15.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063947 s, 164 MB/s 2024-04-25T08:52:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646656 s, 162 MB/s 2024-04-25T08:52:15.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.324 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.324 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638787 s, 164 MB/s 2024-04-25T08:52:15.331 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.332 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.332 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631756 s, 166 MB/s 2024-04-25T08:52:15.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.339 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.339 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628591 s, 167 MB/s 2024-04-25T08:52:15.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.346 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.346 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667402 s, 157 MB/s 2024-04-25T08:52:15.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:15.348 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:15.348 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:15.348 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.17 2024-04-25T08:52:15.348 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:15.348 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:15.348 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:15.348 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:15.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.413 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688759 s, 152 MB/s 2024-04-25T08:52:15.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.420 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063694 s, 165 MB/s 2024-04-25T08:52:15.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590913 s, 177 MB/s 2024-04-25T08:52:15.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.434 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706732 s, 148 MB/s 2024-04-25T08:52:15.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.442 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.442 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665989 s, 157 MB/s 2024-04-25T08:52:15.448 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.449 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.449 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587157 s, 179 MB/s 2024-04-25T08:52:15.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.457 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674133 s, 156 MB/s 2024-04-25T08:52:15.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.464 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.464 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066407 s, 158 MB/s 2024-04-25T08:52:15.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.471 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.471 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635818 s, 165 MB/s 2024-04-25T08:52:15.478 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.478 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.479 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666303 s, 157 MB/s 2024-04-25T08:52:15.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.486 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662891 s, 158 MB/s 2024-04-25T08:52:15.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.493 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058802 s, 178 MB/s 2024-04-25T08:52:15.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.500 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.500 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620177 s, 169 MB/s 2024-04-25T08:52:15.507 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.508 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.508 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704517 s, 149 MB/s 2024-04-25T08:52:15.515 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.515 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.515 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688646 s, 152 MB/s 2024-04-25T08:52:15.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.523 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684626 s, 153 MB/s 2024-04-25T08:52:15.530 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.530 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.530 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058282 s, 180 MB/s 2024-04-25T08:52:15.537 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.537 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.537 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631424 s, 166 MB/s 2024-04-25T08:52:15.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.544 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597049 s, 176 MB/s 2024-04-25T08:52:15.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584792 s, 179 MB/s 2024-04-25T08:52:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652226 s, 161 MB/s 2024-04-25T08:52:15.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.565 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564648 s, 186 MB/s 2024-04-25T08:52:15.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.572 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619721 s, 169 MB/s 2024-04-25T08:52:15.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.579 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.579 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661288 s, 159 MB/s 2024-04-25T08:52:15.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.586 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.587 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607736 s, 173 MB/s 2024-04-25T08:52:15.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.593 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.593 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600681 s, 175 MB/s 2024-04-25T08:52:15.601 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.601 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.601 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720789 s, 145 MB/s 2024-04-25T08:52:15.608 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.608 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.608 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057261 s, 183 MB/s 2024-04-25T08:52:15.616 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.616 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.616 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686017 s, 153 MB/s 2024-04-25T08:52:15.623 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.623 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.623 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645221 s, 163 MB/s 2024-04-25T08:52:15.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709209 s, 148 MB/s 2024-04-25T08:52:15.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.641 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.642 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070645 s, 148 MB/s 2024-04-25T08:52:15.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:15.643 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:15.643 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:15.643 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.18 2024-04-25T08:52:15.643 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:15.643 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:15.643 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:15.643 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:15.708 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.708 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.708 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771591 s, 136 MB/s 2024-04-25T08:52:15.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.715 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.715 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596948 s, 176 MB/s 2024-04-25T08:52:15.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.722 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.722 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634082 s, 165 MB/s 2024-04-25T08:52:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648748 s, 162 MB/s 2024-04-25T08:52:15.737 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.737 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.737 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063431 s, 165 MB/s 2024-04-25T08:52:15.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.745 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.745 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065514 s, 160 MB/s 2024-04-25T08:52:15.752 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.752 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.752 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642795 s, 163 MB/s 2024-04-25T08:52:15.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.759 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.760 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665406 s, 158 MB/s 2024-04-25T08:52:15.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.766 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.766 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590102 s, 178 MB/s 2024-04-25T08:52:15.773 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.773 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.774 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640112 s, 164 MB/s 2024-04-25T08:52:15.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.781 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.781 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656363 s, 160 MB/s 2024-04-25T08:52:15.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.788 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.788 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636744 s, 165 MB/s 2024-04-25T08:52:15.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.795 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.796 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654713 s, 160 MB/s 2024-04-25T08:52:15.803 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.803 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.803 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624282 s, 168 MB/s 2024-04-25T08:52:15.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.810 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.810 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647287 s, 162 MB/s 2024-04-25T08:52:15.818 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.818 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.818 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722905 s, 145 MB/s 2024-04-25T08:52:15.825 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.826 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.826 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654149 s, 160 MB/s 2024-04-25T08:52:15.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.833 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.833 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629502 s, 167 MB/s 2024-04-25T08:52:15.841 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.841 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.841 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724916 s, 145 MB/s 2024-04-25T08:52:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730268 s, 144 MB/s 2024-04-25T08:52:15.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.857 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.857 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723481 s, 145 MB/s 2024-04-25T08:52:15.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.864 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.864 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589538 s, 178 MB/s 2024-04-25T08:52:15.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.871 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.872 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062941 s, 167 MB/s 2024-04-25T08:52:15.878 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.878 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.879 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627338 s, 167 MB/s 2024-04-25T08:52:15.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.886 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.886 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702751 s, 149 MB/s 2024-04-25T08:52:15.893 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.894 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.894 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633766 s, 165 MB/s 2024-04-25T08:52:15.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.900 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.900 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579476 s, 181 MB/s 2024-04-25T08:52:15.908 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.909 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.909 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748527 s, 140 MB/s 2024-04-25T08:52:15.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.916 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.916 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635848 s, 165 MB/s 2024-04-25T08:52:15.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.923 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.924 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677525 s, 155 MB/s 2024-04-25T08:52:15.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.931 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.931 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700063 s, 150 MB/s 2024-04-25T08:52:15.939 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:15.939 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:15.939 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714256 s, 147 MB/s 2024-04-25T08:52:15.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:15.941 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:15.941 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:15.941 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.19 2024-04-25T08:52:15.941 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:15.941 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:15.941 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:15.941 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:16.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.006 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726272 s, 144 MB/s 2024-04-25T08:52:16.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.013 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629988 s, 166 MB/s 2024-04-25T08:52:16.020 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.020 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.020 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634818 s, 165 MB/s 2024-04-25T08:52:16.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.028 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731884 s, 143 MB/s 2024-04-25T08:52:16.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.036 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699778 s, 150 MB/s 2024-04-25T08:52:16.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.043 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.043 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603063 s, 174 MB/s 2024-04-25T08:52:16.056 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.057 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.057 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120297 s, 87.2 MB/s 2024-04-25T08:52:16.063 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.064 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.064 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618223 s, 170 MB/s 2024-04-25T08:52:16.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.072 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.072 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698338 s, 150 MB/s 2024-04-25T08:52:16.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.079 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657957 s, 159 MB/s 2024-04-25T08:52:16.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.086 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.086 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637482 s, 164 MB/s 2024-04-25T08:52:16.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.094 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.094 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651364 s, 161 MB/s 2024-04-25T08:52:16.102 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.102 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.102 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748161 s, 140 MB/s 2024-04-25T08:52:16.109 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.110 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.110 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704949 s, 149 MB/s 2024-04-25T08:52:16.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.117 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.117 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633104 s, 166 MB/s 2024-04-25T08:52:16.125 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.125 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.125 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731389 s, 143 MB/s 2024-04-25T08:52:16.132 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.132 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.132 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642132 s, 163 MB/s 2024-04-25T08:52:16.139 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.140 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.140 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064162 s, 163 MB/s 2024-04-25T08:52:16.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.148 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.148 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679393 s, 154 MB/s 2024-04-25T08:52:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.154 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058189 s, 180 MB/s 2024-04-25T08:52:16.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.162 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.162 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714121 s, 147 MB/s 2024-04-25T08:52:16.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.169 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.169 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620611 s, 169 MB/s 2024-04-25T08:52:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.177 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700746 s, 150 MB/s 2024-04-25T08:52:16.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.185 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.185 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694231 s, 151 MB/s 2024-04-25T08:52:16.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.193 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.193 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697289 s, 150 MB/s 2024-04-25T08:52:16.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.200 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.200 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656592 s, 160 MB/s 2024-04-25T08:52:16.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.208 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702816 s, 149 MB/s 2024-04-25T08:52:16.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.216 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662381 s, 158 MB/s 2024-04-25T08:52:16.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.223 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651824 s, 161 MB/s 2024-04-25T08:52:16.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.231 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660005 s, 159 MB/s 2024-04-25T08:52:16.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.237 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.237 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567009 s, 185 MB/s 2024-04-25T08:52:16.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.245 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.245 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662063 s, 158 MB/s 2024-04-25T08:52:16.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:16.246 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:16.246 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:16.246 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.20 2024-04-25T08:52:16.247 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:16.247 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:16.247 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:16.247 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:16.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.310 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.310 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674421 s, 155 MB/s 2024-04-25T08:52:16.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.318 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.318 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650786 s, 161 MB/s 2024-04-25T08:52:16.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.325 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.325 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064717 s, 162 MB/s 2024-04-25T08:52:16.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.333 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706144 s, 148 MB/s 2024-04-25T08:52:16.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.341 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.341 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723977 s, 145 MB/s 2024-04-25T08:52:16.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.349 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.349 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685697 s, 153 MB/s 2024-04-25T08:52:16.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.357 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.357 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696125 s, 151 MB/s 2024-04-25T08:52:16.364 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.364 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.364 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690544 s, 152 MB/s 2024-04-25T08:52:16.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.372 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.372 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664159 s, 158 MB/s 2024-04-25T08:52:16.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.380 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.380 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679351 s, 154 MB/s 2024-04-25T08:52:16.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.387 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.387 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667247 s, 157 MB/s 2024-04-25T08:52:16.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.395 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071197 s, 147 MB/s 2024-04-25T08:52:16.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.402 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.402 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638357 s, 164 MB/s 2024-04-25T08:52:16.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.409 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.410 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058454 s, 179 MB/s 2024-04-25T08:52:16.417 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.417 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.417 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671081 s, 156 MB/s 2024-04-25T08:52:16.425 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.425 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.425 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701468 s, 149 MB/s 2024-04-25T08:52:16.432 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.432 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.432 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646204 s, 162 MB/s 2024-04-25T08:52:16.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.440 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.440 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715155 s, 147 MB/s 2024-04-25T08:52:16.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.447 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.447 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656235 s, 160 MB/s 2024-04-25T08:52:16.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.456 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.456 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658231 s, 159 MB/s 2024-04-25T08:52:16.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.463 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.463 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631208 s, 166 MB/s 2024-04-25T08:52:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.469 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629136 s, 167 MB/s 2024-04-25T08:52:16.476 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.476 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.476 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580802 s, 181 MB/s 2024-04-25T08:52:16.484 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.484 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.484 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650214 s, 161 MB/s 2024-04-25T08:52:16.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.490 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.491 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623592 s, 168 MB/s 2024-04-25T08:52:16.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.497 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.498 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588439 s, 178 MB/s 2024-04-25T08:52:16.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.504 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622585 s, 168 MB/s 2024-04-25T08:52:16.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.512 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.512 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653829 s, 160 MB/s 2024-04-25T08:52:16.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.519 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.519 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611206 s, 172 MB/s 2024-04-25T08:52:16.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645275 s, 163 MB/s 2024-04-25T08:52:16.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.533 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.533 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570711 s, 184 MB/s 2024-04-25T08:52:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.540 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611115 s, 172 MB/s 2024-04-25T08:52:16.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:16.541 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:16.541 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:16.541 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.21 2024-04-25T08:52:16.541 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:16.541 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:16.541 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:16.541 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:16.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.607 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.607 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718012 s, 146 MB/s 2024-04-25T08:52:16.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.615 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.615 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760176 s, 138 MB/s 2024-04-25T08:52:16.623 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.623 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.623 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719631 s, 146 MB/s 2024-04-25T08:52:16.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660385 s, 159 MB/s 2024-04-25T08:52:16.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.639 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.639 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744879 s, 141 MB/s 2024-04-25T08:52:16.646 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.646 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.646 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646254 s, 162 MB/s 2024-04-25T08:52:16.653 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.653 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.654 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575934 s, 182 MB/s 2024-04-25T08:52:16.661 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.661 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.661 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725573 s, 145 MB/s 2024-04-25T08:52:16.669 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.669 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.669 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710586 s, 148 MB/s 2024-04-25T08:52:16.676 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.676 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.676 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057309 s, 183 MB/s 2024-04-25T08:52:16.683 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.683 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.683 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652934 s, 161 MB/s 2024-04-25T08:52:16.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.690 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.690 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625183 s, 168 MB/s 2024-04-25T08:52:16.697 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.697 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.697 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577951 s, 181 MB/s 2024-04-25T08:52:16.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.704 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.704 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558523 s, 188 MB/s 2024-04-25T08:52:16.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.711 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.711 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063456 s, 165 MB/s 2024-04-25T08:52:16.719 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.719 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.719 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715782 s, 146 MB/s 2024-04-25T08:52:16.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.727 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.727 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699899 s, 150 MB/s 2024-04-25T08:52:16.734 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.734 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.734 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641728 s, 163 MB/s 2024-04-25T08:52:16.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.742 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.742 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673704 s, 156 MB/s 2024-04-25T08:52:16.748 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.748 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.748 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572382 s, 183 MB/s 2024-04-25T08:52:16.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659941 s, 159 MB/s 2024-04-25T08:52:16.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.764 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660635 s, 159 MB/s 2024-04-25T08:52:16.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.770 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.771 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006234 s, 168 MB/s 2024-04-25T08:52:16.779 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.779 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.779 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714388 s, 147 MB/s 2024-04-25T08:52:16.786 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.786 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.786 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659732 s, 159 MB/s 2024-04-25T08:52:16.793 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.793 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.793 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626846 s, 167 MB/s 2024-04-25T08:52:16.800 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.800 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.800 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627346 s, 167 MB/s 2024-04-25T08:52:16.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.808 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.808 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657426 s, 159 MB/s 2024-04-25T08:52:16.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.815 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062751 s, 167 MB/s 2024-04-25T08:52:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.823 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716054 s, 146 MB/s 2024-04-25T08:52:16.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.830 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630002 s, 166 MB/s 2024-04-25T08:52:16.837 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.837 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.837 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065539 s, 160 MB/s 2024-04-25T08:52:16.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:16.839 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:16.839 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:16.839 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.22 2024-04-25T08:52:16.839 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:16.839 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:16.839 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:16.839 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:16.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.903 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.903 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644446 s, 163 MB/s 2024-04-25T08:52:16.910 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.910 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.910 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624508 s, 168 MB/s 2024-04-25T08:52:16.917 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.918 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.918 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687143 s, 153 MB/s 2024-04-25T08:52:16.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.924 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.924 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589804 s, 178 MB/s 2024-04-25T08:52:16.932 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.933 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688945 s, 152 MB/s 2024-04-25T08:52:16.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.940 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.940 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660699 s, 159 MB/s 2024-04-25T08:52:16.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.947 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.947 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677227 s, 155 MB/s 2024-04-25T08:52:16.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.955 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.955 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657962 s, 159 MB/s 2024-04-25T08:52:16.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.963 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.963 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071957 s, 146 MB/s 2024-04-25T08:52:16.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.970 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.970 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643228 s, 163 MB/s 2024-04-25T08:52:16.978 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.978 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.978 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664849 s, 158 MB/s 2024-04-25T08:52:16.986 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.986 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.986 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071339 s, 147 MB/s 2024-04-25T08:52:16.993 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:16.993 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:16.994 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686905 s, 153 MB/s 2024-04-25T08:52:17.001 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.001 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.001 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649587 s, 161 MB/s 2024-04-25T08:52:17.008 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.008 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.008 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635128 s, 165 MB/s 2024-04-25T08:52:17.015 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.015 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.015 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057423 s, 183 MB/s 2024-04-25T08:52:17.023 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.023 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.023 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702638 s, 149 MB/s 2024-04-25T08:52:17.031 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.031 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.031 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071224 s, 147 MB/s 2024-04-25T08:52:17.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.038 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.039 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068589 s, 153 MB/s 2024-04-25T08:52:17.045 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.045 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.045 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561545 s, 187 MB/s 2024-04-25T08:52:17.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.052 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645937 s, 162 MB/s 2024-04-25T08:52:17.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.060 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660586 s, 159 MB/s 2024-04-25T08:52:17.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.068 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.068 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759005 s, 138 MB/s 2024-04-25T08:52:17.075 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.076 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.076 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628131 s, 167 MB/s 2024-04-25T08:52:17.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.083 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.084 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699542 s, 150 MB/s 2024-04-25T08:52:17.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.091 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648498 s, 162 MB/s 2024-04-25T08:52:17.099 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.099 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.099 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638719 s, 164 MB/s 2024-04-25T08:52:17.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.106 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637053 s, 165 MB/s 2024-04-25T08:52:17.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.113 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663993 s, 158 MB/s 2024-04-25T08:52:17.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.120 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638749 s, 164 MB/s 2024-04-25T08:52:17.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.127 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641541 s, 163 MB/s 2024-04-25T08:52:17.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.136 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736136 s, 142 MB/s 2024-04-25T08:52:17.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:17.137 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:17.137 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:17.137 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.23 2024-04-25T08:52:17.137 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:17.137 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:17.137 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:17.137 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:17.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.202 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671648 s, 156 MB/s 2024-04-25T08:52:17.209 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.210 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.210 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670956 s, 156 MB/s 2024-04-25T08:52:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.217 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667094 s, 157 MB/s 2024-04-25T08:52:17.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.224 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.224 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621294 s, 169 MB/s 2024-04-25T08:52:17.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.232 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659451 s, 159 MB/s 2024-04-25T08:52:17.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.239 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665339 s, 158 MB/s 2024-04-25T08:52:17.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.247 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658457 s, 159 MB/s 2024-04-25T08:52:17.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.254 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698608 s, 150 MB/s 2024-04-25T08:52:17.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.262 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705945 s, 149 MB/s 2024-04-25T08:52:17.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.270 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623857 s, 168 MB/s 2024-04-25T08:52:17.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.276 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587507 s, 178 MB/s 2024-04-25T08:52:17.284 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.284 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.284 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715178 s, 147 MB/s 2024-04-25T08:52:17.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.292 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629119 s, 167 MB/s 2024-04-25T08:52:17.300 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.300 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.300 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718382 s, 146 MB/s 2024-04-25T08:52:17.308 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.308 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.308 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734832 s, 143 MB/s 2024-04-25T08:52:17.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.317 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.317 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697758 s, 150 MB/s 2024-04-25T08:52:17.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.323 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.323 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636724 s, 165 MB/s 2024-04-25T08:52:17.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.330 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.330 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648852 s, 162 MB/s 2024-04-25T08:52:17.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.338 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.338 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659097 s, 159 MB/s 2024-04-25T08:52:17.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.345 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.345 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595952 s, 176 MB/s 2024-04-25T08:52:17.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.352 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064835 s, 162 MB/s 2024-04-25T08:52:17.359 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.359 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.359 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564949 s, 186 MB/s 2024-04-25T08:52:17.366 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.366 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.366 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658752 s, 159 MB/s 2024-04-25T08:52:17.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.375 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.375 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761714 s, 138 MB/s 2024-04-25T08:52:17.382 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.382 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.382 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672555 s, 156 MB/s 2024-04-25T08:52:17.389 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.389 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.390 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634204 s, 165 MB/s 2024-04-25T08:52:17.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.397 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.398 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721012 s, 145 MB/s 2024-04-25T08:52:17.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.405 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.405 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651919 s, 161 MB/s 2024-04-25T08:52:17.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.412 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576252 s, 182 MB/s 2024-04-25T08:52:17.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.419 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.419 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646271 s, 162 MB/s 2024-04-25T08:52:17.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.426 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.426 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643731 s, 163 MB/s 2024-04-25T08:52:17.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.435 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.437 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707298 s, 148 MB/s 2024-04-25T08:52:17.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:17.437 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:17.438 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:17.438 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.24 2024-04-25T08:52:17.438 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:17.438 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:17.438 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:17.438 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:17.499 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.499 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.500 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594372 s, 176 MB/s 2024-04-25T08:52:17.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.506 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.506 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600054 s, 175 MB/s 2024-04-25T08:52:17.513 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.514 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.514 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644882 s, 163 MB/s 2024-04-25T08:52:17.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.520 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.520 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559958 s, 187 MB/s 2024-04-25T08:52:17.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.527 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.527 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624629 s, 168 MB/s 2024-04-25T08:52:17.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.535 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.535 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685382 s, 153 MB/s 2024-04-25T08:52:17.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.542 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.542 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661691 s, 158 MB/s 2024-04-25T08:52:17.550 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.551 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.551 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701409 s, 149 MB/s 2024-04-25T08:52:17.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.558 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.558 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658101 s, 159 MB/s 2024-04-25T08:52:17.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.565 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.565 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668681 s, 157 MB/s 2024-04-25T08:52:17.572 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.629 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663572 s, 158 MB/s 2024-04-25T08:52:17.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.630 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659626 s, 159 MB/s 2024-04-25T08:52:17.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.630 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663676 s, 158 MB/s 2024-04-25T08:52:17.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.630 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620834 s, 169 MB/s 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693985 s, 151 MB/s 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721753 s, 145 MB/s 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704895 s, 149 MB/s 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.631 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632629 s, 166 MB/s 2024-04-25T08:52:17.632 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.632 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.632 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570858 s, 184 MB/s 2024-04-25T08:52:17.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.640 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.640 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677585 s, 155 MB/s 2024-04-25T08:52:17.647 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.647 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.647 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630161 s, 166 MB/s 2024-04-25T08:52:17.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.655 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.656 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740604 s, 142 MB/s 2024-04-25T08:52:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735966 s, 142 MB/s 2024-04-25T08:52:17.672 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.672 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.672 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722247 s, 145 MB/s 2024-04-25T08:52:17.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.678 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.678 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573579 s, 183 MB/s 2024-04-25T08:52:17.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.685 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.685 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582191 s, 180 MB/s 2024-04-25T08:52:17.693 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.693 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.693 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644455 s, 163 MB/s 2024-04-25T08:52:17.701 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.701 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.702 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753106 s, 139 MB/s 2024-04-25T08:52:17.709 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.709 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.709 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690314 s, 152 MB/s 2024-04-25T08:52:17.716 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.716 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.716 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662271 s, 158 MB/s 2024-04-25T08:52:17.723 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.723 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.723 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624431 s, 168 MB/s 2024-04-25T08:52:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.730 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649281 s, 161 MB/s 2024-04-25T08:52:17.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:17.731 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:17.732 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:17.732 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.25 2024-04-25T08:52:17.732 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:17.732 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:17.732 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:17.732 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:17.796 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.796 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.796 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632976 s, 166 MB/s 2024-04-25T08:52:17.804 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.804 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.804 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723746 s, 145 MB/s 2024-04-25T08:52:17.811 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.812 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.812 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654108 s, 160 MB/s 2024-04-25T08:52:17.819 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.819 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.820 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708093 s, 148 MB/s 2024-04-25T08:52:17.827 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.827 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.827 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687816 s, 152 MB/s 2024-04-25T08:52:17.834 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.834 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.834 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577988 s, 181 MB/s 2024-04-25T08:52:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.841 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644021 s, 163 MB/s 2024-04-25T08:52:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.849 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638402 s, 164 MB/s 2024-04-25T08:52:17.855 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.856 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.856 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629293 s, 167 MB/s 2024-04-25T08:52:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.862 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.863 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608326 s, 172 MB/s 2024-04-25T08:52:17.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.870 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.870 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648725 s, 162 MB/s 2024-04-25T08:52:17.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.877 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.877 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637673 s, 164 MB/s 2024-04-25T08:52:17.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.884 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.885 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066792 s, 157 MB/s 2024-04-25T08:52:17.891 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.891 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.891 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581942 s, 180 MB/s 2024-04-25T08:52:17.898 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.899 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.899 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649343 s, 161 MB/s 2024-04-25T08:52:17.906 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.906 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.907 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662136 s, 158 MB/s 2024-04-25T08:52:17.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.914 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.914 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719328 s, 146 MB/s 2024-04-25T08:52:17.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.921 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618849 s, 169 MB/s 2024-04-25T08:52:17.929 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.929 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.929 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070793 s, 148 MB/s 2024-04-25T08:52:17.937 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.937 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.937 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716793 s, 146 MB/s 2024-04-25T08:52:17.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.944 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.944 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587588 s, 178 MB/s 2024-04-25T08:52:17.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.952 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.952 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713585 s, 147 MB/s 2024-04-25T08:52:17.960 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.960 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.960 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671468 s, 156 MB/s 2024-04-25T08:52:17.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.967 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.967 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613092 s, 171 MB/s 2024-04-25T08:52:17.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.974 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.974 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595593 s, 176 MB/s 2024-04-25T08:52:17.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.981 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.981 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667851 s, 157 MB/s 2024-04-25T08:52:17.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.989 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706726 s, 148 MB/s 2024-04-25T08:52:17.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:17.996 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:17.996 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570053 s, 184 MB/s 2024-04-25T08:52:18.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.003 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.003 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062946 s, 167 MB/s 2024-04-25T08:52:18.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.011 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.011 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720437 s, 146 MB/s 2024-04-25T08:52:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.019 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665533 s, 158 MB/s 2024-04-25T08:52:18.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.026 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.026 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638916 s, 164 MB/s 2024-04-25T08:52:18.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:18.027 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:18.027 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:18.027 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.26 2024-04-25T08:52:18.027 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:18.027 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:18.027 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:18.028 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:18.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.091 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.091 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626662 s, 167 MB/s 2024-04-25T08:52:18.098 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.098 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.098 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598423 s, 175 MB/s 2024-04-25T08:52:18.104 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.104 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.104 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567076 s, 185 MB/s 2024-04-25T08:52:18.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.112 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.112 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718066 s, 146 MB/s 2024-04-25T08:52:18.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.120 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.120 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705938 s, 149 MB/s 2024-04-25T08:52:18.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.127 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.128 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637486 s, 164 MB/s 2024-04-25T08:52:18.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.135 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615556 s, 170 MB/s 2024-04-25T08:52:18.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.143 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.143 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726928 s, 144 MB/s 2024-04-25T08:52:18.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.150 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.150 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607938 s, 172 MB/s 2024-04-25T08:52:18.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.157 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.157 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679064 s, 154 MB/s 2024-04-25T08:52:18.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.165 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.165 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675907 s, 155 MB/s 2024-04-25T08:52:18.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.172 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587609 s, 178 MB/s 2024-04-25T08:52:18.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.180 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.180 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703724 s, 149 MB/s 2024-04-25T08:52:18.187 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.187 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.187 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652251 s, 161 MB/s 2024-04-25T08:52:18.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.195 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.195 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653578 s, 160 MB/s 2024-04-25T08:52:18.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.201 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.201 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579632 s, 181 MB/s 2024-04-25T08:52:18.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.208 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624932 s, 168 MB/s 2024-04-25T08:52:18.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.216 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.216 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692527 s, 151 MB/s 2024-04-25T08:52:18.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.223 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636763 s, 165 MB/s 2024-04-25T08:52:18.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.231 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.231 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724372 s, 145 MB/s 2024-04-25T08:52:18.238 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.239 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.239 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064539 s, 162 MB/s 2024-04-25T08:52:18.246 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.247 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.247 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675453 s, 155 MB/s 2024-04-25T08:52:18.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.254 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649018 s, 162 MB/s 2024-04-25T08:52:18.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.262 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.262 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751915 s, 139 MB/s 2024-04-25T08:52:18.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.269 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.269 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631145 s, 166 MB/s 2024-04-25T08:52:18.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.276 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.276 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626437 s, 167 MB/s 2024-04-25T08:52:18.284 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.284 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.284 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666492 s, 157 MB/s 2024-04-25T08:52:18.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.291 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.291 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564818 s, 186 MB/s 2024-04-25T08:52:18.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.299 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.299 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729396 s, 144 MB/s 2024-04-25T08:52:18.307 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.307 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.307 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716407 s, 146 MB/s 2024-04-25T08:52:18.314 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.314 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.314 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648248 s, 162 MB/s 2024-04-25T08:52:18.322 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.322 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.322 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667291 s, 157 MB/s 2024-04-25T08:52:18.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:18.323 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:18.323 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:18.323 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.27 2024-04-25T08:52:18.323 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:18.323 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:18.323 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:18.324 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:18.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.388 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668248 s, 157 MB/s 2024-04-25T08:52:18.396 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.396 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.396 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072474 s, 145 MB/s 2024-04-25T08:52:18.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.404 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.404 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757266 s, 138 MB/s 2024-04-25T08:52:18.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.412 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.413 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738884 s, 142 MB/s 2024-04-25T08:52:18.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.420 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.420 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656488 s, 160 MB/s 2024-04-25T08:52:18.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.427 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.427 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061769 s, 170 MB/s 2024-04-25T08:52:18.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.434 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.434 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629869 s, 166 MB/s 2024-04-25T08:52:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.441 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602933 s, 174 MB/s 2024-04-25T08:52:18.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.450 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.450 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739274 s, 142 MB/s 2024-04-25T08:52:18.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.457 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.457 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718612 s, 146 MB/s 2024-04-25T08:52:18.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.465 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.465 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683072 s, 154 MB/s 2024-04-25T08:52:18.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.472 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.472 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626129 s, 167 MB/s 2024-04-25T08:52:18.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.479 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.479 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594862 s, 176 MB/s 2024-04-25T08:52:18.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.486 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.486 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631646 s, 166 MB/s 2024-04-25T08:52:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.493 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620585 s, 169 MB/s 2024-04-25T08:52:18.501 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.502 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.502 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726113 s, 144 MB/s 2024-04-25T08:52:18.509 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.509 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.509 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674379 s, 155 MB/s 2024-04-25T08:52:18.516 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.517 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.517 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643142 s, 163 MB/s 2024-04-25T08:52:18.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.523 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.523 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569439 s, 184 MB/s 2024-04-25T08:52:18.530 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.531 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.531 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650482 s, 161 MB/s 2024-04-25T08:52:18.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.539 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.539 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727244 s, 144 MB/s 2024-04-25T08:52:18.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.546 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.546 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672517 s, 156 MB/s 2024-04-25T08:52:18.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.554 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.554 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670321 s, 156 MB/s 2024-04-25T08:52:18.561 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.561 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.561 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660587 s, 159 MB/s 2024-04-25T08:52:18.568 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.568 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.568 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635487 s, 165 MB/s 2024-04-25T08:52:18.577 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.577 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.577 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756104 s, 139 MB/s 2024-04-25T08:52:18.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.584 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.584 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648751 s, 162 MB/s 2024-04-25T08:52:18.591 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.591 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.592 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630842 s, 166 MB/s 2024-04-25T08:52:18.598 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.598 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.598 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056521 s, 186 MB/s 2024-04-25T08:52:18.605 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.606 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612827 s, 171 MB/s 2024-04-25T08:52:18.612 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.612 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.612 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006153 s, 170 MB/s 2024-04-25T08:52:18.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.620 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.620 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673888 s, 156 MB/s 2024-04-25T08:52:18.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:18.621 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:18.621 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:18.621 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.28 2024-04-25T08:52:18.621 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:18.621 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:18.621 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:18.621 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:18.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.738 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.739 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062695 s, 167 MB/s 2024-04-25T08:52:18.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.746 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.747 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711335 s, 147 MB/s 2024-04-25T08:52:18.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.754 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.754 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652197 s, 161 MB/s 2024-04-25T08:52:18.761 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.761 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.761 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668666 s, 157 MB/s 2024-04-25T08:52:18.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711234 s, 147 MB/s 2024-04-25T08:52:18.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.777 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704712 s, 149 MB/s 2024-04-25T08:52:18.785 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.785 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.785 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653611 s, 160 MB/s 2024-04-25T08:52:18.792 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.792 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.792 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625454 s, 168 MB/s 2024-04-25T08:52:18.800 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.800 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.800 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712105 s, 147 MB/s 2024-04-25T08:52:18.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.807 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.807 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656828 s, 160 MB/s 2024-04-25T08:52:18.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.815 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.815 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668189 s, 157 MB/s 2024-04-25T08:52:18.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.823 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.823 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735454 s, 143 MB/s 2024-04-25T08:52:18.830 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.831 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.831 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670481 s, 156 MB/s 2024-04-25T08:52:18.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.839 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.839 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761972 s, 138 MB/s 2024-04-25T08:52:18.846 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.846 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.847 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661353 s, 159 MB/s 2024-04-25T08:52:18.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.854 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.854 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638454 s, 164 MB/s 2024-04-25T08:52:18.861 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.861 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.861 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659363 s, 159 MB/s 2024-04-25T08:52:18.868 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.868 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.868 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573418 s, 183 MB/s 2024-04-25T08:52:18.875 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.875 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.875 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614784 s, 171 MB/s 2024-04-25T08:52:18.882 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.882 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.883 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697727 s, 150 MB/s 2024-04-25T08:52:18.890 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.890 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.890 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640397 s, 164 MB/s 2024-04-25T08:52:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.897 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645089 s, 163 MB/s 2024-04-25T08:52:18.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.905 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764032 s, 137 MB/s 2024-04-25T08:52:18.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.913 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.913 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691722 s, 152 MB/s 2024-04-25T08:52:18.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.921 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.921 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065703 s, 160 MB/s 2024-04-25T08:52:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.928 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632387 s, 166 MB/s 2024-04-25T08:52:18.935 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.935 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.935 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644369 s, 163 MB/s 2024-04-25T08:52:18.942 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.943 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.943 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638136 s, 164 MB/s 2024-04-25T08:52:18.949 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.951 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.951 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600863 s, 175 MB/s 2024-04-25T08:52:18.956 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.957 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.957 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615538 s, 170 MB/s 2024-04-25T08:52:18.965 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.965 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.965 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717095 s, 146 MB/s 2024-04-25T08:52:18.972 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.972 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.972 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066058 s, 159 MB/s 2024-04-25T08:52:18.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:18.973 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:18.973 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:18.973 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.29 2024-04-25T08:52:18.974 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:18.974 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:18.974 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:18.974 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:18.999 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:18.999 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:18.999 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715494 s, 147 MB/s 2024-04-25T08:52:19.006 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.007 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.007 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633654 s, 165 MB/s 2024-04-25T08:52:19.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.013 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.013 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625595 s, 168 MB/s 2024-04-25T08:52:19.021 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.021 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.021 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642201 s, 163 MB/s 2024-04-25T08:52:19.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.028 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.028 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606826 s, 173 MB/s 2024-04-25T08:52:19.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.036 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.036 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075724 s, 138 MB/s 2024-04-25T08:52:19.045 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.045 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.045 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071286 s, 147 MB/s 2024-04-25T08:52:19.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.052 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.052 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711991 s, 147 MB/s 2024-04-25T08:52:19.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.060 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.060 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669211 s, 157 MB/s 2024-04-25T08:52:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.067 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607658 s, 173 MB/s 2024-04-25T08:52:19.074 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.074 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.074 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615867 s, 170 MB/s 2024-04-25T08:52:19.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.082 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.082 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069728 s, 150 MB/s 2024-04-25T08:52:19.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.090 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.090 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071763 s, 146 MB/s 2024-04-25T08:52:19.097 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.098 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.098 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681266 s, 154 MB/s 2024-04-25T08:52:19.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.105 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.106 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735214 s, 143 MB/s 2024-04-25T08:52:19.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.113 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.113 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623444 s, 168 MB/s 2024-04-25T08:52:19.121 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.121 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.121 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072124 s, 145 MB/s 2024-04-25T08:52:19.128 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.128 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.128 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646082 s, 162 MB/s 2024-04-25T08:52:19.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.135 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640529 s, 164 MB/s 2024-04-25T08:52:19.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.142 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.142 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598601 s, 175 MB/s 2024-04-25T08:52:19.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.149 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.149 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618043 s, 170 MB/s 2024-04-25T08:52:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.156 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061576 s, 170 MB/s 2024-04-25T08:52:19.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.164 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.164 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695784 s, 151 MB/s 2024-04-25T08:52:19.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.173 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.173 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774054 s, 135 MB/s 2024-04-25T08:52:19.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.179 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.179 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570189 s, 184 MB/s 2024-04-25T08:52:19.187 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.187 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.187 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645266 s, 163 MB/s 2024-04-25T08:52:19.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.194 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.194 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643924 s, 163 MB/s 2024-04-25T08:52:19.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.202 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.202 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659155 s, 159 MB/s 2024-04-25T08:52:19.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.208 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.208 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00551142 s, 190 MB/s 2024-04-25T08:52:19.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.216 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655044 s, 160 MB/s 2024-04-25T08:52:19.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.223 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.223 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647455 s, 162 MB/s 2024-04-25T08:52:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.230 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621039 s, 169 MB/s 2024-04-25T08:52:19.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:19.231 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:19.231 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:19.231 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.30 2024-04-25T08:52:19.231 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:19.231 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:19.231 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:19.231 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:19.295 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.295 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.295 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641574 s, 163 MB/s 2024-04-25T08:52:19.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.304 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.304 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077991 s, 134 MB/s 2024-04-25T08:52:19.311 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.311 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.311 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647443 s, 162 MB/s 2024-04-25T08:52:19.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.319 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.319 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717498 s, 146 MB/s 2024-04-25T08:52:19.326 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.326 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.326 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638673 s, 164 MB/s 2024-04-25T08:52:19.333 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.334 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.334 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634797 s, 165 MB/s 2024-04-25T08:52:19.340 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.340 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.341 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601605 s, 174 MB/s 2024-04-25T08:52:19.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.347 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.347 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587135 s, 179 MB/s 2024-04-25T08:52:19.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.354 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.354 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598555 s, 175 MB/s 2024-04-25T08:52:19.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.362 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.362 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680268 s, 154 MB/s 2024-04-25T08:52:19.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.369 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.369 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627308 s, 167 MB/s 2024-04-25T08:52:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.377 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663102 s, 158 MB/s 2024-04-25T08:52:19.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.384 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.384 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668089 s, 157 MB/s 2024-04-25T08:52:19.392 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.392 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.392 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676009 s, 155 MB/s 2024-04-25T08:52:19.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.399 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634773 s, 165 MB/s 2024-04-25T08:52:19.407 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.407 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.407 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717741 s, 146 MB/s 2024-04-25T08:52:19.415 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.415 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.415 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724861 s, 145 MB/s 2024-04-25T08:52:19.423 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.423 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.423 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657611 s, 159 MB/s 2024-04-25T08:52:19.430 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.430 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.430 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636964 s, 165 MB/s 2024-04-25T08:52:19.437 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.437 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.437 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646879 s, 162 MB/s 2024-04-25T08:52:19.444 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.444 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.444 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643102 s, 163 MB/s 2024-04-25T08:52:19.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.451 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.451 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609562 s, 172 MB/s 2024-04-25T08:52:19.459 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.459 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.459 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065371 s, 160 MB/s 2024-04-25T08:52:19.466 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.466 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.466 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663602 s, 158 MB/s 2024-04-25T08:52:19.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.473 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.473 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598695 s, 175 MB/s 2024-04-25T08:52:19.481 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.481 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.481 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726398 s, 144 MB/s 2024-04-25T08:52:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.488 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597237 s, 176 MB/s 2024-04-25T08:52:19.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.496 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.496 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065265 s, 161 MB/s 2024-04-25T08:52:19.503 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.504 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.504 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698916 s, 150 MB/s 2024-04-25T08:52:19.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.511 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.511 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682519 s, 154 MB/s 2024-04-25T08:52:19.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.518 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.518 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586487 s, 179 MB/s 2024-04-25T08:52:19.525 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.526 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.526 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654576 s, 160 MB/s 2024-04-25T08:52:19.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:19.527 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2024-04-25T08:52:19.527 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-25T08:52:19.527 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p scrub_control_test_path/dir.31 2024-04-25T08:52:19.527 DEBUG:teuthology.orchestra.run.smithi172:> for ((i = 0; i < 32; i++)); do 2024-04-25T08:52:19.527 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-04-25T08:52:19.527 DEBUG:teuthology.orchestra.run.smithi172:> done 2024-04-25T08:52:19.527 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-25T08:52:19.591 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.592 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.592 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690544 s, 152 MB/s 2024-04-25T08:52:19.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.599 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.599 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627652 s, 167 MB/s 2024-04-25T08:52:19.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.606 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.606 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644216 s, 163 MB/s 2024-04-25T08:52:19.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.613 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.613 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062668 s, 167 MB/s 2024-04-25T08:52:19.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.621 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.621 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722101 s, 145 MB/s 2024-04-25T08:52:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.628 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615446 s, 170 MB/s 2024-04-25T08:52:19.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.635 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.635 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576302 s, 182 MB/s 2024-04-25T08:52:19.642 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.642 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.642 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063088 s, 166 MB/s 2024-04-25T08:52:19.650 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.651 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.651 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713516 s, 147 MB/s 2024-04-25T08:52:19.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.658 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.658 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687774 s, 152 MB/s 2024-04-25T08:52:19.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.666 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.667 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712136 s, 147 MB/s 2024-04-25T08:52:19.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.673 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.673 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640126 s, 164 MB/s 2024-04-25T08:52:19.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.681 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.681 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652599 s, 161 MB/s 2024-04-25T08:52:19.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.688 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.688 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649385 s, 161 MB/s 2024-04-25T08:52:19.695 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.695 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.695 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625593 s, 168 MB/s 2024-04-25T08:52:19.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.703 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722731 s, 145 MB/s 2024-04-25T08:52:19.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.710 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.710 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619191 s, 169 MB/s 2024-04-25T08:52:19.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.717 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.717 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624306 s, 168 MB/s 2024-04-25T08:52:19.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.725 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.725 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702125 s, 149 MB/s 2024-04-25T08:52:19.734 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.734 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.734 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068081 s, 154 MB/s 2024-04-25T08:52:19.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.740 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.741 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668474 s, 157 MB/s 2024-04-25T08:52:19.748 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.748 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.748 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626872 s, 167 MB/s 2024-04-25T08:52:19.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.756 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744994 s, 141 MB/s 2024-04-25T08:52:19.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.763 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.763 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571444 s, 183 MB/s 2024-04-25T08:52:19.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.769 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.769 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570168 s, 184 MB/s 2024-04-25T08:52:19.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.777 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.777 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658949 s, 159 MB/s 2024-04-25T08:52:19.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.784 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.784 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593727 s, 177 MB/s 2024-04-25T08:52:19.791 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.791 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.791 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663836 s, 158 MB/s 2024-04-25T08:52:19.798 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.798 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.798 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577804 s, 181 MB/s 2024-04-25T08:52:19.806 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.806 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.806 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728486 s, 144 MB/s 2024-04-25T08:52:19.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.814 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.814 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712262 s, 147 MB/s 2024-04-25T08:52:19.821 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T08:52:19.821 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T08:52:19.821 INFO:teuthology.orchestra.run.smithi172.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593959 s, 177 MB/s 2024-04-25T08:52:19.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-04-25T08:52:19.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.973+0000 7f3b0eff4640 1 Processor -- start 2024-04-25T08:52:19.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.973+0000 7f3b0eff4640 1 -- start start 2024-04-25T08:52:19.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0eff4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3b080cc4f0 0x7f3b080cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:19.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0eff4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b080cdb20 0x7f3b080cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:19.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0eff4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b08072280 con 0x7f3b0815b270 2024-04-25T08:52:19.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0eff4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080ce4c0 con 0x7f3b080cc4f0 2024-04-25T08:52:19.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0eff4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b08071270 con 0x7f3b080cdb20 2024-04-25T08:52:19.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0cd90640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3b080cc4f0 0x7f3b080cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0d591640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3b0815b270 0x7f3b0815b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41360/0 (socket says 172.21.15.172:41360) 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0d591640 1 -- 172.21.15.172:0/3076012121 learned_addr learned my addr 172.21.15.172:0/3076012121 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b07fff640 1 --2- 172.21.15.172:0/3076012121 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b080cdb20 0x7f3b080cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0cd90640 1 -- 172.21.15.172:0/3076012121 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b080cdb20 msgr2=0x7f3b080cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0cd90640 1 --2- 172.21.15.172:0/3076012121 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b080cdb20 0x7f3b080cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0cd90640 1 -- 172.21.15.172:0/3076012121 >> v1:172.21.15.172:6789/0 conn(0x7f3b0815b270 legacy=0x7f3b0815b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.974+0000 7f3b0cd90640 1 -- 172.21.15.172:0/3076012121 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080714c0 con 0x7f3b080cc4f0 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.975+0000 7f3b0cd90640 1 --2- 172.21.15.172:0/3076012121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 0x7f3b080cc8d0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f3af800ba40 tx=0x7f3af802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46340857eb50c00c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.975+0000 7f3b077fe640 1 -- 172.21.15.172:0/3076012121 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8032750 con 0x7f3b080cc4f0 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.975+0000 7f3b077fe640 1 -- 172.21.15.172:0/3076012121 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8030050 con 0x7f3b080cc4f0 2024-04-25T08:52:19.966 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.975+0000 7f3b077fe640 1 -- 172.21.15.172:0/3076012121 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8032b10 con 0x7f3b080cc4f0 2024-04-25T08:52:19.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.976+0000 7f3b0eff4640 1 -- 172.21.15.172:0/3076012121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 msgr2=0x7f3b080cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:19.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.976+0000 7f3b0eff4640 1 --2- 172.21.15.172:0/3076012121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 0x7f3b080cc8d0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f3af800ba40 tx=0x7f3af802c850 comp rx=0 tx=0).stop 2024-04-25T08:52:19.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.976+0000 7f3b0eff4640 1 -- 172.21.15.172:0/3076012121 shutdown_connections 2024-04-25T08:52:19.967 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.976+0000 7f3b0eff4640 1 --2- 172.21.15.172:0/3076012121 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b080cdb20 0x7f3b080cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:19.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.976+0000 7f3b0eff4640 1 --2- 172.21.15.172:0/3076012121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 0x7f3b080cc8d0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:19.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.976+0000 7f3b0eff4640 1 -- 172.21.15.172:0/3076012121 >> 172.21.15.172:0/3076012121 conn(0x7f3b0806abe0 msgr2=0x7f3b0806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:19.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.976+0000 7f3b0eff4640 1 -- 172.21.15.172:0/3076012121 shutdown_connections 2024-04-25T08:52:19.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.976+0000 7f3b0eff4640 1 -- 172.21.15.172:0/3076012121 wait complete. 2024-04-25T08:52:19.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.977+0000 7f3b0eff4640 1 Processor -- start 2024-04-25T08:52:19.968 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.977+0000 7f3b0eff4640 1 -- start start 2024-04-25T08:52:19.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0eff4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 0x7f3b08151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:19.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0eff4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b080cdb20 0x7f3b08151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:19.970 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0eff4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b0815b270 0x7f3b08157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0eff4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b08071a80 con 0x7f3b080cc4f0 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0eff4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0815bd90 con 0x7f3b080cdb20 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0eff4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b08071d60 con 0x7f3b0815b270 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0cd90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 0x7f3b08151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0cd90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 0x7f3b08151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50236/0 (socket says 172.21.15.172:50236) 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0cd90640 1 -- 172.21.15.172:0/1448149969 learned_addr learned my addr 172.21.15.172:0/1448149969 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0d591640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b0815b270 0x7f3b08157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b07fff640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b080cdb20 0x7f3b08151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0cd90640 1 -- 172.21.15.172:0/1448149969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b0815b270 msgr2=0x7f3b08157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0cd90640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b0815b270 0x7f3b08157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0cd90640 1 -- 172.21.15.172:0/1448149969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b080cdb20 msgr2=0x7f3b08151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0cd90640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b080cdb20 0x7f3b08151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:19.971 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0cd90640 1 -- 172.21.15.172:0/1448149969 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b081527f0 con 0x7f3b080cc4f0 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.978+0000 7f3b0cd90640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 0x7f3b08151fa0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f3af800bb60 tx=0x7f3af80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.979+0000 7f3b057fa640 1 -- 172.21.15.172:0/1448149969 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8041020 con 0x7f3b080cc4f0 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.979+0000 7f3b057fa640 1 -- 172.21.15.172:0/1448149969 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8034c20 con 0x7f3b080cc4f0 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.979+0000 7f3b057fa640 1 -- 172.21.15.172:0/1448149969 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8032e30 con 0x7f3b080cc4f0 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.979+0000 7f3b0eff4640 1 -- 172.21.15.172:0/1448149969 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b08152ad0 con 0x7f3b080cc4f0 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.979+0000 7f3b0eff4640 1 -- 172.21.15.172:0/1448149969 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b08153370 con 0x7f3b080cc4f0 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.980+0000 7f3b0eff4640 1 -- 172.21.15.172:0/1448149969 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b08073a00 con 0x7f3b080cc4f0 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.980+0000 7f3b057fa640 1 -- 172.21.15.172:0/1448149969 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3af8044020 con 0x7f3b080cc4f0 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.980+0000 7f3b057fa640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3af406b4d0 0x7f3af406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.980+0000 7f3b057fa640 1 -- 172.21.15.172:0/1448149969 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3af80aadc0 con 0x7f3b080cc4f0 2024-04-25T08:52:19.972 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.980+0000 7f3b07fff640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3af406b4d0 0x7f3af406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:19.973 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.981+0000 7f3b07fff640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3af406b4d0 0x7f3af406d990 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3b08068080 tx=0x7f3afc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:19.974 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:19.985+0000 7f3b057fa640 1 -- 172.21.15.172:0/1448149969 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3af804b030 con 0x7f3b080cc4f0 2024-04-25T08:52:20.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.193+0000 7f3b0eff4640 1 -- 172.21.15.172:0/1448149969 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f3b0806d3a0 con 0x7f3b080cc4f0 2024-04-25T08:52:20.745 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.755+0000 7f3b057fa640 1 -- 172.21.15.172:0/1448149969 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v86) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3af8079430 con 0x7f3b080cc4f0 2024-04-25T08:52:20.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 -- 172.21.15.172:0/1448149969 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3af406b4d0 msgr2=0x7f3af406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:20.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3af406b4d0 0x7f3af406d990 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3b08068080 tx=0x7f3afc008040 comp rx=0 tx=0).stop 2024-04-25T08:52:20.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 -- 172.21.15.172:0/1448149969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 msgr2=0x7f3b08151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:20.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 0x7f3b08151fa0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f3af800bb60 tx=0x7f3af80046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:20.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 -- 172.21.15.172:0/1448149969 shutdown_connections 2024-04-25T08:52:20.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3af406b4d0 0x7f3af406d990 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:20.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b080cdb20 0x7f3b08151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:20.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b0815b270 0x7f3b08157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:20.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 --2- 172.21.15.172:0/1448149969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b080cc4f0 0x7f3b08151fa0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:20.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 -- 172.21.15.172:0/1448149969 >> 172.21.15.172:0/1448149969 conn(0x7f3b0806abe0 msgr2=0x7f3b08158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:20.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 -- 172.21.15.172:0/1448149969 shutdown_connections 2024-04-25T08:52:20.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.758+0000 7f3b0eff4640 1 -- 172.21.15.172:0/1448149969 wait complete. 2024-04-25T08:52:20.759 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-25T08:52:20.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.870+0000 7fa51c0cd640 1 Processor -- start 2024-04-25T08:52:20.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.870+0000 7fa51c0cd640 1 -- start start 2024-04-25T08:52:20.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa51c0cd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5140cc4f0 0x7fa5140cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa51c0cd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa514072280 con 0x7fa51415b980 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa51c0cd640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5140714c0 con 0x7fa5140cdb20 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa51c0cd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa514071270 con 0x7fa5140cc4f0 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa51a66a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa51415b980 0x7fa5140ae500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41362/0 (socket says 172.21.15.172:41362) 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa51a66a640 1 -- 172.21.15.172:0/510074577 learned_addr learned my addr 172.21.15.172:0/510074577 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa519e69640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5140cc4f0 0x7fa5140cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277378865 0 0) 0x7fa514072280 con 0x7fa51415b980 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa500003520 con 0x7fa51415b980 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664595084 0 0) 0x7fa500003520 con 0x7fa51415b980 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5140cc4f0 msgr2=0x7fa5140cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5140cc4f0 0x7fa5140cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 >> v1:172.21.15.186:6789/0 conn(0x7fa5140cdb20 legacy=0x7fa51415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:20.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5140717a0 con 0x7fa51415b980 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fa50c0019f0 con 0x7fa51415b980 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 >> v1:172.21.15.172:6789/0 conn(0x7fa51415b980 legacy=0x7fa5140ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5000039e0 0x7fa500003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa500004390 0x7fa500004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5140cc4f0 0x7fa5000050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514071270 con 0x7fa5000039e0 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50000b9c0 con 0x7fa500004390 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.871+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50000bbc0 con 0x7fa5140cc4f0 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.872+0000 7fa519e69640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5000039e0 0x7fa500003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.872+0000 7fa51a66a640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5140cc4f0 0x7fa5000050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.872+0000 7fa519668640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa500004390 0x7fa500004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.872+0000 7fa519e69640 1 -- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5140cc4f0 msgr2=0x7fa5000050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.872+0000 7fa519e69640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5140cc4f0 0x7fa5000050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.872+0000 7fa519e69640 1 -- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa500004390 msgr2=0x7fa500004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:20.865 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.872+0000 7fa519e69640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa500004390 0x7fa500004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.872+0000 7fa519e69640 1 -- 172.21.15.172:0/510074577 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500003520 con 0x7fa5000039e0 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa519e69640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5000039e0 0x7fa500003dc0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fa510009ac0 tx=0x7fa500005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e622c3965028587 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510036070 con 0x7fa5000039e0 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa510031400 con 0x7fa5000039e0 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa518e67640 1 -- 172.21.15.172:0/510074577 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510009690 con 0x7fa5000039e0 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa51c0cd640 1 -- 172.21.15.172:0/510074577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5000039e0 msgr2=0x7fa500003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa51c0cd640 1 --2- 172.21.15.172:0/510074577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5000039e0 0x7fa500003dc0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fa510009ac0 tx=0x7fa500005830 comp rx=0 tx=0).stop 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa51a66a640 1 -- 172.21.15.172:0/510074577 reap_dead start 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa51c0cd640 1 -- 172.21.15.172:0/510074577 shutdown_connections 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa51c0cd640 1 -- 172.21.15.172:0/510074577 >> 172.21.15.172:0/510074577 conn(0x7fa51406abe0 msgr2=0x7fa51406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa51c0cd640 1 -- 172.21.15.172:0/510074577 shutdown_connections 2024-04-25T08:52:20.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.873+0000 7fa51c0cd640 1 -- 172.21.15.172:0/510074577 wait complete. 2024-04-25T08:52:20.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.874+0000 7fa51c0cd640 1 Processor -- start 2024-04-25T08:52:20.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.874+0000 7fa51c0cd640 1 -- start start 2024-04-25T08:52:20.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa51c0cd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5000039e0 0x7fa5140c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:20.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa51c0cd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5140b4040 0x7fa514146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:20.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa51c0cd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa514154200 0x7fa514154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:20.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa51c0cd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514071d60 con 0x7fa5140b4040 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa51c0cd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51415bd90 con 0x7fa514154200 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa51c0cd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51406e8a0 con 0x7fa5000039e0 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa519668640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5140b4040 0x7fa514146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa519668640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5140b4040 0x7fa514146ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50262/0 (socket says 172.21.15.172:50262) 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa519668640 1 -- 172.21.15.172:0/627773480 learned_addr learned my addr 172.21.15.172:0/627773480 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa51a66a640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa514154200 0x7fa514154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.875+0000 7fa519e69640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5000039e0 0x7fa5140c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa519668640 1 -- 172.21.15.172:0/627773480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5000039e0 msgr2=0x7fa5140c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa519668640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5000039e0 0x7fa5140c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa519668640 1 -- 172.21.15.172:0/627773480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa514154200 msgr2=0x7fa514154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa519668640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa514154200 0x7fa514154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa519668640 1 -- 172.21.15.172:0/627773480 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5140c4c10 con 0x7fa5140b4040 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa519e69640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5000039e0 0x7fa5140c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa519668640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5140b4040 0x7fa514146ff0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fa50400f750 tx=0x7fa50400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:20.870 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa50a7fc640 1 -- 172.21.15.172:0/627773480 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400fe60 con 0x7fa5140b4040 2024-04-25T08:52:20.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa50a7fc640 1 -- 172.21.15.172:0/627773480 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa504018070 con 0x7fa5140b4040 2024-04-25T08:52:20.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa51c0cd640 1 -- 172.21.15.172:0/627773480 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5140c4e90 con 0x7fa5140b4040 2024-04-25T08:52:20.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa50a7fc640 1 -- 172.21.15.172:0/627773480 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400d730 con 0x7fa5140b4040 2024-04-25T08:52:20.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.876+0000 7fa51c0cd640 1 -- 172.21.15.172:0/627773480 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5140c5450 con 0x7fa5140b4040 2024-04-25T08:52:20.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.877+0000 7fa51c0cd640 1 -- 172.21.15.172:0/627773480 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa514073a00 con 0x7fa5140b4040 2024-04-25T08:52:20.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.878+0000 7fa50a7fc640 1 -- 172.21.15.172:0/627773480 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa50400d8d0 con 0x7fa5140b4040 2024-04-25T08:52:20.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.878+0000 7fa50a7fc640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4f806b4d0 0x7fa4f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:20.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.878+0000 7fa50a7fc640 1 -- 172.21.15.172:0/627773480 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa50408a240 con 0x7fa5140b4040 2024-04-25T08:52:20.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.878+0000 7fa519e69640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4f806b4d0 0x7fa4f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:20.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.878+0000 7fa519e69640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4f806b4d0 0x7fa4f806d990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa510009ac0 tx=0x7fa510008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:20.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:20.882+0000 7fa50a7fc640 1 -- 172.21.15.172:0/627773480 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5140c4c10 con 0x7fa5140b4040 2024-04-25T08:52:21.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.089+0000 7fa51c0cd640 1 -- 172.21.15.172:0/627773480 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fa51406d3a0 con 0x7fa5140b4040 2024-04-25T08:52:21.751 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.761+0000 7fa50a7fc640 1 -- 172.21.15.172:0/627773480 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v87) v1 ==== 121+0+0 (secure 0 0 0) 0x7fa50401a310 con 0x7fa5140b4040 2024-04-25T08:52:21.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.763+0000 7fa51c0cd640 1 -- 172.21.15.172:0/627773480 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4f806b4d0 msgr2=0x7fa4f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:21.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.763+0000 7fa51c0cd640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4f806b4d0 0x7fa4f806d990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa510009ac0 tx=0x7fa510008030 comp rx=0 tx=0).stop 2024-04-25T08:52:21.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.763+0000 7fa51c0cd640 1 -- 172.21.15.172:0/627773480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5140b4040 msgr2=0x7fa514146ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:21.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.763+0000 7fa51c0cd640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5140b4040 0x7fa514146ff0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fa50400f750 tx=0x7fa50400fc10 comp rx=0 tx=0).stop 2024-04-25T08:52:21.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.764+0000 7fa51c0cd640 1 -- 172.21.15.172:0/627773480 shutdown_connections 2024-04-25T08:52:21.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.764+0000 7fa51c0cd640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa4f806b4d0 0x7fa4f806d990 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:21.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.764+0000 7fa51c0cd640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa514154200 0x7fa514154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:21.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.764+0000 7fa51c0cd640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5140b4040 0x7fa514146ff0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:21.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.764+0000 7fa51c0cd640 1 --2- 172.21.15.172:0/627773480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa5000039e0 0x7fa5140c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:21.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.764+0000 7fa51c0cd640 1 -- 172.21.15.172:0/627773480 >> 172.21.15.172:0/627773480 conn(0x7fa51406abe0 msgr2=0x7fa514159530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:21.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.764+0000 7fa51c0cd640 1 -- 172.21.15.172:0/627773480 shutdown_connections 2024-04-25T08:52:21.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.764+0000 7fa51c0cd640 1 -- 172.21.15.172:0/627773480 wait complete. 2024-04-25T08:52:21.769 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:52:21.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.879+0000 7fa6689a5640 1 Processor -- start 2024-04-25T08:52:21.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.879+0000 7fa6689a5640 1 -- start start 2024-04-25T08:52:21.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa6689a5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 0x7fa66415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:21.871 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa6689a5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa6640721d0 0x7fa66406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa6689a5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66406de40 con 0x7fa6640adbc0 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa6689a5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6640ad0e0 con 0x7fa6640721d0 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa6689a5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640ad3c0 con 0x7fa664155fe0 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa66259c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 0x7fa66415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa662d9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa6640721d0 0x7fa66406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa65bfff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fa6640adbc0 0x7fa664071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41196/0 (socket says 172.21.15.172:41196) 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa662d9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa6640721d0 0x7fa66406abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:49376/0 (socket says 172.21.15.172:49376) 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa65bfff640 1 -- 172.21.15.172:0/2400416460 learned_addr learned my addr 172.21.15.172:0/2400416460 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa66259c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 0x7fa66415c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:52684/0 (socket says 172.21.15.172:52684) 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa66259c640 1 -- 172.21.15.172:0/2400416460 >> v2:172.21.15.186:3300/0 conn(0x7fa6640721d0 msgr2=0x7fa66406abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa66259c640 1 --2- 172.21.15.172:0/2400416460 >> v2:172.21.15.186:3300/0 conn(0x7fa6640721d0 0x7fa66406abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa66259c640 1 -- 172.21.15.172:0/2400416460 >> v1:172.21.15.186:6789/0 conn(0x7fa6640adbc0 legacy=0x7fa664071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa661d9b640 1 -- 172.21.15.172:0/2400416460 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948196295 0 0) 0x7fa66406de40 con 0x7fa6640adbc0 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.880+0000 7fa66259c640 1 -- 172.21.15.172:0/2400416460 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6640ad6a0 con 0x7fa664155fe0 2024-04-25T08:52:21.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.881+0000 7fa662d9d640 1 --2- 172.21.15.172:0/2400416460 >> v2:172.21.15.186:3300/0 conn(0x7fa6640721d0 0x7fa66406abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:52:21.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.881+0000 7fa66259c640 1 --2- 172.21.15.172:0/2400416460 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 0x7fa66415c9e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa6540097a0 tx=0x7fa65402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0049d4a9dd5485d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:21.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.881+0000 7fa661d9b640 1 -- 172.21.15.172:0/2400416460 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654037070 con 0x7fa664155fe0 2024-04-25T08:52:21.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.881+0000 7fa661d9b640 1 -- 172.21.15.172:0/2400416460 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654032440 con 0x7fa664155fe0 2024-04-25T08:52:21.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.881+0000 7fa661d9b640 1 -- 172.21.15.172:0/2400416460 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654032810 con 0x7fa664155fe0 2024-04-25T08:52:21.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.882+0000 7fa6689a5640 1 -- 172.21.15.172:0/2400416460 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 msgr2=0x7fa66415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:21.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.882+0000 7fa6689a5640 1 --2- 172.21.15.172:0/2400416460 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 0x7fa66415c9e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa6540097a0 tx=0x7fa65402a180 comp rx=0 tx=0).stop 2024-04-25T08:52:21.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.882+0000 7fa6689a5640 1 -- 172.21.15.172:0/2400416460 shutdown_connections 2024-04-25T08:52:21.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.882+0000 7fa6689a5640 1 --2- 172.21.15.172:0/2400416460 >> v2:172.21.15.186:3300/0 conn(0x7fa6640721d0 0x7fa66406abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:21.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.882+0000 7fa6689a5640 1 --2- 172.21.15.172:0/2400416460 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 0x7fa66415c9e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.882+0000 7fa6689a5640 1 -- 172.21.15.172:0/2400416460 >> 172.21.15.172:0/2400416460 conn(0x7fa6640af670 msgr2=0x7fa6640b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.882+0000 7fa6689a5640 1 -- 172.21.15.172:0/2400416460 shutdown_connections 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.882+0000 7fa6689a5640 1 -- 172.21.15.172:0/2400416460 wait complete. 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.883+0000 7fa6689a5640 1 Processor -- start 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.883+0000 7fa6689a5640 1 -- start start 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa6689a5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6640adbc0 0x7fa6640b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa6689a5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 0x7fa6641f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa6689a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6641f0ba0 0x7fa6641f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa6689a5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66406fa00 con 0x7fa6641f0ba0 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa6689a5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66406f880 con 0x7fa6640adbc0 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa6689a5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640ae020 con 0x7fa664155fe0 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa662d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6641f0ba0 0x7fa6641f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa662d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6641f0ba0 0x7fa6641f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50278/0 (socket says 172.21.15.172:50278) 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa662d9d640 1 -- 172.21.15.172:0/2323763237 learned_addr learned my addr 172.21.15.172:0/2323763237 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:21.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa66259c640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6640adbc0 0x7fa6640b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa65bfff640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 0x7fa6641f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa662d9d640 1 -- 172.21.15.172:0/2323763237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 msgr2=0x7fa6641f0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa662d9d640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 0x7fa6641f0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa662d9d640 1 -- 172.21.15.172:0/2323763237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6640adbc0 msgr2=0x7fa6640b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa662d9d640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6640adbc0 0x7fa6640b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa662d9d640 1 -- 172.21.15.172:0/2323763237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa664157210 con 0x7fa6641f0ba0 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.884+0000 7fa66259c640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6640adbc0 0x7fa6640b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.885+0000 7fa662d9d640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6641f0ba0 0x7fa6641f4790 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009d50 tx=0x7fa65c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.885+0000 7fa65affd640 1 -- 172.21.15.172:0/2323763237 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c018020 con 0x7fa6641f0ba0 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.885+0000 7fa65affd640 1 -- 172.21.15.172:0/2323763237 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c014480 con 0x7fa6641f0ba0 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.885+0000 7fa6689a5640 1 -- 172.21.15.172:0/2323763237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6641f54c0 con 0x7fa6641f0ba0 2024-04-25T08:52:21.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.885+0000 7fa65affd640 1 -- 172.21.15.172:0/2323763237 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c014870 con 0x7fa6641f0ba0 2024-04-25T08:52:21.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.885+0000 7fa6689a5640 1 -- 172.21.15.172:0/2323763237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6641577b0 con 0x7fa6641f0ba0 2024-04-25T08:52:21.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.886+0000 7fa6689a5640 1 -- 172.21.15.172:0/2323763237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6641579b0 con 0x7fa6641f0ba0 2024-04-25T08:52:21.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.886+0000 7fa65affd640 1 -- 172.21.15.172:0/2323763237 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa65c005d10 con 0x7fa6641f0ba0 2024-04-25T08:52:21.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.887+0000 7fa65affd640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa64406b4d0 0x7fa64406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:21.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.887+0000 7fa65affd640 1 -- 172.21.15.172:0/2323763237 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa65c08afe0 con 0x7fa6641f0ba0 2024-04-25T08:52:21.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.887+0000 7fa66259c640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa64406b4d0 0x7fa64406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:21.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.887+0000 7fa66259c640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa64406b4d0 0x7fa64406d990 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa654034000 tx=0x7fa65402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:21.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:21.891+0000 7fa65affd640 1 -- 172.21.15.172:0/2323763237 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa6641579b0 con 0x7fa6641f0ba0 2024-04-25T08:52:22.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.095+0000 7fa6689a5640 1 -- 172.21.15.172:0/2323763237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6640b2ac0 con 0x7fa6641f0ba0 2024-04-25T08:52:22.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.096+0000 7fa65affd640 1 -- 172.21.15.172:0/2323763237 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4955 (secure 0 0 0) 0x7fa65c022030 con 0x7fa6641f0ba0 2024-04-25T08:52:22.086 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:22.087 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":88,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3226910746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3226910746},{"type":"v1","addr":"172.21.15.186:6834","nonce":3226910746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/741856049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":741856049},{"type":"v1","addr":"172.21.15.186:6835","nonce":741856049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":88,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T08:51:58.007519+0000","modified":"2024-04-25T08:52:21.764362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9825},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9819":{"gid":9819,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/406316339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":406316339},{"type":"v1","addr":"172.21.15.172:6835","nonce":406316339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9825":{"gid":9825,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2096375996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2096375996},{"type":"v1","addr":"172.21.15.172:6837","nonce":2096375996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T08:52:22.087 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 88 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 -- 172.21.15.172:0/2323763237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa64406b4d0 msgr2=0x7fa64406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa64406b4d0 0x7fa64406d990 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa654034000 tx=0x7fa65402e000 comp rx=0 tx=0).stop 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 -- 172.21.15.172:0/2323763237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6641f0ba0 msgr2=0x7fa6641f4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6641f0ba0 0x7fa6641f4790 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009d50 tx=0x7fa65c00c490 comp rx=0 tx=0).stop 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 -- 172.21.15.172:0/2323763237 shutdown_connections 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa64406b4d0 0x7fa64406d990 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6641f0ba0 0x7fa6641f4790 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa664155fe0 0x7fa6641f0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 --2- 172.21.15.172:0/2323763237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6640adbc0 0x7fa6640b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 -- 172.21.15.172:0/2323763237 >> 172.21.15.172:0/2323763237 conn(0x7fa6640721d0 msgr2=0x7fa6640b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 -- 172.21.15.172:0/2323763237 shutdown_connections 2024-04-25T08:52:22.089 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.098+0000 7fa6689a5640 1 -- 172.21.15.172:0/2323763237 wait complete. 2024-04-25T08:52:22.502 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-25T08:51:58.007519+0000', 'modified': '2024-04-25T08:52:21.764362+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9825}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9819': {'gid': 9819, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/406316339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 406316339}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 406316339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_9825': {'gid': 9825, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6837/2096375996', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2096375996}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2096375996}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T08:52:22.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T08:52:22.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T08:52:22.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.612+0000 7f978cd6a640 1 Processor -- start 2024-04-25T08:52:22.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.612+0000 7f978cd6a640 1 -- start start 2024-04-25T08:52:22.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.612+0000 7f978cd6a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f97880cf600 0x7f97880cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.612+0000 7f978cd6a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97880cbf20 0x7f97880cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.612+0000 7f978cd6a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97880c75e0 con 0x7f978815bb50 2024-04-25T08:52:22.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.612+0000 7f978cd6a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97880c8680 con 0x7f97880cf600 2024-04-25T08:52:22.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.612+0000 7f978cd6a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97880cff80 con 0x7f97880cbf20 2024-04-25T08:52:22.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.612+0000 7f9785d9b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f97880cf600 0x7f97880cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.604 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.612+0000 7f978659c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f978815bb50 0x7f97880c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41374/0 (socket says 172.21.15.172:41374) 2024-04-25T08:52:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.612+0000 7f978659c640 1 -- 172.21.15.172:0/1638108160 learned_addr learned my addr 172.21.15.172:0/1638108160 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.613+0000 7f9786d9d640 1 --2- 172.21.15.172:0/1638108160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97880cbf20 0x7f97880cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.613+0000 7f9785d9b640 1 -- 172.21.15.172:0/1638108160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97880cbf20 msgr2=0x7f97880cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.613+0000 7f9785d9b640 1 --2- 172.21.15.172:0/1638108160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97880cbf20 0x7f97880cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.613+0000 7f9785d9b640 1 -- 172.21.15.172:0/1638108160 >> v1:172.21.15.172:6789/0 conn(0x7f978815bb50 legacy=0x7f97880c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.613+0000 7f9785d9b640 1 -- 172.21.15.172:0/1638108160 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97880c78c0 con 0x7f97880cf600 2024-04-25T08:52:22.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.613+0000 7f978559a640 1 -- 172.21.15.172:0/1638108160 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551943294 0 0) 0x7f97880c75e0 con 0x7f978815bb50 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.613+0000 7f9785d9b640 1 --2- 172.21.15.172:0/1638108160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 0x7f97880cfa40 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f977c0097a0 tx=0x7f977c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5dbbcb2831dd90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978559a640 1 -- 172.21.15.172:0/1638108160 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c037070 con 0x7f97880cf600 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978559a640 1 -- 172.21.15.172:0/1638108160 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c032440 con 0x7f97880cf600 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978559a640 1 -- 172.21.15.172:0/1638108160 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c032810 con 0x7f97880cf600 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978cd6a640 1 -- 172.21.15.172:0/1638108160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 msgr2=0x7f97880cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978cd6a640 1 --2- 172.21.15.172:0/1638108160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 0x7f97880cfa40 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f977c0097a0 tx=0x7f977c02a210 comp rx=0 tx=0).stop 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978cd6a640 1 -- 172.21.15.172:0/1638108160 shutdown_connections 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978cd6a640 1 --2- 172.21.15.172:0/1638108160 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97880cbf20 0x7f97880cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978cd6a640 1 --2- 172.21.15.172:0/1638108160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 0x7f97880cfa40 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978cd6a640 1 -- 172.21.15.172:0/1638108160 >> 172.21.15.172:0/1638108160 conn(0x7f978806f500 msgr2=0x7f978806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978cd6a640 1 -- 172.21.15.172:0/1638108160 shutdown_connections 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.614+0000 7f978cd6a640 1 -- 172.21.15.172:0/1638108160 wait complete. 2024-04-25T08:52:22.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f978cd6a640 1 Processor -- start 2024-04-25T08:52:22.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f978cd6a640 1 -- start start 2024-04-25T08:52:22.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f978cd6a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97880cbf20 0x7f97880b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f978cd6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 0x7f9788147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f978cd6a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978815bb50 0x7f97880cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f978cd6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880c8160 con 0x7f97880cf600 2024-04-25T08:52:22.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f978cd6a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880c7e80 con 0x7f978815bb50 2024-04-25T08:52:22.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f978cd6a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97880c72a0 con 0x7f97880cbf20 2024-04-25T08:52:22.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f9785d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 0x7f9788147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f9785d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 0x7f9788147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50304/0 (socket says 172.21.15.172:50304) 2024-04-25T08:52:22.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.616+0000 7f9785d9b640 1 -- 172.21.15.172:0/3207226259 learned_addr learned my addr 172.21.15.172:0/3207226259 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:22.611 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f978659c640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97880cbf20 0x7f97880b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9786d9d640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978815bb50 0x7f97880cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9785d9b640 1 -- 172.21.15.172:0/3207226259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97880cbf20 msgr2=0x7f97880b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9785d9b640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97880cbf20 0x7f97880b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9785d9b640 1 -- 172.21.15.172:0/3207226259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978815bb50 msgr2=0x7f97880cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9785d9b640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978815bb50 0x7f97880cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9785d9b640 1 -- 172.21.15.172:0/3207226259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9788147870 con 0x7f97880cf600 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9786d9d640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978815bb50 0x7f97880cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9785d9b640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 0x7f9788147330 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f977c0098c0 tx=0x7f977c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9776ffd640 1 -- 172.21.15.172:0/3207226259 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c037040 con 0x7f97880cf600 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9776ffd640 1 -- 172.21.15.172:0/3207226259 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c030500 con 0x7f97880cf600 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f978cd6a640 1 -- 172.21.15.172:0/3207226259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97880b5c40 con 0x7f97880cf600 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f9776ffd640 1 -- 172.21.15.172:0/3207226259 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c0308d0 con 0x7f97880cf600 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.617+0000 7f978cd6a640 1 -- 172.21.15.172:0/3207226259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97880b61c0 con 0x7f97880cf600 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.618+0000 7f9776ffd640 1 -- 172.21.15.172:0/3207226259 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f977c044020 con 0x7f97880cf600 2024-04-25T08:52:22.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.619+0000 7f9776ffd640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f976806b4d0 0x7f976806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.619+0000 7f9776ffd640 1 -- 172.21.15.172:0/3207226259 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f977c0aa5f0 con 0x7f97880cf600 2024-04-25T08:52:22.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.619+0000 7f978659c640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f976806b4d0 0x7f976806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.619+0000 7f978659c640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f976806b4d0 0x7f976806d990 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f97800012e0 tx=0x7f9780001630 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:22.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.620+0000 7f978fa72740 1 Processor -- start 2024-04-25T08:52:22.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.620+0000 7f978fa72740 1 -- start start 2024-04-25T08:52:22.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978fa72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7493e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978fa72740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e7495bad0 0x564e7495c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978fa72740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e74913f10 0x564e7495a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978fa72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e74876a10 con 0x564e7493e230 2024-04-25T08:52:22.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978fa72740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7481fb30 con 0x564e74913f10 2024-04-25T08:52:22.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978fa72740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e74872c50 con 0x564e7495bad0 2024-04-25T08:52:22.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7493e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7493e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50316/0 (socket says 172.21.15.172:50316) 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978659c640 1 -- 172.21.15.172:0/2905464292 learned_addr learned my addr 172.21.15.172:0/2905464292 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978659c640 1 -- 172.21.15.172:0/2905464292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e7495bad0 msgr2=0x564e7495c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978659c640 1 --2- 172.21.15.172:0/2905464292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e7495bad0 0x564e7495c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978659c640 1 -- 172.21.15.172:0/2905464292 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e74913f10 msgr2=0x564e7495a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978659c640 1 --2- 172.21.15.172:0/2905464292 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e74913f10 0x564e7495a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978659c640 1 -- 172.21.15.172:0/2905464292 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e74834e10 con 0x564e7493e230 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f978659c640 1 --2- 172.21.15.172:0/2905464292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7493e610 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f9780007850 tx=0x7f9780013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c010788af2750d08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.621+0000 7f9767fff640 1 -- 172.21.15.172:0/2905464292 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780026070 con 0x564e7493e230 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f9767fff640 1 -- 172.21.15.172:0/2905464292 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780012350 con 0x564e7493e230 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f9767fff640 1 -- 172.21.15.172:0/2905464292 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780012700 con 0x564e7493e230 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f978fa72740 1 -- 172.21.15.172:0/2905464292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 msgr2=0x564e7493e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f978fa72740 1 --2- 172.21.15.172:0/2905464292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7493e610 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f9780007850 tx=0x7f9780013000 comp rx=0 tx=0).stop 2024-04-25T08:52:22.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f978fa72740 1 -- 172.21.15.172:0/2905464292 shutdown_connections 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f978fa72740 1 --2- 172.21.15.172:0/2905464292 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e74913f10 0x564e7495a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f978fa72740 1 --2- 172.21.15.172:0/2905464292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e7495bad0 0x564e7495c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f978fa72740 1 --2- 172.21.15.172:0/2905464292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7493e610 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f978fa72740 1 -- 172.21.15.172:0/2905464292 >> 172.21.15.172:0/2905464292 conn(0x564e74910840 msgr2=0x564e74959040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f978fa72740 1 -- 172.21.15.172:0/2905464292 shutdown_connections 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.622+0000 7f978fa72740 1 -- 172.21.15.172:0/2905464292 wait complete. 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.623+0000 7f978fa72740 1 -- start start 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.623+0000 7f978fa72740 1 Processor -- start 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f978fa72740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7493e230 0x564e74969090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f978fa72740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e7495bad0 0x564e74941a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f978fa72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e749525b0 0x564e74952a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f978fa72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e74914cb0 con 0x564e749525b0 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f978fa72740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e748330c0 con 0x564e7493e230 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f978fa72740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e7490e770 con 0x564e7495bad0 2024-04-25T08:52:22.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f978fa72740 10 client.0 _ll_register_callbacks cb 0x564e74826ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f9786d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e749525b0 0x564e74952a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f9786d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e749525b0 0x564e74952a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50324/0 (socket says 172.21.15.172:50324) 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f9786d9d640 1 -- 172.21.15.172:0/2038374662 learned_addr learned my addr 172.21.15.172:0/2038374662 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f978659c640 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7493e230 0x564e74969090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f9785d9b640 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e7495bad0 0x564e74941a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f9786d9d640 1 -- 172.21.15.172:0/2038374662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e7495bad0 msgr2=0x564e74941a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f9786d9d640 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e7495bad0 0x564e74941a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f9786d9d640 1 -- 172.21.15.172:0/2038374662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7493e230 msgr2=0x564e74969090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f9786d9d640 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7493e230 0x564e74969090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f9786d9d640 1 -- 172.21.15.172:0/2038374662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e7458b2d0 con 0x564e749525b0 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f978659c640 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7493e230 0x564e74969090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f9786d9d640 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e749525b0 0x564e74952a30 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f9778011290 tx=0x7f9778011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52dc728ec25d3d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:22.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.624+0000 7f97657fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f97657fa640 1 -- 172.21.15.172:0/2038374662 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778019070 con 0x564e749525b0 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f97657fa640 1 -- 172.21.15.172:0/2038374662 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9778015870 con 0x564e749525b0 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978fa72740 1 -- 172.21.15.172:0/2038374662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9780012350 con 0x564e749525b0 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f97657fa640 1 -- 172.21.15.172:0/2038374662 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9778024050 con 0x564e749525b0 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978fa72740 10 client.10047 fetch_fsmap learned FSMap version 88 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978fa72740 1 -- 172.21.15.172:0/2038374662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x564e746556b0 con 0x564e749525b0 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f97657fa640 1 -- 172.21.15.172:0/2038374662 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780012350 con 0x564e749525b0 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f97657fa640 1 -- 172.21.15.172:0/2038374662 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 88) v1 ==== 3282+0+0 (secure 0 0 0) 0x7f9778027020 con 0x564e749525b0 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978fa72740 10 client.10047 fetch_fsmap finished waiting for FSMap version 88 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978fa72740 10 client.10047 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978fa72740 20 client.10047 populate_metadata read hostname 'smithi172' 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978fa72740 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x564e74950ad0 0x564e74950eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978fa72740 4 client.10047 mds_command: new command op to 9825 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978fa72740 1 -- 172.21.15.172:0/2038374662 --> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e748d5920 con 0x564e74950ad0 2024-04-25T08:52:22.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978659c640 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x564e74950ad0 0x564e74950eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f97657fa640 10 client.10047 ms_handle_connect on v2:172.21.15.172:6836/2096375996 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.625+0000 7f978659c640 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x564e74950ad0 0x564e74950eb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeab10f30721ff99 server_cookie=268ef93c4ede6a31 in_seq=0 out_seq=0 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f97657fa640 1 -- 172.21.15.172:0/2038374662 <== mds.0 v2:172.21.15.172:6836/2096375996 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564e748d5920 con 0x564e74950ad0 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f97657fa640 10 client.10047 handle_command_reply: tid=0 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 client.10047 shutdown 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 -- 172.21.15.172:0/2038374662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e749525b0 msgr2=0x564e74952a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e749525b0 0x564e74952a30 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f9778011290 tx=0x7f9778011750 comp rx=0 tx=0).stop 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 -- 172.21.15.172:0/2038374662 shutdown_connections 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x564e74950ad0 0x564e74950eb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e749525b0 0x564e74952a30 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e7495bad0 0x564e74941a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f97657fa640 0 client.10047 ms_handle_reset on v2:172.21.15.172:6836/2096375996 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 --2- 172.21.15.172:0/2038374662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7493e230 0x564e74969090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 -- 172.21.15.172:0/2038374662 >> 172.21.15.172:0/2038374662 conn(0x564e74913f10 msgr2=0x564e7495c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:22.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 -- 172.21.15.172:0/2038374662 shutdown_connections 2024-04-25T08:52:22.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 1 -- 172.21.15.172:0/2038374662 wait complete. 2024-04-25T08:52:22.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.626+0000 7f978fa72740 20 client.10047 trim_cache size 0 max 16384 2024-04-25T08:52:22.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.642+0000 7f978fa72740 1 Processor -- start 2024-04-25T08:52:22.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.642+0000 7f978fa72740 1 -- start start 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7495c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e749525b0 0x564e7492ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7495bad0 0x564e7492e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97881fdb70 con 0x564e7493e230 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97881fe1d0 con 0x564e7495bad0 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97880b4e30 con 0x564e749525b0 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7495c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7495c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50326/0 (socket says 172.21.15.172:50326) 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978659c640 1 -- 172.21.15.172:0/4226002977 learned_addr learned my addr 172.21.15.172:0/4226002977 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978659c640 1 -- 172.21.15.172:0/4226002977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e749525b0 msgr2=0x564e7492ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978659c640 1 --2- 172.21.15.172:0/4226002977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e749525b0 0x564e7492ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978659c640 1 -- 172.21.15.172:0/4226002977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7495bad0 msgr2=0x564e7492e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:22.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978659c640 1 --2- 172.21.15.172:0/4226002977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7495bad0 0x564e7492e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978659c640 1 -- 172.21.15.172:0/4226002977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e74872dd0 con 0x564e7493e230 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978659c640 1 --2- 172.21.15.172:0/4226002977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7495c6c0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f9780004ef0 tx=0x7f9780014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed9ff2098952808 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f97677fe640 1 -- 172.21.15.172:0/4226002977 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780026040 con 0x564e7493e230 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f97677fe640 1 -- 172.21.15.172:0/4226002977 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780027040 con 0x564e7493e230 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f97677fe640 1 -- 172.21.15.172:0/4226002977 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780012680 con 0x564e7493e230 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 -- 172.21.15.172:0/4226002977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 msgr2=0x564e7495c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 --2- 172.21.15.172:0/4226002977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7495c6c0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f9780004ef0 tx=0x7f9780014000 comp rx=0 tx=0).stop 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 -- 172.21.15.172:0/4226002977 shutdown_connections 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 --2- 172.21.15.172:0/4226002977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7495bad0 0x564e7492e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 --2- 172.21.15.172:0/4226002977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e749525b0 0x564e7492ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 --2- 172.21.15.172:0/4226002977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7495c6c0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 -- 172.21.15.172:0/4226002977 >> 172.21.15.172:0/4226002977 conn(0x564e74913f10 msgr2=0x564e74950eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 -- 172.21.15.172:0/4226002977 shutdown_connections 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 -- 172.21.15.172:0/4226002977 wait complete. 2024-04-25T08:52:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 -- start start 2024-04-25T08:52:22.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.644+0000 7f978fa72740 1 Processor -- start 2024-04-25T08:52:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.645+0000 7f978fa72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7492e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.645+0000 7f978fa72740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e749525b0 0x564e74959fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.645+0000 7f978fa72740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7495bad0 0x564e74911de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.645+0000 7f978fa72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e749404a0 con 0x564e7493e230 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.645+0000 7f978fa72740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97881fcf10 con 0x564e7495bad0 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.645+0000 7f978fa72740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e74951650 con 0x564e749525b0 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.645+0000 7f978fa72740 10 client.0 _ll_register_callbacks cb 0x564e7490ec50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.645+0000 7f978659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7492e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.645+0000 7f978659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7492e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50342/0 (socket says 172.21.15.172:50342) 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.645+0000 7f978659c640 1 -- 172.21.15.172:0/1645914422 learned_addr learned my addr 172.21.15.172:0/1645914422 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f9785d9b640 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e749525b0 0x564e74959fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f9786d9d640 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7495bad0 0x564e74911de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978659c640 1 -- 172.21.15.172:0/1645914422 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e749525b0 msgr2=0x564e74959fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978659c640 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e749525b0 0x564e74959fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978659c640 1 -- 172.21.15.172:0/1645914422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7495bad0 msgr2=0x564e74911de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978659c640 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7495bad0 0x564e74911de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978659c640 1 -- 172.21.15.172:0/1645914422 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e749423e0 con 0x564e7493e230 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f9786d9d640 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7495bad0 0x564e74911de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978659c640 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7492e870 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f9780007430 tx=0x7f9780001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c62bf669c9364f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f97657fa640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f97657fa640 1 -- 172.21.15.172:0/1645914422 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978003e060 con 0x564e7493e230 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f97657fa640 1 -- 172.21.15.172:0/1645914422 <== mon.0 v2:172.21.15.172:3300/0 2 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9780012680 con 0x564e7493e230 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978fa72740 1 -- 172.21.15.172:0/1645914422 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9780027040 con 0x564e7493e230 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f97657fa640 1 -- 172.21.15.172:0/1645914422 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9780044050 con 0x564e7493e230 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978fa72740 10 client.10053 fetch_fsmap learned FSMap version 88 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978fa72740 1 -- 172.21.15.172:0/1645914422 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) v3 -- 0x564e74958f50 con 0x564e7493e230 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f97657fa640 1 -- 172.21.15.172:0/1645914422 <== mon.0 v2:172.21.15.172:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780027040 con 0x564e7493e230 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f97657fa640 1 -- 172.21.15.172:0/1645914422 <== mon.0 v2:172.21.15.172:3300/0 5 ==== fsmap(e 88) v1 ==== 3282+0+0 (secure 0 0 0) 0x7f9780047020 con 0x564e7493e230 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978fa72740 10 client.10053 fetch_fsmap finished waiting for FSMap version 88 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978fa72740 10 client.10053 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978fa72740 20 client.10053 populate_metadata read hostname 'smithi172' 2024-04-25T08:52:22.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978fa72740 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x564e749c7c00 0x564e74912320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978fa72740 4 client.10053 mds_command: new command op to 9825 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.646+0000 7f978fa72740 1 -- 172.21.15.172:0/1645914422 --> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564e74883f50 con 0x564e749c7c00 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f9785d9b640 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x564e749c7c00 0x564e74912320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f97657fa640 10 client.10053 ms_handle_connect on v2:172.21.15.172:6836/2096375996 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f9785d9b640 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x564e749c7c00 0x564e74912320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=144d79ce83ba37ab server_cookie=a663d017ac58e528 in_seq=0 out_seq=0 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f97657fa640 1 -- 172.21.15.172:0/1645914422 <== mds.0 v2:172.21.15.172:6836/2096375996 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x564e74883f50 con 0x564e749c7c00 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f97657fa640 10 client.10053 handle_command_reply: tid=0 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 client.10053 shutdown 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 -- 172.21.15.172:0/1645914422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 msgr2=0x564e7492e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7492e870 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f9780007430 tx=0x7f9780001250 comp rx=0 tx=0).stop 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 -- 172.21.15.172:0/1645914422 shutdown_connections 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.172:6836/2096375996,v1:172.21.15.172:6837/2096375996] conn(0x564e749c7c00 0x564e74912320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564e7495bad0 0x564e74911de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f97657fa640 0 client.10053 ms_handle_reset on v2:172.21.15.172:6836/2096375996 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x564e749525b0 0x564e74959fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 --2- 172.21.15.172:0/1645914422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e7493e230 0x564e7492e870 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 -- 172.21.15.172:0/1645914422 >> 172.21.15.172:0/1645914422 conn(0x564e74913f10 msgr2=0x564e74950eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 -- 172.21.15.172:0/1645914422 shutdown_connections 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.647+0000 7f978fa72740 1 -- 172.21.15.172:0/1645914422 wait complete. 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978fa72740 20 client.10053 trim_cache size 0 max 16384 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "cluster_fsid": "fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2", 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "whoami": 0, 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "id": 9825, 2024-04-25T08:52:22.645 INFO:teuthology.orchestra.run.smithi172.stdout: "want_state": "up:active", 2024-04-25T08:52:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "state": "up:active", 2024-04-25T08:52:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "fs_name": "cephfs", 2024-04-25T08:52:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "rank_uptime": 23.967178915000002, 2024-04-25T08:52:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "mdsmap_epoch": 88, 2024-04-25T08:52:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch": 145, 2024-04-25T08:52:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_epoch_barrier": 145, 2024-04-25T08:52:22.646 INFO:teuthology.orchestra.run.smithi172.stdout: "uptime": 29.027937783999999 2024-04-25T08:52:22.646 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:52:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 -- 172.21.15.172:0/3207226259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f976806b4d0 msgr2=0x7f976806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f976806b4d0 0x7f976806d990 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f97800012e0 tx=0x7f9780001630 comp rx=0 tx=0).stop 2024-04-25T08:52:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 -- 172.21.15.172:0/3207226259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 msgr2=0x7f9788147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 0x7f9788147330 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f977c0098c0 tx=0x7f977c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 -- 172.21.15.172:0/3207226259 shutdown_connections 2024-04-25T08:52:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f976806b4d0 0x7f976806d990 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f978815bb50 0x7f97880cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97880cf600 0x7f9788147330 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 --2- 172.21.15.172:0/3207226259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97880cbf20 0x7f97880b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 -- 172.21.15.172:0/3207226259 >> 172.21.15.172:0/3207226259 conn(0x7f978806f500 msgr2=0x7f97880b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:22.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 -- 172.21.15.172:0/3207226259 shutdown_connections 2024-04-25T08:52:22.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.648+0000 7f978cd6a640 1 -- 172.21.15.172:0/3207226259 wait complete. 2024-04-25T08:52:22.650 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T08:52:22.650 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:52:22.689 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T08:52:22.730 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T08:52:22.730 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:52:22.730 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:52:22.745 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:52:22.745 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:52:22.803 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:52:22.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.949+0000 7f10e7977640 1 Processor -- start 2024-04-25T08:52:22.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.950+0000 7f10e7977640 1 -- start start 2024-04-25T08:52:22.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.950+0000 7f10e7977640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e00b2cb0 0x7f10e00d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.950+0000 7f10e7977640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f10e00d1020 0x7f10e00d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.950+0000 7f10e7977640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e00b97a0 con 0x7f10e015dbe0 2024-04-25T08:52:22.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.950+0000 7f10e7977640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e015dfc0 con 0x7f10e00d1020 2024-04-25T08:52:22.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.950+0000 7f10e7977640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00d1a00 con 0x7f10e00b2cb0 2024-04-25T08:52:22.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.951+0000 7f10e5713640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f10e015dbe0 0x7f10e00d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41390/0 (socket says 172.21.15.172:41390) 2024-04-25T08:52:22.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.951+0000 7f10e5713640 1 -- 172.21.15.172:0/1563288278 learned_addr learned my addr 172.21.15.172:0/1563288278 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:22.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.951+0000 7f10e5f14640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f10e00d1020 0x7f10e00d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.951+0000 7f10e4f12640 1 --2- 172.21.15.172:0/1563288278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e00b2cb0 0x7f10e00d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.951+0000 7f10e5f14640 1 -- 172.21.15.172:0/1563288278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e00b2cb0 msgr2=0x7f10e00d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:22.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.951+0000 7f10e5f14640 1 --2- 172.21.15.172:0/1563288278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e00b2cb0 0x7f10e00d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.951+0000 7f10e5f14640 1 -- 172.21.15.172:0/1563288278 >> v1:172.21.15.172:6789/0 conn(0x7f10e015dbe0 legacy=0x7f10e00d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.951+0000 7f10e5f14640 1 -- 172.21.15.172:0/1563288278 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00d1c50 con 0x7f10e00d1020 2024-04-25T08:52:22.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.951+0000 7f10d7fff640 1 -- 172.21.15.172:0/1563288278 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629391295 0 0) 0x7f10e00b97a0 con 0x7f10e015dbe0 2024-04-25T08:52:22.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.951+0000 7f10e4f12640 1 --2- 172.21.15.172:0/1563288278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e00b2cb0 0x7f10e00d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10e5f14640 1 --2- 172.21.15.172:0/1563288278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00d1020 0x7f10e00d2c70 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009d90 tx=0x7f10dc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b59ac3c2b0fd13b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10d7fff640 1 -- 172.21.15.172:0/1563288278 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc007740 con 0x7f10e00d1020 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10d7fff640 1 -- 172.21.15.172:0/1563288278 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc0078e0 con 0x7f10e00d1020 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10d7fff640 1 -- 172.21.15.172:0/1563288278 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc007cb0 con 0x7f10e00d1020 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10e7977640 1 -- 172.21.15.172:0/1563288278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00d1020 msgr2=0x7f10e00d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10e7977640 1 --2- 172.21.15.172:0/1563288278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00d1020 0x7f10e00d2c70 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009d90 tx=0x7f10dc02a660 comp rx=0 tx=0).stop 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10e7977640 1 -- 172.21.15.172:0/1563288278 shutdown_connections 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10e7977640 1 --2- 172.21.15.172:0/1563288278 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e00b2cb0 0x7f10e00d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10e7977640 1 --2- 172.21.15.172:0/1563288278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00d1020 0x7f10e00d2c70 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10e7977640 1 -- 172.21.15.172:0/1563288278 >> 172.21.15.172:0/1563288278 conn(0x7f10e0061a20 msgr2=0x7f10e0061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10e7977640 1 -- 172.21.15.172:0/1563288278 shutdown_connections 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.952+0000 7f10e7977640 1 -- 172.21.15.172:0/1563288278 wait complete. 2024-04-25T08:52:22.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e7977640 1 Processor -- start 2024-04-25T08:52:22.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e7977640 1 -- start start 2024-04-25T08:52:22.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e7977640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00b2cb0 0x7f10e014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e7977640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10e00d1020 0x7f10e00b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e7977640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e015dbe0 0x7f10e00b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e7977640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00b92a0 con 0x7f10e00b2cb0 2024-04-25T08:52:22.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e7977640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00d2210 con 0x7f10e00d1020 2024-04-25T08:52:22.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e7977640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00b9420 con 0x7f10e015dbe0 2024-04-25T08:52:22.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e5713640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00b2cb0 0x7f10e014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e5713640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00b2cb0 0x7f10e014bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50350/0 (socket says 172.21.15.172:50350) 2024-04-25T08:52:22.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.954+0000 7f10e5713640 1 -- 172.21.15.172:0/3634984202 learned_addr learned my addr 172.21.15.172:0/3634984202 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:22.947 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10e5f14640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e015dbe0 0x7f10e00b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10e5713640 1 -- 172.21.15.172:0/3634984202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e015dbe0 msgr2=0x7f10e00b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10e5713640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e015dbe0 0x7f10e00b5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10e5713640 1 -- 172.21.15.172:0/3634984202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10e00d1020 msgr2=0x7f10e00b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10e4f12640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10e00d1020 0x7f10e00b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10e5713640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10e00d1020 0x7f10e00b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10e5713640 1 -- 172.21.15.172:0/3634984202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e0155aa0 con 0x7f10e00b2cb0 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10e5713640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00b2cb0 0x7f10e014bb70 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c430 tx=0x7f10d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10d5ffb640 1 -- 172.21.15.172:0/3634984202 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80074e0 con 0x7f10e00b2cb0 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10d5ffb640 1 -- 172.21.15.172:0/3634984202 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d80047e0 con 0x7f10e00b2cb0 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10d5ffb640 1 -- 172.21.15.172:0/3634984202 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8004bd0 con 0x7f10e00b2cb0 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10e7977640 1 -- 172.21.15.172:0/3634984202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e0155d80 con 0x7f10e00b2cb0 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.955+0000 7f10e7977640 1 -- 172.21.15.172:0/3634984202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e0156340 con 0x7f10e00b2cb0 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.956+0000 7f10e7977640 1 -- 172.21.15.172:0/3634984202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e0073990 con 0x7f10e00b2cb0 2024-04-25T08:52:22.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.956+0000 7f10d5ffb640 1 -- 172.21.15.172:0/3634984202 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f10d8011070 con 0x7f10e00b2cb0 2024-04-25T08:52:22.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.957+0000 7f10d5ffb640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10c406b500 0x7f10c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:22.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.957+0000 7f10d5ffb640 1 -- 172.21.15.172:0/3634984202 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f10d808a030 con 0x7f10e00b2cb0 2024-04-25T08:52:22.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.957+0000 7f10e4f12640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10c406b500 0x7f10c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:22.949 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.957+0000 7f10e4f12640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10c406b500 0x7f10c406d9c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f10d0006fd0 tx=0x7f10d0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:22.951 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:22.961+0000 7f10d5ffb640 1 -- 172.21.15.172:0/3634984202 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10d8058cf0 con 0x7f10e00b2cb0 2024-04-25T08:52:23.121 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.130+0000 7f10e7977640 1 -- 172.21.15.172:0/3634984202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10e0061ea0 con 0x7f10e00b2cb0 2024-04-25T08:52:23.122 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.131+0000 7f10d5ffb640 1 -- 172.21.15.172:0/3634984202 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17110 (secure 0 0 0) 0x7f10d80585f0 con 0x7f10e00b2cb0 2024-04-25T08:52:23.123 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:23.123 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":145,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:52:10.728530+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:51:56.275448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T08:51:56.984469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.12","mappings":[{"from":3,"to":0}]},{"pgid":"22.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:52:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.133+0000 7f10e7977640 1 -- 172.21.15.172:0/3634984202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10c406b500 msgr2=0x7f10c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.133+0000 7f10e7977640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10c406b500 0x7f10c406d9c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f10d0006fd0 tx=0x7f10d0008040 comp rx=0 tx=0).stop 2024-04-25T08:52:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.133+0000 7f10e7977640 1 -- 172.21.15.172:0/3634984202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00b2cb0 msgr2=0x7f10e014bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.133+0000 7f10e7977640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00b2cb0 0x7f10e014bb70 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c430 tx=0x7f10d800c8f0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.133+0000 7f10e7977640 1 -- 172.21.15.172:0/3634984202 shutdown_connections 2024-04-25T08:52:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.133+0000 7f10e7977640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f10c406b500 0x7f10c406d9c0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.133+0000 7f10e7977640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10e00d1020 0x7f10e00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.124 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.133+0000 7f10e7977640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10e015dbe0 0x7f10e00b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.133+0000 7f10e7977640 1 --2- 172.21.15.172:0/3634984202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10e00b2cb0 0x7f10e014bb70 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.133+0000 7f10e7977640 1 -- 172.21.15.172:0/3634984202 >> 172.21.15.172:0/3634984202 conn(0x7f10e0061a20 msgr2=0x7f10e015c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.134+0000 7f10e7977640 1 -- 172.21.15.172:0/3634984202 shutdown_connections 2024-04-25T08:52:23.125 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.134+0000 7f10e7977640 1 -- 172.21.15.172:0/3634984202 wait complete. 2024-04-25T08:52:23.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:51:56.275448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:51:56.984469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:52:23.135 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:52:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.244+0000 7fb8b079e640 1 Processor -- start 2024-04-25T08:52:23.235 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.244+0000 7fb8b079e640 1 -- start start 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.245+0000 7fb8b079e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8a80cc4f0 0x7fb8a80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.245+0000 7fb8b079e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb8a815b980 0x7fb8a80cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.245+0000 7fb8b079e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a8072280 con 0x7fb8a80cdb20 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.245+0000 7fb8b079e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a8071270 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.245+0000 7fb8b079e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a815bd80 con 0x7fb8a815b980 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.246+0000 7fb8ae53a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8a80cc4f0 0x7fb8a80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.246+0000 7fb8ae53a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8a80cc4f0 0x7fb8a80cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50358/0 (socket says 172.21.15.172:50358) 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.246+0000 7fb8add39640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb8a80cdb20 0x7fb8a815b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41400/0 (socket says 172.21.15.172:41400) 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.246+0000 7fb8ae53a640 1 -- 172.21.15.172:0/3032861041 learned_addr learned my addr 172.21.15.172:0/3032861041 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.246+0000 7fb8aed3b640 1 --2- 172.21.15.172:0/3032861041 >> v2:172.21.15.186:3300/0 conn(0x7fb8a815b980 0x7fb8a80cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.246+0000 7fb8ae53a640 1 -- 172.21.15.172:0/3032861041 >> v2:172.21.15.186:3300/0 conn(0x7fb8a815b980 msgr2=0x7fb8a80cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:23.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.246+0000 7fb8ae53a640 1 --2- 172.21.15.172:0/3032861041 >> v2:172.21.15.186:3300/0 conn(0x7fb8a815b980 0x7fb8a80cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.246+0000 7fb8ae53a640 1 -- 172.21.15.172:0/3032861041 >> v1:172.21.15.172:6789/0 conn(0x7fb8a80cdb20 legacy=0x7fb8a815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.246+0000 7fb8ad538640 1 -- 172.21.15.172:0/3032861041 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463182483 0 0) 0x7fb8a8072280 con 0x7fb8a80cdb20 2024-04-25T08:52:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.246+0000 7fb8ae53a640 1 -- 172.21.15.172:0/3032861041 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80714c0 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8ae53a640 1 --2- 172.21.15.172:0/3032861041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 0x7fb8a80cc8d0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80b4c00 tx=0x7fb8a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1006153dbea0ee5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8ad538640 1 -- 172.21.15.172:0/3032861041 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4037070 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8ad538640 1 -- 172.21.15.172:0/3032861041 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4032440 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8ad538640 1 -- 172.21.15.172:0/3032861041 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4032810 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8b079e640 1 -- 172.21.15.172:0/3032861041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 msgr2=0x7fb8a80cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8b079e640 1 --2- 172.21.15.172:0/3032861041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 0x7fb8a80cc8d0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80b4c00 tx=0x7fb8a402a270 comp rx=0 tx=0).stop 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8b079e640 1 -- 172.21.15.172:0/3032861041 shutdown_connections 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8b079e640 1 --2- 172.21.15.172:0/3032861041 >> v2:172.21.15.186:3300/0 conn(0x7fb8a815b980 0x7fb8a80cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8b079e640 1 --2- 172.21.15.172:0/3032861041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 0x7fb8a80cc8d0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8b079e640 1 -- 172.21.15.172:0/3032861041 >> 172.21.15.172:0/3032861041 conn(0x7fb8a806abe0 msgr2=0x7fb8a806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8b079e640 1 -- 172.21.15.172:0/3032861041 shutdown_connections 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.247+0000 7fb8b079e640 1 -- 172.21.15.172:0/3032861041 wait complete. 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.248+0000 7fb8b079e640 1 Processor -- start 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8b079e640 1 -- start start 2024-04-25T08:52:23.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8b079e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 0x7fb8a813eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8b079e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8a80cdb20 0x7fb8a81f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8b079e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8a815b980 0x7fb8a81f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8b079e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8071d60 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8b079e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8071a80 con 0x7fb8a80cdb20 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8b079e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a80ae500 con 0x7fb8a815b980 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8ae53a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 0x7fb8a813eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8ae53a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 0x7fb8a813eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50362/0 (socket says 172.21.15.172:50362) 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8ae53a640 1 -- 172.21.15.172:0/3320779026 learned_addr learned my addr 172.21.15.172:0/3320779026 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8add39640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8a80cdb20 0x7fb8a81f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.249+0000 7fb8aed3b640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8a815b980 0x7fb8a81f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb8ae53a640 1 -- 172.21.15.172:0/3320779026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8a815b980 msgr2=0x7fb8a81f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb8ae53a640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8a815b980 0x7fb8a81f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb8ae53a640 1 -- 172.21.15.172:0/3320779026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8a80cdb20 msgr2=0x7fb8a81f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb8ae53a640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8a80cdb20 0x7fb8a81f17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb8ae53a640 1 -- 172.21.15.172:0/3320779026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a813eff0 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb8ae53a640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 0x7fb8a813eab0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fb8a402a2b0 tx=0x7fb8a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb89effd640 1 -- 172.21.15.172:0/3320779026 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4041020 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb89effd640 1 -- 172.21.15.172:0/3320779026 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a40306c0 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb8b079e640 1 -- 172.21.15.172:0/3320779026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a80b06c0 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb89effd640 1 -- 172.21.15.172:0/3320779026 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4037040 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.250+0000 7fb8b079e640 1 -- 172.21.15.172:0/3320779026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a81f25b0 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.251+0000 7fb8b079e640 1 -- 172.21.15.172:0/3320779026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a80cce90 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.251+0000 7fb89effd640 1 -- 172.21.15.172:0/3320779026 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb8a4044020 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.252+0000 7fb89effd640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb88c06b4d0 0x7fb88c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.252+0000 7fb89effd640 1 -- 172.21.15.172:0/3320779026 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb8a40aab80 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.252+0000 7fb8add39640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb88c06b4d0 0x7fb88c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.252+0000 7fb8add39640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb88c06b4d0 0x7fb88c06d990 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb8a814e470 tx=0x7fb898007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:23.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.256+0000 7fb89effd640 1 -- 172.21.15.172:0/3320779026 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8a404b030 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.426+0000 7fb8b079e640 1 -- 172.21.15.172:0/3320779026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8a8073a00 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.418 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.426+0000 7fb89effd640 1 -- 172.21.15.172:0/3320779026 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8a40798d0 con 0x7fb8a80cc4f0 2024-04-25T08:52:23.418 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:52:23.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 -- 172.21.15.172:0/3320779026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb88c06b4d0 msgr2=0x7fb88c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb88c06b4d0 0x7fb88c06d990 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb8a814e470 tx=0x7fb898007b50 comp rx=0 tx=0).stop 2024-04-25T08:52:23.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 -- 172.21.15.172:0/3320779026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 msgr2=0x7fb8a813eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 0x7fb8a813eab0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fb8a402a2b0 tx=0x7fb8a40046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 -- 172.21.15.172:0/3320779026 shutdown_connections 2024-04-25T08:52:23.420 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb88c06b4d0 0x7fb88c06d990 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8a80cdb20 0x7fb8a81f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8a815b980 0x7fb8a81f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 --2- 172.21.15.172:0/3320779026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a80cc4f0 0x7fb8a813eab0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 -- 172.21.15.172:0/3320779026 >> 172.21.15.172:0/3320779026 conn(0x7fb8a806abe0 msgr2=0x7fb8a80cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:23.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 -- 172.21.15.172:0/3320779026 shutdown_connections 2024-04-25T08:52:23.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.428+0000 7fb8b079e640 1 -- 172.21.15.172:0/3320779026 wait complete. 2024-04-25T08:52:23.429 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:52:23.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.539+0000 7f1b29d9e640 1 Processor -- start 2024-04-25T08:52:23.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.539+0000 7f1b29d9e640 1 -- start start 2024-04-25T08:52:23.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.540+0000 7f1b29d9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1b2415de80 0x7f1b240cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.540+0000 7f1b29d9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b240ccfe0 0x7f1b240cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.540+0000 7f1b29d9e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b240afc80 con 0x7f1b240cefb0 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.540+0000 7f1b29d9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b240ce4d0 con 0x7f1b2415de80 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.540+0000 7f1b29d9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240ce7b0 con 0x7f1b240ccfe0 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.540+0000 7f1b237fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1b2415de80 0x7f1b240cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.541+0000 7f1b237fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1b2415de80 0x7f1b240cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50364/0 (socket says 172.21.15.172:50364) 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.541+0000 7f1b237fe640 1 -- 172.21.15.172:0/1335576018 learned_addr learned my addr 172.21.15.172:0/1335576018 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.541+0000 7f1b23fff640 1 --2- 172.21.15.172:0/1335576018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b240ccfe0 0x7f1b240cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.541+0000 7f1b237fe640 1 -- 172.21.15.172:0/1335576018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b240ccfe0 msgr2=0x7f1b240cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.541+0000 7f1b237fe640 1 --2- 172.21.15.172:0/1335576018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b240ccfe0 0x7f1b240cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.541+0000 7f1b237fe640 1 -- 172.21.15.172:0/1335576018 >> v1:172.21.15.186:6789/0 conn(0x7f1b240cefb0 legacy=0x7f1b240cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.541+0000 7f1b237fe640 1 -- 172.21.15.172:0/1335576018 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b240cea90 con 0x7f1b2415de80 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.541+0000 7f1b237fe640 1 --2- 172.21.15.172:0/1335576018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b2415de80 0x7f1b240cadb0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009870 tx=0x7f1b1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf2acc96c926446 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b227fc640 1 -- 172.21.15.172:0/1335576018 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14037070 con 0x7f1b2415de80 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b227fc640 1 -- 172.21.15.172:0/1335576018 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b14032440 con 0x7f1b2415de80 2024-04-25T08:52:23.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b227fc640 1 -- 172.21.15.172:0/1335576018 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14032810 con 0x7f1b2415de80 2024-04-25T08:52:23.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1335576018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b2415de80 msgr2=0x7f1b240cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b29d9e640 1 --2- 172.21.15.172:0/1335576018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b2415de80 0x7f1b240cadb0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f1b14009870 tx=0x7f1b1402a270 comp rx=0 tx=0).stop 2024-04-25T08:52:23.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1335576018 shutdown_connections 2024-04-25T08:52:23.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b29d9e640 1 --2- 172.21.15.172:0/1335576018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b240ccfe0 0x7f1b240cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b29d9e640 1 --2- 172.21.15.172:0/1335576018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b2415de80 0x7f1b240cadb0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1335576018 >> 172.21.15.172:0/1335576018 conn(0x7f1b240b2390 msgr2=0x7f1b240b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:23.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1335576018 shutdown_connections 2024-04-25T08:52:23.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.542+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1335576018 wait complete. 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.543+0000 7f1b29d9e640 1 Processor -- start 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.543+0000 7f1b29d9e640 1 -- start start 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b29d9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b240ccfe0 0x7f1b24153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b29d9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b240cefb0 0x7f1b2415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b29d9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b2415de80 0x7f1b240b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b29d9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240cfb50 con 0x7f1b240cefb0 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b29d9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240b2eb0 con 0x7f1b2415de80 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b29d9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2415cc20 con 0x7f1b240ccfe0 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b22ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b240cefb0 0x7f1b2415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b22ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b240cefb0 0x7f1b2415b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50372/0 (socket says 172.21.15.172:50372) 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b22ffd640 1 -- 172.21.15.172:0/1901894963 learned_addr learned my addr 172.21.15.172:0/1901894963 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:23.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b23fff640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b2415de80 0x7f1b240b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.544+0000 7f1b237fe640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b240ccfe0 0x7f1b24153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b22ffd640 1 -- 172.21.15.172:0/1901894963 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b240ccfe0 msgr2=0x7f1b24153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b22ffd640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b240ccfe0 0x7f1b24153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b22ffd640 1 -- 172.21.15.172:0/1901894963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b2415de80 msgr2=0x7f1b240b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b22ffd640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b2415de80 0x7f1b240b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b22ffd640 1 -- 172.21.15.172:0/1901894963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2415bb80 con 0x7f1b240cefb0 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b22ffd640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b240cefb0 0x7f1b2415b210 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800c430 tx=0x7f1b1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b0bfff640 1 -- 172.21.15.172:0/1901894963 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b180052d0 con 0x7f1b240cefb0 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b0bfff640 1 -- 172.21.15.172:0/1901894963 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b18005490 con 0x7f1b240cefb0 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1901894963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2415be60 con 0x7f1b240cefb0 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b0bfff640 1 -- 172.21.15.172:0/1901894963 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18007260 con 0x7f1b240cefb0 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.545+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1901894963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2415c420 con 0x7f1b240cefb0 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.546+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1901894963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b24073a00 con 0x7f1b240cefb0 2024-04-25T08:52:23.538 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.546+0000 7f1b0bfff640 1 -- 172.21.15.172:0/1901894963 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1b18007400 con 0x7f1b240cefb0 2024-04-25T08:52:23.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.547+0000 7f1b0bfff640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b1006b4d0 0x7f1b1006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.547+0000 7f1b0bfff640 1 -- 172.21.15.172:0/1901894963 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1b18089940 con 0x7f1b240cefb0 2024-04-25T08:52:23.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.547+0000 7f1b237fe640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b1006b4d0 0x7f1b1006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.547+0000 7f1b237fe640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b1006b4d0 0x7f1b1006d990 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1b14034000 tx=0x7f1b1402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:23.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.551+0000 7f1b0bfff640 1 -- 172.21.15.172:0/1901894963 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b18058570 con 0x7f1b240cefb0 2024-04-25T08:52:23.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.726+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1901894963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b240cc2f0 con 0x7f1b240cefb0 2024-04-25T08:52:23.716 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.726+0000 7f1b0bfff640 1 -- 172.21.15.172:0/1901894963 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b18057e70 con 0x7f1b240cefb0 2024-04-25T08:52:23.717 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:52:23.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.728+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1901894963 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b1006b4d0 msgr2=0x7f1b1006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.728+0000 7f1b29d9e640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b1006b4d0 0x7f1b1006d990 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1b14034000 tx=0x7f1b1402e000 comp rx=0 tx=0).stop 2024-04-25T08:52:23.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.728+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1901894963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b240cefb0 msgr2=0x7f1b2415b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.728+0000 7f1b29d9e640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b240cefb0 0x7f1b2415b210 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800c430 tx=0x7f1b1800c8f0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.728+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1901894963 shutdown_connections 2024-04-25T08:52:23.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.728+0000 7f1b29d9e640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1b1006b4d0 0x7f1b1006d990 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.728+0000 7f1b29d9e640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1b2415de80 0x7f1b240b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.728+0000 7f1b29d9e640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b240cefb0 0x7f1b2415b210 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.719 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.728+0000 7f1b29d9e640 1 --2- 172.21.15.172:0/1901894963 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1b240ccfe0 0x7f1b24153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.728+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1901894963 >> 172.21.15.172:0/1901894963 conn(0x7f1b240b2390 msgr2=0x7f1b240cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:23.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.729+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1901894963 shutdown_connections 2024-04-25T08:52:23.720 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.729+0000 7f1b29d9e640 1 -- 172.21.15.172:0/1901894963 wait complete. 2024-04-25T08:52:23.729 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:52:23.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.841+0000 7f0702e53640 1 Processor -- start 2024-04-25T08:52:23.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.841+0000 7f0702e53640 1 -- start start 2024-04-25T08:52:23.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.842+0000 7f0702e53640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f06fc161240 0x7f06fc0b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.842+0000 7f0702e53640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f06fc0b54a0 0x7f06fc0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.842+0000 7f0702e53640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc0cf1d0 con 0x7f06fc161890 2024-04-25T08:52:23.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.842+0000 7f0702e53640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0b7120 con 0x7f06fc0b54a0 2024-04-25T08:52:23.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.842+0000 7f0702e53640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0b5e30 con 0x7f06fc161240 2024-04-25T08:52:23.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.842+0000 7f07013f0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f06fc0b54a0 0x7f06fc0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.834 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.842+0000 7f07013f0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f06fc0b54a0 0x7f06fc0b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50376/0 (socket says 172.21.15.172:50376) 2024-04-25T08:52:23.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.842+0000 7f07013f0640 1 -- 172.21.15.172:0/1394585937 learned_addr learned my addr 172.21.15.172:0/1394585937 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:23.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.842+0000 7f0700bef640 1 --2- 172.21.15.172:0/1394585937 >> v2:172.21.15.186:3300/0 conn(0x7f06fc161240 0x7f06fc0b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.843+0000 7f07013f0640 1 -- 172.21.15.172:0/1394585937 >> v2:172.21.15.186:3300/0 conn(0x7f06fc161240 msgr2=0x7f06fc0b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:23.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.843+0000 7f07013f0640 1 --2- 172.21.15.172:0/1394585937 >> v2:172.21.15.186:3300/0 conn(0x7f06fc161240 0x7f06fc0b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.843+0000 7f07013f0640 1 -- 172.21.15.172:0/1394585937 >> v1:172.21.15.186:6789/0 conn(0x7f06fc161890 legacy=0x7f06fc0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.843+0000 7f07013f0640 1 -- 172.21.15.172:0/1394585937 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc161620 con 0x7f06fc0b54a0 2024-04-25T08:52:23.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.843+0000 7f07013f0640 1 --2- 172.21.15.172:0/1394585937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 0x7f06fc0b58f0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0d0400 tx=0x7f06f402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfddee1346fe4242 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:23.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f06fb7fe640 1 -- 172.21.15.172:0/1394585937 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f4036070 con 0x7f06fc0b54a0 2024-04-25T08:52:23.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f06fb7fe640 1 -- 172.21.15.172:0/1394585937 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f4031600 con 0x7f06fc0b54a0 2024-04-25T08:52:23.835 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f06fb7fe640 1 -- 172.21.15.172:0/1394585937 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40319d0 con 0x7f06fc0b54a0 2024-04-25T08:52:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f0702e53640 1 -- 172.21.15.172:0/1394585937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 msgr2=0x7f06fc0b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f0702e53640 1 --2- 172.21.15.172:0/1394585937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 0x7f06fc0b58f0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0d0400 tx=0x7f06f402a730 comp rx=0 tx=0).stop 2024-04-25T08:52:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f0702e53640 1 -- 172.21.15.172:0/1394585937 shutdown_connections 2024-04-25T08:52:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f0702e53640 1 --2- 172.21.15.172:0/1394585937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 0x7f06fc0b58f0 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f0702e53640 1 --2- 172.21.15.172:0/1394585937 >> v2:172.21.15.186:3300/0 conn(0x7f06fc161240 0x7f06fc0b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.839 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f0702e53640 1 -- 172.21.15.172:0/1394585937 >> 172.21.15.172:0/1394585937 conn(0x7f06fc0d04a0 msgr2=0x7f06fc0d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f0702e53640 1 -- 172.21.15.172:0/1394585937 shutdown_connections 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.844+0000 7f0702e53640 1 -- 172.21.15.172:0/1394585937 wait complete. 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.845+0000 7f0702e53640 1 Processor -- start 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.846+0000 7f0702e53640 1 -- start start 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.846+0000 7f0702e53640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 0x7f06fc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.846+0000 7f0702e53640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06fc161240 0x7f06fc0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.846+0000 7f0702e53640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc161890 0x7f06fc0d3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.846+0000 7f0702e53640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc1623c0 con 0x7f06fc0b54a0 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.846+0000 7f0702e53640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc1620e0 con 0x7f06fc161890 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.846+0000 7f0702e53640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc1626a0 con 0x7f06fc161240 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.846+0000 7f0700bef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 0x7f06fc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f0700bef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 0x7f06fc0c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50378/0 (socket says 172.21.15.172:50378) 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f0700bef640 1 -- 172.21.15.172:0/3649635765 learned_addr learned my addr 172.21.15.172:0/3649635765 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f07013f0640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc161890 0x7f06fc0d3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f06fbfff640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06fc161240 0x7f06fc0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f0700bef640 1 -- 172.21.15.172:0/3649635765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06fc161240 msgr2=0x7f06fc0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f0700bef640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06fc161240 0x7f06fc0cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f0700bef640 1 -- 172.21.15.172:0/3649635765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc161890 msgr2=0x7f06fc0d3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f0700bef640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc161890 0x7f06fc0d3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f0700bef640 1 -- 172.21.15.172:0/3649635765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc14b2a0 con 0x7f06fc0b54a0 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f0700bef640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 0x7f06fc0c7550 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f06f000e9e0 tx=0x7f06f000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f06f97fa640 1 -- 172.21.15.172:0/3649635765 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0017070 con 0x7f06fc0b54a0 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f06f97fa640 1 -- 172.21.15.172:0/3649635765 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f000c970 con 0x7f06fc0b54a0 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f0702e53640 1 -- 172.21.15.172:0/3649635765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc0cb730 con 0x7f06fc0b54a0 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f06f97fa640 1 -- 172.21.15.172:0/3649635765 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f000cd60 con 0x7f06fc0b54a0 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.847+0000 7f0702e53640 1 -- 172.21.15.172:0/3649635765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc0d2930 con 0x7f06fc0b54a0 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.849+0000 7f0702e53640 1 -- 172.21.15.172:0/3649635765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc073a00 con 0x7f06fc0b54a0 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.849+0000 7f06f97fa640 1 -- 172.21.15.172:0/3649635765 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f06f001a070 con 0x7f06fc0b54a0 2024-04-25T08:52:23.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.849+0000 7f06f97fa640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06e006b500 0x7f06e006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:23.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.849+0000 7f06f97fa640 1 -- 172.21.15.172:0/3649635765 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f06f008a2a0 con 0x7f06fc0b54a0 2024-04-25T08:52:23.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.849+0000 7f06fbfff640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06e006b500 0x7f06e006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:23.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.850+0000 7f06fbfff640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06e006b500 0x7f06e006d9c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f06fc160a20 tx=0x7f06e8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:23.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:23.853+0000 7f06f97fa640 1 -- 172.21.15.172:0/3649635765 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f06f0058910 con 0x7f06fc0b54a0 2024-04-25T08:52:24.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.024+0000 7f0702e53640 1 -- 172.21.15.172:0/3649635765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06fc0c7a90 con 0x7f06fc0b54a0 2024-04-25T08:52:24.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.025+0000 7f06f97fa640 1 -- 172.21.15.172:0/3649635765 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06f005c9b0 con 0x7f06fc0b54a0 2024-04-25T08:52:24.015 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:52:24.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 -- 172.21.15.172:0/3649635765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06e006b500 msgr2=0x7f06e006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:24.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06e006b500 0x7f06e006d9c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f06fc160a20 tx=0x7f06e8009040 comp rx=0 tx=0).stop 2024-04-25T08:52:24.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 -- 172.21.15.172:0/3649635765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 msgr2=0x7f06fc0c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:24.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 0x7f06fc0c7550 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f06f000e9e0 tx=0x7f06f000eea0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 -- 172.21.15.172:0/3649635765 shutdown_connections 2024-04-25T08:52:24.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f06e006b500 0x7f06e006d9c0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc161890 0x7f06fc0d3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06fc161240 0x7f06fc0cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 --2- 172.21.15.172:0/3649635765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06fc0b54a0 0x7f06fc0c7550 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 -- 172.21.15.172:0/3649635765 >> 172.21.15.172:0/3649635765 conn(0x7f06fc0d04a0 msgr2=0x7f06fc0b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:24.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 -- 172.21.15.172:0/3649635765 shutdown_connections 2024-04-25T08:52:24.018 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.027+0000 7f0702e53640 1 -- 172.21.15.172:0/3649635765 wait complete. 2024-04-25T08:52:24.028 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T08:52:24.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.136+0000 7fd6f026f640 1 Processor -- start 2024-04-25T08:52:24.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.136+0000 7fd6f026f640 1 -- start start 2024-04-25T08:52:24.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.136+0000 7fd6f026f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81446d0 0x7fd6e80b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:24.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.136+0000 7fd6f026f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6e8144d50 0x7fd6e80b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:24.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.136+0000 7fd6f026f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e80cccc0 con 0x7fd6e81452a0 2024-04-25T08:52:24.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.136+0000 7fd6f026f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e80b2b20 con 0x7fd6e8144d50 2024-04-25T08:52:24.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.136+0000 7fd6f026f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e806d400 con 0x7fd6e81446d0 2024-04-25T08:52:24.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ed80a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6e8144d50 0x7fd6e80b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:24.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ee80c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd6e81452a0 0x7fd6e80cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41414/0 (socket says 172.21.15.172:41414) 2024-04-25T08:52:24.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ee80c640 1 -- 172.21.15.172:0/2785504958 learned_addr learned my addr 172.21.15.172:0/2785504958 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:24.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ed80a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6e8144d50 0x7fd6e80b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50388/0 (socket says 172.21.15.172:50388) 2024-04-25T08:52:24.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ee00b640 1 --2- 172.21.15.172:0/2785504958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81446d0 0x7fd6e80b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ed80a640 1 -- 172.21.15.172:0/2785504958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81446d0 msgr2=0x7fd6e80b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ed80a640 1 --2- 172.21.15.172:0/2785504958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81446d0 0x7fd6e80b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ed80a640 1 -- 172.21.15.172:0/2785504958 >> v1:172.21.15.172:6789/0 conn(0x7fd6e81452a0 legacy=0x7fd6e80cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ed009640 1 -- 172.21.15.172:0/2785504958 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006852108 0 0) 0x7fd6e80cccc0 con 0x7fd6e81452a0 2024-04-25T08:52:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ed80a640 1 -- 172.21.15.172:0/2785504958 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80cc140 con 0x7fd6e8144d50 2024-04-25T08:52:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.137+0000 7fd6ee00b640 1 --2- 172.21.15.172:0/2785504958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81446d0 0x7fd6e80b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6ed80a640 1 --2- 172.21.15.172:0/2785504958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 0x7fd6e80b4460 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0097a0 tx=0x7fd6dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be53424f9f1b89d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6ed009640 1 -- 172.21.15.172:0/2785504958 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc037070 con 0x7fd6e8144d50 2024-04-25T08:52:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6ed009640 1 -- 172.21.15.172:0/2785504958 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc032440 con 0x7fd6e8144d50 2024-04-25T08:52:24.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6ed009640 1 -- 172.21.15.172:0/2785504958 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc032810 con 0x7fd6e8144d50 2024-04-25T08:52:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6f026f640 1 -- 172.21.15.172:0/2785504958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 msgr2=0x7fd6e80b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6f026f640 1 --2- 172.21.15.172:0/2785504958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 0x7fd6e80b4460 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0097a0 tx=0x7fd6dc02a180 comp rx=0 tx=0).stop 2024-04-25T08:52:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6f026f640 1 -- 172.21.15.172:0/2785504958 shutdown_connections 2024-04-25T08:52:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6f026f640 1 --2- 172.21.15.172:0/2785504958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 0x7fd6e80b4460 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6f026f640 1 --2- 172.21.15.172:0/2785504958 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81446d0 0x7fd6e80b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6f026f640 1 -- 172.21.15.172:0/2785504958 >> 172.21.15.172:0/2785504958 conn(0x7fd6e806abe0 msgr2=0x7fd6e806afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6f026f640 1 -- 172.21.15.172:0/2785504958 shutdown_connections 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.138+0000 7fd6f026f640 1 -- 172.21.15.172:0/2785504958 wait complete. 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.139+0000 7fd6f026f640 1 Processor -- start 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6f026f640 1 -- start start 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6f026f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6e81446d0 0x7fd6e813e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6f026f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 0x7fd6e80adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6f026f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81452a0 0x7fd6e8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6f026f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80cc700 con 0x7fd6e8144d50 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6f026f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80b49a0 con 0x7fd6e81446d0 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6f026f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e80cc9e0 con 0x7fd6e81452a0 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6ed80a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 0x7fd6e80adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6ed80a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 0x7fd6e80adb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50392/0 (socket says 172.21.15.172:50392) 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6ed80a640 1 -- 172.21.15.172:0/1475273999 learned_addr learned my addr 172.21.15.172:0/1475273999 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:24.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6ee80c640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81452a0 0x7fd6e8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.140+0000 7fd6ee00b640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6e81446d0 0x7fd6e813e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6ed80a640 1 -- 172.21.15.172:0/1475273999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81452a0 msgr2=0x7fd6e8071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6ed80a640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81452a0 0x7fd6e8071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6ed80a640 1 -- 172.21.15.172:0/1475273999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6e81446d0 msgr2=0x7fd6e813e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6ed80a640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6e81446d0 0x7fd6e813e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6ed80a640 1 -- 172.21.15.172:0/1475273999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80a9590 con 0x7fd6e8144d50 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6ed80a640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 0x7fd6e80adb80 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0098c0 tx=0x7fd6dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6e6ffd640 1 -- 172.21.15.172:0/1475273999 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc037040 con 0x7fd6e8144d50 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6e6ffd640 1 -- 172.21.15.172:0/1475273999 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc030770 con 0x7fd6e8144d50 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6f026f640 1 -- 172.21.15.172:0/1475273999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e80a9870 con 0x7fd6e8144d50 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6e6ffd640 1 -- 172.21.15.172:0/1475273999 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc030b40 con 0x7fd6e8144d50 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.141+0000 7fd6f026f640 1 -- 172.21.15.172:0/1475273999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e80a9e30 con 0x7fd6e8144d50 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.142+0000 7fd6f026f640 1 -- 172.21.15.172:0/1475273999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e8073a00 con 0x7fd6e8144d50 2024-04-25T08:52:24.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.142+0000 7fd6e6ffd640 1 -- 172.21.15.172:0/1475273999 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd6dc044020 con 0x7fd6e8144d50 2024-04-25T08:52:24.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.143+0000 7fd6e6ffd640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6d406b4d0 0x7fd6d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:24.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.143+0000 7fd6e6ffd640 1 -- 172.21.15.172:0/1475273999 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd6dc0aa980 con 0x7fd6e8144d50 2024-04-25T08:52:24.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.143+0000 7fd6ee00b640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6d406b4d0 0x7fd6d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:24.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.143+0000 7fd6ee00b640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6d406b4d0 0x7fd6d406d990 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00075b0 tx=0x7fd6e0007540 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:24.137 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.147+0000 7fd6e6ffd640 1 -- 172.21.15.172:0/1475273999 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd6dc032e20 con 0x7fd6e8144d50 2024-04-25T08:52:24.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.329+0000 7fd6f026f640 1 -- 172.21.15.172:0/1475273999 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd6e806ee20 con 0x7fd6e8144d50 2024-04-25T08:52:24.320 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.329+0000 7fd6e6ffd640 1 -- 172.21.15.172:0/1475273999 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v145) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd6dc079640 con 0x7fd6e8144d50 2024-04-25T08:52:24.320 INFO:teuthology.orchestra.run.smithi172.stderr:listed 0 entries 2024-04-25T08:52:24.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.331+0000 7fd6f026f640 1 -- 172.21.15.172:0/1475273999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6d406b4d0 msgr2=0x7fd6d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:24.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.331+0000 7fd6f026f640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6d406b4d0 0x7fd6d406d990 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00075b0 tx=0x7fd6e0007540 comp rx=0 tx=0).stop 2024-04-25T08:52:24.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.331+0000 7fd6f026f640 1 -- 172.21.15.172:0/1475273999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 msgr2=0x7fd6e80adb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:24.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.331+0000 7fd6f026f640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 0x7fd6e80adb80 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0098c0 tx=0x7fd6dc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.331+0000 7fd6f026f640 1 -- 172.21.15.172:0/1475273999 shutdown_connections 2024-04-25T08:52:24.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.331+0000 7fd6f026f640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd6d406b4d0 0x7fd6d406d990 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.331+0000 7fd6f026f640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6e81452a0 0x7fd6e8071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.331+0000 7fd6f026f640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e8144d50 0x7fd6e80adb80 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.331+0000 7fd6f026f640 1 --2- 172.21.15.172:0/1475273999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6e81446d0 0x7fd6e813e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:24.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.331+0000 7fd6f026f640 1 -- 172.21.15.172:0/1475273999 >> 172.21.15.172:0/1475273999 conn(0x7fd6e806abe0 msgr2=0x7fd6e8143920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:24.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.332+0000 7fd6f026f640 1 -- 172.21.15.172:0/1475273999 shutdown_connections 2024-04-25T08:52:24.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:24.332+0000 7fd6f026f640 1 -- 172.21.15.172:0/1475273999 wait complete. 2024-04-25T08:52:24.333 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T08:52:24.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:24.333 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T08:52:24.968 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:52:24.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:24.968 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T08:52:24.983 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:52:24.983 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:52:25.000 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:52:25.001 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:52:25.001 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:52:25.039 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:52:25.039 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:52:25.039 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:52:25.057 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:52:25.057 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:52:25.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.186+0000 7f2f91589640 1 Processor -- start 2024-04-25T08:52:25.176 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.186+0000 7f2f91589640 1 -- start start 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f91589640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c15dbe0 0x7f2f8c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f91589640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f8c0b2cb0 0x7f2f8c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f91589640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c0b97a0 con 0x7f2f8c0b92a0 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f91589640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c15dfc0 con 0x7f2f8c0b2cb0 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f91589640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0d1a00 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f8a7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f8c0b2cb0 0x7f2f8c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f8a7fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f8c0b2cb0 0x7f2f8c0d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50394/0 (socket says 172.21.15.172:50394) 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f8a7fc640 1 -- 172.21.15.172:0/2010125181 learned_addr learned my addr 172.21.15.172:0/2010125181 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f8affd640 1 --2- 172.21.15.172:0/2010125181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c15dbe0 0x7f2f8c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f8a7fc640 1 -- 172.21.15.172:0/2010125181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c15dbe0 msgr2=0x7f2f8c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:25.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f8a7fc640 1 --2- 172.21.15.172:0/2010125181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c15dbe0 0x7f2f8c0d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f8a7fc640 1 -- 172.21.15.172:0/2010125181 >> v1:172.21.15.186:6789/0 conn(0x7f2f8c0b92a0 legacy=0x7f2f8c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f8a7fc640 1 -- 172.21.15.172:0/2010125181 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0d1c50 con 0x7f2f8c0b2cb0 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.187+0000 7f2f8affd640 1 --2- 172.21.15.172:0/2010125181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c15dbe0 0x7f2f8c0d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.188+0000 7f2f8a7fc640 1 --2- 172.21.15.172:0/2010125181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0b2cb0 0x7f2f8c0d0e50 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009870 tx=0x7f2f8002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9f27c3015aa767 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.188+0000 7f2f89ffb640 1 -- 172.21.15.172:0/2010125181 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80037070 con 0x7f2f8c0b2cb0 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.188+0000 7f2f89ffb640 1 -- 172.21.15.172:0/2010125181 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f80032440 con 0x7f2f8c0b2cb0 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.188+0000 7f2f89ffb640 1 -- 172.21.15.172:0/2010125181 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80032810 con 0x7f2f8c0b2cb0 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.188+0000 7f2f91589640 1 -- 172.21.15.172:0/2010125181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0b2cb0 msgr2=0x7f2f8c0d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.188+0000 7f2f91589640 1 --2- 172.21.15.172:0/2010125181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0b2cb0 0x7f2f8c0d0e50 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009870 tx=0x7f2f8002a210 comp rx=0 tx=0).stop 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.188+0000 7f2f91589640 1 -- 172.21.15.172:0/2010125181 shutdown_connections 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.188+0000 7f2f91589640 1 --2- 172.21.15.172:0/2010125181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c0b2cb0 0x7f2f8c0d0e50 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.188+0000 7f2f91589640 1 --2- 172.21.15.172:0/2010125181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c15dbe0 0x7f2f8c0d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.188+0000 7f2f91589640 1 -- 172.21.15.172:0/2010125181 >> 172.21.15.172:0/2010125181 conn(0x7f2f8c061a20 msgr2=0x7f2f8c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:25.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.189+0000 7f2f91589640 1 -- 172.21.15.172:0/2010125181 shutdown_connections 2024-04-25T08:52:25.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.189+0000 7f2f91589640 1 -- 172.21.15.172:0/2010125181 wait complete. 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.190+0000 7f2f91589640 1 Processor -- start 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.190+0000 7f2f91589640 1 -- start start 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f91589640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c0b2cb0 0x7f2f8c156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f91589640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c0b92a0 0x7f2f8c0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f91589640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dbe0 0x7f2f8c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f91589640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b6ab0 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f91589640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0d2210 con 0x7f2f8c0b92a0 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f91589640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b6c30 con 0x7f2f8c0b2cb0 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dbe0 0x7f2f8c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dbe0 0x7f2f8c0b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50404/0 (socket says 172.21.15.172:50404) 2024-04-25T08:52:25.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8b7fe640 1 -- 172.21.15.172:0/3811866202 learned_addr learned my addr 172.21.15.172:0/3811866202 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8a7fc640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c0b92a0 0x7f2f8c0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8affd640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c0b2cb0 0x7f2f8c156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8b7fe640 1 -- 172.21.15.172:0/3811866202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c0b2cb0 msgr2=0x7f2f8c156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8b7fe640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c0b2cb0 0x7f2f8c156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8b7fe640 1 -- 172.21.15.172:0/3811866202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c0b92a0 msgr2=0x7f2f8c0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8b7fe640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c0b92a0 0x7f2f8c0c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8b7fe640 1 -- 172.21.15.172:0/3811866202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0b4450 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f8b7fe640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dbe0 0x7f2f8c0b54f0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400c6d0 tx=0x7f2f8400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f737fe640 1 -- 172.21.15.172:0/3811866202 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84016020 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f737fe640 1 -- 172.21.15.172:0/3811866202 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8400a840 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f91589640 1 -- 172.21.15.172:0/3811866202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c0b4730 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f737fe640 1 -- 172.21.15.172:0/3811866202 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400ac30 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.191+0000 7f2f91589640 1 -- 172.21.15.172:0/3811866202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c0b4cf0 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.192+0000 7f2f91589640 1 -- 172.21.15.172:0/3811866202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c073990 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.193+0000 7f2f737fe640 1 -- 172.21.15.172:0/3811866202 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f84019020 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.193+0000 7f2f737fe640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7806b4d0 0x7f2f7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.193+0000 7f2f737fe640 1 -- 172.21.15.172:0/3811866202 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2f8408a730 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.193+0000 7f2f8affd640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7806b4d0 0x7f2f7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.194+0000 7f2f8affd640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7806b4d0 0x7f2f7806d990 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00aac0 tx=0x7f2f7c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:25.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.198+0000 7f2f737fe640 1 -- 172.21.15.172:0/3811866202 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f84020020 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.399+0000 7f2f91589640 1 -- 172.21.15.172:0/3811866202 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f8c15e4d0 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.390 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.400+0000 7f2f737fe640 1 -- 172.21.15.172:0/3811866202 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4955 (secure 0 0 0) 0x7f2f84058da0 con 0x7f2f8c15dbe0 2024-04-25T08:52:25.391 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:25.391 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":88,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3226910746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3226910746},{"type":"v1","addr":"172.21.15.186:6834","nonce":3226910746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/741856049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":741856049},{"type":"v1","addr":"172.21.15.186:6835","nonce":741856049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":88,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T08:51:58.007519+0000","modified":"2024-04-25T08:52:21.764362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9825},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9819":{"gid":9819,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/406316339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":406316339},{"type":"v1","addr":"172.21.15.172:6835","nonce":406316339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9825":{"gid":9825,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2096375996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2096375996},{"type":"v1","addr":"172.21.15.172:6837","nonce":2096375996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T08:52:25.391 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 88 2024-04-25T08:52:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 -- 172.21.15.172:0/3811866202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7806b4d0 msgr2=0x7f2f7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7806b4d0 0x7f2f7806d990 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00aac0 tx=0x7f2f7c008040 comp rx=0 tx=0).stop 2024-04-25T08:52:25.392 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 -- 172.21.15.172:0/3811866202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dbe0 msgr2=0x7f2f8c0b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dbe0 0x7f2f8c0b54f0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400c6d0 tx=0x7f2f8400cb90 comp rx=0 tx=0).stop 2024-04-25T08:52:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 -- 172.21.15.172:0/3811866202 shutdown_connections 2024-04-25T08:52:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2f7806b4d0 0x7f2f7806d990 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c0b92a0 0x7f2f8c0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c15dbe0 0x7f2f8c0b54f0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 --2- 172.21.15.172:0/3811866202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2f8c0b2cb0 0x7f2f8c156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 -- 172.21.15.172:0/3811866202 >> 172.21.15.172:0/3811866202 conn(0x7f2f8c061a20 msgr2=0x7f2f8c160a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 -- 172.21.15.172:0/3811866202 shutdown_connections 2024-04-25T08:52:25.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.402+0000 7f2f91589640 1 -- 172.21.15.172:0/3811866202 wait complete. 2024-04-25T08:52:25.404 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:52:25.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.510+0000 7fbec1d89640 1 Processor -- start 2024-04-25T08:52:25.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.510+0000 7fbec1d89640 1 -- start start 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.511+0000 7fbec1d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc0b2cb0 0x7fbebc0d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.511+0000 7fbec1d89640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbebc0d1020 0x7fbebc0d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.511+0000 7fbec1d89640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc0b97a0 con 0x7fbebc15dbe0 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.511+0000 7fbec1d89640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc15dfc0 con 0x7fbebc0d1020 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.511+0000 7fbec1d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0d1a00 con 0x7fbebc0b2cb0 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.511+0000 7fbebbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbebc0d1020 0x7fbebc0d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.511+0000 7fbebbfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbebc0d1020 0x7fbebc0d2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50406/0 (socket says 172.21.15.172:50406) 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.511+0000 7fbebbfff640 1 -- 172.21.15.172:0/1007973608 learned_addr learned my addr 172.21.15.172:0/1007973608 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.512+0000 7fbeb2ffd640 1 --2- 172.21.15.172:0/1007973608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc0b2cb0 0x7fbebc0d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.512+0000 7fbebbfff640 1 -- 172.21.15.172:0/1007973608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc0b2cb0 msgr2=0x7fbebc0d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:25.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.512+0000 7fbebbfff640 1 --2- 172.21.15.172:0/1007973608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc0b2cb0 0x7fbebc0d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.512+0000 7fbebbfff640 1 -- 172.21.15.172:0/1007973608 >> v1:172.21.15.186:6789/0 conn(0x7fbebc15dbe0 legacy=0x7fbebc0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.512+0000 7fbebbfff640 1 -- 172.21.15.172:0/1007973608 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0d1c50 con 0x7fbebc0d1020 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.512+0000 7fbebbfff640 1 --2- 172.21.15.172:0/1007973608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 0x7fbebc0d2c70 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009e50 tx=0x7fbeb402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3954b0a8e8e249f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.512+0000 7fbebaffd640 1 -- 172.21.15.172:0/1007973608 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb4036070 con 0x7fbebc0d1020 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.513+0000 7fbebaffd640 1 -- 172.21.15.172:0/1007973608 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb4031600 con 0x7fbebc0d1020 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.513+0000 7fbebaffd640 1 -- 172.21.15.172:0/1007973608 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40319d0 con 0x7fbebc0d1020 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.513+0000 7fbec1d89640 1 -- 172.21.15.172:0/1007973608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 msgr2=0x7fbebc0d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.513+0000 7fbec1d89640 1 --2- 172.21.15.172:0/1007973608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 0x7fbebc0d2c70 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009e50 tx=0x7fbeb402a710 comp rx=0 tx=0).stop 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.513+0000 7fbec1d89640 1 -- 172.21.15.172:0/1007973608 shutdown_connections 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.513+0000 7fbec1d89640 1 --2- 172.21.15.172:0/1007973608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 0x7fbebc0d2c70 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.513+0000 7fbec1d89640 1 --2- 172.21.15.172:0/1007973608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc0b2cb0 0x7fbebc0d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.513+0000 7fbec1d89640 1 -- 172.21.15.172:0/1007973608 >> 172.21.15.172:0/1007973608 conn(0x7fbebc061a20 msgr2=0x7fbebc061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.513+0000 7fbec1d89640 1 -- 172.21.15.172:0/1007973608 shutdown_connections 2024-04-25T08:52:25.505 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.513+0000 7fbec1d89640 1 -- 172.21.15.172:0/1007973608 wait complete. 2024-04-25T08:52:25.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.514+0000 7fbec1d89640 1 Processor -- start 2024-04-25T08:52:25.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.515+0000 7fbec1d89640 1 -- start start 2024-04-25T08:52:25.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.515+0000 7fbec1d89640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbebc0b2cb0 0x7fbebc0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.515+0000 7fbec1d89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 0x7fbebc151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.515+0000 7fbec1d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc15dbe0 0x7fbebc0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.515+0000 7fbec1d89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0b92a0 con 0x7fbebc0d1020 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.515+0000 7fbec1d89640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0d2210 con 0x7fbebc0b2cb0 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.515+0000 7fbec1d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0b9420 con 0x7fbebc15dbe0 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.515+0000 7fbeb2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 0x7fbebc151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.515+0000 7fbeb2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 0x7fbebc151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50418/0 (socket says 172.21.15.172:50418) 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.515+0000 7fbeb2ffd640 1 -- 172.21.15.172:0/3323645128 learned_addr learned my addr 172.21.15.172:0/3323645128 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbebb7fe640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbebc0b2cb0 0x7fbebc0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbebbfff640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc15dbe0 0x7fbebc0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbeb2ffd640 1 -- 172.21.15.172:0/3323645128 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc15dbe0 msgr2=0x7fbebc0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbeb2ffd640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc15dbe0 0x7fbebc0cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbeb2ffd640 1 -- 172.21.15.172:0/3323645128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbebc0b2cb0 msgr2=0x7fbebc0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbeb2ffd640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbebc0b2cb0 0x7fbebc0ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbeb2ffd640 1 -- 172.21.15.172:0/3323645128 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0b54c0 con 0x7fbebc0d1020 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbebbfff640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc15dbe0 0x7fbebc0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbeb2ffd640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 0x7fbebc151a40 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fbea400d830 tx=0x7fbea400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:25.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbeb8ff9640 1 -- 172.21.15.172:0/3323645128 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400b6c0 con 0x7fbebc0d1020 2024-04-25T08:52:25.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbeb8ff9640 1 -- 172.21.15.172:0/3323645128 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea4019070 con 0x7fbebc0d1020 2024-04-25T08:52:25.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbeb8ff9640 1 -- 172.21.15.172:0/3323645128 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400bac0 con 0x7fbebc0d1020 2024-04-25T08:52:25.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbec1d89640 1 -- 172.21.15.172:0/3323645128 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc0b6240 con 0x7fbebc0d1020 2024-04-25T08:52:25.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.516+0000 7fbec1d89640 1 -- 172.21.15.172:0/3323645128 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc0b5a40 con 0x7fbebc0d1020 2024-04-25T08:52:25.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.517+0000 7fbec1d89640 1 -- 172.21.15.172:0/3323645128 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc073990 con 0x7fbebc0d1020 2024-04-25T08:52:25.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.518+0000 7fbeb8ff9640 1 -- 172.21.15.172:0/3323645128 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbea400bc60 con 0x7fbebc0d1020 2024-04-25T08:52:25.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.518+0000 7fbeb8ff9640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe9c06b500 0x7fbe9c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.518+0000 7fbeb8ff9640 1 -- 172.21.15.172:0/3323645128 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbea408a7d0 con 0x7fbebc0d1020 2024-04-25T08:52:25.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.518+0000 7fbebb7fe640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe9c06b500 0x7fbe9c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.518+0000 7fbebb7fe640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe9c06b500 0x7fbe9c06d9c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbebc1f6b80 tx=0x7fbeac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:25.512 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.522+0000 7fbeb8ff9640 1 -- 172.21.15.172:0/3323645128 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbea4059490 con 0x7fbebc0d1020 2024-04-25T08:52:25.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.697+0000 7fbec1d89640 1 -- 172.21.15.172:0/3323645128 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbebc0b4580 con 0x7fbebc0d1020 2024-04-25T08:52:25.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.698+0000 7fbeb8ff9640 1 -- 172.21.15.172:0/3323645128 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17110 (secure 0 0 0) 0x7fbea4058d90 con 0x7fbebc0d1020 2024-04-25T08:52:25.689 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:25.689 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":145,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:52:10.728530+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:51:56.275448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T08:51:56.984469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.12","mappings":[{"from":3,"to":0}]},{"pgid":"22.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:52:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 -- 172.21.15.172:0/3323645128 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe9c06b500 msgr2=0x7fbe9c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe9c06b500 0x7fbe9c06d9c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbebc1f6b80 tx=0x7fbeac009040 comp rx=0 tx=0).stop 2024-04-25T08:52:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 -- 172.21.15.172:0/3323645128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 msgr2=0x7fbebc151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 0x7fbebc151a40 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fbea400d830 tx=0x7fbea400dcf0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 -- 172.21.15.172:0/3323645128 shutdown_connections 2024-04-25T08:52:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbe9c06b500 0x7fbe9c06d9c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbebc15dbe0 0x7fbebc0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbebc0d1020 0x7fbebc151a40 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 --2- 172.21.15.172:0/3323645128 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbebc0b2cb0 0x7fbebc0ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 -- 172.21.15.172:0/3323645128 >> 172.21.15.172:0/3323645128 conn(0x7fbebc061a20 msgr2=0x7fbebc0d3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 -- 172.21.15.172:0/3323645128 shutdown_connections 2024-04-25T08:52:25.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.700+0000 7fbec1d89640 1 -- 172.21.15.172:0/3323645128 wait complete. 2024-04-25T08:52:25.702 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T08:42:16.540683+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T08:51:56.275448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T08:51:56.984469+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T08:52:25.702 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T08:52:25.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.813+0000 7fa9bed34640 1 Processor -- start 2024-04-25T08:52:25.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.814+0000 7fa9bed34640 1 -- start start 2024-04-25T08:52:25.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.814+0000 7fa9bed34640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa9b806abe0 0x7fa9b80acec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.814+0000 7fa9bed34640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b806db40 con 0x7fa9b80b3920 2024-04-25T08:52:25.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.814+0000 7fa9bed34640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b806de20 con 0x7fa9b80b3db0 2024-04-25T08:52:25.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.814+0000 7fa9bed34640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b806e100 con 0x7fa9b806abe0 2024-04-25T08:52:25.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.815+0000 7fa9bcad0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa9b806abe0 0x7fa9b80acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.815+0000 7fa9bcad0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa9b806abe0 0x7fa9b80acec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50432/0 (socket says 172.21.15.172:50432) 2024-04-25T08:52:25.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.815+0000 7fa9bcad0640 1 -- 172.21.15.172:0/3570076785 learned_addr learned my addr 172.21.15.172:0/3570076785 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:25.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.815+0000 7fa9b7fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa9b80b3920 0x7fa9b806afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41426/0 (socket says 172.21.15.172:41426) 2024-04-25T08:52:25.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.815+0000 7fa9bcad0640 1 -- 172.21.15.172:0/3570076785 >> v1:172.21.15.186:6789/0 conn(0x7fa9b80b3db0 legacy=0x7fa9b806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.815+0000 7fa9bcad0640 1 -- 172.21.15.172:0/3570076785 >> v1:172.21.15.172:6789/0 conn(0x7fa9b80b3920 legacy=0x7fa9b806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.815+0000 7fa9bcad0640 1 -- 172.21.15.172:0/3570076785 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b806e3e0 con 0x7fa9b806abe0 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.815+0000 7fa9b77fe640 1 -- 172.21.15.172:0/3570076785 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172919722 0 0) 0x7fa9b806db40 con 0x7fa9b80b3920 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9bcad0640 1 --2- 172.21.15.172:0/3570076785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b806abe0 0x7fa9b80acec0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009870 tx=0x7fa9a802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c04b6f962ffe532 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9b77fe640 1 -- 172.21.15.172:0/3570076785 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8037070 con 0x7fa9b806abe0 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9b77fe640 1 -- 172.21.15.172:0/3570076785 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a8032440 con 0x7fa9b806abe0 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9b77fe640 1 -- 172.21.15.172:0/3570076785 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8032810 con 0x7fa9b806abe0 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9bed34640 1 -- 172.21.15.172:0/3570076785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b806abe0 msgr2=0x7fa9b80acec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9bed34640 1 --2- 172.21.15.172:0/3570076785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b806abe0 0x7fa9b80acec0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009870 tx=0x7fa9a802a210 comp rx=0 tx=0).stop 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9bed34640 1 -- 172.21.15.172:0/3570076785 shutdown_connections 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9bed34640 1 --2- 172.21.15.172:0/3570076785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b806abe0 0x7fa9b80acec0 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9bed34640 1 -- 172.21.15.172:0/3570076785 >> 172.21.15.172:0/3570076785 conn(0x7fa9b80cfec0 msgr2=0x7fa9b80d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9bed34640 1 -- 172.21.15.172:0/3570076785 shutdown_connections 2024-04-25T08:52:25.808 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.816+0000 7fa9bed34640 1 -- 172.21.15.172:0/3570076785 wait complete. 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.817+0000 7fa9bed34640 1 Processor -- start 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.817+0000 7fa9bed34640 1 -- start start 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.818+0000 7fa9bed34640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9b806abe0 0x7fa9b81e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.818+0000 7fa9bed34640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9b80b3920 0x7fa9b8145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.818+0000 7fa9bed34640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b80b3db0 0x7fa9b815fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.818+0000 7fa9bed34640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b806b850 con 0x7fa9b80b3db0 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.818+0000 7fa9bed34640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b806b6d0 con 0x7fa9b80b3920 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.818+0000 7fa9bed34640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b806b9d0 con 0x7fa9b806abe0 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.818+0000 7fa9bd2d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b80b3db0 0x7fa9b815fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.818+0000 7fa9bd2d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b80b3db0 0x7fa9b815fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50446/0 (socket says 172.21.15.172:50446) 2024-04-25T08:52:25.812 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.818+0000 7fa9bd2d1640 1 -- 172.21.15.172:0/501070647 learned_addr learned my addr 172.21.15.172:0/501070647 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9b7fff640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9b80b3920 0x7fa9b8145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9bcad0640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9b806abe0 0x7fa9b81e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9bd2d1640 1 -- 172.21.15.172:0/501070647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9b806abe0 msgr2=0x7fa9b81e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9bd2d1640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9b806abe0 0x7fa9b81e64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9bd2d1640 1 -- 172.21.15.172:0/501070647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9b80b3920 msgr2=0x7fa9b8145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9bd2d1640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9b80b3920 0x7fa9b8145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9bd2d1640 1 -- 172.21.15.172:0/501070647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b8146100 con 0x7fa9b80b3db0 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9b7fff640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9b80b3920 0x7fa9b8145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9bd2d1640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b80b3db0 0x7fa9b815fe30 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000b9c0 tx=0x7fa9b000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9b57fa640 1 -- 172.21.15.172:0/501070647 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0019070 con 0x7fa9b80b3db0 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9b57fa640 1 -- 172.21.15.172:0/501070647 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b000cba0 con 0x7fa9b80b3db0 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9bed34640 1 -- 172.21.15.172:0/501070647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b81e7b60 con 0x7fa9b80b3db0 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9b57fa640 1 -- 172.21.15.172:0/501070647 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0014440 con 0x7fa9b80b3db0 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.819+0000 7fa9bed34640 1 -- 172.21.15.172:0/501070647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b81e7080 con 0x7fa9b80b3db0 2024-04-25T08:52:25.813 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.820+0000 7fa9bed34640 1 -- 172.21.15.172:0/501070647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b80b4940 con 0x7fa9b80b3db0 2024-04-25T08:52:25.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.820+0000 7fa9b57fa640 1 -- 172.21.15.172:0/501070647 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa9b001c070 con 0x7fa9b80b3db0 2024-04-25T08:52:25.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.821+0000 7fa9b57fa640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9a406b4d0 0x7fa9a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:25.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.821+0000 7fa9b57fa640 1 -- 172.21.15.172:0/501070647 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa9b008a0b0 con 0x7fa9b80b3db0 2024-04-25T08:52:25.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.821+0000 7fa9bcad0640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9a406b4d0 0x7fa9a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:25.814 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.821+0000 7fa9bcad0640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9a406b4d0 0x7fa9a406d990 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8034000 tx=0x7fa9a802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:25.815 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.825+0000 7fa9b57fa640 1 -- 172.21.15.172:0/501070647 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9b80b4940 con 0x7fa9b80b3db0 2024-04-25T08:52:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.995+0000 7fa9bed34640 1 -- 172.21.15.172:0/501070647 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9b8073a00 con 0x7fa9b80b3db0 2024-04-25T08:52:25.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.996+0000 7fa9b57fa640 1 -- 172.21.15.172:0/501070647 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9b8146100 con 0x7fa9b80b3db0 2024-04-25T08:52:25.986 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2024-04-25T08:52:25.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 -- 172.21.15.172:0/501070647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9a406b4d0 msgr2=0x7fa9a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9a406b4d0 0x7fa9a406d990 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8034000 tx=0x7fa9a802e000 comp rx=0 tx=0).stop 2024-04-25T08:52:25.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 -- 172.21.15.172:0/501070647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b80b3db0 msgr2=0x7fa9b815fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:25.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b80b3db0 0x7fa9b815fe30 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000b9c0 tx=0x7fa9b000be80 comp rx=0 tx=0).stop 2024-04-25T08:52:25.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 -- 172.21.15.172:0/501070647 shutdown_connections 2024-04-25T08:52:25.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa9a406b4d0 0x7fa9a406d990 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9b80b3920 0x7fa9b8145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9b80b3db0 0x7fa9b815fe30 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 --2- 172.21.15.172:0/501070647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9b806abe0 0x7fa9b81e64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:25.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 -- 172.21.15.172:0/501070647 >> 172.21.15.172:0/501070647 conn(0x7fa9b80cfec0 msgr2=0x7fa9b80ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:25.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 -- 172.21.15.172:0/501070647 shutdown_connections 2024-04-25T08:52:25.990 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:25.998+0000 7fa9bed34640 1 -- 172.21.15.172:0/501070647 wait complete. 2024-04-25T08:52:25.999 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T08:52:26.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.109+0000 7f79ca25a640 1 Processor -- start 2024-04-25T08:52:26.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.110+0000 7f79ca25a640 1 -- start start 2024-04-25T08:52:26.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.110+0000 7f79ca25a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79c415dc20 0x7f79c40ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.110+0000 7f79ca25a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79c40d32f0 0x7f79c40cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.110+0000 7f79ca25a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c415e000 con 0x7f79c4161710 2024-04-25T08:52:26.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.110+0000 7f79ca25a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c40d1de0 con 0x7f79c40d32f0 2024-04-25T08:52:26.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.110+0000 7f79ca25a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4161c60 con 0x7f79c415dc20 2024-04-25T08:52:26.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.110+0000 7f79c3fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79c40d32f0 0x7f79c40cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.110+0000 7f79c3fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79c40d32f0 0x7f79c40cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50452/0 (socket says 172.21.15.172:50452) 2024-04-25T08:52:26.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.110+0000 7f79c3fff640 1 -- 172.21.15.172:0/3280272950 learned_addr learned my addr 172.21.15.172:0/3280272950 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:26.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.110+0000 7f79c2ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f79c4161710 0x7f79c406bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41438/0 (socket says 172.21.15.172:41438) 2024-04-25T08:52:26.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.111+0000 7f79c37fe640 1 --2- 172.21.15.172:0/3280272950 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79c415dc20 0x7f79c40ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.111+0000 7f79c3fff640 1 -- 172.21.15.172:0/3280272950 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79c415dc20 msgr2=0x7f79c40ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:26.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.111+0000 7f79c3fff640 1 --2- 172.21.15.172:0/3280272950 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79c415dc20 0x7f79c40ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.111+0000 7f79c3fff640 1 -- 172.21.15.172:0/3280272950 >> v1:172.21.15.172:6789/0 conn(0x7f79c4161710 legacy=0x7f79c406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.111+0000 7f79c3fff640 1 -- 172.21.15.172:0/3280272950 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4161f40 con 0x7f79c40d32f0 2024-04-25T08:52:26.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.111+0000 7f79c27fc640 1 -- 172.21.15.172:0/3280272950 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129260352 0 0) 0x7f79c415e000 con 0x7f79c4161710 2024-04-25T08:52:26.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.111+0000 7f79c3fff640 1 --2- 172.21.15.172:0/3280272950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c40d32f0 0x7f79c40cebb0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009e50 tx=0x7f79bc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640084272bc7d718 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:26.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79c27fc640 1 -- 172.21.15.172:0/3280272950 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc036070 con 0x7f79c40d32f0 2024-04-25T08:52:26.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79c27fc640 1 -- 172.21.15.172:0/3280272950 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc031600 con 0x7f79c40d32f0 2024-04-25T08:52:26.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79c27fc640 1 -- 172.21.15.172:0/3280272950 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc0319d0 con 0x7f79c40d32f0 2024-04-25T08:52:26.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79ca25a640 1 -- 172.21.15.172:0/3280272950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c40d32f0 msgr2=0x7f79c40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79ca25a640 1 --2- 172.21.15.172:0/3280272950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c40d32f0 0x7f79c40cebb0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009e50 tx=0x7f79bc02a710 comp rx=0 tx=0).stop 2024-04-25T08:52:26.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79ca25a640 1 -- 172.21.15.172:0/3280272950 shutdown_connections 2024-04-25T08:52:26.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79ca25a640 1 --2- 172.21.15.172:0/3280272950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c40d32f0 0x7f79c40cebb0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79ca25a640 1 --2- 172.21.15.172:0/3280272950 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79c415dc20 0x7f79c40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.109 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79ca25a640 1 -- 172.21.15.172:0/3280272950 >> 172.21.15.172:0/3280272950 conn(0x7f79c40d0420 msgr2=0x7f79c40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:26.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79ca25a640 1 -- 172.21.15.172:0/3280272950 shutdown_connections 2024-04-25T08:52:26.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.112+0000 7f79ca25a640 1 -- 172.21.15.172:0/3280272950 wait complete. 2024-04-25T08:52:26.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.113+0000 7f79ca25a640 1 Processor -- start 2024-04-25T08:52:26.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.114+0000 7f79ca25a640 1 -- start start 2024-04-25T08:52:26.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.114+0000 7f79ca25a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79c40d32f0 0x7f79c4159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.110 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.114+0000 7f79ca25a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c415dc20 0x7f79c40b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.114+0000 7f79ca25a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c4161710 0x7f79c40ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.114+0000 7f79ca25a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40b5e50 con 0x7f79c415dc20 2024-04-25T08:52:26.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.114+0000 7f79ca25a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4162500 con 0x7f79c4161710 2024-04-25T08:52:26.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.114+0000 7f79ca25a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40b5fd0 con 0x7f79c40d32f0 2024-04-25T08:52:26.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.114+0000 7f79c2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c415dc20 0x7f79c40b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.111 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.114+0000 7f79c2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c415dc20 0x7f79c40b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50464/0 (socket says 172.21.15.172:50464) 2024-04-25T08:52:26.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.114+0000 7f79c2ffd640 1 -- 172.21.15.172:0/1717978405 learned_addr learned my addr 172.21.15.172:0/1717978405 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:26.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79c3fff640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c4161710 0x7f79c40ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79c37fe640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79c40d32f0 0x7f79c4159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79c2ffd640 1 -- 172.21.15.172:0/1717978405 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79c40d32f0 msgr2=0x7f79c4159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.112 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79c2ffd640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79c40d32f0 0x7f79c4159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79c2ffd640 1 -- 172.21.15.172:0/1717978405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c4161710 msgr2=0x7f79c40ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79c2ffd640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c4161710 0x7f79c40ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79c2ffd640 1 -- 172.21.15.172:0/1717978405 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c415e2b0 con 0x7f79c415dc20 2024-04-25T08:52:26.113 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79c3fff640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c4161710 0x7f79c40ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:26.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79c2ffd640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c415dc20 0x7f79c40b20a0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f79b800c430 tx=0x7f79b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:26.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79abfff640 1 -- 172.21.15.172:0/1717978405 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80074e0 con 0x7f79c415dc20 2024-04-25T08:52:26.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79abfff640 1 -- 172.21.15.172:0/1717978405 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b80047e0 con 0x7f79c415dc20 2024-04-25T08:52:26.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79abfff640 1 -- 172.21.15.172:0/1717978405 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8004bd0 con 0x7f79c415dc20 2024-04-25T08:52:26.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79ca25a640 1 -- 172.21.15.172:0/1717978405 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c415e590 con 0x7f79c415dc20 2024-04-25T08:52:26.114 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.115+0000 7f79ca25a640 1 -- 172.21.15.172:0/1717978405 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c40b25e0 con 0x7f79c415dc20 2024-04-25T08:52:26.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.116+0000 7f79ca25a640 1 -- 172.21.15.172:0/1717978405 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c4073a00 con 0x7f79c415dc20 2024-04-25T08:52:26.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.117+0000 7f79abfff640 1 -- 172.21.15.172:0/1717978405 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f79b8011070 con 0x7f79c415dc20 2024-04-25T08:52:26.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.117+0000 7f79abfff640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79b006b4d0 0x7f79b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.117+0000 7f79abfff640 1 -- 172.21.15.172:0/1717978405 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f79b8089ff0 con 0x7f79c415dc20 2024-04-25T08:52:26.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.117+0000 7f79c37fe640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79b006b4d0 0x7f79b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.115 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.118+0000 7f79c37fe640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79b006b4d0 0x7f79b006d990 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009a30 tx=0x7f79b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:26.116 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.121+0000 7f79abfff640 1 -- 172.21.15.172:0/1717978405 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f79b8058d40 con 0x7f79c415dc20 2024-04-25T08:52:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.291+0000 7f79ca25a640 1 -- 172.21.15.172:0/1717978405 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79c40d16b0 con 0x7f79c415dc20 2024-04-25T08:52:26.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.291+0000 7f79abfff640 1 -- 172.21.15.172:0/1717978405 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79b8058640 con 0x7f79c415dc20 2024-04-25T08:52:26.283 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 32 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 -- 172.21.15.172:0/1717978405 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79b006b4d0 msgr2=0x7f79b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79b006b4d0 0x7f79b006d990 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009a30 tx=0x7f79b4008040 comp rx=0 tx=0).stop 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 -- 172.21.15.172:0/1717978405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c415dc20 msgr2=0x7f79c40b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c415dc20 0x7f79c40b20a0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f79b800c430 tx=0x7f79b800c8f0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 -- 172.21.15.172:0/1717978405 shutdown_connections 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f79b006b4d0 0x7f79b006d990 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c4161710 0x7f79c40ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79c415dc20 0x7f79c40b20a0 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 --2- 172.21.15.172:0/1717978405 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f79c40d32f0 0x7f79c4159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 -- 172.21.15.172:0/1717978405 >> 172.21.15.172:0/1717978405 conn(0x7f79c40d0420 msgr2=0x7f79c40b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 -- 172.21.15.172:0/1717978405 shutdown_connections 2024-04-25T08:52:26.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.293+0000 7f79ca25a640 1 -- 172.21.15.172:0/1717978405 wait complete. 2024-04-25T08:52:26.294 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T08:52:26.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.402+0000 7fc211241640 1 Processor -- start 2024-04-25T08:52:26.393 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.403+0000 7fc211241640 1 -- start start 2024-04-25T08:52:26.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.403+0000 7fc211241640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc20c06e360 0x7fc20c06e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.403+0000 7fc211241640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc20c06ec80 0x7fc20c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.403+0000 7fc211241640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c15e020 con 0x7fc20c0b3e10 2024-04-25T08:52:26.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.403+0000 7fc211241640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c06b890 con 0x7fc20c06e360 2024-04-25T08:52:26.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.403+0000 7fc211241640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c06ac80 con 0x7fc20c06ec80 2024-04-25T08:52:26.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.403+0000 7fc20ad9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc20c06e360 0x7fc20c06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.403+0000 7fc20ad9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc20c06e360 0x7fc20c06e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50480/0 (socket says 172.21.15.172:50480) 2024-04-25T08:52:26.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.404+0000 7fc20ad9d640 1 -- 172.21.15.172:0/4182767402 learned_addr learned my addr 172.21.15.172:0/4182767402 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:26.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.404+0000 7fc20a59c640 1 --2- 172.21.15.172:0/4182767402 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc20c06ec80 0x7fc20c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.395 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.404+0000 7fc20ad9d640 1 -- 172.21.15.172:0/4182767402 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc20c06ec80 msgr2=0x7fc20c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:26.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.404+0000 7fc20ad9d640 1 --2- 172.21.15.172:0/4182767402 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc20c06ec80 0x7fc20c0b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.404+0000 7fc20ad9d640 1 -- 172.21.15.172:0/4182767402 >> v1:172.21.15.186:6789/0 conn(0x7fc20c0b3e10 legacy=0x7fc20c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.404+0000 7fc20ad9d640 1 -- 172.21.15.172:0/4182767402 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c06af60 con 0x7fc20c06e360 2024-04-25T08:52:26.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.404+0000 7fc20ad9d640 1 --2- 172.21.15.172:0/4182767402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c06e360 0x7fc20c06e740 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fc204009870 tx=0x7fc20402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc9726a9dc938ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:26.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc209d9b640 1 -- 172.21.15.172:0/4182767402 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204037070 con 0x7fc20c06e360 2024-04-25T08:52:26.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc209d9b640 1 -- 172.21.15.172:0/4182767402 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20402ae50 con 0x7fc20c06e360 2024-04-25T08:52:26.396 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc209d9b640 1 -- 172.21.15.172:0/4182767402 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204032860 con 0x7fc20c06e360 2024-04-25T08:52:26.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc211241640 1 -- 172.21.15.172:0/4182767402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c06e360 msgr2=0x7fc20c06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc211241640 1 --2- 172.21.15.172:0/4182767402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c06e360 0x7fc20c06e740 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fc204009870 tx=0x7fc20402a300 comp rx=0 tx=0).stop 2024-04-25T08:52:26.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc211241640 1 -- 172.21.15.172:0/4182767402 shutdown_connections 2024-04-25T08:52:26.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc211241640 1 --2- 172.21.15.172:0/4182767402 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc20c06ec80 0x7fc20c0b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc211241640 1 --2- 172.21.15.172:0/4182767402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c06e360 0x7fc20c06e740 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc211241640 1 -- 172.21.15.172:0/4182767402 >> 172.21.15.172:0/4182767402 conn(0x7fc20c0cfec0 msgr2=0x7fc20c0d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:26.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc211241640 1 -- 172.21.15.172:0/4182767402 shutdown_connections 2024-04-25T08:52:26.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.405+0000 7fc211241640 1 -- 172.21.15.172:0/4182767402 wait complete. 2024-04-25T08:52:26.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.407+0000 7fc211241640 1 Processor -- start 2024-04-25T08:52:26.397 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.407+0000 7fc211241640 1 -- start start 2024-04-25T08:52:26.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.407+0000 7fc211241640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc20c06e360 0x7fc20c0ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.407+0000 7fc211241640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc20c06ec80 0x7fc20c1e8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.407+0000 7fc211241640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c0b3e10 0x7fc20c154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.407+0000 7fc211241640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0b2fd0 con 0x7fc20c0b3e10 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.407+0000 7fc211241640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c06b520 con 0x7fc20c06ec80 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.407+0000 7fc211241640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c0b3150 con 0x7fc20c06e360 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.407+0000 7fc20b59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c0b3e10 0x7fc20c154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc20b59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c0b3e10 0x7fc20c154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50490/0 (socket says 172.21.15.172:50490) 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc20b59e640 1 -- 172.21.15.172:0/2407355461 learned_addr learned my addr 172.21.15.172:0/2407355461 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc20ad9d640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc20c06e360 0x7fc20c0ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc20a59c640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc20c06ec80 0x7fc20c1e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc20b59e640 1 -- 172.21.15.172:0/2407355461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc20c06e360 msgr2=0x7fc20c0ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc20b59e640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc20c06e360 0x7fc20c0ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc20b59e640 1 -- 172.21.15.172:0/2407355461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc20c06ec80 msgr2=0x7fc20c1e8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc20b59e640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc20c06ec80 0x7fc20c1e8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc20b59e640 1 -- 172.21.15.172:0/2407355461 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c1e85d0 con 0x7fc20c0b3e10 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc20b59e640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c0b3e10 0x7fc20c154380 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00c6b0 tx=0x7fc1fc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:26.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc2037fe640 1 -- 172.21.15.172:0/2407355461 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc003b70 con 0x7fc20c0b3e10 2024-04-25T08:52:26.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc2037fe640 1 -- 172.21.15.172:0/2407355461 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc003d30 con 0x7fc20c0b3e10 2024-04-25T08:52:26.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc2037fe640 1 -- 172.21.15.172:0/2407355461 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc005310 con 0x7fc20c0b3e10 2024-04-25T08:52:26.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc211241640 1 -- 172.21.15.172:0/2407355461 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20c1e8870 con 0x7fc20c0b3e10 2024-04-25T08:52:26.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.408+0000 7fc211241640 1 -- 172.21.15.172:0/2407355461 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20c1e8e30 con 0x7fc20c0b3e10 2024-04-25T08:52:26.401 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.409+0000 7fc211241640 1 -- 172.21.15.172:0/2407355461 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20c073a00 con 0x7fc20c0b3e10 2024-04-25T08:52:26.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.410+0000 7fc2037fe640 1 -- 172.21.15.172:0/2407355461 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc1fc0054b0 con 0x7fc20c0b3e10 2024-04-25T08:52:26.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.410+0000 7fc2037fe640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1ec06b4d0 0x7fc1ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.410+0000 7fc20ad9d640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1ec06b4d0 0x7fc1ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.410+0000 7fc2037fe640 1 -- 172.21.15.172:0/2407355461 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc1fc089ff0 con 0x7fc20c0b3e10 2024-04-25T08:52:26.402 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.411+0000 7fc20ad9d640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1ec06b4d0 0x7fc1ec06d990 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc204034000 tx=0x7fc20402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:26.404 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.415+0000 7fc2037fe640 1 -- 172.21.15.172:0/2407355461 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc1fc0586f0 con 0x7fc20c0b3e10 2024-04-25T08:52:26.577 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.587+0000 7fc211241640 1 -- 172.21.15.172:0/2407355461 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc20c15d750 con 0x7fc20c0b3e10 2024-04-25T08:52:26.578 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.587+0000 7fc2037fe640 1 -- 172.21.15.172:0/2407355461 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1fc05c790 con 0x7fc20c0b3e10 2024-04-25T08:52:26.578 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 64 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 -- 172.21.15.172:0/2407355461 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1ec06b4d0 msgr2=0x7fc1ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1ec06b4d0 0x7fc1ec06d990 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc204034000 tx=0x7fc20402e000 comp rx=0 tx=0).stop 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 -- 172.21.15.172:0/2407355461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c0b3e10 msgr2=0x7fc20c154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c0b3e10 0x7fc20c154380 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00c6b0 tx=0x7fc1fc00cb70 comp rx=0 tx=0).stop 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 -- 172.21.15.172:0/2407355461 shutdown_connections 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc1ec06b4d0 0x7fc1ec06d990 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc20c06ec80 0x7fc20c1e8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc20c0b3e10 0x7fc20c154380 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 --2- 172.21.15.172:0/2407355461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc20c06e360 0x7fc20c0ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 -- 172.21.15.172:0/2407355461 >> 172.21.15.172:0/2407355461 conn(0x7fc20c0cfec0 msgr2=0x7fc20c074060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:26.580 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 -- 172.21.15.172:0/2407355461 shutdown_connections 2024-04-25T08:52:26.581 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.589+0000 7fc211241640 1 -- 172.21.15.172:0/2407355461 wait complete. 2024-04-25T08:52:26.591 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.699+0000 7f0a913fe640 1 Processor -- start 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.699+0000 7f0a913fe640 1 -- start start 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.700+0000 7f0a913fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0a8c15b950 0x7f0a8c0cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.700+0000 7f0a913fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.700+0000 7f0a913fe640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0cd6e0 con 0x7f0a8c0cdb40 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.700+0000 7f0a913fe640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c0cc3f0 con 0x7f0a8c15b950 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.700+0000 7f0a913fe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0cc640 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.700+0000 7f0a8affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0a8c15b950 0x7f0a8c0cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.700+0000 7f0a83fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0a8c0cdb40 0x7f0a8c0ce090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41440/0 (socket says 172.21.15.172:41440) 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.700+0000 7f0a83fff640 1 -- 172.21.15.172:0/1586802639 learned_addr learned my addr 172.21.15.172:0/1586802639 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8affd640 1 -- 172.21.15.172:0/1586802639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a8c0ce7a0 msgr2=0x7f0a8c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:26.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8b7fe640 1 --2- 172.21.15.172:0/1586802639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8a7fc640 1 -- 172.21.15.172:0/1586802639 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283052883 0 0) 0x7f0a8c0cd6e0 con 0x7f0a8c0cdb40 2024-04-25T08:52:26.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8affd640 1 --2- 172.21.15.172:0/1586802639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8affd640 1 -- 172.21.15.172:0/1586802639 >> v1:172.21.15.172:6789/0 conn(0x7f0a8c0cdb40 legacy=0x7f0a8c0ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8affd640 1 -- 172.21.15.172:0/1586802639 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0cc920 con 0x7f0a8c15b950 2024-04-25T08:52:26.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8b7fe640 1 --2- 172.21.15.172:0/1586802639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:26.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8affd640 1 --2- 172.21.15.172:0/1586802639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c15b950 0x7f0a8c0cbeb0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0097a0 tx=0x7f0a7c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb85cb804c057ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:26.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8a7fc640 1 -- 172.21.15.172:0/1586802639 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c037070 con 0x7f0a8c15b950 2024-04-25T08:52:26.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8a7fc640 1 -- 172.21.15.172:0/1586802639 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c032440 con 0x7f0a8c15b950 2024-04-25T08:52:26.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.701+0000 7f0a8a7fc640 1 -- 172.21.15.172:0/1586802639 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c032810 con 0x7f0a8c15b950 2024-04-25T08:52:26.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.702+0000 7f0a913fe640 1 -- 172.21.15.172:0/1586802639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c15b950 msgr2=0x7f0a8c0cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.702+0000 7f0a913fe640 1 --2- 172.21.15.172:0/1586802639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c15b950 0x7f0a8c0cbeb0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0097a0 tx=0x7f0a7c02a210 comp rx=0 tx=0).stop 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.702+0000 7f0a913fe640 1 -- 172.21.15.172:0/1586802639 shutdown_connections 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.702+0000 7f0a913fe640 1 --2- 172.21.15.172:0/1586802639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.702+0000 7f0a913fe640 1 --2- 172.21.15.172:0/1586802639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c15b950 0x7f0a8c0cbeb0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.702+0000 7f0a913fe640 1 -- 172.21.15.172:0/1586802639 >> 172.21.15.172:0/1586802639 conn(0x7f0a8c0b33e0 msgr2=0x7f0a8c0b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.702+0000 7f0a913fe640 1 -- 172.21.15.172:0/1586802639 shutdown_connections 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.702+0000 7f0a913fe640 1 -- 172.21.15.172:0/1586802639 wait complete. 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.703+0000 7f0a913fe640 1 Processor -- start 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.703+0000 7f0a913fe640 1 -- start start 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a913fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c0cdb40 0x7f0a8c14b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a913fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a913fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a8c15b950 0x7f0a8c0b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a913fe640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0cd1c0 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a913fe640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0ccee0 con 0x7f0a8c0cdb40 2024-04-25T08:52:26.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a913fe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0d02d0 con 0x7f0a8c15b950 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50496/0 (socket says 172.21.15.172:50496) 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a83fff640 1 -- 172.21.15.172:0/3844668664 learned_addr learned my addr 172.21.15.172:0/3844668664 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a83fff640 1 -- 172.21.15.172:0/3844668664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a8c15b950 msgr2=0x7f0a8c0b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a83fff640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a8c15b950 0x7f0a8c0b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a83fff640 1 -- 172.21.15.172:0/3844668664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c0cdb40 msgr2=0x7f0a8c14b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a83fff640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c0cdb40 0x7f0a8c14b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a83fff640 1 -- 172.21.15.172:0/3844668664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0cb210 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.704+0000 7f0a83fff640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0b1430 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400c4d0 tx=0x7f0a7400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.705+0000 7f0a837fe640 1 -- 172.21.15.172:0/3844668664 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74018070 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.705+0000 7f0a837fe640 1 -- 172.21.15.172:0/3844668664 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a74007500 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.705+0000 7f0a913fe640 1 -- 172.21.15.172:0/3844668664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c1f4d10 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.705+0000 7f0a837fe640 1 -- 172.21.15.172:0/3844668664 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74004a20 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.705+0000 7f0a913fe640 1 -- 172.21.15.172:0/3844668664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c1f52d0 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.706+0000 7f0a913fe640 1 -- 172.21.15.172:0/3844668664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c073990 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.706+0000 7f0a837fe640 1 -- 172.21.15.172:0/3844668664 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0a7401b070 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.706+0000 7f0a837fe640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a6c06b4d0 0x7f0a6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:26.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.707+0000 7f0a837fe640 1 -- 172.21.15.172:0/3844668664 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0a740896d0 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.707+0000 7f0a8affd640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a6c06b4d0 0x7f0a6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:26.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.707+0000 7f0a8affd640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a6c06b4d0 0x7f0a6c06d990 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c034000 tx=0x7f0a7c02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:26.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.711+0000 7f0a837fe640 1 -- 172.21.15.172:0/3844668664 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a74058390 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.918+0000 7f0a913fe640 1 -- 172.21.15.172:0/3844668664 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a8c071bc0 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.908 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.918+0000 7f0a837fe640 1 -- 172.21.15.172:0/3844668664 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4955 (secure 0 0 0) 0x7f0a74057c90 con 0x7f0a8c0ce7a0 2024-04-25T08:52:26.909 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:26.909 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":88,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3226910746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3226910746},{"type":"v1","addr":"172.21.15.186:6834","nonce":3226910746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/741856049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":741856049},{"type":"v1","addr":"172.21.15.186:6835","nonce":741856049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":88,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T08:51:58.007519+0000","modified":"2024-04-25T08:52:21.764362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9825},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9819":{"gid":9819,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/406316339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":406316339},{"type":"v1","addr":"172.21.15.172:6835","nonce":406316339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9825":{"gid":9825,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2096375996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2096375996},{"type":"v1","addr":"172.21.15.172:6837","nonce":2096375996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T08:52:26.909 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 88 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 -- 172.21.15.172:0/3844668664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a6c06b4d0 msgr2=0x7f0a6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a6c06b4d0 0x7f0a6c06d990 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c034000 tx=0x7f0a7c02c000 comp rx=0 tx=0).stop 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 -- 172.21.15.172:0/3844668664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0ce7a0 msgr2=0x7f0a8c0b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0b1430 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400c4d0 tx=0x7f0a7400c990 comp rx=0 tx=0).stop 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 -- 172.21.15.172:0/3844668664 shutdown_connections 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f0a6c06b4d0 0x7f0a6c06d990 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a8c15b950 0x7f0a8c0b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0ce7a0 0x7f0a8c0b1430 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 --2- 172.21.15.172:0/3844668664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a8c0cdb40 0x7f0a8c14b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 -- 172.21.15.172:0/3844668664 >> 172.21.15.172:0/3844668664 conn(0x7f0a8c0b33e0 msgr2=0x7f0a8c15a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:26.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 -- 172.21.15.172:0/3844668664 shutdown_connections 2024-04-25T08:52:26.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:26.920+0000 7f0a913fe640 1 -- 172.21.15.172:0/3844668664 wait complete. 2024-04-25T08:52:26.922 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:52:27.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.029+0000 7f7fbd763640 1 Processor -- start 2024-04-25T08:52:27.019 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.029+0000 7f7fbd763640 1 -- start start 2024-04-25T08:52:27.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fbd763640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7fb80b2cb0 0x7f7fb80d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fbd763640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb80b97a0 con 0x7f7fb80d1020 2024-04-25T08:52:27.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fbd763640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb80d1c50 con 0x7f7fb815dbe0 2024-04-25T08:52:27.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fbd763640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb815dfc0 con 0x7f7fb80b2cb0 2024-04-25T08:52:27.021 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fb67fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7fb80b2cb0 0x7f7fb80d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fb67fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7fb80b2cb0 0x7f7fb80d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50508/0 (socket says 172.21.15.172:50508) 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fb67fc640 1 -- 172.21.15.172:0/3019391538 learned_addr learned my addr 172.21.15.172:0/3019391538 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fb77fe640 1 --1- 172.21.15.172:0/3019391538 >> v1:172.21.15.172:6789/0 conn(0x7f7fb80d1020 0x7f7fb80d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41450/0 (socket says 172.21.15.172:41450) 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fb67fc640 1 -- 172.21.15.172:0/3019391538 >> v1:172.21.15.186:6789/0 conn(0x7f7fb815dbe0 legacy=0x7f7fb80d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fb67fc640 1 -- 172.21.15.172:0/3019391538 >> v1:172.21.15.172:6789/0 conn(0x7f7fb80d1020 legacy=0x7f7fb80d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fb5ffb640 1 -- 172.21.15.172:0/3019391538 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706151849 0 0) 0x7f7fb80b97a0 con 0x7f7fb80d1020 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.030+0000 7f7fb67fc640 1 -- 172.21.15.172:0/3019391538 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb80d1f30 con 0x7f7fb80b2cb0 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.031+0000 7f7fb67fc640 1 --2- 172.21.15.172:0/3019391538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80b2cb0 0x7f7fb80d2730 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009870 tx=0x7f7fac02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fc17029aa8bcad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.031+0000 7f7fb5ffb640 1 -- 172.21.15.172:0/3019391538 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac037070 con 0x7f7fb80b2cb0 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.031+0000 7f7fb5ffb640 1 -- 172.21.15.172:0/3019391538 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac032440 con 0x7f7fb80b2cb0 2024-04-25T08:52:27.022 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.031+0000 7f7fb5ffb640 1 -- 172.21.15.172:0/3019391538 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac032810 con 0x7f7fb80b2cb0 2024-04-25T08:52:27.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.032+0000 7f7fbd763640 1 -- 172.21.15.172:0/3019391538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80b2cb0 msgr2=0x7f7fb80d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.025 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.032+0000 7f7fbd763640 1 --2- 172.21.15.172:0/3019391538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80b2cb0 0x7f7fb80d2730 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009870 tx=0x7f7fac02a2a0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.032+0000 7f7fbd763640 1 -- 172.21.15.172:0/3019391538 shutdown_connections 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.032+0000 7f7fbd763640 1 --2- 172.21.15.172:0/3019391538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80b2cb0 0x7f7fb80d2730 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.032+0000 7f7fbd763640 1 -- 172.21.15.172:0/3019391538 >> 172.21.15.172:0/3019391538 conn(0x7f7fb8061a20 msgr2=0x7f7fb8061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.032+0000 7f7fbd763640 1 -- 172.21.15.172:0/3019391538 shutdown_connections 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.032+0000 7f7fbd763640 1 -- 172.21.15.172:0/3019391538 wait complete. 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.033+0000 7f7fbd763640 1 Processor -- start 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.033+0000 7f7fbd763640 1 -- start start 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fbd763640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fb80b2cb0 0x7f7fb8154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fbd763640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80d1020 0x7f7fb80b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fbd763640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fb815dbe0 0x7f7fb81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fbd763640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80b92a0 con 0x7f7fb80d1020 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fbd763640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80d1a00 con 0x7f7fb80b2cb0 2024-04-25T08:52:27.026 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fbd763640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80b9420 con 0x7f7fb815dbe0 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb67fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80d1020 0x7f7fb80b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb67fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80d1020 0x7f7fb80b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50512/0 (socket says 172.21.15.172:50512) 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb67fc640 1 -- 172.21.15.172:0/2989804632 learned_addr learned my addr 172.21.15.172:0/2989804632 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb6ffd640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fb80b2cb0 0x7f7fb8154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb77fe640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fb815dbe0 0x7f7fb81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb67fc640 1 -- 172.21.15.172:0/2989804632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fb815dbe0 msgr2=0x7f7fb81556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb67fc640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fb815dbe0 0x7f7fb81556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb67fc640 1 -- 172.21.15.172:0/2989804632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fb80b2cb0 msgr2=0x7f7fb8154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb67fc640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fb80b2cb0 0x7f7fb8154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb67fc640 1 -- 172.21.15.172:0/2989804632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb80cbc50 con 0x7f7fb80d1020 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb6ffd640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fb80b2cb0 0x7f7fb8154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fb67fc640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80d1020 0x7f7fb80b5d30 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f7fac000c00 tx=0x7f7fac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7f9f7fe640 1 -- 172.21.15.172:0/2989804632 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac041070 con 0x7f7fb80d1020 2024-04-25T08:52:27.027 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7f9f7fe640 1 -- 172.21.15.172:0/2989804632 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac03c870 con 0x7f7fb80d1020 2024-04-25T08:52:27.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7f9f7fe640 1 -- 172.21.15.172:0/2989804632 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac037040 con 0x7f7fb80d1020 2024-04-25T08:52:27.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.034+0000 7f7fbd763640 1 -- 172.21.15.172:0/2989804632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb80b6270 con 0x7f7fb80d1020 2024-04-25T08:52:27.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.035+0000 7f7fbd763640 1 -- 172.21.15.172:0/2989804632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb80cda70 con 0x7f7fb80d1020 2024-04-25T08:52:27.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.035+0000 7f7fbd763640 1 -- 172.21.15.172:0/2989804632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb8073990 con 0x7f7fb80d1020 2024-04-25T08:52:27.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.036+0000 7f7f9f7fe640 1 -- 172.21.15.172:0/2989804632 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7fac044070 con 0x7f7fb80d1020 2024-04-25T08:52:27.028 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.036+0000 7f7f9f7fe640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa406b4d0 0x7f7fa406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.036+0000 7f7f9f7fe640 1 -- 172.21.15.172:0/2989804632 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7fac0aae70 con 0x7f7fb80d1020 2024-04-25T08:52:27.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.036+0000 7f7fb6ffd640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa406b4d0 0x7f7fa406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.029 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.037+0000 7f7fb6ffd640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa406b4d0 0x7f7fa406d990 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800a830 tx=0x7f7fa8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.030 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.040+0000 7f7f9f7fe640 1 -- 172.21.15.172:0/2989804632 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7fac079c50 con 0x7f7fb80d1020 2024-04-25T08:52:27.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.212+0000 7f7fbd763640 1 -- 172.21.15.172:0/2989804632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fb80cef40 con 0x7f7fb80d1020 2024-04-25T08:52:27.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.213+0000 7f7f9f7fe640 1 -- 172.21.15.172:0/2989804632 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17110 (secure 0 0 0) 0x7f7fac079550 con 0x7f7fb80d1020 2024-04-25T08:52:27.204 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:27.204 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":145,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:52:10.728530+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:51:56.275448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T08:51:56.984469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.12","mappings":[{"from":3,"to":0}]},{"pgid":"22.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:52:27.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.215+0000 7f7fbd763640 1 -- 172.21.15.172:0/2989804632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa406b4d0 msgr2=0x7f7fa406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.215+0000 7f7fbd763640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa406b4d0 0x7f7fa406d990 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800a830 tx=0x7f7fa8008040 comp rx=0 tx=0).stop 2024-04-25T08:52:27.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.216+0000 7f7fbd763640 1 -- 172.21.15.172:0/2989804632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80d1020 msgr2=0x7f7fb80b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.216+0000 7f7fbd763640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80d1020 0x7f7fb80b5d30 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f7fac000c00 tx=0x7f7fac0046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.216+0000 7f7fbd763640 1 -- 172.21.15.172:0/2989804632 shutdown_connections 2024-04-25T08:52:27.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.216+0000 7f7fbd763640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f7fa406b4d0 0x7f7fa406d990 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.206 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.216+0000 7f7fbd763640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7fb815dbe0 0x7f7fb81556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.216+0000 7f7fbd763640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb80d1020 0x7f7fb80b5d30 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.216+0000 7f7fbd763640 1 --2- 172.21.15.172:0/2989804632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7fb80b2cb0 0x7f7fb8154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.216+0000 7f7fbd763640 1 -- 172.21.15.172:0/2989804632 >> 172.21.15.172:0/2989804632 conn(0x7f7fb8061a20 msgr2=0x7f7fb815cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:27.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.216+0000 7f7fbd763640 1 -- 172.21.15.172:0/2989804632 shutdown_connections 2024-04-25T08:52:27.207 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.216+0000 7f7fbd763640 1 -- 172.21.15.172:0/2989804632 wait complete. 2024-04-25T08:52:27.218 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:52:27.218 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:52:27.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.324+0000 7f36e9ae2640 1 Processor -- start 2024-04-25T08:52:27.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.324+0000 7f36e9ae2640 1 -- start start 2024-04-25T08:52:27.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.325+0000 7f36e9ae2640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f36e415dc70 0x7f36e40d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.325+0000 7f36e9ae2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e406ce10 0x7f36e40cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.325+0000 7f36e9ae2640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e406c220 con 0x7f36e409a450 2024-04-25T08:52:27.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.325+0000 7f36e9ae2640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e40d0c90 con 0x7f36e415dc70 2024-04-25T08:52:27.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.325+0000 7f36e9ae2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40d0080 con 0x7f36e406ce10 2024-04-25T08:52:27.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e3fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e406ce10 0x7f36e40cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e37fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f36e415dc70 0x7f36e40d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e2ffd640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f36e409a450 0x7f36e406c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:41270/0 (socket says 172.21.15.172:41270) 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e37fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f36e415dc70 0x7f36e40d1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:49542/0 (socket says 172.21.15.172:49542) 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e3fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e406ce10 0x7f36e40cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:52912/0 (socket says 172.21.15.172:52912) 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e2ffd640 1 -- 172.21.15.172:0/464042375 learned_addr learned my addr 172.21.15.172:0/464042375 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e27fc640 1 -- 172.21.15.172:0/464042375 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063029983 0 0) 0x7f36e406c220 con 0x7f36e409a450 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e27fc640 1 -- 172.21.15.172:0/464042375 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36cc003520 con 0x7f36e409a450 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e37fe640 1 -- 172.21.15.172:0/464042375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e406ce10 msgr2=0x7f36e40cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e37fe640 1 --2- 172.21.15.172:0/464042375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e406ce10 0x7f36e40cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e37fe640 1 -- 172.21.15.172:0/464042375 >> v1:172.21.15.186:6789/0 conn(0x7f36e409a450 legacy=0x7f36e406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e37fe640 1 -- 172.21.15.172:0/464042375 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40d0360 con 0x7f36e415dc70 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.326+0000 7f36e3fff640 1 --2- 172.21.15.172:0/464042375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e406ce10 0x7f36e40cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.327+0000 7f36e37fe640 1 --2- 172.21.15.172:0/464042375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36e415dc70 0x7f36e40d1120 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f36d40097a0 tx=0x7f36d402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e455d276eb85361a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.318 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.327+0000 7f36e27fc640 1 -- 172.21.15.172:0/464042375 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4037070 con 0x7f36e415dc70 2024-04-25T08:52:27.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.327+0000 7f36e27fc640 1 -- 172.21.15.172:0/464042375 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d4032440 con 0x7f36e415dc70 2024-04-25T08:52:27.319 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.327+0000 7f36e27fc640 1 -- 172.21.15.172:0/464042375 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4032810 con 0x7f36e415dc70 2024-04-25T08:52:27.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.327+0000 7f36e9ae2640 1 -- 172.21.15.172:0/464042375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36e415dc70 msgr2=0x7f36e40d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.327+0000 7f36e9ae2640 1 --2- 172.21.15.172:0/464042375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36e415dc70 0x7f36e40d1120 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f36d40097a0 tx=0x7f36d402a180 comp rx=0 tx=0).stop 2024-04-25T08:52:27.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.327+0000 7f36e9ae2640 1 -- 172.21.15.172:0/464042375 shutdown_connections 2024-04-25T08:52:27.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.327+0000 7f36e9ae2640 1 --2- 172.21.15.172:0/464042375 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e406ce10 0x7f36e40cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.327+0000 7f36e9ae2640 1 --2- 172.21.15.172:0/464042375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36e415dc70 0x7f36e40d1120 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.327+0000 7f36e9ae2640 1 -- 172.21.15.172:0/464042375 >> 172.21.15.172:0/464042375 conn(0x7f36e40b3270 msgr2=0x7f36e40b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:27.321 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.328+0000 7f36e9ae2640 1 -- 172.21.15.172:0/464042375 shutdown_connections 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.328+0000 7f36e9ae2640 1 -- 172.21.15.172:0/464042375 wait complete. 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.329+0000 7f36e9ae2640 1 Processor -- start 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.329+0000 7f36e9ae2640 1 -- start start 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.329+0000 7f36e9ae2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e406ce10 0x7f36e40c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.329+0000 7f36e9ae2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36e409a450 0x7f36e414e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.329+0000 7f36e9ae2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e415dc70 0x7f36e40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e9ae2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e415e050 con 0x7f36e406ce10 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e9ae2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40d0920 con 0x7f36e409a450 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e9ae2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40cbdd0 con 0x7f36e415dc70 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e406ce10 0x7f36e40c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e37fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e406ce10 0x7f36e40c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:50524/0 (socket says 172.21.15.172:50524) 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e37fe640 1 -- 172.21.15.172:0/1810885956 learned_addr learned my addr 172.21.15.172:0/1810885956 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e2ffd640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36e409a450 0x7f36e414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e3fff640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e415dc70 0x7f36e40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e37fe640 1 -- 172.21.15.172:0/1810885956 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e415dc70 msgr2=0x7f36e40cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e37fe640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e415dc70 0x7f36e40cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e37fe640 1 -- 172.21.15.172:0/1810885956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36e409a450 msgr2=0x7f36e414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e37fe640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36e409a450 0x7f36e414e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e37fe640 1 -- 172.21.15.172:0/1810885956 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e414ef60 con 0x7f36e406ce10 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e37fe640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e406ce10 0x7f36e40c8850 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f36d40096f0 tx=0x7f36d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36cbfff640 1 -- 172.21.15.172:0/1810885956 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4041020 con 0x7f36e406ce10 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36cbfff640 1 -- 172.21.15.172:0/1810885956 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d403d700 con 0x7f36e406ce10 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e9ae2640 1 -- 172.21.15.172:0/1810885956 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e414f200 con 0x7f36e406ce10 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36cbfff640 1 -- 172.21.15.172:0/1810885956 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4037040 con 0x7f36e406ce10 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.330+0000 7f36e9ae2640 1 -- 172.21.15.172:0/1810885956 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e414f7c0 con 0x7f36e406ce10 2024-04-25T08:52:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.331+0000 7f36e9ae2640 1 -- 172.21.15.172:0/1810885956 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e4073990 con 0x7f36e406ce10 2024-04-25T08:52:27.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.332+0000 7f36cbfff640 1 -- 172.21.15.172:0/1810885956 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f36d4044020 con 0x7f36e406ce10 2024-04-25T08:52:27.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.332+0000 7f36cbfff640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f36d006b4d0 0x7f36d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.332+0000 7f36cbfff640 1 -- 172.21.15.172:0/1810885956 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f36d40aaaa0 con 0x7f36e406ce10 2024-04-25T08:52:27.324 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.332+0000 7f36e2ffd640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f36d006b4d0 0x7f36d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.333+0000 7f36e2ffd640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f36d006b4d0 0x7f36d006d990 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f36d8005880 tx=0x7f36d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.336+0000 7f36cbfff640 1 -- 172.21.15.172:0/1810885956 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36d404b030 con 0x7f36e406ce10 2024-04-25T08:52:27.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.544+0000 7f36e9ae2640 1 -- 172.21.15.172:0/1810885956 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36e40b40a0 con 0x7f36e406ce10 2024-04-25T08:52:27.534 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.544+0000 7f36cbfff640 1 -- 172.21.15.172:0/1810885956 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4955 (secure 0 0 0) 0x7f36d4079770 con 0x7f36e406ce10 2024-04-25T08:52:27.535 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:27.535 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":88,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3226910746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3226910746},{"type":"v1","addr":"172.21.15.186:6834","nonce":3226910746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/741856049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":741856049},{"type":"v1","addr":"172.21.15.186:6835","nonce":741856049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":88,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T08:51:58.007519+0000","modified":"2024-04-25T08:52:21.764362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9825},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9819":{"gid":9819,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/406316339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":406316339},{"type":"v1","addr":"172.21.15.172:6835","nonce":406316339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9825":{"gid":9825,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2096375996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2096375996},{"type":"v1","addr":"172.21.15.172:6837","nonce":2096375996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T08:52:27.535 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 88 2024-04-25T08:52:27.536 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 -- 172.21.15.172:0/1810885956 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f36d006b4d0 msgr2=0x7f36d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f36d006b4d0 0x7f36d006d990 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f36d8005880 tx=0x7f36d8009040 comp rx=0 tx=0).stop 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 -- 172.21.15.172:0/1810885956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e406ce10 msgr2=0x7f36e40c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e406ce10 0x7f36e40c8850 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f36d40096f0 tx=0x7f36d40046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 -- 172.21.15.172:0/1810885956 shutdown_connections 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f36d006b4d0 0x7f36d006d990 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36e409a450 0x7f36e414e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36e415dc70 0x7f36e40cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 --2- 172.21.15.172:0/1810885956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36e406ce10 0x7f36e40c8850 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 -- 172.21.15.172:0/1810885956 >> 172.21.15.172:0/1810885956 conn(0x7f36e40b3270 msgr2=0x7f36e40b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 -- 172.21.15.172:0/1810885956 shutdown_connections 2024-04-25T08:52:27.537 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.546+0000 7f36e9ae2640 1 -- 172.21.15.172:0/1810885956 wait complete. 2024-04-25T08:52:27.548 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:52:27.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.655+0000 7fe2210cb640 1 Processor -- start 2024-04-25T08:52:27.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.655+0000 7fe2210cb640 1 -- start start 2024-04-25T08:52:27.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.655+0000 7fe2210cb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe21c154ee0 0x7fe21c0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.655+0000 7fe2210cb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe21c0ce590 0x7fe21c06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe2210cb640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c071480 con 0x7fe21c0cfcf0 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe2210cb640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c072090 con 0x7fe21c0ce590 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe2210cb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c071230 con 0x7fe21c154ee0 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe21b59e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe21c0ce590 0x7fe21c06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe21a59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe21c0cfcf0 0x7fe21c0cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45970/0 (socket says 172.21.15.172:45970) 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe21b59e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe21c0ce590 0x7fe21c06d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52826/0 (socket says 172.21.15.172:52826) 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe21a59c640 1 -- 172.21.15.172:0/3485720096 learned_addr learned my addr 172.21.15.172:0/3485720096 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe21ad9d640 1 --2- 172.21.15.172:0/3485720096 >> v2:172.21.15.186:3300/0 conn(0x7fe21c154ee0 0x7fe21c0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe21b59e640 1 -- 172.21.15.172:0/3485720096 >> v2:172.21.15.186:3300/0 conn(0x7fe21c154ee0 msgr2=0x7fe21c0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe21b59e640 1 --2- 172.21.15.172:0/3485720096 >> v2:172.21.15.186:3300/0 conn(0x7fe21c154ee0 0x7fe21c0cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe21b59e640 1 -- 172.21.15.172:0/3485720096 >> v1:172.21.15.172:6789/0 conn(0x7fe21c0cfcf0 legacy=0x7fe21c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe21b59e640 1 -- 172.21.15.172:0/3485720096 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c071760 con 0x7fe21c0ce590 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.656+0000 7fe219d9b640 1 -- 172.21.15.172:0/3485720096 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535159483 0 0) 0x7fe21c071480 con 0x7fe21c0cfcf0 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe21b59e640 1 --2- 172.21.15.172:0/3485720096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 0x7fe21c06d6f0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0d02e0 tx=0x7fe21402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da2d2be22e92917 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe219d9b640 1 -- 172.21.15.172:0/3485720096 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214007740 con 0x7fe21c0ce590 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe219d9b640 1 -- 172.21.15.172:0/3485720096 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2140078e0 con 0x7fe21c0ce590 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe219d9b640 1 -- 172.21.15.172:0/3485720096 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214007cb0 con 0x7fe21c0ce590 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe2210cb640 1 -- 172.21.15.172:0/3485720096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 msgr2=0x7fe21c06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe2210cb640 1 --2- 172.21.15.172:0/3485720096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 0x7fe21c06d6f0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0d02e0 tx=0x7fe21402a680 comp rx=0 tx=0).stop 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe2210cb640 1 -- 172.21.15.172:0/3485720096 shutdown_connections 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe2210cb640 1 --2- 172.21.15.172:0/3485720096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 0x7fe21c06d6f0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe2210cb640 1 --2- 172.21.15.172:0/3485720096 >> v2:172.21.15.186:3300/0 conn(0x7fe21c154ee0 0x7fe21c0cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe2210cb640 1 -- 172.21.15.172:0/3485720096 >> 172.21.15.172:0/3485720096 conn(0x7fe21c06abe0 msgr2=0x7fe21c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe2210cb640 1 -- 172.21.15.172:0/3485720096 shutdown_connections 2024-04-25T08:52:27.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.657+0000 7fe2210cb640 1 -- 172.21.15.172:0/3485720096 wait complete. 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.659+0000 7fe2210cb640 1 Processor -- start 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.659+0000 7fe2210cb640 1 -- start start 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2210cb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 0x7fe21c1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2210cb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe21c0cfcf0 0x7fe21c14b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2210cb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe21c154ee0 0x7fe21c14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2210cb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c1552c0 con 0x7fe21c0ce590 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2210cb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c071d20 con 0x7fe21c154ee0 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2210cb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c155440 con 0x7fe21c0cfcf0 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 0x7fe21c1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21ad9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 0x7fe21c1513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52832/0 (socket says 172.21.15.172:52832) 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21ad9d640 1 -- 172.21.15.172:0/4097664250 learned_addr learned my addr 172.21.15.172:0/4097664250 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:27.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21b59e640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe21c154ee0 0x7fe21c14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21a59c640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe21c0cfcf0 0x7fe21c14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21ad9d640 1 -- 172.21.15.172:0/4097664250 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe21c0cfcf0 msgr2=0x7fe21c14b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21ad9d640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe21c0cfcf0 0x7fe21c14b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21ad9d640 1 -- 172.21.15.172:0/4097664250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe21c154ee0 msgr2=0x7fe21c14c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21ad9d640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe21c154ee0 0x7fe21c14c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21ad9d640 1 -- 172.21.15.172:0/4097664250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c14b850 con 0x7fe21c0ce590 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21b59e640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe21c154ee0 0x7fe21c14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21a59c640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe21c0cfcf0 0x7fe21c14b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe21ad9d640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 0x7fe21c1513b0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00d5f0 tx=0x7fe20c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2037fe640 1 -- 172.21.15.172:0/4097664250 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c0125f0 con 0x7fe21c0ce590 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2037fe640 1 -- 172.21.15.172:0/4097664250 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20c019070 con 0x7fe21c0ce590 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2210cb640 1 -- 172.21.15.172:0/4097664250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21c14bb30 con 0x7fe21c0ce590 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2037fe640 1 -- 172.21.15.172:0/4097664250 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c0129d0 con 0x7fe21c0ce590 2024-04-25T08:52:27.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.660+0000 7fe2210cb640 1 -- 172.21.15.172:0/4097664250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c14c0f0 con 0x7fe21c0ce590 2024-04-25T08:52:27.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.661+0000 7fe2210cb640 1 -- 172.21.15.172:0/4097664250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21c073990 con 0x7fe21c0ce590 2024-04-25T08:52:27.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.662+0000 7fe2037fe640 1 -- 172.21.15.172:0/4097664250 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe20c012b70 con 0x7fe21c0ce590 2024-04-25T08:52:27.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.662+0000 7fe2037fe640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe20806b4d0 0x7fe20806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.662+0000 7fe2037fe640 1 -- 172.21.15.172:0/4097664250 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe20c08a6f0 con 0x7fe21c0ce590 2024-04-25T08:52:27.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.662+0000 7fe21a59c640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe20806b4d0 0x7fe20806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.663+0000 7fe21a59c640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe20806b4d0 0x7fe20806d990 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe21c1f2b00 tx=0x7fe210009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.666+0000 7fe2037fe640 1 -- 172.21.15.172:0/4097664250 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe20c059440 con 0x7fe21c0ce590 2024-04-25T08:52:27.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.876+0000 7fe2210cb640 1 -- 172.21.15.172:0/4097664250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe21c1546e0 con 0x7fe21c0ce590 2024-04-25T08:52:27.866 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.876+0000 7fe2037fe640 1 -- 172.21.15.172:0/4097664250 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4955 (secure 0 0 0) 0x7fe20c058d40 con 0x7fe21c0ce590 2024-04-25T08:52:27.867 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:27.867 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":88,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3226910746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3226910746},{"type":"v1","addr":"172.21.15.186:6834","nonce":3226910746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/741856049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":741856049},{"type":"v1","addr":"172.21.15.186:6835","nonce":741856049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":88,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T08:51:58.007519+0000","modified":"2024-04-25T08:52:21.764362+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9825},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9819":{"gid":9819,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/406316339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":406316339},{"type":"v1","addr":"172.21.15.172:6835","nonce":406316339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_9825":{"gid":9825,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/2096375996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2096375996},{"type":"v1","addr":"172.21.15.172:6837","nonce":2096375996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-04-25T08:52:27.867 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 88 2024-04-25T08:52:27.868 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 -- 172.21.15.172:0/4097664250 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe20806b4d0 msgr2=0x7fe20806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe20806b4d0 0x7fe20806d990 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe21c1f2b00 tx=0x7fe210009040 comp rx=0 tx=0).stop 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 -- 172.21.15.172:0/4097664250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 msgr2=0x7fe21c1513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 0x7fe21c1513b0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00d5f0 tx=0x7fe20c00dab0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 -- 172.21.15.172:0/4097664250 shutdown_connections 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe20806b4d0 0x7fe20806d990 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe21c154ee0 0x7fe21c14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe21c0cfcf0 0x7fe21c14b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 --2- 172.21.15.172:0/4097664250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe21c0ce590 0x7fe21c1513b0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 -- 172.21.15.172:0/4097664250 >> 172.21.15.172:0/4097664250 conn(0x7fe21c06abe0 msgr2=0x7fe21c06d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 -- 172.21.15.172:0/4097664250 shutdown_connections 2024-04-25T08:52:27.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.878+0000 7fe2210cb640 1 -- 172.21.15.172:0/4097664250 wait complete. 2024-04-25T08:52:27.880 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:52:27.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.987+0000 7f3af33d5640 1 Processor -- start 2024-04-25T08:52:27.977 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.987+0000 7f3af33d5640 1 -- start start 2024-04-25T08:52:27.978 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af33d5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3aec06abe0 0x7f3aec06afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af33d5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3aec15d370 0x7f3aec15d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af33d5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec1626e0 con 0x7f3aec0ce330 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af33d5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aec06b500 con 0x7f3aec15d370 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af33d5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aec070270 con 0x7f3aec06abe0 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af1972640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3aec15d370 0x7f3aec15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af1972640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3aec15d370 0x7f3aec15d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52842/0 (socket says 172.21.15.172:52842) 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af1972640 1 -- 172.21.15.172:0/1315624463 learned_addr learned my addr 172.21.15.172:0/1315624463 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af1171640 1 --2- 172.21.15.172:0/1315624463 >> v2:172.21.15.186:3300/0 conn(0x7f3aec06abe0 0x7f3aec06afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af1972640 1 -- 172.21.15.172:0/1315624463 >> v2:172.21.15.186:3300/0 conn(0x7f3aec06abe0 msgr2=0x7f3aec06afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af1972640 1 --2- 172.21.15.172:0/1315624463 >> v2:172.21.15.186:3300/0 conn(0x7f3aec06abe0 0x7f3aec06afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af1972640 1 -- 172.21.15.172:0/1315624463 >> v1:172.21.15.186:6789/0 conn(0x7f3aec0ce330 legacy=0x7f3aec06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:27.979 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.988+0000 7f3af1972640 1 -- 172.21.15.172:0/1315624463 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec0cd270 con 0x7f3aec15d370 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.989+0000 7f3af1972640 1 --2- 172.21.15.172:0/1315624463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec15d370 0x7f3aec15d780 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f3aec06e200 tx=0x7f3ae402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ae1c8e86f38262 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.989+0000 7f3ae3fff640 1 -- 172.21.15.172:0/1315624463 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4036070 con 0x7f3aec15d370 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.989+0000 7f3ae3fff640 1 -- 172.21.15.172:0/1315624463 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae4031600 con 0x7f3aec15d370 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.989+0000 7f3ae3fff640 1 -- 172.21.15.172:0/1315624463 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40319d0 con 0x7f3aec15d370 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.990+0000 7f3af33d5640 1 -- 172.21.15.172:0/1315624463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec15d370 msgr2=0x7f3aec15d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.990+0000 7f3af33d5640 1 --2- 172.21.15.172:0/1315624463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec15d370 0x7f3aec15d780 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f3aec06e200 tx=0x7f3ae402a660 comp rx=0 tx=0).stop 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.990+0000 7f3af33d5640 1 -- 172.21.15.172:0/1315624463 shutdown_connections 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.990+0000 7f3af33d5640 1 --2- 172.21.15.172:0/1315624463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec15d370 0x7f3aec15d780 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.990+0000 7f3af33d5640 1 --2- 172.21.15.172:0/1315624463 >> v2:172.21.15.186:3300/0 conn(0x7f3aec06abe0 0x7f3aec06afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.990+0000 7f3af33d5640 1 -- 172.21.15.172:0/1315624463 >> 172.21.15.172:0/1315624463 conn(0x7f3aec0b2220 msgr2=0x7f3aec0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:27.981 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.990+0000 7f3af33d5640 1 -- 172.21.15.172:0/1315624463 shutdown_connections 2024-04-25T08:52:27.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.990+0000 7f3af33d5640 1 -- 172.21.15.172:0/1315624463 wait complete. 2024-04-25T08:52:27.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.991+0000 7f3af33d5640 1 Processor -- start 2024-04-25T08:52:27.982 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.991+0000 7f3af33d5640 1 -- start start 2024-04-25T08:52:27.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af33d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec06abe0 0x7f3aec15b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af33d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aec0ce330 0x7f3aec0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.984 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af33d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aec15d370 0x7f3aec15e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af33d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0cdb10 con 0x7f3aec06abe0 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af33d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0cd830 con 0x7f3aec0ce330 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af33d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec161780 con 0x7f3aec15d370 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1171640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec06abe0 0x7f3aec15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1171640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec06abe0 0x7f3aec15b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52848/0 (socket says 172.21.15.172:52848) 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1171640 1 -- 172.21.15.172:0/3739997236 learned_addr learned my addr 172.21.15.172:0/3739997236 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af0970640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aec0ce330 0x7f3aec0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1972640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aec15d370 0x7f3aec15e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1171640 1 -- 172.21.15.172:0/3739997236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aec15d370 msgr2=0x7f3aec15e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1171640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aec15d370 0x7f3aec15e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1171640 1 -- 172.21.15.172:0/3739997236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aec0ce330 msgr2=0x7f3aec0ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1171640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aec0ce330 0x7f3aec0ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1171640 1 -- 172.21.15.172:0/3739997236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec1f8260 con 0x7f3aec06abe0 2024-04-25T08:52:27.985 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af0970640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aec0ce330 0x7f3aec0ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1972640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aec15d370 0x7f3aec15e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af1171640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec06abe0 0x7f3aec15b530 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800d620 tx=0x7f3ae800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3ae1ffb640 1 -- 172.21.15.172:0/3739997236 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae800b620 con 0x7f3aec06abe0 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3ae1ffb640 1 -- 172.21.15.172:0/3739997236 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8019070 con 0x7f3aec06abe0 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3af33d5640 1 -- 172.21.15.172:0/3739997236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aec15aa70 con 0x7f3aec06abe0 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.992+0000 7f3ae1ffb640 1 -- 172.21.15.172:0/3739997236 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae800ba00 con 0x7f3aec06abe0 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.993+0000 7f3af33d5640 1 -- 172.21.15.172:0/3739997236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aec15ba70 con 0x7f3aec06abe0 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.994+0000 7f3af33d5640 1 -- 172.21.15.172:0/3739997236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aec073990 con 0x7f3aec06abe0 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.994+0000 7f3ae1ffb640 1 -- 172.21.15.172:0/3739997236 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ae800bba0 con 0x7f3aec06abe0 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.994+0000 7f3ae1ffb640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ad006b4d0 0x7f3ad006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.994+0000 7f3ae1ffb640 1 -- 172.21.15.172:0/3739997236 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3ae808a770 con 0x7f3aec06abe0 2024-04-25T08:52:27.986 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.994+0000 7f3af0970640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ad006b4d0 0x7f3ad006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:27.987 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.995+0000 7f3af0970640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ad006b4d0 0x7f3ad006d990 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3aec1610d0 tx=0x7f3adc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:27.989 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:27.998+0000 7f3ae1ffb640 1 -- 172.21.15.172:0/3739997236 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ae80594c0 con 0x7f3aec06abe0 2024-04-25T08:52:28.158 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.168+0000 7f3af33d5640 1 -- 172.21.15.172:0/3739997236 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3aec0afe50 con 0x7f3aec06abe0 2024-04-25T08:52:28.159 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.169+0000 7f3ae1ffb640 1 -- 172.21.15.172:0/3739997236 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+17110 (secure 0 0 0) 0x7f3ae8058dc0 con 0x7f3aec06abe0 2024-04-25T08:52:28.160 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:28.160 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":145,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:52:10.728530+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-04-25T08:51:56.275448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-04-25T08:51:56.984469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.12","mappings":[{"from":3,"to":0}]},{"pgid":"22.13","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:52:28.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 -- 172.21.15.172:0/3739997236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ad006b4d0 msgr2=0x7f3ad006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ad006b4d0 0x7f3ad006d990 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3aec1610d0 tx=0x7f3adc009040 comp rx=0 tx=0).stop 2024-04-25T08:52:28.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 -- 172.21.15.172:0/3739997236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec06abe0 msgr2=0x7f3aec15b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec06abe0 0x7f3aec15b530 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800d620 tx=0x7f3ae800dae0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 -- 172.21.15.172:0/3739997236 shutdown_connections 2024-04-25T08:52:28.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ad006b4d0 0x7f3ad006d990 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aec0ce330 0x7f3aec0ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3aec15d370 0x7f3aec15e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 --2- 172.21.15.172:0/3739997236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3aec06abe0 0x7f3aec15b530 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.162 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 -- 172.21.15.172:0/3739997236 >> 172.21.15.172:0/3739997236 conn(0x7f3aec0b2220 msgr2=0x7f3aec0b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:28.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 -- 172.21.15.172:0/3739997236 shutdown_connections 2024-04-25T08:52:28.163 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.171+0000 7f3af33d5640 1 -- 172.21.15.172:0/3739997236 wait complete. 2024-04-25T08:52:28.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T08:52:28.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.281+0000 7f20e4e4a640 1 Processor -- start 2024-04-25T08:52:28.271 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.281+0000 7f20e4e4a640 1 -- start start 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.281+0000 7f20e4e4a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f20e006e360 0x7f20e006e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.281+0000 7f20e4e4a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006ec80 0x7f20e00b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.281+0000 7f20e4e4a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e015e020 con 0x7f20e00b3e10 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.281+0000 7f20e4e4a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e006b890 con 0x7f20e006e360 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.281+0000 7f20e4e4a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e006ac80 con 0x7f20e006ec80 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.282+0000 7f20de59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f20e006e360 0x7f20e006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.282+0000 7f20ded9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f20e00b3e10 0x7f20e006bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45974/0 (socket says 172.21.15.172:45974) 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.282+0000 7f20ded9d640 1 -- 172.21.15.172:0/2751697469 learned_addr learned my addr 172.21.15.172:0/2751697469 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.282+0000 7f20de59c640 1 -- 172.21.15.172:0/2751697469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006ec80 msgr2=0x7f20e00b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.282+0000 7f20d7fff640 1 --2- 172.21.15.172:0/2751697469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006ec80 0x7f20e00b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.282+0000 7f20ddd9b640 1 -- 172.21.15.172:0/2751697469 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692587483 0 0) 0x7f20e015e020 con 0x7f20e00b3e10 2024-04-25T08:52:28.273 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.282+0000 7f20de59c640 1 --2- 172.21.15.172:0/2751697469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006ec80 0x7f20e00b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.282+0000 7f20de59c640 1 -- 172.21.15.172:0/2751697469 >> v1:172.21.15.172:6789/0 conn(0x7f20e00b3e10 legacy=0x7f20e006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.282+0000 7f20de59c640 1 -- 172.21.15.172:0/2751697469 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e006af60 con 0x7f20e006e360 2024-04-25T08:52:28.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.282+0000 7f20d7fff640 1 --2- 172.21.15.172:0/2751697469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006ec80 0x7f20e00b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:28.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20de59c640 1 --2- 172.21.15.172:0/2751697469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e006e360 0x7f20e006e740 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f20d00097a0 tx=0x7f20d002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0448c7487cda4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:28.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20ddd9b640 1 -- 172.21.15.172:0/2751697469 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0037070 con 0x7f20e006e360 2024-04-25T08:52:28.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20ddd9b640 1 -- 172.21.15.172:0/2751697469 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d0032440 con 0x7f20e006e360 2024-04-25T08:52:28.274 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20ddd9b640 1 -- 172.21.15.172:0/2751697469 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0032810 con 0x7f20e006e360 2024-04-25T08:52:28.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20e4e4a640 1 -- 172.21.15.172:0/2751697469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e006e360 msgr2=0x7f20e006e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20e4e4a640 1 --2- 172.21.15.172:0/2751697469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e006e360 0x7f20e006e740 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f20d00097a0 tx=0x7f20d002a210 comp rx=0 tx=0).stop 2024-04-25T08:52:28.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20e4e4a640 1 -- 172.21.15.172:0/2751697469 shutdown_connections 2024-04-25T08:52:28.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20e4e4a640 1 --2- 172.21.15.172:0/2751697469 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006ec80 0x7f20e00b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20e4e4a640 1 --2- 172.21.15.172:0/2751697469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e006e360 0x7f20e006e740 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20e4e4a640 1 -- 172.21.15.172:0/2751697469 >> 172.21.15.172:0/2751697469 conn(0x7f20e00cfec0 msgr2=0x7f20e00d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:28.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20e4e4a640 1 -- 172.21.15.172:0/2751697469 shutdown_connections 2024-04-25T08:52:28.275 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.283+0000 7f20e4e4a640 1 -- 172.21.15.172:0/2751697469 wait complete. 2024-04-25T08:52:28.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.285+0000 7f20e4e4a640 1 Processor -- start 2024-04-25T08:52:28.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.285+0000 7f20e4e4a640 1 -- start start 2024-04-25T08:52:28.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.285+0000 7f20e4e4a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006e360 0x7f20e0149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.285+0000 7f20e4e4a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20e006ec80 0x7f20e01f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.285+0000 7f20e4e4a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e00b3e10 0x7f20e01e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.285+0000 7f20e4e4a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00b2fd0 con 0x7f20e00b3e10 2024-04-25T08:52:28.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.285+0000 7f20e4e4a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e006b520 con 0x7f20e006ec80 2024-04-25T08:52:28.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.285+0000 7f20e4e4a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00b3150 con 0x7f20e006e360 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20ded9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e00b3e10 0x7f20e01e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20ded9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e00b3e10 0x7f20e01e4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52864/0 (socket says 172.21.15.172:52864) 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20ded9d640 1 -- 172.21.15.172:0/3061271830 learned_addr learned my addr 172.21.15.172:0/3061271830 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20de59c640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006e360 0x7f20e0149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20d7fff640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20e006ec80 0x7f20e01f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20ded9d640 1 -- 172.21.15.172:0/3061271830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006e360 msgr2=0x7f20e0149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20ded9d640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006e360 0x7f20e0149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20ded9d640 1 -- 172.21.15.172:0/3061271830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20e006ec80 msgr2=0x7f20e01f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20ded9d640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20e006ec80 0x7f20e01f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20ded9d640 1 -- 172.21.15.172:0/3061271830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e01f6b90 con 0x7f20e00b3e10 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20d7fff640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20e006ec80 0x7f20e01f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20ded9d640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e00b3e10 0x7f20e01e4cb0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f20d800c730 tx=0x7f20d800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20d6ffd640 1 -- 172.21.15.172:0/3061271830 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8018070 con 0x7f20e00b3e10 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20d6ffd640 1 -- 172.21.15.172:0/3061271830 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d800ce40 con 0x7f20e00b3e10 2024-04-25T08:52:28.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20e4e4a640 1 -- 172.21.15.172:0/3061271830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e01e51f0 con 0x7f20e00b3e10 2024-04-25T08:52:28.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20d6ffd640 1 -- 172.21.15.172:0/3061271830 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800a860 con 0x7f20e00b3e10 2024-04-25T08:52:28.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.286+0000 7f20e4e4a640 1 -- 172.21.15.172:0/3061271830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e01e9d80 con 0x7f20e00b3e10 2024-04-25T08:52:28.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.287+0000 7f20e4e4a640 1 -- 172.21.15.172:0/3061271830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e0073a00 con 0x7f20e00b3e10 2024-04-25T08:52:28.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.288+0000 7f20d6ffd640 1 -- 172.21.15.172:0/3061271830 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f20d800aa00 con 0x7f20e00b3e10 2024-04-25T08:52:28.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.288+0000 7f20d6ffd640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f20c006b500 0x7f20c006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.288+0000 7f20de59c640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f20c006b500 0x7f20c006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.288+0000 7f20d6ffd640 1 -- 172.21.15.172:0/3061271830 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f20d8089790 con 0x7f20e00b3e10 2024-04-25T08:52:28.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.288+0000 7f20de59c640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f20c006b500 0x7f20c006d9c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f20d0034000 tx=0x7f20d002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:28.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.292+0000 7f20d6ffd640 1 -- 172.21.15.172:0/3061271830 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20d8057e10 con 0x7f20e00b3e10 2024-04-25T08:52:28.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.499+0000 7f20e4e4a640 1 -- 172.21.15.172:0/3061271830 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f20e006f2b0 con 0x7f20e00b3e10 2024-04-25T08:52:28.490 INFO:tasks.ceph.mon.a.smithi172.stderr:2024-04-25T08:52:28.500+0000 7f9412b2f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T08:52:28.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.501+0000 7f20d6ffd640 1 -- 172.21.15.172:0/3061271830 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) v1 ==== 161+0+0 (secure 0 0 0) 0x7f20d805beb0 con 0x7f20e00b3e10 2024-04-25T08:52:28.491 INFO:teuthology.orchestra.run.smithi172.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T08:52:28.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 -- 172.21.15.172:0/3061271830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f20c006b500 msgr2=0x7f20c006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f20c006b500 0x7f20c006d9c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f20d0034000 tx=0x7f20d002e000 comp rx=0 tx=0).stop 2024-04-25T08:52:28.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 -- 172.21.15.172:0/3061271830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e00b3e10 msgr2=0x7f20e01e4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e00b3e10 0x7f20e01e4cb0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f20d800c730 tx=0x7f20d800cbf0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 -- 172.21.15.172:0/3061271830 shutdown_connections 2024-04-25T08:52:28.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f20c006b500 0x7f20c006d9c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20e006ec80 0x7f20e01f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20e00b3e10 0x7f20e01e4cb0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 --2- 172.21.15.172:0/3061271830 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20e006e360 0x7f20e0149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 -- 172.21.15.172:0/3061271830 >> 172.21.15.172:0/3061271830 conn(0x7f20e00cfec0 msgr2=0x7f20e015d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:28.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 -- 172.21.15.172:0/3061271830 shutdown_connections 2024-04-25T08:52:28.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.505+0000 7f20e4e4a640 1 -- 172.21.15.172:0/3061271830 wait complete. 2024-04-25T08:52:28.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T08:52:28.533 INFO:tasks.ceph.mds.a.smithi172.stdout:starting mds.a at 2024-04-25T08:52:28.538 INFO:tasks.ceph.mds.c.smithi172.stdout:starting mds.c at 2024-04-25T08:52:28.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.621+0000 7f1afd97e640 1 Processor -- start 2024-04-25T08:52:28.612 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.621+0000 7f1afd97e640 1 -- start start 2024-04-25T08:52:28.613 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.622+0000 7f1afd97e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1af815de80 0x7f1af80cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.622+0000 7f1afd97e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1af80cefb0 0x7f1af80cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.622+0000 7f1afd97e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1af80cf950 0x7f1af806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.622+0000 7f1afd97e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af80afc80 con 0x7f1af815de80 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.622+0000 7f1afd97e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af80ce4d0 con 0x7f1af80cf950 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.622+0000 7f1afd97e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80ce7b0 con 0x7f1af80cefb0 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.622+0000 7f1af6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1af815de80 0x7f1af80cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.622+0000 7f1af6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1af815de80 0x7f1af80cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52900/0 (socket says 172.21.15.172:52900) 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.622+0000 7f1af6ffd640 1 -- 172.21.15.172:0/1010651680 learned_addr learned my addr 172.21.15.172:0/1010651680 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.623+0000 7f1af77fe640 1 --2- 172.21.15.172:0/1010651680 >> v2:172.21.15.186:3300/0 conn(0x7f1af80cf950 0x7f1af806abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.623+0000 7f1af6ffd640 1 -- 172.21.15.172:0/1010651680 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1af80cefb0 msgr2=0x7f1af80cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.623+0000 7f1af6ffd640 1 --2- 172.21.15.172:0/1010651680 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1af80cefb0 0x7f1af80cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.623+0000 7f1af6ffd640 1 -- 172.21.15.172:0/1010651680 >> v2:172.21.15.186:3300/0 conn(0x7f1af80cf950 msgr2=0x7f1af806abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.623+0000 7f1af6ffd640 1 --2- 172.21.15.172:0/1010651680 >> v2:172.21.15.186:3300/0 conn(0x7f1af80cf950 0x7f1af806abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.614 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.623+0000 7f1af6ffd640 1 -- 172.21.15.172:0/1010651680 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af80cea90 con 0x7f1af815de80 2024-04-25T08:52:28.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.623+0000 7f1af6ffd640 1 --2- 172.21.15.172:0/1010651680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af815de80 0x7f1af80cadb0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f1af80d0360 tx=0x7f1ae002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da57dd26139c878 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:28.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.623+0000 7f1af5ffb640 1 -- 172.21.15.172:0/1010651680 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0037070 con 0x7f1af815de80 2024-04-25T08:52:28.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.623+0000 7f1af5ffb640 1 -- 172.21.15.172:0/1010651680 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae0032440 con 0x7f1af815de80 2024-04-25T08:52:28.615 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.623+0000 7f1af5ffb640 1 -- 172.21.15.172:0/1010651680 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0032810 con 0x7f1af815de80 2024-04-25T08:52:28.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.624+0000 7f1afd97e640 1 -- 172.21.15.172:0/1010651680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af815de80 msgr2=0x7f1af80cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.624+0000 7f1afd97e640 1 --2- 172.21.15.172:0/1010651680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af815de80 0x7f1af80cadb0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f1af80d0360 tx=0x7f1ae002a1e0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.624+0000 7f1afd97e640 1 -- 172.21.15.172:0/1010651680 shutdown_connections 2024-04-25T08:52:28.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.624+0000 7f1afd97e640 1 --2- 172.21.15.172:0/1010651680 >> v2:172.21.15.186:3300/0 conn(0x7f1af80cf950 0x7f1af806abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.624+0000 7f1afd97e640 1 --2- 172.21.15.172:0/1010651680 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1af80cefb0 0x7f1af80cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.624+0000 7f1afd97e640 1 --2- 172.21.15.172:0/1010651680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af815de80 0x7f1af80cadb0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.618 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.624+0000 7f1afd97e640 1 -- 172.21.15.172:0/1010651680 >> 172.21.15.172:0/1010651680 conn(0x7f1af80b2390 msgr2=0x7f1af80b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.624+0000 7f1afd97e640 1 -- 172.21.15.172:0/1010651680 shutdown_connections 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.624+0000 7f1afd97e640 1 -- 172.21.15.172:0/1010651680 wait complete. 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.625+0000 7f1afd97e640 1 Processor -- start 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.625+0000 7f1afd97e640 1 -- start start 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1afd97e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af80cefb0 0x7f1af8151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1afd97e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1af80cf950 0x7f1af80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1afd97e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af815de80 0x7f1af80cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1afd97e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80b3030 con 0x7f1af80cefb0 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1afd97e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80b2eb0 con 0x7f1af815de80 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1afd97e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80c5600 con 0x7f1af80cf950 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1af6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af80cefb0 0x7f1af8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1af6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af80cefb0 0x7f1af8151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52908/0 (socket says 172.21.15.172:52908) 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1af6ffd640 1 -- 172.21.15.172:0/3827118610 learned_addr learned my addr 172.21.15.172:0/3827118610 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:28.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1af6ffd640 1 -- 172.21.15.172:0/3827118610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1af80cf950 msgr2=0x7f1af80b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1af77fe640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af815de80 0x7f1af80cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.626+0000 7f1af67fc640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1af80cf950 0x7f1af80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1af6ffd640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1af80cf950 0x7f1af80b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1af6ffd640 1 -- 172.21.15.172:0/3827118610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af815de80 msgr2=0x7f1af80cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1af6ffd640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af815de80 0x7f1af80cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1af6ffd640 1 -- 172.21.15.172:0/3827118610 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af80c8a90 con 0x7f1af80cefb0 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1af77fe640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af815de80 0x7f1af80cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1af67fc640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1af80cf950 0x7f1af80b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1af6ffd640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af80cefb0 0x7f1af8151770 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0000c00 tx=0x7f1ae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1aeffff640 1 -- 172.21.15.172:0/3827118610 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0041070 con 0x7f1af80cefb0 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1aeffff640 1 -- 172.21.15.172:0/3827118610 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae003c870 con 0x7f1af80cefb0 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1afd97e640 1 -- 172.21.15.172:0/3827118610 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af80c8d70 con 0x7f1af80cefb0 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1aeffff640 1 -- 172.21.15.172:0/3827118610 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0037040 con 0x7f1af80cefb0 2024-04-25T08:52:28.620 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.627+0000 7f1afd97e640 1 -- 172.21.15.172:0/3827118610 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af80c9330 con 0x7f1af80cefb0 2024-04-25T08:52:28.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.628+0000 7f1afd97e640 1 -- 172.21.15.172:0/3827118610 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af8073a00 con 0x7f1af80cefb0 2024-04-25T08:52:28.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.628+0000 7f1aeffff640 1 -- 172.21.15.172:0/3827118610 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ae0044070 con 0x7f1af80cefb0 2024-04-25T08:52:28.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.629+0000 7f1aeffff640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ad806b4d0 0x7f1ad806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:28.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.629+0000 7f1aeffff640 1 -- 172.21.15.172:0/3827118610 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f1ae00aafe0 con 0x7f1af80cefb0 2024-04-25T08:52:28.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.629+0000 7f1af67fc640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ad806b4d0 0x7f1ad806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:28.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.629+0000 7f1af67fc640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ad806b4d0 0x7f1ad806d990 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8006fd0 tx=0x7f1ae8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:28.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.633+0000 7f1aeffff640 1 -- 172.21.15.172:0/3827118610 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ae0079cd0 con 0x7f1af80cefb0 2024-04-25T08:52:28.832 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:28.842+0000 7f1afd97e640 1 -- 172.21.15.172:0/3827118610 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1af80b07e0 con 0x7f1af80cefb0 2024-04-25T08:52:29.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.506+0000 7f1aeffff640 1 -- 172.21.15.172:0/3827118610 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v90) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1ae00795d0 con 0x7f1af80cefb0 2024-04-25T08:52:29.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 -- 172.21.15.172:0/3827118610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ad806b4d0 msgr2=0x7f1ad806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:29.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ad806b4d0 0x7f1ad806d990 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8006fd0 tx=0x7f1ae8008040 comp rx=0 tx=0).stop 2024-04-25T08:52:29.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 -- 172.21.15.172:0/3827118610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af80cefb0 msgr2=0x7f1af8151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:29.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af80cefb0 0x7f1af8151770 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0000c00 tx=0x7f1ae00046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 -- 172.21.15.172:0/3827118610 shutdown_connections 2024-04-25T08:52:29.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ad806b4d0 0x7f1ad806d990 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1af815de80 0x7f1af80cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1af80cf950 0x7f1af80b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 --2- 172.21.15.172:0/3827118610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1af80cefb0 0x7f1af8151770 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 -- 172.21.15.172:0/3827118610 >> 172.21.15.172:0/3827118610 conn(0x7f1af80b2390 msgr2=0x7f1af80b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:29.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 -- 172.21.15.172:0/3827118610 shutdown_connections 2024-04-25T08:52:29.502 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.509+0000 7f1afd97e640 1 -- 172.21.15.172:0/3827118610 wait complete. 2024-04-25T08:52:29.514 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T08:52:29.661 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.671+0000 7f497d729640 1 Processor -- start 2024-04-25T08:52:29.662 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.671+0000 7f497d729640 1 -- start start 2024-04-25T08:52:29.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f497d729640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4978158230 0x7f49780d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:29.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f497d729640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f49780d1b80 0x7f497806c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:29.663 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f497d729640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f497806c870 0x7f49780b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f497d729640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4978158610 con 0x7f4978158230 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f497d729640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497806bea0 con 0x7f49780d1b80 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f497d729640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49780d2020 con 0x7f497806c870 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f4976ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4978158230 0x7f49780d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f4976ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4978158230 0x7f49780d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52910/0 (socket says 172.21.15.172:52910) 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f4976ffd640 1 -- 172.21.15.172:0/593777235 learned_addr learned my addr 172.21.15.172:0/593777235 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f49777fe640 1 --2- 172.21.15.172:0/593777235 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f497806c870 0x7f49780b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f49767fc640 1 --2- 172.21.15.172:0/593777235 >> v2:172.21.15.186:3300/0 conn(0x7f49780d1b80 0x7f497806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f4976ffd640 1 -- 172.21.15.172:0/593777235 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f497806c870 msgr2=0x7f49780b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f4976ffd640 1 --2- 172.21.15.172:0/593777235 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f497806c870 0x7f49780b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f4976ffd640 1 -- 172.21.15.172:0/593777235 >> v2:172.21.15.186:3300/0 conn(0x7f49780d1b80 msgr2=0x7f497806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f4976ffd640 1 --2- 172.21.15.172:0/593777235 >> v2:172.21.15.186:3300/0 conn(0x7f49780d1b80 0x7f497806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f4976ffd640 1 -- 172.21.15.172:0/593777235 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49780d2300 con 0x7f4978158230 2024-04-25T08:52:29.664 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.672+0000 7f49767fc640 1 --2- 172.21.15.172:0/593777235 >> v2:172.21.15.186:3300/0 conn(0x7f49780d1b80 0x7f497806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:29.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.673+0000 7f4976ffd640 1 --2- 172.21.15.172:0/593777235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 0x7f49780d1640 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f497815bcc0 tx=0x7f496802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b6ded0d8e4da9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:29.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.673+0000 7f4975ffb640 1 -- 172.21.15.172:0/593777235 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968036070 con 0x7f4978158230 2024-04-25T08:52:29.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.673+0000 7f4975ffb640 1 -- 172.21.15.172:0/593777235 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4968031600 con 0x7f4978158230 2024-04-25T08:52:29.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.673+0000 7f4975ffb640 1 -- 172.21.15.172:0/593777235 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49680319d0 con 0x7f4978158230 2024-04-25T08:52:29.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.674+0000 7f497d729640 1 -- 172.21.15.172:0/593777235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 msgr2=0x7f49780d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:29.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.674+0000 7f497d729640 1 --2- 172.21.15.172:0/593777235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 0x7f49780d1640 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f497815bcc0 tx=0x7f496802a6a0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.674+0000 7f497d729640 1 -- 172.21.15.172:0/593777235 shutdown_connections 2024-04-25T08:52:29.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.674+0000 7f497d729640 1 --2- 172.21.15.172:0/593777235 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f497806c870 0x7f49780b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.674+0000 7f497d729640 1 --2- 172.21.15.172:0/593777235 >> v2:172.21.15.186:3300/0 conn(0x7f49780d1b80 0x7f497806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.674+0000 7f497d729640 1 --2- 172.21.15.172:0/593777235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 0x7f49780d1640 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.674+0000 7f497d729640 1 -- 172.21.15.172:0/593777235 >> 172.21.15.172:0/593777235 conn(0x7f4978061600 msgr2=0x7f49780619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:29.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.674+0000 7f497d729640 1 -- 172.21.15.172:0/593777235 shutdown_connections 2024-04-25T08:52:29.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.674+0000 7f497d729640 1 -- 172.21.15.172:0/593777235 wait complete. 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.675+0000 7f497d729640 1 Processor -- start 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.675+0000 7f497d729640 1 -- start start 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f497d729640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f497806c870 0x7f497814f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f497d729640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49780d1b80 0x7f49781e4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f497d729640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 0x7f49781e46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f497d729640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497815e320 con 0x7f4978158230 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f497d729640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49780d25e0 con 0x7f497806c870 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f497d729640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497815e4a0 con 0x7f49780d1b80 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f49777fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 0x7f49781e46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f49777fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 0x7f49781e46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52922/0 (socket says 172.21.15.172:52922) 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f49777fe640 1 -- 172.21.15.172:0/2547397395 learned_addr learned my addr 172.21.15.172:0/2547397395 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f4976ffd640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f497806c870 0x7f497814f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:29.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.676+0000 7f49767fc640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49780d1b80 0x7f49781e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f49777fe640 1 -- 172.21.15.172:0/2547397395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49780d1b80 msgr2=0x7f49781e4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f49777fe640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49780d1b80 0x7f49781e4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f49777fe640 1 -- 172.21.15.172:0/2547397395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f497806c870 msgr2=0x7f497814f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f49777fe640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f497806c870 0x7f497814f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f49777fe640 1 -- 172.21.15.172:0/2547397395 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497815ae50 con 0x7f4978158230 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f4976ffd640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f497806c870 0x7f497814f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f49777fe640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 0x7f49781e46a0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f497000d800 tx=0x7f497000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f495f7fe640 1 -- 172.21.15.172:0/2547397395 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497000b6c0 con 0x7f4978158230 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f495f7fe640 1 -- 172.21.15.172:0/2547397395 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970019070 con 0x7f4978158230 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f495f7fe640 1 -- 172.21.15.172:0/2547397395 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497000bac0 con 0x7f4978158230 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f497d729640 1 -- 172.21.15.172:0/2547397395 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49780cc060 con 0x7f4978158230 2024-04-25T08:52:29.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.677+0000 7f497d729640 1 -- 172.21.15.172:0/2547397395 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49780cc300 con 0x7f4978158230 2024-04-25T08:52:29.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.678+0000 7f497d729640 1 -- 172.21.15.172:0/2547397395 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497806de50 con 0x7f4978158230 2024-04-25T08:52:29.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.679+0000 7f495f7fe640 1 -- 172.21.15.172:0/2547397395 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f497000bc60 con 0x7f4978158230 2024-04-25T08:52:29.671 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.679+0000 7f495f7fe640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f496406b4d0 0x7f496406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:29.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.679+0000 7f495f7fe640 1 -- 172.21.15.172:0/2547397395 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f497008a720 con 0x7f4978158230 2024-04-25T08:52:29.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.679+0000 7f4976ffd640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f496406b4d0 0x7f496406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:29.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.680+0000 7f4976ffd640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f496406b4d0 0x7f496406d990 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4968033000 tx=0x7f4968009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:29.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.684+0000 7f495f7fe640 1 -- 172.21.15.172:0/2547397395 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4970058dc0 con 0x7f4978158230 2024-04-25T08:52:29.845 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:29.855+0000 7f497d729640 1 -- 172.21.15.172:0/2547397395 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f49780b5c70 con 0x7f4978158230 2024-04-25T08:52:30.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.803+0000 7f495f7fe640 1 -- 172.21.15.172:0/2547397395 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v147) v1 ==== 181+0+0 (secure 0 0 0) 0x7f497005ce60 con 0x7f4978158230 2024-04-25T08:52:30.796 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_metadata' removed 2024-04-25T08:52:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 -- 172.21.15.172:0/2547397395 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f496406b4d0 msgr2=0x7f496406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f496406b4d0 0x7f496406d990 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4968033000 tx=0x7f4968009000 comp rx=0 tx=0).stop 2024-04-25T08:52:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 -- 172.21.15.172:0/2547397395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 msgr2=0x7f49781e46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 0x7f49781e46a0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f497000d800 tx=0x7f497000dcc0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 -- 172.21.15.172:0/2547397395 shutdown_connections 2024-04-25T08:52:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f496406b4d0 0x7f496406d990 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4978158230 0x7f49781e46a0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f49780d1b80 0x7f49781e4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 --2- 172.21.15.172:0/2547397395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f497806c870 0x7f497814f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 -- 172.21.15.172:0/2547397395 >> 172.21.15.172:0/2547397395 conn(0x7f4978061600 msgr2=0x7f497815d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:30.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 -- 172.21.15.172:0/2547397395 shutdown_connections 2024-04-25T08:52:30.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.806+0000 7f497d729640 1 -- 172.21.15.172:0/2547397395 wait complete. 2024-04-25T08:52:30.812 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T08:52:30.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.930+0000 7f5353a1b640 1 Processor -- start 2024-04-25T08:52:30.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.930+0000 7f5353a1b640 1 -- start start 2024-04-25T08:52:30.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.931+0000 7f5353a1b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15dd00 0x7f534c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:30.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.931+0000 7f5353a1b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f534c06bf00 0x7f534c06c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:30.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.931+0000 7f5353a1b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c0d06c0 con 0x7f534c15e0e0 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.931+0000 7f5353a1b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c0d1440 con 0x7f534c06bf00 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.931+0000 7f5353a1b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c09a690 con 0x7f534c15dd00 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.931+0000 7f5350fb6640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f534c15e0e0 0x7f534c099f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:45998/0 (socket says 172.21.15.172:45998) 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.931+0000 7f5350fb6640 1 -- 172.21.15.172:0/857068210 learned_addr learned my addr 172.21.15.172:0/857068210 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.931+0000 7f5351fb8640 1 --2- 172.21.15.172:0/857068210 >> v2:172.21.15.186:3300/0 conn(0x7f534c06bf00 0x7f534c06c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.931+0000 7f53517b7640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15dd00 0x7f534c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277105524 0 0) 0x7f534c0d06c0 con 0x7f534c15e0e0 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5338003520 con 0x7f534c15e0e0 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 18753808 0 0) 0x7f5338003520 con 0x7f534c15e0e0 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15dd00 msgr2=0x7f534c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15dd00 0x7f534c099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 >> v2:172.21.15.186:3300/0 conn(0x7f534c06bf00 msgr2=0x7f534c06c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 --2- 172.21.15.172:0/857068210 >> v2:172.21.15.186:3300/0 conn(0x7f534c06bf00 0x7f534c06c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0d0960 con 0x7f534c15e0e0 2024-04-25T08:52:30.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f533c001670 con 0x7f534c15e0e0 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 >> v1:172.21.15.172:6789/0 conn(0x7f534c15e0e0 legacy=0x7f534c099f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53380039b0 0x7f5338003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5338004800 0x7f5338004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15dd00 0x7f53380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0d1440 con 0x7f53380039b0 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c09a690 con 0x7f5338004800 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533800b9c0 con 0x7f534c15dd00 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f53517b7640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53380039b0 0x7f5338003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5350fb6640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5338004800 0x7f5338004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5351fb8640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15dd00 0x7f53380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f53517b7640 1 -- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15dd00 msgr2=0x7f53380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f53517b7640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15dd00 0x7f53380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f53517b7640 1 -- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5338004800 msgr2=0x7f5338004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:30.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f53517b7640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5338004800 0x7f5338004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f53517b7640 1 -- 172.21.15.172:0/857068210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338003520 con 0x7f53380039b0 2024-04-25T08:52:30.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.932+0000 7f5350fb6640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5338004800 0x7f5338004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:30.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.933+0000 7f53517b7640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53380039b0 0x7f5338003dd0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f5348009fc0 tx=0x7f5338005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89825f00764f103d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:30.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.933+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348009c10 con 0x7f53380039b0 2024-04-25T08:52:30.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.933+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5348036070 con 0x7f53380039b0 2024-04-25T08:52:30.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.933+0000 7f5343fff640 1 -- 172.21.15.172:0/857068210 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348031880 con 0x7f53380039b0 2024-04-25T08:52:30.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.934+0000 7f5353a1b640 1 -- 172.21.15.172:0/857068210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53380039b0 msgr2=0x7f5338003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:30.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.934+0000 7f5353a1b640 1 --2- 172.21.15.172:0/857068210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53380039b0 0x7f5338003dd0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f5348009fc0 tx=0x7f5338005830 comp rx=0 tx=0).stop 2024-04-25T08:52:30.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.934+0000 7f5351fb8640 1 -- 172.21.15.172:0/857068210 reap_dead start 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.934+0000 7f5353a1b640 1 -- 172.21.15.172:0/857068210 shutdown_connections 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.934+0000 7f5353a1b640 1 -- 172.21.15.172:0/857068210 >> 172.21.15.172:0/857068210 conn(0x7f534c0b3290 msgr2=0x7f534c0b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.934+0000 7f5353a1b640 1 -- 172.21.15.172:0/857068210 shutdown_connections 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.934+0000 7f5353a1b640 1 -- 172.21.15.172:0/857068210 wait complete. 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.935+0000 7f5353a1b640 1 Processor -- start 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.935+0000 7f5353a1b640 1 -- start start 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5353a1b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53380039b0 0x7f534c1f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5353a1b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15c5e0 0x7f534c15ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5353a1b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f534c0c5290 0x7f534c0c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5353a1b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c09a950 con 0x7f534c0c5290 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5353a1b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0d0f20 con 0x7f53380039b0 2024-04-25T08:52:30.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5353a1b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c0b2b40 con 0x7f534c15c5e0 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5351fb8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f534c0c5290 0x7f534c0c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5351fb8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f534c0c5290 0x7f534c0c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52942/0 (socket says 172.21.15.172:52942) 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5351fb8640 1 -- 172.21.15.172:0/2490485117 learned_addr learned my addr 172.21.15.172:0/2490485117 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f53517b7640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53380039b0 0x7f534c1f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5351fb8640 1 -- 172.21.15.172:0/2490485117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15c5e0 msgr2=0x7f534c15ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5350fb6640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15c5e0 0x7f534c15ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5351fb8640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15c5e0 0x7f534c15ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5351fb8640 1 -- 172.21.15.172:0/2490485117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53380039b0 msgr2=0x7f534c1f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5351fb8640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53380039b0 0x7f534c1f3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5351fb8640 1 -- 172.21.15.172:0/2490485117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0c5e70 con 0x7f534c0c5290 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5351fb8640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f534c0c5290 0x7f534c0c5710 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f534c071de0 tx=0x7f5344011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5341ffb640 1 -- 172.21.15.172:0/2490485117 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5344019020 con 0x7f534c0c5290 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5341ffb640 1 -- 172.21.15.172:0/2490485117 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5344004240 con 0x7f534c0c5290 2024-04-25T08:52:30.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.936+0000 7f5353a1b640 1 -- 172.21.15.172:0/2490485117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c0c6150 con 0x7f534c0c5290 2024-04-25T08:52:30.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.937+0000 7f5341ffb640 1 -- 172.21.15.172:0/2490485117 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400f7a0 con 0x7f534c0c5290 2024-04-25T08:52:30.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.937+0000 7f5353a1b640 1 -- 172.21.15.172:0/2490485117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c0b4720 con 0x7f534c0c5290 2024-04-25T08:52:30.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.938+0000 7f5353a1b640 1 -- 172.21.15.172:0/2490485117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c15cfa0 con 0x7f534c0c5290 2024-04-25T08:52:30.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.938+0000 7f5341ffb640 1 -- 172.21.15.172:0/2490485117 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f534401c020 con 0x7f534c0c5290 2024-04-25T08:52:30.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.939+0000 7f5341ffb640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f533006b4d0 0x7f533006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:30.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.939+0000 7f5341ffb640 1 -- 172.21.15.172:0/2490485117 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5807+0+0 (secure 0 0 0) 0x7f534408a4c0 con 0x7f534c0c5290 2024-04-25T08:52:30.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.939+0000 7f53517b7640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f533006b4d0 0x7f533006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:30.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.939+0000 7f53517b7640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f533006b4d0 0x7f533006d990 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5348035000 tx=0x7f534802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:30.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:30.943+0000 7f5341ffb640 1 -- 172.21.15.172:0/2490485117 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5344023020 con 0x7f534c0c5290 2024-04-25T08:52:31.107 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.117+0000 7f5353a1b640 1 -- 172.21.15.172:0/2490485117 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f534c073a00 con 0x7f534c0c5290 2024-04-25T08:52:31.692 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:52:31.694 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:52:31.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.812+0000 7f5341ffb640 1 -- 172.21.15.172:0/2490485117 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v148) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5344059370 con 0x7f534c0c5290 2024-04-25T08:52:31.803 INFO:teuthology.orchestra.run.smithi172.stderr:pool 'cephfs_data' removed 2024-04-25T08:52:31.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 -- 172.21.15.172:0/2490485117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f533006b4d0 msgr2=0x7f533006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:31.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f533006b4d0 0x7f533006d990 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5348035000 tx=0x7f534802f000 comp rx=0 tx=0).stop 2024-04-25T08:52:31.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 -- 172.21.15.172:0/2490485117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f534c0c5290 msgr2=0x7f534c0c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:31.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f534c0c5290 0x7f534c0c5710 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f534c071de0 tx=0x7f5344011cf0 comp rx=0 tx=0).stop 2024-04-25T08:52:31.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 -- 172.21.15.172:0/2490485117 shutdown_connections 2024-04-25T08:52:31.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f533006b4d0 0x7f533006d990 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:31.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f534c0c5290 0x7f534c0c5710 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:31.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f534c15c5e0 0x7f534c15ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:31.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 --2- 172.21.15.172:0/2490485117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53380039b0 0x7f534c1f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:31.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 -- 172.21.15.172:0/2490485117 >> 172.21.15.172:0/2490485117 conn(0x7f534c0b3290 msgr2=0x7f534c0cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:31.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 -- 172.21.15.172:0/2490485117 shutdown_connections 2024-04-25T08:52:31.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.815+0000 7f5353a1b640 1 -- 172.21.15.172:0/2490485117 wait complete. 2024-04-25T08:52:31.823 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T08:52:31.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.939+0000 7fc190734640 1 Processor -- start 2024-04-25T08:52:31.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.939+0000 7fc190734640 1 -- start start 2024-04-25T08:52:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.940+0000 7fc190734640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 0x7fc18806fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.940+0000 7fc190734640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1880cae60 con 0x7fc1880cbf00 2024-04-25T08:52:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.940+0000 7fc190734640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1880cb140 con 0x7fc18806c300 2024-04-25T08:52:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.940+0000 7fc190734640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880cb420 con 0x7fc18815dbb0 2024-04-25T08:52:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.940+0000 7fc18dccf640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc1880cbf00 0x7fc18806bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46000/0 (socket says 172.21.15.172:46000) 2024-04-25T08:52:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.940+0000 7fc18dccf640 1 -- 172.21.15.172:0/3655153579 learned_addr learned my addr 172.21.15.172:0/3655153579 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.941+0000 7fc18e4d0640 1 --2- 172.21.15.172:0/3655153579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 0x7fc18806fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.941+0000 7fc18d4ce640 1 -- 172.21.15.172:0/3655153579 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549439586 0 0) 0x7fc1880cae60 con 0x7fc1880cbf00 2024-04-25T08:52:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.941+0000 7fc18d4ce640 1 -- 172.21.15.172:0/3655153579 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc174003520 con 0x7fc1880cbf00 2024-04-25T08:52:31.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.941+0000 7fc18d4ce640 1 -- 172.21.15.172:0/3655153579 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707591540 0 0) 0x7fc1880cb140 con 0x7fc18806c300 2024-04-25T08:52:31.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.941+0000 7fc18d4ce640 1 -- 172.21.15.172:0/3655153579 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1880cae60 con 0x7fc18806c300 2024-04-25T08:52:31.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.941+0000 7fc18e4d0640 1 -- 172.21.15.172:0/3655153579 >> v1:172.21.15.186:6789/0 conn(0x7fc18806c300 legacy=0x7fc18806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:31.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.941+0000 7fc18e4d0640 1 -- 172.21.15.172:0/3655153579 >> v1:172.21.15.172:6789/0 conn(0x7fc1880cbf00 legacy=0x7fc18806bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:31.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.941+0000 7fc18e4d0640 1 -- 172.21.15.172:0/3655153579 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1880cb700 con 0x7fc18815dbb0 2024-04-25T08:52:31.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.942+0000 7fc18e4d0640 1 --2- 172.21.15.172:0/3655153579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 0x7fc18806fea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc184009dc0 tx=0x7fc18402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4149ed7f33e7ed47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:31.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.942+0000 7fc18d4ce640 1 -- 172.21.15.172:0/3655153579 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184007740 con 0x7fc18815dbb0 2024-04-25T08:52:31.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.942+0000 7fc18d4ce640 1 -- 172.21.15.172:0/3655153579 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1840078e0 con 0x7fc18815dbb0 2024-04-25T08:52:31.933 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.942+0000 7fc18d4ce640 1 -- 172.21.15.172:0/3655153579 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184007cb0 con 0x7fc18815dbb0 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.942+0000 7fc190734640 1 -- 172.21.15.172:0/3655153579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 msgr2=0x7fc18806fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.942+0000 7fc190734640 1 --2- 172.21.15.172:0/3655153579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 0x7fc18806fea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc184009dc0 tx=0x7fc18402a6d0 comp rx=0 tx=0).stop 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.943+0000 7fc190734640 1 -- 172.21.15.172:0/3655153579 shutdown_connections 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.943+0000 7fc190734640 1 --2- 172.21.15.172:0/3655153579 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 0x7fc18806fea0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.943+0000 7fc190734640 1 -- 172.21.15.172:0/3655153579 >> 172.21.15.172:0/3655153579 conn(0x7fc188071af0 msgr2=0x7fc188071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.943+0000 7fc190734640 1 -- 172.21.15.172:0/3655153579 shutdown_connections 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.943+0000 7fc190734640 1 -- 172.21.15.172:0/3655153579 wait complete. 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.944+0000 7fc190734640 1 Processor -- start 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.944+0000 7fc190734640 1 -- start start 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.944+0000 7fc190734640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc18806c300 0x7fc18815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.944+0000 7fc190734640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1880cbf00 0x7fc1881604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.944+0000 7fc190734640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 0x7fc188154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:31.936 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.944+0000 7fc190734640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880cab10 con 0x7fc1880cbf00 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.944+0000 7fc190734640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18815df90 con 0x7fc18806c300 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.944+0000 7fc190734640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880703e0 con 0x7fc18815dbb0 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.944+0000 7fc18dccf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1880cbf00 0x7fc1881604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc18dccf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1880cbf00 0x7fc1881604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52956/0 (socket says 172.21.15.172:52956) 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc18dccf640 1 -- 172.21.15.172:0/2478516811 learned_addr learned my addr 172.21.15.172:0/2478516811 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc18e4d0640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc18806c300 0x7fc18815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc18ecd1640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 0x7fc188154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc18dccf640 1 -- 172.21.15.172:0/2478516811 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 msgr2=0x7fc188154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc18dccf640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 0x7fc188154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc18dccf640 1 -- 172.21.15.172:0/2478516811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc18806c300 msgr2=0x7fc18815ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc18dccf640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc18806c300 0x7fc18815ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc18dccf640 1 -- 172.21.15.172:0/2478516811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18815e1b0 con 0x7fc1880cbf00 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc18dccf640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1880cbf00 0x7fc1881604f0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c500 tx=0x7fc17800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc17effd640 1 -- 172.21.15.172:0/2478516811 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178017070 con 0x7fc1880cbf00 2024-04-25T08:52:31.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc17effd640 1 -- 172.21.15.172:0/2478516811 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc178005ce0 con 0x7fc1880cbf00 2024-04-25T08:52:31.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc17effd640 1 -- 172.21.15.172:0/2478516811 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1780072f0 con 0x7fc1880cbf00 2024-04-25T08:52:31.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc190734640 1 -- 172.21.15.172:0/2478516811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc188160d40 con 0x7fc1880cbf00 2024-04-25T08:52:31.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.945+0000 7fc190734640 1 -- 172.21.15.172:0/2478516811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc188160a30 con 0x7fc1880cbf00 2024-04-25T08:52:31.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.946+0000 7fc190734640 1 -- 172.21.15.172:0/2478516811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc188073a00 con 0x7fc1880cbf00 2024-04-25T08:52:31.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.946+0000 7fc17effd640 1 -- 172.21.15.172:0/2478516811 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc17801a070 con 0x7fc1880cbf00 2024-04-25T08:52:31.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.947+0000 7fc17effd640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc16c06b4d0 0x7fc16c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:31.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.947+0000 7fc17effd640 1 -- 172.21.15.172:0/2478516811 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc1780892e0 con 0x7fc1880cbf00 2024-04-25T08:52:31.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.947+0000 7fc18e4d0640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc16c06b4d0 0x7fc16c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:31.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.947+0000 7fc18e4d0640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc16c06b4d0 0x7fc16c06d990 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc184034000 tx=0x7fc18402f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:31.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:31.951+0000 7fc17effd640 1 -- 172.21.15.172:0/2478516811 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc178057dd0 con 0x7fc1880cbf00 2024-04-25T08:52:32.126 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.136+0000 7fc190734640 1 -- 172.21.15.172:0/2478516811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc188061b50 con 0x7fc1880cbf00 2024-04-25T08:52:32.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.139+0000 7fc17effd640 1 -- 172.21.15.172:0/2478516811 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc17805be70 con 0x7fc1880cbf00 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 -- 172.21.15.172:0/2478516811 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc16c06b4d0 msgr2=0x7fc16c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc16c06b4d0 0x7fc16c06d990 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc184034000 tx=0x7fc18402f000 comp rx=0 tx=0).stop 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 -- 172.21.15.172:0/2478516811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1880cbf00 msgr2=0x7fc1881604f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1880cbf00 0x7fc1881604f0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c500 tx=0x7fc17800c9c0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 -- 172.21.15.172:0/2478516811 shutdown_connections 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc16c06b4d0 0x7fc16c06d990 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc18815dbb0 0x7fc188154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1880cbf00 0x7fc1881604f0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 --2- 172.21.15.172:0/2478516811 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc18806c300 0x7fc18815ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 -- 172.21.15.172:0/2478516811 >> 172.21.15.172:0/2478516811 conn(0x7fc188071af0 msgr2=0x7fc18806ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:32.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 -- 172.21.15.172:0/2478516811 shutdown_connections 2024-04-25T08:52:32.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.141+0000 7fc190734640 1 -- 172.21.15.172:0/2478516811 wait complete. 2024-04-25T08:52:32.143 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-04-25T08:52:32.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.250+0000 7f50ef94c640 1 Processor -- start 2024-04-25T08:52:32.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.251+0000 7f50ef94c640 1 -- start start 2024-04-25T08:52:32.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.251+0000 7f50ef94c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f50e815ba00 0x7f50e809a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:32.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.251+0000 7f50ef94c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50e81602e0 0x7f50e80ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:32.241 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.251+0000 7f50ef94c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e80cd710 con 0x7f50e815f5f0 2024-04-25T08:52:32.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.251+0000 7f50ef94c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e8099b70 con 0x7f50e815ba00 2024-04-25T08:52:32.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.251+0000 7f50ef94c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e8099e50 con 0x7f50e81602e0 2024-04-25T08:52:32.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.252+0000 7f50ed6e8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f50e815ba00 0x7f50e809a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:32.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.252+0000 7f50ecee7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50e81602e0 0x7f50e80ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:32.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.252+0000 7f50edee9640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f50e815f5f0 0x7f50e80c52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:53766/0 (socket says 172.21.15.172:53766) 2024-04-25T08:52:32.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.252+0000 7f50edee9640 1 -- 172.21.15.172:0/3207667318 learned_addr learned my addr 172.21.15.172:0/3207667318 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:32.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.252+0000 7f50ed6e8640 1 -- 172.21.15.172:0/3207667318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50e81602e0 msgr2=0x7f50e80ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:32.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.252+0000 7f50ed6e8640 1 --2- 172.21.15.172:0/3207667318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50e81602e0 0x7f50e80ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.252+0000 7f50ed6e8640 1 -- 172.21.15.172:0/3207667318 >> v1:172.21.15.186:6789/0 conn(0x7f50e815f5f0 legacy=0x7f50e80c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:32.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.252+0000 7f50ed6e8640 1 -- 172.21.15.172:0/3207667318 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e809a130 con 0x7f50e815ba00 2024-04-25T08:52:32.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.253+0000 7f50ed6e8640 1 --2- 172.21.15.172:0/3207667318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e815ba00 0x7f50e809a930 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009d90 tx=0x7f50e402a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6def43a33a1738 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:32.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.253+0000 7f50dffff640 1 -- 172.21.15.172:0/3207667318 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4037070 con 0x7f50e815ba00 2024-04-25T08:52:32.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.253+0000 7f50dffff640 1 -- 172.21.15.172:0/3207667318 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4032640 con 0x7f50e815ba00 2024-04-25T08:52:32.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.253+0000 7f50dffff640 1 -- 172.21.15.172:0/3207667318 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4032a10 con 0x7f50e815ba00 2024-04-25T08:52:32.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.253+0000 7f50ef94c640 1 -- 172.21.15.172:0/3207667318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e815ba00 msgr2=0x7f50e809a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:32.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.253+0000 7f50ef94c640 1 --2- 172.21.15.172:0/3207667318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e815ba00 0x7f50e809a930 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009d90 tx=0x7f50e402a430 comp rx=0 tx=0).stop 2024-04-25T08:52:32.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.254+0000 7f50ef94c640 1 -- 172.21.15.172:0/3207667318 shutdown_connections 2024-04-25T08:52:32.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.254+0000 7f50ef94c640 1 --2- 172.21.15.172:0/3207667318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50e81602e0 0x7f50e80ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.254+0000 7f50ef94c640 1 --2- 172.21.15.172:0/3207667318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e815ba00 0x7f50e809a930 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.254+0000 7f50ef94c640 1 -- 172.21.15.172:0/3207667318 >> 172.21.15.172:0/3207667318 conn(0x7f50e80b3270 msgr2=0x7f50e80b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:32.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.254+0000 7f50ef94c640 1 -- 172.21.15.172:0/3207667318 shutdown_connections 2024-04-25T08:52:32.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.254+0000 7f50ef94c640 1 -- 172.21.15.172:0/3207667318 wait complete. 2024-04-25T08:52:32.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.255+0000 7f50ef94c640 1 Processor -- start 2024-04-25T08:52:32.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.255+0000 7f50ef94c640 1 -- start start 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.255+0000 7f50ef94c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e815ba00 0x7f50e80c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ef94c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e815f5f0 0x7f50e81499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ef94c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50e81602e0 0x7f50e8149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ef94c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e815bde0 con 0x7f50e815ba00 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ef94c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e80cd2e0 con 0x7f50e815f5f0 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ef94c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e80ca400 con 0x7f50e81602e0 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ed6e8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e815ba00 0x7f50e80c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ed6e8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e815ba00 0x7f50e80c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52972/0 (socket says 172.21.15.172:52972) 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ed6e8640 1 -- 172.21.15.172:0/525283617 learned_addr learned my addr 172.21.15.172:0/525283617 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ecee7640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e815f5f0 0x7f50e81499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50edee9640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50e81602e0 0x7f50e8149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ed6e8640 1 -- 172.21.15.172:0/525283617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50e81602e0 msgr2=0x7f50e8149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ed6e8640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50e81602e0 0x7f50e8149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ed6e8640 1 -- 172.21.15.172:0/525283617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e815f5f0 msgr2=0x7f50e81499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:32.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ed6e8640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e815f5f0 0x7f50e81499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ed6e8640 1 -- 172.21.15.172:0/525283617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e80c9880 con 0x7f50e815ba00 2024-04-25T08:52:32.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ecee7640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e815f5f0 0x7f50e81499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:32.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ed6e8640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e815ba00 0x7f50e80c9260 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009d90 tx=0x7f50e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:32.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ddffb640 1 -- 172.21.15.172:0/525283617 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4037050 con 0x7f50e815ba00 2024-04-25T08:52:32.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ddffb640 1 -- 172.21.15.172:0/525283617 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e4043070 con 0x7f50e815ba00 2024-04-25T08:52:32.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ef94c640 1 -- 172.21.15.172:0/525283617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e80c9b60 con 0x7f50e815ba00 2024-04-25T08:52:32.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.256+0000 7f50ddffb640 1 -- 172.21.15.172:0/525283617 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4030b40 con 0x7f50e815ba00 2024-04-25T08:52:32.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.257+0000 7f50ef94c640 1 -- 172.21.15.172:0/525283617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e80ca120 con 0x7f50e815ba00 2024-04-25T08:52:32.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.257+0000 7f50ef94c640 1 -- 172.21.15.172:0/525283617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e8073990 con 0x7f50e815ba00 2024-04-25T08:52:32.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.258+0000 7f50ddffb640 1 -- 172.21.15.172:0/525283617 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f50e4030ce0 con 0x7f50e815ba00 2024-04-25T08:52:32.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.258+0000 7f50ddffb640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50cc06b4d0 0x7f50cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:32.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.259+0000 7f50ecee7640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50cc06b4d0 0x7f50cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:32.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.259+0000 7f50ddffb640 1 -- 172.21.15.172:0/525283617 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f50e40ab0b0 con 0x7f50e815ba00 2024-04-25T08:52:32.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.259+0000 7f50ecee7640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50cc06b4d0 0x7f50cc06d990 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f50e80ca6b0 tx=0x7f50d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:32.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.263+0000 7f50ddffb640 1 -- 172.21.15.172:0/525283617 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f50e4046360 con 0x7f50e815ba00 2024-04-25T08:52:32.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.513+0000 7f50ef94c640 1 -- 172.21.15.172:0/525283617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) v1 -- 0x7f50e80b40a0 con 0x7f50e815ba00 2024-04-25T08:52:32.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.813+0000 7f50ddffb640 1 -- 172.21.15.172:0/525283617 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v501) v1 ==== 159+0+0 (secure 0 0 0) 0x7f50e407a0a0 con 0x7f50e815ba00 2024-04-25T08:52:32.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 -- 172.21.15.172:0/525283617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50cc06b4d0 msgr2=0x7f50cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:32.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50cc06b4d0 0x7f50cc06d990 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f50e80ca6b0 tx=0x7f50d8008040 comp rx=0 tx=0).stop 2024-04-25T08:52:32.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 -- 172.21.15.172:0/525283617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e815ba00 msgr2=0x7f50e80c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:32.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e815ba00 0x7f50e80c9260 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009d90 tx=0x7f50e4004a40 comp rx=0 tx=0).stop 2024-04-25T08:52:32.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 -- 172.21.15.172:0/525283617 shutdown_connections 2024-04-25T08:52:32.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f50cc06b4d0 0x7f50cc06d990 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50e815f5f0 0x7f50e81499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50e81602e0 0x7f50e8149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 --2- 172.21.15.172:0/525283617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50e815ba00 0x7f50e80c9260 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:32.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 -- 172.21.15.172:0/525283617 >> 172.21.15.172:0/525283617 conn(0x7f50e80b3270 msgr2=0x7f50e80cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:32.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 -- 172.21.15.172:0/525283617 shutdown_connections 2024-04-25T08:52:32.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:32.816+0000 7f50ef94c640 1 -- 172.21.15.172:0/525283617 wait complete. 2024-04-25T08:52:32.819 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ERROR 2024-04-25T08:52:32.819 INFO:tasks.cephfs_test_runner: 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs/test_scrub_checks.py", line 190, in test_scrub_when_mds_is_inactive 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner: sr_mds_id = self.get_daemon_names('up:standby-replay', status=status)[0] 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner:AttributeError: 'TestScrubControls' object has no attribute 'get_daemon_names' 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner: 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner:Ran 9 tests in 560.999s 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner: 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner: 2024-04-25T08:52:32.820 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-25T08:52:32.821 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T08:52:32.821 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T08:52:32.821 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-25T08:52:32.821 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs/test_scrub_checks.py", line 190, in test_scrub_when_mds_is_inactive 2024-04-25T08:52:32.821 INFO:tasks.cephfs_test_runner: sr_mds_id = self.get_daemon_names('up:standby-replay', status=status)[0] 2024-04-25T08:52:32.821 INFO:tasks.cephfs_test_runner:AttributeError: 'TestScrubControls' object has no attribute 'get_daemon_names' 2024-04-25T08:52:32.821 INFO:tasks.cephfs_test_runner: 2024-04-25T08:52:32.821 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T08:52:33.033 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=1fa5e528ac134db294f1f9e41e73d66b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-04-25T08:52:33.035 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T08:52:33.044 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T08:52:33.055 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T08:52:33.055 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:52:33.055 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:52:33.076 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:52:33.076 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T08:52:33.076 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:52:33.134 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=114 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T08:52:33.134 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:52:33.134 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:52:33.153 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:52:33.153 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T08:52:33.153 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T08:52:33.212 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056109,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17615 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T08:52:33.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.213 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:52:33.232 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T08:52:33.232 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T08:52:33.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.233 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T08:52:33.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.300 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T08:52:33.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-04-25T08:52:33.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.470 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-25T08:52:33.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.486 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-04-25T08:52:33.554 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2024-04-25T08:52:33.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:52:33.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.555 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T08:52:33.573 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T08:52:33.574 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T08:52:33.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.574 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T08:52:33.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.642 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T08:52:33.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.709 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-04-25T08:52:33.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.802 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T08:52:33.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T08:52:33.818 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-04-25T08:52:33.888 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-04-25T08:52:33.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:52:33.890 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T08:52:33.899 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T08:52:33.899 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:52:34.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.011+0000 7f307185d640 1 Processor -- start 2024-04-25T08:52:34.002 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.011+0000 7f307185d640 1 -- start start 2024-04-25T08:52:34.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.012+0000 7f307185d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c0cfec0 0x7f306c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.005 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.012+0000 7f307185d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c071480 con 0x7f306c0ce3c0 2024-04-25T08:52:34.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.012+0000 7f307185d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c071760 con 0x7f306c154ee0 2024-04-25T08:52:34.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.012+0000 7f307185d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c072090 con 0x7f306c0cfec0 2024-04-25T08:52:34.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.012+0000 7f306b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f306c0ce3c0 0x7f306c06d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46002/0 (socket says 172.21.15.172:46002) 2024-04-25T08:52:34.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.012+0000 7f306b7fe640 1 -- 172.21.15.172:0/3697026825 learned_addr learned my addr 172.21.15.172:0/3697026825 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:34.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614759608 0 0) 0x7f306c071480 con 0x7f306c0ce3c0 2024-04-25T08:52:34.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3054003520 con 0x7f306c0ce3c0 2024-04-25T08:52:34.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f306a7fc640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c0cfec0 0x7f306c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1052197740 0 0) 0x7f3054003520 con 0x7f306c0ce3c0 2024-04-25T08:52:34.006 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c0cfec0 msgr2=0x7f306c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:34.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c0cfec0 0x7f306c0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 >> v1:172.21.15.186:6789/0 conn(0x7f306c154ee0 legacy=0x7f306c0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c071a40 con 0x7f306c0ce3c0 2024-04-25T08:52:34.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f3064001670 con 0x7f306c0ce3c0 2024-04-25T08:52:34.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 >> v1:172.21.15.172:6789/0 conn(0x7f306c0ce3c0 legacy=0x7f306c06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.007 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30540039e0 0x7f3054003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c0cfec0 0x7f3054004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3054004d40 0x7f30540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305400b9c0 con 0x7f30540039e0 2024-04-25T08:52:34.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305400bb40 con 0x7f3054004d40 2024-04-25T08:52:34.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305400df50 con 0x7f306c0cfec0 2024-04-25T08:52:34.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f306affd640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30540039e0 0x7f3054003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f306a7fc640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c0cfec0 0x7f3054004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.008 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f306b7fe640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3054004d40 0x7f30540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f306affd640 1 -- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c0cfec0 msgr2=0x7f3054004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:34.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f306affd640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c0cfec0 0x7f3054004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f306affd640 1 -- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3054004d40 msgr2=0x7f30540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:34.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f306affd640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3054004d40 0x7f30540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.013+0000 7f306affd640 1 -- 172.21.15.172:0/3697026825 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054003520 con 0x7f30540039e0 2024-04-25T08:52:34.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.014+0000 7f306affd640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30540039e0 0x7f3054003dc0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f305c001f60 tx=0x7f3054005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2dc678d7cb722a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.014+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c037070 con 0x7f30540039e0 2024-04-25T08:52:34.009 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.014+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c032440 con 0x7f30540039e0 2024-04-25T08:52:34.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.014+0000 7f3069ffb640 1 -- 172.21.15.172:0/3697026825 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c001b30 con 0x7f30540039e0 2024-04-25T08:52:34.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.015+0000 7f307185d640 1 -- 172.21.15.172:0/3697026825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30540039e0 msgr2=0x7f3054003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.015+0000 7f307185d640 1 --2- 172.21.15.172:0/3697026825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30540039e0 0x7f3054003dc0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f305c001f60 tx=0x7f3054005830 comp rx=0 tx=0).stop 2024-04-25T08:52:34.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.015+0000 7f306b7fe640 1 -- 172.21.15.172:0/3697026825 reap_dead start 2024-04-25T08:52:34.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.015+0000 7f307185d640 1 -- 172.21.15.172:0/3697026825 shutdown_connections 2024-04-25T08:52:34.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.015+0000 7f307185d640 1 -- 172.21.15.172:0/3697026825 >> 172.21.15.172:0/3697026825 conn(0x7f306c06abe0 msgr2=0x7f306c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:34.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.015+0000 7f307185d640 1 -- 172.21.15.172:0/3697026825 shutdown_connections 2024-04-25T08:52:34.010 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.015+0000 7f307185d640 1 -- 172.21.15.172:0/3697026825 wait complete. 2024-04-25T08:52:34.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.016+0000 7f307185d640 1 Processor -- start 2024-04-25T08:52:34.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.016+0000 7f307185d640 1 -- start start 2024-04-25T08:52:34.013 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f307185d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30540039e0 0x7f306c1474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f307185d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c1f3450 0x7f306c141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f307185d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c1567c0 0x7f306c0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f307185d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0ce800 con 0x7f306c1567c0 2024-04-25T08:52:34.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f307185d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c071230 con 0x7f30540039e0 2024-04-25T08:52:34.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f307185d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c1552c0 con 0x7f306c1f3450 2024-04-25T08:52:34.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c1567c0 0x7f306c0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c1567c0 0x7f306c0a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52982/0 (socket says 172.21.15.172:52982) 2024-04-25T08:52:34.014 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306b7fe640 1 -- 172.21.15.172:0/3145124081 learned_addr learned my addr 172.21.15.172:0/3145124081 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:34.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306affd640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30540039e0 0x7f306c1474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306a7fc640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c1f3450 0x7f306c141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306b7fe640 1 -- 172.21.15.172:0/3145124081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c1f3450 msgr2=0x7f306c141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306b7fe640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c1f3450 0x7f306c141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306b7fe640 1 -- 172.21.15.172:0/3145124081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30540039e0 msgr2=0x7f306c1474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306b7fe640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30540039e0 0x7f306c1474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306b7fe640 1 -- 172.21.15.172:0/3145124081 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c147a20 con 0x7f306c1567c0 2024-04-25T08:52:34.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306a7fc640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c1f3450 0x7f306c141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:34.015 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.017+0000 7f306b7fe640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c1567c0 0x7f306c0a84a0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f3064000c00 tx=0x7f3064007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.018+0000 7f3053fff640 1 -- 172.21.15.172:0/3145124081 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064001640 con 0x7f306c1567c0 2024-04-25T08:52:34.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.018+0000 7f3053fff640 1 -- 172.21.15.172:0/3145124081 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3064018070 con 0x7f306c1567c0 2024-04-25T08:52:34.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.018+0000 7f307185d640 1 -- 172.21.15.172:0/3145124081 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c155740 con 0x7f306c1567c0 2024-04-25T08:52:34.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.018+0000 7f3053fff640 1 -- 172.21.15.172:0/3145124081 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400fb10 con 0x7f306c1567c0 2024-04-25T08:52:34.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.018+0000 7f307185d640 1 -- 172.21.15.172:0/3145124081 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c155d00 con 0x7f306c1567c0 2024-04-25T08:52:34.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.019+0000 7f307185d640 1 -- 172.21.15.172:0/3145124081 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c073990 con 0x7f306c1567c0 2024-04-25T08:52:34.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.019+0000 7f3053fff640 1 -- 172.21.15.172:0/3145124081 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f306400fcb0 con 0x7f306c1567c0 2024-04-25T08:52:34.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.020+0000 7f3053fff640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f305806b4d0 0x7f305806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.016 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.020+0000 7f3053fff640 1 -- 172.21.15.172:0/3145124081 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f3064089d80 con 0x7f306c1567c0 2024-04-25T08:52:34.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.020+0000 7f306affd640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f305806b4d0 0x7f305806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.020+0000 7f306affd640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f305806b4d0 0x7f305806d990 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f305c034000 tx=0x7f305c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.017 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.024+0000 7f3053fff640 1 -- 172.21.15.172:0/3145124081 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f306c147a20 con 0x7f306c1567c0 2024-04-25T08:52:34.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.189+0000 7f307185d640 1 -- 172.21.15.172:0/3145124081 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f306c15a870 con 0x7f305806b4d0 2024-04-25T08:52:34.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.189+0000 7f3053fff640 1 -- 172.21.15.172:0/3145124081 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13498 (secure 0 0 0) 0x7f306c15a870 con 0x7f305806b4d0 2024-04-25T08:52:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:34.180 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:52:34.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 -- 172.21.15.172:0/3145124081 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f305806b4d0 msgr2=0x7f305806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f305806b4d0 0x7f305806d990 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f305c034000 tx=0x7f305c009030 comp rx=0 tx=0).stop 2024-04-25T08:52:34.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 -- 172.21.15.172:0/3145124081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c1567c0 msgr2=0x7f306c0a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c1567c0 0x7f306c0a84a0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f3064000c00 tx=0x7f3064007720 comp rx=0 tx=0).stop 2024-04-25T08:52:34.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 -- 172.21.15.172:0/3145124081 shutdown_connections 2024-04-25T08:52:34.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f305806b4d0 0x7f305806d990 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f306c1567c0 0x7f306c0a84a0 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f306c1f3450 0x7f306c141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 --2- 172.21.15.172:0/3145124081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30540039e0 0x7f306c1474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 -- 172.21.15.172:0/3145124081 >> 172.21.15.172:0/3145124081 conn(0x7f306c06abe0 msgr2=0x7f306c0b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:34.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.191+0000 7f307185d640 1 -- 172.21.15.172:0/3145124081 shutdown_connections 2024-04-25T08:52:34.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.192+0000 7f307185d640 1 -- 172.21.15.172:0/3145124081 wait complete. 2024-04-25T08:52:34.193 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2024-04-25T08:52:32.637318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2531620,"kb_used_data":2121156,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":752443100,"statfs":{"total":773094113280,"available":770501734400,"internally_reserved":0,"allocated":2172063744,"data_stored":2164205867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078223262,"num_objects":-1047,"num_object_clones":0,"num_object_copies":-2094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1047,"num_whiteouts":0,"num_read":-20,"num_read_kb":-4247,"num_write":-1112,"num_write_kb":-1053100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3,"num_bytes_recovered":-3145728,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001485"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":405,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-04-25T08:52:31.400604+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:52:31.400604+0000","last_peered":"2024-04-25T08:52:31.400604+0000","last_clean":"2024-04-25T08:52:31.400604+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:52:31.400604+0000","last_undegraded":"2024-04-25T08:52:31.400604+0000","last_fullsized":"2024-04-25T08:52:31.400604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322960,"kb_used_data":273732,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94048880,"statfs":{"total":96636764160,"available":96306053120,"internally_reserved":0,"allocated":280301568,"data_stored":279320266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":252684,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":258748416,"data_stored":257764809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325448,"kb_used_data":276220,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94046392,"statfs":{"total":96636764160,"available":96303505408,"internally_reserved":0,"allocated":282849280,"data_stored":281875604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367784,"kb_used_data":314396,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94004056,"statfs":{"total":96636764160,"available":96260153344,"internally_reserved":0,"allocated":321941504,"data_stored":320959252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380880,"kb_used_data":323332,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":93990960,"statfs":{"total":96636764160,"available":96246743040,"internally_reserved":0,"allocated":331091968,"data_stored":330110716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279376,"kb_used_data":230148,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94092464,"statfs":{"total":96636764160,"available":96350683136,"internally_reserved":0,"allocated":235671552,"data_stored":234689796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285516,"kb_used_data":236288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94086324,"statfs":{"total":96636764160,"available":96344395776,"internally_reserved":0,"allocated":241958912,"data_stored":240981210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267744,"kb_used_data":214356,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94104096,"statfs":{"total":96636764160,"available":96362594304,"internally_reserved":0,"allocated":219500544,"data_stored":218504214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:52:34.194 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:52:34.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.302+0000 7fd32f1d5640 1 Processor -- start 2024-04-25T08:52:34.292 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.302+0000 7fd32f1d5640 1 -- start start 2024-04-25T08:52:34.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.302+0000 7fd32f1d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 0x7fd3280d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.302+0000 7fd32f1d5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3280b97a0 con 0x7fd3280d1020 2024-04-25T08:52:34.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.302+0000 7fd32f1d5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3280d1c50 con 0x7fd32815dbe0 2024-04-25T08:52:34.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.302+0000 7fd32f1d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32815dfc0 con 0x7fd3280b2cb0 2024-04-25T08:52:34.294 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.302+0000 7fd32d772640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd3280d1020 0x7fd3280d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46004/0 (socket says 172.21.15.172:46004) 2024-04-25T08:52:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.303+0000 7fd32d772640 1 -- 172.21.15.172:0/110276999 learned_addr learned my addr 172.21.15.172:0/110276999 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.303+0000 7fd327fff640 1 --2- 172.21.15.172:0/110276999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 0x7fd3280d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.303+0000 7fd3277fe640 1 -- 172.21.15.172:0/110276999 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812887240 0 0) 0x7fd3280d1c50 con 0x7fd32815dbe0 2024-04-25T08:52:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.303+0000 7fd3277fe640 1 -- 172.21.15.172:0/110276999 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd318003520 con 0x7fd32815dbe0 2024-04-25T08:52:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.303+0000 7fd3277fe640 1 -- 172.21.15.172:0/110276999 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457719441 0 0) 0x7fd3280b97a0 con 0x7fd3280d1020 2024-04-25T08:52:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.303+0000 7fd3277fe640 1 -- 172.21.15.172:0/110276999 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3280d1c50 con 0x7fd3280d1020 2024-04-25T08:52:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.303+0000 7fd327fff640 1 -- 172.21.15.172:0/110276999 >> v1:172.21.15.186:6789/0 conn(0x7fd32815dbe0 legacy=0x7fd3280d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.303+0000 7fd327fff640 1 -- 172.21.15.172:0/110276999 >> v1:172.21.15.172:6789/0 conn(0x7fd3280d1020 legacy=0x7fd3280d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.295 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.303+0000 7fd327fff640 1 -- 172.21.15.172:0/110276999 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280d1f30 con 0x7fd3280b2cb0 2024-04-25T08:52:34.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd327fff640 1 --2- 172.21.15.172:0/110276999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 0x7fd3280d2730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd3140097d0 tx=0x7fd31402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3ef6936c60ef8c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd3277fe640 1 -- 172.21.15.172:0/110276999 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314037070 con 0x7fd3280b2cb0 2024-04-25T08:52:34.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd3277fe640 1 -- 172.21.15.172:0/110276999 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314032440 con 0x7fd3280b2cb0 2024-04-25T08:52:34.296 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd3277fe640 1 -- 172.21.15.172:0/110276999 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314032810 con 0x7fd3280b2cb0 2024-04-25T08:52:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd32f1d5640 1 -- 172.21.15.172:0/110276999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 msgr2=0x7fd3280d2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd32f1d5640 1 --2- 172.21.15.172:0/110276999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 0x7fd3280d2730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd3140097d0 tx=0x7fd31402a210 comp rx=0 tx=0).stop 2024-04-25T08:52:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd32f1d5640 1 -- 172.21.15.172:0/110276999 shutdown_connections 2024-04-25T08:52:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd32f1d5640 1 --2- 172.21.15.172:0/110276999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 0x7fd3280d2730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd32f1d5640 1 -- 172.21.15.172:0/110276999 >> 172.21.15.172:0/110276999 conn(0x7fd328061a20 msgr2=0x7fd328061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd32f1d5640 1 -- 172.21.15.172:0/110276999 shutdown_connections 2024-04-25T08:52:34.300 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.304+0000 7fd32f1d5640 1 -- 172.21.15.172:0/110276999 wait complete. 2024-04-25T08:52:34.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.305+0000 7fd32f1d5640 1 Processor -- start 2024-04-25T08:52:34.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.306+0000 7fd32f1d5640 1 -- start start 2024-04-25T08:52:34.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.306+0000 7fd32f1d5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 0x7fd3281581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.306+0000 7fd32f1d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3280d1020 0x7fd3281565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.306+0000 7fd32f1d5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd32815dbe0 0x7fd3281f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.301 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.306+0000 7fd32f1d5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280b9420 con 0x7fd32815dbe0 2024-04-25T08:52:34.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.306+0000 7fd32f1d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280b92a0 con 0x7fd3280d1020 2024-04-25T08:52:34.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.306+0000 7fd32f1d5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280b6ab0 con 0x7fd3280b2cb0 2024-04-25T08:52:34.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.306+0000 7fd32d772640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd32815dbe0 0x7fd3281f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32d772640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd32815dbe0 0x7fd3281f6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52984/0 (socket says 172.21.15.172:52984) 2024-04-25T08:52:34.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32d772640 1 -- 172.21.15.172:0/3301170213 learned_addr learned my addr 172.21.15.172:0/3301170213 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:34.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd327fff640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3280d1020 0x7fd3281565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32cf71640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 0x7fd3281581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.302 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32d772640 1 -- 172.21.15.172:0/3301170213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 msgr2=0x7fd3281581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32d772640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 0x7fd3281581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32d772640 1 -- 172.21.15.172:0/3301170213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3280d1020 msgr2=0x7fd3281565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32d772640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3280d1020 0x7fd3281565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32d772640 1 -- 172.21.15.172:0/3301170213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd328156b10 con 0x7fd32815dbe0 2024-04-25T08:52:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32d772640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd32815dbe0 0x7fd3281f6ce0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fd32000cbb0 tx=0x7fd32000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd3257fa640 1 -- 172.21.15.172:0/3301170213 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320017070 con 0x7fd32815dbe0 2024-04-25T08:52:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd3257fa640 1 -- 172.21.15.172:0/3301170213 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32000ad40 con 0x7fd32815dbe0 2024-04-25T08:52:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd3257fa640 1 -- 172.21.15.172:0/3301170213 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320012600 con 0x7fd32815dbe0 2024-04-25T08:52:34.303 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32f1d5640 1 -- 172.21.15.172:0/3301170213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd328157150 con 0x7fd32815dbe0 2024-04-25T08:52:34.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.307+0000 7fd32f1d5640 1 -- 172.21.15.172:0/3301170213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd328157710 con 0x7fd32815dbe0 2024-04-25T08:52:34.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.308+0000 7fd32f1d5640 1 -- 172.21.15.172:0/3301170213 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd328073990 con 0x7fd32815dbe0 2024-04-25T08:52:34.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.309+0000 7fd3257fa640 1 -- 172.21.15.172:0/3301170213 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd32001a070 con 0x7fd32815dbe0 2024-04-25T08:52:34.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.309+0000 7fd3257fa640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30c06b4d0 0x7fd30c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.309+0000 7fd3257fa640 1 -- 172.21.15.172:0/3301170213 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd320089c30 con 0x7fd32815dbe0 2024-04-25T08:52:34.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.309+0000 7fd32cf71640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30c06b4d0 0x7fd30c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.304 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.309+0000 7fd32cf71640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30c06b4d0 0x7fd30c06d990 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd32815caa0 tx=0x7fd31c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.305 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.313+0000 7fd3257fa640 1 -- 172.21.15.172:0/3301170213 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd328156b10 con 0x7fd32815dbe0 2024-04-25T08:52:34.470 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.480+0000 7fd32f1d5640 1 -- 172.21.15.172:0/3301170213 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3280b28d0 con 0x7fd30c06b4d0 2024-04-25T08:52:34.471 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.481+0000 7fd3257fa640 1 -- 172.21.15.172:0/3301170213 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13498 (secure 0 0 0) 0x7fd3280b28d0 con 0x7fd30c06b4d0 2024-04-25T08:52:34.471 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:34.472 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:52:34.473 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 -- 172.21.15.172:0/3301170213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30c06b4d0 msgr2=0x7fd30c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30c06b4d0 0x7fd30c06d990 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd32815caa0 tx=0x7fd31c009040 comp rx=0 tx=0).stop 2024-04-25T08:52:34.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 -- 172.21.15.172:0/3301170213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd32815dbe0 msgr2=0x7fd3281f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd32815dbe0 0x7fd3281f6ce0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fd32000cbb0 tx=0x7fd32000a430 comp rx=0 tx=0).stop 2024-04-25T08:52:34.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 -- 172.21.15.172:0/3301170213 shutdown_connections 2024-04-25T08:52:34.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30c06b4d0 0x7fd30c06d990 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3280d1020 0x7fd3281565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd32815dbe0 0x7fd3281f6ce0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.474 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 --2- 172.21.15.172:0/3301170213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3280b2cb0 0x7fd3281581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 -- 172.21.15.172:0/3301170213 >> 172.21.15.172:0/3301170213 conn(0x7fd328061a20 msgr2=0x7fd328152970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:34.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 -- 172.21.15.172:0/3301170213 shutdown_connections 2024-04-25T08:52:34.475 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.483+0000 7fd32f1d5640 1 -- 172.21.15.172:0/3301170213 wait complete. 2024-04-25T08:52:34.484 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2024-04-25T08:52:32.637318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2531620,"kb_used_data":2121156,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":752443100,"statfs":{"total":773094113280,"available":770501734400,"internally_reserved":0,"allocated":2172063744,"data_stored":2164205867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078223262,"num_objects":-1047,"num_object_clones":0,"num_object_copies":-2094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1047,"num_whiteouts":0,"num_read":-20,"num_read_kb":-4247,"num_write":-1112,"num_write_kb":-1053100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3,"num_bytes_recovered":-3145728,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001485"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":405,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-04-25T08:52:31.400604+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:52:31.400604+0000","last_peered":"2024-04-25T08:52:31.400604+0000","last_clean":"2024-04-25T08:52:31.400604+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:52:31.400604+0000","last_undegraded":"2024-04-25T08:52:31.400604+0000","last_fullsized":"2024-04-25T08:52:31.400604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322960,"kb_used_data":273732,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94048880,"statfs":{"total":96636764160,"available":96306053120,"internally_reserved":0,"allocated":280301568,"data_stored":279320266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":252684,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":258748416,"data_stored":257764809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325448,"kb_used_data":276220,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94046392,"statfs":{"total":96636764160,"available":96303505408,"internally_reserved":0,"allocated":282849280,"data_stored":281875604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367784,"kb_used_data":314396,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94004056,"statfs":{"total":96636764160,"available":96260153344,"internally_reserved":0,"allocated":321941504,"data_stored":320959252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380880,"kb_used_data":323332,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":93990960,"statfs":{"total":96636764160,"available":96246743040,"internally_reserved":0,"allocated":331091968,"data_stored":330110716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279376,"kb_used_data":230148,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94092464,"statfs":{"total":96636764160,"available":96350683136,"internally_reserved":0,"allocated":235671552,"data_stored":234689796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285516,"kb_used_data":236288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94086324,"statfs":{"total":96636764160,"available":96344395776,"internally_reserved":0,"allocated":241958912,"data_stored":240981210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267744,"kb_used_data":214356,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94104096,"statfs":{"total":96636764160,"available":96362594304,"internally_reserved":0,"allocated":219500544,"data_stored":218504214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:52:34.485 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T08:52:34.485 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:52:34.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.592+0000 7f608d163640 1 Processor -- start 2024-04-25T08:52:34.583 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.593+0000 7f608d163640 1 -- start start 2024-04-25T08:52:34.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.593+0000 7f608d163640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f60880b6cb0 0x7f60880b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.593+0000 7f608d163640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60880ceee0 con 0x7f608815db70 2024-04-25T08:52:34.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.593+0000 7f608d163640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60880d1d10 con 0x7f60880b5a60 2024-04-25T08:52:34.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.593+0000 7f608d163640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60880d1ff0 con 0x7f60880b6cb0 2024-04-25T08:52:34.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.593+0000 7f6086d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f608815db70 0x7f6088162150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46008/0 (socket says 172.21.15.172:46008) 2024-04-25T08:52:34.585 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.593+0000 7f6086d9d640 1 -- 172.21.15.172:0/335887025 learned_addr learned my addr 172.21.15.172:0/335887025 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:34.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.594+0000 7f608659c640 1 --2- 172.21.15.172:0/335887025 >> v2:172.21.15.186:3300/0 conn(0x7f60880b6cb0 0x7f60880b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.594+0000 7f6085d9b640 1 -- 172.21.15.172:0/335887025 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394805582 0 0) 0x7f60880ceee0 con 0x7f608815db70 2024-04-25T08:52:34.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.594+0000 7f6085d9b640 1 -- 172.21.15.172:0/335887025 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6074003520 con 0x7f608815db70 2024-04-25T08:52:34.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.594+0000 7f608659c640 1 -- 172.21.15.172:0/335887025 >> v1:172.21.15.186:6789/0 conn(0x7f60880b5a60 legacy=0x7f60880d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.594+0000 7f6085d9b640 1 -- 172.21.15.172:0/335887025 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349425649 0 0) 0x7f6074003520 con 0x7f608815db70 2024-04-25T08:52:34.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.594+0000 7f608659c640 1 -- 172.21.15.172:0/335887025 >> v1:172.21.15.172:6789/0 conn(0x7f608815db70 legacy=0x7f6088162150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.594+0000 7f608659c640 1 -- 172.21.15.172:0/335887025 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880d22d0 con 0x7f60880b6cb0 2024-04-25T08:52:34.586 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.595+0000 7f608659c640 1 --2- 172.21.15.172:0/335887025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60880b6cb0 0x7f60880b5520 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f60700097a0 tx=0x7f607002a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1a4a2085884977d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.595+0000 7f6085d9b640 1 -- 172.21.15.172:0/335887025 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070037070 con 0x7f60880b6cb0 2024-04-25T08:52:34.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.595+0000 7f6085d9b640 1 -- 172.21.15.172:0/335887025 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607002aad0 con 0x7f60880b6cb0 2024-04-25T08:52:34.587 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.595+0000 7f6085d9b640 1 -- 172.21.15.172:0/335887025 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800019f0 con 0x7f60880b6cb0 2024-04-25T08:52:34.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.595+0000 7f608d163640 1 -- 172.21.15.172:0/335887025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60880b6cb0 msgr2=0x7f60880b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.595+0000 7f608d163640 1 --2- 172.21.15.172:0/335887025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60880b6cb0 0x7f60880b5520 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f60700097a0 tx=0x7f607002a040 comp rx=0 tx=0).stop 2024-04-25T08:52:34.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.595+0000 7f608d163640 1 -- 172.21.15.172:0/335887025 shutdown_connections 2024-04-25T08:52:34.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.595+0000 7f608d163640 1 --2- 172.21.15.172:0/335887025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60880b6cb0 0x7f60880b5520 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.595+0000 7f608d163640 1 -- 172.21.15.172:0/335887025 >> 172.21.15.172:0/335887025 conn(0x7f60880d0520 msgr2=0x7f60880d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:34.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.596+0000 7f608d163640 1 -- 172.21.15.172:0/335887025 shutdown_connections 2024-04-25T08:52:34.591 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.596+0000 7f608d163640 1 -- 172.21.15.172:0/335887025 wait complete. 2024-04-25T08:52:34.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.597+0000 7f608d163640 1 Processor -- start 2024-04-25T08:52:34.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.597+0000 7f608d163640 1 -- start start 2024-04-25T08:52:34.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608d163640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60880b5a60 0x7f6088156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608d163640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60880b6cb0 0x7f6088158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608d163640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f608815db70 0x7f6088158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608d163640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880cf1c0 con 0x7f60880b6cb0 2024-04-25T08:52:34.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608d163640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880ce530 con 0x7f608815db70 2024-04-25T08:52:34.592 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608d163640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60880cf340 con 0x7f60880b5a60 2024-04-25T08:52:34.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60880b6cb0 0x7f6088158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60880b6cb0 0x7f6088158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:52996/0 (socket says 172.21.15.172:52996) 2024-04-25T08:52:34.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608659c640 1 -- 172.21.15.172:0/2507792049 learned_addr learned my addr 172.21.15.172:0/2507792049 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:34.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f6086d9d640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60880b5a60 0x7f6088156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608759e640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f608815db70 0x7f6088158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608659c640 1 -- 172.21.15.172:0/2507792049 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60880b5a60 msgr2=0x7f6088156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608659c640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60880b5a60 0x7f6088156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608659c640 1 -- 172.21.15.172:0/2507792049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f608815db70 msgr2=0x7f6088158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.593 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608659c640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f608815db70 0x7f6088158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608659c640 1 -- 172.21.15.172:0/2507792049 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60881f4790 con 0x7f60880b6cb0 2024-04-25T08:52:34.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608759e640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f608815db70 0x7f6088158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:34.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608659c640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60880b6cb0 0x7f6088158690 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f60700097a0 tx=0x7f60700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f607f7fe640 1 -- 172.21.15.172:0/2507792049 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070037040 con 0x7f60880b6cb0 2024-04-25T08:52:34.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f607f7fe640 1 -- 172.21.15.172:0/2507792049 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6070004030 con 0x7f60880b6cb0 2024-04-25T08:52:34.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f607f7fe640 1 -- 172.21.15.172:0/2507792049 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070004400 con 0x7f60880b6cb0 2024-04-25T08:52:34.594 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.598+0000 7f608d163640 1 -- 172.21.15.172:0/2507792049 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608815f010 con 0x7f60880b6cb0 2024-04-25T08:52:34.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.599+0000 7f608d163640 1 -- 172.21.15.172:0/2507792049 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608815f8b0 con 0x7f60880b6cb0 2024-04-25T08:52:34.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.600+0000 7f608d163640 1 -- 172.21.15.172:0/2507792049 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608815f400 con 0x7f60880b6cb0 2024-04-25T08:52:34.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.600+0000 7f607f7fe640 1 -- 172.21.15.172:0/2507792049 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f607003a040 con 0x7f60880b6cb0 2024-04-25T08:52:34.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.600+0000 7f607f7fe640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f606806b4d0 0x7f606806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.601+0000 7f6086d9d640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f606806b4d0 0x7f606806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.601+0000 7f607f7fe640 1 -- 172.21.15.172:0/2507792049 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f60700aa380 con 0x7f60880b6cb0 2024-04-25T08:52:34.595 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.601+0000 7f6086d9d640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f606806b4d0 0x7f606806d990 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f60800016c0 tx=0x7f6080009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.596 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.605+0000 7f607f7fe640 1 -- 172.21.15.172:0/2507792049 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6070042020 con 0x7f60880b6cb0 2024-04-25T08:52:34.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.773+0000 7f608d163640 1 -- 172.21.15.172:0/2507792049 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60881f4960 con 0x7f606806b4d0 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.774+0000 7f607f7fe640 1 -- 172.21.15.172:0/2507792049 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13498 (secure 0 0 0) 0x7f60881f4960 con 0x7f606806b4d0 2024-04-25T08:52:34.764 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:34.765 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 -- 172.21.15.172:0/2507792049 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f606806b4d0 msgr2=0x7f606806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f606806b4d0 0x7f606806d990 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f60800016c0 tx=0x7f6080009040 comp rx=0 tx=0).stop 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 -- 172.21.15.172:0/2507792049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60880b6cb0 msgr2=0x7f6088158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60880b6cb0 0x7f6088158690 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f60700097a0 tx=0x7f60700046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 -- 172.21.15.172:0/2507792049 shutdown_connections 2024-04-25T08:52:34.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f606806b4d0 0x7f606806d990 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f608815db70 0x7f6088158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60880b6cb0 0x7f6088158690 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 --2- 172.21.15.172:0/2507792049 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60880b5a60 0x7f6088156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 -- 172.21.15.172:0/2507792049 >> 172.21.15.172:0/2507792049 conn(0x7f60880d0520 msgr2=0x7f60880b90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:34.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 -- 172.21.15.172:0/2507792049 shutdown_connections 2024-04-25T08:52:34.768 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.776+0000 7f608d163640 1 -- 172.21.15.172:0/2507792049 wait complete. 2024-04-25T08:52:34.777 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":450,"stamp":"2024-04-25T08:52:34.637746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2531620,"kb_used_data":2121156,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":752443100,"statfs":{"total":773094113280,"available":770501734400,"internally_reserved":0,"allocated":2172063744,"data_stored":2164205867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078223262,"num_objects":-1047,"num_object_clones":0,"num_object_copies":-2094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1047,"num_whiteouts":0,"num_read":-20,"num_read_kb":-4247,"num_write":-1112,"num_write_kb":-1053100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3,"num_bytes_recovered":-3145728,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.133766"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":405,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-04-25T08:52:31.400604+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:52:31.400604+0000","last_peered":"2024-04-25T08:52:31.400604+0000","last_clean":"2024-04-25T08:52:31.400604+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:52:31.400604+0000","last_undegraded":"2024-04-25T08:52:31.400604+0000","last_fullsized":"2024-04-25T08:52:31.400604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322960,"kb_used_data":273732,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94048880,"statfs":{"total":96636764160,"available":96306053120,"internally_reserved":0,"allocated":280301568,"data_stored":279320266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":252684,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":258748416,"data_stored":257764809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":325448,"kb_used_data":276220,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94046392,"statfs":{"total":96636764160,"available":96303505408,"internally_reserved":0,"allocated":282849280,"data_stored":281875604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367784,"kb_used_data":314396,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94004056,"statfs":{"total":96636764160,"available":96260153344,"internally_reserved":0,"allocated":321941504,"data_stored":320959252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380880,"kb_used_data":323332,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":93990960,"statfs":{"total":96636764160,"available":96246743040,"internally_reserved":0,"allocated":331091968,"data_stored":330110716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279376,"kb_used_data":230148,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94092464,"statfs":{"total":96636764160,"available":96350683136,"internally_reserved":0,"allocated":235671552,"data_stored":234689796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285516,"kb_used_data":236288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94086324,"statfs":{"total":96636764160,"available":96344395776,"internally_reserved":0,"allocated":241958912,"data_stored":240981210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267744,"kb_used_data":214356,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94104096,"statfs":{"total":96636764160,"available":96362594304,"internally_reserved":0,"allocated":219500544,"data_stored":218504214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:52:34.778 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T08:52:34.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.887+0000 7f4012fc8640 1 Processor -- start 2024-04-25T08:52:34.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.887+0000 7f4012fc8640 1 -- start start 2024-04-25T08:52:34.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.888+0000 7f4012fc8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f400c15dbe0 0x7f400c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.888+0000 7f4012fc8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f400c0b2cb0 0x7f400c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.888+0000 7f4012fc8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b92a0 0x7f400c0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.888+0000 7f4012fc8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c15dfc0 con 0x7f400c15dbe0 2024-04-25T08:52:34.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.888+0000 7f4012fc8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c0d1a00 con 0x7f400c0b2cb0 2024-04-25T08:52:34.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.888+0000 7f4012fc8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0b97a0 con 0x7f400c0b92a0 2024-04-25T08:52:34.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.888+0000 7f4010d64640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f400c15dbe0 0x7f400c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.888+0000 7f4010d64640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f400c15dbe0 0x7f400c0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53000/0 (socket says 172.21.15.172:53000) 2024-04-25T08:52:34.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.888+0000 7f4010d64640 1 -- 172.21.15.172:0/2112437251 learned_addr learned my addr 172.21.15.172:0/2112437251 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:34.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f400bfff640 1 --2- 172.21.15.172:0/2112437251 >> v2:172.21.15.186:3300/0 conn(0x7f400c0b2cb0 0x7f400c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f4011565640 1 --2- 172.21.15.172:0/2112437251 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b92a0 0x7f400c0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f4010d64640 1 -- 172.21.15.172:0/2112437251 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b92a0 msgr2=0x7f400c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:34.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f4010d64640 1 --2- 172.21.15.172:0/2112437251 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b92a0 0x7f400c0b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f4010d64640 1 -- 172.21.15.172:0/2112437251 >> v2:172.21.15.186:3300/0 conn(0x7f400c0b2cb0 msgr2=0x7f400c0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:34.882 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f4010d64640 1 --2- 172.21.15.172:0/2112437251 >> v2:172.21.15.186:3300/0 conn(0x7f400c0b2cb0 0x7f400c0d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f4010d64640 1 -- 172.21.15.172:0/2112437251 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c0d1c50 con 0x7f400c15dbe0 2024-04-25T08:52:34.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f400bfff640 1 --2- 172.21.15.172:0/2112437251 >> v2:172.21.15.186:3300/0 conn(0x7f400c0b2cb0 0x7f400c0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:34.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f4010d64640 1 --2- 172.21.15.172:0/2112437251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 0x7f400c0d0910 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f400c06cff0 tx=0x7f3ffc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d61d9d290d9b30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f400b7fe640 1 -- 172.21.15.172:0/2112437251 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc037070 con 0x7f400c15dbe0 2024-04-25T08:52:34.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.889+0000 7f400b7fe640 1 -- 172.21.15.172:0/2112437251 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc032440 con 0x7f400c15dbe0 2024-04-25T08:52:34.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.890+0000 7f400b7fe640 1 -- 172.21.15.172:0/2112437251 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc032810 con 0x7f400c15dbe0 2024-04-25T08:52:34.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.890+0000 7f4012fc8640 1 -- 172.21.15.172:0/2112437251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 msgr2=0x7f400c0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.883 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.890+0000 7f4012fc8640 1 --2- 172.21.15.172:0/2112437251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 0x7f400c0d0910 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f400c06cff0 tx=0x7f3ffc02a1e0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.890+0000 7f4012fc8640 1 -- 172.21.15.172:0/2112437251 shutdown_connections 2024-04-25T08:52:34.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.890+0000 7f4012fc8640 1 --2- 172.21.15.172:0/2112437251 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b92a0 0x7f400c0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.890+0000 7f4012fc8640 1 --2- 172.21.15.172:0/2112437251 >> v2:172.21.15.186:3300/0 conn(0x7f400c0b2cb0 0x7f400c0d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.890+0000 7f4012fc8640 1 --2- 172.21.15.172:0/2112437251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 0x7f400c0d0910 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.890+0000 7f4012fc8640 1 -- 172.21.15.172:0/2112437251 >> 172.21.15.172:0/2112437251 conn(0x7f400c061a20 msgr2=0x7f400c061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:34.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.890+0000 7f4012fc8640 1 -- 172.21.15.172:0/2112437251 shutdown_connections 2024-04-25T08:52:34.884 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.890+0000 7f4012fc8640 1 -- 172.21.15.172:0/2112437251 wait complete. 2024-04-25T08:52:34.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.891+0000 7f4012fc8640 1 Processor -- start 2024-04-25T08:52:34.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.891+0000 7f4012fc8640 1 -- start start 2024-04-25T08:52:34.887 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f4012fc8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b2cb0 0x7f400c0cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f4012fc8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f400c0b92a0 0x7f400c0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f4012fc8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 0x7f400c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f4012fc8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0b6ab0 con 0x7f400c15dbe0 2024-04-25T08:52:34.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f4012fc8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0d2210 con 0x7f400c0b92a0 2024-04-25T08:52:34.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f4012fc8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0b6c30 con 0x7f400c0b2cb0 2024-04-25T08:52:34.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f4011565640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 0x7f400c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.888 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f4011565640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 0x7f400c1519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53006/0 (socket says 172.21.15.172:53006) 2024-04-25T08:52:34.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f4011565640 1 -- 172.21.15.172:0/268464120 learned_addr learned my addr 172.21.15.172:0/268464120 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:34.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f400bfff640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f400c0b92a0 0x7f400c0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.892+0000 7f4010d64640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b2cb0 0x7f400c0cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f4011565640 1 -- 172.21.15.172:0/268464120 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b2cb0 msgr2=0x7f400c0cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f4011565640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b2cb0 0x7f400c0cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f4011565640 1 -- 172.21.15.172:0/268464120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f400c0b92a0 msgr2=0x7f400c0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:34.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f4011565640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f400c0b92a0 0x7f400c0b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:34.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f4011565640 1 -- 172.21.15.172:0/268464120 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c0b59a0 con 0x7f400c15dbe0 2024-04-25T08:52:34.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f400bfff640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f400c0b92a0 0x7f400c0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:34.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f4010d64640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b2cb0 0x7f400c0cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:34.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f4011565640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 0x7f400c1519b0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f4004007e30 tx=0x7f400400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f40097fa640 1 -- 172.21.15.172:0/268464120 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004014620 con 0x7f400c15dbe0 2024-04-25T08:52:34.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f40097fa640 1 -- 172.21.15.172:0/268464120 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004019070 con 0x7f400c15dbe0 2024-04-25T08:52:34.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f4012fc8640 1 -- 172.21.15.172:0/268464120 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400c151ef0 con 0x7f400c15dbe0 2024-04-25T08:52:34.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f40097fa640 1 -- 172.21.15.172:0/268464120 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004014a00 con 0x7f400c15dbe0 2024-04-25T08:52:34.890 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.893+0000 7f4012fc8640 1 -- 172.21.15.172:0/268464120 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c0cbdd0 con 0x7f400c15dbe0 2024-04-25T08:52:34.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.894+0000 7f4012fc8640 1 -- 172.21.15.172:0/268464120 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400c073990 con 0x7f400c15dbe0 2024-04-25T08:52:34.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.894+0000 7f40097fa640 1 -- 172.21.15.172:0/268464120 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4004014ba0 con 0x7f400c15dbe0 2024-04-25T08:52:34.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.895+0000 7f40097fa640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ff806b500 0x7f3ff806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:34.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.895+0000 7f40097fa640 1 -- 172.21.15.172:0/268464120 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f400408a9d0 con 0x7f400c15dbe0 2024-04-25T08:52:34.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.895+0000 7f4010d64640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ff806b500 0x7f3ff806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:34.891 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.895+0000 7f4010d64640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ff806b500 0x7f3ff806d9c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc034000 tx=0x7f3ffc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:34.892 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:34.899+0000 7f40097fa640 1 -- 172.21.15.172:0/268464120 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f400c0b59a0 con 0x7f400c15dbe0 2024-04-25T08:52:35.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.071+0000 7f4012fc8640 1 -- 172.21.15.172:0/268464120 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f400c0b7820 con 0x7f400c15dbe0 2024-04-25T08:52:35.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.072+0000 7f40097fa640 1 -- 172.21.15.172:0/268464120 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+13365 (secure 0 0 0) 0x7f4004059930 con 0x7f400c15dbe0 2024-04-25T08:52:35.063 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:35.063 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":148,"fsid":"fc7fc6a3-44ef-4f3a-bb3b-8f5e1c82ecd2","created":"2024-04-25T08:42:04.438562+0000","modified":"2024-04-25T08:52:31.805081+0000","last_up_change":"2024-04-25T08:42:15.519897+0000","last_in_change":"2024-04-25T08:42:06.535155+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T08:42:16.540683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6d2b332e-9db6-4e47-9e73-f6401c952cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6801","nonce":1800402261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6803","nonce":1800402261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6807","nonce":1800402261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1800402261},{"type":"v1","addr":"172.21.15.172:6805","nonce":1800402261}]},"public_addr":"172.21.15.172:6801/1800402261","cluster_addr":"172.21.15.172:6803/1800402261","heartbeat_back_addr":"172.21.15.172:6807/1800402261","heartbeat_front_addr":"172.21.15.172:6805/1800402261","state":["exists","up"]},{"osd":1,"uuid":"94541717-bc18-474e-b64c-bb86bf951952","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":144,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6825","nonce":2427392636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6827","nonce":2427392636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6831","nonce":2427392636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2427392636},{"type":"v1","addr":"172.21.15.172:6829","nonce":2427392636}]},"public_addr":"172.21.15.172:6825/2427392636","cluster_addr":"172.21.15.172:6827/2427392636","heartbeat_back_addr":"172.21.15.172:6831/2427392636","heartbeat_front_addr":"172.21.15.172:6829/2427392636","state":["exists","up"]},{"osd":2,"uuid":"d41b27c4-f2ab-4bed-bea7-25436f39e91a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6815","nonce":2429635913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6819","nonce":2429635913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6823","nonce":2429635913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":2429635913},{"type":"v1","addr":"172.21.15.172:6821","nonce":2429635913}]},"public_addr":"172.21.15.172:6815/2429635913","cluster_addr":"172.21.15.172:6819/2429635913","heartbeat_back_addr":"172.21.15.172:6823/2429635913","heartbeat_front_addr":"172.21.15.172:6821/2429635913","state":["exists","up"]},{"osd":3,"uuid":"7ec284fb-fe73-4631-9b85-603e83e63599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6809","nonce":3046026724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6811","nonce":3046026724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6818","nonce":3046026724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3046026724},{"type":"v1","addr":"172.21.15.172:6814","nonce":3046026724}]},"public_addr":"172.21.15.172:6809/3046026724","cluster_addr":"172.21.15.172:6811/3046026724","heartbeat_back_addr":"172.21.15.172:6818/3046026724","heartbeat_front_addr":"172.21.15.172:6814/3046026724","state":["exists","up"]},{"osd":4,"uuid":"7552fd6b-df45-46e9-bfd3-60dc645cc1f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6809","nonce":1547498830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6811","nonce":1547498830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6815","nonce":1547498830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1547498830},{"type":"v1","addr":"172.21.15.186:6813","nonce":1547498830}]},"public_addr":"172.21.15.186:6809/1547498830","cluster_addr":"172.21.15.186:6811/1547498830","heartbeat_back_addr":"172.21.15.186:6815/1547498830","heartbeat_front_addr":"172.21.15.186:6813/1547498830","state":["exists","up"]},{"osd":5,"uuid":"ddbad192-fed4-4c7e-9558-5365e737dc40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6801","nonce":2784790337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6803","nonce":2784790337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6807","nonce":2784790337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2784790337},{"type":"v1","addr":"172.21.15.186:6805","nonce":2784790337}]},"public_addr":"172.21.15.186:6801/2784790337","cluster_addr":"172.21.15.186:6803/2784790337","heartbeat_back_addr":"172.21.15.186:6807/2784790337","heartbeat_front_addr":"172.21.15.186:6805/2784790337","state":["exists","up"]},{"osd":6,"uuid":"b8431046-4c0e-4b35-a561-bf1b2552de8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6817","nonce":2238458508}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6819","nonce":2238458508}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6823","nonce":2238458508}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2238458508},{"type":"v1","addr":"172.21.15.186:6821","nonce":2238458508}]},"public_addr":"172.21.15.186:6817/2238458508","cluster_addr":"172.21.15.186:6819/2238458508","heartbeat_back_addr":"172.21.15.186:6823/2238458508","heartbeat_front_addr":"172.21.15.186:6821/2238458508","state":["exists","up"]},{"osd":7,"uuid":"5fe37232-8e8d-42d8-9b22-eb0a8e2e6a4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6825","nonce":1002001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6827","nonce":1002001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6831","nonce":1002001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1002001557},{"type":"v1","addr":"172.21.15.186:6829","nonce":1002001557}]},"public_addr":"172.21.15.186:6825/1002001557","cluster_addr":"172.21.15.186:6827/1002001557","heartbeat_back_addr":"172.21.15.186:6831/1002001557","heartbeat_front_addr":"172.21.15.186:6829/1002001557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.634118+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.708554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.742961+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.655700+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.623486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.685946+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.760729+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T08:42:11.746768+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6837/2096375996":"2024-04-26T08:52:28.501112+0000","172.21.15.172:6836/2096375996":"2024-04-26T08:52:28.501112+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T08:52:35.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 -- 172.21.15.172:0/268464120 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ff806b500 msgr2=0x7f3ff806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:35.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ff806b500 0x7f3ff806d9c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc034000 tx=0x7f3ffc02e000 comp rx=0 tx=0).stop 2024-04-25T08:52:35.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 -- 172.21.15.172:0/268464120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 msgr2=0x7f400c1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:35.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 0x7f400c1519b0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f4004007e30 tx=0x7f400400e4b0 comp rx=0 tx=0).stop 2024-04-25T08:52:35.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 -- 172.21.15.172:0/268464120 shutdown_connections 2024-04-25T08:52:35.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3ff806b500 0x7f3ff806d9c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:35.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f400c0b92a0 0x7f400c0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:35.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c15dbe0 0x7f400c1519b0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:35.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 --2- 172.21.15.172:0/268464120 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f400c0b2cb0 0x7f400c0cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:35.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 -- 172.21.15.172:0/268464120 >> 172.21.15.172:0/268464120 conn(0x7f400c061a20 msgr2=0x7f400c0b86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:35.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 -- 172.21.15.172:0/268464120 shutdown_connections 2024-04-25T08:52:35.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:35.074+0000 7f4012fc8640 1 -- 172.21.15.172:0/268464120 wait complete. 2024-04-25T08:52:36.076 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T08:52:36.077 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T08:52:36.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.201+0000 7fa410a37640 1 Processor -- start 2024-04-25T08:52:36.192 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.201+0000 7fa410a37640 1 -- start start 2024-04-25T08:52:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.201+0000 7fa410a37640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa40c1610f0 0x7fa40c06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.201+0000 7fa410a37640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c0c6960 con 0x7fa40c1616f0 2024-04-25T08:52:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.201+0000 7fa410a37640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c162260 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.201+0000 7fa410a37640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40c1614d0 con 0x7fa40c1610f0 2024-04-25T08:52:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.202+0000 7fa40a59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa40c1610f0 0x7fa40c06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.202+0000 7fa40a59c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa40c1610f0 0x7fa40c06c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53008/0 (socket says 172.21.15.172:53008) 2024-04-25T08:52:36.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.202+0000 7fa40a59c640 1 -- 172.21.15.172:0/2169232899 learned_addr learned my addr 172.21.15.172:0/2169232899 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:36.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.202+0000 7fa403fff640 1 --1- 172.21.15.172:0/2169232899 >> v1:172.21.15.172:6789/0 conn(0x7fa40c1616f0 0x7fa40c0ce0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46014/0 (socket says 172.21.15.172:46014) 2024-04-25T08:52:36.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.202+0000 7fa40a59c640 1 -- 172.21.15.172:0/2169232899 >> v1:172.21.15.186:6789/0 conn(0x7fa40c0ce7b0 legacy=0x7fa40c0d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.202+0000 7fa40a59c640 1 -- 172.21.15.172:0/2169232899 >> v1:172.21.15.172:6789/0 conn(0x7fa40c1616f0 legacy=0x7fa40c0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.202+0000 7fa40a59c640 1 -- 172.21.15.172:0/2169232899 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c162540 con 0x7fa40c1610f0 2024-04-25T08:52:36.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa40a59c640 1 --2- 172.21.15.172:0/2169232899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa40c1610f0 0x7fa40c06c1c0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009870 tx=0x7fa3fc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f26e2fda7985d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa409d9b640 1 -- 172.21.15.172:0/2169232899 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc037070 con 0x7fa40c1610f0 2024-04-25T08:52:36.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa409d9b640 1 -- 172.21.15.172:0/2169232899 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc02ae50 con 0x7fa40c1610f0 2024-04-25T08:52:36.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa409d9b640 1 -- 172.21.15.172:0/2169232899 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc032860 con 0x7fa40c1610f0 2024-04-25T08:52:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa410a37640 1 -- 172.21.15.172:0/2169232899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa40c1610f0 msgr2=0x7fa40c06c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa410a37640 1 --2- 172.21.15.172:0/2169232899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa40c1610f0 0x7fa40c06c1c0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009870 tx=0x7fa3fc02a300 comp rx=0 tx=0).stop 2024-04-25T08:52:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa410a37640 1 -- 172.21.15.172:0/2169232899 shutdown_connections 2024-04-25T08:52:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa410a37640 1 --2- 172.21.15.172:0/2169232899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa40c1610f0 0x7fa40c06c1c0 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa410a37640 1 -- 172.21.15.172:0/2169232899 >> 172.21.15.172:0/2169232899 conn(0x7fa40c06f500 msgr2=0x7fa40c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa410a37640 1 -- 172.21.15.172:0/2169232899 shutdown_connections 2024-04-25T08:52:36.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.203+0000 7fa410a37640 1 -- 172.21.15.172:0/2169232899 wait complete. 2024-04-25T08:52:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.205+0000 7fa410a37640 1 Processor -- start 2024-04-25T08:52:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.205+0000 7fa410a37640 1 -- start start 2024-04-25T08:52:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.205+0000 7fa410a37640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa40c0ce7b0 0x7fa40c142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.205+0000 7fa410a37640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa40c1610f0 0x7fa40c0aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa410a37640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa40c1616f0 0x7fa40c0acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa410a37640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0cf690 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa410a37640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0cfce0 con 0x7fa40c1616f0 2024-04-25T08:52:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa410a37640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c06c700 con 0x7fa40c1610f0 2024-04-25T08:52:36.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa40a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa40c0ce7b0 0x7fa40c142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa40a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa40c0ce7b0 0x7fa40c142be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53020/0 (socket says 172.21.15.172:53020) 2024-04-25T08:52:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa40a59c640 1 -- 172.21.15.172:0/2803581540 learned_addr learned my addr 172.21.15.172:0/2803581540 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa40ad9d640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa40c1616f0 0x7fa40c0acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa40a59c640 1 -- 172.21.15.172:0/2803581540 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa40c1610f0 msgr2=0x7fa40c0aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa40a59c640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa40c1610f0 0x7fa40c0aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa40a59c640 1 -- 172.21.15.172:0/2803581540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa40c1616f0 msgr2=0x7fa40c0acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa40a59c640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa40c1616f0 0x7fa40c0acf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa40a59c640 1 -- 172.21.15.172:0/2803581540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c143460 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa40a59c640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa40c0ce7b0 0x7fa40c142be0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009870 tx=0x7fa3fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa402ffd640 1 -- 172.21.15.172:0/2803581540 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc041070 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa402ffd640 1 -- 172.21.15.172:0/2803581540 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc03c870 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c143740 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa402ffd640 1 -- 172.21.15.172:0/2803581540 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc037040 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.206+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c143d00 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.201 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.207+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa40c073a00 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.208+0000 7fa402ffd640 1 -- 172.21.15.172:0/2803581540 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa3fc044070 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.208+0000 7fa402ffd640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3ec06b4d0 0x7fa3ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.208+0000 7fa402ffd640 1 -- 172.21.15.172:0/2803581540 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa3fc0aafa0 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.208+0000 7fa403fff640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3ec06b4d0 0x7fa3ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.209+0000 7fa402ffd640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] conn(0x7fa3ec071970 0x7fa3ec073db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.209+0000 7fa402ffd640 1 -- 172.21.15.172:0/2803581540 --> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3fc03fe50 con 0x7fa3ec071970 2024-04-25T08:52:36.203 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.209+0000 7fa402ffd640 1 -- 172.21.15.172:0/2803581540 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3fc0ab430 con 0x7fa40c0ce7b0 2024-04-25T08:52:36.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.209+0000 7fa40ad9d640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] conn(0x7fa3ec071970 0x7fa3ec073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.209+0000 7fa403fff640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3ec06b4d0 0x7fa3ec06d990 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa40c155fa0 tx=0x7fa3f40079c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.209+0000 7fa40ad9d640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] conn(0x7fa3ec071970 0x7fa3ec073db0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.210+0000 7fa402ffd640 1 -- 172.21.15.172:0/2803581540 <== osd.0 v2:172.21.15.172:6800/1800402261 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa3fc03fe50 con 0x7fa3ec071970 2024-04-25T08:52:36.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.222+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 --> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa40c0aecf0 con 0x7fa3ec071970 2024-04-25T08:52:36.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa402ffd640 1 -- 172.21.15.172:0/2803581540 <== osd.0 v2:172.21.15.172:6800/1800402261 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa40c0aecf0 con 0x7fa3ec071970 2024-04-25T08:52:36.213 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:52:36.213 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T08:52:36.213 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:52:36.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] conn(0x7fa3ec071970 msgr2=0x7fa3ec073db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.214 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa410a37640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:6800/1800402261,v1:172.21.15.172:6801/1800402261] conn(0x7fa3ec071970 0x7fa3ec073db0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3ec06b4d0 msgr2=0x7fa3ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa410a37640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fa3ec06b4d0 0x7fa3ec06d990 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa40c155fa0 tx=0x7fa3f40079c0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa40c0ce7b0 msgr2=0x7fa40c142be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa410a37640 1 --2- 172.21.15.172:0/2803581540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa40c0ce7b0 0x7fa40c142be0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009870 tx=0x7fa3fc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa40ad9d640 1 -- 172.21.15.172:0/2803581540 reap_dead start 2024-04-25T08:52:36.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 shutdown_connections 2024-04-25T08:52:36.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 >> 172.21.15.172:0/2803581540 conn(0x7fa40c06f500 msgr2=0x7fa40c160090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:36.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 shutdown_connections 2024-04-25T08:52:36.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.223+0000 7fa410a37640 1 -- 172.21.15.172:0/2803581540 wait complete. 2024-04-25T08:52:36.224 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T08:52:36.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.331+0000 7f3489b6a640 1 Processor -- start 2024-04-25T08:52:36.322 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.332+0000 7f3489b6a640 1 -- start start 2024-04-25T08:52:36.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.332+0000 7f3489b6a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f34840cd8a0 0x7f348415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.332+0000 7f3489b6a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348415e6e0 con 0x7f3484150b90 2024-04-25T08:52:36.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.332+0000 7f3489b6a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348415e9c0 con 0x7f34840cd4c0 2024-04-25T08:52:36.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.332+0000 7f3489b6a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348415a9c0 con 0x7f34840cd8a0 2024-04-25T08:52:36.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.332+0000 7f3483fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3484150b90 0x7f3484071270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46022/0 (socket says 172.21.15.172:46022) 2024-04-25T08:52:36.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.333+0000 7f3483fff640 1 -- 172.21.15.172:0/3991041112 learned_addr learned my addr 172.21.15.172:0/3991041112 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:36.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.333+0000 7f347bfff640 1 --2- 172.21.15.172:0/3991041112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f34840cd8a0 0x7f348415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.333+0000 7f3482ffd640 1 -- 172.21.15.172:0/3991041112 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684132534 0 0) 0x7f348415e6e0 con 0x7f3484150b90 2024-04-25T08:52:36.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.333+0000 7f3482ffd640 1 -- 172.21.15.172:0/3991041112 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3470003520 con 0x7f3484150b90 2024-04-25T08:52:36.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.333+0000 7f3482ffd640 1 -- 172.21.15.172:0/3991041112 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113753901 0 0) 0x7f348415e9c0 con 0x7f34840cd4c0 2024-04-25T08:52:36.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.333+0000 7f3482ffd640 1 -- 172.21.15.172:0/3991041112 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f348415e6e0 con 0x7f34840cd4c0 2024-04-25T08:52:36.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.333+0000 7f347bfff640 1 -- 172.21.15.172:0/3991041112 >> v1:172.21.15.186:6789/0 conn(0x7f34840cd4c0 legacy=0x7f348415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.333+0000 7f347bfff640 1 -- 172.21.15.172:0/3991041112 >> v1:172.21.15.172:6789/0 conn(0x7f3484150b90 legacy=0x7f3484071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.333+0000 7f3482ffd640 1 -- 172.21.15.172:0/3991041112 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 917063099 0 0) 0x7f3470003520 con 0x7f3484150b90 2024-04-25T08:52:36.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.333+0000 7f347bfff640 1 -- 172.21.15.172:0/3991041112 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348415aca0 con 0x7f34840cd8a0 2024-04-25T08:52:36.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.334+0000 7f347bfff640 1 --2- 172.21.15.172:0/3991041112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f34840cd8a0 0x7f348415b1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f346c0097d0 tx=0x7f346c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b573d11ab784b50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.334+0000 7f3482ffd640 1 -- 172.21.15.172:0/3991041112 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c037070 con 0x7f34840cd8a0 2024-04-25T08:52:36.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.334+0000 7f3482ffd640 1 -- 172.21.15.172:0/3991041112 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c02ac30 con 0x7f34840cd8a0 2024-04-25T08:52:36.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.334+0000 7f3482ffd640 1 -- 172.21.15.172:0/3991041112 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0019f0 con 0x7f34840cd8a0 2024-04-25T08:52:36.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.334+0000 7f3489b6a640 1 -- 172.21.15.172:0/3991041112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f34840cd8a0 msgr2=0x7f348415b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.334+0000 7f3489b6a640 1 --2- 172.21.15.172:0/3991041112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f34840cd8a0 0x7f348415b1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f346c0097d0 tx=0x7f346c02a1a0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.335+0000 7f3489b6a640 1 -- 172.21.15.172:0/3991041112 shutdown_connections 2024-04-25T08:52:36.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.335+0000 7f3489b6a640 1 --2- 172.21.15.172:0/3991041112 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f34840cd8a0 0x7f348415b1c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.335+0000 7f3489b6a640 1 -- 172.21.15.172:0/3991041112 >> 172.21.15.172:0/3991041112 conn(0x7f348406abe0 msgr2=0x7f348406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:36.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.335+0000 7f3489b6a640 1 -- 172.21.15.172:0/3991041112 shutdown_connections 2024-04-25T08:52:36.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.335+0000 7f3489b6a640 1 -- 172.21.15.172:0/3991041112 wait complete. 2024-04-25T08:52:36.330 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.336+0000 7f3489b6a640 1 Processor -- start 2024-04-25T08:52:36.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.336+0000 7f3489b6a640 1 -- start start 2024-04-25T08:52:36.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.336+0000 7f3489b6a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f34840cd4c0 0x7f348413eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.336+0000 7f3489b6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34840cd8a0 0x7f34840b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.336+0000 7f3489b6a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3484150b90 0x7f34840b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.336+0000 7f3489b6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348406eca0 con 0x7f34840cd8a0 2024-04-25T08:52:36.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.336+0000 7f3489b6a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348415e370 con 0x7f34840cd4c0 2024-04-25T08:52:36.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.336+0000 7f3489b6a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348406ee20 con 0x7f3484150b90 2024-04-25T08:52:36.331 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.336+0000 7f347bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34840cd8a0 0x7f34840b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f347bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34840cd8a0 0x7f34840b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53028/0 (socket says 172.21.15.172:53028) 2024-04-25T08:52:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f347bfff640 1 -- 172.21.15.172:0/2703939246 learned_addr learned my addr 172.21.15.172:0/2703939246 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f34837fe640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f34840cd4c0 0x7f348413eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f3483fff640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3484150b90 0x7f34840b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f347bfff640 1 -- 172.21.15.172:0/2703939246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3484150b90 msgr2=0x7f34840b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f347bfff640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3484150b90 0x7f34840b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f347bfff640 1 -- 172.21.15.172:0/2703939246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f34840cd4c0 msgr2=0x7f348413eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f347bfff640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f34840cd4c0 0x7f348413eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f347bfff640 1 -- 172.21.15.172:0/2703939246 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484157090 con 0x7f34840cd8a0 2024-04-25T08:52:36.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f3483fff640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3484150b90 0x7f34840b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:36.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f347bfff640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34840cd8a0 0x7f34840b0be0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f346c035040 tx=0x7f346c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f3480ff9640 1 -- 172.21.15.172:0/2703939246 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c041020 con 0x7f34840cd8a0 2024-04-25T08:52:36.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f3480ff9640 1 -- 172.21.15.172:0/2703939246 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c03d640 con 0x7f34840cd8a0 2024-04-25T08:52:36.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f3489b6a640 1 -- 172.21.15.172:0/2703939246 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3484157370 con 0x7f34840cd8a0 2024-04-25T08:52:36.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f3480ff9640 1 -- 172.21.15.172:0/2703939246 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c037040 con 0x7f34840cd8a0 2024-04-25T08:52:36.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.337+0000 7f3489b6a640 1 -- 172.21.15.172:0/2703939246 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3484157930 con 0x7f34840cd8a0 2024-04-25T08:52:36.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.338+0000 7f3489b6a640 1 -- 172.21.15.172:0/2703939246 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3484073a00 con 0x7f34840cd8a0 2024-04-25T08:52:36.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.339+0000 7f3480ff9640 1 -- 172.21.15.172:0/2703939246 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f346c044020 con 0x7f34840cd8a0 2024-04-25T08:52:36.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.339+0000 7f3480ff9640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f346406b4d0 0x7f346406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.339+0000 7f3480ff9640 1 -- 172.21.15.172:0/2703939246 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f346c0aa520 con 0x7f34840cd8a0 2024-04-25T08:52:36.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.339+0000 7f34837fe640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f346406b4d0 0x7f346406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.340+0000 7f34837fe640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f346406b4d0 0x7f346406d990 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f34740011e0 tx=0x7f3474009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.335 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.343+0000 7f3480ff9640 1 -- 172.21.15.172:0/2703939246 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f346c04b030 con 0x7f34840cd8a0 2024-04-25T08:52:36.503 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.513+0000 7f3489b6a640 1 -- 172.21.15.172:0/2703939246 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f34840ccb10 con 0x7f346406b4d0 2024-04-25T08:52:36.504 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.513+0000 7f3480ff9640 1 -- 172.21.15.172:0/2703939246 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f34840ccb10 con 0x7f346406b4d0 2024-04-25T08:52:36.504 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T08:52:36.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 -- 172.21.15.172:0/2703939246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f346406b4d0 msgr2=0x7f346406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f346406b4d0 0x7f346406d990 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f34740011e0 tx=0x7f3474009040 comp rx=0 tx=0).stop 2024-04-25T08:52:36.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 -- 172.21.15.172:0/2703939246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34840cd8a0 msgr2=0x7f34840b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34840cd8a0 0x7f34840b0be0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f346c035040 tx=0x7f346c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 -- 172.21.15.172:0/2703939246 shutdown_connections 2024-04-25T08:52:36.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f346406b4d0 0x7f346406d990 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3484150b90 0x7f34840b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.506 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34840cd8a0 0x7f34840b0be0 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 --2- 172.21.15.172:0/2703939246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f34840cd4c0 0x7f348413eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 -- 172.21.15.172:0/2703939246 >> 172.21.15.172:0/2703939246 conn(0x7f348406abe0 msgr2=0x7f348415be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:36.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 -- 172.21.15.172:0/2703939246 shutdown_connections 2024-04-25T08:52:36.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.515+0000 7f3489b6a640 1 -- 172.21.15.172:0/2703939246 wait complete. 2024-04-25T08:52:36.518 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T08:52:36.519 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T08:52:36.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.631+0000 7f12a64b3640 1 Processor -- start 2024-04-25T08:52:36.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.632+0000 7f12a64b3640 1 -- start start 2024-04-25T08:52:36.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.632+0000 7f12a64b3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f12a00c6010 0x7f12a00ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.632+0000 7f12a64b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 0x7f12a00cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.632+0000 7f12a64b3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a00c6940 con 0x7f12a015a9f0 2024-04-25T08:52:36.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.632+0000 7f12a64b3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a00b0020 con 0x7f12a00c6010 2024-04-25T08:52:36.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.632+0000 7f12a64b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00cb5a0 con 0x7f12a00cd520 2024-04-25T08:52:36.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.633+0000 7f129f7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f12a00c6010 0x7f12a00ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.633+0000 7f12a4a50640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 0x7f12a00cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.633+0000 7f129ffff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f12a015a9f0 0x7f12a00cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:53816/0 (socket says 172.21.15.172:53816) 2024-04-25T08:52:36.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.633+0000 7f129ffff640 1 -- 172.21.15.172:0/3957198312 learned_addr learned my addr 172.21.15.172:0/3957198312 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:36.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.633+0000 7f129f7fe640 1 -- 172.21.15.172:0/3957198312 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 msgr2=0x7f12a00cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:36.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.633+0000 7f129f7fe640 1 --2- 172.21.15.172:0/3957198312 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 0x7f12a00cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.633+0000 7f129f7fe640 1 -- 172.21.15.172:0/3957198312 >> v1:172.21.15.186:6789/0 conn(0x7f12a015a9f0 legacy=0x7f12a00cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.633+0000 7f129f7fe640 1 -- 172.21.15.172:0/3957198312 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a015add0 con 0x7f12a00c6010 2024-04-25T08:52:36.625 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.633+0000 7f12a4a50640 1 --2- 172.21.15.172:0/3957198312 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 0x7f12a00cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:52:36.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f129f7fe640 1 --2- 172.21.15.172:0/3957198312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a00c6010 0x7f12a00ccfe0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f12940097a0 tx=0x7f129402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67700e183d9c0d48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f129effd640 1 -- 172.21.15.172:0/3957198312 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294037070 con 0x7f12a00c6010 2024-04-25T08:52:36.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f129effd640 1 -- 172.21.15.172:0/3957198312 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1294032440 con 0x7f12a00c6010 2024-04-25T08:52:36.626 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f129effd640 1 -- 172.21.15.172:0/3957198312 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294032810 con 0x7f12a00c6010 2024-04-25T08:52:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f12a64b3640 1 -- 172.21.15.172:0/3957198312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a00c6010 msgr2=0x7f12a00ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f12a64b3640 1 --2- 172.21.15.172:0/3957198312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a00c6010 0x7f12a00ccfe0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f12940097a0 tx=0x7f129402a180 comp rx=0 tx=0).stop 2024-04-25T08:52:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f12a64b3640 1 -- 172.21.15.172:0/3957198312 shutdown_connections 2024-04-25T08:52:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f12a64b3640 1 --2- 172.21.15.172:0/3957198312 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 0x7f12a00cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f12a64b3640 1 --2- 172.21.15.172:0/3957198312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a00c6010 0x7f12a00ccfe0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f12a64b3640 1 -- 172.21.15.172:0/3957198312 >> 172.21.15.172:0/3957198312 conn(0x7f12a00b2390 msgr2=0x7f12a00b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:36.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f12a64b3640 1 -- 172.21.15.172:0/3957198312 shutdown_connections 2024-04-25T08:52:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.634+0000 7f12a64b3640 1 -- 172.21.15.172:0/3957198312 wait complete. 2024-04-25T08:52:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.636+0000 7f12a64b3640 1 Processor -- start 2024-04-25T08:52:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.636+0000 7f12a64b3640 1 -- start start 2024-04-25T08:52:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.636+0000 7f12a64b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a00c6010 0x7f12a0144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.636+0000 7f12a64b3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 0x7f12a00cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.636+0000 7f12a64b3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a015a9f0 0x7f12a00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.636+0000 7f12a64b3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00caf50 con 0x7f12a00c6010 2024-04-25T08:52:36.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.636+0000 7f12a64b3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00cd930 con 0x7f12a015a9f0 2024-04-25T08:52:36.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.636+0000 7f12a64b3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00cb230 con 0x7f12a00cd520 2024-04-25T08:52:36.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a00c6010 0x7f12a0144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f12a4a50640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a015a9f0 0x7f12a00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f12a4a50640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a015a9f0 0x7f12a00cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.172:39268/0 (socket says 172.21.15.172:39268) 2024-04-25T08:52:36.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129f7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 0x7f12a00cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f12a4a50640 1 -- 172.21.15.172:0/956210783 learned_addr learned my addr 172.21.15.172:0/956210783 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:36.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129f7fe640 1 -- 172.21.15.172:0/956210783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a015a9f0 msgr2=0x7f12a00cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129f7fe640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a015a9f0 0x7f12a00cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129f7fe640 1 -- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a00c6010 msgr2=0x7f12a0144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129f7fe640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a00c6010 0x7f12a0144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129f7fe640 1 -- 172.21.15.172:0/956210783 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a014d980 con 0x7f12a00cd520 2024-04-25T08:52:36.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f12a4a50640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12a015a9f0 0x7f12a00cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:52:36.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129ffff640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a00c6010 0x7f12a0144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:52:36.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129f7fe640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 0x7f12a00cb930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1294031000 tx=0x7f12940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129cff9640 1 -- 172.21.15.172:0/956210783 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294041020 con 0x7f12a00cd520 2024-04-25T08:52:36.632 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129cff9640 1 -- 172.21.15.172:0/956210783 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1294030700 con 0x7f12a00cd520 2024-04-25T08:52:36.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a00b0330 con 0x7f12a00cd520 2024-04-25T08:52:36.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f129cff9640 1 -- 172.21.15.172:0/956210783 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294037040 con 0x7f12a00cd520 2024-04-25T08:52:36.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.637+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a014cc70 con 0x7f12a00cd520 2024-04-25T08:52:36.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.638+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12a00b09f0 con 0x7f12a00cd520 2024-04-25T08:52:36.633 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.639+0000 7f129cff9640 1 -- 172.21.15.172:0/956210783 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1294066070 con 0x7f12a00cd520 2024-04-25T08:52:36.634 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.639+0000 7f129cff9640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f128c06b4d0 0x7f128c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.639+0000 7f129ffff640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f128c06b4d0 0x7f128c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.639+0000 7f129cff9640 1 -- 172.21.15.172:0/956210783 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f12940ab590 con 0x7f12a00cd520 2024-04-25T08:52:36.635 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.639+0000 7f129cff9640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] conn(0x7f128c071970 0x7f128c073db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.639+0000 7f129cff9640 1 -- 172.21.15.172:0/956210783 --> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1294034ec0 con 0x7f128c071970 2024-04-25T08:52:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.639+0000 7f129cff9640 1 -- 172.21.15.172:0/956210783 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12940ab940 con 0x7f12a00cd520 2024-04-25T08:52:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.639+0000 7f12a4a50640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] conn(0x7f128c071970 0x7f128c073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.640+0000 7f129ffff640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f128c06b4d0 0x7f128c06d990 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1290007fd0 tx=0x7f1290007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.640+0000 7f12a4a50640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] conn(0x7f128c071970 0x7f128c073db0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.636 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.640+0000 7f129cff9640 1 -- 172.21.15.172:0/956210783 <== osd.1 v2:172.21.15.172:6824/2427392636 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1294034ec0 con 0x7f128c071970 2024-04-25T08:52:36.643 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.653+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 --> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f12a0073a00 con 0x7f128c071970 2024-04-25T08:52:36.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.653+0000 7f129cff9640 1 -- 172.21.15.172:0/956210783 <== osd.1 v2:172.21.15.172:6824/2427392636 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f12a0073a00 con 0x7f128c071970 2024-04-25T08:52:36.644 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:52:36.644 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T08:52:36.644 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:52:36.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] conn(0x7f128c071970 msgr2=0x7f128c073db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a64b3640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:6824/2427392636,v1:172.21.15.172:6825/2427392636] conn(0x7f128c071970 0x7f128c073db0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f128c06b4d0 msgr2=0x7f128c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a64b3640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f128c06b4d0 0x7f128c06d990 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1290007fd0 tx=0x7f1290007e80 comp rx=0 tx=0).stop 2024-04-25T08:52:36.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 msgr2=0x7f12a00cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a64b3640 1 --2- 172.21.15.172:0/956210783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12a00cd520 0x7f12a00cb930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1294031000 tx=0x7f12940046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a4a50640 1 -- 172.21.15.172:0/956210783 reap_dead start 2024-04-25T08:52:36.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 shutdown_connections 2024-04-25T08:52:36.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 >> 172.21.15.172:0/956210783 conn(0x7f12a00b2390 msgr2=0x7f12a006e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:36.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 shutdown_connections 2024-04-25T08:52:36.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.654+0000 7f12a64b3640 1 -- 172.21.15.172:0/956210783 wait complete. 2024-04-25T08:52:36.655 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T08:52:36.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.764+0000 7ffa5184d640 1 Processor -- start 2024-04-25T08:52:36.754 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.764+0000 7ffa5184d640 1 -- start start 2024-04-25T08:52:36.756 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.764+0000 7ffa5184d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffa4c0cd8a0 0x7ffa4c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.764+0000 7ffa5184d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c15e6e0 con 0x7ffa4c0cd4c0 2024-04-25T08:52:36.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.764+0000 7ffa5184d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c15e9c0 con 0x7ffa4c150b90 2024-04-25T08:52:36.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.764+0000 7ffa5184d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c15a9c0 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.765+0000 7ffa4affd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ffa4c0cd4c0 0x7ffa4c15dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46032/0 (socket says 172.21.15.172:46032) 2024-04-25T08:52:36.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.765+0000 7ffa4affd640 1 -- 172.21.15.172:0/2447633453 learned_addr learned my addr 172.21.15.172:0/2447633453 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:36.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.765+0000 7ffa4a7fc640 1 --2- 172.21.15.172:0/2447633453 >> v2:172.21.15.186:3300/0 conn(0x7ffa4c0cd8a0 0x7ffa4c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.757 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.765+0000 7ffa49ffb640 1 -- 172.21.15.172:0/2447633453 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983060219 0 0) 0x7ffa4c15e6e0 con 0x7ffa4c0cd4c0 2024-04-25T08:52:36.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.765+0000 7ffa49ffb640 1 -- 172.21.15.172:0/2447633453 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa34003520 con 0x7ffa4c0cd4c0 2024-04-25T08:52:36.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.765+0000 7ffa4a7fc640 1 -- 172.21.15.172:0/2447633453 >> v1:172.21.15.186:6789/0 conn(0x7ffa4c150b90 legacy=0x7ffa4c071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.765+0000 7ffa49ffb640 1 -- 172.21.15.172:0/2447633453 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556351706 0 0) 0x7ffa4c15e9c0 con 0x7ffa4c150b90 2024-04-25T08:52:36.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.765+0000 7ffa4a7fc640 1 -- 172.21.15.172:0/2447633453 >> v1:172.21.15.172:6789/0 conn(0x7ffa4c0cd4c0 legacy=0x7ffa4c15dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.765+0000 7ffa4a7fc640 1 -- 172.21.15.172:0/2447633453 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c15aca0 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa4a7fc640 1 --2- 172.21.15.172:0/2447633453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa4c0cd8a0 0x7ffa4c15b1c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0097a0 tx=0x7ffa3c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc2aee8e5c7fb57d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa49ffb640 1 -- 172.21.15.172:0/2447633453 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c037070 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.758 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa49ffb640 1 -- 172.21.15.172:0/2447633453 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c032440 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa49ffb640 1 -- 172.21.15.172:0/2447633453 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0327f0 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa5184d640 1 -- 172.21.15.172:0/2447633453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa4c0cd8a0 msgr2=0x7ffa4c15b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa5184d640 1 --2- 172.21.15.172:0/2447633453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa4c0cd8a0 0x7ffa4c15b1c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0097a0 tx=0x7ffa3c02a230 comp rx=0 tx=0).stop 2024-04-25T08:52:36.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa5184d640 1 -- 172.21.15.172:0/2447633453 shutdown_connections 2024-04-25T08:52:36.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa5184d640 1 --2- 172.21.15.172:0/2447633453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa4c0cd8a0 0x7ffa4c15b1c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa5184d640 1 -- 172.21.15.172:0/2447633453 >> 172.21.15.172:0/2447633453 conn(0x7ffa4c06abe0 msgr2=0x7ffa4c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:36.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa5184d640 1 -- 172.21.15.172:0/2447633453 shutdown_connections 2024-04-25T08:52:36.759 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.766+0000 7ffa5184d640 1 -- 172.21.15.172:0/2447633453 wait complete. 2024-04-25T08:52:36.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.768+0000 7ffa5184d640 1 Processor -- start 2024-04-25T08:52:36.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.768+0000 7ffa5184d640 1 -- start start 2024-04-25T08:52:36.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.768+0000 7ffa5184d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa4c0cd4c0 0x7ffa4c13c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.768+0000 7ffa5184d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa4c0cd8a0 0x7ffa4c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.768+0000 7ffa5184d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa4c150b90 0x7ffa4c13a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.768+0000 7ffa5184d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c06eca0 con 0x7ffa4c0cd4c0 2024-04-25T08:52:36.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.768+0000 7ffa5184d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c15e370 con 0x7ffa4c150b90 2024-04-25T08:52:36.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.768+0000 7ffa5184d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c06ee20 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.768+0000 7ffa4affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa4c0cd4c0 0x7ffa4c13c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa4c0cd4c0 0x7ffa4c13c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53046/0 (socket says 172.21.15.172:53046) 2024-04-25T08:52:36.763 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4affd640 1 -- 172.21.15.172:0/721070869 learned_addr learned my addr 172.21.15.172:0/721070869 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4a7fc640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa4c0cd8a0 0x7ffa4c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4b7fe640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa4c150b90 0x7ffa4c13a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4a7fc640 1 -- 172.21.15.172:0/721070869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa4c150b90 msgr2=0x7ffa4c13a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4a7fc640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa4c150b90 0x7ffa4c13a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4a7fc640 1 -- 172.21.15.172:0/721070869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa4c0cd4c0 msgr2=0x7ffa4c13c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4a7fc640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa4c0cd4c0 0x7ffa4c13c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4a7fc640 1 -- 172.21.15.172:0/721070869 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c13d720 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4affd640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa4c0cd4c0 0x7ffa4c13c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:52:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa4a7fc640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa4c0cd8a0 0x7ffa4c15d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c031000 tx=0x7ffa3c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa33fff640 1 -- 172.21.15.172:0/721070869 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c041020 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa33fff640 1 -- 172.21.15.172:0/721070869 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c030700 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa5184d640 1 -- 172.21.15.172:0/721070869 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4c13fa80 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa33fff640 1 -- 172.21.15.172:0/721070869 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c037040 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.769+0000 7ffa5184d640 1 -- 172.21.15.172:0/721070869 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4c15cc70 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.770+0000 7ffa5184d640 1 -- 172.21.15.172:0/721070869 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4c15db50 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.771+0000 7ffa33fff640 1 -- 172.21.15.172:0/721070869 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa3c044020 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.771+0000 7ffa33fff640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa3806b4d0 0x7ffa3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.771+0000 7ffa4affd640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa3806b4d0 0x7ffa3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.771+0000 7ffa33fff640 1 -- 172.21.15.172:0/721070869 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ffa3c0aa6a0 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.771+0000 7ffa4affd640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa3806b4d0 0x7ffa3806d990 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ffa40005880 tx=0x7ffa40009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:36.766 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.776+0000 7ffa33fff640 1 -- 172.21.15.172:0/721070869 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffa4c15db50 con 0x7ffa4c0cd8a0 2024-04-25T08:52:36.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.949+0000 7ffa5184d640 1 -- 172.21.15.172:0/721070869 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa4c15d730 con 0x7ffa3806b4d0 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.949+0000 7ffa33fff640 1 -- 172.21.15.172:0/721070869 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffa4c15d730 con 0x7ffa3806b4d0 2024-04-25T08:52:36.940 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 -- 172.21.15.172:0/721070869 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa3806b4d0 msgr2=0x7ffa3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa3806b4d0 0x7ffa3806d990 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ffa40005880 tx=0x7ffa40009040 comp rx=0 tx=0).stop 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 -- 172.21.15.172:0/721070869 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa4c0cd8a0 msgr2=0x7ffa4c15d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa4c0cd8a0 0x7ffa4c15d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c031000 tx=0x7ffa3c0046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 -- 172.21.15.172:0/721070869 shutdown_connections 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa3806b4d0 0x7ffa3806d990 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa4c150b90 0x7ffa4c13a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa4c0cd8a0 0x7ffa4c15d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 --2- 172.21.15.172:0/721070869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa4c0cd4c0 0x7ffa4c13c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:36.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 -- 172.21.15.172:0/721070869 >> 172.21.15.172:0/721070869 conn(0x7ffa4c06abe0 msgr2=0x7ffa4c06d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:36.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 -- 172.21.15.172:0/721070869 shutdown_connections 2024-04-25T08:52:36.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:36.951+0000 7ffa5184d640 1 -- 172.21.15.172:0/721070869 wait complete. 2024-04-25T08:52:36.952 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T08:52:36.953 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T08:52:37.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.065+0000 7f3fe8d14640 1 Processor -- start 2024-04-25T08:52:37.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.065+0000 7f3fe8d14640 1 -- start start 2024-04-25T08:52:37.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.065+0000 7f3fe8d14640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3fe41610f0 0x7f3fe406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.065+0000 7f3fe8d14640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe40ce7b0 0x7f3fe4161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.065+0000 7f3fe8d14640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40c6960 con 0x7f3fe41616f0 2024-04-25T08:52:37.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.065+0000 7f3fe8d14640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe41614d0 con 0x7f3fe41610f0 2024-04-25T08:52:37.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.065+0000 7f3fe8d14640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4162260 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.066+0000 7f3fe259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3fe41610f0 0x7f3fe406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.066+0000 7f3fdbfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3fe41616f0 0x7f3fe40ce0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:46046/0 (socket says 172.21.15.172:46046) 2024-04-25T08:52:37.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.066+0000 7f3fdbfff640 1 -- 172.21.15.172:0/3996625905 learned_addr learned my addr 172.21.15.172:0/3996625905 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:37.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.066+0000 7f3fe259c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3fe41610f0 0x7f3fe406c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53048/0 (socket says 172.21.15.172:53048) 2024-04-25T08:52:37.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.066+0000 7f3fe2d9d640 1 --2- 172.21.15.172:0/3996625905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe40ce7b0 0x7f3fe4161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.066+0000 7f3fe259c640 1 -- 172.21.15.172:0/3996625905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe40ce7b0 msgr2=0x7f3fe4161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:37.058 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.066+0000 7f3fe259c640 1 --2- 172.21.15.172:0/3996625905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe40ce7b0 0x7f3fe4161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.066+0000 7f3fe259c640 1 -- 172.21.15.172:0/3996625905 >> v1:172.21.15.172:6789/0 conn(0x7f3fe41616f0 legacy=0x7f3fe40ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.066+0000 7f3fe259c640 1 -- 172.21.15.172:0/3996625905 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4162540 con 0x7f3fe41610f0 2024-04-25T08:52:37.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.066+0000 7f3fe1d9b640 1 -- 172.21.15.172:0/3996625905 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886703678 0 0) 0x7f3fe40c6960 con 0x7f3fe41616f0 2024-04-25T08:52:37.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe259c640 1 --2- 172.21.15.172:0/3996625905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe41610f0 0x7f3fe406c1c0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40097a0 tx=0x7f3fd402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354f882d9bad5fa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe1d9b640 1 -- 172.21.15.172:0/3996625905 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4037070 con 0x7f3fe41610f0 2024-04-25T08:52:37.059 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe1d9b640 1 -- 172.21.15.172:0/3996625905 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd4032440 con 0x7f3fe41610f0 2024-04-25T08:52:37.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe1d9b640 1 -- 172.21.15.172:0/3996625905 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4032810 con 0x7f3fe41610f0 2024-04-25T08:52:37.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe8d14640 1 -- 172.21.15.172:0/3996625905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe41610f0 msgr2=0x7f3fe406c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe8d14640 1 --2- 172.21.15.172:0/3996625905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe41610f0 0x7f3fe406c1c0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40097a0 tx=0x7f3fd402a180 comp rx=0 tx=0).stop 2024-04-25T08:52:37.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe8d14640 1 -- 172.21.15.172:0/3996625905 shutdown_connections 2024-04-25T08:52:37.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe8d14640 1 --2- 172.21.15.172:0/3996625905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe40ce7b0 0x7f3fe4161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe8d14640 1 --2- 172.21.15.172:0/3996625905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe41610f0 0x7f3fe406c1c0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe8d14640 1 -- 172.21.15.172:0/3996625905 >> 172.21.15.172:0/3996625905 conn(0x7f3fe406f500 msgr2=0x7f3fe406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:37.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe8d14640 1 -- 172.21.15.172:0/3996625905 shutdown_connections 2024-04-25T08:52:37.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.067+0000 7f3fe8d14640 1 -- 172.21.15.172:0/3996625905 wait complete. 2024-04-25T08:52:37.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.069+0000 7f3fe8d14640 1 Processor -- start 2024-04-25T08:52:37.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.069+0000 7f3fe8d14640 1 -- start start 2024-04-25T08:52:37.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.069+0000 7f3fe8d14640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe40ce7b0 0x7f3fe414b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.069+0000 7f3fe8d14640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe41610f0 0x7f3fe40ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.069+0000 7f3fe8d14640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe41616f0 0x7f3fe41f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.069+0000 7f3fe8d14640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40cf690 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.069+0000 7f3fe8d14640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40cfce0 con 0x7f3fe41610f0 2024-04-25T08:52:37.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.069+0000 7f3fe8d14640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe406c700 con 0x7f3fe41616f0 2024-04-25T08:52:37.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe40ce7b0 0x7f3fe414b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe259c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe40ce7b0 0x7f3fe414b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53056/0 (socket says 172.21.15.172:53056) 2024-04-25T08:52:37.068 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe259c640 1 -- 172.21.15.172:0/1279253185 learned_addr learned my addr 172.21.15.172:0/1279253185 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:37.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fdbfff640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe41610f0 0x7f3fe40ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe2d9d640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe41616f0 0x7f3fe41f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe259c640 1 -- 172.21.15.172:0/1279253185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe41616f0 msgr2=0x7f3fe41f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe259c640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe41616f0 0x7f3fe41f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe259c640 1 -- 172.21.15.172:0/1279253185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe41610f0 msgr2=0x7f3fe40ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe259c640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe41610f0 0x7f3fe40ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe259c640 1 -- 172.21.15.172:0/1279253185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe415d230 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe259c640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe40ce7b0 0x7f3fe414b1b0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40098c0 tx=0x7f3fd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fdaffd640 1 -- 172.21.15.172:0/1279253185 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4037040 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fdaffd640 1 -- 172.21.15.172:0/1279253185 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd4042070 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe415d4e0 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fdaffd640 1 -- 172.21.15.172:0/1279253185 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4030940 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.070+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe415dd80 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.071+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fe4073a00 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.072+0000 7f3fdaffd640 1 -- 172.21.15.172:0/1279253185 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3fd4030ae0 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.072+0000 7f3fdaffd640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 0x7f3fc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.072+0000 7f3fdaffd640 1 -- 172.21.15.172:0/1279253185 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f3fd40aa850 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.072+0000 7f3fdbfff640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 0x7f3fc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.072+0000 7f3fdaffd640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] conn(0x7f3fc4071970 0x7f3fc4073db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.072+0000 7f3fdaffd640 1 -- 172.21.15.172:0/1279253185 --> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fc4074480 con 0x7f3fc4071970 2024-04-25T08:52:37.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.072+0000 7f3fdaffd640 1 -- 172.21.15.172:0/1279253185 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fd40af2c0 con 0x7f3fe40ce7b0 2024-04-25T08:52:37.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.072+0000 7f3fe2d9d640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] conn(0x7f3fc4071970 0x7f3fc4073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.072+0000 7f3fdbfff640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 0x7f3fc406d990 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4156540 tx=0x7f3fcc007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.073+0000 7f3fe2d9d640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] conn(0x7f3fc4071970 0x7f3fc4073db0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.073+0000 7f3fdaffd640 1 -- 172.21.15.172:0/1279253185 <== osd.2 v2:172.21.15.172:6813/2429635913 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3fc4074480 con 0x7f3fc4071970 2024-04-25T08:52:37.076 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.086+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 --> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3fe40d0a80 con 0x7f3fc4071970 2024-04-25T08:52:37.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.086+0000 7f3fdaffd640 1 -- 172.21.15.172:0/1279253185 <== osd.2 v2:172.21.15.172:6813/2429635913 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3fe40d0a80 con 0x7f3fc4071970 2024-04-25T08:52:37.077 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:52:37.078 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T08:52:37.078 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:52:37.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.086+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] conn(0x7f3fc4071970 msgr2=0x7f3fc4073db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.086+0000 7f3fe8d14640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:6813/2429635913,v1:172.21.15.172:6815/2429635913] conn(0x7f3fc4071970 0x7f3fc4073db0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.080 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.087+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 msgr2=0x7f3fc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.087+0000 7f3fe8d14640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f3fc406b4d0 0x7f3fc406d990 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4156540 tx=0x7f3fcc007de0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.087+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe40ce7b0 msgr2=0x7f3fe414b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.087+0000 7f3fe8d14640 1 --2- 172.21.15.172:0/1279253185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3fe40ce7b0 0x7f3fe414b1b0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40098c0 tx=0x7f3fd40046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.081 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.087+0000 7f3fe2d9d640 1 -- 172.21.15.172:0/1279253185 reap_dead start 2024-04-25T08:52:37.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.087+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 shutdown_connections 2024-04-25T08:52:37.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.087+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 >> 172.21.15.172:0/1279253185 conn(0x7f3fe406f500 msgr2=0x7f3fe41603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:37.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.087+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 shutdown_connections 2024-04-25T08:52:37.082 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.087+0000 7f3fe8d14640 1 -- 172.21.15.172:0/1279253185 wait complete. 2024-04-25T08:52:37.088 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T08:52:37.187 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.197+0000 7fc875d89640 1 Processor -- start 2024-04-25T08:52:37.188 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.197+0000 7fc875d89640 1 -- start start 2024-04-25T08:52:37.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc875d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8700cadb0 0x7fc8700cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc875d89640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc8700ccfe0 0x7fc8700cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc875d89640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8700afc80 con 0x7fc87015de80 2024-04-25T08:52:37.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc875d89640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8700cb210 con 0x7fc8700ccfe0 2024-04-25T08:52:37.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc875d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700ce4d0 con 0x7fc8700cadb0 2024-04-25T08:52:37.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc86effd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8700cadb0 0x7fc8700cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.189 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc86ffff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc8700ccfe0 0x7fc8700cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc86f7fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fc87015de80 0x7fc8700cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.172:53844/0 (socket says 172.21.15.172:53844) 2024-04-25T08:52:37.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc86f7fe640 1 -- 172.21.15.172:0/3563694967 learned_addr learned my addr 172.21.15.172:0/3563694967 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:37.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc86effd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8700cadb0 0x7fc8700cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.172:37664/0 (socket says 172.21.15.172:37664) 2024-04-25T08:52:37.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc86effd640 1 -- 172.21.15.172:0/3563694967 >> v2:172.21.15.186:3300/0 conn(0x7fc8700ccfe0 msgr2=0x7fc8700cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:37.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc86effd640 1 --2- 172.21.15.172:0/3563694967 >> v2:172.21.15.186:3300/0 conn(0x7fc8700ccfe0 0x7fc8700cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc86effd640 1 -- 172.21.15.172:0/3563694967 >> v1:172.21.15.186:6789/0 conn(0x7fc87015de80 legacy=0x7fc8700cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.198+0000 7fc86effd640 1 -- 172.21.15.172:0/3563694967 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8700ce7b0 con 0x7fc8700cadb0 2024-04-25T08:52:37.190 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.199+0000 7fc86ffff640 1 --2- 172.21.15.172:0/3563694967 >> v2:172.21.15.186:3300/0 conn(0x7fc8700ccfe0 0x7fc8700cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T08:52:37.193 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.199+0000 7fc86effd640 1 --2- 172.21.15.172:0/3563694967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8700cadb0 0x7fc8700cf6c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc8580097a0 tx=0x7fc85802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4abaf14ec3863f71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.199+0000 7fc86e7fc640 1 -- 172.21.15.172:0/3563694967 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858037070 con 0x7fc8700cadb0 2024-04-25T08:52:37.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.199+0000 7fc86e7fc640 1 -- 172.21.15.172:0/3563694967 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc858032440 con 0x7fc8700cadb0 2024-04-25T08:52:37.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.199+0000 7fc86e7fc640 1 -- 172.21.15.172:0/3563694967 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858032810 con 0x7fc8700cadb0 2024-04-25T08:52:37.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.200+0000 7fc875d89640 1 -- 172.21.15.172:0/3563694967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8700cadb0 msgr2=0x7fc8700cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.200+0000 7fc875d89640 1 --2- 172.21.15.172:0/3563694967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8700cadb0 0x7fc8700cf6c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc8580097a0 tx=0x7fc85802a180 comp rx=0 tx=0).stop 2024-04-25T08:52:37.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.200+0000 7fc875d89640 1 -- 172.21.15.172:0/3563694967 shutdown_connections 2024-04-25T08:52:37.194 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.200+0000 7fc875d89640 1 --2- 172.21.15.172:0/3563694967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc8700cadb0 0x7fc8700cf6c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.200+0000 7fc875d89640 1 --2- 172.21.15.172:0/3563694967 >> v2:172.21.15.186:3300/0 conn(0x7fc8700ccfe0 0x7fc8700cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.200+0000 7fc875d89640 1 -- 172.21.15.172:0/3563694967 >> 172.21.15.172:0/3563694967 conn(0x7fc8700b2390 msgr2=0x7fc8700b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:37.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.200+0000 7fc875d89640 1 -- 172.21.15.172:0/3563694967 shutdown_connections 2024-04-25T08:52:37.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.200+0000 7fc875d89640 1 -- 172.21.15.172:0/3563694967 wait complete. 2024-04-25T08:52:37.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.201+0000 7fc875d89640 1 Processor -- start 2024-04-25T08:52:37.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.201+0000 7fc875d89640 1 -- start start 2024-04-25T08:52:37.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc875d89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8700cadb0 0x7fc8700c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc875d89640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8700ccfe0 0x7fc8700b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.195 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc875d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc87015de80 0x7fc870151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc875d89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87015e260 con 0x7fc8700cadb0 2024-04-25T08:52:37.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc875d89640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700cfc00 con 0x7fc8700ccfe0 2024-04-25T08:52:37.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc875d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700b2eb0 con 0x7fc87015de80 2024-04-25T08:52:37.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc86f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8700cadb0 0x7fc8700c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc86f7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8700cadb0 0x7fc8700c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53068/0 (socket says 172.21.15.172:53068) 2024-04-25T08:52:37.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc86f7fe640 1 -- 172.21.15.172:0/1503261591 learned_addr learned my addr 172.21.15.172:0/1503261591 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:37.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc86ffff640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc87015de80 0x7fc870151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.196 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc86effd640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8700ccfe0 0x7fc8700b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc86f7fe640 1 -- 172.21.15.172:0/1503261591 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc87015de80 msgr2=0x7fc870151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc86f7fe640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc87015de80 0x7fc870151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc86f7fe640 1 -- 172.21.15.172:0/1503261591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8700ccfe0 msgr2=0x7fc8700b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.202+0000 7fc86f7fe640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8700ccfe0 0x7fc8700b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.203+0000 7fc86f7fe640 1 -- 172.21.15.172:0/1503261591 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8700c87e0 con 0x7fc8700cadb0 2024-04-25T08:52:37.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.203+0000 7fc86effd640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8700ccfe0 0x7fc8700b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:37.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.203+0000 7fc86f7fe640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8700cadb0 0x7fc8700c9990 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7fc86800ca70 tx=0x7fc86800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.203+0000 7fc867fff640 1 -- 172.21.15.172:0/1503261591 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868017070 con 0x7fc8700cadb0 2024-04-25T08:52:37.197 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.203+0000 7fc867fff640 1 -- 172.21.15.172:0/1503261591 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86800abd0 con 0x7fc8700cadb0 2024-04-25T08:52:37.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.203+0000 7fc875d89640 1 -- 172.21.15.172:0/1503261591 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8700c8d70 con 0x7fc8700cadb0 2024-04-25T08:52:37.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.203+0000 7fc867fff640 1 -- 172.21.15.172:0/1503261591 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868012400 con 0x7fc8700cadb0 2024-04-25T08:52:37.198 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.203+0000 7fc875d89640 1 -- 172.21.15.172:0/1503261591 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8700c9330 con 0x7fc8700cadb0 2024-04-25T08:52:37.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.204+0000 7fc875d89640 1 -- 172.21.15.172:0/1503261591 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc870073a00 con 0x7fc8700cadb0 2024-04-25T08:52:37.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.205+0000 7fc867fff640 1 -- 172.21.15.172:0/1503261591 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc86801a070 con 0x7fc8700cadb0 2024-04-25T08:52:37.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.205+0000 7fc867fff640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 0x7fc85006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.205+0000 7fc867fff640 1 -- 172.21.15.172:0/1503261591 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc868089db0 con 0x7fc8700cadb0 2024-04-25T08:52:37.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.205+0000 7fc86effd640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 0x7fc85006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.199 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.205+0000 7fc86effd640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 0x7fc85006d990 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc858034000 tx=0x7fc85802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.200 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.209+0000 7fc867fff640 1 -- 172.21.15.172:0/1503261591 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc868058da0 con 0x7fc8700cadb0 2024-04-25T08:52:37.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.382+0000 7fc875d89640 1 -- 172.21.15.172:0/1503261591 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc87006d330 con 0x7fc85006b4d0 2024-04-25T08:52:37.373 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.383+0000 7fc867fff640 1 -- 172.21.15.172:0/1503261591 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc87006d330 con 0x7fc85006b4d0 2024-04-25T08:52:37.373 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T08:52:37.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.384+0000 7fc875d89640 1 -- 172.21.15.172:0/1503261591 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 msgr2=0x7fc85006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.384+0000 7fc875d89640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 0x7fc85006d990 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc858034000 tx=0x7fc85802e000 comp rx=0 tx=0).stop 2024-04-25T08:52:37.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.384+0000 7fc875d89640 1 -- 172.21.15.172:0/1503261591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8700cadb0 msgr2=0x7fc8700c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.384+0000 7fc875d89640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8700cadb0 0x7fc8700c9990 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7fc86800ca70 tx=0x7fc86800cf30 comp rx=0 tx=0).stop 2024-04-25T08:52:37.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.384+0000 7fc875d89640 1 -- 172.21.15.172:0/1503261591 shutdown_connections 2024-04-25T08:52:37.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.384+0000 7fc875d89640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc85006b4d0 0x7fc85006d990 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.384+0000 7fc875d89640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc8700ccfe0 0x7fc8700b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.384+0000 7fc875d89640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc87015de80 0x7fc870151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.384+0000 7fc875d89640 1 --2- 172.21.15.172:0/1503261591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8700cadb0 0x7fc8700c9990 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.384+0000 7fc875d89640 1 -- 172.21.15.172:0/1503261591 >> 172.21.15.172:0/1503261591 conn(0x7fc8700b2390 msgr2=0x7fc8700b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:37.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.385+0000 7fc875d89640 1 -- 172.21.15.172:0/1503261591 shutdown_connections 2024-04-25T08:52:37.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.385+0000 7fc875d89640 1 -- 172.21.15.172:0/1503261591 wait complete. 2024-04-25T08:52:37.386 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T08:52:37.386 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T08:52:37.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.497+0000 7f1efd10a640 1 Processor -- start 2024-04-25T08:52:37.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.497+0000 7f1efd10a640 1 -- start start 2024-04-25T08:52:37.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1efd10a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ef806ccd0 0x7f1ef80b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1efd10a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1ef815deb0 0x7f1ef815e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1efd10a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef80d1770 con 0x7f1ef8070dc0 2024-04-25T08:52:37.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1efd10a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef81622b0 con 0x7f1ef815deb0 2024-04-25T08:52:37.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1efd10a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80b10f0 con 0x7f1ef806ccd0 2024-04-25T08:52:37.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1ef759e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1ef815deb0 0x7f1ef815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1ef6d9d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1ef8070dc0 0x7f1ef80711a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41042/0 (socket says 172.21.15.172:41042) 2024-04-25T08:52:37.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1ef759e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1ef815deb0 0x7f1ef815e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60614/0 (socket says 172.21.15.172:60614) 2024-04-25T08:52:37.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1ef6d9d640 1 -- 172.21.15.172:0/1568353441 learned_addr learned my addr 172.21.15.172:0/1568353441 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:37.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1eeffff640 1 --2- 172.21.15.172:0/1568353441 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ef806ccd0 0x7f1ef80b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1ef759e640 1 -- 172.21.15.172:0/1568353441 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ef806ccd0 msgr2=0x7f1ef80b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:37.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1ef759e640 1 --2- 172.21.15.172:0/1568353441 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ef806ccd0 0x7f1ef80b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1ef759e640 1 -- 172.21.15.172:0/1568353441 >> v1:172.21.15.172:6789/0 conn(0x7f1ef8070dc0 legacy=0x7f1ef80711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.491 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1ef759e640 1 -- 172.21.15.172:0/1568353441 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef8162740 con 0x7f1ef815deb0 2024-04-25T08:52:37.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.498+0000 7f1ef659c640 1 -- 172.21.15.172:0/1568353441 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152975840 0 0) 0x7f1ef80d1770 con 0x7f1ef8070dc0 2024-04-25T08:52:37.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.499+0000 7f1ef759e640 1 --2- 172.21.15.172:0/1568353441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ef815deb0 0x7f1ef815e340 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009d90 tx=0x7f1ef002a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e2dad449901228 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.499+0000 7f1ef659c640 1 -- 172.21.15.172:0/1568353441 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0007740 con 0x7f1ef815deb0 2024-04-25T08:52:37.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.499+0000 7f1ef659c640 1 -- 172.21.15.172:0/1568353441 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef00078e0 con 0x7f1ef815deb0 2024-04-25T08:52:37.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.499+0000 7f1ef659c640 1 -- 172.21.15.172:0/1568353441 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0007cb0 con 0x7f1ef815deb0 2024-04-25T08:52:37.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.499+0000 7f1efd10a640 1 -- 172.21.15.172:0/1568353441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ef815deb0 msgr2=0x7f1ef815e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.499+0000 7f1efd10a640 1 --2- 172.21.15.172:0/1568353441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ef815deb0 0x7f1ef815e340 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009d90 tx=0x7f1ef002a530 comp rx=0 tx=0).stop 2024-04-25T08:52:37.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.500+0000 7f1efd10a640 1 -- 172.21.15.172:0/1568353441 shutdown_connections 2024-04-25T08:52:37.492 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.500+0000 7f1efd10a640 1 --2- 172.21.15.172:0/1568353441 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ef806ccd0 0x7f1ef80b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.500+0000 7f1efd10a640 1 --2- 172.21.15.172:0/1568353441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ef815deb0 0x7f1ef815e340 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.500+0000 7f1efd10a640 1 -- 172.21.15.172:0/1568353441 >> 172.21.15.172:0/1568353441 conn(0x7f1ef80b3530 msgr2=0x7f1ef80b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:37.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.500+0000 7f1efd10a640 1 -- 172.21.15.172:0/1568353441 shutdown_connections 2024-04-25T08:52:37.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.500+0000 7f1efd10a640 1 -- 172.21.15.172:0/1568353441 wait complete. 2024-04-25T08:52:37.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.501+0000 7f1efd10a640 1 Processor -- start 2024-04-25T08:52:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.501+0000 7f1efd10a640 1 -- start start 2024-04-25T08:52:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1efd10a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ef806ccd0 0x7f1ef80cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1efd10a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ef8070dc0 0x7f1ef8151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1efd10a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ef815deb0 0x7f1ef815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1efd10a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8161f40 con 0x7f1ef806ccd0 2024-04-25T08:52:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1efd10a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8161c60 con 0x7f1ef8070dc0 2024-04-25T08:52:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1efd10a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef80b5840 con 0x7f1ef815deb0 2024-04-25T08:52:37.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1ef6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ef806ccd0 0x7f1ef80cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1ef6d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ef806ccd0 0x7f1ef80cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60628/0 (socket says 172.21.15.172:60628) 2024-04-25T08:52:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1ef6d9d640 1 -- 172.21.15.172:0/1173472725 learned_addr learned my addr 172.21.15.172:0/1173472725 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1ef759e640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ef815deb0 0x7f1ef815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1ef6d9d640 1 -- 172.21.15.172:0/1173472725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ef815deb0 msgr2=0x7f1ef815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1ef6d9d640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1ef815deb0 0x7f1ef815ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1ef6d9d640 1 -- 172.21.15.172:0/1173472725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ef8070dc0 msgr2=0x7f1ef8151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1ef6d9d640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1ef8070dc0 0x7f1ef8151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1ef6d9d640 1 -- 172.21.15.172:0/1173472725 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef815f920 con 0x7f1ef806ccd0 2024-04-25T08:52:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1ef6d9d640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ef806ccd0 0x7f1ef80cbda0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c4d0 tx=0x7f1ee800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1eef7fe640 1 -- 172.21.15.172:0/1173472725 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8018070 con 0x7f1ef806ccd0 2024-04-25T08:52:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1eef7fe640 1 -- 172.21.15.172:0/1173472725 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee80074e0 con 0x7f1ef806ccd0 2024-04-25T08:52:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef815f640 con 0x7f1ef806ccd0 2024-04-25T08:52:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1eef7fe640 1 -- 172.21.15.172:0/1173472725 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8004a20 con 0x7f1ef806ccd0 2024-04-25T08:52:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.502+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef8156490 con 0x7f1ef806ccd0 2024-04-25T08:52:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.503+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1ef80cc2e0 con 0x7f1ef806ccd0 2024-04-25T08:52:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.504+0000 7f1eef7fe640 1 -- 172.21.15.172:0/1173472725 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1ee801b070 con 0x7f1ef806ccd0 2024-04-25T08:52:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.504+0000 7f1eef7fe640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 0x7f1ed806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.504+0000 7f1eef7fe640 1 -- 172.21.15.172:0/1173472725 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f1ee8089340 con 0x7f1ef806ccd0 2024-04-25T08:52:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.504+0000 7f1eeffff640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 0x7f1ed806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.504+0000 7f1eef7fe640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] conn(0x7f1ed8071970 0x7f1ed8073db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.504+0000 7f1eef7fe640 1 -- 172.21.15.172:0/1173472725 --> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ee8017ec0 con 0x7f1ed8071970 2024-04-25T08:52:37.500 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.504+0000 7f1eef7fe640 1 -- 172.21.15.172:0/1173472725 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ee8090050 con 0x7f1ef806ccd0 2024-04-25T08:52:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.504+0000 7f1ef759e640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] conn(0x7f1ed8071970 0x7f1ed8073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.505+0000 7f1eeffff640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 0x7f1ed806d990 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0006fd0 tx=0x7f1ee0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.505+0000 7f1ef759e640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] conn(0x7f1ed8071970 0x7f1ed8073db0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.501 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.505+0000 7f1eef7fe640 1 -- 172.21.15.172:0/1173472725 <== osd.3 v2:172.21.15.172:6808/3046026724 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1ee8017ec0 con 0x7f1ed8071970 2024-04-25T08:52:37.508 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.518+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 --> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1ef8152280 con 0x7f1ed8071970 2024-04-25T08:52:37.509 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.518+0000 7f1eef7fe640 1 -- 172.21.15.172:0/1173472725 <== osd.3 v2:172.21.15.172:6808/3046026724 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1ef00076b0 con 0x7f1ed8071970 2024-04-25T08:52:37.509 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:52:37.509 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T08:52:37.509 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:52:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] conn(0x7f1ed8071970 msgr2=0x7f1ed8073db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1efd10a640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:6808/3046026724,v1:172.21.15.172:6809/3046026724] conn(0x7f1ed8071970 0x7f1ed8073db0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 msgr2=0x7f1ed806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1efd10a640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f1ed806b4d0 0x7f1ed806d990 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0006fd0 tx=0x7f1ee0008040 comp rx=0 tx=0).stop 2024-04-25T08:52:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ef806ccd0 msgr2=0x7f1ef80cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1efd10a640 1 --2- 172.21.15.172:0/1173472725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ef806ccd0 0x7f1ef80cbda0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c4d0 tx=0x7f1ee800c990 comp rx=0 tx=0).stop 2024-04-25T08:52:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1ef759e640 1 -- 172.21.15.172:0/1173472725 reap_dead start 2024-04-25T08:52:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 shutdown_connections 2024-04-25T08:52:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 >> 172.21.15.172:0/1173472725 conn(0x7f1ef80b3530 msgr2=0x7f1ef815ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 shutdown_connections 2024-04-25T08:52:37.511 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.519+0000 7f1efd10a640 1 -- 172.21.15.172:0/1173472725 wait complete. 2024-04-25T08:52:37.520 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T08:52:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.628+0000 7fbd51ab3640 1 Processor -- start 2024-04-25T08:52:37.619 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.628+0000 7fbd51ab3640 1 -- start start 2024-04-25T08:52:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.629+0000 7fbd51ab3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbd4c0b5620 0x7fbd4c0b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.629+0000 7fbd51ab3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c06cf50 con 0x7fbd4c15b7d0 2024-04-25T08:52:37.621 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.629+0000 7fbd51ab3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c0ce530 con 0x7fbd4c06c2d0 2024-04-25T08:52:37.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.629+0000 7fbd51ab3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0ce810 con 0x7fbd4c0b5620 2024-04-25T08:52:37.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.629+0000 7fbd4affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbd4c0b5620 0x7fbd4c0b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.629+0000 7fbd4b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbd4c15b7d0 0x7fbd4c0cf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41050/0 (socket says 172.21.15.172:41050) 2024-04-25T08:52:37.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.629+0000 7fbd4b7fe640 1 -- 172.21.15.172:0/2699287677 learned_addr learned my addr 172.21.15.172:0/2699287677 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:37.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.630+0000 7fbd4affd640 1 -- 172.21.15.172:0/2699287677 >> v1:172.21.15.186:6789/0 conn(0x7fbd4c06c2d0 legacy=0x7fbd4c06c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.630+0000 7fbd4affd640 1 -- 172.21.15.172:0/2699287677 >> v1:172.21.15.172:6789/0 conn(0x7fbd4c15b7d0 legacy=0x7fbd4c0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.630+0000 7fbd4affd640 1 -- 172.21.15.172:0/2699287677 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0ceaf0 con 0x7fbd4c0b5620 2024-04-25T08:52:37.622 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.630+0000 7fbd4a7fc640 1 -- 172.21.15.172:0/2699287677 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712104775 0 0) 0x7fbd4c06cf50 con 0x7fbd4c15b7d0 2024-04-25T08:52:37.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.630+0000 7fbd4affd640 1 --2- 172.21.15.172:0/2699287677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 0x7fbd4c0b5ab0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fbd400097a0 tx=0x7fbd4002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fb2eff97a900aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.630+0000 7fbd4a7fc640 1 -- 172.21.15.172:0/2699287677 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40037070 con 0x7fbd4c0b5620 2024-04-25T08:52:37.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.630+0000 7fbd4a7fc640 1 -- 172.21.15.172:0/2699287677 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd40032440 con 0x7fbd4c0b5620 2024-04-25T08:52:37.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.630+0000 7fbd4a7fc640 1 -- 172.21.15.172:0/2699287677 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40032810 con 0x7fbd4c0b5620 2024-04-25T08:52:37.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.631+0000 7fbd51ab3640 1 -- 172.21.15.172:0/2699287677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 msgr2=0x7fbd4c0b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.631+0000 7fbd51ab3640 1 --2- 172.21.15.172:0/2699287677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 0x7fbd4c0b5ab0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fbd400097a0 tx=0x7fbd4002a230 comp rx=0 tx=0).stop 2024-04-25T08:52:37.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.631+0000 7fbd51ab3640 1 -- 172.21.15.172:0/2699287677 shutdown_connections 2024-04-25T08:52:37.623 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.631+0000 7fbd51ab3640 1 --2- 172.21.15.172:0/2699287677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 0x7fbd4c0b5ab0 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.631+0000 7fbd51ab3640 1 -- 172.21.15.172:0/2699287677 >> 172.21.15.172:0/2699287677 conn(0x7fbd4c0d0800 msgr2=0x7fbd4c0d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:37.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.631+0000 7fbd51ab3640 1 -- 172.21.15.172:0/2699287677 shutdown_connections 2024-04-25T08:52:37.624 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.631+0000 7fbd51ab3640 1 -- 172.21.15.172:0/2699287677 wait complete. 2024-04-25T08:52:37.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.632+0000 7fbd51ab3640 1 Processor -- start 2024-04-25T08:52:37.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.632+0000 7fbd51ab3640 1 -- start start 2024-04-25T08:52:37.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd51ab3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd4c06c2d0 0x7fbd4c0c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd51ab3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 0x7fbd4c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd51ab3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd4c15b7d0 0x7fbd4c1f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd51ab3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15bd30 con 0x7fbd4c0b5620 2024-04-25T08:52:37.627 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd51ab3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15bbb0 con 0x7fbd4c15b7d0 2024-04-25T08:52:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd51ab3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0d1f40 con 0x7fbd4c06c2d0 2024-04-25T08:52:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 0x7fbd4c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4affd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 0x7fbd4c1571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60636/0 (socket says 172.21.15.172:60636) 2024-04-25T08:52:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4affd640 1 -- 172.21.15.172:0/3981964022 learned_addr learned my addr 172.21.15.172:0/3981964022 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4bfff640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd4c15b7d0 0x7fbd4c1f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4b7fe640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd4c06c2d0 0x7fbd4c0c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4affd640 1 -- 172.21.15.172:0/3981964022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd4c06c2d0 msgr2=0x7fbd4c0c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4affd640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd4c06c2d0 0x7fbd4c0c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.628 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4affd640 1 -- 172.21.15.172:0/3981964022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd4c15b7d0 msgr2=0x7fbd4c1f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4affd640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd4c15b7d0 0x7fbd4c1f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4affd640 1 -- 172.21.15.172:0/3981964022 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c1f3d70 con 0x7fbd4c0b5620 2024-04-25T08:52:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.633+0000 7fbd4b7fe640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd4c06c2d0 0x7fbd4c0c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.634+0000 7fbd4affd640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 0x7fbd4c1571a0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fbd40000c00 tx=0x7fbd400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.634+0000 7fbd33fff640 1 -- 172.21.15.172:0/3981964022 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40037040 con 0x7fbd4c0b5620 2024-04-25T08:52:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.634+0000 7fbd33fff640 1 -- 172.21.15.172:0/3981964022 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd40042070 con 0x7fbd4c0b5620 2024-04-25T08:52:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.634+0000 7fbd33fff640 1 -- 172.21.15.172:0/3981964022 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40030a70 con 0x7fbd4c0b5620 2024-04-25T08:52:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.634+0000 7fbd51ab3640 1 -- 172.21.15.172:0/3981964022 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c1f4050 con 0x7fbd4c0b5620 2024-04-25T08:52:37.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.634+0000 7fbd51ab3640 1 -- 172.21.15.172:0/3981964022 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c157a30 con 0x7fbd4c0b5620 2024-04-25T08:52:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.635+0000 7fbd51ab3640 1 -- 172.21.15.172:0/3981964022 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c0b6970 con 0x7fbd4c0b5620 2024-04-25T08:52:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.635+0000 7fbd33fff640 1 -- 172.21.15.172:0/3981964022 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd40030c10 con 0x7fbd4c0b5620 2024-04-25T08:52:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.636+0000 7fbd33fff640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd3806b4d0 0x7fbd3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.636+0000 7fbd33fff640 1 -- 172.21.15.172:0/3981964022 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fbd400aab20 con 0x7fbd4c0b5620 2024-04-25T08:52:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.636+0000 7fbd4b7fe640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd3806b4d0 0x7fbd3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.630 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.636+0000 7fbd4b7fe640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd3806b4d0 0x7fbd3806d990 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c000f60 tx=0x7fbd3c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.631 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.640+0000 7fbd33fff640 1 -- 172.21.15.172:0/3981964022 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbd4c0b6970 con 0x7fbd4c0b5620 2024-04-25T08:52:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.812+0000 7fbd51ab3640 1 -- 172.21.15.172:0/3981964022 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd4c157820 con 0x7fbd3806b4d0 2024-04-25T08:52:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.813+0000 7fbd33fff640 1 -- 172.21.15.172:0/3981964022 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd4c157820 con 0x7fbd3806b4d0 2024-04-25T08:52:37.803 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T08:52:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 -- 172.21.15.172:0/3981964022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd3806b4d0 msgr2=0x7fbd3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd3806b4d0 0x7fbd3806d990 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c000f60 tx=0x7fbd3c009040 comp rx=0 tx=0).stop 2024-04-25T08:52:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 -- 172.21.15.172:0/3981964022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 msgr2=0x7fbd4c1571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 0x7fbd4c1571a0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fbd40000c00 tx=0x7fbd400046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 -- 172.21.15.172:0/3981964022 shutdown_connections 2024-04-25T08:52:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fbd3806b4d0 0x7fbd3806d990 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd4c15b7d0 0x7fbd4c1f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd4c0b5620 0x7fbd4c1571a0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 --2- 172.21.15.172:0/3981964022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbd4c06c2d0 0x7fbd4c0c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 -- 172.21.15.172:0/3981964022 >> 172.21.15.172:0/3981964022 conn(0x7fbd4c0d0800 msgr2=0x7fbd4c160af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:37.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 -- 172.21.15.172:0/3981964022 shutdown_connections 2024-04-25T08:52:37.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.815+0000 7fbd51ab3640 1 -- 172.21.15.172:0/3981964022 wait complete. 2024-04-25T08:52:37.816 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T08:52:37.816 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T08:52:37.917 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.927+0000 7f5c14d5c640 1 Processor -- start 2024-04-25T08:52:37.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.927+0000 7f5c14d5c640 1 -- start start 2024-04-25T08:52:37.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.928+0000 7f5c14d5c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5c100b5c40 0x7f5c100ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.928+0000 7f5c14d5c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5c1015b980 0x7f5c100ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.928+0000 7f5c14d5c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c100cf320 con 0x7f5c1015b5a0 2024-04-25T08:52:37.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.928+0000 7f5c14d5c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c100ced90 con 0x7f5c100b5c40 2024-04-25T08:52:37.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.928+0000 7f5c14d5c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100cf040 con 0x7f5c1015b980 2024-04-25T08:52:37.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.928+0000 7f5c0e59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5c1015b5a0 0x7f5c100b5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41064/0 (socket says 172.21.15.172:41064) 2024-04-25T08:52:37.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.928+0000 7f5c0e59c640 1 -- 172.21.15.172:0/1773986716 learned_addr learned my addr 172.21.15.172:0/1773986716 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:37.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.928+0000 7f5c0dd9b640 1 --2- 172.21.15.172:0/1773986716 >> v2:172.21.15.172:3300/0 conn(0x7f5c100b5c40 0x7f5c100ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.928+0000 7f5c0ed9d640 1 --2- 172.21.15.172:0/1773986716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5c1015b980 0x7f5c100ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.929+0000 7f5c0dd9b640 1 -- 172.21.15.172:0/1773986716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5c1015b980 msgr2=0x7f5c100ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:37.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.929+0000 7f5c0dd9b640 1 --2- 172.21.15.172:0/1773986716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5c1015b980 0x7f5c100ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.929+0000 7f5c0dd9b640 1 -- 172.21.15.172:0/1773986716 >> v1:172.21.15.172:6789/0 conn(0x7f5c1015b5a0 legacy=0x7f5c100b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.929+0000 7f5c0dd9b640 1 -- 172.21.15.172:0/1773986716 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c10161970 con 0x7f5c100b5c40 2024-04-25T08:52:37.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.929+0000 7f5c0dd9b640 1 --2- 172.21.15.172:0/1773986716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c100b5c40 0x7f5c100ce310 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009790 tx=0x7f5c0402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b056787b38af318 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.923 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.929+0000 7f5c0d59a640 1 -- 172.21.15.172:0/1773986716 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04037070 con 0x7f5c100b5c40 2024-04-25T08:52:37.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.929+0000 7f5c0d59a640 1 -- 172.21.15.172:0/1773986716 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c04032440 con 0x7f5c100b5c40 2024-04-25T08:52:37.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.929+0000 7f5c0d59a640 1 -- 172.21.15.172:0/1773986716 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04032810 con 0x7f5c100b5c40 2024-04-25T08:52:37.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.930+0000 7f5c14d5c640 1 -- 172.21.15.172:0/1773986716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c100b5c40 msgr2=0x7f5c100ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.930+0000 7f5c14d5c640 1 --2- 172.21.15.172:0/1773986716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c100b5c40 0x7f5c100ce310 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009790 tx=0x7f5c0402a180 comp rx=0 tx=0).stop 2024-04-25T08:52:37.924 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.930+0000 7f5c14d5c640 1 -- 172.21.15.172:0/1773986716 shutdown_connections 2024-04-25T08:52:37.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.930+0000 7f5c14d5c640 1 --2- 172.21.15.172:0/1773986716 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5c1015b980 0x7f5c100ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.930+0000 7f5c14d5c640 1 --2- 172.21.15.172:0/1773986716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c100b5c40 0x7f5c100ce310 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.930+0000 7f5c14d5c640 1 -- 172.21.15.172:0/1773986716 >> 172.21.15.172:0/1773986716 conn(0x7f5c100d0530 msgr2=0x7f5c100d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:37.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.930+0000 7f5c14d5c640 1 -- 172.21.15.172:0/1773986716 shutdown_connections 2024-04-25T08:52:37.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.930+0000 7f5c14d5c640 1 -- 172.21.15.172:0/1773986716 wait complete. 2024-04-25T08:52:37.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.931+0000 7f5c14d5c640 1 Processor -- start 2024-04-25T08:52:37.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.931+0000 7f5c14d5c640 1 -- start start 2024-04-25T08:52:37.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c14d5c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5c100b5c40 0x7f5c1015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c14d5c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c1015b5a0 0x7f5c1014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c14d5c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c1015b980 0x7f5c101548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c14d5c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10162450 con 0x7f5c1015b980 2024-04-25T08:52:37.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c14d5c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10161f30 con 0x7f5c1015b5a0 2024-04-25T08:52:37.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c14d5c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c101625d0 con 0x7f5c100b5c40 2024-04-25T08:52:37.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c1015b980 0x7f5c101548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0ed9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c1015b980 0x7f5c101548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60654/0 (socket says 172.21.15.172:60654) 2024-04-25T08:52:37.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0ed9d640 1 -- 172.21.15.172:0/3343279179 learned_addr learned my addr 172.21.15.172:0/3343279179 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:37.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0e59c640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5c100b5c40 0x7f5c1015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0dd9b640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c1015b5a0 0x7f5c1014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0ed9d640 1 -- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5c100b5c40 msgr2=0x7f5c1015a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0ed9d640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5c100b5c40 0x7f5c1015a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0ed9d640 1 -- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c1015b5a0 msgr2=0x7f5c1014b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0ed9d640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5c1015b5a0 0x7f5c1014b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0ed9d640 1 -- 172.21.15.172:0/3343279179 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100c75e0 con 0x7f5c1015b980 2024-04-25T08:52:37.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.932+0000 7f5c0e59c640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5c100b5c40 0x7f5c1015a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:37.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.933+0000 7f5c0ed9d640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c1015b980 0x7f5c101548b0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800d5d0 tx=0x7f5c0800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.933+0000 7f5bfeffd640 1 -- 172.21.15.172:0/3343279179 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080125f0 con 0x7f5c1015b980 2024-04-25T08:52:37.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.933+0000 7f5bfeffd640 1 -- 172.21.15.172:0/3343279179 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c08019070 con 0x7f5c1015b980 2024-04-25T08:52:37.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.933+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c100c78c0 con 0x7f5c1015b980 2024-04-25T08:52:37.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.933+0000 7f5bfeffd640 1 -- 172.21.15.172:0/3343279179 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080129f0 con 0x7f5c1015b980 2024-04-25T08:52:37.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.933+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c100c7e80 con 0x7f5c1015b980 2024-04-25T08:52:37.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.934+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5c100c8260 con 0x7f5c1015b980 2024-04-25T08:52:37.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.934+0000 7f5bfeffd640 1 -- 172.21.15.172:0/3343279179 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5c08012b90 con 0x7f5c1015b980 2024-04-25T08:52:37.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.935+0000 7f5bfeffd640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5bf006b4d0 0x7f5bf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.935+0000 7f5bfeffd640 1 -- 172.21.15.172:0/3343279179 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f5c0808a360 con 0x7f5c1015b980 2024-04-25T08:52:37.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.935+0000 7f5c0e59c640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5bf006b4d0 0x7f5bf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.935+0000 7f5bfeffd640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x7f5bf0071970 0x7f5bf0073db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:37.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.935+0000 7f5bfeffd640 1 -- 172.21.15.172:0/3343279179 --> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c08022ec0 con 0x7f5bf0071970 2024-04-25T08:52:37.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.935+0000 7f5bfeffd640 1 -- 172.21.15.172:0/3343279179 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c08091050 con 0x7f5c1015b980 2024-04-25T08:52:37.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.935+0000 7f5c0e59c640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5bf006b4d0 0x7f5bf006d990 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5c000012e0 tx=0x7f5c00009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.935+0000 7f5c0dd9b640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x7f5bf0071970 0x7f5bf0073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:37.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.936+0000 7f5c0dd9b640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x7f5bf0071970 0x7f5bf0073db0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:37.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.936+0000 7f5bfeffd640 1 -- 172.21.15.172:0/3343279179 <== osd.4 v2:172.21.15.186:6808/1547498830 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5c08022ec0 con 0x7f5bf0071970 2024-04-25T08:52:37.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.949+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 --> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5c100b9a10 con 0x7f5bf0071970 2024-04-25T08:52:37.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5bfeffd640 1 -- 172.21.15.172:0/3343279179 <== osd.4 v2:172.21.15.186:6808/1547498830 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5c100b9a10 con 0x7f5bf0071970 2024-04-25T08:52:37.940 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:52:37.940 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T08:52:37.941 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:52:37.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x7f5bf0071970 msgr2=0x7f5bf0073db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5c14d5c640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.186:6808/1547498830,v1:172.21.15.186:6809/1547498830] conn(0x7f5bf0071970 0x7f5bf0073db0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:37.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5bf006b4d0 msgr2=0x7f5bf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5c14d5c640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f5bf006b4d0 0x7f5bf006d990 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5c000012e0 tx=0x7f5c00009040 comp rx=0 tx=0).stop 2024-04-25T08:52:37.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c1015b980 msgr2=0x7f5c101548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:37.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5c14d5c640 1 --2- 172.21.15.172:0/3343279179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c1015b980 0x7f5c101548b0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800d5d0 tx=0x7f5c0800da90 comp rx=0 tx=0).stop 2024-04-25T08:52:37.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5c0ed9d640 1 -- 172.21.15.172:0/3343279179 reap_dead start 2024-04-25T08:52:37.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 shutdown_connections 2024-04-25T08:52:37.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 >> 172.21.15.172:0/3343279179 conn(0x7f5c100d0530 msgr2=0x7f5c100d2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:37.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.950+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 shutdown_connections 2024-04-25T08:52:37.943 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:37.951+0000 7f5c14d5c640 1 -- 172.21.15.172:0/3343279179 wait complete. 2024-04-25T08:52:37.955 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T08:52:38.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.064+0000 7f716cbed640 1 Processor -- start 2024-04-25T08:52:38.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.064+0000 7f716cbed640 1 -- start start 2024-04-25T08:52:38.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716cbed640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f716806abe0 0x7f716806afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716cbed640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f716815dd80 0x7f71680b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716cbed640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71680ad570 0x7f716806ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716cbed640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716806e410 con 0x7f716806abe0 2024-04-25T08:52:38.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716cbed640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716806b500 con 0x7f716815dd80 2024-04-25T08:52:38.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716cbed640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71680b3930 con 0x7f71680ad570 2024-04-25T08:52:38.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f716806abe0 0x7f716806afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f716806abe0 0x7f716806afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60664/0 (socket says 172.21.15.172:60664) 2024-04-25T08:52:38.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716659c640 1 -- 172.21.15.172:0/2814287967 learned_addr learned my addr 172.21.15.172:0/2814287967 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:38.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f7165d9b640 1 --2- 172.21.15.172:0/2814287967 >> v2:172.21.15.186:3300/0 conn(0x7f716815dd80 0x7f71680b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f7166d9d640 1 --2- 172.21.15.172:0/2814287967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71680ad570 0x7f716806ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716659c640 1 -- 172.21.15.172:0/2814287967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71680ad570 msgr2=0x7f716806ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:38.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716659c640 1 --2- 172.21.15.172:0/2814287967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71680ad570 0x7f716806ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716659c640 1 -- 172.21.15.172:0/2814287967 >> v2:172.21.15.186:3300/0 conn(0x7f716815dd80 msgr2=0x7f71680b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:38.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716659c640 1 --2- 172.21.15.172:0/2814287967 >> v2:172.21.15.186:3300/0 conn(0x7f716815dd80 0x7f71680b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.057 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.065+0000 7f716659c640 1 -- 172.21.15.172:0/2814287967 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680b3c10 con 0x7f716806abe0 2024-04-25T08:52:38.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.066+0000 7f716659c640 1 --2- 172.21.15.172:0/2814287967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716806abe0 0x7f716806afc0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f7168071360 tx=0x7f715802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc82b1405e7e0cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.060 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.066+0000 7f716559a640 1 -- 172.21.15.172:0/2814287967 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158037070 con 0x7f716806abe0 2024-04-25T08:52:38.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.066+0000 7f716559a640 1 -- 172.21.15.172:0/2814287967 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7158032440 con 0x7f716806abe0 2024-04-25T08:52:38.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.066+0000 7f716559a640 1 -- 172.21.15.172:0/2814287967 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158032810 con 0x7f716806abe0 2024-04-25T08:52:38.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.067+0000 7f716cbed640 1 -- 172.21.15.172:0/2814287967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716806abe0 msgr2=0x7f716806afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.067+0000 7f716cbed640 1 --2- 172.21.15.172:0/2814287967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716806abe0 0x7f716806afc0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f7168071360 tx=0x7f715802a1e0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.067+0000 7f716cbed640 1 -- 172.21.15.172:0/2814287967 shutdown_connections 2024-04-25T08:52:38.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.067+0000 7f716cbed640 1 --2- 172.21.15.172:0/2814287967 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71680ad570 0x7f716806ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.067+0000 7f716cbed640 1 --2- 172.21.15.172:0/2814287967 >> v2:172.21.15.186:3300/0 conn(0x7f716815dd80 0x7f71680b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.061 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.067+0000 7f716cbed640 1 --2- 172.21.15.172:0/2814287967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716806abe0 0x7f716806afc0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.067+0000 7f716cbed640 1 -- 172.21.15.172:0/2814287967 >> 172.21.15.172:0/2814287967 conn(0x7f71680b5af0 msgr2=0x7f71680b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:38.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.067+0000 7f716cbed640 1 -- 172.21.15.172:0/2814287967 shutdown_connections 2024-04-25T08:52:38.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.067+0000 7f716cbed640 1 -- 172.21.15.172:0/2814287967 wait complete. 2024-04-25T08:52:38.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.068+0000 7f716cbed640 1 Processor -- start 2024-04-25T08:52:38.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.068+0000 7f716cbed640 1 -- start start 2024-04-25T08:52:38.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f716cbed640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f716806abe0 0x7f7168150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f716cbed640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71680ad570 0x7f7168156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f716cbed640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716815dd80 0x7f7168156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.062 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f716cbed640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680b57d0 con 0x7f716815dd80 2024-04-25T08:52:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f716cbed640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716806e940 con 0x7f71680ad570 2024-04-25T08:52:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f716cbed640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7168070280 con 0x7f716806abe0 2024-04-25T08:52:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7166d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716815dd80 0x7f7168156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7166d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716815dd80 0x7f7168156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60674/0 (socket says 172.21.15.172:60674) 2024-04-25T08:52:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7166d9d640 1 -- 172.21.15.172:0/3791173623 learned_addr learned my addr 172.21.15.172:0/3791173623 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f716659c640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f716806abe0 0x7f7168150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7165d9b640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71680ad570 0x7f7168156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7166d9d640 1 -- 172.21.15.172:0/3791173623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f716806abe0 msgr2=0x7f7168150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.063 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7166d9d640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f716806abe0 0x7f7168150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7166d9d640 1 -- 172.21.15.172:0/3791173623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71680ad570 msgr2=0x7f7168156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7166d9d640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71680ad570 0x7f7168156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7166d9d640 1 -- 172.21.15.172:0/3791173623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71681f77d0 con 0x7f716815dd80 2024-04-25T08:52:38.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7166d9d640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716815dd80 0x7f7168156840 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f7160007e60 tx=0x7f716000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7156ffd640 1 -- 172.21.15.172:0/3791173623 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160014620 con 0x7f716815dd80 2024-04-25T08:52:38.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7156ffd640 1 -- 172.21.15.172:0/3791173623 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7160019070 con 0x7f716815dd80 2024-04-25T08:52:38.064 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f716cbed640 1 -- 172.21.15.172:0/3791173623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716815acf0 con 0x7f716815dd80 2024-04-25T08:52:38.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.069+0000 7f7156ffd640 1 -- 172.21.15.172:0/3791173623 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160014a20 con 0x7f716815dd80 2024-04-25T08:52:38.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.070+0000 7f716cbed640 1 -- 172.21.15.172:0/3791173623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7168159f30 con 0x7f716815dd80 2024-04-25T08:52:38.065 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.070+0000 7f716cbed640 1 -- 172.21.15.172:0/3791173623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7168073a00 con 0x7f716815dd80 2024-04-25T08:52:38.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.071+0000 7f7156ffd640 1 -- 172.21.15.172:0/3791173623 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7160014bc0 con 0x7f716815dd80 2024-04-25T08:52:38.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.071+0000 7f7156ffd640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f714806b4d0 0x7f714806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.071+0000 7f7156ffd640 1 -- 172.21.15.172:0/3791173623 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f716008a8c0 con 0x7f716815dd80 2024-04-25T08:52:38.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.071+0000 7f716659c640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f714806b4d0 0x7f714806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.072+0000 7f716659c640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f714806b4d0 0x7f714806d990 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7158034000 tx=0x7f715802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.075+0000 7f7156ffd640 1 -- 172.21.15.172:0/3791173623 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7160059940 con 0x7f716815dd80 2024-04-25T08:52:38.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.246+0000 7f716cbed640 1 -- 172.21.15.172:0/3791173623 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f716806d370 con 0x7f714806b4d0 2024-04-25T08:52:38.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.246+0000 7f7156ffd640 1 -- 172.21.15.172:0/3791173623 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f716806d370 con 0x7f714806b4d0 2024-04-25T08:52:38.236 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T08:52:38.238 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 -- 172.21.15.172:0/3791173623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f714806b4d0 msgr2=0x7f714806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f714806b4d0 0x7f714806d990 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7158034000 tx=0x7f715802e000 comp rx=0 tx=0).stop 2024-04-25T08:52:38.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 -- 172.21.15.172:0/3791173623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716815dd80 msgr2=0x7f7168156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716815dd80 0x7f7168156840 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f7160007e60 tx=0x7f716000e4b0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 -- 172.21.15.172:0/3791173623 shutdown_connections 2024-04-25T08:52:38.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f714806b4d0 0x7f714806d990 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71680ad570 0x7f7168156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f716815dd80 0x7f7168156840 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 --2- 172.21.15.172:0/3791173623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f716806abe0 0x7f7168150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.239 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 -- 172.21.15.172:0/3791173623 >> 172.21.15.172:0/3791173623 conn(0x7f71680b5af0 msgr2=0x7f716806ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:38.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 -- 172.21.15.172:0/3791173623 shutdown_connections 2024-04-25T08:52:38.240 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.248+0000 7f716cbed640 1 -- 172.21.15.172:0/3791173623 wait complete. 2024-04-25T08:52:38.249 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T08:52:38.249 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T08:52:38.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.361+0000 7f8966bf5640 1 Processor -- start 2024-04-25T08:52:38.352 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.361+0000 7f8966bf5640 1 -- start start 2024-04-25T08:52:38.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.362+0000 7f8966bf5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f89600714d0 0x7f8960166980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.362+0000 7f8966bf5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89600ceba0 con 0x7f8960144d20 2024-04-25T08:52:38.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.362+0000 7f8966bf5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89600cee80 con 0x7f89601454b0 2024-04-25T08:52:38.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.362+0000 7f8966bf5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89600b4830 con 0x7f89600714d0 2024-04-25T08:52:38.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.362+0000 7f8964991640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8960144d20 0x7f89600ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41078/0 (socket says 172.21.15.172:41078) 2024-04-25T08:52:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.362+0000 7f8964991640 1 -- 172.21.15.172:0/1084590026 learned_addr learned my addr 172.21.15.172:0/1084590026 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.362+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670451544 0 0) 0x7f89600ceba0 con 0x7f8960144d20 2024-04-25T08:52:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.362+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8948003520 con 0x7f8960144d20 2024-04-25T08:52:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.362+0000 7f8965192640 1 --2- 172.21.15.172:0/1084590026 >> v2:172.21.15.186:3300/0 conn(0x7f89600714d0 0x7f8960166980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 800062248 0 0) 0x7f8948003520 con 0x7f8960144d20 2024-04-25T08:52:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 >> v2:172.21.15.186:3300/0 conn(0x7f89600714d0 msgr2=0x7f8960166980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 --2- 172.21.15.172:0/1084590026 >> v2:172.21.15.186:3300/0 conn(0x7f89600714d0 0x7f8960166980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 >> v1:172.21.15.186:6789/0 conn(0x7f89601454b0 legacy=0x7f8960070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89600cf160 con 0x7f8960144d20 2024-04-25T08:52:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7f8950001670 con 0x7f8960144d20 2024-04-25T08:52:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 >> v1:172.21.15.172:6789/0 conn(0x7f8960144d20 legacy=0x7f89600ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89480039b0 0x7f8948003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8948004800 0x7f8948004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89480051c0 0x7f894800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89600b4830 con 0x7f8948004800 2024-04-25T08:52:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894800c090 con 0x7f89480039b0 2024-04-25T08:52:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894800c290 con 0x7f89480051c0 2024-04-25T08:52:38.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895ffff640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8948004800 0x7f8948004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f8964991640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89480039b0 0x7f8948003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f8965192640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89480051c0 0x7f894800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895ffff640 1 -- 172.21.15.172:0/1084590026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89480051c0 msgr2=0x7f894800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:38.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895ffff640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89480051c0 0x7f894800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895ffff640 1 -- 172.21.15.172:0/1084590026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89480039b0 msgr2=0x7f8948003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:38.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895ffff640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89480039b0 0x7f8948003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f895ffff640 1 -- 172.21.15.172:0/1084590026 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948003520 con 0x7f8948004800 2024-04-25T08:52:38.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.363+0000 7f8965192640 1 -- 172.21.15.172:0/1084590026 reap_dead start 2024-04-25T08:52:38.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.364+0000 7f895ffff640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8948004800 0x7f8948004c80 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f8954001750 tx=0x7f8948005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21aaeab7b1846560 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.364+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954001370 con 0x7f8948004800 2024-04-25T08:52:38.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.364+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89540052d0 con 0x7f8948004800 2024-04-25T08:52:38.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.364+0000 7f895f7fe640 1 -- 172.21.15.172:0/1084590026 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895402abe0 con 0x7f8948004800 2024-04-25T08:52:38.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.364+0000 7f8966bf5640 1 -- 172.21.15.172:0/1084590026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8948004800 msgr2=0x7f8948004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.364+0000 7f8966bf5640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8948004800 0x7f8948004c80 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f8954001750 tx=0x7f8948005830 comp rx=0 tx=0).stop 2024-04-25T08:52:38.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.365+0000 7f8966bf5640 1 -- 172.21.15.172:0/1084590026 shutdown_connections 2024-04-25T08:52:38.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.365+0000 7f8966bf5640 1 --2- 172.21.15.172:0/1084590026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8948004800 0x7f8948004c80 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.365+0000 7f8966bf5640 1 -- 172.21.15.172:0/1084590026 >> 172.21.15.172:0/1084590026 conn(0x7f89600b3530 msgr2=0x7f89600b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:38.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.365+0000 7f8966bf5640 1 -- 172.21.15.172:0/1084590026 shutdown_connections 2024-04-25T08:52:38.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.365+0000 7f8966bf5640 1 -- 172.21.15.172:0/1084590026 wait complete. 2024-04-25T08:52:38.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.366+0000 7f8966bf5640 1 Processor -- start 2024-04-25T08:52:38.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.366+0000 7f8966bf5640 1 -- start start 2024-04-25T08:52:38.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8966bf5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8948004800 0x7f896006d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8966bf5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f896015b5b0 0x7f89600a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.366 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8966bf5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89600ad330 0x7f89600ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8966bf5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960145280 con 0x7f89600ad330 2024-04-25T08:52:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8966bf5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960145100 con 0x7f8948004800 2024-04-25T08:52:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8966bf5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8960070dc0 con 0x7f896015b5b0 2024-04-25T08:52:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8965192640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89600ad330 0x7f89600ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8965192640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89600ad330 0x7f89600ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60692/0 (socket says 172.21.15.172:60692) 2024-04-25T08:52:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8965192640 1 -- 172.21.15.172:0/3198024581 learned_addr learned my addr 172.21.15.172:0/3198024581 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8964991640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8948004800 0x7f896006d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.367 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f895ffff640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f896015b5b0 0x7f89600a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8965192640 1 -- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f896015b5b0 msgr2=0x7f89600a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8965192640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f896015b5b0 0x7f89600a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8965192640 1 -- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8948004800 msgr2=0x7f896006d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8965192640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8948004800 0x7f896006d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8965192640 1 -- 172.21.15.172:0/3198024581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89600a9b80 con 0x7f89600ad330 2024-04-25T08:52:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8964991640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8948004800 0x7f896006d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f895ffff640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f896015b5b0 0x7f89600a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8965192640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89600ad330 0x7f89600ad7b0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f8960071f90 tx=0x7f895800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.368 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f895d7fa640 1 -- 172.21.15.172:0/3198024581 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800fdb0 con 0x7f89600ad330 2024-04-25T08:52:38.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f895d7fa640 1 -- 172.21.15.172:0/3198024581 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895801d070 con 0x7f89600ad330 2024-04-25T08:52:38.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f895d7fa640 1 -- 172.21.15.172:0/3198024581 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958015670 con 0x7f89600ad330 2024-04-25T08:52:38.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89600a9e60 con 0x7f89600ad330 2024-04-25T08:52:38.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.367+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89600aa700 con 0x7f89600ad330 2024-04-25T08:52:38.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.368+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f896006b8d0 con 0x7f89600ad330 2024-04-25T08:52:38.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.369+0000 7f895d7fa640 1 -- 172.21.15.172:0/3198024581 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8958015810 con 0x7f89600ad330 2024-04-25T08:52:38.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.369+0000 7f895d7fa640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894c06b500 0x7f894c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.369+0000 7f895d7fa640 1 -- 172.21.15.172:0/3198024581 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f895808ab80 con 0x7f89600ad330 2024-04-25T08:52:38.369 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.369+0000 7f8964991640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894c06b500 0x7f894c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.369+0000 7f895d7fa640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x7f894c0719a0 0x7f894c073de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.369+0000 7f895d7fa640 1 -- 172.21.15.172:0/3198024581 --> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f894c0744b0 con 0x7f894c0719a0 2024-04-25T08:52:38.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.369+0000 7f895d7fa640 1 -- 172.21.15.172:0/3198024581 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f895808f2a0 con 0x7f89600ad330 2024-04-25T08:52:38.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.370+0000 7f895ffff640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x7f894c0719a0 0x7f894c073de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.370+0000 7f8964991640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894c06b500 0x7f894c06d9c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8960068290 tx=0x7f8950009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.370+0000 7f895ffff640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x7f894c0719a0 0x7f894c073de0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.370 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.371+0000 7f895d7fa640 1 -- 172.21.15.172:0/3198024581 <== osd.5 v2:172.21.15.186:6800/2784790337 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f894c0744b0 con 0x7f894c0719a0 2024-04-25T08:52:38.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.384+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 --> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8960073a00 con 0x7f894c0719a0 2024-04-25T08:52:38.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.384+0000 7f895d7fa640 1 -- 172.21.15.172:0/3198024581 <== osd.5 v2:172.21.15.186:6800/2784790337 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8960073a00 con 0x7f894c0719a0 2024-04-25T08:52:38.375 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:52:38.375 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T08:52:38.375 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:52:38.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.384+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x7f894c0719a0 msgr2=0x7f894c073de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.384+0000 7f8966bf5640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.186:6800/2784790337,v1:172.21.15.186:6801/2784790337] conn(0x7f894c0719a0 0x7f894c073de0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.385+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894c06b500 msgr2=0x7f894c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.385+0000 7f8966bf5640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f894c06b500 0x7f894c06d9c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8960068290 tx=0x7f8950009040 comp rx=0 tx=0).stop 2024-04-25T08:52:38.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.385+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89600ad330 msgr2=0x7f89600ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.385+0000 7f8966bf5640 1 --2- 172.21.15.172:0/3198024581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89600ad330 0x7f89600ad7b0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f8960071f90 tx=0x7f895800f580 comp rx=0 tx=0).stop 2024-04-25T08:52:38.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.385+0000 7f8965192640 1 -- 172.21.15.172:0/3198024581 reap_dead start 2024-04-25T08:52:38.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.385+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 shutdown_connections 2024-04-25T08:52:38.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.385+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 >> 172.21.15.172:0/3198024581 conn(0x7f89600b3530 msgr2=0x7f89600c67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:38.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.385+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 shutdown_connections 2024-04-25T08:52:38.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.385+0000 7f8966bf5640 1 -- 172.21.15.172:0/3198024581 wait complete. 2024-04-25T08:52:38.386 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T08:52:38.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.494+0000 7fdb4d007640 1 Processor -- start 2024-04-25T08:52:38.484 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.494+0000 7fdb4d007640 1 -- start start 2024-04-25T08:52:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.494+0000 7fdb4d007640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdb4815b7d0 0x7fdb480cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.494+0000 7fdb4d007640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb480b5620 0x7fdb480b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.494+0000 7fdb4d007640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb4806c2d0 0x7fdb4806c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.494+0000 7fdb4d007640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb480b5fc0 con 0x7fdb4806c2d0 2024-04-25T08:52:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.494+0000 7fdb4d007640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4806cca0 con 0x7fdb4815b7d0 2024-04-25T08:52:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.494+0000 7fdb4d007640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4806cf50 con 0x7fdb480b5620 2024-04-25T08:52:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb4759e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb4806c2d0 0x7fdb4806c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb4759e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb4806c2d0 0x7fdb4806c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60708/0 (socket says 172.21.15.172:60708) 2024-04-25T08:52:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb4759e640 1 -- 172.21.15.172:0/765432000 learned_addr learned my addr 172.21.15.172:0/765432000 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb46d9d640 1 --2- 172.21.15.172:0/765432000 >> v2:172.21.15.186:3300/0 conn(0x7fdb4815b7d0 0x7fdb480cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb4659c640 1 --2- 172.21.15.172:0/765432000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb480b5620 0x7fdb480b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.488 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb4759e640 1 -- 172.21.15.172:0/765432000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb480b5620 msgr2=0x7fdb480b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb4759e640 1 --2- 172.21.15.172:0/765432000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb480b5620 0x7fdb480b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb4759e640 1 -- 172.21.15.172:0/765432000 >> v2:172.21.15.186:3300/0 conn(0x7fdb4815b7d0 msgr2=0x7fdb480cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb4759e640 1 --2- 172.21.15.172:0/765432000 >> v2:172.21.15.186:3300/0 conn(0x7fdb4815b7d0 0x7fdb480cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb4759e640 1 -- 172.21.15.172:0/765432000 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480ce530 con 0x7fdb4806c2d0 2024-04-25T08:52:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.495+0000 7fdb4659c640 1 --2- 172.21.15.172:0/765432000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb480b5620 0x7fdb480b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb4759e640 1 --2- 172.21.15.172:0/765432000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4806c2d0 0x7fdb4806c760 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fdb4808c0d0 tx=0x7fdb4002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb79e0100ee8110 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb45d9b640 1 -- 172.21.15.172:0/765432000 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40036070 con 0x7fdb4806c2d0 2024-04-25T08:52:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb45d9b640 1 -- 172.21.15.172:0/765432000 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb40031600 con 0x7fdb4806c2d0 2024-04-25T08:52:38.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb45d9b640 1 -- 172.21.15.172:0/765432000 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400319d0 con 0x7fdb4806c2d0 2024-04-25T08:52:38.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb4d007640 1 -- 172.21.15.172:0/765432000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4806c2d0 msgr2=0x7fdb4806c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb4d007640 1 --2- 172.21.15.172:0/765432000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4806c2d0 0x7fdb4806c760 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fdb4808c0d0 tx=0x7fdb4002a6a0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb4d007640 1 -- 172.21.15.172:0/765432000 shutdown_connections 2024-04-25T08:52:38.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb4d007640 1 --2- 172.21.15.172:0/765432000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4806c2d0 0x7fdb4806c760 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb4d007640 1 --2- 172.21.15.172:0/765432000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb480b5620 0x7fdb480b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb4d007640 1 --2- 172.21.15.172:0/765432000 >> v2:172.21.15.186:3300/0 conn(0x7fdb4815b7d0 0x7fdb480cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb4d007640 1 -- 172.21.15.172:0/765432000 >> 172.21.15.172:0/765432000 conn(0x7fdb480d0800 msgr2=0x7fdb480d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:38.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb4d007640 1 -- 172.21.15.172:0/765432000 shutdown_connections 2024-04-25T08:52:38.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.496+0000 7fdb4d007640 1 -- 172.21.15.172:0/765432000 wait complete. 2024-04-25T08:52:38.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.498+0000 7fdb4d007640 1 Processor -- start 2024-04-25T08:52:38.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.498+0000 7fdb4d007640 1 -- start start 2024-04-25T08:52:38.493 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.498+0000 7fdb4d007640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb4806c2d0 0x7fdb480cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.498+0000 7fdb4d007640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb480b5620 0x7fdb481f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.498+0000 7fdb4d007640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb4815b7d0 0x7fdb480aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.498+0000 7fdb4d007640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4806d230 con 0x7fdb480b5620 2024-04-25T08:52:38.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.498+0000 7fdb4d007640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480ceaf0 con 0x7fdb4815b7d0 2024-04-25T08:52:38.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.498+0000 7fdb4d007640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480cf550 con 0x7fdb4806c2d0 2024-04-25T08:52:38.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb480b5620 0x7fdb481f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.494 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb480b5620 0x7fdb481f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60714/0 (socket says 172.21.15.172:60714) 2024-04-25T08:52:38.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4659c640 1 -- 172.21.15.172:0/1528090765 learned_addr learned my addr 172.21.15.172:0/1528090765 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:38.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb46d9d640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb4806c2d0 0x7fdb480cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.495 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4759e640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb4815b7d0 0x7fdb480aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4659c640 1 -- 172.21.15.172:0/1528090765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb4806c2d0 msgr2=0x7fdb480cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4659c640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb4806c2d0 0x7fdb480cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4659c640 1 -- 172.21.15.172:0/1528090765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb4815b7d0 msgr2=0x7fdb480aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4659c640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb4815b7d0 0x7fdb480aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4659c640 1 -- 172.21.15.172:0/1528090765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480cb570 con 0x7fdb480b5620 2024-04-25T08:52:38.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4659c640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb480b5620 0x7fdb481f2c00 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800c7f0 tx=0x7fdb3800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb2f7fe640 1 -- 172.21.15.172:0/1528090765 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38015070 con 0x7fdb480b5620 2024-04-25T08:52:38.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb2f7fe640 1 -- 172.21.15.172:0/1528090765 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb38007a30 con 0x7fdb480b5620 2024-04-25T08:52:38.496 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4d007640 1 -- 172.21.15.172:0/1528090765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb480cb850 con 0x7fdb480b5620 2024-04-25T08:52:38.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb2f7fe640 1 -- 172.21.15.172:0/1528090765 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38007e00 con 0x7fdb480b5620 2024-04-25T08:52:38.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.499+0000 7fdb4d007640 1 -- 172.21.15.172:0/1528090765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb480cc0f0 con 0x7fdb480b5620 2024-04-25T08:52:38.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.500+0000 7fdb4d007640 1 -- 172.21.15.172:0/1528090765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb480cba20 con 0x7fdb480b5620 2024-04-25T08:52:38.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.501+0000 7fdb2f7fe640 1 -- 172.21.15.172:0/1528090765 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdb38018070 con 0x7fdb480b5620 2024-04-25T08:52:38.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.501+0000 7fdb2f7fe640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdb3406b4d0 0x7fdb3406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.501+0000 7fdb2f7fe640 1 -- 172.21.15.172:0/1528090765 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fdb38089f00 con 0x7fdb480b5620 2024-04-25T08:52:38.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.501+0000 7fdb46d9d640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdb3406b4d0 0x7fdb3406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.497 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.502+0000 7fdb46d9d640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdb3406b4d0 0x7fdb3406d990 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0079a0 tx=0x7fdb3c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.498 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.505+0000 7fdb2f7fe640 1 -- 172.21.15.172:0/1528090765 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb380588a0 con 0x7fdb480b5620 2024-04-25T08:52:38.669 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.679+0000 7fdb4d007640 1 -- 172.21.15.172:0/1528090765 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb480cc2c0 con 0x7fdb3406b4d0 2024-04-25T08:52:38.670 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.679+0000 7fdb2f7fe640 1 -- 172.21.15.172:0/1528090765 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdb480cc2c0 con 0x7fdb3406b4d0 2024-04-25T08:52:38.670 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T08:52:38.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.681+0000 7fdb4d007640 1 -- 172.21.15.172:0/1528090765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdb3406b4d0 msgr2=0x7fdb3406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.681+0000 7fdb4d007640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdb3406b4d0 0x7fdb3406d990 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0079a0 tx=0x7fdb3c008040 comp rx=0 tx=0).stop 2024-04-25T08:52:38.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.681+0000 7fdb4d007640 1 -- 172.21.15.172:0/1528090765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb480b5620 msgr2=0x7fdb481f2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.681+0000 7fdb4d007640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb480b5620 0x7fdb481f2c00 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800c7f0 tx=0x7fdb3800ccb0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.682+0000 7fdb4d007640 1 -- 172.21.15.172:0/1528090765 shutdown_connections 2024-04-25T08:52:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.682+0000 7fdb4d007640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fdb3406b4d0 0x7fdb3406d990 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.682+0000 7fdb4d007640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb4815b7d0 0x7fdb480aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.682+0000 7fdb4d007640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb480b5620 0x7fdb481f2c00 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.682+0000 7fdb4d007640 1 --2- 172.21.15.172:0/1528090765 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb4806c2d0 0x7fdb480cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.682+0000 7fdb4d007640 1 -- 172.21.15.172:0/1528090765 >> 172.21.15.172:0/1528090765 conn(0x7fdb480d0800 msgr2=0x7fdb48160950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.682+0000 7fdb4d007640 1 -- 172.21.15.172:0/1528090765 shutdown_connections 2024-04-25T08:52:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.682+0000 7fdb4d007640 1 -- 172.21.15.172:0/1528090765 wait complete. 2024-04-25T08:52:38.683 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T08:52:38.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T08:52:38.786 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.795+0000 7f2dca222640 1 Processor -- start 2024-04-25T08:52:38.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.795+0000 7f2dca222640 1 -- start start 2024-04-25T08:52:38.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.795+0000 7f2dca222640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2dc415b7d0 0x7f2dc40cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.795+0000 7f2dca222640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2dc40b5620 0x7f2dc40b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dca222640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc406cf50 con 0x7f2dc406c2d0 2024-04-25T08:52:38.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dca222640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc40b5fc0 con 0x7f2dc415b7d0 2024-04-25T08:52:38.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dca222640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40ce530 con 0x7f2dc40b5620 2024-04-25T08:52:38.787 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dc37fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2dc415b7d0 0x7f2dc40cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dc37fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2dc415b7d0 0x7f2dc40cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60716/0 (socket says 172.21.15.172:60716) 2024-04-25T08:52:38.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dc37fe640 1 -- 172.21.15.172:0/428899342 learned_addr learned my addr 172.21.15.172:0/428899342 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:38.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dc2ffd640 1 --2- 172.21.15.172:0/428899342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2dc40b5620 0x7f2dc40b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dc37fe640 1 -- 172.21.15.172:0/428899342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2dc40b5620 msgr2=0x7f2dc40b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:38.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dc37fe640 1 --2- 172.21.15.172:0/428899342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2dc40b5620 0x7f2dc40b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dc37fe640 1 -- 172.21.15.172:0/428899342 >> v1:172.21.15.186:6789/0 conn(0x7f2dc406c2d0 legacy=0x7f2dc406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.796+0000 7f2dc37fe640 1 -- 172.21.15.172:0/428899342 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc40ce810 con 0x7f2dc415b7d0 2024-04-25T08:52:38.788 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dc37fe640 1 --2- 172.21.15.172:0/428899342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc415b7d0 0x7f2dc40cf010 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009870 tx=0x7f2db402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827fb8471439eaed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dc27fc640 1 -- 172.21.15.172:0/428899342 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4037070 con 0x7f2dc415b7d0 2024-04-25T08:52:38.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dc27fc640 1 -- 172.21.15.172:0/428899342 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db4032440 con 0x7f2dc415b7d0 2024-04-25T08:52:38.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dc27fc640 1 -- 172.21.15.172:0/428899342 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4032810 con 0x7f2dc415b7d0 2024-04-25T08:52:38.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dca222640 1 -- 172.21.15.172:0/428899342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc415b7d0 msgr2=0x7f2dc40cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dca222640 1 --2- 172.21.15.172:0/428899342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc415b7d0 0x7f2dc40cf010 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009870 tx=0x7f2db402a270 comp rx=0 tx=0).stop 2024-04-25T08:52:38.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dca222640 1 -- 172.21.15.172:0/428899342 shutdown_connections 2024-04-25T08:52:38.793 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dca222640 1 --2- 172.21.15.172:0/428899342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2dc40b5620 0x7f2dc40b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dca222640 1 --2- 172.21.15.172:0/428899342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc415b7d0 0x7f2dc40cf010 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dca222640 1 -- 172.21.15.172:0/428899342 >> 172.21.15.172:0/428899342 conn(0x7f2dc40d0800 msgr2=0x7f2dc40d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:38.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dca222640 1 -- 172.21.15.172:0/428899342 shutdown_connections 2024-04-25T08:52:38.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.797+0000 7f2dca222640 1 -- 172.21.15.172:0/428899342 wait complete. 2024-04-25T08:52:38.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.798+0000 7f2dca222640 1 Processor -- start 2024-04-25T08:52:38.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.799+0000 7f2dca222640 1 -- start start 2024-04-25T08:52:38.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.799+0000 7f2dca222640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2dc406c2d0 0x7f2dc40c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.794 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.799+0000 7f2dca222640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2dc40b5620 0x7f2dc4158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.799+0000 7f2dca222640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc415b7d0 0x7f2dc40d2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.799+0000 7f2dca222640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40cf550 con 0x7f2dc415b7d0 2024-04-25T08:52:38.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.799+0000 7f2dca222640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc406d230 con 0x7f2dc40b5620 2024-04-25T08:52:38.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.799+0000 7f2dca222640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40cf6d0 con 0x7f2dc406c2d0 2024-04-25T08:52:38.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.799+0000 7f2dc3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc415b7d0 0x7f2dc40d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dc3fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc415b7d0 0x7f2dc40d2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60722/0 (socket says 172.21.15.172:60722) 2024-04-25T08:52:38.795 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dc3fff640 1 -- 172.21.15.172:0/2125873750 learned_addr learned my addr 172.21.15.172:0/2125873750 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:38.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dc2ffd640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2dc40b5620 0x7f2dc4158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dc37fe640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2dc406c2d0 0x7f2dc40c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dc3fff640 1 -- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2dc406c2d0 msgr2=0x7f2dc40c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dc3fff640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2dc406c2d0 0x7f2dc40c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dc3fff640 1 -- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2dc40b5620 msgr2=0x7f2dc4158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dc3fff640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2dc40b5620 0x7f2dc4158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dc3fff640 1 -- 172.21.15.172:0/2125873750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc41586c0 con 0x7f2dc415b7d0 2024-04-25T08:52:38.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dc3fff640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc415b7d0 0x7f2dc40d2150 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00c730 tx=0x7f2dbc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.796 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dabfff640 1 -- 172.21.15.172:0/2125873750 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc003b70 con 0x7f2dc415b7d0 2024-04-25T08:52:38.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dabfff640 1 -- 172.21.15.172:0/2125873750 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc003d30 con 0x7f2dc415b7d0 2024-04-25T08:52:38.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc40d2690 con 0x7f2dc415b7d0 2024-04-25T08:52:38.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dabfff640 1 -- 172.21.15.172:0/2125873750 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc005310 con 0x7f2dc415b7d0 2024-04-25T08:52:38.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.800+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc40d2c10 con 0x7f2dc415b7d0 2024-04-25T08:52:38.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.801+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2dc4073a00 con 0x7f2dc415b7d0 2024-04-25T08:52:38.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.802+0000 7f2dabfff640 1 -- 172.21.15.172:0/2125873750 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2dbc0056c0 con 0x7f2dc415b7d0 2024-04-25T08:52:38.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.802+0000 7f2dabfff640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2db006b4d0 0x7f2db006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.797 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.802+0000 7f2dc37fe640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2db006b4d0 0x7f2db006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.802+0000 7f2dabfff640 1 -- 172.21.15.172:0/2125873750 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f2dbc089fe0 con 0x7f2dc415b7d0 2024-04-25T08:52:38.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.802+0000 7f2dabfff640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x7f2db0071970 0x7f2db0073db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.802+0000 7f2dabfff640 1 -- 172.21.15.172:0/2125873750 --> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2db0074480 con 0x7f2db0071970 2024-04-25T08:52:38.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.802+0000 7f2dabfff640 1 -- 172.21.15.172:0/2125873750 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dbc091050 con 0x7f2dc415b7d0 2024-04-25T08:52:38.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.802+0000 7f2dc2ffd640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x7f2db0071970 0x7f2db0073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.802+0000 7f2dc37fe640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2db006b4d0 0x7f2db006d990 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2db4034000 tx=0x7f2db402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.798 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.803+0000 7f2dc2ffd640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x7f2db0071970 0x7f2db0073db0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.799 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.804+0000 7f2dabfff640 1 -- 172.21.15.172:0/2125873750 <== osd.6 v2:172.21.15.186:6816/2238458508 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2db0074480 con 0x7f2db0071970 2024-04-25T08:52:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.816+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 --> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2dc415b1f0 con 0x7f2db0071970 2024-04-25T08:52:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dabfff640 1 -- 172.21.15.172:0/2125873750 <== osd.6 v2:172.21.15.186:6816/2238458508 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2dc415b1f0 con 0x7f2db0071970 2024-04-25T08:52:38.807 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:52:38.808 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T08:52:38.808 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:52:38.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x7f2db0071970 msgr2=0x7f2db0073db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dca222640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.186:6816/2238458508,v1:172.21.15.186:6817/2238458508] conn(0x7f2db0071970 0x7f2db0073db0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2db006b4d0 msgr2=0x7f2db006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dca222640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f2db006b4d0 0x7f2db006d990 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2db4034000 tx=0x7f2db402e000 comp rx=0 tx=0).stop 2024-04-25T08:52:38.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc415b7d0 msgr2=0x7f2dc40d2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dca222640 1 --2- 172.21.15.172:0/2125873750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2dc415b7d0 0x7f2dc40d2150 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00c730 tx=0x7f2dbc00cbf0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.809 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dc3fff640 1 -- 172.21.15.172:0/2125873750 reap_dead start 2024-04-25T08:52:38.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 shutdown_connections 2024-04-25T08:52:38.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 >> 172.21.15.172:0/2125873750 conn(0x7f2dc40d0800 msgr2=0x7f2dc40d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:38.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 shutdown_connections 2024-04-25T08:52:38.810 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.817+0000 7f2dca222640 1 -- 172.21.15.172:0/2125873750 wait complete. 2024-04-25T08:52:38.818 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T08:52:38.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.925+0000 7fc613cd1640 1 Processor -- start 2024-04-25T08:52:38.916 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.925+0000 7fc613cd1640 1 -- start start 2024-04-25T08:52:38.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.926+0000 7fc613cd1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc60c0d34c0 0x7fc60c0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.926+0000 7fc613cd1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc60c0d08e0 0x7fc60c0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.926+0000 7fc613cd1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c0d2420 con 0x7fc60c15dac0 2024-04-25T08:52:38.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.926+0000 7fc613cd1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60c0d3030 con 0x7fc60c0d34c0 2024-04-25T08:52:38.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.926+0000 7fc613cd1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0d0d20 con 0x7fc60c0d08e0 2024-04-25T08:52:38.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.926+0000 7fc61126c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc60c0d34c0 0x7fc60c0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.919 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.926+0000 7fc61126c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc60c0d34c0 0x7fc60c0d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60726/0 (socket says 172.21.15.172:60726) 2024-04-25T08:52:38.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.926+0000 7fc61126c640 1 -- 172.21.15.172:0/322157220 learned_addr learned my addr 172.21.15.172:0/322157220 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:38.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.927+0000 7fc61226e640 1 --2- 172.21.15.172:0/322157220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc60c0d08e0 0x7fc60c0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.927+0000 7fc61126c640 1 -- 172.21.15.172:0/322157220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc60c0d08e0 msgr2=0x7fc60c0b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:38.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.927+0000 7fc61126c640 1 --2- 172.21.15.172:0/322157220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc60c0d08e0 0x7fc60c0b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.927+0000 7fc61126c640 1 -- 172.21.15.172:0/322157220 >> v1:172.21.15.186:6789/0 conn(0x7fc60c15dac0 legacy=0x7fc60c0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:38.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.927+0000 7fc61126c640 1 -- 172.21.15.172:0/322157220 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c0d2700 con 0x7fc60c0d34c0 2024-04-25T08:52:38.920 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.927+0000 7fc61126c640 1 --2- 172.21.15.172:0/322157220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c0d34c0 0x7fc60c0d03a0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009850 tx=0x7fc5fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726af52dce6326e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.927+0000 7fc610a6b640 1 -- 172.21.15.172:0/322157220 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc004030 con 0x7fc60c0d34c0 2024-04-25T08:52:38.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.928+0000 7fc610a6b640 1 -- 172.21.15.172:0/322157220 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0041d0 con 0x7fc60c0d34c0 2024-04-25T08:52:38.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.928+0000 7fc610a6b640 1 -- 172.21.15.172:0/322157220 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc003610 con 0x7fc60c0d34c0 2024-04-25T08:52:38.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.928+0000 7fc613cd1640 1 -- 172.21.15.172:0/322157220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c0d34c0 msgr2=0x7fc60c0d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.928+0000 7fc613cd1640 1 --2- 172.21.15.172:0/322157220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c0d34c0 0x7fc60c0d03a0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009850 tx=0x7fc5fc02a270 comp rx=0 tx=0).stop 2024-04-25T08:52:38.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.928+0000 7fc613cd1640 1 -- 172.21.15.172:0/322157220 shutdown_connections 2024-04-25T08:52:38.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.928+0000 7fc613cd1640 1 --2- 172.21.15.172:0/322157220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc60c0d08e0 0x7fc60c0b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.921 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.928+0000 7fc613cd1640 1 --2- 172.21.15.172:0/322157220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c0d34c0 0x7fc60c0d03a0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.928+0000 7fc613cd1640 1 -- 172.21.15.172:0/322157220 >> 172.21.15.172:0/322157220 conn(0x7fc60c061c30 msgr2=0x7fc60c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:38.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.928+0000 7fc613cd1640 1 -- 172.21.15.172:0/322157220 shutdown_connections 2024-04-25T08:52:38.922 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.928+0000 7fc613cd1640 1 -- 172.21.15.172:0/322157220 wait complete. 2024-04-25T08:52:38.925 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.929+0000 7fc613cd1640 1 Processor -- start 2024-04-25T08:52:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.929+0000 7fc613cd1640 1 -- start start 2024-04-25T08:52:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc613cd1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc60c0d08e0 0x7fc60c0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc613cd1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc60c0d34c0 0x7fc60c0c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc613cd1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c15dac0 0x7fc60c151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc613cd1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0d2100 con 0x7fc60c15dac0 2024-04-25T08:52:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc613cd1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0d2cc0 con 0x7fc60c0d34c0 2024-04-25T08:52:38.926 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc613cd1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c15dea0 con 0x7fc60c0d08e0 2024-04-25T08:52:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc61226e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c15dac0 0x7fc60c151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc61226e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c15dac0 0x7fc60c151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60732/0 (socket says 172.21.15.172:60732) 2024-04-25T08:52:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc61226e640 1 -- 172.21.15.172:0/3086109447 learned_addr learned my addr 172.21.15.172:0/3086109447 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc61126c640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc60c0d34c0 0x7fc60c0c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.930+0000 7fc611a6d640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc60c0d08e0 0x7fc60c0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc61226e640 1 -- 172.21.15.172:0/3086109447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc60c0d08e0 msgr2=0x7fc60c0b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc61226e640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc60c0d08e0 0x7fc60c0b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.927 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc61226e640 1 -- 172.21.15.172:0/3086109447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc60c0d34c0 msgr2=0x7fc60c0c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:38.928 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc61226e640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc60c0d34c0 0x7fc60c0c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:38.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc61226e640 1 -- 172.21.15.172:0/3086109447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c0b61e0 con 0x7fc60c15dac0 2024-04-25T08:52:38.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc61226e640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c15dac0 0x7fc60c151f30 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c7f0 tx=0x7fc60400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc6027fc640 1 -- 172.21.15.172:0/3086109447 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604015070 con 0x7fc60c15dac0 2024-04-25T08:52:38.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc6027fc640 1 -- 172.21.15.172:0/3086109447 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc604004220 con 0x7fc60c15dac0 2024-04-25T08:52:38.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc613cd1640 1 -- 172.21.15.172:0/3086109447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60c0b5940 con 0x7fc60c15dac0 2024-04-25T08:52:38.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc6027fc640 1 -- 172.21.15.172:0/3086109447 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604007620 con 0x7fc60c15dac0 2024-04-25T08:52:38.929 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.931+0000 7fc613cd1640 1 -- 172.21.15.172:0/3086109447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c0b5f00 con 0x7fc60c15dac0 2024-04-25T08:52:38.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.932+0000 7fc613cd1640 1 -- 172.21.15.172:0/3086109447 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60c073a00 con 0x7fc60c15dac0 2024-04-25T08:52:38.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.932+0000 7fc6027fc640 1 -- 172.21.15.172:0/3086109447 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc6040079d0 con 0x7fc60c15dac0 2024-04-25T08:52:38.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.933+0000 7fc6027fc640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5f006b4d0 0x7fc5f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:38.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.933+0000 7fc6027fc640 1 -- 172.21.15.172:0/3086109447 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc60408a100 con 0x7fc60c15dac0 2024-04-25T08:52:38.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.933+0000 7fc611a6d640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5f006b4d0 0x7fc5f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:38.930 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.933+0000 7fc611a6d640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5f006b4d0 0x7fc5f006d990 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc60c156290 tx=0x7fc6080094d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:38.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:38.937+0000 7fc6027fc640 1 -- 172.21.15.172:0/3086109447 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc6040590f0 con 0x7fc60c15dac0 2024-04-25T08:52:39.096 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.106+0000 7fc613cd1640 1 -- 172.21.15.172:0/3086109447 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc60c15b570 con 0x7fc5f006b4d0 2024-04-25T08:52:39.097 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.106+0000 7fc6027fc640 1 -- 172.21.15.172:0/3086109447 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc60c15b570 con 0x7fc5f006b4d0 2024-04-25T08:52:39.097 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T08:52:39.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 -- 172.21.15.172:0/3086109447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5f006b4d0 msgr2=0x7fc5f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5f006b4d0 0x7fc5f006d990 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc60c156290 tx=0x7fc6080094d0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 -- 172.21.15.172:0/3086109447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c15dac0 msgr2=0x7fc60c151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c15dac0 0x7fc60c151f30 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c7f0 tx=0x7fc60400ccb0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 -- 172.21.15.172:0/3086109447 shutdown_connections 2024-04-25T08:52:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc5f006b4d0 0x7fc5f006d990 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc60c0d34c0 0x7fc60c0c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc60c15dac0 0x7fc60c151f30 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.099 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 --2- 172.21.15.172:0/3086109447 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc60c0d08e0 0x7fc60c0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 -- 172.21.15.172:0/3086109447 >> 172.21.15.172:0/3086109447 conn(0x7fc60c061c30 msgr2=0x7fc60c15ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:39.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 -- 172.21.15.172:0/3086109447 shutdown_connections 2024-04-25T08:52:39.100 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.108+0000 7fc613cd1640 1 -- 172.21.15.172:0/3086109447 wait complete. 2024-04-25T08:52:39.110 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T08:52:39.111 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T08:52:39.212 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.222+0000 7ffa8a49c640 1 Processor -- start 2024-04-25T08:52:39.213 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.222+0000 7ffa8a49c640 1 -- start start 2024-04-25T08:52:39.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa8a49c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffa84158230 0x7ffa840d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa8a49c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa840d2020 con 0x7ffa840b4e60 2024-04-25T08:52:39.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa8a49c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa840d2300 con 0x7ffa840d1b80 2024-04-25T08:52:39.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa8a49c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa84158610 con 0x7ffa84158230 2024-04-25T08:52:39.215 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa83fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffa84158230 0x7ffa840d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa88a39640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ffa840b4e60 0x7ffa8406f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41086/0 (socket says 172.21.15.172:41086) 2024-04-25T08:52:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa88a39640 1 -- 172.21.15.172:0/2082126034 learned_addr learned my addr 172.21.15.172:0/2082126034 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa83fff640 1 -- 172.21.15.172:0/2082126034 >> v1:172.21.15.186:6789/0 conn(0x7ffa840d1b80 legacy=0x7ffa8406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa83fff640 1 -- 172.21.15.172:0/2082126034 >> v1:172.21.15.172:6789/0 conn(0x7ffa840b4e60 legacy=0x7ffa8406f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa82ffd640 1 -- 172.21.15.172:0/2082126034 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707782092 0 0) 0x7ffa840d2020 con 0x7ffa840b4e60 2024-04-25T08:52:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.223+0000 7ffa83fff640 1 -- 172.21.15.172:0/2082126034 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8406bb30 con 0x7ffa84158230 2024-04-25T08:52:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.224+0000 7ffa83fff640 1 --2- 172.21.15.172:0/2082126034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa84158230 0x7ffa840d1640 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7ffa740097a0 tx=0x7ffa7402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4263baff3985d568 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:39.216 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.224+0000 7ffa82ffd640 1 -- 172.21.15.172:0/2082126034 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74037070 con 0x7ffa84158230 2024-04-25T08:52:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.224+0000 7ffa82ffd640 1 -- 172.21.15.172:0/2082126034 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa74032440 con 0x7ffa84158230 2024-04-25T08:52:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.224+0000 7ffa82ffd640 1 -- 172.21.15.172:0/2082126034 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74032810 con 0x7ffa84158230 2024-04-25T08:52:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.225+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2082126034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa84158230 msgr2=0x7ffa840d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.225+0000 7ffa8a49c640 1 --2- 172.21.15.172:0/2082126034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa84158230 0x7ffa840d1640 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7ffa740097a0 tx=0x7ffa7402a230 comp rx=0 tx=0).stop 2024-04-25T08:52:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.225+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2082126034 shutdown_connections 2024-04-25T08:52:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.225+0000 7ffa8a49c640 1 --2- 172.21.15.172:0/2082126034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa84158230 0x7ffa840d1640 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.225+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2082126034 >> 172.21.15.172:0/2082126034 conn(0x7ffa84061600 msgr2=0x7ffa840619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:39.217 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.225+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2082126034 shutdown_connections 2024-04-25T08:52:39.218 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.225+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2082126034 wait complete. 2024-04-25T08:52:39.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.226+0000 7ffa8a49c640 1 Processor -- start 2024-04-25T08:52:39.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.226+0000 7ffa8a49c640 1 -- start start 2024-04-25T08:52:39.221 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa8a49c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa840b4e60 0x7ffa84149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa8a49c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa840d1b80 0x7ffa840caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa8a49c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa84158230 0x7ffa841e8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa8a49c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8406ca40 con 0x7ffa840d1b80 2024-04-25T08:52:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa8a49c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8406bea0 con 0x7ffa840b4e60 2024-04-25T08:52:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa8a49c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8415e320 con 0x7ffa84158230 2024-04-25T08:52:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa837fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa840d1b80 0x7ffa840caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.222 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa837fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa840d1b80 0x7ffa840caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60752/0 (socket says 172.21.15.172:60752) 2024-04-25T08:52:39.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa837fe640 1 -- 172.21.15.172:0/2561437320 learned_addr learned my addr 172.21.15.172:0/2561437320 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:39.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa837fe640 1 -- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa84158230 msgr2=0x7ffa841e8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa88a39640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa84158230 0x7ffa841e8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa83fff640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa840b4e60 0x7ffa84149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa837fe640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa84158230 0x7ffa841e8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa837fe640 1 -- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa840b4e60 msgr2=0x7ffa84149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa837fe640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa840b4e60 0x7ffa84149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa837fe640 1 -- 172.21.15.172:0/2561437320 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84149680 con 0x7ffa840d1b80 2024-04-25T08:52:39.223 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.227+0000 7ffa83fff640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa840b4e60 0x7ffa84149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.228+0000 7ffa837fe640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa840d1b80 0x7ffa840caa60 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800c3c0 tx=0x7ffa78001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.228+0000 7ffa80ff9640 1 -- 172.21.15.172:0/2561437320 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78017070 con 0x7ffa840d1b80 2024-04-25T08:52:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.228+0000 7ffa80ff9640 1 -- 172.21.15.172:0/2561437320 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa780052d0 con 0x7ffa840d1b80 2024-04-25T08:52:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.228+0000 7ffa80ff9640 1 -- 172.21.15.172:0/2561437320 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78003830 con 0x7ffa840d1b80 2024-04-25T08:52:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.228+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa840cb2b0 con 0x7ffa840d1b80 2024-04-25T08:52:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.228+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa840cb870 con 0x7ffa840d1b80 2024-04-25T08:52:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.229+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa8406de50 con 0x7ffa840d1b80 2024-04-25T08:52:39.224 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.229+0000 7ffa80ff9640 1 -- 172.21.15.172:0/2561437320 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa7801a070 con 0x7ffa840d1b80 2024-04-25T08:52:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.230+0000 7ffa80ff9640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa7006b4d0 0x7ffa7006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.230+0000 7ffa80ff9640 1 -- 172.21.15.172:0/2561437320 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ffa78089400 con 0x7ffa840d1b80 2024-04-25T08:52:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.230+0000 7ffa83fff640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa7006b4d0 0x7ffa7006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.230+0000 7ffa80ff9640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] conn(0x7ffa70071970 0x7ffa70073db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.230+0000 7ffa80ff9640 1 -- 172.21.15.172:0/2561437320 --> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa70074480 con 0x7ffa70071970 2024-04-25T08:52:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.230+0000 7ffa80ff9640 1 -- 172.21.15.172:0/2561437320 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=148) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa78090050 con 0x7ffa840d1b80 2024-04-25T08:52:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.230+0000 7ffa88a39640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] conn(0x7ffa70071970 0x7ffa70073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.230+0000 7ffa83fff640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa7006b4d0 0x7ffa7006d990 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ffa74034000 tx=0x7ffa7402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:39.225 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.230+0000 7ffa88a39640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] conn(0x7ffa70071970 0x7ffa70073db0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:39.226 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.231+0000 7ffa80ff9640 1 -- 172.21.15.172:0/2561437320 <== osd.7 v2:172.21.15.186:6824/1002001557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ffa70074480 con 0x7ffa70071970 2024-04-25T08:52:39.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.244+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 --> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffa84073a00 con 0x7ffa70071970 2024-04-25T08:52:39.234 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa80ff9640 1 -- 172.21.15.172:0/2561437320 <== osd.7 v2:172.21.15.186:6824/1002001557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffa84073a00 con 0x7ffa70071970 2024-04-25T08:52:39.235 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-04-25T08:52:39.235 INFO:teuthology.orchestra.run.smithi172.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T08:52:39.235 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-04-25T08:52:39.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] conn(0x7ffa70071970 msgr2=0x7ffa70073db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa8a49c640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.186:6824/1002001557,v1:172.21.15.186:6825/1002001557] conn(0x7ffa70071970 0x7ffa70073db0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa7006b4d0 msgr2=0x7ffa7006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa8a49c640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7ffa7006b4d0 0x7ffa7006d990 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ffa74034000 tx=0x7ffa7402e000 comp rx=0 tx=0).stop 2024-04-25T08:52:39.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa840d1b80 msgr2=0x7ffa840caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.236 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa8a49c640 1 --2- 172.21.15.172:0/2561437320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa840d1b80 0x7ffa840caa60 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800c3c0 tx=0x7ffa78001e70 comp rx=0 tx=0).stop 2024-04-25T08:52:39.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa88a39640 1 -- 172.21.15.172:0/2561437320 reap_dead start 2024-04-25T08:52:39.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 shutdown_connections 2024-04-25T08:52:39.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 >> 172.21.15.172:0/2561437320 conn(0x7ffa84061600 msgr2=0x7ffa840b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:39.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 shutdown_connections 2024-04-25T08:52:39.237 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.245+0000 7ffa8a49c640 1 -- 172.21.15.172:0/2561437320 wait complete. 2024-04-25T08:52:39.246 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T08:52:39.345 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.355+0000 7fc9f71ab640 1 Processor -- start 2024-04-25T08:52:39.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.355+0000 7fc9f71ab640 1 -- start start 2024-04-25T08:52:39.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9f71ab640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc9f00d34c0 0x7fc9f00d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9f71ab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9f00d08e0 0x7fc9f00b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9f71ab640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f00d2420 con 0x7fc9f015dac0 2024-04-25T08:52:39.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9f71ab640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f00d3030 con 0x7fc9f00d34c0 2024-04-25T08:52:39.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9f71ab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00d0d20 con 0x7fc9f00d08e0 2024-04-25T08:52:39.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9effff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc9f00d34c0 0x7fc9f00d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9f4f47640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc9f015dac0 0x7fc9f00d19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:41090/0 (socket says 172.21.15.172:41090) 2024-04-25T08:52:39.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9effff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc9f00d34c0 0x7fc9f00d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60754/0 (socket says 172.21.15.172:60754) 2024-04-25T08:52:39.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9f4f47640 1 -- 172.21.15.172:0/3558677953 learned_addr learned my addr 172.21.15.172:0/3558677953 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:39.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9effff640 1 -- 172.21.15.172:0/3558677953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9f00d08e0 msgr2=0x7fc9f00b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:39.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9effff640 1 --2- 172.21.15.172:0/3558677953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9f00d08e0 0x7fc9f00b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9effff640 1 -- 172.21.15.172:0/3558677953 >> v1:172.21.15.172:6789/0 conn(0x7fc9f015dac0 legacy=0x7fc9f00d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9effff640 1 -- 172.21.15.172:0/3558677953 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f00d2700 con 0x7fc9f00d34c0 2024-04-25T08:52:39.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.356+0000 7fc9ef7fe640 1 -- 172.21.15.172:0/3558677953 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743471045 0 0) 0x7fc9f00d2420 con 0x7fc9f015dac0 2024-04-25T08:52:39.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.357+0000 7fc9effff640 1 --2- 172.21.15.172:0/3558677953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 0x7fc9f00d03a0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009790 tx=0x7fc9dc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed7e3cde3fbab6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:39.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.357+0000 7fc9ef7fe640 1 -- 172.21.15.172:0/3558677953 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc037070 con 0x7fc9f00d34c0 2024-04-25T08:52:39.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.357+0000 7fc9ef7fe640 1 -- 172.21.15.172:0/3558677953 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc032440 con 0x7fc9f00d34c0 2024-04-25T08:52:39.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.357+0000 7fc9ef7fe640 1 -- 172.21.15.172:0/3558677953 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc032810 con 0x7fc9f00d34c0 2024-04-25T08:52:39.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.358+0000 7fc9f71ab640 1 -- 172.21.15.172:0/3558677953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 msgr2=0x7fc9f00d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.358+0000 7fc9f71ab640 1 --2- 172.21.15.172:0/3558677953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 0x7fc9f00d03a0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009790 tx=0x7fc9dc02a210 comp rx=0 tx=0).stop 2024-04-25T08:52:39.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.358+0000 7fc9f71ab640 1 -- 172.21.15.172:0/3558677953 shutdown_connections 2024-04-25T08:52:39.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.358+0000 7fc9f71ab640 1 --2- 172.21.15.172:0/3558677953 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9f00d08e0 0x7fc9f00b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.358+0000 7fc9f71ab640 1 --2- 172.21.15.172:0/3558677953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 0x7fc9f00d03a0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.358+0000 7fc9f71ab640 1 -- 172.21.15.172:0/3558677953 >> 172.21.15.172:0/3558677953 conn(0x7fc9f0061c30 msgr2=0x7fc9f006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:39.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.358+0000 7fc9f71ab640 1 -- 172.21.15.172:0/3558677953 shutdown_connections 2024-04-25T08:52:39.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.358+0000 7fc9f71ab640 1 -- 172.21.15.172:0/3558677953 wait complete. 2024-04-25T08:52:39.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.359+0000 7fc9f71ab640 1 Processor -- start 2024-04-25T08:52:39.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.359+0000 7fc9f71ab640 1 -- start start 2024-04-25T08:52:39.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9f71ab640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9f00d08e0 0x7fc9f01f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9f71ab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 0x7fc9f01ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9f71ab640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f015dac0 0x7fc9f00b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9f71ab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00d2100 con 0x7fc9f00d34c0 2024-04-25T08:52:39.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9f71ab640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00d2cc0 con 0x7fc9f015dac0 2024-04-25T08:52:39.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9f71ab640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f015dea0 con 0x7fc9f00d08e0 2024-04-25T08:52:39.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9effff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 0x7fc9f01ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9effff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 0x7fc9f01ed580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60758/0 (socket says 172.21.15.172:60758) 2024-04-25T08:52:39.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9effff640 1 -- 172.21.15.172:0/2143425646 learned_addr learned my addr 172.21.15.172:0/2143425646 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:39.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9f5748640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f015dac0 0x7fc9f00b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9f4f47640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9f00d08e0 0x7fc9f01f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9effff640 1 -- 172.21.15.172:0/2143425646 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9f00d08e0 msgr2=0x7fc9f01f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.355 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9effff640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9f00d08e0 0x7fc9f01f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9effff640 1 -- 172.21.15.172:0/2143425646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f015dac0 msgr2=0x7fc9f00b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9effff640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f015dac0 0x7fc9f00b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9effff640 1 -- 172.21.15.172:0/2143425646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f01f4620 con 0x7fc9f00d34c0 2024-04-25T08:52:39.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9f5748640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f015dac0 0x7fc9f00b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:39.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9f4f47640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9f00d08e0 0x7fc9f01f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:39.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.360+0000 7fc9effff640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 0x7fc9f01ed580 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc000c00 tx=0x7fc9dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:39.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.361+0000 7fc9ed7fa640 1 -- 172.21.15.172:0/2143425646 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc042070 con 0x7fc9f00d34c0 2024-04-25T08:52:39.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.361+0000 7fc9ed7fa640 1 -- 172.21.15.172:0/2143425646 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc004220 con 0x7fc9f00d34c0 2024-04-25T08:52:39.356 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.361+0000 7fc9f71ab640 1 -- 172.21.15.172:0/2143425646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f00b4850 con 0x7fc9f00d34c0 2024-04-25T08:52:39.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.361+0000 7fc9ed7fa640 1 -- 172.21.15.172:0/2143425646 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc037040 con 0x7fc9f00d34c0 2024-04-25T08:52:39.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.361+0000 7fc9f71ab640 1 -- 172.21.15.172:0/2143425646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f00b4dd0 con 0x7fc9f00d34c0 2024-04-25T08:52:39.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.362+0000 7fc9f71ab640 1 -- 172.21.15.172:0/2143425646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f0073a00 con 0x7fc9f00d34c0 2024-04-25T08:52:39.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.362+0000 7fc9ed7fa640 1 -- 172.21.15.172:0/2143425646 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc9dc005990 con 0x7fc9f00d34c0 2024-04-25T08:52:39.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.362+0000 7fc9ed7fa640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc9d406b4d0 0x7fc9d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.362+0000 7fc9ed7fa640 1 -- 172.21.15.172:0/2143425646 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc9dc0aad90 con 0x7fc9f00d34c0 2024-04-25T08:52:39.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.362+0000 7fc9f4f47640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc9d406b4d0 0x7fc9d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.363+0000 7fc9f4f47640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc9d406b4d0 0x7fc9d406d990 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4000f60 tx=0x7fc9e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:39.358 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.367+0000 7fc9ed7fa640 1 -- 172.21.15.172:0/2143425646 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc9f01f4620 con 0x7fc9f00d34c0 2024-04-25T08:52:39.529 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.539+0000 7fc9f71ab640 1 -- 172.21.15.172:0/2143425646 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9f015c900 con 0x7fc9d406b4d0 2024-04-25T08:52:39.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.539+0000 7fc9ed7fa640 1 -- 172.21.15.172:0/2143425646 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc9f015c900 con 0x7fc9d406b4d0 2024-04-25T08:52:39.530 INFO:teuthology.orchestra.run.smithi172.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T08:52:39.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 -- 172.21.15.172:0/2143425646 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc9d406b4d0 msgr2=0x7fc9d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc9d406b4d0 0x7fc9d406d990 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4000f60 tx=0x7fc9e4009040 comp rx=0 tx=0).stop 2024-04-25T08:52:39.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 -- 172.21.15.172:0/2143425646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 msgr2=0x7fc9f01ed580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 0x7fc9f01ed580 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc000c00 tx=0x7fc9dc0046c0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 -- 172.21.15.172:0/2143425646 shutdown_connections 2024-04-25T08:52:39.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fc9d406b4d0 0x7fc9d406d990 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9f015dac0 0x7fc9f00b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f00d34c0 0x7fc9f01ed580 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 --2- 172.21.15.172:0/2143425646 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9f00d08e0 0x7fc9f01f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 -- 172.21.15.172:0/2143425646 >> 172.21.15.172:0/2143425646 conn(0x7fc9f0061c30 msgr2=0x7fc9f00c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:39.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 -- 172.21.15.172:0/2143425646 shutdown_connections 2024-04-25T08:52:39.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.541+0000 7fc9f71ab640 1 -- 172.21.15.172:0/2143425646 wait complete. 2024-04-25T08:52:39.543 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:52:39.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.651+0000 7fb3ad390640 1 Processor -- start 2024-04-25T08:52:39.642 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.651+0000 7fb3ad390640 1 -- start start 2024-04-25T08:52:39.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.652+0000 7fb3ad390640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb3a815dbe0 0x7fb3a80d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.652+0000 7fb3ad390640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a80b2cb0 0x7fb3a80d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.652+0000 7fb3ad390640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a80b97a0 con 0x7fb3a80b92a0 2024-04-25T08:52:39.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.652+0000 7fb3ad390640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a815dfc0 con 0x7fb3a815dbe0 2024-04-25T08:52:39.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.652+0000 7fb3ad390640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80d1a00 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.652+0000 7fb3a6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb3a815dbe0 0x7fb3a80d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.652+0000 7fb3a6ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb3a815dbe0 0x7fb3a80d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60764/0 (socket says 172.21.15.172:60764) 2024-04-25T08:52:39.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.653+0000 7fb3a6ffd640 1 -- 172.21.15.172:0/2075341666 learned_addr learned my addr 172.21.15.172:0/2075341666 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:39.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.653+0000 7fb3a67fc640 1 --2- 172.21.15.172:0/2075341666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a80b2cb0 0x7fb3a80d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.653+0000 7fb3a6ffd640 1 -- 172.21.15.172:0/2075341666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a80b2cb0 msgr2=0x7fb3a80d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:39.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.653+0000 7fb3a6ffd640 1 --2- 172.21.15.172:0/2075341666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a80b2cb0 0x7fb3a80d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.653+0000 7fb3a6ffd640 1 -- 172.21.15.172:0/2075341666 >> v1:172.21.15.186:6789/0 conn(0x7fb3a80b92a0 legacy=0x7fb3a80b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:39.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.653+0000 7fb3a6ffd640 1 -- 172.21.15.172:0/2075341666 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80d1c50 con 0x7fb3a815dbe0 2024-04-25T08:52:39.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.653+0000 7fb3a67fc640 1 --2- 172.21.15.172:0/2075341666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a80b2cb0 0x7fb3a80d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:52:39.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.653+0000 7fb3a6ffd640 1 --2- 172.21.15.172:0/2075341666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a815dbe0 0x7fb3a80d0910 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fb398009e50 tx=0x7fb39802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1e20e1f78a8a5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:39.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3a5ffb640 1 -- 172.21.15.172:0/2075341666 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398036070 con 0x7fb3a815dbe0 2024-04-25T08:52:39.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3a5ffb640 1 -- 172.21.15.172:0/2075341666 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb398031600 con 0x7fb3a815dbe0 2024-04-25T08:52:39.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3a5ffb640 1 -- 172.21.15.172:0/2075341666 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3980319d0 con 0x7fb3a815dbe0 2024-04-25T08:52:39.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3ad390640 1 -- 172.21.15.172:0/2075341666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a815dbe0 msgr2=0x7fb3a80d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3ad390640 1 --2- 172.21.15.172:0/2075341666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a815dbe0 0x7fb3a80d0910 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fb398009e50 tx=0x7fb39802a6c0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3ad390640 1 -- 172.21.15.172:0/2075341666 shutdown_connections 2024-04-25T08:52:39.647 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3ad390640 1 --2- 172.21.15.172:0/2075341666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a80b2cb0 0x7fb3a80d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3ad390640 1 --2- 172.21.15.172:0/2075341666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a815dbe0 0x7fb3a80d0910 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3ad390640 1 -- 172.21.15.172:0/2075341666 >> 172.21.15.172:0/2075341666 conn(0x7fb3a8061a20 msgr2=0x7fb3a8061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:39.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3ad390640 1 -- 172.21.15.172:0/2075341666 shutdown_connections 2024-04-25T08:52:39.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.654+0000 7fb3ad390640 1 -- 172.21.15.172:0/2075341666 wait complete. 2024-04-25T08:52:39.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.655+0000 7fb3ad390640 1 Processor -- start 2024-04-25T08:52:39.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3ad390640 1 -- start start 2024-04-25T08:52:39.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3ad390640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a80b2cb0 0x7fb3a80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3ad390640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3a80b92a0 0x7fb3a81f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3ad390640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a815dbe0 0x7fb3a80d3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3ad390640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80b6ab0 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3ad390640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80d2210 con 0x7fb3a80b92a0 2024-04-25T08:52:39.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3ad390640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80b6c30 con 0x7fb3a815dbe0 2024-04-25T08:52:39.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3a6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a80b2cb0 0x7fb3a80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3a6ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a80b2cb0 0x7fb3a80c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60774/0 (socket says 172.21.15.172:60774) 2024-04-25T08:52:39.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3a6ffd640 1 -- 172.21.15.172:0/4109145064 learned_addr learned my addr 172.21.15.172:0/4109145064 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:39.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3a77fe640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a815dbe0 0x7fb3a80d3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.656+0000 7fb3a67fc640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3a80b92a0 0x7fb3a81f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb3a6ffd640 1 -- 172.21.15.172:0/4109145064 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a815dbe0 msgr2=0x7fb3a80d3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb3a6ffd640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a815dbe0 0x7fb3a80d3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb3a6ffd640 1 -- 172.21.15.172:0/4109145064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3a80b92a0 msgr2=0x7fb3a81f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb3a6ffd640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3a80b92a0 0x7fb3a81f4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb3a6ffd640 1 -- 172.21.15.172:0/4109145064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80cc5a0 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb3a67fc640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3a80b92a0 0x7fb3a81f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:39.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb3a6ffd640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a80b2cb0 0x7fb3a80c94c0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fb398009e50 tx=0x7fb398004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:39.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb38f7fe640 1 -- 172.21.15.172:0/4109145064 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398036050 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb38f7fe640 1 -- 172.21.15.172:0/4109145064 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb398042070 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.653 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb38f7fe640 1 -- 172.21.15.172:0/4109145064 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398009510 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb3ad390640 1 -- 172.21.15.172:0/4109145064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a81f47a0 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.657+0000 7fb3ad390640 1 -- 172.21.15.172:0/4109145064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a80b57d0 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.658+0000 7fb3ad390640 1 -- 172.21.15.172:0/4109145064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a8073990 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.659+0000 7fb38f7fe640 1 -- 172.21.15.172:0/4109145064 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb398007c50 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.659+0000 7fb38f7fe640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb39406b4d0 0x7fb39406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:39.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.659+0000 7fb38f7fe640 1 -- 172.21.15.172:0/4109145064 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb3980aafb0 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.659+0000 7fb3a67fc640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb39406b4d0 0x7fb39406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:39.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.659+0000 7fb3a67fc640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb39406b4d0 0x7fb39406d990 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80b7960 tx=0x7fb39c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:39.655 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.663+0000 7fb38f7fe640 1 -- 172.21.15.172:0/4109145064 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3a80cc5a0 con 0x7fb3a80b2cb0 2024-04-25T08:52:39.819 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.829+0000 7fb3ad390640 1 -- 172.21.15.172:0/4109145064 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3a80b7990 con 0x7fb39406b4d0 2024-04-25T08:52:39.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.830+0000 7fb38f7fe640 1 -- 172.21.15.172:0/4109145064 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13532 (secure 0 0 0) 0x7fb3a80b7990 con 0x7fb39406b4d0 2024-04-25T08:52:39.821 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:52:39.821 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:52:39.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 -- 172.21.15.172:0/4109145064 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb39406b4d0 msgr2=0x7fb39406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb39406b4d0 0x7fb39406d990 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80b7960 tx=0x7fb39c008040 comp rx=0 tx=0).stop 2024-04-25T08:52:39.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 -- 172.21.15.172:0/4109145064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a80b2cb0 msgr2=0x7fb3a80c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:39.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a80b2cb0 0x7fb3a80c94c0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fb398009e50 tx=0x7fb398004a40 comp rx=0 tx=0).stop 2024-04-25T08:52:39.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 -- 172.21.15.172:0/4109145064 shutdown_connections 2024-04-25T08:52:39.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fb39406b4d0 0x7fb39406d990 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3a80b92a0 0x7fb3a81f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.823 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3a815dbe0 0x7fb3a80d3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 --2- 172.21.15.172:0/4109145064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a80b2cb0 0x7fb3a80c94c0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:39.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 -- 172.21.15.172:0/4109145064 >> 172.21.15.172:0/4109145064 conn(0x7fb3a8061a20 msgr2=0x7fb3a80b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:39.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 -- 172.21.15.172:0/4109145064 shutdown_connections 2024-04-25T08:52:39.824 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:39.832+0000 7fb3ad390640 1 -- 172.21.15.172:0/4109145064 wait complete. 2024-04-25T08:52:39.834 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2024-04-25T08:52:38.638344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":426196,"kb_used_data":15720,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754548524,"statfs":{"total":773094113280,"available":772657688576,"internally_reserved":0,"allocated":16097280,"data_stored":8138176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078223262,"num_objects":-1047,"num_object_clones":0,"num_object_copies":-2094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1047,"num_whiteouts":0,"num_read":-24,"num_read_kb":-4388,"num_write":-1114,"num_write_kb":-1053100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3,"num_bytes_recovered":-3145728,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001646"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":407,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-04-25T08:52:32.483367+0000","last_change":"2024-04-25T08:42:17.588250+0000","last_active":"2024-04-25T08:52:32.483367+0000","last_peered":"2024-04-25T08:52:32.483367+0000","last_clean":"2024-04-25T08:52:32.483367+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:52:32.483367+0000","last_undegraded":"2024-04-25T08:52:32.483367+0000","last_fullsized":"2024-04-25T08:52:32.483367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T08:42:16.541299+0000","last_clean_scrub_stamp":"2024-04-25T08:42:16.541299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:19.135598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51628,"kb_used_data":2400,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320212,"statfs":{"total":96636764160,"available":96583897088,"internally_reserved":0,"allocated":2457600,"data_stored":1460048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51052,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320788,"statfs":{"total":96636764160,"available":96584486912,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51048,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320792,"statfs":{"total":96636764160,"available":96584491008,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55208,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316632,"statfs":{"total":96636764160,"available":96580231168,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59368,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312472,"statfs":{"total":96636764160,"available":96575971328,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51052,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320788,"statfs":{"total":96636764160,"available":96584486912,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51052,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320788,"statfs":{"total":96636764160,"available":96584486912,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55788,"kb_used_data":2400,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316052,"statfs":{"total":96636764160,"available":96579637248,"internally_reserved":0,"allocated":2457600,"data_stored":1460048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:52:39.837 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T08:42:16.541299+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=8, tm_min=42, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=8, tm_min=52, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T08:52:39.837 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T08:52:59.838 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T08:52:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.958+0000 7fe89e0a3640 1 Processor -- start 2024-04-25T08:52:59.948 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.958+0000 7fe89e0a3640 1 -- start start 2024-04-25T08:52:59.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe89e0a3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe8980d1020 0x7fe8980d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:59.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe89e0a3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8980b97a0 con 0x7fe8980b2cb0 2024-04-25T08:52:59.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe89e0a3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8980d1c50 con 0x7fe89815dbe0 2024-04-25T08:52:59.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe89e0a3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89815dfc0 con 0x7fe8980d1020 2024-04-25T08:52:59.952 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe88ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe8980b2cb0 0x7fe8980d2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43194/0 (socket says 172.21.15.172:43194) 2024-04-25T08:52:59.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe88ffff640 1 -- 172.21.15.172:0/1915596548 learned_addr learned my addr 172.21.15.172:0/1915596548 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:52:59.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe897fff640 1 --2- 172.21.15.172:0/1915596548 >> v2:172.21.15.186:3300/0 conn(0x7fe8980d1020 0x7fe8980d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:59.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270288512 0 0) 0x7fe8980b97a0 con 0x7fe8980b2cb0 2024-04-25T08:52:59.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe884003520 con 0x7fe8980b2cb0 2024-04-25T08:52:59.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283794880 0 0) 0x7fe8980d1c50 con 0x7fe89815dbe0 2024-04-25T08:52:59.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8980b97a0 con 0x7fe89815dbe0 2024-04-25T08:52:59.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 <== mon.0 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4053086110 0 0) 0x7fe884003520 con 0x7fe8980b2cb0 2024-04-25T08:52:59.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 >> v2:172.21.15.186:3300/0 conn(0x7fe8980d1020 msgr2=0x7fe8980d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:59.953 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 --2- 172.21.15.172:0/1915596548 >> v2:172.21.15.186:3300/0 conn(0x7fe8980d1020 0x7fe8980d2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:59.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 >> v1:172.21.15.186:6789/0 conn(0x7fe89815dbe0 legacy=0x7fe8980d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:59.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8980d1f30 con 0x7fe8980b2cb0 2024-04-25T08:52:59.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 <== mon.0 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1546457371 0 0) 0x7fe880001670 con 0x7fe8980b2cb0 2024-04-25T08:52:59.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 >> v1:172.21.15.172:6789/0 conn(0x7fe8980b2cb0 legacy=0x7fe8980d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:59.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.959+0000 7fe896ffd640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe884003b40 0x7fe884003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:59.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe896ffd640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:59.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe896ffd640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe88400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:59.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88400c010 con 0x7fe8840051c0 2024-04-25T08:52:59.954 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88400c1c0 con 0x7fe884003b40 2024-04-25T08:52:59.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88400c3c0 con 0x7fe884004800 2024-04-25T08:52:59.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe897fff640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe88400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:59.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe8977fe640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe884003b40 0x7fe884003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:59.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe88ffff640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:59.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe897fff640 1 -- 172.21.15.172:0/1915596548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe884004800 msgr2=0x7fe884004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:59.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe897fff640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:59.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe897fff640 1 -- 172.21.15.172:0/1915596548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe884003b40 msgr2=0x7fe884003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:52:59.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe897fff640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe884003b40 0x7fe884003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:59.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe897fff640 1 -- 172.21.15.172:0/1915596548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe884003520 con 0x7fe8840051c0 2024-04-25T08:52:59.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.960+0000 7fe88ffff640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe884004800 0x7fe884004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:59.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe897fff640 1 -- 172.21.15.172:0/1915596548 reap_dead start 2024-04-25T08:52:59.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe897fff640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe88400b9c0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fe890009fc0 tx=0x7fe884005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e197ed37f47b3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:59.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe890035020 con 0x7fe8840051c0 2024-04-25T08:52:59.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe890003bd0 con 0x7fe8840051c0 2024-04-25T08:52:59.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe896ffd640 1 -- 172.21.15.172:0/1915596548 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe890009c10 con 0x7fe8840051c0 2024-04-25T08:52:59.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe89e0a3640 1 -- 172.21.15.172:0/1915596548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 msgr2=0x7fe88400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:59.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe89e0a3640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe88400b9c0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fe890009fc0 tx=0x7fe884005830 comp rx=0 tx=0).stop 2024-04-25T08:52:59.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe89e0a3640 1 -- 172.21.15.172:0/1915596548 shutdown_connections 2024-04-25T08:52:59.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe89e0a3640 1 --2- 172.21.15.172:0/1915596548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe88400b9c0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:59.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe89e0a3640 1 -- 172.21.15.172:0/1915596548 >> 172.21.15.172:0/1915596548 conn(0x7fe898061a20 msgr2=0x7fe898061e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:52:59.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe89e0a3640 1 -- 172.21.15.172:0/1915596548 shutdown_connections 2024-04-25T08:52:59.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.961+0000 7fe89e0a3640 1 -- 172.21.15.172:0/1915596548 wait complete. 2024-04-25T08:52:59.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.963+0000 7fe89e0a3640 1 Processor -- start 2024-04-25T08:52:59.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.963+0000 7fe89e0a3640 1 -- start start 2024-04-25T08:52:59.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.963+0000 7fe89e0a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe8980c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:59.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.963+0000 7fe89e0a3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe898157ff0 0x7fe898158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:59.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.963+0000 7fe89e0a3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe89815e540 0x7fe89815e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:59.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.963+0000 7fe89e0a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980b92a0 con 0x7fe8840051c0 2024-04-25T08:52:59.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.963+0000 7fe89e0a3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980d1a00 con 0x7fe89815e540 2024-04-25T08:52:59.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.963+0000 7fe89e0a3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980b9420 con 0x7fe898157ff0 2024-04-25T08:52:59.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.963+0000 7fe8977fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe8980c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:59.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.963+0000 7fe8977fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe8980c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46862/0 (socket says 172.21.15.172:46862) 2024-04-25T08:52:59.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe8977fe640 1 -- 172.21.15.172:0/592589743 learned_addr learned my addr 172.21.15.172:0/592589743 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:52:59.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe897fff640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe89815e540 0x7fe89815e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:59.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe88ffff640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe898157ff0 0x7fe898158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:59.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe8977fe640 1 -- 172.21.15.172:0/592589743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe898157ff0 msgr2=0x7fe898158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:59.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe8977fe640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe898157ff0 0x7fe898158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:59.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe8977fe640 1 -- 172.21.15.172:0/592589743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe89815e540 msgr2=0x7fe89815e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:52:59.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe8977fe640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe89815e540 0x7fe89815e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:52:59.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe8977fe640 1 -- 172.21.15.172:0/592589743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8981589b0 con 0x7fe8840051c0 2024-04-25T08:52:59.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe897fff640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe89815e540 0x7fe89815e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:52:59.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe8977fe640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe8980c9bb0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fe88800f7a0 tx=0x7fe88800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:59.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe894ff9640 1 -- 172.21.15.172:0/592589743 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88801a070 con 0x7fe8840051c0 2024-04-25T08:52:59.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe894ff9640 1 -- 172.21.15.172:0/592589743 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88800fe50 con 0x7fe8840051c0 2024-04-25T08:52:59.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe89e0a3640 1 -- 172.21.15.172:0/592589743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe898158c70 con 0x7fe8840051c0 2024-04-25T08:52:59.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe894ff9640 1 -- 172.21.15.172:0/592589743 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888007050 con 0x7fe8840051c0 2024-04-25T08:52:59.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.964+0000 7fe89e0a3640 1 -- 172.21.15.172:0/592589743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe898159230 con 0x7fe8840051c0 2024-04-25T08:52:59.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.965+0000 7fe89e0a3640 1 -- 172.21.15.172:0/592589743 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe898073990 con 0x7fe8840051c0 2024-04-25T08:52:59.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.966+0000 7fe894ff9640 1 -- 172.21.15.172:0/592589743 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe88801d070 con 0x7fe8840051c0 2024-04-25T08:52:59.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.966+0000 7fe894ff9640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe87806b4d0 0x7fe87806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:52:59.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.966+0000 7fe894ff9640 1 -- 172.21.15.172:0/592589743 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe8880897b0 con 0x7fe8840051c0 2024-04-25T08:52:59.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.966+0000 7fe88ffff640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe87806b4d0 0x7fe87806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:52:59.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.966+0000 7fe88ffff640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe87806b4d0 0x7fe87806d990 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe8980b6170 tx=0x7fe880009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:52:59.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:52:59.970+0000 7fe894ff9640 1 -- 172.21.15.172:0/592589743 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe8880587a0 con 0x7fe8840051c0 2024-04-25T08:53:00.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.139+0000 7fe89e0a3640 1 -- 172.21.15.172:0/592589743 --> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8980d3340 con 0x7fe87806b4d0 2024-04-25T08:53:00.129 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.139+0000 7fe894ff9640 1 -- 172.21.15.172:0/592589743 <== mgr.4113 v2:172.21.15.172:6832/2190189121 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13379 (secure 0 0 0) 0x7fe8980d3340 con 0x7fe87806b4d0 2024-04-25T08:53:00.130 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:53:00.130 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2024-04-25T08:53:00.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 -- 172.21.15.172:0/592589743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe87806b4d0 msgr2=0x7fe87806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe87806b4d0 0x7fe87806d990 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe8980b6170 tx=0x7fe880009040 comp rx=0 tx=0).stop 2024-04-25T08:53:00.132 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 -- 172.21.15.172:0/592589743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 msgr2=0x7fe8980c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe8980c9bb0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fe88800f7a0 tx=0x7fe88800fc60 comp rx=0 tx=0).stop 2024-04-25T08:53:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 -- 172.21.15.172:0/592589743 shutdown_connections 2024-04-25T08:53:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fe87806b4d0 0x7fe87806d990 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe89815e540 0x7fe89815e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe898157ff0 0x7fe898158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 --2- 172.21.15.172:0/592589743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8840051c0 0x7fe8980c9bb0 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 -- 172.21.15.172:0/592589743 >> 172.21.15.172:0/592589743 conn(0x7fe898061a20 msgr2=0x7fe8980b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:00.133 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 -- 172.21.15.172:0/592589743 shutdown_connections 2024-04-25T08:53:00.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.142+0000 7fe89e0a3640 1 -- 172.21.15.172:0/592589743 wait complete. 2024-04-25T08:53:00.143 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":462,"stamp":"2024-04-25T08:52:58.642422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":426188,"kb_used_data":15720,"kb_used_omap":12,"kb_used_meta":410355,"kb_avail":754548532,"statfs":{"total":773094113280,"available":772657696768,"internally_reserved":0,"allocated":16097280,"data_stored":8138176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":420204080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002480"},"pg_stats":[{"pgid":"1.0","version":"148'119","reported_seq":418,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-04-25T08:52:39.635970+0000","last_change":"2024-04-25T08:52:39.636008+0000","last_active":"2024-04-25T08:52:39.635970+0000","last_peered":"2024-04-25T08:52:39.635970+0000","last_clean":"2024-04-25T08:52:39.635970+0000","last_became_active":"2024-04-25T08:42:17.587281+0000","last_became_peered":"2024-04-25T08:42:17.587281+0000","last_unstale":"2024-04-25T08:52:39.635970+0000","last_undegraded":"2024-04-25T08:52:39.635970+0000","last_fullsized":"2024-04-25T08:52:39.635970+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'119","last_scrub_stamp":"2024-04-25T08:52:39.635877+0000","last_deep_scrub":"148'119","last_deep_scrub_stamp":"2024-04-25T08:52:39.635877+0000","last_clean_scrub_stamp":"2024-04-25T08:52:39.635877+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:51.423446+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574979,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51624,"kb_used_data":2400,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320216,"statfs":{"total":96636764160,"available":96583901184,"internally_reserved":0,"allocated":2457600,"data_stored":1460048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51052,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320788,"statfs":{"total":96636764160,"available":96584486912,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51048,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320792,"statfs":{"total":96636764160,"available":96584491008,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55208,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316632,"statfs":{"total":96636764160,"available":96580231168,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59368,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312472,"statfs":{"total":96636764160,"available":96575971328,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51052,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320788,"statfs":{"total":96636764160,"available":96584486912,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51052,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320788,"statfs":{"total":96636764160,"available":96584486912,"internally_reserved":0,"allocated":1863680,"data_stored":869680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55784,"kb_used_data":2400,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316056,"statfs":{"total":96636764160,"available":96579641344,"internally_reserved":0,"allocated":2457600,"data_stored":1460048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T08:53:00.144 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T08:53:00.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.252+0000 7fd32835c640 1 Processor -- start 2024-04-25T08:53:00.242 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.252+0000 7fd32835c640 1 -- start start 2024-04-25T08:53:00.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd32835c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd320070dc0 0x7fd32006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd32835c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3200711a0 0x7fd3200b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd32835c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3200d1770 con 0x7fd3200b4830 2024-04-25T08:53:00.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd32835c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3201622b0 con 0x7fd3200711a0 2024-04-25T08:53:00.245 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd32835c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3200b10f0 con 0x7fd320070dc0 2024-04-25T08:53:00.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd3258f7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3200711a0 0x7fd3200b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd3258f7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3200711a0 0x7fd3200b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46870/0 (socket says 172.21.15.172:46870) 2024-04-25T08:53:00.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd3258f7640 1 -- 172.21.15.172:0/2846025272 learned_addr learned my addr 172.21.15.172:0/2846025272 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:53:00.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd3260f8640 1 --2- 172.21.15.172:0/2846025272 >> v2:172.21.15.186:3300/0 conn(0x7fd320070dc0 0x7fd32006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd3258f7640 1 -- 172.21.15.172:0/2846025272 >> v2:172.21.15.186:3300/0 conn(0x7fd320070dc0 msgr2=0x7fd32006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T08:53:00.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd3258f7640 1 --2- 172.21.15.172:0/2846025272 >> v2:172.21.15.186:3300/0 conn(0x7fd320070dc0 0x7fd32006ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd3258f7640 1 -- 172.21.15.172:0/2846025272 >> v1:172.21.15.186:6789/0 conn(0x7fd3200b4830 legacy=0x7fd3200b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.253+0000 7fd3258f7640 1 -- 172.21.15.172:0/2846025272 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd320162740 con 0x7fd3200711a0 2024-04-25T08:53:00.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.254+0000 7fd3258f7640 1 --2- 172.21.15.172:0/2846025272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3200711a0 0x7fd3200b07a0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fd320070a00 tx=0x7fd31002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b532a3134cf6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:00.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.254+0000 7fd3250f6640 1 -- 172.21.15.172:0/2846025272 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310037070 con 0x7fd3200711a0 2024-04-25T08:53:00.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.254+0000 7fd3250f6640 1 -- 172.21.15.172:0/2846025272 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd310032440 con 0x7fd3200711a0 2024-04-25T08:53:00.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.254+0000 7fd3250f6640 1 -- 172.21.15.172:0/2846025272 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310032810 con 0x7fd3200711a0 2024-04-25T08:53:00.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.255+0000 7fd32835c640 1 -- 172.21.15.172:0/2846025272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3200711a0 msgr2=0x7fd3200b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.255+0000 7fd32835c640 1 --2- 172.21.15.172:0/2846025272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3200711a0 0x7fd3200b07a0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fd320070a00 tx=0x7fd31002a150 comp rx=0 tx=0).stop 2024-04-25T08:53:00.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.255+0000 7fd32835c640 1 -- 172.21.15.172:0/2846025272 shutdown_connections 2024-04-25T08:53:00.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.255+0000 7fd32835c640 1 --2- 172.21.15.172:0/2846025272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3200711a0 0x7fd3200b07a0 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.255+0000 7fd32835c640 1 --2- 172.21.15.172:0/2846025272 >> v2:172.21.15.186:3300/0 conn(0x7fd320070dc0 0x7fd32006ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.255+0000 7fd32835c640 1 -- 172.21.15.172:0/2846025272 >> 172.21.15.172:0/2846025272 conn(0x7fd3200b3530 msgr2=0x7fd3200b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:00.248 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.255+0000 7fd32835c640 1 -- 172.21.15.172:0/2846025272 shutdown_connections 2024-04-25T08:53:00.249 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.255+0000 7fd32835c640 1 -- 172.21.15.172:0/2846025272 wait complete. 2024-04-25T08:53:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.256+0000 7fd32835c640 1 Processor -- start 2024-04-25T08:53:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.256+0000 7fd32835c640 1 -- start start 2024-04-25T08:53:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd32835c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd320070dc0 0x7fd320152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd32835c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3200711a0 0x7fd3200cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd32835c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3200b4830 0x7fd3200b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd32835c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd320161f40 con 0x7fd320070dc0 2024-04-25T08:53:00.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd32835c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd320161c60 con 0x7fd3200711a0 2024-04-25T08:53:00.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd32835c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd320071630 con 0x7fd3200b4830 2024-04-25T08:53:00.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3260f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd320070dc0 0x7fd320152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3260f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd320070dc0 0x7fd320152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46876/0 (socket says 172.21.15.172:46876) 2024-04-25T08:53:00.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3260f8640 1 -- 172.21.15.172:0/2391344237 learned_addr learned my addr 172.21.15.172:0/2391344237 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:53:00.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3258f7640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3200711a0 0x7fd3200cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3268f9640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3200b4830 0x7fd3200b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3260f8640 1 -- 172.21.15.172:0/2391344237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3200b4830 msgr2=0x7fd3200b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3260f8640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3200b4830 0x7fd3200b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3260f8640 1 -- 172.21.15.172:0/2391344237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3200711a0 msgr2=0x7fd3200cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3260f8640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3200711a0 0x7fd3200cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3260f8640 1 -- 172.21.15.172:0/2391344237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3200ccf00 con 0x7fd320070dc0 2024-04-25T08:53:00.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3258f7640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3200711a0 0x7fd3200cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T08:53:00.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd3260f8640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd320070dc0 0x7fd320152400 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00d800 tx=0x7fd31c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:00.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd316ffd640 1 -- 172.21.15.172:0/2391344237 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00b6c0 con 0x7fd320070dc0 2024-04-25T08:53:00.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd316ffd640 1 -- 172.21.15.172:0/2391344237 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c019070 con 0x7fd320070dc0 2024-04-25T08:53:00.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd316ffd640 1 -- 172.21.15.172:0/2391344237 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00ba80 con 0x7fd320070dc0 2024-04-25T08:53:00.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd32835c640 1 -- 172.21.15.172:0/2391344237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd320152e70 con 0x7fd320070dc0 2024-04-25T08:53:00.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.257+0000 7fd32835c640 1 -- 172.21.15.172:0/2391344237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd320153430 con 0x7fd320070dc0 2024-04-25T08:53:00.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.258+0000 7fd32835c640 1 -- 172.21.15.172:0/2391344237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd320073a00 con 0x7fd320070dc0 2024-04-25T08:53:00.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.259+0000 7fd316ffd640 1 -- 172.21.15.172:0/2391344237 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd31c00bc20 con 0x7fd320070dc0 2024-04-25T08:53:00.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.259+0000 7fd316ffd640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30406b4d0 0x7fd30406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.259+0000 7fd3258f7640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30406b4d0 0x7fd30406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.255 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.259+0000 7fd316ffd640 1 -- 172.21.15.172:0/2391344237 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fd31c08a4b0 con 0x7fd320070dc0 2024-04-25T08:53:00.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.260+0000 7fd3258f7640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30406b4d0 0x7fd30406d990 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd310034000 tx=0x7fd31002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:00.256 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.264+0000 7fd316ffd640 1 -- 172.21.15.172:0/2391344237 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd31c059530 con 0x7fd320070dc0 2024-04-25T08:53:00.425 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.435+0000 7fd32835c640 1 -- 172.21.15.172:0/2391344237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fd3200d0410 con 0x7fd320070dc0 2024-04-25T08:53:00.428 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.438+0000 7fd316ffd640 1 -- 172.21.15.172:0/2391344237 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v28)=0 v28) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd31c058e30 con 0x7fd320070dc0 2024-04-25T08:53:00.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.439+0000 7fd316ffd640 1 -- 172.21.15.172:0/2391344237 <== mon.0 v2:172.21.15.172:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd31c05cf80 con 0x7fd320070dc0 2024-04-25T08:53:00.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 -- 172.21.15.172:0/2391344237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30406b4d0 msgr2=0x7fd30406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.431 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30406b4d0 0x7fd30406d990 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd310034000 tx=0x7fd31002e000 comp rx=0 tx=0).stop 2024-04-25T08:53:00.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 -- 172.21.15.172:0/2391344237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd320070dc0 msgr2=0x7fd320152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd320070dc0 0x7fd320152400 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00d800 tx=0x7fd31c00dcc0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 -- 172.21.15.172:0/2391344237 shutdown_connections 2024-04-25T08:53:00.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7fd30406b4d0 0x7fd30406d990 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3200711a0 0x7fd3200cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3200b4830 0x7fd3200b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 --2- 172.21.15.172:0/2391344237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd320070dc0 0x7fd320152400 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 -- 172.21.15.172:0/2391344237 >> 172.21.15.172:0/2391344237 conn(0x7fd3200b3530 msgr2=0x7fd32006ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:00.432 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 -- 172.21.15.172:0/2391344237 shutdown_connections 2024-04-25T08:53:00.433 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.441+0000 7fd32835c640 1 -- 172.21.15.172:0/2391344237 wait complete. 2024-04-25T08:53:00.443 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T08:53:00.443 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T08:53:00.540 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.550+0000 7f28e6a9e640 1 Processor -- start 2024-04-25T08:53:00.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.550+0000 7f28e6a9e640 1 -- start start 2024-04-25T08:53:00.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28e6a9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f28e00d1dd0 0x7f28e00ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28e6a9e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e015dfe0 con 0x7f28e015dc00 2024-04-25T08:53:00.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28e6a9e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e00d00c0 con 0x7f28e00c6df0 2024-04-25T08:53:00.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28e6a9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e00d03a0 con 0x7f28e00d1dd0 2024-04-25T08:53:00.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28e483a640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f28e015dc00 0x7f28e00ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:43210/0 (socket says 172.21.15.172:43210) 2024-04-25T08:53:00.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28e483a640 1 -- 172.21.15.172:0/1279115564 learned_addr learned my addr 172.21.15.172:0/1279115564 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-25T08:53:00.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28e503b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f28e00d1dd0 0x7f28e00ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28df7fe640 1 -- 172.21.15.172:0/1279115564 <== mon.0 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541164672 0 0) 0x7f28d4001110 con 0x7f28e015dc00 2024-04-25T08:53:00.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28df7fe640 1 -- 172.21.15.172:0/1279115564 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d0003520 con 0x7f28e015dc00 2024-04-25T08:53:00.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28e503b640 1 -- 172.21.15.172:0/1279115564 >> v1:172.21.15.186:6789/0 conn(0x7f28e00c6df0 legacy=0x7f28e00d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28e503b640 1 -- 172.21.15.172:0/1279115564 >> v1:172.21.15.172:6789/0 conn(0x7f28e015dc00 legacy=0x7f28e00ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.543 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.551+0000 7f28e503b640 1 -- 172.21.15.172:0/1279115564 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e00cc440 con 0x7f28e00d1dd0 2024-04-25T08:53:00.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.552+0000 7f28e503b640 1 --2- 172.21.15.172:0/1279115564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e00d1dd0 0x7f28e00ccc40 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009d90 tx=0x7f28d802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e670ea7fe4a6c5dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:00.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.552+0000 7f28df7fe640 1 -- 172.21.15.172:0/1279115564 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8007740 con 0x7f28e00d1dd0 2024-04-25T08:53:00.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.552+0000 7f28df7fe640 1 -- 172.21.15.172:0/1279115564 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f28d80078e0 con 0x7f28e00d1dd0 2024-04-25T08:53:00.544 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.552+0000 7f28df7fe640 1 -- 172.21.15.172:0/1279115564 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8007cd0 con 0x7f28e00d1dd0 2024-04-25T08:53:00.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.553+0000 7f28e6a9e640 1 -- 172.21.15.172:0/1279115564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e00d1dd0 msgr2=0x7f28e00ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.553+0000 7f28e6a9e640 1 --2- 172.21.15.172:0/1279115564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e00d1dd0 0x7f28e00ccc40 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009d90 tx=0x7f28d802a6f0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.553+0000 7f28e6a9e640 1 -- 172.21.15.172:0/1279115564 shutdown_connections 2024-04-25T08:53:00.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.553+0000 7f28e6a9e640 1 --2- 172.21.15.172:0/1279115564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e00d1dd0 0x7f28e00ccc40 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.547 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.553+0000 7f28e6a9e640 1 -- 172.21.15.172:0/1279115564 >> 172.21.15.172:0/1279115564 conn(0x7f28e006f5d0 msgr2=0x7f28e006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:00.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.553+0000 7f28e6a9e640 1 -- 172.21.15.172:0/1279115564 shutdown_connections 2024-04-25T08:53:00.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.553+0000 7f28e6a9e640 1 -- 172.21.15.172:0/1279115564 wait complete. 2024-04-25T08:53:00.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.554+0000 7f28e6a9e640 1 Processor -- start 2024-04-25T08:53:00.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.554+0000 7f28e6a9e640 1 -- start start 2024-04-25T08:53:00.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e6a9e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28e00c6df0 0x7f28e00b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e6a9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28e00d1dd0 0x7f28e00b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e6a9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e015dc00 0x7f28e014b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e6a9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00cfd90 con 0x7f28e015dc00 2024-04-25T08:53:00.548 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e6a9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00cc130 con 0x7f28e00d1dd0 2024-04-25T08:53:00.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e6a9e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00cdd70 con 0x7f28e00c6df0 2024-04-25T08:53:00.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e503b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e015dc00 0x7f28e014b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e503b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e015dc00 0x7f28e014b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:46890/0 (socket says 172.21.15.172:46890) 2024-04-25T08:53:00.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e503b640 1 -- 172.21.15.172:0/2373605791 learned_addr learned my addr 172.21.15.172:0/2373605791 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-25T08:53:00.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e503b640 1 -- 172.21.15.172:0/2373605791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28e00c6df0 msgr2=0x7f28e00b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28dffff640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28e00d1dd0 0x7f28e00b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e483a640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28e00c6df0 0x7f28e00b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.549 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e503b640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28e00c6df0 0x7f28e00b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e503b640 1 -- 172.21.15.172:0/2373605791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28e00d1dd0 msgr2=0x7f28e00b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e503b640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28e00d1dd0 0x7f28e00b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e503b640 1 -- 172.21.15.172:0/2373605791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e00b4a80 con 0x7f28e015dc00 2024-04-25T08:53:00.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28dffff640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28e00d1dd0 0x7f28e00b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:00.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e483a640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28e00c6df0 0x7f28e00b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T08:53:00.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.555+0000 7f28e503b640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e015dc00 0x7f28e014b1b0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009d90 tx=0x7f28d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:00.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.556+0000 7f28dd7fa640 1 -- 172.21.15.172:0/2373605791 <== mon.0 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8040070 con 0x7f28e015dc00 2024-04-25T08:53:00.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.556+0000 7f28dd7fa640 1 -- 172.21.15.172:0/2373605791 <== mon.0 v2:172.21.15.172:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f28d8031bc0 con 0x7f28e015dc00 2024-04-25T08:53:00.550 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.556+0000 7f28dd7fa640 1 -- 172.21.15.172:0/2373605791 <== mon.0 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8045460 con 0x7f28e015dc00 2024-04-25T08:53:00.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.556+0000 7f28e6a9e640 1 -- 172.21.15.172:0/2373605791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e00b4d60 con 0x7f28e015dc00 2024-04-25T08:53:00.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.556+0000 7f28e6a9e640 1 -- 172.21.15.172:0/2373605791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e00b5320 con 0x7f28e015dc00 2024-04-25T08:53:00.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.557+0000 7f28e6a9e640 1 -- 172.21.15.172:0/2373605791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e0158830 con 0x7f28e015dc00 2024-04-25T08:53:00.551 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.557+0000 7f28dd7fa640 1 -- 172.21.15.172:0/2373605791 <== mon.0 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f28d8039040 con 0x7f28e015dc00 2024-04-25T08:53:00.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.557+0000 7f28dd7fa640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28c406b4d0 0x7f28c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T08:53:00.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.557+0000 7f28dd7fa640 1 -- 172.21.15.172:0/2373605791 <== mon.0 v2:172.21.15.172:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f28d80abab0 con 0x7f28e015dc00 2024-04-25T08:53:00.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.558+0000 7f28e483a640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28c406b4d0 0x7f28c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T08:53:00.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.558+0000 7f28e483a640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28c406b4d0 0x7f28c406d990 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f28d40013b0 tx=0x7f28d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T08:53:00.552 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.562+0000 7f28dd7fa640 1 -- 172.21.15.172:0/2373605791 <== mon.0 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28d807aa10 con 0x7f28e015dc00 2024-04-25T08:53:00.761 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.771+0000 7f28e6a9e640 1 -- 172.21.15.172:0/2373605791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28e0073990 con 0x7f28e015dc00 2024-04-25T08:53:00.762 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.771+0000 7f28dd7fa640 1 -- 172.21.15.172:0/2373605791 <== mon.0 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+3710 (secure 0 0 0) 0x7f28d807a310 con 0x7f28e015dc00 2024-04-25T08:53:00.762 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T08:53:00.762 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":90,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7259,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/3226910746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":3226910746},{"type":"v1","addr":"172.21.15.186:6834","nonce":3226910746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8197,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/741856049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":741856049},{"type":"v1","addr":"172.21.15.186:6835","nonce":741856049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":10185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1160697031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1160697031},{"type":"v1","addr":"172.21.15.172:6835","nonce":1160697031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":90},{"gid":10188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/1315698593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":1315698593},{"type":"v1","addr":"172.21.15.172:6837","nonce":1315698593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":90}],"filesystems":[]} 2024-04-25T08:53:00.763 INFO:teuthology.orchestra.run.smithi172.stderr:dumped fsmap epoch 90 2024-04-25T08:53:00.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 -- 172.21.15.172:0/2373605791 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28c406b4d0 msgr2=0x7f28c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28c406b4d0 0x7f28c406d990 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f28d40013b0 tx=0x7f28d4009040 comp rx=0 tx=0).stop 2024-04-25T08:53:00.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 -- 172.21.15.172:0/2373605791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e015dc00 msgr2=0x7f28e014b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T08:53:00.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e015dc00 0x7f28e014b1b0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009d90 tx=0x7f28d8004a40 comp rx=0 tx=0).stop 2024-04-25T08:53:00.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 -- 172.21.15.172:0/2373605791 shutdown_connections 2024-04-25T08:53:00.764 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.172:6832/2190189121,v1:172.21.15.172:6833/2190189121] conn(0x7f28c406b4d0 0x7f28c406d990 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28e00d1dd0 0x7f28e00b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e015dc00 0x7f28e014b1b0 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 --2- 172.21.15.172:0/2373605791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28e00c6df0 0x7f28e00b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T08:53:00.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 -- 172.21.15.172:0/2373605791 >> 172.21.15.172:0/2373605791 conn(0x7f28e006f5d0 msgr2=0x7f28e00c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T08:53:00.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 -- 172.21.15.172:0/2373605791 shutdown_connections 2024-04-25T08:53:00.765 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T08:53:00.773+0000 7f28e6a9e640 1 -- 172.21.15.172:0/2373605791 wait complete. 2024-04-25T08:53:00.775 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T08:53:00.775 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T08:53:00.775 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T08:53:00.775 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:00.784 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T08:53:00.784 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T08:53:00.784 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:00.833 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T08:53:00.834 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T08:53:00.834 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:00.845 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T08:53:00.846 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T08:53:00.846 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:00.897 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T08:53:00.897 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T08:53:00.897 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T08:53:00.897 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:00.932 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T08:53:00.932 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T08:53:00.932 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:00.998 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T08:53:00.998 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T08:53:00.999 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.067 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T08:53:01.067 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T08:53:01.068 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.138 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T08:53:01.139 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T08:53:01.139 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.176 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T08:53:01.177 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T08:53:01.177 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.249 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T08:53:01.249 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T08:53:01.250 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.322 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T08:53:01.323 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T08:53:01.323 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.411 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T08:53:01.411 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T08:53:01.411 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T08:53:01.411 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.437 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T08:53:01.438 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T08:53:01.438 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.465 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T08:53:01.465 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T08:53:01.466 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T08:53:01.466 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.489 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T08:53:01.490 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T08:53:01.490 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.518 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T08:53:01.518 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T08:53:01.519 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T08:53:01.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-25T08:53:01.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-25T08:53:01.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-25T08:53:01.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-25T08:53:01.571 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T08:53:01.571 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T08:53:01.572 DEBUG:teuthology.orchestra.run.smithi172:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-04-25T08:53:01.609 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:53:01.609 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T08:53:01.835 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:53:01.837 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:53:01.900 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:53:01.900 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T08:53:01.990 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:53:01.990 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T08:53:02.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:53:02.083 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T08:53:02.173 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:53:02.173 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T08:53:02.334 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:53:02.334 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T08:53:02.417 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:53:02.418 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T08:53:02.476 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:53:02.476 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T08:53:02.533 INFO:tasks.ceph:Archiving mon data... 2024-04-25T08:53:02.535 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996/data/mon.a.tgz 2024-04-25T08:53:02.537 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-04-25T08:53:02.554 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.8CFmTS1VVq 2024-04-25T08:53:02.555 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8CFmTS1VVq 2024-04-25T08:53:02.715 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.8CFmTS1VVq 2024-04-25T08:53:02.796 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.8CFmTS1VVq is 434KB 2024-04-25T08:53:02.892 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.8CFmTS1VVq 2024-04-25T08:53:02.907 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996/data/mon.b.tgz 2024-04-25T08:53:02.907 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2024-04-25T08:53:02.924 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.sz0pkFCsQQ 2024-04-25T08:53:02.925 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.sz0pkFCsQQ 2024-04-25T08:53:03.088 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.sz0pkFCsQQ 2024-04-25T08:53:03.172 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.sz0pkFCsQQ is 440KB 2024-04-25T08:53:03.268 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.sz0pkFCsQQ 2024-04-25T08:53:03.283 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996/data/mon.c.tgz 2024-04-25T08:53:03.283 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2024-04-25T08:53:03.337 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.SRlL2WF1d5 2024-04-25T08:53:03.338 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.SRlL2WF1d5 2024-04-25T08:53:03.480 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.SRlL2WF1d5 2024-04-25T08:53:03.561 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.SRlL2WF1d5 is 440KB 2024-04-25T08:53:03.659 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.SRlL2WF1d5 2024-04-25T08:53:03.673 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T08:53:03.673 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T08:53:03.676 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T08:53:03.753 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T08:53:03.791 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T08:53:03.791 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T08:53:03.793 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996/remote/smithi172/crash 2024-04-25T08:53:03.793 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T08:53:03.818 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996/remote/smithi186/crash 2024-04-25T08:53:03.819 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T08:53:03.854 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T08:53:03.854 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:53:03.860 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T08:53:03.954 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T08:53:03.978 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T08:53:04.001 INFO:tasks.ceph:Compressing logs... 2024-04-25T08:53:04.001 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T08:53:04.020 DEBUG:teuthology.orchestra.run.smithi186:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T08:53:04.041 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85895.log 2024-04-25T08:53:04.042 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57313.log 2024-04-25T08:53:04.042 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57836.log 2024-04-25T08:53:04.076 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34685.log 2024-04-25T08:53:04.077 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40759.log 2024-04-25T08:53:04.077 INFO:teuthology.orchestra.run.smithi186.stderr:gzip/var/log/ceph/ceph-client.admin.34685.log: -5 --verbose -- /var/log/ceph/ceph-client.3.41152.log 2024-04-25T08:53:04.077 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.1.40759.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T08:53:04.078 INFO:teuthology.orchestra.run.smithi186.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40759.log.gz 2024-04-25T08:53:04.078 INFO:teuthology.orchestra.run.smithi186.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34685.log.gz 2024-04-25T08:53:04.078 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.3.41152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34598.log 2024-04-25T08:53:04.078 INFO:teuthology.orchestra.run.smithi186.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41152.log.gz 2024-04-25T08:53:04.078 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T08:53:04.078 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.34598.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T08:53:04.078 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T08:53:04.079 INFO:teuthology.orchestra.run.smithi186.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34598.log.gz 2024-04-25T08:53:04.079 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T08:53:04.079 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34474.log 2024-04-25T08:53:04.079 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T08:53:04.079 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.34474.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T08:53:04.079 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.4.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34474.log.gz 2024-04-25T08:53:04.079 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T08:53:04.079 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T08:53:04.080 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mon.c.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T08:53:04.080 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34554.log 2024-04-25T08:53:04.080 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.6.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T08:53:04.091 INFO:teuthology.orchestra.run.smithi186.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T08:53:04.091 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40764.log 2024-04-25T08:53:04.091 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.34554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34765.log 2024-04-25T08:53:04.091 INFO:teuthology.orchestra.run.smithi186.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34554.log.gz 2024-04-25T08:53:04.091 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.1.40764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40764.log.gz 2024-04-25T08:53:04.091 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34725.log 2024-04-25T08:53:04.091 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34645.log 2024-04-25T08:53:04.091 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.34765.log: /var/log/ceph/ceph-client.admin.34725.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34765.log.gz 2024-04-25T08:53:04.092 INFO:teuthology.orchestra.run.smithi186.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34725.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.3.41156.log 2024-04-25T08:53:04.092 INFO:teuthology.orchestra.run.smithi186.stderr: 2024-04-25T08:53:04.092 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.34645.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34645.log.gz 2024-04-25T08:53:04.092 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34514.log 2024-04-25T08:53:04.092 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T08:53:04.092 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.34514.log: /var/log/ceph/ceph-client.3.41156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41156.log.gz 2024-04-25T08:53:04.092 INFO:teuthology.orchestra.run.smithi186.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T08:53:04.092 INFO:teuthology.orchestra.run.smithi186.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34514.log.gz 2024-04-25T08:53:04.093 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mds.d.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T08:53:04.277 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94217.log 2024-04-25T08:53:04.278 INFO:teuthology.orchestra.run.smithi172.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85895.log.gz 2024-04-25T08:53:04.278 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57836.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57313.log.gz 2024-04-25T08:53:04.278 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89360.log 2024-04-25T08:53:04.278 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94217.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57836.log.gz 2024-04-25T08:53:04.278 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65574.log 2024-04-25T08:53:04.278 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85512.log 2024-04-25T08:53:04.278 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94217.log.gz 2024-04-25T08:53:04.278 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89360.log.gz 2024-04-25T08:53:04.278 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62068.log 2024-04-25T08:53:04.279 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65574.log.gz 2024-04-25T08:53:04.279 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47115.log 2024-04-25T08:53:04.279 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62068.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.85512.log.gz 2024-04-25T08:53:04.279 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.91044.log 2024-04-25T08:53:04.279 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47115.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62068.log.gz 2024-04-25T08:53:04.279 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61645.log 2024-04-25T08:53:04.279 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91044.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47115.log.gz 2024-04-25T08:53:04.279 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74941.log 2024-04-25T08:53:04.280 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75025.log 2024-04-25T08:53:04.280 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91044.log.gz 2024-04-25T08:53:04.280 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65752.log 2024-04-25T08:53:04.280 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75025.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74941.log.gzgzip 2024-04-25T08:53:04.280 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.61645.log.gz -- 2024-04-25T08:53:04.280 INFO:teuthology.orchestra.run.smithi172.stderr: /var/log/ceph/ceph-client.2.45568.log 2024-04-25T08:53:04.280 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81268.log 2024-04-25T08:53:04.280 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75025.log.gz 2024-04-25T08:53:04.280 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65752.log.gz 2024-04-25T08:53:04.281 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.2.45568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45568.log.gz 2024-04-25T08:53:04.281 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100997.log 2024-04-25T08:53:04.281 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.81268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47787.log 2024-04-25T08:53:04.281 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64276.log 2024-04-25T08:53:04.281 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47787.log: gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.100997.log.gz 2024-04-25T08:53:04.281 INFO:teuthology.orchestra.run.smithi172.stderr: -- /var/log/ceph/ceph-client.admin.43115.log 2024-04-25T08:53:04.281 INFO:teuthology.orchestra.run.smithi172.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.81268.log.gz 2024-04-25T08:53:04.281 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43375.log 2024-04-25T08:53:04.281 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47787.log.gz 2024-04-25T08:53:04.282 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41109.log 2024-04-25T08:53:04.282 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64276.log.gz 2024-04-25T08:53:04.282 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43375.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43115.log.gz 2024-04-25T08:53:04.282 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49149.log 2024-04-25T08:53:04.282 INFO:teuthology.orchestra.run.smithi172.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43375.log.gz 2024-04-25T08:53:04.282 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91899.log 2024-04-25T08:53:04.282 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49149.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41109.log.gz 2024-04-25T08:53:04.282 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94868.log 2024-04-25T08:53:04.282 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91899.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49149.log.gz 2024-04-25T08:53:04.283 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84495.log 2024-04-25T08:53:04.283 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61537.log 2024-04-25T08:53:04.283 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91899.log.gz 2024-04-25T08:53:04.283 INFO:teuthology.orchestra.run.smithi172.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94868.log.gz 2024-04-25T08:53:04.283 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89102.log 2024-04-25T08:53:04.283 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64444.log 2024-04-25T08:53:04.283 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84495.log.gz 2024-04-25T08:53:04.283 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46542.log 2024-04-25T08:53:04.283 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89102.log.gz 2024-04-25T08:53:04.284 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64444.log: gzip -5 --verbose -- 91.1% /var/log/ceph/ceph-client.admin.67699.log -- replaced with /var/log/ceph/ceph-client.admin.61537.log.gz 2024-04-25T08:53:04.284 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.284 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64444.log.gz 2024-04-25T08:53:04.284 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90096.log 2024-04-25T08:53:04.284 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67699.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46542.log.gz 2024-04-25T08:53:04.284 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96513.log 2024-04-25T08:53:04.284 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.90096.log: /var/log/ceph/ceph-client.admin.48033.log 2024-04-25T08:53:04.284 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67699.log.gz 2024-04-25T08:53:04.284 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96513.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90096.log.gz 2024-04-25T08:53:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65616.log 2024-04-25T08:53:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48033.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96513.log.gz 2024-04-25T08:53:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96427.log 2024-04-25T08:53:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65616.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2024-04-25T08:53:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46416.log 2024-04-25T08:53:04.285 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65616.log.gz 2024-04-25T08:53:04.285 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66443.log 2024-04-25T08:53:04.285 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96427.log.gz 2024-04-25T08:53:04.286 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58937.log 2024-04-25T08:53:04.286 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41065.log 2024-04-25T08:53:04.286 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46416.log.gz 2024-04-25T08:53:04.286 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66443.log.gz 2024-04-25T08:53:04.286 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94784.log 2024-04-25T08:53:04.286 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90409.log 2024-04-25T08:53:04.286 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58937.log.gz 2024-04-25T08:53:04.286 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94784.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41065.log.gz 2024-04-25T08:53:04.286 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66664.log 2024-04-25T08:53:04.287 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94784.log.gz 2024-04-25T08:53:04.287 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90409.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90409.log.gz 2024-04-25T08:53:04.287 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49582.log 2024-04-25T08:53:04.287 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67175.log 2024-04-25T08:53:04.287 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3%/var/log/ceph/ceph-client.admin.49582.log: -- replaced with /var/log/ceph/ceph-client.admin.66664.log.gz 2024-04-25T08:53:04.287 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91086.log 2024-04-25T08:53:04.287 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46122.log 2024-04-25T08:53:04.287 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49582.log.gz 2024-04-25T08:53:04.288 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88868.log 2024-04-25T08:53:04.288 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67175.log.gz 2024-04-25T08:53:04.288 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46122.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91086.log.gz 2024-04-25T08:53:04.288 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62404.log 2024-04-25T08:53:04.288 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88868.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46122.log.gz 2024-04-25T08:53:04.288 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99225.log 2024-04-25T08:53:04.288 INFO:teuthology.orchestra.run.smithi172.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.88868.log.gz 2024-04-25T08:53:04.288 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76075.log 2024-04-25T08:53:04.288 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91002.log 2024-04-25T08:53:04.289 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62404.log.gz 2024-04-25T08:53:04.289 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76075.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99225.log.gz 2024-04-25T08:53:04.289 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59795.log 2024-04-25T08:53:04.289 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76075.log.gz 2024-04-25T08:53:04.289 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96825.log 2024-04-25T08:53:04.289 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42617.log 2024-04-25T08:53:04.289 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91002.log.gz 2024-04-25T08:53:04.289 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66401.log 2024-04-25T08:53:04.290 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0%/var/log/ceph/ceph-client.admin.42617.log: -- replaced with /var/log/ceph/ceph-client.admin.59795.log.gz 2024-04-25T08:53:04.290 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93851.log 2024-04-25T08:53:04.290 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96825.log.gz 2024-04-25T08:53:04.290 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42617.log.gz 2024-04-25T08:53:04.290 INFO:teuthology.orchestra.run.smithi172.stderr:gzip/var/log/ceph/ceph-client.admin.66401.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65532.log 2024-04-25T08:53:04.290 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.93851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61603.log 2024-04-25T08:53:04.290 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66401.log.gz 2024-04-25T08:53:04.290 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99742.log 2024-04-25T08:53:04.290 INFO:teuthology.orchestra.run.smithi172.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65532.log.gz 2024-04-25T08:53:04.291 INFO:teuthology.orchestra.run.smithi172.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.93851.log.gz 2024-04-25T08:53:04.291 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63817.log 2024-04-25T08:53:04.291 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99742.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61603.log.gz 2024-04-25T08:53:04.291 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79232.log 2024-04-25T08:53:04.291 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63817.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99742.log.gz 2024-04-25T08:53:04.291 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62758.log 2024-04-25T08:53:04.291 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63817.log.gz 2024-04-25T08:53:04.291 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91833.log 2024-04-25T08:53:04.292 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79232.log.gz 2024-04-25T08:53:04.292 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88658.log 2024-04-25T08:53:04.292 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42701.log 2024-04-25T08:53:04.292 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62758.log.gz 2024-04-25T08:53:04.292 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41507.log 2024-04-25T08:53:04.292 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88658.log.gz 2024-04-25T08:53:04.292 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63225.log 2024-04-25T08:53:04.292 INFO:teuthology.orchestra.run.smithi172.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.91833.log.gz 2024-04-25T08:53:04.293 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41507.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42701.log.gz 2024-04-25T08:53:04.293 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45744.log 2024-04-25T08:53:04.293 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63225.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41507.log.gz 2024-04-25T08:53:04.293 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42433.log 2024-04-25T08:53:04.293 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63225.log.gz 2024-04-25T08:53:04.293 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.45744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85979.log 2024-04-25T08:53:04.293 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45744.log.gz 2024-04-25T08:53:04.293 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48369.log 2024-04-25T08:53:04.293 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99011.log 2024-04-25T08:53:04.294 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42433.log.gz 2024-04-25T08:53:04.294 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85979.log.gz 2024-04-25T08:53:04.294 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80040.log 2024-04-25T08:53:04.294 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44249.log 2024-04-25T08:53:04.294 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48369.log.gz 2024-04-25T08:53:04.294 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89750.log 2024-04-25T08:53:04.294 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99011.log.gz 2024-04-25T08:53:04.294 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80040.log.gz 2024-04-25T08:53:04.295 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96246.log 2024-04-25T08:53:04.295 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89750.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44249.log.gz 2024-04-25T08:53:04.295 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66784.log 2024-04-25T08:53:04.295 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89750.log.gz 2024-04-25T08:53:04.295 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61806.log 2024-04-25T08:53:04.295 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96246.log.gz 2024-04-25T08:53:04.295 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.66784.log: -- /var/log/ceph/ceph-client.admin.75566.log 2024-04-25T08:53:04.295 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66046.log 2024-04-25T08:53:04.295 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66784.log.gz 2024-04-25T08:53:04.296 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41021.log 2024-04-25T08:53:04.296 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61806.log.gz 2024-04-25T08:53:04.296 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75566.log.gz 2024-04-25T08:53:04.296 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59231.log 2024-04-25T08:53:04.296 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41021.log: gzip 89.6% -- replaced with /var/log/ceph/ceph-client.admin.66046.log.gz -5 2024-04-25T08:53:04.296 INFO:teuthology.orchestra.run.smithi172.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63141.log 2024-04-25T08:53:04.296 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59231.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41021.log.gz 2024-04-25T08:53:04.296 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59488.log 2024-04-25T08:53:04.296 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40499.log 2024-04-25T08:53:04.297 INFO:teuthology.orchestra.run.smithi172.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59231.log.gz 2024-04-25T08:53:04.297 INFO:teuthology.orchestra.run.smithi172.stderr:gzip/var/log/ceph/ceph-client.0.59488.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46836.log 2024-04-25T08:53:04.297 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63141.log.gz 2024-04-25T08:53:04.297 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59488.log.gz 2024-04-25T08:53:04.297 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.40499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60169.log 2024-04-25T08:53:04.297 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63523.log 2024-04-25T08:53:04.297 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40499.log.gz 2024-04-25T08:53:04.297 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60169.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2024-04-25T08:53:04.297 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62362.log 2024-04-25T08:53:04.298 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60169.log.gz 2024-04-25T08:53:04.298 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99784.log 2024-04-25T08:53:04.298 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64360.log 2024-04-25T08:53:04.298 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63523.log.gz 2024-04-25T08:53:04.298 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99784.log: gzip 88.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.62362.log.gz -- 2024-04-25T08:53:04.298 INFO:teuthology.orchestra.run.smithi172.stderr: /var/log/ceph/ceph-client.admin.67038.log 2024-04-25T08:53:04.298 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64360.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99784.log.gz 2024-04-25T08:53:04.298 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89402.log 2024-04-25T08:53:04.298 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67038.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64360.log.gz 2024-04-25T08:53:04.299 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59687.log 2024-04-25T08:53:04.299 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41255.log 2024-04-25T08:53:04.299 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67038.log.gz 2024-04-25T08:53:04.299 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59687.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.89402.log.gz 2024-04-25T08:53:04.299 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76033.log 2024-04-25T08:53:04.299 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76117.log 2024-04-25T08:53:04.299 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41255.log: /var/log/ceph/ceph-client.admin.76033.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59687.log.gz 2024-04-25T08:53:04.299 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60094.log 2024-04-25T08:53:04.300 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41255.log.gz 2024-04-25T08:53:04.300 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76033.log.gz 2024-04-25T08:53:04.300 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58685.log 2024-04-25T08:53:04.300 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45128.log 2024-04-25T08:53:04.300 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76117.log.gz 2024-04-25T08:53:04.300 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95298.log 2024-04-25T08:53:04.300 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60094.log.gz 2024-04-25T08:53:04.300 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58685.log.gz 2024-04-25T08:53:04.300 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.45128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94343.log 2024-04-25T08:53:04.301 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45128.log.gz 2024-04-25T08:53:04.301 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61236.log 2024-04-25T08:53:04.301 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95298.log.gz 2024-04-25T08:53:04.301 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46794.log 2024-04-25T08:53:04.301 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65490.log 2024-04-25T08:53:04.301 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94343.log.gz 2024-04-25T08:53:04.301 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47865.log 2024-04-25T08:53:04.301 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46794.log.gz 2024-04-25T08:53:04.302 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89582.log 2024-04-25T08:53:04.302 INFO:teuthology.orchestra.run.smithi172.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.61236.log.gz 2024-04-25T08:53:04.302 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79064.log 2024-04-25T08:53:04.302 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65490.log.gz 2024-04-25T08:53:04.302 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47865.log.gz 2024-04-25T08:53:04.302 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41423.log 2024-04-25T08:53:04.302 INFO:teuthology.orchestra.run.smithi172.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89582.log.gz 2024-04-25T08:53:04.302 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59297.log 2024-04-25T08:53:04.302 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2024-04-25T08:53:04.303 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.79064.log.gz 2024-04-25T08:53:04.303 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59297.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41423.log.gz -5 2024-04-25T08:53:04.303 INFO:teuthology.orchestra.run.smithi172.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43379.log 2024-04-25T08:53:04.303 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47907.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59297.log.gz 2024-04-25T08:53:04.303 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58727.log 2024-04-25T08:53:04.303 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43379.log: gzip -5 89.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2024-04-25T08:53:04.303 INFO:teuthology.orchestra.run.smithi172.stderr: /var/log/ceph/ceph-client.admin.91267.log 2024-04-25T08:53:04.303 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58727.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43379.log.gz 2024-04-25T08:53:04.304 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76585.log 2024-04-25T08:53:04.304 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58727.log.gz 2024-04-25T08:53:04.304 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91267.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T08:53:04.304 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95653.log 2024-04-25T08:53:04.304 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91267.log.gz 2024-04-25T08:53:04.304 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76585.log.gz 2024-04-25T08:53:04.304 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41297.log 2024-04-25T08:53:04.304 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90138.log 2024-04-25T08:53:04.304 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41297.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95653.log.gz 2024-04-25T08:53:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63439.log 2024-04-25T08:53:04.305 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41297.log.gz 2024-04-25T08:53:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100619.log 2024-04-25T08:53:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63439.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90138.log.gz 2024-04-25T08:53:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58046.log 2024-04-25T08:53:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100619.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63439.log.gz 2024-04-25T08:53:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90619.log 2024-04-25T08:53:04.305 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100619.log.gz 2024-04-25T08:53:04.305 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83760.log 2024-04-25T08:53:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90619.log: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T08:53:04.306 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58046.log.gz 2024-04-25T08:53:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75369.log 2024-04-25T08:53:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58429.log 2024-04-25T08:53:04.306 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90619.log.gz 2024-04-25T08:53:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75369.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.83760.log.gz 2024-04-25T08:53:04.306 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63565.log 2024-04-25T08:53:04.306 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75369.log.gz 2024-04-25T08:53:04.307 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58769.log 2024-04-25T08:53:04.307 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58471.log 2024-04-25T08:53:04.307 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58429.log.gz 2024-04-25T08:53:04.307 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58769.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63565.log.gz 2024-04-25T08:53:04.307 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63775.log 2024-04-25T08:53:04.307 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58769.log.gz 2024-04-25T08:53:04.307 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89928.log 2024-04-25T08:53:04.307 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95382.log 2024-04-25T08:53:04.307 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58471.log.gz 2024-04-25T08:53:04.308 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63775.log.gz 2024-04-25T08:53:04.308 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80382.log 2024-04-25T08:53:04.308 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89928.log.gz 2024-04-25T08:53:04.308 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49794.log 2024-04-25T08:53:04.308 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59903.log 2024-04-25T08:53:04.308 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95382.log.gz 2024-04-25T08:53:04.308 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66359.log 2024-04-25T08:53:04.308 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80382.log.gz 2024-04-25T08:53:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44291.log 2024-04-25T08:53:04.309 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49794.log.gz 2024-04-25T08:53:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99573.log 2024-04-25T08:53:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44291.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66359.log.gzgzip 2024-04-25T08:53:04.309 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59105.log 2024-04-25T08:53:04.309 INFO:teuthology.orchestra.run.smithi172.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.59903.log.gz 2024-04-25T08:53:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99573.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44291.log.gz 2024-04-25T08:53:04.309 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58004.log 2024-04-25T08:53:04.309 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99573.log.gz 2024-04-25T08:53:04.310 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76204.log 2024-04-25T08:53:04.310 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96057.log 2024-04-25T08:53:04.310 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59105.log.gz 2024-04-25T08:53:04.310 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76204.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T08:53:04.310 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58004.log.gz 2024-04-25T08:53:04.310 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96057.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76204.log.gz 2024-04-25T08:53:04.310 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75235.log 2024-04-25T08:53:04.310 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.2.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.96057.log.gz -5 2024-04-25T08:53:04.310 INFO:teuthology.orchestra.run.smithi172.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49064.log 2024-04-25T08:53:04.311 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57009.log 2024-04-25T08:53:04.311 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75235.log.gz 2024-04-25T08:53:04.311 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100745.log 2024-04-25T08:53:04.311 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57009.log: gzip 88.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.49064.log.gz 2024-04-25T08:53:04.311 INFO:teuthology.orchestra.run.smithi172.stderr: -- /var/log/ceph/ceph-client.admin.65051.log 2024-04-25T08:53:04.311 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43374.log 2024-04-25T08:53:04.311 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57009.log.gz 2024-04-25T08:53:04.311 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65051.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100745.log.gz 2024-04-25T08:53:04.311 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95130.log 2024-04-25T08:53:04.312 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65051.log.gz 2024-04-25T08:53:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58088.log 2024-04-25T08:53:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95130.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43374.log.gz 2024-04-25T08:53:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46668.log 2024-04-25T08:53:04.312 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95130.log.gz 2024-04-25T08:53:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99064.log 2024-04-25T08:53:04.312 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46668.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.58088.log.gz -5 2024-04-25T08:53:04.312 INFO:teuthology.orchestra.run.smithi172.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42031.log 2024-04-25T08:53:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62320.log 2024-04-25T08:53:04.313 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46668.log.gz 2024-04-25T08:53:04.313 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99064.log.gz 2024-04-25T08:53:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99910.log 2024-04-25T08:53:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75524.log 2024-04-25T08:53:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99910.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62320.log.gz 2024-04-25T08:53:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101207.log 2024-04-25T08:53:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66130.log 2024-04-25T08:53:04.313 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75524.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99910.log.gz 2024-04-25T08:53:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.101207.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75524.log.gz 2024-04-25T08:53:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49668.log 2024-04-25T08:53:04.314 INFO:teuthology.orchestra.run.smithi172.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.42031.log.gz 2024-04-25T08:53:04.314 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101207.log.gz 2024-04-25T08:53:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60331.log 2024-04-25T08:53:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66130.log: /var/log/ceph/ceph-client.admin.49668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63649.log 2024-04-25T08:53:04.314 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66130.log.gz 2024-04-25T08:53:04.314 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49668.log.gz 2024-04-25T08:53:04.314 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40768.log 2024-04-25T08:53:04.315 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68075.log 2024-04-25T08:53:04.315 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.40768.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63649.log.gz 2024-04-25T08:53:04.315 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75482.log 2024-04-25T08:53:04.315 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60331.log.gz 2024-04-25T08:53:04.315 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40768.log.gz 2024-04-25T08:53:04.315 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90012.log 2024-04-25T08:53:04.315 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.68075.log: /var/log/ceph/ceph-client.admin.75482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58183.log 2024-04-25T08:53:04.315 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68075.log.gz 2024-04-25T08:53:04.316 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75482.log.gz 2024-04-25T08:53:04.316 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43157.log 2024-04-25T08:53:04.316 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100829.log 2024-04-25T08:53:04.316 INFO:teuthology.orchestra.run.smithi172.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.90012.log.gz 2024-04-25T08:53:04.316 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58183.log.gz 2024-04-25T08:53:04.316 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42989.log 2024-04-25T08:53:04.316 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8%/var/log/ceph/ceph-client.admin.100829.log: -- replaced with /var/log/ceph/ceph-client.admin.43157.log.gz 2024-04-25T08:53:04.316 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66088.log 2024-04-25T08:53:04.316 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42989.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100829.log.gzgzip 2024-04-25T08:53:04.317 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.2.45572.log 2024-04-25T08:53:04.317 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42989.log.gz 2024-04-25T08:53:04.317 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46500.log 2024-04-25T08:53:04.317 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.2.45572.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66088.log.gz 2024-04-25T08:53:04.317 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91479.log 2024-04-25T08:53:04.317 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45572.log.gz 2024-04-25T08:53:04.317 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57481.log 2024-04-25T08:53:04.317 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46500.log.gz 2024-04-25T08:53:04.317 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80764.log 2024-04-25T08:53:04.318 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57481.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91479.log.gz -5 2024-04-25T08:53:04.318 INFO:teuthology.orchestra.run.smithi172.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47403.log 2024-04-25T08:53:04.318 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80764.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57481.log.gz 2024-04-25T08:53:04.318 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100535.log 2024-04-25T08:53:04.318 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80764.log.gz 2024-04-25T08:53:04.318 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90960.log 2024-04-25T08:53:04.318 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47403.log.gz 2024-04-25T08:53:04.318 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79662.log 2024-04-25T08:53:04.319 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90960.log: gzip 87.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.100535.log.gz -- 2024-04-25T08:53:04.319 INFO:teuthology.orchestra.run.smithi172.stderr: /var/log/ceph/ceph-client.admin.99394.log 2024-04-25T08:53:04.319 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79662.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.90960.log.gz 2024-04-25T08:53:04.319 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43703.log 2024-04-25T08:53:04.319 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.79662.log.gz 2024-04-25T08:53:04.319 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84663.log 2024-04-25T08:53:04.319 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43703.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T08:53:04.319 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99394.log.gz 2024-04-25T08:53:04.319 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1%/var/log/ceph/ceph-client.admin.84663.log: -- replaced with /var/log/ceph/ceph-client.admin.43703.log.gz 2024-04-25T08:53:04.320 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67741.log 2024-04-25T08:53:04.320 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84663.log.gz 2024-04-25T08:53:04.320 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50004.log 2024-04-25T08:53:04.320 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97101.log 2024-04-25T08:53:04.320 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.50004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91225.log 2024-04-25T08:53:04.320 INFO:teuthology.orchestra.run.smithi172.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.67741.log.gz 2024-04-25T08:53:04.320 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.97101.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.50004.log.gz --verbose 2024-04-25T08:53:04.320 INFO:teuthology.orchestra.run.smithi172.stderr: -- /var/log/ceph/ceph-client.admin.47991.log 2024-04-25T08:53:04.320 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91225.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.97101.log.gz 2024-04-25T08:53:04.321 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63309.log 2024-04-25T08:53:04.321 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91225.log.gz 2024-04-25T08:53:04.321 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99700.log 2024-04-25T08:53:04.321 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47991.log: /var/log/ceph/ceph-client.admin.63309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43997.log 2024-04-25T08:53:04.321 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47991.log.gz 2024-04-25T08:53:04.321 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99700.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63309.log.gz 2024-04-25T08:53:04.321 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47199.log 2024-04-25T08:53:04.321 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99700.log.gz 2024-04-25T08:53:04.322 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64657.log 2024-04-25T08:53:04.322 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80424.log 2024-04-25T08:53:04.322 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43997.log.gz 2024-04-25T08:53:04.322 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47199.log: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T08:53:04.322 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91353.log 2024-04-25T08:53:04.322 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47199.log.gz 2024-04-25T08:53:04.322 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80424.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64657.log.gz 2024-04-25T08:53:04.322 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44081.log 2024-04-25T08:53:04.323 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91353.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80424.log.gz 2024-04-25T08:53:04.323 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47619.log 2024-04-25T08:53:04.323 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91353.log.gz 2024-04-25T08:53:04.323 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76543.log 2024-04-25T08:53:04.323 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66994.log 2024-04-25T08:53:04.323 INFO:teuthology.orchestra.run.smithi172.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44081.log.gz 2024-04-25T08:53:04.323 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47619.log.gz 2024-04-25T08:53:04.323 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80082.log 2024-04-25T08:53:04.323 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76543.log.gz 2024-04-25T08:53:04.324 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101039.log 2024-04-25T08:53:04.324 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61471.log 2024-04-25T08:53:04.324 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66994.log.gz 2024-04-25T08:53:04.324 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80082.log.gz 2024-04-25T08:53:04.324 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.101039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64943.log 2024-04-25T08:53:04.324 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101039.log.gz 2024-04-25T08:53:04.324 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58601.log 2024-04-25T08:53:04.324 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80220.log 2024-04-25T08:53:04.324 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64943.log.gz 2024-04-25T08:53:04.325 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58601.log: 91.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.61471.log.gz -5 2024-04-25T08:53:04.325 INFO:teuthology.orchestra.run.smithi172.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67615.log 2024-04-25T08:53:04.325 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101123.log 2024-04-25T08:53:04.325 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80220.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58601.log.gz 2024-04-25T08:53:04.325 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74368.log 2024-04-25T08:53:04.325 INFO:teuthology.orchestra.run.smithi172.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.80220.log.gz 2024-04-25T08:53:04.325 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.101123.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67615.log.gz 2024-04-25T08:53:04.325 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85346.log 2024-04-25T08:53:04.325 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74368.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101123.log.gz 2024-04-25T08:53:04.326 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88700.log 2024-04-25T08:53:04.326 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91130.log 2024-04-25T08:53:04.326 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88700.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85346.log.gz 2024-04-25T08:53:04.326 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 91.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.74368.log.gz 2024-04-25T08:53:04.326 INFO:teuthology.orchestra.run.smithi172.stderr: /var/log/ceph/ceph-client.admin.62979.log 2024-04-25T08:53:04.326 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88700.log.gz 2024-04-25T08:53:04.326 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61019.log 2024-04-25T08:53:04.326 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62979.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91130.log.gz 2024-04-25T08:53:04.326 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94091.log 2024-04-25T08:53:04.327 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61019.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62979.log.gz 2024-04-25T08:53:04.327 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80594.log 2024-04-25T08:53:04.327 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66527.log 2024-04-25T08:53:04.327 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80594.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94091.log.gz 2024-04-25T08:53:04.327 INFO:teuthology.orchestra.run.smithi172.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61019.log.gz 2024-04-25T08:53:04.327 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47577.log 2024-04-25T08:53:04.327 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80594.log.gz 2024-04-25T08:53:04.327 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89844.log 2024-04-25T08:53:04.327 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66527.log.gz 2024-04-25T08:53:04.328 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100703.log 2024-04-25T08:53:04.328 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89844.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47577.log.gz 2024-04-25T08:53:04.328 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64112.log 2024-04-25T08:53:04.328 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89844.log.gz 2024-04-25T08:53:04.328 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63397.log 2024-04-25T08:53:04.328 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1%/var/log/ceph/ceph-client.0.64112.log: -- replaced with /var/log/ceph/ceph-client.admin.100703.log.gz 2024-04-25T08:53:04.328 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59021.log 2024-04-25T08:53:04.328 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64112.log.gz 2024-04-25T08:53:04.328 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60953.log 2024-04-25T08:53:04.329 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63397.log.gz 2024-04-25T08:53:04.329 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67363.log 2024-04-25T08:53:04.329 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59021.log.gz 2024-04-25T08:53:04.329 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66232.log 2024-04-25T08:53:04.329 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92086.log 2024-04-25T08:53:04.329 INFO:teuthology.orchestra.run.smithi172.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.67363.log.gz 2024-04-25T08:53:04.329 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66232.log: gzip -5 91.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.60953.log.gz /var/log/ceph/ceph-client.admin.74899.log 2024-04-25T08:53:04.329 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.329 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63925.log 2024-04-25T08:53:04.330 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.92086.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66232.log.gz 2024-04-25T08:53:04.330 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.92086.log.gz 2024-04-25T08:53:04.330 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48327.log 2024-04-25T08:53:04.330 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95518.log 2024-04-25T08:53:04.330 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74899.log.gz 2024-04-25T08:53:04.330 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48327.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63925.log.gzgzip 2024-04-25T08:53:04.330 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49962.log 2024-04-25T08:53:04.330 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95518.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48327.log.gz 2024-04-25T08:53:04.331 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94689.log 2024-04-25T08:53:04.331 INFO:teuthology.orchestra.run.smithi172.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95518.log.gz 2024-04-25T08:53:04.331 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67082.log 2024-04-25T08:53:04.331 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94689.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49962.log.gz 2024-04-25T08:53:04.331 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48495.log 2024-04-25T08:53:04.331 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67082.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94689.log.gz 2024-04-25T08:53:04.331 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76417.log 2024-04-25T08:53:04.331 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67082.log.gz 2024-04-25T08:53:04.331 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46878.log 2024-04-25T08:53:04.332 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76417.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48495.log.gz 2024-04-25T08:53:04.332 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81058.log 2024-04-25T08:53:04.332 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76417.log.gz 2024-04-25T08:53:04.332 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57051.log 2024-04-25T08:53:04.332 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46878.log.gz 2024-04-25T08:53:04.332 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.81058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43378.log 2024-04-25T08:53:04.332 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57051.log: gzip -5 --verbose 88.9% -- /var/log/ceph/ceph-client.admin.83220.log -- replaced with /var/log/ceph/ceph-client.admin.81058.log.gz 2024-04-25T08:53:04.332 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.332 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43378.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57051.log.gz 2024-04-25T08:53:04.333 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59484.log 2024-04-25T08:53:04.333 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43378.log.gz 2024-04-25T08:53:04.333 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83220.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T08:53:04.333 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.59484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58979.log 2024-04-25T08:53:04.333 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59484.log.gz 2024-04-25T08:53:04.333 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44375.log 2024-04-25T08:53:04.333 INFO:teuthology.orchestra.run.smithi172.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.83220.log.gz 2024-04-25T08:53:04.333 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90451.log 2024-04-25T08:53:04.334 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44375.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58979.log.gz 2024-04-25T08:53:04.334 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43707.log 2024-04-25T08:53:04.334 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44375.log.gz 2024-04-25T08:53:04.334 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67531.log 2024-04-25T08:53:04.334 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90451.log.gz 2024-04-25T08:53:04.334 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42821.log 2024-04-25T08:53:04.334 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43707.log: /var/log/ceph/ceph-client.admin.67531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41615.log 2024-04-25T08:53:04.334 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43707.log.gz 2024-04-25T08:53:04.334 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42821.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67531.log.gz 2024-04-25T08:53:04.335 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66172.log 2024-04-25T08:53:04.335 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42821.log.gz 2024-04-25T08:53:04.335 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.41615.log: /var/log/ceph/ceph-client.admin.64899.log 2024-04-25T08:53:04.335 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57794.log 2024-04-25T08:53:04.335 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41615.log.gz 2024-04-25T08:53:04.335 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66172.log.gz 2024-04-25T08:53:04.335 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85767.log 2024-04-25T08:53:04.335 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94489.log 2024-04-25T08:53:04.335 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64899.log.gz 2024-04-25T08:53:04.336 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57794.log: /var/log/ceph/ceph-client.admin.85767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88784.log 2024-04-25T08:53:04.336 INFO:teuthology.orchestra.run.smithi172.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57794.log.gz 2024-04-25T08:53:04.336 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.85767.log.gz 2024-04-25T08:53:04.336 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99868.log 2024-04-25T08:53:04.336 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94489.log: /var/log/ceph/ceph-client.admin.88784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79494.log 2024-04-25T08:53:04.336 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94489.log.gz 2024-04-25T08:53:04.336 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88784.log.gz 2024-04-25T08:53:04.336 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95569.log 2024-04-25T08:53:04.336 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41381.log 2024-04-25T08:53:04.337 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79494.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99868.log.gz 2024-04-25T08:53:04.337 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95569.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79494.log.gz 2024-04-25T08:53:04.337 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42905.log 2024-04-25T08:53:04.337 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95569.log.gz 2024-04-25T08:53:04.337 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86189.log 2024-04-25T08:53:04.337 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41381.log: /var/log/ceph/ceph-client.admin.42905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90054.log 2024-04-25T08:53:04.337 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41381.log.gz 2024-04-25T08:53:04.337 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.86189.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42905.log.gz 2024-04-25T08:53:04.338 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44585.log 2024-04-25T08:53:04.338 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90054.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.86189.log.gz 2024-04-25T08:53:04.338 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94826.log 2024-04-25T08:53:04.338 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.90054.log.gz 2024-04-25T08:53:04.338 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67217.log 2024-04-25T08:53:04.338 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44585.log: /var/log/ceph/ceph-client.admin.94826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44333.log 2024-04-25T08:53:04.338 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44585.log.gz 2024-04-25T08:53:04.338 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67217.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94826.log.gz 2024-04-25T08:53:04.338 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91731.log 2024-04-25T08:53:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74452.log 2024-04-25T08:53:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44333.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67217.log.gz 2024-04-25T08:53:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91731.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44333.log.gz 2024-04-25T08:53:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66275.log 2024-04-25T08:53:04.339 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91731.log.gz 2024-04-25T08:53:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61283.log 2024-04-25T08:53:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74452.log: /var/log/ceph/ceph-client.admin.66275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61339.log 2024-04-25T08:53:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61283.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66275.log.gz 2024-04-25T08:53:04.339 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90577.log 2024-04-25T08:53:04.340 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0%/var/log/ceph/ceph-client.admin.61339.log: -- replaced with /var/log/ceph/ceph-client.admin.74452.log.gz 2024-04-25T08:53:04.340 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61283.log.gz 2024-04-25T08:53:04.340 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75109.log 2024-04-25T08:53:04.340 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49710.log 2024-04-25T08:53:04.340 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.90577.log.gz 2024-04-25T08:53:04.340 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49626.log 90.9% 2024-04-25T08:53:04.340 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61339.log.gz 2024-04-25T08:53:04.340 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.75109.log.gz 2024-04-25T08:53:04.340 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.88424.log 2024-04-25T08:53:04.341 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49710.log: /var/log/ceph/ceph-client.admin.49626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50088.log 2024-04-25T08:53:04.341 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49710.log.gz 2024-04-25T08:53:04.341 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88424.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49626.log.gz 2024-04-25T08:53:04.341 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91689.log 2024-04-25T08:53:04.341 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96332.log 2024-04-25T08:53:04.341 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.50088.log: /var/log/ceph/ceph-client.admin.91689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43380.log 2024-04-25T08:53:04.341 INFO:teuthology.orchestra.run.smithi172.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.88424.log.gz 2024-04-25T08:53:04.341 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96332.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91689.log.gz 2024-04-25T08:53:04.341 INFO:teuthology.orchestra.run.smithi172.stderr:gzip 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50088.log.gz 2024-04-25T08:53:04.342 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47703.log 2024-04-25T08:53:04.342 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43380.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96332.log.gz 2024-04-25T08:53:04.342 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94952.log 2024-04-25T08:53:04.342 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100074.log 2024-04-25T08:53:04.342 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43380.log.gz 2024-04-25T08:53:04.342 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47703.log.gz 2024-04-25T08:53:04.342 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57565.log 2024-04-25T08:53:04.342 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100074.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.94952.log.gz 2024-04-25T08:53:04.342 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T08:53:04.343 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100074.log.gz 2024-04-25T08:53:04.343 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60821.log 2024-04-25T08:53:04.343 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49191.log 2024-04-25T08:53:04.343 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mds.c.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57565.log.gz 2024-04-25T08:53:04.343 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59063.log 2024-04-25T08:53:04.343 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79578.log 2024-04-25T08:53:04.343 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60821.log.gz/var/log/ceph/ceph-client.admin.59063.log: 2024-04-25T08:53:04.343 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85937.log 2024-04-25T08:53:04.344 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49191.log.gz 2024-04-25T08:53:04.344 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79578.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.59063.log.gz 2024-04-25T08:53:04.344 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.79368.log 2024-04-25T08:53:04.344 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79578.log.gz 2024-04-25T08:53:04.344 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58263.log 2024-04-25T08:53:04.344 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79368.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.98969.log 2024-04-25T08:53:04.344 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85937.log.gz 2024-04-25T08:53:04.344 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58263.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79368.log.gz 2024-04-25T08:53:04.344 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78645.log 2024-04-25T08:53:04.345 INFO:teuthology.orchestra.run.smithi172.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58263.log.gz 2024-04-25T08:53:04.345 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.98969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58895.log 2024-04-25T08:53:04.345 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99826.log 2024-04-25T08:53:04.345 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.78645.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98969.log.gz 2024-04-25T08:53:04.345 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64521.log 2024-04-25T08:53:04.345 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58895.log.gz 2024-04-25T08:53:04.345 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95863.log 2024-04-25T08:53:04.345 INFO:teuthology.orchestra.run.smithi172.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.78645.log.gz 2024-04-25T08:53:04.345 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64521.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99826.log.gz 2024-04-25T08:53:04.346 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90264.log 2024-04-25T08:53:04.346 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64521.log.gz 2024-04-25T08:53:04.346 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65794.log 2024-04-25T08:53:04.346 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95863.log.gz 2024-04-25T08:53:04.346 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48411.log 2024-04-25T08:53:04.346 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48159.log 2024-04-25T08:53:04.346 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65794.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90264.log.gz 2024-04-25T08:53:04.346 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2024-04-25T08:53:04.347 INFO:teuthology.orchestra.run.smithi172.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65794.log.gz 2024-04-25T08:53:04.347 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3%/var/log/ceph/ceph-client.admin.48159.log: -- replaced with /var/log/ceph/ceph-client.admin.48411.log.gz 2024-04-25T08:53:04.347 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2024-04-25T08:53:04.347 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48159.log.gz 2024-04-25T08:53:04.347 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42491.log 2024-04-25T08:53:04.347 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86615.log 2024-04-25T08:53:04.347 INFO:teuthology.orchestra.run.smithi172.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz 2024-04-25T08:53:04.347 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42491.log: gzip -5 89.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2024-04-25T08:53:04.347 INFO:teuthology.orchestra.run.smithi172.stderr: /var/log/ceph/ceph-client.admin.66317.log 2024-04-25T08:53:04.348 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42491.log.gz 2024-04-25T08:53:04.348 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.86615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57691.log 2024-04-25T08:53:04.348 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.86615.log.gz 2024-04-25T08:53:04.348 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59861.log 2024-04-25T08:53:04.348 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66317.log: /var/log/ceph/ceph-client.admin.57691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46080.log 2024-04-25T08:53:04.348 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66317.log.gz 2024-04-25T08:53:04.348 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57691.log.gz 2024-04-25T08:53:04.348 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78777.log 2024-04-25T08:53:04.349 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88292.log 2024-04-25T08:53:04.349 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6%/var/log/ceph/ceph-client.admin.46080.log: -- replaced with /var/log/ceph/ceph-client.admin.59861.log.gz 2024-04-25T08:53:04.349 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.78777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47949.log 2024-04-25T08:53:04.349 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46080.log.gz 2024-04-25T08:53:04.349 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91521.log 2024-04-25T08:53:04.349 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47949.log: gzip -5 --verbose -- 91.2% -- replaced with /var/log/ceph/ceph-client.admin.78777.log.gz 2024-04-25T08:53:04.349 INFO:teuthology.orchestra.run.smithi172.stderr: /var/log/ceph/ceph-client.admin.49752.log 2024-04-25T08:53:04.349 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91521.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47949.log.gz 2024-04-25T08:53:04.349 INFO:teuthology.orchestra.run.smithi172.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.88292.log.gz 2024-04-25T08:53:04.350 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T08:53:04.350 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91521.log.gz 2024-04-25T08:53:04.350 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86357.log 2024-04-25T08:53:04.350 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49752.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74763.log 2024-04-25T08:53:04.350 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49752.log.gz 2024-04-25T08:53:04.350 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.86357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47361.log 2024-04-25T08:53:04.350 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74763.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T08:53:04.350 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85045.log 2024-04-25T08:53:04.351 INFO:teuthology.orchestra.run.smithi172.stderr: 90.9% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74763.log.gz 2024-04-25T08:53:04.351 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86357.log.gz 2024-04-25T08:53:04.351 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44543.log 2024-04-25T08:53:04.351 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47361.log.gz 2024-04-25T08:53:04.351 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65336.log 2024-04-25T08:53:04.351 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44543.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.85045.log.gz 2024-04-25T08:53:04.351 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.88616.log 2024-04-25T08:53:04.351 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63733.log 2024-04-25T08:53:04.351 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44543.log.gz 2024-04-25T08:53:04.352 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88616.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88616.log.gz 2024-04-25T08:53:04.352 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65336.log.gz 2024-04-25T08:53:04.352 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60228.log 2024-04-25T08:53:04.352 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42947.log 2024-04-25T08:53:04.352 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60228.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63733.log.gz 2024-04-25T08:53:04.352 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41465.log 2024-04-25T08:53:04.352 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42947.log: -- /var/log/ceph/ceph-client.admin.89666.log 2024-04-25T08:53:04.352 INFO:teuthology.orchestra.run.smithi172.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60228.log.gz 2024-04-25T08:53:04.352 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42947.log.gz 2024-04-25T08:53:04.353 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79746.log 2024-04-25T08:53:04.353 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89666.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41465.log.gz 2024-04-25T08:53:04.353 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63183.log 2024-04-25T08:53:04.353 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.89666.log.gz 2024-04-25T08:53:04.353 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63607.log 2024-04-25T08:53:04.353 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79746.log.gz 2024-04-25T08:53:04.353 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79704.log 2024-04-25T08:53:04.353 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63183.log.gz 2024-04-25T08:53:04.354 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75692.log 2024-04-25T08:53:04.354 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63607.log: /var/log/ceph/ceph-client.admin.79704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80848.log 2024-04-25T08:53:04.354 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75692.log: 88.2% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63607.log.gz 2024-04-25T08:53:04.354 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79704.log.gz 2024-04-25T08:53:04.354 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75692.log.gz 2024-04-25T08:53:04.354 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86231.log 2024-04-25T08:53:04.354 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62110.log 2024-04-25T08:53:04.354 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80848.log: /var/log/ceph/ceph-client.admin.86231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95214.log 2024-04-25T08:53:04.354 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62110.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80848.log.gz 2024-04-25T08:53:04.355 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.86231.log.gz 2024-04-25T08:53:04.355 INFO:teuthology.orchestra.run.smithi172.stderr:gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62110.log.gz 2024-04-25T08:53:04.355 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T08:53:04.355 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75422.log 2024-04-25T08:53:04.355 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95214.log.gz 2024-04-25T08:53:04.355 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58643.log 2024-04-25T08:53:04.355 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40687.log 2024-04-25T08:53:04.355 INFO:teuthology.orchestra.run.smithi172.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75422.log.gz 2024-04-25T08:53:04.355 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62800.log 2024-04-25T08:53:04.356 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.40687.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58643.log.gz 2024-04-25T08:53:04.356 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40687.log.gz 2024-04-25T08:53:04.356 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79788.log 2024-04-25T08:53:04.356 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2024-04-25T08:53:04.356 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62800.log: /var/log/ceph/ceph-client.admin.79788.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62800.log.gz 2024-04-25T08:53:04.356 INFO:teuthology.orchestra.run.smithi172.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.79788.log.gz 2024-04-25T08:53:04.356 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86423.log 2024-04-25T08:53:04.356 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43955.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2024-04-25T08:53:04.356 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86611.log 2024-04-25T08:53:04.357 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88910.log 2024-04-25T08:53:04.357 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.86423.log: /var/log/ceph/ceph-client.0.86611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.86611.log.gz 2024-04-25T08:53:04.357 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86423.log.gz 2024-04-25T08:53:04.357 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2024-04-25T08:53:04.357 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57920.log 2024-04-25T08:53:04.357 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88910.log: /var/log/ceph/ceph-client.admin.43715.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2024-04-25T08:53:04.357 INFO:teuthology.orchestra.run.smithi172.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.88910.log.gz 2024-04-25T08:53:04.357 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 2024-04-25T08:53:04.358 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101289.log 2024-04-25T08:53:04.358 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57920.log: /var/log/ceph/ceph-client.admin.47319.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57920.log.gz 2024-04-25T08:53:04.358 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz 2024-04-25T08:53:04.358 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86021.log 2024-04-25T08:53:04.358 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.101289.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101289.log.gz 2024-04-25T08:53:04.358 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100913.log 2024-04-25T08:53:04.358 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2024-04-25T08:53:04.358 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.86021.log: /var/log/ceph/ceph-client.admin.100913.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86021.log.gz 2024-04-25T08:53:04.358 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100913.log.gz 2024-04-25T08:53:04.359 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96741.log 2024-04-25T08:53:04.359 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46332.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2024-04-25T08:53:04.359 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85555.log 2024-04-25T08:53:04.359 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66910.log 2024-04-25T08:53:04.359 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96741.log: /var/log/ceph/ceph-client.admin.85555.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96741.log.gz 2024-04-25T08:53:04.359 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.85555.log.gz 2024-04-25T08:53:04.359 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40937.log 2024-04-25T08:53:04.359 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66910.log.gz 2024-04-25T08:53:04.359 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79956.log 2024-04-25T08:53:04.360 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.40937.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40937.log.gz 2024-04-25T08:53:04.360 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64318.log 2024-04-25T08:53:04.360 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84537.log 2024-04-25T08:53:04.360 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79956.log: /var/log/ceph/ceph-client.admin.64318.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79956.log.gz 2024-04-25T08:53:04.360 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64318.log.gz 2024-04-25T08:53:04.360 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60887.log 2024-04-25T08:53:04.360 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84537.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.84537.log.gz 2024-04-25T08:53:04.360 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79452.log 2024-04-25T08:53:04.360 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80124.log 2024-04-25T08:53:04.361 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60887.log: /var/log/ceph/ceph-client.admin.79452.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.79452.log.gz 2024-04-25T08:53:04.361 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60887.log.gz 2024-04-25T08:53:04.361 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46206.log 2024-04-25T08:53:04.361 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100955.log 2024-04-25T08:53:04.361 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80124.log.gz 2024-04-25T08:53:04.361 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65658.log 2024-04-25T08:53:04.361 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100955.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46206.log.gz 2024-04-25T08:53:04.361 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100955.log.gz 2024-04-25T08:53:04.361 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56740.log 2024-04-25T08:53:04.362 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91773.log 2024-04-25T08:53:04.362 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.56740.log: /var/log/ceph/ceph-client.admin.65658.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65658.log.gz 2024-04-25T08:53:04.362 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48453.log 2024-04-25T08:53:04.362 INFO:teuthology.orchestra.run.smithi172.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56740.log.gz 2024-04-25T08:53:04.362 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65878.log 2024-04-25T08:53:04.362 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48453.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91773.log.gz 2024-04-25T08:53:04.362 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59147.log 2024-04-25T08:53:04.362 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48453.log.gz 2024-04-25T08:53:04.363 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34862.log 2024-04-25T08:53:04.363 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59147.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65878.log.gz 2024-04-25T08:53:04.363 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59147.log.gz 2024-04-25T08:53:04.363 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49359.log 2024-04-25T08:53:04.363 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76777.log 2024-04-25T08:53:04.363 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.34862.log: /var/log/ceph/ceph-client.admin.49359.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34862.log.gz 2024-04-25T08:53:04.363 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49359.log.gz 2024-04-25T08:53:04.363 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57439.log 2024-04-25T08:53:04.364 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99106.log 2024-04-25T08:53:04.364 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76777.log: /var/log/ceph/ceph-client.admin.57439.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76777.log.gz 2024-04-25T08:53:04.364 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46248.log 2024-04-25T08:53:04.364 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57439.log.gz 2024-04-25T08:53:04.364 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57523.log 2024-04-25T08:53:04.364 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46248.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46248.log.gz 2024-04-25T08:53:04.364 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.99106.log.gz 2024-04-25T08:53:04.364 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67998.log 2024-04-25T08:53:04.364 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79830.log 2024-04-25T08:53:04.365 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57523.log.gz 2024-04-25T08:53:04.365 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.67998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67998.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96783.log 2024-04-25T08:53:04.365 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.365 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79830.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79830.log.gz 2024-04-25T08:53:04.365 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.85087.log 2024-04-25T08:53:04.365 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78843.log 2024-04-25T08:53:04.365 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96783.log: /var/log/ceph/ceph-client.admin.85087.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96783.log.gz 2024-04-25T08:53:04.365 INFO:teuthology.orchestra.run.smithi172.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85087.log.gz 2024-04-25T08:53:04.366 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56824.log 2024-04-25T08:53:04.366 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.78843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64659.log 2024-04-25T08:53:04.366 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.56824.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.78843.log.gz 2024-04-25T08:53:04.366 INFO:teuthology.orchestra.run.smithi172.stderr: 90.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60779.log 2024-04-25T08:53:04.366 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56824.log.gz 2024-04-25T08:53:04.366 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64659.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64659.log.gz 2024-04-25T08:53:04.366 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.79872.log 2024-04-25T08:53:04.366 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67405.log 2024-04-25T08:53:04.366 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60779.log: /var/log/ceph/ceph-client.admin.79872.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60779.log.gz 2024-04-25T08:53:04.367 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79872.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.81521.log 2024-04-25T08:53:04.367 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.367 INFO:teuthology.orchestra.run.smithi172.stderr:gzip/var/log/ceph/ceph-client.admin.67405.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.84107.log 2024-04-25T08:53:04.367 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67405.log.gz 2024-04-25T08:53:04.367 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.81521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.81521.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.92090.log 2024-04-25T08:53:04.367 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.367 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59753.log 2024-04-25T08:53:04.367 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84107.log.gz 2024-04-25T08:53:04.367 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.92090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.92090.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.65238.log 2024-04-25T08:53:04.368 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.368 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57962.log 2024-04-25T08:53:04.368 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59753.log: /var/log/ceph/ceph-client.0.65238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65238.log.gz 2024-04-25T08:53:04.368 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59753.log.gz 2024-04-25T08:53:04.368 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79998.log 2024-04-25T08:53:04.368 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95172.log 2024-04-25T08:53:04.368 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57962.log.gz 2024-04-25T08:53:04.368 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81525.log 2024-04-25T08:53:04.369 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95172.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79998.log.gz 2024-04-25T08:53:04.369 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96162.log 2024-04-25T08:53:04.369 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95172.log.gz 2024-04-25T08:53:04.369 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.81525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42223.log 2024-04-25T08:53:04.369 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0%/var/log/ceph/ceph-client.admin.96162.log: -- replaced with /var/log/ceph/ceph-client.0.81525.log.gz 2024-04-25T08:53:04.369 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96162.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96699.log 2024-04-25T08:53:04.369 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.369 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88532.log 2024-04-25T08:53:04.369 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42223.log: /var/log/ceph/ceph-client.admin.96699.log: 88.5% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42223.log.gz 2024-04-25T08:53:04.370 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96699.log.gz 2024-04-25T08:53:04.370 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43717.log 2024-04-25T08:53:04.370 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66004.log 2024-04-25T08:53:04.370 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88532.log.gz 2024-04-25T08:53:04.370 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43716.log 2024-04-25T08:53:04.370 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66004.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43717.log.gz 2024-04-25T08:53:04.370 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66004.log.gz 2024-04-25T08:53:04.370 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43713.log 2024-04-25T08:53:04.370 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60703.log 2024-04-25T08:53:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43713.log: /var/log/ceph/ceph-client.admin.43716.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43716.log.gz 2024-04-25T08:53:04.371 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43713.log.gz 2024-04-25T08:53:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99616.log 2024-04-25T08:53:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74637.log 2024-04-25T08:53:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60703.log: /var/log/ceph/ceph-client.admin.99616.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60703.log.gz 2024-04-25T08:53:04.371 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99616.log.gz 2024-04-25T08:53:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75608.log 2024-04-25T08:53:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84012.log 2024-04-25T08:53:04.371 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74637.log: /var/log/ceph/ceph-client.admin.75608.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74637.log.gz 2024-04-25T08:53:04.372 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75608.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45870.log 2024-04-25T08:53:04.372 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.372 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43031.log 2024-04-25T08:53:04.372 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84012.log: /var/log/ceph/ceph-client.admin.45870.log: 88.6% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84012.log.gz 2024-04-25T08:53:04.372 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45870.log.gz 2024-04-25T08:53:04.372 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49275.log 2024-04-25T08:53:04.372 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63267.log 2024-04-25T08:53:04.372 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43031.log: /var/log/ceph/ceph-client.admin.49275.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43031.log.gz 2024-04-25T08:53:04.373 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49275.log.gz 2024-04-25T08:53:04.373 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83970.log 2024-04-25T08:53:04.373 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83544.log 2024-04-25T08:53:04.373 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83970.log: /var/log/ceph/ceph-client.admin.63267.log: 88.2% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63267.log.gz 2024-04-25T08:53:04.373 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83970.log.gz 2024-04-25T08:53:04.373 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83886.log 2024-04-25T08:53:04.373 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67994.log 2024-04-25T08:53:04.373 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83544.log: /var/log/ceph/ceph-client.admin.83886.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83544.log.gz 2024-04-25T08:53:04.373 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.83886.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28831.log 2024-04-25T08:53:04.374 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.374 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T08:53:04.374 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.67994.log: /var/log/ceph/ceph.tmp-client.admin.28831.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28831.log.gz 2024-04-25T08:53:04.374 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67994.log.gz 2024-04-25T08:53:04.374 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96469.log 2024-04-25T08:53:04.374 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59645.log 2024-04-25T08:53:04.374 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96469.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.96469.log.gz 2024-04-25T08:53:04.374 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86105.log 2024-04-25T08:53:04.375 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59645.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59645.log.gz 2024-04-25T08:53:04.375 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47277.log 2024-04-25T08:53:04.375 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.86105.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86105.log.gz 2024-04-25T08:53:04.375 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43373.log 2024-04-25T08:53:04.375 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47277.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47277.log.gz 2024-04-25T08:53:04.375 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90661.log 2024-04-25T08:53:04.376 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43373.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43373.log.gz 2024-04-25T08:53:04.376 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49403.log 2024-04-25T08:53:04.376 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90661.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90661.log.gz 2024-04-25T08:53:04.376 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61405.log 2024-04-25T08:53:04.376 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49403.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49403.log.gz 2024-04-25T08:53:04.376 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58811.log 2024-04-25T08:53:04.376 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61405.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.61405.log.gz 2024-04-25T08:53:04.376 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81334.log 2024-04-25T08:53:04.377 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58811.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58811.log.gz 2024-04-25T08:53:04.377 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47031.log 2024-04-25T08:53:04.377 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.81334.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.81334.log.gz 2024-04-25T08:53:04.377 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62632.log 2024-04-25T08:53:04.377 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47031.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47031.log.gz 2024-04-25T08:53:04.377 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56890.log 2024-04-25T08:53:04.377 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62632.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62632.log.gz 2024-04-25T08:53:04.377 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95611.log 2024-04-25T08:53:04.377 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.56890.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.56890.log.gz 2024-04-25T08:53:04.378 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84275.log 2024-04-25T08:53:04.378 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95611.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95611.log.gz 2024-04-25T08:53:04.378 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45123.log 2024-04-25T08:53:04.378 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84275.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84275.log.gz 2024-04-25T08:53:04.378 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90836.log 2024-04-25T08:53:04.378 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.45123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45123.log.gz 2024-04-25T08:53:04.378 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63059.log 2024-04-25T08:53:04.378 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90836.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90836.log.gz 2024-04-25T08:53:04.378 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100787.log 2024-04-25T08:53:04.379 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63059.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63059.log.gz 2024-04-25T08:53:04.379 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92167.log 2024-04-25T08:53:04.379 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100787.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100787.log.gz 2024-04-25T08:53:04.379 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46164.log 2024-04-25T08:53:04.379 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.92167.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92167.log.gz 2024-04-25T08:53:04.379 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89624.log 2024-04-25T08:53:04.379 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46164.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46164.log.gz 2024-04-25T08:53:04.379 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80638.log 2024-04-25T08:53:04.380 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89624.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89624.log.gz 2024-04-25T08:53:04.380 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76459.log 2024-04-25T08:53:04.380 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80638.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80638.log.gz 2024-04-25T08:53:04.380 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49540.log 2024-04-25T08:53:04.380 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76459.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76459.log.gz 2024-04-25T08:53:04.380 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74983.log 2024-04-25T08:53:04.380 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49540.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49540.log.gz 2024-04-25T08:53:04.380 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84191.log 2024-04-25T08:53:04.380 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74983.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74983.log.gz 2024-04-25T08:53:04.381 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74721.log 2024-04-25T08:53:04.381 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84191.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84191.log.gz 2024-04-25T08:53:04.381 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95779.log 2024-04-25T08:53:04.381 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74721.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.74721.log.gz 2024-04-25T08:53:04.381 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59969.log 2024-04-25T08:53:04.381 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95779.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95779.log.gz 2024-04-25T08:53:04.381 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76627.log 2024-04-25T08:53:04.381 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59969.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59969.log.gz 2024-04-25T08:53:04.382 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99531.log 2024-04-25T08:53:04.382 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76627.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76627.log.gz 2024-04-25T08:53:04.382 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94049.log 2024-04-25T08:53:04.382 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99531.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99531.log.gz 2024-04-25T08:53:04.382 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79410.log 2024-04-25T08:53:04.382 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94049.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94049.log.gz 2024-04-25T08:53:04.382 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57093.log 2024-04-25T08:53:04.382 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79410.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.79410.log.gz 2024-04-25T08:53:04.382 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93917.log 2024-04-25T08:53:04.383 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57093.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57093.log.gz 2024-04-25T08:53:04.383 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83844.log 2024-04-25T08:53:04.383 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.93917.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93917.log.gz 2024-04-25T08:53:04.383 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97288.log 2024-04-25T08:53:04.383 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83844.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.83844.log.gz 2024-04-25T08:53:04.383 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89318.log 2024-04-25T08:53:04.383 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.97288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97288.log.gz 2024-04-25T08:53:04.383 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80466.log 2024-04-25T08:53:04.383 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89318.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.89318.log.gz 2024-04-25T08:53:04.384 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63353.log 2024-04-25T08:53:04.384 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80466.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80466.log.gz 2024-04-25T08:53:04.384 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85598.log 2024-04-25T08:53:04.384 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63353.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63353.log.gz 2024-04-25T08:53:04.384 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76160.log 2024-04-25T08:53:04.387 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85598.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.85598.log.gz 2024-04-25T08:53:04.387 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76333.log 2024-04-25T08:53:04.387 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76160.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76160.log.gz 2024-04-25T08:53:04.388 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95424.log 2024-04-25T08:53:04.388 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76333.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76333.log.gz 2024-04-25T08:53:04.388 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95466.log 2024-04-25T08:53:04.388 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95424.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95424.log.gz 2024-04-25T08:53:04.388 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44165.log 2024-04-25T08:53:04.388 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95466.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95466.log.gz 2024-04-25T08:53:04.388 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79190.log 2024-04-25T08:53:04.388 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44165.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44165.log.gz 2024-04-25T08:53:04.389 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57607.log 2024-04-25T08:53:04.389 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79190.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79190.log.gz 2024-04-25T08:53:04.389 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101165.log 2024-04-25T08:53:04.389 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57607.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57607.log.gz 2024-04-25T08:53:04.389 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89444.log 2024-04-25T08:53:04.389 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.101165.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101165.log.gz 2024-04-25T08:53:04.390 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88976.log 2024-04-25T08:53:04.390 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89444.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.89444.log.gz 2024-04-25T08:53:04.390 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84579.log 2024-04-25T08:53:04.390 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88976.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.88976.log.gz 2024-04-25T08:53:04.390 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57649.log 2024-04-25T08:53:04.390 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84579.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.84579.log.gz 2024-04-25T08:53:04.390 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50341.log 2024-04-25T08:53:04.390 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57649.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57649.log.gz 2024-04-25T08:53:04.391 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84705.log 2024-04-25T08:53:04.391 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.50341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50341.log.gz 2024-04-25T08:53:04.391 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57271.log 2024-04-25T08:53:04.391 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84705.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.84705.log.gz 2024-04-25T08:53:04.391 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66868.log 2024-04-25T08:53:04.391 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57271.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57271.log.gz 2024-04-25T08:53:04.391 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41339.log 2024-04-25T08:53:04.391 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66868.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66868.log.gz 2024-04-25T08:53:04.391 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89708.log 2024-04-25T08:53:04.392 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41339.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41339.log.gz 2024-04-25T08:53:04.392 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79620.log 2024-04-25T08:53:04.392 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89708.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89708.log.gz 2024-04-25T08:53:04.392 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64658.log 2024-04-25T08:53:04.392 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79620.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79620.log.gz 2024-04-25T08:53:04.392 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60529.log 2024-04-25T08:53:04.392 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64658.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64658.log.gz 2024-04-25T08:53:04.392 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56608.log 2024-04-25T08:53:04.392 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60529.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.60529.log.gz 2024-04-25T08:53:04.393 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76711.log 2024-04-25T08:53:04.393 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.56608.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56608.log.gz 2024-04-25T08:53:04.393 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62716.log 2024-04-25T08:53:04.394 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mon.b.log: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T08:53:04.460 INFO:teuthology.orchestra.run.smithi186.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T08:53:04.627 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76711.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.76711.log.gz 2024-04-25T08:53:04.627 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93983.log 2024-04-25T08:53:04.628 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62716.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62716.log.gz 2024-04-25T08:53:04.628 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74518.log 2024-04-25T08:53:04.628 INFO:teuthology.orchestra.run.smithi172.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T08:53:04.628 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.93983.log: gzip 90.9% -5 --verbose -- /var/log/ceph/ceph-client.admin.75991.log 2024-04-25T08:53:04.628 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93983.log.gz 2024-04-25T08:53:04.628 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81100.log 2024-04-25T08:53:04.628 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74518.log: /var/log/ceph/ceph-client.admin.75991.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75991.log.gz 2024-04-25T08:53:04.628 INFO:teuthology.orchestra.run.smithi172.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89144.log 2024-04-25T08:53:04.629 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.81100.log: -- replaced with /var/log/ceph/ceph-client.admin.74518.log.gz 2024-04-25T08:53:04.629 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83718.log 2024-04-25T08:53:04.629 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81100.log.gz 2024-04-25T08:53:04.629 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94560.log 2024-04-25T08:53:04.629 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83718.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83718.log.gz 2024-04-25T08:53:04.629 INFO:teuthology.orchestra.run.smithi172.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.89144.log.gz 2024-04-25T08:53:04.629 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99978.log 2024-04-25T08:53:04.629 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44809.log 2024-04-25T08:53:04.630 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94560.log.gz 2024-04-25T08:53:04.630 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42575.log 2024-04-25T08:53:04.630 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44809.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99978.log.gz 2024-04-25T08:53:04.630 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44809.log.gz 2024-04-25T08:53:04.630 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83418.log 2024-04-25T08:53:04.630 INFO:teuthology.orchestra.run.smithi172.stderr:gzip/var/log/ceph/ceph-client.admin.42575.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.85129.log 2024-04-25T08:53:04.630 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42575.log.gz 2024-04-25T08:53:04.630 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84831.log 2024-04-25T08:53:04.630 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85129.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83418.log.gz 2024-04-25T08:53:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75734.log 2024-04-25T08:53:04.631 INFO:teuthology.orchestra.run.smithi172.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.85129.log.gz 2024-04-25T08:53:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66826.log 2024-04-25T08:53:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75734.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.84831.log.gz 2024-04-25T08:53:04.631 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75734.log.gz 2024-04-25T08:53:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94259.log 2024-04-25T08:53:04.631 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.66826.log: /var/log/ceph/ceph-client.admin.84149.log 2024-04-25T08:53:04.631 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8%/var/log/ceph/ceph-client.admin.94259.log: -- replaced with /var/log/ceph/ceph-client.admin.66826.log.gz 2024-04-25T08:53:04.632 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48117.log 2024-04-25T08:53:04.632 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94259.log.gz 2024-04-25T08:53:04.632 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84149.log: gzip -5 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84149.log.gz 2024-04-25T08:53:04.632 INFO:teuthology.orchestra.run.smithi172.stderr: --verbose -- /var/log/ceph/ceph-client.admin.85851.log 2024-04-25T08:53:04.632 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49233.log 2024-04-25T08:53:04.632 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48117.log: /var/log/ceph/ceph-client.admin.85851.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48117.log.gz 2024-04-25T08:53:04.632 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.85851.log.gz 2024-04-25T08:53:04.632 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42349.log 2024-04-25T08:53:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49233.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49233.log.gz 2024-04-25T08:53:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95046.log 2024-04-25T08:53:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83586.log 2024-04-25T08:53:04.633 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42349.log.gz 2024-04-25T08:53:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60595.log 2024-04-25T08:53:04.633 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2%/var/log/ceph/ceph-client.admin.83586.log: -- replaced with /var/log/ceph/ceph-client.admin.95046.log.gz 2024-04-25T08:53:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74805.log 2024-04-25T08:53:04.633 INFO:teuthology.orchestra.run.smithi172.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.83586.log.gz 2024-04-25T08:53:04.633 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95088.log 2024-04-25T08:53:04.634 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74805.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60595.log.gz 2024-04-25T08:53:04.634 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62842.log 2024-04-25T08:53:04.634 INFO:teuthology.orchestra.run.smithi172.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.74805.log.gz 2024-04-25T08:53:04.634 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41211.log 2024-04-25T08:53:04.634 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62842.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95088.log.gz 2024-04-25T08:53:04.634 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62842.log.gz 2024-04-25T08:53:04.634 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60397.log 2024-04-25T08:53:04.634 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46584.log 2024-04-25T08:53:04.635 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41211.log: /var/log/ceph/ceph-client.admin.60397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41211.log.gz 2024-04-25T08:53:04.635 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88490.log 2024-04-25T08:53:04.635 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60397.log.gz 2024-04-25T08:53:04.635 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80300.log 2024-04-25T08:53:04.635 INFO:teuthology.orchestra.run.smithi172.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46584.log.gz 2024-04-25T08:53:04.635 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95340.log 2024-04-25T08:53:04.635 INFO:teuthology.orchestra.run.smithi172.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.88490.log.gz 2024-04-25T08:53:04.635 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48969.log 2024-04-25T08:53:04.635 INFO:teuthology.orchestra.run.smithi172.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80300.log.gz 2024-04-25T08:53:04.636 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95821.log 2024-04-25T08:53:04.636 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95340.log.gz 2024-04-25T08:53:04.636 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42307.log 2024-04-25T08:53:04.636 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48969.log.gz 2024-04-25T08:53:04.636 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95821.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95821.log.gz 2024-04-25T08:53:04.636 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96657.log 2024-04-25T08:53:04.636 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100409.log 2024-04-25T08:53:04.636 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42307.log: /var/log/ceph/ceph-client.admin.96657.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42307.log.gz 2024-04-25T08:53:04.637 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96657.log.gz 2024-04-25T08:53:04.637 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85428.log 2024-04-25T08:53:04.637 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90535.log 2024-04-25T08:53:04.637 INFO:teuthology.orchestra.run.smithi172.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100409.log.gz 2024-04-25T08:53:04.637 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94175.log 2024-04-25T08:53:04.637 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90535.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.85428.log.gz 2024-04-25T08:53:04.637 INFO:teuthology.orchestra.run.smithi172.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.90535.log.gz 2024-04-25T08:53:04.637 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96120.log 2024-04-25T08:53:04.638 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94175.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94175.log.gz 2024-04-25T08:53:04.638 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95695.log 2024-04-25T08:53:04.638 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57397.log 2024-04-25T08:53:04.638 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96120.log: /var/log/ceph/ceph-client.admin.95695.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96120.log.gz 2024-04-25T08:53:04.638 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95695.log.gz 2024-04-25T08:53:04.638 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86147.log 2024-04-25T08:53:04.638 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57397.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57397.log.gz 2024-04-25T08:53:04.638 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94405.log 2024-04-25T08:53:04.639 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48621.log 2024-04-25T08:53:04.639 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.86147.log: /var/log/ceph/ceph-client.admin.94405.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86147.log.gz 2024-04-25T08:53:04.639 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94405.log.gz 2024-04-25T08:53:04.639 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65962.log 2024-04-25T08:53:04.639 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81226.log 2024-04-25T08:53:04.639 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65962.log: /var/log/ceph/ceph-client.admin.48621.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48621.log.gz 2024-04-25T08:53:04.639 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65962.log.gz 2024-04-25T08:53:04.639 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41169.log 2024-04-25T08:53:04.640 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76964.log 2024-04-25T08:53:04.640 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.81226.log: /var/log/ceph/ceph-client.admin.41169.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81226.log.gz 2024-04-25T08:53:04.640 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41169.log.gz 2024-04-25T08:53:04.640 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2024-04-25T08:53:04.640 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78711.log 2024-04-25T08:53:04.640 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.76964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.76964.log.gz 2024-04-25T08:53:04.640 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90756.log 2024-04-25T08:53:04.640 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2024-04-25T08:53:04.640 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.78711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64837.log 2024-04-25T08:53:04.641 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90756.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90756.log.gz 2024-04-25T08:53:04.641 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.78711.log.gz 2024-04-25T08:53:04.641 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49498.log 2024-04-25T08:53:04.641 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64544.log 2024-04-25T08:53:04.641 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64837.log.gz 2024-04-25T08:53:04.641 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58387.log 2024-04-25T08:53:04.641 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64544.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49498.log.gz 2024-04-25T08:53:04.641 INFO:teuthology.orchestra.run.smithi172.stderr:gzip 90.4% -- replaced with /var/log/ceph/ceph-client.admin.64544.log.gz 2024-04-25T08:53:04.642 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.83802.log 2024-04-25T08:53:04.642 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40895.log 2024-04-25T08:53:04.642 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58387.log: /var/log/ceph/ceph-client.admin.83802.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58387.log.gz 2024-04-25T08:53:04.642 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83802.log.gz 2024-04-25T08:53:04.642 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96597.log 2024-04-25T08:53:04.642 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.40895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84959.log 2024-04-25T08:53:04.642 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40895.log.gz 2024-04-25T08:53:04.642 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99351.log 2024-04-25T08:53:04.642 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84959.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96597.log.gz 2024-04-25T08:53:04.643 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84959.log.gz 2024-04-25T08:53:04.643 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64985.log 2024-04-25T08:53:04.643 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85809.log 2024-04-25T08:53:04.643 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99351.log: /var/log/ceph/ceph-client.admin.64985.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99351.log.gz 2024-04-25T08:53:04.643 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61932.log 2024-04-25T08:53:04.643 INFO:teuthology.orchestra.run.smithi172.stderr: 91.1%/var/log/ceph/ceph-client.admin.85809.log: -- replaced with /var/log/ceph/ceph-client.admin.64985.log.gz 2024-04-25T08:53:04.643 INFO:teuthology.orchestra.run.smithi172.stderr: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84916.log 2024-04-25T08:53:04.643 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85809.log.gz/var/log/ceph/ceph-client.admin.61932.log: 2024-04-25T08:53:04.644 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47661.log 2024-04-25T08:53:04.644 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61932.log.gz 2024-04-25T08:53:04.644 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84916.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84916.log.gz 2024-04-25T08:53:04.644 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76291.log 2024-04-25T08:53:04.644 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75067.log 2024-04-25T08:53:04.644 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47661.log: /var/log/ceph/ceph-client.admin.76291.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47661.log.gz 2024-04-25T08:53:04.644 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96993.log 2024-04-25T08:53:04.644 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76291.log.gz 2024-04-25T08:53:04.644 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45996.log 2024-04-25T08:53:04.645 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96993.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.75067.log.gz 2024-04-25T08:53:04.645 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96993.log.gz 2024-04-25T08:53:04.645 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60011.log 2024-04-25T08:53:04.645 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65242.log 2024-04-25T08:53:04.645 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.45996.log: /var/log/ceph/ceph-client.admin.60011.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45996.log.gz 2024-04-25T08:53:04.645 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45828.log 2024-04-25T08:53:04.645 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.65242.log: 90.6% 0.0% -- replaced with /var/log/ceph/ceph-client.0.65242.log.gz 2024-04-25T08:53:04.645 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60011.log.gz 2024-04-25T08:53:04.646 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79106.log 2024-04-25T08:53:04.646 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48285.log 2024-04-25T08:53:04.646 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.45828.log: /var/log/ceph/ceph-client.admin.79106.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45828.log.gz 2024-04-25T08:53:04.646 INFO:teuthology.orchestra.run.smithi172.stderr: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.79106.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.44501.log 2024-04-25T08:53:04.646 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.646 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35139.log 2024-04-25T08:53:04.646 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44501.log: /var/log/ceph/ceph-client.admin.48285.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48285.log.gz 2024-04-25T08:53:04.646 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44501.log.gz 2024-04-25T08:53:04.647 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85470.log 2024-04-25T08:53:04.647 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.35139.log: -- /var/log/ceph/ceph-client.admin.35226.log 2024-04-25T08:53:04.647 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35139.log.gz 2024-04-25T08:53:04.647 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101249.log 2024-04-25T08:53:04.647 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35226.log: 88.4% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35226.log.gz 2024-04-25T08:53:04.647 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85470.log.gz 2024-04-25T08:53:04.647 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81016.log 2024-04-25T08:53:04.647 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.101249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64116.log 2024-04-25T08:53:04.647 INFO:teuthology.orchestra.run.smithi172.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101249.log.gz 2024-04-25T08:53:04.648 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.81016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47157.log 2024-04-25T08:53:04.648 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0%/var/log/ceph/ceph-client.0.64116.log: -- replaced with /var/log/ceph/ceph-client.admin.81016.log.gz 2024-04-25T08:53:04.648 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64116.log.gz 2024-04-25T08:53:04.648 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88742.log 2024-04-25T08:53:04.648 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83502.log 2024-04-25T08:53:04.648 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47157.log.gz 2024-04-25T08:53:04.648 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63859.log 2024-04-25T08:53:04.648 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83502.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.88742.log.gz 2024-04-25T08:53:04.649 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83502.log.gz 2024-04-25T08:53:04.649 INFO:teuthology.orchestra.run.smithi172.stderr: /var/log/ceph/ceph-client.admin.89970.log 2024-04-25T08:53:04.649 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75277.log 2024-04-25T08:53:04.649 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63859.log: /var/log/ceph/ceph-client.admin.89970.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.89970.log.gz 2024-04-25T08:53:04.649 INFO:teuthology.orchestra.run.smithi172.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63859.log.gz 2024-04-25T08:53:04.649 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97035.log 2024-04-25T08:53:04.649 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75277.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75277.log.gz 2024-04-25T08:53:04.649 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88574.log 2024-04-25T08:53:04.649 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84621.log 2024-04-25T08:53:04.650 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.97035.log: /var/log/ceph/ceph-client.admin.88574.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88574.log.gz 2024-04-25T08:53:04.650 INFO:teuthology.orchestra.run.smithi172.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.97035.log.gz 2024-04-25T08:53:04.650 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80680.log 2024-04-25T08:53:04.650 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62572.log 2024-04-25T08:53:04.650 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84621.log.gz 2024-04-25T08:53:04.650 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50154.log 2024-04-25T08:53:04.650 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62572.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80680.log.gz 2024-04-25T08:53:04.650 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62572.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49447.log 2024-04-25T08:53:04.651 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.651 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.50154.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50154.log.gz 2024-04-25T08:53:04.651 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83286.log 2024-04-25T08:53:04.651 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61890.log 2024-04-25T08:53:04.651 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49447.log: /var/log/ceph/ceph-client.admin.83286.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49447.log.gz 2024-04-25T08:53:04.651 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101081.log 2024-04-25T08:53:04.651 INFO:teuthology.orchestra.run.smithi172.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.83286.log.gz/var/log/ceph/ceph-client.admin.61890.log: 2024-04-25T08:53:04.651 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90222.log 2024-04-25T08:53:04.651 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61890.log.gz/var/log/ceph/ceph-client.admin.101081.log: 2024-04-25T08:53:04.651 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90180.log 2024-04-25T08:53:04.652 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101081.log.gz 2024-04-25T08:53:04.652 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45257.log 2024-04-25T08:53:04.652 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90180.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90222.log.gz 2024-04-25T08:53:04.652 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90180.log.gz 2024-04-25T08:53:04.652 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88358.log 2024-04-25T08:53:04.652 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57741.log 2024-04-25T08:53:04.652 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.45257.log: /var/log/ceph/ceph-client.admin.88358.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45257.log.gz 2024-04-25T08:53:04.652 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100451.log 2024-04-25T08:53:04.652 INFO:teuthology.orchestra.run.smithi172.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.88358.log.gz 2024-04-25T08:53:04.653 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95256.log 2024-04-25T08:53:04.653 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57741.log.gz/var/log/ceph/ceph-client.admin.100451.log: 2024-04-25T08:53:04.653 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100451.log.gz 2024-04-25T08:53:04.653 INFO:teuthology.orchestra.run.smithi172.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2024-04-25T08:53:04.653 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81142.log 2024-04-25T08:53:04.653 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95256.log: /var/log/ceph/ceph-client.admin.43369.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95256.log.gz 2024-04-25T08:53:04.653 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2024-04-25T08:53:04.653 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62674.log 2024-04-25T08:53:04.653 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.81142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46989.log 2024-04-25T08:53:04.654 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81142.log.gz 2024-04-25T08:53:04.654 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48926.log 2024-04-25T08:53:04.654 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46989.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62674.log.gz 2024-04-25T08:53:04.654 INFO:teuthology.orchestra.run.smithi172.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46989.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67807.log 2024-04-25T08:53:04.654 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.654 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100871.log 2024-04-25T08:53:04.654 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48926.log: /var/log/ceph/ceph-client.admin.67807.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67807.log.gz 2024-04-25T08:53:04.654 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48926.log.gz 2024-04-25T08:53:04.655 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42863.log 2024-04-25T08:53:04.655 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62194.log 2024-04-25T08:53:04.655 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100871.log.gz 2024-04-25T08:53:04.655 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96288.log 2024-04-25T08:53:04.655 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62194.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42863.log.gz 2024-04-25T08:53:04.655 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62194.log.gz 2024-04-25T08:53:04.655 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101331.log 2024-04-25T08:53:04.655 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100577.log 2024-04-25T08:53:04.655 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96288.log.gz 2024-04-25T08:53:04.656 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.101331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44627.log 2024-04-25T08:53:04.656 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100577.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101331.log.gz 2024-04-25T08:53:04.656 INFO:teuthology.orchestra.run.smithi172.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100577.log.gz 2024-04-25T08:53:04.656 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48765.log 2024-04-25T08:53:04.656 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75650.log 2024-04-25T08:53:04.656 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48765.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44627.log.gz 2024-04-25T08:53:04.656 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48765.log.gz 2024-04-25T08:53:04.657 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49317.log 2024-04-25T08:53:04.657 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75650.log: gzip -5 88.3% --verbose -- /var/log/ceph/ceph-client.admin.84233.log 2024-04-25T08:53:04.657 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75650.log.gz 2024-04-25T08:53:04.657 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80806.log 2024-04-25T08:53:04.657 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84233.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49317.log.gz 2024-04-25T08:53:04.657 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58345.log 2024-04-25T08:53:04.657 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80806.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84233.log.gz 2024-04-25T08:53:04.657 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.80806.log.gz 2024-04-25T08:53:04.657 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56674.log 2024-04-25T08:53:04.658 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63691.log 2024-04-25T08:53:04.658 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58345.log: /var/log/ceph/ceph-client.admin.56674.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58345.log.gz 2024-04-25T08:53:04.658 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50422.log 2024-04-25T08:53:04.658 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.63691.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.56674.log.gz 2024-04-25T08:53:04.658 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63691.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46752.log 2024-04-25T08:53:04.658 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.658 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.50422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78951.log 2024-04-25T08:53:04.658 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50422.log.gz 2024-04-25T08:53:04.659 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86315.log 2024-04-25T08:53:04.659 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.78951.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46752.log.gz 2024-04-25T08:53:04.659 INFO:teuthology.orchestra.run.smithi172.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78951.log.gz 2024-04-25T08:53:04.659 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79914.log 2024-04-25T08:53:04.659 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45912.log 2024-04-25T08:53:04.659 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79914.log: /var/log/ceph/ceph-client.admin.86315.log: 88.5% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86315.log.gz 2024-04-25T08:53:04.659 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79914.log.gz 2024-04-25T08:53:04.659 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48705.log 2024-04-25T08:53:04.659 INFO:teuthology.orchestra.run.smithi172.stderr:gzip/var/log/ceph/ceph-client.admin.45912.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.100367.log 2024-04-25T08:53:04.660 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48705.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45912.log.gz 2024-04-25T08:53:04.660 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90367.log 2024-04-25T08:53:04.660 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100367.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48705.log.gz 2024-04-25T08:53:04.660 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100367.log.gz 2024-04-25T08:53:04.660 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47073.log 2024-04-25T08:53:04.660 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49836.log 2024-04-25T08:53:04.660 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90367.log: /var/log/ceph/ceph-client.admin.47073.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90367.log.gz 2024-04-25T08:53:04.660 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44417.log 2024-04-25T08:53:04.660 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47073.log.gz 2024-04-25T08:53:04.661 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67261.log 2024-04-25T08:53:04.661 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44417.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49836.log.gz 2024-04-25T08:53:04.661 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44417.log.gz 2024-04-25T08:53:04.661 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81184.log 2024-04-25T08:53:04.661 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57177.log 2024-04-25T08:53:04.661 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67261.log: /var/log/ceph/ceph-client.admin.81184.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67261.log.gz 2024-04-25T08:53:04.661 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100176.log 2024-04-25T08:53:04.661 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81184.log.gz 2024-04-25T08:53:04.662 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42391.log 2024-04-25T08:53:04.662 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100176.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57177.log.gz 2024-04-25T08:53:04.662 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100176.log.gz 2024-04-25T08:53:04.662 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40853.log 2024-04-25T08:53:04.662 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85003.log 2024-04-25T08:53:04.662 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42391.log: /var/log/ceph/ceph-client.admin.40853.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42391.log.gz 2024-04-25T08:53:04.662 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40853.log.gz 2024-04-25T08:53:04.662 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96951.log 2024-04-25T08:53:04.663 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61711.log 2024-04-25T08:53:04.663 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85003.log: /var/log/ceph/ceph-client.admin.96951.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85003.log.gz 2024-04-25T08:53:04.663 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96951.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58853.log 2024-04-25T08:53:04.663 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.663 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66952.log 2024-04-25T08:53:04.663 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61711.log: /var/log/ceph/ceph-client.admin.58853.log: 89.0% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61711.log.gz 2024-04-25T08:53:04.663 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58853.log.gz 2024-04-25T08:53:04.664 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43709.log 2024-04-25T08:53:04.664 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100661.log 2024-04-25T08:53:04.664 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66952.log: /var/log/ceph/ceph-client.admin.43709.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66952.log.gz 2024-04-25T08:53:04.664 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43709.log.gz 2024-04-25T08:53:04.664 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85266.log 2024-04-25T08:53:04.664 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76249.log 2024-04-25T08:53:04.664 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85266.log: /var/log/ceph/ceph-client.admin.100661.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100661.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.85266.log.gz 2024-04-25T08:53:04.665 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.665 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49107.log 2024-04-25T08:53:04.665 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67657.log 2024-04-25T08:53:04.665 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.76249.log.gz 2024-04-25T08:53:04.665 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43073.log 2024-04-25T08:53:04.665 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49107.log.gz 2024-04-25T08:53:04.665 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49878.log 2024-04-25T08:53:04.665 INFO:teuthology.orchestra.run.smithi172.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67657.log.gz 2024-04-25T08:53:04.665 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80550.log 2024-04-25T08:53:04.666 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2%/var/log/ceph/ceph-client.admin.49878.log: -- replaced with /var/log/ceph/ceph-client.admin.43073.log.gz 2024-04-25T08:53:04.666 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95737.log 2024-04-25T08:53:04.666 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49878.log.gz 2024-04-25T08:53:04.666 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40591.log 2024-04-25T08:53:04.666 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80550.log: /var/log/ceph/ceph-client.admin.95737.log: 87.7% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95737.log.gz -- replaced with /var/log/ceph/ceph-client.admin.80550.log.gz 2024-04-25T08:53:04.666 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.666 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49019.log 2024-04-25T08:53:04.666 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.40591.log: /var/log/ceph/ceph-client.admin.42533.log 2024-04-25T08:53:04.667 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.49019.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40591.log.gz 2024-04-25T08:53:04.667 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91309.log 2024-04-25T08:53:04.667 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42533.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49019.log.gz 2024-04-25T08:53:04.667 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42533.log.gz 2024-04-25T08:53:04.667 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67573.log 2024-04-25T08:53:04.667 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44207.log 2024-04-25T08:53:04.667 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91309.log: /var/log/ceph/ceph-client.admin.67573.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91309.log.gz 2024-04-25T08:53:04.667 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67573.log.gz 2024-04-25T08:53:04.668 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76375.log 2024-04-25T08:53:04.668 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.44207.log: /var/log/ceph/ceph-client.admin.90918.log 2024-04-25T08:53:04.668 INFO:teuthology.orchestra.run.smithi172.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44207.log.gz 2024-04-25T08:53:04.668 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46290.log 2024-04-25T08:53:04.668 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90918.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76375.log.gz 2024-04-25T08:53:04.668 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.90918.log.gz 2024-04-25T08:53:04.668 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94605.log 2024-04-25T08:53:04.668 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61102.log 2024-04-25T08:53:04.668 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46290.log: /var/log/ceph/ceph-client.admin.94605.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46290.log.gz 2024-04-25T08:53:04.669 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94605.log.gz 2024-04-25T08:53:04.669 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60463.log 2024-04-25T08:53:04.669 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99267.log 2024-04-25T08:53:04.669 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61102.log: /var/log/ceph/ceph-client.admin.60463.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61102.log.gz 2024-04-25T08:53:04.669 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47445.log 2024-04-25T08:53:04.669 INFO:teuthology.orchestra.run.smithi172.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.60463.log.gz 2024-04-25T08:53:04.669 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94301.log 2024-04-25T08:53:04.669 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4%/var/log/ceph/ceph-client.admin.47445.log: -- replaced with /var/log/ceph/ceph-client.admin.99267.log.gz 2024-04-25T08:53:04.670 INFO:teuthology.orchestra.run.smithi172.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75829.log 2024-04-25T08:53:04.670 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47445.log.gz 2024-04-25T08:53:04.670 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62884.log 2024-04-25T08:53:04.670 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94301.log: /var/log/ceph/ceph-client.admin.75829.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94301.log.gz 2024-04-25T08:53:04.671 INFO:teuthology.orchestra.run.smithi172.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75829.log.gz 2024-04-25T08:53:04.671 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91605.log 2024-04-25T08:53:04.671 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67447.log 2024-04-25T08:53:04.671 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62884.log: /var/log/ceph/ceph-client.admin.91605.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62884.log.gz 2024-04-25T08:53:04.672 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45786.log 2024-04-25T08:53:04.672 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91605.log.gz 2024-04-25T08:53:04.672 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42779.log 2024-04-25T08:53:04.672 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.45786.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67447.log.gz 2024-04-25T08:53:04.672 INFO:teuthology.orchestra.run.smithi172.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45786.log.gz 2024-04-25T08:53:04.673 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89210.log 2024-04-25T08:53:04.673 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75151.log 2024-04-25T08:53:04.673 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42779.log: /var/log/ceph/ceph-client.admin.89210.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42779.log.gz 2024-04-25T08:53:04.673 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80722.log 2024-04-25T08:53:04.673 INFO:teuthology.orchestra.run.smithi172.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.89210.log.gz/var/log/ceph/ceph-client.admin.75151.log: 2024-04-25T08:53:04.673 INFO:teuthology.orchestra.run.smithi172.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97292.log 2024-04-25T08:53:04.673 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80722.log: -- replaced with /var/log/ceph/ceph-client.admin.75151.log.gz 2024-04-25T08:53:04.673 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94133.log 2024-04-25T08:53:04.673 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.80722.log.gz 2024-04-25T08:53:04.674 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.97292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91437.log 2024-04-25T08:53:04.674 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97292.log.gz 2024-04-25T08:53:04.674 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58513.log 2024-04-25T08:53:04.674 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91437.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94133.log.gz 2024-04-25T08:53:04.674 INFO:teuthology.orchestra.run.smithi172.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91437.log.gz 2024-04-25T08:53:04.674 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86273.log 2024-04-25T08:53:04.674 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60275.log 2024-04-25T08:53:04.674 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58513.log: /var/log/ceph/ceph-client.admin.86273.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58513.log.gz 2024-04-25T08:53:04.675 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89886.log 2024-04-25T08:53:04.675 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86273.log.gz 2024-04-25T08:53:04.675 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99309.log 2024-04-25T08:53:04.675 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89886.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.60275.log.gz 2024-04-25T08:53:04.675 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89886.log.gz 2024-04-25T08:53:04.675 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59189.log 2024-04-25T08:53:04.675 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2024-04-25T08:53:04.675 INFO:teuthology.orchestra.run.smithi172.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99309.log.gz 2024-04-25T08:53:04.675 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.59189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64660.log 2024-04-25T08:53:04.676 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59189.log.gz 2024-04-25T08:53:04.676 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94647.log 2024-04-25T08:53:04.676 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64660.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2024-04-25T08:53:04.676 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96376.log 2024-04-25T08:53:04.676 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64660.log.gz 2024-04-25T08:53:04.676 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84411.log 2024-04-25T08:53:04.676 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96376.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94647.log.gz 2024-04-25T08:53:04.676 INFO:teuthology.orchestra.run.smithi172.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96376.log.gz 2024-04-25T08:53:04.676 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48201.log 2024-04-25T08:53:04.676 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61848.log 2024-04-25T08:53:04.677 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84411.log: /var/log/ceph/ceph-client.admin.48201.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84411.log.gz 2024-04-25T08:53:04.677 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48201.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63481.log 2024-04-25T08:53:04.677 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.677 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90316.log 2024-04-25T08:53:04.677 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61848.log: /var/log/ceph/ceph-client.admin.63481.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61848.log.gz 2024-04-25T08:53:04.677 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43913.log 2024-04-25T08:53:04.677 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63481.log.gz 2024-04-25T08:53:04.677 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40810.log 2024-04-25T08:53:04.677 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43913.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90316.log.gz 2024-04-25T08:53:04.678 INFO:teuthology.orchestra.run.smithi172.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43913.log.gz 2024-04-25T08:53:04.678 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89042.log 2024-04-25T08:53:04.678 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80508.log 2024-04-25T08:53:04.678 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89042.log: /var/log/ceph/ceph-client.admin.40810.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40810.log.gz 2024-04-25T08:53:04.678 INFO:teuthology.orchestra.run.smithi172.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89042.log.gz 2024-04-25T08:53:04.678 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76968.log 2024-04-25T08:53:04.679 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88826.log 2024-04-25T08:53:04.679 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80508.log: /var/log/ceph/ceph-client.0.76968.log: 0.0% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.80508.log.gz 2024-04-25T08:53:04.679 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.0.76968.log.gz 2024-04-25T08:53:04.679 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49920.log 2024-04-25T08:53:04.679 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43704.log 2024-04-25T08:53:04.679 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.88826.log: /var/log/ceph/ceph-client.admin.49920.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88826.log.gz 2024-04-25T08:53:04.679 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49920.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62446.log 2024-04-25T08:53:04.679 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:04.680 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50345.log 2024-04-25T08:53:04.680 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62446.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43704.log.gz 2024-04-25T08:53:04.680 INFO:teuthology.orchestra.run.smithi172.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62446.log.gz 2024-04-25T08:53:04.680 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42659.log 2024-04-25T08:53:04.680 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84789.log 2024-04-25T08:53:04.680 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.0.50345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50345.log.gz 2024-04-25T08:53:04.680 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.42659.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T08:53:04.680 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42659.log.gz 2024-04-25T08:53:04.680 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91174.log 2024-04-25T08:53:04.681 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mds.a.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84789.log.gz 2024-04-25T08:53:04.681 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90493.log 2024-04-25T08:53:04.681 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91174.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.91174.log.gz 2024-04-25T08:53:04.681 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45702.log 2024-04-25T08:53:04.681 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.90493.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.90493.log.gz 2024-04-25T08:53:04.681 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96867.log 2024-04-25T08:53:04.681 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.45702.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45702.log.gz 2024-04-25T08:53:04.682 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46710.log 2024-04-25T08:53:04.682 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96867.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96867.log.gz 2024-04-25T08:53:04.682 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62152.log 2024-04-25T08:53:04.682 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46710.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46710.log.gz 2024-04-25T08:53:04.682 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67489.log 2024-04-25T08:53:04.682 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62152.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62152.log.gz 2024-04-25T08:53:04.682 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94447.log 2024-04-25T08:53:04.682 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67489.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67489.log.gz 2024-04-25T08:53:04.682 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85715.log 2024-04-25T08:53:04.683 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94447.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94447.log.gz 2024-04-25T08:53:04.683 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75909.log 2024-04-25T08:53:04.683 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85715.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.85715.log.gz 2024-04-25T08:53:04.683 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46374.log 2024-04-25T08:53:04.683 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75909.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75909.log.gz 2024-04-25T08:53:04.683 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96909.log 2024-04-25T08:53:04.683 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46374.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46374.log.gz 2024-04-25T08:53:04.683 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64402.log 2024-04-25T08:53:04.683 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96909.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96909.log.gz 2024-04-25T08:53:04.684 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40979.log 2024-04-25T08:53:04.684 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.64402.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64402.log.gz 2024-04-25T08:53:04.684 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95958.log 2024-04-25T08:53:04.684 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.40979.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40979.log.gz 2024-04-25T08:53:04.684 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44123.log 2024-04-25T08:53:04.684 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.95958.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95958.log.gz 2024-04-25T08:53:04.684 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84369.log 2024-04-25T08:53:04.684 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44123.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44123.log.gz 2024-04-25T08:53:04.684 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84747.log 2024-04-25T08:53:04.685 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84369.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84369.log.gz 2024-04-25T08:53:04.685 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57355.log 2024-04-25T08:53:04.685 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84747.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.84747.log.gz 2024-04-25T08:53:04.685 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61974.log 2024-04-25T08:53:04.685 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57355.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57355.log.gz 2024-04-25T08:53:04.685 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79148.log 2024-04-25T08:53:04.686 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61974.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61974.log.gz 2024-04-25T08:53:04.686 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46038.log 2024-04-25T08:53:04.686 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79148.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79148.log.gz 2024-04-25T08:53:04.686 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76501.log 2024-04-25T08:53:04.686 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46038.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46038.log.gz 2024-04-25T08:53:04.686 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48537.log 2024-04-25T08:53:04.686 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76501.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76501.log.gz 2024-04-25T08:53:04.687 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84453.log 2024-04-25T08:53:04.687 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48537.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48537.log.gz 2024-04-25T08:53:04.687 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92209.log 2024-04-25T08:53:04.687 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84453.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84453.log.gz 2024-04-25T08:53:04.687 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44459.log 2024-04-25T08:53:04.687 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.92209.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.92209.log.gz 2024-04-25T08:53:04.687 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83652.log 2024-04-25T08:53:04.687 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.44459.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44459.log.gz 2024-04-25T08:53:04.687 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66569.log 2024-04-25T08:53:04.688 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83652.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.83652.log.gz 2024-04-25T08:53:04.688 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62278.log 2024-04-25T08:53:04.688 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66569.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66569.log.gz 2024-04-25T08:53:04.688 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86063.log 2024-04-25T08:53:04.688 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62278.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62278.log.gz 2024-04-25T08:53:04.688 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2024-04-25T08:53:04.688 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.86063.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86063.log.gz 2024-04-25T08:53:04.688 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78909.log 2024-04-25T08:53:04.688 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.45954.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2024-04-25T08:53:04.689 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74236.log 2024-04-25T08:53:04.689 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.78909.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78909.log.gz 2024-04-25T08:53:04.689 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2024-04-25T08:53:04.689 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74236.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74236.log.gz 2024-04-25T08:53:04.689 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89486.log 2024-04-25T08:53:04.689 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48845.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2024-04-25T08:53:04.689 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100134.log 2024-04-25T08:53:04.689 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89486.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89486.log.gz 2024-04-25T08:53:04.689 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43199.log 2024-04-25T08:53:04.690 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100134.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100134.log.gz 2024-04-25T08:53:04.690 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57878.log 2024-04-25T08:53:04.690 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43199.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43199.log.gz 2024-04-25T08:53:04.690 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61177.log 2024-04-25T08:53:04.690 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57878.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57878.log.gz 2024-04-25T08:53:04.690 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62530.log 2024-04-25T08:53:04.690 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.61177.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61177.log.gz 2024-04-25T08:53:04.690 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57135.log 2024-04-25T08:53:04.691 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62530.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62530.log.gz 2024-04-25T08:53:04.691 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79326.log 2024-04-25T08:53:04.691 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.57135.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57135.log.gz 2024-04-25T08:53:04.691 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60637.log 2024-04-25T08:53:04.691 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79326.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79326.log.gz 2024-04-25T08:53:04.691 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47487.log 2024-04-25T08:53:04.691 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.60637.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.60637.log.gz 2024-04-25T08:53:04.691 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89276.log 2024-04-25T08:53:04.692 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.47487.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47487.log.gz 2024-04-25T08:53:04.692 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83460.log 2024-04-25T08:53:04.692 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.89276.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89276.log.gz 2024-04-25T08:53:04.692 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43381.log 2024-04-25T08:53:04.692 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83460.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.83460.log.gz 2024-04-25T08:53:04.692 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41549.log 2024-04-25T08:53:04.692 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.43381.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43381.log.gz 2024-04-25T08:53:04.692 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48243.log 2024-04-25T08:53:04.692 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.41549.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.41549.log.gz 2024-04-25T08:53:04.693 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85642.log 2024-04-25T08:53:04.693 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48243.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48243.log.gz 2024-04-25T08:53:04.693 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96204.log 2024-04-25T08:53:04.693 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85642.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85642.log.gz 2024-04-25T08:53:04.693 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46626.log 2024-04-25T08:53:04.693 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96204.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96204.log.gz 2024-04-25T08:53:04.693 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100493.log 2024-04-25T08:53:04.693 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.46626.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46626.log.gz 2024-04-25T08:53:04.694 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65836.log 2024-04-25T08:53:04.694 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100493.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.100493.log.gz 2024-04-25T08:53:04.694 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99658.log 2024-04-25T08:53:04.694 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65836.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65836.log.gz 2024-04-25T08:53:04.694 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66485.log 2024-04-25T08:53:04.694 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99658.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99658.log.gz 2024-04-25T08:53:04.694 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48579.log 2024-04-25T08:53:04.694 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.66485.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66485.log.gz 2024-04-25T08:53:04.695 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79536.log 2024-04-25T08:53:04.695 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48579.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48579.log.gz 2024-04-25T08:53:04.695 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96555.log 2024-04-25T08:53:04.695 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.79536.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79536.log.gz 2024-04-25T08:53:04.695 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94910.log 2024-04-25T08:53:04.695 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.96555.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96555.log.gz 2024-04-25T08:53:04.695 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85171.log 2024-04-25T08:53:04.695 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.94910.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94910.log.gz 2024-04-25T08:53:04.695 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80932.log 2024-04-25T08:53:04.696 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.85171.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.85171.log.gz 2024-04-25T08:53:04.696 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58557.log 2024-04-25T08:53:04.696 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80932.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80932.log.gz 2024-04-25T08:53:04.696 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75193.log 2024-04-25T08:53:04.696 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.58557.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58557.log.gz 2024-04-25T08:53:04.696 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62488.log 2024-04-25T08:53:04.696 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75193.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75193.log.gz 2024-04-25T08:53:04.696 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80890.log 2024-04-25T08:53:04.697 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62488.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62488.log.gz 2024-04-25T08:53:04.697 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74679.log 2024-04-25T08:53:04.697 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80890.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80890.log.gz 2024-04-25T08:53:04.697 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76669.log 2024-04-25T08:53:04.697 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74679.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74679.log.gz 2024-04-25T08:53:04.697 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62236.log 2024-04-25T08:53:04.697 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.76669.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76669.log.gz 2024-04-25T08:53:04.698 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65920.log 2024-04-25T08:53:04.698 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.62236.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62236.log.gz 2024-04-25T08:53:04.698 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48663.log 2024-04-25T08:53:04.698 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.65920.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65920.log.gz 2024-04-25T08:53:04.698 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99489.log 2024-04-25T08:53:04.698 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48663.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48663.log.gz 2024-04-25T08:53:04.698 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91647.log 2024-04-25T08:53:04.699 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.99489.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99489.log.gz 2024-04-25T08:53:04.699 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50046.log 2024-04-25T08:53:04.699 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91647.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91647.log.gz 2024-04-25T08:53:04.699 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75319.log 2024-04-25T08:53:04.699 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.50046.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50046.log.gz 2024-04-25T08:53:04.699 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91395.log 2024-04-25T08:53:04.699 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.75319.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75319.log.gz 2024-04-25T08:53:04.699 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80974.log 2024-04-25T08:53:04.700 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91395.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91395.log.gz 2024-04-25T08:53:04.700 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67133.log 2024-04-25T08:53:04.700 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.80974.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80974.log.gz 2024-04-25T08:53:04.700 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74302.log 2024-04-25T08:53:04.700 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67133.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67133.log.gz 2024-04-25T08:53:04.700 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91563.log 2024-04-25T08:53:04.700 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.74302.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.74302.log.gz 2024-04-25T08:53:04.701 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100032.log 2024-04-25T08:53:04.701 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.91563.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91563.log.gz 2024-04-25T08:53:04.701 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67303.log 2024-04-25T08:53:04.701 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.100032.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100032.log.gz 2024-04-25T08:53:04.701 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48075.log 2024-04-25T08:53:04.701 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.67303.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67303.log.gz 2024-04-25T08:53:04.701 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83352.log 2024-04-25T08:53:04.701 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.48075.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48075.log.gz 2024-04-25T08:53:04.701 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83928.log 2024-04-25T08:53:04.702 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83352.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.83352.log.gz 2024-04-25T08:53:04.702 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84874.log 2024-04-25T08:53:04.702 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.83928.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.83928.log.gz 2024-04-25T08:53:04.702 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.84874.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.84874.log.gz 2024-04-25T08:53:05.165 INFO:teuthology.orchestra.run.smithi172.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T08:53:06.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-25T08:53:06.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-25T08:53:06.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-25T08:53:06.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-25T08:53:07.847 INFO:teuthology.orchestra.run.smithi186.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T08:53:07.916 INFO:teuthology.orchestra.run.smithi186.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T08:53:08.062 INFO:teuthology.orchestra.run.smithi172.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T08:53:08.272 INFO:teuthology.orchestra.run.smithi172.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T08:53:08.302 INFO:teuthology.orchestra.run.smithi186.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T08:53:08.905 INFO:teuthology.orchestra.run.smithi186.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T08:53:09.636 INFO:teuthology.orchestra.run.smithi172.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T08:53:09.702 INFO:teuthology.orchestra.run.smithi186.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T08:53:09.703 INFO:teuthology.orchestra.run.smithi186.stderr: 2024-04-25T08:53:09.704 INFO:teuthology.orchestra.run.smithi186.stderr:real 0m5.648s 2024-04-25T08:53:09.704 INFO:teuthology.orchestra.run.smithi186.stderr:user 0m22.319s 2024-04-25T08:53:09.704 INFO:teuthology.orchestra.run.smithi186.stderr:sys 0m0.703s 2024-04-25T08:53:09.938 INFO:teuthology.orchestra.run.smithi172.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T08:53:26.147 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T08:53:26.585 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T08:53:26.588 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T08:53:26.588 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m22.555s 2024-04-25T08:53:26.588 INFO:teuthology.orchestra.run.smithi172.stderr:user 1m3.144s 2024-04-25T08:53:26.588 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m2.325s 2024-04-25T08:53:26.588 INFO:tasks.ceph:Archiving logs... 2024-04-25T08:53:26.589 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996/remote/smithi172/log 2024-04-25T08:53:26.590 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T08:53:35.865 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996/remote/smithi186/log 2024-04-25T08:53:35.866 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T08:53:39.146 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T08:53:39.155 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T08:53:39.156 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T08:53:39.158 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T08:53:39.253 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T08:53:39.262 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T08:53:39.263 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:53:39.266 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:53:39.280 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-04-25T08:53:39.282 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-04-25T08:53:39.284 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T08:53:39.285 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-04-25T08:53:39.285 INFO:teuthology.orchestra.run.smithi172.stdout:^- hv01.front.sepia.ceph.com 2 6 377 47 +1728us[+1728us] +/- 650ms 2024-04-25T08:53:39.285 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv02.front.sepia.ceph.com 3 6 377 48 -655us[ -655us] +/- 69ms 2024-04-25T08:53:39.285 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +750us[ +750us] +/- 66ms 2024-04-25T08:53:39.285 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:53:39.287 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T08:53:39.287 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-04-25T08:53:39.287 INFO:teuthology.orchestra.run.smithi186.stdout:^- hv01.front.sepia.ceph.com 2 6 377 50 +1689us[+1689us] +/- 650ms 2024-04-25T08:53:39.287 INFO:teuthology.orchestra.run.smithi186.stdout:^* hv02.front.sepia.ceph.com 3 6 377 50 -695us[ -678us] +/- 69ms 2024-04-25T08:53:39.288 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +692us[ +709us] +/- 65ms 2024-04-25T08:53:39.288 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T08:53:39.289 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T08:53:39.299 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T08:53:39.300 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T08:53:39.347 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T08:53:39.435 DEBUG:teuthology.orchestra.run.smithi186:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T08:53:39.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T08:53:39.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:53:39.534 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-25T08:53:39.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:53:39.564 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T08:53:39.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T08:53:39.592 INFO:teuthology.task.internal:Duration was 1038.551140 seconds 2024-04-25T08:53:39.593 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T08:53:39.604 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T08:53:39.604 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T08:53:39.607 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T08:53:39.645 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T08:53:39.667 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T08:53:40.001 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T08:53:40.001 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T08:53:40.001 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T08:53:40.062 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T08:53:40.062 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T08:53:40.086 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T08:53:40.087 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T08:53:40.104 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T08:53:40.153 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T08:53:40.153 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T08:53:40.171 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T08:53:40.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T08:53:40.313 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T08:53:40.313 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T08:53:40.337 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T08:53:40.360 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T08:53:40.372 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T08:53:40.380 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T08:53:40.399 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-04-25T08:53:40.422 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2024-04-25T08:53:40.434 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T08:53:40.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:53:40.472 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T08:53:40.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:53:40.489 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T08:53:40.500 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T08:53:40.500 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996/remote/smithi172 2024-04-25T08:53:40.501 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T08:53:40.548 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996/remote/smithi186 2024-04-25T08:53:40.548 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T08:53:40.580 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T08:53:40.581 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T08:53:40.584 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T08:53:40.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T08:53:40.641 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T08:53:40.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T08:53:40.653 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T08:53:40.653 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T08:53:40.656 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T08:53:40.668 INFO:teuthology.orchestra.run.smithi172.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 08:53 /home/ubuntu/cephtest 2024-04-25T08:53:40.683 INFO:teuthology.orchestra.run.smithi186.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 08:53 /home/ubuntu/cephtest 2024-04-25T08:53:40.685 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T08:53:40.696 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T08:53:40.720 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T08:53:40.747 DEBUG:teuthology.nuke:shortname: smithi172 2024-04-25T08:53:40.748 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T08:53:40.774 DEBUG:teuthology.nuke:shortname: smithi186 2024-04-25T08:53:40.774 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T08:53:40.778 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:30:37.658034', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBND9fJUld9x5na72sfQkSEimJBJvAjDa7OsLSDbNFMUDQxIScptMIJ+nUm5g9Bl/jROSTagzLS9QUm+Bc6JSHgE='} 2024-04-25T08:53:40.798 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:30:37.659292', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBML4himyrBcCjd9Rjkz7VPdj8BI3YujYkfAGYTGQ5IBM4NhLN2rUfEdpieu+te3s3XjFTMtZ8usHDaYuxL+oBaM='} 2024-04-25T08:53:40.830 INFO:teuthology.orchestra.console.smithi172:Power off 2024-04-25T08:53:40.831 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T08:53:40.856 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-04-25T08:53:40.856 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T08:53:40.875 INFO:teuthology.orchestra.console.smithi186:Power off 2024-04-25T08:53:40.876 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T08:53:40.887 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-25T08:53:40.902 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2024-04-25T08:53:40.902 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T08:53:40.927 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-04-25T08:53:44.888 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T08:53:44.928 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T08:53:44.999 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-25T08:53:45.039 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-04-25T08:53:49.002 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T08:53:49.040 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T08:53:49.114 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-25T08:53:49.151 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-04-25T08:53:49.215 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-04-25T08:53:53.152 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T08:53:53.262 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2024-04-25T08:53:53.363 INFO:teuthology.orchestra.console.smithi186:Power off completed 2024-04-25T08:53:53.468 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/scrub} duration: 1038.5511395931244 failure_reason: 'Test failure: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1fa5e528ac134db294f1f9e41e73d66b status: fail success: false 2024-04-25T08:53:53.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T08:53:53.558 INFO:teuthology.run:FAIL